2024-08-20T04:41:48.390 INFO:root:teuthology version: 1.2.0 2024-08-20T04:41:48.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-20T04:41:48.516 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861482 branch: wip-hemanth-testing-2024-08-19-1357 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} email: hyelloji@redhat.com first_in_suite: false job_id: '7861482' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-08-19-1357 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: ef4275410d8483698016fe484b2a3c664080b4c1 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: ef4275410d8483698016fe484b2a3c664080b4c1 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=secure - nowsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-08-19-1357 sha1: ef4275410d8483698016fe484b2a3c664080b4c1 owner: scheduled_hyelloji@teuthology priority: 10 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7244 sha1: ef4275410d8483698016fe484b2a3c664080b4c1 sleep_before_teardown: 0 suite: fs suite_branch: wip-hemanth-testing-2024-08-19-1357 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: ef4275410d8483698016fe484b2a3c664080b4c1 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMfbsEjZtLv6wkAIKNUY1ODFPjr0wQzC2gVHdDC9JQIH9pTJXIC0L0XOCrrDDBMv5E2hnUx9d/RMYiwXdLoVx7A= smithi130.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC27AggBjRtrgyfDiF8sDrZtq6/lAeUELSY7r2si6qjBjEC4GYhOIuZ71YKCPEBVEsxrbP/EJsCkJQmvThGuR2M= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAn21BD2jzYAEvfbmTLNSWuBOytyIGDvBwsbJqjlf9sgDc2PtQJuLGv+MNGPWON60Yz3zuLPirM3hoyqTHpCvNg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-19_19:57:23 tube: smithi user: hyelloji verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-20T04:41:48.516 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa; will attempt to use it 2024-08-20T04:41:48.517 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa/tasks 2024-08-20T04:41:48.517 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-20T04:41:48.518 INFO:teuthology.task.internal:Checking packages... 2024-08-20T04:41:48.539 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ef4275410d8483698016fe484b2a3c664080b4c1' 2024-08-20T04:41:48.539 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-20T04:41:48.539 INFO:teuthology.packaging:ref: None 2024-08-20T04:41:48.539 INFO:teuthology.packaging:tag: None 2024-08-20T04:41:48.539 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-08-19-1357 2024-08-20T04:41:48.539 INFO:teuthology.packaging:sha1: ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T04:41:48.540 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-08-19-1357 2024-08-20T04:41:48.684 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-5872.gef427541 2024-08-20T04:41:48.685 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-20T04:41:48.694 INFO:teuthology.task.internal:no buildpackages task found 2024-08-20T04:41:48.694 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-20T04:41:48.708 INFO:teuthology.task.internal:Saving configuration 2024-08-20T04:41:48.728 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-20T04:41:48.740 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-20T04:41:48.762 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861482', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-20 04:36:50.593741', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMfbsEjZtLv6wkAIKNUY1ODFPjr0wQzC2gVHdDC9JQIH9pTJXIC0L0XOCrrDDBMv5E2hnUx9d/RMYiwXdLoVx7A='} 2024-08-20T04:41:48.781 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi130.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861482', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-20 04:36:50.589234', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC27AggBjRtrgyfDiF8sDrZtq6/lAeUELSY7r2si6qjBjEC4GYhOIuZ71YKCPEBVEsxrbP/EJsCkJQmvThGuR2M='} 2024-08-20T04:41:48.807 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861482', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-20 04:36:50.591204', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAn21BD2jzYAEvfbmTLNSWuBOytyIGDvBwsbJqjlf9sgDc2PtQJuLGv+MNGPWON60Yz3zuLPirM3hoyqTHpCvNg='} 2024-08-20T04:41:48.807 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-20T04:41:48.819 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-08-20T04:41:48.819 INFO:teuthology.task.internal:roles: ubuntu@smithi130.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-08-20T04:41:48.819 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-08-20T04:41:48.819 INFO:teuthology.run_tasks:Running task console_log... 2024-08-20T04:41:48.911 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f719dfd3be0>, signals=[15]) 2024-08-20T04:41:48.911 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-20T04:41:48.920 INFO:teuthology.task.internal:Opening connections... 2024-08-20T04:41:48.920 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2024-08-20T04:41:48.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T04:41:48.998 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi130.front.sepia.ceph.com 2024-08-20T04:41:48.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T04:41:49.071 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-08-20T04:41:49.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T04:41:49.148 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-20T04:41:49.157 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-08-20T04:41:49.176 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-08-20T04:41:49.177 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-08-20T04:41:49.236 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-08-20T04:41:49.236 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-08-20T04:41:49.236 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-08-20T04:41:49.236 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-08-20T04:41:49.236 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-08-20T04:41:49.236 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-08-20T04:41:49.236 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-20T04:41:49.236 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-08-20T04:41:49.236 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-08-20T04:41:49.237 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-20T04:41:49.237 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-08-20T04:41:49.237 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-20T04:41:49.237 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-20T04:41:49.237 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-20T04:41:49.237 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-08-20T04:41:49.260 DEBUG:teuthology.orchestra.run.smithi130:> uname -m 2024-08-20T04:41:49.278 INFO:teuthology.orchestra.run.smithi130.stdout:x86_64 2024-08-20T04:41:49.278 DEBUG:teuthology.orchestra.run.smithi130:> cat /etc/os-release 2024-08-20T04:41:49.337 INFO:teuthology.orchestra.run.smithi130.stdout:NAME="CentOS Stream" 2024-08-20T04:41:49.337 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION="9" 2024-08-20T04:41:49.337 INFO:teuthology.orchestra.run.smithi130.stdout:ID="centos" 2024-08-20T04:41:49.337 INFO:teuthology.orchestra.run.smithi130.stdout:ID_LIKE="rhel fedora" 2024-08-20T04:41:49.338 INFO:teuthology.orchestra.run.smithi130.stdout:VERSION_ID="9" 2024-08-20T04:41:49.338 INFO:teuthology.orchestra.run.smithi130.stdout:PLATFORM_ID="platform:el9" 2024-08-20T04:41:49.338 INFO:teuthology.orchestra.run.smithi130.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-20T04:41:49.338 INFO:teuthology.orchestra.run.smithi130.stdout:ANSI_COLOR="0;31" 2024-08-20T04:41:49.338 INFO:teuthology.orchestra.run.smithi130.stdout:LOGO="fedora-logo-icon" 2024-08-20T04:41:49.338 INFO:teuthology.orchestra.run.smithi130.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-20T04:41:49.338 INFO:teuthology.orchestra.run.smithi130.stdout:HOME_URL="https://centos.org/" 2024-08-20T04:41:49.338 INFO:teuthology.orchestra.run.smithi130.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-20T04:41:49.338 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-20T04:41:49.338 INFO:teuthology.orchestra.run.smithi130.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-20T04:41:49.339 INFO:teuthology.lock.ops:Updating smithi130.front.sepia.ceph.com on lock server 2024-08-20T04:41:49.360 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-08-20T04:41:49.378 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-08-20T04:41:49.378 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-08-20T04:41:49.436 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-08-20T04:41:49.436 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-08-20T04:41:49.437 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-08-20T04:41:49.437 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-08-20T04:41:49.437 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-08-20T04:41:49.437 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-08-20T04:41:49.437 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-20T04:41:49.437 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-08-20T04:41:49.437 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-08-20T04:41:49.437 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-20T04:41:49.437 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-08-20T04:41:49.437 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-08-20T04:41:49.437 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-20T04:41:49.437 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-20T04:41:49.438 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-08-20T04:41:49.459 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-20T04:41:49.473 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-20T04:41:49.484 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-20T04:41:49.485 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2024-08-20T04:41:49.488 DEBUG:teuthology.orchestra.run.smithi130:> test '!' -e /home/ubuntu/cephtest 2024-08-20T04:41:49.490 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-08-20T04:41:49.507 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-20T04:41:49.515 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-20T04:41:49.516 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2024-08-20T04:41:49.544 DEBUG:teuthology.orchestra.run.smithi130:> test -z $(ls -A /var/lib/ceph) 2024-08-20T04:41:49.548 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-08-20T04:41:49.572 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-20T04:41:49.641 INFO:teuthology.run_tasks:Running task kernel... 2024-08-20T04:41:49.658 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-20T04:41:49.658 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-08-20T04:41:49.659 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-08-20T04:41:49.659 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-20T04:41:49.676 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T04:41:49.676 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-20T04:41:49.839 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7e35574567e19d2ca345caad671b98560d512bea 2024-08-20T04:41:49.839 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7e35574567e19d2ca345caad671b98560d512bea"... 2024-08-20T04:41:49.839 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-08-20T04:41:49.857 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-496.el9.x86_64 2024-08-20T04:41:49.857 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-496.el9.x86_64 vs 7e35574567e19d2ca345caad671b98560d512bea 2024-08-20T04:41:49.857 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-20T04:41:49.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum upgrade -y linux-firmware 2024-08-20T04:41:55.625 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 2.1 MB/s | 8.2 MB 00:03 2024-08-20T04:42:00.034 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 20 MB 00:03 2024-08-20T04:42:05.735 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.6 MB 00:01 2024-08-20T04:42:07.519 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 18 kB 00:00 2024-08-20T04:42:08.440 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 28 MB/s | 22 MB 00:00 2024-08-20T04:42:14.096 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 9.5 kB/s | 1.7 kB 00:00 2024-08-20T04:42:16.251 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-08-20T04:42:16.252 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-08-20T04:42:16.252 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-08-20T04:42:16.361 INFO:teuthology.task.kernel:Downloading kernel 7e35574567e19d2ca345caad671b98560d512bea on client.0... 2024-08-20T04:42:16.361 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7e35574567e19d2ca345caad671b98560d512bea 2024-08-20T04:42:16.507 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7e35574567e19d2ca345caad671b98560d512bea/centos/9/flavors/default/x86_64/ 2024-08-20T04:42:16.508 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7e35574567e1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7e35574567e19d2ca345caad671b98560d512bea/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-20T04:42:16.510 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi037.front.sepia.ceph.com to complete... 2024-08-20T04:42:25.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20 04:42:25 URL:https://2.chacra.ceph.com/r/kernel/testing/7e35574567e19d2ca345caad671b98560d512bea/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7e35574567e1-1.x86_64.rpm [360142159/360142159] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-20T04:42:25.825 INFO:teuthology.orchestra.run.smithi037.stderr:FINISHED --2024-08-20 04:42:25-- 2024-08-20T04:42:25.825 INFO:teuthology.orchestra.run.smithi037.stderr:Total wall clock time: 9.3s 2024-08-20T04:42:25.826 INFO:teuthology.orchestra.run.smithi037.stderr:Downloaded: 1 files, 343M in 9.0s (38.2 MB/s) 2024-08-20T04:42:25.829 INFO:teuthology.task.kernel:Installing kernel 7e35574567e19d2ca345caad671b98560d512bea on client.0... 2024-08-20T04:42:25.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-20T04:42:28.066 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying... ######################################## 2024-08-20T04:42:28.354 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing... ######################################## 2024-08-20T04:42:28.464 INFO:teuthology.orchestra.run.smithi037.stdout:Updating / installing... 2024-08-20T04:42:36.796 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-6.11.0_rc3_g7e35574567e1-1 ######################################## 2024-08-20T04:43:16.216 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-20T04:43:16.216 DEBUG:teuthology.orchestra.run.smithi037:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-20T04:43:16.301 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/System.map-6.11.0-rc3-g7e35574567e1 2024-08-20T04:43:16.301 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/config-6.11.0-rc3-g7e35574567e1 2024-08-20T04:43:16.301 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/vmlinuz-6.11.0-rc3-g7e35574567e1 2024-08-20T04:43:16.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1 2024-08-20T04:43:16.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/System.map 2024-08-20T04:43:16.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/config 2024-08-20T04:43:16.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel 2024-08-20T04:43:16.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch 2024-08-20T04:43:16.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86 2024-08-20T04:43:16.301 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto 2024-08-20T04:43:16.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-20T04:43:16.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-20T04:43:16.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-20T04:43:16.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-20T04:43:16.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-20T04:43:16.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-20T04:43:16.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-20T04:43:16.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-20T04:43:16.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-20T04:43:16.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-20T04:43:16.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-20T04:43:16.302 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-20T04:43:16.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-20T04:43:16.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-20T04:43:16.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-20T04:43:16.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-20T04:43:16.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-20T04:43:16.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-20T04:43:16.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-20T04:43:16.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-20T04:43:16.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/kernel 2024-08-20T04:43:16.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/kernel/cpu 2024-08-20T04:43:16.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/kernel/cpu/mce 2024-08-20T04:43:16.303 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-20T04:43:16.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/kvm 2024-08-20T04:43:16.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-20T04:43:16.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-20T04:43:16.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/arch/x86/kvm/kvm.ko 2024-08-20T04:43:16.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto 2024-08-20T04:43:16.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/ansi_cprng.ko 2024-08-20T04:43:16.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/anubis.ko 2024-08-20T04:43:16.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/arc4.ko 2024-08-20T04:43:16.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/async_tx 2024-08-20T04:43:16.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/async_tx/async_memcpy.ko 2024-08-20T04:43:16.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/async_tx/async_pq.ko 2024-08-20T04:43:16.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-20T04:43:16.304 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/async_tx/async_tx.ko 2024-08-20T04:43:16.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/async_tx/async_xor.ko 2024-08-20T04:43:16.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/async_tx/raid6test.ko 2024-08-20T04:43:16.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/authenc.ko 2024-08-20T04:43:16.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/authencesn.ko 2024-08-20T04:43:16.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/blake2b_generic.ko 2024-08-20T04:43:16.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/blowfish_common.ko 2024-08-20T04:43:16.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/blowfish_generic.ko 2024-08-20T04:43:16.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/camellia_generic.ko 2024-08-20T04:43:16.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/cast5_generic.ko 2024-08-20T04:43:16.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/cast6_generic.ko 2024-08-20T04:43:16.305 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/cast_common.ko 2024-08-20T04:43:16.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/ccm.ko 2024-08-20T04:43:16.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/cmac.ko 2024-08-20T04:43:16.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/crc32_generic.ko 2024-08-20T04:43:16.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/crypto_engine.ko 2024-08-20T04:43:16.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/crypto_user.ko 2024-08-20T04:43:16.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/cts.ko 2024-08-20T04:43:16.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/des_generic.ko 2024-08-20T04:43:16.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/dh_generic.ko 2024-08-20T04:43:16.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/ecc.ko 2024-08-20T04:43:16.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/ecdh_generic.ko 2024-08-20T04:43:16.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/echainiv.ko 2024-08-20T04:43:16.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/essiv.ko 2024-08-20T04:43:16.306 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/fcrypt.ko 2024-08-20T04:43:16.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/khazad.ko 2024-08-20T04:43:16.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/lz4.ko 2024-08-20T04:43:16.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/lz4hc.ko 2024-08-20T04:43:16.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/md4.ko 2024-08-20T04:43:16.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/michael_mic.ko 2024-08-20T04:43:16.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/pcbc.ko 2024-08-20T04:43:16.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/pcrypt.ko 2024-08-20T04:43:16.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/rmd160.ko 2024-08-20T04:43:16.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/seed.ko 2024-08-20T04:43:16.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/serpent_generic.ko 2024-08-20T04:43:16.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/tcrypt.ko 2024-08-20T04:43:16.307 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/tea.ko 2024-08-20T04:43:16.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/twofish_common.ko 2024-08-20T04:43:16.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/twofish_generic.ko 2024-08-20T04:43:16.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/vmac.ko 2024-08-20T04:43:16.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/wp512.ko 2024-08-20T04:43:16.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/xcbc.ko 2024-08-20T04:43:16.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/xor.ko 2024-08-20T04:43:16.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/crypto/xxhash_generic.ko 2024-08-20T04:43:16.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers 2024-08-20T04:43:16.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/acpi 2024-08-20T04:43:16.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-20T04:43:16.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/acpi/acpi_pad.ko 2024-08-20T04:43:16.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/acpi/ec_sys.ko 2024-08-20T04:43:16.308 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/acpi/platform_profile.ko 2024-08-20T04:43:16.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/acpi/sbs.ko 2024-08-20T04:43:16.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/acpi/sbshc.ko 2024-08-20T04:43:16.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/acpi/video.ko 2024-08-20T04:43:16.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata 2024-08-20T04:43:16.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/acard-ahci.ko 2024-08-20T04:43:16.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/ahci_platform.ko 2024-08-20T04:43:16.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/ata_generic.ko 2024-08-20T04:43:16.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/libahci_platform.ko 2024-08-20T04:43:16.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_acpi.ko 2024-08-20T04:43:16.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_ali.ko 2024-08-20T04:43:16.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_amd.ko 2024-08-20T04:43:16.309 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_artop.ko 2024-08-20T04:43:16.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_atiixp.ko 2024-08-20T04:43:16.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_atp867x.ko 2024-08-20T04:43:16.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_cmd640.ko 2024-08-20T04:43:16.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_cmd64x.ko 2024-08-20T04:43:16.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_cypress.ko 2024-08-20T04:43:16.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_efar.ko 2024-08-20T04:43:16.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_hpt366.ko 2024-08-20T04:43:16.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_hpt37x.ko 2024-08-20T04:43:16.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-20T04:43:16.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-20T04:43:16.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_it8213.ko 2024-08-20T04:43:16.310 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_it821x.ko 2024-08-20T04:43:16.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_jmicron.ko 2024-08-20T04:43:16.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_marvell.ko 2024-08-20T04:43:16.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_mpiix.ko 2024-08-20T04:43:16.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_netcell.ko 2024-08-20T04:43:16.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_ninja32.ko 2024-08-20T04:43:16.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_ns87410.ko 2024-08-20T04:43:16.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_ns87415.ko 2024-08-20T04:43:16.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_oldpiix.ko 2024-08-20T04:43:16.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_opti.ko 2024-08-20T04:43:16.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_optidma.ko 2024-08-20T04:43:16.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_pcmcia.ko 2024-08-20T04:43:16.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-20T04:43:16.311 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-20T04:43:16.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_piccolo.ko 2024-08-20T04:43:16.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_rdc.ko 2024-08-20T04:43:16.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_sch.ko 2024-08-20T04:43:16.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_serverworks.ko 2024-08-20T04:43:16.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_sil680.ko 2024-08-20T04:43:16.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_sis.ko 2024-08-20T04:43:16.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_sl82c105.ko 2024-08-20T04:43:16.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_triflex.ko 2024-08-20T04:43:16.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pata_via.ko 2024-08-20T04:43:16.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/pdc_adma.ko 2024-08-20T04:43:16.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/sata_inic162x.ko 2024-08-20T04:43:16.312 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/sata_mv.ko 2024-08-20T04:43:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/sata_nv.ko 2024-08-20T04:43:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/sata_promise.ko 2024-08-20T04:43:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/sata_qstor.ko 2024-08-20T04:43:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/sata_sil.ko 2024-08-20T04:43:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/sata_sil24.ko 2024-08-20T04:43:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/sata_sis.ko 2024-08-20T04:43:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/sata_svw.ko 2024-08-20T04:43:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/sata_sx4.ko 2024-08-20T04:43:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/sata_uli.ko 2024-08-20T04:43:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/sata_via.ko 2024-08-20T04:43:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ata/sata_vsc.ko 2024-08-20T04:43:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/auxdisplay 2024-08-20T04:43:16.313 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/auxdisplay/ks0108.ko 2024-08-20T04:43:16.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/base 2024-08-20T04:43:16.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/base/regmap 2024-08-20T04:43:16.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-20T04:43:16.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-20T04:43:16.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/bcma 2024-08-20T04:43:16.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/bcma/bcma.ko 2024-08-20T04:43:16.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block 2024-08-20T04:43:16.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/aoe 2024-08-20T04:43:16.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/aoe/aoe.ko 2024-08-20T04:43:16.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/brd.ko 2024-08-20T04:43:16.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/drbd 2024-08-20T04:43:16.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/drbd/drbd.ko 2024-08-20T04:43:16.314 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/floppy.ko 2024-08-20T04:43:16.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/loop.ko 2024-08-20T04:43:16.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/mtip32xx 2024-08-20T04:43:16.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-20T04:43:16.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/nbd.ko 2024-08-20T04:43:16.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/null_blk 2024-08-20T04:43:16.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/null_blk/null_blk.ko 2024-08-20T04:43:16.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/pktcdvd.ko 2024-08-20T04:43:16.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/rbd.ko 2024-08-20T04:43:16.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/virtio_blk.ko 2024-08-20T04:43:16.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/xen-blkback 2024-08-20T04:43:16.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-20T04:43:16.315 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/xen-blkfront.ko 2024-08-20T04:43:16.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/zram 2024-08-20T04:43:16.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/block/zram/zram.ko 2024-08-20T04:43:16.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char 2024-08-20T04:43:16.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/hangcheck-timer.ko 2024-08-20T04:43:16.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/hw_random 2024-08-20T04:43:16.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-20T04:43:16.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-20T04:43:16.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-20T04:43:16.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/hw_random/via-rng.ko 2024-08-20T04:43:16.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-20T04:43:16.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/ipmi 2024-08-20T04:43:16.316 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-20T04:43:16.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-20T04:43:16.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-20T04:43:16.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-20T04:43:16.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-20T04:43:16.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-20T04:43:16.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/lp.ko 2024-08-20T04:43:16.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/mwave 2024-08-20T04:43:16.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/mwave/mwave.ko 2024-08-20T04:43:16.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/ppdev.ko 2024-08-20T04:43:16.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/tlclk.ko 2024-08-20T04:43:16.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/tpm 2024-08-20T04:43:16.317 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/tpm/tpm.ko 2024-08-20T04:43:16.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-20T04:43:16.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-20T04:43:16.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-20T04:43:16.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-20T04:43:16.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-20T04:43:16.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/uv_mmtimer.ko 2024-08-20T04:43:16.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/char/virtio_console.ko 2024-08-20T04:43:16.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/cpufreq 2024-08-20T04:43:16.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-20T04:43:16.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-20T04:43:16.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-20T04:43:16.318 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-20T04:43:16.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-20T04:43:16.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-20T04:43:16.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/crypto 2024-08-20T04:43:16.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/crypto/ccp 2024-08-20T04:43:16.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-20T04:43:16.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/crypto/ccp/ccp.ko 2024-08-20T04:43:16.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/crypto/intel 2024-08-20T04:43:16.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/crypto/intel/qat 2024-08-20T04:43:16.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/crypto/intel/qat/qat_common 2024-08-20T04:43:16.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-20T04:43:16.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-20T04:43:16.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-20T04:43:16.319 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/crypto/padlock-aes.ko 2024-08-20T04:43:16.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/crypto/padlock-sha.ko 2024-08-20T04:43:16.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/crypto/virtio 2024-08-20T04:43:16.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-20T04:43:16.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/dca 2024-08-20T04:43:16.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/dca/dca.ko 2024-08-20T04:43:16.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/devfreq 2024-08-20T04:43:16.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-20T04:43:16.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/dma 2024-08-20T04:43:16.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/dma/dw 2024-08-20T04:43:16.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-20T04:43:16.320 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/dma/ioat 2024-08-20T04:43:16.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-20T04:43:16.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/edac 2024-08-20T04:43:16.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/edac/amd64_edac.ko 2024-08-20T04:43:16.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/edac/e752x_edac.ko 2024-08-20T04:43:16.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/edac/edac_mce_amd.ko 2024-08-20T04:43:16.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/edac/i3000_edac.ko 2024-08-20T04:43:16.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/edac/i3200_edac.ko 2024-08-20T04:43:16.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/edac/i5100_edac.ko 2024-08-20T04:43:16.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/edac/i5400_edac.ko 2024-08-20T04:43:16.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/edac/i7300_edac.ko 2024-08-20T04:43:16.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/edac/i7core_edac.ko 2024-08-20T04:43:16.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/edac/i82975x_edac.ko 2024-08-20T04:43:16.321 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/edac/ie31200_edac.ko 2024-08-20T04:43:16.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/edac/sb_edac.ko 2024-08-20T04:43:16.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/edac/x38_edac.ko 2024-08-20T04:43:16.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/firmware 2024-08-20T04:43:16.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/firmware/edd.ko 2024-08-20T04:43:16.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-20T04:43:16.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/gpio 2024-08-20T04:43:16.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/gpio/gpio-ich.ko 2024-08-20T04:43:16.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-20T04:43:16.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid 2024-08-20T04:43:16.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-appleir.ko 2024-08-20T04:43:16.322 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-aureal.ko 2024-08-20T04:43:16.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-axff.ko 2024-08-20T04:43:16.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-dr.ko 2024-08-20T04:43:16.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-elecom.ko 2024-08-20T04:43:16.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-elo.ko 2024-08-20T04:43:16.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-emsff.ko 2024-08-20T04:43:16.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-gaff.ko 2024-08-20T04:43:16.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-gt683r.ko 2024-08-20T04:43:16.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-gyration.ko 2024-08-20T04:43:16.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-20T04:43:16.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-20T04:43:16.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-holtekff.ko 2024-08-20T04:43:16.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-hyperv.ko 2024-08-20T04:43:16.323 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-icade.ko 2024-08-20T04:43:16.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-keytouch.ko 2024-08-20T04:43:16.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-kye.ko 2024-08-20T04:43:16.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-lcpower.ko 2024-08-20T04:43:16.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-led.ko 2024-08-20T04:43:16.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-lenovo.ko 2024-08-20T04:43:16.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-20T04:43:16.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-20T04:43:16.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-multitouch.ko 2024-08-20T04:43:16.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-ortek.ko 2024-08-20T04:43:16.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-penmount.ko 2024-08-20T04:43:16.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-petalynx.ko 2024-08-20T04:43:16.324 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-picolcd.ko 2024-08-20T04:43:16.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-pl.ko 2024-08-20T04:43:16.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-plantronics.ko 2024-08-20T04:43:16.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-primax.ko 2024-08-20T04:43:16.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-rmi.ko 2024-08-20T04:43:16.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-20T04:43:16.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-roccat-common.ko 2024-08-20T04:43:16.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-20T04:43:16.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-20T04:43:16.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-20T04:43:16.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-20T04:43:16.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-20T04:43:16.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-20T04:43:16.325 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-20T04:43:16.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-20T04:43:16.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-20T04:43:16.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-roccat.ko 2024-08-20T04:43:16.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-saitek.ko 2024-08-20T04:43:16.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-samsung.ko 2024-08-20T04:43:16.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-20T04:43:16.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-sjoy.ko 2024-08-20T04:43:16.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-sony.ko 2024-08-20T04:43:16.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-speedlink.ko 2024-08-20T04:43:16.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-steelseries.ko 2024-08-20T04:43:16.326 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-sunplus.ko 2024-08-20T04:43:16.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-20T04:43:16.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-tivo.ko 2024-08-20T04:43:16.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-tmff.ko 2024-08-20T04:43:16.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-topseed.ko 2024-08-20T04:43:16.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-twinhan.ko 2024-08-20T04:43:16.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-uclogic.ko 2024-08-20T04:43:16.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-waltop.ko 2024-08-20T04:43:16.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-wiimote.ko 2024-08-20T04:43:16.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-xinmo.ko 2024-08-20T04:43:16.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-zpff.ko 2024-08-20T04:43:16.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/hid-zydacron.ko 2024-08-20T04:43:16.327 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/uhid.ko 2024-08-20T04:43:16.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hid/wacom.ko 2024-08-20T04:43:16.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hv 2024-08-20T04:43:16.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hv/hv_balloon.ko 2024-08-20T04:43:16.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hv/hv_utils.ko 2024-08-20T04:43:16.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hv/hv_vmbus.ko 2024-08-20T04:43:16.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon 2024-08-20T04:43:16.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/abituguru.ko 2024-08-20T04:43:16.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/abituguru3.ko 2024-08-20T04:43:16.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-20T04:43:16.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/ad7414.ko 2024-08-20T04:43:16.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/ad7418.ko 2024-08-20T04:43:16.328 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/adc128d818.ko 2024-08-20T04:43:16.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/adm1025.ko 2024-08-20T04:43:16.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/adm1026.ko 2024-08-20T04:43:16.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/adm1029.ko 2024-08-20T04:43:16.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/adm1031.ko 2024-08-20T04:43:16.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/adm9240.ko 2024-08-20T04:43:16.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/ads7828.ko 2024-08-20T04:43:16.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/adt7410.ko 2024-08-20T04:43:16.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/adt7411.ko 2024-08-20T04:43:16.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/adt7462.ko 2024-08-20T04:43:16.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/adt7470.ko 2024-08-20T04:43:16.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/adt7475.ko 2024-08-20T04:43:16.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/adt7x10.ko 2024-08-20T04:43:16.329 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/amc6821.ko 2024-08-20T04:43:16.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/applesmc.ko 2024-08-20T04:43:16.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/asb100.ko 2024-08-20T04:43:16.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/asc7621.ko 2024-08-20T04:43:16.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-20T04:43:16.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/atxp1.ko 2024-08-20T04:43:16.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/coretemp.ko 2024-08-20T04:43:16.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-20T04:43:16.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/dme1737.ko 2024-08-20T04:43:16.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/ds1621.ko 2024-08-20T04:43:16.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/ds620.ko 2024-08-20T04:43:16.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/emc1403.ko 2024-08-20T04:43:16.330 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/emc6w201.ko 2024-08-20T04:43:16.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/f71805f.ko 2024-08-20T04:43:16.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/f71882fg.ko 2024-08-20T04:43:16.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/f75375s.ko 2024-08-20T04:43:16.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/fam15h_power.ko 2024-08-20T04:43:16.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/fschmd.ko 2024-08-20T04:43:16.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/g760a.ko 2024-08-20T04:43:16.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/g762.ko 2024-08-20T04:43:16.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/gl518sm.ko 2024-08-20T04:43:16.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/gl520sm.ko 2024-08-20T04:43:16.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-20T04:43:16.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/i5500_temp.ko 2024-08-20T04:43:16.331 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/i5k_amb.ko 2024-08-20T04:43:16.332 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/ibmaem.ko 2024-08-20T04:43:16.332 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/ibmpex.ko 2024-08-20T04:43:16.332 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/ina209.ko 2024-08-20T04:43:16.332 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/ina2xx.ko 2024-08-20T04:43:16.332 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/it87.ko 2024-08-20T04:43:16.332 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/k10temp.ko 2024-08-20T04:43:16.332 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/k8temp.ko 2024-08-20T04:43:16.332 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/lineage-pem.ko 2024-08-20T04:43:16.332 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/lm63.ko 2024-08-20T04:43:16.332 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/lm73.ko 2024-08-20T04:43:16.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/lm75.ko 2024-08-20T04:43:16.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/lm77.ko 2024-08-20T04:43:16.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/lm78.ko 2024-08-20T04:43:16.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/lm80.ko 2024-08-20T04:43:16.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/lm83.ko 2024-08-20T04:43:16.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/lm85.ko 2024-08-20T04:43:16.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/lm87.ko 2024-08-20T04:43:16.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/lm90.ko 2024-08-20T04:43:16.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/lm92.ko 2024-08-20T04:43:16.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/lm93.ko 2024-08-20T04:43:16.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/lm95234.ko 2024-08-20T04:43:16.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/lm95241.ko 2024-08-20T04:43:16.333 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/lm95245.ko 2024-08-20T04:43:16.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/ltc2945.ko 2024-08-20T04:43:16.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/ltc4151.ko 2024-08-20T04:43:16.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/ltc4215.ko 2024-08-20T04:43:16.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/ltc4222.ko 2024-08-20T04:43:16.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/ltc4245.ko 2024-08-20T04:43:16.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/ltc4260.ko 2024-08-20T04:43:16.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/ltc4261.ko 2024-08-20T04:43:16.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/max16065.ko 2024-08-20T04:43:16.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/max1619.ko 2024-08-20T04:43:16.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/max1668.ko 2024-08-20T04:43:16.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/max197.ko 2024-08-20T04:43:16.334 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/max6639.ko 2024-08-20T04:43:16.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/max6650.ko 2024-08-20T04:43:16.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/max6697.ko 2024-08-20T04:43:16.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/mcp3021.ko 2024-08-20T04:43:16.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/nct6683.ko 2024-08-20T04:43:16.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/nct6775-core.ko 2024-08-20T04:43:16.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/nct6775.ko 2024-08-20T04:43:16.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/nct7802.ko 2024-08-20T04:43:16.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/pc87360.ko 2024-08-20T04:43:16.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/pc87427.ko 2024-08-20T04:43:16.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/pcf8591.ko 2024-08-20T04:43:16.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/pmbus 2024-08-20T04:43:16.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-20T04:43:16.335 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-20T04:43:16.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-20T04:43:16.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-20T04:43:16.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-20T04:43:16.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-20T04:43:16.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-20T04:43:16.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-20T04:43:16.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-20T04:43:16.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-20T04:43:16.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-20T04:43:16.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-20T04:43:16.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/powr1220.ko 2024-08-20T04:43:16.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/sch5627.ko 2024-08-20T04:43:16.336 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/sch5636.ko 2024-08-20T04:43:16.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-20T04:43:16.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/sht15.ko 2024-08-20T04:43:16.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/sht21.ko 2024-08-20T04:43:16.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/shtc1.ko 2024-08-20T04:43:16.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/sis5595.ko 2024-08-20T04:43:16.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/smsc47b397.ko 2024-08-20T04:43:16.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/smsc47m1.ko 2024-08-20T04:43:16.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/smsc47m192.ko 2024-08-20T04:43:16.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/thmc50.ko 2024-08-20T04:43:16.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/tmp102.ko 2024-08-20T04:43:16.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/tmp103.ko 2024-08-20T04:43:16.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/tmp401.ko 2024-08-20T04:43:16.337 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/tmp421.ko 2024-08-20T04:43:16.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/via-cputemp.ko 2024-08-20T04:43:16.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/via686a.ko 2024-08-20T04:43:16.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/vt1211.ko 2024-08-20T04:43:16.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/vt8231.ko 2024-08-20T04:43:16.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/w83627ehf.ko 2024-08-20T04:43:16.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/w83627hf.ko 2024-08-20T04:43:16.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/w83781d.ko 2024-08-20T04:43:16.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/w83791d.ko 2024-08-20T04:43:16.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/w83792d.ko 2024-08-20T04:43:16.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/w83793.ko 2024-08-20T04:43:16.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/w83795.ko 2024-08-20T04:43:16.338 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/w83l785ts.ko 2024-08-20T04:43:16.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/hwmon/w83l786ng.ko 2024-08-20T04:43:16.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c 2024-08-20T04:43:16.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/algos 2024-08-20T04:43:16.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-20T04:43:16.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-20T04:43:16.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses 2024-08-20T04:43:16.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-20T04:43:16.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-20T04:43:16.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-20T04:43:16.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-20T04:43:16.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-20T04:43:16.339 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-20T04:43:16.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-20T04:43:16.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-20T04:43:16.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-20T04:43:16.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-20T04:43:16.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-20T04:43:16.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-20T04:43:16.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-20T04:43:16.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-20T04:43:16.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-20T04:43:16.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-20T04:43:16.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-20T04:43:16.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-20T04:43:16.340 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-20T04:43:16.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-20T04:43:16.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-20T04:43:16.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-20T04:43:16.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-20T04:43:16.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/i2c-dev.ko 2024-08-20T04:43:16.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/i2c-mux.ko 2024-08-20T04:43:16.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-20T04:43:16.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/i2c-smbus.ko 2024-08-20T04:43:16.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/i2c/i2c-stub.ko 2024-08-20T04:43:16.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband 2024-08-20T04:43:16.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/core 2024-08-20T04:43:16.341 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-20T04:43:16.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/core/ib_core.ko 2024-08-20T04:43:16.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-20T04:43:16.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-20T04:43:16.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-20T04:43:16.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-20T04:43:16.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-20T04:43:16.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/hw 2024-08-20T04:43:16.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/hw/cxgb4 2024-08-20T04:43:16.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-20T04:43:16.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/hw/mlx4 2024-08-20T04:43:16.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-20T04:43:16.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/hw/mlx5 2024-08-20T04:43:16.342 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-20T04:43:16.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/hw/mthca 2024-08-20T04:43:16.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-20T04:43:16.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/ulp 2024-08-20T04:43:16.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/ulp/ipoib 2024-08-20T04:43:16.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-20T04:43:16.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/ulp/iser 2024-08-20T04:43:16.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-20T04:43:16.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/ulp/isert 2024-08-20T04:43:16.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-20T04:43:16.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/ulp/srp 2024-08-20T04:43:16.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-20T04:43:16.343 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/ulp/srpt 2024-08-20T04:43:16.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-20T04:43:16.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input 2024-08-20T04:43:16.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/gameport 2024-08-20T04:43:16.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-20T04:43:16.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-20T04:43:16.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/gameport/gameport.ko 2024-08-20T04:43:16.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/joydev.ko 2024-08-20T04:43:16.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/keyboard 2024-08-20T04:43:16.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-20T04:43:16.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/mouse 2024-08-20T04:43:16.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/mouse/appletouch.ko 2024-08-20T04:43:16.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/mouse/bcm5974.ko 2024-08-20T04:43:16.344 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/mouse/cyapatp.ko 2024-08-20T04:43:16.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-20T04:43:16.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/mouse/sermouse.ko 2024-08-20T04:43:16.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-20T04:43:16.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-20T04:43:16.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-20T04:43:16.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/rmi4 2024-08-20T04:43:16.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-20T04:43:16.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/serio 2024-08-20T04:43:16.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/serio/altera_ps2.ko 2024-08-20T04:43:16.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/serio/arc_ps2.ko 2024-08-20T04:43:16.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-20T04:43:16.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/serio/serio_raw.ko 2024-08-20T04:43:16.345 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/input/sparse-keymap.ko 2024-08-20T04:43:16.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/leds 2024-08-20T04:43:16.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/leds/leds-blinkm.ko 2024-08-20T04:43:16.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/leds/leds-lm3530.ko 2024-08-20T04:43:16.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/leds/leds-lp3944.ko 2024-08-20T04:43:16.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/leds/leds-ss4200.ko 2024-08-20T04:43:16.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/leds/trigger 2024-08-20T04:43:16.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-20T04:43:16.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-20T04:43:16.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-20T04:43:16.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-20T04:43:16.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-20T04:43:16.346 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-20T04:43:16.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-20T04:43:16.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-20T04:43:16.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md 2024-08-20T04:43:16.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/bcache 2024-08-20T04:43:16.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/bcache/bcache.ko 2024-08-20T04:43:16.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/dm-bio-prison.ko 2024-08-20T04:43:16.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/dm-cache-smq.ko 2024-08-20T04:43:16.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/dm-cache.ko 2024-08-20T04:43:16.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/dm-crypt.ko 2024-08-20T04:43:16.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/dm-delay.ko 2024-08-20T04:43:16.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/dm-flakey.ko 2024-08-20T04:43:16.347 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/dm-log-userspace.ko 2024-08-20T04:43:16.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/dm-multipath.ko 2024-08-20T04:43:16.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/dm-queue-length.ko 2024-08-20T04:43:16.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/dm-raid.ko 2024-08-20T04:43:16.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/dm-round-robin.ko 2024-08-20T04:43:16.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/dm-service-time.ko 2024-08-20T04:43:16.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/dm-switch.ko 2024-08-20T04:43:16.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/dm-thin-pool.ko 2024-08-20T04:43:16.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/dm-verity.ko 2024-08-20T04:43:16.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/persistent-data 2024-08-20T04:43:16.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-20T04:43:16.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/raid0.ko 2024-08-20T04:43:16.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/raid1.ko 2024-08-20T04:43:16.348 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/raid10.ko 2024-08-20T04:43:16.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/md/raid456.ko 2024-08-20T04:43:16.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/message 2024-08-20T04:43:16.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/message/fusion 2024-08-20T04:43:16.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/message/fusion/mptbase.ko 2024-08-20T04:43:16.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/message/fusion/mptctl.ko 2024-08-20T04:43:16.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/message/fusion/mptfc.ko 2024-08-20T04:43:16.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/message/fusion/mptlan.ko 2024-08-20T04:43:16.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/message/fusion/mptsas.ko 2024-08-20T04:43:16.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/message/fusion/mptscsih.ko 2024-08-20T04:43:16.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/message/fusion/mptspi.ko 2024-08-20T04:43:16.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/mfd 2024-08-20T04:43:16.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/mfd/lpc_ich.ko 2024-08-20T04:43:16.349 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/mfd/lpc_sch.ko 2024-08-20T04:43:16.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/mfd/mfd-core.ko 2024-08-20T04:43:16.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/mfd/sm501.ko 2024-08-20T04:43:16.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/mfd/viperboard.ko 2024-08-20T04:43:16.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/mfd/vx855.ko 2024-08-20T04:43:16.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/mfd/wl1273-core.ko 2024-08-20T04:43:16.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc 2024-08-20T04:43:16.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/altera-stapl 2024-08-20T04:43:16.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-20T04:43:16.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/apds9802als.ko 2024-08-20T04:43:16.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/apds990x.ko 2024-08-20T04:43:16.350 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/bh1770glc.ko 2024-08-20T04:43:16.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/cb710 2024-08-20T04:43:16.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/cb710/cb710.ko 2024-08-20T04:43:16.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/eeprom 2024-08-20T04:43:16.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/eeprom/at24.ko 2024-08-20T04:43:16.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-20T04:43:16.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/eeprom/max6875.ko 2024-08-20T04:43:16.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/enclosure.ko 2024-08-20T04:43:16.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/hpilo.ko 2024-08-20T04:43:16.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/isl29003.ko 2024-08-20T04:43:16.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/isl29020.ko 2024-08-20T04:43:16.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/lis3lv02d 2024-08-20T04:43:16.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-20T04:43:16.351 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-20T04:43:16.352 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/mei 2024-08-20T04:43:16.352 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/mei/mei-me.ko 2024-08-20T04:43:16.352 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/mei/mei-txe.ko 2024-08-20T04:43:16.352 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/mei/mei.ko 2024-08-20T04:43:16.352 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/sgi-gru 2024-08-20T04:43:16.352 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-20T04:43:16.352 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/sgi-xp 2024-08-20T04:43:16.352 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-20T04:43:16.352 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-20T04:43:16.353 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-20T04:43:16.353 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/tifm_7xx1.ko 2024-08-20T04:43:16.353 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/tifm_core.ko 2024-08-20T04:43:16.353 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/tsl2550.ko 2024-08-20T04:43:16.353 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/vmw_balloon.ko 2024-08-20T04:43:16.353 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/vmw_vmci 2024-08-20T04:43:16.354 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-20T04:43:16.354 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net 2024-08-20T04:43:16.354 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/bonding 2024-08-20T04:43:16.354 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/bonding/bonding.ko 2024-08-20T04:43:16.354 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/dsa 2024-08-20T04:43:16.354 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/dsa/b53 2024-08-20T04:43:16.355 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-20T04:43:16.355 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-20T04:43:16.355 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-20T04:43:16.355 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/dsa/mv88e6xxx 2024-08-20T04:43:16.355 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-20T04:43:16.355 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/dummy.ko 2024-08-20T04:43:16.355 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/eql.ko 2024-08-20T04:43:16.356 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet 2024-08-20T04:43:16.356 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/3com 2024-08-20T04:43:16.356 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-20T04:43:16.356 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-20T04:43:16.356 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-20T04:43:16.356 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-20T04:43:16.356 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/8390 2024-08-20T04:43:16.357 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-20T04:43:16.357 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-20T04:43:16.357 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-20T04:43:16.357 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-20T04:43:16.357 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/adaptec 2024-08-20T04:43:16.357 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-20T04:43:16.357 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/agere 2024-08-20T04:43:16.358 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-20T04:43:16.358 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/alteon 2024-08-20T04:43:16.358 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-20T04:43:16.358 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/altera 2024-08-20T04:43:16.358 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-20T04:43:16.358 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/amd 2024-08-20T04:43:16.359 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-20T04:43:16.359 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-20T04:43:16.359 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-20T04:43:16.359 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/atheros 2024-08-20T04:43:16.359 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/atheros/alx 2024-08-20T04:43:16.359 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-20T04:43:16.360 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-20T04:43:16.360 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-20T04:43:16.360 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-20T04:43:16.360 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-20T04:43:16.360 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/atheros/atlx 2024-08-20T04:43:16.360 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-20T04:43:16.361 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-20T04:43:16.361 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/broadcom 2024-08-20T04:43:16.361 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-20T04:43:16.361 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-20T04:43:16.361 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-20T04:43:16.361 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-20T04:43:16.362 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-20T04:43:16.362 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/broadcom/genet 2024-08-20T04:43:16.362 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-20T04:43:16.362 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-20T04:43:16.362 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/brocade 2024-08-20T04:43:16.362 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/brocade/bna 2024-08-20T04:43:16.362 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-20T04:43:16.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/chelsio 2024-08-20T04:43:16.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-20T04:43:16.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-20T04:43:16.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-20T04:43:16.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-20T04:43:16.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-20T04:43:16.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-20T04:43:16.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-20T04:43:16.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-20T04:43:16.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-20T04:43:16.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-20T04:43:16.363 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/cisco 2024-08-20T04:43:16.364 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/cisco/enic 2024-08-20T04:43:16.364 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-20T04:43:16.364 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/dec 2024-08-20T04:43:16.364 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/dec/tulip 2024-08-20T04:43:16.364 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-20T04:43:16.364 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-20T04:43:16.364 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-20T04:43:16.365 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-20T04:43:16.365 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-20T04:43:16.365 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-20T04:43:16.365 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/dlink 2024-08-20T04:43:16.365 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-20T04:43:16.366 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-20T04:43:16.366 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/dnet.ko 2024-08-20T04:43:16.366 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/emulex 2024-08-20T04:43:16.366 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/emulex/benet 2024-08-20T04:43:16.366 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-20T04:43:16.366 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/ethoc.ko 2024-08-20T04:43:16.367 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/fealnx.ko 2024-08-20T04:43:16.367 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel 2024-08-20T04:43:16.367 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-20T04:43:16.367 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/e1000 2024-08-20T04:43:16.367 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-20T04:43:16.367 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/e1000e 2024-08-20T04:43:16.368 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-20T04:43:16.368 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/fm10k 2024-08-20T04:43:16.368 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-20T04:43:16.368 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/i40e 2024-08-20T04:43:16.368 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-20T04:43:16.369 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/iavf 2024-08-20T04:43:16.369 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-20T04:43:16.369 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/igb 2024-08-20T04:43:16.369 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-20T04:43:16.369 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/igbvf 2024-08-20T04:43:16.369 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-20T04:43:16.370 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-20T04:43:16.370 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-20T04:43:16.370 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-20T04:43:16.370 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-20T04:43:16.370 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/libeth 2024-08-20T04:43:16.371 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-20T04:43:16.371 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/libie 2024-08-20T04:43:16.371 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-20T04:43:16.371 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/jme.ko 2024-08-20T04:43:16.371 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/marvell 2024-08-20T04:43:16.372 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-20T04:43:16.372 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-20T04:43:16.372 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-20T04:43:16.372 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/mellanox 2024-08-20T04:43:16.372 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-20T04:43:16.372 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-20T04:43:16.373 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-20T04:43:16.373 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-20T04:43:16.373 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-20T04:43:16.373 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-20T04:43:16.373 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/micrel 2024-08-20T04:43:16.374 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-20T04:43:16.374 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/myricom 2024-08-20T04:43:16.374 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-20T04:43:16.374 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-20T04:43:16.374 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/natsemi 2024-08-20T04:43:16.375 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-20T04:43:16.375 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-20T04:43:16.375 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/neterion 2024-08-20T04:43:16.375 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-20T04:43:16.375 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/nvidia 2024-08-20T04:43:16.375 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-20T04:43:16.376 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/packetengines 2024-08-20T04:43:16.376 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-20T04:43:16.376 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-20T04:43:16.376 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/qlogic 2024-08-20T04:43:16.376 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-20T04:43:16.376 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-20T04:43:16.377 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-20T04:43:16.377 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-20T04:43:16.377 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-20T04:43:16.377 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/rdc 2024-08-20T04:43:16.377 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-20T04:43:16.378 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/realtek 2024-08-20T04:43:16.378 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-20T04:43:16.378 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-20T04:43:16.378 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-20T04:43:16.378 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/rocker 2024-08-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/sfc 2024-08-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/silan 2024-08-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-20T04:43:16.380 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/sis 2024-08-20T04:43:16.380 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-20T04:43:16.380 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-20T04:43:16.380 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/smsc 2024-08-20T04:43:16.380 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-20T04:43:16.380 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-20T04:43:16.381 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-20T04:43:16.381 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-20T04:43:16.381 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/stmicro 2024-08-20T04:43:16.381 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-20T04:43:16.381 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-20T04:43:16.382 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-20T04:43:16.382 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/sun 2024-08-20T04:43:16.382 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-20T04:43:16.382 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-20T04:43:16.382 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-20T04:43:16.382 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-20T04:43:16.383 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/tehuti 2024-08-20T04:43:16.383 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-20T04:43:16.383 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/ti 2024-08-20T04:43:16.383 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-20T04:43:16.383 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/via 2024-08-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/wiznet 2024-08-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/xircom 2024-08-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/geneve.ko 2024-08-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/hyperv 2024-08-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ieee802154 2024-08-20T04:43:16.386 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-20T04:43:16.386 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ifb.ko 2024-08-20T04:43:16.386 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ipvlan 2024-08-20T04:43:16.386 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-20T04:43:16.386 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/macvlan.ko 2024-08-20T04:43:16.386 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/macvtap.ko 2024-08-20T04:43:16.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/mdio 2024-08-20T04:43:16.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/mdio.ko 2024-08-20T04:43:16.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-20T04:43:16.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-20T04:43:16.387 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-20T04:43:16.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/mii.ko 2024-08-20T04:43:16.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/net_failover.ko 2024-08-20T04:43:16.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/netconsole.ko 2024-08-20T04:43:16.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/nlmon.ko 2024-08-20T04:43:16.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/pcs 2024-08-20T04:43:16.388 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-20T04:43:16.389 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-20T04:43:16.389 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy 2024-08-20T04:43:16.389 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/amd.ko 2024-08-20T04:43:16.389 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-20T04:43:16.389 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-20T04:43:16.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-20T04:43:16.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/bcm87xx.ko 2024-08-20T04:43:16.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/broadcom.ko 2024-08-20T04:43:16.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/cicada.ko 2024-08-20T04:43:16.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/davicom.ko 2024-08-20T04:43:16.390 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/dp83640.ko 2024-08-20T04:43:16.391 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/et1011c.ko 2024-08-20T04:43:16.391 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/icplus.ko 2024-08-20T04:43:16.391 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/lxt.ko 2024-08-20T04:43:16.391 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/marvell.ko 2024-08-20T04:43:16.391 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/micrel.ko 2024-08-20T04:43:16.392 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/national.ko 2024-08-20T04:43:16.392 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/phylink.ko 2024-08-20T04:43:16.392 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/qsemi.ko 2024-08-20T04:43:16.392 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/realtek.ko 2024-08-20T04:43:16.392 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/smsc.ko 2024-08-20T04:43:16.392 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/ste10Xp.ko 2024-08-20T04:43:16.393 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/phy/vitesse.ko 2024-08-20T04:43:16.393 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ppp 2024-08-20T04:43:16.393 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-20T04:43:16.393 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ppp/ppp_async.ko 2024-08-20T04:43:16.393 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-20T04:43:16.393 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-20T04:43:16.394 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-20T04:43:16.394 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-20T04:43:16.394 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ppp/pppoe.ko 2024-08-20T04:43:16.394 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ppp/pppox.ko 2024-08-20T04:43:16.395 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/ppp/pptp.ko 2024-08-20T04:43:16.395 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/slip 2024-08-20T04:43:16.395 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/slip/slhc.ko 2024-08-20T04:43:16.395 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/slip/slip.ko 2024-08-20T04:43:16.395 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/sungem_phy.ko 2024-08-20T04:43:16.395 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/tap.ko 2024-08-20T04:43:16.396 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/team 2024-08-20T04:43:16.396 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/team/team.ko 2024-08-20T04:43:16.396 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-20T04:43:16.396 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-20T04:43:16.396 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-20T04:43:16.396 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/team/team_mode_random.ko 2024-08-20T04:43:16.397 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-20T04:43:16.397 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/tun.ko 2024-08-20T04:43:16.397 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/veth.ko 2024-08-20T04:43:16.397 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/virtio_net.ko 2024-08-20T04:43:16.397 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/vmxnet3 2024-08-20T04:43:16.398 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-20T04:43:16.398 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/vxlan 2024-08-20T04:43:16.398 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/vxlan/vxlan.ko 2024-08-20T04:43:16.398 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/xen-netback 2024-08-20T04:43:16.398 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-20T04:43:16.399 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/net/xen-netfront.ko 2024-08-20T04:43:16.399 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ntb 2024-08-20T04:43:16.399 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ntb/ntb.ko 2024-08-20T04:43:16.399 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/nvme 2024-08-20T04:43:16.399 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/nvme/host 2024-08-20T04:43:16.399 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/nvme/host/nvme-core.ko 2024-08-20T04:43:16.400 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/nvme/host/nvme.ko 2024-08-20T04:43:16.400 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/parport 2024-08-20T04:43:16.400 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/parport/parport.ko 2024-08-20T04:43:16.400 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/parport/parport_cs.ko 2024-08-20T04:43:16.400 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/parport/parport_pc.ko 2024-08-20T04:43:16.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/parport/parport_serial.ko 2024-08-20T04:43:16.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pci 2024-08-20T04:43:16.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pci/hotplug 2024-08-20T04:43:16.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-20T04:43:16.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pci/pcie 2024-08-20T04:43:16.401 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-20T04:43:16.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pci/xen-pcifront.ko 2024-08-20T04:43:16.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pcmcia 2024-08-20T04:43:16.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pcmcia/i82092.ko 2024-08-20T04:43:16.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pcmcia/pd6729.ko 2024-08-20T04:43:16.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-20T04:43:16.402 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pinctrl 2024-08-20T04:43:16.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pinctrl/intel 2024-08-20T04:43:16.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-20T04:43:16.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform 2024-08-20T04:43:16.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86 2024-08-20T04:43:16.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-20T04:43:16.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/acerhdf.ko 2024-08-20T04:43:16.403 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-20T04:43:16.404 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-20T04:43:16.404 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-20T04:43:16.404 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-20T04:43:16.404 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-20T04:43:16.404 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-20T04:43:16.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-20T04:43:16.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-20T04:43:16.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-20T04:43:16.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/hdaps.ko 2024-08-20T04:43:16.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/intel 2024-08-20T04:43:16.405 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-20T04:43:16.406 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/intel_ips.ko 2024-08-20T04:43:16.406 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-20T04:43:16.406 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-20T04:43:16.406 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-20T04:43:16.406 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-20T04:43:16.406 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-20T04:43:16.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-20T04:43:16.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-20T04:43:16.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-20T04:43:16.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-20T04:43:16.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/platform/x86/wmi.ko 2024-08-20T04:43:16.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/powercap 2024-08-20T04:43:16.407 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-20T04:43:16.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-20T04:43:16.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pps 2024-08-20T04:43:16.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pps/clients 2024-08-20T04:43:16.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-20T04:43:16.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-20T04:43:16.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pps/clients/pps_parport.ko 2024-08-20T04:43:16.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/pps/pps_core.ko 2024-08-20T04:43:16.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ptp 2024-08-20T04:43:16.408 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ptp/ptp.ko 2024-08-20T04:43:16.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ptp/ptp_kvm.ko 2024-08-20T04:43:16.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ras 2024-08-20T04:43:16.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ras/amd 2024-08-20T04:43:16.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ras/amd/atl 2024-08-20T04:43:16.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-20T04:43:16.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ras/amd/fmpm.ko 2024-08-20T04:43:16.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc 2024-08-20T04:43:16.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-20T04:43:16.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-20T04:43:16.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-20T04:43:16.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-20T04:43:16.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-20T04:43:16.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-20T04:43:16.409 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-20T04:43:16.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-20T04:43:16.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-20T04:43:16.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-20T04:43:16.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-em3027.ko 2024-08-20T04:43:16.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-20T04:43:16.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-20T04:43:16.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-20T04:43:16.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-20T04:43:16.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-20T04:43:16.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-20T04:43:16.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-max6900.ko 2024-08-20T04:43:16.410 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-20T04:43:16.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-20T04:43:16.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-20T04:43:16.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-20T04:43:16.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-20T04:43:16.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-20T04:43:16.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-20T04:43:16.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-20T04:43:16.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-20T04:43:16.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-20T04:43:16.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-20T04:43:16.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-20T04:43:16.411 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/rtc/rtc-x1205.ko 2024-08-20T04:43:16.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi 2024-08-20T04:43:16.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/3w-9xxx.ko 2024-08-20T04:43:16.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/3w-sas.ko 2024-08-20T04:43:16.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/3w-xxxx.ko 2024-08-20T04:43:16.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/BusLogic.ko 2024-08-20T04:43:16.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/a100u2w.ko 2024-08-20T04:43:16.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/aacraid 2024-08-20T04:43:16.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-20T04:43:16.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/advansys.ko 2024-08-20T04:43:16.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/aic7xxx 2024-08-20T04:43:16.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-20T04:43:16.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-20T04:43:16.412 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/am53c974.ko 2024-08-20T04:43:16.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/arcmsr 2024-08-20T04:43:16.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-20T04:43:16.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/atp870u.ko 2024-08-20T04:43:16.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/be2iscsi 2024-08-20T04:43:16.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-20T04:43:16.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/bfa 2024-08-20T04:43:16.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/bfa/bfa.ko 2024-08-20T04:43:16.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/bnx2fc 2024-08-20T04:43:16.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-20T04:43:16.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/bnx2i 2024-08-20T04:43:16.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-20T04:43:16.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/ch.ko 2024-08-20T04:43:16.413 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/csiostor 2024-08-20T04:43:16.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-20T04:43:16.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/cxgbi 2024-08-20T04:43:16.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-20T04:43:16.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-20T04:43:16.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-20T04:43:16.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-20T04:43:16.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-20T04:43:16.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/dc395x.ko 2024-08-20T04:43:16.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/device_handler 2024-08-20T04:43:16.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-20T04:43:16.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-20T04:43:16.414 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-20T04:43:16.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-20T04:43:16.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/dmx3191d.ko 2024-08-20T04:43:16.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/esas2r 2024-08-20T04:43:16.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-20T04:43:16.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/esp_scsi.ko 2024-08-20T04:43:16.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/fcoe 2024-08-20T04:43:16.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-20T04:43:16.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-20T04:43:16.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/fnic 2024-08-20T04:43:16.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/fnic/fnic.ko 2024-08-20T04:43:16.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/hpsa.ko 2024-08-20T04:43:16.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/hptiop.ko 2024-08-20T04:43:16.415 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/hv_storvsc.ko 2024-08-20T04:43:16.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/initio.ko 2024-08-20T04:43:16.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/ipr.ko 2024-08-20T04:43:16.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/ips.ko 2024-08-20T04:43:16.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/isci 2024-08-20T04:43:16.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/isci/isci.ko 2024-08-20T04:43:16.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-20T04:43:16.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-20T04:43:16.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/libfc 2024-08-20T04:43:16.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/libfc/libfc.ko 2024-08-20T04:43:16.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/libiscsi.ko 2024-08-20T04:43:16.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-20T04:43:16.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/libsas 2024-08-20T04:43:16.416 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/libsas/libsas.ko 2024-08-20T04:43:16.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/lpfc 2024-08-20T04:43:16.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-20T04:43:16.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/megaraid 2024-08-20T04:43:16.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/megaraid.ko 2024-08-20T04:43:16.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-20T04:43:16.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-20T04:43:16.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-20T04:43:16.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/mpt3sas 2024-08-20T04:43:16.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-20T04:43:16.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/mvsas 2024-08-20T04:43:16.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-20T04:43:16.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/mvumi.ko 2024-08-20T04:43:16.417 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/pm8001 2024-08-20T04:43:16.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-20T04:43:16.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/pmcraid.ko 2024-08-20T04:43:16.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/qla1280.ko 2024-08-20T04:43:16.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/qla2xxx 2024-08-20T04:43:16.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-20T04:43:16.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-20T04:43:16.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/qla4xxx 2024-08-20T04:43:16.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-20T04:43:16.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/raid_class.ko 2024-08-20T04:43:16.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/scsi_debug.ko 2024-08-20T04:43:16.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-20T04:43:16.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-20T04:43:16.418 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-20T04:43:16.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-20T04:43:16.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-20T04:43:16.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/ses.ko 2024-08-20T04:43:16.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/st.ko 2024-08-20T04:43:16.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/stex.ko 2024-08-20T04:43:16.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/sym53c8xx_2 2024-08-20T04:43:16.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-20T04:43:16.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/virtio_scsi.ko 2024-08-20T04:43:16.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-20T04:43:16.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/scsi/wd719x.ko 2024-08-20T04:43:16.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ssb 2024-08-20T04:43:16.419 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ssb/ssb.ko 2024-08-20T04:43:16.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/target 2024-08-20T04:43:16.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/target/iscsi 2024-08-20T04:43:16.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-20T04:43:16.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/target/loopback 2024-08-20T04:43:16.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-20T04:43:16.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/target/target_core_file.ko 2024-08-20T04:43:16.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/target/target_core_iblock.ko 2024-08-20T04:43:16.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/target/target_core_mod.ko 2024-08-20T04:43:16.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/target/target_core_pscsi.ko 2024-08-20T04:43:16.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/target/target_core_user.ko 2024-08-20T04:43:16.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/target/tcm_fc 2024-08-20T04:43:16.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-20T04:43:16.420 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal 2024-08-20T04:43:16.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel 2024-08-20T04:43:16.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/int340x_thermal 2024-08-20T04:43:16.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-20T04:43:16.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-20T04:43:16.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-20T04:43:16.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-20T04:43:16.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-20T04:43:16.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-20T04:43:16.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-20T04:43:16.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-20T04:43:16.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-20T04:43:16.421 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-20T04:43:16.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-20T04:43:16.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-20T04:43:16.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-20T04:43:16.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-20T04:43:16.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-20T04:43:16.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-20T04:43:16.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-20T04:43:16.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-20T04:43:16.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/tty 2024-08-20T04:43:16.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/tty/ipwireless 2024-08-20T04:43:16.422 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-20T04:43:16.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/tty/n_gsm.ko 2024-08-20T04:43:16.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/tty/n_hdlc.ko 2024-08-20T04:43:16.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/tty/nozomi.ko 2024-08-20T04:43:16.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/tty/serial 2024-08-20T04:43:16.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/tty/serial/8250 2024-08-20T04:43:16.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-20T04:43:16.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/tty/serial/arc_uart.ko 2024-08-20T04:43:16.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/tty/serial/jsm 2024-08-20T04:43:16.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-20T04:43:16.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ufs 2024-08-20T04:43:16.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ufs/core 2024-08-20T04:43:16.423 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-20T04:43:16.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ufs/host 2024-08-20T04:43:16.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-20T04:43:16.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/uio 2024-08-20T04:43:16.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/uio/uio.ko 2024-08-20T04:43:16.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/uio/uio_aec.ko 2024-08-20T04:43:16.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/uio/uio_cif.ko 2024-08-20T04:43:16.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/uio/uio_pci_generic.ko 2024-08-20T04:43:16.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/uio/uio_sercos3.ko 2024-08-20T04:43:16.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb 2024-08-20T04:43:16.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/class 2024-08-20T04:43:16.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/class/cdc-acm.ko 2024-08-20T04:43:16.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-20T04:43:16.424 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/class/usblp.ko 2024-08-20T04:43:16.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/class/usbtmc.ko 2024-08-20T04:43:16.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/host 2024-08-20T04:43:16.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-20T04:43:16.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/image 2024-08-20T04:43:16.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/image/mdc800.ko 2024-08-20T04:43:16.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/image/microtek.ko 2024-08-20T04:43:16.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc 2024-08-20T04:43:16.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/adutux.ko 2024-08-20T04:43:16.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/appledisplay.ko 2024-08-20T04:43:16.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/emi26.ko 2024-08-20T04:43:16.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/emi62.ko 2024-08-20T04:43:16.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/ezusb.ko 2024-08-20T04:43:16.425 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/idmouse.ko 2024-08-20T04:43:16.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/iowarrior.ko 2024-08-20T04:43:16.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-20T04:43:16.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/ldusb.ko 2024-08-20T04:43:16.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/legousbtower.ko 2024-08-20T04:43:16.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/sisusbvga 2024-08-20T04:43:16.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-20T04:43:16.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-20T04:43:16.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/usb3503.ko 2024-08-20T04:43:16.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/usblcd.ko 2024-08-20T04:43:16.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-20T04:43:16.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/uss720.ko 2024-08-20T04:43:16.426 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/misc/yurex.ko 2024-08-20T04:43:16.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/phy 2024-08-20T04:43:16.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/phy/phy-generic.ko 2024-08-20T04:43:16.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial 2024-08-20T04:43:16.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/aircable.ko 2024-08-20T04:43:16.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/ark3116.ko 2024-08-20T04:43:16.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-20T04:43:16.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/ch341.ko 2024-08-20T04:43:16.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/cp210x.ko 2024-08-20T04:43:16.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/cyberjack.ko 2024-08-20T04:43:16.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-20T04:43:16.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-20T04:43:16.427 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/empeg.ko 2024-08-20T04:43:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-20T04:43:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-20T04:43:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-20T04:43:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/io_ti.ko 2024-08-20T04:43:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/ipaq.ko 2024-08-20T04:43:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/ipw.ko 2024-08-20T04:43:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/ir-usb.ko 2024-08-20T04:43:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-20T04:43:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/keyspan.ko 2024-08-20T04:43:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-20T04:43:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-20T04:43:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-20T04:43:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/mct_u232.ko 2024-08-20T04:43:16.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/mos7720.ko 2024-08-20T04:43:16.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/mos7840.ko 2024-08-20T04:43:16.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/navman.ko 2024-08-20T04:43:16.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/omninet.ko 2024-08-20T04:43:16.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/opticon.ko 2024-08-20T04:43:16.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/option.ko 2024-08-20T04:43:16.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/oti6858.ko 2024-08-20T04:43:16.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/pl2303.ko 2024-08-20T04:43:16.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/qcaux.ko 2024-08-20T04:43:16.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/qcserial.ko 2024-08-20T04:43:16.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/quatech2.ko 2024-08-20T04:43:16.429 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/safe_serial.ko 2024-08-20T04:43:16.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/sierra.ko 2024-08-20T04:43:16.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-20T04:43:16.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/ssu100.ko 2024-08-20T04:43:16.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/symbolserial.ko 2024-08-20T04:43:16.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-20T04:43:16.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-20T04:43:16.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/usb_debug.ko 2024-08-20T04:43:16.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-20T04:43:16.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/visor.ko 2024-08-20T04:43:16.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/whiteheat.ko 2024-08-20T04:43:16.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-20T04:43:16.430 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/storage 2024-08-20T04:43:16.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/storage/uas.ko 2024-08-20T04:43:16.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-20T04:43:16.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-20T04:43:16.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-20T04:43:16.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-20T04:43:16.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-20T04:43:16.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-20T04:43:16.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-20T04:43:16.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/storage/ums-karma.ko 2024-08-20T04:43:16.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-20T04:43:16.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-20T04:43:16.431 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-20T04:43:16.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-20T04:43:16.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-20T04:43:16.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/storage/usb-storage.ko 2024-08-20T04:43:16.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/usbip 2024-08-20T04:43:16.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-20T04:43:16.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-20T04:43:16.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-20T04:43:16.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/vfio 2024-08-20T04:43:16.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/vfio/pci 2024-08-20T04:43:16.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-20T04:43:16.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-20T04:43:16.432 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/vfio/vfio.ko 2024-08-20T04:43:16.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-20T04:43:16.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/vhost 2024-08-20T04:43:16.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/vhost/vhost.ko 2024-08-20T04:43:16.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-20T04:43:16.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/vhost/vhost_net.ko 2024-08-20T04:43:16.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/vhost/vhost_scsi.ko 2024-08-20T04:43:16.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/video 2024-08-20T04:43:16.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/video/backlight 2024-08-20T04:43:16.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/video/backlight/apple_bl.ko 2024-08-20T04:43:16.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/video/backlight/lcd.ko 2024-08-20T04:43:16.433 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-20T04:43:16.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/virtio 2024-08-20T04:43:16.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/virtio/virtio.ko 2024-08-20T04:43:16.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/virtio/virtio_balloon.ko 2024-08-20T04:43:16.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/virtio/virtio_mmio.ko 2024-08-20T04:43:16.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/virtio/virtio_pci.ko 2024-08-20T04:43:16.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-20T04:43:16.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-20T04:43:16.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/virtio/virtio_ring.ko 2024-08-20T04:43:16.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/w1 2024-08-20T04:43:16.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/w1/masters 2024-08-20T04:43:16.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/w1/masters/ds2482.ko 2024-08-20T04:43:16.434 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/w1/masters/ds2490.ko 2024-08-20T04:43:16.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/w1/slaves 2024-08-20T04:43:16.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-20T04:43:16.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-20T04:43:16.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-20T04:43:16.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-20T04:43:16.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-20T04:43:16.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-20T04:43:16.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-20T04:43:16.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-20T04:43:16.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-20T04:43:16.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-20T04:43:16.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-20T04:43:16.435 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/w1/wire.ko 2024-08-20T04:43:16.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog 2024-08-20T04:43:16.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-20T04:43:16.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-20T04:43:16.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-20T04:43:16.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/hpwdt.ko 2024-08-20T04:43:16.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/i6300esb.ko 2024-08-20T04:43:16.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-20T04:43:16.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-20T04:43:16.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/ib700wdt.ko 2024-08-20T04:43:16.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/ibmasr.ko 2024-08-20T04:43:16.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-20T04:43:16.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-20T04:43:16.436 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/it87_wdt.ko 2024-08-20T04:43:16.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/machzwd.ko 2024-08-20T04:43:16.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/nv_tco.ko 2024-08-20T04:43:16.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-20T04:43:16.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-20T04:43:16.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-20T04:43:16.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-20T04:43:16.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/softdog.ko 2024-08-20T04:43:16.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-20T04:43:16.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/via_wdt.ko 2024-08-20T04:43:16.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-20T04:43:16.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-20T04:43:16.437 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-20T04:43:16.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/wdt_pci.ko 2024-08-20T04:43:16.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/watchdog/xen_wdt.ko 2024-08-20T04:43:16.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/xen 2024-08-20T04:43:16.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-20T04:43:16.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/xen/xen-evtchn.ko 2024-08-20T04:43:16.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/xen/xen-gntalloc.ko 2024-08-20T04:43:16.438 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/xen/xen-gntdev.ko 2024-08-20T04:43:16.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/xen/xen-pciback 2024-08-20T04:43:16.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-20T04:43:16.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/xen/xen-privcmd.ko 2024-08-20T04:43:16.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/xen/xenfs 2024-08-20T04:43:16.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-20T04:43:16.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs 2024-08-20T04:43:16.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/9p 2024-08-20T04:43:16.439 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/9p/9p.ko 2024-08-20T04:43:16.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/affs 2024-08-20T04:43:16.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/affs/affs.ko 2024-08-20T04:43:16.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/befs 2024-08-20T04:43:16.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/befs/befs.ko 2024-08-20T04:43:16.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/binfmt_misc.ko 2024-08-20T04:43:16.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/btrfs 2024-08-20T04:43:16.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/btrfs/btrfs.ko 2024-08-20T04:43:16.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/cachefiles 2024-08-20T04:43:16.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/cachefiles/cachefiles.ko 2024-08-20T04:43:16.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/ceph 2024-08-20T04:43:16.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/ceph/ceph.ko 2024-08-20T04:43:16.440 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/coda 2024-08-20T04:43:16.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/coda/coda.ko 2024-08-20T04:43:16.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/cramfs 2024-08-20T04:43:16.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/cramfs/cramfs.ko 2024-08-20T04:43:16.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/dlm 2024-08-20T04:43:16.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/dlm/dlm.ko 2024-08-20T04:43:16.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/ecryptfs 2024-08-20T04:43:16.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-20T04:43:16.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/f2fs 2024-08-20T04:43:16.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/f2fs/f2fs.ko 2024-08-20T04:43:16.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/fat 2024-08-20T04:43:16.441 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/fat/fat.ko 2024-08-20T04:43:16.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/fat/msdos.ko 2024-08-20T04:43:16.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/fat/vfat.ko 2024-08-20T04:43:16.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/fuse 2024-08-20T04:43:16.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/fuse/cuse.ko 2024-08-20T04:43:16.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/fuse/fuse.ko 2024-08-20T04:43:16.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/gfs2 2024-08-20T04:43:16.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/gfs2/gfs2.ko 2024-08-20T04:43:16.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/hfs 2024-08-20T04:43:16.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/hfs/hfs.ko 2024-08-20T04:43:16.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/hfsplus 2024-08-20T04:43:16.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/hfsplus/hfsplus.ko 2024-08-20T04:43:16.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/isofs 2024-08-20T04:43:16.442 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/isofs/isofs.ko 2024-08-20T04:43:16.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/jfs 2024-08-20T04:43:16.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/jfs/jfs.ko 2024-08-20T04:43:16.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/lockd 2024-08-20T04:43:16.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/lockd/lockd.ko 2024-08-20T04:43:16.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/minix 2024-08-20T04:43:16.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/minix/minix.ko 2024-08-20T04:43:16.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/netfs 2024-08-20T04:43:16.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/netfs/netfs.ko 2024-08-20T04:43:16.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nfs 2024-08-20T04:43:16.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nfs/blocklayout 2024-08-20T04:43:16.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-20T04:43:16.443 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nfs/filelayout 2024-08-20T04:43:16.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-20T04:43:16.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nfs/flexfilelayout 2024-08-20T04:43:16.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-20T04:43:16.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nfs/nfs.ko 2024-08-20T04:43:16.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nfs/nfsv3.ko 2024-08-20T04:43:16.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nfs/nfsv4.ko 2024-08-20T04:43:16.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nfs_common 2024-08-20T04:43:16.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nfs_common/grace.ko 2024-08-20T04:43:16.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nfs_common/nfs_acl.ko 2024-08-20T04:43:16.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nfsd 2024-08-20T04:43:16.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nfsd/nfsd.ko 2024-08-20T04:43:16.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nilfs2 2024-08-20T04:43:16.444 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nilfs2/nilfs2.ko 2024-08-20T04:43:16.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls 2024-08-20T04:43:16.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/mac-celtic.ko 2024-08-20T04:43:16.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/mac-centeuro.ko 2024-08-20T04:43:16.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/mac-croatian.ko 2024-08-20T04:43:16.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/mac-cyrillic.ko 2024-08-20T04:43:16.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/mac-gaelic.ko 2024-08-20T04:43:16.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/mac-greek.ko 2024-08-20T04:43:16.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/mac-iceland.ko 2024-08-20T04:43:16.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/mac-inuit.ko 2024-08-20T04:43:16.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/mac-roman.ko 2024-08-20T04:43:16.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/mac-romanian.ko 2024-08-20T04:43:16.445 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/mac-turkish.ko 2024-08-20T04:43:16.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp1250.ko 2024-08-20T04:43:16.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp1251.ko 2024-08-20T04:43:16.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp1255.ko 2024-08-20T04:43:16.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp737.ko 2024-08-20T04:43:16.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp775.ko 2024-08-20T04:43:16.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp850.ko 2024-08-20T04:43:16.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp852.ko 2024-08-20T04:43:16.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp855.ko 2024-08-20T04:43:16.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp857.ko 2024-08-20T04:43:16.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp860.ko 2024-08-20T04:43:16.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp861.ko 2024-08-20T04:43:16.446 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp862.ko 2024-08-20T04:43:16.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp863.ko 2024-08-20T04:43:16.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp864.ko 2024-08-20T04:43:16.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp865.ko 2024-08-20T04:43:16.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp866.ko 2024-08-20T04:43:16.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp869.ko 2024-08-20T04:43:16.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp874.ko 2024-08-20T04:43:16.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp932.ko 2024-08-20T04:43:16.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp936.ko 2024-08-20T04:43:16.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp949.ko 2024-08-20T04:43:16.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_cp950.ko 2024-08-20T04:43:16.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_euc-jp.ko 2024-08-20T04:43:16.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_iso8859-1.ko 2024-08-20T04:43:16.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_iso8859-13.ko 2024-08-20T04:43:16.447 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_iso8859-14.ko 2024-08-20T04:43:16.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_iso8859-15.ko 2024-08-20T04:43:16.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_iso8859-2.ko 2024-08-20T04:43:16.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_iso8859-3.ko 2024-08-20T04:43:16.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_iso8859-4.ko 2024-08-20T04:43:16.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_iso8859-5.ko 2024-08-20T04:43:16.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_iso8859-6.ko 2024-08-20T04:43:16.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_iso8859-7.ko 2024-08-20T04:43:16.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_iso8859-9.ko 2024-08-20T04:43:16.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_koi8-r.ko 2024-08-20T04:43:16.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_koi8-ru.ko 2024-08-20T04:43:16.448 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_koi8-u.ko 2024-08-20T04:43:16.449 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-20T04:43:16.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/nls/nls_utf8.ko 2024-08-20T04:43:16.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/ocfs2 2024-08-20T04:43:16.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/ocfs2/cluster 2024-08-20T04:43:16.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-20T04:43:16.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/ocfs2/dlm 2024-08-20T04:43:16.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-20T04:43:16.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/ocfs2/dlmfs 2024-08-20T04:43:16.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-20T04:43:16.450 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/ocfs2/ocfs2.ko 2024-08-20T04:43:16.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-20T04:43:16.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-20T04:43:16.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-20T04:43:16.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/overlayfs 2024-08-20T04:43:16.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/overlayfs/overlay.ko 2024-08-20T04:43:16.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/pstore 2024-08-20T04:43:16.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/pstore/ramoops.ko 2024-08-20T04:43:16.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/reiserfs 2024-08-20T04:43:16.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/reiserfs/reiserfs.ko 2024-08-20T04:43:16.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/romfs 2024-08-20T04:43:16.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/romfs/romfs.ko 2024-08-20T04:43:16.451 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/smb 2024-08-20T04:43:16.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/smb/client 2024-08-20T04:43:16.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/smb/client/cifs.ko 2024-08-20T04:43:16.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/smb/common 2024-08-20T04:43:16.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/smb/common/cifs_arc4.ko 2024-08-20T04:43:16.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/smb/common/cifs_md4.ko 2024-08-20T04:43:16.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/squashfs 2024-08-20T04:43:16.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/squashfs/squashfs.ko 2024-08-20T04:43:16.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/sysv 2024-08-20T04:43:16.452 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/sysv/sysv.ko 2024-08-20T04:43:16.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/udf 2024-08-20T04:43:16.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/udf/udf.ko 2024-08-20T04:43:16.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/ufs 2024-08-20T04:43:16.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/ufs/ufs.ko 2024-08-20T04:43:16.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/xfs 2024-08-20T04:43:16.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/fs/xfs/xfs.ko 2024-08-20T04:43:16.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/kernel 2024-08-20T04:43:16.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/kernel/rcu 2024-08-20T04:43:16.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/kernel/rcu/rcutorture.ko 2024-08-20T04:43:16.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/kernel/torture.ko 2024-08-20T04:43:16.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/kernel/trace 2024-08-20T04:43:16.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-20T04:43:16.453 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib 2024-08-20T04:43:16.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/asn1_encoder.ko 2024-08-20T04:43:16.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/crc-itu-t.ko 2024-08-20T04:43:16.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/crc8.ko 2024-08-20T04:43:16.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/crypto 2024-08-20T04:43:16.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/crypto/libaescfb.ko 2024-08-20T04:43:16.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/crypto/libarc4.ko 2024-08-20T04:43:16.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/crypto/libdes.ko 2024-08-20T04:43:16.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/libcrc32c.ko 2024-08-20T04:43:16.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/lru_cache.ko 2024-08-20T04:43:16.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/lz4 2024-08-20T04:43:16.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/lz4/lz4_compress.ko 2024-08-20T04:43:16.454 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/lz4/lz4hc_compress.ko 2024-08-20T04:43:16.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/math 2024-08-20T04:43:16.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/math/cordic.ko 2024-08-20T04:43:16.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/raid6 2024-08-20T04:43:16.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/raid6/raid6_pq.ko 2024-08-20T04:43:16.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/reed_solomon 2024-08-20T04:43:16.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-20T04:43:16.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/ts_bm.ko 2024-08-20T04:43:16.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/ts_fsm.ko 2024-08-20T04:43:16.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/ts_kmp.ko 2024-08-20T04:43:16.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/zstd 2024-08-20T04:43:16.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/lib/zstd/zstd_compress.ko 2024-08-20T04:43:16.455 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/mm 2024-08-20T04:43:16.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/mm/hwpoison-inject.ko 2024-08-20T04:43:16.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net 2024-08-20T04:43:16.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/6lowpan 2024-08-20T04:43:16.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/6lowpan/6lowpan.ko 2024-08-20T04:43:16.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/6lowpan/nhc_dest.ko 2024-08-20T04:43:16.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/6lowpan/nhc_fragment.ko 2024-08-20T04:43:16.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/6lowpan/nhc_hop.ko 2024-08-20T04:43:16.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-20T04:43:16.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/6lowpan/nhc_mobility.ko 2024-08-20T04:43:16.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/6lowpan/nhc_routing.ko 2024-08-20T04:43:16.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/6lowpan/nhc_udp.ko 2024-08-20T04:43:16.456 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/802 2024-08-20T04:43:16.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/802/garp.ko 2024-08-20T04:43:16.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/802/mrp.ko 2024-08-20T04:43:16.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/802/p8022.ko 2024-08-20T04:43:16.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/802/psnap.ko 2024-08-20T04:43:16.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/802/stp.ko 2024-08-20T04:43:16.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/8021q 2024-08-20T04:43:16.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/8021q/8021q.ko 2024-08-20T04:43:16.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/9p 2024-08-20T04:43:16.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/9p/9pnet.ko 2024-08-20T04:43:16.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/9p/9pnet_fd.ko 2024-08-20T04:43:16.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/9p/9pnet_rdma.ko 2024-08-20T04:43:16.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/9p/9pnet_virtio.ko 2024-08-20T04:43:16.457 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/batman-adv 2024-08-20T04:43:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/batman-adv/batman-adv.ko 2024-08-20T04:43:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge 2024-08-20T04:43:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/br_netfilter.ko 2024-08-20T04:43:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/bridge.ko 2024-08-20T04:43:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter 2024-08-20T04:43:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-20T04:43:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-20T04:43:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-20T04:43:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-20T04:43:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-20T04:43:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-20T04:43:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-20T04:43:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-20T04:43:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-20T04:43:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-20T04:43:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-20T04:43:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-20T04:43:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-20T04:43:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-20T04:43:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-20T04:43:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-20T04:43:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-20T04:43:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-20T04:43:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-20T04:43:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-20T04:43:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/ebtables.ko 2024-08-20T04:43:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-20T04:43:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-20T04:43:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-20T04:43:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ceph 2024-08-20T04:43:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ceph/libceph.ko 2024-08-20T04:43:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/core 2024-08-20T04:43:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/core/failover.ko 2024-08-20T04:43:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/core/pktgen.ko 2024-08-20T04:43:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/dccp 2024-08-20T04:43:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/dccp/dccp.ko 2024-08-20T04:43:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/dccp/dccp_diag.ko 2024-08-20T04:43:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/dccp/dccp_ipv4.ko 2024-08-20T04:43:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/dccp/dccp_ipv6.ko 2024-08-20T04:43:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/dns_resolver 2024-08-20T04:43:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/dns_resolver/dns_resolver.ko 2024-08-20T04:43:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/dsa 2024-08-20T04:43:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/dsa/dsa_core.ko 2024-08-20T04:43:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/dsa/tag_brcm.ko 2024-08-20T04:43:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/dsa/tag_dsa.ko 2024-08-20T04:43:16.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/dsa/tag_none.ko 2024-08-20T04:43:16.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/dsa/tag_trailer.ko 2024-08-20T04:43:16.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ieee802154 2024-08-20T04:43:16.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ieee802154/6lowpan 2024-08-20T04:43:16.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-20T04:43:16.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ieee802154/ieee802154.ko 2024-08-20T04:43:16.462 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-20T04:43:16.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4 2024-08-20T04:43:16.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/ah4.ko 2024-08-20T04:43:16.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/esp4.ko 2024-08-20T04:43:16.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/fou.ko 2024-08-20T04:43:16.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/gre.ko 2024-08-20T04:43:16.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/inet_diag.ko 2024-08-20T04:43:16.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/ip_gre.ko 2024-08-20T04:43:16.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/ip_tunnel.ko 2024-08-20T04:43:16.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/ip_vti.ko 2024-08-20T04:43:16.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/ipcomp.ko 2024-08-20T04:43:16.463 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/ipip.ko 2024-08-20T04:43:16.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter 2024-08-20T04:43:16.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-20T04:43:16.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-20T04:43:16.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-20T04:43:16.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-20T04:43:16.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-20T04:43:16.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-20T04:43:16.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-20T04:43:16.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-20T04:43:16.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-20T04:43:16.464 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-20T04:43:16.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-20T04:43:16.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-20T04:43:16.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-20T04:43:16.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-20T04:43:16.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-20T04:43:16.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-20T04:43:16.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-20T04:43:16.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-20T04:43:16.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-20T04:43:16.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-20T04:43:16.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-20T04:43:16.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/tcp_bic.ko 2024-08-20T04:43:16.465 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/tcp_dctcp.ko 2024-08-20T04:43:16.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/tcp_diag.ko 2024-08-20T04:43:16.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/tcp_highspeed.ko 2024-08-20T04:43:16.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/tcp_htcp.ko 2024-08-20T04:43:16.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/tcp_hybla.ko 2024-08-20T04:43:16.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/tcp_illinois.ko 2024-08-20T04:43:16.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/tcp_lp.ko 2024-08-20T04:43:16.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/tcp_scalable.ko 2024-08-20T04:43:16.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/tcp_vegas.ko 2024-08-20T04:43:16.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/tcp_veno.ko 2024-08-20T04:43:16.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/tcp_westwood.ko 2024-08-20T04:43:16.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/tcp_yeah.ko 2024-08-20T04:43:16.466 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/tunnel4.ko 2024-08-20T04:43:16.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/udp_diag.ko 2024-08-20T04:43:16.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/udp_tunnel.ko 2024-08-20T04:43:16.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-20T04:43:16.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6 2024-08-20T04:43:16.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/ah6.ko 2024-08-20T04:43:16.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/esp6.ko 2024-08-20T04:43:16.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/fou6.ko 2024-08-20T04:43:16.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/ip6_tunnel.ko 2024-08-20T04:43:16.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-20T04:43:16.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/ip6_vti.ko 2024-08-20T04:43:16.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/ipcomp6.ko 2024-08-20T04:43:16.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter 2024-08-20T04:43:16.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-20T04:43:16.467 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-20T04:43:16.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-20T04:43:16.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-20T04:43:16.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-20T04:43:16.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-20T04:43:16.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-20T04:43:16.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-20T04:43:16.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-20T04:43:16.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-20T04:43:16.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-20T04:43:16.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-20T04:43:16.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-20T04:43:16.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-20T04:43:16.468 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-20T04:43:16.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-20T04:43:16.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-20T04:43:16.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-20T04:43:16.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-20T04:43:16.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-20T04:43:16.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-20T04:43:16.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-20T04:43:16.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-20T04:43:16.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-20T04:43:16.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/sit.ko 2024-08-20T04:43:16.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/tunnel6.ko 2024-08-20T04:43:16.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-20T04:43:16.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/key 2024-08-20T04:43:16.469 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/key/af_key.ko 2024-08-20T04:43:16.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/l2tp 2024-08-20T04:43:16.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/l2tp/l2tp_core.ko 2024-08-20T04:43:16.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-20T04:43:16.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/l2tp/l2tp_eth.ko 2024-08-20T04:43:16.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/l2tp/l2tp_ip.ko 2024-08-20T04:43:16.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/l2tp/l2tp_ip6.ko 2024-08-20T04:43:16.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/l2tp/l2tp_netlink.ko 2024-08-20T04:43:16.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/l2tp/l2tp_ppp.ko 2024-08-20T04:43:16.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/llc 2024-08-20T04:43:16.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/llc/llc.ko 2024-08-20T04:43:16.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/mac802154 2024-08-20T04:43:16.470 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/mac802154/mac802154.ko 2024-08-20T04:43:16.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/mpls 2024-08-20T04:43:16.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/mpls/mpls_gso.ko 2024-08-20T04:43:16.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter 2024-08-20T04:43:16.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipset 2024-08-20T04:43:16.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipset/ip_set.ko 2024-08-20T04:43:16.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-20T04:43:16.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-20T04:43:16.471 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-20T04:43:16.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-20T04:43:16.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-20T04:43:16.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-20T04:43:16.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-20T04:43:16.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-20T04:43:16.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-20T04:43:16.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-20T04:43:16.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-20T04:43:16.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-20T04:43:16.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-20T04:43:16.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-20T04:43:16.472 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-20T04:43:16.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipvs 2024-08-20T04:43:16.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-20T04:43:16.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-20T04:43:16.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-20T04:43:16.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-20T04:43:16.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-20T04:43:16.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-20T04:43:16.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-20T04:43:16.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-20T04:43:16.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-20T04:43:16.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-20T04:43:16.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-20T04:43:16.473 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-20T04:43:16.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-20T04:43:16.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-20T04:43:16.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_conncount.ko 2024-08-20T04:43:16.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_conntrack.ko 2024-08-20T04:43:16.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-20T04:43:16.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-20T04:43:16.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-20T04:43:16.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-20T04:43:16.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-20T04:43:16.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-20T04:43:16.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-20T04:43:16.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-20T04:43:16.474 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-20T04:43:16.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-20T04:43:16.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-20T04:43:16.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-20T04:43:16.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-20T04:43:16.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_flow_table.ko 2024-08-20T04:43:16.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-20T04:43:16.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_log_syslog.ko 2024-08-20T04:43:16.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_nat.ko 2024-08-20T04:43:16.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-20T04:43:16.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-20T04:43:16.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_nat_irc.ko 2024-08-20T04:43:16.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_nat_sip.ko 2024-08-20T04:43:16.475 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-20T04:43:16.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-20T04:43:16.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nf_tables.ko 2024-08-20T04:43:16.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nfnetlink.ko 2024-08-20T04:43:16.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-20T04:43:16.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nfnetlink_log.ko 2024-08-20T04:43:16.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-20T04:43:16.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-20T04:43:16.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_chain_nat.ko 2024-08-20T04:43:16.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_compat.ko 2024-08-20T04:43:16.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_ct.ko 2024-08-20T04:43:16.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-20T04:43:16.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_fib.ko 2024-08-20T04:43:16.476 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-20T04:43:16.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_hash.ko 2024-08-20T04:43:16.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_limit.ko 2024-08-20T04:43:16.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_log.ko 2024-08-20T04:43:16.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_masq.ko 2024-08-20T04:43:16.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_nat.ko 2024-08-20T04:43:16.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_numgen.ko 2024-08-20T04:43:16.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_queue.ko 2024-08-20T04:43:16.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_quota.ko 2024-08-20T04:43:16.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_redir.ko 2024-08-20T04:43:16.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_reject.ko 2024-08-20T04:43:16.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_reject_inet.ko 2024-08-20T04:43:16.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_socket.ko 2024-08-20T04:43:16.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/nft_tunnel.ko 2024-08-20T04:43:16.477 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_AUDIT.ko 2024-08-20T04:43:16.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-20T04:43:16.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-20T04:43:16.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-20T04:43:16.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_CT.ko 2024-08-20T04:43:16.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_DSCP.ko 2024-08-20T04:43:16.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_HL.ko 2024-08-20T04:43:16.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_HMARK.ko 2024-08-20T04:43:16.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-20T04:43:16.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_LED.ko 2024-08-20T04:43:16.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_LOG.ko 2024-08-20T04:43:16.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-20T04:43:16.478 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_NETMAP.ko 2024-08-20T04:43:16.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_NFLOG.ko 2024-08-20T04:43:16.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-20T04:43:16.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_RATEEST.ko 2024-08-20T04:43:16.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-20T04:43:16.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_SECMARK.ko 2024-08-20T04:43:16.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-20T04:43:16.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-20T04:43:16.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_TEE.ko 2024-08-20T04:43:16.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_TPROXY.ko 2024-08-20T04:43:16.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_TRACE.ko 2024-08-20T04:43:16.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_addrtype.ko 2024-08-20T04:43:16.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_bpf.ko 2024-08-20T04:43:16.479 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_cgroup.ko 2024-08-20T04:43:16.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_cluster.ko 2024-08-20T04:43:16.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_comment.ko 2024-08-20T04:43:16.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_connbytes.ko 2024-08-20T04:43:16.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_connlabel.ko 2024-08-20T04:43:16.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_connlimit.ko 2024-08-20T04:43:16.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_connmark.ko 2024-08-20T04:43:16.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_conntrack.ko 2024-08-20T04:43:16.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_cpu.ko 2024-08-20T04:43:16.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_dccp.ko 2024-08-20T04:43:16.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_devgroup.ko 2024-08-20T04:43:16.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_dscp.ko 2024-08-20T04:43:16.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_ecn.ko 2024-08-20T04:43:16.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_esp.ko 2024-08-20T04:43:16.480 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_hashlimit.ko 2024-08-20T04:43:16.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_helper.ko 2024-08-20T04:43:16.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_hl.ko 2024-08-20T04:43:16.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_ipcomp.ko 2024-08-20T04:43:16.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_iprange.ko 2024-08-20T04:43:16.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_ipvs.ko 2024-08-20T04:43:16.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_l2tp.ko 2024-08-20T04:43:16.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_length.ko 2024-08-20T04:43:16.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_limit.ko 2024-08-20T04:43:16.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_mac.ko 2024-08-20T04:43:16.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_mark.ko 2024-08-20T04:43:16.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_multiport.ko 2024-08-20T04:43:16.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_nat.ko 2024-08-20T04:43:16.481 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_nfacct.ko 2024-08-20T04:43:16.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_osf.ko 2024-08-20T04:43:16.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_owner.ko 2024-08-20T04:43:16.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_physdev.ko 2024-08-20T04:43:16.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_pkttype.ko 2024-08-20T04:43:16.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_policy.ko 2024-08-20T04:43:16.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_quota.ko 2024-08-20T04:43:16.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_rateest.ko 2024-08-20T04:43:16.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_realm.ko 2024-08-20T04:43:16.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_recent.ko 2024-08-20T04:43:16.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_sctp.ko 2024-08-20T04:43:16.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_set.ko 2024-08-20T04:43:16.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_socket.ko 2024-08-20T04:43:16.482 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_state.ko 2024-08-20T04:43:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_statistic.ko 2024-08-20T04:43:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_string.ko 2024-08-20T04:43:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_tcpmss.ko 2024-08-20T04:43:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_time.ko 2024-08-20T04:43:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netfilter/xt_u32.ko 2024-08-20T04:43:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netlink 2024-08-20T04:43:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/netlink/netlink_diag.ko 2024-08-20T04:43:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/nsh 2024-08-20T04:43:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/nsh/nsh.ko 2024-08-20T04:43:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/openvswitch 2024-08-20T04:43:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/openvswitch/openvswitch.ko 2024-08-20T04:43:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/openvswitch/vport-geneve.ko 2024-08-20T04:43:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/openvswitch/vport-gre.ko 2024-08-20T04:43:16.483 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/openvswitch/vport-vxlan.ko 2024-08-20T04:43:16.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/packet 2024-08-20T04:43:16.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/packet/af_packet_diag.ko 2024-08-20T04:43:16.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/rds 2024-08-20T04:43:16.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/rds/rds.ko 2024-08-20T04:43:16.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/rds/rds_rdma.ko 2024-08-20T04:43:16.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/rds/rds_tcp.ko 2024-08-20T04:43:16.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched 2024-08-20T04:43:16.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/act_csum.ko 2024-08-20T04:43:16.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/act_gact.ko 2024-08-20T04:43:16.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/act_mirred.ko 2024-08-20T04:43:16.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/act_nat.ko 2024-08-20T04:43:16.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/act_pedit.ko 2024-08-20T04:43:16.484 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/act_police.ko 2024-08-20T04:43:16.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/act_simple.ko 2024-08-20T04:43:16.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/act_skbedit.ko 2024-08-20T04:43:16.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/act_vlan.ko 2024-08-20T04:43:16.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/cls_basic.ko 2024-08-20T04:43:16.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/cls_bpf.ko 2024-08-20T04:43:16.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/cls_flow.ko 2024-08-20T04:43:16.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/cls_fw.ko 2024-08-20T04:43:16.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/cls_route.ko 2024-08-20T04:43:16.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/cls_u32.ko 2024-08-20T04:43:16.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/em_cmp.ko 2024-08-20T04:43:16.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/em_ipset.ko 2024-08-20T04:43:16.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/em_meta.ko 2024-08-20T04:43:16.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/em_nbyte.ko 2024-08-20T04:43:16.485 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/em_text.ko 2024-08-20T04:43:16.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/em_u32.ko 2024-08-20T04:43:16.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_choke.ko 2024-08-20T04:43:16.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_codel.ko 2024-08-20T04:43:16.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_drr.ko 2024-08-20T04:43:16.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_fq.ko 2024-08-20T04:43:16.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_gred.ko 2024-08-20T04:43:16.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_hfsc.ko 2024-08-20T04:43:16.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_hhf.ko 2024-08-20T04:43:16.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_htb.ko 2024-08-20T04:43:16.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_ingress.ko 2024-08-20T04:43:16.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_mqprio.ko 2024-08-20T04:43:16.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_mqprio_lib.ko 2024-08-20T04:43:16.486 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_multiq.ko 2024-08-20T04:43:16.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_netem.ko 2024-08-20T04:43:16.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_pie.ko 2024-08-20T04:43:16.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_plug.ko 2024-08-20T04:43:16.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_prio.ko 2024-08-20T04:43:16.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_qfq.ko 2024-08-20T04:43:16.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_red.ko 2024-08-20T04:43:16.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_sfb.ko 2024-08-20T04:43:16.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_sfq.ko 2024-08-20T04:43:16.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_tbf.ko 2024-08-20T04:43:16.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sched/sch_teql.ko 2024-08-20T04:43:16.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sctp 2024-08-20T04:43:16.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sctp/sctp.ko 2024-08-20T04:43:16.487 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sctp/sctp_diag.ko 2024-08-20T04:43:16.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sunrpc 2024-08-20T04:43:16.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sunrpc/auth_gss 2024-08-20T04:43:16.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-20T04:43:16.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-20T04:43:16.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sunrpc/sunrpc.ko 2024-08-20T04:43:16.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sunrpc/xprtrdma 2024-08-20T04:43:16.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-20T04:43:16.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/tipc 2024-08-20T04:43:16.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/tipc/tipc.ko 2024-08-20T04:43:16.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/tipc/tipc_diag.ko 2024-08-20T04:43:16.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/unix 2024-08-20T04:43:16.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/unix/unix_diag.ko 2024-08-20T04:43:16.488 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/vmw_vsock 2024-08-20T04:43:16.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-20T04:43:16.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-20T04:43:16.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/vmw_vsock/vsock.ko 2024-08-20T04:43:16.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-20T04:43:16.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-20T04:43:16.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/xfrm 2024-08-20T04:43:16.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-20T04:43:16.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/security 2024-08-20T04:43:16.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/security/keys 2024-08-20T04:43:16.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/security/keys/encrypted-keys 2024-08-20T04:43:16.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-20T04:43:16.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/security/keys/trusted-keys 2024-08-20T04:43:16.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/kernel/security/keys/trusted-keys/trusted.ko 2024-08-20T04:43:16.489 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/modules.alias 2024-08-20T04:43:16.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/modules.alias.bin 2024-08-20T04:43:16.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/modules.builtin 2024-08-20T04:43:16.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/modules.builtin.alias.bin 2024-08-20T04:43:16.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/modules.builtin.bin 2024-08-20T04:43:16.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/modules.builtin.modinfo 2024-08-20T04:43:16.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/modules.dep 2024-08-20T04:43:16.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/modules.dep.bin 2024-08-20T04:43:16.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/modules.devname 2024-08-20T04:43:16.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/modules.order 2024-08-20T04:43:16.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/modules.softdep 2024-08-20T04:43:16.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/modules.symbols 2024-08-20T04:43:16.490 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/modules.symbols.bin 2024-08-20T04:43:16.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/modules.weakdep 2024-08-20T04:43:16.491 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.11.0-rc3-g7e35574567e1/vmlinuz 2024-08-20T04:43:16.494 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7e35574567e1 2024-08-20T04:43:16.495 DEBUG:teuthology.orchestra.run.smithi037:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-20T04:43:16.518 INFO:teuthology.orchestra.run.smithi037.stdout:postinstall scriptlet (using /bin/sh): 2024-08-20T04:43:16.519 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-20T04:43:16.519 INFO:teuthology.orchestra.run.smithi037.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7e35574567e1 /lib/modules/6.11.0-rc3-g7e35574567e1/vmlinuz 2024-08-20T04:43:16.519 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2024-08-20T04:43:16.519 INFO:teuthology.orchestra.run.smithi037.stdout:for file in vmlinuz System.map config; do 2024-08-20T04:43:16.519 INFO:teuthology.orchestra.run.smithi037.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7e35574567e1/${file}" "/boot/${file}-6.11.0-rc3-g7e35574567e1"; then 2024-08-20T04:43:16.519 INFO:teuthology.orchestra.run.smithi037.stdout: cp "/lib/modules/6.11.0-rc3-g7e35574567e1/${file}" "/boot/${file}-6.11.0-rc3-g7e35574567e1" 2024-08-20T04:43:16.519 INFO:teuthology.orchestra.run.smithi037.stdout: fi 2024-08-20T04:43:16.519 INFO:teuthology.orchestra.run.smithi037.stdout:done 2024-08-20T04:43:16.519 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7e35574567e1/dtb" ] && \ 2024-08-20T04:43:16.519 INFO:teuthology.orchestra.run.smithi037.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7e35574567e1/dtb" "/boot/dtb-6.11.0-rc3-g7e35574567e1" >/dev/null 2>&1; then 2024-08-20T04:43:16.520 INFO:teuthology.orchestra.run.smithi037.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7e35574567e1" 2024-08-20T04:43:16.520 INFO:teuthology.orchestra.run.smithi037.stdout: cp -r "/lib/modules/6.11.0-rc3-g7e35574567e1/dtb" "/boot/dtb-6.11.0-rc3-g7e35574567e1" 2024-08-20T04:43:16.520 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2024-08-20T04:43:16.520 INFO:teuthology.orchestra.run.smithi037.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7e35574567e1/modules.dep" ]; then 2024-08-20T04:43:16.520 INFO:teuthology.orchestra.run.smithi037.stdout: /usr/sbin/depmod 6.11.0-rc3-g7e35574567e1 2024-08-20T04:43:16.520 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2024-08-20T04:43:16.520 INFO:teuthology.orchestra.run.smithi037.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-20T04:43:16.520 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-20T04:43:16.520 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-install remove 6.11.0-rc3-g7e35574567e1 2024-08-20T04:43:16.520 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2024-08-20T04:43:16.521 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2024-08-20T04:43:16.602 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2024-08-20T04:43:16.602 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2024-08-20T04:43:16.602 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.06 2024-08-20T04:43:16.603 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 82.el9 2024-08-20T04:43:16.603 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2024-08-20T04:43:16.603 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Tue 20 Aug 2024 02:15:45 AM UTC 2024-08-20T04:43:16.603 INFO:teuthology.orchestra.run.smithi037.stdout:Group : Unspecified 2024-08-20T04:43:16.603 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 8274670 2024-08-20T04:43:16.603 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2024-08-20T04:43:16.603 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-08-20T04:43:16.603 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-08-20T04:43:16.603 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-08-20T04:43:16.603 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-20T04:43:16.603 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : builder@centos.org 2024-08-20T04:43:16.603 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : CentOS 2024-08-20T04:43:16.603 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-20T04:43:16.603 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2024-08-20T04:43:16.604 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2024-08-20T04:43:16.604 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:43:16.604 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-20T04:43:16.604 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-20T04:43:16.604 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-20T04:43:16.604 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2024-08-20T04:43:16.604 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:43:16.604 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2024-08-20T04:43:16.605 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-20T04:43:16.605 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 6.11.0-rc3-g7e35574567e1 2024-08-20T04:43:16.605 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-20T04:43:17.203 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2024-08-20T04:43:18.502 INFO:teuthology.orchestra.run.smithi037.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-20T04:43:18.526 INFO:teuthology.orchestra.run.smithi037.stderr:done 2024-08-20T04:43:18.527 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-08-20T04:43:18.552 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.x189UJHC7s 2024-08-20T04:43:18.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.x189UJHC7s 2024-08-20T04:43:18.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.x189UJHC7s 2024-08-20T04:43:18.797 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.x189UJHC7s is 6KB 2024-08-20T04:43:18.828 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.x189UJHC7s 2024-08-20T04:43:18.845 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2024-08-20T04:43:18.912 INFO:teuthology.orchestra.run.smithi037.stdout:8332a92de9a04ac1a6fcd1d1c6f57498-0-rescue.conf 2024-08-20T04:43:18.912 INFO:teuthology.orchestra.run.smithi037.stdout:8332a92de9a04ac1a6fcd1d1c6f57498-5.14.0-239.el9.x86_64.conf 2024-08-20T04:43:18.912 INFO:teuthology.orchestra.run.smithi037.stdout:8332a92de9a04ac1a6fcd1d1c6f57498-5.14.0-496.el9.x86_64.conf 2024-08-20T04:43:18.912 INFO:teuthology.orchestra.run.smithi037.stdout:8332a92de9a04ac1a6fcd1d1c6f57498-6.11.0-rc3-g7e35574567e1.conf 2024-08-20T04:43:18.913 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default 8332a92de9a04ac1a6fcd1d1c6f57498-6.11.0-rc3-g7e35574567e1 2024-08-20T04:43:19.058 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2024-08-20T04:43:49.061 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-20T04:43:49.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-08-20T04:43:49.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T04:44:23.647 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-08-20T04:44:32.648 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-08-20T04:44:32.649 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T04:44:35.710 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-08-20T04:44:47.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-08-20T04:44:47.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T04:44:50.782 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-08-20T04:45:05.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-08-20T04:45:05.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T04:45:06.274 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-08-20T04:45:07.020 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-08-20T04:45:07.020 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7e35574567e1"... 2024-08-20T04:45:07.021 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-08-20T04:45:07.055 INFO:teuthology.orchestra.run.smithi037.stdout:6.11.0-rc3-g7e35574567e1 2024-08-20T04:45:07.055 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7e35574567e1 vs 6.11.0-rc3-g7e35574567e1 2024-08-20T04:45:07.055 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-20T04:45:07.056 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-20T04:45:08.057 DEBUG:teuthology.parallel:result is None 2024-08-20T04:45:08.057 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-20T04:45:08.067 INFO:teuthology.task.internal:Creating test directory... 2024-08-20T04:45:08.067 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-20T04:45:08.071 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-20T04:45:08.074 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-20T04:45:08.102 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-20T04:45:08.108 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-20T04:45:08.117 INFO:teuthology.task.internal:Creating archive directory... 2024-08-20T04:45:08.117 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-20T04:45:08.146 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-20T04:45:08.148 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-20T04:45:08.218 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-20T04:45:08.224 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-20T04:45:08.224 DEBUG:teuthology.orchestra.run.smithi130:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-20T04:45:08.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T04:45:08.241 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-20T04:45:08.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T04:45:08.258 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-20T04:45:08.262 DEBUG:teuthology.orchestra.run.smithi130:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-20T04:45:08.283 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-20T04:45:08.321 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T04:45:08.342 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T04:45:08.345 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T04:45:08.364 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T04:45:08.742 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T04:45:08.844 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-20T04:45:08.848 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-20T04:45:08.855 INFO:teuthology.task.internal:Configuring sudo... 2024-08-20T04:45:08.855 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-20T04:45:08.859 DEBUG:teuthology.orchestra.run.smithi130:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-20T04:45:08.862 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-20T04:45:08.914 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-20T04:45:08.923 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-20T04:45:08.923 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-20T04:45:08.927 DEBUG:teuthology.orchestra.run.smithi130:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-20T04:45:08.932 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-20T04:45:08.958 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T04:45:09.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T04:45:09.141 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T04:45:09.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T04:45:09.273 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T04:45:09.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-20T04:45:09.328 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T04:45:09.372 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T04:45:09.429 DEBUG:teuthology.orchestra.run.smithi130:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T04:45:09.514 DEBUG:teuthology.orchestra.run.smithi130:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T04:45:09.556 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-20T04:45:09.557 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-20T04:45:09.624 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T04:45:09.671 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-20T04:45:09.725 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T04:45:09.811 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-20T04:45:09.854 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-20T04:45:09.854 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-20T04:45:09.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2024-08-20T04:45:09.926 DEBUG:teuthology.orchestra.run.smithi130:> sudo service rsyslog restart 2024-08-20T04:45:09.928 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-08-20T04:45:09.973 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T04:45:09.996 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T04:45:10.009 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T04:45:10.531 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-20T04:45:10.538 INFO:teuthology.task.internal:Starting timer... 2024-08-20T04:45:10.538 INFO:teuthology.run_tasks:Running task pcp... 2024-08-20T04:45:10.561 INFO:teuthology.run_tasks:Running task selinux... 2024-08-20T04:45:10.569 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-08-20T04:45:10.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2024-08-20T04:45:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2024-08-20T04:45:10.657 DEBUG:teuthology.orchestra.run.smithi130:> sudo service auditd rotate 2024-08-20T04:45:10.737 INFO:teuthology.orchestra.run.smithi130.stdout:Rotating logs: 2024-08-20T04:45:10.739 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2024-08-20T04:45:10.800 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2024-08-20T04:45:10.802 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-20T04:45:10.802 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2024-08-20T04:45:10.842 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2024-08-20T04:45:10.842 DEBUG:teuthology.orchestra.run.smithi130:> /usr/sbin/getenforce 2024-08-20T04:45:10.867 INFO:teuthology.orchestra.run.smithi130.stdout:Permissive 2024-08-20T04:45:10.867 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2024-08-20T04:45:10.914 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2024-08-20T04:45:10.914 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi130.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive'} 2024-08-20T04:45:10.914 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T04:45:10.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T04:45:10.970 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T04:45:10.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T04:45:10.998 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T04:45:11.028 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T04:45:11.028 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-20T04:45:11.028 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2024-08-20T04:45:11.083 DEBUG:teuthology.orchestra.run.smithi130:> sudo /usr/sbin/setenforce permissive 2024-08-20T04:45:11.109 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2024-08-20T04:45:11.136 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-20T04:45:11.145 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-08-20T04:45:11.148 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-08-20T04:45:11.256 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-20T04:45:11.266 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-20T04:45:11.267 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi130.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-20T04:47:23.388 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi130.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2024-08-20T04:47:23.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-08-20T04:47:23.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T04:47:23.481 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-08-20T04:47:23.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-08-20T04:47:23.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-08-20T04:47:23.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi130.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T04:47:23.676 DEBUG:teuthology.orchestra.run.smithi130:> true 2024-08-20T04:47:23.758 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi130.front.sepia.ceph.com' 2024-08-20T04:47:23.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-08-20T04:47:23.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-20T04:47:23.837 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-08-20T04:47:23.927 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-08-20T04:47:23.927 INFO:teuthology.run_tasks:Running task clock... 2024-08-20T04:47:23.940 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-20T04:47:23.940 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-20T04:47:23.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T04:47:23.945 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-20T04:47:23.945 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T04:47:23.947 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-20T04:47:23.947 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T04:47:23.976 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-20T04:47:23.991 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-20T04:47:23.998 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-20T04:47:24.004 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-20T04:47:24.013 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-20T04:47:24.015 INFO:teuthology.orchestra.run.smithi130.stderr:sudo: ntpd: command not found 2024-08-20T04:47:24.026 INFO:teuthology.orchestra.run.smithi130.stdout:506 Cannot talk to daemon 2024-08-20T04:47:24.035 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-20T04:47:24.038 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2024-08-20T04:47:24.041 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-20T04:47:24.049 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2024-08-20T04:47:24.055 INFO:teuthology.orchestra.run.smithi130.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-20T04:47:24.064 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-20T04:47:24.077 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-20T04:47:24.086 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2024-08-20T04:47:24.111 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2024-08-20T04:47:24.111 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2024-08-20T04:47:24.115 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T04:47:24.115 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2024-08-20T04:47:24.116 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T04:47:24.116 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T04:47:24.116 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T04:47:24.116 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T04:47:24.138 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-08-20T04:47:24.141 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-20T04:47:24.141 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T04:47:24.141 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-08-20T04:47:24.141 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T04:47:24.141 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T04:47:24.142 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T04:47:24.142 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T04:47:24.170 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-20T04:47:24.262 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-08-20T04:47:24.268 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T04:47:24.268 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-08-20T04:47:24.268 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T04:47:24.269 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T04:47:24.269 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T04:47:24.269 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T04:47:24.270 INFO:teuthology.run_tasks:Running task install... 2024-08-20T04:47:24.278 DEBUG:teuthology.task.install:project ceph 2024-08-20T04:47:24.278 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1'}} 2024-08-20T04:47:24.278 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1'} 2024-08-20T04:47:24.278 INFO:teuthology.task.install:Using flavor: default 2024-08-20T04:47:24.283 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-20T04:47:24.283 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-20T04:47:24.284 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1', 'tag': None, 'wait_for_package': False} 2024-08-20T04:47:24.284 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T04:47:24.286 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1', 'tag': None, 'wait_for_package': False} 2024-08-20T04:47:24.286 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T04:47:24.287 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1', 'tag': None, 'wait_for_package': False} 2024-08-20T04:47:24.287 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T04:47:24.436 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/ 2024-08-20T04:47:24.436 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5872.gef427541 2024-08-20T04:47:24.443 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/ 2024-08-20T04:47:24.443 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5872.gef427541 2024-08-20T04:47:24.448 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/ 2024-08-20T04:47:24.448 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5872.gef427541 2024-08-20T04:47:24.545 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-20T04:47:24.545 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-20T04:47:24.546 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-20T04:47:24.552 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-20T04:47:24.552 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T04:47:24.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-20T04:47:24.561 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-20T04:47:24.561 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-20T04:47:24.562 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-20T04:47:24.573 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-20T04:47:24.573 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ef4275410d8483698016fe484b2a3c664080b4c1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-20T04:47:24.587 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-20T04:47:24.587 DEBUG:teuthology.orchestra.run.smithi130:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ef4275410d8483698016fe484b2a3c664080b4c1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-20T04:47:24.609 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-20T04:47:24.609 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ef4275410d8483698016fe484b2a3c664080b4c1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-20T04:47:24.640 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-20T04:47:24.653 DEBUG:teuthology.orchestra.run.smithi130:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-20T04:47:24.706 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-20T04:47:24.716 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-20T04:47:24.728 DEBUG:teuthology.orchestra.run.smithi130:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-20T04:47:24.780 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2024-08-20T04:47:24.782 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2024-08-20T04:47:24.785 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-20T04:47:24.792 INFO:teuthology.orchestra.run.smithi130.stdout:check_obsoletes = 1 2024-08-20T04:47:24.794 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum clean all 2024-08-20T04:47:24.840 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2024-08-20T04:47:24.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2024-08-20T04:47:25.005 INFO:teuthology.orchestra.run.smithi135.stdout:45 files removed 2024-08-20T04:47:25.019 INFO:teuthology.orchestra.run.smithi130.stdout:45 files removed 2024-08-20T04:47:25.032 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-20T04:47:25.046 DEBUG:teuthology.orchestra.run.smithi130:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-20T04:47:25.133 INFO:teuthology.orchestra.run.smithi037.stdout:45 files removed 2024-08-20T04:47:25.166 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-20T04:47:25.582 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-08-20T04:47:25.584 INFO:teuthology.orchestra.run.smithi130.stdout:ceph packages for x86_64 319 kB/s | 84 kB 00:00 2024-08-20T04:47:25.852 INFO:teuthology.orchestra.run.smithi130.stdout:ceph noarch packages 107 kB/s | 24 kB 00:00 2024-08-20T04:47:25.866 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-08-20T04:47:26.000 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 197 kB/s | 84 kB 00:00 2024-08-20T04:47:26.111 INFO:teuthology.orchestra.run.smithi130.stdout:ceph source packages 8.6 kB/s | 1.9 kB 00:00 2024-08-20T04:47:26.141 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-08-20T04:47:26.325 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 86 kB/s | 24 kB 00:00 2024-08-20T04:47:26.610 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-08-20T04:47:28.509 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - BaseOS 3.5 MB/s | 8.2 MB 00:02 2024-08-20T04:47:31.673 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 1.6 MB/s | 8.2 MB 00:05 2024-08-20T04:47:32.316 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 1.3 MB/s | 8.2 MB 00:06 2024-08-20T04:47:35.158 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 8.8 MB/s | 20 MB 00:02 2024-08-20T04:47:37.861 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 20 MB 00:08 2024-08-20T04:47:40.736 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 2.8 MB/s | 20 MB 00:07 2024-08-20T04:47:41.937 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.6 MB 00:02 2024-08-20T04:47:43.543 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 86 kB/s | 18 kB 00:00 2024-08-20T04:47:44.831 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 19 MB/s | 22 MB 00:01 2024-08-20T04:47:45.215 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - CRB 1.8 MB/s | 6.6 MB 00:03 2024-08-20T04:47:46.640 INFO:teuthology.orchestra.run.smithi130.stdout:CentOS Stream 9 - Extras packages 104 kB/s | 18 kB 00:00 2024-08-20T04:47:46.930 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 2.8 MB/s | 6.6 MB 00:02 2024-08-20T04:47:47.528 INFO:teuthology.orchestra.run.smithi130.stdout:Extra Packages for Enterprise Linux 29 MB/s | 22 MB 00:00 2024-08-20T04:47:48.332 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 121 kB/s | 18 kB 00:00 2024-08-20T04:47:49.362 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-20T04:47:51.253 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-20T04:47:52.958 INFO:teuthology.orchestra.run.smithi130.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-20T04:47:53.773 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T04:47:53.774 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T04:47:53.788 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-20T04:47:53.789 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-20T04:47:53.790 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-20T04:47:53.791 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-20T04:47:53.793 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-20T04:47:53.796 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-20T04:47:53.797 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-20T04:47:53.867 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-08-20T04:47:53.880 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-08-20T04:47:53.881 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-08-20T04:47:53.881 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-08-20T04:47:53.881 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-08-20T04:47:53.881 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-20T04:47:53.881 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:19.0.0-5872.gef427541.el9 ceph 6.6 k 2024-08-20T04:47:53.881 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T04:47:53.881 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 901 k 2024-08-20T04:47:53.881 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5872.gef427541.el9 ceph 145 k 2024-08-20T04:47:53.881 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:19.0.0-5872.gef427541.el9 ceph 1.5 M 2024-08-20T04:47:53.881 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 150 k 2024-08-20T04:47:53.881 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 14 M 2024-08-20T04:47:53.881 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 7.4 M 2024-08-20T04:47:53.881 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 49 k 2024-08-20T04:47:53.882 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 11 M 2024-08-20T04:47:53.882 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:19.0.0-5872.gef427541.el9 ceph 50 M 2024-08-20T04:47:53.882 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 285 k 2024-08-20T04:47:53.882 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 772 k 2024-08-20T04:47:53.882 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 225 k 2024-08-20T04:47:53.882 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell x86_64 2:19.0.0-5872.gef427541.el9 ceph 27 k 2024-08-20T04:47:53.882 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 18 k 2024-08-20T04:47:53.882 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-20T04:47:53.882 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-20T04:47:53.882 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-20T04:47:53.882 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 32 k 2024-08-20T04:47:53.882 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 755 k 2024-08-20T04:47:53.883 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 126 k 2024-08-20T04:47:53.883 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-20T04:47:53.883 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-20T04:47:53.883 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-20T04:47:53.883 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-20T04:47:53.883 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-20T04:47:53.883 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-20T04:47:53.883 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:19.0.0-5872.gef427541.el9 ceph 188 k 2024-08-20T04:47:53.883 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:19.0.0-5872.gef427541.el9 ceph 371 k 2024-08-20T04:47:53.883 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 355 k 2024-08-20T04:47:53.883 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 116 k 2024-08-20T04:47:53.883 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 85 k 2024-08-20T04:47:53.884 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T04:47:53.884 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 170 k 2024-08-20T04:47:53.884 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-20T04:47:53.884 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2024-08-20T04:47:53.884 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.5 M 2024-08-20T04:47:53.884 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T04:47:53.884 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-08-20T04:47:53.884 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-20T04:47:53.884 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-20T04:47:53.884 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-20T04:47:53.884 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 22 M 2024-08-20T04:47:53.884 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 34 k 2024-08-20T04:47:53.884 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:19.0.0-5872.gef427541.el9 ceph 2.4 M 2024-08-20T04:47:53.884 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 284 k 2024-08-20T04:47:53.885 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:19.0.0-5872.gef427541.el9 ceph 4.8 M 2024-08-20T04:47:53.885 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:19.0.0-5872.gef427541.el9 ceph 17 M 2024-08-20T04:47:53.885 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 16 k 2024-08-20T04:47:53.885 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:19.0.0-5872.gef427541.el9 ceph 25 k 2024-08-20T04:47:53.885 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-20T04:47:53.885 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-20T04:47:53.885 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-20T04:47:53.885 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-20T04:47:53.885 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-20T04:47:53.885 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-20T04:47:53.885 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-20T04:47:53.885 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-20T04:47:53.885 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:19.0.0-5872.gef427541.el9 ceph 163 k 2024-08-20T04:47:53.886 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-20T04:47:53.886 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-20T04:47:53.886 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-20T04:47:53.886 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-20T04:47:53.886 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-20T04:47:53.886 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 508 k 2024-08-20T04:47:53.886 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-20T04:47:53.886 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T04:47:53.886 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-20T04:47:53.886 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-20T04:47:53.886 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-20T04:47:53.886 INFO:teuthology.orchestra.run.smithi037.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-20T04:47:53.886 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-20T04:47:53.886 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-20T04:47:53.886 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-20T04:47:53.887 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-20T04:47:53.887 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-20T04:47:53.887 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-20T04:47:53.887 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-20T04:47:53.887 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-20T04:47:53.887 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-20T04:47:53.887 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-20T04:47:53.887 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-20T04:47:53.887 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-20T04:47:53.887 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-20T04:47:53.887 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:19.0.0-5872.gef427541.el9 ceph 45 k 2024-08-20T04:47:53.887 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 138 k 2024-08-20T04:47:53.887 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-20T04:47:53.887 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-20T04:47:53.888 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-20T04:47:53.888 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-20T04:47:53.888 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-20T04:47:53.888 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-20T04:47:53.888 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-20T04:47:53.888 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-20T04:47:53.888 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-20T04:47:53.888 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-20T04:47:53.888 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-20T04:47:53.888 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-20T04:47:53.888 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-20T04:47:53.888 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-20T04:47:53.888 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-20T04:47:53.889 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-20T04:47:53.889 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-20T04:47:53.889 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-20T04:47:53.889 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-20T04:47:53.889 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-20T04:47:53.889 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-20T04:47:53.889 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-20T04:47:53.889 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-20T04:47:53.889 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-20T04:47:53.889 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-20T04:47:53.889 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-20T04:47:53.889 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-20T04:47:53.889 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-20T04:47:53.889 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-20T04:47:53.889 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-20T04:47:53.890 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-20T04:47:53.890 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-20T04:47:53.890 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-20T04:47:53.890 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-20T04:47:53.890 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-20T04:47:53.890 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-20T04:47:53.890 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-20T04:47:53.890 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-20T04:47:53.890 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-20T04:47:53.890 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-20T04:47:53.890 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-20T04:47:53.890 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-20T04:47:53.890 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-20T04:47:53.890 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-20T04:47:53.891 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-20T04:47:53.891 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-20T04:47:53.891 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-20T04:47:53.891 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-20T04:47:53.891 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-20T04:47:53.891 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-20T04:47:53.891 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-20T04:47:53.891 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-20T04:47:53.891 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-20T04:47:53.891 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-20T04:47:53.891 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-20T04:47:53.891 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-20T04:47:53.891 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-20T04:47:53.891 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-20T04:47:53.892 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-20T04:47:53.892 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-20T04:47:53.892 INFO:teuthology.orchestra.run.smithi037.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-20T04:47:53.892 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-20T04:47:53.892 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-20T04:47:53.892 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2024-08-20T04:47:53.892 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-20T04:47:53.892 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:47:53.892 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-08-20T04:47:53.892 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-08-20T04:47:53.892 INFO:teuthology.orchestra.run.smithi037.stdout:Install 148 Packages 2024-08-20T04:47:53.892 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 2 Packages 2024-08-20T04:47:53.892 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:47:53.893 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 232 M 2024-08-20T04:47:53.893 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-08-20T04:47:54.713 INFO:teuthology.orchestra.run.smithi037.stdout:(1/150): ceph-19.0.0-5872.gef427541.el9.x86_64. 42 kB/s | 6.6 kB 00:00 2024-08-20T04:47:54.834 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-08-20T04:47:54.946 INFO:teuthology.orchestra.run.smithi037.stdout:(2/150): ceph-fuse-19.0.0-5872.gef427541.el9.x8 3.8 MB/s | 901 kB 00:00 2024-08-20T04:47:55.071 INFO:teuthology.orchestra.run.smithi037.stdout:(3/150): ceph-base-19.0.0-5872.gef427541.el9.x8 11 MB/s | 5.5 MB 00:00 2024-08-20T04:47:55.096 INFO:teuthology.orchestra.run.smithi037.stdout:(4/150): ceph-immutable-object-cache-19.0.0-587 967 kB/s | 145 kB 00:00 2024-08-20T04:47:55.145 INFO:teuthology.orchestra.run.smithi130.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T04:47:55.146 INFO:teuthology.orchestra.run.smithi130.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T04:47:55.157 INFO:teuthology.orchestra.run.smithi130.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-20T04:47:55.158 INFO:teuthology.orchestra.run.smithi130.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-20T04:47:55.159 INFO:teuthology.orchestra.run.smithi130.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-20T04:47:55.160 INFO:teuthology.orchestra.run.smithi130.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-20T04:47:55.161 INFO:teuthology.orchestra.run.smithi130.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-20T04:47:55.164 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-20T04:47:55.164 INFO:teuthology.orchestra.run.smithi130.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-20T04:47:55.222 INFO:teuthology.orchestra.run.smithi037.stdout:(5/150): ceph-mds-19.0.0-5872.gef427541.el9.x86 16 MB/s | 2.4 MB 00:00 2024-08-20T04:47:55.224 INFO:teuthology.orchestra.run.smithi130.stdout:Dependencies resolved. 2024-08-20T04:47:55.240 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================= 2024-08-20T04:47:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: Package Arch Version Repository Size 2024-08-20T04:47:55.240 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================= 2024-08-20T04:47:55.240 INFO:teuthology.orchestra.run.smithi130.stdout:Installing: 2024-08-20T04:47:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-20T04:47:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: ceph x86_64 2:19.0.0-5872.gef427541.el9 ceph 6.6 k 2024-08-20T04:47:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T04:47:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 901 k 2024-08-20T04:47:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5872.gef427541.el9 ceph 145 k 2024-08-20T04:47:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr x86_64 2:19.0.0-5872.gef427541.el9 ceph 1.5 M 2024-08-20T04:47:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 150 k 2024-08-20T04:47:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 14 M 2024-08-20T04:47:55.240 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 7.4 M 2024-08-20T04:47:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 49 k 2024-08-20T04:47:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 11 M 2024-08-20T04:47:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test x86_64 2:19.0.0-5872.gef427541.el9 ceph 50 M 2024-08-20T04:47:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 285 k 2024-08-20T04:47:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 772 k 2024-08-20T04:47:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 225 k 2024-08-20T04:47:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-shell x86_64 2:19.0.0-5872.gef427541.el9 ceph 27 k 2024-08-20T04:47:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 18 k 2024-08-20T04:47:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-20T04:47:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-20T04:47:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-20T04:47:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 32 k 2024-08-20T04:47:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 755 k 2024-08-20T04:47:55.241 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 126 k 2024-08-20T04:47:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-20T04:47:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-20T04:47:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-20T04:47:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-20T04:47:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-20T04:47:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-20T04:47:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs x86_64 2:19.0.0-5872.gef427541.el9 ceph 188 k 2024-08-20T04:47:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados x86_64 2:19.0.0-5872.gef427541.el9 ceph 371 k 2024-08-20T04:47:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 355 k 2024-08-20T04:47:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 116 k 2024-08-20T04:47:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 85 k 2024-08-20T04:47:55.242 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T04:47:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 170 k 2024-08-20T04:47:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-20T04:47:55.243 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrading: 2024-08-20T04:47:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: librados2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.5 M 2024-08-20T04:47:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T04:47:55.243 INFO:teuthology.orchestra.run.smithi130.stdout:Installing dependencies: 2024-08-20T04:47:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-20T04:47:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-20T04:47:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-20T04:47:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 22 M 2024-08-20T04:47:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 34 k 2024-08-20T04:47:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds x86_64 2:19.0.0-5872.gef427541.el9 ceph 2.4 M 2024-08-20T04:47:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 284 k 2024-08-20T04:47:55.243 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon x86_64 2:19.0.0-5872.gef427541.el9 ceph 4.8 M 2024-08-20T04:47:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd x86_64 2:19.0.0-5872.gef427541.el9 ceph 17 M 2024-08-20T04:47:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 16 k 2024-08-20T04:47:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux x86_64 2:19.0.0-5872.gef427541.el9 ceph 25 k 2024-08-20T04:47:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-20T04:47:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-20T04:47:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-20T04:47:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-20T04:47:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-20T04:47:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-20T04:47:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-20T04:47:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-20T04:47:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite x86_64 2:19.0.0-5872.gef427541.el9 ceph 163 k 2024-08-20T04:47:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-20T04:47:55.244 INFO:teuthology.orchestra.run.smithi130.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-20T04:47:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-20T04:47:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-20T04:47:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-20T04:47:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 508 k 2024-08-20T04:47:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-20T04:47:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T04:47:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-20T04:47:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-20T04:47:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-20T04:47:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-20T04:47:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-20T04:47:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-20T04:47:55.245 INFO:teuthology.orchestra.run.smithi130.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-20T04:47:55.246 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-20T04:47:55.246 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-20T04:47:55.246 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-20T04:47:55.246 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-20T04:47:55.246 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-20T04:47:55.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-20T04:47:55.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-20T04:47:55.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-20T04:47:55.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-20T04:47:55.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-20T04:47:55.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse x86_64 2:19.0.0-5872.gef427541.el9 ceph 45 k 2024-08-20T04:47:55.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 138 k 2024-08-20T04:47:55.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-20T04:47:55.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-20T04:47:55.246 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-20T04:47:55.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-20T04:47:55.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-20T04:47:55.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-20T04:47:55.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-20T04:47:55.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-20T04:47:55.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-20T04:47:55.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-20T04:47:55.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-20T04:47:55.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-20T04:47:55.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-20T04:47:55.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-20T04:47:55.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-20T04:47:55.247 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-20T04:47:55.248 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-20T04:47:55.248 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-20T04:47:55.248 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-20T04:47:55.248 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-20T04:47:55.248 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-20T04:47:55.248 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-20T04:47:55.248 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-20T04:47:55.248 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-20T04:47:55.248 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-20T04:47:55.248 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-20T04:47:55.248 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-20T04:47:55.248 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-20T04:47:55.249 INFO:teuthology.orchestra.run.smithi130.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-20T04:47:55.249 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-20T04:47:55.249 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-20T04:47:55.249 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-20T04:47:55.249 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-20T04:47:55.249 INFO:teuthology.orchestra.run.smithi130.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-20T04:47:55.249 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-20T04:47:55.249 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-20T04:47:55.249 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-20T04:47:55.249 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-20T04:47:55.249 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-20T04:47:55.249 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-20T04:47:55.249 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-20T04:47:55.249 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-20T04:47:55.250 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-20T04:47:55.250 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-20T04:47:55.250 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-20T04:47:55.250 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-20T04:47:55.250 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-20T04:47:55.250 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-20T04:47:55.250 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-20T04:47:55.250 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-20T04:47:55.250 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-20T04:47:55.250 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-20T04:47:55.250 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-20T04:47:55.250 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-20T04:47:55.250 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-20T04:47:55.250 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-20T04:47:55.251 INFO:teuthology.orchestra.run.smithi130.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-20T04:47:55.251 INFO:teuthology.orchestra.run.smithi130.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-20T04:47:55.251 INFO:teuthology.orchestra.run.smithi130.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-20T04:47:55.251 INFO:teuthology.orchestra.run.smithi130.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-20T04:47:55.251 INFO:teuthology.orchestra.run.smithi130.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-20T04:47:55.251 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-20T04:47:55.251 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-20T04:47:55.251 INFO:teuthology.orchestra.run.smithi130.stdout:Installing weak dependencies: 2024-08-20T04:47:55.251 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-20T04:47:55.251 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:47:55.251 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction Summary 2024-08-20T04:47:55.251 INFO:teuthology.orchestra.run.smithi130.stdout:======================================================================================= 2024-08-20T04:47:55.251 INFO:teuthology.orchestra.run.smithi130.stdout:Install 148 Packages 2024-08-20T04:47:55.251 INFO:teuthology.orchestra.run.smithi130.stdout:Upgrade 2 Packages 2024-08-20T04:47:55.252 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:47:55.252 INFO:teuthology.orchestra.run.smithi130.stdout:Total download size: 232 M 2024-08-20T04:47:55.252 INFO:teuthology.orchestra.run.smithi130.stdout:Downloading Packages: 2024-08-20T04:47:55.456 INFO:teuthology.orchestra.run.smithi037.stdout:(6/150): ceph-mgr-19.0.0-5872.gef427541.el9.x86 4.2 MB/s | 1.5 MB 00:00 2024-08-20T04:47:55.531 INFO:teuthology.orchestra.run.smithi037.stdout:(7/150): ceph-mon-19.0.0-5872.gef427541.el9.x86 15 MB/s | 4.8 MB 00:00 2024-08-20T04:47:55.781 INFO:teuthology.orchestra.run.smithi037.stdout:(8/150): ceph-common-19.0.0-5872.gef427541.el9. 18 MB/s | 22 MB 00:01 2024-08-20T04:47:55.823 INFO:teuthology.orchestra.run.smithi037.stdout:(9/150): ceph-selinux-19.0.0-5872.gef427541.el9 611 kB/s | 25 kB 00:00 2024-08-20T04:47:56.135 INFO:teuthology.orchestra.run.smithi130.stdout:(1/150): ceph-19.0.0-5872.gef427541.el9.x86_64. 33 kB/s | 6.6 kB 00:00 2024-08-20T04:47:56.149 INFO:teuthology.orchestra.run.smithi037.stdout:(10/150): ceph-radosgw-19.0.0-5872.gef427541.el 18 MB/s | 11 MB 00:00 2024-08-20T04:47:56.199 INFO:teuthology.orchestra.run.smithi037.stdout:(11/150): cephfs-mirror-19.0.0-5872.gef427541.e 4.4 MB/s | 225 kB 00:00 2024-08-20T04:47:56.283 INFO:teuthology.orchestra.run.smithi037.stdout:(12/150): cephfs-shell-19.0.0-5872.gef427541.el 324 kB/s | 27 kB 00:00 2024-08-20T04:47:56.586 INFO:teuthology.orchestra.run.smithi130.stdout:(2/150): ceph-fuse-19.0.0-5872.gef427541.el9.x8 2.0 MB/s | 901 kB 00:00 2024-08-20T04:47:56.597 INFO:teuthology.orchestra.run.smithi037.stdout:(13/150): libcephfs-devel-19.0.0-5872.gef427541 101 kB/s | 32 kB 00:00 2024-08-20T04:47:56.686 INFO:teuthology.orchestra.run.smithi130.stdout:(3/150): ceph-immutable-object-cache-19.0.0-587 1.4 MB/s | 145 kB 00:00 2024-08-20T04:47:56.711 INFO:teuthology.orchestra.run.smithi037.stdout:(14/150): libcephfs2-19.0.0-5872.gef427541.el9. 6.5 MB/s | 755 kB 00:00 2024-08-20T04:47:56.787 INFO:teuthology.orchestra.run.smithi037.stdout:(15/150): libcephsqlite-19.0.0-5872.gef427541.e 2.1 MB/s | 163 kB 00:00 2024-08-20T04:47:56.886 INFO:teuthology.orchestra.run.smithi037.stdout:(16/150): librados-devel-19.0.0-5872.gef427541. 1.2 MB/s | 126 kB 00:00 2024-08-20T04:47:57.028 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T04:47:57.029 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-20T04:47:57.040 INFO:teuthology.orchestra.run.smithi135.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-08-20T04:47:57.041 INFO:teuthology.orchestra.run.smithi135.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-20T04:47:57.042 INFO:teuthology.orchestra.run.smithi135.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-20T04:47:57.043 INFO:teuthology.orchestra.run.smithi135.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-20T04:47:57.044 INFO:teuthology.orchestra.run.smithi135.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-20T04:47:57.047 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-20T04:47:57.048 INFO:teuthology.orchestra.run.smithi135.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-08-20T04:47:57.109 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-08-20T04:47:57.123 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-08-20T04:47:57.123 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-08-20T04:47:57.123 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-08-20T04:47:57.123 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-08-20T04:47:57.123 INFO:teuthology.orchestra.run.smithi135.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-20T04:47:57.123 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:19.0.0-5872.gef427541.el9 ceph 6.6 k 2024-08-20T04:47:57.123 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T04:47:57.123 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 901 k 2024-08-20T04:47:57.123 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5872.gef427541.el9 ceph 145 k 2024-08-20T04:47:57.123 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:19.0.0-5872.gef427541.el9 ceph 1.5 M 2024-08-20T04:47:57.123 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 150 k 2024-08-20T04:47:57.124 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 14 M 2024-08-20T04:47:57.124 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 7.4 M 2024-08-20T04:47:57.124 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 49 k 2024-08-20T04:47:57.124 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 11 M 2024-08-20T04:47:57.124 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:19.0.0-5872.gef427541.el9 ceph 50 M 2024-08-20T04:47:57.124 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 285 k 2024-08-20T04:47:57.124 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 772 k 2024-08-20T04:47:57.124 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 225 k 2024-08-20T04:47:57.124 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell x86_64 2:19.0.0-5872.gef427541.el9 ceph 27 k 2024-08-20T04:47:57.124 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 18 k 2024-08-20T04:47:57.124 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-20T04:47:57.124 INFO:teuthology.orchestra.run.smithi135.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-20T04:47:57.124 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-20T04:47:57.124 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 32 k 2024-08-20T04:47:57.125 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 755 k 2024-08-20T04:47:57.125 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:19.0.0-5872.gef427541.el9 ceph 126 k 2024-08-20T04:47:57.125 INFO:teuthology.orchestra.run.smithi135.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-20T04:47:57.125 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-20T04:47:57.125 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-20T04:47:57.125 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-08-20T04:47:57.125 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-08-20T04:47:57.125 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-08-20T04:47:57.125 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:19.0.0-5872.gef427541.el9 ceph 188 k 2024-08-20T04:47:57.125 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:19.0.0-5872.gef427541.el9 ceph 371 k 2024-08-20T04:47:57.125 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 355 k 2024-08-20T04:47:57.125 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:19.0.0-5872.gef427541.el9 ceph 116 k 2024-08-20T04:47:57.125 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:19.0.0-5872.gef427541.el9 ceph 85 k 2024-08-20T04:47:57.126 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T04:47:57.126 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:19.0.0-5872.gef427541.el9 ceph 170 k 2024-08-20T04:47:57.126 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-08-20T04:47:57.126 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2024-08-20T04:47:57.126 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.5 M 2024-08-20T04:47:57.126 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 3.2 M 2024-08-20T04:47:57.126 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-08-20T04:47:57.126 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-20T04:47:57.126 INFO:teuthology.orchestra.run.smithi135.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-20T04:47:57.126 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-20T04:47:57.126 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 22 M 2024-08-20T04:47:57.126 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 34 k 2024-08-20T04:47:57.126 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:19.0.0-5872.gef427541.el9 ceph 2.4 M 2024-08-20T04:47:57.127 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 284 k 2024-08-20T04:47:57.127 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:19.0.0-5872.gef427541.el9 ceph 4.8 M 2024-08-20T04:47:57.127 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:19.0.0-5872.gef427541.el9 ceph 17 M 2024-08-20T04:47:57.127 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5872.gef427541.el9 ceph-noarch 16 k 2024-08-20T04:47:57.127 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:19.0.0-5872.gef427541.el9 ceph 25 k 2024-08-20T04:47:57.127 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-20T04:47:57.127 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-20T04:47:57.127 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-20T04:47:57.127 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-20T04:47:57.127 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-20T04:47:57.127 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-20T04:47:57.127 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-20T04:47:57.127 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-20T04:47:57.127 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:19.0.0-5872.gef427541.el9 ceph 163 k 2024-08-20T04:47:57.128 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-08-20T04:47:57.128 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-20T04:47:57.128 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-20T04:47:57.128 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-08-20T04:47:57.128 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-20T04:47:57.130 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:19.0.0-5872.gef427541.el9 ceph 508 k 2024-08-20T04:47:57.130 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-20T04:47:57.130 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:19.0.0-5872.gef427541.el9 ceph 5.5 M 2024-08-20T04:47:57.130 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-20T04:47:57.130 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-20T04:47:57.130 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-20T04:47:57.130 INFO:teuthology.orchestra.run.smithi135.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-20T04:47:57.130 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-20T04:47:57.130 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-20T04:47:57.130 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.26-1.el9 appstream 38 k 2024-08-20T04:47:57.131 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp x86_64 0.3.26-1.el9 appstream 4.9 M 2024-08-20T04:47:57.131 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-20T04:47:57.131 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-08-20T04:47:57.131 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-20T04:47:57.131 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-20T04:47:57.131 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-20T04:47:57.131 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-20T04:47:57.131 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-20T04:47:57.131 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-20T04:47:57.131 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-20T04:47:57.131 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:19.0.0-5872.gef427541.el9 ceph 45 k 2024-08-20T04:47:57.131 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:19.0.0-5872.gef427541.el9 ceph 138 k 2024-08-20T04:47:57.131 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-20T04:47:57.131 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-20T04:47:57.132 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-20T04:47:57.132 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-20T04:47:57.132 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-20T04:47:57.132 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-20T04:47:57.132 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-20T04:47:57.132 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel x86_64 3.9.19-7.el9 appstream 245 k 2024-08-20T04:47:57.132 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-20T04:47:57.132 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-20T04:47:57.132 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-20T04:47:57.132 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-20T04:47:57.132 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-20T04:47:57.132 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-20T04:47:57.132 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-20T04:47:57.133 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-20T04:47:57.133 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-20T04:47:57.133 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-20T04:47:57.133 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-20T04:47:57.133 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-20T04:47:57.133 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-20T04:47:57.133 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-20T04:47:57.133 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-20T04:47:57.133 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-20T04:47:57.133 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-20T04:47:57.133 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-20T04:47:57.133 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-20T04:47:57.133 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-20T04:47:57.133 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-20T04:47:57.133 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-20T04:47:57.134 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-20T04:47:57.134 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-20T04:47:57.134 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-20T04:47:57.134 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-20T04:47:57.134 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-20T04:47:57.134 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-20T04:47:57.134 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-20T04:47:57.134 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-20T04:47:57.134 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-20T04:47:57.134 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-20T04:47:57.134 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-20T04:47:57.134 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-20T04:47:57.134 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-20T04:47:57.134 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-20T04:47:57.135 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-20T04:47:57.135 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-20T04:47:57.135 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-20T04:47:57.135 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-20T04:47:57.135 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-20T04:47:57.135 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-20T04:47:57.135 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-20T04:47:57.135 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-20T04:47:57.135 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-20T04:47:57.135 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-20T04:47:57.135 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-20T04:47:57.135 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-20T04:47:57.135 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-20T04:47:57.136 INFO:teuthology.orchestra.run.smithi135.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-20T04:47:57.136 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-20T04:47:57.136 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-20T04:47:57.136 INFO:teuthology.orchestra.run.smithi135.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-20T04:47:57.136 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-20T04:47:57.136 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-20T04:47:57.136 INFO:teuthology.orchestra.run.smithi135.stdout:Installing weak dependencies: 2024-08-20T04:47:57.136 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-20T04:47:57.136 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:47:57.136 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-08-20T04:47:57.136 INFO:teuthology.orchestra.run.smithi135.stdout:======================================================================================= 2024-08-20T04:47:57.136 INFO:teuthology.orchestra.run.smithi135.stdout:Install 148 Packages 2024-08-20T04:47:57.136 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 2 Packages 2024-08-20T04:47:57.136 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:47:57.137 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 232 M 2024-08-20T04:47:57.137 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-08-20T04:47:57.252 INFO:teuthology.orchestra.run.smithi130.stdout:(4/150): ceph-base-19.0.0-5872.gef427541.el9.x8 4.2 MB/s | 5.5 MB 00:01 2024-08-20T04:47:57.319 INFO:teuthology.orchestra.run.smithi130.stdout:(5/150): ceph-mds-19.0.0-5872.gef427541.el9.x86 3.7 MB/s | 2.4 MB 00:00 2024-08-20T04:47:57.328 INFO:teuthology.orchestra.run.smithi037.stdout:(17/150): ceph-osd-19.0.0-5872.gef427541.el9.x8 9.2 MB/s | 17 MB 00:01 2024-08-20T04:47:57.412 INFO:teuthology.orchestra.run.smithi037.stdout:(18/150): libradosstriper1-19.0.0-5872.gef42754 968 kB/s | 508 kB 00:00 2024-08-20T04:47:57.461 INFO:teuthology.orchestra.run.smithi130.stdout:(6/150): ceph-mgr-19.0.0-5872.gef427541.el9.x86 7.3 MB/s | 1.5 MB 00:00 2024-08-20T04:47:57.495 INFO:teuthology.orchestra.run.smithi037.stdout:(19/150): python3-ceph-argparse-19.0.0-5872.gef 544 kB/s | 45 kB 00:00 2024-08-20T04:47:57.587 INFO:teuthology.orchestra.run.smithi037.stdout:(20/150): python3-ceph-common-19.0.0-5872.gef42 1.5 MB/s | 138 kB 00:00 2024-08-20T04:47:57.679 INFO:teuthology.orchestra.run.smithi037.stdout:(21/150): python3-cephfs-19.0.0-5872.gef427541. 2.0 MB/s | 188 kB 00:00 2024-08-20T04:47:57.754 INFO:teuthology.orchestra.run.smithi037.stdout:(22/150): librgw2-19.0.0-5872.gef427541.el9.x86 13 MB/s | 5.5 MB 00:00 2024-08-20T04:47:57.779 INFO:teuthology.orchestra.run.smithi037.stdout:(23/150): python3-rados-19.0.0-5872.gef427541.e 3.6 MB/s | 371 kB 00:00 2024-08-20T04:47:57.838 INFO:teuthology.orchestra.run.smithi037.stdout:(24/150): python3-rbd-19.0.0-5872.gef427541.el9 4.2 MB/s | 355 kB 00:00 2024-08-20T04:47:57.888 INFO:teuthology.orchestra.run.smithi037.stdout:(25/150): python3-rgw-19.0.0-5872.gef427541.el9 1.0 MB/s | 116 kB 00:00 2024-08-20T04:47:57.914 INFO:teuthology.orchestra.run.smithi037.stdout:(26/150): rbd-fuse-19.0.0-5872.gef427541.el9.x8 1.1 MB/s | 85 kB 00:00 2024-08-20T04:47:57.927 INFO:teuthology.orchestra.run.smithi135.stdout:(1/150): ceph-19.0.0-5872.gef427541.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-08-20T04:47:58.014 INFO:teuthology.orchestra.run.smithi037.stdout:(27/150): rbd-nbd-19.0.0-5872.gef427541.el9.x86 1.7 MB/s | 170 kB 00:00 2024-08-20T04:47:58.114 INFO:teuthology.orchestra.run.smithi037.stdout:(28/150): ceph-grafana-dashboards-19.0.0-5872.g 344 kB/s | 34 kB 00:00 2024-08-20T04:47:58.200 INFO:teuthology.orchestra.run.smithi037.stdout:(29/150): rbd-mirror-19.0.0-5872.gef427541.el9. 10 MB/s | 3.2 MB 00:00 2024-08-20T04:47:58.231 INFO:teuthology.orchestra.run.smithi037.stdout:(30/150): ceph-mgr-cephadm-19.0.0-5872.gef42754 1.3 MB/s | 150 kB 00:00 2024-08-20T04:47:58.319 INFO:teuthology.orchestra.run.smithi130.stdout:(7/150): ceph-mon-19.0.0-5872.gef427541.el9.x86 4.8 MB/s | 4.8 MB 00:00 2024-08-20T04:47:58.594 INFO:teuthology.orchestra.run.smithi135.stdout:(2/150): ceph-fuse-19.0.0-5872.gef427541.el9.x8 1.3 MB/s | 901 kB 00:00 2024-08-20T04:47:58.661 INFO:teuthology.orchestra.run.smithi135.stdout:(3/150): ceph-immutable-object-cache-19.0.0-587 2.1 MB/s | 145 kB 00:00 2024-08-20T04:47:58.762 INFO:teuthology.orchestra.run.smithi130.stdout:(8/150): ceph-common-19.0.0-5872.gef427541.el9. 7.6 MB/s | 22 MB 00:02 2024-08-20T04:47:58.807 INFO:teuthology.orchestra.run.smithi037.stdout:(31/150): ceph-test-19.0.0-5872.gef427541.el9.x 17 MB/s | 50 MB 00:02 2024-08-20T04:47:58.811 INFO:teuthology.orchestra.run.smithi130.stdout:(9/150): ceph-selinux-19.0.0-5872.gef427541.el9 506 kB/s | 25 kB 00:00 2024-08-20T04:47:58.874 INFO:teuthology.orchestra.run.smithi037.stdout:(32/150): ceph-mgr-modules-core-19.0.0-5872.gef 4.2 MB/s | 284 kB 00:00 2024-08-20T04:47:58.982 INFO:teuthology.orchestra.run.smithi037.stdout:(33/150): ceph-mgr-rook-19.0.0-5872.gef427541.e 456 kB/s | 49 kB 00:00 2024-08-20T04:47:59.091 INFO:teuthology.orchestra.run.smithi037.stdout:(34/150): ceph-prometheus-alerts-19.0.0-5872.ge 152 kB/s | 16 kB 00:00 2024-08-20T04:47:59.258 INFO:teuthology.orchestra.run.smithi037.stdout:(35/150): ceph-mgr-diskprediction-local-19.0.0- 7.2 MB/s | 7.4 MB 00:01 2024-08-20T04:47:59.291 INFO:teuthology.orchestra.run.smithi037.stdout:(36/150): ceph-volume-19.0.0-5872.gef427541.el9 1.4 MB/s | 285 kB 00:00 2024-08-20T04:47:59.295 INFO:teuthology.orchestra.run.smithi135.stdout:(4/150): ceph-mds-19.0.0-5872.gef427541.el9.x86 3.7 MB/s | 2.4 MB 00:00 2024-08-20T04:47:59.358 INFO:teuthology.orchestra.run.smithi037.stdout:(37/150): cephadm-19.0.0-5872.gef427541.el9.noa 7.5 MB/s | 772 kB 00:00 2024-08-20T04:47:59.392 INFO:teuthology.orchestra.run.smithi037.stdout:(38/150): cephfs-top-19.0.0-5872.gef427541.el9. 182 kB/s | 18 kB 00:00 2024-08-20T04:47:59.570 INFO:teuthology.orchestra.run.smithi130.stdout:(10/150): ceph-osd-19.0.0-5872.gef427541.el9.x8 8.1 MB/s | 17 MB 00:02 2024-08-20T04:47:59.578 INFO:teuthology.orchestra.run.smithi135.stdout:(5/150): ceph-mgr-19.0.0-5872.gef427541.el9.x86 5.4 MB/s | 1.5 MB 00:00 2024-08-20T04:47:59.601 INFO:teuthology.orchestra.run.smithi037.stdout:(39/150): ceph-mgr-dashboard-19.0.0-5872.gef427 10 MB/s | 14 MB 00:01 2024-08-20T04:47:59.620 INFO:teuthology.orchestra.run.smithi130.stdout:(11/150): cephfs-mirror-19.0.0-5872.gef427541.e 4.4 MB/s | 225 kB 00:00 2024-08-20T04:47:59.654 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-20T04:47:59.679 INFO:teuthology.orchestra.run.smithi130.stdout:(12/150): cephfs-shell-19.0.0-5872.gef427541.el 464 kB/s | 27 kB 00:00 2024-08-20T04:47:59.710 INFO:teuthology.orchestra.run.smithi037.stdout:(40/150): fuse-2.9.9-16.el9.x86_64.rpm 227 kB/s | 80 kB 00:00 2024-08-20T04:47:59.720 INFO:teuthology.orchestra.run.smithi135.stdout:(6/150): ceph-base-19.0.0-5872.gef427541.el9.x8 2.7 MB/s | 5.5 MB 00:02 2024-08-20T04:47:59.737 INFO:teuthology.orchestra.run.smithi130.stdout:(13/150): libcephfs-devel-19.0.0-5872.gef427541 543 kB/s | 32 kB 00:00 2024-08-20T04:47:59.762 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-20T04:47:59.762 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-20T04:47:59.805 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T04:47:59.846 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://dfw.mirror.rackspace.com/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 74.205.112.120) 2024-08-20T04:47:59.866 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T04:47:59.883 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T04:47:59.888 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T04:47:59.944 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T04:47:59.948 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T04:47:59.998 INFO:teuthology.orchestra.run.smithi130.stdout:(14/150): libcephfs2-19.0.0-5872.gef427541.el9. 2.8 MB/s | 755 kB 00:00 2024-08-20T04:48:00.046 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T04:48:00.113 INFO:teuthology.orchestra.run.smithi130.stdout:(15/150): libcephsqlite-19.0.0-5872.gef427541.e 1.4 MB/s | 163 kB 00:00 2024-08-20T04:48:00.130 INFO:teuthology.orchestra.run.smithi037.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 603 kB/s | 253 kB 00:00 2024-08-20T04:48:00.131 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T04:48:00.162 INFO:teuthology.orchestra.run.smithi135.stdout:(7/150): ceph-mon-19.0.0-5872.gef427541.el9.x86 8.2 MB/s | 4.8 MB 00:00 2024-08-20T04:48:00.217 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T04:48:00.230 INFO:teuthology.orchestra.run.smithi130.stdout:(16/150): ceph-radosgw-19.0.0-5872.gef427541.el 5.7 MB/s | 11 MB 00:01 2024-08-20T04:48:00.246 INFO:teuthology.orchestra.run.smithi130.stdout:(17/150): librados-devel-19.0.0-5872.gef427541. 948 kB/s | 126 kB 00:00 2024-08-20T04:48:00.300 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T04:48:00.405 INFO:teuthology.orchestra.run.smithi130.stdout:(18/150): libradosstriper1-19.0.0-5872.gef42754 2.8 MB/s | 508 kB 00:00 2024-08-20T04:48:00.497 INFO:teuthology.orchestra.run.smithi130.stdout:(19/150): python3-ceph-argparse-19.0.0-5872.gef 493 kB/s | 45 kB 00:00 2024-08-20T04:48:00.570 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T04:48:00.597 INFO:teuthology.orchestra.run.smithi130.stdout:(20/150): python3-ceph-common-19.0.0-5872.gef42 1.4 MB/s | 138 kB 00:00 2024-08-20T04:48:00.625 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T04:48:00.652 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-osl.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 140.211.166.134) 2024-08-20T04:48:00.692 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T04:48:00.698 INFO:teuthology.orchestra.run.smithi130.stdout:(21/150): python3-cephfs-19.0.0-5872.gef427541. 1.8 MB/s | 188 kB 00:00 2024-08-20T04:48:00.716 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-20T04:48:00.747 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-20T04:48:00.756 INFO:teuthology.orchestra.run.smithi130.stdout:(22/150): python3-rados-19.0.0-5872.gef427541.e 6.2 MB/s | 371 kB 00:00 2024-08-20T04:48:00.840 INFO:teuthology.orchestra.run.smithi130.stdout:(23/150): python3-rbd-19.0.0-5872.gef427541.el9 4.2 MB/s | 355 kB 00:00 2024-08-20T04:48:00.871 INFO:teuthology.orchestra.run.smithi135.stdout:(8/150): ceph-common-19.0.0-5872.gef427541.el9. 6.8 MB/s | 22 MB 00:03 2024-08-20T04:48:00.937 INFO:teuthology.orchestra.run.smithi135.stdout:(9/150): ceph-selinux-19.0.0-5872.gef427541.el9 379 kB/s | 25 kB 00:00 2024-08-20T04:48:00.948 INFO:teuthology.orchestra.run.smithi130.stdout:(24/150): librgw2-19.0.0-5872.gef427541.el9.x86 7.8 MB/s | 5.5 MB 00:00 2024-08-20T04:48:00.974 INFO:teuthology.orchestra.run.smithi130.stdout:(25/150): python3-rgw-19.0.0-5872.gef427541.el9 868 kB/s | 116 kB 00:00 2024-08-20T04:48:01.032 INFO:teuthology.orchestra.run.smithi130.stdout:(26/150): rbd-fuse-19.0.0-5872.gef427541.el9.x8 1.0 MB/s | 85 kB 00:00 2024-08-20T04:48:01.099 INFO:teuthology.orchestra.run.smithi130.stdout:(27/150): rbd-nbd-19.0.0-5872.gef427541.el9.x86 2.5 MB/s | 170 kB 00:00 2024-08-20T04:48:01.129 INFO:teuthology.orchestra.run.smithi135.stdout:(10/150): ceph-radosgw-19.0.0-5872.gef427541.el 11 MB/s | 11 MB 00:00 2024-08-20T04:48:01.158 INFO:teuthology.orchestra.run.smithi130.stdout:(28/150): ceph-grafana-dashboards-19.0.0-5872.g 590 kB/s | 34 kB 00:00 2024-08-20T04:48:01.239 INFO:teuthology.orchestra.run.smithi130.stdout:(29/150): ceph-mgr-cephadm-19.0.0-5872.gef42754 1.8 MB/s | 150 kB 00:00 2024-08-20T04:48:01.305 INFO:teuthology.orchestra.run.smithi135.stdout:(11/150): ceph-osd-19.0.0-5872.gef427541.el9.x8 11 MB/s | 17 MB 00:01 2024-08-20T04:48:01.330 INFO:teuthology.orchestra.run.smithi135.stdout:(12/150): cephfs-mirror-19.0.0-5872.gef427541.e 1.1 MB/s | 225 kB 00:00 2024-08-20T04:48:01.372 INFO:teuthology.orchestra.run.smithi135.stdout:(13/150): cephfs-shell-19.0.0-5872.gef427541.el 405 kB/s | 27 kB 00:00 2024-08-20T04:48:01.397 INFO:teuthology.orchestra.run.smithi135.stdout:(14/150): libcephfs-devel-19.0.0-5872.gef427541 475 kB/s | 32 kB 00:00 2024-08-20T04:48:01.406 INFO:teuthology.orchestra.run.smithi130.stdout:(30/150): rbd-mirror-19.0.0-5872.gef427541.el9. 7.3 MB/s | 3.2 MB 00:00 2024-08-20T04:48:01.418 INFO:teuthology.orchestra.run.smithi037.stdout:(42/150): python3-cryptography-36.0.1-4.el9.x86 975 kB/s | 1.2 MB 00:01 2024-08-20T04:48:01.447 INFO:teuthology.orchestra.run.smithi135.stdout:(15/150): libcephfs2-19.0.0-5872.gef427541.el9. 9.8 MB/s | 755 kB 00:00 2024-08-20T04:48:01.461 INFO:teuthology.orchestra.run.smithi037.stdout:(43/150): libquadmath-11.5.0-2.el9.x86_64.rpm 103 kB/s | 191 kB 00:01 2024-08-20T04:48:01.489 INFO:teuthology.orchestra.run.smithi135.stdout:(16/150): libcephsqlite-19.0.0-5872.gef427541.e 1.7 MB/s | 163 kB 00:00 2024-08-20T04:48:01.532 INFO:teuthology.orchestra.run.smithi135.stdout:(17/150): librados-devel-19.0.0-5872.gef427541. 1.5 MB/s | 126 kB 00:00 2024-08-20T04:48:01.582 INFO:teuthology.orchestra.run.smithi135.stdout:(18/150): libradosstriper1-19.0.0-5872.gef42754 5.4 MB/s | 508 kB 00:00 2024-08-20T04:48:01.683 INFO:teuthology.orchestra.run.smithi135.stdout:(19/150): python3-ceph-argparse-19.0.0-5872.gef 452 kB/s | 45 kB 00:00 2024-08-20T04:48:01.702 INFO:teuthology.orchestra.run.smithi037.stdout:(44/150): libgfortran-11.5.0-2.el9.x86_64.rpm 347 kB/s | 801 kB 00:02 2024-08-20T04:48:01.786 INFO:teuthology.orchestra.run.smithi037.stdout:(45/150): python3-ply-3.11-14.el9.noarch.rpm 290 kB/s | 106 kB 00:00 2024-08-20T04:48:01.788 INFO:teuthology.orchestra.run.smithi135.stdout:(20/150): python3-ceph-common-19.0.0-5872.gef42 1.3 MB/s | 138 kB 00:00 2024-08-20T04:48:01.811 INFO:teuthology.orchestra.run.smithi037.stdout:(46/150): python3-pycparser-2.20-6.el9.noarch.r 400 kB/s | 135 kB 00:00 2024-08-20T04:48:01.889 INFO:teuthology.orchestra.run.smithi135.stdout:(21/150): python3-cephfs-19.0.0-5872.gef427541. 1.8 MB/s | 188 kB 00:00 2024-08-20T04:48:01.997 INFO:teuthology.orchestra.run.smithi135.stdout:(22/150): python3-rados-19.0.0-5872.gef427541.e 3.4 MB/s | 371 kB 00:00 2024-08-20T04:48:02.037 INFO:teuthology.orchestra.run.smithi037.stdout:(47/150): python3-requests-2.25.1-8.el9.noarch. 373 kB/s | 125 kB 00:00 2024-08-20T04:48:02.072 INFO:teuthology.orchestra.run.smithi135.stdout:(23/150): librgw2-19.0.0-5872.gef427541.el9.x86 10 MB/s | 5.5 MB 00:00 2024-08-20T04:48:02.098 INFO:teuthology.orchestra.run.smithi135.stdout:(24/150): python3-rbd-19.0.0-5872.gef427541.el9 3.5 MB/s | 355 kB 00:00 2024-08-20T04:48:02.120 INFO:teuthology.orchestra.run.smithi037.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-08-20T04:48:02.140 INFO:teuthology.orchestra.run.smithi135.stdout:(25/150): python3-rgw-19.0.0-5872.gef427541.el9 1.7 MB/s | 116 kB 00:00 2024-08-20T04:48:02.173 INFO:teuthology.orchestra.run.smithi135.stdout:(26/150): rbd-fuse-19.0.0-5872.gef427541.el9.x8 1.1 MB/s | 85 kB 00:00 2024-08-20T04:48:02.179 INFO:teuthology.orchestra.run.smithi037.stdout:(49/150): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-08-20T04:48:02.230 INFO:teuthology.orchestra.run.smithi037.stdout:(50/150): python3-urllib3-1.26.5-6.el9.noarch.r 485 kB/s | 215 kB 00:00 2024-08-20T04:48:02.265 INFO:teuthology.orchestra.run.smithi135.stdout:(27/150): rbd-nbd-19.0.0-5872.gef427541.el9.x86 1.8 MB/s | 170 kB 00:00 2024-08-20T04:48:02.271 INFO:teuthology.orchestra.run.smithi037.stdout:(51/150): elfutils-libelf-devel-0.191-4.el9.x86 236 kB/s | 22 kB 00:00 2024-08-20T04:48:02.357 INFO:teuthology.orchestra.run.smithi135.stdout:(28/150): ceph-grafana-dashboards-19.0.0-5872.g 374 kB/s | 34 kB 00:00 2024-08-20T04:48:02.364 INFO:teuthology.orchestra.run.smithi037.stdout:(52/150): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-08-20T04:48:02.422 INFO:teuthology.orchestra.run.smithi037.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 218 kB/s | 33 kB 00:00 2024-08-20T04:48:02.466 INFO:teuthology.orchestra.run.smithi135.stdout:(29/150): rbd-mirror-19.0.0-5872.gef427541.el9. 9.7 MB/s | 3.2 MB 00:00 2024-08-20T04:48:02.482 INFO:teuthology.orchestra.run.smithi135.stdout:(30/150): ceph-mgr-cephadm-19.0.0-5872.gef42754 1.2 MB/s | 150 kB 00:00 2024-08-20T04:48:02.505 INFO:teuthology.orchestra.run.smithi037.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 219 kB/s | 18 kB 00:00 2024-08-20T04:48:02.530 INFO:teuthology.orchestra.run.smithi037.stdout:(55/150): flex-2.6.4-9.el9.x86_64.rpm 1.0 MB/s | 313 kB 00:00 2024-08-20T04:48:02.589 INFO:teuthology.orchestra.run.smithi037.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-08-20T04:48:02.614 INFO:teuthology.orchestra.run.smithi037.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-08-20T04:48:02.683 INFO:teuthology.orchestra.run.smithi037.stdout:(58/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.4 MB/s | 3.0 MB 00:00 2024-08-20T04:48:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:(59/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 301 kB/s | 45 kB 00:00 2024-08-20T04:48:02.782 INFO:teuthology.orchestra.run.smithi037.stdout:(60/150): libtool-2.4.6-46.el9.x86_64.rpm 5.8 MB/s | 581 kB 00:00 2024-08-20T04:48:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:(61/150): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-08-20T04:48:02.857 INFO:teuthology.orchestra.run.smithi037.stdout:(62/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 217 kB/s | 25 kB 00:00 2024-08-20T04:48:02.873 INFO:teuthology.orchestra.run.smithi130.stdout:(31/150): ceph-test-19.0.0-5872.gef427541.el9.x 12 MB/s | 50 MB 00:04 2024-08-20T04:48:02.908 INFO:teuthology.orchestra.run.smithi037.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 378 kB/s | 47 kB 00:00 2024-08-20T04:48:02.933 INFO:teuthology.orchestra.run.smithi037.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-08-20T04:48:02.966 INFO:teuthology.orchestra.run.smithi037.stdout:(65/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-08-20T04:48:02.967 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T04:48:02.972 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T04:48:02.974 INFO:teuthology.orchestra.run.smithi135.stdout:(31/150): ceph-mgr-diskprediction-local-19.0.0- 15 MB/s | 7.4 MB 00:00 2024-08-20T04:48:02.981 INFO:teuthology.orchestra.run.smithi130.stdout:(32/150): ceph-mgr-modules-core-19.0.0-5872.gef 2.6 MB/s | 284 kB 00:00 2024-08-20T04:48:03.066 INFO:teuthology.orchestra.run.smithi135.stdout:(32/150): ceph-mgr-modules-core-19.0.0-5872.gef 3.0 MB/s | 284 kB 00:00 2024-08-20T04:48:03.115 INFO:teuthology.orchestra.run.smithi130.stdout:(33/150): ceph-mgr-diskprediction-local-19.0.0- 4.3 MB/s | 7.4 MB 00:01 2024-08-20T04:48:03.132 INFO:teuthology.orchestra.run.smithi130.stdout:(34/150): ceph-mgr-rook-19.0.0-5872.gef427541.e 328 kB/s | 49 kB 00:00 2024-08-20T04:48:03.133 INFO:teuthology.orchestra.run.smithi037.stdout:(66/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-08-20T04:48:03.142 INFO:teuthology.orchestra.run.smithi135.stdout:(33/150): ceph-mgr-rook-19.0.0-5872.gef427541.e 658 kB/s | 49 kB 00:00 2024-08-20T04:48:03.178 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T04:48:03.179 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T04:48:03.217 INFO:teuthology.orchestra.run.smithi135.stdout:(34/150): ceph-prometheus-alerts-19.0.0-5872.ge 220 kB/s | 16 kB 00:00 2024-08-20T04:48:03.221 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T04:48:03.221 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T04:48:03.265 INFO:teuthology.orchestra.run.smithi130.stdout:(35/150): ceph-mgr-dashboard-19.0.0-5872.gef427 7.0 MB/s | 14 MB 00:02 2024-08-20T04:48:03.275 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T04:48:03.282 INFO:teuthology.orchestra.run.smithi130.stdout:(36/150): ceph-prometheus-alerts-19.0.0-5872.ge 98 kB/s | 16 kB 00:00 2024-08-20T04:48:03.292 INFO:teuthology.orchestra.run.smithi135.stdout:(35/150): ceph-volume-19.0.0-5872.gef427541.el9 3.7 MB/s | 285 kB 00:00 2024-08-20T04:48:03.300 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T04:48:03.306 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T04:48:03.307 INFO:teuthology.orchestra.run.smithi130.stdout:(37/150): ceph-volume-19.0.0-5872.gef427541.el9 1.6 MB/s | 285 kB 00:00 2024-08-20T04:48:03.308 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T04:48:03.324 INFO:teuthology.orchestra.run.smithi130.stdout:(38/150): cephfs-top-19.0.0-5872.gef427541.el9. 437 kB/s | 18 kB 00:00 2024-08-20T04:48:03.328 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T04:48:03.350 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T04:48:03.365 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T04:48:03.366 INFO:teuthology.orchestra.run.smithi130.stdout:(39/150): cephadm-19.0.0-5872.gef427541.el9.noa 7.5 MB/s | 772 kB 00:00 2024-08-20T04:48:03.373 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T04:48:03.416 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T04:48:03.421 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T04:48:03.421 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.21) 2024-08-20T04:48:03.458 INFO:teuthology.orchestra.run.smithi130.stdout:(40/150): fuse-2.9.9-16.el9.x86_64.rpm 531 kB/s | 80 kB 00:00 2024-08-20T04:48:03.479 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] openblas-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T04:48:03.500 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] openblas-openmp-0.3.26-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/openblas-openmp-0.3.26-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T04:48:03.500 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-20T04:48:03.521 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 172.65.90.23) 2024-08-20T04:48:03.533 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] postgresql-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T04:48:03.567 INFO:teuthology.orchestra.run.smithi130.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.5 MB/s | 253 kB 00:00 2024-08-20T04:48:03.567 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T04:48:03.598 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T04:48:03.684 INFO:teuthology.orchestra.run.smithi130.stdout:(42/150): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-08-20T04:48:03.710 INFO:teuthology.orchestra.run.smithi135.stdout:(36/150): ceph-test-19.0.0-5872.gef427541.el9.x 18 MB/s | 50 MB 00:02 2024-08-20T04:48:03.715 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T04:48:03.743 INFO:teuthology.orchestra.run.smithi135.stdout:(37/150): cephadm-19.0.0-5872.gef427541.el9.noa 1.7 MB/s | 772 kB 00:00 2024-08-20T04:48:03.751 INFO:teuthology.orchestra.run.smithi130.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-08-20T04:48:03.752 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T04:48:03.770 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T04:48:03.809 INFO:teuthology.orchestra.run.smithi130.stdout:(44/150): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-08-20T04:48:03.818 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T04:48:03.876 INFO:teuthology.orchestra.run.smithi130.stdout:(45/150): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-08-20T04:48:03.894 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T04:48:03.910 INFO:teuthology.orchestra.run.smithi135.stdout:(38/150): ceph-mgr-dashboard-19.0.0-5872.gef427 9.8 MB/s | 14 MB 00:01 2024-08-20T04:48:03.913 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T04:48:03.935 INFO:teuthology.orchestra.run.smithi135.stdout:(39/150): cephfs-top-19.0.0-5872.gef427541.el9. 81 kB/s | 18 kB 00:00 2024-08-20T04:48:03.943 INFO:teuthology.orchestra.run.smithi130.stdout:(46/150): python3-urllib3-1.26.5-6.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-08-20T04:48:03.953 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T04:48:03.971 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T04:48:03.977 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T04:48:03.978 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T04:48:04.019 INFO:teuthology.orchestra.run.smithi135.stdout:(40/150): fuse-2.9.9-16.el9.x86_64.rpm 289 kB/s | 80 kB 00:00 2024-08-20T04:48:04.037 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T04:48:04.042 INFO:teuthology.orchestra.run.smithi037.stdout:(67/150): openblas-0.3.26-1.el9.x86_64.rpm 34 kB/s | 38 kB 00:01 2024-08-20T04:48:04.056 INFO:teuthology.orchestra.run.smithi135.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftp-nyc.osuosl.org/pub/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 64.50.233.100) 2024-08-20T04:48:04.074 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T04:48:04.084 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T04:48:04.092 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://linux-mirrors.fnal.gov/linux/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 131.225.105.75) 2024-08-20T04:48:04.094 INFO:teuthology.orchestra.run.smithi135.stdout:(41/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-08-20T04:48:04.146 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T04:48:04.153 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T04:48:04.214 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T04:48:04.240 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T04:48:04.245 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T04:48:04.252 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://ftpmirror.your.org/pub/CentOS-Stream-All/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 163.237.219.7) 2024-08-20T04:48:04.261 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T04:48:04.290 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T04:48:04.294 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for https://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T04:48:04.295 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for http://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T04:48:04.326 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] postgresql-contrib-13.16-1.el9.x86_64.rpm: Status code: 404 for http://mirror.team-cymru.com/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-contrib-13.16-1.el9.x86_64.rpm (IP: 216.31.2.234) 2024-08-20T04:48:04.361 INFO:teuthology.orchestra.run.smithi135.stdout:(42/150): python3-cryptography-36.0.1-4.el9.x86 4.6 MB/s | 1.2 MB 00:00 2024-08-20T04:48:04.366 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libgfortran-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libgfortran-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T04:48:04.371 INFO:teuthology.orchestra.run.smithi130.stdout:[MIRROR] libquadmath-11.5.0-2.el9.x86_64.rpm: Status code: 404 for https://mirrors.iu13.net/centos-stream/9-stream/BaseOS/x86_64/os/Packages/libquadmath-11.5.0-2.el9.x86_64.rpm (IP: 206.82.17.213) 2024-08-20T04:48:04.420 INFO:teuthology.orchestra.run.smithi135.stdout:(43/150): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-08-20T04:48:04.503 INFO:teuthology.orchestra.run.smithi135.stdout:(44/150): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-08-20T04:48:04.509 INFO:teuthology.orchestra.run.smithi037.stdout:(68/150): postgresql-13.16-1.el9.x86_64.rpm 1.2 MB/s | 1.6 MB 00:01 2024-08-20T04:48:04.545 INFO:teuthology.orchestra.run.smithi135.stdout:(45/150): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-08-20T04:48:04.587 INFO:teuthology.orchestra.run.smithi135.stdout:(46/150): python3-urllib3-1.26.5-6.el9.noarch.r 5.1 MB/s | 215 kB 00:00 2024-08-20T04:48:04.609 INFO:teuthology.orchestra.run.smithi037.stdout:(69/150): openblas-openmp-0.3.26-1.el9.x86_64.r 3.0 MB/s | 4.9 MB 00:01 2024-08-20T04:48:04.622 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] postgresql-private-libs-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-private-libs-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T04:48:04.653 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] postgresql-server-13.16-1.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/postgresql-server-13.16-1.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T04:48:04.804 INFO:teuthology.orchestra.run.smithi135.stdout:(47/150): libquadmath-11.5.0-2.el9.x86_64.rpm 220 kB/s | 191 kB 00:00 2024-08-20T04:48:04.827 INFO:teuthology.orchestra.run.smithi130.stdout:(47/150): automake-1.16.2-8.el9.noarch.rpm 780 kB/s | 689 kB 00:00 2024-08-20T04:48:04.971 INFO:teuthology.orchestra.run.smithi135.stdout:(48/150): libgfortran-11.5.0-2.el9.x86_64.rpm 756 kB/s | 801 kB 00:01 2024-08-20T04:48:05.111 INFO:teuthology.orchestra.run.smithi130.stdout:(48/150): libquadmath-11.5.0-2.el9.x86_64.rpm 110 kB/s | 191 kB 00:01 2024-08-20T04:48:05.261 INFO:teuthology.orchestra.run.smithi130.stdout:(49/150): libgfortran-11.5.0-2.el9.x86_64.rpm 414 kB/s | 801 kB 00:01 2024-08-20T04:48:05.310 INFO:teuthology.orchestra.run.smithi037.stdout:(70/150): postgresql-contrib-13.16-1.el9.x86_64 718 kB/s | 910 kB 00:01 2024-08-20T04:48:05.335 INFO:teuthology.orchestra.run.smithi037.stdout:(71/150): postgresql-private-libs-13.16-1.el9.x 166 kB/s | 137 kB 00:00 2024-08-20T04:48:05.468 INFO:teuthology.orchestra.run.smithi037.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 6.4 MB/s | 1.0 MB 00:00 2024-08-20T04:48:05.471 INFO:teuthology.orchestra.run.smithi135.stdout:(49/150): automake-1.16.2-8.el9.noarch.rpm 779 kB/s | 689 kB 00:00 2024-08-20T04:48:05.527 INFO:teuthology.orchestra.run.smithi037.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 456 kB/s | 87 kB 00:00 2024-08-20T04:48:05.619 INFO:teuthology.orchestra.run.smithi037.stdout:(74/150): python3-colorama-0.4.6-3.el9.noarch.r 670 kB/s | 61 kB 00:00 2024-08-20T04:48:05.638 INFO:teuthology.orchestra.run.smithi135.stdout:(50/150): boost-program-options-1.75.0-8.el9.x8 160 kB/s | 107 kB 00:00 2024-08-20T04:48:05.711 INFO:teuthology.orchestra.run.smithi037.stdout:(75/150): python3-babel-2.9.1-2.el9.noarch.rpm 25 MB/s | 6.0 MB 00:00 2024-08-20T04:48:05.712 INFO:teuthology.orchestra.run.smithi037.stdout:[MIRROR] python3-devel-3.9.19-7.el9.x86_64.rpm: Status code: 404 for http://ftp-chi.osuosl.org/pub/centos-stream/9-stream/AppStream/x86_64/os/Packages/python3-devel-3.9.19-7.el9.x86_64.rpm (IP: 64.50.236.52) 2024-08-20T04:48:05.719 INFO:teuthology.orchestra.run.smithi130.stdout:(50/150): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-08-20T04:48:05.763 INFO:teuthology.orchestra.run.smithi135.stdout:(51/150): bison-3.7.4-5.el9.x86_64.rpm 991 kB/s | 943 kB 00:00 2024-08-20T04:48:05.770 INFO:teuthology.orchestra.run.smithi037.stdout:(76/150): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-08-20T04:48:05.786 INFO:teuthology.orchestra.run.smithi130.stdout:(51/150): boost-program-options-1.75.0-8.el9.x8 158 kB/s | 107 kB 00:00 2024-08-20T04:48:05.811 INFO:teuthology.orchestra.run.smithi130.stdout:(52/150): elfutils-libelf-devel-0.191-4.el9.x86 39 kB/s | 22 kB 00:00 2024-08-20T04:48:05.870 INFO:teuthology.orchestra.run.smithi037.stdout:(77/150): postgresql-server-13.16-1.el9.x86_64. 4.6 MB/s | 5.8 MB 00:01 2024-08-20T04:48:05.887 INFO:teuthology.orchestra.run.smithi037.stdout:(78/150): python3-jsonpatch-1.21-16.el9.noarch. 219 kB/s | 26 kB 00:00 2024-08-20T04:48:05.921 INFO:teuthology.orchestra.run.smithi037.stdout:(79/150): python3-jsonpointer-2.0-4.el9.noarch. 386 kB/s | 19 kB 00:00 2024-08-20T04:48:05.946 INFO:teuthology.orchestra.run.smithi037.stdout:(80/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-08-20T04:48:05.971 INFO:teuthology.orchestra.run.smithi037.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-08-20T04:48:06.039 INFO:teuthology.orchestra.run.smithi135.stdout:(52/150): elfutils-libelf-devel-0.191-4.el9.x86 38 kB/s | 22 kB 00:00 2024-08-20T04:48:06.126 INFO:teuthology.orchestra.run.smithi037.stdout:(82/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 28 MB/s | 5.1 MB 00:00 2024-08-20T04:48:06.155 INFO:teuthology.orchestra.run.smithi037.stdout:(83/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 250 kB 00:00 2024-08-20T04:48:06.189 INFO:teuthology.orchestra.run.smithi037.stdout:(84/150): python3-oauthlib-3.1.1-5.el9.noarch.r 3.5 MB/s | 222 kB 00:00 2024-08-20T04:48:06.214 INFO:teuthology.orchestra.run.smithi037.stdout:(85/150): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-08-20T04:48:06.247 INFO:teuthology.orchestra.run.smithi037.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 725 kB/s | 42 kB 00:00 2024-08-20T04:48:06.273 INFO:teuthology.orchestra.run.smithi037.stdout:(87/150): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-08-20T04:48:06.307 INFO:teuthology.orchestra.run.smithi037.stdout:(88/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-08-20T04:48:06.322 INFO:teuthology.orchestra.run.smithi135.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-08-20T04:48:06.332 INFO:teuthology.orchestra.run.smithi037.stdout:(89/150): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-08-20T04:48:06.361 INFO:teuthology.orchestra.run.smithi130.stdout:(53/150): flexiblas-3.0.4-8.el9.x86_64.rpm 57 kB/s | 33 kB 00:00 2024-08-20T04:48:06.365 INFO:teuthology.orchestra.run.smithi037.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-08-20T04:48:06.431 INFO:teuthology.orchestra.run.smithi135.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 396 kB/s | 313 kB 00:00 2024-08-20T04:48:06.437 INFO:teuthology.orchestra.run.smithi037.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 511 kB/s | 54 kB 00:00 2024-08-20T04:48:06.499 INFO:teuthology.orchestra.run.smithi037.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 671 kB/s | 42 kB 00:00 2024-08-20T04:48:06.503 INFO:teuthology.orchestra.run.smithi130.stdout:(54/150): flex-2.6.4-9.el9.x86_64.rpm 400 kB/s | 313 kB 00:00 2024-08-20T04:48:06.558 INFO:teuthology.orchestra.run.smithi037.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 759 kB/s | 44 kB 00:00 2024-08-20T04:48:06.608 INFO:teuthology.orchestra.run.smithi037.stdout:(94/150): python3-devel-3.9.19-7.el9.x86_64.rpm 247 kB/s | 245 kB 00:00 2024-08-20T04:48:06.641 INFO:teuthology.orchestra.run.smithi037.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-08-20T04:48:06.798 INFO:teuthology.orchestra.run.smithi135.stdout:(55/150): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2024-08-20T04:48:06.845 INFO:teuthology.orchestra.run.smithi130.stdout:(55/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.9 MB/s | 3.0 MB 00:01 2024-08-20T04:48:06.867 INFO:teuthology.orchestra.run.smithi037.stdout:(96/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-08-20T04:48:06.870 INFO:teuthology.orchestra.run.smithi130.stdout:(56/150): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-08-20T04:48:06.914 INFO:teuthology.orchestra.run.smithi135.stdout:(56/150): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-08-20T04:48:07.046 INFO:teuthology.orchestra.run.smithi130.stdout:(57/150): libaio-devel-0.3.111-13.el9.x86_64.rp 21 kB/s | 11 kB 00:00 2024-08-20T04:48:07.081 INFO:teuthology.orchestra.run.smithi135.stdout:(57/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.9 MB/s | 3.0 MB 00:01 2024-08-20T04:48:07.401 INFO:teuthology.orchestra.run.smithi037.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 62 kB/s | 47 kB 00:00 2024-08-20T04:48:07.426 INFO:teuthology.orchestra.run.smithi037.stdout:(98/150): qatlib-service-24.02.0-1.el9.x86_64.r 44 kB/s | 36 kB 00:00 2024-08-20T04:48:07.488 INFO:teuthology.orchestra.run.smithi130.stdout:(58/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 73 kB/s | 45 kB 00:00 2024-08-20T04:48:07.506 INFO:teuthology.orchestra.run.smithi135.stdout:(58/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 226 kB/s | 160 kB 00:00 2024-08-20T04:48:07.533 INFO:teuthology.orchestra.run.smithi135.stdout:(59/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 73 kB/s | 45 kB 00:00 2024-08-20T04:48:07.546 INFO:teuthology.orchestra.run.smithi130.stdout:(59/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 229 kB/s | 160 kB 00:00 2024-08-20T04:48:07.651 INFO:teuthology.orchestra.run.smithi037.stdout:(99/150): socat-1.7.4.1-6.el9.x86_64.rpm 388 kB/s | 304 kB 00:00 2024-08-20T04:48:07.921 INFO:teuthology.orchestra.run.smithi130.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 757 kB/s | 662 kB 00:00 2024-08-20T04:48:07.949 INFO:teuthology.orchestra.run.smithi135.stdout:(60/150): librdkafka-1.6.1-102.el9.x86_64.rpm 764 kB/s | 662 kB 00:00 2024-08-20T04:48:08.035 INFO:teuthology.orchestra.run.smithi037.stdout:(100/150): uuid-1.6.2-55.el9.x86_64.rpm 91 kB/s | 58 kB 00:00 2024-08-20T04:48:08.074 INFO:teuthology.orchestra.run.smithi135.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 47 kB/s | 25 kB 00:00 2024-08-20T04:48:08.085 INFO:teuthology.orchestra.run.smithi037.stdout:(101/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 145 kB/s | 96 kB 00:00 2024-08-20T04:48:08.097 INFO:teuthology.orchestra.run.smithi130.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 46 kB/s | 25 kB 00:00 2024-08-20T04:48:08.194 INFO:teuthology.orchestra.run.smithi037.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 206 kB/s | 22 kB 00:00 2024-08-20T04:48:08.329 INFO:teuthology.orchestra.run.smithi037.stdout:(103/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 96 kB/s | 64 kB 00:00 2024-08-20T04:48:08.359 INFO:teuthology.orchestra.run.smithi135.stdout:(62/150): libtool-2.4.6-46.el9.x86_64.rpm 683 kB/s | 581 kB 00:00 2024-08-20T04:48:08.363 INFO:teuthology.orchestra.run.smithi130.stdout:(62/150): libtool-2.4.6-46.el9.x86_64.rpm 664 kB/s | 581 kB 00:00 2024-08-20T04:48:08.403 INFO:teuthology.orchestra.run.smithi037.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 8.7 MB/s | 548 kB 00:00 2024-08-20T04:48:08.436 INFO:teuthology.orchestra.run.smithi037.stdout:(105/150): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-08-20T04:48:08.478 INFO:teuthology.orchestra.run.smithi037.stdout:(106/150): gperftools-libs-2.9.1-2.el9.x86_64.r 4.0 MB/s | 309 kB 00:00 2024-08-20T04:48:08.497 INFO:teuthology.orchestra.run.smithi130.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-08-20T04:48:08.526 INFO:teuthology.orchestra.run.smithi135.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-08-20T04:48:08.529 INFO:teuthology.orchestra.run.smithi037.stdout:(107/150): grpc-data-1.46.7-10.el9.noarch.rpm 214 kB/s | 19 kB 00:00 2024-08-20T04:48:08.578 INFO:teuthology.orchestra.run.smithi037.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 528 kB/s | 26 kB 00:00 2024-08-20T04:48:08.620 INFO:teuthology.orchestra.run.smithi037.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-08-20T04:48:08.662 INFO:teuthology.orchestra.run.smithi037.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-08-20T04:48:08.704 INFO:teuthology.orchestra.run.smithi037.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-08-20T04:48:08.780 INFO:teuthology.orchestra.run.smithi037.stdout:(112/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-08-20T04:48:08.805 INFO:teuthology.orchestra.run.smithi037.stdout:(113/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 58 kB/s | 45 kB 00:00 2024-08-20T04:48:08.851 INFO:teuthology.orchestra.run.smithi135.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 376 kB/s | 292 kB 00:00 2024-08-20T04:48:08.855 INFO:teuthology.orchestra.run.smithi037.stdout:(114/150): python3-asyncssh-2.13.2-5.el9.noarch 7.3 MB/s | 548 kB 00:00 2024-08-20T04:48:08.872 INFO:teuthology.orchestra.run.smithi130.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 377 kB/s | 292 kB 00:00 2024-08-20T04:48:08.880 INFO:teuthology.orchestra.run.smithi037.stdout:(115/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 578 kB/s | 43 kB 00:00 2024-08-20T04:48:08.906 INFO:teuthology.orchestra.run.smithi037.stdout:(116/150): python3-cachetools-4.2.4-1.el9.noarc 644 kB/s | 32 kB 00:00 2024-08-20T04:48:08.931 INFO:teuthology.orchestra.run.smithi037.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-08-20T04:48:08.990 INFO:teuthology.orchestra.run.smithi037.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-08-20T04:48:09.065 INFO:teuthology.orchestra.run.smithi037.stdout:(119/150): libarrow-9.0.0-11.el9.x86_64.rpm 7.6 MB/s | 4.4 MB 00:00 2024-08-20T04:48:09.072 INFO:teuthology.orchestra.run.smithi130.stdout:(65/150): openblas-0.3.26-1.el9.x86_64.rpm 67 kB/s | 38 kB 00:00 2024-08-20T04:48:09.090 INFO:teuthology.orchestra.run.smithi037.stdout:(120/150): python3-cherrypy-18.6.1-2.el9.noarch 2.2 MB/s | 358 kB 00:00 2024-08-20T04:48:09.098 INFO:teuthology.orchestra.run.smithi130.stdout:(66/150): lua-5.4.4-4.el9.x86_64.rpm 257 kB/s | 188 kB 00:00 2024-08-20T04:48:09.102 INFO:teuthology.orchestra.run.smithi135.stdout:(65/150): openblas-0.3.26-1.el9.x86_64.rpm 67 kB/s | 38 kB 00:00 2024-08-20T04:48:09.115 INFO:teuthology.orchestra.run.smithi037.stdout:(121/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-08-20T04:48:09.127 INFO:teuthology.orchestra.run.smithi135.stdout:(66/150): lua-5.4.4-4.el9.x86_64.rpm 246 kB/s | 188 kB 00:00 2024-08-20T04:48:09.140 INFO:teuthology.orchestra.run.smithi037.stdout:(122/150): python3-google-auth-2.33.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-08-20T04:48:09.166 INFO:teuthology.orchestra.run.smithi037.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 435 kB/s | 11 kB 00:00 2024-08-20T04:48:09.191 INFO:teuthology.orchestra.run.smithi037.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-08-20T04:48:09.216 INFO:teuthology.orchestra.run.smithi037.stdout:(125/150): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-08-20T04:48:09.250 INFO:teuthology.orchestra.run.smithi037.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2024-08-20T04:48:09.300 INFO:teuthology.orchestra.run.smithi037.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 233 kB/s | 19 kB 00:00 2024-08-20T04:48:09.325 INFO:teuthology.orchestra.run.smithi037.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 262 kB/s | 20 kB 00:00 2024-08-20T04:48:09.351 INFO:teuthology.orchestra.run.smithi037.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-20T04:48:09.376 INFO:teuthology.orchestra.run.smithi037.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-20T04:48:09.401 INFO:teuthology.orchestra.run.smithi037.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-20T04:48:09.435 INFO:teuthology.orchestra.run.smithi037.stdout:(132/150): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-20T04:48:09.460 INFO:teuthology.orchestra.run.smithi037.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 734 kB/s | 16 kB 00:00 2024-08-20T04:48:09.494 INFO:teuthology.orchestra.run.smithi037.stdout:(134/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.6 MB/s | 90 kB 00:00 2024-08-20T04:48:09.511 INFO:teuthology.orchestra.run.smithi037.stdout:(135/150): python3-pyperclip-1.8.2-2.el9.noarch 1.7 MB/s | 28 kB 00:00 2024-08-20T04:48:09.545 INFO:teuthology.orchestra.run.smithi037.stdout:(136/150): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-08-20T04:48:09.590 INFO:teuthology.orchestra.run.smithi037.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 392 kB/s | 31 kB 00:00 2024-08-20T04:48:09.612 INFO:teuthology.orchestra.run.smithi037.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.7 MB/s | 59 kB 00:00 2024-08-20T04:48:09.629 INFO:teuthology.orchestra.run.smithi037.stdout:(139/150): python3-tempora-5.0.0-2.el9.noarch.r 2.1 MB/s | 36 kB 00:00 2024-08-20T04:48:09.654 INFO:teuthology.orchestra.run.smithi037.stdout:(140/150): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-08-20T04:48:09.679 INFO:teuthology.orchestra.run.smithi037.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-08-20T04:48:09.705 INFO:teuthology.orchestra.run.smithi037.stdout:(142/150): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-20T04:48:09.730 INFO:teuthology.orchestra.run.smithi037.stdout:(143/150): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-08-20T04:48:09.755 INFO:teuthology.orchestra.run.smithi037.stdout:(144/150): python3-zc-lockfile-2.0-10.el9.noarc 806 kB/s | 20 kB 00:00 2024-08-20T04:48:09.806 INFO:teuthology.orchestra.run.smithi037.stdout:(145/150): python3-grpcio-1.46.7-10.el9.x86_64. 2.8 MB/s | 2.0 MB 00:00 2024-08-20T04:48:09.831 INFO:teuthology.orchestra.run.smithi037.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-08-20T04:48:09.865 INFO:teuthology.orchestra.run.smithi037.stdout:(147/150): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-08-20T04:48:09.957 INFO:teuthology.orchestra.run.smithi037.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-08-20T04:48:09.989 INFO:teuthology.orchestra.run.smithi130.stdout:(67/150): openblas-openmp-0.3.26-1.el9.x86_64.r 4.4 MB/s | 4.9 MB 00:01 2024-08-20T04:48:10.002 INFO:teuthology.orchestra.run.smithi135.stdout:(67/150): openblas-openmp-0.3.26-1.el9.x86_64.r 4.3 MB/s | 4.9 MB 00:01 2024-08-20T04:48:10.152 INFO:teuthology.orchestra.run.smithi135.stdout:(68/150): postgresql-13.16-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-08-20T04:48:10.156 INFO:teuthology.orchestra.run.smithi130.stdout:(68/150): postgresql-13.16-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-08-20T04:48:10.223 INFO:teuthology.orchestra.run.smithi130.stdout:(69/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 3.9 MB/s | 4.4 MB 00:01 2024-08-20T04:48:10.232 INFO:teuthology.orchestra.run.smithi037.stdout:(149/150): librados2-19.0.0-5872.gef427541.el9. 8.7 MB/s | 3.5 MB 00:00 2024-08-20T04:48:10.294 INFO:teuthology.orchestra.run.smithi135.stdout:(69/150): openssl-devel-3.2.2-2.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-08-20T04:48:10.315 INFO:teuthology.orchestra.run.smithi037.stdout:(150/150): librbd1-19.0.0-5872.gef427541.el9.x8 7.4 MB/s | 3.2 MB 00:00 2024-08-20T04:48:10.323 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-08-20T04:48:10.323 INFO:teuthology.orchestra.run.smithi037.stdout:Total 14 MB/s | 232 MB 00:16 2024-08-20T04:48:10.899 INFO:teuthology.orchestra.run.smithi130.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 185 kB/s | 137 kB 00:00 2024-08-20T04:48:10.928 INFO:teuthology.orchestra.run.smithi135.stdout:(70/150): postgresql-private-libs-13.16-1.el9.x 177 kB/s | 137 kB 00:00 2024-08-20T04:48:11.078 INFO:teuthology.orchestra.run.smithi135.stdout:(71/150): postgresql-contrib-13.16-1.el9.x86_64 848 kB/s | 910 kB 00:01 2024-08-20T04:48:11.090 INFO:teuthology.orchestra.run.smithi130.stdout:(71/150): postgresql-contrib-13.16-1.el9.x86_64 828 kB/s | 910 kB 00:01 2024-08-20T04:48:11.405 INFO:teuthology.orchestra.run.smithi130.stdout:(72/150): postgresql-server-13.16-1.el9.x86_64. 4.9 MB/s | 5.8 MB 00:01 2024-08-20T04:48:11.437 INFO:teuthology.orchestra.run.smithi135.stdout:(72/150): postgresql-server-13.16-1.el9.x86_64. 5.1 MB/s | 5.8 MB 00:01 2024-08-20T04:48:11.755 INFO:teuthology.orchestra.run.smithi130.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 132 kB/s | 87 kB 00:00 2024-08-20T04:48:11.787 INFO:teuthology.orchestra.run.smithi135.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 123 kB/s | 87 kB 00:00 2024-08-20T04:48:11.866 INFO:teuthology.orchestra.run.smithi130.stdout:(74/150): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-08-20T04:48:11.887 INFO:teuthology.orchestra.run.smithi135.stdout:(74/150): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-08-20T04:48:12.208 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-08-20T04:48:12.376 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-08-20T04:48:12.376 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-08-20T04:48:12.405 INFO:teuthology.orchestra.run.smithi130.stdout:(75/150): python3-colorama-0.4.6-3.el9.noarch.r 94 kB/s | 61 kB 00:00 2024-08-20T04:48:12.437 INFO:teuthology.orchestra.run.smithi135.stdout:(75/150): python3-colorama-0.4.6-3.el9.noarch.r 94 kB/s | 61 kB 00:00 2024-08-20T04:48:12.622 INFO:teuthology.orchestra.run.smithi130.stdout:(76/150): python3-babel-2.9.1-2.el9.noarch.rpm 4.9 MB/s | 6.0 MB 00:01 2024-08-20T04:48:12.723 INFO:teuthology.orchestra.run.smithi130.stdout:(77/150): python3-devel-3.9.19-7.el9.x86_64.rpm 282 kB/s | 245 kB 00:00 2024-08-20T04:48:12.762 INFO:teuthology.orchestra.run.smithi135.stdout:(76/150): python3-devel-3.9.19-7.el9.x86_64.rpm 280 kB/s | 245 kB 00:00 2024-08-20T04:48:12.846 INFO:teuthology.orchestra.run.smithi135.stdout:(77/150): python3-babel-2.9.1-2.el9.noarch.rpm 4.2 MB/s | 6.0 MB 00:01 2024-08-20T04:48:13.198 INFO:teuthology.orchestra.run.smithi130.stdout:(78/150): python3-jinja2-2.11.3-6.el9.noarch.rp 314 kB/s | 248 kB 00:00 2024-08-20T04:48:13.223 INFO:teuthology.orchestra.run.smithi130.stdout:(79/150): python3-jsonpatch-1.21-16.el9.noarch. 43 kB/s | 26 kB 00:00 2024-08-20T04:48:13.246 INFO:teuthology.orchestra.run.smithi135.stdout:(78/150): python3-jinja2-2.11.3-6.el9.noarch.rp 307 kB/s | 248 kB 00:00 2024-08-20T04:48:13.248 INFO:teuthology.orchestra.run.smithi130.stdout:(80/150): python3-jsonpointer-2.0-4.el9.noarch. 36 kB/s | 19 kB 00:00 2024-08-20T04:48:13.321 INFO:teuthology.orchestra.run.smithi135.stdout:(79/150): python3-jsonpatch-1.21-16.el9.noarch. 46 kB/s | 26 kB 00:00 2024-08-20T04:48:13.364 INFO:teuthology.orchestra.run.smithi135.stdout:(80/150): python3-jsonpointer-2.0-4.el9.noarch. 37 kB/s | 19 kB 00:00 2024-08-20T04:48:13.781 INFO:teuthology.orchestra.run.smithi130.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 62 kB/s | 35 kB 00:00 2024-08-20T04:48:13.872 INFO:teuthology.orchestra.run.smithi135.stdout:(81/150): python3-markupsafe-1.1.1-12.el9.x86_6 63 kB/s | 35 kB 00:00 2024-08-20T04:48:13.965 INFO:teuthology.orchestra.run.smithi130.stdout:(82/150): python3-mako-1.1.4-6.el9.noarch.rpm 225 kB/s | 172 kB 00:00 2024-08-20T04:48:14.006 INFO:teuthology.orchestra.run.smithi135.stdout:(82/150): python3-mako-1.1.4-6.el9.noarch.rpm 227 kB/s | 172 kB 00:00 2024-08-20T04:48:14.507 INFO:teuthology.orchestra.run.smithi130.stdout:(83/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-08-20T04:48:14.624 INFO:teuthology.orchestra.run.smithi130.stdout:(84/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 298 kB/s | 250 kB 00:00 2024-08-20T04:48:14.673 INFO:teuthology.orchestra.run.smithi135.stdout:(83/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.9 MB/s | 5.1 MB 00:01 2024-08-20T04:48:14.740 INFO:teuthology.orchestra.run.smithi135.stdout:(84/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 289 kB/s | 250 kB 00:00 2024-08-20T04:48:14.757 INFO:teuthology.orchestra.run.smithi130.stdout:(85/150): python3-oauthlib-3.1.1-5.el9.noarch.r 280 kB/s | 222 kB 00:00 2024-08-20T04:48:14.773 INFO:teuthology.orchestra.run.smithi135.stdout:(85/150): python3-oauthlib-3.1.1-5.el9.noarch.r 290 kB/s | 222 kB 00:00 2024-08-20T04:48:14.885 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-08-20T04:48:14.890 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-08-20T04:48:15.133 INFO:teuthology.orchestra.run.smithi130.stdout:(86/150): python3-packaging-20.9-5.el9.noarch.r 123 kB/s | 77 kB 00:00 2024-08-20T04:48:15.183 INFO:teuthology.orchestra.run.smithi130.stdout:(87/150): python3-prettytable-0.7.2-27.el9.noar 76 kB/s | 42 kB 00:00 2024-08-20T04:48:15.307 INFO:teuthology.orchestra.run.smithi135.stdout:(86/150): python3-prettytable-0.7.2-27.el9.noar 75 kB/s | 42 kB 00:00 2024-08-20T04:48:15.332 INFO:teuthology.orchestra.run.smithi135.stdout:(87/150): python3-packaging-20.9-5.el9.noarch.r 117 kB/s | 77 kB 00:00 2024-08-20T04:48:15.550 INFO:teuthology.orchestra.run.smithi130.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 340 kB/s | 269 kB 00:00 2024-08-20T04:48:15.557 INFO:teuthology.orchestra.run.smithi135.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 344 kB/s | 269 kB 00:00 2024-08-20T04:48:15.842 INFO:teuthology.orchestra.run.smithi130.stdout:(89/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 224 kB/s | 159 kB 00:00 2024-08-20T04:48:16.067 INFO:teuthology.orchestra.run.smithi130.stdout:(90/150): python3-pyasn1-modules-0.4.8-6.el9.no 316 kB/s | 279 kB 00:00 2024-08-20T04:48:16.082 INFO:teuthology.orchestra.run.smithi135.stdout:(89/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 205 kB/s | 159 kB 00:00 2024-08-20T04:48:16.174 INFO:teuthology.orchestra.run.smithi135.stdout:(90/150): python3-pytz-2021.1-5.el9.noarch.rpm 84 kB/s | 51 kB 00:00 2024-08-20T04:48:16.175 INFO:teuthology.orchestra.run.smithi130.stdout:(91/150): python3-pytz-2021.1-5.el9.noarch.rpm 82 kB/s | 51 kB 00:00 2024-08-20T04:48:16.216 INFO:teuthology.orchestra.run.smithi135.stdout:(91/150): python3-pyasn1-modules-0.4.8-6.el9.no 315 kB/s | 279 kB 00:00 2024-08-20T04:48:16.492 INFO:teuthology.orchestra.run.smithi130.stdout:(92/150): python3-requests-oauthlib-1.3.0-12.el 82 kB/s | 54 kB 00:00 2024-08-20T04:48:16.724 INFO:teuthology.orchestra.run.smithi135.stdout:(92/150): python3-requests-oauthlib-1.3.0-12.el 84 kB/s | 54 kB 00:00 2024-08-20T04:48:16.759 INFO:teuthology.orchestra.run.smithi130.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 71 kB/s | 42 kB 00:00 2024-08-20T04:48:16.808 INFO:teuthology.orchestra.run.smithi135.stdout:(93/150): python3-toml-0.10.2-6.el9.noarch.rpm 70 kB/s | 42 kB 00:00 2024-08-20T04:48:17.076 INFO:teuthology.orchestra.run.smithi130.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 76 kB/s | 44 kB 00:00 2024-08-20T04:48:17.317 INFO:teuthology.orchestra.run.smithi135.stdout:(94/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 75 kB/s | 44 kB 00:00 2024-08-20T04:48:17.584 INFO:teuthology.orchestra.run.smithi130.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 268 kB/s | 221 kB 00:00 2024-08-20T04:48:17.625 INFO:teuthology.orchestra.run.smithi135.stdout:(95/150): qatlib-24.02.0-1.el9.x86_64.rpm 270 kB/s | 221 kB 00:00 2024-08-20T04:48:17.635 INFO:teuthology.orchestra.run.smithi130.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 64 kB/s | 36 kB 00:00 2024-08-20T04:48:17.892 INFO:teuthology.orchestra.run.smithi135.stdout:(96/150): qatlib-service-24.02.0-1.el9.x86_64.r 62 kB/s | 36 kB 00:00 2024-08-20T04:48:18.160 INFO:teuthology.orchestra.run.smithi130.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-08-20T04:48:18.201 INFO:teuthology.orchestra.run.smithi135.stdout:(97/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-08-20T04:48:18.577 INFO:teuthology.orchestra.run.smithi130.stdout:(98/150): socat-1.7.4.1-6.el9.x86_64.rpm 323 kB/s | 304 kB 00:00 2024-08-20T04:48:18.819 INFO:teuthology.orchestra.run.smithi130.stdout:(99/150): uuid-1.6.2-55.el9.x86_64.rpm 88 kB/s | 58 kB 00:00 2024-08-20T04:48:18.926 INFO:teuthology.orchestra.run.smithi135.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 80 kB/s | 58 kB 00:00 2024-08-20T04:48:18.951 INFO:teuthology.orchestra.run.smithi135.stdout:(99/150): socat-1.7.4.1-6.el9.x86_64.rpm 287 kB/s | 304 kB 00:01 2024-08-20T04:48:19.413 INFO:teuthology.orchestra.run.smithi130.stdout:(100/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 115 kB/s | 96 kB 00:00 2024-08-20T04:48:19.530 INFO:teuthology.orchestra.run.smithi130.stdout:(101/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 90 kB/s | 64 kB 00:00 2024-08-20T04:48:19.622 INFO:teuthology.orchestra.run.smithi130.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 244 kB/s | 22 kB 00:00 2024-08-20T04:48:19.643 INFO:teuthology.orchestra.run.smithi135.stdout:(100/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 92 kB/s | 64 kB 00:00 2024-08-20T04:48:19.685 INFO:teuthology.orchestra.run.smithi135.stdout:(101/150): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 126 kB/s | 96 kB 00:00 2024-08-20T04:48:19.778 INFO:teuthology.orchestra.run.smithi135.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 244 kB/s | 22 kB 00:00 2024-08-20T04:48:19.780 INFO:teuthology.orchestra.run.smithi130.stdout:(103/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.4 MB/s | 16 MB 00:03 2024-08-20T04:48:19.847 INFO:teuthology.orchestra.run.smithi130.stdout:(104/150): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-08-20T04:48:19.872 INFO:teuthology.orchestra.run.smithi130.stdout:(105/150): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-08-20T04:48:19.898 INFO:teuthology.orchestra.run.smithi130.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 786 kB/s | 19 kB 00:00 2024-08-20T04:48:20.040 INFO:teuthology.orchestra.run.smithi130.stdout:(107/150): libarrow-9.0.0-11.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-08-20T04:48:20.073 INFO:teuthology.orchestra.run.smithi130.stdout:(108/150): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-08-20T04:48:20.098 INFO:teuthology.orchestra.run.smithi130.stdout:(109/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 446 kB/s | 26 kB 00:00 2024-08-20T04:48:20.132 INFO:teuthology.orchestra.run.smithi130.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.5 MB/s | 67 kB 00:00 2024-08-20T04:48:20.157 INFO:teuthology.orchestra.run.smithi130.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 6.4 MB/s | 151 kB 00:00 2024-08-20T04:48:20.183 INFO:teuthology.orchestra.run.smithi130.stdout:(112/150): liboath-2.6.7-2.el9.x86_64.rpm 445 kB/s | 49 kB 00:00 2024-08-20T04:48:20.194 INFO:teuthology.orchestra.run.smithi135.stdout:(103/150): protobuf-compiler-3.14.0-13.el9.x86_ 2.0 MB/s | 863 kB 00:00 2024-08-20T04:48:20.224 INFO:teuthology.orchestra.run.smithi130.stdout:(113/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-08-20T04:48:20.250 INFO:teuthology.orchestra.run.smithi130.stdout:(114/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 54 kB/s | 45 kB 00:00 2024-08-20T04:48:20.267 INFO:teuthology.orchestra.run.smithi130.stdout:(115/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-08-20T04:48:20.269 INFO:teuthology.orchestra.run.smithi135.stdout:(104/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 72 kB/s | 45 kB 00:00 2024-08-20T04:48:20.292 INFO:teuthology.orchestra.run.smithi130.stdout:(116/150): python3-certifi-2023.05.07-4.el9.noa 823 kB/s | 14 kB 00:00 2024-08-20T04:48:20.303 INFO:teuthology.orchestra.run.smithi135.stdout:(105/150): abseil-cpp-20211102.0-3.el9.x86_64.r 4.9 MB/s | 548 kB 00:00 2024-08-20T04:48:20.326 INFO:teuthology.orchestra.run.smithi130.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 5.4 MB/s | 172 kB 00:00 2024-08-20T04:48:20.328 INFO:teuthology.orchestra.run.smithi135.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 841 kB/s | 19 kB 00:00 2024-08-20T04:48:20.351 INFO:teuthology.orchestra.run.smithi130.stdout:(118/150): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-08-20T04:48:20.361 INFO:teuthology.orchestra.run.smithi135.stdout:(107/150): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-08-20T04:48:20.368 INFO:teuthology.orchestra.run.smithi130.stdout:(119/150): python3-cachetools-4.2.4-1.el9.noarc 273 kB/s | 32 kB 00:00 2024-08-20T04:48:20.390 INFO:teuthology.orchestra.run.smithi135.stdout:(108/150): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-08-20T04:48:20.401 INFO:teuthology.orchestra.run.smithi130.stdout:(120/150): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-08-20T04:48:20.412 INFO:teuthology.orchestra.run.smithi135.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-20T04:48:20.427 INFO:teuthology.orchestra.run.smithi130.stdout:(121/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-08-20T04:48:20.438 INFO:teuthology.orchestra.run.smithi135.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-08-20T04:48:20.452 INFO:teuthology.orchestra.run.smithi130.stdout:(122/150): python3-google-auth-2.33.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-08-20T04:48:20.471 INFO:teuthology.orchestra.run.smithi135.stdout:(111/150): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-08-20T04:48:20.477 INFO:teuthology.orchestra.run.smithi130.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 433 kB/s | 11 kB 00:00 2024-08-20T04:48:20.502 INFO:teuthology.orchestra.run.smithi130.stdout:(124/150): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-08-20T04:48:20.528 INFO:teuthology.orchestra.run.smithi130.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-08-20T04:48:20.538 INFO:teuthology.orchestra.run.smithi135.stdout:(112/150): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-08-20T04:48:20.553 INFO:teuthology.orchestra.run.smithi130.stdout:(126/150): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-08-20T04:48:20.587 INFO:teuthology.orchestra.run.smithi130.stdout:(127/150): python3-jaraco-functools-3.5.0-2.el9 333 kB/s | 19 kB 00:00 2024-08-20T04:48:20.612 INFO:teuthology.orchestra.run.smithi130.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 335 kB/s | 20 kB 00:00 2024-08-20T04:48:20.613 INFO:teuthology.orchestra.run.smithi135.stdout:(113/150): libarrow-9.0.0-11.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-08-20T04:48:20.630 INFO:teuthology.orchestra.run.smithi135.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-08-20T04:48:20.637 INFO:teuthology.orchestra.run.smithi130.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-20T04:48:20.664 INFO:teuthology.orchestra.run.smithi135.stdout:(115/150): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-08-20T04:48:20.671 INFO:teuthology.orchestra.run.smithi130.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-08-20T04:48:20.681 INFO:teuthology.orchestra.run.smithi135.stdout:(116/150): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-08-20T04:48:20.698 INFO:teuthology.orchestra.run.smithi135.stdout:(117/150): python3-certifi-2023.05.07-4.el9.noa 420 kB/s | 14 kB 00:00 2024-08-20T04:48:20.705 INFO:teuthology.orchestra.run.smithi130.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-08-20T04:48:20.723 INFO:teuthology.orchestra.run.smithi135.stdout:(118/150): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-08-20T04:48:20.747 INFO:teuthology.orchestra.run.smithi130.stdout:(132/150): python3-grpcio-1.46.7-10.el9.x86_64. 5.9 MB/s | 2.0 MB 00:00 2024-08-20T04:48:20.757 INFO:teuthology.orchestra.run.smithi135.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-08-20T04:48:20.772 INFO:teuthology.orchestra.run.smithi130.stdout:(133/150): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-08-20T04:48:20.782 INFO:teuthology.orchestra.run.smithi135.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-08-20T04:48:20.807 INFO:teuthology.orchestra.run.smithi135.stdout:(121/150): python3-google-auth-2.33.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-08-20T04:48:20.814 INFO:teuthology.orchestra.run.smithi130.stdout:(134/150): python3-kubernetes-26.1.0-2.el9.noar 4.5 MB/s | 1.0 MB 00:00 2024-08-20T04:48:20.841 INFO:teuthology.orchestra.run.smithi135.stdout:(122/150): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-08-20T04:48:20.866 INFO:teuthology.orchestra.run.smithi135.stdout:(123/150): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-08-20T04:48:20.891 INFO:teuthology.orchestra.run.smithi135.stdout:(124/150): python3-jaraco-classes-3.2.1-5.el9.n 715 kB/s | 18 kB 00:00 2024-08-20T04:48:20.917 INFO:teuthology.orchestra.run.smithi135.stdout:(125/150): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-08-20T04:48:20.959 INFO:teuthology.orchestra.run.smithi135.stdout:(126/150): python3-jaraco-functools-3.5.0-2.el9 469 kB/s | 19 kB 00:00 2024-08-20T04:48:21.009 INFO:teuthology.orchestra.run.smithi135.stdout:(127/150): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-08-20T04:48:21.034 INFO:teuthology.orchestra.run.smithi135.stdout:(128/150): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-08-20T04:48:21.059 INFO:teuthology.orchestra.run.smithi135.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-20T04:48:21.063 INFO:teuthology.orchestra.run.smithi130.stdout:(135/150): python3-pecan-1.4.2-3.el9.noarch.rpm 761 kB/s | 272 kB 00:00 2024-08-20T04:48:21.085 INFO:teuthology.orchestra.run.smithi135.stdout:(130/150): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-20T04:48:21.090 INFO:teuthology.orchestra.run.smithi130.stdout:(136/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 283 kB/s | 90 kB 00:00 2024-08-20T04:48:21.110 INFO:teuthology.orchestra.run.smithi135.stdout:(131/150): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-20T04:48:21.115 INFO:teuthology.orchestra.run.smithi130.stdout:(137/150): python3-pyperclip-1.8.2-2.el9.noarch 94 kB/s | 28 kB 00:00 2024-08-20T04:48:21.140 INFO:teuthology.orchestra.run.smithi130.stdout:(138/150): python3-repoze-lru-0.7-16.el9.noarch 400 kB/s | 31 kB 00:00 2024-08-20T04:48:21.143 INFO:teuthology.orchestra.run.smithi135.stdout:(132/150): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-08-20T04:48:21.165 INFO:teuthology.orchestra.run.smithi130.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-08-20T04:48:21.169 INFO:teuthology.orchestra.run.smithi135.stdout:(133/150): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-08-20T04:48:21.191 INFO:teuthology.orchestra.run.smithi130.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-08-20T04:48:21.194 INFO:teuthology.orchestra.run.smithi135.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-08-20T04:48:21.216 INFO:teuthology.orchestra.run.smithi130.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-20T04:48:21.219 INFO:teuthology.orchestra.run.smithi135.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-08-20T04:48:21.241 INFO:teuthology.orchestra.run.smithi130.stdout:(142/150): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-08-20T04:48:21.245 INFO:teuthology.orchestra.run.smithi135.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 565 kB/s | 28 kB 00:00 2024-08-20T04:48:21.267 INFO:teuthology.orchestra.run.smithi130.stdout:(143/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-20T04:48:21.270 INFO:teuthology.orchestra.run.smithi135.stdout:(137/150): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-08-20T04:48:21.292 INFO:teuthology.orchestra.run.smithi130.stdout:(144/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-08-20T04:48:21.295 INFO:teuthology.orchestra.run.smithi135.stdout:(138/150): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-20T04:48:21.317 INFO:teuthology.orchestra.run.smithi130.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-08-20T04:48:21.321 INFO:teuthology.orchestra.run.smithi135.stdout:(139/150): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-08-20T04:48:21.346 INFO:teuthology.orchestra.run.smithi135.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-08-20T04:48:21.351 INFO:teuthology.orchestra.run.smithi130.stdout:(146/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-08-20T04:48:21.376 INFO:teuthology.orchestra.run.smithi130.stdout:(147/150): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-08-20T04:48:21.380 INFO:teuthology.orchestra.run.smithi135.stdout:(141/150): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-08-20T04:48:21.413 INFO:teuthology.orchestra.run.smithi135.stdout:(142/150): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-08-20T04:48:21.435 INFO:teuthology.orchestra.run.smithi130.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-08-20T04:48:21.447 INFO:teuthology.orchestra.run.smithi135.stdout:(143/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-08-20T04:48:21.472 INFO:teuthology.orchestra.run.smithi135.stdout:(144/150): python3-werkzeug-2.0.3-3.el9.1.noarc 7.1 MB/s | 427 kB 00:00 2024-08-20T04:48:21.497 INFO:teuthology.orchestra.run.smithi135.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-08-20T04:48:21.516 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-08-20T04:48:21.523 INFO:teuthology.orchestra.run.smithi135.stdout:(146/150): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-08-20T04:48:21.581 INFO:teuthology.orchestra.run.smithi135.stdout:(147/150): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-08-20T04:48:21.593 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-20T04:48:21.624 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-20T04:48:21.715 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-20T04:48:21.718 INFO:teuthology.orchestra.run.smithi130.stdout:(149/150): librados2-19.0.0-5872.gef427541.el9. 9.4 MB/s | 3.5 MB 00:00 2024-08-20T04:48:21.798 INFO:teuthology.orchestra.run.smithi135.stdout:(148/150): librados2-19.0.0-5872.gef427541.el9. 13 MB/s | 3.5 MB 00:00 2024-08-20T04:48:21.826 INFO:teuthology.orchestra.run.smithi130.stdout:(150/150): librbd1-19.0.0-5872.gef427541.el9.x8 7.3 MB/s | 3.2 MB 00:00 2024-08-20T04:48:21.835 INFO:teuthology.orchestra.run.smithi130.stdout:-------------------------------------------------------------------------------- 2024-08-20T04:48:21.836 INFO:teuthology.orchestra.run.smithi130.stdout:Total 8.7 MB/s | 232 MB 00:26 2024-08-20T04:48:21.882 INFO:teuthology.orchestra.run.smithi135.stdout:(149/150): librbd1-19.0.0-5872.gef427541.el9.x8 11 MB/s | 3.2 MB 00:00 2024-08-20T04:48:22.118 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-20T04:48:22.216 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T04:48:22.375 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T04:48:22.420 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T04:48:22.546 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T04:48:22.600 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T04:48:22.634 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-20T04:48:22.666 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-20T04:48:22.765 INFO:teuthology.orchestra.run.smithi135.stdout:(150/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.5 MB/s | 16 MB 00:06 2024-08-20T04:48:22.772 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-08-20T04:48:22.772 INFO:teuthology.orchestra.run.smithi135.stdout:Total 9.0 MB/s | 232 MB 00:25 2024-08-20T04:48:22.901 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction check 2024-08-20T04:48:22.924 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-20T04:48:22.996 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-20T04:48:23.033 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction check succeeded. 2024-08-20T04:48:23.033 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction test 2024-08-20T04:48:23.048 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T04:48:23.177 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T04:48:23.207 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T04:48:23.290 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T04:48:23.308 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T04:48:23.352 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T04:48:23.737 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T04:48:23.770 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T04:48:23.918 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-20T04:48:23.940 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-08-20T04:48:23.949 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-20T04:48:24.020 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-20T04:48:24.072 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-08-20T04:48:24.072 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-08-20T04:48:24.105 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-20T04:48:24.165 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-20T04:48:24.211 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-20T04:48:24.266 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-20T04:48:24.329 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-20T04:48:24.371 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-20T04:48:24.463 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-20T04:48:24.525 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-20T04:48:24.558 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-20T04:48:24.630 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-20T04:48:24.731 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-20T04:48:24.770 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 30/152 2024-08-20T04:48:24.817 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 31/152 2024-08-20T04:48:24.850 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 32/152 2024-08-20T04:48:24.945 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-20T04:48:25.004 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-20T04:48:25.099 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-20T04:48:25.274 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-20T04:48:25.350 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-20T04:48:25.498 INFO:teuthology.orchestra.run.smithi130.stdout:Transaction test succeeded. 2024-08-20T04:48:25.499 INFO:teuthology.orchestra.run.smithi130.stdout:Running transaction 2024-08-20T04:48:26.044 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-20T04:48:26.160 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-20T04:48:26.201 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-20T04:48:26.254 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-20T04:48:26.276 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-08-20T04:48:26.276 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-08-20T04:48:26.293 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 42/152 2024-08-20T04:48:26.334 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-20T04:48:26.446 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-20T04:48:26.547 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-20T04:48:26.643 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-20T04:48:26.908 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-20T04:48:26.957 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-20T04:48:27.018 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-20T04:48:27.055 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-20T04:48:27.111 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-20T04:48:27.353 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-20T04:48:27.579 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-20T04:48:27.634 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-20T04:48:27.686 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-20T04:48:27.826 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-20T04:48:27.901 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-20T04:48:27.943 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-20T04:48:27.972 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-20T04:48:27.997 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-20T04:48:28.112 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-20T04:48:28.327 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-20T04:48:28.364 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-20T04:48:28.406 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-20T04:48:28.467 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-20T04:48:28.542 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-20T04:48:28.585 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-20T04:48:28.625 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-20T04:48:28.661 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-20T04:48:28.704 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-20T04:48:28.746 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-20T04:48:28.798 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-20T04:48:28.855 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-20T04:48:28.963 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-20T04:48:29.015 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-20T04:48:29.050 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-20T04:48:29.182 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-20T04:48:29.249 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-20T04:48:30.220 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-20T04:48:30.274 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-20T04:48:30.308 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-20T04:48:30.431 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-20T04:48:30.491 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 83/152 2024-08-20T04:48:30.546 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-20T04:48:30.664 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-20T04:48:30.726 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-20T04:48:30.974 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.26-1.el9.x86_64 87/152 2024-08-20T04:48:31.031 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 88/152 2024-08-20T04:48:31.130 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-20T04:48:31.361 INFO:teuthology.orchestra.run.smithi130.stdout: Preparing : 1/1 2024-08-20T04:48:31.420 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-20T04:48:31.445 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-20T04:48:31.528 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-20T04:48:31.884 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-20T04:48:31.997 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T04:48:32.020 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-20T04:48:32.119 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T04:48:32.148 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T04:48:32.162 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-20T04:48:32.212 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-08-20T04:48:32.243 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T04:48:32.282 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T04:48:32.284 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-08-20T04:48:32.309 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-08-20T04:48:32.310 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-20T04:48:32.336 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-20T04:48:32.407 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-08-20T04:48:32.525 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-20T04:48:32.575 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-20T04:48:32.603 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T04:48:32.708 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T04:48:32.737 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T04:48:32.745 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-08-20T04:48:32.816 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T04:48:32.838 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T04:48:32.857 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T04:48:32.910 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T04:48:33.097 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:19.0.0-5872.gef427541.el9.x86_64 5/152 2024-08-20T04:48:33.119 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T04:48:33.164 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T04:48:33.197 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T04:48:33.215 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T04:48:33.246 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T04:48:33.274 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-08-20T04:48:33.300 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-08-20T04:48:33.305 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-20T04:48:33.341 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-20T04:48:33.379 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-20T04:48:33.454 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-20T04:48:33.506 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-20T04:48:33.514 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 10/152 2024-08-20T04:48:33.546 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-20T04:48:33.584 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-13.16-1.el9.x86_64 11/152 2024-08-20T04:48:33.589 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-20T04:48:33.608 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T04:48:33.623 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-20T04:48:33.649 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-20T04:48:33.712 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T04:48:33.720 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-20T04:48:33.742 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T04:48:33.781 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-20T04:48:33.806 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 13/152 2024-08-20T04:48:33.811 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-20T04:48:33.835 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T04:48:33.843 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-20T04:48:33.854 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-20T04:48:33.861 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-08-20T04:48:33.931 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-20T04:48:33.947 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T04:48:33.965 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 30/152 2024-08-20T04:48:33.988 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-20T04:48:34.011 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 31/152 2024-08-20T04:48:34.024 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-20T04:48:34.037 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 32/152 2024-08-20T04:48:34.108 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-20T04:48:34.134 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T04:48:34.160 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-20T04:48:34.168 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-08-20T04:48:34.235 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-20T04:48:34.286 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-08-20T04:48:34.316 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 17/152 2024-08-20T04:48:34.351 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/152 2024-08-20T04:48:34.370 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-20T04:48:34.403 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-20T04:48:34.421 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-20T04:48:34.422 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/152 2024-08-20T04:48:34.470 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/152 2024-08-20T04:48:34.475 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T04:48:34.519 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-packaging-20.9-5.el9.noarch 21/152 2024-08-20T04:48:34.562 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-08-20T04:48:34.595 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-08-20T04:48:34.605 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T04:48:34.621 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-08-20T04:48:34.633 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 98/152 2024-08-20T04:48:34.683 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-20T04:48:34.691 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-08-20T04:48:34.744 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 26/152 2024-08-20T04:48:34.775 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-08-20T04:48:34.824 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 28/152 2024-08-20T04:48:34.905 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 29/152 2024-08-20T04:48:34.937 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 30/152 2024-08-20T04:48:34.960 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-20T04:48:34.974 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 31/152 2024-08-20T04:48:34.992 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 32/152 2024-08-20T04:48:35.050 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-20T04:48:35.064 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-08-20T04:48:35.078 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-20T04:48:35.107 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : luarocks-3.9.2-5.el9.noarch 34/152 2024-08-20T04:48:35.122 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-20T04:48:35.159 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 42/152 2024-08-20T04:48:35.182 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-08-20T04:48:35.192 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-20T04:48:35.252 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-20T04:48:35.278 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-20T04:48:35.280 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T04:48:35.318 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-08-20T04:48:35.341 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-20T04:48:35.357 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T04:48:35.377 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-08-20T04:48:35.414 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-20T04:48:35.415 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 102/152 2024-08-20T04:48:35.445 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-20T04:48:35.481 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-20T04:48:35.528 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-20T04:48:35.563 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-20T04:48:35.607 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-20T04:48:35.649 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-20T04:48:35.789 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-20T04:48:35.825 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-20T04:48:35.867 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-20T04:48:35.938 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-08-20T04:48:35.971 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-20T04:48:36.001 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-20T04:48:36.032 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-08-20T04:48:36.043 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-20T04:48:36.059 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 40/152 2024-08-20T04:48:36.066 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-20T04:48:36.090 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-20T04:48:36.103 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-08-20T04:48:36.131 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 42/152 2024-08-20T04:48:36.173 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-08-20T04:48:36.185 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-20T04:48:36.267 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-08-20T04:48:36.320 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-20T04:48:36.330 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 45/152 2024-08-20T04:48:36.356 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-20T04:48:36.394 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-20T04:48:36.403 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 46/152 2024-08-20T04:48:36.427 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-20T04:48:36.433 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 47/152 2024-08-20T04:48:36.469 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 48/152 2024-08-20T04:48:36.472 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-20T04:48:36.508 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-20T04:48:36.516 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 49/152 2024-08-20T04:48:36.531 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-20T04:48:36.552 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 50/152 2024-08-20T04:48:36.561 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-20T04:48:36.595 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-20T04:48:36.612 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 51/152 2024-08-20T04:48:36.629 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-20T04:48:36.657 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 52/152 2024-08-20T04:48:36.671 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-20T04:48:36.705 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-20T04:48:36.794 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-20T04:48:36.795 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 53/152 2024-08-20T04:48:36.836 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-20T04:48:36.842 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 54/152 2024-08-20T04:48:36.867 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-20T04:48:36.884 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 55/152 2024-08-20T04:48:36.971 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-20T04:48:36.989 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-08-20T04:48:37.026 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 57/152 2024-08-20T04:48:37.034 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-20T04:48:37.068 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-08-20T04:48:37.108 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-08-20T04:48:37.134 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 60/152 2024-08-20T04:48:37.244 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-08-20T04:48:37.371 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-08-20T04:48:37.409 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-08-20T04:48:37.437 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-08-20T04:48:37.476 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-08-20T04:48:37.525 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-08-20T04:48:37.562 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 67/152 2024-08-20T04:48:37.593 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-08-20T04:48:37.624 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-08-20T04:48:37.658 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-08-20T04:48:37.691 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-08-20T04:48:37.733 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-08-20T04:48:37.768 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-08-20T04:48:37.779 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-20T04:48:37.832 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-20T04:48:37.856 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-08-20T04:48:37.865 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-20T04:48:37.900 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-08-20T04:48:37.930 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-08-20T04:48:37.957 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-20T04:48:38.012 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 83/152 2024-08-20T04:48:38.035 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-08-20T04:48:38.057 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-20T04:48:38.090 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 78/152 2024-08-20T04:48:38.147 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-20T04:48:38.151 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T04:48:38.185 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-20T04:48:38.187 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T04:48:38.361 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-0.3.26-1.el9.x86_64 87/152 2024-08-20T04:48:38.382 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 88/152 2024-08-20T04:48:38.460 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-20T04:48:38.831 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 79/152 2024-08-20T04:48:38.857 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T04:48:38.880 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 80/152 2024-08-20T04:48:38.907 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T04:48:38.914 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 81/152 2024-08-20T04:48:39.015 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 82/152 2024-08-20T04:48:39.044 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T04:48:39.044 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-20T04:48:39.044 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-20T04:48:39.044 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:48:39.070 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-devel-3.9.19-7.el9.x86_64 83/152 2024-08-20T04:48:39.084 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T04:48:39.115 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 84/152 2024-08-20T04:48:39.128 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-20T04:48:39.203 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-08-20T04:48:39.234 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-08-20T04:48:39.241 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-20T04:48:39.411 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.26-1.el9.x86_64 87/152 2024-08-20T04:48:39.440 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-openmp-0.3.26-1.el9.x86_64 88/152 2024-08-20T04:48:39.519 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-08-20T04:48:40.184 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-08-20T04:48:40.301 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-08-20T04:48:40.528 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-20T04:48:40.628 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T04:48:40.658 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-20T04:48:40.689 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-20T04:48:41.024 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-20T04:48:41.060 INFO:teuthology.orchestra.run.smithi130.stdout: Upgrading : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T04:48:41.155 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T04:48:41.172 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 98/152 2024-08-20T04:48:41.218 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-20T04:48:41.585 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-08-20T04:48:41.675 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T04:48:41.699 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-08-20T04:48:41.720 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-08-20T04:48:41.720 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-20T04:48:41.746 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T04:48:41.820 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T04:48:41.847 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 102/152 2024-08-20T04:48:42.054 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-08-20T04:48:42.091 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T04:48:42.187 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 97/152 2024-08-20T04:48:42.213 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 98/152 2024-08-20T04:48:42.250 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-08-20T04:48:42.742 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 100/152 2024-08-20T04:48:42.770 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T04:48:42.843 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 101/152 2024-08-20T04:48:42.872 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 102/152 2024-08-20T04:48:44.167 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T04:48:44.202 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T04:48:44.757 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T04:48:44.798 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T04:48:44.878 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T04:48:44.878 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-20T04:48:44.878 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-20T04:48:44.878 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:48:44.916 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T04:48:45.509 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T04:48:45.553 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T04:48:46.109 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 103/152 2024-08-20T04:48:46.158 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T04:48:46.234 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 104/152 2024-08-20T04:48:46.234 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-20T04:48:46.234 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-20T04:48:46.234 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:48:46.260 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T04:48:51.838 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T04:48:51.838 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2024-08-20T04:48:51.838 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2024-08-20T04:48:51.839 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2024-08-20T04:48:51.839 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2024-08-20T04:48:51.839 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2024-08-20T04:48:51.839 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2024-08-20T04:48:51.839 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2024-08-20T04:48:51.839 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:48:52.054 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T04:48:52.091 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T04:48:52.091 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:48:52.091 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-20T04:48:52.091 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:48:53.792 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T04:48:53.851 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T04:48:53.851 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:48:53.851 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-20T04:48:53.851 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T04:48:53.851 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T04:48:53.851 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:48:54.109 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T04:48:54.161 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T04:48:54.161 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:48:54.161 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-20T04:48:54.161 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T04:48:54.161 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T04:48:54.161 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:48:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T04:48:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T04:48:54.728 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:48:54.728 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-20T04:48:54.728 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T04:48:54.728 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T04:48:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:48:54.877 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-20T04:48:54.938 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-20T04:48:55.020 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-20T04:48:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-20T04:48:55.315 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-20T04:48:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-20T04:48:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-20T04:48:55.714 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-20T04:48:55.790 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-20T04:48:55.829 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-20T04:48:55.863 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-20T04:48:56.321 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T04:48:56.365 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T04:48:56.365 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /sys 2024-08-20T04:48:56.365 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /proc 2024-08-20T04:48:56.365 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /mnt 2024-08-20T04:48:56.366 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /var/tmp 2024-08-20T04:48:56.366 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /home 2024-08-20T04:48:56.366 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /root 2024-08-20T04:48:56.366 INFO:teuthology.orchestra.run.smithi130.stdout:skipping the directory /tmp 2024-08-20T04:48:56.366 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:48:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T04:48:56.431 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 122/152 2024-08-20T04:48:56.512 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 123/152 2024-08-20T04:48:56.545 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T04:48:56.552 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T04:48:56.561 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T04:48:56.561 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:48:56.561 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-20T04:48:56.561 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:48:58.056 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T04:48:58.082 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T04:48:58.082 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:48:58.082 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-20T04:48:58.083 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T04:48:58.083 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T04:48:58.083 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:48:58.187 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 105/152 2024-08-20T04:48:58.187 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2024-08-20T04:48:58.187 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2024-08-20T04:48:58.187 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2024-08-20T04:48:58.187 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2024-08-20T04:48:58.187 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2024-08-20T04:48:58.187 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /root 2024-08-20T04:48:58.187 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2024-08-20T04:48:58.188 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:48:58.307 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T04:48:58.330 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T04:48:58.330 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:48:58.330 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-20T04:48:58.330 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T04:48:58.330 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T04:48:58.330 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:48:58.375 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T04:48:58.392 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 106/152 2024-08-20T04:48:58.392 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:48:58.392 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-20T04:48:58.392 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:48:58.774 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T04:48:58.797 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T04:48:58.797 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:48:58.797 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-20T04:48:58.797 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T04:48:58.797 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T04:48:58.798 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:48:58.913 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-20T04:48:58.970 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-20T04:48:59.024 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-20T04:48:59.211 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-20T04:48:59.258 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-20T04:48:59.336 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-20T04:48:59.424 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-20T04:48:59.563 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-20T04:48:59.616 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-20T04:48:59.648 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-20T04:48:59.676 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-20T04:48:59.920 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T04:48:59.948 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 107/152 2024-08-20T04:48:59.949 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:48:59.949 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-20T04:48:59.949 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T04:48:59.949 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-20T04:48:59.949 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:49:00.123 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T04:49:00.150 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T04:49:00.171 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T04:49:00.182 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 122/152 2024-08-20T04:49:00.195 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 108/152 2024-08-20T04:49:00.195 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:49:00.195 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-20T04:49:00.195 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T04:49:00.196 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-20T04:49:00.196 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:49:00.247 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 123/152 2024-08-20T04:49:00.282 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T04:49:00.403 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T04:49:00.475 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T04:49:00.639 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T04:49:00.663 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 109/152 2024-08-20T04:49:00.663 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:49:00.663 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-20T04:49:00.663 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T04:49:00.663 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-20T04:49:00.663 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:49:00.761 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-08-20T04:49:00.809 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-08-20T04:49:00.865 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-08-20T04:49:01.049 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-08-20T04:49:01.091 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-08-20T04:49:01.168 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-08-20T04:49:01.257 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-08-20T04:49:01.397 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-08-20T04:49:01.439 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-08-20T04:49:01.474 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-08-20T04:49:01.503 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.9-16.el9.x86_64 120/152 2024-08-20T04:49:01.627 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T04:49:01.658 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T04:49:01.815 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T04:49:01.892 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T04:49:01.910 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:19.0.0-5872.gef427541.el9.noarch 121/152 2024-08-20T04:49:01.943 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 122/152 2024-08-20T04:49:01.997 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 127/152 2024-08-20T04:49:02.007 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 123/152 2024-08-20T04:49:02.035 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T04:49:02.042 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T04:49:02.087 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T04:49:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:49:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-20T04:49:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T04:49:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T04:49:02.088 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:49:02.144 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T04:49:02.171 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T04:49:02.283 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:19.0.0-5872.gef427541.el9.x86_64 130/152 2024-08-20T04:49:02.376 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 131/152 2024-08-20T04:49:03.455 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T04:49:03.473 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-20T04:49:03.504 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T04:49:03.505 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T04:49:03.559 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T04:49:03.560 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:49:03.560 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-20T04:49:03.560 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T04:49:03.560 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T04:49:03.560 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:49:03.614 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T04:49:03.664 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T04:49:03.664 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:49:03.665 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-20T04:49:03.665 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:49:03.723 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:49:04.140 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T04:49:04.192 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T04:49:04.192 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:49:04.192 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-20T04:49:04.192 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T04:49:04.193 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T04:49:04.193 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:49:04.469 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T04:49:04.496 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T04:49:04.607 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T04:49:04.767 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 127/152 2024-08-20T04:49:04.798 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T04:49:04.822 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T04:49:04.822 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:49:04.822 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-20T04:49:04.822 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T04:49:04.822 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T04:49:04.823 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:49:04.866 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T04:49:04.877 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T04:49:04.975 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-2:19.0.0-5872.gef427541.el9.x86_64 130/152 2024-08-20T04:49:05.029 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 131/152 2024-08-20T04:49:05.222 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 124/152 2024-08-20T04:49:05.275 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T04:49:05.987 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-20T04:49:06.018 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T04:49:06.041 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T04:49:06.041 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:49:06.041 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-20T04:49:06.041 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T04:49:06.041 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T04:49:06.041 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:49:06.085 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T04:49:06.108 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T04:49:06.108 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:49:06.108 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-20T04:49:06.108 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:49:06.169 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T04:49:06.192 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T04:49:06.192 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:49:06.192 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-20T04:49:06.193 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T04:49:06.193 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T04:49:06.193 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:49:06.240 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 125/152 2024-08-20T04:49:06.276 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T04:49:06.391 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 126/152 2024-08-20T04:49:06.534 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T04:49:06.555 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 127/152 2024-08-20T04:49:06.558 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T04:49:06.558 INFO:teuthology.orchestra.run.smithi130.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:49:06.558 INFO:teuthology.orchestra.run.smithi130.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-20T04:49:06.558 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T04:49:06.558 INFO:teuthology.orchestra.run.smithi130.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T04:49:06.558 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:49:06.586 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T04:49:06.611 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 128/152 2024-08-20T04:49:06.611 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:49:06.611 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-20T04:49:06.611 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T04:49:06.611 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-20T04:49:06.611 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:49:06.663 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T04:49:06.675 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 129/152 2024-08-20T04:49:06.773 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:19.0.0-5872.gef427541.el9.x86_64 130/152 2024-08-20T04:49:06.829 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 131/152 2024-08-20T04:49:07.789 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-2.4.6-46.el9.x86_64 132/152 2024-08-20T04:49:07.816 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T04:49:07.840 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 133/152 2024-08-20T04:49:07.840 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:49:07.840 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-20T04:49:07.840 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T04:49:07.840 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-20T04:49:07.840 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:49:07.883 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T04:49:07.906 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5872.gef427 134/152 2024-08-20T04:49:07.906 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:49:07.907 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-20T04:49:07.907 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:49:07.959 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T04:49:07.982 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 135/152 2024-08-20T04:49:07.983 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:49:07.983 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-20T04:49:07.983 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T04:49:07.983 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-20T04:49:07.983 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:49:08.293 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T04:49:08.317 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 136/152 2024-08-20T04:49:08.317 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-20T04:49:08.317 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-20T04:49:08.317 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T04:49:08.317 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-20T04:49:08.318 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:49:09.613 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 137/152 2024-08-20T04:49:09.655 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 138/152 2024-08-20T04:49:09.717 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 139/152 2024-08-20T04:49:09.752 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-20T04:49:09.821 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-20T04:49:10.072 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 142/152 2024-08-20T04:49:10.151 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-20T04:49:10.171 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 144/152 2024-08-20T04:49:10.938 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T04:49:10.986 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T04:49:11.028 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T04:49:11.257 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 137/152 2024-08-20T04:49:11.298 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 138/152 2024-08-20T04:49:11.351 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 139/152 2024-08-20T04:49:11.380 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-20T04:49:11.407 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-20T04:49:11.601 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 142/152 2024-08-20T04:49:11.653 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-20T04:49:11.683 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 144/152 2024-08-20T04:49:12.278 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T04:49:12.328 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T04:49:12.348 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T04:49:12.404 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 146/152 2024-08-20T04:49:12.519 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-20T04:49:12.577 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-20T04:49:12.717 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-20T04:49:12.758 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-20T04:49:12.758 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T04:49:12.848 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T04:49:12.849 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T04:49:13.032 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 137/152 2024-08-20T04:49:13.073 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 138/152 2024-08-20T04:49:13.126 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 139/152 2024-08-20T04:49:13.159 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 140/152 2024-08-20T04:49:13.171 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 146/152 2024-08-20T04:49:13.187 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 141/152 2024-08-20T04:49:13.240 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T04:49:13.240 INFO:teuthology.orchestra.run.smithi037.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-20T04:49:13.241 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:49:13.241 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-20T04:49:13.293 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-20T04:49:13.388 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 142/152 2024-08-20T04:49:13.400 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-20T04:49:13.434 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 143/152 2024-08-20T04:49:13.438 INFO:teuthology.orchestra.run.smithi130.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-20T04:49:13.438 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T04:49:13.464 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 144/152 2024-08-20T04:49:13.522 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T04:49:13.522 INFO:teuthology.orchestra.run.smithi130.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T04:49:14.088 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T04:49:14.131 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T04:49:14.151 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 145/152 2024-08-20T04:49:14.989 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 146/152 2024-08-20T04:49:15.080 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 147/152 2024-08-20T04:49:15.136 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-08-20T04:49:15.226 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-08-20T04:49:15.261 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-08-20T04:49:15.261 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T04:49:15.353 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-08-20T04:49:15.353 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T04:49:19.612 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:19.0.0-5872.gef427541.el9.x86_64 1/152 2024-08-20T04:49:19.612 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2/152 2024-08-20T04:49:19.612 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 3/152 2024-08-20T04:49:19.613 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 4/152 2024-08-20T04:49:19.613 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5872.gef427 5/152 2024-08-20T04:49:19.613 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T04:49:19.613 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T04:49:19.613 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 8/152 2024-08-20T04:49:19.613 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 9/152 2024-08-20T04:49:19.613 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 10/152 2024-08-20T04:49:19.613 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 11/152 2024-08-20T04:49:19.613 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T04:49:19.613 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 13/152 2024-08-20T04:49:19.613 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 14/152 2024-08-20T04:49:19.613 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 15/152 2024-08-20T04:49:19.614 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 16/152 2024-08-20T04:49:19.614 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 17/152 2024-08-20T04:49:19.614 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 18/152 2024-08-20T04:49:19.614 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 19/152 2024-08-20T04:49:19.614 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 20/152 2024-08-20T04:49:19.614 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 21/152 2024-08-20T04:49:19.614 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 22/152 2024-08-20T04:49:19.614 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 23/152 2024-08-20T04:49:19.614 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 24/152 2024-08-20T04:49:19.614 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 25/152 2024-08-20T04:49:19.614 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 26/152 2024-08-20T04:49:19.614 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 27/152 2024-08-20T04:49:19.614 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 28/152 2024-08-20T04:49:19.635 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 29/152 2024-08-20T04:49:19.635 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 30/152 2024-08-20T04:49:19.635 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 31/152 2024-08-20T04:49:19.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 32/152 2024-08-20T04:49:19.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 33/152 2024-08-20T04:49:19.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 34/152 2024-08-20T04:49:19.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 35/152 2024-08-20T04:49:19.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 36/152 2024-08-20T04:49:19.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 37/152 2024-08-20T04:49:19.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:19.0.0-5872.gef427541.el9.noarch 38/152 2024-08-20T04:49:19.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 39/152 2024-08-20T04:49:19.636 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-20T04:49:19.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-20T04:49:19.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-20T04:49:19.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-20T04:49:19.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-20T04:49:19.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-20T04:49:19.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-20T04:49:19.638 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-20T04:49:19.638 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-20T04:49:19.638 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-20T04:49:19.638 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-20T04:49:19.638 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-20T04:49:19.639 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-20T04:49:19.639 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-20T04:49:19.639 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-20T04:49:19.639 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-20T04:49:19.639 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-20T04:49:19.639 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-20T04:49:19.639 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-20T04:49:19.640 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-20T04:49:19.640 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-20T04:49:19.640 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-20T04:49:19.640 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-20T04:49:19.640 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-20T04:49:19.640 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-20T04:49:19.640 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-20T04:49:19.641 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 66/152 2024-08-20T04:49:19.641 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 67/152 2024-08-20T04:49:19.641 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-20T04:49:19.641 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-20T04:49:19.641 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-20T04:49:19.642 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-20T04:49:19.642 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-20T04:49:19.642 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-20T04:49:19.642 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-20T04:49:19.642 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-20T04:49:19.642 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-20T04:49:19.642 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/152 2024-08-20T04:49:19.642 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-20T04:49:19.642 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-20T04:49:19.642 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-20T04:49:19.642 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-20T04:49:19.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-20T04:49:19.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-20T04:49:19.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-20T04:49:19.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-20T04:49:19.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-20T04:49:19.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-20T04:49:19.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-20T04:49:19.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-20T04:49:19.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-20T04:49:19.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-20T04:49:19.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-20T04:49:19.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T04:49:19.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-20T04:49:19.644 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-20T04:49:19.644 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-20T04:49:19.644 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-20T04:49:19.644 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-20T04:49:19.644 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-20T04:49:19.644 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-20T04:49:19.644 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-20T04:49:19.644 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-20T04:49:19.644 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-20T04:49:19.644 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-20T04:49:19.644 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-20T04:49:19.644 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-20T04:49:19.644 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-20T04:49:19.644 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-20T04:49:19.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-20T04:49:19.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-20T04:49:19.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-20T04:49:19.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-20T04:49:19.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-20T04:49:19.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-20T04:49:19.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-20T04:49:19.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-20T04:49:19.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-20T04:49:19.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-20T04:49:19.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-20T04:49:19.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-20T04:49:19.645 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-20T04:49:19.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-20T04:49:19.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-20T04:49:19.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-20T04:49:19.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-20T04:49:19.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-20T04:49:19.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-20T04:49:19.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-20T04:49:19.646 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-20T04:49:19.647 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-20T04:49:19.647 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-20T04:49:19.647 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-20T04:49:19.647 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-20T04:49:19.647 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-20T04:49:19.647 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-20T04:49:19.647 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-20T04:49:19.647 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-20T04:49:19.647 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-20T04:49:19.647 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-20T04:49:19.647 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-20T04:49:19.647 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-20T04:49:19.647 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-20T04:49:19.648 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-20T04:49:19.648 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-20T04:49:19.648 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-20T04:49:19.648 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-20T04:49:19.648 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-20T04:49:19.648 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-20T04:49:19.648 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:19.0.0-5872.gef427541.el9.x86_64 149/152 2024-08-20T04:49:19.648 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-20T04:49:19.648 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 151/152 2024-08-20T04:49:20.162 INFO:teuthology.orchestra.run.smithi130.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T04:49:20.162 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-2:19.0.0-5872.gef427541.el9.x86_64 1/152 2024-08-20T04:49:20.163 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2/152 2024-08-20T04:49:20.163 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 3/152 2024-08-20T04:49:20.163 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 4/152 2024-08-20T04:49:20.163 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5872.gef427 5/152 2024-08-20T04:49:20.163 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T04:49:20.163 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T04:49:20.163 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 8/152 2024-08-20T04:49:20.163 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 9/152 2024-08-20T04:49:20.163 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 10/152 2024-08-20T04:49:20.163 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 11/152 2024-08-20T04:49:20.163 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T04:49:20.163 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 13/152 2024-08-20T04:49:20.164 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 14/152 2024-08-20T04:49:20.164 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 15/152 2024-08-20T04:49:20.164 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 16/152 2024-08-20T04:49:20.164 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 17/152 2024-08-20T04:49:20.164 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 18/152 2024-08-20T04:49:20.164 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 19/152 2024-08-20T04:49:20.164 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 20/152 2024-08-20T04:49:20.164 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 21/152 2024-08-20T04:49:20.164 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 22/152 2024-08-20T04:49:20.164 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 23/152 2024-08-20T04:49:20.164 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 24/152 2024-08-20T04:49:20.164 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 25/152 2024-08-20T04:49:20.164 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 26/152 2024-08-20T04:49:20.165 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 27/152 2024-08-20T04:49:20.165 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 28/152 2024-08-20T04:49:20.175 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 29/152 2024-08-20T04:49:20.175 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 30/152 2024-08-20T04:49:20.176 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 31/152 2024-08-20T04:49:20.176 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 32/152 2024-08-20T04:49:20.176 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 33/152 2024-08-20T04:49:20.176 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 34/152 2024-08-20T04:49:20.176 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 35/152 2024-08-20T04:49:20.176 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 36/152 2024-08-20T04:49:20.176 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 37/152 2024-08-20T04:49:20.176 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephadm-2:19.0.0-5872.gef427541.el9.noarch 38/152 2024-08-20T04:49:20.176 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 39/152 2024-08-20T04:49:20.176 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-20T04:49:20.176 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-20T04:49:20.176 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-20T04:49:20.176 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-20T04:49:20.176 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-20T04:49:20.177 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-20T04:49:20.177 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-20T04:49:20.177 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-20T04:49:20.177 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-20T04:49:20.177 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-20T04:49:20.177 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-20T04:49:20.177 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-20T04:49:20.177 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-20T04:49:20.177 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-20T04:49:20.177 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-20T04:49:20.177 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-20T04:49:20.177 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-20T04:49:20.177 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-20T04:49:20.177 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-20T04:49:20.178 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-20T04:49:20.178 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-20T04:49:20.178 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-20T04:49:20.178 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-20T04:49:20.178 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-20T04:49:20.178 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-20T04:49:20.178 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-20T04:49:20.178 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 66/152 2024-08-20T04:49:20.178 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 67/152 2024-08-20T04:49:20.178 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-20T04:49:20.178 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-20T04:49:20.178 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-20T04:49:20.178 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-20T04:49:20.178 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-20T04:49:20.179 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-20T04:49:20.179 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-20T04:49:20.179 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-20T04:49:20.179 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-20T04:49:20.179 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/152 2024-08-20T04:49:20.179 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-20T04:49:20.179 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-20T04:49:20.179 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-20T04:49:20.179 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-20T04:49:20.179 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-20T04:49:20.179 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-20T04:49:20.179 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-20T04:49:20.179 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-20T04:49:20.179 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-20T04:49:20.180 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-20T04:49:20.180 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-20T04:49:20.180 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-20T04:49:20.180 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-20T04:49:20.180 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-20T04:49:20.180 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-20T04:49:20.180 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T04:49:20.180 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-20T04:49:20.180 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-20T04:49:20.180 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-20T04:49:20.180 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-20T04:49:20.180 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-20T04:49:20.180 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-20T04:49:20.181 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-20T04:49:20.181 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-20T04:49:20.181 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-20T04:49:20.181 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-20T04:49:20.181 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-20T04:49:20.181 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-20T04:49:20.181 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-20T04:49:20.181 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-20T04:49:20.181 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-20T04:49:20.181 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-20T04:49:20.181 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-20T04:49:20.181 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-20T04:49:20.181 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-20T04:49:20.182 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-20T04:49:20.182 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-20T04:49:20.182 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-20T04:49:20.182 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-20T04:49:20.182 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-20T04:49:20.182 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-20T04:49:20.182 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-20T04:49:20.182 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-20T04:49:20.182 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-20T04:49:20.182 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-20T04:49:20.182 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-20T04:49:20.182 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-20T04:49:20.182 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-20T04:49:20.182 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-20T04:49:20.183 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-20T04:49:20.183 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-20T04:49:20.183 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-20T04:49:20.183 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-20T04:49:20.183 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-20T04:49:20.183 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-20T04:49:20.183 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-20T04:49:20.183 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-20T04:49:20.183 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-20T04:49:20.183 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-20T04:49:20.183 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-20T04:49:20.183 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-20T04:49:20.183 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-20T04:49:20.183 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-20T04:49:20.184 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-20T04:49:20.184 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-20T04:49:20.184 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-20T04:49:20.184 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-20T04:49:20.184 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-20T04:49:20.184 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-20T04:49:20.184 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-20T04:49:20.184 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-20T04:49:20.184 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:19.0.0-5872.gef427541.el9.x86_64 149/152 2024-08-20T04:49:20.184 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-20T04:49:20.184 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 151/152 2024-08-20T04:49:22.075 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T04:49:22.075 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:49:22.075 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2024-08-20T04:49:22.075 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.075 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.075 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-08-20T04:49:22.076 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-20T04:49:22.076 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.2-8.el9.noarch 2024-08-20T04:49:22.076 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.7.4-5.el9.x86_64 2024-08-20T04:49:22.076 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-20T04:49:22.076 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.076 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.076 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.076 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.076 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.076 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.077 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-20T04:49:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.4-9.el9.x86_64 2024-08-20T04:49:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-20T04:49:22.078 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-20T04:49:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-20T04:49:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-20T04:49:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-20T04:49:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-20T04:49:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-20T04:49:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-20T04:49:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-20T04:49:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-20T04:49:22.079 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-20T04:49:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-20T04:49:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-20T04:49:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-20T04:49:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-20T04:49:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-20T04:49:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-20T04:49:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-20T04:49:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-20T04:49:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-20T04:49:22.080 INFO:teuthology.orchestra.run.smithi037.stdout: lua-5.4.4-4.el9.x86_64 2024-08-20T04:49:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-20T04:49:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-20T04:49:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-20T04:49:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-20T04:49:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-20T04:49:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-20T04:49:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-13.16-1.el9.x86_64 2024-08-20T04:49:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-20T04:49:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-20T04:49:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-20T04:49:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-20T04:49:22.081 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-20T04:49:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-20T04:49:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-20T04:49:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-20T04:49:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-20T04:49:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-20T04:49:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-20T04:49:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-20T04:49:22.082 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-20T04:49:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-20T04:49:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-20T04:49:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-20T04:49:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-20T04:49:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-20T04:49:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-20T04:49:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-20T04:49:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-20T04:49:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-20T04:49:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-20T04:49:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-20T04:49:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-20T04:49:22.083 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-20T04:49:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-20T04:49:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-20T04:49:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-20T04:49:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-20T04:49:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-20T04:49:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-20T04:49:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-20T04:49:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-20T04:49:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-20T04:49:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-20T04:49:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-20T04:49:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-20T04:49:22.084 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-20T04:49:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-20T04:49:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2024-08-20T04:49:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-20T04:49:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-20T04:49:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-20T04:49:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-20T04:49:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-20T04:49:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-20T04:49:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-20T04:49:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-20T04:49:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-20T04:49:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.085 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-20T04:49:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-20T04:49:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-20T04:49:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-20T04:49:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-20T04:49:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-20T04:49:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-20T04:49:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-20T04:49:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-20T04:49:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-20T04:49:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-20T04:49:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-20T04:49:22.086 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-20T04:49:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-20T04:49:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-20T04:49:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-20T04:49:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-20T04:49:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-20T04:49:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-3.el9.x86_64 2024-08-20T04:49:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-20T04:49:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-20T04:49:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-20T04:49:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-20T04:49:22.087 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-20T04:49:22.088 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-20T04:49:22.088 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:49:22.088 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-08-20T04:49:22.163 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T04:49:22.163 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:19.0.0-5872.gef427541.el9.x86_64 1/152 2024-08-20T04:49:22.163 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2/152 2024-08-20T04:49:22.163 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 3/152 2024-08-20T04:49:22.163 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 4/152 2024-08-20T04:49:22.163 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5872.gef427 5/152 2024-08-20T04:49:22.163 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 6/152 2024-08-20T04:49:22.163 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 7/152 2024-08-20T04:49:22.163 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 8/152 2024-08-20T04:49:22.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 9/152 2024-08-20T04:49:22.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 10/152 2024-08-20T04:49:22.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 11/152 2024-08-20T04:49:22.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 12/152 2024-08-20T04:49:22.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 13/152 2024-08-20T04:49:22.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 14/152 2024-08-20T04:49:22.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_ 15/152 2024-08-20T04:49:22.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 16/152 2024-08-20T04:49:22.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 17/152 2024-08-20T04:49:22.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:19.0.0-5872.gef427541.el9.x86_6 18/152 2024-08-20T04:49:22.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:19.0.0-5872.gef427541.el9.x86 19/152 2024-08-20T04:49:22.164 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:19.0.0-5872.gef427541.el9.x86_64 20/152 2024-08-20T04:49:22.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5872.gef427541.el 21/152 2024-08-20T04:49:22.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:19.0.0-5872.gef427541.el9. 22/152 2024-08-20T04:49:22.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_6 23/152 2024-08-20T04:49:22.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 24/152 2024-08-20T04:49:22.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 25/152 2024-08-20T04:49:22.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 26/152 2024-08-20T04:49:22.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 27/152 2024-08-20T04:49:22.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 28/152 2024-08-20T04:49:22.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 29/152 2024-08-20T04:49:22.165 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5872.gef427541. 30/152 2024-08-20T04:49:22.176 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noa 31/152 2024-08-20T04:49:22.176 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.n 32/152 2024-08-20T04:49:22.177 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5872.gef4 33/152 2024-08-20T04:49:22.177 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el 34/152 2024-08-20T04:49:22.177 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 35/152 2024-08-20T04:49:22.177 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5872.gef427541.e 36/152 2024-08-20T04:49:22.177 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 37/152 2024-08-20T04:49:22.177 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:19.0.0-5872.gef427541.el9.noarch 38/152 2024-08-20T04:49:22.177 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 39/152 2024-08-20T04:49:22.177 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/152 2024-08-20T04:49:22.177 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/152 2024-08-20T04:49:22.177 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/152 2024-08-20T04:49:22.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-08-20T04:49:22.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-08-20T04:49:22.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-08-20T04:49:22.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-08-20T04:49:22.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-08-20T04:49:22.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/152 2024-08-20T04:49:22.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-08-20T04:49:22.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-08-20T04:49:22.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-08-20T04:49:22.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/152 2024-08-20T04:49:22.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-08-20T04:49:22.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-08-20T04:49:22.178 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-08-20T04:49:22.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-08-20T04:49:22.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-08-20T04:49:22.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-08-20T04:49:22.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-08-20T04:49:22.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-08-20T04:49:22.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/152 2024-08-20T04:49:22.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-08-20T04:49:22.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-08-20T04:49:22.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-08-20T04:49:22.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-08-20T04:49:22.179 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.26-1.el9.x86_64 66/152 2024-08-20T04:49:22.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-openmp-0.3.26-1.el9.x86_64 67/152 2024-08-20T04:49:22.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/152 2024-08-20T04:49:22.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/152 2024-08-20T04:49:22.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/152 2024-08-20T04:49:22.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/152 2024-08-20T04:49:22.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/152 2024-08-20T04:49:22.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-08-20T04:49:22.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-08-20T04:49:22.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-08-20T04:49:22.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/152 2024-08-20T04:49:22.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-devel-3.9.19-7.el9.x86_64 77/152 2024-08-20T04:49:22.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/152 2024-08-20T04:49:22.180 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/152 2024-08-20T04:49:22.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/152 2024-08-20T04:49:22.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/152 2024-08-20T04:49:22.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/152 2024-08-20T04:49:22.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/152 2024-08-20T04:49:22.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/152 2024-08-20T04:49:22.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/152 2024-08-20T04:49:22.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/152 2024-08-20T04:49:22.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/152 2024-08-20T04:49:22.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/152 2024-08-20T04:49:22.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/152 2024-08-20T04:49:22.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/152 2024-08-20T04:49:22.181 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/152 2024-08-20T04:49:22.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/152 2024-08-20T04:49:22.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-08-20T04:49:22.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/152 2024-08-20T04:49:22.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/152 2024-08-20T04:49:22.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/152 2024-08-20T04:49:22.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/152 2024-08-20T04:49:22.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/152 2024-08-20T04:49:22.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/152 2024-08-20T04:49:22.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/152 2024-08-20T04:49:22.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/152 2024-08-20T04:49:22.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/152 2024-08-20T04:49:22.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/152 2024-08-20T04:49:22.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/152 2024-08-20T04:49:22.182 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/152 2024-08-20T04:49:22.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/152 2024-08-20T04:49:22.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/152 2024-08-20T04:49:22.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/152 2024-08-20T04:49:22.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/152 2024-08-20T04:49:22.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/152 2024-08-20T04:49:22.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/152 2024-08-20T04:49:22.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/152 2024-08-20T04:49:22.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/152 2024-08-20T04:49:22.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/152 2024-08-20T04:49:22.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/152 2024-08-20T04:49:22.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/152 2024-08-20T04:49:22.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/152 2024-08-20T04:49:22.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/152 2024-08-20T04:49:22.183 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/152 2024-08-20T04:49:22.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/152 2024-08-20T04:49:22.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/152 2024-08-20T04:49:22.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 122/152 2024-08-20T04:49:22.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-08-20T04:49:22.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-08-20T04:49:22.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-08-20T04:49:22.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-08-20T04:49:22.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-08-20T04:49:22.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-08-20T04:49:22.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-08-20T04:49:22.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-08-20T04:49:22.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-08-20T04:49:22.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-08-20T04:49:22.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-08-20T04:49:22.184 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-08-20T04:49:22.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-08-20T04:49:22.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-08-20T04:49:22.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-08-20T04:49:22.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-08-20T04:49:22.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-08-20T04:49:22.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-08-20T04:49:22.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-08-20T04:49:22.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/152 2024-08-20T04:49:22.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-08-20T04:49:22.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-08-20T04:49:22.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-08-20T04:49:22.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-08-20T04:49:22.185 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-08-20T04:49:22.186 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-08-20T04:49:22.186 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:19.0.0-5872.gef427541.el9.x86_64 149/152 2024-08-20T04:49:22.186 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-08-20T04:49:22.186 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:19.0.0-5872.gef427541.el9.x86_64 151/152 2024-08-20T04:49:22.195 INFO:teuthology.orchestra.run.smithi130.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T04:49:22.195 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:49:22.195 INFO:teuthology.orchestra.run.smithi130.stdout:Upgraded: 2024-08-20T04:49:22.195 INFO:teuthology.orchestra.run.smithi130.stdout: librados2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.195 INFO:teuthology.orchestra.run.smithi130.stdout: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.195 INFO:teuthology.orchestra.run.smithi130.stdout:Installed: 2024-08-20T04:49:22.195 INFO:teuthology.orchestra.run.smithi130.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-20T04:49:22.195 INFO:teuthology.orchestra.run.smithi130.stdout: automake-1.16.2-8.el9.noarch 2024-08-20T04:49:22.196 INFO:teuthology.orchestra.run.smithi130.stdout: bison-3.7.4-5.el9.x86_64 2024-08-20T04:49:22.196 INFO:teuthology.orchestra.run.smithi130.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-20T04:49:22.196 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.196 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.196 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.196 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.196 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-grafana-dashboards-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.196 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-immutable-object-cache-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.196 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.196 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.196 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.196 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.196 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.196 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.197 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.197 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.197 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.197 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-prometheus-alerts-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.197 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.197 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.197 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.197 INFO:teuthology.orchestra.run.smithi130.stdout: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.197 INFO:teuthology.orchestra.run.smithi130.stdout: cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.197 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.197 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.197 INFO:teuthology.orchestra.run.smithi130.stdout: cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:22.198 INFO:teuthology.orchestra.run.smithi130.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-20T04:49:22.198 INFO:teuthology.orchestra.run.smithi130.stdout: flex-2.6.4-9.el9.x86_64 2024-08-20T04:49:22.198 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-20T04:49:22.198 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-20T04:49:22.198 INFO:teuthology.orchestra.run.smithi130.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-20T04:49:22.198 INFO:teuthology.orchestra.run.smithi130.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-20T04:49:22.198 INFO:teuthology.orchestra.run.smithi130.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-20T04:49:22.198 INFO:teuthology.orchestra.run.smithi130.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-20T04:49:22.198 INFO:teuthology.orchestra.run.smithi130.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-20T04:49:22.198 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-20T04:49:22.198 INFO:teuthology.orchestra.run.smithi130.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-20T04:49:22.198 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.198 INFO:teuthology.orchestra.run.smithi130.stdout: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.198 INFO:teuthology.orchestra.run.smithi130.stdout: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.199 INFO:teuthology.orchestra.run.smithi130.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-20T04:49:22.199 INFO:teuthology.orchestra.run.smithi130.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-20T04:49:22.199 INFO:teuthology.orchestra.run.smithi130.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-20T04:49:22.199 INFO:teuthology.orchestra.run.smithi130.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-20T04:49:22.199 INFO:teuthology.orchestra.run.smithi130.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-20T04:49:22.199 INFO:teuthology.orchestra.run.smithi130.stdout: librados-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.199 INFO:teuthology.orchestra.run.smithi130.stdout: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.199 INFO:teuthology.orchestra.run.smithi130.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-20T04:49:22.199 INFO:teuthology.orchestra.run.smithi130.stdout: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.199 INFO:teuthology.orchestra.run.smithi130.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-20T04:49:22.199 INFO:teuthology.orchestra.run.smithi130.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-20T04:49:22.199 INFO:teuthology.orchestra.run.smithi130.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-20T04:49:22.200 INFO:teuthology.orchestra.run.smithi130.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-20T04:49:22.200 INFO:teuthology.orchestra.run.smithi130.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-20T04:49:22.200 INFO:teuthology.orchestra.run.smithi130.stdout: lua-5.4.4-4.el9.x86_64 2024-08-20T04:49:22.200 INFO:teuthology.orchestra.run.smithi130.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-20T04:49:22.200 INFO:teuthology.orchestra.run.smithi130.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-20T04:49:22.200 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-20T04:49:22.200 INFO:teuthology.orchestra.run.smithi130.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-20T04:49:22.200 INFO:teuthology.orchestra.run.smithi130.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-20T04:49:22.200 INFO:teuthology.orchestra.run.smithi130.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-20T04:49:22.200 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-13.16-1.el9.x86_64 2024-08-20T04:49:22.200 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-20T04:49:22.200 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-20T04:49:22.200 INFO:teuthology.orchestra.run.smithi130.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-20T04:49:22.201 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-20T04:49:22.201 INFO:teuthology.orchestra.run.smithi130.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-20T04:49:22.201 INFO:teuthology.orchestra.run.smithi130.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-20T04:49:22.201 INFO:teuthology.orchestra.run.smithi130.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-20T04:49:22.201 INFO:teuthology.orchestra.run.smithi130.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-20T04:49:22.201 INFO:teuthology.orchestra.run.smithi130.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-20T04:49:22.201 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-20T04:49:22.201 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-argparse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.201 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.201 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.201 INFO:teuthology.orchestra.run.smithi130.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-20T04:49:22.201 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-20T04:49:22.201 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-20T04:49:22.202 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-20T04:49:22.202 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-20T04:49:22.202 INFO:teuthology.orchestra.run.smithi130.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-20T04:49:22.202 INFO:teuthology.orchestra.run.smithi130.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-20T04:49:22.202 INFO:teuthology.orchestra.run.smithi130.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-20T04:49:22.202 INFO:teuthology.orchestra.run.smithi130.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-20T04:49:22.202 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-20T04:49:22.202 INFO:teuthology.orchestra.run.smithi130.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-20T04:49:22.202 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-20T04:49:22.202 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-20T04:49:22.202 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-20T04:49:22.202 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-20T04:49:22.202 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-20T04:49:22.203 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-20T04:49:22.203 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-20T04:49:22.203 INFO:teuthology.orchestra.run.smithi130.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-20T04:49:22.203 INFO:teuthology.orchestra.run.smithi130.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-20T04:49:22.203 INFO:teuthology.orchestra.run.smithi130.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-20T04:49:22.203 INFO:teuthology.orchestra.run.smithi130.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-20T04:49:22.203 INFO:teuthology.orchestra.run.smithi130.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-20T04:49:22.203 INFO:teuthology.orchestra.run.smithi130.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-20T04:49:22.203 INFO:teuthology.orchestra.run.smithi130.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-20T04:49:22.203 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-20T04:49:22.203 INFO:teuthology.orchestra.run.smithi130.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-20T04:49:22.203 INFO:teuthology.orchestra.run.smithi130.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-20T04:49:22.203 INFO:teuthology.orchestra.run.smithi130.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-20T04:49:22.203 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-20T04:49:22.204 INFO:teuthology.orchestra.run.smithi130.stdout: python3-ply-3.11-14.el9.noarch 2024-08-20T04:49:22.204 INFO:teuthology.orchestra.run.smithi130.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-20T04:49:22.204 INFO:teuthology.orchestra.run.smithi130.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-20T04:49:22.204 INFO:teuthology.orchestra.run.smithi130.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-20T04:49:22.204 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-20T04:49:22.204 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-20T04:49:22.204 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-20T04:49:22.204 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-20T04:49:22.204 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-20T04:49:22.204 INFO:teuthology.orchestra.run.smithi130.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-20T04:49:22.204 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.204 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.204 INFO:teuthology.orchestra.run.smithi130.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-20T04:49:22.205 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-20T04:49:22.205 INFO:teuthology.orchestra.run.smithi130.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-20T04:49:22.205 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.205 INFO:teuthology.orchestra.run.smithi130.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-20T04:49:22.205 INFO:teuthology.orchestra.run.smithi130.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-20T04:49:22.205 INFO:teuthology.orchestra.run.smithi130.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-20T04:49:22.205 INFO:teuthology.orchestra.run.smithi130.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-20T04:49:22.205 INFO:teuthology.orchestra.run.smithi130.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-20T04:49:22.205 INFO:teuthology.orchestra.run.smithi130.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-20T04:49:22.205 INFO:teuthology.orchestra.run.smithi130.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-20T04:49:22.205 INFO:teuthology.orchestra.run.smithi130.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-20T04:49:22.205 INFO:teuthology.orchestra.run.smithi130.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-20T04:49:22.205 INFO:teuthology.orchestra.run.smithi130.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-20T04:49:22.205 INFO:teuthology.orchestra.run.smithi130.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-20T04:49:22.206 INFO:teuthology.orchestra.run.smithi130.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-20T04:49:22.206 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-20T04:49:22.206 INFO:teuthology.orchestra.run.smithi130.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-20T04:49:22.206 INFO:teuthology.orchestra.run.smithi130.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-20T04:49:22.206 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.206 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.206 INFO:teuthology.orchestra.run.smithi130.stdout: rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:22.206 INFO:teuthology.orchestra.run.smithi130.stdout: re2-1:20211101-3.el9.x86_64 2024-08-20T04:49:22.206 INFO:teuthology.orchestra.run.smithi130.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-20T04:49:22.206 INFO:teuthology.orchestra.run.smithi130.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-20T04:49:22.206 INFO:teuthology.orchestra.run.smithi130.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-20T04:49:22.206 INFO:teuthology.orchestra.run.smithi130.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-20T04:49:22.206 INFO:teuthology.orchestra.run.smithi130.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-20T04:49:22.207 INFO:teuthology.orchestra.run.smithi130.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-20T04:49:22.207 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:49:22.207 INFO:teuthology.orchestra.run.smithi130.stdout:Complete! 2024-08-20T04:49:22.501 DEBUG:teuthology.parallel:result is None 2024-08-20T04:49:22.668 DEBUG:teuthology.parallel:result is None 2024-08-20T04:49:24.214 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-08-20T04:49:24.214 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:49:24.215 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2024-08-20T04:49:24.215 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.215 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.215 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-08-20T04:49:24.215 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-20T04:49:24.215 INFO:teuthology.orchestra.run.smithi135.stdout: automake-1.16.2-8.el9.noarch 2024-08-20T04:49:24.215 INFO:teuthology.orchestra.run.smithi135.stdout: bison-3.7.4-5.el9.x86_64 2024-08-20T04:49:24.215 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-20T04:49:24.215 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.215 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.215 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.216 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.216 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:24.216 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.216 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.216 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.216 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:24.216 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:24.216 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:24.216 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:24.216 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:24.216 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.216 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.216 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:24.217 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.217 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.217 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.217 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:24.217 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:24.217 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.217 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-shell-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.217 INFO:teuthology.orchestra.run.smithi135.stdout: cephfs-top-2:19.0.0-5872.gef427541.el9.noarch 2024-08-20T04:49:24.217 INFO:teuthology.orchestra.run.smithi135.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-20T04:49:24.217 INFO:teuthology.orchestra.run.smithi135.stdout: flex-2.6.4-9.el9.x86_64 2024-08-20T04:49:24.217 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-20T04:49:24.217 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-20T04:49:24.217 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-20T04:49:24.218 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-20T04:49:24.218 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-20T04:49:24.218 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-20T04:49:24.218 INFO:teuthology.orchestra.run.smithi135.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-20T04:49:24.218 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-20T04:49:24.218 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-20T04:49:24.218 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.218 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.218 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.218 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-08-20T04:49:24.218 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-20T04:49:24.218 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-20T04:49:24.219 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-08-20T04:49:24.219 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-20T04:49:24.219 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.219 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.219 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-20T04:49:24.219 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.219 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-20T04:49:24.219 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-20T04:49:24.219 INFO:teuthology.orchestra.run.smithi135.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-20T04:49:24.219 INFO:teuthology.orchestra.run.smithi135.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-20T04:49:24.219 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-20T04:49:24.219 INFO:teuthology.orchestra.run.smithi135.stdout: lua-5.4.4-4.el9.x86_64 2024-08-20T04:49:24.219 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-20T04:49:24.220 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-20T04:49:24.220 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.26-1.el9.x86_64 2024-08-20T04:49:24.220 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp-0.3.26-1.el9.x86_64 2024-08-20T04:49:24.220 INFO:teuthology.orchestra.run.smithi135.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-20T04:49:24.220 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-20T04:49:24.220 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-13.16-1.el9.x86_64 2024-08-20T04:49:24.220 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-08-20T04:49:24.220 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-08-20T04:49:24.220 INFO:teuthology.orchestra.run.smithi135.stdout: postgresql-server-13.16-1.el9.x86_64 2024-08-20T04:49:24.220 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-20T04:49:24.220 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-20T04:49:24.220 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-20T04:49:24.220 INFO:teuthology.orchestra.run.smithi135.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-20T04:49:24.220 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-20T04:49:24.221 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-20T04:49:24.221 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-20T04:49:24.221 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.221 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.221 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.221 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-20T04:49:24.221 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-20T04:49:24.221 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-20T04:49:24.221 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-20T04:49:24.221 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-20T04:49:24.221 INFO:teuthology.orchestra.run.smithi135.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-20T04:49:24.221 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-20T04:49:24.221 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel-3.9.19-7.el9.x86_64 2024-08-20T04:49:24.222 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-20T04:49:24.222 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-20T04:49:24.222 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-20T04:49:24.222 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-20T04:49:24.222 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-20T04:49:24.222 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-20T04:49:24.222 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-20T04:49:24.222 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-20T04:49:24.222 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-20T04:49:24.222 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-20T04:49:24.222 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-20T04:49:24.222 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-20T04:49:24.222 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-20T04:49:24.222 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-20T04:49:24.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-20T04:49:24.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-20T04:49:24.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-20T04:49:24.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-20T04:49:24.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-20T04:49:24.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-20T04:49:24.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-20T04:49:24.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-20T04:49:24.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply-3.11-14.el9.noarch 2024-08-20T04:49:24.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-20T04:49:24.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-20T04:49:24.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-20T04:49:24.223 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-20T04:49:24.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-20T04:49:24.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-20T04:49:24.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-20T04:49:24.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-20T04:49:24.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-20T04:49:24.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-20T04:49:24.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-20T04:49:24.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-20T04:49:24.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-20T04:49:24.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-20T04:49:24.224 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-20T04:49:24.225 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-20T04:49:24.225 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-20T04:49:24.225 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-20T04:49:24.225 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-20T04:49:24.225 INFO:teuthology.orchestra.run.smithi135.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-20T04:49:24.225 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-20T04:49:24.225 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-20T04:49:24.225 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-20T04:49:24.225 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-20T04:49:24.225 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-20T04:49:24.225 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-20T04:49:24.225 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-20T04:49:24.225 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.225 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.225 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:19.0.0-5872.gef427541.el9.x86_64 2024-08-20T04:49:24.226 INFO:teuthology.orchestra.run.smithi135.stdout: re2-1:20211101-3.el9.x86_64 2024-08-20T04:49:24.226 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-20T04:49:24.226 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-20T04:49:24.226 INFO:teuthology.orchestra.run.smithi135.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-20T04:49:24.226 INFO:teuthology.orchestra.run.smithi135.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-08-20T04:49:24.226 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-20T04:49:24.226 INFO:teuthology.orchestra.run.smithi135.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-20T04:49:24.226 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:49:24.226 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-08-20T04:49:24.592 DEBUG:teuthology.parallel:result is None 2024-08-20T04:49:24.593 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T04:49:24.743 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-20T04:49:24.788 INFO:teuthology.orchestra.run.smithi037.stdout:19.0.0-5872.gef427541.el9 2024-08-20T04:49:24.789 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5872.gef427541.el9 2024-08-20T04:49:24.789 INFO:teuthology.task.install:The correct ceph version 19.0.0-5872.gef427541 is installed. 2024-08-20T04:49:24.791 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T04:49:24.924 DEBUG:teuthology.orchestra.run.smithi130:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-20T04:49:24.948 INFO:teuthology.orchestra.run.smithi130.stdout:19.0.0-5872.gef427541.el9 2024-08-20T04:49:24.948 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5872.gef427541.el9 2024-08-20T04:49:24.949 INFO:teuthology.task.install:The correct ceph version 19.0.0-5872.gef427541 is installed. 2024-08-20T04:49:24.950 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T04:49:25.083 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-20T04:49:25.104 INFO:teuthology.orchestra.run.smithi135.stdout:19.0.0-5872.gef427541.el9 2024-08-20T04:49:25.104 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5872.gef427541.el9 2024-08-20T04:49:25.104 INFO:teuthology.task.install:The correct ceph version 19.0.0-5872.gef427541 is installed. 2024-08-20T04:49:25.106 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-20T04:49:25.106 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T04:49:25.106 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-20T04:49:25.176 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-20T04:49:25.176 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-20T04:49:25.205 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-20T04:49:25.205 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-20T04:49:25.231 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-20T04:49:25.232 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T04:49:25.232 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2024-08-20T04:49:25.287 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-20T04:49:25.383 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-20T04:49:25.384 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/daemon-helper 2024-08-20T04:49:25.410 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-20T04:49:25.476 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-20T04:49:25.476 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2024-08-20T04:49:25.500 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-20T04:49:25.564 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-20T04:49:25.565 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T04:49:25.565 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-20T04:49:25.620 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-20T04:49:25.716 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-20T04:49:25.716 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-20T04:49:25.748 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-20T04:49:25.813 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-20T04:49:25.813 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-20T04:49:25.838 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-20T04:49:25.904 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-20T04:49:25.904 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T04:49:25.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2024-08-20T04:49:25.960 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-20T04:49:26.055 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-20T04:49:26.055 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/usr/bin/stdin-killer 2024-08-20T04:49:26.080 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-20T04:49:26.146 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-20T04:49:26.146 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2024-08-20T04:49:26.171 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-20T04:49:26.235 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-20T04:49:26.327 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-08-20T04:49:26.327 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T04:49:26.327 INFO:tasks.cephadm:Cluster fsid is 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:49:26.327 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-20T04:49:26.328 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.37', 'mon.b': '172.21.15.130', 'mon.c': '172.21.15.135'} 2024-08-20T04:49:26.328 INFO:tasks.cephadm:First mon is mon.a on smithi037 2024-08-20T04:49:26.328 INFO:tasks.cephadm:First mgr is x 2024-08-20T04:49:26.328 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-20T04:49:26.328 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname $(hostname -s) 2024-08-20T04:49:26.389 DEBUG:teuthology.orchestra.run.smithi130:> sudo hostname $(hostname -s) 2024-08-20T04:49:26.414 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname $(hostname -s) 2024-08-20T04:49:26.439 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-08-20T04:49:26.439 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T04:49:26.585 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'ef4275410d8483698016fe484b2a3c664080b4c1', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82210/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-5872-gef427541', 'node_name': '172.21.2.6+braggi06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-5872.gef427541'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-08-19 17:15:28.176472', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-hemanth-testing-2024-08-19-1357', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-08-20T04:49:26.728 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-hemanth-testing-2024-08-19-1357, sha1 ef4275410d8483698016fe484b2a3c664080b4c1 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T04:49:26.730 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/x86_64/flavors/default/cephadm 2024-08-20T04:49:26.730 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/x86_64/flavors/default/cephadm 2024-08-20T04:49:26.730 DEBUG:teuthology.orchestra.run.smithi037:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-20T04:49:27.132 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r--. 1 ubuntu ubuntu 792014 Aug 20 04:49 /home/ubuntu/cephtest/cephadm 2024-08-20T04:49:27.133 DEBUG:teuthology.orchestra.run.smithi130:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-20T04:49:27.495 INFO:teuthology.orchestra.run.smithi130.stdout:-rw-r--r--. 1 ubuntu ubuntu 792014 Aug 20 04:49 /home/ubuntu/cephtest/cephadm 2024-08-20T04:49:27.496 DEBUG:teuthology.orchestra.run.smithi135:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-08-19-1357/ef4275410d8483698016fe484b2a3c664080b4c1/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-20T04:49:27.873 INFO:teuthology.orchestra.run.smithi135.stdout:-rw-r--r--. 1 ubuntu ubuntu 792014 Aug 20 04:49 /home/ubuntu/cephtest/cephadm 2024-08-20T04:49:27.874 DEBUG:teuthology.orchestra.run.smithi037:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-20T04:49:27.911 DEBUG:teuthology.orchestra.run.smithi130:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-20T04:49:27.928 DEBUG:teuthology.orchestra.run.smithi135:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-20T04:49:27.959 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 on all hosts... 2024-08-20T04:49:27.959 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 pull 2024-08-20T04:49:27.964 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 pull 2024-08-20T04:49:27.970 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 pull 2024-08-20T04:49:29.588 INFO:teuthology.orchestra.run.smithi130.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1... 2024-08-20T04:49:29.799 INFO:teuthology.orchestra.run.smithi135.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1... 2024-08-20T04:49:31.262 INFO:teuthology.orchestra.run.smithi037.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1... 2024-08-20T04:50:05.680 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-08-20T04:50:05.680 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_version": "ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev)", 2024-08-20T04:50:05.680 INFO:teuthology.orchestra.run.smithi130.stdout: "image_id": "9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a", 2024-08-20T04:50:05.680 INFO:teuthology.orchestra.run.smithi130.stdout: "repo_digests": [ 2024-08-20T04:50:05.680 INFO:teuthology.orchestra.run.smithi130.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8" 2024-08-20T04:50:05.681 INFO:teuthology.orchestra.run.smithi130.stdout: ] 2024-08-20T04:50:05.681 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-08-20T04:50:13.992 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-08-20T04:50:13.993 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_version": "ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev)", 2024-08-20T04:50:13.993 INFO:teuthology.orchestra.run.smithi135.stdout: "image_id": "9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a", 2024-08-20T04:50:13.993 INFO:teuthology.orchestra.run.smithi135.stdout: "repo_digests": [ 2024-08-20T04:50:13.993 INFO:teuthology.orchestra.run.smithi135.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8" 2024-08-20T04:50:13.993 INFO:teuthology.orchestra.run.smithi135.stdout: ] 2024-08-20T04:50:13.993 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-08-20T04:50:15.557 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T04:50:15.558 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev)", 2024-08-20T04:50:15.558 INFO:teuthology.orchestra.run.smithi037.stdout: "image_id": "9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a", 2024-08-20T04:50:15.558 INFO:teuthology.orchestra.run.smithi037.stdout: "repo_digests": [ 2024-08-20T04:50:15.558 INFO:teuthology.orchestra.run.smithi037.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8" 2024-08-20T04:50:15.558 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-20T04:50:15.558 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T04:50:15.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph 2024-08-20T04:50:15.647 DEBUG:teuthology.orchestra.run.smithi130:> sudo mkdir -p /etc/ceph 2024-08-20T04:50:15.679 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph 2024-08-20T04:50:15.710 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /etc/ceph 2024-08-20T04:50:15.765 DEBUG:teuthology.orchestra.run.smithi130:> sudo chmod 777 /etc/ceph 2024-08-20T04:50:15.792 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /etc/ceph 2024-08-20T04:50:15.819 INFO:tasks.cephadm:Writing seed config... 2024-08-20T04:50:15.820 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-08-20T04:50:15.820 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-08-20T04:50:15.820 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-20T04:50:15.820 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-20T04:50:15.820 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-20T04:50:15.820 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-20T04:50:15.821 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-20T04:50:15.821 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-20T04:50:15.821 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-20T04:50:15.821 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-20T04:50:15.821 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-20T04:50:15.821 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-08-20T04:50:15.821 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-08-20T04:50:15.821 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-20T04:50:15.821 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-20T04:50:15.821 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-08-20T04:50:15.821 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-20T04:50:15.821 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-20T04:50:15.821 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-20T04:50:15.822 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-20T04:50:15.822 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-20T04:50:15.822 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-08-20T04:50:15.822 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-08-20T04:50:15.822 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T04:50:15.822 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-20T04:50:15.857 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 93c5cea6-5eaf-11ef-bccf-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-08-20T04:50:15.857 DEBUG:teuthology.orchestra.run.smithi037:mon.a> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mon.a.service 2024-08-20T04:50:15.902 DEBUG:teuthology.orchestra.run.smithi037:mgr.x> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mgr.x.service 2024-08-20T04:50:15.947 INFO:tasks.cephadm:Bootstrapping... 2024-08-20T04:50:15.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 -v bootstrap --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.37 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-20T04:50:16.211 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-08-20T04:50:16.211 INFO:teuthology.orchestra.run.smithi037.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', '-v', 'bootstrap', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.37', '--skip-admin-label'] 2024-08-20T04:50:16.211 INFO:teuthology.orchestra.run.smithi037.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-20T04:50:16.211 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying podman|docker is present... 2024-08-20T04:50:16.257 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 5.2.1 2024-08-20T04:50:16.257 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying lvm2 is present... 2024-08-20T04:50:16.257 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying time synchronization is in place... 2024-08-20T04:50:16.271 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-20T04:50:16.271 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-20T04:50:16.283 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-20T04:50:16.283 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-08-20T04:50:16.297 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout enabled 2024-08-20T04:50:16.310 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout active 2024-08-20T04:50:16.310 INFO:teuthology.orchestra.run.smithi037.stdout:Unit chronyd.service is enabled and running 2024-08-20T04:50:16.310 INFO:teuthology.orchestra.run.smithi037.stdout:Repeating the final host check... 2024-08-20T04:50:16.376 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 5.2.1 2024-08-20T04:50:16.377 INFO:teuthology.orchestra.run.smithi037.stdout:podman (/bin/podman) version 5.2.1 is present 2024-08-20T04:50:16.377 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl is present 2024-08-20T04:50:16.377 INFO:teuthology.orchestra.run.smithi037.stdout:lvcreate is present 2024-08-20T04:50:16.389 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-20T04:50:16.389 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-20T04:50:16.402 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-20T04:50:16.402 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-08-20T04:50:16.415 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout enabled 2024-08-20T04:50:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout active 2024-08-20T04:50:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:Unit chronyd.service is enabled and running 2024-08-20T04:50:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:Host looks OK 2024-08-20T04:50:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:Cluster fsid: 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:50:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:Acquiring lock 140001727848304 on /run/cephadm/93c5cea6-5eaf-11ef-bccf-c7b262605968.lock 2024-08-20T04:50:16.428 INFO:teuthology.orchestra.run.smithi037.stdout:Lock 140001727848304 acquired on /run/cephadm/93c5cea6-5eaf-11ef-bccf-c7b262605968.lock 2024-08-20T04:50:16.429 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying IP 172.21.15.37 port 3300 ... 2024-08-20T04:50:16.429 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying IP 172.21.15.37 port 6789 ... 2024-08-20T04:50:16.429 INFO:teuthology.orchestra.run.smithi037.stdout:Base mon IP(s) is [172.21.15.37:3300, 172.21.15.37:6789], mon addrv is [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-08-20T04:50:16.436 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.37 metric 100 2024-08-20T04:50:16.436 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.37 metric 100 2024-08-20T04:50:16.442 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-20T04:50:16.442 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-08-20T04:50:16.442 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1794sec hoplimit 64 pref medium 2024-08-20T04:50:16.448 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-20T04:50:16.448 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-20T04:50:16.448 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-20T04:50:16.448 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-08-20T04:50:16.448 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-08-20T04:50:16.448 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-20T04:50:16.449 INFO:teuthology.orchestra.run.smithi037.stdout:Mon IP `172.21.15.37` is in CIDR network `172.21.0.0/20` 2024-08-20T04:50:16.449 INFO:teuthology.orchestra.run.smithi037.stdout:Mon IP `172.21.15.37` is in CIDR network `172.21.0.0/20` 2024-08-20T04:50:16.449 INFO:teuthology.orchestra.run.smithi037.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-20T04:50:16.449 INFO:teuthology.orchestra.run.smithi037.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-20T04:50:16.450 INFO:teuthology.orchestra.run.smithi037.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1... 2024-08-20T04:50:17.101 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a 2024-08-20T04:50:17.101 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1... 2024-08-20T04:50:17.101 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Getting image source signatures 2024-08-20T04:50:17.101 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-20T04:50:17.101 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying blob sha256:0beb2e0cf0f87d34a70e3776822a6ff39fafdc5a4d91bc4481cb39d566d52b0d 2024-08-20T04:50:17.101 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying config sha256:9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a 2024-08-20T04:50:17.101 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-20T04:50:18.274 INFO:teuthology.orchestra.run.smithi037.stdout:ceph: stdout ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev) 2024-08-20T04:50:18.274 INFO:teuthology.orchestra.run.smithi037.stdout:Ceph version: ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev) 2024-08-20T04:50:18.274 INFO:teuthology.orchestra.run.smithi037.stdout:Extracting ceph user uid/gid from container image... 2024-08-20T04:50:19.294 INFO:teuthology.orchestra.run.smithi037.stdout:stat: stdout 167 167 2024-08-20T04:50:19.294 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial keys... 2024-08-20T04:50:20.457 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQCLIMRmtpdQKhAAzi9FRMzfVZ3QcT3UczgjTg== 2024-08-20T04:50:21.496 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQCMIMRmebaxMBAAh4+Rz9Rc56dLfCzWB68a/A== 2024-08-20T04:50:22.493 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQCNIMRmchpbNBAAR45o7lVxWosvJQY6QtFDLw== 2024-08-20T04:50:22.494 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial monmap... 2024-08-20T04:50:23.475 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-20T04:50:23.475 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-08-20T04:50:23.475 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:50:23.475 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-20T04:50:23.475 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool for a [v2:172.21.15.37:3300,v1:172.21.15.37:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-20T04:50:23.476 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = quincy 2024-08-20T04:50:23.476 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: set fsid to 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:50:23.476 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-20T04:50:23.476 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:50:23.476 INFO:teuthology.orchestra.run.smithi037.stdout:Creating mon... 2024-08-20T04:50:24.465 INFO:teuthology.orchestra.run.smithi037.stdout:create mon.a on 2024-08-20T04:50:24.775 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-20T04:50:24.997 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-20T04:50:25.273 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968.target → /etc/systemd/system/ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968.target. 2024-08-20T04:50:25.273 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968.target → /etc/systemd/system/ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968.target. 2024-08-20T04:50:25.623 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mon.a 2024-08-20T04:50:25.623 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to reset failed state of unit ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mon.a.service: Unit ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mon.a.service not loaded. 2024-08-20T04:50:25.895 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968.target.wants/ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mon.a.service → /etc/systemd/system/ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@.service. 2024-08-20T04:50:26.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:26 smithi037 podman[16883]: 2024-08-20 04:50:26.460199166 +0000 UTC m=+0.333443787 container start 932603c624bbbf52b735225bb55af1be410a34b72365542b9cec8b6546644e1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-20T04:50:26.555 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-20T04:50:26.555 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-08-20T04:50:26.569 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-20T04:50:26.569 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-08-20T04:50:26.569 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-08-20T04:50:26.569 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to enable service . firewalld.service is not available 2024-08-20T04:50:26.570 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mon to start... 2024-08-20T04:50:26.570 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mon... 2024-08-20T04:50:26.844 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:26 smithi037 ceph-mon[16901]: mkfs 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:50:26.844 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:26 smithi037 ceph-mon[16901]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-20T04:50:26.844 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:26 smithi037 bash[16883]: 932603c624bbbf52b735225bb55af1be410a34b72365542b9cec8b6546644e1d 2024-08-20T04:50:26.844 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:26 smithi037 systemd[1]: Started Ceph mon.a for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:50:27.711 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:27 smithi037 ceph-mon[16901]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-20T04:50:27.711 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:27 smithi037 ceph-mon[16901]: monmap epoch 1 2024-08-20T04:50:27.711 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:27 smithi037 ceph-mon[16901]: fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:50:27.711 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:27 smithi037 ceph-mon[16901]: last_changed 2024-08-20T04:50:22.881182+0000 2024-08-20T04:50:27.711 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:27 smithi037 ceph-mon[16901]: created 2024-08-20T04:50:22.881182+0000 2024-08-20T04:50:27.711 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:27 smithi037 ceph-mon[16901]: min_mon_release 19 (squid) 2024-08-20T04:50:27.711 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:27 smithi037 ceph-mon[16901]: election_strategy: 1 2024-08-20T04:50:27.711 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:27 smithi037 ceph-mon[16901]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-08-20T04:50:27.711 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:27 smithi037 ceph-mon[16901]: fsmap 2024-08-20T04:50:27.711 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:27 smithi037 ceph-mon[16901]: osdmap e1: 0 total, 0 up, 0 in 2024-08-20T04:50:27.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:27 smithi037 ceph-mon[16901]: mgrmap e1: no daemons active 2024-08-20T04:50:27.712 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:27 smithi037 ceph-mon[16901]: from='client.? 172.21.15.37:0/3652576906' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-08-20T04:50:27.718 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout cluster: 2024-08-20T04:50:27.718 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout id: 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:50:27.718 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-20T04:50:27.718 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-20T04:50:27.718 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout services: 2024-08-20T04:50:27.718 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.611131s) 2024-08-20T04:50:27.718 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-20T04:50:27.718 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-20T04:50:27.718 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-20T04:50:27.718 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout data: 2024-08-20T04:50:27.719 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-20T04:50:27.719 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-20T04:50:27.719 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-20T04:50:27.719 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout pgs: 2024-08-20T04:50:27.719 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-20T04:50:27.719 INFO:teuthology.orchestra.run.smithi037.stdout:mon is available 2024-08-20T04:50:27.719 INFO:teuthology.orchestra.run.smithi037.stdout:Assimilating anything we can from ceph.conf... 2024-08-20T04:50:28.639 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:28 smithi037 ceph-mon[16901]: from='client.? 172.21.15.37:0/3875965720' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-20T04:50:28.639 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:28 smithi037 ceph-mon[16901]: from='client.? 172.21.15.37:0/3875965720' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-20T04:50:28.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-20T04:50:28.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [global] 2024-08-20T04:50:28.874 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout fsid = 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:50:28.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-20T04:50:28.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-08-20T04:50:28.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-20T04:50:28.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-20T04:50:28.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-20T04:50:28.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-20T04:50:28.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-20T04:50:28.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-20T04:50:28.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-20T04:50:28.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-20T04:50:28.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [osd] 2024-08-20T04:50:28.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-20T04:50:28.875 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-20T04:50:28.876 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-20T04:50:28.876 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-20T04:50:28.876 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-20T04:50:28.876 INFO:teuthology.orchestra.run.smithi037.stdout:Generating new minimal ceph.conf... 2024-08-20T04:50:29.720 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:29 smithi037 ceph-mon[16901]: from='client.? 172.21.15.37:0/1099198532' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:50:29.996 INFO:teuthology.orchestra.run.smithi037.stdout:Restarting the monitor... 2024-08-20T04:50:30.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:30 smithi037 systemd[1]: Stopping Ceph mon.a for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T04:50:30.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-a[16897]: 2024-08-20T04:50:30.353+0000 7fc6e4a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T04:50:30.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-a[16897]: 2024-08-20T04:50:30.353+0000 7fc6e4a00640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-08-20T04:50:30.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:30 smithi037 podman[17141]: 2024-08-20 04:50:30.41580138 +0000 UTC m=+0.177411561 container died 932603c624bbbf52b735225bb55af1be410a34b72365542b9cec8b6546644e1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-a, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0) 2024-08-20T04:50:30.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:30 smithi037 podman[17141]: 2024-08-20 04:50:30.774892455 +0000 UTC m=+0.536502630 container cleanup 932603c624bbbf52b735225bb55af1be410a34b72365542b9cec8b6546644e1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-a, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T04:50:30.976 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:30 smithi037 bash[17141]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-a 2024-08-20T04:50:31.242 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:30 smithi037 podman[17153]: 2024-08-20 04:50:30.975651356 +0000 UTC m=+0.554929527 container remove 932603c624bbbf52b735225bb55af1be410a34b72365542b9cec8b6546644e1d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-20T04:50:31.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 systemd[1]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-20T04:50:31.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 systemd[1]: Stopped Ceph mon.a for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:50:31.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 systemd[1]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mon.a.service: Consumed 1.225s CPU time. 2024-08-20T04:50:31.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 systemd[1]: Starting Ceph mon.a for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T04:50:31.864 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 podman[17245]: 2024-08-20 04:50:31.502794851 +0000 UTC m=+0.027478630 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T04:50:31.864 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 podman[17245]: 2024-08-20 04:50:31.609851303 +0000 UTC m=+0.134535069 container create e1ebf7073663a00dc70e32dcc5c41b517b3d86993bf0233b5e23f654f95fcc00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731) 2024-08-20T04:50:31.864 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 podman[17245]: 2024-08-20 04:50:31.820649481 +0000 UTC m=+0.345333269 container init e1ebf7073663a00dc70e32dcc5c41b517b3d86993bf0233b5e23f654f95fcc00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-20T04:50:31.864 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 podman[17245]: 2024-08-20 04:50:31.827180064 +0000 UTC m=+0.351863830 container start e1ebf7073663a00dc70e32dcc5c41b517b3d86993bf0233b5e23f654f95fcc00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-08-20T04:50:31.922 INFO:teuthology.orchestra.run.smithi037.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-20T04:50:32.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: set uid:gid to 167:167 (ceph:ceph) 2024-08-20T04:50:32.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev), process ceph-mon, pid 2 2024-08-20T04:50:32.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: pidfile_write: ignore empty --pid-file 2024-08-20T04:50:32.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: load: jerasure load: lrc 2024-08-20T04:50:32.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: RocksDB version: 7.9.2 2024-08-20T04:50:32.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Git sha 0 2024-08-20T04:50:32.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Compile date 2024-08-19 15:50:59 2024-08-20T04:50:32.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: DB SUMMARY 2024-08-20T04:50:32.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: DB Session ID: 3YTGZ02UPMM7LDW4R71B 2024-08-20T04:50:32.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: CURRENT file: CURRENT 2024-08-20T04:50:32.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: IDENTITY file: IDENTITY 2024-08-20T04:50:32.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-20T04:50:32.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-08-20T04:50:32.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 93873 ; 2024-08-20T04:50:32.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.error_if_exists: 0 2024-08-20T04:50:32.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.create_if_missing: 0 2024-08-20T04:50:32.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.paranoid_checks: 1 2024-08-20T04:50:32.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-20T04:50:32.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-20T04:50:32.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-20T04:50:32.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.env: 0x55df61637be0 2024-08-20T04:50:32.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.fs: PosixFileSystem 2024-08-20T04:50:32.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.info_log: 0x55df9fe1d740 2024-08-20T04:50:32.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_file_opening_threads: 16 2024-08-20T04:50:32.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.statistics: (nil) 2024-08-20T04:50:32.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.use_fsync: 0 2024-08-20T04:50:32.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_log_file_size: 0 2024-08-20T04:50:32.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-20T04:50:32.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-20T04:50:32.186 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.keep_log_file_num: 1000 2024-08-20T04:50:32.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.recycle_log_file_num: 0 2024-08-20T04:50:32.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.allow_fallocate: 1 2024-08-20T04:50:32.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.allow_mmap_reads: 0 2024-08-20T04:50:32.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.allow_mmap_writes: 0 2024-08-20T04:50:32.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.use_direct_reads: 0 2024-08-20T04:50:32.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-20T04:50:32.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.create_missing_column_families: 0 2024-08-20T04:50:32.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.db_log_dir: 2024-08-20T04:50:32.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.wal_dir: 2024-08-20T04:50:32.187 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-20T04:50:32.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-20T04:50:32.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-20T04:50:32.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-20T04:50:32.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-20T04:50:32.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-20T04:50:32.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.advise_random_on_open: 1 2024-08-20T04:50:32.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.db_write_buffer_size: 0 2024-08-20T04:50:32.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.write_buffer_manager: 0x55df9fe20e60 2024-08-20T04:50:32.190 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-20T04:50:32.190 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-20T04:50:32.190 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-20T04:50:32.190 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.rate_limiter: (nil) 2024-08-20T04:50:32.190 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-20T04:50:32.190 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.wal_recovery_mode: 2 2024-08-20T04:50:32.190 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.enable_thread_tracking: 0 2024-08-20T04:50:32.190 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.enable_pipelined_write: 0 2024-08-20T04:50:32.190 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.unordered_write: 0 2024-08-20T04:50:32.190 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-20T04:50:32.190 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-20T04:50:32.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-20T04:50:32.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-20T04:50:32.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.row_cache: None 2024-08-20T04:50:32.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.wal_filter: None 2024-08-20T04:50:32.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-20T04:50:32.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.allow_ingest_behind: 0 2024-08-20T04:50:32.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.two_write_queues: 0 2024-08-20T04:50:32.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.manual_wal_flush: 0 2024-08-20T04:50:32.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.wal_compression: 0 2024-08-20T04:50:32.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.atomic_flush: 0 2024-08-20T04:50:32.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-20T04:50:32.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-20T04:50:32.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-20T04:50:32.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.log_readahead_size: 0 2024-08-20T04:50:32.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-20T04:50:32.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.best_efforts_recovery: 0 2024-08-20T04:50:32.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-20T04:50:32.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-20T04:50:32.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.allow_data_in_errors: 0 2024-08-20T04:50:32.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.db_host_id: __hostname__ 2024-08-20T04:50:32.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-20T04:50:32.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_background_jobs: 2 2024-08-20T04:50:32.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_background_compactions: -1 2024-08-20T04:50:32.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_subcompactions: 1 2024-08-20T04:50:32.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-20T04:50:32.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-20T04:50:32.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-20T04:50:32.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_total_wal_size: 0 2024-08-20T04:50:32.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-20T04:50:32.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-20T04:50:32.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-20T04:50:32.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-20T04:50:32.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_open_files: -1 2024-08-20T04:50:32.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.bytes_per_sync: 0 2024-08-20T04:50:32.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-20T04:50:32.193 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-20T04:50:32.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compaction_readahead_size: 0 2024-08-20T04:50:32.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_background_flushes: -1 2024-08-20T04:50:32.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Compression algorithms supported: 2024-08-20T04:50:32.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: kZSTD supported: 0 2024-08-20T04:50:32.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: kXpressCompression supported: 0 2024-08-20T04:50:32.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: kBZip2Compression supported: 0 2024-08-20T04:50:32.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-20T04:50:32.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: kLZ4Compression supported: 1 2024-08-20T04:50:32.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: kZlibCompression supported: 1 2024-08-20T04:50:32.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: kLZ4HCCompression supported: 1 2024-08-20T04:50:32.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: kSnappyCompression supported: 1 2024-08-20T04:50:32.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-20T04:50:32.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-20T04:50:32.194 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-08-20T04:50:32.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-20T04:50:32.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-20T04:50:32.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.merge_operator: 2024-08-20T04:50:32.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compaction_filter: None 2024-08-20T04:50:32.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compaction_filter_factory: None 2024-08-20T04:50:32.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.sst_partitioner_factory: None 2024-08-20T04:50:32.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-20T04:50:32.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-20T04:50:32.195 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55df9fe1d340) 2024-08-20T04:50:32.195 INFO:journalctl@ceph.mon.a.smithi037.stdout: cache_index_and_filter_blocks: 1 2024-08-20T04:50:32.196 INFO:journalctl@ceph.mon.a.smithi037.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-20T04:50:32.196 INFO:journalctl@ceph.mon.a.smithi037.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-20T04:50:32.196 INFO:journalctl@ceph.mon.a.smithi037.stdout: pin_top_level_index_and_filter: 1 2024-08-20T04:50:32.196 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_type: 0 2024-08-20T04:50:32.196 INFO:journalctl@ceph.mon.a.smithi037.stdout: data_block_index_type: 0 2024-08-20T04:50:32.196 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_shortening: 1 2024-08-20T04:50:32.196 INFO:journalctl@ceph.mon.a.smithi037.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-20T04:50:32.196 INFO:journalctl@ceph.mon.a.smithi037.stdout: checksum: 4 2024-08-20T04:50:32.196 INFO:journalctl@ceph.mon.a.smithi037.stdout: no_block_cache: 0 2024-08-20T04:50:32.196 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache: 0x55df9fe11610 2024-08-20T04:50:32.196 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_name: BinnedLRUCache 2024-08-20T04:50:32.197 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_options: 2024-08-20T04:50:32.197 INFO:journalctl@ceph.mon.a.smithi037.stdout: capacity : 536870912 2024-08-20T04:50:32.197 INFO:journalctl@ceph.mon.a.smithi037.stdout: num_shard_bits : 4 2024-08-20T04:50:32.197 INFO:journalctl@ceph.mon.a.smithi037.stdout: strict_capacity_limit : 0 2024-08-20T04:50:32.197 INFO:journalctl@ceph.mon.a.smithi037.stdout: high_pri_pool_ratio: 0.000 2024-08-20T04:50:32.197 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_cache_compressed: (nil) 2024-08-20T04:50:32.197 INFO:journalctl@ceph.mon.a.smithi037.stdout: persistent_cache: (nil) 2024-08-20T04:50:32.197 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_size: 4096 2024-08-20T04:50:32.197 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_size_deviation: 10 2024-08-20T04:50:32.197 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_restart_interval: 16 2024-08-20T04:50:32.197 INFO:journalctl@ceph.mon.a.smithi037.stdout: index_block_restart_interval: 1 2024-08-20T04:50:32.198 INFO:journalctl@ceph.mon.a.smithi037.stdout: metadata_block_size: 4096 2024-08-20T04:50:32.198 INFO:journalctl@ceph.mon.a.smithi037.stdout: partition_filters: 0 2024-08-20T04:50:32.198 INFO:journalctl@ceph.mon.a.smithi037.stdout: use_delta_encoding: 1 2024-08-20T04:50:32.198 INFO:journalctl@ceph.mon.a.smithi037.stdout: filter_policy: bloomfilter 2024-08-20T04:50:32.198 INFO:journalctl@ceph.mon.a.smithi037.stdout: whole_key_filtering: 1 2024-08-20T04:50:32.198 INFO:journalctl@ceph.mon.a.smithi037.stdout: verify_compression: 0 2024-08-20T04:50:32.198 INFO:journalctl@ceph.mon.a.smithi037.stdout: read_amp_bytes_per_bit: 0 2024-08-20T04:50:32.198 INFO:journalctl@ceph.mon.a.smithi037.stdout: format_version: 5 2024-08-20T04:50:32.198 INFO:journalctl@ceph.mon.a.smithi037.stdout: enable_index_compression: 1 2024-08-20T04:50:32.198 INFO:journalctl@ceph.mon.a.smithi037.stdout: block_align: 0 2024-08-20T04:50:32.198 INFO:journalctl@ceph.mon.a.smithi037.stdout: max_auto_readahead_size: 262144 2024-08-20T04:50:32.198 INFO:journalctl@ceph.mon.a.smithi037.stdout: prepopulate_block_cache: 0 2024-08-20T04:50:32.199 INFO:journalctl@ceph.mon.a.smithi037.stdout: initial_auto_readahead_size: 8192 2024-08-20T04:50:32.199 INFO:journalctl@ceph.mon.a.smithi037.stdout: num_file_reads_for_auto_readahead: 2 2024-08-20T04:50:32.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.write_buffer_size: 33554432 2024-08-20T04:50:32.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_write_buffer_number: 2 2024-08-20T04:50:32.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compression: NoCompression 2024-08-20T04:50:32.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.bottommost_compression: Disabled 2024-08-20T04:50:32.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.prefix_extractor: nullptr 2024-08-20T04:50:32.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-20T04:50:32.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.num_levels: 7 2024-08-20T04:50:32.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-20T04:50:32.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-20T04:50:32.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-20T04:50:32.199 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-20T04:50:32.200 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-20T04:50:32.200 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-20T04:50:32.200 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-20T04:50:32.200 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-20T04:50:32.200 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-20T04:50:32.200 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-20T04:50:32.200 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-20T04:50:32.200 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-20T04:50:32.200 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-20T04:50:32.200 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compression_opts.level: 32767 2024-08-20T04:50:32.200 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compression_opts.strategy: 0 2024-08-20T04:50:32.200 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-20T04:50:32.200 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-20T04:50:32.200 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-20T04:50:32.201 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-20T04:50:32.201 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compression_opts.enabled: false 2024-08-20T04:50:32.201 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-20T04:50:32.201 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-20T04:50:32.201 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-20T04:50:32.201 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-20T04:50:32.201 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.target_file_size_base: 67108864 2024-08-20T04:50:32.201 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-20T04:50:32.201 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-20T04:50:32.201 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-20T04:50:32.201 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-20T04:50:32.202 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-20T04:50:32.202 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-20T04:50:32.202 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-20T04:50:32.202 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-20T04:50:32.202 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-20T04:50:32.202 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-20T04:50:32.202 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-20T04:50:32.202 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-20T04:50:32.202 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-20T04:50:32.202 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-20T04:50:32.202 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.arena_block_size: 1048576 2024-08-20T04:50:32.202 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-20T04:50:32.202 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-20T04:50:32.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.disable_auto_compactions: 0 2024-08-20T04:50:32.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-20T04:50:32.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-20T04:50:32.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-20T04:50:32.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-20T04:50:32.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-20T04:50:32.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-20T04:50:32.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-20T04:50:32.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-20T04:50:32.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-20T04:50:32.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-20T04:50:32.203 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-20T04:50:32.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.inplace_update_support: 0 2024-08-20T04:50:32.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-20T04:50:32.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-20T04:50:32.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-20T04:50:32.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-20T04:50:32.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.bloom_locality: 0 2024-08-20T04:50:32.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.max_successive_merges: 0 2024-08-20T04:50:32.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-20T04:50:32.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.paranoid_file_checks: 0 2024-08-20T04:50:32.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.force_consistency_checks: 1 2024-08-20T04:50:32.204 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.report_bg_io_stats: 0 2024-08-20T04:50:32.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.ttl: 2592000 2024-08-20T04:50:32.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-20T04:50:32.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-20T04:50:32.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-20T04:50:32.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.enable_blob_files: false 2024-08-20T04:50:32.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.min_blob_size: 0 2024-08-20T04:50:32.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.blob_file_size: 268435456 2024-08-20T04:50:32.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-20T04:50:32.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-20T04:50:32.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-20T04:50:32.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-20T04:50:32.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-20T04:50:32.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.blob_file_starting_level: 0 2024-08-20T04:50:32.205 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-20T04:50:32.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-20T04:50:32.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-20T04:50:32.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: dc8cb39a-c714-4c0e-ba97-c134bd55ad9c 2024-08-20T04:50:32.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724129431871588, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-20T04:50:32.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-20T04:50:32.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724129431873286, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 90073, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 278, "table_properties": {"data_size": 88143, "index_size": 250, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11355, "raw_average_key_size": 47, "raw_value_size": 81790, "raw_average_value_size": 345, "num_data_blocks": 11, "num_entries": 237, "num_filter_entries": 237, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724129431, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "dc8cb39a-c714-4c0e-ba97-c134bd55ad9c", "db_session_id": "3YTGZ02UPMM7LDW4R71B", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-20T04:50:32.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724129431873464, "job": 1, "event": "recovery_finished"} 2024-08-20T04:50:32.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-20T04:50:32.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-20T04:50:32.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55df9fe42e00 2024-08-20T04:50:32.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: DB pointer 0x55df9ff40000 2024-08-20T04:50:32.206 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-20T04:50:32.207 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-20T04:50:32.207 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** DB Stats ** 2024-08-20T04:50:32.207 INFO:journalctl@ceph.mon.a.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-20T04:50:32.207 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-20T04:50:32.207 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-20T04:50:32.207 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-20T04:50:32.207 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-20T04:50:32.207 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-20T04:50:32.207 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-20T04:50:32.207 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-08-20T04:50:32.207 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** Compaction Stats [default] ** 2024-08-20T04:50:32.207 INFO:journalctl@ceph.mon.a.smithi037.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-20T04:50:32.207 INFO:journalctl@ceph.mon.a.smithi037.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-20T04:50:32.208 INFO:journalctl@ceph.mon.a.smithi037.stdout: L0 2/0 89.82 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-20T04:50:32.208 INFO:journalctl@ceph.mon.a.smithi037.stdout: Sum 2/0 89.82 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-20T04:50:32.208 INFO:journalctl@ceph.mon.a.smithi037.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-20T04:50:32.208 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-08-20T04:50:32.208 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** Compaction Stats [default] ** 2024-08-20T04:50:32.208 INFO:journalctl@ceph.mon.a.smithi037.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-20T04:50:32.208 INFO:journalctl@ceph.mon.a.smithi037.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-20T04:50:32.208 INFO:journalctl@ceph.mon.a.smithi037.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 72.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-20T04:50:32.208 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-08-20T04:50:32.208 INFO:journalctl@ceph.mon.a.smithi037.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-20T04:50:32.208 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-08-20T04:50:32.209 INFO:journalctl@ceph.mon.a.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-20T04:50:32.209 INFO:journalctl@ceph.mon.a.smithi037.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-20T04:50:32.209 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-20T04:50:32.209 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-20T04:50:32.209 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-20T04:50:32.209 INFO:journalctl@ceph.mon.a.smithi037.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-20T04:50:32.209 INFO:journalctl@ceph.mon.a.smithi037.stdout: Cumulative compaction: 0.00 GB write, 14.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-20T04:50:32.209 INFO:journalctl@ceph.mon.a.smithi037.stdout: Interval compaction: 0.00 GB write, 14.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-20T04:50:32.209 INFO:journalctl@ceph.mon.a.smithi037.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-20T04:50:32.209 INFO:journalctl@ceph.mon.a.smithi037.stdout: Block cache BinnedLRUCache@0x55df9fe11610#2 capacity: 512.00 MB usage: 1.27 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-08-20T04:50:32.209 INFO:journalctl@ceph.mon.a.smithi037.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2024-08-20T04:50:32.209 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-08-20T04:50:32.210 INFO:journalctl@ceph.mon.a.smithi037.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-20T04:50:32.210 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: starting mon.a rank 0 at public addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] at bind addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:50:32.210 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: mon.a@-1(???) e1 preinit fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:50:32.210 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: mon.a@-1(???).mds e1 new map 2024-08-20T04:50:32.210 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: mon.a@-1(???).mds e1 print_map 2024-08-20T04:50:32.210 INFO:journalctl@ceph.mon.a.smithi037.stdout: e1 2024-08-20T04:50:32.210 INFO:journalctl@ceph.mon.a.smithi037.stdout: btime 2024-08-20T04:50:26:520042+0000 2024-08-20T04:50:32.210 INFO:journalctl@ceph.mon.a.smithi037.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-20T04:50:32.210 INFO:journalctl@ceph.mon.a.smithi037.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-20T04:50:32.210 INFO:journalctl@ceph.mon.a.smithi037.stdout: legacy client fscid: -1 2024-08-20T04:50:32.210 INFO:journalctl@ceph.mon.a.smithi037.stdout: 2024-08-20T04:50:32.210 INFO:journalctl@ceph.mon.a.smithi037.stdout: No filesystems configured 2024-08-20T04:50:32.210 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-20T04:50:32.211 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T04:50:32.211 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T04:50:32.211 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T04:50:32.211 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-20T04:50:32.211 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 bash[17245]: e1ebf7073663a00dc70e32dcc5c41b517b3d86993bf0233b5e23f654f95fcc00 2024-08-20T04:50:32.211 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 systemd[1]: Started Ceph mon.a for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:50:32.211 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-20T04:50:32.211 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: monmap epoch 1 2024-08-20T04:50:32.211 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:50:32.211 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: last_changed 2024-08-20T04:50:22.881182+0000 2024-08-20T04:50:32.211 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: created 2024-08-20T04:50:22.881182+0000 2024-08-20T04:50:32.211 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: min_mon_release 19 (squid) 2024-08-20T04:50:32.211 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: election_strategy: 1 2024-08-20T04:50:32.212 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-08-20T04:50:32.212 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: fsmap 2024-08-20T04:50:32.212 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: osdmap e1: 0 total, 0 up, 0 in 2024-08-20T04:50:32.212 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:31 smithi037 ceph-mon[17265]: mgrmap e1: no daemons active 2024-08-20T04:50:33.196 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-20T04:50:33.220 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-20T04:50:33.220 INFO:teuthology.orchestra.run.smithi037.stdout:Creating mgr... 2024-08-20T04:50:33.221 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-20T04:50:33.222 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-20T04:50:33.625 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mgr.x 2024-08-20T04:50:33.625 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to reset failed state of unit ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mgr.x.service: Unit ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mgr.x.service not loaded. 2024-08-20T04:50:33.755 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:33 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/4251929590' entity='client.admin' 2024-08-20T04:50:34.206 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968.target.wants/ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@.service. 2024-08-20T04:50:34.516 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:50:34 smithi037 systemd[1]: Starting Ceph mgr.x for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T04:50:35.015 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:50:34 smithi037 podman[17489]: 2024-08-20 04:50:34.459021744 +0000 UTC m=+0.028943716 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 2024-08-20T04:50:40.765 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:50:40 smithi037 podman[17489]: 2024-08-20 04:50:40.31588492 +0000 UTC m=+5.885806879 container create 92646408c94e32f09b983964cf6ebed2466895b3a44a6c0556f14ab956867e8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-20T04:50:42.677 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-20T04:50:42.677 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-08-20T04:50:42.691 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-20T04:50:42.691 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-08-20T04:50:42.692 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-08-20T04:50:42.692 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to enable service . firewalld.service is not available 2024-08-20T04:50:42.709 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-20T04:50:42.709 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-08-20T04:50:42.724 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-20T04:50:42.724 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-08-20T04:50:42.724 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-08-20T04:50:42.724 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-08-20T04:50:42.724 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr to start... 2024-08-20T04:50:42.724 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr... 2024-08-20T04:50:42.868 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:50:42 smithi037 podman[17489]: 2024-08-20 04:50:42.556953342 +0000 UTC m=+8.126875302 container init 92646408c94e32f09b983964cf6ebed2466895b3a44a6c0556f14ab956867e8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-08-20T04:50:42.868 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:50:42 smithi037 podman[17489]: 2024-08-20 04:50:42.564515639 +0000 UTC m=+8.134437598 container start 92646408c94e32f09b983964cf6ebed2466895b3a44a6c0556f14ab956867e8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, ceph=True) 2024-08-20T04:50:42.868 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:50:42 smithi037 bash[17489]: 92646408c94e32f09b983964cf6ebed2466895b3a44a6c0556f14ab956867e8c 2024-08-20T04:50:42.868 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:50:42 smithi037 systemd[1]: Started Ceph mgr.x for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:50:43.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:43 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3149556651' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-20T04:50:43.990 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-20T04:50:43.990 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-08-20T04:50:43.990 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T04:50:43.990 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-08-20T04:50:43.990 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-20T04:50:43.990 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-20T04:50:43.991 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-20T04:50:43.991 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:43.991 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-20T04:50:43.991 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-20T04:50:43.991 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-08-20T04:50:43.991 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-20T04:50:43.991 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-20T04:50:43.991 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-08-20T04:50:43.991 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-20T04:50:43.991 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-08-20T04:50:43.991 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-20T04:50:43.991 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T04:50:43.991 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-20T04:50:43.992 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-20T04:50:43.992 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:43.992 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-20T04:50:43.992 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T04:50:43.992 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-20T04:50:43.992 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-20T04:50:43.992 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-20T04:50:43.995 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-20T04:50:43.995 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-20T04:50:43.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-20T04:50:43.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:43.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-20T04:50:43.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-20T04:50:43.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-20T04:50:43.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-20T04:50:43.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-20T04:50:43.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-20T04:50:43.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-20T04:50:43.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-20T04:50:43.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-20T04:50:43.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:43.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-20T04:50:43.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T04:50:43.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-08-20T04:50:26:520042+0000", 2024-08-20T04:50:43.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-20T04:50:43.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-20T04:50:43.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:43.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-20T04:50:43.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-20T04:50:43.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-20T04:50:43.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-20T04:50:43.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-20T04:50:43.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-20T04:50:43.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-08-20T04:50:43.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-20T04:50:43.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T04:50:43.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:43.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-20T04:50:43.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T04:50:43.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-08-20T04:50:26.520832+0000", 2024-08-20T04:50:43.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T04:50:43.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:43.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-20T04:50:43.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-08-20T04:50:43.999 INFO:teuthology.orchestra.run.smithi037.stdout:mgr not available, waiting (1/15)... 2024-08-20T04:50:46.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:46 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3031274925' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-20T04:50:47.724 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-20T04:50:47.724 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-08-20T04:50:47.724 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T04:50:47.724 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-08-20T04:50:47.724 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-20T04:50:47.725 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-20T04:50:47.725 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-20T04:50:47.725 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:47.725 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-20T04:50:47.725 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-20T04:50:47.725 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-08-20T04:50:47.725 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-20T04:50:47.725 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-20T04:50:47.725 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-08-20T04:50:47.725 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-20T04:50:47.725 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-08-20T04:50:47.725 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-20T04:50:47.725 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T04:50:47.726 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-20T04:50:47.726 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-20T04:50:47.726 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:47.726 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-20T04:50:47.726 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T04:50:47.726 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-20T04:50:47.726 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-20T04:50:47.726 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-20T04:50:47.726 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-20T04:50:47.726 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-20T04:50:47.726 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-20T04:50:47.729 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:47.730 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-20T04:50:47.730 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-20T04:50:47.730 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-20T04:50:47.730 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-20T04:50:47.730 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-20T04:50:47.730 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-20T04:50:47.730 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-20T04:50:47.730 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-20T04:50:47.730 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-20T04:50:47.730 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:47.730 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-20T04:50:47.730 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T04:50:47.730 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-08-20T04:50:26:520042+0000", 2024-08-20T04:50:47.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-20T04:50:47.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-20T04:50:47.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:47.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-20T04:50:47.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-20T04:50:47.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-20T04:50:47.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-20T04:50:47.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-20T04:50:47.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-20T04:50:47.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-08-20T04:50:47.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-20T04:50:47.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T04:50:47.731 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:47.732 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-20T04:50:47.732 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T04:50:47.732 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-08-20T04:50:26.520832+0000", 2024-08-20T04:50:47.732 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T04:50:47.732 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:47.732 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-20T04:50:47.732 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-08-20T04:50:47.732 INFO:teuthology.orchestra.run.smithi037.stdout:mgr not available, waiting (2/15)... 2024-08-20T04:50:49.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:48 smithi037 ceph-mon[17265]: Activating manager daemon x 2024-08-20T04:50:49.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:48 smithi037 ceph-mon[17265]: mgrmap e2: x(active, starting, since 0.00427547s) 2024-08-20T04:50:49.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:48 smithi037 ceph-mon[17265]: from='mgr.14100 172.21.15.37:0/1794417132' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-20T04:50:49.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:48 smithi037 ceph-mon[17265]: from='mgr.14100 172.21.15.37:0/1794417132' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-20T04:50:49.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:48 smithi037 ceph-mon[17265]: from='mgr.14100 172.21.15.37:0/1794417132' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-20T04:50:49.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:48 smithi037 ceph-mon[17265]: from='mgr.14100 172.21.15.37:0/1794417132' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:50:49.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:48 smithi037 ceph-mon[17265]: from='mgr.14100 172.21.15.37:0/1794417132' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-20T04:50:49.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:48 smithi037 ceph-mon[17265]: Manager daemon x is now available 2024-08-20T04:50:49.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:48 smithi037 ceph-mon[17265]: from='mgr.14100 172.21.15.37:0/1794417132' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-20T04:50:49.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:48 smithi037 ceph-mon[17265]: from='mgr.14100 172.21.15.37:0/1794417132' entity='mgr.x' 2024-08-20T04:50:49.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:48 smithi037 ceph-mon[17265]: from='mgr.14100 172.21.15.37:0/1794417132' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-20T04:50:49.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:48 smithi037 ceph-mon[17265]: from='mgr.14100 172.21.15.37:0/1794417132' entity='mgr.x' 2024-08-20T04:50:49.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:48 smithi037 ceph-mon[17265]: from='mgr.14100 172.21.15.37:0/1794417132' entity='mgr.x' 2024-08-20T04:50:51.120 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:50 smithi037 ceph-mon[17265]: mgrmap e3: x(active, since 1.00831s) 2024-08-20T04:50:51.120 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:50 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2710484746' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-08-20T04:50:51.131 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-20T04:50:51.132 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-08-20T04:50:51.132 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T04:50:51.132 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-08-20T04:50:51.132 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-20T04:50:51.132 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-20T04:50:51.132 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-20T04:50:51.132 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:51.132 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-20T04:50:51.132 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-20T04:50:51.132 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-08-20T04:50:51.132 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-20T04:50:51.132 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-20T04:50:51.133 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "a" 2024-08-20T04:50:51.133 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-20T04:50:51.133 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 18, 2024-08-20T04:50:51.133 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-20T04:50:51.133 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T04:50:51.133 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-20T04:50:51.133 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-20T04:50:51.133 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:51.133 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-20T04:50:51.133 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T04:50:51.133 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-20T04:50:51.133 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-20T04:50:51.133 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-20T04:50:51.133 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-20T04:50:51.134 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-20T04:50:51.134 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-20T04:50:51.134 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:51.134 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-20T04:50:51.134 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-20T04:50:51.134 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-20T04:50:51.134 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-20T04:50:51.134 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-20T04:50:51.134 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-20T04:50:51.134 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-20T04:50:51.134 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-20T04:50:51.134 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-20T04:50:51.134 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:51.135 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-20T04:50:51.135 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T04:50:51.135 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "btime": "2024-08-20T04:50:26:520042+0000", 2024-08-20T04:50:51.135 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-20T04:50:51.135 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-20T04:50:51.135 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:51.135 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-20T04:50:51.135 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-20T04:50:51.135 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-20T04:50:51.135 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-20T04:50:51.135 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-20T04:50:51.135 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-20T04:50:51.135 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-08-20T04:50:51.135 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-08-20T04:50:51.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T04:50:51.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:51.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-20T04:50:51.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-20T04:50:51.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-08-20T04:50:26.520832+0000", 2024-08-20T04:50:51.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-20T04:50:51.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-08-20T04:50:51.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-20T04:50:51.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-08-20T04:50:51.136 INFO:teuthology.orchestra.run.smithi037.stdout:mgr is available 2024-08-20T04:50:52.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:51 smithi037 ceph-mon[17265]: mgrmap e4: x(active, since 2s) 2024-08-20T04:50:52.192 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:51 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2295336517' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-08-20T04:50:52.440 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-20T04:50:52.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [global] 2024-08-20T04:50:52.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout fsid = 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:50:52.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-08-20T04:50:52.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-08-20T04:50:52.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-20T04:50:52.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-20T04:50:52.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-20T04:50:52.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-20T04:50:52.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-20T04:50:52.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-20T04:50:52.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-20T04:50:52.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-08-20T04:50:52.441 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [osd] 2024-08-20T04:50:52.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-20T04:50:52.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-20T04:50:52.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-20T04:50:52.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-20T04:50:52.442 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-20T04:50:52.442 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling cephadm module... 2024-08-20T04:50:53.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:53 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1292343554' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-08-20T04:50:53.516 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:50:53 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: ignoring --setuser ceph since I am not root 2024-08-20T04:50:53.516 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:50:53 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: ignoring --setgroup ceph since I am not root 2024-08-20T04:50:54.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:54 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1292343554' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-20T04:50:54.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:54 smithi037 ceph-mon[17265]: mgrmap e5: x(active, since 4s) 2024-08-20T04:50:55.379 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:55 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2578494275' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-20T04:50:55.386 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-08-20T04:50:55.386 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-20T04:50:55.386 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-20T04:50:55.386 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-20T04:50:55.386 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-20T04:50:55.386 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-08-20T04:50:55.386 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for the mgr to restart... 2024-08-20T04:50:55.387 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr epoch 5... 2024-08-20T04:50:59.836 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:59 smithi037 ceph-mon[17265]: Active manager daemon x restarted 2024-08-20T04:50:59.837 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:59 smithi037 ceph-mon[17265]: Activating manager daemon x 2024-08-20T04:50:59.837 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:59 smithi037 ceph-mon[17265]: osdmap e2: 0 total, 0 up, 0 in 2024-08-20T04:50:59.837 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:59 smithi037 ceph-mon[17265]: mgrmap e6: x(active, starting, since 0.00404125s) 2024-08-20T04:50:59.837 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:59 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:50:59.837 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:59 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-20T04:50:59.837 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:59 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-20T04:50:59.837 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:59 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-20T04:50:59.837 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:59 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-20T04:50:59.837 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:50:59 smithi037 ceph-mon[17265]: Manager daemon x is now available 2024-08-20T04:51:01.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-08-20T04:51:01.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-20T04:51:01.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-20T04:51:01.107 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-08-20T04:51:01.108 INFO:teuthology.orchestra.run.smithi037.stdout:mgr epoch 5 is available 2024-08-20T04:51:01.108 INFO:teuthology.orchestra.run.smithi037.stdout:Setting orchestrator backend to cephadm... 2024-08-20T04:51:01.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' 2024-08-20T04:51:01.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' 2024-08-20T04:51:01.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-mon[17265]: Found migration_current of "None". Setting to last migration. 2024-08-20T04:51:01.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' 2024-08-20T04:51:01.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' 2024-08-20T04:51:01.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:51:01.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:51:01.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-20T04:51:01.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-20T04:51:01.748 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-mon[17265]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-20T04:51:01.748 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-mon[17265]: mgrmap e7: x(active, since 1.00935s) 2024-08-20T04:51:01.748 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-mon[17265]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-20T04:51:02.016 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: 2024-08-20T04:51:01.745+0000 7ff9d0e00640 -1 log_channel(cephadm) log [ERR] : [20/Aug/2024:04:51:01] ENGINE Error in HTTPServer.serve 2024-08-20T04:51:02.016 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: Traceback (most recent call last): 2024-08-20T04:51:02.016 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-20T04:51:02.016 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: self._connections.run(self.expiration_interval) 2024-08-20T04:51:02.016 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-20T04:51:02.016 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: self._run(expiration_interval) 2024-08-20T04:51:02.016 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-20T04:51:02.016 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: new_conn = self._from_server_socket(self.server.socket) 2024-08-20T04:51:02.016 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-20T04:51:02.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-20T04:51:02.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-20T04:51:02.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: s = self.context.wrap_socket( 2024-08-20T04:51:02.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-20T04:51:02.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: return self.sslsocket_class._create( 2024-08-20T04:51:02.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-20T04:51:02.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: self.do_handshake() 2024-08-20T04:51:02.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-20T04:51:02.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: self._sslobj.do_handshake() 2024-08-20T04:51:02.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-20T04:51:02.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: 2024-08-20T04:51:02.742 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:02 smithi037 ceph-mon[17265]: [20/Aug/2024:04:51:01] ENGINE Bus STARTING 2024-08-20T04:51:02.742 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:02 smithi037 ceph-mon[17265]: [20/Aug/2024:04:51:01] ENGINE Serving on http://172.21.15.37:8765 2024-08-20T04:51:02.742 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:02 smithi037 ceph-mon[17265]: [20/Aug/2024:04:51:01] ENGINE Serving on https://172.21.15.37:7150 2024-08-20T04:51:02.742 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:02 smithi037 ceph-mon[17265]: [20/Aug/2024:04:51:01] ENGINE Bus STARTED 2024-08-20T04:51:02.743 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:02 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:51:02.743 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:02 smithi037 ceph-mon[17265]: [20/Aug/2024:04:51:01] ENGINE Error in HTTPServer.serve 2024-08-20T04:51:02.743 INFO:journalctl@ceph.mon.a.smithi037.stdout: Traceback (most recent call last): 2024-08-20T04:51:02.743 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-20T04:51:02.743 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._connections.run(self.expiration_interval) 2024-08-20T04:51:02.743 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-20T04:51:02.743 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._run(expiration_interval) 2024-08-20T04:51:02.743 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-20T04:51:02.743 INFO:journalctl@ceph.mon.a.smithi037.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-20T04:51:02.743 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-20T04:51:02.743 INFO:journalctl@ceph.mon.a.smithi037.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-20T04:51:02.743 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-20T04:51:02.744 INFO:journalctl@ceph.mon.a.smithi037.stdout: s = self.context.wrap_socket( 2024-08-20T04:51:02.744 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-20T04:51:02.744 INFO:journalctl@ceph.mon.a.smithi037.stdout: return self.sslsocket_class._create( 2024-08-20T04:51:02.744 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-20T04:51:02.744 INFO:journalctl@ceph.mon.a.smithi037.stdout: self.do_handshake() 2024-08-20T04:51:02.744 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-20T04:51:02.744 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._sslobj.do_handshake() 2024-08-20T04:51:02.744 INFO:journalctl@ceph.mon.a.smithi037.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-20T04:51:02.744 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:02 smithi037 ceph-mon[17265]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:51:02.744 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:02 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' 2024-08-20T04:51:02.744 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:02 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:51:03.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:03 smithi037 ceph-mon[17265]: mgrmap e8: x(active, since 2s) 2024-08-20T04:51:03.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:03 smithi037 ceph-mon[17265]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:51:03.852 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-20T04:51:03.853 INFO:teuthology.orchestra.run.smithi037.stdout:Generating ssh key... 2024-08-20T04:51:05.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: Generating public/private rsa key pair. 2024-08-20T04:51:05.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: Your identification has been saved in /tmp/tmpqt_iwdb0/key 2024-08-20T04:51:05.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: Your public key has been saved in /tmp/tmpqt_iwdb0/key.pub 2024-08-20T04:51:05.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: The key fingerprint is: 2024-08-20T04:51:05.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: SHA256:lz46snEN3/g3KXMPVA9nKuWnMsZwJ6tnbqExk/fLytU ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:51:05.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: The key's randomart image is: 2024-08-20T04:51:05.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: +---[RSA 3072]----+ 2024-08-20T04:51:05.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: | | 2024-08-20T04:51:05.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: | | 2024-08-20T04:51:05.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: | o +| 2024-08-20T04:51:05.017 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: | . o *.| 2024-08-20T04:51:05.018 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: | S +.+ = o| 2024-08-20T04:51:05.018 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: | *=*o* + | 2024-08-20T04:51:05.018 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: | . . **Bo+.E| 2024-08-20T04:51:05.018 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: | .o...**=*. | 2024-08-20T04:51:05.018 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: | .o...==*o+.| 2024-08-20T04:51:05.018 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: +----[SHA256]-----+ 2024-08-20T04:51:06.023 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:05 smithi037 ceph-mon[17265]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:51:06.023 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:05 smithi037 ceph-mon[17265]: Generating ssh key... 2024-08-20T04:51:06.024 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:05 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' 2024-08-20T04:51:06.024 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:05 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' 2024-08-20T04:51:06.940 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5ynqdChjvPJFOmqrG2Jry3yAuts53EALTbV44XLasaqhyRlaqiOiofyRLmvkBOKYy4tSuDKakg5LEYroXL4Wz8sGti2+u5nj1RhaniH7LQfeQithXlloHie+9YXe6YQaaK2Lk/EIN09mlFEpCyoauQlrTvPetwjdwDhJ/DZKh2kEgbBXYCbBw503PwBqo1SGtfRZc2tBpXt/DfG7rrJeZQShNA3RIicuPmDoQ5takADAElmqGEBxpmHg3v+D6egSA8VcDug/K+b6KGzWeft8BfO1OKEVdcx87DNJmQmcIwBOMaLMIU82FKbDi38budKmJ0SvkMZdSyiGnSylqfIxRam93XKsShWkytZMGPFsEsfTdmPBAmYf8Ty2eMjzc1YXWhFh76ob7rnVeLsfN4sZHYqm4ahx1icQqTNC3H/rT1BnTLMhkCQ90nb3qG5QSJlJeHXfDDujF5raf8ysCX67soQAZRVtm7WFb6QF5yoKViiHOOGAYE0JbN/xvaBxAq+0= ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:51:06.941 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-20T04:51:06.941 INFO:teuthology.orchestra.run.smithi037.stdout:Adding key to root@localhost authorized_keys... 2024-08-20T04:51:06.951 INFO:teuthology.orchestra.run.smithi037.stdout:Adding host smithi037... 2024-08-20T04:51:07.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:06 smithi037 ceph-mon[17265]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:51:08.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:08 smithi037 ceph-mon[17265]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi037", "addr": "172.21.15.37", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:51:09.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:09 smithi037 ceph-mon[17265]: Deploying cephadm binary to smithi037 2024-08-20T04:51:12.806 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Added host 'smithi037' with addr '172.21.15.37' 2024-08-20T04:51:12.806 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying unmanaged mon service... 2024-08-20T04:51:13.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:13 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' 2024-08-20T04:51:13.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:13 smithi037 ceph-mon[17265]: Added host smithi037 2024-08-20T04:51:13.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:13 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:51:14.347 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-20T04:51:14.347 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying unmanaged mgr service... 2024-08-20T04:51:14.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:14 smithi037 ceph-mon[17265]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:51:14.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:14 smithi037 ceph-mon[17265]: Saving service mon spec with placement count:5 2024-08-20T04:51:14.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:14 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' 2024-08-20T04:51:16.563 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:16 smithi037 ceph-mon[17265]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:51:16.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:16 smithi037 ceph-mon[17265]: Saving service mgr spec with placement count:2 2024-08-20T04:51:16.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:16 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' 2024-08-20T04:51:16.564 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:16 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' 2024-08-20T04:51:16.570 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-20T04:51:17.939 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:17 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' 2024-08-20T04:51:17.939 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:17 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1805104221' entity='client.admin' 2024-08-20T04:51:19.703 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:19 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' 2024-08-20T04:51:20.228 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling the dashboard module... 2024-08-20T04:51:20.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:20 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2906441566' entity='client.admin' 2024-08-20T04:51:20.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:20 smithi037 ceph-mon[17265]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:51:20.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:20 smithi037 ceph-mon[17265]: from='mgr.14118 172.21.15.37:0/1441409683' entity='mgr.x' 2024-08-20T04:51:21.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:21 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2951155359' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-08-20T04:51:21.766 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:21 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: ignoring --setuser ceph since I am not root 2024-08-20T04:51:21.766 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:21 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: ignoring --setgroup ceph since I am not root 2024-08-20T04:51:22.850 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:22 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2951155359' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-20T04:51:22.851 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:22 smithi037 ceph-mon[17265]: mgrmap e9: x(active, since 22s) 2024-08-20T04:51:24.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:23 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1027628560' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-08-20T04:51:24.321 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-08-20T04:51:24.321 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-20T04:51:24.321 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-20T04:51:24.321 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-20T04:51:24.321 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-20T04:51:24.321 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-08-20T04:51:24.322 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for the mgr to restart... 2024-08-20T04:51:24.322 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr epoch 9... 2024-08-20T04:51:28.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:27 smithi037 ceph-mon[17265]: Active manager daemon x restarted 2024-08-20T04:51:28.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:27 smithi037 ceph-mon[17265]: Activating manager daemon x 2024-08-20T04:51:28.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:27 smithi037 ceph-mon[17265]: osdmap e3: 0 total, 0 up, 0 in 2024-08-20T04:51:28.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:27 smithi037 ceph-mon[17265]: mgrmap e10: x(active, starting, since 0.00445268s) 2024-08-20T04:51:28.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:51:28.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-08-20T04:51:28.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-08-20T04:51:28.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-08-20T04:51:28.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-08-20T04:51:28.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:27 smithi037 ceph-mon[17265]: Manager daemon x is now available 2024-08-20T04:51:29.259 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:51:29.259 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-08-20T04:51:29.259 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-08-20T04:51:29.259 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:28 smithi037 ceph-mon[17265]: mgrmap e11: x(active, since 1.00921s) 2024-08-20T04:51:29.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-08-20T04:51:29.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-20T04:51:29.517 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-20T04:51:29.518 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-08-20T04:51:29.518 INFO:teuthology.orchestra.run.smithi037.stdout:mgr epoch 9 is available 2024-08-20T04:51:29.518 INFO:teuthology.orchestra.run.smithi037.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-08-20T04:51:30.055 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:29 smithi037 ceph-mon[17265]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-20T04:51:30.055 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:29 smithi037 ceph-mon[17265]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-20T04:51:30.697 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: 2024-08-20T04:51:30.310+0000 7f4f15c00640 -1 log_channel(cephadm) log [ERR] : [20/Aug/2024:04:51:30] ENGINE Error in HTTPServer.serve 2024-08-20T04:51:30.697 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: Traceback (most recent call last): 2024-08-20T04:51:30.697 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-20T04:51:30.698 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: self._connections.run(self.expiration_interval) 2024-08-20T04:51:30.698 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-20T04:51:30.698 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: self._run(expiration_interval) 2024-08-20T04:51:30.698 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-20T04:51:30.698 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: new_conn = self._from_server_socket(self.server.socket) 2024-08-20T04:51:30.698 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-20T04:51:30.698 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-20T04:51:30.698 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-20T04:51:30.698 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: s = self.context.wrap_socket( 2024-08-20T04:51:30.698 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-20T04:51:30.698 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: return self.sslsocket_class._create( 2024-08-20T04:51:30.699 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-20T04:51:30.699 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: self.do_handshake() 2024-08-20T04:51:30.699 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-20T04:51:30.699 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: self._sslobj.do_handshake() 2024-08-20T04:51:30.699 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-20T04:51:30.699 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: 2024-08-20T04:51:31.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-mon[17265]: mgrmap e12: x(active, since 2s) 2024-08-20T04:51:31.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-mon[17265]: [20/Aug/2024:04:51:30] ENGINE Bus STARTING 2024-08-20T04:51:31.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-mon[17265]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:51:31.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-mon[17265]: [20/Aug/2024:04:51:30] ENGINE Serving on https://172.21.15.37:7150 2024-08-20T04:51:31.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-mon[17265]: [20/Aug/2024:04:51:30] ENGINE Error in HTTPServer.serve 2024-08-20T04:51:31.016 INFO:journalctl@ceph.mon.a.smithi037.stdout: Traceback (most recent call last): 2024-08-20T04:51:31.016 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-20T04:51:31.016 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._connections.run(self.expiration_interval) 2024-08-20T04:51:31.016 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-20T04:51:31.016 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._run(expiration_interval) 2024-08-20T04:51:31.016 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-20T04:51:31.016 INFO:journalctl@ceph.mon.a.smithi037.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-20T04:51:31.016 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-20T04:51:31.017 INFO:journalctl@ceph.mon.a.smithi037.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-20T04:51:31.017 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-20T04:51:31.017 INFO:journalctl@ceph.mon.a.smithi037.stdout: s = self.context.wrap_socket( 2024-08-20T04:51:31.017 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-20T04:51:31.017 INFO:journalctl@ceph.mon.a.smithi037.stdout: return self.sslsocket_class._create( 2024-08-20T04:51:31.017 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-20T04:51:31.017 INFO:journalctl@ceph.mon.a.smithi037.stdout: self.do_handshake() 2024-08-20T04:51:31.017 INFO:journalctl@ceph.mon.a.smithi037.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-20T04:51:31.017 INFO:journalctl@ceph.mon.a.smithi037.stdout: self._sslobj.do_handshake() 2024-08-20T04:51:31.017 INFO:journalctl@ceph.mon.a.smithi037.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-20T04:51:31.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-mon[17265]: [20/Aug/2024:04:51:30] ENGINE Serving on http://172.21.15.37:8765 2024-08-20T04:51:31.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-mon[17265]: [20/Aug/2024:04:51:30] ENGINE Bus STARTED 2024-08-20T04:51:31.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:32.645 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFEDCCAvigAwIBAgIUZgOngS2FL2JxA+Gpq7A1X4TFZFkwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDgyMDA0NTEzMloXDTM0\nMDgyMTA0NTEzMlowFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjM3MIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEApeY/Wv16tC4WhgNOD7CJYwGiOTYypTQku9Cs\nepTV9g4PSCbB+ocvzp7ZqlRTSSpbYRX8Cfz/sIdDjXS/yjvpFpFfmKWrwWRY+vXW\nrEumXeuOY+gTUyLKgs1TbT+hVo5jcbdOXhW1MRnZi3XKf7z/SA2I8ZXvR0+uJ5Qv\nX5+URl5gmeIuiIbEAGevVO6yrL6TYUrsDLmZwordYJR3TDsZEc675cTBaz4C4HJ/\nlYu38qT3QUHFVN2RfsJ+zSFIKFR5gyJr3p82FYPsm2jWN5cMMydpOFbo/Bq9ZrlS\n9prWXeLqOVbUrJ3slAOgjMEb9WoC7W2C2Kudz+PO3PDrXmg/1/p96l9qBMptVaaG\nxWsBnh6wiytS0qQ+zn3abNBsDTwVU1+8TUsrsvolYcALude/JT38H1eQv9EMT/V4\nj7HWWD5JIOAoYMXCTNHDZMVjRa7G+NJa9a/0elewwnW7FLMrhmpPQ2ZrLIt1AcJ3\nYDMBHl5znkOXy/q0yc2ZzrmMdB21DuySA0ySM5KvvSYoK3dZq/E3m0weoB9vR+GF\nld+CO7GSDj8jn5hYftZs1+jkZJmc+QcH2wW6FIUhYYY2usXr6bVPZyDDMoSNfCcx\nFco6hZhPZuyJaYbpbqSEspH7BraQRlPMmOJlfT8Rfga9M3fOt2ZvBI0R5S6HN9DG\nE+9IfxsCAwEAAaNUMFIwQgYDVR0RBDswOYIec21pdGhpMDM3LmZyb250LnNlcGlh\nLmNlcGguY29tghFkYXNoYm9hcmRfc2VydmVyc4cErBUPJTAMBgNVHRMBAf8EAjAA\nMA0GCSqGSIb3DQEBCwUAA4ICAQAjCIkCQKY3aicHFxN3oNREc8y7VSZ3NqpRvg/h\nMbdEsflZ8zLYLTPd3f1pmiTof2j/cqqIly6NuZ74lJ28WomFpZdjv2W0Wtb5D+Oo\nKueuZ8ESsrEG9Ef8iC8OMTYBnghkVWPylrVyIla1ASCN1pHEJWF73JckaP4uxnnR\nG9e0lNxFdnDNUN+PnZK+luXAkEuFVTlXnnpuzlF8zxKY2FlPvFlZB6RW01cv1WRm\nxE1bE60pY2JE4jV6wWmgNHDcXf83+DUlxUhaoGgqjMUkS9fSuM6EdBnm18yZec9a\nk/qwLG8AdTXdY+rDbODK2cQK3DsFryW/WGOanIPz12dTiRTc+nDVXKEUFqrUw3kK\n+aq8kFKE9Se9D4oOLA54k7K/QYRVQVy6mwH1uZgkcaCStfeW6x16QF9sMSAIkHPG\n5Hs+vL9YXk6Z5u1aCVcV7dQMPE9DS4oH058Gfo8EDqLLIuNY4ZBnKx9OEJ6swcdt\nJVlsLJJsapRc3K25TzjpuLHFiRyTXVzrquS+rrs1kvqr37eK4OE9BlIwMxY11oYR\nfTNKBW5KfBsd95i+xyJfpCtbegq1468NmLqumR009qc10DOeVzgMjx0zE0LhE18S\nWlyB3TnntfNKWqX0xGoyP/Uy5lMhGUVy1L7CfBzVDWYQ51j9p9GJj52+llr8Wpia\n8IYqEA==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKQIBAAKCAgEApeY/Wv16tC4WhgNOD7CJYwGiOTYypTQku9CsepTV9g4PSCbB\n+ocvzp7ZqlRTSSpbYRX8Cfz/sIdDjXS/yjvpFpFfmKWrwWRY+vXWrEumXeuOY+gT\nUyLKgs1TbT+hVo5jcbdOXhW1MRnZi3XKf7z/SA2I8ZXvR0+uJ5QvX5+URl5gmeIu\niIbEAGevVO6yrL6TYUrsDLmZwordYJR3TDsZEc675cTBaz4C4HJ/lYu38qT3QUHF\nVN2RfsJ+zSFIKFR5gyJr3p82FYPsm2jWN5cMMydpOFbo/Bq9ZrlS9prWXeLqOVbU\nrJ3slAOgjMEb9WoC7W2C2Kudz+PO3PDrXmg/1/p96l9qBMptVaaGxWsBnh6wiytS\n0qQ+zn3abNBsDTwVU1+8TUsrsvolYcALude/JT38H1eQv9EMT/V4j7HWWD5JIOAo\nYMXCTNHDZMVjRa7G+NJa9a/0elewwnW7FLMrhmpPQ2ZrLIt1AcJ3YDMBHl5znkOX\ny/q0yc2ZzrmMdB21DuySA0ySM5KvvSYoK3dZq/E3m0weoB9vR+GFld+CO7GSDj8j\nn5hYftZs1+jkZJmc+QcH2wW6FIUhYYY2usXr6bVPZyDDMoSNfCcxFco6hZhPZuyJ\naYbpbqSEspH7BraQRlPMmOJlfT8Rfga9M3fOt2ZvBI0R5S6HN9DGE+9IfxsCAwEA\nAQKCAgBNHbpVkX54QvQ1V1Px9x3l59yAu7DPGm344AdM8+KBfgecgmepDS4r3atQ\ngeI1IHtZpd6CxhgU9stv9dUxLKgs1WaajmhIfVzfS2d+r6ul/Nkzl61j98grBUbC\ngdF9arLPKWZEVdLkACAfs6Ftv2zrEV+W7RtNCrzpqPhcetFx5G0DGyCGVh7GEWxv\nDoX/xpa7oxgW0i+nPuWo/1p1FQOSQ4cUR2GheDHeI1srKMdZA1Xr/6a6zEPVqJNI\nxy/Dj4DsdBOwaFG7rpdNpm3taUlCfg9rIPssNUHVflASUedTvScjgDlcBAz0wLrg\nsuNMMPsrYrxv+1ZgTITcLyE5wTvraRgVVmf4OjDAvFpmEKPUrRPxHFCkg8cWG7wN\n/nx0+OWT0f9ixFuCp/I5loSS9Ex4llHz5bPKR8wxl6UqFkF3XZGcCHPveBXKe1y6\nFHz+I5m/f3rNle6QPMMNSGwG3sTB3DEQavc8wjeu7UHX2+CpMmoXq6KutmESOThB\nGp/hTT8JIHzQBUog+oEOoO/pSYSJ3ZhUSajd9RbinaGI90kgyyJ2H1DtYm2TLn2W\n7o/w/Kyun5K8CldaK4LrLDDM50iOe4mIPntMlVUZuXPk6TEq1EUj60wrlEmqycCz\nMDSFomZ7jjNUOEFepYU9b4Z/Mjj+GnJPkQ9zDSfOSItNHnjYAQKCAQEA4je4LqhT\nmzGVaQyQ2cF9dLAekChnYQ4AdiSKtiQHz0G1ArN4zHUjpxKR9me8LPp/eqSs4b6i\nZnfONr6wLycR5Xhd5g8JoKH/n4CVr2ZLtLB6eE9TsmC9sjdRzGekE3oZ+VWZ5PrK\nZ8Fi85tI6lmq78th3O1Zyj2KCaBRVub6yhcd4yf5BBQWF5XeHxC1GFV6yw+nQ1Pn\n51JgPIEV30GwPm3rRu+zgmdDLpszqCSAQqMXEMvti2TX+VCgMquZ0ar8WTf3c30R\n/M4o7Hof2dl6SI8C2x03gQDYveZwOd/x8Xmq+YuiYzd4qcuoZjygvINhDxogA4aG\naUPilGxF9lfW1wKCAQEAu72arHoKLLzehD2uSiz9kGINi43oZtucy9xBV4Eijnxi\nvJqsIJwl4jnKVgaZsX7kZSKnxijWdjkiQCX1mXHZco4gVngQUkIpjm+JS06RXeu2\nEpBdAnMlsa6ZcF+uYb8h8iknHmqr4Ai4UBA3TY6rNGk6ETNeFF3mRGyhQqNbXhn9\nJEFL4QMr9oM0yt5eOYWkfhIFfyKWn3eYrqnSna4OgaKDOTgeNXJlXoj9snCRaQMz\nEaa4hxPao8XO6eWKKdrUDEsI4waSaEViKnc+TLKfs+t7Uyt3IOPAw0t2GexgaMBO\nAJUcUL8JGLxl2xdOfYLdK1ybXbiDGgMaNSTqqdTFXQKCAQEAvGn+PNY0NIma0REH\nQGc5D8x02Eret+aKmdwbsFLYMlae5e4Hiftyw3/jFKEYCTpmnQa1e5xk9QWKOuye\nH9fhvwd+5dPWh/UFzJqzkZCZM5jdmIExy9tphBsxRRd5gENtiM80S5RaqwpWWWIX\n3CDtD6aNDw6df6W76AKgXMorTdDtMrqjXDNCp0hK5gLrYqYnjSOvg5NKDs/8mchG\nKFo06fpxQPb6w30wZowb/UrRjS77UiEX68cFX4E4vJtSlWBdqA3GS2l7Zt1rFnMt\nPiw1/mMm1MtD5G2JGLnq9TlB8YcN0aTsjsiv9nRLAUQz+G9QktyGl4kfQGOrP0Xj\nC6fjpwKCAQEAtzkcMygHthG9uKHZ71ppPPf08DXWkkvSgsK6ooPNDfInCpqJUmoS\nLu7noX1fkfKdRHbF9ob0hvzLiH+DafXKmhpLRRh4FU+s7u27uFs9U8QvNX7exv1J\n1FbqONmofozivEudefnxM/xOpRSuZGrQe54WpaLUNlxN1omN+FMlYHlMrI1tWHSX\n+0WhyDutCcZ7+u3rn2BKT+eQgyYJ/wlX7vyDxNwX32F9vP1FW1ixESOmO5vSi0G9\nKAhtH6h9ZsvCFx1D1w0a5diRLZCipIfPhPBUs56/7MFZ5z9GS5Z9oL3NYpQjxkoq\nvpFfdqsQVz3YS/FdT+I7UK+mbCdTPdwBoQKCAQAl1UKNZNYWZeg3iht9ncEVGurZ\nOYbLkTwuJgC6KcHkCDDK6XoC2HEgIYGB9lG/rccPMxdktoz03oS4FVz4k5ZnVgIx\nhgUCQbQdgt8JebIjKI6weDlW1KeKgodwoK3OK5UL0qmPGMLdsK9pEYyJ6x0EHKVM\nQ6DrkyA2GAWuN7W3p0wELhmrq+YpXDD90bWcmaaz8sHIoJ/FoTzFTD/UWgBTSOKm\n3HraZdErlNfXGo0UnNevcHcuP6blHYrMisqHro/9o4NGq73ZjCMyvneS9cPr0ll/\nhQ9vjdrI3ACGxMkPR1sKBIVMCI7HpkC9/FUk/hE3VYv1jH3fDAi2b7XRR2g0\n-----END RSA PRIVATE KEY-----\n"} 2024-08-20T04:51:33.158 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:34.490 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:34 smithi037 ceph-mon[17265]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:51:34.491 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:34.497 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-08-20T04:51:36.249 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-08-20T04:51:36.249 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial admin user... 2024-08-20T04:51:37.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:36 smithi037 ceph-mon[17265]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:51:37.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:36 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:37.853 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$31/nE/qgaUZtHLWagI27he1oWsPhO.1WBlN/aRY1zE6E02XCI9y5u", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1724129497, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-20T04:51:37.853 INFO:teuthology.orchestra.run.smithi037.stdout:Fetching dashboard port number... 2024-08-20T04:51:38.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:38 smithi037 ceph-mon[17265]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:51:38.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:38 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:39.204 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 8443 2024-08-20T04:51:39.222 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-20T04:51:39.223 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-08-20T04:51:39.237 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-20T04:51:39.237 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-08-20T04:51:39.237 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-08-20T04:51:39.237 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-20T04:51:39.239 INFO:teuthology.orchestra.run.smithi037.stdout:Ceph Dashboard is now available at: 2024-08-20T04:51:39.239 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:51:39.239 INFO:teuthology.orchestra.run.smithi037.stdout: URL: https://smithi037.front.sepia.ceph.com:8443/ 2024-08-20T04:51:39.239 INFO:teuthology.orchestra.run.smithi037.stdout: User: admin 2024-08-20T04:51:39.239 INFO:teuthology.orchestra.run.smithi037.stdout: Password: 8zsojuxedr 2024-08-20T04:51:39.239 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:51:39.240 INFO:teuthology.orchestra.run.smithi037.stdout:Saving cluster configuration to /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config directory 2024-08-20T04:51:39.510 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:39 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2555354705' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-08-20T04:51:40.691 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-20T04:51:40.692 INFO:teuthology.orchestra.run.smithi037.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-20T04:51:40.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:51:40.692 INFO:teuthology.orchestra.run.smithi037.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-20T04:51:40.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:51:40.692 INFO:teuthology.orchestra.run.smithi037.stdout:Or, if you are only running a single cluster on this host: 2024-08-20T04:51:40.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:51:40.692 INFO:teuthology.orchestra.run.smithi037.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-20T04:51:40.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:51:40.692 INFO:teuthology.orchestra.run.smithi037.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-20T04:51:40.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:51:40.692 INFO:teuthology.orchestra.run.smithi037.stdout: ceph telemetry on 2024-08-20T04:51:40.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:51:40.693 INFO:teuthology.orchestra.run.smithi037.stdout:For more information see: 2024-08-20T04:51:40.693 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:51:40.693 INFO:teuthology.orchestra.run.smithi037.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-20T04:51:40.693 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:51:40.693 INFO:teuthology.orchestra.run.smithi037.stdout:Bootstrap complete. 2024-08-20T04:51:40.748 INFO:tasks.cephadm:Fetching config... 2024-08-20T04:51:40.748 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T04:51:40.748 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-20T04:51:40.784 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-20T04:51:40.784 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T04:51:40.784 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-20T04:51:40.861 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-20T04:51:40.861 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T04:51:40.861 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/keyring of=/dev/stdout 2024-08-20T04:51:40.958 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-20T04:51:40.959 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T04:51:40.959 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-20T04:51:41.035 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-20T04:51:41.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5ynqdChjvPJFOmqrG2Jry3yAuts53EALTbV44XLasaqhyRlaqiOiofyRLmvkBOKYy4tSuDKakg5LEYroXL4Wz8sGti2+u5nj1RhaniH7LQfeQithXlloHie+9YXe6YQaaK2Lk/EIN09mlFEpCyoauQlrTvPetwjdwDhJ/DZKh2kEgbBXYCbBw503PwBqo1SGtfRZc2tBpXt/DfG7rrJeZQShNA3RIicuPmDoQ5takADAElmqGEBxpmHg3v+D6egSA8VcDug/K+b6KGzWeft8BfO1OKEVdcx87DNJmQmcIwBOMaLMIU82FKbDi38budKmJ0SvkMZdSyiGnSylqfIxRam93XKsShWkytZMGPFsEsfTdmPBAmYf8Ty2eMjzc1YXWhFh76ob7rnVeLsfN4sZHYqm4ahx1icQqTNC3H/rT1BnTLMhkCQ90nb3qG5QSJlJeHXfDDujF5raf8ysCX67soQAZRVtm7WFb6QF5yoKViiHOOGAYE0JbN/xvaBxAq+0= ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-20T04:51:41.158 INFO:teuthology.orchestra.run.smithi037.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5ynqdChjvPJFOmqrG2Jry3yAuts53EALTbV44XLasaqhyRlaqiOiofyRLmvkBOKYy4tSuDKakg5LEYroXL4Wz8sGti2+u5nj1RhaniH7LQfeQithXlloHie+9YXe6YQaaK2Lk/EIN09mlFEpCyoauQlrTvPetwjdwDhJ/DZKh2kEgbBXYCbBw503PwBqo1SGtfRZc2tBpXt/DfG7rrJeZQShNA3RIicuPmDoQ5takADAElmqGEBxpmHg3v+D6egSA8VcDug/K+b6KGzWeft8BfO1OKEVdcx87DNJmQmcIwBOMaLMIU82FKbDi38budKmJ0SvkMZdSyiGnSylqfIxRam93XKsShWkytZMGPFsEsfTdmPBAmYf8Ty2eMjzc1YXWhFh76ob7rnVeLsfN4sZHYqm4ahx1icQqTNC3H/rT1BnTLMhkCQ90nb3qG5QSJlJeHXfDDujF5raf8ysCX67soQAZRVtm7WFb6QF5yoKViiHOOGAYE0JbN/xvaBxAq+0= ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:51:41.184 DEBUG:teuthology.orchestra.run.smithi130:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5ynqdChjvPJFOmqrG2Jry3yAuts53EALTbV44XLasaqhyRlaqiOiofyRLmvkBOKYy4tSuDKakg5LEYroXL4Wz8sGti2+u5nj1RhaniH7LQfeQithXlloHie+9YXe6YQaaK2Lk/EIN09mlFEpCyoauQlrTvPetwjdwDhJ/DZKh2kEgbBXYCbBw503PwBqo1SGtfRZc2tBpXt/DfG7rrJeZQShNA3RIicuPmDoQ5takADAElmqGEBxpmHg3v+D6egSA8VcDug/K+b6KGzWeft8BfO1OKEVdcx87DNJmQmcIwBOMaLMIU82FKbDi38budKmJ0SvkMZdSyiGnSylqfIxRam93XKsShWkytZMGPFsEsfTdmPBAmYf8Ty2eMjzc1YXWhFh76ob7rnVeLsfN4sZHYqm4ahx1icQqTNC3H/rT1BnTLMhkCQ90nb3qG5QSJlJeHXfDDujF5raf8ysCX67soQAZRVtm7WFb6QF5yoKViiHOOGAYE0JbN/xvaBxAq+0= ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-20T04:51:41.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:41 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1980688251' entity='client.admin' 2024-08-20T04:51:41.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:41 smithi037 ceph-mon[17265]: mgrmap e13: x(active, since 12s) 2024-08-20T04:51:41.321 INFO:teuthology.orchestra.run.smithi130.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5ynqdChjvPJFOmqrG2Jry3yAuts53EALTbV44XLasaqhyRlaqiOiofyRLmvkBOKYy4tSuDKakg5LEYroXL4Wz8sGti2+u5nj1RhaniH7LQfeQithXlloHie+9YXe6YQaaK2Lk/EIN09mlFEpCyoauQlrTvPetwjdwDhJ/DZKh2kEgbBXYCbBw503PwBqo1SGtfRZc2tBpXt/DfG7rrJeZQShNA3RIicuPmDoQ5takADAElmqGEBxpmHg3v+D6egSA8VcDug/K+b6KGzWeft8BfO1OKEVdcx87DNJmQmcIwBOMaLMIU82FKbDi38budKmJ0SvkMZdSyiGnSylqfIxRam93XKsShWkytZMGPFsEsfTdmPBAmYf8Ty2eMjzc1YXWhFh76ob7rnVeLsfN4sZHYqm4ahx1icQqTNC3H/rT1BnTLMhkCQ90nb3qG5QSJlJeHXfDDujF5raf8ysCX67soQAZRVtm7WFb6QF5yoKViiHOOGAYE0JbN/xvaBxAq+0= ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:51:41.333 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5ynqdChjvPJFOmqrG2Jry3yAuts53EALTbV44XLasaqhyRlaqiOiofyRLmvkBOKYy4tSuDKakg5LEYroXL4Wz8sGti2+u5nj1RhaniH7LQfeQithXlloHie+9YXe6YQaaK2Lk/EIN09mlFEpCyoauQlrTvPetwjdwDhJ/DZKh2kEgbBXYCbBw503PwBqo1SGtfRZc2tBpXt/DfG7rrJeZQShNA3RIicuPmDoQ5takADAElmqGEBxpmHg3v+D6egSA8VcDug/K+b6KGzWeft8BfO1OKEVdcx87DNJmQmcIwBOMaLMIU82FKbDi38budKmJ0SvkMZdSyiGnSylqfIxRam93XKsShWkytZMGPFsEsfTdmPBAmYf8Ty2eMjzc1YXWhFh76ob7rnVeLsfN4sZHYqm4ahx1icQqTNC3H/rT1BnTLMhkCQ90nb3qG5QSJlJeHXfDDujF5raf8ysCX67soQAZRVtm7WFb6QF5yoKViiHOOGAYE0JbN/xvaBxAq+0= ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-20T04:51:41.386 INFO:teuthology.orchestra.run.smithi135.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5ynqdChjvPJFOmqrG2Jry3yAuts53EALTbV44XLasaqhyRlaqiOiofyRLmvkBOKYy4tSuDKakg5LEYroXL4Wz8sGti2+u5nj1RhaniH7LQfeQithXlloHie+9YXe6YQaaK2Lk/EIN09mlFEpCyoauQlrTvPetwjdwDhJ/DZKh2kEgbBXYCbBw503PwBqo1SGtfRZc2tBpXt/DfG7rrJeZQShNA3RIicuPmDoQ5takADAElmqGEBxpmHg3v+D6egSA8VcDug/K+b6KGzWeft8BfO1OKEVdcx87DNJmQmcIwBOMaLMIU82FKbDi38budKmJ0SvkMZdSyiGnSylqfIxRam93XKsShWkytZMGPFsEsfTdmPBAmYf8Ty2eMjzc1YXWhFh76ob7rnVeLsfN4sZHYqm4ahx1icQqTNC3H/rT1BnTLMhkCQ90nb3qG5QSJlJeHXfDDujF5raf8ysCX67soQAZRVtm7WFb6QF5yoKViiHOOGAYE0JbN/xvaBxAq+0= ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:51:41.399 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-20T04:51:41.773 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:51:43.795 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-20T04:51:43.795 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-20T04:51:43.845 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:43 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/4010528298' entity='client.admin' 2024-08-20T04:51:43.845 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:43 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:43.845 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:43 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:43.845 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:43 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"} : dispatch 2024-08-20T04:51:43.846 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:43 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:43.846 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:43 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:51:43.846 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:43 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:44.306 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:51:46.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:46 smithi037 ceph-mon[17265]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:51:46.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:46 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:46.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:46 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:51:46.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:46 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:51:46.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:46 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:51:46.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:46 smithi037 ceph-mon[17265]: Updating smithi037:/etc/ceph/ceph.conf 2024-08-20T04:51:46.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:46 smithi037 ceph-mon[17265]: Updating smithi037:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:51:46.617 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi130 2024-08-20T04:51:46.618 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-20T04:51:46.618 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/etc/ceph/ceph.conf 2024-08-20T04:51:46.636 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-20T04:51:46.636 DEBUG:teuthology.orchestra.run.smithi130:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-20T04:51:46.695 INFO:tasks.cephadm:Adding host smithi130 to orchestrator... 2024-08-20T04:51:46.695 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch host add smithi130 2024-08-20T04:51:47.077 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:51:47.342 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:47 smithi037 ceph-mon[17265]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-08-20T04:51:47.342 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:47 smithi037 ceph-mon[17265]: Updating smithi037:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T04:51:47.342 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:47.342 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:47.342 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:49.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:49 smithi037 ceph-mon[17265]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi130", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:51:49.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:49 smithi037 ceph-mon[17265]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:51:50.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:50 smithi037 ceph-mon[17265]: Deploying cephadm binary to smithi130 2024-08-20T04:51:51.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:51 smithi037 ceph-mon[17265]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:51:51.637 INFO:teuthology.orchestra.run.smithi037.stdout:Added host 'smithi130' with addr '172.21.15.130' 2024-08-20T04:51:52.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch host ls --format=json 2024-08-20T04:51:52.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:52.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:52 smithi037 ceph-mon[17265]: Added host smithi130 2024-08-20T04:51:52.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:51:52.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:52.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:51:53.554 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:51:53.555 INFO:teuthology.orchestra.run.smithi037.stdout:[{"addr": "172.21.15.37", "hostname": "smithi037", "labels": [], "status": ""}, {"addr": "172.21.15.130", "hostname": "smithi130", "labels": [], "status": ""}] 2024-08-20T04:51:53.897 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:53 smithi037 ceph-mon[17265]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:51:53.897 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:53 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:54.227 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi135 2024-08-20T04:51:54.227 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-20T04:51:54.227 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.conf 2024-08-20T04:51:54.244 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-20T04:51:54.244 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-20T04:51:54.299 INFO:tasks.cephadm:Adding host smithi135 to orchestrator... 2024-08-20T04:51:54.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch host add smithi135 2024-08-20T04:51:54.675 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:51:54.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:54 smithi037 ceph-mon[17265]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T04:51:56.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:55 smithi037 ceph-mon[17265]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:51:56.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:56.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:56.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:56.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:56.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"} : dispatch 2024-08-20T04:51:57.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:56 smithi037 ceph-mon[17265]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:51:57.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:56 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:51:57.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:56 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:51:57.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:56 smithi037 ceph-mon[17265]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-20T04:51:57.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:56 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:57.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:56 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:57.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:56 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:58.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:57 smithi037 ceph-mon[17265]: Updating smithi130:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:51:58.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:57 smithi037 ceph-mon[17265]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:51:58.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:57 smithi037 ceph-mon[17265]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-08-20T04:51:58.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:57 smithi037 ceph-mon[17265]: Updating smithi130:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T04:51:58.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:57 smithi037 ceph-mon[17265]: Deploying cephadm binary to smithi135 2024-08-20T04:51:59.283 INFO:teuthology.orchestra.run.smithi037.stdout:Added host 'smithi135' with addr '172.21.15.135' 2024-08-20T04:51:59.913 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:59 smithi037 ceph-mon[17265]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:51:59.913 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:59 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:59.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:59 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:51:59.914 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:51:59 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:51:59.952 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch host ls --format=json 2024-08-20T04:52:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:00.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:00 smithi037 ceph-mon[17265]: Added host smithi135 2024-08-20T04:52:00.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:00 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:00.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:00 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:01.014 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:52:01.014 INFO:teuthology.orchestra.run.smithi037.stdout:[{"addr": "172.21.15.37", "hostname": "smithi037", "labels": [], "status": ""}, {"addr": "172.21.15.130", "hostname": "smithi130", "labels": [], "status": ""}, {"addr": "172.21.15.135", "hostname": "smithi135", "labels": [], "status": ""}] 2024-08-20T04:52:01.689 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-20T04:52:01.689 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd crush tunables default 2024-08-20T04:52:02.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:01 smithi037 ceph-mon[17265]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:02.052 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:03.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:02 smithi037 ceph-mon[17265]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T04:52:03.662 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2024-08-20T04:52:04.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:03 smithi037 ceph-mon[17265]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:04.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:03 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/4054028872' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-20T04:52:04.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:03 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:04.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:03 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:04.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:03 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:04.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:03 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:04.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:03 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-08-20T04:52:04.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:03 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:04.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:03 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:04.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:03 smithi037 ceph-mon[17265]: Updating smithi135:/etc/ceph/ceph.conf 2024-08-20T04:52:04.390 INFO:tasks.cephadm:Adding mon.a on smithi037 2024-08-20T04:52:04.391 INFO:tasks.cephadm:Adding mon.b on smithi130 2024-08-20T04:52:04.391 INFO:tasks.cephadm:Adding mon.c on smithi135 2024-08-20T04:52:04.391 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch apply mon '3;smithi037:172.21.15.37=a;smithi130:172.21.15.130=b;smithi135:172.21.15.135=c' 2024-08-20T04:52:04.645 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:52:05.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:04 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/4054028872' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-20T04:52:05.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:04 smithi037 ceph-mon[17265]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T04:52:05.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:04 smithi037 ceph-mon[17265]: Updating smithi135:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:52:05.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:04 smithi037 ceph-mon[17265]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-08-20T04:52:05.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:04 smithi037 ceph-mon[17265]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:05.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:04 smithi037 ceph-mon[17265]: Updating smithi135:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T04:52:05.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:04 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:05.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:04 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:05.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:04 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:05.273 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled mon update... 2024-08-20T04:52:05.859 DEBUG:teuthology.orchestra.run.smithi130:mon.b> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mon.b.service 2024-08-20T04:52:05.862 DEBUG:teuthology.orchestra.run.smithi135:mon.c> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mon.c.service 2024-08-20T04:52:05.864 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-20T04:52:05.864 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-20T04:52:06.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:06 smithi037 ceph-mon[17265]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi130:172.21.15.130=b;smithi135:172.21.15.135=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:52:06.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:06 smithi037 ceph-mon[17265]: Saving service mon spec with placement smithi037:172.21.15.37=a;smithi130:172.21.15.130=b;smithi135:172.21.15.135=c;count:3 2024-08-20T04:52:06.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:06 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:06.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:06 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:52:06.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:06 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:06.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:06 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:06.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:06 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:06.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:06 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T04:52:06.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:06 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:06.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:06 smithi037 ceph-mon[17265]: Deploying daemon mon.c on smithi135 2024-08-20T04:52:07.043 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:52:07.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:07 smithi037 ceph-mon[17265]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:08.764 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:52:08.764 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":1,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","modified":"2024-08-20T04:50:22.881182Z","created":"2024-08-20T04:50:22.881182Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-20T04:52:08.765 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 1 2024-08-20T04:52:09.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 podman[22323]: 2024-08-20 04:52:09.536298272 +0000 UTC m=+0.114297224 container create cdd2b1e22e07d235f3dfdd901a6d0cb023738d4297e452e35526406a0730e6fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-c, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-20T04:52:09.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:09 smithi037 ceph-mon[17265]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:09.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:09 smithi037 ceph-mon[17265]: from='client.? 172.21.15.135:0/152300662' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T04:52:10.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 podman[22323]: 2024-08-20 04:52:09.741078583 +0000 UTC m=+0.319077537 container init cdd2b1e22e07d235f3dfdd901a6d0cb023738d4297e452e35526406a0730e6fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-c, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-08-20T04:52:10.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 podman[22323]: 2024-08-20 04:52:09.744314552 +0000 UTC m=+0.322313508 container start cdd2b1e22e07d235f3dfdd901a6d0cb023738d4297e452e35526406a0730e6fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-c, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True) 2024-08-20T04:52:10.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: set uid:gid to 167:167 (ceph:ceph) 2024-08-20T04:52:10.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev), process ceph-mon, pid 2 2024-08-20T04:52:10.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: pidfile_write: ignore empty --pid-file 2024-08-20T04:52:10.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: load: jerasure load: lrc 2024-08-20T04:52:10.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: RocksDB version: 7.9.2 2024-08-20T04:52:10.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Git sha 0 2024-08-20T04:52:10.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Compile date 2024-08-19 15:50:59 2024-08-20T04:52:10.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: DB SUMMARY 2024-08-20T04:52:10.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: DB Session ID: ST66NLFV9WTIAPL4QWOU 2024-08-20T04:52:10.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: CURRENT file: CURRENT 2024-08-20T04:52:10.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: IDENTITY file: IDENTITY 2024-08-20T04:52:10.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-20T04:52:10.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-08-20T04:52:10.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-08-20T04:52:10.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.error_if_exists: 0 2024-08-20T04:52:10.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.create_if_missing: 0 2024-08-20T04:52:10.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.paranoid_checks: 1 2024-08-20T04:52:10.118 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-20T04:52:10.118 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-20T04:52:10.118 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-20T04:52:10.118 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.env: 0x55f1d81e5be0 2024-08-20T04:52:10.118 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.fs: PosixFileSystem 2024-08-20T04:52:10.118 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.info_log: 0x55f1da20f700 2024-08-20T04:52:10.118 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_file_opening_threads: 16 2024-08-20T04:52:10.118 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.statistics: (nil) 2024-08-20T04:52:10.118 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.use_fsync: 0 2024-08-20T04:52:10.118 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_log_file_size: 0 2024-08-20T04:52:10.119 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-20T04:52:10.119 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-20T04:52:10.119 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.keep_log_file_num: 1000 2024-08-20T04:52:10.119 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.recycle_log_file_num: 0 2024-08-20T04:52:10.119 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.allow_fallocate: 1 2024-08-20T04:52:10.119 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.allow_mmap_reads: 0 2024-08-20T04:52:10.119 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.allow_mmap_writes: 0 2024-08-20T04:52:10.119 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.use_direct_reads: 0 2024-08-20T04:52:10.119 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-20T04:52:10.119 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.create_missing_column_families: 0 2024-08-20T04:52:10.119 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.db_log_dir: 2024-08-20T04:52:10.119 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.wal_dir: 2024-08-20T04:52:10.119 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-20T04:52:10.119 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-20T04:52:10.120 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-20T04:52:10.120 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-20T04:52:10.120 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-20T04:52:10.120 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-20T04:52:10.120 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.advise_random_on_open: 1 2024-08-20T04:52:10.120 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.db_write_buffer_size: 0 2024-08-20T04:52:10.120 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.write_buffer_manager: 0x55f1da212e60 2024-08-20T04:52:10.120 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-20T04:52:10.120 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-20T04:52:10.120 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-20T04:52:10.120 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.rate_limiter: (nil) 2024-08-20T04:52:10.120 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-20T04:52:10.120 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.wal_recovery_mode: 2 2024-08-20T04:52:10.120 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.enable_thread_tracking: 0 2024-08-20T04:52:10.121 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.enable_pipelined_write: 0 2024-08-20T04:52:10.121 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.unordered_write: 0 2024-08-20T04:52:10.121 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-20T04:52:10.121 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-20T04:52:10.121 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-20T04:52:10.121 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-20T04:52:10.121 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.row_cache: None 2024-08-20T04:52:10.121 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.wal_filter: None 2024-08-20T04:52:10.123 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-20T04:52:10.123 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.allow_ingest_behind: 0 2024-08-20T04:52:10.123 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.two_write_queues: 0 2024-08-20T04:52:10.123 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.manual_wal_flush: 0 2024-08-20T04:52:10.123 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.wal_compression: 0 2024-08-20T04:52:10.123 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.atomic_flush: 0 2024-08-20T04:52:10.123 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-20T04:52:10.123 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-20T04:52:10.123 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-20T04:52:10.123 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.log_readahead_size: 0 2024-08-20T04:52:10.123 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-20T04:52:10.124 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.best_efforts_recovery: 0 2024-08-20T04:52:10.124 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-20T04:52:10.124 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-20T04:52:10.124 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.allow_data_in_errors: 0 2024-08-20T04:52:10.124 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.db_host_id: __hostname__ 2024-08-20T04:52:10.124 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-20T04:52:10.124 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_background_jobs: 2 2024-08-20T04:52:10.124 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_background_compactions: -1 2024-08-20T04:52:10.124 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_subcompactions: 1 2024-08-20T04:52:10.124 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-20T04:52:10.124 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-20T04:52:10.125 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-20T04:52:10.125 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_total_wal_size: 0 2024-08-20T04:52:10.125 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-20T04:52:10.125 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-20T04:52:10.125 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-20T04:52:10.125 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-20T04:52:10.125 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_open_files: -1 2024-08-20T04:52:10.125 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.bytes_per_sync: 0 2024-08-20T04:52:10.125 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-20T04:52:10.125 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-20T04:52:10.125 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compaction_readahead_size: 0 2024-08-20T04:52:10.126 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_background_flushes: -1 2024-08-20T04:52:10.126 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Compression algorithms supported: 2024-08-20T04:52:10.126 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: kZSTD supported: 0 2024-08-20T04:52:10.126 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: kXpressCompression supported: 0 2024-08-20T04:52:10.126 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: kBZip2Compression supported: 0 2024-08-20T04:52:10.126 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-20T04:52:10.126 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: kLZ4Compression supported: 1 2024-08-20T04:52:10.126 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: kZlibCompression supported: 1 2024-08-20T04:52:10.127 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: kLZ4HCCompression supported: 1 2024-08-20T04:52:10.127 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: kSnappyCompression supported: 1 2024-08-20T04:52:10.127 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-20T04:52:10.127 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-20T04:52:10.127 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-08-20T04:52:10.127 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-20T04:52:10.127 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-20T04:52:10.127 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.merge_operator: 2024-08-20T04:52:10.127 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compaction_filter: None 2024-08-20T04:52:10.127 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compaction_filter_factory: None 2024-08-20T04:52:10.127 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.sst_partitioner_factory: None 2024-08-20T04:52:10.127 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-20T04:52:10.127 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-20T04:52:10.128 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f1da20f380) 2024-08-20T04:52:10.128 INFO:journalctl@ceph.mon.c.smithi135.stdout: cache_index_and_filter_blocks: 1 2024-08-20T04:52:10.128 INFO:journalctl@ceph.mon.c.smithi135.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-20T04:52:10.128 INFO:journalctl@ceph.mon.c.smithi135.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-20T04:52:10.128 INFO:journalctl@ceph.mon.c.smithi135.stdout: pin_top_level_index_and_filter: 1 2024-08-20T04:52:10.128 INFO:journalctl@ceph.mon.c.smithi135.stdout: index_type: 0 2024-08-20T04:52:10.128 INFO:journalctl@ceph.mon.c.smithi135.stdout: data_block_index_type: 0 2024-08-20T04:52:10.128 INFO:journalctl@ceph.mon.c.smithi135.stdout: index_shortening: 1 2024-08-20T04:52:10.128 INFO:journalctl@ceph.mon.c.smithi135.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-20T04:52:10.128 INFO:journalctl@ceph.mon.c.smithi135.stdout: checksum: 4 2024-08-20T04:52:10.128 INFO:journalctl@ceph.mon.c.smithi135.stdout: no_block_cache: 0 2024-08-20T04:52:10.128 INFO:journalctl@ceph.mon.c.smithi135.stdout: block_cache: 0x55f1da203610 2024-08-20T04:52:10.128 INFO:journalctl@ceph.mon.c.smithi135.stdout: block_cache_name: BinnedLRUCache 2024-08-20T04:52:10.128 INFO:journalctl@ceph.mon.c.smithi135.stdout: block_cache_options: 2024-08-20T04:52:10.129 INFO:journalctl@ceph.mon.c.smithi135.stdout: capacity : 536870912 2024-08-20T04:52:10.129 INFO:journalctl@ceph.mon.c.smithi135.stdout: num_shard_bits : 4 2024-08-20T04:52:10.129 INFO:journalctl@ceph.mon.c.smithi135.stdout: strict_capacity_limit : 0 2024-08-20T04:52:10.129 INFO:journalctl@ceph.mon.c.smithi135.stdout: high_pri_pool_ratio: 0.000 2024-08-20T04:52:10.129 INFO:journalctl@ceph.mon.c.smithi135.stdout: block_cache_compressed: (nil) 2024-08-20T04:52:10.129 INFO:journalctl@ceph.mon.c.smithi135.stdout: persistent_cache: (nil) 2024-08-20T04:52:10.129 INFO:journalctl@ceph.mon.c.smithi135.stdout: block_size: 4096 2024-08-20T04:52:10.129 INFO:journalctl@ceph.mon.c.smithi135.stdout: block_size_deviation: 10 2024-08-20T04:52:10.129 INFO:journalctl@ceph.mon.c.smithi135.stdout: block_restart_interval: 16 2024-08-20T04:52:10.129 INFO:journalctl@ceph.mon.c.smithi135.stdout: index_block_restart_interval: 1 2024-08-20T04:52:10.129 INFO:journalctl@ceph.mon.c.smithi135.stdout: metadata_block_size: 4096 2024-08-20T04:52:10.129 INFO:journalctl@ceph.mon.c.smithi135.stdout: partition_filters: 0 2024-08-20T04:52:10.130 INFO:journalctl@ceph.mon.c.smithi135.stdout: use_delta_encoding: 1 2024-08-20T04:52:10.130 INFO:journalctl@ceph.mon.c.smithi135.stdout: filter_policy: bloomfilter 2024-08-20T04:52:10.130 INFO:journalctl@ceph.mon.c.smithi135.stdout: whole_key_filtering: 1 2024-08-20T04:52:10.130 INFO:journalctl@ceph.mon.c.smithi135.stdout: verify_compression: 0 2024-08-20T04:52:10.130 INFO:journalctl@ceph.mon.c.smithi135.stdout: read_amp_bytes_per_bit: 0 2024-08-20T04:52:10.130 INFO:journalctl@ceph.mon.c.smithi135.stdout: format_version: 5 2024-08-20T04:52:10.130 INFO:journalctl@ceph.mon.c.smithi135.stdout: enable_index_compression: 1 2024-08-20T04:52:10.130 INFO:journalctl@ceph.mon.c.smithi135.stdout: block_align: 0 2024-08-20T04:52:10.130 INFO:journalctl@ceph.mon.c.smithi135.stdout: max_auto_readahead_size: 262144 2024-08-20T04:52:10.130 INFO:journalctl@ceph.mon.c.smithi135.stdout: prepopulate_block_cache: 0 2024-08-20T04:52:10.130 INFO:journalctl@ceph.mon.c.smithi135.stdout: initial_auto_readahead_size: 8192 2024-08-20T04:52:10.130 INFO:journalctl@ceph.mon.c.smithi135.stdout: num_file_reads_for_auto_readahead: 2 2024-08-20T04:52:10.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.write_buffer_size: 33554432 2024-08-20T04:52:10.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_write_buffer_number: 2 2024-08-20T04:52:10.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compression: NoCompression 2024-08-20T04:52:10.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.bottommost_compression: Disabled 2024-08-20T04:52:10.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.prefix_extractor: nullptr 2024-08-20T04:52:10.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-20T04:52:10.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.num_levels: 7 2024-08-20T04:52:10.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-20T04:52:10.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-20T04:52:10.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-20T04:52:10.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-20T04:52:10.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-20T04:52:10.131 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-20T04:52:10.132 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-20T04:52:10.132 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-20T04:52:10.132 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-20T04:52:10.132 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-20T04:52:10.132 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-20T04:52:10.132 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-20T04:52:10.132 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-20T04:52:10.132 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compression_opts.level: 32767 2024-08-20T04:52:10.132 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compression_opts.strategy: 0 2024-08-20T04:52:10.132 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-20T04:52:10.132 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-20T04:52:10.132 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-20T04:52:10.132 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-20T04:52:10.133 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compression_opts.enabled: false 2024-08-20T04:52:10.133 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-20T04:52:10.133 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-20T04:52:10.133 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-20T04:52:10.133 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-20T04:52:10.133 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.target_file_size_base: 67108864 2024-08-20T04:52:10.133 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-20T04:52:10.133 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-20T04:52:10.133 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-20T04:52:10.133 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-20T04:52:10.133 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-20T04:52:10.133 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-20T04:52:10.134 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-20T04:52:10.134 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-20T04:52:10.134 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-20T04:52:10.134 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-20T04:52:10.134 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-20T04:52:10.134 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-20T04:52:10.134 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-20T04:52:10.134 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-20T04:52:10.134 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.arena_block_size: 1048576 2024-08-20T04:52:10.134 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-20T04:52:10.134 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-20T04:52:10.135 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.disable_auto_compactions: 0 2024-08-20T04:52:10.135 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-20T04:52:10.135 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-20T04:52:10.135 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-20T04:52:10.135 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-20T04:52:10.135 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-20T04:52:10.135 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-20T04:52:10.135 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-20T04:52:10.135 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-20T04:52:10.135 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-20T04:52:10.135 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-20T04:52:10.135 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-20T04:52:10.135 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.inplace_update_support: 0 2024-08-20T04:52:10.136 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-20T04:52:10.136 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-20T04:52:10.136 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-20T04:52:10.136 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-20T04:52:10.136 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.bloom_locality: 0 2024-08-20T04:52:10.136 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.max_successive_merges: 0 2024-08-20T04:52:10.136 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-20T04:52:10.136 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.paranoid_file_checks: 0 2024-08-20T04:52:10.136 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.force_consistency_checks: 1 2024-08-20T04:52:10.136 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.report_bg_io_stats: 0 2024-08-20T04:52:10.136 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.ttl: 2592000 2024-08-20T04:52:10.136 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-20T04:52:10.137 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-20T04:52:10.137 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-20T04:52:10.137 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.enable_blob_files: false 2024-08-20T04:52:10.137 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.min_blob_size: 0 2024-08-20T04:52:10.137 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.blob_file_size: 268435456 2024-08-20T04:52:10.137 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-20T04:52:10.137 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-20T04:52:10.137 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-20T04:52:10.137 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-20T04:52:10.137 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-20T04:52:10.137 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.blob_file_starting_level: 0 2024-08-20T04:52:10.137 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-20T04:52:10.138 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-20T04:52:10.138 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-20T04:52:10.138 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1afb236a-c986-4e58-b552-8ed901f178a0 2024-08-20T04:52:10.138 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724129529771603, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-20T04:52:10.139 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-20T04:52:10.139 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724129529772026, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1724129529, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1afb236a-c986-4e58-b552-8ed901f178a0", "db_session_id": "ST66NLFV9WTIAPL4QWOU", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-20T04:52:10.139 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: EVENT_LOG_v1 {"time_micros": 1724129529772120, "job": 1, "event": "recovery_finished"} 2024-08-20T04:52:10.139 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-20T04:52:10.139 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-20T04:52:10.140 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f1da232e00 2024-08-20T04:52:10.140 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: DB pointer 0x55f1da330000 2024-08-20T04:52:10.140 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-20T04:52:10.140 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-20T04:52:10.140 INFO:journalctl@ceph.mon.c.smithi135.stdout: ** DB Stats ** 2024-08-20T04:52:10.141 INFO:journalctl@ceph.mon.c.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-20T04:52:10.141 INFO:journalctl@ceph.mon.c.smithi135.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-20T04:52:10.141 INFO:journalctl@ceph.mon.c.smithi135.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-20T04:52:10.141 INFO:journalctl@ceph.mon.c.smithi135.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-20T04:52:10.141 INFO:journalctl@ceph.mon.c.smithi135.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-20T04:52:10.141 INFO:journalctl@ceph.mon.c.smithi135.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-20T04:52:10.142 INFO:journalctl@ceph.mon.c.smithi135.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-20T04:52:10.142 INFO:journalctl@ceph.mon.c.smithi135.stdout: 2024-08-20T04:52:10.142 INFO:journalctl@ceph.mon.c.smithi135.stdout: ** Compaction Stats [default] ** 2024-08-20T04:52:10.142 INFO:journalctl@ceph.mon.c.smithi135.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-20T04:52:10.142 INFO:journalctl@ceph.mon.c.smithi135.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-20T04:52:10.143 INFO:journalctl@ceph.mon.c.smithi135.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-20T04:52:10.143 INFO:journalctl@ceph.mon.c.smithi135.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-20T04:52:10.143 INFO:journalctl@ceph.mon.c.smithi135.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-20T04:52:10.143 INFO:journalctl@ceph.mon.c.smithi135.stdout: 2024-08-20T04:52:10.144 INFO:journalctl@ceph.mon.c.smithi135.stdout: ** Compaction Stats [default] ** 2024-08-20T04:52:10.144 INFO:journalctl@ceph.mon.c.smithi135.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-20T04:52:10.144 INFO:journalctl@ceph.mon.c.smithi135.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-20T04:52:10.144 INFO:journalctl@ceph.mon.c.smithi135.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-20T04:52:10.144 INFO:journalctl@ceph.mon.c.smithi135.stdout: 2024-08-20T04:52:10.144 INFO:journalctl@ceph.mon.c.smithi135.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-20T04:52:10.144 INFO:journalctl@ceph.mon.c.smithi135.stdout: 2024-08-20T04:52:10.144 INFO:journalctl@ceph.mon.c.smithi135.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-20T04:52:10.144 INFO:journalctl@ceph.mon.c.smithi135.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-20T04:52:10.144 INFO:journalctl@ceph.mon.c.smithi135.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-20T04:52:10.144 INFO:journalctl@ceph.mon.c.smithi135.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-20T04:52:10.144 INFO:journalctl@ceph.mon.c.smithi135.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-20T04:52:10.145 INFO:journalctl@ceph.mon.c.smithi135.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-20T04:52:10.145 INFO:journalctl@ceph.mon.c.smithi135.stdout: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-20T04:52:10.145 INFO:journalctl@ceph.mon.c.smithi135.stdout: Interval compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-20T04:52:10.145 INFO:journalctl@ceph.mon.c.smithi135.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-20T04:52:10.145 INFO:journalctl@ceph.mon.c.smithi135.stdout: Block cache BinnedLRUCache@0x55f1da203610#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-08-20T04:52:10.145 INFO:journalctl@ceph.mon.c.smithi135.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-20T04:52:10.145 INFO:journalctl@ceph.mon.c.smithi135.stdout: 2024-08-20T04:52:10.145 INFO:journalctl@ceph.mon.c.smithi135.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-20T04:52:10.145 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-08-20T04:52:10.145 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: using public_addr v2:172.21.15.135:0/0 -> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-20T04:52:10.145 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: starting mon.c rank -1 at public addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] at bind addrs [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:52:10.146 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: mon.c@-1(???) e0 preinit fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:52:10.146 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: mon.c@-1(synchronizing).mds e1 new map 2024-08-20T04:52:10.146 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: mon.c@-1(synchronizing).mds e1 print_map 2024-08-20T04:52:10.146 INFO:journalctl@ceph.mon.c.smithi135.stdout: e1 2024-08-20T04:52:10.146 INFO:journalctl@ceph.mon.c.smithi135.stdout: btime 2024-08-20T04:50:26:520042+0000 2024-08-20T04:52:10.146 INFO:journalctl@ceph.mon.c.smithi135.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-20T04:52:10.146 INFO:journalctl@ceph.mon.c.smithi135.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-20T04:52:10.146 INFO:journalctl@ceph.mon.c.smithi135.stdout: legacy client fscid: -1 2024-08-20T04:52:10.146 INFO:journalctl@ceph.mon.c.smithi135.stdout: 2024-08-20T04:52:10.146 INFO:journalctl@ceph.mon.c.smithi135.stdout: No filesystems configured 2024-08-20T04:52:10.146 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-20T04:52:10.147 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-20T04:52:10.147 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-20T04:52:10.147 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-20T04:52:10.147 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-20T04:52:10.147 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-20T04:52:10.147 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-20T04:52:10.147 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T04:52:10.147 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T04:52:10.147 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T04:52:10.147 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:10.147 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.148 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.148 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.148 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.148 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"} : dispatch 2024-08-20T04:52:10.148 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:52:10.148 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:10.148 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:10.148 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-20T04:52:10.148 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.148 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.148 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.148 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: Updating smithi130:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:52:10.148 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:10.149 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-08-20T04:52:10.149 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: Updating smithi130:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T04:52:10.149 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: Deploying cephadm binary to smithi135 2024-08-20T04:52:10.149 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:10.149 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.149 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:52:10.149 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.149 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: Added host smithi135 2024-08-20T04:52:10.149 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.149 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.149 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:10.149 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T04:52:10.149 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:10.150 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/4054028872' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-20T04:52:10.150 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.150 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.150 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.150 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.150 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-08-20T04:52:10.150 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:10.150 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:10.150 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: Updating smithi135:/etc/ceph/ceph.conf 2024-08-20T04:52:10.150 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/4054028872' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-20T04:52:10.150 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T04:52:10.150 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: Updating smithi135:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:52:10.151 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-08-20T04:52:10.151 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:10.151 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: Updating smithi135:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T04:52:10.151 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.151 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.151 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.151 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi130:172.21.15.130=b;smithi135:172.21.15.135=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:52:10.151 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: Saving service mon spec with placement smithi037:172.21.15.37=a;smithi130:172.21.15.130=b;smithi135:172.21.15.135=c;count:3 2024-08-20T04:52:10.151 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.151 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:52:10.151 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:10.152 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:10.152 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:10.152 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T04:52:10.152 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:10.152 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: Deploying daemon mon.c on smithi135 2024-08-20T04:52:10.152 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:10.152 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:10.152 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: from='client.? 172.21.15.135:0/152300662' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T04:52:10.152 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 ceph-mon[22342]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-20T04:52:10.152 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 bash[22323]: cdd2b1e22e07d235f3dfdd901a6d0cb023738d4297e452e35526406a0730e6fc 2024-08-20T04:52:10.152 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:09 smithi135 systemd[1]: Started Ceph mon.c for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:52:10.374 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-20T04:52:10.374 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-20T04:52:10.624 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T04:52:15.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:52:15.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:15.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: mon.a calling monitor election 2024-08-20T04:52:15.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:15.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:15.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:15.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: mon.c calling monitor election 2024-08-20T04:52:15.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:15.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:15.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:15.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:15.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:15.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-20T04:52:15.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: monmap epoch 2 2024-08-20T04:52:15.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:52:15.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: last_changed 2024-08-20T04:52:09.800466+0000 2024-08-20T04:52:15.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: created 2024-08-20T04:50:22.881182+0000 2024-08-20T04:52:15.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: min_mon_release 19 (squid) 2024-08-20T04:52:15.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: election_strategy: 1 2024-08-20T04:52:15.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-08-20T04:52:15.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: 1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.c 2024-08-20T04:52:15.268 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: fsmap 2024-08-20T04:52:15.268 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T04:52:15.268 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: mgrmap e13: x(active, since 46s) 2024-08-20T04:52:15.268 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: overall HEALTH_OK 2024-08-20T04:52:15.268 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:15.268 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:15.268 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:15.268 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T04:52:15.268 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:15.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:52:15.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:15.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: mon.a calling monitor election 2024-08-20T04:52:15.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:15.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:15.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:15.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: mon.c calling monitor election 2024-08-20T04:52:15.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:15.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:15.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:15.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:15.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:15.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-20T04:52:15.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: monmap epoch 2 2024-08-20T04:52:15.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:52:15.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: last_changed 2024-08-20T04:52:09.800466+0000 2024-08-20T04:52:15.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: created 2024-08-20T04:50:22.881182+0000 2024-08-20T04:52:15.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: min_mon_release 19 (squid) 2024-08-20T04:52:15.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: election_strategy: 1 2024-08-20T04:52:15.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-08-20T04:52:15.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: 1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.c 2024-08-20T04:52:15.368 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: fsmap 2024-08-20T04:52:15.368 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T04:52:15.368 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: mgrmap e13: x(active, since 46s) 2024-08-20T04:52:15.368 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: overall HEALTH_OK 2024-08-20T04:52:15.368 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:15.368 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:15.368 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:15.368 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T04:52:15.368 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:15.708 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:52:15.709 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":2,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","modified":"2024-08-20T04:52:09.800466Z","created":"2024-08-20T04:50:22.881182Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-20T04:52:15.709 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 2 2024-08-20T04:52:16.013 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:15 smithi135 ceph-mon[22342]: Deploying daemon mon.b on smithi130 2024-08-20T04:52:16.014 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:15 smithi135 ceph-mon[22342]: from='client.? 172.21.15.135:0/2148571859' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T04:52:16.014 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:16.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:15 smithi037 ceph-mon[17265]: Deploying daemon mon.b on smithi130 2024-08-20T04:52:16.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:15 smithi037 ceph-mon[17265]: from='client.? 172.21.15.135:0/2148571859' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T04:52:16.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:17.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:16 smithi037 ceph-mon[17265]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:17.268 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-20T04:52:17.268 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-20T04:52:17.296 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:16 smithi135 ceph-mon[22342]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:17.521 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T04:52:18.291 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:52:18.292 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":2,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","modified":"2024-08-20T04:52:09.800466Z","created":"2024-08-20T04:50:22.881182Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-20T04:52:18.292 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 2 2024-08-20T04:52:18.421 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mon.b@-1(???) e0 preinit fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:52:18.421 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mon.b@-1(synchronizing).mds e1 new map 2024-08-20T04:52:18.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mon.b@-1(synchronizing).mds e1 print_map 2024-08-20T04:52:18.422 INFO:journalctl@ceph.mon.b.smithi130.stdout: e1 2024-08-20T04:52:18.422 INFO:journalctl@ceph.mon.b.smithi130.stdout: btime 2024-08-20T04:50:26:520042+0000 2024-08-20T04:52:18.422 INFO:journalctl@ceph.mon.b.smithi130.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-20T04:52:18.422 INFO:journalctl@ceph.mon.b.smithi130.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-20T04:52:18.422 INFO:journalctl@ceph.mon.b.smithi130.stdout: legacy client fscid: -1 2024-08-20T04:52:18.422 INFO:journalctl@ceph.mon.b.smithi130.stdout: 2024-08-20T04:52:18.422 INFO:journalctl@ceph.mon.b.smithi130.stdout: No filesystems configured 2024-08-20T04:52:18.422 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-20T04:52:18.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-20T04:52:18.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-20T04:52:18.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-20T04:52:18.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-20T04:52:18.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-20T04:52:18.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-20T04:52:18.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T04:52:18.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T04:52:18.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-20T04:52:18.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:18.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi130", "name": "osd_memory_target"} : dispatch 2024-08-20T04:52:18.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi135", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:52:18.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:18.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:18.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-20T04:52:18.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: Updating smithi130:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:52:18.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:18.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: Updating smithi130:/etc/ceph/ceph.client.admin.keyring 2024-08-20T04:52:18.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: Updating smithi130:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T04:52:18.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: Deploying cephadm binary to smithi135 2024-08-20T04:52:18.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:18.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:52:18.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: Added host smithi135 2024-08-20T04:52:18.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.709 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:18.709 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T04:52:18.709 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:18.709 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/4054028872' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-08-20T04:52:18.709 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.709 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-08-20T04:52:18.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:18.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:18.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: Updating smithi135:/etc/ceph/ceph.conf 2024-08-20T04:52:18.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/4054028872' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-20T04:52:18.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T04:52:18.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: Updating smithi135:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:52:18.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: Updating smithi135:/etc/ceph/ceph.client.admin.keyring 2024-08-20T04:52:18.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:18.710 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: Updating smithi135:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.client.admin.keyring 2024-08-20T04:52:18.711 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.711 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.711 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.711 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi037:172.21.15.37=a;smithi130:172.21.15.130=b;smithi135:172.21.15.135=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:52:18.711 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: Saving service mon spec with placement smithi037:172.21.15.37=a;smithi130:172.21.15.130=b;smithi135:172.21.15.135=c;count:3 2024-08-20T04:52:18.711 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.711 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:52:18.711 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:18.711 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:18.711 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.711 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T04:52:18.711 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:18.711 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: Deploying daemon mon.c on smithi135 2024-08-20T04:52:18.712 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:18.712 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:18.712 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='client.? 172.21.15.135:0/152300662' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T04:52:18.712 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:52:18.712 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:18.712 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mon.a calling monitor election 2024-08-20T04:52:18.712 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:18.712 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:18.712 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:18.712 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mon.c calling monitor election 2024-08-20T04:52:18.712 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:18.712 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:18.712 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:18.712 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:18.713 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:18.713 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-20T04:52:18.713 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: monmap epoch 2 2024-08-20T04:52:18.713 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:52:18.713 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: last_changed 2024-08-20T04:52:09.800466+0000 2024-08-20T04:52:18.713 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: created 2024-08-20T04:50:22.881182+0000 2024-08-20T04:52:18.713 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: min_mon_release 19 (squid) 2024-08-20T04:52:18.713 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: election_strategy: 1 2024-08-20T04:52:18.713 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-08-20T04:52:18.713 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: 1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.c 2024-08-20T04:52:18.713 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: fsmap 2024-08-20T04:52:18.713 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T04:52:18.714 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mgrmap e13: x(active, since 46s) 2024-08-20T04:52:18.714 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: overall HEALTH_OK 2024-08-20T04:52:18.714 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.714 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.714 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:18.714 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T04:52:18.714 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:18.714 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: Deploying daemon mon.b on smithi130 2024-08-20T04:52:18.714 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='client.? 172.21.15.135:0/2148571859' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T04:52:18.714 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:18.714 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:18.714 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 ceph-mon[22007]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-20T04:52:18.715 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 bash[21988]: 543875a034e5d15c928ed796436a41c82e3fbee1f84e0ee051b8c27bbfa8054a 2024-08-20T04:52:18.715 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:18 smithi130 systemd[1]: Started Ceph mon.b for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:52:19.892 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-20T04:52:19.892 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph mon dump -f json 2024-08-20T04:52:20.141 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T04:52:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:52:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: mon.a calling monitor election 2024-08-20T04:52:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: mon.c calling monitor election 2024-08-20T04:52:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: mon.b calling monitor election 2024-08-20T04:52:23.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:23.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-20T04:52:23.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: monmap epoch 3 2024-08-20T04:52:23.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:52:23.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: last_changed 2024-08-20T04:52:18.426156+0000 2024-08-20T04:52:23.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: created 2024-08-20T04:50:22.881182+0000 2024-08-20T04:52:23.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: min_mon_release 19 (squid) 2024-08-20T04:52:23.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: election_strategy: 1 2024-08-20T04:52:23.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-08-20T04:52:23.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: 1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.c 2024-08-20T04:52:23.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-08-20T04:52:23.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: fsmap 2024-08-20T04:52:23.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T04:52:23.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: mgrmap e13: x(active, since 55s) 2024-08-20T04:52:23.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: overall HEALTH_OK 2024-08-20T04:52:23.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:23.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:23.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:23.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:23.863 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:52:23.863 INFO:teuthology.orchestra.run.smithi135.stdout:{"epoch":3,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","modified":"2024-08-20T04:52:18.426156Z","created":"2024-08-20T04:50:22.881182Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:3300","nonce":0},{"type":"v1","addr":"172.21.15.135:6789","nonce":0}]},"addr":"172.21.15.135:6789/0","public_addr":"172.21.15.135:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:3300","nonce":0},{"type":"v1","addr":"172.21.15.130:6789","nonce":0}]},"addr":"172.21.15.130:6789/0","public_addr":"172.21.15.130:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-08-20T04:52:23.863 INFO:teuthology.orchestra.run.smithi135.stderr:dumped monmap epoch 3 2024-08-20T04:52:23.863 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:23.864 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:52:23.864 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.864 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:23.864 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: mon.a calling monitor election 2024-08-20T04:52:23.864 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: mon.c calling monitor election 2024-08-20T04:52:23.864 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.864 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:23.864 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.864 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: mon.b calling monitor election 2024-08-20T04:52:23.864 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.864 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:23.864 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.864 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-20T04:52:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: monmap epoch 3 2024-08-20T04:52:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:52:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: last_changed 2024-08-20T04:52:18.426156+0000 2024-08-20T04:52:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: created 2024-08-20T04:50:22.881182+0000 2024-08-20T04:52:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: min_mon_release 19 (squid) 2024-08-20T04:52:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: election_strategy: 1 2024-08-20T04:52:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-08-20T04:52:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: 1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.c 2024-08-20T04:52:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-08-20T04:52:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: fsmap 2024-08-20T04:52:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T04:52:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: mgrmap e13: x(active, since 55s) 2024-08-20T04:52:23.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: overall HEALTH_OK 2024-08-20T04:52:23.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:23.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:23.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:23.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:52:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:52:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: mon.a calling monitor election 2024-08-20T04:52:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: mon.c calling monitor election 2024-08-20T04:52:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: mon.b calling monitor election 2024-08-20T04:52:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-20T04:52:23.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: monmap epoch 3 2024-08-20T04:52:23.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:52:23.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: last_changed 2024-08-20T04:52:18.426156+0000 2024-08-20T04:52:23.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: created 2024-08-20T04:50:22.881182+0000 2024-08-20T04:52:23.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: min_mon_release 19 (squid) 2024-08-20T04:52:23.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: election_strategy: 1 2024-08-20T04:52:23.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-08-20T04:52:23.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: 1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.c 2024-08-20T04:52:23.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: 2: [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] mon.b 2024-08-20T04:52:23.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: fsmap 2024-08-20T04:52:23.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: osdmap e4: 0 total, 0 up, 0 in 2024-08-20T04:52:23.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: mgrmap e13: x(active, since 55s) 2024-08-20T04:52:23.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: overall HEALTH_OK 2024-08-20T04:52:23.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:23.958 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:23.958 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:23.958 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:24.438 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-20T04:52:24.438 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config generate-minimal-conf 2024-08-20T04:52:24.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:24 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:52:24.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:24 smithi135 ceph-mon[22342]: from='client.? 172.21.15.135:0/1788894639' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T04:52:24.705 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:24 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:24.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:24 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:52:24.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:24 smithi037 ceph-mon[17265]: from='client.? 172.21.15.135:0/1788894639' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T04:52:24.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:24 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:24.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:24 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:52:24.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:24 smithi130 ceph-mon[22007]: from='client.? 172.21.15.135:0/1788894639' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-08-20T04:52:24.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:24 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:52:25.634 INFO:teuthology.orchestra.run.smithi037.stdout:# minimal ceph.conf for 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:52:25.634 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-08-20T04:52:25.634 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T04:52:25.635 INFO:teuthology.orchestra.run.smithi037.stdout: mon_host = [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-08-20T04:52:25.635 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 04:52:25 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: 2024-08-20T04:52:25.425+0000 7f4f56200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-20T04:52:25.899 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:25 smithi130 ceph-mon[22007]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:25.900 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:25 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:25.900 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:25 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:25.900 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:25 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:25.900 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:25 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:25.900 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:25 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:25.900 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:25 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:25.900 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:25 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:25.900 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:25 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:25.900 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:25 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:25.900 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:25 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:25.900 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:25 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2944757654' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:26.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:25 smithi037 ceph-mon[17265]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:25 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:25 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:25 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:25 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:25 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:25 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:25 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:25 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:25 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:25 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:25 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2944757654' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:26.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:25 smithi135 ceph-mon[22342]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:26.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:25 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:25 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:25 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:25 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:25 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:25 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:25 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:25 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:25 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:25 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:25 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2944757654' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:26.384 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-20T04:52:26.384 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T04:52:26.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.conf 2024-08-20T04:52:26.443 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T04:52:26.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-20T04:52:26.539 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-20T04:52:26.539 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.conf 2024-08-20T04:52:26.566 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-20T04:52:26.566 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-20T04:52:26.630 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-20T04:52:26.631 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.conf 2024-08-20T04:52:26.661 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-20T04:52:26.661 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-20T04:52:26.728 INFO:tasks.cephadm:Adding mgr.x on smithi037 2024-08-20T04:52:26.728 INFO:tasks.cephadm:Adding mgr.y on smithi130 2024-08-20T04:52:26.728 INFO:tasks.cephadm:Adding mgr.z on smithi135 2024-08-20T04:52:26.728 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch apply mgr '3;smithi037=x;smithi130=y;smithi135=z' 2024-08-20T04:52:26.920 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:26 smithi037 ceph-mon[17265]: Updating smithi037:/etc/ceph/ceph.conf 2024-08-20T04:52:26.920 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:26 smithi037 ceph-mon[17265]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-20T04:52:26.920 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:26 smithi037 ceph-mon[17265]: Updating smithi135:/etc/ceph/ceph.conf 2024-08-20T04:52:26.920 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:26 smithi037 ceph-mon[17265]: Updating smithi135:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:52:26.920 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:26 smithi037 ceph-mon[17265]: Updating smithi130:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:52:26.920 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:26 smithi037 ceph-mon[17265]: Updating smithi037:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:52:26.921 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:26 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.921 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:26 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.921 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:26 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.921 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:26 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.921 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:26 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.921 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:26 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.921 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:26 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.921 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:26 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T04:52:26.921 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:26 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T04:52:26.921 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:26 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:26.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:26 smithi130 ceph-mon[22007]: Updating smithi037:/etc/ceph/ceph.conf 2024-08-20T04:52:26.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:26 smithi130 ceph-mon[22007]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-20T04:52:26.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:26 smithi130 ceph-mon[22007]: Updating smithi135:/etc/ceph/ceph.conf 2024-08-20T04:52:26.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:26 smithi130 ceph-mon[22007]: Updating smithi135:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:52:26.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:26 smithi130 ceph-mon[22007]: Updating smithi130:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:52:26.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:26 smithi130 ceph-mon[22007]: Updating smithi037:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:52:26.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:26 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:26 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:26 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:26 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:26 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:26 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:26 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:26.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:26 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T04:52:26.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:26 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T04:52:26.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:26 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:27.007 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T04:52:27.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:26 smithi135 ceph-mon[22342]: Updating smithi037:/etc/ceph/ceph.conf 2024-08-20T04:52:27.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:26 smithi135 ceph-mon[22342]: Updating smithi130:/etc/ceph/ceph.conf 2024-08-20T04:52:27.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:26 smithi135 ceph-mon[22342]: Updating smithi135:/etc/ceph/ceph.conf 2024-08-20T04:52:27.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:26 smithi135 ceph-mon[22342]: Updating smithi135:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:52:27.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:26 smithi135 ceph-mon[22342]: Updating smithi130:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:52:27.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:26 smithi135 ceph-mon[22342]: Updating smithi037:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/config/ceph.conf 2024-08-20T04:52:27.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:26 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:27.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:26 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:27.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:26 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:27.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:26 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:27.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:26 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:27.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:26 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:27.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:26 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:27.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:26 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T04:52:27.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:26 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T04:52:27.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:26 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:27.636 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled mgr update... 2024-08-20T04:52:27.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:27 smithi135 ceph-mon[22342]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:27.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:27 smithi135 ceph-mon[22342]: Reconfiguring mon.a (unknown last config time)... 2024-08-20T04:52:27.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:27 smithi135 ceph-mon[22342]: Reconfiguring daemon mon.a on smithi037 2024-08-20T04:52:27.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:27 smithi130 ceph-mon[22007]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:27 smithi130 ceph-mon[22007]: Reconfiguring mon.a (unknown last config time)... 2024-08-20T04:52:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:27 smithi130 ceph-mon[22007]: Reconfiguring daemon mon.a on smithi037 2024-08-20T04:52:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:28.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:27 smithi037 ceph-mon[17265]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:28.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:27 smithi037 ceph-mon[17265]: Reconfiguring mon.a (unknown last config time)... 2024-08-20T04:52:28.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:27 smithi037 ceph-mon[17265]: Reconfiguring daemon mon.a on smithi037 2024-08-20T04:52:28.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:28.225 DEBUG:teuthology.orchestra.run.smithi130:mgr.y> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mgr.y.service 2024-08-20T04:52:28.228 DEBUG:teuthology.orchestra.run.smithi135:mgr.z> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mgr.z.service 2024-08-20T04:52:28.230 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-08-20T04:52:28.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-08-20T04:52:28.234 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-08-20T04:52:28.235 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set client debug_client 20 2024-08-20T04:52:28.281 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-08-20T04:52:28.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set client debug_ms 1 2024-08-20T04:52:28.329 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-08-20T04:52:28.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-08-20T04:52:28.376 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-08-20T04:52:28.376 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-08-20T04:52:28.425 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-08-20T04:52:28.426 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set mds debug_mds 20 2024-08-20T04:52:28.472 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-08-20T04:52:28.472 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-08-20T04:52:28.524 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-08-20T04:52:28.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set mds debug_ms 2 2024-08-20T04:52:28.578 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-08-20T04:52:28.578 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-08-20T04:52:28.630 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-08-20T04:52:28.630 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-08-20T04:52:28.684 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-08-20T04:52:28.685 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-08-20T04:52:28.740 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-08-20T04:52:28.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-08-20T04:52:28.807 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-08-20T04:52:28.807 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-08-20T04:52:28.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:28 smithi037 ceph-mon[17265]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi130=y;smithi135=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:52:28.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:28 smithi037 ceph-mon[17265]: Saving service mgr spec with placement smithi037=x;smithi130=y;smithi135=z;count:3 2024-08-20T04:52:28.816 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:28.817 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:28.817 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T04:52:28.817 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T04:52:28.817 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:28.817 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:28.833 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-08-20T04:52:28.833 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-08-20T04:52:28.882 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-08-20T04:52:28.882 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-08-20T04:52:28.937 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-08-20T04:52:28.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-08-20T04:52:28.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:28 smithi130 ceph-mon[22007]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi130=y;smithi135=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:52:28.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:28 smithi130 ceph-mon[22007]: Saving service mgr spec with placement smithi037=x;smithi130=y;smithi135=z;count:3 2024-08-20T04:52:28.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:28.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:28.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T04:52:28.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T04:52:28.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:28.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:28.997 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-08-20T04:52:28.997 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-08-20T04:52:29.053 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-08-20T04:52:29.053 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-08-20T04:52:29.108 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-08-20T04:52:29.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-08-20T04:52:29.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:28 smithi135 ceph-mon[22342]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi037=x;smithi130=y;smithi135=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:52:29.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:28 smithi135 ceph-mon[22342]: Saving service mgr spec with placement smithi037=x;smithi130=y;smithi135=z;count:3 2024-08-20T04:52:29.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:29.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:29.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T04:52:29.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T04:52:29.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:29.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:29.166 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-08-20T04:52:29.166 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-08-20T04:52:29.220 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-08-20T04:52:29.221 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-08-20T04:52:29.271 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-08-20T04:52:29.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-08-20T04:52:29.323 DEBUG:tasks.cephadm:set 22 configs 2024-08-20T04:52:29.323 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi037') 2024-08-20T04:52:29.672 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:29 smithi037 ceph-mon[17265]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:29.672 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:29 smithi037 ceph-mon[17265]: Reconfiguring mgr.x (unknown last config time)... 2024-08-20T04:52:29.672 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:29 smithi037 ceph-mon[17265]: Reconfiguring daemon mgr.x on smithi037 2024-08-20T04:52:29.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:29 smithi130 ceph-mon[22007]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:29.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:29 smithi130 ceph-mon[22007]: Reconfiguring mgr.x (unknown last config time)... 2024-08-20T04:52:29.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:29 smithi130 ceph-mon[22007]: Reconfiguring daemon mgr.x on smithi037 2024-08-20T04:52:30.006 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:30.109 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:30.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:29 smithi135 ceph-mon[22342]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:30.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:29 smithi135 ceph-mon[22342]: Reconfiguring mgr.x (unknown last config time)... 2024-08-20T04:52:30.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:29 smithi135 ceph-mon[22342]: Reconfiguring daemon mgr.x on smithi037 2024-08-20T04:52:30.231 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.225+0000 7fa653e00640 1 -- 172.21.15.37:0/336087963 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa63403ed60 msgr2=0x7fa634041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.225+0000 7fa653e00640 1 --2- 172.21.15.37:0/336087963 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa63403ed60 0x7fa634041220 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa638009bd0 tx=0x7fa638005f90 comp rx=0 tx=0).stop 2024-08-20T04:52:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.225+0000 7fa653e00640 1 -- 172.21.15.37:0/336087963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa64c077740 msgr2=0x7fa64c19e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.225+0000 7fa653e00640 1 --2- 172.21.15.37:0/336087963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa64c077740 0x7fa64c19e520 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa640004770 tx=0x7fa640005000 comp rx=0 tx=0).stop 2024-08-20T04:52:31.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.228+0000 7fa653e00640 1 -- 172.21.15.37:0/336087963 shutdown_connections 2024-08-20T04:52:31.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.228+0000 7fa653e00640 1 --2- 172.21.15.37:0/336087963 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa63403ed60 0x7fa634041220 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:31.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.228+0000 7fa653e00640 1 --2- 172.21.15.37:0/336087963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa64c079260 0x7fa64c19f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:31.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.228+0000 7fa653e00640 1 --2- 172.21.15.37:0/336087963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa64c0788a0 0x7fa64c19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:31.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.228+0000 7fa653e00640 1 --2- 172.21.15.37:0/336087963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa64c077740 0x7fa64c19e520 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:31.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.228+0000 7fa653e00640 1 -- 172.21.15.37:0/336087963 >> 172.21.15.37:0/336087963 conn(0x7fa64c100210 msgr2=0x7fa64c102560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:31.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.228+0000 7fa653e00640 1 -- 172.21.15.37:0/336087963 shutdown_connections 2024-08-20T04:52:31.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.228+0000 7fa653e00640 1 -- 172.21.15.37:0/336087963 wait complete. 2024-08-20T04:52:31.235 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:31.236 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:31.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.264+0000 7f558f400640 1 -- 172.21.15.37:0/2981672616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f558810a840 msgr2=0x7f5588119dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:31.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.265+0000 7f558f400640 1 --2- 172.21.15.37:0/2981672616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f558810a840 0x7f5588119dc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5580009ca0 tx=0x7f558002a8f0 comp rx=0 tx=0).stop 2024-08-20T04:52:31.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.265+0000 7f558f400640 1 -- 172.21.15.37:0/2981672616 shutdown_connections 2024-08-20T04:52:31.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.265+0000 7f558f400640 1 --2- 172.21.15.37:0/2981672616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f558810a840 0x7f5588119dc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:31.268 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:31.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.267+0000 7f558f400640 1 --2- 172.21.15.37:0/2981672616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5588109e80 0x7f558810a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:31.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.267+0000 7f558f400640 1 --2- 172.21.15.37:0/2981672616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5588074060 0x7f5588074460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:31.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.267+0000 7f558f400640 1 -- 172.21.15.37:0/2981672616 >> 172.21.15.37:0/2981672616 conn(0x7f558806f9b0 msgr2=0x7f5588071df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:31.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.269+0000 7f558f400640 1 -- 172.21.15.37:0/2981672616 shutdown_connections 2024-08-20T04:52:31.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.269+0000 7f558f400640 1 -- 172.21.15.37:0/2981672616 wait complete. 2024-08-20T04:52:31.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.270+0000 7f558f400640 1 Processor -- start 2024-08-20T04:52:31.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.271+0000 7f558f400640 1 -- start start 2024-08-20T04:52:31.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.273+0000 7f558f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5588074060 0x7f5588116100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:31.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.273+0000 7f558f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5588109e80 0x7f5588116750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:31.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.273+0000 7f558f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f558810a840 0x7f5588117390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:31.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.274+0000 7f5587e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5588109e80 0x7f5588116750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:31.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.274+0000 7f5587e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5588109e80 0x7f5588116750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:39766/0 (socket says 172.21.15.37:39766) 2024-08-20T04:52:31.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.274+0000 7f558ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5588074060 0x7f5588116100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:31.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.274+0000 7f558ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5588074060 0x7f5588116100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44288/0 (socket says 172.21.15.37:44288) 2024-08-20T04:52:31.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.275+0000 7f558d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f558810a840 0x7f5588117390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:31.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.275+0000 7f558d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f558810a840 0x7f5588117390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43642/0 (socket says 172.21.15.37:43642) 2024-08-20T04:52:31.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.275+0000 7f5587e00640 1 -- 172.21.15.37:0/770319034 learned_addr learned my addr 172.21.15.37:0/770319034 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:31.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.275+0000 7f558f400640 1 -- 172.21.15.37:0/770319034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f558811c4e0 con 0x7f5588074060 2024-08-20T04:52:31.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.276+0000 7f558f400640 1 -- 172.21.15.37:0/770319034 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f558811c360 con 0x7f558810a840 2024-08-20T04:52:31.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.276+0000 7f558f400640 1 -- 172.21.15.37:0/770319034 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f558811c660 con 0x7f5588109e80 2024-08-20T04:52:31.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.277+0000 7f5587e00640 1 -- 172.21.15.37:0/770319034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f558810a840 msgr2=0x7f5588117390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:31.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.277+0000 7f5587e00640 1 --2- 172.21.15.37:0/770319034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f558810a840 0x7f5588117390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:31.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.277+0000 7f5587e00640 1 -- 172.21.15.37:0/770319034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5588074060 msgr2=0x7f5588116100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:31.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.278+0000 7f5587e00640 1 --2- 172.21.15.37:0/770319034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5588074060 0x7f5588116100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:31.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.278+0000 7f5587e00640 1 -- 172.21.15.37:0/770319034 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5588117c30 con 0x7f5588109e80 2024-08-20T04:52:31.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.278+0000 7f558ca00640 1 --2- 172.21.15.37:0/770319034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5588074060 0x7f5588116100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T04:52:31.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.278+0000 7f5587e00640 1 --2- 172.21.15.37:0/770319034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5588109e80 0x7f5588116750 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f557c00c920 tx=0x7f557c00cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:31.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.279+0000 7f5585600640 1 -- 172.21.15.37:0/770319034 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c007c70 con 0x7f5588109e80 2024-08-20T04:52:31.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.279+0000 7f5585600640 1 -- 172.21.15.37:0/770319034 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(22 keys) ==== 983+0+0 (secure 0 0 0) 0x7f557c007e10 con 0x7f5588109e80 2024-08-20T04:52:31.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.279+0000 7f5585600640 1 -- 172.21.15.37:0/770319034 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f557c018660 con 0x7f5588109e80 2024-08-20T04:52:31.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.280+0000 7f558f400640 1 -- 172.21.15.37:0/770319034 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5588117f20 con 0x7f5588109e80 2024-08-20T04:52:31.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.280+0000 7f558f400640 1 -- 172.21.15.37:0/770319034 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55881185d0 con 0x7f5588109e80 2024-08-20T04:52:31.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.283+0000 7f5585600640 1 -- 172.21.15.37:0/770319034 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7f557c005020 con 0x7f5588109e80 2024-08-20T04:52:31.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.284+0000 7f558f400640 1 -- 172.21.15.37:0/770319034 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f558810a300 con 0x7f5588109e80 2024-08-20T04:52:31.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.284+0000 7f5585600640 1 --2- 172.21.15.37:0/770319034 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f557003eda0 0x7f5570041260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:31.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.286+0000 7f558ca00640 1 --2- 172.21.15.37:0/770319034 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f557003eda0 0x7f5570041260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:31.299 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:31.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.286+0000 7f5585600640 1 -- 172.21.15.37:0/770319034 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f557c053870 con 0x7f5588109e80 2024-08-20T04:52:31.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.287+0000 7f558ca00640 1 --2- 172.21.15.37:0/770319034 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f557003eda0 0x7f5570041260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f557400abe0 tx=0x7f557400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:31.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.291+0000 7f5585600640 1 -- 172.21.15.37:0/770319034 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f557c014030 con 0x7f5588109e80 2024-08-20T04:52:31.300 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:31.300 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:31.335 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:31.349 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:31.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:31 smithi037 ceph-mon[17265]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:31.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:31 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:31.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:31 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:31.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:31 smithi037 ceph-mon[17265]: Reconfiguring mon.b (monmap changed)... 2024-08-20T04:52:31.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:31 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T04:52:31.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:31 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T04:52:31.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:31 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:31.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:31 smithi037 ceph-mon[17265]: Reconfiguring daemon mon.b on smithi130 2024-08-20T04:52:31.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:31 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/336087963' entity='client.admin' 2024-08-20T04:52:31.542 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:31.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.587+0000 7f558f400640 1 -- 172.21.15.37:0/770319034 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f558810f410 con 0x7f5588109e80 2024-08-20T04:52:31.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.592+0000 7f5585600640 1 -- 172.21.15.37:0/770319034 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v11)=0 v11) ==== 116+0+0 (secure 0 0 0) 0x7f557c00ecb0 con 0x7f5588109e80 2024-08-20T04:52:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.594+0000 7f558f400640 1 -- 172.21.15.37:0/770319034 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f557003eda0 msgr2=0x7f5570041260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.594+0000 7f558f400640 1 --2- 172.21.15.37:0/770319034 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f557003eda0 0x7f5570041260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f557400abe0 tx=0x7f557400a5c0 comp rx=0 tx=0).stop 2024-08-20T04:52:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.594+0000 7f558f400640 1 -- 172.21.15.37:0/770319034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5588109e80 msgr2=0x7f5588116750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.594+0000 7f558f400640 1 --2- 172.21.15.37:0/770319034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5588109e80 0x7f5588116750 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f557c00c920 tx=0x7f557c00cde0 comp rx=0 tx=0).stop 2024-08-20T04:52:31.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.594+0000 7f558f400640 1 -- 172.21.15.37:0/770319034 shutdown_connections 2024-08-20T04:52:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.594+0000 7f558f400640 1 --2- 172.21.15.37:0/770319034 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f557003eda0 0x7f5570041260 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.594+0000 7f558f400640 1 --2- 172.21.15.37:0/770319034 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f558810a840 0x7f5588117390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.594+0000 7f558f400640 1 --2- 172.21.15.37:0/770319034 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5588109e80 0x7f5588116750 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.594+0000 7f558f400640 1 --2- 172.21.15.37:0/770319034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5588074060 0x7f5588116100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.594+0000 7f558f400640 1 -- 172.21.15.37:0/770319034 >> 172.21.15.37:0/770319034 conn(0x7f558806f9b0 msgr2=0x7f5588071a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.594+0000 7f558f400640 1 -- 172.21.15.37:0/770319034 shutdown_connections 2024-08-20T04:52:31.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:31.594+0000 7f558f400640 1 -- 172.21.15.37:0/770319034 wait complete. 2024-08-20T04:52:31.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:31 smithi135 ceph-mon[22342]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:31.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:31 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:31.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:31 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:31.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:31 smithi135 ceph-mon[22342]: Reconfiguring mon.b (monmap changed)... 2024-08-20T04:52:31.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:31 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T04:52:31.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:31 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T04:52:31.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:31 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:31.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:31 smithi135 ceph-mon[22342]: Reconfiguring daemon mon.b on smithi130 2024-08-20T04:52:31.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:31 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/336087963' entity='client.admin' 2024-08-20T04:52:31.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:31 smithi130 ceph-mon[22007]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:31.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:31 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:31.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:31 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:31.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:31 smithi130 ceph-mon[22007]: Reconfiguring mon.b (monmap changed)... 2024-08-20T04:52:31.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:31 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T04:52:31.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:31 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T04:52:31.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:31 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:31.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:31 smithi130 ceph-mon[22007]: Reconfiguring daemon mon.b on smithi130 2024-08-20T04:52:31.637 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:31 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/336087963' entity='client.admin' 2024-08-20T04:52:32.125 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:32.126 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:32.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.335+0000 7f1f27000640 1 -- 172.21.15.37:0/957110580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f201062b0 msgr2=0x7f1f2010cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:32.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.335+0000 7f1f27000640 1 --2- 172.21.15.37:0/957110580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f201062b0 0x7f1f2010cc30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009d00 tx=0x7f1f1802a910 comp rx=0 tx=0).stop 2024-08-20T04:52:32.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.336+0000 7f1f27000640 1 -- 172.21.15.37:0/957110580 shutdown_connections 2024-08-20T04:52:32.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.336+0000 7f1f27000640 1 --2- 172.21.15.37:0/957110580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f201062b0 0x7f1f2010cc30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:32.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.336+0000 7f1f27000640 1 --2- 172.21.15.37:0/957110580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f201058f0 0x7f1f20105d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:32.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.336+0000 7f1f27000640 1 --2- 172.21.15.37:0/957110580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f20104790 0x7f1f20104b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:32.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.336+0000 7f1f27000640 1 -- 172.21.15.37:0/957110580 >> 172.21.15.37:0/957110580 conn(0x7f1f201000a0 msgr2=0x7f1f201024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:32.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.336+0000 7f1f27000640 1 -- 172.21.15.37:0/957110580 shutdown_connections 2024-08-20T04:52:32.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.336+0000 7f1f27000640 1 -- 172.21.15.37:0/957110580 wait complete. 2024-08-20T04:52:32.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.337+0000 7f1f27000640 1 Processor -- start 2024-08-20T04:52:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.337+0000 7f1f27000640 1 -- start start 2024-08-20T04:52:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.337+0000 7f1f27000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f20104790 0x7f1f20199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.337+0000 7f1f27000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f201058f0 0x7f1f2019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.337+0000 7f1f27000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f201062b0 0x7f1f2019b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.337+0000 7f1f27000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2010f790 con 0x7f1f201058f0 2024-08-20T04:52:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.337+0000 7f1f27000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2010f610 con 0x7f1f201062b0 2024-08-20T04:52:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.337+0000 7f1f27000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1f2010f910 con 0x7f1f20104790 2024-08-20T04:52:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.338+0000 7f1f25c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f20104790 0x7f1f20199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.338+0000 7f1f26600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f201062b0 0x7f1f2019b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.338+0000 7f1f26600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f201062b0 0x7f1f2019b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43666/0 (socket says 172.21.15.37:43666) 2024-08-20T04:52:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.338+0000 7f1f26600640 1 -- 172.21.15.37:0/2956499214 learned_addr learned my addr 172.21.15.37:0/2956499214 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.338+0000 7f1f25c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f20104790 0x7f1f20199eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:39776/0 (socket says 172.21.15.37:39776) 2024-08-20T04:52:32.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.338+0000 7f1f25200640 1 --2- 172.21.15.37:0/2956499214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f201058f0 0x7f1f2019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:32.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.338+0000 7f1f26600640 1 -- 172.21.15.37:0/2956499214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f20104790 msgr2=0x7f1f20199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.338+0000 7f1f26600640 1 --2- 172.21.15.37:0/2956499214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f20104790 0x7f1f20199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.338+0000 7f1f26600640 1 -- 172.21.15.37:0/2956499214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f201058f0 msgr2=0x7f1f2019a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.338+0000 7f1f26600640 1 --2- 172.21.15.37:0/2956499214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f201058f0 0x7f1f2019a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.338+0000 7f1f26600640 1 -- 172.21.15.37:0/2956499214 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f2019b9e0 con 0x7f1f201062b0 2024-08-20T04:52:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.338+0000 7f1f25200640 1 --2- 172.21.15.37:0/2956499214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f201058f0 0x7f1f2019a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:52:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.339+0000 7f1f26600640 1 --2- 172.21.15.37:0/2956499214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f201062b0 0x7f1f2019b140 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1f18030830 tx=0x7f1f18030860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.339+0000 7f1f1e000640 1 -- 172.21.15.37:0/2956499214 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18030e90 con 0x7f1f201062b0 2024-08-20T04:52:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.339+0000 7f1f1e000640 1 -- 172.21.15.37:0/2956499214 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(22 keys) ==== 983+0+0 (secure 0 0 0) 0x7f1f1803a840 con 0x7f1f201062b0 2024-08-20T04:52:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.339+0000 7f1f1e000640 1 -- 172.21.15.37:0/2956499214 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1803b620 con 0x7f1f201062b0 2024-08-20T04:52:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.339+0000 7f1f27000640 1 -- 172.21.15.37:0/2956499214 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f2019bc70 con 0x7f1f201062b0 2024-08-20T04:52:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.339+0000 7f1f27000640 1 -- 172.21.15.37:0/2956499214 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f201a23b0 con 0x7f1f201062b0 2024-08-20T04:52:32.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.340+0000 7f1f27000640 1 -- 172.21.15.37:0/2956499214 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f2010ff50 con 0x7f1f201062b0 2024-08-20T04:52:32.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.340+0000 7f1f1e000640 1 -- 172.21.15.37:0/2956499214 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7f1f1803a400 con 0x7f1f201062b0 2024-08-20T04:52:32.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.341+0000 7f1f1e000640 1 --2- 172.21.15.37:0/2956499214 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1f0803ee10 0x7f1f080412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:32.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.341+0000 7f1f1e000640 1 -- 172.21.15.37:0/2956499214 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f1f180746c0 con 0x7f1f201062b0 2024-08-20T04:52:32.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.341+0000 7f1f25c00640 1 --2- 172.21.15.37:0/2956499214 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1f0803ee10 0x7f1f080412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:32.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.342+0000 7f1f25c00640 1 --2- 172.21.15.37:0/2956499214 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1f0803ee10 0x7f1f080412d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009bd0 tx=0x7f1f14005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.346+0000 7f1f1e000640 1 -- 172.21.15.37:0/2956499214 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f1f1802e280 con 0x7f1f201062b0 2024-08-20T04:52:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.544+0000 7f1f27000640 1 -- 172.21.15.37:0/2956499214 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f1f2002e600 con 0x7f1f201062b0 2024-08-20T04:52:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.550+0000 7f1f1e000640 1 -- 172.21.15.37:0/2956499214 <== mon.2 v2:172.21.15.130:3300/0 7 ==== config(23 keys) ==== 1014+0+0 (secure 0 0 0) 0x7f1f18036030 con 0x7f1f201062b0 2024-08-20T04:52:32.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.550+0000 7f1f1e000640 1 -- 172.21.15.37:0/2956499214 <== mon.2 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f1f1804adf0 con 0x7f1f201062b0 2024-08-20T04:52:32.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.553+0000 7f1f27000640 1 -- 172.21.15.37:0/2956499214 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1f0803ee10 msgr2=0x7f1f080412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:32.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.553+0000 7f1f27000640 1 --2- 172.21.15.37:0/2956499214 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1f0803ee10 0x7f1f080412d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009bd0 tx=0x7f1f14005f90 comp rx=0 tx=0).stop 2024-08-20T04:52:32.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.553+0000 7f1f27000640 1 -- 172.21.15.37:0/2956499214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f201062b0 msgr2=0x7f1f2019b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:32.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.553+0000 7f1f27000640 1 --2- 172.21.15.37:0/2956499214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f201062b0 0x7f1f2019b140 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1f18030830 tx=0x7f1f18030860 comp rx=0 tx=0).stop 2024-08-20T04:52:32.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.553+0000 7f1f27000640 1 -- 172.21.15.37:0/2956499214 shutdown_connections 2024-08-20T04:52:32.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.553+0000 7f1f27000640 1 --2- 172.21.15.37:0/2956499214 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1f0803ee10 0x7f1f080412d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:32.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.553+0000 7f1f27000640 1 --2- 172.21.15.37:0/2956499214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f201062b0 0x7f1f2019b140 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:32.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.553+0000 7f1f27000640 1 --2- 172.21.15.37:0/2956499214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f201058f0 0x7f1f2019a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:32.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.553+0000 7f1f27000640 1 --2- 172.21.15.37:0/2956499214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f20104790 0x7f1f20199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:32.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.553+0000 7f1f27000640 1 -- 172.21.15.37:0/2956499214 >> 172.21.15.37:0/2956499214 conn(0x7f1f201000a0 msgr2=0x7f1f20101be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:32.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.553+0000 7f1f27000640 1 -- 172.21.15.37:0/2956499214 shutdown_connections 2024-08-20T04:52:32.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:32.553+0000 7f1f27000640 1 -- 172.21.15.37:0/2956499214 wait complete. 2024-08-20T04:52:32.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:32 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' 2024-08-20T04:52:32.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:32.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:32.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T04:52:32.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T04:52:32.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:32.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:32 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' 2024-08-20T04:52:32.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:32 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' 2024-08-20T04:52:32.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:32.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:32.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T04:52:32.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T04:52:32.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:32.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:32 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' 2024-08-20T04:52:32.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:32 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' 2024-08-20T04:52:32.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:32.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:32.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-08-20T04:52:32.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-08-20T04:52:32.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:32.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:32 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' 2024-08-20T04:52:33.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:33 smithi037 ceph-mon[17265]: Reconfiguring mon.c (monmap changed)... 2024-08-20T04:52:33.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:33 smithi037 ceph-mon[17265]: Reconfiguring daemon mon.c on smithi135 2024-08-20T04:52:33.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:33 smithi037 ceph-mon[17265]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:33.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:33.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:33.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:52:33.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:33 smithi135 ceph-mon[22342]: Reconfiguring mon.c (monmap changed)... 2024-08-20T04:52:33.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:33 smithi135 ceph-mon[22342]: Reconfiguring daemon mon.c on smithi135 2024-08-20T04:52:33.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:33 smithi135 ceph-mon[22342]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:33.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:33.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:33.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:52:33.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:33 smithi130 ceph-mon[22007]: Reconfiguring mon.c (monmap changed)... 2024-08-20T04:52:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:33 smithi130 ceph-mon[22007]: Reconfiguring daemon mon.c on smithi135 2024-08-20T04:52:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:33 smithi130 ceph-mon[22007]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:52:34.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:34.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:34.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:34.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T04:52:34.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T04:52:34.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T04:52:34.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:34.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:34 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' 2024-08-20T04:52:34.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:34 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' 2024-08-20T04:52:34.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:34.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T04:52:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T04:52:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T04:52:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:34 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' 2024-08-20T04:52:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:34 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' 2024-08-20T04:52:34.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.508+0000 7f88cb000640 1 -- 172.21.15.37:0/4084821636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88c4079260 msgr2=0x7f88c4079bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:34.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.508+0000 7f88cb000640 1 --2- 172.21.15.37:0/4084821636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88c4079260 0x7f88c4079bb0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f88bc009be0 tx=0x7f88bc02a6c0 comp rx=0 tx=0).stop 2024-08-20T04:52:34.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.508+0000 7f88cb000640 1 -- 172.21.15.37:0/4084821636 shutdown_connections 2024-08-20T04:52:34.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.508+0000 7f88cb000640 1 --2- 172.21.15.37:0/4084821636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88c4079260 0x7f88c4079bb0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:34.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.508+0000 7f88cb000640 1 --2- 172.21.15.37:0/4084821636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c40788a0 0x7f88c4078d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:34.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.508+0000 7f88cb000640 1 --2- 172.21.15.37:0/4084821636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88c4077740 0x7f88c4077b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:34.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.508+0000 7f88cb000640 1 -- 172.21.15.37:0/4084821636 >> 172.21.15.37:0/4084821636 conn(0x7f88c4100210 msgr2=0x7f88c4102650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:34.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.508+0000 7f88cb000640 1 -- 172.21.15.37:0/4084821636 shutdown_connections 2024-08-20T04:52:34.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.508+0000 7f88cb000640 1 -- 172.21.15.37:0/4084821636 wait complete. 2024-08-20T04:52:34.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.509+0000 7f88cb000640 1 Processor -- start 2024-08-20T04:52:34.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.509+0000 7f88cb000640 1 -- start start 2024-08-20T04:52:34.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.510+0000 7f88cb000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88c4077740 0x7f88c419eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:34.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.510+0000 7f88cb000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88c40788a0 0x7f88c419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:34.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.510+0000 7f88cb000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c4079260 0x7f88c41a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:34.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.510+0000 7f88cb000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f88c4114750 con 0x7f88c4079260 2024-08-20T04:52:34.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.510+0000 7f88cb000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f88c41145d0 con 0x7f88c40788a0 2024-08-20T04:52:34.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.510+0000 7f88cb000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f88c41148d0 con 0x7f88c4077740 2024-08-20T04:52:34.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.510+0000 7f88c3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88c4077740 0x7f88c419eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:34.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.510+0000 7f88c3400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88c40788a0 0x7f88c419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:34.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.510+0000 7f88c3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88c4077740 0x7f88c419eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:48670/0 (socket says 172.21.15.37:48670) 2024-08-20T04:52:34.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.510+0000 7f88c3e00640 1 -- 172.21.15.37:0/669497093 learned_addr learned my addr 172.21.15.37:0/669497093 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:34.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.510+0000 7f88c9000640 1 --2- 172.21.15.37:0/669497093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c4079260 0x7f88c41a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:34.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.510+0000 7f88c3e00640 1 -- 172.21.15.37:0/669497093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88c40788a0 msgr2=0x7f88c419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:34.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.510+0000 7f88c3e00640 1 --2- 172.21.15.37:0/669497093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88c40788a0 0x7f88c419f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:34.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.510+0000 7f88c3e00640 1 -- 172.21.15.37:0/669497093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c4079260 msgr2=0x7f88c41a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.510+0000 7f88c3e00640 1 --2- 172.21.15.37:0/669497093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c4079260 0x7f88c41a0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.510+0000 7f88c3e00640 1 -- 172.21.15.37:0/669497093 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88c41a09d0 con 0x7f88c4077740 2024-08-20T04:52:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.511+0000 7f88c3e00640 1 --2- 172.21.15.37:0/669497093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88c4077740 0x7f88c419eea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f88b400e9f0 tx=0x7f88b400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.511+0000 7f88c0c00640 1 -- 172.21.15.37:0/669497093 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b400ccc0 con 0x7f88c4077740 2024-08-20T04:52:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.511+0000 7f88cb000640 1 -- 172.21.15.37:0/669497093 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88c41a0cc0 con 0x7f88c4077740 2024-08-20T04:52:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.511+0000 7f88c0c00640 1 -- 172.21.15.37:0/669497093 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f88b40108a0 con 0x7f88c4077740 2024-08-20T04:52:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.511+0000 7f88c0c00640 1 -- 172.21.15.37:0/669497093 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b4018680 con 0x7f88c4077740 2024-08-20T04:52:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.511+0000 7f88cb000640 1 -- 172.21.15.37:0/669497093 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88c41a73a0 con 0x7f88c4077740 2024-08-20T04:52:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.512+0000 7f88cb000640 1 -- 172.21.15.37:0/669497093 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88c4078d20 con 0x7f88c4077740 2024-08-20T04:52:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.513+0000 7f88c0c00640 1 -- 172.21.15.37:0/669497093 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7f88b4010430 con 0x7f88c4077740 2024-08-20T04:52:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.513+0000 7f88c0c00640 1 --2- 172.21.15.37:0/669497093 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f88a803ed60 0x7f88a8041220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:34.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.514+0000 7f88c0c00640 1 -- 172.21.15.37:0/669497093 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f88b40536e0 con 0x7f88c4077740 2024-08-20T04:52:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.514+0000 7f88c3400640 1 --2- 172.21.15.37:0/669497093 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f88a803ed60 0x7f88a8041220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.514+0000 7f88c3400640 1 --2- 172.21.15.37:0/669497093 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f88a803ed60 0x7f88a8041220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f88b0005fd0 tx=0x7f88b0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.518+0000 7f88c0c00640 1 -- 172.21.15.37:0/669497093 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f88b4010cc0 con 0x7f88c4077740 2024-08-20T04:52:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.688+0000 7f88c0c00640 1 -- 172.21.15.37:0/669497093 <== mon.1 v2:172.21.15.135:3300/0 7 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f88b40168f0 con 0x7f88c4077740 2024-08-20T04:52:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.770+0000 7f88cb000640 1 -- 172.21.15.37:0/669497093 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f88c4111400 con 0x7f88c4077740 2024-08-20T04:52:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.776+0000 7f88c0c00640 1 -- 172.21.15.37:0/669497093 <== mon.1 v2:172.21.15.135:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f88b4013dc0 con 0x7f88c4077740 2024-08-20T04:52:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.779+0000 7f88cb000640 1 -- 172.21.15.37:0/669497093 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f88a803ed60 msgr2=0x7f88a8041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.779+0000 7f88cb000640 1 --2- 172.21.15.37:0/669497093 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f88a803ed60 0x7f88a8041220 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f88b0005fd0 tx=0x7f88b0009260 comp rx=0 tx=0).stop 2024-08-20T04:52:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.779+0000 7f88cb000640 1 -- 172.21.15.37:0/669497093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88c4077740 msgr2=0x7f88c419eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.779+0000 7f88cb000640 1 --2- 172.21.15.37:0/669497093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88c4077740 0x7f88c419eea0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f88b400e9f0 tx=0x7f88b400edf0 comp rx=0 tx=0).stop 2024-08-20T04:52:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.779+0000 7f88cb000640 1 -- 172.21.15.37:0/669497093 shutdown_connections 2024-08-20T04:52:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.779+0000 7f88cb000640 1 --2- 172.21.15.37:0/669497093 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f88a803ed60 0x7f88a8041220 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:34.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.779+0000 7f88cb000640 1 --2- 172.21.15.37:0/669497093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c4079260 0x7f88c41a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:34.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.779+0000 7f88cb000640 1 --2- 172.21.15.37:0/669497093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f88c40788a0 0x7f88c419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:34.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.779+0000 7f88cb000640 1 --2- 172.21.15.37:0/669497093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88c4077740 0x7f88c419eea0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:34.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.779+0000 7f88cb000640 1 -- 172.21.15.37:0/669497093 >> 172.21.15.37:0/669497093 conn(0x7f88c4100210 msgr2=0x7f88c4101e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:34.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.779+0000 7f88cb000640 1 -- 172.21.15.37:0/669497093 shutdown_connections 2024-08-20T04:52:34.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.779+0000 7f88cb000640 1 -- 172.21.15.37:0/669497093 wait complete. 2024-08-20T04:52:34.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:34.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:34.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:34.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T04:52:34.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T04:52:34.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T04:52:34.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:34.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:34 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' 2024-08-20T04:52:34.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:34 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' 2024-08-20T04:52:35.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.329+0000 7f72eca00640 1 -- 172.21.15.37:0/4200048716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e8102590 msgr2=0x7f72e8102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:35.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.329+0000 7f72eca00640 1 --2- 172.21.15.37:0/4200048716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e8102590 0x7f72e8102990 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009930 tx=0x7f72d802a420 comp rx=0 tx=0).stop 2024-08-20T04:52:35.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.329+0000 7f72eca00640 1 -- 172.21.15.37:0/4200048716 shutdown_connections 2024-08-20T04:52:35.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.329+0000 7f72eca00640 1 --2- 172.21.15.37:0/4200048716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e81040b0 0x7f72e810aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:35.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.329+0000 7f72eca00640 1 --2- 172.21.15.37:0/4200048716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e81036f0 0x7f72e8103b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:35.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.329+0000 7f72eca00640 1 --2- 172.21.15.37:0/4200048716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e8102590 0x7f72e8102990 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:35.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.329+0000 7f72eca00640 1 -- 172.21.15.37:0/4200048716 >> 172.21.15.37:0/4200048716 conn(0x7f72e80fde80 msgr2=0x7f72e81002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:35.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.329+0000 7f72eca00640 1 -- 172.21.15.37:0/4200048716 shutdown_connections 2024-08-20T04:52:35.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.329+0000 7f72eca00640 1 -- 172.21.15.37:0/4200048716 wait complete. 2024-08-20T04:52:35.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.330+0000 7f72eca00640 1 Processor -- start 2024-08-20T04:52:35.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.330+0000 7f72eca00640 1 -- start start 2024-08-20T04:52:35.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72eca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e8102590 0x7f72e819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:35.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72eca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e81036f0 0x7f72e819aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:35.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72eca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e81040b0 0x7f72e819bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:35.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72eca00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f72e810e100 con 0x7f72e81036f0 2024-08-20T04:52:35.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72eca00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f72e810df80 con 0x7f72e81040b0 2024-08-20T04:52:35.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72eca00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f72e810e280 con 0x7f72e8102590 2024-08-20T04:52:35.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72e6800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e8102590 0x7f72e819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:35.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72e5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e81036f0 0x7f72e819aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:35.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72e6800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e8102590 0x7f72e819a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:48702/0 (socket says 172.21.15.37:48702) 2024-08-20T04:52:35.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72e6800640 1 -- 172.21.15.37:0/45525884 learned_addr learned my addr 172.21.15.37:0/45525884 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:35.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72e7200640 1 --2- 172.21.15.37:0/45525884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e81040b0 0x7f72e819bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:35.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72e6800640 1 -- 172.21.15.37:0/45525884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e81040b0 msgr2=0x7f72e819bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:35.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72e6800640 1 --2- 172.21.15.37:0/45525884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e81040b0 0x7f72e819bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:35.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72e6800640 1 -- 172.21.15.37:0/45525884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e81036f0 msgr2=0x7f72e819aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:35.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72e6800640 1 --2- 172.21.15.37:0/45525884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e81036f0 0x7f72e819aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:35.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72e6800640 1 -- 172.21.15.37:0/45525884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e819c4d0 con 0x7f72e8102590 2024-08-20T04:52:35.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72e7200640 1 --2- 172.21.15.37:0/45525884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e81040b0 0x7f72e819bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T04:52:35.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.331+0000 7f72e5e00640 1 --2- 172.21.15.37:0/45525884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e81036f0 0x7f72e819aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:52:35.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.332+0000 7f72e6800640 1 --2- 172.21.15.37:0/45525884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e8102590 0x7f72e819a9a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f72d8005ab0 tx=0x7f72d8003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:35.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.332+0000 7f72df400640 1 -- 172.21.15.37:0/45525884 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d803f070 con 0x7f72e8102590 2024-08-20T04:52:35.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.332+0000 7f72df400640 1 -- 172.21.15.37:0/45525884 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f72d8031b10 con 0x7f72e8102590 2024-08-20T04:52:35.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.332+0000 7f72df400640 1 -- 172.21.15.37:0/45525884 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d8035030 con 0x7f72e8102590 2024-08-20T04:52:35.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.332+0000 7f72eca00640 1 -- 172.21.15.37:0/45525884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e819c760 con 0x7f72e8102590 2024-08-20T04:52:35.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.332+0000 7f72eca00640 1 -- 172.21.15.37:0/45525884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e81a2ea0 con 0x7f72e8102590 2024-08-20T04:52:35.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.333+0000 7f72df400640 1 -- 172.21.15.37:0/45525884 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7f72d8042070 con 0x7f72e8102590 2024-08-20T04:52:35.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.333+0000 7f72eca00640 1 -- 172.21.15.37:0/45525884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72e8102990 con 0x7f72e8102590 2024-08-20T04:52:35.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.334+0000 7f72df400640 1 --2- 172.21.15.37:0/45525884 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72cc03ee10 0x7f72cc0412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:35.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.334+0000 7f72df400640 1 -- 172.21.15.37:0/45525884 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f72d8073af0 con 0x7f72e8102590 2024-08-20T04:52:35.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.334+0000 7f72e5e00640 1 --2- 172.21.15.37:0/45525884 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72cc03ee10 0x7f72cc0412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:35.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.335+0000 7f72e5e00640 1 --2- 172.21.15.37:0/45525884 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72cc03ee10 0x7f72cc0412d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f72d4009fc0 tx=0x7f72d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:35.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.338+0000 7f72df400640 1 -- 172.21.15.37:0/45525884 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f72d8039e20 con 0x7f72e8102590 2024-08-20T04:52:35.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.534+0000 7f72eca00640 1 -- 172.21.15.37:0/45525884 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f72e81a3230 con 0x7f72e8102590 2024-08-20T04:52:35.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.541+0000 7f72df400640 1 -- 172.21.15.37:0/45525884 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v18)=0 v18) ==== 120+0+0 (secure 0 0 0) 0x7f72d80412c0 con 0x7f72e8102590 2024-08-20T04:52:35.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.543+0000 7f72eca00640 1 -- 172.21.15.37:0/45525884 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72cc03ee10 msgr2=0x7f72cc0412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:35.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.543+0000 7f72eca00640 1 --2- 172.21.15.37:0/45525884 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72cc03ee10 0x7f72cc0412d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f72d4009fc0 tx=0x7f72d4005f90 comp rx=0 tx=0).stop 2024-08-20T04:52:35.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.543+0000 7f72eca00640 1 -- 172.21.15.37:0/45525884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e8102590 msgr2=0x7f72e819a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:35.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.543+0000 7f72eca00640 1 --2- 172.21.15.37:0/45525884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e8102590 0x7f72e819a9a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f72d8005ab0 tx=0x7f72d8003c10 comp rx=0 tx=0).stop 2024-08-20T04:52:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.543+0000 7f72eca00640 1 -- 172.21.15.37:0/45525884 shutdown_connections 2024-08-20T04:52:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.543+0000 7f72eca00640 1 --2- 172.21.15.37:0/45525884 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72cc03ee10 0x7f72cc0412d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.543+0000 7f72eca00640 1 --2- 172.21.15.37:0/45525884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72e81040b0 0x7f72e819bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.543+0000 7f72eca00640 1 --2- 172.21.15.37:0/45525884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72e81036f0 0x7f72e819aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.543+0000 7f72eca00640 1 --2- 172.21.15.37:0/45525884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72e8102590 0x7f72e819a9a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.543+0000 7f72eca00640 1 -- 172.21.15.37:0/45525884 >> 172.21.15.37:0/45525884 conn(0x7f72e80fde80 msgr2=0x7f72e80750b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.543+0000 7f72eca00640 1 -- 172.21.15.37:0/45525884 shutdown_connections 2024-08-20T04:52:35.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.543+0000 7f72eca00640 1 -- 172.21.15.37:0/45525884 wait complete. 2024-08-20T04:52:35.597 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Aug 20 04:52:35 smithi135 systemd[1]: Starting Ceph mgr.z for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T04:52:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:35 smithi135 ceph-mon[22342]: Deploying daemon mgr.z on smithi135 2024-08-20T04:52:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:35 smithi135 ceph-mon[22342]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:35.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:35 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' 2024-08-20T04:52:35.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:35 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' 2024-08-20T04:52:35.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:35 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1757723418' entity='client.admin' 2024-08-20T04:52:35.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:35 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' 2024-08-20T04:52:35.866 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Aug 20 04:52:35 smithi135 podman[23906]: 2024-08-20 04:52:35.499167268 +0000 UTC m=+0.015612640 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T04:52:35.866 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Aug 20 04:52:35 smithi135 podman[23906]: 2024-08-20 04:52:35.620086217 +0000 UTC m=+0.136531614 container create c8c410a818f9c2c3776b06404e0cf8ba49a337abfdf5d987571ad855eab44d80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-20T04:52:35.866 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Aug 20 04:52:35 smithi135 podman[23906]: 2024-08-20 04:52:35.789222753 +0000 UTC m=+0.305668111 container init c8c410a818f9c2c3776b06404e0cf8ba49a337abfdf5d987571ad855eab44d80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731) 2024-08-20T04:52:35.866 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Aug 20 04:52:35 smithi135 podman[23906]: 2024-08-20 04:52:35.792010319 +0000 UTC m=+0.308455689 container start c8c410a818f9c2c3776b06404e0cf8ba49a337abfdf5d987571ad855eab44d80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-z, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T04:52:35.866 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Aug 20 04:52:35 smithi135 ceph-mgr[23926]: -- 172.21.15.135:0/118495312 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560e726df0e0 con 0x560e726bd400 2024-08-20T04:52:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:35 smithi130 ceph-mon[22007]: Deploying daemon mgr.z on smithi135 2024-08-20T04:52:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:35 smithi130 ceph-mon[22007]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:35.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:35 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' 2024-08-20T04:52:35.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:35 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' 2024-08-20T04:52:35.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:35 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1757723418' entity='client.admin' 2024-08-20T04:52:35.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:35 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' 2024-08-20T04:52:35.993 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:35 smithi037 ceph-mon[17265]: Deploying daemon mgr.z on smithi135 2024-08-20T04:52:35.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:35 smithi037 ceph-mon[17265]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:35.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:35 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' 2024-08-20T04:52:35.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:35 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' 2024-08-20T04:52:35.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:35 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1757723418' entity='client.admin' 2024-08-20T04:52:35.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:35 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' 2024-08-20T04:52:36.365 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Aug 20 04:52:35 smithi135 bash[23906]: c8c410a818f9c2c3776b06404e0cf8ba49a337abfdf5d987571ad855eab44d80 2024-08-20T04:52:36.365 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Aug 20 04:52:35 smithi135 systemd[1]: Started Ceph mgr.z for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:52:36.798 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:36.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:36 smithi130 ceph-mon[22007]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:36.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:36 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:36.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:36 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:36.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:36 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:36.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:36 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T04:52:36.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:36 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T04:52:36.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:36 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T04:52:36.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:36 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:36.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:36 smithi130 ceph-mon[22007]: Deploying daemon mgr.y on smithi130 2024-08-20T04:52:37.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.008+0000 7f39a5a00640 1 -- 172.21.15.37:0/2104447041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a01058f0 msgr2=0x7f39a0105d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:37.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.008+0000 7f39a5a00640 1 --2- 172.21.15.37:0/2104447041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a01058f0 0x7f39a0105d70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f398c009930 tx=0x7f398c02a420 comp rx=0 tx=0).stop 2024-08-20T04:52:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.008+0000 7f39a5a00640 1 -- 172.21.15.37:0/2104447041 shutdown_connections 2024-08-20T04:52:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.008+0000 7f39a5a00640 1 --2- 172.21.15.37:0/2104447041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39a01062b0 0x7f39a010cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.008+0000 7f39a5a00640 1 --2- 172.21.15.37:0/2104447041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a01058f0 0x7f39a0105d70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.008+0000 7f39a5a00640 1 --2- 172.21.15.37:0/2104447041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39a0104790 0x7f39a0104b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.008+0000 7f39a5a00640 1 -- 172.21.15.37:0/2104447041 >> 172.21.15.37:0/2104447041 conn(0x7f39a01000a0 msgr2=0x7f39a01024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.008+0000 7f39a5a00640 1 -- 172.21.15.37:0/2104447041 shutdown_connections 2024-08-20T04:52:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.008+0000 7f39a5a00640 1 -- 172.21.15.37:0/2104447041 wait complete. 2024-08-20T04:52:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.009+0000 7f39a5a00640 1 Processor -- start 2024-08-20T04:52:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.010+0000 7f39a5a00640 1 -- start start 2024-08-20T04:52:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.010+0000 7f39a5a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39a0104790 0x7f39a019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.010+0000 7f39a5a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39a01058f0 0x7f39a019af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.010+0000 7f39a5a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a01062b0 0x7f39a019bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.010+0000 7f39a5a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f39a0110300 con 0x7f39a01062b0 2024-08-20T04:52:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.010+0000 7f39a5a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f39a0110180 con 0x7f39a0104790 2024-08-20T04:52:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.010+0000 7f39a5a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f39a0110480 con 0x7f39a01058f0 2024-08-20T04:52:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.010+0000 7f399f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39a01058f0 0x7f39a019af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.010+0000 7f399f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39a01058f0 0x7f39a019af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:48728/0 (socket says 172.21.15.37:48728) 2024-08-20T04:52:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.010+0000 7f399f400640 1 -- 172.21.15.37:0/1983324349 learned_addr learned my addr 172.21.15.37:0/1983324349 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.010+0000 7f39a5000640 1 --2- 172.21.15.37:0/1983324349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a01062b0 0x7f39a019bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.010+0000 7f399fe00640 1 --2- 172.21.15.37:0/1983324349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39a0104790 0x7f39a019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:37.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.011+0000 7f399f400640 1 -- 172.21.15.37:0/1983324349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39a0104790 msgr2=0x7f39a019a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:37.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.011+0000 7f399f400640 1 --2- 172.21.15.37:0/1983324349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39a0104790 0x7f39a019a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.011+0000 7f399f400640 1 -- 172.21.15.37:0/1983324349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a01062b0 msgr2=0x7f39a019bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:37.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.011+0000 7f399f400640 1 --2- 172.21.15.37:0/1983324349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a01062b0 0x7f39a019bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.011+0000 7f399f400640 1 -- 172.21.15.37:0/1983324349 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a019c470 con 0x7f39a01058f0 2024-08-20T04:52:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.011+0000 7f399fe00640 1 --2- 172.21.15.37:0/1983324349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39a0104790 0x7f39a019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:52:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.011+0000 7f399f400640 1 --2- 172.21.15.37:0/1983324349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39a01058f0 0x7f39a019af90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f398c005ab0 tx=0x7f398c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.011+0000 7f399cc00640 1 -- 172.21.15.37:0/1983324349 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c03f070 con 0x7f39a01058f0 2024-08-20T04:52:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.011+0000 7f399cc00640 1 -- 172.21.15.37:0/1983324349 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f398c031b10 con 0x7f39a01058f0 2024-08-20T04:52:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.011+0000 7f39a5a00640 1 -- 172.21.15.37:0/1983324349 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a019c700 con 0x7f39a01058f0 2024-08-20T04:52:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.012+0000 7f399cc00640 1 -- 172.21.15.37:0/1983324349 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c035030 con 0x7f39a01058f0 2024-08-20T04:52:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.012+0000 7f39a5a00640 1 -- 172.21.15.37:0/1983324349 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a01a2c70 con 0x7f39a01058f0 2024-08-20T04:52:37.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.013+0000 7f399cc00640 1 -- 172.21.15.37:0/1983324349 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7f398c042070 con 0x7f39a01058f0 2024-08-20T04:52:37.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.013+0000 7f39a5a00640 1 -- 172.21.15.37:0/1983324349 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a010bab0 con 0x7f39a01058f0 2024-08-20T04:52:37.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.013+0000 7f399cc00640 1 --2- 172.21.15.37:0/1983324349 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f398403ee10 0x7f39840412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:37.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.013+0000 7f399cc00640 1 -- 172.21.15.37:0/1983324349 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f398c073af0 con 0x7f39a01058f0 2024-08-20T04:52:37.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.014+0000 7f399fe00640 1 --2- 172.21.15.37:0/1983324349 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f398403ee10 0x7f39840412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:37.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.014+0000 7f399fe00640 1 --2- 172.21.15.37:0/1983324349 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f398403ee10 0x7f39840412d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3990009fc0 tx=0x7f3990005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.018+0000 7f399cc00640 1 -- 172.21.15.37:0/1983324349 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f398c039e20 con 0x7f39a01058f0 2024-08-20T04:52:37.134 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:36 smithi037 ceph-mon[17265]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:37.134 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:36 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:37.134 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:36 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:37.134 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:36 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:37.134 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:36 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T04:52:37.134 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:36 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T04:52:37.134 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:36 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T04:52:37.135 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:36 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:37.135 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:36 smithi037 ceph-mon[17265]: Deploying daemon mgr.y on smithi130 2024-08-20T04:52:37.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.215+0000 7f39a5a00640 1 -- 172.21.15.37:0/1983324349 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f39a0063a80 con 0x7f39a01058f0 2024-08-20T04:52:37.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.220+0000 7f399cc00640 1 -- 172.21.15.37:0/1983324349 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v19)=0 v19) ==== 116+0+0 (secure 0 0 0) 0x7f398c04c350 con 0x7f39a01058f0 2024-08-20T04:52:37.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.222+0000 7f39a5a00640 1 -- 172.21.15.37:0/1983324349 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f398403ee10 msgr2=0x7f39840412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:37.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.222+0000 7f39a5a00640 1 --2- 172.21.15.37:0/1983324349 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f398403ee10 0x7f39840412d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3990009fc0 tx=0x7f3990005f90 comp rx=0 tx=0).stop 2024-08-20T04:52:37.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.222+0000 7f39a5a00640 1 -- 172.21.15.37:0/1983324349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39a01058f0 msgr2=0x7f39a019af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:37.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.222+0000 7f39a5a00640 1 --2- 172.21.15.37:0/1983324349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39a01058f0 0x7f39a019af90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f398c005ab0 tx=0x7f398c003c10 comp rx=0 tx=0).stop 2024-08-20T04:52:37.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.222+0000 7f39a5a00640 1 -- 172.21.15.37:0/1983324349 shutdown_connections 2024-08-20T04:52:37.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.222+0000 7f39a5a00640 1 --2- 172.21.15.37:0/1983324349 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f398403ee10 0x7f39840412d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.222+0000 7f39a5a00640 1 --2- 172.21.15.37:0/1983324349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39a01062b0 0x7f39a019bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.222+0000 7f39a5a00640 1 --2- 172.21.15.37:0/1983324349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f39a01058f0 0x7f39a019af90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.222+0000 7f39a5a00640 1 --2- 172.21.15.37:0/1983324349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f39a0104790 0x7f39a019a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.222+0000 7f39a5a00640 1 -- 172.21.15.37:0/1983324349 >> 172.21.15.37:0/1983324349 conn(0x7f39a01000a0 msgr2=0x7f39a0108c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:37.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.222+0000 7f39a5a00640 1 -- 172.21.15.37:0/1983324349 shutdown_connections 2024-08-20T04:52:37.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.222+0000 7f39a5a00640 1 -- 172.21.15.37:0/1983324349 wait complete. 2024-08-20T04:52:37.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.431+0000 7fde48a00640 1 -- 172.21.15.37:0/329603073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde44105aa0 msgr2=0x7fde44105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:37.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.431+0000 7fde48a00640 1 --2- 172.21.15.37:0/329603073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde44105aa0 0x7fde44105f20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fde30009930 tx=0x7fde3002a420 comp rx=0 tx=0).stop 2024-08-20T04:52:37.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.431+0000 7fde48a00640 1 -- 172.21.15.37:0/329603073 shutdown_connections 2024-08-20T04:52:37.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.431+0000 7fde48a00640 1 --2- 172.21.15.37:0/329603073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde44106460 0x7fde4410cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.431+0000 7fde48a00640 1 --2- 172.21.15.37:0/329603073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde44105aa0 0x7fde44105f20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.431+0000 7fde48a00640 1 --2- 172.21.15.37:0/329603073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde44104940 0x7fde44104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.431+0000 7fde48a00640 1 -- 172.21.15.37:0/329603073 >> 172.21.15.37:0/329603073 conn(0x7fde44100210 msgr2=0x7fde44102650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.431+0000 7fde48a00640 1 -- 172.21.15.37:0/329603073 shutdown_connections 2024-08-20T04:52:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.431+0000 7fde48a00640 1 -- 172.21.15.37:0/329603073 wait complete. 2024-08-20T04:52:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.432+0000 7fde48a00640 1 Processor -- start 2024-08-20T04:52:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.432+0000 7fde48a00640 1 -- start start 2024-08-20T04:52:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.432+0000 7fde48a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde44104940 0x7fde4419ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.432+0000 7fde48a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde44105aa0 0x7fde4419b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.432+0000 7fde48a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde44106460 0x7fde4419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.432+0000 7fde48a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fde44110370 con 0x7fde44106460 2024-08-20T04:52:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.432+0000 7fde48a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fde441101f0 con 0x7fde44104940 2024-08-20T04:52:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.432+0000 7fde48a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fde441104f0 con 0x7fde44105aa0 2024-08-20T04:52:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.433+0000 7fde42800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde44106460 0x7fde4419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.433+0000 7fde41e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde44104940 0x7fde4419ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:37.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.433+0000 7fde42800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde44106460 0x7fde4419bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53916/0 (socket says 172.21.15.37:53916) 2024-08-20T04:52:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.433+0000 7fde42800640 1 -- 172.21.15.37:0/4040277466 learned_addr learned my addr 172.21.15.37:0/4040277466 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.433+0000 7fde41e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde44104940 0x7fde4419ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56284/0 (socket says 172.21.15.37:56284) 2024-08-20T04:52:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.433+0000 7fde41400640 1 --2- 172.21.15.37:0/4040277466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde44105aa0 0x7fde4419b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.433+0000 7fde41e00640 1 -- 172.21.15.37:0/4040277466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde44105aa0 msgr2=0x7fde4419b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.433+0000 7fde41e00640 1 --2- 172.21.15.37:0/4040277466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde44105aa0 0x7fde4419b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.433+0000 7fde41e00640 1 -- 172.21.15.37:0/4040277466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde44106460 msgr2=0x7fde4419bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.433+0000 7fde41e00640 1 --2- 172.21.15.37:0/4040277466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde44106460 0x7fde4419bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.433+0000 7fde41e00640 1 -- 172.21.15.37:0/4040277466 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde4419c680 con 0x7fde44104940 2024-08-20T04:52:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.433+0000 7fde42800640 1 --2- 172.21.15.37:0/4040277466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde44106460 0x7fde4419bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:52:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.434+0000 7fde41e00640 1 --2- 172.21.15.37:0/4040277466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde44104940 0x7fde4419ab50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde3400e9f0 tx=0x7fde3400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.434+0000 7fde3aa00640 1 -- 172.21.15.37:0/4040277466 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde3400ccc0 con 0x7fde44104940 2024-08-20T04:52:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.434+0000 7fde3aa00640 1 -- 172.21.15.37:0/4040277466 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7fde340108a0 con 0x7fde44104940 2024-08-20T04:52:37.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.434+0000 7fde3aa00640 1 -- 172.21.15.37:0/4040277466 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde34018710 con 0x7fde44104940 2024-08-20T04:52:37.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.434+0000 7fde48a00640 1 -- 172.21.15.37:0/4040277466 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde4419c970 con 0x7fde44104940 2024-08-20T04:52:37.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.434+0000 7fde48a00640 1 -- 172.21.15.37:0/4040277466 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde441a3050 con 0x7fde44104940 2024-08-20T04:52:37.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.435+0000 7fde48a00640 1 -- 172.21.15.37:0/4040277466 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde44104d40 con 0x7fde44104940 2024-08-20T04:52:37.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.435+0000 7fde3aa00640 1 -- 172.21.15.37:0/4040277466 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7fde340188b0 con 0x7fde44104940 2024-08-20T04:52:37.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.436+0000 7fde3aa00640 1 --2- 172.21.15.37:0/4040277466 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fde2803ed60 0x7fde28041220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:37.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.436+0000 7fde3aa00640 1 -- 172.21.15.37:0/4040277466 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fde340537f0 con 0x7fde44104940 2024-08-20T04:52:37.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.436+0000 7fde41400640 1 --2- 172.21.15.37:0/4040277466 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fde2803ed60 0x7fde28041220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:37.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.437+0000 7fde41400640 1 --2- 172.21.15.37:0/4040277466 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fde2803ed60 0x7fde28041220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde30009900 tx=0x7fde30005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:37.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.441+0000 7fde3aa00640 1 -- 172.21.15.37:0/4040277466 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fde34010cc0 con 0x7fde44104940 2024-08-20T04:52:37.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.681+0000 7fde48a00640 1 -- 172.21.15.37:0/4040277466 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fde4402e5f0 con 0x7fde44104940 2024-08-20T04:52:37.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.688+0000 7fde3aa00640 1 -- 172.21.15.37:0/4040277466 <== mon.2 v2:172.21.15.130:3300/0 7 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fde34016c00 con 0x7fde44104940 2024-08-20T04:52:37.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.688+0000 7fde3aa00640 1 -- 172.21.15.37:0/4040277466 <== mon.2 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v15)=0 v15) ==== 123+0+0 (secure 0 0 0) 0x7fde34055c40 con 0x7fde44104940 2024-08-20T04:52:37.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.691+0000 7fde48a00640 1 -- 172.21.15.37:0/4040277466 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fde2803ed60 msgr2=0x7fde28041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:37.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.691+0000 7fde48a00640 1 --2- 172.21.15.37:0/4040277466 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fde2803ed60 0x7fde28041220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde30009900 tx=0x7fde30005a20 comp rx=0 tx=0).stop 2024-08-20T04:52:37.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.691+0000 7fde48a00640 1 -- 172.21.15.37:0/4040277466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde44104940 msgr2=0x7fde4419ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:37.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.691+0000 7fde48a00640 1 --2- 172.21.15.37:0/4040277466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde44104940 0x7fde4419ab50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde3400e9f0 tx=0x7fde3400eeb0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.691+0000 7fde48a00640 1 -- 172.21.15.37:0/4040277466 shutdown_connections 2024-08-20T04:52:37.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.691+0000 7fde48a00640 1 --2- 172.21.15.37:0/4040277466 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fde2803ed60 0x7fde28041220 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.691+0000 7fde48a00640 1 --2- 172.21.15.37:0/4040277466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde44106460 0x7fde4419bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.691+0000 7fde48a00640 1 --2- 172.21.15.37:0/4040277466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde44105aa0 0x7fde4419b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.691+0000 7fde48a00640 1 --2- 172.21.15.37:0/4040277466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde44104940 0x7fde4419ab50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:37.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.691+0000 7fde48a00640 1 -- 172.21.15.37:0/4040277466 >> 172.21.15.37:0/4040277466 conn(0x7fde44100210 msgr2=0x7fde44108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:37.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.692+0000 7fde48a00640 1 -- 172.21.15.37:0/4040277466 shutdown_connections 2024-08-20T04:52:37.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.692+0000 7fde48a00640 1 -- 172.21.15.37:0/4040277466 wait complete. 2024-08-20T04:52:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:36 smithi135 ceph-mon[22342]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:36 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:36 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:36 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:36 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-08-20T04:52:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:36 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-20T04:52:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:36 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-08-20T04:52:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:36 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:36 smithi135 ceph-mon[22342]: Deploying daemon mgr.y on smithi130 2024-08-20T04:52:37.705 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 20 04:52:37 smithi130 systemd[1]: Starting Ceph mgr.y for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T04:52:38.089 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 20 04:52:37 smithi130 podman[23128]: 2024-08-20 04:52:37.819064695 +0000 UTC m=+0.103823673 container create 48a8abbaf7de5e6ce2ef24a64e5153f323faa8652c11f659b729b7c6827985f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-y, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-08-20T04:52:38.089 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 20 04:52:37 smithi130 podman[23128]: 2024-08-20 04:52:37.730719894 +0000 UTC m=+0.015478841 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T04:52:38.089 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 20 04:52:38 smithi130 podman[23128]: 2024-08-20 04:52:38.029774213 +0000 UTC m=+0.314533149 container init 48a8abbaf7de5e6ce2ef24a64e5153f323faa8652c11f659b729b7c6827985f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-y, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T04:52:38.089 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 20 04:52:38 smithi130 podman[23128]: 2024-08-20 04:52:38.032491047 +0000 UTC m=+0.317249983 container start 48a8abbaf7de5e6ce2ef24a64e5153f323faa8652c11f659b729b7c6827985f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-y, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T04:52:38.089 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 20 04:52:38 smithi130 ceph-mgr[23146]: -- 172.21.15.130:0/22986674 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561ba02b30e0 con 0x561ba0290800 2024-08-20T04:52:38.089 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 20 04:52:38 smithi130 bash[23128]: 48a8abbaf7de5e6ce2ef24a64e5153f323faa8652c11f659b729b7c6827985f3 2024-08-20T04:52:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.135+0000 7f8dfc000640 1 -- 172.21.15.37:0/2362355492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8df4105ab0 msgr2=0x7f8df4105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.135+0000 7f8dfc000640 1 --2- 172.21.15.37:0/2362355492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8df4105ab0 0x7f8df4105f30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009890 tx=0x7f8de002a360 comp rx=0 tx=0).stop 2024-08-20T04:52:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.135+0000 7f8dfc000640 1 -- 172.21.15.37:0/2362355492 shutdown_connections 2024-08-20T04:52:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.135+0000 7f8dfc000640 1 --2- 172.21.15.37:0/2362355492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8df4106470 0x7f8df410cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.135+0000 7f8dfc000640 1 --2- 172.21.15.37:0/2362355492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8df4105ab0 0x7f8df4105f30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.135+0000 7f8dfc000640 1 --2- 172.21.15.37:0/2362355492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8df4104950 0x7f8df4104d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.135+0000 7f8dfc000640 1 -- 172.21.15.37:0/2362355492 >> 172.21.15.37:0/2362355492 conn(0x7f8df4100240 msgr2=0x7f8df4102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.135+0000 7f8dfc000640 1 -- 172.21.15.37:0/2362355492 shutdown_connections 2024-08-20T04:52:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.135+0000 7f8dfc000640 1 -- 172.21.15.37:0/2362355492 wait complete. 2024-08-20T04:52:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.136+0000 7f8dfc000640 1 Processor -- start 2024-08-20T04:52:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.136+0000 7f8dfc000640 1 -- start start 2024-08-20T04:52:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.137+0000 7f8dfc000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8df4104950 0x7f8df419ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.137+0000 7f8dfc000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8df4105ab0 0x7f8df419b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.137+0000 7f8dfc000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8df4106470 0x7f8df419bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.137+0000 7f8dfc000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8df4110490 con 0x7f8df4106470 2024-08-20T04:52:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.137+0000 7f8dfc000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8df4110310 con 0x7f8df4104950 2024-08-20T04:52:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.137+0000 7f8dfc000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8df4110610 con 0x7f8df4105ab0 2024-08-20T04:52:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.137+0000 7f8dfa000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8df4106470 0x7f8df419bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.137+0000 7f8df9600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8df4104950 0x7f8df419ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.137+0000 7f8df8c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8df4105ab0 0x7f8df419b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.137+0000 7f8df8c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8df4105ab0 0x7f8df419b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:48766/0 (socket says 172.21.15.37:48766) 2024-08-20T04:52:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.137+0000 7f8df8c00640 1 -- 172.21.15.37:0/413973325 learned_addr learned my addr 172.21.15.37:0/413973325 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.137+0000 7f8df9600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8df4104950 0x7f8df419ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56374/0 (socket says 172.21.15.37:56374) 2024-08-20T04:52:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.137+0000 7f8df8c00640 1 -- 172.21.15.37:0/413973325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8df4104950 msgr2=0x7f8df419ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.137+0000 7f8df8c00640 1 --2- 172.21.15.37:0/413973325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8df4104950 0x7f8df419ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.137+0000 7f8df8c00640 1 -- 172.21.15.37:0/413973325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8df4106470 msgr2=0x7f8df419bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.137+0000 7f8df8c00640 1 --2- 172.21.15.37:0/413973325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8df4106470 0x7f8df419bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.138+0000 7f8df8c00640 1 -- 172.21.15.37:0/413973325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8df419c790 con 0x7f8df4105ab0 2024-08-20T04:52:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.138+0000 7f8df8c00640 1 --2- 172.21.15.37:0/413973325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8df4105ab0 0x7f8df419b2b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8de0030790 tx=0x7f8de00307c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.138+0000 7f8df2000640 1 -- 172.21.15.37:0/413973325 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0037040 con 0x7f8df4105ab0 2024-08-20T04:52:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.138+0000 7f8dfc000640 1 -- 172.21.15.37:0/413973325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8df419ca20 con 0x7f8df4105ab0 2024-08-20T04:52:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.138+0000 7f8df2000640 1 -- 172.21.15.37:0/413973325 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8de0032d40 con 0x7f8df4105ab0 2024-08-20T04:52:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.138+0000 7f8df2000640 1 -- 172.21.15.37:0/413973325 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de0003850 con 0x7f8df4105ab0 2024-08-20T04:52:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.138+0000 7f8dfc000640 1 -- 172.21.15.37:0/413973325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8df41a3160 con 0x7f8df4105ab0 2024-08-20T04:52:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.140+0000 7f8dfc000640 1 -- 172.21.15.37:0/413973325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8df4104d50 con 0x7f8df4105ab0 2024-08-20T04:52:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.140+0000 7f8df2000640 1 -- 172.21.15.37:0/413973325 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7f8de0030aa0 con 0x7f8df4105ab0 2024-08-20T04:52:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.140+0000 7f8df2000640 1 --2- 172.21.15.37:0/413973325 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8ddc03ed60 0x7f8ddc041220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.140+0000 7f8df2000640 1 -- 172.21.15.37:0/413973325 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8de0072db0 con 0x7f8df4105ab0 2024-08-20T04:52:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.141+0000 7f8df9600640 1 --2- 172.21.15.37:0/413973325 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8ddc03ed60 0x7f8ddc041220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.141+0000 7f8df9600640 1 --2- 172.21.15.37:0/413973325 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8ddc03ed60 0x7f8ddc041220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8de8009530 tx=0x7f8de8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.145+0000 7f8df2000640 1 -- 172.21.15.37:0/413973325 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f8de0038250 con 0x7f8df4105ab0 2024-08-20T04:52:38.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.348+0000 7f8dfc000640 1 -- 172.21.15.37:0/413973325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f8df41a33d0 con 0x7f8df4105ab0 2024-08-20T04:52:38.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.352+0000 7f8df2000640 1 -- 172.21.15.37:0/413973325 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v21)=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7f8de0032880 con 0x7f8df4105ab0 2024-08-20T04:52:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.354+0000 7f8dfc000640 1 -- 172.21.15.37:0/413973325 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8ddc03ed60 msgr2=0x7f8ddc041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.354+0000 7f8dfc000640 1 --2- 172.21.15.37:0/413973325 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8ddc03ed60 0x7f8ddc041220 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8de8009530 tx=0x7f8de8009260 comp rx=0 tx=0).stop 2024-08-20T04:52:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.354+0000 7f8dfc000640 1 -- 172.21.15.37:0/413973325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8df4105ab0 msgr2=0x7f8df419b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.354+0000 7f8dfc000640 1 --2- 172.21.15.37:0/413973325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8df4105ab0 0x7f8df419b2b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8de0030790 tx=0x7f8de00307c0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.355+0000 7f8dfc000640 1 -- 172.21.15.37:0/413973325 shutdown_connections 2024-08-20T04:52:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.355+0000 7f8dfc000640 1 --2- 172.21.15.37:0/413973325 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8ddc03ed60 0x7f8ddc041220 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.355+0000 7f8dfc000640 1 --2- 172.21.15.37:0/413973325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8df4106470 0x7f8df419bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.355+0000 7f8dfc000640 1 --2- 172.21.15.37:0/413973325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8df4105ab0 0x7f8df419b2b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.355+0000 7f8dfc000640 1 --2- 172.21.15.37:0/413973325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8df4104950 0x7f8df419ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.355+0000 7f8dfc000640 1 -- 172.21.15.37:0/413973325 >> 172.21.15.37:0/413973325 conn(0x7f8df4100240 msgr2=0x7f8df4106e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.355+0000 7f8dfc000640 1 -- 172.21.15.37:0/413973325 shutdown_connections 2024-08-20T04:52:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.355+0000 7f8dfc000640 1 -- 172.21.15.37:0/413973325 wait complete. 2024-08-20T04:52:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.365+0000 7fae08c00640 1 -- 172.21.15.37:0/647150678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae04104940 msgr2=0x7fae04104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.365+0000 7fae08c00640 1 --2- 172.21.15.37:0/647150678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae04104940 0x7fae04104d40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fadf4009960 tx=0x7fadf402a460 comp rx=0 tx=0).stop 2024-08-20T04:52:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.365+0000 7fae08c00640 1 -- 172.21.15.37:0/647150678 shutdown_connections 2024-08-20T04:52:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.365+0000 7fae08c00640 1 --2- 172.21.15.37:0/647150678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04106460 0x7fae0410cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.365+0000 7fae08c00640 1 --2- 172.21.15.37:0/647150678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae04105aa0 0x7fae04105f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.365+0000 7fae08c00640 1 --2- 172.21.15.37:0/647150678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae04104940 0x7fae04104d40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.365+0000 7fae08c00640 1 -- 172.21.15.37:0/647150678 >> 172.21.15.37:0/647150678 conn(0x7fae04100210 msgr2=0x7fae04102650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.365+0000 7fae08c00640 1 -- 172.21.15.37:0/647150678 shutdown_connections 2024-08-20T04:52:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.365+0000 7fae08c00640 1 -- 172.21.15.37:0/647150678 wait complete. 2024-08-20T04:52:38.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.366+0000 7fae08c00640 1 Processor -- start 2024-08-20T04:52:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.366+0000 7fae08c00640 1 -- start start 2024-08-20T04:52:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.367+0000 7fae08c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae04104940 0x7fae0419ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.367+0000 7fae08c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae04105aa0 0x7fae0419b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.367+0000 7fae08c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04106460 0x7fae0419bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.367+0000 7fae08c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fae041104b0 con 0x7fae04105aa0 2024-08-20T04:52:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.367+0000 7fae08c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fae04110330 con 0x7fae04106460 2024-08-20T04:52:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.367+0000 7fae08c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fae04110630 con 0x7fae04104940 2024-08-20T04:52:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.367+0000 7fae01e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae04104940 0x7fae0419ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.367+0000 7fae01e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae04104940 0x7fae0419ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:48796/0 (socket says 172.21.15.37:48796) 2024-08-20T04:52:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.367+0000 7fae01e00640 1 -- 172.21.15.37:0/530998964 learned_addr learned my addr 172.21.15.37:0/530998964 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.367+0000 7fae01400640 1 --2- 172.21.15.37:0/530998964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae04105aa0 0x7fae0419b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.367+0000 7fae02800640 1 --2- 172.21.15.37:0/530998964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04106460 0x7fae0419bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.368+0000 7fae01400640 1 -- 172.21.15.37:0/530998964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae04104940 msgr2=0x7fae0419ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.368+0000 7fae01400640 1 --2- 172.21.15.37:0/530998964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae04104940 0x7fae0419ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.368+0000 7fae01400640 1 -- 172.21.15.37:0/530998964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04106460 msgr2=0x7fae0419bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.368+0000 7fae01400640 1 --2- 172.21.15.37:0/530998964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04106460 0x7fae0419bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.368+0000 7fae01400640 1 -- 172.21.15.37:0/530998964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0419c810 con 0x7fae04105aa0 2024-08-20T04:52:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.368+0000 7fae01e00640 1 --2- 172.21.15.37:0/530998964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae04104940 0x7fae0419ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:52:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.368+0000 7fae01400640 1 --2- 172.21.15.37:0/530998964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae04105aa0 0x7fae0419b330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fadf000e9f0 tx=0x7fadf000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.368+0000 7fadfaa00640 1 -- 172.21.15.37:0/530998964 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf000ccc0 con 0x7fae04105aa0 2024-08-20T04:52:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.368+0000 7fadfaa00640 1 -- 172.21.15.37:0/530998964 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fadf00108c0 con 0x7fae04105aa0 2024-08-20T04:52:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.368+0000 7fae08c00640 1 -- 172.21.15.37:0/530998964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae0419cb00 con 0x7fae04105aa0 2024-08-20T04:52:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.368+0000 7fadfaa00640 1 -- 172.21.15.37:0/530998964 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf0018660 con 0x7fae04105aa0 2024-08-20T04:52:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.368+0000 7fae08c00640 1 -- 172.21.15.37:0/530998964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae041a31e0 con 0x7fae04105aa0 2024-08-20T04:52:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.370+0000 7fae08c00640 1 -- 172.21.15.37:0/530998964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae0410bd90 con 0x7fae04105aa0 2024-08-20T04:52:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.370+0000 7fadfaa00640 1 -- 172.21.15.37:0/530998964 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7fadf0010430 con 0x7fae04105aa0 2024-08-20T04:52:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.371+0000 7fadfaa00640 1 --2- 172.21.15.37:0/530998964 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fade803ed60 0x7fade8041220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.371+0000 7fadfaa00640 1 -- 172.21.15.37:0/530998964 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fadf0053580 con 0x7fae04105aa0 2024-08-20T04:52:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.371+0000 7fae01e00640 1 --2- 172.21.15.37:0/530998964 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fade803ed60 0x7fade8041220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.372+0000 7fae01e00640 1 --2- 172.21.15.37:0/530998964 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fade803ed60 0x7fade8041220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fadf40096c0 tx=0x7fadf4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:38.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.376+0000 7fadfaa00640 1 -- 172.21.15.37:0/530998964 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fadf000b2c0 con 0x7fae04105aa0 2024-08-20T04:52:38.455 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 20 04:52:38 smithi130 systemd[1]: Started Ceph mgr.y for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:52:38.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:38 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' 2024-08-20T04:52:38.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:38 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' 2024-08-20T04:52:38.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:38 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:38.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:38 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:38.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:38 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:38.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:38 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:38.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:38 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' 2024-08-20T04:52:38.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:38 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' 2024-08-20T04:52:38.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:38 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:38.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:38 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:38.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:38 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:38.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:38 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:38.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.587+0000 7fae08c00640 1 -- 172.21.15.37:0/530998964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fae04063a80 con 0x7fae04105aa0 2024-08-20T04:52:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.590+0000 7fadfaa00640 1 -- 172.21.15.37:0/530998964 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v22)=0 v22) ==== 123+0+0 (secure 0 0 0) 0x7fadf00071c0 con 0x7fae04105aa0 2024-08-20T04:52:38.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.591+0000 7fadfaa00640 1 -- 172.21.15.37:0/530998964 <== mon.0 v2:172.21.15.37:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fadf00166d0 con 0x7fae04105aa0 2024-08-20T04:52:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.592+0000 7fae08c00640 1 -- 172.21.15.37:0/530998964 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fade803ed60 msgr2=0x7fade8041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:38.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.592+0000 7fae08c00640 1 --2- 172.21.15.37:0/530998964 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fade803ed60 0x7fade8041220 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fadf40096c0 tx=0x7fadf4005a20 comp rx=0 tx=0).stop 2024-08-20T04:52:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.592+0000 7fae08c00640 1 -- 172.21.15.37:0/530998964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae04105aa0 msgr2=0x7fae0419b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.592+0000 7fae08c00640 1 --2- 172.21.15.37:0/530998964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae04105aa0 0x7fae0419b330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fadf000e9f0 tx=0x7fadf000edf0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.592+0000 7fae08c00640 1 -- 172.21.15.37:0/530998964 shutdown_connections 2024-08-20T04:52:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.592+0000 7fae08c00640 1 --2- 172.21.15.37:0/530998964 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fade803ed60 0x7fade8041220 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.592+0000 7fae08c00640 1 --2- 172.21.15.37:0/530998964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fae04106460 0x7fae0419bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.593+0000 7fae08c00640 1 --2- 172.21.15.37:0/530998964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae04105aa0 0x7fae0419b330 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.593+0000 7fae08c00640 1 --2- 172.21.15.37:0/530998964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fae04104940 0x7fae0419ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.593+0000 7fae08c00640 1 -- 172.21.15.37:0/530998964 >> 172.21.15.37:0/530998964 conn(0x7fae04100210 msgr2=0x7fae04108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.593+0000 7fae08c00640 1 -- 172.21.15.37:0/530998964 shutdown_connections 2024-08-20T04:52:38.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:38.593+0000 7fae08c00640 1 -- 172.21.15.37:0/530998964 wait complete. 2024-08-20T04:52:38.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:38 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' 2024-08-20T04:52:38.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:38 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' 2024-08-20T04:52:38.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:38 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:38.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:38 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:38.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:38 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:38.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:38 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:38.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.746+0000 7f42f3000640 1 -- 172.21.15.37:0/740325912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec106250 msgr2=0x7f42ec106700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:38.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.746+0000 7f42f3000640 1 --2- 172.21.15.37:0/740325912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec106250 0x7f42ec106700 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009c90 tx=0x7f42e402a860 comp rx=0 tx=0).stop 2024-08-20T04:52:38.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.746+0000 7f42f3000640 1 -- 172.21.15.37:0/740325912 shutdown_connections 2024-08-20T04:52:38.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.746+0000 7f42f3000640 1 --2- 172.21.15.37:0/740325912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec106250 0x7f42ec106700 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.746+0000 7f42f3000640 1 --2- 172.21.15.37:0/740325912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ec1036a0 0x7f42ec105b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.746+0000 7f42f3000640 1 --2- 172.21.15.37:0/740325912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42ec06bd60 0x7f42ec103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.746+0000 7f42f3000640 1 -- 172.21.15.37:0/740325912 >> 172.21.15.37:0/740325912 conn(0x7f42ec0fcf30 msgr2=0x7f42ec0ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:38.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.746+0000 7f42f3000640 1 -- 172.21.15.37:0/740325912 shutdown_connections 2024-08-20T04:52:38.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.746+0000 7f42f3000640 1 -- 172.21.15.37:0/740325912 wait complete. 2024-08-20T04:52:38.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.747+0000 7f42f3000640 1 Processor -- start 2024-08-20T04:52:38.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.748+0000 7f42f3000640 1 -- start start 2024-08-20T04:52:38.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.748+0000 7f42f3000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec06bd60 0x7f42ec19ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:38.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.748+0000 7f42f3000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42ec1036a0 0x7f42ec19f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:38.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.748+0000 7f42f3000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ec106250 0x7f42ec1a0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:38.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.748+0000 7f42f3000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec114690 con 0x7f42ec106250 2024-08-20T04:52:38.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.748+0000 7f42f3000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec114510 con 0x7f42ec1036a0 2024-08-20T04:52:38.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.748+0000 7f42f3000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec114810 con 0x7f42ec06bd60 2024-08-20T04:52:38.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.748+0000 7f42ebe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec06bd60 0x7f42ec19ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:38.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.748+0000 7f42f1000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ec106250 0x7f42ec1a0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:38.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.748+0000 7f42ebe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec06bd60 0x7f42ec19ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:48626/0 (socket says 172.21.15.37:48626) 2024-08-20T04:52:38.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.748+0000 7f42ebe00640 1 -- 172.21.15.37:0/1524796275 learned_addr learned my addr 172.21.15.37:0/1524796275 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:38.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.749+0000 7f42e3e00640 1 --2- 172.21.15.37:0/1524796275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42ec1036a0 0x7f42ec19f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:38.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.749+0000 7f42e3e00640 1 -- 172.21.15.37:0/1524796275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec06bd60 msgr2=0x7f42ec19ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:38.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.749+0000 7f42e3e00640 1 --2- 172.21.15.37:0/1524796275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec06bd60 0x7f42ec19ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.749+0000 7f42e3e00640 1 -- 172.21.15.37:0/1524796275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ec106250 msgr2=0x7f42ec1a0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:38.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.749+0000 7f42e3e00640 1 --2- 172.21.15.37:0/1524796275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ec106250 0x7f42ec1a0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.749+0000 7f42e3e00640 1 -- 172.21.15.37:0/1524796275 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ec1a09c0 con 0x7f42ec1036a0 2024-08-20T04:52:38.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.749+0000 7f42ebe00640 1 --2- 172.21.15.37:0/1524796275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec06bd60 0x7f42ec19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:52:38.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.749+0000 7f42e3e00640 1 --2- 172.21.15.37:0/1524796275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42ec1036a0 0x7f42ec19f4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f42d400e9c0 tx=0x7f42d400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:38.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.750+0000 7f42e9600640 1 -- 172.21.15.37:0/1524796275 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d400ccc0 con 0x7f42ec1036a0 2024-08-20T04:52:38.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.750+0000 7f42e9600640 1 -- 172.21.15.37:0/1524796275 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(23 keys) ==== 1014+0+0 (secure 0 0 0) 0x7f42d4004480 con 0x7f42ec1036a0 2024-08-20T04:52:38.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.750+0000 7f42e9600640 1 -- 172.21.15.37:0/1524796275 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4003d40 con 0x7f42ec1036a0 2024-08-20T04:52:38.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.750+0000 7f42f3000640 1 -- 172.21.15.37:0/1524796275 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ec1a0cb0 con 0x7f42ec1036a0 2024-08-20T04:52:38.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.750+0000 7f42f3000640 1 -- 172.21.15.37:0/1524796275 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ec1a7390 con 0x7f42ec1036a0 2024-08-20T04:52:38.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.751+0000 7f42e9600640 1 -- 172.21.15.37:0/1524796275 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7f42d4021440 con 0x7f42ec1036a0 2024-08-20T04:52:38.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.752+0000 7f42f3000640 1 -- 172.21.15.37:0/1524796275 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42ec106700 con 0x7f42ec1036a0 2024-08-20T04:52:38.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.752+0000 7f42e9600640 1 --2- 172.21.15.37:0/1524796275 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42d003ed60 0x7f42d0041220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:38.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.752+0000 7f42e9600640 1 -- 172.21.15.37:0/1524796275 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f42d40536e0 con 0x7f42ec1036a0 2024-08-20T04:52:38.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.752+0000 7f42ebe00640 1 --2- 172.21.15.37:0/1524796275 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42d003ed60 0x7f42d0041220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:38.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.753+0000 7f42ebe00640 1 --2- 172.21.15.37:0/1524796275 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42d003ed60 0x7f42d0041220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f42dc011550 tx=0x7f42dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:38.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.757+0000 7f42e9600640 1 -- 172.21.15.37:0/1524796275 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f42d40203a0 con 0x7f42ec1036a0 2024-08-20T04:52:38.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.979+0000 7f42f3000640 1 -- 172.21.15.37:0/1524796275 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f42ec0fea20 con 0x7f42ec1036a0 2024-08-20T04:52:38.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.986+0000 7f42e9600640 1 -- 172.21.15.37:0/1524796275 <== mon.2 v2:172.21.15.130:3300/0 7 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f42d4021730 con 0x7f42ec1036a0 2024-08-20T04:52:38.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.986+0000 7f42e9600640 1 -- 172.21.15.37:0/1524796275 <== mon.2 v2:172.21.15.130:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v13)=0 v13) ==== 114+0+0 (secure 0 0 0) 0x7f42d401fdb0 con 0x7f42ec1036a0 2024-08-20T04:52:38.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.989+0000 7f42f3000640 1 -- 172.21.15.37:0/1524796275 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42d003ed60 msgr2=0x7f42d0041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:38.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.989+0000 7f42f3000640 1 --2- 172.21.15.37:0/1524796275 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42d003ed60 0x7f42d0041220 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f42dc011550 tx=0x7f42dc005f90 comp rx=0 tx=0).stop 2024-08-20T04:52:38.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.989+0000 7f42f3000640 1 -- 172.21.15.37:0/1524796275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42ec1036a0 msgr2=0x7f42ec19f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:38.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.989+0000 7f42f3000640 1 --2- 172.21.15.37:0/1524796275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42ec1036a0 0x7f42ec19f4e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f42d400e9c0 tx=0x7f42d400ee80 comp rx=0 tx=0).stop 2024-08-20T04:52:38.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.989+0000 7f42f3000640 1 -- 172.21.15.37:0/1524796275 shutdown_connections 2024-08-20T04:52:38.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.989+0000 7f42f3000640 1 --2- 172.21.15.37:0/1524796275 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42d003ed60 0x7f42d0041220 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.989+0000 7f42f3000640 1 --2- 172.21.15.37:0/1524796275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ec106250 0x7f42ec1a0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.989+0000 7f42f3000640 1 --2- 172.21.15.37:0/1524796275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42ec1036a0 0x7f42ec19f4e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.989+0000 7f42f3000640 1 --2- 172.21.15.37:0/1524796275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec06bd60 0x7f42ec19ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:38.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.989+0000 7f42f3000640 1 -- 172.21.15.37:0/1524796275 >> 172.21.15.37:0/1524796275 conn(0x7f42ec0fcf30 msgr2=0x7f42ec101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:38.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.989+0000 7f42f3000640 1 -- 172.21.15.37:0/1524796275 shutdown_connections 2024-08-20T04:52:38.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.990+0000 7f42f3000640 1 -- 172.21.15.37:0/1524796275 wait complete. 2024-08-20T04:52:39.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.336+0000 7f49ffe00640 1 -- 172.21.15.37:0/630147626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a00104790 msgr2=0x7f4a00104b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:39.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.336+0000 7f49ffe00640 1 --2- 172.21.15.37:0/630147626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a00104790 0x7f4a00104b90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f49f0009930 tx=0x7f49f002a420 comp rx=0 tx=0).stop 2024-08-20T04:52:39.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.336+0000 7f49ffe00640 1 -- 172.21.15.37:0/630147626 shutdown_connections 2024-08-20T04:52:39.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.336+0000 7f49ffe00640 1 --2- 172.21.15.37:0/630147626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a001062b0 0x7f4a0010cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:39.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.336+0000 7f49ffe00640 1 --2- 172.21.15.37:0/630147626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a001058f0 0x7f4a00105d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:39.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.336+0000 7f49ffe00640 1 --2- 172.21.15.37:0/630147626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a00104790 0x7f4a00104b90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:39.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.336+0000 7f49ffe00640 1 -- 172.21.15.37:0/630147626 >> 172.21.15.37:0/630147626 conn(0x7f4a001000a0 msgr2=0x7f4a001024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:39.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.336+0000 7f49ffe00640 1 -- 172.21.15.37:0/630147626 shutdown_connections 2024-08-20T04:52:39.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.336+0000 7f49ffe00640 1 -- 172.21.15.37:0/630147626 wait complete. 2024-08-20T04:52:39.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.337+0000 7f49ffe00640 1 Processor -- start 2024-08-20T04:52:39.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.338+0000 7f49ffe00640 1 -- start start 2024-08-20T04:52:39.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.338+0000 7f49ffe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a00104790 0x7f4a0019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:39.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.338+0000 7f49ffe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a001058f0 0x7f4a0019b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:39.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.338+0000 7f49ffe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a001062b0 0x7f4a0019bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:39.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.338+0000 7f49ffe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4a00110440 con 0x7f4a001062b0 2024-08-20T04:52:39.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.338+0000 7f49ffe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4a001102c0 con 0x7f4a001058f0 2024-08-20T04:52:39.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.338+0000 7f49ffe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4a001105c0 con 0x7f4a00104790 2024-08-20T04:52:39.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.338+0000 7f49fe000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a001058f0 0x7f4a0019b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:39.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.338+0000 7f49fea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a00104790 0x7f4a0019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:39.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.338+0000 7f49fe000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a001058f0 0x7f4a0019b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56410/0 (socket says 172.21.15.37:56410) 2024-08-20T04:52:39.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.338+0000 7f49fe000640 1 -- 172.21.15.37:0/897888854 learned_addr learned my addr 172.21.15.37:0/897888854 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:39.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.338+0000 7f49ff400640 1 --2- 172.21.15.37:0/897888854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a001062b0 0x7f4a0019bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:39.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.339+0000 7f49fe000640 1 -- 172.21.15.37:0/897888854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a00104790 msgr2=0x7f4a0019aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:39.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.339+0000 7f49fe000640 1 --2- 172.21.15.37:0/897888854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a00104790 0x7f4a0019aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:39.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.339+0000 7f49fe000640 1 -- 172.21.15.37:0/897888854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a001062b0 msgr2=0x7f4a0019bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:39.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.339+0000 7f49fe000640 1 --2- 172.21.15.37:0/897888854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a001062b0 0x7f4a0019bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:39.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.339+0000 7f49fe000640 1 -- 172.21.15.37:0/897888854 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0019c5a0 con 0x7f4a001058f0 2024-08-20T04:52:39.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.339+0000 7f49fea00640 1 --2- 172.21.15.37:0/897888854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a00104790 0x7f4a0019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:52:39.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.339+0000 7f49ff400640 1 --2- 172.21.15.37:0/897888854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a001062b0 0x7f4a0019bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T04:52:39.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.339+0000 7f49fe000640 1 --2- 172.21.15.37:0/897888854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a001058f0 0x7f4a0019b0c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f49ec00e9f0 tx=0x7f49ec00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:39.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.339+0000 7f4a04a00640 1 -- 172.21.15.37:0/897888854 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ec00cd80 con 0x7f4a001058f0 2024-08-20T04:52:39.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.339+0000 7f4a04a00640 1 -- 172.21.15.37:0/897888854 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49ec0108e0 con 0x7f4a001058f0 2024-08-20T04:52:39.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.339+0000 7f4a04a00640 1 -- 172.21.15.37:0/897888854 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49ec018980 con 0x7f4a001058f0 2024-08-20T04:52:39.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.339+0000 7f49ffe00640 1 -- 172.21.15.37:0/897888854 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0019c890 con 0x7f4a001058f0 2024-08-20T04:52:39.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.339+0000 7f49ffe00640 1 -- 172.21.15.37:0/897888854 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a001a2f70 con 0x7f4a001058f0 2024-08-20T04:52:39.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.341+0000 7f4a04a00640 1 -- 172.21.15.37:0/897888854 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7f49ec018b20 con 0x7f4a001058f0 2024-08-20T04:52:39.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.341+0000 7f49ffe00640 1 -- 172.21.15.37:0/897888854 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a00104b90 con 0x7f4a001058f0 2024-08-20T04:52:39.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.341+0000 7f4a04a00640 1 --2- 172.21.15.37:0/897888854 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f49e403ee10 0x7f49e40412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:39.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.341+0000 7f4a04a00640 1 -- 172.21.15.37:0/897888854 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f49ec0538a0 con 0x7f4a001058f0 2024-08-20T04:52:39.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.342+0000 7f49fea00640 1 --2- 172.21.15.37:0/897888854 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f49e403ee10 0x7f49e40412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:39.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.342+0000 7f49fea00640 1 --2- 172.21.15.37:0/897888854 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f49e403ee10 0x7f49e40412d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f49f0009900 tx=0x7f49f0031450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:39.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.346+0000 7f4a04a00640 1 -- 172.21.15.37:0/897888854 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f49ec010d70 con 0x7f4a001058f0 2024-08-20T04:52:39.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:39 smithi037 ceph-mon[17265]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:39.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:52:39.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:39.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:39 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' 2024-08-20T04:52:39.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:39 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/530998964' entity='client.admin' 2024-08-20T04:52:39.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.554+0000 7f49ffe00640 1 -- 172.21.15.37:0/897888854 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f4a0002e340 con 0x7f4a001058f0 2024-08-20T04:52:39.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.561+0000 7f4a04a00640 1 -- 172.21.15.37:0/897888854 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f49ec010b00 con 0x7f4a001058f0 2024-08-20T04:52:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.563+0000 7f49ffe00640 1 -- 172.21.15.37:0/897888854 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f49e403ee10 msgr2=0x7f49e40412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.563+0000 7f49ffe00640 1 --2- 172.21.15.37:0/897888854 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f49e403ee10 0x7f49e40412d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f49f0009900 tx=0x7f49f0031450 comp rx=0 tx=0).stop 2024-08-20T04:52:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.563+0000 7f49ffe00640 1 -- 172.21.15.37:0/897888854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a001058f0 msgr2=0x7f4a0019b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.563+0000 7f49ffe00640 1 --2- 172.21.15.37:0/897888854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a001058f0 0x7f4a0019b0c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f49ec00e9f0 tx=0x7f49ec00eeb0 comp rx=0 tx=0).stop 2024-08-20T04:52:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.563+0000 7f49ffe00640 1 -- 172.21.15.37:0/897888854 shutdown_connections 2024-08-20T04:52:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.563+0000 7f49ffe00640 1 --2- 172.21.15.37:0/897888854 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f49e403ee10 0x7f49e40412d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.563+0000 7f49ffe00640 1 --2- 172.21.15.37:0/897888854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a001062b0 0x7f4a0019bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.563+0000 7f49ffe00640 1 --2- 172.21.15.37:0/897888854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a001058f0 0x7f4a0019b0c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.563+0000 7f49ffe00640 1 --2- 172.21.15.37:0/897888854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a00104790 0x7f4a0019aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.563+0000 7f49ffe00640 1 -- 172.21.15.37:0/897888854 >> 172.21.15.37:0/897888854 conn(0x7f4a001000a0 msgr2=0x7f4a00108c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.564+0000 7f49ffe00640 1 -- 172.21.15.37:0/897888854 shutdown_connections 2024-08-20T04:52:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:39.564+0000 7f49ffe00640 1 -- 172.21.15.37:0/897888854 wait complete. 2024-08-20T04:52:39.619 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:39 smithi135 ceph-mon[22342]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:39.619 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:52:39.619 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:39.619 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:39 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' 2024-08-20T04:52:39.620 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:39 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/530998964' entity='client.admin' 2024-08-20T04:52:39.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:39 smithi130 ceph-mon[22007]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:39.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:52:39.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:39.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:39 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' 2024-08-20T04:52:39.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:39 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/530998964' entity='client.admin' 2024-08-20T04:52:39.719 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:39.719 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:39.720 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.872+0000 7f4ff7e00640 1 -- 172.21.15.37:0/1130582222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ff0104950 msgr2=0x7f4ff0104d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.872+0000 7f4ff7e00640 1 --2- 172.21.15.37:0/1130582222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ff0104950 0x7f4ff0104d50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4009cd0 tx=0x7f4fe402a8e0 comp rx=0 tx=0).stop 2024-08-20T04:52:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.873+0000 7f4ff7e00640 1 -- 172.21.15.37:0/1130582222 shutdown_connections 2024-08-20T04:52:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.873+0000 7f4ff7e00640 1 --2- 172.21.15.37:0/1130582222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff0106470 0x7f4ff010cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.873+0000 7f4ff7e00640 1 --2- 172.21.15.37:0/1130582222 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ff0105ab0 0x7f4ff0105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.873+0000 7f4ff7e00640 1 --2- 172.21.15.37:0/1130582222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ff0104950 0x7f4ff0104d50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:40.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.873+0000 7f4ff7e00640 1 -- 172.21.15.37:0/1130582222 >> 172.21.15.37:0/1130582222 conn(0x7f4ff0100200 msgr2=0x7f4ff0102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.873+0000 7f4ff7e00640 1 -- 172.21.15.37:0/1130582222 shutdown_connections 2024-08-20T04:52:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.873+0000 7f4ff7e00640 1 -- 172.21.15.37:0/1130582222 wait complete. 2024-08-20T04:52:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.874+0000 7f4ff7e00640 1 Processor -- start 2024-08-20T04:52:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.874+0000 7f4ff7e00640 1 -- start start 2024-08-20T04:52:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.874+0000 7f4ff7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff0104950 0x7f4ff019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.874+0000 7f4ff7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ff0105ab0 0x7f4ff019b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.874+0000 7f4ff7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ff0106470 0x7f4ff019bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.874+0000 7f4ff7e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff01102f0 con 0x7f4ff0105ab0 2024-08-20T04:52:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.874+0000 7f4ff7e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff0110170 con 0x7f4ff0106470 2024-08-20T04:52:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.874+0000 7f4ff7e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff0110470 con 0x7f4ff0104950 2024-08-20T04:52:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.874+0000 7f4ff5400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff0104950 0x7f4ff019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:40.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.874+0000 7f4ff5400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff0104950 0x7f4ff019aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:48634/0 (socket says 172.21.15.37:48634) 2024-08-20T04:52:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.874+0000 7f4ff5400640 1 -- 172.21.15.37:0/2838626961 learned_addr learned my addr 172.21.15.37:0/2838626961 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.874+0000 7f4ff4a00640 1 --2- 172.21.15.37:0/2838626961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ff0105ab0 0x7f4ff019b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.875+0000 7f4ff5e00640 1 --2- 172.21.15.37:0/2838626961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ff0106470 0x7f4ff019bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.875+0000 7f4ff5400640 1 -- 172.21.15.37:0/2838626961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ff0106470 msgr2=0x7f4ff019bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.875+0000 7f4ff5400640 1 --2- 172.21.15.37:0/2838626961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ff0106470 0x7f4ff019bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.875+0000 7f4ff5400640 1 -- 172.21.15.37:0/2838626961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ff0105ab0 msgr2=0x7f4ff019b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.875+0000 7f4ff5400640 1 --2- 172.21.15.37:0/2838626961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ff0105ab0 0x7f4ff019b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.875+0000 7f4ff5400640 1 -- 172.21.15.37:0/2838626961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff019c5d0 con 0x7f4ff0104950 2024-08-20T04:52:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.875+0000 7f4ff5e00640 1 --2- 172.21.15.37:0/2838626961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ff0106470 0x7f4ff019bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T04:52:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.875+0000 7f4ff4a00640 1 --2- 172.21.15.37:0/2838626961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ff0105ab0 0x7f4ff019b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:52:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.875+0000 7f4ff5400640 1 --2- 172.21.15.37:0/2838626961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff0104950 0x7f4ff019aaa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4000f80 tx=0x7f4fe4003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:40.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.875+0000 7f4fee000640 1 -- 172.21.15.37:0/2838626961 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4004240 con 0x7f4ff0104950 2024-08-20T04:52:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.875+0000 7f4fee000640 1 -- 172.21.15.37:0/2838626961 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(23 keys) ==== 1014+0+0 (secure 0 0 0) 0x7f4fe4004840 con 0x7f4ff0104950 2024-08-20T04:52:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.875+0000 7f4ff7e00640 1 -- 172.21.15.37:0/2838626961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff019c860 con 0x7f4ff0104950 2024-08-20T04:52:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.875+0000 7f4fee000640 1 -- 172.21.15.37:0/2838626961 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4030d90 con 0x7f4ff0104950 2024-08-20T04:52:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.876+0000 7f4ff7e00640 1 -- 172.21.15.37:0/2838626961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff01a2fa0 con 0x7f4ff0104950 2024-08-20T04:52:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.877+0000 7f4fee000640 1 -- 172.21.15.37:0/2838626961 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7f4fe40043e0 con 0x7f4ff0104950 2024-08-20T04:52:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.877+0000 7f4ff7e00640 1 -- 172.21.15.37:0/2838626961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff0104d50 con 0x7f4ff0104950 2024-08-20T04:52:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.877+0000 7f4fee000640 1 --2- 172.21.15.37:0/2838626961 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4fd803ed60 0x7f4fd8041220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.877+0000 7f4fee000640 1 -- 172.21.15.37:0/2838626961 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4fe402e030 con 0x7f4ff0104950 2024-08-20T04:52:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.877+0000 7f4ff4a00640 1 --2- 172.21.15.37:0/2838626961 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4fd803ed60 0x7f4fd8041220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.878+0000 7f4ff4a00640 1 --2- 172.21.15.37:0/2838626961 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4fd803ed60 0x7f4fd8041220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009fc0 tx=0x7f4fdc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.882+0000 7f4fee000640 1 -- 172.21.15.37:0/2838626961 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4fe404b060 con 0x7f4ff0104950 2024-08-20T04:52:40.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:33.986+0000 7f4fee000640 1 -- 172.21.15.37:0/2838626961 <== mon.1 v2:172.21.15.135:3300/0 7 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f4fe404edc0 con 0x7f4ff0104950 2024-08-20T04:52:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.093+0000 7f4ff7e00640 1 -- 172.21.15.37:0/2838626961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f4ff01a3530 con 0x7f4ff0104950 2024-08-20T04:52:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.100+0000 7f4fee000640 1 -- 172.21.15.37:0/2838626961 <== mon.1 v2:172.21.15.135:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7f4fe40469a0 con 0x7f4ff0104950 2024-08-20T04:52:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.103+0000 7f4ff7e00640 1 -- 172.21.15.37:0/2838626961 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4fd803ed60 msgr2=0x7f4fd8041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.103+0000 7f4ff7e00640 1 --2- 172.21.15.37:0/2838626961 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4fd803ed60 0x7f4fd8041220 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009fc0 tx=0x7f4fdc005f90 comp rx=0 tx=0).stop 2024-08-20T04:52:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.103+0000 7f4ff7e00640 1 -- 172.21.15.37:0/2838626961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff0104950 msgr2=0x7f4ff019aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.103+0000 7f4ff7e00640 1 --2- 172.21.15.37:0/2838626961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff0104950 0x7f4ff019aaa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4000f80 tx=0x7f4fe4003ba0 comp rx=0 tx=0).stop 2024-08-20T04:52:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.103+0000 7f4ff7e00640 1 -- 172.21.15.37:0/2838626961 shutdown_connections 2024-08-20T04:52:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.103+0000 7f4ff7e00640 1 --2- 172.21.15.37:0/2838626961 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4fd803ed60 0x7f4fd8041220 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.103+0000 7f4ff7e00640 1 --2- 172.21.15.37:0/2838626961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ff0106470 0x7f4ff019bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.103+0000 7f4ff7e00640 1 --2- 172.21.15.37:0/2838626961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ff0105ab0 0x7f4ff019b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.103+0000 7f4ff7e00640 1 --2- 172.21.15.37:0/2838626961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ff0104950 0x7f4ff019aaa0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:40.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.103+0000 7f4ff7e00640 1 -- 172.21.15.37:0/2838626961 >> 172.21.15.37:0/2838626961 conn(0x7f4ff0100200 msgr2=0x7f4ff0106e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.103+0000 7f4ff7e00640 1 -- 172.21.15.37:0/2838626961 shutdown_connections 2024-08-20T04:52:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.103+0000 7f4ff7e00640 1 -- 172.21.15.37:0/2838626961 wait complete. 2024-08-20T04:52:40.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:40 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:40 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:40 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:40 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:40 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:40.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:40 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:40.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:40 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:40 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:52:40.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:40 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:40.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:40 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:40.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:40 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:40 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' 2024-08-20T04:52:40.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:40 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:40 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:40 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:40 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:40 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:40.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:40 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:40.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:40 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:40 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:52:40.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:40 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:40.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:40 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:40.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:40 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:40 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' 2024-08-20T04:52:40.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:40 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:40 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:40 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:40 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:40 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:40.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:40 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:40.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:40 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:40 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:52:40.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:40 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:52:40.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:40 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:52:40.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:40 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:52:40.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:40 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' 2024-08-20T04:52:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.943+0000 7fd1d1000640 1 -- 172.21.15.37:0/3968399954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc10a670 msgr2=0x7fd1cc10cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.943+0000 7fd1d1000640 1 --2- 172.21.15.37:0/3968399954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc10a670 0x7fd1cc10cb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4009ca0 tx=0x7fd1c402a8c0 comp rx=0 tx=0).stop 2024-08-20T04:52:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.943+0000 7fd1d1000640 1 -- 172.21.15.37:0/3968399954 shutdown_connections 2024-08-20T04:52:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.943+0000 7fd1d1000640 1 --2- 172.21.15.37:0/3968399954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc10a670 0x7fd1cc10cb30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.943+0000 7fd1d1000640 1 --2- 172.21.15.37:0/3968399954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1cc107cc0 0x7fd1cc10a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.943+0000 7fd1d1000640 1 --2- 172.21.15.37:0/3968399954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1cc06bc50 0x7fd1cc107780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.943+0000 7fd1d1000640 1 -- 172.21.15.37:0/3968399954 >> 172.21.15.37:0/3968399954 conn(0x7fd1cc0fcf30 msgr2=0x7fd1cc0ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.943+0000 7fd1d1000640 1 -- 172.21.15.37:0/3968399954 shutdown_connections 2024-08-20T04:52:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.943+0000 7fd1d1000640 1 -- 172.21.15.37:0/3968399954 wait complete. 2024-08-20T04:52:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.945+0000 7fd1d1000640 1 Processor -- start 2024-08-20T04:52:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.945+0000 7fd1d1000640 1 -- start start 2024-08-20T04:52:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.945+0000 7fd1d1000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc06bc50 0x7fd1cc19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.945+0000 7fd1d1000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1cc107cc0 0x7fd1cc19b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.945+0000 7fd1d1000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1cc10a670 0x7fd1cc19bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.945+0000 7fd1d1000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc1104b0 con 0x7fd1cc06bc50 2024-08-20T04:52:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.945+0000 7fd1d1000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc110330 con 0x7fd1cc107cc0 2024-08-20T04:52:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.945+0000 7fd1d1000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc110630 con 0x7fd1cc10a670 2024-08-20T04:52:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.945+0000 7fd1c9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc06bc50 0x7fd1cc19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.946+0000 7fd1c9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc06bc50 0x7fd1cc19ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53956/0 (socket says 172.21.15.37:53956) 2024-08-20T04:52:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.946+0000 7fd1c9e00640 1 -- 172.21.15.37:0/1757723418 learned_addr learned my addr 172.21.15.37:0/1757723418 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.946+0000 7fd1c9400640 1 --2- 172.21.15.37:0/1757723418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1cc107cc0 0x7fd1cc19b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.946+0000 7fd1ca800640 1 --2- 172.21.15.37:0/1757723418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1cc10a670 0x7fd1cc19bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.946+0000 7fd1c9e00640 1 -- 172.21.15.37:0/1757723418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1cc10a670 msgr2=0x7fd1cc19bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.946+0000 7fd1c9e00640 1 --2- 172.21.15.37:0/1757723418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1cc10a670 0x7fd1cc19bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.946+0000 7fd1c9e00640 1 -- 172.21.15.37:0/1757723418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1cc107cc0 msgr2=0x7fd1cc19b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.946+0000 7fd1c9e00640 1 --2- 172.21.15.37:0/1757723418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1cc107cc0 0x7fd1cc19b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.946+0000 7fd1c9e00640 1 -- 172.21.15.37:0/1757723418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1cc19c740 con 0x7fd1cc06bc50 2024-08-20T04:52:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.946+0000 7fd1c9e00640 1 --2- 172.21.15.37:0/1757723418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc06bc50 0x7fd1cc19ac10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00e9f0 tx=0x7fd1bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.946+0000 7fd1c2a00640 1 -- 172.21.15.37:0/1757723418 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc00cd80 con 0x7fd1cc06bc50 2024-08-20T04:52:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.947+0000 7fd1c2a00640 1 -- 172.21.15.37:0/1757723418 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fd1bc0054b0 con 0x7fd1cc06bc50 2024-08-20T04:52:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.947+0000 7fd1d1000640 1 -- 172.21.15.37:0/1757723418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1cc19ca30 con 0x7fd1cc06bc50 2024-08-20T04:52:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.947+0000 7fd1c2a00640 1 -- 172.21.15.37:0/1757723418 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc010430 con 0x7fd1cc06bc50 2024-08-20T04:52:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.947+0000 7fd1d1000640 1 -- 172.21.15.37:0/1757723418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1cc1a3110 con 0x7fd1cc06bc50 2024-08-20T04:52:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.948+0000 7fd1c2a00640 1 -- 172.21.15.37:0/1757723418 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7fd1bc005020 con 0x7fd1cc06bc50 2024-08-20T04:52:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.948+0000 7fd1d1000640 1 -- 172.21.15.37:0/1757723418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1cc19cc90 con 0x7fd1cc06bc50 2024-08-20T04:52:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.948+0000 7fd1c2a00640 1 --2- 172.21.15.37:0/1757723418 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd1b003ed60 0x7fd1b0041220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.948+0000 7fd1c2a00640 1 -- 172.21.15.37:0/1757723418 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd1bc053800 con 0x7fd1cc06bc50 2024-08-20T04:52:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.949+0000 7fd1c9400640 1 --2- 172.21.15.37:0/1757723418 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd1b003ed60 0x7fd1b0041220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.949+0000 7fd1c9400640 1 --2- 172.21.15.37:0/1757723418 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd1b003ed60 0x7fd1b0041220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40095f0 tx=0x7fd1b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:34.953+0000 7fd1c2a00640 1 -- 172.21.15.37:0/1757723418 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd1bc01fe10 con 0x7fd1cc06bc50 2024-08-20T04:52:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.151+0000 7fd1d1000640 1 -- 172.21.15.37:0/1757723418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fd1cc0fea20 con 0x7fd1cc06bc50 2024-08-20T04:52:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.157+0000 7fd1c2a00640 1 -- 172.21.15.37:0/1757723418 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v17)=0 v17) ==== 106+0+0 (secure 0 0 0) 0x7fd1bc00fca0 con 0x7fd1cc06bc50 2024-08-20T04:52:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.159+0000 7fd1d1000640 1 -- 172.21.15.37:0/1757723418 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd1b003ed60 msgr2=0x7fd1b0041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.159+0000 7fd1d1000640 1 --2- 172.21.15.37:0/1757723418 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd1b003ed60 0x7fd1b0041220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd1b40095f0 tx=0x7fd1b4005f90 comp rx=0 tx=0).stop 2024-08-20T04:52:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.159+0000 7fd1d1000640 1 -- 172.21.15.37:0/1757723418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc06bc50 msgr2=0x7fd1cc19ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.159+0000 7fd1d1000640 1 --2- 172.21.15.37:0/1757723418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc06bc50 0x7fd1cc19ac10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc00e9f0 tx=0x7fd1bc00edf0 comp rx=0 tx=0).stop 2024-08-20T04:52:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.160+0000 7fd1d1000640 1 -- 172.21.15.37:0/1757723418 shutdown_connections 2024-08-20T04:52:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.160+0000 7fd1d1000640 1 --2- 172.21.15.37:0/1757723418 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd1b003ed60 0x7fd1b0041220 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.160+0000 7fd1d1000640 1 --2- 172.21.15.37:0/1757723418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1cc10a670 0x7fd1cc19bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.160+0000 7fd1d1000640 1 --2- 172.21.15.37:0/1757723418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1cc107cc0 0x7fd1cc19b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.160+0000 7fd1d1000640 1 --2- 172.21.15.37:0/1757723418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1cc06bc50 0x7fd1cc19ac10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.160+0000 7fd1d1000640 1 -- 172.21.15.37:0/1757723418 >> 172.21.15.37:0/1757723418 conn(0x7fd1cc0fcf30 msgr2=0x7fd1cc108a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.160+0000 7fd1d1000640 1 -- 172.21.15.37:0/1757723418 shutdown_connections 2024-08-20T04:52:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:35.160+0000 7fd1d1000640 1 -- 172.21.15.37:0/1757723418 wait complete. 2024-08-20T04:52:41.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:41 smithi135 ceph-mon[22342]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:41.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:41 smithi135 ceph-mon[22342]: Standby manager daemon z started 2024-08-20T04:52:41.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:41 smithi135 ceph-mon[22342]: from='mgr.? 172.21.15.135:0/1340747873' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-20T04:52:41.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:41 smithi135 ceph-mon[22342]: from='mgr.? 172.21.15.135:0/1340747873' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T04:52:41.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:41 smithi135 ceph-mon[22342]: from='mgr.? 172.21.15.135:0/1340747873' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-20T04:52:41.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:41 smithi135 ceph-mon[22342]: from='mgr.? 172.21.15.135:0/1340747873' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T04:52:41.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:41 smithi037 ceph-mon[17265]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:41.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:41 smithi037 ceph-mon[17265]: Standby manager daemon z started 2024-08-20T04:52:41.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:41 smithi037 ceph-mon[17265]: from='mgr.? 172.21.15.135:0/1340747873' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-20T04:52:41.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:41 smithi037 ceph-mon[17265]: from='mgr.? 172.21.15.135:0/1340747873' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T04:52:41.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:41 smithi037 ceph-mon[17265]: from='mgr.? 172.21.15.135:0/1340747873' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-20T04:52:41.915 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:41 smithi037 ceph-mon[17265]: from='mgr.? 172.21.15.135:0/1340747873' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T04:52:41.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:41 smithi130 ceph-mon[22007]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:41.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:41 smithi130 ceph-mon[22007]: Standby manager daemon z started 2024-08-20T04:52:41.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:41 smithi130 ceph-mon[22007]: from='mgr.? 172.21.15.135:0/1340747873' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-08-20T04:52:41.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:41 smithi130 ceph-mon[22007]: from='mgr.? 172.21.15.135:0/1340747873' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T04:52:41.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:41 smithi130 ceph-mon[22007]: from='mgr.? 172.21.15.135:0/1340747873' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-08-20T04:52:41.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:41 smithi130 ceph-mon[22007]: from='mgr.? 172.21.15.135:0/1340747873' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T04:52:42.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.367+0000 7fbbe8e00640 1 -- 172.21.15.37:0/1918168774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbe4106460 msgr2=0x7fbbe410cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:42.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.367+0000 7fbbe8e00640 1 --2- 172.21.15.37:0/1918168774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbe4106460 0x7fbbe410cde0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009c40 tx=0x7fbbdc02a720 comp rx=0 tx=0).stop 2024-08-20T04:52:42.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.368+0000 7fbbe8e00640 1 -- 172.21.15.37:0/1918168774 shutdown_connections 2024-08-20T04:52:42.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.368+0000 7fbbe8e00640 1 --2- 172.21.15.37:0/1918168774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbe4106460 0x7fbbe410cde0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:42.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.368+0000 7fbbe8e00640 1 --2- 172.21.15.37:0/1918168774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe4105aa0 0x7fbbe4105f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:42.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.368+0000 7fbbe8e00640 1 --2- 172.21.15.37:0/1918168774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4104940 0x7fbbe4104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:42.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.368+0000 7fbbe8e00640 1 -- 172.21.15.37:0/1918168774 >> 172.21.15.37:0/1918168774 conn(0x7fbbe4100210 msgr2=0x7fbbe4102650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:42.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.368+0000 7fbbe8e00640 1 -- 172.21.15.37:0/1918168774 shutdown_connections 2024-08-20T04:52:42.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.368+0000 7fbbe8e00640 1 -- 172.21.15.37:0/1918168774 wait complete. 2024-08-20T04:52:42.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.369+0000 7fbbe8e00640 1 Processor -- start 2024-08-20T04:52:42.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.369+0000 7fbbe8e00640 1 -- start start 2024-08-20T04:52:42.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.369+0000 7fbbe8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbe4104940 0x7fbbe419ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:42.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.369+0000 7fbbe8e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4105aa0 0x7fbbe419b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:42.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.369+0000 7fbbe8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe4106460 0x7fbbe419bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:42.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.369+0000 7fbbe8e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe4110460 con 0x7fbbe4106460 2024-08-20T04:52:42.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.369+0000 7fbbe8e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe41102e0 con 0x7fbbe4105aa0 2024-08-20T04:52:42.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.369+0000 7fbbe8e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbbe41105e0 con 0x7fbbe4104940 2024-08-20T04:52:42.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.369+0000 7fbbe1e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbe4104940 0x7fbbe419ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:42.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.369+0000 7fbbe1e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbe4104940 0x7fbbe419ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:48752/0 (socket says 172.21.15.37:48752) 2024-08-20T04:52:42.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.369+0000 7fbbe1e00640 1 -- 172.21.15.37:0/2605938390 learned_addr learned my addr 172.21.15.37:0/2605938390 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:42.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.369+0000 7fbbdbe00640 1 --2- 172.21.15.37:0/2605938390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4105aa0 0x7fbbe419b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:42.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.369+0000 7fbbe2800640 1 --2- 172.21.15.37:0/2605938390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe4106460 0x7fbbe419bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:42.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.370+0000 7fbbe1e00640 1 -- 172.21.15.37:0/2605938390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4105aa0 msgr2=0x7fbbe419b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:42.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.370+0000 7fbbe1e00640 1 --2- 172.21.15.37:0/2605938390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4105aa0 0x7fbbe419b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:42.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.370+0000 7fbbe1e00640 1 -- 172.21.15.37:0/2605938390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe4106460 msgr2=0x7fbbe419bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:42.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.370+0000 7fbbe1e00640 1 --2- 172.21.15.37:0/2605938390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe4106460 0x7fbbe419bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:42.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.370+0000 7fbbe1e00640 1 -- 172.21.15.37:0/2605938390 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbe419c740 con 0x7fbbe4104940 2024-08-20T04:52:42.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.370+0000 7fbbe1e00640 1 --2- 172.21.15.37:0/2605938390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbe4104940 0x7fbbe419ac10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400d950 tx=0x7fbbd400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:42.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.370+0000 7fbbdaa00640 1 -- 172.21.15.37:0/2605938390 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4017030 con 0x7fbbe4104940 2024-08-20T04:52:42.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.370+0000 7fbbdaa00640 1 -- 172.21.15.37:0/2605938390 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fbbd4004020 con 0x7fbbe4104940 2024-08-20T04:52:42.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.370+0000 7fbbdaa00640 1 -- 172.21.15.37:0/2605938390 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd40055e0 con 0x7fbbe4104940 2024-08-20T04:52:42.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.370+0000 7fbbe8e00640 1 -- 172.21.15.37:0/2605938390 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbe419ca30 con 0x7fbbe4104940 2024-08-20T04:52:42.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.370+0000 7fbbe8e00640 1 -- 172.21.15.37:0/2605938390 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbe41a3110 con 0x7fbbe4104940 2024-08-20T04:52:42.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.371+0000 7fbbdaa00640 1 -- 172.21.15.37:0/2605938390 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 13) ==== 50747+0+0 (secure 0 0 0) 0x7fbbd4009a30 con 0x7fbbe4104940 2024-08-20T04:52:42.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.371+0000 7fbbe8e00640 1 -- 172.21.15.37:0/2605938390 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbe419cc90 con 0x7fbbe4104940 2024-08-20T04:52:42.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.372+0000 7fbbdaa00640 1 --2- 172.21.15.37:0/2605938390 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbbc803ed60 0x7fbbc8041220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:42.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.372+0000 7fbbdaa00640 1 -- 172.21.15.37:0/2605938390 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbbd4052cd0 con 0x7fbbe4104940 2024-08-20T04:52:42.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.372+0000 7fbbdbe00640 1 --2- 172.21.15.37:0/2605938390 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbbc803ed60 0x7fbbc8041220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:42.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.373+0000 7fbbdbe00640 1 --2- 172.21.15.37:0/2605938390 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbbc803ed60 0x7fbbc8041220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0096c0 tx=0x7fbbcc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:42.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.377+0000 7fbbdaa00640 1 -- 172.21.15.37:0/2605938390 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fbbd400f3c0 con 0x7fbbe4104940 2024-08-20T04:52:42.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.572+0000 7fbbe8e00640 1 -- 172.21.15.37:0/2605938390 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fbbe410bcc0 con 0x7fbbe4104940 2024-08-20T04:52:42.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.577+0000 7fbbdaa00640 1 -- 172.21.15.37:0/2605938390 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v20)=0 v20) ==== 118+0+0 (secure 0 0 0) 0x7fbbd4021200 con 0x7fbbe4104940 2024-08-20T04:52:42.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.579+0000 7fbbe8e00640 1 -- 172.21.15.37:0/2605938390 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbbc803ed60 msgr2=0x7fbbc8041220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:42.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.579+0000 7fbbe8e00640 1 --2- 172.21.15.37:0/2605938390 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbbc803ed60 0x7fbbc8041220 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc0096c0 tx=0x7fbbcc009260 comp rx=0 tx=0).stop 2024-08-20T04:52:42.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.579+0000 7fbbe8e00640 1 -- 172.21.15.37:0/2605938390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbe4104940 msgr2=0x7fbbe419ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:42.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.579+0000 7fbbe8e00640 1 --2- 172.21.15.37:0/2605938390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbe4104940 0x7fbbe419ac10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400d950 tx=0x7fbbd400de10 comp rx=0 tx=0).stop 2024-08-20T04:52:42.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.579+0000 7fbbe8e00640 1 -- 172.21.15.37:0/2605938390 shutdown_connections 2024-08-20T04:52:42.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.579+0000 7fbbe8e00640 1 --2- 172.21.15.37:0/2605938390 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbbc803ed60 0x7fbbc8041220 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:42.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.579+0000 7fbbe8e00640 1 --2- 172.21.15.37:0/2605938390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe4106460 0x7fbbe419bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:42.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.579+0000 7fbbe8e00640 1 --2- 172.21.15.37:0/2605938390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbbe4105aa0 0x7fbbe419b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:42.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.579+0000 7fbbe8e00640 1 --2- 172.21.15.37:0/2605938390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbbe4104940 0x7fbbe419ac10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:42.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.579+0000 7fbbe8e00640 1 -- 172.21.15.37:0/2605938390 >> 172.21.15.37:0/2605938390 conn(0x7fbbe4100210 msgr2=0x7fbbe4108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:42.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.580+0000 7fbbe8e00640 1 -- 172.21.15.37:0/2605938390 shutdown_connections 2024-08-20T04:52:42.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:37.580+0000 7fbbe8e00640 1 -- 172.21.15.37:0/2605938390 wait complete. 2024-08-20T04:52:42.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:42 smithi135 ceph-mon[22342]: mgrmap e14: x(active, since 73s), standbys: z 2024-08-20T04:52:42.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:42 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-20T04:52:42.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:42 smithi130 ceph-mon[22007]: mgrmap e14: x(active, since 73s), standbys: z 2024-08-20T04:52:42.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:42 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-20T04:52:42.979 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:42 smithi037 ceph-mon[17265]: mgrmap e14: x(active, since 73s), standbys: z 2024-08-20T04:52:42.979 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:42 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-08-20T04:52:43.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.119+0000 7eff8d600640 1 -- 172.21.15.37:0/2004481889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff88104950 msgr2=0x7eff88104d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:43.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.119+0000 7eff8d600640 1 --2- 172.21.15.37:0/2004481889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff88104950 0x7eff88104d50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7eff78009930 tx=0x7eff7802a420 comp rx=0 tx=0).stop 2024-08-20T04:52:43.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.119+0000 7eff8d600640 1 -- 172.21.15.37:0/2004481889 shutdown_connections 2024-08-20T04:52:43.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.119+0000 7eff8d600640 1 --2- 172.21.15.37:0/2004481889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff88106470 0x7eff8810cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:43.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.119+0000 7eff8d600640 1 --2- 172.21.15.37:0/2004481889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff88105ab0 0x7eff88105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:43.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.119+0000 7eff8d600640 1 --2- 172.21.15.37:0/2004481889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff88104950 0x7eff88104d50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:43.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.119+0000 7eff8d600640 1 -- 172.21.15.37:0/2004481889 >> 172.21.15.37:0/2004481889 conn(0x7eff88100200 msgr2=0x7eff88102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:43.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.120+0000 7eff8d600640 1 -- 172.21.15.37:0/2004481889 shutdown_connections 2024-08-20T04:52:43.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.120+0000 7eff8d600640 1 -- 172.21.15.37:0/2004481889 wait complete. 2024-08-20T04:52:43.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.121+0000 7eff8d600640 1 Processor -- start 2024-08-20T04:52:43.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.121+0000 7eff8d600640 1 -- start start 2024-08-20T04:52:43.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.121+0000 7eff8d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff88104950 0x7eff8819ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:43.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.121+0000 7eff8d600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff88105ab0 0x7eff8819b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:43.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.121+0000 7eff8d600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff88106470 0x7eff8819bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:43.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.121+0000 7eff8d600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff88110600 con 0x7eff88104950 2024-08-20T04:52:43.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.121+0000 7eff8d600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7eff88110480 con 0x7eff88106470 2024-08-20T04:52:43.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.121+0000 7eff8d600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7eff88110780 con 0x7eff88105ab0 2024-08-20T04:52:43.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.121+0000 7eff86a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff88104950 0x7eff8819ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:43.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.121+0000 7eff87400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff88106470 0x7eff8819bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:43.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.121+0000 7eff86000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff88105ab0 0x7eff8819b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:43.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.121+0000 7eff87400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff88106470 0x7eff8819bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:48572/0 (socket says 172.21.15.37:48572) 2024-08-20T04:52:43.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.121+0000 7eff87400640 1 -- 172.21.15.37:0/2133480598 learned_addr learned my addr 172.21.15.37:0/2133480598 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:43.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.121+0000 7eff86000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff88105ab0 0x7eff8819b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52650/0 (socket says 172.21.15.37:52650) 2024-08-20T04:52:43.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.122+0000 7eff87400640 1 -- 172.21.15.37:0/2133480598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff88105ab0 msgr2=0x7eff8819b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:43.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.122+0000 7eff87400640 1 --2- 172.21.15.37:0/2133480598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff88105ab0 0x7eff8819b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:43.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.122+0000 7eff87400640 1 -- 172.21.15.37:0/2133480598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff88104950 msgr2=0x7eff8819ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:43.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.122+0000 7eff87400640 1 --2- 172.21.15.37:0/2133480598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff88104950 0x7eff8819ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:43.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.122+0000 7eff87400640 1 -- 172.21.15.37:0/2133480598 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff8819c850 con 0x7eff88106470 2024-08-20T04:52:43.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.122+0000 7eff87400640 1 --2- 172.21.15.37:0/2133480598 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff88106470 0x7eff8819bfb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7eff8000efd0 tx=0x7eff8000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:43.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.122+0000 7eff7f400640 1 -- 172.21.15.37:0/2133480598 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff80003b70 con 0x7eff88106470 2024-08-20T04:52:43.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.122+0000 7eff8d600640 1 -- 172.21.15.37:0/2133480598 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff8819cb40 con 0x7eff88106470 2024-08-20T04:52:43.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.122+0000 7eff7f400640 1 -- 172.21.15.37:0/2133480598 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff80003d10 con 0x7eff88106470 2024-08-20T04:52:43.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.122+0000 7eff7f400640 1 -- 172.21.15.37:0/2133480598 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff800108a0 con 0x7eff88106470 2024-08-20T04:52:43.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.123+0000 7eff8d600640 1 -- 172.21.15.37:0/2133480598 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff881a3220 con 0x7eff88106470 2024-08-20T04:52:43.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.124+0000 7eff8d600640 1 -- 172.21.15.37:0/2133480598 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff8810bcd0 con 0x7eff88106470 2024-08-20T04:52:43.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.125+0000 7eff7f400640 1 -- 172.21.15.37:0/2133480598 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 14) ==== 100875+0+0 (secure 0 0 0) 0x7eff80004020 con 0x7eff88106470 2024-08-20T04:52:43.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.126+0000 7eff7f400640 1 --2- 172.21.15.37:0/2133480598 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff6c079450 0x7eff6c07b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:43.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.126+0000 7eff7f400640 1 -- 172.21.15.37:0/2133480598 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7eff8009acf0 con 0x7eff88106470 2024-08-20T04:52:43.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.126+0000 7eff86a00640 1 --2- 172.21.15.37:0/2133480598 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff6c079450 0x7eff6c07b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:43.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.126+0000 7eff86a00640 1 --2- 172.21.15.37:0/2133480598 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff6c079450 0x7eff6c07b910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7eff78009900 tx=0x7eff78031450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:43.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.130+0000 7eff7f400640 1 -- 172.21.15.37:0/2133480598 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7eff80063a40 con 0x7eff88106470 2024-08-20T04:52:43.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.328+0000 7eff8d600640 1 -- 172.21.15.37:0/2133480598 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7eff88063a80 con 0x7eff88106470 2024-08-20T04:52:43.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.333+0000 7eff7f400640 1 -- 172.21.15.37:0/2133480598 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v24)=0 v24) ==== 117+0+0 (secure 0 0 0) 0x7eff80067f90 con 0x7eff88106470 2024-08-20T04:52:43.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.336+0000 7eff8d600640 1 -- 172.21.15.37:0/2133480598 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff6c079450 msgr2=0x7eff6c07b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:43.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.336+0000 7eff8d600640 1 --2- 172.21.15.37:0/2133480598 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff6c079450 0x7eff6c07b910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7eff78009900 tx=0x7eff78031450 comp rx=0 tx=0).stop 2024-08-20T04:52:43.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.336+0000 7eff8d600640 1 -- 172.21.15.37:0/2133480598 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff88106470 msgr2=0x7eff8819bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:43.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.336+0000 7eff8d600640 1 --2- 172.21.15.37:0/2133480598 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff88106470 0x7eff8819bfb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7eff8000efd0 tx=0x7eff8000c6a0 comp rx=0 tx=0).stop 2024-08-20T04:52:43.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.336+0000 7eff8d600640 1 -- 172.21.15.37:0/2133480598 shutdown_connections 2024-08-20T04:52:43.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.336+0000 7eff8d600640 1 --2- 172.21.15.37:0/2133480598 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff6c079450 0x7eff6c07b910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:43.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.336+0000 7eff8d600640 1 --2- 172.21.15.37:0/2133480598 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff88106470 0x7eff8819bfb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:43.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.336+0000 7eff8d600640 1 --2- 172.21.15.37:0/2133480598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff88105ab0 0x7eff8819b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:43.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.336+0000 7eff8d600640 1 --2- 172.21.15.37:0/2133480598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff88104950 0x7eff8819ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:43.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.336+0000 7eff8d600640 1 -- 172.21.15.37:0/2133480598 >> 172.21.15.37:0/2133480598 conn(0x7eff88100200 msgr2=0x7eff88108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:43.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.336+0000 7eff8d600640 1 -- 172.21.15.37:0/2133480598 shutdown_connections 2024-08-20T04:52:43.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:43.336+0000 7eff8d600640 1 -- 172.21.15.37:0/2133480598 wait complete. 2024-08-20T04:52:43.858 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:43.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:43 smithi037 ceph-mon[17265]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:43.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:43 smithi037 ceph-mon[17265]: Standby manager daemon y started 2024-08-20T04:52:43.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:43 smithi037 ceph-mon[17265]: from='mgr.? 172.21.15.130:0/1364699421' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-20T04:52:43.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:43 smithi037 ceph-mon[17265]: from='mgr.? 172.21.15.130:0/1364699421' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T04:52:43.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:43 smithi037 ceph-mon[17265]: from='mgr.? 172.21.15.130:0/1364699421' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-20T04:52:43.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:43 smithi037 ceph-mon[17265]: from='mgr.? 172.21.15.130:0/1364699421' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T04:52:43.861 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:43 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' 2024-08-20T04:52:43.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:43 smithi135 ceph-mon[22342]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:43.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:43 smithi135 ceph-mon[22342]: Standby manager daemon y started 2024-08-20T04:52:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:43 smithi135 ceph-mon[22342]: from='mgr.? 172.21.15.130:0/1364699421' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-20T04:52:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:43 smithi135 ceph-mon[22342]: from='mgr.? 172.21.15.130:0/1364699421' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T04:52:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:43 smithi135 ceph-mon[22342]: from='mgr.? 172.21.15.130:0/1364699421' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-20T04:52:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:43 smithi135 ceph-mon[22342]: from='mgr.? 172.21.15.130:0/1364699421' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T04:52:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:43 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' 2024-08-20T04:52:43.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:43 smithi130 ceph-mon[22007]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:43.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:43 smithi130 ceph-mon[22007]: Standby manager daemon y started 2024-08-20T04:52:43.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:43 smithi130 ceph-mon[22007]: from='mgr.? 172.21.15.130:0/1364699421' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-08-20T04:52:43.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:43 smithi130 ceph-mon[22007]: from='mgr.? 172.21.15.130:0/1364699421' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-08-20T04:52:43.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:43 smithi130 ceph-mon[22007]: from='mgr.? 172.21.15.130:0/1364699421' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-08-20T04:52:43.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:43 smithi130 ceph-mon[22007]: from='mgr.? 172.21.15.130:0/1364699421' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-08-20T04:52:43.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:43 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' 2024-08-20T04:52:44.713 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:44 smithi037 ceph-mon[17265]: mgrmap e15: x(active, since 75s), standbys: z, y 2024-08-20T04:52:44.714 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:44 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-20T04:52:44.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:44 smithi135 ceph-mon[22342]: mgrmap e15: x(active, since 75s), standbys: z, y 2024-08-20T04:52:44.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:44 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-20T04:52:44.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:44 smithi130 ceph-mon[22007]: mgrmap e15: x(active, since 75s), standbys: z, y 2024-08-20T04:52:44.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:44 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-08-20T04:52:45.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.190+0000 7f5586400640 1 -- 172.21.15.37:0/3464630611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5580105ab0 msgr2=0x7f5580105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:45.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.190+0000 7f5586400640 1 --2- 172.21.15.37:0/3464630611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5580105ab0 0x7f5580105f30 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f556c009930 tx=0x7f556c02a420 comp rx=0 tx=0).stop 2024-08-20T04:52:45.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.190+0000 7f5586400640 1 -- 172.21.15.37:0/3464630611 shutdown_connections 2024-08-20T04:52:45.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.190+0000 7f5586400640 1 --2- 172.21.15.37:0/3464630611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5580106470 0x7f558010cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:45.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.190+0000 7f5586400640 1 --2- 172.21.15.37:0/3464630611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5580105ab0 0x7f5580105f30 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:45.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.190+0000 7f5586400640 1 --2- 172.21.15.37:0/3464630611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5580104950 0x7f5580104d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:45.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.190+0000 7f5586400640 1 -- 172.21.15.37:0/3464630611 >> 172.21.15.37:0/3464630611 conn(0x7f5580100200 msgr2=0x7f5580102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:45.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.190+0000 7f5586400640 1 -- 172.21.15.37:0/3464630611 shutdown_connections 2024-08-20T04:52:45.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.190+0000 7f5586400640 1 -- 172.21.15.37:0/3464630611 wait complete. 2024-08-20T04:52:45.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.191+0000 7f5586400640 1 Processor -- start 2024-08-20T04:52:45.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.191+0000 7f5586400640 1 -- start start 2024-08-20T04:52:45.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.192+0000 7f5586400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5580104950 0x7f558019ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:45.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.192+0000 7f5586400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5580105ab0 0x7f558019b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:45.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.192+0000 7f5586400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5580106470 0x7f558019bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.192+0000 7f5586400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5580110620 con 0x7f5580106470 2024-08-20T04:52:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.192+0000 7f5586400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f55801104a0 con 0x7f5580104950 2024-08-20T04:52:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.192+0000 7f5586400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55801107a0 con 0x7f5580105ab0 2024-08-20T04:52:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.192+0000 7f557fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5580106470 0x7f558019bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.192+0000 7f557fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5580106470 0x7f558019bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52782/0 (socket says 172.21.15.37:52782) 2024-08-20T04:52:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.192+0000 7f557fe00640 1 -- 172.21.15.37:0/2758651805 learned_addr learned my addr 172.21.15.37:0/2758651805 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.192+0000 7f557f400640 1 --2- 172.21.15.37:0/2758651805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5580104950 0x7f558019ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.192+0000 7f557ea00640 1 --2- 172.21.15.37:0/2758651805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5580105ab0 0x7f558019b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.192+0000 7f557fe00640 1 -- 172.21.15.37:0/2758651805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5580105ab0 msgr2=0x7f558019b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.192+0000 7f557fe00640 1 --2- 172.21.15.37:0/2758651805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5580105ab0 0x7f558019b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.192+0000 7f557fe00640 1 -- 172.21.15.37:0/2758651805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5580104950 msgr2=0x7f558019ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.192+0000 7f557fe00640 1 --2- 172.21.15.37:0/2758651805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5580104950 0x7f558019ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:45.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.192+0000 7f557fe00640 1 -- 172.21.15.37:0/2758651805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f558019c850 con 0x7f5580106470 2024-08-20T04:52:45.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.192+0000 7f557f400640 1 --2- 172.21.15.37:0/2758651805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5580104950 0x7f558019ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:52:45.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.193+0000 7f557fe00640 1 --2- 172.21.15.37:0/2758651805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5580106470 0x7f558019bfb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f557800eb10 tx=0x7f557800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:45.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.193+0000 7f5577e00640 1 -- 172.21.15.37:0/2758651805 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5578004b20 con 0x7f5580106470 2024-08-20T04:52:45.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.193+0000 7f5577e00640 1 -- 172.21.15.37:0/2758651805 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5578004cc0 con 0x7f5580106470 2024-08-20T04:52:45.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.193+0000 7f5586400640 1 -- 172.21.15.37:0/2758651805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f558019cb40 con 0x7f5580106470 2024-08-20T04:52:45.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.193+0000 7f5577e00640 1 -- 172.21.15.37:0/2758651805 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5578010670 con 0x7f5580106470 2024-08-20T04:52:45.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.193+0000 7f5586400640 1 -- 172.21.15.37:0/2758651805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55801a3220 con 0x7f5580106470 2024-08-20T04:52:45.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.195+0000 7f5586400640 1 -- 172.21.15.37:0/2758651805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f558010bcd0 con 0x7f5580106470 2024-08-20T04:52:45.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.199+0000 7f5577e00640 1 -- 172.21.15.37:0/2758651805 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f5578005000 con 0x7f5580106470 2024-08-20T04:52:45.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.200+0000 7f5577e00640 1 --2- 172.21.15.37:0/2758651805 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55640b3b40 0x7f55640b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:45.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.200+0000 7f5577e00640 1 -- 172.21.15.37:0/2758651805 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f55780e26e0 con 0x7f5580106470 2024-08-20T04:52:45.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.200+0000 7f557f400640 1 --2- 172.21.15.37:0/2758651805 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55640b3b40 0x7f55640b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:45.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.201+0000 7f557f400640 1 --2- 172.21.15.37:0/2758651805 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55640b3b40 0x7f55640b6000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f55700095f0 tx=0x7f5570005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:45.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.201+0000 7f5577e00640 1 -- 172.21.15.37:0/2758651805 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f5578055e20 con 0x7f5580106470 2024-08-20T04:52:45.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.398+0000 7f5586400640 1 -- 172.21.15.37:0/2758651805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f558002e340 con 0x7f5580106470 2024-08-20T04:52:45.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.403+0000 7f5577e00640 1 -- 172.21.15.37:0/2758651805 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v25)=0 v25) ==== 121+0+0 (secure 0 0 0) 0x7f55780ab960 con 0x7f5580106470 2024-08-20T04:52:45.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.405+0000 7f5586400640 1 -- 172.21.15.37:0/2758651805 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55640b3b40 msgr2=0x7f55640b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:45.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.405+0000 7f5586400640 1 --2- 172.21.15.37:0/2758651805 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55640b3b40 0x7f55640b6000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f55700095f0 tx=0x7f5570005f90 comp rx=0 tx=0).stop 2024-08-20T04:52:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.405+0000 7f5586400640 1 -- 172.21.15.37:0/2758651805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5580106470 msgr2=0x7f558019bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.405+0000 7f5586400640 1 --2- 172.21.15.37:0/2758651805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5580106470 0x7f558019bfb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f557800eb10 tx=0x7f557800c2d0 comp rx=0 tx=0).stop 2024-08-20T04:52:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.405+0000 7f5586400640 1 -- 172.21.15.37:0/2758651805 shutdown_connections 2024-08-20T04:52:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.405+0000 7f5586400640 1 --2- 172.21.15.37:0/2758651805 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55640b3b40 0x7f55640b6000 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.405+0000 7f5586400640 1 --2- 172.21.15.37:0/2758651805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5580106470 0x7f558019bfb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.405+0000 7f5586400640 1 --2- 172.21.15.37:0/2758651805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5580105ab0 0x7f558019b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.405+0000 7f5586400640 1 --2- 172.21.15.37:0/2758651805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5580104950 0x7f558019ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.405+0000 7f5586400640 1 -- 172.21.15.37:0/2758651805 >> 172.21.15.37:0/2758651805 conn(0x7f5580100200 msgr2=0x7f5580108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.406+0000 7f5586400640 1 -- 172.21.15.37:0/2758651805 shutdown_connections 2024-08-20T04:52:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:45.406+0000 7f5586400640 1 -- 172.21.15.37:0/2758651805 wait complete. 2024-08-20T04:52:45.538 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi037') 2024-08-20T04:52:45.539 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi037') 2024-08-20T04:52:45.719 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:45 smithi037 ceph-mon[17265]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:45.719 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:45 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2758651805' entity='client.admin' 2024-08-20T04:52:45.857 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:45 smithi130 ceph-mon[22007]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:45.857 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:45 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2758651805' entity='client.admin' 2024-08-20T04:52:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:45 smithi135 ceph-mon[22342]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:45 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2758651805' entity='client.admin' 2024-08-20T04:52:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.112+0000 7ff47ac00640 1 -- 172.21.15.37:0/3671141003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff474102730 msgr2=0x7ff474102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.112+0000 7ff47ac00640 1 --2- 172.21.15.37:0/3671141003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff474102730 0x7ff474102b30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff464009930 tx=0x7ff46402a420 comp rx=0 tx=0).stop 2024-08-20T04:52:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.112+0000 7ff47ac00640 1 -- 172.21.15.37:0/3671141003 shutdown_connections 2024-08-20T04:52:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.112+0000 7ff47ac00640 1 --2- 172.21.15.37:0/3671141003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff474104250 0x7ff47410abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.112+0000 7ff47ac00640 1 --2- 172.21.15.37:0/3671141003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff474103890 0x7ff474103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.112+0000 7ff47ac00640 1 --2- 172.21.15.37:0/3671141003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff474102730 0x7ff474102b30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.112+0000 7ff47ac00640 1 -- 172.21.15.37:0/3671141003 >> 172.21.15.37:0/3671141003 conn(0x7ff4740fe020 msgr2=0x7ff474100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.112+0000 7ff47ac00640 1 -- 172.21.15.37:0/3671141003 shutdown_connections 2024-08-20T04:52:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.112+0000 7ff47ac00640 1 -- 172.21.15.37:0/3671141003 wait complete. 2024-08-20T04:52:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.113+0000 7ff47ac00640 1 Processor -- start 2024-08-20T04:52:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.113+0000 7ff47ac00640 1 -- start start 2024-08-20T04:52:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.113+0000 7ff47ac00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff474102730 0x7ff47419ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.113+0000 7ff47ac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff474103890 0x7ff47419b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.113+0000 7ff47ac00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff474104250 0x7ff47419bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.113+0000 7ff47ac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff47410e3e0 con 0x7ff474103890 2024-08-20T04:52:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.113+0000 7ff47ac00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff47410e260 con 0x7ff474104250 2024-08-20T04:52:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.113+0000 7ff47ac00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff47410e560 con 0x7ff474102730 2024-08-20T04:52:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.114+0000 7ff473e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff474102730 0x7ff47419ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.114+0000 7ff473e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff474102730 0x7ff47419ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52686/0 (socket says 172.21.15.37:52686) 2024-08-20T04:52:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.114+0000 7ff473e00640 1 -- 172.21.15.37:0/2423212988 learned_addr learned my addr 172.21.15.37:0/2423212988 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.114+0000 7ff473400640 1 --2- 172.21.15.37:0/2423212988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff474103890 0x7ff47419b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.114+0000 7ff478c00640 1 --2- 172.21.15.37:0/2423212988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff474104250 0x7ff47419bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.114+0000 7ff473e00640 1 -- 172.21.15.37:0/2423212988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff474104250 msgr2=0x7ff47419bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.114+0000 7ff473e00640 1 --2- 172.21.15.37:0/2423212988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff474104250 0x7ff47419bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.114+0000 7ff473e00640 1 -- 172.21.15.37:0/2423212988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff474103890 msgr2=0x7ff47419b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.114+0000 7ff473e00640 1 --2- 172.21.15.37:0/2423212988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff474103890 0x7ff47419b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.114+0000 7ff473e00640 1 -- 172.21.15.37:0/2423212988 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47419c880 con 0x7ff474102730 2024-08-20T04:52:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.114+0000 7ff478c00640 1 --2- 172.21.15.37:0/2423212988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff474104250 0x7ff47419bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T04:52:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.114+0000 7ff473400640 1 --2- 172.21.15.37:0/2423212988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff474103890 0x7ff47419b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:52:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.114+0000 7ff473e00640 1 --2- 172.21.15.37:0/2423212988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff474102730 0x7ff47419ad50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff464031490 tx=0x7ff464003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.115+0000 7ff470c00640 1 -- 172.21.15.37:0/2423212988 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46403f070 con 0x7ff474102730 2024-08-20T04:52:46.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.115+0000 7ff47ac00640 1 -- 172.21.15.37:0/2423212988 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff47419cb10 con 0x7ff474102730 2024-08-20T04:52:46.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.115+0000 7ff470c00640 1 -- 172.21.15.37:0/2423212988 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff464031bf0 con 0x7ff474102730 2024-08-20T04:52:46.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.115+0000 7ff470c00640 1 -- 172.21.15.37:0/2423212988 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff464035030 con 0x7ff474102730 2024-08-20T04:52:46.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.115+0000 7ff47ac00640 1 -- 172.21.15.37:0/2423212988 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4741a3250 con 0x7ff474102730 2024-08-20T04:52:46.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.116+0000 7ff47ac00640 1 -- 172.21.15.37:0/2423212988 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff474102b30 con 0x7ff474102730 2024-08-20T04:52:46.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.118+0000 7ff470c00640 1 -- 172.21.15.37:0/2423212988 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7ff464042070 con 0x7ff474102730 2024-08-20T04:52:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.119+0000 7ff470c00640 1 --2- 172.21.15.37:0/2423212988 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4580b3b40 0x7ff4580b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.119+0000 7ff470c00640 1 -- 172.21.15.37:0/2423212988 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff4641026c0 con 0x7ff474102730 2024-08-20T04:52:46.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.120+0000 7ff473400640 1 --2- 172.21.15.37:0/2423212988 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4580b3b40 0x7ff4580b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:46.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.120+0000 7ff473400640 1 --2- 172.21.15.37:0/2423212988 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4580b3b40 0x7ff4580b6000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff460009fc0 tx=0x7ff460005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:46.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.124+0000 7ff470c00640 1 -- 172.21.15.37:0/2423212988 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff4640cb940 con 0x7ff474102730 2024-08-20T04:52:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.318+0000 7ff47ac00640 1 -- 172.21.15.37:0/2423212988 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7ff4741a3420 con 0x7ff474102730 2024-08-20T04:52:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.324+0000 7ff470c00640 1 -- 172.21.15.37:0/2423212988 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v26)=0 v26) ==== 120+0+0 (secure 0 0 0) 0x7ff4640cb240 con 0x7ff474102730 2024-08-20T04:52:46.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.326+0000 7ff47ac00640 1 -- 172.21.15.37:0/2423212988 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4580b3b40 msgr2=0x7ff4580b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.326+0000 7ff47ac00640 1 --2- 172.21.15.37:0/2423212988 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4580b3b40 0x7ff4580b6000 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff460009fc0 tx=0x7ff460005f90 comp rx=0 tx=0).stop 2024-08-20T04:52:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.326+0000 7ff47ac00640 1 -- 172.21.15.37:0/2423212988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff474102730 msgr2=0x7ff47419ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.326+0000 7ff47ac00640 1 --2- 172.21.15.37:0/2423212988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff474102730 0x7ff47419ad50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff464031490 tx=0x7ff464003c10 comp rx=0 tx=0).stop 2024-08-20T04:52:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.326+0000 7ff47ac00640 1 -- 172.21.15.37:0/2423212988 shutdown_connections 2024-08-20T04:52:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.326+0000 7ff47ac00640 1 --2- 172.21.15.37:0/2423212988 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4580b3b40 0x7ff4580b6000 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.326+0000 7ff47ac00640 1 --2- 172.21.15.37:0/2423212988 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff474104250 0x7ff47419bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.326+0000 7ff47ac00640 1 --2- 172.21.15.37:0/2423212988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff474103890 0x7ff47419b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.326+0000 7ff47ac00640 1 --2- 172.21.15.37:0/2423212988 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff474102730 0x7ff47419ad50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.326+0000 7ff47ac00640 1 -- 172.21.15.37:0/2423212988 >> 172.21.15.37:0/2423212988 conn(0x7ff4740fe020 msgr2=0x7ff4740750b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.327+0000 7ff47ac00640 1 -- 172.21.15.37:0/2423212988 shutdown_connections 2024-08-20T04:52:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.327+0000 7ff47ac00640 1 -- 172.21.15.37:0/2423212988 wait complete. 2024-08-20T04:52:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.783+0000 7fea49e00640 1 -- 172.21.15.37:0/1339576518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea441062c0 msgr2=0x7fea4410cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.783+0000 7fea49e00640 1 --2- 172.21.15.37:0/1339576518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea441062c0 0x7fea4410cc40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009cd0 tx=0x7fea3c02a8f0 comp rx=0 tx=0).stop 2024-08-20T04:52:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.783+0000 7fea49e00640 1 -- 172.21.15.37:0/1339576518 shutdown_connections 2024-08-20T04:52:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.783+0000 7fea49e00640 1 --2- 172.21.15.37:0/1339576518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea441062c0 0x7fea4410cc40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.783+0000 7fea49e00640 1 --2- 172.21.15.37:0/1339576518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea44105900 0x7fea44105d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.783+0000 7fea49e00640 1 --2- 172.21.15.37:0/1339576518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea441047a0 0x7fea44104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.783+0000 7fea49e00640 1 -- 172.21.15.37:0/1339576518 >> 172.21.15.37:0/1339576518 conn(0x7fea44100070 msgr2=0x7fea441024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.784+0000 7fea49e00640 1 -- 172.21.15.37:0/1339576518 shutdown_connections 2024-08-20T04:52:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.784+0000 7fea49e00640 1 -- 172.21.15.37:0/1339576518 wait complete. 2024-08-20T04:52:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.784+0000 7fea49e00640 1 Processor -- start 2024-08-20T04:52:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.785+0000 7fea49e00640 1 -- start start 2024-08-20T04:52:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.785+0000 7fea49e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea441047a0 0x7fea4419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:46.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.785+0000 7fea49e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea44105900 0x7fea4419b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.785+0000 7fea49e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea441062c0 0x7fea4419bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.785+0000 7fea49e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fea44110470 con 0x7fea441047a0 2024-08-20T04:52:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.785+0000 7fea49e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fea441102f0 con 0x7fea441062c0 2024-08-20T04:52:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.785+0000 7fea49e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fea441105f0 con 0x7fea44105900 2024-08-20T04:52:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.785+0000 7fea48a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea441047a0 0x7fea4419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.785+0000 7fea48a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea441047a0 0x7fea4419aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52816/0 (socket says 172.21.15.37:52816) 2024-08-20T04:52:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.785+0000 7fea48a00640 1 -- 172.21.15.37:0/3155513764 learned_addr learned my addr 172.21.15.37:0/3155513764 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.785+0000 7fea43e00640 1 --2- 172.21.15.37:0/3155513764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea44105900 0x7fea4419b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.785+0000 7fea49400640 1 --2- 172.21.15.37:0/3155513764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea441062c0 0x7fea4419bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:46.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.786+0000 7fea48a00640 1 -- 172.21.15.37:0/3155513764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea44105900 msgr2=0x7fea4419b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:46.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.786+0000 7fea48a00640 1 --2- 172.21.15.37:0/3155513764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea44105900 0x7fea4419b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:46.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.786+0000 7fea48a00640 1 -- 172.21.15.37:0/3155513764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea441062c0 msgr2=0x7fea4419bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:46.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.786+0000 7fea48a00640 1 --2- 172.21.15.37:0/3155513764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea441062c0 0x7fea4419bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:46.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.786+0000 7fea48a00640 1 -- 172.21.15.37:0/3155513764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea4419c540 con 0x7fea441047a0 2024-08-20T04:52:46.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.786+0000 7fea48a00640 1 --2- 172.21.15.37:0/3155513764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea441047a0 0x7fea4419aa80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fea3800e9f0 tx=0x7fea3800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:46.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.786+0000 7fea41600640 1 -- 172.21.15.37:0/3155513764 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3800cd80 con 0x7fea441047a0 2024-08-20T04:52:46.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.786+0000 7fea41600640 1 -- 172.21.15.37:0/3155513764 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fea380108e0 con 0x7fea441047a0 2024-08-20T04:52:46.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.786+0000 7fea49e00640 1 -- 172.21.15.37:0/3155513764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea4419c830 con 0x7fea441047a0 2024-08-20T04:52:46.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.786+0000 7fea41600640 1 -- 172.21.15.37:0/3155513764 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea38018980 con 0x7fea441047a0 2024-08-20T04:52:46.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.787+0000 7fea49e00640 1 -- 172.21.15.37:0/3155513764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea441a2f10 con 0x7fea441047a0 2024-08-20T04:52:46.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.788+0000 7fea49e00640 1 -- 172.21.15.37:0/3155513764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea4410ba50 con 0x7fea441047a0 2024-08-20T04:52:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.790+0000 7fea41600640 1 -- 172.21.15.37:0/3155513764 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fea38010430 con 0x7fea441047a0 2024-08-20T04:52:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.791+0000 7fea41600640 1 --2- 172.21.15.37:0/3155513764 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fea2c0b3c70 0x7fea2c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.791+0000 7fea41600640 1 -- 172.21.15.37:0/3155513764 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fea380e2220 con 0x7fea441047a0 2024-08-20T04:52:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.791+0000 7fea43e00640 1 --2- 172.21.15.37:0/3155513764 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fea2c0b3c70 0x7fea2c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.792+0000 7fea43e00640 1 --2- 172.21.15.37:0/3155513764 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fea2c0b3c70 0x7fea2c0b6130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fea30009bd0 tx=0x7fea30005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.795+0000 7fea41600640 1 -- 172.21.15.37:0/3155513764 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fea380aae50 con 0x7fea441047a0 2024-08-20T04:52:46.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.993+0000 7fea49e00640 1 -- 172.21.15.37:0/3155513764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fea4402e340 con 0x7fea441047a0 2024-08-20T04:52:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:46.997+0000 7fea41600640 1 -- 172.21.15.37:0/3155513764 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v27)=0 v27) ==== 127+0+0 (secure 0 0 0) 0x7fea380af3a0 con 0x7fea441047a0 2024-08-20T04:52:47.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.000+0000 7fea49e00640 1 -- 172.21.15.37:0/3155513764 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fea2c0b3c70 msgr2=0x7fea2c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:47.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.000+0000 7fea49e00640 1 --2- 172.21.15.37:0/3155513764 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fea2c0b3c70 0x7fea2c0b6130 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fea30009bd0 tx=0x7fea30005f90 comp rx=0 tx=0).stop 2024-08-20T04:52:47.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.000+0000 7fea49e00640 1 -- 172.21.15.37:0/3155513764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea441047a0 msgr2=0x7fea4419aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:47.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.000+0000 7fea49e00640 1 --2- 172.21.15.37:0/3155513764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea441047a0 0x7fea4419aa80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fea3800e9f0 tx=0x7fea3800eeb0 comp rx=0 tx=0).stop 2024-08-20T04:52:47.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.000+0000 7fea49e00640 1 -- 172.21.15.37:0/3155513764 shutdown_connections 2024-08-20T04:52:47.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.000+0000 7fea49e00640 1 --2- 172.21.15.37:0/3155513764 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fea2c0b3c70 0x7fea2c0b6130 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:47.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.000+0000 7fea49e00640 1 --2- 172.21.15.37:0/3155513764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fea441062c0 0x7fea4419bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:47.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.000+0000 7fea49e00640 1 --2- 172.21.15.37:0/3155513764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fea44105900 0x7fea4419b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:47.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.000+0000 7fea49e00640 1 --2- 172.21.15.37:0/3155513764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea441047a0 0x7fea4419aa80 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fea3800e9f0 tx=0x7fea3800eeb0 comp rx=0 tx=0).stop 2024-08-20T04:52:47.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.000+0000 7fea49e00640 1 -- 172.21.15.37:0/3155513764 >> 172.21.15.37:0/3155513764 conn(0x7fea44100070 msgr2=0x7fea44108c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:47.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.001+0000 7fea49e00640 1 -- 172.21.15.37:0/3155513764 shutdown_connections 2024-08-20T04:52:47.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.001+0000 7fea49e00640 1 -- 172.21.15.37:0/3155513764 wait complete. 2024-08-20T04:52:47.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.328+0000 7f2ec5600640 1 -- 172.21.15.37:0/734910196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec01036f0 msgr2=0x7f2ec0103b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:47.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.328+0000 7f2ec5600640 1 --2- 172.21.15.37:0/734910196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec01036f0 0x7f2ec0103b70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009930 tx=0x7f2eac02a420 comp rx=0 tx=0).stop 2024-08-20T04:52:47.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.328+0000 7f2ec5600640 1 -- 172.21.15.37:0/734910196 shutdown_connections 2024-08-20T04:52:47.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.328+0000 7f2ec5600640 1 --2- 172.21.15.37:0/734910196 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec01040b0 0x7f2ec010aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:47.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.328+0000 7f2ec5600640 1 --2- 172.21.15.37:0/734910196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec01036f0 0x7f2ec0103b70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:47.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.328+0000 7f2ec5600640 1 --2- 172.21.15.37:0/734910196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec0102590 0x7f2ec0102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:47.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.328+0000 7f2ec5600640 1 -- 172.21.15.37:0/734910196 >> 172.21.15.37:0/734910196 conn(0x7f2ec00fde80 msgr2=0x7f2ec01002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:47.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.329+0000 7f2ec5600640 1 -- 172.21.15.37:0/734910196 shutdown_connections 2024-08-20T04:52:47.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.329+0000 7f2ec5600640 1 -- 172.21.15.37:0/734910196 wait complete. 2024-08-20T04:52:47.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.329+0000 7f2ec5600640 1 Processor -- start 2024-08-20T04:52:47.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.330+0000 7f2ec5600640 1 -- start start 2024-08-20T04:52:47.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.330+0000 7f2ec5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec0102590 0x7f2ec0076a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:47.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.330+0000 7f2ec5600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec01036f0 0x7f2ec0075270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:47.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.330+0000 7f2ec5600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec01040b0 0x7f2ec00757b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:47.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.330+0000 7f2ec5600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec010e1f0 con 0x7f2ec0102590 2024-08-20T04:52:47.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.330+0000 7f2ec5600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec010e070 con 0x7f2ec01040b0 2024-08-20T04:52:47.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.330+0000 7f2ec5600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec010e370 con 0x7f2ec01036f0 2024-08-20T04:52:47.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.330+0000 7f2ebfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec0102590 0x7f2ec0076a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:47.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.330+0000 7f2ebfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec0102590 0x7f2ec0076a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52828/0 (socket says 172.21.15.37:52828) 2024-08-20T04:52:47.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.330+0000 7f2ebfe00640 1 -- 172.21.15.37:0/4030701820 learned_addr learned my addr 172.21.15.37:0/4030701820 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.330+0000 7f2ebf400640 1 --2- 172.21.15.37:0/4030701820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec01036f0 0x7f2ec0075270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.330+0000 7f2ec4c00640 1 --2- 172.21.15.37:0/4030701820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec01040b0 0x7f2ec00757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.331+0000 7f2ebfe00640 1 -- 172.21.15.37:0/4030701820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec01036f0 msgr2=0x7f2ec0075270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.331+0000 7f2ebfe00640 1 --2- 172.21.15.37:0/4030701820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec01036f0 0x7f2ec0075270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.331+0000 7f2ebfe00640 1 -- 172.21.15.37:0/4030701820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec01040b0 msgr2=0x7f2ec00757b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.331+0000 7f2ebfe00640 1 --2- 172.21.15.37:0/4030701820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec01040b0 0x7f2ec00757b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.331+0000 7f2ebfe00640 1 -- 172.21.15.37:0/4030701820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec0076070 con 0x7f2ec0102590 2024-08-20T04:52:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.331+0000 7f2ebf400640 1 --2- 172.21.15.37:0/4030701820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec01036f0 0x7f2ec0075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:52:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.331+0000 7f2ec4c00640 1 --2- 172.21.15.37:0/4030701820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec01040b0 0x7f2ec00757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:52:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.331+0000 7f2ebfe00640 1 --2- 172.21.15.37:0/4030701820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec0102590 0x7f2ec0076a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000e9f0 tx=0x7f2eb000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.331+0000 7f2ebcc00640 1 -- 172.21.15.37:0/4030701820 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb000cd80 con 0x7f2ec0102590 2024-08-20T04:52:47.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.331+0000 7f2ebcc00640 1 -- 172.21.15.37:0/4030701820 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2eb00108e0 con 0x7f2ec0102590 2024-08-20T04:52:47.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.331+0000 7f2ebcc00640 1 -- 172.21.15.37:0/4030701820 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0018980 con 0x7f2ec0102590 2024-08-20T04:52:47.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.331+0000 7f2ec5600640 1 -- 172.21.15.37:0/4030701820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec01a2930 con 0x7f2ec0102590 2024-08-20T04:52:47.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.332+0000 7f2ec5600640 1 -- 172.21.15.37:0/4030701820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec01a2e90 con 0x7f2ec0102590 2024-08-20T04:52:47.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.333+0000 7f2ec5600640 1 -- 172.21.15.37:0/4030701820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec01098b0 con 0x7f2ec0102590 2024-08-20T04:52:47.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.335+0000 7f2ebcc00640 1 -- 172.21.15.37:0/4030701820 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f2eb0010430 con 0x7f2ec0102590 2024-08-20T04:52:47.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.336+0000 7f2ebcc00640 1 --2- 172.21.15.37:0/4030701820 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2ea40b3c70 0x7f2ea40b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:47.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.337+0000 7f2ebcc00640 1 -- 172.21.15.37:0/4030701820 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2eb00e2220 con 0x7f2ec0102590 2024-08-20T04:52:47.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.337+0000 7f2ebf400640 1 --2- 172.21.15.37:0/4030701820 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2ea40b3c70 0x7f2ea40b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:47.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.337+0000 7f2ebf400640 1 --2- 172.21.15.37:0/4030701820 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2ea40b3c70 0x7f2ea40b6130 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009900 tx=0x7f2eac031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:47.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.340+0000 7f2ebcc00640 1 -- 172.21.15.37:0/4030701820 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f2eb00aae50 con 0x7f2ec0102590 2024-08-20T04:52:47.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:47 smithi130 ceph-mon[22007]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:47.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:47 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' 2024-08-20T04:52:47.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:47 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3155513764' entity='client.admin' 2024-08-20T04:52:47.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.540+0000 7f2ec5600640 1 -- 172.21.15.37:0/4030701820 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f2ec0063a80 con 0x7f2ec0102590 2024-08-20T04:52:47.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.544+0000 7f2ebcc00640 1 -- 172.21.15.37:0/4030701820 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v28)=0 v28) ==== 108+0+0 (secure 0 0 0) 0x7f2eb00af3a0 con 0x7f2ec0102590 2024-08-20T04:52:47.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.546+0000 7f2ec5600640 1 -- 172.21.15.37:0/4030701820 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2ea40b3c70 msgr2=0x7f2ea40b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:47.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.546+0000 7f2ec5600640 1 --2- 172.21.15.37:0/4030701820 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2ea40b3c70 0x7f2ea40b6130 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2eac009900 tx=0x7f2eac031430 comp rx=0 tx=0).stop 2024-08-20T04:52:47.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.546+0000 7f2ec5600640 1 -- 172.21.15.37:0/4030701820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec0102590 msgr2=0x7f2ec0076a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:47.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.546+0000 7f2ec5600640 1 --2- 172.21.15.37:0/4030701820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec0102590 0x7f2ec0076a00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000e9f0 tx=0x7f2eb000eeb0 comp rx=0 tx=0).stop 2024-08-20T04:52:47.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.546+0000 7f2ec5600640 1 -- 172.21.15.37:0/4030701820 shutdown_connections 2024-08-20T04:52:47.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.546+0000 7f2ec5600640 1 --2- 172.21.15.37:0/4030701820 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2ea40b3c70 0x7f2ea40b6130 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:47.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.546+0000 7f2ec5600640 1 --2- 172.21.15.37:0/4030701820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ec01040b0 0x7f2ec00757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:47.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.546+0000 7f2ec5600640 1 --2- 172.21.15.37:0/4030701820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ec01036f0 0x7f2ec0075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:47.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.546+0000 7f2ec5600640 1 --2- 172.21.15.37:0/4030701820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec0102590 0x7f2ec0076a00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:47.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.546+0000 7f2ec5600640 1 -- 172.21.15.37:0/4030701820 >> 172.21.15.37:0/4030701820 conn(0x7f2ec00fde80 msgr2=0x7f2ec0106a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:47.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.547+0000 7f2ec5600640 1 -- 172.21.15.37:0/4030701820 shutdown_connections 2024-08-20T04:52:47.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:47.547+0000 7f2ec5600640 1 -- 172.21.15.37:0/4030701820 wait complete. 2024-08-20T04:52:47.562 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:47 smithi037 ceph-mon[17265]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:47.563 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:47 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' 2024-08-20T04:52:47.563 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:47 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3155513764' entity='client.admin' 2024-08-20T04:52:47.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:47 smithi135 ceph-mon[22342]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:47.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:47 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' 2024-08-20T04:52:47.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:47 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3155513764' entity='client.admin' 2024-08-20T04:52:48.622 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:48 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/4030701820' entity='client.admin' 2024-08-20T04:52:48.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:48 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/4030701820' entity='client.admin' 2024-08-20T04:52:48.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:48 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/4030701820' entity='client.admin' 2024-08-20T04:52:49.028 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi037') 2024-08-20T04:52:49.047 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi037') 2024-08-20T04:52:49.048 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi037') 2024-08-20T04:52:49.048 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi037') 2024-08-20T04:52:49.048 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi037') 2024-08-20T04:52:49.048 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi037') 2024-08-20T04:52:49.807 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:49 smithi037 ceph-mon[17265]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:49.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:49 smithi135 ceph-mon[22342]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:49.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:49 smithi130 ceph-mon[22007]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:50.158 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:50.159 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:50.196 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi037') 2024-08-20T04:52:50.196 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi037') 2024-08-20T04:52:50.196 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi037') 2024-08-20T04:52:50.197 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi037') 2024-08-20T04:52:50.197 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi037') 2024-08-20T04:52:50.197 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi037') 2024-08-20T04:52:50.197 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi037') 2024-08-20T04:52:50.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.893+0000 7f8019a00640 1 -- 172.21.15.37:0/4211596274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8014105aa0 msgr2=0x7f8014105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:50.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.893+0000 7f8019a00640 1 --2- 172.21.15.37:0/4211596274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8014105aa0 0x7f8014105f20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8000009930 tx=0x7f800002a420 comp rx=0 tx=0).stop 2024-08-20T04:52:50.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.893+0000 7f8019a00640 1 -- 172.21.15.37:0/4211596274 shutdown_connections 2024-08-20T04:52:50.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.893+0000 7f8019a00640 1 --2- 172.21.15.37:0/4211596274 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8014106460 0x7f801410cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:50.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.893+0000 7f8019a00640 1 --2- 172.21.15.37:0/4211596274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8014105aa0 0x7f8014105f20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:50.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.893+0000 7f8019a00640 1 --2- 172.21.15.37:0/4211596274 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8014104940 0x7f8014104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:50.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.893+0000 7f8019a00640 1 -- 172.21.15.37:0/4211596274 >> 172.21.15.37:0/4211596274 conn(0x7f8014100210 msgr2=0x7f8014102650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:50.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.893+0000 7f8019a00640 1 -- 172.21.15.37:0/4211596274 shutdown_connections 2024-08-20T04:52:50.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.893+0000 7f8019a00640 1 -- 172.21.15.37:0/4211596274 wait complete. 2024-08-20T04:52:50.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.894+0000 7f8019a00640 1 Processor -- start 2024-08-20T04:52:50.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.894+0000 7f8019a00640 1 -- start start 2024-08-20T04:52:50.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.895+0000 7f8019a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8014104940 0x7f801419acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:50.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.895+0000 7f8019a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8014105aa0 0x7f801419b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:50.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.895+0000 7f8019a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8014106460 0x7f801419bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:50.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.895+0000 7f8019a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8014110610 con 0x7f8014105aa0 2024-08-20T04:52:50.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.895+0000 7f8019a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8014110490 con 0x7f8014104940 2024-08-20T04:52:50.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.895+0000 7f8019a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8014110790 con 0x7f8014106460 2024-08-20T04:52:50.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.895+0000 7f8012000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8014105aa0 0x7f801419b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:50.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.895+0000 7f8012000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8014105aa0 0x7f801419b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52856/0 (socket says 172.21.15.37:52856) 2024-08-20T04:52:50.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.895+0000 7f8012000640 1 -- 172.21.15.37:0/1178431984 learned_addr learned my addr 172.21.15.37:0/1178431984 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:50.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.895+0000 7f8012a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8014104940 0x7f801419acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:50.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.895+0000 7f8013400640 1 --2- 172.21.15.37:0/1178431984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8014106460 0x7f801419bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:50.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.896+0000 7f8012000640 1 -- 172.21.15.37:0/1178431984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8014106460 msgr2=0x7f801419bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:50.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.896+0000 7f8012000640 1 --2- 172.21.15.37:0/1178431984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8014106460 0x7f801419bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:50.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.896+0000 7f8012000640 1 -- 172.21.15.37:0/1178431984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8014104940 msgr2=0x7f801419acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:50.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.896+0000 7f8012000640 1 --2- 172.21.15.37:0/1178431984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8014104940 0x7f801419acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:50.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.896+0000 7f8012000640 1 -- 172.21.15.37:0/1178431984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f801419c820 con 0x7f8014105aa0 2024-08-20T04:52:50.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.896+0000 7f8012a00640 1 --2- 172.21.15.37:0/1178431984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8014104940 0x7f801419acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:52:50.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.896+0000 7f8013400640 1 --2- 172.21.15.37:0/1178431984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8014106460 0x7f801419bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:52:50.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.896+0000 7f8012000640 1 --2- 172.21.15.37:0/1178431984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8014105aa0 0x7f801419b340 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8000031490 tx=0x7f8000003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:50.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.896+0000 7f800b400640 1 -- 172.21.15.37:0/1178431984 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800003f070 con 0x7f8014105aa0 2024-08-20T04:52:50.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.896+0000 7f800b400640 1 -- 172.21.15.37:0/1178431984 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8000031bf0 con 0x7f8014105aa0 2024-08-20T04:52:50.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.896+0000 7f800b400640 1 -- 172.21.15.37:0/1178431984 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8000035030 con 0x7f8014105aa0 2024-08-20T04:52:50.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.896+0000 7f8019a00640 1 -- 172.21.15.37:0/1178431984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f801419cab0 con 0x7f8014105aa0 2024-08-20T04:52:50.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.896+0000 7f8019a00640 1 -- 172.21.15.37:0/1178431984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80141a3020 con 0x7f8014105aa0 2024-08-20T04:52:50.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.898+0000 7f8019a00640 1 -- 172.21.15.37:0/1178431984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f801410bc60 con 0x7f8014105aa0 2024-08-20T04:52:50.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.900+0000 7f800b400640 1 -- 172.21.15.37:0/1178431984 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f8000042070 con 0x7f8014105aa0 2024-08-20T04:52:50.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.903+0000 7f800b400640 1 --2- 172.21.15.37:0/1178431984 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7ff80b3bc0 0x7f7ff80b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.903+0000 7f8012a00640 1 --2- 172.21.15.37:0/1178431984 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7ff80b3bc0 0x7f7ff80b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.903+0000 7f800b400640 1 -- 172.21.15.37:0/1178431984 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f80001025b0 con 0x7f8014105aa0 2024-08-20T04:52:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.904+0000 7f8012a00640 1 --2- 172.21.15.37:0/1178431984 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7ff80b3bc0 0x7f7ff80b6080 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8004009fc0 tx=0x7f8004005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:50.907+0000 7f800b400640 1 -- 172.21.15.37:0/1178431984 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f80000cb1e0 con 0x7f8014105aa0 2024-08-20T04:52:51.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.108+0000 7f8019a00640 1 -- 172.21.15.37:0/1178431984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f801402e340 con 0x7f8014105aa0 2024-08-20T04:52:51.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.091+0000 7fc671400640 1 -- 172.21.15.37:0/3829934702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc66c106460 msgr2=0x7fc66c10cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:51.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.091+0000 7fc671400640 1 --2- 172.21.15.37:0/3829934702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc66c106460 0x7fc66c10cde0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc664009cd0 tx=0x7fc66402a8f0 comp rx=0 tx=0).stop 2024-08-20T04:52:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.091+0000 7fc671400640 1 -- 172.21.15.37:0/3829934702 shutdown_connections 2024-08-20T04:52:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.091+0000 7fc671400640 1 --2- 172.21.15.37:0/3829934702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc66c106460 0x7fc66c10cde0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.091+0000 7fc671400640 1 --2- 172.21.15.37:0/3829934702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc66c105aa0 0x7fc66c105f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.091+0000 7fc671400640 1 --2- 172.21.15.37:0/3829934702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc66c104940 0x7fc66c104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.091+0000 7fc671400640 1 -- 172.21.15.37:0/3829934702 >> 172.21.15.37:0/3829934702 conn(0x7fc66c100210 msgr2=0x7fc66c102650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.091+0000 7fc671400640 1 -- 172.21.15.37:0/3829934702 shutdown_connections 2024-08-20T04:52:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.091+0000 7fc671400640 1 -- 172.21.15.37:0/3829934702 wait complete. 2024-08-20T04:52:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.092+0000 7fc671400640 1 Processor -- start 2024-08-20T04:52:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.092+0000 7fc671400640 1 -- start start 2024-08-20T04:52:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.092+0000 7fc671400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc66c104940 0x7fc66c19aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:51.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.092+0000 7fc671400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc66c105aa0 0x7fc66c19b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.092+0000 7fc671400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc66c106460 0x7fc66c19bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.092+0000 7fc671400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c1105f0 con 0x7fc66c105aa0 2024-08-20T04:52:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.092+0000 7fc671400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c110470 con 0x7fc66c106460 2024-08-20T04:52:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.092+0000 7fc671400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c110770 con 0x7fc66c104940 2024-08-20T04:52:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.092+0000 7fc669e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc66c105aa0 0x7fc66c19b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.092+0000 7fc669e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc66c105aa0 0x7fc66c19b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52876/0 (socket says 172.21.15.37:52876) 2024-08-20T04:52:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.093+0000 7fc66a800640 1 --2- 172.21.15.37:0/861062388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc66c104940 0x7fc66c19aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.093+0000 7fc669e00640 1 -- 172.21.15.37:0/861062388 learned_addr learned my addr 172.21.15.37:0/861062388 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.093+0000 7fc66b200640 1 --2- 172.21.15.37:0/861062388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc66c106460 0x7fc66c19bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.093+0000 7fc669e00640 1 -- 172.21.15.37:0/861062388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc66c104940 msgr2=0x7fc66c19aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.093+0000 7fc669e00640 1 --2- 172.21.15.37:0/861062388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc66c104940 0x7fc66c19aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:51.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.093+0000 7fc669e00640 1 -- 172.21.15.37:0/861062388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc66c106460 msgr2=0x7fc66c19bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.093+0000 7fc669e00640 1 --2- 172.21.15.37:0/861062388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc66c106460 0x7fc66c19bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.093+0000 7fc669e00640 1 -- 172.21.15.37:0/861062388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66c19c7d0 con 0x7fc66c105aa0 2024-08-20T04:52:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.093+0000 7fc669e00640 1 --2- 172.21.15.37:0/861062388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc66c105aa0 0x7fc66c19b2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc65800ea60 tx=0x7fc65800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.094+0000 7fc663400640 1 -- 172.21.15.37:0/861062388 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65800cde0 con 0x7fc66c105aa0 2024-08-20T04:52:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.094+0000 7fc663400640 1 -- 172.21.15.37:0/861062388 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6580035f0 con 0x7fc66c105aa0 2024-08-20T04:52:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.094+0000 7fc663400640 1 -- 172.21.15.37:0/861062388 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc658010690 con 0x7fc66c105aa0 2024-08-20T04:52:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.094+0000 7fc671400640 1 -- 172.21.15.37:0/861062388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66c19cac0 con 0x7fc66c105aa0 2024-08-20T04:52:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.094+0000 7fc671400640 1 -- 172.21.15.37:0/861062388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc66c1a31a0 con 0x7fc66c105aa0 2024-08-20T04:52:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.095+0000 7fc671400640 1 -- 172.21.15.37:0/861062388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc66c104d40 con 0x7fc66c105aa0 2024-08-20T04:52:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.097+0000 7fc663400640 1 -- 172.21.15.37:0/861062388 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fc6580037a0 con 0x7fc66c105aa0 2024-08-20T04:52:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.099+0000 7fc663400640 1 --2- 172.21.15.37:0/861062388 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc6500b3bc0 0x7fc6500b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:51.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.099+0000 7fc663400640 1 -- 172.21.15.37:0/861062388 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc6580e22d0 con 0x7fc66c105aa0 2024-08-20T04:52:51.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.099+0000 7fc66a800640 1 --2- 172.21.15.37:0/861062388 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc6500b3bc0 0x7fc6500b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:51.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.099+0000 7fc66a800640 1 --2- 172.21.15.37:0/861062388 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc6500b3bc0 0x7fc6500b6080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc65c0095f0 tx=0x7fc65c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:51.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.100+0000 7fc663400640 1 -- 172.21.15.37:0/861062388 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fc658055e20 con 0x7fc66c105aa0 2024-08-20T04:52:51.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.112+0000 7f800b400640 1 -- 172.21.15.37:0/1178431984 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v29)=0 v29) ==== 125+0+0 (secure 0 0 0) 0x7f80000cf730 con 0x7f8014105aa0 2024-08-20T04:52:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.115+0000 7f8019a00640 1 -- 172.21.15.37:0/1178431984 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7ff80b3bc0 msgr2=0x7f7ff80b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.115+0000 7f8019a00640 1 --2- 172.21.15.37:0/1178431984 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7ff80b3bc0 0x7f7ff80b6080 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8004009fc0 tx=0x7f8004005f90 comp rx=0 tx=0).stop 2024-08-20T04:52:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.115+0000 7f8019a00640 1 -- 172.21.15.37:0/1178431984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8014105aa0 msgr2=0x7f801419b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.115+0000 7f8019a00640 1 --2- 172.21.15.37:0/1178431984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8014105aa0 0x7f801419b340 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8000031490 tx=0x7f8000003c10 comp rx=0 tx=0).stop 2024-08-20T04:52:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.115+0000 7f8019a00640 1 -- 172.21.15.37:0/1178431984 shutdown_connections 2024-08-20T04:52:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.115+0000 7f8019a00640 1 --2- 172.21.15.37:0/1178431984 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7ff80b3bc0 0x7f7ff80b6080 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:51.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.115+0000 7f8019a00640 1 --2- 172.21.15.37:0/1178431984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8014106460 0x7f801419bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:51.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.115+0000 7f8019a00640 1 --2- 172.21.15.37:0/1178431984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8014105aa0 0x7f801419b340 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:51.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.115+0000 7f8019a00640 1 --2- 172.21.15.37:0/1178431984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8014104940 0x7f801419acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:51.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.115+0000 7f8019a00640 1 -- 172.21.15.37:0/1178431984 >> 172.21.15.37:0/1178431984 conn(0x7f8014100210 msgr2=0x7f8014108e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:51.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.115+0000 7f8019a00640 1 -- 172.21.15.37:0/1178431984 shutdown_connections 2024-08-20T04:52:51.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.115+0000 7f8019a00640 1 -- 172.21.15.37:0/1178431984 wait complete. 2024-08-20T04:52:51.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.302+0000 7fc671400640 1 -- 172.21.15.37:0/861062388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fc66c02e340 con 0x7fc66c105aa0 2024-08-20T04:52:51.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.306+0000 7fc663400640 1 -- 172.21.15.37:0/861062388 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7fc6580ab5f0 con 0x7fc66c105aa0 2024-08-20T04:52:51.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.309+0000 7fc671400640 1 -- 172.21.15.37:0/861062388 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc6500b3bc0 msgr2=0x7fc6500b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:51.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.309+0000 7fc671400640 1 --2- 172.21.15.37:0/861062388 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc6500b3bc0 0x7fc6500b6080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc65c0095f0 tx=0x7fc65c005f90 comp rx=0 tx=0).stop 2024-08-20T04:52:51.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.309+0000 7fc671400640 1 -- 172.21.15.37:0/861062388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc66c105aa0 msgr2=0x7fc66c19b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:51.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.309+0000 7fc671400640 1 --2- 172.21.15.37:0/861062388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc66c105aa0 0x7fc66c19b2f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc65800ea60 tx=0x7fc65800ef20 comp rx=0 tx=0).stop 2024-08-20T04:52:51.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.309+0000 7fc671400640 1 -- 172.21.15.37:0/861062388 shutdown_connections 2024-08-20T04:52:51.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.309+0000 7fc671400640 1 --2- 172.21.15.37:0/861062388 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc6500b3bc0 0x7fc6500b6080 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:51.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.309+0000 7fc671400640 1 --2- 172.21.15.37:0/861062388 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc66c106460 0x7fc66c19bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:51.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.309+0000 7fc671400640 1 --2- 172.21.15.37:0/861062388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc66c105aa0 0x7fc66c19b2f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:51.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.309+0000 7fc671400640 1 --2- 172.21.15.37:0/861062388 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc66c104940 0x7fc66c19aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:51.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.309+0000 7fc671400640 1 -- 172.21.15.37:0/861062388 >> 172.21.15.37:0/861062388 conn(0x7fc66c100210 msgr2=0x7fc66c108e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:51.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.309+0000 7fc671400640 1 -- 172.21.15.37:0/861062388 shutdown_connections 2024-08-20T04:52:51.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:51.309+0000 7fc671400640 1 -- 172.21.15.37:0/861062388 wait complete. 2024-08-20T04:52:51.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:51 smithi037 ceph-mon[17265]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:51.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:51 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1178431984' entity='client.admin' 2024-08-20T04:52:51.591 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:51 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/861062388' entity='client.admin' 2024-08-20T04:52:51.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:51 smithi135 ceph-mon[22342]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:51.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:51 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1178431984' entity='client.admin' 2024-08-20T04:52:51.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:51 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/861062388' entity='client.admin' 2024-08-20T04:52:51.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:51 smithi130 ceph-mon[22007]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:51.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:51 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1178431984' entity='client.admin' 2024-08-20T04:52:51.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:51 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/861062388' entity='client.admin' 2024-08-20T04:52:53.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.271+0000 7fed77200640 1 -- 172.21.15.37:0/2043689064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed78105900 msgr2=0x7fed78105d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:53.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.271+0000 7fed77200640 1 --2- 172.21.15.37:0/2043689064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed78105900 0x7fed78105d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fed60009930 tx=0x7fed6002a420 comp rx=0 tx=0).stop 2024-08-20T04:52:53.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.271+0000 7fed77200640 1 -- 172.21.15.37:0/2043689064 shutdown_connections 2024-08-20T04:52:53.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.271+0000 7fed77200640 1 --2- 172.21.15.37:0/2043689064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed781062c0 0x7fed7810cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:53.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.271+0000 7fed77200640 1 --2- 172.21.15.37:0/2043689064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed78105900 0x7fed78105d80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:53.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.271+0000 7fed77200640 1 --2- 172.21.15.37:0/2043689064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed781047a0 0x7fed78104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:53.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.271+0000 7fed77200640 1 -- 172.21.15.37:0/2043689064 >> 172.21.15.37:0/2043689064 conn(0x7fed78100070 msgr2=0x7fed781024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:53.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.271+0000 7fed77200640 1 -- 172.21.15.37:0/2043689064 shutdown_connections 2024-08-20T04:52:53.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.271+0000 7fed77200640 1 -- 172.21.15.37:0/2043689064 wait complete. 2024-08-20T04:52:53.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.272+0000 7fed77200640 1 Processor -- start 2024-08-20T04:52:53.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.272+0000 7fed77200640 1 -- start start 2024-08-20T04:52:53.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.272+0000 7fed77200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed781047a0 0x7fed7819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:53.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.272+0000 7fed77200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed78105900 0x7fed7819b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:53.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.272+0000 7fed77200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed781062c0 0x7fed7819bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:53.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.272+0000 7fed77200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fed78110450 con 0x7fed781047a0 2024-08-20T04:52:53.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.272+0000 7fed77200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fed781102d0 con 0x7fed78105900 2024-08-20T04:52:53.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.272+0000 7fed77200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fed781105d0 con 0x7fed781062c0 2024-08-20T04:52:53.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.272+0000 7fed75e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed781047a0 0x7fed7819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:53.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.273+0000 7fed6d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed78105900 0x7fed7819b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:53.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.273+0000 7fed75e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed781047a0 0x7fed7819aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37684/0 (socket says 172.21.15.37:37684) 2024-08-20T04:52:53.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.273+0000 7fed75e00640 1 -- 172.21.15.37:0/2965564602 learned_addr learned my addr 172.21.15.37:0/2965564602 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:52:53.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.273+0000 7fed76800640 1 --2- 172.21.15.37:0/2965564602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed781062c0 0x7fed7819bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:53.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.273+0000 7fed75e00640 1 -- 172.21.15.37:0/2965564602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed781062c0 msgr2=0x7fed7819bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:53.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.273+0000 7fed75e00640 1 --2- 172.21.15.37:0/2965564602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed781062c0 0x7fed7819bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.273+0000 7fed75e00640 1 -- 172.21.15.37:0/2965564602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed78105900 msgr2=0x7fed7819b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.273+0000 7fed75e00640 1 --2- 172.21.15.37:0/2965564602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed78105900 0x7fed7819b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.273+0000 7fed75e00640 1 -- 172.21.15.37:0/2965564602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7819c5e0 con 0x7fed781047a0 2024-08-20T04:52:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.273+0000 7fed6d400640 1 --2- 172.21.15.37:0/2965564602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed78105900 0x7fed7819b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:52:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.273+0000 7fed75e00640 1 --2- 172.21.15.37:0/2965564602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed781047a0 0x7fed7819aab0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fed6800d950 tx=0x7fed6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.274+0000 7fed6f400640 1 -- 172.21.15.37:0/2965564602 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed68017030 con 0x7fed781047a0 2024-08-20T04:52:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.274+0000 7fed6f400640 1 -- 172.21.15.37:0/2965564602 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fed68004020 con 0x7fed781047a0 2024-08-20T04:52:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.274+0000 7fed77200640 1 -- 172.21.15.37:0/2965564602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed7819c8d0 con 0x7fed781047a0 2024-08-20T04:52:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.274+0000 7fed6f400640 1 -- 172.21.15.37:0/2965564602 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed680047a0 con 0x7fed781047a0 2024-08-20T04:52:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.274+0000 7fed77200640 1 -- 172.21.15.37:0/2965564602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed781a2fb0 con 0x7fed781047a0 2024-08-20T04:52:53.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.275+0000 7fed77200640 1 -- 172.21.15.37:0/2965564602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed7810ba50 con 0x7fed781047a0 2024-08-20T04:52:53.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.277+0000 7fed6f400640 1 -- 172.21.15.37:0/2965564602 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fed68009a30 con 0x7fed781047a0 2024-08-20T04:52:53.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.278+0000 7fed6f400640 1 --2- 172.21.15.37:0/2965564602 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fed5c0b3c70 0x7fed5c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:52:53.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.279+0000 7fed6f400640 1 -- 172.21.15.37:0/2965564602 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fed680e1930 con 0x7fed781047a0 2024-08-20T04:52:53.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.279+0000 7fed6d400640 1 --2- 172.21.15.37:0/2965564602 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fed5c0b3c70 0x7fed5c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:52:53.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.279+0000 7fed6d400640 1 --2- 172.21.15.37:0/2965564602 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fed5c0b3c70 0x7fed5c0b6130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fed60009900 tx=0x7fed60031450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:52:53.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.282+0000 7fed6f400640 1 -- 172.21.15.37:0/2965564602 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fed680aabb0 con 0x7fed781047a0 2024-08-20T04:52:53.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.475+0000 7fed77200640 1 -- 172.21.15.37:0/2965564602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fed7802e340 con 0x7fed781047a0 2024-08-20T04:52:53.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.480+0000 7fed6f400640 1 -- 172.21.15.37:0/2965564602 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v31)=0 v31) ==== 119+0+0 (secure 0 0 0) 0x7fed680aa4b0 con 0x7fed781047a0 2024-08-20T04:52:53.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.482+0000 7fed77200640 1 -- 172.21.15.37:0/2965564602 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fed5c0b3c70 msgr2=0x7fed5c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:53.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.482+0000 7fed77200640 1 --2- 172.21.15.37:0/2965564602 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fed5c0b3c70 0x7fed5c0b6130 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fed60009900 tx=0x7fed60031450 comp rx=0 tx=0).stop 2024-08-20T04:52:53.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.482+0000 7fed77200640 1 -- 172.21.15.37:0/2965564602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed781047a0 msgr2=0x7fed7819aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:52:53.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.482+0000 7fed77200640 1 --2- 172.21.15.37:0/2965564602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed781047a0 0x7fed7819aab0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fed6800d950 tx=0x7fed6800de10 comp rx=0 tx=0).stop 2024-08-20T04:52:53.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.482+0000 7fed77200640 1 -- 172.21.15.37:0/2965564602 shutdown_connections 2024-08-20T04:52:53.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.482+0000 7fed77200640 1 --2- 172.21.15.37:0/2965564602 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fed5c0b3c70 0x7fed5c0b6130 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:53.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.482+0000 7fed77200640 1 --2- 172.21.15.37:0/2965564602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fed781062c0 0x7fed7819bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:53.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.482+0000 7fed77200640 1 --2- 172.21.15.37:0/2965564602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fed78105900 0x7fed7819b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:53.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.482+0000 7fed77200640 1 --2- 172.21.15.37:0/2965564602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed781047a0 0x7fed7819aab0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:52:53.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.482+0000 7fed77200640 1 -- 172.21.15.37:0/2965564602 >> 172.21.15.37:0/2965564602 conn(0x7fed78100070 msgr2=0x7fed78108c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:52:53.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.482+0000 7fed77200640 1 -- 172.21.15.37:0/2965564602 shutdown_connections 2024-08-20T04:52:53.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:52:53.482+0000 7fed77200640 1 -- 172.21.15.37:0/2965564602 wait complete. 2024-08-20T04:52:53.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:53 smithi037 ceph-mon[17265]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:53.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:53 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2965564602' entity='client.admin' 2024-08-20T04:52:53.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:53 smithi135 ceph-mon[22342]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:53.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:53 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2965564602' entity='client.admin' 2024-08-20T04:52:53.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:53 smithi130 ceph-mon[22007]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:53.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:53 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2965564602' entity='client.admin' 2024-08-20T04:52:54.183 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi037') 2024-08-20T04:52:54.183 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi037') 2024-08-20T04:52:54.184 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi037') 2024-08-20T04:52:54.184 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi037') 2024-08-20T04:52:54.184 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi037') 2024-08-20T04:52:54.184 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '93c5cea6-5eaf-11ef-bccf-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi037') 2024-08-20T04:52:54.184 INFO:tasks.cephadm:Deploying OSDs... 2024-08-20T04:52:54.184 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T04:52:54.184 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2024-08-20T04:52:54.220 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-20T04:52:54.221 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2024-08-20T04:52:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-20T04:52:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T04:52:54.295 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-08-20T04:52:54.295 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T04:52:54.296 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T04:52:54.296 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-08-20 04:51:44.899480391 +0000 2024-08-20T04:52:54.296 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-08-20 04:46:54.494499186 +0000 2024-08-20T04:52:54.296 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-08-20 04:46:54.494499186 +0000 2024-08-20T04:52:54.296 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-08-20 04:46:54.494499186 +0000 2024-08-20T04:52:54.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-20T04:52:54.390 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-08-20T04:52:54.390 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-08-20T04:52:54.390 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000287493 s, 1.8 MB/s 2024-08-20T04:52:54.392 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-20T04:52:54.429 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2024-08-20T04:52:54.504 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-20T04:52:54.505 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T04:52:54.505 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-08-20T04:52:54.505 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T04:52:54.505 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T04:52:54.505 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-08-20 04:51:44.938479878 +0000 2024-08-20T04:52:54.505 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-08-20 04:46:54.947493168 +0000 2024-08-20T04:52:54.505 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-08-20 04:46:54.947493168 +0000 2024-08-20T04:52:54.505 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-08-20 04:46:54.947493168 +0000 2024-08-20T04:52:54.505 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-20T04:52:54.597 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-08-20T04:52:54.598 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-08-20T04:52:54.598 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000273797 s, 1.9 MB/s 2024-08-20T04:52:54.600 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-20T04:52:54.637 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2024-08-20T04:52:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-20T04:52:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T04:52:54.712 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-08-20T04:52:54.713 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T04:52:54.713 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T04:52:54.713 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-08-20 04:51:44.978479352 +0000 2024-08-20T04:52:54.713 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-08-20 04:46:55.400487150 +0000 2024-08-20T04:52:54.713 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-08-20 04:46:55.400487150 +0000 2024-08-20T04:52:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-08-20 04:46:55.400487150 +0000 2024-08-20T04:52:54.713 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-20T04:52:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-08-20T04:52:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-08-20T04:52:54.805 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000272136 s, 1.9 MB/s 2024-08-20T04:52:54.808 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-20T04:52:54.845 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2024-08-20T04:52:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-20T04:52:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T04:52:54.920 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-08-20T04:52:54.920 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T04:52:54.920 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T04:52:54.920 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-08-20 04:51:45.017478839 +0000 2024-08-20T04:52:54.920 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-08-20 04:46:55.839481318 +0000 2024-08-20T04:52:54.920 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-08-20 04:46:55.839481318 +0000 2024-08-20T04:52:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-08-20 04:46:55.839481318 +0000 2024-08-20T04:52:54.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-20T04:52:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-08-20T04:52:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-08-20T04:52:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000266669 s, 1.9 MB/s 2024-08-20T04:52:55.015 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-20T04:52:55.051 DEBUG:teuthology.orchestra.run.smithi130:> set -ex 2024-08-20T04:52:55.051 DEBUG:teuthology.orchestra.run.smithi130:> dd if=/scratch_devs of=/dev/stdout 2024-08-20T04:52:55.071 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-20T04:52:55.071 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_1 2024-08-20T04:52:55.130 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-20T04:52:55.130 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T04:52:55.130 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-08-20T04:52:55.130 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T04:52:55.130 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T04:52:55.131 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-08-20 04:52:37.557338804 +0000 2024-08-20T04:52:55.131 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-08-20 04:47:02.143161557 +0000 2024-08-20T04:52:55.131 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-08-20 04:47:02.144161539 +0000 2024-08-20T04:52:55.131 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-08-20 04:47:02.143161557 +0000 2024-08-20T04:52:55.131 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-20T04:52:55.201 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-08-20T04:52:55.201 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-08-20T04:52:55.201 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000289912 s, 1.8 MB/s 2024-08-20T04:52:55.202 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-20T04:52:55.261 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_2 2024-08-20T04:52:55.318 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-20T04:52:55.318 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T04:52:55.319 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-08-20T04:52:55.319 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T04:52:55.319 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T04:52:55.319 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-08-20 04:52:37.558338786 +0000 2024-08-20T04:52:55.319 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-08-20 04:47:02.471155572 +0000 2024-08-20T04:52:55.319 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-08-20 04:47:02.471155572 +0000 2024-08-20T04:52:55.319 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-08-20 04:47:02.471155572 +0000 2024-08-20T04:52:55.319 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-20T04:52:55.384 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-08-20T04:52:55.384 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-08-20T04:52:55.384 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000219724 s, 2.3 MB/s 2024-08-20T04:52:55.385 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-20T04:52:55.442 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_3 2024-08-20T04:52:55.498 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-20T04:52:55.498 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T04:52:55.499 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-08-20T04:52:55.499 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T04:52:55.499 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T04:52:55.499 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-08-20 04:52:37.558338786 +0000 2024-08-20T04:52:55.499 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-08-20 04:47:02.810149386 +0000 2024-08-20T04:52:55.499 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-08-20 04:47:02.810149386 +0000 2024-08-20T04:52:55.499 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-08-20 04:47:02.810149386 +0000 2024-08-20T04:52:55.499 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-20T04:52:55.563 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-08-20T04:52:55.563 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-08-20T04:52:55.563 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000244275 s, 2.1 MB/s 2024-08-20T04:52:55.564 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-20T04:52:55.621 DEBUG:teuthology.orchestra.run.smithi130:> stat /dev/vg_nvme/lv_4 2024-08-20T04:52:55.677 INFO:teuthology.orchestra.run.smithi130.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-20T04:52:55.677 INFO:teuthology.orchestra.run.smithi130.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T04:52:55.678 INFO:teuthology.orchestra.run.smithi130.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-08-20T04:52:55.678 INFO:teuthology.orchestra.run.smithi130.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T04:52:55.678 INFO:teuthology.orchestra.run.smithi130.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T04:52:55.678 INFO:teuthology.orchestra.run.smithi130.stdout:Access: 2024-08-20 04:52:37.559338768 +0000 2024-08-20T04:52:55.678 INFO:teuthology.orchestra.run.smithi130.stdout:Modify: 2024-08-20 04:47:03.140143365 +0000 2024-08-20T04:52:55.678 INFO:teuthology.orchestra.run.smithi130.stdout:Change: 2024-08-20 04:47:03.140143365 +0000 2024-08-20T04:52:55.678 INFO:teuthology.orchestra.run.smithi130.stdout: Birth: 2024-08-20 04:47:03.140143365 +0000 2024-08-20T04:52:55.678 DEBUG:teuthology.orchestra.run.smithi130:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-20T04:52:55.741 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records in 2024-08-20T04:52:55.741 INFO:teuthology.orchestra.run.smithi130.stderr:1+0 records out 2024-08-20T04:52:55.741 INFO:teuthology.orchestra.run.smithi130.stderr:512 bytes copied, 0.000218786 s, 2.3 MB/s 2024-08-20T04:52:55.743 DEBUG:teuthology.orchestra.run.smithi130:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-20T04:52:55.799 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-08-20T04:52:55.799 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-08-20T04:52:55.819 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-20T04:52:55.819 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-08-20T04:52:55.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:55 smithi135 ceph-mon[22342]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:55.878 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-20T04:52:55.878 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T04:52:55.878 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-08-20T04:52:55.878 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T04:52:55.878 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T04:52:55.879 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-08-20 04:52:35.324381810 +0000 2024-08-20T04:52:55.879 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-08-20 04:47:00.063569299 +0000 2024-08-20T04:52:55.879 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-08-20 04:47:00.063569299 +0000 2024-08-20T04:52:55.879 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-08-20 04:47:00.063569299 +0000 2024-08-20T04:52:55.879 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-20T04:52:55.948 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-08-20T04:52:55.949 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-08-20T04:52:55.949 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000287423 s, 1.8 MB/s 2024-08-20T04:52:55.950 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-20T04:52:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:55 smithi130 ceph-mon[22007]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:56.009 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-08-20T04:52:56.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:55 smithi037 ceph-mon[17265]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:56.066 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-20T04:52:56.066 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T04:52:56.067 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-08-20T04:52:56.067 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T04:52:56.067 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T04:52:56.067 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-08-20 04:52:35.325381789 +0000 2024-08-20T04:52:56.067 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-08-20 04:47:00.390562352 +0000 2024-08-20T04:52:56.067 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-08-20 04:47:00.390562352 +0000 2024-08-20T04:52:56.067 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-08-20 04:47:00.390562352 +0000 2024-08-20T04:52:56.067 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-20T04:52:56.132 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-08-20T04:52:56.132 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-08-20T04:52:56.132 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000216988 s, 2.4 MB/s 2024-08-20T04:52:56.133 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-20T04:52:56.190 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-08-20T04:52:56.246 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-20T04:52:56.247 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T04:52:56.247 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-08-20T04:52:56.247 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T04:52:56.247 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T04:52:56.247 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-08-20 04:52:35.325381789 +0000 2024-08-20T04:52:56.247 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-08-20 04:47:00.706555639 +0000 2024-08-20T04:52:56.247 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-08-20 04:47:00.706555639 +0000 2024-08-20T04:52:56.247 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-08-20 04:47:00.706555639 +0000 2024-08-20T04:52:56.247 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-20T04:52:56.311 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-08-20T04:52:56.312 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-08-20T04:52:56.312 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000183867 s, 2.8 MB/s 2024-08-20T04:52:56.313 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-20T04:52:56.370 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-08-20T04:52:56.429 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-20T04:52:56.429 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-20T04:52:56.429 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-08-20T04:52:56.429 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-20T04:52:56.429 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-08-20T04:52:56.429 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-08-20 04:52:35.326381767 +0000 2024-08-20T04:52:56.429 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-08-20 04:47:01.024548883 +0000 2024-08-20T04:52:56.429 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-08-20 04:47:01.024548883 +0000 2024-08-20T04:52:56.429 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-08-20 04:47:01.024548883 +0000 2024-08-20T04:52:56.430 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-20T04:52:56.492 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-08-20T04:52:56.492 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-08-20T04:52:56.493 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000221708 s, 2.3 MB/s 2024-08-20T04:52:56.494 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-20T04:52:56.550 INFO:tasks.cephadm:Deploying osd.0 on smithi037 with /dev/vg_nvme/lv_4... 2024-08-20T04:52:56.550 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-20T04:52:56.926 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:52:57.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:57 smithi037 ceph-mon[17265]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:57.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:57 smithi135 ceph-mon[22342]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:57 smithi130 ceph-mon[22007]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:59.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:52:59 smithi037 ceph-mon[17265]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:59.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:52:59 smithi135 ceph-mon[22342]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:52:59.889 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:52:59.922 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_4 2024-08-20T04:52:59.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:52:59 smithi130 ceph-mon[22007]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:00.307 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:53:00.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.877+0000 7f75bca00640 1 -- 172.21.15.37:0/3178263089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b8076cb0 msgr2=0x7f75b8075310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:53:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.877+0000 7f75bca00640 1 --2- 172.21.15.37:0/3178263089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b8076cb0 0x7f75b8075310 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009860 tx=0x7f75a802a340 comp rx=0 tx=0).stop 2024-08-20T04:53:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.877+0000 7f75bca00640 1 -- 172.21.15.37:0/3178263089 shutdown_connections 2024-08-20T04:53:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.877+0000 7f75bca00640 1 --2- 172.21.15.37:0/3178263089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b8106250 0x7f75b8110f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.877+0000 7f75bca00640 1 --2- 172.21.15.37:0/3178263089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75b8075850 0x7f75b8075cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.877+0000 7f75bca00640 1 --2- 172.21.15.37:0/3178263089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b8076cb0 0x7f75b8075310 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.877+0000 7f75bca00640 1 -- 172.21.15.37:0/3178263089 >> 172.21.15.37:0/3178263089 conn(0x7f75b80fe020 msgr2=0x7f75b8100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:53:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.877+0000 7f75bca00640 1 -- 172.21.15.37:0/3178263089 shutdown_connections 2024-08-20T04:53:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.877+0000 7f75bca00640 1 -- 172.21.15.37:0/3178263089 wait complete. 2024-08-20T04:53:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.878+0000 7f75bca00640 1 Processor -- start 2024-08-20T04:53:00.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.878+0000 7f75bca00640 1 -- start start 2024-08-20T04:53:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.878+0000 7f75bca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b8075850 0x7f75b819f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:53:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.878+0000 7f75bca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b8076cb0 0x7f75b819f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:53:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.878+0000 7f75bca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75b81a03b0 0x7f75b81a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:53:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.878+0000 7f75bca00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81149a0 con 0x7f75b8075850 2024-08-20T04:53:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.878+0000 7f75bca00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f75b8114820 con 0x7f75b8076cb0 2024-08-20T04:53:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.878+0000 7f75bca00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f75b8114b20 con 0x7f75b81a03b0 2024-08-20T04:53:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.879+0000 7f75b5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b8075850 0x7f75b819f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:53:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.879+0000 7f75ad400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b8076cb0 0x7f75b819f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:53:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.879+0000 7f75b5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b8075850 0x7f75b819f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37688/0 (socket says 172.21.15.37:37688) 2024-08-20T04:53:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.879+0000 7f75b5e00640 1 -- 172.21.15.37:0/2303751789 learned_addr learned my addr 172.21.15.37:0/2303751789 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:53:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.879+0000 7f75b6800640 1 --2- 172.21.15.37:0/2303751789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75b81a03b0 0x7f75b81a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:53:00.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.879+0000 7f75ad400640 1 -- 172.21.15.37:0/2303751789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75b81a03b0 msgr2=0x7f75b81a0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:53:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.879+0000 7f75ad400640 1 --2- 172.21.15.37:0/2303751789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75b81a03b0 0x7f75b81a0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.879+0000 7f75ad400640 1 -- 172.21.15.37:0/2303751789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b8075850 msgr2=0x7f75b819f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:53:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.879+0000 7f75ad400640 1 --2- 172.21.15.37:0/2303751789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b8075850 0x7f75b819f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.879+0000 7f75ad400640 1 -- 172.21.15.37:0/2303751789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b81a1030 con 0x7f75b8076cb0 2024-08-20T04:53:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.879+0000 7f75ad400640 1 --2- 172.21.15.37:0/2303751789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b8076cb0 0x7f75b819f770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f75a000e9f0 tx=0x7f75a000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:53:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.880+0000 7f75af400640 1 -- 172.21.15.37:0/2303751789 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a000ccc0 con 0x7f75b8076cb0 2024-08-20T04:53:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.880+0000 7f75af400640 1 -- 172.21.15.37:0/2303751789 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75a0005020 con 0x7f75b8076cb0 2024-08-20T04:53:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.880+0000 7f75bca00640 1 -- 172.21.15.37:0/2303751789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75b81a7450 con 0x7f75b8076cb0 2024-08-20T04:53:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.880+0000 7f75af400640 1 -- 172.21.15.37:0/2303751789 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a0004a00 con 0x7f75b8076cb0 2024-08-20T04:53:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.880+0000 7f75bca00640 1 -- 172.21.15.37:0/2303751789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75b81a7900 con 0x7f75b8076cb0 2024-08-20T04:53:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.881+0000 7f75bca00640 1 -- 172.21.15.37:0/2303751789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75b81047d0 con 0x7f75b8076cb0 2024-08-20T04:53:00.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.884+0000 7f75af400640 1 -- 172.21.15.37:0/2303751789 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f75a0004ba0 con 0x7f75b8076cb0 2024-08-20T04:53:00.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.885+0000 7f75af400640 1 --2- 172.21.15.37:0/2303751789 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f759c0b3bc0 0x7f759c0b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:53:00.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.885+0000 7f75af400640 1 -- 172.21.15.37:0/2303751789 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f75a00e2070 con 0x7f75b8076cb0 2024-08-20T04:53:00.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.885+0000 7f75b5e00640 1 --2- 172.21.15.37:0/2303751789 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f759c0b3bc0 0x7f759c0b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:53:00.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.886+0000 7f75b5e00640 1 --2- 172.21.15.37:0/2303751789 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f759c0b3bc0 0x7f759c0b6080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f75a80095f0 tx=0x7f75a8030450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:53:00.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:00.887+0000 7f75af400640 1 -- 172.21.15.37:0/2303751789 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f75a00ab2f0 con 0x7f75b8076cb0 2024-08-20T04:53:01.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:01.095+0000 7f75bca00640 1 -- 172.21.15.37:0/2303751789 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f75b802e4f0 con 0x7f759c0b3bc0 2024-08-20T04:53:01.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:01 smithi037 ceph-mon[17265]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:01.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:01 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:53:01.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:01 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:53:01.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:01 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:01.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:01 smithi135 ceph-mon[22342]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:01.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:01 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:53:01.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:01 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:53:01.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:01 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:01.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:01 smithi130 ceph-mon[22007]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:01.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:01 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:53:01.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:01 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:53:01.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:01 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:02.827 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:02 smithi037 ceph-mon[17265]: from='client.24245 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:53:02.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:02 smithi135 ceph-mon[22342]: from='client.24245 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:53:02.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:02 smithi130 ceph-mon[22007]: from='client.24245 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:53:03.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:03 smithi135 ceph-mon[22342]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:03.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:03 smithi130 ceph-mon[22007]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:04.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:03 smithi037 ceph-mon[17265]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:04.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:04 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2980316126' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a813e53b-68b3-43ff-a59b-aed00e98f2fd"} : dispatch 2024-08-20T04:53:04.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:04 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2980316126' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a813e53b-68b3-43ff-a59b-aed00e98f2fd"}]': finished 2024-08-20T04:53:04.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:04 smithi037 ceph-mon[17265]: osdmap e5: 1 total, 0 up, 1 in 2024-08-20T04:53:04.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:04 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:04.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:04 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2980316126' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a813e53b-68b3-43ff-a59b-aed00e98f2fd"} : dispatch 2024-08-20T04:53:04.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:04 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2980316126' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a813e53b-68b3-43ff-a59b-aed00e98f2fd"}]': finished 2024-08-20T04:53:04.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:04 smithi135 ceph-mon[22342]: osdmap e5: 1 total, 0 up, 1 in 2024-08-20T04:53:04.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:04 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:04.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:04 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2980316126' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a813e53b-68b3-43ff-a59b-aed00e98f2fd"} : dispatch 2024-08-20T04:53:04.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:04 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2980316126' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a813e53b-68b3-43ff-a59b-aed00e98f2fd"}]': finished 2024-08-20T04:53:04.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:04 smithi130 ceph-mon[22007]: osdmap e5: 1 total, 0 up, 1 in 2024-08-20T04:53:04.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:04 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:05.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:05 smithi135 ceph-mon[22342]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:05.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:05 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1177686688' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:53:05.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:05 smithi130 ceph-mon[22007]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:05.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:05 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1177686688' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:53:06.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:05 smithi037 ceph-mon[17265]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:06.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:05 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1177686688' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:53:07.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:07 smithi135 ceph-mon[22342]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:07 smithi130 ceph-mon[22007]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:08.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:07 smithi037 ceph-mon[17265]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:09.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:09 smithi135 ceph-mon[22342]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:09.886 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:09 smithi037 ceph-mon[17265]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:09.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:09 smithi130 ceph-mon[22007]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:11.708 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:11 smithi037 ceph-mon[17265]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:11.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:11 smithi135 ceph-mon[22342]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:11.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:11 smithi130 ceph-mon[22007]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:13.862 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:13 smithi037 ceph-mon[17265]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:13.862 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:13 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-20T04:53:13.862 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:13 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:13.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:13 smithi135 ceph-mon[22342]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:13.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:13 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-20T04:53:13.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:13 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:13 smithi130 ceph-mon[22007]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:13 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-08-20T04:53:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:13 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:14.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:14 smithi135 ceph-mon[22342]: Deploying daemon osd.0 on smithi037 2024-08-20T04:53:14.894 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:14 smithi037 ceph-mon[17265]: Deploying daemon osd.0 on smithi037 2024-08-20T04:53:14.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:14 smithi130 ceph-mon[22007]: Deploying daemon osd.0 on smithi037 2024-08-20T04:53:15.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:15 smithi037 ceph-mon[17265]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:15.857 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:15 smithi130 ceph-mon[22007]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:15 smithi135 ceph-mon[22342]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:17.764 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:17 smithi037 ceph-mon[17265]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:17.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:17 smithi135 ceph-mon[22342]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:17 smithi130 ceph-mon[22007]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:19.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:19 smithi037 ceph-mon[17265]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:19.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:19 smithi135 ceph-mon[22342]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:19.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:19 smithi130 ceph-mon[22007]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:20.708 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:20 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:53:20.708 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:20 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:20.708 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:20 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:20 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:53:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:20 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:20 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:20.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:20 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:53:20.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:20 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:20.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:20 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:21 smithi135 ceph-mon[22342]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:21 smithi130 ceph-mon[22007]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:21.988 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:21 smithi037 ceph-mon[17265]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:23.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:23 smithi135 ceph-mon[22342]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:23.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:23.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:23.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:23.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:53:23.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:23.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:23 smithi130 ceph-mon[22007]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:23.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:23.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:23.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:23.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:53:23.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:23.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:23 smithi037 ceph-mon[17265]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:23.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:23.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:23.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:23.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:53:23.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:24.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:24.937+0000 7f75af400640 1 -- 172.21.15.37:0/2303751789 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f75b802e4f0 con 0x7f759c0b3bc0 2024-08-20T04:53:24.939 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 0 on host 'smithi037' 2024-08-20T04:53:24.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:24.940+0000 7f75bca00640 1 -- 172.21.15.37:0/2303751789 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f759c0b3bc0 msgr2=0x7f759c0b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:53:24.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:24.940+0000 7f75bca00640 1 --2- 172.21.15.37:0/2303751789 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f759c0b3bc0 0x7f759c0b6080 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f75a80095f0 tx=0x7f75a8030450 comp rx=0 tx=0).stop 2024-08-20T04:53:24.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:24.940+0000 7f75bca00640 1 -- 172.21.15.37:0/2303751789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b8076cb0 msgr2=0x7f75b819f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:53:24.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:24.940+0000 7f75bca00640 1 --2- 172.21.15.37:0/2303751789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b8076cb0 0x7f75b819f770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f75a000e9f0 tx=0x7f75a000eeb0 comp rx=0 tx=0).stop 2024-08-20T04:53:24.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:24.940+0000 7f75bca00640 1 -- 172.21.15.37:0/2303751789 shutdown_connections 2024-08-20T04:53:24.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:24.940+0000 7f75bca00640 1 --2- 172.21.15.37:0/2303751789 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f759c0b3bc0 0x7f759c0b6080 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:24.940+0000 7f75bca00640 1 --2- 172.21.15.37:0/2303751789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75b81a03b0 0x7f75b81a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:24.940+0000 7f75bca00640 1 --2- 172.21.15.37:0/2303751789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b8076cb0 0x7f75b819f770 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:24.940+0000 7f75bca00640 1 --2- 172.21.15.37:0/2303751789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b8075850 0x7f75b819f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:24.940+0000 7f75bca00640 1 -- 172.21.15.37:0/2303751789 >> 172.21.15.37:0/2303751789 conn(0x7f75b80fe020 msgr2=0x7f75b8100410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:53:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:24.940+0000 7f75bca00640 1 -- 172.21.15.37:0/2303751789 shutdown_connections 2024-08-20T04:53:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:53:24.940+0000 7f75bca00640 1 -- 172.21.15.37:0/2303751789 wait complete. 2024-08-20T04:53:25.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:25 smithi037 ceph-mon[17265]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:25.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:25 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:53:25.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:25 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:25.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:25 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:25.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:25 smithi135 ceph-mon[22342]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:25.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:25 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:53:25.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:25 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:25.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:25 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:25.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:25 smithi130 ceph-mon[22007]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:25.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:25 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:53:25.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:25 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:25.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:25 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:25.772 DEBUG:teuthology.orchestra.run.smithi037:osd.0> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.0.service 2024-08-20T04:53:25.776 INFO:tasks.cephadm:Deploying osd.1 on smithi130 with /dev/vg_nvme/lv_4... 2024-08-20T04:53:25.776 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-20T04:53:26.023 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T04:53:26.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:26 smithi037 ceph-mon[17265]: from='osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-20T04:53:26.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:26 smithi135 ceph-mon[22342]: from='osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-20T04:53:26.372 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:26 smithi130 ceph-mon[22007]: from='osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-08-20T04:53:27.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:27 smithi037 ceph-mon[17265]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:27.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:27 smithi037 ceph-mon[17265]: from='osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-20T04:53:27.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:27 smithi037 ceph-mon[17265]: osdmap e6: 1 total, 0 up, 1 in 2024-08-20T04:53:27.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:27 smithi037 ceph-mon[17265]: from='osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-20T04:53:27.344 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:27.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:27 smithi135 ceph-mon[22342]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:27.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:27 smithi135 ceph-mon[22342]: from='osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-20T04:53:27.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:27 smithi135 ceph-mon[22342]: osdmap e6: 1 total, 0 up, 1 in 2024-08-20T04:53:27.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:27 smithi135 ceph-mon[22342]: from='osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-20T04:53:27.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:27.374 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:27 smithi130 ceph-mon[22007]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:27.374 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:27 smithi130 ceph-mon[22007]: from='osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-20T04:53:27.374 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:27 smithi130 ceph-mon[22007]: osdmap e6: 1 total, 0 up, 1 in 2024-08-20T04:53:27.374 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:27 smithi130 ceph-mon[22007]: from='osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-20T04:53:27.374 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:28.016 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 04:53:27 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-0[33556]: 2024-08-20T04:53:27.808+0000 7fb305600640 -1 osd.0 0 waiting for initial osdmap 2024-08-20T04:53:28.016 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 04:53:27 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-0[33556]: 2024-08-20T04:53:27.827+0000 7fb2fb600640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T04:53:28.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:28 smithi130 ceph-mon[22007]: from='osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-20T04:53:28.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:28 smithi130 ceph-mon[22007]: osdmap e7: 1 total, 0 up, 1 in 2024-08-20T04:53:28.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:28.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:28.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:28 smithi130 ceph-mon[22007]: from='osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373]' entity='osd.0' 2024-08-20T04:53:28.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:28 smithi135 ceph-mon[22342]: from='osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-20T04:53:28.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:28 smithi135 ceph-mon[22342]: osdmap e7: 1 total, 0 up, 1 in 2024-08-20T04:53:28.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:28.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:28.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:28 smithi135 ceph-mon[22342]: from='osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373]' entity='osd.0' 2024-08-20T04:53:28.514 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:53:28.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:28 smithi037 ceph-mon[17265]: from='osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-20T04:53:28.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:28 smithi037 ceph-mon[17265]: osdmap e7: 1 total, 0 up, 1 in 2024-08-20T04:53:28.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:28.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:28.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:28 smithi037 ceph-mon[17265]: from='osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373]' entity='osd.0' 2024-08-20T04:53:28.539 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_4 2024-08-20T04:53:28.793 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T04:53:29.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.280+0000 7fdc05af7640 1 -- 172.21.15.130:0/1917874562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc00104250 msgr2=0x7fdc0010abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:53:29.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.280+0000 7fdc05af7640 1 --2- 172.21.15.130:0/1917874562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc00104250 0x7fdc0010abd0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8009cd0 tx=0x7fdbf802a8e0 comp rx=0 tx=0).stop 2024-08-20T04:53:29.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.280+0000 7fdc05af7640 1 -- 172.21.15.130:0/1917874562 shutdown_connections 2024-08-20T04:53:29.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.280+0000 7fdc05af7640 1 --2- 172.21.15.130:0/1917874562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc00104250 0x7fdc0010abd0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:29.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.280+0000 7fdc05af7640 1 --2- 172.21.15.130:0/1917874562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc00103890 0x7fdc00103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:29.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.280+0000 7fdc05af7640 1 --2- 172.21.15.130:0/1917874562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc00102730 0x7fdc00102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:29.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.280+0000 7fdc05af7640 1 -- 172.21.15.130:0/1917874562 >> 172.21.15.130:0/1917874562 conn(0x7fdc000fe020 msgr2=0x7fdc00100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:53:29.282 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.280+0000 7fdc05af7640 1 -- 172.21.15.130:0/1917874562 shutdown_connections 2024-08-20T04:53:29.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.280+0000 7fdc05af7640 1 -- 172.21.15.130:0/1917874562 wait complete. 2024-08-20T04:53:29.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.280+0000 7fdc05af7640 1 Processor -- start 2024-08-20T04:53:29.283 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdc05af7640 1 -- start start 2024-08-20T04:53:29.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdc05af7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc00102730 0x7fdc001989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:53:29.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdc05af7640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc00103890 0x7fdc00198ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:53:29.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdc05af7640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc00104250 0x7fdc00199bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:53:29.284 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdc05af7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0010e3e0 con 0x7fdc00102730 2024-08-20T04:53:29.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdc05af7640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0010e260 con 0x7fdc00103890 2024-08-20T04:53:29.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdc05af7640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0010e560 con 0x7fdc00104250 2024-08-20T04:53:29.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdbfeffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc00103890 0x7fdc00198ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:53:29.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdbfeffd640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc00103890 0x7fdc00198ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:34310/0 (socket says 172.21.15.130:34310) 2024-08-20T04:53:29.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdbfeffd640 1 -- 172.21.15.130:0/2277258177 learned_addr learned my addr 172.21.15.130:0/2277258177 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-08-20T04:53:29.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdbff7fe640 1 --2- 172.21.15.130:0/2277258177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc00102730 0x7fdc001989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:53:29.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdbfffff640 1 --2- 172.21.15.130:0/2277258177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc00104250 0x7fdc00199bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:53:29.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdbfeffd640 1 -- 172.21.15.130:0/2277258177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc00104250 msgr2=0x7fdc00199bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:53:29.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdbfeffd640 1 --2- 172.21.15.130:0/2277258177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc00104250 0x7fdc00199bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:29.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdbfeffd640 1 -- 172.21.15.130:0/2277258177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc00102730 msgr2=0x7fdc001989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:53:29.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdbfeffd640 1 --2- 172.21.15.130:0/2277258177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc00102730 0x7fdc001989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:29.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdbfeffd640 1 -- 172.21.15.130:0/2277258177 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0019a460 con 0x7fdc00103890 2024-08-20T04:53:29.285 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.281+0000 7fdbfeffd640 1 --2- 172.21.15.130:0/2277258177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc00103890 0x7fdc00198ff0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000c920 tx=0x7fdbf000cd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:53:29.286 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.282+0000 7fdbfcff9640 1 -- 172.21.15.130:0/2277258177 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0007bb0 con 0x7fdc00103890 2024-08-20T04:53:29.286 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.282+0000 7fdbfcff9640 1 -- 172.21.15.130:0/2277258177 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbf0007d50 con 0x7fdc00103890 2024-08-20T04:53:29.286 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.282+0000 7fdc05af7640 1 -- 172.21.15.130:0/2277258177 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0019a750 con 0x7fdc00103890 2024-08-20T04:53:29.286 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.282+0000 7fdbfcff9640 1 -- 172.21.15.130:0/2277258177 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0018730 con 0x7fdc00103890 2024-08-20T04:53:29.286 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.282+0000 7fdc05af7640 1 -- 172.21.15.130:0/2277258177 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc001a0e30 con 0x7fdc00103890 2024-08-20T04:53:29.286 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.283+0000 7fdc05af7640 1 -- 172.21.15.130:0/2277258177 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc001099e0 con 0x7fdc00103890 2024-08-20T04:53:29.287 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.284+0000 7fdbfcff9640 1 -- 172.21.15.130:0/2277258177 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fdbf000f450 con 0x7fdc00103890 2024-08-20T04:53:29.287 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.285+0000 7fdbfcff9640 1 --2- 172.21.15.130:0/2277258177 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdbe80b3bc0 0x7fdbe80b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:53:29.287 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.285+0000 7fdbfcff9640 1 -- 172.21.15.130:0/2277258177 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7fdbf00e2160 con 0x7fdc00103890 2024-08-20T04:53:29.287 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.285+0000 7fdbff7fe640 1 --2- 172.21.15.130:0/2277258177 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdbe80b3bc0 0x7fdbe80b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:53:29.287 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.286+0000 7fdbff7fe640 1 --2- 172.21.15.130:0/2277258177 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdbe80b3bc0 0x7fdbe80b6080 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400abe0 tx=0x7fdbf400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:53:29.290 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.289+0000 7fdbfcff9640 1 -- 172.21.15.130:0/2277258177 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fdbf0014030 con 0x7fdc00103890 2024-08-20T04:53:29.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:29 smithi135 ceph-mon[22342]: purged_snaps scrub starts 2024-08-20T04:53:29.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:29 smithi135 ceph-mon[22342]: purged_snaps scrub ok 2024-08-20T04:53:29.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:29 smithi135 ceph-mon[22342]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:29.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:29.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:29 smithi135 ceph-mon[22342]: osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373] boot 2024-08-20T04:53:29.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:29 smithi135 ceph-mon[22342]: osdmap e8: 1 total, 1 up, 1 in 2024-08-20T04:53:29.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:29.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:29 smithi130 ceph-mon[22007]: purged_snaps scrub starts 2024-08-20T04:53:29.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:29 smithi130 ceph-mon[22007]: purged_snaps scrub ok 2024-08-20T04:53:29.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:29 smithi130 ceph-mon[22007]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:29.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:29.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:29 smithi130 ceph-mon[22007]: osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373] boot 2024-08-20T04:53:29.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:29 smithi130 ceph-mon[22007]: osdmap e8: 1 total, 1 up, 1 in 2024-08-20T04:53:29.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:29.484 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:29.482+0000 7fdc05af7640 1 -- 172.21.15.130:0/2277258177 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fdc000632c0 con 0x7fdbe80b3bc0 2024-08-20T04:53:29.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:29 smithi037 ceph-mon[17265]: purged_snaps scrub starts 2024-08-20T04:53:29.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:29 smithi037 ceph-mon[17265]: purged_snaps scrub ok 2024-08-20T04:53:29.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:29 smithi037 ceph-mon[17265]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-20T04:53:29.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:29.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:29 smithi037 ceph-mon[17265]: osd.0 [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373] boot 2024-08-20T04:53:29.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:29 smithi037 ceph-mon[17265]: osdmap e8: 1 total, 1 up, 1 in 2024-08-20T04:53:29.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-08-20T04:53:30.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:30 smithi135 ceph-mon[22342]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:53:30.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:53:30.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:53:30.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:30.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:30 smithi135 ceph-mon[22342]: Detected new or changed devices on smithi037 2024-08-20T04:53:30.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:30.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:30.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T04:53:30.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:30 smithi135 ceph-mon[22342]: Adjusting osd_memory_target on smithi037 to 17094M 2024-08-20T04:53:30.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:30.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:30.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:53:30.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:30.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:30 smithi130 ceph-mon[22007]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:53:30.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:53:30.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:53:30.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:30 smithi130 ceph-mon[22007]: Detected new or changed devices on smithi037 2024-08-20T04:53:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T04:53:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:30 smithi130 ceph-mon[22007]: Adjusting osd_memory_target on smithi037 to 17094M 2024-08-20T04:53:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:53:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:30.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:30 smithi037 ceph-mon[17265]: from='client.24272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:53:30.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:53:30.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:53:30.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:30.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:30 smithi037 ceph-mon[17265]: Detected new or changed devices on smithi037 2024-08-20T04:53:30.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:30.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:30.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T04:53:30.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:30 smithi037 ceph-mon[17265]: Adjusting osd_memory_target on smithi037 to 17094M 2024-08-20T04:53:30.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:30.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:30.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:53:30.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:31.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:31 smithi037 ceph-mon[17265]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:31.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:31 smithi037 ceph-mon[17265]: osdmap e9: 1 total, 1 up, 1 in 2024-08-20T04:53:31.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:31 smithi135 ceph-mon[22342]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:31.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:31 smithi135 ceph-mon[22342]: osdmap e9: 1 total, 1 up, 1 in 2024-08-20T04:53:31.392 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:31 smithi130 ceph-mon[22007]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:31.392 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:31 smithi130 ceph-mon[22007]: osdmap e9: 1 total, 1 up, 1 in 2024-08-20T04:53:32.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:32 smithi130 ceph-mon[22007]: from='client.? 172.21.15.130:0/1224087955' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c216a8d0-9685-467a-8161-700682ce617c"} : dispatch 2024-08-20T04:53:32.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:32 smithi130 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c216a8d0-9685-467a-8161-700682ce617c"} : dispatch 2024-08-20T04:53:32.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:32 smithi130 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c216a8d0-9685-467a-8161-700682ce617c"}]': finished 2024-08-20T04:53:32.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:32 smithi130 ceph-mon[22007]: osdmap e10: 2 total, 1 up, 2 in 2024-08-20T04:53:32.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:32.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:32 smithi135 ceph-mon[22342]: from='client.? 172.21.15.130:0/1224087955' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c216a8d0-9685-467a-8161-700682ce617c"} : dispatch 2024-08-20T04:53:32.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:32 smithi135 ceph-mon[22342]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c216a8d0-9685-467a-8161-700682ce617c"} : dispatch 2024-08-20T04:53:32.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:32 smithi135 ceph-mon[22342]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c216a8d0-9685-467a-8161-700682ce617c"}]': finished 2024-08-20T04:53:32.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:32 smithi135 ceph-mon[22342]: osdmap e10: 2 total, 1 up, 2 in 2024-08-20T04:53:32.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:32.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:32 smithi037 ceph-mon[17265]: from='client.? 172.21.15.130:0/1224087955' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c216a8d0-9685-467a-8161-700682ce617c"} : dispatch 2024-08-20T04:53:32.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:32 smithi037 ceph-mon[17265]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c216a8d0-9685-467a-8161-700682ce617c"} : dispatch 2024-08-20T04:53:32.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:32 smithi037 ceph-mon[17265]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c216a8d0-9685-467a-8161-700682ce617c"}]': finished 2024-08-20T04:53:32.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:32 smithi037 ceph-mon[17265]: osdmap e10: 2 total, 1 up, 2 in 2024-08-20T04:53:32.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:33.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:33 smithi135 ceph-mon[22342]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:33.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:33 smithi135 ceph-mon[22342]: from='client.? 172.21.15.130:0/1165743344' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:53:33.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:33 smithi130 ceph-mon[22007]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:33.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:33 smithi130 ceph-mon[22007]: from='client.? 172.21.15.130:0/1165743344' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:53:33.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:33 smithi037 ceph-mon[17265]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:33.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:33 smithi037 ceph-mon[17265]: from='client.? 172.21.15.130:0/1165743344' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:53:35.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:35 smithi135 ceph-mon[22342]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:35.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:35 smithi130 ceph-mon[22007]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:35.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:35 smithi037 ceph-mon[17265]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:37.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:37 smithi135 ceph-mon[22342]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:37.380 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:37 smithi130 ceph-mon[22007]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:37.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:37 smithi037 ceph-mon[17265]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:39.199 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:39 smithi130 ceph-mon[22007]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:39.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:39 smithi135 ceph-mon[22342]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:39.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:39 smithi037 ceph-mon[17265]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:40.296 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:40 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-20T04:53:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:40 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:40.297 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:40 smithi130 ceph-mon[22007]: Deploying daemon osd.1 on smithi130 2024-08-20T04:53:40.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:40 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-20T04:53:40.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:40 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:40.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:40 smithi135 ceph-mon[22342]: Deploying daemon osd.1 on smithi130 2024-08-20T04:53:40.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:40 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-08-20T04:53:40.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:40 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:40.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:40 smithi037 ceph-mon[17265]: Deploying daemon osd.1 on smithi130 2024-08-20T04:53:41.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:41 smithi130 ceph-mon[22007]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:41.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:41 smithi037 ceph-mon[17265]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:41.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:41 smithi135 ceph-mon[22342]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:43.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:43 smithi130 ceph-mon[22007]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:43.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:43 smithi037 ceph-mon[17265]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:43.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:43 smithi135 ceph-mon[22342]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:45.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:45 smithi130 ceph-mon[22007]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:45.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:53:45.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:45.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:45.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:45 smithi037 ceph-mon[17265]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:45.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:53:45.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:45.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:45.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:45 smithi135 ceph-mon[22342]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:45.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:53:45.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:45.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:47.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:47 smithi130 ceph-mon[22007]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:47.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:47.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:47.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:47.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:53:47.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:47.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:47 smithi037 ceph-mon[17265]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:47.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:47.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:47.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:47.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:53:47.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:47.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:47 smithi135 ceph-mon[22342]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:47.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:47.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:47.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:47.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:53:47.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:47.957 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:47.955+0000 7fdbfcff9640 1 -- 172.21.15.130:0/2277258177 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdc000632c0 con 0x7fdbe80b3bc0 2024-08-20T04:53:47.958 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 1 on host 'smithi130' 2024-08-20T04:53:47.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:47.958+0000 7fdc05af7640 1 -- 172.21.15.130:0/2277258177 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdbe80b3bc0 msgr2=0x7fdbe80b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:53:47.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:47.958+0000 7fdc05af7640 1 --2- 172.21.15.130:0/2277258177 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdbe80b3bc0 0x7fdbe80b6080 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400abe0 tx=0x7fdbf400a2d0 comp rx=0 tx=0).stop 2024-08-20T04:53:47.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:47.958+0000 7fdc05af7640 1 -- 172.21.15.130:0/2277258177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc00103890 msgr2=0x7fdc00198ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:53:47.959 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:47.958+0000 7fdc05af7640 1 --2- 172.21.15.130:0/2277258177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc00103890 0x7fdc00198ff0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000c920 tx=0x7fdbf000cd20 comp rx=0 tx=0).stop 2024-08-20T04:53:47.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:47.958+0000 7fdc05af7640 1 -- 172.21.15.130:0/2277258177 shutdown_connections 2024-08-20T04:53:47.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:47.958+0000 7fdc05af7640 1 --2- 172.21.15.130:0/2277258177 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdbe80b3bc0 0x7fdbe80b6080 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:47.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:47.958+0000 7fdc05af7640 1 --2- 172.21.15.130:0/2277258177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc00104250 0x7fdc00199bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:47.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:47.958+0000 7fdc05af7640 1 --2- 172.21.15.130:0/2277258177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc00103890 0x7fdc00198ff0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:47.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:47.958+0000 7fdc05af7640 1 --2- 172.21.15.130:0/2277258177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc00102730 0x7fdc001989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:47.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:47.958+0000 7fdc05af7640 1 -- 172.21.15.130:0/2277258177 >> 172.21.15.130:0/2277258177 conn(0x7fdc000fe020 msgr2=0x7fdc00106bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:53:47.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:47.958+0000 7fdc05af7640 1 -- 172.21.15.130:0/2277258177 shutdown_connections 2024-08-20T04:53:47.960 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:53:47.958+0000 7fdc05af7640 1 -- 172.21.15.130:0/2277258177 wait complete. 2024-08-20T04:53:48.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:48 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:53:48.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:48 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:48.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:48 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:48.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:48 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:53:48.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:48 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:48.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:48 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:48.542 DEBUG:teuthology.orchestra.run.smithi130:osd.1> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.1.service 2024-08-20T04:53:48.545 INFO:tasks.cephadm:Deploying osd.2 on smithi135 with /dev/vg_nvme/lv_4... 2024-08-20T04:53:48.545 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-20T04:53:48.572 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:48 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:53:48.572 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:48 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:48.572 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:48 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:48.795 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T04:53:49.267 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:49 smithi135 ceph-mon[22342]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:49.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:49 smithi130 ceph-mon[22007]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:49.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:49 smithi037 ceph-mon[17265]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:50.881 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 04:53:50 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-1[26411]: 2024-08-20T04:53:50.493+0000 7f7e85c07640 -1 osd.1 0 log_to_monitors true 2024-08-20T04:53:51.389 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:53:51.417 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:51 smithi135 ceph-mon[22342]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:51.417 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:51 smithi135 ceph-mon[22342]: from='osd.1 [v2:172.21.15.130:6800/4206461125,v1:172.21.15.130:6801/4206461125]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T04:53:51.418 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:51 smithi135 ceph-mon[22342]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T04:53:51.419 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_4 2024-08-20T04:53:51.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:51 smithi130 ceph-mon[22007]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:51.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:51 smithi130 ceph-mon[22007]: from='osd.1 [v2:172.21.15.130:6800/4206461125,v1:172.21.15.130:6801/4206461125]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T04:53:51.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:51 smithi130 ceph-mon[22007]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T04:53:51.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:51 smithi037 ceph-mon[17265]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:51.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:51 smithi037 ceph-mon[17265]: from='osd.1 [v2:172.21.15.130:6800/4206461125,v1:172.21.15.130:6801/4206461125]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T04:53:51.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:51 smithi037 ceph-mon[17265]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-08-20T04:53:51.709 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T04:53:52.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.173+0000 7fc608676640 1 -- 172.21.15.135:0/1681235041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc600103160 msgr2=0x7fc600109ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:53:52.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.173+0000 7fc608676640 1 --2- 172.21.15.135:0/1681235041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc600103160 0x7fc600109ae0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009cf0 tx=0x7fc5f802a8c0 comp rx=0 tx=0).stop 2024-08-20T04:53:52.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.173+0000 7fc608676640 1 -- 172.21.15.135:0/1681235041 shutdown_connections 2024-08-20T04:53:52.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.173+0000 7fc608676640 1 --2- 172.21.15.135:0/1681235041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc600103160 0x7fc600109ae0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:52.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.173+0000 7fc608676640 1 --2- 172.21.15.135:0/1681235041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6001027a0 0x7fc600102c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:52.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.173+0000 7fc608676640 1 --2- 172.21.15.135:0/1681235041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc600101640 0x7fc600101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:52.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.173+0000 7fc608676640 1 -- 172.21.15.135:0/1681235041 >> 172.21.15.135:0/1681235041 conn(0x7fc6000fcf30 msgr2=0x7fc6000ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:53:52.177 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.173+0000 7fc608676640 1 -- 172.21.15.135:0/1681235041 shutdown_connections 2024-08-20T04:53:52.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.173+0000 7fc608676640 1 -- 172.21.15.135:0/1681235041 wait complete. 2024-08-20T04:53:52.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.174+0000 7fc608676640 1 Processor -- start 2024-08-20T04:53:52.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.174+0000 7fc608676640 1 -- start start 2024-08-20T04:53:52.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.174+0000 7fc608676640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc600101640 0x7fc600197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:53:52.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.174+0000 7fc608676640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6001027a0 0x7fc6001981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:53:52.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.174+0000 7fc608676640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc600103160 0x7fc600198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:53:52.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.174+0000 7fc608676640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc60010d390 con 0x7fc600101640 2024-08-20T04:53:52.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.174+0000 7fc608676640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc60010d210 con 0x7fc6001027a0 2024-08-20T04:53:52.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.174+0000 7fc608676640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc60010d510 con 0x7fc600103160 2024-08-20T04:53:52.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.174+0000 7fc606c13640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc600103160 0x7fc600198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:53:52.178 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.174+0000 7fc606c13640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc600103160 0x7fc600198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:41114/0 (socket says 172.21.15.135:41114) 2024-08-20T04:53:52.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.174+0000 7fc606c13640 1 -- 172.21.15.135:0/2020521275 learned_addr learned my addr 172.21.15.135:0/2020521275 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-08-20T04:53:52.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.174+0000 7fc605c11640 1 --2- 172.21.15.135:0/2020521275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6001027a0 0x7fc6001981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:53:52.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.174+0000 7fc606412640 1 --2- 172.21.15.135:0/2020521275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc600101640 0x7fc600197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:53:52.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.175+0000 7fc606c13640 1 -- 172.21.15.135:0/2020521275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6001027a0 msgr2=0x7fc6001981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:53:52.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.175+0000 7fc606c13640 1 --2- 172.21.15.135:0/2020521275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6001027a0 0x7fc6001981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:52.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.175+0000 7fc606c13640 1 -- 172.21.15.135:0/2020521275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc600101640 msgr2=0x7fc600197b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:53:52.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.175+0000 7fc606c13640 1 --2- 172.21.15.135:0/2020521275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc600101640 0x7fc600197b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:53:52.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.175+0000 7fc606c13640 1 -- 172.21.15.135:0/2020521275 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc600199640 con 0x7fc600103160 2024-08-20T04:53:52.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.175+0000 7fc606c13640 1 --2- 172.21.15.135:0/2020521275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc600103160 0x7fc600198da0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc5f802aeb0 tx=0x7fc5f8003bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:53:52.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.175+0000 7fc5f77fe640 1 -- 172.21.15.135:0/2020521275 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8030990 con 0x7fc600103160 2024-08-20T04:53:52.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.175+0000 7fc5f77fe640 1 -- 172.21.15.135:0/2020521275 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5f8040030 con 0x7fc600103160 2024-08-20T04:53:52.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.175+0000 7fc608676640 1 -- 172.21.15.135:0/2020521275 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6001998d0 con 0x7fc600103160 2024-08-20T04:53:52.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.175+0000 7fc5f77fe640 1 -- 172.21.15.135:0/2020521275 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5f80059b0 con 0x7fc600103160 2024-08-20T04:53:52.179 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.175+0000 7fc608676640 1 -- 172.21.15.135:0/2020521275 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc60006b1b0 con 0x7fc600103160 2024-08-20T04:53:52.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.176+0000 7fc608676640 1 -- 172.21.15.135:0/2020521275 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc60006bbd0 con 0x7fc600103160 2024-08-20T04:53:52.180 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.178+0000 7fc5f77fe640 1 -- 172.21.15.135:0/2020521275 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7fc5f8005090 con 0x7fc600103160 2024-08-20T04:53:52.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.178+0000 7fc5f77fe640 1 --2- 172.21.15.135:0/2020521275 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5ec0b3b40 0x7fc5ec0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:53:52.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.178+0000 7fc5f77fe640 1 -- 172.21.15.135:0/2020521275 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7fc5f8103380 con 0x7fc600103160 2024-08-20T04:53:52.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.179+0000 7fc606412640 1 --2- 172.21.15.135:0/2020521275 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5ec0b3b40 0x7fc5ec0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:53:52.181 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.179+0000 7fc606412640 1 --2- 172.21.15.135:0/2020521275 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5ec0b3b40 0x7fc5ec0b6000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009bd0 tx=0x7fc5fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:53:52.186 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.185+0000 7fc5f77fe640 1 -- 172.21.15.135:0/2020521275 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fc5f802e050 con 0x7fc600103160 2024-08-20T04:53:52.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:52 smithi135 ceph-mon[22342]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-20T04:53:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:52 smithi135 ceph-mon[22342]: osdmap e11: 2 total, 1 up, 2 in 2024-08-20T04:53:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:52 smithi135 ceph-mon[22342]: from='osd.1 [v2:172.21.15.130:6800/4206461125,v1:172.21.15.130:6801/4206461125]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:53:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:52 smithi135 ceph-mon[22342]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:53:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:52 smithi135 ceph-mon[22342]: Detected new or changed devices on smithi130 2024-08-20T04:53:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:52.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T04:53:52.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:52 smithi135 ceph-mon[22342]: Adjusting osd_memory_target on smithi130 to 17088M 2024-08-20T04:53:52.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:52.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:52.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:53:52.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:52.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:52 smithi135 ceph-mon[22342]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-20T04:53:52.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:52 smithi135 ceph-mon[22342]: osdmap e12: 2 total, 1 up, 2 in 2024-08-20T04:53:52.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:52.372 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:53:52.371+0000 7fc608676640 1 -- 172.21.15.135:0/2020521275 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc600108520 con 0x7fc5ec0b3b40 2024-08-20T04:53:52.455 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-1[26411]: 2024-08-20T04:53:52.146+0000 7f7e81b8a640 -1 osd.1 0 waiting for initial osdmap 2024-08-20T04:53:52.455 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-1[26411]: 2024-08-20T04:53:52.154+0000 7f7e7d9b1640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T04:53:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-mon[22007]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-20T04:53:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-mon[22007]: osdmap e11: 2 total, 1 up, 2 in 2024-08-20T04:53:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-mon[22007]: from='osd.1 [v2:172.21.15.130:6800/4206461125,v1:172.21.15.130:6801/4206461125]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:53:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-mon[22007]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:53:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-mon[22007]: Detected new or changed devices on smithi130 2024-08-20T04:53:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T04:53:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-mon[22007]: Adjusting osd_memory_target on smithi130 to 17088M 2024-08-20T04:53:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:52.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:53:52.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:52.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-mon[22007]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-20T04:53:52.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-mon[22007]: osdmap e12: 2 total, 1 up, 2 in 2024-08-20T04:53:52.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:52.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:52 smithi037 ceph-mon[17265]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-20T04:53:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:52 smithi037 ceph-mon[17265]: osdmap e11: 2 total, 1 up, 2 in 2024-08-20T04:53:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:52 smithi037 ceph-mon[17265]: from='osd.1 [v2:172.21.15.130:6800/4206461125,v1:172.21.15.130:6801/4206461125]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:53:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:52 smithi037 ceph-mon[17265]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:53:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:52 smithi037 ceph-mon[17265]: Detected new or changed devices on smithi130 2024-08-20T04:53:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T04:53:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:52 smithi037 ceph-mon[17265]: Adjusting osd_memory_target on smithi130 to 17088M 2024-08-20T04:53:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:53:52.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:53:52.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:52 smithi037 ceph-mon[17265]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-20T04:53:52.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:52 smithi037 ceph-mon[17265]: osdmap e12: 2 total, 1 up, 2 in 2024-08-20T04:53:52.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:53.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:53 smithi130 ceph-mon[22007]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:53.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:53 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:53.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:53 smithi130 ceph-mon[22007]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:53:53.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:53 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:53:53.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:53 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:53:53.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:53 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:53.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:53 smithi037 ceph-mon[17265]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:53.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:53 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:53.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:53 smithi037 ceph-mon[17265]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:53:53.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:53 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:53:53.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:53 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:53:53.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:53 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:53.578 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:53 smithi135 ceph-mon[22342]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:53.578 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:53 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:53.579 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:53 smithi135 ceph-mon[22342]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:53:53.579 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:53 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:53:53.579 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:53 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:53:53.579 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:53 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:53:54.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:54 smithi130 ceph-mon[22007]: purged_snaps scrub starts 2024-08-20T04:53:54.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:54 smithi130 ceph-mon[22007]: purged_snaps scrub ok 2024-08-20T04:53:54.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:54 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:54.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:54 smithi130 ceph-mon[22007]: osd.1 [v2:172.21.15.130:6800/4206461125,v1:172.21.15.130:6801/4206461125] boot 2024-08-20T04:53:54.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:54 smithi130 ceph-mon[22007]: osdmap e13: 2 total, 2 up, 2 in 2024-08-20T04:53:54.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:54 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:54.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:54 smithi037 ceph-mon[17265]: purged_snaps scrub starts 2024-08-20T04:53:54.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:54 smithi037 ceph-mon[17265]: purged_snaps scrub ok 2024-08-20T04:53:54.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:54 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:54.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:54 smithi037 ceph-mon[17265]: osd.1 [v2:172.21.15.130:6800/4206461125,v1:172.21.15.130:6801/4206461125] boot 2024-08-20T04:53:54.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:54 smithi037 ceph-mon[17265]: osdmap e13: 2 total, 2 up, 2 in 2024-08-20T04:53:54.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:54 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:54.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:54 smithi135 ceph-mon[22342]: purged_snaps scrub starts 2024-08-20T04:53:54.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:54 smithi135 ceph-mon[22342]: purged_snaps scrub ok 2024-08-20T04:53:54.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:54 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:54.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:54 smithi135 ceph-mon[22342]: osd.1 [v2:172.21.15.130:6800/4206461125,v1:172.21.15.130:6801/4206461125] boot 2024-08-20T04:53:54.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:54 smithi135 ceph-mon[22342]: osdmap e13: 2 total, 2 up, 2 in 2024-08-20T04:53:54.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:54 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-08-20T04:53:55.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:55 smithi135 ceph-mon[22342]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:55.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:55 smithi135 ceph-mon[22342]: osdmap e14: 2 total, 2 up, 2 in 2024-08-20T04:53:55.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:55 smithi135 ceph-mon[22342]: from='client.? 172.21.15.135:0/1202142843' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "34402442-c652-40eb-865e-a607a28846b2"} : dispatch 2024-08-20T04:53:55.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:55 smithi135 ceph-mon[22342]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "34402442-c652-40eb-865e-a607a28846b2"} : dispatch 2024-08-20T04:53:55.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:55 smithi135 ceph-mon[22342]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34402442-c652-40eb-865e-a607a28846b2"}]': finished 2024-08-20T04:53:55.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:55 smithi135 ceph-mon[22342]: osdmap e15: 3 total, 2 up, 3 in 2024-08-20T04:53:55.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:55 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:53:55.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:55 smithi135 ceph-mon[22342]: from='client.? 172.21.15.135:0/4148777124' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:53:55.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:55 smithi130 ceph-mon[22007]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:55.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:55 smithi130 ceph-mon[22007]: osdmap e14: 2 total, 2 up, 2 in 2024-08-20T04:53:55.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:55 smithi130 ceph-mon[22007]: from='client.? 172.21.15.135:0/1202142843' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "34402442-c652-40eb-865e-a607a28846b2"} : dispatch 2024-08-20T04:53:55.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:55 smithi130 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "34402442-c652-40eb-865e-a607a28846b2"} : dispatch 2024-08-20T04:53:55.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:55 smithi130 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34402442-c652-40eb-865e-a607a28846b2"}]': finished 2024-08-20T04:53:55.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:55 smithi130 ceph-mon[22007]: osdmap e15: 3 total, 2 up, 3 in 2024-08-20T04:53:55.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:55 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:53:55.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:55 smithi130 ceph-mon[22007]: from='client.? 172.21.15.135:0/4148777124' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:53:55.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:55 smithi037 ceph-mon[17265]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-08-20T04:53:55.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:55 smithi037 ceph-mon[17265]: osdmap e14: 2 total, 2 up, 2 in 2024-08-20T04:53:55.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:55 smithi037 ceph-mon[17265]: from='client.? 172.21.15.135:0/1202142843' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "34402442-c652-40eb-865e-a607a28846b2"} : dispatch 2024-08-20T04:53:55.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:55 smithi037 ceph-mon[17265]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "34402442-c652-40eb-865e-a607a28846b2"} : dispatch 2024-08-20T04:53:55.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:55 smithi037 ceph-mon[17265]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34402442-c652-40eb-865e-a607a28846b2"}]': finished 2024-08-20T04:53:55.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:55 smithi037 ceph-mon[17265]: osdmap e15: 3 total, 2 up, 3 in 2024-08-20T04:53:55.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:53:55.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:55 smithi037 ceph-mon[17265]: from='client.? 172.21.15.135:0/4148777124' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:53:57.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:57 smithi130 ceph-mon[22007]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:53:57.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:57 smithi037 ceph-mon[17265]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:53:57.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:57 smithi135 ceph-mon[22342]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:53:59.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:53:59 smithi135 ceph-mon[22342]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:53:59.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:53:59 smithi130 ceph-mon[22007]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:53:59.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:53:59 smithi037 ceph-mon[17265]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:01.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:01 smithi135 ceph-mon[22342]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:01.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:01 smithi130 ceph-mon[22007]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:01.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:01 smithi037 ceph-mon[17265]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:03.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:03 smithi130 ceph-mon[22007]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:03.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:03 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-20T04:54:03.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:03 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:03.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:03 smithi130 ceph-mon[22007]: Deploying daemon osd.2 on smithi135 2024-08-20T04:54:03.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:03 smithi037 ceph-mon[17265]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:03.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:03 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-20T04:54:03.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:03 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:03.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:03 smithi037 ceph-mon[17265]: Deploying daemon osd.2 on smithi135 2024-08-20T04:54:03.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:03 smithi135 ceph-mon[22342]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:03.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:03 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-08-20T04:54:03.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:03 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:03.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:03 smithi135 ceph-mon[22342]: Deploying daemon osd.2 on smithi135 2024-08-20T04:54:05.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:05 smithi130 ceph-mon[22007]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:05.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:05 smithi037 ceph-mon[17265]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:05.585 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:05 smithi135 ceph-mon[22342]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:07.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:07 smithi130 ceph-mon[22007]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:07.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:07 smithi037 ceph-mon[17265]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:07.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:07 smithi135 ceph-mon[22342]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:08.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:08 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:54:08.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:08 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:08.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:08 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:08.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:08 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:54:08.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:08 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:08.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:08 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:08.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:08 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:54:08.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:08 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:08.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:08 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:09.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:09 smithi130 ceph-mon[22007]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:09.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:09 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:09.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:09 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:09.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:09 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:09.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:09 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:54:09.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:09 smithi037 ceph-mon[17265]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:09.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:09 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:09.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:09 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:09.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:09 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:09.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:09 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:54:09.772 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:09 smithi135 ceph-mon[22342]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:09.772 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:09.772 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:09.772 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:09.773 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:54:10.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:10 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:10.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:10 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:10.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:10 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:11.537 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 2 on host 'smithi135' 2024-08-20T04:54:11.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:54:11.533+0000 7fc5f77fe640 1 -- 172.21.15.135:0/2020521275 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc600108520 con 0x7fc5ec0b3b40 2024-08-20T04:54:11.537 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:54:11.536+0000 7fc608676640 1 -- 172.21.15.135:0/2020521275 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5ec0b3b40 msgr2=0x7fc5ec0b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:54:11.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:54:11.536+0000 7fc608676640 1 --2- 172.21.15.135:0/2020521275 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5ec0b3b40 0x7fc5ec0b6000 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009bd0 tx=0x7fc5fc005f90 comp rx=0 tx=0).stop 2024-08-20T04:54:11.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:54:11.536+0000 7fc608676640 1 -- 172.21.15.135:0/2020521275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc600103160 msgr2=0x7fc600198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:54:11.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:54:11.536+0000 7fc608676640 1 --2- 172.21.15.135:0/2020521275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc600103160 0x7fc600198da0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc5f802aeb0 tx=0x7fc5f8003bf0 comp rx=0 tx=0).stop 2024-08-20T04:54:11.538 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:54:11.536+0000 7fc608676640 1 -- 172.21.15.135:0/2020521275 shutdown_connections 2024-08-20T04:54:11.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:54:11.536+0000 7fc608676640 1 --2- 172.21.15.135:0/2020521275 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5ec0b3b40 0x7fc5ec0b6000 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:11.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:54:11.536+0000 7fc608676640 1 --2- 172.21.15.135:0/2020521275 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc600103160 0x7fc600198da0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:11.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:54:11.536+0000 7fc608676640 1 --2- 172.21.15.135:0/2020521275 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc6001027a0 0x7fc6001981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:11.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:54:11.536+0000 7fc608676640 1 --2- 172.21.15.135:0/2020521275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc600101640 0x7fc600197b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:11.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:54:11.536+0000 7fc608676640 1 -- 172.21.15.135:0/2020521275 >> 172.21.15.135:0/2020521275 conn(0x7fc6000fcf30 msgr2=0x7fc600105b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:54:11.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:54:11.536+0000 7fc608676640 1 -- 172.21.15.135:0/2020521275 shutdown_connections 2024-08-20T04:54:11.539 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:54:11.536+0000 7fc608676640 1 -- 172.21.15.135:0/2020521275 wait complete. 2024-08-20T04:54:11.713 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:11 smithi130 ceph-mon[22007]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:11.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:11 smithi037 ceph-mon[17265]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:11.838 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:11 smithi135 ceph-mon[22342]: pgmap v86: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:12.157 DEBUG:teuthology.orchestra.run.smithi135:osd.2> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.2.service 2024-08-20T04:54:12.159 INFO:tasks.cephadm:Deploying osd.3 on smithi037 with /dev/vg_nvme/lv_3... 2024-08-20T04:54:12.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-20T04:54:12.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:54:12.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:12.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:54:12.633 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:54:12.634 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:12.634 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:12.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:54:12.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:12.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:13.539 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 04:54:13 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-2[27288]: 2024-08-20T04:54:13.283+0000 7fd3fb2eb640 -1 osd.2 0 log_to_monitors true 2024-08-20T04:54:13.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:13 smithi037 ceph-mon[17265]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:13.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:13 smithi037 ceph-mon[17265]: from='osd.2 [v2:172.21.15.135:6800/2653255199,v1:172.21.15.135:6801/2653255199]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T04:54:13.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:13 smithi037 ceph-mon[17265]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T04:54:13.790 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:13 smithi135 ceph-mon[22342]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:13.790 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:13 smithi135 ceph-mon[22342]: from='osd.2 [v2:172.21.15.135:6800/2653255199,v1:172.21.15.135:6801/2653255199]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T04:54:13.790 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:13 smithi135 ceph-mon[22342]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T04:54:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:13 smithi130 ceph-mon[22007]: pgmap v87: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:13 smithi130 ceph-mon[22007]: from='osd.2 [v2:172.21.15.135:6800/2653255199,v1:172.21.15.135:6801/2653255199]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T04:54:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:13 smithi130 ceph-mon[22007]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-08-20T04:54:14.794 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:14 smithi135 ceph-mon[22342]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-20T04:54:14.794 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:14 smithi135 ceph-mon[22342]: from='osd.2 [v2:172.21.15.135:6800/2653255199,v1:172.21.15.135:6801/2653255199]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:54:14.794 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:14 smithi135 ceph-mon[22342]: osdmap e16: 3 total, 2 up, 3 in 2024-08-20T04:54:14.794 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:54:14.794 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:14 smithi135 ceph-mon[22342]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:54:14.794 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:14 smithi135 ceph-mon[22342]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-08-20T04:54:14.795 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:14 smithi135 ceph-mon[22342]: osdmap e17: 3 total, 2 up, 3 in 2024-08-20T04:54:14.848 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:14 smithi037 ceph-mon[17265]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-20T04:54:14.848 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:14 smithi037 ceph-mon[17265]: from='osd.2 [v2:172.21.15.135:6800/2653255199,v1:172.21.15.135:6801/2653255199]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:54:14.848 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:14 smithi037 ceph-mon[17265]: osdmap e16: 3 total, 2 up, 3 in 2024-08-20T04:54:14.848 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:54:14.848 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:14 smithi037 ceph-mon[17265]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:54:14.848 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:14 smithi037 ceph-mon[17265]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-08-20T04:54:14.848 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:14 smithi037 ceph-mon[17265]: osdmap e17: 3 total, 2 up, 3 in 2024-08-20T04:54:14.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:14 smithi130 ceph-mon[22007]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-20T04:54:14.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:14 smithi130 ceph-mon[22007]: from='osd.2 [v2:172.21.15.135:6800/2653255199,v1:172.21.15.135:6801/2653255199]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:54:14.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:14 smithi130 ceph-mon[22007]: osdmap e16: 3 total, 2 up, 3 in 2024-08-20T04:54:14.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:14 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:54:14.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:14 smithi130 ceph-mon[22007]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:54:14.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:14 smithi130 ceph-mon[22007]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-08-20T04:54:14.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:14 smithi130 ceph-mon[22007]: osdmap e17: 3 total, 2 up, 3 in 2024-08-20T04:54:15.562 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 04:54:15 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-2[27288]: 2024-08-20T04:54:15.219+0000 7fd3f726e640 -1 osd.2 0 waiting for initial osdmap 2024-08-20T04:54:15.563 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 04:54:15 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-2[27288]: 2024-08-20T04:54:15.223+0000 7fd3ef08d640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T04:54:15.792 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:54:15.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:15 smithi037 ceph-mon[17265]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:15.822 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:54:15.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:54:15.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:15 smithi037 ceph-mon[17265]: from='osd.2 ' entity='osd.2' 2024-08-20T04:54:15.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:15.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:15.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T04:54:15.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:15.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:15.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:54:15.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:15.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:54:15.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_3 2024-08-20T04:54:15.857 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:15 smithi130 ceph-mon[22007]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:15.857 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:54:15.857 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:54:15.857 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:15 smithi130 ceph-mon[22007]: from='osd.2 ' entity='osd.2' 2024-08-20T04:54:15.857 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:15.857 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:15.857 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T04:54:15.857 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:15.857 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:15.858 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:54:15.858 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:15.858 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:54:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:15 smithi135 ceph-mon[22342]: pgmap v89: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:54:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:54:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:15 smithi135 ceph-mon[22342]: from='osd.2 ' entity='osd.2' 2024-08-20T04:54:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T04:54:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:54:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:54:16.208 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:54:16.692 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:16 smithi037 ceph-mon[17265]: purged_snaps scrub starts 2024-08-20T04:54:16.692 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:16 smithi037 ceph-mon[17265]: purged_snaps scrub ok 2024-08-20T04:54:16.693 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:16 smithi037 ceph-mon[17265]: Detected new or changed devices on smithi135 2024-08-20T04:54:16.693 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:16 smithi037 ceph-mon[17265]: Adjusting osd_memory_target on smithi135 to 5815M 2024-08-20T04:54:16.693 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:16 smithi037 ceph-mon[17265]: osd.2 [v2:172.21.15.135:6800/2653255199,v1:172.21.15.135:6801/2653255199] boot 2024-08-20T04:54:16.693 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:16 smithi037 ceph-mon[17265]: osdmap e18: 3 total, 3 up, 3 in 2024-08-20T04:54:16.693 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:16 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:54:16.693 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:16 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-20T04:54:16.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.807+0000 7f21dde00640 1 -- 172.21.15.37:0/1870041278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d8077740 msgr2=0x7f21d8077b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:54:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.807+0000 7f21dde00640 1 --2- 172.21.15.37:0/1870041278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d8077740 0x7f21d8077b40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009900 tx=0x7f21c802a410 comp rx=0 tx=0).stop 2024-08-20T04:54:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.808+0000 7f21dde00640 1 -- 172.21.15.37:0/1870041278 shutdown_connections 2024-08-20T04:54:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.808+0000 7f21dde00640 1 --2- 172.21.15.37:0/1870041278 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21d8079260 0x7f21d8079bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.808+0000 7f21dde00640 1 --2- 172.21.15.37:0/1870041278 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21d80788a0 0x7f21d8078d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.808+0000 7f21dde00640 1 --2- 172.21.15.37:0/1870041278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d8077740 0x7f21d8077b40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.808+0000 7f21dde00640 1 -- 172.21.15.37:0/1870041278 >> 172.21.15.37:0/1870041278 conn(0x7f21d8100210 msgr2=0x7f21d8102650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:54:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.808+0000 7f21dde00640 1 -- 172.21.15.37:0/1870041278 shutdown_connections 2024-08-20T04:54:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.808+0000 7f21dde00640 1 -- 172.21.15.37:0/1870041278 wait complete. 2024-08-20T04:54:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.809+0000 7f21dde00640 1 Processor -- start 2024-08-20T04:54:16.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.809+0000 7f21dde00640 1 -- start start 2024-08-20T04:54:16.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.809+0000 7f21dde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d8077740 0x7f21d819f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:54:16.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.809+0000 7f21dde00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21d80788a0 0x7f21d819f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:54:16.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.809+0000 7f21dde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21d8079260 0x7f21d81a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:54:16.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.809+0000 7f21dde00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f21d8114a20 con 0x7f21d8077740 2024-08-20T04:54:16.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.809+0000 7f21dde00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f21d81148a0 con 0x7f21d8079260 2024-08-20T04:54:16.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.809+0000 7f21dde00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f21d8114ba0 con 0x7f21d80788a0 2024-08-20T04:54:16.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.809+0000 7f21d6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d8077740 0x7f21d819f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:54:16.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.809+0000 7f21d6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d8077740 0x7f21d819f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57244/0 (socket says 172.21.15.37:57244) 2024-08-20T04:54:16.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.809+0000 7f21d6a00640 1 -- 172.21.15.37:0/3138005914 learned_addr learned my addr 172.21.15.37:0/3138005914 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:54:16.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.809+0000 7f21d6000640 1 --2- 172.21.15.37:0/3138005914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21d80788a0 0x7f21d819f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:54:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.810+0000 7f21d7400640 1 --2- 172.21.15.37:0/3138005914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21d8079260 0x7f21d81a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:54:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.810+0000 7f21d6000640 1 -- 172.21.15.37:0/3138005914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21d8079260 msgr2=0x7f21d81a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:54:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.810+0000 7f21d6000640 1 --2- 172.21.15.37:0/3138005914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21d8079260 0x7f21d81a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.810+0000 7f21d6000640 1 -- 172.21.15.37:0/3138005914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d8077740 msgr2=0x7f21d819f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:54:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.810+0000 7f21d6000640 1 --2- 172.21.15.37:0/3138005914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d8077740 0x7f21d819f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.810+0000 7f21d6000640 1 -- 172.21.15.37:0/3138005914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21d81a0c10 con 0x7f21d80788a0 2024-08-20T04:54:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.810+0000 7f21d6a00640 1 --2- 172.21.15.37:0/3138005914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d8077740 0x7f21d819f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:54:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.810+0000 7f21d6000640 1 --2- 172.21.15.37:0/3138005914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21d80788a0 0x7f21d819f730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f21c400e9f0 tx=0x7f21c400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:54:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.811+0000 7f21dca00640 1 -- 172.21.15.37:0/3138005914 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c400ccc0 con 0x7f21d80788a0 2024-08-20T04:54:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.811+0000 7f21dde00640 1 -- 172.21.15.37:0/3138005914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21d81a0f00 con 0x7f21d80788a0 2024-08-20T04:54:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.811+0000 7f21dca00640 1 -- 172.21.15.37:0/3138005914 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21c40108e0 con 0x7f21d80788a0 2024-08-20T04:54:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.811+0000 7f21dca00640 1 -- 172.21.15.37:0/3138005914 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c4018880 con 0x7f21d80788a0 2024-08-20T04:54:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.811+0000 7f21dde00640 1 -- 172.21.15.37:0/3138005914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21d81a75e0 con 0x7f21d80788a0 2024-08-20T04:54:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.812+0000 7f21dde00640 1 -- 172.21.15.37:0/3138005914 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21d8111400 con 0x7f21d80788a0 2024-08-20T04:54:16.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.814+0000 7f21dca00640 1 -- 172.21.15.37:0/3138005914 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 15) ==== 151003+0+0 (secure 0 0 0) 0x7f21c4010430 con 0x7f21d80788a0 2024-08-20T04:54:16.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.816+0000 7f21dca00640 1 --2- 172.21.15.37:0/3138005914 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f21bc0b3b40 0x7f21bc0b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:54:16.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.816+0000 7f21dca00640 1 -- 172.21.15.37:0/3138005914 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7f21c40e2960 con 0x7f21d80788a0 2024-08-20T04:54:16.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.816+0000 7f21d6a00640 1 --2- 172.21.15.37:0/3138005914 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f21bc0b3b40 0x7f21bc0b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:54:16.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.817+0000 7f21d6a00640 1 --2- 172.21.15.37:0/3138005914 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f21bc0b3b40 0x7f21bc0b6000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f21c80096c0 tx=0x7f21c8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:54:16.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:16.817+0000 7f21dca00640 1 -- 172.21.15.37:0/3138005914 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f21c40aaef0 con 0x7f21d80788a0 2024-08-20T04:54:16.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:16 smithi135 ceph-mon[22342]: purged_snaps scrub starts 2024-08-20T04:54:16.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:16 smithi135 ceph-mon[22342]: purged_snaps scrub ok 2024-08-20T04:54:16.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:16 smithi135 ceph-mon[22342]: Detected new or changed devices on smithi135 2024-08-20T04:54:16.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:16 smithi135 ceph-mon[22342]: Adjusting osd_memory_target on smithi135 to 5815M 2024-08-20T04:54:16.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:16 smithi135 ceph-mon[22342]: osd.2 [v2:172.21.15.135:6800/2653255199,v1:172.21.15.135:6801/2653255199] boot 2024-08-20T04:54:16.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:16 smithi135 ceph-mon[22342]: osdmap e18: 3 total, 3 up, 3 in 2024-08-20T04:54:16.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:16 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:54:16.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:16 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-20T04:54:16.871 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:16 smithi130 ceph-mon[22007]: purged_snaps scrub starts 2024-08-20T04:54:16.871 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:16 smithi130 ceph-mon[22007]: purged_snaps scrub ok 2024-08-20T04:54:16.871 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:16 smithi130 ceph-mon[22007]: Detected new or changed devices on smithi135 2024-08-20T04:54:16.871 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:16 smithi130 ceph-mon[22007]: Adjusting osd_memory_target on smithi135 to 5815M 2024-08-20T04:54:16.871 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:16 smithi130 ceph-mon[22007]: osd.2 [v2:172.21.15.135:6800/2653255199,v1:172.21.15.135:6801/2653255199] boot 2024-08-20T04:54:16.871 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:16 smithi130 ceph-mon[22007]: osdmap e18: 3 total, 3 up, 3 in 2024-08-20T04:54:16.871 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:16 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-08-20T04:54:16.871 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:16 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-08-20T04:54:17.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:17.021+0000 7f21dde00640 1 -- 172.21.15.37:0/3138005914 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f21d80632c0 con 0x7f21bc0b3b40 2024-08-20T04:54:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:17 smithi135 ceph-mon[22342]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:17 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:54:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:17 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:54:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:17 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:17 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-20T04:54:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:17 smithi135 ceph-mon[22342]: osdmap e19: 3 total, 3 up, 3 in 2024-08-20T04:54:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:17 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-20T04:54:17.912 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:17 smithi037 ceph-mon[17265]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:17.912 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:17 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:54:17.913 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:17 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:54:17.913 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:17 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:17.913 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:17 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-20T04:54:17.913 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:17 smithi037 ceph-mon[17265]: osdmap e19: 3 total, 3 up, 3 in 2024-08-20T04:54:17.913 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:17 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-20T04:54:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:17 smithi130 ceph-mon[22007]: pgmap v91: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-08-20T04:54:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:17 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:54:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:17 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:54:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:17 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:17 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-20T04:54:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:17 smithi130 ceph-mon[22007]: osdmap e19: 3 total, 3 up, 3 in 2024-08-20T04:54:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:17 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-08-20T04:54:18.558 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:18 smithi037 sudo[38309]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T04:54:18.558 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:18 smithi037 sudo[38309]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T04:54:18.558 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:18 smithi037 sudo[38309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T04:54:18.558 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:18 smithi037 sudo[38309]: pam_unix(sudo:session): session closed for user root 2024-08-20T04:54:18.559 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 04:54:18 smithi037 sudo[38302]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T04:54:18.559 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 04:54:18 smithi037 sudo[38302]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T04:54:18.559 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 04:54:18 smithi037 sudo[38302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T04:54:18.559 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 04:54:18 smithi037 sudo[38302]: pam_unix(sudo:session): session closed for user root 2024-08-20T04:54:18.559 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 04:54:18 smithi037 sudo[38306]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T04:54:18.559 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 04:54:18 smithi037 sudo[38306]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T04:54:18.559 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 04:54:18 smithi037 sudo[38306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T04:54:18.559 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 04:54:18 smithi037 sudo[38306]: pam_unix(sudo:session): session closed for user root 2024-08-20T04:54:18.660 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 04:54:18 smithi130 sudo[30558]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T04:54:18.661 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 04:54:18 smithi130 sudo[30558]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T04:54:18.661 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 04:54:18 smithi130 sudo[30558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T04:54:18.661 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 04:54:18 smithi130 sudo[30558]: pam_unix(sudo:session): session closed for user root 2024-08-20T04:54:18.661 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 04:54:18 smithi130 sudo[30561]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T04:54:18.661 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 04:54:18 smithi130 sudo[30561]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T04:54:18.661 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 04:54:18 smithi130 sudo[30561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T04:54:18.661 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 04:54:18 smithi130 sudo[30561]: pam_unix(sudo:session): session closed for user root 2024-08-20T04:54:18.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:18 smithi130 ceph-mon[22007]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:54:18.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-20T04:54:18.661 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:18 smithi130 ceph-mon[22007]: osdmap e20: 3 total, 3 up, 3 in 2024-08-20T04:54:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:18 smithi130 ceph-mon[22007]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T04:54:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:18 smithi130 ceph-mon[22007]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T04:54:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:18 smithi130 sudo[30564]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T04:54:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:18 smithi130 sudo[30564]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T04:54:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:18 smithi130 sudo[30564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T04:54:18.662 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:18 smithi130 sudo[30564]: pam_unix(sudo:session): session closed for user root 2024-08-20T04:54:18.865 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 04:54:18 smithi135 sudo[31369]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T04:54:18.865 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 04:54:18 smithi135 sudo[31369]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T04:54:18.865 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 04:54:18 smithi135 sudo[31369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T04:54:18.866 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 04:54:18 smithi135 sudo[31369]: pam_unix(sudo:session): session closed for user root 2024-08-20T04:54:18.866 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 04:54:18 smithi135 sudo[31372]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T04:54:18.866 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 04:54:18 smithi135 sudo[31372]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T04:54:18.866 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 04:54:18 smithi135 sudo[31372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T04:54:18.866 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 04:54:18 smithi135 sudo[31372]: pam_unix(sudo:session): session closed for user root 2024-08-20T04:54:18.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:18 smithi135 ceph-mon[22342]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:54:18.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:18 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-20T04:54:18.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:18 smithi135 ceph-mon[22342]: osdmap e20: 3 total, 3 up, 3 in 2024-08-20T04:54:18.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:18 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:18.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:18 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:18.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:18 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:18.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:18 smithi135 ceph-mon[22342]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T04:54:18.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:18 smithi135 ceph-mon[22342]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T04:54:18.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:18 smithi135 sudo[31375]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-20T04:54:18.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:18 smithi135 sudo[31375]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T04:54:18.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:18 smithi135 sudo[31375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T04:54:18.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:18 smithi135 sudo[31375]: pam_unix(sudo:session): session closed for user root 2024-08-20T04:54:18.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:18 smithi135 sudo[31378]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T04:54:18.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:18 smithi135 sudo[31378]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T04:54:18.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:18 smithi135 sudo[31378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T04:54:18.868 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:18 smithi135 sudo[31378]: pam_unix(sudo:session): session closed for user root 2024-08-20T04:54:18.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:18 smithi130 sudo[30567]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T04:54:18.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:18 smithi130 sudo[30567]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T04:54:18.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:18 smithi130 sudo[30567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T04:54:18.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:18 smithi130 sudo[30567]: pam_unix(sudo:session): session closed for user root 2024-08-20T04:54:19.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:18 smithi037 sudo[38312]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-20T04:54:19.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:18 smithi037 sudo[38312]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-20T04:54:19.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:18 smithi037 sudo[38312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-20T04:54:19.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:18 smithi037 sudo[38312]: pam_unix(sudo:session): session closed for user root 2024-08-20T04:54:19.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:18 smithi037 ceph-mon[17265]: from='client.24325 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:54:19.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:18 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-20T04:54:19.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:18 smithi037 ceph-mon[17265]: osdmap e20: 3 total, 3 up, 3 in 2024-08-20T04:54:19.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:18 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:19.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:18 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:19.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:18 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:19.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:18 smithi037 ceph-mon[17265]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T04:54:19.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:18 smithi037 ceph-mon[17265]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T04:54:19.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:19 smithi135 ceph-mon[22342]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:19 smithi135 ceph-mon[22342]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-20T04:54:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:54:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:54:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:54:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:19 smithi135 ceph-mon[22342]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T04:54:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:54:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:54:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:54:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:19 smithi135 ceph-mon[22342]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T04:54:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:19 smithi135 ceph-mon[22342]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T04:54:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:54:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:54:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:54:19.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:19 smithi135 ceph-mon[22342]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T04:54:19.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:19 smithi135 ceph-mon[22342]: osdmap e21: 3 total, 3 up, 3 in 2024-08-20T04:54:19.875 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:19 smithi037 ceph-mon[17265]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:19.875 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:19 smithi037 ceph-mon[17265]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-20T04:54:19.875 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:54:19.875 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:54:19.875 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:54:19.875 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:19 smithi037 ceph-mon[17265]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T04:54:19.875 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:54:19.875 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:54:19.875 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:54:19.876 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:19 smithi037 ceph-mon[17265]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T04:54:19.876 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:19 smithi037 ceph-mon[17265]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T04:54:19.876 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:54:19.876 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:54:19.876 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:54:19.876 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:19 smithi037 ceph-mon[17265]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T04:54:19.876 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:19 smithi037 ceph-mon[17265]: osdmap e21: 3 total, 3 up, 3 in 2024-08-20T04:54:19.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:19 smithi130 ceph-mon[22007]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:19.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:19 smithi130 ceph-mon[22007]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-20T04:54:19.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:54:19.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:54:19.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:54:19.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:19 smithi130 ceph-mon[22007]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T04:54:19.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:54:19.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:54:19.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:54:19.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:19 smithi130 ceph-mon[22007]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T04:54:19.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:19 smithi130 ceph-mon[22007]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-20T04:54:19.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T04:54:19.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T04:54:19.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T04:54:19.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:19 smithi130 ceph-mon[22007]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-20T04:54:19.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:19 smithi130 ceph-mon[22007]: osdmap e21: 3 total, 3 up, 3 in 2024-08-20T04:54:20.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:20.609+0000 7f21dca00640 1 -- 172.21.15.37:0/3138005914 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f21c40a7180 con 0x7f21d80788a0 2024-08-20T04:54:20.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:20 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1270935653' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ec7be9dc-96b5-4816-9065-8121baedcdc5"} : dispatch 2024-08-20T04:54:20.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:20 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1270935653' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec7be9dc-96b5-4816-9065-8121baedcdc5"}]': finished 2024-08-20T04:54:20.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:20 smithi037 ceph-mon[17265]: osdmap e22: 4 total, 3 up, 4 in 2024-08-20T04:54:20.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:20 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:20 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1270935653' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ec7be9dc-96b5-4816-9065-8121baedcdc5"} : dispatch 2024-08-20T04:54:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:20 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1270935653' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec7be9dc-96b5-4816-9065-8121baedcdc5"}]': finished 2024-08-20T04:54:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:20 smithi135 ceph-mon[22342]: osdmap e22: 4 total, 3 up, 4 in 2024-08-20T04:54:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:20 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:20.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:20 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1270935653' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ec7be9dc-96b5-4816-9065-8121baedcdc5"} : dispatch 2024-08-20T04:54:20.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:20 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1270935653' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec7be9dc-96b5-4816-9065-8121baedcdc5"}]': finished 2024-08-20T04:54:20.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:20 smithi130 ceph-mon[22007]: osdmap e22: 4 total, 3 up, 4 in 2024-08-20T04:54:20.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:20 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:21 smithi135 ceph-mon[22342]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:21 smithi135 ceph-mon[22342]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-20T04:54:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:21 smithi135 ceph-mon[22342]: Cluster is now healthy 2024-08-20T04:54:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:21 smithi135 ceph-mon[22342]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-20T04:54:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:21 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3790682489' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:54:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:21 smithi130 ceph-mon[22007]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:21.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:21 smithi130 ceph-mon[22007]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-20T04:54:21.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:21 smithi130 ceph-mon[22007]: Cluster is now healthy 2024-08-20T04:54:21.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:21 smithi130 ceph-mon[22007]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-20T04:54:21.977 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:21 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3790682489' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:54:22.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:21 smithi037 ceph-mon[17265]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:22.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:21 smithi037 ceph-mon[17265]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-20T04:54:22.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:21 smithi037 ceph-mon[17265]: Cluster is now healthy 2024-08-20T04:54:22.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:21 smithi037 ceph-mon[17265]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-20T04:54:22.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:21 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3790682489' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:54:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:23 smithi135 ceph-mon[22342]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:23 smithi130 ceph-mon[22007]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:24.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:23 smithi037 ceph-mon[17265]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:25.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:25 smithi037 ceph-mon[17265]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:25.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:25 smithi135 ceph-mon[22342]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:25.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:25 smithi130 ceph-mon[22007]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:27.955 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:27 smithi037 ceph-mon[17265]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:27 smithi130 ceph-mon[22007]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:28.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:27 smithi135 ceph-mon[22342]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:29.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:29 smithi130 ceph-mon[22007]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:29.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-20T04:54:29.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:30.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:29 smithi037 ceph-mon[17265]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:30.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-20T04:54:30.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:30.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:29 smithi135 ceph-mon[22342]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:30.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-08-20T04:54:30.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:30.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:30 smithi130 ceph-mon[22007]: Deploying daemon osd.3 on smithi037 2024-08-20T04:54:31.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:30 smithi037 ceph-mon[17265]: Deploying daemon osd.3 on smithi037 2024-08-20T04:54:31.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:30 smithi135 ceph-mon[22342]: Deploying daemon osd.3 on smithi037 2024-08-20T04:54:31.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:31 smithi130 ceph-mon[22007]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:32.007 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:31 smithi037 ceph-mon[17265]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:32.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:31 smithi135 ceph-mon[22342]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:33.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:33 smithi037 ceph-mon[17265]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:33.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:33 smithi130 ceph-mon[22007]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:34.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:33 smithi135 ceph-mon[22342]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:35.865 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:35 smithi037 ceph-mon[17265]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:35 smithi130 ceph-mon[22007]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:36.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:35 smithi135 ceph-mon[22342]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:36.927 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:36 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:54:36.927 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:36 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:36.927 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:36 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:36.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:36 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:54:36.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:36 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:36.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:36 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:37.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:36 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:54:37.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:36 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:37.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:36 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:37.913 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:37 smithi037 ceph-mon[17265]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:37.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:37 smithi130 ceph-mon[22007]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:38.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:37 smithi135 ceph-mon[22342]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:39.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:39 smithi130 ceph-mon[22007]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:39.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:39.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:39.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:39.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:54:39.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:40.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:39 smithi037 ceph-mon[17265]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:40.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:40.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:40.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:40.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:54:40.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:40.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:39 smithi135 ceph-mon[22342]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:40.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:40.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:40.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:40.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:54:40.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:40.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:40.828+0000 7f21dca00640 1 -- 172.21.15.37:0/3138005914 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f21d80632c0 con 0x7f21bc0b3b40 2024-08-20T04:54:40.830 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 3 on host 'smithi037' 2024-08-20T04:54:40.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:40.831+0000 7f21dde00640 1 -- 172.21.15.37:0/3138005914 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f21bc0b3b40 msgr2=0x7f21bc0b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:54:40.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:40.831+0000 7f21dde00640 1 --2- 172.21.15.37:0/3138005914 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f21bc0b3b40 0x7f21bc0b6000 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f21c80096c0 tx=0x7f21c8005a20 comp rx=0 tx=0).stop 2024-08-20T04:54:40.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:40.831+0000 7f21dde00640 1 -- 172.21.15.37:0/3138005914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21d80788a0 msgr2=0x7f21d819f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:54:40.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:40.831+0000 7f21dde00640 1 --2- 172.21.15.37:0/3138005914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21d80788a0 0x7f21d819f730 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f21c400e9f0 tx=0x7f21c400eeb0 comp rx=0 tx=0).stop 2024-08-20T04:54:40.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:40.831+0000 7f21dde00640 1 -- 172.21.15.37:0/3138005914 shutdown_connections 2024-08-20T04:54:40.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:40.831+0000 7f21dde00640 1 --2- 172.21.15.37:0/3138005914 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f21bc0b3b40 0x7f21bc0b6000 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:40.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:40.831+0000 7f21dde00640 1 --2- 172.21.15.37:0/3138005914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21d8079260 0x7f21d81a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:40.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:40.831+0000 7f21dde00640 1 --2- 172.21.15.37:0/3138005914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21d80788a0 0x7f21d819f730 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:40.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:40.831+0000 7f21dde00640 1 --2- 172.21.15.37:0/3138005914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21d8077740 0x7f21d819f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:40.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:40.831+0000 7f21dde00640 1 -- 172.21.15.37:0/3138005914 >> 172.21.15.37:0/3138005914 conn(0x7f21d8100210 msgr2=0x7f21d8101dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:54:40.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:40.831+0000 7f21dde00640 1 -- 172.21.15.37:0/3138005914 shutdown_connections 2024-08-20T04:54:40.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:54:40.832+0000 7f21dde00640 1 -- 172.21.15.37:0/3138005914 wait complete. 2024-08-20T04:54:41.539 DEBUG:teuthology.orchestra.run.smithi037:osd.3> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.3.service 2024-08-20T04:54:41.544 INFO:tasks.cephadm:Deploying osd.4 on smithi130 with /dev/vg_nvme/lv_3... 2024-08-20T04:54:41.544 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-20T04:54:41.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:41 smithi037 ceph-mon[17265]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:41.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:41 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:54:41.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:41 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:41.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:41 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:41.766 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 20 04:54:41 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-3[40406]: 2024-08-20T04:54:41.743+0000 7fc090252640 -1 osd.3 0 log_to_monitors true 2024-08-20T04:54:41.796 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T04:54:41.913 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:41 smithi130 ceph-mon[22007]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:41.913 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:41 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:54:41.913 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:41 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:41.913 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:41 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:41.917 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:41 smithi135 ceph-mon[22342]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:41.918 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:41 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:54:41.918 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:41 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:41.918 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:41 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:42.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:42 smithi037 ceph-mon[17265]: from='osd.3 [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-20T04:54:42.916 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:42 smithi130 ceph-mon[22007]: from='osd.3 [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-20T04:54:43.097 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:42 smithi135 ceph-mon[22342]: from='osd.3 [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-08-20T04:54:43.934 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:43 smithi130 ceph-mon[22007]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:43.934 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:43 smithi130 ceph-mon[22007]: from='osd.3 [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-20T04:54:43.934 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:43 smithi130 ceph-mon[22007]: osdmap e23: 4 total, 3 up, 4 in 2024-08-20T04:54:43.934 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:43 smithi130 ceph-mon[22007]: from='osd.3 [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-20T04:54:43.934 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:43 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:44.015 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 20 04:54:43 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-3[40406]: 2024-08-20T04:54:43.671+0000 7fc08ae00640 -1 osd.3 0 waiting for initial osdmap 2024-08-20T04:54:44.016 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 20 04:54:43 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-3[40406]: 2024-08-20T04:54:43.677+0000 7fc085e00640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T04:54:44.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:43 smithi037 ceph-mon[17265]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:44.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:43 smithi037 ceph-mon[17265]: from='osd.3 [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-20T04:54:44.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:43 smithi037 ceph-mon[17265]: osdmap e23: 4 total, 3 up, 4 in 2024-08-20T04:54:44.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:43 smithi037 ceph-mon[17265]: from='osd.3 [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-20T04:54:44.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:43 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:44.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:43 smithi135 ceph-mon[22342]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:44.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:43 smithi135 ceph-mon[22342]: from='osd.3 [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-20T04:54:44.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:43 smithi135 ceph-mon[22342]: osdmap e23: 4 total, 3 up, 4 in 2024-08-20T04:54:44.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:43 smithi135 ceph-mon[22342]: from='osd.3 [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-20T04:54:44.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:43 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:44.171 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:54:44.199 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_3 2024-08-20T04:54:44.455 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T04:54:44.813 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:44 smithi130 ceph-mon[22007]: from='osd.3 [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-20T04:54:44.813 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:44 smithi130 ceph-mon[22007]: osdmap e24: 4 total, 3 up, 4 in 2024-08-20T04:54:44.813 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:44 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:44.813 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:44 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:44.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.896+0000 7f878c64d640 1 -- 172.21.15.130:0/198817147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8784107cc0 msgr2=0x7f878410a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:54:44.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.896+0000 7f878c64d640 1 --2- 172.21.15.130:0/198817147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8784107cc0 0x7f878410a0b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8774009900 tx=0x7f877402a410 comp rx=0 tx=0).stop 2024-08-20T04:54:44.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.897+0000 7f878c64d640 1 -- 172.21.15.130:0/198817147 shutdown_connections 2024-08-20T04:54:44.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.897+0000 7f878c64d640 1 --2- 172.21.15.130:0/198817147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f878410a670 0x7f878410cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:44.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.897+0000 7f878c64d640 1 --2- 172.21.15.130:0/198817147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8784107cc0 0x7f878410a0b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:44.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.897+0000 7f878c64d640 1 --2- 172.21.15.130:0/198817147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f878406bc50 0x7f8784107780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:44.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.897+0000 7f878c64d640 1 -- 172.21.15.130:0/198817147 >> 172.21.15.130:0/198817147 conn(0x7f87840fcf30 msgr2=0x7f87840ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:54:44.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.897+0000 7f878c64d640 1 -- 172.21.15.130:0/198817147 shutdown_connections 2024-08-20T04:54:44.905 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.897+0000 7f878c64d640 1 -- 172.21.15.130:0/198817147 wait complete. 2024-08-20T04:54:44.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.897+0000 7f878c64d640 1 Processor -- start 2024-08-20T04:54:44.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.897+0000 7f878c64d640 1 -- start start 2024-08-20T04:54:44.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.897+0000 7f878c64d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f878406bc50 0x7f878419acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:54:44.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.897+0000 7f878c64d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8784107cc0 0x7f878419b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:54:44.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.897+0000 7f878c64d640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f878410a670 0x7f878419bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:54:44.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.897+0000 7f878c64d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f87841105c0 con 0x7f8784107cc0 2024-08-20T04:54:44.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.897+0000 7f878c64d640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8784110440 con 0x7f878410a670 2024-08-20T04:54:44.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.897+0000 7f878c64d640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8784110740 con 0x7f878406bc50 2024-08-20T04:54:44.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.898+0000 7f878abea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f878410a670 0x7f878419bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:54:44.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.898+0000 7f878a3e9640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f878406bc50 0x7f878419acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:54:44.906 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.898+0000 7f878abea640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f878410a670 0x7f878419bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:56462/0 (socket says 172.21.15.130:56462) 2024-08-20T04:54:44.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.898+0000 7f878abea640 1 -- 172.21.15.130:0/3567457740 learned_addr learned my addr 172.21.15.130:0/3567457740 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-08-20T04:54:44.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.898+0000 7f878abea640 1 -- 172.21.15.130:0/3567457740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f878406bc50 msgr2=0x7f878419acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:54:44.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.898+0000 7f878abea640 1 --2- 172.21.15.130:0/3567457740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f878406bc50 0x7f878419acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:44.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.898+0000 7f878abea640 1 -- 172.21.15.130:0/3567457740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8784107cc0 msgr2=0x7f878419b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:54:44.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.898+0000 7f878abea640 1 --2- 172.21.15.130:0/3567457740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8784107cc0 0x7f878419b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:54:44.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.898+0000 7f878abea640 1 -- 172.21.15.130:0/3567457740 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878419c7e0 con 0x7f878410a670 2024-08-20T04:54:44.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.898+0000 7f878abea640 1 --2- 172.21.15.130:0/3567457740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f878410a670 0x7f878419bf40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f877c00eaa0 tx=0x7f877c00eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:54:44.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.898+0000 7f877b7fe640 1 -- 172.21.15.130:0/3567457740 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c004d20 con 0x7f878410a670 2024-08-20T04:54:44.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.898+0000 7f877b7fe640 1 -- 172.21.15.130:0/3567457740 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f877c005020 con 0x7f878410a670 2024-08-20T04:54:44.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.898+0000 7f878c64d640 1 -- 172.21.15.130:0/3567457740 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f878419cad0 con 0x7f878410a670 2024-08-20T04:54:44.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.898+0000 7f877b7fe640 1 -- 172.21.15.130:0/3567457740 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877c0116b0 con 0x7f878410a670 2024-08-20T04:54:44.907 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.898+0000 7f878c64d640 1 -- 172.21.15.130:0/3567457740 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87841a31b0 con 0x7f878410a670 2024-08-20T04:54:44.908 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.899+0000 7f878c64d640 1 -- 172.21.15.130:0/3567457740 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87840fea20 con 0x7f878410a670 2024-08-20T04:54:44.908 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.901+0000 7f877b7fe640 1 -- 172.21.15.130:0/3567457740 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f877c0051d0 con 0x7f878410a670 2024-08-20T04:54:44.908 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.901+0000 7f877b7fe640 1 --2- 172.21.15.130:0/3567457740 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87700b3bd0 0x7f87700b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:54:44.908 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.902+0000 7f877b7fe640 1 -- 172.21.15.130:0/3567457740 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3702+0+0 (secure 0 0 0) 0x7f877c0e2fb0 con 0x7f878410a670 2024-08-20T04:54:44.908 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.902+0000 7f878a3e9640 1 --2- 172.21.15.130:0/3567457740 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87700b3bd0 0x7f87700b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:54:44.908 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.903+0000 7f878a3e9640 1 --2- 172.21.15.130:0/3567457740 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87700b3bd0 0x7f87700b6090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f878000abe0 tx=0x7f878000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:54:44.908 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:44.905+0000 7f877b7fe640 1 -- 172.21.15.130:0/3567457740 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f877c016030 con 0x7f878410a670 2024-08-20T04:54:44.926 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:44 smithi037 ceph-mon[17265]: from='osd.3 [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-20T04:54:44.926 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:44 smithi037 ceph-mon[17265]: osdmap e24: 4 total, 3 up, 4 in 2024-08-20T04:54:44.926 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:44 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:44.926 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:44 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:45.097 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:54:45.095+0000 7f878c64d640 1 -- 172.21.15.130:0/3567457740 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f87840632c0 con 0x7f87700b3bd0 2024-08-20T04:54:45.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:44 smithi135 ceph-mon[22342]: from='osd.3 [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-20T04:54:45.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:44 smithi135 ceph-mon[22342]: osdmap e24: 4 total, 3 up, 4 in 2024-08-20T04:54:45.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:44 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:45.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:44 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:45.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: purged_snaps scrub starts 2024-08-20T04:54:45.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: purged_snaps scrub ok 2024-08-20T04:54:45.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:45.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:45.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: osd.3 [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990] boot 2024-08-20T04:54:45.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: osdmap e25: 4 total, 4 up, 4 in 2024-08-20T04:54:45.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:45.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:45.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:45.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T04:54:45.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T04:54:45.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:45.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:45.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:54:45.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:45.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:54:45.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:54:45.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:46.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: purged_snaps scrub starts 2024-08-20T04:54:46.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: purged_snaps scrub ok 2024-08-20T04:54:46.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:46.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:46.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: osd.3 [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990] boot 2024-08-20T04:54:46.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: osdmap e25: 4 total, 4 up, 4 in 2024-08-20T04:54:46.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:46.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:46.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:46.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T04:54:46.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T04:54:46.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:46.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:46.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:54:46.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:46.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:54:46.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:54:46.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:46.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: purged_snaps scrub starts 2024-08-20T04:54:46.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: purged_snaps scrub ok 2024-08-20T04:54:46.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-08-20T04:54:46.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:46.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: osd.3 [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990] boot 2024-08-20T04:54:46.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: osdmap e25: 4 total, 4 up, 4 in 2024-08-20T04:54:46.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-08-20T04:54:46.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:46.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:46.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T04:54:46.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T04:54:46.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:46.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:46.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:54:46.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:54:46.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:54:46.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:54:46.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:46.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:46 smithi130 ceph-mon[22007]: Detected new or changed devices on smithi037 2024-08-20T04:54:46.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:46 smithi130 ceph-mon[22007]: Adjusting osd_memory_target on smithi037 to 8547M 2024-08-20T04:54:46.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:46 smithi130 ceph-mon[22007]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:54:46.786 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:46 smithi130 ceph-mon[22007]: osdmap e26: 4 total, 4 up, 4 in 2024-08-20T04:54:47.006 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:46 smithi037 ceph-mon[17265]: Detected new or changed devices on smithi037 2024-08-20T04:54:47.007 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:46 smithi037 ceph-mon[17265]: Adjusting osd_memory_target on smithi037 to 8547M 2024-08-20T04:54:47.007 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:46 smithi037 ceph-mon[17265]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:54:47.007 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:46 smithi037 ceph-mon[17265]: osdmap e26: 4 total, 4 up, 4 in 2024-08-20T04:54:47.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:46 smithi135 ceph-mon[22342]: Detected new or changed devices on smithi037 2024-08-20T04:54:47.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:46 smithi135 ceph-mon[22342]: Adjusting osd_memory_target on smithi037 to 8547M 2024-08-20T04:54:47.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:46 smithi135 ceph-mon[22342]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:54:47.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:46 smithi135 ceph-mon[22342]: osdmap e26: 4 total, 4 up, 4 in 2024-08-20T04:54:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:47 smithi130 ceph-mon[22007]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:54:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:47 smithi130 ceph-mon[22007]: osdmap e27: 4 total, 4 up, 4 in 2024-08-20T04:54:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:47 smithi130 ceph-mon[22007]: from='client.? 172.21.15.130:0/1895149287' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2dbd47f9-8686-4707-8862-3c7a99a37d73"} : dispatch 2024-08-20T04:54:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:47 smithi130 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2dbd47f9-8686-4707-8862-3c7a99a37d73"} : dispatch 2024-08-20T04:54:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:47 smithi130 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2dbd47f9-8686-4707-8862-3c7a99a37d73"}]': finished 2024-08-20T04:54:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:47 smithi130 ceph-mon[22007]: osdmap e28: 5 total, 4 up, 5 in 2024-08-20T04:54:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T04:54:48.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:47 smithi037 ceph-mon[17265]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:54:48.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:47 smithi037 ceph-mon[17265]: osdmap e27: 4 total, 4 up, 4 in 2024-08-20T04:54:48.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:47 smithi037 ceph-mon[17265]: from='client.? 172.21.15.130:0/1895149287' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2dbd47f9-8686-4707-8862-3c7a99a37d73"} : dispatch 2024-08-20T04:54:48.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:47 smithi037 ceph-mon[17265]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2dbd47f9-8686-4707-8862-3c7a99a37d73"} : dispatch 2024-08-20T04:54:48.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:47 smithi037 ceph-mon[17265]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2dbd47f9-8686-4707-8862-3c7a99a37d73"}]': finished 2024-08-20T04:54:48.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:47 smithi037 ceph-mon[17265]: osdmap e28: 5 total, 4 up, 5 in 2024-08-20T04:54:48.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T04:54:48.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:47 smithi135 ceph-mon[22342]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:54:48.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:47 smithi135 ceph-mon[22342]: osdmap e27: 4 total, 4 up, 4 in 2024-08-20T04:54:48.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:47 smithi135 ceph-mon[22342]: from='client.? 172.21.15.130:0/1895149287' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2dbd47f9-8686-4707-8862-3c7a99a37d73"} : dispatch 2024-08-20T04:54:48.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:47 smithi135 ceph-mon[22342]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2dbd47f9-8686-4707-8862-3c7a99a37d73"} : dispatch 2024-08-20T04:54:48.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:47 smithi135 ceph-mon[22342]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2dbd47f9-8686-4707-8862-3c7a99a37d73"}]': finished 2024-08-20T04:54:48.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:47 smithi135 ceph-mon[22342]: osdmap e28: 5 total, 4 up, 5 in 2024-08-20T04:54:48.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T04:54:48.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:48 smithi130 ceph-mon[22007]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:54:48.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:48 smithi130 ceph-mon[22007]: from='client.? 172.21.15.130:0/1612308461' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:54:49.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:48 smithi037 ceph-mon[17265]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:54:49.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:48 smithi037 ceph-mon[17265]: from='client.? 172.21.15.130:0/1612308461' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:54:49.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:48 smithi135 ceph-mon[22342]: pgmap v118: 1 pgs: 1 peering; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:54:49.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:48 smithi135 ceph-mon[22342]: from='client.? 172.21.15.130:0/1612308461' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:54:51.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:50 smithi037 ceph-mon[17265]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-08-20T04:54:51.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:50 smithi135 ceph-mon[22342]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-08-20T04:54:51.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:50 smithi130 ceph-mon[22007]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 110 KiB/s, 0 objects/s recovering 2024-08-20T04:54:53.237 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:52 smithi130 ceph-mon[22007]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-20T04:54:53.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:52 smithi037 ceph-mon[17265]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-20T04:54:53.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:52 smithi135 ceph-mon[22342]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-08-20T04:54:55.056 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:54 smithi130 ceph-mon[22007]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T04:54:55.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:54 smithi037 ceph-mon[17265]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T04:54:55.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:54 smithi135 ceph-mon[22342]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T04:54:56.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:55 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-20T04:54:56.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:55 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:56.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-20T04:54:56.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:56.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:55 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-08-20T04:54:56.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:55 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:54:57.258 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:56 smithi130 ceph-mon[22007]: Deploying daemon osd.4 on smithi130 2024-08-20T04:54:57.258 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:56 smithi130 ceph-mon[22007]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-20T04:54:57.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:56 smithi037 ceph-mon[17265]: Deploying daemon osd.4 on smithi130 2024-08-20T04:54:57.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:56 smithi037 ceph-mon[17265]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-20T04:54:57.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:56 smithi135 ceph-mon[22342]: Deploying daemon osd.4 on smithi130 2024-08-20T04:54:57.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:56 smithi135 ceph-mon[22342]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-08-20T04:54:59.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:54:58 smithi037 ceph-mon[17265]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-08-20T04:54:59.320 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:54:58 smithi130 ceph-mon[22007]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-08-20T04:54:59.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:54:58 smithi135 ceph-mon[22342]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-08-20T04:55:01.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:00 smithi130 ceph-mon[22007]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T04:55:01.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:00 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:55:01.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:00 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:01.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:00 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:01.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:00 smithi037 ceph-mon[17265]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T04:55:01.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:00 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:55:01.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:00 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:01.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:00 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:01.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:00 smithi135 ceph-mon[22342]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T04:55:01.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:00 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:55:01.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:00 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:01.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:00 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:03.248 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:02 smithi130 ceph-mon[22007]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:55:03.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:02 smithi037 ceph-mon[17265]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:55:03.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:02 smithi135 ceph-mon[22342]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:55:04.711 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:55:04.709+0000 7f877b7fe640 1 -- 172.21.15.130:0/3567457740 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f87840632c0 con 0x7f87700b3bd0 2024-08-20T04:55:04.712 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 4 on host 'smithi130' 2024-08-20T04:55:04.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:55:04.711+0000 7f878c64d640 1 -- 172.21.15.130:0/3567457740 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87700b3bd0 msgr2=0x7f87700b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:55:04.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:55:04.711+0000 7f878c64d640 1 --2- 172.21.15.130:0/3567457740 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87700b3bd0 0x7f87700b6090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f878000abe0 tx=0x7f878000a2d0 comp rx=0 tx=0).stop 2024-08-20T04:55:04.713 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:55:04.711+0000 7f878c64d640 1 -- 172.21.15.130:0/3567457740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f878410a670 msgr2=0x7f878419bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:55:04.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:55:04.711+0000 7f878c64d640 1 --2- 172.21.15.130:0/3567457740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f878410a670 0x7f878419bf40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f877c00eaa0 tx=0x7f877c00eea0 comp rx=0 tx=0).stop 2024-08-20T04:55:04.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:55:04.712+0000 7f878c64d640 1 -- 172.21.15.130:0/3567457740 shutdown_connections 2024-08-20T04:55:04.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:55:04.712+0000 7f878c64d640 1 --2- 172.21.15.130:0/3567457740 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87700b3bd0 0x7f87700b6090 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:04.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:55:04.712+0000 7f878c64d640 1 --2- 172.21.15.130:0/3567457740 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f878410a670 0x7f878419bf40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:04.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:55:04.712+0000 7f878c64d640 1 --2- 172.21.15.130:0/3567457740 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8784107cc0 0x7f878419b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:04.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:55:04.712+0000 7f878c64d640 1 --2- 172.21.15.130:0/3567457740 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f878406bc50 0x7f878419acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:04.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:55:04.712+0000 7f878c64d640 1 -- 172.21.15.130:0/3567457740 >> 172.21.15.130:0/3567457740 conn(0x7f87840fcf30 msgr2=0x7f87841088c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:55:04.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:55:04.712+0000 7f878c64d640 1 -- 172.21.15.130:0/3567457740 shutdown_connections 2024-08-20T04:55:04.714 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:55:04.712+0000 7f878c64d640 1 -- 172.21.15.130:0/3567457740 wait complete. 2024-08-20T04:55:04.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:04 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:04.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:04 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:04.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:04 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:04.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:04 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:55:04.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:04 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:05.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:04 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:05.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:04 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:05.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:04 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:05.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:04 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:55:05.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:04 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:05.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:04 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:05.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:04 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:05.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:04 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:05.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:04 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:55:05.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:04 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:05.442 DEBUG:teuthology.orchestra.run.smithi130:osd.4> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.4.service 2024-08-20T04:55:05.445 INFO:tasks.cephadm:Deploying osd.5 on smithi135 with /dev/vg_nvme/lv_3... 2024-08-20T04:55:05.445 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-20T04:55:05.702 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T04:55:05.810 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:05 smithi135 ceph-mon[22342]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:55:05.811 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:05 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:55:05.811 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:05 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:05.811 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:05 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:05.919 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:05 smithi130 ceph-mon[22007]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:55:05.919 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:05 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:55:05.919 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:05 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:05.919 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:05 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:06.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:05 smithi037 ceph-mon[17265]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:55:06.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:05 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:55:06.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:05 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:06.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:05 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:06.633 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 04:55:06 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4[33284]: 2024-08-20T04:55:06.603+0000 7f01d252d640 -1 osd.4 0 log_to_monitors true 2024-08-20T04:55:06.905 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:06 smithi130 ceph-mon[22007]: from='osd.4 [v2:172.21.15.130:6808/3542081474,v1:172.21.15.130:6809/3542081474]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T04:55:06.906 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:06 smithi130 ceph-mon[22007]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T04:55:06.961 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:06 smithi135 ceph-mon[22342]: from='osd.4 [v2:172.21.15.130:6808/3542081474,v1:172.21.15.130:6809/3542081474]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T04:55:06.961 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:06 smithi135 ceph-mon[22342]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T04:55:07.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:06 smithi037 ceph-mon[17265]: from='osd.4 [v2:172.21.15.130:6808/3542081474,v1:172.21.15.130:6809/3542081474]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T04:55:07.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:06 smithi037 ceph-mon[17265]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-08-20T04:55:07.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:07 smithi135 ceph-mon[22342]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:55:07.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:07 smithi135 ceph-mon[22342]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-20T04:55:07.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:07 smithi135 ceph-mon[22342]: osdmap e29: 5 total, 4 up, 5 in 2024-08-20T04:55:07.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:07 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T04:55:07.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:07 smithi135 ceph-mon[22342]: from='osd.4 [v2:172.21.15.130:6808/3542081474,v1:172.21.15.130:6809/3542081474]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:55:07.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:07 smithi135 ceph-mon[22342]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:55:07.955 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 04:55:07 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4[33284]: 2024-08-20T04:55:07.695+0000 7f01ce4b0640 -1 osd.4 0 waiting for initial osdmap 2024-08-20T04:55:07.955 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 04:55:07 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4[33284]: 2024-08-20T04:55:07.700+0000 7f01ca2d7640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T04:55:07.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:07 smithi130 ceph-mon[22007]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:55:07.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:07 smithi130 ceph-mon[22007]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-20T04:55:07.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:07 smithi130 ceph-mon[22007]: osdmap e29: 5 total, 4 up, 5 in 2024-08-20T04:55:07.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:07 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T04:55:07.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:07 smithi130 ceph-mon[22007]: from='osd.4 [v2:172.21.15.130:6808/3542081474,v1:172.21.15.130:6809/3542081474]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:55:07.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:07 smithi130 ceph-mon[22007]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:55:08.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:07 smithi037 ceph-mon[17265]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:55:08.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:07 smithi037 ceph-mon[17265]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-20T04:55:08.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:07 smithi037 ceph-mon[17265]: osdmap e29: 5 total, 4 up, 5 in 2024-08-20T04:55:08.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:07 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T04:55:08.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:07 smithi037 ceph-mon[17265]: from='osd.4 [v2:172.21.15.130:6808/3542081474,v1:172.21.15.130:6809/3542081474]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:55:08.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:07 smithi037 ceph-mon[17265]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:55:08.211 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:55:08.237 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_3 2024-08-20T04:55:08.490 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T04:55:08.820 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:08 smithi135 ceph-mon[22342]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-20T04:55:08.821 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:08 smithi135 ceph-mon[22342]: osdmap e30: 5 total, 4 up, 5 in 2024-08-20T04:55:08.821 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:08 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T04:55:08.821 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:08 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T04:55:08.821 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:08 smithi135 ceph-mon[22342]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:55:08.821 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:08 smithi135 ceph-mon[22342]: Detected new or changed devices on smithi130 2024-08-20T04:55:08.821 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:08 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:08.821 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:08 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:08.821 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:08 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T04:55:08.821 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:08 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T04:55:08.821 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:08 smithi135 ceph-mon[22342]: Adjusting osd_memory_target on smithi130 to 8544M 2024-08-20T04:55:08.821 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:08 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:08.821 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:08 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:08.822 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:08 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:55:08.822 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:08 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:08.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.904+0000 7fa6acfcf640 1 -- 172.21.15.135:0/564241171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6a8104250 msgr2=0x7fa6a810abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:55:08.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.904+0000 7fa6acfcf640 1 --2- 172.21.15.135:0/564241171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6a8104250 0x7fa6a810abd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009d00 tx=0x7fa6a002a910 comp rx=0 tx=0).stop 2024-08-20T04:55:08.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.905+0000 7fa6acfcf640 1 -- 172.21.15.135:0/564241171 shutdown_connections 2024-08-20T04:55:08.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.905+0000 7fa6acfcf640 1 --2- 172.21.15.135:0/564241171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6a8104250 0x7fa6a810abd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:08.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.905+0000 7fa6acfcf640 1 --2- 172.21.15.135:0/564241171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6a8103890 0x7fa6a8103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:08.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.905+0000 7fa6acfcf640 1 --2- 172.21.15.135:0/564241171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a8102730 0x7fa6a8102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:08.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.905+0000 7fa6acfcf640 1 -- 172.21.15.135:0/564241171 >> 172.21.15.135:0/564241171 conn(0x7fa6a80fe020 msgr2=0x7fa6a8100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:55:08.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.905+0000 7fa6acfcf640 1 -- 172.21.15.135:0/564241171 shutdown_connections 2024-08-20T04:55:08.929 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.905+0000 7fa6acfcf640 1 -- 172.21.15.135:0/564241171 wait complete. 2024-08-20T04:55:08.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.905+0000 7fa6acfcf640 1 Processor -- start 2024-08-20T04:55:08.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.905+0000 7fa6acfcf640 1 -- start start 2024-08-20T04:55:08.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa6acfcf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a8102730 0x7fa6a8198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:55:08.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa6acfcf640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6a8103890 0x7fa6a8199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:55:08.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa6acfcf640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6a8104250 0x7fa6a8199d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:55:08.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa6acfcf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a810e410 con 0x7fa6a8102730 2024-08-20T04:55:08.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa6acfcf640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a810e290 con 0x7fa6a8104250 2024-08-20T04:55:08.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa6acfcf640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a810e590 con 0x7fa6a8103890 2024-08-20T04:55:08.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa69ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6a8103890 0x7fa6a8199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:55:08.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa69ffff640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6a8103890 0x7fa6a8199150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:48714/0 (socket says 172.21.15.135:48714) 2024-08-20T04:55:08.930 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa69ffff640 1 -- 172.21.15.135:0/2787320382 learned_addr learned my addr 172.21.15.135:0/2787320382 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-08-20T04:55:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa6a6d9d640 1 --2- 172.21.15.135:0/2787320382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6a8104250 0x7fa6a8199d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:55:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa6a659c640 1 --2- 172.21.15.135:0/2787320382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a8102730 0x7fa6a8198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:55:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa69ffff640 1 -- 172.21.15.135:0/2787320382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6a8104250 msgr2=0x7fa6a8199d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:55:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa69ffff640 1 --2- 172.21.15.135:0/2787320382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6a8104250 0x7fa6a8199d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa69ffff640 1 -- 172.21.15.135:0/2787320382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a8102730 msgr2=0x7fa6a8198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:55:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa69ffff640 1 --2- 172.21.15.135:0/2787320382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a8102730 0x7fa6a8198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa69ffff640 1 -- 172.21.15.135:0/2787320382 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a819a630 con 0x7fa6a8103890 2024-08-20T04:55:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa6a659c640 1 --2- 172.21.15.135:0/2787320382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a8102730 0x7fa6a8198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T04:55:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa69ffff640 1 --2- 172.21.15.135:0/2787320382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6a8103890 0x7fa6a8199150 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa69000d950 tx=0x7fa69000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:55:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.906+0000 7fa69f7fe640 1 -- 172.21.15.135:0/2787320382 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa690017070 con 0x7fa6a8103890 2024-08-20T04:55:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.907+0000 7fa6acfcf640 1 -- 172.21.15.135:0/2787320382 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a819a920 con 0x7fa6a8103890 2024-08-20T04:55:08.931 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.907+0000 7fa69f7fe640 1 -- 172.21.15.135:0/2787320382 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa690009c30 con 0x7fa6a8103890 2024-08-20T04:55:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.907+0000 7fa69f7fe640 1 -- 172.21.15.135:0/2787320382 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa69000f620 con 0x7fa6a8103890 2024-08-20T04:55:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.907+0000 7fa6acfcf640 1 -- 172.21.15.135:0/2787320382 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a81a1000 con 0x7fa6a8103890 2024-08-20T04:55:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.908+0000 7fa6acfcf640 1 -- 172.21.15.135:0/2787320382 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a8109b00 con 0x7fa6a8103890 2024-08-20T04:55:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.909+0000 7fa69f7fe640 1 -- 172.21.15.135:0/2787320382 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fa690005030 con 0x7fa6a8103890 2024-08-20T04:55:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.910+0000 7fa69f7fe640 1 --2- 172.21.15.135:0/2787320382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa6940b3bd0 0x7fa6940b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:55:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.910+0000 7fa69f7fe640 1 -- 172.21.15.135:0/2787320382 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4101+0+0 (secure 0 0 0) 0x7fa6900e27a0 con 0x7fa6a8103890 2024-08-20T04:55:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.910+0000 7fa6a659c640 1 --2- 172.21.15.135:0/2787320382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa6940b3bd0 0x7fa6940b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:55:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.911+0000 7fa6a659c640 1 --2- 172.21.15.135:0/2787320382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa6940b3bd0 0x7fa6940b6090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa698009930 tx=0x7fa698008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:55:08.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:08.916+0000 7fa69f7fe640 1 -- 172.21.15.135:0/2787320382 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa6900aae60 con 0x7fa6a8103890 2024-08-20T04:55:08.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:08 smithi130 ceph-mon[22007]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-20T04:55:08.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:08 smithi130 ceph-mon[22007]: osdmap e30: 5 total, 4 up, 5 in 2024-08-20T04:55:08.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:08 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T04:55:08.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:08 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T04:55:08.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:08 smithi130 ceph-mon[22007]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:55:08.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:08 smithi130 ceph-mon[22007]: Detected new or changed devices on smithi130 2024-08-20T04:55:08.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:08 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:08.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:08 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:08.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:08 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T04:55:08.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:08 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T04:55:08.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:08 smithi130 ceph-mon[22007]: Adjusting osd_memory_target on smithi130 to 8544M 2024-08-20T04:55:08.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:08 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:08.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:08 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:08.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:08 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:55:08.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:08 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:09.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:08 smithi037 ceph-mon[17265]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-20T04:55:09.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:08 smithi037 ceph-mon[17265]: osdmap e30: 5 total, 4 up, 5 in 2024-08-20T04:55:09.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:08 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T04:55:09.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:08 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T04:55:09.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:08 smithi037 ceph-mon[17265]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-08-20T04:55:09.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:08 smithi037 ceph-mon[17265]: Detected new or changed devices on smithi130 2024-08-20T04:55:09.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:08 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:09.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:08 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:09.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:08 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T04:55:09.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:08 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T04:55:09.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:08 smithi037 ceph-mon[17265]: Adjusting osd_memory_target on smithi130 to 8544M 2024-08-20T04:55:09.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:08 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:09.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:08 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:09.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:08 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:55:09.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:08 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:09.110 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:09.108+0000 7fa6acfcf640 1 -- 172.21.15.135:0/2787320382 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa6a80632c0 con 0x7fa6940b3bd0 2024-08-20T04:55:09.740 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:09 smithi135 ceph-mon[22342]: purged_snaps scrub starts 2024-08-20T04:55:09.740 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:09 smithi135 ceph-mon[22342]: purged_snaps scrub ok 2024-08-20T04:55:09.740 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:09 smithi135 ceph-mon[22342]: osd.4 [v2:172.21.15.130:6808/3542081474,v1:172.21.15.130:6809/3542081474] boot 2024-08-20T04:55:09.740 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:09 smithi135 ceph-mon[22342]: osdmap e31: 5 total, 5 up, 5 in 2024-08-20T04:55:09.740 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T04:55:09.740 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:09 smithi135 ceph-mon[22342]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:55:09.740 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:55:09.740 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:55:09.740 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:09.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:09 smithi130 ceph-mon[22007]: purged_snaps scrub starts 2024-08-20T04:55:09.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:09 smithi130 ceph-mon[22007]: purged_snaps scrub ok 2024-08-20T04:55:09.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:09 smithi130 ceph-mon[22007]: osd.4 [v2:172.21.15.130:6808/3542081474,v1:172.21.15.130:6809/3542081474] boot 2024-08-20T04:55:09.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:09 smithi130 ceph-mon[22007]: osdmap e31: 5 total, 5 up, 5 in 2024-08-20T04:55:09.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:09 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T04:55:09.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:09 smithi130 ceph-mon[22007]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:55:09.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:09 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:55:09.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:09 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:55:09.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:09 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:10.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:09 smithi037 ceph-mon[17265]: purged_snaps scrub starts 2024-08-20T04:55:10.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:09 smithi037 ceph-mon[17265]: purged_snaps scrub ok 2024-08-20T04:55:10.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:09 smithi037 ceph-mon[17265]: osd.4 [v2:172.21.15.130:6808/3542081474,v1:172.21.15.130:6809/3542081474] boot 2024-08-20T04:55:10.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:09 smithi037 ceph-mon[17265]: osdmap e31: 5 total, 5 up, 5 in 2024-08-20T04:55:10.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:09 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-08-20T04:55:10.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:09 smithi037 ceph-mon[17265]: from='client.24385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:55:10.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:09 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:55:10.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:09 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:55:10.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:09 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:10.785 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:10 smithi135 ceph-mon[22342]: osdmap e32: 5 total, 5 up, 5 in 2024-08-20T04:55:10.786 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:10 smithi135 ceph-mon[22342]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:11.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:10 smithi037 ceph-mon[17265]: osdmap e32: 5 total, 5 up, 5 in 2024-08-20T04:55:11.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:10 smithi037 ceph-mon[17265]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:11.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:10 smithi130 ceph-mon[22007]: osdmap e32: 5 total, 5 up, 5 in 2024-08-20T04:55:11.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:10 smithi130 ceph-mon[22007]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:12.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:11 smithi037 ceph-mon[17265]: from='client.? 172.21.15.135:0/2316153429' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a07a137-d6b7-4aba-8678-4fd164597f27"} : dispatch 2024-08-20T04:55:12.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:11 smithi037 ceph-mon[17265]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a07a137-d6b7-4aba-8678-4fd164597f27"} : dispatch 2024-08-20T04:55:12.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:11 smithi037 ceph-mon[17265]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a07a137-d6b7-4aba-8678-4fd164597f27"}]': finished 2024-08-20T04:55:12.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:11 smithi037 ceph-mon[17265]: osdmap e33: 6 total, 5 up, 6 in 2024-08-20T04:55:12.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:11 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:12.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:11 smithi135 ceph-mon[22342]: from='client.? 172.21.15.135:0/2316153429' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a07a137-d6b7-4aba-8678-4fd164597f27"} : dispatch 2024-08-20T04:55:12.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:11 smithi135 ceph-mon[22342]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a07a137-d6b7-4aba-8678-4fd164597f27"} : dispatch 2024-08-20T04:55:12.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:11 smithi135 ceph-mon[22342]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a07a137-d6b7-4aba-8678-4fd164597f27"}]': finished 2024-08-20T04:55:12.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:11 smithi135 ceph-mon[22342]: osdmap e33: 6 total, 5 up, 6 in 2024-08-20T04:55:12.081 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:11 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:12.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:11 smithi130 ceph-mon[22007]: from='client.? 172.21.15.135:0/2316153429' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a07a137-d6b7-4aba-8678-4fd164597f27"} : dispatch 2024-08-20T04:55:12.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:11 smithi130 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a07a137-d6b7-4aba-8678-4fd164597f27"} : dispatch 2024-08-20T04:55:12.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:11 smithi130 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a07a137-d6b7-4aba-8678-4fd164597f27"}]': finished 2024-08-20T04:55:12.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:11 smithi130 ceph-mon[22007]: osdmap e33: 6 total, 5 up, 6 in 2024-08-20T04:55:12.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:11 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:13.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:12 smithi037 ceph-mon[17265]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:13.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:12 smithi037 ceph-mon[17265]: from='client.? 172.21.15.135:0/3427218173' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:55:13.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:12 smithi135 ceph-mon[22342]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:13.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:12 smithi135 ceph-mon[22342]: from='client.? 172.21.15.135:0/3427218173' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:55:13.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:12 smithi130 ceph-mon[22007]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:13.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:12 smithi130 ceph-mon[22007]: from='client.? 172.21.15.135:0/3427218173' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:55:15.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:14 smithi037 ceph-mon[17265]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:15.277 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:14 smithi130 ceph-mon[22007]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:15.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:14 smithi135 ceph-mon[22342]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:17.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:16 smithi037 ceph-mon[17265]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:17.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:16 smithi135 ceph-mon[22342]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:17.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:16 smithi130 ceph-mon[22007]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:19.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:18 smithi135 ceph-mon[22342]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:19.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:18 smithi037 ceph-mon[17265]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:19.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:18 smithi130 ceph-mon[22007]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:21.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:20 smithi135 ceph-mon[22342]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:21.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:20 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-20T04:55:21.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:20 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:21.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:20 smithi135 ceph-mon[22342]: Deploying daemon osd.5 on smithi135 2024-08-20T04:55:21.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:20 smithi037 ceph-mon[17265]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:21.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:20 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-20T04:55:21.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:20 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:21.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:20 smithi037 ceph-mon[17265]: Deploying daemon osd.5 on smithi135 2024-08-20T04:55:21.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:20 smithi130 ceph-mon[22007]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:21.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:20 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-08-20T04:55:21.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:20 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:21.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:20 smithi130 ceph-mon[22007]: Deploying daemon osd.5 on smithi135 2024-08-20T04:55:23.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:22 smithi037 ceph-mon[17265]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:23.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:22 smithi135 ceph-mon[22342]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:23.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:22 smithi130 ceph-mon[22007]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:25.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:24 smithi135 ceph-mon[22342]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:25.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:24 smithi037 ceph-mon[17265]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:25.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:24 smithi130 ceph-mon[22007]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:26.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:25 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:55:26.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:25 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:26.192 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:25 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:26.263 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:25 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:55:26.263 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:25 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:26.263 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:25 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:26.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:25 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:55:26.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:25 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:26.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:25 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:27.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:27 smithi130 ceph-mon[22007]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:27.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:27 smithi037 ceph-mon[17265]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:27.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:27 smithi135 ceph-mon[22342]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:29.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:29 smithi135 ceph-mon[22342]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:29.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:29.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:29.450 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:29.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:55:29.451 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:29.451 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:29.448+0000 7fa69f7fe640 1 -- 172.21.15.135:0/2787320382 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa6a80632c0 con 0x7fa6940b3bd0 2024-08-20T04:55:29.451 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 5 on host 'smithi135' 2024-08-20T04:55:29.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:29.451+0000 7fa6acfcf640 1 -- 172.21.15.135:0/2787320382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa6940b3bd0 msgr2=0x7fa6940b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:55:29.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:29.451+0000 7fa6acfcf640 1 --2- 172.21.15.135:0/2787320382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa6940b3bd0 0x7fa6940b6090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa698009930 tx=0x7fa698008040 comp rx=0 tx=0).stop 2024-08-20T04:55:29.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:29.451+0000 7fa6acfcf640 1 -- 172.21.15.135:0/2787320382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6a8103890 msgr2=0x7fa6a8199150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:55:29.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:29.451+0000 7fa6acfcf640 1 --2- 172.21.15.135:0/2787320382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6a8103890 0x7fa6a8199150 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa69000d950 tx=0x7fa69000de10 comp rx=0 tx=0).stop 2024-08-20T04:55:29.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:29.451+0000 7fa6acfcf640 1 -- 172.21.15.135:0/2787320382 shutdown_connections 2024-08-20T04:55:29.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:29.451+0000 7fa6acfcf640 1 --2- 172.21.15.135:0/2787320382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa6940b3bd0 0x7fa6940b6090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:29.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:29.451+0000 7fa6acfcf640 1 --2- 172.21.15.135:0/2787320382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa6a8104250 0x7fa6a8199d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:29.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:29.451+0000 7fa6acfcf640 1 --2- 172.21.15.135:0/2787320382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa6a8103890 0x7fa6a8199150 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:29.453 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:29.451+0000 7fa6acfcf640 1 --2- 172.21.15.135:0/2787320382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6a8102730 0x7fa6a8198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:29.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:29.451+0000 7fa6acfcf640 1 -- 172.21.15.135:0/2787320382 >> 172.21.15.135:0/2787320382 conn(0x7fa6a80fe020 msgr2=0x7fa6a8106cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:55:29.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:29.451+0000 7fa6acfcf640 1 -- 172.21.15.135:0/2787320382 shutdown_connections 2024-08-20T04:55:29.454 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:55:29.451+0000 7fa6acfcf640 1 -- 172.21.15.135:0/2787320382 wait complete. 2024-08-20T04:55:29.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:29 smithi130 ceph-mon[22007]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:29.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:29.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:29.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:29.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:55:29.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:29.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:29 smithi037 ceph-mon[17265]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:29.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:29.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:29.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:29.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:55:29.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:30.127 DEBUG:teuthology.orchestra.run.smithi135:osd.5> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.5.service 2024-08-20T04:55:30.129 INFO:tasks.cephadm:Deploying osd.6 on smithi037 with /dev/vg_nvme/lv_2... 2024-08-20T04:55:30.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-20T04:55:30.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:55:30.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:30.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:30.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:55:30.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:30.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:30.511 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:55:30.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:55:30.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:30.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:31.498 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:31 smithi135 ceph-mon[22342]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:31.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:31 smithi130 ceph-mon[22007]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:31.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:31 smithi037 ceph-mon[17265]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:31.832 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 04:55:31 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T04:55:31.495+0000 7f0d3a1a0640 -1 osd.5 0 log_to_monitors true 2024-08-20T04:55:32.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:32 smithi135 ceph-mon[22342]: from='osd.5 [v2:172.21.15.135:6808/2507249148,v1:172.21.15.135:6809/2507249148]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T04:55:32.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:32 smithi135 ceph-mon[22342]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T04:55:32.761 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:32 smithi037 ceph-mon[17265]: from='osd.5 [v2:172.21.15.135:6808/2507249148,v1:172.21.15.135:6809/2507249148]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T04:55:32.761 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:32 smithi037 ceph-mon[17265]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T04:55:32.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:32 smithi130 ceph-mon[22007]: from='osd.5 [v2:172.21.15.135:6808/2507249148,v1:172.21.15.135:6809/2507249148]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T04:55:32.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:32 smithi130 ceph-mon[22007]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-08-20T04:55:33.646 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:33 smithi037 ceph-mon[17265]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:33.647 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:33 smithi037 ceph-mon[17265]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-20T04:55:33.647 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:33 smithi037 ceph-mon[17265]: from='osd.5 [v2:172.21.15.135:6808/2507249148,v1:172.21.15.135:6809/2507249148]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:55:33.647 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:33 smithi037 ceph-mon[17265]: osdmap e34: 6 total, 5 up, 6 in 2024-08-20T04:55:33.647 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:33.647 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:33 smithi037 ceph-mon[17265]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:55:33.647 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:33.647 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:33.647 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T04:55:33.648 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T04:55:33.648 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:33.648 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:33.648 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:55:33.648 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:33.865 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 04:55:33 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T04:55:33.466+0000 7f0d36123640 -1 osd.5 0 waiting for initial osdmap 2024-08-20T04:55:33.866 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 04:55:33 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T04:55:33.472+0000 7f0d31f4a640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T04:55:33.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:33 smithi135 ceph-mon[22342]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:33.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:33 smithi135 ceph-mon[22342]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-20T04:55:33.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:33 smithi135 ceph-mon[22342]: from='osd.5 [v2:172.21.15.135:6808/2507249148,v1:172.21.15.135:6809/2507249148]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:55:33.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:33 smithi135 ceph-mon[22342]: osdmap e34: 6 total, 5 up, 6 in 2024-08-20T04:55:33.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:33.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:33 smithi135 ceph-mon[22342]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:55:33.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:33.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:33.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T04:55:33.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T04:55:33.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:33.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:33.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:55:33.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:33.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:33 smithi130 ceph-mon[22007]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:33 smithi130 ceph-mon[22007]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-20T04:55:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:33 smithi130 ceph-mon[22007]: from='osd.5 [v2:172.21.15.135:6808/2507249148,v1:172.21.15.135:6809/2507249148]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:55:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:33 smithi130 ceph-mon[22007]: osdmap e34: 6 total, 5 up, 6 in 2024-08-20T04:55:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:33 smithi130 ceph-mon[22007]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:55:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T04:55:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T04:55:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:55:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:34.139 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:55:34.173 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_2 2024-08-20T04:55:34.564 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:55:34.734 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:34 smithi037 ceph-mon[17265]: Detected new or changed devices on smithi135 2024-08-20T04:55:34.734 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:34 smithi037 ceph-mon[17265]: Adjusting osd_memory_target on smithi135 to 2907M 2024-08-20T04:55:34.734 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:34 smithi037 ceph-mon[17265]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-08-20T04:55:34.734 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:34 smithi037 ceph-mon[17265]: osdmap e35: 6 total, 5 up, 6 in 2024-08-20T04:55:34.734 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:34.734 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:34.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:34 smithi135 ceph-mon[22342]: Detected new or changed devices on smithi135 2024-08-20T04:55:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:34 smithi135 ceph-mon[22342]: Adjusting osd_memory_target on smithi135 to 2907M 2024-08-20T04:55:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:34 smithi135 ceph-mon[22342]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-08-20T04:55:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:34 smithi135 ceph-mon[22342]: osdmap e35: 6 total, 5 up, 6 in 2024-08-20T04:55:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:34.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:34 smithi130 ceph-mon[22007]: Detected new or changed devices on smithi135 2024-08-20T04:55:34.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:34 smithi130 ceph-mon[22007]: Adjusting osd_memory_target on smithi135 to 2907M 2024-08-20T04:55:34.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:34 smithi130 ceph-mon[22007]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-08-20T04:55:34.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:34 smithi130 ceph-mon[22007]: osdmap e35: 6 total, 5 up, 6 in 2024-08-20T04:55:34.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:34.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:35.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.136+0000 7fcd66a00640 1 -- 172.21.15.37:0/4170123759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd60079260 msgr2=0x7fcd60079bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:55:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.136+0000 7fcd66a00640 1 --2- 172.21.15.37:0/4170123759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd60079260 0x7fcd60079bb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcd58009ca0 tx=0x7fcd5802a8c0 comp rx=0 tx=0).stop 2024-08-20T04:55:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.136+0000 7fcd66a00640 1 -- 172.21.15.37:0/4170123759 shutdown_connections 2024-08-20T04:55:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.136+0000 7fcd66a00640 1 --2- 172.21.15.37:0/4170123759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd60079260 0x7fcd60079bb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.136+0000 7fcd66a00640 1 --2- 172.21.15.37:0/4170123759 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd600788a0 0x7fcd60078d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.136+0000 7fcd66a00640 1 --2- 172.21.15.37:0/4170123759 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd60077740 0x7fcd60077b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:35.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.136+0000 7fcd66a00640 1 -- 172.21.15.37:0/4170123759 >> 172.21.15.37:0/4170123759 conn(0x7fcd601000a0 msgr2=0x7fcd601024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:55:35.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.136+0000 7fcd66a00640 1 -- 172.21.15.37:0/4170123759 shutdown_connections 2024-08-20T04:55:35.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.136+0000 7fcd66a00640 1 -- 172.21.15.37:0/4170123759 wait complete. 2024-08-20T04:55:35.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.137+0000 7fcd66a00640 1 Processor -- start 2024-08-20T04:55:35.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.138+0000 7fcd66a00640 1 -- start start 2024-08-20T04:55:35.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.138+0000 7fcd66a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd60077740 0x7fcd6019ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:55:35.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.138+0000 7fcd66a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd600788a0 0x7fcd6019f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:55:35.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.138+0000 7fcd66a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd60079260 0x7fcd601a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:55:35.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.138+0000 7fcd66a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcd60114870 con 0x7fcd60077740 2024-08-20T04:55:35.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.138+0000 7fcd66a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcd601146f0 con 0x7fcd600788a0 2024-08-20T04:55:35.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.138+0000 7fcd66a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcd601149f0 con 0x7fcd60079260 2024-08-20T04:55:35.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.138+0000 7fcd65600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd60077740 0x7fcd6019ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:55:35.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.138+0000 7fcd65600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd60077740 0x7fcd6019ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37504/0 (socket says 172.21.15.37:37504) 2024-08-20T04:55:35.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.138+0000 7fcd65600640 1 -- 172.21.15.37:0/2626632011 learned_addr learned my addr 172.21.15.37:0/2626632011 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:55:35.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.138+0000 7fcd66000640 1 --2- 172.21.15.37:0/2626632011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd60079260 0x7fcd601a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:55:35.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.138+0000 7fcd64c00640 1 --2- 172.21.15.37:0/2626632011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd600788a0 0x7fcd6019f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:55:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.139+0000 7fcd65600640 1 -- 172.21.15.37:0/2626632011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd60079260 msgr2=0x7fcd601a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:55:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.139+0000 7fcd65600640 1 --2- 172.21.15.37:0/2626632011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd60079260 0x7fcd601a00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.139+0000 7fcd65600640 1 -- 172.21.15.37:0/2626632011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd600788a0 msgr2=0x7fcd6019f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:55:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.139+0000 7fcd65600640 1 --2- 172.21.15.37:0/2626632011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd600788a0 0x7fcd6019f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.139+0000 7fcd65600640 1 -- 172.21.15.37:0/2626632011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd601a0950 con 0x7fcd60077740 2024-08-20T04:55:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.139+0000 7fcd65600640 1 --2- 172.21.15.37:0/2626632011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd60077740 0x7fcd6019ee20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400d950 tx=0x7fcd5400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:55:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.139+0000 7fcd5e000640 1 -- 172.21.15.37:0/2626632011 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd54017070 con 0x7fcd60077740 2024-08-20T04:55:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.139+0000 7fcd5e000640 1 -- 172.21.15.37:0/2626632011 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd54009c30 con 0x7fcd60077740 2024-08-20T04:55:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.139+0000 7fcd66a00640 1 -- 172.21.15.37:0/2626632011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd601a0c40 con 0x7fcd60077740 2024-08-20T04:55:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.139+0000 7fcd5e000640 1 -- 172.21.15.37:0/2626632011 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5400f620 con 0x7fcd60077740 2024-08-20T04:55:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.140+0000 7fcd66a00640 1 -- 172.21.15.37:0/2626632011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd601a7320 con 0x7fcd60077740 2024-08-20T04:55:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.141+0000 7fcd66a00640 1 -- 172.21.15.37:0/2626632011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd60111250 con 0x7fcd60077740 2024-08-20T04:55:35.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.143+0000 7fcd5e000640 1 -- 172.21.15.37:0/2626632011 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fcd54005030 con 0x7fcd60077740 2024-08-20T04:55:35.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.144+0000 7fcd5e000640 1 --2- 172.21.15.37:0/2626632011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcd480b3cf0 0x7fcd480b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:55:35.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.144+0000 7fcd5e000640 1 -- 172.21.15.37:0/2626632011 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4566+0+0 (secure 0 0 0) 0x7fcd540e28e0 con 0x7fcd60077740 2024-08-20T04:55:35.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.144+0000 7fcd64c00640 1 --2- 172.21.15.37:0/2626632011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcd480b3cf0 0x7fcd480b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:55:35.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.145+0000 7fcd64c00640 1 --2- 172.21.15.37:0/2626632011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcd480b3cf0 0x7fcd480b61b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009bd0 tx=0x7fcd4c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:55:35.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.146+0000 7fcd5e000640 1 -- 172.21.15.37:0/2626632011 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fcd54009de0 con 0x7fcd60077740 2024-08-20T04:55:35.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:35.352+0000 7fcd66a00640 1 -- 172.21.15.37:0/2626632011 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fcd600632c0 con 0x7fcd480b3cf0 2024-08-20T04:55:35.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:35 smithi037 ceph-mon[17265]: purged_snaps scrub starts 2024-08-20T04:55:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:35 smithi037 ceph-mon[17265]: purged_snaps scrub ok 2024-08-20T04:55:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:35 smithi037 ceph-mon[17265]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:35 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:35 smithi037 ceph-mon[17265]: osd.5 [v2:172.21.15.135:6808/2507249148,v1:172.21.15.135:6809/2507249148] boot 2024-08-20T04:55:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:35 smithi037 ceph-mon[17265]: osdmap e36: 6 total, 6 up, 6 in 2024-08-20T04:55:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:35 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:35 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:55:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:35 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:55:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:35 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:35 smithi135 ceph-mon[22342]: purged_snaps scrub starts 2024-08-20T04:55:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:35 smithi135 ceph-mon[22342]: purged_snaps scrub ok 2024-08-20T04:55:35.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:35 smithi135 ceph-mon[22342]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:35.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:35 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:35.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:35 smithi135 ceph-mon[22342]: osd.5 [v2:172.21.15.135:6808/2507249148,v1:172.21.15.135:6809/2507249148] boot 2024-08-20T04:55:35.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:35 smithi135 ceph-mon[22342]: osdmap e36: 6 total, 6 up, 6 in 2024-08-20T04:55:35.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:35 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:35.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:35 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:55:35.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:35 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:55:35.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:35 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:35 smithi130 ceph-mon[22007]: purged_snaps scrub starts 2024-08-20T04:55:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:35 smithi130 ceph-mon[22007]: purged_snaps scrub ok 2024-08-20T04:55:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:35 smithi130 ceph-mon[22007]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 143 MiB used, 447 GiB / 447 GiB avail 2024-08-20T04:55:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:35 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:35 smithi130 ceph-mon[22007]: osd.5 [v2:172.21.15.135:6808/2507249148,v1:172.21.15.135:6809/2507249148] boot 2024-08-20T04:55:35.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:35 smithi130 ceph-mon[22007]: osdmap e36: 6 total, 6 up, 6 in 2024-08-20T04:55:35.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:35 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-08-20T04:55:35.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:35 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:55:35.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:35 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:55:35.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:35 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:36.681 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:36 smithi037 ceph-mon[17265]: from='client.14469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:55:36.681 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:36 smithi037 ceph-mon[17265]: osdmap e37: 6 total, 6 up, 6 in 2024-08-20T04:55:36.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:36 smithi135 ceph-mon[22342]: from='client.14469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:55:36.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:36 smithi135 ceph-mon[22342]: osdmap e37: 6 total, 6 up, 6 in 2024-08-20T04:55:36.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:36 smithi130 ceph-mon[22007]: from='client.14469 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:55:36.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:36 smithi130 ceph-mon[22007]: osdmap e37: 6 total, 6 up, 6 in 2024-08-20T04:55:37.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:37 smithi037 ceph-mon[17265]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:37.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:37 smithi037 ceph-mon[17265]: osdmap e38: 6 total, 6 up, 6 in 2024-08-20T04:55:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:37 smithi135 ceph-mon[22342]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:37 smithi135 ceph-mon[22342]: osdmap e38: 6 total, 6 up, 6 in 2024-08-20T04:55:37.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:37 smithi130 ceph-mon[22007]: pgmap v151: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:37.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:37 smithi130 ceph-mon[22007]: osdmap e38: 6 total, 6 up, 6 in 2024-08-20T04:55:38.736 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:38 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3049316746' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d6346e8-5418-4c30-9bb3-5af352b616a9"} : dispatch 2024-08-20T04:55:38.736 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:38 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3049316746' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d6346e8-5418-4c30-9bb3-5af352b616a9"}]': finished 2024-08-20T04:55:38.736 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:38 smithi037 ceph-mon[17265]: osdmap e39: 7 total, 6 up, 7 in 2024-08-20T04:55:38.736 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:38 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:55:38.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:38 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3049316746' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d6346e8-5418-4c30-9bb3-5af352b616a9"} : dispatch 2024-08-20T04:55:38.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:38 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3049316746' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d6346e8-5418-4c30-9bb3-5af352b616a9"}]': finished 2024-08-20T04:55:38.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:38 smithi135 ceph-mon[22342]: osdmap e39: 7 total, 6 up, 7 in 2024-08-20T04:55:38.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:38 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:55:38.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:38 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3049316746' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6d6346e8-5418-4c30-9bb3-5af352b616a9"} : dispatch 2024-08-20T04:55:38.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:38 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3049316746' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6d6346e8-5418-4c30-9bb3-5af352b616a9"}]': finished 2024-08-20T04:55:38.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:38 smithi130 ceph-mon[22007]: osdmap e39: 7 total, 6 up, 7 in 2024-08-20T04:55:38.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:38 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:55:39.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:39 smithi037 ceph-mon[17265]: pgmap v153: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:39.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:39 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2200715259' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:55:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:39 smithi135 ceph-mon[22342]: pgmap v153: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:39 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2200715259' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:55:39.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:39 smithi130 ceph-mon[22007]: pgmap v153: 1 pgs: 1 peering; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:39.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:39 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2200715259' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:55:41.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:41 smithi037 ceph-mon[17265]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-08-20T04:55:41.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:41 smithi135 ceph-mon[22342]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-08-20T04:55:41.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:41 smithi130 ceph-mon[22007]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-08-20T04:55:43.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:43 smithi037 ceph-mon[17265]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-08-20T04:55:43.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:43 smithi135 ceph-mon[22342]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-08-20T04:55:43.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:43 smithi130 ceph-mon[22007]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 89 KiB/s, 0 objects/s recovering 2024-08-20T04:55:45.758 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:45 smithi130 ceph-mon[22007]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T04:55:45.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:45 smithi037 ceph-mon[17265]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T04:55:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:45 smithi135 ceph-mon[22342]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-20T04:55:47.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:47 smithi037 ceph-mon[17265]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-08-20T04:55:47.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:47 smithi135 ceph-mon[22342]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-08-20T04:55:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:47 smithi130 ceph-mon[22007]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-08-20T04:55:48.557 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:48 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-20T04:55:48.557 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:48 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:48.558 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:48 smithi037 ceph-mon[17265]: Deploying daemon osd.6 on smithi037 2024-08-20T04:55:48.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:48 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-20T04:55:48.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:48 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:48.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:48 smithi135 ceph-mon[22342]: Deploying daemon osd.6 on smithi037 2024-08-20T04:55:48.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:48 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-08-20T04:55:48.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:48 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:48.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:48 smithi130 ceph-mon[22007]: Deploying daemon osd.6 on smithi037 2024-08-20T04:55:49.723 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:49 smithi037 ceph-mon[17265]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-20T04:55:49.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:49 smithi135 ceph-mon[22342]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-20T04:55:49.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:49 smithi130 ceph-mon[22007]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-20T04:55:51.657 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:51 smithi037 ceph-mon[17265]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-20T04:55:51.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:51 smithi135 ceph-mon[22342]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-20T04:55:51.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:51 smithi130 ceph-mon[22007]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-08-20T04:55:53.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:53 smithi037 ceph-mon[17265]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:53.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:53 smithi135 ceph-mon[22342]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:53.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:53 smithi130 ceph-mon[22007]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:55.794 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:55 smithi037 ceph-mon[17265]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:55.794 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:55:55.794 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:55.794 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:55.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:55 smithi135 ceph-mon[22342]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:55.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:55 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:55:55.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:55 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:55.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:55 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:55 smithi130 ceph-mon[22007]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:55 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:55:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:55 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:55 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:57.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:57 smithi037 ceph-mon[17265]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:57.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:57 smithi135 ceph-mon[22342]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:57 smithi130 ceph-mon[22007]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:59.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:59 smithi037 ceph-mon[17265]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:59.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:59 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:59.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:59 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:59.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:59 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:59.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:59 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:55:59.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:55:59 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:59.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:59.396+0000 7fcd5e000640 1 -- 172.21.15.37:0/2626632011 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcd600632c0 con 0x7fcd480b3cf0 2024-08-20T04:55:59.398 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 6 on host 'smithi037' 2024-08-20T04:55:59.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:59.399+0000 7fcd66a00640 1 -- 172.21.15.37:0/2626632011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcd480b3cf0 msgr2=0x7fcd480b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:55:59.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:59.399+0000 7fcd66a00640 1 --2- 172.21.15.37:0/2626632011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcd480b3cf0 0x7fcd480b61b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c009bd0 tx=0x7fcd4c005f90 comp rx=0 tx=0).stop 2024-08-20T04:55:59.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:59.399+0000 7fcd66a00640 1 -- 172.21.15.37:0/2626632011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd60077740 msgr2=0x7fcd6019ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:55:59.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:59.399+0000 7fcd66a00640 1 --2- 172.21.15.37:0/2626632011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd60077740 0x7fcd6019ee20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400d950 tx=0x7fcd5400de10 comp rx=0 tx=0).stop 2024-08-20T04:55:59.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:59.399+0000 7fcd66a00640 1 -- 172.21.15.37:0/2626632011 shutdown_connections 2024-08-20T04:55:59.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:59.399+0000 7fcd66a00640 1 --2- 172.21.15.37:0/2626632011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcd480b3cf0 0x7fcd480b61b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:59.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:59.399+0000 7fcd66a00640 1 --2- 172.21.15.37:0/2626632011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcd60079260 0x7fcd601a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:59.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:59.399+0000 7fcd66a00640 1 --2- 172.21.15.37:0/2626632011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcd600788a0 0x7fcd6019f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:59.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:59.399+0000 7fcd66a00640 1 --2- 172.21.15.37:0/2626632011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd60077740 0x7fcd6019ee20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:55:59.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:59.399+0000 7fcd66a00640 1 -- 172.21.15.37:0/2626632011 >> 172.21.15.37:0/2626632011 conn(0x7fcd601000a0 msgr2=0x7fcd60101b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:55:59.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:59.400+0000 7fcd66a00640 1 -- 172.21.15.37:0/2626632011 shutdown_connections 2024-08-20T04:55:59.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:55:59.400+0000 7fcd66a00640 1 -- 172.21.15.37:0/2626632011 wait complete. 2024-08-20T04:55:59.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:59 smithi130 ceph-mon[22007]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:59.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:59 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:59.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:59 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:59.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:59 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:59.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:59 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:55:59.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:55:59 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:59.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:59 smithi135 ceph-mon[22342]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:55:59.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:59 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:59.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:59 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:55:59.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:59 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:55:59.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:59 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:55:59.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:55:59 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:00.207 DEBUG:teuthology.orchestra.run.smithi037:osd.6> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.6.service 2024-08-20T04:56:00.211 INFO:tasks.cephadm:Deploying osd.7 on smithi130 with /dev/vg_nvme/lv_2... 2024-08-20T04:56:00.211 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-20T04:56:00.437 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:00 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:56:00.437 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:00 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:00.437 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:00 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:00.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:00 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:56:00.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:00 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:00.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:00 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:00.485 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T04:56:00.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:00 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:56:00.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:00 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:00.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:00 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:01.266 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 04:56:00 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T04:56:00.862+0000 7f605dc4d640 -1 osd.6 0 log_to_monitors true 2024-08-20T04:56:01.576 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:01 smithi130 ceph-mon[22007]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:56:01.576 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:01 smithi130 ceph-mon[22007]: from='osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-20T04:56:01.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:01 smithi037 ceph-mon[17265]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:56:01.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:01 smithi037 ceph-mon[17265]: from='osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-20T04:56:01.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:01 smithi135 ceph-mon[22342]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:56:01.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:01 smithi135 ceph-mon[22342]: from='osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-08-20T04:56:02.630 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:02 smithi130 ceph-mon[22007]: from='osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-20T04:56:02.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:02 smithi130 ceph-mon[22007]: osdmap e40: 7 total, 6 up, 7 in 2024-08-20T04:56:02.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:02 smithi130 ceph-mon[22007]: from='osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-20T04:56:02.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:02 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:56:02.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:02 smithi130 ceph-mon[22007]: from='osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-20T04:56:02.631 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:02 smithi130 ceph-mon[22007]: osdmap e41: 7 total, 6 up, 7 in 2024-08-20T04:56:02.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:02 smithi037 ceph-mon[17265]: from='osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-20T04:56:02.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:02 smithi037 ceph-mon[17265]: osdmap e40: 7 total, 6 up, 7 in 2024-08-20T04:56:02.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:02 smithi037 ceph-mon[17265]: from='osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-20T04:56:02.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:02 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:56:02.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:02 smithi037 ceph-mon[17265]: from='osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-20T04:56:02.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:02 smithi037 ceph-mon[17265]: osdmap e41: 7 total, 6 up, 7 in 2024-08-20T04:56:02.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:02 smithi135 ceph-mon[22342]: from='osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-20T04:56:02.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:02 smithi135 ceph-mon[22342]: osdmap e40: 7 total, 6 up, 7 in 2024-08-20T04:56:02.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:02 smithi135 ceph-mon[22342]: from='osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-20T04:56:02.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:02 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:56:02.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:02 smithi135 ceph-mon[22342]: from='osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-20T04:56:02.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:02 smithi135 ceph-mon[22342]: osdmap e41: 7 total, 6 up, 7 in 2024-08-20T04:56:02.945 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:56:02.971 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_2 2024-08-20T04:56:03.228 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T04:56:03.515 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 04:56:03 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T04:56:03.253+0000 7f6058400640 -1 osd.6 0 waiting for initial osdmap 2024-08-20T04:56:03.515 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 04:56:03 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T04:56:03.277+0000 7f604e400640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T04:56:03.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:03 smithi037 ceph-mon[17265]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:56:03.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:03 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:56:03.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:03 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:56:03.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:03 smithi037 ceph-mon[17265]: from='osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692]' entity='osd.6' 2024-08-20T04:56:03.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:03 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:56:03.601 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:03 smithi130 ceph-mon[22007]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:56:03.601 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:03 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:56:03.601 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:03 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:56:03.601 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:03 smithi130 ceph-mon[22007]: from='osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692]' entity='osd.6' 2024-08-20T04:56:03.601 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:03 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:56:03.720 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.670+0000 7ff5213b0640 1 -- 172.21.15.130:0/3723458849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff51c101630 msgr2=0x7ff51c101a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:56:03.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.670+0000 7ff5213b0640 1 --2- 172.21.15.130:0/3723458849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff51c101630 0x7ff51c101a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff510009930 tx=0x7ff51002a420 comp rx=0 tx=0).stop 2024-08-20T04:56:03.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.670+0000 7ff5213b0640 1 -- 172.21.15.130:0/3723458849 shutdown_connections 2024-08-20T04:56:03.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.670+0000 7ff5213b0640 1 --2- 172.21.15.130:0/3723458849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff51c103150 0x7ff51c109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:03.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.670+0000 7ff5213b0640 1 --2- 172.21.15.130:0/3723458849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff51c102790 0x7ff51c102c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:03.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.670+0000 7ff5213b0640 1 --2- 172.21.15.130:0/3723458849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff51c101630 0x7ff51c101a30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:03.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.670+0000 7ff5213b0640 1 -- 172.21.15.130:0/3723458849 >> 172.21.15.130:0/3723458849 conn(0x7ff51c0fcf00 msgr2=0x7ff51c0ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:56:03.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.670+0000 7ff5213b0640 1 -- 172.21.15.130:0/3723458849 shutdown_connections 2024-08-20T04:56:03.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.670+0000 7ff5213b0640 1 -- 172.21.15.130:0/3723458849 wait complete. 2024-08-20T04:56:03.721 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.671+0000 7ff5213b0640 1 Processor -- start 2024-08-20T04:56:03.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.671+0000 7ff5213b0640 1 -- start start 2024-08-20T04:56:03.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.671+0000 7ff5213b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff51c101630 0x7ff51c198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:56:03.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.671+0000 7ff5213b0640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff51c102790 0x7ff51c199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:56:03.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.671+0000 7ff5213b0640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff51c103150 0x7ff51c199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:56:03.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.671+0000 7ff5213b0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c10d2b0 con 0x7ff51c101630 2024-08-20T04:56:03.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.671+0000 7ff5213b0640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c10d130 con 0x7ff51c103150 2024-08-20T04:56:03.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.671+0000 7ff5213b0640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c10d430 con 0x7ff51c102790 2024-08-20T04:56:03.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.671+0000 7ff51b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff51c103150 0x7ff51c199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:56:03.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.671+0000 7ff51b7fe640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff51c103150 0x7ff51c199e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:57856/0 (socket says 172.21.15.130:57856) 2024-08-20T04:56:03.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.671+0000 7ff51b7fe640 1 -- 172.21.15.130:0/4272108022 learned_addr learned my addr 172.21.15.130:0/4272108022 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-08-20T04:56:03.722 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.671+0000 7ff51affd640 1 --2- 172.21.15.130:0/4272108022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff51c101630 0x7ff51c198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:56:03.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.671+0000 7ff51a7fc640 1 --2- 172.21.15.130:0/4272108022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff51c102790 0x7ff51c199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:56:03.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.672+0000 7ff51b7fe640 1 -- 172.21.15.130:0/4272108022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff51c102790 msgr2=0x7ff51c199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:56:03.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.672+0000 7ff51b7fe640 1 --2- 172.21.15.130:0/4272108022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff51c102790 0x7ff51c199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:03.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.672+0000 7ff51b7fe640 1 -- 172.21.15.130:0/4272108022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff51c101630 msgr2=0x7ff51c198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:56:03.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.672+0000 7ff51b7fe640 1 --2- 172.21.15.130:0/4272108022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff51c101630 0x7ff51c198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:03.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.672+0000 7ff51b7fe640 1 -- 172.21.15.130:0/4272108022 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51c19a6f0 con 0x7ff51c103150 2024-08-20T04:56:03.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.672+0000 7ff51affd640 1 --2- 172.21.15.130:0/4272108022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff51c101630 0x7ff51c198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T04:56:03.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.672+0000 7ff51b7fe640 1 --2- 172.21.15.130:0/4272108022 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff51c103150 0x7ff51c199e50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff51400dac0 tx=0x7ff51400df80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:56:03.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.672+0000 7ff503fff640 1 -- 172.21.15.130:0/4272108022 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff514017070 con 0x7ff51c103150 2024-08-20T04:56:03.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.672+0000 7ff503fff640 1 -- 172.21.15.130:0/4272108022 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff51400be30 con 0x7ff51c103150 2024-08-20T04:56:03.723 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.672+0000 7ff5213b0640 1 -- 172.21.15.130:0/4272108022 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff51c19a9e0 con 0x7ff51c103150 2024-08-20T04:56:03.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.672+0000 7ff503fff640 1 -- 172.21.15.130:0/4272108022 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff514010460 con 0x7ff51c103150 2024-08-20T04:56:03.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.672+0000 7ff5213b0640 1 -- 172.21.15.130:0/4272108022 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff51c1a10c0 con 0x7ff51c103150 2024-08-20T04:56:03.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.673+0000 7ff5213b0640 1 -- 172.21.15.130:0/4272108022 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff51c101a30 con 0x7ff51c103150 2024-08-20T04:56:03.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.674+0000 7ff503fff640 1 -- 172.21.15.130:0/4272108022 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7ff514003f90 con 0x7ff51c103150 2024-08-20T04:56:03.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.675+0000 7ff503fff640 1 --2- 172.21.15.130:0/4272108022 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5040b3bd0 0x7ff5040b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:56:03.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.675+0000 7ff503fff640 1 -- 172.21.15.130:0/4272108022 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4685+0+0 (secure 0 0 0) 0x7ff5140e3510 con 0x7ff51c103150 2024-08-20T04:56:03.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.675+0000 7ff51affd640 1 --2- 172.21.15.130:0/4272108022 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5040b3bd0 0x7ff5040b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:56:03.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.676+0000 7ff51affd640 1 --2- 172.21.15.130:0/4272108022 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5040b3bd0 0x7ff5040b6090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff510006010 tx=0x7ff510031450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:56:03.724 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.678+0000 7ff503fff640 1 -- 172.21.15.130:0/4272108022 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff514020020 con 0x7ff51c103150 2024-08-20T04:56:03.863 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:03.861+0000 7ff5213b0640 1 -- 172.21.15.130:0/4272108022 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff51c1a1290 con 0x7ff5040b3bd0 2024-08-20T04:56:03.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:03 smithi135 ceph-mon[22342]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:56:03.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:03 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:56:03.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:03 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:56:03.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:03 smithi135 ceph-mon[22342]: from='osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692]' entity='osd.6' 2024-08-20T04:56:03.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:03 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:56:04.532 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:04 smithi130 ceph-mon[22007]: purged_snaps scrub starts 2024-08-20T04:56:04.532 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:04 smithi130 ceph-mon[22007]: purged_snaps scrub ok 2024-08-20T04:56:04.532 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:04 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:56:04.532 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:04 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:56:04.532 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:04 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:04.533 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:04 smithi130 ceph-mon[22007]: osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692] boot 2024-08-20T04:56:04.533 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:04 smithi130 ceph-mon[22007]: osdmap e42: 7 total, 7 up, 7 in 2024-08-20T04:56:04.533 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:04 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:56:04.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:04 smithi037 ceph-mon[17265]: purged_snaps scrub starts 2024-08-20T04:56:04.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:04 smithi037 ceph-mon[17265]: purged_snaps scrub ok 2024-08-20T04:56:04.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:04 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:56:04.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:04 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:56:04.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:04 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:04.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:04 smithi037 ceph-mon[17265]: osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692] boot 2024-08-20T04:56:04.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:04 smithi037 ceph-mon[17265]: osdmap e42: 7 total, 7 up, 7 in 2024-08-20T04:56:04.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:04 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:56:04.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:04 smithi135 ceph-mon[22342]: purged_snaps scrub starts 2024-08-20T04:56:04.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:04 smithi135 ceph-mon[22342]: purged_snaps scrub ok 2024-08-20T04:56:04.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:04 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:56:04.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:04 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:56:04.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:04 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:04.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:04 smithi135 ceph-mon[22342]: osd.6 [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692] boot 2024-08-20T04:56:04.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:04 smithi135 ceph-mon[22342]: osdmap e42: 7 total, 7 up, 7 in 2024-08-20T04:56:04.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:04 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-08-20T04:56:05.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:05 smithi130 ceph-mon[22007]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:56:05.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:05 smithi130 ceph-mon[22007]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:56:05.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:05 smithi130 ceph-mon[22007]: Detected new or changed devices on smithi037 2024-08-20T04:56:05.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:05 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:05.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:05 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:05.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:05 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:05.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:05 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:05.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:05 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:05.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:05 smithi130 ceph-mon[22007]: Adjusting osd_memory_target on smithi037 to 5698M 2024-08-20T04:56:05.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:05 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:05.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:05 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:05.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:05 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:56:05.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:05 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:05.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:05 smithi037 ceph-mon[17265]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:56:05.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:05 smithi037 ceph-mon[17265]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:56:05.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:05 smithi037 ceph-mon[17265]: Detected new or changed devices on smithi037 2024-08-20T04:56:05.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:05 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:05.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:05 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:05.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:05 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:05.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:05 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:05.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:05 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:05.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:05 smithi037 ceph-mon[17265]: Adjusting osd_memory_target on smithi037 to 5698M 2024-08-20T04:56:05.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:05 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:05.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:05 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:05.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:05 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:56:05.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:05 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:05.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:05 smithi135 ceph-mon[22342]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:56:05.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:05 smithi135 ceph-mon[22342]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 170 MiB used, 536 GiB / 536 GiB avail 2024-08-20T04:56:05.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:05 smithi135 ceph-mon[22342]: Detected new or changed devices on smithi037 2024-08-20T04:56:05.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:05 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:05.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:05 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:05.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:05 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:05.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:05 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:05.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:05 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:05.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:05 smithi135 ceph-mon[22342]: Adjusting osd_memory_target on smithi037 to 5698M 2024-08-20T04:56:05.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:05 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:05.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:05 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:05.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:05 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:56:05.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:05 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:06.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:06 smithi130 ceph-mon[22007]: osdmap e43: 7 total, 7 up, 7 in 2024-08-20T04:56:06.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:06 smithi130 ceph-mon[22007]: from='client.? 172.21.15.130:0/3400738140' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c87804c2-d456-495e-b36e-33dbb3548347"} : dispatch 2024-08-20T04:56:06.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:06 smithi130 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c87804c2-d456-495e-b36e-33dbb3548347"} : dispatch 2024-08-20T04:56:06.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:06 smithi130 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c87804c2-d456-495e-b36e-33dbb3548347"}]': finished 2024-08-20T04:56:06.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:06 smithi130 ceph-mon[22007]: osdmap e44: 8 total, 7 up, 8 in 2024-08-20T04:56:06.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:06 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T04:56:06.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:06 smithi135 ceph-mon[22342]: osdmap e43: 7 total, 7 up, 7 in 2024-08-20T04:56:06.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:06 smithi135 ceph-mon[22342]: from='client.? 172.21.15.130:0/3400738140' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c87804c2-d456-495e-b36e-33dbb3548347"} : dispatch 2024-08-20T04:56:06.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:06 smithi135 ceph-mon[22342]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c87804c2-d456-495e-b36e-33dbb3548347"} : dispatch 2024-08-20T04:56:06.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:06 smithi135 ceph-mon[22342]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c87804c2-d456-495e-b36e-33dbb3548347"}]': finished 2024-08-20T04:56:06.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:06 smithi135 ceph-mon[22342]: osdmap e44: 8 total, 7 up, 8 in 2024-08-20T04:56:06.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:06 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T04:56:07.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:06 smithi037 ceph-mon[17265]: osdmap e43: 7 total, 7 up, 7 in 2024-08-20T04:56:07.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:06 smithi037 ceph-mon[17265]: from='client.? 172.21.15.130:0/3400738140' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c87804c2-d456-495e-b36e-33dbb3548347"} : dispatch 2024-08-20T04:56:07.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:06 smithi037 ceph-mon[17265]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c87804c2-d456-495e-b36e-33dbb3548347"} : dispatch 2024-08-20T04:56:07.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:06 smithi037 ceph-mon[17265]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c87804c2-d456-495e-b36e-33dbb3548347"}]': finished 2024-08-20T04:56:07.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:06 smithi037 ceph-mon[17265]: osdmap e44: 8 total, 7 up, 8 in 2024-08-20T04:56:07.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:06 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T04:56:07.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:07 smithi135 ceph-mon[22342]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:07.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:07 smithi135 ceph-mon[22342]: from='client.? 172.21.15.130:0/2649187822' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:56:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:07 smithi130 ceph-mon[22007]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:07.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:07 smithi130 ceph-mon[22007]: from='client.? 172.21.15.130:0/2649187822' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:56:08.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:07 smithi037 ceph-mon[17265]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:08.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:07 smithi037 ceph-mon[17265]: from='client.? 172.21.15.130:0/2649187822' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:56:09.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:09 smithi135 ceph-mon[22342]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:09.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:09 smithi130 ceph-mon[22007]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:10.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:09 smithi037 ceph-mon[17265]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:11.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:11 smithi130 ceph-mon[22007]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:11.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:11 smithi135 ceph-mon[22342]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:12.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:11 smithi037 ceph-mon[17265]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:13.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:13 smithi130 ceph-mon[22007]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:13.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:13 smithi135 ceph-mon[22342]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:14.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:13 smithi037 ceph-mon[17265]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:15.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:15 smithi130 ceph-mon[22007]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:15.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-20T04:56:15.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:15.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:15 smithi130 ceph-mon[22007]: Deploying daemon osd.7 on smithi130 2024-08-20T04:56:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:15 smithi135 ceph-mon[22342]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-20T04:56:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:15 smithi135 ceph-mon[22342]: Deploying daemon osd.7 on smithi130 2024-08-20T04:56:16.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:15 smithi037 ceph-mon[17265]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:16.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-08-20T04:56:16.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:16.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:15 smithi037 ceph-mon[17265]: Deploying daemon osd.7 on smithi130 2024-08-20T04:56:17.802 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:17 smithi130 ceph-mon[22007]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:17.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:17 smithi135 ceph-mon[22342]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:18.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:17 smithi037 ceph-mon[17265]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:19.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:19 smithi130 ceph-mon[22007]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:19.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:19 smithi135 ceph-mon[22342]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:20.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:19 smithi037 ceph-mon[17265]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:20.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:20 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:56:20.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:20 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:20.793 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:20 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:20 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:56:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:20 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:20.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:20 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:21.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:20 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:56:21.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:20 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:21.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:20 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:21 smithi135 ceph-mon[22342]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:21.883 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:21 smithi130 ceph-mon[22007]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:22.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:21 smithi037 ceph-mon[17265]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:23.776 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:23.774+0000 7ff503fff640 1 -- 172.21.15.130:0/4272108022 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff51c1a1290 con 0x7ff5040b3bd0 2024-08-20T04:56:23.776 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 7 on host 'smithi130' 2024-08-20T04:56:23.778 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:23.776+0000 7ff5213b0640 1 -- 172.21.15.130:0/4272108022 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5040b3bd0 msgr2=0x7ff5040b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:56:23.778 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:23.776+0000 7ff5213b0640 1 --2- 172.21.15.130:0/4272108022 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5040b3bd0 0x7ff5040b6090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff510006010 tx=0x7ff510031450 comp rx=0 tx=0).stop 2024-08-20T04:56:23.778 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:23.776+0000 7ff5213b0640 1 -- 172.21.15.130:0/4272108022 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff51c103150 msgr2=0x7ff51c199e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:56:23.778 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:23.776+0000 7ff5213b0640 1 --2- 172.21.15.130:0/4272108022 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff51c103150 0x7ff51c199e50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff51400dac0 tx=0x7ff51400df80 comp rx=0 tx=0).stop 2024-08-20T04:56:23.778 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:23.776+0000 7ff5213b0640 1 -- 172.21.15.130:0/4272108022 shutdown_connections 2024-08-20T04:56:23.778 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:23.776+0000 7ff5213b0640 1 --2- 172.21.15.130:0/4272108022 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5040b3bd0 0x7ff5040b6090 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:23.778 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:23.776+0000 7ff5213b0640 1 --2- 172.21.15.130:0/4272108022 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff51c103150 0x7ff51c199e50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:23.779 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:23.776+0000 7ff5213b0640 1 --2- 172.21.15.130:0/4272108022 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff51c102790 0x7ff51c199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:23.779 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:23.776+0000 7ff5213b0640 1 --2- 172.21.15.130:0/4272108022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff51c101630 0x7ff51c198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:23.779 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:23.776+0000 7ff5213b0640 1 -- 172.21.15.130:0/4272108022 >> 172.21.15.130:0/4272108022 conn(0x7ff51c0fcf00 msgr2=0x7ff51c103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:56:23.779 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:23.777+0000 7ff5213b0640 1 -- 172.21.15.130:0/4272108022 shutdown_connections 2024-08-20T04:56:23.779 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:56:23.777+0000 7ff5213b0640 1 -- 172.21.15.130:0/4272108022 wait complete. 2024-08-20T04:56:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:23 smithi130 ceph-mon[22007]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:56:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:24.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:23 smithi037 ceph-mon[17265]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:24.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:24.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:24.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:24.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:56:24.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:24.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:23 smithi135 ceph-mon[22342]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:24.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:24.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:24.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:24.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:56:24.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:24.463 DEBUG:teuthology.orchestra.run.smithi130:osd.7> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.7.service 2024-08-20T04:56:24.465 INFO:tasks.cephadm:Deploying osd.8 on smithi135 with /dev/vg_nvme/lv_2... 2024-08-20T04:56:24.465 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-20T04:56:24.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:24 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:56:24.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:24 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:24.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:24 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:24.721 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T04:56:24.843 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:24 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:56:24.843 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:24 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:24.843 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:24 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:25.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:24 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:56:25.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:24 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:25.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:24 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:25.817 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:25 smithi135 ceph-mon[22342]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:25.895 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:25 smithi130 ceph-mon[22007]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:25.896 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 04:56:25 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T04:56:25.845+0000 7f64fa67a640 -1 osd.7 0 log_to_monitors true 2024-08-20T04:56:26.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:25 smithi037 ceph-mon[17265]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:26.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:26 smithi130 ceph-mon[22007]: from='osd.7 [v2:172.21.15.130:6816/4148130245,v1:172.21.15.130:6817/4148130245]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T04:56:26.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:26 smithi130 ceph-mon[22007]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T04:56:26.995 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:26 smithi135 ceph-mon[22342]: from='osd.7 [v2:172.21.15.130:6816/4148130245,v1:172.21.15.130:6817/4148130245]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T04:56:26.995 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:26 smithi135 ceph-mon[22342]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T04:56:27.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:26 smithi037 ceph-mon[17265]: from='osd.7 [v2:172.21.15.130:6816/4148130245,v1:172.21.15.130:6817/4148130245]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T04:56:27.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:26 smithi037 ceph-mon[17265]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-08-20T04:56:27.228 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:56:27.255 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_2 2024-08-20T04:56:27.515 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T04:56:27.796 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:27 smithi135 ceph-mon[22342]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:27.797 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:27 smithi135 ceph-mon[22342]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-20T04:56:27.797 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:27 smithi135 ceph-mon[22342]: osdmap e45: 8 total, 7 up, 8 in 2024-08-20T04:56:27.797 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T04:56:27.797 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:27 smithi135 ceph-mon[22342]: from='osd.7 [v2:172.21.15.130:6816/4148130245,v1:172.21.15.130:6817/4148130245]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:56:27.797 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:27 smithi135 ceph-mon[22342]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:56:27.797 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:27.797 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:27.797 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:27.797 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:27.797 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:27.797 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:27.797 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:27.798 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:56:27.798 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:27 smithi130 ceph-mon[22007]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:27 smithi130 ceph-mon[22007]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-20T04:56:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:27 smithi130 ceph-mon[22007]: osdmap e45: 8 total, 7 up, 8 in 2024-08-20T04:56:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T04:56:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:27 smithi130 ceph-mon[22007]: from='osd.7 [v2:172.21.15.130:6816/4148130245,v1:172.21.15.130:6817/4148130245]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:56:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:27 smithi130 ceph-mon[22007]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:56:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:27.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:27.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:27.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:27.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:56:27.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:27.957 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 04:56:27 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T04:56:27.698+0000 7f64f65fd640 -1 osd.7 0 waiting for initial osdmap 2024-08-20T04:56:27.957 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 04:56:27 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T04:56:27.708+0000 7f64f2424640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T04:56:28.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:27 smithi037 ceph-mon[17265]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:28.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:27 smithi037 ceph-mon[17265]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-20T04:56:28.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:27 smithi037 ceph-mon[17265]: osdmap e45: 8 total, 7 up, 8 in 2024-08-20T04:56:28.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T04:56:28.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:27 smithi037 ceph-mon[17265]: from='osd.7 [v2:172.21.15.130:6816/4148130245,v1:172.21.15.130:6817/4148130245]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:56:28.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:27 smithi037 ceph-mon[17265]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:56:28.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:28.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:28.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:28.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:28.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:28.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:28.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:28.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:56:28.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:28.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.006+0000 7f929570c640 1 -- 172.21.15.135:0/817028261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9290101610 msgr2=0x7f9290101a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:56:28.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.006+0000 7f929570c640 1 --2- 172.21.15.135:0/817028261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9290101610 0x7f9290101a10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9280009960 tx=0x7f928002a460 comp rx=0 tx=0).stop 2024-08-20T04:56:28.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.006+0000 7f929570c640 1 -- 172.21.15.135:0/817028261 shutdown_connections 2024-08-20T04:56:28.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.006+0000 7f929570c640 1 --2- 172.21.15.135:0/817028261 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9290103130 0x7f9290109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:28.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.006+0000 7f929570c640 1 --2- 172.21.15.135:0/817028261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9290102770 0x7f9290102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:28.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.006+0000 7f929570c640 1 --2- 172.21.15.135:0/817028261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9290101610 0x7f9290101a10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:28.038 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.006+0000 7f929570c640 1 -- 172.21.15.135:0/817028261 >> 172.21.15.135:0/817028261 conn(0x7f92900fcee0 msgr2=0x7f92900ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:56:28.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.006+0000 7f929570c640 1 -- 172.21.15.135:0/817028261 shutdown_connections 2024-08-20T04:56:28.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.006+0000 7f929570c640 1 -- 172.21.15.135:0/817028261 wait complete. 2024-08-20T04:56:28.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.006+0000 7f929570c640 1 Processor -- start 2024-08-20T04:56:28.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f929570c640 1 -- start start 2024-08-20T04:56:28.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f929570c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9290101610 0x7f9290198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:56:28.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f929570c640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9290102770 0x7f9290199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:56:28.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f929570c640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9290103130 0x7f9290199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:56:28.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f929570c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f929010d290 con 0x7f9290101610 2024-08-20T04:56:28.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f929570c640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f929010d110 con 0x7f9290102770 2024-08-20T04:56:28.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f929570c640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f929010d410 con 0x7f9290103130 2024-08-20T04:56:28.039 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f928f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9290103130 0x7f9290199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:56:28.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f928f7fe640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9290103130 0x7f9290199dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:52870/0 (socket says 172.21.15.135:52870) 2024-08-20T04:56:28.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f928f7fe640 1 -- 172.21.15.135:0/1229398995 learned_addr learned my addr 172.21.15.135:0/1229398995 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-08-20T04:56:28.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f9287fff640 1 --2- 172.21.15.135:0/1229398995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9290102770 0x7f9290199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:56:28.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f928f7fe640 1 -- 172.21.15.135:0/1229398995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9290102770 msgr2=0x7f9290199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:56:28.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f928f7fe640 1 --2- 172.21.15.135:0/1229398995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9290102770 0x7f9290199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:28.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f928f7fe640 1 -- 172.21.15.135:0/1229398995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9290101610 msgr2=0x7f9290198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:56:28.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f928f7fe640 1 --2- 172.21.15.135:0/1229398995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9290101610 0x7f9290198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:28.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f928f7fe640 1 -- 172.21.15.135:0/1229398995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f929019a660 con 0x7f9290103130 2024-08-20T04:56:28.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f928f7fe640 1 --2- 172.21.15.135:0/1229398995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9290103130 0x7f9290199dc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f928800eaa0 tx=0x7f928800ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:56:28.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.007+0000 7f928cff9640 1 -- 172.21.15.135:0/1229398995 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928800cdb0 con 0x7f9290103130 2024-08-20T04:56:28.040 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.008+0000 7f928cff9640 1 -- 172.21.15.135:0/1229398995 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9288005020 con 0x7f9290103130 2024-08-20T04:56:28.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.008+0000 7f929570c640 1 -- 172.21.15.135:0/1229398995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f929019a950 con 0x7f9290103130 2024-08-20T04:56:28.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.008+0000 7f928cff9640 1 -- 172.21.15.135:0/1229398995 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92880116d0 con 0x7f9290103130 2024-08-20T04:56:28.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.008+0000 7f929570c640 1 -- 172.21.15.135:0/1229398995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92901a1030 con 0x7f9290103130 2024-08-20T04:56:28.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.009+0000 7f929570c640 1 -- 172.21.15.135:0/1229398995 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92901a1200 con 0x7f9290103130 2024-08-20T04:56:28.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.010+0000 7f928cff9640 1 -- 172.21.15.135:0/1229398995 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f92880051d0 con 0x7f9290103130 2024-08-20T04:56:28.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.011+0000 7f928cff9640 1 --2- 172.21.15.135:0/1229398995 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f927c0b3c50 0x7f927c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:56:28.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.011+0000 7f928cff9640 1 -- 172.21.15.135:0/1229398995 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5117+0+0 (secure 0 0 0) 0x7f92880e3120 con 0x7f9290103130 2024-08-20T04:56:28.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.011+0000 7f928effd640 1 --2- 172.21.15.135:0/1229398995 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f927c0b3c50 0x7f927c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:56:28.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.012+0000 7f928effd640 1 --2- 172.21.15.135:0/1229398995 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f927c0b3c50 0x7f927c0b6110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9280005ec0 tx=0x7f9280005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:56:28.041 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.015+0000 7f928cff9640 1 -- 172.21.15.135:0/1229398995 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f9288016030 con 0x7f9290103130 2024-08-20T04:56:28.207 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:28.205+0000 7f929570c640 1 -- 172.21.15.135:0/1229398995 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f92901a13d0 con 0x7f927c0b3c50 2024-08-20T04:56:28.759 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:28 smithi135 ceph-mon[22342]: Detected new or changed devices on smithi130 2024-08-20T04:56:28.759 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:28 smithi135 ceph-mon[22342]: Adjusting osd_memory_target on smithi130 to 5696M 2024-08-20T04:56:28.759 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:28 smithi135 ceph-mon[22342]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-20T04:56:28.759 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:28 smithi135 ceph-mon[22342]: osdmap e46: 8 total, 7 up, 8 in 2024-08-20T04:56:28.759 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T04:56:28.759 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T04:56:28.759 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:56:28.759 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:56:28.759 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:29.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:28 smithi037 ceph-mon[17265]: Detected new or changed devices on smithi130 2024-08-20T04:56:29.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:28 smithi037 ceph-mon[17265]: Adjusting osd_memory_target on smithi130 to 5696M 2024-08-20T04:56:29.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:28 smithi037 ceph-mon[17265]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-20T04:56:29.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:28 smithi037 ceph-mon[17265]: osdmap e46: 8 total, 7 up, 8 in 2024-08-20T04:56:29.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T04:56:29.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T04:56:29.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:56:29.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:56:29.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:29.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:28 smithi130 ceph-mon[22007]: Detected new or changed devices on smithi130 2024-08-20T04:56:29.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:28 smithi130 ceph-mon[22007]: Adjusting osd_memory_target on smithi130 to 5696M 2024-08-20T04:56:29.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:28 smithi130 ceph-mon[22007]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-20T04:56:29.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:28 smithi130 ceph-mon[22007]: osdmap e46: 8 total, 7 up, 8 in 2024-08-20T04:56:29.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T04:56:29.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T04:56:29.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:56:29.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:56:29.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:29.958 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:29 smithi135 ceph-mon[22342]: purged_snaps scrub starts 2024-08-20T04:56:29.958 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:29 smithi135 ceph-mon[22342]: purged_snaps scrub ok 2024-08-20T04:56:29.958 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:29 smithi135 ceph-mon[22342]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:29.958 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:29 smithi135 ceph-mon[22342]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:56:29.958 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:29 smithi135 ceph-mon[22342]: osd.7 [v2:172.21.15.130:6816/4148130245,v1:172.21.15.130:6817/4148130245] boot 2024-08-20T04:56:29.959 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:29 smithi135 ceph-mon[22342]: osdmap e47: 8 total, 8 up, 8 in 2024-08-20T04:56:29.959 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T04:56:29.959 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:29 smithi135 ceph-mon[22342]: osdmap e48: 8 total, 8 up, 8 in 2024-08-20T04:56:30.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:29 smithi037 ceph-mon[17265]: purged_snaps scrub starts 2024-08-20T04:56:30.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:29 smithi037 ceph-mon[17265]: purged_snaps scrub ok 2024-08-20T04:56:30.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:29 smithi037 ceph-mon[17265]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:30.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:29 smithi037 ceph-mon[17265]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:56:30.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:29 smithi037 ceph-mon[17265]: osd.7 [v2:172.21.15.130:6816/4148130245,v1:172.21.15.130:6817/4148130245] boot 2024-08-20T04:56:30.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:29 smithi037 ceph-mon[17265]: osdmap e47: 8 total, 8 up, 8 in 2024-08-20T04:56:30.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T04:56:30.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:29 smithi037 ceph-mon[17265]: osdmap e48: 8 total, 8 up, 8 in 2024-08-20T04:56:30.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:29 smithi130 ceph-mon[22007]: purged_snaps scrub starts 2024-08-20T04:56:30.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:29 smithi130 ceph-mon[22007]: purged_snaps scrub ok 2024-08-20T04:56:30.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:29 smithi130 ceph-mon[22007]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 201 MiB used, 626 GiB / 626 GiB avail 2024-08-20T04:56:30.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:29 smithi130 ceph-mon[22007]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:56:30.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:29 smithi130 ceph-mon[22007]: osd.7 [v2:172.21.15.130:6816/4148130245,v1:172.21.15.130:6817/4148130245] boot 2024-08-20T04:56:30.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:29 smithi130 ceph-mon[22007]: osdmap e47: 8 total, 8 up, 8 in 2024-08-20T04:56:30.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-08-20T04:56:30.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:29 smithi130 ceph-mon[22007]: osdmap e48: 8 total, 8 up, 8 in 2024-08-20T04:56:31.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:30 smithi037 ceph-mon[17265]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:31.184 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:30 smithi037 ceph-mon[17265]: from='client.? 172.21.15.135:0/3747331719' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a7d4c9c8-1826-4703-92ad-ded2800b4780"} : dispatch 2024-08-20T04:56:31.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:30 smithi037 ceph-mon[17265]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a7d4c9c8-1826-4703-92ad-ded2800b4780"} : dispatch 2024-08-20T04:56:31.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:30 smithi037 ceph-mon[17265]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a7d4c9c8-1826-4703-92ad-ded2800b4780"}]': finished 2024-08-20T04:56:31.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:30 smithi037 ceph-mon[17265]: osdmap e49: 9 total, 8 up, 9 in 2024-08-20T04:56:31.185 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:31.186 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:30 smithi135 ceph-mon[22342]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:31.186 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:30 smithi135 ceph-mon[22342]: from='client.? 172.21.15.135:0/3747331719' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a7d4c9c8-1826-4703-92ad-ded2800b4780"} : dispatch 2024-08-20T04:56:31.186 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:30 smithi135 ceph-mon[22342]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a7d4c9c8-1826-4703-92ad-ded2800b4780"} : dispatch 2024-08-20T04:56:31.186 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:30 smithi135 ceph-mon[22342]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a7d4c9c8-1826-4703-92ad-ded2800b4780"}]': finished 2024-08-20T04:56:31.186 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:30 smithi135 ceph-mon[22342]: osdmap e49: 9 total, 8 up, 9 in 2024-08-20T04:56:31.186 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:31.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:30 smithi130 ceph-mon[22007]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:31.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:30 smithi130 ceph-mon[22007]: from='client.? 172.21.15.135:0/3747331719' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a7d4c9c8-1826-4703-92ad-ded2800b4780"} : dispatch 2024-08-20T04:56:31.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:30 smithi130 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a7d4c9c8-1826-4703-92ad-ded2800b4780"} : dispatch 2024-08-20T04:56:31.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:30 smithi130 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a7d4c9c8-1826-4703-92ad-ded2800b4780"}]': finished 2024-08-20T04:56:31.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:30 smithi130 ceph-mon[22007]: osdmap e49: 9 total, 8 up, 9 in 2024-08-20T04:56:31.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:32.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:31 smithi037 ceph-mon[17265]: from='client.? 172.21.15.135:0/468430892' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:56:32.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:31 smithi135 ceph-mon[22342]: from='client.? 172.21.15.135:0/468430892' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:56:32.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:31 smithi130 ceph-mon[22007]: from='client.? 172.21.15.135:0/468430892' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:56:33.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:32 smithi037 ceph-mon[17265]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:33.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:32 smithi135 ceph-mon[22342]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:33.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:32 smithi130 ceph-mon[22007]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:35.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:34 smithi135 ceph-mon[22342]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T04:56:35.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:34 smithi037 ceph-mon[17265]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T04:56:35.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:34 smithi130 ceph-mon[22007]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T04:56:37.255 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:36 smithi135 ceph-mon[22342]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-08-20T04:56:37.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:36 smithi037 ceph-mon[17265]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-08-20T04:56:37.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:36 smithi130 ceph-mon[22007]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-08-20T04:56:39.253 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:39 smithi135 ceph-mon[22342]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-08-20T04:56:39.253 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-20T04:56:39.253 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:39.253 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:39 smithi135 ceph-mon[22342]: Deploying daemon osd.8 on smithi135 2024-08-20T04:56:39.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:39 smithi037 ceph-mon[17265]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-08-20T04:56:39.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-20T04:56:39.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:39.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:39 smithi037 ceph-mon[17265]: Deploying daemon osd.8 on smithi135 2024-08-20T04:56:39.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:39 smithi130 ceph-mon[22007]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-08-20T04:56:39.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-08-20T04:56:39.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:39.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:39 smithi130 ceph-mon[22007]: Deploying daemon osd.8 on smithi135 2024-08-20T04:56:41.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:41 smithi037 ceph-mon[17265]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-20T04:56:41.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:41 smithi135 ceph-mon[22342]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-20T04:56:41.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:41 smithi130 ceph-mon[22007]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-20T04:56:43.254 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:43 smithi135 ceph-mon[22342]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-08-20T04:56:43.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:43 smithi037 ceph-mon[17265]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-08-20T04:56:43.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:43 smithi130 ceph-mon[22007]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-08-20T04:56:45.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:45 smithi037 ceph-mon[17265]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T04:56:45.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:56:45.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:45.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:45 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:45.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:45 smithi135 ceph-mon[22342]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T04:56:45.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:56:45.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:45.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:45 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:45.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:45 smithi130 ceph-mon[22007]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T04:56:45.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:56:45.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:45.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:45 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:47.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:47 smithi037 ceph-mon[17265]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:47.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:47.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:47.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:47.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:56:47.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:47.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:47 smithi135 ceph-mon[22342]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:47.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:47.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:47.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:47.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:56:47.281 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:47.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:47 smithi130 ceph-mon[22007]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:47.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:47.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:47.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:47.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:56:47.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:47.905 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:47.901+0000 7f928cff9640 1 -- 172.21.15.135:0/1229398995 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f92901a13d0 con 0x7f927c0b3c50 2024-08-20T04:56:47.906 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 8 on host 'smithi135' 2024-08-20T04:56:47.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:47.904+0000 7f929570c640 1 -- 172.21.15.135:0/1229398995 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f927c0b3c50 msgr2=0x7f927c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:56:47.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:47.904+0000 7f929570c640 1 --2- 172.21.15.135:0/1229398995 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f927c0b3c50 0x7f927c0b6110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9280005ec0 tx=0x7f9280005d50 comp rx=0 tx=0).stop 2024-08-20T04:56:47.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:47.904+0000 7f929570c640 1 -- 172.21.15.135:0/1229398995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9290103130 msgr2=0x7f9290199dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:56:47.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:47.904+0000 7f929570c640 1 --2- 172.21.15.135:0/1229398995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9290103130 0x7f9290199dc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f928800eaa0 tx=0x7f928800ef60 comp rx=0 tx=0).stop 2024-08-20T04:56:47.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:47.904+0000 7f929570c640 1 -- 172.21.15.135:0/1229398995 shutdown_connections 2024-08-20T04:56:47.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:47.904+0000 7f929570c640 1 --2- 172.21.15.135:0/1229398995 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f927c0b3c50 0x7f927c0b6110 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:47.907 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:47.904+0000 7f929570c640 1 --2- 172.21.15.135:0/1229398995 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9290103130 0x7f9290199dc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:47.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:47.904+0000 7f929570c640 1 --2- 172.21.15.135:0/1229398995 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9290102770 0x7f9290199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:47.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:47.904+0000 7f929570c640 1 --2- 172.21.15.135:0/1229398995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9290101610 0x7f9290198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:47.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:47.904+0000 7f929570c640 1 -- 172.21.15.135:0/1229398995 >> 172.21.15.135:0/1229398995 conn(0x7f92900fcee0 msgr2=0x7f929006a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:56:47.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:47.904+0000 7f929570c640 1 -- 172.21.15.135:0/1229398995 shutdown_connections 2024-08-20T04:56:47.908 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:56:47.904+0000 7f929570c640 1 -- 172.21.15.135:0/1229398995 wait complete. 2024-08-20T04:56:48.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:48 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:56:48.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:48 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:48.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:48 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:48.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:48 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:56:48.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:48 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:48.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:48 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:48.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:48 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:56:48.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:48 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:48.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:48 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:48.594 DEBUG:teuthology.orchestra.run.smithi135:osd.8> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.8.service 2024-08-20T04:56:48.596 INFO:tasks.cephadm:Deploying osd.9 on smithi037 with /dev/vg_nvme/lv_1... 2024-08-20T04:56:48.596 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-20T04:56:48.980 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:56:49.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:49 smithi135 ceph-mon[22342]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:49.292 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:49 smithi037 ceph-mon[17265]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:49.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:49 smithi130 ceph-mon[22007]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:50.366 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 04:56:50 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T04:56:50.204+0000 7fc6b4588640 -1 osd.8 0 log_to_monitors true 2024-08-20T04:56:51.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:51 smithi135 ceph-mon[22342]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:51.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:51 smithi135 ceph-mon[22342]: from='osd.8 [v2:172.21.15.135:6816/222884649,v1:172.21.15.135:6817/222884649]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T04:56:51.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:51 smithi135 ceph-mon[22342]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T04:56:51.436 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:51 smithi037 ceph-mon[17265]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:51.437 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:51 smithi037 ceph-mon[17265]: from='osd.8 [v2:172.21.15.135:6816/222884649,v1:172.21.15.135:6817/222884649]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T04:56:51.437 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:51 smithi037 ceph-mon[17265]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T04:56:51.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:51 smithi130 ceph-mon[22007]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:51.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:51 smithi130 ceph-mon[22007]: from='osd.8 [v2:172.21.15.135:6816/222884649,v1:172.21.15.135:6817/222884649]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T04:56:51.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:51 smithi130 ceph-mon[22007]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-08-20T04:56:52.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-mon[22342]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-20T04:56:52.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-mon[22342]: from='osd.8 [v2:172.21.15.135:6816/222884649,v1:172.21.15.135:6817/222884649]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:56:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-mon[22342]: osdmap e50: 9 total, 8 up, 9 in 2024-08-20T04:56:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-mon[22342]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:56:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-mon[22342]: Detected new or changed devices on smithi135 2024-08-20T04:56:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-mon[22342]: Adjusting osd_memory_target on smithi135 to 1938M 2024-08-20T04:56:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:52.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:52.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:56:52.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:52.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:52 smithi130 ceph-mon[22007]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-20T04:56:52.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:52 smithi130 ceph-mon[22007]: from='osd.8 [v2:172.21.15.135:6816/222884649,v1:172.21.15.135:6817/222884649]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:56:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:52 smithi130 ceph-mon[22007]: osdmap e50: 9 total, 8 up, 9 in 2024-08-20T04:56:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:52 smithi130 ceph-mon[22007]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:56:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:52 smithi130 ceph-mon[22007]: Detected new or changed devices on smithi135 2024-08-20T04:56:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:52 smithi130 ceph-mon[22007]: Adjusting osd_memory_target on smithi135 to 1938M 2024-08-20T04:56:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:52.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:52.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:56:52.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:52 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:52.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:52 smithi037 ceph-mon[17265]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-20T04:56:52.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:52 smithi037 ceph-mon[17265]: from='osd.8 [v2:172.21.15.135:6816/222884649,v1:172.21.15.135:6817/222884649]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:56:52.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:52 smithi037 ceph-mon[17265]: osdmap e50: 9 total, 8 up, 9 in 2024-08-20T04:56:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:52 smithi037 ceph-mon[17265]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:56:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:52 smithi037 ceph-mon[17265]: Detected new or changed devices on smithi135 2024-08-20T04:56:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T04:56:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:52 smithi037 ceph-mon[17265]: Adjusting osd_memory_target on smithi135 to 1938M 2024-08-20T04:56:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:56:52.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:52 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:56:52.578 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:56:52.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_1 2024-08-20T04:56:52.932 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T04:56:52.673+0000 7fc6b050b640 -1 osd.8 0 waiting for initial osdmap 2024-08-20T04:56:52.932 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 04:56:52 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T04:56:52.681+0000 7fc6a832a640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T04:56:53.002 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:56:53.328 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:53 smithi037 ceph-mon[17265]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:53.328 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:53 smithi037 ceph-mon[17265]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-08-20T04:56:53.328 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:53 smithi037 ceph-mon[17265]: osdmap e51: 9 total, 8 up, 9 in 2024-08-20T04:56:53.329 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:53 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:53.329 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:53 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:53.329 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:53 smithi037 ceph-mon[17265]: from='osd.8 ' entity='osd.8' 2024-08-20T04:56:53.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:53 smithi135 ceph-mon[22342]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:53.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:53 smithi135 ceph-mon[22342]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-08-20T04:56:53.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:53 smithi135 ceph-mon[22342]: osdmap e51: 9 total, 8 up, 9 in 2024-08-20T04:56:53.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:53 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:53.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:53 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:53.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:53 smithi135 ceph-mon[22342]: from='osd.8 ' entity='osd.8' 2024-08-20T04:56:53.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:53 smithi130 ceph-mon[22007]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:53.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:53 smithi130 ceph-mon[22007]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-08-20T04:56:53.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:53 smithi130 ceph-mon[22007]: osdmap e51: 9 total, 8 up, 9 in 2024-08-20T04:56:53.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:53 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:53.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:53 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:53.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:53 smithi130 ceph-mon[22007]: from='osd.8 ' entity='osd.8' 2024-08-20T04:56:53.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.598+0000 7ff9a2e00640 1 -- 172.21.15.37:0/1670310772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff99c075850 msgr2=0x7ff99c075cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:56:53.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.598+0000 7ff9a2e00640 1 --2- 172.21.15.37:0/1670310772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff99c075850 0x7ff99c075cd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff988009900 tx=0x7ff98802a410 comp rx=0 tx=0).stop 2024-08-20T04:56:53.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.598+0000 7ff9a2e00640 1 -- 172.21.15.37:0/1670310772 shutdown_connections 2024-08-20T04:56:53.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.598+0000 7ff9a2e00640 1 --2- 172.21.15.37:0/1670310772 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff99c10a660 0x7ff99c10cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:53.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.598+0000 7ff9a2e00640 1 --2- 172.21.15.37:0/1670310772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff99c075850 0x7ff99c075cd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:53.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.598+0000 7ff9a2e00640 1 --2- 172.21.15.37:0/1670310772 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff99c076cb0 0x7ff99c075310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:53.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.598+0000 7ff9a2e00640 1 -- 172.21.15.37:0/1670310772 >> 172.21.15.37:0/1670310772 conn(0x7ff99c0fe020 msgr2=0x7ff99c100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:56:53.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.599+0000 7ff9a2e00640 1 -- 172.21.15.37:0/1670310772 shutdown_connections 2024-08-20T04:56:53.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.599+0000 7ff9a2e00640 1 -- 172.21.15.37:0/1670310772 wait complete. 2024-08-20T04:56:53.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.600+0000 7ff9a2e00640 1 Processor -- start 2024-08-20T04:56:53.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.600+0000 7ff9a2e00640 1 -- start start 2024-08-20T04:56:53.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.600+0000 7ff9a2e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff99c075850 0x7ff99c19ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:56:53.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.600+0000 7ff9a2e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff99c076cb0 0x7ff99c19b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:56:53.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.600+0000 7ff9a2e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff99c10a660 0x7ff99c19bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:56:53.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.600+0000 7ff9a2e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c1105c0 con 0x7ff99c076cb0 2024-08-20T04:56:53.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.600+0000 7ff9a2e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c110440 con 0x7ff99c075850 2024-08-20T04:56:53.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.600+0000 7ff9a2e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c110740 con 0x7ff99c10a660 2024-08-20T04:56:53.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.600+0000 7ff99b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff99c076cb0 0x7ff99c19b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:56:53.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.600+0000 7ff99be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff99c075850 0x7ff99c19ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:56:53.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.600+0000 7ff9a0e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff99c10a660 0x7ff99c19bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:56:53.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.600+0000 7ff99be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff99c075850 0x7ff99c19ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43396/0 (socket says 172.21.15.37:43396) 2024-08-20T04:56:53.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.600+0000 7ff99be00640 1 -- 172.21.15.37:0/1908805867 learned_addr learned my addr 172.21.15.37:0/1908805867 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:56:53.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.601+0000 7ff99be00640 1 -- 172.21.15.37:0/1908805867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff99c10a660 msgr2=0x7ff99c19bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:56:53.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.601+0000 7ff99be00640 1 --2- 172.21.15.37:0/1908805867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff99c10a660 0x7ff99c19bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:53.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.601+0000 7ff99be00640 1 -- 172.21.15.37:0/1908805867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff99c076cb0 msgr2=0x7ff99c19b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:56:53.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.601+0000 7ff99be00640 1 --2- 172.21.15.37:0/1908805867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff99c076cb0 0x7ff99c19b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:56:53.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.601+0000 7ff99be00640 1 -- 172.21.15.37:0/1908805867 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99c19c840 con 0x7ff99c075850 2024-08-20T04:56:53.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.601+0000 7ff9a0e00640 1 --2- 172.21.15.37:0/1908805867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff99c10a660 0x7ff99c19bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:56:53.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.601+0000 7ff99be00640 1 --2- 172.21.15.37:0/1908805867 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff99c075850 0x7ff99c19ad10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00e9f0 tx=0x7ff98c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:56:53.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.601+0000 7ff998c00640 1 -- 172.21.15.37:0/1908805867 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c00ccc0 con 0x7ff99c075850 2024-08-20T04:56:53.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.601+0000 7ff9a2e00640 1 -- 172.21.15.37:0/1908805867 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff99c19cb30 con 0x7ff99c075850 2024-08-20T04:56:53.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.601+0000 7ff998c00640 1 -- 172.21.15.37:0/1908805867 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff98c0108e0 con 0x7ff99c075850 2024-08-20T04:56:53.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.602+0000 7ff998c00640 1 -- 172.21.15.37:0/1908805867 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98c018880 con 0x7ff99c075850 2024-08-20T04:56:53.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.602+0000 7ff9a2e00640 1 -- 172.21.15.37:0/1908805867 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff99c1a3210 con 0x7ff99c075850 2024-08-20T04:56:53.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.603+0000 7ff9a2e00640 1 -- 172.21.15.37:0/1908805867 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff99c1a33e0 con 0x7ff99c075850 2024-08-20T04:56:53.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.605+0000 7ff998c00640 1 -- 172.21.15.37:0/1908805867 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7ff98c010430 con 0x7ff99c075850 2024-08-20T04:56:53.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.606+0000 7ff998c00640 1 --2- 172.21.15.37:0/1908805867 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9800b3bd0 0x7ff9800b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:56:53.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.607+0000 7ff998c00640 1 -- 172.21.15.37:0/1908805867 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5862+0+0 (secure 0 0 0) 0x7ff98c0e3b50 con 0x7ff99c075850 2024-08-20T04:56:53.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.607+0000 7ff99b400640 1 --2- 172.21.15.37:0/1908805867 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9800b3bd0 0x7ff9800b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:56:53.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.607+0000 7ff99b400640 1 --2- 172.21.15.37:0/1908805867 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9800b3bd0 0x7ff9800b6090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff988031500 tx=0x7ff988005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:56:53.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.608+0000 7ff998c00640 1 -- 172.21.15.37:0/1908805867 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff98c0aba90 con 0x7ff99c075850 2024-08-20T04:56:53.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:56:53.812+0000 7ff9a2e00640 1 -- 172.21.15.37:0/1908805867 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff99c0fed50 con 0x7ff9800b3bd0 2024-08-20T04:56:54.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:54 smithi135 ceph-mon[22342]: purged_snaps scrub starts 2024-08-20T04:56:54.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:54 smithi135 ceph-mon[22342]: purged_snaps scrub ok 2024-08-20T04:56:54.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:54 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:54.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:54 smithi135 ceph-mon[22342]: osd.8 [v2:172.21.15.135:6816/222884649,v1:172.21.15.135:6817/222884649] boot 2024-08-20T04:56:54.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:54 smithi135 ceph-mon[22342]: osdmap e52: 9 total, 9 up, 9 in 2024-08-20T04:56:54.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:54 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:54.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:54 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:56:54.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:54 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:56:54.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:54 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:54.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:54 smithi037 ceph-mon[17265]: purged_snaps scrub starts 2024-08-20T04:56:54.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:54 smithi037 ceph-mon[17265]: purged_snaps scrub ok 2024-08-20T04:56:54.414 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:54 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:54.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:54 smithi037 ceph-mon[17265]: osd.8 [v2:172.21.15.135:6816/222884649,v1:172.21.15.135:6817/222884649] boot 2024-08-20T04:56:54.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:54 smithi037 ceph-mon[17265]: osdmap e52: 9 total, 9 up, 9 in 2024-08-20T04:56:54.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:54 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:54.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:54 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:56:54.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:54 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:56:54.415 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:54 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:54.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:54 smithi130 ceph-mon[22007]: purged_snaps scrub starts 2024-08-20T04:56:54.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:54 smithi130 ceph-mon[22007]: purged_snaps scrub ok 2024-08-20T04:56:54.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:54 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:54.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:54 smithi130 ceph-mon[22007]: osd.8 [v2:172.21.15.135:6816/222884649,v1:172.21.15.135:6817/222884649] boot 2024-08-20T04:56:54.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:54 smithi130 ceph-mon[22007]: osdmap e52: 9 total, 9 up, 9 in 2024-08-20T04:56:54.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:54 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-08-20T04:56:54.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:54 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:56:54.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:54 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:56:54.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:54 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:56:55.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:55 smithi135 ceph-mon[22342]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:56:55.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:55 smithi135 ceph-mon[22342]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:55.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:55 smithi135 ceph-mon[22342]: osdmap e53: 9 total, 9 up, 9 in 2024-08-20T04:56:55.436 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:55 smithi037 ceph-mon[17265]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:56:55.436 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:55 smithi037 ceph-mon[17265]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:55.437 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:55 smithi037 ceph-mon[17265]: osdmap e53: 9 total, 9 up, 9 in 2024-08-20T04:56:55.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:55 smithi130 ceph-mon[22007]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:56:55.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:55 smithi130 ceph-mon[22007]: pgmap v205: 1 pgs: 1 remapped+peering; 577 KiB data, 229 MiB used, 715 GiB / 715 GiB avail 2024-08-20T04:56:55.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:55 smithi130 ceph-mon[22007]: osdmap e53: 9 total, 9 up, 9 in 2024-08-20T04:56:56.236 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:56 smithi037 ceph-mon[17265]: osdmap e54: 9 total, 9 up, 9 in 2024-08-20T04:56:56.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:56 smithi135 ceph-mon[22342]: osdmap e54: 9 total, 9 up, 9 in 2024-08-20T04:56:56.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:56 smithi130 ceph-mon[22007]: osdmap e54: 9 total, 9 up, 9 in 2024-08-20T04:56:57.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:57 smithi135 ceph-mon[22342]: pgmap v208: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:56:57.401 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:57 smithi037 ceph-mon[17265]: pgmap v208: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:56:57.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:57 smithi130 ceph-mon[22007]: pgmap v208: 1 pgs: 1 remapped+peering; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:56:58.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:58 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1979615249' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f9e0c194-66b5-4e62-b2ae-816a4a4fffbb"} : dispatch 2024-08-20T04:56:58.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:58 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1979615249' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9e0c194-66b5-4e62-b2ae-816a4a4fffbb"}]': finished 2024-08-20T04:56:58.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:58 smithi135 ceph-mon[22342]: osdmap e55: 10 total, 9 up, 10 in 2024-08-20T04:56:58.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:58 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:56:58.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:58 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/705195404' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:56:58.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:58 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1979615249' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f9e0c194-66b5-4e62-b2ae-816a4a4fffbb"} : dispatch 2024-08-20T04:56:58.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:58 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1979615249' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9e0c194-66b5-4e62-b2ae-816a4a4fffbb"}]': finished 2024-08-20T04:56:58.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:58 smithi130 ceph-mon[22007]: osdmap e55: 10 total, 9 up, 10 in 2024-08-20T04:56:58.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:58 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:56:58.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:58 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/705195404' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:56:58.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:58 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1979615249' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f9e0c194-66b5-4e62-b2ae-816a4a4fffbb"} : dispatch 2024-08-20T04:56:58.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:58 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1979615249' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9e0c194-66b5-4e62-b2ae-816a4a4fffbb"}]': finished 2024-08-20T04:56:58.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:58 smithi037 ceph-mon[17265]: osdmap e55: 10 total, 9 up, 10 in 2024-08-20T04:56:58.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:58 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:56:58.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:58 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/705195404' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:56:59.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:56:59 smithi135 ceph-mon[22342]: pgmap v210: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:56:59.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:56:59 smithi130 ceph-mon[22007]: pgmap v210: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:56:59.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:56:59 smithi037 ceph-mon[17265]: pgmap v210: 1 pgs: 1 remapped+peering; 577 KiB data, 259 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:01.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:01 smithi135 ceph-mon[22342]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T04:57:01.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:01 smithi130 ceph-mon[22007]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T04:57:01.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:01 smithi037 ceph-mon[17265]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T04:57:03.364 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:03 smithi037 ceph-mon[17265]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-08-20T04:57:03.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:03 smithi135 ceph-mon[22342]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-08-20T04:57:03.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:03 smithi130 ceph-mon[22007]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-08-20T04:57:05.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:05 smithi037 ceph-mon[17265]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-08-20T04:57:05.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:05 smithi135 ceph-mon[22342]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-08-20T04:57:05.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:05 smithi130 ceph-mon[22007]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-08-20T04:57:07.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:07 smithi135 ceph-mon[22342]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-20T04:57:07.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:07 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-20T04:57:07.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:07 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:07.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:07 smithi135 ceph-mon[22342]: Deploying daemon osd.9 on smithi037 2024-08-20T04:57:07.446 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:07 smithi037 ceph-mon[17265]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-20T04:57:07.446 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:07 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-20T04:57:07.447 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:07 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:07.447 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:07 smithi037 ceph-mon[17265]: Deploying daemon osd.9 on smithi037 2024-08-20T04:57:07.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:07 smithi130 ceph-mon[22007]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-08-20T04:57:07.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:07 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-08-20T04:57:07.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:07 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:07.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:07 smithi130 ceph-mon[22007]: Deploying daemon osd.9 on smithi037 2024-08-20T04:57:09.357 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:09 smithi037 ceph-mon[17265]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-20T04:57:09.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:09 smithi135 ceph-mon[22342]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-20T04:57:09.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:09 smithi130 ceph-mon[22007]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-20T04:57:11.189 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:11 smithi037 ceph-mon[17265]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T04:57:11.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:11 smithi135 ceph-mon[22342]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T04:57:11.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:11 smithi130 ceph-mon[22007]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T04:57:13.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:13 smithi037 ceph-mon[17265]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:13.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:13 smithi135 ceph-mon[22342]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:13.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:13 smithi130 ceph-mon[22007]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:14.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:57:14.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:14.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:14.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:57:14.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:14.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:14.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:14 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:57:14.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:14 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:14.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:14 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:15.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:15 smithi037 ceph-mon[17265]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:15 smithi135 ceph-mon[22342]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:15.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:15 smithi130 ceph-mon[22007]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:17 smithi037 ceph-mon[17265]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:17 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:17 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:17 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:17 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:57:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:17 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:17.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:17 smithi135 ceph-mon[22342]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:17.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:17 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:17 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:17 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:17 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:57:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:17 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:17 smithi130 ceph-mon[22007]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:17 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:17 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:17 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:17 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:57:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:17 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:18.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:57:18.091+0000 7ff998c00640 1 -- 172.21.15.37:0/1908805867 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff99c0fed50 con 0x7ff9800b3bd0 2024-08-20T04:57:18.093 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 9 on host 'smithi037' 2024-08-20T04:57:18.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:57:18.093+0000 7ff9a2e00640 1 -- 172.21.15.37:0/1908805867 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9800b3bd0 msgr2=0x7ff9800b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:57:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:57:18.093+0000 7ff9a2e00640 1 --2- 172.21.15.37:0/1908805867 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9800b3bd0 0x7ff9800b6090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff988031500 tx=0x7ff988005a20 comp rx=0 tx=0).stop 2024-08-20T04:57:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:57:18.093+0000 7ff9a2e00640 1 -- 172.21.15.37:0/1908805867 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff99c075850 msgr2=0x7ff99c19ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:57:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:57:18.093+0000 7ff9a2e00640 1 --2- 172.21.15.37:0/1908805867 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff99c075850 0x7ff99c19ad10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00e9f0 tx=0x7ff98c00edf0 comp rx=0 tx=0).stop 2024-08-20T04:57:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:57:18.093+0000 7ff9a2e00640 1 -- 172.21.15.37:0/1908805867 shutdown_connections 2024-08-20T04:57:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:57:18.094+0000 7ff9a2e00640 1 --2- 172.21.15.37:0/1908805867 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9800b3bd0 0x7ff9800b6090 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:57:18.094+0000 7ff9a2e00640 1 --2- 172.21.15.37:0/1908805867 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff99c10a660 0x7ff99c19bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:57:18.094+0000 7ff9a2e00640 1 --2- 172.21.15.37:0/1908805867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff99c076cb0 0x7ff99c19b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:57:18.094+0000 7ff9a2e00640 1 --2- 172.21.15.37:0/1908805867 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff99c075850 0x7ff99c19ad10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:57:18.094+0000 7ff9a2e00640 1 -- 172.21.15.37:0/1908805867 >> 172.21.15.37:0/1908805867 conn(0x7ff99c0fe020 msgr2=0x7ff99c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:57:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:57:18.094+0000 7ff9a2e00640 1 -- 172.21.15.37:0/1908805867 shutdown_connections 2024-08-20T04:57:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:57:18.094+0000 7ff9a2e00640 1 -- 172.21.15.37:0/1908805867 wait complete. 2024-08-20T04:57:18.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:18 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:57:18.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:18 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:18.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:18 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:18.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:18 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:57:18.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:18 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:18.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:18 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:18.899 DEBUG:teuthology.orchestra.run.smithi037:osd.9> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.9.service 2024-08-20T04:57:18.903 INFO:tasks.cephadm:Deploying osd.10 on smithi130 with /dev/vg_nvme/lv_1... 2024-08-20T04:57:18.904 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-20T04:57:18.929 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:57:18.930 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:18.930 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:18 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:19.153 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T04:57:19.490 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 04:57:19 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T04:57:19.414+0000 7fc0a5241640 -1 osd.9 0 log_to_monitors true 2024-08-20T04:57:19.525 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:19 smithi130 ceph-mon[22007]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:19.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:19 smithi130 ceph-mon[22007]: from='osd.9 [v2:172.21.15.37:6826/2240773042,v1:172.21.15.37:6827/2240773042]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-20T04:57:19.526 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:19 smithi130 ceph-mon[22007]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-20T04:57:19.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:19 smithi037 ceph-mon[17265]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:19.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:19 smithi037 ceph-mon[17265]: from='osd.9 [v2:172.21.15.37:6826/2240773042,v1:172.21.15.37:6827/2240773042]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-20T04:57:19.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:19 smithi037 ceph-mon[17265]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-20T04:57:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:19 smithi135 ceph-mon[22342]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:19 smithi135 ceph-mon[22342]: from='osd.9 [v2:172.21.15.37:6826/2240773042,v1:172.21.15.37:6827/2240773042]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-20T04:57:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:19 smithi135 ceph-mon[22342]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-08-20T04:57:20.624 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:20 smithi130 ceph-mon[22007]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-20T04:57:20.624 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:20 smithi130 ceph-mon[22007]: osdmap e56: 10 total, 9 up, 10 in 2024-08-20T04:57:20.625 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:20 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:57:20.625 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:20 smithi130 ceph-mon[22007]: from='osd.9 [v2:172.21.15.37:6826/2240773042,v1:172.21.15.37:6827/2240773042]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-20T04:57:20.625 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:20 smithi130 ceph-mon[22007]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-20T04:57:20.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:20 smithi037 ceph-mon[17265]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-20T04:57:20.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:20 smithi037 ceph-mon[17265]: osdmap e56: 10 total, 9 up, 10 in 2024-08-20T04:57:20.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:20 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:57:20.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:20 smithi037 ceph-mon[17265]: from='osd.9 [v2:172.21.15.37:6826/2240773042,v1:172.21.15.37:6827/2240773042]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-20T04:57:20.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:20 smithi037 ceph-mon[17265]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-20T04:57:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:20 smithi135 ceph-mon[22342]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-20T04:57:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:20 smithi135 ceph-mon[22342]: osdmap e56: 10 total, 9 up, 10 in 2024-08-20T04:57:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:20 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:57:20.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:20 smithi135 ceph-mon[22342]: from='osd.9 [v2:172.21.15.37:6826/2240773042,v1:172.21.15.37:6827/2240773042]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-20T04:57:20.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:20 smithi135 ceph-mon[22342]: from='osd.9 ' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]} : dispatch 2024-08-20T04:57:21.688 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:21 smithi130 ceph-mon[22007]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:21.688 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:21 smithi130 ceph-mon[22007]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-20T04:57:21.688 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:21 smithi130 ceph-mon[22007]: osdmap e57: 10 total, 9 up, 10 in 2024-08-20T04:57:21.688 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:21 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:57:21.688 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:21 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:57:21.688 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:21 smithi130 ceph-mon[22007]: from='osd.9 ' entity='osd.9' 2024-08-20T04:57:21.691 INFO:teuthology.orchestra.run.smithi130.stdout: 2024-08-20T04:57:21.716 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi130:vg_nvme/lv_1 2024-08-20T04:57:21.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:21 smithi037 ceph-mon[17265]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:21.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:21 smithi037 ceph-mon[17265]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-20T04:57:21.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:21 smithi037 ceph-mon[17265]: osdmap e57: 10 total, 9 up, 10 in 2024-08-20T04:57:21.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:21 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:57:21.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:21 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:57:21.749 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:21 smithi037 ceph-mon[17265]: from='osd.9 ' entity='osd.9' 2024-08-20T04:57:21.749 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 04:57:21 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T04:57:21.273+0000 7fc0a0400640 -1 osd.9 0 waiting for initial osdmap 2024-08-20T04:57:21.749 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 04:57:21 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T04:57:21.297+0000 7fc095a00640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T04:57:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:21 smithi135 ceph-mon[22342]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:21 smithi135 ceph-mon[22342]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-08-20T04:57:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:21 smithi135 ceph-mon[22342]: osdmap e57: 10 total, 9 up, 10 in 2024-08-20T04:57:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:21 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:57:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:21 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:57:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:21 smithi135 ceph-mon[22342]: from='osd.9 ' entity='osd.9' 2024-08-20T04:57:21.999 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T04:57:22.466 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.456+0000 7fb5b0777640 1 -- 172.21.15.130:0/239428470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a8104260 msgr2=0x7fb5a810abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:57:22.466 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.456+0000 7fb5b0777640 1 --2- 172.21.15.130:0/239428470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a8104260 0x7fb5a810abe0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0009cd0 tx=0x7fb5a002a8e0 comp rx=0 tx=0).stop 2024-08-20T04:57:22.466 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.456+0000 7fb5b0777640 1 -- 172.21.15.130:0/239428470 shutdown_connections 2024-08-20T04:57:22.466 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.456+0000 7fb5b0777640 1 --2- 172.21.15.130:0/239428470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a8104260 0x7fb5a810abe0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:22.466 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.456+0000 7fb5b0777640 1 --2- 172.21.15.130:0/239428470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5a81038a0 0x7fb5a8103d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:22.466 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.456+0000 7fb5b0777640 1 --2- 172.21.15.130:0/239428470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a8102740 0x7fb5a8102b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:22.466 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.456+0000 7fb5b0777640 1 -- 172.21.15.130:0/239428470 >> 172.21.15.130:0/239428470 conn(0x7fb5a80fdff0 msgr2=0x7fb5a8100450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:57:22.466 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.456+0000 7fb5b0777640 1 -- 172.21.15.130:0/239428470 shutdown_connections 2024-08-20T04:57:22.467 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.456+0000 7fb5b0777640 1 -- 172.21.15.130:0/239428470 wait complete. 2024-08-20T04:57:22.467 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.457+0000 7fb5b0777640 1 Processor -- start 2024-08-20T04:57:22.467 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.457+0000 7fb5b0777640 1 -- start start 2024-08-20T04:57:22.467 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.457+0000 7fb5b0777640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a8102740 0x7fb5a8198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:57:22.467 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.457+0000 7fb5b0777640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a81038a0 0x7fb5a8199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:57:22.467 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.457+0000 7fb5b0777640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5a8104260 0x7fb5a8199dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:57:22.467 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.457+0000 7fb5b0777640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a810e3a0 con 0x7fb5a8104260 2024-08-20T04:57:22.467 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.457+0000 7fb5b0777640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a810e220 con 0x7fb5a81038a0 2024-08-20T04:57:22.467 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.457+0000 7fb5b0777640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a810e520 con 0x7fb5a8102740 2024-08-20T04:57:22.467 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.457+0000 7fb5add12640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a81038a0 0x7fb5a8199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:57:22.467 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.457+0000 7fb5add12640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a81038a0 0x7fb5a8199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.130:50282/0 (socket says 172.21.15.130:50282) 2024-08-20T04:57:22.467 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.457+0000 7fb5ae513640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a8102740 0x7fb5a8198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:57:22.468 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.457+0000 7fb5add12640 1 -- 172.21.15.130:0/3138350924 learned_addr learned my addr 172.21.15.130:0/3138350924 (peer_addr_for_me v2:172.21.15.130:0/0) 2024-08-20T04:57:22.468 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.457+0000 7fb5aed14640 1 --2- 172.21.15.130:0/3138350924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5a8104260 0x7fb5a8199dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:57:22.468 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.458+0000 7fb5add12640 1 -- 172.21.15.130:0/3138350924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a8102740 msgr2=0x7fb5a8198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:57:22.468 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.458+0000 7fb5add12640 1 --2- 172.21.15.130:0/3138350924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a8102740 0x7fb5a8198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:22.468 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.458+0000 7fb5add12640 1 -- 172.21.15.130:0/3138350924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5a8104260 msgr2=0x7fb5a8199dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:57:22.468 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.458+0000 7fb5add12640 1 --2- 172.21.15.130:0/3138350924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5a8104260 0x7fb5a8199dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:22.468 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.458+0000 7fb5add12640 1 -- 172.21.15.130:0/3138350924 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a819a660 con 0x7fb5a81038a0 2024-08-20T04:57:22.468 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.458+0000 7fb5aed14640 1 --2- 172.21.15.130:0/3138350924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5a8104260 0x7fb5a8199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T04:57:22.468 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.458+0000 7fb5add12640 1 --2- 172.21.15.130:0/3138350924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a81038a0 0x7fb5a8199180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb59800d950 tx=0x7fb59800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:57:22.468 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.458+0000 7fb59f7fe640 1 -- 172.21.15.130:0/3138350924 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598017070 con 0x7fb5a81038a0 2024-08-20T04:57:22.468 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.458+0000 7fb5b0777640 1 -- 172.21.15.130:0/3138350924 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a819a950 con 0x7fb5a81038a0 2024-08-20T04:57:22.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.458+0000 7fb59f7fe640 1 -- 172.21.15.130:0/3138350924 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb598009c30 con 0x7fb5a81038a0 2024-08-20T04:57:22.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.458+0000 7fb59f7fe640 1 -- 172.21.15.130:0/3138350924 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59800f620 con 0x7fb5a81038a0 2024-08-20T04:57:22.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.458+0000 7fb5b0777640 1 -- 172.21.15.130:0/3138350924 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a81a1030 con 0x7fb5a81038a0 2024-08-20T04:57:22.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.459+0000 7fb5b0777640 1 -- 172.21.15.130:0/3138350924 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a81099f0 con 0x7fb5a81038a0 2024-08-20T04:57:22.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.461+0000 7fb59f7fe640 1 -- 172.21.15.130:0/3138350924 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fb598005030 con 0x7fb5a81038a0 2024-08-20T04:57:22.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.462+0000 7fb59f7fe640 1 --2- 172.21.15.130:0/3138350924 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5940b3bd0 0x7fb5940b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:57:22.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.462+0000 7fb59f7fe640 1 -- 172.21.15.130:0/3138350924 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6261+0+0 (secure 0 0 0) 0x7fb5980e2fe0 con 0x7fb5a81038a0 2024-08-20T04:57:22.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.462+0000 7fb5ae513640 1 --2- 172.21.15.130:0/3138350924 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5940b3bd0 0x7fb5940b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:57:22.469 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.463+0000 7fb5ae513640 1 --2- 172.21.15.130:0/3138350924 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5940b3bd0 0x7fb5940b6090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400bbe0 tx=0x7fb5a400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:57:22.470 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.465+0000 7fb59f7fe640 1 -- 172.21.15.130:0/3138350924 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fb5980aae30 con 0x7fb5a81038a0 2024-08-20T04:57:22.653 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:22.652+0000 7fb5b0777640 1 -- 172.21.15.130:0/3138350924 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb5a80632c0 con 0x7fb5940b3bd0 2024-08-20T04:57:22.654 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:22 smithi130 ceph-mon[22007]: purged_snaps scrub starts 2024-08-20T04:57:22.654 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:22 smithi130 ceph-mon[22007]: purged_snaps scrub ok 2024-08-20T04:57:22.654 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:57:22.654 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:22 smithi130 ceph-mon[22007]: osd.9 [v2:172.21.15.37:6826/2240773042,v1:172.21.15.37:6827/2240773042] boot 2024-08-20T04:57:22.654 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:22 smithi130 ceph-mon[22007]: osdmap e58: 10 total, 10 up, 10 in 2024-08-20T04:57:22.654 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:57:22.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:22 smithi037 ceph-mon[17265]: purged_snaps scrub starts 2024-08-20T04:57:22.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:22 smithi037 ceph-mon[17265]: purged_snaps scrub ok 2024-08-20T04:57:22.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:57:22.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:22 smithi037 ceph-mon[17265]: osd.9 [v2:172.21.15.37:6826/2240773042,v1:172.21.15.37:6827/2240773042] boot 2024-08-20T04:57:22.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:22 smithi037 ceph-mon[17265]: osdmap e58: 10 total, 10 up, 10 in 2024-08-20T04:57:22.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:57:22.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:22 smithi135 ceph-mon[22342]: purged_snaps scrub starts 2024-08-20T04:57:22.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:22 smithi135 ceph-mon[22342]: purged_snaps scrub ok 2024-08-20T04:57:22.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:57:22.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:22 smithi135 ceph-mon[22342]: osd.9 [v2:172.21.15.37:6826/2240773042,v1:172.21.15.37:6827/2240773042] boot 2024-08-20T04:57:22.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:22 smithi135 ceph-mon[22342]: osdmap e58: 10 total, 10 up, 10 in 2024-08-20T04:57:22.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-08-20T04:57:23.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:23 smithi130 ceph-mon[22007]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:23.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:23 smithi130 ceph-mon[22007]: from='client.24500 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:57:23.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:57:23.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:57:23.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:23.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:23.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:23.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:23.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:23.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:23.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:23.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:23.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:23.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:57:23.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:23.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:23 smithi130 ceph-mon[22007]: osdmap e59: 10 total, 10 up, 10 in 2024-08-20T04:57:23.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:23 smithi037 ceph-mon[17265]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:23 smithi037 ceph-mon[17265]: from='client.24500 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:57:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:57:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:57:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:23.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:23.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:57:23.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:23.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:23 smithi037 ceph-mon[17265]: osdmap e59: 10 total, 10 up, 10 in 2024-08-20T04:57:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:23 smithi135 ceph-mon[22342]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 260 MiB used, 804 GiB / 805 GiB avail 2024-08-20T04:57:23.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:23 smithi135 ceph-mon[22342]: from='client.24500 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi130:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:57:23.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:57:23.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:57:23.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:23.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:23.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:23.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:23.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:23.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:23.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:23.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:23.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:23.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:57:23.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:23.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:23 smithi135 ceph-mon[22342]: osdmap e59: 10 total, 10 up, 10 in 2024-08-20T04:57:24.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:24 smithi130 ceph-mon[22007]: Detected new or changed devices on smithi037 2024-08-20T04:57:24.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:24 smithi130 ceph-mon[22007]: Adjusting osd_memory_target on smithi037 to 4273M 2024-08-20T04:57:24.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:24 smithi135 ceph-mon[22342]: Detected new or changed devices on smithi037 2024-08-20T04:57:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:24 smithi135 ceph-mon[22342]: Adjusting osd_memory_target on smithi037 to 4273M 2024-08-20T04:57:25.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:24 smithi037 ceph-mon[17265]: Detected new or changed devices on smithi037 2024-08-20T04:57:25.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:24 smithi037 ceph-mon[17265]: Adjusting osd_memory_target on smithi037 to 4273M 2024-08-20T04:57:25.648 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:25 smithi130 ceph-mon[22007]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:25.648 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:25 smithi130 ceph-mon[22007]: from='client.? 172.21.15.130:0/485320568' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fa6a50a5-2b97-42d1-9b57-b5502b7083d9"} : dispatch 2024-08-20T04:57:25.649 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:25 smithi130 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fa6a50a5-2b97-42d1-9b57-b5502b7083d9"} : dispatch 2024-08-20T04:57:25.649 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:25 smithi130 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa6a50a5-2b97-42d1-9b57-b5502b7083d9"}]': finished 2024-08-20T04:57:25.649 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:25 smithi130 ceph-mon[22007]: osdmap e60: 11 total, 10 up, 11 in 2024-08-20T04:57:25.649 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:25 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:25.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:25 smithi135 ceph-mon[22342]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:25.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:25 smithi135 ceph-mon[22342]: from='client.? 172.21.15.130:0/485320568' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fa6a50a5-2b97-42d1-9b57-b5502b7083d9"} : dispatch 2024-08-20T04:57:25.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:25 smithi135 ceph-mon[22342]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fa6a50a5-2b97-42d1-9b57-b5502b7083d9"} : dispatch 2024-08-20T04:57:25.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:25 smithi135 ceph-mon[22342]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa6a50a5-2b97-42d1-9b57-b5502b7083d9"}]': finished 2024-08-20T04:57:25.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:25 smithi135 ceph-mon[22342]: osdmap e60: 11 total, 10 up, 11 in 2024-08-20T04:57:25.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:25 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:25 smithi037 ceph-mon[17265]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 291 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:25 smithi037 ceph-mon[17265]: from='client.? 172.21.15.130:0/485320568' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fa6a50a5-2b97-42d1-9b57-b5502b7083d9"} : dispatch 2024-08-20T04:57:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:25 smithi037 ceph-mon[17265]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fa6a50a5-2b97-42d1-9b57-b5502b7083d9"} : dispatch 2024-08-20T04:57:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:25 smithi037 ceph-mon[17265]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa6a50a5-2b97-42d1-9b57-b5502b7083d9"}]': finished 2024-08-20T04:57:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:25 smithi037 ceph-mon[17265]: osdmap e60: 11 total, 10 up, 11 in 2024-08-20T04:57:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:25 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:26.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:26 smithi135 ceph-mon[22342]: from='client.? 172.21.15.130:0/411291107' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:57:26.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:26 smithi130 ceph-mon[22007]: from='client.? 172.21.15.130:0/411291107' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:57:27.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:26 smithi037 ceph-mon[17265]: from='client.? 172.21.15.130:0/411291107' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:57:27.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:27 smithi135 ceph-mon[22342]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:27 smithi130 ceph-mon[22007]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:28.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:27 smithi037 ceph-mon[17265]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:29.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:29 smithi135 ceph-mon[22342]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:29.881 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:29 smithi130 ceph-mon[22007]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:30.019 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:29 smithi037 ceph-mon[17265]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:31.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:31 smithi130 ceph-mon[22007]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:31.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:31 smithi135 ceph-mon[22342]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:32.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:31 smithi037 ceph-mon[17265]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:33.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:33 smithi037 ceph-mon[17265]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:33.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:33 smithi135 ceph-mon[22342]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:33.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:33 smithi130 ceph-mon[22007]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:34.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-20T04:57:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:34 smithi135 ceph-mon[22342]: Deploying daemon osd.10 on smithi130 2024-08-20T04:57:34.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-20T04:57:34.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:34.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:34 smithi130 ceph-mon[22007]: Deploying daemon osd.10 on smithi130 2024-08-20T04:57:35.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-08-20T04:57:35.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:35.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:34 smithi037 ceph-mon[17265]: Deploying daemon osd.10 on smithi130 2024-08-20T04:57:35.703 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:35 smithi130 ceph-mon[22007]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:35 smithi135 ceph-mon[22342]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:35.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:35 smithi037 ceph-mon[17265]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:37.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:37 smithi037 ceph-mon[17265]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:37 smithi135 ceph-mon[22342]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:37.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:37 smithi130 ceph-mon[22007]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:39.825 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:39 smithi130 ceph-mon[22007]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:39.825 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:57:39.825 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:39.825 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:39 smithi135 ceph-mon[22342]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:57:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:39.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:40.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:39 smithi037 ceph-mon[17265]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:40.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:57:40.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:40.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:41.838 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:41 smithi130 ceph-mon[22007]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:41.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:41 smithi135 ceph-mon[22342]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:42.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:41 smithi037 ceph-mon[17265]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:42.579 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:42.577+0000 7fb59f7fe640 1 -- 172.21.15.130:0/3138350924 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fb5a80632c0 con 0x7fb5940b3bd0 2024-08-20T04:57:42.580 INFO:teuthology.orchestra.run.smithi130.stdout:Created osd(s) 10 on host 'smithi130' 2024-08-20T04:57:42.582 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:42.580+0000 7fb5b0777640 1 -- 172.21.15.130:0/3138350924 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5940b3bd0 msgr2=0x7fb5940b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:57:42.582 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:42.580+0000 7fb5b0777640 1 --2- 172.21.15.130:0/3138350924 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5940b3bd0 0x7fb5940b6090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400bbe0 tx=0x7fb5a400b390 comp rx=0 tx=0).stop 2024-08-20T04:57:42.582 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:42.580+0000 7fb5b0777640 1 -- 172.21.15.130:0/3138350924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a81038a0 msgr2=0x7fb5a8199180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:57:42.582 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:42.580+0000 7fb5b0777640 1 --2- 172.21.15.130:0/3138350924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a81038a0 0x7fb5a8199180 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb59800d950 tx=0x7fb59800de10 comp rx=0 tx=0).stop 2024-08-20T04:57:42.582 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:42.580+0000 7fb5b0777640 1 -- 172.21.15.130:0/3138350924 shutdown_connections 2024-08-20T04:57:42.583 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:42.580+0000 7fb5b0777640 1 --2- 172.21.15.130:0/3138350924 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5940b3bd0 0x7fb5940b6090 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:42.583 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:42.580+0000 7fb5b0777640 1 --2- 172.21.15.130:0/3138350924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5a8104260 0x7fb5a8199dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:42.583 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:42.581+0000 7fb5b0777640 1 --2- 172.21.15.130:0/3138350924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a81038a0 0x7fb5a8199180 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:42.583 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:42.581+0000 7fb5b0777640 1 --2- 172.21.15.130:0/3138350924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a8102740 0x7fb5a8198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:42.583 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:42.581+0000 7fb5b0777640 1 -- 172.21.15.130:0/3138350924 >> 172.21.15.130:0/3138350924 conn(0x7fb5a80fdff0 msgr2=0x7fb5a8106bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:57:42.583 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:42.581+0000 7fb5b0777640 1 -- 172.21.15.130:0/3138350924 shutdown_connections 2024-08-20T04:57:42.583 INFO:teuthology.orchestra.run.smithi130.stderr:2024-08-20T04:57:42.581+0000 7fb5b0777640 1 -- 172.21.15.130:0/3138350924 wait complete. 2024-08-20T04:57:43.248 DEBUG:teuthology.orchestra.run.smithi130:osd.10> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.10.service 2024-08-20T04:57:43.250 INFO:tasks.cephadm:Deploying osd.11 on smithi135 with /dev/vg_nvme/lv_1... 2024-08-20T04:57:43.250 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-20T04:57:43.508 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T04:57:43.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:43 smithi135 ceph-mon[22342]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:43.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:43 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:43.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:43 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:43.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:43 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:43 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:43.916 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:43 smithi130 ceph-mon[22007]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:43.917 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:43 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:43.917 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:43 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:43.917 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:43 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:43.917 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:43 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:44.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:43 smithi037 ceph-mon[17265]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:44.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:43 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:44.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:43 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:44.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:43 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:44.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:43 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:45.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 04:57:45 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T04:57:45.278+0000 7f1c03ecc640 -1 osd.10 0 log_to_monitors true 2024-08-20T04:57:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:45 smithi135 ceph-mon[22342]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:45 smithi135 ceph-mon[22342]: from='osd.10 [v2:172.21.15.130:6824/2896730163,v1:172.21.15.130:6825/2896730163]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T04:57:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:45 smithi135 ceph-mon[22342]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T04:57:45.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:45 smithi130 ceph-mon[22007]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:45.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:45 smithi130 ceph-mon[22007]: from='osd.10 [v2:172.21.15.130:6824/2896730163,v1:172.21.15.130:6825/2896730163]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T04:57:45.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:45 smithi130 ceph-mon[22007]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T04:57:46.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:45 smithi037 ceph-mon[17265]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:46.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:45 smithi037 ceph-mon[17265]: from='osd.10 [v2:172.21.15.130:6824/2896730163,v1:172.21.15.130:6825/2896730163]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T04:57:46.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:45 smithi037 ceph-mon[17265]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-08-20T04:57:46.294 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-08-20T04:57:46.321 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch daemon add osd smithi135:vg_nvme/lv_1 2024-08-20T04:57:46.567 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T04:57:46.705 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T04:57:46.580+0000 7f1bffe4f640 -1 osd.10 0 waiting for initial osdmap 2024-08-20T04:57:46.705 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T04:57:46.597+0000 7f1bfbc76640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T04:57:46.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-mon[22007]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-20T04:57:46.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-mon[22007]: osdmap e61: 11 total, 10 up, 11 in 2024-08-20T04:57:46.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-mon[22007]: from='osd.10 [v2:172.21.15.130:6824/2896730163,v1:172.21.15.130:6825/2896730163]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:57:46.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:46.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-mon[22007]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:57:46.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:46.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:46.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:46.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:46.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:46.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:46.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:46.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:46.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:57:46.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:46.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-mon[22007]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-20T04:57:46.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:46 smithi130 ceph-mon[22007]: osdmap e62: 11 total, 10 up, 11 in 2024-08-20T04:57:46.847 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:46 smithi135 ceph-mon[22342]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-20T04:57:46.847 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:46 smithi135 ceph-mon[22342]: osdmap e61: 11 total, 10 up, 11 in 2024-08-20T04:57:46.847 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:46 smithi135 ceph-mon[22342]: from='osd.10 [v2:172.21.15.130:6824/2896730163,v1:172.21.15.130:6825/2896730163]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:57:46.847 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:46 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:46.847 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:46 smithi135 ceph-mon[22342]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:57:46.847 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:46 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:46.847 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:46 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:46.847 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:46 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:46.847 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:46 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:46.848 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:46 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:46.848 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:46 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:46.848 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:46 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:46.848 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:46 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:46.848 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:46 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:57:46.848 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:46 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:46.848 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:46 smithi135 ceph-mon[22342]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-20T04:57:46.848 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:46 smithi135 ceph-mon[22342]: osdmap e62: 11 total, 10 up, 11 in 2024-08-20T04:57:46.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:46 smithi037 ceph-mon[17265]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-20T04:57:46.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:46 smithi037 ceph-mon[17265]: osdmap e61: 11 total, 10 up, 11 in 2024-08-20T04:57:46.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:46 smithi037 ceph-mon[17265]: from='osd.10 [v2:172.21.15.130:6824/2896730163,v1:172.21.15.130:6825/2896730163]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:57:46.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:46 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:46.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:46 smithi037 ceph-mon[17265]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]} : dispatch 2024-08-20T04:57:46.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:46 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:46.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:46 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:46.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:46 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:46.861 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:46 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:46.861 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:46 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:46.861 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:46 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T04:57:46.861 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:46 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:46.861 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:46 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:46.861 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:46 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:57:46.861 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:46 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:46.861 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:46 smithi037 ceph-mon[17265]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi130", "root=default"]}]': finished 2024-08-20T04:57:46.861 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:46 smithi037 ceph-mon[17265]: osdmap e62: 11 total, 10 up, 11 in 2024-08-20T04:57:47.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.062+0000 7f3cbffa5640 1 -- 172.21.15.135:0/3592959523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cb8104270 msgr2=0x7f3cb810abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:57:47.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.062+0000 7f3cbffa5640 1 --2- 172.21.15.135:0/3592959523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cb8104270 0x7f3cb810abf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009960 tx=0x7f3cb002a460 comp rx=0 tx=0).stop 2024-08-20T04:57:47.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.062+0000 7f3cbffa5640 1 -- 172.21.15.135:0/3592959523 shutdown_connections 2024-08-20T04:57:47.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.062+0000 7f3cbffa5640 1 --2- 172.21.15.135:0/3592959523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cb8104270 0x7f3cb810abf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:47.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.062+0000 7f3cbffa5640 1 --2- 172.21.15.135:0/3592959523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cb81038b0 0x7f3cb8103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:47.087 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.062+0000 7f3cbffa5640 1 --2- 172.21.15.135:0/3592959523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb8102750 0x7f3cb8102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:47.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.062+0000 7f3cbffa5640 1 -- 172.21.15.135:0/3592959523 >> 172.21.15.135:0/3592959523 conn(0x7f3cb80fe020 msgr2=0x7f3cb8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:57:47.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.062+0000 7f3cbffa5640 1 -- 172.21.15.135:0/3592959523 shutdown_connections 2024-08-20T04:57:47.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.062+0000 7f3cbffa5640 1 -- 172.21.15.135:0/3592959523 wait complete. 2024-08-20T04:57:47.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.062+0000 7f3cbffa5640 1 Processor -- start 2024-08-20T04:57:47.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.062+0000 7f3cbffa5640 1 -- start start 2024-08-20T04:57:47.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbffa5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb8102750 0x7f3cb8198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:57:47.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbffa5640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cb81038b0 0x7f3cb81991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:57:47.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbffa5640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cb8104270 0x7f3cb8199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:57:47.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbffa5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb810e430 con 0x7f3cb8102750 2024-08-20T04:57:47.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbffa5640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb810e2b0 con 0x7f3cb81038b0 2024-08-20T04:57:47.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbffa5640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb810e5b0 con 0x7f3cb8104270 2024-08-20T04:57:47.088 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbe542640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cb8104270 0x7f3cb8199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:57:47.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbd540640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cb81038b0 0x7f3cb81991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:57:47.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbe542640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cb8104270 0x7f3cb8199e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:49906/0 (socket says 172.21.15.135:49906) 2024-08-20T04:57:47.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbe542640 1 -- 172.21.15.135:0/1015941477 learned_addr learned my addr 172.21.15.135:0/1015941477 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-08-20T04:57:47.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbdd41640 1 --2- 172.21.15.135:0/1015941477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb8102750 0x7f3cb8198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:57:47.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbd540640 1 -- 172.21.15.135:0/1015941477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cb8104270 msgr2=0x7f3cb8199e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:57:47.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbd540640 1 --2- 172.21.15.135:0/1015941477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cb8104270 0x7f3cb8199e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:47.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbd540640 1 -- 172.21.15.135:0/1015941477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb8102750 msgr2=0x7f3cb8198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:57:47.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbd540640 1 --2- 172.21.15.135:0/1015941477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb8102750 0x7f3cb8198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:57:47.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbd540640 1 -- 172.21.15.135:0/1015941477 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb819a6b0 con 0x7f3cb81038b0 2024-08-20T04:57:47.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbe542640 1 --2- 172.21.15.135:0/1015941477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cb8104270 0x7f3cb8199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:57:47.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbdd41640 1 --2- 172.21.15.135:0/1015941477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb8102750 0x7f3cb8198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T04:57:47.089 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbd540640 1 --2- 172.21.15.135:0/1015941477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cb81038b0 0x7f3cb81991d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00e9f0 tx=0x7f3cac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:57:47.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cb6ffd640 1 -- 172.21.15.135:0/1015941477 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00ccc0 con 0x7f3cb81038b0 2024-08-20T04:57:47.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.063+0000 7f3cbffa5640 1 -- 172.21.15.135:0/1015941477 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb819a9a0 con 0x7f3cb81038b0 2024-08-20T04:57:47.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.064+0000 7f3cb6ffd640 1 -- 172.21.15.135:0/1015941477 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cac0108e0 con 0x7f3cb81038b0 2024-08-20T04:57:47.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.064+0000 7f3cb6ffd640 1 -- 172.21.15.135:0/1015941477 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac018880 con 0x7f3cb81038b0 2024-08-20T04:57:47.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.064+0000 7f3cbffa5640 1 -- 172.21.15.135:0/1015941477 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb81a1080 con 0x7f3cb81038b0 2024-08-20T04:57:47.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.064+0000 7f3cbffa5640 1 -- 172.21.15.135:0/1015941477 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb8109ad0 con 0x7f3cb81038b0 2024-08-20T04:57:47.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.066+0000 7f3cb6ffd640 1 -- 172.21.15.135:0/1015941477 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f3cac010430 con 0x7f3cb81038b0 2024-08-20T04:57:47.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.066+0000 7f3cb6ffd640 1 --2- 172.21.15.135:0/1015941477 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3ca00b3bd0 0x7f3ca00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:57:47.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.067+0000 7f3cb6ffd640 1 -- 172.21.15.135:0/1015941477 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6414+0+0 (secure 0 0 0) 0x7f3cac0e3d80 con 0x7f3cb81038b0 2024-08-20T04:57:47.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.067+0000 7f3cbdd41640 1 --2- 172.21.15.135:0/1015941477 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3ca00b3bd0 0x7f3ca00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:57:47.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.067+0000 7f3cbdd41640 1 --2- 172.21.15.135:0/1015941477 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3ca00b3bd0 0x7f3ca00b6090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8009fa0 tx=0x7f3ca8009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:57:47.090 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.069+0000 7f3cb6ffd640 1 -- 172.21.15.135:0/1015941477 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f3cac0abae0 con 0x7f3cb81038b0 2024-08-20T04:57:47.256 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:57:47.255+0000 7f3cbffa5640 1 -- 172.21.15.135:0/1015941477 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3cb80632c0 con 0x7f3ca00b3bd0 2024-08-20T04:57:47.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:47 smithi037 ceph-mon[17265]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:47.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:47 smithi037 ceph-mon[17265]: Detected new or changed devices on smithi130 2024-08-20T04:57:47.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:47 smithi037 ceph-mon[17265]: Adjusting osd_memory_target on smithi130 to 4272M 2024-08-20T04:57:47.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:47.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:47.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:57:47.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:47.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:57:47.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:47.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:57:47.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:57:47.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:47.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:47.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:47 smithi135 ceph-mon[22342]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:47.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:47 smithi135 ceph-mon[22342]: Detected new or changed devices on smithi130 2024-08-20T04:57:47.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:47 smithi135 ceph-mon[22342]: Adjusting osd_memory_target on smithi130 to 4272M 2024-08-20T04:57:47.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:47.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:47.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:57:47.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:47.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:57:47.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:47.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:57:47.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:57:47.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:47.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:47 smithi130 ceph-mon[22007]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:47 smithi130 ceph-mon[22007]: Detected new or changed devices on smithi130 2024-08-20T04:57:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:47 smithi130 ceph-mon[22007]: Adjusting osd_memory_target on smithi130 to 4272M 2024-08-20T04:57:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:57:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:57:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:57:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-08-20T04:57:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-08-20T04:57:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:48.739 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:48 smithi135 ceph-mon[22342]: purged_snaps scrub starts 2024-08-20T04:57:48.739 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:48 smithi135 ceph-mon[22342]: purged_snaps scrub ok 2024-08-20T04:57:48.739 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:48 smithi135 ceph-mon[22342]: from='client.24527 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:57:48.739 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:48 smithi135 ceph-mon[22342]: osd.10 [v2:172.21.15.130:6824/2896730163,v1:172.21.15.130:6825/2896730163] boot 2024-08-20T04:57:48.739 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:48 smithi135 ceph-mon[22342]: osdmap e63: 11 total, 11 up, 11 in 2024-08-20T04:57:48.739 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:48 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:48.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:48 smithi130 ceph-mon[22007]: purged_snaps scrub starts 2024-08-20T04:57:48.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:48 smithi130 ceph-mon[22007]: purged_snaps scrub ok 2024-08-20T04:57:48.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:48 smithi130 ceph-mon[22007]: from='client.24527 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:57:48.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:48 smithi130 ceph-mon[22007]: osd.10 [v2:172.21.15.130:6824/2896730163,v1:172.21.15.130:6825/2896730163] boot 2024-08-20T04:57:48.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:48 smithi130 ceph-mon[22007]: osdmap e63: 11 total, 11 up, 11 in 2024-08-20T04:57:48.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:48 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:49.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:48 smithi037 ceph-mon[17265]: purged_snaps scrub starts 2024-08-20T04:57:49.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:48 smithi037 ceph-mon[17265]: purged_snaps scrub ok 2024-08-20T04:57:49.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:48 smithi037 ceph-mon[17265]: from='client.24527 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi135:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:57:49.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:48 smithi037 ceph-mon[17265]: osd.10 [v2:172.21.15.130:6824/2896730163,v1:172.21.15.130:6825/2896730163] boot 2024-08-20T04:57:49.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:48 smithi037 ceph-mon[17265]: osdmap e63: 11 total, 11 up, 11 in 2024-08-20T04:57:49.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:48 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-08-20T04:57:49.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:49 smithi135 ceph-mon[22342]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:49.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:49 smithi135 ceph-mon[22342]: osdmap e64: 11 total, 11 up, 11 in 2024-08-20T04:57:49.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:49 smithi130 ceph-mon[22007]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:49.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:49 smithi130 ceph-mon[22007]: osdmap e64: 11 total, 11 up, 11 in 2024-08-20T04:57:50.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:49 smithi037 ceph-mon[17265]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 292 MiB used, 894 GiB / 894 GiB avail 2024-08-20T04:57:50.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:49 smithi037 ceph-mon[17265]: osdmap e64: 11 total, 11 up, 11 in 2024-08-20T04:57:50.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:50 smithi130 ceph-mon[22007]: osdmap e65: 11 total, 11 up, 11 in 2024-08-20T04:57:50.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:50 smithi130 ceph-mon[22007]: from='client.? 172.21.15.135:0/3917758384' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a305d75-030d-41db-abfb-81bb71e8c6db"} : dispatch 2024-08-20T04:57:50.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:50 smithi130 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a305d75-030d-41db-abfb-81bb71e8c6db"} : dispatch 2024-08-20T04:57:50.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:50 smithi130 ceph-mon[22007]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a305d75-030d-41db-abfb-81bb71e8c6db"}]': finished 2024-08-20T04:57:50.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:50 smithi130 ceph-mon[22007]: osdmap e66: 12 total, 11 up, 12 in 2024-08-20T04:57:50.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:50 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T04:57:50.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:50 smithi130 ceph-mon[22007]: from='client.? 172.21.15.135:0/628844997' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:57:51.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:50 smithi037 ceph-mon[17265]: osdmap e65: 11 total, 11 up, 11 in 2024-08-20T04:57:51.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:50 smithi037 ceph-mon[17265]: from='client.? 172.21.15.135:0/3917758384' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a305d75-030d-41db-abfb-81bb71e8c6db"} : dispatch 2024-08-20T04:57:51.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:50 smithi037 ceph-mon[17265]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a305d75-030d-41db-abfb-81bb71e8c6db"} : dispatch 2024-08-20T04:57:51.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:50 smithi037 ceph-mon[17265]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a305d75-030d-41db-abfb-81bb71e8c6db"}]': finished 2024-08-20T04:57:51.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:50 smithi037 ceph-mon[17265]: osdmap e66: 12 total, 11 up, 12 in 2024-08-20T04:57:51.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:50 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T04:57:51.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:50 smithi037 ceph-mon[17265]: from='client.? 172.21.15.135:0/628844997' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:57:51.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:50 smithi135 ceph-mon[22342]: osdmap e65: 11 total, 11 up, 11 in 2024-08-20T04:57:51.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:50 smithi135 ceph-mon[22342]: from='client.? 172.21.15.135:0/3917758384' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a305d75-030d-41db-abfb-81bb71e8c6db"} : dispatch 2024-08-20T04:57:51.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:50 smithi135 ceph-mon[22342]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a305d75-030d-41db-abfb-81bb71e8c6db"} : dispatch 2024-08-20T04:57:51.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:50 smithi135 ceph-mon[22342]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a305d75-030d-41db-abfb-81bb71e8c6db"}]': finished 2024-08-20T04:57:51.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:50 smithi135 ceph-mon[22342]: osdmap e66: 12 total, 11 up, 12 in 2024-08-20T04:57:51.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:50 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T04:57:51.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:50 smithi135 ceph-mon[22342]: from='client.? 172.21.15.135:0/628844997' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-08-20T04:57:51.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:51 smithi130 ceph-mon[22007]: pgmap v247: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:57:52.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:51 smithi037 ceph-mon[17265]: pgmap v247: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:57:52.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:51 smithi135 ceph-mon[22342]: pgmap v247: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:57:53.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:53 smithi130 ceph-mon[22007]: pgmap v248: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:57:54.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:53 smithi037 ceph-mon[17265]: pgmap v248: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:57:54.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:53 smithi135 ceph-mon[22342]: pgmap v248: 1 pgs: 1 peering; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:57:55.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:55 smithi135 ceph-mon[22342]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T04:57:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:55 smithi130 ceph-mon[22007]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T04:57:56.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:55 smithi037 ceph-mon[17265]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-20T04:57:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:57 smithi130 ceph-mon[22007]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-08-20T04:57:58.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:57 smithi037 ceph-mon[17265]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-08-20T04:57:58.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:57 smithi135 ceph-mon[22342]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-08-20T04:57:58.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:58 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-20T04:57:58.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:58 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:58.964 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:58 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-20T04:57:58.964 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:58 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:59.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:58 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-08-20T04:57:59.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:58 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:57:59.830 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:59 smithi135 ceph-mon[22342]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-08-20T04:57:59.830 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:57:59 smithi135 ceph-mon[22342]: Deploying daemon osd.11 on smithi135 2024-08-20T04:57:59.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:59 smithi130 ceph-mon[22007]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-08-20T04:57:59.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:57:59 smithi130 ceph-mon[22007]: Deploying daemon osd.11 on smithi135 2024-08-20T04:58:00.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:59 smithi037 ceph-mon[17265]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-08-20T04:58:00.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:57:59 smithi037 ceph-mon[17265]: Deploying daemon osd.11 on smithi135 2024-08-20T04:58:01.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:01 smithi135 ceph-mon[22342]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-08-20T04:58:01.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:01 smithi130 ceph-mon[22007]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-08-20T04:58:02.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:01 smithi037 ceph-mon[17265]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-08-20T04:58:03.901 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:03 smithi135 ceph-mon[22342]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T04:58:03.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:03 smithi130 ceph-mon[22007]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T04:58:04.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:03 smithi037 ceph-mon[17265]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T04:58:04.856 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:04 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:58:04.856 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:04 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:04.856 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:04 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:04.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:04 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:58:04.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:04 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:04.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:04 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:05.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:04 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:58:05.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:04 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:05.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:04 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:05.803 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:05 smithi135 ceph-mon[22342]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T04:58:05.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:05 smithi037 ceph-mon[17265]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T04:58:05.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:05 smithi130 ceph-mon[22007]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-20T04:58:06.942 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:06.940+0000 7f3cb6ffd640 1 -- 172.21.15.135:0/1015941477 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3cb80632c0 con 0x7f3ca00b3bd0 2024-08-20T04:58:06.942 INFO:teuthology.orchestra.run.smithi135.stdout:Created osd(s) 11 on host 'smithi135' 2024-08-20T04:58:06.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:06.942+0000 7f3cbffa5640 1 -- 172.21.15.135:0/1015941477 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3ca00b3bd0 msgr2=0x7f3ca00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:06.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:06.942+0000 7f3cbffa5640 1 --2- 172.21.15.135:0/1015941477 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3ca00b3bd0 0x7f3ca00b6090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8009fa0 tx=0x7f3ca8009570 comp rx=0 tx=0).stop 2024-08-20T04:58:06.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:06.942+0000 7f3cbffa5640 1 -- 172.21.15.135:0/1015941477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cb81038b0 msgr2=0x7f3cb81991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:06.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:06.942+0000 7f3cbffa5640 1 --2- 172.21.15.135:0/1015941477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cb81038b0 0x7f3cb81991d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00e9f0 tx=0x7f3cac00eeb0 comp rx=0 tx=0).stop 2024-08-20T04:58:06.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:06.942+0000 7f3cbffa5640 1 -- 172.21.15.135:0/1015941477 shutdown_connections 2024-08-20T04:58:06.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:06.942+0000 7f3cbffa5640 1 --2- 172.21.15.135:0/1015941477 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3ca00b3bd0 0x7f3ca00b6090 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:06.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:06.942+0000 7f3cbffa5640 1 --2- 172.21.15.135:0/1015941477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3cb8104270 0x7f3cb8199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:06.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:06.942+0000 7f3cbffa5640 1 --2- 172.21.15.135:0/1015941477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3cb81038b0 0x7f3cb81991d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:06.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:06.942+0000 7f3cbffa5640 1 --2- 172.21.15.135:0/1015941477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb8102750 0x7f3cb8198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:06.944 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:06.942+0000 7f3cbffa5640 1 -- 172.21.15.135:0/1015941477 >> 172.21.15.135:0/1015941477 conn(0x7f3cb80fe020 msgr2=0x7f3cb8106ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:06.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:06.942+0000 7f3cbffa5640 1 -- 172.21.15.135:0/1015941477 shutdown_connections 2024-08-20T04:58:06.945 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:06.942+0000 7f3cbffa5640 1 -- 172.21.15.135:0/1015941477 wait complete. 2024-08-20T04:58:07.663 DEBUG:teuthology.orchestra.run.smithi135:osd.11> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.11.service 2024-08-20T04:58:07.665 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-08-20T04:58:07.666 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd stat -f json 2024-08-20T04:58:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:07 smithi130 ceph-mon[22007]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:58:07.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:07 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:07.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:07 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:08.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:07 smithi037 ceph-mon[17265]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:58:08.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:07 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:08.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:07 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:08.049 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:58:08.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:07 smithi135 ceph-mon[22342]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:58:08.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:07 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:08.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:07 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.742+0000 7f3815a00640 1 -- 172.21.15.37:0/526836833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38101034e0 msgr2=0x7f3810105970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.742+0000 7f3815a00640 1 --2- 172.21.15.37:0/526836833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38101034e0 0x7f3810105970 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009900 tx=0x7f37fc02a410 comp rx=0 tx=0).stop 2024-08-20T04:58:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.742+0000 7f3815a00640 1 -- 172.21.15.37:0/526836833 shutdown_connections 2024-08-20T04:58:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.742+0000 7f3815a00640 1 --2- 172.21.15.37:0/526836833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3810106090 0x7f3810106540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.742+0000 7f3815a00640 1 --2- 172.21.15.37:0/526836833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38101034e0 0x7f3810105970 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.742+0000 7f3815a00640 1 --2- 172.21.15.37:0/526836833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f381006bc00 0x7f3810102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.742+0000 7f3815a00640 1 -- 172.21.15.37:0/526836833 >> 172.21.15.37:0/526836833 conn(0x7f38100fcd50 msgr2=0x7f38100ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.742+0000 7f3815a00640 1 -- 172.21.15.37:0/526836833 shutdown_connections 2024-08-20T04:58:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.742+0000 7f3815a00640 1 -- 172.21.15.37:0/526836833 wait complete. 2024-08-20T04:58:08.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.743+0000 7f3815a00640 1 Processor -- start 2024-08-20T04:58:08.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.743+0000 7f3815a00640 1 -- start start 2024-08-20T04:58:08.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.744+0000 7f3815a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f381006bc00 0x7f381019ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:08.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.744+0000 7f3815a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38101034e0 0x7f381019f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:08.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.744+0000 7f3815a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3810106090 0x7f38101a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:08.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.744+0000 7f3815a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3810114820 con 0x7f381006bc00 2024-08-20T04:58:08.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.744+0000 7f3815a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f38101146a0 con 0x7f3810106090 2024-08-20T04:58:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.744+0000 7f3815a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f38101149a0 con 0x7f38101034e0 2024-08-20T04:58:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.744+0000 7f380fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f381006bc00 0x7f381019ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.744+0000 7f380f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38101034e0 0x7f381019f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.744+0000 7f380f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38101034e0 0x7f381019f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57592/0 (socket says 172.21.15.37:57592) 2024-08-20T04:58:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.744+0000 7f380fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f381006bc00 0x7f381019ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32894/0 (socket says 172.21.15.37:32894) 2024-08-20T04:58:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.744+0000 7f380f400640 1 -- 172.21.15.37:0/783190310 learned_addr learned my addr 172.21.15.37:0/783190310 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:58:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.744+0000 7f3815000640 1 --2- 172.21.15.37:0/783190310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3810106090 0x7f38101a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.744+0000 7f380f400640 1 -- 172.21.15.37:0/783190310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3810106090 msgr2=0x7f38101a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.744+0000 7f380f400640 1 --2- 172.21.15.37:0/783190310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3810106090 0x7f38101a00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.744+0000 7f380f400640 1 -- 172.21.15.37:0/783190310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f381006bc00 msgr2=0x7f381019ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.744+0000 7f380f400640 1 --2- 172.21.15.37:0/783190310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f381006bc00 0x7f381019ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.744+0000 7f380f400640 1 -- 172.21.15.37:0/783190310 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38101a0950 con 0x7f38101034e0 2024-08-20T04:58:08.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.745+0000 7f380f400640 1 --2- 172.21.15.37:0/783190310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38101034e0 0x7f381019f470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f37fc031500 tx=0x7f37fc003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:08.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.745+0000 7f380cc00640 1 -- 172.21.15.37:0/783190310 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37fc03f070 con 0x7f38101034e0 2024-08-20T04:58:08.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.745+0000 7f380cc00640 1 -- 172.21.15.37:0/783190310 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f37fc031c50 con 0x7f38101034e0 2024-08-20T04:58:08.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.745+0000 7f3815a00640 1 -- 172.21.15.37:0/783190310 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38101a0be0 con 0x7f38101034e0 2024-08-20T04:58:08.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.745+0000 7f380cc00640 1 -- 172.21.15.37:0/783190310 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37fc035030 con 0x7f38101034e0 2024-08-20T04:58:08.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.745+0000 7f3815a00640 1 -- 172.21.15.37:0/783190310 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38101a7320 con 0x7f38101034e0 2024-08-20T04:58:08.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.746+0000 7f3815a00640 1 -- 172.21.15.37:0/783190310 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3810106540 con 0x7f38101034e0 2024-08-20T04:58:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.748+0000 7f380cc00640 1 -- 172.21.15.37:0/783190310 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f37fc042070 con 0x7f38101034e0 2024-08-20T04:58:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.750+0000 7f380cc00640 1 --2- 172.21.15.37:0/783190310 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f37f40b3cf0 0x7f37f40b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:08.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.750+0000 7f380cc00640 1 -- 172.21.15.37:0/783190310 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6809+0+0 (secure 0 0 0) 0x7f37fc103d40 con 0x7f38101034e0 2024-08-20T04:58:08.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.750+0000 7f380fe00640 1 --2- 172.21.15.37:0/783190310 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f37f40b3cf0 0x7f37f40b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:08.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.751+0000 7f380fe00640 1 --2- 172.21.15.37:0/783190310 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f37f40b3cf0 0x7f37f40b61b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3800009bd0 tx=0x7f3800005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:08.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.753+0000 7f380cc00640 1 -- 172.21.15.37:0/783190310 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f37fc0cb280 con 0x7f38101034e0 2024-08-20T04:58:08.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.948+0000 7f3815a00640 1 -- 172.21.15.37:0/783190310 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f381002e340 con 0x7f38101034e0 2024-08-20T04:58:08.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.948+0000 7f380cc00640 1 -- 172.21.15.37:0/783190310 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7f37fc0cf7d0 con 0x7f38101034e0 2024-08-20T04:58:08.950 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:58:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.951+0000 7f3815a00640 1 -- 172.21.15.37:0/783190310 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f37f40b3cf0 msgr2=0x7f37f40b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.951+0000 7f3815a00640 1 --2- 172.21.15.37:0/783190310 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f37f40b3cf0 0x7f37f40b61b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3800009bd0 tx=0x7f3800005f90 comp rx=0 tx=0).stop 2024-08-20T04:58:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.951+0000 7f3815a00640 1 -- 172.21.15.37:0/783190310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38101034e0 msgr2=0x7f381019f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.951+0000 7f3815a00640 1 --2- 172.21.15.37:0/783190310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38101034e0 0x7f381019f470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f37fc031500 tx=0x7f37fc003c10 comp rx=0 tx=0).stop 2024-08-20T04:58:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.951+0000 7f3815a00640 1 -- 172.21.15.37:0/783190310 shutdown_connections 2024-08-20T04:58:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.951+0000 7f3815a00640 1 --2- 172.21.15.37:0/783190310 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f37f40b3cf0 0x7f37f40b61b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.951+0000 7f3815a00640 1 --2- 172.21.15.37:0/783190310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3810106090 0x7f38101a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.951+0000 7f3815a00640 1 --2- 172.21.15.37:0/783190310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f38101034e0 0x7f381019f470 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:08.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.951+0000 7f3815a00640 1 --2- 172.21.15.37:0/783190310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f381006bc00 0x7f381019ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.951+0000 7f3815a00640 1 -- 172.21.15.37:0/783190310 >> 172.21.15.37:0/783190310 conn(0x7f38100fcd50 msgr2=0x7f3810101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.951+0000 7f3815a00640 1 -- 172.21.15.37:0/783190310 shutdown_connections 2024-08-20T04:58:08.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:08.951+0000 7f3815a00640 1 -- 172.21.15.37:0/783190310 wait complete. 2024-08-20T04:58:09.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:09 smithi037 ceph-mon[17265]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:58:09.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:09 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:09.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:09 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:09.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:09 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/783190310' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T04:58:09.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:09 smithi135 ceph-mon[22342]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:58:09.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:09.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:09.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:09 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/783190310' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T04:58:09.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:09 smithi130 ceph-mon[22007]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:58:09.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:09 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:09.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:09 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:09.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:09 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/783190310' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T04:58:09.815 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1724129867,"num_in_osds":12,"osd_in_since":1724129869,"num_remapped_pgs":0} 2024-08-20T04:58:10.240 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 04:58:10 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T04:58:10.113+0000 7f7346026640 -1 osd.11 0 log_to_monitors true 2024-08-20T04:58:10.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:10 smithi037 ceph-mon[17265]: from='osd.11 [v2:172.21.15.135:6824/2532897645,v1:172.21.15.135:6825/2532897645]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T04:58:10.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:10 smithi037 ceph-mon[17265]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T04:58:10.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:10 smithi135 ceph-mon[22342]: from='osd.11 [v2:172.21.15.135:6824/2532897645,v1:172.21.15.135:6825/2532897645]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T04:58:10.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:10 smithi135 ceph-mon[22342]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T04:58:10.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:10 smithi130 ceph-mon[22007]: from='osd.11 [v2:172.21.15.135:6824/2532897645,v1:172.21.15.135:6825/2532897645]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T04:58:10.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:10 smithi130 ceph-mon[22007]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-08-20T04:58:10.816 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd stat -f json 2024-08-20T04:58:11.220 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:58:11.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:11 smithi135 ceph-mon[22342]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:58:11.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:11 smithi135 ceph-mon[22342]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-20T04:58:11.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:11 smithi135 ceph-mon[22342]: from='osd.11 [v2:172.21.15.135:6824/2532897645,v1:172.21.15.135:6825/2532897645]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:58:11.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:11 smithi135 ceph-mon[22342]: osdmap e67: 12 total, 11 up, 12 in 2024-08-20T04:58:11.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:11 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T04:58:11.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:11 smithi135 ceph-mon[22342]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:58:11.366 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 04:58:11 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T04:58:11.253+0000 7f7341fa9640 -1 osd.11 0 waiting for initial osdmap 2024-08-20T04:58:11.366 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 04:58:11 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T04:58:11.264+0000 7f733ddd0640 -1 osd.11 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-20T04:58:11.469 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:11 smithi037 ceph-mon[17265]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:58:11.469 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:11 smithi037 ceph-mon[17265]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-20T04:58:11.469 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:11 smithi037 ceph-mon[17265]: from='osd.11 [v2:172.21.15.135:6824/2532897645,v1:172.21.15.135:6825/2532897645]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:58:11.469 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:11 smithi037 ceph-mon[17265]: osdmap e67: 12 total, 11 up, 12 in 2024-08-20T04:58:11.469 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:11 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T04:58:11.469 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:11 smithi037 ceph-mon[17265]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:58:11.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:11 smithi130 ceph-mon[22007]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:58:11.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:11 smithi130 ceph-mon[22007]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-20T04:58:11.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:11 smithi130 ceph-mon[22007]: from='osd.11 [v2:172.21.15.135:6824/2532897645,v1:172.21.15.135:6825/2532897645]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:58:11.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:11 smithi130 ceph-mon[22007]: osdmap e67: 12 total, 11 up, 12 in 2024-08-20T04:58:11.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:11 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T04:58:11.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:11 smithi130 ceph-mon[22007]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]} : dispatch 2024-08-20T04:58:11.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.869+0000 7f0402800640 1 -- 172.21.15.37:0/227715473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03fc104940 msgr2=0x7f03fc104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.869+0000 7f0402800640 1 --2- 172.21.15.37:0/227715473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03fc104940 0x7f03fc104d40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009c40 tx=0x7f03ec02a720 comp rx=0 tx=0).stop 2024-08-20T04:58:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.869+0000 7f0402800640 1 -- 172.21.15.37:0/227715473 shutdown_connections 2024-08-20T04:58:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.869+0000 7f0402800640 1 --2- 172.21.15.37:0/227715473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03fc106460 0x7f03fc10cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.869+0000 7f0402800640 1 --2- 172.21.15.37:0/227715473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc105aa0 0x7f03fc105f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.869+0000 7f0402800640 1 --2- 172.21.15.37:0/227715473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03fc104940 0x7f03fc104d40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.869+0000 7f0402800640 1 -- 172.21.15.37:0/227715473 >> 172.21.15.37:0/227715473 conn(0x7f03fc100210 msgr2=0x7f03fc102650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.869+0000 7f0402800640 1 -- 172.21.15.37:0/227715473 shutdown_connections 2024-08-20T04:58:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.869+0000 7f0402800640 1 -- 172.21.15.37:0/227715473 wait complete. 2024-08-20T04:58:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.870+0000 7f0402800640 1 Processor -- start 2024-08-20T04:58:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.870+0000 7f0402800640 1 -- start start 2024-08-20T04:58:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.870+0000 7f0402800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03fc104940 0x7f03fc19ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.870+0000 7f0402800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc105aa0 0x7f03fc19b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.871+0000 7f0402800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03fc106460 0x7f03fc19c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.871+0000 7f0402800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc1105c0 con 0x7f03fc105aa0 2024-08-20T04:58:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.871+0000 7f0402800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc110440 con 0x7f03fc104940 2024-08-20T04:58:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.871+0000 7f0402800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03fc110740 con 0x7f03fc106460 2024-08-20T04:58:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.871+0000 7f03fbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03fc106460 0x7f03fc19c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.871+0000 7f03f2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc105aa0 0x7f03fc19b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.871+0000 7f03fbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03fc106460 0x7f03fc19c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57620/0 (socket says 172.21.15.37:57620) 2024-08-20T04:58:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.871+0000 7f03fbe00640 1 -- 172.21.15.37:0/1694163101 learned_addr learned my addr 172.21.15.37:0/1694163101 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:58:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.871+0000 7f03fb400640 1 --2- 172.21.15.37:0/1694163101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03fc104940 0x7f03fc19ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.871+0000 7f03fbe00640 1 -- 172.21.15.37:0/1694163101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03fc104940 msgr2=0x7f03fc19ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.871+0000 7f03fbe00640 1 --2- 172.21.15.37:0/1694163101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03fc104940 0x7f03fc19ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.871+0000 7f03fbe00640 1 -- 172.21.15.37:0/1694163101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc105aa0 msgr2=0x7f03fc19b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.871+0000 7f03fbe00640 1 --2- 172.21.15.37:0/1694163101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc105aa0 0x7f03fc19b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.871+0000 7f03fbe00640 1 -- 172.21.15.37:0/1694163101 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03fc19c8a0 con 0x7f03fc106460 2024-08-20T04:58:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.871+0000 7f03f2a00640 1 --2- 172.21.15.37:0/1694163101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc105aa0 0x7f03fc19b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T04:58:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.872+0000 7f03fbe00640 1 --2- 172.21.15.37:0/1694163101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03fc106460 0x7f03fc19c000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f03f400e970 tx=0x7f03f400ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.872+0000 7f03f8c00640 1 -- 172.21.15.37:0/1694163101 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f400ccc0 con 0x7f03fc106460 2024-08-20T04:58:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.872+0000 7f03f8c00640 1 -- 172.21.15.37:0/1694163101 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03f400ce60 con 0x7f03fc106460 2024-08-20T04:58:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.872+0000 7f03f8c00640 1 -- 172.21.15.37:0/1694163101 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f4010430 con 0x7f03fc106460 2024-08-20T04:58:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.872+0000 7f0402800640 1 -- 172.21.15.37:0/1694163101 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03fc19cb90 con 0x7f03fc106460 2024-08-20T04:58:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.872+0000 7f0402800640 1 -- 172.21.15.37:0/1694163101 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03fc1a3270 con 0x7f03fc106460 2024-08-20T04:58:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.873+0000 7f0402800640 1 -- 172.21.15.37:0/1694163101 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03fc10bd40 con 0x7f03fc106460 2024-08-20T04:58:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.877+0000 7f03f8c00640 1 -- 172.21.15.37:0/1694163101 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f03f40046c0 con 0x7f03fc106460 2024-08-20T04:58:11.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.880+0000 7f03f8c00640 1 --2- 172.21.15.37:0/1694163101 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03e00b3c50 0x7f03e00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:11.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.881+0000 7f03f8c00640 1 -- 172.21.15.37:0/1694163101 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6847+0+0 (secure 0 0 0) 0x7f03f40e3c60 con 0x7f03fc106460 2024-08-20T04:58:11.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.881+0000 7f03fb400640 1 --2- 172.21.15.37:0/1694163101 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03e00b3c50 0x7f03e00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:11.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.881+0000 7f03f8c00640 1 -- 172.21.15.37:0/1694163101 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f03f40e40c0 con 0x7f03fc106460 2024-08-20T04:58:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:11.881+0000 7f03fb400640 1 --2- 172.21.15.37:0/1694163101 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03e00b3c50 0x7f03e00b6110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f03ec02ad10 tx=0x7f03ec000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:12.079+0000 7f0402800640 1 -- 172.21.15.37:0/1694163101 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f03fc02e540 con 0x7f03fc106460 2024-08-20T04:58:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:12.080+0000 7f03f8c00640 1 -- 172.21.15.37:0/1694163101 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f03f40ab7d0 con 0x7f03fc106460 2024-08-20T04:58:12.082 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:58:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:12.082+0000 7f0402800640 1 -- 172.21.15.37:0/1694163101 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03e00b3c50 msgr2=0x7f03e00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:12.082+0000 7f0402800640 1 --2- 172.21.15.37:0/1694163101 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03e00b3c50 0x7f03e00b6110 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f03ec02ad10 tx=0x7f03ec000f40 comp rx=0 tx=0).stop 2024-08-20T04:58:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:12.082+0000 7f0402800640 1 -- 172.21.15.37:0/1694163101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03fc106460 msgr2=0x7f03fc19c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:12.082+0000 7f0402800640 1 --2- 172.21.15.37:0/1694163101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03fc106460 0x7f03fc19c000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f03f400e970 tx=0x7f03f400ed70 comp rx=0 tx=0).stop 2024-08-20T04:58:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:12.082+0000 7f0402800640 1 -- 172.21.15.37:0/1694163101 shutdown_connections 2024-08-20T04:58:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:12.082+0000 7f0402800640 1 --2- 172.21.15.37:0/1694163101 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03e00b3c50 0x7f03e00b6110 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:12.082+0000 7f0402800640 1 --2- 172.21.15.37:0/1694163101 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03fc106460 0x7f03fc19c000 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:12.083+0000 7f0402800640 1 --2- 172.21.15.37:0/1694163101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03fc105aa0 0x7f03fc19b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:12.083+0000 7f0402800640 1 --2- 172.21.15.37:0/1694163101 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03fc104940 0x7f03fc19ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:12.083+0000 7f0402800640 1 -- 172.21.15.37:0/1694163101 >> 172.21.15.37:0/1694163101 conn(0x7f03fc100210 msgr2=0x7f03fc108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:12.083+0000 7f0402800640 1 -- 172.21.15.37:0/1694163101 shutdown_connections 2024-08-20T04:58:12.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:12.083+0000 7f0402800640 1 -- 172.21.15.37:0/1694163101 wait complete. 2024-08-20T04:58:12.382 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-08-20T04:58:12.382 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: osdmap e68: 12 total, 11 up, 12 in 2024-08-20T04:58:12.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T04:58:12.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T04:58:12.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: Detected new or changed devices on smithi135 2024-08-20T04:58:12.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:12.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:12.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T04:58:12.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T04:58:12.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T04:58:12.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T04:58:12.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: Adjusting osd_memory_target on smithi135 to 1453M 2024-08-20T04:58:12.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:12.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:12.383 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:58:12.384 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:12.384 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:58:12.384 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:12.384 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:58:12.384 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:12.384 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:12 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1694163101' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T04:58:12.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-08-20T04:58:12.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: osdmap e68: 12 total, 11 up, 12 in 2024-08-20T04:58:12.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T04:58:12.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T04:58:12.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: Detected new or changed devices on smithi135 2024-08-20T04:58:12.641 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:12.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:12.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T04:58:12.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T04:58:12.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T04:58:12.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T04:58:12.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: Adjusting osd_memory_target on smithi135 to 1453M 2024-08-20T04:58:12.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:12.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:12.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:58:12.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:12.642 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:58:12.643 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:12.643 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:58:12.643 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:12.643 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:12 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1694163101' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T04:58:12.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi135", "root=default"]}]': finished 2024-08-20T04:58:12.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: osdmap e68: 12 total, 11 up, 12 in 2024-08-20T04:58:12.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T04:58:12.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T04:58:12.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: Detected new or changed devices on smithi135 2024-08-20T04:58:12.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:12.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:12.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-08-20T04:58:12.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-08-20T04:58:12.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-08-20T04:58:12.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-08-20T04:58:12.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: Adjusting osd_memory_target on smithi135 to 1453M 2024-08-20T04:58:12.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:12.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:12.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:58:12.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:12.708 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:58:12.709 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:12.709 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:58:12.709 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:12.709 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:12 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1694163101' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T04:58:13.136 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1724129867,"num_in_osds":12,"osd_in_since":1724129869,"num_remapped_pgs":0} 2024-08-20T04:58:13.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:13 smithi135 ceph-mon[22342]: purged_snaps scrub starts 2024-08-20T04:58:13.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:13 smithi135 ceph-mon[22342]: purged_snaps scrub ok 2024-08-20T04:58:13.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:13 smithi135 ceph-mon[22342]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:58:13.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:13 smithi135 ceph-mon[22342]: osd.11 [v2:172.21.15.135:6824/2532897645,v1:172.21.15.135:6825/2532897645] boot 2024-08-20T04:58:13.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:13 smithi135 ceph-mon[22342]: osdmap e69: 12 total, 12 up, 12 in 2024-08-20T04:58:13.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:13 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T04:58:13.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:13 smithi037 ceph-mon[17265]: purged_snaps scrub starts 2024-08-20T04:58:13.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:13 smithi037 ceph-mon[17265]: purged_snaps scrub ok 2024-08-20T04:58:13.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:13 smithi037 ceph-mon[17265]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:58:13.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:13 smithi037 ceph-mon[17265]: osd.11 [v2:172.21.15.135:6824/2532897645,v1:172.21.15.135:6825/2532897645] boot 2024-08-20T04:58:13.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:13 smithi037 ceph-mon[17265]: osdmap e69: 12 total, 12 up, 12 in 2024-08-20T04:58:13.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:13 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T04:58:13.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:13 smithi130 ceph-mon[22007]: purged_snaps scrub starts 2024-08-20T04:58:13.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:13 smithi130 ceph-mon[22007]: purged_snaps scrub ok 2024-08-20T04:58:13.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:13 smithi130 ceph-mon[22007]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 320 MiB used, 983 GiB / 983 GiB avail 2024-08-20T04:58:13.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:13 smithi130 ceph-mon[22007]: osd.11 [v2:172.21.15.135:6824/2532897645,v1:172.21.15.135:6825/2532897645] boot 2024-08-20T04:58:13.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:13 smithi130 ceph-mon[22007]: osdmap e69: 12 total, 12 up, 12 in 2024-08-20T04:58:13.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:13 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-08-20T04:58:14.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd stat -f json 2024-08-20T04:58:14.523 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:58:14.872 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:14 smithi037 ceph-mon[17265]: osdmap e70: 12 total, 12 up, 12 in 2024-08-20T04:58:14.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:14 smithi130 ceph-mon[22007]: osdmap e70: 12 total, 12 up, 12 in 2024-08-20T04:58:15.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.104+0000 7f967ba00640 1 -- 172.21.15.37:0/986279386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9674105aa0 msgr2=0x7f9674105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:15.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.104+0000 7f967ba00640 1 --2- 172.21.15.37:0/986279386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9674105aa0 0x7f9674105f20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9660009930 tx=0x7f966002a420 comp rx=0 tx=0).stop 2024-08-20T04:58:15.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.104+0000 7f967ba00640 1 -- 172.21.15.37:0/986279386 shutdown_connections 2024-08-20T04:58:15.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.104+0000 7f967ba00640 1 --2- 172.21.15.37:0/986279386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9674106460 0x7f967410cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:15.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.104+0000 7f967ba00640 1 --2- 172.21.15.37:0/986279386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9674105aa0 0x7f9674105f20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:15.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.104+0000 7f967ba00640 1 --2- 172.21.15.37:0/986279386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9674104940 0x7f9674104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:15.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.104+0000 7f967ba00640 1 -- 172.21.15.37:0/986279386 >> 172.21.15.37:0/986279386 conn(0x7f9674100210 msgr2=0x7f9674102650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:15.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.104+0000 7f967ba00640 1 -- 172.21.15.37:0/986279386 shutdown_connections 2024-08-20T04:58:15.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.104+0000 7f967ba00640 1 -- 172.21.15.37:0/986279386 wait complete. 2024-08-20T04:58:15.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.105+0000 7f967ba00640 1 Processor -- start 2024-08-20T04:58:15.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.105+0000 7f967ba00640 1 -- start start 2024-08-20T04:58:15.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.106+0000 7f967ba00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9674104940 0x7f967419ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:15.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.106+0000 7f967ba00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9674105aa0 0x7f967419b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:15.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.106+0000 7f967ba00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9674106460 0x7f967419bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:15.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.106+0000 7f967ba00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9674110610 con 0x7f9674106460 2024-08-20T04:58:15.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.106+0000 7f967ba00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9674110490 con 0x7f9674105aa0 2024-08-20T04:58:15.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.106+0000 7f967ba00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9674110790 con 0x7f9674104940 2024-08-20T04:58:15.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.106+0000 7f9679a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9674106460 0x7f967419bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:15.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.106+0000 7f9679a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9674106460 0x7f967419bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41416/0 (socket says 172.21.15.37:41416) 2024-08-20T04:58:15.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.106+0000 7f9679a00640 1 -- 172.21.15.37:0/1453409046 learned_addr learned my addr 172.21.15.37:0/1453409046 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:58:15.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.106+0000 7f9673e00640 1 --2- 172.21.15.37:0/1453409046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9674105aa0 0x7f967419b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:15.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.106+0000 7f9679000640 1 --2- 172.21.15.37:0/1453409046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9674104940 0x7f967419ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:15.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.106+0000 7f9679a00640 1 -- 172.21.15.37:0/1453409046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9674104940 msgr2=0x7f967419ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:15.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.106+0000 7f9679a00640 1 --2- 172.21.15.37:0/1453409046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9674104940 0x7f967419ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:15.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.106+0000 7f9679a00640 1 -- 172.21.15.37:0/1453409046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9674105aa0 msgr2=0x7f967419b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:15.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.106+0000 7f9679a00640 1 --2- 172.21.15.37:0/1453409046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9674105aa0 0x7f967419b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:15.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.106+0000 7f9679a00640 1 -- 172.21.15.37:0/1453409046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f967419c860 con 0x7f9674106460 2024-08-20T04:58:15.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.107+0000 7f9679a00640 1 --2- 172.21.15.37:0/1453409046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9674106460 0x7f967419bfc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f966c00efd0 tx=0x7f966c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:15.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.107+0000 7f9671600640 1 -- 172.21.15.37:0/1453409046 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c003b70 con 0x7f9674106460 2024-08-20T04:58:15.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.107+0000 7f9671600640 1 -- 172.21.15.37:0/1453409046 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f966c003d10 con 0x7f9674106460 2024-08-20T04:58:15.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.107+0000 7f9671600640 1 -- 172.21.15.37:0/1453409046 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966c0108a0 con 0x7f9674106460 2024-08-20T04:58:15.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.107+0000 7f967ba00640 1 -- 172.21.15.37:0/1453409046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f967419cb50 con 0x7f9674106460 2024-08-20T04:58:15.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.107+0000 7f967ba00640 1 -- 172.21.15.37:0/1453409046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96741a3230 con 0x7f9674106460 2024-08-20T04:58:15.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.108+0000 7f967ba00640 1 -- 172.21.15.37:0/1453409046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f967410bca0 con 0x7f9674106460 2024-08-20T04:58:15.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.111+0000 7f9671600640 1 -- 172.21.15.37:0/1453409046 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f966c004b40 con 0x7f9674106460 2024-08-20T04:58:15.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.112+0000 7f9671600640 1 --2- 172.21.15.37:0/1453409046 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f965c0b3c50 0x7f965c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:15.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.112+0000 7f9671600640 1 -- 172.21.15.37:0/1453409046 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f966c0e3f90 con 0x7f9674106460 2024-08-20T04:58:15.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.112+0000 7f9679000640 1 --2- 172.21.15.37:0/1453409046 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f965c0b3c50 0x7f965c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:15.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.113+0000 7f9679000640 1 --2- 172.21.15.37:0/1453409046 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f965c0b3c50 0x7f965c0b6110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9668009bd0 tx=0x7f9668005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:15.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:14 smithi135 ceph-mon[22342]: osdmap e70: 12 total, 12 up, 12 in 2024-08-20T04:58:15.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.114+0000 7f9671600640 1 -- 172.21.15.37:0/1453409046 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f966c0ab9e0 con 0x7f9674106460 2024-08-20T04:58:15.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.314+0000 7f967ba00640 1 -- 172.21.15.37:0/1453409046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f967402e340 con 0x7f9674106460 2024-08-20T04:58:15.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.315+0000 7f9671600640 1 -- 172.21.15.37:0/1453409046 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f967402e340 con 0x7f9674106460 2024-08-20T04:58:15.317 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:58:15.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.317+0000 7f967ba00640 1 -- 172.21.15.37:0/1453409046 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f965c0b3c50 msgr2=0x7f965c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:15.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.317+0000 7f967ba00640 1 --2- 172.21.15.37:0/1453409046 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f965c0b3c50 0x7f965c0b6110 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9668009bd0 tx=0x7f9668005f90 comp rx=0 tx=0).stop 2024-08-20T04:58:15.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.317+0000 7f967ba00640 1 -- 172.21.15.37:0/1453409046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9674106460 msgr2=0x7f967419bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:15.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.317+0000 7f967ba00640 1 --2- 172.21.15.37:0/1453409046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9674106460 0x7f967419bfc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f966c00efd0 tx=0x7f966c00c6a0 comp rx=0 tx=0).stop 2024-08-20T04:58:15.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.317+0000 7f967ba00640 1 -- 172.21.15.37:0/1453409046 shutdown_connections 2024-08-20T04:58:15.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.317+0000 7f967ba00640 1 --2- 172.21.15.37:0/1453409046 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f965c0b3c50 0x7f965c0b6110 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:15.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.317+0000 7f967ba00640 1 --2- 172.21.15.37:0/1453409046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9674106460 0x7f967419bfc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:15.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.317+0000 7f967ba00640 1 --2- 172.21.15.37:0/1453409046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9674105aa0 0x7f967419b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:15.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.317+0000 7f967ba00640 1 --2- 172.21.15.37:0/1453409046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9674104940 0x7f967419ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:15.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.317+0000 7f967ba00640 1 -- 172.21.15.37:0/1453409046 >> 172.21.15.37:0/1453409046 conn(0x7f9674100210 msgr2=0x7f9674108e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:15.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.317+0000 7f967ba00640 1 -- 172.21.15.37:0/1453409046 shutdown_connections 2024-08-20T04:58:15.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:15.317+0000 7f967ba00640 1 -- 172.21.15.37:0/1453409046 wait complete. 2024-08-20T04:58:15.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:15 smithi130 ceph-mon[22007]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:15.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:15 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1453409046' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T04:58:16.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:15 smithi037 ceph-mon[17265]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:16.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:15 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1453409046' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T04:58:16.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:15 smithi135 ceph-mon[22342]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:16.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:15 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1453409046' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-08-20T04:58:16.377 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":70,"num_osds":12,"num_up_osds":12,"osd_up_since":1724129892,"num_in_osds":12,"osd_in_since":1724129869,"num_remapped_pgs":0} 2024-08-20T04:58:16.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T04:58:16.757 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:58:17.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.328+0000 7f4ab2000640 1 -- 172.21.15.37:0/855707894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4aac102920 msgr2=0x7f4aac102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:17.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.328+0000 7f4ab2000640 1 --2- 172.21.15.37:0/855707894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4aac102920 0x7f4aac102d00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0009900 tx=0x7f4aa002a3f0 comp rx=0 tx=0).stop 2024-08-20T04:58:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.328+0000 7f4ab2000640 1 -- 172.21.15.37:0/855707894 shutdown_connections 2024-08-20T04:58:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.328+0000 7f4ab2000640 1 --2- 172.21.15.37:0/855707894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac108cb0 0x7f4aac10f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.328+0000 7f4ab2000640 1 --2- 172.21.15.37:0/855707894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4aac108330 0x7f4aac108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.328+0000 7f4ab2000640 1 --2- 172.21.15.37:0/855707894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4aac102920 0x7f4aac102d00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.328+0000 7f4ab2000640 1 -- 172.21.15.37:0/855707894 >> 172.21.15.37:0/855707894 conn(0x7f4aac0fe350 msgr2=0x7f4aac100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.328+0000 7f4ab2000640 1 -- 172.21.15.37:0/855707894 shutdown_connections 2024-08-20T04:58:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.328+0000 7f4ab2000640 1 -- 172.21.15.37:0/855707894 wait complete. 2024-08-20T04:58:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.329+0000 7f4ab2000640 1 Processor -- start 2024-08-20T04:58:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.329+0000 7f4ab2000640 1 -- start start 2024-08-20T04:58:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.330+0000 7f4ab2000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4aac102920 0x7f4aac0751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.330+0000 7f4ab2000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac108330 0x7f4aac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.330+0000 7f4ab2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4aac108cb0 0x7f4aac075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.330+0000 7f4ab2000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac112930 con 0x7f4aac108cb0 2024-08-20T04:58:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.330+0000 7f4ab2000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac1127b0 con 0x7f4aac102920 2024-08-20T04:58:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.330+0000 7f4ab2000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4aac112ab0 con 0x7f4aac108330 2024-08-20T04:58:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.330+0000 7f4ab1600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4aac108cb0 0x7f4aac075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.330+0000 7f4ab1600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4aac108cb0 0x7f4aac075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41420/0 (socket says 172.21.15.37:41420) 2024-08-20T04:58:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.330+0000 7f4ab1600640 1 -- 172.21.15.37:0/895654037 learned_addr learned my addr 172.21.15.37:0/895654037 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:58:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.330+0000 7f4ab0c00640 1 --2- 172.21.15.37:0/895654037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4aac102920 0x7f4aac0751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.330+0000 7f4aabe00640 1 --2- 172.21.15.37:0/895654037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac108330 0x7f4aac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.331+0000 7f4ab0c00640 1 -- 172.21.15.37:0/895654037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac108330 msgr2=0x7f4aac075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.331+0000 7f4ab0c00640 1 --2- 172.21.15.37:0/895654037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac108330 0x7f4aac075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.331+0000 7f4ab0c00640 1 -- 172.21.15.37:0/895654037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4aac108cb0 msgr2=0x7f4aac075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:17.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.331+0000 7f4ab0c00640 1 --2- 172.21.15.37:0/895654037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4aac108cb0 0x7f4aac075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:17.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.331+0000 7f4ab0c00640 1 -- 172.21.15.37:0/895654037 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aac1a7160 con 0x7f4aac102920 2024-08-20T04:58:17.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.331+0000 7f4ab1600640 1 --2- 172.21.15.37:0/895654037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4aac108cb0 0x7f4aac075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:58:17.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.331+0000 7f4ab0c00640 1 --2- 172.21.15.37:0/895654037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4aac102920 0x7f4aac0751d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0006010 tx=0x7f4aa0004060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.331+0000 7f4aa9600640 1 -- 172.21.15.37:0/895654037 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa003f070 con 0x7f4aac102920 2024-08-20T04:58:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.331+0000 7f4aa9600640 1 -- 172.21.15.37:0/895654037 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4aa0003ca0 con 0x7f4aac102920 2024-08-20T04:58:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.331+0000 7f4ab2000640 1 -- 172.21.15.37:0/895654037 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aac1a73f0 con 0x7f4aac102920 2024-08-20T04:58:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.331+0000 7f4aa9600640 1 -- 172.21.15.37:0/895654037 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0035070 con 0x7f4aac102920 2024-08-20T04:58:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.332+0000 7f4ab2000640 1 -- 172.21.15.37:0/895654037 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aac1a7920 con 0x7f4aac102920 2024-08-20T04:58:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.333+0000 7f4ab2000640 1 -- 172.21.15.37:0/895654037 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aac102d00 con 0x7f4aac102920 2024-08-20T04:58:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.335+0000 7f4aa9600640 1 -- 172.21.15.37:0/895654037 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f4aa003b460 con 0x7f4aac102920 2024-08-20T04:58:17.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.336+0000 7f4aa9600640 1 --2- 172.21.15.37:0/895654037 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a940b3cf0 0x7f4a940b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:17.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.336+0000 7f4aa9600640 1 -- 172.21.15.37:0/895654037 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f4aa0103ea0 con 0x7f4aac102920 2024-08-20T04:58:17.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.336+0000 7f4aabe00640 1 --2- 172.21.15.37:0/895654037 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a940b3cf0 0x7f4a940b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.337+0000 7f4aabe00640 1 --2- 172.21.15.37:0/895654037 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a940b3cf0 0x7f4a940b61b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4aac076cc0 tx=0x7f4a98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:17.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.338+0000 7f4aa9600640 1 -- 172.21.15.37:0/895654037 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4aa00cb2a0 con 0x7f4aac102920 2024-08-20T04:58:17.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.533+0000 7f4ab2000640 1 -- 172.21.15.37:0/895654037 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4aac02e340 con 0x7f4aac102920 2024-08-20T04:58:17.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.534+0000 7f4aa9600640 1 -- 172.21.15.37:0/895654037 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18492 (secure 0 0 0) 0x7f4aa00cf7f0 con 0x7f4aac102920 2024-08-20T04:58:17.536 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:58:17.537 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":70,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","created":"2024-08-20T04:50:26.520303+0000","modified":"2024-08-20T04:58:13.613432+0000","last_up_change":"2024-08-20T04:58:12.250259+0000","last_in_change":"2024-08-20T04:57:49.724189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T04:54:16.381529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a813e53b-68b3-43ff-a59b-aed00e98f2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6803","nonce":3569936373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6805","nonce":3569936373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6809","nonce":3569936373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6807","nonce":3569936373}]},"public_addr":"172.21.15.37:6803/3569936373","cluster_addr":"172.21.15.37:6805/3569936373","heartbeat_back_addr":"172.21.15.37:6809/3569936373","heartbeat_front_addr":"172.21.15.37:6807/3569936373","state":["exists","up"]},{"osd":1,"uuid":"c216a8d0-9685-467a-8161-700682ce617c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6801","nonce":4206461125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6803","nonce":4206461125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6807","nonce":4206461125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6805","nonce":4206461125}]},"public_addr":"172.21.15.130:6801/4206461125","cluster_addr":"172.21.15.130:6803/4206461125","heartbeat_back_addr":"172.21.15.130:6807/4206461125","heartbeat_front_addr":"172.21.15.130:6805/4206461125","state":["exists","up"]},{"osd":2,"uuid":"34402442-c652-40eb-865e-a607a28846b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6801","nonce":2653255199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6803","nonce":2653255199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6807","nonce":2653255199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6805","nonce":2653255199}]},"public_addr":"172.21.15.135:6801/2653255199","cluster_addr":"172.21.15.135:6803/2653255199","heartbeat_back_addr":"172.21.15.135:6807/2653255199","heartbeat_front_addr":"172.21.15.135:6805/2653255199","state":["exists","up"]},{"osd":3,"uuid":"ec7be9dc-96b5-4816-9065-8121baedcdc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6811","nonce":2601290990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6813","nonce":2601290990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6817","nonce":2601290990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6815","nonce":2601290990}]},"public_addr":"172.21.15.37:6811/2601290990","cluster_addr":"172.21.15.37:6813/2601290990","heartbeat_back_addr":"172.21.15.37:6817/2601290990","heartbeat_front_addr":"172.21.15.37:6815/2601290990","state":["exists","up"]},{"osd":4,"uuid":"2dbd47f9-8686-4707-8862-3c7a99a37d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6809","nonce":3542081474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6811","nonce":3542081474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6815","nonce":3542081474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6813","nonce":3542081474}]},"public_addr":"172.21.15.130:6809/3542081474","cluster_addr":"172.21.15.130:6811/3542081474","heartbeat_back_addr":"172.21.15.130:6815/3542081474","heartbeat_front_addr":"172.21.15.130:6813/3542081474","state":["exists","up"]},{"osd":5,"uuid":"9a07a137-d6b7-4aba-8678-4fd164597f27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6809","nonce":2507249148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6811","nonce":2507249148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6815","nonce":2507249148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6813","nonce":2507249148}]},"public_addr":"172.21.15.135:6809/2507249148","cluster_addr":"172.21.15.135:6811/2507249148","heartbeat_back_addr":"172.21.15.135:6815/2507249148","heartbeat_front_addr":"172.21.15.135:6813/2507249148","state":["exists","up"]},{"osd":6,"uuid":"6d6346e8-5418-4c30-9bb3-5af352b616a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6819","nonce":155932692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6821","nonce":155932692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6825","nonce":155932692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6823","nonce":155932692}]},"public_addr":"172.21.15.37:6819/155932692","cluster_addr":"172.21.15.37:6821/155932692","heartbeat_back_addr":"172.21.15.37:6825/155932692","heartbeat_front_addr":"172.21.15.37:6823/155932692","state":["exists","up"]},{"osd":7,"uuid":"c87804c2-d456-495e-b36e-33dbb3548347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6817","nonce":4148130245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6819","nonce":4148130245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6823","nonce":4148130245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6821","nonce":4148130245}]},"public_addr":"172.21.15.130:6817/4148130245","cluster_addr":"172.21.15.130:6819/4148130245","heartbeat_back_addr":"172.21.15.130:6823/4148130245","heartbeat_front_addr":"172.21.15.130:6821/4148130245","state":["exists","up"]},{"osd":8,"uuid":"a7d4c9c8-1826-4703-92ad-ded2800b4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6817","nonce":222884649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6819","nonce":222884649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6823","nonce":222884649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6821","nonce":222884649}]},"public_addr":"172.21.15.135:6817/222884649","cluster_addr":"172.21.15.135:6819/222884649","heartbeat_back_addr":"172.21.15.135:6823/222884649","heartbeat_front_addr":"172.21.15.135:6821/222884649","state":["exists","up"]},{"osd":9,"uuid":"f9e0c194-66b5-4e62-b2ae-816a4a4fffbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6827","nonce":2240773042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6829","nonce":2240773042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6833","nonce":2240773042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6831","nonce":2240773042}]},"public_addr":"172.21.15.37:6827/2240773042","cluster_addr":"172.21.15.37:6829/2240773042","heartbeat_back_addr":"172.21.15.37:6833/2240773042","heartbeat_front_addr":"172.21.15.37:6831/2240773042","state":["exists","up"]},{"osd":10,"uuid":"fa6a50a5-2b97-42d1-9b57-b5502b7083d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6825","nonce":2896730163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6827","nonce":2896730163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6831","nonce":2896730163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6829","nonce":2896730163}]},"public_addr":"172.21.15.130:6825/2896730163","cluster_addr":"172.21.15.130:6827/2896730163","heartbeat_back_addr":"172.21.15.130:6831/2896730163","heartbeat_front_addr":"172.21.15.130:6829/2896730163","state":["exists","up"]},{"osd":11,"uuid":"9a305d75-030d-41db-abfb-81bb71e8c6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6825","nonce":2532897645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6827","nonce":2532897645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6831","nonce":2532897645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6829","nonce":2532897645}]},"public_addr":"172.21.15.135:6825/2532897645","cluster_addr":"172.21.15.135:6827/2532897645","heartbeat_back_addr":"172.21.15.135:6831/2532897645","heartbeat_front_addr":"172.21.15.135:6829/2532897645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:26.455665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:51.456030+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:14.332699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:42.749386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:07.587091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:32.450249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:01.864489+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:26.830527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:51.206257+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:20.400020+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:46.329864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:58:11.086508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4282140105":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/1217599998":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/3737412906":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/58912454":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/2105948300":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/1480362562":"2024-08-21T04:50:59.520912+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T04:58:17.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.536+0000 7f4ab2000640 1 -- 172.21.15.37:0/895654037 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a940b3cf0 msgr2=0x7f4a940b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:17.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.536+0000 7f4ab2000640 1 --2- 172.21.15.37:0/895654037 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a940b3cf0 0x7f4a940b61b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4aac076cc0 tx=0x7f4a98005f90 comp rx=0 tx=0).stop 2024-08-20T04:58:17.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.536+0000 7f4ab2000640 1 -- 172.21.15.37:0/895654037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4aac102920 msgr2=0x7f4aac0751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:17.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.536+0000 7f4ab2000640 1 --2- 172.21.15.37:0/895654037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4aac102920 0x7f4aac0751d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0006010 tx=0x7f4aa0004060 comp rx=0 tx=0).stop 2024-08-20T04:58:17.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.536+0000 7f4ab2000640 1 -- 172.21.15.37:0/895654037 shutdown_connections 2024-08-20T04:58:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.536+0000 7f4ab2000640 1 --2- 172.21.15.37:0/895654037 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a940b3cf0 0x7f4a940b61b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.536+0000 7f4ab2000640 1 --2- 172.21.15.37:0/895654037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4aac108cb0 0x7f4aac075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.536+0000 7f4ab2000640 1 --2- 172.21.15.37:0/895654037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4aac108330 0x7f4aac075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.536+0000 7f4ab2000640 1 --2- 172.21.15.37:0/895654037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4aac102920 0x7f4aac0751d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.536+0000 7f4ab2000640 1 -- 172.21.15.37:0/895654037 >> 172.21.15.37:0/895654037 conn(0x7f4aac0fe350 msgr2=0x7f4aac100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.536+0000 7f4ab2000640 1 -- 172.21.15.37:0/895654037 shutdown_connections 2024-08-20T04:58:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:17.536+0000 7f4ab2000640 1 -- 172.21.15.37:0/895654037 wait complete. 2024-08-20T04:58:17.933 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:17 smithi037 ceph-mon[17265]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:17.933 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:17 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/895654037' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:58:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:17 smithi130 ceph-mon[22007]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:17 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/895654037' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:58:18.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:17 smithi135 ceph-mon[22342]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:18.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:17 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/895654037' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:58:18.567 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-20T04:54:16.381529+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-20T04:58:18.567 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-20T04:58:18.938 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:58:19.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.581+0000 7fa84dc00640 1 -- 172.21.15.37:0/1812765564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa848104c90 msgr2=0x7fa848105070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:19.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.581+0000 7fa84dc00640 1 --2- 172.21.15.37:0/1812765564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa848104c90 0x7fa848105070 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa838009900 tx=0x7fa83802a410 comp rx=0 tx=0).stop 2024-08-20T04:58:19.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.581+0000 7fa84dc00640 1 -- 172.21.15.37:0/1812765564 shutdown_connections 2024-08-20T04:58:19.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.581+0000 7fa84dc00640 1 --2- 172.21.15.37:0/1812765564 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa84810b020 0x7fa848111820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:19.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.581+0000 7fa84dc00640 1 --2- 172.21.15.37:0/1812765564 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa84810a6a0 0x7fa84810aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:19.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.581+0000 7fa84dc00640 1 --2- 172.21.15.37:0/1812765564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa848104c90 0x7fa848105070 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:19.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.581+0000 7fa84dc00640 1 -- 172.21.15.37:0/1812765564 >> 172.21.15.37:0/1812765564 conn(0x7fa8481006c0 msgr2=0x7fa848102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:19.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.581+0000 7fa84dc00640 1 -- 172.21.15.37:0/1812765564 shutdown_connections 2024-08-20T04:58:19.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.582+0000 7fa84dc00640 1 -- 172.21.15.37:0/1812765564 wait complete. 2024-08-20T04:58:19.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.582+0000 7fa84dc00640 1 Processor -- start 2024-08-20T04:58:19.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.583+0000 7fa84dc00640 1 -- start start 2024-08-20T04:58:19.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.583+0000 7fa84dc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa848104c90 0x7fa84819b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:19.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.583+0000 7fa84dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa84810a6a0 0x7fa84819b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:19.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.583+0000 7fa84dc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa84810b020 0x7fa8481a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:19.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.583+0000 7fa84dc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa848114d30 con 0x7fa84810a6a0 2024-08-20T04:58:19.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.583+0000 7fa84dc00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa848114bb0 con 0x7fa848104c90 2024-08-20T04:58:19.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.583+0000 7fa84dc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa848114eb0 con 0x7fa84810b020 2024-08-20T04:58:19.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.583+0000 7fa83e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa84810a6a0 0x7fa84819b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:19.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.583+0000 7fa83e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa84810a6a0 0x7fa84819b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41444/0 (socket says 172.21.15.37:41444) 2024-08-20T04:58:19.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.583+0000 7fa83e000640 1 -- 172.21.15.37:0/1109495699 learned_addr learned my addr 172.21.15.37:0/1109495699 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:58:19.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.583+0000 7fa846a00640 1 --2- 172.21.15.37:0/1109495699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa848104c90 0x7fa84819b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:19.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.583+0000 7fa847400640 1 --2- 172.21.15.37:0/1109495699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa84810b020 0x7fa8481a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:19.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.584+0000 7fa83e000640 1 -- 172.21.15.37:0/1109495699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa84810b020 msgr2=0x7fa8481a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:19.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.584+0000 7fa83e000640 1 --2- 172.21.15.37:0/1109495699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa84810b020 0x7fa8481a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:19.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.584+0000 7fa83e000640 1 -- 172.21.15.37:0/1109495699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa848104c90 msgr2=0x7fa84819b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:19.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.584+0000 7fa83e000640 1 --2- 172.21.15.37:0/1109495699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa848104c90 0x7fa84819b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:19.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.584+0000 7fa83e000640 1 -- 172.21.15.37:0/1109495699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8481a1260 con 0x7fa84810a6a0 2024-08-20T04:58:19.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.584+0000 7fa83e000640 1 --2- 172.21.15.37:0/1109495699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa84810a6a0 0x7fa84819b6f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa83000e9f0 tx=0x7fa83000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:19.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.584+0000 7fa83fe00640 1 -- 172.21.15.37:0/1109495699 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83000cd80 con 0x7fa84810a6a0 2024-08-20T04:58:19.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.584+0000 7fa83fe00640 1 -- 172.21.15.37:0/1109495699 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8300054d0 con 0x7fa84810a6a0 2024-08-20T04:58:19.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.584+0000 7fa84dc00640 1 -- 172.21.15.37:0/1109495699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8481a1550 con 0x7fa84810a6a0 2024-08-20T04:58:19.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.584+0000 7fa83fe00640 1 -- 172.21.15.37:0/1109495699 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830010690 con 0x7fa84810a6a0 2024-08-20T04:58:19.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.585+0000 7fa84dc00640 1 -- 172.21.15.37:0/1109495699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8481a7c10 con 0x7fa84810a6a0 2024-08-20T04:58:19.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.586+0000 7fa84dc00640 1 -- 172.21.15.37:0/1109495699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa848105070 con 0x7fa84810a6a0 2024-08-20T04:58:19.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.588+0000 7fa83fe00640 1 -- 172.21.15.37:0/1109495699 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fa830004e30 con 0x7fa84810a6a0 2024-08-20T04:58:19.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.589+0000 7fa83fe00640 1 --2- 172.21.15.37:0/1109495699 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa82c0b3bd0 0x7fa82c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:19.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.590+0000 7fa83fe00640 1 -- 172.21.15.37:0/1109495699 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fa8300e3e30 con 0x7fa84810a6a0 2024-08-20T04:58:19.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.590+0000 7fa846a00640 1 --2- 172.21.15.37:0/1109495699 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa82c0b3bd0 0x7fa82c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.591+0000 7fa846a00640 1 --2- 172.21.15.37:0/1109495699 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa82c0b3bd0 0x7fa82c0b6090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa838005ab0 tx=0x7fa838005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:19.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.592+0000 7fa83fe00640 1 -- 172.21.15.37:0/1109495699 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa830055e20 con 0x7fa84810a6a0 2024-08-20T04:58:19.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:19 smithi037 ceph-mon[17265]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:19.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.788+0000 7fa84dc00640 1 -- 172.21.15.37:0/1109495699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa84802e340 con 0x7fa84810a6a0 2024-08-20T04:58:19.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.788+0000 7fa83fe00640 1 -- 172.21.15.37:0/1109495699 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7fa8300ab880 con 0x7fa84810a6a0 2024-08-20T04:58:19.790 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-08-20T04:58:19.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.790+0000 7fa84dc00640 1 -- 172.21.15.37:0/1109495699 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa82c0b3bd0 msgr2=0x7fa82c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:19.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.790+0000 7fa84dc00640 1 --2- 172.21.15.37:0/1109495699 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa82c0b3bd0 0x7fa82c0b6090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa838005ab0 tx=0x7fa838005a20 comp rx=0 tx=0).stop 2024-08-20T04:58:19.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.790+0000 7fa84dc00640 1 -- 172.21.15.37:0/1109495699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa84810a6a0 msgr2=0x7fa84819b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:19.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.790+0000 7fa84dc00640 1 --2- 172.21.15.37:0/1109495699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa84810a6a0 0x7fa84819b6f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa83000e9f0 tx=0x7fa83000edf0 comp rx=0 tx=0).stop 2024-08-20T04:58:19.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.790+0000 7fa84dc00640 1 -- 172.21.15.37:0/1109495699 shutdown_connections 2024-08-20T04:58:19.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.790+0000 7fa84dc00640 1 --2- 172.21.15.37:0/1109495699 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa82c0b3bd0 0x7fa82c0b6090 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:19.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.790+0000 7fa84dc00640 1 --2- 172.21.15.37:0/1109495699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa84810b020 0x7fa8481a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:19.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.791+0000 7fa84dc00640 1 --2- 172.21.15.37:0/1109495699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa84810a6a0 0x7fa84819b6f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:19.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.791+0000 7fa84dc00640 1 --2- 172.21.15.37:0/1109495699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa848104c90 0x7fa84819b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:19.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.791+0000 7fa84dc00640 1 -- 172.21.15.37:0/1109495699 >> 172.21.15.37:0/1109495699 conn(0x7fa8481006c0 msgr2=0x7fa848102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:19.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.791+0000 7fa84dc00640 1 -- 172.21.15.37:0/1109495699 shutdown_connections 2024-08-20T04:58:19.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:19.791+0000 7fa84dc00640 1 -- 172.21.15.37:0/1109495699 wait complete. 2024-08-20T04:58:19.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:19 smithi130 ceph-mon[22007]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:20.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:19 smithi135 ceph-mon[22342]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:20.746 INFO:tasks.cephadm:Adding mds.a on smithi037 2024-08-20T04:58:20.746 INFO:tasks.cephadm:Adding mds.d on smithi037 2024-08-20T04:58:20.746 INFO:tasks.cephadm:Adding mds.g on smithi037 2024-08-20T04:58:20.746 INFO:tasks.cephadm:Adding mds.j on smithi037 2024-08-20T04:58:20.746 INFO:tasks.cephadm:Adding mds.b on smithi130 2024-08-20T04:58:20.746 INFO:tasks.cephadm:Adding mds.e on smithi130 2024-08-20T04:58:20.746 INFO:tasks.cephadm:Adding mds.h on smithi130 2024-08-20T04:58:20.746 INFO:tasks.cephadm:Adding mds.k on smithi130 2024-08-20T04:58:20.747 INFO:tasks.cephadm:Adding mds.c on smithi135 2024-08-20T04:58:20.747 INFO:tasks.cephadm:Adding mds.f on smithi135 2024-08-20T04:58:20.747 INFO:tasks.cephadm:Adding mds.i on smithi135 2024-08-20T04:58:20.747 INFO:tasks.cephadm:Adding mds.l on smithi135 2024-08-20T04:58:20.747 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph orch apply mds all '12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l' 2024-08-20T04:58:20.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:20 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1109495699' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T04:58:21.003 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T04:58:21.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:20 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1109495699' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T04:58:21.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:20 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1109495699' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T04:58:21.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.461+0000 7f9f95054640 1 -- 172.21.15.135:0/437023065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f901027b0 msgr2=0x7f9f90102c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:21.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.461+0000 7f9f95054640 1 --2- 172.21.15.135:0/437023065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f901027b0 0x7f9f90102c30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009960 tx=0x7f9f8402a460 comp rx=0 tx=0).stop 2024-08-20T04:58:21.472 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.461+0000 7f9f95054640 1 -- 172.21.15.135:0/437023065 shutdown_connections 2024-08-20T04:58:21.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.461+0000 7f9f95054640 1 --2- 172.21.15.135:0/437023065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f90103170 0x7f9f90109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:21.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.461+0000 7f9f95054640 1 --2- 172.21.15.135:0/437023065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f901027b0 0x7f9f90102c30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:21.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.461+0000 7f9f95054640 1 --2- 172.21.15.135:0/437023065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f90101650 0x7f9f90101a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:21.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.461+0000 7f9f95054640 1 -- 172.21.15.135:0/437023065 >> 172.21.15.135:0/437023065 conn(0x7f9f900fcf00 msgr2=0x7f9f900ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:21.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.461+0000 7f9f95054640 1 -- 172.21.15.135:0/437023065 shutdown_connections 2024-08-20T04:58:21.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.461+0000 7f9f95054640 1 -- 172.21.15.135:0/437023065 wait complete. 2024-08-20T04:58:21.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.462+0000 7f9f95054640 1 Processor -- start 2024-08-20T04:58:21.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.462+0000 7f9f95054640 1 -- start start 2024-08-20T04:58:21.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.462+0000 7f9f95054640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f90101650 0x7f9f9006bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:21.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.462+0000 7f9f95054640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f901027b0 0x7f9f9019da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:21.473 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.462+0000 7f9f95054640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f90103170 0x7f9f901a0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:21.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.462+0000 7f9f95054640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9010d3b0 con 0x7f9f90103170 2024-08-20T04:58:21.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.462+0000 7f9f95054640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9010d230 con 0x7f9f901027b0 2024-08-20T04:58:21.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.462+0000 7f9f95054640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9010d530 con 0x7f9f90101650 2024-08-20T04:58:21.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.462+0000 7f9f8ed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f90101650 0x7f9f9006bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:21.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.462+0000 7f9f8ed9d640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f90101650 0x7f9f9006bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.135:60508/0 (socket says 172.21.15.135:60508) 2024-08-20T04:58:21.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.462+0000 7f9f8ed9d640 1 -- 172.21.15.135:0/3273468186 learned_addr learned my addr 172.21.15.135:0/3273468186 (peer_addr_for_me v2:172.21.15.135:0/0) 2024-08-20T04:58:21.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.463+0000 7f9f8ed9d640 1 -- 172.21.15.135:0/3273468186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f901027b0 msgr2=0x7f9f9019da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:21.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.463+0000 7f9f8e59c640 1 --2- 172.21.15.135:0/3273468186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f901027b0 0x7f9f9019da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:21.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.463+0000 7f9f8ed9d640 1 --2- 172.21.15.135:0/3273468186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f901027b0 0x7f9f9019da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:21.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.463+0000 7f9f8ed9d640 1 -- 172.21.15.135:0/3273468186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f90103170 msgr2=0x7f9f901a0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:21.474 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.463+0000 7f9f8f59e640 1 --2- 172.21.15.135:0/3273468186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f90103170 0x7f9f901a0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:21.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.463+0000 7f9f8ed9d640 1 --2- 172.21.15.135:0/3273468186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f90103170 0x7f9f901a0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:21.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.463+0000 7f9f8ed9d640 1 -- 172.21.15.135:0/3273468186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f901a0900 con 0x7f9f90101650 2024-08-20T04:58:21.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.463+0000 7f9f8f59e640 1 --2- 172.21.15.135:0/3273468186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f90103170 0x7f9f901a0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T04:58:21.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.463+0000 7f9f8ed9d640 1 --2- 172.21.15.135:0/3273468186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f90101650 0x7f9f9006bb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000b4a0 tx=0x7f9f8000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:21.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.463+0000 7f9f77fff640 1 -- 172.21.15.135:0/3273468186 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f80014070 con 0x7f9f90101650 2024-08-20T04:58:21.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.463+0000 7f9f95054640 1 -- 172.21.15.135:0/3273468186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f901a0bf0 con 0x7f9f90101650 2024-08-20T04:58:21.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.463+0000 7f9f77fff640 1 -- 172.21.15.135:0/3273468186 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f80010ac0 con 0x7f9f90101650 2024-08-20T04:58:21.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.463+0000 7f9f77fff640 1 -- 172.21.15.135:0/3273468186 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f80017c30 con 0x7f9f90101650 2024-08-20T04:58:21.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.463+0000 7f9f95054640 1 -- 172.21.15.135:0/3273468186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f901a1130 con 0x7f9f90101650 2024-08-20T04:58:21.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.464+0000 7f9f95054640 1 -- 172.21.15.135:0/3273468186 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f90108b10 con 0x7f9f90101650 2024-08-20T04:58:21.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.466+0000 7f9f77fff640 1 -- 172.21.15.135:0/3273468186 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f9f80017070 con 0x7f9f90101650 2024-08-20T04:58:21.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.466+0000 7f9f77fff640 1 --2- 172.21.15.135:0/3273468186 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f780b3bd0 0x7f9f780b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:21.475 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.466+0000 7f9f77fff640 1 -- 172.21.15.135:0/3273468186 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f9f800e2ff0 con 0x7f9f90101650 2024-08-20T04:58:21.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.466+0000 7f9f8e59c640 1 --2- 172.21.15.135:0/3273468186 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f780b3bd0 0x7f9f780b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:21.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.467+0000 7f9f8e59c640 1 --2- 172.21.15.135:0/3273468186 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f780b3bd0 0x7f9f780b6090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f84005ec0 tx=0x7f9f84005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:21.476 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.470+0000 7f9f77fff640 1 -- 172.21.15.135:0/3273468186 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f9f800aaae0 con 0x7f9f90101650 2024-08-20T04:58:21.660 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.658+0000 7f9f95054640 1 -- 172.21.15.135:0/3273468186 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l", "target": ["mon-mgr", ""]}) -- 0x7f9f900633c0 con 0x7f9f780b3bd0 2024-08-20T04:58:21.668 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.666+0000 7f9f77fff640 1 -- 172.21.15.135:0/3273468186 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f9f900633c0 con 0x7f9f780b3bd0 2024-08-20T04:58:21.668 INFO:teuthology.orchestra.run.smithi135.stdout:Scheduled mds.all update... 2024-08-20T04:58:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.668+0000 7f9f95054640 1 -- 172.21.15.135:0/3273468186 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f780b3bd0 msgr2=0x7f9f780b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.668+0000 7f9f95054640 1 --2- 172.21.15.135:0/3273468186 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f780b3bd0 0x7f9f780b6090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f84005ec0 tx=0x7f9f84005fd0 comp rx=0 tx=0).stop 2024-08-20T04:58:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.668+0000 7f9f95054640 1 -- 172.21.15.135:0/3273468186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f90101650 msgr2=0x7f9f9006bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.668+0000 7f9f95054640 1 --2- 172.21.15.135:0/3273468186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f90101650 0x7f9f9006bb30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000b4a0 tx=0x7f9f8000b960 comp rx=0 tx=0).stop 2024-08-20T04:58:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.668+0000 7f9f95054640 1 -- 172.21.15.135:0/3273468186 shutdown_connections 2024-08-20T04:58:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.668+0000 7f9f95054640 1 --2- 172.21.15.135:0/3273468186 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f780b3bd0 0x7f9f780b6090 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.668+0000 7f9f95054640 1 --2- 172.21.15.135:0/3273468186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f90103170 0x7f9f901a0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.668+0000 7f9f95054640 1 --2- 172.21.15.135:0/3273468186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f901027b0 0x7f9f9019da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.668+0000 7f9f95054640 1 --2- 172.21.15.135:0/3273468186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f90101650 0x7f9f9006bb30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.668+0000 7f9f95054640 1 -- 172.21.15.135:0/3273468186 >> 172.21.15.135:0/3273468186 conn(0x7f9f900fcf00 msgr2=0x7f9f90105ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.668+0000 7f9f95054640 1 -- 172.21.15.135:0/3273468186 shutdown_connections 2024-08-20T04:58:21.671 INFO:teuthology.orchestra.run.smithi135.stderr:2024-08-20T04:58:21.668+0000 7f9f95054640 1 -- 172.21.15.135:0/3273468186 wait complete. 2024-08-20T04:58:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:21 smithi130 ceph-mon[22007]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:22.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:21 smithi037 ceph-mon[17265]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:22.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:21 smithi135 ceph-mon[22342]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:22.367 DEBUG:teuthology.orchestra.run.smithi037:mds.a> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.a.service 2024-08-20T04:58:22.372 DEBUG:teuthology.orchestra.run.smithi037:mds.d> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.d.service 2024-08-20T04:58:22.416 DEBUG:teuthology.orchestra.run.smithi037:mds.g> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.g.service 2024-08-20T04:58:22.461 DEBUG:teuthology.orchestra.run.smithi037:mds.j> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.j.service 2024-08-20T04:58:22.506 DEBUG:teuthology.orchestra.run.smithi130:mds.b> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.b.service 2024-08-20T04:58:22.509 DEBUG:teuthology.orchestra.run.smithi130:mds.e> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.e.service 2024-08-20T04:58:22.552 DEBUG:teuthology.orchestra.run.smithi130:mds.h> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.h.service 2024-08-20T04:58:22.595 DEBUG:teuthology.orchestra.run.smithi130:mds.k> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.k.service 2024-08-20T04:58:22.638 DEBUG:teuthology.orchestra.run.smithi135:mds.c> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.c.service 2024-08-20T04:58:22.641 DEBUG:teuthology.orchestra.run.smithi135:mds.f> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.f.service 2024-08-20T04:58:22.672 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:22 smithi037 ceph-mon[17265]: from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:58:22.672 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:22 smithi037 ceph-mon[17265]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l;count:12 2024-08-20T04:58:22.672 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:22.672 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:58:22.672 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:22.672 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:58:22.672 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:22.684 DEBUG:teuthology.orchestra.run.smithi135:mds.i> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.i.service 2024-08-20T04:58:22.727 DEBUG:teuthology.orchestra.run.smithi135:mds.l> sudo journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.l.service 2024-08-20T04:58:22.770 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-08-20T04:58:22.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T04:58:22.788 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:22 smithi135 ceph-mon[22342]: from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:58:22.788 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:22 smithi135 ceph-mon[22342]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l;count:12 2024-08-20T04:58:22.788 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:22.788 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:58:22.789 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:22.789 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:58:22.789 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:22.789 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:22.789 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:22.789 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:22.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:22 smithi130 ceph-mon[22007]: from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T04:58:22.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:22 smithi130 ceph-mon[22007]: Saving service mds.all spec with placement smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l;count:12 2024-08-20T04:58:22.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:22.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:58:22.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:22.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:58:22.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:22.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:22.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:22.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:23.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:23.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:23.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:23.142 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:58:23.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.720+0000 7f889d800640 1 -- 172.21.15.37:0/1868297870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88981084c0 msgr2=0x7f8898108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:23.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.720+0000 7f889d800640 1 --2- 172.21.15.37:0/1868297870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88981084c0 0x7f8898108900 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8880009900 tx=0x7f888002a3f0 comp rx=0 tx=0).stop 2024-08-20T04:58:23.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.720+0000 7f889d800640 1 -- 172.21.15.37:0/1868297870 shutdown_connections 2024-08-20T04:58:23.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.720+0000 7f889d800640 1 --2- 172.21.15.37:0/1868297870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8898108e40 0x7f889810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:23.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.720+0000 7f889d800640 1 --2- 172.21.15.37:0/1868297870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88981084c0 0x7f8898108900 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:23.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.720+0000 7f889d800640 1 --2- 172.21.15.37:0/1868297870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8898102ab0 0x7f8898102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:23.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.720+0000 7f889d800640 1 -- 172.21.15.37:0/1868297870 >> 172.21.15.37:0/1868297870 conn(0x7f88980fe500 msgr2=0x7f8898100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:23.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.720+0000 7f889d800640 1 -- 172.21.15.37:0/1868297870 shutdown_connections 2024-08-20T04:58:23.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.720+0000 7f889d800640 1 -- 172.21.15.37:0/1868297870 wait complete. 2024-08-20T04:58:23.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.721+0000 7f889d800640 1 Processor -- start 2024-08-20T04:58:23.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.721+0000 7f889d800640 1 -- start start 2024-08-20T04:58:23.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.722+0000 7f889d800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8898102ab0 0x7f889819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:23.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.722+0000 7f889d800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88981084c0 0x7f889819b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:23.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.722+0000 7f889d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8898108e40 0x7f88981a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:23.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.722+0000 7f889d800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8898112ae0 con 0x7f8898108e40 2024-08-20T04:58:23.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.722+0000 7f889d800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8898112960 con 0x7f8898102ab0 2024-08-20T04:58:23.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.722+0000 7f889d800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8898112c60 con 0x7f88981084c0 2024-08-20T04:58:23.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.722+0000 7f8897400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8898108e40 0x7f88981a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:23.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.722+0000 7f8897400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8898108e40 0x7f88981a0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51560/0 (socket says 172.21.15.37:51560) 2024-08-20T04:58:23.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.722+0000 7f8897400640 1 -- 172.21.15.37:0/3138742960 learned_addr learned my addr 172.21.15.37:0/3138742960 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:58:23.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.722+0000 7f8896a00640 1 --2- 172.21.15.37:0/3138742960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8898102ab0 0x7f889819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:23.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.722+0000 7f888e000640 1 --2- 172.21.15.37:0/3138742960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88981084c0 0x7f889819b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.723+0000 7f8897400640 1 -- 172.21.15.37:0/3138742960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88981084c0 msgr2=0x7f889819b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.723+0000 7f8897400640 1 --2- 172.21.15.37:0/3138742960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88981084c0 0x7f889819b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.723+0000 7f8897400640 1 -- 172.21.15.37:0/3138742960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8898102ab0 msgr2=0x7f889819b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.723+0000 7f8897400640 1 --2- 172.21.15.37:0/3138742960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8898102ab0 0x7f889819b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.723+0000 7f8897400640 1 -- 172.21.15.37:0/3138742960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88981a1270 con 0x7f8898108e40 2024-08-20T04:58:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.723+0000 7f8896a00640 1 --2- 172.21.15.37:0/3138742960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8898102ab0 0x7f889819b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:58:23.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.723+0000 7f8897400640 1 --2- 172.21.15.37:0/3138742960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8898108e40 0x7f88981a0aa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f889000eaa0 tx=0x7f889000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.723+0000 7f888fe00640 1 -- 172.21.15.37:0/3138742960 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889000cdb0 con 0x7f8898108e40 2024-08-20T04:58:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.723+0000 7f888fe00640 1 -- 172.21.15.37:0/3138742960 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8890005020 con 0x7f8898108e40 2024-08-20T04:58:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.723+0000 7f888fe00640 1 -- 172.21.15.37:0/3138742960 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88900116d0 con 0x7f8898108e40 2024-08-20T04:58:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.723+0000 7f889d800640 1 -- 172.21.15.37:0/3138742960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88981a1560 con 0x7f8898108e40 2024-08-20T04:58:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.723+0000 7f889d800640 1 -- 172.21.15.37:0/3138742960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88981a7c20 con 0x7f8898108e40 2024-08-20T04:58:23.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.725+0000 7f889d800640 1 -- 172.21.15.37:0/3138742960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8898102e90 con 0x7f8898108e40 2024-08-20T04:58:23.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.727+0000 7f888fe00640 1 -- 172.21.15.37:0/3138742960 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f88900051d0 con 0x7f8898108e40 2024-08-20T04:58:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.728+0000 7f888fe00640 1 --2- 172.21.15.37:0/3138742960 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f887c0b3c50 0x7f887c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.728+0000 7f888fe00640 1 -- 172.21.15.37:0/3138742960 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f88900e38b0 con 0x7f8898108e40 2024-08-20T04:58:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.728+0000 7f8896a00640 1 --2- 172.21.15.37:0/3138742960 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f887c0b3c50 0x7f887c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:23.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.729+0000 7f8896a00640 1 --2- 172.21.15.37:0/3138742960 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f887c0b3c50 0x7f887c0b6110 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8888009fc0 tx=0x7f8888005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:23.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.732+0000 7f888fe00640 1 -- 172.21.15.37:0/3138742960 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f8890016030 con 0x7f8898108e40 2024-08-20T04:58:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:23 smithi135 ceph-mon[22342]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:23 smithi135 ceph-mon[22342]: Deploying daemon mds.l on smithi135 2024-08-20T04:58:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:23 smithi130 ceph-mon[22007]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:23 smithi130 ceph-mon[22007]: Deploying daemon mds.l on smithi135 2024-08-20T04:58:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.965+0000 7f889d800640 1 -- 172.21.15.37:0/3138742960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f889802e340 con 0x7f8898108e40 2024-08-20T04:58:23.968 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:23 smithi037 ceph-mon[17265]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:23.968 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:23 smithi037 ceph-mon[17265]: Deploying daemon mds.l on smithi135 2024-08-20T04:58:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.966+0000 7f888fe00640 1 -- 172.21.15.37:0/3138742960 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f88900aacb0 con 0x7f8898108e40 2024-08-20T04:58:23.968 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:58:23.969 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"btime":"2024-08-20T04:50:26:520042+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-08-20T04:58:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 1 2024-08-20T04:58:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.969+0000 7f889d800640 1 -- 172.21.15.37:0/3138742960 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f887c0b3c50 msgr2=0x7f887c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.969+0000 7f889d800640 1 --2- 172.21.15.37:0/3138742960 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f887c0b3c50 0x7f887c0b6110 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8888009fc0 tx=0x7f8888005f90 comp rx=0 tx=0).stop 2024-08-20T04:58:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.969+0000 7f889d800640 1 -- 172.21.15.37:0/3138742960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8898108e40 msgr2=0x7f88981a0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.969+0000 7f889d800640 1 --2- 172.21.15.37:0/3138742960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8898108e40 0x7f88981a0aa0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f889000eaa0 tx=0x7f889000ef60 comp rx=0 tx=0).stop 2024-08-20T04:58:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.969+0000 7f889d800640 1 -- 172.21.15.37:0/3138742960 shutdown_connections 2024-08-20T04:58:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.969+0000 7f889d800640 1 --2- 172.21.15.37:0/3138742960 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f887c0b3c50 0x7f887c0b6110 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.969+0000 7f889d800640 1 --2- 172.21.15.37:0/3138742960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8898108e40 0x7f88981a0aa0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.969+0000 7f889d800640 1 --2- 172.21.15.37:0/3138742960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f88981084c0 0x7f889819b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.969+0000 7f889d800640 1 --2- 172.21.15.37:0/3138742960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8898102ab0 0x7f889819b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.969+0000 7f889d800640 1 -- 172.21.15.37:0/3138742960 >> 172.21.15.37:0/3138742960 conn(0x7f88980fe500 msgr2=0x7f8898105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.969+0000 7f889d800640 1 -- 172.21.15.37:0/3138742960 shutdown_connections 2024-08-20T04:58:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:23.969+0000 7f889d800640 1 -- 172.21.15.37:0/3138742960 wait complete. 2024-08-20T04:58:24.255 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 04:58:24 smithi135 systemd[1]: Starting Ceph mds.l for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T04:58:24.508 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 04:58:24 smithi135 podman[51636]: 2024-08-20 04:58:24.156507156 +0000 UTC m=+0.016005776 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T04:58:24.615 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 04:58:24 smithi135 podman[51636]: 2024-08-20 04:58:24.270087205 +0000 UTC m=+0.129585818 container create 189e6b2e677f9ed589b086251fe0462d05e1e4dc0031656960eaf61da454e1db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-l, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731) 2024-08-20T04:58:24.615 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 04:58:24 smithi135 podman[51636]: 2024-08-20 04:58:24.481069033 +0000 UTC m=+0.340567644 container init 189e6b2e677f9ed589b086251fe0462d05e1e4dc0031656960eaf61da454e1db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T04:58:24.615 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 04:58:24 smithi135 podman[51636]: 2024-08-20 04:58:24.483921186 +0000 UTC m=+0.343419797 container start 189e6b2e677f9ed589b086251fe0462d05e1e4dc0031656960eaf61da454e1db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-l, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-20T04:58:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:24 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3138742960' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:24 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.135:6832/4059666386,v1:172.21.15.135:6833/4059666386] up:boot 2024-08-20T04:58:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:24 smithi037 ceph-mon[17265]: fsmap 1 up:standby 2024-08-20T04:58:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:24 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-20T04:58:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:24 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:24 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:24 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:24 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:24 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:24 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:24.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:24 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3138742960' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:24.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:24 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.135:6832/4059666386,v1:172.21.15.135:6833/4059666386] up:boot 2024-08-20T04:58:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:24 smithi135 ceph-mon[22342]: fsmap 1 up:standby 2024-08-20T04:58:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:24 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-20T04:58:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:24 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:24 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:24 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:24 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:24 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:24 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:24.866 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 04:58:24 smithi135 ceph-mds[51656]: -- 172.21.15.135:0/2861671625 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5565870ff860 con 0x5565870dc800 2024-08-20T04:58:24.866 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 04:58:24 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-l[51652]: starting mds.l at 2024-08-20T04:58:24.867 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 04:58:24 smithi135 bash[51636]: 189e6b2e677f9ed589b086251fe0462d05e1e4dc0031656960eaf61da454e1db 2024-08-20T04:58:24.867 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 04:58:24 smithi135 systemd[1]: Started Ceph mds.l for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:58:24.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:24 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3138742960' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:24.974 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:24 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.135:6832/4059666386,v1:172.21.15.135:6833/4059666386] up:boot 2024-08-20T04:58:24.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:24 smithi130 ceph-mon[22007]: fsmap 1 up:standby 2024-08-20T04:58:24.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:24 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-20T04:58:24.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:24 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:24.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:24 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:24.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:24 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:24.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:24 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:24.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:24 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:24.975 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:24 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:25.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:25 smithi130 ceph-mon[22007]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:25.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:25 smithi130 ceph-mon[22007]: Deploying daemon mds.k on smithi130 2024-08-20T04:58:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:25 smithi037 ceph-mon[17265]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:25 smithi037 ceph-mon[17265]: Deploying daemon mds.k on smithi130 2024-08-20T04:58:26.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:25 smithi135 ceph-mon[22342]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:26.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:25 smithi135 ceph-mon[22342]: Deploying daemon mds.k on smithi130 2024-08-20T04:58:26.991 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 20 04:58:26 smithi130 podman[50852]: 2024-08-20 04:58:26.98695462 +0000 UTC m=+0.363242066 container init 410859f184b578765d795984af85d144aaefd0600550cf86698f4ae3ba14dd43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-k, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T04:58:26.991 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 20 04:58:26 smithi130 podman[50852]: 2024-08-20 04:58:26.9897981 +0000 UTC m=+0.366085544 container start 410859f184b578765d795984af85d144aaefd0600550cf86698f4ae3ba14dd43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-k, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T04:58:27.005 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T04:58:27.404 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:58:27.455 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 20 04:58:27 smithi130 ceph-mds[50872]: -- 172.21.15.130:0/741084181 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ceb9d79860 con 0x55ceb9d56800 2024-08-20T04:58:27.455 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 20 04:58:27 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-k[50868]: starting mds.k at 2024-08-20T04:58:27.456 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 20 04:58:27 smithi130 bash[50852]: 410859f184b578765d795984af85d144aaefd0600550cf86698f4ae3ba14dd43 2024-08-20T04:58:27.456 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 20 04:58:27 smithi130 systemd[1]: Started Ceph mds.k for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:58:27.876 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:27 smithi037 ceph-mon[17265]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:27.877 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:27.877 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:27.877 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:27.877 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:27.877 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:27.877 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:27 smithi130 ceph-mon[22007]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:27.995 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:27.995 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:27.995 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:27.995 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:27.996 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:27.996 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:28.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.995+0000 7fe801e00640 1 -- 172.21.15.37:0/2876774290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7fc108e40 msgr2=0x7fe7fc10f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:28.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.995+0000 7fe801e00640 1 --2- 172.21.15.37:0/2876774290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7fc108e40 0x7fe7fc10f640 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4009ca0 tx=0x7fe7f402a8c0 comp rx=0 tx=0).stop 2024-08-20T04:58:28.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.996+0000 7fe801e00640 1 -- 172.21.15.37:0/2876774290 shutdown_connections 2024-08-20T04:58:28.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.996+0000 7fe801e00640 1 --2- 172.21.15.37:0/2876774290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7fc108e40 0x7fe7fc10f640 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:28.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.996+0000 7fe801e00640 1 --2- 172.21.15.37:0/2876774290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7fc1084c0 0x7fe7fc108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:28.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.996+0000 7fe801e00640 1 --2- 172.21.15.37:0/2876774290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7fc102ab0 0x7fe7fc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:28.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.996+0000 7fe801e00640 1 -- 172.21.15.37:0/2876774290 >> 172.21.15.37:0/2876774290 conn(0x7fe7fc0fe500 msgr2=0x7fe7fc100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:28.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.996+0000 7fe801e00640 1 -- 172.21.15.37:0/2876774290 shutdown_connections 2024-08-20T04:58:28.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.996+0000 7fe801e00640 1 -- 172.21.15.37:0/2876774290 wait complete. 2024-08-20T04:58:28.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.997+0000 7fe801e00640 1 Processor -- start 2024-08-20T04:58:28.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.997+0000 7fe801e00640 1 -- start start 2024-08-20T04:58:28.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.998+0000 7fe801e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7fc102ab0 0x7fe7fc19b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:28.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.998+0000 7fe801e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7fc1084c0 0x7fe7fc19b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:28.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.998+0000 7fe801e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7fc108e40 0x7fe7fc1a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:28.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.998+0000 7fe801e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc112ac0 con 0x7fe7fc1084c0 2024-08-20T04:58:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.998+0000 7fe801e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc112940 con 0x7fe7fc108e40 2024-08-20T04:58:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.998+0000 7fe801e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc112c40 con 0x7fe7fc102ab0 2024-08-20T04:58:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.998+0000 7fe7fa000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7fc1084c0 0x7fe7fc19b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.998+0000 7fe7fa000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7fc1084c0 0x7fe7fc19b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51586/0 (socket says 172.21.15.37:51586) 2024-08-20T04:58:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.998+0000 7fe7fa000640 1 -- 172.21.15.37:0/2123003840 learned_addr learned my addr 172.21.15.37:0/2123003840 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:58:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.998+0000 7fe7faa00640 1 --2- 172.21.15.37:0/2123003840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7fc102ab0 0x7fe7fc19b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.998+0000 7fe7fb400640 1 --2- 172.21.15.37:0/2123003840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7fc108e40 0x7fe7fc1a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.998+0000 7fe7fa000640 1 -- 172.21.15.37:0/2123003840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7fc102ab0 msgr2=0x7fe7fc19b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.998+0000 7fe7fa000640 1 --2- 172.21.15.37:0/2123003840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7fc102ab0 0x7fe7fc19b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.998+0000 7fe7fa000640 1 -- 172.21.15.37:0/2123003840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7fc108e40 msgr2=0x7fe7fc1a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.998+0000 7fe7fa000640 1 --2- 172.21.15.37:0/2123003840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7fc108e40 0x7fe7fc1a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.998+0000 7fe7fa000640 1 -- 172.21.15.37:0/2123003840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7fc1a1230 con 0x7fe7fc1084c0 2024-08-20T04:58:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.998+0000 7fe7fb400640 1 --2- 172.21.15.37:0/2123003840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7fc108e40 0x7fe7fc1a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T04:58:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.999+0000 7fe7fa000640 1 --2- 172.21.15.37:0/2123003840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7fc1084c0 0x7fe7fc19b6c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800d950 tx=0x7fe7e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.999+0000 7fe800a00640 1 -- 172.21.15.37:0/2123003840 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8017070 con 0x7fe7fc1084c0 2024-08-20T04:58:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.999+0000 7fe800a00640 1 -- 172.21.15.37:0/2123003840 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7e8009c30 con 0x7fe7fc1084c0 2024-08-20T04:58:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.999+0000 7fe801e00640 1 -- 172.21.15.37:0/2123003840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7fc1a1520 con 0x7fe7fc1084c0 2024-08-20T04:58:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.999+0000 7fe800a00640 1 -- 172.21.15.37:0/2123003840 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800f620 con 0x7fe7fc1084c0 2024-08-20T04:58:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:27.999+0000 7fe801e00640 1 -- 172.21.15.37:0/2123003840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7fc1a7db0 con 0x7fe7fc1084c0 2024-08-20T04:58:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.000+0000 7fe801e00640 1 -- 172.21.15.37:0/2123003840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7fc103d60 con 0x7fe7fc1084c0 2024-08-20T04:58:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.003+0000 7fe800a00640 1 -- 172.21.15.37:0/2123003840 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fe7e8010460 con 0x7fe7fc1084c0 2024-08-20T04:58:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.006+0000 7fe800a00640 1 --2- 172.21.15.37:0/2123003840 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe7e00b3c50 0x7fe7e00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.006+0000 7fe800a00640 1 -- 172.21.15.37:0/2123003840 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fe7e80e33a0 con 0x7fe7fc1084c0 2024-08-20T04:58:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.006+0000 7fe7faa00640 1 --2- 172.21.15.37:0/2123003840 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe7e00b3c50 0x7fe7e00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:28.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.007+0000 7fe7faa00640 1 --2- 172.21.15.37:0/2123003840 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe7e00b3c50 0x7fe7e00b6110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0095f0 tx=0x7fe7ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:28.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.007+0000 7fe800a00640 1 -- 172.21.15.37:0/2123003840 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe7e80aae70 con 0x7fe7fc1084c0 2024-08-20T04:58:28.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:27 smithi135 ceph-mon[22342]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:28.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:28.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:28.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:28.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:28.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:28.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:28.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.261+0000 7fe801e00640 1 -- 172.21.15.37:0/2123003840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7fc102e90 con 0x7fe7fc1084c0 2024-08-20T04:58:28.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.261+0000 7fe800a00640 1 -- 172.21.15.37:0/2123003840 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7fe7e8009de0 con 0x7fe7fc1084c0 2024-08-20T04:58:28.263 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:58:28.263 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":3,"btime":"2024-08-20T04:58:27:973430+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-20T04:58:28.263 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 3 2024-08-20T04:58:28.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.264+0000 7fe801e00640 1 -- 172.21.15.37:0/2123003840 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe7e00b3c50 msgr2=0x7fe7e00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:28.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.264+0000 7fe801e00640 1 --2- 172.21.15.37:0/2123003840 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe7e00b3c50 0x7fe7e00b6110 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0095f0 tx=0x7fe7ec005f90 comp rx=0 tx=0).stop 2024-08-20T04:58:28.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.264+0000 7fe801e00640 1 -- 172.21.15.37:0/2123003840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7fc1084c0 msgr2=0x7fe7fc19b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:28.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.264+0000 7fe801e00640 1 --2- 172.21.15.37:0/2123003840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7fc1084c0 0x7fe7fc19b6c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800d950 tx=0x7fe7e800de10 comp rx=0 tx=0).stop 2024-08-20T04:58:28.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.264+0000 7fe801e00640 1 -- 172.21.15.37:0/2123003840 shutdown_connections 2024-08-20T04:58:28.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.264+0000 7fe801e00640 1 --2- 172.21.15.37:0/2123003840 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe7e00b3c50 0x7fe7e00b6110 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:28.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.264+0000 7fe801e00640 1 --2- 172.21.15.37:0/2123003840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe7fc108e40 0x7fe7fc1a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:28.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.264+0000 7fe801e00640 1 --2- 172.21.15.37:0/2123003840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7fc1084c0 0x7fe7fc19b6c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:28.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.264+0000 7fe801e00640 1 --2- 172.21.15.37:0/2123003840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe7fc102ab0 0x7fe7fc19b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:28.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.264+0000 7fe801e00640 1 -- 172.21.15.37:0/2123003840 >> 172.21.15.37:0/2123003840 conn(0x7fe7fc0fe500 msgr2=0x7fe7fc075100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:28.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.264+0000 7fe801e00640 1 -- 172.21.15.37:0/2123003840 shutdown_connections 2024-08-20T04:58:28.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:28.264+0000 7fe801e00640 1 -- 172.21.15.37:0/2123003840 wait complete. 2024-08-20T04:58:28.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:28 smithi130 ceph-mon[22007]: Deploying daemon mds.j on smithi037 2024-08-20T04:58:28.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:28 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.130:6832/1818782678,v1:172.21.15.130:6833/1818782678] up:boot 2024-08-20T04:58:28.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:28 smithi130 ceph-mon[22007]: fsmap 2 up:standby 2024-08-20T04:58:28.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-20T04:58:28.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:28 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2123003840' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:29.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:28 smithi037 ceph-mon[17265]: Deploying daemon mds.j on smithi037 2024-08-20T04:58:29.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:28 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.130:6832/1818782678,v1:172.21.15.130:6833/1818782678] up:boot 2024-08-20T04:58:29.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:28 smithi037 ceph-mon[17265]: fsmap 2 up:standby 2024-08-20T04:58:29.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-20T04:58:29.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:28 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2123003840' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:29.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:28 smithi135 ceph-mon[22342]: Deploying daemon mds.j on smithi037 2024-08-20T04:58:29.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:28 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.130:6832/1818782678,v1:172.21.15.130:6833/1818782678] up:boot 2024-08-20T04:58:29.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:28 smithi135 ceph-mon[22342]: fsmap 2 up:standby 2024-08-20T04:58:29.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-20T04:58:29.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:28 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2123003840' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:29.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:29 smithi037 ceph-mon[17265]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:29.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:29 smithi130 ceph-mon[22007]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:30.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:29 smithi135 ceph-mon[22342]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:31.473 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 20 04:58:31 smithi037 systemd[1]: Starting Ceph mds.j for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T04:58:31.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:31 smithi037 ceph-mon[17265]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:31.767 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 20 04:58:31 smithi037 podman[59391]: 2024-08-20 04:58:31.375769744 +0000 UTC m=+0.027804895 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T04:58:31.767 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 20 04:58:31 smithi037 podman[59391]: 2024-08-20 04:58:31.515909909 +0000 UTC m=+0.167945050 container create ee4ea35400eca8d3508823bce19f90f026e3e44e67e0a680f0b599caf4034479 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-j, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-20T04:58:31.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:31 smithi130 ceph-mon[22007]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:31.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T04:58:32.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:31 smithi135 ceph-mon[22342]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:32.265 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 20 04:58:31 smithi037 podman[59391]: 2024-08-20 04:58:31.801974992 +0000 UTC m=+0.454010142 container init ee4ea35400eca8d3508823bce19f90f026e3e44e67e0a680f0b599caf4034479 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-j, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-20T04:58:32.265 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 20 04:58:31 smithi037 podman[59391]: 2024-08-20 04:58:31.808345973 +0000 UTC m=+0.460381121 container start ee4ea35400eca8d3508823bce19f90f026e3e44e67e0a680f0b599caf4034479 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-j, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T04:58:32.266 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 20 04:58:31 smithi037 ceph-mds[59410]: -- 172.21.15.37:0/1968000923 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5560947b3860 con 0x556094790800 2024-08-20T04:58:32.266 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 20 04:58:31 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-j[59406]: starting mds.j at 2024-08-20T04:58:32.266 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 20 04:58:31 smithi037 bash[59391]: ee4ea35400eca8d3508823bce19f90f026e3e44e67e0a680f0b599caf4034479 2024-08-20T04:58:32.266 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 20 04:58:31 smithi037 systemd[1]: Started Ceph mds.j for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:58:32.392 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:58:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.969+0000 7fbad8c00640 1 -- 172.21.15.37:0/1391251969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbad4104ca0 msgr2=0x7fbad4105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.969+0000 7fbad8c00640 1 --2- 172.21.15.37:0/1391251969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbad4104ca0 0x7fbad4105080 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009900 tx=0x7fbac402a410 comp rx=0 tx=0).stop 2024-08-20T04:58:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.969+0000 7fbad8c00640 1 -- 172.21.15.37:0/1391251969 shutdown_connections 2024-08-20T04:58:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.969+0000 7fbad8c00640 1 --2- 172.21.15.37:0/1391251969 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbad410b030 0x7fbad4111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.969+0000 7fbad8c00640 1 --2- 172.21.15.37:0/1391251969 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbad410a6b0 0x7fbad410aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.969+0000 7fbad8c00640 1 --2- 172.21.15.37:0/1391251969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbad4104ca0 0x7fbad4105080 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.969+0000 7fbad8c00640 1 -- 172.21.15.37:0/1391251969 >> 172.21.15.37:0/1391251969 conn(0x7fbad4100730 msgr2=0x7fbad4102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.969+0000 7fbad8c00640 1 -- 172.21.15.37:0/1391251969 shutdown_connections 2024-08-20T04:58:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.969+0000 7fbad8c00640 1 -- 172.21.15.37:0/1391251969 wait complete. 2024-08-20T04:58:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.970+0000 7fbad8c00640 1 Processor -- start 2024-08-20T04:58:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.970+0000 7fbad8c00640 1 -- start start 2024-08-20T04:58:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.971+0000 7fbad8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbad4104ca0 0x7fbad419b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.971+0000 7fbad8c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbad410a6b0 0x7fbad419b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.971+0000 7fbad8c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbad410b030 0x7fbad41a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.971+0000 7fbad8c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbad4114d00 con 0x7fbad4104ca0 2024-08-20T04:58:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.971+0000 7fbad8c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbad4114b80 con 0x7fbad410b030 2024-08-20T04:58:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.971+0000 7fbad8c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbad4114e80 con 0x7fbad410a6b0 2024-08-20T04:58:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.971+0000 7fbad1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbad4104ca0 0x7fbad419b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.971+0000 7fbad1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbad4104ca0 0x7fbad419b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53922/0 (socket says 172.21.15.37:53922) 2024-08-20T04:58:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.971+0000 7fbad1e00640 1 -- 172.21.15.37:0/3154238999 learned_addr learned my addr 172.21.15.37:0/3154238999 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:58:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.971+0000 7fbad2800640 1 --2- 172.21.15.37:0/3154238999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbad410b030 0x7fbad41a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.971+0000 7fbac9400640 1 --2- 172.21.15.37:0/3154238999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbad410a6b0 0x7fbad419b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.971+0000 7fbad1e00640 1 -- 172.21.15.37:0/3154238999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbad410a6b0 msgr2=0x7fbad419b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.971+0000 7fbad1e00640 1 --2- 172.21.15.37:0/3154238999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbad410a6b0 0x7fbad419b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:32.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.971+0000 7fbad1e00640 1 -- 172.21.15.37:0/3154238999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbad410b030 msgr2=0x7fbad41a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:32.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.971+0000 7fbad1e00640 1 --2- 172.21.15.37:0/3154238999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbad410b030 0x7fbad41a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:32.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.971+0000 7fbad1e00640 1 -- 172.21.15.37:0/3154238999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad41a1280 con 0x7fbad4104ca0 2024-08-20T04:58:32.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.972+0000 7fbad1e00640 1 --2- 172.21.15.37:0/3154238999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbad4104ca0 0x7fbad419b1d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbac4005ab0 tx=0x7fbac4003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:32.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.972+0000 7fbacb400640 1 -- 172.21.15.37:0/3154238999 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac403f070 con 0x7fbad4104ca0 2024-08-20T04:58:32.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.972+0000 7fbacb400640 1 -- 172.21.15.37:0/3154238999 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbac4031d60 con 0x7fbad4104ca0 2024-08-20T04:58:32.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.972+0000 7fbad8c00640 1 -- 172.21.15.37:0/3154238999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad41a1510 con 0x7fbad4104ca0 2024-08-20T04:58:32.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.972+0000 7fbacb400640 1 -- 172.21.15.37:0/3154238999 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4035030 con 0x7fbad4104ca0 2024-08-20T04:58:32.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.972+0000 7fbad8c00640 1 -- 172.21.15.37:0/3154238999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad41a7c30 con 0x7fbad4104ca0 2024-08-20T04:58:32.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.973+0000 7fbad8c00640 1 -- 172.21.15.37:0/3154238999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad4105080 con 0x7fbad4104ca0 2024-08-20T04:58:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.975+0000 7fbacb400640 1 -- 172.21.15.37:0/3154238999 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fbac4042070 con 0x7fbad4104ca0 2024-08-20T04:58:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.978+0000 7fbacb400640 1 --2- 172.21.15.37:0/3154238999 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbab80b3c50 0x7fbab80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.978+0000 7fbacb400640 1 -- 172.21.15.37:0/3154238999 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fbac4103fa0 con 0x7fbad4104ca0 2024-08-20T04:58:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.978+0000 7fbac9400640 1 --2- 172.21.15.37:0/3154238999 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbab80b3c50 0x7fbab80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.979+0000 7fbac9400640 1 --2- 172.21.15.37:0/3154238999 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbab80b3c50 0x7fbab80b6110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbad4109d80 tx=0x7fbabc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:32.982+0000 7fbacb400640 1 -- 172.21.15.37:0/3154238999 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fbac40cb3a0 con 0x7fbad4104ca0 2024-08-20T04:58:33.124 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:32 smithi037 ceph-mon[17265]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:33.124 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:33.124 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:33.124 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:33.124 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:33.124 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:33.125 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:33.125 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:32 smithi037 ceph-mon[17265]: Deploying daemon mds.d on smithi037 2024-08-20T04:58:33.125 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:32 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.37:6834/2131006297,v1:172.21.15.37:6835/2131006297] up:boot 2024-08-20T04:58:33.125 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:32 smithi037 ceph-mon[17265]: fsmap 3 up:standby 2024-08-20T04:58:33.125 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-20T04:58:33.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:33.217+0000 7fbad8c00640 1 -- 172.21.15.37:0/3154238999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbad410ce70 con 0x7fbad4104ca0 2024-08-20T04:58:33.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:33.218+0000 7fbacb400640 1 -- 172.21.15.37:0/3154238999 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7fbac40cf8f0 con 0x7fbad4104ca0 2024-08-20T04:58:33.219 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:58:33.219 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":4,"btime":"2024-08-20T04:58:32:696049+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-20T04:58:33.220 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 4 2024-08-20T04:58:33.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:33.221+0000 7fbad8c00640 1 -- 172.21.15.37:0/3154238999 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbab80b3c50 msgr2=0x7fbab80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:33.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:33.221+0000 7fbad8c00640 1 --2- 172.21.15.37:0/3154238999 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbab80b3c50 0x7fbab80b6110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbad4109d80 tx=0x7fbabc00b390 comp rx=0 tx=0).stop 2024-08-20T04:58:33.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:33.221+0000 7fbad8c00640 1 -- 172.21.15.37:0/3154238999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbad4104ca0 msgr2=0x7fbad419b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:33.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:33.221+0000 7fbad8c00640 1 --2- 172.21.15.37:0/3154238999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbad4104ca0 0x7fbad419b1d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fbac4005ab0 tx=0x7fbac4003cd0 comp rx=0 tx=0).stop 2024-08-20T04:58:33.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:33.221+0000 7fbad8c00640 1 -- 172.21.15.37:0/3154238999 shutdown_connections 2024-08-20T04:58:33.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:33.221+0000 7fbad8c00640 1 --2- 172.21.15.37:0/3154238999 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbab80b3c50 0x7fbab80b6110 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:33.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:33.221+0000 7fbad8c00640 1 --2- 172.21.15.37:0/3154238999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbad410b030 0x7fbad41a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:33.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:33.221+0000 7fbad8c00640 1 --2- 172.21.15.37:0/3154238999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbad410a6b0 0x7fbad419b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:33.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:33.221+0000 7fbad8c00640 1 --2- 172.21.15.37:0/3154238999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbad4104ca0 0x7fbad419b1d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:33.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:33.221+0000 7fbad8c00640 1 -- 172.21.15.37:0/3154238999 >> 172.21.15.37:0/3154238999 conn(0x7fbad4100730 msgr2=0x7fbad4102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:33.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:33.221+0000 7fbad8c00640 1 -- 172.21.15.37:0/3154238999 shutdown_connections 2024-08-20T04:58:33.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:33.221+0000 7fbad8c00640 1 -- 172.21.15.37:0/3154238999 wait complete. 2024-08-20T04:58:33.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:32 smithi135 ceph-mon[22342]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:33.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:33.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:33.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:33.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:33.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:33.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:33.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:32 smithi135 ceph-mon[22342]: Deploying daemon mds.d on smithi037 2024-08-20T04:58:33.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:32 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.37:6834/2131006297,v1:172.21.15.37:6835/2131006297] up:boot 2024-08-20T04:58:33.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:32 smithi135 ceph-mon[22342]: fsmap 3 up:standby 2024-08-20T04:58:33.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-20T04:58:33.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:32 smithi130 ceph-mon[22007]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:33.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:33.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:33.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:33.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:33.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:33.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:33.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:32 smithi130 ceph-mon[22007]: Deploying daemon mds.d on smithi037 2024-08-20T04:58:33.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:32 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.37:6834/2131006297,v1:172.21.15.37:6835/2131006297] up:boot 2024-08-20T04:58:33.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:32 smithi130 ceph-mon[22007]: fsmap 3 up:standby 2024-08-20T04:58:33.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-08-20T04:58:34.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:33 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3154238999' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:34.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:33 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3154238999' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:34.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:33 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3154238999' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:35.136 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:34 smithi037 ceph-mon[17265]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:35.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:34 smithi135 ceph-mon[22342]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:35.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:34 smithi130 ceph-mon[22007]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:35.516 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 20 04:58:35 smithi037 systemd[1]: Starting Ceph mds.d for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T04:58:35.890 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 20 04:58:35 smithi037 podman[59803]: 2024-08-20 04:58:35.44774783 +0000 UTC m=+0.028272529 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T04:58:35.890 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 20 04:58:35 smithi037 podman[59803]: 2024-08-20 04:58:35.603446733 +0000 UTC m=+0.183971435 container create 79c4bb61dcc34777a6e8f7731f42617d63641370aa84b8e3657b5df9b15afa1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T04:58:35.891 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 20 04:58:35 smithi037 podman[59803]: 2024-08-20 04:58:35.889405672 +0000 UTC m=+0.469930381 container init 79c4bb61dcc34777a6e8f7731f42617d63641370aa84b8e3657b5df9b15afa1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-d, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-20T04:58:36.265 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 20 04:58:35 smithi037 podman[59803]: 2024-08-20 04:58:35.895686683 +0000 UTC m=+0.476211382 container start 79c4bb61dcc34777a6e8f7731f42617d63641370aa84b8e3657b5df9b15afa1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731) 2024-08-20T04:58:36.265 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 20 04:58:35 smithi037 ceph-mds[59822]: -- 172.21.15.37:0/1517029431 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x5588fbdcf520 con 0x5588fbda2800 2024-08-20T04:58:36.265 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 20 04:58:35 smithi037 ceph-mds[59822]: -- 172.21.15.37:0/1517029431 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5588fbdc5860 con 0x5588fbda2800 2024-08-20T04:58:36.266 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 20 04:58:35 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-d[59818]: starting mds.d at 2024-08-20T04:58:36.266 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 20 04:58:36 smithi037 bash[59803]: 79c4bb61dcc34777a6e8f7731f42617d63641370aa84b8e3657b5df9b15afa1b 2024-08-20T04:58:36.266 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 20 04:58:36 smithi037 systemd[1]: Started Ceph mds.d for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:58:37.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T04:58:37.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:37 smithi130 ceph-mon[22007]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:37.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:37 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.37:6836/3652581224,v1:172.21.15.37:6837/3652581224] up:boot 2024-08-20T04:58:37.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:37 smithi130 ceph-mon[22007]: fsmap 4 up:standby 2024-08-20T04:58:37.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:37 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-20T04:58:37.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:37 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:37.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:37 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:37.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:37 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:37.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:37 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:37.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:37 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:37.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:37 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:37.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:37 smithi130 ceph-mon[22007]: Deploying daemon mds.e on smithi130 2024-08-20T04:58:37.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:37 smithi037 ceph-mon[17265]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:37.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:37 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.37:6836/3652581224,v1:172.21.15.37:6837/3652581224] up:boot 2024-08-20T04:58:37.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:37 smithi037 ceph-mon[17265]: fsmap 4 up:standby 2024-08-20T04:58:37.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:37 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-20T04:58:37.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:37 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:37.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:37 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:37.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:37 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:37.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:37 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:37.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:37 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:37.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:37 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:37.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:37 smithi037 ceph-mon[17265]: Deploying daemon mds.e on smithi130 2024-08-20T04:58:37.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:37 smithi135 ceph-mon[22342]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:37 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.37:6836/3652581224,v1:172.21.15.37:6837/3652581224] up:boot 2024-08-20T04:58:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:37 smithi135 ceph-mon[22342]: fsmap 4 up:standby 2024-08-20T04:58:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:37 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-08-20T04:58:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:37 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:37 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:37 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:37 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:37 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:37 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:37 smithi135 ceph-mon[22342]: Deploying daemon mds.e on smithi130 2024-08-20T04:58:37.560 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:58:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.187+0000 7f066e200640 1 -- 172.21.15.37:0/3311198849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f066810b030 msgr2=0x7f0668111830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.187+0000 7f066e200640 1 --2- 172.21.15.37:0/3311198849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f066810b030 0x7f0668111830 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0660009900 tx=0x7f066002a410 comp rx=0 tx=0).stop 2024-08-20T04:58:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.187+0000 7f066e200640 1 -- 172.21.15.37:0/3311198849 shutdown_connections 2024-08-20T04:58:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.187+0000 7f066e200640 1 --2- 172.21.15.37:0/3311198849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f066810b030 0x7f0668111830 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.187+0000 7f066e200640 1 --2- 172.21.15.37:0/3311198849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f066810a6b0 0x7f066810aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.187+0000 7f066e200640 1 --2- 172.21.15.37:0/3311198849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0668104ca0 0x7f0668105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.187+0000 7f066e200640 1 -- 172.21.15.37:0/3311198849 >> 172.21.15.37:0/3311198849 conn(0x7f0668100730 msgr2=0x7f0668102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.187+0000 7f066e200640 1 -- 172.21.15.37:0/3311198849 shutdown_connections 2024-08-20T04:58:38.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.187+0000 7f066e200640 1 -- 172.21.15.37:0/3311198849 wait complete. 2024-08-20T04:58:38.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.188+0000 7f066e200640 1 Processor -- start 2024-08-20T04:58:38.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.188+0000 7f066e200640 1 -- start start 2024-08-20T04:58:38.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.189+0000 7f066e200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0668104ca0 0x7f06680773e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:38.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.189+0000 7f066e200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f066810a6b0 0x7f0668077920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:38.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.189+0000 7f066e200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f066810b030 0x7f0668077e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:38.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.189+0000 7f066e200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0668114d40 con 0x7f066810a6b0 2024-08-20T04:58:38.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.189+0000 7f066e200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0668114bc0 con 0x7f066810b030 2024-08-20T04:58:38.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.189+0000 7f066e200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0668114ec0 con 0x7f0668104ca0 2024-08-20T04:58:38.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.189+0000 7f0666a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f066810a6b0 0x7f0668077920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:38.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.189+0000 7f0667400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0668104ca0 0x7f06680773e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:38.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.189+0000 7f0667e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f066810b030 0x7f0668077e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:38.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.189+0000 7f0667400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0668104ca0 0x7f06680773e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51796/0 (socket says 172.21.15.37:51796) 2024-08-20T04:58:38.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.189+0000 7f0666a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f066810a6b0 0x7f0668077920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53964/0 (socket says 172.21.15.37:53964) 2024-08-20T04:58:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.189+0000 7f0667400640 1 -- 172.21.15.37:0/1897628683 learned_addr learned my addr 172.21.15.37:0/1897628683 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:58:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.189+0000 7f0667e00640 1 -- 172.21.15.37:0/1897628683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0668104ca0 msgr2=0x7f06680773e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.189+0000 7f0667e00640 1 --2- 172.21.15.37:0/1897628683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0668104ca0 0x7f06680773e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.189+0000 7f0667e00640 1 -- 172.21.15.37:0/1897628683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f066810a6b0 msgr2=0x7f0668077920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.189+0000 7f0667e00640 1 --2- 172.21.15.37:0/1897628683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f066810a6b0 0x7f0668077920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.189+0000 7f0667e00640 1 -- 172.21.15.37:0/1897628683 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06681ab750 con 0x7f066810b030 2024-08-20T04:58:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.190+0000 7f0667e00640 1 --2- 172.21.15.37:0/1897628683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f066810b030 0x7f0668077e60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f066002a930 tx=0x7f0660003c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.190+0000 7f065fe00640 1 -- 172.21.15.37:0/1897628683 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066003f070 con 0x7f066810b030 2024-08-20T04:58:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.190+0000 7f065fe00640 1 -- 172.21.15.37:0/1897628683 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0660031b50 con 0x7f066810b030 2024-08-20T04:58:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.190+0000 7f065fe00640 1 -- 172.21.15.37:0/1897628683 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0660035030 con 0x7f066810b030 2024-08-20T04:58:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.190+0000 7f066e200640 1 -- 172.21.15.37:0/1897628683 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06681ab9e0 con 0x7f066810b030 2024-08-20T04:58:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.190+0000 7f066e200640 1 -- 172.21.15.37:0/1897628683 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06681abf10 con 0x7f066810b030 2024-08-20T04:58:38.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.191+0000 7f066e200640 1 -- 172.21.15.37:0/1897628683 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0668105080 con 0x7f066810b030 2024-08-20T04:58:38.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.193+0000 7f065fe00640 1 -- 172.21.15.37:0/1897628683 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f0660042070 con 0x7f066810b030 2024-08-20T04:58:38.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.195+0000 7f065fe00640 1 --2- 172.21.15.37:0/1897628683 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f064c0b3c50 0x7f064c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:38.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.195+0000 7f065fe00640 1 -- 172.21.15.37:0/1897628683 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f0660103d50 con 0x7f066810b030 2024-08-20T04:58:38.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.195+0000 7f0667400640 1 --2- 172.21.15.37:0/1897628683 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f064c0b3c50 0x7f064c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:38.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.196+0000 7f0667400640 1 --2- 172.21.15.37:0/1897628683 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f064c0b3c50 0x7f064c0b6110 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0658009270 tx=0x7f0658009700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:38.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.199+0000 7f065fe00640 1 -- 172.21.15.37:0/1897628683 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f06600cb150 con 0x7f066810b030 2024-08-20T04:58:38.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.430+0000 7f066e200640 1 -- 172.21.15.37:0/1897628683 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06680786e0 con 0x7f066810b030 2024-08-20T04:58:38.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.430+0000 7f065fe00640 1 -- 172.21.15.37:0/1897628683 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7f06600cf6a0 con 0x7f066810b030 2024-08-20T04:58:38.431 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:58:38.431 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"btime":"2024-08-20T04:58:35:998560+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-20T04:58:38.432 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 5 2024-08-20T04:58:38.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.433+0000 7f066e200640 1 -- 172.21.15.37:0/1897628683 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f064c0b3c50 msgr2=0x7f064c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:38.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.433+0000 7f066e200640 1 --2- 172.21.15.37:0/1897628683 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f064c0b3c50 0x7f064c0b6110 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0658009270 tx=0x7f0658009700 comp rx=0 tx=0).stop 2024-08-20T04:58:38.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.433+0000 7f066e200640 1 -- 172.21.15.37:0/1897628683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f066810b030 msgr2=0x7f0668077e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:38.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.433+0000 7f066e200640 1 --2- 172.21.15.37:0/1897628683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f066810b030 0x7f0668077e60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f066002a930 tx=0x7f0660003c00 comp rx=0 tx=0).stop 2024-08-20T04:58:38.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.433+0000 7f066e200640 1 -- 172.21.15.37:0/1897628683 shutdown_connections 2024-08-20T04:58:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.433+0000 7f066e200640 1 --2- 172.21.15.37:0/1897628683 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f064c0b3c50 0x7f064c0b6110 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.433+0000 7f066e200640 1 --2- 172.21.15.37:0/1897628683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f066810b030 0x7f0668077e60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.433+0000 7f066e200640 1 --2- 172.21.15.37:0/1897628683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f066810a6b0 0x7f0668077920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.433+0000 7f066e200640 1 --2- 172.21.15.37:0/1897628683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0668104ca0 0x7f06680773e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.433+0000 7f066e200640 1 -- 172.21.15.37:0/1897628683 >> 172.21.15.37:0/1897628683 conn(0x7f0668100730 msgr2=0x7f0668102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.433+0000 7f066e200640 1 -- 172.21.15.37:0/1897628683 shutdown_connections 2024-08-20T04:58:38.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:38.433+0000 7f066e200640 1 -- 172.21.15.37:0/1897628683 wait complete. 2024-08-20T04:58:38.448 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 04:58:38 smithi130 systemd[1]: Starting Ceph mds.e for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T04:58:38.706 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 04:58:38 smithi130 podman[51166]: 2024-08-20 04:58:38.350257105 +0000 UTC m=+0.016278544 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T04:58:38.706 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 04:58:38 smithi130 podman[51166]: 2024-08-20 04:58:38.464227148 +0000 UTC m=+0.130248588 container create 010ddc9a7d93b99433f18d85960c866710e99518272663b56591163abc9a2f9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T04:58:38.706 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 04:58:38 smithi130 podman[51166]: 2024-08-20 04:58:38.691904728 +0000 UTC m=+0.357926167 container init 010ddc9a7d93b99433f18d85960c866710e99518272663b56591163abc9a2f9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-e, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-08-20T04:58:38.706 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 04:58:38 smithi130 podman[51166]: 2024-08-20 04:58:38.695002695 +0000 UTC m=+0.361024145 container start 010ddc9a7d93b99433f18d85960c866710e99518272663b56591163abc9a2f9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-e, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-20T04:58:39.015 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 04:58:38 smithi130 ceph-mds[51185]: -- 172.21.15.130:0/3152810517 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5623ded31860 con 0x5623ded0f400 2024-08-20T04:58:39.015 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 04:58:38 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-e[51181]: starting mds.e at 2024-08-20T04:58:39.015 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 04:58:38 smithi130 bash[51166]: 010ddc9a7d93b99433f18d85960c866710e99518272663b56591163abc9a2f9e 2024-08-20T04:58:39.015 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 04:58:38 smithi130 systemd[1]: Started Ceph mds.e for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:58:39.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:39 smithi037 ceph-mon[17265]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:39.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:39 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1897628683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:39.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:39.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:39.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:39.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:39.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:39.165 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:39 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:39.272 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:39 smithi135 ceph-mon[22342]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:39.272 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:39 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1897628683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:39.272 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:39.272 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:39.273 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:39.273 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:39.273 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:39.273 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:39 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:39.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:39 smithi130 ceph-mon[22007]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:39.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:39 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1897628683' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:39.393 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:39.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:39.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:39.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:39.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:39.394 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:39 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:40.315 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:40 smithi135 ceph-mon[22342]: Deploying daemon mds.f on smithi135 2024-08-20T04:58:40.315 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:40 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.130:6834/538714148,v1:172.21.15.130:6835/538714148] up:boot 2024-08-20T04:58:40.315 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:40 smithi135 ceph-mon[22342]: fsmap 5 up:standby 2024-08-20T04:58:40.315 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:40 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T04:58:40.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:40 smithi130 ceph-mon[22007]: Deploying daemon mds.f on smithi135 2024-08-20T04:58:40.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:40 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.130:6834/538714148,v1:172.21.15.130:6835/538714148] up:boot 2024-08-20T04:58:40.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:40 smithi130 ceph-mon[22007]: fsmap 5 up:standby 2024-08-20T04:58:40.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:40 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T04:58:40.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:40 smithi037 ceph-mon[17265]: Deploying daemon mds.f on smithi135 2024-08-20T04:58:40.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:40 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.130:6834/538714148,v1:172.21.15.130:6835/538714148] up:boot 2024-08-20T04:58:40.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:40 smithi037 ceph-mon[17265]: fsmap 5 up:standby 2024-08-20T04:58:40.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:40 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T04:58:40.866 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 04:58:40 smithi135 systemd[1]: Starting Ceph mds.f for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T04:58:41.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T04:58:41.231 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:41 smithi135 ceph-mon[22342]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:41.231 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 04:58:40 smithi135 podman[51938]: 2024-08-20 04:58:40.864496174 +0000 UTC m=+0.015881469 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T04:58:41.231 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 04:58:40 smithi135 podman[51938]: 2024-08-20 04:58:40.984583469 +0000 UTC m=+0.135968752 container create 43e6161555a8b8359f19666d65757fcd89773733093cedd8f25060f1ad143a0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-f, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0) 2024-08-20T04:58:41.232 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 04:58:41 smithi135 podman[51938]: 2024-08-20 04:58:41.2305413 +0000 UTC m=+0.381926583 container init 43e6161555a8b8359f19666d65757fcd89773733093cedd8f25060f1ad143a0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0) 2024-08-20T04:58:41.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:41 smithi130 ceph-mon[22007]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:41.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:41 smithi037 ceph-mon[17265]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:41.595 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:58:41.615 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 04:58:41 smithi135 podman[51938]: 2024-08-20 04:58:41.233933671 +0000 UTC m=+0.385318955 container start 43e6161555a8b8359f19666d65757fcd89773733093cedd8f25060f1ad143a0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0) 2024-08-20T04:58:41.616 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 04:58:41 smithi135 ceph-mds[51957]: -- 172.21.15.135:0/3060669208 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56203b365860 con 0x56203b343000 2024-08-20T04:58:41.616 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 04:58:41 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-f[51953]: starting mds.f at 2024-08-20T04:58:41.616 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 04:58:41 smithi135 bash[51938]: 43e6161555a8b8359f19666d65757fcd89773733093cedd8f25060f1ad143a0b 2024-08-20T04:58:41.616 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 04:58:41 smithi135 systemd[1]: Started Ceph mds.f for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:58:42.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.213+0000 7f105c200640 1 -- 172.21.15.37:0/1645183170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1054075c70 msgr2=0x7f105410eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:42.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.213+0000 7f105c200640 1 --2- 172.21.15.37:0/1645183170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1054075c70 0x7f105410eb00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1040009900 tx=0x7f104002a410 comp rx=0 tx=0).stop 2024-08-20T04:58:42.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.213+0000 7f105c200640 1 -- 172.21.15.37:0/1645183170 shutdown_connections 2024-08-20T04:58:42.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.213+0000 7f105c200640 1 --2- 172.21.15.37:0/1645183170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f105410f0d0 0x7f10541114c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:42.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.213+0000 7f105c200640 1 --2- 172.21.15.37:0/1645183170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1054075c70 0x7f105410eb00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:42.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.213+0000 7f105c200640 1 --2- 172.21.15.37:0/1645183170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1054075270 0x7f1054075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:42.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.213+0000 7f105c200640 1 -- 172.21.15.37:0/1645183170 >> 172.21.15.37:0/1645183170 conn(0x7f10540fe500 msgr2=0x7f1054100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:42.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.213+0000 7f105c200640 1 -- 172.21.15.37:0/1645183170 shutdown_connections 2024-08-20T04:58:42.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.213+0000 7f105c200640 1 -- 172.21.15.37:0/1645183170 wait complete. 2024-08-20T04:58:42.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.214+0000 7f105c200640 1 Processor -- start 2024-08-20T04:58:42.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.214+0000 7f105c200640 1 -- start start 2024-08-20T04:58:42.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.215+0000 7f105c200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1054075270 0x7f105419b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:42.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.215+0000 7f105c200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1054075c70 0x7f105419b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:42.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.215+0000 7f105c200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f105410f0d0 0x7f10541a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:42.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.215+0000 7f105c200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1054114cd0 con 0x7f1054075c70 2024-08-20T04:58:42.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.215+0000 7f105c200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1054114b50 con 0x7f105410f0d0 2024-08-20T04:58:42.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.215+0000 7f105c200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1054114e50 con 0x7f1054075270 2024-08-20T04:58:42.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.215+0000 7f1059800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1054075270 0x7f105419b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:42.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.215+0000 7f1058e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1054075c70 0x7f105419b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:42.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.215+0000 7f1059800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1054075270 0x7f105419b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51820/0 (socket says 172.21.15.37:51820) 2024-08-20T04:58:42.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.215+0000 7f1059800640 1 -- 172.21.15.37:0/1463816985 learned_addr learned my addr 172.21.15.37:0/1463816985 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:58:42.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.215+0000 7f105a200640 1 --2- 172.21.15.37:0/1463816985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f105410f0d0 0x7f10541a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:42.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.215+0000 7f1059800640 1 -- 172.21.15.37:0/1463816985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f105410f0d0 msgr2=0x7f10541a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.215+0000 7f1059800640 1 --2- 172.21.15.37:0/1463816985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f105410f0d0 0x7f10541a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.216+0000 7f1059800640 1 -- 172.21.15.37:0/1463816985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1054075c70 msgr2=0x7f105419b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.216+0000 7f1059800640 1 --2- 172.21.15.37:0/1463816985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1054075c70 0x7f105419b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.216+0000 7f1059800640 1 -- 172.21.15.37:0/1463816985 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10541a1270 con 0x7f1054075270 2024-08-20T04:58:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.216+0000 7f1059800640 1 --2- 172.21.15.37:0/1463816985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1054075270 0x7f105419b1c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f104800e9f0 tx=0x7f104800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.216+0000 7f1052000640 1 -- 172.21.15.37:0/1463816985 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104800cd80 con 0x7f1054075270 2024-08-20T04:58:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.216+0000 7f105c200640 1 -- 172.21.15.37:0/1463816985 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10541a1560 con 0x7f1054075270 2024-08-20T04:58:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.216+0000 7f1052000640 1 -- 172.21.15.37:0/1463816985 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10480108e0 con 0x7f1054075270 2024-08-20T04:58:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.216+0000 7f1052000640 1 -- 172.21.15.37:0/1463816985 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1048018980 con 0x7f1054075270 2024-08-20T04:58:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.216+0000 7f105c200640 1 -- 172.21.15.37:0/1463816985 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10541a7c20 con 0x7f1054075270 2024-08-20T04:58:42.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.217+0000 7f105c200640 1 -- 172.21.15.37:0/1463816985 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1054075650 con 0x7f1054075270 2024-08-20T04:58:42.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.219+0000 7f1052000640 1 -- 172.21.15.37:0/1463816985 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f1048010430 con 0x7f1054075270 2024-08-20T04:58:42.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.221+0000 7f1052000640 1 --2- 172.21.15.37:0/1463816985 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f103c0b3bd0 0x7f103c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:42.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.221+0000 7f1052000640 1 -- 172.21.15.37:0/1463816985 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f10480e3e80 con 0x7f1054075270 2024-08-20T04:58:42.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.221+0000 7f1058e00640 1 --2- 172.21.15.37:0/1463816985 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f103c0b3bd0 0x7f103c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:42.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.222+0000 7f1058e00640 1 --2- 172.21.15.37:0/1463816985 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f103c0b3bd0 0x7f103c0b6090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1040005ab0 tx=0x7f1040005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:42.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.223+0000 7f1052000640 1 -- 172.21.15.37:0/1463816985 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f10480ab8d0 con 0x7f1054075270 2024-08-20T04:58:42.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.459+0000 7f105c200640 1 -- 172.21.15.37:0/1463816985 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f105419c2f0 con 0x7f1054075270 2024-08-20T04:58:42.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.460+0000 7f1052000640 1 -- 172.21.15.37:0/1463816985 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5566 (secure 0 0 0) 0x7f10480ab1d0 con 0x7f1054075270 2024-08-20T04:58:42.461 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:58:42.461 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":7,"btime":"2024-08-20T04:58:42:021091+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24626,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-08-20T04:58:42.462 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 7 2024-08-20T04:58:42.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.463+0000 7f105c200640 1 -- 172.21.15.37:0/1463816985 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f103c0b3bd0 msgr2=0x7f103c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:42.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.463+0000 7f105c200640 1 --2- 172.21.15.37:0/1463816985 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f103c0b3bd0 0x7f103c0b6090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1040005ab0 tx=0x7f1040005a20 comp rx=0 tx=0).stop 2024-08-20T04:58:42.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.463+0000 7f105c200640 1 -- 172.21.15.37:0/1463816985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1054075270 msgr2=0x7f105419b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:42.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.463+0000 7f105c200640 1 --2- 172.21.15.37:0/1463816985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1054075270 0x7f105419b1c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f104800e9f0 tx=0x7f104800eeb0 comp rx=0 tx=0).stop 2024-08-20T04:58:42.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.463+0000 7f105c200640 1 -- 172.21.15.37:0/1463816985 shutdown_connections 2024-08-20T04:58:42.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.463+0000 7f105c200640 1 --2- 172.21.15.37:0/1463816985 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f103c0b3bd0 0x7f103c0b6090 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:42.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.463+0000 7f105c200640 1 --2- 172.21.15.37:0/1463816985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f105410f0d0 0x7f10541a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:42.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.463+0000 7f105c200640 1 --2- 172.21.15.37:0/1463816985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1054075c70 0x7f105419b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:42.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.463+0000 7f105c200640 1 --2- 172.21.15.37:0/1463816985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1054075270 0x7f105419b1c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:42.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.463+0000 7f105c200640 1 -- 172.21.15.37:0/1463816985 >> 172.21.15.37:0/1463816985 conn(0x7f10540fe500 msgr2=0x7f10541112b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:42.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.463+0000 7f105c200640 1 -- 172.21.15.37:0/1463816985 shutdown_connections 2024-08-20T04:58:42.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:42.463+0000 7f105c200640 1 -- 172.21.15.37:0/1463816985 wait complete. 2024-08-20T04:58:42.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:42 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:42.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:42 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:42.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:42 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:42.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:42 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:42.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:42 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:42.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:42 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:42.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:42 smithi130 ceph-mon[22007]: Deploying daemon mds.c on smithi135 2024-08-20T04:58:42.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:42 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] up:boot 2024-08-20T04:58:42.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:42 smithi130 ceph-mon[22007]: fsmap 6 up:standby 2024-08-20T04:58:42.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:42 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T04:58:42.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:42 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:42.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:42 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:42.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:42 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:42.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:42 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:42.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:42 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:42.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:42 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:42.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:42 smithi037 ceph-mon[17265]: Deploying daemon mds.c on smithi135 2024-08-20T04:58:42.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:42 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] up:boot 2024-08-20T04:58:42.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:42 smithi037 ceph-mon[17265]: fsmap 6 up:standby 2024-08-20T04:58:42.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:42 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T04:58:42.818 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:42 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:42.818 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:42 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:42.818 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:42 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:42.819 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:42 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:42.819 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:42 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:42.819 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:42 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:42.819 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:42 smithi135 ceph-mon[22342]: Deploying daemon mds.c on smithi135 2024-08-20T04:58:42.819 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:42 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] up:boot 2024-08-20T04:58:42.819 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:42 smithi135 ceph-mon[22342]: fsmap 6 up:standby 2024-08-20T04:58:42.819 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:42 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T04:58:43.365 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 04:58:43 smithi135 systemd[1]: Starting Ceph mds.c for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T04:58:43.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:43 smithi037 ceph-mon[17265]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:43.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:43 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1463816985' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:43.664 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:43 smithi135 ceph-mon[22342]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:43.665 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:43 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1463816985' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:43.665 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 04:58:43 smithi135 podman[52251]: 2024-08-20 04:58:43.408822357 +0000 UTC m=+0.016285640 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T04:58:43.665 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 04:58:43 smithi135 podman[52251]: 2024-08-20 04:58:43.537734201 +0000 UTC m=+0.145197487 container create 7d337573f9e8401230655003aa088192363f333825229869d5a5bda8c6ef75f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-c, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-20T04:58:43.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:43 smithi130 ceph-mon[22007]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:43.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:43 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1463816985' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:44.115 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 04:58:43 smithi135 podman[52251]: 2024-08-20 04:58:43.799528853 +0000 UTC m=+0.406992136 container init 7d337573f9e8401230655003aa088192363f333825229869d5a5bda8c6ef75f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-c, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T04:58:44.115 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 04:58:43 smithi135 podman[52251]: 2024-08-20 04:58:43.80257703 +0000 UTC m=+0.410040314 container start 7d337573f9e8401230655003aa088192363f333825229869d5a5bda8c6ef75f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-c, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T04:58:44.116 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 04:58:43 smithi135 ceph-mds[52270]: -- 172.21.15.135:0/884842530 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5557392f7860 con 0x5557392d4800 2024-08-20T04:58:44.116 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 04:58:43 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-c[52266]: starting mds.c at 2024-08-20T04:58:44.116 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 04:58:43 smithi135 bash[52251]: 7d337573f9e8401230655003aa088192363f333825229869d5a5bda8c6ef75f4 2024-08-20T04:58:44.116 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 04:58:43 smithi135 systemd[1]: Started Ceph mds.c for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:58:45.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:44 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:45.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:44 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:45.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:44 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:45.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:44 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:45.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:44 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:45.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:44 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:45.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:44 smithi130 ceph-mon[22007]: Deploying daemon mds.h on smithi130 2024-08-20T04:58:45.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:44 smithi130 ceph-mon[22007]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:45.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:44 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] up:boot 2024-08-20T04:58:45.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:44 smithi130 ceph-mon[22007]: fsmap 7 up:standby 2024-08-20T04:58:45.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:44 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T04:58:45.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:44 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:45.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:44 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:45.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:44 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:45.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:44 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:45.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:44 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:45.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:44 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:45.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:44 smithi037 ceph-mon[17265]: Deploying daemon mds.h on smithi130 2024-08-20T04:58:45.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:44 smithi037 ceph-mon[17265]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:45.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:44 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] up:boot 2024-08-20T04:58:45.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:44 smithi037 ceph-mon[17265]: fsmap 7 up:standby 2024-08-20T04:58:45.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:44 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T04:58:45.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T04:58:45.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:44 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:45.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:44 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:45.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:44 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:45.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:44 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:45.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:44 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:45.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:44 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:45.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:44 smithi135 ceph-mon[22342]: Deploying daemon mds.h on smithi130 2024-08-20T04:58:45.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:44 smithi135 ceph-mon[22342]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:45.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:44 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] up:boot 2024-08-20T04:58:45.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:44 smithi135 ceph-mon[22342]: fsmap 7 up:standby 2024-08-20T04:58:45.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:44 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T04:58:45.654 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:58:46.205 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 04:58:46 smithi130 systemd[1]: Starting Ceph mds.h for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T04:58:46.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.252+0000 7fbd67e00640 1 -- 172.21.15.37:0/2268582986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd6810a520 msgr2=0x7fbd6810a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:46.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.252+0000 7fbd67e00640 1 --2- 172.21.15.37:0/2268582986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd6810a520 0x7fbd6810a960 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009900 tx=0x7fbd5002a3f0 comp rx=0 tx=0).stop 2024-08-20T04:58:46.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.252+0000 7fbd67e00640 1 -- 172.21.15.37:0/2268582986 shutdown_connections 2024-08-20T04:58:46.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.252+0000 7fbd67e00640 1 --2- 172.21.15.37:0/2268582986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd6810aea0 0x7fbd681116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:46.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.252+0000 7fbd67e00640 1 --2- 172.21.15.37:0/2268582986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd6810a520 0x7fbd6810a960 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:46.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.252+0000 7fbd67e00640 1 --2- 172.21.15.37:0/2268582986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd68104b10 0x7fbd68104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:46.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.252+0000 7fbd67e00640 1 -- 172.21.15.37:0/2268582986 >> 172.21.15.37:0/2268582986 conn(0x7fbd68100540 msgr2=0x7fbd68102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:46.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.252+0000 7fbd67e00640 1 -- 172.21.15.37:0/2268582986 shutdown_connections 2024-08-20T04:58:46.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.252+0000 7fbd67e00640 1 -- 172.21.15.37:0/2268582986 wait complete. 2024-08-20T04:58:46.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.253+0000 7fbd67e00640 1 Processor -- start 2024-08-20T04:58:46.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.253+0000 7fbd67e00640 1 -- start start 2024-08-20T04:58:46.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.254+0000 7fbd67e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd68104b10 0x7fbd6819af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:46.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.254+0000 7fbd67e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6810a520 0x7fbd6819b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:46.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.254+0000 7fbd67e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd6810aea0 0x7fbd681a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:46.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.254+0000 7fbd67e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68114b40 con 0x7fbd6810a520 2024-08-20T04:58:46.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.254+0000 7fbd67e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbd681149c0 con 0x7fbd68104b10 2024-08-20T04:58:46.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.254+0000 7fbd67e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd68114cc0 con 0x7fbd6810aea0 2024-08-20T04:58:46.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.254+0000 7fbd5e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6810a520 0x7fbd6819b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:46.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.254+0000 7fbd5e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6810a520 0x7fbd6819b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49834/0 (socket says 172.21.15.37:49834) 2024-08-20T04:58:46.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.254+0000 7fbd5e000640 1 -- 172.21.15.37:0/1488567059 learned_addr learned my addr 172.21.15.37:0/1488567059 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:58:46.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.254+0000 7fbd66a00640 1 --2- 172.21.15.37:0/1488567059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd68104b10 0x7fbd6819af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:46.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.254+0000 7fbd67400640 1 --2- 172.21.15.37:0/1488567059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd6810aea0 0x7fbd681a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:46.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.254+0000 7fbd5e000640 1 -- 172.21.15.37:0/1488567059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd6810aea0 msgr2=0x7fbd681a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:46.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.254+0000 7fbd5e000640 1 --2- 172.21.15.37:0/1488567059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd6810aea0 0x7fbd681a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:46.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.254+0000 7fbd5e000640 1 -- 172.21.15.37:0/1488567059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd68104b10 msgr2=0x7fbd6819af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:46.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.254+0000 7fbd5e000640 1 --2- 172.21.15.37:0/1488567059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd68104b10 0x7fbd6819af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:46.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.254+0000 7fbd5e000640 1 -- 172.21.15.37:0/1488567059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd681a0fe0 con 0x7fbd6810a520 2024-08-20T04:58:46.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.255+0000 7fbd5e000640 1 --2- 172.21.15.37:0/1488567059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6810a520 0x7fbd6819b470 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbd50005ab0 tx=0x7fbd50003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:46.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.255+0000 7fbd5fe00640 1 -- 172.21.15.37:0/1488567059 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd5003f070 con 0x7fbd6810a520 2024-08-20T04:58:46.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.255+0000 7fbd67e00640 1 -- 172.21.15.37:0/1488567059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd681a1270 con 0x7fbd6810a520 2024-08-20T04:58:46.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.255+0000 7fbd5fe00640 1 -- 172.21.15.37:0/1488567059 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd50031d60 con 0x7fbd6810a520 2024-08-20T04:58:46.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.255+0000 7fbd5fe00640 1 -- 172.21.15.37:0/1488567059 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd50035030 con 0x7fbd6810a520 2024-08-20T04:58:46.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.255+0000 7fbd67e00640 1 -- 172.21.15.37:0/1488567059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd681a7990 con 0x7fbd6810a520 2024-08-20T04:58:46.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.256+0000 7fbd67e00640 1 -- 172.21.15.37:0/1488567059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd68104ef0 con 0x7fbd6810a520 2024-08-20T04:58:46.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.258+0000 7fbd5fe00640 1 -- 172.21.15.37:0/1488567059 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fbd50042070 con 0x7fbd6810a520 2024-08-20T04:58:46.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.260+0000 7fbd5fe00640 1 --2- 172.21.15.37:0/1488567059 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd4c0b3cf0 0x7fbd4c0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:46.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.261+0000 7fbd5fe00640 1 -- 172.21.15.37:0/1488567059 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fbd50103f80 con 0x7fbd6810a520 2024-08-20T04:58:46.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.261+0000 7fbd66a00640 1 --2- 172.21.15.37:0/1488567059 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd4c0b3cf0 0x7fbd4c0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:46.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.261+0000 7fbd66a00640 1 --2- 172.21.15.37:0/1488567059 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd4c0b3cf0 0x7fbd4c0b61b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbd580099a0 tx=0x7fbd58009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:46.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.265+0000 7fbd5fe00640 1 -- 172.21.15.37:0/1488567059 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fbd500cb9d0 con 0x7fbd6810a520 2024-08-20T04:58:46.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.496+0000 7fbd67e00640 1 -- 172.21.15.37:0/1488567059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd681a7c50 con 0x7fbd6810a520 2024-08-20T04:58:46.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.497+0000 7fbd5fe00640 1 -- 172.21.15.37:0/1488567059 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6391 (secure 0 0 0) 0x7fbd500cb2d0 con 0x7fbd6810a520 2024-08-20T04:58:46.499 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:58:46.499 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"btime":"2024-08-20T04:58:44:396607+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24626,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-08-20T04:58:46.499 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2024-08-20T04:58:46.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.499+0000 7fbd67e00640 1 -- 172.21.15.37:0/1488567059 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd4c0b3cf0 msgr2=0x7fbd4c0b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:46.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.499+0000 7fbd67e00640 1 --2- 172.21.15.37:0/1488567059 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd4c0b3cf0 0x7fbd4c0b61b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbd580099a0 tx=0x7fbd58009500 comp rx=0 tx=0).stop 2024-08-20T04:58:46.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.499+0000 7fbd67e00640 1 -- 172.21.15.37:0/1488567059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6810a520 msgr2=0x7fbd6819b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:46.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.499+0000 7fbd67e00640 1 --2- 172.21.15.37:0/1488567059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6810a520 0x7fbd6819b470 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbd50005ab0 tx=0x7fbd50003c80 comp rx=0 tx=0).stop 2024-08-20T04:58:46.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.499+0000 7fbd67e00640 1 -- 172.21.15.37:0/1488567059 shutdown_connections 2024-08-20T04:58:46.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.499+0000 7fbd67e00640 1 --2- 172.21.15.37:0/1488567059 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd4c0b3cf0 0x7fbd4c0b61b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:46.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.499+0000 7fbd67e00640 1 --2- 172.21.15.37:0/1488567059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd6810aea0 0x7fbd681a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:46.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.499+0000 7fbd67e00640 1 --2- 172.21.15.37:0/1488567059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6810a520 0x7fbd6819b470 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:46.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.499+0000 7fbd67e00640 1 --2- 172.21.15.37:0/1488567059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd68104b10 0x7fbd6819af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:46.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.499+0000 7fbd67e00640 1 -- 172.21.15.37:0/1488567059 >> 172.21.15.37:0/1488567059 conn(0x7fbd68100540 msgr2=0x7fbd68102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:46.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.499+0000 7fbd67e00640 1 -- 172.21.15.37:0/1488567059 shutdown_connections 2024-08-20T04:58:46.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:46.499+0000 7fbd67e00640 1 -- 172.21.15.37:0/1488567059 wait complete. 2024-08-20T04:58:46.503 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 04:58:46 smithi130 podman[51471]: 2024-08-20 04:58:46.117242552 +0000 UTC m=+0.015653248 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T04:58:46.503 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 04:58:46 smithi130 podman[51471]: 2024-08-20 04:58:46.236797067 +0000 UTC m=+0.135207752 container create 0e6a1f28ebce34cb13f3aff44407e341dc373d95bfd86344359144d7b7dc20ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-h, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-08-20T04:58:46.503 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 04:58:46 smithi130 podman[51471]: 2024-08-20 04:58:46.502527062 +0000 UTC m=+0.400937747 container init 0e6a1f28ebce34cb13f3aff44407e341dc373d95bfd86344359144d7b7dc20ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-h, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-08-20T04:58:46.797 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 04:58:46 smithi130 podman[51471]: 2024-08-20 04:58:46.505541585 +0000 UTC m=+0.403952287 container start 0e6a1f28ebce34cb13f3aff44407e341dc373d95bfd86344359144d7b7dc20ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-h, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T04:58:46.797 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 04:58:46 smithi130 ceph-mds[51491]: -- 172.21.15.130:0/189827177 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f489623860 con 0x55f489600800 2024-08-20T04:58:46.797 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 04:58:46 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-h[51486]: starting mds.h at 2024-08-20T04:58:46.797 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 04:58:46 smithi130 bash[51471]: 0e6a1f28ebce34cb13f3aff44407e341dc373d95bfd86344359144d7b7dc20ed 2024-08-20T04:58:46.797 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 04:58:46 smithi130 systemd[1]: Started Ceph mds.h for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:58:47.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:47 smithi130 ceph-mon[22007]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:47.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:47 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1488567059' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:47.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:47.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:47.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:47.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:47.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:47.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:47 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:47.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:47 smithi130 ceph-mon[22007]: Deploying daemon mds.i on smithi135 2024-08-20T04:58:47.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:47 smithi037 ceph-mon[17265]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:47.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:47 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1488567059' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:47.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:47.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:47.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:47.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:47.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:47.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:47 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:47.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:47 smithi037 ceph-mon[17265]: Deploying daemon mds.i on smithi135 2024-08-20T04:58:47.330 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:47 smithi135 ceph-mon[22342]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:47.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:47 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1488567059' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:47.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:47.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:47.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:47.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:47.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:47.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:47 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:47.331 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:47 smithi135 ceph-mon[22342]: Deploying daemon mds.i on smithi135 2024-08-20T04:58:48.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:48 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] up:boot 2024-08-20T04:58:48.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:48 smithi135 ceph-mon[22342]: fsmap 8 up:standby 2024-08-20T04:58:48.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:48 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T04:58:48.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:48 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] up:boot 2024-08-20T04:58:48.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:48 smithi130 ceph-mon[22007]: fsmap 8 up:standby 2024-08-20T04:58:48.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:48 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T04:58:48.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:48 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] up:boot 2024-08-20T04:58:48.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:48 smithi037 ceph-mon[17265]: fsmap 8 up:standby 2024-08-20T04:58:48.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:48 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T04:58:48.760 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 04:58:48 smithi135 systemd[1]: Starting Ceph mds.i for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T04:58:49.031 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 04:58:48 smithi135 podman[52551]: 2024-08-20 04:58:48.662362789 +0000 UTC m=+0.016513935 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T04:58:49.031 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 04:58:48 smithi135 podman[52551]: 2024-08-20 04:58:48.792862628 +0000 UTC m=+0.147013806 container create dbda39241ba238aa002de8290da57d1521b842406fb6fa99903bf2aa8823ec51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-i, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0) 2024-08-20T04:58:49.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:49 smithi135 ceph-mon[22342]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:49.365 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 04:58:49 smithi135 podman[52551]: 2024-08-20 04:58:49.056410446 +0000 UTC m=+0.410561581 container init dbda39241ba238aa002de8290da57d1521b842406fb6fa99903bf2aa8823ec51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-20T04:58:49.366 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 04:58:49 smithi135 podman[52551]: 2024-08-20 04:58:49.059423288 +0000 UTC m=+0.413574429 container start dbda39241ba238aa002de8290da57d1521b842406fb6fa99903bf2aa8823ec51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-i, io.buildah.version=1.36.0, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-20T04:58:49.366 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 04:58:49 smithi135 ceph-mds[52571]: -- 172.21.15.135:0/3150812860 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558cd85cd860 con 0x558cd85ab000 2024-08-20T04:58:49.366 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 04:58:49 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-i[52567]: starting mds.i at 2024-08-20T04:58:49.366 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 04:58:49 smithi135 bash[52551]: dbda39241ba238aa002de8290da57d1521b842406fb6fa99903bf2aa8823ec51 2024-08-20T04:58:49.366 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 04:58:49 smithi135 systemd[1]: Started Ceph mds.i for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:58:49.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T04:58:49.446 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:49 smithi037 ceph-mon[17265]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:49.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:49 smithi130 ceph-mon[22007]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:49.787 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:58:50.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:50 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:50.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:50 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:50.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:50 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:50.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:50 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:50.416 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:50 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:50.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:50 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:50.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:50 smithi037 ceph-mon[17265]: Deploying daemon mds.g on smithi037 2024-08-20T04:58:50.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:50 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] up:boot 2024-08-20T04:58:50.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:50 smithi037 ceph-mon[17265]: fsmap 9 up:standby 2024-08-20T04:58:50.417 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:50 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T04:58:50.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:50 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:50.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:50 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:50.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:50 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:50.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:50 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:50.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:50 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:50.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:50 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:50.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:50 smithi135 ceph-mon[22342]: Deploying daemon mds.g on smithi037 2024-08-20T04:58:50.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:50 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] up:boot 2024-08-20T04:58:50.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:50 smithi135 ceph-mon[22342]: fsmap 9 up:standby 2024-08-20T04:58:50.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:50 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T04:58:50.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:50 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:50.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:50 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:50.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:50 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:50.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:50 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:50.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:50 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:50.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:50 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:50.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:50 smithi130 ceph-mon[22007]: Deploying daemon mds.g on smithi037 2024-08-20T04:58:50.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:50 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] up:boot 2024-08-20T04:58:50.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:50 smithi130 ceph-mon[22007]: fsmap 9 up:standby 2024-08-20T04:58:50.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:50 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T04:58:51.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.780+0000 7f809ea00640 1 -- 172.21.15.37:0/2405330597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8098108cb0 msgr2=0x7f809810f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:51.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.780+0000 7f809ea00640 1 --2- 172.21.15.37:0/2405330597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8098108cb0 0x7f809810f4b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f8090009ca0 tx=0x7f809002a8c0 comp rx=0 tx=0).stop 2024-08-20T04:58:51.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.780+0000 7f809ea00640 1 -- 172.21.15.37:0/2405330597 shutdown_connections 2024-08-20T04:58:51.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.780+0000 7f809ea00640 1 --2- 172.21.15.37:0/2405330597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8098108cb0 0x7f809810f4b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:51.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.780+0000 7f809ea00640 1 --2- 172.21.15.37:0/2405330597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8098108330 0x7f8098108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.780+0000 7f809ea00640 1 --2- 172.21.15.37:0/2405330597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8098102920 0x7f8098102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.780+0000 7f809ea00640 1 -- 172.21.15.37:0/2405330597 >> 172.21.15.37:0/2405330597 conn(0x7f80980fe350 msgr2=0x7f8098100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.780+0000 7f809ea00640 1 -- 172.21.15.37:0/2405330597 shutdown_connections 2024-08-20T04:58:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.780+0000 7f809ea00640 1 -- 172.21.15.37:0/2405330597 wait complete. 2024-08-20T04:58:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.781+0000 7f809ea00640 1 Processor -- start 2024-08-20T04:58:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.781+0000 7f809ea00640 1 -- start start 2024-08-20T04:58:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.782+0000 7f809ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8098102920 0x7f80980751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.782+0000 7f809ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8098108330 0x7f8098075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.782+0000 7f809ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8098108cb0 0x7f8098075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.782+0000 7f809ea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f80981129c0 con 0x7f8098102920 2024-08-20T04:58:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.782+0000 7f809ea00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8098112840 con 0x7f8098108cb0 2024-08-20T04:58:51.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.782+0000 7f809ea00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8098112b40 con 0x7f8098108330 2024-08-20T04:58:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.782+0000 7f809d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8098102920 0x7f80980751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.782+0000 7f809d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8098102920 0x7f80980751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49864/0 (socket says 172.21.15.37:49864) 2024-08-20T04:58:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.782+0000 7f809d600640 1 -- 172.21.15.37:0/329170839 learned_addr learned my addr 172.21.15.37:0/329170839 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:58:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.782+0000 7f809cc00640 1 --2- 172.21.15.37:0/329170839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8098108330 0x7f8098075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.782+0000 7f809e000640 1 --2- 172.21.15.37:0/329170839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8098108cb0 0x7f8098075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.782+0000 7f809d600640 1 -- 172.21.15.37:0/329170839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8098108330 msgr2=0x7f8098075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.782+0000 7f809d600640 1 --2- 172.21.15.37:0/329170839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8098108330 0x7f8098075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.782+0000 7f809d600640 1 -- 172.21.15.37:0/329170839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8098108cb0 msgr2=0x7f8098075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.782+0000 7f809d600640 1 --2- 172.21.15.37:0/329170839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8098108cb0 0x7f8098075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.782+0000 7f809d600640 1 -- 172.21.15.37:0/329170839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80981a70c0 con 0x7f8098102920 2024-08-20T04:58:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.782+0000 7f809cc00640 1 --2- 172.21.15.37:0/329170839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8098108330 0x7f8098075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T04:58:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.783+0000 7f809d600640 1 --2- 172.21.15.37:0/329170839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8098102920 0x7f80980751d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f808c00e9f0 tx=0x7f808c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:51.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.783+0000 7f8096000640 1 -- 172.21.15.37:0/329170839 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c00cd80 con 0x7f8098102920 2024-08-20T04:58:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.783+0000 7f8096000640 1 -- 172.21.15.37:0/329170839 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f808c0054d0 con 0x7f8098102920 2024-08-20T04:58:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.783+0000 7f8096000640 1 -- 172.21.15.37:0/329170839 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808c010690 con 0x7f8098102920 2024-08-20T04:58:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.783+0000 7f809ea00640 1 -- 172.21.15.37:0/329170839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80981a73b0 con 0x7f8098102920 2024-08-20T04:58:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.783+0000 7f809ea00640 1 -- 172.21.15.37:0/329170839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80981a78a0 con 0x7f8098102920 2024-08-20T04:58:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.784+0000 7f809ea00640 1 -- 172.21.15.37:0/329170839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8098102d00 con 0x7f8098102920 2024-08-20T04:58:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.787+0000 7f8096000640 1 -- 172.21.15.37:0/329170839 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f808c004e30 con 0x7f8098102920 2024-08-20T04:58:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.788+0000 7f8096000640 1 --2- 172.21.15.37:0/329170839 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80800b3cf0 0x7f80800b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.788+0000 7f8096000640 1 -- 172.21.15.37:0/329170839 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f808c0e3ef0 con 0x7f8098102920 2024-08-20T04:58:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.788+0000 7f809cc00640 1 --2- 172.21.15.37:0/329170839 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80800b3cf0 0x7f80800b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.789+0000 7f809cc00640 1 --2- 172.21.15.37:0/329170839 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80800b3cf0 0x7f80800b61b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8098076cc0 tx=0x7f8084005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:50.790+0000 7f8096000640 1 -- 172.21.15.37:0/329170839 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f808c055e20 con 0x7f8098102920 2024-08-20T04:58:51.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:51.025+0000 7f809ea00640 1 -- 172.21.15.37:0/329170839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80981a7cc0 con 0x7f8098102920 2024-08-20T04:58:51.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:51.026+0000 7f8096000640 1 -- 172.21.15.37:0/329170839 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8049 (secure 0 0 0) 0x7f808c0ab940 con 0x7f8098102920 2024-08-20T04:58:51.126 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:58:51.126 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":10,"btime":"2024-08-20T04:58:50:030220+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24626,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24664,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-20T04:58:51.126 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 10 2024-08-20T04:58:51.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:51.028+0000 7f809ea00640 1 -- 172.21.15.37:0/329170839 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80800b3cf0 msgr2=0x7f80800b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:51.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:51.028+0000 7f809ea00640 1 --2- 172.21.15.37:0/329170839 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80800b3cf0 0x7f80800b61b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8098076cc0 tx=0x7f8084005f90 comp rx=0 tx=0).stop 2024-08-20T04:58:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:51.028+0000 7f809ea00640 1 -- 172.21.15.37:0/329170839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8098102920 msgr2=0x7f80980751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:51.028+0000 7f809ea00640 1 --2- 172.21.15.37:0/329170839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8098102920 0x7f80980751d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f808c00e9f0 tx=0x7f808c00edf0 comp rx=0 tx=0).stop 2024-08-20T04:58:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:51.028+0000 7f809ea00640 1 -- 172.21.15.37:0/329170839 shutdown_connections 2024-08-20T04:58:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:51.028+0000 7f809ea00640 1 --2- 172.21.15.37:0/329170839 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80800b3cf0 0x7f80800b61b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:51.028+0000 7f809ea00640 1 --2- 172.21.15.37:0/329170839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8098108cb0 0x7f8098075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:51.028+0000 7f809ea00640 1 --2- 172.21.15.37:0/329170839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8098108330 0x7f8098075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:51.028+0000 7f809ea00640 1 --2- 172.21.15.37:0/329170839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8098102920 0x7f80980751d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:51.028+0000 7f809ea00640 1 -- 172.21.15.37:0/329170839 >> 172.21.15.37:0/329170839 conn(0x7f80980fe350 msgr2=0x7f8098101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:51.028+0000 7f809ea00640 1 -- 172.21.15.37:0/329170839 shutdown_connections 2024-08-20T04:58:51.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:51.028+0000 7f809ea00640 1 -- 172.21.15.37:0/329170839 wait complete. 2024-08-20T04:58:51.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:51 smithi037 ceph-mon[17265]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:51.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:51 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/329170839' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:51.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:51 smithi135 ceph-mon[22342]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:51.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:51 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/329170839' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:51.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:51 smithi130 ceph-mon[22007]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:51.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:51 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/329170839' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:53.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:53 smithi037 ceph-mon[17265]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:53.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:53 smithi135 ceph-mon[22342]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:53.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:53 smithi130 ceph-mon[22007]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:53.885 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 04:58:53 smithi037 podman[60564]: 2024-08-20 04:58:53.606054511 +0000 UTC m=+0.181972630 container create 43fba314613eceeee2162f4f666bdd4812d1672e69e1f5dcfa86189b256252a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T04:58:53.885 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 04:58:53 smithi037 podman[60564]: 2024-08-20 04:58:53.883977998 +0000 UTC m=+0.459896120 container init 43fba314613eceeee2162f4f666bdd4812d1672e69e1f5dcfa86189b256252a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-g, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-20T04:58:54.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T04:58:54.266 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 04:58:53 smithi037 podman[60564]: 2024-08-20 04:58:53.891037204 +0000 UTC m=+0.466955326 container start 43fba314613eceeee2162f4f666bdd4812d1672e69e1f5dcfa86189b256252a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-g, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.build-date=20240731) 2024-08-20T04:58:54.266 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 04:58:53 smithi037 ceph-mds[60583]: -- 172.21.15.37:0/59017806 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560025ffd860 con 0x560025fdb000 2024-08-20T04:58:54.266 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 04:58:53 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-g[60579]: starting mds.g at 2024-08-20T04:58:54.266 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 04:58:53 smithi037 bash[60564]: 43fba314613eceeee2162f4f666bdd4812d1672e69e1f5dcfa86189b256252a2 2024-08-20T04:58:54.266 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 04:58:53 smithi037 systemd[1]: Started Ceph mds.g for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:58:54.408 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:58:54.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.975+0000 7f210f200640 1 -- 172.21.15.37:0/1711632044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f210810eaf0 msgr2=0x7f210810ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:54.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.975+0000 7f210f200640 1 --2- 172.21.15.37:0/1711632044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f210810eaf0 0x7f210810ef30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009900 tx=0x7f20f002a3f0 comp rx=0 tx=0).stop 2024-08-20T04:58:54.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.975+0000 7f210f200640 1 -- 172.21.15.37:0/1711632044 shutdown_connections 2024-08-20T04:58:54.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.975+0000 7f210f200640 1 --2- 172.21.15.37:0/1711632044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f210810f470 0x7f2108115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:54.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.975+0000 7f210f200640 1 --2- 172.21.15.37:0/1711632044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f210810eaf0 0x7f210810ef30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:54.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.975+0000 7f210f200640 1 --2- 172.21.15.37:0/1711632044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21081090e0 0x7f21081094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:54.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.975+0000 7f210f200640 1 -- 172.21.15.37:0/1711632044 >> 172.21.15.37:0/1711632044 conn(0x7f2108078760 msgr2=0x7f210807ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:54.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.975+0000 7f210f200640 1 -- 172.21.15.37:0/1711632044 shutdown_connections 2024-08-20T04:58:54.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.975+0000 7f210f200640 1 -- 172.21.15.37:0/1711632044 wait complete. 2024-08-20T04:58:54.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.976+0000 7f210f200640 1 Processor -- start 2024-08-20T04:58:54.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.976+0000 7f210f200640 1 -- start start 2024-08-20T04:58:54.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.976+0000 7f210f200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21081090e0 0x7f210819f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:54.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.977+0000 7f210f200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f210810eaf0 0x7f210819fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:54.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.977+0000 7f210f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f210810f470 0x7f21081a4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:54.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.977+0000 7f210f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f21081190e0 con 0x7f210810f470 2024-08-20T04:58:54.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.977+0000 7f210f200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2108118f60 con 0x7f210810eaf0 2024-08-20T04:58:54.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.977+0000 7f210f200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2108119260 con 0x7f21081090e0 2024-08-20T04:58:54.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.977+0000 7f2107e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21081090e0 0x7f210819f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:54.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.977+0000 7f2107e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21081090e0 0x7f210819f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46866/0 (socket says 172.21.15.37:46866) 2024-08-20T04:58:54.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.977+0000 7f2107e00640 1 -- 172.21.15.37:0/3810290432 learned_addr learned my addr 172.21.15.37:0/3810290432 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:58:54.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.977+0000 7f210d200640 1 --2- 172.21.15.37:0/3810290432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f210810f470 0x7f21081a4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:54.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.977+0000 7f20ffe00640 1 --2- 172.21.15.37:0/3810290432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f210810eaf0 0x7f210819fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:54.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.977+0000 7f2107e00640 1 -- 172.21.15.37:0/3810290432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f210810eaf0 msgr2=0x7f210819fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:54.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.977+0000 7f2107e00640 1 --2- 172.21.15.37:0/3810290432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f210810eaf0 0x7f210819fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:54.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.977+0000 7f2107e00640 1 -- 172.21.15.37:0/3810290432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f210810f470 msgr2=0x7f21081a4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:54.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.977+0000 7f2107e00640 1 --2- 172.21.15.37:0/3810290432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f210810f470 0x7f21081a4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:54.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.977+0000 7f2107e00640 1 -- 172.21.15.37:0/3810290432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21081a56e0 con 0x7f21081090e0 2024-08-20T04:58:54.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.978+0000 7f2107e00640 1 --2- 172.21.15.37:0/3810290432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21081090e0 0x7f210819f630 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f20f800e9f0 tx=0x7f20f800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.978+0000 7f2105600640 1 -- 172.21.15.37:0/3810290432 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f800cd80 con 0x7f21081090e0 2024-08-20T04:58:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.978+0000 7f2105600640 1 -- 172.21.15.37:0/3810290432 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20f80054d0 con 0x7f21081090e0 2024-08-20T04:58:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.978+0000 7f210f200640 1 -- 172.21.15.37:0/3810290432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21081a59d0 con 0x7f21081090e0 2024-08-20T04:58:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.978+0000 7f2105600640 1 -- 172.21.15.37:0/3810290432 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f8010690 con 0x7f21081090e0 2024-08-20T04:58:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.978+0000 7f210f200640 1 -- 172.21.15.37:0/3810290432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21081ac090 con 0x7f21081090e0 2024-08-20T04:58:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.979+0000 7f210f200640 1 -- 172.21.15.37:0/3810290432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21081094c0 con 0x7f21081090e0 2024-08-20T04:58:54.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.981+0000 7f2105600640 1 -- 172.21.15.37:0/3810290432 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f20f8004e30 con 0x7f21081090e0 2024-08-20T04:58:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.983+0000 7f2105600640 1 --2- 172.21.15.37:0/3810290432 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20ec0b3bd0 0x7f20ec0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.983+0000 7f2105600640 1 -- 172.21.15.37:0/3810290432 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f20f80e3e30 con 0x7f21081090e0 2024-08-20T04:58:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.983+0000 7f20ffe00640 1 --2- 172.21.15.37:0/3810290432 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20ec0b3bd0 0x7f20ec0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:54.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.984+0000 7f20ffe00640 1 --2- 172.21.15.37:0/3810290432 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20ec0b3bd0 0x7f20ec0b6090 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f20f0005ab0 tx=0x7f20f0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:54.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:54.985+0000 7f2105600640 1 -- 172.21.15.37:0/3810290432 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f20f8055e20 con 0x7f21081090e0 2024-08-20T04:58:55.216 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:55 smithi037 ceph-mon[17265]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:55.217 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:55.217 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:55.217 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:55.217 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:55.217 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:55.217 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:55.217 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:55 smithi037 ceph-mon[17265]: Deploying daemon mds.a on smithi037 2024-08-20T04:58:55.217 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:55 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.37:6838/1587848243,v1:172.21.15.37:6839/1587848243] up:boot 2024-08-20T04:58:55.217 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:55 smithi037 ceph-mon[17265]: fsmap 10 up:standby 2024-08-20T04:58:55.217 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:55 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-20T04:58:55.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:55.247+0000 7f210f200640 1 -- 172.21.15.37:0/3810290432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21081a0760 con 0x7f21081090e0 2024-08-20T04:58:55.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:55.248+0000 7f2105600640 1 -- 172.21.15.37:0/3810290432 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8875 (secure 0 0 0) 0x7f21081a0760 con 0x7f21081090e0 2024-08-20T04:58:55.251 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:58:55.251 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":11,"btime":"2024-08-20T04:58:54:243515+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24626,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24664,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-20T04:58:55.251 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 11 2024-08-20T04:58:55.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:55.251+0000 7f210f200640 1 -- 172.21.15.37:0/3810290432 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20ec0b3bd0 msgr2=0x7f20ec0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:55.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:55.251+0000 7f210f200640 1 --2- 172.21.15.37:0/3810290432 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20ec0b3bd0 0x7f20ec0b6090 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f20f0005ab0 tx=0x7f20f0005a20 comp rx=0 tx=0).stop 2024-08-20T04:58:55.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:55.251+0000 7f210f200640 1 -- 172.21.15.37:0/3810290432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21081090e0 msgr2=0x7f210819f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:55.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:55.251+0000 7f210f200640 1 --2- 172.21.15.37:0/3810290432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21081090e0 0x7f210819f630 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f20f800e9f0 tx=0x7f20f800edf0 comp rx=0 tx=0).stop 2024-08-20T04:58:55.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:55.251+0000 7f210f200640 1 -- 172.21.15.37:0/3810290432 shutdown_connections 2024-08-20T04:58:55.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:55.251+0000 7f210f200640 1 --2- 172.21.15.37:0/3810290432 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20ec0b3bd0 0x7f20ec0b6090 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:55.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:55.251+0000 7f210f200640 1 --2- 172.21.15.37:0/3810290432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f210810f470 0x7f21081a4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:55.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:55.251+0000 7f210f200640 1 --2- 172.21.15.37:0/3810290432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f210810eaf0 0x7f210819fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:55.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:55.251+0000 7f210f200640 1 --2- 172.21.15.37:0/3810290432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21081090e0 0x7f210819f630 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:55.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:55.251+0000 7f210f200640 1 -- 172.21.15.37:0/3810290432 >> 172.21.15.37:0/3810290432 conn(0x7f2108078760 msgr2=0x7f210807ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:55.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:55.251+0000 7f210f200640 1 -- 172.21.15.37:0/3810290432 shutdown_connections 2024-08-20T04:58:55.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:55.251+0000 7f210f200640 1 -- 172.21.15.37:0/3810290432 wait complete. 2024-08-20T04:58:55.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:55 smithi135 ceph-mon[22342]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:55.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:55 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:55.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:55 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:55.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:55 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:55.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:55 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:55.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:55 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:55.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:55 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:55.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:55 smithi135 ceph-mon[22342]: Deploying daemon mds.a on smithi037 2024-08-20T04:58:55.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:55 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.37:6838/1587848243,v1:172.21.15.37:6839/1587848243] up:boot 2024-08-20T04:58:55.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:55 smithi135 ceph-mon[22342]: fsmap 10 up:standby 2024-08-20T04:58:55.367 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:55 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-20T04:58:55.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:55 smithi130 ceph-mon[22007]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:55.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:55 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:55.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:55 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:55.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:55 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:55.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:55 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:55.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:55 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:55.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:55 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:55.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:55 smithi130 ceph-mon[22007]: Deploying daemon mds.a on smithi037 2024-08-20T04:58:55.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:55 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.37:6838/1587848243,v1:172.21.15.37:6839/1587848243] up:boot 2024-08-20T04:58:55.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:55 smithi130 ceph-mon[22007]: fsmap 10 up:standby 2024-08-20T04:58:55.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:55 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-20T04:58:56.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:56 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3810290432' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:56.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:56 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3810290432' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:56.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:56 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3810290432' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:58:57.314 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:57 smithi037 ceph-mon[17265]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:57.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:57 smithi135 ceph-mon[22342]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:57.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:57 smithi130 ceph-mon[22007]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:58.209 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 04:58:57 smithi037 systemd[1]: Starting Ceph mds.a for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T04:58:58.481 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 04:58:58 smithi037 podman[60976]: 2024-08-20 04:58:58.1127816 +0000 UTC m=+0.027797000 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T04:58:58.481 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 04:58:58 smithi037 podman[60976]: 2024-08-20 04:58:58.252081257 +0000 UTC m=+0.167096633 container create 078ff38624ccb70cf3dfad834e098d6ab05e71c3d2217cbf71d5e553e6c34dba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-20T04:58:58.482 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 04:58:58 smithi037 podman[60976]: 2024-08-20 04:58:58.479735319 +0000 UTC m=+0.394750695 container init 078ff38624ccb70cf3dfad834e098d6ab05e71c3d2217cbf71d5e553e6c34dba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T04:58:58.639 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T04:58:58.765 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 04:58:58 smithi037 podman[60976]: 2024-08-20 04:58:58.488184689 +0000 UTC m=+0.403200065 container start 078ff38624ccb70cf3dfad834e098d6ab05e71c3d2217cbf71d5e553e6c34dba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, io.buildah.version=1.36.0) 2024-08-20T04:58:58.765 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 04:58:58 smithi037 ceph-mds[60995]: -- 172.21.15.37:0/1666597379 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dbd13bf860 con 0x55dbd139d000 2024-08-20T04:58:58.766 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 04:58:58 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-a[60991]: starting mds.a at 2024-08-20T04:58:58.766 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 04:58:58 smithi037 bash[60976]: 078ff38624ccb70cf3dfad834e098d6ab05e71c3d2217cbf71d5e553e6c34dba 2024-08-20T04:58:58.766 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 04:58:58 smithi037 systemd[1]: Started Ceph mds.a for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:58:59.042 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:58:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.671+0000 7efde1200640 1 -- 172.21.15.37:0/1367052391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efddc108e40 msgr2=0x7efddc10f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.671+0000 7efde1200640 1 --2- 172.21.15.37:0/1367052391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efddc108e40 0x7efddc10f640 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efdd4009ca0 tx=0x7efdd402a8c0 comp rx=0 tx=0).stop 2024-08-20T04:58:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.671+0000 7efde1200640 1 -- 172.21.15.37:0/1367052391 shutdown_connections 2024-08-20T04:58:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.671+0000 7efde1200640 1 --2- 172.21.15.37:0/1367052391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efddc108e40 0x7efddc10f640 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.671+0000 7efde1200640 1 --2- 172.21.15.37:0/1367052391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efddc1084c0 0x7efddc108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.671+0000 7efde1200640 1 --2- 172.21.15.37:0/1367052391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efddc102ab0 0x7efddc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.671+0000 7efde1200640 1 -- 172.21.15.37:0/1367052391 >> 172.21.15.37:0/1367052391 conn(0x7efddc0fe500 msgr2=0x7efddc100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.671+0000 7efde1200640 1 -- 172.21.15.37:0/1367052391 shutdown_connections 2024-08-20T04:58:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.671+0000 7efde1200640 1 -- 172.21.15.37:0/1367052391 wait complete. 2024-08-20T04:58:59.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.672+0000 7efde1200640 1 Processor -- start 2024-08-20T04:58:59.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.673+0000 7efde1200640 1 -- start start 2024-08-20T04:58:59.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.673+0000 7efde1200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efddc102ab0 0x7efddc19b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:59.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.673+0000 7efde1200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efddc1084c0 0x7efddc19b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:59.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.673+0000 7efde1200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efddc108e40 0x7efddc1a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:59.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.673+0000 7efde1200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efddc112b50 con 0x7efddc1084c0 2024-08-20T04:58:59.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.673+0000 7efde1200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efddc1129d0 con 0x7efddc108e40 2024-08-20T04:58:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.673+0000 7efde1200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efddc112cd0 con 0x7efddc102ab0 2024-08-20T04:58:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.673+0000 7efdd9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efddc102ab0 0x7efddc19b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.673+0000 7efdda800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efddc108e40 0x7efddc1a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.673+0000 7efdd9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efddc102ab0 0x7efddc19b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46902/0 (socket says 172.21.15.37:46902) 2024-08-20T04:58:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.673+0000 7efdd3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efddc1084c0 0x7efddc19b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.673+0000 7efdd9e00640 1 -- 172.21.15.37:0/3395212309 learned_addr learned my addr 172.21.15.37:0/3395212309 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:58:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.674+0000 7efdd9e00640 1 -- 172.21.15.37:0/3395212309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efddc108e40 msgr2=0x7efddc1a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.674+0000 7efdd9e00640 1 --2- 172.21.15.37:0/3395212309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efddc108e40 0x7efddc1a09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:59.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.674+0000 7efdd9e00640 1 -- 172.21.15.37:0/3395212309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efddc1084c0 msgr2=0x7efddc19b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:59.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.674+0000 7efdd9e00640 1 --2- 172.21.15.37:0/3395212309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efddc1084c0 0x7efddc19b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:59.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.674+0000 7efdd9e00640 1 -- 172.21.15.37:0/3395212309 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efddc1a11a0 con 0x7efddc102ab0 2024-08-20T04:58:59.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.674+0000 7efdd9e00640 1 --2- 172.21.15.37:0/3395212309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efddc102ab0 0x7efddc19b0f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00d950 tx=0x7efdcc00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:59.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.674+0000 7efdd2a00640 1 -- 172.21.15.37:0/3395212309 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc017030 con 0x7efddc102ab0 2024-08-20T04:58:59.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.675+0000 7efde1200640 1 -- 172.21.15.37:0/3395212309 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efddc1a1490 con 0x7efddc102ab0 2024-08-20T04:58:59.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.675+0000 7efdd2a00640 1 -- 172.21.15.37:0/3395212309 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdcc004020 con 0x7efddc102ab0 2024-08-20T04:58:59.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.675+0000 7efdd2a00640 1 -- 172.21.15.37:0/3395212309 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc0047a0 con 0x7efddc102ab0 2024-08-20T04:58:59.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.675+0000 7efde1200640 1 -- 172.21.15.37:0/3395212309 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efddc1a7d20 con 0x7efddc102ab0 2024-08-20T04:58:59.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.676+0000 7efde1200640 1 -- 172.21.15.37:0/3395212309 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efddc102e90 con 0x7efddc102ab0 2024-08-20T04:58:59.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.678+0000 7efdd2a00640 1 -- 172.21.15.37:0/3395212309 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7efdcc009a30 con 0x7efddc102ab0 2024-08-20T04:58:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.679+0000 7efdd2a00640 1 --2- 172.21.15.37:0/3395212309 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdc00b3c50 0x7efdc00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:58:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.680+0000 7efdd2a00640 1 -- 172.21.15.37:0/3395212309 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7efdcc0e3840 con 0x7efddc102ab0 2024-08-20T04:58:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.680+0000 7efdd3e00640 1 --2- 172.21.15.37:0/3395212309 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdc00b3c50 0x7efdc00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:58:59.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.680+0000 7efdd3e00640 1 --2- 172.21.15.37:0/3395212309 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdc00b3c50 0x7efdc00b6110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efddc107cd0 tx=0x7efdc4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:58:59.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.681+0000 7efdd2a00640 1 -- 172.21.15.37:0/3395212309 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7efdcc0ab310 con 0x7efddc102ab0 2024-08-20T04:58:59.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.914+0000 7efde1200640 1 -- 172.21.15.37:0/3395212309 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efddc19c220 con 0x7efddc102ab0 2024-08-20T04:58:59.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:59 smithi037 ceph-mon[17265]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:59.916 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:59 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:59.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:59 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:59.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:59 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:59.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:59 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:59.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:59 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:59.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:59 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:59.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:59 smithi037 ceph-mon[17265]: Deploying daemon mds.b on smithi130 2024-08-20T04:58:59.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:59 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.37:6840/466077750,v1:172.21.15.37:6841/466077750] up:boot 2024-08-20T04:58:59.917 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:59 smithi037 ceph-mon[17265]: fsmap 11 up:standby 2024-08-20T04:58:59.918 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:58:59 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-20T04:58:59.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.915+0000 7efdd2a00640 1 -- 172.21.15.37:0/3395212309 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9698 (secure 0 0 0) 0x7efdcc0aac10 con 0x7efddc102ab0 2024-08-20T04:58:59.919 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:58:59.919 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":12,"btime":"2024-08-20T04:58:59:034375+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24626,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24664,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-20T04:58:59.919 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 12 2024-08-20T04:58:59.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.918+0000 7efde1200640 1 -- 172.21.15.37:0/3395212309 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdc00b3c50 msgr2=0x7efdc00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:59.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.918+0000 7efde1200640 1 --2- 172.21.15.37:0/3395212309 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdc00b3c50 0x7efdc00b6110 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efddc107cd0 tx=0x7efdc4005f90 comp rx=0 tx=0).stop 2024-08-20T04:58:59.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.918+0000 7efde1200640 1 -- 172.21.15.37:0/3395212309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efddc102ab0 msgr2=0x7efddc19b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:58:59.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.918+0000 7efde1200640 1 --2- 172.21.15.37:0/3395212309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efddc102ab0 0x7efddc19b0f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00d950 tx=0x7efdcc00de10 comp rx=0 tx=0).stop 2024-08-20T04:58:59.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.918+0000 7efde1200640 1 -- 172.21.15.37:0/3395212309 shutdown_connections 2024-08-20T04:58:59.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.918+0000 7efde1200640 1 --2- 172.21.15.37:0/3395212309 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdc00b3c50 0x7efdc00b6110 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:59.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.918+0000 7efde1200640 1 --2- 172.21.15.37:0/3395212309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efddc108e40 0x7efddc1a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:59.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.918+0000 7efde1200640 1 --2- 172.21.15.37:0/3395212309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efddc1084c0 0x7efddc19b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:59.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.918+0000 7efde1200640 1 --2- 172.21.15.37:0/3395212309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efddc102ab0 0x7efddc19b0f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:58:59.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.918+0000 7efde1200640 1 -- 172.21.15.37:0/3395212309 >> 172.21.15.37:0/3395212309 conn(0x7efddc0fe500 msgr2=0x7efddc104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:58:59.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.919+0000 7efde1200640 1 -- 172.21.15.37:0/3395212309 shutdown_connections 2024-08-20T04:58:59.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:58:59.919+0000 7efde1200640 1 -- 172.21.15.37:0/3395212309 wait complete. 2024-08-20T04:58:59.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:59 smithi130 ceph-mon[22007]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:58:59.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:59 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:59.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:59 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:59.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:59 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:58:59.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:59 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:58:59.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:59 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:58:59.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:59 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:58:59.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:59 smithi130 ceph-mon[22007]: Deploying daemon mds.b on smithi130 2024-08-20T04:58:59.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:59 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.37:6840/466077750,v1:172.21.15.37:6841/466077750] up:boot 2024-08-20T04:58:59.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:59 smithi130 ceph-mon[22007]: fsmap 11 up:standby 2024-08-20T04:58:59.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:58:59 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-20T04:59:00.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:59 smithi135 ceph-mon[22342]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:00.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:59 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:59 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:59 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:59 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-08-20T04:59:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:59 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-20T04:59:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:59 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:59:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:59 smithi135 ceph-mon[22342]: Deploying daemon mds.b on smithi130 2024-08-20T04:59:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:59 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.37:6840/466077750,v1:172.21.15.37:6841/466077750] up:boot 2024-08-20T04:59:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:59 smithi135 ceph-mon[22342]: fsmap 11 up:standby 2024-08-20T04:59:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:58:59 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-20T04:59:00.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:00 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3395212309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:59:00.955 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 04:59:00 smithi130 systemd[1]: Starting Ceph mds.b for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T04:59:01.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:00 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3395212309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:59:01.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:00 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3395212309' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:59:01.229 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 04:59:00 smithi130 podman[51779]: 2024-08-20 04:59:00.861365318 +0000 UTC m=+0.015941539 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T04:59:01.229 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 04:59:00 smithi130 podman[51779]: 2024-08-20 04:59:00.97505302 +0000 UTC m=+0.129629275 container create 27e70f1225f770de63a157df3c9b38147981388e31f94b430198d4c6a7f3bfd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-08-20T04:59:01.229 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 04:59:01 smithi130 podman[51779]: 2024-08-20 04:59:01.227817247 +0000 UTC m=+0.382393458 container init 27e70f1225f770de63a157df3c9b38147981388e31f94b430198d4c6a7f3bfd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0) 2024-08-20T04:59:01.703 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 04:59:01 smithi130 podman[51779]: 2024-08-20 04:59:01.231103052 +0000 UTC m=+0.385679281 container start 27e70f1225f770de63a157df3c9b38147981388e31f94b430198d4c6a7f3bfd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, ceph=True, GIT_BRANCH=HEAD) 2024-08-20T04:59:01.703 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 04:59:01 smithi130 ceph-mds[51798]: -- 172.21.15.130:0/568997862 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dc3c0a9c20 con 0x55dc3c086800 2024-08-20T04:59:01.703 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 04:59:01 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b[51794]: starting mds.b at 2024-08-20T04:59:01.703 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 04:59:01 smithi130 bash[51779]: 27e70f1225f770de63a157df3c9b38147981388e31f94b430198d4c6a7f3bfd5 2024-08-20T04:59:01.703 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 04:59:01 smithi130 systemd[1]: Started Ceph mds.b for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T04:59:01.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:01 smithi130 ceph-mon[22007]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:01.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:01 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:01.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:01 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:01.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:01 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:01.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:01 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:01.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:01 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:01.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:01 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:59:02.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:01 smithi037 ceph-mon[17265]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:02.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:01 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:02.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:01 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:02.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:01 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:02.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:01 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:02.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:01 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:02.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:01 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:59:02.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:01 smithi135 ceph-mon[22342]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:02.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:01 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:02.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:01 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:02.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:01 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:02.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:01 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:02.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:01 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:02.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:01 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:59:02.659 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T04:59:03.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:02 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] up:boot 2024-08-20T04:59:03.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:02 smithi037 ceph-mon[17265]: fsmap 12 up:standby 2024-08-20T04:59:03.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:02 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T04:59:03.063 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:03.099 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:02 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] up:boot 2024-08-20T04:59:03.099 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:02 smithi130 ceph-mon[22007]: fsmap 12 up:standby 2024-08-20T04:59:03.100 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:02 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T04:59:03.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:02 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] up:boot 2024-08-20T04:59:03.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:02 smithi135 ceph-mon[22342]: fsmap 12 up:standby 2024-08-20T04:59:03.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:02 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T04:59:03.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.631+0000 7f331dc00640 1 -- 172.21.15.37:0/1091531501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f331810aea0 msgr2=0x7f33181116a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.631+0000 7f331dc00640 1 --2- 172.21.15.37:0/1091531501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f331810aea0 0x7f33181116a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3310009be0 tx=0x7f331002a6c0 comp rx=0 tx=0).stop 2024-08-20T04:59:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.631+0000 7f331dc00640 1 -- 172.21.15.37:0/1091531501 shutdown_connections 2024-08-20T04:59:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.631+0000 7f331dc00640 1 --2- 172.21.15.37:0/1091531501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f331810aea0 0x7f33181116a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.631+0000 7f331dc00640 1 --2- 172.21.15.37:0/1091531501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f331810a520 0x7f331810a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.631+0000 7f331dc00640 1 --2- 172.21.15.37:0/1091531501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3318104b10 0x7f3318104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.631+0000 7f331dc00640 1 -- 172.21.15.37:0/1091531501 >> 172.21.15.37:0/1091531501 conn(0x7f3318100540 msgr2=0x7f3318102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.631+0000 7f331dc00640 1 -- 172.21.15.37:0/1091531501 shutdown_connections 2024-08-20T04:59:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.631+0000 7f331dc00640 1 -- 172.21.15.37:0/1091531501 wait complete. 2024-08-20T04:59:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.632+0000 7f331dc00640 1 Processor -- start 2024-08-20T04:59:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.632+0000 7f331dc00640 1 -- start start 2024-08-20T04:59:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.633+0000 7f331dc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3318104b10 0x7f331819af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.633+0000 7f331dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f331810a520 0x7f331819b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.633+0000 7f331dc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f331810aea0 0x7f33181a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.633+0000 7f331dc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3318114b20 con 0x7f331810a520 2024-08-20T04:59:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.633+0000 7f331dc00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f33181149a0 con 0x7f331810aea0 2024-08-20T04:59:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.633+0000 7f331dc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3318114ca0 con 0x7f3318104b10 2024-08-20T04:59:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.633+0000 7f331d200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f331810aea0 0x7f33181a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.633+0000 7f3317400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f331810a520 0x7f331819b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.633+0000 7f331d200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f331810aea0 0x7f33181a07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47368/0 (socket says 172.21.15.37:47368) 2024-08-20T04:59:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.633+0000 7f331d200640 1 -- 172.21.15.37:0/498897542 learned_addr learned my addr 172.21.15.37:0/498897542 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.633+0000 7f3317e00640 1 --2- 172.21.15.37:0/498897542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3318104b10 0x7f331819af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.634+0000 7f331d200640 1 -- 172.21.15.37:0/498897542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3318104b10 msgr2=0x7f331819af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:03.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.634+0000 7f331d200640 1 --2- 172.21.15.37:0/498897542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3318104b10 0x7f331819af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.634+0000 7f331d200640 1 -- 172.21.15.37:0/498897542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f331810a520 msgr2=0x7f331819b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.634+0000 7f331d200640 1 --2- 172.21.15.37:0/498897542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f331810a520 0x7f331819b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.634+0000 7f331d200640 1 -- 172.21.15.37:0/498897542 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33181a0fb0 con 0x7f331810aea0 2024-08-20T04:59:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.634+0000 7f3317400640 1 --2- 172.21.15.37:0/498897542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f331810a520 0x7f331819b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:59:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.634+0000 7f331d200640 1 --2- 172.21.15.37:0/498897542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f331810aea0 0x7f33181a07e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3310009b30 tx=0x7f3310003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.634+0000 7f3314c00640 1 -- 172.21.15.37:0/498897542 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3310040020 con 0x7f331810aea0 2024-08-20T04:59:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.634+0000 7f331dc00640 1 -- 172.21.15.37:0/498897542 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33181a1240 con 0x7f331810aea0 2024-08-20T04:59:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.634+0000 7f3314c00640 1 -- 172.21.15.37:0/498897542 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3310030970 con 0x7f331810aea0 2024-08-20T04:59:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.634+0000 7f3314c00640 1 -- 172.21.15.37:0/498897542 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3310036040 con 0x7f331810aea0 2024-08-20T04:59:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.634+0000 7f331dc00640 1 -- 172.21.15.37:0/498897542 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33181a7960 con 0x7f331810aea0 2024-08-20T04:59:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.635+0000 7f331dc00640 1 -- 172.21.15.37:0/498897542 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3318104ef0 con 0x7f331810aea0 2024-08-20T04:59:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.638+0000 7f3314c00640 1 -- 172.21.15.37:0/498897542 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f3310043020 con 0x7f331810aea0 2024-08-20T04:59:03.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.639+0000 7f3314c00640 1 --2- 172.21.15.37:0/498897542 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32fc0b3c70 0x7f32fc0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:03.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.639+0000 7f3314c00640 1 -- 172.21.15.37:0/498897542 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f33101047a0 con 0x7f331810aea0 2024-08-20T04:59:03.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.639+0000 7f3317e00640 1 --2- 172.21.15.37:0/498897542 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32fc0b3c70 0x7f32fc0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:03.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.640+0000 7f3317e00640 1 --2- 172.21.15.37:0/498897542 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32fc0b3c70 0x7f32fc0b6130 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3308009530 tx=0x7f3308009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:03.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.644+0000 7f3314c00640 1 -- 172.21.15.37:0/498897542 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f331004a020 con 0x7f331810aea0 2024-08-20T04:59:03.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.884+0000 7f331dc00640 1 -- 172.21.15.37:0/498897542 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f331819c030 con 0x7f331810aea0 2024-08-20T04:59:03.887 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:03 smithi037 ceph-mon[17265]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:03.887 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:03 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:03.887 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:03 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:03.887 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:03 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:03.887 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:03 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:03.887 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:03 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:03.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.885+0000 7f3314c00640 1 -- 172.21.15.37:0/498897542 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10527 (secure 0 0 0) 0x7f331819c030 con 0x7f331810aea0 2024-08-20T04:59:03.888 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:59:03.888 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":13,"btime":"2024-08-20T04:59:01:700658+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24626,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24664,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24695,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-08-20T04:59:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 13 2024-08-20T04:59:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.887+0000 7f331dc00640 1 -- 172.21.15.37:0/498897542 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32fc0b3c70 msgr2=0x7f32fc0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.887+0000 7f331dc00640 1 --2- 172.21.15.37:0/498897542 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32fc0b3c70 0x7f32fc0b6130 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3308009530 tx=0x7f3308009260 comp rx=0 tx=0).stop 2024-08-20T04:59:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.887+0000 7f331dc00640 1 -- 172.21.15.37:0/498897542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f331810aea0 msgr2=0x7f33181a07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.887+0000 7f331dc00640 1 --2- 172.21.15.37:0/498897542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f331810aea0 0x7f33181a07e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3310009b30 tx=0x7f3310003c10 comp rx=0 tx=0).stop 2024-08-20T04:59:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.887+0000 7f331dc00640 1 -- 172.21.15.37:0/498897542 shutdown_connections 2024-08-20T04:59:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.887+0000 7f331dc00640 1 --2- 172.21.15.37:0/498897542 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32fc0b3c70 0x7f32fc0b6130 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.887+0000 7f331dc00640 1 --2- 172.21.15.37:0/498897542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f331810aea0 0x7f33181a07e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.887+0000 7f331dc00640 1 --2- 172.21.15.37:0/498897542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f331810a520 0x7f331819b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:03.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.887+0000 7f331dc00640 1 --2- 172.21.15.37:0/498897542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3318104b10 0x7f331819af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:03.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.887+0000 7f331dc00640 1 -- 172.21.15.37:0/498897542 >> 172.21.15.37:0/498897542 conn(0x7f3318100540 msgr2=0x7f3318108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:03.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.887+0000 7f331dc00640 1 -- 172.21.15.37:0/498897542 shutdown_connections 2024-08-20T04:59:03.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:03.887+0000 7f331dc00640 1 -- 172.21.15.37:0/498897542 wait complete. 2024-08-20T04:59:04.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:03 smithi135 ceph-mon[22342]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:04.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:03 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:04.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:03 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:04.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:03 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:04.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:03 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:04.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:03 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:04.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:03 smithi130 ceph-mon[22007]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:04.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:03 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:04.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:03 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:04.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:03 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:04.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:03 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:04.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:03 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:04.654 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-08-20T04:59:05.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:04 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/498897542' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:59:05.040 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:05.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:04 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/498897542' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:59:05.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:04 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/498897542' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:59:05.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.700+0000 7fa202400640 1 -- 172.21.15.37:0/3690678791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1fc104ca0 msgr2=0x7fa1fc105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:05.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.700+0000 7fa202400640 1 --2- 172.21.15.37:0/3690678791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1fc104ca0 0x7fa1fc105080 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009900 tx=0x7fa1ec02a410 comp rx=0 tx=0).stop 2024-08-20T04:59:05.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.700+0000 7fa202400640 1 -- 172.21.15.37:0/3690678791 shutdown_connections 2024-08-20T04:59:05.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.700+0000 7fa202400640 1 --2- 172.21.15.37:0/3690678791 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1fc10b030 0x7fa1fc111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:05.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.700+0000 7fa202400640 1 --2- 172.21.15.37:0/3690678791 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1fc10a6b0 0x7fa1fc10aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:05.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.700+0000 7fa202400640 1 --2- 172.21.15.37:0/3690678791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1fc104ca0 0x7fa1fc105080 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:05.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.700+0000 7fa202400640 1 -- 172.21.15.37:0/3690678791 >> 172.21.15.37:0/3690678791 conn(0x7fa1fc100730 msgr2=0x7fa1fc102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:05.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.700+0000 7fa202400640 1 -- 172.21.15.37:0/3690678791 shutdown_connections 2024-08-20T04:59:05.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.700+0000 7fa202400640 1 -- 172.21.15.37:0/3690678791 wait complete. 2024-08-20T04:59:05.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.701+0000 7fa202400640 1 Processor -- start 2024-08-20T04:59:05.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.701+0000 7fa202400640 1 -- start start 2024-08-20T04:59:05.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.701+0000 7fa202400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1fc104ca0 0x7fa1fc19b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:05.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.701+0000 7fa202400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1fc10a6b0 0x7fa1fc19b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:05.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.701+0000 7fa202400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1fc10b030 0x7fa1fc1a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:05.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.701+0000 7fa202400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc114d00 con 0x7fa1fc10a6b0 2024-08-20T04:59:05.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.701+0000 7fa202400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc114b80 con 0x7fa1fc104ca0 2024-08-20T04:59:05.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.701+0000 7fa202400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc114e80 con 0x7fa1fc10b030 2024-08-20T04:59:05.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.702+0000 7fa1fb400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1fc104ca0 0x7fa1fc19b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:05.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.702+0000 7fa1faa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1fc10a6b0 0x7fa1fc19b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:05.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.702+0000 7fa1fb400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1fc104ca0 0x7fa1fc19b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47388/0 (socket says 172.21.15.37:47388) 2024-08-20T04:59:05.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.702+0000 7fa1fb400640 1 -- 172.21.15.37:0/1557172028 learned_addr learned my addr 172.21.15.37:0/1557172028 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:05.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.702+0000 7fa1fbe00640 1 --2- 172.21.15.37:0/1557172028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1fc10b030 0x7fa1fc1a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:05.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.702+0000 7fa1fb400640 1 -- 172.21.15.37:0/1557172028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1fc10b030 msgr2=0x7fa1fc1a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:05.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.702+0000 7fa1fb400640 1 --2- 172.21.15.37:0/1557172028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1fc10b030 0x7fa1fc1a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:05.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.702+0000 7fa1fb400640 1 -- 172.21.15.37:0/1557172028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1fc10a6b0 msgr2=0x7fa1fc19b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:05.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.702+0000 7fa1fb400640 1 --2- 172.21.15.37:0/1557172028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1fc10a6b0 0x7fa1fc19b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:05.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.702+0000 7fa1fb400640 1 -- 172.21.15.37:0/1557172028 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1fc1a1260 con 0x7fa1fc104ca0 2024-08-20T04:59:05.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.703+0000 7fa1fb400640 1 --2- 172.21.15.37:0/1557172028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1fc104ca0 0x7fa1fc19b1b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec005ab0 tx=0x7fa1ec003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:05.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.703+0000 7fa1f3e00640 1 -- 172.21.15.37:0/1557172028 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec03f070 con 0x7fa1fc104ca0 2024-08-20T04:59:05.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.703+0000 7fa1f3e00640 1 -- 172.21.15.37:0/1557172028 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1ec031d60 con 0x7fa1fc104ca0 2024-08-20T04:59:05.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.703+0000 7fa1f3e00640 1 -- 172.21.15.37:0/1557172028 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec035030 con 0x7fa1fc104ca0 2024-08-20T04:59:05.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.703+0000 7fa202400640 1 -- 172.21.15.37:0/1557172028 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1fc1a14f0 con 0x7fa1fc104ca0 2024-08-20T04:59:05.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.703+0000 7fa202400640 1 -- 172.21.15.37:0/1557172028 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1fc1a7c10 con 0x7fa1fc104ca0 2024-08-20T04:59:05.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.704+0000 7fa202400640 1 -- 172.21.15.37:0/1557172028 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1fc105080 con 0x7fa1fc104ca0 2024-08-20T04:59:05.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.707+0000 7fa1f3e00640 1 -- 172.21.15.37:0/1557172028 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fa1ec042070 con 0x7fa1fc104ca0 2024-08-20T04:59:05.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.708+0000 7fa1f3e00640 1 --2- 172.21.15.37:0/1557172028 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa1e00b3c50 0x7fa1e00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:05.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.708+0000 7fa1f3e00640 1 -- 172.21.15.37:0/1557172028 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7fa1ec104390 con 0x7fa1fc104ca0 2024-08-20T04:59:05.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.708+0000 7fa1faa00640 1 --2- 172.21.15.37:0/1557172028 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa1e00b3c50 0x7fa1e00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:05.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.709+0000 7fa1faa00640 1 --2- 172.21.15.37:0/1557172028 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa1e00b3c50 0x7fa1e00b6110 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc109d80 tx=0x7fa1e800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:05.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.710+0000 7fa1f3e00640 1 -- 172.21.15.37:0/1557172028 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa1ec0cb790 con 0x7fa1fc104ca0 2024-08-20T04:59:05.928 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:05 smithi037 ceph-mon[17265]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:05.928 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:05 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:05.928 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:05 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:05.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.926+0000 7fa202400640 1 -- 172.21.15.37:0/1557172028 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa1fc19c2e0 con 0x7fa1fc104ca0 2024-08-20T04:59:05.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.927+0000 7fa1f3e00640 1 -- 172.21.15.37:0/1557172028 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7fa1ec0cfce0 con 0x7fa1fc104ca0 2024-08-20T04:59:05.929 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:59:05.929 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2024-08-20T04:59:05.929 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T04:59:05.929 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2024-08-20T04:59:05.929 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2024-08-20T04:59:05.930 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T04:59:05.930 INFO:teuthology.orchestra.run.smithi037.stdout:] 2024-08-20T04:59:05.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.929+0000 7fa202400640 1 -- 172.21.15.37:0/1557172028 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa1e00b3c50 msgr2=0x7fa1e00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:05.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.929+0000 7fa202400640 1 --2- 172.21.15.37:0/1557172028 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa1e00b3c50 0x7fa1e00b6110 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc109d80 tx=0x7fa1e800b410 comp rx=0 tx=0).stop 2024-08-20T04:59:05.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.929+0000 7fa202400640 1 -- 172.21.15.37:0/1557172028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1fc104ca0 msgr2=0x7fa1fc19b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:05.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.929+0000 7fa202400640 1 --2- 172.21.15.37:0/1557172028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1fc104ca0 0x7fa1fc19b1b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec005ab0 tx=0x7fa1ec003c80 comp rx=0 tx=0).stop 2024-08-20T04:59:05.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.930+0000 7fa202400640 1 -- 172.21.15.37:0/1557172028 shutdown_connections 2024-08-20T04:59:05.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.930+0000 7fa202400640 1 --2- 172.21.15.37:0/1557172028 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa1e00b3c50 0x7fa1e00b6110 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:05.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.930+0000 7fa202400640 1 --2- 172.21.15.37:0/1557172028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa1fc10b030 0x7fa1fc1a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:05.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.930+0000 7fa202400640 1 --2- 172.21.15.37:0/1557172028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1fc10a6b0 0x7fa1fc19b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:05.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.930+0000 7fa202400640 1 --2- 172.21.15.37:0/1557172028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa1fc104ca0 0x7fa1fc19b1b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:05.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.930+0000 7fa202400640 1 -- 172.21.15.37:0/1557172028 >> 172.21.15.37:0/1557172028 conn(0x7fa1fc100730 msgr2=0x7fa1fc102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:05.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.930+0000 7fa202400640 1 -- 172.21.15.37:0/1557172028 shutdown_connections 2024-08-20T04:59:05.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:05.930+0000 7fa202400640 1 -- 172.21.15.37:0/1557172028 wait complete. 2024-08-20T04:59:06.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:05 smithi135 ceph-mon[22342]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:06.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:05 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:06.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:05 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:06.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:05 smithi130 ceph-mon[22007]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:06.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:05 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:06.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:05 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:06.765 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-20T04:59:06.766 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-20T04:59:06.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:06 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:59:06.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:06 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:59:06.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:06 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:06.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:06 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1557172028' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-20T04:59:06.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:06 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:59:06.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:06 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:59:06.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:06 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:59:06.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:06 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:06.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:06 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1557172028' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-20T04:59:06.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:06 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:59:07.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:06 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:59:07.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:06 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:59:07.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:06 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:07.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:06 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1557172028' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-08-20T04:59:07.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:06 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T04:59:07.812 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:07.953 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:07 smithi037 ceph-mon[17265]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:07.953 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:07 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:07.954 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:07 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:07.954 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:07 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:07.954 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:07 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:08.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:07 smithi135 ceph-mon[22342]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:08.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:07 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:08.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:07 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:08.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:07 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:08.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:07 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:08.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:07 smithi130 ceph-mon[22007]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:08.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:07 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:08.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:07 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:08.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:07 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:08.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:07 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:08.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.373+0000 7f2cace00640 1 -- 172.21.15.37:0/721072205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca8077d20 msgr2=0x7f2ca8112fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:08.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.373+0000 7f2cace00640 1 --2- 172.21.15.37:0/721072205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca8077d20 0x7f2ca8112fb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2c90009900 tx=0x7f2c9002a3f0 comp rx=0 tx=0).stop 2024-08-20T04:59:08.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.374+0000 7f2cace00640 1 -- 172.21.15.37:0/721072205 shutdown_connections 2024-08-20T04:59:08.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.374+0000 7f2cace00640 1 --2- 172.21.15.37:0/721072205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca81134f0 0x7f2ca81158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:08.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.374+0000 7f2cace00640 1 --2- 172.21.15.37:0/721072205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca8077d20 0x7f2ca8112fb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:08.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.374+0000 7f2cace00640 1 --2- 172.21.15.37:0/721072205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca8077400 0x7f2ca80777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:08.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.374+0000 7f2cace00640 1 -- 172.21.15.37:0/721072205 >> 172.21.15.37:0/721072205 conn(0x7f2ca8100550 msgr2=0x7f2ca8102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:08.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.374+0000 7f2cace00640 1 -- 172.21.15.37:0/721072205 shutdown_connections 2024-08-20T04:59:08.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.374+0000 7f2cace00640 1 -- 172.21.15.37:0/721072205 wait complete. 2024-08-20T04:59:08.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.375+0000 7f2cace00640 1 Processor -- start 2024-08-20T04:59:08.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.375+0000 7f2cace00640 1 -- start start 2024-08-20T04:59:08.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.375+0000 7f2cace00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca8077400 0x7f2ca819f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:08.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.375+0000 7f2cace00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca8077d20 0x7f2ca819f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:08.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.375+0000 7f2cace00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca81134f0 0x7f2ca81a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:08.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.375+0000 7f2cace00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca8118f50 con 0x7f2ca8077400 2024-08-20T04:59:08.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.375+0000 7f2cace00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca8118dd0 con 0x7f2ca8077d20 2024-08-20T04:59:08.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.375+0000 7f2cace00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca81190d0 con 0x7f2ca81134f0 2024-08-20T04:59:08.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.375+0000 7f2ca7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca8077400 0x7f2ca819f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:08.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.375+0000 7f2ca7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca8077400 0x7f2ca819f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43310/0 (socket says 172.21.15.37:43310) 2024-08-20T04:59:08.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.376+0000 7f2ca7e00640 1 --2- 172.21.15.37:0/3260077933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca81134f0 0x7f2ca81a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:08.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.376+0000 7f2c9fe00640 1 --2- 172.21.15.37:0/3260077933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca8077d20 0x7f2ca819f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:08.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.375+0000 7f2ca7400640 1 -- 172.21.15.37:0/3260077933 learned_addr learned my addr 172.21.15.37:0/3260077933 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:08.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.376+0000 7f2ca7400640 1 -- 172.21.15.37:0/3260077933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca81134f0 msgr2=0x7f2ca81a4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.376+0000 7f2ca7400640 1 --2- 172.21.15.37:0/3260077933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca81134f0 0x7f2ca81a4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.376+0000 7f2ca7400640 1 -- 172.21.15.37:0/3260077933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca8077d20 msgr2=0x7f2ca819f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.376+0000 7f2ca7400640 1 --2- 172.21.15.37:0/3260077933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca8077d20 0x7f2ca819f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.376+0000 7f2ca7400640 1 -- 172.21.15.37:0/3260077933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca81a5410 con 0x7f2ca8077400 2024-08-20T04:59:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.376+0000 7f2ca7e00640 1 --2- 172.21.15.37:0/3260077933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca81134f0 0x7f2ca81a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:59:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.376+0000 7f2c9fe00640 1 --2- 172.21.15.37:0/3260077933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca8077d20 0x7f2ca819f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:59:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.376+0000 7f2ca7400640 1 --2- 172.21.15.37:0/3260077933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca8077400 0x7f2ca819f360 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800ea60 tx=0x7f2c9800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.376+0000 7f2ca4c00640 1 -- 172.21.15.37:0/3260077933 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800cde0 con 0x7f2ca8077400 2024-08-20T04:59:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.377+0000 7f2ca4c00640 1 -- 172.21.15.37:0/3260077933 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c980035f0 con 0x7f2ca8077400 2024-08-20T04:59:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.377+0000 7f2ca4c00640 1 -- 172.21.15.37:0/3260077933 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c98010690 con 0x7f2ca8077400 2024-08-20T04:59:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.377+0000 7f2cace00640 1 -- 172.21.15.37:0/3260077933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca81a5700 con 0x7f2ca8077400 2024-08-20T04:59:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.377+0000 7f2cace00640 1 -- 172.21.15.37:0/3260077933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca81abdc0 con 0x7f2ca8077400 2024-08-20T04:59:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.378+0000 7f2cace00640 1 -- 172.21.15.37:0/3260077933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca80777e0 con 0x7f2ca8077400 2024-08-20T04:59:08.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.380+0000 7f2ca4c00640 1 -- 172.21.15.37:0/3260077933 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f2c980037a0 con 0x7f2ca8077400 2024-08-20T04:59:08.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.381+0000 7f2ca4c00640 1 --2- 172.21.15.37:0/3260077933 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2c8c0b3c70 0x7f2c8c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:08.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.382+0000 7f2ca4c00640 1 -- 172.21.15.37:0/3260077933 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7127+0+0 (secure 0 0 0) 0x7f2c980e3cc0 con 0x7f2ca8077400 2024-08-20T04:59:08.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.382+0000 7f2c9fe00640 1 --2- 172.21.15.37:0/3260077933 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2c8c0b3c70 0x7f2c8c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:08.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.382+0000 7f2c9fe00640 1 --2- 172.21.15.37:0/3260077933 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2c8c0b3c70 0x7f2c8c0b6130 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2c90005ab0 tx=0x7f2c90005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:08.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.383+0000 7f2ca4c00640 1 -- 172.21.15.37:0/3260077933 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f2c98055e20 con 0x7f2ca8077400 2024-08-20T04:59:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.588+0000 7f2cace00640 1 -- 172.21.15.37:0/3260077933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2ca81ac0d0 con 0x7f2ca8077400 2024-08-20T04:59:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.729+0000 7f2ca4c00640 1 -- 172.21.15.37:0/3260077933 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7f2c980ab710 con 0x7f2ca8077400 2024-08-20T04:59:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2024-08-20T04:59:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.732+0000 7f2cace00640 1 -- 172.21.15.37:0/3260077933 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2c8c0b3c70 msgr2=0x7f2c8c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.732+0000 7f2cace00640 1 --2- 172.21.15.37:0/3260077933 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2c8c0b3c70 0x7f2c8c0b6130 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2c90005ab0 tx=0x7f2c90005a20 comp rx=0 tx=0).stop 2024-08-20T04:59:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.732+0000 7f2cace00640 1 -- 172.21.15.37:0/3260077933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca8077400 msgr2=0x7f2ca819f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.732+0000 7f2cace00640 1 --2- 172.21.15.37:0/3260077933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca8077400 0x7f2ca819f360 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800ea60 tx=0x7f2c9800ef20 comp rx=0 tx=0).stop 2024-08-20T04:59:08.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.733+0000 7f2cace00640 1 -- 172.21.15.37:0/3260077933 shutdown_connections 2024-08-20T04:59:08.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.733+0000 7f2cace00640 1 --2- 172.21.15.37:0/3260077933 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2c8c0b3c70 0x7f2c8c0b6130 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:08.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.733+0000 7f2cace00640 1 --2- 172.21.15.37:0/3260077933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca81134f0 0x7f2ca81a4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:08.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.733+0000 7f2cace00640 1 --2- 172.21.15.37:0/3260077933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca8077d20 0x7f2ca819f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:08.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.733+0000 7f2cace00640 1 --2- 172.21.15.37:0/3260077933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca8077400 0x7f2ca819f360 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:08.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.733+0000 7f2cace00640 1 -- 172.21.15.37:0/3260077933 >> 172.21.15.37:0/3260077933 conn(0x7f2ca8100550 msgr2=0x7f2ca8102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:08.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.733+0000 7f2cace00640 1 -- 172.21.15.37:0/3260077933 shutdown_connections 2024-08-20T04:59:08.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:08.733+0000 7f2cace00640 1 -- 172.21.15.37:0/3260077933 wait complete. 2024-08-20T04:59:09.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:08 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3260077933' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-20T04:59:09.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:08 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3260077933' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-20T04:59:09.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:08 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3260077933' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-08-20T04:59:09.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-08-20T04:59:09.950 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:10.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:09 smithi037 ceph-mon[17265]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:10.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:09 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3260077933' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-20T04:59:10.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:09 smithi037 ceph-mon[17265]: osdmap e71: 12 total, 12 up, 12 in 2024-08-20T04:59:10.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:09 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:10.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:09 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:10.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:09 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:59:10.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:09 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:59:10.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:09 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:10.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:09 smithi135 ceph-mon[22342]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:10.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:09 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3260077933' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-20T04:59:10.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:09 smithi135 ceph-mon[22342]: osdmap e71: 12 total, 12 up, 12 in 2024-08-20T04:59:10.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:10.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:10.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:59:10.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:59:10.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:09 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:10.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:09 smithi130 ceph-mon[22007]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:10.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:09 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3260077933' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-20T04:59:10.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:09 smithi130 ceph-mon[22007]: osdmap e71: 12 total, 12 up, 12 in 2024-08-20T04:59:10.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:09 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:10.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:09 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:10.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:09 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T04:59:10.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:09 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T04:59:10.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:09 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T04:59:10.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.576+0000 7fbc8ac00640 1 -- 172.21.15.37:0/2944189008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc841084c0 msgr2=0x7fbc84108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:10.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.576+0000 7fbc8ac00640 1 --2- 172.21.15.37:0/2944189008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc841084c0 0x7fbc84108900 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009900 tx=0x7fbc6c02a410 comp rx=0 tx=0).stop 2024-08-20T04:59:10.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.576+0000 7fbc8ac00640 1 -- 172.21.15.37:0/2944189008 shutdown_connections 2024-08-20T04:59:10.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.576+0000 7fbc8ac00640 1 --2- 172.21.15.37:0/2944189008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc84108e40 0x7fbc8410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.576+0000 7fbc8ac00640 1 --2- 172.21.15.37:0/2944189008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc841084c0 0x7fbc84108900 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.576+0000 7fbc8ac00640 1 --2- 172.21.15.37:0/2944189008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc84102ab0 0x7fbc84102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.576+0000 7fbc8ac00640 1 -- 172.21.15.37:0/2944189008 >> 172.21.15.37:0/2944189008 conn(0x7fbc840fe500 msgr2=0x7fbc84100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.576+0000 7fbc8ac00640 1 -- 172.21.15.37:0/2944189008 shutdown_connections 2024-08-20T04:59:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.577+0000 7fbc8ac00640 1 -- 172.21.15.37:0/2944189008 wait complete. 2024-08-20T04:59:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.577+0000 7fbc8ac00640 1 Processor -- start 2024-08-20T04:59:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.578+0000 7fbc8ac00640 1 -- start start 2024-08-20T04:59:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.578+0000 7fbc8ac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc84102ab0 0x7fbc84109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.578+0000 7fbc8ac00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc841084c0 0x7fbc84109b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.578+0000 7fbc8ac00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc84108e40 0x7fbc8410a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.578+0000 7fbc8ac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbc84112ac0 con 0x7fbc84102ab0 2024-08-20T04:59:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.578+0000 7fbc8ac00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbc84112940 con 0x7fbc841084c0 2024-08-20T04:59:10.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.578+0000 7fbc8ac00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbc84112c40 con 0x7fbc84108e40 2024-08-20T04:59:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.578+0000 7fbc83e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc84102ab0 0x7fbc84109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.578+0000 7fbc83e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc84102ab0 0x7fbc84109630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43338/0 (socket says 172.21.15.37:43338) 2024-08-20T04:59:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.578+0000 7fbc83e00640 1 -- 172.21.15.37:0/3706770009 learned_addr learned my addr 172.21.15.37:0/3706770009 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.578+0000 7fbc88c00640 1 --2- 172.21.15.37:0/3706770009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc84108e40 0x7fbc8410a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.578+0000 7fbc7b400640 1 --2- 172.21.15.37:0/3706770009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc841084c0 0x7fbc84109b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.578+0000 7fbc83e00640 1 -- 172.21.15.37:0/3706770009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc84108e40 msgr2=0x7fbc8410a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.579+0000 7fbc83e00640 1 --2- 172.21.15.37:0/3706770009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc84108e40 0x7fbc8410a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.579+0000 7fbc83e00640 1 -- 172.21.15.37:0/3706770009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc841084c0 msgr2=0x7fbc84109b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.579+0000 7fbc83e00640 1 --2- 172.21.15.37:0/3706770009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc841084c0 0x7fbc84109b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.579+0000 7fbc83e00640 1 -- 172.21.15.37:0/3706770009 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc841ab880 con 0x7fbc84102ab0 2024-08-20T04:59:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.579+0000 7fbc7b400640 1 --2- 172.21.15.37:0/3706770009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc841084c0 0x7fbc84109b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T04:59:10.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.579+0000 7fbc83e00640 1 --2- 172.21.15.37:0/3706770009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc84102ab0 0x7fbc84109630 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400ea60 tx=0x7fbc7400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.579+0000 7fbc81600640 1 -- 172.21.15.37:0/3706770009 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400cde0 con 0x7fbc84102ab0 2024-08-20T04:59:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.579+0000 7fbc81600640 1 -- 172.21.15.37:0/3706770009 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc740035f0 con 0x7fbc84102ab0 2024-08-20T04:59:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.579+0000 7fbc81600640 1 -- 172.21.15.37:0/3706770009 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74010690 con 0x7fbc84102ab0 2024-08-20T04:59:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.579+0000 7fbc8ac00640 1 -- 172.21.15.37:0/3706770009 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc841abb70 con 0x7fbc84102ab0 2024-08-20T04:59:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.579+0000 7fbc8ac00640 1 -- 172.21.15.37:0/3706770009 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc841ac030 con 0x7fbc84102ab0 2024-08-20T04:59:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.581+0000 7fbc8ac00640 1 -- 172.21.15.37:0/3706770009 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc84102e90 con 0x7fbc84102ab0 2024-08-20T04:59:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.583+0000 7fbc81600640 1 -- 172.21.15.37:0/3706770009 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fbc740037a0 con 0x7fbc84102ab0 2024-08-20T04:59:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.584+0000 7fbc81600640 1 --2- 172.21.15.37:0/3706770009 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbc680b3bd0 0x7fbc680b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.585+0000 7fbc81600640 1 -- 172.21.15.37:0/3706770009 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7497+0+0 (secure 0 0 0) 0x7fbc740e3e80 con 0x7fbc84102ab0 2024-08-20T04:59:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.585+0000 7fbc7b400640 1 --2- 172.21.15.37:0/3706770009 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbc680b3bd0 0x7fbc680b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.586+0000 7fbc7b400640 1 --2- 172.21.15.37:0/3706770009 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbc680b3bd0 0x7fbc680b6090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c031440 tx=0x7fbc6c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:10.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.587+0000 7fbc81600640 1 -- 172.21.15.37:0/3706770009 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fbc74055e20 con 0x7fbc84102ab0 2024-08-20T04:59:10.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:10.783+0000 7fbc8ac00640 1 -- 172.21.15.37:0/3706770009 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fbc8410a930 con 0x7fbc84102ab0 2024-08-20T04:59:11.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:10 smithi037 ceph-mon[17265]: osdmap e72: 12 total, 12 up, 12 in 2024-08-20T04:59:11.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:10 smithi037 ceph-mon[17265]: pgmap v293: 33 pgs: 10 creating+peering, 22 unknown, 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:11.016 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:10 smithi135 ceph-mon[22342]: osdmap e72: 12 total, 12 up, 12 in 2024-08-20T04:59:11.017 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:10 smithi135 ceph-mon[22342]: pgmap v293: 33 pgs: 10 creating+peering, 22 unknown, 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:11.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:10 smithi130 ceph-mon[22007]: osdmap e72: 12 total, 12 up, 12 in 2024-08-20T04:59:11.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:10 smithi130 ceph-mon[22007]: pgmap v293: 33 pgs: 10 creating+peering, 22 unknown, 1 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:11.754+0000 7fbc81600640 1 -- 172.21.15.37:0/3706770009 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v74) ==== 171+0+0 (secure 0 0 0) 0x7fbc740ab760 con 0x7fbc84102ab0 2024-08-20T04:59:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2024-08-20T04:59:11.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:11.758+0000 7fbc8ac00640 1 -- 172.21.15.37:0/3706770009 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbc680b3bd0 msgr2=0x7fbc680b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:11.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:11.758+0000 7fbc8ac00640 1 --2- 172.21.15.37:0/3706770009 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbc680b3bd0 0x7fbc680b6090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c031440 tx=0x7fbc6c005a20 comp rx=0 tx=0).stop 2024-08-20T04:59:11.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:11.758+0000 7fbc8ac00640 1 -- 172.21.15.37:0/3706770009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc84102ab0 msgr2=0x7fbc84109630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:11.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:11.758+0000 7fbc8ac00640 1 --2- 172.21.15.37:0/3706770009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc84102ab0 0x7fbc84109630 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400ea60 tx=0x7fbc7400ef20 comp rx=0 tx=0).stop 2024-08-20T04:59:11.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:11.758+0000 7fbc8ac00640 1 -- 172.21.15.37:0/3706770009 shutdown_connections 2024-08-20T04:59:11.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:11.758+0000 7fbc8ac00640 1 --2- 172.21.15.37:0/3706770009 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbc680b3bd0 0x7fbc680b6090 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:11.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:11.759+0000 7fbc8ac00640 1 --2- 172.21.15.37:0/3706770009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbc84108e40 0x7fbc8410a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:11.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:11.759+0000 7fbc8ac00640 1 --2- 172.21.15.37:0/3706770009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbc841084c0 0x7fbc84109b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:11.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:11.759+0000 7fbc8ac00640 1 --2- 172.21.15.37:0/3706770009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc84102ab0 0x7fbc84109630 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:11.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:11.759+0000 7fbc8ac00640 1 -- 172.21.15.37:0/3706770009 >> 172.21.15.37:0/3706770009 conn(0x7fbc840fe500 msgr2=0x7fbc84105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:11.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:11.759+0000 7fbc8ac00640 1 -- 172.21.15.37:0/3706770009 shutdown_connections 2024-08-20T04:59:11.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:11.759+0000 7fbc8ac00640 1 -- 172.21.15.37:0/3706770009 wait complete. 2024-08-20T04:59:12.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:11 smithi037 ceph-mon[17265]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-20T04:59:12.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:11 smithi037 ceph-mon[17265]: osdmap e73: 12 total, 12 up, 12 in 2024-08-20T04:59:12.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:11 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3706770009' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-08-20T04:59:12.028 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:11 smithi135 ceph-mon[22342]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-20T04:59:12.028 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:11 smithi135 ceph-mon[22342]: osdmap e73: 12 total, 12 up, 12 in 2024-08-20T04:59:12.029 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:11 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3706770009' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-08-20T04:59:12.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:11 smithi130 ceph-mon[22007]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-20T04:59:12.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:11 smithi130 ceph-mon[22007]: osdmap e73: 12 total, 12 up, 12 in 2024-08-20T04:59:12.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:11 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3706770009' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-08-20T04:59:12.612 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-20T04:59:13.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:12 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3706770009' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-20T04:59:13.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:12 smithi037 ceph-mon[17265]: osdmap e74: 12 total, 12 up, 12 in 2024-08-20T04:59:13.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:12 smithi037 ceph-mon[17265]: pgmap v296: 97 pgs: 10 creating+peering, 76 unknown, 11 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:13.035 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:13.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:12 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3706770009' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-20T04:59:13.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:12 smithi135 ceph-mon[22342]: osdmap e74: 12 total, 12 up, 12 in 2024-08-20T04:59:13.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:12 smithi135 ceph-mon[22342]: pgmap v296: 97 pgs: 10 creating+peering, 76 unknown, 11 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:13.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:12 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3706770009' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-20T04:59:13.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:12 smithi130 ceph-mon[22007]: osdmap e74: 12 total, 12 up, 12 in 2024-08-20T04:59:13.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:12 smithi130 ceph-mon[22007]: pgmap v296: 97 pgs: 10 creating+peering, 76 unknown, 11 active+clean; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:13.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.570+0000 7f2a2fa00640 1 -- 172.21.15.37:0/829879656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a281090e0 msgr2=0x7f2a281094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:13.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.570+0000 7f2a2fa00640 1 --2- 172.21.15.37:0/829879656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a281090e0 0x7f2a281094c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009900 tx=0x7f2a1c02a3f0 comp rx=0 tx=0).stop 2024-08-20T04:59:13.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.571+0000 7f2a2fa00640 1 -- 172.21.15.37:0/829879656 shutdown_connections 2024-08-20T04:59:13.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.571+0000 7f2a2fa00640 1 --2- 172.21.15.37:0/829879656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a2810f470 0x7f2a28115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:13.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.571+0000 7f2a2fa00640 1 --2- 172.21.15.37:0/829879656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a2810eaf0 0x7f2a2810ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:13.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.571+0000 7f2a2fa00640 1 --2- 172.21.15.37:0/829879656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a281090e0 0x7f2a281094c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:13.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.571+0000 7f2a2fa00640 1 -- 172.21.15.37:0/829879656 >> 172.21.15.37:0/829879656 conn(0x7f2a28078760 msgr2=0x7f2a2807ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:13.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.571+0000 7f2a2fa00640 1 -- 172.21.15.37:0/829879656 shutdown_connections 2024-08-20T04:59:13.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.571+0000 7f2a2fa00640 1 -- 172.21.15.37:0/829879656 wait complete. 2024-08-20T04:59:13.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.572+0000 7f2a2fa00640 1 Processor -- start 2024-08-20T04:59:13.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.572+0000 7f2a2fa00640 1 -- start start 2024-08-20T04:59:13.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.572+0000 7f2a2fa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a281090e0 0x7f2a2819f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.572+0000 7f2a2fa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a2810eaf0 0x7f2a2819fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.572+0000 7f2a2fa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a2810f470 0x7f2a281a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.572+0000 7f2a2fa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2a281190d0 con 0x7f2a281090e0 2024-08-20T04:59:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.572+0000 7f2a2fa00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2a28118f50 con 0x7f2a2810eaf0 2024-08-20T04:59:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.572+0000 7f2a2fa00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2a28119250 con 0x7f2a2810f470 2024-08-20T04:59:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.572+0000 7f2a2d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a281090e0 0x7f2a2819f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.572+0000 7f2a27e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a2810eaf0 0x7f2a2819fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.572+0000 7f2a2da00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a2810f470 0x7f2a281a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.572+0000 7f2a2d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a281090e0 0x7f2a2819f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49132/0 (socket says 172.21.15.37:49132) 2024-08-20T04:59:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.573+0000 7f2a27e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a2810eaf0 0x7f2a2819fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:38096/0 (socket says 172.21.15.37:38096) 2024-08-20T04:59:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.573+0000 7f2a2d000640 1 -- 172.21.15.37:0/641947553 learned_addr learned my addr 172.21.15.37:0/641947553 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.573+0000 7f2a27e00640 1 -- 172.21.15.37:0/641947553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a2810f470 msgr2=0x7f2a281a4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.573+0000 7f2a27e00640 1 --2- 172.21.15.37:0/641947553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a2810f470 0x7f2a281a4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.573+0000 7f2a27e00640 1 -- 172.21.15.37:0/641947553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a281090e0 msgr2=0x7f2a2819f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.573+0000 7f2a27e00640 1 --2- 172.21.15.37:0/641947553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a281090e0 0x7f2a2819f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.573+0000 7f2a27e00640 1 -- 172.21.15.37:0/641947553 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a281a5650 con 0x7f2a2810eaf0 2024-08-20T04:59:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.573+0000 7f2a27e00640 1 --2- 172.21.15.37:0/641947553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a2810eaf0 0x7f2a2819fae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400e9f0 tx=0x7f2a1400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.574+0000 7f2a25600640 1 -- 172.21.15.37:0/641947553 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1400cd80 con 0x7f2a2810eaf0 2024-08-20T04:59:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.574+0000 7f2a2fa00640 1 -- 172.21.15.37:0/641947553 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a281a5940 con 0x7f2a2810eaf0 2024-08-20T04:59:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.574+0000 7f2a25600640 1 -- 172.21.15.37:0/641947553 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a140035f0 con 0x7f2a2810eaf0 2024-08-20T04:59:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.574+0000 7f2a25600640 1 -- 172.21.15.37:0/641947553 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a14010690 con 0x7f2a2810eaf0 2024-08-20T04:59:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.574+0000 7f2a2fa00640 1 -- 172.21.15.37:0/641947553 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a281ac000 con 0x7f2a2810eaf0 2024-08-20T04:59:13.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.575+0000 7f2a2fa00640 1 -- 172.21.15.37:0/641947553 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a281094c0 con 0x7f2a2810eaf0 2024-08-20T04:59:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.577+0000 7f2a25600640 1 -- 172.21.15.37:0/641947553 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f2a140037a0 con 0x7f2a2810eaf0 2024-08-20T04:59:13.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.579+0000 7f2a25600640 1 --2- 172.21.15.37:0/641947553 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2a100b3bd0 0x7f2a100b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:13.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.580+0000 7f2a25600640 1 -- 172.21.15.37:0/641947553 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7879+0+0 (secure 0 0 0) 0x7f2a140e3e50 con 0x7f2a2810eaf0 2024-08-20T04:59:13.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.580+0000 7f2a2d000640 1 --2- 172.21.15.37:0/641947553 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2a100b3bd0 0x7f2a100b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:13.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.580+0000 7f2a25600640 1 -- 172.21.15.37:0/641947553 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f2a140ab640 con 0x7f2a2810eaf0 2024-08-20T04:59:13.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.580+0000 7f2a2d000640 1 --2- 172.21.15.37:0/641947553 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2a100b3bd0 0x7f2a100b6090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c0096c0 tx=0x7f2a1c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:13.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:13.820+0000 7f2a2fa00640 1 -- 172.21.15.37:0/641947553 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2a281a06d0 con 0x7f2a2810eaf0 2024-08-20T04:59:14.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:13 smithi135 ceph-mon[22342]: osdmap e75: 12 total, 12 up, 12 in 2024-08-20T04:59:14.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:13 smithi130 ceph-mon[22007]: osdmap e75: 12 total, 12 up, 12 in 2024-08-20T04:59:14.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:13 smithi037 ceph-mon[17265]: osdmap e75: 12 total, 12 up, 12 in 2024-08-20T04:59:14.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:14.781+0000 7f2a25600640 1 -- 172.21.15.37:0/641947553 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f2a281a06d0 con 0x7f2a2810eaf0 2024-08-20T04:59:14.783 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 2 and data pool 3 2024-08-20T04:59:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:14.785+0000 7f2a2fa00640 1 -- 172.21.15.37:0/641947553 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2a100b3bd0 msgr2=0x7f2a100b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:14.785+0000 7f2a2fa00640 1 --2- 172.21.15.37:0/641947553 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2a100b3bd0 0x7f2a100b6090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c0096c0 tx=0x7f2a1c005a20 comp rx=0 tx=0).stop 2024-08-20T04:59:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:14.785+0000 7f2a2fa00640 1 -- 172.21.15.37:0/641947553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a2810eaf0 msgr2=0x7f2a2819fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:14.785+0000 7f2a2fa00640 1 --2- 172.21.15.37:0/641947553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a2810eaf0 0x7f2a2819fae0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400e9f0 tx=0x7f2a1400eeb0 comp rx=0 tx=0).stop 2024-08-20T04:59:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:14.785+0000 7f2a2fa00640 1 -- 172.21.15.37:0/641947553 shutdown_connections 2024-08-20T04:59:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:14.785+0000 7f2a2fa00640 1 --2- 172.21.15.37:0/641947553 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2a100b3bd0 0x7f2a100b6090 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:14.785+0000 7f2a2fa00640 1 --2- 172.21.15.37:0/641947553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a2810f470 0x7f2a281a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:14.785+0000 7f2a2fa00640 1 --2- 172.21.15.37:0/641947553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a2810eaf0 0x7f2a2819fae0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:14.786+0000 7f2a2fa00640 1 --2- 172.21.15.37:0/641947553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a281090e0 0x7f2a2819f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:14.786+0000 7f2a2fa00640 1 -- 172.21.15.37:0/641947553 >> 172.21.15.37:0/641947553 conn(0x7f2a28078760 msgr2=0x7f2a28078fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:14.787+0000 7f2a2fa00640 1 -- 172.21.15.37:0/641947553 shutdown_connections 2024-08-20T04:59:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:14.787+0000 7f2a2fa00640 1 -- 172.21.15.37:0/641947553 wait complete. 2024-08-20T04:59:15.107 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:14 smithi130 ceph-mon[22007]: osdmap e76: 12 total, 12 up, 12 in 2024-08-20T04:59:15.107 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:14 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/641947553' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-20T04:59:15.107 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:14 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-20T04:59:15.107 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:14 smithi130 ceph-mon[22007]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-20T04:59:15.107 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:14 smithi130 ceph-mon[22007]: pgmap v299: 97 pgs: 12 creating+peering, 41 unknown, 44 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:15.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:14 smithi135 ceph-mon[22342]: osdmap e76: 12 total, 12 up, 12 in 2024-08-20T04:59:15.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:14 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/641947553' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-20T04:59:15.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:14 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-20T04:59:15.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:14 smithi135 ceph-mon[22342]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-20T04:59:15.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:14 smithi135 ceph-mon[22342]: pgmap v299: 97 pgs: 12 creating+peering, 41 unknown, 44 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:15.119 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:14 smithi037 ceph-mon[17265]: osdmap e76: 12 total, 12 up, 12 in 2024-08-20T04:59:15.119 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:14 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/641947553' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-20T04:59:15.120 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:14 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-08-20T04:59:15.120 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:14 smithi037 ceph-mon[17265]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-20T04:59:15.120 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:14 smithi037 ceph-mon[17265]: pgmap v299: 97 pgs: 12 creating+peering, 41 unknown, 44 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:15.650 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-08-20T04:59:15.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-08-20T04:59:16.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:15 smithi037 ceph-mon[17265]: osdmap e77: 12 total, 12 up, 12 in 2024-08-20T04:59:16.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:15 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-20T04:59:16.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:15 smithi037 ceph-mon[17265]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-20T04:59:16.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:15 smithi037 ceph-mon[17265]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-20T04:59:16.038 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:16.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:15 smithi135 ceph-mon[22342]: osdmap e77: 12 total, 12 up, 12 in 2024-08-20T04:59:16.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:15 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-20T04:59:16.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:15 smithi135 ceph-mon[22342]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-20T04:59:16.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:15 smithi135 ceph-mon[22342]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-20T04:59:16.121 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:15 smithi130 ceph-mon[22007]: osdmap e77: 12 total, 12 up, 12 in 2024-08-20T04:59:16.121 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:15 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-20T04:59:16.121 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:15 smithi130 ceph-mon[22007]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-20T04:59:16.121 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:15 smithi130 ceph-mon[22007]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-20T04:59:16.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.734+0000 7fb8b1c00640 1 -- 172.21.15.37:0/3691867392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8ac104ca0 msgr2=0x7fb8ac105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:16.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.734+0000 7fb8b1c00640 1 --2- 172.21.15.37:0/3691867392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8ac104ca0 0x7fb8ac105080 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009900 tx=0x7fb89c02a3f0 comp rx=0 tx=0).stop 2024-08-20T04:59:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.734+0000 7fb8b1c00640 1 -- 172.21.15.37:0/3691867392 shutdown_connections 2024-08-20T04:59:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.734+0000 7fb8b1c00640 1 --2- 172.21.15.37:0/3691867392 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8ac10b030 0x7fb8ac111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.734+0000 7fb8b1c00640 1 --2- 172.21.15.37:0/3691867392 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8ac10a6b0 0x7fb8ac10aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.734+0000 7fb8b1c00640 1 --2- 172.21.15.37:0/3691867392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8ac104ca0 0x7fb8ac105080 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.734+0000 7fb8b1c00640 1 -- 172.21.15.37:0/3691867392 >> 172.21.15.37:0/3691867392 conn(0x7fb8ac100730 msgr2=0x7fb8ac102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.734+0000 7fb8b1c00640 1 -- 172.21.15.37:0/3691867392 shutdown_connections 2024-08-20T04:59:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.734+0000 7fb8b1c00640 1 -- 172.21.15.37:0/3691867392 wait complete. 2024-08-20T04:59:16.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.735+0000 7fb8b1c00640 1 Processor -- start 2024-08-20T04:59:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.735+0000 7fb8b1c00640 1 -- start start 2024-08-20T04:59:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.735+0000 7fb8b1c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8ac104ca0 0x7fb8ac19b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.735+0000 7fb8b1c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8ac10a6b0 0x7fb8ac19b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.735+0000 7fb8b1c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8ac10b030 0x7fb8ac1a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.735+0000 7fb8b1c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ac114d00 con 0x7fb8ac10b030 2024-08-20T04:59:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.735+0000 7fb8b1c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ac114b80 con 0x7fb8ac104ca0 2024-08-20T04:59:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.735+0000 7fb8b1c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ac114e80 con 0x7fb8ac10a6b0 2024-08-20T04:59:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.735+0000 7fb8aaa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8ac104ca0 0x7fb8ac19b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:16.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.735+0000 7fb8a2000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8ac10a6b0 0x7fb8ac19b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:16.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.735+0000 7fb8ab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8ac10b030 0x7fb8ac1a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:16.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.735+0000 7fb8aaa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8ac104ca0 0x7fb8ac19b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:38104/0 (socket says 172.21.15.37:38104) 2024-08-20T04:59:16.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.735+0000 7fb8aaa00640 1 -- 172.21.15.37:0/4223415450 learned_addr learned my addr 172.21.15.37:0/4223415450 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:16.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.736+0000 7fb8aaa00640 1 -- 172.21.15.37:0/4223415450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8ac10a6b0 msgr2=0x7fb8ac19b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:16.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.736+0000 7fb8aaa00640 1 --2- 172.21.15.37:0/4223415450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8ac10a6b0 0x7fb8ac19b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:16.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.736+0000 7fb8aaa00640 1 -- 172.21.15.37:0/4223415450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8ac10b030 msgr2=0x7fb8ac1a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:16.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.736+0000 7fb8aaa00640 1 --2- 172.21.15.37:0/4223415450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8ac10b030 0x7fb8ac1a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:16.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.736+0000 7fb8aaa00640 1 -- 172.21.15.37:0/4223415450 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ac1a1240 con 0x7fb8ac104ca0 2024-08-20T04:59:16.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.736+0000 7fb8ab400640 1 --2- 172.21.15.37:0/4223415450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8ac10b030 0x7fb8ac1a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:59:16.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.736+0000 7fb8aaa00640 1 --2- 172.21.15.37:0/4223415450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8ac104ca0 0x7fb8ac19b190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb89c005ab0 tx=0x7fb89c003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:16.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.737+0000 7fb8a3e00640 1 -- 172.21.15.37:0/4223415450 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c03f070 con 0x7fb8ac104ca0 2024-08-20T04:59:16.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.737+0000 7fb8b1c00640 1 -- 172.21.15.37:0/4223415450 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8ac1a14d0 con 0x7fb8ac104ca0 2024-08-20T04:59:16.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.737+0000 7fb8a3e00640 1 -- 172.21.15.37:0/4223415450 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb89c031d60 con 0x7fb8ac104ca0 2024-08-20T04:59:16.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.737+0000 7fb8a3e00640 1 -- 172.21.15.37:0/4223415450 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c035030 con 0x7fb8ac104ca0 2024-08-20T04:59:16.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.737+0000 7fb8b1c00640 1 -- 172.21.15.37:0/4223415450 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8ac1a7bf0 con 0x7fb8ac104ca0 2024-08-20T04:59:16.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.738+0000 7fb8b1c00640 1 -- 172.21.15.37:0/4223415450 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8ac105080 con 0x7fb8ac104ca0 2024-08-20T04:59:16.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.740+0000 7fb8a3e00640 1 -- 172.21.15.37:0/4223415450 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fb89c042070 con 0x7fb8ac104ca0 2024-08-20T04:59:16.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.741+0000 7fb8a3e00640 1 --2- 172.21.15.37:0/4223415450 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb8900b3bd0 0x7fb8900b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:16.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.742+0000 7fb8a3e00640 1 -- 172.21.15.37:0/4223415450 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7979+0+0 (secure 0 0 0) 0x7fb89c104760 con 0x7fb8ac104ca0 2024-08-20T04:59:16.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.742+0000 7fb8a2000640 1 --2- 172.21.15.37:0/4223415450 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb8900b3bd0 0x7fb8900b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:16.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.742+0000 7fb8a2000640 1 --2- 172.21.15.37:0/4223415450 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb8900b3bd0 0x7fb8900b6090 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac104080 tx=0x7fb89400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:16.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.743+0000 7fb8a3e00640 1 -- 172.21.15.37:0/4223415450 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fb89c0cb810 con 0x7fb8ac104ca0 2024-08-20T04:59:16.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:16.954+0000 7fb8b1c00640 1 -- 172.21.15.37:0/4223415450 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fb8ac19c2c0 con 0x7fb8ac104ca0 2024-08-20T04:59:16.957 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:16 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] up:active 2024-08-20T04:59:16.957 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:16 smithi037 ceph-mon[17265]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T04:59:16.957 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:16 smithi037 ceph-mon[17265]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T04:59:16.957 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:16 smithi037 ceph-mon[17265]: pgmap v301: 97 pgs: 2 creating+peering, 4 unknown, 91 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 485 B/s wr, 1 op/s 2024-08-20T04:59:17.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:16 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] up:active 2024-08-20T04:59:17.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:16 smithi135 ceph-mon[22342]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T04:59:17.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:16 smithi135 ceph-mon[22342]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T04:59:17.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:16 smithi135 ceph-mon[22342]: pgmap v301: 97 pgs: 2 creating+peering, 4 unknown, 91 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 485 B/s wr, 1 op/s 2024-08-20T04:59:17.205 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 04:59:16 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b[51794]: 2024-08-20T04:59:16.713+0000 7fabb9c61640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-20T04:59:17.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:16 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] up:active 2024-08-20T04:59:17.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:16 smithi130 ceph-mon[22007]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T04:59:17.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:16 smithi130 ceph-mon[22007]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T04:59:17.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:16 smithi130 ceph-mon[22007]: pgmap v301: 97 pgs: 2 creating+peering, 4 unknown, 91 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 485 B/s wr, 1 op/s 2024-08-20T04:59:17.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:17.796+0000 7fb8a3e00640 1 -- 172.21.15.37:0/4223415450 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v78) ==== 157+0+0 (secure 0 0 0) 0x7fb89c0cfd60 con 0x7fb8ac104ca0 2024-08-20T04:59:17.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:17.799+0000 7fb8b1c00640 1 -- 172.21.15.37:0/4223415450 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb8900b3bd0 msgr2=0x7fb8900b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:17.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:17.799+0000 7fb8b1c00640 1 --2- 172.21.15.37:0/4223415450 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb8900b3bd0 0x7fb8900b6090 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac104080 tx=0x7fb89400b410 comp rx=0 tx=0).stop 2024-08-20T04:59:17.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:17.799+0000 7fb8b1c00640 1 -- 172.21.15.37:0/4223415450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8ac104ca0 msgr2=0x7fb8ac19b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:17.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:17.799+0000 7fb8b1c00640 1 --2- 172.21.15.37:0/4223415450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8ac104ca0 0x7fb8ac19b190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb89c005ab0 tx=0x7fb89c003cd0 comp rx=0 tx=0).stop 2024-08-20T04:59:17.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:17.799+0000 7fb8b1c00640 1 -- 172.21.15.37:0/4223415450 shutdown_connections 2024-08-20T04:59:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:17.799+0000 7fb8b1c00640 1 --2- 172.21.15.37:0/4223415450 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb8900b3bd0 0x7fb8900b6090 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:17.799+0000 7fb8b1c00640 1 --2- 172.21.15.37:0/4223415450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8ac10b030 0x7fb8ac1a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:17.799+0000 7fb8b1c00640 1 --2- 172.21.15.37:0/4223415450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8ac10a6b0 0x7fb8ac19b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:17.799+0000 7fb8b1c00640 1 --2- 172.21.15.37:0/4223415450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8ac104ca0 0x7fb8ac19b190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:17.799+0000 7fb8b1c00640 1 -- 172.21.15.37:0/4223415450 >> 172.21.15.37:0/4223415450 conn(0x7fb8ac100730 msgr2=0x7fb8ac102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:17.799+0000 7fb8b1c00640 1 -- 172.21.15.37:0/4223415450 shutdown_connections 2024-08-20T04:59:17.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:17.799+0000 7fb8b1c00640 1 -- 172.21.15.37:0/4223415450 wait complete. 2024-08-20T04:59:18.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:17 smithi135 ceph-mon[22342]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-20T04:59:18.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:17 smithi135 ceph-mon[22342]: Cluster is now healthy 2024-08-20T04:59:18.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:17 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/4223415450' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-08-20T04:59:18.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:17 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-08-20T04:59:18.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:17 smithi037 ceph-mon[17265]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-20T04:59:18.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:17 smithi037 ceph-mon[17265]: Cluster is now healthy 2024-08-20T04:59:18.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:17 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/4223415450' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-08-20T04:59:18.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:17 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-08-20T04:59:18.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:17 smithi130 ceph-mon[22007]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-20T04:59:18.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:17 smithi130 ceph-mon[22007]: Cluster is now healthy 2024-08-20T04:59:18.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:17 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/4223415450' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-08-20T04:59:18.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:17 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-08-20T04:59:18.683 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-08-20T04:59:19.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:18 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-20T04:59:19.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:18 smithi037 ceph-mon[17265]: osdmap e78: 12 total, 12 up, 12 in 2024-08-20T04:59:19.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:18 smithi037 ceph-mon[17265]: pgmap v303: 97 pgs: 97 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 2 op/s 2024-08-20T04:59:19.067 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:19.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:18 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-20T04:59:19.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:18 smithi135 ceph-mon[22342]: osdmap e78: 12 total, 12 up, 12 in 2024-08-20T04:59:19.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:18 smithi135 ceph-mon[22342]: pgmap v303: 97 pgs: 97 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 2 op/s 2024-08-20T04:59:19.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:18 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-20T04:59:19.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:18 smithi130 ceph-mon[22007]: osdmap e78: 12 total, 12 up, 12 in 2024-08-20T04:59:19.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:18 smithi130 ceph-mon[22007]: pgmap v303: 97 pgs: 97 active+clean; 577 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 2 op/s 2024-08-20T04:59:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.617+0000 7f9dcf200640 1 -- 172.21.15.37:0/1712516717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd0104b10 msgr2=0x7f9dd0104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.617+0000 7f9dcf200640 1 --2- 172.21.15.37:0/1712516717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd0104b10 0x7f9dd0104ef0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0009900 tx=0x7f9dc002a3f0 comp rx=0 tx=0).stop 2024-08-20T04:59:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.617+0000 7f9dcf200640 1 -- 172.21.15.37:0/1712516717 shutdown_connections 2024-08-20T04:59:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.617+0000 7f9dcf200640 1 --2- 172.21.15.37:0/1712516717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dd010aea0 0x7f9dd01116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.617+0000 7f9dcf200640 1 --2- 172.21.15.37:0/1712516717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd010a520 0x7f9dd010a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:19.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.617+0000 7f9dcf200640 1 --2- 172.21.15.37:0/1712516717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd0104b10 0x7f9dd0104ef0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:19.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.617+0000 7f9dcf200640 1 -- 172.21.15.37:0/1712516717 >> 172.21.15.37:0/1712516717 conn(0x7f9dd0100540 msgr2=0x7f9dd0102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:19.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.617+0000 7f9dcf200640 1 -- 172.21.15.37:0/1712516717 shutdown_connections 2024-08-20T04:59:19.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.617+0000 7f9dcf200640 1 -- 172.21.15.37:0/1712516717 wait complete. 2024-08-20T04:59:19.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.618+0000 7f9dcf200640 1 Processor -- start 2024-08-20T04:59:19.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.619+0000 7f9dcf200640 1 -- start start 2024-08-20T04:59:19.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.619+0000 7f9dcf200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd0104b10 0x7f9dd019af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:19.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.619+0000 7f9dcf200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dd010a520 0x7f9dd019b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:19.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.619+0000 7f9dcf200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd010aea0 0x7f9dd01a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:19.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.619+0000 7f9dcf200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd0114b70 con 0x7f9dd0104b10 2024-08-20T04:59:19.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.619+0000 7f9dcf200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd01149f0 con 0x7f9dd010aea0 2024-08-20T04:59:19.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.619+0000 7f9dcf200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd0114cf0 con 0x7f9dd010a520 2024-08-20T04:59:19.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.619+0000 7f9dcde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd0104b10 0x7f9dd019af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:19.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.619+0000 7f9dcde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd0104b10 0x7f9dd019af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49160/0 (socket says 172.21.15.37:49160) 2024-08-20T04:59:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.619+0000 7f9dcde00640 1 -- 172.21.15.37:0/3106012052 learned_addr learned my addr 172.21.15.37:0/3106012052 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.619+0000 7f9dcd400640 1 --2- 172.21.15.37:0/3106012052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dd010a520 0x7f9dd019b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.619+0000 7f9dce800640 1 --2- 172.21.15.37:0/3106012052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd010aea0 0x7f9dd01a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.620+0000 7f9dcde00640 1 -- 172.21.15.37:0/3106012052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dd010a520 msgr2=0x7f9dd019b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.620+0000 7f9dcde00640 1 --2- 172.21.15.37:0/3106012052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dd010a520 0x7f9dd019b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.620+0000 7f9dcde00640 1 -- 172.21.15.37:0/3106012052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd010aea0 msgr2=0x7f9dd01a0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.620+0000 7f9dcde00640 1 --2- 172.21.15.37:0/3106012052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd010aea0 0x7f9dd01a0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.620+0000 7f9dcde00640 1 -- 172.21.15.37:0/3106012052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd01a0ff0 con 0x7f9dd0104b10 2024-08-20T04:59:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.620+0000 7f9dcde00640 1 --2- 172.21.15.37:0/3106012052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd0104b10 0x7f9dd019af40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0005ab0 tx=0x7f9dc0003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.620+0000 7f9dc6a00640 1 -- 172.21.15.37:0/3106012052 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc003f070 con 0x7f9dd0104b10 2024-08-20T04:59:19.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.620+0000 7f9dc6a00640 1 -- 172.21.15.37:0/3106012052 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dc0031d60 con 0x7f9dd0104b10 2024-08-20T04:59:19.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.620+0000 7f9dc6a00640 1 -- 172.21.15.37:0/3106012052 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0035030 con 0x7f9dd0104b10 2024-08-20T04:59:19.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.620+0000 7f9dcf200640 1 -- 172.21.15.37:0/3106012052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd01a1280 con 0x7f9dd0104b10 2024-08-20T04:59:19.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.620+0000 7f9dcf200640 1 -- 172.21.15.37:0/3106012052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd01a79a0 con 0x7f9dd0104b10 2024-08-20T04:59:19.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.621+0000 7f9dcf200640 1 -- 172.21.15.37:0/3106012052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd0104ef0 con 0x7f9dd0104b10 2024-08-20T04:59:19.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.624+0000 7f9dc6a00640 1 -- 172.21.15.37:0/3106012052 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f9dc0042070 con 0x7f9dd0104b10 2024-08-20T04:59:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.625+0000 7f9dc6a00640 1 --2- 172.21.15.37:0/3106012052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9db40b3cf0 0x7f9db40b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.626+0000 7f9dc6a00640 1 -- 172.21.15.37:0/3106012052 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8277+0+0 (secure 0 0 0) 0x7f9dc0104a00 con 0x7f9dd0104b10 2024-08-20T04:59:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.626+0000 7f9dcd400640 1 --2- 172.21.15.37:0/3106012052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9db40b3cf0 0x7f9db40b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:19.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.626+0000 7f9dcd400640 1 --2- 172.21.15.37:0/3106012052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9db40b3cf0 0x7f9db40b61b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9dd010a110 tx=0x7f9dbc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:19.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.628+0000 7f9dc6a00640 1 -- 172.21.15.37:0/3106012052 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f9dc00cb970 con 0x7f9dd0104b10 2024-08-20T04:59:19.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:19.822+0000 7f9dcf200640 1 -- 172.21.15.37:0/3106012052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f9dd01a7c60 con 0x7f9dd0104b10 2024-08-20T04:59:20.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:19 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3106012052' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-20T04:59:20.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:19 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3106012052' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-20T04:59:20.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:19 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3106012052' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-08-20T04:59:20.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:20.877+0000 7f9dc6a00640 1 -- 172.21.15.37:0/3106012052 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v80) ==== 228+0+0 (secure 0 0 0) 0x7f9dc00cfec0 con 0x7f9dd0104b10 2024-08-20T04:59:20.879 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data_ec' created 2024-08-20T04:59:20.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:20.881+0000 7f9dcf200640 1 -- 172.21.15.37:0/3106012052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9db40b3cf0 msgr2=0x7f9db40b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:20.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:20.881+0000 7f9dcf200640 1 --2- 172.21.15.37:0/3106012052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9db40b3cf0 0x7f9db40b61b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9dd010a110 tx=0x7f9dbc00b390 comp rx=0 tx=0).stop 2024-08-20T04:59:20.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:20.881+0000 7f9dcf200640 1 -- 172.21.15.37:0/3106012052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd0104b10 msgr2=0x7f9dd019af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:20.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:20.881+0000 7f9dcf200640 1 --2- 172.21.15.37:0/3106012052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd0104b10 0x7f9dd019af40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0005ab0 tx=0x7f9dc0003c80 comp rx=0 tx=0).stop 2024-08-20T04:59:20.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:20.882+0000 7f9dcf200640 1 -- 172.21.15.37:0/3106012052 shutdown_connections 2024-08-20T04:59:20.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:20.882+0000 7f9dcf200640 1 --2- 172.21.15.37:0/3106012052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9db40b3cf0 0x7f9db40b61b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:20.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:20.882+0000 7f9dcf200640 1 --2- 172.21.15.37:0/3106012052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9dd010aea0 0x7f9dd01a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:20.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:20.882+0000 7f9dcf200640 1 --2- 172.21.15.37:0/3106012052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9dd010a520 0x7f9dd019b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:20.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:20.882+0000 7f9dcf200640 1 --2- 172.21.15.37:0/3106012052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd0104b10 0x7f9dd019af40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:20.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:20.882+0000 7f9dcf200640 1 -- 172.21.15.37:0/3106012052 >> 172.21.15.37:0/3106012052 conn(0x7f9dd0100540 msgr2=0x7f9dd0102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:20.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:20.882+0000 7f9dcf200640 1 -- 172.21.15.37:0/3106012052 shutdown_connections 2024-08-20T04:59:20.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:20.882+0000 7f9dcf200640 1 -- 172.21.15.37:0/3106012052 wait complete. 2024-08-20T04:59:21.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:20 smithi130 ceph-mon[22007]: osdmap e79: 12 total, 12 up, 12 in 2024-08-20T04:59:21.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:20 smithi130 ceph-mon[22007]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-08-20T04:59:21.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:20 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3106012052' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-20T04:59:21.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:20 smithi130 ceph-mon[22007]: osdmap e80: 12 total, 12 up, 12 in 2024-08-20T04:59:21.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:20 smithi037 ceph-mon[17265]: osdmap e79: 12 total, 12 up, 12 in 2024-08-20T04:59:21.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:20 smithi037 ceph-mon[17265]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-08-20T04:59:21.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:20 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3106012052' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-20T04:59:21.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:20 smithi037 ceph-mon[17265]: osdmap e80: 12 total, 12 up, 12 in 2024-08-20T04:59:21.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:20 smithi135 ceph-mon[22342]: osdmap e79: 12 total, 12 up, 12 in 2024-08-20T04:59:21.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:20 smithi135 ceph-mon[22342]: pgmap v305: 97 pgs: 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-08-20T04:59:21.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:20 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3106012052' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-20T04:59:21.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:20 smithi135 ceph-mon[22342]: osdmap e80: 12 total, 12 up, 12 in 2024-08-20T04:59:21.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-08-20T04:59:22.188 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:22.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.780+0000 7ff184c00640 1 -- 172.21.15.37:0/158730123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1801136a0 msgr2=0x7ff180115a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:22.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.780+0000 7ff184c00640 1 --2- 172.21.15.37:0/158730123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1801136a0 0x7ff180115a90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff178009be0 tx=0x7ff17802a6c0 comp rx=0 tx=0).stop 2024-08-20T04:59:22.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.780+0000 7ff184c00640 1 -- 172.21.15.37:0/158730123 shutdown_connections 2024-08-20T04:59:22.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.780+0000 7ff184c00640 1 --2- 172.21.15.37:0/158730123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1801136a0 0x7ff180115a90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:22.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.780+0000 7ff184c00640 1 --2- 172.21.15.37:0/158730123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff180077d20 0x7ff180113160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:22.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.780+0000 7ff184c00640 1 --2- 172.21.15.37:0/158730123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff180077400 0x7ff1800777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:22.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.780+0000 7ff184c00640 1 -- 172.21.15.37:0/158730123 >> 172.21.15.37:0/158730123 conn(0x7ff180100720 msgr2=0x7ff180102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:22.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.780+0000 7ff184c00640 1 -- 172.21.15.37:0/158730123 shutdown_connections 2024-08-20T04:59:22.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.780+0000 7ff184c00640 1 -- 172.21.15.37:0/158730123 wait complete. 2024-08-20T04:59:22.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.782+0000 7ff184c00640 1 Processor -- start 2024-08-20T04:59:22.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.782+0000 7ff184c00640 1 -- start start 2024-08-20T04:59:22.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.782+0000 7ff184c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff180077400 0x7ff18019f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:22.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.782+0000 7ff184c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff180077d20 0x7ff18019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:22.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.782+0000 7ff184c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1801136a0 0x7ff1801a4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:22.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.782+0000 7ff184c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff180119070 con 0x7ff180077d20 2024-08-20T04:59:22.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.782+0000 7ff184c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff180118ef0 con 0x7ff1801136a0 2024-08-20T04:59:22.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.782+0000 7ff184c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff1801191f0 con 0x7ff180077400 2024-08-20T04:59:22.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.783+0000 7ff17de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff180077400 0x7ff18019f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:22.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.783+0000 7ff175400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff180077d20 0x7ff18019fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:22.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.783+0000 7ff17de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff180077400 0x7ff18019f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:58186/0 (socket says 172.21.15.37:58186) 2024-08-20T04:59:22.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.783+0000 7ff17de00640 1 -- 172.21.15.37:0/1951210231 learned_addr learned my addr 172.21.15.37:0/1951210231 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:22.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.783+0000 7ff17e800640 1 --2- 172.21.15.37:0/1951210231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1801136a0 0x7ff1801a4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:22.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.783+0000 7ff175400640 1 -- 172.21.15.37:0/1951210231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff180077400 msgr2=0x7ff18019f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:22.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.783+0000 7ff175400640 1 --2- 172.21.15.37:0/1951210231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff180077400 0x7ff18019f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:22.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.783+0000 7ff175400640 1 -- 172.21.15.37:0/1951210231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1801136a0 msgr2=0x7ff1801a4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:22.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.783+0000 7ff175400640 1 --2- 172.21.15.37:0/1951210231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1801136a0 0x7ff1801a4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.783+0000 7ff175400640 1 -- 172.21.15.37:0/1951210231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1801a55b0 con 0x7ff180077d20 2024-08-20T04:59:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.783+0000 7ff175400640 1 --2- 172.21.15.37:0/1951210231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff180077d20 0x7ff18019fa40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff16800e9f0 tx=0x7ff16800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.784+0000 7ff177400640 1 -- 172.21.15.37:0/1951210231 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16800ccc0 con 0x7ff180077d20 2024-08-20T04:59:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.784+0000 7ff177400640 1 -- 172.21.15.37:0/1951210231 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1680108e0 con 0x7ff180077d20 2024-08-20T04:59:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.784+0000 7ff177400640 1 -- 172.21.15.37:0/1951210231 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff168018880 con 0x7ff180077d20 2024-08-20T04:59:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.784+0000 7ff184c00640 1 -- 172.21.15.37:0/1951210231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1801a58a0 con 0x7ff180077d20 2024-08-20T04:59:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.784+0000 7ff184c00640 1 -- 172.21.15.37:0/1951210231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1801abf60 con 0x7ff180077d20 2024-08-20T04:59:22.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.785+0000 7ff184c00640 1 -- 172.21.15.37:0/1951210231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1800777e0 con 0x7ff180077d20 2024-08-20T04:59:22.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.788+0000 7ff177400640 1 -- 172.21.15.37:0/1951210231 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7ff168010430 con 0x7ff180077d20 2024-08-20T04:59:22.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.789+0000 7ff177400640 1 --2- 172.21.15.37:0/1951210231 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff1640b3c50 0x7ff1640b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:22.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.789+0000 7ff177400640 1 -- 172.21.15.37:0/1951210231 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8770+0+0 (secure 0 0 0) 0x7ff1680e45a0 con 0x7ff180077d20 2024-08-20T04:59:22.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.789+0000 7ff17de00640 1 --2- 172.21.15.37:0/1951210231 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff1640b3c50 0x7ff1640b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:22.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.790+0000 7ff17de00640 1 --2- 172.21.15.37:0/1951210231 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff1640b3c50 0x7ff1640b6110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff170005c80 tx=0x7ff170009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:22.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.791+0000 7ff177400640 1 -- 172.21.15.37:0/1951210231 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff1680ab320 con 0x7ff180077d20 2024-08-20T04:59:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:22.989+0000 7ff184c00640 1 -- 172.21.15.37:0/1951210231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7ff1801ac2a0 con 0x7ff180077d20 2024-08-20T04:59:22.991 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:22 smithi037 ceph-mon[17265]: osdmap e81: 12 total, 12 up, 12 in 2024-08-20T04:59:22.991 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:22 smithi037 ceph-mon[17265]: pgmap v308: 129 pgs: 4 creating+peering, 28 unknown, 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s wr, 7 op/s 2024-08-20T04:59:23.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:22 smithi135 ceph-mon[22342]: osdmap e81: 12 total, 12 up, 12 in 2024-08-20T04:59:23.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:22 smithi135 ceph-mon[22342]: pgmap v308: 129 pgs: 4 creating+peering, 28 unknown, 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s wr, 7 op/s 2024-08-20T04:59:23.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:22 smithi130 ceph-mon[22007]: osdmap e81: 12 total, 12 up, 12 in 2024-08-20T04:59:23.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:22 smithi130 ceph-mon[22007]: pgmap v308: 129 pgs: 4 creating+peering, 28 unknown, 97 active+clean; 579 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 980 B/s wr, 7 op/s 2024-08-20T04:59:23.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:23.892+0000 7ff177400640 1 -- 172.21.15.37:0/1951210231 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v83) ==== 169+0+0 (secure 0 0 0) 0x7ff1680af870 con 0x7ff180077d20 2024-08-20T04:59:23.895 INFO:teuthology.orchestra.run.smithi037.stderr:set pool 4 allow_ec_overwrites to true 2024-08-20T04:59:23.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:23.896+0000 7ff184c00640 1 -- 172.21.15.37:0/1951210231 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff1640b3c50 msgr2=0x7ff1640b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:23.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:23.896+0000 7ff184c00640 1 --2- 172.21.15.37:0/1951210231 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff1640b3c50 0x7ff1640b6110 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff170005c80 tx=0x7ff170009260 comp rx=0 tx=0).stop 2024-08-20T04:59:23.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:23.896+0000 7ff184c00640 1 -- 172.21.15.37:0/1951210231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff180077d20 msgr2=0x7ff18019fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:23.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:23.896+0000 7ff184c00640 1 --2- 172.21.15.37:0/1951210231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff180077d20 0x7ff18019fa40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff16800e9f0 tx=0x7ff16800eeb0 comp rx=0 tx=0).stop 2024-08-20T04:59:23.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:23.896+0000 7ff184c00640 1 -- 172.21.15.37:0/1951210231 shutdown_connections 2024-08-20T04:59:23.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:23.896+0000 7ff184c00640 1 --2- 172.21.15.37:0/1951210231 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff1640b3c50 0x7ff1640b6110 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:23.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:23.896+0000 7ff184c00640 1 --2- 172.21.15.37:0/1951210231 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1801136a0 0x7ff1801a4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:23.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:23.896+0000 7ff184c00640 1 --2- 172.21.15.37:0/1951210231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff180077d20 0x7ff18019fa40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:23.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:23.896+0000 7ff184c00640 1 --2- 172.21.15.37:0/1951210231 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff180077400 0x7ff18019f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:23.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:23.896+0000 7ff184c00640 1 -- 172.21.15.37:0/1951210231 >> 172.21.15.37:0/1951210231 conn(0x7ff180100720 msgr2=0x7ff180102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:23.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:23.897+0000 7ff184c00640 1 -- 172.21.15.37:0/1951210231 shutdown_connections 2024-08-20T04:59:23.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:23.897+0000 7ff184c00640 1 -- 172.21.15.37:0/1951210231 wait complete. 2024-08-20T04:59:24.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:23 smithi130 ceph-mon[22007]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-20T04:59:24.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:23 smithi130 ceph-mon[22007]: osdmap e82: 12 total, 12 up, 12 in 2024-08-20T04:59:24.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:23 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1951210231' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-08-20T04:59:24.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:23 smithi037 ceph-mon[17265]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-20T04:59:24.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:23 smithi037 ceph-mon[17265]: osdmap e82: 12 total, 12 up, 12 in 2024-08-20T04:59:24.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:23 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1951210231' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-08-20T04:59:24.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:23 smithi135 ceph-mon[22342]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-20T04:59:24.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:23 smithi135 ceph-mon[22342]: osdmap e82: 12 total, 12 up, 12 in 2024-08-20T04:59:24.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:23 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1951210231' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-08-20T04:59:24.700 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-08-20T04:59:25.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:24 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1951210231' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-20T04:59:25.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:24 smithi037 ceph-mon[17265]: osdmap e83: 12 total, 12 up, 12 in 2024-08-20T04:59:25.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:24 smithi037 ceph-mon[17265]: pgmap v311: 129 pgs: 4 creating+peering, 13 unknown, 112 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:25.085 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:25.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:24 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1951210231' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-20T04:59:25.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:24 smithi130 ceph-mon[22007]: osdmap e83: 12 total, 12 up, 12 in 2024-08-20T04:59:25.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:24 smithi130 ceph-mon[22007]: pgmap v311: 129 pgs: 4 creating+peering, 13 unknown, 112 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:25.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:24 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1951210231' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-20T04:59:25.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:24 smithi135 ceph-mon[22342]: osdmap e83: 12 total, 12 up, 12 in 2024-08-20T04:59:25.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:24 smithi135 ceph-mon[22342]: pgmap v311: 129 pgs: 4 creating+peering, 13 unknown, 112 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:25.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.618+0000 7f1706a00640 1 -- 172.21.15.37:0/1584436934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1700108330 msgr2=0x7f1700108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:25.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.618+0000 7f1706a00640 1 --2- 172.21.15.37:0/1584436934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1700108330 0x7f1700108770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009900 tx=0x7f16ec02a410 comp rx=0 tx=0).stop 2024-08-20T04:59:25.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.618+0000 7f1706a00640 1 -- 172.21.15.37:0/1584436934 shutdown_connections 2024-08-20T04:59:25.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.618+0000 7f1706a00640 1 --2- 172.21.15.37:0/1584436934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1700108cb0 0x7f170010f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:25.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.618+0000 7f1706a00640 1 --2- 172.21.15.37:0/1584436934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1700108330 0x7f1700108770 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:25.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.618+0000 7f1706a00640 1 --2- 172.21.15.37:0/1584436934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1700102920 0x7f1700102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:25.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.618+0000 7f1706a00640 1 -- 172.21.15.37:0/1584436934 >> 172.21.15.37:0/1584436934 conn(0x7f17000fe350 msgr2=0x7f1700100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:25.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.618+0000 7f1706a00640 1 -- 172.21.15.37:0/1584436934 shutdown_connections 2024-08-20T04:59:25.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.618+0000 7f1706a00640 1 -- 172.21.15.37:0/1584436934 wait complete. 2024-08-20T04:59:25.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.619+0000 7f1706a00640 1 Processor -- start 2024-08-20T04:59:25.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.619+0000 7f1706a00640 1 -- start start 2024-08-20T04:59:25.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1706a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1700102920 0x7f17000751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:25.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1706a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1700108330 0x7f1700075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1706a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1700108cb0 0x7f1700075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1706a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f17001129c0 con 0x7f1700108330 2024-08-20T04:59:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1706a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1700112840 con 0x7f1700108cb0 2024-08-20T04:59:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1706a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1700112b40 con 0x7f1700102920 2024-08-20T04:59:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1704c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1700108330 0x7f1700075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1705600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1700102920 0x7f17000751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1704c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1700108330 0x7f1700075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57186/0 (socket says 172.21.15.37:57186) 2024-08-20T04:59:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1704c00640 1 -- 172.21.15.37:0/407831644 learned_addr learned my addr 172.21.15.37:0/407831644 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1705600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1700102920 0x7f17000751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:58264/0 (socket says 172.21.15.37:58264) 2024-08-20T04:59:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1706000640 1 --2- 172.21.15.37:0/407831644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1700108cb0 0x7f1700075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1704c00640 1 -- 172.21.15.37:0/407831644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1700102920 msgr2=0x7f17000751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:25.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1704c00640 1 --2- 172.21.15.37:0/407831644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1700102920 0x7f17000751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:25.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1704c00640 1 -- 172.21.15.37:0/407831644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1700108cb0 msgr2=0x7f1700075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:25.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1704c00640 1 --2- 172.21.15.37:0/407831644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1700108cb0 0x7f1700075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:25.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1704c00640 1 -- 172.21.15.37:0/407831644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17001a7170 con 0x7f1700108330 2024-08-20T04:59:25.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.620+0000 7f1706000640 1 --2- 172.21.15.37:0/407831644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1700108cb0 0x7f1700075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:59:25.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.621+0000 7f1704c00640 1 --2- 172.21.15.37:0/407831644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1700108330 0x7f1700075710 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f16ec005ab0 tx=0x7f16ec003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:25.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.621+0000 7f16fe000640 1 -- 172.21.15.37:0/407831644 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec03f070 con 0x7f1700108330 2024-08-20T04:59:25.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.621+0000 7f16fe000640 1 -- 172.21.15.37:0/407831644 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16ec031b60 con 0x7f1700108330 2024-08-20T04:59:25.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.621+0000 7f1706a00640 1 -- 172.21.15.37:0/407831644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17001a7400 con 0x7f1700108330 2024-08-20T04:59:25.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.621+0000 7f16fe000640 1 -- 172.21.15.37:0/407831644 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16ec035030 con 0x7f1700108330 2024-08-20T04:59:25.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.621+0000 7f1706a00640 1 -- 172.21.15.37:0/407831644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17001a78e0 con 0x7f1700108330 2024-08-20T04:59:25.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.622+0000 7f1706a00640 1 -- 172.21.15.37:0/407831644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1700102d00 con 0x7f1700108330 2024-08-20T04:59:25.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.625+0000 7f16fe000640 1 -- 172.21.15.37:0/407831644 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f16ec042070 con 0x7f1700108330 2024-08-20T04:59:25.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.626+0000 7f16fe000640 1 --2- 172.21.15.37:0/407831644 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f16e80b3c70 0x7f16e80b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:25.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.626+0000 7f16fe000640 1 -- 172.21.15.37:0/407831644 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8770+0+0 (secure 0 0 0) 0x7f16ec1044c0 con 0x7f1700108330 2024-08-20T04:59:25.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.626+0000 7f1705600640 1 --2- 172.21.15.37:0/407831644 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f16e80b3c70 0x7f16e80b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:25.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.627+0000 7f1705600640 1 --2- 172.21.15.37:0/407831644 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f16e80b3c70 0x7f16e80b6130 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009bd0 tx=0x7f16f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:25.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.630+0000 7f16fe000640 1 -- 172.21.15.37:0/407831644 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f16ec0cb890 con 0x7f1700108330 2024-08-20T04:59:25.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.865+0000 7f1706a00640 1 -- 172.21.15.37:0/407831644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f17001a7ca0 con 0x7f1700108330 2024-08-20T04:59:25.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.906+0000 7f16fe000640 1 -- 172.21.15.37:0/407831644 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f16ec0cb190 con 0x7f1700108330 2024-08-20T04:59:25.908 INFO:teuthology.orchestra.run.smithi037.stderr:added data pool 4 to fsmap 2024-08-20T04:59:25.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.908+0000 7f1706a00640 1 -- 172.21.15.37:0/407831644 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f16e80b3c70 msgr2=0x7f16e80b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:25.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.908+0000 7f1706a00640 1 --2- 172.21.15.37:0/407831644 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f16e80b3c70 0x7f16e80b6130 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009bd0 tx=0x7f16f4005f90 comp rx=0 tx=0).stop 2024-08-20T04:59:25.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.908+0000 7f1706a00640 1 -- 172.21.15.37:0/407831644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1700108330 msgr2=0x7f1700075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:25.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.908+0000 7f1706a00640 1 --2- 172.21.15.37:0/407831644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1700108330 0x7f1700075710 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f16ec005ab0 tx=0x7f16ec003c10 comp rx=0 tx=0).stop 2024-08-20T04:59:25.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.908+0000 7f1706a00640 1 -- 172.21.15.37:0/407831644 shutdown_connections 2024-08-20T04:59:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.908+0000 7f1706a00640 1 --2- 172.21.15.37:0/407831644 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f16e80b3c70 0x7f16e80b6130 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.908+0000 7f1706a00640 1 --2- 172.21.15.37:0/407831644 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1700108cb0 0x7f1700075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.908+0000 7f1706a00640 1 --2- 172.21.15.37:0/407831644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1700108330 0x7f1700075710 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.908+0000 7f1706a00640 1 --2- 172.21.15.37:0/407831644 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1700102920 0x7f17000751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.908+0000 7f1706a00640 1 -- 172.21.15.37:0/407831644 >> 172.21.15.37:0/407831644 conn(0x7f17000fe350 msgr2=0x7f1700100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.908+0000 7f1706a00640 1 -- 172.21.15.37:0/407831644 shutdown_connections 2024-08-20T04:59:25.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:25.908+0000 7f1706a00640 1 -- 172.21.15.37:0/407831644 wait complete. 2024-08-20T04:59:26.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:25 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/407831644' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-08-20T04:59:26.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:25 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/407831644' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-08-20T04:59:26.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:25 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/407831644' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-08-20T04:59:26.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T04:59:27.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:26 smithi130 ceph-mon[22007]: osdmap e84: 12 total, 12 up, 12 in 2024-08-20T04:59:27.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:26 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/407831644' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-20T04:59:27.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:26 smithi130 ceph-mon[22007]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T04:59:27.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:26 smithi130 ceph-mon[22007]: pgmap v313: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:27.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:26 smithi037 ceph-mon[17265]: osdmap e84: 12 total, 12 up, 12 in 2024-08-20T04:59:27.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:26 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/407831644' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-20T04:59:27.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:26 smithi037 ceph-mon[17265]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T04:59:27.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:26 smithi037 ceph-mon[17265]: pgmap v313: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:27.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:26 smithi135 ceph-mon[22342]: osdmap e84: 12 total, 12 up, 12 in 2024-08-20T04:59:27.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:26 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/407831644' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-20T04:59:27.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:26 smithi135 ceph-mon[22342]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T04:59:27.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:26 smithi135 ceph-mon[22342]: pgmap v313: 129 pgs: 4 creating+peering, 125 active+clean; 579 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:27.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.809+0000 7ff5c6800640 1 -- 172.21.15.37:0/3169174556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5c0075b90 msgr2=0x7ff5c01132d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:27.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.809+0000 7ff5c6800640 1 --2- 172.21.15.37:0/3169174556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5c0075b90 0x7ff5c01132d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac009900 tx=0x7ff5ac02a410 comp rx=0 tx=0).stop 2024-08-20T04:59:27.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.809+0000 7ff5c6800640 1 -- 172.21.15.37:0/3169174556 shutdown_connections 2024-08-20T04:59:27.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.809+0000 7ff5c6800640 1 --2- 172.21.15.37:0/3169174556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5c0113810 0x7ff5c0115c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:27.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.809+0000 7ff5c6800640 1 --2- 172.21.15.37:0/3169174556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5c0075b90 0x7ff5c01132d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:27.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.809+0000 7ff5c6800640 1 --2- 172.21.15.37:0/3169174556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c0075270 0x7ff5c0075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:27.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.809+0000 7ff5c6800640 1 -- 172.21.15.37:0/3169174556 >> 172.21.15.37:0/3169174556 conn(0x7ff5c00fe500 msgr2=0x7ff5c0100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:27.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.809+0000 7ff5c6800640 1 -- 172.21.15.37:0/3169174556 shutdown_connections 2024-08-20T04:59:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.809+0000 7ff5c6800640 1 -- 172.21.15.37:0/3169174556 wait complete. 2024-08-20T04:59:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.810+0000 7ff5c6800640 1 Processor -- start 2024-08-20T04:59:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.810+0000 7ff5c6800640 1 -- start start 2024-08-20T04:59:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.811+0000 7ff5c6800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c0075270 0x7ff5c019f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.811+0000 7ff5c6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5c0075b90 0x7ff5c019fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.811+0000 7ff5c6800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5c0113810 0x7ff5c01a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.811+0000 7ff5c6800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c01190a0 con 0x7ff5c0075b90 2024-08-20T04:59:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.811+0000 7ff5c6800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c0118f20 con 0x7ff5c0113810 2024-08-20T04:59:27.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.811+0000 7ff5c6800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff5c0119220 con 0x7ff5c0075270 2024-08-20T04:59:27.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.811+0000 7ff5bea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5c0075b90 0x7ff5c019fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:27.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.811+0000 7ff5bea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5c0075b90 0x7ff5c019fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57214/0 (socket says 172.21.15.37:57214) 2024-08-20T04:59:27.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.811+0000 7ff5bea00640 1 -- 172.21.15.37:0/1933179519 learned_addr learned my addr 172.21.15.37:0/1933179519 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:27.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.811+0000 7ff5bf400640 1 --2- 172.21.15.37:0/1933179519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c0075270 0x7ff5c019f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:27.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.811+0000 7ff5bfe00640 1 --2- 172.21.15.37:0/1933179519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5c0113810 0x7ff5c01a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:27.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.812+0000 7ff5bea00640 1 -- 172.21.15.37:0/1933179519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c0075270 msgr2=0x7ff5c019f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:27.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.812+0000 7ff5bea00640 1 --2- 172.21.15.37:0/1933179519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c0075270 0x7ff5c019f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:27.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.812+0000 7ff5bea00640 1 -- 172.21.15.37:0/1933179519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5c0113810 msgr2=0x7ff5c01a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:27.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.812+0000 7ff5bea00640 1 --2- 172.21.15.37:0/1933179519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5c0113810 0x7ff5c01a4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:27.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.812+0000 7ff5bea00640 1 -- 172.21.15.37:0/1933179519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5c01a5700 con 0x7ff5c0075b90 2024-08-20T04:59:27.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.812+0000 7ff5bea00640 1 --2- 172.21.15.37:0/1933179519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5c0075b90 0x7ff5c019fb90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac005940 tx=0x7ff5ac004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:27.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.812+0000 7ff5b7e00640 1 -- 172.21.15.37:0/1933179519 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac03f030 con 0x7ff5c0075b90 2024-08-20T04:59:27.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.812+0000 7ff5b7e00640 1 -- 172.21.15.37:0/1933179519 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5ac003aa0 con 0x7ff5c0075b90 2024-08-20T04:59:27.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.812+0000 7ff5c6800640 1 -- 172.21.15.37:0/1933179519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5c01a5990 con 0x7ff5c0075b90 2024-08-20T04:59:27.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.812+0000 7ff5b7e00640 1 -- 172.21.15.37:0/1933179519 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac035070 con 0x7ff5c0075b90 2024-08-20T04:59:27.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.813+0000 7ff5c6800640 1 -- 172.21.15.37:0/1933179519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5c01ac0b0 con 0x7ff5c0075b90 2024-08-20T04:59:27.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.814+0000 7ff5c6800640 1 -- 172.21.15.37:0/1933179519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5c0075650 con 0x7ff5c0075b90 2024-08-20T04:59:27.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.816+0000 7ff5b7e00640 1 -- 172.21.15.37:0/1933179519 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7ff5ac042030 con 0x7ff5c0075b90 2024-08-20T04:59:27.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.818+0000 7ff5b7e00640 1 --2- 172.21.15.37:0/1933179519 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5a40b3c50 0x7ff5a40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:27.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.818+0000 7ff5b7e00640 1 -- 172.21.15.37:0/1933179519 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7ff5ac104440 con 0x7ff5c0075b90 2024-08-20T04:59:27.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.818+0000 7ff5bf400640 1 --2- 172.21.15.37:0/1933179519 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5a40b3c50 0x7ff5a40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:27.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.819+0000 7ff5bf400640 1 --2- 172.21.15.37:0/1933179519 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5a40b3c50 0x7ff5a40b6110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0009bd0 tx=0x7ff5b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:27.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:27.822+0000 7ff5b7e00640 1 -- 172.21.15.37:0/1933179519 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff5ac0cb1a0 con 0x7ff5c0075b90 2024-08-20T04:59:28.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:27 smithi037 ceph-mon[17265]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-20T04:59:28.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:27 smithi037 ceph-mon[17265]: Cluster is now healthy 2024-08-20T04:59:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:28.063+0000 7ff5c6800640 1 -- 172.21.15.37:0/1933179519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5c01ac2e0 con 0x7ff5c0075b90 2024-08-20T04:59:28.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:28.064+0000 7ff5b7e00640 1 -- 172.21.15.37:0/1933179519 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11845 (secure 0 0 0) 0x7ff5ac0cf6f0 con 0x7ff5c0075b90 2024-08-20T04:59:28.067 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:59:28.067 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"btime":"2024-08-20T04:59:25:900390+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24626,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24664,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T04:59:25.866880+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24695},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24695,"qdb_cluster":[24695]},"id":1}]} 2024-08-20T04:59:28.067 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2024-08-20T04:59:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:28.067+0000 7ff5c6800640 1 -- 172.21.15.37:0/1933179519 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5a40b3c50 msgr2=0x7ff5a40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:28.067+0000 7ff5c6800640 1 --2- 172.21.15.37:0/1933179519 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5a40b3c50 0x7ff5a40b6110 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff5b0009bd0 tx=0x7ff5b0005f90 comp rx=0 tx=0).stop 2024-08-20T04:59:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:28.067+0000 7ff5c6800640 1 -- 172.21.15.37:0/1933179519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5c0075b90 msgr2=0x7ff5c019fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:28.067+0000 7ff5c6800640 1 --2- 172.21.15.37:0/1933179519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5c0075b90 0x7ff5c019fb90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac005940 tx=0x7ff5ac004270 comp rx=0 tx=0).stop 2024-08-20T04:59:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:28.067+0000 7ff5c6800640 1 -- 172.21.15.37:0/1933179519 shutdown_connections 2024-08-20T04:59:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:28.067+0000 7ff5c6800640 1 --2- 172.21.15.37:0/1933179519 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5a40b3c50 0x7ff5a40b6110 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:28.067+0000 7ff5c6800640 1 --2- 172.21.15.37:0/1933179519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5c0113810 0x7ff5c01a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:28.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:28.067+0000 7ff5c6800640 1 --2- 172.21.15.37:0/1933179519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5c0075b90 0x7ff5c019fb90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:28.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:28.067+0000 7ff5c6800640 1 --2- 172.21.15.37:0/1933179519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5c0075270 0x7ff5c019f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:28.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:28.067+0000 7ff5c6800640 1 -- 172.21.15.37:0/1933179519 >> 172.21.15.37:0/1933179519 conn(0x7ff5c00fe500 msgr2=0x7ff5c00ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:28.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:28.067+0000 7ff5c6800640 1 -- 172.21.15.37:0/1933179519 shutdown_connections 2024-08-20T04:59:28.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:28.067+0000 7ff5c6800640 1 -- 172.21.15.37:0/1933179519 wait complete. 2024-08-20T04:59:28.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:27 smithi130 ceph-mon[22007]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-20T04:59:28.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:27 smithi130 ceph-mon[22007]: Cluster is now healthy 2024-08-20T04:59:28.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:27 smithi135 ceph-mon[22342]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-20T04:59:28.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:27 smithi135 ceph-mon[22342]: Cluster is now healthy 2024-08-20T04:59:28.974 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T04:59:29.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:28 smithi130 ceph-mon[22007]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:29.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:28 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1933179519' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:59:29.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:28 smithi037 ceph-mon[17265]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:29.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:28 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1933179519' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:59:29.353 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:29.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:28 smithi135 ceph-mon[22342]: pgmap v314: 129 pgs: 129 active+clean; 579 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:29.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:28 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1933179519' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:59:29.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.919+0000 7efd00600640 1 -- 172.21.15.37:0/778986924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcf810a6a0 msgr2=0x7efcf810aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:29.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.919+0000 7efd00600640 1 --2- 172.21.15.37:0/778986924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcf810a6a0 0x7efcf810aae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efce4009900 tx=0x7efce402a3f0 comp rx=0 tx=0).stop 2024-08-20T04:59:29.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.920+0000 7efd00600640 1 -- 172.21.15.37:0/778986924 shutdown_connections 2024-08-20T04:59:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.920+0000 7efd00600640 1 --2- 172.21.15.37:0/778986924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcf810b020 0x7efcf8111820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.920+0000 7efd00600640 1 --2- 172.21.15.37:0/778986924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcf810a6a0 0x7efcf810aae0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.920+0000 7efd00600640 1 --2- 172.21.15.37:0/778986924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcf8104c90 0x7efcf8105070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.920+0000 7efd00600640 1 -- 172.21.15.37:0/778986924 >> 172.21.15.37:0/778986924 conn(0x7efcf81006c0 msgr2=0x7efcf8102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.920+0000 7efd00600640 1 -- 172.21.15.37:0/778986924 shutdown_connections 2024-08-20T04:59:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.920+0000 7efd00600640 1 -- 172.21.15.37:0/778986924 wait complete. 2024-08-20T04:59:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.921+0000 7efd00600640 1 Processor -- start 2024-08-20T04:59:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.921+0000 7efd00600640 1 -- start start 2024-08-20T04:59:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.921+0000 7efd00600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcf8104c90 0x7efcf819b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.921+0000 7efd00600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcf810a6a0 0x7efcf819b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.921+0000 7efd00600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcf810b020 0x7efcf81a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.921+0000 7efd00600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8114cf0 con 0x7efcf8104c90 2024-08-20T04:59:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.921+0000 7efd00600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8114b70 con 0x7efcf810a6a0 2024-08-20T04:59:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.921+0000 7efd00600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8114e70 con 0x7efcf810b020 2024-08-20T04:59:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.921+0000 7efcfdc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcf8104c90 0x7efcf819b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.921+0000 7efcfd200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcf810a6a0 0x7efcf819b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.921+0000 7efcfdc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcf8104c90 0x7efcf819b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57226/0 (socket says 172.21.15.37:57226) 2024-08-20T04:59:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.921+0000 7efcfdc00640 1 -- 172.21.15.37:0/345972356 learned_addr learned my addr 172.21.15.37:0/345972356 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.921+0000 7efcfe600640 1 --2- 172.21.15.37:0/345972356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcf810b020 0x7efcf81a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.922+0000 7efcfd200640 1 -- 172.21.15.37:0/345972356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcf810b020 msgr2=0x7efcf81a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.922+0000 7efcfd200640 1 --2- 172.21.15.37:0/345972356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcf810b020 0x7efcf81a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.922+0000 7efcfd200640 1 -- 172.21.15.37:0/345972356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcf8104c90 msgr2=0x7efcf819b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.922+0000 7efcfd200640 1 --2- 172.21.15.37:0/345972356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcf8104c90 0x7efcf819b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.922+0000 7efcfd200640 1 -- 172.21.15.37:0/345972356 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf81a1230 con 0x7efcf810a6a0 2024-08-20T04:59:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.922+0000 7efcfdc00640 1 --2- 172.21.15.37:0/345972356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcf8104c90 0x7efcf819b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:59:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.922+0000 7efcfd200640 1 --2- 172.21.15.37:0/345972356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcf810a6a0 0x7efcf819b6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efce402a9e0 tx=0x7efce4003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.922+0000 7efcf6000640 1 -- 172.21.15.37:0/345972356 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce403f070 con 0x7efcf810a6a0 2024-08-20T04:59:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.922+0000 7efd00600640 1 -- 172.21.15.37:0/345972356 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf81a14c0 con 0x7efcf810a6a0 2024-08-20T04:59:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.922+0000 7efcf6000640 1 -- 172.21.15.37:0/345972356 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efce4031b50 con 0x7efcf810a6a0 2024-08-20T04:59:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.923+0000 7efcf6000640 1 -- 172.21.15.37:0/345972356 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce4035030 con 0x7efcf810a6a0 2024-08-20T04:59:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.923+0000 7efd00600640 1 -- 172.21.15.37:0/345972356 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf81a7be0 con 0x7efcf810a6a0 2024-08-20T04:59:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.924+0000 7efd00600640 1 -- 172.21.15.37:0/345972356 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcf8105070 con 0x7efcf810a6a0 2024-08-20T04:59:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.926+0000 7efcf6000640 1 -- 172.21.15.37:0/345972356 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7efce4042070 con 0x7efcf810a6a0 2024-08-20T04:59:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.928+0000 7efcf6000640 1 --2- 172.21.15.37:0/345972356 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efce00b3bd0 0x7efce00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:29.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.928+0000 7efcf6000640 1 -- 172.21.15.37:0/345972356 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7efce4104590 con 0x7efcf810a6a0 2024-08-20T04:59:29.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.928+0000 7efcfdc00640 1 --2- 172.21.15.37:0/345972356 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efce00b3bd0 0x7efce00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:29.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.929+0000 7efcfdc00640 1 --2- 172.21.15.37:0/345972356 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efce00b3bd0 0x7efce00b6090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efcec011550 tx=0x7efcec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:29.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:29.929+0000 7efcf6000640 1 -- 172.21.15.37:0/345972356 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7efce40cb940 con 0x7efcf810a6a0 2024-08-20T04:59:30.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:30.125+0000 7efd00600640 1 -- 172.21.15.37:0/345972356 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efcf810ce30 con 0x7efcf810a6a0 2024-08-20T04:59:30.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:30.127+0000 7efcf6000640 1 -- 172.21.15.37:0/345972356 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24236 (secure 0 0 0) 0x7efce4031d00 con 0x7efcf810a6a0 2024-08-20T04:59:30.129 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:59:30.129 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","created":"2024-08-20T04:50:26.520303+0000","modified":"2024-08-20T04:59:25.866747+0000","last_up_change":"2024-08-20T04:58:12.250259+0000","last_in_change":"2024-08-20T04:57:49.724189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T04:54:16.381529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T04:59:08.598741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T04:59:10.793802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-20T04:59:19.888446+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a813e53b-68b3-43ff-a59b-aed00e98f2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6803","nonce":3569936373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6805","nonce":3569936373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6809","nonce":3569936373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6807","nonce":3569936373}]},"public_addr":"172.21.15.37:6803/3569936373","cluster_addr":"172.21.15.37:6805/3569936373","heartbeat_back_addr":"172.21.15.37:6809/3569936373","heartbeat_front_addr":"172.21.15.37:6807/3569936373","state":["exists","up"]},{"osd":1,"uuid":"c216a8d0-9685-467a-8161-700682ce617c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6801","nonce":4206461125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6803","nonce":4206461125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6807","nonce":4206461125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6805","nonce":4206461125}]},"public_addr":"172.21.15.130:6801/4206461125","cluster_addr":"172.21.15.130:6803/4206461125","heartbeat_back_addr":"172.21.15.130:6807/4206461125","heartbeat_front_addr":"172.21.15.130:6805/4206461125","state":["exists","up"]},{"osd":2,"uuid":"34402442-c652-40eb-865e-a607a28846b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6801","nonce":2653255199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6803","nonce":2653255199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6807","nonce":2653255199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6805","nonce":2653255199}]},"public_addr":"172.21.15.135:6801/2653255199","cluster_addr":"172.21.15.135:6803/2653255199","heartbeat_back_addr":"172.21.15.135:6807/2653255199","heartbeat_front_addr":"172.21.15.135:6805/2653255199","state":["exists","up"]},{"osd":3,"uuid":"ec7be9dc-96b5-4816-9065-8121baedcdc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6811","nonce":2601290990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6813","nonce":2601290990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6817","nonce":2601290990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6815","nonce":2601290990}]},"public_addr":"172.21.15.37:6811/2601290990","cluster_addr":"172.21.15.37:6813/2601290990","heartbeat_back_addr":"172.21.15.37:6817/2601290990","heartbeat_front_addr":"172.21.15.37:6815/2601290990","state":["exists","up"]},{"osd":4,"uuid":"2dbd47f9-8686-4707-8862-3c7a99a37d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6809","nonce":3542081474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6811","nonce":3542081474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6815","nonce":3542081474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6813","nonce":3542081474}]},"public_addr":"172.21.15.130:6809/3542081474","cluster_addr":"172.21.15.130:6811/3542081474","heartbeat_back_addr":"172.21.15.130:6815/3542081474","heartbeat_front_addr":"172.21.15.130:6813/3542081474","state":["exists","up"]},{"osd":5,"uuid":"9a07a137-d6b7-4aba-8678-4fd164597f27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6809","nonce":2507249148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6811","nonce":2507249148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6815","nonce":2507249148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6813","nonce":2507249148}]},"public_addr":"172.21.15.135:6809/2507249148","cluster_addr":"172.21.15.135:6811/2507249148","heartbeat_back_addr":"172.21.15.135:6815/2507249148","heartbeat_front_addr":"172.21.15.135:6813/2507249148","state":["exists","up"]},{"osd":6,"uuid":"6d6346e8-5418-4c30-9bb3-5af352b616a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6819","nonce":155932692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6821","nonce":155932692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6825","nonce":155932692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6823","nonce":155932692}]},"public_addr":"172.21.15.37:6819/155932692","cluster_addr":"172.21.15.37:6821/155932692","heartbeat_back_addr":"172.21.15.37:6825/155932692","heartbeat_front_addr":"172.21.15.37:6823/155932692","state":["exists","up"]},{"osd":7,"uuid":"c87804c2-d456-495e-b36e-33dbb3548347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6817","nonce":4148130245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6819","nonce":4148130245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6823","nonce":4148130245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6821","nonce":4148130245}]},"public_addr":"172.21.15.130:6817/4148130245","cluster_addr":"172.21.15.130:6819/4148130245","heartbeat_back_addr":"172.21.15.130:6823/4148130245","heartbeat_front_addr":"172.21.15.130:6821/4148130245","state":["exists","up"]},{"osd":8,"uuid":"a7d4c9c8-1826-4703-92ad-ded2800b4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6817","nonce":222884649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6819","nonce":222884649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6823","nonce":222884649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6821","nonce":222884649}]},"public_addr":"172.21.15.135:6817/222884649","cluster_addr":"172.21.15.135:6819/222884649","heartbeat_back_addr":"172.21.15.135:6823/222884649","heartbeat_front_addr":"172.21.15.135:6821/222884649","state":["exists","up"]},{"osd":9,"uuid":"f9e0c194-66b5-4e62-b2ae-816a4a4fffbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6827","nonce":2240773042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6829","nonce":2240773042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6833","nonce":2240773042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6831","nonce":2240773042}]},"public_addr":"172.21.15.37:6827/2240773042","cluster_addr":"172.21.15.37:6829/2240773042","heartbeat_back_addr":"172.21.15.37:6833/2240773042","heartbeat_front_addr":"172.21.15.37:6831/2240773042","state":["exists","up"]},{"osd":10,"uuid":"fa6a50a5-2b97-42d1-9b57-b5502b7083d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6825","nonce":2896730163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6827","nonce":2896730163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6831","nonce":2896730163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6829","nonce":2896730163}]},"public_addr":"172.21.15.130:6825/2896730163","cluster_addr":"172.21.15.130:6827/2896730163","heartbeat_back_addr":"172.21.15.130:6831/2896730163","heartbeat_front_addr":"172.21.15.130:6829/2896730163","state":["exists","up"]},{"osd":11,"uuid":"9a305d75-030d-41db-abfb-81bb71e8c6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6825","nonce":2532897645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6827","nonce":2532897645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6831","nonce":2532897645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6829","nonce":2532897645}]},"public_addr":"172.21.15.135:6825/2532897645","cluster_addr":"172.21.15.135:6827/2532897645","heartbeat_back_addr":"172.21.15.135:6831/2532897645","heartbeat_front_addr":"172.21.15.135:6829/2532897645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:26.455665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:51.456030+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:14.332699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:42.749386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:07.587091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:32.450249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:01.864489+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:26.830527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:51.206257+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:20.400020+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:46.329864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:58:11.086508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4282140105":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/1217599998":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/3737412906":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/58912454":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/2105948300":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/1480362562":"2024-08-21T04:50:59.520912+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T04:59:30.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:30.130+0000 7efd00600640 1 -- 172.21.15.37:0/345972356 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efce00b3bd0 msgr2=0x7efce00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:30.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:30.130+0000 7efd00600640 1 --2- 172.21.15.37:0/345972356 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efce00b3bd0 0x7efce00b6090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efcec011550 tx=0x7efcec005f90 comp rx=0 tx=0).stop 2024-08-20T04:59:30.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:30.130+0000 7efd00600640 1 -- 172.21.15.37:0/345972356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcf810a6a0 msgr2=0x7efcf819b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:30.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:30.130+0000 7efd00600640 1 --2- 172.21.15.37:0/345972356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcf810a6a0 0x7efcf819b6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efce402a9e0 tx=0x7efce4003b90 comp rx=0 tx=0).stop 2024-08-20T04:59:30.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:30.130+0000 7efd00600640 1 -- 172.21.15.37:0/345972356 shutdown_connections 2024-08-20T04:59:30.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:30.130+0000 7efd00600640 1 --2- 172.21.15.37:0/345972356 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efce00b3bd0 0x7efce00b6090 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:30.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:30.130+0000 7efd00600640 1 --2- 172.21.15.37:0/345972356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efcf810b020 0x7efcf81a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:30.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:30.130+0000 7efd00600640 1 --2- 172.21.15.37:0/345972356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efcf810a6a0 0x7efcf819b6c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:30.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:30.130+0000 7efd00600640 1 --2- 172.21.15.37:0/345972356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcf8104c90 0x7efcf819b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:30.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:30.130+0000 7efd00600640 1 -- 172.21.15.37:0/345972356 >> 172.21.15.37:0/345972356 conn(0x7efcf81006c0 msgr2=0x7efcf8102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:30.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:30.130+0000 7efd00600640 1 -- 172.21.15.37:0/345972356 shutdown_connections 2024-08-20T04:59:30.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:30.130+0000 7efd00600640 1 -- 172.21.15.37:0/345972356 wait complete. 2024-08-20T04:59:31.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T04:59:31.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:31 smithi037 ceph-mon[17265]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:31.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:31 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/345972356' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:59:31.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:31 smithi135 ceph-mon[22342]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:31.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:31 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/345972356' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:59:31.416 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:31.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:31 smithi130 ceph-mon[22007]: pgmap v315: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:31.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:31 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/345972356' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:59:31.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.943+0000 7ff57f200640 1 -- 172.21.15.37:0/3762672878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff58010cc70 msgr2=0x7ff58010f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:31.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.943+0000 7ff57f200640 1 --2- 172.21.15.37:0/3762672878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff58010cc70 0x7ff58010f0d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff578009ca0 tx=0x7ff57802a8c0 comp rx=0 tx=0).stop 2024-08-20T04:59:31.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.943+0000 7ff57f200640 1 -- 172.21.15.37:0/3762672878 shutdown_connections 2024-08-20T04:59:31.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.943+0000 7ff57f200640 1 --2- 172.21.15.37:0/3762672878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff58010cc70 0x7ff58010f0d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:31.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.943+0000 7ff57f200640 1 --2- 172.21.15.37:0/3762672878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff580104130 0x7ff58010c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:31.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.943+0000 7ff57f200640 1 --2- 172.21.15.37:0/3762672878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff580103810 0x7ff580103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:31.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.943+0000 7ff57f200640 1 -- 172.21.15.37:0/3762672878 >> 172.21.15.37:0/3762672878 conn(0x7ff5800fd2d0 msgr2=0x7ff5800ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:31.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.943+0000 7ff57f200640 1 -- 172.21.15.37:0/3762672878 shutdown_connections 2024-08-20T04:59:31.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.943+0000 7ff57f200640 1 -- 172.21.15.37:0/3762672878 wait complete. 2024-08-20T04:59:31.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.944+0000 7ff57f200640 1 Processor -- start 2024-08-20T04:59:31.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.945+0000 7ff57f200640 1 -- start start 2024-08-20T04:59:31.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.945+0000 7ff57f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff580103810 0x7ff580198cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:31.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.945+0000 7ff57f200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff580104130 0x7ff5801991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:31.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.945+0000 7ff57f200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff58010cc70 0x7ff58019e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:31.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.945+0000 7ff57f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff580112930 con 0x7ff580103810 2024-08-20T04:59:31.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.945+0000 7ff57f200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff5801127b0 con 0x7ff580104130 2024-08-20T04:59:31.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.945+0000 7ff57f200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff580112ab0 con 0x7ff58010cc70 2024-08-20T04:59:31.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.945+0000 7ff57de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff580103810 0x7ff580198cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:31.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.946+0000 7ff57de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff580103810 0x7ff580198cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57252/0 (socket says 172.21.15.37:57252) 2024-08-20T04:59:31.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.946+0000 7ff57de00640 1 -- 172.21.15.37:0/442419849 learned_addr learned my addr 172.21.15.37:0/442419849 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:31.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.946+0000 7ff575400640 1 --2- 172.21.15.37:0/442419849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff580104130 0x7ff5801991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:31.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.946+0000 7ff57e800640 1 --2- 172.21.15.37:0/442419849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff58010cc70 0x7ff58019e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:31.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.946+0000 7ff57de00640 1 -- 172.21.15.37:0/442419849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff58010cc70 msgr2=0x7ff58019e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:31.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.946+0000 7ff57de00640 1 --2- 172.21.15.37:0/442419849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff58010cc70 0x7ff58019e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.946+0000 7ff57de00640 1 -- 172.21.15.37:0/442419849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff580104130 msgr2=0x7ff5801991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.946+0000 7ff57de00640 1 --2- 172.21.15.37:0/442419849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff580104130 0x7ff5801991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.946+0000 7ff57de00640 1 -- 172.21.15.37:0/442419849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58019ed60 con 0x7ff580103810 2024-08-20T04:59:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.946+0000 7ff57e800640 1 --2- 172.21.15.37:0/442419849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff58010cc70 0x7ff58019e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T04:59:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.946+0000 7ff57de00640 1 --2- 172.21.15.37:0/442419849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff580103810 0x7ff580198cb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff57000d950 tx=0x7ff57000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.947+0000 7ff577400640 1 -- 172.21.15.37:0/442419849 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff570017030 con 0x7ff580103810 2024-08-20T04:59:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.947+0000 7ff577400640 1 -- 172.21.15.37:0/442419849 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff570004020 con 0x7ff580103810 2024-08-20T04:59:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.947+0000 7ff57f200640 1 -- 172.21.15.37:0/442419849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff58019f050 con 0x7ff580103810 2024-08-20T04:59:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.947+0000 7ff577400640 1 -- 172.21.15.37:0/442419849 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5700047a0 con 0x7ff580103810 2024-08-20T04:59:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.947+0000 7ff57f200640 1 -- 172.21.15.37:0/442419849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5801a58e0 con 0x7ff580103810 2024-08-20T04:59:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.948+0000 7ff57f200640 1 -- 172.21.15.37:0/442419849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff580103bf0 con 0x7ff580103810 2024-08-20T04:59:31.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.950+0000 7ff577400640 1 -- 172.21.15.37:0/442419849 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7ff570009a30 con 0x7ff580103810 2024-08-20T04:59:31.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.951+0000 7ff577400640 1 --2- 172.21.15.37:0/442419849 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5640b3cf0 0x7ff5640b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:31.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.952+0000 7ff577400640 1 -- 172.21.15.37:0/442419849 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7ff5700e3f80 con 0x7ff580103810 2024-08-20T04:59:31.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.952+0000 7ff575400640 1 --2- 172.21.15.37:0/442419849 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5640b3cf0 0x7ff5640b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:31.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.953+0000 7ff575400640 1 --2- 172.21.15.37:0/442419849 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5640b3cf0 0x7ff5640b61b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff5800ffbe0 tx=0x7ff56800b360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:31.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:31.953+0000 7ff577400640 1 -- 172.21.15.37:0/442419849 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff5700ab3b0 con 0x7ff580103810 2024-08-20T04:59:32.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:32.151+0000 7ff57f200640 1 -- 172.21.15.37:0/442419849 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5801a5c10 con 0x7ff580103810 2024-08-20T04:59:32.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:32.152+0000 7ff577400640 1 -- 172.21.15.37:0/442419849 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24236 (secure 0 0 0) 0x7ff5700aacb0 con 0x7ff580103810 2024-08-20T04:59:32.155 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:59:32.156 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","created":"2024-08-20T04:50:26.520303+0000","modified":"2024-08-20T04:59:25.866747+0000","last_up_change":"2024-08-20T04:58:12.250259+0000","last_in_change":"2024-08-20T04:57:49.724189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T04:54:16.381529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T04:59:08.598741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T04:59:10.793802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-20T04:59:19.888446+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a813e53b-68b3-43ff-a59b-aed00e98f2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6803","nonce":3569936373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6805","nonce":3569936373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6809","nonce":3569936373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6807","nonce":3569936373}]},"public_addr":"172.21.15.37:6803/3569936373","cluster_addr":"172.21.15.37:6805/3569936373","heartbeat_back_addr":"172.21.15.37:6809/3569936373","heartbeat_front_addr":"172.21.15.37:6807/3569936373","state":["exists","up"]},{"osd":1,"uuid":"c216a8d0-9685-467a-8161-700682ce617c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6801","nonce":4206461125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6803","nonce":4206461125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6807","nonce":4206461125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6805","nonce":4206461125}]},"public_addr":"172.21.15.130:6801/4206461125","cluster_addr":"172.21.15.130:6803/4206461125","heartbeat_back_addr":"172.21.15.130:6807/4206461125","heartbeat_front_addr":"172.21.15.130:6805/4206461125","state":["exists","up"]},{"osd":2,"uuid":"34402442-c652-40eb-865e-a607a28846b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6801","nonce":2653255199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6803","nonce":2653255199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6807","nonce":2653255199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6805","nonce":2653255199}]},"public_addr":"172.21.15.135:6801/2653255199","cluster_addr":"172.21.15.135:6803/2653255199","heartbeat_back_addr":"172.21.15.135:6807/2653255199","heartbeat_front_addr":"172.21.15.135:6805/2653255199","state":["exists","up"]},{"osd":3,"uuid":"ec7be9dc-96b5-4816-9065-8121baedcdc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6811","nonce":2601290990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6813","nonce":2601290990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6817","nonce":2601290990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6815","nonce":2601290990}]},"public_addr":"172.21.15.37:6811/2601290990","cluster_addr":"172.21.15.37:6813/2601290990","heartbeat_back_addr":"172.21.15.37:6817/2601290990","heartbeat_front_addr":"172.21.15.37:6815/2601290990","state":["exists","up"]},{"osd":4,"uuid":"2dbd47f9-8686-4707-8862-3c7a99a37d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6809","nonce":3542081474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6811","nonce":3542081474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6815","nonce":3542081474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6813","nonce":3542081474}]},"public_addr":"172.21.15.130:6809/3542081474","cluster_addr":"172.21.15.130:6811/3542081474","heartbeat_back_addr":"172.21.15.130:6815/3542081474","heartbeat_front_addr":"172.21.15.130:6813/3542081474","state":["exists","up"]},{"osd":5,"uuid":"9a07a137-d6b7-4aba-8678-4fd164597f27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6809","nonce":2507249148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6811","nonce":2507249148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6815","nonce":2507249148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6813","nonce":2507249148}]},"public_addr":"172.21.15.135:6809/2507249148","cluster_addr":"172.21.15.135:6811/2507249148","heartbeat_back_addr":"172.21.15.135:6815/2507249148","heartbeat_front_addr":"172.21.15.135:6813/2507249148","state":["exists","up"]},{"osd":6,"uuid":"6d6346e8-5418-4c30-9bb3-5af352b616a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6819","nonce":155932692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6821","nonce":155932692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6825","nonce":155932692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6823","nonce":155932692}]},"public_addr":"172.21.15.37:6819/155932692","cluster_addr":"172.21.15.37:6821/155932692","heartbeat_back_addr":"172.21.15.37:6825/155932692","heartbeat_front_addr":"172.21.15.37:6823/155932692","state":["exists","up"]},{"osd":7,"uuid":"c87804c2-d456-495e-b36e-33dbb3548347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6817","nonce":4148130245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6819","nonce":4148130245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6823","nonce":4148130245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6821","nonce":4148130245}]},"public_addr":"172.21.15.130:6817/4148130245","cluster_addr":"172.21.15.130:6819/4148130245","heartbeat_back_addr":"172.21.15.130:6823/4148130245","heartbeat_front_addr":"172.21.15.130:6821/4148130245","state":["exists","up"]},{"osd":8,"uuid":"a7d4c9c8-1826-4703-92ad-ded2800b4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6817","nonce":222884649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6819","nonce":222884649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6823","nonce":222884649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6821","nonce":222884649}]},"public_addr":"172.21.15.135:6817/222884649","cluster_addr":"172.21.15.135:6819/222884649","heartbeat_back_addr":"172.21.15.135:6823/222884649","heartbeat_front_addr":"172.21.15.135:6821/222884649","state":["exists","up"]},{"osd":9,"uuid":"f9e0c194-66b5-4e62-b2ae-816a4a4fffbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6827","nonce":2240773042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6829","nonce":2240773042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6833","nonce":2240773042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6831","nonce":2240773042}]},"public_addr":"172.21.15.37:6827/2240773042","cluster_addr":"172.21.15.37:6829/2240773042","heartbeat_back_addr":"172.21.15.37:6833/2240773042","heartbeat_front_addr":"172.21.15.37:6831/2240773042","state":["exists","up"]},{"osd":10,"uuid":"fa6a50a5-2b97-42d1-9b57-b5502b7083d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6825","nonce":2896730163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6827","nonce":2896730163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6831","nonce":2896730163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6829","nonce":2896730163}]},"public_addr":"172.21.15.130:6825/2896730163","cluster_addr":"172.21.15.130:6827/2896730163","heartbeat_back_addr":"172.21.15.130:6831/2896730163","heartbeat_front_addr":"172.21.15.130:6829/2896730163","state":["exists","up"]},{"osd":11,"uuid":"9a305d75-030d-41db-abfb-81bb71e8c6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6825","nonce":2532897645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6827","nonce":2532897645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6831","nonce":2532897645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6829","nonce":2532897645}]},"public_addr":"172.21.15.135:6825/2532897645","cluster_addr":"172.21.15.135:6827/2532897645","heartbeat_back_addr":"172.21.15.135:6831/2532897645","heartbeat_front_addr":"172.21.15.135:6829/2532897645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:26.455665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:51.456030+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:14.332699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:42.749386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:07.587091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:32.450249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:01.864489+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:26.830527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:51.206257+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:20.400020+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:46.329864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:58:11.086508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4282140105":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/1217599998":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/3737412906":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/58912454":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/2105948300":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/1480362562":"2024-08-21T04:50:59.520912+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T04:59:32.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:32.155+0000 7ff57f200640 1 -- 172.21.15.37:0/442419849 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5640b3cf0 msgr2=0x7ff5640b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:32.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:32.155+0000 7ff57f200640 1 --2- 172.21.15.37:0/442419849 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5640b3cf0 0x7ff5640b61b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff5800ffbe0 tx=0x7ff56800b360 comp rx=0 tx=0).stop 2024-08-20T04:59:32.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:32.155+0000 7ff57f200640 1 -- 172.21.15.37:0/442419849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff580103810 msgr2=0x7ff580198cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:32.155+0000 7ff57f200640 1 --2- 172.21.15.37:0/442419849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff580103810 0x7ff580198cb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff57000d950 tx=0x7ff57000de10 comp rx=0 tx=0).stop 2024-08-20T04:59:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:32.155+0000 7ff57f200640 1 -- 172.21.15.37:0/442419849 shutdown_connections 2024-08-20T04:59:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:32.155+0000 7ff57f200640 1 --2- 172.21.15.37:0/442419849 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5640b3cf0 0x7ff5640b61b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:32.155+0000 7ff57f200640 1 --2- 172.21.15.37:0/442419849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff58010cc70 0x7ff58019e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:32.155+0000 7ff57f200640 1 --2- 172.21.15.37:0/442419849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff580104130 0x7ff5801991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:32.155+0000 7ff57f200640 1 --2- 172.21.15.37:0/442419849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff580103810 0x7ff580198cb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:32.155+0000 7ff57f200640 1 -- 172.21.15.37:0/442419849 >> 172.21.15.37:0/442419849 conn(0x7ff5800fd2d0 msgr2=0x7ff58010eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:32.155+0000 7ff57f200640 1 -- 172.21.15.37:0/442419849 shutdown_connections 2024-08-20T04:59:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:32.155+0000 7ff57f200640 1 -- 172.21.15.37:0/442419849 wait complete. 2024-08-20T04:59:33.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T04:59:33.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:33 smithi037 ceph-mon[17265]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:33.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:33 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/442419849' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:59:33.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:33 smithi135 ceph-mon[22342]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:33.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:33 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/442419849' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:59:33.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:33 smithi130 ceph-mon[22007]: pgmap v316: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:33.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:33 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/442419849' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:59:33.462 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:34.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.019+0000 7f7236e00640 1 -- 172.21.15.37:0/1319637847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f723010f0d0 msgr2=0x7f72301114c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.019+0000 7f7236e00640 1 --2- 172.21.15.37:0/1319637847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f723010f0d0 0x7f72301114c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7228009ca0 tx=0x7f722802a8c0 comp rx=0 tx=0).stop 2024-08-20T04:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.019+0000 7f7236e00640 1 -- 172.21.15.37:0/1319637847 shutdown_connections 2024-08-20T04:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.019+0000 7f7236e00640 1 --2- 172.21.15.37:0/1319637847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f723010f0d0 0x7f72301114c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.019+0000 7f7236e00640 1 --2- 172.21.15.37:0/1319637847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7230075c70 0x7f723010eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.019+0000 7f7236e00640 1 --2- 172.21.15.37:0/1319637847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7230075270 0x7f7230075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.019+0000 7f7236e00640 1 -- 172.21.15.37:0/1319637847 >> 172.21.15.37:0/1319637847 conn(0x7f72300fe500 msgr2=0x7f7230100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.019+0000 7f7236e00640 1 -- 172.21.15.37:0/1319637847 shutdown_connections 2024-08-20T04:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.019+0000 7f7236e00640 1 -- 172.21.15.37:0/1319637847 wait complete. 2024-08-20T04:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.020+0000 7f7236e00640 1 Processor -- start 2024-08-20T04:59:34.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.020+0000 7f7236e00640 1 -- start start 2024-08-20T04:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.020+0000 7f7236e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7230075270 0x7f723019b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.020+0000 7f7236e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7230075c70 0x7f723019b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.020+0000 7f7236e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f723010f0d0 0x7f72301a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.020+0000 7f7236e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7230114cd0 con 0x7f7230075270 2024-08-20T04:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.020+0000 7f7236e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7230114b50 con 0x7f723010f0d0 2024-08-20T04:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.020+0000 7f7236e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7230114e50 con 0x7f7230075c70 2024-08-20T04:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.021+0000 7f722fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7230075270 0x7f723019b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.021+0000 7f722fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7230075270 0x7f723019b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44250/0 (socket says 172.21.15.37:44250) 2024-08-20T04:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.021+0000 7f722fe00640 1 -- 172.21.15.37:0/2210969774 learned_addr learned my addr 172.21.15.37:0/2210969774 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.021+0000 7f7227400640 1 --2- 172.21.15.37:0/2210969774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7230075c70 0x7f723019b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.021+0000 7f7234e00640 1 --2- 172.21.15.37:0/2210969774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f723010f0d0 0x7f72301a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:34.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.021+0000 7f722fe00640 1 -- 172.21.15.37:0/2210969774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7230075c70 msgr2=0x7f723019b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.021+0000 7f722fe00640 1 --2- 172.21.15.37:0/2210969774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7230075c70 0x7f723019b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.021+0000 7f722fe00640 1 -- 172.21.15.37:0/2210969774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f723010f0d0 msgr2=0x7f72301a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.021+0000 7f722fe00640 1 --2- 172.21.15.37:0/2210969774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f723010f0d0 0x7f72301a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.021+0000 7f722fe00640 1 -- 172.21.15.37:0/2210969774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72301a1230 con 0x7f7230075270 2024-08-20T04:59:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.021+0000 7f722fe00640 1 --2- 172.21.15.37:0/2210969774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7230075270 0x7f723019b180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f722000e9f0 tx=0x7f722000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.022+0000 7f722d600640 1 -- 172.21.15.37:0/2210969774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722000cd80 con 0x7f7230075270 2024-08-20T04:59:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.022+0000 7f722d600640 1 -- 172.21.15.37:0/2210969774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72200054d0 con 0x7f7230075270 2024-08-20T04:59:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.022+0000 7f722d600640 1 -- 172.21.15.37:0/2210969774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7220010690 con 0x7f7230075270 2024-08-20T04:59:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.022+0000 7f7236e00640 1 -- 172.21.15.37:0/2210969774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72301a1520 con 0x7f7230075270 2024-08-20T04:59:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.022+0000 7f7236e00640 1 -- 172.21.15.37:0/2210969774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72301a7be0 con 0x7f7230075270 2024-08-20T04:59:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.023+0000 7f7236e00640 1 -- 172.21.15.37:0/2210969774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7230075650 con 0x7f7230075270 2024-08-20T04:59:34.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.025+0000 7f722d600640 1 -- 172.21.15.37:0/2210969774 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f7220004e30 con 0x7f7230075270 2024-08-20T04:59:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.027+0000 7f722d600640 1 --2- 172.21.15.37:0/2210969774 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72140b3c50 0x7f72140b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.027+0000 7f722d600640 1 -- 172.21.15.37:0/2210969774 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f72200e4420 con 0x7f7230075270 2024-08-20T04:59:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.027+0000 7f7227400640 1 --2- 172.21.15.37:0/2210969774 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72140b3c50 0x7f72140b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.028+0000 7f7227400640 1 --2- 172.21.15.37:0/2210969774 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72140b3c50 0x7f72140b6110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7230100d10 tx=0x7f721800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:34.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.028+0000 7f722d600640 1 -- 172.21.15.37:0/2210969774 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f7220055e20 con 0x7f7230075270 2024-08-20T04:59:34.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.264+0000 7f7236e00640 1 -- 172.21.15.37:0/2210969774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72301a7fd0 con 0x7f7230075270 2024-08-20T04:59:34.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.265+0000 7f722d600640 1 -- 172.21.15.37:0/2210969774 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11845 (secure 0 0 0) 0x7f72200ab7d0 con 0x7f7230075270 2024-08-20T04:59:34.267 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:59:34.267 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"btime":"2024-08-20T04:59:25:900390+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14652,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14664,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24592,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24626,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24637,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24656,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24664,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T04:59:25.866880+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24695},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24695,"qdb_cluster":[24695]},"id":1}]} 2024-08-20T04:59:34.268 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2024-08-20T04:59:34.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.268+0000 7f7236e00640 1 -- 172.21.15.37:0/2210969774 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72140b3c50 msgr2=0x7f72140b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:34.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.268+0000 7f7236e00640 1 --2- 172.21.15.37:0/2210969774 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72140b3c50 0x7f72140b6110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7230100d10 tx=0x7f721800b410 comp rx=0 tx=0).stop 2024-08-20T04:59:34.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.268+0000 7f7236e00640 1 -- 172.21.15.37:0/2210969774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7230075270 msgr2=0x7f723019b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:34.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.268+0000 7f7236e00640 1 --2- 172.21.15.37:0/2210969774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7230075270 0x7f723019b180 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f722000e9f0 tx=0x7f722000edf0 comp rx=0 tx=0).stop 2024-08-20T04:59:34.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.268+0000 7f7236e00640 1 -- 172.21.15.37:0/2210969774 shutdown_connections 2024-08-20T04:59:34.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.268+0000 7f7236e00640 1 --2- 172.21.15.37:0/2210969774 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72140b3c50 0x7f72140b6110 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:34.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.268+0000 7f7236e00640 1 --2- 172.21.15.37:0/2210969774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f723010f0d0 0x7f72301a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:34.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.268+0000 7f7236e00640 1 --2- 172.21.15.37:0/2210969774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7230075c70 0x7f723019b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:34.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.268+0000 7f7236e00640 1 --2- 172.21.15.37:0/2210969774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7230075270 0x7f723019b180 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:34.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.268+0000 7f7236e00640 1 -- 172.21.15.37:0/2210969774 >> 172.21.15.37:0/2210969774 conn(0x7f72300fe500 msgr2=0x7f7230111260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:34.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.268+0000 7f7236e00640 1 -- 172.21.15.37:0/2210969774 shutdown_connections 2024-08-20T04:59:34.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:34.268+0000 7f7236e00640 1 -- 172.21.15.37:0/2210969774 wait complete. 2024-08-20T04:59:35.124 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T04:59:35.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:35 smithi135 ceph-mon[22342]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:35.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:35 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2210969774' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:59:35.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:35 smithi130 ceph-mon[22007]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:35.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:35 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2210969774' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:59:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:35.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:35 smithi037 ceph-mon[17265]: pgmap v317: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:35.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:35 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2210969774' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T04:59:36.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.099+0000 7f647a200640 1 -- 172.21.15.37:0/595314863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6474102ab0 msgr2=0x7f6474102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:36.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.099+0000 7f647a200640 1 --2- 172.21.15.37:0/595314863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6474102ab0 0x7f6474102e90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6464009900 tx=0x7f646402a410 comp rx=0 tx=0).stop 2024-08-20T04:59:36.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.099+0000 7f647a200640 1 -- 172.21.15.37:0/595314863 shutdown_connections 2024-08-20T04:59:36.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.099+0000 7f647a200640 1 --2- 172.21.15.37:0/595314863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6474108e40 0x7f647410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.099+0000 7f647a200640 1 --2- 172.21.15.37:0/595314863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64741084c0 0x7f6474108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.099+0000 7f647a200640 1 --2- 172.21.15.37:0/595314863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6474102ab0 0x7f6474102e90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.099+0000 7f647a200640 1 -- 172.21.15.37:0/595314863 >> 172.21.15.37:0/595314863 conn(0x7f64740fe500 msgr2=0x7f6474100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.099+0000 7f647a200640 1 -- 172.21.15.37:0/595314863 shutdown_connections 2024-08-20T04:59:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.099+0000 7f647a200640 1 -- 172.21.15.37:0/595314863 wait complete. 2024-08-20T04:59:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.100+0000 7f647a200640 1 Processor -- start 2024-08-20T04:59:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.100+0000 7f647a200640 1 -- start start 2024-08-20T04:59:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.101+0000 7f647a200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6474102ab0 0x7f6474198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.101+0000 7f647a200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64741084c0 0x7f64741994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.101+0000 7f647a200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6474108e40 0x7f647419e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.101+0000 7f647a200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6474112b00 con 0x7f6474102ab0 2024-08-20T04:59:36.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.101+0000 7f647a200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6474112980 con 0x7f6474108e40 2024-08-20T04:59:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.101+0000 7f647a200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6474112c80 con 0x7f64741084c0 2024-08-20T04:59:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.101+0000 7f6473400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6474102ab0 0x7f6474198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.101+0000 7f6473400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6474102ab0 0x7f6474198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44254/0 (socket says 172.21.15.37:44254) 2024-08-20T04:59:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.101+0000 7f6473400640 1 -- 172.21.15.37:0/2810097994 learned_addr learned my addr 172.21.15.37:0/2810097994 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.101+0000 7f6472a00640 1 --2- 172.21.15.37:0/2810097994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64741084c0 0x7f64741994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.101+0000 7f6473e00640 1 --2- 172.21.15.37:0/2810097994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6474108e40 0x7f647419e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.102+0000 7f6473400640 1 -- 172.21.15.37:0/2810097994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64741084c0 msgr2=0x7f64741994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.102+0000 7f6473400640 1 --2- 172.21.15.37:0/2810097994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64741084c0 0x7f64741994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.102+0000 7f6473400640 1 -- 172.21.15.37:0/2810097994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6474108e40 msgr2=0x7f647419e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.102+0000 7f6473400640 1 --2- 172.21.15.37:0/2810097994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6474108e40 0x7f647419e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.102+0000 7f6473400640 1 -- 172.21.15.37:0/2810097994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647419f050 con 0x7f6474102ab0 2024-08-20T04:59:36.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.102+0000 7f6473400640 1 --2- 172.21.15.37:0/2810097994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6474102ab0 0x7f6474198fa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6464005940 tx=0x7f64640040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:36.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.102+0000 7f646be00640 1 -- 172.21.15.37:0/2810097994 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f646403f030 con 0x7f6474102ab0 2024-08-20T04:59:36.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.102+0000 7f646be00640 1 -- 172.21.15.37:0/2810097994 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64640044c0 con 0x7f6474102ab0 2024-08-20T04:59:36.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.102+0000 7f647a200640 1 -- 172.21.15.37:0/2810097994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647419f2e0 con 0x7f6474102ab0 2024-08-20T04:59:36.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.102+0000 7f646be00640 1 -- 172.21.15.37:0/2810097994 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6464035070 con 0x7f6474102ab0 2024-08-20T04:59:36.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.102+0000 7f647a200640 1 -- 172.21.15.37:0/2810097994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64741a5a00 con 0x7f6474102ab0 2024-08-20T04:59:36.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.104+0000 7f647a200640 1 -- 172.21.15.37:0/2810097994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6474102e90 con 0x7f6474102ab0 2024-08-20T04:59:36.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.106+0000 7f646be00640 1 -- 172.21.15.37:0/2810097994 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f6464042030 con 0x7f6474102ab0 2024-08-20T04:59:36.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.108+0000 7f646be00640 1 --2- 172.21.15.37:0/2810097994 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f64580b3c50 0x7f64580b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:36.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.108+0000 7f646be00640 1 -- 172.21.15.37:0/2810097994 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f6464104130 con 0x7f6474102ab0 2024-08-20T04:59:36.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.109+0000 7f6472a00640 1 --2- 172.21.15.37:0/2810097994 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f64580b3c50 0x7f64580b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:36.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.109+0000 7f6472a00640 1 --2- 172.21.15.37:0/2810097994 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f64580b3c50 0x7f64580b6110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6474108060 tx=0x7f6460005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:36.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.112+0000 7f646be00640 1 -- 172.21.15.37:0/2810097994 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f64640cae90 con 0x7f6474102ab0 2024-08-20T04:59:36.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.309+0000 7f647a200640 1 -- 172.21.15.37:0/2810097994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f647410ac20 con 0x7f6474102ab0 2024-08-20T04:59:36.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.311+0000 7f646be00640 1 -- 172.21.15.37:0/2810097994 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24236 (secure 0 0 0) 0x7f64640cf3e0 con 0x7f6474102ab0 2024-08-20T04:59:36.313 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:59:36.313 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","created":"2024-08-20T04:50:26.520303+0000","modified":"2024-08-20T04:59:25.866747+0000","last_up_change":"2024-08-20T04:58:12.250259+0000","last_in_change":"2024-08-20T04:57:49.724189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T04:54:16.381529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T04:59:08.598741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T04:59:10.793802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-20T04:59:19.888446+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a813e53b-68b3-43ff-a59b-aed00e98f2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6803","nonce":3569936373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6805","nonce":3569936373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6809","nonce":3569936373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6807","nonce":3569936373}]},"public_addr":"172.21.15.37:6803/3569936373","cluster_addr":"172.21.15.37:6805/3569936373","heartbeat_back_addr":"172.21.15.37:6809/3569936373","heartbeat_front_addr":"172.21.15.37:6807/3569936373","state":["exists","up"]},{"osd":1,"uuid":"c216a8d0-9685-467a-8161-700682ce617c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6801","nonce":4206461125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6803","nonce":4206461125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6807","nonce":4206461125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6805","nonce":4206461125}]},"public_addr":"172.21.15.130:6801/4206461125","cluster_addr":"172.21.15.130:6803/4206461125","heartbeat_back_addr":"172.21.15.130:6807/4206461125","heartbeat_front_addr":"172.21.15.130:6805/4206461125","state":["exists","up"]},{"osd":2,"uuid":"34402442-c652-40eb-865e-a607a28846b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6801","nonce":2653255199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6803","nonce":2653255199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6807","nonce":2653255199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6805","nonce":2653255199}]},"public_addr":"172.21.15.135:6801/2653255199","cluster_addr":"172.21.15.135:6803/2653255199","heartbeat_back_addr":"172.21.15.135:6807/2653255199","heartbeat_front_addr":"172.21.15.135:6805/2653255199","state":["exists","up"]},{"osd":3,"uuid":"ec7be9dc-96b5-4816-9065-8121baedcdc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6811","nonce":2601290990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6813","nonce":2601290990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6817","nonce":2601290990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6815","nonce":2601290990}]},"public_addr":"172.21.15.37:6811/2601290990","cluster_addr":"172.21.15.37:6813/2601290990","heartbeat_back_addr":"172.21.15.37:6817/2601290990","heartbeat_front_addr":"172.21.15.37:6815/2601290990","state":["exists","up"]},{"osd":4,"uuid":"2dbd47f9-8686-4707-8862-3c7a99a37d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6809","nonce":3542081474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6811","nonce":3542081474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6815","nonce":3542081474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6813","nonce":3542081474}]},"public_addr":"172.21.15.130:6809/3542081474","cluster_addr":"172.21.15.130:6811/3542081474","heartbeat_back_addr":"172.21.15.130:6815/3542081474","heartbeat_front_addr":"172.21.15.130:6813/3542081474","state":["exists","up"]},{"osd":5,"uuid":"9a07a137-d6b7-4aba-8678-4fd164597f27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6809","nonce":2507249148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6811","nonce":2507249148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6815","nonce":2507249148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6813","nonce":2507249148}]},"public_addr":"172.21.15.135:6809/2507249148","cluster_addr":"172.21.15.135:6811/2507249148","heartbeat_back_addr":"172.21.15.135:6815/2507249148","heartbeat_front_addr":"172.21.15.135:6813/2507249148","state":["exists","up"]},{"osd":6,"uuid":"6d6346e8-5418-4c30-9bb3-5af352b616a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6819","nonce":155932692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6821","nonce":155932692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6825","nonce":155932692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6823","nonce":155932692}]},"public_addr":"172.21.15.37:6819/155932692","cluster_addr":"172.21.15.37:6821/155932692","heartbeat_back_addr":"172.21.15.37:6825/155932692","heartbeat_front_addr":"172.21.15.37:6823/155932692","state":["exists","up"]},{"osd":7,"uuid":"c87804c2-d456-495e-b36e-33dbb3548347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6817","nonce":4148130245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6819","nonce":4148130245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6823","nonce":4148130245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6821","nonce":4148130245}]},"public_addr":"172.21.15.130:6817/4148130245","cluster_addr":"172.21.15.130:6819/4148130245","heartbeat_back_addr":"172.21.15.130:6823/4148130245","heartbeat_front_addr":"172.21.15.130:6821/4148130245","state":["exists","up"]},{"osd":8,"uuid":"a7d4c9c8-1826-4703-92ad-ded2800b4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6817","nonce":222884649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6819","nonce":222884649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6823","nonce":222884649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6821","nonce":222884649}]},"public_addr":"172.21.15.135:6817/222884649","cluster_addr":"172.21.15.135:6819/222884649","heartbeat_back_addr":"172.21.15.135:6823/222884649","heartbeat_front_addr":"172.21.15.135:6821/222884649","state":["exists","up"]},{"osd":9,"uuid":"f9e0c194-66b5-4e62-b2ae-816a4a4fffbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6827","nonce":2240773042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6829","nonce":2240773042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6833","nonce":2240773042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6831","nonce":2240773042}]},"public_addr":"172.21.15.37:6827/2240773042","cluster_addr":"172.21.15.37:6829/2240773042","heartbeat_back_addr":"172.21.15.37:6833/2240773042","heartbeat_front_addr":"172.21.15.37:6831/2240773042","state":["exists","up"]},{"osd":10,"uuid":"fa6a50a5-2b97-42d1-9b57-b5502b7083d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6825","nonce":2896730163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6827","nonce":2896730163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6831","nonce":2896730163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6829","nonce":2896730163}]},"public_addr":"172.21.15.130:6825/2896730163","cluster_addr":"172.21.15.130:6827/2896730163","heartbeat_back_addr":"172.21.15.130:6831/2896730163","heartbeat_front_addr":"172.21.15.130:6829/2896730163","state":["exists","up"]},{"osd":11,"uuid":"9a305d75-030d-41db-abfb-81bb71e8c6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6825","nonce":2532897645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6827","nonce":2532897645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6831","nonce":2532897645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6829","nonce":2532897645}]},"public_addr":"172.21.15.135:6825/2532897645","cluster_addr":"172.21.15.135:6827/2532897645","heartbeat_back_addr":"172.21.15.135:6831/2532897645","heartbeat_front_addr":"172.21.15.135:6829/2532897645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:26.455665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:51.456030+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:14.332699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:42.749386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:07.587091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:32.450249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:01.864489+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:26.830527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:51.206257+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:20.400020+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:46.329864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:58:11.086508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4282140105":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/1217599998":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/3737412906":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/58912454":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/2105948300":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/1480362562":"2024-08-21T04:50:59.520912+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T04:59:36.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.313+0000 7f647a200640 1 -- 172.21.15.37:0/2810097994 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f64580b3c50 msgr2=0x7f64580b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:36.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.313+0000 7f647a200640 1 --2- 172.21.15.37:0/2810097994 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f64580b3c50 0x7f64580b6110 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6474108060 tx=0x7f6460005f90 comp rx=0 tx=0).stop 2024-08-20T04:59:36.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.313+0000 7f647a200640 1 -- 172.21.15.37:0/2810097994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6474102ab0 msgr2=0x7f6474198fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:36.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.313+0000 7f647a200640 1 --2- 172.21.15.37:0/2810097994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6474102ab0 0x7f6474198fa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6464005940 tx=0x7f64640040c0 comp rx=0 tx=0).stop 2024-08-20T04:59:36.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.313+0000 7f647a200640 1 -- 172.21.15.37:0/2810097994 shutdown_connections 2024-08-20T04:59:36.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.313+0000 7f647a200640 1 --2- 172.21.15.37:0/2810097994 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f64580b3c50 0x7f64580b6110 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:36.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.313+0000 7f647a200640 1 --2- 172.21.15.37:0/2810097994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6474108e40 0x7f647419e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:36.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.313+0000 7f647a200640 1 --2- 172.21.15.37:0/2810097994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64741084c0 0x7f64741994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:36.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.313+0000 7f647a200640 1 --2- 172.21.15.37:0/2810097994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6474102ab0 0x7f6474198fa0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:36.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.313+0000 7f647a200640 1 -- 172.21.15.37:0/2810097994 >> 172.21.15.37:0/2810097994 conn(0x7f64740fe500 msgr2=0x7f64741008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:36.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.313+0000 7f647a200640 1 -- 172.21.15.37:0/2810097994 shutdown_connections 2024-08-20T04:59:36.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:36.313+0000 7f647a200640 1 -- 172.21.15.37:0/2810097994 wait complete. 2024-08-20T04:59:37.076 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-20T04:59:13.823062+0000', 'modified': '2024-08-20T04:59:25.866880+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24695}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24695': {'gid': 24695, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.130:6839/2863850712', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6838', 'nonce': 2863850712}, {'type': 'v1', 'addr': '172.21.15.130:6839', 'nonce': 2863850712}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24695, 'qdb_cluster': [24695]} 2024-08-20T04:59:37.076 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-20T04:59:37.076 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.b status 2024-08-20T04:59:37.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:37 smithi037 ceph-mon[17265]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:37.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:37 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2810097994' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:59:37.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:37 smithi135 ceph-mon[22342]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:37.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:37 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2810097994' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:59:37.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:37 smithi130 ceph-mon[22007]: pgmap v318: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:37.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:37 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2810097994' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:59:37.464 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.089+0000 7fc981400640 1 -- 172.21.15.37:0/2750671773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c108cb0 msgr2=0x7fc97c10f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.089+0000 7fc981400640 1 --2- 172.21.15.37:0/2750671773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c108cb0 0x7fc97c10f4b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc974009ca0 tx=0x7fc97402a8c0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.089+0000 7fc981400640 1 -- 172.21.15.37:0/2750671773 shutdown_connections 2024-08-20T04:59:38.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.089+0000 7fc981400640 1 --2- 172.21.15.37:0/2750671773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c108cb0 0x7fc97c10f4b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.089+0000 7fc981400640 1 --2- 172.21.15.37:0/2750671773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc97c108330 0x7fc97c108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.089+0000 7fc981400640 1 --2- 172.21.15.37:0/2750671773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc97c102920 0x7fc97c102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.089+0000 7fc981400640 1 -- 172.21.15.37:0/2750671773 >> 172.21.15.37:0/2750671773 conn(0x7fc97c0fe350 msgr2=0x7fc97c100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.089+0000 7fc981400640 1 -- 172.21.15.37:0/2750671773 shutdown_connections 2024-08-20T04:59:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.089+0000 7fc981400640 1 -- 172.21.15.37:0/2750671773 wait complete. 2024-08-20T04:59:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.090+0000 7fc981400640 1 Processor -- start 2024-08-20T04:59:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.090+0000 7fc981400640 1 -- start start 2024-08-20T04:59:38.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.090+0000 7fc981400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c102920 0x7fc97c19aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.090+0000 7fc981400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc97c108330 0x7fc97c19b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.090+0000 7fc981400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc97c108cb0 0x7fc97c1a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.091+0000 7fc981400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c112970 con 0x7fc97c102920 2024-08-20T04:59:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.091+0000 7fc981400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c1127f0 con 0x7fc97c108cb0 2024-08-20T04:59:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.091+0000 7fc981400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c112af0 con 0x7fc97c108330 2024-08-20T04:59:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.091+0000 7fc97be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c102920 0x7fc97c19aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.091+0000 7fc97be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c102920 0x7fc97c19aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44274/0 (socket says 172.21.15.37:44274) 2024-08-20T04:59:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.091+0000 7fc97be00640 1 -- 172.21.15.37:0/50750052 learned_addr learned my addr 172.21.15.37:0/50750052 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:38.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.091+0000 7fc973e00640 1 --2- 172.21.15.37:0/50750052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc97c108330 0x7fc97c19b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.091+0000 7fc980a00640 1 --2- 172.21.15.37:0/50750052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc97c108cb0 0x7fc97c1a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.091+0000 7fc97be00640 1 -- 172.21.15.37:0/50750052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc97c108330 msgr2=0x7fc97c19b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.091+0000 7fc97be00640 1 --2- 172.21.15.37:0/50750052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc97c108330 0x7fc97c19b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.091+0000 7fc97be00640 1 -- 172.21.15.37:0/50750052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc97c108cb0 msgr2=0x7fc97c1a07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.091+0000 7fc97be00640 1 --2- 172.21.15.37:0/50750052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc97c108cb0 0x7fc97c1a07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.091+0000 7fc97be00640 1 -- 172.21.15.37:0/50750052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97c1a0f70 con 0x7fc97c102920 2024-08-20T04:59:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.092+0000 7fc97be00640 1 --2- 172.21.15.37:0/50750052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c102920 0x7fc97c19aec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc96c00e9f0 tx=0x7fc96c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:38.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.092+0000 7fc979600640 1 -- 172.21.15.37:0/50750052 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c00cd80 con 0x7fc97c102920 2024-08-20T04:59:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.092+0000 7fc979600640 1 -- 172.21.15.37:0/50750052 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc96c0054d0 con 0x7fc97c102920 2024-08-20T04:59:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.092+0000 7fc981400640 1 -- 172.21.15.37:0/50750052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97c1a1260 con 0x7fc97c102920 2024-08-20T04:59:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.092+0000 7fc979600640 1 -- 172.21.15.37:0/50750052 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96c010690 con 0x7fc97c102920 2024-08-20T04:59:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.092+0000 7fc981400640 1 -- 172.21.15.37:0/50750052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc97c1a7920 con 0x7fc97c102920 2024-08-20T04:59:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.095+0000 7fc98548a740 1 Processor -- start 2024-08-20T04:59:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.095+0000 7fc98548a740 1 -- start start 2024-08-20T04:59:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.095+0000 7fc98548a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5170 0x5653354e5550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.095+0000 7fc98548a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5a90 0x5653354f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.095+0000 7fc98548a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354f1a20 0x5653354f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.095+0000 7fc98548a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56533545b840 con 0x5653354e5a90 2024-08-20T04:59:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.095+0000 7fc98548a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56533544ad40 con 0x5653354e5170 2024-08-20T04:59:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.095+0000 7fc98548a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56533544ed80 con 0x5653354f1a20 2024-08-20T04:59:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.096+0000 7fc979600640 1 -- 172.21.15.37:0/50750052 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fc96c004e90 con 0x7fc97c102920 2024-08-20T04:59:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.096+0000 7fc980a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5170 0x5653354e5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.096+0000 7fc980a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5170 0x5653354e5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:32998/0 (socket says 172.21.15.37:32998) 2024-08-20T04:59:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.096+0000 7fc980a00640 1 -- 172.21.15.37:0/3981750516 learned_addr learned my addr 172.21.15.37:0/3981750516 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.096+0000 7fc973e00640 1 --2- 172.21.15.37:0/3981750516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354f1a20 0x5653354f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.096+0000 7fc97be00640 1 --2- 172.21.15.37:0/3981750516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5a90 0x5653354f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.096+0000 7fc980a00640 1 -- 172.21.15.37:0/3981750516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354f1a20 msgr2=0x5653354f3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T04:59:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.096+0000 7fc980a00640 1 --2- 172.21.15.37:0/3981750516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354f1a20 0x5653354f3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.096+0000 7fc980a00640 1 -- 172.21.15.37:0/3981750516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5a90 msgr2=0x5653354f14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T04:59:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.096+0000 7fc980a00640 1 --2- 172.21.15.37:0/3981750516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5a90 0x5653354f14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.096+0000 7fc980a00640 1 -- 172.21.15.37:0/3981750516 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653353f11c0 con 0x5653354e5170 2024-08-20T04:59:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.096+0000 7fc973e00640 1 --2- 172.21.15.37:0/3981750516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354f1a20 0x5653354f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T04:59:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.096+0000 7fc97be00640 1 --2- 172.21.15.37:0/3981750516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5a90 0x5653354f14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T04:59:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.096+0000 7fc980a00640 1 --2- 172.21.15.37:0/3981750516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5170 0x5653354e5550 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc974009410 tx=0x7fc974005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae95b8e814e8eb55 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.097+0000 7fc971200640 1 -- 172.21.15.37:0/3981750516 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974031cf0 con 0x5653354e5170 2024-08-20T04:59:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.097+0000 7fc971200640 1 -- 172.21.15.37:0/3981750516 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc974036030 con 0x5653354e5170 2024-08-20T04:59:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.097+0000 7fc971200640 1 -- 172.21.15.37:0/3981750516 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9740042a0 con 0x5653354e5170 2024-08-20T04:59:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.097+0000 7fc979600640 1 --2- 172.21.15.37:0/50750052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc9600b3cf0 0x7fc9600b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.098+0000 7fc979600640 1 -- 172.21.15.37:0/50750052 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7fc96c0e4220 con 0x7fc97c102920 2024-08-20T04:59:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.098+0000 7fc97be00640 1 --2- 172.21.15.37:0/50750052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc9600b3cf0 0x7fc9600b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.098+0000 7fc98548a740 1 -- 172.21.15.37:0/3981750516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5170 msgr2=0x5653354e5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.098+0000 7fc98548a740 1 --2- 172.21.15.37:0/3981750516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5170 0x5653354e5550 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc974009410 tx=0x7fc974005ef0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.098+0000 7fc98548a740 1 -- 172.21.15.37:0/3981750516 shutdown_connections 2024-08-20T04:59:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.098+0000 7fc98548a740 1 --2- 172.21.15.37:0/3981750516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354f1a20 0x5653354f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.098+0000 7fc98548a740 1 --2- 172.21.15.37:0/3981750516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5a90 0x5653354f14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.098+0000 7fc98548a740 1 --2- 172.21.15.37:0/3981750516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5170 0x5653354e5550 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.098+0000 7fc98548a740 1 -- 172.21.15.37:0/3981750516 >> 172.21.15.37:0/3981750516 conn(0x5653354e2fa0 msgr2=0x5653354e4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.098+0000 7fc98548a740 1 -- 172.21.15.37:0/3981750516 shutdown_connections 2024-08-20T04:59:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.098+0000 7fc98548a740 1 -- 172.21.15.37:0/3981750516 wait complete. 2024-08-20T04:59:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.098+0000 7fc97be00640 1 --2- 172.21.15.37:0/50750052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc9600b3cf0 0x7fc9600b61b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0aabd0 tx=0x7fc96c004a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.099+0000 7fc98548a740 1 -- start start 2024-08-20T04:59:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.099+0000 7fc98548a740 1 Processor -- start 2024-08-20T04:59:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.099+0000 7fc98548a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5170 0x5653354f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.099+0000 7fc98548a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5a90 0x5653354ee630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.099+0000 7fc98548a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354f1a20 0x5653354eeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.099+0000 7fc98548a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5653352ad5f0 con 0x5653354e5170 2024-08-20T04:59:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.099+0000 7fc98548a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5653353e6170 con 0x5653354e5a90 2024-08-20T04:59:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.099+0000 7fc98548a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5653354f44f0 con 0x5653354f1a20 2024-08-20T04:59:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.099+0000 7fc98548a740 10 client.0 _ll_register_callbacks cb 0x5653354458b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T04:59:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.099+0000 7fc980a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5170 0x5653354f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.099+0000 7fc980a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5170 0x5653354f11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44294/0 (socket says 172.21.15.37:44294) 2024-08-20T04:59:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.099+0000 7fc980a00640 1 -- 172.21.15.37:0/3167873263 learned_addr learned my addr 172.21.15.37:0/3167873263 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.100+0000 7fc973e00640 1 --2- 172.21.15.37:0/3167873263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5a90 0x5653354ee630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.100+0000 7fc980a00640 1 --2- 172.21.15.37:0/3167873263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354f1a20 0x5653354eeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.100+0000 7fc980a00640 1 -- 172.21.15.37:0/3167873263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354f1a20 msgr2=0x5653354eeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T04:59:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.100+0000 7fc980a00640 1 --2- 172.21.15.37:0/3167873263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354f1a20 0x5653354eeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.100+0000 7fc980a00640 1 -- 172.21.15.37:0/3167873263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5a90 msgr2=0x5653354ee630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T04:59:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.100+0000 7fc980a00640 1 --2- 172.21.15.37:0/3167873263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5a90 0x5653354ee630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.100+0000 7fc980a00640 1 -- 172.21.15.37:0/3167873263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653351aa540 con 0x5653354e5170 2024-08-20T04:59:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.100+0000 7fc980a00640 1 --2- 172.21.15.37:0/3167873263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5170 0x5653354f11e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc974005e30 tx=0x7fc974003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0338a3acea4e7fc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.100+0000 7fc969600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T04:59:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.101+0000 7fc969600640 1 -- 172.21.15.37:0/3167873263 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974058060 con 0x5653354e5170 2024-08-20T04:59:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.101+0000 7fc969600640 1 -- 172.21.15.37:0/3167873263 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7fc97402f660 con 0x5653354e5170 2024-08-20T04:59:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.101+0000 7fc98548a740 1 -- 172.21.15.37:0/3167873263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc974036030 con 0x5653354e5170 2024-08-20T04:59:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.101+0000 7fc969600640 1 -- 172.21.15.37:0/3167873263 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fc97405f050 con 0x5653354e5170 2024-08-20T04:59:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.101+0000 7fc98548a740 10 client.14763 fetch_fsmap learned FSMap version 17 2024-08-20T04:59:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.101+0000 7fc98548a740 1 -- 172.21.15.37:0/3167873263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x5653354ffca0 con 0x5653354e5170 2024-08-20T04:59:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.101+0000 7fc969600640 1 -- 172.21.15.37:0/3167873263 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc974036030 con 0x5653354e5170 2024-08-20T04:59:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.101+0000 7fc969600640 1 -- 172.21.15.37:0/3167873263 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7fc974043070 con 0x5653354e5170 2024-08-20T04:59:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.102+0000 7fc98548a740 10 client.14763 fetch_fsmap finished waiting for FSMap version 17 2024-08-20T04:59:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.102+0000 7fc98548a740 10 client.14763 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-20T04:59:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.102+0000 7fc98548a740 20 client.14763 populate_metadata read hostname 'smithi037' 2024-08-20T04:59:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.102+0000 7fc98548a740 1 --2- 172.21.15.37:0/3167873263 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x565335501f60 0x5653355033d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.102+0000 7fc98548a740 4 client.14763 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T04:59:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.102+0000 7fc98548a740 1 -- 172.21.15.37:0/3167873263 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56533545d790 con 0x565335501f60 2024-08-20T04:59:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.102+0000 7fc973e00640 1 --2- 172.21.15.37:0/3167873263 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x565335501f60 0x5653355033d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.103+0000 7fc973e00640 1 --2- 172.21.15.37:0/3167873263 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x565335501f60 0x5653355033d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11f4b5d869caae27 server_cookie=46a9171f73b71caf in_seq=0 out_seq=0 2024-08-20T04:59:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.103+0000 7fc969600640 10 client.14763 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T04:59:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.103+0000 7fc969600640 1 -- 172.21.15.37:0/3167873263 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56533545d790 con 0x565335501f60 2024-08-20T04:59:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.103+0000 7fc969600640 10 client.14763 handle_command_reply: tid=0 2024-08-20T04:59:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.104+0000 7fc98548a740 1 client.14763 shutdown 2024-08-20T04:59:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.104+0000 7fc98548a740 1 -- 172.21.15.37:0/3167873263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5170 msgr2=0x5653354f11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.104+0000 7fc98548a740 1 --2- 172.21.15.37:0/3167873263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5170 0x5653354f11e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc974005e30 tx=0x7fc974003c20 comp rx=0 tx=0).stop 2024-08-20T04:59:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.104+0000 7fc98548a740 1 -- 172.21.15.37:0/3167873263 shutdown_connections 2024-08-20T04:59:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.104+0000 7fc98548a740 1 --2- 172.21.15.37:0/3167873263 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x565335501f60 0x5653355033d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.104+0000 7fc98548a740 1 --2- 172.21.15.37:0/3167873263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354f1a20 0x5653354eeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.104+0000 7fc98548a740 1 --2- 172.21.15.37:0/3167873263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5a90 0x5653354ee630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.104+0000 7fc98548a740 1 --2- 172.21.15.37:0/3167873263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5170 0x5653354f11e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.104+0000 7fc969600640 0 client.14763 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T04:59:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.104+0000 7fc98548a740 1 -- 172.21.15.37:0/3167873263 >> 172.21.15.37:0/3167873263 conn(0x5653354e2fa0 msgr2=0x5653354e8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.104+0000 7fc98548a740 1 -- 172.21.15.37:0/3167873263 shutdown_connections 2024-08-20T04:59:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.104+0000 7fc98548a740 1 -- 172.21.15.37:0/3167873263 wait complete. 2024-08-20T04:59:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.104+0000 7fc98548a740 20 client.14763 trim_cache size 0 max 16384 2024-08-20T04:59:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.123+0000 7fc98548a740 1 Processor -- start 2024-08-20T04:59:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.123+0000 7fc98548a740 1 -- start start 2024-08-20T04:59:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.123+0000 7fc98548a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5170 0x565335502d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.123+0000 7fc98548a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354e5a90 0x5653354e4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.123+0000 7fc98548a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354f1a20 0x5653354e9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.123+0000 7fc98548a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x565335501710 con 0x5653354f1a20 2024-08-20T04:59:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.123+0000 7fc98548a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x565335501de0 con 0x5653354e5170 2024-08-20T04:59:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.123+0000 7fc98548a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5653355024b0 con 0x5653354e5a90 2024-08-20T04:59:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.124+0000 7fc980a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5170 0x565335502d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.124+0000 7fc973e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354e5a90 0x5653354e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.124+0000 7fc973e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354e5a90 0x5653354e4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49726/0 (socket says 172.21.15.37:49726) 2024-08-20T04:59:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.124+0000 7fc973e00640 1 -- 172.21.15.37:0/1110901144 learned_addr learned my addr 172.21.15.37:0/1110901144 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.124+0000 7fc980a00640 1 --2- 172.21.15.37:0/1110901144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354f1a20 0x5653354e9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.124+0000 7fc973e00640 1 -- 172.21.15.37:0/1110901144 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5170 msgr2=0x565335502d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T04:59:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.124+0000 7fc973e00640 1 --2- 172.21.15.37:0/1110901144 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5170 0x565335502d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.124+0000 7fc973e00640 1 -- 172.21.15.37:0/1110901144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354f1a20 msgr2=0x5653354e9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T04:59:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.124+0000 7fc973e00640 1 --2- 172.21.15.37:0/1110901144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354f1a20 0x5653354e9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.124+0000 7fc973e00640 1 -- 172.21.15.37:0/1110901144 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653354e3a20 con 0x5653354e5a90 2024-08-20T04:59:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.124+0000 7fc980a00640 1 --2- 172.21.15.37:0/1110901144 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5170 0x565335502d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:59:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.125+0000 7fc973e00640 1 --2- 172.21.15.37:0/1110901144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354e5a90 0x5653354e4660 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x565335503c30 tx=0x7fc964005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d0d59775aa4b48e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.125+0000 7fc96be00640 1 -- 172.21.15.37:0/1110901144 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc964010430 con 0x5653354e5a90 2024-08-20T04:59:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.125+0000 7fc96be00640 1 -- 172.21.15.37:0/1110901144 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc964010a80 con 0x5653354e5a90 2024-08-20T04:59:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.125+0000 7fc96be00640 1 -- 172.21.15.37:0/1110901144 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc96401e9c0 con 0x5653354e5a90 2024-08-20T04:59:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.126+0000 7fc98548a740 1 -- 172.21.15.37:0/1110901144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354e5a90 msgr2=0x5653354e4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.126+0000 7fc98548a740 1 --2- 172.21.15.37:0/1110901144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354e5a90 0x5653354e4660 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x565335503c30 tx=0x7fc964005f90 comp rx=0 tx=0).stop 2024-08-20T04:59:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.126+0000 7fc98548a740 1 -- 172.21.15.37:0/1110901144 shutdown_connections 2024-08-20T04:59:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.126+0000 7fc98548a740 1 --2- 172.21.15.37:0/1110901144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354f1a20 0x5653354e9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.126+0000 7fc98548a740 1 --2- 172.21.15.37:0/1110901144 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354e5a90 0x5653354e4660 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.126+0000 7fc98548a740 1 --2- 172.21.15.37:0/1110901144 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354e5170 0x565335502d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.126+0000 7fc98548a740 1 -- 172.21.15.37:0/1110901144 >> 172.21.15.37:0/1110901144 conn(0x5653354e2fa0 msgr2=0x5653354e9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.126+0000 7fc98548a740 1 -- 172.21.15.37:0/1110901144 shutdown_connections 2024-08-20T04:59:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.126+0000 7fc98548a740 1 -- 172.21.15.37:0/1110901144 wait complete. 2024-08-20T04:59:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.126+0000 7fc98548a740 1 -- start start 2024-08-20T04:59:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.127+0000 7fc98548a740 1 Processor -- start 2024-08-20T04:59:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.127+0000 7fc98548a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354e5170 0x56533550bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.127+0000 7fc98548a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5a90 0x565335505230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.127+0000 7fc98548a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354f1a20 0x5653355057d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.127+0000 7fc98548a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x565335503250 con 0x5653354e5a90 2024-08-20T04:59:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.127+0000 7fc98548a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x565335502b80 con 0x5653354f1a20 2024-08-20T04:59:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.127+0000 7fc98548a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x565335503920 con 0x5653354e5170 2024-08-20T04:59:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.127+0000 7fc98548a740 10 client.0 _ll_register_callbacks cb 0x7fc974009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T04:59:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.127+0000 7fc973e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5a90 0x565335505230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.127+0000 7fc973e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5a90 0x565335505230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44312/0 (socket says 172.21.15.37:44312) 2024-08-20T04:59:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.127+0000 7fc973e00640 1 -- 172.21.15.37:0/2856786683 learned_addr learned my addr 172.21.15.37:0/2856786683 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.127+0000 7fc980a00640 1 --2- 172.21.15.37:0/2856786683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354e5170 0x56533550bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.127+0000 7fc980a00640 1 --2- 172.21.15.37:0/2856786683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354f1a20 0x5653355057d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.128+0000 7fc980a00640 1 -- 172.21.15.37:0/2856786683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354f1a20 msgr2=0x5653355057d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T04:59:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.128+0000 7fc980a00640 1 --2- 172.21.15.37:0/2856786683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354f1a20 0x5653355057d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.128+0000 7fc980a00640 1 -- 172.21.15.37:0/2856786683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5a90 msgr2=0x565335505230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T04:59:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.128+0000 7fc980a00640 1 --2- 172.21.15.37:0/2856786683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5a90 0x565335505230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.128+0000 7fc980a00640 1 -- 172.21.15.37:0/2856786683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565335506000 con 0x5653354e5170 2024-08-20T04:59:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.128+0000 7fc980a00640 1 --2- 172.21.15.37:0/2856786683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354e5170 0x56533550bd60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc974009ca0 tx=0x7fc974005c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6240235938ccbfc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.128+0000 7fc969600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T04:59:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.128+0000 7fc969600640 1 -- 172.21.15.37:0/2856786683 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974058040 con 0x5653354e5170 2024-08-20T04:59:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.128+0000 7fc98548a740 1 -- 172.21.15.37:0/2856786683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc964010a80 con 0x5653354e5170 2024-08-20T04:59:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.128+0000 7fc969600640 1 -- 172.21.15.37:0/2856786683 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7fc974030830 con 0x5653354e5170 2024-08-20T04:59:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.129+0000 7fc969600640 1 -- 172.21.15.37:0/2856786683 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fc97402f660 con 0x5653354e5170 2024-08-20T04:59:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.129+0000 7fc98548a740 10 client.24802 fetch_fsmap learned FSMap version 17 2024-08-20T04:59:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.129+0000 7fc98548a740 1 -- 172.21.15.37:0/2856786683 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x56533556c730 con 0x5653354e5170 2024-08-20T04:59:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.129+0000 7fc969600640 1 -- 172.21.15.37:0/2856786683 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc964010a80 con 0x5653354e5170 2024-08-20T04:59:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.129+0000 7fc969600640 1 -- 172.21.15.37:0/2856786683 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7fc974062040 con 0x5653354e5170 2024-08-20T04:59:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.129+0000 7fc98548a740 10 client.24802 fetch_fsmap finished waiting for FSMap version 17 2024-08-20T04:59:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.129+0000 7fc98548a740 10 client.24802 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-20T04:59:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.129+0000 7fc98548a740 20 client.24802 populate_metadata read hostname 'smithi037' 2024-08-20T04:59:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.129+0000 7fc98548a740 1 --2- 172.21.15.37:0/2856786683 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x565335571210 0x56533556ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.129+0000 7fc98548a740 4 client.24802 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T04:59:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.129+0000 7fc98548a740 1 -- 172.21.15.37:0/2856786683 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "status"}) -- 0x565335459230 con 0x565335571210 2024-08-20T04:59:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.130+0000 7fc973e00640 1 --2- 172.21.15.37:0/2856786683 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x565335571210 0x56533556ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.130+0000 7fc973e00640 1 --2- 172.21.15.37:0/2856786683 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x565335571210 0x56533556ff20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a14ed852f97f71ff server_cookie=f35d3e870ff8bf6 in_seq=0 out_seq=0 2024-08-20T04:59:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.130+0000 7fc969600640 10 client.24802 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T04:59:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.130+0000 7fc969600640 1 -- 172.21.15.37:0/2856786683 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x565335459230 con 0x565335571210 2024-08-20T04:59:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.130+0000 7fc969600640 10 client.24802 handle_command_reply: tid=0 2024-08-20T04:59:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.130+0000 7fc98548a740 1 client.24802 shutdown 2024-08-20T04:59:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.131+0000 7fc98548a740 1 -- 172.21.15.37:0/2856786683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354e5170 msgr2=0x56533550bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.131+0000 7fc98548a740 1 --2- 172.21.15.37:0/2856786683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354e5170 0x56533550bd60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc974009ca0 tx=0x7fc974005c50 comp rx=0 tx=0).stop 2024-08-20T04:59:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.131+0000 7fc98548a740 1 -- 172.21.15.37:0/2856786683 shutdown_connections 2024-08-20T04:59:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.131+0000 7fc98548a740 1 --2- 172.21.15.37:0/2856786683 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x565335571210 0x56533556ff20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.131+0000 7fc98548a740 1 --2- 172.21.15.37:0/2856786683 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5653354f1a20 0x5653355057d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.131+0000 7fc98548a740 1 --2- 172.21.15.37:0/2856786683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5653354e5a90 0x565335505230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.131+0000 7fc98548a740 1 --2- 172.21.15.37:0/2856786683 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5653354e5170 0x56533550bd60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.131+0000 7fc969600640 0 client.24802 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T04:59:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.131+0000 7fc98548a740 1 -- 172.21.15.37:0/2856786683 >> 172.21.15.37:0/2856786683 conn(0x5653354e2fa0 msgr2=0x5653354f0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.131+0000 7fc98548a740 1 -- 172.21.15.37:0/2856786683 shutdown_connections 2024-08-20T04:59:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.131+0000 7fc98548a740 1 -- 172.21.15.37:0/2856786683 wait complete. 2024-08-20T04:59:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.131+0000 7fc98548a740 20 client.24802 trim_cache size 0 max 16384 2024-08-20T04:59:38.136 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T04:59:38.136 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T04:59:38.136 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-08-20T04:59:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24695, 2024-08-20T04:59:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-20T04:59:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-20T04:59:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-20T04:59:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 23.352347826999999, 2024-08-20T04:59:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 17, 2024-08-20T04:59:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 84, 2024-08-20T04:59:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 84, 2024-08-20T04:59:38.137 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 36.874397281 2024-08-20T04:59:38.137 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T04:59:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.132+0000 7fc981400640 1 -- 172.21.15.37:0/50750052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc9600b3cf0 msgr2=0x7fc9600b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.132+0000 7fc981400640 1 --2- 172.21.15.37:0/50750052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc9600b3cf0 0x7fc9600b61b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0aabd0 tx=0x7fc96c004a90 comp rx=0 tx=0).stop 2024-08-20T04:59:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.132+0000 7fc981400640 1 -- 172.21.15.37:0/50750052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c102920 msgr2=0x7fc97c19aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.132+0000 7fc981400640 1 --2- 172.21.15.37:0/50750052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c102920 0x7fc97c19aec0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc96c00e9f0 tx=0x7fc96c00edf0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.132+0000 7fc981400640 1 -- 172.21.15.37:0/50750052 shutdown_connections 2024-08-20T04:59:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.132+0000 7fc981400640 1 --2- 172.21.15.37:0/50750052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc9600b3cf0 0x7fc9600b61b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.132+0000 7fc981400640 1 --2- 172.21.15.37:0/50750052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc97c108cb0 0x7fc97c1a07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.132+0000 7fc981400640 1 --2- 172.21.15.37:0/50750052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc97c108330 0x7fc97c19b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.132+0000 7fc981400640 1 --2- 172.21.15.37:0/50750052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc97c102920 0x7fc97c19aec0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.132+0000 7fc981400640 1 -- 172.21.15.37:0/50750052 >> 172.21.15.37:0/50750052 conn(0x7fc97c0fe350 msgr2=0x7fc97c1048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:38.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.132+0000 7fc981400640 1 -- 172.21.15.37:0/50750052 shutdown_connections 2024-08-20T04:59:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:38.132+0000 7fc981400640 1 -- 172.21.15.37:0/50750052 wait complete. 2024-08-20T04:59:38.980 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-20T04:59:38.981 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-20T04:59:38.981 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs ls 2024-08-20T04:59:39.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:39 smithi037 ceph-mon[17265]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:39.364 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:39.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:39 smithi135 ceph-mon[22342]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:39.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:39 smithi130 ceph-mon[22007]: pgmap v319: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:40.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.977+0000 7f8083a00640 1 -- 172.21.15.37:0/1898160945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f807c113690 msgr2=0x7f807c115a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:40.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.977+0000 7f8083a00640 1 --2- 172.21.15.37:0/1898160945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f807c113690 0x7f807c115a80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8074009ca0 tx=0x7f807402a8c0 comp rx=0 tx=0).stop 2024-08-20T04:59:40.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.977+0000 7f8083a00640 1 -- 172.21.15.37:0/1898160945 shutdown_connections 2024-08-20T04:59:40.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.977+0000 7f8083a00640 1 --2- 172.21.15.37:0/1898160945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f807c113690 0x7f807c115a80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:40.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.977+0000 7f8083a00640 1 --2- 172.21.15.37:0/1898160945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f807c077d20 0x7f807c113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:40.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.977+0000 7f8083a00640 1 --2- 172.21.15.37:0/1898160945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f807c077400 0x7f807c0777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:40.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.977+0000 7f8083a00640 1 -- 172.21.15.37:0/1898160945 >> 172.21.15.37:0/1898160945 conn(0x7f807c100730 msgr2=0x7f807c102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:40.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.977+0000 7f8083a00640 1 -- 172.21.15.37:0/1898160945 shutdown_connections 2024-08-20T04:59:40.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.977+0000 7f8083a00640 1 -- 172.21.15.37:0/1898160945 wait complete. 2024-08-20T04:59:40.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.979+0000 7f8083a00640 1 Processor -- start 2024-08-20T04:59:40.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.979+0000 7f8083a00640 1 -- start start 2024-08-20T04:59:40.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.980+0000 7f8083a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f807c077400 0x7f807c19f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:40.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.980+0000 7f8083a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f807c077d20 0x7f807c19fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:40.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.980+0000 7f8083a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f807c113690 0x7f807c1a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:40.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.980+0000 7f8083a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f807c1190b0 con 0x7f807c113690 2024-08-20T04:59:40.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.980+0000 7f8083a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f807c118f30 con 0x7f807c077d20 2024-08-20T04:59:40.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.980+0000 7f8083a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f807c119230 con 0x7f807c077400 2024-08-20T04:59:40.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.980+0000 7f8081a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f807c113690 0x7f807c1a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.980+0000 7f8081a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f807c113690 0x7f807c1a4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44326/0 (socket says 172.21.15.37:44326) 2024-08-20T04:59:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.980+0000 7f8081a00640 1 -- 172.21.15.37:0/194720745 learned_addr learned my addr 172.21.15.37:0/194720745 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.980+0000 7f8081000640 1 --2- 172.21.15.37:0/194720745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f807c077400 0x7f807c19f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.980+0000 7f807be00640 1 --2- 172.21.15.37:0/194720745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f807c077d20 0x7f807c19fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.980+0000 7f8081a00640 1 -- 172.21.15.37:0/194720745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f807c077400 msgr2=0x7f807c19f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.980+0000 7f8081a00640 1 --2- 172.21.15.37:0/194720745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f807c077400 0x7f807c19f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.980+0000 7f8081a00640 1 -- 172.21.15.37:0/194720745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f807c077d20 msgr2=0x7f807c19fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.980+0000 7f8081a00640 1 --2- 172.21.15.37:0/194720745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f807c077d20 0x7f807c19fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.980+0000 7f8081a00640 1 -- 172.21.15.37:0/194720745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f807c1a5630 con 0x7f807c113690 2024-08-20T04:59:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.980+0000 7f8081000640 1 --2- 172.21.15.37:0/194720745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f807c077400 0x7f807c19f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:59:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.981+0000 7f8081a00640 1 --2- 172.21.15.37:0/194720745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f807c113690 0x7f807c1a4e60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8074005e30 tx=0x7f80740317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:40.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.981+0000 7f8079600640 1 -- 172.21.15.37:0/194720745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8074003b70 con 0x7f807c113690 2024-08-20T04:59:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.981+0000 7f8079600640 1 -- 172.21.15.37:0/194720745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8074003d10 con 0x7f807c113690 2024-08-20T04:59:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.981+0000 7f8083a00640 1 -- 172.21.15.37:0/194720745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f807c1a58c0 con 0x7f807c113690 2024-08-20T04:59:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.981+0000 7f8079600640 1 -- 172.21.15.37:0/194720745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f807402f970 con 0x7f807c113690 2024-08-20T04:59:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.981+0000 7f8083a00640 1 -- 172.21.15.37:0/194720745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f807c1abfe0 con 0x7f807c113690 2024-08-20T04:59:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.982+0000 7f8083a00640 1 -- 172.21.15.37:0/194720745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f807c0777e0 con 0x7f807c113690 2024-08-20T04:59:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.985+0000 7f8079600640 1 -- 172.21.15.37:0/194720745 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f8074004b40 con 0x7f807c113690 2024-08-20T04:59:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.986+0000 7f8079600640 1 --2- 172.21.15.37:0/194720745 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80640b3bd0 0x7f80640b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.986+0000 7f8079600640 1 -- 172.21.15.37:0/194720745 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f8074105220 con 0x7f807c113690 2024-08-20T04:59:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.986+0000 7f8081000640 1 --2- 172.21.15.37:0/194720745 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80640b3bd0 0x7f80640b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.987+0000 7f8081000640 1 --2- 172.21.15.37:0/194720745 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80640b3bd0 0x7f80640b6090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8070009fc0 tx=0x7f8070005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:40.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:39.988+0000 7f8079600640 1 -- 172.21.15.37:0/194720745 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f80740cc5d0 con 0x7f807c113690 2024-08-20T04:59:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:40.223+0000 7f8083a00640 1 -- 172.21.15.37:0/194720745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f807c1ac350 con 0x7f807c113690 2024-08-20T04:59:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:40.223+0000 7f8079600640 1 -- 172.21.15.37:0/194720745 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f80740cbed0 con 0x7f807c113690 2024-08-20T04:59:40.225 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-20T04:59:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:40.225+0000 7f8083a00640 1 -- 172.21.15.37:0/194720745 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80640b3bd0 msgr2=0x7f80640b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:40.225+0000 7f8083a00640 1 --2- 172.21.15.37:0/194720745 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80640b3bd0 0x7f80640b6090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8070009fc0 tx=0x7f8070005f90 comp rx=0 tx=0).stop 2024-08-20T04:59:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:40.225+0000 7f8083a00640 1 -- 172.21.15.37:0/194720745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f807c113690 msgr2=0x7f807c1a4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:40.225+0000 7f8083a00640 1 --2- 172.21.15.37:0/194720745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f807c113690 0x7f807c1a4e60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8074005e30 tx=0x7f80740317c0 comp rx=0 tx=0).stop 2024-08-20T04:59:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:40.226+0000 7f8083a00640 1 -- 172.21.15.37:0/194720745 shutdown_connections 2024-08-20T04:59:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:40.226+0000 7f8083a00640 1 --2- 172.21.15.37:0/194720745 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80640b3bd0 0x7f80640b6090 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:40.226+0000 7f8083a00640 1 --2- 172.21.15.37:0/194720745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f807c113690 0x7f807c1a4e60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:40.226+0000 7f8083a00640 1 --2- 172.21.15.37:0/194720745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f807c077d20 0x7f807c19fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:40.226+0000 7f8083a00640 1 --2- 172.21.15.37:0/194720745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f807c077400 0x7f807c19f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:40.226+0000 7f8083a00640 1 -- 172.21.15.37:0/194720745 >> 172.21.15.37:0/194720745 conn(0x7f807c100730 msgr2=0x7f807c102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:40.226+0000 7f8083a00640 1 -- 172.21.15.37:0/194720745 shutdown_connections 2024-08-20T04:59:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:40.226+0000 7f8083a00640 1 -- 172.21.15.37:0/194720745 wait complete. 2024-08-20T04:59:41.083 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-20T04:59:41.083 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-20T04:59:41.083 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-08-20T04:59:41.084 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-08-20T04:59:41.084 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-20T04:59:41.084 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-20T04:59:41.084 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-20T04:59:41.084 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-20T04:59:41.084 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-08-20T04:59:41.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T04:59:41.084 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-08-20T04:59:41.120 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-20T04:59:41.120 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-20T04:59:41.120 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-08-20T04:59:41.120 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-08-20T04:59:41.121 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-08-20T04:59:41.121 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-08-20T04:59:41.121 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-20T04:59:41.121 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-08-20T04:59:41.121 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-08-20T04:59:41.121 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-20T04:59:41.121 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-08-20T04:59:41.121 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-08-20T04:59:41.121 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-20T04:59:41.121 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-08-20T04:59:41.121 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-08-20T04:59:41.121 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-20T04:59:41.121 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42312sec preferred_lft 42312sec 2024-08-20T04:59:41.121 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-08-20T04:59:41.122 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-08-20T04:59:41.122 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-20T04:59:41.122 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-08-20T04:59:41.122 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-08-20T04:59:41.122 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-20T04:59:41.123 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T04:59:41.123 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-08-20T04:59:41.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2024-08-20T04:59:41.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2024-08-20T04:59:41.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2024-08-20T04:59:41.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-20T04:59:41.123 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-08-20T04:59:41.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T04:59:41.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:41 smithi135 ceph-mon[22342]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:41.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:41 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/194720745' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-20T04:59:41.453 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:41 smithi037 ceph-mon[17265]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:41.454 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:41 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/194720745' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-20T04:59:41.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:41 smithi130 ceph-mon[22007]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:41.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:41 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/194720745' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-20T04:59:41.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T04:59:41.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T04:59:41.539 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-20T04:59:41.597 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-08-20T04:59:41.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T04:59:41.601 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-08-20T04:59:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-08-20T04:59:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-20T04:59:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-20T04:59:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-20T04:59:41.653 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-20T04:59:41.654 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T04:59:41.654 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-08-20T04:59:41.654 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-20T04:59:41.654 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-20T04:59:41.654 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-20T04:59:41.654 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-08-20T04:59:41.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T04:59:42.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T04:59:42.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T04:59:42.297 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-08-20T04:59:42.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T04:59:42.333 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-08-20T04:59:42.409 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T04:59:42.410 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-08-20T04:59:42.410 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-20T04:59:42.410 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-08-20T04:59:42.410 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-08-20T04:59:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T04:59:42.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T04:59:42.589 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-08-20T04:59:42.589 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T04:59:42.589 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-08-20T04:59:42.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-08-20T04:59:42.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-20T04:59:42.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-08-20T04:59:42.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-08-20T04:59:42.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-08-20T04:59:42.590 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-08-20T04:59:42.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T04:59:42.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T04:59:42.839 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T04:59:42.839 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-08-20T04:59:42.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-08-20T04:59:42.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2024-08-20T04:59:42.840 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-08-20T04:59:42.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T04:59:43.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T04:59:43.009 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-08-20T04:59:43.009 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-20T04:59:43.009 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-08-20T04:59:43.044 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-08-20T04:59:43.045 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-20T04:59:43.045 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-08-20T04:59:43.120 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2024-08-20T04:59:43.219 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2024-08-20T04:59:43.257 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2024-08-20T04:59:43.257 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2024-08-20T04:59:43.257 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2024-08-20T04:59:43.257 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2024-08-20T04:59:43.257 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2024-08-20T04:59:43.257 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2024-08-20T04:59:43.257 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2024-08-20T04:59:43.257 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2024-08-20T04:59:43.257 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2024-08-20T04:59:43.257 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/bpf 2024-08-20T04:59:43.257 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2024-08-20T04:59:43.258 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2024-08-20T04:59:43.258 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-08-20T04:59:43.258 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2024-08-20T04:59:43.258 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2024-08-20T04:59:43.258 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2024-08-20T04:59:43.258 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2024-08-20T04:59:43.258 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2024-08-20T04:59:43.258 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2024-08-20T04:59:43.258 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2024-08-20T04:59:43.258 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-20T04:59:43.258 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-20T04:59:43.259 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2024-08-20T04:59:43.259 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2024-08-20T04:59:43.259 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2024-08-20T04:59:43.259 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay 2024-08-20T04:59:43.259 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/ae86637e25725fa8aa5550afbc8adb13366a6029a99a73d2912bbcca872ff18c/merged 2024-08-20T04:59:43.259 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/1ade120bbdc0059ab56a8d6e09110db83f318549005fdf0ec334e29706cd2966/merged 2024-08-20T04:59:43.259 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/0 2024-08-20T04:59:43.259 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-08-20T04:59:43.259 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/927030ca42cab1be8feef6d9d542e495ad9afc52129231c930469c1846216e98/merged 2024-08-20T04:59:43.259 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/eab47e4badf874567a43b927aaf6df436803c57ad70bf9fb3efe6475f7766f4e/merged 2024-08-20T04:59:43.259 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/7eb65d7101117ea8199ab66f9b0b1dcb8b967cea6c8c9a2fa169bdba37161cb2/merged 2024-08-20T04:59:43.259 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/df94662a896ffca65b29bc974508493f71010825573a44f116be559375954dc7/merged 2024-08-20T04:59:43.260 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/8a0c3a6e2ee87b9e1c5d024f6d683bd5a4a15a294e4eec6c27fc15bf0561d44b/merged 2024-08-20T04:59:43.260 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/2e57c2ad253fe8293881b170c1b08d8f758a6c4ce3e606982f3468ab9683d6a9/merged 2024-08-20T04:59:43.260 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/228b99d4b45e498d14dc368d6da13f54328785d3f93140fddef1780fde1091ec/merged 2024-08-20T04:59:43.260 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/2512d285c0e8d8d349e3d7157c154b106c465bcac299b82cdba67d066afcd2d7/merged 2024-08-20T04:59:43.260 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2024-08-20T04:59:43.260 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-20T04:59:43.260 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-20T04:59:43.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T04:59:43.261 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2024-08-20T04:59:43.339 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-20T04:59:43.339 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-08-20T04:59:43.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:43 smithi135 ceph-mon[22342]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:43.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2024-08-20T04:59:43.429 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:43 smithi037 ceph-mon[17265]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:43.441 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2024-08-20T04:59:43.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:43 smithi130 ceph-mon[22007]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T04:59:43.518 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2024-08-20T04:59:43.518 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2024-08-20T04:59:43.518 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2024-08-20T04:59:43.518 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2024-08-20T04:59:43.518 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2024-08-20T04:59:43.518 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2024-08-20T04:59:43.518 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2024-08-20T04:59:43.519 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2024-08-20T04:59:43.519 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2024-08-20T04:59:43.519 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/bpf 2024-08-20T04:59:43.519 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2024-08-20T04:59:43.519 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2024-08-20T04:59:43.519 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-08-20T04:59:43.519 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2024-08-20T04:59:43.519 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2024-08-20T04:59:43.519 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2024-08-20T04:59:43.519 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2024-08-20T04:59:43.519 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2024-08-20T04:59:43.519 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2024-08-20T04:59:43.519 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2024-08-20T04:59:43.519 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-20T04:59:43.520 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-20T04:59:43.520 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2024-08-20T04:59:43.520 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2024-08-20T04:59:43.520 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2024-08-20T04:59:43.520 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay 2024-08-20T04:59:43.520 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/ae86637e25725fa8aa5550afbc8adb13366a6029a99a73d2912bbcca872ff18c/merged 2024-08-20T04:59:43.520 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/1ade120bbdc0059ab56a8d6e09110db83f318549005fdf0ec334e29706cd2966/merged 2024-08-20T04:59:43.520 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/0 2024-08-20T04:59:43.520 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-08-20T04:59:43.520 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/927030ca42cab1be8feef6d9d542e495ad9afc52129231c930469c1846216e98/merged 2024-08-20T04:59:43.520 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/eab47e4badf874567a43b927aaf6df436803c57ad70bf9fb3efe6475f7766f4e/merged 2024-08-20T04:59:43.520 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/7eb65d7101117ea8199ab66f9b0b1dcb8b967cea6c8c9a2fa169bdba37161cb2/merged 2024-08-20T04:59:43.520 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/df94662a896ffca65b29bc974508493f71010825573a44f116be559375954dc7/merged 2024-08-20T04:59:43.521 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/8a0c3a6e2ee87b9e1c5d024f6d683bd5a4a15a294e4eec6c27fc15bf0561d44b/merged 2024-08-20T04:59:43.521 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/2e57c2ad253fe8293881b170c1b08d8f758a6c4ce3e606982f3468ab9683d6a9/merged 2024-08-20T04:59:43.521 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/228b99d4b45e498d14dc368d6da13f54328785d3f93140fddef1780fde1091ec/merged 2024-08-20T04:59:43.521 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/2512d285c0e8d8d349e3d7157c154b106c465bcac299b82cdba67d066afcd2d7/merged 2024-08-20T04:59:43.521 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2024-08-20T04:59:43.521 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-20T04:59:43.521 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-20T04:59:43.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T04:59:43.522 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2024-08-20T04:59:43.583 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:2024-08-20T04:59:43.581+0000 7fc5a6870480 -1 init, newargv = 0x558adcc3d720 newargc=15 2024-08-20T04:59:43.583 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[64249]: starting ceph client 2024-08-20T04:59:43.593 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[64249]: starting fuse 2024-08-20T04:59:43.601 INFO:teuthology.orchestra.run.smithi037.stdout:120 2024-08-20T04:59:43.602 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-08-20T04:59:43.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo stdin-killer -- python3 -c ' 2024-08-20T04:59:43.602 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2024-08-20T04:59:43.602 DEBUG:teuthology.orchestra.run.smithi037:> import re 2024-08-20T04:59:43.602 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-08-20T04:59:43.602 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2024-08-20T04:59:43.602 DEBUG:teuthology.orchestra.run.smithi037:> 2024-08-20T04:59:43.602 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2024-08-20T04:59:43.603 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-08-20T04:59:43.603 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2024-08-20T04:59:43.603 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-08-20T04:59:43.603 DEBUG:teuthology.orchestra.run.smithi037:> 2024-08-20T04:59:43.603 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2024-08-20T04:59:43.603 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2024-08-20T04:59:43.603 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2024-08-20T04:59:43.603 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2024-08-20T04:59:43.603 DEBUG:teuthology.orchestra.run.smithi037:> 2024-08-20T04:59:43.603 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2024-08-20T04:59:43.603 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-20T04:59:43.603 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-20T04:59:43.603 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-20T04:59:43.603 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2024-08-20T04:59:43.603 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2024-08-20T04:59:43.604 DEBUG:teuthology.orchestra.run.smithi037:> return f 2024-08-20T04:59:43.604 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-20T04:59:43.604 DEBUG:teuthology.orchestra.run.smithi037:> 2024-08-20T04:59:43.604 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.admin")) 2024-08-20T04:59:43.604 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-08-20T04:59:43.766 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.admin.64249.asok 2024-08-20T04:59:43.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T04:59:43.780 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.64249.asok 2024-08-20T04:59:43.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T04:59:43.780 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.64249.asok status 2024-08-20T04:59:43.967 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T04:59:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2024-08-20T04:59:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "ef4275410d8483698016fe484b2a3c664080b4c1", 2024-08-20T04:59:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 19.0.0-5872-gef427541 (ef4275410d8483698016fe484b2a3c664080b4c1) squid (dev)", 2024-08-20T04:59:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "admin", 2024-08-20T04:59:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2024-08-20T04:59:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-08-20T04:59:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "64249", 2024-08-20T04:59:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2024-08-20T04:59:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T04:59:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2024-08-20T04:59:43.968 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2024-08-20T04:59:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24809, 2024-08-20T04:59:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2024-08-20T04:59:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2024-08-20T04:59:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2024-08-20T04:59:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 24809 2024-08-20T04:59:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T04:59:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2024-08-20T04:59:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-08-20T04:59:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-08-20T04:59:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 826490729 2024-08-20T04:59:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T04:59:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T04:59:43.969 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2024-08-20T04:59:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-08-20T04:59:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-08-20T04:59:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 826490729 2024-08-20T04:59:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T04:59:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.24809 172.21.15.37:0/826490729", 2024-08-20T04:59:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "172.21.15.37:0/826490729", 2024-08-20T04:59:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2024-08-20T04:59:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 17, 2024-08-20T04:59:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 84, 2024-08-20T04:59:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2024-08-20T04:59:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2024-08-20T04:59:43.970 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2024-08-20T04:59:43.970 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T04:59:43.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T04:59:43.980 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2024-08-20T04:59:43.980 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-08-20T04:59:44.016 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2024-08-20T04:59:44.017 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-08-20T04:59:44.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T04:59:44.017 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-08-20T04:59:44.114 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-08-20T04:59:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-20T04:59:44.222 INFO:teuthology.orchestra.run.smithi037.stdout:# file: . 2024-08-20T04:59:44.222 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-08-20T04:59:44.223 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:59:44.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T04:59:44.231 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T04:59:44.231 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-20T04:59:44.268 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd blocklist ls 2024-08-20T04:59:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:45.136 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:45 smithi037 ceph-mon[17265]: pgmap v322: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-08-20T04:59:45.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.251+0000 7f4141e00640 1 -- 172.21.15.37:0/3337539417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c10f0d0 msgr2=0x7f413c1114c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:45.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.251+0000 7f4141e00640 1 --2- 172.21.15.37:0/3337539417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c10f0d0 0x7f413c1114c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4134009ca0 tx=0x7f413402a8c0 comp rx=0 tx=0).stop 2024-08-20T04:59:45.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.251+0000 7f4141e00640 1 -- 172.21.15.37:0/3337539417 shutdown_connections 2024-08-20T04:59:45.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.251+0000 7f4141e00640 1 --2- 172.21.15.37:0/3337539417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c10f0d0 0x7f413c1114c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:45.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.251+0000 7f4141e00640 1 --2- 172.21.15.37:0/3337539417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f413c075c70 0x7f413c10eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:45.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.251+0000 7f4141e00640 1 --2- 172.21.15.37:0/3337539417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f413c075270 0x7f413c075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:45.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.251+0000 7f4141e00640 1 -- 172.21.15.37:0/3337539417 >> 172.21.15.37:0/3337539417 conn(0x7f413c0fe500 msgr2=0x7f413c100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:45.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.251+0000 7f4141e00640 1 -- 172.21.15.37:0/3337539417 shutdown_connections 2024-08-20T04:59:45.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.251+0000 7f4141e00640 1 -- 172.21.15.37:0/3337539417 wait complete. 2024-08-20T04:59:45.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.252+0000 7f4141e00640 1 Processor -- start 2024-08-20T04:59:45.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.252+0000 7f4141e00640 1 -- start start 2024-08-20T04:59:45.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.253+0000 7f4141e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f413c075270 0x7f413c19b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.253+0000 7f4141e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f413c075c70 0x7f413c19b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.253+0000 7f4141e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c10f0d0 0x7f413c1a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.253+0000 7f4141e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f413c114cd0 con 0x7f413c10f0d0 2024-08-20T04:59:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.253+0000 7f4141e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f413c114b50 con 0x7f413c075c70 2024-08-20T04:59:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.253+0000 7f4141e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f413c114e50 con 0x7f413c075270 2024-08-20T04:59:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.253+0000 7f413aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f413c075270 0x7f413c19b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.253+0000 7f413aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f413c075270 0x7f413c19b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51478/0 (socket says 172.21.15.37:51478) 2024-08-20T04:59:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.253+0000 7f413aa00640 1 -- 172.21.15.37:0/2120159990 learned_addr learned my addr 172.21.15.37:0/2120159990 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.253+0000 7f413b400640 1 --2- 172.21.15.37:0/2120159990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c10f0d0 0x7f413c1a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.253+0000 7f4132000640 1 --2- 172.21.15.37:0/2120159990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f413c075c70 0x7f413c19b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.253+0000 7f413aa00640 1 -- 172.21.15.37:0/2120159990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f413c075c70 msgr2=0x7f413c19b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:45.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.253+0000 7f413aa00640 1 --2- 172.21.15.37:0/2120159990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f413c075c70 0x7f413c19b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.253+0000 7f413aa00640 1 -- 172.21.15.37:0/2120159990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c10f0d0 msgr2=0x7f413c1a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.253+0000 7f413aa00640 1 --2- 172.21.15.37:0/2120159990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c10f0d0 0x7f413c1a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.253+0000 7f413aa00640 1 -- 172.21.15.37:0/2120159990 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413c1a12d0 con 0x7f413c075270 2024-08-20T04:59:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.254+0000 7f413aa00640 1 --2- 172.21.15.37:0/2120159990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f413c075270 0x7f413c19b220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f412c00e9f0 tx=0x7f412c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.254+0000 7f4140a00640 1 -- 172.21.15.37:0/2120159990 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c00cd80 con 0x7f413c075270 2024-08-20T04:59:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.254+0000 7f4141e00640 1 -- 172.21.15.37:0/2120159990 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f413c1a15c0 con 0x7f413c075270 2024-08-20T04:59:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.254+0000 7f4140a00640 1 -- 172.21.15.37:0/2120159990 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f412c0108e0 con 0x7f413c075270 2024-08-20T04:59:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.254+0000 7f4140a00640 1 -- 172.21.15.37:0/2120159990 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c018980 con 0x7f413c075270 2024-08-20T04:59:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.254+0000 7f4141e00640 1 -- 172.21.15.37:0/2120159990 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f413c1a7c80 con 0x7f413c075270 2024-08-20T04:59:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.255+0000 7f4141e00640 1 -- 172.21.15.37:0/2120159990 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f413c075650 con 0x7f413c075270 2024-08-20T04:59:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.257+0000 7f4140a00640 1 -- 172.21.15.37:0/2120159990 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f412c010430 con 0x7f413c075270 2024-08-20T04:59:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.259+0000 7f4140a00640 1 --2- 172.21.15.37:0/2120159990 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f41200b3bd0 0x7f41200b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.259+0000 7f4140a00640 1 -- 172.21.15.37:0/2120159990 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f412c0e4440 con 0x7f413c075270 2024-08-20T04:59:45.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.259+0000 7f4132000640 1 --2- 172.21.15.37:0/2120159990 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f41200b3bd0 0x7f41200b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:45.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.260+0000 7f4132000640 1 --2- 172.21.15.37:0/2120159990 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f41200b3bd0 0x7f41200b6090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f413c100da0 tx=0x7f4124005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:45.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.260+0000 7f4140a00640 1 -- 172.21.15.37:0/2120159990 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f412c0ab1a0 con 0x7f413c075270 2024-08-20T04:59:45.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:45 smithi135 ceph-mon[22342]: pgmap v322: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-08-20T04:59:45.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:45 smithi130 ceph-mon[22007]: pgmap v322: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-08-20T04:59:45.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.468+0000 7f4141e00640 1 -- 172.21.15.37:0/2120159990 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f413c02e340 con 0x7f413c075270 2024-08-20T04:59:45.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.469+0000 7f4140a00640 1 -- 172.21.15.37:0/2120159990 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) ==== 81+0+590 (secure 0 0 0) 0x7f412c0af6f0 con 0x7f413c075270 2024-08-20T04:59:45.470 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/4282140105 2024-08-21T04:51:27.877907+0000 2024-08-20T04:59:45.470 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1217599998 2024-08-21T04:51:27.877907+0000 2024-08-20T04:59:45.470 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/1372988755 2024-08-21T04:51:27.877907+0000 2024-08-20T04:59:45.470 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3737412906 2024-08-21T04:51:27.877907+0000 2024-08-20T04:59:45.470 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/2577159152 2024-08-21T04:50:59.520912+0000 2024-08-20T04:59:45.470 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/2577159152 2024-08-21T04:50:59.520912+0000 2024-08-20T04:59:45.470 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/1372988755 2024-08-21T04:51:27.877907+0000 2024-08-20T04:59:45.470 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/58912454 2024-08-21T04:50:59.520912+0000 2024-08-20T04:59:45.471 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2105948300 2024-08-21T04:50:59.520912+0000 2024-08-20T04:59:45.471 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1480362562 2024-08-21T04:50:59.520912+0000 2024-08-20T04:59:45.471 INFO:teuthology.orchestra.run.smithi037.stderr:listed 10 entries 2024-08-20T04:59:45.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.471+0000 7f4141e00640 1 -- 172.21.15.37:0/2120159990 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f41200b3bd0 msgr2=0x7f41200b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:45.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.471+0000 7f4141e00640 1 --2- 172.21.15.37:0/2120159990 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f41200b3bd0 0x7f41200b6090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f413c100da0 tx=0x7f4124005f90 comp rx=0 tx=0).stop 2024-08-20T04:59:45.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.471+0000 7f4141e00640 1 -- 172.21.15.37:0/2120159990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f413c075270 msgr2=0x7f413c19b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:45.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.471+0000 7f4141e00640 1 --2- 172.21.15.37:0/2120159990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f413c075270 0x7f413c19b220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f412c00e9f0 tx=0x7f412c00eeb0 comp rx=0 tx=0).stop 2024-08-20T04:59:45.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.471+0000 7f4141e00640 1 -- 172.21.15.37:0/2120159990 shutdown_connections 2024-08-20T04:59:45.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.471+0000 7f4141e00640 1 --2- 172.21.15.37:0/2120159990 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f41200b3bd0 0x7f41200b6090 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:45.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.471+0000 7f4141e00640 1 --2- 172.21.15.37:0/2120159990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f413c10f0d0 0x7f413c1a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:45.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.471+0000 7f4141e00640 1 --2- 172.21.15.37:0/2120159990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f413c075c70 0x7f413c19b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:45.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.471+0000 7f4141e00640 1 --2- 172.21.15.37:0/2120159990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f413c075270 0x7f413c19b220 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:45.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.471+0000 7f4141e00640 1 -- 172.21.15.37:0/2120159990 >> 172.21.15.37:0/2120159990 conn(0x7f413c0fe500 msgr2=0x7f413c0ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:45.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.471+0000 7f4141e00640 1 -- 172.21.15.37:0/2120159990 shutdown_connections 2024-08-20T04:59:45.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:45.471+0000 7f4141e00640 1 -- 172.21.15.37:0/2120159990 wait complete. 2024-08-20T04:59:46.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:46 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2120159990' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T04:59:46.350 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T04:59:46.350 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-20T04:59:46.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:46 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2120159990' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T04:59:46.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd blocklist ls 2024-08-20T04:59:46.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:46 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2120159990' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T04:59:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:47.245 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:47 smithi037 ceph-mon[17265]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-08-20T04:59:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.358+0000 7f1d05400640 1 -- 172.21.15.37:0/2639335435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d00108e40 msgr2=0x7f1d0010f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.358+0000 7f1d05400640 1 --2- 172.21.15.37:0/2639335435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d00108e40 0x7f1d0010f640 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009ca0 tx=0x7f1cf802a8c0 comp rx=0 tx=0).stop 2024-08-20T04:59:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.358+0000 7f1d05400640 1 -- 172.21.15.37:0/2639335435 shutdown_connections 2024-08-20T04:59:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.358+0000 7f1d05400640 1 --2- 172.21.15.37:0/2639335435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d00108e40 0x7f1d0010f640 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.358+0000 7f1d05400640 1 --2- 172.21.15.37:0/2639335435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d001084c0 0x7f1d00108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.358+0000 7f1d05400640 1 --2- 172.21.15.37:0/2639335435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d00102ab0 0x7f1d00102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.358+0000 7f1d05400640 1 -- 172.21.15.37:0/2639335435 >> 172.21.15.37:0/2639335435 conn(0x7f1d000fe500 msgr2=0x7f1d00100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.359+0000 7f1d05400640 1 -- 172.21.15.37:0/2639335435 shutdown_connections 2024-08-20T04:59:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.359+0000 7f1d05400640 1 -- 172.21.15.37:0/2639335435 wait complete. 2024-08-20T04:59:47.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.360+0000 7f1d05400640 1 Processor -- start 2024-08-20T04:59:47.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.360+0000 7f1d05400640 1 -- start start 2024-08-20T04:59:47.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.360+0000 7f1d05400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d00102ab0 0x7f1d0019b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:47.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.360+0000 7f1d05400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d001084c0 0x7f1d0019b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:47.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.361+0000 7f1d05400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d00108e40 0x7f1d001a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:47.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.361+0000 7f1d05400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1d00112b10 con 0x7f1d001084c0 2024-08-20T04:59:47.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.361+0000 7f1d05400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1d00112990 con 0x7f1d00102ab0 2024-08-20T04:59:47.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.361+0000 7f1d05400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1d00112c90 con 0x7f1d00108e40 2024-08-20T04:59:47.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.361+0000 7f1cfde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d001084c0 0x7f1d0019b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:47.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.361+0000 7f1cfde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d001084c0 0x7f1d0019b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57006/0 (socket says 172.21.15.37:57006) 2024-08-20T04:59:47.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.361+0000 7f1cfde00640 1 -- 172.21.15.37:0/2550974268 learned_addr learned my addr 172.21.15.37:0/2550974268 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:47.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.361+0000 7f1cff200640 1 --2- 172.21.15.37:0/2550974268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d00108e40 0x7f1d001a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:47.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.361+0000 7f1cfe800640 1 --2- 172.21.15.37:0/2550974268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d00102ab0 0x7f1d0019b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:47.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.361+0000 7f1cfde00640 1 -- 172.21.15.37:0/2550974268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d00108e40 msgr2=0x7f1d001a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.361+0000 7f1cfde00640 1 --2- 172.21.15.37:0/2550974268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d00108e40 0x7f1d001a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.361+0000 7f1cfde00640 1 -- 172.21.15.37:0/2550974268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d00102ab0 msgr2=0x7f1d0019b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.361+0000 7f1cfde00640 1 --2- 172.21.15.37:0/2550974268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d00102ab0 0x7f1d0019b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.361+0000 7f1cfde00640 1 -- 172.21.15.37:0/2550974268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d001a1290 con 0x7f1d001084c0 2024-08-20T04:59:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.361+0000 7f1cff200640 1 --2- 172.21.15.37:0/2550974268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d00108e40 0x7f1d001a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:59:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.362+0000 7f1cfde00640 1 --2- 172.21.15.37:0/2550974268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d001084c0 0x7f1d0019b720 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00e9f0 tx=0x7f1cec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.362+0000 7f1cf7400640 1 -- 172.21.15.37:0/2550974268 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00cd80 con 0x7f1d001084c0 2024-08-20T04:59:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.362+0000 7f1cf7400640 1 -- 172.21.15.37:0/2550974268 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cec0108e0 con 0x7f1d001084c0 2024-08-20T04:59:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.362+0000 7f1cf7400640 1 -- 172.21.15.37:0/2550974268 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cec018980 con 0x7f1d001084c0 2024-08-20T04:59:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.362+0000 7f1d05400640 1 -- 172.21.15.37:0/2550974268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d001a1580 con 0x7f1d001084c0 2024-08-20T04:59:47.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.362+0000 7f1d05400640 1 -- 172.21.15.37:0/2550974268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d001a7c40 con 0x7f1d001084c0 2024-08-20T04:59:47.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.363+0000 7f1d05400640 1 -- 172.21.15.37:0/2550974268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d00102e90 con 0x7f1d001084c0 2024-08-20T04:59:47.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:47 smithi135 ceph-mon[22342]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-08-20T04:59:47.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.365+0000 7f1cf7400640 1 -- 172.21.15.37:0/2550974268 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f1cec010430 con 0x7f1d001084c0 2024-08-20T04:59:47.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.367+0000 7f1cf7400640 1 --2- 172.21.15.37:0/2550974268 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ce40b3c50 0x7f1ce40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:47.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.367+0000 7f1cf7400640 1 -- 172.21.15.37:0/2550974268 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f1cec0e4090 con 0x7f1d001084c0 2024-08-20T04:59:47.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.367+0000 7f1cfe800640 1 --2- 172.21.15.37:0/2550974268 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ce40b3c50 0x7f1ce40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:47.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.368+0000 7f1cfe800640 1 --2- 172.21.15.37:0/2550974268 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ce40b3c50 0x7f1ce40b6110 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00095f0 tx=0x7f1cf0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:47.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.371+0000 7f1cf7400640 1 -- 172.21.15.37:0/2550974268 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f1cec0aadf0 con 0x7f1d001084c0 2024-08-20T04:59:47.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:47 smithi130 ceph-mon[22007]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-08-20T04:59:47.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.578+0000 7f1d05400640 1 -- 172.21.15.37:0/2550974268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1d001a8010 con 0x7f1d001084c0 2024-08-20T04:59:47.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.579+0000 7f1cf7400640 1 -- 172.21.15.37:0/2550974268 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) ==== 81+0+590 (secure 0 0 0) 0x7f1cec0af340 con 0x7f1d001084c0 2024-08-20T04:59:47.580 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/4282140105 2024-08-21T04:51:27.877907+0000 2024-08-20T04:59:47.580 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1217599998 2024-08-21T04:51:27.877907+0000 2024-08-20T04:59:47.580 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/1372988755 2024-08-21T04:51:27.877907+0000 2024-08-20T04:59:47.581 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3737412906 2024-08-21T04:51:27.877907+0000 2024-08-20T04:59:47.581 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/2577159152 2024-08-21T04:50:59.520912+0000 2024-08-20T04:59:47.581 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/2577159152 2024-08-21T04:50:59.520912+0000 2024-08-20T04:59:47.581 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/1372988755 2024-08-21T04:51:27.877907+0000 2024-08-20T04:59:47.581 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/58912454 2024-08-21T04:50:59.520912+0000 2024-08-20T04:59:47.581 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2105948300 2024-08-21T04:50:59.520912+0000 2024-08-20T04:59:47.581 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1480362562 2024-08-21T04:50:59.520912+0000 2024-08-20T04:59:47.581 INFO:teuthology.orchestra.run.smithi037.stderr:listed 10 entries 2024-08-20T04:59:47.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.581+0000 7f1d05400640 1 -- 172.21.15.37:0/2550974268 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ce40b3c50 msgr2=0x7f1ce40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:47.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.581+0000 7f1d05400640 1 --2- 172.21.15.37:0/2550974268 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ce40b3c50 0x7f1ce40b6110 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1cf00095f0 tx=0x7f1cf0005f90 comp rx=0 tx=0).stop 2024-08-20T04:59:47.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.581+0000 7f1d05400640 1 -- 172.21.15.37:0/2550974268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d001084c0 msgr2=0x7f1d0019b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:47.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.581+0000 7f1d05400640 1 --2- 172.21.15.37:0/2550974268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d001084c0 0x7f1d0019b720 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00e9f0 tx=0x7f1cec00eeb0 comp rx=0 tx=0).stop 2024-08-20T04:59:47.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.581+0000 7f1d05400640 1 -- 172.21.15.37:0/2550974268 shutdown_connections 2024-08-20T04:59:47.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.581+0000 7f1d05400640 1 --2- 172.21.15.37:0/2550974268 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ce40b3c50 0x7f1ce40b6110 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:47.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.581+0000 7f1d05400640 1 --2- 172.21.15.37:0/2550974268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1d00108e40 0x7f1d001a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:47.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.581+0000 7f1d05400640 1 --2- 172.21.15.37:0/2550974268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d001084c0 0x7f1d0019b720 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:47.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.581+0000 7f1d05400640 1 --2- 172.21.15.37:0/2550974268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1d00102ab0 0x7f1d0019b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:47.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.581+0000 7f1d05400640 1 -- 172.21.15.37:0/2550974268 >> 172.21.15.37:0/2550974268 conn(0x7f1d000fe500 msgr2=0x7f1d000750b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:47.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.582+0000 7f1d05400640 1 -- 172.21.15.37:0/2550974268 shutdown_connections 2024-08-20T04:59:47.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:47.582+0000 7f1d05400640 1 -- 172.21.15.37:0/2550974268 wait complete. 2024-08-20T04:59:48.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:48 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2550974268' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T04:59:48.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:48 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2550974268' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T04:59:48.370 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2024-08-20T04:59:48.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T04:59:48.370 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-08-20T04:59:48.425 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[64249]: fuse finished with error 0 and tester_r 0 2024-08-20T04:59:48.429 INFO:teuthology.orchestra.run:waiting for 300 2024-08-20T04:59:48.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:48 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2550974268' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T04:59:49.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:49 smithi135 ceph-mon[22342]: pgmap v324: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-08-20T04:59:49.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:49 smithi130 ceph-mon[22007]: pgmap v324: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-08-20T04:59:49.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:49 smithi037 ceph-mon[17265]: pgmap v324: 129 pgs: 129 active+clean; 579 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-08-20T04:59:51.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:51 smithi135 ceph-mon[22342]: pgmap v325: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-20T04:59:51.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:51 smithi130 ceph-mon[22007]: pgmap v325: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-20T04:59:51.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:51 smithi037 ceph-mon[17265]: pgmap v325: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-20T04:59:53.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:53 smithi135 ceph-mon[22342]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-20T04:59:53.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:53 smithi130 ceph-mon[22007]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-20T04:59:53.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:53 smithi037 ceph-mon[17265]: pgmap v326: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-20T04:59:54.530 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-08-20T04:59:54.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T04:59:54.530 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-08-20T04:59:54.579 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T04:59:54.976 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:55.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:55 smithi135 ceph-mon[22342]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-20T04:59:55.378 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:55 smithi037 ceph-mon[17265]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-20T04:59:55.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:55 smithi130 ceph-mon[22007]: pgmap v327: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-20T04:59:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.490+0000 7f9255200640 1 -- 172.21.15.37:0/3968257703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9250108cb0 msgr2=0x7f925010f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.490+0000 7f9255200640 1 --2- 172.21.15.37:0/3968257703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9250108cb0 0x7f925010f4b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9248009ca0 tx=0x7f924802a8c0 comp rx=0 tx=0).stop 2024-08-20T04:59:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.490+0000 7f9255200640 1 -- 172.21.15.37:0/3968257703 shutdown_connections 2024-08-20T04:59:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.490+0000 7f9255200640 1 --2- 172.21.15.37:0/3968257703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9250108cb0 0x7f925010f4b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.490+0000 7f9255200640 1 --2- 172.21.15.37:0/3968257703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9250108330 0x7f9250108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.490+0000 7f9255200640 1 --2- 172.21.15.37:0/3968257703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9250102920 0x7f9250102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.490+0000 7f9255200640 1 -- 172.21.15.37:0/3968257703 >> 172.21.15.37:0/3968257703 conn(0x7f92500fe350 msgr2=0x7f9250100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.490+0000 7f9255200640 1 -- 172.21.15.37:0/3968257703 shutdown_connections 2024-08-20T04:59:55.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.490+0000 7f9255200640 1 -- 172.21.15.37:0/3968257703 wait complete. 2024-08-20T04:59:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.491+0000 7f9255200640 1 Processor -- start 2024-08-20T04:59:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.491+0000 7f9255200640 1 -- start start 2024-08-20T04:59:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.492+0000 7f9255200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9250102920 0x7f925019aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.492+0000 7f9255200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9250108330 0x7f925019b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.492+0000 7f9255200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9250108cb0 0x7f92501a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.492+0000 7f9255200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f92501129c0 con 0x7f9250108cb0 2024-08-20T04:59:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.492+0000 7f9255200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9250112840 con 0x7f9250108330 2024-08-20T04:59:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.492+0000 7f9255200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9250112b40 con 0x7f9250102920 2024-08-20T04:59:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.492+0000 7f924fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9250108cb0 0x7f92501a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.492+0000 7f924fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9250108cb0 0x7f92501a07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53818/0 (socket says 172.21.15.37:53818) 2024-08-20T04:59:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.492+0000 7f924fe00640 1 -- 172.21.15.37:0/345688191 learned_addr learned my addr 172.21.15.37:0/345688191 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.492+0000 7f924f400640 1 --2- 172.21.15.37:0/345688191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9250102920 0x7f925019aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:55.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.492+0000 7f9247e00640 1 --2- 172.21.15.37:0/345688191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9250108330 0x7f925019b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.493+0000 7f924fe00640 1 -- 172.21.15.37:0/345688191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9250102920 msgr2=0x7f925019aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.493+0000 7f924fe00640 1 --2- 172.21.15.37:0/345688191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9250102920 0x7f925019aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.493+0000 7f924fe00640 1 -- 172.21.15.37:0/345688191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9250108330 msgr2=0x7f925019b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.493+0000 7f924fe00640 1 --2- 172.21.15.37:0/345688191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9250108330 0x7f925019b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.493+0000 7f924fe00640 1 -- 172.21.15.37:0/345688191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92501a0fa0 con 0x7f9250108cb0 2024-08-20T04:59:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.493+0000 7f924fe00640 1 --2- 172.21.15.37:0/345688191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9250108cb0 0x7f92501a07d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f924802f540 tx=0x7f92480316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.493+0000 7f924cc00640 1 -- 172.21.15.37:0/345688191 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9248003b70 con 0x7f9250108cb0 2024-08-20T04:59:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.493+0000 7f9255200640 1 -- 172.21.15.37:0/345688191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92501a1230 con 0x7f9250108cb0 2024-08-20T04:59:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.493+0000 7f9255200640 1 -- 172.21.15.37:0/345688191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92501a7950 con 0x7f9250108cb0 2024-08-20T04:59:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.493+0000 7f924cc00640 1 -- 172.21.15.37:0/345688191 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9248003d10 con 0x7f9250108cb0 2024-08-20T04:59:55.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.493+0000 7f924cc00640 1 -- 172.21.15.37:0/345688191 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924802f990 con 0x7f9250108cb0 2024-08-20T04:59:55.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.495+0000 7f9255200640 1 -- 172.21.15.37:0/345688191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9250102d00 con 0x7f9250108cb0 2024-08-20T04:59:55.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.497+0000 7f924cc00640 1 -- 172.21.15.37:0/345688191 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f924802fb30 con 0x7f9250108cb0 2024-08-20T04:59:55.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.498+0000 7f924cc00640 1 --2- 172.21.15.37:0/345688191 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f92340b3cf0 0x7f92340b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:55.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.498+0000 7f924cc00640 1 -- 172.21.15.37:0/345688191 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f92481052c0 con 0x7f9250108cb0 2024-08-20T04:59:55.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.499+0000 7f924f400640 1 --2- 172.21.15.37:0/345688191 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f92340b3cf0 0x7f92340b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:55.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.499+0000 7f924f400640 1 --2- 172.21.15.37:0/345688191 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f92340b3cf0 0x7f92340b61b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9240009bd0 tx=0x7f9240005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:55.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.500+0000 7f924cc00640 1 -- 172.21.15.37:0/345688191 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f92480cc6d0 con 0x7f9250108cb0 2024-08-20T04:59:55.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.696+0000 7f9255200640 1 -- 172.21.15.37:0/345688191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f925010eed0 con 0x7f9250108cb0 2024-08-20T04:59:55.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.699+0000 7f924cc00640 1 -- 172.21.15.37:0/345688191 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24236 (secure 0 0 0) 0x7f92480cbfd0 con 0x7f9250108cb0 2024-08-20T04:59:55.700 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:59:55.700 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","created":"2024-08-20T04:50:26.520303+0000","modified":"2024-08-20T04:59:25.866747+0000","last_up_change":"2024-08-20T04:58:12.250259+0000","last_in_change":"2024-08-20T04:57:49.724189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T04:54:16.381529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T04:59:08.598741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T04:59:10.793802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-20T04:59:19.888446+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a813e53b-68b3-43ff-a59b-aed00e98f2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6803","nonce":3569936373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6805","nonce":3569936373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6809","nonce":3569936373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6807","nonce":3569936373}]},"public_addr":"172.21.15.37:6803/3569936373","cluster_addr":"172.21.15.37:6805/3569936373","heartbeat_back_addr":"172.21.15.37:6809/3569936373","heartbeat_front_addr":"172.21.15.37:6807/3569936373","state":["exists","up"]},{"osd":1,"uuid":"c216a8d0-9685-467a-8161-700682ce617c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6801","nonce":4206461125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6803","nonce":4206461125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6807","nonce":4206461125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6805","nonce":4206461125}]},"public_addr":"172.21.15.130:6801/4206461125","cluster_addr":"172.21.15.130:6803/4206461125","heartbeat_back_addr":"172.21.15.130:6807/4206461125","heartbeat_front_addr":"172.21.15.130:6805/4206461125","state":["exists","up"]},{"osd":2,"uuid":"34402442-c652-40eb-865e-a607a28846b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6801","nonce":2653255199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6803","nonce":2653255199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6807","nonce":2653255199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6805","nonce":2653255199}]},"public_addr":"172.21.15.135:6801/2653255199","cluster_addr":"172.21.15.135:6803/2653255199","heartbeat_back_addr":"172.21.15.135:6807/2653255199","heartbeat_front_addr":"172.21.15.135:6805/2653255199","state":["exists","up"]},{"osd":3,"uuid":"ec7be9dc-96b5-4816-9065-8121baedcdc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6811","nonce":2601290990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6813","nonce":2601290990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6817","nonce":2601290990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6815","nonce":2601290990}]},"public_addr":"172.21.15.37:6811/2601290990","cluster_addr":"172.21.15.37:6813/2601290990","heartbeat_back_addr":"172.21.15.37:6817/2601290990","heartbeat_front_addr":"172.21.15.37:6815/2601290990","state":["exists","up"]},{"osd":4,"uuid":"2dbd47f9-8686-4707-8862-3c7a99a37d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6809","nonce":3542081474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6811","nonce":3542081474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6815","nonce":3542081474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6813","nonce":3542081474}]},"public_addr":"172.21.15.130:6809/3542081474","cluster_addr":"172.21.15.130:6811/3542081474","heartbeat_back_addr":"172.21.15.130:6815/3542081474","heartbeat_front_addr":"172.21.15.130:6813/3542081474","state":["exists","up"]},{"osd":5,"uuid":"9a07a137-d6b7-4aba-8678-4fd164597f27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6809","nonce":2507249148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6811","nonce":2507249148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6815","nonce":2507249148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6813","nonce":2507249148}]},"public_addr":"172.21.15.135:6809/2507249148","cluster_addr":"172.21.15.135:6811/2507249148","heartbeat_back_addr":"172.21.15.135:6815/2507249148","heartbeat_front_addr":"172.21.15.135:6813/2507249148","state":["exists","up"]},{"osd":6,"uuid":"6d6346e8-5418-4c30-9bb3-5af352b616a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6819","nonce":155932692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6821","nonce":155932692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6825","nonce":155932692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6823","nonce":155932692}]},"public_addr":"172.21.15.37:6819/155932692","cluster_addr":"172.21.15.37:6821/155932692","heartbeat_back_addr":"172.21.15.37:6825/155932692","heartbeat_front_addr":"172.21.15.37:6823/155932692","state":["exists","up"]},{"osd":7,"uuid":"c87804c2-d456-495e-b36e-33dbb3548347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6817","nonce":4148130245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6819","nonce":4148130245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6823","nonce":4148130245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6821","nonce":4148130245}]},"public_addr":"172.21.15.130:6817/4148130245","cluster_addr":"172.21.15.130:6819/4148130245","heartbeat_back_addr":"172.21.15.130:6823/4148130245","heartbeat_front_addr":"172.21.15.130:6821/4148130245","state":["exists","up"]},{"osd":8,"uuid":"a7d4c9c8-1826-4703-92ad-ded2800b4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6817","nonce":222884649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6819","nonce":222884649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6823","nonce":222884649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6821","nonce":222884649}]},"public_addr":"172.21.15.135:6817/222884649","cluster_addr":"172.21.15.135:6819/222884649","heartbeat_back_addr":"172.21.15.135:6823/222884649","heartbeat_front_addr":"172.21.15.135:6821/222884649","state":["exists","up"]},{"osd":9,"uuid":"f9e0c194-66b5-4e62-b2ae-816a4a4fffbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6827","nonce":2240773042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6829","nonce":2240773042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6833","nonce":2240773042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6831","nonce":2240773042}]},"public_addr":"172.21.15.37:6827/2240773042","cluster_addr":"172.21.15.37:6829/2240773042","heartbeat_back_addr":"172.21.15.37:6833/2240773042","heartbeat_front_addr":"172.21.15.37:6831/2240773042","state":["exists","up"]},{"osd":10,"uuid":"fa6a50a5-2b97-42d1-9b57-b5502b7083d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6825","nonce":2896730163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6827","nonce":2896730163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6831","nonce":2896730163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6829","nonce":2896730163}]},"public_addr":"172.21.15.130:6825/2896730163","cluster_addr":"172.21.15.130:6827/2896730163","heartbeat_back_addr":"172.21.15.130:6831/2896730163","heartbeat_front_addr":"172.21.15.130:6829/2896730163","state":["exists","up"]},{"osd":11,"uuid":"9a305d75-030d-41db-abfb-81bb71e8c6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6825","nonce":2532897645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6827","nonce":2532897645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6831","nonce":2532897645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6829","nonce":2532897645}]},"public_addr":"172.21.15.135:6825/2532897645","cluster_addr":"172.21.15.135:6827/2532897645","heartbeat_back_addr":"172.21.15.135:6831/2532897645","heartbeat_front_addr":"172.21.15.135:6829/2532897645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:26.455665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:51.456030+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:14.332699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:42.749386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:07.587091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:32.450249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:01.864489+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:26.830527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:51.206257+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:20.400020+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:46.329864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:58:11.086508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4282140105":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/1217599998":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/3737412906":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/58912454":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/2105948300":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/1480362562":"2024-08-21T04:50:59.520912+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T04:59:55.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.701+0000 7f9255200640 1 -- 172.21.15.37:0/345688191 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f92340b3cf0 msgr2=0x7f92340b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:55.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.701+0000 7f9255200640 1 --2- 172.21.15.37:0/345688191 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f92340b3cf0 0x7f92340b61b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9240009bd0 tx=0x7f9240005f90 comp rx=0 tx=0).stop 2024-08-20T04:59:55.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.701+0000 7f9255200640 1 -- 172.21.15.37:0/345688191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9250108cb0 msgr2=0x7f92501a07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:55.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.701+0000 7f9255200640 1 --2- 172.21.15.37:0/345688191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9250108cb0 0x7f92501a07d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f924802f540 tx=0x7f92480316f0 comp rx=0 tx=0).stop 2024-08-20T04:59:55.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.702+0000 7f9255200640 1 -- 172.21.15.37:0/345688191 shutdown_connections 2024-08-20T04:59:55.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.702+0000 7f9255200640 1 --2- 172.21.15.37:0/345688191 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f92340b3cf0 0x7f92340b61b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:55.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.702+0000 7f9255200640 1 --2- 172.21.15.37:0/345688191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9250108cb0 0x7f92501a07d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:55.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.702+0000 7f9255200640 1 --2- 172.21.15.37:0/345688191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9250108330 0x7f925019b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:55.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.702+0000 7f9255200640 1 --2- 172.21.15.37:0/345688191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9250102920 0x7f925019aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:55.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.702+0000 7f9255200640 1 -- 172.21.15.37:0/345688191 >> 172.21.15.37:0/345688191 conn(0x7f92500fe350 msgr2=0x7f92501048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:55.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.702+0000 7f9255200640 1 -- 172.21.15.37:0/345688191 shutdown_connections 2024-08-20T04:59:55.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:55.702+0000 7f9255200640 1 -- 172.21.15.37:0/345688191 wait complete. 2024-08-20T04:59:56.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:56 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/345688191' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:59:56.433 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:56 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/345688191' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:59:56.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:56 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/345688191' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:59:56.472 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T04:59:56.852 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:57.276 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:57 smithi037 ceph-mon[17265]: pgmap v328: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-08-20T04:59:57.368 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:57 smithi135 ceph-mon[22342]: pgmap v328: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-08-20T04:59:57.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.389+0000 7f0b7aa00640 1 -- 172.21.15.37:0/644340782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7410b030 msgr2=0x7f0b74111830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:57.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.389+0000 7f0b7aa00640 1 --2- 172.21.15.37:0/644340782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7410b030 0x7f0b74111830 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009900 tx=0x7f0b6c02a3f0 comp rx=0 tx=0).stop 2024-08-20T04:59:57.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.389+0000 7f0b7aa00640 1 -- 172.21.15.37:0/644340782 shutdown_connections 2024-08-20T04:59:57.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.389+0000 7f0b7aa00640 1 --2- 172.21.15.37:0/644340782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7410b030 0x7f0b74111830 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:57.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.389+0000 7f0b7aa00640 1 --2- 172.21.15.37:0/644340782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b7410a6b0 0x7f0b7410aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:57.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.389+0000 7f0b7aa00640 1 --2- 172.21.15.37:0/644340782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b74104ca0 0x7f0b74105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:57.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.389+0000 7f0b7aa00640 1 -- 172.21.15.37:0/644340782 >> 172.21.15.37:0/644340782 conn(0x7f0b74100730 msgr2=0x7f0b74102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:57.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.390+0000 7f0b7aa00640 1 -- 172.21.15.37:0/644340782 shutdown_connections 2024-08-20T04:59:57.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.390+0000 7f0b7aa00640 1 -- 172.21.15.37:0/644340782 wait complete. 2024-08-20T04:59:57.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.391+0000 7f0b7aa00640 1 Processor -- start 2024-08-20T04:59:57.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.391+0000 7f0b7aa00640 1 -- start start 2024-08-20T04:59:57.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.391+0000 7f0b7aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b74104ca0 0x7f0b7419b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:57.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.391+0000 7f0b7aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7410a6b0 0x7f0b7419b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:57.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.391+0000 7f0b7aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b7410b030 0x7f0b741a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:57.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.391+0000 7f0b7aa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b74114d00 con 0x7f0b7410a6b0 2024-08-20T04:59:57.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.391+0000 7f0b7aa00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b74114b80 con 0x7f0b74104ca0 2024-08-20T04:59:57.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.391+0000 7f0b7aa00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b74114e80 con 0x7f0b7410b030 2024-08-20T04:59:57.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.391+0000 7f0b73400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7410a6b0 0x7f0b7419b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:57.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.391+0000 7f0b73400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7410a6b0 0x7f0b7419b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53828/0 (socket says 172.21.15.37:53828) 2024-08-20T04:59:57.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.391+0000 7f0b73400640 1 -- 172.21.15.37:0/3962900906 learned_addr learned my addr 172.21.15.37:0/3962900906 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:57.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.391+0000 7f0b78a00640 1 --2- 172.21.15.37:0/3962900906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b7410b030 0x7f0b741a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:57.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.392+0000 7f0b73e00640 1 --2- 172.21.15.37:0/3962900906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b74104ca0 0x7f0b7419b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:57.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.392+0000 7f0b73400640 1 -- 172.21.15.37:0/3962900906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b7410b030 msgr2=0x7f0b741a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:57.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.392+0000 7f0b73400640 1 --2- 172.21.15.37:0/3962900906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b7410b030 0x7f0b741a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:57.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.392+0000 7f0b73400640 1 -- 172.21.15.37:0/3962900906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b74104ca0 msgr2=0x7f0b7419b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:57.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.392+0000 7f0b73400640 1 --2- 172.21.15.37:0/3962900906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b74104ca0 0x7f0b7419b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:57.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.392+0000 7f0b73400640 1 -- 172.21.15.37:0/3962900906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b741a12a0 con 0x7f0b7410a6b0 2024-08-20T04:59:57.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.392+0000 7f0b73400640 1 --2- 172.21.15.37:0/3962900906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7410a6b0 0x7f0b7419b730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000e9f0 tx=0x7f0b6000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:57.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.392+0000 7f0b70c00640 1 -- 172.21.15.37:0/3962900906 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6000cd80 con 0x7f0b7410a6b0 2024-08-20T04:59:57.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.392+0000 7f0b70c00640 1 -- 172.21.15.37:0/3962900906 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b600108e0 con 0x7f0b7410a6b0 2024-08-20T04:59:57.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.392+0000 7f0b70c00640 1 -- 172.21.15.37:0/3962900906 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b60018980 con 0x7f0b7410a6b0 2024-08-20T04:59:57.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.393+0000 7f0b7aa00640 1 -- 172.21.15.37:0/3962900906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b741a1590 con 0x7f0b7410a6b0 2024-08-20T04:59:57.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.393+0000 7f0b7aa00640 1 -- 172.21.15.37:0/3962900906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b741a7c50 con 0x7f0b7410a6b0 2024-08-20T04:59:57.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.394+0000 7f0b7aa00640 1 -- 172.21.15.37:0/3962900906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b74105080 con 0x7f0b7410a6b0 2024-08-20T04:59:57.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.397+0000 7f0b70c00640 1 -- 172.21.15.37:0/3962900906 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f0b60010430 con 0x7f0b7410a6b0 2024-08-20T04:59:57.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.398+0000 7f0b70c00640 1 --2- 172.21.15.37:0/3962900906 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0b580b3bd0 0x7f0b580b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:57.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.398+0000 7f0b70c00640 1 -- 172.21.15.37:0/3962900906 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f0b600e4110 con 0x7f0b7410a6b0 2024-08-20T04:59:57.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.399+0000 7f0b73e00640 1 --2- 172.21.15.37:0/3962900906 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0b580b3bd0 0x7f0b580b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:57.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.399+0000 7f0b73e00640 1 --2- 172.21.15.37:0/3962900906 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0b580b3bd0 0x7f0b580b6090 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0b64005fd0 tx=0x7f0b64009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:57.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.402+0000 7f0b70c00640 1 -- 172.21.15.37:0/3962900906 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f0b600aae70 con 0x7f0b7410a6b0 2024-08-20T04:59:57.460 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:57 smithi130 ceph-mon[22007]: pgmap v328: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-08-20T04:59:57.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.599+0000 7f0b7aa00640 1 -- 172.21.15.37:0/3962900906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b7410c880 con 0x7f0b7410a6b0 2024-08-20T04:59:57.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.600+0000 7f0b70c00640 1 -- 172.21.15.37:0/3962900906 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24236 (secure 0 0 0) 0x7f0b600af3c0 con 0x7f0b7410a6b0 2024-08-20T04:59:57.606 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T04:59:57.611 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","created":"2024-08-20T04:50:26.520303+0000","modified":"2024-08-20T04:59:25.866747+0000","last_up_change":"2024-08-20T04:58:12.250259+0000","last_in_change":"2024-08-20T04:57:49.724189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T04:54:16.381529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T04:59:08.598741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T04:59:10.793802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-20T04:59:19.888446+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a813e53b-68b3-43ff-a59b-aed00e98f2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6803","nonce":3569936373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6805","nonce":3569936373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6809","nonce":3569936373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6807","nonce":3569936373}]},"public_addr":"172.21.15.37:6803/3569936373","cluster_addr":"172.21.15.37:6805/3569936373","heartbeat_back_addr":"172.21.15.37:6809/3569936373","heartbeat_front_addr":"172.21.15.37:6807/3569936373","state":["exists","up"]},{"osd":1,"uuid":"c216a8d0-9685-467a-8161-700682ce617c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6801","nonce":4206461125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6803","nonce":4206461125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6807","nonce":4206461125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6805","nonce":4206461125}]},"public_addr":"172.21.15.130:6801/4206461125","cluster_addr":"172.21.15.130:6803/4206461125","heartbeat_back_addr":"172.21.15.130:6807/4206461125","heartbeat_front_addr":"172.21.15.130:6805/4206461125","state":["exists","up"]},{"osd":2,"uuid":"34402442-c652-40eb-865e-a607a28846b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6801","nonce":2653255199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6803","nonce":2653255199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6807","nonce":2653255199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6805","nonce":2653255199}]},"public_addr":"172.21.15.135:6801/2653255199","cluster_addr":"172.21.15.135:6803/2653255199","heartbeat_back_addr":"172.21.15.135:6807/2653255199","heartbeat_front_addr":"172.21.15.135:6805/2653255199","state":["exists","up"]},{"osd":3,"uuid":"ec7be9dc-96b5-4816-9065-8121baedcdc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6811","nonce":2601290990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6813","nonce":2601290990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6817","nonce":2601290990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6815","nonce":2601290990}]},"public_addr":"172.21.15.37:6811/2601290990","cluster_addr":"172.21.15.37:6813/2601290990","heartbeat_back_addr":"172.21.15.37:6817/2601290990","heartbeat_front_addr":"172.21.15.37:6815/2601290990","state":["exists","up"]},{"osd":4,"uuid":"2dbd47f9-8686-4707-8862-3c7a99a37d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6809","nonce":3542081474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6811","nonce":3542081474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6815","nonce":3542081474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6813","nonce":3542081474}]},"public_addr":"172.21.15.130:6809/3542081474","cluster_addr":"172.21.15.130:6811/3542081474","heartbeat_back_addr":"172.21.15.130:6815/3542081474","heartbeat_front_addr":"172.21.15.130:6813/3542081474","state":["exists","up"]},{"osd":5,"uuid":"9a07a137-d6b7-4aba-8678-4fd164597f27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6809","nonce":2507249148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6811","nonce":2507249148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6815","nonce":2507249148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6813","nonce":2507249148}]},"public_addr":"172.21.15.135:6809/2507249148","cluster_addr":"172.21.15.135:6811/2507249148","heartbeat_back_addr":"172.21.15.135:6815/2507249148","heartbeat_front_addr":"172.21.15.135:6813/2507249148","state":["exists","up"]},{"osd":6,"uuid":"6d6346e8-5418-4c30-9bb3-5af352b616a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6819","nonce":155932692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6821","nonce":155932692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6825","nonce":155932692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6823","nonce":155932692}]},"public_addr":"172.21.15.37:6819/155932692","cluster_addr":"172.21.15.37:6821/155932692","heartbeat_back_addr":"172.21.15.37:6825/155932692","heartbeat_front_addr":"172.21.15.37:6823/155932692","state":["exists","up"]},{"osd":7,"uuid":"c87804c2-d456-495e-b36e-33dbb3548347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6817","nonce":4148130245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6819","nonce":4148130245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6823","nonce":4148130245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6821","nonce":4148130245}]},"public_addr":"172.21.15.130:6817/4148130245","cluster_addr":"172.21.15.130:6819/4148130245","heartbeat_back_addr":"172.21.15.130:6823/4148130245","heartbeat_front_addr":"172.21.15.130:6821/4148130245","state":["exists","up"]},{"osd":8,"uuid":"a7d4c9c8-1826-4703-92ad-ded2800b4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6817","nonce":222884649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6819","nonce":222884649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6823","nonce":222884649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6821","nonce":222884649}]},"public_addr":"172.21.15.135:6817/222884649","cluster_addr":"172.21.15.135:6819/222884649","heartbeat_back_addr":"172.21.15.135:6823/222884649","heartbeat_front_addr":"172.21.15.135:6821/222884649","state":["exists","up"]},{"osd":9,"uuid":"f9e0c194-66b5-4e62-b2ae-816a4a4fffbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6827","nonce":2240773042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6829","nonce":2240773042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6833","nonce":2240773042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6831","nonce":2240773042}]},"public_addr":"172.21.15.37:6827/2240773042","cluster_addr":"172.21.15.37:6829/2240773042","heartbeat_back_addr":"172.21.15.37:6833/2240773042","heartbeat_front_addr":"172.21.15.37:6831/2240773042","state":["exists","up"]},{"osd":10,"uuid":"fa6a50a5-2b97-42d1-9b57-b5502b7083d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6825","nonce":2896730163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6827","nonce":2896730163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6831","nonce":2896730163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6829","nonce":2896730163}]},"public_addr":"172.21.15.130:6825/2896730163","cluster_addr":"172.21.15.130:6827/2896730163","heartbeat_back_addr":"172.21.15.130:6831/2896730163","heartbeat_front_addr":"172.21.15.130:6829/2896730163","state":["exists","up"]},{"osd":11,"uuid":"9a305d75-030d-41db-abfb-81bb71e8c6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6825","nonce":2532897645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6827","nonce":2532897645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6831","nonce":2532897645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6829","nonce":2532897645}]},"public_addr":"172.21.15.135:6825/2532897645","cluster_addr":"172.21.15.135:6827/2532897645","heartbeat_back_addr":"172.21.15.135:6831/2532897645","heartbeat_front_addr":"172.21.15.135:6829/2532897645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:26.455665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:51.456030+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:14.332699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:42.749386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:07.587091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:32.450249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:01.864489+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:26.830527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:51.206257+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:20.400020+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:46.329864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:58:11.086508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4282140105":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/1217599998":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/3737412906":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/58912454":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/2105948300":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/1480362562":"2024-08-21T04:50:59.520912+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T04:59:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.603+0000 7f0b7aa00640 1 -- 172.21.15.37:0/3962900906 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0b580b3bd0 msgr2=0x7f0b580b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:57.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.603+0000 7f0b7aa00640 1 --2- 172.21.15.37:0/3962900906 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0b580b3bd0 0x7f0b580b6090 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0b64005fd0 tx=0x7f0b64009500 comp rx=0 tx=0).stop 2024-08-20T04:59:57.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.603+0000 7f0b7aa00640 1 -- 172.21.15.37:0/3962900906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7410a6b0 msgr2=0x7f0b7419b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:57.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.603+0000 7f0b7aa00640 1 --2- 172.21.15.37:0/3962900906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7410a6b0 0x7f0b7419b730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000e9f0 tx=0x7f0b6000eeb0 comp rx=0 tx=0).stop 2024-08-20T04:59:57.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.603+0000 7f0b7aa00640 1 -- 172.21.15.37:0/3962900906 shutdown_connections 2024-08-20T04:59:57.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.603+0000 7f0b7aa00640 1 --2- 172.21.15.37:0/3962900906 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0b580b3bd0 0x7f0b580b6090 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:57.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.603+0000 7f0b7aa00640 1 --2- 172.21.15.37:0/3962900906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b7410b030 0x7f0b741a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:57.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.603+0000 7f0b7aa00640 1 --2- 172.21.15.37:0/3962900906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7410a6b0 0x7f0b7419b730 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:57.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.603+0000 7f0b7aa00640 1 --2- 172.21.15.37:0/3962900906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b74104ca0 0x7f0b7419b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:57.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.603+0000 7f0b7aa00640 1 -- 172.21.15.37:0/3962900906 >> 172.21.15.37:0/3962900906 conn(0x7f0b74100730 msgr2=0x7f0b741010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:57.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.604+0000 7f0b7aa00640 1 -- 172.21.15.37:0/3962900906 shutdown_connections 2024-08-20T04:59:57.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:57.604+0000 7f0b7aa00640 1 -- 172.21.15.37:0/3962900906 wait complete. 2024-08-20T04:59:58.341 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:58 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3962900906' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:59:58.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:58 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3962900906' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:59:58.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-08-20T04:59:58.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:58 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3962900906' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T04:59:58.756 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T04:59:59.236 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 04:59:59 smithi037 ceph-mon[17265]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-08-20T04:59:59.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 04:59:59 smithi135 ceph-mon[22342]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-08-20T04:59:59.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.351+0000 7f8741600640 1 -- 172.21.15.37:0/2654348362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f873c075b90 msgr2=0x7f873c1132d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:59.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.351+0000 7f8741600640 1 --2- 172.21.15.37:0/2654348362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f873c075b90 0x7f873c1132d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8724009860 tx=0x7f872402a340 comp rx=0 tx=0).stop 2024-08-20T04:59:59.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.351+0000 7f8741600640 1 -- 172.21.15.37:0/2654348362 shutdown_connections 2024-08-20T04:59:59.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.351+0000 7f8741600640 1 --2- 172.21.15.37:0/2654348362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f873c113810 0x7f873c115c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:59.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.351+0000 7f8741600640 1 --2- 172.21.15.37:0/2654348362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f873c075b90 0x7f873c1132d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:59.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.351+0000 7f8741600640 1 --2- 172.21.15.37:0/2654348362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f873c075270 0x7f873c075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:59.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.351+0000 7f8741600640 1 -- 172.21.15.37:0/2654348362 >> 172.21.15.37:0/2654348362 conn(0x7f873c0fe500 msgr2=0x7f873c100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T04:59:59.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.351+0000 7f8741600640 1 -- 172.21.15.37:0/2654348362 shutdown_connections 2024-08-20T04:59:59.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.351+0000 7f8741600640 1 -- 172.21.15.37:0/2654348362 wait complete. 2024-08-20T04:59:59.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.352+0000 7f8741600640 1 Processor -- start 2024-08-20T04:59:59.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.352+0000 7f8741600640 1 -- start start 2024-08-20T04:59:59.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.353+0000 7f8741600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f873c075270 0x7f873c19f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:59.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.353+0000 7f8741600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f873c075b90 0x7f873c19fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:59.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.353+0000 7f8741600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f873c113810 0x7f873c1a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:59.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.353+0000 7f8741600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f873c119090 con 0x7f873c113810 2024-08-20T04:59:59.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.353+0000 7f8741600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f873c118f10 con 0x7f873c075b90 2024-08-20T04:59:59.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.353+0000 7f8741600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f873c119210 con 0x7f873c075270 2024-08-20T04:59:59.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.353+0000 7f873b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f873c113810 0x7f873c1a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:59.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.353+0000 7f873b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f873c113810 0x7f873c1a4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53840/0 (socket says 172.21.15.37:53840) 2024-08-20T04:59:59.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.353+0000 7f873b400640 1 -- 172.21.15.37:0/1617563630 learned_addr learned my addr 172.21.15.37:0/1617563630 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T04:59:59.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.353+0000 7f873aa00640 1 --2- 172.21.15.37:0/1617563630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f873c075270 0x7f873c19f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:59.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.353+0000 7f8732000640 1 --2- 172.21.15.37:0/1617563630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f873c075b90 0x7f873c19fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.354+0000 7f873b400640 1 -- 172.21.15.37:0/1617563630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f873c075270 msgr2=0x7f873c19f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.354+0000 7f873b400640 1 --2- 172.21.15.37:0/1617563630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f873c075270 0x7f873c19f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.354+0000 7f873b400640 1 -- 172.21.15.37:0/1617563630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f873c075b90 msgr2=0x7f873c19fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T04:59:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.354+0000 7f873b400640 1 --2- 172.21.15.37:0/1617563630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f873c075b90 0x7f873c19fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T04:59:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.354+0000 7f873b400640 1 -- 172.21.15.37:0/1617563630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873c1a5690 con 0x7f873c113810 2024-08-20T04:59:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.354+0000 7f873aa00640 1 --2- 172.21.15.37:0/1617563630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f873c075270 0x7f873c19f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T04:59:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.354+0000 7f873b400640 1 --2- 172.21.15.37:0/1617563630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f873c113810 0x7f873c1a4ec0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f873400c3f0 tx=0x7f873400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.354+0000 7f8733e00640 1 -- 172.21.15.37:0/1617563630 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8734003970 con 0x7f873c113810 2024-08-20T04:59:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.354+0000 7f8733e00640 1 -- 172.21.15.37:0/1617563630 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f873400b690 con 0x7f873c113810 2024-08-20T04:59:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.354+0000 7f8741600640 1 -- 172.21.15.37:0/1617563630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f873c1a5980 con 0x7f873c113810 2024-08-20T04:59:59.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.354+0000 7f8733e00640 1 -- 172.21.15.37:0/1617563630 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8734004380 con 0x7f873c113810 2024-08-20T04:59:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.355+0000 7f8741600640 1 -- 172.21.15.37:0/1617563630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f873c1ac040 con 0x7f873c113810 2024-08-20T04:59:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.356+0000 7f8741600640 1 -- 172.21.15.37:0/1617563630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f873c076780 con 0x7f873c113810 2024-08-20T04:59:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.359+0000 7f8733e00640 1 -- 172.21.15.37:0/1617563630 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f873401d020 con 0x7f873c113810 2024-08-20T04:59:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.361+0000 7f8733e00640 1 --2- 172.21.15.37:0/1617563630 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87200b3bd0 0x7f87200b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T04:59:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.361+0000 7f8733e00640 1 -- 172.21.15.37:0/1617563630 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f87340e4300 con 0x7f873c113810 2024-08-20T04:59:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.361+0000 7f873aa00640 1 --2- 172.21.15.37:0/1617563630 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87200b3bd0 0x7f87200b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T04:59:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.362+0000 7f873aa00640 1 --2- 172.21.15.37:0/1617563630 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87200b3bd0 0x7f87200b6090 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f872c009fc0 tx=0x7f872c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T04:59:59.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.363+0000 7f8733e00640 1 -- 172.21.15.37:0/1617563630 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f87340ab6b0 con 0x7f873c113810 2024-08-20T04:59:59.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 04:59:59 smithi130 ceph-mon[22007]: pgmap v329: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-08-20T04:59:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T04:59:59.598+0000 7f8741600640 1 -- 172.21.15.37:0/1617563630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f873c1ac2d0 con 0x7f873c113810 2024-08-20T05:00:00.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:00.098+0000 7f8733e00640 1 -- 172.21.15.37:0/1617563630 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f87340aafb0 con 0x7f873c113810 2024-08-20T05:00:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:00.101+0000 7f8741600640 1 -- 172.21.15.37:0/1617563630 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87200b3bd0 msgr2=0x7f87200b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:00.101+0000 7f8741600640 1 --2- 172.21.15.37:0/1617563630 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87200b3bd0 0x7f87200b6090 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f872c009fc0 tx=0x7f872c005f90 comp rx=0 tx=0).stop 2024-08-20T05:00:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:00.101+0000 7f8741600640 1 -- 172.21.15.37:0/1617563630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f873c113810 msgr2=0x7f873c1a4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:00.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:00.101+0000 7f8741600640 1 --2- 172.21.15.37:0/1617563630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f873c113810 0x7f873c1a4ec0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f873400c3f0 tx=0x7f873400c8b0 comp rx=0 tx=0).stop 2024-08-20T05:00:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:00.101+0000 7f8741600640 1 -- 172.21.15.37:0/1617563630 shutdown_connections 2024-08-20T05:00:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:00.101+0000 7f8741600640 1 --2- 172.21.15.37:0/1617563630 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87200b3bd0 0x7f87200b6090 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:00.101+0000 7f8741600640 1 --2- 172.21.15.37:0/1617563630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f873c113810 0x7f873c1a4ec0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:00.101+0000 7f8741600640 1 --2- 172.21.15.37:0/1617563630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f873c075b90 0x7f873c19fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:00.101+0000 7f8741600640 1 --2- 172.21.15.37:0/1617563630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f873c075270 0x7f873c19f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:00.101+0000 7f8741600640 1 -- 172.21.15.37:0/1617563630 >> 172.21.15.37:0/1617563630 conn(0x7f873c0fe500 msgr2=0x7f873c0ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:00.102+0000 7f8741600640 1 -- 172.21.15.37:0/1617563630 shutdown_connections 2024-08-20T05:00:00.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:00.102+0000 7f8741600640 1 -- 172.21.15.37:0/1617563630 wait complete. 2024-08-20T05:00:00.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:00 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1617563630' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-20T05:00:00.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:00 smithi135 ceph-mon[22342]: overall HEALTH_OK 2024-08-20T05:00:00.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:00 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1617563630' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-20T05:00:00.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:00 smithi130 ceph-mon[22007]: overall HEALTH_OK 2024-08-20T05:00:00.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:00 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1617563630' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-08-20T05:00:00.500 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:00 smithi037 ceph-mon[17265]: overall HEALTH_OK 2024-08-20T05:00:00.900 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-08-20T05:00:00.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-08-20T05:00:01.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:01 smithi037 ceph-mon[17265]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-08-20T05:00:01.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:01 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1617563630' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-20T05:00:01.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:01 smithi037 ceph-mon[17265]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T05:00:01.286 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:01.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:01 smithi135 ceph-mon[22342]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-08-20T05:00:01.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:01 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1617563630' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-20T05:00:01.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:01 smithi135 ceph-mon[22342]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T05:00:01.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:01 smithi130 ceph-mon[22007]: pgmap v330: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-08-20T05:00:01.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:01 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1617563630' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-20T05:00:01.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:01 smithi130 ceph-mon[22007]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T05:00:01.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.791+0000 7f8356800640 1 -- 172.21.15.37:0/2016236315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835010cc70 msgr2=0x7f835010f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:01.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.791+0000 7f8356800640 1 --2- 172.21.15.37:0/2016236315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835010cc70 0x7f835010f0d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8348009be0 tx=0x7f834802a6c0 comp rx=0 tx=0).stop 2024-08-20T05:00:01.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.791+0000 7f8356800640 1 -- 172.21.15.37:0/2016236315 shutdown_connections 2024-08-20T05:00:01.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.791+0000 7f8356800640 1 --2- 172.21.15.37:0/2016236315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835010cc70 0x7f835010f0d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:01.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.791+0000 7f8356800640 1 --2- 172.21.15.37:0/2016236315 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8350104130 0x7f835010c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:01.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.791+0000 7f8356800640 1 --2- 172.21.15.37:0/2016236315 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8350103810 0x7f8350103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:01.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.791+0000 7f8356800640 1 -- 172.21.15.37:0/2016236315 >> 172.21.15.37:0/2016236315 conn(0x7f83500fd2d0 msgr2=0x7f83500ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:01.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.791+0000 7f8356800640 1 -- 172.21.15.37:0/2016236315 shutdown_connections 2024-08-20T05:00:01.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.791+0000 7f8356800640 1 -- 172.21.15.37:0/2016236315 wait complete. 2024-08-20T05:00:01.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.792+0000 7f8356800640 1 Processor -- start 2024-08-20T05:00:01.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.793+0000 7f8356800640 1 -- start start 2024-08-20T05:00:01.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.793+0000 7f8356800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8350103810 0x7f8350198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:01.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.793+0000 7f8356800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8350104130 0x7f8350199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:01.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.793+0000 7f8356800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835010cc70 0x7f835019e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:01.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.793+0000 7f8356800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f83501128e0 con 0x7f8350103810 2024-08-20T05:00:01.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.793+0000 7f8356800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8350112760 con 0x7f835010cc70 2024-08-20T05:00:01.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.793+0000 7f8356800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8350112a60 con 0x7f8350104130 2024-08-20T05:00:01.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.793+0000 7f8355400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8350103810 0x7f8350198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:01.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.793+0000 7f8354a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8350104130 0x7f8350199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:01.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.793+0000 7f8355400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8350103810 0x7f8350198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53862/0 (socket says 172.21.15.37:53862) 2024-08-20T05:00:01.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.793+0000 7f8355400640 1 -- 172.21.15.37:0/274156895 learned_addr learned my addr 172.21.15.37:0/274156895 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:01.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.794+0000 7f8355e00640 1 --2- 172.21.15.37:0/274156895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835010cc70 0x7f835019e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:01.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.794+0000 7f8354a00640 1 -- 172.21.15.37:0/274156895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835010cc70 msgr2=0x7f835019e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:01.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.794+0000 7f8354a00640 1 --2- 172.21.15.37:0/274156895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835010cc70 0x7f835019e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:01.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.794+0000 7f8354a00640 1 -- 172.21.15.37:0/274156895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8350103810 msgr2=0x7f8350198cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:01.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.794+0000 7f8354a00640 1 --2- 172.21.15.37:0/274156895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8350103810 0x7f8350198cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:01.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.794+0000 7f8354a00640 1 -- 172.21.15.37:0/274156895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835019ed70 con 0x7f8350104130 2024-08-20T05:00:01.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.794+0000 7f8354a00640 1 --2- 172.21.15.37:0/274156895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8350104130 0x7f8350199200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f833c005fd0 tx=0x7f833c00ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:01.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.794+0000 7f834e000640 1 -- 172.21.15.37:0/274156895 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c00cc40 con 0x7f8350104130 2024-08-20T05:00:01.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.795+0000 7f834e000640 1 -- 172.21.15.37:0/274156895 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f833c00cde0 con 0x7f8350104130 2024-08-20T05:00:01.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.795+0000 7f834e000640 1 -- 172.21.15.37:0/274156895 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c018780 con 0x7f8350104130 2024-08-20T05:00:01.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.795+0000 7f8356800640 1 -- 172.21.15.37:0/274156895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835019f060 con 0x7f8350104130 2024-08-20T05:00:01.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.795+0000 7f8356800640 1 -- 172.21.15.37:0/274156895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83501a58f0 con 0x7f8350104130 2024-08-20T05:00:01.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.796+0000 7f8356800640 1 -- 172.21.15.37:0/274156895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f835006aeb0 con 0x7f8350104130 2024-08-20T05:00:01.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.798+0000 7f834e000640 1 -- 172.21.15.37:0/274156895 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f833c01f020 con 0x7f8350104130 2024-08-20T05:00:01.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.800+0000 7f834e000640 1 --2- 172.21.15.37:0/274156895 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83380b3cf0 0x7f83380b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:01.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.800+0000 7f834e000640 1 -- 172.21.15.37:0/274156895 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f833c0e43d0 con 0x7f8350104130 2024-08-20T05:00:01.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.800+0000 7f8355400640 1 --2- 172.21.15.37:0/274156895 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83380b3cf0 0x7f83380b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:01.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.800+0000 7f8355400640 1 --2- 172.21.15.37:0/274156895 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83380b3cf0 0x7f83380b61b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8344009cd0 tx=0x7f8344005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:01.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:01.803+0000 7f834e000640 1 -- 172.21.15.37:0/274156895 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f833c0ab780 con 0x7f8350104130 2024-08-20T05:00:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:02.045+0000 7f8356800640 1 -- 172.21.15.37:0/274156895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f8350107c90 con 0x7f8350104130 2024-08-20T05:00:02.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:02.109+0000 7f834e000640 1 -- 172.21.15.37:0/274156895 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f833c0ab080 con 0x7f8350104130 2024-08-20T05:00:02.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:02.112+0000 7f8356800640 1 -- 172.21.15.37:0/274156895 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83380b3cf0 msgr2=0x7f83380b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:02.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:02.112+0000 7f8356800640 1 --2- 172.21.15.37:0/274156895 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83380b3cf0 0x7f83380b61b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8344009cd0 tx=0x7f8344005f90 comp rx=0 tx=0).stop 2024-08-20T05:00:02.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:02.112+0000 7f8356800640 1 -- 172.21.15.37:0/274156895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8350104130 msgr2=0x7f8350199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:02.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:02.112+0000 7f8356800640 1 --2- 172.21.15.37:0/274156895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8350104130 0x7f8350199200 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f833c005fd0 tx=0x7f833c00ee50 comp rx=0 tx=0).stop 2024-08-20T05:00:02.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:02.112+0000 7f8356800640 1 -- 172.21.15.37:0/274156895 shutdown_connections 2024-08-20T05:00:02.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:02.112+0000 7f8356800640 1 --2- 172.21.15.37:0/274156895 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83380b3cf0 0x7f83380b61b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:02.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:02.112+0000 7f8356800640 1 --2- 172.21.15.37:0/274156895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835010cc70 0x7f835019e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:02.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:02.112+0000 7f8356800640 1 --2- 172.21.15.37:0/274156895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8350104130 0x7f8350199200 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:02.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:02.112+0000 7f8356800640 1 --2- 172.21.15.37:0/274156895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8350103810 0x7f8350198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:02.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:02.112+0000 7f8356800640 1 -- 172.21.15.37:0/274156895 >> 172.21.15.37:0/274156895 conn(0x7f83500fd2d0 msgr2=0x7f83500fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:02.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:02.112+0000 7f8356800640 1 -- 172.21.15.37:0/274156895 shutdown_connections 2024-08-20T05:00:02.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:02.112+0000 7f8356800640 1 -- 172.21.15.37:0/274156895 wait complete. 2024-08-20T05:00:02.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:02 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/274156895' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-20T05:00:02.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:02 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-20T05:00:02.441 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:02 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/274156895' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-20T05:00:02.441 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:02 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-20T05:00:02.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:02 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/274156895' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-20T05:00:02.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:02 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-08-20T05:00:02.820 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-08-20T05:00:03.209 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:03.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:03 smithi135 ceph-mon[22342]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T05:00:03.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:03 smithi135 ceph-mon[22342]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-20T05:00:03.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:03 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-20T05:00:03.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:03 smithi135 ceph-mon[22342]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-20T05:00:03.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:03 smithi135 ceph-mon[22342]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T05:00:03.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:03 smithi135 ceph-mon[22342]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-08-20T05:00:03.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:03 smithi135 ceph-mon[22342]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-08-20T05:00:03.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:03 smithi037 ceph-mon[17265]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T05:00:03.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:03 smithi037 ceph-mon[17265]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-20T05:00:03.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:03 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-20T05:00:03.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:03 smithi037 ceph-mon[17265]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-20T05:00:03.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:03 smithi037 ceph-mon[17265]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T05:00:03.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:03 smithi037 ceph-mon[17265]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-08-20T05:00:03.375 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:03 smithi037 ceph-mon[17265]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-08-20T05:00:03.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:03 smithi130 ceph-mon[22007]: pgmap v331: 129 pgs: 129 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T05:00:03.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:03 smithi130 ceph-mon[22007]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-20T05:00:03.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:03 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-08-20T05:00:03.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:03 smithi130 ceph-mon[22007]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-20T05:00:03.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:03 smithi130 ceph-mon[22007]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-20T05:00:03.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:03 smithi130 ceph-mon[22007]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-08-20T05:00:03.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:03 smithi130 ceph-mon[22007]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-08-20T05:00:03.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.817+0000 7f55e7400640 1 -- 172.21.15.37:0/3238007030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55e0104cb0 msgr2=0x7f55e0105090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:03.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.817+0000 7f55e7400640 1 --2- 172.21.15.37:0/3238007030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55e0104cb0 0x7f55e0105090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f55d0009be0 tx=0x7f55d002a6c0 comp rx=0 tx=0).stop 2024-08-20T05:00:03.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.817+0000 7f55e7400640 1 -- 172.21.15.37:0/3238007030 shutdown_connections 2024-08-20T05:00:03.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.817+0000 7f55e7400640 1 --2- 172.21.15.37:0/3238007030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e010b040 0x7f55e0111840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:03.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.817+0000 7f55e7400640 1 --2- 172.21.15.37:0/3238007030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55e010a6c0 0x7f55e010ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:03.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.817+0000 7f55e7400640 1 --2- 172.21.15.37:0/3238007030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55e0104cb0 0x7f55e0105090 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:03.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.817+0000 7f55e7400640 1 -- 172.21.15.37:0/3238007030 >> 172.21.15.37:0/3238007030 conn(0x7f55e0100720 msgr2=0x7f55e0102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:03.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.817+0000 7f55e7400640 1 -- 172.21.15.37:0/3238007030 shutdown_connections 2024-08-20T05:00:03.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.817+0000 7f55e7400640 1 -- 172.21.15.37:0/3238007030 wait complete. 2024-08-20T05:00:03.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.818+0000 7f55e7400640 1 Processor -- start 2024-08-20T05:00:03.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.818+0000 7f55e7400640 1 -- start start 2024-08-20T05:00:03.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.819+0000 7f55e7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e0104cb0 0x7f55e019b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:03.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.819+0000 7f55e7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55e010a6c0 0x7f55e019b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:03.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.819+0000 7f55e7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55e010b040 0x7f55e01a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:03.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.819+0000 7f55e7400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55e0114d00 con 0x7f55e0104cb0 2024-08-20T05:00:03.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.819+0000 7f55e7400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f55e0114b80 con 0x7f55e010b040 2024-08-20T05:00:03.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.819+0000 7f55e7400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55e0114e80 con 0x7f55e010a6c0 2024-08-20T05:00:03.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.819+0000 7f55e4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e0104cb0 0x7f55e019b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:03.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.819+0000 7f55e4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e0104cb0 0x7f55e019b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43596/0 (socket says 172.21.15.37:43596) 2024-08-20T05:00:03.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.819+0000 7f55e4a00640 1 -- 172.21.15.37:0/1849571997 learned_addr learned my addr 172.21.15.37:0/1849571997 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:03.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.819+0000 7f55e5400640 1 --2- 172.21.15.37:0/1849571997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55e010b040 0x7f55e01a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:03.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.819+0000 7f55d7e00640 1 --2- 172.21.15.37:0/1849571997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55e010a6c0 0x7f55e019b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:03.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.820+0000 7f55e4a00640 1 -- 172.21.15.37:0/1849571997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55e010a6c0 msgr2=0x7f55e019b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:03.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.820+0000 7f55e4a00640 1 --2- 172.21.15.37:0/1849571997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55e010a6c0 0x7f55e019b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:03.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.820+0000 7f55e4a00640 1 -- 172.21.15.37:0/1849571997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55e010b040 msgr2=0x7f55e01a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:03.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.820+0000 7f55e4a00640 1 --2- 172.21.15.37:0/1849571997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55e010b040 0x7f55e01a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:03.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.820+0000 7f55e4a00640 1 -- 172.21.15.37:0/1849571997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e01a1220 con 0x7f55e0104cb0 2024-08-20T05:00:03.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.820+0000 7f55d7e00640 1 --2- 172.21.15.37:0/1849571997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55e010a6c0 0x7f55e019b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:00:03.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.820+0000 7f55e4a00640 1 --2- 172.21.15.37:0/1849571997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e0104cb0 0x7f55e019b170 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f55d002acb0 tx=0x7f55d0003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:03.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.820+0000 7f55de000640 1 -- 172.21.15.37:0/1849571997 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d0041020 con 0x7f55e0104cb0 2024-08-20T05:00:03.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.820+0000 7f55e7400640 1 -- 172.21.15.37:0/1849571997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e01a14b0 con 0x7f55e0104cb0 2024-08-20T05:00:03.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.820+0000 7f55de000640 1 -- 172.21.15.37:0/1849571997 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55d00318f0 con 0x7f55e0104cb0 2024-08-20T05:00:03.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.820+0000 7f55de000640 1 -- 172.21.15.37:0/1849571997 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d0036040 con 0x7f55e0104cb0 2024-08-20T05:00:03.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.820+0000 7f55e7400640 1 -- 172.21.15.37:0/1849571997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e01a7bd0 con 0x7f55e0104cb0 2024-08-20T05:00:03.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.822+0000 7f55e7400640 1 -- 172.21.15.37:0/1849571997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e0105090 con 0x7f55e0104cb0 2024-08-20T05:00:03.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.824+0000 7f55de000640 1 -- 172.21.15.37:0/1849571997 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f55d0044020 con 0x7f55e0104cb0 2024-08-20T05:00:03.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.825+0000 7f55de000640 1 --2- 172.21.15.37:0/1849571997 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55c40b3c50 0x7f55c40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:03.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.825+0000 7f55de000640 1 -- 172.21.15.37:0/1849571997 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f55d01049d0 con 0x7f55e0104cb0 2024-08-20T05:00:03.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.825+0000 7f55d7e00640 1 --2- 172.21.15.37:0/1849571997 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55c40b3c50 0x7f55c40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:03.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.826+0000 7f55d7e00640 1 --2- 172.21.15.37:0/1849571997 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55c40b3c50 0x7f55c40b6110 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f55e010a150 tx=0x7f55c8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:03.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:03.829+0000 7f55de000640 1 -- 172.21.15.37:0/1849571997 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f55d004b020 con 0x7f55e0104cb0 2024-08-20T05:00:04.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:04.064+0000 7f55e7400640 1 -- 172.21.15.37:0/1849571997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f55e010c890 con 0x7f55e0104cb0 2024-08-20T05:00:04.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:04.128+0000 7f55de000640 1 -- 172.21.15.37:0/1849571997 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f55d00cbd80 con 0x7f55e0104cb0 2024-08-20T05:00:04.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:04.130+0000 7f55e7400640 1 -- 172.21.15.37:0/1849571997 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55c40b3c50 msgr2=0x7f55c40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:04.130+0000 7f55e7400640 1 --2- 172.21.15.37:0/1849571997 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55c40b3c50 0x7f55c40b6110 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f55e010a150 tx=0x7f55c8005f90 comp rx=0 tx=0).stop 2024-08-20T05:00:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:04.130+0000 7f55e7400640 1 -- 172.21.15.37:0/1849571997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e0104cb0 msgr2=0x7f55e019b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:04.130+0000 7f55e7400640 1 --2- 172.21.15.37:0/1849571997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e0104cb0 0x7f55e019b170 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f55d002acb0 tx=0x7f55d0003b80 comp rx=0 tx=0).stop 2024-08-20T05:00:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:04.130+0000 7f55e7400640 1 -- 172.21.15.37:0/1849571997 shutdown_connections 2024-08-20T05:00:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:04.130+0000 7f55e7400640 1 --2- 172.21.15.37:0/1849571997 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55c40b3c50 0x7f55c40b6110 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:04.130+0000 7f55e7400640 1 --2- 172.21.15.37:0/1849571997 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55e010b040 0x7f55e01a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:04.130+0000 7f55e7400640 1 --2- 172.21.15.37:0/1849571997 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55e010a6c0 0x7f55e019b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:04.130+0000 7f55e7400640 1 --2- 172.21.15.37:0/1849571997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55e0104cb0 0x7f55e019b170 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:04.130+0000 7f55e7400640 1 -- 172.21.15.37:0/1849571997 >> 172.21.15.37:0/1849571997 conn(0x7f55e0100720 msgr2=0x7f55e0102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:04.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:04.131+0000 7f55e7400640 1 -- 172.21.15.37:0/1849571997 shutdown_connections 2024-08-20T05:00:04.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:04.131+0000 7f55e7400640 1 -- 172.21.15.37:0/1849571997 wait complete. 2024-08-20T05:00:04.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:04 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] up:active 2024-08-20T05:00:04.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:04 smithi130 ceph-mon[22007]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-20T05:00:04.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:04 smithi130 ceph-mon[22007]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-08-20T05:00:04.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:04 smithi130 ceph-mon[22007]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-08-20T05:00:04.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:04 smithi130 ceph-mon[22007]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-08-20T05:00:04.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:04 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1849571997' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-20T05:00:04.495 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:04 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] up:active 2024-08-20T05:00:04.496 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:04 smithi037 ceph-mon[17265]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-20T05:00:04.496 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:04 smithi037 ceph-mon[17265]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-08-20T05:00:04.496 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:04 smithi037 ceph-mon[17265]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-08-20T05:00:04.496 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:04 smithi037 ceph-mon[17265]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-08-20T05:00:04.496 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:04 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1849571997' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-20T05:00:04.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:04 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] up:active 2024-08-20T05:00:04.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:04 smithi135 ceph-mon[22342]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-20T05:00:04.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:04 smithi135 ceph-mon[22342]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-08-20T05:00:04.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:04 smithi135 ceph-mon[22342]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-08-20T05:00:04.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:04 smithi135 ceph-mon[22342]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-08-20T05:00:04.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:04 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1849571997' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-08-20T05:00:04.845 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-08-20T05:00:05.230 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:05 smithi037 ceph-mon[17265]: pgmap v332: 129 pgs: 129 active+clean; 582 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2024-08-20T05:00:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:05 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1849571997' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-20T05:00:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:05 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] up:active 2024-08-20T05:00:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:05 smithi037 ceph-mon[17265]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-20T05:00:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:05 smithi037 ceph-mon[17265]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-08-20T05:00:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:05 smithi037 ceph-mon[17265]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-08-20T05:00:05.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:05 smithi037 ceph-mon[17265]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-08-20T05:00:05.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:05 smithi130 ceph-mon[22007]: pgmap v332: 129 pgs: 129 active+clean; 582 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2024-08-20T05:00:05.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:05 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1849571997' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-20T05:00:05.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:05 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] up:active 2024-08-20T05:00:05.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:05 smithi130 ceph-mon[22007]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-20T05:00:05.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:05 smithi130 ceph-mon[22007]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-08-20T05:00:05.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:05 smithi130 ceph-mon[22007]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-08-20T05:00:05.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:05 smithi130 ceph-mon[22007]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-08-20T05:00:05.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:05 smithi135 ceph-mon[22342]: pgmap v332: 129 pgs: 129 active+clean; 582 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2024-08-20T05:00:05.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:05 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1849571997' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-20T05:00:05.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:05 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] up:active 2024-08-20T05:00:05.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:05 smithi135 ceph-mon[22342]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-08-20T05:00:05.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:05 smithi135 ceph-mon[22342]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-08-20T05:00:05.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:05 smithi135 ceph-mon[22342]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-08-20T05:00:05.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:05 smithi135 ceph-mon[22342]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-08-20T05:00:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.817+0000 7fe6c3200640 1 -- 172.21.15.37:0/1188417866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6bc077d20 msgr2=0x7fe6bc113150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.817+0000 7fe6c3200640 1 --2- 172.21.15.37:0/1188417866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6bc077d20 0x7fe6bc113150 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4009900 tx=0x7fe6a402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:00:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.817+0000 7fe6c3200640 1 -- 172.21.15.37:0/1188417866 shutdown_connections 2024-08-20T05:00:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.817+0000 7fe6c3200640 1 --2- 172.21.15.37:0/1188417866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6bc113690 0x7fe6bc115a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.817+0000 7fe6c3200640 1 --2- 172.21.15.37:0/1188417866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6bc077d20 0x7fe6bc113150 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.817+0000 7fe6c3200640 1 --2- 172.21.15.37:0/1188417866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6bc077400 0x7fe6bc0777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.817+0000 7fe6c3200640 1 -- 172.21.15.37:0/1188417866 >> 172.21.15.37:0/1188417866 conn(0x7fe6bc100730 msgr2=0x7fe6bc102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.817+0000 7fe6c3200640 1 -- 172.21.15.37:0/1188417866 shutdown_connections 2024-08-20T05:00:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.817+0000 7fe6c3200640 1 -- 172.21.15.37:0/1188417866 wait complete. 2024-08-20T05:00:05.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.819+0000 7fe6c3200640 1 Processor -- start 2024-08-20T05:00:05.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.819+0000 7fe6c3200640 1 -- start start 2024-08-20T05:00:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.819+0000 7fe6c3200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6bc077400 0x7fe6bc19f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.819+0000 7fe6c3200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6bc077d20 0x7fe6bc19faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.819+0000 7fe6c3200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6bc113690 0x7fe6bc1a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.819+0000 7fe6c3200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc1190c0 con 0x7fe6bc077d20 2024-08-20T05:00:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.819+0000 7fe6c3200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc118f40 con 0x7fe6bc077400 2024-08-20T05:00:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.819+0000 7fe6c3200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe6bc119240 con 0x7fe6bc113690 2024-08-20T05:00:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.820+0000 7fe6bbe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6bc077400 0x7fe6bc19f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.820+0000 7fe6b3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6bc077d20 0x7fe6bc19faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.820+0000 7fe6bbe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6bc077400 0x7fe6bc19f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45680/0 (socket says 172.21.15.37:45680) 2024-08-20T05:00:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.820+0000 7fe6c1200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6bc113690 0x7fe6bc1a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.820+0000 7fe6bbe00640 1 -- 172.21.15.37:0/2067574308 learned_addr learned my addr 172.21.15.37:0/2067574308 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.820+0000 7fe6bbe00640 1 -- 172.21.15.37:0/2067574308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6bc113690 msgr2=0x7fe6bc1a4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.820+0000 7fe6bbe00640 1 --2- 172.21.15.37:0/2067574308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6bc113690 0x7fe6bc1a4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.820+0000 7fe6bbe00640 1 -- 172.21.15.37:0/2067574308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6bc077d20 msgr2=0x7fe6bc19faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.820+0000 7fe6bbe00640 1 --2- 172.21.15.37:0/2067574308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6bc077d20 0x7fe6bc19faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.820+0000 7fe6bbe00640 1 -- 172.21.15.37:0/2067574308 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6bc1a5660 con 0x7fe6bc077400 2024-08-20T05:00:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.820+0000 7fe6b3e00640 1 --2- 172.21.15.37:0/2067574308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6bc077d20 0x7fe6bc19faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:00:05.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.821+0000 7fe6bbe00640 1 --2- 172.21.15.37:0/2067574308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6bc077400 0x7fe6bc19f5b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00e9f0 tx=0x7fe6ac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:05.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.821+0000 7fe6b9600640 1 -- 172.21.15.37:0/2067574308 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac00cd80 con 0x7fe6bc077400 2024-08-20T05:00:05.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.821+0000 7fe6b9600640 1 -- 172.21.15.37:0/2067574308 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6ac0108e0 con 0x7fe6bc077400 2024-08-20T05:00:05.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.821+0000 7fe6c3200640 1 -- 172.21.15.37:0/2067574308 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6bc1a5950 con 0x7fe6bc077400 2024-08-20T05:00:05.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.821+0000 7fe6b9600640 1 -- 172.21.15.37:0/2067574308 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac018980 con 0x7fe6bc077400 2024-08-20T05:00:05.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.821+0000 7fe6c3200640 1 -- 172.21.15.37:0/2067574308 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6bc1ac010 con 0x7fe6bc077400 2024-08-20T05:00:05.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.822+0000 7fe6c3200640 1 -- 172.21.15.37:0/2067574308 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6bc0777e0 con 0x7fe6bc077400 2024-08-20T05:00:05.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.825+0000 7fe6b9600640 1 -- 172.21.15.37:0/2067574308 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fe6ac010430 con 0x7fe6bc077400 2024-08-20T05:00:05.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.826+0000 7fe6b9600640 1 --2- 172.21.15.37:0/2067574308 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe6a00b3bd0 0x7fe6a00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:05.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.826+0000 7fe6b9600640 1 -- 172.21.15.37:0/2067574308 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7fe6ac0e4720 con 0x7fe6bc077400 2024-08-20T05:00:05.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.827+0000 7fe6b3e00640 1 --2- 172.21.15.37:0/2067574308 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe6a00b3bd0 0x7fe6a00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:05.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.827+0000 7fe6b3e00640 1 --2- 172.21.15.37:0/2067574308 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe6a00b3bd0 0x7fe6a00b6090 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4000c00 tx=0x7fe6a4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:05.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:05.828+0000 7fe6b9600640 1 -- 172.21.15.37:0/2067574308 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe6ac0abad0 con 0x7fe6bc077400 2024-08-20T05:00:06.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:06.063+0000 7fe6c3200640 1 -- 172.21.15.37:0/2067574308 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fe6bc1a06e0 con 0x7fe6bc077400 2024-08-20T05:00:06.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:06.145+0000 7fe6b9600640 1 -- 172.21.15.37:0/2067574308 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v27) ==== 115+0+0 (secure 0 0 0) 0x7fe6ac0ab3d0 con 0x7fe6bc077400 2024-08-20T05:00:06.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:06.148+0000 7fe6c3200640 1 -- 172.21.15.37:0/2067574308 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe6a00b3bd0 msgr2=0x7fe6a00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:06.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:06.148+0000 7fe6c3200640 1 --2- 172.21.15.37:0/2067574308 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe6a00b3bd0 0x7fe6a00b6090 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe6a4000c00 tx=0x7fe6a4005a20 comp rx=0 tx=0).stop 2024-08-20T05:00:06.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:06.148+0000 7fe6c3200640 1 -- 172.21.15.37:0/2067574308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6bc077400 msgr2=0x7fe6bc19f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:06.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:06.148+0000 7fe6c3200640 1 --2- 172.21.15.37:0/2067574308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6bc077400 0x7fe6bc19f5b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00e9f0 tx=0x7fe6ac00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:00:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:06.148+0000 7fe6c3200640 1 -- 172.21.15.37:0/2067574308 shutdown_connections 2024-08-20T05:00:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:06.148+0000 7fe6c3200640 1 --2- 172.21.15.37:0/2067574308 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe6a00b3bd0 0x7fe6a00b6090 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:06.148+0000 7fe6c3200640 1 --2- 172.21.15.37:0/2067574308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe6bc113690 0x7fe6bc1a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:06.148+0000 7fe6c3200640 1 --2- 172.21.15.37:0/2067574308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6bc077d20 0x7fe6bc19faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:06.148+0000 7fe6c3200640 1 --2- 172.21.15.37:0/2067574308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe6bc077400 0x7fe6bc19f5b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:06.148+0000 7fe6c3200640 1 -- 172.21.15.37:0/2067574308 >> 172.21.15.37:0/2067574308 conn(0x7fe6bc100730 msgr2=0x7fe6bc102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:06.149+0000 7fe6c3200640 1 -- 172.21.15.37:0/2067574308 shutdown_connections 2024-08-20T05:00:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:06.149+0000 7fe6c3200640 1 -- 172.21.15.37:0/2067574308 wait complete. 2024-08-20T05:00:06.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:06 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] up:active 2024-08-20T05:00:06.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:06 smithi130 ceph-mon[22007]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-20T05:00:06.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:06 smithi130 ceph-mon[22007]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-20T05:00:06.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:06 smithi130 ceph-mon[22007]: Cluster is now healthy 2024-08-20T05:00:06.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:06 smithi130 ceph-mon[22007]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-08-20T05:00:06.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:06 smithi130 ceph-mon[22007]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-20T05:00:06.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:06 smithi130 ceph-mon[22007]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-08-20T05:00:06.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:06 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2067574308' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-20T05:00:06.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:06 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-20T05:00:06.513 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:06 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] up:active 2024-08-20T05:00:06.513 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:06 smithi037 ceph-mon[17265]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-20T05:00:06.513 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:06 smithi037 ceph-mon[17265]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-20T05:00:06.513 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:06 smithi037 ceph-mon[17265]: Cluster is now healthy 2024-08-20T05:00:06.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:06 smithi037 ceph-mon[17265]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-08-20T05:00:06.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:06 smithi037 ceph-mon[17265]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-20T05:00:06.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:06 smithi037 ceph-mon[17265]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-08-20T05:00:06.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:06 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2067574308' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-20T05:00:06.514 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:06 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-20T05:00:06.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:06 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] up:active 2024-08-20T05:00:06.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:06 smithi135 ceph-mon[22342]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-08-20T05:00:06.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:06 smithi135 ceph-mon[22342]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-20T05:00:06.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:06 smithi135 ceph-mon[22342]: Cluster is now healthy 2024-08-20T05:00:06.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:06 smithi135 ceph-mon[22342]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-08-20T05:00:06.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:06 smithi135 ceph-mon[22342]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-08-20T05:00:06.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:06 smithi135 ceph-mon[22342]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-08-20T05:00:06.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:06 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2067574308' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-20T05:00:06.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:06 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-08-20T05:00:07.051 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-08-20T05:00:07.052 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-08-20T05:00:07.145 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 05:00:06 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b[51794]: 2024-08-20T05:00:06.717+0000 7fabb9c61640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-08-20T05:00:07.446 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:07.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:07 smithi130 ceph-mon[22007]: pgmap v333: 129 pgs: 129 active+clean; 584 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 5 op/s 2024-08-20T05:00:07.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:07 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-20T05:00:07.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:07 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] up:active 2024-08-20T05:00:07.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:07 smithi130 ceph-mon[22007]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-20T05:00:07.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:07 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:00:07.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:07 smithi037 ceph-mon[17265]: pgmap v333: 129 pgs: 129 active+clean; 584 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 5 op/s 2024-08-20T05:00:07.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:07 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-20T05:00:07.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:07 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] up:active 2024-08-20T05:00:07.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:07 smithi037 ceph-mon[17265]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-20T05:00:07.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:07 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:00:07.618 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:07 smithi135 ceph-mon[22342]: pgmap v333: 129 pgs: 129 active+clean; 584 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 5 op/s 2024-08-20T05:00:07.618 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:07 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-20T05:00:07.618 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:07 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] up:active 2024-08-20T05:00:07.618 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:07 smithi135 ceph-mon[22342]: fsmap cephfs:5 7 up:standby 5 up:active 2024-08-20T05:00:07.618 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:07 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:00:08.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.084+0000 7f331c400640 1 -- 172.21.15.37:0/69803696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3314108e40 msgr2=0x7f331410f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:08.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.084+0000 7f331c400640 1 --2- 172.21.15.37:0/69803696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3314108e40 0x7f331410f640 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f330c009ca0 tx=0x7f330c02a8c0 comp rx=0 tx=0).stop 2024-08-20T05:00:08.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.084+0000 7f331c400640 1 -- 172.21.15.37:0/69803696 shutdown_connections 2024-08-20T05:00:08.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.084+0000 7f331c400640 1 --2- 172.21.15.37:0/69803696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3314108e40 0x7f331410f640 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:08.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.084+0000 7f331c400640 1 --2- 172.21.15.37:0/69803696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33141084c0 0x7f3314108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:08.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.084+0000 7f331c400640 1 --2- 172.21.15.37:0/69803696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3314102ab0 0x7f3314102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:08.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.084+0000 7f331c400640 1 -- 172.21.15.37:0/69803696 >> 172.21.15.37:0/69803696 conn(0x7f33140fe500 msgr2=0x7f3314100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:08.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.084+0000 7f331c400640 1 -- 172.21.15.37:0/69803696 shutdown_connections 2024-08-20T05:00:08.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.084+0000 7f331c400640 1 -- 172.21.15.37:0/69803696 wait complete. 2024-08-20T05:00:08.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.085+0000 7f331c400640 1 Processor -- start 2024-08-20T05:00:08.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.085+0000 7f331c400640 1 -- start start 2024-08-20T05:00:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.086+0000 7f331c400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3314102ab0 0x7f331419b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.086+0000 7f331c400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33141084c0 0x7f331419b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.086+0000 7f331c400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3314108e40 0x7f33141a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.086+0000 7f331c400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3314112b50 con 0x7f3314108e40 2024-08-20T05:00:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.086+0000 7f331c400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f33141129d0 con 0x7f3314102ab0 2024-08-20T05:00:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.086+0000 7f331c400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3314112cd0 con 0x7f33141084c0 2024-08-20T05:00:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.086+0000 7f3319000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33141084c0 0x7f331419b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.086+0000 7f3319a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3314102ab0 0x7f331419b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.086+0000 7f3319000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33141084c0 0x7f331419b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34232/0 (socket says 172.21.15.37:34232) 2024-08-20T05:00:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.086+0000 7f331a400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3314108e40 0x7f33141a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.086+0000 7f3319000640 1 -- 172.21.15.37:0/3187238866 learned_addr learned my addr 172.21.15.37:0/3187238866 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.087+0000 7f3319000640 1 -- 172.21.15.37:0/3187238866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3314102ab0 msgr2=0x7f331419b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:08.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.087+0000 7f3319000640 1 --2- 172.21.15.37:0/3187238866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3314102ab0 0x7f331419b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:08.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.087+0000 7f3319000640 1 -- 172.21.15.37:0/3187238866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3314108e40 msgr2=0x7f33141a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:08.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.087+0000 7f3319000640 1 --2- 172.21.15.37:0/3187238866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3314108e40 0x7f33141a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:08.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.087+0000 7f3319000640 1 -- 172.21.15.37:0/3187238866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33141a1290 con 0x7f33141084c0 2024-08-20T05:00:08.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.087+0000 7f3319000640 1 --2- 172.21.15.37:0/3187238866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33141084c0 0x7f331419b720 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f330000e9f0 tx=0x7f330000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:08.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.087+0000 7f3312000640 1 -- 172.21.15.37:0/3187238866 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330000cd80 con 0x7f33141084c0 2024-08-20T05:00:08.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.088+0000 7f331c400640 1 -- 172.21.15.37:0/3187238866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33141a1580 con 0x7f33141084c0 2024-08-20T05:00:08.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.088+0000 7f3312000640 1 -- 172.21.15.37:0/3187238866 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33000054d0 con 0x7f33141084c0 2024-08-20T05:00:08.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.088+0000 7f3312000640 1 -- 172.21.15.37:0/3187238866 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300010690 con 0x7f33141084c0 2024-08-20T05:00:08.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.088+0000 7f331c400640 1 -- 172.21.15.37:0/3187238866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33141a7c40 con 0x7f33141084c0 2024-08-20T05:00:08.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.089+0000 7f331c400640 1 -- 172.21.15.37:0/3187238866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3314102e90 con 0x7f33141084c0 2024-08-20T05:00:08.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.092+0000 7f3312000640 1 -- 172.21.15.37:0/3187238866 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7f3300004e90 con 0x7f33141084c0 2024-08-20T05:00:08.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.094+0000 7f3312000640 1 --2- 172.21.15.37:0/3187238866 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32fc0b3c50 0x7f32fc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:08.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.094+0000 7f3312000640 1 -- 172.21.15.37:0/3187238866 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f33000e41e0 con 0x7f33141084c0 2024-08-20T05:00:08.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.094+0000 7f3319a00640 1 --2- 172.21.15.37:0/3187238866 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32fc0b3c50 0x7f32fc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:08.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.094+0000 7f3312000640 1 -- 172.21.15.37:0/3187238866 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f33000ab590 con 0x7f33141084c0 2024-08-20T05:00:08.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.095+0000 7f3319a00640 1 --2- 172.21.15.37:0/3187238866 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32fc0b3c50 0x7f32fc0b6110 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3308009bd0 tx=0x7f3308005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:08.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.316+0000 7f331c400640 1 -- 172.21.15.37:0/3187238866 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f33140632c0 con 0x7f32fc0b3c50 2024-08-20T05:00:08.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.349+0000 7f3312000640 1 -- 172.21.15.37:0/3187238866 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f33140632c0 con 0x7f32fc0b3c50 2024-08-20T05:00:08.351 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 05:00:08 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: 2024-08-20T05:00:08.323+0000 7f4f16600640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-20T05:00:08.351 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 05:00:08 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: 2024-08-20T05:00:08.323+0000 7f4f16600640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-20T05:00:08.351 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 05:00:08 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: 2024-08-20T05:00:08.323+0000 7f4f16600640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-20T05:00:08.351 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 05:00:08 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: 2024-08-20T05:00:08.323+0000 7f4f16600640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-20T05:00:08.352 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 05:00:08 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: 2024-08-20T05:00:08.323+0000 7f4f16600640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-20T05:00:08.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.351+0000 7f331c400640 1 -- 172.21.15.37:0/3187238866 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32fc0b3c50 msgr2=0x7f32fc0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.351+0000 7f331c400640 1 --2- 172.21.15.37:0/3187238866 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32fc0b3c50 0x7f32fc0b6110 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3308009bd0 tx=0x7f3308005f90 comp rx=0 tx=0).stop 2024-08-20T05:00:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.351+0000 7f331c400640 1 -- 172.21.15.37:0/3187238866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33141084c0 msgr2=0x7f331419b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.351+0000 7f331c400640 1 --2- 172.21.15.37:0/3187238866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33141084c0 0x7f331419b720 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f330000e9f0 tx=0x7f330000edf0 comp rx=0 tx=0).stop 2024-08-20T05:00:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.352+0000 7f331c400640 1 -- 172.21.15.37:0/3187238866 shutdown_connections 2024-08-20T05:00:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.352+0000 7f331c400640 1 --2- 172.21.15.37:0/3187238866 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32fc0b3c50 0x7f32fc0b6110 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.352+0000 7f331c400640 1 --2- 172.21.15.37:0/3187238866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3314108e40 0x7f33141a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.352+0000 7f331c400640 1 --2- 172.21.15.37:0/3187238866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33141084c0 0x7f331419b720 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.352+0000 7f331c400640 1 --2- 172.21.15.37:0/3187238866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3314102ab0 0x7f331419b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.352+0000 7f331c400640 1 -- 172.21.15.37:0/3187238866 >> 172.21.15.37:0/3187238866 conn(0x7f33140fe500 msgr2=0x7f3314104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.352+0000 7f331c400640 1 -- 172.21.15.37:0/3187238866 shutdown_connections 2024-08-20T05:00:08.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:08.352+0000 7f331c400640 1 -- 172.21.15.37:0/3187238866 wait complete. 2024-08-20T05:00:09.187 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-08-20T05:00:09.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:09 smithi130 ceph-mon[22007]: pgmap v334: 129 pgs: 129 active+clean; 585 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 2.9 KiB/s wr, 9 op/s 2024-08-20T05:00:09.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:09 smithi130 ceph-mon[22007]: from='client.24868 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:00:09.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:09 smithi037 ceph-mon[17265]: pgmap v334: 129 pgs: 129 active+clean; 585 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 2.9 KiB/s wr, 9 op/s 2024-08-20T05:00:09.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:09 smithi037 ceph-mon[17265]: from='client.24868 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:00:09.587 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:09.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:09 smithi135 ceph-mon[22342]: pgmap v334: 129 pgs: 129 active+clean; 585 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 2.9 KiB/s wr, 9 op/s 2024-08-20T05:00:09.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:09 smithi135 ceph-mon[22342]: from='client.24868 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:00:10.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.134+0000 7fa2dbe00640 1 -- 172.21.15.37:0/342685678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2d4102ab0 msgr2=0x7fa2d4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:10.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.134+0000 7fa2dbe00640 1 --2- 172.21.15.37:0/342685678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2d4102ab0 0x7fa2d4102e90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009900 tx=0x7fa2c802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:00:10.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.134+0000 7fa2dbe00640 1 -- 172.21.15.37:0/342685678 shutdown_connections 2024-08-20T05:00:10.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.134+0000 7fa2dbe00640 1 --2- 172.21.15.37:0/342685678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d4108e40 0x7fa2d410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:10.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.134+0000 7fa2dbe00640 1 --2- 172.21.15.37:0/342685678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d41084c0 0x7fa2d4108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:10.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.134+0000 7fa2dbe00640 1 --2- 172.21.15.37:0/342685678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2d4102ab0 0x7fa2d4102e90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:10.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.134+0000 7fa2dbe00640 1 -- 172.21.15.37:0/342685678 >> 172.21.15.37:0/342685678 conn(0x7fa2d40fe500 msgr2=0x7fa2d4100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:10.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.134+0000 7fa2dbe00640 1 -- 172.21.15.37:0/342685678 shutdown_connections 2024-08-20T05:00:10.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.134+0000 7fa2dbe00640 1 -- 172.21.15.37:0/342685678 wait complete. 2024-08-20T05:00:10.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.135+0000 7fa2dbe00640 1 Processor -- start 2024-08-20T05:00:10.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.135+0000 7fa2dbe00640 1 -- start start 2024-08-20T05:00:10.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.135+0000 7fa2dbe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2d4102ab0 0x7fa2d4198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:10.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.135+0000 7fa2dbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d41084c0 0x7fa2d41994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:10.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.135+0000 7fa2dbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d4108e40 0x7fa2d419e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:10.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.135+0000 7fa2dbe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4112b50 con 0x7fa2d41084c0 2024-08-20T05:00:10.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.135+0000 7fa2dbe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d41129d0 con 0x7fa2d4102ab0 2024-08-20T05:00:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.135+0000 7fa2dbe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2d4112cd0 con 0x7fa2d4108e40 2024-08-20T05:00:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.136+0000 7fa2d8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d41084c0 0x7fa2d41994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.136+0000 7fa2d8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d41084c0 0x7fa2d41994e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43682/0 (socket says 172.21.15.37:43682) 2024-08-20T05:00:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.136+0000 7fa2d8a00640 1 -- 172.21.15.37:0/3444818344 learned_addr learned my addr 172.21.15.37:0/3444818344 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.136+0000 7fa2d9400640 1 --2- 172.21.15.37:0/3444818344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2d4102ab0 0x7fa2d4198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.136+0000 7fa2d9e00640 1 --2- 172.21.15.37:0/3444818344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d4108e40 0x7fa2d419e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.136+0000 7fa2d8a00640 1 -- 172.21.15.37:0/3444818344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d4108e40 msgr2=0x7fa2d419e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.136+0000 7fa2d8a00640 1 --2- 172.21.15.37:0/3444818344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d4108e40 0x7fa2d419e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:10.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.136+0000 7fa2d8a00640 1 -- 172.21.15.37:0/3444818344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2d4102ab0 msgr2=0x7fa2d4198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.136+0000 7fa2d8a00640 1 --2- 172.21.15.37:0/3444818344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2d4102ab0 0x7fa2d4198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.136+0000 7fa2d8a00640 1 -- 172.21.15.37:0/3444818344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2d419f050 con 0x7fa2d41084c0 2024-08-20T05:00:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.136+0000 7fa2d9e00640 1 --2- 172.21.15.37:0/3444818344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d4108e40 0x7fa2d419e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:00:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.136+0000 7fa2d8a00640 1 --2- 172.21.15.37:0/3444818344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d41084c0 0x7fa2d41994e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000e9f0 tx=0x7fa2c000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.137+0000 7fa2d2000640 1 -- 172.21.15.37:0/3444818344 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c000cd80 con 0x7fa2d41084c0 2024-08-20T05:00:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.137+0000 7fa2dbe00640 1 -- 172.21.15.37:0/3444818344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2d419f340 con 0x7fa2d41084c0 2024-08-20T05:00:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.137+0000 7fa2d2000640 1 -- 172.21.15.37:0/3444818344 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2c00108e0 con 0x7fa2d41084c0 2024-08-20T05:00:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.137+0000 7fa2d2000640 1 -- 172.21.15.37:0/3444818344 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0018980 con 0x7fa2d41084c0 2024-08-20T05:00:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.137+0000 7fa2dbe00640 1 -- 172.21.15.37:0/3444818344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2d41a5bd0 con 0x7fa2d41084c0 2024-08-20T05:00:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.138+0000 7fa2dbe00640 1 -- 172.21.15.37:0/3444818344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2d4103d60 con 0x7fa2d41084c0 2024-08-20T05:00:10.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.140+0000 7fa2d2000640 1 -- 172.21.15.37:0/3444818344 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) ==== 151059+0+0 (secure 0 0 0) 0x7fa2c0010430 con 0x7fa2d41084c0 2024-08-20T05:00:10.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.144+0000 7fa2d2000640 1 --2- 172.21.15.37:0/3444818344 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2bc0b3c50 0x7fa2bc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:10.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.144+0000 7fa2d2000640 1 -- 172.21.15.37:0/3444818344 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7fa2c00e4590 con 0x7fa2d41084c0 2024-08-20T05:00:10.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.144+0000 7fa2d9400640 1 --2- 172.21.15.37:0/3444818344 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2bc0b3c50 0x7fa2bc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:10.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.145+0000 7fa2d9400640 1 --2- 172.21.15.37:0/3444818344 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2bc0b3c50 0x7fa2bc0b6110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8005ab0 tx=0x7fa2c8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:10.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.146+0000 7fa2d2000640 1 -- 172.21.15.37:0/3444818344 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa2c00ab350 con 0x7fa2d41084c0 2024-08-20T05:00:10.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.166+0000 7fa2d2000640 1 -- 172.21.15.37:0/3444818344 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fa2c00a75e0 con 0x7fa2d41084c0 2024-08-20T05:00:10.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:10 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:00:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.396+0000 7fa2dbe00640 1 -- 172.21.15.37:0/3444818344 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fa2d40632c0 con 0x7fa2bc0b3c50 2024-08-20T05:00:10.398 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:10 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:00:10.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.421+0000 7fa2d2000640 1 -- 172.21.15.37:0/3444818344 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa2d40632c0 con 0x7fa2bc0b3c50 2024-08-20T05:00:10.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.423+0000 7fa2dbe00640 1 -- 172.21.15.37:0/3444818344 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2bc0b3c50 msgr2=0x7fa2bc0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:10.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.423+0000 7fa2dbe00640 1 --2- 172.21.15.37:0/3444818344 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2bc0b3c50 0x7fa2bc0b6110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8005ab0 tx=0x7fa2c8005a20 comp rx=0 tx=0).stop 2024-08-20T05:00:10.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.423+0000 7fa2dbe00640 1 -- 172.21.15.37:0/3444818344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d41084c0 msgr2=0x7fa2d41994e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:10.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.423+0000 7fa2dbe00640 1 --2- 172.21.15.37:0/3444818344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d41084c0 0x7fa2d41994e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000e9f0 tx=0x7fa2c000eeb0 comp rx=0 tx=0).stop 2024-08-20T05:00:10.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.423+0000 7fa2dbe00640 1 -- 172.21.15.37:0/3444818344 shutdown_connections 2024-08-20T05:00:10.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.423+0000 7fa2dbe00640 1 --2- 172.21.15.37:0/3444818344 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2bc0b3c50 0x7fa2bc0b6110 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:10.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.423+0000 7fa2dbe00640 1 --2- 172.21.15.37:0/3444818344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2d4108e40 0x7fa2d419e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:10.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.423+0000 7fa2dbe00640 1 --2- 172.21.15.37:0/3444818344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2d41084c0 0x7fa2d41994e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:10.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.423+0000 7fa2dbe00640 1 --2- 172.21.15.37:0/3444818344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2d4102ab0 0x7fa2d4198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:10.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.423+0000 7fa2dbe00640 1 -- 172.21.15.37:0/3444818344 >> 172.21.15.37:0/3444818344 conn(0x7fa2d40fe500 msgr2=0x7fa2d41008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:10.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.423+0000 7fa2dbe00640 1 -- 172.21.15.37:0/3444818344 shutdown_connections 2024-08-20T05:00:10.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:10.423+0000 7fa2dbe00640 1 -- 172.21.15.37:0/3444818344 wait complete. 2024-08-20T05:00:10.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:10 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:00:11.394 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-08-20T05:00:11.443 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:11 smithi037 ceph-mon[17265]: pgmap v335: 129 pgs: 129 active+clean; 593 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.8 KiB/s wr, 17 op/s 2024-08-20T05:00:11.443 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:11 smithi037 ceph-mon[17265]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-08-20T05:00:11.443 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:11 smithi037 ceph-mon[17265]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:00:11.443 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:11 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:11.443 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:11 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:11.443 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:11 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:11.444 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:11 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:11.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:11 smithi130 ceph-mon[22007]: pgmap v335: 129 pgs: 129 active+clean; 593 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.8 KiB/s wr, 17 op/s 2024-08-20T05:00:11.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:11 smithi130 ceph-mon[22007]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-08-20T05:00:11.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:11 smithi130 ceph-mon[22007]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:00:11.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:11 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:11.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:11 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:11.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:11 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:11.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:11 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:11.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:11 smithi135 ceph-mon[22342]: pgmap v335: 129 pgs: 129 active+clean; 593 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.8 KiB/s wr, 17 op/s 2024-08-20T05:00:11.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:11 smithi135 ceph-mon[22342]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-08-20T05:00:11.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:11 smithi135 ceph-mon[22342]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:00:11.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:11 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:11.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:11 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:11.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:11 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:11.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:11 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:12.109 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.741+0000 7faad8400640 1 -- 172.21.15.37:0/1503998445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faad0113690 msgr2=0x7faad0115a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.741+0000 7faad8400640 1 --2- 172.21.15.37:0/1503998445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faad0113690 0x7faad0115a80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faac8009be0 tx=0x7faac802a6c0 comp rx=0 tx=0).stop 2024-08-20T05:00:12.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.742+0000 7faad8400640 1 -- 172.21.15.37:0/1503998445 shutdown_connections 2024-08-20T05:00:12.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.742+0000 7faad8400640 1 --2- 172.21.15.37:0/1503998445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faad0113690 0x7faad0115a80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:12.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.742+0000 7faad8400640 1 --2- 172.21.15.37:0/1503998445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faad0077d20 0x7faad0113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:12.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.742+0000 7faad8400640 1 --2- 172.21.15.37:0/1503998445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faad0077400 0x7faad00777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:12.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.742+0000 7faad8400640 1 -- 172.21.15.37:0/1503998445 >> 172.21.15.37:0/1503998445 conn(0x7faad0100730 msgr2=0x7faad0102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:12.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.742+0000 7faad8400640 1 -- 172.21.15.37:0/1503998445 shutdown_connections 2024-08-20T05:00:12.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.742+0000 7faad8400640 1 -- 172.21.15.37:0/1503998445 wait complete. 2024-08-20T05:00:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.743+0000 7faad8400640 1 Processor -- start 2024-08-20T05:00:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.744+0000 7faad8400640 1 -- start start 2024-08-20T05:00:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.744+0000 7faad8400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faad0077400 0x7faad019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.744+0000 7faad8400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faad0077d20 0x7faad019fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.744+0000 7faad8400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faad0113690 0x7faad01a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:12.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.744+0000 7faad8400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faad0119060 con 0x7faad0077d20 2024-08-20T05:00:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.744+0000 7faad8400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faad0118ee0 con 0x7faad0113690 2024-08-20T05:00:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.744+0000 7faad8400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faad01191e0 con 0x7faad0077400 2024-08-20T05:00:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.744+0000 7faad5a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faad0077400 0x7faad019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.744+0000 7faad5000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faad0077d20 0x7faad019fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.744+0000 7faad5a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faad0077400 0x7faad019f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34282/0 (socket says 172.21.15.37:34282) 2024-08-20T05:00:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.744+0000 7faad5a00640 1 -- 172.21.15.37:0/2799020349 learned_addr learned my addr 172.21.15.37:0/2799020349 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:12.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.745+0000 7faad6400640 1 --2- 172.21.15.37:0/2799020349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faad0113690 0x7faad01a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.745+0000 7faad5a00640 1 -- 172.21.15.37:0/2799020349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faad0113690 msgr2=0x7faad01a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.745+0000 7faad5a00640 1 --2- 172.21.15.37:0/2799020349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faad0113690 0x7faad01a4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.745+0000 7faad5a00640 1 -- 172.21.15.37:0/2799020349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faad0077d20 msgr2=0x7faad019fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.745+0000 7faad5a00640 1 --2- 172.21.15.37:0/2799020349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faad0077d20 0x7faad019fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.745+0000 7faad5a00640 1 -- 172.21.15.37:0/2799020349 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad01a55e0 con 0x7faad0077400 2024-08-20T05:00:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.745+0000 7faad5a00640 1 --2- 172.21.15.37:0/2799020349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faad0077400 0x7faad019f530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faac400e9c0 tx=0x7faac400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.746+0000 7faace000640 1 -- 172.21.15.37:0/2799020349 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac400cde0 con 0x7faad0077400 2024-08-20T05:00:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.746+0000 7faace000640 1 -- 172.21.15.37:0/2799020349 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faac40035f0 con 0x7faad0077400 2024-08-20T05:00:12.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.746+0000 7faace000640 1 -- 172.21.15.37:0/2799020349 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac4010690 con 0x7faad0077400 2024-08-20T05:00:12.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.746+0000 7faad8400640 1 -- 172.21.15.37:0/2799020349 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad01a58d0 con 0x7faad0077400 2024-08-20T05:00:12.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.746+0000 7faad8400640 1 -- 172.21.15.37:0/2799020349 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad01abf90 con 0x7faad0077400 2024-08-20T05:00:12.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.747+0000 7faad8400640 1 -- 172.21.15.37:0/2799020349 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faad00777e0 con 0x7faad0077400 2024-08-20T05:00:12.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.749+0000 7faace000640 1 -- 172.21.15.37:0/2799020349 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7faac4004000 con 0x7faad0077400 2024-08-20T05:00:12.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.751+0000 7faace000640 1 --2- 172.21.15.37:0/2799020349 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faab80b3ce0 0x7faab80b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:12.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.751+0000 7faace000640 1 -- 172.21.15.37:0/2799020349 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7faac40e4410 con 0x7faad0077400 2024-08-20T05:00:12.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.751+0000 7faad5000640 1 --2- 172.21.15.37:0/2799020349 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faab80b3ce0 0x7faab80b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:12.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.752+0000 7faad5000640 1 --2- 172.21.15.37:0/2799020349 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faab80b3ce0 0x7faab80b61a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faad00799d0 tx=0x7faabc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:12.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.752+0000 7faace000640 1 -- 172.21.15.37:0/2799020349 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7faac40ab660 con 0x7faad0077400 2024-08-20T05:00:12.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.993+0000 7faad8400640 1 -- 172.21.15.37:0/2799020349 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7faad01152a0 con 0x7faab80b3ce0 2024-08-20T05:00:13.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:12.999+0000 7faace000640 1 -- 172.21.15.37:0/2799020349 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7faad01152a0 con 0x7faab80b3ce0 2024-08-20T05:00:13.001 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/qa/sv_0/a49312cf-7c6e-43eb-af1f-0e995dcfd2ac 2024-08-20T05:00:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:13.001+0000 7faad8400640 1 -- 172.21.15.37:0/2799020349 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faab80b3ce0 msgr2=0x7faab80b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:13.001+0000 7faad8400640 1 --2- 172.21.15.37:0/2799020349 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faab80b3ce0 0x7faab80b61a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7faad00799d0 tx=0x7faabc00b390 comp rx=0 tx=0).stop 2024-08-20T05:00:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:13.001+0000 7faad8400640 1 -- 172.21.15.37:0/2799020349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faad0077400 msgr2=0x7faad019f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:13.001+0000 7faad8400640 1 --2- 172.21.15.37:0/2799020349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faad0077400 0x7faad019f530 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faac400e9c0 tx=0x7faac400ee80 comp rx=0 tx=0).stop 2024-08-20T05:00:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:13.001+0000 7faad8400640 1 -- 172.21.15.37:0/2799020349 shutdown_connections 2024-08-20T05:00:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:13.001+0000 7faad8400640 1 --2- 172.21.15.37:0/2799020349 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faab80b3ce0 0x7faab80b61a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:13.001+0000 7faad8400640 1 --2- 172.21.15.37:0/2799020349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faad0113690 0x7faad01a4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:13.001+0000 7faad8400640 1 --2- 172.21.15.37:0/2799020349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faad0077d20 0x7faad019fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:13.001+0000 7faad8400640 1 --2- 172.21.15.37:0/2799020349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faad0077400 0x7faad019f530 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:13.001+0000 7faad8400640 1 -- 172.21.15.37:0/2799020349 >> 172.21.15.37:0/2799020349 conn(0x7faad0100730 msgr2=0x7faad0102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:13.001+0000 7faad8400640 1 -- 172.21.15.37:0/2799020349 shutdown_connections 2024-08-20T05:00:13.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:13.001+0000 7faad8400640 1 -- 172.21.15.37:0/2799020349 wait complete. 2024-08-20T05:00:13.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:13 smithi037 ceph-mon[17265]: pgmap v336: 129 pgs: 129 active+clean; 594 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.9 KiB/s wr, 19 op/s 2024-08-20T05:00:13.448 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:13 smithi135 ceph-mon[22342]: pgmap v336: 129 pgs: 129 active+clean; 594 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.9 KiB/s wr, 19 op/s 2024-08-20T05:00:13.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:13 smithi130 ceph-mon[22007]: pgmap v336: 129 pgs: 129 active+clean; 594 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 4.9 KiB/s wr, 19 op/s 2024-08-20T05:00:13.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-08-20T05:00:14.175 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:14.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:14 smithi037 ceph-mon[17265]: from='client.24886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:00:14.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:14.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:14.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:00:14.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:00:14.568 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:14.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:14 smithi135 ceph-mon[22342]: from='client.24886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:00:14.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:14.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:14.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:00:14.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:00:14.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:14.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:14 smithi130 ceph-mon[22007]: from='client.24886 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:00:14.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:14 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:14.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:14 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:14.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:14 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:00:14.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:14 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:00:14.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:14 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:00:14.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.798+0000 7fb607e00640 1 -- 172.21.15.37:0/3771775440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb608104b00 msgr2=0x7fb608104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:14.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.798+0000 7fb607e00640 1 --2- 172.21.15.37:0/3771775440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb608104b00 0x7fb608104ee0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009900 tx=0x7fb5f802a410 comp rx=0 tx=0).stop 2024-08-20T05:00:14.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.798+0000 7fb607e00640 1 -- 172.21.15.37:0/3771775440 shutdown_connections 2024-08-20T05:00:14.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.798+0000 7fb607e00640 1 --2- 172.21.15.37:0/3771775440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb60810ae90 0x7fb608111690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:14.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.798+0000 7fb607e00640 1 --2- 172.21.15.37:0/3771775440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60810a510 0x7fb60810a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:14.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.798+0000 7fb607e00640 1 --2- 172.21.15.37:0/3771775440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb608104b00 0x7fb608104ee0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:14.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.798+0000 7fb607e00640 1 -- 172.21.15.37:0/3771775440 >> 172.21.15.37:0/3771775440 conn(0x7fb608100550 msgr2=0x7fb608102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:14.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.798+0000 7fb607e00640 1 -- 172.21.15.37:0/3771775440 shutdown_connections 2024-08-20T05:00:14.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.798+0000 7fb607e00640 1 -- 172.21.15.37:0/3771775440 wait complete. 2024-08-20T05:00:14.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.799+0000 7fb607e00640 1 Processor -- start 2024-08-20T05:00:14.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.799+0000 7fb607e00640 1 -- start start 2024-08-20T05:00:14.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.800+0000 7fb607e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb608104b00 0x7fb60819af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:14.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.800+0000 7fb607e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60810a510 0x7fb60819b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:14.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.800+0000 7fb607e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb60810ae90 0x7fb6081a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:14.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.800+0000 7fb607e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb608114b50 con 0x7fb608104b00 2024-08-20T05:00:14.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.800+0000 7fb607e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb6081149d0 con 0x7fb60810ae90 2024-08-20T05:00:14.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.800+0000 7fb607e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb608114cd0 con 0x7fb60810a510 2024-08-20T05:00:14.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.800+0000 7fb606a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb608104b00 0x7fb60819af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:14.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.800+0000 7fb606a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb608104b00 0x7fb60819af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35266/0 (socket says 172.21.15.37:35266) 2024-08-20T05:00:14.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.800+0000 7fb606a00640 1 -- 172.21.15.37:0/3315007469 learned_addr learned my addr 172.21.15.37:0/3315007469 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:14.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.800+0000 7fb607400640 1 --2- 172.21.15.37:0/3315007469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb60810ae90 0x7fb6081a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:14.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.800+0000 7fb5ffe00640 1 --2- 172.21.15.37:0/3315007469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60810a510 0x7fb60819b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:14.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.800+0000 7fb606a00640 1 -- 172.21.15.37:0/3315007469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60810a510 msgr2=0x7fb60819b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:14.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.801+0000 7fb606a00640 1 --2- 172.21.15.37:0/3315007469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60810a510 0x7fb60819b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:14.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.801+0000 7fb606a00640 1 -- 172.21.15.37:0/3315007469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb60810ae90 msgr2=0x7fb6081a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:14.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.801+0000 7fb606a00640 1 --2- 172.21.15.37:0/3315007469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb60810ae90 0x7fb6081a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:14.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.801+0000 7fb606a00640 1 -- 172.21.15.37:0/3315007469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6081a1020 con 0x7fb608104b00 2024-08-20T05:00:14.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.801+0000 7fb607400640 1 --2- 172.21.15.37:0/3315007469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb60810ae90 0x7fb6081a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:00:14.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.801+0000 7fb5ffe00640 1 --2- 172.21.15.37:0/3315007469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60810a510 0x7fb60819b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:00:14.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.801+0000 7fb606a00640 1 --2- 172.21.15.37:0/3315007469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb608104b00 0x7fb60819af70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8005940 tx=0x7fb5f8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:14.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.801+0000 7fb5ff400640 1 -- 172.21.15.37:0/3315007469 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f803f030 con 0x7fb608104b00 2024-08-20T05:00:14.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.801+0000 7fb607e00640 1 -- 172.21.15.37:0/3315007469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6081a12b0 con 0x7fb608104b00 2024-08-20T05:00:14.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.801+0000 7fb5ff400640 1 -- 172.21.15.37:0/3315007469 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f8003aa0 con 0x7fb608104b00 2024-08-20T05:00:14.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.801+0000 7fb5ff400640 1 -- 172.21.15.37:0/3315007469 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8035070 con 0x7fb608104b00 2024-08-20T05:00:14.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.801+0000 7fb607e00640 1 -- 172.21.15.37:0/3315007469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6081a79d0 con 0x7fb608104b00 2024-08-20T05:00:14.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.803+0000 7fb607e00640 1 -- 172.21.15.37:0/3315007469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb608104ee0 con 0x7fb608104b00 2024-08-20T05:00:14.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.805+0000 7fb5ff400640 1 -- 172.21.15.37:0/3315007469 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fb5f8042030 con 0x7fb608104b00 2024-08-20T05:00:14.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.806+0000 7fb5ff400640 1 --2- 172.21.15.37:0/3315007469 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5ec0b3d90 0x7fb5ec0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:14.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.806+0000 7fb5ff400640 1 -- 172.21.15.37:0/3315007469 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7fb5f81046b0 con 0x7fb608104b00 2024-08-20T05:00:14.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.806+0000 7fb5ffe00640 1 --2- 172.21.15.37:0/3315007469 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5ec0b3d90 0x7fb5ec0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:14.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.807+0000 7fb5ffe00640 1 --2- 172.21.15.37:0/3315007469 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5ec0b3d90 0x7fb5ec0b6250 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb608103dc0 tx=0x7fb5f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:14.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:14.810+0000 7fb5ff400640 1 -- 172.21.15.37:0/3315007469 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fb5f80cb900 con 0x7fb608104b00 2024-08-20T05:00:15.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:15.033+0000 7fb607e00640 1 -- 172.21.15.37:0/3315007469 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb6080632c0 con 0x7fb5ec0b3d90 2024-08-20T05:00:15.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:15.059+0000 7fb5ff400640 1 -- 172.21.15.37:0/3315007469 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb6080632c0 con 0x7fb5ec0b3d90 2024-08-20T05:00:15.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:15.061+0000 7fb607e00640 1 -- 172.21.15.37:0/3315007469 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5ec0b3d90 msgr2=0x7fb5ec0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:15.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:15.061+0000 7fb607e00640 1 --2- 172.21.15.37:0/3315007469 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5ec0b3d90 0x7fb5ec0b6250 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb608103dc0 tx=0x7fb5f0005f90 comp rx=0 tx=0).stop 2024-08-20T05:00:15.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:15.061+0000 7fb607e00640 1 -- 172.21.15.37:0/3315007469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb608104b00 msgr2=0x7fb60819af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:15.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:15.061+0000 7fb607e00640 1 --2- 172.21.15.37:0/3315007469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb608104b00 0x7fb60819af70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8005940 tx=0x7fb5f8004270 comp rx=0 tx=0).stop 2024-08-20T05:00:15.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:15.061+0000 7fb607e00640 1 -- 172.21.15.37:0/3315007469 shutdown_connections 2024-08-20T05:00:15.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:15.061+0000 7fb607e00640 1 --2- 172.21.15.37:0/3315007469 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5ec0b3d90 0x7fb5ec0b6250 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:15.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:15.061+0000 7fb607e00640 1 --2- 172.21.15.37:0/3315007469 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb60810ae90 0x7fb6081a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:15.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:15.061+0000 7fb607e00640 1 --2- 172.21.15.37:0/3315007469 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb60810a510 0x7fb60819b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:15.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:15.061+0000 7fb607e00640 1 --2- 172.21.15.37:0/3315007469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb608104b00 0x7fb60819af70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:15.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:15.061+0000 7fb607e00640 1 -- 172.21.15.37:0/3315007469 >> 172.21.15.37:0/3315007469 conn(0x7fb608100550 msgr2=0x7fb608106ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:15.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:15.062+0000 7fb607e00640 1 -- 172.21.15.37:0/3315007469 shutdown_connections 2024-08-20T05:00:15.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:15.062+0000 7fb607e00640 1 -- 172.21.15.37:0/3315007469 wait complete. 2024-08-20T05:00:15.607 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:15 smithi130 ceph-mon[22007]: pgmap v337: 129 pgs: 129 active+clean; 612 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.9 KiB/s wr, 23 op/s 2024-08-20T05:00:15.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:15 smithi135 ceph-mon[22342]: pgmap v337: 129 pgs: 129 active+clean; 612 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.9 KiB/s wr, 23 op/s 2024-08-20T05:00:15.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:15 smithi037 ceph-mon[17265]: pgmap v337: 129 pgs: 129 active+clean; 612 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.9 KiB/s wr, 23 op/s 2024-08-20T05:00:15.872 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-08-20T05:00:16.254 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:16.569 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:16 smithi037 ceph-mon[17265]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:00:16.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:16 smithi135 ceph-mon[22342]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:00:16.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:16 smithi130 ceph-mon[22007]: from='client.14859 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:00:16.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.876+0000 7f0dcd800640 1 -- 172.21.15.37:0/1302829346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc8077d20 msgr2=0x7f0dc8112fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:16.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.876+0000 7f0dcd800640 1 --2- 172.21.15.37:0/1302829346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc8077d20 0x7f0dc8112fb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0db0009900 tx=0x7f0db002a3f0 comp rx=0 tx=0).stop 2024-08-20T05:00:16.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.876+0000 7f0dcd800640 1 -- 172.21.15.37:0/1302829346 shutdown_connections 2024-08-20T05:00:16.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.876+0000 7f0dcd800640 1 --2- 172.21.15.37:0/1302829346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dc81134f0 0x7f0dc81158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:16.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.876+0000 7f0dcd800640 1 --2- 172.21.15.37:0/1302829346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc8077d20 0x7f0dc8112fb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:16.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.876+0000 7f0dcd800640 1 --2- 172.21.15.37:0/1302829346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0dc8077400 0x7f0dc80777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:16.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.876+0000 7f0dcd800640 1 -- 172.21.15.37:0/1302829346 >> 172.21.15.37:0/1302829346 conn(0x7f0dc8100550 msgr2=0x7f0dc8102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:16.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.876+0000 7f0dcd800640 1 -- 172.21.15.37:0/1302829346 shutdown_connections 2024-08-20T05:00:16.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.876+0000 7f0dcd800640 1 -- 172.21.15.37:0/1302829346 wait complete. 2024-08-20T05:00:16.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.877+0000 7f0dcd800640 1 Processor -- start 2024-08-20T05:00:16.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.877+0000 7f0dcd800640 1 -- start start 2024-08-20T05:00:16.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.877+0000 7f0dcd800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc8077400 0x7f0dc819f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:16.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.877+0000 7f0dcd800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0dc8077d20 0x7f0dc819f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:16.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.877+0000 7f0dcd800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dc81134f0 0x7f0dc81a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:16.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.877+0000 7f0dcd800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc8118f50 con 0x7f0dc8077400 2024-08-20T05:00:16.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.877+0000 7f0dcd800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc8118dd0 con 0x7f0dc8077d20 2024-08-20T05:00:16.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.877+0000 7f0dcd800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc81190d0 con 0x7f0dc81134f0 2024-08-20T05:00:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.877+0000 7f0dc7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc8077400 0x7f0dc819f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.878+0000 7f0dbf400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0dc8077d20 0x7f0dc819f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.878+0000 7f0dcce00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dc81134f0 0x7f0dc81a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.878+0000 7f0dc7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc8077400 0x7f0dc819f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35280/0 (socket says 172.21.15.37:35280) 2024-08-20T05:00:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.878+0000 7f0dc7e00640 1 -- 172.21.15.37:0/2134317646 learned_addr learned my addr 172.21.15.37:0/2134317646 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.878+0000 7f0dbf400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0dc8077d20 0x7f0dc819f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47928/0 (socket says 172.21.15.37:47928) 2024-08-20T05:00:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.878+0000 7f0dbf400640 1 -- 172.21.15.37:0/2134317646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dc81134f0 msgr2=0x7f0dc81a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.878+0000 7f0dbf400640 1 --2- 172.21.15.37:0/2134317646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dc81134f0 0x7f0dc81a4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.878+0000 7f0dbf400640 1 -- 172.21.15.37:0/2134317646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc8077400 msgr2=0x7f0dc819f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.878+0000 7f0dbf400640 1 --2- 172.21.15.37:0/2134317646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc8077400 0x7f0dc819f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.878+0000 7f0dbf400640 1 -- 172.21.15.37:0/2134317646 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc81a5470 con 0x7f0dc8077d20 2024-08-20T05:00:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.878+0000 7f0dbf400640 1 --2- 172.21.15.37:0/2134317646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0dc8077d20 0x7f0dc819f900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0db002a9e0 tx=0x7f0db0003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:16.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.879+0000 7f0dc5600640 1 -- 172.21.15.37:0/2134317646 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db003f070 con 0x7f0dc8077d20 2024-08-20T05:00:16.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.879+0000 7f0dc5600640 1 -- 172.21.15.37:0/2134317646 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0db0031b50 con 0x7f0dc8077d20 2024-08-20T05:00:16.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.879+0000 7f0dc5600640 1 -- 172.21.15.37:0/2134317646 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db0035030 con 0x7f0dc8077d20 2024-08-20T05:00:16.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.879+0000 7f0dcd800640 1 -- 172.21.15.37:0/2134317646 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc81a5700 con 0x7f0dc8077d20 2024-08-20T05:00:16.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.879+0000 7f0dcd800640 1 -- 172.21.15.37:0/2134317646 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc81abe20 con 0x7f0dc8077d20 2024-08-20T05:00:16.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.880+0000 7f0dcd800640 1 -- 172.21.15.37:0/2134317646 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dc80777e0 con 0x7f0dc8077d20 2024-08-20T05:00:16.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.882+0000 7f0dc5600640 1 -- 172.21.15.37:0/2134317646 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f0db0042070 con 0x7f0dc8077d20 2024-08-20T05:00:16.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.883+0000 7f0dc5600640 1 --2- 172.21.15.37:0/2134317646 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0dac0b3d90 0x7f0dac0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:16.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.884+0000 7f0dc5600640 1 -- 172.21.15.37:0/2134317646 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f0db0104570 con 0x7f0dc8077d20 2024-08-20T05:00:16.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.884+0000 7f0dc7e00640 1 --2- 172.21.15.37:0/2134317646 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0dac0b3d90 0x7f0dac0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:16.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.884+0000 7f0dc7e00640 1 --2- 172.21.15.37:0/2134317646 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0dac0b3d90 0x7f0dac0b6250 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009c90 tx=0x7f0db8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:16.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:16.887+0000 7f0dc5600640 1 -- 172.21.15.37:0/2134317646 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f0db0031d00 con 0x7f0dc8077d20 2024-08-20T05:00:17.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:17.110+0000 7f0dcd800640 1 -- 172.21.15.37:0/2134317646 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f0dc8115580 con 0x7f0dac0b3d90 2024-08-20T05:00:17.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:17.115+0000 7f0dc5600640 1 -- 172.21.15.37:0/2134317646 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f0dc8115580 con 0x7f0dac0b3d90 2024-08-20T05:00:17.117 INFO:teuthology.orchestra.run.smithi037.stdout:/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0 2024-08-20T05:00:17.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:17.117+0000 7f0dcd800640 1 -- 172.21.15.37:0/2134317646 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0dac0b3d90 msgr2=0x7f0dac0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:17.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:17.117+0000 7f0dcd800640 1 --2- 172.21.15.37:0/2134317646 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0dac0b3d90 0x7f0dac0b6250 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0db8009c90 tx=0x7f0db8005f90 comp rx=0 tx=0).stop 2024-08-20T05:00:17.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:17.117+0000 7f0dcd800640 1 -- 172.21.15.37:0/2134317646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0dc8077d20 msgr2=0x7f0dc819f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:17.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:17.117+0000 7f0dcd800640 1 --2- 172.21.15.37:0/2134317646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0dc8077d20 0x7f0dc819f900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0db002a9e0 tx=0x7f0db0003b90 comp rx=0 tx=0).stop 2024-08-20T05:00:17.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:17.117+0000 7f0dcd800640 1 -- 172.21.15.37:0/2134317646 shutdown_connections 2024-08-20T05:00:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:17.117+0000 7f0dcd800640 1 --2- 172.21.15.37:0/2134317646 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0dac0b3d90 0x7f0dac0b6250 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:17.117+0000 7f0dcd800640 1 --2- 172.21.15.37:0/2134317646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0dc81134f0 0x7f0dc81a4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:17.117+0000 7f0dcd800640 1 --2- 172.21.15.37:0/2134317646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0dc8077d20 0x7f0dc819f900 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:17.117+0000 7f0dcd800640 1 --2- 172.21.15.37:0/2134317646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dc8077400 0x7f0dc819f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:17.117+0000 7f0dcd800640 1 -- 172.21.15.37:0/2134317646 >> 172.21.15.37:0/2134317646 conn(0x7f0dc8100550 msgr2=0x7f0dc8102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:17.117+0000 7f0dcd800640 1 -- 172.21.15.37:0/2134317646 shutdown_connections 2024-08-20T05:00:17.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:17.117+0000 7f0dcd800640 1 -- 172.21.15.37:0/2134317646 wait complete. 2024-08-20T05:00:17.483 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:17 smithi037 ceph-mon[17265]: pgmap v338: 129 pgs: 129 active+clean; 612 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.2 KiB/s wr, 22 op/s 2024-08-20T05:00:17.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:17 smithi135 ceph-mon[22342]: pgmap v338: 129 pgs: 129 active+clean; 612 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.2 KiB/s wr, 22 op/s 2024-08-20T05:00:17.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:17 smithi130 ceph-mon[22007]: pgmap v338: 129 pgs: 129 active+clean; 612 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.2 KiB/s wr, 22 op/s 2024-08-20T05:00:17.850 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:00:18.375 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:18.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:18 smithi135 ceph-mon[22342]: from='client.24893 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:00:18.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:18 smithi037 ceph-mon[17265]: from='client.24893 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:00:18.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:18 smithi130 ceph-mon[22007]: from='client.24893 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:00:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.924+0000 7fb5b2c00640 1 -- 172.21.15.37:0/3884891190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ac10a6a0 msgr2=0x7fb5ac10aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.924+0000 7fb5b2c00640 1 --2- 172.21.15.37:0/3884891190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ac10a6a0 0x7fb5ac10aae0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb598009900 tx=0x7fb59802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:00:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.924+0000 7fb5b2c00640 1 -- 172.21.15.37:0/3884891190 shutdown_connections 2024-08-20T05:00:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.924+0000 7fb5b2c00640 1 --2- 172.21.15.37:0/3884891190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5ac10b020 0x7fb5ac111820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.924+0000 7fb5b2c00640 1 --2- 172.21.15.37:0/3884891190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ac10a6a0 0x7fb5ac10aae0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.924+0000 7fb5b2c00640 1 --2- 172.21.15.37:0/3884891190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5ac104c90 0x7fb5ac105070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.924+0000 7fb5b2c00640 1 -- 172.21.15.37:0/3884891190 >> 172.21.15.37:0/3884891190 conn(0x7fb5ac1006c0 msgr2=0x7fb5ac102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.924+0000 7fb5b2c00640 1 -- 172.21.15.37:0/3884891190 shutdown_connections 2024-08-20T05:00:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.924+0000 7fb5b2c00640 1 -- 172.21.15.37:0/3884891190 wait complete. 2024-08-20T05:00:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.926+0000 7fb5b2c00640 1 Processor -- start 2024-08-20T05:00:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.926+0000 7fb5b2c00640 1 -- start start 2024-08-20T05:00:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.926+0000 7fb5b2c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5ac104c90 0x7fb5ac19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.926+0000 7fb5b2c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ac10a6a0 0x7fb5ac19b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.926+0000 7fb5b2c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5ac10b020 0x7fb5ac1a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.926+0000 7fb5b2c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac114cf0 con 0x7fb5ac10a6a0 2024-08-20T05:00:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.926+0000 7fb5b2c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac114b70 con 0x7fb5ac10b020 2024-08-20T05:00:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.926+0000 7fb5b2c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5ac114e70 con 0x7fb5ac104c90 2024-08-20T05:00:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.926+0000 7fb5ab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ac10a6a0 0x7fb5ac19b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.926+0000 7fb5abe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5ac104c90 0x7fb5ac19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.926+0000 7fb5abe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5ac104c90 0x7fb5ac19b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:39174/0 (socket says 172.21.15.37:39174) 2024-08-20T05:00:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.926+0000 7fb5abe00640 1 -- 172.21.15.37:0/623145559 learned_addr learned my addr 172.21.15.37:0/623145559 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.927+0000 7fb5b0c00640 1 --2- 172.21.15.37:0/623145559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5ac10b020 0x7fb5ac1a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.927+0000 7fb5ab400640 1 -- 172.21.15.37:0/623145559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5ac104c90 msgr2=0x7fb5ac19b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.927+0000 7fb5ab400640 1 --2- 172.21.15.37:0/623145559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5ac104c90 0x7fb5ac19b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.927+0000 7fb5ab400640 1 -- 172.21.15.37:0/623145559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5ac10b020 msgr2=0x7fb5ac1a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.927+0000 7fb5ab400640 1 --2- 172.21.15.37:0/623145559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5ac10b020 0x7fb5ac1a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.927+0000 7fb5ab400640 1 -- 172.21.15.37:0/623145559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5ac1a1250 con 0x7fb5ac10a6a0 2024-08-20T05:00:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.927+0000 7fb5b0c00640 1 --2- 172.21.15.37:0/623145559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5ac10b020 0x7fb5ac1a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:00:18.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.927+0000 7fb5ab400640 1 --2- 172.21.15.37:0/623145559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ac10a6a0 0x7fb5ac19b6e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb59802a9e0 tx=0x7fb598003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:18.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.927+0000 7fb5a8c00640 1 -- 172.21.15.37:0/623145559 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59803f070 con 0x7fb5ac10a6a0 2024-08-20T05:00:18.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.927+0000 7fb5a8c00640 1 -- 172.21.15.37:0/623145559 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb598031d60 con 0x7fb5ac10a6a0 2024-08-20T05:00:18.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.928+0000 7fb5a8c00640 1 -- 172.21.15.37:0/623145559 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598035030 con 0x7fb5ac10a6a0 2024-08-20T05:00:18.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.928+0000 7fb5b2c00640 1 -- 172.21.15.37:0/623145559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5ac1a14e0 con 0x7fb5ac10a6a0 2024-08-20T05:00:18.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.928+0000 7fb5b2c00640 1 -- 172.21.15.37:0/623145559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5ac1a7c00 con 0x7fb5ac10a6a0 2024-08-20T05:00:18.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.929+0000 7fb5b2c00640 1 -- 172.21.15.37:0/623145559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5ac105070 con 0x7fb5ac10a6a0 2024-08-20T05:00:18.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.931+0000 7fb5a8c00640 1 -- 172.21.15.37:0/623145559 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fb598042070 con 0x7fb5ac10a6a0 2024-08-20T05:00:18.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.932+0000 7fb5a8c00640 1 --2- 172.21.15.37:0/623145559 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5900b3ce0 0x7fb5900b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:18.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.932+0000 7fb5a8c00640 1 -- 172.21.15.37:0/623145559 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7fb598104d00 con 0x7fb5ac10a6a0 2024-08-20T05:00:18.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.933+0000 7fb5abe00640 1 --2- 172.21.15.37:0/623145559 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5900b3ce0 0x7fb5900b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:18.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.933+0000 7fb5abe00640 1 --2- 172.21.15.37:0/623145559 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5900b3ce0 0x7fb5900b61a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00bca0 tx=0x7fb59c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:18.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:18.934+0000 7fb5a8c00640 1 -- 172.21.15.37:0/623145559 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fb5980cbf50 con 0x7fb5ac10a6a0 2024-08-20T05:00:19.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:19.168+0000 7fb5b2c00640 1 -- 172.21.15.37:0/623145559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5ac19c2d0 con 0x7fb5ac10a6a0 2024-08-20T05:00:19.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:19.169+0000 7fb5a8c00640 1 -- 172.21.15.37:0/623145559 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11980 (secure 0 0 0) 0x7fb5ac19c2d0 con 0x7fb5ac10a6a0 2024-08-20T05:00:19.171 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:00:19.171 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"btime":"2024-08-20T05:00:06:145262+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:00:06.145248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:00:19.172 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-08-20T05:00:19.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:19.171+0000 7fb5b2c00640 1 -- 172.21.15.37:0/623145559 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5900b3ce0 msgr2=0x7fb5900b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:19.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:19.171+0000 7fb5b2c00640 1 --2- 172.21.15.37:0/623145559 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5900b3ce0 0x7fb5900b61a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00bca0 tx=0x7fb59c00b410 comp rx=0 tx=0).stop 2024-08-20T05:00:19.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:19.171+0000 7fb5b2c00640 1 -- 172.21.15.37:0/623145559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ac10a6a0 msgr2=0x7fb5ac19b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:19.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:19.171+0000 7fb5b2c00640 1 --2- 172.21.15.37:0/623145559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ac10a6a0 0x7fb5ac19b6e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb59802a9e0 tx=0x7fb598003cd0 comp rx=0 tx=0).stop 2024-08-20T05:00:19.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:19.171+0000 7fb5b2c00640 1 -- 172.21.15.37:0/623145559 shutdown_connections 2024-08-20T05:00:19.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:19.171+0000 7fb5b2c00640 1 --2- 172.21.15.37:0/623145559 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb5900b3ce0 0x7fb5900b61a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:19.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:19.171+0000 7fb5b2c00640 1 --2- 172.21.15.37:0/623145559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5ac10b020 0x7fb5ac1a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:19.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:19.171+0000 7fb5b2c00640 1 --2- 172.21.15.37:0/623145559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ac10a6a0 0x7fb5ac19b6e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:19.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:19.171+0000 7fb5b2c00640 1 --2- 172.21.15.37:0/623145559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5ac104c90 0x7fb5ac19b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:19.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:19.172+0000 7fb5b2c00640 1 -- 172.21.15.37:0/623145559 >> 172.21.15.37:0/623145559 conn(0x7fb5ac1006c0 msgr2=0x7fb5ac102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:19.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:19.172+0000 7fb5b2c00640 1 -- 172.21.15.37:0/623145559 shutdown_connections 2024-08-20T05:00:19.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:19.172+0000 7fb5b2c00640 1 -- 172.21.15.37:0/623145559 wait complete. 2024-08-20T05:00:19.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:19 smithi037 ceph-mon[17265]: pgmap v339: 129 pgs: 129 active+clean; 612 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.5 KiB/s wr, 19 op/s 2024-08-20T05:00:19.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:19 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/623145559' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:00:19.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:19 smithi135 ceph-mon[22342]: pgmap v339: 129 pgs: 129 active+clean; 612 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.5 KiB/s wr, 19 op/s 2024-08-20T05:00:19.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:19 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/623145559' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:00:19.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:19 smithi130 ceph-mon[22007]: pgmap v339: 129 pgs: 129 active+clean; 612 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.5 KiB/s wr, 19 op/s 2024-08-20T05:00:19.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:19 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/623145559' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:00:19.982 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T05:00:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:20.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.958+0000 7f42ac000640 1 -- 172.21.15.37:0/2746319833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42a41084c0 msgr2=0x7f42a4108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:20.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.958+0000 7f42ac000640 1 --2- 172.21.15.37:0/2746319833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42a41084c0 0x7f42a4108900 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4290009900 tx=0x7f429002a410 comp rx=0 tx=0).stop 2024-08-20T05:00:20.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.958+0000 7f42ac000640 1 -- 172.21.15.37:0/2746319833 shutdown_connections 2024-08-20T05:00:20.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.958+0000 7f42ac000640 1 --2- 172.21.15.37:0/2746319833 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42a4108e40 0x7f42a410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:20.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.958+0000 7f42ac000640 1 --2- 172.21.15.37:0/2746319833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42a41084c0 0x7f42a4108900 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:20.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.958+0000 7f42ac000640 1 --2- 172.21.15.37:0/2746319833 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42a4102ab0 0x7f42a4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:20.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.958+0000 7f42ac000640 1 -- 172.21.15.37:0/2746319833 >> 172.21.15.37:0/2746319833 conn(0x7f42a40fe500 msgr2=0x7f42a4100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:20.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.958+0000 7f42ac000640 1 -- 172.21.15.37:0/2746319833 shutdown_connections 2024-08-20T05:00:20.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.958+0000 7f42ac000640 1 -- 172.21.15.37:0/2746319833 wait complete. 2024-08-20T05:00:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.959+0000 7f42ac000640 1 Processor -- start 2024-08-20T05:00:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.959+0000 7f42ac000640 1 -- start start 2024-08-20T05:00:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.959+0000 7f42ac000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42a4102ab0 0x7f42a419b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.959+0000 7f42ac000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42a41084c0 0x7f42a419b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.959+0000 7f42ac000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42a4108e40 0x7f42a41a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.959+0000 7f42ac000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f42a4112b50 con 0x7f42a4102ab0 2024-08-20T05:00:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.959+0000 7f42ac000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f42a41129d0 con 0x7f42a4108e40 2024-08-20T05:00:20.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.959+0000 7f42ac000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f42a4112cd0 con 0x7f42a41084c0 2024-08-20T05:00:20.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.960+0000 7f42a9600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42a4102ab0 0x7f42a419b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:20.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.960+0000 7f42a9600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42a4102ab0 0x7f42a419b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35330/0 (socket says 172.21.15.37:35330) 2024-08-20T05:00:20.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.960+0000 7f42a9600640 1 -- 172.21.15.37:0/4242005189 learned_addr learned my addr 172.21.15.37:0/4242005189 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:20.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.960+0000 7f42a8c00640 1 --2- 172.21.15.37:0/4242005189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42a41084c0 0x7f42a419b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:20.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.960+0000 7f42aa000640 1 --2- 172.21.15.37:0/4242005189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42a4108e40 0x7f42a41a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:20.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.960+0000 7f42a9600640 1 -- 172.21.15.37:0/4242005189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42a41084c0 msgr2=0x7f42a419b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:20.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.960+0000 7f42a9600640 1 --2- 172.21.15.37:0/4242005189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42a41084c0 0x7f42a419b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:20.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.960+0000 7f42a9600640 1 -- 172.21.15.37:0/4242005189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42a4108e40 msgr2=0x7f42a41a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:20.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.960+0000 7f42a9600640 1 --2- 172.21.15.37:0/4242005189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42a4108e40 0x7f42a41a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:20.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.960+0000 7f42a9600640 1 -- 172.21.15.37:0/4242005189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a41a1240 con 0x7f42a4102ab0 2024-08-20T05:00:20.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.961+0000 7f42a9600640 1 --2- 172.21.15.37:0/4242005189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42a4102ab0 0x7f42a419b190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f429800e9f0 tx=0x7f429800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:20.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.961+0000 7f42a2000640 1 -- 172.21.15.37:0/4242005189 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429800cd80 con 0x7f42a4102ab0 2024-08-20T05:00:20.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.961+0000 7f42a2000640 1 -- 172.21.15.37:0/4242005189 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42980108e0 con 0x7f42a4102ab0 2024-08-20T05:00:20.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.961+0000 7f42ac000640 1 -- 172.21.15.37:0/4242005189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a41a1530 con 0x7f42a4102ab0 2024-08-20T05:00:20.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.961+0000 7f42a2000640 1 -- 172.21.15.37:0/4242005189 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4298018980 con 0x7f42a4102ab0 2024-08-20T05:00:20.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.961+0000 7f42ac000640 1 -- 172.21.15.37:0/4242005189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a41a7bf0 con 0x7f42a4102ab0 2024-08-20T05:00:20.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.962+0000 7f42ac000640 1 -- 172.21.15.37:0/4242005189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a4102e90 con 0x7f42a4102ab0 2024-08-20T05:00:20.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.964+0000 7f42a2000640 1 -- 172.21.15.37:0/4242005189 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f4298010430 con 0x7f42a4102ab0 2024-08-20T05:00:20.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.966+0000 7f42a2000640 1 --2- 172.21.15.37:0/4242005189 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f428c0b3c60 0x7f428c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:20.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.966+0000 7f42a2000640 1 -- 172.21.15.37:0/4242005189 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f42980e4300 con 0x7f42a4102ab0 2024-08-20T05:00:20.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.966+0000 7f42a8c00640 1 --2- 172.21.15.37:0/4242005189 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f428c0b3c60 0x7f428c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:20.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.967+0000 7f42a8c00640 1 --2- 172.21.15.37:0/4242005189 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f428c0b3c60 0x7f428c0b6120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4290005ab0 tx=0x7f4290005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:20.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:20.969+0000 7f42a2000640 1 -- 172.21.15.37:0/4242005189 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f42980aaf00 con 0x7f42a4102ab0 2024-08-20T05:00:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:21.163+0000 7f42ac000640 1 -- 172.21.15.37:0/4242005189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42a419c2c0 con 0x7f42a4102ab0 2024-08-20T05:00:21.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:21.165+0000 7f42a2000640 1 -- 172.21.15.37:0/4242005189 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+24236 (secure 0 0 0) 0x7f42980af450 con 0x7f42a4102ab0 2024-08-20T05:00:21.167 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:00:21.167 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","created":"2024-08-20T04:50:26.520303+0000","modified":"2024-08-20T04:59:25.866747+0000","last_up_change":"2024-08-20T04:58:12.250259+0000","last_in_change":"2024-08-20T04:57:49.724189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T04:54:16.381529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T04:59:08.598741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T04:59:10.793802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-20T04:59:19.888446+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a813e53b-68b3-43ff-a59b-aed00e98f2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6803","nonce":3569936373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6805","nonce":3569936373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6809","nonce":3569936373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6807","nonce":3569936373}]},"public_addr":"172.21.15.37:6803/3569936373","cluster_addr":"172.21.15.37:6805/3569936373","heartbeat_back_addr":"172.21.15.37:6809/3569936373","heartbeat_front_addr":"172.21.15.37:6807/3569936373","state":["exists","up"]},{"osd":1,"uuid":"c216a8d0-9685-467a-8161-700682ce617c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6801","nonce":4206461125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6803","nonce":4206461125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6807","nonce":4206461125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6805","nonce":4206461125}]},"public_addr":"172.21.15.130:6801/4206461125","cluster_addr":"172.21.15.130:6803/4206461125","heartbeat_back_addr":"172.21.15.130:6807/4206461125","heartbeat_front_addr":"172.21.15.130:6805/4206461125","state":["exists","up"]},{"osd":2,"uuid":"34402442-c652-40eb-865e-a607a28846b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6801","nonce":2653255199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6803","nonce":2653255199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6807","nonce":2653255199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6805","nonce":2653255199}]},"public_addr":"172.21.15.135:6801/2653255199","cluster_addr":"172.21.15.135:6803/2653255199","heartbeat_back_addr":"172.21.15.135:6807/2653255199","heartbeat_front_addr":"172.21.15.135:6805/2653255199","state":["exists","up"]},{"osd":3,"uuid":"ec7be9dc-96b5-4816-9065-8121baedcdc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6811","nonce":2601290990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6813","nonce":2601290990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6817","nonce":2601290990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6815","nonce":2601290990}]},"public_addr":"172.21.15.37:6811/2601290990","cluster_addr":"172.21.15.37:6813/2601290990","heartbeat_back_addr":"172.21.15.37:6817/2601290990","heartbeat_front_addr":"172.21.15.37:6815/2601290990","state":["exists","up"]},{"osd":4,"uuid":"2dbd47f9-8686-4707-8862-3c7a99a37d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6809","nonce":3542081474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6811","nonce":3542081474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6815","nonce":3542081474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6813","nonce":3542081474}]},"public_addr":"172.21.15.130:6809/3542081474","cluster_addr":"172.21.15.130:6811/3542081474","heartbeat_back_addr":"172.21.15.130:6815/3542081474","heartbeat_front_addr":"172.21.15.130:6813/3542081474","state":["exists","up"]},{"osd":5,"uuid":"9a07a137-d6b7-4aba-8678-4fd164597f27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6809","nonce":2507249148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6811","nonce":2507249148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6815","nonce":2507249148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6813","nonce":2507249148}]},"public_addr":"172.21.15.135:6809/2507249148","cluster_addr":"172.21.15.135:6811/2507249148","heartbeat_back_addr":"172.21.15.135:6815/2507249148","heartbeat_front_addr":"172.21.15.135:6813/2507249148","state":["exists","up"]},{"osd":6,"uuid":"6d6346e8-5418-4c30-9bb3-5af352b616a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6819","nonce":155932692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6821","nonce":155932692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6825","nonce":155932692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6823","nonce":155932692}]},"public_addr":"172.21.15.37:6819/155932692","cluster_addr":"172.21.15.37:6821/155932692","heartbeat_back_addr":"172.21.15.37:6825/155932692","heartbeat_front_addr":"172.21.15.37:6823/155932692","state":["exists","up"]},{"osd":7,"uuid":"c87804c2-d456-495e-b36e-33dbb3548347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6817","nonce":4148130245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6819","nonce":4148130245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6823","nonce":4148130245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6821","nonce":4148130245}]},"public_addr":"172.21.15.130:6817/4148130245","cluster_addr":"172.21.15.130:6819/4148130245","heartbeat_back_addr":"172.21.15.130:6823/4148130245","heartbeat_front_addr":"172.21.15.130:6821/4148130245","state":["exists","up"]},{"osd":8,"uuid":"a7d4c9c8-1826-4703-92ad-ded2800b4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6817","nonce":222884649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6819","nonce":222884649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6823","nonce":222884649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6821","nonce":222884649}]},"public_addr":"172.21.15.135:6817/222884649","cluster_addr":"172.21.15.135:6819/222884649","heartbeat_back_addr":"172.21.15.135:6823/222884649","heartbeat_front_addr":"172.21.15.135:6821/222884649","state":["exists","up"]},{"osd":9,"uuid":"f9e0c194-66b5-4e62-b2ae-816a4a4fffbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6827","nonce":2240773042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6829","nonce":2240773042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6833","nonce":2240773042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6831","nonce":2240773042}]},"public_addr":"172.21.15.37:6827/2240773042","cluster_addr":"172.21.15.37:6829/2240773042","heartbeat_back_addr":"172.21.15.37:6833/2240773042","heartbeat_front_addr":"172.21.15.37:6831/2240773042","state":["exists","up"]},{"osd":10,"uuid":"fa6a50a5-2b97-42d1-9b57-b5502b7083d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6825","nonce":2896730163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6827","nonce":2896730163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6831","nonce":2896730163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6829","nonce":2896730163}]},"public_addr":"172.21.15.130:6825/2896730163","cluster_addr":"172.21.15.130:6827/2896730163","heartbeat_back_addr":"172.21.15.130:6831/2896730163","heartbeat_front_addr":"172.21.15.130:6829/2896730163","state":["exists","up"]},{"osd":11,"uuid":"9a305d75-030d-41db-abfb-81bb71e8c6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6825","nonce":2532897645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6827","nonce":2532897645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6831","nonce":2532897645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6829","nonce":2532897645}]},"public_addr":"172.21.15.135:6825/2532897645","cluster_addr":"172.21.15.135:6827/2532897645","heartbeat_back_addr":"172.21.15.135:6831/2532897645","heartbeat_front_addr":"172.21.15.135:6829/2532897645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:26.455665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:51.456030+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:14.332699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:42.749386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:07.587091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:32.450249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:01.864489+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:26.830527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:51.206257+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:20.400020+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:46.329864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:58:11.086508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4282140105":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/1217599998":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/3737412906":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/58912454":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/2105948300":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/1480362562":"2024-08-21T04:50:59.520912+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T05:00:21.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:21.167+0000 7f42ac000640 1 -- 172.21.15.37:0/4242005189 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f428c0b3c60 msgr2=0x7f428c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:21.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:21.167+0000 7f42ac000640 1 --2- 172.21.15.37:0/4242005189 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f428c0b3c60 0x7f428c0b6120 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4290005ab0 tx=0x7f4290005a20 comp rx=0 tx=0).stop 2024-08-20T05:00:21.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:21.167+0000 7f42ac000640 1 -- 172.21.15.37:0/4242005189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42a4102ab0 msgr2=0x7f42a419b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:21.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:21.167+0000 7f42ac000640 1 --2- 172.21.15.37:0/4242005189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42a4102ab0 0x7f42a419b190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f429800e9f0 tx=0x7f429800eeb0 comp rx=0 tx=0).stop 2024-08-20T05:00:21.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:21.167+0000 7f42ac000640 1 -- 172.21.15.37:0/4242005189 shutdown_connections 2024-08-20T05:00:21.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:21.167+0000 7f42ac000640 1 --2- 172.21.15.37:0/4242005189 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f428c0b3c60 0x7f428c0b6120 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:21.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:21.167+0000 7f42ac000640 1 --2- 172.21.15.37:0/4242005189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42a4108e40 0x7f42a41a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:21.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:21.167+0000 7f42ac000640 1 --2- 172.21.15.37:0/4242005189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42a41084c0 0x7f42a419b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:21.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:21.167+0000 7f42ac000640 1 --2- 172.21.15.37:0/4242005189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42a4102ab0 0x7f42a419b190 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:21.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:21.167+0000 7f42ac000640 1 -- 172.21.15.37:0/4242005189 >> 172.21.15.37:0/4242005189 conn(0x7f42a40fe500 msgr2=0x7f42a4104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:21.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:21.168+0000 7f42ac000640 1 -- 172.21.15.37:0/4242005189 shutdown_connections 2024-08-20T05:00:21.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:21.168+0000 7f42ac000640 1 -- 172.21.15.37:0/4242005189 wait complete. 2024-08-20T05:00:21.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:21 smithi037 ceph-mon[17265]: pgmap v340: 129 pgs: 129 active+clean; 634 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 KiB/s wr, 20 op/s 2024-08-20T05:00:21.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:21 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/4242005189' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:00:21.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:21 smithi135 ceph-mon[22342]: pgmap v340: 129 pgs: 129 active+clean; 634 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 KiB/s wr, 20 op/s 2024-08-20T05:00:21.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:21 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/4242005189' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:00:21.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:21 smithi130 ceph-mon[22007]: pgmap v340: 129 pgs: 129 active+clean; 634 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 KiB/s wr, 20 op/s 2024-08-20T05:00:21.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:21 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/4242005189' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:00:21.956 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-20T05:00:21.957 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-20T05:00:22.338 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:22.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.912+0000 7f9a46a00640 1 -- 172.21.15.37:0/2876832362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a40113500 msgr2=0x7f9a401158f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.912+0000 7f9a46a00640 1 --2- 172.21.15.37:0/2876832362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a40113500 0x7f9a401158f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9a38009ca0 tx=0x7f9a3802a8c0 comp rx=0 tx=0).stop 2024-08-20T05:00:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.912+0000 7f9a46a00640 1 -- 172.21.15.37:0/2876832362 shutdown_connections 2024-08-20T05:00:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.912+0000 7f9a46a00640 1 --2- 172.21.15.37:0/2876832362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a40113500 0x7f9a401158f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.912+0000 7f9a46a00640 1 --2- 172.21.15.37:0/2876832362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a40077d20 0x7f9a40112fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.912+0000 7f9a46a00640 1 --2- 172.21.15.37:0/2876832362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a40077400 0x7f9a400777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.912+0000 7f9a46a00640 1 -- 172.21.15.37:0/2876832362 >> 172.21.15.37:0/2876832362 conn(0x7f9a40100540 msgr2=0x7f9a40102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.912+0000 7f9a46a00640 1 -- 172.21.15.37:0/2876832362 shutdown_connections 2024-08-20T05:00:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.912+0000 7f9a46a00640 1 -- 172.21.15.37:0/2876832362 wait complete. 2024-08-20T05:00:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.913+0000 7f9a46a00640 1 Processor -- start 2024-08-20T05:00:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.913+0000 7f9a46a00640 1 -- start start 2024-08-20T05:00:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.914+0000 7f9a46a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a40077400 0x7f9a4019f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.914+0000 7f9a46a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a40077d20 0x7f9a4019f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.914+0000 7f9a46a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a40113500 0x7f9a401a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.914+0000 7f9a46a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9a40118f00 con 0x7f9a40077400 2024-08-20T05:00:22.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.914+0000 7f9a46a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9a40118d80 con 0x7f9a40077d20 2024-08-20T05:00:22.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.914+0000 7f9a46a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9a40119080 con 0x7f9a40113500 2024-08-20T05:00:22.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.914+0000 7f9a45600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a40077400 0x7f9a4019f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:22.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.914+0000 7f9a45600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a40077400 0x7f9a4019f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45574/0 (socket says 172.21.15.37:45574) 2024-08-20T05:00:22.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.914+0000 7f9a45600640 1 -- 172.21.15.37:0/301132916 learned_addr learned my addr 172.21.15.37:0/301132916 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:22.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.914+0000 7f9a44c00640 1 --2- 172.21.15.37:0/301132916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a40077d20 0x7f9a4019f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:22.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.914+0000 7f9a46000640 1 --2- 172.21.15.37:0/301132916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a40113500 0x7f9a401a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:22.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.915+0000 7f9a45600640 1 -- 172.21.15.37:0/301132916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a40113500 msgr2=0x7f9a401a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:22.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.915+0000 7f9a45600640 1 --2- 172.21.15.37:0/301132916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a40113500 0x7f9a401a4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:22.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.915+0000 7f9a45600640 1 -- 172.21.15.37:0/301132916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a40077d20 msgr2=0x7f9a4019f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:22.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.915+0000 7f9a45600640 1 --2- 172.21.15.37:0/301132916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a40077d20 0x7f9a4019f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:22.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.915+0000 7f9a45600640 1 -- 172.21.15.37:0/301132916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a401a53a0 con 0x7f9a40077400 2024-08-20T05:00:22.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.915+0000 7f9a44c00640 1 --2- 172.21.15.37:0/301132916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a40077d20 0x7f9a4019f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:00:22.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.915+0000 7f9a45600640 1 --2- 172.21.15.37:0/301132916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a40077400 0x7f9a4019f2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9a3400e9f0 tx=0x7f9a3400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:22.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.915+0000 7f9a3e000640 1 -- 172.21.15.37:0/301132916 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3400cd80 con 0x7f9a40077400 2024-08-20T05:00:22.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.915+0000 7f9a3e000640 1 -- 172.21.15.37:0/301132916 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a340108e0 con 0x7f9a40077400 2024-08-20T05:00:22.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.915+0000 7f9a3e000640 1 -- 172.21.15.37:0/301132916 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a34018980 con 0x7f9a40077400 2024-08-20T05:00:22.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.915+0000 7f9a46a00640 1 -- 172.21.15.37:0/301132916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a401a5690 con 0x7f9a40077400 2024-08-20T05:00:22.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.916+0000 7f9a46a00640 1 -- 172.21.15.37:0/301132916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a401abd50 con 0x7f9a40077400 2024-08-20T05:00:22.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.917+0000 7f9a46a00640 1 -- 172.21.15.37:0/301132916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a400777e0 con 0x7f9a40077400 2024-08-20T05:00:22.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.920+0000 7f9a3e000640 1 -- 172.21.15.37:0/301132916 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f9a34010430 con 0x7f9a40077400 2024-08-20T05:00:22.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.922+0000 7f9a3e000640 1 --2- 172.21.15.37:0/301132916 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9a280b3d90 0x7f9a280b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:22.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.922+0000 7f9a3e000640 1 -- 172.21.15.37:0/301132916 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f9a340e4be0 con 0x7f9a40077400 2024-08-20T05:00:22.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.922+0000 7f9a44c00640 1 --2- 172.21.15.37:0/301132916 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9a280b3d90 0x7f9a280b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:22.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.923+0000 7f9a44c00640 1 --2- 172.21.15.37:0/301132916 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9a280b3d90 0x7f9a280b6250 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9a40079b40 tx=0x7f9a2c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:22.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:22.924+0000 7f9a3e000640 1 -- 172.21.15.37:0/301132916 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f9a340abe30 con 0x7f9a40077400 2024-08-20T05:00:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:23.115+0000 7f9a46a00640 1 -- 172.21.15.37:0/301132916 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9a40115590 con 0x7f9a280b3d90 2024-08-20T05:00:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:23.122+0000 7f9a3e000640 1 -- 172.21.15.37:0/301132916 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340377 (secure 0 0 0) 0x7f9a40115590 con 0x7f9a280b3d90 2024-08-20T05:00:23.129 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:00:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-20T05:00:23.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:23.127+0000 7f9a46a00640 1 -- 172.21.15.37:0/301132916 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9a280b3d90 msgr2=0x7f9a280b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:23.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:23.127+0000 7f9a46a00640 1 --2- 172.21.15.37:0/301132916 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9a280b3d90 0x7f9a280b6250 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9a40079b40 tx=0x7f9a2c00b390 comp rx=0 tx=0).stop 2024-08-20T05:00:23.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:23.127+0000 7f9a46a00640 1 -- 172.21.15.37:0/301132916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a40077400 msgr2=0x7f9a4019f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:23.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:23.127+0000 7f9a46a00640 1 --2- 172.21.15.37:0/301132916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a40077400 0x7f9a4019f2f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9a3400e9f0 tx=0x7f9a3400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:00:23.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:23.127+0000 7f9a46a00640 1 -- 172.21.15.37:0/301132916 shutdown_connections 2024-08-20T05:00:23.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:23.127+0000 7f9a46a00640 1 --2- 172.21.15.37:0/301132916 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9a280b3d90 0x7f9a280b6250 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:23.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:23.127+0000 7f9a46a00640 1 --2- 172.21.15.37:0/301132916 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9a40113500 0x7f9a401a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:23.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:23.127+0000 7f9a46a00640 1 --2- 172.21.15.37:0/301132916 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9a40077d20 0x7f9a4019f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:23.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:23.127+0000 7f9a46a00640 1 --2- 172.21.15.37:0/301132916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a40077400 0x7f9a4019f2f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:23.127+0000 7f9a46a00640 1 -- 172.21.15.37:0/301132916 >> 172.21.15.37:0/301132916 conn(0x7f9a40100540 msgr2=0x7f9a40102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:23.127+0000 7f9a46a00640 1 -- 172.21.15.37:0/301132916 shutdown_connections 2024-08-20T05:00:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:23.127+0000 7f9a46a00640 1 -- 172.21.15.37:0/301132916 wait complete. 2024-08-20T05:00:23.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:23 smithi037 ceph-mon[17265]: pgmap v341: 129 pgs: 129 active+clean; 634 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-08-20T05:00:23.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:23 smithi135 ceph-mon[22342]: pgmap v341: 129 pgs: 129 active+clean; 634 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-08-20T05:00:23.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:23 smithi130 ceph-mon[22007]: pgmap v341: 129 pgs: 129 active+clean; 634 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-08-20T05:00:23.943 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":341,"stamp":"2024-08-20T05:00:21.988705+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649701,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":250,"num_read_kb":215,"num_write":364,"num_write_kb":2281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":301,"ondisk_log_size":301,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362540,"kb_used_data":13292,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124579284,"statfs":{"total":1151940427776,"available":1151569186816,"internally_reserved":0,"allocated":13611008,"data_stored":7585589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":42078,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":108,"num_write":27,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003318"},"pg_stats":[{"pgid":"2.1f","version":"84'13","reported_seq":61,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:16.175833+0000","last_change":"2024-08-20T04:59:09.751382+0000","last_active":"2024-08-20T05:00:16.175833+0000","last_peered":"2024-08-20T05:00:16.175833+0000","last_clean":"2024-08-20T05:00:16.175833+0000","last_became_active":"2024-08-20T04:59:09.751026+0000","last_became_peered":"2024-08-20T04:59:09.751026+0000","last_unstale":"2024-08-20T05:00:16.175833+0000","last_undegraded":"2024-08-20T05:00:16.175833+0000","last_fullsized":"2024-08-20T05:00:16.175833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:14:50.107767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294898+0000","last_change":"2024-08-20T04:59:12.789596+0000","last_active":"2024-08-20T04:59:26.294898+0000","last_peered":"2024-08-20T04:59:26.294898+0000","last_clean":"2024-08-20T04:59:26.294898+0000","last_became_active":"2024-08-20T04:59:12.788839+0000","last_became_peered":"2024-08-20T04:59:12.788839+0000","last_unstale":"2024-08-20T04:59:26.294898+0000","last_undegraded":"2024-08-20T04:59:26.294898+0000","last_fullsized":"2024-08-20T04:59:26.294898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:31:05.681475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.432478+0000","last_change":"2024-08-20T04:59:21.902558+0000","last_active":"2024-08-20T04:59:26.432478+0000","last_peered":"2024-08-20T04:59:26.432478+0000","last_clean":"2024-08-20T04:59:26.432478+0000","last_became_active":"2024-08-20T04:59:21.902119+0000","last_became_peered":"2024-08-20T04:59:21.902119+0000","last_unstale":"2024-08-20T04:59:26.432478+0000","last_undegraded":"2024-08-20T04:59:26.432478+0000","last_fullsized":"2024-08-20T04:59:26.432478+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:53.765865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294313+0000","last_change":"2024-08-20T04:59:09.946282+0000","last_active":"2024-08-20T04:59:26.294313+0000","last_peered":"2024-08-20T04:59:26.294313+0000","last_clean":"2024-08-20T04:59:26.294313+0000","last_became_active":"2024-08-20T04:59:09.945867+0000","last_became_peered":"2024-08-20T04:59:09.945867+0000","last_unstale":"2024-08-20T04:59:26.294313+0000","last_undegraded":"2024-08-20T04:59:26.294313+0000","last_fullsized":"2024-08-20T04:59:26.294313+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:29:08.119504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020881+0000","last_change":"2024-08-20T04:59:12.796121+0000","last_active":"2024-08-20T04:59:26.020881+0000","last_peered":"2024-08-20T04:59:26.020881+0000","last_clean":"2024-08-20T04:59:26.020881+0000","last_became_active":"2024-08-20T04:59:12.792764+0000","last_became_peered":"2024-08-20T04:59:12.792764+0000","last_unstale":"2024-08-20T04:59:26.020881+0000","last_undegraded":"2024-08-20T04:59:26.020881+0000","last_fullsized":"2024-08-20T04:59:26.020881+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:01:53.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.226920+0000","last_change":"2024-08-20T04:59:21.909607+0000","last_active":"2024-08-20T04:59:26.226920+0000","last_peered":"2024-08-20T04:59:26.226920+0000","last_clean":"2024-08-20T04:59:26.226920+0000","last_became_active":"2024-08-20T04:59:21.909175+0000","last_became_peered":"2024-08-20T04:59:21.909175+0000","last_unstale":"2024-08-20T04:59:26.226920+0000","last_undegraded":"2024-08-20T04:59:26.226920+0000","last_fullsized":"2024-08-20T04:59:26.226920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:29:49.940169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:06.145926+0000","last_change":"2024-08-20T04:59:09.753233+0000","last_active":"2024-08-20T05:00:06.145926+0000","last_peered":"2024-08-20T05:00:06.145926+0000","last_clean":"2024-08-20T05:00:06.145926+0000","last_became_active":"2024-08-20T04:59:09.752614+0000","last_became_peered":"2024-08-20T04:59:09.752614+0000","last_unstale":"2024-08-20T05:00:06.145926+0000","last_undegraded":"2024-08-20T05:00:06.145926+0000","last_fullsized":"2024-08-20T05:00:06.145926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:04:20.199669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904456+0000","last_change":"2024-08-20T04:59:12.799116+0000","last_active":"2024-08-20T04:59:25.904456+0000","last_peered":"2024-08-20T04:59:25.904456+0000","last_clean":"2024-08-20T04:59:25.904456+0000","last_became_active":"2024-08-20T04:59:12.798725+0000","last_became_peered":"2024-08-20T04:59:12.798725+0000","last_unstale":"2024-08-20T04:59:25.904456+0000","last_undegraded":"2024-08-20T04:59:25.904456+0000","last_fullsized":"2024-08-20T04:59:25.904456+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:46.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.227087+0000","last_change":"2024-08-20T04:59:21.916635+0000","last_active":"2024-08-20T04:59:26.227087+0000","last_peered":"2024-08-20T04:59:26.227087+0000","last_clean":"2024-08-20T04:59:26.227087+0000","last_became_active":"2024-08-20T04:59:21.916224+0000","last_became_peered":"2024-08-20T04:59:21.916224+0000","last_unstale":"2024-08-20T04:59:26.227087+0000","last_undegraded":"2024-08-20T04:59:26.227087+0000","last_fullsized":"2024-08-20T04:59:26.227087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:24:34.516430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.150348+0000","last_change":"2024-08-20T04:59:09.752771+0000","last_active":"2024-08-20T05:00:05.150348+0000","last_peered":"2024-08-20T05:00:05.150348+0000","last_clean":"2024-08-20T05:00:05.150348+0000","last_became_active":"2024-08-20T04:59:09.752415+0000","last_became_peered":"2024-08-20T04:59:09.752415+0000","last_unstale":"2024-08-20T05:00:05.150348+0000","last_undegraded":"2024-08-20T05:00:05.150348+0000","last_fullsized":"2024-08-20T05:00:05.150348+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:13:18.843587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904735+0000","last_change":"2024-08-20T04:59:12.794418+0000","last_active":"2024-08-20T04:59:25.904735+0000","last_peered":"2024-08-20T04:59:25.904735+0000","last_clean":"2024-08-20T04:59:25.904735+0000","last_became_active":"2024-08-20T04:59:12.794117+0000","last_became_peered":"2024-08-20T04:59:12.794117+0000","last_unstale":"2024-08-20T04:59:25.904735+0000","last_undegraded":"2024-08-20T04:59:25.904735+0000","last_fullsized":"2024-08-20T04:59:25.904735+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:18.209690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.227115+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T04:59:26.227115+0000","last_peered":"2024-08-20T04:59:26.227115+0000","last_clean":"2024-08-20T04:59:26.227115+0000","last_became_active":"2024-08-20T04:59:21.906344+0000","last_became_peered":"2024-08-20T04:59:21.906344+0000","last_unstale":"2024-08-20T04:59:26.227115+0000","last_undegraded":"2024-08-20T04:59:26.227115+0000","last_fullsized":"2024-08-20T04:59:26.227115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:48:34.982558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.527746+0000","last_change":"2024-08-20T04:59:12.792719+0000","last_active":"2024-08-20T04:59:26.527746+0000","last_peered":"2024-08-20T04:59:26.527746+0000","last_clean":"2024-08-20T04:59:26.527746+0000","last_became_active":"2024-08-20T04:59:12.792294+0000","last_became_peered":"2024-08-20T04:59:12.792294+0000","last_unstale":"2024-08-20T04:59:26.527746+0000","last_undegraded":"2024-08-20T04:59:26.527746+0000","last_fullsized":"2024-08-20T04:59:26.527746+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:20:03.593798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:02.124565+0000","last_change":"2024-08-20T04:59:09.753804+0000","last_active":"2024-08-20T05:00:02.124565+0000","last_peered":"2024-08-20T05:00:02.124565+0000","last_clean":"2024-08-20T05:00:02.124565+0000","last_became_active":"2024-08-20T04:59:09.753493+0000","last_became_peered":"2024-08-20T04:59:09.753493+0000","last_unstale":"2024-08-20T05:00:02.124565+0000","last_undegraded":"2024-08-20T05:00:02.124565+0000","last_fullsized":"2024-08-20T05:00:02.124565+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:50:26.306087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.227508+0000","last_change":"2024-08-20T04:59:21.902445+0000","last_active":"2024-08-20T04:59:26.227508+0000","last_peered":"2024-08-20T04:59:26.227508+0000","last_clean":"2024-08-20T04:59:26.227508+0000","last_became_active":"2024-08-20T04:59:21.901950+0000","last_became_peered":"2024-08-20T04:59:21.901950+0000","last_unstale":"2024-08-20T04:59:26.227508+0000","last_undegraded":"2024-08-20T04:59:26.227508+0000","last_fullsized":"2024-08-20T04:59:26.227508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:55:28.653841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294725+0000","last_change":"2024-08-20T04:59:12.784236+0000","last_active":"2024-08-20T04:59:26.294725+0000","last_peered":"2024-08-20T04:59:26.294725+0000","last_clean":"2024-08-20T04:59:26.294725+0000","last_became_active":"2024-08-20T04:59:12.783945+0000","last_became_peered":"2024-08-20T04:59:12.783945+0000","last_unstale":"2024-08-20T04:59:26.294725+0000","last_undegraded":"2024-08-20T04:59:26.294725+0000","last_fullsized":"2024-08-20T04:59:26.294725+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:43:07.137543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:04.146028+0000","last_change":"2024-08-20T04:59:09.751661+0000","last_active":"2024-08-20T05:00:04.146028+0000","last_peered":"2024-08-20T05:00:04.146028+0000","last_clean":"2024-08-20T05:00:04.146028+0000","last_became_active":"2024-08-20T04:59:09.751326+0000","last_became_peered":"2024-08-20T04:59:09.751326+0000","last_unstale":"2024-08-20T05:00:04.146028+0000","last_undegraded":"2024-08-20T05:00:04.146028+0000","last_fullsized":"2024-08-20T05:00:04.146028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:54.751929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.227491+0000","last_change":"2024-08-20T04:59:21.913657+0000","last_active":"2024-08-20T04:59:26.227491+0000","last_peered":"2024-08-20T04:59:26.227491+0000","last_clean":"2024-08-20T04:59:26.227491+0000","last_became_active":"2024-08-20T04:59:21.913187+0000","last_became_peered":"2024-08-20T04:59:21.913187+0000","last_unstale":"2024-08-20T04:59:26.227491+0000","last_undegraded":"2024-08-20T04:59:26.227491+0000","last_fullsized":"2024-08-20T04:59:26.227491+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:51:29.008810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547244+0000","last_change":"2024-08-20T04:59:12.780137+0000","last_active":"2024-08-20T04:59:26.547244+0000","last_peered":"2024-08-20T04:59:26.547244+0000","last_clean":"2024-08-20T04:59:26.547244+0000","last_became_active":"2024-08-20T04:59:12.779820+0000","last_became_peered":"2024-08-20T04:59:12.779820+0000","last_unstale":"2024-08-20T04:59:26.547244+0000","last_undegraded":"2024-08-20T04:59:26.547244+0000","last_fullsized":"2024-08-20T04:59:26.547244+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:33:58.204255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.149542+0000","last_change":"2024-08-20T04:59:09.750521+0000","last_active":"2024-08-20T05:00:05.149542+0000","last_peered":"2024-08-20T05:00:05.149542+0000","last_clean":"2024-08-20T05:00:05.149542+0000","last_became_active":"2024-08-20T04:59:09.750115+0000","last_became_peered":"2024-08-20T04:59:09.750115+0000","last_unstale":"2024-08-20T05:00:05.149542+0000","last_undegraded":"2024-08-20T05:00:05.149542+0000","last_fullsized":"2024-08-20T05:00:05.149542+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:44:20.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547106+0000","last_change":"2024-08-20T04:59:21.910737+0000","last_active":"2024-08-20T04:59:26.547106+0000","last_peered":"2024-08-20T04:59:26.547106+0000","last_clean":"2024-08-20T04:59:26.547106+0000","last_became_active":"2024-08-20T04:59:21.910104+0000","last_became_peered":"2024-08-20T04:59:21.910104+0000","last_unstale":"2024-08-20T04:59:26.547106+0000","last_undegraded":"2024-08-20T04:59:26.547106+0000","last_fullsized":"2024-08-20T04:59:26.547106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:17:40.436885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.546530+0000","last_change":"2024-08-20T04:59:12.787285+0000","last_active":"2024-08-20T04:59:26.546530+0000","last_peered":"2024-08-20T04:59:26.546530+0000","last_clean":"2024-08-20T04:59:26.546530+0000","last_became_active":"2024-08-20T04:59:12.786998+0000","last_became_peered":"2024-08-20T04:59:12.786998+0000","last_unstale":"2024-08-20T04:59:26.546530+0000","last_undegraded":"2024-08-20T04:59:26.546530+0000","last_fullsized":"2024-08-20T04:59:26.546530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:12:49.860291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:02.125231+0000","last_change":"2024-08-20T04:59:09.947715+0000","last_active":"2024-08-20T05:00:02.125231+0000","last_peered":"2024-08-20T05:00:02.125231+0000","last_clean":"2024-08-20T05:00:02.125231+0000","last_became_active":"2024-08-20T04:59:09.947372+0000","last_became_peered":"2024-08-20T04:59:09.947372+0000","last_unstale":"2024-08-20T05:00:02.125231+0000","last_undegraded":"2024-08-20T05:00:02.125231+0000","last_fullsized":"2024-08-20T05:00:02.125231+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:42:04.352964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.227591+0000","last_change":"2024-08-20T04:59:21.910176+0000","last_active":"2024-08-20T04:59:26.227591+0000","last_peered":"2024-08-20T04:59:26.227591+0000","last_clean":"2024-08-20T04:59:26.227591+0000","last_became_active":"2024-08-20T04:59:21.909435+0000","last_became_peered":"2024-08-20T04:59:21.909435+0000","last_unstale":"2024-08-20T04:59:26.227591+0000","last_undegraded":"2024-08-20T04:59:26.227591+0000","last_fullsized":"2024-08-20T04:59:26.227591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:17:16.256844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020790+0000","last_change":"2024-08-20T04:59:12.785952+0000","last_active":"2024-08-20T04:59:26.020790+0000","last_peered":"2024-08-20T04:59:26.020790+0000","last_clean":"2024-08-20T04:59:26.020790+0000","last_became_active":"2024-08-20T04:59:12.785596+0000","last_became_peered":"2024-08-20T04:59:12.785596+0000","last_unstale":"2024-08-20T04:59:26.020790+0000","last_undegraded":"2024-08-20T04:59:26.020790+0000","last_fullsized":"2024-08-20T04:59:26.020790+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:47.299560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.150862+0000","last_change":"2024-08-20T04:59:09.964725+0000","last_active":"2024-08-20T05:00:05.150862+0000","last_peered":"2024-08-20T05:00:05.150862+0000","last_clean":"2024-08-20T05:00:05.150862+0000","last_became_active":"2024-08-20T04:59:09.964351+0000","last_became_peered":"2024-08-20T04:59:09.964351+0000","last_unstale":"2024-08-20T05:00:05.150862+0000","last_undegraded":"2024-08-20T05:00:05.150862+0000","last_fullsized":"2024-08-20T05:00:05.150862+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:26:03.216378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.432844+0000","last_change":"2024-08-20T04:59:21.898758+0000","last_active":"2024-08-20T04:59:26.432844+0000","last_peered":"2024-08-20T04:59:26.432844+0000","last_clean":"2024-08-20T04:59:26.432844+0000","last_became_active":"2024-08-20T04:59:21.898282+0000","last_became_peered":"2024-08-20T04:59:21.898282+0000","last_unstale":"2024-08-20T04:59:26.432844+0000","last_undegraded":"2024-08-20T04:59:26.432844+0000","last_fullsized":"2024-08-20T04:59:26.432844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:45:49.093459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.295082+0000","last_change":"2024-08-20T04:59:12.793870+0000","last_active":"2024-08-20T04:59:26.295082+0000","last_peered":"2024-08-20T04:59:26.295082+0000","last_clean":"2024-08-20T04:59:26.295082+0000","last_became_active":"2024-08-20T04:59:12.792928+0000","last_became_peered":"2024-08-20T04:59:12.792928+0000","last_unstale":"2024-08-20T04:59:26.295082+0000","last_undegraded":"2024-08-20T04:59:26.295082+0000","last_fullsized":"2024-08-20T04:59:26.295082+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:12:25.450347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'12","reported_seq":47,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:15.792167+0000","last_change":"2024-08-20T04:59:09.751403+0000","last_active":"2024-08-20T05:00:15.792167+0000","last_peered":"2024-08-20T05:00:15.792167+0000","last_clean":"2024-08-20T05:00:15.792167+0000","last_became_active":"2024-08-20T04:59:09.750976+0000","last_became_peered":"2024-08-20T04:59:09.750976+0000","last_unstale":"2024-08-20T05:00:15.792167+0000","last_undegraded":"2024-08-20T05:00:15.792167+0000","last_fullsized":"2024-08-20T05:00:15.792167+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:58:54.627836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294380+0000","last_change":"2024-08-20T04:59:21.899813+0000","last_active":"2024-08-20T04:59:26.294380+0000","last_peered":"2024-08-20T04:59:26.294380+0000","last_clean":"2024-08-20T04:59:26.294380+0000","last_became_active":"2024-08-20T04:59:21.899462+0000","last_became_peered":"2024-08-20T04:59:21.899462+0000","last_unstale":"2024-08-20T04:59:26.294380+0000","last_undegraded":"2024-08-20T04:59:26.294380+0000","last_fullsized":"2024-08-20T04:59:26.294380+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.468845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904142+0000","last_change":"2024-08-20T04:59:12.783953+0000","last_active":"2024-08-20T04:59:25.904142+0000","last_peered":"2024-08-20T04:59:25.904142+0000","last_clean":"2024-08-20T04:59:25.904142+0000","last_became_active":"2024-08-20T04:59:12.781445+0000","last_became_peered":"2024-08-20T04:59:12.781445+0000","last_unstale":"2024-08-20T04:59:25.904142+0000","last_undegraded":"2024-08-20T04:59:25.904142+0000","last_fullsized":"2024-08-20T04:59:25.904142+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:04.792064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.151269+0000","last_change":"2024-08-20T04:59:09.947194+0000","last_active":"2024-08-20T05:00:05.151269+0000","last_peered":"2024-08-20T05:00:05.151269+0000","last_clean":"2024-08-20T05:00:05.151269+0000","last_became_active":"2024-08-20T04:59:09.946822+0000","last_became_peered":"2024-08-20T04:59:09.946822+0000","last_unstale":"2024-08-20T05:00:05.151269+0000","last_undegraded":"2024-08-20T05:00:05.151269+0000","last_fullsized":"2024-08-20T05:00:05.151269+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:23:08.279378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547065+0000","last_change":"2024-08-20T04:59:21.905202+0000","last_active":"2024-08-20T04:59:26.547065+0000","last_peered":"2024-08-20T04:59:26.547065+0000","last_clean":"2024-08-20T04:59:26.547065+0000","last_became_active":"2024-08-20T04:59:21.904771+0000","last_became_peered":"2024-08-20T04:59:21.904771+0000","last_unstale":"2024-08-20T04:59:26.547065+0000","last_undegraded":"2024-08-20T04:59:26.547065+0000","last_fullsized":"2024-08-20T04:59:26.547065+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:35:56.887981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.979872+0000","last_change":"2024-08-20T04:59:12.798301+0000","last_active":"2024-08-20T04:59:25.979872+0000","last_peered":"2024-08-20T04:59:25.979872+0000","last_clean":"2024-08-20T04:59:25.979872+0000","last_became_active":"2024-08-20T04:59:12.797934+0000","last_became_peered":"2024-08-20T04:59:12.797934+0000","last_unstale":"2024-08-20T04:59:25.979872+0000","last_undegraded":"2024-08-20T04:59:25.979872+0000","last_fullsized":"2024-08-20T04:59:25.979872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:41:24.465380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547223+0000","last_change":"2024-08-20T04:59:09.947602+0000","last_active":"2024-08-20T04:59:26.547223+0000","last_peered":"2024-08-20T04:59:26.547223+0000","last_clean":"2024-08-20T04:59:26.547223+0000","last_became_active":"2024-08-20T04:59:09.946795+0000","last_became_peered":"2024-08-20T04:59:09.946795+0000","last_unstale":"2024-08-20T04:59:26.547223+0000","last_undegraded":"2024-08-20T04:59:26.547223+0000","last_fullsized":"2024-08-20T04:59:26.547223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:09:09.003266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.546675+0000","last_change":"2024-08-20T04:59:21.913853+0000","last_active":"2024-08-20T04:59:26.546675+0000","last_peered":"2024-08-20T04:59:26.546675+0000","last_clean":"2024-08-20T04:59:26.546675+0000","last_became_active":"2024-08-20T04:59:21.913432+0000","last_became_peered":"2024-08-20T04:59:21.913432+0000","last_unstale":"2024-08-20T04:59:26.546675+0000","last_undegraded":"2024-08-20T04:59:26.546675+0000","last_fullsized":"2024-08-20T04:59:26.546675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:43:11.045525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.979767+0000","last_change":"2024-08-20T04:59:12.784852+0000","last_active":"2024-08-20T04:59:25.979767+0000","last_peered":"2024-08-20T04:59:25.979767+0000","last_clean":"2024-08-20T04:59:25.979767+0000","last_became_active":"2024-08-20T04:59:12.784496+0000","last_became_peered":"2024-08-20T04:59:12.784496+0000","last_unstale":"2024-08-20T04:59:25.979767+0000","last_undegraded":"2024-08-20T04:59:25.979767+0000","last_fullsized":"2024-08-20T04:59:25.979767+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:41:42.421383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:17.177405+0000","last_change":"2024-08-20T04:59:09.750785+0000","last_active":"2024-08-20T05:00:17.177405+0000","last_peered":"2024-08-20T05:00:17.177405+0000","last_clean":"2024-08-20T05:00:17.177405+0000","last_became_active":"2024-08-20T04:59:09.750255+0000","last_became_peered":"2024-08-20T04:59:09.750255+0000","last_unstale":"2024-08-20T05:00:17.177405+0000","last_undegraded":"2024-08-20T05:00:17.177405+0000","last_fullsized":"2024-08-20T05:00:17.177405+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:20:17.900367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904059+0000","last_change":"2024-08-20T04:59:21.909409+0000","last_active":"2024-08-20T04:59:25.904059+0000","last_peered":"2024-08-20T04:59:25.904059+0000","last_clean":"2024-08-20T04:59:25.904059+0000","last_became_active":"2024-08-20T04:59:21.907934+0000","last_became_peered":"2024-08-20T04:59:21.907934+0000","last_unstale":"2024-08-20T04:59:25.904059+0000","last_undegraded":"2024-08-20T04:59:25.904059+0000","last_fullsized":"2024-08-20T04:59:25.904059+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:26:36.768407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904386+0000","last_change":"2024-08-20T04:59:12.783496+0000","last_active":"2024-08-20T04:59:25.904386+0000","last_peered":"2024-08-20T04:59:25.904386+0000","last_clean":"2024-08-20T04:59:25.904386+0000","last_became_active":"2024-08-20T04:59:12.783211+0000","last_became_peered":"2024-08-20T04:59:12.783211+0000","last_unstale":"2024-08-20T04:59:25.904386+0000","last_undegraded":"2024-08-20T04:59:25.904386+0000","last_fullsized":"2024-08-20T04:59:25.904386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:45:49.514189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":56,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:18.174140+0000","last_change":"2024-08-20T04:59:09.948284+0000","last_active":"2024-08-20T05:00:18.174140+0000","last_peered":"2024-08-20T05:00:18.174140+0000","last_clean":"2024-08-20T05:00:18.174140+0000","last_became_active":"2024-08-20T04:59:09.947909+0000","last_became_peered":"2024-08-20T04:59:09.947909+0000","last_unstale":"2024-08-20T05:00:18.174140+0000","last_undegraded":"2024-08-20T05:00:18.174140+0000","last_fullsized":"2024-08-20T05:00:18.174140+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:24:04.344380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.903977+0000","last_change":"2024-08-20T04:59:21.905282+0000","last_active":"2024-08-20T04:59:25.903977+0000","last_peered":"2024-08-20T04:59:25.903977+0000","last_clean":"2024-08-20T04:59:25.903977+0000","last_became_active":"2024-08-20T04:59:21.904842+0000","last_became_peered":"2024-08-20T04:59:21.904842+0000","last_unstale":"2024-08-20T04:59:25.903977+0000","last_undegraded":"2024-08-20T04:59:25.903977+0000","last_fullsized":"2024-08-20T04:59:25.903977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:01:19.949949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.903533+0000","last_change":"2024-08-20T04:59:12.788571+0000","last_active":"2024-08-20T04:59:25.903533+0000","last_peered":"2024-08-20T04:59:25.903533+0000","last_clean":"2024-08-20T04:59:25.903533+0000","last_became_active":"2024-08-20T04:59:12.784148+0000","last_became_peered":"2024-08-20T04:59:12.784148+0000","last_unstale":"2024-08-20T04:59:25.903533+0000","last_undegraded":"2024-08-20T04:59:25.903533+0000","last_fullsized":"2024-08-20T04:59:25.903533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:10:51.565404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:03.130836+0000","last_change":"2024-08-20T04:59:09.753842+0000","last_active":"2024-08-20T05:00:03.130836+0000","last_peered":"2024-08-20T05:00:03.130836+0000","last_clean":"2024-08-20T05:00:03.130836+0000","last_became_active":"2024-08-20T04:59:09.753439+0000","last_became_peered":"2024-08-20T04:59:09.753439+0000","last_unstale":"2024-08-20T05:00:03.130836+0000","last_undegraded":"2024-08-20T05:00:03.130836+0000","last_fullsized":"2024-08-20T05:00:03.130836+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:54.171964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904627+0000","last_change":"2024-08-20T04:59:21.909621+0000","last_active":"2024-08-20T04:59:25.904627+0000","last_peered":"2024-08-20T04:59:25.904627+0000","last_clean":"2024-08-20T04:59:25.904627+0000","last_became_active":"2024-08-20T04:59:21.909239+0000","last_became_peered":"2024-08-20T04:59:21.909239+0000","last_unstale":"2024-08-20T04:59:25.904627+0000","last_undegraded":"2024-08-20T04:59:25.904627+0000","last_fullsized":"2024-08-20T04:59:25.904627+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:53:15.131163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294664+0000","last_change":"2024-08-20T04:59:12.796643+0000","last_active":"2024-08-20T04:59:26.294664+0000","last_peered":"2024-08-20T04:59:26.294664+0000","last_clean":"2024-08-20T04:59:26.294664+0000","last_became_active":"2024-08-20T04:59:12.796262+0000","last_became_peered":"2024-08-20T04:59:12.796262+0000","last_unstale":"2024-08-20T04:59:26.294664+0000","last_undegraded":"2024-08-20T04:59:26.294664+0000","last_fullsized":"2024-08-20T04:59:26.294664+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:11:37.792359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:06.153178+0000","last_change":"2024-08-20T04:59:09.750550+0000","last_active":"2024-08-20T05:00:06.153178+0000","last_peered":"2024-08-20T05:00:06.153178+0000","last_clean":"2024-08-20T05:00:06.153178+0000","last_became_active":"2024-08-20T04:59:09.750097+0000","last_became_peered":"2024-08-20T04:59:09.750097+0000","last_unstale":"2024-08-20T05:00:06.153178+0000","last_undegraded":"2024-08-20T05:00:06.153178+0000","last_fullsized":"2024-08-20T05:00:06.153178+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:32:22.826478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":109,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.527375+0000","last_change":"2024-08-20T04:57:50.824023+0000","last_active":"2024-08-20T04:59:26.527375+0000","last_peered":"2024-08-20T04:59:26.527375+0000","last_clean":"2024-08-20T04:59:26.527375+0000","last_became_active":"2024-08-20T04:57:50.350587+0000","last_became_peered":"2024-08-20T04:57:50.350587+0000","last_unstale":"2024-08-20T04:59:26.527375+0000","last_undegraded":"2024-08-20T04:59:26.527375+0000","last_fullsized":"2024-08-20T04:59:26.527375+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_clean_scrub_stamp":"2024-08-20T04:54:17.224468+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:59:23.450117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.527966+0000","last_change":"2024-08-20T04:59:21.909203+0000","last_active":"2024-08-20T04:59:26.527966+0000","last_peered":"2024-08-20T04:59:26.527966+0000","last_clean":"2024-08-20T04:59:26.527966+0000","last_became_active":"2024-08-20T04:59:21.908610+0000","last_became_peered":"2024-08-20T04:59:21.908610+0000","last_unstale":"2024-08-20T04:59:26.527966+0000","last_undegraded":"2024-08-20T04:59:26.527966+0000","last_fullsized":"2024-08-20T04:59:26.527966+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:49.567655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.528093+0000","last_change":"2024-08-20T04:59:12.793799+0000","last_active":"2024-08-20T04:59:26.528093+0000","last_peered":"2024-08-20T04:59:26.528093+0000","last_clean":"2024-08-20T04:59:26.528093+0000","last_became_active":"2024-08-20T04:59:12.793487+0000","last_became_peered":"2024-08-20T04:59:12.793487+0000","last_unstale":"2024-08-20T04:59:26.528093+0000","last_undegraded":"2024-08-20T04:59:26.528093+0000","last_fullsized":"2024-08-20T04:59:26.528093+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:08:30.835824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'6","reported_seq":60,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:20.180245+0000","last_change":"2024-08-20T04:59:09.964586+0000","last_active":"2024-08-20T05:00:20.180245+0000","last_peered":"2024-08-20T05:00:20.180245+0000","last_clean":"2024-08-20T05:00:20.180245+0000","last_became_active":"2024-08-20T04:59:09.964258+0000","last_became_peered":"2024-08-20T04:59:09.964258+0000","last_unstale":"2024-08-20T05:00:20.180245+0000","last_undegraded":"2024-08-20T05:00:20.180245+0000","last_fullsized":"2024-08-20T05:00:20.180245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:37:48.138019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904194+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T04:59:25.904194+0000","last_peered":"2024-08-20T04:59:25.904194+0000","last_clean":"2024-08-20T04:59:25.904194+0000","last_became_active":"2024-08-20T04:59:21.906197+0000","last_became_peered":"2024-08-20T04:59:21.906197+0000","last_unstale":"2024-08-20T04:59:25.904194+0000","last_undegraded":"2024-08-20T04:59:25.904194+0000","last_fullsized":"2024-08-20T04:59:25.904194+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:10:45.819035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.527924+0000","last_change":"2024-08-20T04:59:12.794221+0000","last_active":"2024-08-20T04:59:26.527924+0000","last_peered":"2024-08-20T04:59:26.527924+0000","last_clean":"2024-08-20T04:59:26.527924+0000","last_became_active":"2024-08-20T04:59:12.793680+0000","last_became_peered":"2024-08-20T04:59:12.793680+0000","last_unstale":"2024-08-20T04:59:26.527924+0000","last_undegraded":"2024-08-20T04:59:26.527924+0000","last_fullsized":"2024-08-20T04:59:26.527924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:45.435700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.150020+0000","last_change":"2024-08-20T04:59:09.755955+0000","last_active":"2024-08-20T05:00:05.150020+0000","last_peered":"2024-08-20T05:00:05.150020+0000","last_clean":"2024-08-20T05:00:05.150020+0000","last_became_active":"2024-08-20T04:59:09.755614+0000","last_became_peered":"2024-08-20T04:59:09.755614+0000","last_unstale":"2024-08-20T05:00:05.150020+0000","last_undegraded":"2024-08-20T05:00:05.150020+0000","last_fullsized":"2024-08-20T05:00:05.150020+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:15:06.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020566+0000","last_change":"2024-08-20T04:59:21.915952+0000","last_active":"2024-08-20T04:59:26.020566+0000","last_peered":"2024-08-20T04:59:26.020566+0000","last_clean":"2024-08-20T04:59:26.020566+0000","last_became_active":"2024-08-20T04:59:21.915533+0000","last_became_peered":"2024-08-20T04:59:21.915533+0000","last_unstale":"2024-08-20T04:59:26.020566+0000","last_undegraded":"2024-08-20T04:59:26.020566+0000","last_fullsized":"2024-08-20T04:59:26.020566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:52:54.906061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.528012+0000","last_change":"2024-08-20T04:59:12.782663+0000","last_active":"2024-08-20T04:59:26.528012+0000","last_peered":"2024-08-20T04:59:26.528012+0000","last_clean":"2024-08-20T04:59:26.528012+0000","last_became_active":"2024-08-20T04:59:12.782068+0000","last_became_peered":"2024-08-20T04:59:12.782068+0000","last_unstale":"2024-08-20T04:59:26.528012+0000","last_undegraded":"2024-08-20T04:59:26.528012+0000","last_fullsized":"2024-08-20T04:59:26.528012+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:46:39.662033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.150050+0000","last_change":"2024-08-20T04:59:09.747456+0000","last_active":"2024-08-20T05:00:05.150050+0000","last_peered":"2024-08-20T05:00:05.150050+0000","last_clean":"2024-08-20T05:00:05.150050+0000","last_became_active":"2024-08-20T04:59:09.747141+0000","last_became_peered":"2024-08-20T04:59:09.747141+0000","last_unstale":"2024-08-20T05:00:05.150050+0000","last_undegraded":"2024-08-20T05:00:05.150050+0000","last_fullsized":"2024-08-20T05:00:05.150050+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:39:01.600831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904162+0000","last_change":"2024-08-20T04:59:21.898059+0000","last_active":"2024-08-20T04:59:25.904162+0000","last_peered":"2024-08-20T04:59:25.904162+0000","last_clean":"2024-08-20T04:59:25.904162+0000","last_became_active":"2024-08-20T04:59:21.897617+0000","last_became_peered":"2024-08-20T04:59:21.897617+0000","last_unstale":"2024-08-20T04:59:25.904162+0000","last_undegraded":"2024-08-20T04:59:25.904162+0000","last_fullsized":"2024-08-20T04:59:25.904162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:53:21.122106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547010+0000","last_change":"2024-08-20T04:59:12.784275+0000","last_active":"2024-08-20T04:59:26.547010+0000","last_peered":"2024-08-20T04:59:26.547010+0000","last_clean":"2024-08-20T04:59:26.547010+0000","last_became_active":"2024-08-20T04:59:12.783888+0000","last_became_peered":"2024-08-20T04:59:12.783888+0000","last_unstale":"2024-08-20T04:59:26.547010+0000","last_undegraded":"2024-08-20T04:59:26.547010+0000","last_fullsized":"2024-08-20T04:59:26.547010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:38:50.060057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.126501+0000","last_change":"2024-08-20T04:59:09.751943+0000","last_active":"2024-08-20T05:00:05.126501+0000","last_peered":"2024-08-20T05:00:05.126501+0000","last_clean":"2024-08-20T05:00:05.126501+0000","last_became_active":"2024-08-20T04:59:09.751586+0000","last_became_peered":"2024-08-20T04:59:09.751586+0000","last_unstale":"2024-08-20T05:00:05.126501+0000","last_undegraded":"2024-08-20T05:00:05.126501+0000","last_fullsized":"2024-08-20T05:00:05.126501+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:35:03.400574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904200+0000","last_change":"2024-08-20T04:59:21.901315+0000","last_active":"2024-08-20T04:59:25.904200+0000","last_peered":"2024-08-20T04:59:25.904200+0000","last_clean":"2024-08-20T04:59:25.904200+0000","last_became_active":"2024-08-20T04:59:21.900871+0000","last_became_peered":"2024-08-20T04:59:21.900871+0000","last_unstale":"2024-08-20T04:59:25.904200+0000","last_undegraded":"2024-08-20T04:59:25.904200+0000","last_fullsized":"2024-08-20T04:59:25.904200+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:39:30.940409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904248+0000","last_change":"2024-08-20T04:59:12.793140+0000","last_active":"2024-08-20T04:59:25.904248+0000","last_peered":"2024-08-20T04:59:25.904248+0000","last_clean":"2024-08-20T04:59:25.904248+0000","last_became_active":"2024-08-20T04:59:12.792678+0000","last_became_peered":"2024-08-20T04:59:12.792678+0000","last_unstale":"2024-08-20T04:59:25.904248+0000","last_undegraded":"2024-08-20T04:59:25.904248+0000","last_fullsized":"2024-08-20T04:59:25.904248+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:07:05.610634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":55,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.151132+0000","last_change":"2024-08-20T04:59:09.946158+0000","last_active":"2024-08-20T05:00:05.151132+0000","last_peered":"2024-08-20T05:00:05.151132+0000","last_clean":"2024-08-20T05:00:05.151132+0000","last_became_active":"2024-08-20T04:59:09.945736+0000","last_became_peered":"2024-08-20T04:59:09.945736+0000","last_unstale":"2024-08-20T05:00:05.151132+0000","last_undegraded":"2024-08-20T05:00:05.151132+0000","last_fullsized":"2024-08-20T05:00:05.151132+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:02.759879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904150+0000","last_change":"2024-08-20T04:59:21.913457+0000","last_active":"2024-08-20T04:59:25.904150+0000","last_peered":"2024-08-20T04:59:25.904150+0000","last_clean":"2024-08-20T04:59:25.904150+0000","last_became_active":"2024-08-20T04:59:21.910468+0000","last_became_peered":"2024-08-20T04:59:21.910468+0000","last_unstale":"2024-08-20T04:59:25.904150+0000","last_undegraded":"2024-08-20T04:59:25.904150+0000","last_fullsized":"2024-08-20T04:59:25.904150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:16:30.817166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.527752+0000","last_change":"2024-08-20T04:59:12.788088+0000","last_active":"2024-08-20T04:59:26.527752+0000","last_peered":"2024-08-20T04:59:26.527752+0000","last_clean":"2024-08-20T04:59:26.527752+0000","last_became_active":"2024-08-20T04:59:12.787756+0000","last_became_peered":"2024-08-20T04:59:12.787756+0000","last_unstale":"2024-08-20T04:59:26.527752+0000","last_undegraded":"2024-08-20T04:59:26.527752+0000","last_fullsized":"2024-08-20T04:59:26.527752+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:51.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":58,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:17.173445+0000","last_change":"2024-08-20T04:59:09.746896+0000","last_active":"2024-08-20T05:00:17.173445+0000","last_peered":"2024-08-20T05:00:17.173445+0000","last_clean":"2024-08-20T05:00:17.173445+0000","last_became_active":"2024-08-20T04:59:09.746570+0000","last_became_peered":"2024-08-20T04:59:09.746570+0000","last_unstale":"2024-08-20T05:00:17.173445+0000","last_undegraded":"2024-08-20T05:00:17.173445+0000","last_fullsized":"2024-08-20T05:00:17.173445+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:06:02.395260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547187+0000","last_change":"2024-08-20T04:59:21.911747+0000","last_active":"2024-08-20T04:59:26.547187+0000","last_peered":"2024-08-20T04:59:26.547187+0000","last_clean":"2024-08-20T04:59:26.547187+0000","last_became_active":"2024-08-20T04:59:21.908861+0000","last_became_peered":"2024-08-20T04:59:21.908861+0000","last_unstale":"2024-08-20T04:59:26.547187+0000","last_undegraded":"2024-08-20T04:59:26.547187+0000","last_fullsized":"2024-08-20T04:59:26.547187+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:22:17.336776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.527724+0000","last_change":"2024-08-20T04:59:12.792010+0000","last_active":"2024-08-20T04:59:26.527724+0000","last_peered":"2024-08-20T04:59:26.527724+0000","last_clean":"2024-08-20T04:59:26.527724+0000","last_became_active":"2024-08-20T04:59:12.791699+0000","last_became_peered":"2024-08-20T04:59:12.791699+0000","last_unstale":"2024-08-20T04:59:26.527724+0000","last_undegraded":"2024-08-20T04:59:26.527724+0000","last_fullsized":"2024-08-20T04:59:26.527724+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:01.434149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.150986+0000","last_change":"2024-08-20T04:59:09.755225+0000","last_active":"2024-08-20T05:00:05.150986+0000","last_peered":"2024-08-20T05:00:05.150986+0000","last_clean":"2024-08-20T05:00:05.150986+0000","last_became_active":"2024-08-20T04:59:09.754580+0000","last_became_peered":"2024-08-20T04:59:09.754580+0000","last_unstale":"2024-08-20T05:00:05.150986+0000","last_undegraded":"2024-08-20T05:00:05.150986+0000","last_fullsized":"2024-08-20T05:00:05.150986+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:54:53.606954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547036+0000","last_change":"2024-08-20T04:59:21.905200+0000","last_active":"2024-08-20T04:59:26.547036+0000","last_peered":"2024-08-20T04:59:26.547036+0000","last_clean":"2024-08-20T04:59:26.547036+0000","last_became_active":"2024-08-20T04:59:21.904724+0000","last_became_peered":"2024-08-20T04:59:21.904724+0000","last_unstale":"2024-08-20T04:59:26.547036+0000","last_undegraded":"2024-08-20T04:59:26.547036+0000","last_fullsized":"2024-08-20T04:59:26.547036+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:50:43.446750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.903708+0000","last_change":"2024-08-20T04:59:12.787261+0000","last_active":"2024-08-20T04:59:25.903708+0000","last_peered":"2024-08-20T04:59:25.903708+0000","last_clean":"2024-08-20T04:59:25.903708+0000","last_became_active":"2024-08-20T04:59:12.786971+0000","last_became_peered":"2024-08-20T04:59:12.786971+0000","last_unstale":"2024-08-20T04:59:25.903708+0000","last_undegraded":"2024-08-20T04:59:25.903708+0000","last_fullsized":"2024-08-20T04:59:25.903708+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:55:57.209321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:06.153406+0000","last_change":"2024-08-20T04:59:09.749147+0000","last_active":"2024-08-20T05:00:06.153406+0000","last_peered":"2024-08-20T05:00:06.153406+0000","last_clean":"2024-08-20T05:00:06.153406+0000","last_became_active":"2024-08-20T04:59:09.748806+0000","last_became_peered":"2024-08-20T04:59:09.748806+0000","last_unstale":"2024-08-20T05:00:06.153406+0000","last_undegraded":"2024-08-20T05:00:06.153406+0000","last_fullsized":"2024-08-20T05:00:06.153406+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:59:43.377105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904810+0000","last_change":"2024-08-20T04:59:21.905007+0000","last_active":"2024-08-20T04:59:25.904810+0000","last_peered":"2024-08-20T04:59:25.904810+0000","last_clean":"2024-08-20T04:59:25.904810+0000","last_became_active":"2024-08-20T04:59:21.904608+0000","last_became_peered":"2024-08-20T04:59:21.904608+0000","last_unstale":"2024-08-20T04:59:25.904810+0000","last_undegraded":"2024-08-20T04:59:25.904810+0000","last_fullsized":"2024-08-20T04:59:25.904810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:00:42.390966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547343+0000","last_change":"2024-08-20T04:59:12.783339+0000","last_active":"2024-08-20T04:59:26.547343+0000","last_peered":"2024-08-20T04:59:26.547343+0000","last_clean":"2024-08-20T04:59:26.547343+0000","last_became_active":"2024-08-20T04:59:12.783051+0000","last_became_peered":"2024-08-20T04:59:12.783051+0000","last_unstale":"2024-08-20T04:59:26.547343+0000","last_undegraded":"2024-08-20T04:59:26.547343+0000","last_fullsized":"2024-08-20T04:59:26.547343+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:23:54.390491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'31","reported_seq":100,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:18.175493+0000","last_change":"2024-08-20T04:59:09.754340+0000","last_active":"2024-08-20T05:00:18.175493+0000","last_peered":"2024-08-20T05:00:18.175493+0000","last_clean":"2024-08-20T05:00:18.175493+0000","last_became_active":"2024-08-20T04:59:09.754000+0000","last_became_peered":"2024-08-20T04:59:09.754000+0000","last_unstale":"2024-08-20T05:00:18.175493+0000","last_undegraded":"2024-08-20T05:00:18.175493+0000","last_fullsized":"2024-08-20T05:00:18.175493+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:26:17.256961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51895,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":67,"num_write":33,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547079+0000","last_change":"2024-08-20T04:59:21.910369+0000","last_active":"2024-08-20T04:59:26.547079+0000","last_peered":"2024-08-20T04:59:26.547079+0000","last_clean":"2024-08-20T04:59:26.547079+0000","last_became_active":"2024-08-20T04:59:21.909941+0000","last_became_peered":"2024-08-20T04:59:21.909941+0000","last_unstale":"2024-08-20T04:59:26.547079+0000","last_undegraded":"2024-08-20T04:59:26.547079+0000","last_fullsized":"2024-08-20T04:59:26.547079+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:27:07.088021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904456+0000","last_change":"2024-08-20T04:59:12.787747+0000","last_active":"2024-08-20T04:59:25.904456+0000","last_peered":"2024-08-20T04:59:25.904456+0000","last_clean":"2024-08-20T04:59:25.904456+0000","last_became_active":"2024-08-20T04:59:12.786962+0000","last_became_peered":"2024-08-20T04:59:12.786962+0000","last_unstale":"2024-08-20T04:59:25.904456+0000","last_undegraded":"2024-08-20T04:59:25.904456+0000","last_fullsized":"2024-08-20T04:59:25.904456+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:14:43.822829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:04.144763+0000","last_change":"2024-08-20T04:59:09.947582+0000","last_active":"2024-08-20T05:00:04.144763+0000","last_peered":"2024-08-20T05:00:04.144763+0000","last_clean":"2024-08-20T05:00:04.144763+0000","last_became_active":"2024-08-20T04:59:09.947117+0000","last_became_peered":"2024-08-20T04:59:09.947117+0000","last_unstale":"2024-08-20T05:00:04.144763+0000","last_undegraded":"2024-08-20T05:00:04.144763+0000","last_fullsized":"2024-08-20T05:00:04.144763+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:22:05.815486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.227287+0000","last_change":"2024-08-20T04:59:21.910776+0000","last_active":"2024-08-20T04:59:26.227287+0000","last_peered":"2024-08-20T04:59:26.227287+0000","last_clean":"2024-08-20T04:59:26.227287+0000","last_became_active":"2024-08-20T04:59:21.909726+0000","last_became_peered":"2024-08-20T04:59:21.909726+0000","last_unstale":"2024-08-20T04:59:26.227287+0000","last_undegraded":"2024-08-20T04:59:26.227287+0000","last_fullsized":"2024-08-20T04:59:26.227287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:03:04.042649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020880+0000","last_change":"2024-08-20T04:59:12.788839+0000","last_active":"2024-08-20T04:59:26.020880+0000","last_peered":"2024-08-20T04:59:26.020880+0000","last_clean":"2024-08-20T04:59:26.020880+0000","last_became_active":"2024-08-20T04:59:12.788363+0000","last_became_peered":"2024-08-20T04:59:12.788363+0000","last_unstale":"2024-08-20T04:59:26.020880+0000","last_undegraded":"2024-08-20T04:59:26.020880+0000","last_fullsized":"2024-08-20T04:59:26.020880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:26:29.144455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.150446+0000","last_change":"2024-08-20T04:59:09.747316+0000","last_active":"2024-08-20T05:00:05.150446+0000","last_peered":"2024-08-20T05:00:05.150446+0000","last_clean":"2024-08-20T05:00:05.150446+0000","last_became_active":"2024-08-20T04:59:09.746959+0000","last_became_peered":"2024-08-20T04:59:09.746959+0000","last_unstale":"2024-08-20T05:00:05.150446+0000","last_undegraded":"2024-08-20T05:00:05.150446+0000","last_fullsized":"2024-08-20T05:00:05.150446+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:28.480465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.546718+0000","last_change":"2024-08-20T04:59:21.907940+0000","last_active":"2024-08-20T04:59:26.546718+0000","last_peered":"2024-08-20T04:59:26.546718+0000","last_clean":"2024-08-20T04:59:26.546718+0000","last_became_active":"2024-08-20T04:59:21.907591+0000","last_became_peered":"2024-08-20T04:59:21.907591+0000","last_unstale":"2024-08-20T04:59:26.546718+0000","last_undegraded":"2024-08-20T04:59:26.546718+0000","last_fullsized":"2024-08-20T04:59:26.546718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:33.583556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904729+0000","last_change":"2024-08-20T04:59:12.795662+0000","last_active":"2024-08-20T04:59:25.904729+0000","last_peered":"2024-08-20T04:59:25.904729+0000","last_clean":"2024-08-20T04:59:25.904729+0000","last_became_active":"2024-08-20T04:59:12.795321+0000","last_became_peered":"2024-08-20T04:59:12.795321+0000","last_unstale":"2024-08-20T04:59:25.904729+0000","last_undegraded":"2024-08-20T04:59:25.904729+0000","last_fullsized":"2024-08-20T04:59:25.904729+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:40:30.561306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":66,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:18.173529+0000","last_change":"2024-08-20T04:59:09.754468+0000","last_active":"2024-08-20T05:00:18.173529+0000","last_peered":"2024-08-20T05:00:18.173529+0000","last_clean":"2024-08-20T05:00:18.173529+0000","last_became_active":"2024-08-20T04:59:09.754115+0000","last_became_peered":"2024-08-20T04:59:09.754115+0000","last_unstale":"2024-08-20T05:00:18.173529+0000","last_undegraded":"2024-08-20T05:00:18.173529+0000","last_fullsized":"2024-08-20T05:00:18.173529+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:50:21.301246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294529+0000","last_change":"2024-08-20T04:59:21.898785+0000","last_active":"2024-08-20T04:59:26.294529+0000","last_peered":"2024-08-20T04:59:26.294529+0000","last_clean":"2024-08-20T04:59:26.294529+0000","last_became_active":"2024-08-20T04:59:21.898423+0000","last_became_peered":"2024-08-20T04:59:21.898423+0000","last_unstale":"2024-08-20T04:59:26.294529+0000","last_undegraded":"2024-08-20T04:59:26.294529+0000","last_fullsized":"2024-08-20T04:59:26.294529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:52:58.800104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020823+0000","last_change":"2024-08-20T04:59:21.906208+0000","last_active":"2024-08-20T04:59:26.020823+0000","last_peered":"2024-08-20T04:59:26.020823+0000","last_clean":"2024-08-20T04:59:26.020823+0000","last_became_active":"2024-08-20T04:59:21.905041+0000","last_became_peered":"2024-08-20T04:59:21.905041+0000","last_unstale":"2024-08-20T04:59:26.020823+0000","last_undegraded":"2024-08-20T04:59:26.020823+0000","last_fullsized":"2024-08-20T04:59:26.020823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:05:28.971357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.546722+0000","last_change":"2024-08-20T04:59:12.788130+0000","last_active":"2024-08-20T04:59:26.546722+0000","last_peered":"2024-08-20T04:59:26.546722+0000","last_clean":"2024-08-20T04:59:26.546722+0000","last_became_active":"2024-08-20T04:59:12.787665+0000","last_became_peered":"2024-08-20T04:59:12.787665+0000","last_unstale":"2024-08-20T04:59:26.546722+0000","last_undegraded":"2024-08-20T04:59:26.546722+0000","last_fullsized":"2024-08-20T04:59:26.546722+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:59:39.628781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.151585+0000","last_change":"2024-08-20T04:59:09.754842+0000","last_active":"2024-08-20T05:00:05.151585+0000","last_peered":"2024-08-20T05:00:05.151585+0000","last_clean":"2024-08-20T05:00:05.151585+0000","last_became_active":"2024-08-20T04:59:09.754515+0000","last_became_peered":"2024-08-20T04:59:09.754515+0000","last_unstale":"2024-08-20T05:00:05.151585+0000","last_undegraded":"2024-08-20T05:00:05.151585+0000","last_fullsized":"2024-08-20T05:00:05.151585+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:19:02.241567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.546918+0000","last_change":"2024-08-20T04:59:21.900610+0000","last_active":"2024-08-20T04:59:26.546918+0000","last_peered":"2024-08-20T04:59:26.546918+0000","last_clean":"2024-08-20T04:59:26.546918+0000","last_became_active":"2024-08-20T04:59:21.900207+0000","last_became_peered":"2024-08-20T04:59:21.900207+0000","last_unstale":"2024-08-20T04:59:26.546918+0000","last_undegraded":"2024-08-20T04:59:26.546918+0000","last_fullsized":"2024-08-20T04:59:26.546918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:41:00.115344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294510+0000","last_change":"2024-08-20T04:59:12.780772+0000","last_active":"2024-08-20T04:59:26.294510+0000","last_peered":"2024-08-20T04:59:26.294510+0000","last_clean":"2024-08-20T04:59:26.294510+0000","last_became_active":"2024-08-20T04:59:12.780385+0000","last_became_peered":"2024-08-20T04:59:12.780385+0000","last_unstale":"2024-08-20T04:59:26.294510+0000","last_undegraded":"2024-08-20T04:59:26.294510+0000","last_fullsized":"2024-08-20T04:59:26.294510+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:23.680899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:03.133873+0000","last_change":"2024-08-20T04:59:09.749567+0000","last_active":"2024-08-20T05:00:03.133873+0000","last_peered":"2024-08-20T05:00:03.133873+0000","last_clean":"2024-08-20T05:00:03.133873+0000","last_became_active":"2024-08-20T04:59:09.749204+0000","last_became_peered":"2024-08-20T04:59:09.749204+0000","last_unstale":"2024-08-20T05:00:03.133873+0000","last_undegraded":"2024-08-20T05:00:03.133873+0000","last_fullsized":"2024-08-20T05:00:03.133873+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:57:51.236459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:04.143615+0000","last_change":"2024-08-20T04:59:09.751622+0000","last_active":"2024-08-20T05:00:04.143615+0000","last_peered":"2024-08-20T05:00:04.143615+0000","last_clean":"2024-08-20T05:00:04.143615+0000","last_became_active":"2024-08-20T04:59:09.751227+0000","last_became_peered":"2024-08-20T04:59:09.751227+0000","last_unstale":"2024-08-20T05:00:04.143615+0000","last_undegraded":"2024-08-20T05:00:04.143615+0000","last_fullsized":"2024-08-20T05:00:04.143615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:53:38.755122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904396+0000","last_change":"2024-08-20T04:59:12.789243+0000","last_active":"2024-08-20T04:59:25.904396+0000","last_peered":"2024-08-20T04:59:25.904396+0000","last_clean":"2024-08-20T04:59:25.904396+0000","last_became_active":"2024-08-20T04:59:12.788932+0000","last_became_peered":"2024-08-20T04:59:12.788932+0000","last_unstale":"2024-08-20T04:59:25.904396+0000","last_undegraded":"2024-08-20T04:59:25.904396+0000","last_fullsized":"2024-08-20T04:59:25.904396+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:27:00.122328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.432713+0000","last_change":"2024-08-20T04:59:21.902847+0000","last_active":"2024-08-20T04:59:26.432713+0000","last_peered":"2024-08-20T04:59:26.432713+0000","last_clean":"2024-08-20T04:59:26.432713+0000","last_became_active":"2024-08-20T04:59:21.902426+0000","last_became_peered":"2024-08-20T04:59:21.902426+0000","last_unstale":"2024-08-20T04:59:26.432713+0000","last_undegraded":"2024-08-20T04:59:26.432713+0000","last_fullsized":"2024-08-20T04:59:26.432713+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:18:38.107358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":58,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:19.175940+0000","last_change":"2024-08-20T04:59:09.754977+0000","last_active":"2024-08-20T05:00:19.175940+0000","last_peered":"2024-08-20T05:00:19.175940+0000","last_clean":"2024-08-20T05:00:19.175940+0000","last_became_active":"2024-08-20T04:59:09.754078+0000","last_became_peered":"2024-08-20T04:59:09.754078+0000","last_unstale":"2024-08-20T05:00:19.175940+0000","last_undegraded":"2024-08-20T05:00:19.175940+0000","last_fullsized":"2024-08-20T05:00:19.175940+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:47:42.125326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.546819+0000","last_change":"2024-08-20T04:59:12.785811+0000","last_active":"2024-08-20T04:59:26.546819+0000","last_peered":"2024-08-20T04:59:26.546819+0000","last_clean":"2024-08-20T04:59:26.546819+0000","last_became_active":"2024-08-20T04:59:12.785483+0000","last_became_peered":"2024-08-20T04:59:12.785483+0000","last_unstale":"2024-08-20T04:59:26.546819+0000","last_undegraded":"2024-08-20T04:59:26.546819+0000","last_fullsized":"2024-08-20T04:59:26.546819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:31:25.355197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.432930+0000","last_change":"2024-08-20T04:59:21.897832+0000","last_active":"2024-08-20T04:59:26.432930+0000","last_peered":"2024-08-20T04:59:26.432930+0000","last_clean":"2024-08-20T04:59:26.432930+0000","last_became_active":"2024-08-20T04:59:21.897457+0000","last_became_peered":"2024-08-20T04:59:21.897457+0000","last_unstale":"2024-08-20T04:59:26.432930+0000","last_undegraded":"2024-08-20T04:59:26.432930+0000","last_fullsized":"2024-08-20T04:59:26.432930+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:39:51.934014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547220+0000","last_change":"2024-08-20T04:59:12.787671+0000","last_active":"2024-08-20T04:59:26.547220+0000","last_peered":"2024-08-20T04:59:26.547220+0000","last_clean":"2024-08-20T04:59:26.547220+0000","last_became_active":"2024-08-20T04:59:12.787372+0000","last_became_peered":"2024-08-20T04:59:12.787372+0000","last_unstale":"2024-08-20T04:59:26.547220+0000","last_undegraded":"2024-08-20T04:59:26.547220+0000","last_fullsized":"2024-08-20T04:59:26.547220+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:16:55.031031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.433010+0000","last_change":"2024-08-20T04:59:12.792192+0000","last_active":"2024-08-20T04:59:26.433010+0000","last_peered":"2024-08-20T04:59:26.433010+0000","last_clean":"2024-08-20T04:59:26.433010+0000","last_became_active":"2024-08-20T04:59:12.791447+0000","last_became_peered":"2024-08-20T04:59:12.791447+0000","last_unstale":"2024-08-20T04:59:26.433010+0000","last_undegraded":"2024-08-20T04:59:26.433010+0000","last_fullsized":"2024-08-20T04:59:26.433010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:03:32.559245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.432503+0000","last_change":"2024-08-20T04:59:12.785393+0000","last_active":"2024-08-20T04:59:26.432503+0000","last_peered":"2024-08-20T04:59:26.432503+0000","last_clean":"2024-08-20T04:59:26.432503+0000","last_became_active":"2024-08-20T04:59:12.784998+0000","last_became_peered":"2024-08-20T04:59:12.784998+0000","last_unstale":"2024-08-20T04:59:26.432503+0000","last_undegraded":"2024-08-20T04:59:26.432503+0000","last_fullsized":"2024-08-20T04:59:26.432503+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:27:04.964290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020584+0000","last_change":"2024-08-20T04:59:12.784730+0000","last_active":"2024-08-20T04:59:26.020584+0000","last_peered":"2024-08-20T04:59:26.020584+0000","last_clean":"2024-08-20T04:59:26.020584+0000","last_became_active":"2024-08-20T04:59:12.784269+0000","last_became_peered":"2024-08-20T04:59:12.784269+0000","last_unstale":"2024-08-20T04:59:26.020584+0000","last_undegraded":"2024-08-20T04:59:26.020584+0000","last_fullsized":"2024-08-20T04:59:26.020584+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:43:12.248033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904125+0000","last_change":"2024-08-20T04:59:12.786484+0000","last_active":"2024-08-20T04:59:25.904125+0000","last_peered":"2024-08-20T04:59:25.904125+0000","last_clean":"2024-08-20T04:59:25.904125+0000","last_became_active":"2024-08-20T04:59:12.786166+0000","last_became_peered":"2024-08-20T04:59:12.786166+0000","last_unstale":"2024-08-20T04:59:25.904125+0000","last_undegraded":"2024-08-20T04:59:25.904125+0000","last_fullsized":"2024-08-20T04:59:25.904125+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:30.084519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547565+0000","last_change":"2024-08-20T04:59:12.786985+0000","last_active":"2024-08-20T04:59:26.547565+0000","last_peered":"2024-08-20T04:59:26.547565+0000","last_clean":"2024-08-20T04:59:26.547565+0000","last_became_active":"2024-08-20T04:59:12.786674+0000","last_became_peered":"2024-08-20T04:59:12.786674+0000","last_unstale":"2024-08-20T04:59:26.547565+0000","last_undegraded":"2024-08-20T04:59:26.547565+0000","last_fullsized":"2024-08-20T04:59:26.547565+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:30:59.996149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.432950+0000","last_change":"2024-08-20T04:59:12.796410+0000","last_active":"2024-08-20T04:59:26.432950+0000","last_peered":"2024-08-20T04:59:26.432950+0000","last_clean":"2024-08-20T04:59:26.432950+0000","last_became_active":"2024-08-20T04:59:12.796081+0000","last_became_peered":"2024-08-20T04:59:12.796081+0000","last_unstale":"2024-08-20T04:59:26.432950+0000","last_undegraded":"2024-08-20T04:59:26.432950+0000","last_fullsized":"2024-08-20T04:59:26.432950+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:49:09.706265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.295080+0000","last_change":"2024-08-20T04:59:12.795994+0000","last_active":"2024-08-20T04:59:26.295080+0000","last_peered":"2024-08-20T04:59:26.295080+0000","last_clean":"2024-08-20T04:59:26.295080+0000","last_became_active":"2024-08-20T04:59:12.795604+0000","last_became_peered":"2024-08-20T04:59:12.795604+0000","last_unstale":"2024-08-20T04:59:26.295080+0000","last_undegraded":"2024-08-20T04:59:26.295080+0000","last_fullsized":"2024-08-20T04:59:26.295080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:54:09.628743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904322+0000","last_change":"2024-08-20T04:59:12.788966+0000","last_active":"2024-08-20T04:59:25.904322+0000","last_peered":"2024-08-20T04:59:25.904322+0000","last_clean":"2024-08-20T04:59:25.904322+0000","last_became_active":"2024-08-20T04:59:12.788534+0000","last_became_peered":"2024-08-20T04:59:12.788534+0000","last_unstale":"2024-08-20T04:59:25.904322+0000","last_undegraded":"2024-08-20T04:59:25.904322+0000","last_fullsized":"2024-08-20T04:59:25.904322+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.615399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294509+0000","last_change":"2024-08-20T04:59:12.785914+0000","last_active":"2024-08-20T04:59:26.294509+0000","last_peered":"2024-08-20T04:59:26.294509+0000","last_clean":"2024-08-20T04:59:26.294509+0000","last_became_active":"2024-08-20T04:59:12.785551+0000","last_became_peered":"2024-08-20T04:59:12.785551+0000","last_unstale":"2024-08-20T04:59:26.294509+0000","last_undegraded":"2024-08-20T04:59:26.294509+0000","last_fullsized":"2024-08-20T04:59:26.294509+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:30:32.072387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904302+0000","last_change":"2024-08-20T04:59:12.795635+0000","last_active":"2024-08-20T04:59:25.904302+0000","last_peered":"2024-08-20T04:59:25.904302+0000","last_clean":"2024-08-20T04:59:25.904302+0000","last_became_active":"2024-08-20T04:59:12.794805+0000","last_became_peered":"2024-08-20T04:59:12.794805+0000","last_unstale":"2024-08-20T04:59:25.904302+0000","last_undegraded":"2024-08-20T04:59:25.904302+0000","last_fullsized":"2024-08-20T04:59:25.904302+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:09:08.725503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.903884+0000","last_change":"2024-08-20T04:59:12.785099+0000","last_active":"2024-08-20T04:59:25.903884+0000","last_peered":"2024-08-20T04:59:25.903884+0000","last_clean":"2024-08-20T04:59:25.903884+0000","last_became_active":"2024-08-20T04:59:12.784727+0000","last_became_peered":"2024-08-20T04:59:12.784727+0000","last_unstale":"2024-08-20T04:59:25.903884+0000","last_undegraded":"2024-08-20T04:59:25.903884+0000","last_fullsized":"2024-08-20T04:59:25.903884+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:24:36.227289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547177+0000","last_change":"2024-08-20T04:59:12.781832+0000","last_active":"2024-08-20T04:59:26.547177+0000","last_peered":"2024-08-20T04:59:26.547177+0000","last_clean":"2024-08-20T04:59:26.547177+0000","last_became_active":"2024-08-20T04:59:12.781342+0000","last_became_peered":"2024-08-20T04:59:12.781342+0000","last_unstale":"2024-08-20T04:59:26.547177+0000","last_undegraded":"2024-08-20T04:59:26.547177+0000","last_fullsized":"2024-08-20T04:59:26.547177+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:26:17.762048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.432967+0000","last_change":"2024-08-20T04:59:12.792350+0000","last_active":"2024-08-20T04:59:26.432967+0000","last_peered":"2024-08-20T04:59:26.432967+0000","last_clean":"2024-08-20T04:59:26.432967+0000","last_became_active":"2024-08-20T04:59:12.792028+0000","last_became_peered":"2024-08-20T04:59:12.792028+0000","last_unstale":"2024-08-20T04:59:26.432967+0000","last_undegraded":"2024-08-20T04:59:26.432967+0000","last_fullsized":"2024-08-20T04:59:26.432967+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:16:23.173759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547435+0000","last_change":"2024-08-20T04:59:12.795047+0000","last_active":"2024-08-20T04:59:26.547435+0000","last_peered":"2024-08-20T04:59:26.547435+0000","last_clean":"2024-08-20T04:59:26.547435+0000","last_became_active":"2024-08-20T04:59:12.794705+0000","last_became_peered":"2024-08-20T04:59:12.794705+0000","last_unstale":"2024-08-20T04:59:26.547435+0000","last_undegraded":"2024-08-20T04:59:26.547435+0000","last_fullsized":"2024-08-20T04:59:26.547435+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:51:16.355892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547432+0000","last_change":"2024-08-20T04:59:12.785022+0000","last_active":"2024-08-20T04:59:26.547432+0000","last_peered":"2024-08-20T04:59:26.547432+0000","last_clean":"2024-08-20T04:59:26.547432+0000","last_became_active":"2024-08-20T04:59:12.784730+0000","last_became_peered":"2024-08-20T04:59:12.784730+0000","last_unstale":"2024-08-20T04:59:26.547432+0000","last_undegraded":"2024-08-20T04:59:26.547432+0000","last_fullsized":"2024-08-20T04:59:26.547432+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:21:53.053890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.903982+0000","last_change":"2024-08-20T04:59:12.790825+0000","last_active":"2024-08-20T04:59:25.903982+0000","last_peered":"2024-08-20T04:59:25.903982+0000","last_clean":"2024-08-20T04:59:25.903982+0000","last_became_active":"2024-08-20T04:59:12.790299+0000","last_became_peered":"2024-08-20T04:59:12.790299+0000","last_unstale":"2024-08-20T04:59:25.903982+0000","last_undegraded":"2024-08-20T04:59:25.903982+0000","last_fullsized":"2024-08-20T04:59:25.903982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:12.477186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020338+0000","last_change":"2024-08-20T04:59:12.786237+0000","last_active":"2024-08-20T04:59:26.020338+0000","last_peered":"2024-08-20T04:59:26.020338+0000","last_clean":"2024-08-20T04:59:26.020338+0000","last_became_active":"2024-08-20T04:59:12.785829+0000","last_became_peered":"2024-08-20T04:59:12.785829+0000","last_unstale":"2024-08-20T04:59:26.020338+0000","last_undegraded":"2024-08-20T04:59:26.020338+0000","last_fullsized":"2024-08-20T04:59:26.020338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:29:04.330564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020341+0000","last_change":"2024-08-20T04:59:12.783355+0000","last_active":"2024-08-20T04:59:26.020341+0000","last_peered":"2024-08-20T04:59:26.020341+0000","last_clean":"2024-08-20T04:59:26.020341+0000","last_became_active":"2024-08-20T04:59:12.782992+0000","last_became_peered":"2024-08-20T04:59:12.782992+0000","last_unstale":"2024-08-20T04:59:26.020341+0000","last_undegraded":"2024-08-20T04:59:26.020341+0000","last_fullsized":"2024-08-20T04:59:26.020341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:09:47.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.903857+0000","last_change":"2024-08-20T04:59:12.783989+0000","last_active":"2024-08-20T04:59:25.903857+0000","last_peered":"2024-08-20T04:59:25.903857+0000","last_clean":"2024-08-20T04:59:25.903857+0000","last_became_active":"2024-08-20T04:59:12.783671+0000","last_became_peered":"2024-08-20T04:59:12.783671+0000","last_unstale":"2024-08-20T04:59:25.903857+0000","last_undegraded":"2024-08-20T04:59:25.903857+0000","last_fullsized":"2024-08-20T04:59:25.903857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:34:55.727599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.227508+0000","last_change":"2024-08-20T04:59:12.787118+0000","last_active":"2024-08-20T04:59:26.227508+0000","last_peered":"2024-08-20T04:59:26.227508+0000","last_clean":"2024-08-20T04:59:26.227508+0000","last_became_active":"2024-08-20T04:59:12.786754+0000","last_became_peered":"2024-08-20T04:59:12.786754+0000","last_unstale":"2024-08-20T04:59:26.227508+0000","last_undegraded":"2024-08-20T04:59:26.227508+0000","last_fullsized":"2024-08-20T04:59:26.227508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:13:23.959972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.528040+0000","last_change":"2024-08-20T04:59:12.793748+0000","last_active":"2024-08-20T04:59:26.528040+0000","last_peered":"2024-08-20T04:59:26.528040+0000","last_clean":"2024-08-20T04:59:26.528040+0000","last_became_active":"2024-08-20T04:59:12.792550+0000","last_became_peered":"2024-08-20T04:59:12.792550+0000","last_unstale":"2024-08-20T04:59:26.528040+0000","last_undegraded":"2024-08-20T04:59:26.528040+0000","last_fullsized":"2024-08-20T04:59:26.528040+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:59:24.226273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.980105+0000","last_change":"2024-08-20T04:59:12.788827+0000","last_active":"2024-08-20T04:59:25.980105+0000","last_peered":"2024-08-20T04:59:25.980105+0000","last_clean":"2024-08-20T04:59:25.980105+0000","last_became_active":"2024-08-20T04:59:12.788395+0000","last_became_peered":"2024-08-20T04:59:12.788395+0000","last_unstale":"2024-08-20T04:59:25.980105+0000","last_undegraded":"2024-08-20T04:59:25.980105+0000","last_fullsized":"2024-08-20T04:59:25.980105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:26.453063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904753+0000","last_change":"2024-08-20T04:59:12.795513+0000","last_active":"2024-08-20T04:59:25.904753+0000","last_peered":"2024-08-20T04:59:25.904753+0000","last_clean":"2024-08-20T04:59:25.904753+0000","last_became_active":"2024-08-20T04:59:12.795191+0000","last_became_peered":"2024-08-20T04:59:12.795191+0000","last_unstale":"2024-08-20T04:59:25.904753+0000","last_undegraded":"2024-08-20T04:59:25.904753+0000","last_fullsized":"2024-08-20T04:59:25.904753+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:04:00.893420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294465+0000","last_change":"2024-08-20T04:59:12.789825+0000","last_active":"2024-08-20T04:59:26.294465+0000","last_peered":"2024-08-20T04:59:26.294465+0000","last_clean":"2024-08-20T04:59:26.294465+0000","last_became_active":"2024-08-20T04:59:12.788198+0000","last_became_peered":"2024-08-20T04:59:12.788198+0000","last_unstale":"2024-08-20T04:59:26.294465+0000","last_undegraded":"2024-08-20T04:59:26.294465+0000","last_fullsized":"2024-08-20T04:59:26.294465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:10.898308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.527583+0000","last_change":"2024-08-20T04:59:12.787707+0000","last_active":"2024-08-20T04:59:26.527583+0000","last_peered":"2024-08-20T04:59:26.527583+0000","last_clean":"2024-08-20T04:59:26.527583+0000","last_became_active":"2024-08-20T04:59:12.787035+0000","last_became_peered":"2024-08-20T04:59:12.787035+0000","last_unstale":"2024-08-20T04:59:26.527583+0000","last_undegraded":"2024-08-20T04:59:26.527583+0000","last_fullsized":"2024-08-20T04:59:26.527583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:16:52.451048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.979647+0000","last_change":"2024-08-20T04:59:12.784012+0000","last_active":"2024-08-20T04:59:25.979647+0000","last_peered":"2024-08-20T04:59:25.979647+0000","last_clean":"2024-08-20T04:59:25.979647+0000","last_became_active":"2024-08-20T04:59:12.783599+0000","last_became_peered":"2024-08-20T04:59:12.783599+0000","last_unstale":"2024-08-20T04:59:25.979647+0000","last_undegraded":"2024-08-20T04:59:25.979647+0000","last_fullsized":"2024-08-20T04:59:25.979647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:23:15.271873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.546591+0000","last_change":"2024-08-20T04:59:12.784987+0000","last_active":"2024-08-20T04:59:26.546591+0000","last_peered":"2024-08-20T04:59:26.546591+0000","last_clean":"2024-08-20T04:59:26.546591+0000","last_became_active":"2024-08-20T04:59:12.784693+0000","last_became_peered":"2024-08-20T04:59:12.784693+0000","last_unstale":"2024-08-20T04:59:26.546591+0000","last_undegraded":"2024-08-20T04:59:26.546591+0000","last_fullsized":"2024-08-20T04:59:26.546591+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:07:51.624602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.227392+0000","last_change":"2024-08-20T04:59:12.792466+0000","last_active":"2024-08-20T04:59:26.227392+0000","last_peered":"2024-08-20T04:59:26.227392+0000","last_clean":"2024-08-20T04:59:26.227392+0000","last_became_active":"2024-08-20T04:59:12.792114+0000","last_became_peered":"2024-08-20T04:59:12.792114+0000","last_unstale":"2024-08-20T04:59:26.227392+0000","last_undegraded":"2024-08-20T04:59:26.227392+0000","last_fullsized":"2024-08-20T04:59:26.227392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:23:09.919907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020538+0000","last_change":"2024-08-20T04:59:12.793041+0000","last_active":"2024-08-20T04:59:26.020538+0000","last_peered":"2024-08-20T04:59:26.020538+0000","last_clean":"2024-08-20T04:59:26.020538+0000","last_became_active":"2024-08-20T04:59:12.792709+0000","last_became_peered":"2024-08-20T04:59:12.792709+0000","last_unstale":"2024-08-20T04:59:26.020538+0000","last_undegraded":"2024-08-20T04:59:26.020538+0000","last_fullsized":"2024-08-20T04:59:26.020538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:09:04.523493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020698+0000","last_change":"2024-08-20T04:59:12.790256+0000","last_active":"2024-08-20T04:59:26.020698+0000","last_peered":"2024-08-20T04:59:26.020698+0000","last_clean":"2024-08-20T04:59:26.020698+0000","last_became_active":"2024-08-20T04:59:12.788467+0000","last_became_peered":"2024-08-20T04:59:12.788467+0000","last_unstale":"2024-08-20T04:59:26.020698+0000","last_undegraded":"2024-08-20T04:59:26.020698+0000","last_fullsized":"2024-08-20T04:59:26.020698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:55:31.386030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547385+0000","last_change":"2024-08-20T04:59:12.794882+0000","last_active":"2024-08-20T04:59:26.547385+0000","last_peered":"2024-08-20T04:59:26.547385+0000","last_clean":"2024-08-20T04:59:26.547385+0000","last_became_active":"2024-08-20T04:59:12.794564+0000","last_became_peered":"2024-08-20T04:59:12.794564+0000","last_unstale":"2024-08-20T04:59:26.547385+0000","last_undegraded":"2024-08-20T04:59:26.547385+0000","last_fullsized":"2024-08-20T04:59:26.547385+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:36:47.515754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":59099,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":174,"num_read_kb":151,"num_write":239,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":181562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743451,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":472714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939680,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28624,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716528,"statfs":{"total":95995035648,"available":95965724672,"internally_reserved":0,"allocated":1638400,"data_stored":1111425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103206,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":476349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299435,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":472631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462959,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1572864,"data_stored":1069128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626486,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":467757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822715,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1581056,"data_stored":1064319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986239,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":472222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182469,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":467465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1032192,"data_stored":521293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":520682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":469604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":54022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T05:00:23.949 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-20T05:00:24.330 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:24.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:24 smithi135 ceph-mon[22342]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:00:24.643 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:24 smithi037 ceph-mon[17265]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:00:24.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:24 smithi130 ceph-mon[22007]: from='client.14883 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:00:24.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.908+0000 7ff9e5e00640 1 -- 172.21.15.37:0/2627115781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e010a510 msgr2=0x7ff9e010a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:24.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.908+0000 7ff9e5e00640 1 --2- 172.21.15.37:0/2627115781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e010a510 0x7ff9e010a950 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8009900 tx=0x7ff9c802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:00:24.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.908+0000 7ff9e5e00640 1 -- 172.21.15.37:0/2627115781 shutdown_connections 2024-08-20T05:00:24.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.908+0000 7ff9e5e00640 1 --2- 172.21.15.37:0/2627115781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e010ae90 0x7ff9e0111690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:24.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.908+0000 7ff9e5e00640 1 --2- 172.21.15.37:0/2627115781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e010a510 0x7ff9e010a950 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.908+0000 7ff9e5e00640 1 --2- 172.21.15.37:0/2627115781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0104b00 0x7ff9e0104ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.908+0000 7ff9e5e00640 1 -- 172.21.15.37:0/2627115781 >> 172.21.15.37:0/2627115781 conn(0x7ff9e0100550 msgr2=0x7ff9e0102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.909+0000 7ff9e5e00640 1 -- 172.21.15.37:0/2627115781 shutdown_connections 2024-08-20T05:00:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.909+0000 7ff9e5e00640 1 -- 172.21.15.37:0/2627115781 wait complete. 2024-08-20T05:00:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.910+0000 7ff9e5e00640 1 Processor -- start 2024-08-20T05:00:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.910+0000 7ff9e5e00640 1 -- start start 2024-08-20T05:00:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.910+0000 7ff9e5e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0104b00 0x7ff9e019aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.910+0000 7ff9e5e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e010a510 0x7ff9e019b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.910+0000 7ff9e5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e010ae90 0x7ff9e01a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.910+0000 7ff9e5e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e0114ae0 con 0x7ff9e010ae90 2024-08-20T05:00:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.910+0000 7ff9e5e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e0114960 con 0x7ff9e0104b00 2024-08-20T05:00:24.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.910+0000 7ff9e5e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e0114c60 con 0x7ff9e010a510 2024-08-20T05:00:24.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.910+0000 7ff9e5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e010ae90 0x7ff9e01a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:24.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.911+0000 7ff9e5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e010ae90 0x7ff9e01a07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45594/0 (socket says 172.21.15.37:45594) 2024-08-20T05:00:24.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.911+0000 7ff9d7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e010a510 0x7ff9e019b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:24.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.911+0000 7ff9e4a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0104b00 0x7ff9e019aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:24.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.911+0000 7ff9e5400640 1 -- 172.21.15.37:0/2177064818 learned_addr learned my addr 172.21.15.37:0/2177064818 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:24.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.911+0000 7ff9e5400640 1 -- 172.21.15.37:0/2177064818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e010a510 msgr2=0x7ff9e019b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:24.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.911+0000 7ff9e5400640 1 --2- 172.21.15.37:0/2177064818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e010a510 0x7ff9e019b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:24.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.911+0000 7ff9e5400640 1 -- 172.21.15.37:0/2177064818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0104b00 msgr2=0x7ff9e019aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:24.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.911+0000 7ff9e5400640 1 --2- 172.21.15.37:0/2177064818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0104b00 0x7ff9e019aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:24.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.911+0000 7ff9e5400640 1 -- 172.21.15.37:0/2177064818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e01a0f80 con 0x7ff9e010ae90 2024-08-20T05:00:24.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.911+0000 7ff9e5400640 1 --2- 172.21.15.37:0/2177064818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e010ae90 0x7ff9e01a07b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800eaa0 tx=0x7ff9d800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:24.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.911+0000 7ff9de000640 1 -- 172.21.15.37:0/2177064818 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d800cdb0 con 0x7ff9e010ae90 2024-08-20T05:00:24.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.911+0000 7ff9e5e00640 1 -- 172.21.15.37:0/2177064818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e01a1270 con 0x7ff9e010ae90 2024-08-20T05:00:24.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.911+0000 7ff9de000640 1 -- 172.21.15.37:0/2177064818 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9d8005020 con 0x7ff9e010ae90 2024-08-20T05:00:24.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.912+0000 7ff9e5e00640 1 -- 172.21.15.37:0/2177064818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e01a7930 con 0x7ff9e010ae90 2024-08-20T05:00:24.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.912+0000 7ff9de000640 1 -- 172.21.15.37:0/2177064818 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d801f060 con 0x7ff9e010ae90 2024-08-20T05:00:24.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.913+0000 7ff9e5e00640 1 -- 172.21.15.37:0/2177064818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e0104ee0 con 0x7ff9e010ae90 2024-08-20T05:00:24.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.915+0000 7ff9de000640 1 -- 172.21.15.37:0/2177064818 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7ff9d80051d0 con 0x7ff9e010ae90 2024-08-20T05:00:24.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.917+0000 7ff9de000640 1 --2- 172.21.15.37:0/2177064818 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9c40b3d10 0x7ff9c40b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:24.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.917+0000 7ff9de000640 1 -- 172.21.15.37:0/2177064818 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7ff9d80e40f0 con 0x7ff9e010ae90 2024-08-20T05:00:24.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.917+0000 7ff9e4a00640 1 --2- 172.21.15.37:0/2177064818 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9c40b3d10 0x7ff9c40b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:24.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.918+0000 7ff9e4a00640 1 --2- 172.21.15.37:0/2177064818 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9c40b3d10 0x7ff9c40b61d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000bbe0 tx=0x7ff9d000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:24.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:24.920+0000 7ff9de000640 1 -- 172.21.15.37:0/2177064818 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff9d8016030 con 0x7ff9e010ae90 2024-08-20T05:00:25.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:25.113+0000 7ff9e5e00640 1 -- 172.21.15.37:0/2177064818 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff9e00632c0 con 0x7ff9c40b3d10 2024-08-20T05:00:25.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:25.119+0000 7ff9de000640 1 -- 172.21.15.37:0/2177064818 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340377 (secure 0 0 0) 0x7ff9e00632c0 con 0x7ff9c40b3d10 2024-08-20T05:00:25.124 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:00:25.126 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-20T05:00:25.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:25.123+0000 7ff9e5e00640 1 -- 172.21.15.37:0/2177064818 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9c40b3d10 msgr2=0x7ff9c40b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:25.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:25.123+0000 7ff9e5e00640 1 --2- 172.21.15.37:0/2177064818 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9c40b3d10 0x7ff9c40b61d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000bbe0 tx=0x7ff9d000b390 comp rx=0 tx=0).stop 2024-08-20T05:00:25.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:25.123+0000 7ff9e5e00640 1 -- 172.21.15.37:0/2177064818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e010ae90 msgr2=0x7ff9e01a07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:25.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:25.123+0000 7ff9e5e00640 1 --2- 172.21.15.37:0/2177064818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e010ae90 0x7ff9e01a07b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800eaa0 tx=0x7ff9d800ef60 comp rx=0 tx=0).stop 2024-08-20T05:00:25.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:25.123+0000 7ff9e5e00640 1 -- 172.21.15.37:0/2177064818 shutdown_connections 2024-08-20T05:00:25.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:25.123+0000 7ff9e5e00640 1 --2- 172.21.15.37:0/2177064818 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9c40b3d10 0x7ff9c40b61d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:25.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:25.123+0000 7ff9e5e00640 1 --2- 172.21.15.37:0/2177064818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e010ae90 0x7ff9e01a07b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:25.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:25.123+0000 7ff9e5e00640 1 --2- 172.21.15.37:0/2177064818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9e010a510 0x7ff9e019b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:25.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:25.123+0000 7ff9e5e00640 1 --2- 172.21.15.37:0/2177064818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9e0104b00 0x7ff9e019aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:25.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:25.124+0000 7ff9e5e00640 1 -- 172.21.15.37:0/2177064818 >> 172.21.15.37:0/2177064818 conn(0x7ff9e0100550 msgr2=0x7ff9e0102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:25.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:25.124+0000 7ff9e5e00640 1 -- 172.21.15.37:0/2177064818 shutdown_connections 2024-08-20T05:00:25.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:25.124+0000 7ff9e5e00640 1 -- 172.21.15.37:0/2177064818 wait complete. 2024-08-20T05:00:25.525 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:25 smithi037 ceph-mon[17265]: pgmap v342: 129 pgs: 129 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2024-08-20T05:00:25.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:25 smithi135 ceph-mon[22342]: pgmap v342: 129 pgs: 129 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2024-08-20T05:00:25.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:25 smithi130 ceph-mon[22007]: pgmap v342: 129 pgs: 129 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.8 KiB/s wr, 14 op/s 2024-08-20T05:00:25.887 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-08-20T05:00:23.989208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653966,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":286,"num_read_kb":240,"num_write":369,"num_write_kb":2286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362544,"kb_used_data":13296,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124579280,"statfs":{"total":1151940427776,"available":1151569182720,"internally_reserved":0,"allocated":13615104,"data_stored":7589854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45952,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":142,"num_read_kb":125,"num_write":31,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003274"},"pg_stats":[{"pgid":"2.1f","version":"84'13","reported_seq":66,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:21.181870+0000","last_change":"2024-08-20T04:59:09.751382+0000","last_active":"2024-08-20T05:00:21.181870+0000","last_peered":"2024-08-20T05:00:21.181870+0000","last_clean":"2024-08-20T05:00:21.181870+0000","last_became_active":"2024-08-20T04:59:09.751026+0000","last_became_peered":"2024-08-20T04:59:09.751026+0000","last_unstale":"2024-08-20T05:00:21.181870+0000","last_undegraded":"2024-08-20T05:00:21.181870+0000","last_fullsized":"2024-08-20T05:00:21.181870+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:14:50.107767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294898+0000","last_change":"2024-08-20T04:59:12.789596+0000","last_active":"2024-08-20T04:59:26.294898+0000","last_peered":"2024-08-20T04:59:26.294898+0000","last_clean":"2024-08-20T04:59:26.294898+0000","last_became_active":"2024-08-20T04:59:12.788839+0000","last_became_peered":"2024-08-20T04:59:12.788839+0000","last_unstale":"2024-08-20T04:59:26.294898+0000","last_undegraded":"2024-08-20T04:59:26.294898+0000","last_fullsized":"2024-08-20T04:59:26.294898+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:31:05.681475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.432478+0000","last_change":"2024-08-20T04:59:21.902558+0000","last_active":"2024-08-20T04:59:26.432478+0000","last_peered":"2024-08-20T04:59:26.432478+0000","last_clean":"2024-08-20T04:59:26.432478+0000","last_became_active":"2024-08-20T04:59:21.902119+0000","last_became_peered":"2024-08-20T04:59:21.902119+0000","last_unstale":"2024-08-20T04:59:26.432478+0000","last_undegraded":"2024-08-20T04:59:26.432478+0000","last_fullsized":"2024-08-20T04:59:26.432478+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:53.765865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294313+0000","last_change":"2024-08-20T04:59:09.946282+0000","last_active":"2024-08-20T04:59:26.294313+0000","last_peered":"2024-08-20T04:59:26.294313+0000","last_clean":"2024-08-20T04:59:26.294313+0000","last_became_active":"2024-08-20T04:59:09.945867+0000","last_became_peered":"2024-08-20T04:59:09.945867+0000","last_unstale":"2024-08-20T04:59:26.294313+0000","last_undegraded":"2024-08-20T04:59:26.294313+0000","last_fullsized":"2024-08-20T04:59:26.294313+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:29:08.119504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020881+0000","last_change":"2024-08-20T04:59:12.796121+0000","last_active":"2024-08-20T04:59:26.020881+0000","last_peered":"2024-08-20T04:59:26.020881+0000","last_clean":"2024-08-20T04:59:26.020881+0000","last_became_active":"2024-08-20T04:59:12.792764+0000","last_became_peered":"2024-08-20T04:59:12.792764+0000","last_unstale":"2024-08-20T04:59:26.020881+0000","last_undegraded":"2024-08-20T04:59:26.020881+0000","last_fullsized":"2024-08-20T04:59:26.020881+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:01:53.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.226920+0000","last_change":"2024-08-20T04:59:21.909607+0000","last_active":"2024-08-20T04:59:26.226920+0000","last_peered":"2024-08-20T04:59:26.226920+0000","last_clean":"2024-08-20T04:59:26.226920+0000","last_became_active":"2024-08-20T04:59:21.909175+0000","last_became_peered":"2024-08-20T04:59:21.909175+0000","last_unstale":"2024-08-20T04:59:26.226920+0000","last_undegraded":"2024-08-20T04:59:26.226920+0000","last_fullsized":"2024-08-20T04:59:26.226920+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:29:49.940169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":50,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:06.145926+0000","last_change":"2024-08-20T04:59:09.753233+0000","last_active":"2024-08-20T05:00:06.145926+0000","last_peered":"2024-08-20T05:00:06.145926+0000","last_clean":"2024-08-20T05:00:06.145926+0000","last_became_active":"2024-08-20T04:59:09.752614+0000","last_became_peered":"2024-08-20T04:59:09.752614+0000","last_unstale":"2024-08-20T05:00:06.145926+0000","last_undegraded":"2024-08-20T05:00:06.145926+0000","last_fullsized":"2024-08-20T05:00:06.145926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:04:20.199669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904456+0000","last_change":"2024-08-20T04:59:12.799116+0000","last_active":"2024-08-20T04:59:25.904456+0000","last_peered":"2024-08-20T04:59:25.904456+0000","last_clean":"2024-08-20T04:59:25.904456+0000","last_became_active":"2024-08-20T04:59:12.798725+0000","last_became_peered":"2024-08-20T04:59:12.798725+0000","last_unstale":"2024-08-20T04:59:25.904456+0000","last_undegraded":"2024-08-20T04:59:25.904456+0000","last_fullsized":"2024-08-20T04:59:25.904456+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:46.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.227087+0000","last_change":"2024-08-20T04:59:21.916635+0000","last_active":"2024-08-20T04:59:26.227087+0000","last_peered":"2024-08-20T04:59:26.227087+0000","last_clean":"2024-08-20T04:59:26.227087+0000","last_became_active":"2024-08-20T04:59:21.916224+0000","last_became_peered":"2024-08-20T04:59:21.916224+0000","last_unstale":"2024-08-20T04:59:26.227087+0000","last_undegraded":"2024-08-20T04:59:26.227087+0000","last_fullsized":"2024-08-20T04:59:26.227087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:24:34.516430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.150348+0000","last_change":"2024-08-20T04:59:09.752771+0000","last_active":"2024-08-20T05:00:05.150348+0000","last_peered":"2024-08-20T05:00:05.150348+0000","last_clean":"2024-08-20T05:00:05.150348+0000","last_became_active":"2024-08-20T04:59:09.752415+0000","last_became_peered":"2024-08-20T04:59:09.752415+0000","last_unstale":"2024-08-20T05:00:05.150348+0000","last_undegraded":"2024-08-20T05:00:05.150348+0000","last_fullsized":"2024-08-20T05:00:05.150348+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:13:18.843587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904735+0000","last_change":"2024-08-20T04:59:12.794418+0000","last_active":"2024-08-20T04:59:25.904735+0000","last_peered":"2024-08-20T04:59:25.904735+0000","last_clean":"2024-08-20T04:59:25.904735+0000","last_became_active":"2024-08-20T04:59:12.794117+0000","last_became_peered":"2024-08-20T04:59:12.794117+0000","last_unstale":"2024-08-20T04:59:25.904735+0000","last_undegraded":"2024-08-20T04:59:25.904735+0000","last_fullsized":"2024-08-20T04:59:25.904735+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:18.209690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.227115+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T04:59:26.227115+0000","last_peered":"2024-08-20T04:59:26.227115+0000","last_clean":"2024-08-20T04:59:26.227115+0000","last_became_active":"2024-08-20T04:59:21.906344+0000","last_became_peered":"2024-08-20T04:59:21.906344+0000","last_unstale":"2024-08-20T04:59:26.227115+0000","last_undegraded":"2024-08-20T04:59:26.227115+0000","last_fullsized":"2024-08-20T04:59:26.227115+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:48:34.982558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.527746+0000","last_change":"2024-08-20T04:59:12.792719+0000","last_active":"2024-08-20T04:59:26.527746+0000","last_peered":"2024-08-20T04:59:26.527746+0000","last_clean":"2024-08-20T04:59:26.527746+0000","last_became_active":"2024-08-20T04:59:12.792294+0000","last_became_peered":"2024-08-20T04:59:12.792294+0000","last_unstale":"2024-08-20T04:59:26.527746+0000","last_undegraded":"2024-08-20T04:59:26.527746+0000","last_fullsized":"2024-08-20T04:59:26.527746+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:20:03.593798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:02.124565+0000","last_change":"2024-08-20T04:59:09.753804+0000","last_active":"2024-08-20T05:00:02.124565+0000","last_peered":"2024-08-20T05:00:02.124565+0000","last_clean":"2024-08-20T05:00:02.124565+0000","last_became_active":"2024-08-20T04:59:09.753493+0000","last_became_peered":"2024-08-20T04:59:09.753493+0000","last_unstale":"2024-08-20T05:00:02.124565+0000","last_undegraded":"2024-08-20T05:00:02.124565+0000","last_fullsized":"2024-08-20T05:00:02.124565+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:50:26.306087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.227508+0000","last_change":"2024-08-20T04:59:21.902445+0000","last_active":"2024-08-20T04:59:26.227508+0000","last_peered":"2024-08-20T04:59:26.227508+0000","last_clean":"2024-08-20T04:59:26.227508+0000","last_became_active":"2024-08-20T04:59:21.901950+0000","last_became_peered":"2024-08-20T04:59:21.901950+0000","last_unstale":"2024-08-20T04:59:26.227508+0000","last_undegraded":"2024-08-20T04:59:26.227508+0000","last_fullsized":"2024-08-20T04:59:26.227508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:55:28.653841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294725+0000","last_change":"2024-08-20T04:59:12.784236+0000","last_active":"2024-08-20T04:59:26.294725+0000","last_peered":"2024-08-20T04:59:26.294725+0000","last_clean":"2024-08-20T04:59:26.294725+0000","last_became_active":"2024-08-20T04:59:12.783945+0000","last_became_peered":"2024-08-20T04:59:12.783945+0000","last_unstale":"2024-08-20T04:59:26.294725+0000","last_undegraded":"2024-08-20T04:59:26.294725+0000","last_fullsized":"2024-08-20T04:59:26.294725+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:43:07.137543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":38,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:04.146028+0000","last_change":"2024-08-20T04:59:09.751661+0000","last_active":"2024-08-20T05:00:04.146028+0000","last_peered":"2024-08-20T05:00:04.146028+0000","last_clean":"2024-08-20T05:00:04.146028+0000","last_became_active":"2024-08-20T04:59:09.751326+0000","last_became_peered":"2024-08-20T04:59:09.751326+0000","last_unstale":"2024-08-20T05:00:04.146028+0000","last_undegraded":"2024-08-20T05:00:04.146028+0000","last_fullsized":"2024-08-20T05:00:04.146028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:54.751929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.227491+0000","last_change":"2024-08-20T04:59:21.913657+0000","last_active":"2024-08-20T04:59:26.227491+0000","last_peered":"2024-08-20T04:59:26.227491+0000","last_clean":"2024-08-20T04:59:26.227491+0000","last_became_active":"2024-08-20T04:59:21.913187+0000","last_became_peered":"2024-08-20T04:59:21.913187+0000","last_unstale":"2024-08-20T04:59:26.227491+0000","last_undegraded":"2024-08-20T04:59:26.227491+0000","last_fullsized":"2024-08-20T04:59:26.227491+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:51:29.008810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547244+0000","last_change":"2024-08-20T04:59:12.780137+0000","last_active":"2024-08-20T04:59:26.547244+0000","last_peered":"2024-08-20T04:59:26.547244+0000","last_clean":"2024-08-20T04:59:26.547244+0000","last_became_active":"2024-08-20T04:59:12.779820+0000","last_became_peered":"2024-08-20T04:59:12.779820+0000","last_unstale":"2024-08-20T04:59:26.547244+0000","last_undegraded":"2024-08-20T04:59:26.547244+0000","last_fullsized":"2024-08-20T04:59:26.547244+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:33:58.204255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.149542+0000","last_change":"2024-08-20T04:59:09.750521+0000","last_active":"2024-08-20T05:00:05.149542+0000","last_peered":"2024-08-20T05:00:05.149542+0000","last_clean":"2024-08-20T05:00:05.149542+0000","last_became_active":"2024-08-20T04:59:09.750115+0000","last_became_peered":"2024-08-20T04:59:09.750115+0000","last_unstale":"2024-08-20T05:00:05.149542+0000","last_undegraded":"2024-08-20T05:00:05.149542+0000","last_fullsized":"2024-08-20T05:00:05.149542+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:44:20.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547106+0000","last_change":"2024-08-20T04:59:21.910737+0000","last_active":"2024-08-20T04:59:26.547106+0000","last_peered":"2024-08-20T04:59:26.547106+0000","last_clean":"2024-08-20T04:59:26.547106+0000","last_became_active":"2024-08-20T04:59:21.910104+0000","last_became_peered":"2024-08-20T04:59:21.910104+0000","last_unstale":"2024-08-20T04:59:26.547106+0000","last_undegraded":"2024-08-20T04:59:26.547106+0000","last_fullsized":"2024-08-20T04:59:26.547106+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:17:40.436885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.546530+0000","last_change":"2024-08-20T04:59:12.787285+0000","last_active":"2024-08-20T04:59:26.546530+0000","last_peered":"2024-08-20T04:59:26.546530+0000","last_clean":"2024-08-20T04:59:26.546530+0000","last_became_active":"2024-08-20T04:59:12.786998+0000","last_became_peered":"2024-08-20T04:59:12.786998+0000","last_unstale":"2024-08-20T04:59:26.546530+0000","last_undegraded":"2024-08-20T04:59:26.546530+0000","last_fullsized":"2024-08-20T04:59:26.546530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:12:49.860291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:02.125231+0000","last_change":"2024-08-20T04:59:09.947715+0000","last_active":"2024-08-20T05:00:02.125231+0000","last_peered":"2024-08-20T05:00:02.125231+0000","last_clean":"2024-08-20T05:00:02.125231+0000","last_became_active":"2024-08-20T04:59:09.947372+0000","last_became_peered":"2024-08-20T04:59:09.947372+0000","last_unstale":"2024-08-20T05:00:02.125231+0000","last_undegraded":"2024-08-20T05:00:02.125231+0000","last_fullsized":"2024-08-20T05:00:02.125231+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:42:04.352964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.227591+0000","last_change":"2024-08-20T04:59:21.910176+0000","last_active":"2024-08-20T04:59:26.227591+0000","last_peered":"2024-08-20T04:59:26.227591+0000","last_clean":"2024-08-20T04:59:26.227591+0000","last_became_active":"2024-08-20T04:59:21.909435+0000","last_became_peered":"2024-08-20T04:59:21.909435+0000","last_unstale":"2024-08-20T04:59:26.227591+0000","last_undegraded":"2024-08-20T04:59:26.227591+0000","last_fullsized":"2024-08-20T04:59:26.227591+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:17:16.256844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020790+0000","last_change":"2024-08-20T04:59:12.785952+0000","last_active":"2024-08-20T04:59:26.020790+0000","last_peered":"2024-08-20T04:59:26.020790+0000","last_clean":"2024-08-20T04:59:26.020790+0000","last_became_active":"2024-08-20T04:59:12.785596+0000","last_became_peered":"2024-08-20T04:59:12.785596+0000","last_unstale":"2024-08-20T04:59:26.020790+0000","last_undegraded":"2024-08-20T04:59:26.020790+0000","last_fullsized":"2024-08-20T04:59:26.020790+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:47.299560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":44,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.150862+0000","last_change":"2024-08-20T04:59:09.964725+0000","last_active":"2024-08-20T05:00:05.150862+0000","last_peered":"2024-08-20T05:00:05.150862+0000","last_clean":"2024-08-20T05:00:05.150862+0000","last_became_active":"2024-08-20T04:59:09.964351+0000","last_became_peered":"2024-08-20T04:59:09.964351+0000","last_unstale":"2024-08-20T05:00:05.150862+0000","last_undegraded":"2024-08-20T05:00:05.150862+0000","last_fullsized":"2024-08-20T05:00:05.150862+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:26:03.216378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.432844+0000","last_change":"2024-08-20T04:59:21.898758+0000","last_active":"2024-08-20T04:59:26.432844+0000","last_peered":"2024-08-20T04:59:26.432844+0000","last_clean":"2024-08-20T04:59:26.432844+0000","last_became_active":"2024-08-20T04:59:21.898282+0000","last_became_peered":"2024-08-20T04:59:21.898282+0000","last_unstale":"2024-08-20T04:59:26.432844+0000","last_undegraded":"2024-08-20T04:59:26.432844+0000","last_fullsized":"2024-08-20T04:59:26.432844+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:45:49.093459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.295082+0000","last_change":"2024-08-20T04:59:12.793870+0000","last_active":"2024-08-20T04:59:26.295082+0000","last_peered":"2024-08-20T04:59:26.295082+0000","last_clean":"2024-08-20T04:59:26.295082+0000","last_became_active":"2024-08-20T04:59:12.792928+0000","last_became_peered":"2024-08-20T04:59:12.792928+0000","last_unstale":"2024-08-20T04:59:26.295082+0000","last_undegraded":"2024-08-20T04:59:26.295082+0000","last_fullsized":"2024-08-20T04:59:26.295082+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:12:25.450347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'14","reported_seq":49,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:18.792797+0000","last_change":"2024-08-20T04:59:09.751403+0000","last_active":"2024-08-20T05:00:18.792797+0000","last_peered":"2024-08-20T05:00:18.792797+0000","last_clean":"2024-08-20T05:00:18.792797+0000","last_became_active":"2024-08-20T04:59:09.750976+0000","last_became_peered":"2024-08-20T04:59:09.750976+0000","last_unstale":"2024-08-20T05:00:18.792797+0000","last_undegraded":"2024-08-20T05:00:18.792797+0000","last_fullsized":"2024-08-20T05:00:18.792797+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:58:54.627836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294380+0000","last_change":"2024-08-20T04:59:21.899813+0000","last_active":"2024-08-20T04:59:26.294380+0000","last_peered":"2024-08-20T04:59:26.294380+0000","last_clean":"2024-08-20T04:59:26.294380+0000","last_became_active":"2024-08-20T04:59:21.899462+0000","last_became_peered":"2024-08-20T04:59:21.899462+0000","last_unstale":"2024-08-20T04:59:26.294380+0000","last_undegraded":"2024-08-20T04:59:26.294380+0000","last_fullsized":"2024-08-20T04:59:26.294380+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.468845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904142+0000","last_change":"2024-08-20T04:59:12.783953+0000","last_active":"2024-08-20T04:59:25.904142+0000","last_peered":"2024-08-20T04:59:25.904142+0000","last_clean":"2024-08-20T04:59:25.904142+0000","last_became_active":"2024-08-20T04:59:12.781445+0000","last_became_peered":"2024-08-20T04:59:12.781445+0000","last_unstale":"2024-08-20T04:59:25.904142+0000","last_undegraded":"2024-08-20T04:59:25.904142+0000","last_fullsized":"2024-08-20T04:59:25.904142+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:04.792064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.151269+0000","last_change":"2024-08-20T04:59:09.947194+0000","last_active":"2024-08-20T05:00:05.151269+0000","last_peered":"2024-08-20T05:00:05.151269+0000","last_clean":"2024-08-20T05:00:05.151269+0000","last_became_active":"2024-08-20T04:59:09.946822+0000","last_became_peered":"2024-08-20T04:59:09.946822+0000","last_unstale":"2024-08-20T05:00:05.151269+0000","last_undegraded":"2024-08-20T05:00:05.151269+0000","last_fullsized":"2024-08-20T05:00:05.151269+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:23:08.279378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547065+0000","last_change":"2024-08-20T04:59:21.905202+0000","last_active":"2024-08-20T04:59:26.547065+0000","last_peered":"2024-08-20T04:59:26.547065+0000","last_clean":"2024-08-20T04:59:26.547065+0000","last_became_active":"2024-08-20T04:59:21.904771+0000","last_became_peered":"2024-08-20T04:59:21.904771+0000","last_unstale":"2024-08-20T04:59:26.547065+0000","last_undegraded":"2024-08-20T04:59:26.547065+0000","last_fullsized":"2024-08-20T04:59:26.547065+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:35:56.887981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.979872+0000","last_change":"2024-08-20T04:59:12.798301+0000","last_active":"2024-08-20T04:59:25.979872+0000","last_peered":"2024-08-20T04:59:25.979872+0000","last_clean":"2024-08-20T04:59:25.979872+0000","last_became_active":"2024-08-20T04:59:12.797934+0000","last_became_peered":"2024-08-20T04:59:12.797934+0000","last_unstale":"2024-08-20T04:59:25.979872+0000","last_undegraded":"2024-08-20T04:59:25.979872+0000","last_fullsized":"2024-08-20T04:59:25.979872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:41:24.465380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547223+0000","last_change":"2024-08-20T04:59:09.947602+0000","last_active":"2024-08-20T04:59:26.547223+0000","last_peered":"2024-08-20T04:59:26.547223+0000","last_clean":"2024-08-20T04:59:26.547223+0000","last_became_active":"2024-08-20T04:59:09.946795+0000","last_became_peered":"2024-08-20T04:59:09.946795+0000","last_unstale":"2024-08-20T04:59:26.547223+0000","last_undegraded":"2024-08-20T04:59:26.547223+0000","last_fullsized":"2024-08-20T04:59:26.547223+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:09:09.003266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.546675+0000","last_change":"2024-08-20T04:59:21.913853+0000","last_active":"2024-08-20T04:59:26.546675+0000","last_peered":"2024-08-20T04:59:26.546675+0000","last_clean":"2024-08-20T04:59:26.546675+0000","last_became_active":"2024-08-20T04:59:21.913432+0000","last_became_peered":"2024-08-20T04:59:21.913432+0000","last_unstale":"2024-08-20T04:59:26.546675+0000","last_undegraded":"2024-08-20T04:59:26.546675+0000","last_fullsized":"2024-08-20T04:59:26.546675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:43:11.045525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.979767+0000","last_change":"2024-08-20T04:59:12.784852+0000","last_active":"2024-08-20T04:59:25.979767+0000","last_peered":"2024-08-20T04:59:25.979767+0000","last_clean":"2024-08-20T04:59:25.979767+0000","last_became_active":"2024-08-20T04:59:12.784496+0000","last_became_peered":"2024-08-20T04:59:12.784496+0000","last_unstale":"2024-08-20T04:59:25.979767+0000","last_undegraded":"2024-08-20T04:59:25.979767+0000","last_fullsized":"2024-08-20T04:59:25.979767+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:41:42.421383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":59,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:22.184074+0000","last_change":"2024-08-20T04:59:09.750785+0000","last_active":"2024-08-20T05:00:22.184074+0000","last_peered":"2024-08-20T05:00:22.184074+0000","last_clean":"2024-08-20T05:00:22.184074+0000","last_became_active":"2024-08-20T04:59:09.750255+0000","last_became_peered":"2024-08-20T04:59:09.750255+0000","last_unstale":"2024-08-20T05:00:22.184074+0000","last_undegraded":"2024-08-20T05:00:22.184074+0000","last_fullsized":"2024-08-20T05:00:22.184074+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:20:17.900367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904059+0000","last_change":"2024-08-20T04:59:21.909409+0000","last_active":"2024-08-20T04:59:25.904059+0000","last_peered":"2024-08-20T04:59:25.904059+0000","last_clean":"2024-08-20T04:59:25.904059+0000","last_became_active":"2024-08-20T04:59:21.907934+0000","last_became_peered":"2024-08-20T04:59:21.907934+0000","last_unstale":"2024-08-20T04:59:25.904059+0000","last_undegraded":"2024-08-20T04:59:25.904059+0000","last_fullsized":"2024-08-20T04:59:25.904059+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:26:36.768407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904386+0000","last_change":"2024-08-20T04:59:12.783496+0000","last_active":"2024-08-20T04:59:25.904386+0000","last_peered":"2024-08-20T04:59:25.904386+0000","last_clean":"2024-08-20T04:59:25.904386+0000","last_became_active":"2024-08-20T04:59:12.783211+0000","last_became_peered":"2024-08-20T04:59:12.783211+0000","last_unstale":"2024-08-20T04:59:25.904386+0000","last_undegraded":"2024-08-20T04:59:25.904386+0000","last_fullsized":"2024-08-20T04:59:25.904386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:45:49.514189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":56,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:18.174140+0000","last_change":"2024-08-20T04:59:09.948284+0000","last_active":"2024-08-20T05:00:18.174140+0000","last_peered":"2024-08-20T05:00:18.174140+0000","last_clean":"2024-08-20T05:00:18.174140+0000","last_became_active":"2024-08-20T04:59:09.947909+0000","last_became_peered":"2024-08-20T04:59:09.947909+0000","last_unstale":"2024-08-20T05:00:18.174140+0000","last_undegraded":"2024-08-20T05:00:18.174140+0000","last_fullsized":"2024-08-20T05:00:18.174140+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:24:04.344380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.903977+0000","last_change":"2024-08-20T04:59:21.905282+0000","last_active":"2024-08-20T04:59:25.903977+0000","last_peered":"2024-08-20T04:59:25.903977+0000","last_clean":"2024-08-20T04:59:25.903977+0000","last_became_active":"2024-08-20T04:59:21.904842+0000","last_became_peered":"2024-08-20T04:59:21.904842+0000","last_unstale":"2024-08-20T04:59:25.903977+0000","last_undegraded":"2024-08-20T04:59:25.903977+0000","last_fullsized":"2024-08-20T04:59:25.903977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:01:19.949949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.903533+0000","last_change":"2024-08-20T04:59:12.788571+0000","last_active":"2024-08-20T04:59:25.903533+0000","last_peered":"2024-08-20T04:59:25.903533+0000","last_clean":"2024-08-20T04:59:25.903533+0000","last_became_active":"2024-08-20T04:59:12.784148+0000","last_became_peered":"2024-08-20T04:59:12.784148+0000","last_unstale":"2024-08-20T04:59:25.903533+0000","last_undegraded":"2024-08-20T04:59:25.903533+0000","last_fullsized":"2024-08-20T04:59:25.903533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:10:51.565404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:03.130836+0000","last_change":"2024-08-20T04:59:09.753842+0000","last_active":"2024-08-20T05:00:03.130836+0000","last_peered":"2024-08-20T05:00:03.130836+0000","last_clean":"2024-08-20T05:00:03.130836+0000","last_became_active":"2024-08-20T04:59:09.753439+0000","last_became_peered":"2024-08-20T04:59:09.753439+0000","last_unstale":"2024-08-20T05:00:03.130836+0000","last_undegraded":"2024-08-20T05:00:03.130836+0000","last_fullsized":"2024-08-20T05:00:03.130836+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:54.171964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904627+0000","last_change":"2024-08-20T04:59:21.909621+0000","last_active":"2024-08-20T04:59:25.904627+0000","last_peered":"2024-08-20T04:59:25.904627+0000","last_clean":"2024-08-20T04:59:25.904627+0000","last_became_active":"2024-08-20T04:59:21.909239+0000","last_became_peered":"2024-08-20T04:59:21.909239+0000","last_unstale":"2024-08-20T04:59:25.904627+0000","last_undegraded":"2024-08-20T04:59:25.904627+0000","last_fullsized":"2024-08-20T04:59:25.904627+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:53:15.131163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294664+0000","last_change":"2024-08-20T04:59:12.796643+0000","last_active":"2024-08-20T04:59:26.294664+0000","last_peered":"2024-08-20T04:59:26.294664+0000","last_clean":"2024-08-20T04:59:26.294664+0000","last_became_active":"2024-08-20T04:59:12.796262+0000","last_became_peered":"2024-08-20T04:59:12.796262+0000","last_unstale":"2024-08-20T04:59:26.294664+0000","last_undegraded":"2024-08-20T04:59:26.294664+0000","last_fullsized":"2024-08-20T04:59:26.294664+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:11:37.792359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":45,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:06.153178+0000","last_change":"2024-08-20T04:59:09.750550+0000","last_active":"2024-08-20T05:00:06.153178+0000","last_peered":"2024-08-20T05:00:06.153178+0000","last_clean":"2024-08-20T05:00:06.153178+0000","last_became_active":"2024-08-20T04:59:09.750097+0000","last_became_peered":"2024-08-20T04:59:09.750097+0000","last_unstale":"2024-08-20T05:00:06.153178+0000","last_undegraded":"2024-08-20T05:00:06.153178+0000","last_fullsized":"2024-08-20T05:00:06.153178+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:32:22.826478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":109,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.527375+0000","last_change":"2024-08-20T04:57:50.824023+0000","last_active":"2024-08-20T04:59:26.527375+0000","last_peered":"2024-08-20T04:59:26.527375+0000","last_clean":"2024-08-20T04:59:26.527375+0000","last_became_active":"2024-08-20T04:57:50.350587+0000","last_became_peered":"2024-08-20T04:57:50.350587+0000","last_unstale":"2024-08-20T04:59:26.527375+0000","last_undegraded":"2024-08-20T04:59:26.527375+0000","last_fullsized":"2024-08-20T04:59:26.527375+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_clean_scrub_stamp":"2024-08-20T04:54:17.224468+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:59:23.450117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.527966+0000","last_change":"2024-08-20T04:59:21.909203+0000","last_active":"2024-08-20T04:59:26.527966+0000","last_peered":"2024-08-20T04:59:26.527966+0000","last_clean":"2024-08-20T04:59:26.527966+0000","last_became_active":"2024-08-20T04:59:21.908610+0000","last_became_peered":"2024-08-20T04:59:21.908610+0000","last_unstale":"2024-08-20T04:59:26.527966+0000","last_undegraded":"2024-08-20T04:59:26.527966+0000","last_fullsized":"2024-08-20T04:59:26.527966+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:49.567655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.528093+0000","last_change":"2024-08-20T04:59:12.793799+0000","last_active":"2024-08-20T04:59:26.528093+0000","last_peered":"2024-08-20T04:59:26.528093+0000","last_clean":"2024-08-20T04:59:26.528093+0000","last_became_active":"2024-08-20T04:59:12.793487+0000","last_became_peered":"2024-08-20T04:59:12.793487+0000","last_unstale":"2024-08-20T04:59:26.528093+0000","last_undegraded":"2024-08-20T04:59:26.528093+0000","last_fullsized":"2024-08-20T04:59:26.528093+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:08:30.835824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'6","reported_seq":60,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:20.180245+0000","last_change":"2024-08-20T04:59:09.964586+0000","last_active":"2024-08-20T05:00:20.180245+0000","last_peered":"2024-08-20T05:00:20.180245+0000","last_clean":"2024-08-20T05:00:20.180245+0000","last_became_active":"2024-08-20T04:59:09.964258+0000","last_became_peered":"2024-08-20T04:59:09.964258+0000","last_unstale":"2024-08-20T05:00:20.180245+0000","last_undegraded":"2024-08-20T05:00:20.180245+0000","last_fullsized":"2024-08-20T05:00:20.180245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:37:48.138019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904194+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T04:59:25.904194+0000","last_peered":"2024-08-20T04:59:25.904194+0000","last_clean":"2024-08-20T04:59:25.904194+0000","last_became_active":"2024-08-20T04:59:21.906197+0000","last_became_peered":"2024-08-20T04:59:21.906197+0000","last_unstale":"2024-08-20T04:59:25.904194+0000","last_undegraded":"2024-08-20T04:59:25.904194+0000","last_fullsized":"2024-08-20T04:59:25.904194+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:10:45.819035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.527924+0000","last_change":"2024-08-20T04:59:12.794221+0000","last_active":"2024-08-20T04:59:26.527924+0000","last_peered":"2024-08-20T04:59:26.527924+0000","last_clean":"2024-08-20T04:59:26.527924+0000","last_became_active":"2024-08-20T04:59:12.793680+0000","last_became_peered":"2024-08-20T04:59:12.793680+0000","last_unstale":"2024-08-20T04:59:26.527924+0000","last_undegraded":"2024-08-20T04:59:26.527924+0000","last_fullsized":"2024-08-20T04:59:26.527924+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:45.435700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.150020+0000","last_change":"2024-08-20T04:59:09.755955+0000","last_active":"2024-08-20T05:00:05.150020+0000","last_peered":"2024-08-20T05:00:05.150020+0000","last_clean":"2024-08-20T05:00:05.150020+0000","last_became_active":"2024-08-20T04:59:09.755614+0000","last_became_peered":"2024-08-20T04:59:09.755614+0000","last_unstale":"2024-08-20T05:00:05.150020+0000","last_undegraded":"2024-08-20T05:00:05.150020+0000","last_fullsized":"2024-08-20T05:00:05.150020+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:15:06.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020566+0000","last_change":"2024-08-20T04:59:21.915952+0000","last_active":"2024-08-20T04:59:26.020566+0000","last_peered":"2024-08-20T04:59:26.020566+0000","last_clean":"2024-08-20T04:59:26.020566+0000","last_became_active":"2024-08-20T04:59:21.915533+0000","last_became_peered":"2024-08-20T04:59:21.915533+0000","last_unstale":"2024-08-20T04:59:26.020566+0000","last_undegraded":"2024-08-20T04:59:26.020566+0000","last_fullsized":"2024-08-20T04:59:26.020566+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:52:54.906061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.528012+0000","last_change":"2024-08-20T04:59:12.782663+0000","last_active":"2024-08-20T04:59:26.528012+0000","last_peered":"2024-08-20T04:59:26.528012+0000","last_clean":"2024-08-20T04:59:26.528012+0000","last_became_active":"2024-08-20T04:59:12.782068+0000","last_became_peered":"2024-08-20T04:59:12.782068+0000","last_unstale":"2024-08-20T04:59:26.528012+0000","last_undegraded":"2024-08-20T04:59:26.528012+0000","last_fullsized":"2024-08-20T04:59:26.528012+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:46:39.662033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":41,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.150050+0000","last_change":"2024-08-20T04:59:09.747456+0000","last_active":"2024-08-20T05:00:05.150050+0000","last_peered":"2024-08-20T05:00:05.150050+0000","last_clean":"2024-08-20T05:00:05.150050+0000","last_became_active":"2024-08-20T04:59:09.747141+0000","last_became_peered":"2024-08-20T04:59:09.747141+0000","last_unstale":"2024-08-20T05:00:05.150050+0000","last_undegraded":"2024-08-20T05:00:05.150050+0000","last_fullsized":"2024-08-20T05:00:05.150050+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:39:01.600831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904162+0000","last_change":"2024-08-20T04:59:21.898059+0000","last_active":"2024-08-20T04:59:25.904162+0000","last_peered":"2024-08-20T04:59:25.904162+0000","last_clean":"2024-08-20T04:59:25.904162+0000","last_became_active":"2024-08-20T04:59:21.897617+0000","last_became_peered":"2024-08-20T04:59:21.897617+0000","last_unstale":"2024-08-20T04:59:25.904162+0000","last_undegraded":"2024-08-20T04:59:25.904162+0000","last_fullsized":"2024-08-20T04:59:25.904162+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:53:21.122106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547010+0000","last_change":"2024-08-20T04:59:12.784275+0000","last_active":"2024-08-20T04:59:26.547010+0000","last_peered":"2024-08-20T04:59:26.547010+0000","last_clean":"2024-08-20T04:59:26.547010+0000","last_became_active":"2024-08-20T04:59:12.783888+0000","last_became_peered":"2024-08-20T04:59:12.783888+0000","last_unstale":"2024-08-20T04:59:26.547010+0000","last_undegraded":"2024-08-20T04:59:26.547010+0000","last_fullsized":"2024-08-20T04:59:26.547010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:38:50.060057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.126501+0000","last_change":"2024-08-20T04:59:09.751943+0000","last_active":"2024-08-20T05:00:05.126501+0000","last_peered":"2024-08-20T05:00:05.126501+0000","last_clean":"2024-08-20T05:00:05.126501+0000","last_became_active":"2024-08-20T04:59:09.751586+0000","last_became_peered":"2024-08-20T04:59:09.751586+0000","last_unstale":"2024-08-20T05:00:05.126501+0000","last_undegraded":"2024-08-20T05:00:05.126501+0000","last_fullsized":"2024-08-20T05:00:05.126501+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:35:03.400574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904200+0000","last_change":"2024-08-20T04:59:21.901315+0000","last_active":"2024-08-20T04:59:25.904200+0000","last_peered":"2024-08-20T04:59:25.904200+0000","last_clean":"2024-08-20T04:59:25.904200+0000","last_became_active":"2024-08-20T04:59:21.900871+0000","last_became_peered":"2024-08-20T04:59:21.900871+0000","last_unstale":"2024-08-20T04:59:25.904200+0000","last_undegraded":"2024-08-20T04:59:25.904200+0000","last_fullsized":"2024-08-20T04:59:25.904200+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:39:30.940409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904248+0000","last_change":"2024-08-20T04:59:12.793140+0000","last_active":"2024-08-20T04:59:25.904248+0000","last_peered":"2024-08-20T04:59:25.904248+0000","last_clean":"2024-08-20T04:59:25.904248+0000","last_became_active":"2024-08-20T04:59:12.792678+0000","last_became_peered":"2024-08-20T04:59:12.792678+0000","last_unstale":"2024-08-20T04:59:25.904248+0000","last_undegraded":"2024-08-20T04:59:25.904248+0000","last_fullsized":"2024-08-20T04:59:25.904248+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:07:05.610634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":55,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.151132+0000","last_change":"2024-08-20T04:59:09.946158+0000","last_active":"2024-08-20T05:00:05.151132+0000","last_peered":"2024-08-20T05:00:05.151132+0000","last_clean":"2024-08-20T05:00:05.151132+0000","last_became_active":"2024-08-20T04:59:09.945736+0000","last_became_peered":"2024-08-20T04:59:09.945736+0000","last_unstale":"2024-08-20T05:00:05.151132+0000","last_undegraded":"2024-08-20T05:00:05.151132+0000","last_fullsized":"2024-08-20T05:00:05.151132+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:02.759879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904150+0000","last_change":"2024-08-20T04:59:21.913457+0000","last_active":"2024-08-20T04:59:25.904150+0000","last_peered":"2024-08-20T04:59:25.904150+0000","last_clean":"2024-08-20T04:59:25.904150+0000","last_became_active":"2024-08-20T04:59:21.910468+0000","last_became_peered":"2024-08-20T04:59:21.910468+0000","last_unstale":"2024-08-20T04:59:25.904150+0000","last_undegraded":"2024-08-20T04:59:25.904150+0000","last_fullsized":"2024-08-20T04:59:25.904150+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:16:30.817166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.527752+0000","last_change":"2024-08-20T04:59:12.788088+0000","last_active":"2024-08-20T04:59:26.527752+0000","last_peered":"2024-08-20T04:59:26.527752+0000","last_clean":"2024-08-20T04:59:26.527752+0000","last_became_active":"2024-08-20T04:59:12.787756+0000","last_became_peered":"2024-08-20T04:59:12.787756+0000","last_unstale":"2024-08-20T04:59:26.527752+0000","last_undegraded":"2024-08-20T04:59:26.527752+0000","last_fullsized":"2024-08-20T04:59:26.527752+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:51.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":63,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:22.180205+0000","last_change":"2024-08-20T04:59:09.746896+0000","last_active":"2024-08-20T05:00:22.180205+0000","last_peered":"2024-08-20T05:00:22.180205+0000","last_clean":"2024-08-20T05:00:22.180205+0000","last_became_active":"2024-08-20T04:59:09.746570+0000","last_became_peered":"2024-08-20T04:59:09.746570+0000","last_unstale":"2024-08-20T05:00:22.180205+0000","last_undegraded":"2024-08-20T05:00:22.180205+0000","last_fullsized":"2024-08-20T05:00:22.180205+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:06:02.395260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547187+0000","last_change":"2024-08-20T04:59:21.911747+0000","last_active":"2024-08-20T04:59:26.547187+0000","last_peered":"2024-08-20T04:59:26.547187+0000","last_clean":"2024-08-20T04:59:26.547187+0000","last_became_active":"2024-08-20T04:59:21.908861+0000","last_became_peered":"2024-08-20T04:59:21.908861+0000","last_unstale":"2024-08-20T04:59:26.547187+0000","last_undegraded":"2024-08-20T04:59:26.547187+0000","last_fullsized":"2024-08-20T04:59:26.547187+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:22:17.336776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.527724+0000","last_change":"2024-08-20T04:59:12.792010+0000","last_active":"2024-08-20T04:59:26.527724+0000","last_peered":"2024-08-20T04:59:26.527724+0000","last_clean":"2024-08-20T04:59:26.527724+0000","last_became_active":"2024-08-20T04:59:12.791699+0000","last_became_peered":"2024-08-20T04:59:12.791699+0000","last_unstale":"2024-08-20T04:59:26.527724+0000","last_undegraded":"2024-08-20T04:59:26.527724+0000","last_fullsized":"2024-08-20T04:59:26.527724+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:28:01.434149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.150986+0000","last_change":"2024-08-20T04:59:09.755225+0000","last_active":"2024-08-20T05:00:05.150986+0000","last_peered":"2024-08-20T05:00:05.150986+0000","last_clean":"2024-08-20T05:00:05.150986+0000","last_became_active":"2024-08-20T04:59:09.754580+0000","last_became_peered":"2024-08-20T04:59:09.754580+0000","last_unstale":"2024-08-20T05:00:05.150986+0000","last_undegraded":"2024-08-20T05:00:05.150986+0000","last_fullsized":"2024-08-20T05:00:05.150986+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:54:53.606954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547036+0000","last_change":"2024-08-20T04:59:21.905200+0000","last_active":"2024-08-20T04:59:26.547036+0000","last_peered":"2024-08-20T04:59:26.547036+0000","last_clean":"2024-08-20T04:59:26.547036+0000","last_became_active":"2024-08-20T04:59:21.904724+0000","last_became_peered":"2024-08-20T04:59:21.904724+0000","last_unstale":"2024-08-20T04:59:26.547036+0000","last_undegraded":"2024-08-20T04:59:26.547036+0000","last_fullsized":"2024-08-20T04:59:26.547036+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:50:43.446750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.903708+0000","last_change":"2024-08-20T04:59:12.787261+0000","last_active":"2024-08-20T04:59:25.903708+0000","last_peered":"2024-08-20T04:59:25.903708+0000","last_clean":"2024-08-20T04:59:25.903708+0000","last_became_active":"2024-08-20T04:59:12.786971+0000","last_became_peered":"2024-08-20T04:59:12.786971+0000","last_unstale":"2024-08-20T04:59:25.903708+0000","last_undegraded":"2024-08-20T04:59:25.903708+0000","last_fullsized":"2024-08-20T04:59:25.903708+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:55:57.209321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":46,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:06.153406+0000","last_change":"2024-08-20T04:59:09.749147+0000","last_active":"2024-08-20T05:00:06.153406+0000","last_peered":"2024-08-20T05:00:06.153406+0000","last_clean":"2024-08-20T05:00:06.153406+0000","last_became_active":"2024-08-20T04:59:09.748806+0000","last_became_peered":"2024-08-20T04:59:09.748806+0000","last_unstale":"2024-08-20T05:00:06.153406+0000","last_undegraded":"2024-08-20T05:00:06.153406+0000","last_fullsized":"2024-08-20T05:00:06.153406+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:59:43.377105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904810+0000","last_change":"2024-08-20T04:59:21.905007+0000","last_active":"2024-08-20T04:59:25.904810+0000","last_peered":"2024-08-20T04:59:25.904810+0000","last_clean":"2024-08-20T04:59:25.904810+0000","last_became_active":"2024-08-20T04:59:21.904608+0000","last_became_peered":"2024-08-20T04:59:21.904608+0000","last_unstale":"2024-08-20T04:59:25.904810+0000","last_undegraded":"2024-08-20T04:59:25.904810+0000","last_fullsized":"2024-08-20T04:59:25.904810+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:00:42.390966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547343+0000","last_change":"2024-08-20T04:59:12.783339+0000","last_active":"2024-08-20T04:59:26.547343+0000","last_peered":"2024-08-20T04:59:26.547343+0000","last_clean":"2024-08-20T04:59:26.547343+0000","last_became_active":"2024-08-20T04:59:12.783051+0000","last_became_peered":"2024-08-20T04:59:12.783051+0000","last_unstale":"2024-08-20T04:59:26.547343+0000","last_undegraded":"2024-08-20T04:59:26.547343+0000","last_fullsized":"2024-08-20T04:59:26.547343+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:23:54.390491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'32","reported_seq":112,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:23.181492+0000","last_change":"2024-08-20T04:59:09.754340+0000","last_active":"2024-08-20T05:00:23.181492+0000","last_peered":"2024-08-20T05:00:23.181492+0000","last_clean":"2024-08-20T05:00:23.181492+0000","last_became_active":"2024-08-20T04:59:09.754000+0000","last_became_peered":"2024-08-20T04:59:09.754000+0000","last_unstale":"2024-08-20T05:00:23.181492+0000","last_undegraded":"2024-08-20T05:00:23.181492+0000","last_fullsized":"2024-08-20T05:00:23.181492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:26:17.256961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56160,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":77,"num_write":34,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547079+0000","last_change":"2024-08-20T04:59:21.910369+0000","last_active":"2024-08-20T04:59:26.547079+0000","last_peered":"2024-08-20T04:59:26.547079+0000","last_clean":"2024-08-20T04:59:26.547079+0000","last_became_active":"2024-08-20T04:59:21.909941+0000","last_became_peered":"2024-08-20T04:59:21.909941+0000","last_unstale":"2024-08-20T04:59:26.547079+0000","last_undegraded":"2024-08-20T04:59:26.547079+0000","last_fullsized":"2024-08-20T04:59:26.547079+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:27:07.088021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904456+0000","last_change":"2024-08-20T04:59:12.787747+0000","last_active":"2024-08-20T04:59:25.904456+0000","last_peered":"2024-08-20T04:59:25.904456+0000","last_clean":"2024-08-20T04:59:25.904456+0000","last_became_active":"2024-08-20T04:59:12.786962+0000","last_became_peered":"2024-08-20T04:59:12.786962+0000","last_unstale":"2024-08-20T04:59:25.904456+0000","last_undegraded":"2024-08-20T04:59:25.904456+0000","last_fullsized":"2024-08-20T04:59:25.904456+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:14:43.822829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":42,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:04.144763+0000","last_change":"2024-08-20T04:59:09.947582+0000","last_active":"2024-08-20T05:00:04.144763+0000","last_peered":"2024-08-20T05:00:04.144763+0000","last_clean":"2024-08-20T05:00:04.144763+0000","last_became_active":"2024-08-20T04:59:09.947117+0000","last_became_peered":"2024-08-20T04:59:09.947117+0000","last_unstale":"2024-08-20T05:00:04.144763+0000","last_undegraded":"2024-08-20T05:00:04.144763+0000","last_fullsized":"2024-08-20T05:00:04.144763+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:22:05.815486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.227287+0000","last_change":"2024-08-20T04:59:21.910776+0000","last_active":"2024-08-20T04:59:26.227287+0000","last_peered":"2024-08-20T04:59:26.227287+0000","last_clean":"2024-08-20T04:59:26.227287+0000","last_became_active":"2024-08-20T04:59:21.909726+0000","last_became_peered":"2024-08-20T04:59:21.909726+0000","last_unstale":"2024-08-20T04:59:26.227287+0000","last_undegraded":"2024-08-20T04:59:26.227287+0000","last_fullsized":"2024-08-20T04:59:26.227287+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:03:04.042649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020880+0000","last_change":"2024-08-20T04:59:12.788839+0000","last_active":"2024-08-20T04:59:26.020880+0000","last_peered":"2024-08-20T04:59:26.020880+0000","last_clean":"2024-08-20T04:59:26.020880+0000","last_became_active":"2024-08-20T04:59:12.788363+0000","last_became_peered":"2024-08-20T04:59:12.788363+0000","last_unstale":"2024-08-20T04:59:26.020880+0000","last_undegraded":"2024-08-20T04:59:26.020880+0000","last_fullsized":"2024-08-20T04:59:26.020880+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:26:29.144455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.150446+0000","last_change":"2024-08-20T04:59:09.747316+0000","last_active":"2024-08-20T05:00:05.150446+0000","last_peered":"2024-08-20T05:00:05.150446+0000","last_clean":"2024-08-20T05:00:05.150446+0000","last_became_active":"2024-08-20T04:59:09.746959+0000","last_became_peered":"2024-08-20T04:59:09.746959+0000","last_unstale":"2024-08-20T05:00:05.150446+0000","last_undegraded":"2024-08-20T05:00:05.150446+0000","last_fullsized":"2024-08-20T05:00:05.150446+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:28.480465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.546718+0000","last_change":"2024-08-20T04:59:21.907940+0000","last_active":"2024-08-20T04:59:26.546718+0000","last_peered":"2024-08-20T04:59:26.546718+0000","last_clean":"2024-08-20T04:59:26.546718+0000","last_became_active":"2024-08-20T04:59:21.907591+0000","last_became_peered":"2024-08-20T04:59:21.907591+0000","last_unstale":"2024-08-20T04:59:26.546718+0000","last_undegraded":"2024-08-20T04:59:26.546718+0000","last_fullsized":"2024-08-20T04:59:26.546718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:33.583556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904729+0000","last_change":"2024-08-20T04:59:12.795662+0000","last_active":"2024-08-20T04:59:25.904729+0000","last_peered":"2024-08-20T04:59:25.904729+0000","last_clean":"2024-08-20T04:59:25.904729+0000","last_became_active":"2024-08-20T04:59:12.795321+0000","last_became_peered":"2024-08-20T04:59:12.795321+0000","last_unstale":"2024-08-20T04:59:25.904729+0000","last_undegraded":"2024-08-20T04:59:25.904729+0000","last_fullsized":"2024-08-20T04:59:25.904729+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:40:30.561306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":76,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:23.181420+0000","last_change":"2024-08-20T04:59:09.754468+0000","last_active":"2024-08-20T05:00:23.181420+0000","last_peered":"2024-08-20T05:00:23.181420+0000","last_clean":"2024-08-20T05:00:23.181420+0000","last_became_active":"2024-08-20T04:59:09.754115+0000","last_became_peered":"2024-08-20T04:59:09.754115+0000","last_unstale":"2024-08-20T05:00:23.181420+0000","last_undegraded":"2024-08-20T05:00:23.181420+0000","last_fullsized":"2024-08-20T05:00:23.181420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:50:21.301246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294529+0000","last_change":"2024-08-20T04:59:21.898785+0000","last_active":"2024-08-20T04:59:26.294529+0000","last_peered":"2024-08-20T04:59:26.294529+0000","last_clean":"2024-08-20T04:59:26.294529+0000","last_became_active":"2024-08-20T04:59:21.898423+0000","last_became_peered":"2024-08-20T04:59:21.898423+0000","last_unstale":"2024-08-20T04:59:26.294529+0000","last_undegraded":"2024-08-20T04:59:26.294529+0000","last_fullsized":"2024-08-20T04:59:26.294529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:52:58.800104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020823+0000","last_change":"2024-08-20T04:59:21.906208+0000","last_active":"2024-08-20T04:59:26.020823+0000","last_peered":"2024-08-20T04:59:26.020823+0000","last_clean":"2024-08-20T04:59:26.020823+0000","last_became_active":"2024-08-20T04:59:21.905041+0000","last_became_peered":"2024-08-20T04:59:21.905041+0000","last_unstale":"2024-08-20T04:59:26.020823+0000","last_undegraded":"2024-08-20T04:59:26.020823+0000","last_fullsized":"2024-08-20T04:59:26.020823+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:05:28.971357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.546722+0000","last_change":"2024-08-20T04:59:12.788130+0000","last_active":"2024-08-20T04:59:26.546722+0000","last_peered":"2024-08-20T04:59:26.546722+0000","last_clean":"2024-08-20T04:59:26.546722+0000","last_became_active":"2024-08-20T04:59:12.787665+0000","last_became_peered":"2024-08-20T04:59:12.787665+0000","last_unstale":"2024-08-20T04:59:26.546722+0000","last_undegraded":"2024-08-20T04:59:26.546722+0000","last_fullsized":"2024-08-20T04:59:26.546722+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:59:39.628781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:05.151585+0000","last_change":"2024-08-20T04:59:09.754842+0000","last_active":"2024-08-20T05:00:05.151585+0000","last_peered":"2024-08-20T05:00:05.151585+0000","last_clean":"2024-08-20T05:00:05.151585+0000","last_became_active":"2024-08-20T04:59:09.754515+0000","last_became_peered":"2024-08-20T04:59:09.754515+0000","last_unstale":"2024-08-20T05:00:05.151585+0000","last_undegraded":"2024-08-20T05:00:05.151585+0000","last_fullsized":"2024-08-20T05:00:05.151585+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:19:02.241567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.546918+0000","last_change":"2024-08-20T04:59:21.900610+0000","last_active":"2024-08-20T04:59:26.546918+0000","last_peered":"2024-08-20T04:59:26.546918+0000","last_clean":"2024-08-20T04:59:26.546918+0000","last_became_active":"2024-08-20T04:59:21.900207+0000","last_became_peered":"2024-08-20T04:59:21.900207+0000","last_unstale":"2024-08-20T04:59:26.546918+0000","last_undegraded":"2024-08-20T04:59:26.546918+0000","last_fullsized":"2024-08-20T04:59:26.546918+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:41:00.115344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294510+0000","last_change":"2024-08-20T04:59:12.780772+0000","last_active":"2024-08-20T04:59:26.294510+0000","last_peered":"2024-08-20T04:59:26.294510+0000","last_clean":"2024-08-20T04:59:26.294510+0000","last_became_active":"2024-08-20T04:59:12.780385+0000","last_became_peered":"2024-08-20T04:59:12.780385+0000","last_unstale":"2024-08-20T04:59:26.294510+0000","last_undegraded":"2024-08-20T04:59:26.294510+0000","last_fullsized":"2024-08-20T04:59:26.294510+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:23.680899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":39,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:03.133873+0000","last_change":"2024-08-20T04:59:09.749567+0000","last_active":"2024-08-20T05:00:03.133873+0000","last_peered":"2024-08-20T05:00:03.133873+0000","last_clean":"2024-08-20T05:00:03.133873+0000","last_became_active":"2024-08-20T04:59:09.749204+0000","last_became_peered":"2024-08-20T04:59:09.749204+0000","last_unstale":"2024-08-20T05:00:03.133873+0000","last_undegraded":"2024-08-20T05:00:03.133873+0000","last_fullsized":"2024-08-20T05:00:03.133873+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:57:51.236459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":43,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:04.143615+0000","last_change":"2024-08-20T04:59:09.751622+0000","last_active":"2024-08-20T05:00:04.143615+0000","last_peered":"2024-08-20T05:00:04.143615+0000","last_clean":"2024-08-20T05:00:04.143615+0000","last_became_active":"2024-08-20T04:59:09.751227+0000","last_became_peered":"2024-08-20T04:59:09.751227+0000","last_unstale":"2024-08-20T05:00:04.143615+0000","last_undegraded":"2024-08-20T05:00:04.143615+0000","last_fullsized":"2024-08-20T05:00:04.143615+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:53:38.755122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904396+0000","last_change":"2024-08-20T04:59:12.789243+0000","last_active":"2024-08-20T04:59:25.904396+0000","last_peered":"2024-08-20T04:59:25.904396+0000","last_clean":"2024-08-20T04:59:25.904396+0000","last_became_active":"2024-08-20T04:59:12.788932+0000","last_became_peered":"2024-08-20T04:59:12.788932+0000","last_unstale":"2024-08-20T04:59:25.904396+0000","last_undegraded":"2024-08-20T04:59:25.904396+0000","last_fullsized":"2024-08-20T04:59:25.904396+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:27:00.122328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.432713+0000","last_change":"2024-08-20T04:59:21.902847+0000","last_active":"2024-08-20T04:59:26.432713+0000","last_peered":"2024-08-20T04:59:26.432713+0000","last_clean":"2024-08-20T04:59:26.432713+0000","last_became_active":"2024-08-20T04:59:21.902426+0000","last_became_peered":"2024-08-20T04:59:21.902426+0000","last_unstale":"2024-08-20T04:59:26.432713+0000","last_undegraded":"2024-08-20T04:59:26.432713+0000","last_fullsized":"2024-08-20T04:59:26.432713+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:18:38.107358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":58,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T05:00:19.175940+0000","last_change":"2024-08-20T04:59:09.754977+0000","last_active":"2024-08-20T05:00:19.175940+0000","last_peered":"2024-08-20T05:00:19.175940+0000","last_clean":"2024-08-20T05:00:19.175940+0000","last_became_active":"2024-08-20T04:59:09.754078+0000","last_became_peered":"2024-08-20T04:59:09.754078+0000","last_unstale":"2024-08-20T05:00:19.175940+0000","last_undegraded":"2024-08-20T05:00:19.175940+0000","last_fullsized":"2024-08-20T05:00:19.175940+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:47:42.125326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.546819+0000","last_change":"2024-08-20T04:59:12.785811+0000","last_active":"2024-08-20T04:59:26.546819+0000","last_peered":"2024-08-20T04:59:26.546819+0000","last_clean":"2024-08-20T04:59:26.546819+0000","last_became_active":"2024-08-20T04:59:12.785483+0000","last_became_peered":"2024-08-20T04:59:12.785483+0000","last_unstale":"2024-08-20T04:59:26.546819+0000","last_undegraded":"2024-08-20T04:59:26.546819+0000","last_fullsized":"2024-08-20T04:59:26.546819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:31:25.355197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.432930+0000","last_change":"2024-08-20T04:59:21.897832+0000","last_active":"2024-08-20T04:59:26.432930+0000","last_peered":"2024-08-20T04:59:26.432930+0000","last_clean":"2024-08-20T04:59:26.432930+0000","last_became_active":"2024-08-20T04:59:21.897457+0000","last_became_peered":"2024-08-20T04:59:21.897457+0000","last_unstale":"2024-08-20T04:59:26.432930+0000","last_undegraded":"2024-08-20T04:59:26.432930+0000","last_fullsized":"2024-08-20T04:59:26.432930+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:39:51.934014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547220+0000","last_change":"2024-08-20T04:59:12.787671+0000","last_active":"2024-08-20T04:59:26.547220+0000","last_peered":"2024-08-20T04:59:26.547220+0000","last_clean":"2024-08-20T04:59:26.547220+0000","last_became_active":"2024-08-20T04:59:12.787372+0000","last_became_peered":"2024-08-20T04:59:12.787372+0000","last_unstale":"2024-08-20T04:59:26.547220+0000","last_undegraded":"2024-08-20T04:59:26.547220+0000","last_fullsized":"2024-08-20T04:59:26.547220+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:16:55.031031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.433010+0000","last_change":"2024-08-20T04:59:12.792192+0000","last_active":"2024-08-20T04:59:26.433010+0000","last_peered":"2024-08-20T04:59:26.433010+0000","last_clean":"2024-08-20T04:59:26.433010+0000","last_became_active":"2024-08-20T04:59:12.791447+0000","last_became_peered":"2024-08-20T04:59:12.791447+0000","last_unstale":"2024-08-20T04:59:26.433010+0000","last_undegraded":"2024-08-20T04:59:26.433010+0000","last_fullsized":"2024-08-20T04:59:26.433010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:03:32.559245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.432503+0000","last_change":"2024-08-20T04:59:12.785393+0000","last_active":"2024-08-20T04:59:26.432503+0000","last_peered":"2024-08-20T04:59:26.432503+0000","last_clean":"2024-08-20T04:59:26.432503+0000","last_became_active":"2024-08-20T04:59:12.784998+0000","last_became_peered":"2024-08-20T04:59:12.784998+0000","last_unstale":"2024-08-20T04:59:26.432503+0000","last_undegraded":"2024-08-20T04:59:26.432503+0000","last_fullsized":"2024-08-20T04:59:26.432503+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:27:04.964290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020584+0000","last_change":"2024-08-20T04:59:12.784730+0000","last_active":"2024-08-20T04:59:26.020584+0000","last_peered":"2024-08-20T04:59:26.020584+0000","last_clean":"2024-08-20T04:59:26.020584+0000","last_became_active":"2024-08-20T04:59:12.784269+0000","last_became_peered":"2024-08-20T04:59:12.784269+0000","last_unstale":"2024-08-20T04:59:26.020584+0000","last_undegraded":"2024-08-20T04:59:26.020584+0000","last_fullsized":"2024-08-20T04:59:26.020584+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:43:12.248033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904125+0000","last_change":"2024-08-20T04:59:12.786484+0000","last_active":"2024-08-20T04:59:25.904125+0000","last_peered":"2024-08-20T04:59:25.904125+0000","last_clean":"2024-08-20T04:59:25.904125+0000","last_became_active":"2024-08-20T04:59:12.786166+0000","last_became_peered":"2024-08-20T04:59:12.786166+0000","last_unstale":"2024-08-20T04:59:25.904125+0000","last_undegraded":"2024-08-20T04:59:25.904125+0000","last_fullsized":"2024-08-20T04:59:25.904125+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:30.084519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547565+0000","last_change":"2024-08-20T04:59:12.786985+0000","last_active":"2024-08-20T04:59:26.547565+0000","last_peered":"2024-08-20T04:59:26.547565+0000","last_clean":"2024-08-20T04:59:26.547565+0000","last_became_active":"2024-08-20T04:59:12.786674+0000","last_became_peered":"2024-08-20T04:59:12.786674+0000","last_unstale":"2024-08-20T04:59:26.547565+0000","last_undegraded":"2024-08-20T04:59:26.547565+0000","last_fullsized":"2024-08-20T04:59:26.547565+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:30:59.996149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.432950+0000","last_change":"2024-08-20T04:59:12.796410+0000","last_active":"2024-08-20T04:59:26.432950+0000","last_peered":"2024-08-20T04:59:26.432950+0000","last_clean":"2024-08-20T04:59:26.432950+0000","last_became_active":"2024-08-20T04:59:12.796081+0000","last_became_peered":"2024-08-20T04:59:12.796081+0000","last_unstale":"2024-08-20T04:59:26.432950+0000","last_undegraded":"2024-08-20T04:59:26.432950+0000","last_fullsized":"2024-08-20T04:59:26.432950+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:49:09.706265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.295080+0000","last_change":"2024-08-20T04:59:12.795994+0000","last_active":"2024-08-20T04:59:26.295080+0000","last_peered":"2024-08-20T04:59:26.295080+0000","last_clean":"2024-08-20T04:59:26.295080+0000","last_became_active":"2024-08-20T04:59:12.795604+0000","last_became_peered":"2024-08-20T04:59:12.795604+0000","last_unstale":"2024-08-20T04:59:26.295080+0000","last_undegraded":"2024-08-20T04:59:26.295080+0000","last_fullsized":"2024-08-20T04:59:26.295080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:54:09.628743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904322+0000","last_change":"2024-08-20T04:59:12.788966+0000","last_active":"2024-08-20T04:59:25.904322+0000","last_peered":"2024-08-20T04:59:25.904322+0000","last_clean":"2024-08-20T04:59:25.904322+0000","last_became_active":"2024-08-20T04:59:12.788534+0000","last_became_peered":"2024-08-20T04:59:12.788534+0000","last_unstale":"2024-08-20T04:59:25.904322+0000","last_undegraded":"2024-08-20T04:59:25.904322+0000","last_fullsized":"2024-08-20T04:59:25.904322+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.615399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294509+0000","last_change":"2024-08-20T04:59:12.785914+0000","last_active":"2024-08-20T04:59:26.294509+0000","last_peered":"2024-08-20T04:59:26.294509+0000","last_clean":"2024-08-20T04:59:26.294509+0000","last_became_active":"2024-08-20T04:59:12.785551+0000","last_became_peered":"2024-08-20T04:59:12.785551+0000","last_unstale":"2024-08-20T04:59:26.294509+0000","last_undegraded":"2024-08-20T04:59:26.294509+0000","last_fullsized":"2024-08-20T04:59:26.294509+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:30:32.072387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904302+0000","last_change":"2024-08-20T04:59:12.795635+0000","last_active":"2024-08-20T04:59:25.904302+0000","last_peered":"2024-08-20T04:59:25.904302+0000","last_clean":"2024-08-20T04:59:25.904302+0000","last_became_active":"2024-08-20T04:59:12.794805+0000","last_became_peered":"2024-08-20T04:59:12.794805+0000","last_unstale":"2024-08-20T04:59:25.904302+0000","last_undegraded":"2024-08-20T04:59:25.904302+0000","last_fullsized":"2024-08-20T04:59:25.904302+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:09:08.725503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.903884+0000","last_change":"2024-08-20T04:59:12.785099+0000","last_active":"2024-08-20T04:59:25.903884+0000","last_peered":"2024-08-20T04:59:25.903884+0000","last_clean":"2024-08-20T04:59:25.903884+0000","last_became_active":"2024-08-20T04:59:12.784727+0000","last_became_peered":"2024-08-20T04:59:12.784727+0000","last_unstale":"2024-08-20T04:59:25.903884+0000","last_undegraded":"2024-08-20T04:59:25.903884+0000","last_fullsized":"2024-08-20T04:59:25.903884+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:24:36.227289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547177+0000","last_change":"2024-08-20T04:59:12.781832+0000","last_active":"2024-08-20T04:59:26.547177+0000","last_peered":"2024-08-20T04:59:26.547177+0000","last_clean":"2024-08-20T04:59:26.547177+0000","last_became_active":"2024-08-20T04:59:12.781342+0000","last_became_peered":"2024-08-20T04:59:12.781342+0000","last_unstale":"2024-08-20T04:59:26.547177+0000","last_undegraded":"2024-08-20T04:59:26.547177+0000","last_fullsized":"2024-08-20T04:59:26.547177+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:26:17.762048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.432967+0000","last_change":"2024-08-20T04:59:12.792350+0000","last_active":"2024-08-20T04:59:26.432967+0000","last_peered":"2024-08-20T04:59:26.432967+0000","last_clean":"2024-08-20T04:59:26.432967+0000","last_became_active":"2024-08-20T04:59:12.792028+0000","last_became_peered":"2024-08-20T04:59:12.792028+0000","last_unstale":"2024-08-20T04:59:26.432967+0000","last_undegraded":"2024-08-20T04:59:26.432967+0000","last_fullsized":"2024-08-20T04:59:26.432967+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:16:23.173759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547435+0000","last_change":"2024-08-20T04:59:12.795047+0000","last_active":"2024-08-20T04:59:26.547435+0000","last_peered":"2024-08-20T04:59:26.547435+0000","last_clean":"2024-08-20T04:59:26.547435+0000","last_became_active":"2024-08-20T04:59:12.794705+0000","last_became_peered":"2024-08-20T04:59:12.794705+0000","last_unstale":"2024-08-20T04:59:26.547435+0000","last_undegraded":"2024-08-20T04:59:26.547435+0000","last_fullsized":"2024-08-20T04:59:26.547435+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:51:16.355892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547432+0000","last_change":"2024-08-20T04:59:12.785022+0000","last_active":"2024-08-20T04:59:26.547432+0000","last_peered":"2024-08-20T04:59:26.547432+0000","last_clean":"2024-08-20T04:59:26.547432+0000","last_became_active":"2024-08-20T04:59:12.784730+0000","last_became_peered":"2024-08-20T04:59:12.784730+0000","last_unstale":"2024-08-20T04:59:26.547432+0000","last_undegraded":"2024-08-20T04:59:26.547432+0000","last_fullsized":"2024-08-20T04:59:26.547432+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:21:53.053890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.903982+0000","last_change":"2024-08-20T04:59:12.790825+0000","last_active":"2024-08-20T04:59:25.903982+0000","last_peered":"2024-08-20T04:59:25.903982+0000","last_clean":"2024-08-20T04:59:25.903982+0000","last_became_active":"2024-08-20T04:59:12.790299+0000","last_became_peered":"2024-08-20T04:59:12.790299+0000","last_unstale":"2024-08-20T04:59:25.903982+0000","last_undegraded":"2024-08-20T04:59:25.903982+0000","last_fullsized":"2024-08-20T04:59:25.903982+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:12.477186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020338+0000","last_change":"2024-08-20T04:59:12.786237+0000","last_active":"2024-08-20T04:59:26.020338+0000","last_peered":"2024-08-20T04:59:26.020338+0000","last_clean":"2024-08-20T04:59:26.020338+0000","last_became_active":"2024-08-20T04:59:12.785829+0000","last_became_peered":"2024-08-20T04:59:12.785829+0000","last_unstale":"2024-08-20T04:59:26.020338+0000","last_undegraded":"2024-08-20T04:59:26.020338+0000","last_fullsized":"2024-08-20T04:59:26.020338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:29:04.330564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020341+0000","last_change":"2024-08-20T04:59:12.783355+0000","last_active":"2024-08-20T04:59:26.020341+0000","last_peered":"2024-08-20T04:59:26.020341+0000","last_clean":"2024-08-20T04:59:26.020341+0000","last_became_active":"2024-08-20T04:59:12.782992+0000","last_became_peered":"2024-08-20T04:59:12.782992+0000","last_unstale":"2024-08-20T04:59:26.020341+0000","last_undegraded":"2024-08-20T04:59:26.020341+0000","last_fullsized":"2024-08-20T04:59:26.020341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:09:47.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.903857+0000","last_change":"2024-08-20T04:59:12.783989+0000","last_active":"2024-08-20T04:59:25.903857+0000","last_peered":"2024-08-20T04:59:25.903857+0000","last_clean":"2024-08-20T04:59:25.903857+0000","last_became_active":"2024-08-20T04:59:12.783671+0000","last_became_peered":"2024-08-20T04:59:12.783671+0000","last_unstale":"2024-08-20T04:59:25.903857+0000","last_undegraded":"2024-08-20T04:59:25.903857+0000","last_fullsized":"2024-08-20T04:59:25.903857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:34:55.727599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.227508+0000","last_change":"2024-08-20T04:59:12.787118+0000","last_active":"2024-08-20T04:59:26.227508+0000","last_peered":"2024-08-20T04:59:26.227508+0000","last_clean":"2024-08-20T04:59:26.227508+0000","last_became_active":"2024-08-20T04:59:12.786754+0000","last_became_peered":"2024-08-20T04:59:12.786754+0000","last_unstale":"2024-08-20T04:59:26.227508+0000","last_undegraded":"2024-08-20T04:59:26.227508+0000","last_fullsized":"2024-08-20T04:59:26.227508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:13:23.959972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.528040+0000","last_change":"2024-08-20T04:59:12.793748+0000","last_active":"2024-08-20T04:59:26.528040+0000","last_peered":"2024-08-20T04:59:26.528040+0000","last_clean":"2024-08-20T04:59:26.528040+0000","last_became_active":"2024-08-20T04:59:12.792550+0000","last_became_peered":"2024-08-20T04:59:12.792550+0000","last_unstale":"2024-08-20T04:59:26.528040+0000","last_undegraded":"2024-08-20T04:59:26.528040+0000","last_fullsized":"2024-08-20T04:59:26.528040+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:59:24.226273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.980105+0000","last_change":"2024-08-20T04:59:12.788827+0000","last_active":"2024-08-20T04:59:25.980105+0000","last_peered":"2024-08-20T04:59:25.980105+0000","last_clean":"2024-08-20T04:59:25.980105+0000","last_became_active":"2024-08-20T04:59:12.788395+0000","last_became_peered":"2024-08-20T04:59:12.788395+0000","last_unstale":"2024-08-20T04:59:25.980105+0000","last_undegraded":"2024-08-20T04:59:25.980105+0000","last_fullsized":"2024-08-20T04:59:25.980105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:26.453063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.904753+0000","last_change":"2024-08-20T04:59:12.795513+0000","last_active":"2024-08-20T04:59:25.904753+0000","last_peered":"2024-08-20T04:59:25.904753+0000","last_clean":"2024-08-20T04:59:25.904753+0000","last_became_active":"2024-08-20T04:59:12.795191+0000","last_became_peered":"2024-08-20T04:59:12.795191+0000","last_unstale":"2024-08-20T04:59:25.904753+0000","last_undegraded":"2024-08-20T04:59:25.904753+0000","last_fullsized":"2024-08-20T04:59:25.904753+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:04:00.893420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.294465+0000","last_change":"2024-08-20T04:59:12.789825+0000","last_active":"2024-08-20T04:59:26.294465+0000","last_peered":"2024-08-20T04:59:26.294465+0000","last_clean":"2024-08-20T04:59:26.294465+0000","last_became_active":"2024-08-20T04:59:12.788198+0000","last_became_peered":"2024-08-20T04:59:12.788198+0000","last_unstale":"2024-08-20T04:59:26.294465+0000","last_undegraded":"2024-08-20T04:59:26.294465+0000","last_fullsized":"2024-08-20T04:59:26.294465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:10.898308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.527583+0000","last_change":"2024-08-20T04:59:12.787707+0000","last_active":"2024-08-20T04:59:26.527583+0000","last_peered":"2024-08-20T04:59:26.527583+0000","last_clean":"2024-08-20T04:59:26.527583+0000","last_became_active":"2024-08-20T04:59:12.787035+0000","last_became_peered":"2024-08-20T04:59:12.787035+0000","last_unstale":"2024-08-20T04:59:26.527583+0000","last_undegraded":"2024-08-20T04:59:26.527583+0000","last_fullsized":"2024-08-20T04:59:26.527583+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:16:52.451048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:25.979647+0000","last_change":"2024-08-20T04:59:12.784012+0000","last_active":"2024-08-20T04:59:25.979647+0000","last_peered":"2024-08-20T04:59:25.979647+0000","last_clean":"2024-08-20T04:59:25.979647+0000","last_became_active":"2024-08-20T04:59:12.783599+0000","last_became_peered":"2024-08-20T04:59:12.783599+0000","last_unstale":"2024-08-20T04:59:25.979647+0000","last_undegraded":"2024-08-20T04:59:25.979647+0000","last_fullsized":"2024-08-20T04:59:25.979647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:23:15.271873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.546591+0000","last_change":"2024-08-20T04:59:12.784987+0000","last_active":"2024-08-20T04:59:26.546591+0000","last_peered":"2024-08-20T04:59:26.546591+0000","last_clean":"2024-08-20T04:59:26.546591+0000","last_became_active":"2024-08-20T04:59:12.784693+0000","last_became_peered":"2024-08-20T04:59:12.784693+0000","last_unstale":"2024-08-20T04:59:26.546591+0000","last_undegraded":"2024-08-20T04:59:26.546591+0000","last_fullsized":"2024-08-20T04:59:26.546591+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:07:51.624602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.227392+0000","last_change":"2024-08-20T04:59:12.792466+0000","last_active":"2024-08-20T04:59:26.227392+0000","last_peered":"2024-08-20T04:59:26.227392+0000","last_clean":"2024-08-20T04:59:26.227392+0000","last_became_active":"2024-08-20T04:59:12.792114+0000","last_became_peered":"2024-08-20T04:59:12.792114+0000","last_unstale":"2024-08-20T04:59:26.227392+0000","last_undegraded":"2024-08-20T04:59:26.227392+0000","last_fullsized":"2024-08-20T04:59:26.227392+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:23:09.919907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020538+0000","last_change":"2024-08-20T04:59:12.793041+0000","last_active":"2024-08-20T04:59:26.020538+0000","last_peered":"2024-08-20T04:59:26.020538+0000","last_clean":"2024-08-20T04:59:26.020538+0000","last_became_active":"2024-08-20T04:59:12.792709+0000","last_became_peered":"2024-08-20T04:59:12.792709+0000","last_unstale":"2024-08-20T04:59:26.020538+0000","last_undegraded":"2024-08-20T04:59:26.020538+0000","last_fullsized":"2024-08-20T04:59:26.020538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:09:04.523493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.020698+0000","last_change":"2024-08-20T04:59:12.790256+0000","last_active":"2024-08-20T04:59:26.020698+0000","last_peered":"2024-08-20T04:59:26.020698+0000","last_clean":"2024-08-20T04:59:26.020698+0000","last_became_active":"2024-08-20T04:59:12.788467+0000","last_became_peered":"2024-08-20T04:59:12.788467+0000","last_unstale":"2024-08-20T04:59:26.020698+0000","last_undegraded":"2024-08-20T04:59:26.020698+0000","last_fullsized":"2024-08-20T04:59:26.020698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:55:31.386030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-08-20T04:59:26.547385+0000","last_change":"2024-08-20T04:59:12.794882+0000","last_active":"2024-08-20T04:59:26.547385+0000","last_peered":"2024-08-20T04:59:26.547385+0000","last_clean":"2024-08-20T04:59:26.547385+0000","last_became_active":"2024-08-20T04:59:12.794564+0000","last_became_peered":"2024-08-20T04:59:12.794564+0000","last_unstale":"2024-08-20T04:59:26.547385+0000","last_undegraded":"2024-08-20T04:59:26.547385+0000","last_fullsized":"2024-08-20T04:59:26.547385+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:36:47.515754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63364,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":210,"num_read_kb":176,"num_write":244,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":185827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743452,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":472714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939681,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1642496,"data_stored":1115690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103207,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":476349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299435,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32136,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713016,"statfs":{"total":95995035648,"available":95962128384,"internally_reserved":0,"allocated":974848,"data_stored":472631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462960,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1572864,"data_stored":1069128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626486,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":954368,"data_stored":467757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822715,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1581056,"data_stored":1064319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986240,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":472222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182469,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":467465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1032192,"data_stored":521293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1011712,"data_stored":520682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32140,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713012,"statfs":{"total":95995035648,"available":95962124288,"internally_reserved":0,"allocated":978944,"data_stored":469604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":53647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":58287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T05:00:25.892 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-20T05:00:25.893 INFO:tasks.cephadm:Setting up client nodes... 2024-08-20T05:00:25.893 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-20T05:00:26.278 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:26.612 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:26 smithi037 ceph-mon[17265]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:00:26.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:26 smithi135 ceph-mon[22342]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:00:26.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:26 smithi130 ceph-mon[22007]: from='client.14889 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:00:26.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.865+0000 7f784ec00640 1 -- 172.21.15.37:0/3250357964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7848077740 msgr2=0x7f7848077b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:26.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.865+0000 7f784ec00640 1 --2- 172.21.15.37:0/3250357964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7848077740 0x7f7848077b40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f783c009900 tx=0x7f783c02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:00:26.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.865+0000 7f784ec00640 1 -- 172.21.15.37:0/3250357964 shutdown_connections 2024-08-20T05:00:26.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.865+0000 7f784ec00640 1 --2- 172.21.15.37:0/3250357964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7848079260 0x7f7848079bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:26.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.865+0000 7f784ec00640 1 --2- 172.21.15.37:0/3250357964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f78480788a0 0x7f7848078d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:26.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.865+0000 7f784ec00640 1 --2- 172.21.15.37:0/3250357964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7848077740 0x7f7848077b40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:26.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.865+0000 7f784ec00640 1 -- 172.21.15.37:0/3250357964 >> 172.21.15.37:0/3250357964 conn(0x7f78481000a0 msgr2=0x7f78481024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:26.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.865+0000 7f784ec00640 1 -- 172.21.15.37:0/3250357964 shutdown_connections 2024-08-20T05:00:26.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.866+0000 7f784ec00640 1 -- 172.21.15.37:0/3250357964 wait complete. 2024-08-20T05:00:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.866+0000 7f784ec00640 1 Processor -- start 2024-08-20T05:00:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.867+0000 7f784ec00640 1 -- start start 2024-08-20T05:00:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.867+0000 7f784ec00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7848077740 0x7f784819ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.867+0000 7f784ec00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78480788a0 0x7f784819f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.867+0000 7f784ec00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7848079260 0x7f78481a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.867+0000 7f784ec00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7848114840 con 0x7f78480788a0 2024-08-20T05:00:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.867+0000 7f784ec00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f78481146c0 con 0x7f7848079260 2024-08-20T05:00:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.867+0000 7f784ec00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f78481149c0 con 0x7f7848077740 2024-08-20T05:00:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.867+0000 7f784ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78480788a0 0x7f784819f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:26.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.867+0000 7f784ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78480788a0 0x7f784819f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45616/0 (socket says 172.21.15.37:45616) 2024-08-20T05:00:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.867+0000 7f784ce00640 1 -- 172.21.15.37:0/1320682963 learned_addr learned my addr 172.21.15.37:0/1320682963 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.867+0000 7f784d800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7848077740 0x7f784819ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.867+0000 7f784e200640 1 --2- 172.21.15.37:0/1320682963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7848079260 0x7f78481a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.868+0000 7f784d800640 1 -- 172.21.15.37:0/1320682963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7848079260 msgr2=0x7f78481a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.868+0000 7f784d800640 1 --2- 172.21.15.37:0/1320682963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7848079260 0x7f78481a00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.868+0000 7f784d800640 1 -- 172.21.15.37:0/1320682963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78480788a0 msgr2=0x7f784819f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.868+0000 7f784d800640 1 --2- 172.21.15.37:0/1320682963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78480788a0 0x7f784819f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.868+0000 7f784d800640 1 -- 172.21.15.37:0/1320682963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78481a0950 con 0x7f7848077740 2024-08-20T05:00:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.868+0000 7f784e200640 1 --2- 172.21.15.37:0/1320682963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7848079260 0x7f78481a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:00:26.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.868+0000 7f784ce00640 1 --2- 172.21.15.37:0/1320682963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78480788a0 0x7f784819f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:00:26.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.868+0000 7f784d800640 1 --2- 172.21.15.37:0/1320682963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7848077740 0x7f784819ee20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f783c02a9e0 tx=0x7f783c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:26.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.869+0000 7f7846000640 1 -- 172.21.15.37:0/1320682963 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c03f070 con 0x7f7848077740 2024-08-20T05:00:26.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.869+0000 7f7846000640 1 -- 172.21.15.37:0/1320682963 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f783c031c50 con 0x7f7848077740 2024-08-20T05:00:26.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.869+0000 7f7846000640 1 -- 172.21.15.37:0/1320682963 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c035030 con 0x7f7848077740 2024-08-20T05:00:26.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.869+0000 7f784ec00640 1 -- 172.21.15.37:0/1320682963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78481a0be0 con 0x7f7848077740 2024-08-20T05:00:26.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.869+0000 7f784ec00640 1 -- 172.21.15.37:0/1320682963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78481a7150 con 0x7f7848077740 2024-08-20T05:00:26.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.870+0000 7f784ec00640 1 -- 172.21.15.37:0/1320682963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7848111250 con 0x7f7848077740 2024-08-20T05:00:26.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.873+0000 7f7846000640 1 -- 172.21.15.37:0/1320682963 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f783c042070 con 0x7f7848077740 2024-08-20T05:00:26.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.874+0000 7f7846000640 1 --2- 172.21.15.37:0/1320682963 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f78300b3d90 0x7f78300b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:26.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.874+0000 7f7846000640 1 -- 172.21.15.37:0/1320682963 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8802+0+0 (secure 0 0 0) 0x7f783c104ac0 con 0x7f7848077740 2024-08-20T05:00:26.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.874+0000 7f784ce00640 1 --2- 172.21.15.37:0/1320682963 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f78300b3d90 0x7f78300b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:26.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.875+0000 7f784ce00640 1 --2- 172.21.15.37:0/1320682963 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f78300b3d90 0x7f78300b6250 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7834005fd0 tx=0x7f783400b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:26.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:26.876+0000 7f7846000640 1 -- 172.21.15.37:0/1320682963 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f783c03be20 con 0x7f7848077740 2024-08-20T05:00:27.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:27.145+0000 7f784ec00640 1 -- 172.21.15.37:0/1320682963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f784802e340 con 0x7f7848077740 2024-08-20T05:00:27.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:27.151+0000 7f7846000640 1 -- 172.21.15.37:0/1320682963 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f783c0cb6c0 con 0x7f7848077740 2024-08-20T05:00:27.153 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-08-20T05:00:27.153 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDrIsRmbY3LCBAAe0AmaSj3sUtwvP3qZJ5Ggg== 2024-08-20T05:00:27.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:27.154+0000 7f784ec00640 1 -- 172.21.15.37:0/1320682963 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f78300b3d90 msgr2=0x7f78300b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:27.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:27.154+0000 7f784ec00640 1 --2- 172.21.15.37:0/1320682963 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f78300b3d90 0x7f78300b6250 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7834005fd0 tx=0x7f783400b480 comp rx=0 tx=0).stop 2024-08-20T05:00:27.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:27.154+0000 7f784ec00640 1 -- 172.21.15.37:0/1320682963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7848077740 msgr2=0x7f784819ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:27.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:27.154+0000 7f784ec00640 1 --2- 172.21.15.37:0/1320682963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7848077740 0x7f784819ee20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f783c02a9e0 tx=0x7f783c003c10 comp rx=0 tx=0).stop 2024-08-20T05:00:27.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:27.154+0000 7f784ec00640 1 -- 172.21.15.37:0/1320682963 shutdown_connections 2024-08-20T05:00:27.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:27.154+0000 7f784ec00640 1 --2- 172.21.15.37:0/1320682963 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f78300b3d90 0x7f78300b6250 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:27.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:27.154+0000 7f784ec00640 1 --2- 172.21.15.37:0/1320682963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7848079260 0x7f78481a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:27.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:27.154+0000 7f784ec00640 1 --2- 172.21.15.37:0/1320682963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78480788a0 0x7f784819f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:27.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:27.154+0000 7f784ec00640 1 --2- 172.21.15.37:0/1320682963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7848077740 0x7f784819ee20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:27.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:27.154+0000 7f784ec00640 1 -- 172.21.15.37:0/1320682963 >> 172.21.15.37:0/1320682963 conn(0x7f78481000a0 msgr2=0x7f7848101b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:27.154+0000 7f784ec00640 1 -- 172.21.15.37:0/1320682963 shutdown_connections 2024-08-20T05:00:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:27.154+0000 7f784ec00640 1 -- 172.21.15.37:0/1320682963 wait complete. 2024-08-20T05:00:27.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:27 smithi037 ceph-mon[17265]: pgmap v343: 129 pgs: 129 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-08-20T05:00:27.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:27 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1320682963' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-20T05:00:27.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:27 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-20T05:00:27.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:27 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-20T05:00:27.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:27 smithi135 ceph-mon[22342]: pgmap v343: 129 pgs: 129 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-08-20T05:00:27.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:27 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1320682963' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-20T05:00:27.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:27 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-20T05:00:27.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:27 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-20T05:00:27.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:27 smithi130 ceph-mon[22007]: pgmap v343: 129 pgs: 129 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-08-20T05:00:27.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:27 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1320682963' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-20T05:00:27.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:27 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-08-20T05:00:27.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:27 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-20T05:00:27.938 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T05:00:27.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-20T05:00:27.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-20T05:00:28.018 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph config log 1 --format=json 2024-08-20T05:00:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:28.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-08-20T05:00:28.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-08-20T05:00:28.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-08-20T05:00:28.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]} : dispatch 2024-08-20T05:00:28.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2024-08-20T05:00:28.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]} : dispatch 2024-08-20T05:00:28.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-08-20T05:00:28.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]} : dispatch 2024-08-20T05:00:28.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]} : dispatch 2024-08-20T05:00:28.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]} : dispatch 2024-08-20T05:00:28.626 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-08-20T05:00:28.626 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-08-20T05:00:28.626 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-08-20T05:00:28.626 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]} : dispatch 2024-08-20T05:00:28.626 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2024-08-20T05:00:28.626 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]} : dispatch 2024-08-20T05:00:28.626 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-08-20T05:00:28.626 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]} : dispatch 2024-08-20T05:00:28.626 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]} : dispatch 2024-08-20T05:00:28.626 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]} : dispatch 2024-08-20T05:00:28.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]} : dispatch 2024-08-20T05:00:28.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-08-20T05:00:28.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-08-20T05:00:28.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]} : dispatch 2024-08-20T05:00:28.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2024-08-20T05:00:28.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]} : dispatch 2024-08-20T05:00:28.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]} : dispatch 2024-08-20T05:00:28.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]} : dispatch 2024-08-20T05:00:28.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]} : dispatch 2024-08-20T05:00:28.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]} : dispatch 2024-08-20T05:00:29.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.035+0000 7fe102a00640 1 -- 172.21.15.37:0/526551694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0fc10a520 msgr2=0x7fe0fc10a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.035+0000 7fe102a00640 1 --2- 172.21.15.37:0/526551694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0fc10a520 0x7fe0fc10a960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009900 tx=0x7fe0e802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:00:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.035+0000 7fe102a00640 1 -- 172.21.15.37:0/526551694 shutdown_connections 2024-08-20T05:00:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.035+0000 7fe102a00640 1 --2- 172.21.15.37:0/526551694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc10aea0 0x7fe0fc1116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.035+0000 7fe102a00640 1 --2- 172.21.15.37:0/526551694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0fc10a520 0x7fe0fc10a960 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.035+0000 7fe102a00640 1 --2- 172.21.15.37:0/526551694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0fc104b10 0x7fe0fc104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.035+0000 7fe102a00640 1 -- 172.21.15.37:0/526551694 >> 172.21.15.37:0/526551694 conn(0x7fe0fc100540 msgr2=0x7fe0fc102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.035+0000 7fe102a00640 1 -- 172.21.15.37:0/526551694 shutdown_connections 2024-08-20T05:00:29.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.035+0000 7fe102a00640 1 -- 172.21.15.37:0/526551694 wait complete. 2024-08-20T05:00:29.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.036+0000 7fe102a00640 1 Processor -- start 2024-08-20T05:00:29.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.036+0000 7fe102a00640 1 -- start start 2024-08-20T05:00:29.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.037+0000 7fe102a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc104b10 0x7fe0fc19aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:29.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.037+0000 7fe102a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0fc10a520 0x7fe0fc19b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:29.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.037+0000 7fe102a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0fc10aea0 0x7fe0fc1a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:29.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.037+0000 7fe102a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc114bb0 con 0x7fe0fc104b10 2024-08-20T05:00:29.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.037+0000 7fe102a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc114a30 con 0x7fe0fc10a520 2024-08-20T05:00:29.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.037+0000 7fe102a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc114d30 con 0x7fe0fc10aea0 2024-08-20T05:00:29.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.037+0000 7fe101600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc104b10 0x7fe0fc19aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:29.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.037+0000 7fe101600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc104b10 0x7fe0fc19aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45630/0 (socket says 172.21.15.37:45630) 2024-08-20T05:00:29.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.037+0000 7fe101600640 1 -- 172.21.15.37:0/3525320384 learned_addr learned my addr 172.21.15.37:0/3525320384 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:29.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.037+0000 7fe102000640 1 --2- 172.21.15.37:0/3525320384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0fc10aea0 0x7fe0fc1a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:29.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.037+0000 7fe100c00640 1 --2- 172.21.15.37:0/3525320384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0fc10a520 0x7fe0fc19b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.038+0000 7fe101600640 1 -- 172.21.15.37:0/3525320384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0fc10aea0 msgr2=0x7fe0fc1a07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.038+0000 7fe101600640 1 --2- 172.21.15.37:0/3525320384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0fc10aea0 0x7fe0fc1a07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.038+0000 7fe101600640 1 -- 172.21.15.37:0/3525320384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0fc10a520 msgr2=0x7fe0fc19b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.038+0000 7fe101600640 1 --2- 172.21.15.37:0/3525320384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0fc10a520 0x7fe0fc19b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.038+0000 7fe101600640 1 -- 172.21.15.37:0/3525320384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc1a0f90 con 0x7fe0fc104b10 2024-08-20T05:00:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.038+0000 7fe102000640 1 --2- 172.21.15.37:0/3525320384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0fc10aea0 0x7fe0fc1a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:00:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.038+0000 7fe101600640 1 --2- 172.21.15.37:0/3525320384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc104b10 0x7fe0fc19aee0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000e9f0 tx=0x7fe0f000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:29.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.038+0000 7fe0fa000640 1 -- 172.21.15.37:0/3525320384 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f000cd80 con 0x7fe0fc104b10 2024-08-20T05:00:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.038+0000 7fe0fa000640 1 -- 172.21.15.37:0/3525320384 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0f00108e0 con 0x7fe0fc104b10 2024-08-20T05:00:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.038+0000 7fe102a00640 1 -- 172.21.15.37:0/3525320384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0fc1a1280 con 0x7fe0fc104b10 2024-08-20T05:00:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.038+0000 7fe0fa000640 1 -- 172.21.15.37:0/3525320384 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0018980 con 0x7fe0fc104b10 2024-08-20T05:00:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.039+0000 7fe102a00640 1 -- 172.21.15.37:0/3525320384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0fc1a7b10 con 0x7fe0fc104b10 2024-08-20T05:00:29.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.040+0000 7fe102a00640 1 -- 172.21.15.37:0/3525320384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0fc105dc0 con 0x7fe0fc104b10 2024-08-20T05:00:29.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.042+0000 7fe0fa000640 1 -- 172.21.15.37:0/3525320384 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fe0f0010430 con 0x7fe0fc104b10 2024-08-20T05:00:29.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.044+0000 7fe0fa000640 1 --2- 172.21.15.37:0/3525320384 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe0e40b3d90 0x7fe0e40b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:29.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.045+0000 7fe0fa000640 1 -- 172.21.15.37:0/3525320384 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9092+0+0 (secure 0 0 0) 0x7fe0f00e43e0 con 0x7fe0fc104b10 2024-08-20T05:00:29.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.045+0000 7fe100c00640 1 --2- 172.21.15.37:0/3525320384 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe0e40b3d90 0x7fe0e40b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:29.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.045+0000 7fe100c00640 1 --2- 172.21.15.37:0/3525320384 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe0e40b3d90 0x7fe0e40b6250 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8005ab0 tx=0x7fe0e8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:29.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.048+0000 7fe0fa000640 1 -- 172.21.15.37:0/3525320384 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe0f00aaec0 con 0x7fe0fc104b10 2024-08-20T05:00:29.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.245+0000 7fe102a00640 1 -- 172.21.15.37:0/3525320384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fe0fc1a7ce0 con 0x7fe0fc104b10 2024-08-20T05:00:29.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.246+0000 7fe0fa000640 1 -- 172.21.15.37:0/3525320384 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v49) ==== 86+0+133 (secure 0 0 0) 0x7fe0f00af410 con 0x7fe0fc104b10 2024-08-20T05:00:29.248 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:00:29.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.248+0000 7fe102a00640 1 -- 172.21.15.37:0/3525320384 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe0e40b3d90 msgr2=0x7fe0e40b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:29.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.248+0000 7fe102a00640 1 --2- 172.21.15.37:0/3525320384 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe0e40b3d90 0x7fe0e40b6250 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8005ab0 tx=0x7fe0e8005a20 comp rx=0 tx=0).stop 2024-08-20T05:00:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.248+0000 7fe102a00640 1 -- 172.21.15.37:0/3525320384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc104b10 msgr2=0x7fe0fc19aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.248+0000 7fe102a00640 1 --2- 172.21.15.37:0/3525320384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc104b10 0x7fe0fc19aee0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe0f000e9f0 tx=0x7fe0f000eeb0 comp rx=0 tx=0).stop 2024-08-20T05:00:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.248+0000 7fe102a00640 1 -- 172.21.15.37:0/3525320384 shutdown_connections 2024-08-20T05:00:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.248+0000 7fe102a00640 1 --2- 172.21.15.37:0/3525320384 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe0e40b3d90 0x7fe0e40b6250 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.248+0000 7fe102a00640 1 --2- 172.21.15.37:0/3525320384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0fc10aea0 0x7fe0fc1a07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.248+0000 7fe102a00640 1 --2- 172.21.15.37:0/3525320384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0fc10a520 0x7fe0fc19b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.248+0000 7fe102a00640 1 --2- 172.21.15.37:0/3525320384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc104b10 0x7fe0fc19aee0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.248+0000 7fe102a00640 1 -- 172.21.15.37:0/3525320384 >> 172.21.15.37:0/3525320384 conn(0x7fe0fc100540 msgr2=0x7fe0fc103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.249+0000 7fe102a00640 1 -- 172.21.15.37:0/3525320384 shutdown_connections 2024-08-20T05:00:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:29.249+0000 7fe102a00640 1 -- 172.21.15.37:0/3525320384 wait complete. 2024-08-20T05:00:29.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:29 smithi037 ceph-mon[17265]: pgmap v344: 129 pgs: 129 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-08-20T05:00:29.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-08-20T05:00:29.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-08-20T05:00:29.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-08-20T05:00:29.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-08-20T05:00:29.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-08-20T05:00:29.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-08-20T05:00:29.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-08-20T05:00:29.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2024-08-20T05:00:29.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-08-20T05:00:29.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-08-20T05:00:29.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:29 smithi037 ceph-mon[17265]: osdmap e85: 12 total, 12 up, 12 in 2024-08-20T05:00:29.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:29 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3525320384' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-20T05:00:29.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:29 smithi135 ceph-mon[22342]: pgmap v344: 129 pgs: 129 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-08-20T05:00:29.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-08-20T05:00:29.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-08-20T05:00:29.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-08-20T05:00:29.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-08-20T05:00:29.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-08-20T05:00:29.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-08-20T05:00:29.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-08-20T05:00:29.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2024-08-20T05:00:29.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-08-20T05:00:29.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-08-20T05:00:29.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:29 smithi135 ceph-mon[22342]: osdmap e85: 12 total, 12 up, 12 in 2024-08-20T05:00:29.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:29 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3525320384' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-20T05:00:29.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:29 smithi130 ceph-mon[22007]: pgmap v344: 129 pgs: 129 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-08-20T05:00:29.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [2, 4]}]': finished 2024-08-20T05:00:29.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-08-20T05:00:29.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-08-20T05:00:29.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-08-20T05:00:29.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-08-20T05:00:29.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-08-20T05:00:29.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-08-20T05:00:29.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.5", "id": [9, 10]}]': finished 2024-08-20T05:00:29.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-08-20T05:00:29.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [9, 8]}]': finished 2024-08-20T05:00:29.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:29 smithi130 ceph-mon[22007]: osdmap e85: 12 total, 12 up, 12 in 2024-08-20T05:00:29.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:29 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3525320384' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-08-20T05:00:30.036 INFO:teuthology.orchestra.run.smithi037.stdout:[{"version":49,"timestamp":"2024-08-20T04:59:01.400635+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-08-20T05:00:30.036 INFO:tasks.ceph_manager:config epoch is 49 2024-08-20T05:00:30.036 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-20T05:00:30.037 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-20T05:00:30.037 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph mgr dump --format=json 2024-08-20T05:00:30.418 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:30.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:30 smithi037 ceph-mon[17265]: osdmap e86: 12 total, 12 up, 12 in 2024-08-20T05:00:30.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:30 smithi130 ceph-mon[22007]: osdmap e86: 12 total, 12 up, 12 in 2024-08-20T05:00:30.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:30 smithi135 ceph-mon[22342]: osdmap e86: 12 total, 12 up, 12 in 2024-08-20T05:00:30.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.955+0000 7fa850600640 1 -- 172.21.15.37:0/4049161914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa84810b040 msgr2=0x7fa848111840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:30.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.955+0000 7fa850600640 1 --2- 172.21.15.37:0/4049161914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa84810b040 0x7fa848111840 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa840009ca0 tx=0x7fa84002a8c0 comp rx=0 tx=0).stop 2024-08-20T05:00:30.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.955+0000 7fa850600640 1 -- 172.21.15.37:0/4049161914 shutdown_connections 2024-08-20T05:00:30.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.955+0000 7fa850600640 1 --2- 172.21.15.37:0/4049161914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa84810b040 0x7fa848111840 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:30.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.955+0000 7fa850600640 1 --2- 172.21.15.37:0/4049161914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa84810a6c0 0x7fa84810ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:30.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.955+0000 7fa850600640 1 --2- 172.21.15.37:0/4049161914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa848104cb0 0x7fa848105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:30.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.955+0000 7fa850600640 1 -- 172.21.15.37:0/4049161914 >> 172.21.15.37:0/4049161914 conn(0x7fa848100720 msgr2=0x7fa848102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:30.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.955+0000 7fa850600640 1 -- 172.21.15.37:0/4049161914 shutdown_connections 2024-08-20T05:00:30.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.955+0000 7fa850600640 1 -- 172.21.15.37:0/4049161914 wait complete. 2024-08-20T05:00:30.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.956+0000 7fa850600640 1 Processor -- start 2024-08-20T05:00:30.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.956+0000 7fa850600640 1 -- start start 2024-08-20T05:00:30.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.957+0000 7fa850600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa848104cb0 0x7fa84819b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:30.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.957+0000 7fa850600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa84810a6c0 0x7fa84819b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:30.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.957+0000 7fa850600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa84810b040 0x7fa8481a09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:30.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.957+0000 7fa850600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa848114cc0 con 0x7fa84810a6c0 2024-08-20T05:00:30.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.957+0000 7fa850600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa848114b40 con 0x7fa84810b040 2024-08-20T05:00:30.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.957+0000 7fa850600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa848114e40 con 0x7fa848104cb0 2024-08-20T05:00:30.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.957+0000 7fa84d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa84810a6c0 0x7fa84819b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:30.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.957+0000 7fa84d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa84810a6c0 0x7fa84819b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45654/0 (socket says 172.21.15.37:45654) 2024-08-20T05:00:30.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.957+0000 7fa84d200640 1 -- 172.21.15.37:0/2965699534 learned_addr learned my addr 172.21.15.37:0/2965699534 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:30.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.957+0000 7fa84dc00640 1 --2- 172.21.15.37:0/2965699534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa848104cb0 0x7fa84819b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:30.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.957+0000 7fa84e600640 1 --2- 172.21.15.37:0/2965699534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa84810b040 0x7fa8481a09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:30.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.958+0000 7fa84d200640 1 -- 172.21.15.37:0/2965699534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa848104cb0 msgr2=0x7fa84819b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:30.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.958+0000 7fa84d200640 1 --2- 172.21.15.37:0/2965699534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa848104cb0 0x7fa84819b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:30.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.958+0000 7fa84d200640 1 -- 172.21.15.37:0/2965699534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa84810b040 msgr2=0x7fa8481a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:30.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.958+0000 7fa84d200640 1 --2- 172.21.15.37:0/2965699534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa84810b040 0x7fa8481a09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:30.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.958+0000 7fa84d200640 1 -- 172.21.15.37:0/2965699534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8481a11c0 con 0x7fa84810a6c0 2024-08-20T05:00:30.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.958+0000 7fa84dc00640 1 --2- 172.21.15.37:0/2965699534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa848104cb0 0x7fa84819b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:00:30.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.958+0000 7fa84d200640 1 --2- 172.21.15.37:0/2965699534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa84810a6c0 0x7fa84819b650 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa83400e9f0 tx=0x7fa83400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:30.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.958+0000 7fa846000640 1 -- 172.21.15.37:0/2965699534 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83400cd80 con 0x7fa84810a6c0 2024-08-20T05:00:30.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.958+0000 7fa846000640 1 -- 172.21.15.37:0/2965699534 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8340108e0 con 0x7fa84810a6c0 2024-08-20T05:00:30.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.958+0000 7fa846000640 1 -- 172.21.15.37:0/2965699534 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834018980 con 0x7fa84810a6c0 2024-08-20T05:00:30.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.959+0000 7fa850600640 1 -- 172.21.15.37:0/2965699534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8481a14b0 con 0x7fa84810a6c0 2024-08-20T05:00:30.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.959+0000 7fa850600640 1 -- 172.21.15.37:0/2965699534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8481a7b70 con 0x7fa84810a6c0 2024-08-20T05:00:30.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.960+0000 7fa850600640 1 -- 172.21.15.37:0/2965699534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa848105090 con 0x7fa84810a6c0 2024-08-20T05:00:30.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.962+0000 7fa846000640 1 -- 172.21.15.37:0/2965699534 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fa834010430 con 0x7fa84810a6c0 2024-08-20T05:00:30.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.963+0000 7fa846000640 1 --2- 172.21.15.37:0/2965699534 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa8300b3c60 0x7fa8300b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:30.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.964+0000 7fa846000640 1 -- 172.21.15.37:0/2965699534 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fa8340e4920 con 0x7fa84810a6c0 2024-08-20T05:00:30.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.964+0000 7fa84dc00640 1 --2- 172.21.15.37:0/2965699534 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa8300b3c60 0x7fa8300b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:30.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.964+0000 7fa84dc00640 1 --2- 172.21.15.37:0/2965699534 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa8300b3c60 0x7fa8300b6120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0095f0 tx=0x7fa83c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:30.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:30.965+0000 7fa846000640 1 -- 172.21.15.37:0/2965699534 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa8340ab400 con 0x7fa84810a6c0 2024-08-20T05:00:31.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:31.209+0000 7fa850600640 1 -- 172.21.15.37:0/2965699534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fa84819c240 con 0x7fa84810a6c0 2024-08-20T05:00:31.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:31.215+0000 7fa846000640 1 -- 172.21.15.37:0/2965699534 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+291015 (secure 0 0 0) 0x7fa84819c240 con 0x7fa84810a6c0 2024-08-20T05:00:31.222 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:00:31.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:31.220+0000 7fa850600640 1 -- 172.21.15.37:0/2965699534 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa8300b3c60 msgr2=0x7fa8300b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:31.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:31.220+0000 7fa850600640 1 --2- 172.21.15.37:0/2965699534 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa8300b3c60 0x7fa8300b6120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0095f0 tx=0x7fa83c005f90 comp rx=0 tx=0).stop 2024-08-20T05:00:31.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:31.220+0000 7fa850600640 1 -- 172.21.15.37:0/2965699534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa84810a6c0 msgr2=0x7fa84819b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:31.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:31.220+0000 7fa850600640 1 --2- 172.21.15.37:0/2965699534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa84810a6c0 0x7fa84819b650 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa83400e9f0 tx=0x7fa83400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:00:31.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:31.220+0000 7fa850600640 1 -- 172.21.15.37:0/2965699534 shutdown_connections 2024-08-20T05:00:31.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:31.220+0000 7fa850600640 1 --2- 172.21.15.37:0/2965699534 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa8300b3c60 0x7fa8300b6120 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:31.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:31.220+0000 7fa850600640 1 --2- 172.21.15.37:0/2965699534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa84810b040 0x7fa8481a09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:31.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:31.220+0000 7fa850600640 1 --2- 172.21.15.37:0/2965699534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa84810a6c0 0x7fa84819b650 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:31.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:31.220+0000 7fa850600640 1 --2- 172.21.15.37:0/2965699534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa848104cb0 0x7fa84819b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:31.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:31.220+0000 7fa850600640 1 -- 172.21.15.37:0/2965699534 >> 172.21.15.37:0/2965699534 conn(0x7fa848100720 msgr2=0x7fa848100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:31.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:31.220+0000 7fa850600640 1 -- 172.21.15.37:0/2965699534 shutdown_connections 2024-08-20T05:00:31.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:31.220+0000 7fa850600640 1 -- 172.21.15.37:0/2965699534 wait complete. 2024-08-20T05:00:31.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:31 smithi037 ceph-mon[17265]: pgmap v347: 129 pgs: 7 peering, 122 active+clean; 646 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-08-20T05:00:31.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:31 smithi037 ceph-mon[17265]: Health check failed: Reduced data availability: 6 pgs peering (PG_AVAILABILITY) 2024-08-20T05:00:31.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:31 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2965699534' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-20T05:00:31.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:31 smithi130 ceph-mon[22007]: pgmap v347: 129 pgs: 7 peering, 122 active+clean; 646 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-08-20T05:00:31.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:31 smithi130 ceph-mon[22007]: Health check failed: Reduced data availability: 6 pgs peering (PG_AVAILABILITY) 2024-08-20T05:00:31.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:31 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2965699534' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-20T05:00:31.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:31 smithi135 ceph-mon[22342]: pgmap v347: 129 pgs: 7 peering, 122 active+clean; 646 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.9 KiB/s wr, 12 op/s 2024-08-20T05:00:31.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:31 smithi135 ceph-mon[22342]: Health check failed: Reduced data availability: 6 pgs peering (PG_AVAILABILITY) 2024-08-20T05:00:31.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:31 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2965699534' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-08-20T05:00:32.180 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":839402922},{"type":"v1","addr":"172.21.15.37:6801","nonce":839402922}]},"active_addr":"172.21.15.37:6801/839402922","active_change":"2024-08-20T04:51:27.878054+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24163,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24173,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.37:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":3726395445}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":3197144397}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":712925947}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":4195212710}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":440662032}]}]} 2024-08-20T05:00:32.188 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-20T05:00:32.188 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-20T05:00:32.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T05:00:32.567 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.166+0000 7f454e400640 1 -- 172.21.15.37:0/2186034819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45481084c0 msgr2=0x7f4548108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.166+0000 7f454e400640 1 --2- 172.21.15.37:0/2186034819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45481084c0 0x7f4548108900 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4534009900 tx=0x7f453402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:00:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.167+0000 7f454e400640 1 -- 172.21.15.37:0/2186034819 shutdown_connections 2024-08-20T05:00:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.167+0000 7f454e400640 1 --2- 172.21.15.37:0/2186034819 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4548108e40 0x7f454810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.167+0000 7f454e400640 1 --2- 172.21.15.37:0/2186034819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45481084c0 0x7f4548108900 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.167+0000 7f454e400640 1 --2- 172.21.15.37:0/2186034819 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4548102ab0 0x7f4548102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.167+0000 7f454e400640 1 -- 172.21.15.37:0/2186034819 >> 172.21.15.37:0/2186034819 conn(0x7f45480fe500 msgr2=0x7f4548100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.167+0000 7f454e400640 1 -- 172.21.15.37:0/2186034819 shutdown_connections 2024-08-20T05:00:33.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.167+0000 7f454e400640 1 -- 172.21.15.37:0/2186034819 wait complete. 2024-08-20T05:00:33.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.168+0000 7f454e400640 1 Processor -- start 2024-08-20T05:00:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.168+0000 7f454e400640 1 -- start start 2024-08-20T05:00:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.168+0000 7f454e400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4548102ab0 0x7f4548076c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.168+0000 7f454e400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45481084c0 0x7f45480751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.168+0000 7f454e400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4548108e40 0x7f4548075800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.168+0000 7f454e400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4548112b10 con 0x7f4548108e40 2024-08-20T05:00:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.168+0000 7f454e400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4548112990 con 0x7f4548102ab0 2024-08-20T05:00:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.168+0000 7f454e400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4548112c90 con 0x7f45481084c0 2024-08-20T05:00:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.168+0000 7f4546a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45481084c0 0x7f45480751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.168+0000 7f4546a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45481084c0 0x7f45480751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:40830/0 (socket says 172.21.15.37:40830) 2024-08-20T05:00:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.168+0000 7f4546a00640 1 -- 172.21.15.37:0/3115609849 learned_addr learned my addr 172.21.15.37:0/3115609849 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.168+0000 7f4547e00640 1 --2- 172.21.15.37:0/3115609849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4548108e40 0x7f4548075800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:33.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.168+0000 7f4547400640 1 --2- 172.21.15.37:0/3115609849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4548102ab0 0x7f4548076c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.169+0000 7f4547400640 1 -- 172.21.15.37:0/3115609849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45481084c0 msgr2=0x7f45480751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.169+0000 7f4547400640 1 --2- 172.21.15.37:0/3115609849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45481084c0 0x7f45480751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.169+0000 7f4547400640 1 -- 172.21.15.37:0/3115609849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4548108e40 msgr2=0x7f4548075800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.169+0000 7f4547400640 1 --2- 172.21.15.37:0/3115609849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4548108e40 0x7f4548075800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.169+0000 7f4547400640 1 -- 172.21.15.37:0/3115609849 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45481ab8c0 con 0x7f4548102ab0 2024-08-20T05:00:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.169+0000 7f4546a00640 1 --2- 172.21.15.37:0/3115609849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45481084c0 0x7f45480751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:00:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.169+0000 7f4547e00640 1 --2- 172.21.15.37:0/3115609849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4548108e40 0x7f4548075800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:00:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.169+0000 7f4547400640 1 --2- 172.21.15.37:0/3115609849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4548102ab0 0x7f4548076c80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4538005fd0 tx=0x7f453800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.170+0000 7f453fe00640 1 -- 172.21.15.37:0/3115609849 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4538009c30 con 0x7f4548102ab0 2024-08-20T05:00:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.170+0000 7f453fe00640 1 -- 172.21.15.37:0/3115609849 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4538009dd0 con 0x7f4548102ab0 2024-08-20T05:00:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.170+0000 7f453fe00640 1 -- 172.21.15.37:0/3115609849 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4538003e20 con 0x7f4548102ab0 2024-08-20T05:00:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.170+0000 7f454e400640 1 -- 172.21.15.37:0/3115609849 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45481aba90 con 0x7f4548102ab0 2024-08-20T05:00:33.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.170+0000 7f454e400640 1 -- 172.21.15.37:0/3115609849 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45481abff0 con 0x7f4548102ab0 2024-08-20T05:00:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.171+0000 7f454e400640 1 -- 172.21.15.37:0/3115609849 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4548102e90 con 0x7f4548102ab0 2024-08-20T05:00:33.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.173+0000 7f453fe00640 1 -- 172.21.15.37:0/3115609849 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f4538003fe0 con 0x7f4548102ab0 2024-08-20T05:00:33.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.175+0000 7f453fe00640 1 --2- 172.21.15.37:0/3115609849 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f452c0b3ce0 0x7f452c0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:33.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.175+0000 7f453fe00640 1 -- 172.21.15.37:0/3115609849 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f45380e3c10 con 0x7f4548102ab0 2024-08-20T05:00:33.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.175+0000 7f4546a00640 1 --2- 172.21.15.37:0/3115609849 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f452c0b3ce0 0x7f452c0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:33.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.176+0000 7f4546a00640 1 --2- 172.21.15.37:0/3115609849 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f452c0b3ce0 0x7f452c0b61a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4534005ec0 tx=0x7f4534005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:33.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.176+0000 7f453fe00640 1 -- 172.21.15.37:0/3115609849 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4538017020 con 0x7f4548102ab0 2024-08-20T05:00:33.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.371+0000 7f454e400640 1 -- 172.21.15.37:0/3115609849 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45480764d0 con 0x7f4548102ab0 2024-08-20T05:00:33.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.372+0000 7f453fe00640 1 -- 172.21.15.37:0/3115609849 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24705 (secure 0 0 0) 0x7f45380aa770 con 0x7f4548102ab0 2024-08-20T05:00:33.375 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:00:33.375 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":86,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","created":"2024-08-20T04:50:26.520303+0000","modified":"2024-08-20T05:00:29.355329+0000","last_up_change":"2024-08-20T04:58:12.250259+0000","last_in_change":"2024-08-20T04:57:49.724189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T04:54:16.381529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T04:59:08.598741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T04:59:10.793802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-20T04:59:19.888446+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a813e53b-68b3-43ff-a59b-aed00e98f2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6803","nonce":3569936373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6805","nonce":3569936373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6809","nonce":3569936373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6807","nonce":3569936373}]},"public_addr":"172.21.15.37:6803/3569936373","cluster_addr":"172.21.15.37:6805/3569936373","heartbeat_back_addr":"172.21.15.37:6809/3569936373","heartbeat_front_addr":"172.21.15.37:6807/3569936373","state":["exists","up"]},{"osd":1,"uuid":"c216a8d0-9685-467a-8161-700682ce617c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6801","nonce":4206461125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6803","nonce":4206461125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6807","nonce":4206461125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6805","nonce":4206461125}]},"public_addr":"172.21.15.130:6801/4206461125","cluster_addr":"172.21.15.130:6803/4206461125","heartbeat_back_addr":"172.21.15.130:6807/4206461125","heartbeat_front_addr":"172.21.15.130:6805/4206461125","state":["exists","up"]},{"osd":2,"uuid":"34402442-c652-40eb-865e-a607a28846b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6801","nonce":2653255199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6803","nonce":2653255199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6807","nonce":2653255199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6805","nonce":2653255199}]},"public_addr":"172.21.15.135:6801/2653255199","cluster_addr":"172.21.15.135:6803/2653255199","heartbeat_back_addr":"172.21.15.135:6807/2653255199","heartbeat_front_addr":"172.21.15.135:6805/2653255199","state":["exists","up"]},{"osd":3,"uuid":"ec7be9dc-96b5-4816-9065-8121baedcdc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6811","nonce":2601290990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6813","nonce":2601290990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6817","nonce":2601290990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6815","nonce":2601290990}]},"public_addr":"172.21.15.37:6811/2601290990","cluster_addr":"172.21.15.37:6813/2601290990","heartbeat_back_addr":"172.21.15.37:6817/2601290990","heartbeat_front_addr":"172.21.15.37:6815/2601290990","state":["exists","up"]},{"osd":4,"uuid":"2dbd47f9-8686-4707-8862-3c7a99a37d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6809","nonce":3542081474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6811","nonce":3542081474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6815","nonce":3542081474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6813","nonce":3542081474}]},"public_addr":"172.21.15.130:6809/3542081474","cluster_addr":"172.21.15.130:6811/3542081474","heartbeat_back_addr":"172.21.15.130:6815/3542081474","heartbeat_front_addr":"172.21.15.130:6813/3542081474","state":["exists","up"]},{"osd":5,"uuid":"9a07a137-d6b7-4aba-8678-4fd164597f27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6809","nonce":2507249148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6811","nonce":2507249148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6815","nonce":2507249148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6813","nonce":2507249148}]},"public_addr":"172.21.15.135:6809/2507249148","cluster_addr":"172.21.15.135:6811/2507249148","heartbeat_back_addr":"172.21.15.135:6815/2507249148","heartbeat_front_addr":"172.21.15.135:6813/2507249148","state":["exists","up"]},{"osd":6,"uuid":"6d6346e8-5418-4c30-9bb3-5af352b616a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6819","nonce":155932692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6821","nonce":155932692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6825","nonce":155932692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6823","nonce":155932692}]},"public_addr":"172.21.15.37:6819/155932692","cluster_addr":"172.21.15.37:6821/155932692","heartbeat_back_addr":"172.21.15.37:6825/155932692","heartbeat_front_addr":"172.21.15.37:6823/155932692","state":["exists","up"]},{"osd":7,"uuid":"c87804c2-d456-495e-b36e-33dbb3548347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6817","nonce":4148130245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6819","nonce":4148130245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6823","nonce":4148130245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6821","nonce":4148130245}]},"public_addr":"172.21.15.130:6817/4148130245","cluster_addr":"172.21.15.130:6819/4148130245","heartbeat_back_addr":"172.21.15.130:6823/4148130245","heartbeat_front_addr":"172.21.15.130:6821/4148130245","state":["exists","up"]},{"osd":8,"uuid":"a7d4c9c8-1826-4703-92ad-ded2800b4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6817","nonce":222884649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6819","nonce":222884649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6823","nonce":222884649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6821","nonce":222884649}]},"public_addr":"172.21.15.135:6817/222884649","cluster_addr":"172.21.15.135:6819/222884649","heartbeat_back_addr":"172.21.15.135:6823/222884649","heartbeat_front_addr":"172.21.15.135:6821/222884649","state":["exists","up"]},{"osd":9,"uuid":"f9e0c194-66b5-4e62-b2ae-816a4a4fffbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6827","nonce":2240773042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6829","nonce":2240773042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6833","nonce":2240773042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6831","nonce":2240773042}]},"public_addr":"172.21.15.37:6827/2240773042","cluster_addr":"172.21.15.37:6829/2240773042","heartbeat_back_addr":"172.21.15.37:6833/2240773042","heartbeat_front_addr":"172.21.15.37:6831/2240773042","state":["exists","up"]},{"osd":10,"uuid":"fa6a50a5-2b97-42d1-9b57-b5502b7083d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6825","nonce":2896730163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6827","nonce":2896730163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6831","nonce":2896730163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6829","nonce":2896730163}]},"public_addr":"172.21.15.130:6825/2896730163","cluster_addr":"172.21.15.130:6827/2896730163","heartbeat_back_addr":"172.21.15.130:6831/2896730163","heartbeat_front_addr":"172.21.15.130:6829/2896730163","state":["exists","up"]},{"osd":11,"uuid":"9a305d75-030d-41db-abfb-81bb71e8c6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6825","nonce":2532897645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6827","nonce":2532897645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6831","nonce":2532897645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6829","nonce":2532897645}]},"public_addr":"172.21.15.135:6825/2532897645","cluster_addr":"172.21.15.135:6827/2532897645","heartbeat_back_addr":"172.21.15.135:6831/2532897645","heartbeat_front_addr":"172.21.15.135:6829/2532897645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:26.455665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:51.456030+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:14.332699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:42.749386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:07.587091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:32.450249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:01.864489+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:26.830527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:51.206257+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:20.400020+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:46.329864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:58:11.086508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4282140105":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/1217599998":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/3737412906":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/58912454":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/2105948300":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/1480362562":"2024-08-21T04:50:59.520912+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T05:00:33.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.376+0000 7f454e400640 1 -- 172.21.15.37:0/3115609849 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f452c0b3ce0 msgr2=0x7f452c0b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:33.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.376+0000 7f454e400640 1 --2- 172.21.15.37:0/3115609849 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f452c0b3ce0 0x7f452c0b61a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4534005ec0 tx=0x7f4534005a20 comp rx=0 tx=0).stop 2024-08-20T05:00:33.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.376+0000 7f454e400640 1 -- 172.21.15.37:0/3115609849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4548102ab0 msgr2=0x7f4548076c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:33.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.376+0000 7f454e400640 1 --2- 172.21.15.37:0/3115609849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4548102ab0 0x7f4548076c80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4538005fd0 tx=0x7f453800dde0 comp rx=0 tx=0).stop 2024-08-20T05:00:33.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.376+0000 7f454e400640 1 -- 172.21.15.37:0/3115609849 shutdown_connections 2024-08-20T05:00:33.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.376+0000 7f454e400640 1 --2- 172.21.15.37:0/3115609849 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f452c0b3ce0 0x7f452c0b61a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:33.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.376+0000 7f454e400640 1 --2- 172.21.15.37:0/3115609849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4548108e40 0x7f4548075800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:33.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.376+0000 7f454e400640 1 --2- 172.21.15.37:0/3115609849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45481084c0 0x7f45480751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:33.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.376+0000 7f454e400640 1 --2- 172.21.15.37:0/3115609849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4548102ab0 0x7f4548076c80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:33.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.376+0000 7f454e400640 1 -- 172.21.15.37:0/3115609849 >> 172.21.15.37:0/3115609849 conn(0x7f45480fe500 msgr2=0x7f45481008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:33.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.377+0000 7f454e400640 1 -- 172.21.15.37:0/3115609849 shutdown_connections 2024-08-20T05:00:33.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:33.377+0000 7f454e400640 1 -- 172.21.15.37:0/3115609849 wait complete. 2024-08-20T05:00:33.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:33 smithi130 ceph-mon[22007]: pgmap v348: 129 pgs: 7 peering, 122 active+clean; 646 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s; 77 B/s, 0 objects/s recovering 2024-08-20T05:00:33.755 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:33 smithi037 ceph-mon[17265]: pgmap v348: 129 pgs: 7 peering, 122 active+clean; 646 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s; 77 B/s, 0 objects/s recovering 2024-08-20T05:00:33.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:33 smithi135 ceph-mon[22342]: pgmap v348: 129 pgs: 7 peering, 122 active+clean; 646 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s; 77 B/s, 0 objects/s recovering 2024-08-20T05:00:34.258 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-20T05:00:34.258 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T05:00:34.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:34 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3115609849' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:00:34.636 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:34.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:34 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3115609849' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:00:34.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:34 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3115609849' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:00:35.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.167+0000 7f6afcc00640 1 -- 172.21.15.37:0/299108158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af8102920 msgr2=0x7f6af8102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:35.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.167+0000 7f6afcc00640 1 --2- 172.21.15.37:0/299108158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af8102920 0x7f6af8102d00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8009900 tx=0x7f6ae802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:00:35.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.167+0000 7f6afcc00640 1 -- 172.21.15.37:0/299108158 shutdown_connections 2024-08-20T05:00:35.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.167+0000 7f6afcc00640 1 --2- 172.21.15.37:0/299108158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6af8108cb0 0x7f6af810f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:35.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.167+0000 7f6afcc00640 1 --2- 172.21.15.37:0/299108158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6af8108330 0x7f6af8108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:35.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.167+0000 7f6afcc00640 1 --2- 172.21.15.37:0/299108158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af8102920 0x7f6af8102d00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:35.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.167+0000 7f6afcc00640 1 -- 172.21.15.37:0/299108158 >> 172.21.15.37:0/299108158 conn(0x7f6af80fe350 msgr2=0x7f6af8100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:35.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.167+0000 7f6afcc00640 1 -- 172.21.15.37:0/299108158 shutdown_connections 2024-08-20T05:00:35.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.167+0000 7f6afcc00640 1 -- 172.21.15.37:0/299108158 wait complete. 2024-08-20T05:00:35.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.169+0000 7f6afcc00640 1 Processor -- start 2024-08-20T05:00:35.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.169+0000 7f6afcc00640 1 -- start start 2024-08-20T05:00:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.170+0000 7f6afcc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6af8102920 0x7f6af819af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.170+0000 7f6afcc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af8108330 0x7f6af819b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.170+0000 7f6afcc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6af8108cb0 0x7f6af81a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.170+0000 7f6afcc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6af81129c0 con 0x7f6af8108330 2024-08-20T05:00:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.170+0000 7f6afcc00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6af8112840 con 0x7f6af8102920 2024-08-20T05:00:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.170+0000 7f6afcc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6af8112b40 con 0x7f6af8108cb0 2024-08-20T05:00:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.170+0000 7f6af6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af8108330 0x7f6af819b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.170+0000 7f6af7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6af8102920 0x7f6af819af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.170+0000 7f6af6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af8108330 0x7f6af819b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39880/0 (socket says 172.21.15.37:39880) 2024-08-20T05:00:35.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.170+0000 7f6af6a00640 1 -- 172.21.15.37:0/3785311602 learned_addr learned my addr 172.21.15.37:0/3785311602 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.170+0000 7f6af7e00640 1 --2- 172.21.15.37:0/3785311602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6af8108cb0 0x7f6af81a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.171+0000 7f6af6a00640 1 -- 172.21.15.37:0/3785311602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6af8108cb0 msgr2=0x7f6af81a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.171+0000 7f6af6a00640 1 --2- 172.21.15.37:0/3785311602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6af8108cb0 0x7f6af81a0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.171+0000 7f6af6a00640 1 -- 172.21.15.37:0/3785311602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6af8102920 msgr2=0x7f6af819af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.171+0000 7f6af6a00640 1 --2- 172.21.15.37:0/3785311602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6af8102920 0x7f6af819af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.171+0000 7f6af6a00640 1 -- 172.21.15.37:0/3785311602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af81a1000 con 0x7f6af8108330 2024-08-20T05:00:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.171+0000 7f6af6a00640 1 --2- 172.21.15.37:0/3785311602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af8108330 0x7f6af819b490 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400d950 tx=0x7f6ae400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.171+0000 7f6aefe00640 1 -- 172.21.15.37:0/3785311602 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4017070 con 0x7f6af8108330 2024-08-20T05:00:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.171+0000 7f6aefe00640 1 -- 172.21.15.37:0/3785311602 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ae4009c30 con 0x7f6af8108330 2024-08-20T05:00:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.171+0000 7f6afcc00640 1 -- 172.21.15.37:0/3785311602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af81a12f0 con 0x7f6af8108330 2024-08-20T05:00:35.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.171+0000 7f6aefe00640 1 -- 172.21.15.37:0/3785311602 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ae400f620 con 0x7f6af8108330 2024-08-20T05:00:35.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.172+0000 7f6afcc00640 1 -- 172.21.15.37:0/3785311602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af81a79b0 con 0x7f6af8108330 2024-08-20T05:00:35.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.173+0000 7f6afcc00640 1 -- 172.21.15.37:0/3785311602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6af8102d00 con 0x7f6af8108330 2024-08-20T05:00:35.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.177+0000 7f6aefe00640 1 -- 172.21.15.37:0/3785311602 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f6ae4010460 con 0x7f6af8108330 2024-08-20T05:00:35.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.179+0000 7f6aefe00640 1 --2- 172.21.15.37:0/3785311602 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6adc0b3d10 0x7f6adc0b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:35.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.179+0000 7f6aefe00640 1 -- 172.21.15.37:0/3785311602 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f6ae40e3cc0 con 0x7f6af8108330 2024-08-20T05:00:35.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.179+0000 7f6af7400640 1 --2- 172.21.15.37:0/3785311602 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6adc0b3d10 0x7f6adc0b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:35.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.179+0000 7f6aefe00640 1 -- 172.21.15.37:0/3785311602 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f6ae40a6a30 con 0x7f6af8108330 2024-08-20T05:00:35.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.180+0000 7f6af7400640 1 --2- 172.21.15.37:0/3785311602 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6adc0b3d10 0x7f6adc0b61d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8005ab0 tx=0x7f6ae8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:35.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.377+0000 7f6afcc00640 1 -- 172.21.15.37:0/3785311602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6af81a7d20 con 0x7f6af8108330 2024-08-20T05:00:35.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.378+0000 7f6aefe00640 1 -- 172.21.15.37:0/3785311602 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24705 (secure 0 0 0) 0x7f6ae4009de0 con 0x7f6af8108330 2024-08-20T05:00:35.381 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:00:35.381 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":86,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","created":"2024-08-20T04:50:26.520303+0000","modified":"2024-08-20T05:00:29.355329+0000","last_up_change":"2024-08-20T04:58:12.250259+0000","last_in_change":"2024-08-20T04:57:49.724189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T04:54:16.381529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T04:59:08.598741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T04:59:10.793802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-20T04:59:19.888446+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a813e53b-68b3-43ff-a59b-aed00e98f2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6803","nonce":3569936373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6805","nonce":3569936373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6809","nonce":3569936373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6807","nonce":3569936373}]},"public_addr":"172.21.15.37:6803/3569936373","cluster_addr":"172.21.15.37:6805/3569936373","heartbeat_back_addr":"172.21.15.37:6809/3569936373","heartbeat_front_addr":"172.21.15.37:6807/3569936373","state":["exists","up"]},{"osd":1,"uuid":"c216a8d0-9685-467a-8161-700682ce617c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6801","nonce":4206461125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6803","nonce":4206461125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6807","nonce":4206461125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6805","nonce":4206461125}]},"public_addr":"172.21.15.130:6801/4206461125","cluster_addr":"172.21.15.130:6803/4206461125","heartbeat_back_addr":"172.21.15.130:6807/4206461125","heartbeat_front_addr":"172.21.15.130:6805/4206461125","state":["exists","up"]},{"osd":2,"uuid":"34402442-c652-40eb-865e-a607a28846b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6801","nonce":2653255199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6803","nonce":2653255199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6807","nonce":2653255199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6805","nonce":2653255199}]},"public_addr":"172.21.15.135:6801/2653255199","cluster_addr":"172.21.15.135:6803/2653255199","heartbeat_back_addr":"172.21.15.135:6807/2653255199","heartbeat_front_addr":"172.21.15.135:6805/2653255199","state":["exists","up"]},{"osd":3,"uuid":"ec7be9dc-96b5-4816-9065-8121baedcdc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6811","nonce":2601290990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6813","nonce":2601290990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6817","nonce":2601290990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6815","nonce":2601290990}]},"public_addr":"172.21.15.37:6811/2601290990","cluster_addr":"172.21.15.37:6813/2601290990","heartbeat_back_addr":"172.21.15.37:6817/2601290990","heartbeat_front_addr":"172.21.15.37:6815/2601290990","state":["exists","up"]},{"osd":4,"uuid":"2dbd47f9-8686-4707-8862-3c7a99a37d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6809","nonce":3542081474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6811","nonce":3542081474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6815","nonce":3542081474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6813","nonce":3542081474}]},"public_addr":"172.21.15.130:6809/3542081474","cluster_addr":"172.21.15.130:6811/3542081474","heartbeat_back_addr":"172.21.15.130:6815/3542081474","heartbeat_front_addr":"172.21.15.130:6813/3542081474","state":["exists","up"]},{"osd":5,"uuid":"9a07a137-d6b7-4aba-8678-4fd164597f27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6809","nonce":2507249148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6811","nonce":2507249148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6815","nonce":2507249148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6813","nonce":2507249148}]},"public_addr":"172.21.15.135:6809/2507249148","cluster_addr":"172.21.15.135:6811/2507249148","heartbeat_back_addr":"172.21.15.135:6815/2507249148","heartbeat_front_addr":"172.21.15.135:6813/2507249148","state":["exists","up"]},{"osd":6,"uuid":"6d6346e8-5418-4c30-9bb3-5af352b616a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6819","nonce":155932692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6821","nonce":155932692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6825","nonce":155932692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6823","nonce":155932692}]},"public_addr":"172.21.15.37:6819/155932692","cluster_addr":"172.21.15.37:6821/155932692","heartbeat_back_addr":"172.21.15.37:6825/155932692","heartbeat_front_addr":"172.21.15.37:6823/155932692","state":["exists","up"]},{"osd":7,"uuid":"c87804c2-d456-495e-b36e-33dbb3548347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6817","nonce":4148130245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6819","nonce":4148130245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6823","nonce":4148130245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6821","nonce":4148130245}]},"public_addr":"172.21.15.130:6817/4148130245","cluster_addr":"172.21.15.130:6819/4148130245","heartbeat_back_addr":"172.21.15.130:6823/4148130245","heartbeat_front_addr":"172.21.15.130:6821/4148130245","state":["exists","up"]},{"osd":8,"uuid":"a7d4c9c8-1826-4703-92ad-ded2800b4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6817","nonce":222884649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6819","nonce":222884649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6823","nonce":222884649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6821","nonce":222884649}]},"public_addr":"172.21.15.135:6817/222884649","cluster_addr":"172.21.15.135:6819/222884649","heartbeat_back_addr":"172.21.15.135:6823/222884649","heartbeat_front_addr":"172.21.15.135:6821/222884649","state":["exists","up"]},{"osd":9,"uuid":"f9e0c194-66b5-4e62-b2ae-816a4a4fffbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6827","nonce":2240773042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6829","nonce":2240773042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6833","nonce":2240773042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6831","nonce":2240773042}]},"public_addr":"172.21.15.37:6827/2240773042","cluster_addr":"172.21.15.37:6829/2240773042","heartbeat_back_addr":"172.21.15.37:6833/2240773042","heartbeat_front_addr":"172.21.15.37:6831/2240773042","state":["exists","up"]},{"osd":10,"uuid":"fa6a50a5-2b97-42d1-9b57-b5502b7083d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6825","nonce":2896730163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6827","nonce":2896730163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6831","nonce":2896730163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6829","nonce":2896730163}]},"public_addr":"172.21.15.130:6825/2896730163","cluster_addr":"172.21.15.130:6827/2896730163","heartbeat_back_addr":"172.21.15.130:6831/2896730163","heartbeat_front_addr":"172.21.15.130:6829/2896730163","state":["exists","up"]},{"osd":11,"uuid":"9a305d75-030d-41db-abfb-81bb71e8c6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6825","nonce":2532897645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6827","nonce":2532897645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6831","nonce":2532897645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6829","nonce":2532897645}]},"public_addr":"172.21.15.135:6825/2532897645","cluster_addr":"172.21.15.135:6827/2532897645","heartbeat_back_addr":"172.21.15.135:6831/2532897645","heartbeat_front_addr":"172.21.15.135:6829/2532897645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:26.455665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:51.456030+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:14.332699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:42.749386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:07.587091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:32.450249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:01.864489+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:26.830527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:51.206257+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:20.400020+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:46.329864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:58:11.086508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4282140105":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/1217599998":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/3737412906":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/58912454":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/2105948300":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/1480362562":"2024-08-21T04:50:59.520912+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T05:00:35.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.381+0000 7f6afcc00640 1 -- 172.21.15.37:0/3785311602 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6adc0b3d10 msgr2=0x7f6adc0b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:35.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.381+0000 7f6afcc00640 1 --2- 172.21.15.37:0/3785311602 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6adc0b3d10 0x7f6adc0b61d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8005ab0 tx=0x7f6ae8005a20 comp rx=0 tx=0).stop 2024-08-20T05:00:35.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.381+0000 7f6afcc00640 1 -- 172.21.15.37:0/3785311602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af8108330 msgr2=0x7f6af819b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:35.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.381+0000 7f6afcc00640 1 --2- 172.21.15.37:0/3785311602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af8108330 0x7f6af819b490 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f6ae400d950 tx=0x7f6ae400de10 comp rx=0 tx=0).stop 2024-08-20T05:00:35.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.382+0000 7f6afcc00640 1 -- 172.21.15.37:0/3785311602 shutdown_connections 2024-08-20T05:00:35.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.382+0000 7f6afcc00640 1 --2- 172.21.15.37:0/3785311602 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6adc0b3d10 0x7f6adc0b61d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:35.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.382+0000 7f6afcc00640 1 --2- 172.21.15.37:0/3785311602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6af8108cb0 0x7f6af81a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:35.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.382+0000 7f6afcc00640 1 --2- 172.21.15.37:0/3785311602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6af8108330 0x7f6af819b490 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:35.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.382+0000 7f6afcc00640 1 --2- 172.21.15.37:0/3785311602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6af8102920 0x7f6af819af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:35.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.382+0000 7f6afcc00640 1 -- 172.21.15.37:0/3785311602 >> 172.21.15.37:0/3785311602 conn(0x7f6af80fe350 msgr2=0x7f6af80752e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:35.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.382+0000 7f6afcc00640 1 -- 172.21.15.37:0/3785311602 shutdown_connections 2024-08-20T05:00:35.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:35.382+0000 7f6afcc00640 1 -- 172.21.15.37:0/3785311602 wait complete. 2024-08-20T05:00:35.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:35 smithi037 ceph-mon[17265]: pgmap v349: 129 pgs: 3 peering, 126 active+clean; 646 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s; 92 B/s, 0 objects/s recovering 2024-08-20T05:00:35.683 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:35 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3785311602' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:00:35.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:35 smithi130 ceph-mon[22007]: pgmap v349: 129 pgs: 3 peering, 126 active+clean; 646 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s; 92 B/s, 0 objects/s recovering 2024-08-20T05:00:35.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:35 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3785311602' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:00:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:35 smithi135 ceph-mon[22342]: pgmap v349: 129 pgs: 3 peering, 126 active+clean; 646 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 11 op/s; 92 B/s, 0 objects/s recovering 2024-08-20T05:00:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:35 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3785311602' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:00:36.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-20T05:00:36.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-20T05:00:36.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-20T05:00:36.142 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-20T05:00:36.142 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-20T05:00:36.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-20T05:00:36.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-08-20T05:00:36.144 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-08-20T05:00:36.144 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-08-20T05:00:36.145 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-08-20T05:00:36.145 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-08-20T05:00:36.145 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-08-20T05:00:36.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:36 smithi130 ceph-mon[22007]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-08-20T05:00:36.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:36 smithi130 ceph-mon[22007]: Cluster is now healthy 2024-08-20T05:00:36.770 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:36 smithi037 ceph-mon[17265]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-08-20T05:00:36.770 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:36 smithi037 ceph-mon[17265]: Cluster is now healthy 2024-08-20T05:00:36.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:36 smithi135 ceph-mon[22342]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-08-20T05:00:36.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:36 smithi135 ceph-mon[22342]: Cluster is now healthy 2024-08-20T05:00:37.161 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:37.188 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:37.192 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:37.612 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:37 smithi037 ceph-mon[17265]: pgmap v350: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 92 B/s, 0 objects/s recovering 2024-08-20T05:00:37.665 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:37.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:37 smithi130 ceph-mon[22007]: pgmap v350: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 92 B/s, 0 objects/s recovering 2024-08-20T05:00:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:37 smithi135 ceph-mon[22342]: pgmap v350: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 92 B/s, 0 objects/s recovering 2024-08-20T05:00:37.915 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:37.915 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:37.917 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:37.919 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:37.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.931+0000 7f90dae00640 1 -- 172.21.15.37:0/1189009575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90d4102af0 msgr2=0x7f90d4102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:37.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.931+0000 7f90dae00640 1 --2- 172.21.15.37:0/1189009575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90d4102af0 0x7f90d4102ed0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009860 tx=0x7f90c402a340 comp rx=0 tx=0).stop 2024-08-20T05:00:37.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.931+0000 7f90dae00640 1 -- 172.21.15.37:0/1189009575 shutdown_connections 2024-08-20T05:00:37.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.931+0000 7f90dae00640 1 --2- 172.21.15.37:0/1189009575 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d4108e80 0x7f90d410f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:37.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.931+0000 7f90dae00640 1 --2- 172.21.15.37:0/1189009575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90d4108500 0x7f90d4108940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:37.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.931+0000 7f90dae00640 1 --2- 172.21.15.37:0/1189009575 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90d4102af0 0x7f90d4102ed0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:37.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.931+0000 7f90dae00640 1 -- 172.21.15.37:0/1189009575 >> 172.21.15.37:0/1189009575 conn(0x7f90d40fe540 msgr2=0x7f90d4100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:37.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.931+0000 7f90dae00640 1 -- 172.21.15.37:0/1189009575 shutdown_connections 2024-08-20T05:00:37.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.931+0000 7f90dae00640 1 -- 172.21.15.37:0/1189009575 wait complete. 2024-08-20T05:00:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.932+0000 7f90dae00640 1 Processor -- start 2024-08-20T05:00:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.933+0000 7f90dae00640 1 -- start start 2024-08-20T05:00:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.933+0000 7f90dae00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90d4102af0 0x7f90d40751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.933+0000 7f90dae00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90d4108500 0x7f90d4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.933+0000 7f90dae00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d4108e80 0x7f90d4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.933+0000 7f90dae00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f90d4112b40 con 0x7f90d4102af0 2024-08-20T05:00:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.933+0000 7f90dae00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f90d41129c0 con 0x7f90d4108500 2024-08-20T05:00:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.933+0000 7f90dae00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f90d4112cc0 con 0x7f90d4108e80 2024-08-20T05:00:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.934+0000 7f90d8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d4108e80 0x7f90d4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:37.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.934+0000 7f90d8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d4108e80 0x7f90d4075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:40874/0 (socket says 172.21.15.37:40874) 2024-08-20T05:00:37.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.934+0000 7f90d8e00640 1 -- 172.21.15.37:0/3172311370 learned_addr learned my addr 172.21.15.37:0/3172311370 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:37.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.934+0000 7f90d8e00640 1 -- 172.21.15.37:0/3172311370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90d4108500 msgr2=0x7f90d4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:37.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.934+0000 7f90d8e00640 1 --2- 172.21.15.37:0/3172311370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90d4108500 0x7f90d4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:37.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.934+0000 7f90d8e00640 1 -- 172.21.15.37:0/3172311370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90d4102af0 msgr2=0x7f90d40751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:37.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.934+0000 7f90d3e00640 1 --2- 172.21.15.37:0/3172311370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90d4102af0 0x7f90d40751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:37.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.934+0000 7f90d8e00640 1 --2- 172.21.15.37:0/3172311370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90d4102af0 0x7f90d40751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:37.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.934+0000 7f90d8e00640 1 -- 172.21.15.37:0/3172311370 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d41a73b0 con 0x7f90d4108e80 2024-08-20T05:00:37.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.934+0000 7f90d3e00640 1 --2- 172.21.15.37:0/3172311370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90d4102af0 0x7f90d40751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:00:37.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.935+0000 7f90d8e00640 1 --2- 172.21.15.37:0/3172311370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d4108e80 0x7f90d4075c50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00eb10 tx=0x7f90cc00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:37.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.935+0000 7f90d0c00640 1 -- 172.21.15.37:0/3172311370 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90cc004b20 con 0x7f90d4108e80 2024-08-20T05:00:37.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.936+0000 7f90dae00640 1 -- 172.21.15.37:0/3172311370 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90d41a76a0 con 0x7f90d4108e80 2024-08-20T05:00:37.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.936+0000 7f90d0c00640 1 -- 172.21.15.37:0/3172311370 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90cc004cc0 con 0x7f90d4108e80 2024-08-20T05:00:37.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.936+0000 7f90d0c00640 1 -- 172.21.15.37:0/3172311370 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90cc010690 con 0x7f90d4108e80 2024-08-20T05:00:37.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.936+0000 7f90dae00640 1 -- 172.21.15.37:0/3172311370 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90d41a7c30 con 0x7f90d4108e80 2024-08-20T05:00:37.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.937+0000 7f90dae00640 1 -- 172.21.15.37:0/3172311370 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f90d4063610 con 0x7f90d4108e80 2024-08-20T05:00:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.940+0000 7f90d0c00640 1 -- 172.21.15.37:0/3172311370 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f90cc005000 con 0x7f90d4108e80 2024-08-20T05:00:37.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.941+0000 7f90d0c00640 1 --2- 172.21.15.37:0/3172311370 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f90b80b3c60 0x7f90b80b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.942+0000 7f90d0c00640 1 -- 172.21.15.37:0/3172311370 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f90cc0e4c30 con 0x7f90d4108e80 2024-08-20T05:00:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.942+0000 7f90d3e00640 1 --2- 172.21.15.37:0/3172311370 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f90b80b3c60 0x7f90b80b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.942+0000 7f90d0c00640 1 --2- 172.21.15.37:0/3172311370 >> [v2:172.21.15.130:6800/4206461125,v1:172.21.15.130:6801/4206461125] conn(0x7f90b80bee30 0x7f90b80c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.942+0000 7f90d0c00640 1 -- 172.21.15.37:0/3172311370 --> [v2:172.21.15.130:6800/4206461125,v1:172.21.15.130:6801/4206461125] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90cc015e80 con 0x7f90b80bee30 2024-08-20T05:00:37.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.942+0000 7f90d0c00640 1 -- 172.21.15.37:0/3172311370 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f90cc0e4fe0 con 0x7f90d4108e80 2024-08-20T05:00:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.943+0000 7f90d3400640 1 --2- 172.21.15.37:0/3172311370 >> [v2:172.21.15.130:6800/4206461125,v1:172.21.15.130:6801/4206461125] conn(0x7f90b80bee30 0x7f90b80c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.943+0000 7f90d3e00640 1 --2- 172.21.15.37:0/3172311370 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f90b80b3c60 0x7f90b80b6120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009780 tx=0x7f90c4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.943+0000 7f90d3400640 1 --2- 172.21.15.37:0/3172311370 >> [v2:172.21.15.130:6800/4206461125,v1:172.21.15.130:6801/4206461125] conn(0x7f90b80bee30 0x7f90b80c12d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:37.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.944+0000 7f90d0c00640 1 -- 172.21.15.37:0/3172311370 <== osd.1 v2:172.21.15.130:6800/4206461125 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f90cc015e80 con 0x7f90b80bee30 2024-08-20T05:00:37.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.964+0000 7f90dae00640 1 -- 172.21.15.37:0/3172311370 --> [v2:172.21.15.130:6800/4206461125,v1:172.21.15.130:6801/4206461125] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f90d4063a10 con 0x7f90b80bee30 2024-08-20T05:00:37.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.965+0000 7f90d0c00640 1 -- 172.21.15.37:0/3172311370 <== osd.1 v2:172.21.15.130:6800/4206461125 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f90d4063a10 con 0x7f90b80bee30 2024-08-20T05:00:37.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.966+0000 7f90dae00640 1 -- 172.21.15.37:0/3172311370 >> [v2:172.21.15.130:6800/4206461125,v1:172.21.15.130:6801/4206461125] conn(0x7f90b80bee30 msgr2=0x7f90b80c12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:37.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.966+0000 7f90dae00640 1 --2- 172.21.15.37:0/3172311370 >> [v2:172.21.15.130:6800/4206461125,v1:172.21.15.130:6801/4206461125] conn(0x7f90b80bee30 0x7f90b80c12d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:37.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.967+0000 7f90dae00640 1 -- 172.21.15.37:0/3172311370 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f90b80b3c60 msgr2=0x7f90b80b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:37.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.967+0000 7f90dae00640 1 --2- 172.21.15.37:0/3172311370 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f90b80b3c60 0x7f90b80b6120 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f90c4009780 tx=0x7f90c4000bc0 comp rx=0 tx=0).stop 2024-08-20T05:00:37.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.967+0000 7f90dae00640 1 -- 172.21.15.37:0/3172311370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d4108e80 msgr2=0x7f90d4075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:37.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.967+0000 7f90dae00640 1 --2- 172.21.15.37:0/3172311370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90d4108e80 0x7f90d4075c50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00eb10 tx=0x7f90cc00c2d0 comp rx=0 tx=0).stop 2024-08-20T05:00:37.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.967+0000 7f90d8e00640 1 -- 172.21.15.37:0/3172311370 reap_dead start 2024-08-20T05:00:37.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.967+0000 7f90dae00640 1 -- 172.21.15.37:0/3172311370 shutdown_connections 2024-08-20T05:00:37.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.967+0000 7f90dae00640 1 -- 172.21.15.37:0/3172311370 >> 172.21.15.37:0/3172311370 conn(0x7f90d40fe540 msgr2=0x7f90d4100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:37.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.967+0000 7f90dae00640 1 -- 172.21.15.37:0/3172311370 shutdown_connections 2024-08-20T05:00:37.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:37.968+0000 7f90dae00640 1 -- 172.21.15.37:0/3172311370 wait complete. 2024-08-20T05:00:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.862+0000 7f0a8a400640 1 -- 172.21.15.37:0/3962496488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a84077400 msgr2=0x7f0a840777e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.862+0000 7f0a8a400640 1 --2- 172.21.15.37:0/3962496488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a84077400 0x7f0a840777e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009ca0 tx=0x7f0a7402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:00:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.862+0000 7f0a8a400640 1 -- 172.21.15.37:0/3962496488 shutdown_connections 2024-08-20T05:00:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.862+0000 7f0a8a400640 1 --2- 172.21.15.37:0/3962496488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a84113690 0x7f0a84115a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.862+0000 7f0a8a400640 1 --2- 172.21.15.37:0/3962496488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a84077d20 0x7f0a84113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.862+0000 7f0a8a400640 1 --2- 172.21.15.37:0/3962496488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a84077400 0x7f0a840777e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.862+0000 7f0a8a400640 1 -- 172.21.15.37:0/3962496488 >> 172.21.15.37:0/3962496488 conn(0x7f0a84100730 msgr2=0x7f0a84102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.862+0000 7f0a8a400640 1 -- 172.21.15.37:0/3962496488 shutdown_connections 2024-08-20T05:00:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.862+0000 7f0a8a400640 1 -- 172.21.15.37:0/3962496488 wait complete. 2024-08-20T05:00:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.863+0000 7f0a8a400640 1 Processor -- start 2024-08-20T05:00:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.863+0000 7f0a8a400640 1 -- start start 2024-08-20T05:00:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.863+0000 7f0a8a400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a84077400 0x7f0a8419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.864+0000 7f0a8a400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a84077d20 0x7f0a8419fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.864+0000 7f0a8a400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a84113690 0x7f0a841a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.864+0000 7f0a8a400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a841190d0 con 0x7f0a84077400 2024-08-20T05:00:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.864+0000 7f0a8a400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0a84118f50 con 0x7f0a84077d20 2024-08-20T05:00:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.864+0000 7f0a8a400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0a84119250 con 0x7f0a84113690 2024-08-20T05:00:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.864+0000 7f0a83400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a84077400 0x7f0a8419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.864+0000 7f0a83400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a84077400 0x7f0a8419f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39912/0 (socket says 172.21.15.37:39912) 2024-08-20T05:00:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.864+0000 7f0a83400640 1 -- 172.21.15.37:0/3150541135 learned_addr learned my addr 172.21.15.37:0/3150541135 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.864+0000 7f0a7aa00640 1 --2- 172.21.15.37:0/3150541135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a84077d20 0x7f0a8419fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.864+0000 7f0a83e00640 1 --2- 172.21.15.37:0/3150541135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a84113690 0x7f0a841a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.864+0000 7f0a7aa00640 1 -- 172.21.15.37:0/3150541135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a84113690 msgr2=0x7f0a841a4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.864+0000 7f0a7aa00640 1 --2- 172.21.15.37:0/3150541135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a84113690 0x7f0a841a4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.864+0000 7f0a7aa00640 1 -- 172.21.15.37:0/3150541135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a84077400 msgr2=0x7f0a8419f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.864+0000 7f0a7aa00640 1 --2- 172.21.15.37:0/3150541135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a84077400 0x7f0a8419f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.864+0000 7f0a7aa00640 1 -- 172.21.15.37:0/3150541135 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a841a5630 con 0x7f0a84077d20 2024-08-20T05:00:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.865+0000 7f0a7aa00640 1 --2- 172.21.15.37:0/3150541135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a84077d20 0x7f0a8419fac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00e9f0 tx=0x7f0a6c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.865+0000 7f0a80c00640 1 -- 172.21.15.37:0/3150541135 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c00ccc0 con 0x7f0a84077d20 2024-08-20T05:00:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.865+0000 7f0a80c00640 1 -- 172.21.15.37:0/3150541135 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a6c0108e0 con 0x7f0a84077d20 2024-08-20T05:00:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.865+0000 7f0a80c00640 1 -- 172.21.15.37:0/3150541135 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c018880 con 0x7f0a84077d20 2024-08-20T05:00:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.865+0000 7f0a8a400640 1 -- 172.21.15.37:0/3150541135 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a841a5920 con 0x7f0a84077d20 2024-08-20T05:00:38.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.865+0000 7f0a8a400640 1 -- 172.21.15.37:0/3150541135 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a841abfe0 con 0x7f0a84077d20 2024-08-20T05:00:38.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.866+0000 7f0a8a400640 1 -- 172.21.15.37:0/3150541135 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0a841159f0 con 0x7f0a84077d20 2024-08-20T05:00:38.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.871+0000 7f0a80c00640 1 -- 172.21.15.37:0/3150541135 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f0a6c010430 con 0x7f0a84077d20 2024-08-20T05:00:38.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.872+0000 7f0a80c00640 1 --2- 172.21.15.37:0/3150541135 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0a680b3c60 0x7f0a680b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:38.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.872+0000 7f0a80c00640 1 -- 172.21.15.37:0/3150541135 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f0a6c0e4be0 con 0x7f0a84077d20 2024-08-20T05:00:38.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.872+0000 7f0a83400640 1 --2- 172.21.15.37:0/3150541135 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0a680b3c60 0x7f0a680b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:38.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.873+0000 7f0a80c00640 1 --2- 172.21.15.37:0/3150541135 >> [v2:172.21.15.135:6808/2507249148,v1:172.21.15.135:6809/2507249148] conn(0x7f0a680bee30 0x7f0a680c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:38.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.873+0000 7f0a80c00640 1 -- 172.21.15.37:0/3150541135 --> [v2:172.21.15.135:6808/2507249148,v1:172.21.15.135:6809/2507249148] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a6c015e80 con 0x7f0a680bee30 2024-08-20T05:00:38.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.873+0000 7f0a80c00640 1 -- 172.21.15.37:0/3150541135 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f0a6c0e5030 con 0x7f0a84077d20 2024-08-20T05:00:38.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.873+0000 7f0a83e00640 1 --2- 172.21.15.37:0/3150541135 >> [v2:172.21.15.135:6808/2507249148,v1:172.21.15.135:6809/2507249148] conn(0x7f0a680bee30 0x7f0a680c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:38.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.873+0000 7f0a83400640 1 --2- 172.21.15.37:0/3150541135 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0a680b3c60 0x7f0a680b6120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009a60 tx=0x7f0a74005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:38.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.874+0000 7f0a83e00640 1 --2- 172.21.15.37:0/3150541135 >> [v2:172.21.15.135:6808/2507249148,v1:172.21.15.135:6809/2507249148] conn(0x7f0a680bee30 0x7f0a680c12d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:38.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.875+0000 7f0a80c00640 1 -- 172.21.15.37:0/3150541135 <== osd.5 v2:172.21.15.135:6808/2507249148 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a6c015e80 con 0x7f0a680bee30 2024-08-20T05:00:38.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.889+0000 7f0a8a400640 1 -- 172.21.15.37:0/3150541135 --> [v2:172.21.15.135:6808/2507249148,v1:172.21.15.135:6809/2507249148] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0a84078910 con 0x7f0a680bee30 2024-08-20T05:00:38.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.890+0000 7f0a80c00640 1 -- 172.21.15.37:0/3150541135 <== osd.5 v2:172.21.15.135:6808/2507249148 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0a84078910 con 0x7f0a680bee30 2024-08-20T05:00:38.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.890+0000 7f0a8a400640 1 -- 172.21.15.37:0/3150541135 >> [v2:172.21.15.135:6808/2507249148,v1:172.21.15.135:6809/2507249148] conn(0x7f0a680bee30 msgr2=0x7f0a680c12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:38.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.890+0000 7f0a8a400640 1 --2- 172.21.15.37:0/3150541135 >> [v2:172.21.15.135:6808/2507249148,v1:172.21.15.135:6809/2507249148] conn(0x7f0a680bee30 0x7f0a680c12d0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:38.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.890+0000 7f0a8a400640 1 -- 172.21.15.37:0/3150541135 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0a680b3c60 msgr2=0x7f0a680b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:38.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.890+0000 7f0a8a400640 1 --2- 172.21.15.37:0/3150541135 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0a680b3c60 0x7f0a680b6120 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0a74009a60 tx=0x7f0a74005d80 comp rx=0 tx=0).stop 2024-08-20T05:00:38.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.890+0000 7f0a8a400640 1 -- 172.21.15.37:0/3150541135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a84077d20 msgr2=0x7f0a8419fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:38.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.890+0000 7f0a8a400640 1 --2- 172.21.15.37:0/3150541135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a84077d20 0x7f0a8419fac0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00e9f0 tx=0x7f0a6c00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:00:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.890+0000 7f0a83e00640 1 -- 172.21.15.37:0/3150541135 reap_dead start 2024-08-20T05:00:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.890+0000 7f0a8a400640 1 -- 172.21.15.37:0/3150541135 shutdown_connections 2024-08-20T05:00:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.890+0000 7f0a8a400640 1 -- 172.21.15.37:0/3150541135 >> 172.21.15.37:0/3150541135 conn(0x7f0a84100730 msgr2=0x7f0a84102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.890+0000 7f0a8a400640 1 -- 172.21.15.37:0/3150541135 shutdown_connections 2024-08-20T05:00:38.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.891+0000 7f0a8a400640 1 -- 172.21.15.37:0/3150541135 wait complete. 2024-08-20T05:00:39.469 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:39.469 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:39.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:39 smithi130 ceph-mon[22007]: pgmap v351: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.0 KiB/s wr, 10 op/s; 76 B/s, 0 objects/s recovering 2024-08-20T05:00:39.758 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:39 smithi037 ceph-mon[17265]: pgmap v351: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.0 KiB/s wr, 10 op/s; 76 B/s, 0 objects/s recovering 2024-08-20T05:00:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:39 smithi135 ceph-mon[22342]: pgmap v351: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.0 KiB/s wr, 10 op/s; 76 B/s, 0 objects/s recovering 2024-08-20T05:00:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.977+0000 7fbdc0000640 1 -- 172.21.15.37:0/3359666344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdb810f0d0 msgr2=0x7fbdb81114c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.977+0000 7fbdc0000640 1 --2- 172.21.15.37:0/3359666344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdb810f0d0 0x7fbdb81114c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0009ca0 tx=0x7fbdb002a8c0 comp rx=0 tx=0).stop 2024-08-20T05:00:40.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.977+0000 7fbdc0000640 1 -- 172.21.15.37:0/3359666344 shutdown_connections 2024-08-20T05:00:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.977+0000 7fbdc0000640 1 --2- 172.21.15.37:0/3359666344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdb810f0d0 0x7fbdb81114c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.977+0000 7fbdc0000640 1 --2- 172.21.15.37:0/3359666344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdb8075c70 0x7fbdb810eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.977+0000 7fbdc0000640 1 --2- 172.21.15.37:0/3359666344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdb8075270 0x7fbdb8075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.977+0000 7fbdc0000640 1 -- 172.21.15.37:0/3359666344 >> 172.21.15.37:0/3359666344 conn(0x7fbdb80fe500 msgr2=0x7fbdb8100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.977+0000 7fbdc0000640 1 -- 172.21.15.37:0/3359666344 shutdown_connections 2024-08-20T05:00:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.977+0000 7fbdc0000640 1 -- 172.21.15.37:0/3359666344 wait complete. 2024-08-20T05:00:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.978+0000 7fbdc0000640 1 Processor -- start 2024-08-20T05:00:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.978+0000 7fbdc0000640 1 -- start start 2024-08-20T05:00:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.978+0000 7fbdc0000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdb8075270 0x7fbdb819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.978+0000 7fbdc0000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdb8075c70 0x7fbdb819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.978+0000 7fbdc0000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdb810f0d0 0x7fbdb81a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:40.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.978+0000 7fbdc0000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb8114c80 con 0x7fbdb8075c70 2024-08-20T05:00:40.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.978+0000 7fbdc0000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb8114b00 con 0x7fbdb810f0d0 2024-08-20T05:00:40.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.978+0000 7fbdc0000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb8114e00 con 0x7fbdb8075270 2024-08-20T05:00:40.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.979+0000 7fbdbcc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdb8075c70 0x7fbdb819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:40.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.979+0000 7fbdbd600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdb8075270 0x7fbdb819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:40.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.979+0000 7fbdbe000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdb810f0d0 0x7fbdb81a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:40.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.979+0000 7fbdbd600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdb8075270 0x7fbdb819b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:40900/0 (socket says 172.21.15.37:40900) 2024-08-20T05:00:40.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.979+0000 7fbdbd600640 1 -- 172.21.15.37:0/2799262221 learned_addr learned my addr 172.21.15.37:0/2799262221 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:40.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.979+0000 7fbdbe000640 1 -- 172.21.15.37:0/2799262221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdb8075270 msgr2=0x7fbdb819b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:40.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.979+0000 7fbdbe000640 1 --2- 172.21.15.37:0/2799262221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbdb8075270 0x7fbdb819b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:40.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.979+0000 7fbdbe000640 1 -- 172.21.15.37:0/2799262221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdb8075c70 msgr2=0x7fbdb819b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:40.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.979+0000 7fbdbe000640 1 --2- 172.21.15.37:0/2799262221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdb8075c70 0x7fbdb819b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:40.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.979+0000 7fbdbe000640 1 -- 172.21.15.37:0/2799262221 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb81a1220 con 0x7fbdb810f0d0 2024-08-20T05:00:40.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.979+0000 7fbdbcc00640 1 --2- 172.21.15.37:0/2799262221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdb8075c70 0x7fbdb819b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:00:40.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.979+0000 7fbdbe000640 1 --2- 172.21.15.37:0/2799262221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdb810f0d0 0x7fbdb81a0a50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbdb002ade0 tx=0x7fbdb0031660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:40.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.980+0000 7fbdb6000640 1 -- 172.21.15.37:0/2799262221 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0003b70 con 0x7fbdb810f0d0 2024-08-20T05:00:40.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.980+0000 7fbdb6000640 1 -- 172.21.15.37:0/2799262221 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbdb0031910 con 0x7fbdb810f0d0 2024-08-20T05:00:40.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.980+0000 7fbdc0000640 1 -- 172.21.15.37:0/2799262221 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdb81a14b0 con 0x7fbdb810f0d0 2024-08-20T05:00:40.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.980+0000 7fbdb6000640 1 -- 172.21.15.37:0/2799262221 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb002f950 con 0x7fbdb810f0d0 2024-08-20T05:00:40.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.980+0000 7fbdc0000640 1 -- 172.21.15.37:0/2799262221 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdb81a7bd0 con 0x7fbdb810f0d0 2024-08-20T05:00:40.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.981+0000 7fbdc0000640 1 -- 172.21.15.37:0/2799262221 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbdb8100460 con 0x7fbdb810f0d0 2024-08-20T05:00:40.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.983+0000 7fbdb6000640 1 -- 172.21.15.37:0/2799262221 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fbdb002faf0 con 0x7fbdb810f0d0 2024-08-20T05:00:40.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.985+0000 7fbdb6000640 1 --2- 172.21.15.37:0/2799262221 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbda00b3ce0 0x7fbda00b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:40.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.985+0000 7fbdb6000640 1 -- 172.21.15.37:0/2799262221 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fbdb0105490 con 0x7fbdb810f0d0 2024-08-20T05:00:40.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.986+0000 7fbdbd600640 1 --2- 172.21.15.37:0/2799262221 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbda00b3ce0 0x7fbda00b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.986+0000 7fbdb6000640 1 --2- 172.21.15.37:0/2799262221 >> [v2:172.21.15.135:6824/2532897645,v1:172.21.15.135:6825/2532897645] conn(0x7fbda00beeb0 0x7fbda00c1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.986+0000 7fbdb6000640 1 -- 172.21.15.37:0/2799262221 --> [v2:172.21.15.135:6824/2532897645,v1:172.21.15.135:6825/2532897645] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbda00c1a20 con 0x7fbda00beeb0 2024-08-20T05:00:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.986+0000 7fbdb6000640 1 -- 172.21.15.37:0/2799262221 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fbdb0105840 con 0x7fbdb810f0d0 2024-08-20T05:00:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.986+0000 7fbdbcc00640 1 --2- 172.21.15.37:0/2799262221 >> [v2:172.21.15.135:6824/2532897645,v1:172.21.15.135:6825/2532897645] conn(0x7fbda00beeb0 0x7fbda00c1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.986+0000 7fbdbd600640 1 --2- 172.21.15.37:0/2799262221 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbda00b3ce0 0x7fbda00b61a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbdac0095f0 tx=0x7fbdac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.987+0000 7fbdbcc00640 1 --2- 172.21.15.37:0/2799262221 >> [v2:172.21.15.135:6824/2532897645,v1:172.21.15.135:6825/2532897645] conn(0x7fbda00beeb0 0x7fbda00c1350 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:40.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:38.987+0000 7fbdb6000640 1 -- 172.21.15.37:0/2799262221 <== osd.11 v2:172.21.15.135:6824/2532897645 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbda00c1a20 con 0x7fbda00beeb0 2024-08-20T05:00:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:39.002+0000 7fbdc0000640 1 -- 172.21.15.37:0/2799262221 --> [v2:172.21.15.135:6824/2532897645,v1:172.21.15.135:6825/2532897645] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbdb8076780 con 0x7fbda00beeb0 2024-08-20T05:00:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:39.002+0000 7fbdb6000640 1 -- 172.21.15.37:0/2799262221 <== osd.11 v2:172.21.15.135:6824/2532897645 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbdb8076780 con 0x7fbda00beeb0 2024-08-20T05:00:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:39.003+0000 7fbdc0000640 1 -- 172.21.15.37:0/2799262221 >> [v2:172.21.15.135:6824/2532897645,v1:172.21.15.135:6825/2532897645] conn(0x7fbda00beeb0 msgr2=0x7fbda00c1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:39.003+0000 7fbdc0000640 1 --2- 172.21.15.37:0/2799262221 >> [v2:172.21.15.135:6824/2532897645,v1:172.21.15.135:6825/2532897645] conn(0x7fbda00beeb0 0x7fbda00c1350 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:39.003+0000 7fbdc0000640 1 -- 172.21.15.37:0/2799262221 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbda00b3ce0 msgr2=0x7fbda00b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:39.003+0000 7fbdc0000640 1 --2- 172.21.15.37:0/2799262221 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbda00b3ce0 0x7fbda00b61a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbdac0095f0 tx=0x7fbdac005f90 comp rx=0 tx=0).stop 2024-08-20T05:00:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:39.003+0000 7fbdc0000640 1 -- 172.21.15.37:0/2799262221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdb810f0d0 msgr2=0x7fbdb81a0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:39.003+0000 7fbdc0000640 1 --2- 172.21.15.37:0/2799262221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbdb810f0d0 0x7fbdb81a0a50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbdb002ade0 tx=0x7fbdb0031660 comp rx=0 tx=0).stop 2024-08-20T05:00:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:39.003+0000 7fbdbe000640 1 -- 172.21.15.37:0/2799262221 reap_dead start 2024-08-20T05:00:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:39.003+0000 7fbdc0000640 1 -- 172.21.15.37:0/2799262221 shutdown_connections 2024-08-20T05:00:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:39.003+0000 7fbdc0000640 1 -- 172.21.15.37:0/2799262221 >> 172.21.15.37:0/2799262221 conn(0x7fbdb80fe500 msgr2=0x7fbdb81112b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:40.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:39.003+0000 7fbdc0000640 1 -- 172.21.15.37:0/2799262221 shutdown_connections 2024-08-20T05:00:40.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:39.003+0000 7fbdc0000640 1 -- 172.21.15.37:0/2799262221 wait complete. 2024-08-20T05:00:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.969+0000 7fe496c00640 1 -- 172.21.15.37:0/4227965050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe49010eaf0 msgr2=0x7fe49010ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.969+0000 7fe496c00640 1 --2- 172.21.15.37:0/4227965050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe49010eaf0 0x7fe49010ef30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe478009900 tx=0x7fe47802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:00:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.969+0000 7fe496c00640 1 -- 172.21.15.37:0/4227965050 shutdown_connections 2024-08-20T05:00:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.969+0000 7fe496c00640 1 --2- 172.21.15.37:0/4227965050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe49010f470 0x7fe490115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.969+0000 7fe496c00640 1 --2- 172.21.15.37:0/4227965050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe49010eaf0 0x7fe49010ef30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.969+0000 7fe496c00640 1 --2- 172.21.15.37:0/4227965050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe4901090e0 0x7fe4901094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.969+0000 7fe496c00640 1 -- 172.21.15.37:0/4227965050 >> 172.21.15.37:0/4227965050 conn(0x7fe490078760 msgr2=0x7fe49007ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.969+0000 7fe496c00640 1 -- 172.21.15.37:0/4227965050 shutdown_connections 2024-08-20T05:00:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.970+0000 7fe496c00640 1 -- 172.21.15.37:0/4227965050 wait complete. 2024-08-20T05:00:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.970+0000 7fe496c00640 1 Processor -- start 2024-08-20T05:00:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.971+0000 7fe496c00640 1 -- start start 2024-08-20T05:00:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.971+0000 7fe496c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4901090e0 0x7fe49019f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:41.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.971+0000 7fe496c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe49010eaf0 0x7fe49019fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.971+0000 7fe496c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe49010f470 0x7fe4901a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.971+0000 7fe496c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe4901190c0 con 0x7fe4901090e0 2024-08-20T05:00:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.971+0000 7fe496c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe490118f40 con 0x7fe49010f470 2024-08-20T05:00:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.971+0000 7fe496c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe490119240 con 0x7fe49010eaf0 2024-08-20T05:00:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.971+0000 7fe48fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4901090e0 0x7fe49019f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.971+0000 7fe48fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4901090e0 0x7fe49019f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39940/0 (socket says 172.21.15.37:39940) 2024-08-20T05:00:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.971+0000 7fe48fe00640 1 -- 172.21.15.37:0/1791717016 learned_addr learned my addr 172.21.15.37:0/1791717016 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.971+0000 7fe494c00640 1 --2- 172.21.15.37:0/1791717016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe49010f470 0x7fe4901a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.971+0000 7fe487400640 1 --2- 172.21.15.37:0/1791717016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe49010eaf0 0x7fe49019fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.972+0000 7fe48fe00640 1 -- 172.21.15.37:0/1791717016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe49010eaf0 msgr2=0x7fe49019fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.972+0000 7fe48fe00640 1 --2- 172.21.15.37:0/1791717016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe49010eaf0 0x7fe49019fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.972+0000 7fe48fe00640 1 -- 172.21.15.37:0/1791717016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe49010f470 msgr2=0x7fe4901a4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.972+0000 7fe48fe00640 1 --2- 172.21.15.37:0/1791717016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe49010f470 0x7fe4901a4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.972+0000 7fe48fe00640 1 -- 172.21.15.37:0/1791717016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4901a5640 con 0x7fe4901090e0 2024-08-20T05:00:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.972+0000 7fe494c00640 1 --2- 172.21.15.37:0/1791717016 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe49010f470 0x7fe4901a4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:00:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.972+0000 7fe487400640 1 --2- 172.21.15.37:0/1791717016 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe49010eaf0 0x7fe49019fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:00:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.972+0000 7fe48fe00640 1 --2- 172.21.15.37:0/1791717016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4901090e0 0x7fe49019f590 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe48000e9f0 tx=0x7fe48000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.972+0000 7fe48d600640 1 -- 172.21.15.37:0/1791717016 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe48000cd80 con 0x7fe4901090e0 2024-08-20T05:00:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.972+0000 7fe48d600640 1 -- 172.21.15.37:0/1791717016 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4800108e0 con 0x7fe4901090e0 2024-08-20T05:00:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.972+0000 7fe48d600640 1 -- 172.21.15.37:0/1791717016 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe480018980 con 0x7fe4901090e0 2024-08-20T05:00:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.972+0000 7fe496c00640 1 -- 172.21.15.37:0/1791717016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4901a5930 con 0x7fe4901090e0 2024-08-20T05:00:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.972+0000 7fe496c00640 1 -- 172.21.15.37:0/1791717016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4901ac1c0 con 0x7fe4901090e0 2024-08-20T05:00:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.973+0000 7fe496c00640 1 -- 172.21.15.37:0/1791717016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe4900635d0 con 0x7fe4901090e0 2024-08-20T05:00:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.976+0000 7fe48d600640 1 -- 172.21.15.37:0/1791717016 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fe480010430 con 0x7fe4901090e0 2024-08-20T05:00:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.977+0000 7fe48d600640 1 --2- 172.21.15.37:0/1791717016 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe4740b3ce0 0x7fe4740b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.977+0000 7fe48d600640 1 -- 172.21.15.37:0/1791717016 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fe4800e4c80 con 0x7fe4901090e0 2024-08-20T05:00:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.977+0000 7fe487400640 1 --2- 172.21.15.37:0/1791717016 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe4740b3ce0 0x7fe4740b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.978+0000 7fe48d600640 1 --2- 172.21.15.37:0/1791717016 >> [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990] conn(0x7fe4740beeb0 0x7fe4740c1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.978+0000 7fe48d600640 1 -- 172.21.15.37:0/1791717016 --> [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe4740c1a20 con 0x7fe4740beeb0 2024-08-20T05:00:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.978+0000 7fe48d600640 1 -- 172.21.15.37:0/1791717016 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fe4800e5030 con 0x7fe4901090e0 2024-08-20T05:00:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.978+0000 7fe494c00640 1 --2- 172.21.15.37:0/1791717016 >> [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990] conn(0x7fe4740beeb0 0x7fe4740c1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.978+0000 7fe487400640 1 --2- 172.21.15.37:0/1791717016 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe4740b3ce0 0x7fe4740b61a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe478000c00 tx=0x7fe478005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.978+0000 7fe494c00640 1 --2- 172.21.15.37:0/1791717016 >> [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990] conn(0x7fe4740beeb0 0x7fe4740c1350 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.979+0000 7fe48d600640 1 -- 172.21.15.37:0/1791717016 <== osd.3 v2:172.21.15.37:6810/2601290990 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe4740c1a20 con 0x7fe4740beeb0 2024-08-20T05:00:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.995+0000 7fe496c00640 1 -- 172.21.15.37:0/1791717016 --> [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe490063a50 con 0x7fe4740beeb0 2024-08-20T05:00:41.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.995+0000 7fe48d600640 1 -- 172.21.15.37:0/1791717016 <== osd.3 v2:172.21.15.37:6810/2601290990 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe490063a50 con 0x7fe4740beeb0 2024-08-20T05:00:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.996+0000 7fe496c00640 1 -- 172.21.15.37:0/1791717016 >> [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990] conn(0x7fe4740beeb0 msgr2=0x7fe4740c1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.996+0000 7fe496c00640 1 --2- 172.21.15.37:0/1791717016 >> [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990] conn(0x7fe4740beeb0 0x7fe4740c1350 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.996+0000 7fe496c00640 1 -- 172.21.15.37:0/1791717016 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe4740b3ce0 msgr2=0x7fe4740b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.996+0000 7fe496c00640 1 --2- 172.21.15.37:0/1791717016 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe4740b3ce0 0x7fe4740b61a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe478000c00 tx=0x7fe478005a20 comp rx=0 tx=0).stop 2024-08-20T05:00:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.996+0000 7fe496c00640 1 -- 172.21.15.37:0/1791717016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4901090e0 msgr2=0x7fe49019f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.996+0000 7fe496c00640 1 --2- 172.21.15.37:0/1791717016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4901090e0 0x7fe49019f590 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe48000e9f0 tx=0x7fe48000eeb0 comp rx=0 tx=0).stop 2024-08-20T05:00:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.996+0000 7fe494c00640 1 -- 172.21.15.37:0/1791717016 reap_dead start 2024-08-20T05:00:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.996+0000 7fe496c00640 1 -- 172.21.15.37:0/1791717016 shutdown_connections 2024-08-20T05:00:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.996+0000 7fe496c00640 1 -- 172.21.15.37:0/1791717016 >> 172.21.15.37:0/1791717016 conn(0x7fe490078760 msgr2=0x7fe49007ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.996+0000 7fe496c00640 1 -- 172.21.15.37:0/1791717016 shutdown_connections 2024-08-20T05:00:41.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.996+0000 7fe496c00640 1 -- 172.21.15.37:0/1791717016 wait complete. 2024-08-20T05:00:41.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:41 smithi130 ceph-mon[22007]: pgmap v352: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 69 B/s, 0 objects/s recovering 2024-08-20T05:00:41.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:41 smithi037 ceph-mon[17265]: pgmap v352: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 69 B/s, 0 objects/s recovering 2024-08-20T05:00:41.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:41 smithi135 ceph-mon[22342]: pgmap v352: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s; 69 B/s, 0 objects/s recovering 2024-08-20T05:00:42.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.154+0000 7fe67d600640 1 -- 172.21.15.37:0/3483769824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67810a6b0 msgr2=0x7fe67810aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.154+0000 7fe67d600640 1 --2- 172.21.15.37:0/3483769824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67810a6b0 0x7fe67810aaf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe660009900 tx=0x7fe66002a3f0 comp rx=0 tx=0).stop 2024-08-20T05:00:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.155+0000 7fe67d600640 1 -- 172.21.15.37:0/3483769824 shutdown_connections 2024-08-20T05:00:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.155+0000 7fe67d600640 1 --2- 172.21.15.37:0/3483769824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe67810b030 0x7fe678111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.155+0000 7fe67d600640 1 --2- 172.21.15.37:0/3483769824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67810a6b0 0x7fe67810aaf0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.155+0000 7fe67d600640 1 --2- 172.21.15.37:0/3483769824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe678104ca0 0x7fe678105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.155+0000 7fe67d600640 1 -- 172.21.15.37:0/3483769824 >> 172.21.15.37:0/3483769824 conn(0x7fe678100730 msgr2=0x7fe678102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.155+0000 7fe67d600640 1 -- 172.21.15.37:0/3483769824 shutdown_connections 2024-08-20T05:00:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.155+0000 7fe67d600640 1 -- 172.21.15.37:0/3483769824 wait complete. 2024-08-20T05:00:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.156+0000 7fe67d600640 1 Processor -- start 2024-08-20T05:00:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.156+0000 7fe67d600640 1 -- start start 2024-08-20T05:00:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.156+0000 7fe67d600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe678104ca0 0x7fe67819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.156+0000 7fe67d600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe67810a6b0 0x7fe67819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.156+0000 7fe67d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67810b030 0x7fe6781a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.156+0000 7fe67d600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe678114d40 con 0x7fe67810b030 2024-08-20T05:00:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.156+0000 7fe67d600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe678114bc0 con 0x7fe67810a6b0 2024-08-20T05:00:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.156+0000 7fe67d600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe678114ec0 con 0x7fe678104ca0 2024-08-20T05:00:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.157+0000 7fe677400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67810b030 0x7fe6781a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.157+0000 7fe676a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe678104ca0 0x7fe67819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.157+0000 7fe677400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67810b030 0x7fe6781a0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39976/0 (socket says 172.21.15.37:39976) 2024-08-20T05:00:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.157+0000 7fe677400640 1 -- 172.21.15.37:0/3829440671 learned_addr learned my addr 172.21.15.37:0/3829440671 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.157+0000 7fe66fe00640 1 --2- 172.21.15.37:0/3829440671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe67810a6b0 0x7fe67819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.157+0000 7fe676a00640 1 -- 172.21.15.37:0/3829440671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe67810a6b0 msgr2=0x7fe67819b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.157+0000 7fe676a00640 1 --2- 172.21.15.37:0/3829440671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe67810a6b0 0x7fe67819b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.157+0000 7fe676a00640 1 -- 172.21.15.37:0/3829440671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67810b030 msgr2=0x7fe6781a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.157+0000 7fe676a00640 1 --2- 172.21.15.37:0/3829440671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67810b030 0x7fe6781a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.157+0000 7fe676a00640 1 -- 172.21.15.37:0/3829440671 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6781a1220 con 0x7fe678104ca0 2024-08-20T05:00:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.157+0000 7fe677400640 1 --2- 172.21.15.37:0/3829440671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe67810b030 0x7fe6781a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:00:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.157+0000 7fe676a00640 1 --2- 172.21.15.37:0/3829440671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe678104ca0 0x7fe67819b170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe66800e9f0 tx=0x7fe66800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.158+0000 7fe66f400640 1 -- 172.21.15.37:0/3829440671 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66800ccc0 con 0x7fe678104ca0 2024-08-20T05:00:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.158+0000 7fe67d600640 1 -- 172.21.15.37:0/3829440671 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6781a1510 con 0x7fe678104ca0 2024-08-20T05:00:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.158+0000 7fe66f400640 1 -- 172.21.15.37:0/3829440671 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe668005020 con 0x7fe678104ca0 2024-08-20T05:00:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.158+0000 7fe66f400640 1 -- 172.21.15.37:0/3829440671 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe668004a00 con 0x7fe678104ca0 2024-08-20T05:00:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.158+0000 7fe67d600640 1 -- 172.21.15.37:0/3829440671 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6781a7bd0 con 0x7fe678104ca0 2024-08-20T05:00:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.159+0000 7fe67d600640 1 -- 172.21.15.37:0/3829440671 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe678063610 con 0x7fe678104ca0 2024-08-20T05:00:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.161+0000 7fe66f400640 1 -- 172.21.15.37:0/3829440671 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fe668004ba0 con 0x7fe678104ca0 2024-08-20T05:00:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.163+0000 7fe66f400640 1 --2- 172.21.15.37:0/3829440671 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe65c0b3ce0 0x7fe65c0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.163+0000 7fe66f400640 1 -- 172.21.15.37:0/3829440671 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fe6680e42b0 con 0x7fe678104ca0 2024-08-20T05:00:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.163+0000 7fe66fe00640 1 --2- 172.21.15.37:0/3829440671 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe65c0b3ce0 0x7fe65c0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.163+0000 7fe66f400640 1 --2- 172.21.15.37:0/3829440671 >> [v2:172.21.15.130:6824/2896730163,v1:172.21.15.130:6825/2896730163] conn(0x7fe65c0beeb0 0x7fe65c0c1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.163+0000 7fe66f400640 1 -- 172.21.15.37:0/3829440671 --> [v2:172.21.15.130:6824/2896730163,v1:172.21.15.130:6825/2896730163] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe668023ea0 con 0x7fe65c0beeb0 2024-08-20T05:00:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.163+0000 7fe66f400640 1 -- 172.21.15.37:0/3829440671 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fe6680e4660 con 0x7fe678104ca0 2024-08-20T05:00:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.164+0000 7fe677400640 1 --2- 172.21.15.37:0/3829440671 >> [v2:172.21.15.130:6824/2896730163,v1:172.21.15.130:6825/2896730163] conn(0x7fe65c0beeb0 0x7fe65c0c1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.164+0000 7fe66fe00640 1 --2- 172.21.15.37:0/3829440671 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe65c0b3ce0 0x7fe65c0b61a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe660005ab0 tx=0x7fe660005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.164+0000 7fe677400640 1 --2- 172.21.15.37:0/3829440671 >> [v2:172.21.15.130:6824/2896730163,v1:172.21.15.130:6825/2896730163] conn(0x7fe65c0beeb0 0x7fe65c0c1350 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.165+0000 7fe66f400640 1 -- 172.21.15.37:0/3829440671 <== osd.10 v2:172.21.15.130:6824/2896730163 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe668023ea0 con 0x7fe65c0beeb0 2024-08-20T05:00:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.181+0000 7fe67d600640 1 -- 172.21.15.37:0/3829440671 --> [v2:172.21.15.130:6824/2896730163,v1:172.21.15.130:6825/2896730163] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe678063ac0 con 0x7fe65c0beeb0 2024-08-20T05:00:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.182+0000 7fe66f400640 1 -- 172.21.15.37:0/3829440671 <== osd.10 v2:172.21.15.130:6824/2896730163 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe678063ac0 con 0x7fe65c0beeb0 2024-08-20T05:00:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.182+0000 7fe67d600640 1 -- 172.21.15.37:0/3829440671 >> [v2:172.21.15.130:6824/2896730163,v1:172.21.15.130:6825/2896730163] conn(0x7fe65c0beeb0 msgr2=0x7fe65c0c1350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.182+0000 7fe67d600640 1 --2- 172.21.15.37:0/3829440671 >> [v2:172.21.15.130:6824/2896730163,v1:172.21.15.130:6825/2896730163] conn(0x7fe65c0beeb0 0x7fe65c0c1350 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.183+0000 7fe67d600640 1 -- 172.21.15.37:0/3829440671 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe65c0b3ce0 msgr2=0x7fe65c0b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.183+0000 7fe67d600640 1 --2- 172.21.15.37:0/3829440671 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe65c0b3ce0 0x7fe65c0b61a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe660005ab0 tx=0x7fe660005a20 comp rx=0 tx=0).stop 2024-08-20T05:00:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.183+0000 7fe67d600640 1 -- 172.21.15.37:0/3829440671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe678104ca0 msgr2=0x7fe67819b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.183+0000 7fe67d600640 1 --2- 172.21.15.37:0/3829440671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe678104ca0 0x7fe67819b170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe66800e9f0 tx=0x7fe66800eeb0 comp rx=0 tx=0).stop 2024-08-20T05:00:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.183+0000 7fe677400640 1 -- 172.21.15.37:0/3829440671 reap_dead start 2024-08-20T05:00:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.183+0000 7fe67d600640 1 -- 172.21.15.37:0/3829440671 shutdown_connections 2024-08-20T05:00:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.183+0000 7fe67d600640 1 -- 172.21.15.37:0/3829440671 >> 172.21.15.37:0/3829440671 conn(0x7fe678100730 msgr2=0x7fe678102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.183+0000 7fe67d600640 1 -- 172.21.15.37:0/3829440671 shutdown_connections 2024-08-20T05:00:42.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.183+0000 7fe67d600640 1 -- 172.21.15.37:0/3829440671 wait complete. 2024-08-20T05:00:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.788+0000 7fcf86800640 1 -- 172.21.15.37:0/2321244762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf80102920 msgr2=0x7fcf80102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.788+0000 7fcf86800640 1 --2- 172.21.15.37:0/2321244762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf80102920 0x7fcf80102d00 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009900 tx=0x7fcf7402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:00:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.788+0000 7fcf86800640 1 -- 172.21.15.37:0/2321244762 shutdown_connections 2024-08-20T05:00:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.788+0000 7fcf86800640 1 --2- 172.21.15.37:0/2321244762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf80108cb0 0x7fcf8010f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.788+0000 7fcf86800640 1 --2- 172.21.15.37:0/2321244762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf80108330 0x7fcf80108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.788+0000 7fcf86800640 1 --2- 172.21.15.37:0/2321244762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf80102920 0x7fcf80102d00 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.788+0000 7fcf86800640 1 -- 172.21.15.37:0/2321244762 >> 172.21.15.37:0/2321244762 conn(0x7fcf800fe350 msgr2=0x7fcf80100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.788+0000 7fcf86800640 1 -- 172.21.15.37:0/2321244762 shutdown_connections 2024-08-20T05:00:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.788+0000 7fcf86800640 1 -- 172.21.15.37:0/2321244762 wait complete. 2024-08-20T05:00:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.789+0000 7fcf86800640 1 Processor -- start 2024-08-20T05:00:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.789+0000 7fcf86800640 1 -- start start 2024-08-20T05:00:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.790+0000 7fcf86800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf80102920 0x7fcf800751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.790+0000 7fcf86800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf80108330 0x7fcf80075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.790+0000 7fcf86800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf80108cb0 0x7fcf80075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.790+0000 7fcf86800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcf801129c0 con 0x7fcf80108cb0 2024-08-20T05:00:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.790+0000 7fcf86800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcf80112840 con 0x7fcf80102920 2024-08-20T05:00:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.790+0000 7fcf86800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcf80112b40 con 0x7fcf80108330 2024-08-20T05:00:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.790+0000 7fcf85e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf80108cb0 0x7fcf80075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.790+0000 7fcf85e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf80108cb0 0x7fcf80075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39984/0 (socket says 172.21.15.37:39984) 2024-08-20T05:00:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.790+0000 7fcf85e00640 1 -- 172.21.15.37:0/3711904015 learned_addr learned my addr 172.21.15.37:0/3711904015 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.790+0000 7fcf85400640 1 --2- 172.21.15.37:0/3711904015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf80102920 0x7fcf800751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.790+0000 7fcf84a00640 1 --2- 172.21.15.37:0/3711904015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf80108330 0x7fcf80075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.790+0000 7fcf85400640 1 -- 172.21.15.37:0/3711904015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf80108330 msgr2=0x7fcf80075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.790+0000 7fcf85400640 1 --2- 172.21.15.37:0/3711904015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf80108330 0x7fcf80075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.791+0000 7fcf85400640 1 -- 172.21.15.37:0/3711904015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf80108cb0 msgr2=0x7fcf80075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.791+0000 7fcf85400640 1 --2- 172.21.15.37:0/3711904015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf80108cb0 0x7fcf80075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.791+0000 7fcf85400640 1 -- 172.21.15.37:0/3711904015 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf801a71d0 con 0x7fcf80102920 2024-08-20T05:00:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.791+0000 7fcf84a00640 1 --2- 172.21.15.37:0/3711904015 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcf80108330 0x7fcf80075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:00:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.791+0000 7fcf85e00640 1 --2- 172.21.15.37:0/3711904015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf80108cb0 0x7fcf80075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:00:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.791+0000 7fcf85400640 1 --2- 172.21.15.37:0/3711904015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf80102920 0x7fcf800751d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf7402a9e0 tx=0x7fcf74003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.791+0000 7fcf7e000640 1 -- 172.21.15.37:0/3711904015 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7403f070 con 0x7fcf80102920 2024-08-20T05:00:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.791+0000 7fcf86800640 1 -- 172.21.15.37:0/3711904015 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf801a7460 con 0x7fcf80102920 2024-08-20T05:00:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.791+0000 7fcf7e000640 1 -- 172.21.15.37:0/3711904015 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf74031b50 con 0x7fcf80102920 2024-08-20T05:00:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.791+0000 7fcf7e000640 1 -- 172.21.15.37:0/3711904015 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf74035030 con 0x7fcf80102920 2024-08-20T05:00:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.791+0000 7fcf86800640 1 -- 172.21.15.37:0/3711904015 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf801a7910 con 0x7fcf80102920 2024-08-20T05:00:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.792+0000 7fcf86800640 1 -- 172.21.15.37:0/3711904015 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf80100520 con 0x7fcf80102920 2024-08-20T05:00:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.795+0000 7fcf7e000640 1 -- 172.21.15.37:0/3711904015 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fcf74042070 con 0x7fcf80102920 2024-08-20T05:00:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.796+0000 7fcf7e000640 1 --2- 172.21.15.37:0/3711904015 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcf680b3d10 0x7fcf680b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.796+0000 7fcf7e000640 1 -- 172.21.15.37:0/3711904015 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fcf74104cc0 con 0x7fcf80102920 2024-08-20T05:00:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.796+0000 7fcf84a00640 1 --2- 172.21.15.37:0/3711904015 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcf680b3d10 0x7fcf680b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.797+0000 7fcf7e000640 1 --2- 172.21.15.37:0/3711904015 >> [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373] conn(0x7fcf680beee0 0x7fcf680c1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.797+0000 7fcf7e000640 1 -- 172.21.15.37:0/3711904015 --> [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf74046e50 con 0x7fcf680beee0 2024-08-20T05:00:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.797+0000 7fcf7e000640 1 -- 172.21.15.37:0/3711904015 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7fcf74105070 con 0x7fcf80102920 2024-08-20T05:00:42.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.797+0000 7fcf85e00640 1 --2- 172.21.15.37:0/3711904015 >> [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373] conn(0x7fcf680beee0 0x7fcf680c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:42.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.797+0000 7fcf84a00640 1 --2- 172.21.15.37:0/3711904015 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcf680b3d10 0x7fcf680b61d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcf80076cc0 tx=0x7fcf6c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:42.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.797+0000 7fcf85e00640 1 --2- 172.21.15.37:0/3711904015 >> [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373] conn(0x7fcf680beee0 0x7fcf680c1380 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:42.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.798+0000 7fcf7e000640 1 -- 172.21.15.37:0/3711904015 <== osd.0 v2:172.21.15.37:6802/3569936373 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf74046e50 con 0x7fcf680beee0 2024-08-20T05:00:42.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.813+0000 7fcf86800640 1 -- 172.21.15.37:0/3711904015 --> [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcf80103bd0 con 0x7fcf680beee0 2024-08-20T05:00:42.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.813+0000 7fcf7e000640 1 -- 172.21.15.37:0/3711904015 <== osd.0 v2:172.21.15.37:6802/3569936373 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcf80103bd0 con 0x7fcf680beee0 2024-08-20T05:00:42.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.814+0000 7fcf86800640 1 -- 172.21.15.37:0/3711904015 >> [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373] conn(0x7fcf680beee0 msgr2=0x7fcf680c1380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:42.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.814+0000 7fcf86800640 1 --2- 172.21.15.37:0/3711904015 >> [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373] conn(0x7fcf680beee0 0x7fcf680c1380 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.814+0000 7fcf86800640 1 -- 172.21.15.37:0/3711904015 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcf680b3d10 msgr2=0x7fcf680b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.814+0000 7fcf86800640 1 --2- 172.21.15.37:0/3711904015 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcf680b3d10 0x7fcf680b61d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcf80076cc0 tx=0x7fcf6c005f90 comp rx=0 tx=0).stop 2024-08-20T05:00:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.814+0000 7fcf86800640 1 -- 172.21.15.37:0/3711904015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf80102920 msgr2=0x7fcf800751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.814+0000 7fcf86800640 1 --2- 172.21.15.37:0/3711904015 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcf80102920 0x7fcf800751d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcf7402a9e0 tx=0x7fcf74003b90 comp rx=0 tx=0).stop 2024-08-20T05:00:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.814+0000 7fcf85e00640 1 -- 172.21.15.37:0/3711904015 reap_dead start 2024-08-20T05:00:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.815+0000 7fcf86800640 1 -- 172.21.15.37:0/3711904015 shutdown_connections 2024-08-20T05:00:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.815+0000 7fcf86800640 1 -- 172.21.15.37:0/3711904015 >> 172.21.15.37:0/3711904015 conn(0x7fcf800fe350 msgr2=0x7fcf800ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.815+0000 7fcf86800640 1 -- 172.21.15.37:0/3711904015 shutdown_connections 2024-08-20T05:00:42.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:42.815+0000 7fcf86800640 1 -- 172.21.15.37:0/3711904015 wait complete. 2024-08-20T05:00:43.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:43 smithi037 ceph-mon[17265]: pgmap v353: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 61 B/s, 0 objects/s recovering 2024-08-20T05:00:43.829 INFO:teuthology.orchestra.run.smithi037.stdout:154618822719 2024-08-20T05:00:43.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-20T05:00:43.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:43 smithi135 ceph-mon[22342]: pgmap v353: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 61 B/s, 0 objects/s recovering 2024-08-20T05:00:43.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:43 smithi130 ceph-mon[22007]: pgmap v353: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 61 B/s, 0 objects/s recovering 2024-08-20T05:00:44.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.108+0000 7f54f0600640 1 -- 172.21.15.37:0/1721879219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54e81042d0 msgr2=0x7f54e810c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:44.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.108+0000 7f54f0600640 1 --2- 172.21.15.37:0/1721879219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54e81042d0 0x7f54e810c7c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009900 tx=0x7f54d402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:00:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.108+0000 7f54f0600640 1 -- 172.21.15.37:0/1721879219 shutdown_connections 2024-08-20T05:00:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.108+0000 7f54f0600640 1 --2- 172.21.15.37:0/1721879219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54e810ce10 0x7f54e810f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.108+0000 7f54f0600640 1 --2- 172.21.15.37:0/1721879219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54e81042d0 0x7f54e810c7c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.108+0000 7f54f0600640 1 --2- 172.21.15.37:0/1721879219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54e81039b0 0x7f54e8103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.108+0000 7f54f0600640 1 -- 172.21.15.37:0/1721879219 >> 172.21.15.37:0/1721879219 conn(0x7f54e80fd3f0 msgr2=0x7f54e80ff810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.108+0000 7f54f0600640 1 -- 172.21.15.37:0/1721879219 shutdown_connections 2024-08-20T05:00:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.108+0000 7f54f0600640 1 -- 172.21.15.37:0/1721879219 wait complete. 2024-08-20T05:00:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.109+0000 7f54f0600640 1 Processor -- start 2024-08-20T05:00:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.109+0000 7f54f0600640 1 -- start start 2024-08-20T05:00:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.109+0000 7f54f0600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54e81039b0 0x7f54e819b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:44.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.109+0000 7f54f0600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54e81042d0 0x7f54e819b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:44.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.109+0000 7f54f0600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54e810ce10 0x7f54e81a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:44.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.109+0000 7f54f0600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54e8102cf0 con 0x7f54e810ce10 2024-08-20T05:00:44.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.109+0000 7f54f0600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54e8102b70 con 0x7f54e81042d0 2024-08-20T05:00:44.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.109+0000 7f54f0600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54e8102e70 con 0x7f54e81039b0 2024-08-20T05:00:44.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.110+0000 7f54ee600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54e810ce10 0x7f54e81a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:44.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.110+0000 7f54ed200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54e81042d0 0x7f54e819b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:44.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.110+0000 7f54edc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54e81039b0 0x7f54e819b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:44.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.110+0000 7f54ed200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54e81042d0 0x7f54e819b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50434/0 (socket says 172.21.15.37:50434) 2024-08-20T05:00:44.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.110+0000 7f54ed200640 1 -- 172.21.15.37:0/3692270324 learned_addr learned my addr 172.21.15.37:0/3692270324 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:44.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.110+0000 7f54ee600640 1 -- 172.21.15.37:0/3692270324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54e81039b0 msgr2=0x7f54e819b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:44.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.110+0000 7f54ee600640 1 --2- 172.21.15.37:0/3692270324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54e81039b0 0x7f54e819b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:44.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.110+0000 7f54ee600640 1 -- 172.21.15.37:0/3692270324 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54e81042d0 msgr2=0x7f54e819b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.110+0000 7f54ee600640 1 --2- 172.21.15.37:0/3692270324 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54e81042d0 0x7f54e819b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.110+0000 7f54ee600640 1 -- 172.21.15.37:0/3692270324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e81a1280 con 0x7f54e810ce10 2024-08-20T05:00:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.110+0000 7f54edc00640 1 --2- 172.21.15.37:0/3692270324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54e81039b0 0x7f54e819b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:00:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.110+0000 7f54ee600640 1 --2- 172.21.15.37:0/3692270324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54e810ce10 0x7f54e81a0ab0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f54e000ec50 tx=0x7f54e000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.111+0000 7f54e6000640 1 -- 172.21.15.37:0/3692270324 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0003b70 con 0x7f54e810ce10 2024-08-20T05:00:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.111+0000 7f54e6000640 1 -- 172.21.15.37:0/3692270324 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54e0003d10 con 0x7f54e810ce10 2024-08-20T05:00:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.111+0000 7f54f0600640 1 -- 172.21.15.37:0/3692270324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54e81a1570 con 0x7f54e810ce10 2024-08-20T05:00:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.111+0000 7f54e6000640 1 -- 172.21.15.37:0/3692270324 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e0010830 con 0x7f54e810ce10 2024-08-20T05:00:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.111+0000 7f54f0600640 1 -- 172.21.15.37:0/3692270324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54e81a7c30 con 0x7f54e810ce10 2024-08-20T05:00:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.112+0000 7f54f0600640 1 -- 172.21.15.37:0/3692270324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54e8107300 con 0x7f54e810ce10 2024-08-20T05:00:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.114+0000 7f54e6000640 1 -- 172.21.15.37:0/3692270324 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f54e0003ec0 con 0x7f54e810ce10 2024-08-20T05:00:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.115+0000 7f54e6000640 1 --2- 172.21.15.37:0/3692270324 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54d00b3c60 0x7f54d00b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:44.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.116+0000 7f54e6000640 1 -- 172.21.15.37:0/3692270324 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f54e00e4900 con 0x7f54e810ce10 2024-08-20T05:00:44.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.116+0000 7f54edc00640 1 --2- 172.21.15.37:0/3692270324 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54d00b3c60 0x7f54d00b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:44.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.116+0000 7f54e6000640 1 --2- 172.21.15.37:0/3692270324 >> [v2:172.21.15.135:6800/2653255199,v1:172.21.15.135:6801/2653255199] conn(0x7f54d00bee30 0x7f54d00c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:44.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.116+0000 7f54e6000640 1 -- 172.21.15.37:0/3692270324 --> [v2:172.21.15.135:6800/2653255199,v1:172.21.15.135:6801/2653255199] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54d00c19a0 con 0x7f54d00bee30 2024-08-20T05:00:44.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.116+0000 7f54e6000640 1 -- 172.21.15.37:0/3692270324 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f54e00e4cb0 con 0x7f54e810ce10 2024-08-20T05:00:44.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.116+0000 7f54edc00640 1 --2- 172.21.15.37:0/3692270324 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54d00b3c60 0x7f54d00b6120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009fc0 tx=0x7f54dc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:44.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.116+0000 7f54ed200640 1 --2- 172.21.15.37:0/3692270324 >> [v2:172.21.15.135:6800/2653255199,v1:172.21.15.135:6801/2653255199] conn(0x7f54d00bee30 0x7f54d00c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.117+0000 7f54ed200640 1 --2- 172.21.15.37:0/3692270324 >> [v2:172.21.15.135:6800/2653255199,v1:172.21.15.135:6801/2653255199] conn(0x7f54d00bee30 0x7f54d00c12d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.118+0000 7f54e6000640 1 -- 172.21.15.37:0/3692270324 <== osd.2 v2:172.21.15.135:6800/2653255199 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f54d00c19a0 con 0x7f54d00bee30 2024-08-20T05:00:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.132+0000 7f54f0600640 1 -- 172.21.15.37:0/3692270324 --> [v2:172.21.15.135:6800/2653255199,v1:172.21.15.135:6801/2653255199] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f54e806b930 con 0x7f54d00bee30 2024-08-20T05:00:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.133+0000 7f54e6000640 1 -- 172.21.15.37:0/3692270324 <== osd.2 v2:172.21.15.135:6800/2653255199 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f54e806b930 con 0x7f54d00bee30 2024-08-20T05:00:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.133+0000 7f54f0600640 1 -- 172.21.15.37:0/3692270324 >> [v2:172.21.15.135:6800/2653255199,v1:172.21.15.135:6801/2653255199] conn(0x7f54d00bee30 msgr2=0x7f54d00c12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.133+0000 7f54f0600640 1 --2- 172.21.15.37:0/3692270324 >> [v2:172.21.15.135:6800/2653255199,v1:172.21.15.135:6801/2653255199] conn(0x7f54d00bee30 0x7f54d00c12d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.133+0000 7f54f0600640 1 -- 172.21.15.37:0/3692270324 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54d00b3c60 msgr2=0x7f54d00b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.133+0000 7f54f0600640 1 --2- 172.21.15.37:0/3692270324 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54d00b3c60 0x7f54d00b6120 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f54dc009fc0 tx=0x7f54dc005f90 comp rx=0 tx=0).stop 2024-08-20T05:00:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.133+0000 7f54f0600640 1 -- 172.21.15.37:0/3692270324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54e810ce10 msgr2=0x7f54e81a0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.133+0000 7f54f0600640 1 --2- 172.21.15.37:0/3692270324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54e810ce10 0x7f54e81a0ab0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f54e000ec50 tx=0x7f54e000c6a0 comp rx=0 tx=0).stop 2024-08-20T05:00:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.133+0000 7f54ee600640 1 -- 172.21.15.37:0/3692270324 reap_dead start 2024-08-20T05:00:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.133+0000 7f54f0600640 1 -- 172.21.15.37:0/3692270324 shutdown_connections 2024-08-20T05:00:44.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.133+0000 7f54f0600640 1 -- 172.21.15.37:0/3692270324 >> 172.21.15.37:0/3692270324 conn(0x7f54e80fd3f0 msgr2=0x7f54e81068a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:44.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.134+0000 7f54f0600640 1 -- 172.21.15.37:0/3692270324 shutdown_connections 2024-08-20T05:00:44.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:41.134+0000 7f54f0600640 1 -- 172.21.15.37:0/3692270324 wait complete. 2024-08-20T05:00:44.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.003+0000 7f1430200640 1 -- 172.21.15.37:0/2804469259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14281084c0 msgr2=0x7f1428108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:44.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.003+0000 7f1430200640 1 --2- 172.21.15.37:0/2804469259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14281084c0 0x7f1428108900 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1414009900 tx=0x7f141402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:00:44.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.004+0000 7f1430200640 1 -- 172.21.15.37:0/2804469259 shutdown_connections 2024-08-20T05:00:44.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.004+0000 7f1430200640 1 --2- 172.21.15.37:0/2804469259 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1428108e40 0x7f142810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:44.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.004+0000 7f1430200640 1 --2- 172.21.15.37:0/2804469259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14281084c0 0x7f1428108900 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:44.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.004+0000 7f1430200640 1 --2- 172.21.15.37:0/2804469259 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1428102ab0 0x7f1428102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:44.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.004+0000 7f1430200640 1 -- 172.21.15.37:0/2804469259 >> 172.21.15.37:0/2804469259 conn(0x7f14280fe500 msgr2=0x7f1428100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:44.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.004+0000 7f1430200640 1 -- 172.21.15.37:0/2804469259 shutdown_connections 2024-08-20T05:00:44.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.004+0000 7f1430200640 1 -- 172.21.15.37:0/2804469259 wait complete. 2024-08-20T05:00:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.005+0000 7f1430200640 1 Processor -- start 2024-08-20T05:00:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.005+0000 7f1430200640 1 -- start start 2024-08-20T05:00:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.006+0000 7f1430200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1428102ab0 0x7f14280751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.006+0000 7f1430200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14281084c0 0x7f1428075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.006+0000 7f1430200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1428108e40 0x7f1428075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.006+0000 7f1430200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1428112b50 con 0x7f1428102ab0 2024-08-20T05:00:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.006+0000 7f1430200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f14281129d0 con 0x7f1428108e40 2024-08-20T05:00:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.006+0000 7f1430200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1428112cd0 con 0x7f14281084c0 2024-08-20T05:00:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.006+0000 7f142d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1428102ab0 0x7f14280751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.006+0000 7f142d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1428102ab0 0x7f14280751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39930/0 (socket says 172.21.15.37:39930) 2024-08-20T05:00:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.006+0000 7f142d800640 1 -- 172.21.15.37:0/3647890220 learned_addr learned my addr 172.21.15.37:0/3647890220 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.006+0000 7f142e200640 1 --2- 172.21.15.37:0/3647890220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1428108e40 0x7f1428075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.006+0000 7f142ce00640 1 --2- 172.21.15.37:0/3647890220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14281084c0 0x7f1428075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:44.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.007+0000 7f142e200640 1 -- 172.21.15.37:0/3647890220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14281084c0 msgr2=0x7f1428075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:44.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.007+0000 7f142e200640 1 --2- 172.21.15.37:0/3647890220 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f14281084c0 0x7f1428075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:44.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.007+0000 7f142e200640 1 -- 172.21.15.37:0/3647890220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1428102ab0 msgr2=0x7f14280751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:44.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.007+0000 7f142e200640 1 --2- 172.21.15.37:0/3647890220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1428102ab0 0x7f14280751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:44.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.007+0000 7f142e200640 1 -- 172.21.15.37:0/3647890220 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14281a73a0 con 0x7f1428108e40 2024-08-20T05:00:44.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.007+0000 7f142e200640 1 --2- 172.21.15.37:0/3647890220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1428108e40 0x7f1428075c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1420009fd0 tx=0x7f142000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:44.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.007+0000 7f1426000640 1 -- 172.21.15.37:0/3647890220 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142000ce20 con 0x7f1428108e40 2024-08-20T05:00:44.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.007+0000 7f1430200640 1 -- 172.21.15.37:0/3647890220 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14281a7690 con 0x7f1428108e40 2024-08-20T05:00:44.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.008+0000 7f1426000640 1 -- 172.21.15.37:0/3647890220 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1420005020 con 0x7f1428108e40 2024-08-20T05:00:44.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.008+0000 7f1426000640 1 -- 172.21.15.37:0/3647890220 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1420010690 con 0x7f1428108e40 2024-08-20T05:00:44.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.008+0000 7f1430200640 1 -- 172.21.15.37:0/3647890220 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14281a7bf0 con 0x7f1428108e40 2024-08-20T05:00:44.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.009+0000 7f1430200640 1 -- 172.21.15.37:0/3647890220 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1428063610 con 0x7f1428108e40 2024-08-20T05:00:44.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.011+0000 7f1426000640 1 -- 172.21.15.37:0/3647890220 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f14200054d0 con 0x7f1428108e40 2024-08-20T05:00:44.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.012+0000 7f1426000640 1 --2- 172.21.15.37:0/3647890220 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f14100b3c60 0x7f14100b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:44.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.013+0000 7f1426000640 1 -- 172.21.15.37:0/3647890220 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f14200e4940 con 0x7f1428108e40 2024-08-20T05:00:44.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.013+0000 7f142d800640 1 --2- 172.21.15.37:0/3647890220 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f14100b3c60 0x7f14100b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:44.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.013+0000 7f1426000640 1 --2- 172.21.15.37:0/3647890220 >> [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692] conn(0x7f14100bee30 0x7f14100c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:44.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.013+0000 7f1426000640 1 -- 172.21.15.37:0/3647890220 --> [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14100c19a0 con 0x7f14100bee30 2024-08-20T05:00:44.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.013+0000 7f1426000640 1 -- 172.21.15.37:0/3647890220 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f14200e4cf0 con 0x7f1428108e40 2024-08-20T05:00:44.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.013+0000 7f142ce00640 1 --2- 172.21.15.37:0/3647890220 >> [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692] conn(0x7f14100bee30 0x7f14100c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:44.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.013+0000 7f142d800640 1 --2- 172.21.15.37:0/3647890220 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f14100b3c60 0x7f14100b6120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f141c009c90 tx=0x7f141c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:44.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.014+0000 7f142ce00640 1 --2- 172.21.15.37:0/3647890220 >> [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692] conn(0x7f14100bee30 0x7f14100c12d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:44.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.015+0000 7f1426000640 1 -- 172.21.15.37:0/3647890220 <== osd.6 v2:172.21.15.37:6818/155932692 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14100c19a0 con 0x7f14100bee30 2024-08-20T05:00:44.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.029+0000 7f1430200640 1 -- 172.21.15.37:0/3647890220 --> [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1428063a90 con 0x7f14100bee30 2024-08-20T05:00:44.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.029+0000 7f1426000640 1 -- 172.21.15.37:0/3647890220 <== osd.6 v2:172.21.15.37:6818/155932692 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1428063a90 con 0x7f14100bee30 2024-08-20T05:00:44.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.030+0000 7f1430200640 1 -- 172.21.15.37:0/3647890220 >> [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692] conn(0x7f14100bee30 msgr2=0x7f14100c12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:44.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.030+0000 7f1430200640 1 --2- 172.21.15.37:0/3647890220 >> [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692] conn(0x7f14100bee30 0x7f14100c12d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:44.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.030+0000 7f1430200640 1 -- 172.21.15.37:0/3647890220 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f14100b3c60 msgr2=0x7f14100b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:44.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.030+0000 7f1430200640 1 --2- 172.21.15.37:0/3647890220 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f14100b3c60 0x7f14100b6120 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f141c009c90 tx=0x7f141c005f90 comp rx=0 tx=0).stop 2024-08-20T05:00:44.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.030+0000 7f1430200640 1 -- 172.21.15.37:0/3647890220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1428108e40 msgr2=0x7f1428075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:44.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.030+0000 7f1430200640 1 --2- 172.21.15.37:0/3647890220 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1428108e40 0x7f1428075c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1420009fd0 tx=0x7f142000ef10 comp rx=0 tx=0).stop 2024-08-20T05:00:44.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.030+0000 7f142e200640 1 -- 172.21.15.37:0/3647890220 reap_dead start 2024-08-20T05:00:44.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.030+0000 7f1430200640 1 -- 172.21.15.37:0/3647890220 shutdown_connections 2024-08-20T05:00:44.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.030+0000 7f1430200640 1 -- 172.21.15.37:0/3647890220 >> 172.21.15.37:0/3647890220 conn(0x7f14280fe500 msgr2=0x7f14281008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:44.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.030+0000 7f1430200640 1 -- 172.21.15.37:0/3647890220 shutdown_connections 2024-08-20T05:00:44.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:40.030+0000 7f1430200640 1 -- 172.21.15.37:0/3647890220 wait complete. 2024-08-20T05:00:45.041 INFO:teuthology.orchestra.run.smithi037.stdout:77309411408 2024-08-20T05:00:45.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-20T05:00:45.535 INFO:teuthology.orchestra.run.smithi037.stdout:55834574931 2024-08-20T05:00:45.536 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-20T05:00:45.757 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:45 smithi130 ceph-mon[22007]: pgmap v354: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 9 B/s, 0 objects/s recovering 2024-08-20T05:00:45.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:45 smithi037 ceph-mon[17265]: pgmap v354: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 9 B/s, 0 objects/s recovering 2024-08-20T05:00:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:45 smithi135 ceph-mon[22342]: pgmap v354: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s; 9 B/s, 0 objects/s recovering 2024-08-20T05:00:46.160 INFO:teuthology.orchestra.run.smithi037.stdout:34359738457 2024-08-20T05:00:46.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-20T05:00:46.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.359+0000 7f5a93e00640 1 -- 172.21.15.37:0/907121225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a8c104ca0 msgr2=0x7f5a8c105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:46.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.359+0000 7f5a93e00640 1 --2- 172.21.15.37:0/907121225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a8c104ca0 0x7f5a8c105080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5a80009860 tx=0x7f5a8002a340 comp rx=0 tx=0).stop 2024-08-20T05:00:46.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.359+0000 7f5a93e00640 1 -- 172.21.15.37:0/907121225 shutdown_connections 2024-08-20T05:00:46.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.359+0000 7f5a93e00640 1 --2- 172.21.15.37:0/907121225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c10b030 0x7f5a8c111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:46.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.359+0000 7f5a93e00640 1 --2- 172.21.15.37:0/907121225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8c10a6b0 0x7f5a8c10aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:46.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.359+0000 7f5a93e00640 1 --2- 172.21.15.37:0/907121225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a8c104ca0 0x7f5a8c105080 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:46.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.359+0000 7f5a93e00640 1 -- 172.21.15.37:0/907121225 >> 172.21.15.37:0/907121225 conn(0x7f5a8c100730 msgr2=0x7f5a8c102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:46.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.359+0000 7f5a93e00640 1 -- 172.21.15.37:0/907121225 shutdown_connections 2024-08-20T05:00:46.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.359+0000 7f5a93e00640 1 -- 172.21.15.37:0/907121225 wait complete. 2024-08-20T05:00:46.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.360+0000 7f5a93e00640 1 Processor -- start 2024-08-20T05:00:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.360+0000 7f5a93e00640 1 -- start start 2024-08-20T05:00:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.361+0000 7f5a93e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c104ca0 0x7f5a8c19b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.361+0000 7f5a93e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8c10a6b0 0x7f5a8c19b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.361+0000 7f5a93e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a8c10b030 0x7f5a8c1a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.361+0000 7f5a93e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c114cf0 con 0x7f5a8c10a6b0 2024-08-20T05:00:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.361+0000 7f5a93e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c114b70 con 0x7f5a8c10b030 2024-08-20T05:00:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.361+0000 7f5a93e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a8c114e70 con 0x7f5a8c104ca0 2024-08-20T05:00:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.361+0000 7f5a90a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8c10a6b0 0x7f5a8c19b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.361+0000 7f5a91400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c104ca0 0x7f5a8c19b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.361+0000 7f5a91400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c104ca0 0x7f5a8c19b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:47154/0 (socket says 172.21.15.37:47154) 2024-08-20T05:00:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.361+0000 7f5a91400640 1 -- 172.21.15.37:0/1568678627 learned_addr learned my addr 172.21.15.37:0/1568678627 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.361+0000 7f5a90a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8c10a6b0 0x7f5a8c19b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43956/0 (socket says 172.21.15.37:43956) 2024-08-20T05:00:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.361+0000 7f5a91e00640 1 --2- 172.21.15.37:0/1568678627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a8c10b030 0x7f5a8c1a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.362+0000 7f5a91400640 1 -- 172.21.15.37:0/1568678627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a8c10b030 msgr2=0x7f5a8c1a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:46.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.362+0000 7f5a91400640 1 --2- 172.21.15.37:0/1568678627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a8c10b030 0x7f5a8c1a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:46.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.362+0000 7f5a91400640 1 -- 172.21.15.37:0/1568678627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8c10a6b0 msgr2=0x7f5a8c19b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:46.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.362+0000 7f5a91400640 1 --2- 172.21.15.37:0/1568678627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8c10a6b0 0x7f5a8c19b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:46.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.362+0000 7f5a91400640 1 -- 172.21.15.37:0/1568678627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a8c1a1210 con 0x7f5a8c104ca0 2024-08-20T05:00:46.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.362+0000 7f5a90a00640 1 --2- 172.21.15.37:0/1568678627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a8c10a6b0 0x7f5a8c19b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:00:46.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.362+0000 7f5a91400640 1 --2- 172.21.15.37:0/1568678627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c104ca0 0x7f5a8c19b160 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5a80035040 tx=0x7f5a80032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:46.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.362+0000 7f5a8a000640 1 -- 172.21.15.37:0/1568678627 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a80037040 con 0x7f5a8c104ca0 2024-08-20T05:00:46.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.362+0000 7f5a93e00640 1 -- 172.21.15.37:0/1568678627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a8c1a14a0 con 0x7f5a8c104ca0 2024-08-20T05:00:46.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.362+0000 7f5a8a000640 1 -- 172.21.15.37:0/1568678627 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a80041070 con 0x7f5a8c104ca0 2024-08-20T05:00:46.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.362+0000 7f5a8a000640 1 -- 172.21.15.37:0/1568678627 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a80003850 con 0x7f5a8c104ca0 2024-08-20T05:00:46.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.362+0000 7f5a93e00640 1 -- 172.21.15.37:0/1568678627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a8c1a7bc0 con 0x7f5a8c104ca0 2024-08-20T05:00:46.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.363+0000 7f5a93e00640 1 -- 172.21.15.37:0/1568678627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5a8c063610 con 0x7f5a8c104ca0 2024-08-20T05:00:46.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.366+0000 7f5a8a000640 1 -- 172.21.15.37:0/1568678627 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f5a800039f0 con 0x7f5a8c104ca0 2024-08-20T05:00:46.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.367+0000 7f5a8a000640 1 --2- 172.21.15.37:0/1568678627 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5a740b3c60 0x7f5a740b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:46.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.368+0000 7f5a8a000640 1 -- 172.21.15.37:0/1568678627 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f5a80104780 con 0x7f5a8c104ca0 2024-08-20T05:00:46.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.368+0000 7f5a90a00640 1 --2- 172.21.15.37:0/1568678627 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5a740b3c60 0x7f5a740b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:46.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.368+0000 7f5a8a000640 1 --2- 172.21.15.37:0/1568678627 >> [v2:172.21.15.135:6816/222884649,v1:172.21.15.135:6817/222884649] conn(0x7f5a740bee30 0x7f5a740c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.368+0000 7f5a8a000640 1 -- 172.21.15.37:0/1568678627 --> [v2:172.21.15.135:6816/222884649,v1:172.21.15.135:6817/222884649] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a800328f0 con 0x7f5a740bee30 2024-08-20T05:00:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.368+0000 7f5a8a000640 1 -- 172.21.15.37:0/1568678627 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f5a80104b30 con 0x7f5a8c104ca0 2024-08-20T05:00:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.369+0000 7f5a91e00640 1 --2- 172.21.15.37:0/1568678627 >> [v2:172.21.15.135:6816/222884649,v1:172.21.15.135:6817/222884649] conn(0x7f5a740bee30 0x7f5a740c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.369+0000 7f5a90a00640 1 --2- 172.21.15.37:0/1568678627 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5a740b3c60 0x7f5a740b6120 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5a780096c0 tx=0x7f5a78009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.369+0000 7f5a91e00640 1 --2- 172.21.15.37:0/1568678627 >> [v2:172.21.15.135:6816/222884649,v1:172.21.15.135:6817/222884649] conn(0x7f5a740bee30 0x7f5a740c12d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.370+0000 7f5a8a000640 1 -- 172.21.15.37:0/1568678627 <== osd.8 v2:172.21.15.135:6816/222884649 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5a800328f0 con 0x7f5a740bee30 2024-08-20T05:00:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.385+0000 7f5a93e00640 1 -- 172.21.15.37:0/1568678627 --> [v2:172.21.15.135:6816/222884649,v1:172.21.15.135:6817/222884649] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5a8c063a10 con 0x7f5a740bee30 2024-08-20T05:00:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.386+0000 7f5a8a000640 1 -- 172.21.15.37:0/1568678627 <== osd.8 v2:172.21.15.135:6816/222884649 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5a8c063a10 con 0x7f5a740bee30 2024-08-20T05:00:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.386+0000 7f5a93e00640 1 -- 172.21.15.37:0/1568678627 >> [v2:172.21.15.135:6816/222884649,v1:172.21.15.135:6817/222884649] conn(0x7f5a740bee30 msgr2=0x7f5a740c12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.386+0000 7f5a93e00640 1 --2- 172.21.15.37:0/1568678627 >> [v2:172.21.15.135:6816/222884649,v1:172.21.15.135:6817/222884649] conn(0x7f5a740bee30 0x7f5a740c12d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.386+0000 7f5a93e00640 1 -- 172.21.15.37:0/1568678627 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5a740b3c60 msgr2=0x7f5a740b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.386+0000 7f5a93e00640 1 --2- 172.21.15.37:0/1568678627 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5a740b3c60 0x7f5a740b6120 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5a780096c0 tx=0x7f5a78009260 comp rx=0 tx=0).stop 2024-08-20T05:00:46.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.386+0000 7f5a93e00640 1 -- 172.21.15.37:0/1568678627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c104ca0 msgr2=0x7f5a8c19b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:46.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.386+0000 7f5a93e00640 1 --2- 172.21.15.37:0/1568678627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8c104ca0 0x7f5a8c19b160 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5a80035040 tx=0x7f5a80032d50 comp rx=0 tx=0).stop 2024-08-20T05:00:46.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.386+0000 7f5a91e00640 1 -- 172.21.15.37:0/1568678627 reap_dead start 2024-08-20T05:00:46.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.386+0000 7f5a93e00640 1 -- 172.21.15.37:0/1568678627 shutdown_connections 2024-08-20T05:00:46.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.386+0000 7f5a93e00640 1 -- 172.21.15.37:0/1568678627 >> 172.21.15.37:0/1568678627 conn(0x7f5a8c100730 msgr2=0x7f5a8c102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:46.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.387+0000 7f5a93e00640 1 -- 172.21.15.37:0/1568678627 shutdown_connections 2024-08-20T05:00:46.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.387+0000 7f5a93e00640 1 -- 172.21.15.37:0/1568678627 wait complete. 2024-08-20T05:00:46.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.896+0000 7f9d4f200640 1 -- 172.21.15.37:0/76608228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d50104b10 msgr2=0x7f9d50104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:46.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.896+0000 7f9d4f200640 1 --2- 172.21.15.37:0/76608228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d50104b10 0x7f9d50104ef0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9d40009900 tx=0x7f9d4002a410 comp rx=0 tx=0).stop 2024-08-20T05:00:46.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.896+0000 7f9d4f200640 1 -- 172.21.15.37:0/76608228 shutdown_connections 2024-08-20T05:00:46.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.896+0000 7f9d4f200640 1 --2- 172.21.15.37:0/76608228 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d5010aea0 0x7f9d501116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:46.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.896+0000 7f9d4f200640 1 --2- 172.21.15.37:0/76608228 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d5010a520 0x7f9d5010a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:46.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.896+0000 7f9d4f200640 1 --2- 172.21.15.37:0/76608228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d50104b10 0x7f9d50104ef0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:46.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.896+0000 7f9d4f200640 1 -- 172.21.15.37:0/76608228 >> 172.21.15.37:0/76608228 conn(0x7f9d50100540 msgr2=0x7f9d50102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:46.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.896+0000 7f9d4f200640 1 -- 172.21.15.37:0/76608228 shutdown_connections 2024-08-20T05:00:46.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.896+0000 7f9d4f200640 1 -- 172.21.15.37:0/76608228 wait complete. 2024-08-20T05:00:46.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.897+0000 7f9d4f200640 1 Processor -- start 2024-08-20T05:00:46.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.897+0000 7f9d4f200640 1 -- start start 2024-08-20T05:00:46.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.898+0000 7f9d4f200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d50104b10 0x7f9d5019af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:46.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.898+0000 7f9d4f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d5010a520 0x7f9d5019b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:46.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.898+0000 7f9d4f200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d5010aea0 0x7f9d501a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:46.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.898+0000 7f9d4f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9d50114bb0 con 0x7f9d5010a520 2024-08-20T05:00:46.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.898+0000 7f9d4f200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9d50114a30 con 0x7f9d5010aea0 2024-08-20T05:00:46.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.898+0000 7f9d4f200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9d50114d30 con 0x7f9d50104b10 2024-08-20T05:00:46.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.898+0000 7f9d4d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d5010a520 0x7f9d5019b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:46.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.898+0000 7f9d4d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d5010a520 0x7f9d5019b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43976/0 (socket says 172.21.15.37:43976) 2024-08-20T05:00:46.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.898+0000 7f9d4d400640 1 -- 172.21.15.37:0/48756373 learned_addr learned my addr 172.21.15.37:0/48756373 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:46.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.898+0000 7f9d4de00640 1 --2- 172.21.15.37:0/48756373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d50104b10 0x7f9d5019af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:46.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.898+0000 7f9d4e800640 1 --2- 172.21.15.37:0/48756373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d5010aea0 0x7f9d501a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:46.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.899+0000 7f9d4de00640 1 -- 172.21.15.37:0/48756373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d5010aea0 msgr2=0x7f9d501a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:46.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.899+0000 7f9d4de00640 1 --2- 172.21.15.37:0/48756373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d5010aea0 0x7f9d501a0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:46.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.899+0000 7f9d4de00640 1 -- 172.21.15.37:0/48756373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d5010a520 msgr2=0x7f9d5019b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:46.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.899+0000 7f9d4de00640 1 --2- 172.21.15.37:0/48756373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d5010a520 0x7f9d5019b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:46.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.899+0000 7f9d4de00640 1 -- 172.21.15.37:0/48756373 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d501a1010 con 0x7f9d50104b10 2024-08-20T05:00:46.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.899+0000 7f9d4d400640 1 --2- 172.21.15.37:0/48756373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d5010a520 0x7f9d5019b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:00:46.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.899+0000 7f9d4e800640 1 --2- 172.21.15.37:0/48756373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9d5010aea0 0x7f9d501a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:00:46.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.899+0000 7f9d4de00640 1 --2- 172.21.15.37:0/48756373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d50104b10 0x7f9d5019af60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9d4002aa00 tx=0x7f9d40003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:46.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.899+0000 7f9d46a00640 1 -- 172.21.15.37:0/48756373 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4003f070 con 0x7f9d50104b10 2024-08-20T05:00:46.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.899+0000 7f9d46a00640 1 -- 172.21.15.37:0/48756373 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d40031b50 con 0x7f9d50104b10 2024-08-20T05:00:46.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.899+0000 7f9d46a00640 1 -- 172.21.15.37:0/48756373 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d40035030 con 0x7f9d50104b10 2024-08-20T05:00:46.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.899+0000 7f9d4f200640 1 -- 172.21.15.37:0/48756373 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d501a12a0 con 0x7f9d50104b10 2024-08-20T05:00:46.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.900+0000 7f9d4f200640 1 -- 172.21.15.37:0/48756373 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d501a79c0 con 0x7f9d50104b10 2024-08-20T05:00:46.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.901+0000 7f9d3be00640 1 -- 172.21.15.37:0/48756373 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9d50063610 con 0x7f9d50104b10 2024-08-20T05:00:46.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.905+0000 7f9d46a00640 1 -- 172.21.15.37:0/48756373 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f9d40042070 con 0x7f9d50104b10 2024-08-20T05:00:46.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.906+0000 7f9d46a00640 1 --2- 172.21.15.37:0/48756373 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9d340b3d90 0x7f9d340b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:46.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.906+0000 7f9d46a00640 1 -- 172.21.15.37:0/48756373 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f9d40104c90 con 0x7f9d50104b10 2024-08-20T05:00:46.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.907+0000 7f9d4d400640 1 --2- 172.21.15.37:0/48756373 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9d340b3d90 0x7f9d340b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:46.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.907+0000 7f9d46a00640 1 --2- 172.21.15.37:0/48756373 >> [v2:172.21.15.37:6826/2240773042,v1:172.21.15.37:6827/2240773042] conn(0x7f9d340bef60 0x7f9d340c1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:46.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.907+0000 7f9d46a00640 1 -- 172.21.15.37:0/48756373 --> [v2:172.21.15.37:6826/2240773042,v1:172.21.15.37:6827/2240773042] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d4004be50 con 0x7f9d340bef60 2024-08-20T05:00:46.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.907+0000 7f9d46a00640 1 -- 172.21.15.37:0/48756373 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f9d401050e0 con 0x7f9d50104b10 2024-08-20T05:00:46.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.907+0000 7f9d4e800640 1 --2- 172.21.15.37:0/48756373 >> [v2:172.21.15.37:6826/2240773042,v1:172.21.15.37:6827/2240773042] conn(0x7f9d340bef60 0x7f9d340c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:46.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.907+0000 7f9d4d400640 1 --2- 172.21.15.37:0/48756373 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9d340b3d90 0x7f9d340b6250 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9d5010a0f0 tx=0x7f9d3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:46.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.908+0000 7f9d4e800640 1 --2- 172.21.15.37:0/48756373 >> [v2:172.21.15.37:6826/2240773042,v1:172.21.15.37:6827/2240773042] conn(0x7f9d340bef60 0x7f9d340c1400 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:46.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.909+0000 7f9d46a00640 1 -- 172.21.15.37:0/48756373 <== osd.9 v2:172.21.15.37:6826/2240773042 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d4004be50 con 0x7f9d340bef60 2024-08-20T05:00:46.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.937+0000 7f9d3be00640 1 -- 172.21.15.37:0/48756373 --> [v2:172.21.15.37:6826/2240773042,v1:172.21.15.37:6827/2240773042] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9d50063ae0 con 0x7f9d340bef60 2024-08-20T05:00:46.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.938+0000 7f9d46a00640 1 -- 172.21.15.37:0/48756373 <== osd.9 v2:172.21.15.37:6826/2240773042 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9d50063ae0 con 0x7f9d340bef60 2024-08-20T05:00:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.939+0000 7f9d3be00640 1 -- 172.21.15.37:0/48756373 >> [v2:172.21.15.37:6826/2240773042,v1:172.21.15.37:6827/2240773042] conn(0x7f9d340bef60 msgr2=0x7f9d340c1400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.939+0000 7f9d3be00640 1 --2- 172.21.15.37:0/48756373 >> [v2:172.21.15.37:6826/2240773042,v1:172.21.15.37:6827/2240773042] conn(0x7f9d340bef60 0x7f9d340c1400 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.939+0000 7f9d3be00640 1 -- 172.21.15.37:0/48756373 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9d340b3d90 msgr2=0x7f9d340b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.939+0000 7f9d3be00640 1 --2- 172.21.15.37:0/48756373 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9d340b3d90 0x7f9d340b6250 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9d5010a0f0 tx=0x7f9d3c005f90 comp rx=0 tx=0).stop 2024-08-20T05:00:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.939+0000 7f9d3be00640 1 -- 172.21.15.37:0/48756373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d50104b10 msgr2=0x7f9d5019af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.939+0000 7f9d3be00640 1 --2- 172.21.15.37:0/48756373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9d50104b10 0x7f9d5019af60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9d4002aa00 tx=0x7f9d40003b90 comp rx=0 tx=0).stop 2024-08-20T05:00:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.939+0000 7f9d4e800640 1 -- 172.21.15.37:0/48756373 reap_dead start 2024-08-20T05:00:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.939+0000 7f9d3be00640 1 -- 172.21.15.37:0/48756373 shutdown_connections 2024-08-20T05:00:46.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.939+0000 7f9d3be00640 1 -- 172.21.15.37:0/48756373 >> 172.21.15.37:0/48756373 conn(0x7f9d50100540 msgr2=0x7f9d50102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:46.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.939+0000 7f9d3be00640 1 -- 172.21.15.37:0/48756373 shutdown_connections 2024-08-20T05:00:46.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:46.939+0000 7f9d3be00640 1 -- 172.21.15.37:0/48756373 wait complete. 2024-08-20T05:00:47.449 INFO:teuthology.orchestra.run.smithi037.stdout:270582939685 2024-08-20T05:00:47.449 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-08-20T05:00:47.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:47 smithi037 ceph-mon[17265]: pgmap v355: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:00:47.828 INFO:teuthology.orchestra.run.smithi037.stdout:107374182474 2024-08-20T05:00:47.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-20T05:00:47.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:47 smithi135 ceph-mon[22342]: pgmap v355: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:00:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:47 smithi130 ceph-mon[22007]: pgmap v355: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:00:48.084 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:48.084 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:48.598 INFO:teuthology.orchestra.run.smithi037.stdout:180388626491 2024-08-20T05:00:48.599 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-08-20T05:00:49.330 INFO:teuthology.orchestra.run.smithi037.stdout:249108103212 2024-08-20T05:00:49.331 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-08-20T05:00:49.574 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:49 smithi037 ceph-mon[17265]: pgmap v356: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:00:49.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:49 smithi135 ceph-mon[22342]: pgmap v356: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:00:49.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:49 smithi130 ceph-mon[22007]: pgmap v356: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:00:49.956 INFO:teuthology.orchestra.run.smithi037.stdout:296352743456 2024-08-20T05:00:49.957 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-08-20T05:00:50.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.457+0000 7f359e600640 1 -- 172.21.15.37:0/3248496166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3598108e40 msgr2=0x7f359810f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:50.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.457+0000 7f359e600640 1 --2- 172.21.15.37:0/3248496166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3598108e40 0x7f359810f640 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3590009ca0 tx=0x7f359002a8c0 comp rx=0 tx=0).stop 2024-08-20T05:00:50.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.457+0000 7f359e600640 1 -- 172.21.15.37:0/3248496166 shutdown_connections 2024-08-20T05:00:50.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.457+0000 7f359e600640 1 --2- 172.21.15.37:0/3248496166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3598108e40 0x7f359810f640 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:50.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.457+0000 7f359e600640 1 --2- 172.21.15.37:0/3248496166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35981084c0 0x7f3598108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:50.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.457+0000 7f359e600640 1 --2- 172.21.15.37:0/3248496166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3598102ab0 0x7f3598102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:50.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.457+0000 7f359e600640 1 -- 172.21.15.37:0/3248496166 >> 172.21.15.37:0/3248496166 conn(0x7f35980fe500 msgr2=0x7f3598100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:50.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.457+0000 7f359e600640 1 -- 172.21.15.37:0/3248496166 shutdown_connections 2024-08-20T05:00:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.457+0000 7f359e600640 1 -- 172.21.15.37:0/3248496166 wait complete. 2024-08-20T05:00:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.459+0000 7f359e600640 1 Processor -- start 2024-08-20T05:00:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.459+0000 7f359e600640 1 -- start start 2024-08-20T05:00:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.459+0000 7f359e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3598102ab0 0x7f35980751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.459+0000 7f359e600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35981084c0 0x7f3598075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.460+0000 7f359e600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3598108e40 0x7f3598075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.460+0000 7f359e600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3598112ac0 con 0x7f3598102ab0 2024-08-20T05:00:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.460+0000 7f359e600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3598112940 con 0x7f35981084c0 2024-08-20T05:00:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.460+0000 7f359e600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3598112c40 con 0x7f3598108e40 2024-08-20T05:00:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.460+0000 7f3597400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3598102ab0 0x7f35980751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.460+0000 7f3597e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3598108e40 0x7f3598075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.460+0000 7f358ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35981084c0 0x7f3598075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.460+0000 7f3597e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3598108e40 0x7f3598075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:47210/0 (socket says 172.21.15.37:47210) 2024-08-20T05:00:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.460+0000 7f3597e00640 1 -- 172.21.15.37:0/1344600094 learned_addr learned my addr 172.21.15.37:0/1344600094 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.460+0000 7f358ea00640 1 -- 172.21.15.37:0/1344600094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3598108e40 msgr2=0x7f3598075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.460+0000 7f358ea00640 1 --2- 172.21.15.37:0/1344600094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3598108e40 0x7f3598075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.460+0000 7f358ea00640 1 -- 172.21.15.37:0/1344600094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3598102ab0 msgr2=0x7f35980751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.460+0000 7f358ea00640 1 --2- 172.21.15.37:0/1344600094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3598102ab0 0x7f35980751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.460+0000 7f358ea00640 1 -- 172.21.15.37:0/1344600094 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35981a7370 con 0x7f35981084c0 2024-08-20T05:00:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.461+0000 7f358ea00640 1 --2- 172.21.15.37:0/1344600094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35981084c0 0x7f3598075710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f358000e9f0 tx=0x7f358000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.461+0000 7f3594c00640 1 -- 172.21.15.37:0/1344600094 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f358000ccc0 con 0x7f35981084c0 2024-08-20T05:00:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.461+0000 7f3594c00640 1 -- 172.21.15.37:0/1344600094 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3580005020 con 0x7f35981084c0 2024-08-20T05:00:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.461+0000 7f3594c00640 1 -- 172.21.15.37:0/1344600094 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580004a00 con 0x7f35981084c0 2024-08-20T05:00:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.461+0000 7f359e600640 1 -- 172.21.15.37:0/1344600094 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35981a7660 con 0x7f35981084c0 2024-08-20T05:00:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.461+0000 7f359e600640 1 -- 172.21.15.37:0/1344600094 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35981a7b50 con 0x7f35981084c0 2024-08-20T05:00:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.462+0000 7f359e600640 1 -- 172.21.15.37:0/1344600094 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3598063610 con 0x7f35981084c0 2024-08-20T05:00:50.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.465+0000 7f3594c00640 1 -- 172.21.15.37:0/1344600094 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f3580004ba0 con 0x7f35981084c0 2024-08-20T05:00:50.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.467+0000 7f3594c00640 1 --2- 172.21.15.37:0/1344600094 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f357c0b3c60 0x7f357c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:50.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.467+0000 7f3594c00640 1 -- 172.21.15.37:0/1344600094 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f35800e42f0 con 0x7f35981084c0 2024-08-20T05:00:50.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.467+0000 7f3597400640 1 --2- 172.21.15.37:0/1344600094 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f357c0b3c60 0x7f357c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:50.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.467+0000 7f3594c00640 1 --2- 172.21.15.37:0/1344600094 >> [v2:172.21.15.130:6808/3542081474,v1:172.21.15.130:6809/3542081474] conn(0x7f357c0bee30 0x7f357c0c12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:50.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.467+0000 7f3594c00640 1 -- 172.21.15.37:0/1344600094 --> [v2:172.21.15.130:6808/3542081474,v1:172.21.15.130:6809/3542081474] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3580023ea0 con 0x7f357c0bee30 2024-08-20T05:00:50.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.467+0000 7f3594c00640 1 -- 172.21.15.37:0/1344600094 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f35800e46a0 con 0x7f35981084c0 2024-08-20T05:00:50.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.467+0000 7f3597e00640 1 --2- 172.21.15.37:0/1344600094 >> [v2:172.21.15.130:6808/3542081474,v1:172.21.15.130:6809/3542081474] conn(0x7f357c0bee30 0x7f357c0c12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.468+0000 7f3597400640 1 --2- 172.21.15.37:0/1344600094 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f357c0b3c60 0x7f357c0b6120 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3588005d00 tx=0x7f358800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.468+0000 7f3597e00640 1 --2- 172.21.15.37:0/1344600094 >> [v2:172.21.15.130:6808/3542081474,v1:172.21.15.130:6809/3542081474] conn(0x7f357c0bee30 0x7f357c0c12d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.469+0000 7f3594c00640 1 -- 172.21.15.37:0/1344600094 <== osd.4 v2:172.21.15.130:6808/3542081474 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3580023ea0 con 0x7f357c0bee30 2024-08-20T05:00:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.484+0000 7f359e600640 1 -- 172.21.15.37:0/1344600094 --> [v2:172.21.15.130:6808/3542081474,v1:172.21.15.130:6809/3542081474] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3598063a90 con 0x7f357c0bee30 2024-08-20T05:00:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.484+0000 7f3594c00640 1 -- 172.21.15.37:0/1344600094 <== osd.4 v2:172.21.15.130:6808/3542081474 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3598063a90 con 0x7f357c0bee30 2024-08-20T05:00:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.485+0000 7f359e600640 1 -- 172.21.15.37:0/1344600094 >> [v2:172.21.15.130:6808/3542081474,v1:172.21.15.130:6809/3542081474] conn(0x7f357c0bee30 msgr2=0x7f357c0c12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.485+0000 7f359e600640 1 --2- 172.21.15.37:0/1344600094 >> [v2:172.21.15.130:6808/3542081474,v1:172.21.15.130:6809/3542081474] conn(0x7f357c0bee30 0x7f357c0c12d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.485+0000 7f359e600640 1 -- 172.21.15.37:0/1344600094 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f357c0b3c60 msgr2=0x7f357c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.485+0000 7f359e600640 1 --2- 172.21.15.37:0/1344600094 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f357c0b3c60 0x7f357c0b6120 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3588005d00 tx=0x7f358800b410 comp rx=0 tx=0).stop 2024-08-20T05:00:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.485+0000 7f359e600640 1 -- 172.21.15.37:0/1344600094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35981084c0 msgr2=0x7f3598075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.485+0000 7f359e600640 1 --2- 172.21.15.37:0/1344600094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35981084c0 0x7f3598075710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f358000e9f0 tx=0x7f358000eeb0 comp rx=0 tx=0).stop 2024-08-20T05:00:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.485+0000 7f3597e00640 1 -- 172.21.15.37:0/1344600094 reap_dead start 2024-08-20T05:00:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.485+0000 7f359e600640 1 -- 172.21.15.37:0/1344600094 shutdown_connections 2024-08-20T05:00:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.485+0000 7f359e600640 1 -- 172.21.15.37:0/1344600094 >> 172.21.15.37:0/1344600094 conn(0x7f35980fe500 msgr2=0x7f35981008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.485+0000 7f359e600640 1 -- 172.21.15.37:0/1344600094 shutdown_connections 2024-08-20T05:00:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:50.485+0000 7f359e600640 1 -- 172.21.15.37:0/1344600094 wait complete. 2024-08-20T05:00:51.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.295+0000 7f0ba8e00640 1 -- 172.21.15.37:0/759840769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba410a520 msgr2=0x7f0ba410a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:51.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.295+0000 7f0ba8e00640 1 --2- 172.21.15.37:0/759840769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba410a520 0x7f0ba410a960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c009900 tx=0x7f0b8c02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:00:51.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.295+0000 7f0ba8e00640 1 -- 172.21.15.37:0/759840769 shutdown_connections 2024-08-20T05:00:51.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.295+0000 7f0ba8e00640 1 --2- 172.21.15.37:0/759840769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ba410aea0 0x7f0ba41116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:51.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.295+0000 7f0ba8e00640 1 --2- 172.21.15.37:0/759840769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba410a520 0x7f0ba410a960 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:51.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.295+0000 7f0ba8e00640 1 --2- 172.21.15.37:0/759840769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba4104b10 0x7f0ba4104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:51.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.295+0000 7f0ba8e00640 1 -- 172.21.15.37:0/759840769 >> 172.21.15.37:0/759840769 conn(0x7f0ba4100540 msgr2=0x7f0ba4102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:51.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.295+0000 7f0ba8e00640 1 -- 172.21.15.37:0/759840769 shutdown_connections 2024-08-20T05:00:51.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.295+0000 7f0ba8e00640 1 -- 172.21.15.37:0/759840769 wait complete. 2024-08-20T05:00:51.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.296+0000 7f0ba8e00640 1 Processor -- start 2024-08-20T05:00:51.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.296+0000 7f0ba8e00640 1 -- start start 2024-08-20T05:00:51.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.297+0000 7f0ba8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba4104b10 0x7f0ba419af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:51.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.297+0000 7f0ba8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba410a520 0x7f0ba419b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:51.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.297+0000 7f0ba8e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ba410aea0 0x7f0ba41a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:51.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.297+0000 7f0ba8e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba4114b20 con 0x7f0ba4104b10 2024-08-20T05:00:51.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.297+0000 7f0ba8e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba41149a0 con 0x7f0ba410aea0 2024-08-20T05:00:51.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.297+0000 7f0ba8e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba4114ca0 con 0x7f0ba410a520 2024-08-20T05:00:51.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.297+0000 7f0ba3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba4104b10 0x7f0ba419af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:51.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.297+0000 7f0ba3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba4104b10 0x7f0ba419af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44000/0 (socket says 172.21.15.37:44000) 2024-08-20T05:00:51.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.297+0000 7f0ba3400640 1 -- 172.21.15.37:0/2741733000 learned_addr learned my addr 172.21.15.37:0/2741733000 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:51.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.297+0000 7f0b9be00640 1 --2- 172.21.15.37:0/2741733000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba410a520 0x7f0ba419b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:51.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.297+0000 7f0ba3e00640 1 --2- 172.21.15.37:0/2741733000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ba410aea0 0x7f0ba41a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:51.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.298+0000 7f0ba3400640 1 -- 172.21.15.37:0/2741733000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba410a520 msgr2=0x7f0ba419b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:51.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.298+0000 7f0ba3400640 1 --2- 172.21.15.37:0/2741733000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0ba410a520 0x7f0ba419b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:51.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.298+0000 7f0ba3400640 1 -- 172.21.15.37:0/2741733000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ba410aea0 msgr2=0x7f0ba41a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:51.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.298+0000 7f0ba3400640 1 --2- 172.21.15.37:0/2741733000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ba410aea0 0x7f0ba41a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:51.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.298+0000 7f0ba3400640 1 -- 172.21.15.37:0/2741733000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba41a0fc0 con 0x7f0ba4104b10 2024-08-20T05:00:51.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.298+0000 7f0ba3e00640 1 --2- 172.21.15.37:0/2741733000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0ba410aea0 0x7f0ba41a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:00:51.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.298+0000 7f0ba3400640 1 --2- 172.21.15.37:0/2741733000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba4104b10 0x7f0ba419af10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400e9f0 tx=0x7f0b9400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:51.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.298+0000 7f0ba0c00640 1 -- 172.21.15.37:0/2741733000 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9400cd80 con 0x7f0ba4104b10 2024-08-20T05:00:51.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.298+0000 7f0ba0c00640 1 -- 172.21.15.37:0/2741733000 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b940054d0 con 0x7f0ba4104b10 2024-08-20T05:00:51.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.298+0000 7f0ba8e00640 1 -- 172.21.15.37:0/2741733000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba41a12b0 con 0x7f0ba4104b10 2024-08-20T05:00:51.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.298+0000 7f0ba0c00640 1 -- 172.21.15.37:0/2741733000 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b94010690 con 0x7f0ba4104b10 2024-08-20T05:00:51.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.298+0000 7f0ba8e00640 1 -- 172.21.15.37:0/2741733000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ba41a7970 con 0x7f0ba4104b10 2024-08-20T05:00:51.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.299+0000 7f0ba8e00640 1 -- 172.21.15.37:0/2741733000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0ba4107e50 con 0x7f0ba4104b10 2024-08-20T05:00:51.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.302+0000 7f0ba0c00640 1 -- 172.21.15.37:0/2741733000 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f0b94004e30 con 0x7f0ba4104b10 2024-08-20T05:00:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.303+0000 7f0ba0c00640 1 --2- 172.21.15.37:0/2741733000 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0b880b3d10 0x7f0b880b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.304+0000 7f0ba0c00640 1 -- 172.21.15.37:0/2741733000 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f0b940e4a30 con 0x7f0ba4104b10 2024-08-20T05:00:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.304+0000 7f0b9be00640 1 --2- 172.21.15.37:0/2741733000 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0b880b3d10 0x7f0b880b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:51.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.304+0000 7f0ba0c00640 1 --2- 172.21.15.37:0/2741733000 >> [v2:172.21.15.130:6816/4148130245,v1:172.21.15.130:6817/4148130245] conn(0x7f0b880beee0 0x7f0b880c1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:51.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.304+0000 7f0ba0c00640 1 -- 172.21.15.37:0/2741733000 --> [v2:172.21.15.130:6816/4148130245,v1:172.21.15.130:6817/4148130245] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b94015e80 con 0x7f0b880beee0 2024-08-20T05:00:51.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.304+0000 7f0ba0c00640 1 -- 172.21.15.37:0/2741733000 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) ==== 24+0+0 (secure 0 0 0) 0x7f0b940e4de0 con 0x7f0ba4104b10 2024-08-20T05:00:51.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.304+0000 7f0ba3e00640 1 --2- 172.21.15.37:0/2741733000 >> [v2:172.21.15.130:6816/4148130245,v1:172.21.15.130:6817/4148130245] conn(0x7f0b880beee0 0x7f0b880c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:51.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.304+0000 7f0b9be00640 1 --2- 172.21.15.37:0/2741733000 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0b880b3d10 0x7f0b880b61d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c031440 tx=0x7f0b8c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:51.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.305+0000 7f0ba3e00640 1 --2- 172.21.15.37:0/2741733000 >> [v2:172.21.15.130:6816/4148130245,v1:172.21.15.130:6817/4148130245] conn(0x7f0b880beee0 0x7f0b880c1380 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:51.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.306+0000 7f0ba0c00640 1 -- 172.21.15.37:0/2741733000 <== osd.7 v2:172.21.15.130:6816/4148130245 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0b94015e80 con 0x7f0b880beee0 2024-08-20T05:00:51.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.320+0000 7f0ba8e00640 1 -- 172.21.15.37:0/2741733000 --> [v2:172.21.15.130:6816/4148130245,v1:172.21.15.130:6817/4148130245] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0ba4105dc0 con 0x7f0b880beee0 2024-08-20T05:00:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.321+0000 7f0ba0c00640 1 -- 172.21.15.37:0/2741733000 <== osd.7 v2:172.21.15.130:6816/4148130245 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0ba4105dc0 con 0x7f0b880beee0 2024-08-20T05:00:51.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.321+0000 7f0ba8e00640 1 -- 172.21.15.37:0/2741733000 >> [v2:172.21.15.130:6816/4148130245,v1:172.21.15.130:6817/4148130245] conn(0x7f0b880beee0 msgr2=0x7f0b880c1380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.321+0000 7f0ba8e00640 1 --2- 172.21.15.37:0/2741733000 >> [v2:172.21.15.130:6816/4148130245,v1:172.21.15.130:6817/4148130245] conn(0x7f0b880beee0 0x7f0b880c1380 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.321+0000 7f0ba8e00640 1 -- 172.21.15.37:0/2741733000 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0b880b3d10 msgr2=0x7f0b880b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.321+0000 7f0ba8e00640 1 --2- 172.21.15.37:0/2741733000 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0b880b3d10 0x7f0b880b61d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c031440 tx=0x7f0b8c005b50 comp rx=0 tx=0).stop 2024-08-20T05:00:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.321+0000 7f0ba8e00640 1 -- 172.21.15.37:0/2741733000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba4104b10 msgr2=0x7f0ba419af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.321+0000 7f0ba8e00640 1 --2- 172.21.15.37:0/2741733000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba4104b10 0x7f0ba419af10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0b9400e9f0 tx=0x7f0b9400edf0 comp rx=0 tx=0).stop 2024-08-20T05:00:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.321+0000 7f0ba3e00640 1 -- 172.21.15.37:0/2741733000 reap_dead start 2024-08-20T05:00:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.322+0000 7f0ba8e00640 1 -- 172.21.15.37:0/2741733000 shutdown_connections 2024-08-20T05:00:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.322+0000 7f0ba8e00640 1 -- 172.21.15.37:0/2741733000 >> 172.21.15.37:0/2741733000 conn(0x7f0ba4100540 msgr2=0x7f0ba4102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.322+0000 7f0ba8e00640 1 -- 172.21.15.37:0/2741733000 shutdown_connections 2024-08-20T05:00:51.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:51.322+0000 7f0ba8e00640 1 -- 172.21.15.37:0/2741733000 wait complete. 2024-08-20T05:00:51.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:51 smithi037 ceph-mon[17265]: pgmap v357: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:00:51.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:51 smithi135 ceph-mon[22342]: pgmap v357: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:00:51.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:51 smithi130 ceph-mon[22007]: pgmap v357: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:00:52.110 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:52.116 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:52.120 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:52.165 INFO:teuthology.orchestra.run.smithi037.stdout:223338299441 2024-08-20T05:00:52.166 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-08-20T05:00:52.839 INFO:teuthology.orchestra.run.smithi037.stdout:201863462966 2024-08-20T05:00:52.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-08-20T05:00:53.392 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:53.393 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:53.393 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:53.408 INFO:teuthology.orchestra.run.smithi037.stdout:133143986246 2024-08-20T05:00:53.408 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-20T05:00:53.658 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:53 smithi037 ceph-mon[17265]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:00:53.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:53 smithi135 ceph-mon[22342]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:00:53.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:53 smithi130 ceph-mon[22007]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:00:54.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.116+0000 7f935da00640 1 -- 172.21.15.37:0/4149184776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9358108e40 msgr2=0x7f935810f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:54.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.116+0000 7f935da00640 1 --2- 172.21.15.37:0/4149184776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9358108e40 0x7f935810f640 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9350009ca0 tx=0x7f935002a8c0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.116+0000 7f935da00640 1 -- 172.21.15.37:0/4149184776 shutdown_connections 2024-08-20T05:00:54.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.116+0000 7f935da00640 1 --2- 172.21.15.37:0/4149184776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9358108e40 0x7f935810f640 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.116+0000 7f935da00640 1 --2- 172.21.15.37:0/4149184776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93581084c0 0x7f9358108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.116+0000 7f935da00640 1 --2- 172.21.15.37:0/4149184776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9358102ab0 0x7f9358102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.116+0000 7f935da00640 1 -- 172.21.15.37:0/4149184776 >> 172.21.15.37:0/4149184776 conn(0x7f93580fe500 msgr2=0x7f9358100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:54.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.116+0000 7f935da00640 1 -- 172.21.15.37:0/4149184776 shutdown_connections 2024-08-20T05:00:54.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.116+0000 7f935da00640 1 -- 172.21.15.37:0/4149184776 wait complete. 2024-08-20T05:00:54.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.117+0000 7f935da00640 1 Processor -- start 2024-08-20T05:00:54.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.118+0000 7f935da00640 1 -- start start 2024-08-20T05:00:54.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.118+0000 7f935da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9358102ab0 0x7f93580751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:54.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.118+0000 7f935da00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93581084c0 0x7f9358075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:54.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.118+0000 7f935da00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9358108e40 0x7f9358075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:54.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.118+0000 7f935da00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9358112b10 con 0x7f9358102ab0 2024-08-20T05:00:54.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.118+0000 7f935da00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9358112990 con 0x7f93581084c0 2024-08-20T05:00:54.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.118+0000 7f935da00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9358112c90 con 0x7f9358108e40 2024-08-20T05:00:54.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.118+0000 7f9356000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93581084c0 0x7f9358075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:54.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.118+0000 7f9356000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93581084c0 0x7f9358075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42632/0 (socket says 172.21.15.37:42632) 2024-08-20T05:00:54.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.118+0000 7f9356000640 1 -- 172.21.15.37:0/2538598271 learned_addr learned my addr 172.21.15.37:0/2538598271 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:54.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.118+0000 7f9356a00640 1 --2- 172.21.15.37:0/2538598271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9358102ab0 0x7f93580751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:54.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.118+0000 7f9357400640 1 --2- 172.21.15.37:0/2538598271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9358108e40 0x7f9358075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:54.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.119+0000 7f9356000640 1 -- 172.21.15.37:0/2538598271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9358108e40 msgr2=0x7f9358075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:54.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.119+0000 7f9356000640 1 --2- 172.21.15.37:0/2538598271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9358108e40 0x7f9358075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.119+0000 7f9356000640 1 -- 172.21.15.37:0/2538598271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9358102ab0 msgr2=0x7f93580751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:54.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.119+0000 7f9356000640 1 --2- 172.21.15.37:0/2538598271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9358102ab0 0x7f93580751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.119+0000 7f9356000640 1 -- 172.21.15.37:0/2538598271 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93581a7360 con 0x7f93581084c0 2024-08-20T05:00:54.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.119+0000 7f9356000640 1 --2- 172.21.15.37:0/2538598271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93581084c0 0x7f9358075710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f934400e9f0 tx=0x7f934400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:54.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.119+0000 7f934f400640 1 -- 172.21.15.37:0/2538598271 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934400cd80 con 0x7f93581084c0 2024-08-20T05:00:54.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.120+0000 7f934f400640 1 -- 172.21.15.37:0/2538598271 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93440108e0 con 0x7f93581084c0 2024-08-20T05:00:54.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.120+0000 7f935da00640 1 -- 172.21.15.37:0/2538598271 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93581a7650 con 0x7f93581084c0 2024-08-20T05:00:54.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.120+0000 7f934f400640 1 -- 172.21.15.37:0/2538598271 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344018980 con 0x7f93581084c0 2024-08-20T05:00:54.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.120+0000 7f935da00640 1 -- 172.21.15.37:0/2538598271 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93581a7b90 con 0x7f93581084c0 2024-08-20T05:00:54.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.121+0000 7f935da00640 1 -- 172.21.15.37:0/2538598271 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9358102e90 con 0x7f93581084c0 2024-08-20T05:00:54.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.124+0000 7f934f400640 1 -- 172.21.15.37:0/2538598271 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f9344010430 con 0x7f93581084c0 2024-08-20T05:00:54.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.126+0000 7f934f400640 1 --2- 172.21.15.37:0/2538598271 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f933c0b3c60 0x7f933c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:54.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.126+0000 7f934f400640 1 -- 172.21.15.37:0/2538598271 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f93440e4730 con 0x7f93581084c0 2024-08-20T05:00:54.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.126+0000 7f934f400640 1 -- 172.21.15.37:0/2538598271 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f93440ab2a0 con 0x7f93581084c0 2024-08-20T05:00:54.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.127+0000 7f9356a00640 1 --2- 172.21.15.37:0/2538598271 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f933c0b3c60 0x7f933c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:54.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.127+0000 7f9356a00640 1 --2- 172.21.15.37:0/2538598271 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f933c0b3c60 0x7f933c0b6120 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9348009bd0 tx=0x7f9348005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:54.141 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:54.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.335+0000 7f935da00640 1 -- 172.21.15.37:0/2538598271 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f935802e340 con 0x7f93581084c0 2024-08-20T05:00:54.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.336+0000 7f934f400640 1 -- 172.21.15.37:0/2538598271 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f93440af7f0 con 0x7f93581084c0 2024-08-20T05:00:54.338 INFO:teuthology.orchestra.run.smithi037.stdout:77309411411 2024-08-20T05:00:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.338+0000 7f935da00640 1 -- 172.21.15.37:0/2538598271 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f933c0b3c60 msgr2=0x7f933c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.338+0000 7f935da00640 1 --2- 172.21.15.37:0/2538598271 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f933c0b3c60 0x7f933c0b6120 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9348009bd0 tx=0x7f9348005f90 comp rx=0 tx=0).stop 2024-08-20T05:00:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.338+0000 7f935da00640 1 -- 172.21.15.37:0/2538598271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93581084c0 msgr2=0x7f9358075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.338+0000 7f935da00640 1 --2- 172.21.15.37:0/2538598271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93581084c0 0x7f9358075710 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f934400e9f0 tx=0x7f934400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.338+0000 7f935da00640 1 -- 172.21.15.37:0/2538598271 shutdown_connections 2024-08-20T05:00:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.338+0000 7f935da00640 1 --2- 172.21.15.37:0/2538598271 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f933c0b3c60 0x7f933c0b6120 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.338+0000 7f935da00640 1 --2- 172.21.15.37:0/2538598271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9358108e40 0x7f9358075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.338+0000 7f935da00640 1 --2- 172.21.15.37:0/2538598271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93581084c0 0x7f9358075710 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.338+0000 7f935da00640 1 --2- 172.21.15.37:0/2538598271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9358102ab0 0x7f93580751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.338+0000 7f935da00640 1 -- 172.21.15.37:0/2538598271 >> 172.21.15.37:0/2538598271 conn(0x7f93580fe500 msgr2=0x7f93580fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.339+0000 7f935da00640 1 -- 172.21.15.37:0/2538598271 shutdown_connections 2024-08-20T05:00:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.339+0000 7f935da00640 1 -- 172.21.15.37:0/2538598271 wait complete. 2024-08-20T05:00:54.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.387+0000 7f206fe00640 1 -- 172.21.15.37:0/2884681400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2070108330 msgr2=0x7f2070108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:54.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.387+0000 7f206fe00640 1 --2- 172.21.15.37:0/2884681400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2070108330 0x7f2070108770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2058009900 tx=0x7f205802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.387+0000 7f206fe00640 1 -- 172.21.15.37:0/2884681400 shutdown_connections 2024-08-20T05:00:54.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.387+0000 7f206fe00640 1 --2- 172.21.15.37:0/2884681400 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2070108cb0 0x7f207010f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.387+0000 7f206fe00640 1 --2- 172.21.15.37:0/2884681400 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2070108330 0x7f2070108770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.387+0000 7f206fe00640 1 --2- 172.21.15.37:0/2884681400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2070102920 0x7f2070102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.387+0000 7f206fe00640 1 -- 172.21.15.37:0/2884681400 >> 172.21.15.37:0/2884681400 conn(0x7f20700fe350 msgr2=0x7f2070100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:54.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.388+0000 7f206fe00640 1 -- 172.21.15.37:0/2884681400 shutdown_connections 2024-08-20T05:00:54.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.388+0000 7f206fe00640 1 -- 172.21.15.37:0/2884681400 wait complete. 2024-08-20T05:00:54.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.389+0000 7f206fe00640 1 Processor -- start 2024-08-20T05:00:54.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.390+0000 7f206fe00640 1 -- start start 2024-08-20T05:00:54.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.390+0000 7f206fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2070102920 0x7f207019af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:54.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.390+0000 7f206fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2070108330 0x7f207019b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:54.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.390+0000 7f206fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2070108cb0 0x7f20701a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:54.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.390+0000 7f206fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2070112980 con 0x7f2070102920 2024-08-20T05:00:54.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.390+0000 7f206fe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2070112800 con 0x7f2070108cb0 2024-08-20T05:00:54.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.390+0000 7f206fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2070112b00 con 0x7f2070108330 2024-08-20T05:00:54.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.391+0000 7f206f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2070108cb0 0x7f20701a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:54.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.391+0000 7f206f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2070108cb0 0x7f20701a0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42638/0 (socket says 172.21.15.37:42638) 2024-08-20T05:00:54.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.391+0000 7f206f400640 1 -- 172.21.15.37:0/1357589655 learned_addr learned my addr 172.21.15.37:0/1357589655 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:54.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.391+0000 7f206ea00640 1 --2- 172.21.15.37:0/1357589655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2070102920 0x7f207019af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:54.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.392+0000 7f206e000640 1 --2- 172.21.15.37:0/1357589655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2070108330 0x7f207019b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:54.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.392+0000 7f206f400640 1 -- 172.21.15.37:0/1357589655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2070108330 msgr2=0x7f207019b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:54.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.392+0000 7f206f400640 1 --2- 172.21.15.37:0/1357589655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2070108330 0x7f207019b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.392+0000 7f206f400640 1 -- 172.21.15.37:0/1357589655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2070102920 msgr2=0x7f207019af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:54.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.392+0000 7f206f400640 1 --2- 172.21.15.37:0/1357589655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2070102920 0x7f207019af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.392+0000 7f206f400640 1 -- 172.21.15.37:0/1357589655 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20701a0fd0 con 0x7f2070108cb0 2024-08-20T05:00:54.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.393+0000 7f206f400640 1 --2- 172.21.15.37:0/1357589655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2070108cb0 0x7f20701a0800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f206800cad0 tx=0x7f206800cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:54.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.393+0000 7f2074a00640 1 -- 172.21.15.37:0/1357589655 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206800ae20 con 0x7f2070108cb0 2024-08-20T05:00:54.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.393+0000 7f206fe00640 1 -- 172.21.15.37:0/1357589655 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20701a12c0 con 0x7f2070108cb0 2024-08-20T05:00:54.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.393+0000 7f206fe00640 1 -- 172.21.15.37:0/1357589655 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2070109550 con 0x7f2070108cb0 2024-08-20T05:00:54.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.393+0000 7f2074a00640 1 -- 172.21.15.37:0/1357589655 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2068005020 con 0x7f2070108cb0 2024-08-20T05:00:54.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.393+0000 7f2074a00640 1 -- 172.21.15.37:0/1357589655 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f206800f690 con 0x7f2070108cb0 2024-08-20T05:00:54.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.394+0000 7f206fe00640 1 -- 172.21.15.37:0/1357589655 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f204c005290 con 0x7f2070108cb0 2024-08-20T05:00:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.398+0000 7f2074a00640 1 -- 172.21.15.37:0/1357589655 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f2068004a40 con 0x7f2070108cb0 2024-08-20T05:00:54.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.400+0000 7f2074a00640 1 --2- 172.21.15.37:0/1357589655 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20540b3d90 0x7f20540b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:54.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.400+0000 7f2074a00640 1 -- 172.21.15.37:0/1357589655 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f20680e4310 con 0x7f2070108cb0 2024-08-20T05:00:54.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.400+0000 7f206ea00640 1 --2- 172.21.15.37:0/1357589655 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20540b3d90 0x7f20540b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:54.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.400+0000 7f2074a00640 1 -- 172.21.15.37:0/1357589655 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f2068014030 con 0x7f2070108cb0 2024-08-20T05:00:54.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.401+0000 7f206ea00640 1 --2- 172.21.15.37:0/1357589655 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20540b3d90 0x7f20540b6250 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f20600095f0 tx=0x7f2060005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:54.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.597+0000 7f206fe00640 1 -- 172.21.15.37:0/1357589655 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f204c005850 con 0x7f2070108cb0 2024-08-20T05:00:54.599 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:54 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2538598271' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-20T05:00:54.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.597+0000 7f2074a00640 1 -- 172.21.15.37:0/1357589655 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f20680ab500 con 0x7f2070108cb0 2024-08-20T05:00:54.599 INFO:teuthology.orchestra.run.smithi037.stdout:180388626493 2024-08-20T05:00:54.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.600+0000 7f206fe00640 1 -- 172.21.15.37:0/1357589655 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20540b3d90 msgr2=0x7f20540b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:54.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.600+0000 7f206fe00640 1 --2- 172.21.15.37:0/1357589655 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20540b3d90 0x7f20540b6250 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f20600095f0 tx=0x7f2060005f90 comp rx=0 tx=0).stop 2024-08-20T05:00:54.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.600+0000 7f206fe00640 1 -- 172.21.15.37:0/1357589655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2070108cb0 msgr2=0x7f20701a0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:54.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.600+0000 7f206fe00640 1 --2- 172.21.15.37:0/1357589655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2070108cb0 0x7f20701a0800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f206800cad0 tx=0x7f206800cf90 comp rx=0 tx=0).stop 2024-08-20T05:00:54.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.600+0000 7f206fe00640 1 -- 172.21.15.37:0/1357589655 shutdown_connections 2024-08-20T05:00:54.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.600+0000 7f206fe00640 1 --2- 172.21.15.37:0/1357589655 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20540b3d90 0x7f20540b6250 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.600+0000 7f206fe00640 1 --2- 172.21.15.37:0/1357589655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2070108cb0 0x7f20701a0800 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.600+0000 7f206fe00640 1 --2- 172.21.15.37:0/1357589655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2070108330 0x7f207019b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.600+0000 7f206fe00640 1 --2- 172.21.15.37:0/1357589655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2070102920 0x7f207019af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.600+0000 7f206fe00640 1 -- 172.21.15.37:0/1357589655 >> 172.21.15.37:0/1357589655 conn(0x7f20700fe350 msgr2=0x7f2070105910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.600+0000 7f206fe00640 1 -- 172.21.15.37:0/1357589655 shutdown_connections 2024-08-20T05:00:54.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:54.600+0000 7f206fe00640 1 -- 172.21.15.37:0/1357589655 wait complete. 2024-08-20T05:00:54.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:54 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2538598271' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-20T05:00:54.889 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:54.891 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:54.892 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:00:54.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:54 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2538598271' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-08-20T05:00:55.626 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:55 smithi037 ceph-mon[17265]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:00:55.626 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:55 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1357589655' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-20T05:00:55.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:55 smithi135 ceph-mon[22342]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:00:55.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:55 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1357589655' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-20T05:00:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:55 smithi130 ceph-mon[22007]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:00:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:55 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1357589655' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-08-20T05:00:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.990+0000 7faa72400640 1 -- 172.21.15.37:0/875160847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c10f0c0 msgr2=0x7faa6c1114b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.990+0000 7faa72400640 1 --2- 172.21.15.37:0/875160847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c10f0c0 0x7faa6c1114b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faa64009ca0 tx=0x7faa6402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:00:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.990+0000 7faa72400640 1 -- 172.21.15.37:0/875160847 shutdown_connections 2024-08-20T05:00:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.990+0000 7faa72400640 1 --2- 172.21.15.37:0/875160847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c10f0c0 0x7faa6c1114b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.990+0000 7faa72400640 1 --2- 172.21.15.37:0/875160847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa6c075b10 0x7faa6c10eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.990+0000 7faa72400640 1 --2- 172.21.15.37:0/875160847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa6c0751f0 0x7faa6c0755d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.990+0000 7faa72400640 1 -- 172.21.15.37:0/875160847 >> 172.21.15.37:0/875160847 conn(0x7faa6c0fe500 msgr2=0x7faa6c100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.990+0000 7faa72400640 1 -- 172.21.15.37:0/875160847 shutdown_connections 2024-08-20T05:00:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.990+0000 7faa72400640 1 -- 172.21.15.37:0/875160847 wait complete. 2024-08-20T05:00:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.991+0000 7faa72400640 1 Processor -- start 2024-08-20T05:00:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.991+0000 7faa72400640 1 -- start start 2024-08-20T05:00:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.991+0000 7faa72400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa6c0751f0 0x7faa6c19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.991+0000 7faa72400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c075b10 0x7faa6c19b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.992+0000 7faa72400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa6c10f0c0 0x7faa6c1a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.992+0000 7faa72400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c114cf0 con 0x7faa6c075b10 2024-08-20T05:00:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.992+0000 7faa72400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c114b70 con 0x7faa6c10f0c0 2024-08-20T05:00:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.992+0000 7faa72400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c114e70 con 0x7faa6c0751f0 2024-08-20T05:00:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.992+0000 7faa6aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c075b10 0x7faa6c19b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.992+0000 7faa6aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c075b10 0x7faa6c19b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52896/0 (socket says 172.21.15.37:52896) 2024-08-20T05:00:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.992+0000 7faa6aa00640 1 -- 172.21.15.37:0/2033761486 learned_addr learned my addr 172.21.15.37:0/2033761486 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.992+0000 7faa6b400640 1 --2- 172.21.15.37:0/2033761486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa6c0751f0 0x7faa6c19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.992+0000 7faa6be00640 1 --2- 172.21.15.37:0/2033761486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa6c10f0c0 0x7faa6c1a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.992+0000 7faa6aa00640 1 -- 172.21.15.37:0/2033761486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa6c0751f0 msgr2=0x7faa6c19b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.992+0000 7faa6aa00640 1 --2- 172.21.15.37:0/2033761486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa6c0751f0 0x7faa6c19b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.992+0000 7faa6aa00640 1 -- 172.21.15.37:0/2033761486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa6c10f0c0 msgr2=0x7faa6c1a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.992+0000 7faa6aa00640 1 --2- 172.21.15.37:0/2033761486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa6c10f0c0 0x7faa6c1a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.992+0000 7faa6aa00640 1 -- 172.21.15.37:0/2033761486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c1a1250 con 0x7faa6c075b10 2024-08-20T05:00:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.993+0000 7faa6aa00640 1 --2- 172.21.15.37:0/2033761486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c075b10 0x7faa6c19b6e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faa5800ea60 tx=0x7faa5800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.993+0000 7faa63e00640 1 -- 172.21.15.37:0/2033761486 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa5800cde0 con 0x7faa6c075b10 2024-08-20T05:00:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.993+0000 7faa63e00640 1 -- 172.21.15.37:0/2033761486 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa580035f0 con 0x7faa6c075b10 2024-08-20T05:00:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.993+0000 7faa72400640 1 -- 172.21.15.37:0/2033761486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6c1a1540 con 0x7faa6c075b10 2024-08-20T05:00:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.993+0000 7faa63e00640 1 -- 172.21.15.37:0/2033761486 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa58010690 con 0x7faa6c075b10 2024-08-20T05:00:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.993+0000 7faa72400640 1 -- 172.21.15.37:0/2033761486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa6c1a7dd0 con 0x7faa6c075b10 2024-08-20T05:00:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.994+0000 7faa72400640 1 -- 172.21.15.37:0/2033761486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa6c0755d0 con 0x7faa6c075b10 2024-08-20T05:00:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.998+0000 7faa63e00640 1 -- 172.21.15.37:0/2033761486 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7faa580037a0 con 0x7faa6c075b10 2024-08-20T05:00:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.000+0000 7faa63e00640 1 --2- 172.21.15.37:0/2033761486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faa500b3ce0 0x7faa500b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.000+0000 7faa63e00640 1 -- 172.21.15.37:0/2033761486 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7faa580e4380 con 0x7faa6c075b10 2024-08-20T05:00:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.000+0000 7faa6b400640 1 --2- 172.21.15.37:0/2033761486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faa500b3ce0 0x7faa500b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.001+0000 7faa6b400640 1 --2- 172.21.15.37:0/2033761486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faa500b3ce0 0x7faa500b61a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faa5c009bd0 tx=0x7faa5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.004+0000 7faa63e00640 1 -- 172.21.15.37:0/2033761486 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7faa580ab4b0 con 0x7faa6c075b10 2024-08-20T05:00:56.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.204+0000 7faa72400640 1 -- 172.21.15.37:0/2033761486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7faa6c1a8050 con 0x7faa6c075b10 2024-08-20T05:00:56.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.204+0000 7faa63e00640 1 -- 172.21.15.37:0/2033761486 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa580aadb0 con 0x7faa6c075b10 2024-08-20T05:00:56.206 INFO:teuthology.orchestra.run.smithi037.stdout:55834574934 2024-08-20T05:00:56.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.206+0000 7faa72400640 1 -- 172.21.15.37:0/2033761486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faa500b3ce0 msgr2=0x7faa500b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:56.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.206+0000 7faa72400640 1 --2- 172.21.15.37:0/2033761486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faa500b3ce0 0x7faa500b61a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faa5c009bd0 tx=0x7faa5c005f90 comp rx=0 tx=0).stop 2024-08-20T05:00:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.206+0000 7faa72400640 1 -- 172.21.15.37:0/2033761486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c075b10 msgr2=0x7faa6c19b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.206+0000 7faa72400640 1 --2- 172.21.15.37:0/2033761486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c075b10 0x7faa6c19b6e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7faa5800ea60 tx=0x7faa5800ef20 comp rx=0 tx=0).stop 2024-08-20T05:00:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.206+0000 7faa72400640 1 -- 172.21.15.37:0/2033761486 shutdown_connections 2024-08-20T05:00:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.206+0000 7faa72400640 1 --2- 172.21.15.37:0/2033761486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faa500b3ce0 0x7faa500b61a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.206+0000 7faa72400640 1 --2- 172.21.15.37:0/2033761486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faa6c10f0c0 0x7faa6c1a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.206+0000 7faa72400640 1 --2- 172.21.15.37:0/2033761486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa6c075b10 0x7faa6c19b6e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.206+0000 7faa72400640 1 --2- 172.21.15.37:0/2033761486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faa6c0751f0 0x7faa6c19b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.206+0000 7faa72400640 1 -- 172.21.15.37:0/2033761486 >> 172.21.15.37:0/2033761486 conn(0x7faa6c0fe500 msgr2=0x7faa6c111260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.206+0000 7faa72400640 1 -- 172.21.15.37:0/2033761486 shutdown_connections 2024-08-20T05:00:56.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.207+0000 7faa72400640 1 -- 172.21.15.37:0/2033761486 wait complete. 2024-08-20T05:00:56.740 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:56 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2555298494' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-20T05:00:56.740 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:56 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2033761486' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-20T05:00:56.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:56 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2555298494' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-20T05:00:56.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:56 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2033761486' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-20T05:00:56.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:56 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2555298494' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-08-20T05:00:56.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:56 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2033761486' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-08-20T05:00:57.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.437+0000 7fac6f200640 1 -- 172.21.15.37:0/2036122921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac68075210 msgr2=0x7fac680755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:57.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.437+0000 7fac6f200640 1 --2- 172.21.15.37:0/2036122921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac68075210 0x7fac680755f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fac5c009860 tx=0x7fac5c02a340 comp rx=0 tx=0).stop 2024-08-20T05:00:57.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.437+0000 7fac6f200640 1 -- 172.21.15.37:0/2036122921 shutdown_connections 2024-08-20T05:00:57.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.437+0000 7fac6f200640 1 --2- 172.21.15.37:0/2036122921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac6810ef10 0x7fac68111300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:57.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.437+0000 7fac6f200640 1 --2- 172.21.15.37:0/2036122921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac68075b30 0x7fac6810e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:57.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.437+0000 7fac6f200640 1 --2- 172.21.15.37:0/2036122921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac68075210 0x7fac680755f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:57.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.437+0000 7fac6f200640 1 -- 172.21.15.37:0/2036122921 >> 172.21.15.37:0/2036122921 conn(0x7fac680fe350 msgr2=0x7fac68100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:57.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.437+0000 7fac6f200640 1 -- 172.21.15.37:0/2036122921 shutdown_connections 2024-08-20T05:00:57.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.437+0000 7fac6f200640 1 -- 172.21.15.37:0/2036122921 wait complete. 2024-08-20T05:00:57.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.438+0000 7fac6f200640 1 Processor -- start 2024-08-20T05:00:57.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.438+0000 7fac6f200640 1 -- start start 2024-08-20T05:00:57.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.439+0000 7fac6f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac68075210 0x7fac6819af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:57.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.439+0000 7fac6f200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac68075b30 0x7fac6819b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:57.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.439+0000 7fac6f200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac6810ef10 0x7fac681a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:57.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.439+0000 7fac6f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fac68114af0 con 0x7fac68075210 2024-08-20T05:00:57.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.439+0000 7fac6f200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fac68114970 con 0x7fac6810ef10 2024-08-20T05:00:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.439+0000 7fac6f200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fac68114c70 con 0x7fac68075b30 2024-08-20T05:00:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.439+0000 7fac6de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac68075210 0x7fac6819af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.439+0000 7fac6de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac68075210 0x7fac6819af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52942/0 (socket says 172.21.15.37:52942) 2024-08-20T05:00:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.439+0000 7fac6de00640 1 -- 172.21.15.37:0/2565907881 learned_addr learned my addr 172.21.15.37:0/2565907881 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.439+0000 7fac6d400640 1 --2- 172.21.15.37:0/2565907881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac68075b30 0x7fac6819b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.439+0000 7fac6e800640 1 --2- 172.21.15.37:0/2565907881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac6810ef10 0x7fac681a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.439+0000 7fac6de00640 1 -- 172.21.15.37:0/2565907881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac68075b30 msgr2=0x7fac6819b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.439+0000 7fac6de00640 1 --2- 172.21.15.37:0/2565907881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac68075b30 0x7fac6819b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.439+0000 7fac6de00640 1 -- 172.21.15.37:0/2565907881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac6810ef10 msgr2=0x7fac681a0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.439+0000 7fac6de00640 1 --2- 172.21.15.37:0/2565907881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac6810ef10 0x7fac681a0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.439+0000 7fac6de00640 1 -- 172.21.15.37:0/2565907881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac681a0ff0 con 0x7fac68075210 2024-08-20T05:00:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.439+0000 7fac6d400640 1 --2- 172.21.15.37:0/2565907881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac68075b30 0x7fac6819b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:00:57.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.440+0000 7fac6de00640 1 --2- 172.21.15.37:0/2565907881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac68075210 0x7fac6819af40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fac5c035040 tx=0x7fac5c032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:57.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.440+0000 7fac62a00640 1 -- 172.21.15.37:0/2565907881 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5c037040 con 0x7fac68075210 2024-08-20T05:00:57.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.440+0000 7fac6f200640 1 -- 172.21.15.37:0/2565907881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac681a1280 con 0x7fac68075210 2024-08-20T05:00:57.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.440+0000 7fac62a00640 1 -- 172.21.15.37:0/2565907881 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac5c041070 con 0x7fac68075210 2024-08-20T05:00:57.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.440+0000 7fac62a00640 1 -- 172.21.15.37:0/2565907881 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5c003850 con 0x7fac68075210 2024-08-20T05:00:57.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.440+0000 7fac6f200640 1 -- 172.21.15.37:0/2565907881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac681a79a0 con 0x7fac68075210 2024-08-20T05:00:57.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.441+0000 7fac6f200640 1 -- 172.21.15.37:0/2565907881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac680755f0 con 0x7fac68075210 2024-08-20T05:00:57.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.443+0000 7fac62a00640 1 -- 172.21.15.37:0/2565907881 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fac5c0039f0 con 0x7fac68075210 2024-08-20T05:00:57.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.445+0000 7fac62a00640 1 --2- 172.21.15.37:0/2565907881 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fac500b3d10 0x7fac500b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:57.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.445+0000 7fac62a00640 1 -- 172.21.15.37:0/2565907881 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fac5c103b80 con 0x7fac68075210 2024-08-20T05:00:57.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.445+0000 7fac6d400640 1 --2- 172.21.15.37:0/2565907881 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fac500b3d10 0x7fac500b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:57.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.446+0000 7fac6d400640 1 --2- 172.21.15.37:0/2565907881 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fac500b3d10 0x7fac500b61d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fac580096c0 tx=0x7fac58009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:57.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.449+0000 7fac62a00640 1 -- 172.21.15.37:0/2565907881 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fac5c0cadc0 con 0x7fac68075210 2024-08-20T05:00:57.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:57 smithi037 ceph-mon[17265]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:00:57.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:57 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3119859583' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-20T05:00:57.571 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:57 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3810958237' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-20T05:00:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.647+0000 7fac6f200640 1 -- 172.21.15.37:0/2565907881 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fac681a7bd0 con 0x7fac68075210 2024-08-20T05:00:57.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.647+0000 7fac62a00640 1 -- 172.21.15.37:0/2565907881 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fac5c0ca6c0 con 0x7fac68075210 2024-08-20T05:00:57.649 INFO:teuthology.orchestra.run.smithi037.stdout:296352743459 2024-08-20T05:00:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.649+0000 7fac6f200640 1 -- 172.21.15.37:0/2565907881 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fac500b3d10 msgr2=0x7fac500b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:57.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.649+0000 7fac6f200640 1 --2- 172.21.15.37:0/2565907881 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fac500b3d10 0x7fac500b61d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fac580096c0 tx=0x7fac58009260 comp rx=0 tx=0).stop 2024-08-20T05:00:57.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.649+0000 7fac6f200640 1 -- 172.21.15.37:0/2565907881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac68075210 msgr2=0x7fac6819af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:57.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.649+0000 7fac6f200640 1 --2- 172.21.15.37:0/2565907881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac68075210 0x7fac6819af40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fac5c035040 tx=0x7fac5c032d50 comp rx=0 tx=0).stop 2024-08-20T05:00:57.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.650+0000 7fac6f200640 1 -- 172.21.15.37:0/2565907881 shutdown_connections 2024-08-20T05:00:57.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.650+0000 7fac6f200640 1 --2- 172.21.15.37:0/2565907881 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fac500b3d10 0x7fac500b61d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:57.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.650+0000 7fac6f200640 1 --2- 172.21.15.37:0/2565907881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fac6810ef10 0x7fac681a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:57.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.650+0000 7fac6f200640 1 --2- 172.21.15.37:0/2565907881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fac68075b30 0x7fac6819b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:57.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.650+0000 7fac6f200640 1 --2- 172.21.15.37:0/2565907881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac68075210 0x7fac6819af40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:57.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.650+0000 7fac6f200640 1 -- 172.21.15.37:0/2565907881 >> 172.21.15.37:0/2565907881 conn(0x7fac680fe350 msgr2=0x7fac68111070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:57.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.650+0000 7fac6f200640 1 -- 172.21.15.37:0/2565907881 shutdown_connections 2024-08-20T05:00:57.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.650+0000 7fac6f200640 1 -- 172.21.15.37:0/2565907881 wait complete. 2024-08-20T05:00:57.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:57 smithi135 ceph-mon[22342]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:00:57.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:57 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3119859583' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-20T05:00:57.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:57 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3810958237' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-20T05:00:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:57 smithi130 ceph-mon[22007]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:00:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:57 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3119859583' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-08-20T05:00:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:57 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3810958237' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-08-20T05:00:58.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:58 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2565907881' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-20T05:00:58.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:58 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2565907881' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-20T05:00:58.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:58 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2565907881' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-08-20T05:00:59.066 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626491 got 180388626493 for osd.6 2024-08-20T05:00:59.066 DEBUG:teuthology.parallel:result is None 2024-08-20T05:00:59.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.838+0000 7f99c6a00640 1 -- 172.21.15.37:0/644549380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c0104130 msgr2=0x7f99c010c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.838+0000 7f99c6a00640 1 --2- 172.21.15.37:0/644549380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c0104130 0x7f99c010c620 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f99ac009900 tx=0x7f99ac02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:00:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.838+0000 7f99c6a00640 1 -- 172.21.15.37:0/644549380 shutdown_connections 2024-08-20T05:00:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.838+0000 7f99c6a00640 1 --2- 172.21.15.37:0/644549380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99c010cc70 0x7f99c010f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.838+0000 7f99c6a00640 1 --2- 172.21.15.37:0/644549380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c0104130 0x7f99c010c620 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.838+0000 7f99c6a00640 1 --2- 172.21.15.37:0/644549380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c0103810 0x7f99c0103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.838+0000 7f99c6a00640 1 -- 172.21.15.37:0/644549380 >> 172.21.15.37:0/644549380 conn(0x7f99c00fd2d0 msgr2=0x7f99c00ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.838+0000 7f99c6a00640 1 -- 172.21.15.37:0/644549380 shutdown_connections 2024-08-20T05:00:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.838+0000 7f99c6a00640 1 -- 172.21.15.37:0/644549380 wait complete. 2024-08-20T05:00:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.839+0000 7f99c6a00640 1 Processor -- start 2024-08-20T05:00:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.840+0000 7f99c6a00640 1 -- start start 2024-08-20T05:00:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.840+0000 7f99c6a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99c0103810 0x7f99c019af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.840+0000 7f99c6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c0104130 0x7f99c019b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.840+0000 7f99c6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c010cc70 0x7f99c01a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.840+0000 7f99c6a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0112930 con 0x7f99c0104130 2024-08-20T05:00:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.840+0000 7f99c6a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99c01127b0 con 0x7f99c0103810 2024-08-20T05:00:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.840+0000 7f99c6a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0112ab0 con 0x7f99c010cc70 2024-08-20T05:00:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.840+0000 7f99c4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c0104130 0x7f99c019b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.840+0000 7f99c4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c0104130 0x7f99c019b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52880/0 (socket says 172.21.15.37:52880) 2024-08-20T05:00:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.840+0000 7f99c4c00640 1 -- 172.21.15.37:0/2555298494 learned_addr learned my addr 172.21.15.37:0/2555298494 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:00:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.840+0000 7f99c6000640 1 --2- 172.21.15.37:0/2555298494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c010cc70 0x7f99c01a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.840+0000 7f99c5600640 1 --2- 172.21.15.37:0/2555298494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99c0103810 0x7f99c019af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.841+0000 7f99c6000640 1 -- 172.21.15.37:0/2555298494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99c0103810 msgr2=0x7f99c019af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.841+0000 7f99c6000640 1 --2- 172.21.15.37:0/2555298494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99c0103810 0x7f99c019af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.841+0000 7f99c6000640 1 -- 172.21.15.37:0/2555298494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c0104130 msgr2=0x7f99c019b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.841+0000 7f99c6000640 1 --2- 172.21.15.37:0/2555298494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c0104130 0x7f99c019b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.841+0000 7f99c6000640 1 -- 172.21.15.37:0/2555298494 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c01a1010 con 0x7f99c010cc70 2024-08-20T05:00:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.841+0000 7f99c6000640 1 --2- 172.21.15.37:0/2555298494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c010cc70 0x7f99c01a0840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009fd0 tx=0x7f99b800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.841+0000 7f99be000640 1 -- 172.21.15.37:0/2555298494 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b800ce20 con 0x7f99c010cc70 2024-08-20T05:00:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.841+0000 7f99c6a00640 1 -- 172.21.15.37:0/2555298494 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c01a1300 con 0x7f99c010cc70 2024-08-20T05:00:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.841+0000 7f99be000640 1 -- 172.21.15.37:0/2555298494 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99b8005020 con 0x7f99c010cc70 2024-08-20T05:00:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.841+0000 7f99be000640 1 -- 172.21.15.37:0/2555298494 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b8010690 con 0x7f99c010cc70 2024-08-20T05:00:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.842+0000 7f99c6a00640 1 -- 172.21.15.37:0/2555298494 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c01a79c0 con 0x7f99c010cc70 2024-08-20T05:00:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.843+0000 7f99c6a00640 1 -- 172.21.15.37:0/2555298494 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c0103bf0 con 0x7f99c010cc70 2024-08-20T05:00:59.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.845+0000 7f99be000640 1 -- 172.21.15.37:0/2555298494 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f99b80054d0 con 0x7f99c010cc70 2024-08-20T05:00:59.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.846+0000 7f99be000640 1 --2- 172.21.15.37:0/2555298494 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99a80b3d10 0x7f99a80b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:00:59.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.847+0000 7f99be000640 1 -- 172.21.15.37:0/2555298494 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f99b80e47c0 con 0x7f99c010cc70 2024-08-20T05:00:59.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.847+0000 7f99c5600640 1 --2- 172.21.15.37:0/2555298494 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99a80b3d10 0x7f99a80b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:00:59.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.847+0000 7f99c5600640 1 --2- 172.21.15.37:0/2555298494 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99a80b3d10 0x7f99a80b61d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009bd0 tx=0x7f99b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:00:59.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:55.848+0000 7f99be000640 1 -- 172.21.15.37:0/2555298494 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f99b80ab8f0 con 0x7f99c010cc70 2024-08-20T05:00:59.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.054+0000 7f99c6a00640 1 -- 172.21.15.37:0/2555298494 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f99c01a7d20 con 0x7f99c010cc70 2024-08-20T05:00:59.398 INFO:teuthology.orchestra.run.smithi037.stdout:107374182476 2024-08-20T05:00:59.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.055+0000 7f99be000640 1 -- 172.21.15.37:0/2555298494 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f99b80ab1f0 con 0x7f99c010cc70 2024-08-20T05:00:59.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.057+0000 7f99c6a00640 1 -- 172.21.15.37:0/2555298494 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99a80b3d10 msgr2=0x7f99a80b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:59.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.057+0000 7f99c6a00640 1 --2- 172.21.15.37:0/2555298494 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99a80b3d10 0x7f99a80b61d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009bd0 tx=0x7f99b4005f90 comp rx=0 tx=0).stop 2024-08-20T05:00:59.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.057+0000 7f99c6a00640 1 -- 172.21.15.37:0/2555298494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c010cc70 msgr2=0x7f99c01a0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:00:59.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.057+0000 7f99c6a00640 1 --2- 172.21.15.37:0/2555298494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c010cc70 0x7f99c01a0840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f99b8009fd0 tx=0x7f99b800ef10 comp rx=0 tx=0).stop 2024-08-20T05:00:59.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.057+0000 7f99c6a00640 1 -- 172.21.15.37:0/2555298494 shutdown_connections 2024-08-20T05:00:59.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.057+0000 7f99c6a00640 1 --2- 172.21.15.37:0/2555298494 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99a80b3d10 0x7f99a80b61d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:59.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.057+0000 7f99c6a00640 1 --2- 172.21.15.37:0/2555298494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f99c010cc70 0x7f99c01a0840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:59.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.057+0000 7f99c6a00640 1 --2- 172.21.15.37:0/2555298494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99c0104130 0x7f99c019b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:59.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.057+0000 7f99c6a00640 1 --2- 172.21.15.37:0/2555298494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f99c0103810 0x7f99c019af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:00:59.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.057+0000 7f99c6a00640 1 -- 172.21.15.37:0/2555298494 >> 172.21.15.37:0/2555298494 conn(0x7f99c00fd2d0 msgr2=0x7f99c01013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:00:59.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.057+0000 7f99c6a00640 1 -- 172.21.15.37:0/2555298494 shutdown_connections 2024-08-20T05:00:59.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.058+0000 7f99c6a00640 1 -- 172.21.15.37:0/2555298494 wait complete. 2024-08-20T05:00:59.699 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:59 smithi037 ceph-mon[17265]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:00:59.699 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:00:59 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3917953166' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-20T05:00:59.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:59 smithi135 ceph-mon[22342]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:00:59.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:00:59 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3917953166' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-20T05:00:59.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:59 smithi130 ceph-mon[22007]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:00:59.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:00:59 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3917953166' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-08-20T05:01:00.382 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743456 got 296352743459 for osd.11 2024-08-20T05:01:00.383 DEBUG:teuthology.parallel:result is None 2024-08-20T05:01:00.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.256+0000 7fe8b3000640 1 -- 172.21.15.37:0/1400793854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8ac108cb0 msgr2=0x7fe8ac10f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:00.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.256+0000 7fe8b3000640 1 --2- 172.21.15.37:0/1400793854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8ac108cb0 0x7fe8ac10f4b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4009ca0 tx=0x7fe8a402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:01:00.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.256+0000 7fe8b3000640 1 -- 172.21.15.37:0/1400793854 shutdown_connections 2024-08-20T05:01:00.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.256+0000 7fe8b3000640 1 --2- 172.21.15.37:0/1400793854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8ac108cb0 0x7fe8ac10f4b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:00.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.256+0000 7fe8b3000640 1 --2- 172.21.15.37:0/1400793854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8ac108330 0x7fe8ac108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:00.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.256+0000 7fe8b3000640 1 --2- 172.21.15.37:0/1400793854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8ac102920 0x7fe8ac102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:00.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.256+0000 7fe8b3000640 1 -- 172.21.15.37:0/1400793854 >> 172.21.15.37:0/1400793854 conn(0x7fe8ac0fe350 msgr2=0x7fe8ac100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:00.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.256+0000 7fe8b3000640 1 -- 172.21.15.37:0/1400793854 shutdown_connections 2024-08-20T05:01:00.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.256+0000 7fe8b3000640 1 -- 172.21.15.37:0/1400793854 wait complete. 2024-08-20T05:01:00.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.257+0000 7fe8b3000640 1 Processor -- start 2024-08-20T05:01:00.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.257+0000 7fe8b3000640 1 -- start start 2024-08-20T05:01:00.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.257+0000 7fe8b3000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8ac102920 0x7fe8ac0751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:00.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.258+0000 7fe8b3000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8ac108330 0x7fe8ac075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:00.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.258+0000 7fe8b3000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8ac108cb0 0x7fe8ac075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:00.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.258+0000 7fe8b3000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac112980 con 0x7fe8ac102920 2024-08-20T05:01:00.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.258+0000 7fe8b3000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac112800 con 0x7fe8ac108cb0 2024-08-20T05:01:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.258+0000 7fe8b3000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe8ac112b00 con 0x7fe8ac108330 2024-08-20T05:01:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.258+0000 7fe8b1c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8ac102920 0x7fe8ac0751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.258+0000 7fe8b1c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8ac102920 0x7fe8ac0751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52962/0 (socket says 172.21.15.37:52962) 2024-08-20T05:01:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.258+0000 7fe8b1c00640 1 -- 172.21.15.37:0/3917953166 learned_addr learned my addr 172.21.15.37:0/3917953166 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.258+0000 7fe8b1200640 1 --2- 172.21.15.37:0/3917953166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8ac108330 0x7fe8ac075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.258+0000 7fe8b2600640 1 --2- 172.21.15.37:0/3917953166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8ac108cb0 0x7fe8ac075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.258+0000 7fe8b1c00640 1 -- 172.21.15.37:0/3917953166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8ac108330 msgr2=0x7fe8ac075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.258+0000 7fe8b1c00640 1 --2- 172.21.15.37:0/3917953166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8ac108330 0x7fe8ac075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.258+0000 7fe8b1c00640 1 -- 172.21.15.37:0/3917953166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8ac108cb0 msgr2=0x7fe8ac075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.258+0000 7fe8b1c00640 1 --2- 172.21.15.37:0/3917953166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8ac108cb0 0x7fe8ac075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.258+0000 7fe8b1c00640 1 -- 172.21.15.37:0/3917953166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ac1a7110 con 0x7fe8ac102920 2024-08-20T05:01:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.259+0000 7fe8b1c00640 1 --2- 172.21.15.37:0/3917953166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8ac102920 0x7fe8ac0751d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000c920 tx=0x7fe8a000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.259+0000 7fe8aa000640 1 -- 172.21.15.37:0/3917953166 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0007c70 con 0x7fe8ac102920 2024-08-20T05:01:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.259+0000 7fe8aa000640 1 -- 172.21.15.37:0/3917953166 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8a0007e10 con 0x7fe8ac102920 2024-08-20T05:01:00.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.259+0000 7fe8aa000640 1 -- 172.21.15.37:0/3917953166 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0018820 con 0x7fe8ac102920 2024-08-20T05:01:00.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.259+0000 7fe8b3000640 1 -- 172.21.15.37:0/3917953166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8ac1a7400 con 0x7fe8ac102920 2024-08-20T05:01:00.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.259+0000 7fe8b3000640 1 -- 172.21.15.37:0/3917953166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8ac1a78f0 con 0x7fe8ac102920 2024-08-20T05:01:00.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.260+0000 7fe8b3000640 1 -- 172.21.15.37:0/3917953166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8ac102d00 con 0x7fe8ac102920 2024-08-20T05:01:00.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.263+0000 7fe8aa000640 1 -- 172.21.15.37:0/3917953166 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fe8a000f450 con 0x7fe8ac102920 2024-08-20T05:01:00.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.264+0000 7fe8aa000640 1 --2- 172.21.15.37:0/3917953166 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe8940b3d90 0x7fe8940b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:00.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.264+0000 7fe8aa000640 1 -- 172.21.15.37:0/3917953166 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fe8a00e4430 con 0x7fe8ac102920 2024-08-20T05:01:00.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.264+0000 7fe8b1200640 1 --2- 172.21.15.37:0/3917953166 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe8940b3d90 0x7fe8940b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:00.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.265+0000 7fe8b1200640 1 --2- 172.21.15.37:0/3917953166 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe8940b3d90 0x7fe8940b6250 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac076cc0 tx=0x7fe898005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:00.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.266+0000 7fe8aa000640 1 -- 172.21.15.37:0/3917953166 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe8a0014030 con 0x7fe8ac102920 2024-08-20T05:01:00.689 INFO:teuthology.orchestra.run.smithi037.stdout:223338299443 2024-08-20T05:01:00.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.463+0000 7fe8b3000640 1 -- 172.21.15.37:0/3917953166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fe8ac1a7cc0 con 0x7fe8ac102920 2024-08-20T05:01:00.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.463+0000 7fe8aa000640 1 -- 172.21.15.37:0/3917953166 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe8a00ab670 con 0x7fe8ac102920 2024-08-20T05:01:00.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.465+0000 7fe8b3000640 1 -- 172.21.15.37:0/3917953166 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe8940b3d90 msgr2=0x7fe8940b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:00.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.465+0000 7fe8b3000640 1 --2- 172.21.15.37:0/3917953166 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe8940b3d90 0x7fe8940b6250 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac076cc0 tx=0x7fe898005f90 comp rx=0 tx=0).stop 2024-08-20T05:01:00.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.465+0000 7fe8b3000640 1 -- 172.21.15.37:0/3917953166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8ac102920 msgr2=0x7fe8ac0751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:00.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.465+0000 7fe8b3000640 1 --2- 172.21.15.37:0/3917953166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8ac102920 0x7fe8ac0751d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe8a000c920 tx=0x7fe8a000cde0 comp rx=0 tx=0).stop 2024-08-20T05:01:00.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.465+0000 7fe8b3000640 1 -- 172.21.15.37:0/3917953166 shutdown_connections 2024-08-20T05:01:00.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.465+0000 7fe8b3000640 1 --2- 172.21.15.37:0/3917953166 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe8940b3d90 0x7fe8940b6250 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:00.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.465+0000 7fe8b3000640 1 --2- 172.21.15.37:0/3917953166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe8ac108cb0 0x7fe8ac075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:00.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.465+0000 7fe8b3000640 1 --2- 172.21.15.37:0/3917953166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe8ac108330 0x7fe8ac075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:00.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.465+0000 7fe8b3000640 1 --2- 172.21.15.37:0/3917953166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8ac102920 0x7fe8ac0751d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:00.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.465+0000 7fe8b3000640 1 -- 172.21.15.37:0/3917953166 >> 172.21.15.37:0/3917953166 conn(0x7fe8ac0fe350 msgr2=0x7fe8ac0fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:00.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.465+0000 7fe8b3000640 1 -- 172.21.15.37:0/3917953166 shutdown_connections 2024-08-20T05:01:00.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:59.465+0000 7fe8b3000640 1 -- 172.21.15.37:0/3917953166 wait complete. 2024-08-20T05:01:01.649 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299441 got 223338299443 for osd.8 2024-08-20T05:01:01.649 DEBUG:teuthology.parallel:result is None 2024-08-20T05:01:01.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:01 smithi037 ceph-mon[17265]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:01.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:01 smithi135 ceph-mon[22342]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:01.873 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:01 smithi130 ceph-mon[22007]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.954+0000 7efd14c00640 1 -- 172.21.15.37:0/3087791547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd1010a6b0 msgr2=0x7efd1010aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.955+0000 7efd14c00640 1 --2- 172.21.15.37:0/3087791547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd1010a6b0 0x7efd1010aaf0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009900 tx=0x7efcfc02a410 comp rx=0 tx=0).stop 2024-08-20T05:01:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.955+0000 7efd14c00640 1 -- 172.21.15.37:0/3087791547 shutdown_connections 2024-08-20T05:01:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.955+0000 7efd14c00640 1 --2- 172.21.15.37:0/3087791547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd1010b030 0x7efd10111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.955+0000 7efd14c00640 1 --2- 172.21.15.37:0/3087791547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd1010a6b0 0x7efd1010aaf0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.955+0000 7efd14c00640 1 --2- 172.21.15.37:0/3087791547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd10104ca0 0x7efd10105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.955+0000 7efd14c00640 1 -- 172.21.15.37:0/3087791547 >> 172.21.15.37:0/3087791547 conn(0x7efd10100730 msgr2=0x7efd10102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.955+0000 7efd14c00640 1 -- 172.21.15.37:0/3087791547 shutdown_connections 2024-08-20T05:01:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.955+0000 7efd14c00640 1 -- 172.21.15.37:0/3087791547 wait complete. 2024-08-20T05:01:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.956+0000 7efd14c00640 1 Processor -- start 2024-08-20T05:01:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.956+0000 7efd14c00640 1 -- start start 2024-08-20T05:01:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.957+0000 7efd14c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd10104ca0 0x7efd1019b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.957+0000 7efd14c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd1010a6b0 0x7efd1019b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.957+0000 7efd14c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd1010b030 0x7efd101a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.957+0000 7efd14c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efd10114cf0 con 0x7efd1010a6b0 2024-08-20T05:01:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.957+0000 7efd14c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efd10114b70 con 0x7efd10104ca0 2024-08-20T05:01:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.957+0000 7efd14c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efd10114e70 con 0x7efd1010b030 2024-08-20T05:01:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.957+0000 7efd0de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd10104ca0 0x7efd1019b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.957+0000 7efd0de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd10104ca0 0x7efd1019b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42694/0 (socket says 172.21.15.37:42694) 2024-08-20T05:01:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.957+0000 7efd0d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd1010a6b0 0x7efd1019b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.957+0000 7efd0de00640 1 -- 172.21.15.37:0/3119859583 learned_addr learned my addr 172.21.15.37:0/3119859583 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.957+0000 7efd0e800640 1 --2- 172.21.15.37:0/3119859583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd1010b030 0x7efd101a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.958+0000 7efd0de00640 1 -- 172.21.15.37:0/3119859583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd1010b030 msgr2=0x7efd101a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.958+0000 7efd0de00640 1 --2- 172.21.15.37:0/3119859583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd1010b030 0x7efd101a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.958+0000 7efd0de00640 1 -- 172.21.15.37:0/3119859583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd1010a6b0 msgr2=0x7efd1019b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.958+0000 7efd0de00640 1 --2- 172.21.15.37:0/3119859583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd1010a6b0 0x7efd1019b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.958+0000 7efd0de00640 1 -- 172.21.15.37:0/3119859583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd101a1230 con 0x7efd10104ca0 2024-08-20T05:01:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.958+0000 7efd0de00640 1 --2- 172.21.15.37:0/3119859583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd10104ca0 0x7efd1019b180 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efd0000d950 tx=0x7efd0000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.958+0000 7efd06a00640 1 -- 172.21.15.37:0/3119859583 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00017030 con 0x7efd10104ca0 2024-08-20T05:01:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.958+0000 7efd14c00640 1 -- 172.21.15.37:0/3119859583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd101a1520 con 0x7efd10104ca0 2024-08-20T05:01:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.958+0000 7efd06a00640 1 -- 172.21.15.37:0/3119859583 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd00004020 con 0x7efd10104ca0 2024-08-20T05:01:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.958+0000 7efd06a00640 1 -- 172.21.15.37:0/3119859583 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd000047a0 con 0x7efd10104ca0 2024-08-20T05:01:01.886 INFO:teuthology.orchestra.run.smithi037.stdout:249108103214 2024-08-20T05:01:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.959+0000 7efd14c00640 1 -- 172.21.15.37:0/3119859583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd101a7db0 con 0x7efd10104ca0 2024-08-20T05:01:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.960+0000 7efd14c00640 1 -- 172.21.15.37:0/3119859583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd10105080 con 0x7efd10104ca0 2024-08-20T05:01:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.962+0000 7efd06a00640 1 -- 172.21.15.37:0/3119859583 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7efd00009a30 con 0x7efd10104ca0 2024-08-20T05:01:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.963+0000 7efd06a00640 1 --2- 172.21.15.37:0/3119859583 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efcf40b3ce0 0x7efcf40b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.963+0000 7efd06a00640 1 -- 172.21.15.37:0/3119859583 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7efd000e4180 con 0x7efd10104ca0 2024-08-20T05:01:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.964+0000 7efd0d400640 1 --2- 172.21.15.37:0/3119859583 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efcf40b3ce0 0x7efcf40b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.964+0000 7efd0d400640 1 --2- 172.21.15.37:0/3119859583 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efcf40b3ce0 0x7efcf40b61a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efcfc031440 tx=0x7efcfc005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:56.965+0000 7efd06a00640 1 -- 172.21.15.37:0/3119859583 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7efd000ab330 con 0x7efd10104ca0 2024-08-20T05:01:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.235+0000 7efd14c00640 1 -- 172.21.15.37:0/3119859583 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7efd1019c2b0 con 0x7efd10104ca0 2024-08-20T05:01:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.235+0000 7efd06a00640 1 -- 172.21.15.37:0/3119859583 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7efd000aac30 con 0x7efd10104ca0 2024-08-20T05:01:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.238+0000 7efd14c00640 1 -- 172.21.15.37:0/3119859583 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efcf40b3ce0 msgr2=0x7efcf40b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.238+0000 7efd14c00640 1 --2- 172.21.15.37:0/3119859583 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efcf40b3ce0 0x7efcf40b61a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efcfc031440 tx=0x7efcfc005b50 comp rx=0 tx=0).stop 2024-08-20T05:01:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.238+0000 7efd14c00640 1 -- 172.21.15.37:0/3119859583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd10104ca0 msgr2=0x7efd1019b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.238+0000 7efd14c00640 1 --2- 172.21.15.37:0/3119859583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd10104ca0 0x7efd1019b180 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efd0000d950 tx=0x7efd0000de10 comp rx=0 tx=0).stop 2024-08-20T05:01:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.238+0000 7efd14c00640 1 -- 172.21.15.37:0/3119859583 shutdown_connections 2024-08-20T05:01:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.238+0000 7efd14c00640 1 --2- 172.21.15.37:0/3119859583 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efcf40b3ce0 0x7efcf40b61a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.238+0000 7efd14c00640 1 --2- 172.21.15.37:0/3119859583 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efd1010b030 0x7efd101a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.238+0000 7efd14c00640 1 --2- 172.21.15.37:0/3119859583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd1010a6b0 0x7efd1019b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.238+0000 7efd14c00640 1 --2- 172.21.15.37:0/3119859583 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efd10104ca0 0x7efd1019b180 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.238+0000 7efd14c00640 1 -- 172.21.15.37:0/3119859583 >> 172.21.15.37:0/3119859583 conn(0x7efd10100730 msgr2=0x7efd10102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.238+0000 7efd14c00640 1 -- 172.21.15.37:0/3119859583 shutdown_connections 2024-08-20T05:01:01.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.238+0000 7efd14c00640 1 -- 172.21.15.37:0/3119859583 wait complete. 2024-08-20T05:01:02.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.066+0000 7faf1a800640 1 -- 172.21.15.37:0/2566536738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf14103810 msgr2=0x7faf14103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:02.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.066+0000 7faf1a800640 1 --2- 172.21.15.37:0/2566536738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf14103810 0x7faf14103bf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faf08009900 tx=0x7faf0802a410 comp rx=0 tx=0).stop 2024-08-20T05:01:02.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.066+0000 7faf1a800640 1 -- 172.21.15.37:0/2566536738 shutdown_connections 2024-08-20T05:01:02.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.066+0000 7faf1a800640 1 --2- 172.21.15.37:0/2566536738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf1410cc70 0x7faf1410f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.066+0000 7faf1a800640 1 --2- 172.21.15.37:0/2566536738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf14104130 0x7faf1410c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.066+0000 7faf1a800640 1 --2- 172.21.15.37:0/2566536738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf14103810 0x7faf14103bf0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.066+0000 7faf1a800640 1 -- 172.21.15.37:0/2566536738 >> 172.21.15.37:0/2566536738 conn(0x7faf140fd2d0 msgr2=0x7faf140ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.067+0000 7faf1a800640 1 -- 172.21.15.37:0/2566536738 shutdown_connections 2024-08-20T05:01:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.067+0000 7faf1a800640 1 -- 172.21.15.37:0/2566536738 wait complete. 2024-08-20T05:01:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.067+0000 7faf1a800640 1 Processor -- start 2024-08-20T05:01:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.068+0000 7faf1a800640 1 -- start start 2024-08-20T05:01:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.068+0000 7faf1a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf14103810 0x7faf14198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.068+0000 7faf1a800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf14104130 0x7faf14199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.068+0000 7faf1a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf1410cc70 0x7faf1419e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.068+0000 7faf1a800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faf14112930 con 0x7faf14103810 2024-08-20T05:01:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.068+0000 7faf1a800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faf141127b0 con 0x7faf14104130 2024-08-20T05:01:02.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.068+0000 7faf1a800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faf14112ab0 con 0x7faf1410cc70 2024-08-20T05:01:02.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.068+0000 7faf19400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf14103810 0x7faf14198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:02.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.068+0000 7faf19e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf1410cc70 0x7faf1419e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:02.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.068+0000 7faf19400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf14103810 0x7faf14198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52930/0 (socket says 172.21.15.37:52930) 2024-08-20T05:01:02.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.068+0000 7faf19400640 1 -- 172.21.15.37:0/3810958237 learned_addr learned my addr 172.21.15.37:0/3810958237 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:02.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.069+0000 7faf18a00640 1 --2- 172.21.15.37:0/3810958237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf14104130 0x7faf14199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:02.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.069+0000 7faf19e00640 1 -- 172.21.15.37:0/3810958237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf14104130 msgr2=0x7faf14199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:02.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.069+0000 7faf19e00640 1 --2- 172.21.15.37:0/3810958237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf14104130 0x7faf14199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.069+0000 7faf19e00640 1 -- 172.21.15.37:0/3810958237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf14103810 msgr2=0x7faf14198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:02.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.069+0000 7faf19e00640 1 --2- 172.21.15.37:0/3810958237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf14103810 0x7faf14198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.069+0000 7faf19e00640 1 -- 172.21.15.37:0/3810958237 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1419ee70 con 0x7faf1410cc70 2024-08-20T05:01:02.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.069+0000 7faf19400640 1 --2- 172.21.15.37:0/3810958237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf14103810 0x7faf14198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.069+0000 7faf19e00640 1 --2- 172.21.15.37:0/3810958237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf1410cc70 0x7faf1419e6a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009fd0 tx=0x7faf0c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.069+0000 7faf12000640 1 -- 172.21.15.37:0/3810958237 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c00ce20 con 0x7faf1410cc70 2024-08-20T05:01:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.070+0000 7faf12000640 1 -- 172.21.15.37:0/3810958237 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf0c005020 con 0x7faf1410cc70 2024-08-20T05:01:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.070+0000 7faf1a800640 1 -- 172.21.15.37:0/3810958237 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf1419f160 con 0x7faf1410cc70 2024-08-20T05:01:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.070+0000 7faf12000640 1 -- 172.21.15.37:0/3810958237 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf0c010690 con 0x7faf1410cc70 2024-08-20T05:01:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.070+0000 7faf1a800640 1 -- 172.21.15.37:0/3810958237 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf141a5820 con 0x7faf1410cc70 2024-08-20T05:01:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.071+0000 7faf1a800640 1 -- 172.21.15.37:0/3810958237 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf14103bf0 con 0x7faf1410cc70 2024-08-20T05:01:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.073+0000 7faf12000640 1 -- 172.21.15.37:0/3810958237 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7faf0c0054d0 con 0x7faf1410cc70 2024-08-20T05:01:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.075+0000 7faf12000640 1 --2- 172.21.15.37:0/3810958237 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faefc0b3d10 0x7faefc0b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.075+0000 7faf12000640 1 -- 172.21.15.37:0/3810958237 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7faf0c0e4d60 con 0x7faf1410cc70 2024-08-20T05:01:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.075+0000 7faf19400640 1 --2- 172.21.15.37:0/3810958237 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faefc0b3d10 0x7faefc0b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.076+0000 7faf19400640 1 --2- 172.21.15.37:0/3810958237 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faefc0b3d10 0x7faefc0b61d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf080096c0 tx=0x7faf08005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.076+0000 7faf12000640 1 -- 172.21.15.37:0/3810958237 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7faf0c0abe90 con 0x7faf1410cc70 2024-08-20T05:01:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.344+0000 7faf1a800640 1 -- 172.21.15.37:0/3810958237 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7faf14199ef0 con 0x7faf1410cc70 2024-08-20T05:01:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.345+0000 7faf12000640 1 -- 172.21.15.37:0/3810958237 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7faf14199ef0 con 0x7faf1410cc70 2024-08-20T05:01:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.347+0000 7faf1a800640 1 -- 172.21.15.37:0/3810958237 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faefc0b3d10 msgr2=0x7faefc0b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.347+0000 7faf1a800640 1 --2- 172.21.15.37:0/3810958237 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faefc0b3d10 0x7faefc0b61d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf080096c0 tx=0x7faf08005a20 comp rx=0 tx=0).stop 2024-08-20T05:01:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.347+0000 7faf1a800640 1 -- 172.21.15.37:0/3810958237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf1410cc70 msgr2=0x7faf1419e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.347+0000 7faf1a800640 1 --2- 172.21.15.37:0/3810958237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf1410cc70 0x7faf1419e6a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faf0c009fd0 tx=0x7faf0c00ef10 comp rx=0 tx=0).stop 2024-08-20T05:01:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.347+0000 7faf1a800640 1 -- 172.21.15.37:0/3810958237 shutdown_connections 2024-08-20T05:01:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.347+0000 7faf1a800640 1 --2- 172.21.15.37:0/3810958237 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faefc0b3d10 0x7faefc0b61d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.347+0000 7faf1a800640 1 --2- 172.21.15.37:0/3810958237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf1410cc70 0x7faf1419e6a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.347+0000 7faf1a800640 1 --2- 172.21.15.37:0/3810958237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf14104130 0x7faf14199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.347+0000 7faf1a800640 1 --2- 172.21.15.37:0/3810958237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf14103810 0x7faf14198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.347+0000 7faf1a800640 1 -- 172.21.15.37:0/3810958237 >> 172.21.15.37:0/3810958237 conn(0x7faf140fd2d0 msgr2=0x7faf140fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:02.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.347+0000 7faf1a800640 1 -- 172.21.15.37:0/3810958237 shutdown_connections 2024-08-20T05:01:02.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:00:57.347+0000 7faf1a800640 1 -- 172.21.15.37:0/3810958237 wait complete. 2024-08-20T05:01:02.300 INFO:teuthology.orchestra.run.smithi037.stdout:154618822723 2024-08-20T05:01:02.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.894+0000 7f419fc00640 1 -- 172.21.15.37:0/1756304879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4198075b30 msgr2=0x7f419810eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:02.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.894+0000 7f419fc00640 1 --2- 172.21.15.37:0/1756304879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4198075b30 0x7f419810eb60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4180009900 tx=0x7f418002a410 comp rx=0 tx=0).stop 2024-08-20T05:01:02.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.895+0000 7f419fc00640 1 -- 172.21.15.37:0/1756304879 shutdown_connections 2024-08-20T05:01:02.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.895+0000 7f419fc00640 1 --2- 172.21.15.37:0/1756304879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f419810f0a0 0x7f4198111490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.895+0000 7f419fc00640 1 --2- 172.21.15.37:0/1756304879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4198075b30 0x7f419810eb60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.895+0000 7f419fc00640 1 --2- 172.21.15.37:0/1756304879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4198075210 0x7f41980755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.895+0000 7f419fc00640 1 -- 172.21.15.37:0/1756304879 >> 172.21.15.37:0/1756304879 conn(0x7f41980fe500 msgr2=0x7f4198100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:02.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.895+0000 7f419fc00640 1 -- 172.21.15.37:0/1756304879 shutdown_connections 2024-08-20T05:01:02.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.896+0000 7f419fc00640 1 -- 172.21.15.37:0/1756304879 wait complete. 2024-08-20T05:01:02.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.896+0000 7f419fc00640 1 Processor -- start 2024-08-20T05:01:02.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.897+0000 7f419fc00640 1 -- start start 2024-08-20T05:01:02.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.897+0000 7f419fc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4198075210 0x7f419819b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:02.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.897+0000 7f419fc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4198075b30 0x7f419819b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:02.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.897+0000 7f419fc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f419810f0a0 0x7f41981a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:02.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.897+0000 7f419fc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4198114c90 con 0x7f4198075b30 2024-08-20T05:01:02.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.897+0000 7f419fc00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4198114b10 con 0x7f4198075210 2024-08-20T05:01:02.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.897+0000 7f419fc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4198114e10 con 0x7f419810f0a0 2024-08-20T05:01:02.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.897+0000 7f418fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4198075b30 0x7f419819b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:02.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.897+0000 7f419d200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4198075210 0x7f419819b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:02.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.897+0000 7f419d200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4198075210 0x7f419819b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42776/0 (socket says 172.21.15.37:42776) 2024-08-20T05:01:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.897+0000 7f419d200640 1 -- 172.21.15.37:0/3560195692 learned_addr learned my addr 172.21.15.37:0/3560195692 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.898+0000 7f419dc00640 1 --2- 172.21.15.37:0/3560195692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f419810f0a0 0x7f41981a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.898+0000 7f419d200640 1 -- 172.21.15.37:0/3560195692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f419810f0a0 msgr2=0x7f41981a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.898+0000 7f419d200640 1 --2- 172.21.15.37:0/3560195692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f419810f0a0 0x7f41981a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.898+0000 7f419d200640 1 -- 172.21.15.37:0/3560195692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4198075b30 msgr2=0x7f419819b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.898+0000 7f419d200640 1 --2- 172.21.15.37:0/3560195692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4198075b30 0x7f419819b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.898+0000 7f419d200640 1 -- 172.21.15.37:0/3560195692 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41981a12f0 con 0x7f4198075210 2024-08-20T05:01:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.898+0000 7f419d200640 1 --2- 172.21.15.37:0/3560195692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4198075210 0x7f419819b240 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f418800e9f0 tx=0x7f418800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.899+0000 7f4196000640 1 -- 172.21.15.37:0/3560195692 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f418800cd80 con 0x7f4198075210 2024-08-20T05:01:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.899+0000 7f4196000640 1 -- 172.21.15.37:0/3560195692 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f41880108e0 con 0x7f4198075210 2024-08-20T05:01:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.899+0000 7f4196000640 1 -- 172.21.15.37:0/3560195692 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4188018980 con 0x7f4198075210 2024-08-20T05:01:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.899+0000 7f419fc00640 1 -- 172.21.15.37:0/3560195692 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41981a15e0 con 0x7f4198075210 2024-08-20T05:01:02.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.899+0000 7f419fc00640 1 -- 172.21.15.37:0/3560195692 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41981a7ca0 con 0x7f4198075210 2024-08-20T05:01:02.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.900+0000 7f419fc00640 1 -- 172.21.15.37:0/3560195692 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41980755f0 con 0x7f4198075210 2024-08-20T05:01:02.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.903+0000 7f4196000640 1 -- 172.21.15.37:0/3560195692 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f4188010430 con 0x7f4198075210 2024-08-20T05:01:02.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.904+0000 7f4196000640 1 --2- 172.21.15.37:0/3560195692 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f417c0b3c60 0x7f417c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:02.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.904+0000 7f4196000640 1 -- 172.21.15.37:0/3560195692 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f41880e46e0 con 0x7f4198075210 2024-08-20T05:01:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:34359738461 2024-08-20T05:01:02.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.904+0000 7f418fe00640 1 --2- 172.21.15.37:0/3560195692 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f417c0b3c60 0x7f417c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:02.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.905+0000 7f418fe00640 1 --2- 172.21.15.37:0/3560195692 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f417c0b3c60 0x7f417c0b6120 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4180005ab0 tx=0x7f4180005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:02.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:01.905+0000 7f4196000640 1 -- 172.21.15.37:0/3560195692 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f41880ab250 con 0x7f4198075210 2024-08-20T05:01:02.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:02.109+0000 7f419fc00640 1 -- 172.21.15.37:0/3560195692 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f41981a7f50 con 0x7f4198075210 2024-08-20T05:01:02.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:02.110+0000 7f4196000640 1 -- 172.21.15.37:0/3560195692 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f41880af7a0 con 0x7f4198075210 2024-08-20T05:01:02.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:02.112+0000 7f419fc00640 1 -- 172.21.15.37:0/3560195692 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f417c0b3c60 msgr2=0x7f417c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:02.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:02.112+0000 7f419fc00640 1 --2- 172.21.15.37:0/3560195692 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f417c0b3c60 0x7f417c0b6120 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4180005ab0 tx=0x7f4180005a20 comp rx=0 tx=0).stop 2024-08-20T05:01:02.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:02.112+0000 7f419fc00640 1 -- 172.21.15.37:0/3560195692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4198075210 msgr2=0x7f419819b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:02.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:02.112+0000 7f419fc00640 1 --2- 172.21.15.37:0/3560195692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4198075210 0x7f419819b240 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f418800e9f0 tx=0x7f418800eeb0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:02.112+0000 7f419fc00640 1 -- 172.21.15.37:0/3560195692 shutdown_connections 2024-08-20T05:01:02.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:02.112+0000 7f419fc00640 1 --2- 172.21.15.37:0/3560195692 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f417c0b3c60 0x7f417c0b6120 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:02.112+0000 7f419fc00640 1 --2- 172.21.15.37:0/3560195692 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f419810f0a0 0x7f41981a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:02.112+0000 7f419fc00640 1 --2- 172.21.15.37:0/3560195692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4198075b30 0x7f419819b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:02.112+0000 7f419fc00640 1 --2- 172.21.15.37:0/3560195692 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4198075210 0x7f419819b240 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:02.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:02.112+0000 7f419fc00640 1 -- 172.21.15.37:0/3560195692 >> 172.21.15.37:0/3560195692 conn(0x7f41980fe500 msgr2=0x7f41980ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:02.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:02.112+0000 7f419fc00640 1 -- 172.21.15.37:0/3560195692 shutdown_connections 2024-08-20T05:01:02.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:02.112+0000 7f419fc00640 1 -- 172.21.15.37:0/3560195692 wait complete. 2024-08-20T05:01:02.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:02 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3560195692' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-20T05:01:02.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:02 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3560195692' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-20T05:01:02.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:02 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3560195692' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-08-20T05:01:03.639 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822719 got 154618822723 for osd.5 2024-08-20T05:01:03.639 DEBUG:teuthology.parallel:result is None 2024-08-20T05:01:03.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:03 smithi037 ceph-mon[17265]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:01:03.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:03 smithi135 ceph-mon[22342]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:01:03.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:03 smithi130 ceph-mon[22007]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:01:04.458 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574931 got 55834574934 for osd.1 2024-08-20T05:01:04.458 DEBUG:teuthology.parallel:result is None 2024-08-20T05:01:04.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.825+0000 7f6ed8c00640 1 -- 172.21.15.37:0/349343705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ed4104c90 msgr2=0x7f6ed4105070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:04.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.825+0000 7f6ed8c00640 1 --2- 172.21.15.37:0/349343705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ed4104c90 0x7f6ed4105070 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4009900 tx=0x7f6ec402a410 comp rx=0 tx=0).stop 2024-08-20T05:01:04.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.825+0000 7f6ed8c00640 1 -- 172.21.15.37:0/349343705 shutdown_connections 2024-08-20T05:01:04.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.825+0000 7f6ed8c00640 1 --2- 172.21.15.37:0/349343705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ed410b020 0x7f6ed4111820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:04.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.825+0000 7f6ed8c00640 1 --2- 172.21.15.37:0/349343705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ed410a6a0 0x7f6ed410aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:04.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.825+0000 7f6ed8c00640 1 --2- 172.21.15.37:0/349343705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ed4104c90 0x7f6ed4105070 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:04.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.825+0000 7f6ed8c00640 1 -- 172.21.15.37:0/349343705 >> 172.21.15.37:0/349343705 conn(0x7f6ed41006c0 msgr2=0x7f6ed4102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:04.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.825+0000 7f6ed8c00640 1 -- 172.21.15.37:0/349343705 shutdown_connections 2024-08-20T05:01:04.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.825+0000 7f6ed8c00640 1 -- 172.21.15.37:0/349343705 wait complete. 2024-08-20T05:01:04.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.826+0000 7f6ed8c00640 1 Processor -- start 2024-08-20T05:01:04.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.826+0000 7f6ed8c00640 1 -- start start 2024-08-20T05:01:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.827+0000 7f6ed8c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ed4104c90 0x7f6ed419b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.827+0000 7f6ed8c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ed410a6a0 0x7f6ed419b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.827+0000 7f6ed8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ed410b020 0x7f6ed41a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.827+0000 7f6ed8c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed4114d30 con 0x7f6ed410b020 2024-08-20T05:01:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.827+0000 7f6ed8c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed4114bb0 con 0x7f6ed4104c90 2024-08-20T05:01:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.827+0000 7f6ed8c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed4114eb0 con 0x7f6ed410a6a0 2024-08-20T05:01:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.827+0000 7f6ecbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ed410a6a0 0x7f6ed419b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.827+0000 7f6ed2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ed410b020 0x7f6ed41a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:04.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.827+0000 7f6ecbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ed410a6a0 0x7f6ed419b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:47634/0 (socket says 172.21.15.37:47634) 2024-08-20T05:01:04.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.827+0000 7f6ecbe00640 1 -- 172.21.15.37:0/2185550627 learned_addr learned my addr 172.21.15.37:0/2185550627 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:04.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.827+0000 7f6ed1e00640 1 --2- 172.21.15.37:0/2185550627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ed4104c90 0x7f6ed419b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.828+0000 7f6ecbe00640 1 -- 172.21.15.37:0/2185550627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ed4104c90 msgr2=0x7f6ed419b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.828+0000 7f6ecbe00640 1 --2- 172.21.15.37:0/2185550627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ed4104c90 0x7f6ed419b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.828+0000 7f6ecbe00640 1 -- 172.21.15.37:0/2185550627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ed410b020 msgr2=0x7f6ed41a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.828+0000 7f6ecbe00640 1 --2- 172.21.15.37:0/2185550627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ed410b020 0x7f6ed41a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.828+0000 7f6ecbe00640 1 -- 172.21.15.37:0/2185550627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ed41a1250 con 0x7f6ed410a6a0 2024-08-20T05:01:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.828+0000 7f6ed2800640 1 --2- 172.21.15.37:0/2185550627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ed410b020 0x7f6ed41a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.828+0000 7f6ecbe00640 1 --2- 172.21.15.37:0/2185550627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ed410a6a0 0x7f6ed419b6e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc00e9f0 tx=0x7f6ebc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.828+0000 7f6ecaa00640 1 -- 172.21.15.37:0/2185550627 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc00cd80 con 0x7f6ed410a6a0 2024-08-20T05:01:04.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.828+0000 7f6ed8c00640 1 -- 172.21.15.37:0/2185550627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed41a1540 con 0x7f6ed410a6a0 2024-08-20T05:01:04.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.828+0000 7f6ecaa00640 1 -- 172.21.15.37:0/2185550627 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ebc0108e0 con 0x7f6ed410a6a0 2024-08-20T05:01:04.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.828+0000 7f6ecaa00640 1 -- 172.21.15.37:0/2185550627 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc018980 con 0x7f6ed410a6a0 2024-08-20T05:01:04.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.828+0000 7f6ed8c00640 1 -- 172.21.15.37:0/2185550627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed41a7dd0 con 0x7f6ed410a6a0 2024-08-20T05:01:04.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.830+0000 7f6ed8c00640 1 -- 172.21.15.37:0/2185550627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed4105f40 con 0x7f6ed410a6a0 2024-08-20T05:01:04.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.832+0000 7f6ecaa00640 1 -- 172.21.15.37:0/2185550627 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f6ebc010430 con 0x7f6ed410a6a0 2024-08-20T05:01:04.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.833+0000 7f6ecaa00640 1 --2- 172.21.15.37:0/2185550627 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6eb80b3ce0 0x7f6eb80b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:04.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.833+0000 7f6ecaa00640 1 -- 172.21.15.37:0/2185550627 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f6ebc0e43e0 con 0x7f6ed410a6a0 2024-08-20T05:01:04.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.833+0000 7f6ed1e00640 1 --2- 172.21.15.37:0/2185550627 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6eb80b3ce0 0x7f6eb80b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:04.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.834+0000 7f6ed1e00640 1 --2- 172.21.15.37:0/2185550627 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6eb80b3ce0 0x7f6eb80b61a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4005ab0 tx=0x7f6ec4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:04.837+0000 7f6ecaa00640 1 -- 172.21.15.37:0/2185550627 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f6ebc0aaec0 con 0x7f6ed410a6a0 2024-08-20T05:01:05.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:05.034+0000 7f6ed8c00640 1 -- 172.21.15.37:0/2185550627 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f6ed410ce00 con 0x7f6ed410a6a0 2024-08-20T05:01:05.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:05.034+0000 7f6ecaa00640 1 -- 172.21.15.37:0/2185550627 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f6ebc0af410 con 0x7f6ed410a6a0 2024-08-20T05:01:05.035 INFO:teuthology.orchestra.run.smithi037.stdout:270582939690 2024-08-20T05:01:05.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:05.036+0000 7f6ed8c00640 1 -- 172.21.15.37:0/2185550627 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6eb80b3ce0 msgr2=0x7f6eb80b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:05.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:05.036+0000 7f6ed8c00640 1 --2- 172.21.15.37:0/2185550627 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6eb80b3ce0 0x7f6eb80b61a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4005ab0 tx=0x7f6ec4005a20 comp rx=0 tx=0).stop 2024-08-20T05:01:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:05.036+0000 7f6ed8c00640 1 -- 172.21.15.37:0/2185550627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ed410a6a0 msgr2=0x7f6ed419b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:05.036+0000 7f6ed8c00640 1 --2- 172.21.15.37:0/2185550627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ed410a6a0 0x7f6ed419b6e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc00e9f0 tx=0x7f6ebc00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:01:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:05.037+0000 7f6ed8c00640 1 -- 172.21.15.37:0/2185550627 shutdown_connections 2024-08-20T05:01:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:05.037+0000 7f6ed8c00640 1 --2- 172.21.15.37:0/2185550627 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6eb80b3ce0 0x7f6eb80b61a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:05.037+0000 7f6ed8c00640 1 --2- 172.21.15.37:0/2185550627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ed410b020 0x7f6ed41a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:05.037+0000 7f6ed8c00640 1 --2- 172.21.15.37:0/2185550627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ed410a6a0 0x7f6ed419b6e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:05.037+0000 7f6ed8c00640 1 --2- 172.21.15.37:0/2185550627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ed4104c90 0x7f6ed419b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:05.037+0000 7f6ed8c00640 1 -- 172.21.15.37:0/2185550627 >> 172.21.15.37:0/2185550627 conn(0x7f6ed41006c0 msgr2=0x7f6ed4101fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:05.037+0000 7f6ed8c00640 1 -- 172.21.15.37:0/2185550627 shutdown_connections 2024-08-20T05:01:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:05.037+0000 7f6ed8c00640 1 -- 172.21.15.37:0/2185550627 wait complete. 2024-08-20T05:01:05.644 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:05 smithi037 ceph-mon[17265]: pgmap v364: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-20T05:01:05.644 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:05 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2185550627' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-20T05:01:05.765 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182474 got 107374182476 for osd.3 2024-08-20T05:01:05.765 DEBUG:teuthology.parallel:result is None 2024-08-20T05:01:05.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:05 smithi135 ceph-mon[22342]: pgmap v364: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-20T05:01:05.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:05 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2185550627' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-20T05:01:05.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:05 smithi130 ceph-mon[22007]: pgmap v364: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-08-20T05:01:05.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:05 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2185550627' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-08-20T05:01:06.081 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738457 got 34359738461 for osd.0 2024-08-20T05:01:06.081 DEBUG:teuthology.parallel:result is None 2024-08-20T05:01:06.460 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939685 got 270582939690 for osd.10 2024-08-20T05:01:06.460 DEBUG:teuthology.parallel:result is None 2024-08-20T05:01:06.907 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411408 got 77309411411 for osd.2 2024-08-20T05:01:06.907 DEBUG:teuthology.parallel:result is None 2024-08-20T05:01:06.995 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:06.997 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:07.031 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103212 got 249108103214 for osd.9 2024-08-20T05:01:07.031 DEBUG:teuthology.parallel:result is None 2024-08-20T05:01:07.663 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:07 smithi037 ceph-mon[17265]: pgmap v365: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:07.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:07 smithi135 ceph-mon[22342]: pgmap v365: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:07.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.873+0000 7f7820400640 1 -- 172.21.15.37:0/3549484823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7818104ca0 msgr2=0x7f7818105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:07.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.873+0000 7f7820400640 1 --2- 172.21.15.37:0/3549484823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7818104ca0 0x7f7818105080 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f780c009900 tx=0x7f780c02a410 comp rx=0 tx=0).stop 2024-08-20T05:01:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.873+0000 7f7820400640 1 -- 172.21.15.37:0/3549484823 shutdown_connections 2024-08-20T05:01:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.873+0000 7f7820400640 1 --2- 172.21.15.37:0/3549484823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f781810b030 0x7f7818111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.873+0000 7f7820400640 1 --2- 172.21.15.37:0/3549484823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f781810a6b0 0x7f781810aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.873+0000 7f7820400640 1 --2- 172.21.15.37:0/3549484823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7818104ca0 0x7f7818105080 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.873+0000 7f7820400640 1 -- 172.21.15.37:0/3549484823 >> 172.21.15.37:0/3549484823 conn(0x7f7818100730 msgr2=0x7f7818102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.873+0000 7f7820400640 1 -- 172.21.15.37:0/3549484823 shutdown_connections 2024-08-20T05:01:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.873+0000 7f7820400640 1 -- 172.21.15.37:0/3549484823 wait complete. 2024-08-20T05:01:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.874+0000 7f7820400640 1 Processor -- start 2024-08-20T05:01:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.874+0000 7f7820400640 1 -- start start 2024-08-20T05:01:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.874+0000 7f7820400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7818104ca0 0x7f781819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.874+0000 7f7820400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f781810a6b0 0x7f781819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:07.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.874+0000 7f7820400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f781810b030 0x7f78181a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.874+0000 7f7820400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7818114d40 con 0x7f7818104ca0 2024-08-20T05:01:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.874+0000 7f7820400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7818114bc0 con 0x7f781810a6b0 2024-08-20T05:01:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.874+0000 7f7820400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7818114ec0 con 0x7f781810b030 2024-08-20T05:01:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.875+0000 7f781da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7818104ca0 0x7f781819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.875+0000 7f781da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7818104ca0 0x7f781819b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43148/0 (socket says 172.21.15.37:43148) 2024-08-20T05:01:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.875+0000 7f781da00640 1 -- 172.21.15.37:0/4241743321 learned_addr learned my addr 172.21.15.37:0/4241743321 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.875+0000 7f781d000640 1 --2- 172.21.15.37:0/4241743321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f781810a6b0 0x7f781819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.875+0000 7f781e400640 1 --2- 172.21.15.37:0/4241743321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f781810b030 0x7f78181a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.875+0000 7f781da00640 1 -- 172.21.15.37:0/4241743321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f781810b030 msgr2=0x7f78181a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.875+0000 7f781da00640 1 --2- 172.21.15.37:0/4241743321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f781810b030 0x7f78181a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.875+0000 7f781da00640 1 -- 172.21.15.37:0/4241743321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f781810a6b0 msgr2=0x7f781819b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.875+0000 7f781da00640 1 --2- 172.21.15.37:0/4241743321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f781810a6b0 0x7f781819b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:07.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.875+0000 7f781da00640 1 -- 172.21.15.37:0/4241743321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78181a1220 con 0x7f7818104ca0 2024-08-20T05:01:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.875+0000 7f781d000640 1 --2- 172.21.15.37:0/4241743321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f781810a6b0 0x7f781819b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.876+0000 7f781da00640 1 --2- 172.21.15.37:0/4241743321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7818104ca0 0x7f781819b170 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f780c005ab0 tx=0x7f780c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.876+0000 7f7816000640 1 -- 172.21.15.37:0/4241743321 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c03f070 con 0x7f7818104ca0 2024-08-20T05:01:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.876+0000 7f7816000640 1 -- 172.21.15.37:0/4241743321 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f780c031b60 con 0x7f7818104ca0 2024-08-20T05:01:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.876+0000 7f7820400640 1 -- 172.21.15.37:0/4241743321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78181a14b0 con 0x7f7818104ca0 2024-08-20T05:01:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.876+0000 7f7816000640 1 -- 172.21.15.37:0/4241743321 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f780c035030 con 0x7f7818104ca0 2024-08-20T05:01:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.876+0000 7f7820400640 1 -- 172.21.15.37:0/4241743321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78181a7bd0 con 0x7f7818104ca0 2024-08-20T05:01:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.877+0000 7f7820400640 1 -- 172.21.15.37:0/4241743321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7818105080 con 0x7f7818104ca0 2024-08-20T05:01:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.879+0000 7f7816000640 1 -- 172.21.15.37:0/4241743321 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f780c042070 con 0x7f7818104ca0 2024-08-20T05:01:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.881+0000 7f7816000640 1 --2- 172.21.15.37:0/4241743321 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f78000b3c60 0x7f78000b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.881+0000 7f7816000640 1 -- 172.21.15.37:0/4241743321 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f780c104ed0 con 0x7f7818104ca0 2024-08-20T05:01:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.881+0000 7f781d000640 1 --2- 172.21.15.37:0/4241743321 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f78000b3c60 0x7f78000b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:07.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.882+0000 7f781d000640 1 --2- 172.21.15.37:0/4241743321 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f78000b3c60 0x7f78000b6120 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f781810a290 tx=0x7f7804005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:07.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.883+0000 7f7816000640 1 -- 172.21.15.37:0/4241743321 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f780c0cb9b0 con 0x7f7818104ca0 2024-08-20T05:01:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:07 smithi130 ceph-mon[22007]: pgmap v365: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.778+0000 7f8c0b000640 1 -- 172.21.15.37:0/1348625937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c04102920 msgr2=0x7f8c04102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.778+0000 7f8c0b000640 1 --2- 172.21.15.37:0/1348625937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c04102920 0x7f8c04102d00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009900 tx=0x7f8bf802a410 comp rx=0 tx=0).stop 2024-08-20T05:01:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.779+0000 7f8c0b000640 1 -- 172.21.15.37:0/1348625937 shutdown_connections 2024-08-20T05:01:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.779+0000 7f8c0b000640 1 --2- 172.21.15.37:0/1348625937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c04108cb0 0x7f8c0410f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.779+0000 7f8c0b000640 1 --2- 172.21.15.37:0/1348625937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c04108330 0x7f8c04108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.779+0000 7f8c0b000640 1 --2- 172.21.15.37:0/1348625937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c04102920 0x7f8c04102d00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.779+0000 7f8c0b000640 1 -- 172.21.15.37:0/1348625937 >> 172.21.15.37:0/1348625937 conn(0x7f8c040fe350 msgr2=0x7f8c04100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.779+0000 7f8c0b000640 1 -- 172.21.15.37:0/1348625937 shutdown_connections 2024-08-20T05:01:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.779+0000 7f8c0b000640 1 -- 172.21.15.37:0/1348625937 wait complete. 2024-08-20T05:01:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.780+0000 7f8c0b000640 1 Processor -- start 2024-08-20T05:01:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.780+0000 7f8c0b000640 1 -- start start 2024-08-20T05:01:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.780+0000 7f8c0b000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c04102920 0x7f8c0419af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.780+0000 7f8c0b000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c04108330 0x7f8c0419b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.780+0000 7f8c0b000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c04108cb0 0x7f8c041a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.780+0000 7f8c0b000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c041129c0 con 0x7f8c04108cb0 2024-08-20T05:01:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.780+0000 7f8c0b000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8c04112840 con 0x7f8c04102920 2024-08-20T05:01:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.780+0000 7f8c0b000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8c04112b40 con 0x7f8c04108330 2024-08-20T05:01:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.781+0000 7f8c09200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c04108330 0x7f8c0419b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.781+0000 7f8c0a600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c04108cb0 0x7f8c041a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.781+0000 7f8c09200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c04108330 0x7f8c0419b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:47640/0 (socket says 172.21.15.37:47640) 2024-08-20T05:01:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.781+0000 7f8c09200640 1 -- 172.21.15.37:0/148152917 learned_addr learned my addr 172.21.15.37:0/148152917 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.781+0000 7f8c09c00640 1 --2- 172.21.15.37:0/148152917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c04102920 0x7f8c0419af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.781+0000 7f8c09200640 1 -- 172.21.15.37:0/148152917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c04102920 msgr2=0x7f8c0419af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.781+0000 7f8c09200640 1 --2- 172.21.15.37:0/148152917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c04102920 0x7f8c0419af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.781+0000 7f8c09200640 1 -- 172.21.15.37:0/148152917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c04108cb0 msgr2=0x7f8c041a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.781+0000 7f8c09200640 1 --2- 172.21.15.37:0/148152917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c04108cb0 0x7f8c041a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.781+0000 7f8c09200640 1 -- 172.21.15.37:0/148152917 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c041a0fc0 con 0x7f8c04108330 2024-08-20T05:01:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.781+0000 7f8c09200640 1 --2- 172.21.15.37:0/148152917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c04108330 0x7f8c0419b450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000d950 tx=0x7f8bf000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.782+0000 7f8c02000640 1 -- 172.21.15.37:0/148152917 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0017030 con 0x7f8c04108330 2024-08-20T05:01:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.782+0000 7f8c0b000640 1 -- 172.21.15.37:0/148152917 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c041a12b0 con 0x7f8c04108330 2024-08-20T05:01:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.782+0000 7f8c0b000640 1 -- 172.21.15.37:0/148152917 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c041a7b40 con 0x7f8c04108330 2024-08-20T05:01:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.782+0000 7f8c02000640 1 -- 172.21.15.37:0/148152917 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bf0004020 con 0x7f8c04108330 2024-08-20T05:01:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.782+0000 7f8c02000640 1 -- 172.21.15.37:0/148152917 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0005650 con 0x7f8c04108330 2024-08-20T05:01:07.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.783+0000 7f8c0b000640 1 -- 172.21.15.37:0/148152917 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be40052c0 con 0x7f8c04108330 2024-08-20T05:01:07.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.789+0000 7f8c02000640 1 -- 172.21.15.37:0/148152917 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f8bf00041d0 con 0x7f8c04108330 2024-08-20T05:01:07.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.790+0000 7f8c02000640 1 --2- 172.21.15.37:0/148152917 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8bec0b3d10 0x7f8bec0b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:07.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.790+0000 7f8c02000640 1 -- 172.21.15.37:0/148152917 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f8bf00e36d0 con 0x7f8c04108330 2024-08-20T05:01:07.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.790+0000 7f8c09c00640 1 --2- 172.21.15.37:0/148152917 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8bec0b3d10 0x7f8bec0b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:07.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.791+0000 7f8c09c00640 1 --2- 172.21.15.37:0/148152917 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8bec0b3d10 0x7f8bec0b61d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8005ab0 tx=0x7f8bf8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:07.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.794+0000 7f8c02000640 1 -- 172.21.15.37:0/148152917 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f8bf0022020 con 0x7f8c04108330 2024-08-20T05:01:07.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.994+0000 7f8c0b000640 1 -- 172.21.15.37:0/148152917 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8be4005880 con 0x7f8c04108330 2024-08-20T05:01:07.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.995+0000 7f8c02000640 1 -- 172.21.15.37:0/148152917 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8bf00aa8f0 con 0x7f8c04108330 2024-08-20T05:01:07.996 INFO:teuthology.orchestra.run.smithi037.stdout:201863462969 2024-08-20T05:01:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.997+0000 7f8c0b000640 1 -- 172.21.15.37:0/148152917 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8bec0b3d10 msgr2=0x7f8bec0b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.997+0000 7f8c0b000640 1 --2- 172.21.15.37:0/148152917 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8bec0b3d10 0x7f8bec0b61d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8005ab0 tx=0x7f8bf8005a20 comp rx=0 tx=0).stop 2024-08-20T05:01:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.997+0000 7f8c0b000640 1 -- 172.21.15.37:0/148152917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c04108330 msgr2=0x7f8c0419b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.997+0000 7f8c0b000640 1 --2- 172.21.15.37:0/148152917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c04108330 0x7f8c0419b450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000d950 tx=0x7f8bf000de10 comp rx=0 tx=0).stop 2024-08-20T05:01:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.997+0000 7f8c0b000640 1 -- 172.21.15.37:0/148152917 shutdown_connections 2024-08-20T05:01:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.997+0000 7f8c0b000640 1 --2- 172.21.15.37:0/148152917 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8bec0b3d10 0x7f8bec0b61d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.997+0000 7f8c0b000640 1 --2- 172.21.15.37:0/148152917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c04108cb0 0x7f8c041a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.997+0000 7f8c0b000640 1 --2- 172.21.15.37:0/148152917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c04108330 0x7f8c0419b450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.997+0000 7f8c0b000640 1 --2- 172.21.15.37:0/148152917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c04102920 0x7f8c0419af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.997+0000 7f8c0b000640 1 -- 172.21.15.37:0/148152917 >> 172.21.15.37:0/148152917 conn(0x7f8c040fe350 msgr2=0x7f8c041048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.998+0000 7f8c0b000640 1 -- 172.21.15.37:0/148152917 shutdown_connections 2024-08-20T05:01:07.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:07.998+0000 7f8c0b000640 1 -- 172.21.15.37:0/148152917 wait complete. 2024-08-20T05:01:08.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:08.083+0000 7f7820400640 1 -- 172.21.15.37:0/4241743321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f78181a7e60 con 0x7f7818104ca0 2024-08-20T05:01:08.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:08.084+0000 7f7816000640 1 -- 172.21.15.37:0/4241743321 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f780c0cff00 con 0x7f7818104ca0 2024-08-20T05:01:08.085 INFO:teuthology.orchestra.run.smithi037.stdout:133143986249 2024-08-20T05:01:08.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:08.086+0000 7f7820400640 1 -- 172.21.15.37:0/4241743321 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f78000b3c60 msgr2=0x7f78000b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:08.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:08.086+0000 7f7820400640 1 --2- 172.21.15.37:0/4241743321 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f78000b3c60 0x7f78000b6120 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f781810a290 tx=0x7f7804005f90 comp rx=0 tx=0).stop 2024-08-20T05:01:08.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:08.086+0000 7f7820400640 1 -- 172.21.15.37:0/4241743321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7818104ca0 msgr2=0x7f781819b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:08.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:08.086+0000 7f7820400640 1 --2- 172.21.15.37:0/4241743321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7818104ca0 0x7f781819b170 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f780c005ab0 tx=0x7f780c003c10 comp rx=0 tx=0).stop 2024-08-20T05:01:08.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:08.086+0000 7f7820400640 1 -- 172.21.15.37:0/4241743321 shutdown_connections 2024-08-20T05:01:08.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:08.086+0000 7f7820400640 1 --2- 172.21.15.37:0/4241743321 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f78000b3c60 0x7f78000b6120 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:08.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:08.086+0000 7f7820400640 1 --2- 172.21.15.37:0/4241743321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f781810b030 0x7f78181a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:08.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:08.086+0000 7f7820400640 1 --2- 172.21.15.37:0/4241743321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f781810a6b0 0x7f781819b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:08.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:08.086+0000 7f7820400640 1 --2- 172.21.15.37:0/4241743321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7818104ca0 0x7f781819b170 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:08.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:08.086+0000 7f7820400640 1 -- 172.21.15.37:0/4241743321 >> 172.21.15.37:0/4241743321 conn(0x7f7818100730 msgr2=0x7f7818102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:08.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:08.086+0000 7f7820400640 1 -- 172.21.15.37:0/4241743321 shutdown_connections 2024-08-20T05:01:08.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:08.087+0000 7f7820400640 1 -- 172.21.15.37:0/4241743321 wait complete. 2024-08-20T05:01:08.603 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:08 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/148152917' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-20T05:01:08.603 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:08 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/4241743321' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-20T05:01:08.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:08 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/148152917' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-20T05:01:08.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:08 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/4241743321' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-20T05:01:08.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:08 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/148152917' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-08-20T05:01:08.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:08 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/4241743321' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-08-20T05:01:08.989 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986246 got 133143986249 for osd.4 2024-08-20T05:01:08.989 DEBUG:teuthology.parallel:result is None 2024-08-20T05:01:09.503 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462966 got 201863462969 for osd.7 2024-08-20T05:01:09.503 DEBUG:teuthology.parallel:result is None 2024-08-20T05:01:09.503 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-20T05:01:09.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-20T05:01:09.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:09 smithi037 ceph-mon[17265]: pgmap v366: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:09.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:09 smithi135 ceph-mon[22342]: pgmap v366: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:09.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:09 smithi130 ceph-mon[22007]: pgmap v366: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:10.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.480+0000 7f71e0000640 1 -- 172.21.15.37:0/3128445435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d8113690 msgr2=0x7f71d8115a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.480+0000 7f71e0000640 1 --2- 172.21.15.37:0/3128445435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d8113690 0x7f71d8115a80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f71d0009ca0 tx=0x7f71d002a8c0 comp rx=0 tx=0).stop 2024-08-20T05:01:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.480+0000 7f71e0000640 1 -- 172.21.15.37:0/3128445435 shutdown_connections 2024-08-20T05:01:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.480+0000 7f71e0000640 1 --2- 172.21.15.37:0/3128445435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d8113690 0x7f71d8115a80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.480+0000 7f71e0000640 1 --2- 172.21.15.37:0/3128445435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71d8077d20 0x7f71d8113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.480+0000 7f71e0000640 1 --2- 172.21.15.37:0/3128445435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71d8077400 0x7f71d80777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.480+0000 7f71e0000640 1 -- 172.21.15.37:0/3128445435 >> 172.21.15.37:0/3128445435 conn(0x7f71d8100730 msgr2=0x7f71d8102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.480+0000 7f71e0000640 1 -- 172.21.15.37:0/3128445435 shutdown_connections 2024-08-20T05:01:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.480+0000 7f71e0000640 1 -- 172.21.15.37:0/3128445435 wait complete. 2024-08-20T05:01:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.482+0000 7f71e0000640 1 Processor -- start 2024-08-20T05:01:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.482+0000 7f71e0000640 1 -- start start 2024-08-20T05:01:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.482+0000 7f71e0000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71d8077400 0x7f71d819f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.482+0000 7f71e0000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71d8077d20 0x7f71d819fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.482+0000 7f71e0000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d8113690 0x7f71d81a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:10.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.482+0000 7f71e0000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f71d8119070 con 0x7f71d8113690 2024-08-20T05:01:10.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.482+0000 7f71e0000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f71d8118ef0 con 0x7f71d8077d20 2024-08-20T05:01:10.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.482+0000 7f71e0000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f71d81191f0 con 0x7f71d8077400 2024-08-20T05:01:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.483+0000 7f71de000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d8113690 0x7f71d81a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.483+0000 7f71dcc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71d8077d20 0x7f71d819fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.483+0000 7f71dd600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71d8077400 0x7f71d819f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.483+0000 7f71de000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d8113690 0x7f71d81a4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43162/0 (socket says 172.21.15.37:43162) 2024-08-20T05:01:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.483+0000 7f71de000640 1 -- 172.21.15.37:0/3724010531 learned_addr learned my addr 172.21.15.37:0/3724010531 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.483+0000 7f71dcc00640 1 -- 172.21.15.37:0/3724010531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71d8077400 msgr2=0x7f71d819f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.483+0000 7f71dcc00640 1 --2- 172.21.15.37:0/3724010531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71d8077400 0x7f71d819f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.483+0000 7f71dcc00640 1 -- 172.21.15.37:0/3724010531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d8113690 msgr2=0x7f71d81a4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.483+0000 7f71dcc00640 1 --2- 172.21.15.37:0/3724010531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d8113690 0x7f71d81a4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.483+0000 7f71dcc00640 1 -- 172.21.15.37:0/3724010531 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d81a5690 con 0x7f71d8077d20 2024-08-20T05:01:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.484+0000 7f71dcc00640 1 --2- 172.21.15.37:0/3724010531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71d8077d20 0x7f71d819fb20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71c400e9f0 tx=0x7f71c400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.484+0000 7f71d6000640 1 -- 172.21.15.37:0/3724010531 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c400ccc0 con 0x7f71d8077d20 2024-08-20T05:01:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.484+0000 7f71e0000640 1 -- 172.21.15.37:0/3724010531 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d81a5980 con 0x7f71d8077d20 2024-08-20T05:01:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.484+0000 7f71d6000640 1 -- 172.21.15.37:0/3724010531 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71c40108e0 con 0x7f71d8077d20 2024-08-20T05:01:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.484+0000 7f71d6000640 1 -- 172.21.15.37:0/3724010531 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71c4018880 con 0x7f71d8077d20 2024-08-20T05:01:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.484+0000 7f71e0000640 1 -- 172.21.15.37:0/3724010531 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d81ac210 con 0x7f71d8077d20 2024-08-20T05:01:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.485+0000 7f71e0000640 1 -- 172.21.15.37:0/3724010531 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d8078910 con 0x7f71d8077d20 2024-08-20T05:01:10.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.487+0000 7f71d6000640 1 -- 172.21.15.37:0/3724010531 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f71c4010430 con 0x7f71d8077d20 2024-08-20T05:01:10.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.489+0000 7f71d6000640 1 --2- 172.21.15.37:0/3724010531 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71c00b3c60 0x7f71c00b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:10.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.489+0000 7f71d6000640 1 -- 172.21.15.37:0/3724010531 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f71c40e4850 con 0x7f71d8077d20 2024-08-20T05:01:10.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.489+0000 7f71dd600640 1 --2- 172.21.15.37:0/3724010531 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71c00b3c60 0x7f71c00b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:10.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.490+0000 7f71dd600640 1 --2- 172.21.15.37:0/3724010531 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71c00b3c60 0x7f71c00b6120 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009bd0 tx=0x7f71cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:10.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.490+0000 7f71d6000640 1 -- 172.21.15.37:0/3724010531 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f71c40ab330 con 0x7f71d8077d20 2024-08-20T05:01:10.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.681+0000 7f71e0000640 1 -- 172.21.15.37:0/3724010531 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71d80632c0 con 0x7f71c00b3c60 2024-08-20T05:01:10.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.688+0000 7f71d6000640 1 -- 172.21.15.37:0/3724010531 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340402 (secure 0 0 0) 0x7f71d80632c0 con 0x7f71c00b3c60 2024-08-20T05:01:10.693 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:01:10.695 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-20T05:01:10.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.692+0000 7f71e0000640 1 -- 172.21.15.37:0/3724010531 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71c00b3c60 msgr2=0x7f71c00b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:10.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.692+0000 7f71e0000640 1 --2- 172.21.15.37:0/3724010531 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71c00b3c60 0x7f71c00b6120 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f71cc009bd0 tx=0x7f71cc005f90 comp rx=0 tx=0).stop 2024-08-20T05:01:10.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.692+0000 7f71e0000640 1 -- 172.21.15.37:0/3724010531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71d8077d20 msgr2=0x7f71d819fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:10.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.692+0000 7f71e0000640 1 --2- 172.21.15.37:0/3724010531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71d8077d20 0x7f71d819fb20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71c400e9f0 tx=0x7f71c400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:01:10.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.692+0000 7f71e0000640 1 -- 172.21.15.37:0/3724010531 shutdown_connections 2024-08-20T05:01:10.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.692+0000 7f71e0000640 1 --2- 172.21.15.37:0/3724010531 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71c00b3c60 0x7f71c00b6120 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:10.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.692+0000 7f71e0000640 1 --2- 172.21.15.37:0/3724010531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71d8113690 0x7f71d81a4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:10.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.692+0000 7f71e0000640 1 --2- 172.21.15.37:0/3724010531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71d8077d20 0x7f71d819fb20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:10.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.692+0000 7f71e0000640 1 --2- 172.21.15.37:0/3724010531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f71d8077400 0x7f71d819f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:10.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.692+0000 7f71e0000640 1 -- 172.21.15.37:0/3724010531 >> 172.21.15.37:0/3724010531 conn(0x7f71d8100730 msgr2=0x7f71d8102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:10.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.692+0000 7f71e0000640 1 -- 172.21.15.37:0/3724010531 shutdown_connections 2024-08-20T05:01:10.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:10.692+0000 7f71e0000640 1 -- 172.21.15.37:0/3724010531 wait complete. 2024-08-20T05:01:11.478 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":367,"stamp":"2024-08-20T05:01:10.001817+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661286,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":735,"num_read_kb":478,"num_write":375,"num_write_kb":2296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952579,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":309,"ondisk_log_size":309,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363012,"kb_used_data":13712,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578812,"statfs":{"total":1151940427776,"available":1151568703488,"internally_reserved":0,"allocated":14041088,"data_stored":7847504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":135,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003238"},"pg_stats":[{"pgid":"2.1f","version":"84'13","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:01:06.245102+0000","last_change":"2024-08-20T04:59:09.751382+0000","last_active":"2024-08-20T05:01:06.245102+0000","last_peered":"2024-08-20T05:01:06.245102+0000","last_clean":"2024-08-20T05:01:06.245102+0000","last_became_active":"2024-08-20T04:59:09.751026+0000","last_became_peered":"2024-08-20T04:59:09.751026+0000","last_unstale":"2024-08-20T05:01:06.245102+0000","last_undegraded":"2024-08-20T05:01:06.245102+0000","last_fullsized":"2024-08-20T05:01:06.245102+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:14:50.107767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.372274+0000","last_change":"2024-08-20T05:00:29.371826+0000","last_active":"2024-08-20T05:00:29.372274+0000","last_peered":"2024-08-20T05:00:29.372274+0000","last_clean":"2024-08-20T05:00:29.372274+0000","last_became_active":"2024-08-20T05:00:29.371618+0000","last_became_peered":"2024-08-20T05:00:29.371618+0000","last_unstale":"2024-08-20T05:00:29.372274+0000","last_undegraded":"2024-08-20T05:00:29.372274+0000","last_fullsized":"2024-08-20T05:00:29.372274+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:34:36.786900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368608+0000","last_change":"2024-08-20T04:59:21.902558+0000","last_active":"2024-08-20T05:00:29.368608+0000","last_peered":"2024-08-20T05:00:29.368608+0000","last_clean":"2024-08-20T05:00:29.368608+0000","last_became_active":"2024-08-20T04:59:21.902119+0000","last_became_peered":"2024-08-20T04:59:21.902119+0000","last_unstale":"2024-08-20T05:00:29.368608+0000","last_undegraded":"2024-08-20T05:00:29.368608+0000","last_fullsized":"2024-08-20T05:00:29.368608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:53.765865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365426+0000","last_change":"2024-08-20T04:59:09.946282+0000","last_active":"2024-08-20T05:00:29.365426+0000","last_peered":"2024-08-20T05:00:29.365426+0000","last_clean":"2024-08-20T05:00:29.365426+0000","last_became_active":"2024-08-20T04:59:09.945867+0000","last_became_peered":"2024-08-20T04:59:09.945867+0000","last_unstale":"2024-08-20T05:00:29.365426+0000","last_undegraded":"2024-08-20T05:00:29.365426+0000","last_fullsized":"2024-08-20T05:00:29.365426+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:29:08.119504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370420+0000","last_change":"2024-08-20T04:59:12.796121+0000","last_active":"2024-08-20T05:00:29.370420+0000","last_peered":"2024-08-20T05:00:29.370420+0000","last_clean":"2024-08-20T05:00:29.370420+0000","last_became_active":"2024-08-20T04:59:12.792764+0000","last_became_peered":"2024-08-20T04:59:12.792764+0000","last_unstale":"2024-08-20T05:00:29.370420+0000","last_undegraded":"2024-08-20T05:00:29.370420+0000","last_fullsized":"2024-08-20T05:00:29.370420+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:01:53.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367270+0000","last_change":"2024-08-20T04:59:21.909607+0000","last_active":"2024-08-20T05:00:29.367270+0000","last_peered":"2024-08-20T05:00:29.367270+0000","last_clean":"2024-08-20T05:00:29.367270+0000","last_became_active":"2024-08-20T04:59:21.909175+0000","last_became_peered":"2024-08-20T04:59:21.909175+0000","last_unstale":"2024-08-20T05:00:29.367270+0000","last_undegraded":"2024-08-20T05:00:29.367270+0000","last_fullsized":"2024-08-20T05:00:29.367270+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:29:49.940169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370874+0000","last_change":"2024-08-20T04:59:09.753233+0000","last_active":"2024-08-20T05:00:29.370874+0000","last_peered":"2024-08-20T05:00:29.370874+0000","last_clean":"2024-08-20T05:00:29.370874+0000","last_became_active":"2024-08-20T04:59:09.752614+0000","last_became_peered":"2024-08-20T04:59:09.752614+0000","last_unstale":"2024-08-20T05:00:29.370874+0000","last_undegraded":"2024-08-20T05:00:29.370874+0000","last_fullsized":"2024-08-20T05:00:29.370874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:04:20.199669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365558+0000","last_change":"2024-08-20T04:59:12.799116+0000","last_active":"2024-08-20T05:00:29.365558+0000","last_peered":"2024-08-20T05:00:29.365558+0000","last_clean":"2024-08-20T05:00:29.365558+0000","last_became_active":"2024-08-20T04:59:12.798725+0000","last_became_peered":"2024-08-20T04:59:12.798725+0000","last_unstale":"2024-08-20T05:00:29.365558+0000","last_undegraded":"2024-08-20T05:00:29.365558+0000","last_fullsized":"2024-08-20T05:00:29.365558+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:46.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.373069+0000","last_change":"2024-08-20T05:00:29.372973+0000","last_active":"2024-08-20T05:00:29.373069+0000","last_peered":"2024-08-20T05:00:29.373069+0000","last_clean":"2024-08-20T05:00:29.373069+0000","last_became_active":"2024-08-20T05:00:29.372504+0000","last_became_peered":"2024-08-20T05:00:29.372504+0000","last_unstale":"2024-08-20T05:00:29.373069+0000","last_undegraded":"2024-08-20T05:00:29.373069+0000","last_fullsized":"2024-08-20T05:00:29.373069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:22:22.410569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.371125+0000","last_change":"2024-08-20T04:59:09.752771+0000","last_active":"2024-08-20T05:00:29.371125+0000","last_peered":"2024-08-20T05:00:29.371125+0000","last_clean":"2024-08-20T05:00:29.371125+0000","last_became_active":"2024-08-20T04:59:09.752415+0000","last_became_peered":"2024-08-20T04:59:09.752415+0000","last_unstale":"2024-08-20T05:00:29.371125+0000","last_undegraded":"2024-08-20T05:00:29.371125+0000","last_fullsized":"2024-08-20T05:00:29.371125+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:13:18.843587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365825+0000","last_change":"2024-08-20T04:59:12.794418+0000","last_active":"2024-08-20T05:00:29.365825+0000","last_peered":"2024-08-20T05:00:29.365825+0000","last_clean":"2024-08-20T05:00:29.365825+0000","last_became_active":"2024-08-20T04:59:12.794117+0000","last_became_peered":"2024-08-20T04:59:12.794117+0000","last_unstale":"2024-08-20T05:00:29.365825+0000","last_undegraded":"2024-08-20T05:00:29.365825+0000","last_fullsized":"2024-08-20T05:00:29.365825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:18.209690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367317+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T05:00:29.367317+0000","last_peered":"2024-08-20T05:00:29.367317+0000","last_clean":"2024-08-20T05:00:29.367317+0000","last_became_active":"2024-08-20T04:59:21.906344+0000","last_became_peered":"2024-08-20T04:59:21.906344+0000","last_unstale":"2024-08-20T05:00:29.367317+0000","last_undegraded":"2024-08-20T05:00:29.367317+0000","last_fullsized":"2024-08-20T05:00:29.367317+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:48:34.982558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368091+0000","last_change":"2024-08-20T04:59:12.792719+0000","last_active":"2024-08-20T05:00:29.368091+0000","last_peered":"2024-08-20T05:00:29.368091+0000","last_clean":"2024-08-20T05:00:29.368091+0000","last_became_active":"2024-08-20T04:59:12.792294+0000","last_became_peered":"2024-08-20T04:59:12.792294+0000","last_unstale":"2024-08-20T05:00:29.368091+0000","last_undegraded":"2024-08-20T05:00:29.368091+0000","last_fullsized":"2024-08-20T05:00:29.368091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:20:03.593798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.371257+0000","last_change":"2024-08-20T04:59:09.753804+0000","last_active":"2024-08-20T05:00:29.371257+0000","last_peered":"2024-08-20T05:00:29.371257+0000","last_clean":"2024-08-20T05:00:29.371257+0000","last_became_active":"2024-08-20T04:59:09.753493+0000","last_became_peered":"2024-08-20T04:59:09.753493+0000","last_unstale":"2024-08-20T05:00:29.371257+0000","last_undegraded":"2024-08-20T05:00:29.371257+0000","last_fullsized":"2024-08-20T05:00:29.371257+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:50:26.306087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368530+0000","last_change":"2024-08-20T04:59:21.902445+0000","last_active":"2024-08-20T05:00:29.368530+0000","last_peered":"2024-08-20T05:00:29.368530+0000","last_clean":"2024-08-20T05:00:29.368530+0000","last_became_active":"2024-08-20T04:59:21.901950+0000","last_became_peered":"2024-08-20T04:59:21.901950+0000","last_unstale":"2024-08-20T05:00:29.368530+0000","last_undegraded":"2024-08-20T05:00:29.368530+0000","last_fullsized":"2024-08-20T05:00:29.368530+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:55:28.653841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365055+0000","last_change":"2024-08-20T04:59:12.784236+0000","last_active":"2024-08-20T05:00:29.365055+0000","last_peered":"2024-08-20T05:00:29.365055+0000","last_clean":"2024-08-20T05:00:29.365055+0000","last_became_active":"2024-08-20T04:59:12.783945+0000","last_became_peered":"2024-08-20T04:59:12.783945+0000","last_unstale":"2024-08-20T05:00:29.365055+0000","last_undegraded":"2024-08-20T05:00:29.365055+0000","last_fullsized":"2024-08-20T05:00:29.365055+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:43:07.137543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368744+0000","last_change":"2024-08-20T04:59:09.751661+0000","last_active":"2024-08-20T05:00:29.368744+0000","last_peered":"2024-08-20T05:00:29.368744+0000","last_clean":"2024-08-20T05:00:29.368744+0000","last_became_active":"2024-08-20T04:59:09.751326+0000","last_became_peered":"2024-08-20T04:59:09.751326+0000","last_unstale":"2024-08-20T05:00:29.368744+0000","last_undegraded":"2024-08-20T05:00:29.368744+0000","last_fullsized":"2024-08-20T05:00:29.368744+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:54.751929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368110+0000","last_change":"2024-08-20T04:59:21.913657+0000","last_active":"2024-08-20T05:00:29.368110+0000","last_peered":"2024-08-20T05:00:29.368110+0000","last_clean":"2024-08-20T05:00:29.368110+0000","last_became_active":"2024-08-20T04:59:21.913187+0000","last_became_peered":"2024-08-20T04:59:21.913187+0000","last_unstale":"2024-08-20T05:00:29.368110+0000","last_undegraded":"2024-08-20T05:00:29.368110+0000","last_fullsized":"2024-08-20T05:00:29.368110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:51:29.008810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367794+0000","last_change":"2024-08-20T04:59:12.780137+0000","last_active":"2024-08-20T05:00:29.367794+0000","last_peered":"2024-08-20T05:00:29.367794+0000","last_clean":"2024-08-20T05:00:29.367794+0000","last_became_active":"2024-08-20T04:59:12.779820+0000","last_became_peered":"2024-08-20T04:59:12.779820+0000","last_unstale":"2024-08-20T05:00:29.367794+0000","last_undegraded":"2024-08-20T05:00:29.367794+0000","last_fullsized":"2024-08-20T05:00:29.367794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:33:58.204255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.364999+0000","last_change":"2024-08-20T04:59:09.750521+0000","last_active":"2024-08-20T05:00:29.364999+0000","last_peered":"2024-08-20T05:00:29.364999+0000","last_clean":"2024-08-20T05:00:29.364999+0000","last_became_active":"2024-08-20T04:59:09.750115+0000","last_became_peered":"2024-08-20T04:59:09.750115+0000","last_unstale":"2024-08-20T05:00:29.364999+0000","last_undegraded":"2024-08-20T05:00:29.364999+0000","last_fullsized":"2024-08-20T05:00:29.364999+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:44:20.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367494+0000","last_change":"2024-08-20T04:59:21.910737+0000","last_active":"2024-08-20T05:00:29.367494+0000","last_peered":"2024-08-20T05:00:29.367494+0000","last_clean":"2024-08-20T05:00:29.367494+0000","last_became_active":"2024-08-20T04:59:21.910104+0000","last_became_peered":"2024-08-20T04:59:21.910104+0000","last_unstale":"2024-08-20T05:00:29.367494+0000","last_undegraded":"2024-08-20T05:00:29.367494+0000","last_fullsized":"2024-08-20T05:00:29.367494+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:17:40.436885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.373058+0000","last_change":"2024-08-20T04:59:12.787285+0000","last_active":"2024-08-20T05:00:29.373058+0000","last_peered":"2024-08-20T05:00:29.373058+0000","last_clean":"2024-08-20T05:00:29.373058+0000","last_became_active":"2024-08-20T04:59:12.786998+0000","last_became_peered":"2024-08-20T04:59:12.786998+0000","last_unstale":"2024-08-20T05:00:29.373058+0000","last_undegraded":"2024-08-20T05:00:29.373058+0000","last_fullsized":"2024-08-20T05:00:29.373058+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:12:49.860291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365264+0000","last_change":"2024-08-20T04:59:09.947715+0000","last_active":"2024-08-20T05:00:29.365264+0000","last_peered":"2024-08-20T05:00:29.365264+0000","last_clean":"2024-08-20T05:00:29.365264+0000","last_became_active":"2024-08-20T04:59:09.947372+0000","last_became_peered":"2024-08-20T04:59:09.947372+0000","last_unstale":"2024-08-20T05:00:29.365264+0000","last_undegraded":"2024-08-20T05:00:29.365264+0000","last_fullsized":"2024-08-20T05:00:29.365264+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:42:04.352964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.860632+0000","last_change":"2024-08-20T05:00:29.860562+0000","last_active":"2024-08-20T05:00:29.860632+0000","last_peered":"2024-08-20T05:00:29.860632+0000","last_clean":"2024-08-20T05:00:29.860632+0000","last_became_active":"2024-08-20T05:00:29.859944+0000","last_became_peered":"2024-08-20T05:00:29.859944+0000","last_unstale":"2024-08-20T05:00:29.860632+0000","last_undegraded":"2024-08-20T05:00:29.860632+0000","last_fullsized":"2024-08-20T05:00:29.860632+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:47.266712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370234+0000","last_change":"2024-08-20T04:59:12.785952+0000","last_active":"2024-08-20T05:00:29.370234+0000","last_peered":"2024-08-20T05:00:29.370234+0000","last_clean":"2024-08-20T05:00:29.370234+0000","last_became_active":"2024-08-20T04:59:12.785596+0000","last_became_peered":"2024-08-20T04:59:12.785596+0000","last_unstale":"2024-08-20T05:00:29.370234+0000","last_undegraded":"2024-08-20T05:00:29.370234+0000","last_fullsized":"2024-08-20T05:00:29.370234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:47.299560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369153+0000","last_change":"2024-08-20T04:59:09.964725+0000","last_active":"2024-08-20T05:00:29.369153+0000","last_peered":"2024-08-20T05:00:29.369153+0000","last_clean":"2024-08-20T05:00:29.369153+0000","last_became_active":"2024-08-20T04:59:09.964351+0000","last_became_peered":"2024-08-20T04:59:09.964351+0000","last_unstale":"2024-08-20T05:00:29.369153+0000","last_undegraded":"2024-08-20T05:00:29.369153+0000","last_fullsized":"2024-08-20T05:00:29.369153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:26:03.216378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368992+0000","last_change":"2024-08-20T04:59:21.898758+0000","last_active":"2024-08-20T05:00:29.368992+0000","last_peered":"2024-08-20T05:00:29.368992+0000","last_clean":"2024-08-20T05:00:29.368992+0000","last_became_active":"2024-08-20T04:59:21.898282+0000","last_became_peered":"2024-08-20T04:59:21.898282+0000","last_unstale":"2024-08-20T05:00:29.368992+0000","last_undegraded":"2024-08-20T05:00:29.368992+0000","last_fullsized":"2024-08-20T05:00:29.368992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:45:49.093459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365479+0000","last_change":"2024-08-20T04:59:12.793870+0000","last_active":"2024-08-20T05:00:29.365479+0000","last_peered":"2024-08-20T05:00:29.365479+0000","last_clean":"2024-08-20T05:00:29.365479+0000","last_became_active":"2024-08-20T04:59:12.792928+0000","last_became_peered":"2024-08-20T04:59:12.792928+0000","last_unstale":"2024-08-20T05:00:29.365479+0000","last_undegraded":"2024-08-20T05:00:29.365479+0000","last_fullsized":"2024-08-20T05:00:29.365479+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:12:25.450347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'15","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368608+0000","last_change":"2024-08-20T04:59:09.751403+0000","last_active":"2024-08-20T05:00:29.368608+0000","last_peered":"2024-08-20T05:00:29.368608+0000","last_clean":"2024-08-20T05:00:29.368608+0000","last_became_active":"2024-08-20T04:59:09.750976+0000","last_became_peered":"2024-08-20T04:59:09.750976+0000","last_unstale":"2024-08-20T05:00:29.368608+0000","last_undegraded":"2024-08-20T05:00:29.368608+0000","last_fullsized":"2024-08-20T05:00:29.368608+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:58:54.627836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.364684+0000","last_change":"2024-08-20T04:59:21.899813+0000","last_active":"2024-08-20T05:00:29.364684+0000","last_peered":"2024-08-20T05:00:29.364684+0000","last_clean":"2024-08-20T05:00:29.364684+0000","last_became_active":"2024-08-20T04:59:21.899462+0000","last_became_peered":"2024-08-20T04:59:21.899462+0000","last_unstale":"2024-08-20T05:00:29.364684+0000","last_undegraded":"2024-08-20T05:00:29.364684+0000","last_fullsized":"2024-08-20T05:00:29.364684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.468845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859599+0000","last_change":"2024-08-20T04:59:12.783953+0000","last_active":"2024-08-20T05:00:29.859599+0000","last_peered":"2024-08-20T05:00:29.859599+0000","last_clean":"2024-08-20T05:00:29.859599+0000","last_became_active":"2024-08-20T04:59:12.781445+0000","last_became_peered":"2024-08-20T04:59:12.781445+0000","last_unstale":"2024-08-20T05:00:29.859599+0000","last_undegraded":"2024-08-20T05:00:29.859599+0000","last_fullsized":"2024-08-20T05:00:29.859599+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:04.792064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.371001+0000","last_change":"2024-08-20T04:59:09.947194+0000","last_active":"2024-08-20T05:00:29.371001+0000","last_peered":"2024-08-20T05:00:29.371001+0000","last_clean":"2024-08-20T05:00:29.371001+0000","last_became_active":"2024-08-20T04:59:09.946822+0000","last_became_peered":"2024-08-20T04:59:09.946822+0000","last_unstale":"2024-08-20T05:00:29.371001+0000","last_undegraded":"2024-08-20T05:00:29.371001+0000","last_fullsized":"2024-08-20T05:00:29.371001+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:23:08.279378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367908+0000","last_change":"2024-08-20T04:59:21.905202+0000","last_active":"2024-08-20T05:00:29.367908+0000","last_peered":"2024-08-20T05:00:29.367908+0000","last_clean":"2024-08-20T05:00:29.367908+0000","last_became_active":"2024-08-20T04:59:21.904771+0000","last_became_peered":"2024-08-20T04:59:21.904771+0000","last_unstale":"2024-08-20T05:00:29.367908+0000","last_undegraded":"2024-08-20T05:00:29.367908+0000","last_fullsized":"2024-08-20T05:00:29.367908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:35:56.887981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859479+0000","last_change":"2024-08-20T04:59:12.798301+0000","last_active":"2024-08-20T05:00:29.859479+0000","last_peered":"2024-08-20T05:00:29.859479+0000","last_clean":"2024-08-20T05:00:29.859479+0000","last_became_active":"2024-08-20T04:59:12.797934+0000","last_became_peered":"2024-08-20T04:59:12.797934+0000","last_unstale":"2024-08-20T05:00:29.859479+0000","last_undegraded":"2024-08-20T05:00:29.859479+0000","last_fullsized":"2024-08-20T05:00:29.859479+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:41:24.465380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367656+0000","last_change":"2024-08-20T04:59:09.947602+0000","last_active":"2024-08-20T05:00:29.367656+0000","last_peered":"2024-08-20T05:00:29.367656+0000","last_clean":"2024-08-20T05:00:29.367656+0000","last_became_active":"2024-08-20T04:59:09.946795+0000","last_became_peered":"2024-08-20T04:59:09.946795+0000","last_unstale":"2024-08-20T05:00:29.367656+0000","last_undegraded":"2024-08-20T05:00:29.367656+0000","last_fullsized":"2024-08-20T05:00:29.367656+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:09:09.003266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.860919+0000","last_change":"2024-08-20T05:00:29.860828+0000","last_active":"2024-08-20T05:00:29.860919+0000","last_peered":"2024-08-20T05:00:29.860919+0000","last_clean":"2024-08-20T05:00:29.860919+0000","last_became_active":"2024-08-20T05:00:29.860242+0000","last_became_peered":"2024-08-20T05:00:29.860242+0000","last_unstale":"2024-08-20T05:00:29.860919+0000","last_undegraded":"2024-08-20T05:00:29.860919+0000","last_fullsized":"2024-08-20T05:00:29.860919+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:09:42.311207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859630+0000","last_change":"2024-08-20T04:59:12.784852+0000","last_active":"2024-08-20T05:00:29.859630+0000","last_peered":"2024-08-20T05:00:29.859630+0000","last_clean":"2024-08-20T05:00:29.859630+0000","last_became_active":"2024-08-20T04:59:12.784496+0000","last_became_peered":"2024-08-20T04:59:12.784496+0000","last_unstale":"2024-08-20T05:00:29.859630+0000","last_undegraded":"2024-08-20T05:00:29.859630+0000","last_fullsized":"2024-08-20T05:00:29.859630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:41:42.421383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:01:07.246976+0000","last_change":"2024-08-20T04:59:09.750785+0000","last_active":"2024-08-20T05:01:07.246976+0000","last_peered":"2024-08-20T05:01:07.246976+0000","last_clean":"2024-08-20T05:01:07.246976+0000","last_became_active":"2024-08-20T04:59:09.750255+0000","last_became_peered":"2024-08-20T04:59:09.750255+0000","last_unstale":"2024-08-20T05:01:07.246976+0000","last_undegraded":"2024-08-20T05:01:07.246976+0000","last_fullsized":"2024-08-20T05:01:07.246976+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:20:17.900367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859414+0000","last_change":"2024-08-20T04:59:21.909409+0000","last_active":"2024-08-20T05:00:29.859414+0000","last_peered":"2024-08-20T05:00:29.859414+0000","last_clean":"2024-08-20T05:00:29.859414+0000","last_became_active":"2024-08-20T04:59:21.907934+0000","last_became_peered":"2024-08-20T04:59:21.907934+0000","last_unstale":"2024-08-20T05:00:29.859414+0000","last_undegraded":"2024-08-20T05:00:29.859414+0000","last_fullsized":"2024-08-20T05:00:29.859414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:26:36.768407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365372+0000","last_change":"2024-08-20T04:59:12.783496+0000","last_active":"2024-08-20T05:00:29.365372+0000","last_peered":"2024-08-20T05:00:29.365372+0000","last_clean":"2024-08-20T05:00:29.365372+0000","last_became_active":"2024-08-20T04:59:12.783211+0000","last_became_peered":"2024-08-20T04:59:12.783211+0000","last_unstale":"2024-08-20T05:00:29.365372+0000","last_undegraded":"2024-08-20T05:00:29.365372+0000","last_fullsized":"2024-08-20T05:00:29.365372+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:45:49.514189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":110,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:01:08.247866+0000","last_change":"2024-08-20T04:59:09.948284+0000","last_active":"2024-08-20T05:01:08.247866+0000","last_peered":"2024-08-20T05:01:08.247866+0000","last_clean":"2024-08-20T05:01:08.247866+0000","last_became_active":"2024-08-20T04:59:09.947909+0000","last_became_peered":"2024-08-20T04:59:09.947909+0000","last_unstale":"2024-08-20T05:01:08.247866+0000","last_undegraded":"2024-08-20T05:01:08.247866+0000","last_fullsized":"2024-08-20T05:01:08.247866+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:24:04.344380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859464+0000","last_change":"2024-08-20T04:59:21.905282+0000","last_active":"2024-08-20T05:00:29.859464+0000","last_peered":"2024-08-20T05:00:29.859464+0000","last_clean":"2024-08-20T05:00:29.859464+0000","last_became_active":"2024-08-20T04:59:21.904842+0000","last_became_peered":"2024-08-20T04:59:21.904842+0000","last_unstale":"2024-08-20T05:00:29.859464+0000","last_undegraded":"2024-08-20T05:00:29.859464+0000","last_fullsized":"2024-08-20T05:00:29.859464+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:01:19.949949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.858996+0000","last_change":"2024-08-20T04:59:12.788571+0000","last_active":"2024-08-20T05:00:29.858996+0000","last_peered":"2024-08-20T05:00:29.858996+0000","last_clean":"2024-08-20T05:00:29.858996+0000","last_became_active":"2024-08-20T04:59:12.784148+0000","last_became_peered":"2024-08-20T04:59:12.784148+0000","last_unstale":"2024-08-20T05:00:29.858996+0000","last_undegraded":"2024-08-20T05:00:29.858996+0000","last_fullsized":"2024-08-20T05:00:29.858996+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:10:51.565404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368181+0000","last_change":"2024-08-20T04:59:09.753842+0000","last_active":"2024-08-20T05:00:29.368181+0000","last_peered":"2024-08-20T05:00:29.368181+0000","last_clean":"2024-08-20T05:00:29.368181+0000","last_became_active":"2024-08-20T04:59:09.753439+0000","last_became_peered":"2024-08-20T04:59:09.753439+0000","last_unstale":"2024-08-20T05:00:29.368181+0000","last_undegraded":"2024-08-20T05:00:29.368181+0000","last_fullsized":"2024-08-20T05:00:29.368181+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:54.171964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365701+0000","last_change":"2024-08-20T04:59:21.909621+0000","last_active":"2024-08-20T05:00:29.365701+0000","last_peered":"2024-08-20T05:00:29.365701+0000","last_clean":"2024-08-20T05:00:29.365701+0000","last_became_active":"2024-08-20T04:59:21.909239+0000","last_became_peered":"2024-08-20T04:59:21.909239+0000","last_unstale":"2024-08-20T05:00:29.365701+0000","last_undegraded":"2024-08-20T05:00:29.365701+0000","last_fullsized":"2024-08-20T05:00:29.365701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:53:15.131163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.364933+0000","last_change":"2024-08-20T04:59:12.796643+0000","last_active":"2024-08-20T05:00:29.364933+0000","last_peered":"2024-08-20T05:00:29.364933+0000","last_clean":"2024-08-20T05:00:29.364933+0000","last_became_active":"2024-08-20T04:59:12.796262+0000","last_became_peered":"2024-08-20T04:59:12.796262+0000","last_unstale":"2024-08-20T05:00:29.364933+0000","last_undegraded":"2024-08-20T05:00:29.364933+0000","last_fullsized":"2024-08-20T05:00:29.364933+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:11:37.792359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369170+0000","last_change":"2024-08-20T04:59:09.750550+0000","last_active":"2024-08-20T05:00:29.369170+0000","last_peered":"2024-08-20T05:00:29.369170+0000","last_clean":"2024-08-20T05:00:29.369170+0000","last_became_active":"2024-08-20T04:59:09.750097+0000","last_became_peered":"2024-08-20T04:59:09.750097+0000","last_unstale":"2024-08-20T05:00:29.369170+0000","last_undegraded":"2024-08-20T05:00:29.369170+0000","last_fullsized":"2024-08-20T05:00:29.369170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:32:22.826478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368146+0000","last_change":"2024-08-20T04:57:50.824023+0000","last_active":"2024-08-20T05:00:29.368146+0000","last_peered":"2024-08-20T05:00:29.368146+0000","last_clean":"2024-08-20T05:00:29.368146+0000","last_became_active":"2024-08-20T04:57:50.350587+0000","last_became_peered":"2024-08-20T04:57:50.350587+0000","last_unstale":"2024-08-20T05:00:29.368146+0000","last_undegraded":"2024-08-20T05:00:29.368146+0000","last_fullsized":"2024-08-20T05:00:29.368146+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_clean_scrub_stamp":"2024-08-20T04:54:17.224468+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:59:23.450117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.866133+0000","last_change":"2024-08-20T05:00:29.866063+0000","last_active":"2024-08-20T05:00:29.866133+0000","last_peered":"2024-08-20T05:00:29.866133+0000","last_clean":"2024-08-20T05:00:29.866133+0000","last_became_active":"2024-08-20T05:00:29.861545+0000","last_became_peered":"2024-08-20T05:00:29.861545+0000","last_unstale":"2024-08-20T05:00:29.866133+0000","last_undegraded":"2024-08-20T05:00:29.866133+0000","last_fullsized":"2024-08-20T05:00:29.866133+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:02:18.516044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370614+0000","last_change":"2024-08-20T04:59:12.793799+0000","last_active":"2024-08-20T05:00:29.370614+0000","last_peered":"2024-08-20T05:00:29.370614+0000","last_clean":"2024-08-20T05:00:29.370614+0000","last_became_active":"2024-08-20T04:59:12.793487+0000","last_became_peered":"2024-08-20T04:59:12.793487+0000","last_unstale":"2024-08-20T05:00:29.370614+0000","last_undegraded":"2024-08-20T05:00:29.370614+0000","last_fullsized":"2024-08-20T05:00:29.370614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:08:30.835824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'6","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:01:05.252244+0000","last_change":"2024-08-20T04:59:09.964586+0000","last_active":"2024-08-20T05:01:05.252244+0000","last_peered":"2024-08-20T05:01:05.252244+0000","last_clean":"2024-08-20T05:01:05.252244+0000","last_became_active":"2024-08-20T04:59:09.964258+0000","last_became_peered":"2024-08-20T04:59:09.964258+0000","last_unstale":"2024-08-20T05:01:05.252244+0000","last_undegraded":"2024-08-20T05:01:05.252244+0000","last_fullsized":"2024-08-20T05:01:05.252244+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:37:48.138019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":64,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365264+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T05:00:29.365264+0000","last_peered":"2024-08-20T05:00:29.365264+0000","last_clean":"2024-08-20T05:00:29.365264+0000","last_became_active":"2024-08-20T04:59:21.906197+0000","last_became_peered":"2024-08-20T04:59:21.906197+0000","last_unstale":"2024-08-20T05:00:29.365264+0000","last_undegraded":"2024-08-20T05:00:29.365264+0000","last_fullsized":"2024-08-20T05:00:29.365264+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:10:45.819035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368770+0000","last_change":"2024-08-20T04:59:12.794221+0000","last_active":"2024-08-20T05:00:29.368770+0000","last_peered":"2024-08-20T05:00:29.368770+0000","last_clean":"2024-08-20T05:00:29.368770+0000","last_became_active":"2024-08-20T04:59:12.793680+0000","last_became_peered":"2024-08-20T04:59:12.793680+0000","last_unstale":"2024-08-20T05:00:29.368770+0000","last_undegraded":"2024-08-20T05:00:29.368770+0000","last_fullsized":"2024-08-20T05:00:29.368770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:45.435700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.366097+0000","last_change":"2024-08-20T04:59:09.755955+0000","last_active":"2024-08-20T05:00:29.366097+0000","last_peered":"2024-08-20T05:00:29.366097+0000","last_clean":"2024-08-20T05:00:29.366097+0000","last_became_active":"2024-08-20T04:59:09.755614+0000","last_became_peered":"2024-08-20T04:59:09.755614+0000","last_unstale":"2024-08-20T05:00:29.366097+0000","last_undegraded":"2024-08-20T05:00:29.366097+0000","last_fullsized":"2024-08-20T05:00:29.366097+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:15:06.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369690+0000","last_change":"2024-08-20T04:59:21.915952+0000","last_active":"2024-08-20T05:00:29.369690+0000","last_peered":"2024-08-20T05:00:29.369690+0000","last_clean":"2024-08-20T05:00:29.369690+0000","last_became_active":"2024-08-20T04:59:21.915533+0000","last_became_peered":"2024-08-20T04:59:21.915533+0000","last_unstale":"2024-08-20T05:00:29.369690+0000","last_undegraded":"2024-08-20T05:00:29.369690+0000","last_fullsized":"2024-08-20T05:00:29.369690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:52:54.906061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368511+0000","last_change":"2024-08-20T04:59:12.782663+0000","last_active":"2024-08-20T05:00:29.368511+0000","last_peered":"2024-08-20T05:00:29.368511+0000","last_clean":"2024-08-20T05:00:29.368511+0000","last_became_active":"2024-08-20T04:59:12.782068+0000","last_became_peered":"2024-08-20T04:59:12.782068+0000","last_unstale":"2024-08-20T05:00:29.368511+0000","last_undegraded":"2024-08-20T05:00:29.368511+0000","last_fullsized":"2024-08-20T05:00:29.368511+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:46:39.662033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.858525+0000","last_change":"2024-08-20T04:59:09.747456+0000","last_active":"2024-08-20T05:00:29.858525+0000","last_peered":"2024-08-20T05:00:29.858525+0000","last_clean":"2024-08-20T05:00:29.858525+0000","last_became_active":"2024-08-20T04:59:09.747141+0000","last_became_peered":"2024-08-20T04:59:09.747141+0000","last_unstale":"2024-08-20T05:00:29.858525+0000","last_undegraded":"2024-08-20T05:00:29.858525+0000","last_fullsized":"2024-08-20T05:00:29.858525+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:39:01.600831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365095+0000","last_change":"2024-08-20T04:59:21.898059+0000","last_active":"2024-08-20T05:00:29.365095+0000","last_peered":"2024-08-20T05:00:29.365095+0000","last_clean":"2024-08-20T05:00:29.365095+0000","last_became_active":"2024-08-20T04:59:21.897617+0000","last_became_peered":"2024-08-20T04:59:21.897617+0000","last_unstale":"2024-08-20T05:00:29.365095+0000","last_undegraded":"2024-08-20T05:00:29.365095+0000","last_fullsized":"2024-08-20T05:00:29.365095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:53:21.122106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.372362+0000","last_change":"2024-08-20T05:00:29.372299+0000","last_active":"2024-08-20T05:00:29.372362+0000","last_peered":"2024-08-20T05:00:29.372362+0000","last_clean":"2024-08-20T05:00:29.372362+0000","last_became_active":"2024-08-20T05:00:29.371959+0000","last_became_peered":"2024-08-20T05:00:29.371959+0000","last_unstale":"2024-08-20T05:00:29.372362+0000","last_undegraded":"2024-08-20T05:00:29.372362+0000","last_fullsized":"2024-08-20T05:00:29.372362+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:03.996267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370441+0000","last_change":"2024-08-20T04:59:09.751943+0000","last_active":"2024-08-20T05:00:29.370441+0000","last_peered":"2024-08-20T05:00:29.370441+0000","last_clean":"2024-08-20T05:00:29.370441+0000","last_became_active":"2024-08-20T04:59:09.751586+0000","last_became_peered":"2024-08-20T04:59:09.751586+0000","last_unstale":"2024-08-20T05:00:29.370441+0000","last_undegraded":"2024-08-20T05:00:29.370441+0000","last_fullsized":"2024-08-20T05:00:29.370441+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:35:03.400574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365246+0000","last_change":"2024-08-20T04:59:21.901315+0000","last_active":"2024-08-20T05:00:29.365246+0000","last_peered":"2024-08-20T05:00:29.365246+0000","last_clean":"2024-08-20T05:00:29.365246+0000","last_became_active":"2024-08-20T04:59:21.900871+0000","last_became_peered":"2024-08-20T04:59:21.900871+0000","last_unstale":"2024-08-20T05:00:29.365246+0000","last_undegraded":"2024-08-20T05:00:29.365246+0000","last_fullsized":"2024-08-20T05:00:29.365246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:39:30.940409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365348+0000","last_change":"2024-08-20T04:59:12.793140+0000","last_active":"2024-08-20T05:00:29.365348+0000","last_peered":"2024-08-20T05:00:29.365348+0000","last_clean":"2024-08-20T05:00:29.365348+0000","last_became_active":"2024-08-20T04:59:12.792678+0000","last_became_peered":"2024-08-20T04:59:12.792678+0000","last_unstale":"2024-08-20T05:00:29.365348+0000","last_undegraded":"2024-08-20T05:00:29.365348+0000","last_fullsized":"2024-08-20T05:00:29.365348+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:07:05.610634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":59,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370213+0000","last_change":"2024-08-20T04:59:09.946158+0000","last_active":"2024-08-20T05:00:29.370213+0000","last_peered":"2024-08-20T05:00:29.370213+0000","last_clean":"2024-08-20T05:00:29.370213+0000","last_became_active":"2024-08-20T04:59:09.945736+0000","last_became_peered":"2024-08-20T04:59:09.945736+0000","last_unstale":"2024-08-20T05:00:29.370213+0000","last_undegraded":"2024-08-20T05:00:29.370213+0000","last_fullsized":"2024-08-20T05:00:29.370213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:02.759879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859568+0000","last_change":"2024-08-20T04:59:21.913457+0000","last_active":"2024-08-20T05:00:29.859568+0000","last_peered":"2024-08-20T05:00:29.859568+0000","last_clean":"2024-08-20T05:00:29.859568+0000","last_became_active":"2024-08-20T04:59:21.910468+0000","last_became_peered":"2024-08-20T04:59:21.910468+0000","last_unstale":"2024-08-20T05:00:29.859568+0000","last_undegraded":"2024-08-20T05:00:29.859568+0000","last_fullsized":"2024-08-20T05:00:29.859568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:16:30.817166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367857+0000","last_change":"2024-08-20T04:59:12.788088+0000","last_active":"2024-08-20T05:00:29.367857+0000","last_peered":"2024-08-20T05:00:29.367857+0000","last_clean":"2024-08-20T05:00:29.367857+0000","last_became_active":"2024-08-20T04:59:12.787756+0000","last_became_peered":"2024-08-20T04:59:12.787756+0000","last_unstale":"2024-08-20T05:00:29.367857+0000","last_undegraded":"2024-08-20T05:00:29.367857+0000","last_fullsized":"2024-08-20T05:00:29.367857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:51.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":112,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:01:07.247172+0000","last_change":"2024-08-20T04:59:09.746896+0000","last_active":"2024-08-20T05:01:07.247172+0000","last_peered":"2024-08-20T05:01:07.247172+0000","last_clean":"2024-08-20T05:01:07.247172+0000","last_became_active":"2024-08-20T04:59:09.746570+0000","last_became_peered":"2024-08-20T04:59:09.746570+0000","last_unstale":"2024-08-20T05:01:07.247172+0000","last_undegraded":"2024-08-20T05:01:07.247172+0000","last_fullsized":"2024-08-20T05:01:07.247172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:06:02.395260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":67,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367593+0000","last_change":"2024-08-20T04:59:21.911747+0000","last_active":"2024-08-20T05:00:29.367593+0000","last_peered":"2024-08-20T05:00:29.367593+0000","last_clean":"2024-08-20T05:00:29.367593+0000","last_became_active":"2024-08-20T04:59:21.908861+0000","last_became_peered":"2024-08-20T04:59:21.908861+0000","last_unstale":"2024-08-20T05:00:29.367593+0000","last_undegraded":"2024-08-20T05:00:29.367593+0000","last_fullsized":"2024-08-20T05:00:29.367593+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:22:17.336776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.860964+0000","last_change":"2024-08-20T05:00:29.860903+0000","last_active":"2024-08-20T05:00:29.860964+0000","last_peered":"2024-08-20T05:00:29.860964+0000","last_clean":"2024-08-20T05:00:29.860964+0000","last_became_active":"2024-08-20T05:00:29.860359+0000","last_became_peered":"2024-08-20T05:00:29.860359+0000","last_unstale":"2024-08-20T05:00:29.860964+0000","last_undegraded":"2024-08-20T05:00:29.860964+0000","last_fullsized":"2024-08-20T05:00:29.860964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:27:02.976859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365410+0000","last_change":"2024-08-20T04:59:09.755225+0000","last_active":"2024-08-20T05:00:29.365410+0000","last_peered":"2024-08-20T05:00:29.365410+0000","last_clean":"2024-08-20T05:00:29.365410+0000","last_became_active":"2024-08-20T04:59:09.754580+0000","last_became_peered":"2024-08-20T04:59:09.754580+0000","last_unstale":"2024-08-20T05:00:29.365410+0000","last_undegraded":"2024-08-20T05:00:29.365410+0000","last_fullsized":"2024-08-20T05:00:29.365410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:54:53.606954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368032+0000","last_change":"2024-08-20T04:59:21.905200+0000","last_active":"2024-08-20T05:00:29.368032+0000","last_peered":"2024-08-20T05:00:29.368032+0000","last_clean":"2024-08-20T05:00:29.368032+0000","last_became_active":"2024-08-20T04:59:21.904724+0000","last_became_peered":"2024-08-20T04:59:21.904724+0000","last_unstale":"2024-08-20T05:00:29.368032+0000","last_undegraded":"2024-08-20T05:00:29.368032+0000","last_fullsized":"2024-08-20T05:00:29.368032+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:50:43.446750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859250+0000","last_change":"2024-08-20T04:59:12.787261+0000","last_active":"2024-08-20T05:00:29.859250+0000","last_peered":"2024-08-20T05:00:29.859250+0000","last_clean":"2024-08-20T05:00:29.859250+0000","last_became_active":"2024-08-20T04:59:12.786971+0000","last_became_peered":"2024-08-20T04:59:12.786971+0000","last_unstale":"2024-08-20T05:00:29.859250+0000","last_undegraded":"2024-08-20T05:00:29.859250+0000","last_fullsized":"2024-08-20T05:00:29.859250+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:55:57.209321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368536+0000","last_change":"2024-08-20T04:59:09.749147+0000","last_active":"2024-08-20T05:00:29.368536+0000","last_peered":"2024-08-20T05:00:29.368536+0000","last_clean":"2024-08-20T05:00:29.368536+0000","last_became_active":"2024-08-20T04:59:09.748806+0000","last_became_peered":"2024-08-20T04:59:09.748806+0000","last_unstale":"2024-08-20T05:00:29.368536+0000","last_undegraded":"2024-08-20T05:00:29.368536+0000","last_fullsized":"2024-08-20T05:00:29.368536+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:59:43.377105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365705+0000","last_change":"2024-08-20T04:59:21.905007+0000","last_active":"2024-08-20T05:00:29.365705+0000","last_peered":"2024-08-20T05:00:29.365705+0000","last_clean":"2024-08-20T05:00:29.365705+0000","last_became_active":"2024-08-20T04:59:21.904608+0000","last_became_peered":"2024-08-20T04:59:21.904608+0000","last_unstale":"2024-08-20T05:00:29.365705+0000","last_undegraded":"2024-08-20T05:00:29.365705+0000","last_fullsized":"2024-08-20T05:00:29.365705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:00:42.390966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370670+0000","last_change":"2024-08-20T04:59:12.783339+0000","last_active":"2024-08-20T05:00:29.370670+0000","last_peered":"2024-08-20T05:00:29.370670+0000","last_clean":"2024-08-20T05:00:29.370670+0000","last_became_active":"2024-08-20T04:59:12.783051+0000","last_became_peered":"2024-08-20T04:59:12.783051+0000","last_unstale":"2024-08-20T05:00:29.370670+0000","last_undegraded":"2024-08-20T05:00:29.370670+0000","last_fullsized":"2024-08-20T05:00:29.370670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:23:54.390491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'36","reported_seq":211,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:01:08.423522+0000","last_change":"2024-08-20T04:59:09.754340+0000","last_active":"2024-08-20T05:01:08.423522+0000","last_peered":"2024-08-20T05:01:08.423522+0000","last_clean":"2024-08-20T05:01:08.423522+0000","last_became_active":"2024-08-20T04:59:09.754000+0000","last_became_peered":"2024-08-20T04:59:09.754000+0000","last_unstale":"2024-08-20T05:01:08.423522+0000","last_undegraded":"2024-08-20T05:01:08.423522+0000","last_fullsized":"2024-08-20T05:01:08.423522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:26:17.256961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63480,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":38,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367246+0000","last_change":"2024-08-20T04:59:21.910369+0000","last_active":"2024-08-20T05:00:29.367246+0000","last_peered":"2024-08-20T05:00:29.367246+0000","last_clean":"2024-08-20T05:00:29.367246+0000","last_became_active":"2024-08-20T04:59:21.909941+0000","last_became_peered":"2024-08-20T04:59:21.909941+0000","last_unstale":"2024-08-20T05:00:29.367246+0000","last_undegraded":"2024-08-20T05:00:29.367246+0000","last_fullsized":"2024-08-20T05:00:29.367246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:27:07.088021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365546+0000","last_change":"2024-08-20T04:59:12.787747+0000","last_active":"2024-08-20T05:00:29.365546+0000","last_peered":"2024-08-20T05:00:29.365546+0000","last_clean":"2024-08-20T05:00:29.365546+0000","last_became_active":"2024-08-20T04:59:12.786962+0000","last_became_peered":"2024-08-20T04:59:12.786962+0000","last_unstale":"2024-08-20T05:00:29.365546+0000","last_undegraded":"2024-08-20T05:00:29.365546+0000","last_fullsized":"2024-08-20T05:00:29.365546+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:14:43.822829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365953+0000","last_change":"2024-08-20T04:59:09.947582+0000","last_active":"2024-08-20T05:00:29.365953+0000","last_peered":"2024-08-20T05:00:29.365953+0000","last_clean":"2024-08-20T05:00:29.365953+0000","last_became_active":"2024-08-20T04:59:09.947117+0000","last_became_peered":"2024-08-20T04:59:09.947117+0000","last_unstale":"2024-08-20T05:00:29.365953+0000","last_undegraded":"2024-08-20T05:00:29.365953+0000","last_fullsized":"2024-08-20T05:00:29.365953+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:22:05.815486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368905+0000","last_change":"2024-08-20T04:59:21.910776+0000","last_active":"2024-08-20T05:00:29.368905+0000","last_peered":"2024-08-20T05:00:29.368905+0000","last_clean":"2024-08-20T05:00:29.368905+0000","last_became_active":"2024-08-20T04:59:21.909726+0000","last_became_peered":"2024-08-20T04:59:21.909726+0000","last_unstale":"2024-08-20T05:00:29.368905+0000","last_undegraded":"2024-08-20T05:00:29.368905+0000","last_fullsized":"2024-08-20T05:00:29.368905+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:03:04.042649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.860699+0000","last_change":"2024-08-20T05:00:29.860637+0000","last_active":"2024-08-20T05:00:29.860699+0000","last_peered":"2024-08-20T05:00:29.860699+0000","last_clean":"2024-08-20T05:00:29.860699+0000","last_became_active":"2024-08-20T05:00:29.860250+0000","last_became_peered":"2024-08-20T05:00:29.860250+0000","last_unstale":"2024-08-20T05:00:29.860699+0000","last_undegraded":"2024-08-20T05:00:29.860699+0000","last_fullsized":"2024-08-20T05:00:29.860699+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:11:27.937844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368381+0000","last_change":"2024-08-20T04:59:09.747316+0000","last_active":"2024-08-20T05:00:29.368381+0000","last_peered":"2024-08-20T05:00:29.368381+0000","last_clean":"2024-08-20T05:00:29.368381+0000","last_became_active":"2024-08-20T04:59:09.746959+0000","last_became_peered":"2024-08-20T04:59:09.746959+0000","last_unstale":"2024-08-20T05:00:29.368381+0000","last_undegraded":"2024-08-20T05:00:29.368381+0000","last_fullsized":"2024-08-20T05:00:29.368381+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:28.480465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.366860+0000","last_change":"2024-08-20T04:59:21.907940+0000","last_active":"2024-08-20T05:00:29.366860+0000","last_peered":"2024-08-20T05:00:29.366860+0000","last_clean":"2024-08-20T05:00:29.366860+0000","last_became_active":"2024-08-20T04:59:21.907591+0000","last_became_peered":"2024-08-20T04:59:21.907591+0000","last_unstale":"2024-08-20T05:00:29.366860+0000","last_undegraded":"2024-08-20T05:00:29.366860+0000","last_fullsized":"2024-08-20T05:00:29.366860+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:33.583556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365872+0000","last_change":"2024-08-20T04:59:12.795662+0000","last_active":"2024-08-20T05:00:29.365872+0000","last_peered":"2024-08-20T05:00:29.365872+0000","last_clean":"2024-08-20T05:00:29.365872+0000","last_became_active":"2024-08-20T04:59:12.795321+0000","last_became_peered":"2024-08-20T04:59:12.795321+0000","last_unstale":"2024-08-20T05:00:29.365872+0000","last_undegraded":"2024-08-20T05:00:29.365872+0000","last_fullsized":"2024-08-20T05:00:29.365872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:40:30.561306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":170,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:01:08.256194+0000","last_change":"2024-08-20T04:59:09.754468+0000","last_active":"2024-08-20T05:01:08.256194+0000","last_peered":"2024-08-20T05:01:08.256194+0000","last_clean":"2024-08-20T05:01:08.256194+0000","last_became_active":"2024-08-20T04:59:09.754115+0000","last_became_peered":"2024-08-20T04:59:09.754115+0000","last_unstale":"2024-08-20T05:01:08.256194+0000","last_undegraded":"2024-08-20T05:01:08.256194+0000","last_fullsized":"2024-08-20T05:01:08.256194+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:50:21.301246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":126,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.364784+0000","last_change":"2024-08-20T04:59:21.898785+0000","last_active":"2024-08-20T05:00:29.364784+0000","last_peered":"2024-08-20T05:00:29.364784+0000","last_clean":"2024-08-20T05:00:29.364784+0000","last_became_active":"2024-08-20T04:59:21.898423+0000","last_became_peered":"2024-08-20T04:59:21.898423+0000","last_unstale":"2024-08-20T05:00:29.364784+0000","last_undegraded":"2024-08-20T05:00:29.364784+0000","last_fullsized":"2024-08-20T05:00:29.364784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:52:58.800104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370125+0000","last_change":"2024-08-20T04:59:21.906208+0000","last_active":"2024-08-20T05:00:29.370125+0000","last_peered":"2024-08-20T05:00:29.370125+0000","last_clean":"2024-08-20T05:00:29.370125+0000","last_became_active":"2024-08-20T04:59:21.905041+0000","last_became_peered":"2024-08-20T04:59:21.905041+0000","last_unstale":"2024-08-20T05:00:29.370125+0000","last_undegraded":"2024-08-20T05:00:29.370125+0000","last_fullsized":"2024-08-20T05:00:29.370125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:05:28.971357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.366981+0000","last_change":"2024-08-20T04:59:12.788130+0000","last_active":"2024-08-20T05:00:29.366981+0000","last_peered":"2024-08-20T05:00:29.366981+0000","last_clean":"2024-08-20T05:00:29.366981+0000","last_became_active":"2024-08-20T04:59:12.787665+0000","last_became_peered":"2024-08-20T04:59:12.787665+0000","last_unstale":"2024-08-20T05:00:29.366981+0000","last_undegraded":"2024-08-20T05:00:29.366981+0000","last_fullsized":"2024-08-20T05:00:29.366981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:59:39.628781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365575+0000","last_change":"2024-08-20T04:59:09.754842+0000","last_active":"2024-08-20T05:00:29.365575+0000","last_peered":"2024-08-20T05:00:29.365575+0000","last_clean":"2024-08-20T05:00:29.365575+0000","last_became_active":"2024-08-20T04:59:09.754515+0000","last_became_peered":"2024-08-20T04:59:09.754515+0000","last_unstale":"2024-08-20T05:00:29.365575+0000","last_undegraded":"2024-08-20T05:00:29.365575+0000","last_fullsized":"2024-08-20T05:00:29.365575+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:19:02.241567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368252+0000","last_change":"2024-08-20T04:59:21.900610+0000","last_active":"2024-08-20T05:00:29.368252+0000","last_peered":"2024-08-20T05:00:29.368252+0000","last_clean":"2024-08-20T05:00:29.368252+0000","last_became_active":"2024-08-20T04:59:21.900207+0000","last_became_peered":"2024-08-20T04:59:21.900207+0000","last_unstale":"2024-08-20T05:00:29.368252+0000","last_undegraded":"2024-08-20T05:00:29.368252+0000","last_fullsized":"2024-08-20T05:00:29.368252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:41:00.115344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.364933+0000","last_change":"2024-08-20T04:59:12.780772+0000","last_active":"2024-08-20T05:00:29.364933+0000","last_peered":"2024-08-20T05:00:29.364933+0000","last_clean":"2024-08-20T05:00:29.364933+0000","last_became_active":"2024-08-20T04:59:12.780385+0000","last_became_peered":"2024-08-20T04:59:12.780385+0000","last_unstale":"2024-08-20T05:00:29.364933+0000","last_undegraded":"2024-08-20T05:00:29.364933+0000","last_fullsized":"2024-08-20T05:00:29.364933+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:23.680899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.858475+0000","last_change":"2024-08-20T04:59:09.749567+0000","last_active":"2024-08-20T05:00:29.858475+0000","last_peered":"2024-08-20T05:00:29.858475+0000","last_clean":"2024-08-20T05:00:29.858475+0000","last_became_active":"2024-08-20T04:59:09.749204+0000","last_became_peered":"2024-08-20T04:59:09.749204+0000","last_unstale":"2024-08-20T05:00:29.858475+0000","last_undegraded":"2024-08-20T05:00:29.858475+0000","last_fullsized":"2024-08-20T05:00:29.858475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:57:51.236459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.858361+0000","last_change":"2024-08-20T04:59:09.751622+0000","last_active":"2024-08-20T05:00:29.858361+0000","last_peered":"2024-08-20T05:00:29.858361+0000","last_clean":"2024-08-20T05:00:29.858361+0000","last_became_active":"2024-08-20T04:59:09.751227+0000","last_became_peered":"2024-08-20T04:59:09.751227+0000","last_unstale":"2024-08-20T05:00:29.858361+0000","last_undegraded":"2024-08-20T05:00:29.858361+0000","last_fullsized":"2024-08-20T05:00:29.858361+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:53:38.755122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365460+0000","last_change":"2024-08-20T04:59:12.789243+0000","last_active":"2024-08-20T05:00:29.365460+0000","last_peered":"2024-08-20T05:00:29.365460+0000","last_clean":"2024-08-20T05:00:29.365460+0000","last_became_active":"2024-08-20T04:59:12.788932+0000","last_became_peered":"2024-08-20T04:59:12.788932+0000","last_unstale":"2024-08-20T05:00:29.365460+0000","last_undegraded":"2024-08-20T05:00:29.365460+0000","last_fullsized":"2024-08-20T05:00:29.365460+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:27:00.122328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369078+0000","last_change":"2024-08-20T04:59:21.902847+0000","last_active":"2024-08-20T05:00:29.369078+0000","last_peered":"2024-08-20T05:00:29.369078+0000","last_clean":"2024-08-20T05:00:29.369078+0000","last_became_active":"2024-08-20T04:59:21.902426+0000","last_became_peered":"2024-08-20T04:59:21.902426+0000","last_unstale":"2024-08-20T05:00:29.369078+0000","last_undegraded":"2024-08-20T05:00:29.369078+0000","last_fullsized":"2024-08-20T05:00:29.369078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:18:38.107358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":120,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:01:04.419033+0000","last_change":"2024-08-20T05:00:29.375139+0000","last_active":"2024-08-20T05:01:04.419033+0000","last_peered":"2024-08-20T05:01:04.419033+0000","last_clean":"2024-08-20T05:01:04.419033+0000","last_became_active":"2024-08-20T05:00:29.370896+0000","last_became_peered":"2024-08-20T05:00:29.370896+0000","last_unstale":"2024-08-20T05:01:04.419033+0000","last_undegraded":"2024-08-20T05:01:04.419033+0000","last_fullsized":"2024-08-20T05:01:04.419033+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:06:48.033558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370483+0000","last_change":"2024-08-20T04:59:12.785811+0000","last_active":"2024-08-20T05:00:29.370483+0000","last_peered":"2024-08-20T05:00:29.370483+0000","last_clean":"2024-08-20T05:00:29.370483+0000","last_became_active":"2024-08-20T04:59:12.785483+0000","last_became_peered":"2024-08-20T04:59:12.785483+0000","last_unstale":"2024-08-20T05:00:29.370483+0000","last_undegraded":"2024-08-20T05:00:29.370483+0000","last_fullsized":"2024-08-20T05:00:29.370483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:31:25.355197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368825+0000","last_change":"2024-08-20T04:59:21.897832+0000","last_active":"2024-08-20T05:00:29.368825+0000","last_peered":"2024-08-20T05:00:29.368825+0000","last_clean":"2024-08-20T05:00:29.368825+0000","last_became_active":"2024-08-20T04:59:21.897457+0000","last_became_peered":"2024-08-20T04:59:21.897457+0000","last_unstale":"2024-08-20T05:00:29.368825+0000","last_undegraded":"2024-08-20T05:00:29.368825+0000","last_fullsized":"2024-08-20T05:00:29.368825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:39:51.934014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367695+0000","last_change":"2024-08-20T04:59:12.787671+0000","last_active":"2024-08-20T05:00:29.367695+0000","last_peered":"2024-08-20T05:00:29.367695+0000","last_clean":"2024-08-20T05:00:29.367695+0000","last_became_active":"2024-08-20T04:59:12.787372+0000","last_became_peered":"2024-08-20T04:59:12.787372+0000","last_unstale":"2024-08-20T05:00:29.367695+0000","last_undegraded":"2024-08-20T05:00:29.367695+0000","last_fullsized":"2024-08-20T05:00:29.367695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:16:55.031031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368949+0000","last_change":"2024-08-20T04:59:12.792192+0000","last_active":"2024-08-20T05:00:29.368949+0000","last_peered":"2024-08-20T05:00:29.368949+0000","last_clean":"2024-08-20T05:00:29.368949+0000","last_became_active":"2024-08-20T04:59:12.791447+0000","last_became_peered":"2024-08-20T04:59:12.791447+0000","last_unstale":"2024-08-20T05:00:29.368949+0000","last_undegraded":"2024-08-20T05:00:29.368949+0000","last_fullsized":"2024-08-20T05:00:29.368949+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:03:32.559245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368659+0000","last_change":"2024-08-20T04:59:12.785393+0000","last_active":"2024-08-20T05:00:29.368659+0000","last_peered":"2024-08-20T05:00:29.368659+0000","last_clean":"2024-08-20T05:00:29.368659+0000","last_became_active":"2024-08-20T04:59:12.784998+0000","last_became_peered":"2024-08-20T04:59:12.784998+0000","last_unstale":"2024-08-20T05:00:29.368659+0000","last_undegraded":"2024-08-20T05:00:29.368659+0000","last_fullsized":"2024-08-20T05:00:29.368659+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:27:04.964290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369758+0000","last_change":"2024-08-20T04:59:12.784730+0000","last_active":"2024-08-20T05:00:29.369758+0000","last_peered":"2024-08-20T05:00:29.369758+0000","last_clean":"2024-08-20T05:00:29.369758+0000","last_became_active":"2024-08-20T04:59:12.784269+0000","last_became_peered":"2024-08-20T04:59:12.784269+0000","last_unstale":"2024-08-20T05:00:29.369758+0000","last_undegraded":"2024-08-20T05:00:29.369758+0000","last_fullsized":"2024-08-20T05:00:29.369758+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:43:12.248033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859567+0000","last_change":"2024-08-20T04:59:12.786484+0000","last_active":"2024-08-20T05:00:29.859567+0000","last_peered":"2024-08-20T05:00:29.859567+0000","last_clean":"2024-08-20T05:00:29.859567+0000","last_became_active":"2024-08-20T04:59:12.786166+0000","last_became_peered":"2024-08-20T04:59:12.786166+0000","last_unstale":"2024-08-20T05:00:29.859567+0000","last_undegraded":"2024-08-20T05:00:29.859567+0000","last_fullsized":"2024-08-20T05:00:29.859567+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:30.084519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368496+0000","last_change":"2024-08-20T04:59:12.786985+0000","last_active":"2024-08-20T05:00:29.368496+0000","last_peered":"2024-08-20T05:00:29.368496+0000","last_clean":"2024-08-20T05:00:29.368496+0000","last_became_active":"2024-08-20T04:59:12.786674+0000","last_became_peered":"2024-08-20T04:59:12.786674+0000","last_unstale":"2024-08-20T05:00:29.368496+0000","last_undegraded":"2024-08-20T05:00:29.368496+0000","last_fullsized":"2024-08-20T05:00:29.368496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:30:59.996149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369225+0000","last_change":"2024-08-20T04:59:12.796410+0000","last_active":"2024-08-20T05:00:29.369225+0000","last_peered":"2024-08-20T05:00:29.369225+0000","last_clean":"2024-08-20T05:00:29.369225+0000","last_became_active":"2024-08-20T04:59:12.796081+0000","last_became_peered":"2024-08-20T04:59:12.796081+0000","last_unstale":"2024-08-20T05:00:29.369225+0000","last_undegraded":"2024-08-20T05:00:29.369225+0000","last_fullsized":"2024-08-20T05:00:29.369225+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:49:09.706265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365453+0000","last_change":"2024-08-20T04:59:12.795994+0000","last_active":"2024-08-20T05:00:29.365453+0000","last_peered":"2024-08-20T05:00:29.365453+0000","last_clean":"2024-08-20T05:00:29.365453+0000","last_became_active":"2024-08-20T04:59:12.795604+0000","last_became_peered":"2024-08-20T04:59:12.795604+0000","last_unstale":"2024-08-20T05:00:29.365453+0000","last_undegraded":"2024-08-20T05:00:29.365453+0000","last_fullsized":"2024-08-20T05:00:29.365453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:54:09.628743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365203+0000","last_change":"2024-08-20T04:59:12.788966+0000","last_active":"2024-08-20T05:00:29.365203+0000","last_peered":"2024-08-20T05:00:29.365203+0000","last_clean":"2024-08-20T05:00:29.365203+0000","last_became_active":"2024-08-20T04:59:12.788534+0000","last_became_peered":"2024-08-20T04:59:12.788534+0000","last_unstale":"2024-08-20T05:00:29.365203+0000","last_undegraded":"2024-08-20T05:00:29.365203+0000","last_fullsized":"2024-08-20T05:00:29.365203+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.615399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.364873+0000","last_change":"2024-08-20T04:59:12.785914+0000","last_active":"2024-08-20T05:00:29.364873+0000","last_peered":"2024-08-20T05:00:29.364873+0000","last_clean":"2024-08-20T05:00:29.364873+0000","last_became_active":"2024-08-20T04:59:12.785551+0000","last_became_peered":"2024-08-20T04:59:12.785551+0000","last_unstale":"2024-08-20T05:00:29.364873+0000","last_undegraded":"2024-08-20T05:00:29.364873+0000","last_fullsized":"2024-08-20T05:00:29.364873+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:30:32.072387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365385+0000","last_change":"2024-08-20T04:59:12.795635+0000","last_active":"2024-08-20T05:00:29.365385+0000","last_peered":"2024-08-20T05:00:29.365385+0000","last_clean":"2024-08-20T05:00:29.365385+0000","last_became_active":"2024-08-20T04:59:12.794805+0000","last_became_peered":"2024-08-20T04:59:12.794805+0000","last_unstale":"2024-08-20T05:00:29.365385+0000","last_undegraded":"2024-08-20T05:00:29.365385+0000","last_fullsized":"2024-08-20T05:00:29.365385+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:09:08.725503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859560+0000","last_change":"2024-08-20T04:59:12.785099+0000","last_active":"2024-08-20T05:00:29.859560+0000","last_peered":"2024-08-20T05:00:29.859560+0000","last_clean":"2024-08-20T05:00:29.859560+0000","last_became_active":"2024-08-20T04:59:12.784727+0000","last_became_peered":"2024-08-20T04:59:12.784727+0000","last_unstale":"2024-08-20T05:00:29.859560+0000","last_undegraded":"2024-08-20T05:00:29.859560+0000","last_fullsized":"2024-08-20T05:00:29.859560+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:24:36.227289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368167+0000","last_change":"2024-08-20T04:59:12.781832+0000","last_active":"2024-08-20T05:00:29.368167+0000","last_peered":"2024-08-20T05:00:29.368167+0000","last_clean":"2024-08-20T05:00:29.368167+0000","last_became_active":"2024-08-20T04:59:12.781342+0000","last_became_peered":"2024-08-20T04:59:12.781342+0000","last_unstale":"2024-08-20T05:00:29.368167+0000","last_undegraded":"2024-08-20T05:00:29.368167+0000","last_fullsized":"2024-08-20T05:00:29.368167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:26:17.762048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369226+0000","last_change":"2024-08-20T04:59:12.792350+0000","last_active":"2024-08-20T05:00:29.369226+0000","last_peered":"2024-08-20T05:00:29.369226+0000","last_clean":"2024-08-20T05:00:29.369226+0000","last_became_active":"2024-08-20T04:59:12.792028+0000","last_became_peered":"2024-08-20T04:59:12.792028+0000","last_unstale":"2024-08-20T05:00:29.369226+0000","last_undegraded":"2024-08-20T05:00:29.369226+0000","last_fullsized":"2024-08-20T05:00:29.369226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:16:23.173759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368516+0000","last_change":"2024-08-20T04:59:12.795047+0000","last_active":"2024-08-20T05:00:29.368516+0000","last_peered":"2024-08-20T05:00:29.368516+0000","last_clean":"2024-08-20T05:00:29.368516+0000","last_became_active":"2024-08-20T04:59:12.794705+0000","last_became_peered":"2024-08-20T04:59:12.794705+0000","last_unstale":"2024-08-20T05:00:29.368516+0000","last_undegraded":"2024-08-20T05:00:29.368516+0000","last_fullsized":"2024-08-20T05:00:29.368516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:51:16.355892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369014+0000","last_change":"2024-08-20T04:59:12.785022+0000","last_active":"2024-08-20T05:00:29.369014+0000","last_peered":"2024-08-20T05:00:29.369014+0000","last_clean":"2024-08-20T05:00:29.369014+0000","last_became_active":"2024-08-20T04:59:12.784730+0000","last_became_peered":"2024-08-20T04:59:12.784730+0000","last_unstale":"2024-08-20T05:00:29.369014+0000","last_undegraded":"2024-08-20T05:00:29.369014+0000","last_fullsized":"2024-08-20T05:00:29.369014+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:21:53.053890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365112+0000","last_change":"2024-08-20T04:59:12.790825+0000","last_active":"2024-08-20T05:00:29.365112+0000","last_peered":"2024-08-20T05:00:29.365112+0000","last_clean":"2024-08-20T05:00:29.365112+0000","last_became_active":"2024-08-20T04:59:12.790299+0000","last_became_peered":"2024-08-20T04:59:12.790299+0000","last_unstale":"2024-08-20T05:00:29.365112+0000","last_undegraded":"2024-08-20T05:00:29.365112+0000","last_fullsized":"2024-08-20T05:00:29.365112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:12.477186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.374271+0000","last_change":"2024-08-20T05:00:29.374190+0000","last_active":"2024-08-20T05:00:29.374271+0000","last_peered":"2024-08-20T05:00:29.374271+0000","last_clean":"2024-08-20T05:00:29.374271+0000","last_became_active":"2024-08-20T05:00:29.373844+0000","last_became_peered":"2024-08-20T05:00:29.373844+0000","last_unstale":"2024-08-20T05:00:29.374271+0000","last_undegraded":"2024-08-20T05:00:29.374271+0000","last_fullsized":"2024-08-20T05:00:29.374271+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:03.131340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369384+0000","last_change":"2024-08-20T04:59:12.783355+0000","last_active":"2024-08-20T05:00:29.369384+0000","last_peered":"2024-08-20T05:00:29.369384+0000","last_clean":"2024-08-20T05:00:29.369384+0000","last_became_active":"2024-08-20T04:59:12.782992+0000","last_became_peered":"2024-08-20T04:59:12.782992+0000","last_unstale":"2024-08-20T05:00:29.369384+0000","last_undegraded":"2024-08-20T05:00:29.369384+0000","last_fullsized":"2024-08-20T05:00:29.369384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:09:47.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859373+0000","last_change":"2024-08-20T04:59:12.783989+0000","last_active":"2024-08-20T05:00:29.859373+0000","last_peered":"2024-08-20T05:00:29.859373+0000","last_clean":"2024-08-20T05:00:29.859373+0000","last_became_active":"2024-08-20T04:59:12.783671+0000","last_became_peered":"2024-08-20T04:59:12.783671+0000","last_unstale":"2024-08-20T05:00:29.859373+0000","last_undegraded":"2024-08-20T05:00:29.859373+0000","last_fullsized":"2024-08-20T05:00:29.859373+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:34:55.727599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368401+0000","last_change":"2024-08-20T04:59:12.787118+0000","last_active":"2024-08-20T05:00:29.368401+0000","last_peered":"2024-08-20T05:00:29.368401+0000","last_clean":"2024-08-20T05:00:29.368401+0000","last_became_active":"2024-08-20T04:59:12.786754+0000","last_became_peered":"2024-08-20T04:59:12.786754+0000","last_unstale":"2024-08-20T05:00:29.368401+0000","last_undegraded":"2024-08-20T05:00:29.368401+0000","last_fullsized":"2024-08-20T05:00:29.368401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:13:23.959972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370604+0000","last_change":"2024-08-20T04:59:12.793748+0000","last_active":"2024-08-20T05:00:29.370604+0000","last_peered":"2024-08-20T05:00:29.370604+0000","last_clean":"2024-08-20T05:00:29.370604+0000","last_became_active":"2024-08-20T04:59:12.792550+0000","last_became_peered":"2024-08-20T04:59:12.792550+0000","last_unstale":"2024-08-20T05:00:29.370604+0000","last_undegraded":"2024-08-20T05:00:29.370604+0000","last_fullsized":"2024-08-20T05:00:29.370604+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:59:24.226273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859879+0000","last_change":"2024-08-20T04:59:12.788827+0000","last_active":"2024-08-20T05:00:29.859879+0000","last_peered":"2024-08-20T05:00:29.859879+0000","last_clean":"2024-08-20T05:00:29.859879+0000","last_became_active":"2024-08-20T04:59:12.788395+0000","last_became_peered":"2024-08-20T04:59:12.788395+0000","last_unstale":"2024-08-20T05:00:29.859879+0000","last_undegraded":"2024-08-20T05:00:29.859879+0000","last_fullsized":"2024-08-20T05:00:29.859879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:26.453063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.366031+0000","last_change":"2024-08-20T04:59:12.795513+0000","last_active":"2024-08-20T05:00:29.366031+0000","last_peered":"2024-08-20T05:00:29.366031+0000","last_clean":"2024-08-20T05:00:29.366031+0000","last_became_active":"2024-08-20T04:59:12.795191+0000","last_became_peered":"2024-08-20T04:59:12.795191+0000","last_unstale":"2024-08-20T05:00:29.366031+0000","last_undegraded":"2024-08-20T05:00:29.366031+0000","last_fullsized":"2024-08-20T05:00:29.366031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:04:00.893420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.364815+0000","last_change":"2024-08-20T04:59:12.789825+0000","last_active":"2024-08-20T05:00:29.364815+0000","last_peered":"2024-08-20T05:00:29.364815+0000","last_clean":"2024-08-20T05:00:29.364815+0000","last_became_active":"2024-08-20T04:59:12.788198+0000","last_became_peered":"2024-08-20T04:59:12.788198+0000","last_unstale":"2024-08-20T05:00:29.364815+0000","last_undegraded":"2024-08-20T05:00:29.364815+0000","last_fullsized":"2024-08-20T05:00:29.364815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:10.898308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368799+0000","last_change":"2024-08-20T04:59:12.787707+0000","last_active":"2024-08-20T05:00:29.368799+0000","last_peered":"2024-08-20T05:00:29.368799+0000","last_clean":"2024-08-20T05:00:29.368799+0000","last_became_active":"2024-08-20T04:59:12.787035+0000","last_became_peered":"2024-08-20T04:59:12.787035+0000","last_unstale":"2024-08-20T05:00:29.368799+0000","last_undegraded":"2024-08-20T05:00:29.368799+0000","last_fullsized":"2024-08-20T05:00:29.368799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:16:52.451048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859390+0000","last_change":"2024-08-20T04:59:12.784012+0000","last_active":"2024-08-20T05:00:29.859390+0000","last_peered":"2024-08-20T05:00:29.859390+0000","last_clean":"2024-08-20T05:00:29.859390+0000","last_became_active":"2024-08-20T04:59:12.783599+0000","last_became_peered":"2024-08-20T04:59:12.783599+0000","last_unstale":"2024-08-20T05:00:29.859390+0000","last_undegraded":"2024-08-20T05:00:29.859390+0000","last_fullsized":"2024-08-20T05:00:29.859390+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:23:15.271873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.371130+0000","last_change":"2024-08-20T04:59:12.784987+0000","last_active":"2024-08-20T05:00:29.371130+0000","last_peered":"2024-08-20T05:00:29.371130+0000","last_clean":"2024-08-20T05:00:29.371130+0000","last_became_active":"2024-08-20T04:59:12.784693+0000","last_became_peered":"2024-08-20T04:59:12.784693+0000","last_unstale":"2024-08-20T05:00:29.371130+0000","last_undegraded":"2024-08-20T05:00:29.371130+0000","last_fullsized":"2024-08-20T05:00:29.371130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:07:51.624602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368297+0000","last_change":"2024-08-20T04:59:12.792466+0000","last_active":"2024-08-20T05:00:29.368297+0000","last_peered":"2024-08-20T05:00:29.368297+0000","last_clean":"2024-08-20T05:00:29.368297+0000","last_became_active":"2024-08-20T04:59:12.792114+0000","last_became_peered":"2024-08-20T04:59:12.792114+0000","last_unstale":"2024-08-20T05:00:29.368297+0000","last_undegraded":"2024-08-20T05:00:29.368297+0000","last_fullsized":"2024-08-20T05:00:29.368297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:23:09.919907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368010+0000","last_change":"2024-08-20T04:59:12.793041+0000","last_active":"2024-08-20T05:00:29.368010+0000","last_peered":"2024-08-20T05:00:29.368010+0000","last_clean":"2024-08-20T05:00:29.368010+0000","last_became_active":"2024-08-20T04:59:12.792709+0000","last_became_peered":"2024-08-20T04:59:12.792709+0000","last_unstale":"2024-08-20T05:00:29.368010+0000","last_undegraded":"2024-08-20T05:00:29.368010+0000","last_fullsized":"2024-08-20T05:00:29.368010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:09:04.523493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370129+0000","last_change":"2024-08-20T04:59:12.790256+0000","last_active":"2024-08-20T05:00:29.370129+0000","last_peered":"2024-08-20T05:00:29.370129+0000","last_clean":"2024-08-20T05:00:29.370129+0000","last_became_active":"2024-08-20T04:59:12.788467+0000","last_became_peered":"2024-08-20T04:59:12.788467+0000","last_unstale":"2024-08-20T05:00:29.370129+0000","last_undegraded":"2024-08-20T05:00:29.370129+0000","last_fullsized":"2024-08-20T05:00:29.370129+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:55:31.386030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368431+0000","last_change":"2024-08-20T04:59:12.794882+0000","last_active":"2024-08-20T05:00:29.368431+0000","last_peered":"2024-08-20T05:00:29.368431+0000","last_clean":"2024-08-20T05:00:29.368431+0000","last_became_active":"2024-08-20T04:59:12.794564+0000","last_became_peered":"2024-08-20T04:59:12.794564+0000","last_unstale":"2024-08-20T05:00:29.368431+0000","last_undegraded":"2024-08-20T05:00:29.368431+0000","last_fullsized":"2024-08-20T05:00:29.368431+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:36:47.515754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70684,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":659,"num_read_kb":414,"num_write":250,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":212052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":215,"ondisk_log_size":215,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743462,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":987136,"data_stored":491644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939691,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28680,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716472,"statfs":{"total":95995035648,"available":95965667328,"internally_reserved":0,"allocated":1687552,"data_stored":1146036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103217,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1011712,"data_stored":491183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299446,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1007616,"data_stored":491561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462970,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28592,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716560,"statfs":{"total":95995035648,"available":95965757440,"internally_reserved":0,"allocated":1605632,"data_stored":1088058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626497,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":987136,"data_stored":486687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1613824,"data_stored":1083249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1003520,"data_stored":491774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":999424,"data_stored":486395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1069056,"data_stored":551186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":551197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":488534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T05:01:11.484 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-20T05:01:11.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:11 smithi037 ceph-mon[17265]: pgmap v367: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:11.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:11 smithi037 ceph-mon[17265]: from='client.25091 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:01:11.863 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:11.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:11 smithi135 ceph-mon[22342]: pgmap v367: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:11.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:11 smithi135 ceph-mon[22342]: from='client.25091 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:01:11.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:11 smithi130 ceph-mon[22007]: pgmap v367: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:11.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:11 smithi130 ceph-mon[22007]: from='client.25091 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:01:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.422+0000 7f9b11200640 1 -- 172.21.15.37:0/1459386135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b0c108cb0 msgr2=0x7f9b0c10f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.422+0000 7f9b11200640 1 --2- 172.21.15.37:0/1459386135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b0c108cb0 0x7f9b0c10f4b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9b04009900 tx=0x7f9b0402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:01:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.422+0000 7f9b11200640 1 -- 172.21.15.37:0/1459386135 shutdown_connections 2024-08-20T05:01:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.422+0000 7f9b11200640 1 --2- 172.21.15.37:0/1459386135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b0c108cb0 0x7f9b0c10f4b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.422+0000 7f9b11200640 1 --2- 172.21.15.37:0/1459386135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b0c108330 0x7f9b0c108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.422+0000 7f9b11200640 1 --2- 172.21.15.37:0/1459386135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b0c102920 0x7f9b0c102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.422+0000 7f9b11200640 1 -- 172.21.15.37:0/1459386135 >> 172.21.15.37:0/1459386135 conn(0x7f9b0c0fe350 msgr2=0x7f9b0c100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.422+0000 7f9b11200640 1 -- 172.21.15.37:0/1459386135 shutdown_connections 2024-08-20T05:01:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.422+0000 7f9b11200640 1 -- 172.21.15.37:0/1459386135 wait complete. 2024-08-20T05:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.423+0000 7f9b11200640 1 Processor -- start 2024-08-20T05:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.423+0000 7f9b11200640 1 -- start start 2024-08-20T05:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.424+0000 7f9b11200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b0c102920 0x7f9b0c19aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.424+0000 7f9b11200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b0c108330 0x7f9b0c19b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.424+0000 7f9b11200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b0c108cb0 0x7f9b0c1a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.424+0000 7f9b11200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c1129c0 con 0x7f9b0c108cb0 2024-08-20T05:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.424+0000 7f9b11200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c112840 con 0x7f9b0c102920 2024-08-20T05:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.424+0000 7f9b11200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0c112b40 con 0x7f9b0c108330 2024-08-20T05:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.424+0000 7f9b0be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b0c108cb0 0x7f9b0c1a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.424+0000 7f9b0be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b0c108cb0 0x7f9b0c1a0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43178/0 (socket says 172.21.15.37:43178) 2024-08-20T05:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.424+0000 7f9b0be00640 1 -- 172.21.15.37:0/927671532 learned_addr learned my addr 172.21.15.37:0/927671532 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.424+0000 7f9b0b400640 1 --2- 172.21.15.37:0/927671532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b0c102920 0x7f9b0c19aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.424+0000 7f9b03e00640 1 --2- 172.21.15.37:0/927671532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b0c108330 0x7f9b0c19b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.425+0000 7f9b0be00640 1 -- 172.21.15.37:0/927671532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b0c108330 msgr2=0x7f9b0c19b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.425+0000 7f9b0be00640 1 --2- 172.21.15.37:0/927671532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b0c108330 0x7f9b0c19b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.425+0000 7f9b0be00640 1 -- 172.21.15.37:0/927671532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b0c102920 msgr2=0x7f9b0c19aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.425+0000 7f9b0be00640 1 --2- 172.21.15.37:0/927671532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b0c102920 0x7f9b0c19aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.425+0000 7f9b0be00640 1 -- 172.21.15.37:0/927671532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0c1a0f60 con 0x7f9b0c108cb0 2024-08-20T05:01:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.425+0000 7f9b0be00640 1 --2- 172.21.15.37:0/927671532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b0c108cb0 0x7f9b0c1a0790 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9b0402a910 tx=0x7f9b04003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.425+0000 7f9b08c00640 1 -- 172.21.15.37:0/927671532 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0403f070 con 0x7f9b0c108cb0 2024-08-20T05:01:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.425+0000 7f9b08c00640 1 -- 172.21.15.37:0/927671532 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b04003e20 con 0x7f9b0c108cb0 2024-08-20T05:01:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.425+0000 7f9b08c00640 1 -- 172.21.15.37:0/927671532 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b04035030 con 0x7f9b0c108cb0 2024-08-20T05:01:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.425+0000 7f9b11200640 1 -- 172.21.15.37:0/927671532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b0c1a11f0 con 0x7f9b0c108cb0 2024-08-20T05:01:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.426+0000 7f9b11200640 1 -- 172.21.15.37:0/927671532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b0c1a7910 con 0x7f9b0c108cb0 2024-08-20T05:01:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.427+0000 7f9b11200640 1 -- 172.21.15.37:0/927671532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b0c102d00 con 0x7f9b0c108cb0 2024-08-20T05:01:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.429+0000 7f9b08c00640 1 -- 172.21.15.37:0/927671532 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f9b04042070 con 0x7f9b0c108cb0 2024-08-20T05:01:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.430+0000 7f9b08c00640 1 --2- 172.21.15.37:0/927671532 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9af00b3d90 0x7f9af00b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.430+0000 7f9b08c00640 1 -- 172.21.15.37:0/927671532 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f9b04104400 con 0x7f9b0c108cb0 2024-08-20T05:01:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.430+0000 7f9b0b400640 1 --2- 172.21.15.37:0/927671532 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9af00b3d90 0x7f9af00b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.431+0000 7f9b0b400640 1 --2- 172.21.15.37:0/927671532 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9af00b3d90 0x7f9af00b6250 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9afc005fd0 tx=0x7f9afc009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:12.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.434+0000 7f9b08c00640 1 -- 172.21.15.37:0/927671532 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f9b040caf40 con 0x7f9b0c108cb0 2024-08-20T05:01:12.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.626+0000 7f9b11200640 1 -- 172.21.15.37:0/927671532 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9b0c0632c0 con 0x7f9af00b3d90 2024-08-20T05:01:12.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.631+0000 7f9b08c00640 1 -- 172.21.15.37:0/927671532 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340402 (secure 0 0 0) 0x7f9b0c0632c0 con 0x7f9af00b3d90 2024-08-20T05:01:12.637 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:01:12.638 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-20T05:01:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.638+0000 7f9b11200640 1 -- 172.21.15.37:0/927671532 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9af00b3d90 msgr2=0x7f9af00b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.638+0000 7f9b11200640 1 --2- 172.21.15.37:0/927671532 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9af00b3d90 0x7f9af00b6250 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9afc005fd0 tx=0x7f9afc009760 comp rx=0 tx=0).stop 2024-08-20T05:01:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.638+0000 7f9b11200640 1 -- 172.21.15.37:0/927671532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b0c108cb0 msgr2=0x7f9b0c1a0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:12.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.638+0000 7f9b11200640 1 --2- 172.21.15.37:0/927671532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b0c108cb0 0x7f9b0c1a0790 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9b0402a910 tx=0x7f9b04003c00 comp rx=0 tx=0).stop 2024-08-20T05:01:12.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.638+0000 7f9b11200640 1 -- 172.21.15.37:0/927671532 shutdown_connections 2024-08-20T05:01:12.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.638+0000 7f9b11200640 1 --2- 172.21.15.37:0/927671532 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9af00b3d90 0x7f9af00b6250 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:12.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.638+0000 7f9b11200640 1 --2- 172.21.15.37:0/927671532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b0c108cb0 0x7f9b0c1a0790 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:12.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.638+0000 7f9b11200640 1 --2- 172.21.15.37:0/927671532 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b0c108330 0x7f9b0c19b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:12.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.638+0000 7f9b11200640 1 --2- 172.21.15.37:0/927671532 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b0c102920 0x7f9b0c19aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:12.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.638+0000 7f9b11200640 1 -- 172.21.15.37:0/927671532 >> 172.21.15.37:0/927671532 conn(0x7f9b0c0fe350 msgr2=0x7f9b0c1048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:12.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.638+0000 7f9b11200640 1 -- 172.21.15.37:0/927671532 shutdown_connections 2024-08-20T05:01:12.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:12.638+0000 7f9b11200640 1 -- 172.21.15.37:0/927671532 wait complete. 2024-08-20T05:01:13.435 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":368,"stamp":"2024-08-20T05:01:12.002693+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661286,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":745,"num_read_kb":478,"num_write":375,"num_write_kb":2296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":2952579,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":309,"ondisk_log_size":309,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":363012,"kb_used_data":13712,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124578812,"statfs":{"total":1151940427776,"available":1151568703488,"internally_reserved":0,"allocated":14041088,"data_stored":7847504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003682"},"pg_stats":[{"pgid":"2.1f","version":"84'13","reported_seq":115,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:01:06.245102+0000","last_change":"2024-08-20T04:59:09.751382+0000","last_active":"2024-08-20T05:01:06.245102+0000","last_peered":"2024-08-20T05:01:06.245102+0000","last_clean":"2024-08-20T05:01:06.245102+0000","last_became_active":"2024-08-20T04:59:09.751026+0000","last_became_peered":"2024-08-20T04:59:09.751026+0000","last_unstale":"2024-08-20T05:01:06.245102+0000","last_undegraded":"2024-08-20T05:01:06.245102+0000","last_fullsized":"2024-08-20T05:01:06.245102+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:14:50.107767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.372274+0000","last_change":"2024-08-20T05:00:29.371826+0000","last_active":"2024-08-20T05:00:29.372274+0000","last_peered":"2024-08-20T05:00:29.372274+0000","last_clean":"2024-08-20T05:00:29.372274+0000","last_became_active":"2024-08-20T05:00:29.371618+0000","last_became_peered":"2024-08-20T05:00:29.371618+0000","last_unstale":"2024-08-20T05:00:29.372274+0000","last_undegraded":"2024-08-20T05:00:29.372274+0000","last_fullsized":"2024-08-20T05:00:29.372274+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:34:36.786900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368608+0000","last_change":"2024-08-20T04:59:21.902558+0000","last_active":"2024-08-20T05:00:29.368608+0000","last_peered":"2024-08-20T05:00:29.368608+0000","last_clean":"2024-08-20T05:00:29.368608+0000","last_became_active":"2024-08-20T04:59:21.902119+0000","last_became_peered":"2024-08-20T04:59:21.902119+0000","last_unstale":"2024-08-20T05:00:29.368608+0000","last_undegraded":"2024-08-20T05:00:29.368608+0000","last_fullsized":"2024-08-20T05:00:29.368608+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:53.765865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365468+0000","last_change":"2024-08-20T04:59:09.946282+0000","last_active":"2024-08-20T05:00:29.365468+0000","last_peered":"2024-08-20T05:00:29.365468+0000","last_clean":"2024-08-20T05:00:29.365468+0000","last_became_active":"2024-08-20T04:59:09.945867+0000","last_became_peered":"2024-08-20T04:59:09.945867+0000","last_unstale":"2024-08-20T05:00:29.365468+0000","last_undegraded":"2024-08-20T05:00:29.365468+0000","last_fullsized":"2024-08-20T05:00:29.365468+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:29:08.119504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370420+0000","last_change":"2024-08-20T04:59:12.796121+0000","last_active":"2024-08-20T05:00:29.370420+0000","last_peered":"2024-08-20T05:00:29.370420+0000","last_clean":"2024-08-20T05:00:29.370420+0000","last_became_active":"2024-08-20T04:59:12.792764+0000","last_became_peered":"2024-08-20T04:59:12.792764+0000","last_unstale":"2024-08-20T05:00:29.370420+0000","last_undegraded":"2024-08-20T05:00:29.370420+0000","last_fullsized":"2024-08-20T05:00:29.370420+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:01:53.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367270+0000","last_change":"2024-08-20T04:59:21.909607+0000","last_active":"2024-08-20T05:00:29.367270+0000","last_peered":"2024-08-20T05:00:29.367270+0000","last_clean":"2024-08-20T05:00:29.367270+0000","last_became_active":"2024-08-20T04:59:21.909175+0000","last_became_peered":"2024-08-20T04:59:21.909175+0000","last_unstale":"2024-08-20T05:00:29.367270+0000","last_undegraded":"2024-08-20T05:00:29.367270+0000","last_fullsized":"2024-08-20T05:00:29.367270+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:29:49.940169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370874+0000","last_change":"2024-08-20T04:59:09.753233+0000","last_active":"2024-08-20T05:00:29.370874+0000","last_peered":"2024-08-20T05:00:29.370874+0000","last_clean":"2024-08-20T05:00:29.370874+0000","last_became_active":"2024-08-20T04:59:09.752614+0000","last_became_peered":"2024-08-20T04:59:09.752614+0000","last_unstale":"2024-08-20T05:00:29.370874+0000","last_undegraded":"2024-08-20T05:00:29.370874+0000","last_fullsized":"2024-08-20T05:00:29.370874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:04:20.199669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365558+0000","last_change":"2024-08-20T04:59:12.799116+0000","last_active":"2024-08-20T05:00:29.365558+0000","last_peered":"2024-08-20T05:00:29.365558+0000","last_clean":"2024-08-20T05:00:29.365558+0000","last_became_active":"2024-08-20T04:59:12.798725+0000","last_became_peered":"2024-08-20T04:59:12.798725+0000","last_unstale":"2024-08-20T05:00:29.365558+0000","last_undegraded":"2024-08-20T05:00:29.365558+0000","last_fullsized":"2024-08-20T05:00:29.365558+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:46.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.373069+0000","last_change":"2024-08-20T05:00:29.372973+0000","last_active":"2024-08-20T05:00:29.373069+0000","last_peered":"2024-08-20T05:00:29.373069+0000","last_clean":"2024-08-20T05:00:29.373069+0000","last_became_active":"2024-08-20T05:00:29.372504+0000","last_became_peered":"2024-08-20T05:00:29.372504+0000","last_unstale":"2024-08-20T05:00:29.373069+0000","last_undegraded":"2024-08-20T05:00:29.373069+0000","last_fullsized":"2024-08-20T05:00:29.373069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:22:22.410569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.371125+0000","last_change":"2024-08-20T04:59:09.752771+0000","last_active":"2024-08-20T05:00:29.371125+0000","last_peered":"2024-08-20T05:00:29.371125+0000","last_clean":"2024-08-20T05:00:29.371125+0000","last_became_active":"2024-08-20T04:59:09.752415+0000","last_became_peered":"2024-08-20T04:59:09.752415+0000","last_unstale":"2024-08-20T05:00:29.371125+0000","last_undegraded":"2024-08-20T05:00:29.371125+0000","last_fullsized":"2024-08-20T05:00:29.371125+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:13:18.843587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365825+0000","last_change":"2024-08-20T04:59:12.794418+0000","last_active":"2024-08-20T05:00:29.365825+0000","last_peered":"2024-08-20T05:00:29.365825+0000","last_clean":"2024-08-20T05:00:29.365825+0000","last_became_active":"2024-08-20T04:59:12.794117+0000","last_became_peered":"2024-08-20T04:59:12.794117+0000","last_unstale":"2024-08-20T05:00:29.365825+0000","last_undegraded":"2024-08-20T05:00:29.365825+0000","last_fullsized":"2024-08-20T05:00:29.365825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:18.209690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367317+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T05:00:29.367317+0000","last_peered":"2024-08-20T05:00:29.367317+0000","last_clean":"2024-08-20T05:00:29.367317+0000","last_became_active":"2024-08-20T04:59:21.906344+0000","last_became_peered":"2024-08-20T04:59:21.906344+0000","last_unstale":"2024-08-20T05:00:29.367317+0000","last_undegraded":"2024-08-20T05:00:29.367317+0000","last_fullsized":"2024-08-20T05:00:29.367317+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:48:34.982558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368091+0000","last_change":"2024-08-20T04:59:12.792719+0000","last_active":"2024-08-20T05:00:29.368091+0000","last_peered":"2024-08-20T05:00:29.368091+0000","last_clean":"2024-08-20T05:00:29.368091+0000","last_became_active":"2024-08-20T04:59:12.792294+0000","last_became_peered":"2024-08-20T04:59:12.792294+0000","last_unstale":"2024-08-20T05:00:29.368091+0000","last_undegraded":"2024-08-20T05:00:29.368091+0000","last_fullsized":"2024-08-20T05:00:29.368091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:20:03.593798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.371257+0000","last_change":"2024-08-20T04:59:09.753804+0000","last_active":"2024-08-20T05:00:29.371257+0000","last_peered":"2024-08-20T05:00:29.371257+0000","last_clean":"2024-08-20T05:00:29.371257+0000","last_became_active":"2024-08-20T04:59:09.753493+0000","last_became_peered":"2024-08-20T04:59:09.753493+0000","last_unstale":"2024-08-20T05:00:29.371257+0000","last_undegraded":"2024-08-20T05:00:29.371257+0000","last_fullsized":"2024-08-20T05:00:29.371257+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:50:26.306087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368530+0000","last_change":"2024-08-20T04:59:21.902445+0000","last_active":"2024-08-20T05:00:29.368530+0000","last_peered":"2024-08-20T05:00:29.368530+0000","last_clean":"2024-08-20T05:00:29.368530+0000","last_became_active":"2024-08-20T04:59:21.901950+0000","last_became_peered":"2024-08-20T04:59:21.901950+0000","last_unstale":"2024-08-20T05:00:29.368530+0000","last_undegraded":"2024-08-20T05:00:29.368530+0000","last_fullsized":"2024-08-20T05:00:29.368530+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:55:28.653841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365055+0000","last_change":"2024-08-20T04:59:12.784236+0000","last_active":"2024-08-20T05:00:29.365055+0000","last_peered":"2024-08-20T05:00:29.365055+0000","last_clean":"2024-08-20T05:00:29.365055+0000","last_became_active":"2024-08-20T04:59:12.783945+0000","last_became_peered":"2024-08-20T04:59:12.783945+0000","last_unstale":"2024-08-20T05:00:29.365055+0000","last_undegraded":"2024-08-20T05:00:29.365055+0000","last_fullsized":"2024-08-20T05:00:29.365055+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:43:07.137543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368744+0000","last_change":"2024-08-20T04:59:09.751661+0000","last_active":"2024-08-20T05:00:29.368744+0000","last_peered":"2024-08-20T05:00:29.368744+0000","last_clean":"2024-08-20T05:00:29.368744+0000","last_became_active":"2024-08-20T04:59:09.751326+0000","last_became_peered":"2024-08-20T04:59:09.751326+0000","last_unstale":"2024-08-20T05:00:29.368744+0000","last_undegraded":"2024-08-20T05:00:29.368744+0000","last_fullsized":"2024-08-20T05:00:29.368744+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:54.751929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368110+0000","last_change":"2024-08-20T04:59:21.913657+0000","last_active":"2024-08-20T05:00:29.368110+0000","last_peered":"2024-08-20T05:00:29.368110+0000","last_clean":"2024-08-20T05:00:29.368110+0000","last_became_active":"2024-08-20T04:59:21.913187+0000","last_became_peered":"2024-08-20T04:59:21.913187+0000","last_unstale":"2024-08-20T05:00:29.368110+0000","last_undegraded":"2024-08-20T05:00:29.368110+0000","last_fullsized":"2024-08-20T05:00:29.368110+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:51:29.008810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367794+0000","last_change":"2024-08-20T04:59:12.780137+0000","last_active":"2024-08-20T05:00:29.367794+0000","last_peered":"2024-08-20T05:00:29.367794+0000","last_clean":"2024-08-20T05:00:29.367794+0000","last_became_active":"2024-08-20T04:59:12.779820+0000","last_became_peered":"2024-08-20T04:59:12.779820+0000","last_unstale":"2024-08-20T05:00:29.367794+0000","last_undegraded":"2024-08-20T05:00:29.367794+0000","last_fullsized":"2024-08-20T05:00:29.367794+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:33:58.204255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.364999+0000","last_change":"2024-08-20T04:59:09.750521+0000","last_active":"2024-08-20T05:00:29.364999+0000","last_peered":"2024-08-20T05:00:29.364999+0000","last_clean":"2024-08-20T05:00:29.364999+0000","last_became_active":"2024-08-20T04:59:09.750115+0000","last_became_peered":"2024-08-20T04:59:09.750115+0000","last_unstale":"2024-08-20T05:00:29.364999+0000","last_undegraded":"2024-08-20T05:00:29.364999+0000","last_fullsized":"2024-08-20T05:00:29.364999+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:44:20.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367494+0000","last_change":"2024-08-20T04:59:21.910737+0000","last_active":"2024-08-20T05:00:29.367494+0000","last_peered":"2024-08-20T05:00:29.367494+0000","last_clean":"2024-08-20T05:00:29.367494+0000","last_became_active":"2024-08-20T04:59:21.910104+0000","last_became_peered":"2024-08-20T04:59:21.910104+0000","last_unstale":"2024-08-20T05:00:29.367494+0000","last_undegraded":"2024-08-20T05:00:29.367494+0000","last_fullsized":"2024-08-20T05:00:29.367494+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:17:40.436885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.373058+0000","last_change":"2024-08-20T04:59:12.787285+0000","last_active":"2024-08-20T05:00:29.373058+0000","last_peered":"2024-08-20T05:00:29.373058+0000","last_clean":"2024-08-20T05:00:29.373058+0000","last_became_active":"2024-08-20T04:59:12.786998+0000","last_became_peered":"2024-08-20T04:59:12.786998+0000","last_unstale":"2024-08-20T05:00:29.373058+0000","last_undegraded":"2024-08-20T05:00:29.373058+0000","last_fullsized":"2024-08-20T05:00:29.373058+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:12:49.860291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365264+0000","last_change":"2024-08-20T04:59:09.947715+0000","last_active":"2024-08-20T05:00:29.365264+0000","last_peered":"2024-08-20T05:00:29.365264+0000","last_clean":"2024-08-20T05:00:29.365264+0000","last_became_active":"2024-08-20T04:59:09.947372+0000","last_became_peered":"2024-08-20T04:59:09.947372+0000","last_unstale":"2024-08-20T05:00:29.365264+0000","last_undegraded":"2024-08-20T05:00:29.365264+0000","last_fullsized":"2024-08-20T05:00:29.365264+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:42:04.352964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.860632+0000","last_change":"2024-08-20T05:00:29.860562+0000","last_active":"2024-08-20T05:00:29.860632+0000","last_peered":"2024-08-20T05:00:29.860632+0000","last_clean":"2024-08-20T05:00:29.860632+0000","last_became_active":"2024-08-20T05:00:29.859944+0000","last_became_peered":"2024-08-20T05:00:29.859944+0000","last_unstale":"2024-08-20T05:00:29.860632+0000","last_undegraded":"2024-08-20T05:00:29.860632+0000","last_fullsized":"2024-08-20T05:00:29.860632+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:47.266712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370234+0000","last_change":"2024-08-20T04:59:12.785952+0000","last_active":"2024-08-20T05:00:29.370234+0000","last_peered":"2024-08-20T05:00:29.370234+0000","last_clean":"2024-08-20T05:00:29.370234+0000","last_became_active":"2024-08-20T04:59:12.785596+0000","last_became_peered":"2024-08-20T04:59:12.785596+0000","last_unstale":"2024-08-20T05:00:29.370234+0000","last_undegraded":"2024-08-20T05:00:29.370234+0000","last_fullsized":"2024-08-20T05:00:29.370234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:47.299560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":48,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369153+0000","last_change":"2024-08-20T04:59:09.964725+0000","last_active":"2024-08-20T05:00:29.369153+0000","last_peered":"2024-08-20T05:00:29.369153+0000","last_clean":"2024-08-20T05:00:29.369153+0000","last_became_active":"2024-08-20T04:59:09.964351+0000","last_became_peered":"2024-08-20T04:59:09.964351+0000","last_unstale":"2024-08-20T05:00:29.369153+0000","last_undegraded":"2024-08-20T05:00:29.369153+0000","last_fullsized":"2024-08-20T05:00:29.369153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:26:03.216378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368992+0000","last_change":"2024-08-20T04:59:21.898758+0000","last_active":"2024-08-20T05:00:29.368992+0000","last_peered":"2024-08-20T05:00:29.368992+0000","last_clean":"2024-08-20T05:00:29.368992+0000","last_became_active":"2024-08-20T04:59:21.898282+0000","last_became_peered":"2024-08-20T04:59:21.898282+0000","last_unstale":"2024-08-20T05:00:29.368992+0000","last_undegraded":"2024-08-20T05:00:29.368992+0000","last_fullsized":"2024-08-20T05:00:29.368992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:45:49.093459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365479+0000","last_change":"2024-08-20T04:59:12.793870+0000","last_active":"2024-08-20T05:00:29.365479+0000","last_peered":"2024-08-20T05:00:29.365479+0000","last_clean":"2024-08-20T05:00:29.365479+0000","last_became_active":"2024-08-20T04:59:12.792928+0000","last_became_peered":"2024-08-20T04:59:12.792928+0000","last_unstale":"2024-08-20T05:00:29.365479+0000","last_undegraded":"2024-08-20T05:00:29.365479+0000","last_fullsized":"2024-08-20T05:00:29.365479+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:12:25.450347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"84'15","reported_seq":54,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368608+0000","last_change":"2024-08-20T04:59:09.751403+0000","last_active":"2024-08-20T05:00:29.368608+0000","last_peered":"2024-08-20T05:00:29.368608+0000","last_clean":"2024-08-20T05:00:29.368608+0000","last_became_active":"2024-08-20T04:59:09.750976+0000","last_became_peered":"2024-08-20T04:59:09.750976+0000","last_unstale":"2024-08-20T05:00:29.368608+0000","last_undegraded":"2024-08-20T05:00:29.368608+0000","last_fullsized":"2024-08-20T05:00:29.368608+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:58:54.627836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.364684+0000","last_change":"2024-08-20T04:59:21.899813+0000","last_active":"2024-08-20T05:00:29.364684+0000","last_peered":"2024-08-20T05:00:29.364684+0000","last_clean":"2024-08-20T05:00:29.364684+0000","last_became_active":"2024-08-20T04:59:21.899462+0000","last_became_peered":"2024-08-20T04:59:21.899462+0000","last_unstale":"2024-08-20T05:00:29.364684+0000","last_undegraded":"2024-08-20T05:00:29.364684+0000","last_fullsized":"2024-08-20T05:00:29.364684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.468845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859599+0000","last_change":"2024-08-20T04:59:12.783953+0000","last_active":"2024-08-20T05:00:29.859599+0000","last_peered":"2024-08-20T05:00:29.859599+0000","last_clean":"2024-08-20T05:00:29.859599+0000","last_became_active":"2024-08-20T04:59:12.781445+0000","last_became_peered":"2024-08-20T04:59:12.781445+0000","last_unstale":"2024-08-20T05:00:29.859599+0000","last_undegraded":"2024-08-20T05:00:29.859599+0000","last_fullsized":"2024-08-20T05:00:29.859599+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:04.792064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.371001+0000","last_change":"2024-08-20T04:59:09.947194+0000","last_active":"2024-08-20T05:00:29.371001+0000","last_peered":"2024-08-20T05:00:29.371001+0000","last_clean":"2024-08-20T05:00:29.371001+0000","last_became_active":"2024-08-20T04:59:09.946822+0000","last_became_peered":"2024-08-20T04:59:09.946822+0000","last_unstale":"2024-08-20T05:00:29.371001+0000","last_undegraded":"2024-08-20T05:00:29.371001+0000","last_fullsized":"2024-08-20T05:00:29.371001+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:23:08.279378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367908+0000","last_change":"2024-08-20T04:59:21.905202+0000","last_active":"2024-08-20T05:00:29.367908+0000","last_peered":"2024-08-20T05:00:29.367908+0000","last_clean":"2024-08-20T05:00:29.367908+0000","last_became_active":"2024-08-20T04:59:21.904771+0000","last_became_peered":"2024-08-20T04:59:21.904771+0000","last_unstale":"2024-08-20T05:00:29.367908+0000","last_undegraded":"2024-08-20T05:00:29.367908+0000","last_fullsized":"2024-08-20T05:00:29.367908+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:35:56.887981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859479+0000","last_change":"2024-08-20T04:59:12.798301+0000","last_active":"2024-08-20T05:00:29.859479+0000","last_peered":"2024-08-20T05:00:29.859479+0000","last_clean":"2024-08-20T05:00:29.859479+0000","last_became_active":"2024-08-20T04:59:12.797934+0000","last_became_peered":"2024-08-20T04:59:12.797934+0000","last_unstale":"2024-08-20T05:00:29.859479+0000","last_undegraded":"2024-08-20T05:00:29.859479+0000","last_fullsized":"2024-08-20T05:00:29.859479+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:41:24.465380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":40,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367656+0000","last_change":"2024-08-20T04:59:09.947602+0000","last_active":"2024-08-20T05:00:29.367656+0000","last_peered":"2024-08-20T05:00:29.367656+0000","last_clean":"2024-08-20T05:00:29.367656+0000","last_became_active":"2024-08-20T04:59:09.946795+0000","last_became_peered":"2024-08-20T04:59:09.946795+0000","last_unstale":"2024-08-20T05:00:29.367656+0000","last_undegraded":"2024-08-20T05:00:29.367656+0000","last_fullsized":"2024-08-20T05:00:29.367656+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:09:09.003266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.860919+0000","last_change":"2024-08-20T05:00:29.860828+0000","last_active":"2024-08-20T05:00:29.860919+0000","last_peered":"2024-08-20T05:00:29.860919+0000","last_clean":"2024-08-20T05:00:29.860919+0000","last_became_active":"2024-08-20T05:00:29.860242+0000","last_became_peered":"2024-08-20T05:00:29.860242+0000","last_unstale":"2024-08-20T05:00:29.860919+0000","last_undegraded":"2024-08-20T05:00:29.860919+0000","last_fullsized":"2024-08-20T05:00:29.860919+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:09:42.311207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859630+0000","last_change":"2024-08-20T04:59:12.784852+0000","last_active":"2024-08-20T05:00:29.859630+0000","last_peered":"2024-08-20T05:00:29.859630+0000","last_clean":"2024-08-20T05:00:29.859630+0000","last_became_active":"2024-08-20T04:59:12.784496+0000","last_became_peered":"2024-08-20T04:59:12.784496+0000","last_unstale":"2024-08-20T05:00:29.859630+0000","last_undegraded":"2024-08-20T05:00:29.859630+0000","last_fullsized":"2024-08-20T05:00:29.859630+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:41:42.421383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":108,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:01:07.246976+0000","last_change":"2024-08-20T04:59:09.750785+0000","last_active":"2024-08-20T05:01:07.246976+0000","last_peered":"2024-08-20T05:01:07.246976+0000","last_clean":"2024-08-20T05:01:07.246976+0000","last_became_active":"2024-08-20T04:59:09.750255+0000","last_became_peered":"2024-08-20T04:59:09.750255+0000","last_unstale":"2024-08-20T05:01:07.246976+0000","last_undegraded":"2024-08-20T05:01:07.246976+0000","last_fullsized":"2024-08-20T05:01:07.246976+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:20:17.900367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859414+0000","last_change":"2024-08-20T04:59:21.909409+0000","last_active":"2024-08-20T05:00:29.859414+0000","last_peered":"2024-08-20T05:00:29.859414+0000","last_clean":"2024-08-20T05:00:29.859414+0000","last_became_active":"2024-08-20T04:59:21.907934+0000","last_became_peered":"2024-08-20T04:59:21.907934+0000","last_unstale":"2024-08-20T05:00:29.859414+0000","last_undegraded":"2024-08-20T05:00:29.859414+0000","last_fullsized":"2024-08-20T05:00:29.859414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:26:36.768407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365372+0000","last_change":"2024-08-20T04:59:12.783496+0000","last_active":"2024-08-20T05:00:29.365372+0000","last_peered":"2024-08-20T05:00:29.365372+0000","last_clean":"2024-08-20T05:00:29.365372+0000","last_became_active":"2024-08-20T04:59:12.783211+0000","last_became_peered":"2024-08-20T04:59:12.783211+0000","last_unstale":"2024-08-20T05:00:29.365372+0000","last_undegraded":"2024-08-20T05:00:29.365372+0000","last_fullsized":"2024-08-20T05:00:29.365372+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:45:49.514189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":110,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:01:08.247866+0000","last_change":"2024-08-20T04:59:09.948284+0000","last_active":"2024-08-20T05:01:08.247866+0000","last_peered":"2024-08-20T05:01:08.247866+0000","last_clean":"2024-08-20T05:01:08.247866+0000","last_became_active":"2024-08-20T04:59:09.947909+0000","last_became_peered":"2024-08-20T04:59:09.947909+0000","last_unstale":"2024-08-20T05:01:08.247866+0000","last_undegraded":"2024-08-20T05:01:08.247866+0000","last_fullsized":"2024-08-20T05:01:08.247866+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:24:04.344380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":65,"num_read_kb":65,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859464+0000","last_change":"2024-08-20T04:59:21.905282+0000","last_active":"2024-08-20T05:00:29.859464+0000","last_peered":"2024-08-20T05:00:29.859464+0000","last_clean":"2024-08-20T05:00:29.859464+0000","last_became_active":"2024-08-20T04:59:21.904842+0000","last_became_peered":"2024-08-20T04:59:21.904842+0000","last_unstale":"2024-08-20T05:00:29.859464+0000","last_undegraded":"2024-08-20T05:00:29.859464+0000","last_fullsized":"2024-08-20T05:00:29.859464+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:01:19.949949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.858996+0000","last_change":"2024-08-20T04:59:12.788571+0000","last_active":"2024-08-20T05:00:29.858996+0000","last_peered":"2024-08-20T05:00:29.858996+0000","last_clean":"2024-08-20T05:00:29.858996+0000","last_became_active":"2024-08-20T04:59:12.784148+0000","last_became_peered":"2024-08-20T04:59:12.784148+0000","last_unstale":"2024-08-20T05:00:29.858996+0000","last_undegraded":"2024-08-20T05:00:29.858996+0000","last_fullsized":"2024-08-20T05:00:29.858996+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:10:51.565404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368181+0000","last_change":"2024-08-20T04:59:09.753842+0000","last_active":"2024-08-20T05:00:29.368181+0000","last_peered":"2024-08-20T05:00:29.368181+0000","last_clean":"2024-08-20T05:00:29.368181+0000","last_became_active":"2024-08-20T04:59:09.753439+0000","last_became_peered":"2024-08-20T04:59:09.753439+0000","last_unstale":"2024-08-20T05:00:29.368181+0000","last_undegraded":"2024-08-20T05:00:29.368181+0000","last_fullsized":"2024-08-20T05:00:29.368181+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:54.171964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365701+0000","last_change":"2024-08-20T04:59:21.909621+0000","last_active":"2024-08-20T05:00:29.365701+0000","last_peered":"2024-08-20T05:00:29.365701+0000","last_clean":"2024-08-20T05:00:29.365701+0000","last_became_active":"2024-08-20T04:59:21.909239+0000","last_became_peered":"2024-08-20T04:59:21.909239+0000","last_unstale":"2024-08-20T05:00:29.365701+0000","last_undegraded":"2024-08-20T05:00:29.365701+0000","last_fullsized":"2024-08-20T05:00:29.365701+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:53:15.131163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.364933+0000","last_change":"2024-08-20T04:59:12.796643+0000","last_active":"2024-08-20T05:00:29.364933+0000","last_peered":"2024-08-20T05:00:29.364933+0000","last_clean":"2024-08-20T05:00:29.364933+0000","last_became_active":"2024-08-20T04:59:12.796262+0000","last_became_peered":"2024-08-20T04:59:12.796262+0000","last_unstale":"2024-08-20T05:00:29.364933+0000","last_undegraded":"2024-08-20T05:00:29.364933+0000","last_fullsized":"2024-08-20T05:00:29.364933+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:11:37.792359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":49,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369170+0000","last_change":"2024-08-20T04:59:09.750550+0000","last_active":"2024-08-20T05:00:29.369170+0000","last_peered":"2024-08-20T05:00:29.369170+0000","last_clean":"2024-08-20T05:00:29.369170+0000","last_became_active":"2024-08-20T04:59:09.750097+0000","last_became_peered":"2024-08-20T04:59:09.750097+0000","last_unstale":"2024-08-20T05:00:29.369170+0000","last_undegraded":"2024-08-20T05:00:29.369170+0000","last_fullsized":"2024-08-20T05:00:29.369170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:32:22.826478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368146+0000","last_change":"2024-08-20T04:57:50.824023+0000","last_active":"2024-08-20T05:00:29.368146+0000","last_peered":"2024-08-20T05:00:29.368146+0000","last_clean":"2024-08-20T05:00:29.368146+0000","last_became_active":"2024-08-20T04:57:50.350587+0000","last_became_peered":"2024-08-20T04:57:50.350587+0000","last_unstale":"2024-08-20T05:00:29.368146+0000","last_undegraded":"2024-08-20T05:00:29.368146+0000","last_fullsized":"2024-08-20T05:00:29.368146+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_clean_scrub_stamp":"2024-08-20T04:54:17.224468+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:59:23.450117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":38,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.866133+0000","last_change":"2024-08-20T05:00:29.866063+0000","last_active":"2024-08-20T05:00:29.866133+0000","last_peered":"2024-08-20T05:00:29.866133+0000","last_clean":"2024-08-20T05:00:29.866133+0000","last_became_active":"2024-08-20T05:00:29.861545+0000","last_became_peered":"2024-08-20T05:00:29.861545+0000","last_unstale":"2024-08-20T05:00:29.866133+0000","last_undegraded":"2024-08-20T05:00:29.866133+0000","last_fullsized":"2024-08-20T05:00:29.866133+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:02:18.516044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370614+0000","last_change":"2024-08-20T04:59:12.793799+0000","last_active":"2024-08-20T05:00:29.370614+0000","last_peered":"2024-08-20T05:00:29.370614+0000","last_clean":"2024-08-20T05:00:29.370614+0000","last_became_active":"2024-08-20T04:59:12.793487+0000","last_became_peered":"2024-08-20T04:59:12.793487+0000","last_unstale":"2024-08-20T05:00:29.370614+0000","last_undegraded":"2024-08-20T05:00:29.370614+0000","last_fullsized":"2024-08-20T05:00:29.370614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:08:30.835824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'6","reported_seq":114,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:01:10.260936+0000","last_change":"2024-08-20T04:59:09.964586+0000","last_active":"2024-08-20T05:01:10.260936+0000","last_peered":"2024-08-20T05:01:10.260936+0000","last_clean":"2024-08-20T05:01:10.260936+0000","last_became_active":"2024-08-20T04:59:09.964258+0000","last_became_peered":"2024-08-20T04:59:09.964258+0000","last_unstale":"2024-08-20T05:01:10.260936+0000","last_undegraded":"2024-08-20T05:01:10.260936+0000","last_fullsized":"2024-08-20T05:01:10.260936+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:37:48.138019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":69,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365264+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T05:00:29.365264+0000","last_peered":"2024-08-20T05:00:29.365264+0000","last_clean":"2024-08-20T05:00:29.365264+0000","last_became_active":"2024-08-20T04:59:21.906197+0000","last_became_peered":"2024-08-20T04:59:21.906197+0000","last_unstale":"2024-08-20T05:00:29.365264+0000","last_undegraded":"2024-08-20T05:00:29.365264+0000","last_fullsized":"2024-08-20T05:00:29.365264+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:10:45.819035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368770+0000","last_change":"2024-08-20T04:59:12.794221+0000","last_active":"2024-08-20T05:00:29.368770+0000","last_peered":"2024-08-20T05:00:29.368770+0000","last_clean":"2024-08-20T05:00:29.368770+0000","last_became_active":"2024-08-20T04:59:12.793680+0000","last_became_peered":"2024-08-20T04:59:12.793680+0000","last_unstale":"2024-08-20T05:00:29.368770+0000","last_undegraded":"2024-08-20T05:00:29.368770+0000","last_fullsized":"2024-08-20T05:00:29.368770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:45.435700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.366097+0000","last_change":"2024-08-20T04:59:09.755955+0000","last_active":"2024-08-20T05:00:29.366097+0000","last_peered":"2024-08-20T05:00:29.366097+0000","last_clean":"2024-08-20T05:00:29.366097+0000","last_became_active":"2024-08-20T04:59:09.755614+0000","last_became_peered":"2024-08-20T04:59:09.755614+0000","last_unstale":"2024-08-20T05:00:29.366097+0000","last_undegraded":"2024-08-20T05:00:29.366097+0000","last_fullsized":"2024-08-20T05:00:29.366097+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:15:06.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369690+0000","last_change":"2024-08-20T04:59:21.915952+0000","last_active":"2024-08-20T05:00:29.369690+0000","last_peered":"2024-08-20T05:00:29.369690+0000","last_clean":"2024-08-20T05:00:29.369690+0000","last_became_active":"2024-08-20T04:59:21.915533+0000","last_became_peered":"2024-08-20T04:59:21.915533+0000","last_unstale":"2024-08-20T05:00:29.369690+0000","last_undegraded":"2024-08-20T05:00:29.369690+0000","last_fullsized":"2024-08-20T05:00:29.369690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:52:54.906061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368511+0000","last_change":"2024-08-20T04:59:12.782663+0000","last_active":"2024-08-20T05:00:29.368511+0000","last_peered":"2024-08-20T05:00:29.368511+0000","last_clean":"2024-08-20T05:00:29.368511+0000","last_became_active":"2024-08-20T04:59:12.782068+0000","last_became_peered":"2024-08-20T04:59:12.782068+0000","last_unstale":"2024-08-20T05:00:29.368511+0000","last_undegraded":"2024-08-20T05:00:29.368511+0000","last_fullsized":"2024-08-20T05:00:29.368511+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:46:39.662033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":45,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.858525+0000","last_change":"2024-08-20T04:59:09.747456+0000","last_active":"2024-08-20T05:00:29.858525+0000","last_peered":"2024-08-20T05:00:29.858525+0000","last_clean":"2024-08-20T05:00:29.858525+0000","last_became_active":"2024-08-20T04:59:09.747141+0000","last_became_peered":"2024-08-20T04:59:09.747141+0000","last_unstale":"2024-08-20T05:00:29.858525+0000","last_undegraded":"2024-08-20T05:00:29.858525+0000","last_fullsized":"2024-08-20T05:00:29.858525+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:39:01.600831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365095+0000","last_change":"2024-08-20T04:59:21.898059+0000","last_active":"2024-08-20T05:00:29.365095+0000","last_peered":"2024-08-20T05:00:29.365095+0000","last_clean":"2024-08-20T05:00:29.365095+0000","last_became_active":"2024-08-20T04:59:21.897617+0000","last_became_peered":"2024-08-20T04:59:21.897617+0000","last_unstale":"2024-08-20T05:00:29.365095+0000","last_undegraded":"2024-08-20T05:00:29.365095+0000","last_fullsized":"2024-08-20T05:00:29.365095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:53:21.122106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.372362+0000","last_change":"2024-08-20T05:00:29.372299+0000","last_active":"2024-08-20T05:00:29.372362+0000","last_peered":"2024-08-20T05:00:29.372362+0000","last_clean":"2024-08-20T05:00:29.372362+0000","last_became_active":"2024-08-20T05:00:29.371959+0000","last_became_peered":"2024-08-20T05:00:29.371959+0000","last_unstale":"2024-08-20T05:00:29.372362+0000","last_undegraded":"2024-08-20T05:00:29.372362+0000","last_fullsized":"2024-08-20T05:00:29.372362+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:03.996267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370441+0000","last_change":"2024-08-20T04:59:09.751943+0000","last_active":"2024-08-20T05:00:29.370441+0000","last_peered":"2024-08-20T05:00:29.370441+0000","last_clean":"2024-08-20T05:00:29.370441+0000","last_became_active":"2024-08-20T04:59:09.751586+0000","last_became_peered":"2024-08-20T04:59:09.751586+0000","last_unstale":"2024-08-20T05:00:29.370441+0000","last_undegraded":"2024-08-20T05:00:29.370441+0000","last_fullsized":"2024-08-20T05:00:29.370441+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:35:03.400574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365246+0000","last_change":"2024-08-20T04:59:21.901315+0000","last_active":"2024-08-20T05:00:29.365246+0000","last_peered":"2024-08-20T05:00:29.365246+0000","last_clean":"2024-08-20T05:00:29.365246+0000","last_became_active":"2024-08-20T04:59:21.900871+0000","last_became_peered":"2024-08-20T04:59:21.900871+0000","last_unstale":"2024-08-20T05:00:29.365246+0000","last_undegraded":"2024-08-20T05:00:29.365246+0000","last_fullsized":"2024-08-20T05:00:29.365246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:39:30.940409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365348+0000","last_change":"2024-08-20T04:59:12.793140+0000","last_active":"2024-08-20T05:00:29.365348+0000","last_peered":"2024-08-20T05:00:29.365348+0000","last_clean":"2024-08-20T05:00:29.365348+0000","last_became_active":"2024-08-20T04:59:12.792678+0000","last_became_peered":"2024-08-20T04:59:12.792678+0000","last_unstale":"2024-08-20T05:00:29.365348+0000","last_undegraded":"2024-08-20T05:00:29.365348+0000","last_fullsized":"2024-08-20T05:00:29.365348+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:07:05.610634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":59,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370213+0000","last_change":"2024-08-20T04:59:09.946158+0000","last_active":"2024-08-20T05:00:29.370213+0000","last_peered":"2024-08-20T05:00:29.370213+0000","last_clean":"2024-08-20T05:00:29.370213+0000","last_became_active":"2024-08-20T04:59:09.945736+0000","last_became_peered":"2024-08-20T04:59:09.945736+0000","last_unstale":"2024-08-20T05:00:29.370213+0000","last_undegraded":"2024-08-20T05:00:29.370213+0000","last_fullsized":"2024-08-20T05:00:29.370213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:02.759879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859568+0000","last_change":"2024-08-20T04:59:21.913457+0000","last_active":"2024-08-20T05:00:29.859568+0000","last_peered":"2024-08-20T05:00:29.859568+0000","last_clean":"2024-08-20T05:00:29.859568+0000","last_became_active":"2024-08-20T04:59:21.910468+0000","last_became_peered":"2024-08-20T04:59:21.910468+0000","last_unstale":"2024-08-20T05:00:29.859568+0000","last_undegraded":"2024-08-20T05:00:29.859568+0000","last_fullsized":"2024-08-20T05:00:29.859568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:16:30.817166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367857+0000","last_change":"2024-08-20T04:59:12.788088+0000","last_active":"2024-08-20T05:00:29.367857+0000","last_peered":"2024-08-20T05:00:29.367857+0000","last_clean":"2024-08-20T05:00:29.367857+0000","last_became_active":"2024-08-20T04:59:12.787756+0000","last_became_peered":"2024-08-20T04:59:12.787756+0000","last_unstale":"2024-08-20T05:00:29.367857+0000","last_undegraded":"2024-08-20T05:00:29.367857+0000","last_fullsized":"2024-08-20T05:00:29.367857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:51.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":112,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:01:07.247172+0000","last_change":"2024-08-20T04:59:09.746896+0000","last_active":"2024-08-20T05:01:07.247172+0000","last_peered":"2024-08-20T05:01:07.247172+0000","last_clean":"2024-08-20T05:01:07.247172+0000","last_became_active":"2024-08-20T04:59:09.746570+0000","last_became_peered":"2024-08-20T04:59:09.746570+0000","last_unstale":"2024-08-20T05:01:07.247172+0000","last_undegraded":"2024-08-20T05:01:07.247172+0000","last_fullsized":"2024-08-20T05:01:07.247172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:06:02.395260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":67,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367593+0000","last_change":"2024-08-20T04:59:21.911747+0000","last_active":"2024-08-20T05:00:29.367593+0000","last_peered":"2024-08-20T05:00:29.367593+0000","last_clean":"2024-08-20T05:00:29.367593+0000","last_became_active":"2024-08-20T04:59:21.908861+0000","last_became_peered":"2024-08-20T04:59:21.908861+0000","last_unstale":"2024-08-20T05:00:29.367593+0000","last_undegraded":"2024-08-20T05:00:29.367593+0000","last_fullsized":"2024-08-20T05:00:29.367593+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:22:17.336776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.860964+0000","last_change":"2024-08-20T05:00:29.860903+0000","last_active":"2024-08-20T05:00:29.860964+0000","last_peered":"2024-08-20T05:00:29.860964+0000","last_clean":"2024-08-20T05:00:29.860964+0000","last_became_active":"2024-08-20T05:00:29.860359+0000","last_became_peered":"2024-08-20T05:00:29.860359+0000","last_unstale":"2024-08-20T05:00:29.860964+0000","last_undegraded":"2024-08-20T05:00:29.860964+0000","last_fullsized":"2024-08-20T05:00:29.860964+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:27:02.976859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365410+0000","last_change":"2024-08-20T04:59:09.755225+0000","last_active":"2024-08-20T05:00:29.365410+0000","last_peered":"2024-08-20T05:00:29.365410+0000","last_clean":"2024-08-20T05:00:29.365410+0000","last_became_active":"2024-08-20T04:59:09.754580+0000","last_became_peered":"2024-08-20T04:59:09.754580+0000","last_unstale":"2024-08-20T05:00:29.365410+0000","last_undegraded":"2024-08-20T05:00:29.365410+0000","last_fullsized":"2024-08-20T05:00:29.365410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:54:53.606954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368032+0000","last_change":"2024-08-20T04:59:21.905200+0000","last_active":"2024-08-20T05:00:29.368032+0000","last_peered":"2024-08-20T05:00:29.368032+0000","last_clean":"2024-08-20T05:00:29.368032+0000","last_became_active":"2024-08-20T04:59:21.904724+0000","last_became_peered":"2024-08-20T04:59:21.904724+0000","last_unstale":"2024-08-20T05:00:29.368032+0000","last_undegraded":"2024-08-20T05:00:29.368032+0000","last_fullsized":"2024-08-20T05:00:29.368032+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:50:43.446750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859250+0000","last_change":"2024-08-20T04:59:12.787261+0000","last_active":"2024-08-20T05:00:29.859250+0000","last_peered":"2024-08-20T05:00:29.859250+0000","last_clean":"2024-08-20T05:00:29.859250+0000","last_became_active":"2024-08-20T04:59:12.786971+0000","last_became_peered":"2024-08-20T04:59:12.786971+0000","last_unstale":"2024-08-20T05:00:29.859250+0000","last_undegraded":"2024-08-20T05:00:29.859250+0000","last_fullsized":"2024-08-20T05:00:29.859250+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:55:57.209321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":50,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368536+0000","last_change":"2024-08-20T04:59:09.749147+0000","last_active":"2024-08-20T05:00:29.368536+0000","last_peered":"2024-08-20T05:00:29.368536+0000","last_clean":"2024-08-20T05:00:29.368536+0000","last_became_active":"2024-08-20T04:59:09.748806+0000","last_became_peered":"2024-08-20T04:59:09.748806+0000","last_unstale":"2024-08-20T05:00:29.368536+0000","last_undegraded":"2024-08-20T05:00:29.368536+0000","last_fullsized":"2024-08-20T05:00:29.368536+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:59:43.377105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365705+0000","last_change":"2024-08-20T04:59:21.905007+0000","last_active":"2024-08-20T05:00:29.365705+0000","last_peered":"2024-08-20T05:00:29.365705+0000","last_clean":"2024-08-20T05:00:29.365705+0000","last_became_active":"2024-08-20T04:59:21.904608+0000","last_became_peered":"2024-08-20T04:59:21.904608+0000","last_unstale":"2024-08-20T05:00:29.365705+0000","last_undegraded":"2024-08-20T05:00:29.365705+0000","last_fullsized":"2024-08-20T05:00:29.365705+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:00:42.390966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370670+0000","last_change":"2024-08-20T04:59:12.783339+0000","last_active":"2024-08-20T05:00:29.370670+0000","last_peered":"2024-08-20T05:00:29.370670+0000","last_clean":"2024-08-20T05:00:29.370670+0000","last_became_active":"2024-08-20T04:59:12.783051+0000","last_became_peered":"2024-08-20T04:59:12.783051+0000","last_unstale":"2024-08-20T05:00:29.370670+0000","last_undegraded":"2024-08-20T05:00:29.370670+0000","last_fullsized":"2024-08-20T05:00:29.370670+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:23:54.390491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"84'36","reported_seq":211,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:01:08.423522+0000","last_change":"2024-08-20T04:59:09.754340+0000","last_active":"2024-08-20T05:01:08.423522+0000","last_peered":"2024-08-20T05:01:08.423522+0000","last_clean":"2024-08-20T05:01:08.423522+0000","last_became_active":"2024-08-20T04:59:09.754000+0000","last_became_peered":"2024-08-20T04:59:09.754000+0000","last_unstale":"2024-08-20T05:01:08.423522+0000","last_undegraded":"2024-08-20T05:01:08.423522+0000","last_fullsized":"2024-08-20T05:01:08.423522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:26:17.256961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63480,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":135,"num_read_kb":130,"num_write":38,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367246+0000","last_change":"2024-08-20T04:59:21.910369+0000","last_active":"2024-08-20T05:00:29.367246+0000","last_peered":"2024-08-20T05:00:29.367246+0000","last_clean":"2024-08-20T05:00:29.367246+0000","last_became_active":"2024-08-20T04:59:21.909941+0000","last_became_peered":"2024-08-20T04:59:21.909941+0000","last_unstale":"2024-08-20T05:00:29.367246+0000","last_undegraded":"2024-08-20T05:00:29.367246+0000","last_fullsized":"2024-08-20T05:00:29.367246+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:27:07.088021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365546+0000","last_change":"2024-08-20T04:59:12.787747+0000","last_active":"2024-08-20T05:00:29.365546+0000","last_peered":"2024-08-20T05:00:29.365546+0000","last_clean":"2024-08-20T05:00:29.365546+0000","last_became_active":"2024-08-20T04:59:12.786962+0000","last_became_peered":"2024-08-20T04:59:12.786962+0000","last_unstale":"2024-08-20T05:00:29.365546+0000","last_undegraded":"2024-08-20T05:00:29.365546+0000","last_fullsized":"2024-08-20T05:00:29.365546+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:14:43.822829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":46,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365953+0000","last_change":"2024-08-20T04:59:09.947582+0000","last_active":"2024-08-20T05:00:29.365953+0000","last_peered":"2024-08-20T05:00:29.365953+0000","last_clean":"2024-08-20T05:00:29.365953+0000","last_became_active":"2024-08-20T04:59:09.947117+0000","last_became_peered":"2024-08-20T04:59:09.947117+0000","last_unstale":"2024-08-20T05:00:29.365953+0000","last_undegraded":"2024-08-20T05:00:29.365953+0000","last_fullsized":"2024-08-20T05:00:29.365953+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:22:05.815486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368905+0000","last_change":"2024-08-20T04:59:21.910776+0000","last_active":"2024-08-20T05:00:29.368905+0000","last_peered":"2024-08-20T05:00:29.368905+0000","last_clean":"2024-08-20T05:00:29.368905+0000","last_became_active":"2024-08-20T04:59:21.909726+0000","last_became_peered":"2024-08-20T04:59:21.909726+0000","last_unstale":"2024-08-20T05:00:29.368905+0000","last_undegraded":"2024-08-20T05:00:29.368905+0000","last_fullsized":"2024-08-20T05:00:29.368905+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:03:04.042649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.860699+0000","last_change":"2024-08-20T05:00:29.860637+0000","last_active":"2024-08-20T05:00:29.860699+0000","last_peered":"2024-08-20T05:00:29.860699+0000","last_clean":"2024-08-20T05:00:29.860699+0000","last_became_active":"2024-08-20T05:00:29.860250+0000","last_became_peered":"2024-08-20T05:00:29.860250+0000","last_unstale":"2024-08-20T05:00:29.860699+0000","last_undegraded":"2024-08-20T05:00:29.860699+0000","last_fullsized":"2024-08-20T05:00:29.860699+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:11:27.937844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368381+0000","last_change":"2024-08-20T04:59:09.747316+0000","last_active":"2024-08-20T05:00:29.368381+0000","last_peered":"2024-08-20T05:00:29.368381+0000","last_clean":"2024-08-20T05:00:29.368381+0000","last_became_active":"2024-08-20T04:59:09.746959+0000","last_became_peered":"2024-08-20T04:59:09.746959+0000","last_unstale":"2024-08-20T05:00:29.368381+0000","last_undegraded":"2024-08-20T05:00:29.368381+0000","last_fullsized":"2024-08-20T05:00:29.368381+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:28.480465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.366860+0000","last_change":"2024-08-20T04:59:21.907940+0000","last_active":"2024-08-20T05:00:29.366860+0000","last_peered":"2024-08-20T05:00:29.366860+0000","last_clean":"2024-08-20T05:00:29.366860+0000","last_became_active":"2024-08-20T04:59:21.907591+0000","last_became_peered":"2024-08-20T04:59:21.907591+0000","last_unstale":"2024-08-20T05:00:29.366860+0000","last_undegraded":"2024-08-20T05:00:29.366860+0000","last_fullsized":"2024-08-20T05:00:29.366860+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:33.583556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365872+0000","last_change":"2024-08-20T04:59:12.795662+0000","last_active":"2024-08-20T05:00:29.365872+0000","last_peered":"2024-08-20T05:00:29.365872+0000","last_clean":"2024-08-20T05:00:29.365872+0000","last_became_active":"2024-08-20T04:59:12.795321+0000","last_became_peered":"2024-08-20T04:59:12.795321+0000","last_unstale":"2024-08-20T05:00:29.365872+0000","last_undegraded":"2024-08-20T05:00:29.365872+0000","last_fullsized":"2024-08-20T05:00:29.365872+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:40:30.561306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":170,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:01:08.256194+0000","last_change":"2024-08-20T04:59:09.754468+0000","last_active":"2024-08-20T05:01:08.256194+0000","last_peered":"2024-08-20T05:01:08.256194+0000","last_clean":"2024-08-20T05:01:08.256194+0000","last_became_active":"2024-08-20T04:59:09.754115+0000","last_became_peered":"2024-08-20T04:59:09.754115+0000","last_unstale":"2024-08-20T05:01:08.256194+0000","last_undegraded":"2024-08-20T05:01:08.256194+0000","last_fullsized":"2024-08-20T05:01:08.256194+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:50:21.301246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":126,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.364784+0000","last_change":"2024-08-20T04:59:21.898785+0000","last_active":"2024-08-20T05:00:29.364784+0000","last_peered":"2024-08-20T05:00:29.364784+0000","last_clean":"2024-08-20T05:00:29.364784+0000","last_became_active":"2024-08-20T04:59:21.898423+0000","last_became_peered":"2024-08-20T04:59:21.898423+0000","last_unstale":"2024-08-20T05:00:29.364784+0000","last_undegraded":"2024-08-20T05:00:29.364784+0000","last_fullsized":"2024-08-20T05:00:29.364784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:52:58.800104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370125+0000","last_change":"2024-08-20T04:59:21.906208+0000","last_active":"2024-08-20T05:00:29.370125+0000","last_peered":"2024-08-20T05:00:29.370125+0000","last_clean":"2024-08-20T05:00:29.370125+0000","last_became_active":"2024-08-20T04:59:21.905041+0000","last_became_peered":"2024-08-20T04:59:21.905041+0000","last_unstale":"2024-08-20T05:00:29.370125+0000","last_undegraded":"2024-08-20T05:00:29.370125+0000","last_fullsized":"2024-08-20T05:00:29.370125+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:05:28.971357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.366981+0000","last_change":"2024-08-20T04:59:12.788130+0000","last_active":"2024-08-20T05:00:29.366981+0000","last_peered":"2024-08-20T05:00:29.366981+0000","last_clean":"2024-08-20T05:00:29.366981+0000","last_became_active":"2024-08-20T04:59:12.787665+0000","last_became_peered":"2024-08-20T04:59:12.787665+0000","last_unstale":"2024-08-20T05:00:29.366981+0000","last_undegraded":"2024-08-20T05:00:29.366981+0000","last_fullsized":"2024-08-20T05:00:29.366981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:59:39.628781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":44,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365575+0000","last_change":"2024-08-20T04:59:09.754842+0000","last_active":"2024-08-20T05:00:29.365575+0000","last_peered":"2024-08-20T05:00:29.365575+0000","last_clean":"2024-08-20T05:00:29.365575+0000","last_became_active":"2024-08-20T04:59:09.754515+0000","last_became_peered":"2024-08-20T04:59:09.754515+0000","last_unstale":"2024-08-20T05:00:29.365575+0000","last_undegraded":"2024-08-20T05:00:29.365575+0000","last_fullsized":"2024-08-20T05:00:29.365575+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:19:02.241567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368252+0000","last_change":"2024-08-20T04:59:21.900610+0000","last_active":"2024-08-20T05:00:29.368252+0000","last_peered":"2024-08-20T05:00:29.368252+0000","last_clean":"2024-08-20T05:00:29.368252+0000","last_became_active":"2024-08-20T04:59:21.900207+0000","last_became_peered":"2024-08-20T04:59:21.900207+0000","last_unstale":"2024-08-20T05:00:29.368252+0000","last_undegraded":"2024-08-20T05:00:29.368252+0000","last_fullsized":"2024-08-20T05:00:29.368252+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:41:00.115344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.364933+0000","last_change":"2024-08-20T04:59:12.780772+0000","last_active":"2024-08-20T05:00:29.364933+0000","last_peered":"2024-08-20T05:00:29.364933+0000","last_clean":"2024-08-20T05:00:29.364933+0000","last_became_active":"2024-08-20T04:59:12.780385+0000","last_became_peered":"2024-08-20T04:59:12.780385+0000","last_unstale":"2024-08-20T05:00:29.364933+0000","last_undegraded":"2024-08-20T05:00:29.364933+0000","last_fullsized":"2024-08-20T05:00:29.364933+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:23.680899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":43,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.858475+0000","last_change":"2024-08-20T04:59:09.749567+0000","last_active":"2024-08-20T05:00:29.858475+0000","last_peered":"2024-08-20T05:00:29.858475+0000","last_clean":"2024-08-20T05:00:29.858475+0000","last_became_active":"2024-08-20T04:59:09.749204+0000","last_became_peered":"2024-08-20T04:59:09.749204+0000","last_unstale":"2024-08-20T05:00:29.858475+0000","last_undegraded":"2024-08-20T05:00:29.858475+0000","last_fullsized":"2024-08-20T05:00:29.858475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:57:51.236459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":47,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.858361+0000","last_change":"2024-08-20T04:59:09.751622+0000","last_active":"2024-08-20T05:00:29.858361+0000","last_peered":"2024-08-20T05:00:29.858361+0000","last_clean":"2024-08-20T05:00:29.858361+0000","last_became_active":"2024-08-20T04:59:09.751227+0000","last_became_peered":"2024-08-20T04:59:09.751227+0000","last_unstale":"2024-08-20T05:00:29.858361+0000","last_undegraded":"2024-08-20T05:00:29.858361+0000","last_fullsized":"2024-08-20T05:00:29.858361+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:53:38.755122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365460+0000","last_change":"2024-08-20T04:59:12.789243+0000","last_active":"2024-08-20T05:00:29.365460+0000","last_peered":"2024-08-20T05:00:29.365460+0000","last_clean":"2024-08-20T05:00:29.365460+0000","last_became_active":"2024-08-20T04:59:12.788932+0000","last_became_peered":"2024-08-20T04:59:12.788932+0000","last_unstale":"2024-08-20T05:00:29.365460+0000","last_undegraded":"2024-08-20T05:00:29.365460+0000","last_fullsized":"2024-08-20T05:00:29.365460+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:27:00.122328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369078+0000","last_change":"2024-08-20T04:59:21.902847+0000","last_active":"2024-08-20T05:00:29.369078+0000","last_peered":"2024-08-20T05:00:29.369078+0000","last_clean":"2024-08-20T05:00:29.369078+0000","last_became_active":"2024-08-20T04:59:21.902426+0000","last_became_peered":"2024-08-20T04:59:21.902426+0000","last_unstale":"2024-08-20T05:00:29.369078+0000","last_undegraded":"2024-08-20T05:00:29.369078+0000","last_fullsized":"2024-08-20T05:00:29.369078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:18:38.107358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":125,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:01:09.425603+0000","last_change":"2024-08-20T05:00:29.375139+0000","last_active":"2024-08-20T05:01:09.425603+0000","last_peered":"2024-08-20T05:01:09.425603+0000","last_clean":"2024-08-20T05:01:09.425603+0000","last_became_active":"2024-08-20T05:00:29.370896+0000","last_became_peered":"2024-08-20T05:00:29.370896+0000","last_unstale":"2024-08-20T05:01:09.425603+0000","last_undegraded":"2024-08-20T05:01:09.425603+0000","last_fullsized":"2024-08-20T05:01:09.425603+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:06:48.033558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":60,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370483+0000","last_change":"2024-08-20T04:59:12.785811+0000","last_active":"2024-08-20T05:00:29.370483+0000","last_peered":"2024-08-20T05:00:29.370483+0000","last_clean":"2024-08-20T05:00:29.370483+0000","last_became_active":"2024-08-20T04:59:12.785483+0000","last_became_peered":"2024-08-20T04:59:12.785483+0000","last_unstale":"2024-08-20T05:00:29.370483+0000","last_undegraded":"2024-08-20T05:00:29.370483+0000","last_fullsized":"2024-08-20T05:00:29.370483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:31:25.355197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368825+0000","last_change":"2024-08-20T04:59:21.897832+0000","last_active":"2024-08-20T05:00:29.368825+0000","last_peered":"2024-08-20T05:00:29.368825+0000","last_clean":"2024-08-20T05:00:29.368825+0000","last_became_active":"2024-08-20T04:59:21.897457+0000","last_became_peered":"2024-08-20T04:59:21.897457+0000","last_unstale":"2024-08-20T05:00:29.368825+0000","last_undegraded":"2024-08-20T05:00:29.368825+0000","last_fullsized":"2024-08-20T05:00:29.368825+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:39:51.934014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.367695+0000","last_change":"2024-08-20T04:59:12.787671+0000","last_active":"2024-08-20T05:00:29.367695+0000","last_peered":"2024-08-20T05:00:29.367695+0000","last_clean":"2024-08-20T05:00:29.367695+0000","last_became_active":"2024-08-20T04:59:12.787372+0000","last_became_peered":"2024-08-20T04:59:12.787372+0000","last_unstale":"2024-08-20T05:00:29.367695+0000","last_undegraded":"2024-08-20T05:00:29.367695+0000","last_fullsized":"2024-08-20T05:00:29.367695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:16:55.031031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368949+0000","last_change":"2024-08-20T04:59:12.792192+0000","last_active":"2024-08-20T05:00:29.368949+0000","last_peered":"2024-08-20T05:00:29.368949+0000","last_clean":"2024-08-20T05:00:29.368949+0000","last_became_active":"2024-08-20T04:59:12.791447+0000","last_became_peered":"2024-08-20T04:59:12.791447+0000","last_unstale":"2024-08-20T05:00:29.368949+0000","last_undegraded":"2024-08-20T05:00:29.368949+0000","last_fullsized":"2024-08-20T05:00:29.368949+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:03:32.559245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368659+0000","last_change":"2024-08-20T04:59:12.785393+0000","last_active":"2024-08-20T05:00:29.368659+0000","last_peered":"2024-08-20T05:00:29.368659+0000","last_clean":"2024-08-20T05:00:29.368659+0000","last_became_active":"2024-08-20T04:59:12.784998+0000","last_became_peered":"2024-08-20T04:59:12.784998+0000","last_unstale":"2024-08-20T05:00:29.368659+0000","last_undegraded":"2024-08-20T05:00:29.368659+0000","last_fullsized":"2024-08-20T05:00:29.368659+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:27:04.964290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369758+0000","last_change":"2024-08-20T04:59:12.784730+0000","last_active":"2024-08-20T05:00:29.369758+0000","last_peered":"2024-08-20T05:00:29.369758+0000","last_clean":"2024-08-20T05:00:29.369758+0000","last_became_active":"2024-08-20T04:59:12.784269+0000","last_became_peered":"2024-08-20T04:59:12.784269+0000","last_unstale":"2024-08-20T05:00:29.369758+0000","last_undegraded":"2024-08-20T05:00:29.369758+0000","last_fullsized":"2024-08-20T05:00:29.369758+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:43:12.248033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859567+0000","last_change":"2024-08-20T04:59:12.786484+0000","last_active":"2024-08-20T05:00:29.859567+0000","last_peered":"2024-08-20T05:00:29.859567+0000","last_clean":"2024-08-20T05:00:29.859567+0000","last_became_active":"2024-08-20T04:59:12.786166+0000","last_became_peered":"2024-08-20T04:59:12.786166+0000","last_unstale":"2024-08-20T05:00:29.859567+0000","last_undegraded":"2024-08-20T05:00:29.859567+0000","last_fullsized":"2024-08-20T05:00:29.859567+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:30.084519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368496+0000","last_change":"2024-08-20T04:59:12.786985+0000","last_active":"2024-08-20T05:00:29.368496+0000","last_peered":"2024-08-20T05:00:29.368496+0000","last_clean":"2024-08-20T05:00:29.368496+0000","last_became_active":"2024-08-20T04:59:12.786674+0000","last_became_peered":"2024-08-20T04:59:12.786674+0000","last_unstale":"2024-08-20T05:00:29.368496+0000","last_undegraded":"2024-08-20T05:00:29.368496+0000","last_fullsized":"2024-08-20T05:00:29.368496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:30:59.996149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369225+0000","last_change":"2024-08-20T04:59:12.796410+0000","last_active":"2024-08-20T05:00:29.369225+0000","last_peered":"2024-08-20T05:00:29.369225+0000","last_clean":"2024-08-20T05:00:29.369225+0000","last_became_active":"2024-08-20T04:59:12.796081+0000","last_became_peered":"2024-08-20T04:59:12.796081+0000","last_unstale":"2024-08-20T05:00:29.369225+0000","last_undegraded":"2024-08-20T05:00:29.369225+0000","last_fullsized":"2024-08-20T05:00:29.369225+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:49:09.706265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365453+0000","last_change":"2024-08-20T04:59:12.795994+0000","last_active":"2024-08-20T05:00:29.365453+0000","last_peered":"2024-08-20T05:00:29.365453+0000","last_clean":"2024-08-20T05:00:29.365453+0000","last_became_active":"2024-08-20T04:59:12.795604+0000","last_became_peered":"2024-08-20T04:59:12.795604+0000","last_unstale":"2024-08-20T05:00:29.365453+0000","last_undegraded":"2024-08-20T05:00:29.365453+0000","last_fullsized":"2024-08-20T05:00:29.365453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:54:09.628743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365203+0000","last_change":"2024-08-20T04:59:12.788966+0000","last_active":"2024-08-20T05:00:29.365203+0000","last_peered":"2024-08-20T05:00:29.365203+0000","last_clean":"2024-08-20T05:00:29.365203+0000","last_became_active":"2024-08-20T04:59:12.788534+0000","last_became_peered":"2024-08-20T04:59:12.788534+0000","last_unstale":"2024-08-20T05:00:29.365203+0000","last_undegraded":"2024-08-20T05:00:29.365203+0000","last_fullsized":"2024-08-20T05:00:29.365203+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.615399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.364873+0000","last_change":"2024-08-20T04:59:12.785914+0000","last_active":"2024-08-20T05:00:29.364873+0000","last_peered":"2024-08-20T05:00:29.364873+0000","last_clean":"2024-08-20T05:00:29.364873+0000","last_became_active":"2024-08-20T04:59:12.785551+0000","last_became_peered":"2024-08-20T04:59:12.785551+0000","last_unstale":"2024-08-20T05:00:29.364873+0000","last_undegraded":"2024-08-20T05:00:29.364873+0000","last_fullsized":"2024-08-20T05:00:29.364873+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:30:32.072387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365385+0000","last_change":"2024-08-20T04:59:12.795635+0000","last_active":"2024-08-20T05:00:29.365385+0000","last_peered":"2024-08-20T05:00:29.365385+0000","last_clean":"2024-08-20T05:00:29.365385+0000","last_became_active":"2024-08-20T04:59:12.794805+0000","last_became_peered":"2024-08-20T04:59:12.794805+0000","last_unstale":"2024-08-20T05:00:29.365385+0000","last_undegraded":"2024-08-20T05:00:29.365385+0000","last_fullsized":"2024-08-20T05:00:29.365385+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:09:08.725503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859560+0000","last_change":"2024-08-20T04:59:12.785099+0000","last_active":"2024-08-20T05:00:29.859560+0000","last_peered":"2024-08-20T05:00:29.859560+0000","last_clean":"2024-08-20T05:00:29.859560+0000","last_became_active":"2024-08-20T04:59:12.784727+0000","last_became_peered":"2024-08-20T04:59:12.784727+0000","last_unstale":"2024-08-20T05:00:29.859560+0000","last_undegraded":"2024-08-20T05:00:29.859560+0000","last_fullsized":"2024-08-20T05:00:29.859560+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:24:36.227289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368167+0000","last_change":"2024-08-20T04:59:12.781832+0000","last_active":"2024-08-20T05:00:29.368167+0000","last_peered":"2024-08-20T05:00:29.368167+0000","last_clean":"2024-08-20T05:00:29.368167+0000","last_became_active":"2024-08-20T04:59:12.781342+0000","last_became_peered":"2024-08-20T04:59:12.781342+0000","last_unstale":"2024-08-20T05:00:29.368167+0000","last_undegraded":"2024-08-20T05:00:29.368167+0000","last_fullsized":"2024-08-20T05:00:29.368167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:26:17.762048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369226+0000","last_change":"2024-08-20T04:59:12.792350+0000","last_active":"2024-08-20T05:00:29.369226+0000","last_peered":"2024-08-20T05:00:29.369226+0000","last_clean":"2024-08-20T05:00:29.369226+0000","last_became_active":"2024-08-20T04:59:12.792028+0000","last_became_peered":"2024-08-20T04:59:12.792028+0000","last_unstale":"2024-08-20T05:00:29.369226+0000","last_undegraded":"2024-08-20T05:00:29.369226+0000","last_fullsized":"2024-08-20T05:00:29.369226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:16:23.173759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368516+0000","last_change":"2024-08-20T04:59:12.795047+0000","last_active":"2024-08-20T05:00:29.368516+0000","last_peered":"2024-08-20T05:00:29.368516+0000","last_clean":"2024-08-20T05:00:29.368516+0000","last_became_active":"2024-08-20T04:59:12.794705+0000","last_became_peered":"2024-08-20T04:59:12.794705+0000","last_unstale":"2024-08-20T05:00:29.368516+0000","last_undegraded":"2024-08-20T05:00:29.368516+0000","last_fullsized":"2024-08-20T05:00:29.368516+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:51:16.355892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369014+0000","last_change":"2024-08-20T04:59:12.785022+0000","last_active":"2024-08-20T05:00:29.369014+0000","last_peered":"2024-08-20T05:00:29.369014+0000","last_clean":"2024-08-20T05:00:29.369014+0000","last_became_active":"2024-08-20T04:59:12.784730+0000","last_became_peered":"2024-08-20T04:59:12.784730+0000","last_unstale":"2024-08-20T05:00:29.369014+0000","last_undegraded":"2024-08-20T05:00:29.369014+0000","last_fullsized":"2024-08-20T05:00:29.369014+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:21:53.053890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.365112+0000","last_change":"2024-08-20T04:59:12.790825+0000","last_active":"2024-08-20T05:00:29.365112+0000","last_peered":"2024-08-20T05:00:29.365112+0000","last_clean":"2024-08-20T05:00:29.365112+0000","last_became_active":"2024-08-20T04:59:12.790299+0000","last_became_peered":"2024-08-20T04:59:12.790299+0000","last_unstale":"2024-08-20T05:00:29.365112+0000","last_undegraded":"2024-08-20T05:00:29.365112+0000","last_fullsized":"2024-08-20T05:00:29.365112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:12.477186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.374271+0000","last_change":"2024-08-20T05:00:29.374190+0000","last_active":"2024-08-20T05:00:29.374271+0000","last_peered":"2024-08-20T05:00:29.374271+0000","last_clean":"2024-08-20T05:00:29.374271+0000","last_became_active":"2024-08-20T05:00:29.373844+0000","last_became_peered":"2024-08-20T05:00:29.373844+0000","last_unstale":"2024-08-20T05:00:29.374271+0000","last_undegraded":"2024-08-20T05:00:29.374271+0000","last_fullsized":"2024-08-20T05:00:29.374271+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:03.131340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.369384+0000","last_change":"2024-08-20T04:59:12.783355+0000","last_active":"2024-08-20T05:00:29.369384+0000","last_peered":"2024-08-20T05:00:29.369384+0000","last_clean":"2024-08-20T05:00:29.369384+0000","last_became_active":"2024-08-20T04:59:12.782992+0000","last_became_peered":"2024-08-20T04:59:12.782992+0000","last_unstale":"2024-08-20T05:00:29.369384+0000","last_undegraded":"2024-08-20T05:00:29.369384+0000","last_fullsized":"2024-08-20T05:00:29.369384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:09:47.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859373+0000","last_change":"2024-08-20T04:59:12.783989+0000","last_active":"2024-08-20T05:00:29.859373+0000","last_peered":"2024-08-20T05:00:29.859373+0000","last_clean":"2024-08-20T05:00:29.859373+0000","last_became_active":"2024-08-20T04:59:12.783671+0000","last_became_peered":"2024-08-20T04:59:12.783671+0000","last_unstale":"2024-08-20T05:00:29.859373+0000","last_undegraded":"2024-08-20T05:00:29.859373+0000","last_fullsized":"2024-08-20T05:00:29.859373+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:34:55.727599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368401+0000","last_change":"2024-08-20T04:59:12.787118+0000","last_active":"2024-08-20T05:00:29.368401+0000","last_peered":"2024-08-20T05:00:29.368401+0000","last_clean":"2024-08-20T05:00:29.368401+0000","last_became_active":"2024-08-20T04:59:12.786754+0000","last_became_peered":"2024-08-20T04:59:12.786754+0000","last_unstale":"2024-08-20T05:00:29.368401+0000","last_undegraded":"2024-08-20T05:00:29.368401+0000","last_fullsized":"2024-08-20T05:00:29.368401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:13:23.959972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370604+0000","last_change":"2024-08-20T04:59:12.793748+0000","last_active":"2024-08-20T05:00:29.370604+0000","last_peered":"2024-08-20T05:00:29.370604+0000","last_clean":"2024-08-20T05:00:29.370604+0000","last_became_active":"2024-08-20T04:59:12.792550+0000","last_became_peered":"2024-08-20T04:59:12.792550+0000","last_unstale":"2024-08-20T05:00:29.370604+0000","last_undegraded":"2024-08-20T05:00:29.370604+0000","last_fullsized":"2024-08-20T05:00:29.370604+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:59:24.226273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859879+0000","last_change":"2024-08-20T04:59:12.788827+0000","last_active":"2024-08-20T05:00:29.859879+0000","last_peered":"2024-08-20T05:00:29.859879+0000","last_clean":"2024-08-20T05:00:29.859879+0000","last_became_active":"2024-08-20T04:59:12.788395+0000","last_became_peered":"2024-08-20T04:59:12.788395+0000","last_unstale":"2024-08-20T05:00:29.859879+0000","last_undegraded":"2024-08-20T05:00:29.859879+0000","last_fullsized":"2024-08-20T05:00:29.859879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:26.453063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.366031+0000","last_change":"2024-08-20T04:59:12.795513+0000","last_active":"2024-08-20T05:00:29.366031+0000","last_peered":"2024-08-20T05:00:29.366031+0000","last_clean":"2024-08-20T05:00:29.366031+0000","last_became_active":"2024-08-20T04:59:12.795191+0000","last_became_peered":"2024-08-20T04:59:12.795191+0000","last_unstale":"2024-08-20T05:00:29.366031+0000","last_undegraded":"2024-08-20T05:00:29.366031+0000","last_fullsized":"2024-08-20T05:00:29.366031+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:04:00.893420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.364815+0000","last_change":"2024-08-20T04:59:12.789825+0000","last_active":"2024-08-20T05:00:29.364815+0000","last_peered":"2024-08-20T05:00:29.364815+0000","last_clean":"2024-08-20T05:00:29.364815+0000","last_became_active":"2024-08-20T04:59:12.788198+0000","last_became_peered":"2024-08-20T04:59:12.788198+0000","last_unstale":"2024-08-20T05:00:29.364815+0000","last_undegraded":"2024-08-20T05:00:29.364815+0000","last_fullsized":"2024-08-20T05:00:29.364815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:10.898308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368799+0000","last_change":"2024-08-20T04:59:12.787707+0000","last_active":"2024-08-20T05:00:29.368799+0000","last_peered":"2024-08-20T05:00:29.368799+0000","last_clean":"2024-08-20T05:00:29.368799+0000","last_became_active":"2024-08-20T04:59:12.787035+0000","last_became_peered":"2024-08-20T04:59:12.787035+0000","last_unstale":"2024-08-20T05:00:29.368799+0000","last_undegraded":"2024-08-20T05:00:29.368799+0000","last_fullsized":"2024-08-20T05:00:29.368799+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:16:52.451048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.859390+0000","last_change":"2024-08-20T04:59:12.784012+0000","last_active":"2024-08-20T05:00:29.859390+0000","last_peered":"2024-08-20T05:00:29.859390+0000","last_clean":"2024-08-20T05:00:29.859390+0000","last_became_active":"2024-08-20T04:59:12.783599+0000","last_became_peered":"2024-08-20T04:59:12.783599+0000","last_unstale":"2024-08-20T05:00:29.859390+0000","last_undegraded":"2024-08-20T05:00:29.859390+0000","last_fullsized":"2024-08-20T05:00:29.859390+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:23:15.271873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.371130+0000","last_change":"2024-08-20T04:59:12.784987+0000","last_active":"2024-08-20T05:00:29.371130+0000","last_peered":"2024-08-20T05:00:29.371130+0000","last_clean":"2024-08-20T05:00:29.371130+0000","last_became_active":"2024-08-20T04:59:12.784693+0000","last_became_peered":"2024-08-20T04:59:12.784693+0000","last_unstale":"2024-08-20T05:00:29.371130+0000","last_undegraded":"2024-08-20T05:00:29.371130+0000","last_fullsized":"2024-08-20T05:00:29.371130+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:07:51.624602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368297+0000","last_change":"2024-08-20T04:59:12.792466+0000","last_active":"2024-08-20T05:00:29.368297+0000","last_peered":"2024-08-20T05:00:29.368297+0000","last_clean":"2024-08-20T05:00:29.368297+0000","last_became_active":"2024-08-20T04:59:12.792114+0000","last_became_peered":"2024-08-20T04:59:12.792114+0000","last_unstale":"2024-08-20T05:00:29.368297+0000","last_undegraded":"2024-08-20T05:00:29.368297+0000","last_fullsized":"2024-08-20T05:00:29.368297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:23:09.919907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368010+0000","last_change":"2024-08-20T04:59:12.793041+0000","last_active":"2024-08-20T05:00:29.368010+0000","last_peered":"2024-08-20T05:00:29.368010+0000","last_clean":"2024-08-20T05:00:29.368010+0000","last_became_active":"2024-08-20T04:59:12.792709+0000","last_became_peered":"2024-08-20T04:59:12.792709+0000","last_unstale":"2024-08-20T05:00:29.368010+0000","last_undegraded":"2024-08-20T05:00:29.368010+0000","last_fullsized":"2024-08-20T05:00:29.368010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:09:04.523493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.370129+0000","last_change":"2024-08-20T04:59:12.790256+0000","last_active":"2024-08-20T05:00:29.370129+0000","last_peered":"2024-08-20T05:00:29.370129+0000","last_clean":"2024-08-20T05:00:29.370129+0000","last_became_active":"2024-08-20T04:59:12.788467+0000","last_became_peered":"2024-08-20T04:59:12.788467+0000","last_unstale":"2024-08-20T05:00:29.370129+0000","last_undegraded":"2024-08-20T05:00:29.370129+0000","last_fullsized":"2024-08-20T05:00:29.370129+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:55:31.386030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":35,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-08-20T05:00:29.368431+0000","last_change":"2024-08-20T04:59:12.794882+0000","last_active":"2024-08-20T05:00:29.368431+0000","last_peered":"2024-08-20T05:00:29.368431+0000","last_clean":"2024-08-20T05:00:29.368431+0000","last_became_active":"2024-08-20T04:59:12.794564+0000","last_became_peered":"2024-08-20T04:59:12.794564+0000","last_unstale":"2024-08-20T05:00:29.368431+0000","last_undegraded":"2024-08-20T05:00:29.368431+0000","last_fullsized":"2024-08-20T05:00:29.368431+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:36:47.515754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70684,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":669,"num_read_kb":414,"num_write":250,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":212052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":215,"ondisk_log_size":215,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743462,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":987136,"data_stored":491644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939691,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28680,"kb_used_data":1648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716472,"statfs":{"total":95995035648,"available":95965667328,"internally_reserved":0,"allocated":1687552,"data_stored":1146036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103217,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1011712,"data_stored":491183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299446,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1007616,"data_stored":491561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462970,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28592,"kb_used_data":1568,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716560,"statfs":{"total":95995035648,"available":95965757440,"internally_reserved":0,"allocated":1605632,"data_stored":1088058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626497,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":987136,"data_stored":486687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822726,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28604,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716548,"statfs":{"total":95995035648,"available":95965745152,"internally_reserved":0,"allocated":1613824,"data_stored":1083249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1003520,"data_stored":491774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182480,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":999424,"data_stored":486395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36392,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708760,"statfs":{"total":95995035648,"available":95957770240,"internally_reserved":0,"allocated":1069056,"data_stored":551186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1056768,"data_stored":551197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32172,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712980,"statfs":{"total":95995035648,"available":95962091520,"internally_reserved":0,"allocated":1011712,"data_stored":488534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":65607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T05:01:13.441 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-20T05:01:13.441 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-20T05:01:13.441 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-20T05:01:13.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph health --format=json 2024-08-20T05:01:13.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:13 smithi037 ceph-mon[17265]: pgmap v368: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:01:13.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:13 smithi037 ceph-mon[17265]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:01:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:13.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:13 smithi135 ceph-mon[22342]: pgmap v368: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:01:13.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:13 smithi135 ceph-mon[22342]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:01:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:13 smithi130 ceph-mon[22007]: pgmap v368: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:01:13.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:13 smithi130 ceph-mon[22007]: from='client.15072 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:01:14.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.424+0000 7fd46a000640 1 -- 172.21.15.37:0/2415948971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd464077d20 msgr2=0x7fd464113150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:14.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.424+0000 7fd46a000640 1 --2- 172.21.15.37:0/2415948971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd464077d20 0x7fd464113150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd450009900 tx=0x7fd45002a3f0 comp rx=0 tx=0).stop 2024-08-20T05:01:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.424+0000 7fd46a000640 1 -- 172.21.15.37:0/2415948971 shutdown_connections 2024-08-20T05:01:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.424+0000 7fd46a000640 1 --2- 172.21.15.37:0/2415948971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd464113690 0x7fd464115a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.424+0000 7fd46a000640 1 --2- 172.21.15.37:0/2415948971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd464077d20 0x7fd464113150 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.424+0000 7fd46a000640 1 --2- 172.21.15.37:0/2415948971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd464077400 0x7fd4640777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.424+0000 7fd46a000640 1 -- 172.21.15.37:0/2415948971 >> 172.21.15.37:0/2415948971 conn(0x7fd464100730 msgr2=0x7fd464102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.425+0000 7fd46a000640 1 -- 172.21.15.37:0/2415948971 shutdown_connections 2024-08-20T05:01:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.425+0000 7fd46a000640 1 -- 172.21.15.37:0/2415948971 wait complete. 2024-08-20T05:01:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.426+0000 7fd46a000640 1 Processor -- start 2024-08-20T05:01:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.426+0000 7fd46a000640 1 -- start start 2024-08-20T05:01:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.426+0000 7fd46a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd464077400 0x7fd46419f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.426+0000 7fd46a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd464077d20 0x7fd46419fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.426+0000 7fd46a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd464113690 0x7fd4641a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.426+0000 7fd46a000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd4641190e0 con 0x7fd464077d20 2024-08-20T05:01:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.426+0000 7fd46a000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd464118f60 con 0x7fd464077400 2024-08-20T05:01:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.426+0000 7fd46a000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd464119260 con 0x7fd464113690 2024-08-20T05:01:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.427+0000 7fd463400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd464077400 0x7fd46419f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.427+0000 7fd463400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd464077400 0x7fd46419f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42884/0 (socket says 172.21.15.37:42884) 2024-08-20T05:01:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.427+0000 7fd463400640 1 -- 172.21.15.37:0/2850903614 learned_addr learned my addr 172.21.15.37:0/2850903614 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.427+0000 7fd462a00640 1 --2- 172.21.15.37:0/2850903614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd464077d20 0x7fd46419fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.427+0000 7fd463e00640 1 --2- 172.21.15.37:0/2850903614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd464113690 0x7fd4641a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.427+0000 7fd463400640 1 -- 172.21.15.37:0/2850903614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd464113690 msgr2=0x7fd4641a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.427+0000 7fd463400640 1 --2- 172.21.15.37:0/2850903614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd464113690 0x7fd4641a4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:14.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.427+0000 7fd463400640 1 -- 172.21.15.37:0/2850903614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd464077d20 msgr2=0x7fd46419fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.427+0000 7fd463400640 1 --2- 172.21.15.37:0/2850903614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd464077d20 0x7fd46419fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.427+0000 7fd463400640 1 -- 172.21.15.37:0/2850903614 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4641a5670 con 0x7fd464077400 2024-08-20T05:01:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.427+0000 7fd462a00640 1 --2- 172.21.15.37:0/2850903614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd464077d20 0x7fd46419fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:01:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.428+0000 7fd463400640 1 --2- 172.21.15.37:0/2850903614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd464077400 0x7fd46419f5c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd45400e9f0 tx=0x7fd45400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.428+0000 7fd45be00640 1 -- 172.21.15.37:0/2850903614 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45400ccc0 con 0x7fd464077400 2024-08-20T05:01:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.428+0000 7fd45be00640 1 -- 172.21.15.37:0/2850903614 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd45400ce60 con 0x7fd464077400 2024-08-20T05:01:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.428+0000 7fd45be00640 1 -- 172.21.15.37:0/2850903614 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454010430 con 0x7fd464077400 2024-08-20T05:01:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.428+0000 7fd46a000640 1 -- 172.21.15.37:0/2850903614 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4641a5960 con 0x7fd464077400 2024-08-20T05:01:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.428+0000 7fd46a000640 1 -- 172.21.15.37:0/2850903614 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4641ac020 con 0x7fd464077400 2024-08-20T05:01:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.429+0000 7fd46a000640 1 -- 172.21.15.37:0/2850903614 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4640777e0 con 0x7fd464077400 2024-08-20T05:01:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.432+0000 7fd45be00640 1 -- 172.21.15.37:0/2850903614 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fd4540046c0 con 0x7fd464077400 2024-08-20T05:01:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.433+0000 7fd45be00640 1 --2- 172.21.15.37:0/2850903614 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd4480b3ce0 0x7fd4480b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.433+0000 7fd45be00640 1 -- 172.21.15.37:0/2850903614 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fd4540e4510 con 0x7fd464077400 2024-08-20T05:01:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.433+0000 7fd462a00640 1 --2- 172.21.15.37:0/2850903614 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd4480b3ce0 0x7fd4480b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.434+0000 7fd462a00640 1 --2- 172.21.15.37:0/2850903614 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd4480b3ce0 0x7fd4480b61a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd450000c00 tx=0x7fd450005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.437+0000 7fd45be00640 1 -- 172.21.15.37:0/2850903614 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd4540ab640 con 0x7fd464077400 2024-08-20T05:01:14.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.674+0000 7fd46a000640 1 -- 172.21.15.37:0/2850903614 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd4641ac380 con 0x7fd464077400 2024-08-20T05:01:14.676 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:14 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:01:14.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.675+0000 7fd45be00640 1 -- 172.21.15.37:0/2850903614 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd4540aaf40 con 0x7fd464077400 2024-08-20T05:01:14.677 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:01:14.677 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-20T05:01:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.677+0000 7fd46a000640 1 -- 172.21.15.37:0/2850903614 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd4480b3ce0 msgr2=0x7fd4480b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:14.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.677+0000 7fd46a000640 1 --2- 172.21.15.37:0/2850903614 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd4480b3ce0 0x7fd4480b61a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd450000c00 tx=0x7fd450005a20 comp rx=0 tx=0).stop 2024-08-20T05:01:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.677+0000 7fd46a000640 1 -- 172.21.15.37:0/2850903614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd464077400 msgr2=0x7fd46419f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.677+0000 7fd46a000640 1 --2- 172.21.15.37:0/2850903614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd464077400 0x7fd46419f5c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd45400e9f0 tx=0x7fd45400edf0 comp rx=0 tx=0).stop 2024-08-20T05:01:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.678+0000 7fd46a000640 1 -- 172.21.15.37:0/2850903614 shutdown_connections 2024-08-20T05:01:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.678+0000 7fd46a000640 1 --2- 172.21.15.37:0/2850903614 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd4480b3ce0 0x7fd4480b61a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.678+0000 7fd46a000640 1 --2- 172.21.15.37:0/2850903614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd464113690 0x7fd4641a4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.678+0000 7fd46a000640 1 --2- 172.21.15.37:0/2850903614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd464077d20 0x7fd46419fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.678+0000 7fd46a000640 1 --2- 172.21.15.37:0/2850903614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd464077400 0x7fd46419f5c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.678+0000 7fd46a000640 1 -- 172.21.15.37:0/2850903614 >> 172.21.15.37:0/2850903614 conn(0x7fd464100730 msgr2=0x7fd464102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.678+0000 7fd46a000640 1 -- 172.21.15.37:0/2850903614 shutdown_connections 2024-08-20T05:01:14.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:14.678+0000 7fd46a000640 1 -- 172.21.15.37:0/2850903614 wait complete. 2024-08-20T05:01:14.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:14 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:01:14.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:14 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:01:15.467 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-20T05:01:15.468 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:01:15.759 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:15 smithi130 ceph-mon[22007]: pgmap v369: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:15.759 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:15 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2850903614' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-20T05:01:15.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:15 smithi037 ceph-mon[17265]: pgmap v369: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:15.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:15 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2850903614' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-20T05:01:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:15 smithi135 ceph-mon[22342]: pgmap v369: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:15 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2850903614' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-08-20T05:01:16.522 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:16.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:16 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:16.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:16 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:16.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:16 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:16.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:16 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:16.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:16 smithi130 ceph-mon[22007]: pgmap v370: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:17.013 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:16 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:17.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:16 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:17.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:16 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:17.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:16 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:17.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:16 smithi037 ceph-mon[17265]: pgmap v370: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:17.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:16 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:17.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:16 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:17.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:16 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:17.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:16 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:17.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:16 smithi135 ceph-mon[22342]: pgmap v370: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:17.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.125+0000 7fde5b000640 1 -- 172.21.15.37:0/219243310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde54108ca0 msgr2=0x7fde5410f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:17.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.125+0000 7fde5b000640 1 --2- 172.21.15.37:0/219243310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde54108ca0 0x7fde5410f4a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009ca0 tx=0x7fde4c02a8c0 comp rx=0 tx=0).stop 2024-08-20T05:01:17.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.125+0000 7fde5b000640 1 -- 172.21.15.37:0/219243310 shutdown_connections 2024-08-20T05:01:17.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.125+0000 7fde5b000640 1 --2- 172.21.15.37:0/219243310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde54108ca0 0x7fde5410f4a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:17.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.125+0000 7fde5b000640 1 --2- 172.21.15.37:0/219243310 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde54108320 0x7fde54108760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:17.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.125+0000 7fde5b000640 1 --2- 172.21.15.37:0/219243310 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde54102910 0x7fde54102cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:17.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.125+0000 7fde5b000640 1 -- 172.21.15.37:0/219243310 >> 172.21.15.37:0/219243310 conn(0x7fde540fe3c0 msgr2=0x7fde541007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:17.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.125+0000 7fde5b000640 1 -- 172.21.15.37:0/219243310 shutdown_connections 2024-08-20T05:01:17.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.125+0000 7fde5b000640 1 -- 172.21.15.37:0/219243310 wait complete. 2024-08-20T05:01:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.126+0000 7fde5b000640 1 Processor -- start 2024-08-20T05:01:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.127+0000 7fde5b000640 1 -- start start 2024-08-20T05:01:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.127+0000 7fde5b000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde54102910 0x7fde540751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.127+0000 7fde5b000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde54108320 0x7fde54075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.127+0000 7fde5b000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde54108ca0 0x7fde54075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.127+0000 7fde5b000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fde541129b0 con 0x7fde54102910 2024-08-20T05:01:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.127+0000 7fde5b000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fde54112830 con 0x7fde54108ca0 2024-08-20T05:01:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.127+0000 7fde5b000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fde54112b30 con 0x7fde54108320 2024-08-20T05:01:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.127+0000 7fde59c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde54102910 0x7fde540751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.127+0000 7fde59200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde54108320 0x7fde54075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.127+0000 7fde59200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde54108320 0x7fde54075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49250/0 (socket says 172.21.15.37:49250) 2024-08-20T05:01:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.127+0000 7fde59c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde54102910 0x7fde540751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60504/0 (socket says 172.21.15.37:60504) 2024-08-20T05:01:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.127+0000 7fde59200640 1 -- 172.21.15.37:0/2916333513 learned_addr learned my addr 172.21.15.37:0/2916333513 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.127+0000 7fde5a600640 1 --2- 172.21.15.37:0/2916333513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde54108ca0 0x7fde54075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.128+0000 7fde59200640 1 -- 172.21.15.37:0/2916333513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde54108ca0 msgr2=0x7fde54075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.128+0000 7fde59200640 1 --2- 172.21.15.37:0/2916333513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde54108ca0 0x7fde54075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.128+0000 7fde59200640 1 -- 172.21.15.37:0/2916333513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde54102910 msgr2=0x7fde540751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.128+0000 7fde59200640 1 --2- 172.21.15.37:0/2916333513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde54102910 0x7fde540751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.128+0000 7fde59200640 1 -- 172.21.15.37:0/2916333513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde541a7100 con 0x7fde54108320 2024-08-20T05:01:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.128+0000 7fde59200640 1 --2- 172.21.15.37:0/2916333513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde54108320 0x7fde54075710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fde4000ea60 tx=0x7fde4000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:17.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.128+0000 7fde52000640 1 -- 172.21.15.37:0/2916333513 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4000cde0 con 0x7fde54108320 2024-08-20T05:01:17.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.128+0000 7fde52000640 1 -- 172.21.15.37:0/2916333513 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fde400035f0 con 0x7fde54108320 2024-08-20T05:01:17.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.128+0000 7fde52000640 1 -- 172.21.15.37:0/2916333513 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40010690 con 0x7fde54108320 2024-08-20T05:01:17.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.128+0000 7fde5b000640 1 -- 172.21.15.37:0/2916333513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde541a73f0 con 0x7fde54108320 2024-08-20T05:01:17.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.129+0000 7fde5b000640 1 -- 172.21.15.37:0/2916333513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde541a7930 con 0x7fde54108320 2024-08-20T05:01:17.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.130+0000 7fde5b000640 1 -- 172.21.15.37:0/2916333513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde54102cf0 con 0x7fde54108320 2024-08-20T05:01:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.132+0000 7fde52000640 1 -- 172.21.15.37:0/2916333513 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fde400037a0 con 0x7fde54108320 2024-08-20T05:01:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.133+0000 7fde52000640 1 --2- 172.21.15.37:0/2916333513 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fde3c0b3d10 0x7fde3c0b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.133+0000 7fde52000640 1 -- 172.21.15.37:0/2916333513 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fde400e44f0 con 0x7fde54108320 2024-08-20T05:01:17.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.133+0000 7fde59c00640 1 --2- 172.21.15.37:0/2916333513 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fde3c0b3d10 0x7fde3c0b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:17.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.134+0000 7fde59c00640 1 --2- 172.21.15.37:0/2916333513 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fde3c0b3d10 0x7fde3c0b61d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fde48009bd0 tx=0x7fde48005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:17.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.135+0000 7fde52000640 1 -- 172.21.15.37:0/2916333513 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fde400ab620 con 0x7fde54108320 2024-08-20T05:01:17.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.397+0000 7fde5b000640 1 -- 172.21.15.37:0/2916333513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde541a7d50 con 0x7fde54108320 2024-08-20T05:01:17.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.398+0000 7fde52000640 1 -- 172.21.15.37:0/2916333513 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11980 (secure 0 0 0) 0x7fde400aaf20 con 0x7fde54108320 2024-08-20T05:01:17.400 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:01:17.400 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"btime":"2024-08-20T05:00:06:145262+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:00:06.145248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:01:17.400 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-08-20T05:01:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.400+0000 7fde5b000640 1 -- 172.21.15.37:0/2916333513 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fde3c0b3d10 msgr2=0x7fde3c0b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.400+0000 7fde5b000640 1 --2- 172.21.15.37:0/2916333513 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fde3c0b3d10 0x7fde3c0b61d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fde48009bd0 tx=0x7fde48005f90 comp rx=0 tx=0).stop 2024-08-20T05:01:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.400+0000 7fde5b000640 1 -- 172.21.15.37:0/2916333513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde54108320 msgr2=0x7fde54075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.400+0000 7fde5b000640 1 --2- 172.21.15.37:0/2916333513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde54108320 0x7fde54075710 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fde4000ea60 tx=0x7fde4000ef20 comp rx=0 tx=0).stop 2024-08-20T05:01:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.401+0000 7fde5b000640 1 -- 172.21.15.37:0/2916333513 shutdown_connections 2024-08-20T05:01:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.401+0000 7fde5b000640 1 --2- 172.21.15.37:0/2916333513 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fde3c0b3d10 0x7fde3c0b61d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.401+0000 7fde5b000640 1 --2- 172.21.15.37:0/2916333513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fde54108ca0 0x7fde54075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.401+0000 7fde5b000640 1 --2- 172.21.15.37:0/2916333513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fde54108320 0x7fde54075710 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.401+0000 7fde5b000640 1 --2- 172.21.15.37:0/2916333513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde54102910 0x7fde540751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.401+0000 7fde5b000640 1 -- 172.21.15.37:0/2916333513 >> 172.21.15.37:0/2916333513 conn(0x7fde540fe3c0 msgr2=0x7fde54101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.401+0000 7fde5b000640 1 -- 172.21.15.37:0/2916333513 shutdown_connections 2024-08-20T05:01:17.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:17.401+0000 7fde5b000640 1 -- 172.21.15.37:0/2916333513 wait complete. 2024-08-20T05:01:18.177 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:17 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2916333513' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:01:18.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:17 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2916333513' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:01:18.215 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:01:18.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:17 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2916333513' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:01:18.626 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.177+0000 7fe137e00640 1 -- 172.21.15.37:0/969093210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe130102ab0 msgr2=0x7fe130102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.177+0000 7fe137e00640 1 --2- 172.21.15.37:0/969093210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe130102ab0 0x7fe130102e90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe124009900 tx=0x7fe12402a400 comp rx=0 tx=0).stop 2024-08-20T05:01:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.177+0000 7fe137e00640 1 -- 172.21.15.37:0/969093210 shutdown_connections 2024-08-20T05:01:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.177+0000 7fe137e00640 1 --2- 172.21.15.37:0/969093210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe130108e40 0x7fe13010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.177+0000 7fe137e00640 1 --2- 172.21.15.37:0/969093210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1301084c0 0x7fe130108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.177+0000 7fe137e00640 1 --2- 172.21.15.37:0/969093210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe130102ab0 0x7fe130102e90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:19.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.177+0000 7fe137e00640 1 -- 172.21.15.37:0/969093210 >> 172.21.15.37:0/969093210 conn(0x7fe1300fe500 msgr2=0x7fe130100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.177+0000 7fe137e00640 1 -- 172.21.15.37:0/969093210 shutdown_connections 2024-08-20T05:01:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.177+0000 7fe137e00640 1 -- 172.21.15.37:0/969093210 wait complete. 2024-08-20T05:01:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.178+0000 7fe137e00640 1 Processor -- start 2024-08-20T05:01:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.178+0000 7fe137e00640 1 -- start start 2024-08-20T05:01:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.179+0000 7fe137e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe130102ab0 0x7fe13010e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.179+0000 7fe137e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1301084c0 0x7fe13010eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.179+0000 7fe137e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe130108e40 0x7fe1301a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.179+0000 7fe137e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe130112b10 con 0x7fe130108e40 2024-08-20T05:01:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.179+0000 7fe137e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe130112990 con 0x7fe1301084c0 2024-08-20T05:01:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.179+0000 7fe137e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe130112c90 con 0x7fe130102ab0 2024-08-20T05:01:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.179+0000 7fe134a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1301084c0 0x7fe13010eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.179+0000 7fe135e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe130108e40 0x7fe1301a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.179+0000 7fe134a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1301084c0 0x7fe13010eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42922/0 (socket says 172.21.15.37:42922) 2024-08-20T05:01:19.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.179+0000 7fe134a00640 1 -- 172.21.15.37:0/1289766839 learned_addr learned my addr 172.21.15.37:0/1289766839 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:19.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.179+0000 7fe135400640 1 --2- 172.21.15.37:0/1289766839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe130102ab0 0x7fe13010e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:19.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.180+0000 7fe135e00640 1 -- 172.21.15.37:0/1289766839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe130102ab0 msgr2=0x7fe13010e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:19.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.180+0000 7fe135e00640 1 --2- 172.21.15.37:0/1289766839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe130102ab0 0x7fe13010e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:19.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.180+0000 7fe135e00640 1 -- 172.21.15.37:0/1289766839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1301084c0 msgr2=0x7fe13010eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:19.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.180+0000 7fe135e00640 1 --2- 172.21.15.37:0/1289766839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1301084c0 0x7fe13010eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:19.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.180+0000 7fe135e00640 1 -- 172.21.15.37:0/1289766839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1301a5640 con 0x7fe130108e40 2024-08-20T05:01:19.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.180+0000 7fe134a00640 1 --2- 172.21.15.37:0/1289766839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1301084c0 0x7fe13010eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:19.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.180+0000 7fe135e00640 1 --2- 172.21.15.37:0/1289766839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe130108e40 0x7fe1301a4e70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe12800e940 tx=0x7fe12800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:19.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.180+0000 7fe12e000640 1 -- 172.21.15.37:0/1289766839 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe128004d20 con 0x7fe130108e40 2024-08-20T05:01:19.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.180+0000 7fe12e000640 1 -- 172.21.15.37:0/1289766839 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe128005020 con 0x7fe130108e40 2024-08-20T05:01:19.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.180+0000 7fe137e00640 1 -- 172.21.15.37:0/1289766839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1301a5930 con 0x7fe130108e40 2024-08-20T05:01:19.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.180+0000 7fe12e000640 1 -- 172.21.15.37:0/1289766839 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1280116d0 con 0x7fe130108e40 2024-08-20T05:01:19.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.180+0000 7fe137e00640 1 -- 172.21.15.37:0/1289766839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1301abff0 con 0x7fe130108e40 2024-08-20T05:01:19.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.182+0000 7fe137e00640 1 -- 172.21.15.37:0/1289766839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe130102e90 con 0x7fe130108e40 2024-08-20T05:01:19.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.184+0000 7fe12e000640 1 -- 172.21.15.37:0/1289766839 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7fe128005460 con 0x7fe130108e40 2024-08-20T05:01:19.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.185+0000 7fe12e000640 1 --2- 172.21.15.37:0/1289766839 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe1180b3c60 0x7fe1180b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:19.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.185+0000 7fe12e000640 1 -- 172.21.15.37:0/1289766839 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7fe1280e41c0 con 0x7fe130108e40 2024-08-20T05:01:19.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.185+0000 7fe135400640 1 --2- 172.21.15.37:0/1289766839 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe1180b3c60 0x7fe1180b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:19.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.186+0000 7fe135400640 1 --2- 172.21.15.37:0/1289766839 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe1180b3c60 0x7fe1180b6120 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe124005ab0 tx=0x7fe124005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:19.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.189+0000 7fe12e000640 1 -- 172.21.15.37:0/1289766839 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe128016030 con 0x7fe130108e40 2024-08-20T05:01:19.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.423+0000 7fe137e00640 1 -- 172.21.15.37:0/1289766839 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe13002e340 con 0x7fe130108e40 2024-08-20T05:01:19.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:19 smithi037 ceph-mon[17265]: pgmap v371: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:19.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:19.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:19.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:01:19.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:01:19.425 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:19.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.423+0000 7fe12e000640 1 -- 172.21.15.37:0/1289766839 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11980 (secure 0 0 0) 0x7fe1280aaca0 con 0x7fe130108e40 2024-08-20T05:01:19.426 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:01:19.426 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"btime":"2024-08-20T05:00:06:145262+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:00:06.145248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:01:19.427 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-08-20T05:01:19.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.426+0000 7fe137e00640 1 -- 172.21.15.37:0/1289766839 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe1180b3c60 msgr2=0x7fe1180b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:19.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.426+0000 7fe137e00640 1 --2- 172.21.15.37:0/1289766839 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe1180b3c60 0x7fe1180b6120 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe124005ab0 tx=0x7fe124005a20 comp rx=0 tx=0).stop 2024-08-20T05:01:19.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.426+0000 7fe137e00640 1 -- 172.21.15.37:0/1289766839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe130108e40 msgr2=0x7fe1301a4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:19.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.426+0000 7fe137e00640 1 --2- 172.21.15.37:0/1289766839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe130108e40 0x7fe1301a4e70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe12800e940 tx=0x7fe12800ee00 comp rx=0 tx=0).stop 2024-08-20T05:01:19.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.426+0000 7fe137e00640 1 -- 172.21.15.37:0/1289766839 shutdown_connections 2024-08-20T05:01:19.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.426+0000 7fe137e00640 1 --2- 172.21.15.37:0/1289766839 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe1180b3c60 0x7fe1180b6120 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:19.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.426+0000 7fe137e00640 1 --2- 172.21.15.37:0/1289766839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe130108e40 0x7fe1301a4e70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:19.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.426+0000 7fe137e00640 1 --2- 172.21.15.37:0/1289766839 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe1301084c0 0x7fe13010eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:19.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.426+0000 7fe137e00640 1 --2- 172.21.15.37:0/1289766839 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe130102ab0 0x7fe13010e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:19.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.426+0000 7fe137e00640 1 -- 172.21.15.37:0/1289766839 >> 172.21.15.37:0/1289766839 conn(0x7fe1300fe500 msgr2=0x7fe130104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:19.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.426+0000 7fe137e00640 1 -- 172.21.15.37:0/1289766839 shutdown_connections 2024-08-20T05:01:19.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:19.426+0000 7fe137e00640 1 -- 172.21.15.37:0/1289766839 wait complete. 2024-08-20T05:01:19.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:19 smithi135 ceph-mon[22342]: pgmap v371: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:19.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:19.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:19.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:01:19.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:01:19.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:19.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:19 smithi130 ceph-mon[22007]: pgmap v371: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:19.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:19.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:19.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:01:19.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:01:19.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:01:20.146 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T05:01:20.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:20 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1289766839' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:01:20.528 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:20.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:20 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1289766839' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:01:20.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:20 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1289766839' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:01:21.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.157+0000 7f453c000640 1 -- 172.21.15.37:0/4283038717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453410f470 msgr2=0x7f4534115c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:21.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.157+0000 7f453c000640 1 --2- 172.21.15.37:0/4283038717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453410f470 0x7f4534115c70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f452c009ca0 tx=0x7f452c02a8c0 comp rx=0 tx=0).stop 2024-08-20T05:01:21.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.158+0000 7f453c000640 1 -- 172.21.15.37:0/4283038717 shutdown_connections 2024-08-20T05:01:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.158+0000 7f453c000640 1 --2- 172.21.15.37:0/4283038717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453410f470 0x7f4534115c70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.158+0000 7f453c000640 1 --2- 172.21.15.37:0/4283038717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f453410eaf0 0x7f453410ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.158+0000 7f453c000640 1 --2- 172.21.15.37:0/4283038717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45341090e0 0x7f45341094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.158+0000 7f453c000640 1 -- 172.21.15.37:0/4283038717 >> 172.21.15.37:0/4283038717 conn(0x7f4534078760 msgr2=0x7f453407ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.158+0000 7f453c000640 1 -- 172.21.15.37:0/4283038717 shutdown_connections 2024-08-20T05:01:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.158+0000 7f453c000640 1 -- 172.21.15.37:0/4283038717 wait complete. 2024-08-20T05:01:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.159+0000 7f453c000640 1 Processor -- start 2024-08-20T05:01:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.159+0000 7f453c000640 1 -- start start 2024-08-20T05:01:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.159+0000 7f453c000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45341090e0 0x7f453419f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.159+0000 7f453c000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f453410eaf0 0x7f453419faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.159+0000 7f453c000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453410f470 0x7f45341a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.159+0000 7f453c000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f45341190f0 con 0x7f453410f470 2024-08-20T05:01:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.159+0000 7f453c000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4534118f70 con 0x7f453410eaf0 2024-08-20T05:01:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.159+0000 7f453c000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4534119270 con 0x7f45341090e0 2024-08-20T05:01:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.159+0000 7f453a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453410f470 0x7f45341a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.159+0000 7f4539600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45341090e0 0x7f453419f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.159+0000 7f4538c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f453410eaf0 0x7f453419faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:21.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.159+0000 7f453a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453410f470 0x7f45341a4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60552/0 (socket says 172.21.15.37:60552) 2024-08-20T05:01:21.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.159+0000 7f453a000640 1 -- 172.21.15.37:0/2134476551 learned_addr learned my addr 172.21.15.37:0/2134476551 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:21.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.160+0000 7f4539600640 1 -- 172.21.15.37:0/2134476551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f453410eaf0 msgr2=0x7f453419faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:21.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.160+0000 7f4539600640 1 --2- 172.21.15.37:0/2134476551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f453410eaf0 0x7f453419faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:21.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.160+0000 7f4539600640 1 -- 172.21.15.37:0/2134476551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453410f470 msgr2=0x7f45341a4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:21.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.160+0000 7f4539600640 1 --2- 172.21.15.37:0/2134476551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453410f470 0x7f45341a4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:21.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.160+0000 7f4539600640 1 -- 172.21.15.37:0/2134476551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45341a5610 con 0x7f45341090e0 2024-08-20T05:01:21.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.160+0000 7f4539600640 1 --2- 172.21.15.37:0/2134476551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45341090e0 0x7f453419f560 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f452800e9f0 tx=0x7f452800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.161+0000 7f4532000640 1 -- 172.21.15.37:0/2134476551 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452800ccc0 con 0x7f45341090e0 2024-08-20T05:01:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.161+0000 7f453c000640 1 -- 172.21.15.37:0/2134476551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45341a5900 con 0x7f45341090e0 2024-08-20T05:01:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.161+0000 7f4532000640 1 -- 172.21.15.37:0/2134476551 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4528005020 con 0x7f45341090e0 2024-08-20T05:01:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.161+0000 7f4532000640 1 -- 172.21.15.37:0/2134476551 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4528004a00 con 0x7f45341090e0 2024-08-20T05:01:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.161+0000 7f453c000640 1 -- 172.21.15.37:0/2134476551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45341abfc0 con 0x7f45341090e0 2024-08-20T05:01:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.162+0000 7f453c000640 1 -- 172.21.15.37:0/2134476551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45341094c0 con 0x7f45341090e0 2024-08-20T05:01:21.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.164+0000 7f4532000640 1 -- 172.21.15.37:0/2134476551 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f4528004ba0 con 0x7f45341090e0 2024-08-20T05:01:21.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.166+0000 7f4532000640 1 --2- 172.21.15.37:0/2134476551 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f451c0b3c60 0x7f451c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:21.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.166+0000 7f4532000640 1 -- 172.21.15.37:0/2134476551 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f45280e4150 con 0x7f45341090e0 2024-08-20T05:01:21.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.166+0000 7f4538c00640 1 --2- 172.21.15.37:0/2134476551 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f451c0b3c60 0x7f451c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:21.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.167+0000 7f4538c00640 1 --2- 172.21.15.37:0/2134476551 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f451c0b3c60 0x7f451c0b6120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4534108a20 tx=0x7f452000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:21.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.168+0000 7f4532000640 1 -- 172.21.15.37:0/2134476551 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f45280ab310 con 0x7f45341090e0 2024-08-20T05:01:21.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.366+0000 7f453c000640 1 -- 172.21.15.37:0/2134476551 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f45341ac3a0 con 0x7f45341090e0 2024-08-20T05:01:21.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.368+0000 7f4532000640 1 -- 172.21.15.37:0/2134476551 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) ==== 74+0+24705 (secure 0 0 0) 0x7f45280aac10 con 0x7f45341090e0 2024-08-20T05:01:21.371 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:01:21.371 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":86,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","created":"2024-08-20T04:50:26.520303+0000","modified":"2024-08-20T05:00:29.355329+0000","last_up_change":"2024-08-20T04:58:12.250259+0000","last_in_change":"2024-08-20T04:57:49.724189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T04:54:16.381529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T04:59:08.598741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T04:59:10.793802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-20T04:59:19.888446+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a813e53b-68b3-43ff-a59b-aed00e98f2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6803","nonce":3569936373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6805","nonce":3569936373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6809","nonce":3569936373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6807","nonce":3569936373}]},"public_addr":"172.21.15.37:6803/3569936373","cluster_addr":"172.21.15.37:6805/3569936373","heartbeat_back_addr":"172.21.15.37:6809/3569936373","heartbeat_front_addr":"172.21.15.37:6807/3569936373","state":["exists","up"]},{"osd":1,"uuid":"c216a8d0-9685-467a-8161-700682ce617c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6801","nonce":4206461125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6803","nonce":4206461125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6807","nonce":4206461125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6805","nonce":4206461125}]},"public_addr":"172.21.15.130:6801/4206461125","cluster_addr":"172.21.15.130:6803/4206461125","heartbeat_back_addr":"172.21.15.130:6807/4206461125","heartbeat_front_addr":"172.21.15.130:6805/4206461125","state":["exists","up"]},{"osd":2,"uuid":"34402442-c652-40eb-865e-a607a28846b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6801","nonce":2653255199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6803","nonce":2653255199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6807","nonce":2653255199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6805","nonce":2653255199}]},"public_addr":"172.21.15.135:6801/2653255199","cluster_addr":"172.21.15.135:6803/2653255199","heartbeat_back_addr":"172.21.15.135:6807/2653255199","heartbeat_front_addr":"172.21.15.135:6805/2653255199","state":["exists","up"]},{"osd":3,"uuid":"ec7be9dc-96b5-4816-9065-8121baedcdc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6811","nonce":2601290990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6813","nonce":2601290990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6817","nonce":2601290990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6815","nonce":2601290990}]},"public_addr":"172.21.15.37:6811/2601290990","cluster_addr":"172.21.15.37:6813/2601290990","heartbeat_back_addr":"172.21.15.37:6817/2601290990","heartbeat_front_addr":"172.21.15.37:6815/2601290990","state":["exists","up"]},{"osd":4,"uuid":"2dbd47f9-8686-4707-8862-3c7a99a37d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6809","nonce":3542081474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6811","nonce":3542081474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6815","nonce":3542081474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6813","nonce":3542081474}]},"public_addr":"172.21.15.130:6809/3542081474","cluster_addr":"172.21.15.130:6811/3542081474","heartbeat_back_addr":"172.21.15.130:6815/3542081474","heartbeat_front_addr":"172.21.15.130:6813/3542081474","state":["exists","up"]},{"osd":5,"uuid":"9a07a137-d6b7-4aba-8678-4fd164597f27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6809","nonce":2507249148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6811","nonce":2507249148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6815","nonce":2507249148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6813","nonce":2507249148}]},"public_addr":"172.21.15.135:6809/2507249148","cluster_addr":"172.21.15.135:6811/2507249148","heartbeat_back_addr":"172.21.15.135:6815/2507249148","heartbeat_front_addr":"172.21.15.135:6813/2507249148","state":["exists","up"]},{"osd":6,"uuid":"6d6346e8-5418-4c30-9bb3-5af352b616a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6819","nonce":155932692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6821","nonce":155932692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6825","nonce":155932692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6823","nonce":155932692}]},"public_addr":"172.21.15.37:6819/155932692","cluster_addr":"172.21.15.37:6821/155932692","heartbeat_back_addr":"172.21.15.37:6825/155932692","heartbeat_front_addr":"172.21.15.37:6823/155932692","state":["exists","up"]},{"osd":7,"uuid":"c87804c2-d456-495e-b36e-33dbb3548347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6817","nonce":4148130245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6819","nonce":4148130245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6823","nonce":4148130245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6821","nonce":4148130245}]},"public_addr":"172.21.15.130:6817/4148130245","cluster_addr":"172.21.15.130:6819/4148130245","heartbeat_back_addr":"172.21.15.130:6823/4148130245","heartbeat_front_addr":"172.21.15.130:6821/4148130245","state":["exists","up"]},{"osd":8,"uuid":"a7d4c9c8-1826-4703-92ad-ded2800b4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6817","nonce":222884649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6819","nonce":222884649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6823","nonce":222884649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6821","nonce":222884649}]},"public_addr":"172.21.15.135:6817/222884649","cluster_addr":"172.21.15.135:6819/222884649","heartbeat_back_addr":"172.21.15.135:6823/222884649","heartbeat_front_addr":"172.21.15.135:6821/222884649","state":["exists","up"]},{"osd":9,"uuid":"f9e0c194-66b5-4e62-b2ae-816a4a4fffbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6827","nonce":2240773042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6829","nonce":2240773042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6833","nonce":2240773042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6831","nonce":2240773042}]},"public_addr":"172.21.15.37:6827/2240773042","cluster_addr":"172.21.15.37:6829/2240773042","heartbeat_back_addr":"172.21.15.37:6833/2240773042","heartbeat_front_addr":"172.21.15.37:6831/2240773042","state":["exists","up"]},{"osd":10,"uuid":"fa6a50a5-2b97-42d1-9b57-b5502b7083d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6825","nonce":2896730163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6827","nonce":2896730163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6831","nonce":2896730163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6829","nonce":2896730163}]},"public_addr":"172.21.15.130:6825/2896730163","cluster_addr":"172.21.15.130:6827/2896730163","heartbeat_back_addr":"172.21.15.130:6831/2896730163","heartbeat_front_addr":"172.21.15.130:6829/2896730163","state":["exists","up"]},{"osd":11,"uuid":"9a305d75-030d-41db-abfb-81bb71e8c6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6825","nonce":2532897645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6827","nonce":2532897645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6831","nonce":2532897645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6829","nonce":2532897645}]},"public_addr":"172.21.15.135:6825/2532897645","cluster_addr":"172.21.15.135:6827/2532897645","heartbeat_back_addr":"172.21.15.135:6831/2532897645","heartbeat_front_addr":"172.21.15.135:6829/2532897645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:26.455665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:51.456030+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:14.332699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:42.749386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:07.587091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:32.450249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:01.864489+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:26.830527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:51.206257+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:20.400020+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:46.329864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:58:11.086508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4282140105":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/1217599998":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/3737412906":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/58912454":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/2105948300":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/1480362562":"2024-08-21T04:50:59.520912+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T05:01:21.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.371+0000 7f453c000640 1 -- 172.21.15.37:0/2134476551 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f451c0b3c60 msgr2=0x7f451c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:21.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.371+0000 7f453c000640 1 --2- 172.21.15.37:0/2134476551 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f451c0b3c60 0x7f451c0b6120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4534108a20 tx=0x7f452000b410 comp rx=0 tx=0).stop 2024-08-20T05:01:21.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.371+0000 7f453c000640 1 -- 172.21.15.37:0/2134476551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45341090e0 msgr2=0x7f453419f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:21.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.371+0000 7f453c000640 1 --2- 172.21.15.37:0/2134476551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45341090e0 0x7f453419f560 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f452800e9f0 tx=0x7f452800eeb0 comp rx=0 tx=0).stop 2024-08-20T05:01:21.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.371+0000 7f453c000640 1 -- 172.21.15.37:0/2134476551 shutdown_connections 2024-08-20T05:01:21.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.371+0000 7f453c000640 1 --2- 172.21.15.37:0/2134476551 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f451c0b3c60 0x7f451c0b6120 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:21.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.371+0000 7f453c000640 1 --2- 172.21.15.37:0/2134476551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f453410f470 0x7f45341a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:21.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.371+0000 7f453c000640 1 --2- 172.21.15.37:0/2134476551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f453410eaf0 0x7f453419faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:21.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.371+0000 7f453c000640 1 --2- 172.21.15.37:0/2134476551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f45341090e0 0x7f453419f560 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:21.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.371+0000 7f453c000640 1 -- 172.21.15.37:0/2134476551 >> 172.21.15.37:0/2134476551 conn(0x7f4534078760 msgr2=0x7f453407ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:21.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.371+0000 7f453c000640 1 -- 172.21.15.37:0/2134476551 shutdown_connections 2024-08-20T05:01:21.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:21.371+0000 7f453c000640 1 -- 172.21.15.37:0/2134476551 wait complete. 2024-08-20T05:01:21.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:21 smithi135 ceph-mon[22342]: pgmap v372: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:21.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:21 smithi130 ceph-mon[22007]: pgmap v372: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:21.747 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:21 smithi037 ceph-mon[17265]: pgmap v372: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:22.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:01:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:22.615 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:22 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2134476551' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:01:22.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:22 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2134476551' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:01:22.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:22 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2134476551' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:01:23.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.073+0000 7f8a17e00640 1 -- 172.21.15.37:0/486055731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a1810a520 msgr2=0x7f8a1810a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:23.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.073+0000 7f8a17e00640 1 --2- 172.21.15.37:0/486055731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a1810a520 0x7f8a1810a960 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009900 tx=0x7f8a0402a410 comp rx=0 tx=0).stop 2024-08-20T05:01:23.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.073+0000 7f8a17e00640 1 -- 172.21.15.37:0/486055731 shutdown_connections 2024-08-20T05:01:23.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.073+0000 7f8a17e00640 1 --2- 172.21.15.37:0/486055731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a1810aea0 0x7f8a181116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:23.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.073+0000 7f8a17e00640 1 --2- 172.21.15.37:0/486055731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a1810a520 0x7f8a1810a960 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:23.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.073+0000 7f8a17e00640 1 --2- 172.21.15.37:0/486055731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a18104b10 0x7f8a18104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:23.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.073+0000 7f8a17e00640 1 -- 172.21.15.37:0/486055731 >> 172.21.15.37:0/486055731 conn(0x7f8a18100540 msgr2=0x7f8a18102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:23.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.073+0000 7f8a17e00640 1 -- 172.21.15.37:0/486055731 shutdown_connections 2024-08-20T05:01:23.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.073+0000 7f8a17e00640 1 -- 172.21.15.37:0/486055731 wait complete. 2024-08-20T05:01:23.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.074+0000 7f8a17e00640 1 Processor -- start 2024-08-20T05:01:23.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.074+0000 7f8a17e00640 1 -- start start 2024-08-20T05:01:23.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.075+0000 7f8a17e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a18104b10 0x7f8a1819af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:23.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.075+0000 7f8a17e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a1810a520 0x7f8a1819b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:23.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.075+0000 7f8a17e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a1810aea0 0x7f8a181a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:23.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.075+0000 7f8a17e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a18114af0 con 0x7f8a1810aea0 2024-08-20T05:01:23.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.075+0000 7f8a17e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8a18114970 con 0x7f8a1810a520 2024-08-20T05:01:23.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.075+0000 7f8a17e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a18114c70 con 0x7f8a18104b10 2024-08-20T05:01:23.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.075+0000 7f8a16a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a18104b10 0x7f8a1819af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:23.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.075+0000 7f8a16a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a18104b10 0x7f8a1819af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:56872/0 (socket says 172.21.15.37:56872) 2024-08-20T05:01:23.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.075+0000 7f8a16a00640 1 -- 172.21.15.37:0/1392692300 learned_addr learned my addr 172.21.15.37:0/1392692300 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:23.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.075+0000 7f8a17400640 1 --2- 172.21.15.37:0/1392692300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a1810aea0 0x7f8a181a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:23.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.075+0000 7f8a16000640 1 --2- 172.21.15.37:0/1392692300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a1810a520 0x7f8a1819b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:23.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.076+0000 7f8a16a00640 1 -- 172.21.15.37:0/1392692300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a1810a520 msgr2=0x7f8a1819b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:23.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.076+0000 7f8a16a00640 1 --2- 172.21.15.37:0/1392692300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a1810a520 0x7f8a1819b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:23.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.076+0000 7f8a16a00640 1 -- 172.21.15.37:0/1392692300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a1810aea0 msgr2=0x7f8a181a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:23.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.076+0000 7f8a16a00640 1 --2- 172.21.15.37:0/1392692300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a1810aea0 0x7f8a181a07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:23.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.076+0000 7f8a16a00640 1 -- 172.21.15.37:0/1392692300 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a181a0fb0 con 0x7f8a18104b10 2024-08-20T05:01:23.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.076+0000 7f8a16a00640 1 --2- 172.21.15.37:0/1392692300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a18104b10 0x7f8a1819af00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009d50 tx=0x7f8a0800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:23.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.076+0000 7f8a0f400640 1 -- 172.21.15.37:0/1392692300 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a08003b70 con 0x7f8a18104b10 2024-08-20T05:01:23.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.076+0000 7f8a17e00640 1 -- 172.21.15.37:0/1392692300 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a181a12a0 con 0x7f8a18104b10 2024-08-20T05:01:23.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.076+0000 7f8a0f400640 1 -- 172.21.15.37:0/1392692300 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a08003d10 con 0x7f8a18104b10 2024-08-20T05:01:23.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.076+0000 7f8a0f400640 1 -- 172.21.15.37:0/1392692300 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a080108b0 con 0x7f8a18104b10 2024-08-20T05:01:23.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.077+0000 7f8a17e00640 1 -- 172.21.15.37:0/1392692300 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a181a7b30 con 0x7f8a18104b10 2024-08-20T05:01:23.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.077+0000 7f8a17e00640 1 -- 172.21.15.37:0/1392692300 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a18104ef0 con 0x7f8a18104b10 2024-08-20T05:01:23.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.080+0000 7f8a0f400640 1 -- 172.21.15.37:0/1392692300 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f8a08004000 con 0x7f8a18104b10 2024-08-20T05:01:23.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.081+0000 7f8a0f400640 1 --2- 172.21.15.37:0/1392692300 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f89fc0b3d90 0x7f89fc0b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:23.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.082+0000 7f8a0f400640 1 -- 172.21.15.37:0/1392692300 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f8a080e47e0 con 0x7f8a18104b10 2024-08-20T05:01:23.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.082+0000 7f8a16000640 1 --2- 172.21.15.37:0/1392692300 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f89fc0b3d90 0x7f89fc0b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:23.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.082+0000 7f8a16000640 1 --2- 172.21.15.37:0/1392692300 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f89fc0b3d90 0x7f89fc0b6250 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8a04031440 tx=0x7f8a04005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:23.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.083+0000 7f8a0f400640 1 -- 172.21.15.37:0/1392692300 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f8a080ab9a0 con 0x7f8a18104b10 2024-08-20T05:01:23.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.321+0000 7f8a17e00640 1 -- 172.21.15.37:0/1392692300 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a1810cce0 con 0x7f8a18104b10 2024-08-20T05:01:23.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.322+0000 7f8a0f400640 1 -- 172.21.15.37:0/1392692300 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11980 (secure 0 0 0) 0x7f8a080ab2a0 con 0x7f8a18104b10 2024-08-20T05:01:23.324 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:01:23.325 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"btime":"2024-08-20T05:00:06:145262+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:00:06.145248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:01:23.325 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-08-20T05:01:23.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.325+0000 7f8a17e00640 1 -- 172.21.15.37:0/1392692300 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f89fc0b3d90 msgr2=0x7f89fc0b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:23.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.325+0000 7f8a17e00640 1 --2- 172.21.15.37:0/1392692300 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f89fc0b3d90 0x7f89fc0b6250 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8a04031440 tx=0x7f8a04005b50 comp rx=0 tx=0).stop 2024-08-20T05:01:23.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.325+0000 7f8a17e00640 1 -- 172.21.15.37:0/1392692300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a18104b10 msgr2=0x7f8a1819af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:23.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.325+0000 7f8a17e00640 1 --2- 172.21.15.37:0/1392692300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a18104b10 0x7f8a1819af00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009d50 tx=0x7f8a0800c6a0 comp rx=0 tx=0).stop 2024-08-20T05:01:23.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.325+0000 7f8a17e00640 1 -- 172.21.15.37:0/1392692300 shutdown_connections 2024-08-20T05:01:23.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.325+0000 7f8a17e00640 1 --2- 172.21.15.37:0/1392692300 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f89fc0b3d90 0x7f89fc0b6250 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:23.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.325+0000 7f8a17e00640 1 --2- 172.21.15.37:0/1392692300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a1810aea0 0x7f8a181a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:23.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.325+0000 7f8a17e00640 1 --2- 172.21.15.37:0/1392692300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a1810a520 0x7f8a1819b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:23.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.325+0000 7f8a17e00640 1 --2- 172.21.15.37:0/1392692300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a18104b10 0x7f8a1819af00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:23.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.325+0000 7f8a17e00640 1 -- 172.21.15.37:0/1392692300 >> 172.21.15.37:0/1392692300 conn(0x7f8a18100540 msgr2=0x7f8a18102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:23.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.325+0000 7f8a17e00640 1 -- 172.21.15.37:0/1392692300 shutdown_connections 2024-08-20T05:01:23.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:23.325+0000 7f8a17e00640 1 -- 172.21.15.37:0/1392692300 wait complete. 2024-08-20T05:01:23.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:23 smithi135 ceph-mon[22342]: pgmap v373: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:01:23.666 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:23 smithi037 ceph-mon[17265]: pgmap v373: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:01:23.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:23 smithi130 ceph-mon[22007]: pgmap v373: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:01:24.064 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-20T04:59:13.823062+0000', 'modified': '2024-08-20T05:00:06.145248+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24695, 'mds_1': 24664, 'mds_2': 24656, 'mds_3': 24649, 'mds_4': 24637}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14652': {'gid': 14652, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6839/1587848243', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6838', 'nonce': 1587848243}, {'type': 'v1', 'addr': '172.21.15.37:6839', 'nonce': 1587848243}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14664': {'gid': 14664, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6841/466077750', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6840', 'nonce': 466077750}, {'type': 'v1', 'addr': '172.21.15.37:6841', 'nonce': 466077750}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24590': {'gid': 24590, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6833/1818782678', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6832', 'nonce': 1818782678}, {'type': 'v1', 'addr': '172.21.15.130:6833', 'nonce': 1818782678}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24592': {'gid': 24592, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6833/4059666386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6832', 'nonce': 4059666386}, {'type': 'v1', 'addr': '172.21.15.135:6833', 'nonce': 4059666386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24626': {'gid': 24626, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6835/538714148', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6834', 'nonce': 538714148}, {'type': 'v1', 'addr': '172.21.15.130:6835', 'nonce': 538714148}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24637': {'gid': 24637, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 22, 'addr': '172.21.15.135:6835/998113160', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 998113160}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 998113160}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24649': {'gid': 24649, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 22, 'addr': '172.21.15.135:6837/894352067', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6836', 'nonce': 894352067}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 894352067}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24656': {'gid': 24656, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.130:6837/1513603753', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6836', 'nonce': 1513603753}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 1513603753}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24664': {'gid': 24664, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.135:6839/2602130726', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 2602130726}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 2602130726}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24695': {'gid': 24695, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.130:6839/2863850712', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6838', 'nonce': 2863850712}, {'type': 'v1', 'addr': '172.21.15.130:6839', 'nonce': 2863850712}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24695, 'qdb_cluster': [24664, 24695, 24656, 24649, 24637]} 2024-08-20T05:01:24.064 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-20T05:01:24.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.f status 2024-08-20T05:01:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:24.581 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:24 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1392692300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:01:24.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:24 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1392692300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:01:24.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:24 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1392692300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:01:24.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.982+0000 7f017d000640 1 -- 172.21.15.37:0/1737438531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01781084c0 msgr2=0x7f0178108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:24.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.982+0000 7f017d000640 1 --2- 172.21.15.37:0/1737438531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01781084c0 0x7f0178108900 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f0160009900 tx=0x7f016002a410 comp rx=0 tx=0).stop 2024-08-20T05:01:24.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.982+0000 7f017d000640 1 -- 172.21.15.37:0/1737438531 shutdown_connections 2024-08-20T05:01:24.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.982+0000 7f017d000640 1 --2- 172.21.15.37:0/1737438531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0178108e40 0x7f017810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:24.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.982+0000 7f017d000640 1 --2- 172.21.15.37:0/1737438531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01781084c0 0x7f0178108900 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:24.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.982+0000 7f017d000640 1 --2- 172.21.15.37:0/1737438531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0178102ab0 0x7f0178102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:24.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.982+0000 7f017d000640 1 -- 172.21.15.37:0/1737438531 >> 172.21.15.37:0/1737438531 conn(0x7f01780fe500 msgr2=0x7f0178100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:24.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.982+0000 7f017d000640 1 -- 172.21.15.37:0/1737438531 shutdown_connections 2024-08-20T05:01:24.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.982+0000 7f017d000640 1 -- 172.21.15.37:0/1737438531 wait complete. 2024-08-20T05:01:24.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.983+0000 7f017d000640 1 Processor -- start 2024-08-20T05:01:24.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.983+0000 7f017d000640 1 -- start start 2024-08-20T05:01:24.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.984+0000 7f017d000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0178102ab0 0x7f017819b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:24.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.984+0000 7f017d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01781084c0 0x7f017819b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:24.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.984+0000 7f017d000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0178108e40 0x7f01781a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:24.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.984+0000 7f017d000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0178112b50 con 0x7f01781084c0 2024-08-20T05:01:24.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.984+0000 7f017d000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f01781129d0 con 0x7f0178102ab0 2024-08-20T05:01:24.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.984+0000 7f017d000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0178112cd0 con 0x7f0178108e40 2024-08-20T05:01:24.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.984+0000 7f016d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01781084c0 0x7f017819b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:24.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.984+0000 7f0175e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0178102ab0 0x7f017819b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:24.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.984+0000 7f016d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01781084c0 0x7f017819b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34172/0 (socket says 172.21.15.37:34172) 2024-08-20T05:01:24.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.984+0000 7f016d400640 1 -- 172.21.15.37:0/736198139 learned_addr learned my addr 172.21.15.37:0/736198139 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:24.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.984+0000 7f0176800640 1 --2- 172.21.15.37:0/736198139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0178108e40 0x7f01781a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:24.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.984+0000 7f016d400640 1 -- 172.21.15.37:0/736198139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0178108e40 msgr2=0x7f01781a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:24.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.984+0000 7f016d400640 1 --2- 172.21.15.37:0/736198139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0178108e40 0x7f01781a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:24.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.984+0000 7f016d400640 1 -- 172.21.15.37:0/736198139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0178102ab0 msgr2=0x7f017819b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:24.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.984+0000 7f016d400640 1 --2- 172.21.15.37:0/736198139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0178102ab0 0x7f017819b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:24.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.985+0000 7f016d400640 1 -- 172.21.15.37:0/736198139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01781a1280 con 0x7f01781084c0 2024-08-20T05:01:24.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.985+0000 7f0175e00640 1 --2- 172.21.15.37:0/736198139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0178102ab0 0x7f017819b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:24.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.985+0000 7f016d400640 1 --2- 172.21.15.37:0/736198139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01781084c0 0x7f017819b710 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0160005ab0 tx=0x7f0160003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:24.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.985+0000 7f016f400640 1 -- 172.21.15.37:0/736198139 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016003f070 con 0x7f01781084c0 2024-08-20T05:01:24.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.985+0000 7f016f400640 1 -- 172.21.15.37:0/736198139 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0160031d60 con 0x7f01781084c0 2024-08-20T05:01:24.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.985+0000 7f017d000640 1 -- 172.21.15.37:0/736198139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01781a1510 con 0x7f01781084c0 2024-08-20T05:01:24.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.985+0000 7f016f400640 1 -- 172.21.15.37:0/736198139 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0160035030 con 0x7f01781084c0 2024-08-20T05:01:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.985+0000 7f017d000640 1 -- 172.21.15.37:0/736198139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01781a7c30 con 0x7f01781084c0 2024-08-20T05:01:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.988+0000 7f017fa78740 1 Processor -- start 2024-08-20T05:01:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.988+0000 7f017fa78740 1 -- start start 2024-08-20T05:01:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.989+0000 7f017fa78740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff2f10 0x5592c6ff32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.989+0000 7f017fa78740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff3830 0x5592c6fff280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.989+0000 7f017fa78740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6fff7c0 0x5592c7001bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.989+0000 7f017fa78740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5592c6f69840 con 0x5592c6ff3830 2024-08-20T05:01:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.989+0000 7f017fa78740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5592c6f58d40 con 0x5592c6ff2f10 2024-08-20T05:01:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.989+0000 7f017fa78740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5592c6f5cd80 con 0x5592c6fff7c0 2024-08-20T05:01:25.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.989+0000 7f016f400640 1 -- 172.21.15.37:0/736198139 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f0160042070 con 0x7f01781084c0 2024-08-20T05:01:25.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.989+0000 7f0175e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff3830 0x5592c6fff280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:25.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.989+0000 7f0175e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff3830 0x5592c6fff280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34182/0 (socket says 172.21.15.37:34182) 2024-08-20T05:01:25.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.989+0000 7f0175e00640 1 -- 172.21.15.37:0/2334694398 learned_addr learned my addr 172.21.15.37:0/2334694398 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:25.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.989+0000 7f016d400640 1 --2- 172.21.15.37:0/2334694398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6fff7c0 0x5592c7001bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:25.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.989+0000 7f0176800640 1 --2- 172.21.15.37:0/2334694398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff2f10 0x5592c6ff32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:25.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.990+0000 7f0175e00640 1 -- 172.21.15.37:0/2334694398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6fff7c0 msgr2=0x5592c7001bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:25.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.990+0000 7f0175e00640 1 --2- 172.21.15.37:0/2334694398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6fff7c0 0x5592c7001bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.990+0000 7f0175e00640 1 -- 172.21.15.37:0/2334694398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff2f10 msgr2=0x5592c6ff32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:25.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.990+0000 7f0175e00640 1 --2- 172.21.15.37:0/2334694398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff2f10 0x5592c6ff32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.990+0000 7f0175e00640 1 -- 172.21.15.37:0/2334694398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592c6eff1c0 con 0x5592c6ff3830 2024-08-20T05:01:25.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.990+0000 7f0175e00640 1 --2- 172.21.15.37:0/2334694398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff3830 0x5592c6fff280 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f01680115f0 tx=0x7f0168011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284be3b27b7724a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:25.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.990+0000 7f0167400640 1 -- 172.21.15.37:0/2334694398 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016801e070 con 0x5592c6ff3830 2024-08-20T05:01:25.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.990+0000 7f0167400640 1 -- 172.21.15.37:0/2334694398 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f016800faf0 con 0x5592c6ff3830 2024-08-20T05:01:25.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.990+0000 7f0167400640 1 -- 172.21.15.37:0/2334694398 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168019b40 con 0x5592c6ff3830 2024-08-20T05:01:25.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.991+0000 7f016f400640 1 --2- 172.21.15.37:0/736198139 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f015c0b3c60 0x7f015c0b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:25.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.991+0000 7f016f400640 1 -- 172.21.15.37:0/736198139 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f01601048d0 con 0x7f01781084c0 2024-08-20T05:01:25.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.991+0000 7f0176800640 1 --2- 172.21.15.37:0/736198139 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f015c0b3c60 0x7f015c0b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:25.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.991+0000 7f017fa78740 1 -- 172.21.15.37:0/2334694398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff3830 msgr2=0x5592c6fff280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:25.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.991+0000 7f017fa78740 1 --2- 172.21.15.37:0/2334694398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff3830 0x5592c6fff280 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f01680115f0 tx=0x7f0168011ab0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.991+0000 7f017fa78740 1 -- 172.21.15.37:0/2334694398 shutdown_connections 2024-08-20T05:01:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.991+0000 7f017fa78740 1 --2- 172.21.15.37:0/2334694398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6fff7c0 0x5592c7001bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.991+0000 7f017fa78740 1 --2- 172.21.15.37:0/2334694398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff3830 0x5592c6fff280 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.991+0000 7f017fa78740 1 --2- 172.21.15.37:0/2334694398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff2f10 0x5592c6ff32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.991+0000 7f017fa78740 1 -- 172.21.15.37:0/2334694398 >> 172.21.15.37:0/2334694398 conn(0x5592c6ff0d40 msgr2=0x5592c6ff1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.992+0000 7f017fa78740 1 -- 172.21.15.37:0/2334694398 shutdown_connections 2024-08-20T05:01:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.992+0000 7f017fa78740 1 -- 172.21.15.37:0/2334694398 wait complete. 2024-08-20T05:01:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.992+0000 7f0176800640 1 --2- 172.21.15.37:0/736198139 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f015c0b3c60 0x7f015c0b6120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0170005fd0 tx=0x7f01700096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.992+0000 7f017fa78740 1 -- start start 2024-08-20T05:01:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.992+0000 7f017fa78740 1 Processor -- start 2024-08-20T05:01:25.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.993+0000 7f017fa78740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff2f10 0x5592c6ffef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:25.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.993+0000 7f017fa78740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff3830 0x5592c6ffc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:25.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.993+0000 7f017fa78740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6fff7c0 0x5592c6ffc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:25.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.993+0000 7f017fa78740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5592c6dbb5f0 con 0x5592c6ff2f10 2024-08-20T05:01:25.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.993+0000 7f017fa78740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5592c6ef4170 con 0x5592c6ff3830 2024-08-20T05:01:25.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.993+0000 7f017fa78740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5592c7002470 con 0x5592c6fff7c0 2024-08-20T05:01:25.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.993+0000 7f017fa78740 10 client.0 _ll_register_callbacks cb 0x5592c6f538b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:01:25.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.993+0000 7f0175e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff2f10 0x5592c6ffef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:25.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.993+0000 7f0175e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff2f10 0x5592c6ffef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34184/0 (socket says 172.21.15.37:34184) 2024-08-20T05:01:25.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.993+0000 7f0175e00640 1 -- 172.21.15.37:0/3347053037 learned_addr learned my addr 172.21.15.37:0/3347053037 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:25.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.993+0000 7f016d400640 1 --2- 172.21.15.37:0/3347053037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff3830 0x5592c6ffc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:25.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.993+0000 7f0176800640 1 --2- 172.21.15.37:0/3347053037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6fff7c0 0x5592c6ffc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:25.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.994+0000 7f0175e00640 1 -- 172.21.15.37:0/3347053037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6fff7c0 msgr2=0x5592c6ffc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:25.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.994+0000 7f0175e00640 1 --2- 172.21.15.37:0/3347053037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6fff7c0 0x5592c6ffc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.994+0000 7f0175e00640 1 -- 172.21.15.37:0/3347053037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff3830 msgr2=0x5592c6ffc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:25.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.994+0000 7f0175e00640 1 --2- 172.21.15.37:0/3347053037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff3830 0x5592c6ffc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.994+0000 7f0175e00640 1 -- 172.21.15.37:0/3347053037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592c6cb8540 con 0x5592c6ff2f10 2024-08-20T05:01:25.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.994+0000 7f016d400640 1 --2- 172.21.15.37:0/3347053037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff3830 0x5592c6ffc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:25.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.994+0000 7f0175e00640 1 --2- 172.21.15.37:0/3347053037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff2f10 0x5592c6ffef50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0168019640 tx=0x7f0168009d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a5759a5504d9c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:25.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.994+0000 7f015be00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:01:25.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.994+0000 7f015be00640 1 -- 172.21.15.37:0/3347053037 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168027060 con 0x5592c6ff2f10 2024-08-20T05:01:25.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.994+0000 7f015be00640 1 -- 172.21.15.37:0/3347053037 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f016800f800 con 0x5592c6ff2f10 2024-08-20T05:01:25.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.994+0000 7f017fa78740 1 -- 172.21.15.37:0/3347053037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f016800faf0 con 0x5592c6ff2f10 2024-08-20T05:01:25.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.995+0000 7f015be00640 1 -- 172.21.15.37:0/3347053037 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f016802e050 con 0x5592c6ff2f10 2024-08-20T05:01:25.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.995+0000 7f017fa78740 10 client.15114 fetch_fsmap learned FSMap version 28 2024-08-20T05:01:25.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.995+0000 7f017fa78740 1 -- 172.21.15.37:0/3347053037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5592c700dc70 con 0x5592c6ff2f10 2024-08-20T05:01:25.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.995+0000 7f015be00640 1 -- 172.21.15.37:0/3347053037 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f016800faf0 con 0x5592c6ff2f10 2024-08-20T05:01:25.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.995+0000 7f015be00640 1 -- 172.21.15.37:0/3347053037 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0168021070 con 0x5592c6ff2f10 2024-08-20T05:01:25.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.995+0000 7f017fa78740 10 client.15114 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:01:25.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.995+0000 7f017fa78740 10 client.15114 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-20T05:01:25.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.995+0000 7f017fa78740 20 client.15114 populate_metadata read hostname 'smithi037' 2024-08-20T05:01:25.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.995+0000 7f017fa78740 1 --2- 172.21.15.37:0/3347053037 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5592c7010070 0x5592c70114e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:25.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.995+0000 7f017fa78740 4 client.15114 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:01:25.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.995+0000 7f017fa78740 1 -- 172.21.15.37:0/3347053037 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5592c6f6b790 con 0x5592c7010070 2024-08-20T05:01:25.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.996+0000 7f016d400640 1 --2- 172.21.15.37:0/3347053037 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5592c7010070 0x5592c70114e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:25.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.996+0000 7f016d400640 1 --2- 172.21.15.37:0/3347053037 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5592c7010070 0x5592c70114e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a96dc1e5a3f537d2 server_cookie=6f33f9323d8c58c3 in_seq=0 out_seq=0 2024-08-20T05:01:25.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.996+0000 7f015be00640 10 client.15114 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:01:25.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.997+0000 7f015be00640 1 -- 172.21.15.37:0/3347053037 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5592c6f6b790 con 0x5592c7010070 2024-08-20T05:01:25.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.997+0000 7f015be00640 10 client.15114 handle_command_reply: tid=0 2024-08-20T05:01:25.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.997+0000 7f017fa78740 1 client.15114 shutdown 2024-08-20T05:01:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.997+0000 7f017fa78740 1 -- 172.21.15.37:0/3347053037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff2f10 msgr2=0x5592c6ffef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.997+0000 7f017fa78740 1 --2- 172.21.15.37:0/3347053037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff2f10 0x5592c6ffef50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0168019640 tx=0x7f0168009d40 comp rx=0 tx=0).stop 2024-08-20T05:01:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.997+0000 7f017fa78740 1 -- 172.21.15.37:0/3347053037 shutdown_connections 2024-08-20T05:01:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.997+0000 7f017fa78740 1 --2- 172.21.15.37:0/3347053037 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5592c7010070 0x5592c70114e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.997+0000 7f017fa78740 1 --2- 172.21.15.37:0/3347053037 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6fff7c0 0x5592c6ffc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.997+0000 7f015be00640 0 client.15114 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:01:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.997+0000 7f017fa78740 1 --2- 172.21.15.37:0/3347053037 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff3830 0x5592c6ffc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.997+0000 7f017fa78740 1 --2- 172.21.15.37:0/3347053037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff2f10 0x5592c6ffef50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.998+0000 7f017fa78740 1 -- 172.21.15.37:0/3347053037 >> 172.21.15.37:0/3347053037 conn(0x5592c6ff0d40 msgr2=0x5592c6ff68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.998+0000 7f017fa78740 1 -- 172.21.15.37:0/3347053037 shutdown_connections 2024-08-20T05:01:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.998+0000 7f017fa78740 1 -- 172.21.15.37:0/3347053037 wait complete. 2024-08-20T05:01:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:24.998+0000 7f017fa78740 20 client.15114 trim_cache size 0 max 16384 2024-08-20T05:01:25.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.016+0000 7f017fa78740 1 Processor -- start 2024-08-20T05:01:25.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.017+0000 7f017fa78740 1 -- start start 2024-08-20T05:01:25.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.017+0000 7f017fa78740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff0d40 0x5592c6ffc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.017+0000 7f017fa78740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff2f10 0x5592c6ff95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.017+0000 7f017fa78740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6ff3830 0x5592c6ff9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.017+0000 7f017fa78740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5592c700f820 con 0x5592c6ff0d40 2024-08-20T05:01:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.017+0000 7f017fa78740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5592c700fef0 con 0x5592c6ff2f10 2024-08-20T05:01:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.017+0000 7f017fa78740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5592c70105c0 con 0x5592c6ff3830 2024-08-20T05:01:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.017+0000 7f0175e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff0d40 0x5592c6ffc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.017+0000 7f0175e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff0d40 0x5592c6ffc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34188/0 (socket says 172.21.15.37:34188) 2024-08-20T05:01:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.017+0000 7f0175e00640 1 -- 172.21.15.37:0/2393565787 learned_addr learned my addr 172.21.15.37:0/2393565787 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.017+0000 7f016d400640 1 --2- 172.21.15.37:0/2393565787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff2f10 0x5592c6ff95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.017+0000 7f0176800640 1 --2- 172.21.15.37:0/2393565787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6ff3830 0x5592c6ff9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:25.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.018+0000 7f0175e00640 1 -- 172.21.15.37:0/2393565787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6ff3830 msgr2=0x5592c6ff9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.018+0000 7f0175e00640 1 --2- 172.21.15.37:0/2393565787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6ff3830 0x5592c6ff9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.018+0000 7f0175e00640 1 -- 172.21.15.37:0/2393565787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff2f10 msgr2=0x5592c6ff95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.018+0000 7f0175e00640 1 --2- 172.21.15.37:0/2393565787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff2f10 0x5592c6ff95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.018+0000 7f0175e00640 1 -- 172.21.15.37:0/2393565787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592c6ff17c0 con 0x5592c6ff0d40 2024-08-20T05:01:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.018+0000 7f0175e00640 1 --2- 172.21.15.37:0/2393565787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff0d40 0x5592c6ffc860 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0168011510 tx=0x7f0168011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc9ff9d2e32f54b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.018+0000 7f0166a00640 1 -- 172.21.15.37:0/2393565787 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168015020 con 0x5592c6ff0d40 2024-08-20T05:01:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.018+0000 7f0166a00640 1 -- 172.21.15.37:0/2393565787 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f016800f800 con 0x5592c6ff0d40 2024-08-20T05:01:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.018+0000 7f0166a00640 1 -- 172.21.15.37:0/2393565787 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168027040 con 0x5592c6ff0d40 2024-08-20T05:01:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.019+0000 7f017fa78740 1 -- 172.21.15.37:0/2393565787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff0d40 msgr2=0x5592c6ffc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.019+0000 7f017fa78740 1 --2- 172.21.15.37:0/2393565787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff0d40 0x5592c6ffc860 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0168011510 tx=0x7f0168011ab0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.019+0000 7f017fa78740 1 -- 172.21.15.37:0/2393565787 shutdown_connections 2024-08-20T05:01:25.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.019+0000 7f017fa78740 1 --2- 172.21.15.37:0/2393565787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6ff3830 0x5592c6ff9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.019+0000 7f017fa78740 1 --2- 172.21.15.37:0/2393565787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff2f10 0x5592c6ff95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.019+0000 7f017fa78740 1 --2- 172.21.15.37:0/2393565787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff0d40 0x5592c6ffc860 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.019+0000 7f017fa78740 1 -- 172.21.15.37:0/2393565787 >> 172.21.15.37:0/2393565787 conn(0x5592c700f440 msgr2=0x5592c6ffc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.019+0000 7f017fa78740 1 -- 172.21.15.37:0/2393565787 shutdown_connections 2024-08-20T05:01:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.019+0000 7f017fa78740 1 -- 172.21.15.37:0/2393565787 wait complete. 2024-08-20T05:01:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.019+0000 7f017fa78740 1 -- start start 2024-08-20T05:01:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.020+0000 7f017fa78740 1 Processor -- start 2024-08-20T05:01:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.020+0000 7f017fa78740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff0d40 0x5592c7015140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.020+0000 7f017fa78740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6ff2f10 0x5592c70156e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.020+0000 7f017fa78740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff3830 0x5592c7072840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.020+0000 7f017fa78740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5592c7011360 con 0x5592c6ff3830 2024-08-20T05:01:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.020+0000 7f017fa78740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5592c7010c90 con 0x5592c6ff0d40 2024-08-20T05:01:25.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.020+0000 7f017fa78740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5592c7011a30 con 0x5592c6ff2f10 2024-08-20T05:01:25.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.020+0000 7f017fa78740 10 client.0 _ll_register_callbacks cb 0x7f016801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:01:25.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.020+0000 7f0176800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff3830 0x5592c7072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:25.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.021+0000 7f016d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6ff2f10 0x5592c70156e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:25.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.020+0000 7f0175e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff0d40 0x5592c7015140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:25.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.021+0000 7f0176800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff3830 0x5592c7072840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34194/0 (socket says 172.21.15.37:34194) 2024-08-20T05:01:25.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.021+0000 7f0176800640 1 -- 172.21.15.37:0/3948664503 learned_addr learned my addr 172.21.15.37:0/3948664503 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:25.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.021+0000 7f0176800640 1 -- 172.21.15.37:0/3948664503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6ff2f10 msgr2=0x5592c70156e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:25.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.021+0000 7f0176800640 1 --2- 172.21.15.37:0/3948664503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6ff2f10 0x5592c70156e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.021+0000 7f0176800640 1 -- 172.21.15.37:0/3948664503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff0d40 msgr2=0x5592c7015140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:25.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.021+0000 7f0176800640 1 --2- 172.21.15.37:0/3948664503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff0d40 0x5592c7015140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.021+0000 7f0176800640 1 -- 172.21.15.37:0/3948664503 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592c7072f80 con 0x5592c6ff3830 2024-08-20T05:01:25.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.021+0000 7f0176800640 1 --2- 172.21.15.37:0/3948664503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff3830 0x5592c7072840 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f017001e560 tx=0x7f0170004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a97b4407117cb22 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:25.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.021+0000 7f015be00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:01:25.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.021+0000 7f015be00640 1 -- 172.21.15.37:0/3948664503 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f017002e060 con 0x5592c6ff3830 2024-08-20T05:01:25.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.022+0000 7f017fa78740 1 -- 172.21.15.37:0/3948664503 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f016800f800 con 0x5592c6ff3830 2024-08-20T05:01:25.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.022+0000 7f015be00640 1 -- 172.21.15.37:0/3948664503 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f017001d410 con 0x5592c6ff3830 2024-08-20T05:01:25.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.022+0000 7f015be00640 1 -- 172.21.15.37:0/3948664503 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0170035050 con 0x5592c6ff3830 2024-08-20T05:01:25.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.022+0000 7f017fa78740 10 client.15120 fetch_fsmap learned FSMap version 28 2024-08-20T05:01:25.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.022+0000 7f017fa78740 1 -- 172.21.15.37:0/3948664503 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5592c707a4e0 con 0x5592c6ff3830 2024-08-20T05:01:25.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.022+0000 7f015be00640 1 -- 172.21.15.37:0/3948664503 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f016800f800 con 0x5592c6ff3830 2024-08-20T05:01:25.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.022+0000 7f015be00640 1 -- 172.21.15.37:0/3948664503 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0170029840 con 0x5592c6ff3830 2024-08-20T05:01:25.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.022+0000 7f017fa78740 10 client.15120 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:01:25.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.022+0000 7f017fa78740 10 client.15120 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-20T05:01:25.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.022+0000 7f017fa78740 20 client.15120 populate_metadata read hostname 'smithi037' 2024-08-20T05:01:25.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.022+0000 7f017fa78740 1 --2- 172.21.15.37:0/3948664503 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5592c6fff7c0 0x5592c707de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:25.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.022+0000 7f017fa78740 4 client.15120 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T05:01:25.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.022+0000 7f017fa78740 1 -- 172.21.15.37:0/3948664503 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "status"}) -- 0x5592c6f67230 con 0x5592c6fff7c0 2024-08-20T05:01:25.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.023+0000 7f0175e00640 1 --2- 172.21.15.37:0/3948664503 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5592c6fff7c0 0x5592c707de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:25.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.023+0000 7f0175e00640 1 --2- 172.21.15.37:0/3948664503 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5592c6fff7c0 0x5592c707de10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8ef97b997e5fa512 server_cookie=970b90dc947b1bb7 in_seq=0 out_seq=0 2024-08-20T05:01:25.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.023+0000 7f015be00640 10 client.15120 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:01:25.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.024+0000 7f015be00640 1 -- 172.21.15.37:0/3948664503 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5592c6f67230 con 0x5592c6fff7c0 2024-08-20T05:01:25.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.024+0000 7f015be00640 10 client.15120 handle_command_reply: tid=0 2024-08-20T05:01:25.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.024+0000 7f017fa78740 1 client.15120 shutdown 2024-08-20T05:01:25.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.024+0000 7f017fa78740 1 -- 172.21.15.37:0/3948664503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff3830 msgr2=0x5592c7072840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:25.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.024+0000 7f017fa78740 1 --2- 172.21.15.37:0/3948664503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff3830 0x5592c7072840 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f017001e560 tx=0x7f0170004a40 comp rx=0 tx=0).stop 2024-08-20T05:01:25.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.024+0000 7f017fa78740 1 -- 172.21.15.37:0/3948664503 shutdown_connections 2024-08-20T05:01:25.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.024+0000 7f017fa78740 1 --2- 172.21.15.37:0/3948664503 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5592c6fff7c0 0x5592c707de10 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.024+0000 7f017fa78740 1 --2- 172.21.15.37:0/3948664503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592c6ff3830 0x5592c7072840 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.024+0000 7f017fa78740 1 --2- 172.21.15.37:0/3948664503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5592c6ff2f10 0x5592c70156e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.024+0000 7f015be00640 0 client.15120 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:01:25.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.024+0000 7f017fa78740 1 --2- 172.21.15.37:0/3948664503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5592c6ff0d40 0x5592c7015140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.024+0000 7f017fa78740 1 -- 172.21.15.37:0/3948664503 >> 172.21.15.37:0/3948664503 conn(0x5592c700f440 msgr2=0x5592c6ff1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:25.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.024+0000 7f017fa78740 1 -- 172.21.15.37:0/3948664503 shutdown_connections 2024-08-20T05:01:25.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.024+0000 7f017fa78740 1 -- 172.21.15.37:0/3948664503 wait complete. 2024-08-20T05:01:25.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.024+0000 7f017fa78740 20 client.15120 trim_cache size 0 max 16384 2024-08-20T05:01:25.051 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:01:25.051 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T05:01:25.051 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 4, 2024-08-20T05:01:25.052 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24637, 2024-08-20T05:01:25.052 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-20T05:01:25.052 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-20T05:01:25.052 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-20T05:01:25.052 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 79.883063716999999, 2024-08-20T05:01:25.052 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-08-20T05:01:25.052 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 86, 2024-08-20T05:01:25.052 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 84, 2024-08-20T05:01:25.053 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 163.765712616 2024-08-20T05:01:25.053 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:01:25.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.025+0000 7f017d000640 1 -- 172.21.15.37:0/736198139 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f015c0b3c60 msgr2=0x7f015c0b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:25.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.025+0000 7f017d000640 1 --2- 172.21.15.37:0/736198139 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f015c0b3c60 0x7f015c0b6120 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0170005fd0 tx=0x7f01700096a0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.025+0000 7f017d000640 1 -- 172.21.15.37:0/736198139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01781084c0 msgr2=0x7f017819b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:25.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.025+0000 7f017d000640 1 --2- 172.21.15.37:0/736198139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01781084c0 0x7f017819b710 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0160005ab0 tx=0x7f0160003c80 comp rx=0 tx=0).stop 2024-08-20T05:01:25.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.025+0000 7f017d000640 1 -- 172.21.15.37:0/736198139 shutdown_connections 2024-08-20T05:01:25.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.025+0000 7f017d000640 1 --2- 172.21.15.37:0/736198139 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f015c0b3c60 0x7f015c0b6120 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.025+0000 7f017d000640 1 --2- 172.21.15.37:0/736198139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0178108e40 0x7f01781a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.025+0000 7f017d000640 1 --2- 172.21.15.37:0/736198139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01781084c0 0x7f017819b710 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.025+0000 7f017d000640 1 --2- 172.21.15.37:0/736198139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0178102ab0 0x7f017819b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:25.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.025+0000 7f017d000640 1 -- 172.21.15.37:0/736198139 >> 172.21.15.37:0/736198139 conn(0x7f01780fe500 msgr2=0x7f0178104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:25.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.025+0000 7f017d000640 1 -- 172.21.15.37:0/736198139 shutdown_connections 2024-08-20T05:01:25.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:25.025+0000 7f017d000640 1 -- 172.21.15.37:0/736198139 wait complete. 2024-08-20T05:01:25.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:25 smithi135 ceph-mon[22342]: pgmap v374: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:25.622 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:25 smithi037 ceph-mon[17265]: pgmap v374: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:25.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:25 smithi130 ceph-mon[22007]: pgmap v374: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:25.879 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.c status 2024-08-20T05:01:26.260 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:26.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.875+0000 7f05ec000640 1 -- 172.21.15.37:0/2641699222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e4075c70 msgr2=0x7f05e410eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:26.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.875+0000 7f05ec000640 1 --2- 172.21.15.37:0/2641699222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e4075c70 0x7f05e410eb00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f05d0009900 tx=0x7f05d002a410 comp rx=0 tx=0).stop 2024-08-20T05:01:26.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.875+0000 7f05ec000640 1 -- 172.21.15.37:0/2641699222 shutdown_connections 2024-08-20T05:01:26.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.875+0000 7f05ec000640 1 --2- 172.21.15.37:0/2641699222 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e410f0d0 0x7f05e41114c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.875+0000 7f05ec000640 1 --2- 172.21.15.37:0/2641699222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e4075c70 0x7f05e410eb00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.875+0000 7f05ec000640 1 --2- 172.21.15.37:0/2641699222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05e4075270 0x7f05e4075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.875+0000 7f05ec000640 1 -- 172.21.15.37:0/2641699222 >> 172.21.15.37:0/2641699222 conn(0x7f05e40fe500 msgr2=0x7f05e4100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:26.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.875+0000 7f05ec000640 1 -- 172.21.15.37:0/2641699222 shutdown_connections 2024-08-20T05:01:26.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.875+0000 7f05ec000640 1 -- 172.21.15.37:0/2641699222 wait complete. 2024-08-20T05:01:26.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.876+0000 7f05ec000640 1 Processor -- start 2024-08-20T05:01:26.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.876+0000 7f05ec000640 1 -- start start 2024-08-20T05:01:26.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.877+0000 7f05ec000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e4075270 0x7f05e419b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.877+0000 7f05ec000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05e4075c70 0x7f05e419b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.877+0000 7f05ec000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e410f0d0 0x7f05e41a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.877+0000 7f05ec000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f05e4114cd0 con 0x7f05e4075270 2024-08-20T05:01:26.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.877+0000 7f05ec000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f05e4114b50 con 0x7f05e410f0d0 2024-08-20T05:01:26.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.877+0000 7f05ec000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f05e4114e50 con 0x7f05e4075c70 2024-08-20T05:01:26.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.877+0000 7f05e9600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e4075270 0x7f05e419b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.877+0000 7f05e9600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e4075270 0x7f05e419b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34218/0 (socket says 172.21.15.37:34218) 2024-08-20T05:01:26.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.877+0000 7f05e9600640 1 -- 172.21.15.37:0/3777976333 learned_addr learned my addr 172.21.15.37:0/3777976333 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:26.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.877+0000 7f05ea000640 1 --2- 172.21.15.37:0/3777976333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e410f0d0 0x7f05e41a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.877+0000 7f05e8c00640 1 --2- 172.21.15.37:0/3777976333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05e4075c70 0x7f05e419b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.878+0000 7f05e9600640 1 -- 172.21.15.37:0/3777976333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05e4075c70 msgr2=0x7f05e419b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:26.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.878+0000 7f05e9600640 1 --2- 172.21.15.37:0/3777976333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05e4075c70 0x7f05e419b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.878+0000 7f05e9600640 1 -- 172.21.15.37:0/3777976333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e410f0d0 msgr2=0x7f05e41a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:26.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.878+0000 7f05e9600640 1 --2- 172.21.15.37:0/3777976333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e410f0d0 0x7f05e41a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.878+0000 7f05e9600640 1 -- 172.21.15.37:0/3777976333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e41a12b0 con 0x7f05e4075270 2024-08-20T05:01:26.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.878+0000 7f05e9600640 1 --2- 172.21.15.37:0/3777976333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e4075270 0x7f05e419b200 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f05d800d950 tx=0x7f05d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:26.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.878+0000 7f05e2000640 1 -- 172.21.15.37:0/3777976333 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d8017030 con 0x7f05e4075270 2024-08-20T05:01:26.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.878+0000 7f05e2000640 1 -- 172.21.15.37:0/3777976333 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05d8004020 con 0x7f05e4075270 2024-08-20T05:01:26.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.878+0000 7f05ec000640 1 -- 172.21.15.37:0/3777976333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e41a15a0 con 0x7f05e4075270 2024-08-20T05:01:26.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.878+0000 7f05e2000640 1 -- 172.21.15.37:0/3777976333 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d80047a0 con 0x7f05e4075270 2024-08-20T05:01:26.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.879+0000 7f05ec000640 1 -- 172.21.15.37:0/3777976333 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e41a7e30 con 0x7f05e4075270 2024-08-20T05:01:26.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.881+0000 7f05eebe3740 1 Processor -- start 2024-08-20T05:01:26.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.882+0000 7f05eebe3740 1 -- start start 2024-08-20T05:01:26.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.882+0000 7f05e2000640 1 -- 172.21.15.37:0/3777976333 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f05d8009a30 con 0x7f05e4075270 2024-08-20T05:01:26.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.882+0000 7f05eebe3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562803950f10 0x5628039512f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.882+0000 7f05eebe3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562803951830 0x56280395d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.882+0000 7f05eebe3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56280395d7c0 0x56280395fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.882+0000 7f05eebe3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5628038c7840 con 0x562803951830 2024-08-20T05:01:26.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.882+0000 7f05eebe3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5628038b6d40 con 0x56280395d7c0 2024-08-20T05:01:26.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.882+0000 7f05eebe3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5628038bad80 con 0x562803950f10 2024-08-20T05:01:26.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.882+0000 7f05e9600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562803951830 0x56280395d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.882+0000 7f05ea000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562803950f10 0x5628039512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.882+0000 7f05e9600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562803951830 0x56280395d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34234/0 (socket says 172.21.15.37:34234) 2024-08-20T05:01:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.882+0000 7f05e9600640 1 -- 172.21.15.37:0/3459902985 learned_addr learned my addr 172.21.15.37:0/3459902985 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.882+0000 7f05e8c00640 1 --2- 172.21.15.37:0/3459902985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56280395d7c0 0x56280395fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.883+0000 7f05e8c00640 1 -- 172.21.15.37:0/3459902985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562803950f10 msgr2=0x5628039512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.883+0000 7f05e8c00640 1 --2- 172.21.15.37:0/3459902985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562803950f10 0x5628039512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.883+0000 7f05e8c00640 1 -- 172.21.15.37:0/3459902985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562803951830 msgr2=0x56280395d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.883+0000 7f05e8c00640 1 --2- 172.21.15.37:0/3459902985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562803951830 0x56280395d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.883+0000 7f05e8c00640 1 -- 172.21.15.37:0/3459902985 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56280385d1c0 con 0x56280395d7c0 2024-08-20T05:01:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.883+0000 7f05e8c00640 1 --2- 172.21.15.37:0/3459902985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56280395d7c0 0x56280395fbb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f05d002aa00 tx=0x7f05d0004190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1ada2dcb68bb346 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.883+0000 7f05d6600640 1 -- 172.21.15.37:0/3459902985 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d0035040 con 0x56280395d7c0 2024-08-20T05:01:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.884+0000 7f05d6600640 1 -- 172.21.15.37:0/3459902985 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05d00054f0 con 0x56280395d7c0 2024-08-20T05:01:26.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.884+0000 7f05d6600640 1 -- 172.21.15.37:0/3459902985 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d00035f0 con 0x56280395d7c0 2024-08-20T05:01:26.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.884+0000 7f05e2000640 1 --2- 172.21.15.37:0/3777976333 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f05cc0b3ce0 0x7f05cc0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.884+0000 7f05e2000640 1 -- 172.21.15.37:0/3777976333 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f05d80e3af0 con 0x7f05e4075270 2024-08-20T05:01:26.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.884+0000 7f05ea000640 1 --2- 172.21.15.37:0/3777976333 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f05cc0b3ce0 0x7f05cc0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.884+0000 7f05eebe3740 1 -- 172.21.15.37:0/3459902985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56280395d7c0 msgr2=0x56280395fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:26.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.884+0000 7f05eebe3740 1 --2- 172.21.15.37:0/3459902985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56280395d7c0 0x56280395fbb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f05d002aa00 tx=0x7f05d0004190 comp rx=0 tx=0).stop 2024-08-20T05:01:26.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.885+0000 7f05eebe3740 1 -- 172.21.15.37:0/3459902985 shutdown_connections 2024-08-20T05:01:26.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.885+0000 7f05eebe3740 1 --2- 172.21.15.37:0/3459902985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56280395d7c0 0x56280395fbb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.885+0000 7f05eebe3740 1 --2- 172.21.15.37:0/3459902985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562803951830 0x56280395d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.885+0000 7f05eebe3740 1 --2- 172.21.15.37:0/3459902985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562803950f10 0x5628039512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.885+0000 7f05eebe3740 1 -- 172.21.15.37:0/3459902985 >> 172.21.15.37:0/3459902985 conn(0x56280394ed40 msgr2=0x56280394fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:26.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.885+0000 7f05eebe3740 1 -- 172.21.15.37:0/3459902985 shutdown_connections 2024-08-20T05:01:26.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.885+0000 7f05eebe3740 1 -- 172.21.15.37:0/3459902985 wait complete. 2024-08-20T05:01:26.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.885+0000 7f05ea000640 1 --2- 172.21.15.37:0/3777976333 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f05cc0b3ce0 0x7f05cc0b61a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f05e406bdb0 tx=0x7f05dc0096a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:26.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.885+0000 7f05eebe3740 1 -- start start 2024-08-20T05:01:26.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.886+0000 7f05eebe3740 1 Processor -- start 2024-08-20T05:01:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.886+0000 7f05eebe3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803950f10 0x56280395cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.886+0000 7f05eebe3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562803951830 0x56280395a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.886+0000 7f05eebe3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56280395d7c0 0x56280395a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.886+0000 7f05eebe3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5628037195f0 con 0x56280395d7c0 2024-08-20T05:01:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.886+0000 7f05eebe3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562803852170 con 0x562803950f10 2024-08-20T05:01:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.886+0000 7f05eebe3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562803960410 con 0x562803951830 2024-08-20T05:01:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.886+0000 7f05eebe3740 10 client.0 _ll_register_callbacks cb 0x5628038b18b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:01:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.886+0000 7f05ea000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56280395d7c0 0x56280395a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.886+0000 7f05e9600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803950f10 0x56280395cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.886+0000 7f05e9600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803950f10 0x56280395cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:58238/0 (socket says 172.21.15.37:58238) 2024-08-20T05:01:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.886+0000 7f05ea000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56280395d7c0 0x56280395a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34246/0 (socket says 172.21.15.37:34246) 2024-08-20T05:01:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.886+0000 7f05e9600640 1 -- 172.21.15.37:0/88174405 learned_addr learned my addr 172.21.15.37:0/88174405 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.887+0000 7f05e8c00640 1 --2- 172.21.15.37:0/88174405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562803951830 0x56280395a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.887+0000 7f05e9600640 1 -- 172.21.15.37:0/88174405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562803951830 msgr2=0x56280395a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.887+0000 7f05e9600640 1 --2- 172.21.15.37:0/88174405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562803951830 0x56280395a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.887+0000 7f05e9600640 1 -- 172.21.15.37:0/88174405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56280395d7c0 msgr2=0x56280395a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.887+0000 7f05e9600640 1 --2- 172.21.15.37:0/88174405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56280395d7c0 0x56280395a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.887+0000 7f05e9600640 1 -- 172.21.15.37:0/88174405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562803616540 con 0x562803950f10 2024-08-20T05:01:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.887+0000 7f05e9600640 1 --2- 172.21.15.37:0/88174405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803950f10 0x56280395cf90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f05d80a7790 tx=0x7f05d80a63e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8e8775ec84a9743 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.887+0000 7f05caa00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:01:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.887+0000 7f05caa00640 1 -- 172.21.15.37:0/88174405 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d80a9c90 con 0x562803950f10 2024-08-20T05:01:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.887+0000 7f05eebe3740 1 -- 172.21.15.37:0/88174405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05d00054f0 con 0x562803950f10 2024-08-20T05:01:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.887+0000 7f05caa00640 1 -- 172.21.15.37:0/88174405 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f05d80a6b10 con 0x562803950f10 2024-08-20T05:01:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.887+0000 7f05caa00640 1 -- 172.21.15.37:0/88174405 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f05d80cd0c0 con 0x562803950f10 2024-08-20T05:01:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.888+0000 7f05eebe3740 10 client.25157 fetch_fsmap learned FSMap version 28 2024-08-20T05:01:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.888+0000 7f05eebe3740 1 -- 172.21.15.37:0/88174405 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56280396bc70 con 0x562803950f10 2024-08-20T05:01:26.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.888+0000 7f05caa00640 1 -- 172.21.15.37:0/88174405 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05d00054f0 con 0x562803950f10 2024-08-20T05:01:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.888+0000 7f05caa00640 1 -- 172.21.15.37:0/88174405 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f05d80a67b0 con 0x562803950f10 2024-08-20T05:01:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.888+0000 7f05eebe3740 10 client.25157 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:01:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.888+0000 7f05eebe3740 10 client.25157 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-20T05:01:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.888+0000 7f05eebe3740 20 client.25157 populate_metadata read hostname 'smithi037' 2024-08-20T05:01:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.888+0000 7f05eebe3740 1 --2- 172.21.15.37:0/88174405 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x56280396e2a0 0x56280396f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.888+0000 7f05eebe3740 4 client.25157 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:01:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.888+0000 7f05eebe3740 1 -- 172.21.15.37:0/88174405 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628038c9790 con 0x56280396e2a0 2024-08-20T05:01:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.889+0000 7f05e8c00640 1 --2- 172.21.15.37:0/88174405 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x56280396e2a0 0x56280396f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.889+0000 7f05e8c00640 1 --2- 172.21.15.37:0/88174405 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x56280396e2a0 0x56280396f710 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2bc9f0557e5be96e server_cookie=ba39393d9cd81222 in_seq=0 out_seq=0 2024-08-20T05:01:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.889+0000 7f05caa00640 10 client.25157 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:01:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.890+0000 7f05caa00640 1 -- 172.21.15.37:0/88174405 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628038c9790 con 0x56280396e2a0 2024-08-20T05:01:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.890+0000 7f05caa00640 10 client.25157 handle_command_reply: tid=0 2024-08-20T05:01:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.890+0000 7f05eebe3740 1 client.25157 shutdown 2024-08-20T05:01:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.891+0000 7f05eebe3740 1 -- 172.21.15.37:0/88174405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803950f10 msgr2=0x56280395cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.891+0000 7f05eebe3740 1 --2- 172.21.15.37:0/88174405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803950f10 0x56280395cf90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f05d80a7790 tx=0x7f05d80a63e0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.891+0000 7f05eebe3740 1 -- 172.21.15.37:0/88174405 shutdown_connections 2024-08-20T05:01:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.891+0000 7f05eebe3740 1 --2- 172.21.15.37:0/88174405 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x56280396e2a0 0x56280396f710 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.891+0000 7f05eebe3740 1 --2- 172.21.15.37:0/88174405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56280395d7c0 0x56280395a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.891+0000 7f05eebe3740 1 --2- 172.21.15.37:0/88174405 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562803951830 0x56280395a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.891+0000 7f05caa00640 0 client.25157 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:01:26.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.891+0000 7f05eebe3740 1 --2- 172.21.15.37:0/88174405 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803950f10 0x56280395cf90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.891+0000 7f05eebe3740 1 -- 172.21.15.37:0/88174405 >> 172.21.15.37:0/88174405 conn(0x56280394ed40 msgr2=0x5628039548e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:26.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.891+0000 7f05eebe3740 1 -- 172.21.15.37:0/88174405 shutdown_connections 2024-08-20T05:01:26.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.891+0000 7f05eebe3740 1 -- 172.21.15.37:0/88174405 wait complete. 2024-08-20T05:01:26.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.891+0000 7f05eebe3740 20 client.25157 trim_cache size 0 max 16384 2024-08-20T05:01:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.910+0000 7f05eebe3740 1 Processor -- start 2024-08-20T05:01:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.910+0000 7f05eebe3740 1 -- start start 2024-08-20T05:01:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.911+0000 7f05eebe3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803950f10 0x56280396f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.911+0000 7f05eebe3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562803951830 0x56280395a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.911+0000 7f05eebe3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56280395d7c0 0x56280395a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.911+0000 7f05eebe3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56280396da50 con 0x562803951830 2024-08-20T05:01:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.911+0000 7f05eebe3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56280396e120 con 0x562803950f10 2024-08-20T05:01:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.911+0000 7f05eebe3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56280396e7f0 con 0x56280395d7c0 2024-08-20T05:01:26.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.911+0000 7f05ea000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56280395d7c0 0x56280395a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.911+0000 7f05e8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562803951830 0x56280395a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.911+0000 7f05ea000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56280395d7c0 0x56280395a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:56964/0 (socket says 172.21.15.37:56964) 2024-08-20T05:01:26.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.911+0000 7f05ea000640 1 -- 172.21.15.37:0/2407126960 learned_addr learned my addr 172.21.15.37:0/2407126960 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:26.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.911+0000 7f05e9600640 1 --2- 172.21.15.37:0/2407126960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803950f10 0x56280396f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.911+0000 7f05e9600640 1 -- 172.21.15.37:0/2407126960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56280395d7c0 msgr2=0x56280395a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:26.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.911+0000 7f05e9600640 1 --2- 172.21.15.37:0/2407126960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56280395d7c0 0x56280395a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.911+0000 7f05e9600640 1 -- 172.21.15.37:0/2407126960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562803951830 msgr2=0x56280395a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:26.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.911+0000 7f05e9600640 1 --2- 172.21.15.37:0/2407126960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562803951830 0x56280395a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.912+0000 7f05e9600640 1 -- 172.21.15.37:0/2407126960 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562803951660 con 0x562803950f10 2024-08-20T05:01:26.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.912+0000 7f05ea000640 1 --2- 172.21.15.37:0/2407126960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56280395d7c0 0x56280395a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:26.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.912+0000 7f05e8c00640 1 --2- 172.21.15.37:0/2407126960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562803951830 0x56280395a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.912+0000 7f05e9600640 1 --2- 172.21.15.37:0/2407126960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803950f10 0x56280396f040 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f05d80c1040 tx=0x7f05d80a6510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=979fd7829f7e7a4b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.912+0000 7f05d5c00640 1 -- 172.21.15.37:0/2407126960 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d80e14d0 con 0x562803950f10 2024-08-20T05:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.912+0000 7f05d5c00640 1 -- 172.21.15.37:0/2407126960 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05d80aa030 con 0x562803950f10 2024-08-20T05:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.912+0000 7f05d5c00640 1 -- 172.21.15.37:0/2407126960 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d80e7230 con 0x562803950f10 2024-08-20T05:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.913+0000 7f05eebe3740 1 -- 172.21.15.37:0/2407126960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803950f10 msgr2=0x56280396f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.913+0000 7f05eebe3740 1 --2- 172.21.15.37:0/2407126960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803950f10 0x56280396f040 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f05d80c1040 tx=0x7f05d80a6510 comp rx=0 tx=0).stop 2024-08-20T05:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.913+0000 7f05eebe3740 1 -- 172.21.15.37:0/2407126960 shutdown_connections 2024-08-20T05:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.913+0000 7f05eebe3740 1 --2- 172.21.15.37:0/2407126960 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56280395d7c0 0x56280395a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.913+0000 7f05eebe3740 1 --2- 172.21.15.37:0/2407126960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562803951830 0x56280395a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.913+0000 7f05eebe3740 1 --2- 172.21.15.37:0/2407126960 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803950f10 0x56280396f040 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.913+0000 7f05eebe3740 1 -- 172.21.15.37:0/2407126960 >> 172.21.15.37:0/2407126960 conn(0x56280394ed40 msgr2=0x562803949ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.913+0000 7f05eebe3740 1 -- 172.21.15.37:0/2407126960 shutdown_connections 2024-08-20T05:01:26.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.913+0000 7f05eebe3740 1 -- 172.21.15.37:0/2407126960 wait complete. 2024-08-20T05:01:26.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.913+0000 7f05eebe3740 1 -- start start 2024-08-20T05:01:26.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.913+0000 7f05eebe3740 1 Processor -- start 2024-08-20T05:01:26.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.914+0000 7f05eebe3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562803950f10 0x562803973390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.914+0000 7f05eebe3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803951830 0x562803973910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.914+0000 7f05eebe3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56280395d7c0 0x5628039d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.914+0000 7f05eebe3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56280396f590 con 0x56280395d7c0 2024-08-20T05:01:26.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.914+0000 7f05eebe3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56280396eec0 con 0x562803951830 2024-08-20T05:01:26.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.914+0000 7f05eebe3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56280396fc60 con 0x562803950f10 2024-08-20T05:01:26.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.914+0000 7f05eebe3740 10 client.0 _ll_register_callbacks cb 0x7f05d80e1050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:01:26.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.914+0000 7f05ea000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56280395d7c0 0x5628039d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.914+0000 7f05e8c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803951830 0x562803973910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.914+0000 7f05ea000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56280395d7c0 0x5628039d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34262/0 (socket says 172.21.15.37:34262) 2024-08-20T05:01:26.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.914+0000 7f05ea000640 1 -- 172.21.15.37:0/4098117979 learned_addr learned my addr 172.21.15.37:0/4098117979 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:26.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.914+0000 7f05e9600640 1 --2- 172.21.15.37:0/4098117979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562803950f10 0x562803973390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.915+0000 7f05e8c00640 1 -- 172.21.15.37:0/4098117979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562803950f10 msgr2=0x562803973390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.915+0000 7f05e8c00640 1 --2- 172.21.15.37:0/4098117979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562803950f10 0x562803973390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.915+0000 7f05e8c00640 1 -- 172.21.15.37:0/4098117979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56280395d7c0 msgr2=0x5628039d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.915+0000 7f05e8c00640 1 --2- 172.21.15.37:0/4098117979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56280395d7c0 0x5628039d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.915+0000 7f05e8c00640 1 -- 172.21.15.37:0/4098117979 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628039d1160 con 0x562803951830 2024-08-20T05:01:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.915+0000 7f05ea000640 1 --2- 172.21.15.37:0/4098117979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56280395d7c0 0x5628039d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.915+0000 7f05e8c00640 1 --2- 172.21.15.37:0/4098117979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803951830 0x562803973910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f05d0005ab0 tx=0x7f05d0009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed54183f22bb04c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.915+0000 7f05caa00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:01:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.915+0000 7f05caa00640 1 -- 172.21.15.37:0/4098117979 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d0035040 con 0x562803951830 2024-08-20T05:01:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.915+0000 7f05caa00640 1 -- 172.21.15.37:0/4098117979 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f05d00035f0 con 0x562803951830 2024-08-20T05:01:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.915+0000 7f05eebe3740 1 -- 172.21.15.37:0/4098117979 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05d80aa030 con 0x562803951830 2024-08-20T05:01:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.915+0000 7f05caa00640 1 -- 172.21.15.37:0/4098117979 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f05d0003810 con 0x562803951830 2024-08-20T05:01:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.916+0000 7f05eebe3740 10 client.25163 fetch_fsmap learned FSMap version 28 2024-08-20T05:01:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.916+0000 7f05eebe3740 1 -- 172.21.15.37:0/4098117979 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5628039d85f0 con 0x562803951830 2024-08-20T05:01:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.916+0000 7f05caa00640 1 -- 172.21.15.37:0/4098117979 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05d80aa030 con 0x562803951830 2024-08-20T05:01:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.916+0000 7f05caa00640 1 -- 172.21.15.37:0/4098117979 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f05d0057070 con 0x562803951830 2024-08-20T05:01:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.916+0000 7f05eebe3740 10 client.25163 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:01:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.916+0000 7f05eebe3740 10 client.25163 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-20T05:01:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.916+0000 7f05eebe3740 20 client.25163 populate_metadata read hostname 'smithi037' 2024-08-20T05:01:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.916+0000 7f05eebe3740 1 --2- 172.21.15.37:0/4098117979 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5628039dcd10 0x5628039dba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.916+0000 7f05eebe3740 4 client.25163 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T05:01:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.916+0000 7f05eebe3740 1 -- 172.21.15.37:0/4098117979 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "status"}) -- 0x5628038c5230 con 0x5628039dcd10 2024-08-20T05:01:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.916+0000 7f05e9600640 1 --2- 172.21.15.37:0/4098117979 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5628039dcd10 0x5628039dba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.917+0000 7f05e9600640 1 --2- 172.21.15.37:0/4098117979 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5628039dcd10 0x5628039dba20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e8bf9275cf563757 server_cookie=87de052862d38e1e in_seq=0 out_seq=0 2024-08-20T05:01:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.917+0000 7f05caa00640 10 client.25163 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:01:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.917+0000 7f05caa00640 1 -- 172.21.15.37:0/4098117979 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5628038c5230 con 0x5628039dcd10 2024-08-20T05:01:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.917+0000 7f05caa00640 10 client.25163 handle_command_reply: tid=0 2024-08-20T05:01:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.917+0000 7f05eebe3740 1 client.25163 shutdown 2024-08-20T05:01:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.917+0000 7f05eebe3740 1 -- 172.21.15.37:0/4098117979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803951830 msgr2=0x562803973910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.917+0000 7f05eebe3740 1 --2- 172.21.15.37:0/4098117979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803951830 0x562803973910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f05d0005ab0 tx=0x7f05d0009260 comp rx=0 tx=0).stop 2024-08-20T05:01:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.918+0000 7f05eebe3740 1 -- 172.21.15.37:0/4098117979 shutdown_connections 2024-08-20T05:01:26.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.918+0000 7f05eebe3740 1 --2- 172.21.15.37:0/4098117979 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5628039dcd10 0x5628039dba20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.918+0000 7f05eebe3740 1 --2- 172.21.15.37:0/4098117979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56280395d7c0 0x5628039d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.918+0000 7f05eebe3740 1 --2- 172.21.15.37:0/4098117979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562803951830 0x562803973910 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.918+0000 7f05caa00640 0 client.25163 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:01:26.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.918+0000 7f05eebe3740 1 --2- 172.21.15.37:0/4098117979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562803950f10 0x562803973390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.918+0000 7f05eebe3740 1 -- 172.21.15.37:0/4098117979 >> 172.21.15.37:0/4098117979 conn(0x56280394ed40 msgr2=0x56280395a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:26.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.918+0000 7f05eebe3740 1 -- 172.21.15.37:0/4098117979 shutdown_connections 2024-08-20T05:01:26.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.918+0000 7f05eebe3740 1 -- 172.21.15.37:0/4098117979 wait complete. 2024-08-20T05:01:26.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.918+0000 7f05eebe3740 20 client.25163 trim_cache size 0 max 16384 2024-08-20T05:01:26.924 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:01:26.925 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T05:01:26.925 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 3, 2024-08-20T05:01:26.925 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24649, 2024-08-20T05:01:26.925 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-20T05:01:26.925 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-20T05:01:26.925 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-20T05:01:26.925 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 82.783365687, 2024-08-20T05:01:26.925 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-08-20T05:01:26.925 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 86, 2024-08-20T05:01:26.925 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 84, 2024-08-20T05:01:26.925 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 163.09019289099999 2024-08-20T05:01:26.925 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:01:26.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.918+0000 7f05ec000640 1 -- 172.21.15.37:0/3777976333 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f05cc0b3ce0 msgr2=0x7f05cc0b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:26.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.918+0000 7f05ec000640 1 --2- 172.21.15.37:0/3777976333 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f05cc0b3ce0 0x7f05cc0b61a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f05e406bdb0 tx=0x7f05dc0096a0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.919+0000 7f05ec000640 1 -- 172.21.15.37:0/3777976333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e4075270 msgr2=0x7f05e419b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:26.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.919+0000 7f05ec000640 1 --2- 172.21.15.37:0/3777976333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e4075270 0x7f05e419b200 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f05d800d950 tx=0x7f05d800de10 comp rx=0 tx=0).stop 2024-08-20T05:01:26.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.919+0000 7f05ec000640 1 -- 172.21.15.37:0/3777976333 shutdown_connections 2024-08-20T05:01:26.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.919+0000 7f05ec000640 1 --2- 172.21.15.37:0/3777976333 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f05cc0b3ce0 0x7f05cc0b61a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.919+0000 7f05ec000640 1 --2- 172.21.15.37:0/3777976333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f05e410f0d0 0x7f05e41a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.919+0000 7f05ec000640 1 --2- 172.21.15.37:0/3777976333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f05e4075c70 0x7f05e419b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.919+0000 7f05ec000640 1 --2- 172.21.15.37:0/3777976333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e4075270 0x7f05e419b200 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:26.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.919+0000 7f05ec000640 1 -- 172.21.15.37:0/3777976333 >> 172.21.15.37:0/3777976333 conn(0x7f05e40fe500 msgr2=0x7f05e41112c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:26.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.919+0000 7f05ec000640 1 -- 172.21.15.37:0/3777976333 shutdown_connections 2024-08-20T05:01:26.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:26.919+0000 7f05ec000640 1 -- 172.21.15.37:0/3777976333 wait complete. 2024-08-20T05:01:27.576 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:27 smithi037 ceph-mon[17265]: pgmap v375: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:27.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:27 smithi135 ceph-mon[22342]: pgmap v375: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:27.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:27 smithi130 ceph-mon[22007]: pgmap v375: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:27.949 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.h status 2024-08-20T05:01:28.327 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:28.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.925+0000 7f0abbe00640 1 -- 172.21.15.37:0/1779268559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0abc108330 msgr2=0x7f0abc108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:28.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.925+0000 7f0abbe00640 1 --2- 172.21.15.37:0/1779268559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0abc108330 0x7f0abc108770 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009ca0 tx=0x7f0aa402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.925+0000 7f0abbe00640 1 -- 172.21.15.37:0/1779268559 shutdown_connections 2024-08-20T05:01:28.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.925+0000 7f0abbe00640 1 --2- 172.21.15.37:0/1779268559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0abc108cb0 0x7f0abc10f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.925+0000 7f0abbe00640 1 --2- 172.21.15.37:0/1779268559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0abc108330 0x7f0abc108770 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.925+0000 7f0abbe00640 1 --2- 172.21.15.37:0/1779268559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0abc102920 0x7f0abc102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.925+0000 7f0abbe00640 1 -- 172.21.15.37:0/1779268559 >> 172.21.15.37:0/1779268559 conn(0x7f0abc0fe350 msgr2=0x7f0abc100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:28.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.925+0000 7f0abbe00640 1 -- 172.21.15.37:0/1779268559 shutdown_connections 2024-08-20T05:01:28.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.925+0000 7f0abbe00640 1 -- 172.21.15.37:0/1779268559 wait complete. 2024-08-20T05:01:28.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.926+0000 7f0abbe00640 1 Processor -- start 2024-08-20T05:01:28.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.926+0000 7f0abbe00640 1 -- start start 2024-08-20T05:01:28.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.927+0000 7f0abbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0abc102920 0x7f0abc0751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.927+0000 7f0abbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0abc108330 0x7f0abc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.927+0000 7f0abbe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0abc108cb0 0x7f0abc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.927+0000 7f0abbe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc1129c0 con 0x7f0abc102920 2024-08-20T05:01:28.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.927+0000 7f0abbe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc112840 con 0x7f0abc108cb0 2024-08-20T05:01:28.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.927+0000 7f0abbe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0abc112b40 con 0x7f0abc108330 2024-08-20T05:01:28.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.927+0000 7f0abaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0abc102920 0x7f0abc0751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.927+0000 7f0abaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0abc102920 0x7f0abc0751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34276/0 (socket says 172.21.15.37:34276) 2024-08-20T05:01:28.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.927+0000 7f0abaa00640 1 -- 172.21.15.37:0/1085446117 learned_addr learned my addr 172.21.15.37:0/1085446117 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:28.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.927+0000 7f0ab2000640 1 --2- 172.21.15.37:0/1085446117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0abc108330 0x7f0abc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.927+0000 7f0abb400640 1 --2- 172.21.15.37:0/1085446117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0abc108cb0 0x7f0abc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.928+0000 7f0abaa00640 1 -- 172.21.15.37:0/1085446117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0abc108330 msgr2=0x7f0abc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:28.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.928+0000 7f0abaa00640 1 --2- 172.21.15.37:0/1085446117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0abc108330 0x7f0abc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.928+0000 7f0abaa00640 1 -- 172.21.15.37:0/1085446117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0abc108cb0 msgr2=0x7f0abc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:28.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.928+0000 7f0abaa00640 1 --2- 172.21.15.37:0/1085446117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0abc108cb0 0x7f0abc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.928+0000 7f0abaa00640 1 -- 172.21.15.37:0/1085446117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0abc1a7170 con 0x7f0abc102920 2024-08-20T05:01:28.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.928+0000 7f0abb400640 1 --2- 172.21.15.37:0/1085446117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0abc108cb0 0x7f0abc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:01:28.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.928+0000 7f0abaa00640 1 --2- 172.21.15.37:0/1085446117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0abc102920 0x7f0abc0751d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00d950 tx=0x7f0aac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:28.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.928+0000 7f0ab3e00640 1 -- 172.21.15.37:0/1085446117 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac017030 con 0x7f0abc102920 2024-08-20T05:01:28.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.928+0000 7f0ab3e00640 1 -- 172.21.15.37:0/1085446117 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aac004020 con 0x7f0abc102920 2024-08-20T05:01:28.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.928+0000 7f0ab3e00640 1 -- 172.21.15.37:0/1085446117 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac0047a0 con 0x7f0abc102920 2024-08-20T05:01:28.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.928+0000 7f0abbe00640 1 -- 172.21.15.37:0/1085446117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0abc1a7460 con 0x7f0abc102920 2024-08-20T05:01:28.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.928+0000 7f0abbe00640 1 -- 172.21.15.37:0/1085446117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0abc1a7970 con 0x7f0abc102920 2024-08-20T05:01:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.932+0000 7f0ab3e00640 1 -- 172.21.15.37:0/1085446117 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) ==== 151110+0+0 (secure 0 0 0) 0x7f0aac009a30 con 0x7f0abc102920 2024-08-20T05:01:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.932+0000 7f0ac425c740 1 Processor -- start 2024-08-20T05:01:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.932+0000 7f0ac425c740 1 -- start start 2024-08-20T05:01:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.932+0000 7f0ac425c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3917170 0x55ffd3917550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.932+0000 7f0ac425c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917a90 0x55ffd39234e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.932+0000 7f0ac425c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3923a20 0x55ffd3925e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.932+0000 7f0ac425c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ffd388d840 con 0x55ffd3923a20 2024-08-20T05:01:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.932+0000 7f0ac425c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ffd387cd40 con 0x55ffd3917a90 2024-08-20T05:01:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.932+0000 7f0ac425c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ffd3880d80 con 0x55ffd3917170 2024-08-20T05:01:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.933+0000 7f0abb400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3917170 0x55ffd3917550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.933+0000 7f0abb400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3917170 0x55ffd3917550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:56986/0 (socket says 172.21.15.37:56986) 2024-08-20T05:01:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.933+0000 7f0abb400640 1 -- 172.21.15.37:0/3216908639 learned_addr learned my addr 172.21.15.37:0/3216908639 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.933+0000 7f0abaa00640 1 --2- 172.21.15.37:0/3216908639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917a90 0x55ffd39234e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.933+0000 7f0ab2000640 1 --2- 172.21.15.37:0/3216908639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3923a20 0x55ffd3925e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.933+0000 7f0abb400640 1 -- 172.21.15.37:0/3216908639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917a90 msgr2=0x55ffd39234e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.933+0000 7f0abb400640 1 --2- 172.21.15.37:0/3216908639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917a90 0x55ffd39234e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.933+0000 7f0abb400640 1 -- 172.21.15.37:0/3216908639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3923a20 msgr2=0x55ffd3925e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.933+0000 7f0abb400640 1 --2- 172.21.15.37:0/3216908639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3923a20 0x55ffd3925e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.933+0000 7f0abb400640 1 -- 172.21.15.37:0/3216908639 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffd38231c0 con 0x55ffd3917170 2024-08-20T05:01:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.933+0000 7f0ab2000640 1 --2- 172.21.15.37:0/3216908639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3923a20 0x55ffd3925e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:01:28.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.934+0000 7f0abb400640 1 --2- 172.21.15.37:0/3216908639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3917170 0x55ffd3917550 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009c00 tx=0x7f0ab40117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5975b44797481587 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:28.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.934+0000 7f0ab3e00640 1 --2- 172.21.15.37:0/1085446117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0aa00b3d10 0x7f0aa00b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.934+0000 7f0aabe00640 1 -- 172.21.15.37:0/3216908639 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4012450 con 0x55ffd3917170 2024-08-20T05:01:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.934+0000 7f0aabe00640 1 -- 172.21.15.37:0/3216908639 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ab4012aa0 con 0x55ffd3917170 2024-08-20T05:01:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.934+0000 7f0aabe00640 1 -- 172.21.15.37:0/3216908639 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab400fa90 con 0x55ffd3917170 2024-08-20T05:01:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.934+0000 7f0ab3e00640 1 -- 172.21.15.37:0/1085446117 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f0aac0e3bd0 con 0x7f0abc102920 2024-08-20T05:01:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.934+0000 7f0abaa00640 1 --2- 172.21.15.37:0/1085446117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0aa00b3d10 0x7f0aa00b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.935+0000 7f0ac425c740 1 -- 172.21.15.37:0/3216908639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3917170 msgr2=0x55ffd3917550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.935+0000 7f0ac425c740 1 --2- 172.21.15.37:0/3216908639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3917170 0x55ffd3917550 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4009c00 tx=0x7f0ab40117b0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.935+0000 7f0abaa00640 1 --2- 172.21.15.37:0/1085446117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0aa00b3d10 0x7f0aa00b61d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55ffd391a2f0 tx=0x7f0aac0e7710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.935+0000 7f0ac425c740 1 -- 172.21.15.37:0/3216908639 shutdown_connections 2024-08-20T05:01:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.935+0000 7f0ac425c740 1 --2- 172.21.15.37:0/3216908639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3923a20 0x55ffd3925e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.935+0000 7f0ac425c740 1 --2- 172.21.15.37:0/3216908639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917a90 0x55ffd39234e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.935+0000 7f0ac425c740 1 --2- 172.21.15.37:0/3216908639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3917170 0x55ffd3917550 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.935+0000 7f0ac425c740 1 -- 172.21.15.37:0/3216908639 >> 172.21.15.37:0/3216908639 conn(0x55ffd3914fa0 msgr2=0x55ffd3916140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.935+0000 7f0ac425c740 1 -- 172.21.15.37:0/3216908639 shutdown_connections 2024-08-20T05:01:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.935+0000 7f0ac425c740 1 -- 172.21.15.37:0/3216908639 wait complete. 2024-08-20T05:01:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.936+0000 7f0ac425c740 1 -- start start 2024-08-20T05:01:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.936+0000 7f0ac425c740 1 Processor -- start 2024-08-20T05:01:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.936+0000 7f0ac425c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917170 0x55ffd3923260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.936+0000 7f0ac425c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3917a90 0x55ffd39206b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.936+0000 7f0ac425c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3923a20 0x55ffd3920c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.936+0000 7f0ac425c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ffd36df5f0 con 0x55ffd3917a90 2024-08-20T05:01:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.936+0000 7f0ac425c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ffd3818170 con 0x55ffd3917170 2024-08-20T05:01:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.936+0000 7f0ac425c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ffd39266d0 con 0x55ffd3923a20 2024-08-20T05:01:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.936+0000 7f0ac425c740 10 client.0 _ll_register_callbacks cb 0x55ffd38778b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:01:28.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.937+0000 7f0ab2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3917a90 0x55ffd39206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.937+0000 7f0abb400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3923a20 0x55ffd3920c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.937+0000 7f0ab2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3917a90 0x55ffd39206b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34296/0 (socket says 172.21.15.37:34296) 2024-08-20T05:01:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.937+0000 7f0ab2000640 1 -- 172.21.15.37:0/3470038541 learned_addr learned my addr 172.21.15.37:0/3470038541 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.937+0000 7f0abb400640 1 --2- 172.21.15.37:0/3470038541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3923a20 0x55ffd3920c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57000/0 (socket says 172.21.15.37:57000) 2024-08-20T05:01:28.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.937+0000 7f0abb400640 1 --2- 172.21.15.37:0/3470038541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917170 0x55ffd3923260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.937+0000 7f0ab2000640 1 -- 172.21.15.37:0/3470038541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3923a20 msgr2=0x55ffd3920c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:28.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.937+0000 7f0ab2000640 1 --2- 172.21.15.37:0/3470038541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3923a20 0x55ffd3920c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.937+0000 7f0ab2000640 1 -- 172.21.15.37:0/3470038541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917170 msgr2=0x55ffd3923260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.937+0000 7f0ab2000640 1 --2- 172.21.15.37:0/3470038541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917170 0x55ffd3923260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.937+0000 7f0ab2000640 1 -- 172.21.15.37:0/3470038541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffd35dc540 con 0x55ffd3917a90 2024-08-20T05:01:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.937+0000 7f0ab2000640 1 --2- 172.21.15.37:0/3470038541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3917a90 0x55ffd39206b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009ca0 tx=0x7f0aa40099d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f9e6f40f6c5b3f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.937+0000 7f0aa8c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:01:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.938+0000 7f0aa8c00640 1 -- 172.21.15.37:0/3470038541 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40316e0 con 0x55ffd3917a90 2024-08-20T05:01:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.938+0000 7f0ac425c740 1 -- 172.21.15.37:0/3470038541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ab4012aa0 con 0x55ffd3917a90 2024-08-20T05:01:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.938+0000 7f0aa8c00640 1 -- 172.21.15.37:0/3470038541 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f0aa4031880 con 0x55ffd3917a90 2024-08-20T05:01:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.938+0000 7f0aa8c00640 1 -- 172.21.15.37:0/3470038541 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0aa4004b40 con 0x55ffd3917a90 2024-08-20T05:01:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.938+0000 7f0ac425c740 10 client.15150 fetch_fsmap learned FSMap version 28 2024-08-20T05:01:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.938+0000 7f0ac425c740 1 -- 172.21.15.37:0/3470038541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ffd3931fb0 con 0x55ffd3917a90 2024-08-20T05:01:28.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.938+0000 7f0aa8c00640 1 -- 172.21.15.37:0/3470038541 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ab4012aa0 con 0x55ffd3917a90 2024-08-20T05:01:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.939+0000 7f0aa8c00640 1 -- 172.21.15.37:0/3470038541 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0aa4004480 con 0x55ffd3917a90 2024-08-20T05:01:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.939+0000 7f0ac425c740 10 client.15150 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:01:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.939+0000 7f0ac425c740 10 client.15150 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-20T05:01:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.939+0000 7f0ac425c740 20 client.15150 populate_metadata read hostname 'smithi037' 2024-08-20T05:01:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.939+0000 7f0ac425c740 1 --2- 172.21.15.37:0/3470038541 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55ffd39345b0 0x55ffd3935a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.939+0000 7f0ac425c740 4 client.15150 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:01:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.939+0000 7f0ac425c740 1 -- 172.21.15.37:0/3470038541 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffd388f790 con 0x55ffd39345b0 2024-08-20T05:01:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.939+0000 7f0abb400640 1 --2- 172.21.15.37:0/3470038541 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55ffd39345b0 0x55ffd3935a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.940+0000 7f0abb400640 1 --2- 172.21.15.37:0/3470038541 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55ffd39345b0 0x55ffd3935a20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ae1cca2f8fcb8004 server_cookie=88f603497acde7c7 in_seq=0 out_seq=0 2024-08-20T05:01:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.940+0000 7f0aa8c00640 10 client.15150 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:01:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.941+0000 7f0aa8c00640 1 -- 172.21.15.37:0/3470038541 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ffd388f790 con 0x55ffd39345b0 2024-08-20T05:01:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.941+0000 7f0aa8c00640 10 client.15150 handle_command_reply: tid=0 2024-08-20T05:01:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.941+0000 7f0ac425c740 1 client.15150 shutdown 2024-08-20T05:01:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.941+0000 7f0ac425c740 1 -- 172.21.15.37:0/3470038541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3917a90 msgr2=0x55ffd39206b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:28.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.941+0000 7f0ac425c740 1 --2- 172.21.15.37:0/3470038541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3917a90 0x55ffd39206b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009ca0 tx=0x7f0aa40099d0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.941+0000 7f0ac425c740 1 -- 172.21.15.37:0/3470038541 shutdown_connections 2024-08-20T05:01:28.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.941+0000 7f0ac425c740 1 --2- 172.21.15.37:0/3470038541 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55ffd39345b0 0x55ffd3935a20 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.941+0000 7f0ac425c740 1 --2- 172.21.15.37:0/3470038541 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3923a20 0x55ffd3920c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.941+0000 7f0ac425c740 1 --2- 172.21.15.37:0/3470038541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3917a90 0x55ffd39206b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.941+0000 7f0ac425c740 1 --2- 172.21.15.37:0/3470038541 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917170 0x55ffd3923260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.941+0000 7f0ac425c740 1 -- 172.21.15.37:0/3470038541 >> 172.21.15.37:0/3470038541 conn(0x55ffd3914fa0 msgr2=0x55ffd391ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:28.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.941+0000 7f0aa8c00640 0 client.15150 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:01:28.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.941+0000 7f0ac425c740 1 -- 172.21.15.37:0/3470038541 shutdown_connections 2024-08-20T05:01:28.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.941+0000 7f0ac425c740 1 -- 172.21.15.37:0/3470038541 wait complete. 2024-08-20T05:01:28.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.942+0000 7f0ac425c740 20 client.15150 trim_cache size 0 max 16384 2024-08-20T05:01:28.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.960+0000 7f0ac425c740 1 Processor -- start 2024-08-20T05:01:28.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.960+0000 7f0ac425c740 1 -- start start 2024-08-20T05:01:28.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.961+0000 7f0ac425c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3917170 0x55ffd391fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.961+0000 7f0ac425c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917a90 0x55ffd3915ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.961+0000 7f0ac425c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3923a20 0x55ffd3916530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.961+0000 7f0ac425c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ffd3933d60 con 0x55ffd3923a20 2024-08-20T05:01:28.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.961+0000 7f0ac425c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ffd3934430 con 0x55ffd3917a90 2024-08-20T05:01:28.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.961+0000 7f0ac425c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ffd3934b00 con 0x55ffd3917170 2024-08-20T05:01:28.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.961+0000 7f0abb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3923a20 0x55ffd3916530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.961+0000 7f0abb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3923a20 0x55ffd3916530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34302/0 (socket says 172.21.15.37:34302) 2024-08-20T05:01:28.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.961+0000 7f0abb400640 1 -- 172.21.15.37:0/478917868 learned_addr learned my addr 172.21.15.37:0/478917868 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:28.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.961+0000 7f0ab2000640 1 --2- 172.21.15.37:0/478917868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917a90 0x55ffd3915ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.961+0000 7f0abb400640 1 --2- 172.21.15.37:0/478917868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3917170 0x55ffd391fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.962+0000 7f0ab2000640 1 -- 172.21.15.37:0/478917868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3917170 msgr2=0x55ffd391fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.962+0000 7f0ab2000640 1 --2- 172.21.15.37:0/478917868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3917170 0x55ffd391fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.962+0000 7f0ab2000640 1 -- 172.21.15.37:0/478917868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3923a20 msgr2=0x55ffd3916530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.962+0000 7f0ab2000640 1 --2- 172.21.15.37:0/478917868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3923a20 0x55ffd3916530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.962+0000 7f0ab2000640 1 -- 172.21.15.37:0/478917868 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffd3915a20 con 0x55ffd3917a90 2024-08-20T05:01:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.962+0000 7f0ab2000640 1 --2- 172.21.15.37:0/478917868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917a90 0x55ffd3915ff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0aa402f540 tx=0x7f0aa40021f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a03ad4b3ebdc07ee server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.962+0000 7f0aab400640 1 -- 172.21.15.37:0/478917868 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa40316e0 con 0x55ffd3917a90 2024-08-20T05:01:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.962+0000 7f0aab400640 1 -- 172.21.15.37:0/478917868 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aa4036050 con 0x55ffd3917a90 2024-08-20T05:01:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.962+0000 7f0aab400640 1 -- 172.21.15.37:0/478917868 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4030a30 con 0x55ffd3917a90 2024-08-20T05:01:28.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.963+0000 7f0ac425c740 1 -- 172.21.15.37:0/478917868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917a90 msgr2=0x55ffd3915ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:28.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.963+0000 7f0ac425c740 1 --2- 172.21.15.37:0/478917868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917a90 0x55ffd3915ff0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0aa402f540 tx=0x7f0aa40021f0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.963+0000 7f0ac425c740 1 -- 172.21.15.37:0/478917868 shutdown_connections 2024-08-20T05:01:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.963+0000 7f0ac425c740 1 --2- 172.21.15.37:0/478917868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3923a20 0x55ffd3916530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.963+0000 7f0ac425c740 1 --2- 172.21.15.37:0/478917868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917a90 0x55ffd3915ff0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.963+0000 7f0ac425c740 1 --2- 172.21.15.37:0/478917868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3917170 0x55ffd391fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.963+0000 7f0ac425c740 1 -- 172.21.15.37:0/478917868 >> 172.21.15.37:0/478917868 conn(0x55ffd3914fa0 msgr2=0x55ffd391ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.963+0000 7f0ac425c740 1 -- 172.21.15.37:0/478917868 shutdown_connections 2024-08-20T05:01:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.963+0000 7f0ac425c740 1 -- 172.21.15.37:0/478917868 wait complete. 2024-08-20T05:01:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.963+0000 7f0ac425c740 1 -- start start 2024-08-20T05:01:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.964+0000 7f0ac425c740 1 Processor -- start 2024-08-20T05:01:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.964+0000 7f0ac425c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917170 0x55ffd3939540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.964+0000 7f0ac425c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3917a90 0x55ffd3939ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.964+0000 7f0ac425c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3923a20 0x55ffd393d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.964+0000 7f0ac425c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ffd39358a0 con 0x55ffd3917a90 2024-08-20T05:01:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.964+0000 7f0ac425c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ffd39351d0 con 0x55ffd3917170 2024-08-20T05:01:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.964+0000 7f0ac425c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ffd3935f70 con 0x55ffd3923a20 2024-08-20T05:01:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.964+0000 7f0ac425c740 10 client.0 _ll_register_callbacks cb 0x7f0aa4009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:01:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.964+0000 7f0abb400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917170 0x55ffd3939540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.964+0000 7f0ab2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3917a90 0x55ffd3939ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.964+0000 7f0abb400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917170 0x55ffd3939540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:58336/0 (socket says 172.21.15.37:58336) 2024-08-20T05:01:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.965+0000 7f0abb400640 1 -- 172.21.15.37:0/3004426639 learned_addr learned my addr 172.21.15.37:0/3004426639 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.965+0000 7f0abb400640 1 --2- 172.21.15.37:0/3004426639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3923a20 0x55ffd393d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.965+0000 7f0ab2000640 1 -- 172.21.15.37:0/3004426639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3923a20 msgr2=0x55ffd393d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.965+0000 7f0ab2000640 1 --2- 172.21.15.37:0/3004426639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3923a20 0x55ffd393d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.965+0000 7f0ab2000640 1 -- 172.21.15.37:0/3004426639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917170 msgr2=0x55ffd3939540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.965+0000 7f0ab2000640 1 --2- 172.21.15.37:0/3004426639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917170 0x55ffd3939540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.965+0000 7f0ab2000640 1 -- 172.21.15.37:0/3004426639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffd393e120 con 0x55ffd3917a90 2024-08-20T05:01:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.965+0000 7f0abb400640 1 --2- 172.21.15.37:0/3004426639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3923a20 0x55ffd393d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:01:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.965+0000 7f0ab2000640 1 --2- 172.21.15.37:0/3004426639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3917a90 0x55ffd3939ae0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009bf0 tx=0x7f0aa402fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c53e3cd9dea39f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.965+0000 7f0aa8c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:01:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.965+0000 7f0aa8c00640 1 -- 172.21.15.37:0/3004426639 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4061060 con 0x55ffd3917a90 2024-08-20T05:01:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.966+0000 7f0aa8c00640 1 -- 172.21.15.37:0/3004426639 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 9092+0+0 (secure 0 0 0) 0x7f0aa402fe70 con 0x55ffd3917a90 2024-08-20T05:01:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.966+0000 7f0ac425c740 1 -- 172.21.15.37:0/3004426639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aa4036050 con 0x55ffd3917a90 2024-08-20T05:01:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.966+0000 7f0aa8c00640 1 -- 172.21.15.37:0/3004426639 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0aa402f610 con 0x55ffd3917a90 2024-08-20T05:01:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.966+0000 7f0ac425c740 10 client.15156 fetch_fsmap learned FSMap version 28 2024-08-20T05:01:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.966+0000 7f0ac425c740 1 -- 172.21.15.37:0/3004426639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ffd399e800 con 0x55ffd3917a90 2024-08-20T05:01:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.966+0000 7f0aa8c00640 1 -- 172.21.15.37:0/3004426639 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aa4036050 con 0x55ffd3917a90 2024-08-20T05:01:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.966+0000 7f0aa8c00640 1 -- 172.21.15.37:0/3004426639 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0aa405b030 con 0x55ffd3917a90 2024-08-20T05:01:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.966+0000 7f0ac425c740 10 client.15156 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:01:28.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.966+0000 7f0ac425c740 10 client.15156 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-20T05:01:28.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.966+0000 7f0ac425c740 20 client.15156 populate_metadata read hostname 'smithi037' 2024-08-20T05:01:28.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.966+0000 7f0ac425c740 1 --2- 172.21.15.37:0/3004426639 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55ffd39a2fd0 0x55ffd39a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:28.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.966+0000 7f0ac425c740 4 client.15156 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T05:01:28.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.966+0000 7f0ac425c740 1 -- 172.21.15.37:0/3004426639 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "status"}) -- 0x55ffd388b230 con 0x55ffd39a2fd0 2024-08-20T05:01:28.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.967+0000 7f0abb400640 1 --2- 172.21.15.37:0/3004426639 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55ffd39a2fd0 0x55ffd39a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.967+0000 7f0abb400640 1 --2- 172.21.15.37:0/3004426639 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55ffd39a2fd0 0x55ffd39a1ce0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=782389a869b8c7af server_cookie=46489368746a6466 in_seq=0 out_seq=0 2024-08-20T05:01:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.967+0000 7f0aa8c00640 10 client.15156 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:01:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.968+0000 7f0aa8c00640 1 -- 172.21.15.37:0/3004426639 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ffd388b230 con 0x55ffd39a2fd0 2024-08-20T05:01:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.968+0000 7f0aa8c00640 10 client.15156 handle_command_reply: tid=0 2024-08-20T05:01:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.968+0000 7f0ac425c740 1 client.15156 shutdown 2024-08-20T05:01:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.968+0000 7f0ac425c740 1 -- 172.21.15.37:0/3004426639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3917a90 msgr2=0x55ffd3939ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.968+0000 7f0ac425c740 1 --2- 172.21.15.37:0/3004426639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3917a90 0x55ffd3939ae0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009bf0 tx=0x7f0aa402fc80 comp rx=0 tx=0).stop 2024-08-20T05:01:28.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.968+0000 7f0ac425c740 1 -- 172.21.15.37:0/3004426639 shutdown_connections 2024-08-20T05:01:28.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.968+0000 7f0ac425c740 1 --2- 172.21.15.37:0/3004426639 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55ffd39a2fd0 0x55ffd39a1ce0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.968+0000 7f0ac425c740 1 --2- 172.21.15.37:0/3004426639 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ffd3923a20 0x55ffd393d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.968+0000 7f0ac425c740 1 --2- 172.21.15.37:0/3004426639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ffd3917a90 0x55ffd3939ae0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.968+0000 7f0ac425c740 1 --2- 172.21.15.37:0/3004426639 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ffd3917170 0x55ffd3939540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.968+0000 7f0ac425c740 1 -- 172.21.15.37:0/3004426639 >> 172.21.15.37:0/3004426639 conn(0x55ffd3914fa0 msgr2=0x55ffd3915ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:28.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.968+0000 7f0aa8c00640 0 client.15156 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:01:28.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.968+0000 7f0ac425c740 1 -- 172.21.15.37:0/3004426639 shutdown_connections 2024-08-20T05:01:28.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.968+0000 7f0ac425c740 1 -- 172.21.15.37:0/3004426639 wait complete. 2024-08-20T05:01:28.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.968+0000 7f0ac425c740 20 client.15156 trim_cache size 0 max 16384 2024-08-20T05:01:28.975 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:01:28.975 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T05:01:28.975 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 2, 2024-08-20T05:01:28.975 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24656, 2024-08-20T05:01:28.975 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-20T05:01:28.975 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-20T05:01:28.975 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-20T05:01:28.975 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 85.846627221999995, 2024-08-20T05:01:28.975 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-08-20T05:01:28.975 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 86, 2024-08-20T05:01:28.975 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 84, 2024-08-20T05:01:28.976 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 162.43699055900001 2024-08-20T05:01:28.976 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:01:28.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.969+0000 7f0abbe00640 1 -- 172.21.15.37:0/1085446117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0aa00b3d10 msgr2=0x7f0aa00b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:28.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.969+0000 7f0abbe00640 1 --2- 172.21.15.37:0/1085446117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0aa00b3d10 0x7f0aa00b61d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55ffd391a2f0 tx=0x7f0aac0e7710 comp rx=0 tx=0).stop 2024-08-20T05:01:28.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.969+0000 7f0abbe00640 1 -- 172.21.15.37:0/1085446117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0abc102920 msgr2=0x7f0abc0751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:28.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.969+0000 7f0abbe00640 1 --2- 172.21.15.37:0/1085446117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0abc102920 0x7f0abc0751d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00d950 tx=0x7f0aac00de10 comp rx=0 tx=0).stop 2024-08-20T05:01:28.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.969+0000 7f0abbe00640 1 -- 172.21.15.37:0/1085446117 shutdown_connections 2024-08-20T05:01:28.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.969+0000 7f0abbe00640 1 --2- 172.21.15.37:0/1085446117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0aa00b3d10 0x7f0aa00b61d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.969+0000 7f0abbe00640 1 --2- 172.21.15.37:0/1085446117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0abc108cb0 0x7f0abc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.969+0000 7f0abbe00640 1 --2- 172.21.15.37:0/1085446117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0abc108330 0x7f0abc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.969+0000 7f0abbe00640 1 --2- 172.21.15.37:0/1085446117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0abc102920 0x7f0abc0751d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:28.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.969+0000 7f0abbe00640 1 -- 172.21.15.37:0/1085446117 >> 172.21.15.37:0/1085446117 conn(0x7f0abc0fe350 msgr2=0x7f0abc100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:28.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.969+0000 7f0abbe00640 1 -- 172.21.15.37:0/1085446117 shutdown_connections 2024-08-20T05:01:28.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:28.969+0000 7f0abbe00640 1 -- 172.21.15.37:0/1085446117 wait complete. 2024-08-20T05:01:29.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:29 smithi135 ceph-mon[22342]: pgmap v376: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:29.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-08-20T05:01:29.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]} : dispatch 2024-08-20T05:01:29.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:29 smithi130 ceph-mon[22007]: pgmap v376: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:29.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-08-20T05:01:29.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]} : dispatch 2024-08-20T05:01:29.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:29 smithi037 ceph-mon[17265]: pgmap v376: 129 pgs: 129 active+clean; 646 KiB data, 355 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:29.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2024-08-20T05:01:29.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]} : dispatch 2024-08-20T05:01:29.822 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.i status 2024-08-20T05:01:30.205 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:30.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-08-20T05:01:30.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]': finished 2024-08-20T05:01:30.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:30 smithi135 ceph-mon[22342]: osdmap e87: 12 total, 12 up, 12 in 2024-08-20T05:01:30.680 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-08-20T05:01:30.680 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]': finished 2024-08-20T05:01:30.680 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:30 smithi037 ceph-mon[17265]: osdmap e87: 12 total, 12 up, 12 in 2024-08-20T05:01:30.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-08-20T05:01:30.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]': finished 2024-08-20T05:01:30.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:30 smithi130 ceph-mon[22007]: osdmap e87: 12 total, 12 up, 12 in 2024-08-20T05:01:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.791+0000 7f5ffa200640 1 -- 172.21.15.37:0/1648435389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ff410f470 msgr2=0x7f5ff4115c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:30.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.791+0000 7f5ffa200640 1 --2- 172.21.15.37:0/1648435389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ff410f470 0x7f5ff4115c70 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009ca0 tx=0x7f5fec02a8c0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.791+0000 7f5ffa200640 1 -- 172.21.15.37:0/1648435389 shutdown_connections 2024-08-20T05:01:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.791+0000 7f5ffa200640 1 --2- 172.21.15.37:0/1648435389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ff410f470 0x7f5ff4115c70 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.791+0000 7f5ffa200640 1 --2- 172.21.15.37:0/1648435389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ff410eaf0 0x7f5ff410ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.791+0000 7f5ffa200640 1 --2- 172.21.15.37:0/1648435389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ff41090e0 0x7f5ff41094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.791+0000 7f5ffa200640 1 -- 172.21.15.37:0/1648435389 >> 172.21.15.37:0/1648435389 conn(0x7f5ff4078760 msgr2=0x7f5ff407ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.791+0000 7f5ffa200640 1 -- 172.21.15.37:0/1648435389 shutdown_connections 2024-08-20T05:01:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.792+0000 7f5ffa200640 1 -- 172.21.15.37:0/1648435389 wait complete. 2024-08-20T05:01:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.793+0000 7f5ffa200640 1 Processor -- start 2024-08-20T05:01:30.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.793+0000 7f5ffa200640 1 -- start start 2024-08-20T05:01:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.793+0000 7f5ffa200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ff41090e0 0x7f5ff419f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.793+0000 7f5ffa200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ff410eaf0 0x7f5ff419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.793+0000 7f5ffa200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ff410f470 0x7f5ff41a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.793+0000 7f5ffa200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff41190a0 con 0x7f5ff41090e0 2024-08-20T05:01:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.793+0000 7f5ffa200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff4118f20 con 0x7f5ff410f470 2024-08-20T05:01:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.793+0000 7f5ffa200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff4119220 con 0x7f5ff410eaf0 2024-08-20T05:01:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.794+0000 7f5ff3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ff41090e0 0x7f5ff419f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:30.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.794+0000 7f5ff3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ff41090e0 0x7f5ff419f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34334/0 (socket says 172.21.15.37:34334) 2024-08-20T05:01:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.794+0000 7f5ff3400640 1 -- 172.21.15.37:0/1480492417 learned_addr learned my addr 172.21.15.37:0/1480492417 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.794+0000 7f5ff2a00640 1 --2- 172.21.15.37:0/1480492417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ff410eaf0 0x7f5ff419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.794+0000 7f5ff3e00640 1 --2- 172.21.15.37:0/1480492417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ff410f470 0x7f5ff41a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.794+0000 7f5ff2a00640 1 -- 172.21.15.37:0/1480492417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ff410f470 msgr2=0x7f5ff41a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.794+0000 7f5ff2a00640 1 --2- 172.21.15.37:0/1480492417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ff410f470 0x7f5ff41a4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.794+0000 7f5ff2a00640 1 -- 172.21.15.37:0/1480492417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ff41090e0 msgr2=0x7f5ff419f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.794+0000 7f5ff2a00640 1 --2- 172.21.15.37:0/1480492417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ff41090e0 0x7f5ff419f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.794+0000 7f5ff2a00640 1 -- 172.21.15.37:0/1480492417 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff41a55e0 con 0x7f5ff410eaf0 2024-08-20T05:01:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.794+0000 7f5ff3400640 1 --2- 172.21.15.37:0/1480492417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ff41090e0 0x7f5ff419f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.795+0000 7f5ff2a00640 1 --2- 172.21.15.37:0/1480492417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ff410eaf0 0x7f5ff419fa70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0005fd0 tx=0x7f5fe000dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.795+0000 7f5febe00640 1 -- 172.21.15.37:0/1480492417 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0009c30 con 0x7f5ff410eaf0 2024-08-20T05:01:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.795+0000 7f5ffa200640 1 -- 172.21.15.37:0/1480492417 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff41a58d0 con 0x7f5ff410eaf0 2024-08-20T05:01:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.795+0000 7f5febe00640 1 -- 172.21.15.37:0/1480492417 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fe0009dd0 con 0x7f5ff410eaf0 2024-08-20T05:01:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.795+0000 7f5febe00640 1 -- 172.21.15.37:0/1480492417 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0010460 con 0x7f5ff410eaf0 2024-08-20T05:01:30.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.795+0000 7f5ffa200640 1 -- 172.21.15.37:0/1480492417 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff41abf90 con 0x7f5ff410eaf0 2024-08-20T05:01:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.798+0000 7f5ffce1c740 1 Processor -- start 2024-08-20T05:01:30.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.798+0000 7f5ffce1c740 1 -- start start 2024-08-20T05:01:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.799+0000 7f5ffce1c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b255f10 0x55f76b2562f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.799+0000 7f5ffce1c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 0x55f76b262280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.799+0000 7f5ffce1c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b2627c0 0x55f76b264bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.799+0000 7f5ffce1c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f76b1cc840 con 0x55f76b255f10 2024-08-20T05:01:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.799+0000 7f5ffce1c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f76b1bbd40 con 0x55f76b2627c0 2024-08-20T05:01:30.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.799+0000 7f5ffce1c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f76b1bfd80 con 0x55f76b256830 2024-08-20T05:01:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.799+0000 7f5ff3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b255f10 0x55f76b2562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.799+0000 7f5ff3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 0x55f76b262280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.799+0000 7f5ff3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b255f10 0x55f76b2562f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34346/0 (socket says 172.21.15.37:34346) 2024-08-20T05:01:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.799+0000 7f5ff3e00640 1 -- 172.21.15.37:0/3661413096 learned_addr learned my addr 172.21.15.37:0/3661413096 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:30.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.799+0000 7f5febe00640 1 -- 172.21.15.37:0/1480492417 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5fe0003e80 con 0x7f5ff410eaf0 2024-08-20T05:01:30.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.799+0000 7f5ff3e00640 1 -- 172.21.15.37:0/3661413096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 msgr2=0x55f76b262280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:30.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.799+0000 7f5ff3e00640 1 --2- 172.21.15.37:0/3661413096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 0x55f76b262280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.799+0000 7f5ff3e00640 1 -- 172.21.15.37:0/3661413096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b2627c0 msgr2=0x55f76b264bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:30.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.799+0000 7f5ff3e00640 1 --2- 172.21.15.37:0/3661413096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b2627c0 0x55f76b264bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.799+0000 7f5ff3e00640 1 -- 172.21.15.37:0/3661413096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f76b1621c0 con 0x55f76b255f10 2024-08-20T05:01:30.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.800+0000 7f5ff3e00640 1 --2- 172.21.15.37:0/3661413096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b255f10 0x55f76b2562f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009800 tx=0x7f5fec009830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ccc2221e883f56 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:30.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.800+0000 7f5fdfe00640 1 -- 172.21.15.37:0/3661413096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec031cf0 con 0x55f76b255f10 2024-08-20T05:01:30.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.800+0000 7f5fdfe00640 1 -- 172.21.15.37:0/3661413096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fec036070 con 0x55f76b255f10 2024-08-20T05:01:30.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.800+0000 7f5fdfe00640 1 -- 172.21.15.37:0/3661413096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fec004240 con 0x55f76b255f10 2024-08-20T05:01:30.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.801+0000 7f5febe00640 1 --2- 172.21.15.37:0/1480492417 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5fd80b3bd0 0x7f5fd80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.801+0000 7f5ffce1c740 1 -- 172.21.15.37:0/3661413096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b255f10 msgr2=0x55f76b2562f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.801+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/3661413096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b255f10 0x55f76b2562f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5fec009800 tx=0x7f5fec009830 comp rx=0 tx=0).stop 2024-08-20T05:01:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.801+0000 7f5ffce1c740 1 -- 172.21.15.37:0/3661413096 shutdown_connections 2024-08-20T05:01:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.801+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/3661413096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b2627c0 0x55f76b264bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.801+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/3661413096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 0x55f76b262280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.801+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/3661413096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b255f10 0x55f76b2562f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.801+0000 7f5ffce1c740 1 -- 172.21.15.37:0/3661413096 >> 172.21.15.37:0/3661413096 conn(0x55f76b253d40 msgr2=0x55f76b254ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.801+0000 7f5febe00640 1 -- 172.21.15.37:0/1480492417 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5fe00e3e40 con 0x7f5ff410eaf0 2024-08-20T05:01:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.801+0000 7f5ff3400640 1 --2- 172.21.15.37:0/1480492417 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5fd80b3bd0 0x7f5fd80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:30.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.801+0000 7f5ffce1c740 1 -- 172.21.15.37:0/3661413096 shutdown_connections 2024-08-20T05:01:30.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.801+0000 7f5ffce1c740 1 -- 172.21.15.37:0/3661413096 wait complete. 2024-08-20T05:01:30.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.802+0000 7f5ffce1c740 1 -- start start 2024-08-20T05:01:30.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.802+0000 7f5ff3400640 1 --2- 172.21.15.37:0/1480492417 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5fd80b3bd0 0x7f5fd80b6090 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55f76b259090 tx=0x7f5fe400b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.802+0000 7f5ffce1c740 1 Processor -- start 2024-08-20T05:01:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.802+0000 7f5ffce1c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 0x55f76b262010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.802+0000 7f5ffce1c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b256830 0x55f76b25f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.802+0000 7f5ffce1c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b2627c0 0x55f76b25f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.802+0000 7f5ffce1c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f76b01e5f0 con 0x55f76b256830 2024-08-20T05:01:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.803+0000 7f5ffce1c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f76b157170 con 0x55f76b255f10 2024-08-20T05:01:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.803+0000 7f5ffce1c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f76b265290 con 0x55f76b2627c0 2024-08-20T05:01:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.803+0000 7f5ffce1c740 10 client.0 _ll_register_callbacks cb 0x55f76b1b68b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:01:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.803+0000 7f5ff2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b256830 0x55f76b25f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:30.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.803+0000 7f5ff3400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 0x55f76b262010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.803+0000 7f5ff2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b256830 0x55f76b25f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34362/0 (socket says 172.21.15.37:34362) 2024-08-20T05:01:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.803+0000 7f5ff3400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 0x55f76b262010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:58376/0 (socket says 172.21.15.37:58376) 2024-08-20T05:01:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.803+0000 7f5ff2a00640 1 -- 172.21.15.37:0/3298837471 learned_addr learned my addr 172.21.15.37:0/3298837471 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.803+0000 7f5ff3e00640 1 --2- 172.21.15.37:0/3298837471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b2627c0 0x55f76b25f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.803+0000 7f5ff3400640 1 -- 172.21.15.37:0/3298837471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b2627c0 msgr2=0x55f76b25f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.803+0000 7f5ff3400640 1 --2- 172.21.15.37:0/3298837471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b2627c0 0x55f76b25f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.803+0000 7f5ff3400640 1 -- 172.21.15.37:0/3298837471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b256830 msgr2=0x55f76b25f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.803+0000 7f5ff3400640 1 --2- 172.21.15.37:0/3298837471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b256830 0x55f76b25f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.803+0000 7f5ff3400640 1 -- 172.21.15.37:0/3298837471 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f76af1b540 con 0x55f76b255f10 2024-08-20T05:01:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.803+0000 7f5ff2a00640 1 --2- 172.21.15.37:0/3298837471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b256830 0x55f76b25f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.803+0000 7f5ff3e00640 1 --2- 172.21.15.37:0/3298837471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b2627c0 0x55f76b25f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:01:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.804+0000 7f5ff3400640 1 --2- 172.21.15.37:0/3298837471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 0x55f76b262010 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4010850 tx=0x7f5fe4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1654c819d722bae server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:30.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.804+0000 7f5fdcc00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:01:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.804+0000 7f5fdcc00640 1 -- 172.21.15.37:0/3298837471 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe4004320 con 0x55f76b255f10 2024-08-20T05:01:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.804+0000 7f5ffce1c740 1 -- 172.21.15.37:0/3298837471 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fec036070 con 0x55f76b255f10 2024-08-20T05:01:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.804+0000 7f5fdcc00640 1 -- 172.21.15.37:0/3298837471 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5fe401f6a0 con 0x55f76b255f10 2024-08-20T05:01:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.804+0000 7f5fdcc00640 1 -- 172.21.15.37:0/3298837471 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5fe40044c0 con 0x55f76b255f10 2024-08-20T05:01:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.804+0000 7f5ffce1c740 10 client.25190 fetch_fsmap learned FSMap version 28 2024-08-20T05:01:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.804+0000 7f5ffce1c740 1 -- 172.21.15.37:0/3298837471 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f76b270bd0 con 0x55f76b255f10 2024-08-20T05:01:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.805+0000 7f5fdcc00640 1 -- 172.21.15.37:0/3298837471 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fec036070 con 0x55f76b255f10 2024-08-20T05:01:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.805+0000 7f5fdcc00640 1 -- 172.21.15.37:0/3298837471 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5fe4026070 con 0x55f76b255f10 2024-08-20T05:01:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.805+0000 7f5ffce1c740 10 client.25190 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:01:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.805+0000 7f5ffce1c740 10 client.25190 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-20T05:01:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.805+0000 7f5ffce1c740 20 client.25190 populate_metadata read hostname 'smithi037' 2024-08-20T05:01:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.805+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/3298837471 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55f76b2731c0 0x55f76b274630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.805+0000 7f5ffce1c740 4 client.25190 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:01:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.805+0000 7f5ffce1c740 1 -- 172.21.15.37:0/3298837471 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f76b1ce790 con 0x55f76b2731c0 2024-08-20T05:01:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.805+0000 7f5ff2a00640 1 --2- 172.21.15.37:0/3298837471 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55f76b2731c0 0x55f76b274630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.806+0000 7f5ff2a00640 1 --2- 172.21.15.37:0/3298837471 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55f76b2731c0 0x55f76b274630 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b6b495eeb8ef6cb0 server_cookie=e794efcea7c7bcdf in_seq=0 out_seq=0 2024-08-20T05:01:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.806+0000 7f5fdcc00640 10 client.25190 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:01:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.807+0000 7f5fdcc00640 1 -- 172.21.15.37:0/3298837471 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f76b1ce790 con 0x55f76b2731c0 2024-08-20T05:01:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.807+0000 7f5fdcc00640 10 client.25190 handle_command_reply: tid=0 2024-08-20T05:01:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.807+0000 7f5ffce1c740 1 client.25190 shutdown 2024-08-20T05:01:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.807+0000 7f5ffce1c740 1 -- 172.21.15.37:0/3298837471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 msgr2=0x55f76b262010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.807+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/3298837471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 0x55f76b262010 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4010850 tx=0x7f5fe4004730 comp rx=0 tx=0).stop 2024-08-20T05:01:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.807+0000 7f5ffce1c740 1 -- 172.21.15.37:0/3298837471 shutdown_connections 2024-08-20T05:01:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.807+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/3298837471 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55f76b2731c0 0x55f76b274630 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.807+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/3298837471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b2627c0 0x55f76b25f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.807+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/3298837471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b256830 0x55f76b25f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.807+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/3298837471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 0x55f76b262010 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.807+0000 7f5fdcc00640 0 client.25190 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:01:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.807+0000 7f5ffce1c740 1 -- 172.21.15.37:0/3298837471 >> 172.21.15.37:0/3298837471 conn(0x55f76b253d40 msgr2=0x55f76b252e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.807+0000 7f5ffce1c740 1 -- 172.21.15.37:0/3298837471 shutdown_connections 2024-08-20T05:01:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.807+0000 7f5ffce1c740 1 -- 172.21.15.37:0/3298837471 wait complete. 2024-08-20T05:01:30.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.807+0000 7f5ffce1c740 20 client.25190 trim_cache size 0 max 16384 2024-08-20T05:01:30.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.826+0000 7f5ffce1c740 1 Processor -- start 2024-08-20T05:01:30.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.826+0000 7f5ffce1c740 1 -- start start 2024-08-20T05:01:30.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ffce1c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 0x55f76b255560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ffce1c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 0x55f76b25c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ffce1c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b2627c0 0x55f76b25cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ffce1c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f76b272970 con 0x55f76b2627c0 2024-08-20T05:01:30.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ffce1c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f76b273040 con 0x55f76b255f10 2024-08-20T05:01:30.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ffce1c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f76b273710 con 0x55f76b256830 2024-08-20T05:01:30.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ff3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b2627c0 0x55f76b25cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:30.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ff3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b2627c0 0x55f76b25cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34364/0 (socket says 172.21.15.37:34364) 2024-08-20T05:01:30.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ff3e00640 1 -- 172.21.15.37:0/2408579643 learned_addr learned my addr 172.21.15.37:0/2408579643 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:30.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ff3400640 1 --2- 172.21.15.37:0/2408579643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 0x55f76b255560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:30.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ff2a00640 1 --2- 172.21.15.37:0/2408579643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 0x55f76b25c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:30.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ff3400640 1 -- 172.21.15.37:0/2408579643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 msgr2=0x55f76b25c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:30.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ff3400640 1 --2- 172.21.15.37:0/2408579643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 0x55f76b25c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ff3400640 1 -- 172.21.15.37:0/2408579643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b2627c0 msgr2=0x55f76b25cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:30.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ff3400640 1 --2- 172.21.15.37:0/2408579643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b2627c0 0x55f76b25cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ff3400640 1 -- 172.21.15.37:0/2408579643 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f76b2547c0 con 0x55f76b255f10 2024-08-20T05:01:30.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ff2a00640 1 --2- 172.21.15.37:0/2408579643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 0x55f76b25c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:30.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.827+0000 7f5ff3e00640 1 --2- 172.21.15.37:0/2408579643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b2627c0 0x55f76b25cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:30.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.828+0000 7f5ff3400640 1 --2- 172.21.15.37:0/2408579643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 0x55f76b255560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4012010 tx=0x7f5fe4028440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9c79fa19a677ab5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:30.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.828+0000 7f5fdf400640 1 -- 172.21.15.37:0/2408579643 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe401f240 con 0x55f76b255f10 2024-08-20T05:01:30.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.828+0000 7f5fdf400640 1 -- 172.21.15.37:0/2408579643 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fe401f3e0 con 0x55f76b255f10 2024-08-20T05:01:30.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.828+0000 7f5fdf400640 1 -- 172.21.15.37:0/2408579643 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe401fe00 con 0x55f76b255f10 2024-08-20T05:01:30.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.829+0000 7f5ffce1c740 1 -- 172.21.15.37:0/2408579643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 msgr2=0x55f76b255560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:30.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.829+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/2408579643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 0x55f76b255560 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5fe4012010 tx=0x7f5fe4028440 comp rx=0 tx=0).stop 2024-08-20T05:01:30.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.829+0000 7f5ffce1c740 1 -- 172.21.15.37:0/2408579643 shutdown_connections 2024-08-20T05:01:30.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.829+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/2408579643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b2627c0 0x55f76b25cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.829+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/2408579643 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 0x55f76b25c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.829+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/2408579643 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 0x55f76b255560 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.829+0000 7f5ffce1c740 1 -- 172.21.15.37:0/2408579643 >> 172.21.15.37:0/2408579643 conn(0x55f76b253d40 msgr2=0x55f76b254e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:30.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.829+0000 7f5ffce1c740 1 -- 172.21.15.37:0/2408579643 shutdown_connections 2024-08-20T05:01:30.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.829+0000 7f5ffce1c740 1 -- 172.21.15.37:0/2408579643 wait complete. 2024-08-20T05:01:30.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.830+0000 7f5ffce1c740 1 -- start start 2024-08-20T05:01:30.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.830+0000 7f5ffce1c740 1 Processor -- start 2024-08-20T05:01:30.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.830+0000 7f5ffce1c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 0x55f76b275b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.830+0000 7f5ffce1c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 0x55f76b2760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.830+0000 7f5ffce1c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b2627c0 0x55f76b27b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.830+0000 7f5ffce1c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f76b2744b0 con 0x55f76b2627c0 2024-08-20T05:01:30.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.830+0000 7f5ffce1c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f76b273de0 con 0x55f76b255f10 2024-08-20T05:01:30.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.830+0000 7f5ffce1c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f76b274b80 con 0x55f76b256830 2024-08-20T05:01:30.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.830+0000 7f5ffce1c740 10 client.0 _ll_register_callbacks cb 0x7f5fe4010710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:01:30.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.831+0000 7f5ff2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 0x55f76b2760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.831+0000 7f5ff3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b2627c0 0x55f76b27b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.831+0000 7f5ff2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 0x55f76b2760a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57056/0 (socket says 172.21.15.37:57056) 2024-08-20T05:01:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.831+0000 7f5ff2a00640 1 -- 172.21.15.37:0/1294800781 learned_addr learned my addr 172.21.15.37:0/1294800781 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.831+0000 7f5ff3400640 1 --2- 172.21.15.37:0/1294800781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 0x55f76b275b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.831+0000 7f5ff2a00640 1 -- 172.21.15.37:0/1294800781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 msgr2=0x55f76b275b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.831+0000 7f5ff2a00640 1 --2- 172.21.15.37:0/1294800781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 0x55f76b275b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.831+0000 7f5ff2a00640 1 -- 172.21.15.37:0/1294800781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b2627c0 msgr2=0x55f76b27b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.831+0000 7f5ff2a00640 1 --2- 172.21.15.37:0/1294800781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b2627c0 0x55f76b27b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.831+0000 7f5ff2a00640 1 -- 172.21.15.37:0/1294800781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f76b253b70 con 0x55f76b256830 2024-08-20T05:01:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.831+0000 7f5ff2a00640 1 --2- 172.21.15.37:0/1294800781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 0x55f76b2760a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009610 tx=0x7f5fe000df10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c667cbc07769de7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.831+0000 7f5fdcc00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:01:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.831+0000 7f5fdcc00640 1 -- 172.21.15.37:0/1294800781 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0020040 con 0x55f76b256830 2024-08-20T05:01:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.832+0000 7f5fdcc00640 1 -- 172.21.15.37:0/1294800781 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5fe00a6cd0 con 0x55f76b256830 2024-08-20T05:01:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.832+0000 7f5ffce1c740 1 -- 172.21.15.37:0/1294800781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5fe401f3e0 con 0x55f76b256830 2024-08-20T05:01:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.832+0000 7f5fdcc00640 1 -- 172.21.15.37:0/1294800781 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5fe00aaa40 con 0x55f76b256830 2024-08-20T05:01:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.832+0000 7f5ffce1c740 10 client.25204 fetch_fsmap learned FSMap version 28 2024-08-20T05:01:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.832+0000 7f5ffce1c740 1 -- 172.21.15.37:0/1294800781 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f76b27cb30 con 0x55f76b256830 2024-08-20T05:01:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.832+0000 7f5fdcc00640 1 -- 172.21.15.37:0/1294800781 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5fe401f3e0 con 0x55f76b256830 2024-08-20T05:01:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.832+0000 7f5fdcc00640 1 -- 172.21.15.37:0/1294800781 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f5fe00b35b0 con 0x55f76b256830 2024-08-20T05:01:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.832+0000 7f5ffce1c740 10 client.25204 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:01:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.832+0000 7f5ffce1c740 10 client.25204 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-20T05:01:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.832+0000 7f5ffce1c740 20 client.25204 populate_metadata read hostname 'smithi037' 2024-08-20T05:01:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.832+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/1294800781 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55f76b2e17d0 0x55f76b2e04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.832+0000 7f5ffce1c740 4 client.25204 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T05:01:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.832+0000 7f5ffce1c740 1 -- 172.21.15.37:0/1294800781 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "status"}) -- 0x55f76b1ca230 con 0x55f76b2e17d0 2024-08-20T05:01:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.833+0000 7f5ff3400640 1 --2- 172.21.15.37:0/1294800781 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55f76b2e17d0 0x55f76b2e04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.833+0000 7f5ff3400640 1 --2- 172.21.15.37:0/1294800781 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55f76b2e17d0 0x55f76b2e04e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1e69c1c868bbfe4e server_cookie=bde9be3681e9af3f in_seq=0 out_seq=0 2024-08-20T05:01:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.833+0000 7f5fdcc00640 10 client.25204 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:01:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.833+0000 7f5fdcc00640 1 -- 172.21.15.37:0/1294800781 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f76b1ca230 con 0x55f76b2e17d0 2024-08-20T05:01:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.833+0000 7f5fdcc00640 10 client.25204 handle_command_reply: tid=0 2024-08-20T05:01:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.833+0000 7f5ffce1c740 1 client.25204 shutdown 2024-08-20T05:01:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.834+0000 7f5ffce1c740 1 -- 172.21.15.37:0/1294800781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 msgr2=0x55f76b2760a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.834+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/1294800781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 0x55f76b2760a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0009610 tx=0x7f5fe000df10 comp rx=0 tx=0).stop 2024-08-20T05:01:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.834+0000 7f5ffce1c740 1 -- 172.21.15.37:0/1294800781 shutdown_connections 2024-08-20T05:01:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.834+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/1294800781 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55f76b2e17d0 0x55f76b2e04e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.834+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/1294800781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f76b2627c0 0x55f76b27b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.834+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/1294800781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f76b256830 0x55f76b2760a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.834+0000 7f5ffce1c740 1 --2- 172.21.15.37:0/1294800781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f76b255f10 0x55f76b275b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.834+0000 7f5ffce1c740 1 -- 172.21.15.37:0/1294800781 >> 172.21.15.37:0/1294800781 conn(0x55f76b253d40 msgr2=0x55f76b2525e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.834+0000 7f5fdcc00640 0 client.25204 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:01:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.834+0000 7f5ffce1c740 1 -- 172.21.15.37:0/1294800781 shutdown_connections 2024-08-20T05:01:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.834+0000 7f5ffce1c740 1 -- 172.21.15.37:0/1294800781 wait complete. 2024-08-20T05:01:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.834+0000 7f5ffce1c740 20 client.25204 trim_cache size 0 max 16384 2024-08-20T05:01:30.841 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:01:30.842 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T05:01:30.842 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 1, 2024-08-20T05:01:30.842 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24664, 2024-08-20T05:01:30.842 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-20T05:01:30.842 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-20T05:01:30.842 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-20T05:01:30.842 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 88.719489405999994, 2024-08-20T05:01:30.842 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-08-20T05:01:30.842 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 88, 2024-08-20T05:01:30.842 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 84, 2024-08-20T05:01:30.842 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 161.74976090000001 2024-08-20T05:01:30.842 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:01:30.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.835+0000 7f5ffa200640 1 -- 172.21.15.37:0/1480492417 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5fd80b3bd0 msgr2=0x7f5fd80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:30.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.835+0000 7f5ffa200640 1 --2- 172.21.15.37:0/1480492417 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5fd80b3bd0 0x7f5fd80b6090 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55f76b259090 tx=0x7f5fe400b4a0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.835+0000 7f5ffa200640 1 -- 172.21.15.37:0/1480492417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ff410eaf0 msgr2=0x7f5ff419fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:30.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.835+0000 7f5ffa200640 1 --2- 172.21.15.37:0/1480492417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ff410eaf0 0x7f5ff419fa70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0005fd0 tx=0x7f5fe000dde0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.835+0000 7f5ffa200640 1 -- 172.21.15.37:0/1480492417 shutdown_connections 2024-08-20T05:01:30.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.835+0000 7f5ffa200640 1 --2- 172.21.15.37:0/1480492417 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5fd80b3bd0 0x7f5fd80b6090 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.835+0000 7f5ffa200640 1 --2- 172.21.15.37:0/1480492417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5ff410f470 0x7f5ff41a4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.835+0000 7f5ffa200640 1 --2- 172.21.15.37:0/1480492417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5ff410eaf0 0x7f5ff419fa70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.835+0000 7f5ffa200640 1 --2- 172.21.15.37:0/1480492417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ff41090e0 0x7f5ff419f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:30.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.835+0000 7f5ffa200640 1 -- 172.21.15.37:0/1480492417 >> 172.21.15.37:0/1480492417 conn(0x7f5ff4078760 msgr2=0x7f5ff407ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:30.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.835+0000 7f5ffa200640 1 -- 172.21.15.37:0/1480492417 shutdown_connections 2024-08-20T05:01:30.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:30.835+0000 7f5ffa200640 1 -- 172.21.15.37:0/1480492417 wait complete. 2024-08-20T05:01:31.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:31 smithi037 ceph-mon[17265]: pgmap v378: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 614 B/s wr, 10 op/s 2024-08-20T05:01:31.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:31 smithi037 ceph-mon[17265]: osdmap e88: 12 total, 12 up, 12 in 2024-08-20T05:01:31.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:31 smithi037 ceph-mon[17265]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-08-20T05:01:31.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:31 smithi135 ceph-mon[22342]: pgmap v378: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 614 B/s wr, 10 op/s 2024-08-20T05:01:31.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:31 smithi135 ceph-mon[22342]: osdmap e88: 12 total, 12 up, 12 in 2024-08-20T05:01:31.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:31 smithi135 ceph-mon[22342]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-08-20T05:01:31.705 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.b status 2024-08-20T05:01:31.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:31 smithi130 ceph-mon[22007]: pgmap v378: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 614 B/s wr, 10 op/s 2024-08-20T05:01:31.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:31 smithi130 ceph-mon[22007]: osdmap e88: 12 total, 12 up, 12 in 2024-08-20T05:01:31.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:31 smithi130 ceph-mon[22007]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-08-20T05:01:32.083 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.693+0000 7fc733e00640 1 -- 172.21.15.37:0/2961894348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc72c108f80 msgr2=0x7fc72c10f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.693+0000 7fc733e00640 1 --2- 172.21.15.37:0/2961894348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc72c108f80 0x7fc72c10f6b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc724009be0 tx=0x7fc72402a6d0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.693+0000 7fc733e00640 1 -- 172.21.15.37:0/2961894348 shutdown_connections 2024-08-20T05:01:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.693+0000 7fc733e00640 1 --2- 172.21.15.37:0/2961894348 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc72c108f80 0x7fc72c10f6b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.693+0000 7fc733e00640 1 --2- 172.21.15.37:0/2961894348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72c108600 0x7fc72c108a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.693+0000 7fc733e00640 1 --2- 172.21.15.37:0/2961894348 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc72c101500 0x7fc72c1018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.693+0000 7fc733e00640 1 -- 172.21.15.37:0/2961894348 >> 172.21.15.37:0/2961894348 conn(0x7fc72c076cc0 msgr2=0x7fc72c0770d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.693+0000 7fc733e00640 1 -- 172.21.15.37:0/2961894348 shutdown_connections 2024-08-20T05:01:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.693+0000 7fc733e00640 1 -- 172.21.15.37:0/2961894348 wait complete. 2024-08-20T05:01:32.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.694+0000 7fc733e00640 1 Processor -- start 2024-08-20T05:01:32.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.694+0000 7fc733e00640 1 -- start start 2024-08-20T05:01:32.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.695+0000 7fc733e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc72c101500 0x7fc72c198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.695+0000 7fc733e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72c108600 0x7fc72c1994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.695+0000 7fc733e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc72c108f80 0x7fc72c19e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.695+0000 7fc733e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc72c112af0 con 0x7fc72c108600 2024-08-20T05:01:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.695+0000 7fc733e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc72c112970 con 0x7fc72c108f80 2024-08-20T05:01:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.695+0000 7fc733e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc72c112c70 con 0x7fc72c101500 2024-08-20T05:01:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.695+0000 7fc730a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72c108600 0x7fc72c1994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.695+0000 7fc730a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72c108600 0x7fc72c1994e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34388/0 (socket says 172.21.15.37:34388) 2024-08-20T05:01:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.695+0000 7fc730a00640 1 -- 172.21.15.37:0/3352882330 learned_addr learned my addr 172.21.15.37:0/3352882330 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.695+0000 7fc731400640 1 --2- 172.21.15.37:0/3352882330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc72c101500 0x7fc72c198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.695+0000 7fc731e00640 1 --2- 172.21.15.37:0/3352882330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc72c108f80 0x7fc72c19e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.695+0000 7fc730a00640 1 -- 172.21.15.37:0/3352882330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc72c101500 msgr2=0x7fc72c198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.695+0000 7fc730a00640 1 --2- 172.21.15.37:0/3352882330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc72c101500 0x7fc72c198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.695+0000 7fc730a00640 1 -- 172.21.15.37:0/3352882330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc72c108f80 msgr2=0x7fc72c19e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.695+0000 7fc730a00640 1 --2- 172.21.15.37:0/3352882330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc72c108f80 0x7fc72c19e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.695+0000 7fc730a00640 1 -- 172.21.15.37:0/3352882330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72c19f050 con 0x7fc72c108600 2024-08-20T05:01:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.696+0000 7fc730a00640 1 --2- 172.21.15.37:0/3352882330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72c108600 0x7fc72c1994e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc71800ea60 tx=0x7fc71800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.696+0000 7fc72a000640 1 -- 172.21.15.37:0/3352882330 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71800cde0 con 0x7fc72c108600 2024-08-20T05:01:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.696+0000 7fc733e00640 1 -- 172.21.15.37:0/3352882330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc72c19f340 con 0x7fc72c108600 2024-08-20T05:01:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.696+0000 7fc72a000640 1 -- 172.21.15.37:0/3352882330 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7180035f0 con 0x7fc72c108600 2024-08-20T05:01:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.696+0000 7fc733e00640 1 -- 172.21.15.37:0/3352882330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc72c1a5bd0 con 0x7fc72c108600 2024-08-20T05:01:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.697+0000 7fc72a000640 1 -- 172.21.15.37:0/3352882330 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc718005220 con 0x7fc72c108600 2024-08-20T05:01:32.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.700+0000 7fc7368b9740 1 Processor -- start 2024-08-20T05:01:32.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.701+0000 7fc7368b9740 1 -- start start 2024-08-20T05:01:32.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.701+0000 7fc7368b9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3903f10 0x562fa39042f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.701+0000 7fc7368b9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3904830 0x562fa3910280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.701+0000 7fc7368b9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa39107c0 0x562fa3912bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.701+0000 7fc7368b9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562fa387a840 con 0x562fa3904830 2024-08-20T05:01:32.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.701+0000 7fc7368b9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562fa3869d40 con 0x562fa39107c0 2024-08-20T05:01:32.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.701+0000 7fc7368b9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562fa386dd80 con 0x562fa3903f10 2024-08-20T05:01:32.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.701+0000 7fc72a000640 1 -- 172.21.15.37:0/3352882330 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc7180037a0 con 0x7fc72c108600 2024-08-20T05:01:32.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.701+0000 7fc731400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3904830 0x562fa3910280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.701+0000 7fc731e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3903f10 0x562fa39042f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.701+0000 7fc731400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3904830 0x562fa3910280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34404/0 (socket says 172.21.15.37:34404) 2024-08-20T05:01:32.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.701+0000 7fc731e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3903f10 0x562fa39042f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57066/0 (socket says 172.21.15.37:57066) 2024-08-20T05:01:32.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.701+0000 7fc731400640 1 -- 172.21.15.37:0/494903050 learned_addr learned my addr 172.21.15.37:0/494903050 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:32.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.702+0000 7fc730a00640 1 --2- 172.21.15.37:0/494903050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa39107c0 0x562fa3912bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.702+0000 7fc731e00640 1 -- 172.21.15.37:0/494903050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa39107c0 msgr2=0x562fa3912bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:32.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.702+0000 7fc731e00640 1 --2- 172.21.15.37:0/494903050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa39107c0 0x562fa3912bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.702+0000 7fc731e00640 1 -- 172.21.15.37:0/494903050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3904830 msgr2=0x562fa3910280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:32.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.702+0000 7fc731e00640 1 --2- 172.21.15.37:0/494903050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3904830 0x562fa3910280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.702+0000 7fc731e00640 1 -- 172.21.15.37:0/494903050 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fa38101c0 con 0x562fa3903f10 2024-08-20T05:01:32.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.702+0000 7fc731e00640 1 --2- 172.21.15.37:0/494903050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3903f10 0x562fa39042f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc724009b30 tx=0x7fc724030430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22fc0f1d1898dc91 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:32.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.703+0000 7fc71e600640 1 -- 172.21.15.37:0/494903050 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc724041070 con 0x562fa3903f10 2024-08-20T05:01:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.703+0000 7fc71e600640 1 -- 172.21.15.37:0/494903050 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc724003e20 con 0x562fa3903f10 2024-08-20T05:01:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.703+0000 7fc71e600640 1 -- 172.21.15.37:0/494903050 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc724036040 con 0x562fa3903f10 2024-08-20T05:01:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.703+0000 7fc72a000640 1 --2- 172.21.15.37:0/3352882330 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc7140b3bd0 0x7fc7140b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.703+0000 7fc72a000640 1 -- 172.21.15.37:0/3352882330 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc7180e4200 con 0x7fc72c108600 2024-08-20T05:01:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.703+0000 7fc7368b9740 1 -- 172.21.15.37:0/494903050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3903f10 msgr2=0x562fa39042f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.703+0000 7fc7368b9740 1 --2- 172.21.15.37:0/494903050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3903f10 0x562fa39042f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc724009b30 tx=0x7fc724030430 comp rx=0 tx=0).stop 2024-08-20T05:01:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.703+0000 7fc731400640 1 --2- 172.21.15.37:0/3352882330 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc7140b3bd0 0x7fc7140b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.704+0000 7fc7368b9740 1 -- 172.21.15.37:0/494903050 shutdown_connections 2024-08-20T05:01:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.704+0000 7fc7368b9740 1 --2- 172.21.15.37:0/494903050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa39107c0 0x562fa3912bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.704+0000 7fc7368b9740 1 --2- 172.21.15.37:0/494903050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3904830 0x562fa3910280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.704+0000 7fc7368b9740 1 --2- 172.21.15.37:0/494903050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3903f10 0x562fa39042f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.704+0000 7fc7368b9740 1 -- 172.21.15.37:0/494903050 >> 172.21.15.37:0/494903050 conn(0x562fa3901d40 msgr2=0x562fa3902ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:32.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.704+0000 7fc7368b9740 1 -- 172.21.15.37:0/494903050 shutdown_connections 2024-08-20T05:01:32.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.704+0000 7fc7368b9740 1 -- 172.21.15.37:0/494903050 wait complete. 2024-08-20T05:01:32.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.704+0000 7fc731400640 1 --2- 172.21.15.37:0/3352882330 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc7140b3bd0 0x7fc7140b6090 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x562fa3907090 tx=0x7fc720014040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:32.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.704+0000 7fc7368b9740 1 -- start start 2024-08-20T05:01:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.705+0000 7fc7368b9740 1 Processor -- start 2024-08-20T05:01:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.705+0000 7fc7368b9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3903f10 0x562fa3910020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.705+0000 7fc7368b9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3904830 0x562fa390d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.705+0000 7fc7368b9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa39107c0 0x562fa390d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.705+0000 7fc7368b9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562fa36cc5f0 con 0x562fa3903f10 2024-08-20T05:01:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.705+0000 7fc7368b9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562fa3805170 con 0x562fa39107c0 2024-08-20T05:01:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.705+0000 7fc7368b9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562fa3913410 con 0x562fa3904830 2024-08-20T05:01:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.705+0000 7fc7368b9740 10 client.0 _ll_register_callbacks cb 0x562fa38648b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:01:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.705+0000 7fc731400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3903f10 0x562fa3910020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.705+0000 7fc730a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3904830 0x562fa390d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.705+0000 7fc730a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3904830 0x562fa390d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57082/0 (socket says 172.21.15.37:57082) 2024-08-20T05:01:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.705+0000 7fc730a00640 1 -- 172.21.15.37:0/3806474961 learned_addr learned my addr 172.21.15.37:0/3806474961 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.706+0000 7fc731e00640 1 --2- 172.21.15.37:0/3806474961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa39107c0 0x562fa390d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.706+0000 7fc730a00640 1 -- 172.21.15.37:0/3806474961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa39107c0 msgr2=0x562fa390d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.706+0000 7fc730a00640 1 --2- 172.21.15.37:0/3806474961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa39107c0 0x562fa390d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.706+0000 7fc730a00640 1 -- 172.21.15.37:0/3806474961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3903f10 msgr2=0x562fa3910020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.706+0000 7fc730a00640 1 --2- 172.21.15.37:0/3806474961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3903f10 0x562fa3910020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.706+0000 7fc730a00640 1 -- 172.21.15.37:0/3806474961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fa35c9540 con 0x562fa3904830 2024-08-20T05:01:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.706+0000 7fc730a00640 1 --2- 172.21.15.37:0/3806474961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3904830 0x562fa390d470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7180a6e30 tx=0x7fc7180aac40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=701697f7764d4f43 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.706+0000 7fc712a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:01:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.706+0000 7fc712a00640 1 -- 172.21.15.37:0/3806474961 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7180ab4b0 con 0x562fa3904830 2024-08-20T05:01:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.706+0000 7fc7368b9740 1 -- 172.21.15.37:0/3806474961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc724003e20 con 0x562fa3904830 2024-08-20T05:01:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.706+0000 7fc712a00640 1 -- 172.21.15.37:0/3806474961 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc7180a73a0 con 0x562fa3904830 2024-08-20T05:01:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.707+0000 7fc712a00640 1 -- 172.21.15.37:0/3806474961 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc7180aadb0 con 0x562fa3904830 2024-08-20T05:01:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.707+0000 7fc7368b9740 10 client.25216 fetch_fsmap learned FSMap version 28 2024-08-20T05:01:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.707+0000 7fc7368b9740 1 -- 172.21.15.37:0/3806474961 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562fa391edd0 con 0x562fa3904830 2024-08-20T05:01:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.707+0000 7fc712a00640 1 -- 172.21.15.37:0/3806474961 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc724003e20 con 0x562fa3904830 2024-08-20T05:01:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.707+0000 7fc712a00640 1 -- 172.21.15.37:0/3806474961 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc7180053c0 con 0x562fa3904830 2024-08-20T05:01:32.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.707+0000 7fc7368b9740 10 client.25216 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:01:32.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.707+0000 7fc7368b9740 10 client.25216 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-20T05:01:32.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.708+0000 7fc7368b9740 20 client.25216 populate_metadata read hostname 'smithi037' 2024-08-20T05:01:32.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.708+0000 7fc7368b9740 1 --2- 172.21.15.37:0/3806474961 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562fa3921340 0x562fa39227b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.708+0000 7fc7368b9740 4 client.25216 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:01:32.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.708+0000 7fc7368b9740 1 -- 172.21.15.37:0/3806474961 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fa387c790 con 0x562fa3921340 2024-08-20T05:01:32.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.708+0000 7fc731400640 1 --2- 172.21.15.37:0/3806474961 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562fa3921340 0x562fa39227b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.709+0000 7fc731400640 1 --2- 172.21.15.37:0/3806474961 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562fa3921340 0x562fa39227b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=468c71ac42c52eae server_cookie=d1c56229244cc283 in_seq=0 out_seq=0 2024-08-20T05:01:32.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.709+0000 7fc712a00640 10 client.25216 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:01:32.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.709+0000 7fc712a00640 1 -- 172.21.15.37:0/3806474961 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562fa387c790 con 0x562fa3921340 2024-08-20T05:01:32.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.709+0000 7fc712a00640 10 client.25216 handle_command_reply: tid=0 2024-08-20T05:01:32.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.710+0000 7fc7368b9740 1 client.25216 shutdown 2024-08-20T05:01:32.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.710+0000 7fc7368b9740 1 -- 172.21.15.37:0/3806474961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3904830 msgr2=0x562fa390d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:32.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.710+0000 7fc7368b9740 1 --2- 172.21.15.37:0/3806474961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3904830 0x562fa390d470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7180a6e30 tx=0x7fc7180aac40 comp rx=0 tx=0).stop 2024-08-20T05:01:32.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.710+0000 7fc7368b9740 1 -- 172.21.15.37:0/3806474961 shutdown_connections 2024-08-20T05:01:32.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.710+0000 7fc7368b9740 1 --2- 172.21.15.37:0/3806474961 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562fa3921340 0x562fa39227b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.710+0000 7fc7368b9740 1 --2- 172.21.15.37:0/3806474961 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa39107c0 0x562fa390d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.710+0000 7fc7368b9740 1 --2- 172.21.15.37:0/3806474961 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3904830 0x562fa390d470 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.710+0000 7fc7368b9740 1 --2- 172.21.15.37:0/3806474961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3903f10 0x562fa3910020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.710+0000 7fc7368b9740 1 -- 172.21.15.37:0/3806474961 >> 172.21.15.37:0/3806474961 conn(0x562fa3901d40 msgr2=0x562fa39078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:32.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.710+0000 7fc712a00640 0 client.25216 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:01:32.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.710+0000 7fc7368b9740 1 -- 172.21.15.37:0/3806474961 shutdown_connections 2024-08-20T05:01:32.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.710+0000 7fc7368b9740 1 -- 172.21.15.37:0/3806474961 wait complete. 2024-08-20T05:01:32.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.710+0000 7fc7368b9740 20 client.25216 trim_cache size 0 max 16384 2024-08-20T05:01:32.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.729+0000 7fc7368b9740 1 Processor -- start 2024-08-20T05:01:32.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.729+0000 7fc7368b9740 1 -- start start 2024-08-20T05:01:32.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.729+0000 7fc7368b9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa3903f10 0x562fa38fce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.729+0000 7fc7368b9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3904830 0x562fa390a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.729+0000 7fc7368b9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa39107c0 0x562fa390abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.729+0000 7fc7368b9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562fa3920af0 con 0x562fa39107c0 2024-08-20T05:01:32.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.729+0000 7fc7368b9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562fa39211c0 con 0x562fa3903f10 2024-08-20T05:01:32.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.729+0000 7fc7368b9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562fa3921890 con 0x562fa3904830 2024-08-20T05:01:32.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.730+0000 7fc731e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa39107c0 0x562fa390abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.730+0000 7fc731e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa39107c0 0x562fa390abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34420/0 (socket says 172.21.15.37:34420) 2024-08-20T05:01:32.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.730+0000 7fc731e00640 1 -- 172.21.15.37:0/95550757 learned_addr learned my addr 172.21.15.37:0/95550757 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:32.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.730+0000 7fc730a00640 1 --2- 172.21.15.37:0/95550757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3904830 0x562fa390a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.730+0000 7fc731400640 1 --2- 172.21.15.37:0/95550757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa3903f10 0x562fa38fce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.730+0000 7fc731e00640 1 -- 172.21.15.37:0/95550757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3904830 msgr2=0x562fa390a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:32.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.730+0000 7fc731e00640 1 --2- 172.21.15.37:0/95550757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3904830 0x562fa390a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.730+0000 7fc731e00640 1 -- 172.21.15.37:0/95550757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa3903f10 msgr2=0x562fa38fce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:32.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.730+0000 7fc731e00640 1 --2- 172.21.15.37:0/95550757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa3903f10 0x562fa38fce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.730+0000 7fc731e00640 1 -- 172.21.15.37:0/95550757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fa39027c0 con 0x562fa39107c0 2024-08-20T05:01:32.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.730+0000 7fc731e00640 1 --2- 172.21.15.37:0/95550757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa39107c0 0x562fa390abc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc724009be0 tx=0x7fc72402a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33fc48709fff3aa4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:32.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.731+0000 7fc71dc00640 1 -- 172.21.15.37:0/95550757 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc724054070 con 0x562fa39107c0 2024-08-20T05:01:32.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.731+0000 7fc71dc00640 1 -- 172.21.15.37:0/95550757 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc724003e20 con 0x562fa39107c0 2024-08-20T05:01:32.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.731+0000 7fc71dc00640 1 -- 172.21.15.37:0/95550757 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc724036050 con 0x562fa39107c0 2024-08-20T05:01:32.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.731+0000 7fc7368b9740 1 -- 172.21.15.37:0/95550757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa39107c0 msgr2=0x562fa390abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:32.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.731+0000 7fc7368b9740 1 --2- 172.21.15.37:0/95550757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa39107c0 0x562fa390abc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc724009be0 tx=0x7fc72402a6d0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.731+0000 7fc7368b9740 1 -- 172.21.15.37:0/95550757 shutdown_connections 2024-08-20T05:01:32.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.731+0000 7fc7368b9740 1 --2- 172.21.15.37:0/95550757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa39107c0 0x562fa390abc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.731+0000 7fc7368b9740 1 --2- 172.21.15.37:0/95550757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa3904830 0x562fa390a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.731+0000 7fc7368b9740 1 --2- 172.21.15.37:0/95550757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa3903f10 0x562fa38fce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.731+0000 7fc7368b9740 1 -- 172.21.15.37:0/95550757 >> 172.21.15.37:0/95550757 conn(0x562fa3901d40 msgr2=0x562fa390bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:32.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.732+0000 7fc7368b9740 1 -- 172.21.15.37:0/95550757 shutdown_connections 2024-08-20T05:01:32.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.732+0000 7fc7368b9740 1 -- 172.21.15.37:0/95550757 wait complete. 2024-08-20T05:01:32.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.732+0000 7fc7368b9740 1 -- start start 2024-08-20T05:01:32.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.732+0000 7fc7368b9740 1 Processor -- start 2024-08-20T05:01:32.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc7368b9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3903f10 0x562fa3925d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc7368b9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa3904830 0x562fa39262a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc7368b9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa39107c0 0x562fa3989a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc7368b9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562fa3922630 con 0x562fa3903f10 2024-08-20T05:01:32.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc7368b9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562fa3921f60 con 0x562fa3904830 2024-08-20T05:01:32.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc7368b9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562fa3922d00 con 0x562fa39107c0 2024-08-20T05:01:32.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc7368b9740 10 client.0 _ll_register_callbacks cb 0x7fc718009490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:01:32.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc731400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3903f10 0x562fa3925d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc731400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3903f10 0x562fa3925d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34422/0 (socket says 172.21.15.37:34422) 2024-08-20T05:01:32.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc731400640 1 -- 172.21.15.37:0/3663811425 learned_addr learned my addr 172.21.15.37:0/3663811425 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:32.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc730a00640 1 --2- 172.21.15.37:0/3663811425 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa3904830 0x562fa39262a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc731e00640 1 --2- 172.21.15.37:0/3663811425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa39107c0 0x562fa3989a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc731400640 1 -- 172.21.15.37:0/3663811425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa39107c0 msgr2=0x562fa3989a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:32.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc731400640 1 --2- 172.21.15.37:0/3663811425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa39107c0 0x562fa3989a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc731400640 1 -- 172.21.15.37:0/3663811425 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa3904830 msgr2=0x562fa39262a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:32.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc731400640 1 --2- 172.21.15.37:0/3663811425 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa3904830 0x562fa39262a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc731400640 1 -- 172.21.15.37:0/3663811425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fa38fc1c0 con 0x562fa3903f10 2024-08-20T05:01:32.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.733+0000 7fc730a00640 1 --2- 172.21.15.37:0/3663811425 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa3904830 0x562fa39262a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:01:32.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.734+0000 7fc731400640 1 --2- 172.21.15.37:0/3663811425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3903f10 0x562fa3925d60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc720021a80 tx=0x7fc720004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb7179713ff6451 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:32.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.734+0000 7fc712a00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:01:32.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.734+0000 7fc712a00640 1 -- 172.21.15.37:0/3663811425 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc720004020 con 0x562fa3903f10 2024-08-20T05:01:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.734+0000 7fc712a00640 1 -- 172.21.15.37:0/3663811425 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc7200041c0 con 0x562fa3903f10 2024-08-20T05:01:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.734+0000 7fc7368b9740 1 -- 172.21.15.37:0/3663811425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc724003e20 con 0x562fa3903f10 2024-08-20T05:01:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.734+0000 7fc712a00640 1 -- 172.21.15.37:0/3663811425 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc72003e050 con 0x562fa3903f10 2024-08-20T05:01:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.734+0000 7fc7368b9740 10 client.15192 fetch_fsmap learned FSMap version 28 2024-08-20T05:01:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.734+0000 7fc7368b9740 1 -- 172.21.15.37:0/3663811425 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562fa398b0c0 con 0x562fa3903f10 2024-08-20T05:01:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.735+0000 7fc712a00640 1 -- 172.21.15.37:0/3663811425 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc724003e20 con 0x562fa3903f10 2024-08-20T05:01:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.735+0000 7fc712a00640 1 -- 172.21.15.37:0/3663811425 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fc72002d480 con 0x562fa3903f10 2024-08-20T05:01:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.735+0000 7fc7368b9740 10 client.15192 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:01:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.735+0000 7fc7368b9740 10 client.15192 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-20T05:01:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.735+0000 7fc7368b9740 20 client.15192 populate_metadata read hostname 'smithi037' 2024-08-20T05:01:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.735+0000 7fc7368b9740 1 --2- 172.21.15.37:0/3663811425 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562fa398fcd0 0x562fa398e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.735+0000 7fc7368b9740 4 client.15192 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T05:01:32.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.735+0000 7fc7368b9740 1 -- 172.21.15.37:0/3663811425 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "status"}) -- 0x562fa3878230 con 0x562fa398fcd0 2024-08-20T05:01:32.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.736+0000 7fc730a00640 1 --2- 172.21.15.37:0/3663811425 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562fa398fcd0 0x562fa398e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:32.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.736+0000 7fc730a00640 1 --2- 172.21.15.37:0/3663811425 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562fa398fcd0 0x562fa398e9e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7891332b276343 server_cookie=3baa2e1754c819cb in_seq=0 out_seq=0 2024-08-20T05:01:32.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.736+0000 7fc712a00640 10 client.15192 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:01:32.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.736+0000 7fc712a00640 1 -- 172.21.15.37:0/3663811425 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x562fa3878230 con 0x562fa398fcd0 2024-08-20T05:01:32.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.736+0000 7fc712a00640 10 client.15192 handle_command_reply: tid=0 2024-08-20T05:01:32.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.736+0000 7fc7368b9740 1 client.15192 shutdown 2024-08-20T05:01:32.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.736+0000 7fc7368b9740 1 -- 172.21.15.37:0/3663811425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3903f10 msgr2=0x562fa3925d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:32.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.736+0000 7fc7368b9740 1 --2- 172.21.15.37:0/3663811425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3903f10 0x562fa3925d60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc720021a80 tx=0x7fc720004730 comp rx=0 tx=0).stop 2024-08-20T05:01:32.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.737+0000 7fc7368b9740 1 -- 172.21.15.37:0/3663811425 shutdown_connections 2024-08-20T05:01:32.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.737+0000 7fc7368b9740 1 --2- 172.21.15.37:0/3663811425 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562fa398fcd0 0x562fa398e9e0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.737+0000 7fc7368b9740 1 --2- 172.21.15.37:0/3663811425 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fa39107c0 0x562fa3989a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.737+0000 7fc7368b9740 1 --2- 172.21.15.37:0/3663811425 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fa3904830 0x562fa39262a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.737+0000 7fc7368b9740 1 --2- 172.21.15.37:0/3663811425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fa3903f10 0x562fa3925d60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.737+0000 7fc7368b9740 1 -- 172.21.15.37:0/3663811425 >> 172.21.15.37:0/3663811425 conn(0x562fa3901d40 msgr2=0x562fa390bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.737+0000 7fc712a00640 0 client.15192 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:01:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.737+0000 7fc7368b9740 1 -- 172.21.15.37:0/3663811425 shutdown_connections 2024-08-20T05:01:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.737+0000 7fc7368b9740 1 -- 172.21.15.37:0/3663811425 wait complete. 2024-08-20T05:01:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.737+0000 7fc7368b9740 20 client.15192 trim_cache size 0 max 16384 2024-08-20T05:01:32.743 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:01:32.743 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T05:01:32.744 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-08-20T05:01:32.744 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24695, 2024-08-20T05:01:32.744 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-20T05:01:32.744 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-20T05:01:32.744 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-20T05:01:32.744 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 137.95828973100001, 2024-08-20T05:01:32.744 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-08-20T05:01:32.744 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 88, 2024-08-20T05:01:32.744 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 84, 2024-08-20T05:01:32.744 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 151.48033828499999 2024-08-20T05:01:32.744 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:01:32.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.737+0000 7fc733e00640 1 -- 172.21.15.37:0/3352882330 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc7140b3bd0 msgr2=0x7fc7140b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:32.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.737+0000 7fc733e00640 1 --2- 172.21.15.37:0/3352882330 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc7140b3bd0 0x7fc7140b6090 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x562fa3907090 tx=0x7fc720014040 comp rx=0 tx=0).stop 2024-08-20T05:01:32.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.737+0000 7fc733e00640 1 -- 172.21.15.37:0/3352882330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72c108600 msgr2=0x7fc72c1994e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:32.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.737+0000 7fc733e00640 1 --2- 172.21.15.37:0/3352882330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72c108600 0x7fc72c1994e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc71800ea60 tx=0x7fc71800ef20 comp rx=0 tx=0).stop 2024-08-20T05:01:32.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.738+0000 7fc733e00640 1 -- 172.21.15.37:0/3352882330 shutdown_connections 2024-08-20T05:01:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.738+0000 7fc733e00640 1 --2- 172.21.15.37:0/3352882330 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc7140b3bd0 0x7fc7140b6090 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.738+0000 7fc733e00640 1 --2- 172.21.15.37:0/3352882330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc72c108f80 0x7fc72c19e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.738+0000 7fc733e00640 1 --2- 172.21.15.37:0/3352882330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc72c108600 0x7fc72c1994e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.738+0000 7fc733e00640 1 --2- 172.21.15.37:0/3352882330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc72c101500 0x7fc72c198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.738+0000 7fc733e00640 1 -- 172.21.15.37:0/3352882330 >> 172.21.15.37:0/3352882330 conn(0x7fc72c076cc0 msgr2=0x7fc72c0ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.738+0000 7fc733e00640 1 -- 172.21.15.37:0/3352882330 shutdown_connections 2024-08-20T05:01:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:32.738+0000 7fc733e00640 1 -- 172.21.15.37:0/3352882330 wait complete. 2024-08-20T05:01:33.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:33 smithi037 ceph-mon[17265]: pgmap v380: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 895 B/s wr, 9 op/s 2024-08-20T05:01:33.599 INFO:tasks.cephadm:Setup complete, yielding 2024-08-20T05:01:33.599 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-20T05:01:33.609 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-08-20T05:01:33.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- bash -c 'ceph orch status' 2024-08-20T05:01:33.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:33 smithi135 ceph-mon[22342]: pgmap v380: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 895 B/s wr, 9 op/s 2024-08-20T05:01:33.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:33 smithi130 ceph-mon[22007]: pgmap v380: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 895 B/s wr, 9 op/s 2024-08-20T05:01:33.989 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.610+0000 7f2a15e00640 1 -- 172.21.15.37:0/4061523699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a101036e0 msgr2=0x7f2a10103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.610+0000 7f2a15e00640 1 --2- 172.21.15.37:0/4061523699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a101036e0 0x7f2a10103b60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009930 tx=0x7f29f802a420 comp rx=0 tx=0).stop 2024-08-20T05:01:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.611+0000 7f2a15e00640 1 -- 172.21.15.37:0/4061523699 shutdown_connections 2024-08-20T05:01:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.611+0000 7f2a15e00640 1 --2- 172.21.15.37:0/4061523699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a101040a0 0x7f2a1010aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.611+0000 7f2a15e00640 1 --2- 172.21.15.37:0/4061523699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a101036e0 0x7f2a10103b60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.611+0000 7f2a15e00640 1 --2- 172.21.15.37:0/4061523699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a10102580 0x7f2a10102980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.611+0000 7f2a15e00640 1 -- 172.21.15.37:0/4061523699 >> 172.21.15.37:0/4061523699 conn(0x7f2a100fde70 msgr2=0x7f2a10100290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:34.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.611+0000 7f2a15e00640 1 -- 172.21.15.37:0/4061523699 shutdown_connections 2024-08-20T05:01:34.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.611+0000 7f2a15e00640 1 -- 172.21.15.37:0/4061523699 wait complete. 2024-08-20T05:01:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.612+0000 7f2a15e00640 1 Processor -- start 2024-08-20T05:01:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.612+0000 7f2a15e00640 1 -- start start 2024-08-20T05:01:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.612+0000 7f2a15e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a10102580 0x7f2a1019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.612+0000 7f2a15e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a101036e0 0x7f2a1019b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.612+0000 7f2a15e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a101040a0 0x7f2a1019bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.612+0000 7f2a15e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1010e200 con 0x7f2a101036e0 2024-08-20T05:01:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.612+0000 7f2a15e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1010e080 con 0x7f2a101040a0 2024-08-20T05:01:34.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.612+0000 7f2a15e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1010e380 con 0x7f2a10102580 2024-08-20T05:01:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.612+0000 7f2a07e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a101036e0 0x7f2a1019b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.612+0000 7f2a07e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a101036e0 0x7f2a1019b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59018/0 (socket says 172.21.15.37:59018) 2024-08-20T05:01:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.612+0000 7f2a07e00640 1 -- 172.21.15.37:0/302399157 learned_addr learned my addr 172.21.15.37:0/302399157 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.612+0000 7f2a14a00640 1 --2- 172.21.15.37:0/302399157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a10102580 0x7f2a1019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.613+0000 7f2a15400640 1 --2- 172.21.15.37:0/302399157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a101040a0 0x7f2a1019bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.613+0000 7f2a07e00640 1 -- 172.21.15.37:0/302399157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a10102580 msgr2=0x7f2a1019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.613+0000 7f2a07e00640 1 --2- 172.21.15.37:0/302399157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a10102580 0x7f2a1019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.613+0000 7f2a07e00640 1 -- 172.21.15.37:0/302399157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a101040a0 msgr2=0x7f2a1019bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.613+0000 7f2a07e00640 1 --2- 172.21.15.37:0/302399157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a101040a0 0x7f2a1019bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.613+0000 7f2a07e00640 1 -- 172.21.15.37:0/302399157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1019c580 con 0x7f2a101036e0 2024-08-20T05:01:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.613+0000 7f2a07e00640 1 --2- 172.21.15.37:0/302399157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a101036e0 0x7f2a1019b0a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f29f8005ab0 tx=0x7f29f80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.614+0000 7f2a0e000640 1 -- 172.21.15.37:0/302399157 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f803f030 con 0x7f2a101036e0 2024-08-20T05:01:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.614+0000 7f2a0e000640 1 -- 172.21.15.37:0/302399157 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29f8032e40 con 0x7f2a101036e0 2024-08-20T05:01:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.614+0000 7f2a15e00640 1 -- 172.21.15.37:0/302399157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a1019c810 con 0x7f2a101036e0 2024-08-20T05:01:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.614+0000 7f2a0e000640 1 -- 172.21.15.37:0/302399157 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f8035070 con 0x7f2a101036e0 2024-08-20T05:01:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.614+0000 7f2a15e00640 1 -- 172.21.15.37:0/302399157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a101a2f50 con 0x7f2a101036e0 2024-08-20T05:01:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.615+0000 7f2a15e00640 1 -- 172.21.15.37:0/302399157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a10102980 con 0x7f2a101036e0 2024-08-20T05:01:34.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.617+0000 7f2a0e000640 1 -- 172.21.15.37:0/302399157 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f29f8042030 con 0x7f2a101036e0 2024-08-20T05:01:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.618+0000 7f2a0e000640 1 --2- 172.21.15.37:0/302399157 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f29f40b3cf0 0x7f29f40b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.618+0000 7f2a0e000640 1 -- 172.21.15.37:0/302399157 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f29f81043d0 con 0x7f2a101036e0 2024-08-20T05:01:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.619+0000 7f2a14a00640 1 --2- 172.21.15.37:0/302399157 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f29f40b3cf0 0x7f29f40b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:34.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.619+0000 7f2a14a00640 1 --2- 172.21.15.37:0/302399157 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f29f40b3cf0 0x7f29f40b61b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009bd0 tx=0x7f2a00005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:34.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.622+0000 7f2a0e000640 1 -- 172.21.15.37:0/302399157 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f29f80cafd0 con 0x7f2a101036e0 2024-08-20T05:01:34.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.832+0000 7f2a15e00640 1 -- 172.21.15.37:0/302399157 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f2a100767d0 con 0x7f29f40b3cf0 2024-08-20T05:01:34.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.834+0000 7f2a0e000640 1 -- 172.21.15.37:0/302399157 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f2a100767d0 con 0x7f29f40b3cf0 2024-08-20T05:01:34.836 INFO:teuthology.orchestra.run.smithi037.stdout:Backend: cephadm 2024-08-20T05:01:34.836 INFO:teuthology.orchestra.run.smithi037.stdout:Available: Yes 2024-08-20T05:01:34.836 INFO:teuthology.orchestra.run.smithi037.stdout:Paused: No 2024-08-20T05:01:34.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.836+0000 7f2a15e00640 1 -- 172.21.15.37:0/302399157 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f29f40b3cf0 msgr2=0x7f29f40b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:34.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.836+0000 7f2a15e00640 1 --2- 172.21.15.37:0/302399157 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f29f40b3cf0 0x7f29f40b61b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009bd0 tx=0x7f2a00005f90 comp rx=0 tx=0).stop 2024-08-20T05:01:34.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.836+0000 7f2a15e00640 1 -- 172.21.15.37:0/302399157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a101036e0 msgr2=0x7f2a1019b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:34.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.836+0000 7f2a15e00640 1 --2- 172.21.15.37:0/302399157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a101036e0 0x7f2a1019b0a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f29f8005ab0 tx=0x7f29f80042f0 comp rx=0 tx=0).stop 2024-08-20T05:01:34.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.837+0000 7f2a15e00640 1 -- 172.21.15.37:0/302399157 shutdown_connections 2024-08-20T05:01:34.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.837+0000 7f2a15e00640 1 --2- 172.21.15.37:0/302399157 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f29f40b3cf0 0x7f29f40b61b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:34.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.837+0000 7f2a15e00640 1 --2- 172.21.15.37:0/302399157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2a101040a0 0x7f2a1019bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:34.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.837+0000 7f2a15e00640 1 --2- 172.21.15.37:0/302399157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a101036e0 0x7f2a1019b0a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:34.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.837+0000 7f2a15e00640 1 --2- 172.21.15.37:0/302399157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2a10102580 0x7f2a1019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:34.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.837+0000 7f2a15e00640 1 -- 172.21.15.37:0/302399157 >> 172.21.15.37:0/302399157 conn(0x7f2a100fde70 msgr2=0x7f2a100750b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:34.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.837+0000 7f2a15e00640 1 -- 172.21.15.37:0/302399157 shutdown_connections 2024-08-20T05:01:34.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:34.837+0000 7f2a15e00640 1 -- 172.21.15.37:0/302399157 wait complete. 2024-08-20T05:01:35.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:35 smithi037 ceph-mon[17265]: pgmap v381: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 895 B/s wr, 12 op/s; 13 B/s, 0 objects/s recovering 2024-08-20T05:01:35.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-20T05:01:35.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:35 smithi135 ceph-mon[22342]: pgmap v381: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 895 B/s wr, 12 op/s; 13 B/s, 0 objects/s recovering 2024-08-20T05:01:35.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:35 smithi130 ceph-mon[22007]: pgmap v381: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 895 B/s wr, 12 op/s; 13 B/s, 0 objects/s recovering 2024-08-20T05:01:35.970 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:36.447 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:36 smithi037 ceph-mon[17265]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:01:36.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.560+0000 7fb715400640 1 -- 172.21.15.37:0/3649704775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb710102720 msgr2=0x7fb710102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:36.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.560+0000 7fb715400640 1 --2- 172.21.15.37:0/3649704775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb710102720 0x7fb710102b20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb700009930 tx=0x7fb70002a420 comp rx=0 tx=0).stop 2024-08-20T05:01:36.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.560+0000 7fb715400640 1 -- 172.21.15.37:0/3649704775 shutdown_connections 2024-08-20T05:01:36.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.560+0000 7fb715400640 1 --2- 172.21.15.37:0/3649704775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb710104240 0x7fb71010abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:36.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.560+0000 7fb715400640 1 --2- 172.21.15.37:0/3649704775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb710103880 0x7fb710103d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:36.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.560+0000 7fb715400640 1 --2- 172.21.15.37:0/3649704775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb710102720 0x7fb710102b20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:36.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.560+0000 7fb715400640 1 -- 172.21.15.37:0/3649704775 >> 172.21.15.37:0/3649704775 conn(0x7fb7100fdff0 msgr2=0x7fb710100430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:36.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.560+0000 7fb715400640 1 -- 172.21.15.37:0/3649704775 shutdown_connections 2024-08-20T05:01:36.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.560+0000 7fb715400640 1 -- 172.21.15.37:0/3649704775 wait complete. 2024-08-20T05:01:36.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.561+0000 7fb715400640 1 Processor -- start 2024-08-20T05:01:36.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.561+0000 7fb715400640 1 -- start start 2024-08-20T05:01:36.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.562+0000 7fb715400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb710102720 0x7fb71019ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:36.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.562+0000 7fb715400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb710103880 0x7fb71019b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:36.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.562+0000 7fb715400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb710104240 0x7fb71019c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:36.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.562+0000 7fb715400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb71010e3a0 con 0x7fb710103880 2024-08-20T05:01:36.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.562+0000 7fb715400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb71010e220 con 0x7fb710102720 2024-08-20T05:01:36.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.562+0000 7fb715400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb71010e520 con 0x7fb710104240 2024-08-20T05:01:36.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.562+0000 7fb70e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb710102720 0x7fb71019ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:36.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.562+0000 7fb707e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb710103880 0x7fb71019b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:36.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.562+0000 7fb70e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb710102720 0x7fb71019ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:58042/0 (socket says 172.21.15.37:58042) 2024-08-20T05:01:36.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.562+0000 7fb70e800640 1 -- 172.21.15.37:0/1607286158 learned_addr learned my addr 172.21.15.37:0/1607286158 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:36.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.562+0000 7fb70f200640 1 --2- 172.21.15.37:0/1607286158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb710104240 0x7fb71019c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:36.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.563+0000 7fb70e800640 1 -- 172.21.15.37:0/1607286158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb710104240 msgr2=0x7fb71019c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:36.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.563+0000 7fb70e800640 1 --2- 172.21.15.37:0/1607286158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb710104240 0x7fb71019c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:36.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.563+0000 7fb70e800640 1 -- 172.21.15.37:0/1607286158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb710103880 msgr2=0x7fb71019b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:36.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.563+0000 7fb70e800640 1 --2- 172.21.15.37:0/1607286158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb710103880 0x7fb71019b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:36.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.563+0000 7fb70e800640 1 -- 172.21.15.37:0/1607286158 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71019c8d0 con 0x7fb710102720 2024-08-20T05:01:36.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.563+0000 7fb70e800640 1 --2- 172.21.15.37:0/1607286158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb710102720 0x7fb71019ada0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb700009230 tx=0x7fb7000042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:36.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.563+0000 7fb707400640 1 -- 172.21.15.37:0/1607286158 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70003f030 con 0x7fb710102720 2024-08-20T05:01:36.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.563+0000 7fb707400640 1 -- 172.21.15.37:0/1607286158 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb700032e40 con 0x7fb710102720 2024-08-20T05:01:36.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.563+0000 7fb707400640 1 -- 172.21.15.37:0/1607286158 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb700035070 con 0x7fb710102720 2024-08-20T05:01:36.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.563+0000 7fb715400640 1 -- 172.21.15.37:0/1607286158 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb71019cb60 con 0x7fb710102720 2024-08-20T05:01:36.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.564+0000 7fb715400640 1 -- 172.21.15.37:0/1607286158 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7101a30d0 con 0x7fb710102720 2024-08-20T05:01:36.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.565+0000 7fb715400640 1 -- 172.21.15.37:0/1607286158 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7101a33f0 con 0x7fb710102720 2024-08-20T05:01:36.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.568+0000 7fb707400640 1 -- 172.21.15.37:0/1607286158 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb700042030 con 0x7fb710102720 2024-08-20T05:01:36.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.569+0000 7fb707400640 1 --2- 172.21.15.37:0/1607286158 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb6f40b3bd0 0x7fb6f40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:36.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.569+0000 7fb707400640 1 -- 172.21.15.37:0/1607286158 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb700104980 con 0x7fb710102720 2024-08-20T05:01:36.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.569+0000 7fb707e00640 1 --2- 172.21.15.37:0/1607286158 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb6f40b3bd0 0x7fb6f40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:36.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.570+0000 7fb707400640 1 -- 172.21.15.37:0/1607286158 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fb700049070 con 0x7fb710102720 2024-08-20T05:01:36.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.570+0000 7fb707e00640 1 --2- 172.21.15.37:0/1607286158 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb6f40b3bd0 0x7fb6f40b6090 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009bd0 tx=0x7fb6f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:36.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:36 smithi135 ceph-mon[22342]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:01:36.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:36 smithi130 ceph-mon[22007]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:01:36.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.778+0000 7fb715400640 1 -- 172.21.15.37:0/1607286158 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb710109720 con 0x7fb6f40b3bd0 2024-08-20T05:01:36.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.793+0000 7fb707400640 1 -- 172.21.15.37:0/1607286158 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7fb710109720 con 0x7fb6f40b3bd0 2024-08-20T05:01:36.796 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-20T05:01:36.796 INFO:teuthology.orchestra.run.smithi037.stdout:mds.a smithi037 running (2m) 18s ago 2m 16.9M - 19.0.0-5872-gef427541 9f5c88d94bb6 078ff38624cc 2024-08-20T05:01:36.796 INFO:teuthology.orchestra.run.smithi037.stdout:mds.b smithi130 running (2m) 20s ago 2m 26.7M - 19.0.0-5872-gef427541 9f5c88d94bb6 27e70f1225f7 2024-08-20T05:01:36.796 INFO:teuthology.orchestra.run.smithi037.stdout:mds.c smithi135 running (2m) 20s ago 2m 18.6M - 19.0.0-5872-gef427541 9f5c88d94bb6 7d337573f9e8 2024-08-20T05:01:36.796 INFO:teuthology.orchestra.run.smithi037.stdout:mds.d smithi037 running (3m) 18s ago 3m 13.4M - 19.0.0-5872-gef427541 9f5c88d94bb6 79c4bb61dcc3 2024-08-20T05:01:36.796 INFO:teuthology.orchestra.run.smithi037.stdout:mds.e smithi130 running (2m) 20s ago 2m 19.9M - 19.0.0-5872-gef427541 9f5c88d94bb6 010ddc9a7d93 2024-08-20T05:01:36.796 INFO:teuthology.orchestra.run.smithi037.stdout:mds.f smithi135 running (2m) 20s ago 2m 19.1M - 19.0.0-5872-gef427541 9f5c88d94bb6 43e6161555a8 2024-08-20T05:01:36.796 INFO:teuthology.orchestra.run.smithi037.stdout:mds.g smithi037 running (2m) 18s ago 2m 16.9M - 19.0.0-5872-gef427541 9f5c88d94bb6 43fba314613e 2024-08-20T05:01:36.796 INFO:teuthology.orchestra.run.smithi037.stdout:mds.h smithi130 running (2m) 20s ago 2m 21.6M - 19.0.0-5872-gef427541 9f5c88d94bb6 0e6a1f28ebce 2024-08-20T05:01:36.797 INFO:teuthology.orchestra.run.smithi037.stdout:mds.i smithi135 running (2m) 20s ago 2m 21.3M - 19.0.0-5872-gef427541 9f5c88d94bb6 dbda39241ba2 2024-08-20T05:01:36.797 INFO:teuthology.orchestra.run.smithi037.stdout:mds.j smithi037 running (3m) 18s ago 3m 13.4M - 19.0.0-5872-gef427541 9f5c88d94bb6 ee4ea35400ec 2024-08-20T05:01:36.797 INFO:teuthology.orchestra.run.smithi037.stdout:mds.k smithi130 running (3m) 20s ago 3m 18.7M - 19.0.0-5872-gef427541 9f5c88d94bb6 410859f184b5 2024-08-20T05:01:36.797 INFO:teuthology.orchestra.run.smithi037.stdout:mds.l smithi135 running (3m) 20s ago 3m 17.9M - 19.0.0-5872-gef427541 9f5c88d94bb6 189e6b2e677f 2024-08-20T05:01:36.797 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.x smithi037 *:9283,8765 running (11m) 18s ago 10m 523M - 19.0.0-5872-gef427541 9f5c88d94bb6 92646408c94e 2024-08-20T05:01:36.797 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.y smithi130 *:8443,8765 running (8m) 20s ago 8m 456M - 19.0.0-5872-gef427541 9f5c88d94bb6 48a8abbaf7de 2024-08-20T05:01:36.797 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.z smithi135 *:8443,8765 running (9m) 20s ago 9m 454M - 19.0.0-5872-gef427541 9f5c88d94bb6 c8c410a818f9 2024-08-20T05:01:36.797 INFO:teuthology.orchestra.run.smithi037.stdout:mon.a smithi037 running (11m) 18s ago 11m 52.6M 2048M 19.0.0-5872-gef427541 9f5c88d94bb6 e1ebf7073663 2024-08-20T05:01:36.797 INFO:teuthology.orchestra.run.smithi037.stdout:mon.b smithi130 running (9m) 20s ago 9m 43.4M 2048M 19.0.0-5872-gef427541 9f5c88d94bb6 543875a034e5 2024-08-20T05:01:36.797 INFO:teuthology.orchestra.run.smithi037.stdout:mon.c smithi135 running (9m) 20s ago 9m 45.7M 2048M 19.0.0-5872-gef427541 9f5c88d94bb6 cdd2b1e22e07 2024-08-20T05:01:36.797 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (8m) 18s ago 8m 51.8M 4273M 19.0.0-5872-gef427541 9f5c88d94bb6 1a3d02ce37ff 2024-08-20T05:01:36.797 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi130 running (7m) 20s ago 7m 48.3M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 25d9e12a70f6 2024-08-20T05:01:36.798 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi135 running (7m) 20s ago 7m 57.5M 1453M 19.0.0-5872-gef427541 9f5c88d94bb6 aa1d36194c8f 2024-08-20T05:01:36.798 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi037 running (7m) 18s ago 7m 43.7M 4273M 19.0.0-5872-gef427541 9f5c88d94bb6 0b316fc2cac2 2024-08-20T05:01:36.798 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi130 running (6m) 20s ago 6m 44.2M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 0c14b874ef1d 2024-08-20T05:01:36.798 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi135 running (6m) 20s ago 6m 46.3M 1453M 19.0.0-5872-gef427541 9f5c88d94bb6 d5019682a409 2024-08-20T05:01:36.798 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6 smithi037 running (5m) 18s ago 5m 51.4M 4273M 19.0.0-5872-gef427541 9f5c88d94bb6 afdb0c3b91ea 2024-08-20T05:01:36.798 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7 smithi130 running (5m) 20s ago 5m 45.6M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 762a8d823c79 2024-08-20T05:01:36.798 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8 smithi135 running (4m) 20s ago 4m 52.0M 1453M 19.0.0-5872-gef427541 9f5c88d94bb6 fd65d2f158b1 2024-08-20T05:01:36.798 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9 smithi037 running (4m) 18s ago 4m 50.0M 4273M 19.0.0-5872-gef427541 9f5c88d94bb6 513deaa5df74 2024-08-20T05:01:36.798 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10 smithi130 running (3m) 20s ago 3m 45.7M 4272M 19.0.0-5872-gef427541 9f5c88d94bb6 54bcfe4d330e 2024-08-20T05:01:36.798 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11 smithi135 running (3m) 20s ago 3m 42.5M 1453M 19.0.0-5872-gef427541 9f5c88d94bb6 2e21c453d48c 2024-08-20T05:01:36.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.797+0000 7fb715400640 1 -- 172.21.15.37:0/1607286158 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb6f40b3bd0 msgr2=0x7fb6f40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:36.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.797+0000 7fb715400640 1 --2- 172.21.15.37:0/1607286158 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb6f40b3bd0 0x7fb6f40b6090 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009bd0 tx=0x7fb6f8005f90 comp rx=0 tx=0).stop 2024-08-20T05:01:36.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.797+0000 7fb715400640 1 -- 172.21.15.37:0/1607286158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb710102720 msgr2=0x7fb71019ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:36.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.797+0000 7fb715400640 1 --2- 172.21.15.37:0/1607286158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb710102720 0x7fb71019ada0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb700009230 tx=0x7fb7000042f0 comp rx=0 tx=0).stop 2024-08-20T05:01:36.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.797+0000 7fb715400640 1 -- 172.21.15.37:0/1607286158 shutdown_connections 2024-08-20T05:01:36.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.797+0000 7fb715400640 1 --2- 172.21.15.37:0/1607286158 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb6f40b3bd0 0x7fb6f40b6090 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:36.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.797+0000 7fb715400640 1 --2- 172.21.15.37:0/1607286158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb710104240 0x7fb71019c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:36.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.797+0000 7fb715400640 1 --2- 172.21.15.37:0/1607286158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb710103880 0x7fb71019b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:36.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.797+0000 7fb715400640 1 --2- 172.21.15.37:0/1607286158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb710102720 0x7fb71019ada0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:36.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.797+0000 7fb715400640 1 -- 172.21.15.37:0/1607286158 >> 172.21.15.37:0/1607286158 conn(0x7fb7100fdff0 msgr2=0x7fb710109010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:36.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.797+0000 7fb715400640 1 -- 172.21.15.37:0/1607286158 shutdown_connections 2024-08-20T05:01:36.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:36.797+0000 7fb715400640 1 -- 172.21.15.37:0/1607286158 wait complete. 2024-08-20T05:01:37.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:37 smithi037 ceph-mon[17265]: pgmap v382: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 895 B/s wr, 12 op/s; 13 B/s, 0 objects/s recovering 2024-08-20T05:01:37.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:37 smithi135 ceph-mon[22342]: pgmap v382: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 895 B/s wr, 12 op/s; 13 B/s, 0 objects/s recovering 2024-08-20T05:01:37.655 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-20T05:01:37.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:37 smithi130 ceph-mon[22007]: pgmap v382: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 895 B/s wr, 12 op/s; 13 B/s, 0 objects/s recovering 2024-08-20T05:01:38.043 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:38.435 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:38 smithi037 ceph-mon[17265]: from='client.25226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:01:38.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:38 smithi135 ceph-mon[22342]: from='client.25226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:01:38.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.694+0000 7f42f2a00640 1 -- 172.21.15.37:0/3426150311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ec102730 msgr2=0x7f42ec102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:38.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.694+0000 7f42f2a00640 1 --2- 172.21.15.37:0/3426150311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ec102730 0x7f42ec102b30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009930 tx=0x7f42dc02a420 comp rx=0 tx=0).stop 2024-08-20T05:01:38.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.694+0000 7f42f2a00640 1 -- 172.21.15.37:0/3426150311 shutdown_connections 2024-08-20T05:01:38.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.694+0000 7f42f2a00640 1 --2- 172.21.15.37:0/3426150311 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42ec104250 0x7f42ec10abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:38.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.694+0000 7f42f2a00640 1 --2- 172.21.15.37:0/3426150311 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec103890 0x7f42ec103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:38.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.694+0000 7f42f2a00640 1 --2- 172.21.15.37:0/3426150311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ec102730 0x7f42ec102b30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:38.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.694+0000 7f42f2a00640 1 -- 172.21.15.37:0/3426150311 >> 172.21.15.37:0/3426150311 conn(0x7f42ec0fe020 msgr2=0x7f42ec100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:38.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.694+0000 7f42f2a00640 1 -- 172.21.15.37:0/3426150311 shutdown_connections 2024-08-20T05:01:38.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.694+0000 7f42f2a00640 1 -- 172.21.15.37:0/3426150311 wait complete. 2024-08-20T05:01:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.695+0000 7f42f2a00640 1 Processor -- start 2024-08-20T05:01:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.695+0000 7f42f2a00640 1 -- start start 2024-08-20T05:01:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.695+0000 7f42f2a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42ec102730 0x7f42ec19ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.695+0000 7f42f2a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ec103890 0x7f42ec19b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.695+0000 7f42f2a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec104250 0x7f42ec19bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.695+0000 7f42f2a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec10e3e0 con 0x7f42ec103890 2024-08-20T05:01:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.695+0000 7f42f2a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec10e260 con 0x7f42ec102730 2024-08-20T05:01:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.695+0000 7f42f2a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f42ec10e560 con 0x7f42ec104250 2024-08-20T05:01:38.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.696+0000 7f42e3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ec103890 0x7f42ec19b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:38.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.696+0000 7f42e3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ec103890 0x7f42ec19b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59058/0 (socket says 172.21.15.37:59058) 2024-08-20T05:01:38.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.696+0000 7f42ebe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42ec102730 0x7f42ec19ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:38.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.696+0000 7f42e3400640 1 -- 172.21.15.37:0/1308562738 learned_addr learned my addr 172.21.15.37:0/1308562738 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:38.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.696+0000 7f42f0a00640 1 --2- 172.21.15.37:0/1308562738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec104250 0x7f42ec19bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:38.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.696+0000 7f42e3400640 1 -- 172.21.15.37:0/1308562738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec104250 msgr2=0x7f42ec19bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:38.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.696+0000 7f42e3400640 1 --2- 172.21.15.37:0/1308562738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec104250 0x7f42ec19bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:38.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.696+0000 7f42e3400640 1 -- 172.21.15.37:0/1308562738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42ec102730 msgr2=0x7f42ec19ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:38.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.696+0000 7f42e3400640 1 --2- 172.21.15.37:0/1308562738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42ec102730 0x7f42ec19ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:38.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.696+0000 7f42e3400640 1 -- 172.21.15.37:0/1308562738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ec19c870 con 0x7f42ec103890 2024-08-20T05:01:38.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.697+0000 7f42e3400640 1 --2- 172.21.15.37:0/1308562738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ec103890 0x7f42ec19b390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f42d400e9f0 tx=0x7f42d400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:38.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.697+0000 7f42e9600640 1 -- 172.21.15.37:0/1308562738 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d400ccc0 con 0x7f42ec103890 2024-08-20T05:01:38.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.697+0000 7f42e9600640 1 -- 172.21.15.37:0/1308562738 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42d40108e0 con 0x7f42ec103890 2024-08-20T05:01:38.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.697+0000 7f42e9600640 1 -- 172.21.15.37:0/1308562738 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4018880 con 0x7f42ec103890 2024-08-20T05:01:38.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.697+0000 7f42f2a00640 1 -- 172.21.15.37:0/1308562738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ec19cb60 con 0x7f42ec103890 2024-08-20T05:01:38.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.697+0000 7f42f2a00640 1 -- 172.21.15.37:0/1308562738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ec1a3240 con 0x7f42ec103890 2024-08-20T05:01:38.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.698+0000 7f42f2a00640 1 -- 172.21.15.37:0/1308562738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42ec102b30 con 0x7f42ec103890 2024-08-20T05:01:38.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.700+0000 7f42e9600640 1 -- 172.21.15.37:0/1308562738 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f42d4010430 con 0x7f42ec103890 2024-08-20T05:01:38.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.702+0000 7f42e9600640 1 --2- 172.21.15.37:0/1308562738 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42d00b3c50 0x7f42d00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:38.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.702+0000 7f42e9600640 1 -- 172.21.15.37:0/1308562738 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f42d40e47e0 con 0x7f42ec103890 2024-08-20T05:01:38.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.702+0000 7f42ebe00640 1 --2- 172.21.15.37:0/1308562738 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42d00b3c50 0x7f42d00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:38.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.703+0000 7f42ebe00640 1 --2- 172.21.15.37:0/1308562738 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42d00b3c50 0x7f42d00b6110 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009900 tx=0x7f42dc031450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:38.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:38 smithi130 ceph-mon[22007]: from='client.25226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:01:38.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.703+0000 7f42e9600640 1 -- 172.21.15.37:0/1308562738 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f42d40aba30 con 0x7f42ec103890 2024-08-20T05:01:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.905+0000 7f42f2a00640 1 -- 172.21.15.37:0/1308562738 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f42ec1096c0 con 0x7f42d00b3c50 2024-08-20T05:01:38.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.911+0000 7f42e9600640 1 -- 172.21.15.37:0/1308562738 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f42ec1096c0 con 0x7f42d00b3c50 2024-08-20T05:01:38.913 INFO:teuthology.orchestra.run.smithi037.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-20T05:01:38.913 INFO:teuthology.orchestra.run.smithi037.stdout:mds.all 12/12 23s ago 3m smithi037=a;smithi037=d;smithi037=g;smithi037=j;smithi130=b;smithi130=e;smithi130=h;smithi130=k;smithi135=c;smithi135=f;smithi135=i;smithi135=l;count:12 2024-08-20T05:01:38.914 INFO:teuthology.orchestra.run.smithi037.stdout:mgr 3/3 23s ago 9m smithi037=x;smithi130=y;smithi135=z;count:3 2024-08-20T05:01:38.914 INFO:teuthology.orchestra.run.smithi037.stdout:mon 3/3 23s ago 9m smithi037:172.21.15.37=a;smithi130:172.21.15.130=b;smithi135:172.21.15.135=c;count:3 2024-08-20T05:01:38.914 INFO:teuthology.orchestra.run.smithi037.stdout:osd 12 23s ago - 2024-08-20T05:01:38.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.913+0000 7f42f2a00640 1 -- 172.21.15.37:0/1308562738 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42d00b3c50 msgr2=0x7f42d00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:38.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.913+0000 7f42f2a00640 1 --2- 172.21.15.37:0/1308562738 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42d00b3c50 0x7f42d00b6110 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009900 tx=0x7f42dc031450 comp rx=0 tx=0).stop 2024-08-20T05:01:38.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.914+0000 7f42f2a00640 1 -- 172.21.15.37:0/1308562738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ec103890 msgr2=0x7f42ec19b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:38.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.914+0000 7f42f2a00640 1 --2- 172.21.15.37:0/1308562738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ec103890 0x7f42ec19b390 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f42d400e9f0 tx=0x7f42d400edf0 comp rx=0 tx=0).stop 2024-08-20T05:01:38.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.914+0000 7f42f2a00640 1 -- 172.21.15.37:0/1308562738 shutdown_connections 2024-08-20T05:01:38.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.914+0000 7f42f2a00640 1 --2- 172.21.15.37:0/1308562738 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42d00b3c50 0x7f42d00b6110 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:38.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.914+0000 7f42f2a00640 1 --2- 172.21.15.37:0/1308562738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f42ec104250 0x7f42ec19bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:38.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.914+0000 7f42f2a00640 1 --2- 172.21.15.37:0/1308562738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42ec103890 0x7f42ec19b390 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:38.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.914+0000 7f42f2a00640 1 --2- 172.21.15.37:0/1308562738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f42ec102730 0x7f42ec19ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:38.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.914+0000 7f42f2a00640 1 -- 172.21.15.37:0/1308562738 >> 172.21.15.37:0/1308562738 conn(0x7f42ec0fe020 msgr2=0x7f42ec108fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:38.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.914+0000 7f42f2a00640 1 -- 172.21.15.37:0/1308562738 shutdown_connections 2024-08-20T05:01:38.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:38.914+0000 7f42f2a00640 1 -- 172.21.15.37:0/1308562738 wait complete. 2024-08-20T05:01:39.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:39 smithi037 ceph-mon[17265]: pgmap v383: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 235 B/s wr, 8 op/s; 12 B/s, 0 objects/s recovering 2024-08-20T05:01:39.595 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-20T05:01:39.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:39 smithi135 ceph-mon[22342]: pgmap v383: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 235 B/s wr, 8 op/s; 12 B/s, 0 objects/s recovering 2024-08-20T05:01:39.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:39 smithi130 ceph-mon[22007]: pgmap v383: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 235 B/s wr, 8 op/s; 12 B/s, 0 objects/s recovering 2024-08-20T05:01:39.977 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.586+0000 7ffba6e00640 1 -- 172.21.15.37:0/616091747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba01082c0 msgr2=0x7ffba010a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.586+0000 7ffba6e00640 1 --2- 172.21.15.37:0/616091747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba01082c0 0x7ffba010a780 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ffb98009ca0 tx=0x7ffb9802a8c0 comp rx=0 tx=0).stop 2024-08-20T05:01:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.586+0000 7ffba6e00640 1 -- 172.21.15.37:0/616091747 shutdown_connections 2024-08-20T05:01:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.586+0000 7ffba6e00640 1 --2- 172.21.15.37:0/616091747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba01082c0 0x7ffba010a780 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.586+0000 7ffba6e00640 1 --2- 172.21.15.37:0/616091747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffba0105710 0x7ffba0107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.586+0000 7ffba6e00640 1 --2- 172.21.15.37:0/616091747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffba006b3e0 0x7ffba0105180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.586+0000 7ffba6e00640 1 -- 172.21.15.37:0/616091747 >> 172.21.15.37:0/616091747 conn(0x7ffba00fcd50 msgr2=0x7ffba00ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.586+0000 7ffba6e00640 1 -- 172.21.15.37:0/616091747 shutdown_connections 2024-08-20T05:01:40.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.586+0000 7ffba6e00640 1 -- 172.21.15.37:0/616091747 wait complete. 2024-08-20T05:01:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.587+0000 7ffba6e00640 1 Processor -- start 2024-08-20T05:01:40.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.587+0000 7ffba6e00640 1 -- start start 2024-08-20T05:01:40.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.587+0000 7ffba6e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffba006b3e0 0x7ffba01028b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:40.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.587+0000 7ffba6e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba0105710 0x7ffba0101120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:40.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.587+0000 7ffba6e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffba01082c0 0x7ffba0101660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:40.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.587+0000 7ffba6e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffba010e280 con 0x7ffba0105710 2024-08-20T05:01:40.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.587+0000 7ffba6e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffba010e100 con 0x7ffba01082c0 2024-08-20T05:01:40.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.587+0000 7ffba6e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffba010e400 con 0x7ffba006b3e0 2024-08-20T05:01:40.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.588+0000 7ffba5000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba0105710 0x7ffba0101120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:40.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.588+0000 7ffba5000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba0105710 0x7ffba0101120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59076/0 (socket says 172.21.15.37:59076) 2024-08-20T05:01:40.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.588+0000 7ffba5a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffba006b3e0 0x7ffba01028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:40.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.588+0000 7ffba5000640 1 -- 172.21.15.37:0/2610501067 learned_addr learned my addr 172.21.15.37:0/2610501067 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:40.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.588+0000 7ffba6400640 1 --2- 172.21.15.37:0/2610501067 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffba01082c0 0x7ffba0101660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:40.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.588+0000 7ffba5000640 1 -- 172.21.15.37:0/2610501067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffba006b3e0 msgr2=0x7ffba01028b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:40.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.588+0000 7ffba5000640 1 --2- 172.21.15.37:0/2610501067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffba006b3e0 0x7ffba01028b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:40.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.588+0000 7ffba5000640 1 -- 172.21.15.37:0/2610501067 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffba01082c0 msgr2=0x7ffba0101660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:40.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.588+0000 7ffba5000640 1 --2- 172.21.15.37:0/2610501067 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffba01082c0 0x7ffba0101660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:40.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.588+0000 7ffba5000640 1 -- 172.21.15.37:0/2610501067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffba0101f20 con 0x7ffba0105710 2024-08-20T05:01:40.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.588+0000 7ffba5a00640 1 --2- 172.21.15.37:0/2610501067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffba006b3e0 0x7ffba01028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:40.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.588+0000 7ffba6400640 1 --2- 172.21.15.37:0/2610501067 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffba01082c0 0x7ffba0101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:01:40.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.589+0000 7ffba5000640 1 --2- 172.21.15.37:0/2610501067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba0105710 0x7ffba0101120 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00d770 tx=0x7ffb8c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:40.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.589+0000 7ffb9e000640 1 -- 172.21.15.37:0/2610501067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c017070 con 0x7ffba0105710 2024-08-20T05:01:40.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.589+0000 7ffba6e00640 1 -- 172.21.15.37:0/2610501067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffba01a2950 con 0x7ffba0105710 2024-08-20T05:01:40.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.589+0000 7ffb9e000640 1 -- 172.21.15.37:0/2610501067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb8c009c30 con 0x7ffba0105710 2024-08-20T05:01:40.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.589+0000 7ffb9e000640 1 -- 172.21.15.37:0/2610501067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb8c00f620 con 0x7ffba0105710 2024-08-20T05:01:40.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.589+0000 7ffba6e00640 1 -- 172.21.15.37:0/2610501067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffba01a2eb0 con 0x7ffba0105710 2024-08-20T05:01:40.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.590+0000 7ffba6e00640 1 -- 172.21.15.37:0/2610501067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffba00fe840 con 0x7ffba0105710 2024-08-20T05:01:40.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.592+0000 7ffb9e000640 1 -- 172.21.15.37:0/2610501067 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ffb8c01a070 con 0x7ffba0105710 2024-08-20T05:01:40.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.595+0000 7ffb9e000640 1 --2- 172.21.15.37:0/2610501067 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ffb880b3cf0 0x7ffb880b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:40.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.595+0000 7ffb9e000640 1 -- 172.21.15.37:0/2610501067 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ffb8c0e3a60 con 0x7ffba0105710 2024-08-20T05:01:40.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.595+0000 7ffba5a00640 1 --2- 172.21.15.37:0/2610501067 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ffb880b3cf0 0x7ffb880b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:40.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.596+0000 7ffba5a00640 1 --2- 172.21.15.37:0/2610501067 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ffb880b3cf0 0x7ffb880b61b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffb94005fd0 tx=0x7ffb9400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:40.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.597+0000 7ffb9e000640 1 -- 172.21.15.37:0/2610501067 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ffb8c009de0 con 0x7ffba0105710 2024-08-20T05:01:40.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:40 smithi130 ceph-mon[22007]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:01:40.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:40 smithi037 ceph-mon[17265]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:01:40.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.797+0000 7ffba6e00640 1 -- 172.21.15.37:0/2610501067 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7ffba00632c0 con 0x7ffb880b3cf0 2024-08-20T05:01:40.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.799+0000 7ffb9e000640 1 -- 172.21.15.37:0/2610501067 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7ffba00632c0 con 0x7ffb880b3cf0 2024-08-20T05:01:40.801 INFO:teuthology.orchestra.run.smithi037.stdout:HOST ADDR LABELS STATUS 2024-08-20T05:01:40.801 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037 172.21.15.37 2024-08-20T05:01:40.801 INFO:teuthology.orchestra.run.smithi037.stdout:smithi130 172.21.15.130 2024-08-20T05:01:40.801 INFO:teuthology.orchestra.run.smithi037.stdout:smithi135 172.21.15.135 2024-08-20T05:01:40.801 INFO:teuthology.orchestra.run.smithi037.stdout:3 hosts in cluster 2024-08-20T05:01:40.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.801+0000 7ffba6e00640 1 -- 172.21.15.37:0/2610501067 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ffb880b3cf0 msgr2=0x7ffb880b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:40.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.801+0000 7ffba6e00640 1 --2- 172.21.15.37:0/2610501067 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ffb880b3cf0 0x7ffb880b61b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffb94005fd0 tx=0x7ffb9400b390 comp rx=0 tx=0).stop 2024-08-20T05:01:40.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.801+0000 7ffba6e00640 1 -- 172.21.15.37:0/2610501067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba0105710 msgr2=0x7ffba0101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:40.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.801+0000 7ffba6e00640 1 --2- 172.21.15.37:0/2610501067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba0105710 0x7ffba0101120 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c00d770 tx=0x7ffb8c00dc30 comp rx=0 tx=0).stop 2024-08-20T05:01:40.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.801+0000 7ffba6e00640 1 -- 172.21.15.37:0/2610501067 shutdown_connections 2024-08-20T05:01:40.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.801+0000 7ffba6e00640 1 --2- 172.21.15.37:0/2610501067 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ffb880b3cf0 0x7ffb880b61b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:40.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.801+0000 7ffba6e00640 1 --2- 172.21.15.37:0/2610501067 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffba01082c0 0x7ffba0101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:40.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.801+0000 7ffba6e00640 1 --2- 172.21.15.37:0/2610501067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffba0105710 0x7ffba0101120 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:40.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.801+0000 7ffba6e00640 1 --2- 172.21.15.37:0/2610501067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffba006b3e0 0x7ffba01028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:40.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.801+0000 7ffba6e00640 1 -- 172.21.15.37:0/2610501067 >> 172.21.15.37:0/2610501067 conn(0x7ffba00fcd50 msgr2=0x7ffba0103990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:40.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.801+0000 7ffba6e00640 1 -- 172.21.15.37:0/2610501067 shutdown_connections 2024-08-20T05:01:40.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:40.801+0000 7ffba6e00640 1 -- 172.21.15.37:0/2610501067 wait complete. 2024-08-20T05:01:40.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:40 smithi135 ceph-mon[22342]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:01:41.509 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:41 smithi037 ceph-mon[17265]: pgmap v384: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 10 op/s; 11 B/s, 0 objects/s recovering 2024-08-20T05:01:41.549 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-20T05:01:41.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:41 smithi130 ceph-mon[22007]: pgmap v384: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 10 op/s; 11 B/s, 0 objects/s recovering 2024-08-20T05:01:41.767 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:41 smithi135 ceph-mon[22342]: pgmap v384: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 102 B/s wr, 10 op/s; 11 B/s, 0 objects/s recovering 2024-08-20T05:01:41.931 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:42.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.495+0000 7f9f54a00640 1 -- 172.21.15.37:0/4236607070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f501058f0 msgr2=0x7f9f50105d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:42.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.495+0000 7f9f54a00640 1 --2- 172.21.15.37:0/4236607070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f501058f0 0x7f9f50105d70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009930 tx=0x7f9f3802a440 comp rx=0 tx=0).stop 2024-08-20T05:01:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.495+0000 7f9f54a00640 1 -- 172.21.15.37:0/4236607070 shutdown_connections 2024-08-20T05:01:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.495+0000 7f9f54a00640 1 --2- 172.21.15.37:0/4236607070 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f501062b0 0x7f9f5010cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.495+0000 7f9f54a00640 1 --2- 172.21.15.37:0/4236607070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f501058f0 0x7f9f50105d70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.495+0000 7f9f54a00640 1 --2- 172.21.15.37:0/4236607070 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f50104790 0x7f9f50104b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.495+0000 7f9f54a00640 1 -- 172.21.15.37:0/4236607070 >> 172.21.15.37:0/4236607070 conn(0x7f9f501000a0 msgr2=0x7f9f501024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.495+0000 7f9f54a00640 1 -- 172.21.15.37:0/4236607070 shutdown_connections 2024-08-20T05:01:42.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.495+0000 7f9f54a00640 1 -- 172.21.15.37:0/4236607070 wait complete. 2024-08-20T05:01:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.496+0000 7f9f54a00640 1 Processor -- start 2024-08-20T05:01:42.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.496+0000 7f9f54a00640 1 -- start start 2024-08-20T05:01:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.497+0000 7f9f54a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f50104790 0x7f9f5019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.497+0000 7f9f54a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f501058f0 0x7f9f5019b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.497+0000 7f9f54a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f501062b0 0x7f9f5019bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.497+0000 7f9f54a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9f50110440 con 0x7f9f501058f0 2024-08-20T05:01:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.497+0000 7f9f54a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9f501102c0 con 0x7f9f50104790 2024-08-20T05:01:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.497+0000 7f9f54a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9f501105c0 con 0x7f9f501062b0 2024-08-20T05:01:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.497+0000 7f9f46a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f501058f0 0x7f9f5019b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.497+0000 7f9f4f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f50104790 0x7f9f5019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.497+0000 7f9f46a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f501058f0 0x7f9f5019b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59088/0 (socket says 172.21.15.37:59088) 2024-08-20T05:01:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.497+0000 7f9f46a00640 1 -- 172.21.15.37:0/3928707831 learned_addr learned my addr 172.21.15.37:0/3928707831 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.497+0000 7f9f4fe00640 1 --2- 172.21.15.37:0/3928707831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f501062b0 0x7f9f5019bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:42.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.497+0000 7f9f46a00640 1 -- 172.21.15.37:0/3928707831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f501062b0 msgr2=0x7f9f5019bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:42.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.497+0000 7f9f46a00640 1 --2- 172.21.15.37:0/3928707831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f501062b0 0x7f9f5019bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:42.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.498+0000 7f9f46a00640 1 -- 172.21.15.37:0/3928707831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f50104790 msgr2=0x7f9f5019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:42.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.498+0000 7f9f46a00640 1 --2- 172.21.15.37:0/3928707831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f50104790 0x7f9f5019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:42.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.498+0000 7f9f46a00640 1 -- 172.21.15.37:0/3928707831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f5019c580 con 0x7f9f501058f0 2024-08-20T05:01:42.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.498+0000 7f9f4f400640 1 --2- 172.21.15.37:0/3928707831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f50104790 0x7f9f5019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:42.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.498+0000 7f9f4fe00640 1 --2- 172.21.15.37:0/3928707831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f501062b0 0x7f9f5019bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:42.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.498+0000 7f9f46a00640 1 --2- 172.21.15.37:0/3928707831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f501058f0 0x7f9f5019b0a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9f38031490 tx=0x7f9f38003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:42.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.498+0000 7f9f4cc00640 1 -- 172.21.15.37:0/3928707831 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3803f070 con 0x7f9f501058f0 2024-08-20T05:01:42.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.498+0000 7f9f4cc00640 1 -- 172.21.15.37:0/3928707831 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f38031bf0 con 0x7f9f501058f0 2024-08-20T05:01:42.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.498+0000 7f9f54a00640 1 -- 172.21.15.37:0/3928707831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f5019c810 con 0x7f9f501058f0 2024-08-20T05:01:42.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.498+0000 7f9f4cc00640 1 -- 172.21.15.37:0/3928707831 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f38035030 con 0x7f9f501058f0 2024-08-20T05:01:42.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.498+0000 7f9f54a00640 1 -- 172.21.15.37:0/3928707831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f501a2f50 con 0x7f9f501058f0 2024-08-20T05:01:42.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.500+0000 7f9f54a00640 1 -- 172.21.15.37:0/3928707831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f50104b90 con 0x7f9f501058f0 2024-08-20T05:01:42.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.502+0000 7f9f4cc00640 1 -- 172.21.15.37:0/3928707831 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9f38042070 con 0x7f9f501058f0 2024-08-20T05:01:42.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.503+0000 7f9f4cc00640 1 --2- 172.21.15.37:0/3928707831 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f340b3cf0 0x7f9f340b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:42.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.503+0000 7f9f4cc00640 1 -- 172.21.15.37:0/3928707831 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9f38104630 con 0x7f9f501058f0 2024-08-20T05:01:42.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.503+0000 7f9f4f400640 1 --2- 172.21.15.37:0/3928707831 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f340b3cf0 0x7f9f340b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:42.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.504+0000 7f9f4f400640 1 --2- 172.21.15.37:0/3928707831 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f340b3cf0 0x7f9f340b61b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009fc0 tx=0x7f9f40005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.507+0000 7f9f4cc00640 1 -- 172.21.15.37:0/3928707831 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f9f38031da0 con 0x7f9f501058f0 2024-08-20T05:01:42.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:42 smithi130 ceph-mon[22007]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:01:42.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.708+0000 7f9f54a00640 1 -- 172.21.15.37:0/3928707831 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f9f500632c0 con 0x7f9f340b3cf0 2024-08-20T05:01:42.711 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:42 smithi037 ceph-mon[17265]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:01:42.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.710+0000 7f9f4cc00640 1 -- 172.21.15.37:0/3928707831 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f9f500632c0 con 0x7f9f340b3cf0 2024-08-20T05:01:42.712 INFO:teuthology.orchestra.run.smithi037.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-20T05:01:42.712 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331005T400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-08-20T05:01:42.712 INFO:teuthology.orchestra.run.smithi037.stdout:smithi130 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500Q1400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-08-20T05:01:42.712 INFO:teuthology.orchestra.run.smithi037.stdout:smithi135 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620401BA400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-08-20T05:01:42.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.712+0000 7f9f54a00640 1 -- 172.21.15.37:0/3928707831 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f340b3cf0 msgr2=0x7f9f340b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:42.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.712+0000 7f9f54a00640 1 --2- 172.21.15.37:0/3928707831 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f340b3cf0 0x7f9f340b61b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009fc0 tx=0x7f9f40005f90 comp rx=0 tx=0).stop 2024-08-20T05:01:42.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.712+0000 7f9f54a00640 1 -- 172.21.15.37:0/3928707831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f501058f0 msgr2=0x7f9f5019b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:42.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.712+0000 7f9f54a00640 1 --2- 172.21.15.37:0/3928707831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f501058f0 0x7f9f5019b0a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9f38031490 tx=0x7f9f38003c10 comp rx=0 tx=0).stop 2024-08-20T05:01:42.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.713+0000 7f9f54a00640 1 -- 172.21.15.37:0/3928707831 shutdown_connections 2024-08-20T05:01:42.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.713+0000 7f9f54a00640 1 --2- 172.21.15.37:0/3928707831 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f340b3cf0 0x7f9f340b61b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:42.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.713+0000 7f9f54a00640 1 --2- 172.21.15.37:0/3928707831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f501062b0 0x7f9f5019bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:42.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.713+0000 7f9f54a00640 1 --2- 172.21.15.37:0/3928707831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f501058f0 0x7f9f5019b0a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:42.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.713+0000 7f9f54a00640 1 --2- 172.21.15.37:0/3928707831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f50104790 0x7f9f5019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:42.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.713+0000 7f9f54a00640 1 -- 172.21.15.37:0/3928707831 >> 172.21.15.37:0/3928707831 conn(0x7f9f501000a0 msgr2=0x7f9f50108c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:42.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.713+0000 7f9f54a00640 1 -- 172.21.15.37:0/3928707831 shutdown_connections 2024-08-20T05:01:42.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:42.713+0000 7f9f54a00640 1 -- 172.21.15.37:0/3928707831 wait complete. 2024-08-20T05:01:42.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:42 smithi135 ceph-mon[22342]: from='client.15216 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:01:43.531 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-20T05:01:43.539 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-08-20T05:01:43.540 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-20T05:01:43.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:43 smithi130 ceph-mon[22007]: pgmap v385: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 87 B/s wr, 9 op/s; 9 B/s, 0 objects/s recovering 2024-08-20T05:01:43.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:43 smithi130 ceph-mon[22007]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:01:43.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:43 smithi037 ceph-mon[17265]: pgmap v385: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 87 B/s wr, 9 op/s; 9 B/s, 0 objects/s recovering 2024-08-20T05:01:43.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:43 smithi037 ceph-mon[17265]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:01:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:43 smithi135 ceph-mon[22342]: pgmap v385: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 87 B/s wr, 9 op/s; 9 B/s, 0 objects/s recovering 2024-08-20T05:01:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:43 smithi135 ceph-mon[22342]: from='client.15222 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-20T05:01:43.917 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.517+0000 7f72ca200640 1 -- 172.21.15.37:0/1175619703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72c4108450 msgr2=0x7f72c410a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.517+0000 7f72ca200640 1 --2- 172.21.15.37:0/1175619703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72c4108450 0x7f72c410a910 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f72bc009ca0 tx=0x7f72bc02a8c0 comp rx=0 tx=0).stop 2024-08-20T05:01:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.517+0000 7f72ca200640 1 -- 172.21.15.37:0/1175619703 shutdown_connections 2024-08-20T05:01:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.517+0000 7f72ca200640 1 --2- 172.21.15.37:0/1175619703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72c4108450 0x7f72c410a910 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.517+0000 7f72ca200640 1 --2- 172.21.15.37:0/1175619703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72c41058a0 0x7f72c4107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.517+0000 7f72ca200640 1 --2- 172.21.15.37:0/1175619703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c406be40 0x7f72c4105310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.517+0000 7f72ca200640 1 -- 172.21.15.37:0/1175619703 >> 172.21.15.37:0/1175619703 conn(0x7f72c40fcf00 msgr2=0x7f72c40ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.517+0000 7f72ca200640 1 -- 172.21.15.37:0/1175619703 shutdown_connections 2024-08-20T05:01:44.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.517+0000 7f72ca200640 1 -- 172.21.15.37:0/1175619703 wait complete. 2024-08-20T05:01:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.518+0000 7f72ca200640 1 Processor -- start 2024-08-20T05:01:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.518+0000 7f72ca200640 1 -- start start 2024-08-20T05:01:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.518+0000 7f72ca200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72c406be40 0x7f72c419acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.518+0000 7f72ca200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72c41058a0 0x7f72c419b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.518+0000 7f72ca200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4108450 0x7f72c419bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.518+0000 7f72ca200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f72c410e3a0 con 0x7f72c41058a0 2024-08-20T05:01:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.518+0000 7f72ca200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f72c410e220 con 0x7f72c4108450 2024-08-20T05:01:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.518+0000 7f72ca200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f72c410e520 con 0x7f72c406be40 2024-08-20T05:01:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.519+0000 7f72baa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72c41058a0 0x7f72c419b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.519+0000 7f72baa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72c41058a0 0x7f72c419b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53556/0 (socket says 172.21.15.37:53556) 2024-08-20T05:01:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.519+0000 7f72baa00640 1 -- 172.21.15.37:0/885860314 learned_addr learned my addr 172.21.15.37:0/885860314 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.519+0000 7f72c3e00640 1 --2- 172.21.15.37:0/885860314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4108450 0x7f72c419bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.519+0000 7f72c3400640 1 --2- 172.21.15.37:0/885860314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72c406be40 0x7f72c419acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.519+0000 7f72baa00640 1 -- 172.21.15.37:0/885860314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72c406be40 msgr2=0x7f72c419acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.519+0000 7f72baa00640 1 --2- 172.21.15.37:0/885860314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72c406be40 0x7f72c419acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.519+0000 7f72baa00640 1 -- 172.21.15.37:0/885860314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4108450 msgr2=0x7f72c419bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.519+0000 7f72baa00640 1 --2- 172.21.15.37:0/885860314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4108450 0x7f72c419bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.519+0000 7f72baa00640 1 -- 172.21.15.37:0/885860314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c419c800 con 0x7f72c41058a0 2024-08-20T05:01:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.519+0000 7f72c3400640 1 --2- 172.21.15.37:0/885860314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72c406be40 0x7f72c419acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.519+0000 7f72baa00640 1 --2- 172.21.15.37:0/885860314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72c41058a0 0x7f72c419b320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00e9a0 tx=0x7f72ac00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.520+0000 7f72c0c00640 1 -- 172.21.15.37:0/885860314 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac00cd80 con 0x7f72c41058a0 2024-08-20T05:01:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.520+0000 7f72c0c00640 1 -- 172.21.15.37:0/885860314 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72ac0035f0 con 0x7f72c41058a0 2024-08-20T05:01:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.520+0000 7f72ca200640 1 -- 172.21.15.37:0/885860314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c419caf0 con 0x7f72c41058a0 2024-08-20T05:01:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.520+0000 7f72c0c00640 1 -- 172.21.15.37:0/885860314 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72ac010690 con 0x7f72c41058a0 2024-08-20T05:01:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.520+0000 7f72ca200640 1 -- 172.21.15.37:0/885860314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c41a31d0 con 0x7f72c41058a0 2024-08-20T05:01:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.521+0000 7f72ca200640 1 -- 172.21.15.37:0/885860314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c41a3400 con 0x7f72c41058a0 2024-08-20T05:01:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.523+0000 7f72c0c00640 1 -- 172.21.15.37:0/885860314 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f72ac004000 con 0x7f72c41058a0 2024-08-20T05:01:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.524+0000 7f72c0c00640 1 --2- 172.21.15.37:0/885860314 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72a80b3c50 0x7f72a80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.525+0000 7f72c0c00640 1 -- 172.21.15.37:0/885860314 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f72ac0e4290 con 0x7f72c41058a0 2024-08-20T05:01:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.525+0000 7f72c3400640 1 --2- 172.21.15.37:0/885860314 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72a80b3c50 0x7f72a80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.526+0000 7f72c3400640 1 --2- 172.21.15.37:0/885860314 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72a80b3c50 0x7f72a80b6110 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009fc0 tx=0x7f72b4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.526+0000 7f72c0c00640 1 -- 172.21.15.37:0/885860314 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f72ac0042f0 con 0x7f72c41058a0 2024-08-20T05:01:44.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.757+0000 7f72ca200640 1 -- 172.21.15.37:0/885860314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f72c41a35d0 con 0x7f72c41058a0 2024-08-20T05:01:44.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.758+0000 7f72c0c00640 1 -- 172.21.15.37:0/885860314 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3134 (secure 0 0 0) 0x7f72ac0ab570 con 0x7f72c41058a0 2024-08-20T05:01:44.760 INFO:teuthology.orchestra.run.smithi037.stdout:e28 2024-08-20T05:01:44.760 INFO:teuthology.orchestra.run.smithi037.stdout:btime 2024-08-20T05:00:06:145262+0000 2024-08-20T05:01:44.760 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-20T05:01:44.761 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-20T05:01:44.761 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-08-20T05:01:44.761 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:01:44.761 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-08-20T05:01:44.761 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-08-20T05:01:44.761 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 28 2024-08-20T05:01:44.761 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-20T05:01:44.761 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-08-20T04:59:13.823062+0000 2024-08-20T05:01:44.761 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-08-20T05:00:06.145248+0000 2024-08-20T05:01:44.761 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-08-20T05:01:44.761 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-08-20T05:01:44.761 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 300 2024-08-20T05:01:44.762 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-08-20T05:01:44.762 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-08-20T05:01:44.762 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-08-20T05:01:44.762 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-08-20T05:01:44.762 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-08-20T05:01:44.762 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-08-20T05:01:44.762 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-20T05:01:44.762 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 5 2024-08-20T05:01:44.762 INFO:teuthology.orchestra.run.smithi037.stdout:in 0,1,2,3,4 2024-08-20T05:01:44.762 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=24695,1=24664,2=24656,3=24649,4=24637} 2024-08-20T05:01:44.762 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-08-20T05:01:44.762 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-08-20T05:01:44.763 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-08-20T05:01:44.763 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3,4] 2024-08-20T05:01:44.763 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-08-20T05:01:44.763 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-08-20T05:01:44.763 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-08-20T05:01:44.763 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-08-20T05:01:44.763 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 0 2024-08-20T05:01:44.763 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 24695 members: 24664,24695,24656,24649,24637 2024-08-20T05:01:44.763 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b{0:24695} state up:active seq 5 addr [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T05:01:44.763 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.e{0:24626} state up:standby-replay seq 1 addr [v2:172.21.15.130:6834/538714148,v1:172.21.15.130:6835/538714148] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T05:01:44.764 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.i{1:24664} state up:active seq 20 addr [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T05:01:44.764 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.l{1:24592} state up:standby-replay seq 1 addr [v2:172.21.15.135:6832/4059666386,v1:172.21.15.135:6833/4059666386] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T05:01:44.764 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.h{2:24656} state up:active seq 21 addr [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T05:01:44.764 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.k{2:24590} state up:standby-replay seq 1 addr [v2:172.21.15.130:6832/1818782678,v1:172.21.15.130:6833/1818782678] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T05:01:44.764 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c{3:24649} state up:active seq 22 addr [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T05:01:44.764 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a{3:14664} state up:standby-replay seq 1 addr [v2:172.21.15.37:6840/466077750,v1:172.21.15.37:6841/466077750] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T05:01:44.764 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.f{4:24637} state up:active seq 22 addr [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T05:01:44.764 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.g{4:14652} state up:standby-replay seq 1 addr [v2:172.21.15.37:6838/1587848243,v1:172.21.15.37:6839/1587848243] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T05:01:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:01:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:01:44.764 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-08-20T05:01:44.764 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:01:44.764 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.j{-1:14604} state up:standby seq 1 addr [v2:172.21.15.37:6834/2131006297,v1:172.21.15.37:6835/2131006297] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T05:01:44.764 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d{-1:14616} state up:standby seq 1 addr [v2:172.21.15.37:6836/3652581224,v1:172.21.15.37:6837/3652581224] compat {c=[1],r=[1],i=[1fff]}] 2024-08-20T05:01:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-08-20T05:01:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.760+0000 7f72ca200640 1 -- 172.21.15.37:0/885860314 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72a80b3c50 msgr2=0x7f72a80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.760+0000 7f72ca200640 1 --2- 172.21.15.37:0/885860314 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72a80b3c50 0x7f72a80b6110 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f72b4009fc0 tx=0x7f72b4005f90 comp rx=0 tx=0).stop 2024-08-20T05:01:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.760+0000 7f72ca200640 1 -- 172.21.15.37:0/885860314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72c41058a0 msgr2=0x7f72c419b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.760+0000 7f72ca200640 1 --2- 172.21.15.37:0/885860314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72c41058a0 0x7f72c419b320 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00e9a0 tx=0x7f72ac00ee60 comp rx=0 tx=0).stop 2024-08-20T05:01:44.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.760+0000 7f72ca200640 1 -- 172.21.15.37:0/885860314 shutdown_connections 2024-08-20T05:01:44.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.760+0000 7f72ca200640 1 --2- 172.21.15.37:0/885860314 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f72a80b3c50 0x7f72a80b6110 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:44.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.760+0000 7f72ca200640 1 --2- 172.21.15.37:0/885860314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f72c4108450 0x7f72c419bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:44.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.760+0000 7f72ca200640 1 --2- 172.21.15.37:0/885860314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72c41058a0 0x7f72c419b320 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:44.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.760+0000 7f72ca200640 1 --2- 172.21.15.37:0/885860314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f72c406be40 0x7f72c419acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:44.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.760+0000 7f72ca200640 1 -- 172.21.15.37:0/885860314 >> 172.21.15.37:0/885860314 conn(0x7f72c40fcf00 msgr2=0x7f72c40ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:44.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.761+0000 7f72ca200640 1 -- 172.21.15.37:0/885860314 shutdown_connections 2024-08-20T05:01:44.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:44.761+0000 7f72ca200640 1 -- 172.21.15.37:0/885860314 wait complete. 2024-08-20T05:01:45.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:45 smithi037 ceph-mon[17265]: pgmap v386: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 0 B/s wr, 11 op/s; 9 B/s, 0 objects/s recovering 2024-08-20T05:01:45.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:45 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/885860314' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-20T05:01:45.554 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- bash -c 'ceph osd dump' 2024-08-20T05:01:45.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:45 smithi130 ceph-mon[22007]: pgmap v386: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 0 B/s wr, 11 op/s; 9 B/s, 0 objects/s recovering 2024-08-20T05:01:45.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:45 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/885860314' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-20T05:01:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:45 smithi135 ceph-mon[22342]: pgmap v386: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 0 B/s wr, 11 op/s; 9 B/s, 0 objects/s recovering 2024-08-20T05:01:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:45 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/885860314' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-08-20T05:01:45.938 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:46.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.532+0000 7f5809400640 1 -- 172.21.15.37:0/3840807071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5804104250 msgr2=0x7f580410abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:46.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.532+0000 7f5809400640 1 --2- 172.21.15.37:0/3840807071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5804104250 0x7f580410abd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f57fc009cd0 tx=0x7f57fc02a8e0 comp rx=0 tx=0).stop 2024-08-20T05:01:46.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.533+0000 7f5809400640 1 -- 172.21.15.37:0/3840807071 shutdown_connections 2024-08-20T05:01:46.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.533+0000 7f5809400640 1 --2- 172.21.15.37:0/3840807071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5804104250 0x7f580410abd0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:46.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.533+0000 7f5809400640 1 --2- 172.21.15.37:0/3840807071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5804103890 0x7f5804103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:46.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.533+0000 7f5809400640 1 --2- 172.21.15.37:0/3840807071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5804102730 0x7f5804102b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:46.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.533+0000 7f5809400640 1 -- 172.21.15.37:0/3840807071 >> 172.21.15.37:0/3840807071 conn(0x7f58040fe020 msgr2=0x7f5804100440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:46.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.533+0000 7f5809400640 1 -- 172.21.15.37:0/3840807071 shutdown_connections 2024-08-20T05:01:46.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.533+0000 7f5809400640 1 -- 172.21.15.37:0/3840807071 wait complete. 2024-08-20T05:01:46.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.534+0000 7f5809400640 1 Processor -- start 2024-08-20T05:01:46.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.534+0000 7f5809400640 1 -- start start 2024-08-20T05:01:46.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.534+0000 7f5809400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5804102730 0x7f580419ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.534+0000 7f5809400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5804103890 0x7f580419b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.534+0000 7f5809400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5804104250 0x7f580419bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.534+0000 7f5809400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f580410e400 con 0x7f5804103890 2024-08-20T05:01:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.534+0000 7f5809400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f580410e280 con 0x7f5804102730 2024-08-20T05:01:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.534+0000 7f5809400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f580410e580 con 0x7f5804104250 2024-08-20T05:01:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.534+0000 7f57fbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5804103890 0x7f580419b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.535+0000 7f57fbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5804103890 0x7f580419b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53566/0 (socket says 172.21.15.37:53566) 2024-08-20T05:01:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.535+0000 7f5802800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5804102730 0x7f580419ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.535+0000 7f57fbe00640 1 -- 172.21.15.37:0/2325036752 learned_addr learned my addr 172.21.15.37:0/2325036752 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.535+0000 7f5803200640 1 --2- 172.21.15.37:0/2325036752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5804104250 0x7f580419bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:46.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.535+0000 7f57fbe00640 1 -- 172.21.15.37:0/2325036752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5804104250 msgr2=0x7f580419bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.535+0000 7f57fbe00640 1 --2- 172.21.15.37:0/2325036752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5804104250 0x7f580419bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.535+0000 7f57fbe00640 1 -- 172.21.15.37:0/2325036752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5804102730 msgr2=0x7f580419ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.535+0000 7f57fbe00640 1 --2- 172.21.15.37:0/2325036752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5804102730 0x7f580419ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.535+0000 7f57fbe00640 1 -- 172.21.15.37:0/2325036752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580419c7c0 con 0x7f5804103890 2024-08-20T05:01:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.535+0000 7f5802800640 1 --2- 172.21.15.37:0/2325036752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5804102730 0x7f580419ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.535+0000 7f57fbe00640 1 --2- 172.21.15.37:0/2325036752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5804103890 0x7f580419b2e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00d950 tx=0x7f57ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.536+0000 7f57fb400640 1 -- 172.21.15.37:0/2325036752 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec017030 con 0x7f5804103890 2024-08-20T05:01:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.536+0000 7f57fb400640 1 -- 172.21.15.37:0/2325036752 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57ec004020 con 0x7f5804103890 2024-08-20T05:01:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.536+0000 7f57fb400640 1 -- 172.21.15.37:0/2325036752 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57ec0047a0 con 0x7f5804103890 2024-08-20T05:01:46.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.536+0000 7f5809400640 1 -- 172.21.15.37:0/2325036752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f580419cab0 con 0x7f5804103890 2024-08-20T05:01:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.536+0000 7f5809400640 1 -- 172.21.15.37:0/2325036752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58041a3190 con 0x7f5804103890 2024-08-20T05:01:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.537+0000 7f5809400640 1 -- 172.21.15.37:0/2325036752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5804102b30 con 0x7f5804103890 2024-08-20T05:01:46.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.539+0000 7f57fb400640 1 -- 172.21.15.37:0/2325036752 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f57ec009a30 con 0x7f5804103890 2024-08-20T05:01:46.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.541+0000 7f57fb400640 1 --2- 172.21.15.37:0/2325036752 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57e80b3c50 0x7f57e80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:46.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.542+0000 7f57fb400640 1 -- 172.21.15.37:0/2325036752 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f57ec0e3940 con 0x7f5804103890 2024-08-20T05:01:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.542+0000 7f5802800640 1 --2- 172.21.15.37:0/2325036752 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57e80b3c50 0x7f57e80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.542+0000 7f5802800640 1 --2- 172.21.15.37:0/2325036752 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57e80b3c50 0x7f57e80b6110 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009fc0 tx=0x7f57f4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:46.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.545+0000 7f57fb400640 1 -- 172.21.15.37:0/2325036752 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f57ec0aab90 con 0x7f5804103890 2024-08-20T05:01:46.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.741+0000 7f5809400640 1 -- 172.21.15.37:0/2325036752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f58041a3ab0 con 0x7f5804103890 2024-08-20T05:01:46.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.742+0000 7f57fb400640 1 -- 172.21.15.37:0/2325036752 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v88) ==== 56+0+5660 (secure 0 0 0) 0x7f57ec0aa490 con 0x7f5804103890 2024-08-20T05:01:46.745 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 88 2024-08-20T05:01:46.745 INFO:teuthology.orchestra.run.smithi037.stdout:fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T05:01:46.745 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-08-20T04:50:26.520303+0000 2024-08-20T05:01:46.745 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-08-20T05:01:30.328315+0000 2024-08-20T05:01:46.745 INFO:teuthology.orchestra.run.smithi037.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-08-20T05:01:46.745 INFO:teuthology.orchestra.run.smithi037.stdout:crush_version 27 2024-08-20T05:01:46.745 INFO:teuthology.orchestra.run.smithi037.stdout:full_ratio 0.95 2024-08-20T05:01:46.745 INFO:teuthology.orchestra.run.smithi037.stdout:backfillfull_ratio 0.9 2024-08-20T05:01:46.746 INFO:teuthology.orchestra.run.smithi037.stdout:nearfull_ratio 0.85 2024-08-20T05:01:46.746 INFO:teuthology.orchestra.run.smithi037.stdout:require_min_compat_client luminous 2024-08-20T05:01:46.746 INFO:teuthology.orchestra.run.smithi037.stdout:min_compat_client luminous 2024-08-20T05:01:46.746 INFO:teuthology.orchestra.run.smithi037.stdout:require_osd_release squid 2024-08-20T05:01:46.746 INFO:teuthology.orchestra.run.smithi037.stdout:stretch_mode_enabled false 2024-08-20T05:01:46.746 INFO:teuthology.orchestra.run.smithi037.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-08-20T05:01:46.746 INFO:teuthology.orchestra.run.smithi037.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-08-20T05:01:46.746 INFO:teuthology.orchestra.run.smithi037.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 77 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-08-20T05:01:46.746 INFO:teuthology.orchestra.run.smithi037.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-08-20T05:01:46.747 INFO:teuthology.orchestra.run.smithi037.stdout:max_osd 12 2024-08-20T05:01:46.747 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 up in weight 1 up_from 8 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6802/3569936373,v1:172.21.15.37:6803/3569936373] [v2:172.21.15.37:6804/3569936373,v1:172.21.15.37:6805/3569936373] exists,up a813e53b-68b3-43ff-a59b-aed00e98f2fd 2024-08-20T05:01:46.747 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 up in weight 1 up_from 13 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6800/4206461125,v1:172.21.15.130:6801/4206461125] [v2:172.21.15.130:6802/4206461125,v1:172.21.15.130:6803/4206461125] exists,up c216a8d0-9685-467a-8161-700682ce617c 2024-08-20T05:01:46.747 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 up in weight 1 up_from 18 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6800/2653255199,v1:172.21.15.135:6801/2653255199] [v2:172.21.15.135:6802/2653255199,v1:172.21.15.135:6803/2653255199] exists,up 34402442-c652-40eb-865e-a607a28846b2 2024-08-20T05:01:46.747 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 up in weight 1 up_from 25 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6810/2601290990,v1:172.21.15.37:6811/2601290990] [v2:172.21.15.37:6812/2601290990,v1:172.21.15.37:6813/2601290990] exists,up ec7be9dc-96b5-4816-9065-8121baedcdc5 2024-08-20T05:01:46.747 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 up in weight 1 up_from 31 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6808/3542081474,v1:172.21.15.130:6809/3542081474] [v2:172.21.15.130:6810/3542081474,v1:172.21.15.130:6811/3542081474] exists,up 2dbd47f9-8686-4707-8862-3c7a99a37d73 2024-08-20T05:01:46.747 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 up in weight 1 up_from 36 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6808/2507249148,v1:172.21.15.135:6809/2507249148] [v2:172.21.15.135:6810/2507249148,v1:172.21.15.135:6811/2507249148] exists,up 9a07a137-d6b7-4aba-8678-4fd164597f27 2024-08-20T05:01:46.747 INFO:teuthology.orchestra.run.smithi037.stdout:osd.6 up in weight 1 up_from 42 up_thru 80 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6818/155932692,v1:172.21.15.37:6819/155932692] [v2:172.21.15.37:6820/155932692,v1:172.21.15.37:6821/155932692] exists,up 6d6346e8-5418-4c30-9bb3-5af352b616a9 2024-08-20T05:01:46.747 INFO:teuthology.orchestra.run.smithi037.stdout:osd.7 up in weight 1 up_from 47 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6816/4148130245,v1:172.21.15.130:6817/4148130245] [v2:172.21.15.130:6818/4148130245,v1:172.21.15.130:6819/4148130245] exists,up c87804c2-d456-495e-b36e-33dbb3548347 2024-08-20T05:01:46.748 INFO:teuthology.orchestra.run.smithi037.stdout:osd.8 up in weight 1 up_from 52 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6816/222884649,v1:172.21.15.135:6817/222884649] [v2:172.21.15.135:6818/222884649,v1:172.21.15.135:6819/222884649] exists,up a7d4c9c8-1826-4703-92ad-ded2800b4780 2024-08-20T05:01:46.748 INFO:teuthology.orchestra.run.smithi037.stdout:osd.9 up in weight 1 up_from 58 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.37:6826/2240773042,v1:172.21.15.37:6827/2240773042] [v2:172.21.15.37:6828/2240773042,v1:172.21.15.37:6829/2240773042] exists,up f9e0c194-66b5-4e62-b2ae-816a4a4fffbb 2024-08-20T05:01:46.748 INFO:teuthology.orchestra.run.smithi037.stdout:osd.10 up in weight 1 up_from 63 up_thru 74 down_at 0 last_clean_interval [0,0) [v2:172.21.15.130:6824/2896730163,v1:172.21.15.130:6825/2896730163] [v2:172.21.15.130:6826/2896730163,v1:172.21.15.130:6827/2896730163] exists,up fa6a50a5-2b97-42d1-9b57-b5502b7083d9 2024-08-20T05:01:46.748 INFO:teuthology.orchestra.run.smithi037.stdout:osd.11 up in weight 1 up_from 69 up_thru 87 down_at 0 last_clean_interval [0,0) [v2:172.21.15.135:6824/2532897645,v1:172.21.15.135:6825/2532897645] [v2:172.21.15.135:6826/2532897645,v1:172.21.15.135:6827/2532897645] exists,up 9a305d75-030d-41db-abfb-81bb71e8c6db 2024-08-20T05:01:46.748 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.5 [8,11] 2024-08-20T05:01:46.748 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.b [2,1,8,11] 2024-08-20T05:01:46.748 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 2.1b [2,4] 2024-08-20T05:01:46.749 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.e [5,9] 2024-08-20T05:01:46.749 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.13 [4,9] 2024-08-20T05:01:46.749 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.17 [4,6] 2024-08-20T05:01:46.749 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.1e [3,9] 2024-08-20T05:01:46.749 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 3.31 [4,8] 2024-08-20T05:01:46.749 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 4.2 [9,1] 2024-08-20T05:01:46.749 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 4.5 [9,10] 2024-08-20T05:01:46.749 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 4.e [5,8] 2024-08-20T05:01:46.749 INFO:teuthology.orchestra.run.smithi037.stdout:pg_upmap_items 4.1b [9,8] 2024-08-20T05:01:46.749 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/4282140105 expires 2024-08-21T04:51:27.877907+0000 2024-08-20T05:01:46.750 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/1217599998 expires 2024-08-21T04:51:27.877907+0000 2024-08-20T05:01:46.750 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6801/1372988755 expires 2024-08-21T04:51:27.877907+0000 2024-08-20T05:01:46.750 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/3737412906 expires 2024-08-21T04:51:27.877907+0000 2024-08-20T05:01:46.750 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6801/2577159152 expires 2024-08-21T04:50:59.520912+0000 2024-08-20T05:01:46.750 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6800/2577159152 expires 2024-08-21T04:50:59.520912+0000 2024-08-20T05:01:46.750 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:6800/1372988755 expires 2024-08-21T04:51:27.877907+0000 2024-08-20T05:01:46.750 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/58912454 expires 2024-08-21T04:50:59.520912+0000 2024-08-20T05:01:46.750 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/2105948300 expires 2024-08-21T04:50:59.520912+0000 2024-08-20T05:01:46.750 INFO:teuthology.orchestra.run.smithi037.stdout:blocklist 172.21.15.37:0/1480362562 expires 2024-08-21T04:50:59.520912+0000 2024-08-20T05:01:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.745+0000 7f5809400640 1 -- 172.21.15.37:0/2325036752 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57e80b3c50 msgr2=0x7f57e80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.745+0000 7f5809400640 1 --2- 172.21.15.37:0/2325036752 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57e80b3c50 0x7f57e80b6110 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009fc0 tx=0x7f57f4005f90 comp rx=0 tx=0).stop 2024-08-20T05:01:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.745+0000 7f5809400640 1 -- 172.21.15.37:0/2325036752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5804103890 msgr2=0x7f580419b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.745+0000 7f5809400640 1 --2- 172.21.15.37:0/2325036752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5804103890 0x7f580419b2e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00d950 tx=0x7f57ec00de10 comp rx=0 tx=0).stop 2024-08-20T05:01:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.745+0000 7f5809400640 1 -- 172.21.15.37:0/2325036752 shutdown_connections 2024-08-20T05:01:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.745+0000 7f5809400640 1 --2- 172.21.15.37:0/2325036752 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57e80b3c50 0x7f57e80b6110 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.745+0000 7f5809400640 1 --2- 172.21.15.37:0/2325036752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5804104250 0x7f580419bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:46.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.745+0000 7f5809400640 1 --2- 172.21.15.37:0/2325036752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5804103890 0x7f580419b2e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.745+0000 7f5809400640 1 --2- 172.21.15.37:0/2325036752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5804102730 0x7f580419ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.746+0000 7f5809400640 1 -- 172.21.15.37:0/2325036752 >> 172.21.15.37:0/2325036752 conn(0x7f58040fe020 msgr2=0x7f58040750b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.746+0000 7f5809400640 1 -- 172.21.15.37:0/2325036752 shutdown_connections 2024-08-20T05:01:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:46.746+0000 7f5809400640 1 -- 172.21.15.37:0/2325036752 wait complete. 2024-08-20T05:01:47.428 INFO:teuthology.run_tasks:Running task fs.ready... 2024-08-20T05:01:47.439 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:01:47.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:47 smithi130 ceph-mon[22007]: pgmap v387: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:47.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:47 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2325036752' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-20T05:01:47.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:47 smithi037 ceph-mon[17265]: pgmap v387: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:47.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:47 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2325036752' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-20T05:01:47.820 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:47.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:47 smithi135 ceph-mon[22342]: pgmap v387: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:47.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:47 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2325036752' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-08-20T05:01:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.440+0000 7f93ac000640 1 -- 172.21.15.37:0/1123400017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a4077400 msgr2=0x7f93a40777e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.440+0000 7f93ac000640 1 --2- 172.21.15.37:0/1123400017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a4077400 0x7f93a40777e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9398009900 tx=0x7f939802a410 comp rx=0 tx=0).stop 2024-08-20T05:01:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.440+0000 7f93ac000640 1 -- 172.21.15.37:0/1123400017 shutdown_connections 2024-08-20T05:01:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.440+0000 7f93ac000640 1 --2- 172.21.15.37:0/1123400017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93a4113680 0x7f93a4115a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.440+0000 7f93ac000640 1 --2- 172.21.15.37:0/1123400017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93a4077d20 0x7f93a4113140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.440+0000 7f93ac000640 1 --2- 172.21.15.37:0/1123400017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a4077400 0x7f93a40777e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.440+0000 7f93ac000640 1 -- 172.21.15.37:0/1123400017 >> 172.21.15.37:0/1123400017 conn(0x7f93a41006c0 msgr2=0x7f93a4102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.440+0000 7f93ac000640 1 -- 172.21.15.37:0/1123400017 shutdown_connections 2024-08-20T05:01:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.440+0000 7f93ac000640 1 -- 172.21.15.37:0/1123400017 wait complete. 2024-08-20T05:01:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.441+0000 7f93ac000640 1 Processor -- start 2024-08-20T05:01:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.442+0000 7f93ac000640 1 -- start start 2024-08-20T05:01:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.442+0000 7f93ac000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93a4077400 0x7f93a419f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.442+0000 7f93ac000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93a4077d20 0x7f93a419fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.442+0000 7f93ac000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a4113680 0x7f93a41a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.442+0000 7f93ac000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93a4119080 con 0x7f93a4113680 2024-08-20T05:01:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.442+0000 7f93ac000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f93a4118f00 con 0x7f93a4077d20 2024-08-20T05:01:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.442+0000 7f93ac000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93a4119200 con 0x7f93a4077400 2024-08-20T05:01:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.442+0000 7f93aa000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a4113680 0x7f93a41a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.442+0000 7f93a9600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93a4077400 0x7f93a419f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.442+0000 7f93a9600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93a4077400 0x7f93a419f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:38368/0 (socket says 172.21.15.37:38368) 2024-08-20T05:01:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.442+0000 7f93a9600640 1 -- 172.21.15.37:0/3221954470 learned_addr learned my addr 172.21.15.37:0/3221954470 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.442+0000 7f93a8c00640 1 --2- 172.21.15.37:0/3221954470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93a4077d20 0x7f93a419fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.443+0000 7f93a8c00640 1 -- 172.21.15.37:0/3221954470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93a4077400 msgr2=0x7f93a419f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.443+0000 7f93a8c00640 1 --2- 172.21.15.37:0/3221954470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93a4077400 0x7f93a419f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.443+0000 7f93a8c00640 1 -- 172.21.15.37:0/3221954470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a4113680 msgr2=0x7f93a41a4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.443+0000 7f93a8c00640 1 --2- 172.21.15.37:0/3221954470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a4113680 0x7f93a41a4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.443+0000 7f93a8c00640 1 -- 172.21.15.37:0/3221954470 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a41a5640 con 0x7f93a4077d20 2024-08-20T05:01:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.443+0000 7f93aa000640 1 --2- 172.21.15.37:0/3221954470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a4113680 0x7f93a41a4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.443+0000 7f93a8c00640 1 --2- 172.21.15.37:0/3221954470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93a4077d20 0x7f93a419fad0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f939000e9f0 tx=0x7f939000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:48.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.443+0000 7f93a2000640 1 -- 172.21.15.37:0/3221954470 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939000ccc0 con 0x7f93a4077d20 2024-08-20T05:01:48.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.444+0000 7f93ac000640 1 -- 172.21.15.37:0/3221954470 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93a41a5930 con 0x7f93a4077d20 2024-08-20T05:01:48.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.444+0000 7f93a2000640 1 -- 172.21.15.37:0/3221954470 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93900108e0 con 0x7f93a4077d20 2024-08-20T05:01:48.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.444+0000 7f93a2000640 1 -- 172.21.15.37:0/3221954470 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9390018880 con 0x7f93a4077d20 2024-08-20T05:01:48.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.444+0000 7f93ac000640 1 -- 172.21.15.37:0/3221954470 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93a41abff0 con 0x7f93a4077d20 2024-08-20T05:01:48.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.445+0000 7f93ac000640 1 -- 172.21.15.37:0/3221954470 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93a40777e0 con 0x7f93a4077d20 2024-08-20T05:01:48.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.447+0000 7f93a2000640 1 -- 172.21.15.37:0/3221954470 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9390010430 con 0x7f93a4077d20 2024-08-20T05:01:48.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.449+0000 7f93a2000640 1 --2- 172.21.15.37:0/3221954470 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f938c0b3bd0 0x7f938c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:48.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.449+0000 7f93a2000640 1 -- 172.21.15.37:0/3221954470 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f93900e43b0 con 0x7f93a4077d20 2024-08-20T05:01:48.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.449+0000 7f93a9600640 1 --2- 172.21.15.37:0/3221954470 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f938c0b3bd0 0x7f938c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:48.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.450+0000 7f93a2000640 1 -- 172.21.15.37:0/3221954470 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f93900aafb0 con 0x7f93a4077d20 2024-08-20T05:01:48.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.450+0000 7f93a9600640 1 --2- 172.21.15.37:0/3221954470 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f938c0b3bd0 0x7f938c0b6090 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9398031440 tx=0x7f93980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:48.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.682+0000 7f93ac000640 1 -- 172.21.15.37:0/3221954470 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93a41a06c0 con 0x7f93a4077d20 2024-08-20T05:01:48.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.683+0000 7f93a2000640 1 -- 172.21.15.37:0/3221954470 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11980 (secure 0 0 0) 0x7f93a41a06c0 con 0x7f93a4077d20 2024-08-20T05:01:48.685 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:01:48.685 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-08-20T05:01:48.685 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"btime":"2024-08-20T05:00:06:145262+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:00:06.145248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:01:48.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.685+0000 7f93ac000640 1 -- 172.21.15.37:0/3221954470 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f938c0b3bd0 msgr2=0x7f938c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:48.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.685+0000 7f93ac000640 1 --2- 172.21.15.37:0/3221954470 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f938c0b3bd0 0x7f938c0b6090 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9398031440 tx=0x7f93980058d0 comp rx=0 tx=0).stop 2024-08-20T05:01:48.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.685+0000 7f93ac000640 1 -- 172.21.15.37:0/3221954470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93a4077d20 msgr2=0x7f93a419fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:48.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.685+0000 7f93ac000640 1 --2- 172.21.15.37:0/3221954470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93a4077d20 0x7f93a419fad0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f939000e9f0 tx=0x7f939000eeb0 comp rx=0 tx=0).stop 2024-08-20T05:01:48.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.685+0000 7f93ac000640 1 -- 172.21.15.37:0/3221954470 shutdown_connections 2024-08-20T05:01:48.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.685+0000 7f93ac000640 1 --2- 172.21.15.37:0/3221954470 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f938c0b3bd0 0x7f938c0b6090 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:48.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.685+0000 7f93ac000640 1 --2- 172.21.15.37:0/3221954470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a4113680 0x7f93a41a4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:48.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.685+0000 7f93ac000640 1 --2- 172.21.15.37:0/3221954470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f93a4077d20 0x7f93a419fad0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:48.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.685+0000 7f93ac000640 1 --2- 172.21.15.37:0/3221954470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f93a4077400 0x7f93a419f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:48.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.685+0000 7f93ac000640 1 -- 172.21.15.37:0/3221954470 >> 172.21.15.37:0/3221954470 conn(0x7f93a41006c0 msgr2=0x7f93a4102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:48.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.685+0000 7f93ac000640 1 -- 172.21.15.37:0/3221954470 shutdown_connections 2024-08-20T05:01:48.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:48.685+0000 7f93ac000640 1 -- 172.21.15.37:0/3221954470 wait complete. 2024-08-20T05:01:49.649 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:49 smithi037 ceph-mon[17265]: pgmap v388: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:49.649 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:49 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3221954470' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:01:49.652 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:01:49.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:49 smithi130 ceph-mon[22007]: pgmap v388: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:49.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:49 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3221954470' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:01:49.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:49 smithi135 ceph-mon[22342]: pgmap v388: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:49.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:49 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3221954470' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:01:50.034 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.574+0000 7f0a7f000640 1 -- 172.21.15.37:0/449732141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a78077d20 msgr2=0x7f0a78112fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.574+0000 7f0a7f000640 1 --2- 172.21.15.37:0/449732141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a78077d20 0x7f0a78112fb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0a64009900 tx=0x7f0a6402a400 comp rx=0 tx=0).stop 2024-08-20T05:01:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.574+0000 7f0a7f000640 1 -- 172.21.15.37:0/449732141 shutdown_connections 2024-08-20T05:01:50.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.574+0000 7f0a7f000640 1 --2- 172.21.15.37:0/449732141 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a781134f0 0x7f0a781158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:50.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.574+0000 7f0a7f000640 1 --2- 172.21.15.37:0/449732141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a78077d20 0x7f0a78112fb0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:50.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.574+0000 7f0a7f000640 1 --2- 172.21.15.37:0/449732141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a78077400 0x7f0a780777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:50.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.574+0000 7f0a7f000640 1 -- 172.21.15.37:0/449732141 >> 172.21.15.37:0/449732141 conn(0x7f0a78100550 msgr2=0x7f0a78102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:50.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.574+0000 7f0a7f000640 1 -- 172.21.15.37:0/449732141 shutdown_connections 2024-08-20T05:01:50.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.574+0000 7f0a7f000640 1 -- 172.21.15.37:0/449732141 wait complete. 2024-08-20T05:01:50.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.575+0000 7f0a7f000640 1 Processor -- start 2024-08-20T05:01:50.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.575+0000 7f0a7f000640 1 -- start start 2024-08-20T05:01:50.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.576+0000 7f0a7f000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a78077400 0x7f0a7819f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:50.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.576+0000 7f0a7f000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a78077d20 0x7f0a7819f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:50.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.576+0000 7f0a7f000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a781134f0 0x7f0a781a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:50.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.576+0000 7f0a7f000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a78118f50 con 0x7f0a781134f0 2024-08-20T05:01:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.576+0000 7f0a7f000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0a78118dd0 con 0x7f0a78077400 2024-08-20T05:01:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.576+0000 7f0a7f000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0a781190d0 con 0x7f0a78077d20 2024-08-20T05:01:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.576+0000 7f0a7e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a781134f0 0x7f0a781a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.576+0000 7f0a7dc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a78077400 0x7f0a7819f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.576+0000 7f0a7e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a781134f0 0x7f0a781a4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53596/0 (socket says 172.21.15.37:53596) 2024-08-20T05:01:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.576+0000 7f0a7e600640 1 -- 172.21.15.37:0/1601408397 learned_addr learned my addr 172.21.15.37:0/1601408397 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.576+0000 7f0a7d200640 1 --2- 172.21.15.37:0/1601408397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a78077d20 0x7f0a7819f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.577+0000 7f0a7e600640 1 -- 172.21.15.37:0/1601408397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a78077d20 msgr2=0x7f0a7819f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.577+0000 7f0a7e600640 1 --2- 172.21.15.37:0/1601408397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a78077d20 0x7f0a7819f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.577+0000 7f0a7e600640 1 -- 172.21.15.37:0/1601408397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a78077400 msgr2=0x7f0a7819f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.577+0000 7f0a7e600640 1 --2- 172.21.15.37:0/1601408397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a78077400 0x7f0a7819f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.577+0000 7f0a7e600640 1 -- 172.21.15.37:0/1601408397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a781a5450 con 0x7f0a781134f0 2024-08-20T05:01:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.577+0000 7f0a7dc00640 1 --2- 172.21.15.37:0/1601408397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a78077400 0x7f0a7819f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.577+0000 7f0a7e600640 1 --2- 172.21.15.37:0/1601408397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a781134f0 0x7f0a781a4c80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000eb40 tx=0x7f0a7000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.577+0000 7f0a76000640 1 -- 172.21.15.37:0/1601408397 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70004b20 con 0x7f0a781134f0 2024-08-20T05:01:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.577+0000 7f0a76000640 1 -- 172.21.15.37:0/1601408397 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a70004cc0 con 0x7f0a781134f0 2024-08-20T05:01:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.577+0000 7f0a76000640 1 -- 172.21.15.37:0/1601408397 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a70010720 con 0x7f0a781134f0 2024-08-20T05:01:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.577+0000 7f0a7f000640 1 -- 172.21.15.37:0/1601408397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a781a5740 con 0x7f0a781134f0 2024-08-20T05:01:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.577+0000 7f0a7f000640 1 -- 172.21.15.37:0/1601408397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a781abe00 con 0x7f0a781134f0 2024-08-20T05:01:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.579+0000 7f0a7f000640 1 -- 172.21.15.37:0/1601408397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a780777e0 con 0x7f0a781134f0 2024-08-20T05:01:50.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.581+0000 7f0a76000640 1 -- 172.21.15.37:0/1601408397 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0a70005560 con 0x7f0a781134f0 2024-08-20T05:01:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.582+0000 7f0a76000640 1 --2- 172.21.15.37:0/1601408397 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0a600b3cf0 0x7f0a600b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.582+0000 7f0a76000640 1 -- 172.21.15.37:0/1601408397 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0a700e4680 con 0x7f0a781134f0 2024-08-20T05:01:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.582+0000 7f0a7dc00640 1 --2- 172.21.15.37:0/1601408397 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0a600b3cf0 0x7f0a600b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.583+0000 7f0a7dc00640 1 --2- 172.21.15.37:0/1601408397 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0a600b3cf0 0x7f0a600b61b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009fc0 tx=0x7f0a6c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:50.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.586+0000 7f0a76000640 1 -- 172.21.15.37:0/1601408397 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f0a700ab8d0 con 0x7f0a781134f0 2024-08-20T05:01:50.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.817+0000 7f0a7f000640 1 -- 172.21.15.37:0/1601408397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a781ac1a0 con 0x7f0a781134f0 2024-08-20T05:01:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.818+0000 7f0a76000640 1 -- 172.21.15.37:0/1601408397 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11980 (secure 0 0 0) 0x7f0a700ab1d0 con 0x7f0a781134f0 2024-08-20T05:01:50.820 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:01:50.820 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"btime":"2024-08-20T05:00:06:145262+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:00:06.145248+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:01:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-08-20T05:01:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.820+0000 7f0a7f000640 1 -- 172.21.15.37:0/1601408397 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0a600b3cf0 msgr2=0x7f0a600b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.820+0000 7f0a7f000640 1 --2- 172.21.15.37:0/1601408397 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0a600b3cf0 0x7f0a600b61b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009fc0 tx=0x7f0a6c005f90 comp rx=0 tx=0).stop 2024-08-20T05:01:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.820+0000 7f0a7f000640 1 -- 172.21.15.37:0/1601408397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a781134f0 msgr2=0x7f0a781a4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.820+0000 7f0a7f000640 1 --2- 172.21.15.37:0/1601408397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a781134f0 0x7f0a781a4c80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000eb40 tx=0x7f0a7000c2d0 comp rx=0 tx=0).stop 2024-08-20T05:01:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.820+0000 7f0a7f000640 1 -- 172.21.15.37:0/1601408397 shutdown_connections 2024-08-20T05:01:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.821+0000 7f0a7f000640 1 --2- 172.21.15.37:0/1601408397 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0a600b3cf0 0x7f0a600b61b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.821+0000 7f0a7f000640 1 --2- 172.21.15.37:0/1601408397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a781134f0 0x7f0a781a4c80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.821+0000 7f0a7f000640 1 --2- 172.21.15.37:0/1601408397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a78077d20 0x7f0a7819f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.821+0000 7f0a7f000640 1 --2- 172.21.15.37:0/1601408397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a78077400 0x7f0a7819f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.821+0000 7f0a7f000640 1 -- 172.21.15.37:0/1601408397 >> 172.21.15.37:0/1601408397 conn(0x7f0a78100550 msgr2=0x7f0a78102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.821+0000 7f0a7f000640 1 -- 172.21.15.37:0/1601408397 shutdown_connections 2024-08-20T05:01:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:50.821+0000 7f0a7f000640 1 -- 172.21.15.37:0/1601408397 wait complete. 2024-08-20T05:01:51.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:51 smithi130 ceph-mon[22007]: pgmap v389: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:51.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:51 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1601408397' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:01:51.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:51 smithi037 ceph-mon[17265]: pgmap v389: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:51.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:51 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1601408397' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:01:51.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:51 smithi135 ceph-mon[22342]: pgmap v389: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:51.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:51 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1601408397' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:01:51.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T05:01:52.283 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.015+0000 7f9927200640 1 -- 172.21.15.37:0/713228518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992010ae90 msgr2=0x7f9920111690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.015+0000 7f9927200640 1 --2- 172.21.15.37:0/713228518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992010ae90 0x7f9920111690 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f991c009ca0 tx=0x7f991c02a8c0 comp rx=0 tx=0).stop 2024-08-20T05:01:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.015+0000 7f9927200640 1 -- 172.21.15.37:0/713228518 shutdown_connections 2024-08-20T05:01:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.015+0000 7f9927200640 1 --2- 172.21.15.37:0/713228518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992010ae90 0x7f9920111690 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.015+0000 7f9927200640 1 --2- 172.21.15.37:0/713228518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f992010a510 0x7f992010a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.015+0000 7f9927200640 1 --2- 172.21.15.37:0/713228518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920104b00 0x7f9920104ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.015+0000 7f9927200640 1 -- 172.21.15.37:0/713228518 >> 172.21.15.37:0/713228518 conn(0x7f9920100550 msgr2=0x7f9920102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.015+0000 7f9927200640 1 -- 172.21.15.37:0/713228518 shutdown_connections 2024-08-20T05:01:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.015+0000 7f9927200640 1 -- 172.21.15.37:0/713228518 wait complete. 2024-08-20T05:01:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.016+0000 7f9927200640 1 Processor -- start 2024-08-20T05:01:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.016+0000 7f9927200640 1 -- start start 2024-08-20T05:01:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.017+0000 7f9927200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920104b00 0x7f992019afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.017+0000 7f9927200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f992010a510 0x7f992019b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.017+0000 7f9927200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992010ae90 0x7f99201a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.017+0000 7f9927200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9920114b60 con 0x7f992010ae90 2024-08-20T05:01:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.017+0000 7f9927200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99201149e0 con 0x7f992010a510 2024-08-20T05:01:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.017+0000 7f9927200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9920114ce0 con 0x7f9920104b00 2024-08-20T05:01:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.017+0000 7f9926800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992010ae90 0x7f99201a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.017+0000 7f9925e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920104b00 0x7f992019afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.017+0000 7f9926800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992010ae90 0x7f99201a0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38968/0 (socket says 172.21.15.37:38968) 2024-08-20T05:01:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.017+0000 7f9926800640 1 -- 172.21.15.37:0/1879606730 learned_addr learned my addr 172.21.15.37:0/1879606730 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.017+0000 7f9925400640 1 --2- 172.21.15.37:0/1879606730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f992010a510 0x7f992019b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.018+0000 7f9925e00640 1 -- 172.21.15.37:0/1879606730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f992010a510 msgr2=0x7f992019b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.018+0000 7f9925e00640 1 --2- 172.21.15.37:0/1879606730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f992010a510 0x7f992019b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.018+0000 7f9925e00640 1 -- 172.21.15.37:0/1879606730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992010ae90 msgr2=0x7f99201a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.018+0000 7f9925e00640 1 --2- 172.21.15.37:0/1879606730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992010ae90 0x7f99201a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.018+0000 7f9925e00640 1 -- 172.21.15.37:0/1879606730 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99201a1060 con 0x7f9920104b00 2024-08-20T05:01:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.018+0000 7f9925e00640 1 --2- 172.21.15.37:0/1879606730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920104b00 0x7f992019afb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f991400e9f0 tx=0x7f991400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.018+0000 7f991aa00640 1 -- 172.21.15.37:0/1879606730 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f991400ccc0 con 0x7f9920104b00 2024-08-20T05:01:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.019+0000 7f991aa00640 1 -- 172.21.15.37:0/1879606730 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9914005020 con 0x7f9920104b00 2024-08-20T05:01:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.019+0000 7f9927200640 1 -- 172.21.15.37:0/1879606730 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99201a1350 con 0x7f9920104b00 2024-08-20T05:01:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.019+0000 7f991aa00640 1 -- 172.21.15.37:0/1879606730 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9914004a00 con 0x7f9920104b00 2024-08-20T05:01:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.019+0000 7f9927200640 1 -- 172.21.15.37:0/1879606730 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99201a7a10 con 0x7f9920104b00 2024-08-20T05:01:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.020+0000 7f9927200640 1 -- 172.21.15.37:0/1879606730 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9920104ee0 con 0x7f9920104b00 2024-08-20T05:01:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.022+0000 7f991aa00640 1 -- 172.21.15.37:0/1879606730 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9914004ba0 con 0x7f9920104b00 2024-08-20T05:01:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.024+0000 7f991aa00640 1 --2- 172.21.15.37:0/1879606730 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99080b3c70 0x7f99080b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.024+0000 7f991aa00640 1 -- 172.21.15.37:0/1879606730 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f99140e40a0 con 0x7f9920104b00 2024-08-20T05:01:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.024+0000 7f9925400640 1 --2- 172.21.15.37:0/1879606730 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99080b3c70 0x7f99080b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:53.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.025+0000 7f9925400640 1 --2- 172.21.15.37:0/1879606730 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99080b3c70 0x7f99080b6130 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9920102ef0 tx=0x7f9910005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:53.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.025+0000 7f991aa00640 1 -- 172.21.15.37:0/1879606730 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f99140ab2f0 con 0x7f9920104b00 2024-08-20T05:01:53.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.220+0000 7f9927200640 1 -- 172.21.15.37:0/1879606730 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f992010cca0 con 0x7f9920104b00 2024-08-20T05:01:53.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.222+0000 7f991aa00640 1 -- 172.21.15.37:0/1879606730 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24873 (secure 0 0 0) 0x7f99140aabf0 con 0x7f9920104b00 2024-08-20T05:01:53.224 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:01:53.224 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":88,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","created":"2024-08-20T04:50:26.520303+0000","modified":"2024-08-20T05:01:30.328315+0000","last_up_change":"2024-08-20T04:58:12.250259+0000","last_in_change":"2024-08-20T04:57:49.724189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T04:54:16.381529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T04:59:08.598741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T04:59:10.793802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-20T04:59:19.888446+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a813e53b-68b3-43ff-a59b-aed00e98f2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6803","nonce":3569936373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6805","nonce":3569936373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6809","nonce":3569936373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6807","nonce":3569936373}]},"public_addr":"172.21.15.37:6803/3569936373","cluster_addr":"172.21.15.37:6805/3569936373","heartbeat_back_addr":"172.21.15.37:6809/3569936373","heartbeat_front_addr":"172.21.15.37:6807/3569936373","state":["exists","up"]},{"osd":1,"uuid":"c216a8d0-9685-467a-8161-700682ce617c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6801","nonce":4206461125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6803","nonce":4206461125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6807","nonce":4206461125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6805","nonce":4206461125}]},"public_addr":"172.21.15.130:6801/4206461125","cluster_addr":"172.21.15.130:6803/4206461125","heartbeat_back_addr":"172.21.15.130:6807/4206461125","heartbeat_front_addr":"172.21.15.130:6805/4206461125","state":["exists","up"]},{"osd":2,"uuid":"34402442-c652-40eb-865e-a607a28846b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6801","nonce":2653255199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6803","nonce":2653255199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6807","nonce":2653255199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6805","nonce":2653255199}]},"public_addr":"172.21.15.135:6801/2653255199","cluster_addr":"172.21.15.135:6803/2653255199","heartbeat_back_addr":"172.21.15.135:6807/2653255199","heartbeat_front_addr":"172.21.15.135:6805/2653255199","state":["exists","up"]},{"osd":3,"uuid":"ec7be9dc-96b5-4816-9065-8121baedcdc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6811","nonce":2601290990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6813","nonce":2601290990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6817","nonce":2601290990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6815","nonce":2601290990}]},"public_addr":"172.21.15.37:6811/2601290990","cluster_addr":"172.21.15.37:6813/2601290990","heartbeat_back_addr":"172.21.15.37:6817/2601290990","heartbeat_front_addr":"172.21.15.37:6815/2601290990","state":["exists","up"]},{"osd":4,"uuid":"2dbd47f9-8686-4707-8862-3c7a99a37d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6809","nonce":3542081474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6811","nonce":3542081474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6815","nonce":3542081474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6813","nonce":3542081474}]},"public_addr":"172.21.15.130:6809/3542081474","cluster_addr":"172.21.15.130:6811/3542081474","heartbeat_back_addr":"172.21.15.130:6815/3542081474","heartbeat_front_addr":"172.21.15.130:6813/3542081474","state":["exists","up"]},{"osd":5,"uuid":"9a07a137-d6b7-4aba-8678-4fd164597f27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6809","nonce":2507249148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6811","nonce":2507249148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6815","nonce":2507249148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6813","nonce":2507249148}]},"public_addr":"172.21.15.135:6809/2507249148","cluster_addr":"172.21.15.135:6811/2507249148","heartbeat_back_addr":"172.21.15.135:6815/2507249148","heartbeat_front_addr":"172.21.15.135:6813/2507249148","state":["exists","up"]},{"osd":6,"uuid":"6d6346e8-5418-4c30-9bb3-5af352b616a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6819","nonce":155932692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6821","nonce":155932692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6825","nonce":155932692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6823","nonce":155932692}]},"public_addr":"172.21.15.37:6819/155932692","cluster_addr":"172.21.15.37:6821/155932692","heartbeat_back_addr":"172.21.15.37:6825/155932692","heartbeat_front_addr":"172.21.15.37:6823/155932692","state":["exists","up"]},{"osd":7,"uuid":"c87804c2-d456-495e-b36e-33dbb3548347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6817","nonce":4148130245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6819","nonce":4148130245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6823","nonce":4148130245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6821","nonce":4148130245}]},"public_addr":"172.21.15.130:6817/4148130245","cluster_addr":"172.21.15.130:6819/4148130245","heartbeat_back_addr":"172.21.15.130:6823/4148130245","heartbeat_front_addr":"172.21.15.130:6821/4148130245","state":["exists","up"]},{"osd":8,"uuid":"a7d4c9c8-1826-4703-92ad-ded2800b4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6817","nonce":222884649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6819","nonce":222884649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6823","nonce":222884649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6821","nonce":222884649}]},"public_addr":"172.21.15.135:6817/222884649","cluster_addr":"172.21.15.135:6819/222884649","heartbeat_back_addr":"172.21.15.135:6823/222884649","heartbeat_front_addr":"172.21.15.135:6821/222884649","state":["exists","up"]},{"osd":9,"uuid":"f9e0c194-66b5-4e62-b2ae-816a4a4fffbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6827","nonce":2240773042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6829","nonce":2240773042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6833","nonce":2240773042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6831","nonce":2240773042}]},"public_addr":"172.21.15.37:6827/2240773042","cluster_addr":"172.21.15.37:6829/2240773042","heartbeat_back_addr":"172.21.15.37:6833/2240773042","heartbeat_front_addr":"172.21.15.37:6831/2240773042","state":["exists","up"]},{"osd":10,"uuid":"fa6a50a5-2b97-42d1-9b57-b5502b7083d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6825","nonce":2896730163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6827","nonce":2896730163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6831","nonce":2896730163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6829","nonce":2896730163}]},"public_addr":"172.21.15.130:6825/2896730163","cluster_addr":"172.21.15.130:6827/2896730163","heartbeat_back_addr":"172.21.15.130:6831/2896730163","heartbeat_front_addr":"172.21.15.130:6829/2896730163","state":["exists","up"]},{"osd":11,"uuid":"9a305d75-030d-41db-abfb-81bb71e8c6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6825","nonce":2532897645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6827","nonce":2532897645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6831","nonce":2532897645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6829","nonce":2532897645}]},"public_addr":"172.21.15.135:6825/2532897645","cluster_addr":"172.21.15.135:6827/2532897645","heartbeat_back_addr":"172.21.15.135:6831/2532897645","heartbeat_front_addr":"172.21.15.135:6829/2532897645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:26.455665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:51.456030+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:14.332699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:42.749386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:07.587091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:32.450249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:01.864489+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:26.830527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:51.206257+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:20.400020+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:46.329864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:58:11.086508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4282140105":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/1217599998":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/3737412906":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/58912454":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/2105948300":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/1480362562":"2024-08-21T04:50:59.520912+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T05:01:53.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.224+0000 7f9927200640 1 -- 172.21.15.37:0/1879606730 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99080b3c70 msgr2=0x7f99080b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:53.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.224+0000 7f9927200640 1 --2- 172.21.15.37:0/1879606730 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99080b3c70 0x7f99080b6130 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9920102ef0 tx=0x7f9910005f90 comp rx=0 tx=0).stop 2024-08-20T05:01:53.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.224+0000 7f9927200640 1 -- 172.21.15.37:0/1879606730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920104b00 msgr2=0x7f992019afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:53.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.224+0000 7f9927200640 1 --2- 172.21.15.37:0/1879606730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920104b00 0x7f992019afb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f991400e9f0 tx=0x7f991400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:01:53.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.224+0000 7f9927200640 1 -- 172.21.15.37:0/1879606730 shutdown_connections 2024-08-20T05:01:53.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.224+0000 7f9927200640 1 --2- 172.21.15.37:0/1879606730 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99080b3c70 0x7f99080b6130 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:53.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.224+0000 7f9927200640 1 --2- 172.21.15.37:0/1879606730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f992010ae90 0x7f99201a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:53.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.224+0000 7f9927200640 1 --2- 172.21.15.37:0/1879606730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f992010a510 0x7f992019b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:53.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.224+0000 7f9927200640 1 --2- 172.21.15.37:0/1879606730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9920104b00 0x7f992019afb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:53.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.224+0000 7f9927200640 1 -- 172.21.15.37:0/1879606730 >> 172.21.15.37:0/1879606730 conn(0x7f9920100550 msgr2=0x7f9920100cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:53.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.224+0000 7f9927200640 1 -- 172.21.15.37:0/1879606730 shutdown_connections 2024-08-20T05:01:53.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:53.224+0000 7f9927200640 1 -- 172.21.15.37:0/1879606730 wait complete. 2024-08-20T05:01:53.649 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:53 smithi037 ceph-mon[17265]: pgmap v390: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:01:53.650 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:53 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1879606730' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:01:53.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:53 smithi130 ceph-mon[22007]: pgmap v390: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:01:53.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:53 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1879606730' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:01:53.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:53 smithi135 ceph-mon[22342]: pgmap v390: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:01:53.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:53 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1879606730' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:01:53.991 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-20T04:59:13.823062+0000', 'modified': '2024-08-20T05:00:06.145248+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24695, 'mds_1': 24664, 'mds_2': 24656, 'mds_3': 24649, 'mds_4': 24637}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14652': {'gid': 14652, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6839/1587848243', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6838', 'nonce': 1587848243}, {'type': 'v1', 'addr': '172.21.15.37:6839', 'nonce': 1587848243}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14664': {'gid': 14664, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6841/466077750', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6840', 'nonce': 466077750}, {'type': 'v1', 'addr': '172.21.15.37:6841', 'nonce': 466077750}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24590': {'gid': 24590, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6833/1818782678', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6832', 'nonce': 1818782678}, {'type': 'v1', 'addr': '172.21.15.130:6833', 'nonce': 1818782678}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24592': {'gid': 24592, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6833/4059666386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6832', 'nonce': 4059666386}, {'type': 'v1', 'addr': '172.21.15.135:6833', 'nonce': 4059666386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24626': {'gid': 24626, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6835/538714148', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6834', 'nonce': 538714148}, {'type': 'v1', 'addr': '172.21.15.130:6835', 'nonce': 538714148}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24637': {'gid': 24637, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 22, 'addr': '172.21.15.135:6835/998113160', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 998113160}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 998113160}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24649': {'gid': 24649, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 22, 'addr': '172.21.15.135:6837/894352067', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6836', 'nonce': 894352067}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 894352067}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24656': {'gid': 24656, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.130:6837/1513603753', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6836', 'nonce': 1513603753}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 1513603753}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24664': {'gid': 24664, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.135:6839/2602130726', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 2602130726}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 2602130726}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24695': {'gid': 24695, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.130:6839/2863850712', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6838', 'nonce': 2863850712}, {'type': 'v1', 'addr': '172.21.15.130:6839', 'nonce': 2863850712}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24695, 'qdb_cluster': [24664, 24695, 24656, 24649, 24637]} 2024-08-20T05:01:53.991 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-20T05:01:53.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.f status 2024-08-20T05:01:54.372 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.966+0000 7febb7600640 1 -- 172.21.15.37:0/3189090825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febb0104ca0 msgr2=0x7febb0105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.966+0000 7febb7600640 1 --2- 172.21.15.37:0/3189090825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febb0104ca0 0x7febb0105080 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7feba4009900 tx=0x7feba402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:01:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.966+0000 7febb7600640 1 -- 172.21.15.37:0/3189090825 shutdown_connections 2024-08-20T05:01:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.966+0000 7febb7600640 1 --2- 172.21.15.37:0/3189090825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febb010b030 0x7febb0111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:54.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.966+0000 7febb7600640 1 --2- 172.21.15.37:0/3189090825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febb010a6b0 0x7febb010aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.966+0000 7febb7600640 1 --2- 172.21.15.37:0/3189090825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febb0104ca0 0x7febb0105080 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.966+0000 7febb7600640 1 -- 172.21.15.37:0/3189090825 >> 172.21.15.37:0/3189090825 conn(0x7febb0100730 msgr2=0x7febb0102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.966+0000 7febb7600640 1 -- 172.21.15.37:0/3189090825 shutdown_connections 2024-08-20T05:01:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.966+0000 7febb7600640 1 -- 172.21.15.37:0/3189090825 wait complete. 2024-08-20T05:01:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.967+0000 7febb7600640 1 Processor -- start 2024-08-20T05:01:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.967+0000 7febb7600640 1 -- start start 2024-08-20T05:01:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.968+0000 7febb7600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febb0104ca0 0x7febb019b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.968+0000 7febb7600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febb010a6b0 0x7febb019b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.968+0000 7febb7600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febb010b030 0x7febb01a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.968+0000 7febb7600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7febb0114cf0 con 0x7febb0104ca0 2024-08-20T05:01:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.968+0000 7febb7600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7febb0114b70 con 0x7febb010a6b0 2024-08-20T05:01:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.968+0000 7febb7600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7febb0114e70 con 0x7febb010b030 2024-08-20T05:01:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.968+0000 7febb4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febb0104ca0 0x7febb019b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:54.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.968+0000 7febb4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febb0104ca0 0x7febb019b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38986/0 (socket says 172.21.15.37:38986) 2024-08-20T05:01:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.968+0000 7febb4c00640 1 -- 172.21.15.37:0/46580604 learned_addr learned my addr 172.21.15.37:0/46580604 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.968+0000 7febafe00640 1 --2- 172.21.15.37:0/46580604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febb010a6b0 0x7febb019b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.968+0000 7febb5600640 1 --2- 172.21.15.37:0/46580604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febb010b030 0x7febb01a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.968+0000 7febb4c00640 1 -- 172.21.15.37:0/46580604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febb010b030 msgr2=0x7febb01a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.968+0000 7febb4c00640 1 --2- 172.21.15.37:0/46580604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febb010b030 0x7febb01a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.968+0000 7febb4c00640 1 -- 172.21.15.37:0/46580604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febb010a6b0 msgr2=0x7febb019b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.968+0000 7febb4c00640 1 --2- 172.21.15.37:0/46580604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febb010a6b0 0x7febb019b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.968+0000 7febb4c00640 1 -- 172.21.15.37:0/46580604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb01a1210 con 0x7febb0104ca0 2024-08-20T05:01:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.969+0000 7febb4c00640 1 --2- 172.21.15.37:0/46580604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febb0104ca0 0x7febb019b160 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7feba4005940 tx=0x7feba40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.969+0000 7febad600640 1 -- 172.21.15.37:0/46580604 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba403f030 con 0x7febb0104ca0 2024-08-20T05:01:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.969+0000 7febb7600640 1 -- 172.21.15.37:0/46580604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb01a14a0 con 0x7febb0104ca0 2024-08-20T05:01:54.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.969+0000 7febad600640 1 -- 172.21.15.37:0/46580604 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba40044c0 con 0x7febb0104ca0 2024-08-20T05:01:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.969+0000 7febad600640 1 -- 172.21.15.37:0/46580604 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba4035070 con 0x7febb0104ca0 2024-08-20T05:01:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.969+0000 7febb7600640 1 -- 172.21.15.37:0/46580604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb01a7bc0 con 0x7febb0104ca0 2024-08-20T05:01:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.972+0000 7febb9ff2740 1 Processor -- start 2024-08-20T05:01:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.973+0000 7febb9ff2740 1 -- start start 2024-08-20T05:01:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.973+0000 7febad600640 1 -- 172.21.15.37:0/46580604 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7feba4042030 con 0x7febb0104ca0 2024-08-20T05:01:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.973+0000 7febb9ff2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3df10 0x5620fbc3e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.973+0000 7febb9ff2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3e830 0x5620fbc4a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.973+0000 7febb9ff2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc4a7c0 0x5620fbc4cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.973+0000 7febb9ff2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5620fbbb4840 con 0x5620fbc3e830 2024-08-20T05:01:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.973+0000 7febb9ff2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5620fbba3d40 con 0x5620fbc4a7c0 2024-08-20T05:01:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.973+0000 7febb9ff2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5620fbba7d80 con 0x5620fbc3df10 2024-08-20T05:01:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.973+0000 7febb5600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3df10 0x5620fbc3e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.973+0000 7febb4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3e830 0x5620fbc4a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:54.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.973+0000 7febb5600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3df10 0x5620fbc3e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50970/0 (socket says 172.21.15.37:50970) 2024-08-20T05:01:54.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.973+0000 7febb5600640 1 -- 172.21.15.37:0/521978848 learned_addr learned my addr 172.21.15.37:0/521978848 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:54.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.973+0000 7febafe00640 1 --2- 172.21.15.37:0/521978848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc4a7c0 0x5620fbc4cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:54.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.974+0000 7febb5600640 1 -- 172.21.15.37:0/521978848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc4a7c0 msgr2=0x5620fbc4cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:54.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.974+0000 7febb5600640 1 --2- 172.21.15.37:0/521978848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc4a7c0 0x5620fbc4cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:54.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.974+0000 7febb5600640 1 -- 172.21.15.37:0/521978848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3e830 msgr2=0x5620fbc4a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:54.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.974+0000 7febb5600640 1 --2- 172.21.15.37:0/521978848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3e830 0x5620fbc4a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:54.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.974+0000 7febb5600640 1 -- 172.21.15.37:0/521978848 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620fbb4a1c0 con 0x5620fbc3df10 2024-08-20T05:01:54.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.974+0000 7febb5600640 1 --2- 172.21.15.37:0/521978848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3df10 0x5620fbc3e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feba8011440 tx=0x7feba8011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c778f34f8d7b6094 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:54.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.974+0000 7feba1c00640 1 -- 172.21.15.37:0/521978848 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba8004d20 con 0x5620fbc3df10 2024-08-20T05:01:54.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.974+0000 7feba1c00640 1 -- 172.21.15.37:0/521978848 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba8004050 con 0x5620fbc3df10 2024-08-20T05:01:54.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.974+0000 7feba1c00640 1 -- 172.21.15.37:0/521978848 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba800f7a0 con 0x5620fbc3df10 2024-08-20T05:01:54.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.975+0000 7febad600640 1 --2- 172.21.15.37:0/46580604 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feb980b3bd0 0x7feb980b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:54.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.975+0000 7febad600640 1 -- 172.21.15.37:0/46580604 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7feba4104310 con 0x7febb0104ca0 2024-08-20T05:01:54.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.975+0000 7febb4c00640 1 --2- 172.21.15.37:0/46580604 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feb980b3bd0 0x7feb980b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:54.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.975+0000 7febb9ff2740 1 -- 172.21.15.37:0/521978848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3df10 msgr2=0x5620fbc3e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:54.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.975+0000 7febb9ff2740 1 --2- 172.21.15.37:0/521978848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3df10 0x5620fbc3e2f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7feba8011440 tx=0x7feba8011900 comp rx=0 tx=0).stop 2024-08-20T05:01:54.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.975+0000 7febb9ff2740 1 -- 172.21.15.37:0/521978848 shutdown_connections 2024-08-20T05:01:54.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.975+0000 7febb9ff2740 1 --2- 172.21.15.37:0/521978848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc4a7c0 0x5620fbc4cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:54.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.975+0000 7febb9ff2740 1 --2- 172.21.15.37:0/521978848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3e830 0x5620fbc4a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:54.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.975+0000 7febb9ff2740 1 --2- 172.21.15.37:0/521978848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3df10 0x5620fbc3e2f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:54.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.975+0000 7febb9ff2740 1 -- 172.21.15.37:0/521978848 >> 172.21.15.37:0/521978848 conn(0x5620fbc3bd40 msgr2=0x5620fbc3cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:54.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.975+0000 7febb9ff2740 1 -- 172.21.15.37:0/521978848 shutdown_connections 2024-08-20T05:01:54.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.975+0000 7febb9ff2740 1 -- 172.21.15.37:0/521978848 wait complete. 2024-08-20T05:01:54.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.976+0000 7febb4c00640 1 --2- 172.21.15.37:0/46580604 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feb980b3bd0 0x7feb980b6090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feba40caea0 tx=0x7feba4107d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:54.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.976+0000 7febb9ff2740 1 -- start start 2024-08-20T05:01:54.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.976+0000 7febb9ff2740 1 Processor -- start 2024-08-20T05:01:54.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.977+0000 7febb9ff2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3df10 0x5620fbc49fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:54.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.977+0000 7febb9ff2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc3e830 0x5620fbc47430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.977+0000 7febb9ff2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc4a7c0 0x5620fbc47970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.977+0000 7febb9ff2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5620fba065f0 con 0x5620fbc3df10 2024-08-20T05:01:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.977+0000 7febb9ff2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5620fbb3f170 con 0x5620fbc3e830 2024-08-20T05:01:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.977+0000 7febb9ff2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5620fbc4d470 con 0x5620fbc4a7c0 2024-08-20T05:01:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.977+0000 7febb9ff2740 10 client.0 _ll_register_callbacks cb 0x5620fbb9e8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:01:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.977+0000 7febb5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3df10 0x5620fbc49fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.977+0000 7febb5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3df10 0x5620fbc49fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39000/0 (socket says 172.21.15.37:39000) 2024-08-20T05:01:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.977+0000 7febb5600640 1 -- 172.21.15.37:0/2862155520 learned_addr learned my addr 172.21.15.37:0/2862155520 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.977+0000 7febafe00640 1 --2- 172.21.15.37:0/2862155520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc3e830 0x5620fbc47430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.977+0000 7febb5600640 1 --2- 172.21.15.37:0/2862155520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc4a7c0 0x5620fbc47970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.977+0000 7febb5600640 1 -- 172.21.15.37:0/2862155520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc4a7c0 msgr2=0x5620fbc47970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:54.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.977+0000 7febb5600640 1 --2- 172.21.15.37:0/2862155520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc4a7c0 0x5620fbc47970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.977+0000 7febb5600640 1 -- 172.21.15.37:0/2862155520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc3e830 msgr2=0x5620fbc47430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.977+0000 7febb5600640 1 --2- 172.21.15.37:0/2862155520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc3e830 0x5620fbc47430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.977+0000 7febb5600640 1 -- 172.21.15.37:0/2862155520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620fb903540 con 0x5620fbc3df10 2024-08-20T05:01:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.978+0000 7febb5600640 1 --2- 172.21.15.37:0/2862155520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3df10 0x5620fbc49fe0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feba8014040 tx=0x7feba8003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff9017c29bd37fa6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.978+0000 7feb96000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:01:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.978+0000 7feb96000640 1 -- 172.21.15.37:0/2862155520 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba802b060 con 0x5620fbc3df10 2024-08-20T05:01:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.978+0000 7feb96000640 1 -- 172.21.15.37:0/2862155520 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7feba8004c40 con 0x5620fbc3df10 2024-08-20T05:01:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.978+0000 7febb9ff2740 1 -- 172.21.15.37:0/2862155520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feba8004050 con 0x5620fbc3df10 2024-08-20T05:01:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.978+0000 7feb96000640 1 -- 172.21.15.37:0/2862155520 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feba8032050 con 0x5620fbc3df10 2024-08-20T05:01:54.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.978+0000 7febb9ff2740 10 client.15264 fetch_fsmap learned FSMap version 28 2024-08-20T05:01:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.978+0000 7febb9ff2740 1 -- 172.21.15.37:0/2862155520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5620fbc58d10 con 0x5620fbc3df10 2024-08-20T05:01:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.979+0000 7feb96000640 1 -- 172.21.15.37:0/2862155520 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba8004050 con 0x5620fbc3df10 2024-08-20T05:01:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.979+0000 7feb96000640 1 -- 172.21.15.37:0/2862155520 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7feba8023070 con 0x5620fbc3df10 2024-08-20T05:01:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.979+0000 7febb9ff2740 10 client.15264 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:01:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.979+0000 7febb9ff2740 10 client.15264 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-20T05:01:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.979+0000 7febb9ff2740 20 client.15264 populate_metadata read hostname 'smithi037' 2024-08-20T05:01:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.979+0000 7febb9ff2740 1 --2- 172.21.15.37:0/2862155520 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5620fbc5b0b0 0x5620fbc5c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.979+0000 7febb9ff2740 4 client.15264 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:01:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.979+0000 7febb9ff2740 1 -- 172.21.15.37:0/2862155520 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620fbbb6790 con 0x5620fbc5b0b0 2024-08-20T05:01:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.979+0000 7febafe00640 1 --2- 172.21.15.37:0/2862155520 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5620fbc5b0b0 0x5620fbc5c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.980+0000 7febafe00640 1 --2- 172.21.15.37:0/2862155520 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5620fbc5b0b0 0x5620fbc5c520 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9b52591f096b0ad3 server_cookie=3c881b0b253140d in_seq=0 out_seq=0 2024-08-20T05:01:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.980+0000 7feb96000640 10 client.15264 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:01:54.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.981+0000 7feb96000640 1 -- 172.21.15.37:0/2862155520 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5620fbbb6790 con 0x5620fbc5b0b0 2024-08-20T05:01:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.981+0000 7feb96000640 10 client.15264 handle_command_reply: tid=0 2024-08-20T05:01:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.981+0000 7febb9ff2740 1 client.15264 shutdown 2024-08-20T05:01:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.981+0000 7febb9ff2740 1 -- 172.21.15.37:0/2862155520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3df10 msgr2=0x5620fbc49fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.981+0000 7febb9ff2740 1 --2- 172.21.15.37:0/2862155520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3df10 0x5620fbc49fe0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7feba8014040 tx=0x7feba8003f50 comp rx=0 tx=0).stop 2024-08-20T05:01:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.981+0000 7febb9ff2740 1 -- 172.21.15.37:0/2862155520 shutdown_connections 2024-08-20T05:01:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.981+0000 7febb9ff2740 1 --2- 172.21.15.37:0/2862155520 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5620fbc5b0b0 0x5620fbc5c520 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.981+0000 7febb9ff2740 1 --2- 172.21.15.37:0/2862155520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc4a7c0 0x5620fbc47970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.981+0000 7febb9ff2740 1 --2- 172.21.15.37:0/2862155520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc3e830 0x5620fbc47430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.981+0000 7feb96000640 0 client.15264 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:01:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.981+0000 7febb9ff2740 1 --2- 172.21.15.37:0/2862155520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3df10 0x5620fbc49fe0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.981+0000 7febb9ff2740 1 -- 172.21.15.37:0/2862155520 >> 172.21.15.37:0/2862155520 conn(0x5620fbc3bd40 msgr2=0x5620fbc418e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.981+0000 7febb9ff2740 1 -- 172.21.15.37:0/2862155520 shutdown_connections 2024-08-20T05:01:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.981+0000 7febb9ff2740 1 -- 172.21.15.37:0/2862155520 wait complete. 2024-08-20T05:01:54.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:54.981+0000 7febb9ff2740 20 client.15264 trim_cache size 0 max 16384 2024-08-20T05:01:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.000+0000 7febb9ff2740 1 Processor -- start 2024-08-20T05:01:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.000+0000 7febb9ff2740 1 -- start start 2024-08-20T05:01:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.000+0000 7febb9ff2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3df10 0x5620fbc44660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.001+0000 7febb9ff2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3e830 0x5620fbc44ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.001+0000 7febb9ff2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc4a7c0 0x5620fbc48a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.001+0000 7febb9ff2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5620fbc5a860 con 0x5620fbc3df10 2024-08-20T05:01:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.001+0000 7febb9ff2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5620fbc5af30 con 0x5620fbc4a7c0 2024-08-20T05:01:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.001+0000 7febb9ff2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5620fbc5b600 con 0x5620fbc3e830 2024-08-20T05:01:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.001+0000 7febb5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3df10 0x5620fbc44660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.001+0000 7febb5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3df10 0x5620fbc44660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39010/0 (socket says 172.21.15.37:39010) 2024-08-20T05:01:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.001+0000 7febb5600640 1 -- 172.21.15.37:0/656785645 learned_addr learned my addr 172.21.15.37:0/656785645 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.001+0000 7febafe00640 1 --2- 172.21.15.37:0/656785645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3e830 0x5620fbc44ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.001+0000 7febb5600640 1 --2- 172.21.15.37:0/656785645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc4a7c0 0x5620fbc48a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.001+0000 7febb5600640 1 -- 172.21.15.37:0/656785645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3e830 msgr2=0x5620fbc44ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.001+0000 7febb5600640 1 --2- 172.21.15.37:0/656785645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3e830 0x5620fbc44ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.001+0000 7febb5600640 1 -- 172.21.15.37:0/656785645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc4a7c0 msgr2=0x5620fbc48a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.001+0000 7febb5600640 1 --2- 172.21.15.37:0/656785645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc4a7c0 0x5620fbc48a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.001+0000 7febb5600640 1 -- 172.21.15.37:0/656785645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620fbc3c7c0 con 0x5620fbc3df10 2024-08-20T05:01:55.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.001+0000 7febafe00640 1 --2- 172.21.15.37:0/656785645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3e830 0x5620fbc44ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:55.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.002+0000 7febb5600640 1 --2- 172.21.15.37:0/656785645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3df10 0x5620fbc44660 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feba80248f0 tx=0x7feba8009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ffe2d82f0fe5d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:55.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.002+0000 7feba1200640 1 -- 172.21.15.37:0/656785645 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba802b040 con 0x5620fbc3df10 2024-08-20T05:01:55.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.002+0000 7feba1200640 1 -- 172.21.15.37:0/656785645 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba8004620 con 0x5620fbc3df10 2024-08-20T05:01:55.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.002+0000 7feba1200640 1 -- 172.21.15.37:0/656785645 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba801d040 con 0x5620fbc3df10 2024-08-20T05:01:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.003+0000 7febb9ff2740 1 -- 172.21.15.37:0/656785645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3df10 msgr2=0x5620fbc44660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.003+0000 7febb9ff2740 1 --2- 172.21.15.37:0/656785645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3df10 0x5620fbc44660 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feba80248f0 tx=0x7feba8009520 comp rx=0 tx=0).stop 2024-08-20T05:01:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.003+0000 7febb9ff2740 1 -- 172.21.15.37:0/656785645 shutdown_connections 2024-08-20T05:01:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.003+0000 7febb9ff2740 1 --2- 172.21.15.37:0/656785645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc4a7c0 0x5620fbc48a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.003+0000 7febb9ff2740 1 --2- 172.21.15.37:0/656785645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3e830 0x5620fbc44ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.003+0000 7febb9ff2740 1 --2- 172.21.15.37:0/656785645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc3df10 0x5620fbc44660 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.003+0000 7febb9ff2740 1 -- 172.21.15.37:0/656785645 >> 172.21.15.37:0/656785645 conn(0x5620fbc3bd40 msgr2=0x5620fbc42a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.003+0000 7febb9ff2740 1 -- 172.21.15.37:0/656785645 shutdown_connections 2024-08-20T05:01:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.003+0000 7febb9ff2740 1 -- 172.21.15.37:0/656785645 wait complete. 2024-08-20T05:01:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.003+0000 7febb9ff2740 1 -- start start 2024-08-20T05:01:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.003+0000 7febb9ff2740 1 Processor -- start 2024-08-20T05:01:55.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.004+0000 7febb9ff2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3df10 0x5620fbc44610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.004+0000 7febb9ff2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc3e830 0x5620fbc44b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.004+0000 7febb9ff2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc4a7c0 0x5620fbc45090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.004+0000 7febb9ff2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5620fbc5c3a0 con 0x5620fbc4a7c0 2024-08-20T05:01:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.004+0000 7febb9ff2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5620fbc5bcd0 con 0x5620fbc3e830 2024-08-20T05:01:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.004+0000 7febb9ff2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5620fbc5ca70 con 0x5620fbc3df10 2024-08-20T05:01:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.004+0000 7febb9ff2740 10 client.0 _ll_register_callbacks cb 0x7feba4107c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:01:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.004+0000 7febb5600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3df10 0x5620fbc44610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.004+0000 7febb5600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3df10 0x5620fbc44610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50990/0 (socket says 172.21.15.37:50990) 2024-08-20T05:01:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.004+0000 7febb5600640 1 -- 172.21.15.37:0/1318684799 learned_addr learned my addr 172.21.15.37:0/1318684799 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.004+0000 7febafe00640 1 --2- 172.21.15.37:0/1318684799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc3e830 0x5620fbc44b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:55.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.004+0000 7febb5600640 1 --2- 172.21.15.37:0/1318684799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc4a7c0 0x5620fbc45090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.005+0000 7febb5600640 1 -- 172.21.15.37:0/1318684799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc3e830 msgr2=0x5620fbc44b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.005+0000 7febb5600640 1 --2- 172.21.15.37:0/1318684799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc3e830 0x5620fbc44b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.005+0000 7febb5600640 1 -- 172.21.15.37:0/1318684799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc4a7c0 msgr2=0x5620fbc45090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.005+0000 7febb5600640 1 --2- 172.21.15.37:0/1318684799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc4a7c0 0x5620fbc45090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.005+0000 7febb5600640 1 -- 172.21.15.37:0/1318684799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620fbc63f00 con 0x5620fbc3df10 2024-08-20T05:01:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.005+0000 7febb5600640 1 --2- 172.21.15.37:0/1318684799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3df10 0x5620fbc44610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feba8024b90 tx=0x7feba8039040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79f12264a44f6586 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.005+0000 7feb96000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:01:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.005+0000 7feb96000640 1 -- 172.21.15.37:0/1318684799 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba801d070 con 0x5620fbc3df10 2024-08-20T05:01:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.005+0000 7febb9ff2740 1 -- 172.21.15.37:0/1318684799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feba8004620 con 0x5620fbc3df10 2024-08-20T05:01:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.005+0000 7feb96000640 1 -- 172.21.15.37:0/1318684799 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7feba8004970 con 0x5620fbc3df10 2024-08-20T05:01:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.006+0000 7feb96000640 1 -- 172.21.15.37:0/1318684799 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7feba802b070 con 0x5620fbc3df10 2024-08-20T05:01:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.006+0000 7febb9ff2740 10 client.25300 fetch_fsmap learned FSMap version 28 2024-08-20T05:01:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.006+0000 7febb9ff2740 1 -- 172.21.15.37:0/1318684799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5620fbcc5b80 con 0x5620fbc3df10 2024-08-20T05:01:55.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.006+0000 7feb96000640 1 -- 172.21.15.37:0/1318684799 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feba8004620 con 0x5620fbc3df10 2024-08-20T05:01:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.006+0000 7feb96000640 1 -- 172.21.15.37:0/1318684799 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7feba8023070 con 0x5620fbc3df10 2024-08-20T05:01:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.006+0000 7febb9ff2740 10 client.25300 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:01:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.006+0000 7febb9ff2740 10 client.25300 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-20T05:01:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.006+0000 7febb9ff2740 20 client.25300 populate_metadata read hostname 'smithi037' 2024-08-20T05:01:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.006+0000 7febb9ff2740 1 --2- 172.21.15.37:0/1318684799 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5620fbcca500 0x5620fbcc9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.006+0000 7febb9ff2740 4 client.25300 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T05:01:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.006+0000 7febb9ff2740 1 -- 172.21.15.37:0/1318684799 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "status"}) -- 0x5620fbbb2230 con 0x5620fbcca500 2024-08-20T05:01:55.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.007+0000 7febafe00640 1 --2- 172.21.15.37:0/1318684799 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5620fbcca500 0x5620fbcc9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.007+0000 7febafe00640 1 --2- 172.21.15.37:0/1318684799 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5620fbcca500 0x5620fbcc9210 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=26e6ce04da248600 server_cookie=596c5ff34e6eb936 in_seq=0 out_seq=0 2024-08-20T05:01:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.007+0000 7feb96000640 10 client.25300 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:01:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.007+0000 7feb96000640 1 -- 172.21.15.37:0/1318684799 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5620fbbb2230 con 0x5620fbcca500 2024-08-20T05:01:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.007+0000 7feb96000640 10 client.25300 handle_command_reply: tid=0 2024-08-20T05:01:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.007+0000 7febb9ff2740 1 client.25300 shutdown 2024-08-20T05:01:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.008+0000 7febb9ff2740 1 -- 172.21.15.37:0/1318684799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3df10 msgr2=0x5620fbc44610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.008+0000 7febb9ff2740 1 --2- 172.21.15.37:0/1318684799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3df10 0x5620fbc44610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feba8024b90 tx=0x7feba8039040 comp rx=0 tx=0).stop 2024-08-20T05:01:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.008+0000 7febb9ff2740 1 -- 172.21.15.37:0/1318684799 shutdown_connections 2024-08-20T05:01:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.008+0000 7febb9ff2740 1 --2- 172.21.15.37:0/1318684799 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5620fbcca500 0x5620fbcc9210 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.008+0000 7febb9ff2740 1 --2- 172.21.15.37:0/1318684799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5620fbc4a7c0 0x5620fbc45090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.008+0000 7febb9ff2740 1 --2- 172.21.15.37:0/1318684799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5620fbc3e830 0x5620fbc44b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.008+0000 7febb9ff2740 1 --2- 172.21.15.37:0/1318684799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5620fbc3df10 0x5620fbc44610 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.008+0000 7febb9ff2740 1 -- 172.21.15.37:0/1318684799 >> 172.21.15.37:0/1318684799 conn(0x5620fbc3bd40 msgr2=0x5620fbc410c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.008+0000 7feb96000640 0 client.25300 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:01:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.008+0000 7febb9ff2740 1 -- 172.21.15.37:0/1318684799 shutdown_connections 2024-08-20T05:01:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.008+0000 7febb9ff2740 1 -- 172.21.15.37:0/1318684799 wait complete. 2024-08-20T05:01:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.008+0000 7febb9ff2740 20 client.25300 trim_cache size 0 max 16384 2024-08-20T05:01:55.015 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T05:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 4, 2024-08-20T05:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24637, 2024-08-20T05:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-20T05:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-20T05:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-20T05:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 109.866773275, 2024-08-20T05:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-08-20T05:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 88, 2024-08-20T05:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 84, 2024-08-20T05:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 193.74942096800001 2024-08-20T05:01:55.017 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:01:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.009+0000 7febb7600640 1 -- 172.21.15.37:0/46580604 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feb980b3bd0 msgr2=0x7feb980b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.009+0000 7febb7600640 1 --2- 172.21.15.37:0/46580604 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feb980b3bd0 0x7feb980b6090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feba40caea0 tx=0x7feba4107d50 comp rx=0 tx=0).stop 2024-08-20T05:01:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.009+0000 7febb7600640 1 -- 172.21.15.37:0/46580604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febb0104ca0 msgr2=0x7febb019b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.009+0000 7febb7600640 1 --2- 172.21.15.37:0/46580604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febb0104ca0 0x7febb019b160 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7feba4005940 tx=0x7feba40040c0 comp rx=0 tx=0).stop 2024-08-20T05:01:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.009+0000 7febb7600640 1 -- 172.21.15.37:0/46580604 shutdown_connections 2024-08-20T05:01:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.009+0000 7febb7600640 1 --2- 172.21.15.37:0/46580604 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feb980b3bd0 0x7feb980b6090 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.009+0000 7febb7600640 1 --2- 172.21.15.37:0/46580604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febb010b030 0x7febb01a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.009+0000 7febb7600640 1 --2- 172.21.15.37:0/46580604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febb010a6b0 0x7febb019b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.009+0000 7febb7600640 1 --2- 172.21.15.37:0/46580604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febb0104ca0 0x7febb019b160 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.009+0000 7febb7600640 1 -- 172.21.15.37:0/46580604 >> 172.21.15.37:0/46580604 conn(0x7febb0100730 msgr2=0x7febb0102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.009+0000 7febb7600640 1 -- 172.21.15.37:0/46580604 shutdown_connections 2024-08-20T05:01:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:55.009+0000 7febb7600640 1 -- 172.21.15.37:0/46580604 wait complete. 2024-08-20T05:01:55.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:55 smithi130 ceph-mon[22007]: pgmap v391: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:55.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:55 smithi037 ceph-mon[17265]: pgmap v391: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:55.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:55 smithi135 ceph-mon[22342]: pgmap v391: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:01:55.949 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.c status 2024-08-20T05:01:56.326 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:56.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.948+0000 7fe23ac00640 1 -- 172.21.15.37:0/1357661624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2341039d0 msgr2=0x7fe234103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:56.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.948+0000 7fe23ac00640 1 --2- 172.21.15.37:0/1357661624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2341039d0 0x7fe234103db0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe224009900 tx=0x7fe22402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.948+0000 7fe23ac00640 1 -- 172.21.15.37:0/1357661624 shutdown_connections 2024-08-20T05:01:56.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.948+0000 7fe23ac00640 1 --2- 172.21.15.37:0/1357661624 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe23410ce30 0x7fe23410f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.948+0000 7fe23ac00640 1 --2- 172.21.15.37:0/1357661624 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe2341042f0 0x7fe23410c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.948+0000 7fe23ac00640 1 --2- 172.21.15.37:0/1357661624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2341039d0 0x7fe234103db0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.948+0000 7fe23ac00640 1 -- 172.21.15.37:0/1357661624 >> 172.21.15.37:0/1357661624 conn(0x7fe2340fd410 msgr2=0x7fe2340ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:56.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.948+0000 7fe23ac00640 1 -- 172.21.15.37:0/1357661624 shutdown_connections 2024-08-20T05:01:56.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.948+0000 7fe23ac00640 1 -- 172.21.15.37:0/1357661624 wait complete. 2024-08-20T05:01:56.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.949+0000 7fe23ac00640 1 Processor -- start 2024-08-20T05:01:56.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.950+0000 7fe23ac00640 1 -- start start 2024-08-20T05:01:56.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.950+0000 7fe23ac00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2341039d0 0x7fe23419b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.950+0000 7fe23ac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2341042f0 0x7fe23419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.950+0000 7fe23ac00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23410ce30 0x7fe2341a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.950+0000 7fe23ac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe234112af0 con 0x7fe2341042f0 2024-08-20T05:01:56.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.950+0000 7fe23ac00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe234112970 con 0x7fe2341039d0 2024-08-20T05:01:56.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.950+0000 7fe23ac00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe234112c70 con 0x7fe23410ce30 2024-08-20T05:01:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.950+0000 7fe22be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2341042f0 0x7fe23419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.950+0000 7fe233e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2341039d0 0x7fe23419b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.950+0000 7fe233e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2341039d0 0x7fe23419b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47208/0 (socket says 172.21.15.37:47208) 2024-08-20T05:01:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.950+0000 7fe238c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23410ce30 0x7fe2341a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.950+0000 7fe233e00640 1 -- 172.21.15.37:0/3636687858 learned_addr learned my addr 172.21.15.37:0/3636687858 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.951+0000 7fe233e00640 1 -- 172.21.15.37:0/3636687858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23410ce30 msgr2=0x7fe2341a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.951+0000 7fe233e00640 1 --2- 172.21.15.37:0/3636687858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23410ce30 0x7fe2341a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.951+0000 7fe233e00640 1 -- 172.21.15.37:0/3636687858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2341042f0 msgr2=0x7fe23419b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.951+0000 7fe233e00640 1 --2- 172.21.15.37:0/3636687858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2341042f0 0x7fe23419b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.951+0000 7fe233e00640 1 -- 172.21.15.37:0/3636687858 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2341a1390 con 0x7fe2341039d0 2024-08-20T05:01:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.951+0000 7fe22be00640 1 --2- 172.21.15.37:0/3636687858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2341042f0 0x7fe23419b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.951+0000 7fe238c00640 1 --2- 172.21.15.37:0/3636687858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23410ce30 0x7fe2341a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.951+0000 7fe233e00640 1 --2- 172.21.15.37:0/3636687858 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2341039d0 0x7fe23419b2e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe224005ab0 tx=0x7fe224003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.952+0000 7fe231600640 1 -- 172.21.15.37:0/3636687858 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22403f070 con 0x7fe2341039d0 2024-08-20T05:01:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.952+0000 7fe231600640 1 -- 172.21.15.37:0/3636687858 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe224031d60 con 0x7fe2341039d0 2024-08-20T05:01:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.952+0000 7fe231600640 1 -- 172.21.15.37:0/3636687858 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224035030 con 0x7fe2341039d0 2024-08-20T05:01:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.952+0000 7fe23ac00640 1 -- 172.21.15.37:0/3636687858 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2341a1620 con 0x7fe2341039d0 2024-08-20T05:01:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.952+0000 7fe23ac00640 1 -- 172.21.15.37:0/3636687858 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2341a7d40 con 0x7fe2341039d0 2024-08-20T05:01:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.955+0000 7fe23d6aa740 1 Processor -- start 2024-08-20T05:01:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.956+0000 7fe23d6aa740 1 -- start start 2024-08-20T05:01:56.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.956+0000 7fe23d6aa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a11f10 0x55a2a5a122f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.956+0000 7fe23d6aa740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a12830 0x55a2a5a1e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.956+0000 7fe23d6aa740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a20bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.956+0000 7fe23d6aa740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a2a5988840 con 0x55a2a5a12830 2024-08-20T05:01:56.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.956+0000 7fe23d6aa740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a2a5977d40 con 0x55a2a5a1e7c0 2024-08-20T05:01:56.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.956+0000 7fe23d6aa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a2a597bd80 con 0x55a2a5a11f10 2024-08-20T05:01:56.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.956+0000 7fe238c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a11f10 0x55a2a5a122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.956+0000 7fe22be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a20bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.956+0000 7fe238c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a11f10 0x55a2a5a122f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51022/0 (socket says 172.21.15.37:51022) 2024-08-20T05:01:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.956+0000 7fe238c00640 1 -- 172.21.15.37:0/2700286255 learned_addr learned my addr 172.21.15.37:0/2700286255 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.957+0000 7fe231600640 1 -- 172.21.15.37:0/3636687858 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe224042070 con 0x7fe2341039d0 2024-08-20T05:01:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.957+0000 7fe22be00640 1 -- 172.21.15.37:0/2700286255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a11f10 msgr2=0x55a2a5a122f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.957+0000 7fe22be00640 1 --2- 172.21.15.37:0/2700286255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a11f10 0x55a2a5a122f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.957+0000 7fe22be00640 1 -- 172.21.15.37:0/2700286255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a12830 msgr2=0x55a2a5a1e280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:01:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.957+0000 7fe22be00640 1 --2- 172.21.15.37:0/2700286255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a12830 0x55a2a5a1e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.957+0000 7fe22be00640 1 -- 172.21.15.37:0/2700286255 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2a591e1c0 con 0x55a2a5a1e7c0 2024-08-20T05:01:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.958+0000 7fe22be00640 1 --2- 172.21.15.37:0/2700286255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a20bb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe21c005fd0 tx=0x7fe21c010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c47dd43aaffca273 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.958+0000 7fe229200640 1 -- 172.21.15.37:0/2700286255 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c011700 con 0x55a2a5a1e7c0 2024-08-20T05:01:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.958+0000 7fe229200640 1 -- 172.21.15.37:0/2700286255 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe21c011d50 con 0x55a2a5a1e7c0 2024-08-20T05:01:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.958+0000 7fe229200640 1 -- 172.21.15.37:0/2700286255 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c01ce40 con 0x55a2a5a1e7c0 2024-08-20T05:01:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.958+0000 7fe231600640 1 --2- 172.21.15.37:0/3636687858 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe2180b3c50 0x7fe2180b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.959+0000 7fe23d6aa740 1 -- 172.21.15.37:0/2700286255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a1e7c0 msgr2=0x55a2a5a20bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.959+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/2700286255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a20bb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe21c005fd0 tx=0x7fe21c010860 comp rx=0 tx=0).stop 2024-08-20T05:01:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.959+0000 7fe231600640 1 -- 172.21.15.37:0/3636687858 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe2241047e0 con 0x7fe2341039d0 2024-08-20T05:01:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.959+0000 7fe23d6aa740 1 -- 172.21.15.37:0/2700286255 shutdown_connections 2024-08-20T05:01:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.959+0000 7fe238c00640 1 --2- 172.21.15.37:0/3636687858 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe2180b3c50 0x7fe2180b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.959+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/2700286255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a20bb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.959+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/2700286255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a12830 0x55a2a5a1e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.959+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/2700286255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a11f10 0x55a2a5a122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.959+0000 7fe23d6aa740 1 -- 172.21.15.37:0/2700286255 >> 172.21.15.37:0/2700286255 conn(0x55a2a5a0fd40 msgr2=0x55a2a5a10ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.959+0000 7fe23d6aa740 1 -- 172.21.15.37:0/2700286255 shutdown_connections 2024-08-20T05:01:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.959+0000 7fe23d6aa740 1 -- 172.21.15.37:0/2700286255 wait complete. 2024-08-20T05:01:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.960+0000 7fe23d6aa740 1 -- start start 2024-08-20T05:01:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.960+0000 7fe238c00640 1 --2- 172.21.15.37:0/3636687858 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe2180b3c50 0x7fe2180b6110 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0092a0 tx=0x7fe22c009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.960+0000 7fe23d6aa740 1 Processor -- start 2024-08-20T05:01:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.960+0000 7fe23d6aa740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a1dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.960+0000 7fe23d6aa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a12830 0x55a2a5a1b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.960+0000 7fe23d6aa740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a1b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.960+0000 7fe23d6aa740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a2a57da5f0 con 0x55a2a5a11f10 2024-08-20T05:01:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.960+0000 7fe23d6aa740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a2a5913170 con 0x55a2a5a1e7c0 2024-08-20T05:01:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.960+0000 7fe23d6aa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a2a5a21470 con 0x55a2a5a12830 2024-08-20T05:01:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.960+0000 7fe23d6aa740 10 client.0 _ll_register_callbacks cb 0x55a2a59728b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:01:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.960+0000 7fe233e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a1dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.961+0000 7fe233e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a1dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39044/0 (socket says 172.21.15.37:39044) 2024-08-20T05:01:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.961+0000 7fe233e00640 1 -- 172.21.15.37:0/3138072089 learned_addr learned my addr 172.21.15.37:0/3138072089 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.961+0000 7fe238c00640 1 --2- 172.21.15.37:0/3138072089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a1b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.961+0000 7fe22be00640 1 --2- 172.21.15.37:0/3138072089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a12830 0x55a2a5a1b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.961+0000 7fe233e00640 1 -- 172.21.15.37:0/3138072089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a12830 msgr2=0x55a2a5a1b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:56.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.961+0000 7fe233e00640 1 --2- 172.21.15.37:0/3138072089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a12830 0x55a2a5a1b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.961+0000 7fe233e00640 1 -- 172.21.15.37:0/3138072089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a1e7c0 msgr2=0x55a2a5a1b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:56.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.961+0000 7fe233e00640 1 --2- 172.21.15.37:0/3138072089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a1b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.961+0000 7fe233e00640 1 -- 172.21.15.37:0/3138072089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2a56d7540 con 0x55a2a5a11f10 2024-08-20T05:01:56.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.961+0000 7fe238c00640 1 --2- 172.21.15.37:0/3138072089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a1b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:01:56.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.961+0000 7fe233e00640 1 --2- 172.21.15.37:0/3138072089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a1dec0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe2240cb0e0 tx=0x7fe2240cb270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678757752ee1d942 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:56.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.961+0000 7fe221600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:01:56.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.961+0000 7fe221600640 1 -- 172.21.15.37:0/3138072089 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224049070 con 0x55a2a5a11f10 2024-08-20T05:01:56.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.962+0000 7fe221600640 1 -- 172.21.15.37:0/3138072089 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe22403b560 con 0x55a2a5a11f10 2024-08-20T05:01:56.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.962+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3138072089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe21c011d50 con 0x55a2a5a11f10 2024-08-20T05:01:56.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.962+0000 7fe221600640 1 -- 172.21.15.37:0/3138072089 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe2240cb3e0 con 0x55a2a5a11f10 2024-08-20T05:01:56.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.962+0000 7fe23d6aa740 10 client.15279 fetch_fsmap learned FSMap version 28 2024-08-20T05:01:56.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.962+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3138072089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a2a5a2cc10 con 0x55a2a5a11f10 2024-08-20T05:01:56.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.962+0000 7fe221600640 1 -- 172.21.15.37:0/3138072089 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe21c011d50 con 0x55a2a5a11f10 2024-08-20T05:01:56.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.962+0000 7fe221600640 1 -- 172.21.15.37:0/3138072089 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe2240d3f50 con 0x55a2a5a11f10 2024-08-20T05:01:56.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.962+0000 7fe23d6aa740 10 client.15279 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:01:56.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.962+0000 7fe23d6aa740 10 client.15279 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-20T05:01:56.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.962+0000 7fe23d6aa740 20 client.15279 populate_metadata read hostname 'smithi037' 2024-08-20T05:01:56.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.962+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/3138072089 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55a2a5a2f1d0 0x55a2a5a30640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.963+0000 7fe23d6aa740 4 client.15279 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:01:56.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.963+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3138072089 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2a598a790 con 0x55a2a5a2f1d0 2024-08-20T05:01:56.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.963+0000 7fe22be00640 1 --2- 172.21.15.37:0/3138072089 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55a2a5a2f1d0 0x55a2a5a30640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:56.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.964+0000 7fe22be00640 1 --2- 172.21.15.37:0/3138072089 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55a2a5a2f1d0 0x55a2a5a30640 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=18807590514b480e server_cookie=90ff7558a2e6955b in_seq=0 out_seq=0 2024-08-20T05:01:56.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.964+0000 7fe221600640 10 client.15279 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:01:56.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.964+0000 7fe221600640 1 -- 172.21.15.37:0/3138072089 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a2a598a790 con 0x55a2a5a2f1d0 2024-08-20T05:01:56.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.964+0000 7fe221600640 10 client.15279 handle_command_reply: tid=0 2024-08-20T05:01:56.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.965+0000 7fe23d6aa740 1 client.15279 shutdown 2024-08-20T05:01:56.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.965+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3138072089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 msgr2=0x55a2a5a1dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:56.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.965+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/3138072089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a1dec0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe2240cb0e0 tx=0x7fe2240cb270 comp rx=0 tx=0).stop 2024-08-20T05:01:56.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.965+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3138072089 shutdown_connections 2024-08-20T05:01:56.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.965+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/3138072089 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55a2a5a2f1d0 0x55a2a5a30640 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.965+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/3138072089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a1b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.965+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/3138072089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a12830 0x55a2a5a1b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.965+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/3138072089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a1dec0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.965+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3138072089 >> 172.21.15.37:0/3138072089 conn(0x55a2a5a0fd40 msgr2=0x55a2a5a158e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:56.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.965+0000 7fe221600640 0 client.15279 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:01:56.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.965+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3138072089 shutdown_connections 2024-08-20T05:01:56.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.965+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3138072089 wait complete. 2024-08-20T05:01:56.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.965+0000 7fe23d6aa740 20 client.15279 trim_cache size 0 max 16384 2024-08-20T05:01:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.984+0000 7fe23d6aa740 1 Processor -- start 2024-08-20T05:01:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.984+0000 7fe23d6aa740 1 -- start start 2024-08-20T05:01:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.984+0000 7fe23d6aa740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a2f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.984+0000 7fe23d6aa740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a12830 0x55a2a5a19b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.984+0000 7fe23d6aa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a1a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.984+0000 7fe23d6aa740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a2a5a2e980 con 0x55a2a5a11f10 2024-08-20T05:01:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.984+0000 7fe23d6aa740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a2a5a2f050 con 0x55a2a5a12830 2024-08-20T05:01:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.984+0000 7fe23d6aa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a2a5a2f720 con 0x55a2a5a1e7c0 2024-08-20T05:01:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.985+0000 7fe233e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a2f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.985+0000 7fe233e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a2f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39056/0 (socket says 172.21.15.37:39056) 2024-08-20T05:01:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.985+0000 7fe233e00640 1 -- 172.21.15.37:0/3416321638 learned_addr learned my addr 172.21.15.37:0/3416321638 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.985+0000 7fe22be00640 1 --2- 172.21.15.37:0/3416321638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a12830 0x55a2a5a19b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.985+0000 7fe238c00640 1 --2- 172.21.15.37:0/3416321638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a1a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.985+0000 7fe233e00640 1 -- 172.21.15.37:0/3416321638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a1e7c0 msgr2=0x55a2a5a1a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.985+0000 7fe233e00640 1 --2- 172.21.15.37:0/3416321638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a1a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.985+0000 7fe233e00640 1 -- 172.21.15.37:0/3416321638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a12830 msgr2=0x55a2a5a19b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.985+0000 7fe233e00640 1 --2- 172.21.15.37:0/3416321638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a12830 0x55a2a5a19b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.985+0000 7fe233e00640 1 -- 172.21.15.37:0/3416321638 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2a5a107c0 con 0x55a2a5a11f10 2024-08-20T05:01:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.985+0000 7fe238c00640 1 --2- 172.21.15.37:0/3416321638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a1a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:01:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.985+0000 7fe233e00640 1 --2- 172.21.15.37:0/3416321638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a2f1d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe2240cb370 tx=0x7fe2240cb2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b03eca0913de57 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.985+0000 7fe223e00640 1 -- 172.21.15.37:0/3416321638 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224049070 con 0x55a2a5a11f10 2024-08-20T05:01:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.986+0000 7fe223e00640 1 -- 172.21.15.37:0/3416321638 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2240cf930 con 0x55a2a5a11f10 2024-08-20T05:01:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.986+0000 7fe223e00640 1 -- 172.21.15.37:0/3416321638 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224104b80 con 0x55a2a5a11f10 2024-08-20T05:01:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.986+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3416321638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 msgr2=0x55a2a5a2f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.986+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/3416321638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a2f1d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe2240cb370 tx=0x7fe2240cb2e0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.986+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3416321638 shutdown_connections 2024-08-20T05:01:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.986+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/3416321638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a1a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.986+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/3416321638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a12830 0x55a2a5a19b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.986+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/3416321638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a2f1d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.986+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3416321638 >> 172.21.15.37:0/3416321638 conn(0x55a2a5a0fd40 msgr2=0x55a2a5a2df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.986+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3416321638 shutdown_connections 2024-08-20T05:01:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.986+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3416321638 wait complete. 2024-08-20T05:01:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.987+0000 7fe23d6aa740 1 -- start start 2024-08-20T05:01:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.987+0000 7fe23d6aa740 1 Processor -- start 2024-08-20T05:01:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.987+0000 7fe23d6aa740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a31e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.987+0000 7fe23d6aa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a12830 0x55a2a5a323f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.987+0000 7fe23d6aa740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a373b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.987+0000 7fe23d6aa740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a2a5a304c0 con 0x55a2a5a11f10 2024-08-20T05:01:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.987+0000 7fe23d6aa740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a2a5a2fdf0 con 0x55a2a5a1e7c0 2024-08-20T05:01:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.987+0000 7fe23d6aa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a2a5a30b90 con 0x55a2a5a12830 2024-08-20T05:01:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.987+0000 7fe23d6aa740 10 client.0 _ll_register_callbacks cb 0x7fe2240c72a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:01:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.988+0000 7fe233e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a31e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.988+0000 7fe233e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a31e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39068/0 (socket says 172.21.15.37:39068) 2024-08-20T05:01:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.988+0000 7fe233e00640 1 -- 172.21.15.37:0/3133836149 learned_addr learned my addr 172.21.15.37:0/3133836149 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.988+0000 7fe22be00640 1 --2- 172.21.15.37:0/3133836149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a12830 0x55a2a5a323f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.988+0000 7fe238c00640 1 --2- 172.21.15.37:0/3133836149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a373b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.988+0000 7fe233e00640 1 -- 172.21.15.37:0/3133836149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a12830 msgr2=0x55a2a5a323f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.988+0000 7fe233e00640 1 --2- 172.21.15.37:0/3133836149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a12830 0x55a2a5a323f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.988+0000 7fe233e00640 1 -- 172.21.15.37:0/3133836149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a1e7c0 msgr2=0x55a2a5a373b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.988+0000 7fe233e00640 1 --2- 172.21.15.37:0/3133836149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a373b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.988+0000 7fe233e00640 1 -- 172.21.15.37:0/3133836149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2a5a37ac0 con 0x55a2a5a11f10 2024-08-20T05:01:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.988+0000 7fe233e00640 1 --2- 172.21.15.37:0/3133836149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a31e70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe2240ca7d0 tx=0x7fe2240d41f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1851ab06d4e988 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.988+0000 7fe221600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:01:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.989+0000 7fe221600640 1 -- 172.21.15.37:0/3133836149 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe224049070 con 0x55a2a5a11f10 2024-08-20T05:01:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.989+0000 7fe221600640 1 -- 172.21.15.37:0/3133836149 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe2240318b0 con 0x55a2a5a11f10 2024-08-20T05:01:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.989+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3133836149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2240cf930 con 0x55a2a5a11f10 2024-08-20T05:01:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.989+0000 7fe221600640 1 -- 172.21.15.37:0/3133836149 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe2240d43e0 con 0x55a2a5a11f10 2024-08-20T05:01:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.989+0000 7fe23d6aa740 10 client.15285 fetch_fsmap learned FSMap version 28 2024-08-20T05:01:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.989+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3133836149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a2a5a37ac0 con 0x55a2a5a11f10 2024-08-20T05:01:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.989+0000 7fe221600640 1 -- 172.21.15.37:0/3133836149 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2240cf930 con 0x55a2a5a11f10 2024-08-20T05:01:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.989+0000 7fe221600640 1 -- 172.21.15.37:0/3133836149 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe2240c5b00 con 0x55a2a5a11f10 2024-08-20T05:01:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.989+0000 7fe23d6aa740 10 client.15285 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:01:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.989+0000 7fe23d6aa740 10 client.15285 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-20T05:01:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.989+0000 7fe23d6aa740 20 client.15285 populate_metadata read hostname 'smithi037' 2024-08-20T05:01:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.989+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/3133836149 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55a2a5aa5cb0 0x55a2a5aa20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.989+0000 7fe23d6aa740 4 client.15285 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T05:01:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.989+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3133836149 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "status"}) -- 0x55a2a5986230 con 0x55a2a5aa5cb0 2024-08-20T05:01:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.990+0000 7fe22be00640 1 --2- 172.21.15.37:0/3133836149 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55a2a5aa5cb0 0x55a2a5aa20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.990+0000 7fe22be00640 1 --2- 172.21.15.37:0/3133836149 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55a2a5aa5cb0 0x55a2a5aa20f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1e7c3fdae497e73a server_cookie=5db7f405b90d0277 in_seq=0 out_seq=0 2024-08-20T05:01:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.990+0000 7fe221600640 10 client.15285 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:01:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.991+0000 7fe221600640 1 -- 172.21.15.37:0/3133836149 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55a2a5986230 con 0x55a2a5aa5cb0 2024-08-20T05:01:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.991+0000 7fe221600640 10 client.15285 handle_command_reply: tid=0 2024-08-20T05:01:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.991+0000 7fe23d6aa740 1 client.15285 shutdown 2024-08-20T05:01:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.991+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3133836149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 msgr2=0x55a2a5a31e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.991+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/3133836149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a31e70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe2240ca7d0 tx=0x7fe2240d41f0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.991+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3133836149 shutdown_connections 2024-08-20T05:01:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.991+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/3133836149 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55a2a5aa5cb0 0x55a2a5aa20f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.991+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/3133836149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2a5a1e7c0 0x55a2a5a373b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.991+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/3133836149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2a5a12830 0x55a2a5a323f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.991+0000 7fe23d6aa740 1 --2- 172.21.15.37:0/3133836149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2a5a11f10 0x55a2a5a31e70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.991+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3133836149 >> 172.21.15.37:0/3133836149 conn(0x55a2a5a0fd40 msgr2=0x55a2a5a19ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.991+0000 7fe221600640 0 client.15285 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:01:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.991+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3133836149 shutdown_connections 2024-08-20T05:01:56.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.991+0000 7fe23d6aa740 1 -- 172.21.15.37:0/3133836149 wait complete. 2024-08-20T05:01:56.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.991+0000 7fe23d6aa740 20 client.15285 trim_cache size 0 max 16384 2024-08-20T05:01:56.998 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:01:56.998 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T05:01:56.998 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 3, 2024-08-20T05:01:56.998 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24649, 2024-08-20T05:01:56.998 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-20T05:01:56.998 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-20T05:01:56.999 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-20T05:01:56.999 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 112.856741263, 2024-08-20T05:01:56.999 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-08-20T05:01:56.999 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 88, 2024-08-20T05:01:56.999 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 84, 2024-08-20T05:01:56.999 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 193.16356902199999 2024-08-20T05:01:56.999 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:01:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.992+0000 7fe23ac00640 1 -- 172.21.15.37:0/3636687858 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe2180b3c50 msgr2=0x7fe2180b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.992+0000 7fe23ac00640 1 --2- 172.21.15.37:0/3636687858 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe2180b3c50 0x7fe2180b6110 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0092a0 tx=0x7fe22c009600 comp rx=0 tx=0).stop 2024-08-20T05:01:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.992+0000 7fe23ac00640 1 -- 172.21.15.37:0/3636687858 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2341039d0 msgr2=0x7fe23419b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.992+0000 7fe23ac00640 1 --2- 172.21.15.37:0/3636687858 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2341039d0 0x7fe23419b2e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe224005ab0 tx=0x7fe224003cd0 comp rx=0 tx=0).stop 2024-08-20T05:01:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.992+0000 7fe23ac00640 1 -- 172.21.15.37:0/3636687858 shutdown_connections 2024-08-20T05:01:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.992+0000 7fe23ac00640 1 --2- 172.21.15.37:0/3636687858 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe2180b3c50 0x7fe2180b6110 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.992+0000 7fe23ac00640 1 --2- 172.21.15.37:0/3636687858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe23410ce30 0x7fe2341a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.992+0000 7fe23ac00640 1 --2- 172.21.15.37:0/3636687858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2341042f0 0x7fe23419b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.992+0000 7fe23ac00640 1 --2- 172.21.15.37:0/3636687858 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2341039d0 0x7fe23419b2e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.992+0000 7fe23ac00640 1 -- 172.21.15.37:0/3636687858 >> 172.21.15.37:0/3636687858 conn(0x7fe2340fd410 msgr2=0x7fe23410f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.992+0000 7fe23ac00640 1 -- 172.21.15.37:0/3636687858 shutdown_connections 2024-08-20T05:01:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:56.992+0000 7fe23ac00640 1 -- 172.21.15.37:0/3636687858 wait complete. 2024-08-20T05:01:57.659 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:57 smithi037 ceph-mon[17265]: pgmap v392: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:57.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:57 smithi130 ceph-mon[22007]: pgmap v392: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:57.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.h status 2024-08-20T05:01:57.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:57 smithi135 ceph-mon[22342]: pgmap v392: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:58.170 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:01:58.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.742+0000 7f890ea00640 1 -- 172.21.15.37:0/2412716279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8908108cb0 msgr2=0x7f890810f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:58.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.742+0000 7f890ea00640 1 --2- 172.21.15.37:0/2412716279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8908108cb0 0x7f890810f4b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8900009ca0 tx=0x7f890002a8c0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.742+0000 7f890ea00640 1 -- 172.21.15.37:0/2412716279 shutdown_connections 2024-08-20T05:01:58.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.742+0000 7f890ea00640 1 --2- 172.21.15.37:0/2412716279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8908108cb0 0x7f890810f4b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.742+0000 7f890ea00640 1 --2- 172.21.15.37:0/2412716279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8908108330 0x7f8908108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.742+0000 7f890ea00640 1 --2- 172.21.15.37:0/2412716279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8908102920 0x7f8908102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.742+0000 7f890ea00640 1 -- 172.21.15.37:0/2412716279 >> 172.21.15.37:0/2412716279 conn(0x7f89080fe350 msgr2=0x7f8908100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:58.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.742+0000 7f890ea00640 1 -- 172.21.15.37:0/2412716279 shutdown_connections 2024-08-20T05:01:58.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.742+0000 7f890ea00640 1 -- 172.21.15.37:0/2412716279 wait complete. 2024-08-20T05:01:58.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.743+0000 7f890ea00640 1 Processor -- start 2024-08-20T05:01:58.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.744+0000 7f890ea00640 1 -- start start 2024-08-20T05:01:58.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.744+0000 7f890ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8908102920 0x7f89080751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.744+0000 7f890ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8908108330 0x7f8908075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.744+0000 7f890ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8908108cb0 0x7f8908075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.744+0000 7f890ea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f89081129c0 con 0x7f8908108330 2024-08-20T05:01:58.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.744+0000 7f890ea00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8908112840 con 0x7f8908102920 2024-08-20T05:01:58.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.744+0000 7f890ea00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8908112b40 con 0x7f8908108cb0 2024-08-20T05:01:58.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.744+0000 7f890cc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8908108330 0x7f8908075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.745+0000 7f890cc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8908108330 0x7f8908075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39088/0 (socket says 172.21.15.37:39088) 2024-08-20T05:01:58.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.745+0000 7f890cc00640 1 -- 172.21.15.37:0/3595593695 learned_addr learned my addr 172.21.15.37:0/3595593695 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:58.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.745+0000 7f890d600640 1 --2- 172.21.15.37:0/3595593695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8908102920 0x7f89080751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.745+0000 7f890e000640 1 --2- 172.21.15.37:0/3595593695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8908108cb0 0x7f8908075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.745+0000 7f890cc00640 1 -- 172.21.15.37:0/3595593695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8908108cb0 msgr2=0x7f8908075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:58.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.745+0000 7f890cc00640 1 --2- 172.21.15.37:0/3595593695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8908108cb0 0x7f8908075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.745+0000 7f890cc00640 1 -- 172.21.15.37:0/3595593695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8908102920 msgr2=0x7f89080751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:58.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.745+0000 7f890cc00640 1 --2- 172.21.15.37:0/3595593695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8908102920 0x7f89080751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.745+0000 7f890cc00640 1 -- 172.21.15.37:0/3595593695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89081a7110 con 0x7f8908108330 2024-08-20T05:01:58.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.745+0000 7f890cc00640 1 --2- 172.21.15.37:0/3595593695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8908108330 0x7f8908075710 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f88f400e9f0 tx=0x7f88f400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:58.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.746+0000 7f8906000640 1 -- 172.21.15.37:0/3595593695 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f400cd80 con 0x7f8908108330 2024-08-20T05:01:58.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.746+0000 7f8906000640 1 -- 172.21.15.37:0/3595593695 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88f40054d0 con 0x7f8908108330 2024-08-20T05:01:58.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.746+0000 7f890ea00640 1 -- 172.21.15.37:0/3595593695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89081a7400 con 0x7f8908108330 2024-08-20T05:01:58.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.746+0000 7f8906000640 1 -- 172.21.15.37:0/3595593695 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f4010690 con 0x7f8908108330 2024-08-20T05:01:58.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.746+0000 7f890ea00640 1 -- 172.21.15.37:0/3595593695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89081a78f0 con 0x7f8908108330 2024-08-20T05:01:58.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.749+0000 7f8912c3e740 1 Processor -- start 2024-08-20T05:01:58.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.749+0000 7f8912c3e740 1 -- start start 2024-08-20T05:01:58.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.749+0000 7f8906000640 1 -- 172.21.15.37:0/3595593695 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f88f4004e70 con 0x7f8908108330 2024-08-20T05:01:58.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.749+0000 7f8912c3e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080170 0x562443080550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.749+0000 7f8912c3e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562443080a90 0x56244308c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.749+0000 7f8912c3e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56244308ca20 0x56244308ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.749+0000 7f8912c3e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562442ff6840 con 0x562443080170 2024-08-20T05:01:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.749+0000 7f8912c3e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562442fe5d40 con 0x56244308ca20 2024-08-20T05:01:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.749+0000 7f8912c3e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562442fe9d80 con 0x562443080a90 2024-08-20T05:01:58.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.750+0000 7f890e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080170 0x562443080550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.750+0000 7f890d600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562443080a90 0x56244308c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.750+0000 7f890e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080170 0x562443080550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39092/0 (socket says 172.21.15.37:39092) 2024-08-20T05:01:58.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.750+0000 7f890d600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562443080a90 0x56244308c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51058/0 (socket says 172.21.15.37:51058) 2024-08-20T05:01:58.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.750+0000 7f890e000640 1 -- 172.21.15.37:0/1353002776 learned_addr learned my addr 172.21.15.37:0/1353002776 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:58.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.750+0000 7f890cc00640 1 --2- 172.21.15.37:0/1353002776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56244308ca20 0x56244308ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.750+0000 7f890e000640 1 -- 172.21.15.37:0/1353002776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562443080a90 msgr2=0x56244308c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:58.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.750+0000 7f890e000640 1 --2- 172.21.15.37:0/1353002776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562443080a90 0x56244308c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.750+0000 7f890e000640 1 -- 172.21.15.37:0/1353002776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56244308ca20 msgr2=0x56244308ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:58.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.750+0000 7f890e000640 1 --2- 172.21.15.37:0/1353002776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56244308ca20 0x56244308ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.750+0000 7f890e000640 1 -- 172.21.15.37:0/1353002776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562442f8c1c0 con 0x562443080170 2024-08-20T05:01:58.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.750+0000 7f890cc00640 1 --2- 172.21.15.37:0/1353002776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56244308ca20 0x56244308ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:01:58.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.751+0000 7f890e000640 1 --2- 172.21.15.37:0/1353002776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080170 0x562443080550 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8900035000 tx=0x7f8900005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce447dea2c3e87b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:58.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.751+0000 7f88fa600640 1 -- 172.21.15.37:0/1353002776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900031cf0 con 0x562443080170 2024-08-20T05:01:58.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.751+0000 7f88fa600640 1 -- 172.21.15.37:0/1353002776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8900036070 con 0x562443080170 2024-08-20T05:01:58.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.751+0000 7f88fa600640 1 -- 172.21.15.37:0/1353002776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900004240 con 0x562443080170 2024-08-20T05:01:58.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.751+0000 7f8906000640 1 --2- 172.21.15.37:0/3595593695 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f88f00b3c70 0x7f88f00b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.751+0000 7f8906000640 1 -- 172.21.15.37:0/3595593695 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f88f40e43e0 con 0x7f8908108330 2024-08-20T05:01:58.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.751+0000 7f890d600640 1 --2- 172.21.15.37:0/3595593695 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f88f00b3c70 0x7f88f00b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.752+0000 7f8912c3e740 1 -- 172.21.15.37:0/1353002776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080170 msgr2=0x562443080550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:58.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.752+0000 7f8912c3e740 1 --2- 172.21.15.37:0/1353002776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080170 0x562443080550 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8900035000 tx=0x7f8900005f80 comp rx=0 tx=0).stop 2024-08-20T05:01:58.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.752+0000 7f8912c3e740 1 -- 172.21.15.37:0/1353002776 shutdown_connections 2024-08-20T05:01:58.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.752+0000 7f8912c3e740 1 --2- 172.21.15.37:0/1353002776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56244308ca20 0x56244308ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.752+0000 7f8912c3e740 1 --2- 172.21.15.37:0/1353002776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562443080a90 0x56244308c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.752+0000 7f8912c3e740 1 --2- 172.21.15.37:0/1353002776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080170 0x562443080550 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.752+0000 7f8912c3e740 1 -- 172.21.15.37:0/1353002776 >> 172.21.15.37:0/1353002776 conn(0x56244307dfa0 msgr2=0x56244307f140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:58.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.752+0000 7f890d600640 1 --2- 172.21.15.37:0/3595593695 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f88f00b3c70 0x7f88f00b6130 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x5624430832f0 tx=0x7f88fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:58.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.752+0000 7f8912c3e740 1 -- 172.21.15.37:0/1353002776 shutdown_connections 2024-08-20T05:01:58.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.752+0000 7f8912c3e740 1 -- 172.21.15.37:0/1353002776 wait complete. 2024-08-20T05:01:58.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.753+0000 7f8912c3e740 1 -- start start 2024-08-20T05:01:58.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.753+0000 7f8912c3e740 1 Processor -- start 2024-08-20T05:01:58.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.753+0000 7f8912c3e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080170 0x56244308c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.753+0000 7f8912c3e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562443080a90 0x562443089670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.753+0000 7f8912c3e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56244308ca20 0x562443089bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.754+0000 7f8912c3e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562442e485f0 con 0x562443080170 2024-08-20T05:01:58.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.754+0000 7f8912c3e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562442f81170 con 0x56244308ca20 2024-08-20T05:01:58.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.754+0000 7f8912c3e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56244308f4f0 con 0x562443080a90 2024-08-20T05:01:58.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.754+0000 7f8912c3e740 10 client.0 _ll_register_callbacks cb 0x562442fe08b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:01:58.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.754+0000 7f890d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080170 0x56244308c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.754+0000 7f890d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080170 0x56244308c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39108/0 (socket says 172.21.15.37:39108) 2024-08-20T05:01:58.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.754+0000 7f890d600640 1 -- 172.21.15.37:0/4249964045 learned_addr learned my addr 172.21.15.37:0/4249964045 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:58.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.754+0000 7f890cc00640 1 --2- 172.21.15.37:0/4249964045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562443080a90 0x562443089670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.754+0000 7f890e000640 1 --2- 172.21.15.37:0/4249964045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56244308ca20 0x562443089bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.754+0000 7f890cc00640 1 -- 172.21.15.37:0/4249964045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56244308ca20 msgr2=0x562443089bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:58.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.754+0000 7f890cc00640 1 --2- 172.21.15.37:0/4249964045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56244308ca20 0x562443089bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.754+0000 7f890cc00640 1 -- 172.21.15.37:0/4249964045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080170 msgr2=0x56244308c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:58.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.754+0000 7f890cc00640 1 --2- 172.21.15.37:0/4249964045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080170 0x56244308c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.754+0000 7f890cc00640 1 -- 172.21.15.37:0/4249964045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562442d45540 con 0x562443080a90 2024-08-20T05:01:58.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.754+0000 7f890d600640 1 --2- 172.21.15.37:0/4249964045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080170 0x56244308c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:01:58.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.755+0000 7f890cc00640 1 --2- 172.21.15.37:0/4249964045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562443080a90 0x562443089670 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f88f40e1b90 tx=0x7f88f40aa9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22eb475e7d88a3ef server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:58.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.755+0000 7f88eea00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:01:58.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.755+0000 7f88eea00640 1 -- 172.21.15.37:0/4249964045 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f40ab690 con 0x562443080a90 2024-08-20T05:01:58.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.755+0000 7f8912c3e740 1 -- 172.21.15.37:0/4249964045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8900036070 con 0x562443080a90 2024-08-20T05:01:58.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.755+0000 7f88eea00640 1 -- 172.21.15.37:0/4249964045 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f88f40e4170 con 0x562443080a90 2024-08-20T05:01:58.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.755+0000 7f88eea00640 1 -- 172.21.15.37:0/4249964045 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f88f40aaf90 con 0x562443080a90 2024-08-20T05:01:58.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.755+0000 7f8912c3e740 10 client.25330 fetch_fsmap learned FSMap version 28 2024-08-20T05:01:58.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.755+0000 7f8912c3e740 1 -- 172.21.15.37:0/4249964045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56244309ae40 con 0x562443080a90 2024-08-20T05:01:58.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.755+0000 7f88eea00640 1 -- 172.21.15.37:0/4249964045 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8900036070 con 0x562443080a90 2024-08-20T05:01:58.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.756+0000 7f88eea00640 1 -- 172.21.15.37:0/4249964045 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f88f40a6900 con 0x562443080a90 2024-08-20T05:01:58.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.756+0000 7f8912c3e740 10 client.25330 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:01:58.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.756+0000 7f8912c3e740 10 client.25330 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-20T05:01:58.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.756+0000 7f8912c3e740 20 client.25330 populate_metadata read hostname 'smithi037' 2024-08-20T05:01:58.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.756+0000 7f8912c3e740 1 --2- 172.21.15.37:0/4249964045 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56244309d340 0x56244309e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.756+0000 7f8912c3e740 4 client.25330 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:01:58.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.756+0000 7f8912c3e740 1 -- 172.21.15.37:0/4249964045 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562442ff8790 con 0x56244309d340 2024-08-20T05:01:58.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.756+0000 7f890d600640 1 --2- 172.21.15.37:0/4249964045 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56244309d340 0x56244309e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.757+0000 7f890d600640 1 --2- 172.21.15.37:0/4249964045 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56244309d340 0x56244309e7b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6be7596b13a350db server_cookie=1ccd4c81617ec121 in_seq=0 out_seq=0 2024-08-20T05:01:58.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.757+0000 7f88eea00640 10 client.25330 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:01:58.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.758+0000 7f88eea00640 1 -- 172.21.15.37:0/4249964045 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562442ff8790 con 0x56244309d340 2024-08-20T05:01:58.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.758+0000 7f88eea00640 10 client.25330 handle_command_reply: tid=0 2024-08-20T05:01:58.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.758+0000 7f8912c3e740 1 client.25330 shutdown 2024-08-20T05:01:58.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.758+0000 7f8912c3e740 1 -- 172.21.15.37:0/4249964045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562443080a90 msgr2=0x562443089670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:58.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.758+0000 7f8912c3e740 1 --2- 172.21.15.37:0/4249964045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562443080a90 0x562443089670 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f88f40e1b90 tx=0x7f88f40aa9a0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.758+0000 7f8912c3e740 1 -- 172.21.15.37:0/4249964045 shutdown_connections 2024-08-20T05:01:58.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.758+0000 7f8912c3e740 1 --2- 172.21.15.37:0/4249964045 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56244309d340 0x56244309e7b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.758+0000 7f8912c3e740 1 --2- 172.21.15.37:0/4249964045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56244308ca20 0x562443089bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.758+0000 7f8912c3e740 1 --2- 172.21.15.37:0/4249964045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562443080a90 0x562443089670 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.758+0000 7f8912c3e740 1 --2- 172.21.15.37:0/4249964045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080170 0x56244308c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.758+0000 7f8912c3e740 1 -- 172.21.15.37:0/4249964045 >> 172.21.15.37:0/4249964045 conn(0x56244307dfa0 msgr2=0x562443083b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:58.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.758+0000 7f88eea00640 0 client.25330 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:01:58.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.758+0000 7f8912c3e740 1 -- 172.21.15.37:0/4249964045 shutdown_connections 2024-08-20T05:01:58.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.758+0000 7f8912c3e740 1 -- 172.21.15.37:0/4249964045 wait complete. 2024-08-20T05:01:58.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.758+0000 7f8912c3e740 20 client.25330 trim_cache size 0 max 16384 2024-08-20T05:01:58.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.777+0000 7f8912c3e740 1 Processor -- start 2024-08-20T05:01:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.777+0000 7f8912c3e740 1 -- start start 2024-08-20T05:01:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.777+0000 7f8912c3e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562443080170 0x56244309da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.777+0000 7f8912c3e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080a90 0x562443087ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.777+0000 7f8912c3e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56244308ca20 0x562443086880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.777+0000 7f8912c3e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56244309caf0 con 0x562443080a90 2024-08-20T05:01:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.777+0000 7f8912c3e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56244309d1c0 con 0x562443080170 2024-08-20T05:01:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.777+0000 7f8912c3e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56244309d890 con 0x56244308ca20 2024-08-20T05:01:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.778+0000 7f890cc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080a90 0x562443087ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.778+0000 7f890cc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080a90 0x562443087ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39114/0 (socket says 172.21.15.37:39114) 2024-08-20T05:01:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.778+0000 7f890cc00640 1 -- 172.21.15.37:0/3209820448 learned_addr learned my addr 172.21.15.37:0/3209820448 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.778+0000 7f890d600640 1 --2- 172.21.15.37:0/3209820448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562443080170 0x56244309da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.778+0000 7f890e000640 1 --2- 172.21.15.37:0/3209820448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56244308ca20 0x562443086880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.778+0000 7f890cc00640 1 -- 172.21.15.37:0/3209820448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56244308ca20 msgr2=0x562443086880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.778+0000 7f890cc00640 1 --2- 172.21.15.37:0/3209820448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56244308ca20 0x562443086880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.778+0000 7f890cc00640 1 -- 172.21.15.37:0/3209820448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562443080170 msgr2=0x56244309da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.778+0000 7f890cc00640 1 --2- 172.21.15.37:0/3209820448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562443080170 0x56244309da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.778+0000 7f890cc00640 1 -- 172.21.15.37:0/3209820448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56244307ea20 con 0x562443080a90 2024-08-20T05:01:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.778+0000 7f890cc00640 1 --2- 172.21.15.37:0/3209820448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080a90 0x562443087ef0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f88f40a7530 tx=0x7f88f4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8796bef1554ca6e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.779+0000 7f88f9c00640 1 -- 172.21.15.37:0/3209820448 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f40a6e50 con 0x562443080a90 2024-08-20T05:01:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.779+0000 7f88f9c00640 1 -- 172.21.15.37:0/3209820448 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88f40ab690 con 0x562443080a90 2024-08-20T05:01:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.779+0000 7f88f9c00640 1 -- 172.21.15.37:0/3209820448 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f40e4170 con 0x562443080a90 2024-08-20T05:01:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.779+0000 7f8912c3e740 1 -- 172.21.15.37:0/3209820448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080a90 msgr2=0x562443087ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.779+0000 7f8912c3e740 1 --2- 172.21.15.37:0/3209820448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080a90 0x562443087ef0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f88f40a7530 tx=0x7f88f4009310 comp rx=0 tx=0).stop 2024-08-20T05:01:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.779+0000 7f8912c3e740 1 -- 172.21.15.37:0/3209820448 shutdown_connections 2024-08-20T05:01:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.779+0000 7f8912c3e740 1 --2- 172.21.15.37:0/3209820448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56244308ca20 0x562443086880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.779+0000 7f8912c3e740 1 --2- 172.21.15.37:0/3209820448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562443080a90 0x562443087ef0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.779+0000 7f8912c3e740 1 --2- 172.21.15.37:0/3209820448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562443080170 0x56244309da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.779+0000 7f8912c3e740 1 -- 172.21.15.37:0/3209820448 >> 172.21.15.37:0/3209820448 conn(0x56244307dfa0 msgr2=0x56244307f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.779+0000 7f8912c3e740 1 -- 172.21.15.37:0/3209820448 shutdown_connections 2024-08-20T05:01:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.780+0000 7f8912c3e740 1 -- 172.21.15.37:0/3209820448 wait complete. 2024-08-20T05:01:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.780+0000 7f8912c3e740 1 -- start start 2024-08-20T05:01:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.780+0000 7f8912c3e740 1 Processor -- start 2024-08-20T05:01:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.780+0000 7f8912c3e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562443080170 0x5624430a2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.780+0000 7f8912c3e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562443080a90 0x5624430a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.780+0000 7f8912c3e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56244308ca20 0x562443105a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.781+0000 7f8912c3e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56244309e630 con 0x56244308ca20 2024-08-20T05:01:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.781+0000 7f8912c3e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56244309df60 con 0x562443080170 2024-08-20T05:01:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.781+0000 7f8912c3e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56244309ed00 con 0x562443080a90 2024-08-20T05:01:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.781+0000 7f8912c3e740 10 client.0 _ll_register_callbacks cb 0x7f88f400cf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:01:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.781+0000 7f890e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56244308ca20 0x562443105a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.781+0000 7f890e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56244308ca20 0x562443105a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39126/0 (socket says 172.21.15.37:39126) 2024-08-20T05:01:58.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.781+0000 7f890e000640 1 -- 172.21.15.37:0/3146420172 learned_addr learned my addr 172.21.15.37:0/3146420172 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:01:58.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.781+0000 7f890d600640 1 --2- 172.21.15.37:0/3146420172 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562443080170 0x5624430a2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.781+0000 7f890cc00640 1 --2- 172.21.15.37:0/3146420172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562443080a90 0x5624430a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.781+0000 7f890e000640 1 -- 172.21.15.37:0/3146420172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562443080a90 msgr2=0x5624430a25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:58.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.781+0000 7f890e000640 1 --2- 172.21.15.37:0/3146420172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562443080a90 0x5624430a25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.781+0000 7f890e000640 1 -- 172.21.15.37:0/3146420172 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562443080170 msgr2=0x5624430a2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:01:58.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.781+0000 7f890e000640 1 --2- 172.21.15.37:0/3146420172 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562443080170 0x5624430a2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.781+0000 7f890e000640 1 -- 172.21.15.37:0/3146420172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624431060b0 con 0x56244308ca20 2024-08-20T05:01:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.782+0000 7f890e000640 1 --2- 172.21.15.37:0/3146420172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56244308ca20 0x562443105a40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f890002ade0 tx=0x7f8900003d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb2d2f4a1a72a9f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:01:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.782+0000 7f88eea00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:01:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.782+0000 7f88eea00640 1 -- 172.21.15.37:0/3146420172 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8900054070 con 0x56244308ca20 2024-08-20T05:01:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.782+0000 7f88eea00640 1 -- 172.21.15.37:0/3146420172 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8900031650 con 0x56244308ca20 2024-08-20T05:01:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.782+0000 7f8912c3e740 1 -- 172.21.15.37:0/3146420172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88f40ab690 con 0x56244308ca20 2024-08-20T05:01:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.782+0000 7f88eea00640 1 -- 172.21.15.37:0/3146420172 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8900031850 con 0x56244308ca20 2024-08-20T05:01:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.782+0000 7f8912c3e740 10 client.15303 fetch_fsmap learned FSMap version 28 2024-08-20T05:01:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.782+0000 7f8912c3e740 1 -- 172.21.15.37:0/3146420172 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562443107390 con 0x56244308ca20 2024-08-20T05:01:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.783+0000 7f88eea00640 1 -- 172.21.15.37:0/3146420172 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88f40ab690 con 0x56244308ca20 2024-08-20T05:01:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.783+0000 7f88eea00640 1 -- 172.21.15.37:0/3146420172 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f8900043020 con 0x56244308ca20 2024-08-20T05:01:58.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.783+0000 7f8912c3e740 10 client.15303 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:01:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.783+0000 7f8912c3e740 10 client.15303 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-20T05:01:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.783+0000 7f8912c3e740 20 client.15303 populate_metadata read hostname 'smithi037' 2024-08-20T05:01:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.783+0000 7f8912c3e740 1 --2- 172.21.15.37:0/3146420172 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56244310bc00 0x56244310a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:01:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.783+0000 7f8912c3e740 4 client.15303 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T05:01:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.783+0000 7f8912c3e740 1 -- 172.21.15.37:0/3146420172 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "status"}) -- 0x562442ff4230 con 0x56244310bc00 2024-08-20T05:01:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.783+0000 7f890d600640 1 --2- 172.21.15.37:0/3146420172 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56244310bc00 0x56244310a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:01:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.784+0000 7f890d600640 1 --2- 172.21.15.37:0/3146420172 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56244310bc00 0x56244310a910 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2c3473489e281d19 server_cookie=de2c08844119b82f in_seq=0 out_seq=0 2024-08-20T05:01:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.784+0000 7f88eea00640 10 client.15303 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:01:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.784+0000 7f88eea00640 1 -- 172.21.15.37:0/3146420172 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562442ff4230 con 0x56244310bc00 2024-08-20T05:01:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.784+0000 7f88eea00640 10 client.15303 handle_command_reply: tid=0 2024-08-20T05:01:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.784+0000 7f8912c3e740 1 client.15303 shutdown 2024-08-20T05:01:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.784+0000 7f8912c3e740 1 -- 172.21.15.37:0/3146420172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56244308ca20 msgr2=0x562443105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.784+0000 7f8912c3e740 1 --2- 172.21.15.37:0/3146420172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56244308ca20 0x562443105a40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f890002ade0 tx=0x7f8900003d10 comp rx=0 tx=0).stop 2024-08-20T05:01:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.784+0000 7f8912c3e740 1 -- 172.21.15.37:0/3146420172 shutdown_connections 2024-08-20T05:01:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.784+0000 7f8912c3e740 1 --2- 172.21.15.37:0/3146420172 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56244310bc00 0x56244310a910 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.784+0000 7f8912c3e740 1 --2- 172.21.15.37:0/3146420172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56244308ca20 0x562443105a40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.784+0000 7f8912c3e740 1 --2- 172.21.15.37:0/3146420172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562443080a90 0x5624430a25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.784+0000 7f8912c3e740 1 --2- 172.21.15.37:0/3146420172 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562443080170 0x5624430a2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.784+0000 7f8912c3e740 1 -- 172.21.15.37:0/3146420172 >> 172.21.15.37:0/3146420172 conn(0x56244307dfa0 msgr2=0x562443087e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.785+0000 7f88eea00640 0 client.15303 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:01:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.785+0000 7f8912c3e740 1 -- 172.21.15.37:0/3146420172 shutdown_connections 2024-08-20T05:01:58.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.785+0000 7f8912c3e740 1 -- 172.21.15.37:0/3146420172 wait complete. 2024-08-20T05:01:58.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.785+0000 7f8912c3e740 20 client.15303 trim_cache size 0 max 16384 2024-08-20T05:01:58.794 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:01:58.794 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T05:01:58.794 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 2, 2024-08-20T05:01:58.794 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24656, 2024-08-20T05:01:58.794 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-20T05:01:58.794 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-20T05:01:58.795 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-20T05:01:58.795 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 115.663245956, 2024-08-20T05:01:58.795 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-08-20T05:01:58.795 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 88, 2024-08-20T05:01:58.795 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 84, 2024-08-20T05:01:58.795 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 192.25360886600001 2024-08-20T05:01:58.795 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:01:58.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.785+0000 7f890ea00640 1 -- 172.21.15.37:0/3595593695 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f88f00b3c70 msgr2=0x7f88f00b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:58.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.785+0000 7f890ea00640 1 --2- 172.21.15.37:0/3595593695 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f88f00b3c70 0x7f88f00b6130 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x5624430832f0 tx=0x7f88fc005f90 comp rx=0 tx=0).stop 2024-08-20T05:01:58.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.786+0000 7f890ea00640 1 -- 172.21.15.37:0/3595593695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8908108330 msgr2=0x7f8908075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:01:58.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.786+0000 7f890ea00640 1 --2- 172.21.15.37:0/3595593695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8908108330 0x7f8908075710 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f88f400e9f0 tx=0x7f88f400edf0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.786+0000 7f890ea00640 1 -- 172.21.15.37:0/3595593695 shutdown_connections 2024-08-20T05:01:58.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.786+0000 7f890ea00640 1 --2- 172.21.15.37:0/3595593695 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f88f00b3c70 0x7f88f00b6130 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.786+0000 7f890ea00640 1 --2- 172.21.15.37:0/3595593695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8908108cb0 0x7f8908075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.786+0000 7f890ea00640 1 --2- 172.21.15.37:0/3595593695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8908108330 0x7f8908075710 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.786+0000 7f890ea00640 1 --2- 172.21.15.37:0/3595593695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8908102920 0x7f89080751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:01:58.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.786+0000 7f890ea00640 1 -- 172.21.15.37:0/3595593695 >> 172.21.15.37:0/3595593695 conn(0x7f89080fe350 msgr2=0x7f8908101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:01:58.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.786+0000 7f890ea00640 1 -- 172.21.15.37:0/3595593695 shutdown_connections 2024-08-20T05:01:58.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:01:58.786+0000 7f890ea00640 1 -- 172.21.15.37:0/3595593695 wait complete. 2024-08-20T05:01:59.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:01:59 smithi037 ceph-mon[17265]: pgmap v393: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:59.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.i status 2024-08-20T05:01:59.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:01:59 smithi130 ceph-mon[22007]: pgmap v393: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:59.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:01:59 smithi135 ceph-mon[22342]: pgmap v393: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:01:59.931 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:00.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.501+0000 7fd472000640 1 -- 172.21.15.37:0/4072385215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd46c100ae0 msgr2=0x7fd46c100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:00.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.501+0000 7fd472000640 1 --2- 172.21.15.37:0/4072385215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd46c100ae0 0x7fd46c100ec0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd45c009ca0 tx=0x7fd45c02a8c0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.501+0000 7fd472000640 1 -- 172.21.15.37:0/4072385215 shutdown_connections 2024-08-20T05:02:00.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.501+0000 7fd472000640 1 --2- 172.21.15.37:0/4072385215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd46c10f1a0 0x7fd46c111590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.501+0000 7fd472000640 1 --2- 172.21.15.37:0/4072385215 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd46c10c870 0x7fd46c10ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.501+0000 7fd472000640 1 --2- 172.21.15.37:0/4072385215 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd46c100ae0 0x7fd46c100ec0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.501+0000 7fd472000640 1 -- 172.21.15.37:0/4072385215 >> 172.21.15.37:0/4072385215 conn(0x7fd46c0fc730 msgr2=0x7fd46c0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:00.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.501+0000 7fd472000640 1 -- 172.21.15.37:0/4072385215 shutdown_connections 2024-08-20T05:02:00.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.501+0000 7fd472000640 1 -- 172.21.15.37:0/4072385215 wait complete. 2024-08-20T05:02:00.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.502+0000 7fd472000640 1 Processor -- start 2024-08-20T05:02:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.502+0000 7fd472000640 1 -- start start 2024-08-20T05:02:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.503+0000 7fd472000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd46c100ae0 0x7fd46c19b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.503+0000 7fd472000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd46c10c870 0x7fd46c19b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.503+0000 7fd472000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd46c10f1a0 0x7fd46c1a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.503+0000 7fd472000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd46c114cb0 con 0x7fd46c100ae0 2024-08-20T05:02:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.503+0000 7fd472000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd46c114b30 con 0x7fd46c10f1a0 2024-08-20T05:02:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.503+0000 7fd472000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd46c114e30 con 0x7fd46c10c870 2024-08-20T05:02:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.503+0000 7fd46b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd46c100ae0 0x7fd46c19b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.503+0000 7fd46b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd46c100ae0 0x7fd46c19b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39150/0 (socket says 172.21.15.37:39150) 2024-08-20T05:02:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.503+0000 7fd46b400640 1 -- 172.21.15.37:0/3135204529 learned_addr learned my addr 172.21.15.37:0/3135204529 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.503+0000 7fd46be00640 1 --2- 172.21.15.37:0/3135204529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd46c10f1a0 0x7fd46c1a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.503+0000 7fd462a00640 1 --2- 172.21.15.37:0/3135204529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd46c10c870 0x7fd46c19b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.504+0000 7fd46b400640 1 -- 172.21.15.37:0/3135204529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd46c10c870 msgr2=0x7fd46c19b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.504+0000 7fd46b400640 1 --2- 172.21.15.37:0/3135204529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd46c10c870 0x7fd46c19b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.504+0000 7fd46b400640 1 -- 172.21.15.37:0/3135204529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd46c10f1a0 msgr2=0x7fd46c1a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.504+0000 7fd46b400640 1 --2- 172.21.15.37:0/3135204529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd46c10f1a0 0x7fd46c1a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.504+0000 7fd46b400640 1 -- 172.21.15.37:0/3135204529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46c1a12b0 con 0x7fd46c100ae0 2024-08-20T05:02:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.504+0000 7fd46be00640 1 --2- 172.21.15.37:0/3135204529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd46c10f1a0 0x7fd46c1a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.504+0000 7fd46b400640 1 --2- 172.21.15.37:0/3135204529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd46c100ae0 0x7fd46c19b200 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd45c005e30 tx=0x7fd45c031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:00.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.504+0000 7fd468c00640 1 -- 172.21.15.37:0/3135204529 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45c003b70 con 0x7fd46c100ae0 2024-08-20T05:02:00.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.504+0000 7fd468c00640 1 -- 172.21.15.37:0/3135204529 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd45c003d10 con 0x7fd46c100ae0 2024-08-20T05:02:00.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.504+0000 7fd468c00640 1 -- 172.21.15.37:0/3135204529 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45c02f900 con 0x7fd46c100ae0 2024-08-20T05:02:00.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.504+0000 7fd472000640 1 -- 172.21.15.37:0/3135204529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd46c1a1540 con 0x7fd46c100ae0 2024-08-20T05:02:00.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.505+0000 7fd472000640 1 -- 172.21.15.37:0/3135204529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd46c1a7c60 con 0x7fd46c100ae0 2024-08-20T05:02:00.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.507+0000 7fd474a6a740 1 Processor -- start 2024-08-20T05:02:00.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.508+0000 7fd474a6a740 1 -- start start 2024-08-20T05:02:00.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.508+0000 7fd468c00640 1 -- 172.21.15.37:0/3135204529 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd45c02faa0 con 0x7fd46c100ae0 2024-08-20T05:02:00.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.508+0000 7fd474a6a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d120df10 0x55f9d120e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.508+0000 7fd474a6a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 0x55f9d121a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.508+0000 7fd474a6a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d121a7c0 0x55f9d121cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.508+0000 7fd474a6a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f9d1184840 con 0x55f9d120df10 2024-08-20T05:02:00.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.508+0000 7fd474a6a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f9d1173d40 con 0x55f9d121a7c0 2024-08-20T05:02:00.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.508+0000 7fd474a6a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f9d1177d80 con 0x55f9d120e830 2024-08-20T05:02:00.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.508+0000 7fd46be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d120df10 0x55f9d120e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.508+0000 7fd46b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 0x55f9d121a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.508+0000 7fd46be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d120df10 0x55f9d120e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39152/0 (socket says 172.21.15.37:39152) 2024-08-20T05:02:00.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.508+0000 7fd46be00640 1 -- 172.21.15.37:0/2447567324 learned_addr learned my addr 172.21.15.37:0/2447567324 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:00.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.509+0000 7fd462a00640 1 --2- 172.21.15.37:0/2447567324 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d121a7c0 0x55f9d121cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.509+0000 7fd46be00640 1 -- 172.21.15.37:0/2447567324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 msgr2=0x55f9d121a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:00.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.509+0000 7fd46be00640 1 --2- 172.21.15.37:0/2447567324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 0x55f9d121a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.509+0000 7fd46be00640 1 -- 172.21.15.37:0/2447567324 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d121a7c0 msgr2=0x55f9d121cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:00.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.509+0000 7fd46be00640 1 --2- 172.21.15.37:0/2447567324 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d121a7c0 0x55f9d121cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.509+0000 7fd46be00640 1 -- 172.21.15.37:0/2447567324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d111a1c0 con 0x55f9d120df10 2024-08-20T05:02:00.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.509+0000 7fd46be00640 1 --2- 172.21.15.37:0/2447567324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d120df10 0x55f9d120e2f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd4640114a0 tx=0x7fd464011960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5ea9be7839b3ecc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:00.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.510+0000 7fd45be00640 1 -- 172.21.15.37:0/2447567324 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46401e070 con 0x55f9d120df10 2024-08-20T05:02:00.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.510+0000 7fd45be00640 1 -- 172.21.15.37:0/2447567324 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd46400fa10 con 0x55f9d120df10 2024-08-20T05:02:00.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.510+0000 7fd45be00640 1 -- 172.21.15.37:0/2447567324 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd464019b30 con 0x55f9d120df10 2024-08-20T05:02:00.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.510+0000 7fd468c00640 1 --2- 172.21.15.37:0/3135204529 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd4500b3bd0 0x7fd4500b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.510+0000 7fd474a6a740 1 -- 172.21.15.37:0/2447567324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d120df10 msgr2=0x55f9d120e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:00.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.510+0000 7fd474a6a740 1 --2- 172.21.15.37:0/2447567324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d120df10 0x55f9d120e2f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd4640114a0 tx=0x7fd464011960 comp rx=0 tx=0).stop 2024-08-20T05:02:00.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.511+0000 7fd468c00640 1 -- 172.21.15.37:0/3135204529 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd45c105310 con 0x7fd46c100ae0 2024-08-20T05:02:00.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.511+0000 7fd46b400640 1 --2- 172.21.15.37:0/3135204529 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd4500b3bd0 0x7fd4500b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.511+0000 7fd474a6a740 1 -- 172.21.15.37:0/2447567324 shutdown_connections 2024-08-20T05:02:00.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.511+0000 7fd474a6a740 1 --2- 172.21.15.37:0/2447567324 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d121a7c0 0x55f9d121cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.511+0000 7fd474a6a740 1 --2- 172.21.15.37:0/2447567324 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 0x55f9d121a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.511+0000 7fd474a6a740 1 --2- 172.21.15.37:0/2447567324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d120df10 0x55f9d120e2f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.511+0000 7fd474a6a740 1 -- 172.21.15.37:0/2447567324 >> 172.21.15.37:0/2447567324 conn(0x55f9d120bd40 msgr2=0x55f9d120cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:00.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.511+0000 7fd474a6a740 1 -- 172.21.15.37:0/2447567324 shutdown_connections 2024-08-20T05:02:00.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.511+0000 7fd474a6a740 1 -- 172.21.15.37:0/2447567324 wait complete. 2024-08-20T05:02:00.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.511+0000 7fd46b400640 1 --2- 172.21.15.37:0/3135204529 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd4500b3bd0 0x7fd4500b6090 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd45c102de0 tx=0x7fd45c108df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:00.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.512+0000 7fd474a6a740 1 -- start start 2024-08-20T05:02:00.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.512+0000 7fd474a6a740 1 Processor -- start 2024-08-20T05:02:00.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.512+0000 7fd474a6a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d120df10 0x55f9d1219f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.512+0000 7fd474a6a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 0x55f9d1217380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.512+0000 7fd474a6a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d121a7c0 0x55f9d12178c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.512+0000 7fd474a6a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f9d0fd65f0 con 0x55f9d120df10 2024-08-20T05:02:00.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.512+0000 7fd474a6a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f9d110f170 con 0x55f9d121a7c0 2024-08-20T05:02:00.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.512+0000 7fd474a6a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f9d121d4c0 con 0x55f9d120e830 2024-08-20T05:02:00.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.512+0000 7fd474a6a740 10 client.0 _ll_register_callbacks cb 0x55f9d116e8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:00.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.513+0000 7fd46be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d120df10 0x55f9d1219f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.513+0000 7fd46be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d120df10 0x55f9d1219f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39158/0 (socket says 172.21.15.37:39158) 2024-08-20T05:02:00.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.513+0000 7fd46be00640 1 -- 172.21.15.37:0/3006933899 learned_addr learned my addr 172.21.15.37:0/3006933899 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:00.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.513+0000 7fd462a00640 1 --2- 172.21.15.37:0/3006933899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 0x55f9d1217380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.513+0000 7fd46be00640 1 --2- 172.21.15.37:0/3006933899 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d121a7c0 0x55f9d12178c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.513+0000 7fd462a00640 1 -- 172.21.15.37:0/3006933899 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d121a7c0 msgr2=0x55f9d12178c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.513+0000 7fd462a00640 1 --2- 172.21.15.37:0/3006933899 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d121a7c0 0x55f9d12178c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.513+0000 7fd462a00640 1 -- 172.21.15.37:0/3006933899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d120df10 msgr2=0x55f9d1219f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.513+0000 7fd462a00640 1 --2- 172.21.15.37:0/3006933899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d120df10 0x55f9d1219f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.513+0000 7fd462a00640 1 -- 172.21.15.37:0/3006933899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9d0ed3540 con 0x55f9d120e830 2024-08-20T05:02:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.513+0000 7fd462a00640 1 --2- 172.21.15.37:0/3006933899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 0x55f9d1217380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd46c10eff0 tx=0x7fd454012b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f79e8a7fb4b75922 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.513+0000 7fd458c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:02:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.514+0000 7fd458c00640 1 -- 172.21.15.37:0/3006933899 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45400f8f0 con 0x55f9d120e830 2024-08-20T05:02:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.514+0000 7fd474a6a740 1 -- 172.21.15.37:0/3006933899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd46400fa10 con 0x55f9d120e830 2024-08-20T05:02:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.514+0000 7fd458c00640 1 -- 172.21.15.37:0/3006933899 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd45400fa90 con 0x55f9d120e830 2024-08-20T05:02:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.514+0000 7fd458c00640 1 -- 172.21.15.37:0/3006933899 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd45400fc90 con 0x55f9d120e830 2024-08-20T05:02:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.514+0000 7fd474a6a740 10 client.25348 fetch_fsmap learned FSMap version 28 2024-08-20T05:02:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.514+0000 7fd474a6a740 1 -- 172.21.15.37:0/3006933899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f9d1228d80 con 0x55f9d120e830 2024-08-20T05:02:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.515+0000 7fd458c00640 1 -- 172.21.15.37:0/3006933899 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd46400fa10 con 0x55f9d120e830 2024-08-20T05:02:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.515+0000 7fd458c00640 1 -- 172.21.15.37:0/3006933899 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd45401c420 con 0x55f9d120e830 2024-08-20T05:02:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.515+0000 7fd474a6a740 10 client.25348 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:02:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.515+0000 7fd474a6a740 10 client.25348 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-20T05:02:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.515+0000 7fd474a6a740 20 client.25348 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.515+0000 7fd474a6a740 1 --2- 172.21.15.37:0/3006933899 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55f9d122b3d0 0x55f9d122c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.515+0000 7fd474a6a740 4 client.25348 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:02:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.515+0000 7fd474a6a740 1 -- 172.21.15.37:0/3006933899 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9d1186790 con 0x55f9d122b3d0 2024-08-20T05:02:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.516+0000 7fd46be00640 1 --2- 172.21.15.37:0/3006933899 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55f9d122b3d0 0x55f9d122c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.516+0000 7fd46be00640 1 --2- 172.21.15.37:0/3006933899 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55f9d122b3d0 0x55f9d122c840 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ecb041629c6c12e4 server_cookie=242e0e5606a752a in_seq=0 out_seq=0 2024-08-20T05:02:00.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.516+0000 7fd458c00640 10 client.25348 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:02:00.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.517+0000 7fd458c00640 1 -- 172.21.15.37:0/3006933899 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f9d1186790 con 0x55f9d122b3d0 2024-08-20T05:02:00.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.517+0000 7fd458c00640 10 client.25348 handle_command_reply: tid=0 2024-08-20T05:02:00.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.517+0000 7fd474a6a740 1 client.25348 shutdown 2024-08-20T05:02:00.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.517+0000 7fd474a6a740 1 -- 172.21.15.37:0/3006933899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 msgr2=0x55f9d1217380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:00.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.517+0000 7fd474a6a740 1 --2- 172.21.15.37:0/3006933899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 0x55f9d1217380 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd46c10eff0 tx=0x7fd454012b60 comp rx=0 tx=0).stop 2024-08-20T05:02:00.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.517+0000 7fd474a6a740 1 -- 172.21.15.37:0/3006933899 shutdown_connections 2024-08-20T05:02:00.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.517+0000 7fd474a6a740 1 --2- 172.21.15.37:0/3006933899 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55f9d122b3d0 0x55f9d122c840 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.517+0000 7fd474a6a740 1 --2- 172.21.15.37:0/3006933899 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d121a7c0 0x55f9d12178c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.517+0000 7fd474a6a740 1 --2- 172.21.15.37:0/3006933899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 0x55f9d1217380 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.517+0000 7fd474a6a740 1 --2- 172.21.15.37:0/3006933899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d120df10 0x55f9d1219f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.517+0000 7fd458c00640 0 client.25348 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:02:00.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.517+0000 7fd474a6a740 1 -- 172.21.15.37:0/3006933899 >> 172.21.15.37:0/3006933899 conn(0x55f9d120bd40 msgr2=0x55f9d12118e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:00.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.517+0000 7fd474a6a740 1 -- 172.21.15.37:0/3006933899 shutdown_connections 2024-08-20T05:02:00.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.517+0000 7fd474a6a740 1 -- 172.21.15.37:0/3006933899 wait complete. 2024-08-20T05:02:00.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.518+0000 7fd474a6a740 20 client.25348 trim_cache size 0 max 16384 2024-08-20T05:02:00.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.536+0000 7fd474a6a740 1 Processor -- start 2024-08-20T05:02:00.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.536+0000 7fd474a6a740 1 -- start start 2024-08-20T05:02:00.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.536+0000 7fd474a6a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120df10 0x55f9d1216870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.537+0000 7fd474a6a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d120e830 0x55f9d1215c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.537+0000 7fd474a6a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d121a7c0 0x55f9d1216140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.537+0000 7fd474a6a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f9d122ab80 con 0x55f9d121a7c0 2024-08-20T05:02:00.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.537+0000 7fd474a6a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f9d122b250 con 0x55f9d120e830 2024-08-20T05:02:00.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.537+0000 7fd474a6a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f9d122b920 con 0x55f9d120df10 2024-08-20T05:02:00.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.537+0000 7fd46be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120df10 0x55f9d1216870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.537+0000 7fd46be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d121a7c0 0x55f9d1216140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.537+0000 7fd462a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d120e830 0x55f9d1215c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.537+0000 7fd46be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d121a7c0 0x55f9d1216140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39170/0 (socket says 172.21.15.37:39170) 2024-08-20T05:02:00.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.537+0000 7fd46be00640 1 -- 172.21.15.37:0/2135861450 learned_addr learned my addr 172.21.15.37:0/2135861450 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:00.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.537+0000 7fd46be00640 1 -- 172.21.15.37:0/2135861450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120df10 msgr2=0x55f9d1216870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:00.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.537+0000 7fd46be00640 1 --2- 172.21.15.37:0/2135861450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120df10 0x55f9d1216870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.537+0000 7fd46be00640 1 -- 172.21.15.37:0/2135861450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d120e830 msgr2=0x55f9d1215c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:00.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.537+0000 7fd46be00640 1 --2- 172.21.15.37:0/2135861450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d120e830 0x55f9d1215c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.537+0000 7fd46be00640 1 -- 172.21.15.37:0/2135861450 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d120c7c0 con 0x55f9d121a7c0 2024-08-20T05:02:00.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.538+0000 7fd462a00640 1 --2- 172.21.15.37:0/2135861450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d120e830 0x55f9d1215c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:00.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.538+0000 7fd46be00640 1 --2- 172.21.15.37:0/2135861450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d121a7c0 0x55f9d1216140 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd464009250 tx=0x7fd464019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a35026493ba51c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:00.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.538+0000 7fd45b400640 1 -- 172.21.15.37:0/2135861450 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46401e040 con 0x55f9d121a7c0 2024-08-20T05:02:00.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.538+0000 7fd45b400640 1 -- 172.21.15.37:0/2135861450 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd46400f560 con 0x55f9d121a7c0 2024-08-20T05:02:00.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.538+0000 7fd45b400640 1 -- 172.21.15.37:0/2135861450 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd464019ac0 con 0x55f9d121a7c0 2024-08-20T05:02:00.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.539+0000 7fd474a6a740 1 -- 172.21.15.37:0/2135861450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d121a7c0 msgr2=0x55f9d1216140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:00.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.539+0000 7fd474a6a740 1 --2- 172.21.15.37:0/2135861450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d121a7c0 0x55f9d1216140 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd464009250 tx=0x7fd464019690 comp rx=0 tx=0).stop 2024-08-20T05:02:00.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.539+0000 7fd474a6a740 1 -- 172.21.15.37:0/2135861450 shutdown_connections 2024-08-20T05:02:00.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.539+0000 7fd474a6a740 1 --2- 172.21.15.37:0/2135861450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d121a7c0 0x55f9d1216140 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.539+0000 7fd474a6a740 1 --2- 172.21.15.37:0/2135861450 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d120e830 0x55f9d1215c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.539+0000 7fd474a6a740 1 --2- 172.21.15.37:0/2135861450 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120df10 0x55f9d1216870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.539+0000 7fd474a6a740 1 -- 172.21.15.37:0/2135861450 >> 172.21.15.37:0/2135861450 conn(0x55f9d120bd40 msgr2=0x55f9d12172f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:00.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.539+0000 7fd474a6a740 1 -- 172.21.15.37:0/2135861450 shutdown_connections 2024-08-20T05:02:00.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.539+0000 7fd474a6a740 1 -- 172.21.15.37:0/2135861450 wait complete. 2024-08-20T05:02:00.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.540+0000 7fd474a6a740 1 -- start start 2024-08-20T05:02:00.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.540+0000 7fd474a6a740 1 Processor -- start 2024-08-20T05:02:00.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.540+0000 7fd474a6a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d120df10 0x55f9d121b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.540+0000 7fd474a6a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 0x55f9d121b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.540+0000 7fd474a6a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d121a7c0 0x55f9d1233a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.540+0000 7fd474a6a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f9d122c6c0 con 0x55f9d121a7c0 2024-08-20T05:02:00.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.540+0000 7fd474a6a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f9d122bff0 con 0x55f9d120df10 2024-08-20T05:02:00.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.540+0000 7fd474a6a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f9d122cd90 con 0x55f9d120e830 2024-08-20T05:02:00.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.540+0000 7fd474a6a740 10 client.0 _ll_register_callbacks cb 0x7fd454009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:00.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.540+0000 7fd462a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 0x55f9d121b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.541+0000 7fd46be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d120df10 0x55f9d121b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.541+0000 7fd462a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 0x55f9d121b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51142/0 (socket says 172.21.15.37:51142) 2024-08-20T05:02:00.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.541+0000 7fd462a00640 1 -- 172.21.15.37:0/3183170648 learned_addr learned my addr 172.21.15.37:0/3183170648 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:00.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.541+0000 7fd46be00640 1 --2- 172.21.15.37:0/3183170648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d120df10 0x55f9d121b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47336/0 (socket says 172.21.15.37:47336) 2024-08-20T05:02:00.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.541+0000 7fd46be00640 1 --2- 172.21.15.37:0/3183170648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d121a7c0 0x55f9d1233a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.541+0000 7fd462a00640 1 -- 172.21.15.37:0/3183170648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d120df10 msgr2=0x55f9d121b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:00.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.541+0000 7fd462a00640 1 --2- 172.21.15.37:0/3183170648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d120df10 0x55f9d121b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.541+0000 7fd462a00640 1 -- 172.21.15.37:0/3183170648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d121a7c0 msgr2=0x55f9d1233a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:00.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.541+0000 7fd462a00640 1 --2- 172.21.15.37:0/3183170648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d121a7c0 0x55f9d1233a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.541+0000 7fd462a00640 1 -- 172.21.15.37:0/3183170648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9d1233fd0 con 0x55f9d120e830 2024-08-20T05:02:00.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.541+0000 7fd462a00640 1 --2- 172.21.15.37:0/3183170648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 0x55f9d121b710 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd454000c00 tx=0x7fd454009640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7da3ae5313bf527 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:00.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.541+0000 7fd458c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:02:00.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.542+0000 7fd458c00640 1 -- 172.21.15.37:0/3183170648 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45402f060 con 0x55f9d120e830 2024-08-20T05:02:00.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.542+0000 7fd474a6a740 1 -- 172.21.15.37:0/3183170648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd46400f560 con 0x55f9d120e830 2024-08-20T05:02:00.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.542+0000 7fd458c00640 1 -- 172.21.15.37:0/3183170648 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd45401c420 con 0x55f9d120e830 2024-08-20T05:02:00.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.542+0000 7fd458c00640 1 -- 172.21.15.37:0/3183170648 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd45401c620 con 0x55f9d120e830 2024-08-20T05:02:00.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.542+0000 7fd474a6a740 10 client.25354 fetch_fsmap learned FSMap version 28 2024-08-20T05:02:00.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.542+0000 7fd474a6a740 1 -- 172.21.15.37:0/3183170648 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f9d1235300 con 0x55f9d120e830 2024-08-20T05:02:00.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.542+0000 7fd458c00640 1 -- 172.21.15.37:0/3183170648 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd46400f560 con 0x55f9d120e830 2024-08-20T05:02:00.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.542+0000 7fd458c00640 1 -- 172.21.15.37:0/3183170648 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd454003b40 con 0x55f9d120e830 2024-08-20T05:02:00.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.543+0000 7fd474a6a740 10 client.25354 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:02:00.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.543+0000 7fd474a6a740 10 client.25354 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-20T05:02:00.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.543+0000 7fd474a6a740 20 client.25354 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:00.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.543+0000 7fd474a6a740 1 --2- 172.21.15.37:0/3183170648 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55f9d129a070 0x55f9d1298d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:00.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.543+0000 7fd474a6a740 4 client.25354 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T05:02:00.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.543+0000 7fd474a6a740 1 -- 172.21.15.37:0/3183170648 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "status"}) -- 0x55f9d1182230 con 0x55f9d129a070 2024-08-20T05:02:00.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.543+0000 7fd46be00640 1 --2- 172.21.15.37:0/3183170648 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55f9d129a070 0x55f9d1298d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:00.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.543+0000 7fd46be00640 1 --2- 172.21.15.37:0/3183170648 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55f9d129a070 0x55f9d1298d80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c3fe3d50c0e1444c server_cookie=af8ebbdb49666138 in_seq=0 out_seq=0 2024-08-20T05:02:00.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.543+0000 7fd458c00640 10 client.25354 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:02:00.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.544+0000 7fd458c00640 1 -- 172.21.15.37:0/3183170648 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f9d1182230 con 0x55f9d129a070 2024-08-20T05:02:00.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.544+0000 7fd458c00640 10 client.25354 handle_command_reply: tid=0 2024-08-20T05:02:00.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.544+0000 7fd474a6a740 1 client.25354 shutdown 2024-08-20T05:02:00.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.544+0000 7fd474a6a740 1 -- 172.21.15.37:0/3183170648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 msgr2=0x55f9d121b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:00.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.544+0000 7fd474a6a740 1 --2- 172.21.15.37:0/3183170648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 0x55f9d121b710 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd454000c00 tx=0x7fd454009640 comp rx=0 tx=0).stop 2024-08-20T05:02:00.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.544+0000 7fd474a6a740 1 -- 172.21.15.37:0/3183170648 shutdown_connections 2024-08-20T05:02:00.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.544+0000 7fd474a6a740 1 --2- 172.21.15.37:0/3183170648 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55f9d129a070 0x55f9d1298d80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.544+0000 7fd474a6a740 1 --2- 172.21.15.37:0/3183170648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9d121a7c0 0x55f9d1233a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.544+0000 7fd474a6a740 1 --2- 172.21.15.37:0/3183170648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9d120e830 0x55f9d121b710 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.544+0000 7fd474a6a740 1 --2- 172.21.15.37:0/3183170648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9d120df10 0x55f9d121b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.544+0000 7fd474a6a740 1 -- 172.21.15.37:0/3183170648 >> 172.21.15.37:0/3183170648 conn(0x55f9d120bd40 msgr2=0x55f9d120ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:00.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.544+0000 7fd458c00640 0 client.25354 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:02:00.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.544+0000 7fd474a6a740 1 -- 172.21.15.37:0/3183170648 shutdown_connections 2024-08-20T05:02:00.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.544+0000 7fd474a6a740 1 -- 172.21.15.37:0/3183170648 wait complete. 2024-08-20T05:02:00.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.544+0000 7fd474a6a740 20 client.25354 trim_cache size 0 max 16384 2024-08-20T05:02:00.551 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:02:00.551 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T05:02:00.551 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 1, 2024-08-20T05:02:00.551 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24664, 2024-08-20T05:02:00.551 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-20T05:02:00.551 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-20T05:02:00.551 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-20T05:02:00.551 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 118.42983943599999, 2024-08-20T05:02:00.551 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-08-20T05:02:00.551 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 88, 2024-08-20T05:02:00.551 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 84, 2024-08-20T05:02:00.551 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 191.460111364 2024-08-20T05:02:00.552 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:02:00.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.545+0000 7fd472000640 1 -- 172.21.15.37:0/3135204529 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd4500b3bd0 msgr2=0x7fd4500b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:00.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.545+0000 7fd472000640 1 --2- 172.21.15.37:0/3135204529 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd4500b3bd0 0x7fd4500b6090 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd45c102de0 tx=0x7fd45c108df0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.545+0000 7fd472000640 1 -- 172.21.15.37:0/3135204529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd46c100ae0 msgr2=0x7fd46c19b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:00.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.545+0000 7fd472000640 1 --2- 172.21.15.37:0/3135204529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd46c100ae0 0x7fd46c19b200 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd45c005e30 tx=0x7fd45c031840 comp rx=0 tx=0).stop 2024-08-20T05:02:00.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.545+0000 7fd472000640 1 -- 172.21.15.37:0/3135204529 shutdown_connections 2024-08-20T05:02:00.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.545+0000 7fd472000640 1 --2- 172.21.15.37:0/3135204529 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd4500b3bd0 0x7fd4500b6090 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.545+0000 7fd472000640 1 --2- 172.21.15.37:0/3135204529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd46c10f1a0 0x7fd46c1a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.545+0000 7fd472000640 1 --2- 172.21.15.37:0/3135204529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd46c10c870 0x7fd46c19b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.545+0000 7fd472000640 1 --2- 172.21.15.37:0/3135204529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd46c100ae0 0x7fd46c19b200 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:00.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.545+0000 7fd472000640 1 -- 172.21.15.37:0/3135204529 >> 172.21.15.37:0/3135204529 conn(0x7fd46c0fc730 msgr2=0x7fd46c10d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:00.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.545+0000 7fd472000640 1 -- 172.21.15.37:0/3135204529 shutdown_connections 2024-08-20T05:02:00.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:00.545+0000 7fd472000640 1 -- 172.21.15.37:0/3135204529 wait complete. 2024-08-20T05:02:01.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.b status 2024-08-20T05:02:01.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:01 smithi130 ceph-mon[22007]: pgmap v394: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:02:01.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:01 smithi037 ceph-mon[17265]: pgmap v394: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:02:01.855 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:01.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:01 smithi135 ceph-mon[22342]: pgmap v394: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:02:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.445+0000 7ff836000640 1 -- 172.21.15.37:0/2506816321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8301042f0 msgr2=0x7ff83010c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:02.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.445+0000 7ff836000640 1 --2- 172.21.15.37:0/2506816321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8301042f0 0x7ff83010c7e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff818009900 tx=0x7ff81802a410 comp rx=0 tx=0).stop 2024-08-20T05:02:02.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.445+0000 7ff836000640 1 -- 172.21.15.37:0/2506816321 shutdown_connections 2024-08-20T05:02:02.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.445+0000 7ff836000640 1 --2- 172.21.15.37:0/2506816321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff83010ce30 0x7ff83010f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.445+0000 7ff836000640 1 --2- 172.21.15.37:0/2506816321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8301042f0 0x7ff83010c7e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.445+0000 7ff836000640 1 --2- 172.21.15.37:0/2506816321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8301039d0 0x7ff830103db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.445+0000 7ff836000640 1 -- 172.21.15.37:0/2506816321 >> 172.21.15.37:0/2506816321 conn(0x7ff8300fd410 msgr2=0x7ff8300ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:02.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.445+0000 7ff836000640 1 -- 172.21.15.37:0/2506816321 shutdown_connections 2024-08-20T05:02:02.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.446+0000 7ff836000640 1 -- 172.21.15.37:0/2506816321 wait complete. 2024-08-20T05:02:02.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.446+0000 7ff836000640 1 Processor -- start 2024-08-20T05:02:02.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.447+0000 7ff836000640 1 -- start start 2024-08-20T05:02:02.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.447+0000 7ff836000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8301039d0 0x7ff83019b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.447+0000 7ff836000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8301042f0 0x7ff83019b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.447+0000 7ff836000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff83010ce30 0x7ff8301a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.447+0000 7ff836000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff830112af0 con 0x7ff83010ce30 2024-08-20T05:02:02.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.447+0000 7ff836000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff830112970 con 0x7ff8301039d0 2024-08-20T05:02:02.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.447+0000 7ff836000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff830112c70 con 0x7ff8301042f0 2024-08-20T05:02:02.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.447+0000 7ff82fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff83010ce30 0x7ff8301a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.447+0000 7ff827e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8301042f0 0x7ff83019b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.447+0000 7ff82f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8301039d0 0x7ff83019b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.447+0000 7ff827e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8301042f0 0x7ff83019b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51160/0 (socket says 172.21.15.37:51160) 2024-08-20T05:02:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.447+0000 7ff827e00640 1 -- 172.21.15.37:0/1808834459 learned_addr learned my addr 172.21.15.37:0/1808834459 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.448+0000 7ff82f400640 1 -- 172.21.15.37:0/1808834459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8301042f0 msgr2=0x7ff83019b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.448+0000 7ff82f400640 1 --2- 172.21.15.37:0/1808834459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8301042f0 0x7ff83019b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.448+0000 7ff82f400640 1 -- 172.21.15.37:0/1808834459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff83010ce30 msgr2=0x7ff8301a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.448+0000 7ff82f400640 1 --2- 172.21.15.37:0/1808834459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff83010ce30 0x7ff8301a0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.448+0000 7ff82f400640 1 -- 172.21.15.37:0/1808834459 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8301a1310 con 0x7ff8301039d0 2024-08-20T05:02:02.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.448+0000 7ff82f400640 1 --2- 172.21.15.37:0/1808834459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8301039d0 0x7ff83019b260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff82000e9f0 tx=0x7ff82000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:02.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.448+0000 7ff82cc00640 1 -- 172.21.15.37:0/1808834459 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82000ccc0 con 0x7ff8301039d0 2024-08-20T05:02:02.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.448+0000 7ff836000640 1 -- 172.21.15.37:0/1808834459 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8301a1600 con 0x7ff8301039d0 2024-08-20T05:02:02.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.449+0000 7ff82cc00640 1 -- 172.21.15.37:0/1808834459 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8200044d0 con 0x7ff8301039d0 2024-08-20T05:02:02.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.449+0000 7ff82cc00640 1 -- 172.21.15.37:0/1808834459 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82001c070 con 0x7ff8301039d0 2024-08-20T05:02:02.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.449+0000 7ff836000640 1 -- 172.21.15.37:0/1808834459 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8301a7cc0 con 0x7ff8301039d0 2024-08-20T05:02:02.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.452+0000 7ff838acc740 1 Processor -- start 2024-08-20T05:02:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.452+0000 7ff838acc740 1 -- start start 2024-08-20T05:02:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.452+0000 7ff82cc00640 1 -- 172.21.15.37:0/1808834459 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff820005020 con 0x7ff8301039d0 2024-08-20T05:02:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.452+0000 7ff838acc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f3197f10 0x55b6f31982f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.452+0000 7ff838acc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3198830 0x55b6f31a4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.452+0000 7ff838acc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f31a47c0 0x55b6f31a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.452+0000 7ff838acc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b6f310e840 con 0x55b6f31a47c0 2024-08-20T05:02:02.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.452+0000 7ff838acc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b6f30fdd40 con 0x55b6f3197f10 2024-08-20T05:02:02.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.452+0000 7ff838acc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b6f3101d80 con 0x55b6f3198830 2024-08-20T05:02:02.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.452+0000 7ff827e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f31a47c0 0x55b6f31a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.452+0000 7ff82f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3198830 0x55b6f31a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.452+0000 7ff827e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f31a47c0 0x55b6f31a6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39212/0 (socket says 172.21.15.37:39212) 2024-08-20T05:02:02.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.452+0000 7ff827e00640 1 -- 172.21.15.37:0/1692321886 learned_addr learned my addr 172.21.15.37:0/1692321886 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:02.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.453+0000 7ff82fe00640 1 --2- 172.21.15.37:0/1692321886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f3197f10 0x55b6f31982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.453+0000 7ff827e00640 1 -- 172.21.15.37:0/1692321886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3198830 msgr2=0x55b6f31a4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:02.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.453+0000 7ff827e00640 1 --2- 172.21.15.37:0/1692321886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3198830 0x55b6f31a4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.453+0000 7ff827e00640 1 -- 172.21.15.37:0/1692321886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f3197f10 msgr2=0x55b6f31982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.453+0000 7ff827e00640 1 --2- 172.21.15.37:0/1692321886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f3197f10 0x55b6f31982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.453+0000 7ff827e00640 1 -- 172.21.15.37:0/1692321886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6f30a41c0 con 0x55b6f31a47c0 2024-08-20T05:02:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.453+0000 7ff82fe00640 1 --2- 172.21.15.37:0/1692321886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f3197f10 0x55b6f31982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.453+0000 7ff827e00640 1 --2- 172.21.15.37:0/1692321886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f31a47c0 0x55b6f31a6bb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff81802a930 tx=0x7ff8180040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80816e49e0dbcd1a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.454+0000 7ff81fe00640 1 -- 172.21.15.37:0/1692321886 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff818035040 con 0x55b6f31a47c0 2024-08-20T05:02:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.454+0000 7ff81fe00640 1 -- 172.21.15.37:0/1692321886 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8180054d0 con 0x55b6f31a47c0 2024-08-20T05:02:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.454+0000 7ff81fe00640 1 -- 172.21.15.37:0/1692321886 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff818003850 con 0x55b6f31a47c0 2024-08-20T05:02:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.454+0000 7ff82cc00640 1 --2- 172.21.15.37:0/1808834459 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8140b3bd0 0x7ff8140b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.454+0000 7ff838acc740 1 -- 172.21.15.37:0/1692321886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f31a47c0 msgr2=0x55b6f31a6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.454+0000 7ff838acc740 1 --2- 172.21.15.37:0/1692321886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f31a47c0 0x55b6f31a6bb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff81802a930 tx=0x7ff8180040e0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.454+0000 7ff838acc740 1 -- 172.21.15.37:0/1692321886 shutdown_connections 2024-08-20T05:02:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.454+0000 7ff838acc740 1 --2- 172.21.15.37:0/1692321886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f31a47c0 0x55b6f31a6bb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.454+0000 7ff838acc740 1 --2- 172.21.15.37:0/1692321886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3198830 0x55b6f31a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.454+0000 7ff838acc740 1 --2- 172.21.15.37:0/1692321886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f3197f10 0x55b6f31982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.454+0000 7ff838acc740 1 -- 172.21.15.37:0/1692321886 >> 172.21.15.37:0/1692321886 conn(0x55b6f3195d40 msgr2=0x55b6f3196ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.454+0000 7ff82cc00640 1 -- 172.21.15.37:0/1808834459 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff8200e3fe0 con 0x7ff8301039d0 2024-08-20T05:02:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.455+0000 7ff82fe00640 1 --2- 172.21.15.37:0/1808834459 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8140b3bd0 0x7ff8140b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.455+0000 7ff838acc740 1 -- 172.21.15.37:0/1692321886 shutdown_connections 2024-08-20T05:02:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.455+0000 7ff838acc740 1 -- 172.21.15.37:0/1692321886 wait complete. 2024-08-20T05:02:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.455+0000 7ff838acc740 1 -- start start 2024-08-20T05:02:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.455+0000 7ff82fe00640 1 --2- 172.21.15.37:0/1808834459 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8140b3bd0 0x7ff8140b6090 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff828005fd0 tx=0x7ff828009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.456+0000 7ff838acc740 1 Processor -- start 2024-08-20T05:02:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.456+0000 7ff838acc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f3197f10 0x55b6f31a3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.456+0000 7ff838acc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3198830 0x55b6f31a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.456+0000 7ff838acc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f31a47c0 0x55b6f31a1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.456+0000 7ff838acc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b6f2f605f0 con 0x55b6f31a47c0 2024-08-20T05:02:02.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.456+0000 7ff838acc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b6f3099170 con 0x55b6f3197f10 2024-08-20T05:02:02.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.456+0000 7ff838acc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b6f31a7410 con 0x55b6f3198830 2024-08-20T05:02:02.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.456+0000 7ff838acc740 10 client.0 _ll_register_callbacks cb 0x55b6f30f88b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:02.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.456+0000 7ff82fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f31a47c0 0x55b6f31a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.456+0000 7ff82fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f31a47c0 0x55b6f31a1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39222/0 (socket says 172.21.15.37:39222) 2024-08-20T05:02:02.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.456+0000 7ff82fe00640 1 -- 172.21.15.37:0/752181458 learned_addr learned my addr 172.21.15.37:0/752181458 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:02.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.456+0000 7ff827e00640 1 --2- 172.21.15.37:0/752181458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3198830 0x55b6f31a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.456+0000 7ff82f400640 1 --2- 172.21.15.37:0/752181458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f3197f10 0x55b6f31a3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.457+0000 7ff82fe00640 1 -- 172.21.15.37:0/752181458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3198830 msgr2=0x55b6f31a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:02.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.457+0000 7ff82fe00640 1 --2- 172.21.15.37:0/752181458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3198830 0x55b6f31a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.457+0000 7ff82fe00640 1 -- 172.21.15.37:0/752181458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f3197f10 msgr2=0x55b6f31a3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:02.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.457+0000 7ff82fe00640 1 --2- 172.21.15.37:0/752181458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f3197f10 0x55b6f31a3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.457+0000 7ff82fe00640 1 -- 172.21.15.37:0/752181458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6f2e5d540 con 0x55b6f31a47c0 2024-08-20T05:02:02.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.457+0000 7ff82fe00640 1 --2- 172.21.15.37:0/752181458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f31a47c0 0x55b6f31a1930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff8280099c0 tx=0x7ff828004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b66983e4b921674 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:02.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.457+0000 7ff81cc00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:02:02.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.457+0000 7ff81cc00640 1 -- 172.21.15.37:0/752181458 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828004b20 con 0x55b6f31a47c0 2024-08-20T05:02:02.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.457+0000 7ff81cc00640 1 -- 172.21.15.37:0/752181458 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff828004cc0 con 0x55b6f31a47c0 2024-08-20T05:02:02.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.457+0000 7ff838acc740 1 -- 172.21.15.37:0/752181458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8180054d0 con 0x55b6f31a47c0 2024-08-20T05:02:02.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.458+0000 7ff81cc00640 1 -- 172.21.15.37:0/752181458 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff82800f890 con 0x55b6f31a47c0 2024-08-20T05:02:02.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.458+0000 7ff838acc740 10 client.15333 fetch_fsmap learned FSMap version 28 2024-08-20T05:02:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.458+0000 7ff838acc740 1 -- 172.21.15.37:0/752181458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b6f31b2cd0 con 0x55b6f31a47c0 2024-08-20T05:02:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.458+0000 7ff81cc00640 1 -- 172.21.15.37:0/752181458 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8180054d0 con 0x55b6f31a47c0 2024-08-20T05:02:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.458+0000 7ff81cc00640 1 -- 172.21.15.37:0/752181458 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff828026070 con 0x55b6f31a47c0 2024-08-20T05:02:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.458+0000 7ff838acc740 10 client.15333 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:02:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.458+0000 7ff838acc740 10 client.15333 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-20T05:02:02.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.458+0000 7ff838acc740 20 client.15333 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:02.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.458+0000 7ff838acc740 1 --2- 172.21.15.37:0/752181458 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b6f31b53a0 0x55b6f31b6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.458+0000 7ff838acc740 4 client.15333 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:02:02.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.458+0000 7ff838acc740 1 -- 172.21.15.37:0/752181458 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6f3110790 con 0x55b6f31b53a0 2024-08-20T05:02:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.459+0000 7ff82f400640 1 --2- 172.21.15.37:0/752181458 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b6f31b53a0 0x55b6f31b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.459+0000 7ff82f400640 1 --2- 172.21.15.37:0/752181458 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b6f31b53a0 0x55b6f31b6810 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8340aaa1080407b7 server_cookie=7ad249331c40499e in_seq=0 out_seq=0 2024-08-20T05:02:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.459+0000 7ff81cc00640 10 client.15333 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.460+0000 7ff81cc00640 1 -- 172.21.15.37:0/752181458 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b6f3110790 con 0x55b6f31b53a0 2024-08-20T05:02:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.460+0000 7ff81cc00640 10 client.15333 handle_command_reply: tid=0 2024-08-20T05:02:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.460+0000 7ff838acc740 1 client.15333 shutdown 2024-08-20T05:02:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.460+0000 7ff838acc740 1 -- 172.21.15.37:0/752181458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f31a47c0 msgr2=0x55b6f31a1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.460+0000 7ff838acc740 1 --2- 172.21.15.37:0/752181458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f31a47c0 0x55b6f31a1930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff8280099c0 tx=0x7ff828004ab0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.461+0000 7ff838acc740 1 -- 172.21.15.37:0/752181458 shutdown_connections 2024-08-20T05:02:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.461+0000 7ff838acc740 1 --2- 172.21.15.37:0/752181458 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b6f31b53a0 0x55b6f31b6810 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.461+0000 7ff838acc740 1 --2- 172.21.15.37:0/752181458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f31a47c0 0x55b6f31a1930 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.461+0000 7ff838acc740 1 --2- 172.21.15.37:0/752181458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3198830 0x55b6f31a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.461+0000 7ff838acc740 1 --2- 172.21.15.37:0/752181458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f3197f10 0x55b6f31a3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.461+0000 7ff838acc740 1 -- 172.21.15.37:0/752181458 >> 172.21.15.37:0/752181458 conn(0x55b6f3195d40 msgr2=0x55b6f319b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.461+0000 7ff81cc00640 0 client.15333 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.461+0000 7ff838acc740 1 -- 172.21.15.37:0/752181458 shutdown_connections 2024-08-20T05:02:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.461+0000 7ff838acc740 1 -- 172.21.15.37:0/752181458 wait complete. 2024-08-20T05:02:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.461+0000 7ff838acc740 20 client.15333 trim_cache size 0 max 16384 2024-08-20T05:02:02.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.480+0000 7ff838acc740 1 Processor -- start 2024-08-20T05:02:02.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.480+0000 7ff838acc740 1 -- start start 2024-08-20T05:02:02.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.480+0000 7ff838acc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3197f10 0x55b6f31a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.480+0000 7ff838acc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f3198830 0x55b6f31a16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.480+0000 7ff838acc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f31a47c0 0x55b6f319e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.480+0000 7ff838acc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b6f31b4b50 con 0x55b6f3198830 2024-08-20T05:02:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.480+0000 7ff838acc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b6f31b5220 con 0x55b6f31a47c0 2024-08-20T05:02:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.480+0000 7ff838acc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b6f31b58f0 con 0x55b6f3197f10 2024-08-20T05:02:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.480+0000 7ff82f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3197f10 0x55b6f31a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.480+0000 7ff827e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f3198830 0x55b6f31a16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.480+0000 7ff82f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3197f10 0x55b6f31a11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51182/0 (socket says 172.21.15.37:51182) 2024-08-20T05:02:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.480+0000 7ff82f400640 1 -- 172.21.15.37:0/211206453 learned_addr learned my addr 172.21.15.37:0/211206453 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.480+0000 7ff82fe00640 1 --2- 172.21.15.37:0/211206453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f31a47c0 0x55b6f319e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.481+0000 7ff82f400640 1 -- 172.21.15.37:0/211206453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f31a47c0 msgr2=0x55b6f319e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:02.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.481+0000 7ff82f400640 1 --2- 172.21.15.37:0/211206453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f31a47c0 0x55b6f319e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.481+0000 7ff82f400640 1 -- 172.21.15.37:0/211206453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f3198830 msgr2=0x55b6f31a16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:02.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.481+0000 7ff82f400640 1 --2- 172.21.15.37:0/211206453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f3198830 0x55b6f31a16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.481+0000 7ff82f400640 1 -- 172.21.15.37:0/211206453 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6f3191370 con 0x55b6f3197f10 2024-08-20T05:02:02.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.481+0000 7ff82fe00640 1 --2- 172.21.15.37:0/211206453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f31a47c0 0x55b6f319e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:02:02.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.481+0000 7ff82f400640 1 --2- 172.21.15.37:0/211206453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3197f10 0x55b6f31a11a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff8200a6bb0 tx=0x7ff8200e7a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d151f317f118f423 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:02.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.481+0000 7ff81f400640 1 -- 172.21.15.37:0/211206453 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8200abe60 con 0x55b6f3197f10 2024-08-20T05:02:02.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.481+0000 7ff81f400640 1 -- 172.21.15.37:0/211206453 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8200aa640 con 0x55b6f3197f10 2024-08-20T05:02:02.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.481+0000 7ff81f400640 1 -- 172.21.15.37:0/211206453 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8200af130 con 0x55b6f3197f10 2024-08-20T05:02:02.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.482+0000 7ff838acc740 1 -- 172.21.15.37:0/211206453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3197f10 msgr2=0x55b6f31a11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:02.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.482+0000 7ff838acc740 1 --2- 172.21.15.37:0/211206453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3197f10 0x55b6f31a11a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff8200a6bb0 tx=0x7ff8200e7a20 comp rx=0 tx=0).stop 2024-08-20T05:02:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.482+0000 7ff838acc740 1 -- 172.21.15.37:0/211206453 shutdown_connections 2024-08-20T05:02:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.482+0000 7ff838acc740 1 --2- 172.21.15.37:0/211206453 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f31a47c0 0x55b6f319e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.482+0000 7ff838acc740 1 --2- 172.21.15.37:0/211206453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f3198830 0x55b6f31a16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.482+0000 7ff838acc740 1 --2- 172.21.15.37:0/211206453 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3197f10 0x55b6f31a11a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.482+0000 7ff838acc740 1 -- 172.21.15.37:0/211206453 >> 172.21.15.37:0/211206453 conn(0x55b6f3195d40 msgr2=0x55b6f31b4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.482+0000 7ff838acc740 1 -- 172.21.15.37:0/211206453 shutdown_connections 2024-08-20T05:02:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.482+0000 7ff838acc740 1 -- 172.21.15.37:0/211206453 wait complete. 2024-08-20T05:02:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.483+0000 7ff838acc740 1 -- start start 2024-08-20T05:02:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.483+0000 7ff838acc740 1 Processor -- start 2024-08-20T05:02:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.483+0000 7ff838acc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f3197f10 0x55b6f31bf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.483+0000 7ff838acc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3198830 0x55b6f31ba730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.483+0000 7ff838acc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f31a47c0 0x55b6f31bad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.483+0000 7ff838acc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b6f31b6690 con 0x55b6f3197f10 2024-08-20T05:02:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.483+0000 7ff838acc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b6f31b5fc0 con 0x55b6f31a47c0 2024-08-20T05:02:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.483+0000 7ff838acc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b6f31b6d60 con 0x55b6f3198830 2024-08-20T05:02:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.483+0000 7ff838acc740 10 client.0 _ll_register_callbacks cb 0x7ff828009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.483+0000 7ff827e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3198830 0x55b6f31ba730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.484+0000 7ff82f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f3197f10 0x55b6f31bf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.484+0000 7ff82fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f31a47c0 0x55b6f31bad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.484+0000 7ff827e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3198830 0x55b6f31ba730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51188/0 (socket says 172.21.15.37:51188) 2024-08-20T05:02:02.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.484+0000 7ff827e00640 1 -- 172.21.15.37:0/2508877762 learned_addr learned my addr 172.21.15.37:0/2508877762 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:02.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.484+0000 7ff82fe00640 1 -- 172.21.15.37:0/2508877762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3198830 msgr2=0x55b6f31ba730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:02.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.484+0000 7ff82fe00640 1 --2- 172.21.15.37:0/2508877762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3198830 0x55b6f31ba730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.484+0000 7ff82fe00640 1 -- 172.21.15.37:0/2508877762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f3197f10 msgr2=0x55b6f31bf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:02.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.484+0000 7ff82fe00640 1 --2- 172.21.15.37:0/2508877762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f3197f10 0x55b6f31bf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.484+0000 7ff82fe00640 1 -- 172.21.15.37:0/2508877762 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6f321eab0 con 0x55b6f31a47c0 2024-08-20T05:02:02.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.484+0000 7ff82fe00640 1 --2- 172.21.15.37:0/2508877762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f31a47c0 0x55b6f31bad60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff8280059e0 tx=0x7ff82800ff90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d5f3d3479db5785 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:02.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.484+0000 7ff81cc00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:02:02.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.484+0000 7ff81cc00640 1 -- 172.21.15.37:0/2508877762 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff828011230 con 0x55b6f31a47c0 2024-08-20T05:02:02.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.485+0000 7ff838acc740 1 -- 172.21.15.37:0/2508877762 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8200aa640 con 0x55b6f31a47c0 2024-08-20T05:02:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.485+0000 7ff81cc00640 1 -- 172.21.15.37:0/2508877762 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff82801e640 con 0x55b6f31a47c0 2024-08-20T05:02:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.485+0000 7ff81cc00640 1 -- 172.21.15.37:0/2508877762 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff82801e840 con 0x55b6f31a47c0 2024-08-20T05:02:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.485+0000 7ff838acc740 10 client.25364 fetch_fsmap learned FSMap version 28 2024-08-20T05:02:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.485+0000 7ff838acc740 1 -- 172.21.15.37:0/2508877762 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b6f321fc00 con 0x55b6f31a47c0 2024-08-20T05:02:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.485+0000 7ff81cc00640 1 -- 172.21.15.37:0/2508877762 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8200aa640 con 0x55b6f31a47c0 2024-08-20T05:02:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.485+0000 7ff81cc00640 1 -- 172.21.15.37:0/2508877762 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff828026070 con 0x55b6f31a47c0 2024-08-20T05:02:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.485+0000 7ff838acc740 10 client.25364 fetch_fsmap finished waiting for FSMap version 28 2024-08-20T05:02:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.486+0000 7ff838acc740 10 client.25364 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-20T05:02:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.486+0000 7ff838acc740 20 client.25364 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.486+0000 7ff838acc740 1 --2- 172.21.15.37:0/2508877762 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b6f32245d0 0x55b6f32232e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.486+0000 7ff838acc740 4 client.25364 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T05:02:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.486+0000 7ff838acc740 1 -- 172.21.15.37:0/2508877762 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "status"}) -- 0x55b6f310c230 con 0x55b6f32245d0 2024-08-20T05:02:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.486+0000 7ff82f400640 1 --2- 172.21.15.37:0/2508877762 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b6f32245d0 0x55b6f32232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.487+0000 7ff82f400640 1 --2- 172.21.15.37:0/2508877762 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b6f32245d0 0x55b6f32232e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d8fc3739c933b82 server_cookie=d7d84c281381e974 in_seq=0 out_seq=0 2024-08-20T05:02:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.487+0000 7ff81cc00640 10 client.25364 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.487+0000 7ff81cc00640 1 -- 172.21.15.37:0/2508877762 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b6f310c230 con 0x55b6f32245d0 2024-08-20T05:02:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.487+0000 7ff81cc00640 10 client.25364 handle_command_reply: tid=0 2024-08-20T05:02:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.487+0000 7ff838acc740 1 client.25364 shutdown 2024-08-20T05:02:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.487+0000 7ff838acc740 1 -- 172.21.15.37:0/2508877762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f31a47c0 msgr2=0x55b6f31bad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.487+0000 7ff838acc740 1 --2- 172.21.15.37:0/2508877762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f31a47c0 0x55b6f31bad60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff8280059e0 tx=0x7ff82800ff90 comp rx=0 tx=0).stop 2024-08-20T05:02:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.487+0000 7ff838acc740 1 -- 172.21.15.37:0/2508877762 shutdown_connections 2024-08-20T05:02:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.487+0000 7ff838acc740 1 --2- 172.21.15.37:0/2508877762 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b6f32245d0 0x55b6f32232e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.487+0000 7ff838acc740 1 --2- 172.21.15.37:0/2508877762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b6f31a47c0 0x55b6f31bad60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.487+0000 7ff838acc740 1 --2- 172.21.15.37:0/2508877762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b6f3198830 0x55b6f31ba730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.487+0000 7ff838acc740 1 --2- 172.21.15.37:0/2508877762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b6f3197f10 0x55b6f31bf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.487+0000 7ff81cc00640 0 client.25364 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.487+0000 7ff838acc740 1 -- 172.21.15.37:0/2508877762 >> 172.21.15.37:0/2508877762 conn(0x55b6f3195d40 msgr2=0x55b6f31a11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.487+0000 7ff838acc740 1 -- 172.21.15.37:0/2508877762 shutdown_connections 2024-08-20T05:02:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.487+0000 7ff838acc740 1 -- 172.21.15.37:0/2508877762 wait complete. 2024-08-20T05:02:02.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.487+0000 7ff838acc740 20 client.25364 trim_cache size 0 max 16384 2024-08-20T05:02:02.500 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:02:02.500 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T05:02:02.500 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-08-20T05:02:02.500 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24695, 2024-08-20T05:02:02.500 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-20T05:02:02.500 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-20T05:02:02.501 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-20T05:02:02.501 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 167.70879372799999, 2024-08-20T05:02:02.501 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 28, 2024-08-20T05:02:02.501 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 88, 2024-08-20T05:02:02.501 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 84, 2024-08-20T05:02:02.501 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 181.23084486600001 2024-08-20T05:02:02.501 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:02:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.488+0000 7ff836000640 1 -- 172.21.15.37:0/1808834459 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8140b3bd0 msgr2=0x7ff8140b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.488+0000 7ff836000640 1 --2- 172.21.15.37:0/1808834459 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8140b3bd0 0x7ff8140b6090 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff828005fd0 tx=0x7ff828009500 comp rx=0 tx=0).stop 2024-08-20T05:02:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.488+0000 7ff836000640 1 -- 172.21.15.37:0/1808834459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8301039d0 msgr2=0x7ff83019b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.488+0000 7ff836000640 1 --2- 172.21.15.37:0/1808834459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8301039d0 0x7ff83019b260 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff82000e9f0 tx=0x7ff82000eeb0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.488+0000 7ff836000640 1 -- 172.21.15.37:0/1808834459 shutdown_connections 2024-08-20T05:02:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.488+0000 7ff836000640 1 --2- 172.21.15.37:0/1808834459 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8140b3bd0 0x7ff8140b6090 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.488+0000 7ff836000640 1 --2- 172.21.15.37:0/1808834459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff83010ce30 0x7ff8301a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.488+0000 7ff836000640 1 --2- 172.21.15.37:0/1808834459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8301042f0 0x7ff83019b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.488+0000 7ff836000640 1 --2- 172.21.15.37:0/1808834459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8301039d0 0x7ff83019b260 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.488+0000 7ff836000640 1 -- 172.21.15.37:0/1808834459 >> 172.21.15.37:0/1808834459 conn(0x7ff8300fd410 msgr2=0x7ff8300ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.488+0000 7ff836000640 1 -- 172.21.15.37:0/1808834459 shutdown_connections 2024-08-20T05:02:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:02.488+0000 7ff836000640 1 -- 172.21.15.37:0/1808834459 wait complete. 2024-08-20T05:02:03.394 INFO:teuthology.run_tasks:Running task sequential... 2024-08-20T05:02:03.406 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-08-20T05:02:03.406 INFO:teuthology.task.sequential:In sequential, running task print... 2024-08-20T05:02:03.406 INFO:teuthology.task.print:Enabling mgr modules 2024-08-20T05:02:03.406 INFO:teuthology.run_tasks:Running task kclient... 2024-08-20T05:02:03.419 INFO:tasks.kclient:Mounting kernel clients... 2024-08-20T05:02:03.419 INFO:tasks.kclient:config is {'client.0': {}} 2024-08-20T05:02:03.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T05:02:03.420 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-08-20T05:02:03.456 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-08-20T05:02:03.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T05:02:03.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-20T05:02:03.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T05:02:03.558 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-08-20T05:02:03.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:03 smithi130 ceph-mon[22007]: pgmap v395: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:02:03.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:03 smithi037 ceph-mon[17265]: pgmap v395: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:02:03.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:03 smithi135 ceph-mon[22342]: pgmap v395: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-08-20T05:02:03.881 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v1', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-08-20T05:02:03.881 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-20T05:02:03.881 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-08-20T05:02:03.881 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-08-20T05:02:03.882 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs ls 2024-08-20T05:02:04.263 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:04.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.888+0000 7f2821000640 1 -- 172.21.15.37:0/1001379660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f281c102ab0 msgr2=0x7f281c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:04.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.888+0000 7f2821000640 1 --2- 172.21.15.37:0/1001379660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f281c102ab0 0x7f281c102e90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f280c009900 tx=0x7f280c02a410 comp rx=0 tx=0).stop 2024-08-20T05:02:04.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.888+0000 7f2821000640 1 -- 172.21.15.37:0/1001379660 shutdown_connections 2024-08-20T05:02:04.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.888+0000 7f2821000640 1 --2- 172.21.15.37:0/1001379660 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f281c108e40 0x7f281c10f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:04.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.888+0000 7f2821000640 1 --2- 172.21.15.37:0/1001379660 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c1084c0 0x7f281c108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:04.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.888+0000 7f2821000640 1 --2- 172.21.15.37:0/1001379660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f281c102ab0 0x7f281c102e90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:04.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.888+0000 7f2821000640 1 -- 172.21.15.37:0/1001379660 >> 172.21.15.37:0/1001379660 conn(0x7f281c0fe500 msgr2=0x7f281c100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:04.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.888+0000 7f2821000640 1 -- 172.21.15.37:0/1001379660 shutdown_connections 2024-08-20T05:02:04.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.888+0000 7f2821000640 1 -- 172.21.15.37:0/1001379660 wait complete. 2024-08-20T05:02:04.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.889+0000 7f2821000640 1 Processor -- start 2024-08-20T05:02:04.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.889+0000 7f2821000640 1 -- start start 2024-08-20T05:02:04.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.890+0000 7f2821000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f281c102ab0 0x7f281c198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.890+0000 7f2821000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f281c1084c0 0x7f281c1994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.890+0000 7f2821000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c108e40 0x7f281c19e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.890+0000 7f2821000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f281c112b50 con 0x7f281c1084c0 2024-08-20T05:02:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.890+0000 7f2821000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f281c1129d0 con 0x7f281c102ab0 2024-08-20T05:02:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.890+0000 7f2821000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f281c112cd0 con 0x7f281c108e40 2024-08-20T05:02:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.890+0000 7f2811400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f281c1084c0 0x7f281c1994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.890+0000 7f2819e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f281c102ab0 0x7f281c198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.890+0000 7f2819e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f281c102ab0 0x7f281c198f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:54126/0 (socket says 172.21.15.37:54126) 2024-08-20T05:02:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.890+0000 7f2819e00640 1 -- 172.21.15.37:0/643757604 learned_addr learned my addr 172.21.15.37:0/643757604 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.890+0000 7f281a800640 1 --2- 172.21.15.37:0/643757604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c108e40 0x7f281c19e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.891+0000 7f2819e00640 1 -- 172.21.15.37:0/643757604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c108e40 msgr2=0x7f281c19e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.891+0000 7f2819e00640 1 --2- 172.21.15.37:0/643757604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c108e40 0x7f281c19e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:04.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.891+0000 7f2819e00640 1 -- 172.21.15.37:0/643757604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f281c1084c0 msgr2=0x7f281c1994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:04.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.891+0000 7f2819e00640 1 --2- 172.21.15.37:0/643757604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f281c1084c0 0x7f281c1994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:04.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.891+0000 7f2819e00640 1 -- 172.21.15.37:0/643757604 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f281c19f040 con 0x7f281c102ab0 2024-08-20T05:02:04.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.891+0000 7f2811400640 1 --2- 172.21.15.37:0/643757604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f281c1084c0 0x7f281c1994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:04.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.891+0000 7f281a800640 1 --2- 172.21.15.37:0/643757604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c108e40 0x7f281c19e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:02:04.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.891+0000 7f2819e00640 1 --2- 172.21.15.37:0/643757604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f281c102ab0 0x7f281c198f90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f280c005ab0 tx=0x7f280c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:04.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.891+0000 7f2813400640 1 -- 172.21.15.37:0/643757604 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c03f070 con 0x7f281c102ab0 2024-08-20T05:02:04.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.891+0000 7f2821000640 1 -- 172.21.15.37:0/643757604 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f281c19f2d0 con 0x7f281c102ab0 2024-08-20T05:02:04.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.891+0000 7f2813400640 1 -- 172.21.15.37:0/643757604 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f280c031b60 con 0x7f281c102ab0 2024-08-20T05:02:04.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.891+0000 7f2813400640 1 -- 172.21.15.37:0/643757604 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c035030 con 0x7f281c102ab0 2024-08-20T05:02:04.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.892+0000 7f2821000640 1 -- 172.21.15.37:0/643757604 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f281c1a59f0 con 0x7f281c102ab0 2024-08-20T05:02:04.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.893+0000 7f2821000640 1 -- 172.21.15.37:0/643757604 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f281c102e90 con 0x7f281c102ab0 2024-08-20T05:02:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.895+0000 7f2813400640 1 -- 172.21.15.37:0/643757604 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f280c042070 con 0x7f281c102ab0 2024-08-20T05:02:04.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.897+0000 7f2813400640 1 --2- 172.21.15.37:0/643757604 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f28000b3bd0 0x7f28000b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:04.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.897+0000 7f2813400640 1 -- 172.21.15.37:0/643757604 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f280c104e00 con 0x7f281c102ab0 2024-08-20T05:02:04.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.897+0000 7f2811400640 1 --2- 172.21.15.37:0/643757604 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f28000b3bd0 0x7f28000b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:04.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.898+0000 7f2811400640 1 --2- 172.21.15.37:0/643757604 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f28000b3bd0 0x7f28000b6090 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f281c101d40 tx=0x7f2804005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:04.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:04.898+0000 7f2813400640 1 -- 172.21.15.37:0/643757604 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f280c0cc050 con 0x7f281c102ab0 2024-08-20T05:02:05.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:05.142+0000 7f2821000640 1 -- 172.21.15.37:0/643757604 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f281c02e340 con 0x7f281c102ab0 2024-08-20T05:02:05.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:05.142+0000 7f2813400640 1 -- 172.21.15.37:0/643757604 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+88 (secure 0 0 0) 0x7f280c0d4320 con 0x7f281c102ab0 2024-08-20T05:02:05.145 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-20T05:02:05.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:05.145+0000 7f2821000640 1 -- 172.21.15.37:0/643757604 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f28000b3bd0 msgr2=0x7f28000b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:05.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:05.145+0000 7f2821000640 1 --2- 172.21.15.37:0/643757604 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f28000b3bd0 0x7f28000b6090 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f281c101d40 tx=0x7f2804005f90 comp rx=0 tx=0).stop 2024-08-20T05:02:05.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:05.145+0000 7f2821000640 1 -- 172.21.15.37:0/643757604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f281c102ab0 msgr2=0x7f281c198f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:05.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:05.145+0000 7f2821000640 1 --2- 172.21.15.37:0/643757604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f281c102ab0 0x7f281c198f90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f280c005ab0 tx=0x7f280c003c10 comp rx=0 tx=0).stop 2024-08-20T05:02:05.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:05.145+0000 7f2821000640 1 -- 172.21.15.37:0/643757604 shutdown_connections 2024-08-20T05:02:05.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:05.146+0000 7f2821000640 1 --2- 172.21.15.37:0/643757604 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f28000b3bd0 0x7f28000b6090 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:05.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:05.146+0000 7f2821000640 1 --2- 172.21.15.37:0/643757604 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f281c108e40 0x7f281c19e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:05.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:05.146+0000 7f2821000640 1 --2- 172.21.15.37:0/643757604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f281c1084c0 0x7f281c1994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:05.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:05.146+0000 7f2821000640 1 --2- 172.21.15.37:0/643757604 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f281c102ab0 0x7f281c198f90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:05.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:05.146+0000 7f2821000640 1 -- 172.21.15.37:0/643757604 >> 172.21.15.37:0/643757604 conn(0x7f281c0fe500 msgr2=0x7f281c1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:05.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:05.146+0000 7f2821000640 1 -- 172.21.15.37:0/643757604 shutdown_connections 2024-08-20T05:02:05.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:05.146+0000 7f2821000640 1 -- 172.21.15.37:0/643757604 wait complete. 2024-08-20T05:02:05.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:05 smithi130 ceph-mon[22007]: pgmap v396: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:02:05.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:05 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/643757604' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-20T05:02:05.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:05 smithi037 ceph-mon[17265]: pgmap v396: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:02:05.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:05 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/643757604' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-20T05:02:05.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:05 smithi135 ceph-mon[22342]: pgmap v396: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:02:05.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:05 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/643757604' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-08-20T05:02:06.115 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-20T05:02:06.115 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-20T05:02:06.115 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-08-20T05:02:06.115 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-20T05:02:06.115 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-08-20T05:02:06.115 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-20T05:02:06.115 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-20T05:02:06.115 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-20T05:02:06.116 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-08-20T05:02:06.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T05:02:06.116 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-08-20T05:02:06.153 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-20T05:02:06.153 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-20T05:02:06.154 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-08-20T05:02:06.154 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-08-20T05:02:06.154 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-08-20T05:02:06.154 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-08-20T05:02:06.154 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-20T05:02:06.154 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-08-20T05:02:06.154 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-08-20T05:02:06.154 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-20T05:02:06.154 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-08-20T05:02:06.154 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-08-20T05:02:06.155 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-20T05:02:06.155 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-08-20T05:02:06.155 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-08-20T05:02:06.155 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-20T05:02:06.155 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42167sec preferred_lft 42167sec 2024-08-20T05:02:06.155 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2024-08-20T05:02:06.155 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-08-20T05:02:06.155 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-20T05:02:06.155 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-08-20T05:02:06.155 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-08-20T05:02:06.156 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-20T05:02:06.156 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T05:02:06.156 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-08-20T05:02:06.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2024-08-20T05:02:06.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2024-08-20T05:02:06.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2024-08-20T05:02:06.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-20T05:02:06.156 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-08-20T05:02:06.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T05:02:06.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T05:02:06.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T05:02:06.383 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-20T05:02:06.442 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-08-20T05:02:06.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T05:02:06.446 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-08-20T05:02:06.482 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-08-20T05:02:06.482 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-20T05:02:06.482 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-20T05:02:06.482 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-20T05:02:06.482 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-20T05:02:06.483 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T05:02:06.483 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-08-20T05:02:06.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-20T05:02:06.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-20T05:02:06.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-20T05:02:06.483 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-08-20T05:02:06.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T05:02:06.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T05:02:06.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T05:02:06.684 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-08-20T05:02:06.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T05:02:06.720 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-08-20T05:02:06.796 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T05:02:06.796 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-08-20T05:02:06.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--tmp-cephfs 2024-08-20T05:02:06.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-08-20T05:02:06.796 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-08-20T05:02:06.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T05:02:06.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T05:02:06.975 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-08-20T05:02:06.976 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T05:02:06.976 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-08-20T05:02:06.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-08-20T05:02:06.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-20T05:02:06.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-08-20T05:02:06.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-08-20T05:02:06.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-08-20T05:02:06.976 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-08-20T05:02:07.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T05:02:07.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T05:02:07.200 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-20T05:02:07.200 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-08-20T05:02:07.200 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-08-20T05:02:07.200 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2024-08-20T05:02:07.200 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-08-20T05:02:07.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T05:02:07.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T05:02:07.368 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-20T05:02:07.368 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /tmp/cephfs 2024-08-20T05:02:07.403 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/tmp/cephfs' 2024-08-20T05:02:07.403 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-20T05:02:07.404 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /tmp/cephfs 2024-08-20T05:02:07.479 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-08-20T05:02:07.479 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-08-20T05:02:07.479 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0 2024-08-20T05:02:07.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T05:02:07.480 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0 /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context=system_u:object_r:postgresql_db_t:s0 2024-08-20T05:02:07.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:07 smithi037 ceph-mon[17265]: pgmap v397: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:02:07.603 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0" 2024-08-20T05:02:07.603 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-08-20T05:02:07.603 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-08-20T05:02:07.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:07 smithi130 ceph-mon[22007]: pgmap v397: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:02:07.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:07 smithi135 ceph-mon[22342]: pgmap v397: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:02:08.197 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0" 2024-08-20T05:02:08.198 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-08-20T05:02:08.198 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2024-08-20T05:02:08.198 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.130:3300,172.21.15.135:3300" 2024-08-20T05:02:08.198 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:3300,172.21.15.130:3300,172.21.15.135:3300:/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0 2024-08-20T05:02:08.198 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,context="system_u:object_r:postgresql_db_t:s0",key=0,fsid=93c5cea6-5eaf-11ef-bccf-c7b262605968" will pass to kernel 2024-08-20T05:02:08.203 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-20T05:02:08.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T05:02:08.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /tmp/cephfs 2024-08-20T05:02:08.262 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-20T05:02:08.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-20T05:02:08.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T05:02:08.355 INFO:teuthology.orchestra.run.smithi037.stdout:client25373 2024-08-20T05:02:08.356 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T05:02:08.356 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-20T05:02:08.393 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-20T05:02:08.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-20T05:02:08.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T05:02:08.522 INFO:teuthology.orchestra.run.smithi037.stdout:client25373 2024-08-20T05:02:08.523 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-20T05:02:08.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-20T05:02:08.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T05:02:08.614 INFO:teuthology.orchestra.run.smithi037.stdout:client25373 2024-08-20T05:02:08.615 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/cephfs && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968.client25373/status') 2024-08-20T05:02:08.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-20T05:02:08.714 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.25373 (3)172.21.15.37:0/2215792991 2024-08-20T05:02:08.714 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2024-08-20T05:02:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2024-08-20T05:02:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2024-08-20T05:02:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:71 bytes copied, 5.9981e-05 s, 1.2 MB/s 2024-08-20T05:02:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-20T05:02:08.725 INFO:teuthology.run_tasks:Running task exec... 2024-08-20T05:02:08.736 INFO:teuthology.task.exec:Executing custom commands... 2024-08-20T05:02:08.736 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-08-20T05:02:08.736 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-08-20T05:02:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.895+0000 7fe673600640 1 -- 172.21.15.37:0/2093015606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c0788a0 msgr2=0x7fe66c078d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.895+0000 7fe673600640 1 --2- 172.21.15.37:0/2093015606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c0788a0 0x7fe66c078d20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe654009900 tx=0x7fe65402a410 comp rx=0 tx=0).stop 2024-08-20T05:02:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.895+0000 7fe673600640 1 -- 172.21.15.37:0/2093015606 shutdown_connections 2024-08-20T05:02:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.895+0000 7fe673600640 1 --2- 172.21.15.37:0/2093015606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe66c079260 0x7fe66c079bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.895+0000 7fe673600640 1 --2- 172.21.15.37:0/2093015606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c0788a0 0x7fe66c078d20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.895+0000 7fe673600640 1 --2- 172.21.15.37:0/2093015606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe66c077750 0x7fe66c077b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.895+0000 7fe673600640 1 -- 172.21.15.37:0/2093015606 >> 172.21.15.37:0/2093015606 conn(0x7fe66c100130 msgr2=0x7fe66c102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.895+0000 7fe673600640 1 -- 172.21.15.37:0/2093015606 shutdown_connections 2024-08-20T05:02:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.895+0000 7fe673600640 1 -- 172.21.15.37:0/2093015606 wait complete. 2024-08-20T05:02:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.896+0000 7fe673600640 1 Processor -- start 2024-08-20T05:02:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.896+0000 7fe673600640 1 -- start start 2024-08-20T05:02:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.896+0000 7fe673600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe66c077750 0x7fe66c19f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.896+0000 7fe673600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe66c0788a0 0x7fe66c19f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.896+0000 7fe673600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c079260 0x7fe66c1a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.896+0000 7fe673600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c114980 con 0x7fe66c079260 2024-08-20T05:02:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.896+0000 7fe673600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c114800 con 0x7fe66c077750 2024-08-20T05:02:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.896+0000 7fe673600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe66c114b00 con 0x7fe66c0788a0 2024-08-20T05:02:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.897+0000 7fe663e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe66c0788a0 0x7fe66c19f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.897+0000 7fe671600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c079260 0x7fe66c1a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.897+0000 7fe663e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe66c0788a0 0x7fe66c19f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:55634/0 (socket says 172.21.15.37:55634) 2024-08-20T05:02:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.897+0000 7fe663e00640 1 -- 172.21.15.37:0/89390019 learned_addr learned my addr 172.21.15.37:0/89390019 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.897+0000 7fe670c00640 1 --2- 172.21.15.37:0/89390019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe66c077750 0x7fe66c19f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.897+0000 7fe663e00640 1 -- 172.21.15.37:0/89390019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe66c077750 msgr2=0x7fe66c19f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.897+0000 7fe663e00640 1 --2- 172.21.15.37:0/89390019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe66c077750 0x7fe66c19f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.897+0000 7fe663e00640 1 -- 172.21.15.37:0/89390019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c079260 msgr2=0x7fe66c1a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.897+0000 7fe663e00640 1 --2- 172.21.15.37:0/89390019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c079260 0x7fe66c1a0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.897+0000 7fe663e00640 1 -- 172.21.15.37:0/89390019 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66c1a0bf0 con 0x7fe66c0788a0 2024-08-20T05:02:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.897+0000 7fe663e00640 1 --2- 172.21.15.37:0/89390019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe66c0788a0 0x7fe66c19f700 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe654005ab0 tx=0x7fe654003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.898+0000 7fe66a000640 1 -- 172.21.15.37:0/89390019 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65403f070 con 0x7fe66c0788a0 2024-08-20T05:02:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.898+0000 7fe673600640 1 -- 172.21.15.37:0/89390019 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe66c1a0e80 con 0x7fe66c0788a0 2024-08-20T05:02:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.898+0000 7fe66a000640 1 -- 172.21.15.37:0/89390019 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe654031c50 con 0x7fe66c0788a0 2024-08-20T05:02:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.898+0000 7fe66a000640 1 -- 172.21.15.37:0/89390019 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654035030 con 0x7fe66c0788a0 2024-08-20T05:02:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.898+0000 7fe673600640 1 -- 172.21.15.37:0/89390019 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe66c1a75b0 con 0x7fe66c0788a0 2024-08-20T05:02:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.899+0000 7fe673600640 1 -- 172.21.15.37:0/89390019 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe66c078d20 con 0x7fe66c0788a0 2024-08-20T05:02:08.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.901+0000 7fe66a000640 1 -- 172.21.15.37:0/89390019 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe654042070 con 0x7fe66c0788a0 2024-08-20T05:02:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.902+0000 7fe66a000640 1 --2- 172.21.15.37:0/89390019 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe6500b3bd0 0x7fe6500b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.903+0000 7fe66a000640 1 -- 172.21.15.37:0/89390019 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe654104e60 con 0x7fe66c0788a0 2024-08-20T05:02:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.903+0000 7fe670c00640 1 --2- 172.21.15.37:0/89390019 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe6500b3bd0 0x7fe6500b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:08.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.903+0000 7fe670c00640 1 --2- 172.21.15.37:0/89390019 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe6500b3bd0 0x7fe6500b6090 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009bd0 tx=0x7fe65c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:08.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:08.904+0000 7fe66a000640 1 -- 172.21.15.37:0/89390019 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe6540cba60 con 0x7fe66c0788a0 2024-08-20T05:02:09.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.141+0000 7fe673600640 1 -- 172.21.15.37:0/89390019 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fe66c02e6d0 con 0x7fe66c0788a0 2024-08-20T05:02:09.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.434+0000 7fe66a000640 1 -- 172.21.15.37:0/89390019 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v29) ==== 117+0+0 (secure 0 0 0) 0x7fe6540cffb0 con 0x7fe66c0788a0 2024-08-20T05:02:09.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.437+0000 7fe673600640 1 -- 172.21.15.37:0/89390019 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe6500b3bd0 msgr2=0x7fe6500b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:09.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.437+0000 7fe673600640 1 --2- 172.21.15.37:0/89390019 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe6500b3bd0 0x7fe6500b6090 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009bd0 tx=0x7fe65c005f90 comp rx=0 tx=0).stop 2024-08-20T05:02:09.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.437+0000 7fe673600640 1 -- 172.21.15.37:0/89390019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe66c0788a0 msgr2=0x7fe66c19f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:09.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.437+0000 7fe673600640 1 --2- 172.21.15.37:0/89390019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe66c0788a0 0x7fe66c19f700 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe654005ab0 tx=0x7fe654003b90 comp rx=0 tx=0).stop 2024-08-20T05:02:09.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.437+0000 7fe673600640 1 -- 172.21.15.37:0/89390019 shutdown_connections 2024-08-20T05:02:09.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.437+0000 7fe673600640 1 --2- 172.21.15.37:0/89390019 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe6500b3bd0 0x7fe6500b6090 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:09.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.437+0000 7fe673600640 1 --2- 172.21.15.37:0/89390019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c079260 0x7fe66c1a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:09.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.437+0000 7fe673600640 1 --2- 172.21.15.37:0/89390019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe66c0788a0 0x7fe66c19f700 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:09.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.437+0000 7fe673600640 1 --2- 172.21.15.37:0/89390019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe66c077750 0x7fe66c19f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:09.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.438+0000 7fe673600640 1 -- 172.21.15.37:0/89390019 >> 172.21.15.37:0/89390019 conn(0x7fe66c100130 msgr2=0x7fe66c101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:09.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.438+0000 7fe673600640 1 -- 172.21.15.37:0/89390019 shutdown_connections 2024-08-20T05:02:09.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.438+0000 7fe673600640 1 -- 172.21.15.37:0/89390019 wait complete. 2024-08-20T05:02:09.456 INFO:teuthology.run_tasks:Running task check-counter... 2024-08-20T05:02:09.467 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-08-20T05:02:09.490 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-20T05:02:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.648+0000 7fa284c00640 1 -- 172.21.15.37:0/62816820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2801023f0 msgr2=0x7fa280102870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.648+0000 7fa284c00640 1 --2- 172.21.15.37:0/62816820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2801023f0 0x7fa280102870 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa268009900 tx=0x7fa26802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:02:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.649+0000 7fa284c00640 1 -- 172.21.15.37:0/62816820 shutdown_connections 2024-08-20T05:02:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.649+0000 7fa284c00640 1 --2- 172.21.15.37:0/62816820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa280102db0 0x7fa28010ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.649+0000 7fa284c00640 1 --2- 172.21.15.37:0/62816820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2801023f0 0x7fa280102870 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.649+0000 7fa284c00640 1 --2- 172.21.15.37:0/62816820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa280103ba0 0x7fa280103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.649+0000 7fa284c00640 1 -- 172.21.15.37:0/62816820 >> 172.21.15.37:0/62816820 conn(0x7fa2800fdf40 msgr2=0x7fa280100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.649+0000 7fa284c00640 1 -- 172.21.15.37:0/62816820 shutdown_connections 2024-08-20T05:02:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.649+0000 7fa284c00640 1 -- 172.21.15.37:0/62816820 wait complete. 2024-08-20T05:02:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.649+0000 7fa284c00640 1 Processor -- start 2024-08-20T05:02:09.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.650+0000 7fa284c00640 1 -- start start 2024-08-20T05:02:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.650+0000 7fa284c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2801023f0 0x7fa280198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.650+0000 7fa284c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa280102db0 0x7fa2801991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.650+0000 7fa284c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa280103ba0 0x7fa280199dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.650+0000 7fa284c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa28010e430 con 0x7fa280103ba0 2024-08-20T05:02:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.650+0000 7fa284c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa28010e2b0 con 0x7fa2801023f0 2024-08-20T05:02:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.650+0000 7fa284c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa28010e5b0 con 0x7fa280102db0 2024-08-20T05:02:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.650+0000 7fa27e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa280103ba0 0x7fa280199dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.650+0000 7fa27e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa280103ba0 0x7fa280199dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50742/0 (socket says 172.21.15.37:50742) 2024-08-20T05:02:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.650+0000 7fa27e800640 1 -- 172.21.15.37:0/4207595183 learned_addr learned my addr 172.21.15.37:0/4207595183 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.650+0000 7fa275400640 1 --2- 172.21.15.37:0/4207595183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa280102db0 0x7fa2801991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.650+0000 7fa27de00640 1 --2- 172.21.15.37:0/4207595183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2801023f0 0x7fa280198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.651+0000 7fa27e800640 1 -- 172.21.15.37:0/4207595183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa280102db0 msgr2=0x7fa2801991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.651+0000 7fa27e800640 1 --2- 172.21.15.37:0/4207595183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa280102db0 0x7fa2801991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.651+0000 7fa27e800640 1 -- 172.21.15.37:0/4207595183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2801023f0 msgr2=0x7fa280198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.651+0000 7fa27e800640 1 --2- 172.21.15.37:0/4207595183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2801023f0 0x7fa280198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.651+0000 7fa27e800640 1 -- 172.21.15.37:0/4207595183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28019a690 con 0x7fa280103ba0 2024-08-20T05:02:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.651+0000 7fa275400640 1 --2- 172.21.15.37:0/4207595183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa280102db0 0x7fa2801991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.651+0000 7fa27de00640 1 --2- 172.21.15.37:0/4207595183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2801023f0 0x7fa280198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.651+0000 7fa27e800640 1 --2- 172.21.15.37:0/4207595183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa280103ba0 0x7fa280199dd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa278009fd0 tx=0x7fa27800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.651+0000 7fa277400640 1 -- 172.21.15.37:0/4207595183 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa278017070 con 0x7fa280103ba0 2024-08-20T05:02:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.651+0000 7fa277400640 1 -- 172.21.15.37:0/4207595183 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa278003e20 con 0x7fa280103ba0 2024-08-20T05:02:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.651+0000 7fa284c00640 1 -- 172.21.15.37:0/4207595183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa28019a980 con 0x7fa280103ba0 2024-08-20T05:02:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.651+0000 7fa277400640 1 -- 172.21.15.37:0/4207595183 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa278010460 con 0x7fa280103ba0 2024-08-20T05:02:09.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.652+0000 7fa284c00640 1 -- 172.21.15.37:0/4207595183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2801a1050 con 0x7fa280103ba0 2024-08-20T05:02:09.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.652+0000 7fa284c00640 1 -- 172.21.15.37:0/4207595183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa28019abe0 con 0x7fa280103ba0 2024-08-20T05:02:09.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.655+0000 7fa277400640 1 -- 172.21.15.37:0/4207595183 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa278003970 con 0x7fa280103ba0 2024-08-20T05:02:09.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.656+0000 7fa277400640 1 --2- 172.21.15.37:0/4207595183 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2640b3bd0 0x7fa2640b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:09.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.656+0000 7fa277400640 1 -- 172.21.15.37:0/4207595183 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa2780e3cd0 con 0x7fa280103ba0 2024-08-20T05:02:09.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.656+0000 7fa27de00640 1 --2- 172.21.15.37:0/4207595183 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2640b3bd0 0x7fa2640b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:09.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.657+0000 7fa27de00640 1 --2- 172.21.15.37:0/4207595183 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2640b3bd0 0x7fa2640b6090 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa270009f40 tx=0x7fa270005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:09.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.658+0000 7fa277400640 1 -- 172.21.15.37:0/4207595183 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa2780aa930 con 0x7fa280103ba0 2024-08-20T05:02:09.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:09 smithi130 ceph-mon[22007]: pgmap v398: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:02:09.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:09 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/89390019' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-20T05:02:09.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:09 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-20T05:02:09.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:09 smithi037 ceph-mon[17265]: pgmap v398: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:02:09.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:09 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/89390019' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-20T05:02:09.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:09 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-20T05:02:09.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.854+0000 7fa284c00640 1 -- 172.21.15.37:0/4207595183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa28002e6b0 con 0x7fa280103ba0 2024-08-20T05:02:09.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.856+0000 7fa277400640 1 -- 172.21.15.37:0/4207595183 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24873 (secure 0 0 0) 0x7fa2780aee80 con 0x7fa280103ba0 2024-08-20T05:02:09.858 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:09.858 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":88,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","created":"2024-08-20T04:50:26.520303+0000","modified":"2024-08-20T05:01:30.328315+0000","last_up_change":"2024-08-20T04:58:12.250259+0000","last_in_change":"2024-08-20T04:57:49.724189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T04:54:16.381529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T04:59:08.598741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T04:59:10.793802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-20T04:59:19.888446+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a813e53b-68b3-43ff-a59b-aed00e98f2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6803","nonce":3569936373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6805","nonce":3569936373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6809","nonce":3569936373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6807","nonce":3569936373}]},"public_addr":"172.21.15.37:6803/3569936373","cluster_addr":"172.21.15.37:6805/3569936373","heartbeat_back_addr":"172.21.15.37:6809/3569936373","heartbeat_front_addr":"172.21.15.37:6807/3569936373","state":["exists","up"]},{"osd":1,"uuid":"c216a8d0-9685-467a-8161-700682ce617c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6801","nonce":4206461125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6803","nonce":4206461125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6807","nonce":4206461125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6805","nonce":4206461125}]},"public_addr":"172.21.15.130:6801/4206461125","cluster_addr":"172.21.15.130:6803/4206461125","heartbeat_back_addr":"172.21.15.130:6807/4206461125","heartbeat_front_addr":"172.21.15.130:6805/4206461125","state":["exists","up"]},{"osd":2,"uuid":"34402442-c652-40eb-865e-a607a28846b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6801","nonce":2653255199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6803","nonce":2653255199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6807","nonce":2653255199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6805","nonce":2653255199}]},"public_addr":"172.21.15.135:6801/2653255199","cluster_addr":"172.21.15.135:6803/2653255199","heartbeat_back_addr":"172.21.15.135:6807/2653255199","heartbeat_front_addr":"172.21.15.135:6805/2653255199","state":["exists","up"]},{"osd":3,"uuid":"ec7be9dc-96b5-4816-9065-8121baedcdc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6811","nonce":2601290990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6813","nonce":2601290990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6817","nonce":2601290990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6815","nonce":2601290990}]},"public_addr":"172.21.15.37:6811/2601290990","cluster_addr":"172.21.15.37:6813/2601290990","heartbeat_back_addr":"172.21.15.37:6817/2601290990","heartbeat_front_addr":"172.21.15.37:6815/2601290990","state":["exists","up"]},{"osd":4,"uuid":"2dbd47f9-8686-4707-8862-3c7a99a37d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6809","nonce":3542081474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6811","nonce":3542081474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6815","nonce":3542081474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6813","nonce":3542081474}]},"public_addr":"172.21.15.130:6809/3542081474","cluster_addr":"172.21.15.130:6811/3542081474","heartbeat_back_addr":"172.21.15.130:6815/3542081474","heartbeat_front_addr":"172.21.15.130:6813/3542081474","state":["exists","up"]},{"osd":5,"uuid":"9a07a137-d6b7-4aba-8678-4fd164597f27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6809","nonce":2507249148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6811","nonce":2507249148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6815","nonce":2507249148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6813","nonce":2507249148}]},"public_addr":"172.21.15.135:6809/2507249148","cluster_addr":"172.21.15.135:6811/2507249148","heartbeat_back_addr":"172.21.15.135:6815/2507249148","heartbeat_front_addr":"172.21.15.135:6813/2507249148","state":["exists","up"]},{"osd":6,"uuid":"6d6346e8-5418-4c30-9bb3-5af352b616a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6819","nonce":155932692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6821","nonce":155932692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6825","nonce":155932692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6823","nonce":155932692}]},"public_addr":"172.21.15.37:6819/155932692","cluster_addr":"172.21.15.37:6821/155932692","heartbeat_back_addr":"172.21.15.37:6825/155932692","heartbeat_front_addr":"172.21.15.37:6823/155932692","state":["exists","up"]},{"osd":7,"uuid":"c87804c2-d456-495e-b36e-33dbb3548347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6817","nonce":4148130245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6819","nonce":4148130245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6823","nonce":4148130245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6821","nonce":4148130245}]},"public_addr":"172.21.15.130:6817/4148130245","cluster_addr":"172.21.15.130:6819/4148130245","heartbeat_back_addr":"172.21.15.130:6823/4148130245","heartbeat_front_addr":"172.21.15.130:6821/4148130245","state":["exists","up"]},{"osd":8,"uuid":"a7d4c9c8-1826-4703-92ad-ded2800b4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6817","nonce":222884649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6819","nonce":222884649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6823","nonce":222884649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6821","nonce":222884649}]},"public_addr":"172.21.15.135:6817/222884649","cluster_addr":"172.21.15.135:6819/222884649","heartbeat_back_addr":"172.21.15.135:6823/222884649","heartbeat_front_addr":"172.21.15.135:6821/222884649","state":["exists","up"]},{"osd":9,"uuid":"f9e0c194-66b5-4e62-b2ae-816a4a4fffbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6827","nonce":2240773042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6829","nonce":2240773042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6833","nonce":2240773042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6831","nonce":2240773042}]},"public_addr":"172.21.15.37:6827/2240773042","cluster_addr":"172.21.15.37:6829/2240773042","heartbeat_back_addr":"172.21.15.37:6833/2240773042","heartbeat_front_addr":"172.21.15.37:6831/2240773042","state":["exists","up"]},{"osd":10,"uuid":"fa6a50a5-2b97-42d1-9b57-b5502b7083d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6825","nonce":2896730163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6827","nonce":2896730163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6831","nonce":2896730163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6829","nonce":2896730163}]},"public_addr":"172.21.15.130:6825/2896730163","cluster_addr":"172.21.15.130:6827/2896730163","heartbeat_back_addr":"172.21.15.130:6831/2896730163","heartbeat_front_addr":"172.21.15.130:6829/2896730163","state":["exists","up"]},{"osd":11,"uuid":"9a305d75-030d-41db-abfb-81bb71e8c6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6825","nonce":2532897645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6827","nonce":2532897645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6831","nonce":2532897645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6829","nonce":2532897645}]},"public_addr":"172.21.15.135:6825/2532897645","cluster_addr":"172.21.15.135:6827/2532897645","heartbeat_back_addr":"172.21.15.135:6831/2532897645","heartbeat_front_addr":"172.21.15.135:6829/2532897645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:26.455665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:51.456030+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:14.332699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:42.749386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:07.587091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:32.450249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:01.864489+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:26.830527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:51.206257+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:20.400020+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:46.329864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:58:11.086508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4282140105":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/1217599998":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/3737412906":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/58912454":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/2105948300":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/1480362562":"2024-08-21T04:50:59.520912+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T05:02:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.858+0000 7fa284c00640 1 -- 172.21.15.37:0/4207595183 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2640b3bd0 msgr2=0x7fa2640b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.858+0000 7fa284c00640 1 --2- 172.21.15.37:0/4207595183 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2640b3bd0 0x7fa2640b6090 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa270009f40 tx=0x7fa270005f90 comp rx=0 tx=0).stop 2024-08-20T05:02:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.858+0000 7fa284c00640 1 -- 172.21.15.37:0/4207595183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa280103ba0 msgr2=0x7fa280199dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.858+0000 7fa284c00640 1 --2- 172.21.15.37:0/4207595183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa280103ba0 0x7fa280199dd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa278009fd0 tx=0x7fa27800b260 comp rx=0 tx=0).stop 2024-08-20T05:02:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.858+0000 7fa284c00640 1 -- 172.21.15.37:0/4207595183 shutdown_connections 2024-08-20T05:02:09.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.858+0000 7fa284c00640 1 --2- 172.21.15.37:0/4207595183 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2640b3bd0 0x7fa2640b6090 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:09.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.858+0000 7fa284c00640 1 --2- 172.21.15.37:0/4207595183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa280103ba0 0x7fa280199dd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:09.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.858+0000 7fa284c00640 1 --2- 172.21.15.37:0/4207595183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa280102db0 0x7fa2801991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:09.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.858+0000 7fa284c00640 1 --2- 172.21.15.37:0/4207595183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2801023f0 0x7fa280198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:09.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.858+0000 7fa284c00640 1 -- 172.21.15.37:0/4207595183 >> 172.21.15.37:0/4207595183 conn(0x7fa2800fdf40 msgr2=0x7fa280106b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:09.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.858+0000 7fa284c00640 1 -- 172.21.15.37:0/4207595183 shutdown_connections 2024-08-20T05:02:09.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:09.858+0000 7fa284c00640 1 -- 172.21.15.37:0/4207595183 wait complete. 2024-08-20T05:02:09.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:09 smithi135 ceph-mon[22342]: pgmap v398: 129 pgs: 129 active+clean; 646 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:02:09.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:09 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/89390019' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-20T05:02:09.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:09 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-08-20T05:02:09.877 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-20T04:54:16.381529+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-20T04:59:08.598741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-20T04:59:10.793802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-08-20T04:59:19.888446+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-20T05:02:09.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-20T05:02:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.041+0000 7fa693000640 1 -- 172.21.15.37:0/3717908686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa68c076c40 msgr2=0x7fa68c075290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.041+0000 7fa693000640 1 --2- 172.21.15.37:0/3717908686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa68c076c40 0x7fa68c075290 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009900 tx=0x7fa67c02a410 comp rx=0 tx=0).stop 2024-08-20T05:02:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.042+0000 7fa693000640 1 -- 172.21.15.37:0/3717908686 shutdown_connections 2024-08-20T05:02:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.042+0000 7fa693000640 1 --2- 172.21.15.37:0/3717908686 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa68c10a620 0x7fa68c10ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.042+0000 7fa693000640 1 --2- 172.21.15.37:0/3717908686 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa68c0757d0 0x7fa68c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.042+0000 7fa693000640 1 --2- 172.21.15.37:0/3717908686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa68c076c40 0x7fa68c075290 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.042+0000 7fa693000640 1 -- 172.21.15.37:0/3717908686 >> 172.21.15.37:0/3717908686 conn(0x7fa68c0fdf40 msgr2=0x7fa68c100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.042+0000 7fa693000640 1 -- 172.21.15.37:0/3717908686 shutdown_connections 2024-08-20T05:02:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.042+0000 7fa693000640 1 -- 172.21.15.37:0/3717908686 wait complete. 2024-08-20T05:02:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.043+0000 7fa693000640 1 Processor -- start 2024-08-20T05:02:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.043+0000 7fa693000640 1 -- start start 2024-08-20T05:02:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.043+0000 7fa693000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa68c0757d0 0x7fa68c19acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.043+0000 7fa693000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa68c076c40 0x7fa68c19b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.043+0000 7fa693000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa68c10a620 0x7fa68c19bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.043+0000 7fa693000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c110540 con 0x7fa68c0757d0 2024-08-20T05:02:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.043+0000 7fa693000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c1103c0 con 0x7fa68c076c40 2024-08-20T05:02:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.043+0000 7fa693000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa68c1106c0 con 0x7fa68c10a620 2024-08-20T05:02:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.043+0000 7fa68be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa68c0757d0 0x7fa68c19acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.043+0000 7fa68b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa68c076c40 0x7fa68c19b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.043+0000 7fa68be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa68c0757d0 0x7fa68c19acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50752/0 (socket says 172.21.15.37:50752) 2024-08-20T05:02:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.043+0000 7fa68be00640 1 -- 172.21.15.37:0/569263726 learned_addr learned my addr 172.21.15.37:0/569263726 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.043+0000 7fa691000640 1 --2- 172.21.15.37:0/569263726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa68c10a620 0x7fa68c19bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.044+0000 7fa68b400640 1 -- 172.21.15.37:0/569263726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa68c10a620 msgr2=0x7fa68c19bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.044+0000 7fa68b400640 1 --2- 172.21.15.37:0/569263726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa68c10a620 0x7fa68c19bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.044+0000 7fa68b400640 1 -- 172.21.15.37:0/569263726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa68c0757d0 msgr2=0x7fa68c19acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.044+0000 7fa68b400640 1 --2- 172.21.15.37:0/569263726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa68c0757d0 0x7fa68c19acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.044+0000 7fa68b400640 1 -- 172.21.15.37:0/569263726 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68c19c800 con 0x7fa68c076c40 2024-08-20T05:02:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.044+0000 7fa68b400640 1 --2- 172.21.15.37:0/569263726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa68c076c40 0x7fa68c19b310 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa67800e9f0 tx=0x7fa67800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.044+0000 7fa688c00640 1 -- 172.21.15.37:0/569263726 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67800ccc0 con 0x7fa68c076c40 2024-08-20T05:02:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.044+0000 7fa688c00640 1 -- 172.21.15.37:0/569263726 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa678005020 con 0x7fa68c076c40 2024-08-20T05:02:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.044+0000 7fa693000640 1 -- 172.21.15.37:0/569263726 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa68c19caf0 con 0x7fa68c076c40 2024-08-20T05:02:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.044+0000 7fa688c00640 1 -- 172.21.15.37:0/569263726 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678004a00 con 0x7fa68c076c40 2024-08-20T05:02:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.044+0000 7fa693000640 1 -- 172.21.15.37:0/569263726 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa68c1a31c0 con 0x7fa68c076c40 2024-08-20T05:02:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.046+0000 7fa693000640 1 -- 172.21.15.37:0/569263726 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa68c075c50 con 0x7fa68c076c40 2024-08-20T05:02:10.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.049+0000 7fa688c00640 1 -- 172.21.15.37:0/569263726 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa678004ba0 con 0x7fa68c076c40 2024-08-20T05:02:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.050+0000 7fa688c00640 1 --2- 172.21.15.37:0/569263726 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa6700b3bd0 0x7fa6700b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.050+0000 7fa688c00640 1 -- 172.21.15.37:0/569263726 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa6780e3fe0 con 0x7fa68c076c40 2024-08-20T05:02:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.050+0000 7fa68be00640 1 --2- 172.21.15.37:0/569263726 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa6700b3bd0 0x7fa6700b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.051+0000 7fa688c00640 1 -- 172.21.15.37:0/569263726 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa6780ab2e0 con 0x7fa68c076c40 2024-08-20T05:02:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.051+0000 7fa68be00640 1 --2- 172.21.15.37:0/569263726 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa6700b3bd0 0x7fa6700b6090 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0096c0 tx=0x7fa67c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:10.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.248+0000 7fa693000640 1 -- 172.21.15.37:0/569263726 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa68c1a3520 con 0x7fa68c076c40 2024-08-20T05:02:10.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.248+0000 7fa688c00640 1 -- 172.21.15.37:0/569263726 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7fa6780aabe0 con 0x7fa68c076c40 2024-08-20T05:02:10.250 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-08-20T05:02:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.251+0000 7fa693000640 1 -- 172.21.15.37:0/569263726 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa6700b3bd0 msgr2=0x7fa6700b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.251+0000 7fa693000640 1 --2- 172.21.15.37:0/569263726 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa6700b3bd0 0x7fa6700b6090 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0096c0 tx=0x7fa67c005a20 comp rx=0 tx=0).stop 2024-08-20T05:02:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.251+0000 7fa693000640 1 -- 172.21.15.37:0/569263726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa68c076c40 msgr2=0x7fa68c19b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.251+0000 7fa693000640 1 --2- 172.21.15.37:0/569263726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa68c076c40 0x7fa68c19b310 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa67800e9f0 tx=0x7fa67800eeb0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.251+0000 7fa693000640 1 -- 172.21.15.37:0/569263726 shutdown_connections 2024-08-20T05:02:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.251+0000 7fa693000640 1 --2- 172.21.15.37:0/569263726 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa6700b3bd0 0x7fa6700b6090 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.251+0000 7fa693000640 1 --2- 172.21.15.37:0/569263726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa68c10a620 0x7fa68c19bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.251+0000 7fa693000640 1 --2- 172.21.15.37:0/569263726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa68c076c40 0x7fa68c19b310 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.251+0000 7fa693000640 1 --2- 172.21.15.37:0/569263726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa68c0757d0 0x7fa68c19acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.251+0000 7fa693000640 1 -- 172.21.15.37:0/569263726 >> 172.21.15.37:0/569263726 conn(0x7fa68c0fdf40 msgr2=0x7fa68c0fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.251+0000 7fa693000640 1 -- 172.21.15.37:0/569263726 shutdown_connections 2024-08-20T05:02:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.251+0000 7fa693000640 1 -- 172.21.15.37:0/569263726 wait complete. 2024-08-20T05:02:10.268 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-20T05:02:10.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.429+0000 7f33bca00640 1 -- 172.21.15.37:0/3208038707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33b81046c0 msgr2=0x7f33b8104ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:10.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.429+0000 7f33bca00640 1 --2- 172.21.15.37:0/3208038707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33b81046c0 0x7f33b8104ac0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009930 tx=0x7f33a802a440 comp rx=0 tx=0).stop 2024-08-20T05:02:10.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.429+0000 7f33bca00640 1 -- 172.21.15.37:0/3208038707 shutdown_connections 2024-08-20T05:02:10.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.429+0000 7f33bca00640 1 --2- 172.21.15.37:0/3208038707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33b81061d0 0x7f33b810cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.429+0000 7f33bca00640 1 --2- 172.21.15.37:0/3208038707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33b8105810 0x7f33b8105c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.429+0000 7f33bca00640 1 --2- 172.21.15.37:0/3208038707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33b81046c0 0x7f33b8104ac0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.429+0000 7f33bca00640 1 -- 172.21.15.37:0/3208038707 >> 172.21.15.37:0/3208038707 conn(0x7f33b80fff80 msgr2=0x7f33b81023a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:10.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.429+0000 7f33bca00640 1 -- 172.21.15.37:0/3208038707 shutdown_connections 2024-08-20T05:02:10.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.429+0000 7f33bca00640 1 -- 172.21.15.37:0/3208038707 wait complete. 2024-08-20T05:02:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.430+0000 7f33bca00640 1 Processor -- start 2024-08-20T05:02:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.430+0000 7f33bca00640 1 -- start start 2024-08-20T05:02:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.430+0000 7f33bca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33b81046c0 0x7f33b819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.430+0000 7f33bca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33b8105810 0x7f33b819b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.430+0000 7f33bca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33b81061d0 0x7f33b819bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.430+0000 7f33bca00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f33b8110360 con 0x7f33b8105810 2024-08-20T05:02:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.430+0000 7f33bca00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f33b81101e0 con 0x7f33b81061d0 2024-08-20T05:02:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.430+0000 7f33bca00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f33b81104e0 con 0x7f33b81046c0 2024-08-20T05:02:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.431+0000 7f33b6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33b8105810 0x7f33b819b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.431+0000 7f33b7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33b81046c0 0x7f33b819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.431+0000 7f33b7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33b81046c0 0x7f33b819aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:55688/0 (socket says 172.21.15.37:55688) 2024-08-20T05:02:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.431+0000 7f33b6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33b8105810 0x7f33b819b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50764/0 (socket says 172.21.15.37:50764) 2024-08-20T05:02:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.431+0000 7f33b7400640 1 -- 172.21.15.37:0/1181238053 learned_addr learned my addr 172.21.15.37:0/1181238053 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.431+0000 7f33b7e00640 1 --2- 172.21.15.37:0/1181238053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33b81061d0 0x7f33b819bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.431+0000 7f33b6a00640 1 -- 172.21.15.37:0/1181238053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33b81046c0 msgr2=0x7f33b819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.431+0000 7f33b6a00640 1 --2- 172.21.15.37:0/1181238053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33b81046c0 0x7f33b819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.431+0000 7f33b6a00640 1 -- 172.21.15.37:0/1181238053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33b81061d0 msgr2=0x7f33b819bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.431+0000 7f33b6a00640 1 --2- 172.21.15.37:0/1181238053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33b81061d0 0x7f33b819bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.431+0000 7f33b6a00640 1 -- 172.21.15.37:0/1181238053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b819c5c0 con 0x7f33b8105810 2024-08-20T05:02:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.432+0000 7f33b6a00640 1 --2- 172.21.15.37:0/1181238053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33b8105810 0x7f33b819b0d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f33a400e9f0 tx=0x7f33a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.432+0000 7f33afe00640 1 -- 172.21.15.37:0/1181238053 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a400ccc0 con 0x7f33b8105810 2024-08-20T05:02:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.432+0000 7f33afe00640 1 -- 172.21.15.37:0/1181238053 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f33a40108e0 con 0x7f33b8105810 2024-08-20T05:02:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.432+0000 7f33afe00640 1 -- 172.21.15.37:0/1181238053 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4018880 con 0x7f33b8105810 2024-08-20T05:02:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.432+0000 7f33bca00640 1 -- 172.21.15.37:0/1181238053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b819c8b0 con 0x7f33b8105810 2024-08-20T05:02:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.432+0000 7f33bca00640 1 -- 172.21.15.37:0/1181238053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b81a2f80 con 0x7f33b8105810 2024-08-20T05:02:10.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.433+0000 7f33bca00640 1 -- 172.21.15.37:0/1181238053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33b810ba30 con 0x7f33b8105810 2024-08-20T05:02:10.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.436+0000 7f33afe00640 1 -- 172.21.15.37:0/1181238053 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f33a4010430 con 0x7f33b8105810 2024-08-20T05:02:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.437+0000 7f33afe00640 1 --2- 172.21.15.37:0/1181238053 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f339c0b3c50 0x7f339c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.438+0000 7f33afe00640 1 -- 172.21.15.37:0/1181238053 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f33a40e42d0 con 0x7f33b8105810 2024-08-20T05:02:10.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.438+0000 7f33b7400640 1 --2- 172.21.15.37:0/1181238053 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f339c0b3c50 0x7f339c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:10.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.439+0000 7f33b7400640 1 --2- 172.21.15.37:0/1181238053 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f339c0b3c50 0x7f339c0b6110 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f33a8000c00 tx=0x7f33a8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.441+0000 7f33afe00640 1 -- 172.21.15.37:0/1181238053 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f33a40aaed0 con 0x7f33b8105810 2024-08-20T05:02:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.637+0000 7f33bca00640 1 -- 172.21.15.37:0/1181238053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f33b8063a80 con 0x7f33b8105810 2024-08-20T05:02:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.638+0000 7f33afe00640 1 -- 172.21.15.37:0/1181238053 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f33a40af420 con 0x7f33b8105810 2024-08-20T05:02:10.640 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-08-20T05:02:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.640+0000 7f33bca00640 1 -- 172.21.15.37:0/1181238053 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f339c0b3c50 msgr2=0x7f339c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.640+0000 7f33bca00640 1 --2- 172.21.15.37:0/1181238053 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f339c0b3c50 0x7f339c0b6110 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f33a8000c00 tx=0x7f33a8005a20 comp rx=0 tx=0).stop 2024-08-20T05:02:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.640+0000 7f33bca00640 1 -- 172.21.15.37:0/1181238053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33b8105810 msgr2=0x7f33b819b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.640+0000 7f33bca00640 1 --2- 172.21.15.37:0/1181238053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33b8105810 0x7f33b819b0d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f33a400e9f0 tx=0x7f33a400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.640+0000 7f33bca00640 1 -- 172.21.15.37:0/1181238053 shutdown_connections 2024-08-20T05:02:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.640+0000 7f33bca00640 1 --2- 172.21.15.37:0/1181238053 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f339c0b3c50 0x7f339c0b6110 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.640+0000 7f33bca00640 1 --2- 172.21.15.37:0/1181238053 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f33b81061d0 0x7f33b819bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.640+0000 7f33bca00640 1 --2- 172.21.15.37:0/1181238053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33b8105810 0x7f33b819b0d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.640+0000 7f33bca00640 1 --2- 172.21.15.37:0/1181238053 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f33b81046c0 0x7f33b819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.640+0000 7f33bca00640 1 -- 172.21.15.37:0/1181238053 >> 172.21.15.37:0/1181238053 conn(0x7f33b80fff80 msgr2=0x7f33b8108c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.640+0000 7f33bca00640 1 -- 172.21.15.37:0/1181238053 shutdown_connections 2024-08-20T05:02:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.640+0000 7f33bca00640 1 -- 172.21.15.37:0/1181238053 wait complete. 2024-08-20T05:02:10.655 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:10 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-20T05:02:10.655 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:10 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:02:10.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:10 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/4207595183' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:02:10.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:10 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/569263726' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T05:02:10.657 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-20T05:02:10.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:10 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-20T05:02:10.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:10 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:02:10.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:10 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/4207595183' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:02:10.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:10 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/569263726' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T05:02:10.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.818+0000 7f9f4d400640 1 -- 172.21.15.37:0/2188591985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f481046a0 msgr2=0x7f9f48104aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:10.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.818+0000 7f9f4d400640 1 --2- 172.21.15.37:0/2188591985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f481046a0 0x7f9f48104aa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f9f38009890 tx=0x7f9f3802a360 comp rx=0 tx=0).stop 2024-08-20T05:02:10.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.818+0000 7f9f4d400640 1 -- 172.21.15.37:0/2188591985 shutdown_connections 2024-08-20T05:02:10.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.818+0000 7f9f4d400640 1 --2- 172.21.15.37:0/2188591985 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f481061b0 0x7f9f4810cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.818+0000 7f9f4d400640 1 --2- 172.21.15.37:0/2188591985 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f481057f0 0x7f9f48105c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.818+0000 7f9f4d400640 1 --2- 172.21.15.37:0/2188591985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f481046a0 0x7f9f48104aa0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.818+0000 7f9f4d400640 1 -- 172.21.15.37:0/2188591985 >> 172.21.15.37:0/2188591985 conn(0x7f9f480fff80 msgr2=0x7f9f481023a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:10.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.818+0000 7f9f4d400640 1 -- 172.21.15.37:0/2188591985 shutdown_connections 2024-08-20T05:02:10.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.818+0000 7f9f4d400640 1 -- 172.21.15.37:0/2188591985 wait complete. 2024-08-20T05:02:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.819+0000 7f9f4d400640 1 Processor -- start 2024-08-20T05:02:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.819+0000 7f9f4d400640 1 -- start start 2024-08-20T05:02:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.820+0000 7f9f4d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f481046a0 0x7f9f4819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.820+0000 7f9f4d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f481057f0 0x7f9f4819b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.820+0000 7f9f4d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f481061b0 0x7f9f4819bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.820+0000 7f9f4d400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9f481102f0 con 0x7f9f481046a0 2024-08-20T05:02:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.820+0000 7f9f4d400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9f48110170 con 0x7f9f481061b0 2024-08-20T05:02:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.820+0000 7f9f4d400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9f48110470 con 0x7f9f481057f0 2024-08-20T05:02:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.820+0000 7f9f47e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f481046a0 0x7f9f4819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.820+0000 7f9f47e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f481046a0 0x7f9f4819aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50782/0 (socket says 172.21.15.37:50782) 2024-08-20T05:02:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.820+0000 7f9f47e00640 1 -- 172.21.15.37:0/3629580394 learned_addr learned my addr 172.21.15.37:0/3629580394 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.820+0000 7f9f47400640 1 --2- 172.21.15.37:0/3629580394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f481057f0 0x7f9f4819b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.820+0000 7f9f4ca00640 1 --2- 172.21.15.37:0/3629580394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f481061b0 0x7f9f4819bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.820+0000 7f9f47e00640 1 -- 172.21.15.37:0/3629580394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f481057f0 msgr2=0x7f9f4819b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.820+0000 7f9f47e00640 1 --2- 172.21.15.37:0/3629580394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f481057f0 0x7f9f4819b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.820+0000 7f9f47e00640 1 -- 172.21.15.37:0/3629580394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f481061b0 msgr2=0x7f9f4819bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.820+0000 7f9f47e00640 1 --2- 172.21.15.37:0/3629580394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f481061b0 0x7f9f4819bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.820+0000 7f9f47e00640 1 -- 172.21.15.37:0/3629580394 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4819c5b0 con 0x7f9f481046a0 2024-08-20T05:02:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.821+0000 7f9f47e00640 1 --2- 172.21.15.37:0/3629580394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f481046a0 0x7f9f4819aa70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9f38005940 tx=0x7f9f38032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.821+0000 7f9f44c00640 1 -- 172.21.15.37:0/3629580394 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f38040020 con 0x7f9f481046a0 2024-08-20T05:02:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.821+0000 7f9f44c00640 1 -- 172.21.15.37:0/3629580394 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f38030de0 con 0x7f9f481046a0 2024-08-20T05:02:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.821+0000 7f9f44c00640 1 -- 172.21.15.37:0/3629580394 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f38037040 con 0x7f9f481046a0 2024-08-20T05:02:10.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.821+0000 7f9f4d400640 1 -- 172.21.15.37:0/3629580394 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f4819c840 con 0x7f9f481046a0 2024-08-20T05:02:10.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.821+0000 7f9f4d400640 1 -- 172.21.15.37:0/3629580394 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f481a2f70 con 0x7f9f481046a0 2024-08-20T05:02:10.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.822+0000 7f9f4d400640 1 -- 172.21.15.37:0/3629580394 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f48104aa0 con 0x7f9f481046a0 2024-08-20T05:02:10.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.824+0000 7f9f44c00640 1 -- 172.21.15.37:0/3629580394 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9f38043020 con 0x7f9f481046a0 2024-08-20T05:02:10.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.827+0000 7f9f44c00640 1 --2- 172.21.15.37:0/3629580394 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f2c0b3c50 0x7f9f2c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:10.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.827+0000 7f9f44c00640 1 -- 172.21.15.37:0/3629580394 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9f38103d40 con 0x7f9f481046a0 2024-08-20T05:02:10.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.827+0000 7f9f47400640 1 --2- 172.21.15.37:0/3629580394 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f2c0b3c50 0x7f9f2c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:10.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.827+0000 7f9f47400640 1 --2- 172.21.15.37:0/3629580394 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f2c0b3c50 0x7f9f2c0b6110 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009530 tx=0x7f9f34009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:10.830+0000 7f9f44c00640 1 -- 172.21.15.37:0/3629580394 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f9f3804a020 con 0x7f9f481046a0 2024-08-20T05:02:10.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:10 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-20T05:02:10.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:10 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:02:10.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:10 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/4207595183' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:02:10.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:10 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/569263726' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T05:02:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.025+0000 7f9f4d400640 1 -- 172.21.15.37:0/3629580394 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9f48063a80 con 0x7f9f481046a0 2024-08-20T05:02:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.025+0000 7f9f44c00640 1 -- 172.21.15.37:0/3629580394 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f9f380caf90 con 0x7f9f481046a0 2024-08-20T05:02:11.027 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-08-20T05:02:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.028+0000 7f9f4d400640 1 -- 172.21.15.37:0/3629580394 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f2c0b3c50 msgr2=0x7f9f2c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.028+0000 7f9f4d400640 1 --2- 172.21.15.37:0/3629580394 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f2c0b3c50 0x7f9f2c0b6110 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009530 tx=0x7f9f34009260 comp rx=0 tx=0).stop 2024-08-20T05:02:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.028+0000 7f9f4d400640 1 -- 172.21.15.37:0/3629580394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f481046a0 msgr2=0x7f9f4819aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.028+0000 7f9f4d400640 1 --2- 172.21.15.37:0/3629580394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f481046a0 0x7f9f4819aa70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9f38005940 tx=0x7f9f38032d50 comp rx=0 tx=0).stop 2024-08-20T05:02:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.028+0000 7f9f4d400640 1 -- 172.21.15.37:0/3629580394 shutdown_connections 2024-08-20T05:02:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.028+0000 7f9f4d400640 1 --2- 172.21.15.37:0/3629580394 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f2c0b3c50 0x7f9f2c0b6110 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.028+0000 7f9f4d400640 1 --2- 172.21.15.37:0/3629580394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f481061b0 0x7f9f4819bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.028+0000 7f9f4d400640 1 --2- 172.21.15.37:0/3629580394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f481057f0 0x7f9f4819b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.028+0000 7f9f4d400640 1 --2- 172.21.15.37:0/3629580394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f481046a0 0x7f9f4819aa70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.028+0000 7f9f4d400640 1 -- 172.21.15.37:0/3629580394 >> 172.21.15.37:0/3629580394 conn(0x7f9f480fff80 msgr2=0x7f9f48108be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.028+0000 7f9f4d400640 1 -- 172.21.15.37:0/3629580394 shutdown_connections 2024-08-20T05:02:11.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.028+0000 7f9f4d400640 1 -- 172.21.15.37:0/3629580394 wait complete. 2024-08-20T05:02:11.046 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-08-20T05:02:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.206+0000 7f3bf8a00640 1 -- 172.21.15.37:0/4093101154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bf4077750 msgr2=0x7f3bf4077b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:11.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.206+0000 7f3bf8a00640 1 --2- 172.21.15.37:0/4093101154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bf4077750 0x7f3bf4077b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009860 tx=0x7f3be402a340 comp rx=0 tx=0).stop 2024-08-20T05:02:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.206+0000 7f3bf8a00640 1 -- 172.21.15.37:0/4093101154 shutdown_connections 2024-08-20T05:02:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.206+0000 7f3bf8a00640 1 --2- 172.21.15.37:0/4093101154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bf4079260 0x7f3bf4079bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.206+0000 7f3bf8a00640 1 --2- 172.21.15.37:0/4093101154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf40788a0 0x7f3bf4078d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.206+0000 7f3bf8a00640 1 --2- 172.21.15.37:0/4093101154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bf4077750 0x7f3bf4077b50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.206+0000 7f3bf8a00640 1 -- 172.21.15.37:0/4093101154 >> 172.21.15.37:0/4093101154 conn(0x7f3bf40fff80 msgr2=0x7f3bf41023a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.206+0000 7f3bf8a00640 1 -- 172.21.15.37:0/4093101154 shutdown_connections 2024-08-20T05:02:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.206+0000 7f3bf8a00640 1 -- 172.21.15.37:0/4093101154 wait complete. 2024-08-20T05:02:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.207+0000 7f3bf8a00640 1 Processor -- start 2024-08-20T05:02:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.207+0000 7f3bf8a00640 1 -- start start 2024-08-20T05:02:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.207+0000 7f3bf8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bf4077750 0x7f3bf419ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.207+0000 7f3bf8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf40788a0 0x7f3bf419f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.208+0000 7f3bf8a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bf4079260 0x7f3bf41a00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.208+0000 7f3bf8a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf4114720 con 0x7f3bf40788a0 2024-08-20T05:02:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.208+0000 7f3bf8a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf41145a0 con 0x7f3bf4079260 2024-08-20T05:02:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.208+0000 7f3bf8a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf41148a0 con 0x7f3bf4077750 2024-08-20T05:02:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.208+0000 7f3bebe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf40788a0 0x7f3bf419f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.208+0000 7f3bebe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf40788a0 0x7f3bf419f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50790/0 (socket says 172.21.15.37:50790) 2024-08-20T05:02:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.208+0000 7f3bebe00640 1 -- 172.21.15.37:0/478053549 learned_addr learned my addr 172.21.15.37:0/478053549 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:11.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.208+0000 7f3bf2800640 1 --2- 172.21.15.37:0/478053549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bf4077750 0x7f3bf419ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.208+0000 7f3bf3200640 1 --2- 172.21.15.37:0/478053549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bf4079260 0x7f3bf41a00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.208+0000 7f3bebe00640 1 -- 172.21.15.37:0/478053549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bf4077750 msgr2=0x7f3bf419ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.208+0000 7f3bebe00640 1 --2- 172.21.15.37:0/478053549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bf4077750 0x7f3bf419ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.208+0000 7f3bebe00640 1 -- 172.21.15.37:0/478053549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bf4079260 msgr2=0x7f3bf41a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.208+0000 7f3bebe00640 1 --2- 172.21.15.37:0/478053549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bf4079260 0x7f3bf41a00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.208+0000 7f3bebe00640 1 -- 172.21.15.37:0/478053549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf41a0970 con 0x7f3bf40788a0 2024-08-20T05:02:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.208+0000 7f3bf3200640 1 --2- 172.21.15.37:0/478053549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bf4079260 0x7f3bf41a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:02:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.208+0000 7f3bebe00640 1 --2- 172.21.15.37:0/478053549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf40788a0 0x7f3bf419f480 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00e9c0 tx=0x7f3bdc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.209+0000 7f3beb400640 1 -- 172.21.15.37:0/478053549 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc00cde0 con 0x7f3bf40788a0 2024-08-20T05:02:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.209+0000 7f3bf8a00640 1 -- 172.21.15.37:0/478053549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf41a0c60 con 0x7f3bf40788a0 2024-08-20T05:02:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.209+0000 7f3beb400640 1 -- 172.21.15.37:0/478053549 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bdc0035f0 con 0x7f3bf40788a0 2024-08-20T05:02:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.209+0000 7f3beb400640 1 -- 172.21.15.37:0/478053549 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc010690 con 0x7f3bf40788a0 2024-08-20T05:02:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.209+0000 7f3bf8a00640 1 -- 172.21.15.37:0/478053549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf41a7330 con 0x7f3bf40788a0 2024-08-20T05:02:11.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.210+0000 7f3bf8a00640 1 -- 172.21.15.37:0/478053549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bf4111150 con 0x7f3bf40788a0 2024-08-20T05:02:11.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.212+0000 7f3beb400640 1 -- 172.21.15.37:0/478053549 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3bdc004000 con 0x7f3bf40788a0 2024-08-20T05:02:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.214+0000 7f3beb400640 1 --2- 172.21.15.37:0/478053549 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3bd80b3bd0 0x7f3bd80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:11.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.214+0000 7f3beb400640 1 -- 172.21.15.37:0/478053549 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3bdc0e4490 con 0x7f3bf40788a0 2024-08-20T05:02:11.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.214+0000 7f3bf2800640 1 --2- 172.21.15.37:0/478053549 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3bd80b3bd0 0x7f3bd80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:11.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.215+0000 7f3bf2800640 1 --2- 172.21.15.37:0/478053549 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3bd80b3bd0 0x7f3bd80b6090 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3be402a930 tx=0x7f3be4030450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:11.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.215+0000 7f3beb400640 1 -- 172.21.15.37:0/478053549 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f3bdc0ab770 con 0x7f3bf40788a0 2024-08-20T05:02:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.409+0000 7f3bf8a00640 1 -- 172.21.15.37:0/478053549 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f3bf4063a80 con 0x7f3bf40788a0 2024-08-20T05:02:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.409+0000 7f3beb400640 1 -- 172.21.15.37:0/478053549 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) ==== 103+0+11 (secure 0 0 0) 0x7f3bdc0ab070 con 0x7f3bf40788a0 2024-08-20T05:02:11.411 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-08-20T05:02:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.412+0000 7f3bf8a00640 1 -- 172.21.15.37:0/478053549 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3bd80b3bd0 msgr2=0x7f3bd80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.412+0000 7f3bf8a00640 1 --2- 172.21.15.37:0/478053549 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3bd80b3bd0 0x7f3bd80b6090 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3be402a930 tx=0x7f3be4030450 comp rx=0 tx=0).stop 2024-08-20T05:02:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.412+0000 7f3bf8a00640 1 -- 172.21.15.37:0/478053549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf40788a0 msgr2=0x7f3bf419f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.412+0000 7f3bf8a00640 1 --2- 172.21.15.37:0/478053549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf40788a0 0x7f3bf419f480 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00e9c0 tx=0x7f3bdc00ee80 comp rx=0 tx=0).stop 2024-08-20T05:02:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.412+0000 7f3bf8a00640 1 -- 172.21.15.37:0/478053549 shutdown_connections 2024-08-20T05:02:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.412+0000 7f3bf8a00640 1 --2- 172.21.15.37:0/478053549 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3bd80b3bd0 0x7f3bd80b6090 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.412+0000 7f3bf8a00640 1 --2- 172.21.15.37:0/478053549 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bf4079260 0x7f3bf41a00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.412+0000 7f3bf8a00640 1 --2- 172.21.15.37:0/478053549 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bf40788a0 0x7f3bf419f480 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.412+0000 7f3bf8a00640 1 --2- 172.21.15.37:0/478053549 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bf4077750 0x7f3bf419ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.412+0000 7f3bf8a00640 1 -- 172.21.15.37:0/478053549 >> 172.21.15.37:0/478053549 conn(0x7f3bf40fff80 msgr2=0x7f3bf4101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.412+0000 7f3bf8a00640 1 -- 172.21.15.37:0/478053549 shutdown_connections 2024-08-20T05:02:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:11.412+0000 7f3bf8a00640 1 -- 172.21.15.37:0/478053549 wait complete. 2024-08-20T05:02:11.430 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-08-20T05:02:11.431 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:02:11.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:11 smithi130 ceph-mon[22007]: pgmap v399: 129 pgs: 129 active+clean; 647 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-08-20T05:02:11.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:11 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1181238053' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T05:02:11.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:11 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3629580394' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T05:02:11.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:11 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/478053549' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-20T05:02:11.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:11 smithi037 ceph-mon[17265]: pgmap v399: 129 pgs: 129 active+clean; 647 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-08-20T05:02:11.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:11 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1181238053' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T05:02:11.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:11 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3629580394' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T05:02:11.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:11 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/478053549' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-20T05:02:11.767 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:11 smithi135 ceph-mon[22342]: pgmap v399: 129 pgs: 129 active+clean; 647 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 170 B/s wr, 11 op/s 2024-08-20T05:02:11.767 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:11 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1181238053' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T05:02:11.767 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:11 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3629580394' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T05:02:11.767 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:11 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/478053549' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-20T05:02:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:12.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.438+0000 7f8773200640 1 -- 172.21.15.37:0/3692290379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c104ca0 msgr2=0x7f876c105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:12.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.438+0000 7f8773200640 1 --2- 172.21.15.37:0/3692290379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c104ca0 0x7f876c105080 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f875c009900 tx=0x7f875c02a410 comp rx=0 tx=0).stop 2024-08-20T05:02:12.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.439+0000 7f8773200640 1 -- 172.21.15.37:0/3692290379 shutdown_connections 2024-08-20T05:02:12.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.439+0000 7f8773200640 1 --2- 172.21.15.37:0/3692290379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f876c10b030 0x7f876c111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:12.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.439+0000 7f8773200640 1 --2- 172.21.15.37:0/3692290379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f876c10a6b0 0x7f876c10aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:12.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.439+0000 7f8773200640 1 --2- 172.21.15.37:0/3692290379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c104ca0 0x7f876c105080 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:12.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.439+0000 7f8773200640 1 -- 172.21.15.37:0/3692290379 >> 172.21.15.37:0/3692290379 conn(0x7f876c100730 msgr2=0x7f876c102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:12.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.439+0000 7f8773200640 1 -- 172.21.15.37:0/3692290379 shutdown_connections 2024-08-20T05:02:12.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.439+0000 7f8773200640 1 -- 172.21.15.37:0/3692290379 wait complete. 2024-08-20T05:02:12.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.440+0000 7f8773200640 1 Processor -- start 2024-08-20T05:02:12.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.440+0000 7f8773200640 1 -- start start 2024-08-20T05:02:12.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.440+0000 7f8773200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c104ca0 0x7f876c19b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:12.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.440+0000 7f8773200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f876c10a6b0 0x7f876c19b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:12.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.440+0000 7f8773200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f876c10b030 0x7f876c1a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:12.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.440+0000 7f8773200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f876c114d40 con 0x7f876c104ca0 2024-08-20T05:02:12.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.440+0000 7f8773200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f876c114bc0 con 0x7f876c10a6b0 2024-08-20T05:02:12.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.440+0000 7f8773200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f876c114ec0 con 0x7f876c10b030 2024-08-20T05:02:12.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.441+0000 7f876be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c104ca0 0x7f876c19b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.441+0000 7f876be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c104ca0 0x7f876c19b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50820/0 (socket says 172.21.15.37:50820) 2024-08-20T05:02:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.441+0000 7f876be00640 1 -- 172.21.15.37:0/2470159822 learned_addr learned my addr 172.21.15.37:0/2470159822 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.441+0000 7f8771200640 1 --2- 172.21.15.37:0/2470159822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f876c10b030 0x7f876c1a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.441+0000 7f876b400640 1 --2- 172.21.15.37:0/2470159822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f876c10a6b0 0x7f876c19b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.441+0000 7f876be00640 1 -- 172.21.15.37:0/2470159822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f876c10b030 msgr2=0x7f876c1a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.441+0000 7f876be00640 1 --2- 172.21.15.37:0/2470159822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f876c10b030 0x7f876c1a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.441+0000 7f876be00640 1 -- 172.21.15.37:0/2470159822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f876c10a6b0 msgr2=0x7f876c19b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.441+0000 7f876be00640 1 --2- 172.21.15.37:0/2470159822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f876c10a6b0 0x7f876c19b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.441+0000 7f876be00640 1 -- 172.21.15.37:0/2470159822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876c1a1240 con 0x7f876c104ca0 2024-08-20T05:02:12.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.442+0000 7f876be00640 1 --2- 172.21.15.37:0/2470159822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c104ca0 0x7f876c19b190 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f875c005ab0 tx=0x7f875c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.442+0000 7f8768c00640 1 -- 172.21.15.37:0/2470159822 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c03f070 con 0x7f876c104ca0 2024-08-20T05:02:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.442+0000 7f8773200640 1 -- 172.21.15.37:0/2470159822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f876c1a14d0 con 0x7f876c104ca0 2024-08-20T05:02:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.442+0000 7f8768c00640 1 -- 172.21.15.37:0/2470159822 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f875c031b60 con 0x7f876c104ca0 2024-08-20T05:02:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.442+0000 7f8768c00640 1 -- 172.21.15.37:0/2470159822 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f875c035030 con 0x7f876c104ca0 2024-08-20T05:02:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.442+0000 7f8773200640 1 -- 172.21.15.37:0/2470159822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f876c1a7bf0 con 0x7f876c104ca0 2024-08-20T05:02:12.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.443+0000 7f8773200640 1 -- 172.21.15.37:0/2470159822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f876c105080 con 0x7f876c104ca0 2024-08-20T05:02:12.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.445+0000 7f8768c00640 1 -- 172.21.15.37:0/2470159822 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f875c042070 con 0x7f876c104ca0 2024-08-20T05:02:12.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.447+0000 7f8768c00640 1 --2- 172.21.15.37:0/2470159822 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87500b3c50 0x7f87500b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:12.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.447+0000 7f8768c00640 1 -- 172.21.15.37:0/2470159822 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f875c104600 con 0x7f876c104ca0 2024-08-20T05:02:12.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.447+0000 7f876b400640 1 --2- 172.21.15.37:0/2470159822 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87500b3c50 0x7f87500b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:12.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.448+0000 7f876b400640 1 --2- 172.21.15.37:0/2470159822 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87500b3c50 0x7f87500b6110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f876c10a2d0 tx=0x7f8758005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:12.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.451+0000 7f8768c00640 1 -- 172.21.15.37:0/2470159822 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f875c0cb200 con 0x7f876c104ca0 2024-08-20T05:02:12.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.682+0000 7f8773200640 1 -- 172.21.15.37:0/2470159822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f876c19c2c0 con 0x7f876c104ca0 2024-08-20T05:02:12.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.683+0000 7f8768c00640 1 -- 172.21.15.37:0/2470159822 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f875c0cf750 con 0x7f876c104ca0 2024-08-20T05:02:12.685 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:12.685 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"btime":"2024-08-20T05:02:09:430035+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:02:09.143672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:02:12.685 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 29 2024-08-20T05:02:12.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.685+0000 7f8773200640 1 -- 172.21.15.37:0/2470159822 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87500b3c50 msgr2=0x7f87500b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:12.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.685+0000 7f8773200640 1 --2- 172.21.15.37:0/2470159822 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87500b3c50 0x7f87500b6110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f876c10a2d0 tx=0x7f8758005f90 comp rx=0 tx=0).stop 2024-08-20T05:02:12.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.685+0000 7f8773200640 1 -- 172.21.15.37:0/2470159822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c104ca0 msgr2=0x7f876c19b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:12.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.685+0000 7f8773200640 1 --2- 172.21.15.37:0/2470159822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c104ca0 0x7f876c19b190 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f875c005ab0 tx=0x7f875c003c10 comp rx=0 tx=0).stop 2024-08-20T05:02:12.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.686+0000 7f8773200640 1 -- 172.21.15.37:0/2470159822 shutdown_connections 2024-08-20T05:02:12.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.686+0000 7f8773200640 1 --2- 172.21.15.37:0/2470159822 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87500b3c50 0x7f87500b6110 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:12.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.686+0000 7f8773200640 1 --2- 172.21.15.37:0/2470159822 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f876c10b030 0x7f876c1a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:12.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.686+0000 7f8773200640 1 --2- 172.21.15.37:0/2470159822 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f876c10a6b0 0x7f876c19b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:12.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.686+0000 7f8773200640 1 --2- 172.21.15.37:0/2470159822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f876c104ca0 0x7f876c19b190 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:12.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.686+0000 7f8773200640 1 -- 172.21.15.37:0/2470159822 >> 172.21.15.37:0/2470159822 conn(0x7f876c100730 msgr2=0x7f876c102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:12.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.686+0000 7f8773200640 1 -- 172.21.15.37:0/2470159822 shutdown_connections 2024-08-20T05:02:12.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:12.686+0000 7f8773200640 1 -- 172.21.15.37:0/2470159822 wait complete. 2024-08-20T05:02:13.538 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-08-20T05:02:13.538 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-08-20T05:02:13.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-20T05:02:13.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.698+0000 7f216d000640 1 -- 172.21.15.37:0/389692612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2168104690 msgr2=0x7f2168104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.698+0000 7f216d000640 1 --2- 172.21.15.37:0/389692612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2168104690 0x7f2168104a90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2158009930 tx=0x7f215802a420 comp rx=0 tx=0).stop 2024-08-20T05:02:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.698+0000 7f216d000640 1 -- 172.21.15.37:0/389692612 shutdown_connections 2024-08-20T05:02:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.698+0000 7f216d000640 1 --2- 172.21.15.37:0/389692612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21681061a0 0x7f216810cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.698+0000 7f216d000640 1 --2- 172.21.15.37:0/389692612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f21681057e0 0x7f2168105c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:13.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.698+0000 7f216d000640 1 --2- 172.21.15.37:0/389692612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2168104690 0x7f2168104a90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:13.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.698+0000 7f216d000640 1 -- 172.21.15.37:0/389692612 >> 172.21.15.37:0/389692612 conn(0x7f21680fff70 msgr2=0x7f2168102390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:13.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.698+0000 7f216d000640 1 -- 172.21.15.37:0/389692612 shutdown_connections 2024-08-20T05:02:13.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.698+0000 7f216d000640 1 -- 172.21.15.37:0/389692612 wait complete. 2024-08-20T05:02:13.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.699+0000 7f216d000640 1 Processor -- start 2024-08-20T05:02:13.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.699+0000 7f216d000640 1 -- start start 2024-08-20T05:02:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.700+0000 7f216d000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2168104690 0x7f216819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.700+0000 7f216d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21681057e0 0x7f216819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.700+0000 7f216d000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21681061a0 0x7f216819bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.700+0000 7f216d000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2168110300 con 0x7f21681057e0 2024-08-20T05:02:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.700+0000 7f216d000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2168110180 con 0x7f2168104690 2024-08-20T05:02:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.700+0000 7f216d000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2168110480 con 0x7f21681061a0 2024-08-20T05:02:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.700+0000 7f215ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21681057e0 0x7f216819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.700+0000 7f2167e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21681061a0 0x7f216819bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.700+0000 7f215ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21681057e0 0x7f216819b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34984/0 (socket says 172.21.15.37:34984) 2024-08-20T05:02:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.700+0000 7f215ea00640 1 -- 172.21.15.37:0/4062349196 learned_addr learned my addr 172.21.15.37:0/4062349196 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.700+0000 7f2167400640 1 --2- 172.21.15.37:0/4062349196 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2168104690 0x7f216819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.700+0000 7f215ea00640 1 -- 172.21.15.37:0/4062349196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21681061a0 msgr2=0x7f216819bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:13.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.700+0000 7f215ea00640 1 --2- 172.21.15.37:0/4062349196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21681061a0 0x7f216819bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:13.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.700+0000 7f215ea00640 1 -- 172.21.15.37:0/4062349196 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2168104690 msgr2=0x7f216819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:13.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.700+0000 7f215ea00640 1 --2- 172.21.15.37:0/4062349196 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2168104690 0x7f216819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:13.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.700+0000 7f215ea00640 1 -- 172.21.15.37:0/4062349196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216819c660 con 0x7f21681057e0 2024-08-20T05:02:13.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.700+0000 7f2167e00640 1 --2- 172.21.15.37:0/4062349196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21681061a0 0x7f216819bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:13.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.701+0000 7f215ea00640 1 --2- 172.21.15.37:0/4062349196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21681057e0 0x7f216819b170 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f215000e9f0 tx=0x7f215000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:13.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.701+0000 7f2164c00640 1 -- 172.21.15.37:0/4062349196 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f215000ccc0 con 0x7f21681057e0 2024-08-20T05:02:13.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.701+0000 7f2164c00640 1 -- 172.21.15.37:0/4062349196 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f215000ce60 con 0x7f21681057e0 2024-08-20T05:02:13.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.701+0000 7f216d000640 1 -- 172.21.15.37:0/4062349196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f216819c950 con 0x7f21681057e0 2024-08-20T05:02:13.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.701+0000 7f2164c00640 1 -- 172.21.15.37:0/4062349196 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2150010430 con 0x7f21681057e0 2024-08-20T05:02:13.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.701+0000 7f216d000640 1 -- 172.21.15.37:0/4062349196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21681a3020 con 0x7f21681057e0 2024-08-20T05:02:13.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.702+0000 7f216d000640 1 -- 172.21.15.37:0/4062349196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2168104a90 con 0x7f21681057e0 2024-08-20T05:02:13.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.705+0000 7f2164c00640 1 -- 172.21.15.37:0/4062349196 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f21500046c0 con 0x7f21681057e0 2024-08-20T05:02:13.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.706+0000 7f2164c00640 1 --2- 172.21.15.37:0/4062349196 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f214c0b3bd0 0x7f214c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:13.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.706+0000 7f2164c00640 1 -- 172.21.15.37:0/4062349196 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f21500e43a0 con 0x7f21681057e0 2024-08-20T05:02:13.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.706+0000 7f2167400640 1 --2- 172.21.15.37:0/4062349196 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f214c0b3bd0 0x7f214c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:13.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.707+0000 7f2167400640 1 --2- 172.21.15.37:0/4062349196 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f214c0b3bd0 0x7f214c0b6090 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2158006010 tx=0x7f21580314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:13.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.709+0000 7f2164c00640 1 -- 172.21.15.37:0/4062349196 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f21500ab5f0 con 0x7f21681057e0 2024-08-20T05:02:13.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:13 smithi037 ceph-mon[17265]: pgmap v400: 129 pgs: 129 active+clean; 647 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-20T05:02:13.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:13 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2470159822' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:13.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:13 smithi135 ceph-mon[22342]: pgmap v400: 129 pgs: 129 active+clean; 647 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-20T05:02:13.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:13 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2470159822' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:13.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.902+0000 7f216d000640 1 -- 172.21.15.37:0/4062349196 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f21680632c0 con 0x7f214c0b3bd0 2024-08-20T05:02:13.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.908+0000 7f2164c00640 1 -- 172.21.15.37:0/4062349196 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340542 (secure 0 0 0) 0x7f21680632c0 con 0x7f214c0b3bd0 2024-08-20T05:02:13.915 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:13.917 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-20T05:02:13.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.912+0000 7f216d000640 1 -- 172.21.15.37:0/4062349196 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f214c0b3bd0 msgr2=0x7f214c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:13.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.912+0000 7f216d000640 1 --2- 172.21.15.37:0/4062349196 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f214c0b3bd0 0x7f214c0b6090 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2158006010 tx=0x7f21580314a0 comp rx=0 tx=0).stop 2024-08-20T05:02:13.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.912+0000 7f216d000640 1 -- 172.21.15.37:0/4062349196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21681057e0 msgr2=0x7f216819b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:13.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.912+0000 7f216d000640 1 --2- 172.21.15.37:0/4062349196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21681057e0 0x7f216819b170 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f215000e9f0 tx=0x7f215000edf0 comp rx=0 tx=0).stop 2024-08-20T05:02:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.912+0000 7f216d000640 1 -- 172.21.15.37:0/4062349196 shutdown_connections 2024-08-20T05:02:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.912+0000 7f216d000640 1 --2- 172.21.15.37:0/4062349196 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f214c0b3bd0 0x7f214c0b6090 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.912+0000 7f216d000640 1 --2- 172.21.15.37:0/4062349196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f21681061a0 0x7f216819bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.912+0000 7f216d000640 1 --2- 172.21.15.37:0/4062349196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21681057e0 0x7f216819b170 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.912+0000 7f216d000640 1 --2- 172.21.15.37:0/4062349196 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2168104690 0x7f216819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.912+0000 7f216d000640 1 -- 172.21.15.37:0/4062349196 >> 172.21.15.37:0/4062349196 conn(0x7f21680fff70 msgr2=0x7f2168108bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.914+0000 7f216d000640 1 -- 172.21.15.37:0/4062349196 shutdown_connections 2024-08-20T05:02:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:13.914+0000 7f216d000640 1 -- 172.21.15.37:0/4062349196 wait complete. 2024-08-20T05:02:13.932 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":400,"stamp":"2024-08-20T05:02:12.019196+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662128,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1345,"num_read_kb":779,"num_write":386,"num_write_kb":2305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952691,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":819,"ondisk_log_size":819,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367568,"kb_used_data":14096,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124574256,"statfs":{"total":1151940427776,"available":1151564038144,"internally_reserved":0,"allocated":14434304,"data_stored":8075510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":311,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":51,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003535"},"pg_stats":[{"pgid":"2.1f","version":"84'13","reported_seq":180,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:06.336822+0000","last_change":"2024-08-20T04:59:09.751382+0000","last_active":"2024-08-20T05:02:06.336822+0000","last_peered":"2024-08-20T05:02:06.336822+0000","last_clean":"2024-08-20T05:02:06.336822+0000","last_became_active":"2024-08-20T04:59:09.751026+0000","last_became_peered":"2024-08-20T04:59:09.751026+0000","last_unstale":"2024-08-20T05:02:06.336822+0000","last_undegraded":"2024-08-20T05:02:06.336822+0000","last_fullsized":"2024-08-20T05:02:06.336822+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:14:50.107767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":123,"num_read_kb":123,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342960+0000","last_change":"2024-08-20T05:00:29.371826+0000","last_active":"2024-08-20T05:01:30.342960+0000","last_peered":"2024-08-20T05:01:30.342960+0000","last_clean":"2024-08-20T05:01:30.342960+0000","last_became_active":"2024-08-20T05:00:29.371618+0000","last_became_peered":"2024-08-20T05:00:29.371618+0000","last_unstale":"2024-08-20T05:01:30.342960+0000","last_undegraded":"2024-08-20T05:01:30.342960+0000","last_fullsized":"2024-08-20T05:01:30.342960+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:34:36.786900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344146+0000","last_change":"2024-08-20T04:59:21.902558+0000","last_active":"2024-08-20T05:01:30.344146+0000","last_peered":"2024-08-20T05:01:30.344146+0000","last_clean":"2024-08-20T05:01:30.344146+0000","last_became_active":"2024-08-20T04:59:21.902119+0000","last_became_peered":"2024-08-20T04:59:21.902119+0000","last_unstale":"2024-08-20T05:01:30.344146+0000","last_undegraded":"2024-08-20T05:01:30.344146+0000","last_fullsized":"2024-08-20T05:01:30.344146+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:53.765865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357136+0000","last_change":"2024-08-20T04:59:09.946282+0000","last_active":"2024-08-20T05:01:30.357136+0000","last_peered":"2024-08-20T05:01:30.357136+0000","last_clean":"2024-08-20T05:01:30.357136+0000","last_became_active":"2024-08-20T04:59:09.945867+0000","last_became_peered":"2024-08-20T04:59:09.945867+0000","last_unstale":"2024-08-20T05:01:30.357136+0000","last_undegraded":"2024-08-20T05:01:30.357136+0000","last_fullsized":"2024-08-20T05:01:30.357136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:29:08.119504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338826+0000","last_change":"2024-08-20T04:59:12.796121+0000","last_active":"2024-08-20T05:01:30.338826+0000","last_peered":"2024-08-20T05:01:30.338826+0000","last_clean":"2024-08-20T05:01:30.338826+0000","last_became_active":"2024-08-20T04:59:12.792764+0000","last_became_peered":"2024-08-20T04:59:12.792764+0000","last_unstale":"2024-08-20T05:01:30.338826+0000","last_undegraded":"2024-08-20T05:01:30.338826+0000","last_fullsized":"2024-08-20T05:01:30.338826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:01:53.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355898+0000","last_change":"2024-08-20T04:59:21.909607+0000","last_active":"2024-08-20T05:01:30.355898+0000","last_peered":"2024-08-20T05:01:30.355898+0000","last_clean":"2024-08-20T05:01:30.355898+0000","last_became_active":"2024-08-20T04:59:21.909175+0000","last_became_peered":"2024-08-20T04:59:21.909175+0000","last_unstale":"2024-08-20T05:01:30.355898+0000","last_undegraded":"2024-08-20T05:01:30.355898+0000","last_fullsized":"2024-08-20T05:01:30.355898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:29:49.940169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342724+0000","last_change":"2024-08-20T04:59:09.753233+0000","last_active":"2024-08-20T05:01:30.342724+0000","last_peered":"2024-08-20T05:01:30.342724+0000","last_clean":"2024-08-20T05:01:30.342724+0000","last_became_active":"2024-08-20T04:59:09.752614+0000","last_became_peered":"2024-08-20T04:59:09.752614+0000","last_unstale":"2024-08-20T05:01:30.342724+0000","last_undegraded":"2024-08-20T05:01:30.342724+0000","last_fullsized":"2024-08-20T05:01:30.342724+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:04:20.199669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356860+0000","last_change":"2024-08-20T04:59:12.799116+0000","last_active":"2024-08-20T05:01:30.356860+0000","last_peered":"2024-08-20T05:01:30.356860+0000","last_clean":"2024-08-20T05:01:30.356860+0000","last_became_active":"2024-08-20T04:59:12.798725+0000","last_became_peered":"2024-08-20T04:59:12.798725+0000","last_unstale":"2024-08-20T05:01:30.356860+0000","last_undegraded":"2024-08-20T05:01:30.356860+0000","last_fullsized":"2024-08-20T05:01:30.356860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:46.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356542+0000","last_change":"2024-08-20T05:00:29.372973+0000","last_active":"2024-08-20T05:01:30.356542+0000","last_peered":"2024-08-20T05:01:30.356542+0000","last_clean":"2024-08-20T05:01:30.356542+0000","last_became_active":"2024-08-20T05:00:29.372504+0000","last_became_peered":"2024-08-20T05:00:29.372504+0000","last_unstale":"2024-08-20T05:01:30.356542+0000","last_undegraded":"2024-08-20T05:01:30.356542+0000","last_fullsized":"2024-08-20T05:01:30.356542+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:22:22.410569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342961+0000","last_change":"2024-08-20T04:59:09.752771+0000","last_active":"2024-08-20T05:01:30.342961+0000","last_peered":"2024-08-20T05:01:30.342961+0000","last_clean":"2024-08-20T05:01:30.342961+0000","last_became_active":"2024-08-20T04:59:09.752415+0000","last_became_peered":"2024-08-20T04:59:09.752415+0000","last_unstale":"2024-08-20T05:01:30.342961+0000","last_undegraded":"2024-08-20T05:01:30.342961+0000","last_fullsized":"2024-08-20T05:01:30.342961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:13:18.843587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356341+0000","last_change":"2024-08-20T04:59:12.794418+0000","last_active":"2024-08-20T05:01:30.356341+0000","last_peered":"2024-08-20T05:01:30.356341+0000","last_clean":"2024-08-20T05:01:30.356341+0000","last_became_active":"2024-08-20T04:59:12.794117+0000","last_became_peered":"2024-08-20T04:59:12.794117+0000","last_unstale":"2024-08-20T05:01:30.356341+0000","last_undegraded":"2024-08-20T05:01:30.356341+0000","last_fullsized":"2024-08-20T05:01:30.356341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:18.209690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356247+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T05:01:30.356247+0000","last_peered":"2024-08-20T05:01:30.356247+0000","last_clean":"2024-08-20T05:01:30.356247+0000","last_became_active":"2024-08-20T04:59:21.906344+0000","last_became_peered":"2024-08-20T04:59:21.906344+0000","last_unstale":"2024-08-20T05:01:30.356247+0000","last_undegraded":"2024-08-20T05:01:30.356247+0000","last_fullsized":"2024-08-20T05:01:30.356247+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:48:34.982558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340475+0000","last_change":"2024-08-20T04:59:12.792719+0000","last_active":"2024-08-20T05:01:30.340475+0000","last_peered":"2024-08-20T05:01:30.340475+0000","last_clean":"2024-08-20T05:01:30.340475+0000","last_became_active":"2024-08-20T04:59:12.792294+0000","last_became_peered":"2024-08-20T04:59:12.792294+0000","last_unstale":"2024-08-20T05:01:30.340475+0000","last_undegraded":"2024-08-20T05:01:30.340475+0000","last_fullsized":"2024-08-20T05:01:30.340475+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:20:03.593798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.363468+0000","last_change":"2024-08-20T05:01:30.363065+0000","last_active":"2024-08-20T05:01:30.363468+0000","last_peered":"2024-08-20T05:01:30.363468+0000","last_clean":"2024-08-20T05:01:30.363468+0000","last_became_active":"2024-08-20T05:01:30.357909+0000","last_became_peered":"2024-08-20T05:01:30.357909+0000","last_unstale":"2024-08-20T05:01:30.363468+0000","last_undegraded":"2024-08-20T05:01:30.363468+0000","last_fullsized":"2024-08-20T05:01:30.363468+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:46:56.468529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356466+0000","last_change":"2024-08-20T04:59:21.902445+0000","last_active":"2024-08-20T05:01:30.356466+0000","last_peered":"2024-08-20T05:01:30.356466+0000","last_clean":"2024-08-20T05:01:30.356466+0000","last_became_active":"2024-08-20T04:59:21.901950+0000","last_became_peered":"2024-08-20T04:59:21.901950+0000","last_unstale":"2024-08-20T05:01:30.356466+0000","last_undegraded":"2024-08-20T05:01:30.356466+0000","last_fullsized":"2024-08-20T05:01:30.356466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:55:28.653841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356733+0000","last_change":"2024-08-20T04:59:12.784236+0000","last_active":"2024-08-20T05:01:30.356733+0000","last_peered":"2024-08-20T05:01:30.356733+0000","last_clean":"2024-08-20T05:01:30.356733+0000","last_became_active":"2024-08-20T04:59:12.783945+0000","last_became_peered":"2024-08-20T04:59:12.783945+0000","last_unstale":"2024-08-20T05:01:30.356733+0000","last_undegraded":"2024-08-20T05:01:30.356733+0000","last_fullsized":"2024-08-20T05:01:30.356733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:43:07.137543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343581+0000","last_change":"2024-08-20T04:59:09.751661+0000","last_active":"2024-08-20T05:01:30.343581+0000","last_peered":"2024-08-20T05:01:30.343581+0000","last_clean":"2024-08-20T05:01:30.343581+0000","last_became_active":"2024-08-20T04:59:09.751326+0000","last_became_peered":"2024-08-20T04:59:09.751326+0000","last_unstale":"2024-08-20T05:01:30.343581+0000","last_undegraded":"2024-08-20T05:01:30.343581+0000","last_fullsized":"2024-08-20T05:01:30.343581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:54.751929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356948+0000","last_change":"2024-08-20T04:59:21.913657+0000","last_active":"2024-08-20T05:01:30.356948+0000","last_peered":"2024-08-20T05:01:30.356948+0000","last_clean":"2024-08-20T05:01:30.356948+0000","last_became_active":"2024-08-20T04:59:21.913187+0000","last_became_peered":"2024-08-20T04:59:21.913187+0000","last_unstale":"2024-08-20T05:01:30.356948+0000","last_undegraded":"2024-08-20T05:01:30.356948+0000","last_fullsized":"2024-08-20T05:01:30.356948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:51:29.008810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339857+0000","last_change":"2024-08-20T04:59:12.780137+0000","last_active":"2024-08-20T05:01:30.339857+0000","last_peered":"2024-08-20T05:01:30.339857+0000","last_clean":"2024-08-20T05:01:30.339857+0000","last_became_active":"2024-08-20T04:59:12.779820+0000","last_became_peered":"2024-08-20T04:59:12.779820+0000","last_unstale":"2024-08-20T05:01:30.339857+0000","last_undegraded":"2024-08-20T05:01:30.339857+0000","last_fullsized":"2024-08-20T05:01:30.339857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:33:58.204255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356668+0000","last_change":"2024-08-20T04:59:09.750521+0000","last_active":"2024-08-20T05:01:30.356668+0000","last_peered":"2024-08-20T05:01:30.356668+0000","last_clean":"2024-08-20T05:01:30.356668+0000","last_became_active":"2024-08-20T04:59:09.750115+0000","last_became_peered":"2024-08-20T04:59:09.750115+0000","last_unstale":"2024-08-20T05:01:30.356668+0000","last_undegraded":"2024-08-20T05:01:30.356668+0000","last_fullsized":"2024-08-20T05:01:30.356668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:44:20.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342721+0000","last_change":"2024-08-20T04:59:21.910737+0000","last_active":"2024-08-20T05:01:30.342721+0000","last_peered":"2024-08-20T05:01:30.342721+0000","last_clean":"2024-08-20T05:01:30.342721+0000","last_became_active":"2024-08-20T04:59:21.910104+0000","last_became_peered":"2024-08-20T04:59:21.910104+0000","last_unstale":"2024-08-20T05:01:30.342721+0000","last_undegraded":"2024-08-20T05:01:30.342721+0000","last_fullsized":"2024-08-20T05:01:30.342721+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:17:40.436885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344499+0000","last_change":"2024-08-20T04:59:12.787285+0000","last_active":"2024-08-20T05:01:30.344499+0000","last_peered":"2024-08-20T05:01:30.344499+0000","last_clean":"2024-08-20T05:01:30.344499+0000","last_became_active":"2024-08-20T04:59:12.786998+0000","last_became_peered":"2024-08-20T04:59:12.786998+0000","last_unstale":"2024-08-20T05:01:30.344499+0000","last_undegraded":"2024-08-20T05:01:30.344499+0000","last_fullsized":"2024-08-20T05:01:30.344499+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:12:49.860291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356758+0000","last_change":"2024-08-20T04:59:09.947715+0000","last_active":"2024-08-20T05:01:30.356758+0000","last_peered":"2024-08-20T05:01:30.356758+0000","last_clean":"2024-08-20T05:01:30.356758+0000","last_became_active":"2024-08-20T04:59:09.947372+0000","last_became_peered":"2024-08-20T04:59:09.947372+0000","last_unstale":"2024-08-20T05:01:30.356758+0000","last_undegraded":"2024-08-20T05:01:30.356758+0000","last_fullsized":"2024-08-20T05:01:30.356758+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:42:04.352964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357308+0000","last_change":"2024-08-20T05:00:29.860562+0000","last_active":"2024-08-20T05:01:30.357308+0000","last_peered":"2024-08-20T05:01:30.357308+0000","last_clean":"2024-08-20T05:01:30.357308+0000","last_became_active":"2024-08-20T05:00:29.859944+0000","last_became_peered":"2024-08-20T05:00:29.859944+0000","last_unstale":"2024-08-20T05:01:30.357308+0000","last_undegraded":"2024-08-20T05:01:30.357308+0000","last_fullsized":"2024-08-20T05:01:30.357308+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:47.266712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338727+0000","last_change":"2024-08-20T04:59:12.785952+0000","last_active":"2024-08-20T05:01:30.338727+0000","last_peered":"2024-08-20T05:01:30.338727+0000","last_clean":"2024-08-20T05:01:30.338727+0000","last_became_active":"2024-08-20T04:59:12.785596+0000","last_became_peered":"2024-08-20T04:59:12.785596+0000","last_unstale":"2024-08-20T05:01:30.338727+0000","last_undegraded":"2024-08-20T05:01:30.338727+0000","last_fullsized":"2024-08-20T05:01:30.338727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:47.299560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356854+0000","last_change":"2024-08-20T04:59:09.964725+0000","last_active":"2024-08-20T05:01:30.356854+0000","last_peered":"2024-08-20T05:01:30.356854+0000","last_clean":"2024-08-20T05:01:30.356854+0000","last_became_active":"2024-08-20T04:59:09.964351+0000","last_became_peered":"2024-08-20T04:59:09.964351+0000","last_unstale":"2024-08-20T05:01:30.356854+0000","last_undegraded":"2024-08-20T05:01:30.356854+0000","last_fullsized":"2024-08-20T05:01:30.356854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:26:03.216378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344343+0000","last_change":"2024-08-20T04:59:21.898758+0000","last_active":"2024-08-20T05:01:30.344343+0000","last_peered":"2024-08-20T05:01:30.344343+0000","last_clean":"2024-08-20T05:01:30.344343+0000","last_became_active":"2024-08-20T04:59:21.898282+0000","last_became_peered":"2024-08-20T04:59:21.898282+0000","last_unstale":"2024-08-20T05:01:30.344343+0000","last_undegraded":"2024-08-20T05:01:30.344343+0000","last_fullsized":"2024-08-20T05:01:30.344343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:45:49.093459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357095+0000","last_change":"2024-08-20T04:59:12.793870+0000","last_active":"2024-08-20T05:01:30.357095+0000","last_peered":"2024-08-20T05:01:30.357095+0000","last_clean":"2024-08-20T05:01:30.357095+0000","last_became_active":"2024-08-20T04:59:12.792928+0000","last_became_peered":"2024-08-20T04:59:12.792928+0000","last_unstale":"2024-08-20T05:01:30.357095+0000","last_undegraded":"2024-08-20T05:01:30.357095+0000","last_fullsized":"2024-08-20T05:01:30.357095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:12:25.450347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"86'16","reported_seq":60,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343403+0000","last_change":"2024-08-20T04:59:09.751403+0000","last_active":"2024-08-20T05:01:30.343403+0000","last_peered":"2024-08-20T05:01:30.343403+0000","last_clean":"2024-08-20T05:01:30.343403+0000","last_became_active":"2024-08-20T04:59:09.750976+0000","last_became_peered":"2024-08-20T04:59:09.750976+0000","last_unstale":"2024-08-20T05:01:30.343403+0000","last_undegraded":"2024-08-20T05:01:30.343403+0000","last_fullsized":"2024-08-20T05:01:30.343403+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:58:54.627836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356432+0000","last_change":"2024-08-20T04:59:21.899813+0000","last_active":"2024-08-20T05:01:30.356432+0000","last_peered":"2024-08-20T05:01:30.356432+0000","last_clean":"2024-08-20T05:01:30.356432+0000","last_became_active":"2024-08-20T04:59:21.899462+0000","last_became_peered":"2024-08-20T04:59:21.899462+0000","last_unstale":"2024-08-20T05:01:30.356432+0000","last_undegraded":"2024-08-20T05:01:30.356432+0000","last_fullsized":"2024-08-20T05:01:30.356432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.468845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355826+0000","last_change":"2024-08-20T04:59:12.783953+0000","last_active":"2024-08-20T05:01:30.355826+0000","last_peered":"2024-08-20T05:01:30.355826+0000","last_clean":"2024-08-20T05:01:30.355826+0000","last_became_active":"2024-08-20T04:59:12.781445+0000","last_became_peered":"2024-08-20T04:59:12.781445+0000","last_unstale":"2024-08-20T05:01:30.355826+0000","last_undegraded":"2024-08-20T05:01:30.355826+0000","last_fullsized":"2024-08-20T05:01:30.355826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:04.792064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356223+0000","last_change":"2024-08-20T05:01:30.355578+0000","last_active":"2024-08-20T05:01:30.356223+0000","last_peered":"2024-08-20T05:01:30.356223+0000","last_clean":"2024-08-20T05:01:30.356223+0000","last_became_active":"2024-08-20T05:01:30.349099+0000","last_became_peered":"2024-08-20T05:01:30.349099+0000","last_unstale":"2024-08-20T05:01:30.356223+0000","last_undegraded":"2024-08-20T05:01:30.356223+0000","last_fullsized":"2024-08-20T05:01:30.356223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:17:57.165914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339956+0000","last_change":"2024-08-20T04:59:21.905202+0000","last_active":"2024-08-20T05:01:30.339956+0000","last_peered":"2024-08-20T05:01:30.339956+0000","last_clean":"2024-08-20T05:01:30.339956+0000","last_became_active":"2024-08-20T04:59:21.904771+0000","last_became_peered":"2024-08-20T04:59:21.904771+0000","last_unstale":"2024-08-20T05:01:30.339956+0000","last_undegraded":"2024-08-20T05:01:30.339956+0000","last_fullsized":"2024-08-20T05:01:30.339956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:35:56.887981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"86'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356122+0000","last_change":"2024-08-20T04:59:12.798301+0000","last_active":"2024-08-20T05:01:30.356122+0000","last_peered":"2024-08-20T05:01:30.356122+0000","last_clean":"2024-08-20T05:01:30.356122+0000","last_became_active":"2024-08-20T04:59:12.797934+0000","last_became_peered":"2024-08-20T04:59:12.797934+0000","last_unstale":"2024-08-20T05:01:30.356122+0000","last_undegraded":"2024-08-20T05:01:30.356122+0000","last_fullsized":"2024-08-20T05:01:30.356122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:41:24.465380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343575+0000","last_change":"2024-08-20T04:59:09.947602+0000","last_active":"2024-08-20T05:01:30.343575+0000","last_peered":"2024-08-20T05:01:30.343575+0000","last_clean":"2024-08-20T05:01:30.343575+0000","last_became_active":"2024-08-20T04:59:09.946795+0000","last_became_peered":"2024-08-20T04:59:09.946795+0000","last_unstale":"2024-08-20T05:01:30.343575+0000","last_undegraded":"2024-08-20T05:01:30.343575+0000","last_fullsized":"2024-08-20T05:01:30.343575+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:09:09.003266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344130+0000","last_change":"2024-08-20T05:00:29.860828+0000","last_active":"2024-08-20T05:01:30.344130+0000","last_peered":"2024-08-20T05:01:30.344130+0000","last_clean":"2024-08-20T05:01:30.344130+0000","last_became_active":"2024-08-20T05:00:29.860242+0000","last_became_peered":"2024-08-20T05:00:29.860242+0000","last_unstale":"2024-08-20T05:01:30.344130+0000","last_undegraded":"2024-08-20T05:01:30.344130+0000","last_fullsized":"2024-08-20T05:01:30.344130+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:09:42.311207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356682+0000","last_change":"2024-08-20T04:59:12.784852+0000","last_active":"2024-08-20T05:01:30.356682+0000","last_peered":"2024-08-20T05:01:30.356682+0000","last_clean":"2024-08-20T05:01:30.356682+0000","last_became_active":"2024-08-20T04:59:12.784496+0000","last_became_peered":"2024-08-20T04:59:12.784496+0000","last_unstale":"2024-08-20T05:01:30.356682+0000","last_undegraded":"2024-08-20T05:01:30.356682+0000","last_fullsized":"2024-08-20T05:01:30.356682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:41:42.421383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":173,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:07.338910+0000","last_change":"2024-08-20T04:59:09.750785+0000","last_active":"2024-08-20T05:02:07.338910+0000","last_peered":"2024-08-20T05:02:07.338910+0000","last_clean":"2024-08-20T05:02:07.338910+0000","last_became_active":"2024-08-20T04:59:09.750255+0000","last_became_peered":"2024-08-20T04:59:09.750255+0000","last_unstale":"2024-08-20T05:02:07.338910+0000","last_undegraded":"2024-08-20T05:02:07.338910+0000","last_fullsized":"2024-08-20T05:02:07.338910+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:20:17.900367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355715+0000","last_change":"2024-08-20T04:59:21.909409+0000","last_active":"2024-08-20T05:01:30.355715+0000","last_peered":"2024-08-20T05:01:30.355715+0000","last_clean":"2024-08-20T05:01:30.355715+0000","last_became_active":"2024-08-20T04:59:21.907934+0000","last_became_peered":"2024-08-20T04:59:21.907934+0000","last_unstale":"2024-08-20T05:01:30.355715+0000","last_undegraded":"2024-08-20T05:01:30.355715+0000","last_fullsized":"2024-08-20T05:01:30.355715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:26:36.768407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355879+0000","last_change":"2024-08-20T04:59:12.783496+0000","last_active":"2024-08-20T05:01:30.355879+0000","last_peered":"2024-08-20T05:01:30.355879+0000","last_clean":"2024-08-20T05:01:30.355879+0000","last_became_active":"2024-08-20T04:59:12.783211+0000","last_became_peered":"2024-08-20T04:59:12.783211+0000","last_unstale":"2024-08-20T05:01:30.355879+0000","last_undegraded":"2024-08-20T05:01:30.355879+0000","last_fullsized":"2024-08-20T05:01:30.355879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:45:49.514189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":176,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:08.342828+0000","last_change":"2024-08-20T04:59:09.948284+0000","last_active":"2024-08-20T05:02:08.342828+0000","last_peered":"2024-08-20T05:02:08.342828+0000","last_clean":"2024-08-20T05:02:08.342828+0000","last_became_active":"2024-08-20T04:59:09.947909+0000","last_became_peered":"2024-08-20T04:59:09.947909+0000","last_unstale":"2024-08-20T05:02:08.342828+0000","last_undegraded":"2024-08-20T05:02:08.342828+0000","last_fullsized":"2024-08-20T05:02:08.342828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:24:04.344380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":125,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356288+0000","last_change":"2024-08-20T04:59:21.905282+0000","last_active":"2024-08-20T05:01:30.356288+0000","last_peered":"2024-08-20T05:01:30.356288+0000","last_clean":"2024-08-20T05:01:30.356288+0000","last_became_active":"2024-08-20T04:59:21.904842+0000","last_became_peered":"2024-08-20T04:59:21.904842+0000","last_unstale":"2024-08-20T05:01:30.356288+0000","last_undegraded":"2024-08-20T05:01:30.356288+0000","last_fullsized":"2024-08-20T05:01:30.356288+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:01:19.949949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355357+0000","last_change":"2024-08-20T04:59:12.788571+0000","last_active":"2024-08-20T05:01:30.355357+0000","last_peered":"2024-08-20T05:01:30.355357+0000","last_clean":"2024-08-20T05:01:30.355357+0000","last_became_active":"2024-08-20T04:59:12.784148+0000","last_became_peered":"2024-08-20T04:59:12.784148+0000","last_unstale":"2024-08-20T05:01:30.355357+0000","last_undegraded":"2024-08-20T05:01:30.355357+0000","last_fullsized":"2024-08-20T05:01:30.355357+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:10:51.565404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340278+0000","last_change":"2024-08-20T04:59:09.753842+0000","last_active":"2024-08-20T05:01:30.340278+0000","last_peered":"2024-08-20T05:01:30.340278+0000","last_clean":"2024-08-20T05:01:30.340278+0000","last_became_active":"2024-08-20T04:59:09.753439+0000","last_became_peered":"2024-08-20T04:59:09.753439+0000","last_unstale":"2024-08-20T05:01:30.340278+0000","last_undegraded":"2024-08-20T05:01:30.340278+0000","last_fullsized":"2024-08-20T05:01:30.340278+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:54.171964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356341+0000","last_change":"2024-08-20T04:59:21.909621+0000","last_active":"2024-08-20T05:01:30.356341+0000","last_peered":"2024-08-20T05:01:30.356341+0000","last_clean":"2024-08-20T05:01:30.356341+0000","last_became_active":"2024-08-20T04:59:21.909239+0000","last_became_peered":"2024-08-20T04:59:21.909239+0000","last_unstale":"2024-08-20T05:01:30.356341+0000","last_undegraded":"2024-08-20T05:01:30.356341+0000","last_fullsized":"2024-08-20T05:01:30.356341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:53:15.131163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356523+0000","last_change":"2024-08-20T04:59:12.796643+0000","last_active":"2024-08-20T05:01:30.356523+0000","last_peered":"2024-08-20T05:01:30.356523+0000","last_clean":"2024-08-20T05:01:30.356523+0000","last_became_active":"2024-08-20T04:59:12.796262+0000","last_became_peered":"2024-08-20T04:59:12.796262+0000","last_unstale":"2024-08-20T05:01:30.356523+0000","last_undegraded":"2024-08-20T05:01:30.356523+0000","last_fullsized":"2024-08-20T05:01:30.356523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:11:37.792359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357176+0000","last_change":"2024-08-20T04:59:09.750550+0000","last_active":"2024-08-20T05:01:30.357176+0000","last_peered":"2024-08-20T05:01:30.357176+0000","last_clean":"2024-08-20T05:01:30.357176+0000","last_became_active":"2024-08-20T04:59:09.750097+0000","last_became_peered":"2024-08-20T04:59:09.750097+0000","last_unstale":"2024-08-20T05:01:30.357176+0000","last_undegraded":"2024-08-20T05:01:30.357176+0000","last_fullsized":"2024-08-20T05:01:30.357176+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:32:22.826478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340442+0000","last_change":"2024-08-20T04:57:50.824023+0000","last_active":"2024-08-20T05:01:30.340442+0000","last_peered":"2024-08-20T05:01:30.340442+0000","last_clean":"2024-08-20T05:01:30.340442+0000","last_became_active":"2024-08-20T04:57:50.350587+0000","last_became_peered":"2024-08-20T04:57:50.350587+0000","last_unstale":"2024-08-20T05:01:30.340442+0000","last_undegraded":"2024-08-20T05:01:30.340442+0000","last_fullsized":"2024-08-20T05:01:30.340442+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_clean_scrub_stamp":"2024-08-20T04:54:17.224468+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:59:23.450117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340604+0000","last_change":"2024-08-20T05:00:29.866063+0000","last_active":"2024-08-20T05:01:30.340604+0000","last_peered":"2024-08-20T05:01:30.340604+0000","last_clean":"2024-08-20T05:01:30.340604+0000","last_became_active":"2024-08-20T05:00:29.861545+0000","last_became_peered":"2024-08-20T05:00:29.861545+0000","last_unstale":"2024-08-20T05:01:30.340604+0000","last_undegraded":"2024-08-20T05:01:30.340604+0000","last_fullsized":"2024-08-20T05:01:30.340604+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:02:18.516044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.341028+0000","last_change":"2024-08-20T04:59:12.793799+0000","last_active":"2024-08-20T05:01:30.341028+0000","last_peered":"2024-08-20T05:01:30.341028+0000","last_clean":"2024-08-20T05:01:30.341028+0000","last_became_active":"2024-08-20T04:59:12.793487+0000","last_became_peered":"2024-08-20T04:59:12.793487+0000","last_unstale":"2024-08-20T05:01:30.341028+0000","last_undegraded":"2024-08-20T05:01:30.341028+0000","last_fullsized":"2024-08-20T05:01:30.341028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:08:30.835824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'7","reported_seq":181,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:10.374561+0000","last_change":"2024-08-20T04:59:09.964586+0000","last_active":"2024-08-20T05:02:10.374561+0000","last_peered":"2024-08-20T05:02:10.374561+0000","last_clean":"2024-08-20T05:02:10.374561+0000","last_became_active":"2024-08-20T04:59:09.964258+0000","last_became_peered":"2024-08-20T04:59:09.964258+0000","last_unstale":"2024-08-20T05:02:10.374561+0000","last_undegraded":"2024-08-20T05:02:10.374561+0000","last_fullsized":"2024-08-20T05:02:10.374561+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:37:48.138019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357127+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T05:01:30.357127+0000","last_peered":"2024-08-20T05:01:30.357127+0000","last_clean":"2024-08-20T05:01:30.357127+0000","last_became_active":"2024-08-20T04:59:21.906197+0000","last_became_peered":"2024-08-20T04:59:21.906197+0000","last_unstale":"2024-08-20T05:01:30.357127+0000","last_undegraded":"2024-08-20T05:01:30.357127+0000","last_fullsized":"2024-08-20T05:01:30.357127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:10:45.819035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340707+0000","last_change":"2024-08-20T04:59:12.794221+0000","last_active":"2024-08-20T05:01:30.340707+0000","last_peered":"2024-08-20T05:01:30.340707+0000","last_clean":"2024-08-20T05:01:30.340707+0000","last_became_active":"2024-08-20T04:59:12.793680+0000","last_became_peered":"2024-08-20T04:59:12.793680+0000","last_unstale":"2024-08-20T05:01:30.340707+0000","last_undegraded":"2024-08-20T05:01:30.340707+0000","last_fullsized":"2024-08-20T05:01:30.340707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:45.435700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356414+0000","last_change":"2024-08-20T04:59:09.755955+0000","last_active":"2024-08-20T05:01:30.356414+0000","last_peered":"2024-08-20T05:01:30.356414+0000","last_clean":"2024-08-20T05:01:30.356414+0000","last_became_active":"2024-08-20T04:59:09.755614+0000","last_became_peered":"2024-08-20T04:59:09.755614+0000","last_unstale":"2024-08-20T05:01:30.356414+0000","last_undegraded":"2024-08-20T05:01:30.356414+0000","last_fullsized":"2024-08-20T05:01:30.356414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:15:06.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338518+0000","last_change":"2024-08-20T04:59:21.915952+0000","last_active":"2024-08-20T05:01:30.338518+0000","last_peered":"2024-08-20T05:01:30.338518+0000","last_clean":"2024-08-20T05:01:30.338518+0000","last_became_active":"2024-08-20T04:59:21.915533+0000","last_became_peered":"2024-08-20T04:59:21.915533+0000","last_unstale":"2024-08-20T05:01:30.338518+0000","last_undegraded":"2024-08-20T05:01:30.338518+0000","last_fullsized":"2024-08-20T05:01:30.338518+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:52:54.906061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340713+0000","last_change":"2024-08-20T04:59:12.782663+0000","last_active":"2024-08-20T05:01:30.340713+0000","last_peered":"2024-08-20T05:01:30.340713+0000","last_clean":"2024-08-20T05:01:30.340713+0000","last_became_active":"2024-08-20T04:59:12.782068+0000","last_became_peered":"2024-08-20T04:59:12.782068+0000","last_unstale":"2024-08-20T05:01:30.340713+0000","last_undegraded":"2024-08-20T05:01:30.340713+0000","last_fullsized":"2024-08-20T05:01:30.340713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:46:39.662033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356158+0000","last_change":"2024-08-20T04:59:09.747456+0000","last_active":"2024-08-20T05:01:30.356158+0000","last_peered":"2024-08-20T05:01:30.356158+0000","last_clean":"2024-08-20T05:01:30.356158+0000","last_became_active":"2024-08-20T04:59:09.747141+0000","last_became_peered":"2024-08-20T04:59:09.747141+0000","last_unstale":"2024-08-20T05:01:30.356158+0000","last_undegraded":"2024-08-20T05:01:30.356158+0000","last_fullsized":"2024-08-20T05:01:30.356158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:39:01.600831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355926+0000","last_change":"2024-08-20T04:59:21.898059+0000","last_active":"2024-08-20T05:01:30.355926+0000","last_peered":"2024-08-20T05:01:30.355926+0000","last_clean":"2024-08-20T05:01:30.355926+0000","last_became_active":"2024-08-20T04:59:21.897617+0000","last_became_peered":"2024-08-20T04:59:21.897617+0000","last_unstale":"2024-08-20T05:01:30.355926+0000","last_undegraded":"2024-08-20T05:01:30.355926+0000","last_fullsized":"2024-08-20T05:01:30.355926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:53:21.122106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340301+0000","last_change":"2024-08-20T05:00:29.372299+0000","last_active":"2024-08-20T05:01:30.340301+0000","last_peered":"2024-08-20T05:01:30.340301+0000","last_clean":"2024-08-20T05:01:30.340301+0000","last_became_active":"2024-08-20T05:00:29.371959+0000","last_became_peered":"2024-08-20T05:00:29.371959+0000","last_unstale":"2024-08-20T05:01:30.340301+0000","last_undegraded":"2024-08-20T05:01:30.340301+0000","last_fullsized":"2024-08-20T05:01:30.340301+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:03.996267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343839+0000","last_change":"2024-08-20T04:59:09.751943+0000","last_active":"2024-08-20T05:01:30.343839+0000","last_peered":"2024-08-20T05:01:30.343839+0000","last_clean":"2024-08-20T05:01:30.343839+0000","last_became_active":"2024-08-20T04:59:09.751586+0000","last_became_peered":"2024-08-20T04:59:09.751586+0000","last_unstale":"2024-08-20T05:01:30.343839+0000","last_undegraded":"2024-08-20T05:01:30.343839+0000","last_fullsized":"2024-08-20T05:01:30.343839+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:35:03.400574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355994+0000","last_change":"2024-08-20T04:59:21.901315+0000","last_active":"2024-08-20T05:01:30.355994+0000","last_peered":"2024-08-20T05:01:30.355994+0000","last_clean":"2024-08-20T05:01:30.355994+0000","last_became_active":"2024-08-20T04:59:21.900871+0000","last_became_peered":"2024-08-20T04:59:21.900871+0000","last_unstale":"2024-08-20T05:01:30.355994+0000","last_undegraded":"2024-08-20T05:01:30.355994+0000","last_fullsized":"2024-08-20T05:01:30.355994+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:39:30.940409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355957+0000","last_change":"2024-08-20T04:59:12.793140+0000","last_active":"2024-08-20T05:01:30.355957+0000","last_peered":"2024-08-20T05:01:30.355957+0000","last_clean":"2024-08-20T05:01:30.355957+0000","last_became_active":"2024-08-20T04:59:12.792678+0000","last_became_peered":"2024-08-20T04:59:12.792678+0000","last_unstale":"2024-08-20T05:01:30.355957+0000","last_undegraded":"2024-08-20T05:01:30.355957+0000","last_fullsized":"2024-08-20T05:01:30.355957+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:07:05.610634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342165+0000","last_change":"2024-08-20T04:59:09.946158+0000","last_active":"2024-08-20T05:01:30.342165+0000","last_peered":"2024-08-20T05:01:30.342165+0000","last_clean":"2024-08-20T05:01:30.342165+0000","last_became_active":"2024-08-20T04:59:09.945736+0000","last_became_peered":"2024-08-20T04:59:09.945736+0000","last_unstale":"2024-08-20T05:01:30.342165+0000","last_undegraded":"2024-08-20T05:01:30.342165+0000","last_fullsized":"2024-08-20T05:01:30.342165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:02.759879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356102+0000","last_change":"2024-08-20T04:59:21.913457+0000","last_active":"2024-08-20T05:01:30.356102+0000","last_peered":"2024-08-20T05:01:30.356102+0000","last_clean":"2024-08-20T05:01:30.356102+0000","last_became_active":"2024-08-20T04:59:21.910468+0000","last_became_peered":"2024-08-20T04:59:21.910468+0000","last_unstale":"2024-08-20T05:01:30.356102+0000","last_undegraded":"2024-08-20T05:01:30.356102+0000","last_fullsized":"2024-08-20T05:01:30.356102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:16:30.817166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340293+0000","last_change":"2024-08-20T04:59:12.788088+0000","last_active":"2024-08-20T05:01:30.340293+0000","last_peered":"2024-08-20T05:01:30.340293+0000","last_clean":"2024-08-20T05:01:30.340293+0000","last_became_active":"2024-08-20T04:59:12.787756+0000","last_became_peered":"2024-08-20T04:59:12.787756+0000","last_unstale":"2024-08-20T05:01:30.340293+0000","last_undegraded":"2024-08-20T05:01:30.340293+0000","last_fullsized":"2024-08-20T05:01:30.340293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:51.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'7","reported_seq":179,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:07.341979+0000","last_change":"2024-08-20T04:59:09.746896+0000","last_active":"2024-08-20T05:02:07.341979+0000","last_peered":"2024-08-20T05:02:07.341979+0000","last_clean":"2024-08-20T05:02:07.341979+0000","last_became_active":"2024-08-20T04:59:09.746570+0000","last_became_peered":"2024-08-20T04:59:09.746570+0000","last_unstale":"2024-08-20T05:02:07.341979+0000","last_undegraded":"2024-08-20T05:02:07.341979+0000","last_fullsized":"2024-08-20T05:02:07.341979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:06:02.395260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":128,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342767+0000","last_change":"2024-08-20T04:59:21.911747+0000","last_active":"2024-08-20T05:01:30.342767+0000","last_peered":"2024-08-20T05:01:30.342767+0000","last_clean":"2024-08-20T05:01:30.342767+0000","last_became_active":"2024-08-20T04:59:21.908861+0000","last_became_peered":"2024-08-20T04:59:21.908861+0000","last_unstale":"2024-08-20T05:01:30.342767+0000","last_undegraded":"2024-08-20T05:01:30.342767+0000","last_fullsized":"2024-08-20T05:01:30.342767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:22:17.336776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340612+0000","last_change":"2024-08-20T05:00:29.860903+0000","last_active":"2024-08-20T05:01:30.340612+0000","last_peered":"2024-08-20T05:01:30.340612+0000","last_clean":"2024-08-20T05:01:30.340612+0000","last_became_active":"2024-08-20T05:00:29.860359+0000","last_became_peered":"2024-08-20T05:00:29.860359+0000","last_unstale":"2024-08-20T05:01:30.340612+0000","last_undegraded":"2024-08-20T05:01:30.340612+0000","last_fullsized":"2024-08-20T05:01:30.340612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:27:02.976859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355985+0000","last_change":"2024-08-20T04:59:09.755225+0000","last_active":"2024-08-20T05:01:30.355985+0000","last_peered":"2024-08-20T05:01:30.355985+0000","last_clean":"2024-08-20T05:01:30.355985+0000","last_became_active":"2024-08-20T04:59:09.754580+0000","last_became_peered":"2024-08-20T04:59:09.754580+0000","last_unstale":"2024-08-20T05:01:30.355985+0000","last_undegraded":"2024-08-20T05:01:30.355985+0000","last_fullsized":"2024-08-20T05:01:30.355985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:54:53.606954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340025+0000","last_change":"2024-08-20T04:59:21.905200+0000","last_active":"2024-08-20T05:01:30.340025+0000","last_peered":"2024-08-20T05:01:30.340025+0000","last_clean":"2024-08-20T05:01:30.340025+0000","last_became_active":"2024-08-20T04:59:21.904724+0000","last_became_peered":"2024-08-20T04:59:21.904724+0000","last_unstale":"2024-08-20T05:01:30.340025+0000","last_undegraded":"2024-08-20T05:01:30.340025+0000","last_fullsized":"2024-08-20T05:01:30.340025+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:50:43.446750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355643+0000","last_change":"2024-08-20T04:59:12.787261+0000","last_active":"2024-08-20T05:01:30.355643+0000","last_peered":"2024-08-20T05:01:30.355643+0000","last_clean":"2024-08-20T05:01:30.355643+0000","last_became_active":"2024-08-20T04:59:12.786971+0000","last_became_peered":"2024-08-20T04:59:12.786971+0000","last_unstale":"2024-08-20T05:01:30.355643+0000","last_undegraded":"2024-08-20T05:01:30.355643+0000","last_fullsized":"2024-08-20T05:01:30.355643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:55:57.209321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343535+0000","last_change":"2024-08-20T04:59:09.749147+0000","last_active":"2024-08-20T05:01:30.343535+0000","last_peered":"2024-08-20T05:01:30.343535+0000","last_clean":"2024-08-20T05:01:30.343535+0000","last_became_active":"2024-08-20T04:59:09.748806+0000","last_became_peered":"2024-08-20T04:59:09.748806+0000","last_unstale":"2024-08-20T05:01:30.343535+0000","last_undegraded":"2024-08-20T05:01:30.343535+0000","last_fullsized":"2024-08-20T05:01:30.343535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:59:43.377105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356203+0000","last_change":"2024-08-20T04:59:21.905007+0000","last_active":"2024-08-20T05:01:30.356203+0000","last_peered":"2024-08-20T05:01:30.356203+0000","last_clean":"2024-08-20T05:01:30.356203+0000","last_became_active":"2024-08-20T04:59:21.904608+0000","last_became_peered":"2024-08-20T04:59:21.904608+0000","last_unstale":"2024-08-20T05:01:30.356203+0000","last_undegraded":"2024-08-20T05:01:30.356203+0000","last_fullsized":"2024-08-20T05:01:30.356203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:00:42.390966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342457+0000","last_change":"2024-08-20T04:59:12.783339+0000","last_active":"2024-08-20T05:01:30.342457+0000","last_peered":"2024-08-20T05:01:30.342457+0000","last_clean":"2024-08-20T05:01:30.342457+0000","last_became_active":"2024-08-20T04:59:12.783051+0000","last_became_peered":"2024-08-20T04:59:12.783051+0000","last_unstale":"2024-08-20T05:01:30.342457+0000","last_undegraded":"2024-08-20T05:01:30.342457+0000","last_fullsized":"2024-08-20T05:01:30.342457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:23:54.390491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'41","reported_seq":343,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:08.509592+0000","last_change":"2024-08-20T04:59:09.754340+0000","last_active":"2024-08-20T05:02:08.509592+0000","last_peered":"2024-08-20T05:02:08.509592+0000","last_clean":"2024-08-20T05:02:08.509592+0000","last_became_active":"2024-08-20T04:59:09.754000+0000","last_became_peered":"2024-08-20T04:59:09.754000+0000","last_unstale":"2024-08-20T05:02:08.509592+0000","last_undegraded":"2024-08-20T05:02:08.509592+0000","last_fullsized":"2024-08-20T05:02:08.509592+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:26:17.256961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64040,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":257,"num_read_kb":192,"num_write":43,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342495+0000","last_change":"2024-08-20T04:59:21.910369+0000","last_active":"2024-08-20T05:01:30.342495+0000","last_peered":"2024-08-20T05:01:30.342495+0000","last_clean":"2024-08-20T05:01:30.342495+0000","last_became_active":"2024-08-20T04:59:21.909941+0000","last_became_peered":"2024-08-20T04:59:21.909941+0000","last_unstale":"2024-08-20T05:01:30.342495+0000","last_undegraded":"2024-08-20T05:01:30.342495+0000","last_fullsized":"2024-08-20T05:01:30.342495+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:27:07.088021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356969+0000","last_change":"2024-08-20T04:59:12.787747+0000","last_active":"2024-08-20T05:01:30.356969+0000","last_peered":"2024-08-20T05:01:30.356969+0000","last_clean":"2024-08-20T05:01:30.356969+0000","last_became_active":"2024-08-20T04:59:12.786962+0000","last_became_peered":"2024-08-20T04:59:12.786962+0000","last_unstale":"2024-08-20T05:01:30.356969+0000","last_undegraded":"2024-08-20T05:01:30.356969+0000","last_fullsized":"2024-08-20T05:01:30.356969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:14:43.822829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356420+0000","last_change":"2024-08-20T04:59:09.947582+0000","last_active":"2024-08-20T05:01:30.356420+0000","last_peered":"2024-08-20T05:01:30.356420+0000","last_clean":"2024-08-20T05:01:30.356420+0000","last_became_active":"2024-08-20T04:59:09.947117+0000","last_became_peered":"2024-08-20T04:59:09.947117+0000","last_unstale":"2024-08-20T05:01:30.356420+0000","last_undegraded":"2024-08-20T05:01:30.356420+0000","last_fullsized":"2024-08-20T05:01:30.356420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:22:05.815486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357390+0000","last_change":"2024-08-20T04:59:21.910776+0000","last_active":"2024-08-20T05:01:30.357390+0000","last_peered":"2024-08-20T05:01:30.357390+0000","last_clean":"2024-08-20T05:01:30.357390+0000","last_became_active":"2024-08-20T04:59:21.909726+0000","last_became_peered":"2024-08-20T04:59:21.909726+0000","last_unstale":"2024-08-20T05:01:30.357390+0000","last_undegraded":"2024-08-20T05:01:30.357390+0000","last_fullsized":"2024-08-20T05:01:30.357390+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:03:04.042649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338903+0000","last_change":"2024-08-20T05:00:29.860637+0000","last_active":"2024-08-20T05:01:30.338903+0000","last_peered":"2024-08-20T05:01:30.338903+0000","last_clean":"2024-08-20T05:01:30.338903+0000","last_became_active":"2024-08-20T05:00:29.860250+0000","last_became_peered":"2024-08-20T05:00:29.860250+0000","last_unstale":"2024-08-20T05:01:30.338903+0000","last_undegraded":"2024-08-20T05:01:30.338903+0000","last_fullsized":"2024-08-20T05:01:30.338903+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:11:27.937844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340908+0000","last_change":"2024-08-20T04:59:09.747316+0000","last_active":"2024-08-20T05:01:30.340908+0000","last_peered":"2024-08-20T05:01:30.340908+0000","last_clean":"2024-08-20T05:01:30.340908+0000","last_became_active":"2024-08-20T04:59:09.746959+0000","last_became_peered":"2024-08-20T04:59:09.746959+0000","last_unstale":"2024-08-20T05:01:30.340908+0000","last_undegraded":"2024-08-20T05:01:30.340908+0000","last_fullsized":"2024-08-20T05:01:30.340908+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:28.480465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342302+0000","last_change":"2024-08-20T04:59:21.907940+0000","last_active":"2024-08-20T05:01:30.342302+0000","last_peered":"2024-08-20T05:01:30.342302+0000","last_clean":"2024-08-20T05:01:30.342302+0000","last_became_active":"2024-08-20T04:59:21.907591+0000","last_became_peered":"2024-08-20T04:59:21.907591+0000","last_unstale":"2024-08-20T05:01:30.342302+0000","last_undegraded":"2024-08-20T05:01:30.342302+0000","last_fullsized":"2024-08-20T05:01:30.342302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:33.583556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357523+0000","last_change":"2024-08-20T04:59:12.795662+0000","last_active":"2024-08-20T05:01:30.357523+0000","last_peered":"2024-08-20T05:01:30.357523+0000","last_clean":"2024-08-20T05:01:30.357523+0000","last_became_active":"2024-08-20T04:59:12.795321+0000","last_became_peered":"2024-08-20T04:59:12.795321+0000","last_unstale":"2024-08-20T05:01:30.357523+0000","last_undegraded":"2024-08-20T05:01:30.357523+0000","last_fullsized":"2024-08-20T05:01:30.357523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:40:30.561306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'5","reported_seq":296,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:08.370200+0000","last_change":"2024-08-20T04:59:09.754468+0000","last_active":"2024-08-20T05:02:08.370200+0000","last_peered":"2024-08-20T05:02:08.370200+0000","last_clean":"2024-08-20T05:02:08.370200+0000","last_became_active":"2024-08-20T04:59:09.754115+0000","last_became_peered":"2024-08-20T04:59:09.754115+0000","last_unstale":"2024-08-20T05:02:08.370200+0000","last_undegraded":"2024-08-20T05:02:08.370200+0000","last_fullsized":"2024-08-20T05:02:08.370200+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:50:21.301246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":246,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356257+0000","last_change":"2024-08-20T04:59:21.898785+0000","last_active":"2024-08-20T05:01:30.356257+0000","last_peered":"2024-08-20T05:01:30.356257+0000","last_clean":"2024-08-20T05:01:30.356257+0000","last_became_active":"2024-08-20T04:59:21.898423+0000","last_became_peered":"2024-08-20T04:59:21.898423+0000","last_unstale":"2024-08-20T05:01:30.356257+0000","last_undegraded":"2024-08-20T05:01:30.356257+0000","last_fullsized":"2024-08-20T05:01:30.356257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:52:58.800104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338624+0000","last_change":"2024-08-20T04:59:21.906208+0000","last_active":"2024-08-20T05:01:30.338624+0000","last_peered":"2024-08-20T05:01:30.338624+0000","last_clean":"2024-08-20T05:01:30.338624+0000","last_became_active":"2024-08-20T04:59:21.905041+0000","last_became_peered":"2024-08-20T04:59:21.905041+0000","last_unstale":"2024-08-20T05:01:30.338624+0000","last_undegraded":"2024-08-20T05:01:30.338624+0000","last_fullsized":"2024-08-20T05:01:30.338624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:05:28.971357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342413+0000","last_change":"2024-08-20T04:59:12.788130+0000","last_active":"2024-08-20T05:01:30.342413+0000","last_peered":"2024-08-20T05:01:30.342413+0000","last_clean":"2024-08-20T05:01:30.342413+0000","last_became_active":"2024-08-20T04:59:12.787665+0000","last_became_peered":"2024-08-20T04:59:12.787665+0000","last_unstale":"2024-08-20T05:01:30.342413+0000","last_undegraded":"2024-08-20T05:01:30.342413+0000","last_fullsized":"2024-08-20T05:01:30.342413+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:59:39.628781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356172+0000","last_change":"2024-08-20T04:59:09.754842+0000","last_active":"2024-08-20T05:01:30.356172+0000","last_peered":"2024-08-20T05:01:30.356172+0000","last_clean":"2024-08-20T05:01:30.356172+0000","last_became_active":"2024-08-20T04:59:09.754515+0000","last_became_peered":"2024-08-20T04:59:09.754515+0000","last_unstale":"2024-08-20T05:01:30.356172+0000","last_undegraded":"2024-08-20T05:01:30.356172+0000","last_fullsized":"2024-08-20T05:01:30.356172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:19:02.241567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340312+0000","last_change":"2024-08-20T04:59:21.900610+0000","last_active":"2024-08-20T05:01:30.340312+0000","last_peered":"2024-08-20T05:01:30.340312+0000","last_clean":"2024-08-20T05:01:30.340312+0000","last_became_active":"2024-08-20T04:59:21.900207+0000","last_became_peered":"2024-08-20T04:59:21.900207+0000","last_unstale":"2024-08-20T05:01:30.340312+0000","last_undegraded":"2024-08-20T05:01:30.340312+0000","last_fullsized":"2024-08-20T05:01:30.340312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:41:00.115344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356667+0000","last_change":"2024-08-20T04:59:12.780772+0000","last_active":"2024-08-20T05:01:30.356667+0000","last_peered":"2024-08-20T05:01:30.356667+0000","last_clean":"2024-08-20T05:01:30.356667+0000","last_became_active":"2024-08-20T04:59:12.780385+0000","last_became_peered":"2024-08-20T04:59:12.780385+0000","last_unstale":"2024-08-20T05:01:30.356667+0000","last_undegraded":"2024-08-20T05:01:30.356667+0000","last_fullsized":"2024-08-20T05:01:30.356667+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:23.680899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355522+0000","last_change":"2024-08-20T04:59:09.749567+0000","last_active":"2024-08-20T05:01:30.355522+0000","last_peered":"2024-08-20T05:01:30.355522+0000","last_clean":"2024-08-20T05:01:30.355522+0000","last_became_active":"2024-08-20T04:59:09.749204+0000","last_became_peered":"2024-08-20T04:59:09.749204+0000","last_unstale":"2024-08-20T05:01:30.355522+0000","last_undegraded":"2024-08-20T05:01:30.355522+0000","last_fullsized":"2024-08-20T05:01:30.355522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:57:51.236459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356327+0000","last_change":"2024-08-20T04:59:09.751622+0000","last_active":"2024-08-20T05:01:30.356327+0000","last_peered":"2024-08-20T05:01:30.356327+0000","last_clean":"2024-08-20T05:01:30.356327+0000","last_became_active":"2024-08-20T04:59:09.751227+0000","last_became_peered":"2024-08-20T04:59:09.751227+0000","last_unstale":"2024-08-20T05:01:30.356327+0000","last_undegraded":"2024-08-20T05:01:30.356327+0000","last_fullsized":"2024-08-20T05:01:30.356327+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:53:38.755122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356190+0000","last_change":"2024-08-20T04:59:12.789243+0000","last_active":"2024-08-20T05:01:30.356190+0000","last_peered":"2024-08-20T05:01:30.356190+0000","last_clean":"2024-08-20T05:01:30.356190+0000","last_became_active":"2024-08-20T04:59:12.788932+0000","last_became_peered":"2024-08-20T04:59:12.788932+0000","last_unstale":"2024-08-20T05:01:30.356190+0000","last_undegraded":"2024-08-20T05:01:30.356190+0000","last_fullsized":"2024-08-20T05:01:30.356190+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:27:00.122328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343578+0000","last_change":"2024-08-20T04:59:21.902847+0000","last_active":"2024-08-20T05:01:30.343578+0000","last_peered":"2024-08-20T05:01:30.343578+0000","last_clean":"2024-08-20T05:01:30.343578+0000","last_became_active":"2024-08-20T04:59:21.902426+0000","last_became_peered":"2024-08-20T04:59:21.902426+0000","last_unstale":"2024-08-20T05:01:30.343578+0000","last_undegraded":"2024-08-20T05:01:30.343578+0000","last_fullsized":"2024-08-20T05:01:30.343578+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:18:38.107358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":189,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:08.510197+0000","last_change":"2024-08-20T05:00:29.375139+0000","last_active":"2024-08-20T05:02:08.510197+0000","last_peered":"2024-08-20T05:02:08.510197+0000","last_clean":"2024-08-20T05:02:08.510197+0000","last_became_active":"2024-08-20T05:00:29.370896+0000","last_became_peered":"2024-08-20T05:00:29.370896+0000","last_unstale":"2024-08-20T05:02:08.510197+0000","last_undegraded":"2024-08-20T05:02:08.510197+0000","last_fullsized":"2024-08-20T05:02:08.510197+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:06:48.033558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342418+0000","last_change":"2024-08-20T04:59:12.785811+0000","last_active":"2024-08-20T05:01:30.342418+0000","last_peered":"2024-08-20T05:01:30.342418+0000","last_clean":"2024-08-20T05:01:30.342418+0000","last_became_active":"2024-08-20T04:59:12.785483+0000","last_became_peered":"2024-08-20T04:59:12.785483+0000","last_unstale":"2024-08-20T05:01:30.342418+0000","last_undegraded":"2024-08-20T05:01:30.342418+0000","last_fullsized":"2024-08-20T05:01:30.342418+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:31:25.355197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344575+0000","last_change":"2024-08-20T04:59:21.897832+0000","last_active":"2024-08-20T05:01:30.344575+0000","last_peered":"2024-08-20T05:01:30.344575+0000","last_clean":"2024-08-20T05:01:30.344575+0000","last_became_active":"2024-08-20T04:59:21.897457+0000","last_became_peered":"2024-08-20T04:59:21.897457+0000","last_unstale":"2024-08-20T05:01:30.344575+0000","last_undegraded":"2024-08-20T05:01:30.344575+0000","last_fullsized":"2024-08-20T05:01:30.344575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:39:51.934014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339787+0000","last_change":"2024-08-20T04:59:12.787671+0000","last_active":"2024-08-20T05:01:30.339787+0000","last_peered":"2024-08-20T05:01:30.339787+0000","last_clean":"2024-08-20T05:01:30.339787+0000","last_became_active":"2024-08-20T04:59:12.787372+0000","last_became_peered":"2024-08-20T04:59:12.787372+0000","last_unstale":"2024-08-20T05:01:30.339787+0000","last_undegraded":"2024-08-20T05:01:30.339787+0000","last_fullsized":"2024-08-20T05:01:30.339787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:16:55.031031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344513+0000","last_change":"2024-08-20T04:59:12.792192+0000","last_active":"2024-08-20T05:01:30.344513+0000","last_peered":"2024-08-20T05:01:30.344513+0000","last_clean":"2024-08-20T05:01:30.344513+0000","last_became_active":"2024-08-20T04:59:12.791447+0000","last_became_peered":"2024-08-20T04:59:12.791447+0000","last_unstale":"2024-08-20T05:01:30.344513+0000","last_undegraded":"2024-08-20T05:01:30.344513+0000","last_fullsized":"2024-08-20T05:01:30.344513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:03:32.559245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343399+0000","last_change":"2024-08-20T04:59:12.785393+0000","last_active":"2024-08-20T05:01:30.343399+0000","last_peered":"2024-08-20T05:01:30.343399+0000","last_clean":"2024-08-20T05:01:30.343399+0000","last_became_active":"2024-08-20T04:59:12.784998+0000","last_became_peered":"2024-08-20T04:59:12.784998+0000","last_unstale":"2024-08-20T05:01:30.343399+0000","last_undegraded":"2024-08-20T05:01:30.343399+0000","last_fullsized":"2024-08-20T05:01:30.343399+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:27:04.964290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338483+0000","last_change":"2024-08-20T04:59:12.784730+0000","last_active":"2024-08-20T05:01:30.338483+0000","last_peered":"2024-08-20T05:01:30.338483+0000","last_clean":"2024-08-20T05:01:30.338483+0000","last_became_active":"2024-08-20T04:59:12.784269+0000","last_became_peered":"2024-08-20T04:59:12.784269+0000","last_unstale":"2024-08-20T05:01:30.338483+0000","last_undegraded":"2024-08-20T05:01:30.338483+0000","last_fullsized":"2024-08-20T05:01:30.338483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:43:12.248033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355819+0000","last_change":"2024-08-20T04:59:12.786484+0000","last_active":"2024-08-20T05:01:30.355819+0000","last_peered":"2024-08-20T05:01:30.355819+0000","last_clean":"2024-08-20T05:01:30.355819+0000","last_became_active":"2024-08-20T04:59:12.786166+0000","last_became_peered":"2024-08-20T04:59:12.786166+0000","last_unstale":"2024-08-20T05:01:30.355819+0000","last_undegraded":"2024-08-20T05:01:30.355819+0000","last_fullsized":"2024-08-20T05:01:30.355819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:30.084519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340680+0000","last_change":"2024-08-20T04:59:12.786985+0000","last_active":"2024-08-20T05:01:30.340680+0000","last_peered":"2024-08-20T05:01:30.340680+0000","last_clean":"2024-08-20T05:01:30.340680+0000","last_became_active":"2024-08-20T04:59:12.786674+0000","last_became_peered":"2024-08-20T04:59:12.786674+0000","last_unstale":"2024-08-20T05:01:30.340680+0000","last_undegraded":"2024-08-20T05:01:30.340680+0000","last_fullsized":"2024-08-20T05:01:30.340680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:30:59.996149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344184+0000","last_change":"2024-08-20T04:59:12.796410+0000","last_active":"2024-08-20T05:01:30.344184+0000","last_peered":"2024-08-20T05:01:30.344184+0000","last_clean":"2024-08-20T05:01:30.344184+0000","last_became_active":"2024-08-20T04:59:12.796081+0000","last_became_peered":"2024-08-20T04:59:12.796081+0000","last_unstale":"2024-08-20T05:01:30.344184+0000","last_undegraded":"2024-08-20T05:01:30.344184+0000","last_fullsized":"2024-08-20T05:01:30.344184+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:49:09.706265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357071+0000","last_change":"2024-08-20T04:59:12.795994+0000","last_active":"2024-08-20T05:01:30.357071+0000","last_peered":"2024-08-20T05:01:30.357071+0000","last_clean":"2024-08-20T05:01:30.357071+0000","last_became_active":"2024-08-20T04:59:12.795604+0000","last_became_peered":"2024-08-20T04:59:12.795604+0000","last_unstale":"2024-08-20T05:01:30.357071+0000","last_undegraded":"2024-08-20T05:01:30.357071+0000","last_fullsized":"2024-08-20T05:01:30.357071+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:54:09.628743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355741+0000","last_change":"2024-08-20T04:59:12.788966+0000","last_active":"2024-08-20T05:01:30.355741+0000","last_peered":"2024-08-20T05:01:30.355741+0000","last_clean":"2024-08-20T05:01:30.355741+0000","last_became_active":"2024-08-20T04:59:12.788534+0000","last_became_peered":"2024-08-20T04:59:12.788534+0000","last_unstale":"2024-08-20T05:01:30.355741+0000","last_undegraded":"2024-08-20T05:01:30.355741+0000","last_fullsized":"2024-08-20T05:01:30.355741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.615399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356431+0000","last_change":"2024-08-20T04:59:12.785914+0000","last_active":"2024-08-20T05:01:30.356431+0000","last_peered":"2024-08-20T05:01:30.356431+0000","last_clean":"2024-08-20T05:01:30.356431+0000","last_became_active":"2024-08-20T04:59:12.785551+0000","last_became_peered":"2024-08-20T04:59:12.785551+0000","last_unstale":"2024-08-20T05:01:30.356431+0000","last_undegraded":"2024-08-20T05:01:30.356431+0000","last_fullsized":"2024-08-20T05:01:30.356431+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:30:32.072387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357188+0000","last_change":"2024-08-20T04:59:12.795635+0000","last_active":"2024-08-20T05:01:30.357188+0000","last_peered":"2024-08-20T05:01:30.357188+0000","last_clean":"2024-08-20T05:01:30.357188+0000","last_became_active":"2024-08-20T04:59:12.794805+0000","last_became_peered":"2024-08-20T04:59:12.794805+0000","last_unstale":"2024-08-20T05:01:30.357188+0000","last_undegraded":"2024-08-20T05:01:30.357188+0000","last_fullsized":"2024-08-20T05:01:30.357188+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:09:08.725503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355737+0000","last_change":"2024-08-20T04:59:12.785099+0000","last_active":"2024-08-20T05:01:30.355737+0000","last_peered":"2024-08-20T05:01:30.355737+0000","last_clean":"2024-08-20T05:01:30.355737+0000","last_became_active":"2024-08-20T04:59:12.784727+0000","last_became_peered":"2024-08-20T04:59:12.784727+0000","last_unstale":"2024-08-20T05:01:30.355737+0000","last_undegraded":"2024-08-20T05:01:30.355737+0000","last_fullsized":"2024-08-20T05:01:30.355737+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:24:36.227289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340160+0000","last_change":"2024-08-20T04:59:12.781832+0000","last_active":"2024-08-20T05:01:30.340160+0000","last_peered":"2024-08-20T05:01:30.340160+0000","last_clean":"2024-08-20T05:01:30.340160+0000","last_became_active":"2024-08-20T04:59:12.781342+0000","last_became_peered":"2024-08-20T04:59:12.781342+0000","last_unstale":"2024-08-20T05:01:30.340160+0000","last_undegraded":"2024-08-20T05:01:30.340160+0000","last_fullsized":"2024-08-20T05:01:30.340160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:26:17.762048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344755+0000","last_change":"2024-08-20T04:59:12.792350+0000","last_active":"2024-08-20T05:01:30.344755+0000","last_peered":"2024-08-20T05:01:30.344755+0000","last_clean":"2024-08-20T05:01:30.344755+0000","last_became_active":"2024-08-20T04:59:12.792028+0000","last_became_peered":"2024-08-20T04:59:12.792028+0000","last_unstale":"2024-08-20T05:01:30.344755+0000","last_undegraded":"2024-08-20T05:01:30.344755+0000","last_fullsized":"2024-08-20T05:01:30.344755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:16:23.173759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343346+0000","last_change":"2024-08-20T04:59:12.795047+0000","last_active":"2024-08-20T05:01:30.343346+0000","last_peered":"2024-08-20T05:01:30.343346+0000","last_clean":"2024-08-20T05:01:30.343346+0000","last_became_active":"2024-08-20T04:59:12.794705+0000","last_became_peered":"2024-08-20T04:59:12.794705+0000","last_unstale":"2024-08-20T05:01:30.343346+0000","last_undegraded":"2024-08-20T05:01:30.343346+0000","last_fullsized":"2024-08-20T05:01:30.343346+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:51:16.355892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340659+0000","last_change":"2024-08-20T04:59:12.785022+0000","last_active":"2024-08-20T05:01:30.340659+0000","last_peered":"2024-08-20T05:01:30.340659+0000","last_clean":"2024-08-20T05:01:30.340659+0000","last_became_active":"2024-08-20T04:59:12.784730+0000","last_became_peered":"2024-08-20T04:59:12.784730+0000","last_unstale":"2024-08-20T05:01:30.340659+0000","last_undegraded":"2024-08-20T05:01:30.340659+0000","last_fullsized":"2024-08-20T05:01:30.340659+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:21:53.053890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356636+0000","last_change":"2024-08-20T04:59:12.790825+0000","last_active":"2024-08-20T05:01:30.356636+0000","last_peered":"2024-08-20T05:01:30.356636+0000","last_clean":"2024-08-20T05:01:30.356636+0000","last_became_active":"2024-08-20T04:59:12.790299+0000","last_became_peered":"2024-08-20T04:59:12.790299+0000","last_unstale":"2024-08-20T05:01:30.356636+0000","last_undegraded":"2024-08-20T05:01:30.356636+0000","last_fullsized":"2024-08-20T05:01:30.356636+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:12.477186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338217+0000","last_change":"2024-08-20T05:00:29.374190+0000","last_active":"2024-08-20T05:01:30.338217+0000","last_peered":"2024-08-20T05:01:30.338217+0000","last_clean":"2024-08-20T05:01:30.338217+0000","last_became_active":"2024-08-20T05:00:29.373844+0000","last_became_peered":"2024-08-20T05:00:29.373844+0000","last_unstale":"2024-08-20T05:01:30.338217+0000","last_undegraded":"2024-08-20T05:01:30.338217+0000","last_fullsized":"2024-08-20T05:01:30.338217+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:03.131340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338379+0000","last_change":"2024-08-20T04:59:12.783355+0000","last_active":"2024-08-20T05:01:30.338379+0000","last_peered":"2024-08-20T05:01:30.338379+0000","last_clean":"2024-08-20T05:01:30.338379+0000","last_became_active":"2024-08-20T04:59:12.782992+0000","last_became_peered":"2024-08-20T04:59:12.782992+0000","last_unstale":"2024-08-20T05:01:30.338379+0000","last_undegraded":"2024-08-20T05:01:30.338379+0000","last_fullsized":"2024-08-20T05:01:30.338379+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:09:47.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355676+0000","last_change":"2024-08-20T04:59:12.783989+0000","last_active":"2024-08-20T05:01:30.355676+0000","last_peered":"2024-08-20T05:01:30.355676+0000","last_clean":"2024-08-20T05:01:30.355676+0000","last_became_active":"2024-08-20T04:59:12.783671+0000","last_became_peered":"2024-08-20T04:59:12.783671+0000","last_unstale":"2024-08-20T05:01:30.355676+0000","last_undegraded":"2024-08-20T05:01:30.355676+0000","last_fullsized":"2024-08-20T05:01:30.355676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:34:55.727599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357140+0000","last_change":"2024-08-20T04:59:12.787118+0000","last_active":"2024-08-20T05:01:30.357140+0000","last_peered":"2024-08-20T05:01:30.357140+0000","last_clean":"2024-08-20T05:01:30.357140+0000","last_became_active":"2024-08-20T04:59:12.786754+0000","last_became_peered":"2024-08-20T04:59:12.786754+0000","last_unstale":"2024-08-20T05:01:30.357140+0000","last_undegraded":"2024-08-20T05:01:30.357140+0000","last_fullsized":"2024-08-20T05:01:30.357140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:13:23.959972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340919+0000","last_change":"2024-08-20T04:59:12.793748+0000","last_active":"2024-08-20T05:01:30.340919+0000","last_peered":"2024-08-20T05:01:30.340919+0000","last_clean":"2024-08-20T05:01:30.340919+0000","last_became_active":"2024-08-20T04:59:12.792550+0000","last_became_peered":"2024-08-20T04:59:12.792550+0000","last_unstale":"2024-08-20T05:01:30.340919+0000","last_undegraded":"2024-08-20T05:01:30.340919+0000","last_fullsized":"2024-08-20T05:01:30.340919+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:59:24.226273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356824+0000","last_change":"2024-08-20T04:59:12.788827+0000","last_active":"2024-08-20T05:01:30.356824+0000","last_peered":"2024-08-20T05:01:30.356824+0000","last_clean":"2024-08-20T05:01:30.356824+0000","last_became_active":"2024-08-20T04:59:12.788395+0000","last_became_peered":"2024-08-20T04:59:12.788395+0000","last_unstale":"2024-08-20T05:01:30.356824+0000","last_undegraded":"2024-08-20T05:01:30.356824+0000","last_fullsized":"2024-08-20T05:01:30.356824+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:26.453063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357616+0000","last_change":"2024-08-20T04:59:12.795513+0000","last_active":"2024-08-20T05:01:30.357616+0000","last_peered":"2024-08-20T05:01:30.357616+0000","last_clean":"2024-08-20T05:01:30.357616+0000","last_became_active":"2024-08-20T04:59:12.795191+0000","last_became_peered":"2024-08-20T04:59:12.795191+0000","last_unstale":"2024-08-20T05:01:30.357616+0000","last_undegraded":"2024-08-20T05:01:30.357616+0000","last_fullsized":"2024-08-20T05:01:30.357616+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:04:00.893420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356614+0000","last_change":"2024-08-20T04:59:12.789825+0000","last_active":"2024-08-20T05:01:30.356614+0000","last_peered":"2024-08-20T05:01:30.356614+0000","last_clean":"2024-08-20T05:01:30.356614+0000","last_became_active":"2024-08-20T04:59:12.788198+0000","last_became_peered":"2024-08-20T04:59:12.788198+0000","last_unstale":"2024-08-20T05:01:30.356614+0000","last_undegraded":"2024-08-20T05:01:30.356614+0000","last_fullsized":"2024-08-20T05:01:30.356614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:10.898308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340338+0000","last_change":"2024-08-20T04:59:12.787707+0000","last_active":"2024-08-20T05:01:30.340338+0000","last_peered":"2024-08-20T05:01:30.340338+0000","last_clean":"2024-08-20T05:01:30.340338+0000","last_became_active":"2024-08-20T04:59:12.787035+0000","last_became_peered":"2024-08-20T04:59:12.787035+0000","last_unstale":"2024-08-20T05:01:30.340338+0000","last_undegraded":"2024-08-20T05:01:30.340338+0000","last_fullsized":"2024-08-20T05:01:30.340338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:16:52.451048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356216+0000","last_change":"2024-08-20T04:59:12.784012+0000","last_active":"2024-08-20T05:01:30.356216+0000","last_peered":"2024-08-20T05:01:30.356216+0000","last_clean":"2024-08-20T05:01:30.356216+0000","last_became_active":"2024-08-20T04:59:12.783599+0000","last_became_peered":"2024-08-20T04:59:12.783599+0000","last_unstale":"2024-08-20T05:01:30.356216+0000","last_undegraded":"2024-08-20T05:01:30.356216+0000","last_fullsized":"2024-08-20T05:01:30.356216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:23:15.271873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342676+0000","last_change":"2024-08-20T04:59:12.784987+0000","last_active":"2024-08-20T05:01:30.342676+0000","last_peered":"2024-08-20T05:01:30.342676+0000","last_clean":"2024-08-20T05:01:30.342676+0000","last_became_active":"2024-08-20T04:59:12.784693+0000","last_became_peered":"2024-08-20T04:59:12.784693+0000","last_unstale":"2024-08-20T05:01:30.342676+0000","last_undegraded":"2024-08-20T05:01:30.342676+0000","last_fullsized":"2024-08-20T05:01:30.342676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:07:51.624602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357088+0000","last_change":"2024-08-20T04:59:12.792466+0000","last_active":"2024-08-20T05:01:30.357088+0000","last_peered":"2024-08-20T05:01:30.357088+0000","last_clean":"2024-08-20T05:01:30.357088+0000","last_became_active":"2024-08-20T04:59:12.792114+0000","last_became_peered":"2024-08-20T04:59:12.792114+0000","last_unstale":"2024-08-20T05:01:30.357088+0000","last_undegraded":"2024-08-20T05:01:30.357088+0000","last_fullsized":"2024-08-20T05:01:30.357088+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:23:09.919907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338528+0000","last_change":"2024-08-20T04:59:12.793041+0000","last_active":"2024-08-20T05:01:30.338528+0000","last_peered":"2024-08-20T05:01:30.338528+0000","last_clean":"2024-08-20T05:01:30.338528+0000","last_became_active":"2024-08-20T04:59:12.792709+0000","last_became_peered":"2024-08-20T04:59:12.792709+0000","last_unstale":"2024-08-20T05:01:30.338528+0000","last_undegraded":"2024-08-20T05:01:30.338528+0000","last_fullsized":"2024-08-20T05:01:30.338528+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:09:04.523493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338652+0000","last_change":"2024-08-20T04:59:12.790256+0000","last_active":"2024-08-20T05:01:30.338652+0000","last_peered":"2024-08-20T05:01:30.338652+0000","last_clean":"2024-08-20T05:01:30.338652+0000","last_became_active":"2024-08-20T04:59:12.788467+0000","last_became_peered":"2024-08-20T04:59:12.788467+0000","last_unstale":"2024-08-20T05:01:30.338652+0000","last_undegraded":"2024-08-20T05:01:30.338652+0000","last_fullsized":"2024-08-20T05:01:30.338652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:55:31.386030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340563+0000","last_change":"2024-08-20T04:59:12.794882+0000","last_active":"2024-08-20T05:01:30.340563+0000","last_peered":"2024-08-20T05:01:30.340563+0000","last_clean":"2024-08-20T05:01:30.340563+0000","last_became_active":"2024-08-20T04:59:12.794564+0000","last_became_peered":"2024-08-20T04:59:12.794564+0000","last_unstale":"2024-08-20T05:01:30.340563+0000","last_undegraded":"2024-08-20T05:01:30.340563+0000","last_fullsized":"2024-08-20T05:01:30.340563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:36:47.515754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71526,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1269,"num_read_kb":715,"num_write":261,"num_write_kb":153,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":734,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":219951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743474,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1028096,"data_stored":510687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939703,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28704,"kb_used_data":1680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716448,"statfs":{"total":95995035648,"available":95965642752,"internally_reserved":0,"allocated":1720320,"data_stored":1165527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103229,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1044480,"data_stored":509973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299458,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1032192,"data_stored":510239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462982,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1638400,"data_stored":1106989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626509,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":505477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822738,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1646592,"data_stored":1102039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986262,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1036288,"data_stored":510705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182492,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1032192,"data_stored":505185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411427,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708732,"statfs":{"total":95995035648,"available":95957741568,"internally_reserved":0,"allocated":1101824,"data_stored":570677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":570547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738475,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1044480,"data_stored":507465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T05:02:13.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-20T05:02:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:13 smithi130 ceph-mon[22007]: pgmap v400: 129 pgs: 129 active+clean; 647 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-20T05:02:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:13 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2470159822' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:14.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.132+0000 7ff65ac00640 1 -- 172.21.15.37:0/3865997084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff65410a600 msgr2=0x7ff65410ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:14.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.132+0000 7ff65ac00640 1 --2- 172.21.15.37:0/3865997084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff65410a600 0x7ff65410ca50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009ca0 tx=0x7ff64c02a8b0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.132+0000 7ff65ac00640 1 -- 172.21.15.37:0/3865997084 shutdown_connections 2024-08-20T05:02:14.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.132+0000 7ff65ac00640 1 --2- 172.21.15.37:0/3865997084 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff65410a600 0x7ff65410ca50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.132+0000 7ff65ac00640 1 --2- 172.21.15.37:0/3865997084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6540757f0 0x7ff654075c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.132+0000 7ff65ac00640 1 --2- 172.21.15.37:0/3865997084 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff654076c60 0x7ff6540752b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.132+0000 7ff65ac00640 1 -- 172.21.15.37:0/3865997084 >> 172.21.15.37:0/3865997084 conn(0x7ff6540fdf40 msgr2=0x7ff654100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:14.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.132+0000 7ff65ac00640 1 -- 172.21.15.37:0/3865997084 shutdown_connections 2024-08-20T05:02:14.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.132+0000 7ff65ac00640 1 -- 172.21.15.37:0/3865997084 wait complete. 2024-08-20T05:02:14.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.133+0000 7ff65ac00640 1 Processor -- start 2024-08-20T05:02:14.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.133+0000 7ff65ac00640 1 -- start start 2024-08-20T05:02:14.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.133+0000 7ff65ac00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6540757f0 0x7ff65419aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:14.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.133+0000 7ff65ac00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff654076c60 0x7ff65419b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:14.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.133+0000 7ff65ac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff65410a600 0x7ff65419be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:14.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.133+0000 7ff65ac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff654110510 con 0x7ff65410a600 2024-08-20T05:02:14.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.133+0000 7ff65ac00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff654110390 con 0x7ff654076c60 2024-08-20T05:02:14.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.133+0000 7ff65ac00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff654110690 con 0x7ff6540757f0 2024-08-20T05:02:14.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.133+0000 7ff658c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff65410a600 0x7ff65419be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:14.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.133+0000 7ff658c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff65410a600 0x7ff65419be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34998/0 (socket says 172.21.15.37:34998) 2024-08-20T05:02:14.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.133+0000 7ff658c00640 1 -- 172.21.15.37:0/1636180931 learned_addr learned my addr 172.21.15.37:0/1636180931 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:14.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.133+0000 7ff653400640 1 --2- 172.21.15.37:0/1636180931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff654076c60 0x7ff65419b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:14.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.133+0000 7ff653e00640 1 --2- 172.21.15.37:0/1636180931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6540757f0 0x7ff65419aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:14.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.134+0000 7ff658c00640 1 -- 172.21.15.37:0/1636180931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6540757f0 msgr2=0x7ff65419aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:14.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.134+0000 7ff658c00640 1 --2- 172.21.15.37:0/1636180931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6540757f0 0x7ff65419aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.134+0000 7ff658c00640 1 -- 172.21.15.37:0/1636180931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff654076c60 msgr2=0x7ff65419b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:14.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.134+0000 7ff658c00640 1 --2- 172.21.15.37:0/1636180931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff654076c60 0x7ff65419b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.134+0000 7ff658c00640 1 -- 172.21.15.37:0/1636180931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65419c6e0 con 0x7ff65410a600 2024-08-20T05:02:14.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.134+0000 7ff653400640 1 --2- 172.21.15.37:0/1636180931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff654076c60 0x7ff65419b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:14.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.134+0000 7ff658c00640 1 --2- 172.21.15.37:0/1636180931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff65410a600 0x7ff65419be20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff64c003bd0 tx=0x7ff64c003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:14.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.134+0000 7ff650c00640 1 -- 172.21.15.37:0/1636180931 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c004450 con 0x7ff65410a600 2024-08-20T05:02:14.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.134+0000 7ff650c00640 1 -- 172.21.15.37:0/1636180931 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff64c040070 con 0x7ff65410a600 2024-08-20T05:02:14.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.134+0000 7ff65ac00640 1 -- 172.21.15.37:0/1636180931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff65419c970 con 0x7ff65410a600 2024-08-20T05:02:14.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.134+0000 7ff650c00640 1 -- 172.21.15.37:0/1636180931 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff64c031c60 con 0x7ff65410a600 2024-08-20T05:02:14.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.134+0000 7ff65ac00640 1 -- 172.21.15.37:0/1636180931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6541a30a0 con 0x7ff65410a600 2024-08-20T05:02:14.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.136+0000 7ff65ac00640 1 -- 172.21.15.37:0/1636180931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff654075c70 con 0x7ff65410a600 2024-08-20T05:02:14.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.138+0000 7ff650c00640 1 -- 172.21.15.37:0/1636180931 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff64c031440 con 0x7ff65410a600 2024-08-20T05:02:14.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.139+0000 7ff650c00640 1 --2- 172.21.15.37:0/1636180931 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff6380b3bd0 0x7ff6380b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:14.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.139+0000 7ff650c00640 1 -- 172.21.15.37:0/1636180931 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff64c1051e0 con 0x7ff65410a600 2024-08-20T05:02:14.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.139+0000 7ff653e00640 1 --2- 172.21.15.37:0/1636180931 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff6380b3bd0 0x7ff6380b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:14.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.140+0000 7ff653e00640 1 --2- 172.21.15.37:0/1636180931 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff6380b3bd0 0x7ff6380b6090 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff64400bbe0 tx=0x7ff64400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:14.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.143+0000 7ff650c00640 1 -- 172.21.15.37:0/1636180931 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff64c0cc430 con 0x7ff65410a600 2024-08-20T05:02:14.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.335+0000 7ff65ac00640 1 -- 172.21.15.37:0/1636180931 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff6540feb20 con 0x7ff6380b3bd0 2024-08-20T05:02:14.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.340+0000 7ff650c00640 1 -- 172.21.15.37:0/1636180931 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340543 (secure 0 0 0) 0x7ff6540feb20 con 0x7ff6380b3bd0 2024-08-20T05:02:14.345 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:14.347 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-20T05:02:14.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.345+0000 7ff65ac00640 1 -- 172.21.15.37:0/1636180931 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff6380b3bd0 msgr2=0x7ff6380b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:14.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.345+0000 7ff65ac00640 1 --2- 172.21.15.37:0/1636180931 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff6380b3bd0 0x7ff6380b6090 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff64400bbe0 tx=0x7ff64400b390 comp rx=0 tx=0).stop 2024-08-20T05:02:14.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.345+0000 7ff65ac00640 1 -- 172.21.15.37:0/1636180931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff65410a600 msgr2=0x7ff65419be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:14.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.345+0000 7ff65ac00640 1 --2- 172.21.15.37:0/1636180931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff65410a600 0x7ff65419be20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff64c003bd0 tx=0x7ff64c003c00 comp rx=0 tx=0).stop 2024-08-20T05:02:14.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.345+0000 7ff65ac00640 1 -- 172.21.15.37:0/1636180931 shutdown_connections 2024-08-20T05:02:14.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.345+0000 7ff65ac00640 1 --2- 172.21.15.37:0/1636180931 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff6380b3bd0 0x7ff6380b6090 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.345+0000 7ff65ac00640 1 --2- 172.21.15.37:0/1636180931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff65410a600 0x7ff65419be20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.345+0000 7ff65ac00640 1 --2- 172.21.15.37:0/1636180931 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff654076c60 0x7ff65419b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.345+0000 7ff65ac00640 1 --2- 172.21.15.37:0/1636180931 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff6540757f0 0x7ff65419aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.345+0000 7ff65ac00640 1 -- 172.21.15.37:0/1636180931 >> 172.21.15.37:0/1636180931 conn(0x7ff6540fdf40 msgr2=0x7ff6540fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.345+0000 7ff65ac00640 1 -- 172.21.15.37:0/1636180931 shutdown_connections 2024-08-20T05:02:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.346+0000 7ff65ac00640 1 -- 172.21.15.37:0/1636180931 wait complete. 2024-08-20T05:02:14.362 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":401,"stamp":"2024-08-20T05:02:14.019689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667501,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1381,"num_read_kb":805,"num_write":389,"num_write_kb":2312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952691,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":821,"ondisk_log_size":821,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367572,"kb_used_data":14100,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124574252,"statfs":{"total":1151940427776,"available":1151564034048,"internally_reserved":0,"allocated":14438400,"data_stored":8080883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5684,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":77,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003362"},"pg_stats":[{"pgid":"2.1f","version":"84'13","reported_seq":185,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:11.344406+0000","last_change":"2024-08-20T04:59:09.751382+0000","last_active":"2024-08-20T05:02:11.344406+0000","last_peered":"2024-08-20T05:02:11.344406+0000","last_clean":"2024-08-20T05:02:11.344406+0000","last_became_active":"2024-08-20T04:59:09.751026+0000","last_became_peered":"2024-08-20T04:59:09.751026+0000","last_unstale":"2024-08-20T05:02:11.344406+0000","last_undegraded":"2024-08-20T05:02:11.344406+0000","last_fullsized":"2024-08-20T05:02:11.344406+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:14:50.107767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":128,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342960+0000","last_change":"2024-08-20T05:00:29.371826+0000","last_active":"2024-08-20T05:01:30.342960+0000","last_peered":"2024-08-20T05:01:30.342960+0000","last_clean":"2024-08-20T05:01:30.342960+0000","last_became_active":"2024-08-20T05:00:29.371618+0000","last_became_peered":"2024-08-20T05:00:29.371618+0000","last_unstale":"2024-08-20T05:01:30.342960+0000","last_undegraded":"2024-08-20T05:01:30.342960+0000","last_fullsized":"2024-08-20T05:01:30.342960+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:34:36.786900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344146+0000","last_change":"2024-08-20T04:59:21.902558+0000","last_active":"2024-08-20T05:01:30.344146+0000","last_peered":"2024-08-20T05:01:30.344146+0000","last_clean":"2024-08-20T05:01:30.344146+0000","last_became_active":"2024-08-20T04:59:21.902119+0000","last_became_peered":"2024-08-20T04:59:21.902119+0000","last_unstale":"2024-08-20T05:01:30.344146+0000","last_undegraded":"2024-08-20T05:01:30.344146+0000","last_fullsized":"2024-08-20T05:01:30.344146+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:53.765865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357136+0000","last_change":"2024-08-20T04:59:09.946282+0000","last_active":"2024-08-20T05:01:30.357136+0000","last_peered":"2024-08-20T05:01:30.357136+0000","last_clean":"2024-08-20T05:01:30.357136+0000","last_became_active":"2024-08-20T04:59:09.945867+0000","last_became_peered":"2024-08-20T04:59:09.945867+0000","last_unstale":"2024-08-20T05:01:30.357136+0000","last_undegraded":"2024-08-20T05:01:30.357136+0000","last_fullsized":"2024-08-20T05:01:30.357136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:29:08.119504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338826+0000","last_change":"2024-08-20T04:59:12.796121+0000","last_active":"2024-08-20T05:01:30.338826+0000","last_peered":"2024-08-20T05:01:30.338826+0000","last_clean":"2024-08-20T05:01:30.338826+0000","last_became_active":"2024-08-20T04:59:12.792764+0000","last_became_peered":"2024-08-20T04:59:12.792764+0000","last_unstale":"2024-08-20T05:01:30.338826+0000","last_undegraded":"2024-08-20T05:01:30.338826+0000","last_fullsized":"2024-08-20T05:01:30.338826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:01:53.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355898+0000","last_change":"2024-08-20T04:59:21.909607+0000","last_active":"2024-08-20T05:01:30.355898+0000","last_peered":"2024-08-20T05:01:30.355898+0000","last_clean":"2024-08-20T05:01:30.355898+0000","last_became_active":"2024-08-20T04:59:21.909175+0000","last_became_peered":"2024-08-20T04:59:21.909175+0000","last_unstale":"2024-08-20T05:01:30.355898+0000","last_undegraded":"2024-08-20T05:01:30.355898+0000","last_fullsized":"2024-08-20T05:01:30.355898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:29:49.940169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342724+0000","last_change":"2024-08-20T04:59:09.753233+0000","last_active":"2024-08-20T05:01:30.342724+0000","last_peered":"2024-08-20T05:01:30.342724+0000","last_clean":"2024-08-20T05:01:30.342724+0000","last_became_active":"2024-08-20T04:59:09.752614+0000","last_became_peered":"2024-08-20T04:59:09.752614+0000","last_unstale":"2024-08-20T05:01:30.342724+0000","last_undegraded":"2024-08-20T05:01:30.342724+0000","last_fullsized":"2024-08-20T05:01:30.342724+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:04:20.199669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356860+0000","last_change":"2024-08-20T04:59:12.799116+0000","last_active":"2024-08-20T05:01:30.356860+0000","last_peered":"2024-08-20T05:01:30.356860+0000","last_clean":"2024-08-20T05:01:30.356860+0000","last_became_active":"2024-08-20T04:59:12.798725+0000","last_became_peered":"2024-08-20T04:59:12.798725+0000","last_unstale":"2024-08-20T05:01:30.356860+0000","last_undegraded":"2024-08-20T05:01:30.356860+0000","last_fullsized":"2024-08-20T05:01:30.356860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:46.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356542+0000","last_change":"2024-08-20T05:00:29.372973+0000","last_active":"2024-08-20T05:01:30.356542+0000","last_peered":"2024-08-20T05:01:30.356542+0000","last_clean":"2024-08-20T05:01:30.356542+0000","last_became_active":"2024-08-20T05:00:29.372504+0000","last_became_peered":"2024-08-20T05:00:29.372504+0000","last_unstale":"2024-08-20T05:01:30.356542+0000","last_undegraded":"2024-08-20T05:01:30.356542+0000","last_fullsized":"2024-08-20T05:01:30.356542+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:22:22.410569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342961+0000","last_change":"2024-08-20T04:59:09.752771+0000","last_active":"2024-08-20T05:01:30.342961+0000","last_peered":"2024-08-20T05:01:30.342961+0000","last_clean":"2024-08-20T05:01:30.342961+0000","last_became_active":"2024-08-20T04:59:09.752415+0000","last_became_peered":"2024-08-20T04:59:09.752415+0000","last_unstale":"2024-08-20T05:01:30.342961+0000","last_undegraded":"2024-08-20T05:01:30.342961+0000","last_fullsized":"2024-08-20T05:01:30.342961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:13:18.843587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356341+0000","last_change":"2024-08-20T04:59:12.794418+0000","last_active":"2024-08-20T05:01:30.356341+0000","last_peered":"2024-08-20T05:01:30.356341+0000","last_clean":"2024-08-20T05:01:30.356341+0000","last_became_active":"2024-08-20T04:59:12.794117+0000","last_became_peered":"2024-08-20T04:59:12.794117+0000","last_unstale":"2024-08-20T05:01:30.356341+0000","last_undegraded":"2024-08-20T05:01:30.356341+0000","last_fullsized":"2024-08-20T05:01:30.356341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:18.209690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356247+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T05:01:30.356247+0000","last_peered":"2024-08-20T05:01:30.356247+0000","last_clean":"2024-08-20T05:01:30.356247+0000","last_became_active":"2024-08-20T04:59:21.906344+0000","last_became_peered":"2024-08-20T04:59:21.906344+0000","last_unstale":"2024-08-20T05:01:30.356247+0000","last_undegraded":"2024-08-20T05:01:30.356247+0000","last_fullsized":"2024-08-20T05:01:30.356247+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:48:34.982558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340475+0000","last_change":"2024-08-20T04:59:12.792719+0000","last_active":"2024-08-20T05:01:30.340475+0000","last_peered":"2024-08-20T05:01:30.340475+0000","last_clean":"2024-08-20T05:01:30.340475+0000","last_became_active":"2024-08-20T04:59:12.792294+0000","last_became_peered":"2024-08-20T04:59:12.792294+0000","last_unstale":"2024-08-20T05:01:30.340475+0000","last_undegraded":"2024-08-20T05:01:30.340475+0000","last_fullsized":"2024-08-20T05:01:30.340475+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:20:03.593798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.363468+0000","last_change":"2024-08-20T05:01:30.363065+0000","last_active":"2024-08-20T05:01:30.363468+0000","last_peered":"2024-08-20T05:01:30.363468+0000","last_clean":"2024-08-20T05:01:30.363468+0000","last_became_active":"2024-08-20T05:01:30.357909+0000","last_became_peered":"2024-08-20T05:01:30.357909+0000","last_unstale":"2024-08-20T05:01:30.363468+0000","last_undegraded":"2024-08-20T05:01:30.363468+0000","last_fullsized":"2024-08-20T05:01:30.363468+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:46:56.468529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356466+0000","last_change":"2024-08-20T04:59:21.902445+0000","last_active":"2024-08-20T05:01:30.356466+0000","last_peered":"2024-08-20T05:01:30.356466+0000","last_clean":"2024-08-20T05:01:30.356466+0000","last_became_active":"2024-08-20T04:59:21.901950+0000","last_became_peered":"2024-08-20T04:59:21.901950+0000","last_unstale":"2024-08-20T05:01:30.356466+0000","last_undegraded":"2024-08-20T05:01:30.356466+0000","last_fullsized":"2024-08-20T05:01:30.356466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:55:28.653841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356733+0000","last_change":"2024-08-20T04:59:12.784236+0000","last_active":"2024-08-20T05:01:30.356733+0000","last_peered":"2024-08-20T05:01:30.356733+0000","last_clean":"2024-08-20T05:01:30.356733+0000","last_became_active":"2024-08-20T04:59:12.783945+0000","last_became_peered":"2024-08-20T04:59:12.783945+0000","last_unstale":"2024-08-20T05:01:30.356733+0000","last_undegraded":"2024-08-20T05:01:30.356733+0000","last_fullsized":"2024-08-20T05:01:30.356733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:43:07.137543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343581+0000","last_change":"2024-08-20T04:59:09.751661+0000","last_active":"2024-08-20T05:01:30.343581+0000","last_peered":"2024-08-20T05:01:30.343581+0000","last_clean":"2024-08-20T05:01:30.343581+0000","last_became_active":"2024-08-20T04:59:09.751326+0000","last_became_peered":"2024-08-20T04:59:09.751326+0000","last_unstale":"2024-08-20T05:01:30.343581+0000","last_undegraded":"2024-08-20T05:01:30.343581+0000","last_fullsized":"2024-08-20T05:01:30.343581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:54.751929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356948+0000","last_change":"2024-08-20T04:59:21.913657+0000","last_active":"2024-08-20T05:01:30.356948+0000","last_peered":"2024-08-20T05:01:30.356948+0000","last_clean":"2024-08-20T05:01:30.356948+0000","last_became_active":"2024-08-20T04:59:21.913187+0000","last_became_peered":"2024-08-20T04:59:21.913187+0000","last_unstale":"2024-08-20T05:01:30.356948+0000","last_undegraded":"2024-08-20T05:01:30.356948+0000","last_fullsized":"2024-08-20T05:01:30.356948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:51:29.008810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339857+0000","last_change":"2024-08-20T04:59:12.780137+0000","last_active":"2024-08-20T05:01:30.339857+0000","last_peered":"2024-08-20T05:01:30.339857+0000","last_clean":"2024-08-20T05:01:30.339857+0000","last_became_active":"2024-08-20T04:59:12.779820+0000","last_became_peered":"2024-08-20T04:59:12.779820+0000","last_unstale":"2024-08-20T05:01:30.339857+0000","last_undegraded":"2024-08-20T05:01:30.339857+0000","last_fullsized":"2024-08-20T05:01:30.339857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:33:58.204255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356668+0000","last_change":"2024-08-20T04:59:09.750521+0000","last_active":"2024-08-20T05:01:30.356668+0000","last_peered":"2024-08-20T05:01:30.356668+0000","last_clean":"2024-08-20T05:01:30.356668+0000","last_became_active":"2024-08-20T04:59:09.750115+0000","last_became_peered":"2024-08-20T04:59:09.750115+0000","last_unstale":"2024-08-20T05:01:30.356668+0000","last_undegraded":"2024-08-20T05:01:30.356668+0000","last_fullsized":"2024-08-20T05:01:30.356668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:44:20.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342721+0000","last_change":"2024-08-20T04:59:21.910737+0000","last_active":"2024-08-20T05:01:30.342721+0000","last_peered":"2024-08-20T05:01:30.342721+0000","last_clean":"2024-08-20T05:01:30.342721+0000","last_became_active":"2024-08-20T04:59:21.910104+0000","last_became_peered":"2024-08-20T04:59:21.910104+0000","last_unstale":"2024-08-20T05:01:30.342721+0000","last_undegraded":"2024-08-20T05:01:30.342721+0000","last_fullsized":"2024-08-20T05:01:30.342721+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:17:40.436885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344499+0000","last_change":"2024-08-20T04:59:12.787285+0000","last_active":"2024-08-20T05:01:30.344499+0000","last_peered":"2024-08-20T05:01:30.344499+0000","last_clean":"2024-08-20T05:01:30.344499+0000","last_became_active":"2024-08-20T04:59:12.786998+0000","last_became_peered":"2024-08-20T04:59:12.786998+0000","last_unstale":"2024-08-20T05:01:30.344499+0000","last_undegraded":"2024-08-20T05:01:30.344499+0000","last_fullsized":"2024-08-20T05:01:30.344499+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:12:49.860291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356758+0000","last_change":"2024-08-20T04:59:09.947715+0000","last_active":"2024-08-20T05:01:30.356758+0000","last_peered":"2024-08-20T05:01:30.356758+0000","last_clean":"2024-08-20T05:01:30.356758+0000","last_became_active":"2024-08-20T04:59:09.947372+0000","last_became_peered":"2024-08-20T04:59:09.947372+0000","last_unstale":"2024-08-20T05:01:30.356758+0000","last_undegraded":"2024-08-20T05:01:30.356758+0000","last_fullsized":"2024-08-20T05:01:30.356758+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:42:04.352964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357308+0000","last_change":"2024-08-20T05:00:29.860562+0000","last_active":"2024-08-20T05:01:30.357308+0000","last_peered":"2024-08-20T05:01:30.357308+0000","last_clean":"2024-08-20T05:01:30.357308+0000","last_became_active":"2024-08-20T05:00:29.859944+0000","last_became_peered":"2024-08-20T05:00:29.859944+0000","last_unstale":"2024-08-20T05:01:30.357308+0000","last_undegraded":"2024-08-20T05:01:30.357308+0000","last_fullsized":"2024-08-20T05:01:30.357308+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:47.266712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338727+0000","last_change":"2024-08-20T04:59:12.785952+0000","last_active":"2024-08-20T05:01:30.338727+0000","last_peered":"2024-08-20T05:01:30.338727+0000","last_clean":"2024-08-20T05:01:30.338727+0000","last_became_active":"2024-08-20T04:59:12.785596+0000","last_became_peered":"2024-08-20T04:59:12.785596+0000","last_unstale":"2024-08-20T05:01:30.338727+0000","last_undegraded":"2024-08-20T05:01:30.338727+0000","last_fullsized":"2024-08-20T05:01:30.338727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:47.299560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356854+0000","last_change":"2024-08-20T04:59:09.964725+0000","last_active":"2024-08-20T05:01:30.356854+0000","last_peered":"2024-08-20T05:01:30.356854+0000","last_clean":"2024-08-20T05:01:30.356854+0000","last_became_active":"2024-08-20T04:59:09.964351+0000","last_became_peered":"2024-08-20T04:59:09.964351+0000","last_unstale":"2024-08-20T05:01:30.356854+0000","last_undegraded":"2024-08-20T05:01:30.356854+0000","last_fullsized":"2024-08-20T05:01:30.356854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:26:03.216378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344343+0000","last_change":"2024-08-20T04:59:21.898758+0000","last_active":"2024-08-20T05:01:30.344343+0000","last_peered":"2024-08-20T05:01:30.344343+0000","last_clean":"2024-08-20T05:01:30.344343+0000","last_became_active":"2024-08-20T04:59:21.898282+0000","last_became_peered":"2024-08-20T04:59:21.898282+0000","last_unstale":"2024-08-20T05:01:30.344343+0000","last_undegraded":"2024-08-20T05:01:30.344343+0000","last_fullsized":"2024-08-20T05:01:30.344343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:45:49.093459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357095+0000","last_change":"2024-08-20T04:59:12.793870+0000","last_active":"2024-08-20T05:01:30.357095+0000","last_peered":"2024-08-20T05:01:30.357095+0000","last_clean":"2024-08-20T05:01:30.357095+0000","last_became_active":"2024-08-20T04:59:12.792928+0000","last_became_peered":"2024-08-20T04:59:12.792928+0000","last_unstale":"2024-08-20T05:01:30.357095+0000","last_undegraded":"2024-08-20T05:01:30.357095+0000","last_fullsized":"2024-08-20T05:01:30.357095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:12:25.450347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'17","reported_seq":61,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343461+0000","last_change":"2024-08-20T04:59:09.751403+0000","last_active":"2024-08-20T05:01:30.343461+0000","last_peered":"2024-08-20T05:01:30.343461+0000","last_clean":"2024-08-20T05:01:30.343461+0000","last_became_active":"2024-08-20T04:59:09.750976+0000","last_became_peered":"2024-08-20T04:59:09.750976+0000","last_unstale":"2024-08-20T05:01:30.343461+0000","last_undegraded":"2024-08-20T05:01:30.343461+0000","last_fullsized":"2024-08-20T05:01:30.343461+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:58:54.627836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356432+0000","last_change":"2024-08-20T04:59:21.899813+0000","last_active":"2024-08-20T05:01:30.356432+0000","last_peered":"2024-08-20T05:01:30.356432+0000","last_clean":"2024-08-20T05:01:30.356432+0000","last_became_active":"2024-08-20T04:59:21.899462+0000","last_became_peered":"2024-08-20T04:59:21.899462+0000","last_unstale":"2024-08-20T05:01:30.356432+0000","last_undegraded":"2024-08-20T05:01:30.356432+0000","last_fullsized":"2024-08-20T05:01:30.356432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.468845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355826+0000","last_change":"2024-08-20T04:59:12.783953+0000","last_active":"2024-08-20T05:01:30.355826+0000","last_peered":"2024-08-20T05:01:30.355826+0000","last_clean":"2024-08-20T05:01:30.355826+0000","last_became_active":"2024-08-20T04:59:12.781445+0000","last_became_peered":"2024-08-20T04:59:12.781445+0000","last_unstale":"2024-08-20T05:01:30.355826+0000","last_undegraded":"2024-08-20T05:01:30.355826+0000","last_fullsized":"2024-08-20T05:01:30.355826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:04.792064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356223+0000","last_change":"2024-08-20T05:01:30.355578+0000","last_active":"2024-08-20T05:01:30.356223+0000","last_peered":"2024-08-20T05:01:30.356223+0000","last_clean":"2024-08-20T05:01:30.356223+0000","last_became_active":"2024-08-20T05:01:30.349099+0000","last_became_peered":"2024-08-20T05:01:30.349099+0000","last_unstale":"2024-08-20T05:01:30.356223+0000","last_undegraded":"2024-08-20T05:01:30.356223+0000","last_fullsized":"2024-08-20T05:01:30.356223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:17:57.165914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339956+0000","last_change":"2024-08-20T04:59:21.905202+0000","last_active":"2024-08-20T05:01:30.339956+0000","last_peered":"2024-08-20T05:01:30.339956+0000","last_clean":"2024-08-20T05:01:30.339956+0000","last_became_active":"2024-08-20T04:59:21.904771+0000","last_became_peered":"2024-08-20T04:59:21.904771+0000","last_unstale":"2024-08-20T05:01:30.339956+0000","last_undegraded":"2024-08-20T05:01:30.339956+0000","last_fullsized":"2024-08-20T05:01:30.339956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:35:56.887981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"86'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356122+0000","last_change":"2024-08-20T04:59:12.798301+0000","last_active":"2024-08-20T05:01:30.356122+0000","last_peered":"2024-08-20T05:01:30.356122+0000","last_clean":"2024-08-20T05:01:30.356122+0000","last_became_active":"2024-08-20T04:59:12.797934+0000","last_became_peered":"2024-08-20T04:59:12.797934+0000","last_unstale":"2024-08-20T05:01:30.356122+0000","last_undegraded":"2024-08-20T05:01:30.356122+0000","last_fullsized":"2024-08-20T05:01:30.356122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:41:24.465380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343575+0000","last_change":"2024-08-20T04:59:09.947602+0000","last_active":"2024-08-20T05:01:30.343575+0000","last_peered":"2024-08-20T05:01:30.343575+0000","last_clean":"2024-08-20T05:01:30.343575+0000","last_became_active":"2024-08-20T04:59:09.946795+0000","last_became_peered":"2024-08-20T04:59:09.946795+0000","last_unstale":"2024-08-20T05:01:30.343575+0000","last_undegraded":"2024-08-20T05:01:30.343575+0000","last_fullsized":"2024-08-20T05:01:30.343575+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:09:09.003266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344130+0000","last_change":"2024-08-20T05:00:29.860828+0000","last_active":"2024-08-20T05:01:30.344130+0000","last_peered":"2024-08-20T05:01:30.344130+0000","last_clean":"2024-08-20T05:01:30.344130+0000","last_became_active":"2024-08-20T05:00:29.860242+0000","last_became_peered":"2024-08-20T05:00:29.860242+0000","last_unstale":"2024-08-20T05:01:30.344130+0000","last_undegraded":"2024-08-20T05:01:30.344130+0000","last_fullsized":"2024-08-20T05:01:30.344130+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:09:42.311207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356682+0000","last_change":"2024-08-20T04:59:12.784852+0000","last_active":"2024-08-20T05:01:30.356682+0000","last_peered":"2024-08-20T05:01:30.356682+0000","last_clean":"2024-08-20T05:01:30.356682+0000","last_became_active":"2024-08-20T04:59:12.784496+0000","last_became_peered":"2024-08-20T04:59:12.784496+0000","last_unstale":"2024-08-20T05:01:30.356682+0000","last_undegraded":"2024-08-20T05:01:30.356682+0000","last_fullsized":"2024-08-20T05:01:30.356682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:41:42.421383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":178,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:12.346358+0000","last_change":"2024-08-20T04:59:09.750785+0000","last_active":"2024-08-20T05:02:12.346358+0000","last_peered":"2024-08-20T05:02:12.346358+0000","last_clean":"2024-08-20T05:02:12.346358+0000","last_became_active":"2024-08-20T04:59:09.750255+0000","last_became_peered":"2024-08-20T04:59:09.750255+0000","last_unstale":"2024-08-20T05:02:12.346358+0000","last_undegraded":"2024-08-20T05:02:12.346358+0000","last_fullsized":"2024-08-20T05:02:12.346358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:20:17.900367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355715+0000","last_change":"2024-08-20T04:59:21.909409+0000","last_active":"2024-08-20T05:01:30.355715+0000","last_peered":"2024-08-20T05:01:30.355715+0000","last_clean":"2024-08-20T05:01:30.355715+0000","last_became_active":"2024-08-20T04:59:21.907934+0000","last_became_peered":"2024-08-20T04:59:21.907934+0000","last_unstale":"2024-08-20T05:01:30.355715+0000","last_undegraded":"2024-08-20T05:01:30.355715+0000","last_fullsized":"2024-08-20T05:01:30.355715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:26:36.768407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355879+0000","last_change":"2024-08-20T04:59:12.783496+0000","last_active":"2024-08-20T05:01:30.355879+0000","last_peered":"2024-08-20T05:01:30.355879+0000","last_clean":"2024-08-20T05:01:30.355879+0000","last_became_active":"2024-08-20T04:59:12.783211+0000","last_became_peered":"2024-08-20T04:59:12.783211+0000","last_unstale":"2024-08-20T05:01:30.355879+0000","last_undegraded":"2024-08-20T05:01:30.355879+0000","last_fullsized":"2024-08-20T05:01:30.355879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:45:49.514189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":176,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:08.342828+0000","last_change":"2024-08-20T04:59:09.948284+0000","last_active":"2024-08-20T05:02:08.342828+0000","last_peered":"2024-08-20T05:02:08.342828+0000","last_clean":"2024-08-20T05:02:08.342828+0000","last_became_active":"2024-08-20T04:59:09.947909+0000","last_became_peered":"2024-08-20T04:59:09.947909+0000","last_unstale":"2024-08-20T05:02:08.342828+0000","last_undegraded":"2024-08-20T05:02:08.342828+0000","last_fullsized":"2024-08-20T05:02:08.342828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:24:04.344380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":125,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356288+0000","last_change":"2024-08-20T04:59:21.905282+0000","last_active":"2024-08-20T05:01:30.356288+0000","last_peered":"2024-08-20T05:01:30.356288+0000","last_clean":"2024-08-20T05:01:30.356288+0000","last_became_active":"2024-08-20T04:59:21.904842+0000","last_became_peered":"2024-08-20T04:59:21.904842+0000","last_unstale":"2024-08-20T05:01:30.356288+0000","last_undegraded":"2024-08-20T05:01:30.356288+0000","last_fullsized":"2024-08-20T05:01:30.356288+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:01:19.949949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355357+0000","last_change":"2024-08-20T04:59:12.788571+0000","last_active":"2024-08-20T05:01:30.355357+0000","last_peered":"2024-08-20T05:01:30.355357+0000","last_clean":"2024-08-20T05:01:30.355357+0000","last_became_active":"2024-08-20T04:59:12.784148+0000","last_became_peered":"2024-08-20T04:59:12.784148+0000","last_unstale":"2024-08-20T05:01:30.355357+0000","last_undegraded":"2024-08-20T05:01:30.355357+0000","last_fullsized":"2024-08-20T05:01:30.355357+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:10:51.565404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340278+0000","last_change":"2024-08-20T04:59:09.753842+0000","last_active":"2024-08-20T05:01:30.340278+0000","last_peered":"2024-08-20T05:01:30.340278+0000","last_clean":"2024-08-20T05:01:30.340278+0000","last_became_active":"2024-08-20T04:59:09.753439+0000","last_became_peered":"2024-08-20T04:59:09.753439+0000","last_unstale":"2024-08-20T05:01:30.340278+0000","last_undegraded":"2024-08-20T05:01:30.340278+0000","last_fullsized":"2024-08-20T05:01:30.340278+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:54.171964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356341+0000","last_change":"2024-08-20T04:59:21.909621+0000","last_active":"2024-08-20T05:01:30.356341+0000","last_peered":"2024-08-20T05:01:30.356341+0000","last_clean":"2024-08-20T05:01:30.356341+0000","last_became_active":"2024-08-20T04:59:21.909239+0000","last_became_peered":"2024-08-20T04:59:21.909239+0000","last_unstale":"2024-08-20T05:01:30.356341+0000","last_undegraded":"2024-08-20T05:01:30.356341+0000","last_fullsized":"2024-08-20T05:01:30.356341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:53:15.131163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356523+0000","last_change":"2024-08-20T04:59:12.796643+0000","last_active":"2024-08-20T05:01:30.356523+0000","last_peered":"2024-08-20T05:01:30.356523+0000","last_clean":"2024-08-20T05:01:30.356523+0000","last_became_active":"2024-08-20T04:59:12.796262+0000","last_became_peered":"2024-08-20T04:59:12.796262+0000","last_unstale":"2024-08-20T05:01:30.356523+0000","last_undegraded":"2024-08-20T05:01:30.356523+0000","last_fullsized":"2024-08-20T05:01:30.356523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:11:37.792359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357176+0000","last_change":"2024-08-20T04:59:09.750550+0000","last_active":"2024-08-20T05:01:30.357176+0000","last_peered":"2024-08-20T05:01:30.357176+0000","last_clean":"2024-08-20T05:01:30.357176+0000","last_became_active":"2024-08-20T04:59:09.750097+0000","last_became_peered":"2024-08-20T04:59:09.750097+0000","last_unstale":"2024-08-20T05:01:30.357176+0000","last_undegraded":"2024-08-20T05:01:30.357176+0000","last_fullsized":"2024-08-20T05:01:30.357176+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:32:22.826478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340442+0000","last_change":"2024-08-20T04:57:50.824023+0000","last_active":"2024-08-20T05:01:30.340442+0000","last_peered":"2024-08-20T05:01:30.340442+0000","last_clean":"2024-08-20T05:01:30.340442+0000","last_became_active":"2024-08-20T04:57:50.350587+0000","last_became_peered":"2024-08-20T04:57:50.350587+0000","last_unstale":"2024-08-20T05:01:30.340442+0000","last_undegraded":"2024-08-20T05:01:30.340442+0000","last_fullsized":"2024-08-20T05:01:30.340442+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_clean_scrub_stamp":"2024-08-20T04:54:17.224468+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:59:23.450117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340604+0000","last_change":"2024-08-20T05:00:29.866063+0000","last_active":"2024-08-20T05:01:30.340604+0000","last_peered":"2024-08-20T05:01:30.340604+0000","last_clean":"2024-08-20T05:01:30.340604+0000","last_became_active":"2024-08-20T05:00:29.861545+0000","last_became_peered":"2024-08-20T05:00:29.861545+0000","last_unstale":"2024-08-20T05:01:30.340604+0000","last_undegraded":"2024-08-20T05:01:30.340604+0000","last_fullsized":"2024-08-20T05:01:30.340604+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:02:18.516044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.341028+0000","last_change":"2024-08-20T04:59:12.793799+0000","last_active":"2024-08-20T05:01:30.341028+0000","last_peered":"2024-08-20T05:01:30.341028+0000","last_clean":"2024-08-20T05:01:30.341028+0000","last_became_active":"2024-08-20T04:59:12.793487+0000","last_became_peered":"2024-08-20T04:59:12.793487+0000","last_unstale":"2024-08-20T05:01:30.341028+0000","last_undegraded":"2024-08-20T05:01:30.341028+0000","last_fullsized":"2024-08-20T05:01:30.341028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:08:30.835824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'7","reported_seq":181,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:10.374561+0000","last_change":"2024-08-20T04:59:09.964586+0000","last_active":"2024-08-20T05:02:10.374561+0000","last_peered":"2024-08-20T05:02:10.374561+0000","last_clean":"2024-08-20T05:02:10.374561+0000","last_became_active":"2024-08-20T04:59:09.964258+0000","last_became_peered":"2024-08-20T04:59:09.964258+0000","last_unstale":"2024-08-20T05:02:10.374561+0000","last_undegraded":"2024-08-20T05:02:10.374561+0000","last_fullsized":"2024-08-20T05:02:10.374561+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:37:48.138019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357127+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T05:01:30.357127+0000","last_peered":"2024-08-20T05:01:30.357127+0000","last_clean":"2024-08-20T05:01:30.357127+0000","last_became_active":"2024-08-20T04:59:21.906197+0000","last_became_peered":"2024-08-20T04:59:21.906197+0000","last_unstale":"2024-08-20T05:01:30.357127+0000","last_undegraded":"2024-08-20T05:01:30.357127+0000","last_fullsized":"2024-08-20T05:01:30.357127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:10:45.819035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340707+0000","last_change":"2024-08-20T04:59:12.794221+0000","last_active":"2024-08-20T05:01:30.340707+0000","last_peered":"2024-08-20T05:01:30.340707+0000","last_clean":"2024-08-20T05:01:30.340707+0000","last_became_active":"2024-08-20T04:59:12.793680+0000","last_became_peered":"2024-08-20T04:59:12.793680+0000","last_unstale":"2024-08-20T05:01:30.340707+0000","last_undegraded":"2024-08-20T05:01:30.340707+0000","last_fullsized":"2024-08-20T05:01:30.340707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:45.435700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356414+0000","last_change":"2024-08-20T04:59:09.755955+0000","last_active":"2024-08-20T05:01:30.356414+0000","last_peered":"2024-08-20T05:01:30.356414+0000","last_clean":"2024-08-20T05:01:30.356414+0000","last_became_active":"2024-08-20T04:59:09.755614+0000","last_became_peered":"2024-08-20T04:59:09.755614+0000","last_unstale":"2024-08-20T05:01:30.356414+0000","last_undegraded":"2024-08-20T05:01:30.356414+0000","last_fullsized":"2024-08-20T05:01:30.356414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:15:06.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338518+0000","last_change":"2024-08-20T04:59:21.915952+0000","last_active":"2024-08-20T05:01:30.338518+0000","last_peered":"2024-08-20T05:01:30.338518+0000","last_clean":"2024-08-20T05:01:30.338518+0000","last_became_active":"2024-08-20T04:59:21.915533+0000","last_became_peered":"2024-08-20T04:59:21.915533+0000","last_unstale":"2024-08-20T05:01:30.338518+0000","last_undegraded":"2024-08-20T05:01:30.338518+0000","last_fullsized":"2024-08-20T05:01:30.338518+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:52:54.906061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340713+0000","last_change":"2024-08-20T04:59:12.782663+0000","last_active":"2024-08-20T05:01:30.340713+0000","last_peered":"2024-08-20T05:01:30.340713+0000","last_clean":"2024-08-20T05:01:30.340713+0000","last_became_active":"2024-08-20T04:59:12.782068+0000","last_became_peered":"2024-08-20T04:59:12.782068+0000","last_unstale":"2024-08-20T05:01:30.340713+0000","last_undegraded":"2024-08-20T05:01:30.340713+0000","last_fullsized":"2024-08-20T05:01:30.340713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:46:39.662033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356158+0000","last_change":"2024-08-20T04:59:09.747456+0000","last_active":"2024-08-20T05:01:30.356158+0000","last_peered":"2024-08-20T05:01:30.356158+0000","last_clean":"2024-08-20T05:01:30.356158+0000","last_became_active":"2024-08-20T04:59:09.747141+0000","last_became_peered":"2024-08-20T04:59:09.747141+0000","last_unstale":"2024-08-20T05:01:30.356158+0000","last_undegraded":"2024-08-20T05:01:30.356158+0000","last_fullsized":"2024-08-20T05:01:30.356158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:39:01.600831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355926+0000","last_change":"2024-08-20T04:59:21.898059+0000","last_active":"2024-08-20T05:01:30.355926+0000","last_peered":"2024-08-20T05:01:30.355926+0000","last_clean":"2024-08-20T05:01:30.355926+0000","last_became_active":"2024-08-20T04:59:21.897617+0000","last_became_peered":"2024-08-20T04:59:21.897617+0000","last_unstale":"2024-08-20T05:01:30.355926+0000","last_undegraded":"2024-08-20T05:01:30.355926+0000","last_fullsized":"2024-08-20T05:01:30.355926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:53:21.122106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340301+0000","last_change":"2024-08-20T05:00:29.372299+0000","last_active":"2024-08-20T05:01:30.340301+0000","last_peered":"2024-08-20T05:01:30.340301+0000","last_clean":"2024-08-20T05:01:30.340301+0000","last_became_active":"2024-08-20T05:00:29.371959+0000","last_became_peered":"2024-08-20T05:00:29.371959+0000","last_unstale":"2024-08-20T05:01:30.340301+0000","last_undegraded":"2024-08-20T05:01:30.340301+0000","last_fullsized":"2024-08-20T05:01:30.340301+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:03.996267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343839+0000","last_change":"2024-08-20T04:59:09.751943+0000","last_active":"2024-08-20T05:01:30.343839+0000","last_peered":"2024-08-20T05:01:30.343839+0000","last_clean":"2024-08-20T05:01:30.343839+0000","last_became_active":"2024-08-20T04:59:09.751586+0000","last_became_peered":"2024-08-20T04:59:09.751586+0000","last_unstale":"2024-08-20T05:01:30.343839+0000","last_undegraded":"2024-08-20T05:01:30.343839+0000","last_fullsized":"2024-08-20T05:01:30.343839+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:35:03.400574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355994+0000","last_change":"2024-08-20T04:59:21.901315+0000","last_active":"2024-08-20T05:01:30.355994+0000","last_peered":"2024-08-20T05:01:30.355994+0000","last_clean":"2024-08-20T05:01:30.355994+0000","last_became_active":"2024-08-20T04:59:21.900871+0000","last_became_peered":"2024-08-20T04:59:21.900871+0000","last_unstale":"2024-08-20T05:01:30.355994+0000","last_undegraded":"2024-08-20T05:01:30.355994+0000","last_fullsized":"2024-08-20T05:01:30.355994+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:39:30.940409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355957+0000","last_change":"2024-08-20T04:59:12.793140+0000","last_active":"2024-08-20T05:01:30.355957+0000","last_peered":"2024-08-20T05:01:30.355957+0000","last_clean":"2024-08-20T05:01:30.355957+0000","last_became_active":"2024-08-20T04:59:12.792678+0000","last_became_peered":"2024-08-20T04:59:12.792678+0000","last_unstale":"2024-08-20T05:01:30.355957+0000","last_undegraded":"2024-08-20T05:01:30.355957+0000","last_fullsized":"2024-08-20T05:01:30.355957+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:07:05.610634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342165+0000","last_change":"2024-08-20T04:59:09.946158+0000","last_active":"2024-08-20T05:01:30.342165+0000","last_peered":"2024-08-20T05:01:30.342165+0000","last_clean":"2024-08-20T05:01:30.342165+0000","last_became_active":"2024-08-20T04:59:09.945736+0000","last_became_peered":"2024-08-20T04:59:09.945736+0000","last_unstale":"2024-08-20T05:01:30.342165+0000","last_undegraded":"2024-08-20T05:01:30.342165+0000","last_fullsized":"2024-08-20T05:01:30.342165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:02.759879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356102+0000","last_change":"2024-08-20T04:59:21.913457+0000","last_active":"2024-08-20T05:01:30.356102+0000","last_peered":"2024-08-20T05:01:30.356102+0000","last_clean":"2024-08-20T05:01:30.356102+0000","last_became_active":"2024-08-20T04:59:21.910468+0000","last_became_peered":"2024-08-20T04:59:21.910468+0000","last_unstale":"2024-08-20T05:01:30.356102+0000","last_undegraded":"2024-08-20T05:01:30.356102+0000","last_fullsized":"2024-08-20T05:01:30.356102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:16:30.817166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340293+0000","last_change":"2024-08-20T04:59:12.788088+0000","last_active":"2024-08-20T05:01:30.340293+0000","last_peered":"2024-08-20T05:01:30.340293+0000","last_clean":"2024-08-20T05:01:30.340293+0000","last_became_active":"2024-08-20T04:59:12.787756+0000","last_became_peered":"2024-08-20T04:59:12.787756+0000","last_unstale":"2024-08-20T05:01:30.340293+0000","last_undegraded":"2024-08-20T05:01:30.340293+0000","last_fullsized":"2024-08-20T05:01:30.340293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:51.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'7","reported_seq":184,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:12.348516+0000","last_change":"2024-08-20T04:59:09.746896+0000","last_active":"2024-08-20T05:02:12.348516+0000","last_peered":"2024-08-20T05:02:12.348516+0000","last_clean":"2024-08-20T05:02:12.348516+0000","last_became_active":"2024-08-20T04:59:09.746570+0000","last_became_peered":"2024-08-20T04:59:09.746570+0000","last_unstale":"2024-08-20T05:02:12.348516+0000","last_undegraded":"2024-08-20T05:02:12.348516+0000","last_fullsized":"2024-08-20T05:02:12.348516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:06:02.395260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":133,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342767+0000","last_change":"2024-08-20T04:59:21.911747+0000","last_active":"2024-08-20T05:01:30.342767+0000","last_peered":"2024-08-20T05:01:30.342767+0000","last_clean":"2024-08-20T05:01:30.342767+0000","last_became_active":"2024-08-20T04:59:21.908861+0000","last_became_peered":"2024-08-20T04:59:21.908861+0000","last_unstale":"2024-08-20T05:01:30.342767+0000","last_undegraded":"2024-08-20T05:01:30.342767+0000","last_fullsized":"2024-08-20T05:01:30.342767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:22:17.336776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340612+0000","last_change":"2024-08-20T05:00:29.860903+0000","last_active":"2024-08-20T05:01:30.340612+0000","last_peered":"2024-08-20T05:01:30.340612+0000","last_clean":"2024-08-20T05:01:30.340612+0000","last_became_active":"2024-08-20T05:00:29.860359+0000","last_became_peered":"2024-08-20T05:00:29.860359+0000","last_unstale":"2024-08-20T05:01:30.340612+0000","last_undegraded":"2024-08-20T05:01:30.340612+0000","last_fullsized":"2024-08-20T05:01:30.340612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:27:02.976859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355985+0000","last_change":"2024-08-20T04:59:09.755225+0000","last_active":"2024-08-20T05:01:30.355985+0000","last_peered":"2024-08-20T05:01:30.355985+0000","last_clean":"2024-08-20T05:01:30.355985+0000","last_became_active":"2024-08-20T04:59:09.754580+0000","last_became_peered":"2024-08-20T04:59:09.754580+0000","last_unstale":"2024-08-20T05:01:30.355985+0000","last_undegraded":"2024-08-20T05:01:30.355985+0000","last_fullsized":"2024-08-20T05:01:30.355985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:54:53.606954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340025+0000","last_change":"2024-08-20T04:59:21.905200+0000","last_active":"2024-08-20T05:01:30.340025+0000","last_peered":"2024-08-20T05:01:30.340025+0000","last_clean":"2024-08-20T05:01:30.340025+0000","last_became_active":"2024-08-20T04:59:21.904724+0000","last_became_peered":"2024-08-20T04:59:21.904724+0000","last_unstale":"2024-08-20T05:01:30.340025+0000","last_undegraded":"2024-08-20T05:01:30.340025+0000","last_fullsized":"2024-08-20T05:01:30.340025+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:50:43.446750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355643+0000","last_change":"2024-08-20T04:59:12.787261+0000","last_active":"2024-08-20T05:01:30.355643+0000","last_peered":"2024-08-20T05:01:30.355643+0000","last_clean":"2024-08-20T05:01:30.355643+0000","last_became_active":"2024-08-20T04:59:12.786971+0000","last_became_peered":"2024-08-20T04:59:12.786971+0000","last_unstale":"2024-08-20T05:01:30.355643+0000","last_undegraded":"2024-08-20T05:01:30.355643+0000","last_fullsized":"2024-08-20T05:01:30.355643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:55:57.209321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343535+0000","last_change":"2024-08-20T04:59:09.749147+0000","last_active":"2024-08-20T05:01:30.343535+0000","last_peered":"2024-08-20T05:01:30.343535+0000","last_clean":"2024-08-20T05:01:30.343535+0000","last_became_active":"2024-08-20T04:59:09.748806+0000","last_became_peered":"2024-08-20T04:59:09.748806+0000","last_unstale":"2024-08-20T05:01:30.343535+0000","last_undegraded":"2024-08-20T05:01:30.343535+0000","last_fullsized":"2024-08-20T05:01:30.343535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:59:43.377105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356203+0000","last_change":"2024-08-20T04:59:21.905007+0000","last_active":"2024-08-20T05:01:30.356203+0000","last_peered":"2024-08-20T05:01:30.356203+0000","last_clean":"2024-08-20T05:01:30.356203+0000","last_became_active":"2024-08-20T04:59:21.904608+0000","last_became_peered":"2024-08-20T04:59:21.904608+0000","last_unstale":"2024-08-20T05:01:30.356203+0000","last_undegraded":"2024-08-20T05:01:30.356203+0000","last_fullsized":"2024-08-20T05:01:30.356203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:00:42.390966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342457+0000","last_change":"2024-08-20T04:59:12.783339+0000","last_active":"2024-08-20T05:01:30.342457+0000","last_peered":"2024-08-20T05:01:30.342457+0000","last_clean":"2024-08-20T05:01:30.342457+0000","last_became_active":"2024-08-20T04:59:12.783051+0000","last_became_peered":"2024-08-20T04:59:12.783051+0000","last_unstale":"2024-08-20T05:01:30.342457+0000","last_undegraded":"2024-08-20T05:01:30.342457+0000","last_fullsized":"2024-08-20T05:01:30.342457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:23:54.390491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'42","reported_seq":355,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:13.517451+0000","last_change":"2024-08-20T04:59:09.754340+0000","last_active":"2024-08-20T05:02:13.517451+0000","last_peered":"2024-08-20T05:02:13.517451+0000","last_clean":"2024-08-20T05:02:13.517451+0000","last_became_active":"2024-08-20T04:59:09.754000+0000","last_became_peered":"2024-08-20T04:59:09.754000+0000","last_unstale":"2024-08-20T05:02:13.517451+0000","last_undegraded":"2024-08-20T05:02:13.517451+0000","last_fullsized":"2024-08-20T05:02:13.517451+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:26:17.256961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69413,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":203,"num_write":44,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342495+0000","last_change":"2024-08-20T04:59:21.910369+0000","last_active":"2024-08-20T05:01:30.342495+0000","last_peered":"2024-08-20T05:01:30.342495+0000","last_clean":"2024-08-20T05:01:30.342495+0000","last_became_active":"2024-08-20T04:59:21.909941+0000","last_became_peered":"2024-08-20T04:59:21.909941+0000","last_unstale":"2024-08-20T05:01:30.342495+0000","last_undegraded":"2024-08-20T05:01:30.342495+0000","last_fullsized":"2024-08-20T05:01:30.342495+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:27:07.088021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356969+0000","last_change":"2024-08-20T04:59:12.787747+0000","last_active":"2024-08-20T05:01:30.356969+0000","last_peered":"2024-08-20T05:01:30.356969+0000","last_clean":"2024-08-20T05:01:30.356969+0000","last_became_active":"2024-08-20T04:59:12.786962+0000","last_became_peered":"2024-08-20T04:59:12.786962+0000","last_unstale":"2024-08-20T05:01:30.356969+0000","last_undegraded":"2024-08-20T05:01:30.356969+0000","last_fullsized":"2024-08-20T05:01:30.356969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:14:43.822829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356420+0000","last_change":"2024-08-20T04:59:09.947582+0000","last_active":"2024-08-20T05:01:30.356420+0000","last_peered":"2024-08-20T05:01:30.356420+0000","last_clean":"2024-08-20T05:01:30.356420+0000","last_became_active":"2024-08-20T04:59:09.947117+0000","last_became_peered":"2024-08-20T04:59:09.947117+0000","last_unstale":"2024-08-20T05:01:30.356420+0000","last_undegraded":"2024-08-20T05:01:30.356420+0000","last_fullsized":"2024-08-20T05:01:30.356420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:22:05.815486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357390+0000","last_change":"2024-08-20T04:59:21.910776+0000","last_active":"2024-08-20T05:01:30.357390+0000","last_peered":"2024-08-20T05:01:30.357390+0000","last_clean":"2024-08-20T05:01:30.357390+0000","last_became_active":"2024-08-20T04:59:21.909726+0000","last_became_peered":"2024-08-20T04:59:21.909726+0000","last_unstale":"2024-08-20T05:01:30.357390+0000","last_undegraded":"2024-08-20T05:01:30.357390+0000","last_fullsized":"2024-08-20T05:01:30.357390+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:03:04.042649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338903+0000","last_change":"2024-08-20T05:00:29.860637+0000","last_active":"2024-08-20T05:01:30.338903+0000","last_peered":"2024-08-20T05:01:30.338903+0000","last_clean":"2024-08-20T05:01:30.338903+0000","last_became_active":"2024-08-20T05:00:29.860250+0000","last_became_peered":"2024-08-20T05:00:29.860250+0000","last_unstale":"2024-08-20T05:01:30.338903+0000","last_undegraded":"2024-08-20T05:01:30.338903+0000","last_fullsized":"2024-08-20T05:01:30.338903+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:11:27.937844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340908+0000","last_change":"2024-08-20T04:59:09.747316+0000","last_active":"2024-08-20T05:01:30.340908+0000","last_peered":"2024-08-20T05:01:30.340908+0000","last_clean":"2024-08-20T05:01:30.340908+0000","last_became_active":"2024-08-20T04:59:09.746959+0000","last_became_peered":"2024-08-20T04:59:09.746959+0000","last_unstale":"2024-08-20T05:01:30.340908+0000","last_undegraded":"2024-08-20T05:01:30.340908+0000","last_fullsized":"2024-08-20T05:01:30.340908+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:28.480465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342302+0000","last_change":"2024-08-20T04:59:21.907940+0000","last_active":"2024-08-20T05:01:30.342302+0000","last_peered":"2024-08-20T05:01:30.342302+0000","last_clean":"2024-08-20T05:01:30.342302+0000","last_became_active":"2024-08-20T04:59:21.907591+0000","last_became_peered":"2024-08-20T04:59:21.907591+0000","last_unstale":"2024-08-20T05:01:30.342302+0000","last_undegraded":"2024-08-20T05:01:30.342302+0000","last_fullsized":"2024-08-20T05:01:30.342302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:33.583556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357523+0000","last_change":"2024-08-20T04:59:12.795662+0000","last_active":"2024-08-20T05:01:30.357523+0000","last_peered":"2024-08-20T05:01:30.357523+0000","last_clean":"2024-08-20T05:01:30.357523+0000","last_became_active":"2024-08-20T04:59:12.795321+0000","last_became_peered":"2024-08-20T04:59:12.795321+0000","last_unstale":"2024-08-20T05:01:30.357523+0000","last_undegraded":"2024-08-20T05:01:30.357523+0000","last_fullsized":"2024-08-20T05:01:30.357523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:40:30.561306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'5","reported_seq":306,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:13.378550+0000","last_change":"2024-08-20T04:59:09.754468+0000","last_active":"2024-08-20T05:02:13.378550+0000","last_peered":"2024-08-20T05:02:13.378550+0000","last_clean":"2024-08-20T05:02:13.378550+0000","last_became_active":"2024-08-20T04:59:09.754115+0000","last_became_peered":"2024-08-20T04:59:09.754115+0000","last_unstale":"2024-08-20T05:02:13.378550+0000","last_undegraded":"2024-08-20T05:02:13.378550+0000","last_fullsized":"2024-08-20T05:02:13.378550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:50:21.301246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":256,"num_read_kb":256,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356257+0000","last_change":"2024-08-20T04:59:21.898785+0000","last_active":"2024-08-20T05:01:30.356257+0000","last_peered":"2024-08-20T05:01:30.356257+0000","last_clean":"2024-08-20T05:01:30.356257+0000","last_became_active":"2024-08-20T04:59:21.898423+0000","last_became_peered":"2024-08-20T04:59:21.898423+0000","last_unstale":"2024-08-20T05:01:30.356257+0000","last_undegraded":"2024-08-20T05:01:30.356257+0000","last_fullsized":"2024-08-20T05:01:30.356257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:52:58.800104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338624+0000","last_change":"2024-08-20T04:59:21.906208+0000","last_active":"2024-08-20T05:01:30.338624+0000","last_peered":"2024-08-20T05:01:30.338624+0000","last_clean":"2024-08-20T05:01:30.338624+0000","last_became_active":"2024-08-20T04:59:21.905041+0000","last_became_peered":"2024-08-20T04:59:21.905041+0000","last_unstale":"2024-08-20T05:01:30.338624+0000","last_undegraded":"2024-08-20T05:01:30.338624+0000","last_fullsized":"2024-08-20T05:01:30.338624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:05:28.971357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342413+0000","last_change":"2024-08-20T04:59:12.788130+0000","last_active":"2024-08-20T05:01:30.342413+0000","last_peered":"2024-08-20T05:01:30.342413+0000","last_clean":"2024-08-20T05:01:30.342413+0000","last_became_active":"2024-08-20T04:59:12.787665+0000","last_became_peered":"2024-08-20T04:59:12.787665+0000","last_unstale":"2024-08-20T05:01:30.342413+0000","last_undegraded":"2024-08-20T05:01:30.342413+0000","last_fullsized":"2024-08-20T05:01:30.342413+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:59:39.628781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356172+0000","last_change":"2024-08-20T04:59:09.754842+0000","last_active":"2024-08-20T05:01:30.356172+0000","last_peered":"2024-08-20T05:01:30.356172+0000","last_clean":"2024-08-20T05:01:30.356172+0000","last_became_active":"2024-08-20T04:59:09.754515+0000","last_became_peered":"2024-08-20T04:59:09.754515+0000","last_unstale":"2024-08-20T05:01:30.356172+0000","last_undegraded":"2024-08-20T05:01:30.356172+0000","last_fullsized":"2024-08-20T05:01:30.356172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:19:02.241567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340312+0000","last_change":"2024-08-20T04:59:21.900610+0000","last_active":"2024-08-20T05:01:30.340312+0000","last_peered":"2024-08-20T05:01:30.340312+0000","last_clean":"2024-08-20T05:01:30.340312+0000","last_became_active":"2024-08-20T04:59:21.900207+0000","last_became_peered":"2024-08-20T04:59:21.900207+0000","last_unstale":"2024-08-20T05:01:30.340312+0000","last_undegraded":"2024-08-20T05:01:30.340312+0000","last_fullsized":"2024-08-20T05:01:30.340312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:41:00.115344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356667+0000","last_change":"2024-08-20T04:59:12.780772+0000","last_active":"2024-08-20T05:01:30.356667+0000","last_peered":"2024-08-20T05:01:30.356667+0000","last_clean":"2024-08-20T05:01:30.356667+0000","last_became_active":"2024-08-20T04:59:12.780385+0000","last_became_peered":"2024-08-20T04:59:12.780385+0000","last_unstale":"2024-08-20T05:01:30.356667+0000","last_undegraded":"2024-08-20T05:01:30.356667+0000","last_fullsized":"2024-08-20T05:01:30.356667+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:23.680899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355522+0000","last_change":"2024-08-20T04:59:09.749567+0000","last_active":"2024-08-20T05:01:30.355522+0000","last_peered":"2024-08-20T05:01:30.355522+0000","last_clean":"2024-08-20T05:01:30.355522+0000","last_became_active":"2024-08-20T04:59:09.749204+0000","last_became_peered":"2024-08-20T04:59:09.749204+0000","last_unstale":"2024-08-20T05:01:30.355522+0000","last_undegraded":"2024-08-20T05:01:30.355522+0000","last_fullsized":"2024-08-20T05:01:30.355522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:57:51.236459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356327+0000","last_change":"2024-08-20T04:59:09.751622+0000","last_active":"2024-08-20T05:01:30.356327+0000","last_peered":"2024-08-20T05:01:30.356327+0000","last_clean":"2024-08-20T05:01:30.356327+0000","last_became_active":"2024-08-20T04:59:09.751227+0000","last_became_peered":"2024-08-20T04:59:09.751227+0000","last_unstale":"2024-08-20T05:01:30.356327+0000","last_undegraded":"2024-08-20T05:01:30.356327+0000","last_fullsized":"2024-08-20T05:01:30.356327+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:53:38.755122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356190+0000","last_change":"2024-08-20T04:59:12.789243+0000","last_active":"2024-08-20T05:01:30.356190+0000","last_peered":"2024-08-20T05:01:30.356190+0000","last_clean":"2024-08-20T05:01:30.356190+0000","last_became_active":"2024-08-20T04:59:12.788932+0000","last_became_peered":"2024-08-20T04:59:12.788932+0000","last_unstale":"2024-08-20T05:01:30.356190+0000","last_undegraded":"2024-08-20T05:01:30.356190+0000","last_fullsized":"2024-08-20T05:01:30.356190+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:27:00.122328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343578+0000","last_change":"2024-08-20T04:59:21.902847+0000","last_active":"2024-08-20T05:01:30.343578+0000","last_peered":"2024-08-20T05:01:30.343578+0000","last_clean":"2024-08-20T05:01:30.343578+0000","last_became_active":"2024-08-20T04:59:21.902426+0000","last_became_peered":"2024-08-20T04:59:21.902426+0000","last_unstale":"2024-08-20T05:01:30.343578+0000","last_undegraded":"2024-08-20T05:01:30.343578+0000","last_fullsized":"2024-08-20T05:01:30.343578+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:18:38.107358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":189,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:08.510197+0000","last_change":"2024-08-20T05:00:29.375139+0000","last_active":"2024-08-20T05:02:08.510197+0000","last_peered":"2024-08-20T05:02:08.510197+0000","last_clean":"2024-08-20T05:02:08.510197+0000","last_became_active":"2024-08-20T05:00:29.370896+0000","last_became_peered":"2024-08-20T05:00:29.370896+0000","last_unstale":"2024-08-20T05:02:08.510197+0000","last_undegraded":"2024-08-20T05:02:08.510197+0000","last_fullsized":"2024-08-20T05:02:08.510197+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:06:48.033558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342418+0000","last_change":"2024-08-20T04:59:12.785811+0000","last_active":"2024-08-20T05:01:30.342418+0000","last_peered":"2024-08-20T05:01:30.342418+0000","last_clean":"2024-08-20T05:01:30.342418+0000","last_became_active":"2024-08-20T04:59:12.785483+0000","last_became_peered":"2024-08-20T04:59:12.785483+0000","last_unstale":"2024-08-20T05:01:30.342418+0000","last_undegraded":"2024-08-20T05:01:30.342418+0000","last_fullsized":"2024-08-20T05:01:30.342418+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:31:25.355197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344575+0000","last_change":"2024-08-20T04:59:21.897832+0000","last_active":"2024-08-20T05:01:30.344575+0000","last_peered":"2024-08-20T05:01:30.344575+0000","last_clean":"2024-08-20T05:01:30.344575+0000","last_became_active":"2024-08-20T04:59:21.897457+0000","last_became_peered":"2024-08-20T04:59:21.897457+0000","last_unstale":"2024-08-20T05:01:30.344575+0000","last_undegraded":"2024-08-20T05:01:30.344575+0000","last_fullsized":"2024-08-20T05:01:30.344575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:39:51.934014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339787+0000","last_change":"2024-08-20T04:59:12.787671+0000","last_active":"2024-08-20T05:01:30.339787+0000","last_peered":"2024-08-20T05:01:30.339787+0000","last_clean":"2024-08-20T05:01:30.339787+0000","last_became_active":"2024-08-20T04:59:12.787372+0000","last_became_peered":"2024-08-20T04:59:12.787372+0000","last_unstale":"2024-08-20T05:01:30.339787+0000","last_undegraded":"2024-08-20T05:01:30.339787+0000","last_fullsized":"2024-08-20T05:01:30.339787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:16:55.031031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344513+0000","last_change":"2024-08-20T04:59:12.792192+0000","last_active":"2024-08-20T05:01:30.344513+0000","last_peered":"2024-08-20T05:01:30.344513+0000","last_clean":"2024-08-20T05:01:30.344513+0000","last_became_active":"2024-08-20T04:59:12.791447+0000","last_became_peered":"2024-08-20T04:59:12.791447+0000","last_unstale":"2024-08-20T05:01:30.344513+0000","last_undegraded":"2024-08-20T05:01:30.344513+0000","last_fullsized":"2024-08-20T05:01:30.344513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:03:32.559245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343399+0000","last_change":"2024-08-20T04:59:12.785393+0000","last_active":"2024-08-20T05:01:30.343399+0000","last_peered":"2024-08-20T05:01:30.343399+0000","last_clean":"2024-08-20T05:01:30.343399+0000","last_became_active":"2024-08-20T04:59:12.784998+0000","last_became_peered":"2024-08-20T04:59:12.784998+0000","last_unstale":"2024-08-20T05:01:30.343399+0000","last_undegraded":"2024-08-20T05:01:30.343399+0000","last_fullsized":"2024-08-20T05:01:30.343399+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:27:04.964290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338483+0000","last_change":"2024-08-20T04:59:12.784730+0000","last_active":"2024-08-20T05:01:30.338483+0000","last_peered":"2024-08-20T05:01:30.338483+0000","last_clean":"2024-08-20T05:01:30.338483+0000","last_became_active":"2024-08-20T04:59:12.784269+0000","last_became_peered":"2024-08-20T04:59:12.784269+0000","last_unstale":"2024-08-20T05:01:30.338483+0000","last_undegraded":"2024-08-20T05:01:30.338483+0000","last_fullsized":"2024-08-20T05:01:30.338483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:43:12.248033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355819+0000","last_change":"2024-08-20T04:59:12.786484+0000","last_active":"2024-08-20T05:01:30.355819+0000","last_peered":"2024-08-20T05:01:30.355819+0000","last_clean":"2024-08-20T05:01:30.355819+0000","last_became_active":"2024-08-20T04:59:12.786166+0000","last_became_peered":"2024-08-20T04:59:12.786166+0000","last_unstale":"2024-08-20T05:01:30.355819+0000","last_undegraded":"2024-08-20T05:01:30.355819+0000","last_fullsized":"2024-08-20T05:01:30.355819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:30.084519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340680+0000","last_change":"2024-08-20T04:59:12.786985+0000","last_active":"2024-08-20T05:01:30.340680+0000","last_peered":"2024-08-20T05:01:30.340680+0000","last_clean":"2024-08-20T05:01:30.340680+0000","last_became_active":"2024-08-20T04:59:12.786674+0000","last_became_peered":"2024-08-20T04:59:12.786674+0000","last_unstale":"2024-08-20T05:01:30.340680+0000","last_undegraded":"2024-08-20T05:01:30.340680+0000","last_fullsized":"2024-08-20T05:01:30.340680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:30:59.996149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344184+0000","last_change":"2024-08-20T04:59:12.796410+0000","last_active":"2024-08-20T05:01:30.344184+0000","last_peered":"2024-08-20T05:01:30.344184+0000","last_clean":"2024-08-20T05:01:30.344184+0000","last_became_active":"2024-08-20T04:59:12.796081+0000","last_became_peered":"2024-08-20T04:59:12.796081+0000","last_unstale":"2024-08-20T05:01:30.344184+0000","last_undegraded":"2024-08-20T05:01:30.344184+0000","last_fullsized":"2024-08-20T05:01:30.344184+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:49:09.706265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357071+0000","last_change":"2024-08-20T04:59:12.795994+0000","last_active":"2024-08-20T05:01:30.357071+0000","last_peered":"2024-08-20T05:01:30.357071+0000","last_clean":"2024-08-20T05:01:30.357071+0000","last_became_active":"2024-08-20T04:59:12.795604+0000","last_became_peered":"2024-08-20T04:59:12.795604+0000","last_unstale":"2024-08-20T05:01:30.357071+0000","last_undegraded":"2024-08-20T05:01:30.357071+0000","last_fullsized":"2024-08-20T05:01:30.357071+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:54:09.628743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355741+0000","last_change":"2024-08-20T04:59:12.788966+0000","last_active":"2024-08-20T05:01:30.355741+0000","last_peered":"2024-08-20T05:01:30.355741+0000","last_clean":"2024-08-20T05:01:30.355741+0000","last_became_active":"2024-08-20T04:59:12.788534+0000","last_became_peered":"2024-08-20T04:59:12.788534+0000","last_unstale":"2024-08-20T05:01:30.355741+0000","last_undegraded":"2024-08-20T05:01:30.355741+0000","last_fullsized":"2024-08-20T05:01:30.355741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.615399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356431+0000","last_change":"2024-08-20T04:59:12.785914+0000","last_active":"2024-08-20T05:01:30.356431+0000","last_peered":"2024-08-20T05:01:30.356431+0000","last_clean":"2024-08-20T05:01:30.356431+0000","last_became_active":"2024-08-20T04:59:12.785551+0000","last_became_peered":"2024-08-20T04:59:12.785551+0000","last_unstale":"2024-08-20T05:01:30.356431+0000","last_undegraded":"2024-08-20T05:01:30.356431+0000","last_fullsized":"2024-08-20T05:01:30.356431+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:30:32.072387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357188+0000","last_change":"2024-08-20T04:59:12.795635+0000","last_active":"2024-08-20T05:01:30.357188+0000","last_peered":"2024-08-20T05:01:30.357188+0000","last_clean":"2024-08-20T05:01:30.357188+0000","last_became_active":"2024-08-20T04:59:12.794805+0000","last_became_peered":"2024-08-20T04:59:12.794805+0000","last_unstale":"2024-08-20T05:01:30.357188+0000","last_undegraded":"2024-08-20T05:01:30.357188+0000","last_fullsized":"2024-08-20T05:01:30.357188+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:09:08.725503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355737+0000","last_change":"2024-08-20T04:59:12.785099+0000","last_active":"2024-08-20T05:01:30.355737+0000","last_peered":"2024-08-20T05:01:30.355737+0000","last_clean":"2024-08-20T05:01:30.355737+0000","last_became_active":"2024-08-20T04:59:12.784727+0000","last_became_peered":"2024-08-20T04:59:12.784727+0000","last_unstale":"2024-08-20T05:01:30.355737+0000","last_undegraded":"2024-08-20T05:01:30.355737+0000","last_fullsized":"2024-08-20T05:01:30.355737+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:24:36.227289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340160+0000","last_change":"2024-08-20T04:59:12.781832+0000","last_active":"2024-08-20T05:01:30.340160+0000","last_peered":"2024-08-20T05:01:30.340160+0000","last_clean":"2024-08-20T05:01:30.340160+0000","last_became_active":"2024-08-20T04:59:12.781342+0000","last_became_peered":"2024-08-20T04:59:12.781342+0000","last_unstale":"2024-08-20T05:01:30.340160+0000","last_undegraded":"2024-08-20T05:01:30.340160+0000","last_fullsized":"2024-08-20T05:01:30.340160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:26:17.762048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344755+0000","last_change":"2024-08-20T04:59:12.792350+0000","last_active":"2024-08-20T05:01:30.344755+0000","last_peered":"2024-08-20T05:01:30.344755+0000","last_clean":"2024-08-20T05:01:30.344755+0000","last_became_active":"2024-08-20T04:59:12.792028+0000","last_became_peered":"2024-08-20T04:59:12.792028+0000","last_unstale":"2024-08-20T05:01:30.344755+0000","last_undegraded":"2024-08-20T05:01:30.344755+0000","last_fullsized":"2024-08-20T05:01:30.344755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:16:23.173759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343346+0000","last_change":"2024-08-20T04:59:12.795047+0000","last_active":"2024-08-20T05:01:30.343346+0000","last_peered":"2024-08-20T05:01:30.343346+0000","last_clean":"2024-08-20T05:01:30.343346+0000","last_became_active":"2024-08-20T04:59:12.794705+0000","last_became_peered":"2024-08-20T04:59:12.794705+0000","last_unstale":"2024-08-20T05:01:30.343346+0000","last_undegraded":"2024-08-20T05:01:30.343346+0000","last_fullsized":"2024-08-20T05:01:30.343346+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:51:16.355892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340659+0000","last_change":"2024-08-20T04:59:12.785022+0000","last_active":"2024-08-20T05:01:30.340659+0000","last_peered":"2024-08-20T05:01:30.340659+0000","last_clean":"2024-08-20T05:01:30.340659+0000","last_became_active":"2024-08-20T04:59:12.784730+0000","last_became_peered":"2024-08-20T04:59:12.784730+0000","last_unstale":"2024-08-20T05:01:30.340659+0000","last_undegraded":"2024-08-20T05:01:30.340659+0000","last_fullsized":"2024-08-20T05:01:30.340659+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:21:53.053890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356636+0000","last_change":"2024-08-20T04:59:12.790825+0000","last_active":"2024-08-20T05:01:30.356636+0000","last_peered":"2024-08-20T05:01:30.356636+0000","last_clean":"2024-08-20T05:01:30.356636+0000","last_became_active":"2024-08-20T04:59:12.790299+0000","last_became_peered":"2024-08-20T04:59:12.790299+0000","last_unstale":"2024-08-20T05:01:30.356636+0000","last_undegraded":"2024-08-20T05:01:30.356636+0000","last_fullsized":"2024-08-20T05:01:30.356636+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:12.477186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338217+0000","last_change":"2024-08-20T05:00:29.374190+0000","last_active":"2024-08-20T05:01:30.338217+0000","last_peered":"2024-08-20T05:01:30.338217+0000","last_clean":"2024-08-20T05:01:30.338217+0000","last_became_active":"2024-08-20T05:00:29.373844+0000","last_became_peered":"2024-08-20T05:00:29.373844+0000","last_unstale":"2024-08-20T05:01:30.338217+0000","last_undegraded":"2024-08-20T05:01:30.338217+0000","last_fullsized":"2024-08-20T05:01:30.338217+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:03.131340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338379+0000","last_change":"2024-08-20T04:59:12.783355+0000","last_active":"2024-08-20T05:01:30.338379+0000","last_peered":"2024-08-20T05:01:30.338379+0000","last_clean":"2024-08-20T05:01:30.338379+0000","last_became_active":"2024-08-20T04:59:12.782992+0000","last_became_peered":"2024-08-20T04:59:12.782992+0000","last_unstale":"2024-08-20T05:01:30.338379+0000","last_undegraded":"2024-08-20T05:01:30.338379+0000","last_fullsized":"2024-08-20T05:01:30.338379+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:09:47.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355676+0000","last_change":"2024-08-20T04:59:12.783989+0000","last_active":"2024-08-20T05:01:30.355676+0000","last_peered":"2024-08-20T05:01:30.355676+0000","last_clean":"2024-08-20T05:01:30.355676+0000","last_became_active":"2024-08-20T04:59:12.783671+0000","last_became_peered":"2024-08-20T04:59:12.783671+0000","last_unstale":"2024-08-20T05:01:30.355676+0000","last_undegraded":"2024-08-20T05:01:30.355676+0000","last_fullsized":"2024-08-20T05:01:30.355676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:34:55.727599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357140+0000","last_change":"2024-08-20T04:59:12.787118+0000","last_active":"2024-08-20T05:01:30.357140+0000","last_peered":"2024-08-20T05:01:30.357140+0000","last_clean":"2024-08-20T05:01:30.357140+0000","last_became_active":"2024-08-20T04:59:12.786754+0000","last_became_peered":"2024-08-20T04:59:12.786754+0000","last_unstale":"2024-08-20T05:01:30.357140+0000","last_undegraded":"2024-08-20T05:01:30.357140+0000","last_fullsized":"2024-08-20T05:01:30.357140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:13:23.959972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340919+0000","last_change":"2024-08-20T04:59:12.793748+0000","last_active":"2024-08-20T05:01:30.340919+0000","last_peered":"2024-08-20T05:01:30.340919+0000","last_clean":"2024-08-20T05:01:30.340919+0000","last_became_active":"2024-08-20T04:59:12.792550+0000","last_became_peered":"2024-08-20T04:59:12.792550+0000","last_unstale":"2024-08-20T05:01:30.340919+0000","last_undegraded":"2024-08-20T05:01:30.340919+0000","last_fullsized":"2024-08-20T05:01:30.340919+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:59:24.226273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356824+0000","last_change":"2024-08-20T04:59:12.788827+0000","last_active":"2024-08-20T05:01:30.356824+0000","last_peered":"2024-08-20T05:01:30.356824+0000","last_clean":"2024-08-20T05:01:30.356824+0000","last_became_active":"2024-08-20T04:59:12.788395+0000","last_became_peered":"2024-08-20T04:59:12.788395+0000","last_unstale":"2024-08-20T05:01:30.356824+0000","last_undegraded":"2024-08-20T05:01:30.356824+0000","last_fullsized":"2024-08-20T05:01:30.356824+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:26.453063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357616+0000","last_change":"2024-08-20T04:59:12.795513+0000","last_active":"2024-08-20T05:01:30.357616+0000","last_peered":"2024-08-20T05:01:30.357616+0000","last_clean":"2024-08-20T05:01:30.357616+0000","last_became_active":"2024-08-20T04:59:12.795191+0000","last_became_peered":"2024-08-20T04:59:12.795191+0000","last_unstale":"2024-08-20T05:01:30.357616+0000","last_undegraded":"2024-08-20T05:01:30.357616+0000","last_fullsized":"2024-08-20T05:01:30.357616+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:04:00.893420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356614+0000","last_change":"2024-08-20T04:59:12.789825+0000","last_active":"2024-08-20T05:01:30.356614+0000","last_peered":"2024-08-20T05:01:30.356614+0000","last_clean":"2024-08-20T05:01:30.356614+0000","last_became_active":"2024-08-20T04:59:12.788198+0000","last_became_peered":"2024-08-20T04:59:12.788198+0000","last_unstale":"2024-08-20T05:01:30.356614+0000","last_undegraded":"2024-08-20T05:01:30.356614+0000","last_fullsized":"2024-08-20T05:01:30.356614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:10.898308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340338+0000","last_change":"2024-08-20T04:59:12.787707+0000","last_active":"2024-08-20T05:01:30.340338+0000","last_peered":"2024-08-20T05:01:30.340338+0000","last_clean":"2024-08-20T05:01:30.340338+0000","last_became_active":"2024-08-20T04:59:12.787035+0000","last_became_peered":"2024-08-20T04:59:12.787035+0000","last_unstale":"2024-08-20T05:01:30.340338+0000","last_undegraded":"2024-08-20T05:01:30.340338+0000","last_fullsized":"2024-08-20T05:01:30.340338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:16:52.451048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356216+0000","last_change":"2024-08-20T04:59:12.784012+0000","last_active":"2024-08-20T05:01:30.356216+0000","last_peered":"2024-08-20T05:01:30.356216+0000","last_clean":"2024-08-20T05:01:30.356216+0000","last_became_active":"2024-08-20T04:59:12.783599+0000","last_became_peered":"2024-08-20T04:59:12.783599+0000","last_unstale":"2024-08-20T05:01:30.356216+0000","last_undegraded":"2024-08-20T05:01:30.356216+0000","last_fullsized":"2024-08-20T05:01:30.356216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:23:15.271873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342676+0000","last_change":"2024-08-20T04:59:12.784987+0000","last_active":"2024-08-20T05:01:30.342676+0000","last_peered":"2024-08-20T05:01:30.342676+0000","last_clean":"2024-08-20T05:01:30.342676+0000","last_became_active":"2024-08-20T04:59:12.784693+0000","last_became_peered":"2024-08-20T04:59:12.784693+0000","last_unstale":"2024-08-20T05:01:30.342676+0000","last_undegraded":"2024-08-20T05:01:30.342676+0000","last_fullsized":"2024-08-20T05:01:30.342676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:07:51.624602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357088+0000","last_change":"2024-08-20T04:59:12.792466+0000","last_active":"2024-08-20T05:01:30.357088+0000","last_peered":"2024-08-20T05:01:30.357088+0000","last_clean":"2024-08-20T05:01:30.357088+0000","last_became_active":"2024-08-20T04:59:12.792114+0000","last_became_peered":"2024-08-20T04:59:12.792114+0000","last_unstale":"2024-08-20T05:01:30.357088+0000","last_undegraded":"2024-08-20T05:01:30.357088+0000","last_fullsized":"2024-08-20T05:01:30.357088+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:23:09.919907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338528+0000","last_change":"2024-08-20T04:59:12.793041+0000","last_active":"2024-08-20T05:01:30.338528+0000","last_peered":"2024-08-20T05:01:30.338528+0000","last_clean":"2024-08-20T05:01:30.338528+0000","last_became_active":"2024-08-20T04:59:12.792709+0000","last_became_peered":"2024-08-20T04:59:12.792709+0000","last_unstale":"2024-08-20T05:01:30.338528+0000","last_undegraded":"2024-08-20T05:01:30.338528+0000","last_fullsized":"2024-08-20T05:01:30.338528+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:09:04.523493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338652+0000","last_change":"2024-08-20T04:59:12.790256+0000","last_active":"2024-08-20T05:01:30.338652+0000","last_peered":"2024-08-20T05:01:30.338652+0000","last_clean":"2024-08-20T05:01:30.338652+0000","last_became_active":"2024-08-20T04:59:12.788467+0000","last_became_peered":"2024-08-20T04:59:12.788467+0000","last_unstale":"2024-08-20T05:01:30.338652+0000","last_undegraded":"2024-08-20T05:01:30.338652+0000","last_fullsized":"2024-08-20T05:01:30.338652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:55:31.386030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340563+0000","last_change":"2024-08-20T04:59:12.794882+0000","last_active":"2024-08-20T05:01:30.340563+0000","last_peered":"2024-08-20T05:01:30.340563+0000","last_clean":"2024-08-20T05:01:30.340563+0000","last_became_active":"2024-08-20T04:59:12.794564+0000","last_became_peered":"2024-08-20T04:59:12.794564+0000","last_unstale":"2024-08-20T05:01:30.340563+0000","last_undegraded":"2024-08-20T05:01:30.340563+0000","last_fullsized":"2024-08-20T05:01:30.340563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:36:47.515754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76899,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1305,"num_read_kb":741,"num_write":264,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":734,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":225324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743475,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1028096,"data_stored":510687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939704,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28708,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716444,"statfs":{"total":95995035648,"available":95965638656,"internally_reserved":0,"allocated":1724416,"data_stored":1170900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103230,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1044480,"data_stored":509973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299458,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1032192,"data_stored":510239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462983,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1638400,"data_stored":1106989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626509,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":505477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822738,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1646592,"data_stored":1102039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986263,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1036288,"data_stored":510705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182492,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1032192,"data_stored":505185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411427,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708732,"statfs":{"total":95995035648,"available":95957741568,"internally_reserved":0,"allocated":1101824,"data_stored":570677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":570547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738475,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1044480,"data_stored":507465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":71681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T05:02:14.367 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-08-20T05:02:14.367 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-20T05:02:14.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.561+0000 7fb3cea00640 1 -- 172.21.15.37:0/4069969941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c81035e0 msgr2=0x7fb3c8103a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:14.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.561+0000 7fb3cea00640 1 --2- 172.21.15.37:0/4069969941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c81035e0 0x7fb3c8103a60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4009930 tx=0x7fb3b402a420 comp rx=0 tx=0).stop 2024-08-20T05:02:14.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.561+0000 7fb3cea00640 1 -- 172.21.15.37:0/4069969941 shutdown_connections 2024-08-20T05:02:14.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.561+0000 7fb3cea00640 1 --2- 172.21.15.37:0/4069969941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3c8103fa0 0x7fb3c810a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.561+0000 7fb3cea00640 1 --2- 172.21.15.37:0/4069969941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c81035e0 0x7fb3c8103a60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.561+0000 7fb3cea00640 1 --2- 172.21.15.37:0/4069969941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3c8102490 0x7fb3c8102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.561+0000 7fb3cea00640 1 -- 172.21.15.37:0/4069969941 >> 172.21.15.37:0/4069969941 conn(0x7fb3c80fdd30 msgr2=0x7fb3c8100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:14.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.561+0000 7fb3cea00640 1 -- 172.21.15.37:0/4069969941 shutdown_connections 2024-08-20T05:02:14.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.561+0000 7fb3cea00640 1 -- 172.21.15.37:0/4069969941 wait complete. 2024-08-20T05:02:14.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.562+0000 7fb3cea00640 1 Processor -- start 2024-08-20T05:02:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.562+0000 7fb3cea00640 1 -- start start 2024-08-20T05:02:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.562+0000 7fb3cea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3c8102490 0x7fb3c819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.562+0000 7fb3cea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c81035e0 0x7fb3c819b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.562+0000 7fb3cea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3c8103fa0 0x7fb3c819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.562+0000 7fb3cea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c810e150 con 0x7fb3c81035e0 2024-08-20T05:02:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.562+0000 7fb3cea00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c810dfd0 con 0x7fb3c8103fa0 2024-08-20T05:02:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.562+0000 7fb3cea00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c810e2d0 con 0x7fb3c8102490 2024-08-20T05:02:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.563+0000 7fb3ccc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c81035e0 0x7fb3c819b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.563+0000 7fb3ccc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c81035e0 0x7fb3c819b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35008/0 (socket says 172.21.15.37:35008) 2024-08-20T05:02:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.563+0000 7fb3ccc00640 1 -- 172.21.15.37:0/3325513294 learned_addr learned my addr 172.21.15.37:0/3325513294 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.563+0000 7fb3cd600640 1 --2- 172.21.15.37:0/3325513294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3c8102490 0x7fb3c819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.563+0000 7fb3ce000640 1 --2- 172.21.15.37:0/3325513294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3c8103fa0 0x7fb3c819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.563+0000 7fb3ccc00640 1 -- 172.21.15.37:0/3325513294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3c8102490 msgr2=0x7fb3c819aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.563+0000 7fb3ccc00640 1 --2- 172.21.15.37:0/3325513294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3c8102490 0x7fb3c819aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.563+0000 7fb3ccc00640 1 -- 172.21.15.37:0/3325513294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3c8103fa0 msgr2=0x7fb3c819bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.563+0000 7fb3ccc00640 1 --2- 172.21.15.37:0/3325513294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3c8103fa0 0x7fb3c819bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.563+0000 7fb3ccc00640 1 -- 172.21.15.37:0/3325513294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c819c5d0 con 0x7fb3c81035e0 2024-08-20T05:02:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.563+0000 7fb3ccc00640 1 --2- 172.21.15.37:0/3325513294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c81035e0 0x7fb3c819b0e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4031500 tx=0x7fb3b4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.564+0000 7fb3c6000640 1 -- 172.21.15.37:0/3325513294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b403f070 con 0x7fb3c81035e0 2024-08-20T05:02:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.564+0000 7fb3c6000640 1 -- 172.21.15.37:0/3325513294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3b4031c50 con 0x7fb3c81035e0 2024-08-20T05:02:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.564+0000 7fb3cea00640 1 -- 172.21.15.37:0/3325513294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c819c860 con 0x7fb3c81035e0 2024-08-20T05:02:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.564+0000 7fb3c6000640 1 -- 172.21.15.37:0/3325513294 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4035030 con 0x7fb3c81035e0 2024-08-20T05:02:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.564+0000 7fb3cea00640 1 -- 172.21.15.37:0/3325513294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c81a2f90 con 0x7fb3c81035e0 2024-08-20T05:02:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.565+0000 7fb3cea00640 1 -- 172.21.15.37:0/3325513294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3c8102890 con 0x7fb3c81035e0 2024-08-20T05:02:14.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.567+0000 7fb3c6000640 1 -- 172.21.15.37:0/3325513294 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb3b4042070 con 0x7fb3c81035e0 2024-08-20T05:02:14.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.568+0000 7fb3c6000640 1 --2- 172.21.15.37:0/3325513294 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb3b00b3c50 0x7fb3b00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:14.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.569+0000 7fb3c6000640 1 -- 172.21.15.37:0/3325513294 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb3b4104d40 con 0x7fb3c81035e0 2024-08-20T05:02:14.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.569+0000 7fb3cd600640 1 --2- 172.21.15.37:0/3325513294 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb3b00b3c50 0x7fb3b00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:14.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.569+0000 7fb3cd600640 1 --2- 172.21.15.37:0/3325513294 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb3b00b3c50 0x7fb3b00b6110 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc005d00 tx=0x7fb3bc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:14.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.570+0000 7fb3c6000640 1 -- 172.21.15.37:0/3325513294 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fb3b40cb940 con 0x7fb3c81035e0 2024-08-20T05:02:14.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.764+0000 7fb3cea00640 1 -- 172.21.15.37:0/3325513294 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb3c80767d0 con 0x7fb3b00b3c50 2024-08-20T05:02:14.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.770+0000 7fb3c6000640 1 -- 172.21.15.37:0/3325513294 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340543 (secure 0 0 0) 0x7fb3c80767d0 con 0x7fb3b00b3c50 2024-08-20T05:02:14.775 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:14.776 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-20T05:02:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.774+0000 7fb3cea00640 1 -- 172.21.15.37:0/3325513294 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb3b00b3c50 msgr2=0x7fb3b00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.774+0000 7fb3cea00640 1 --2- 172.21.15.37:0/3325513294 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb3b00b3c50 0x7fb3b00b6110 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc005d00 tx=0x7fb3bc00b410 comp rx=0 tx=0).stop 2024-08-20T05:02:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.774+0000 7fb3cea00640 1 -- 172.21.15.37:0/3325513294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c81035e0 msgr2=0x7fb3c819b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.774+0000 7fb3cea00640 1 --2- 172.21.15.37:0/3325513294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c81035e0 0x7fb3c819b0e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb3b4031500 tx=0x7fb3b4003c10 comp rx=0 tx=0).stop 2024-08-20T05:02:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.774+0000 7fb3cea00640 1 -- 172.21.15.37:0/3325513294 shutdown_connections 2024-08-20T05:02:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.774+0000 7fb3cea00640 1 --2- 172.21.15.37:0/3325513294 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb3b00b3c50 0x7fb3b00b6110 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.774+0000 7fb3cea00640 1 --2- 172.21.15.37:0/3325513294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb3c8103fa0 0x7fb3c819bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.774+0000 7fb3cea00640 1 --2- 172.21.15.37:0/3325513294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3c81035e0 0x7fb3c819b0e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.774+0000 7fb3cea00640 1 --2- 172.21.15.37:0/3325513294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb3c8102490 0x7fb3c819aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:14.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.774+0000 7fb3cea00640 1 -- 172.21.15.37:0/3325513294 >> 172.21.15.37:0/3325513294 conn(0x7fb3c80fdd30 msgr2=0x7fb3c80750b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:14.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.775+0000 7fb3cea00640 1 -- 172.21.15.37:0/3325513294 shutdown_connections 2024-08-20T05:02:14.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:14.775+0000 7fb3cea00640 1 -- 172.21.15.37:0/3325513294 wait complete. 2024-08-20T05:02:14.792 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":401,"stamp":"2024-08-20T05:02:14.019689+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667501,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1381,"num_read_kb":805,"num_write":389,"num_write_kb":2312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952691,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":821,"ondisk_log_size":821,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367572,"kb_used_data":14100,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124574252,"statfs":{"total":1151940427776,"available":1151564034048,"internally_reserved":0,"allocated":14438400,"data_stored":8080883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5684,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":77,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003362"},"pg_stats":[{"pgid":"2.1f","version":"84'13","reported_seq":185,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:11.344406+0000","last_change":"2024-08-20T04:59:09.751382+0000","last_active":"2024-08-20T05:02:11.344406+0000","last_peered":"2024-08-20T05:02:11.344406+0000","last_clean":"2024-08-20T05:02:11.344406+0000","last_became_active":"2024-08-20T04:59:09.751026+0000","last_became_peered":"2024-08-20T04:59:09.751026+0000","last_unstale":"2024-08-20T05:02:11.344406+0000","last_undegraded":"2024-08-20T05:02:11.344406+0000","last_fullsized":"2024-08-20T05:02:11.344406+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:14:50.107767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":128,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342960+0000","last_change":"2024-08-20T05:00:29.371826+0000","last_active":"2024-08-20T05:01:30.342960+0000","last_peered":"2024-08-20T05:01:30.342960+0000","last_clean":"2024-08-20T05:01:30.342960+0000","last_became_active":"2024-08-20T05:00:29.371618+0000","last_became_peered":"2024-08-20T05:00:29.371618+0000","last_unstale":"2024-08-20T05:01:30.342960+0000","last_undegraded":"2024-08-20T05:01:30.342960+0000","last_fullsized":"2024-08-20T05:01:30.342960+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:34:36.786900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344146+0000","last_change":"2024-08-20T04:59:21.902558+0000","last_active":"2024-08-20T05:01:30.344146+0000","last_peered":"2024-08-20T05:01:30.344146+0000","last_clean":"2024-08-20T05:01:30.344146+0000","last_became_active":"2024-08-20T04:59:21.902119+0000","last_became_peered":"2024-08-20T04:59:21.902119+0000","last_unstale":"2024-08-20T05:01:30.344146+0000","last_undegraded":"2024-08-20T05:01:30.344146+0000","last_fullsized":"2024-08-20T05:01:30.344146+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:53.765865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357136+0000","last_change":"2024-08-20T04:59:09.946282+0000","last_active":"2024-08-20T05:01:30.357136+0000","last_peered":"2024-08-20T05:01:30.357136+0000","last_clean":"2024-08-20T05:01:30.357136+0000","last_became_active":"2024-08-20T04:59:09.945867+0000","last_became_peered":"2024-08-20T04:59:09.945867+0000","last_unstale":"2024-08-20T05:01:30.357136+0000","last_undegraded":"2024-08-20T05:01:30.357136+0000","last_fullsized":"2024-08-20T05:01:30.357136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:29:08.119504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338826+0000","last_change":"2024-08-20T04:59:12.796121+0000","last_active":"2024-08-20T05:01:30.338826+0000","last_peered":"2024-08-20T05:01:30.338826+0000","last_clean":"2024-08-20T05:01:30.338826+0000","last_became_active":"2024-08-20T04:59:12.792764+0000","last_became_peered":"2024-08-20T04:59:12.792764+0000","last_unstale":"2024-08-20T05:01:30.338826+0000","last_undegraded":"2024-08-20T05:01:30.338826+0000","last_fullsized":"2024-08-20T05:01:30.338826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:01:53.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355898+0000","last_change":"2024-08-20T04:59:21.909607+0000","last_active":"2024-08-20T05:01:30.355898+0000","last_peered":"2024-08-20T05:01:30.355898+0000","last_clean":"2024-08-20T05:01:30.355898+0000","last_became_active":"2024-08-20T04:59:21.909175+0000","last_became_peered":"2024-08-20T04:59:21.909175+0000","last_unstale":"2024-08-20T05:01:30.355898+0000","last_undegraded":"2024-08-20T05:01:30.355898+0000","last_fullsized":"2024-08-20T05:01:30.355898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:29:49.940169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342724+0000","last_change":"2024-08-20T04:59:09.753233+0000","last_active":"2024-08-20T05:01:30.342724+0000","last_peered":"2024-08-20T05:01:30.342724+0000","last_clean":"2024-08-20T05:01:30.342724+0000","last_became_active":"2024-08-20T04:59:09.752614+0000","last_became_peered":"2024-08-20T04:59:09.752614+0000","last_unstale":"2024-08-20T05:01:30.342724+0000","last_undegraded":"2024-08-20T05:01:30.342724+0000","last_fullsized":"2024-08-20T05:01:30.342724+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:04:20.199669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356860+0000","last_change":"2024-08-20T04:59:12.799116+0000","last_active":"2024-08-20T05:01:30.356860+0000","last_peered":"2024-08-20T05:01:30.356860+0000","last_clean":"2024-08-20T05:01:30.356860+0000","last_became_active":"2024-08-20T04:59:12.798725+0000","last_became_peered":"2024-08-20T04:59:12.798725+0000","last_unstale":"2024-08-20T05:01:30.356860+0000","last_undegraded":"2024-08-20T05:01:30.356860+0000","last_fullsized":"2024-08-20T05:01:30.356860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:46.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356542+0000","last_change":"2024-08-20T05:00:29.372973+0000","last_active":"2024-08-20T05:01:30.356542+0000","last_peered":"2024-08-20T05:01:30.356542+0000","last_clean":"2024-08-20T05:01:30.356542+0000","last_became_active":"2024-08-20T05:00:29.372504+0000","last_became_peered":"2024-08-20T05:00:29.372504+0000","last_unstale":"2024-08-20T05:01:30.356542+0000","last_undegraded":"2024-08-20T05:01:30.356542+0000","last_fullsized":"2024-08-20T05:01:30.356542+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:22:22.410569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342961+0000","last_change":"2024-08-20T04:59:09.752771+0000","last_active":"2024-08-20T05:01:30.342961+0000","last_peered":"2024-08-20T05:01:30.342961+0000","last_clean":"2024-08-20T05:01:30.342961+0000","last_became_active":"2024-08-20T04:59:09.752415+0000","last_became_peered":"2024-08-20T04:59:09.752415+0000","last_unstale":"2024-08-20T05:01:30.342961+0000","last_undegraded":"2024-08-20T05:01:30.342961+0000","last_fullsized":"2024-08-20T05:01:30.342961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:13:18.843587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356341+0000","last_change":"2024-08-20T04:59:12.794418+0000","last_active":"2024-08-20T05:01:30.356341+0000","last_peered":"2024-08-20T05:01:30.356341+0000","last_clean":"2024-08-20T05:01:30.356341+0000","last_became_active":"2024-08-20T04:59:12.794117+0000","last_became_peered":"2024-08-20T04:59:12.794117+0000","last_unstale":"2024-08-20T05:01:30.356341+0000","last_undegraded":"2024-08-20T05:01:30.356341+0000","last_fullsized":"2024-08-20T05:01:30.356341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:18.209690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356247+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T05:01:30.356247+0000","last_peered":"2024-08-20T05:01:30.356247+0000","last_clean":"2024-08-20T05:01:30.356247+0000","last_became_active":"2024-08-20T04:59:21.906344+0000","last_became_peered":"2024-08-20T04:59:21.906344+0000","last_unstale":"2024-08-20T05:01:30.356247+0000","last_undegraded":"2024-08-20T05:01:30.356247+0000","last_fullsized":"2024-08-20T05:01:30.356247+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:48:34.982558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340475+0000","last_change":"2024-08-20T04:59:12.792719+0000","last_active":"2024-08-20T05:01:30.340475+0000","last_peered":"2024-08-20T05:01:30.340475+0000","last_clean":"2024-08-20T05:01:30.340475+0000","last_became_active":"2024-08-20T04:59:12.792294+0000","last_became_peered":"2024-08-20T04:59:12.792294+0000","last_unstale":"2024-08-20T05:01:30.340475+0000","last_undegraded":"2024-08-20T05:01:30.340475+0000","last_fullsized":"2024-08-20T05:01:30.340475+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:20:03.593798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.363468+0000","last_change":"2024-08-20T05:01:30.363065+0000","last_active":"2024-08-20T05:01:30.363468+0000","last_peered":"2024-08-20T05:01:30.363468+0000","last_clean":"2024-08-20T05:01:30.363468+0000","last_became_active":"2024-08-20T05:01:30.357909+0000","last_became_peered":"2024-08-20T05:01:30.357909+0000","last_unstale":"2024-08-20T05:01:30.363468+0000","last_undegraded":"2024-08-20T05:01:30.363468+0000","last_fullsized":"2024-08-20T05:01:30.363468+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:46:56.468529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356466+0000","last_change":"2024-08-20T04:59:21.902445+0000","last_active":"2024-08-20T05:01:30.356466+0000","last_peered":"2024-08-20T05:01:30.356466+0000","last_clean":"2024-08-20T05:01:30.356466+0000","last_became_active":"2024-08-20T04:59:21.901950+0000","last_became_peered":"2024-08-20T04:59:21.901950+0000","last_unstale":"2024-08-20T05:01:30.356466+0000","last_undegraded":"2024-08-20T05:01:30.356466+0000","last_fullsized":"2024-08-20T05:01:30.356466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:55:28.653841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356733+0000","last_change":"2024-08-20T04:59:12.784236+0000","last_active":"2024-08-20T05:01:30.356733+0000","last_peered":"2024-08-20T05:01:30.356733+0000","last_clean":"2024-08-20T05:01:30.356733+0000","last_became_active":"2024-08-20T04:59:12.783945+0000","last_became_peered":"2024-08-20T04:59:12.783945+0000","last_unstale":"2024-08-20T05:01:30.356733+0000","last_undegraded":"2024-08-20T05:01:30.356733+0000","last_fullsized":"2024-08-20T05:01:30.356733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:43:07.137543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343581+0000","last_change":"2024-08-20T04:59:09.751661+0000","last_active":"2024-08-20T05:01:30.343581+0000","last_peered":"2024-08-20T05:01:30.343581+0000","last_clean":"2024-08-20T05:01:30.343581+0000","last_became_active":"2024-08-20T04:59:09.751326+0000","last_became_peered":"2024-08-20T04:59:09.751326+0000","last_unstale":"2024-08-20T05:01:30.343581+0000","last_undegraded":"2024-08-20T05:01:30.343581+0000","last_fullsized":"2024-08-20T05:01:30.343581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:54.751929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356948+0000","last_change":"2024-08-20T04:59:21.913657+0000","last_active":"2024-08-20T05:01:30.356948+0000","last_peered":"2024-08-20T05:01:30.356948+0000","last_clean":"2024-08-20T05:01:30.356948+0000","last_became_active":"2024-08-20T04:59:21.913187+0000","last_became_peered":"2024-08-20T04:59:21.913187+0000","last_unstale":"2024-08-20T05:01:30.356948+0000","last_undegraded":"2024-08-20T05:01:30.356948+0000","last_fullsized":"2024-08-20T05:01:30.356948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:51:29.008810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339857+0000","last_change":"2024-08-20T04:59:12.780137+0000","last_active":"2024-08-20T05:01:30.339857+0000","last_peered":"2024-08-20T05:01:30.339857+0000","last_clean":"2024-08-20T05:01:30.339857+0000","last_became_active":"2024-08-20T04:59:12.779820+0000","last_became_peered":"2024-08-20T04:59:12.779820+0000","last_unstale":"2024-08-20T05:01:30.339857+0000","last_undegraded":"2024-08-20T05:01:30.339857+0000","last_fullsized":"2024-08-20T05:01:30.339857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:33:58.204255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356668+0000","last_change":"2024-08-20T04:59:09.750521+0000","last_active":"2024-08-20T05:01:30.356668+0000","last_peered":"2024-08-20T05:01:30.356668+0000","last_clean":"2024-08-20T05:01:30.356668+0000","last_became_active":"2024-08-20T04:59:09.750115+0000","last_became_peered":"2024-08-20T04:59:09.750115+0000","last_unstale":"2024-08-20T05:01:30.356668+0000","last_undegraded":"2024-08-20T05:01:30.356668+0000","last_fullsized":"2024-08-20T05:01:30.356668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:44:20.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342721+0000","last_change":"2024-08-20T04:59:21.910737+0000","last_active":"2024-08-20T05:01:30.342721+0000","last_peered":"2024-08-20T05:01:30.342721+0000","last_clean":"2024-08-20T05:01:30.342721+0000","last_became_active":"2024-08-20T04:59:21.910104+0000","last_became_peered":"2024-08-20T04:59:21.910104+0000","last_unstale":"2024-08-20T05:01:30.342721+0000","last_undegraded":"2024-08-20T05:01:30.342721+0000","last_fullsized":"2024-08-20T05:01:30.342721+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:17:40.436885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344499+0000","last_change":"2024-08-20T04:59:12.787285+0000","last_active":"2024-08-20T05:01:30.344499+0000","last_peered":"2024-08-20T05:01:30.344499+0000","last_clean":"2024-08-20T05:01:30.344499+0000","last_became_active":"2024-08-20T04:59:12.786998+0000","last_became_peered":"2024-08-20T04:59:12.786998+0000","last_unstale":"2024-08-20T05:01:30.344499+0000","last_undegraded":"2024-08-20T05:01:30.344499+0000","last_fullsized":"2024-08-20T05:01:30.344499+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:12:49.860291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356758+0000","last_change":"2024-08-20T04:59:09.947715+0000","last_active":"2024-08-20T05:01:30.356758+0000","last_peered":"2024-08-20T05:01:30.356758+0000","last_clean":"2024-08-20T05:01:30.356758+0000","last_became_active":"2024-08-20T04:59:09.947372+0000","last_became_peered":"2024-08-20T04:59:09.947372+0000","last_unstale":"2024-08-20T05:01:30.356758+0000","last_undegraded":"2024-08-20T05:01:30.356758+0000","last_fullsized":"2024-08-20T05:01:30.356758+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:42:04.352964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357308+0000","last_change":"2024-08-20T05:00:29.860562+0000","last_active":"2024-08-20T05:01:30.357308+0000","last_peered":"2024-08-20T05:01:30.357308+0000","last_clean":"2024-08-20T05:01:30.357308+0000","last_became_active":"2024-08-20T05:00:29.859944+0000","last_became_peered":"2024-08-20T05:00:29.859944+0000","last_unstale":"2024-08-20T05:01:30.357308+0000","last_undegraded":"2024-08-20T05:01:30.357308+0000","last_fullsized":"2024-08-20T05:01:30.357308+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:47.266712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338727+0000","last_change":"2024-08-20T04:59:12.785952+0000","last_active":"2024-08-20T05:01:30.338727+0000","last_peered":"2024-08-20T05:01:30.338727+0000","last_clean":"2024-08-20T05:01:30.338727+0000","last_became_active":"2024-08-20T04:59:12.785596+0000","last_became_peered":"2024-08-20T04:59:12.785596+0000","last_unstale":"2024-08-20T05:01:30.338727+0000","last_undegraded":"2024-08-20T05:01:30.338727+0000","last_fullsized":"2024-08-20T05:01:30.338727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:47.299560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356854+0000","last_change":"2024-08-20T04:59:09.964725+0000","last_active":"2024-08-20T05:01:30.356854+0000","last_peered":"2024-08-20T05:01:30.356854+0000","last_clean":"2024-08-20T05:01:30.356854+0000","last_became_active":"2024-08-20T04:59:09.964351+0000","last_became_peered":"2024-08-20T04:59:09.964351+0000","last_unstale":"2024-08-20T05:01:30.356854+0000","last_undegraded":"2024-08-20T05:01:30.356854+0000","last_fullsized":"2024-08-20T05:01:30.356854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:26:03.216378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344343+0000","last_change":"2024-08-20T04:59:21.898758+0000","last_active":"2024-08-20T05:01:30.344343+0000","last_peered":"2024-08-20T05:01:30.344343+0000","last_clean":"2024-08-20T05:01:30.344343+0000","last_became_active":"2024-08-20T04:59:21.898282+0000","last_became_peered":"2024-08-20T04:59:21.898282+0000","last_unstale":"2024-08-20T05:01:30.344343+0000","last_undegraded":"2024-08-20T05:01:30.344343+0000","last_fullsized":"2024-08-20T05:01:30.344343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:45:49.093459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357095+0000","last_change":"2024-08-20T04:59:12.793870+0000","last_active":"2024-08-20T05:01:30.357095+0000","last_peered":"2024-08-20T05:01:30.357095+0000","last_clean":"2024-08-20T05:01:30.357095+0000","last_became_active":"2024-08-20T04:59:12.792928+0000","last_became_peered":"2024-08-20T04:59:12.792928+0000","last_unstale":"2024-08-20T05:01:30.357095+0000","last_undegraded":"2024-08-20T05:01:30.357095+0000","last_fullsized":"2024-08-20T05:01:30.357095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:12:25.450347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'17","reported_seq":61,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343461+0000","last_change":"2024-08-20T04:59:09.751403+0000","last_active":"2024-08-20T05:01:30.343461+0000","last_peered":"2024-08-20T05:01:30.343461+0000","last_clean":"2024-08-20T05:01:30.343461+0000","last_became_active":"2024-08-20T04:59:09.750976+0000","last_became_peered":"2024-08-20T04:59:09.750976+0000","last_unstale":"2024-08-20T05:01:30.343461+0000","last_undegraded":"2024-08-20T05:01:30.343461+0000","last_fullsized":"2024-08-20T05:01:30.343461+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:58:54.627836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356432+0000","last_change":"2024-08-20T04:59:21.899813+0000","last_active":"2024-08-20T05:01:30.356432+0000","last_peered":"2024-08-20T05:01:30.356432+0000","last_clean":"2024-08-20T05:01:30.356432+0000","last_became_active":"2024-08-20T04:59:21.899462+0000","last_became_peered":"2024-08-20T04:59:21.899462+0000","last_unstale":"2024-08-20T05:01:30.356432+0000","last_undegraded":"2024-08-20T05:01:30.356432+0000","last_fullsized":"2024-08-20T05:01:30.356432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.468845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355826+0000","last_change":"2024-08-20T04:59:12.783953+0000","last_active":"2024-08-20T05:01:30.355826+0000","last_peered":"2024-08-20T05:01:30.355826+0000","last_clean":"2024-08-20T05:01:30.355826+0000","last_became_active":"2024-08-20T04:59:12.781445+0000","last_became_peered":"2024-08-20T04:59:12.781445+0000","last_unstale":"2024-08-20T05:01:30.355826+0000","last_undegraded":"2024-08-20T05:01:30.355826+0000","last_fullsized":"2024-08-20T05:01:30.355826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:04.792064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356223+0000","last_change":"2024-08-20T05:01:30.355578+0000","last_active":"2024-08-20T05:01:30.356223+0000","last_peered":"2024-08-20T05:01:30.356223+0000","last_clean":"2024-08-20T05:01:30.356223+0000","last_became_active":"2024-08-20T05:01:30.349099+0000","last_became_peered":"2024-08-20T05:01:30.349099+0000","last_unstale":"2024-08-20T05:01:30.356223+0000","last_undegraded":"2024-08-20T05:01:30.356223+0000","last_fullsized":"2024-08-20T05:01:30.356223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:17:57.165914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339956+0000","last_change":"2024-08-20T04:59:21.905202+0000","last_active":"2024-08-20T05:01:30.339956+0000","last_peered":"2024-08-20T05:01:30.339956+0000","last_clean":"2024-08-20T05:01:30.339956+0000","last_became_active":"2024-08-20T04:59:21.904771+0000","last_became_peered":"2024-08-20T04:59:21.904771+0000","last_unstale":"2024-08-20T05:01:30.339956+0000","last_undegraded":"2024-08-20T05:01:30.339956+0000","last_fullsized":"2024-08-20T05:01:30.339956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:35:56.887981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"86'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356122+0000","last_change":"2024-08-20T04:59:12.798301+0000","last_active":"2024-08-20T05:01:30.356122+0000","last_peered":"2024-08-20T05:01:30.356122+0000","last_clean":"2024-08-20T05:01:30.356122+0000","last_became_active":"2024-08-20T04:59:12.797934+0000","last_became_peered":"2024-08-20T04:59:12.797934+0000","last_unstale":"2024-08-20T05:01:30.356122+0000","last_undegraded":"2024-08-20T05:01:30.356122+0000","last_fullsized":"2024-08-20T05:01:30.356122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:41:24.465380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343575+0000","last_change":"2024-08-20T04:59:09.947602+0000","last_active":"2024-08-20T05:01:30.343575+0000","last_peered":"2024-08-20T05:01:30.343575+0000","last_clean":"2024-08-20T05:01:30.343575+0000","last_became_active":"2024-08-20T04:59:09.946795+0000","last_became_peered":"2024-08-20T04:59:09.946795+0000","last_unstale":"2024-08-20T05:01:30.343575+0000","last_undegraded":"2024-08-20T05:01:30.343575+0000","last_fullsized":"2024-08-20T05:01:30.343575+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:09:09.003266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344130+0000","last_change":"2024-08-20T05:00:29.860828+0000","last_active":"2024-08-20T05:01:30.344130+0000","last_peered":"2024-08-20T05:01:30.344130+0000","last_clean":"2024-08-20T05:01:30.344130+0000","last_became_active":"2024-08-20T05:00:29.860242+0000","last_became_peered":"2024-08-20T05:00:29.860242+0000","last_unstale":"2024-08-20T05:01:30.344130+0000","last_undegraded":"2024-08-20T05:01:30.344130+0000","last_fullsized":"2024-08-20T05:01:30.344130+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:09:42.311207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356682+0000","last_change":"2024-08-20T04:59:12.784852+0000","last_active":"2024-08-20T05:01:30.356682+0000","last_peered":"2024-08-20T05:01:30.356682+0000","last_clean":"2024-08-20T05:01:30.356682+0000","last_became_active":"2024-08-20T04:59:12.784496+0000","last_became_peered":"2024-08-20T04:59:12.784496+0000","last_unstale":"2024-08-20T05:01:30.356682+0000","last_undegraded":"2024-08-20T05:01:30.356682+0000","last_fullsized":"2024-08-20T05:01:30.356682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:41:42.421383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":178,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:12.346358+0000","last_change":"2024-08-20T04:59:09.750785+0000","last_active":"2024-08-20T05:02:12.346358+0000","last_peered":"2024-08-20T05:02:12.346358+0000","last_clean":"2024-08-20T05:02:12.346358+0000","last_became_active":"2024-08-20T04:59:09.750255+0000","last_became_peered":"2024-08-20T04:59:09.750255+0000","last_unstale":"2024-08-20T05:02:12.346358+0000","last_undegraded":"2024-08-20T05:02:12.346358+0000","last_fullsized":"2024-08-20T05:02:12.346358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:20:17.900367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355715+0000","last_change":"2024-08-20T04:59:21.909409+0000","last_active":"2024-08-20T05:01:30.355715+0000","last_peered":"2024-08-20T05:01:30.355715+0000","last_clean":"2024-08-20T05:01:30.355715+0000","last_became_active":"2024-08-20T04:59:21.907934+0000","last_became_peered":"2024-08-20T04:59:21.907934+0000","last_unstale":"2024-08-20T05:01:30.355715+0000","last_undegraded":"2024-08-20T05:01:30.355715+0000","last_fullsized":"2024-08-20T05:01:30.355715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:26:36.768407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355879+0000","last_change":"2024-08-20T04:59:12.783496+0000","last_active":"2024-08-20T05:01:30.355879+0000","last_peered":"2024-08-20T05:01:30.355879+0000","last_clean":"2024-08-20T05:01:30.355879+0000","last_became_active":"2024-08-20T04:59:12.783211+0000","last_became_peered":"2024-08-20T04:59:12.783211+0000","last_unstale":"2024-08-20T05:01:30.355879+0000","last_undegraded":"2024-08-20T05:01:30.355879+0000","last_fullsized":"2024-08-20T05:01:30.355879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:45:49.514189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":176,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:08.342828+0000","last_change":"2024-08-20T04:59:09.948284+0000","last_active":"2024-08-20T05:02:08.342828+0000","last_peered":"2024-08-20T05:02:08.342828+0000","last_clean":"2024-08-20T05:02:08.342828+0000","last_became_active":"2024-08-20T04:59:09.947909+0000","last_became_peered":"2024-08-20T04:59:09.947909+0000","last_unstale":"2024-08-20T05:02:08.342828+0000","last_undegraded":"2024-08-20T05:02:08.342828+0000","last_fullsized":"2024-08-20T05:02:08.342828+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:24:04.344380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":125,"num_read_kb":125,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356288+0000","last_change":"2024-08-20T04:59:21.905282+0000","last_active":"2024-08-20T05:01:30.356288+0000","last_peered":"2024-08-20T05:01:30.356288+0000","last_clean":"2024-08-20T05:01:30.356288+0000","last_became_active":"2024-08-20T04:59:21.904842+0000","last_became_peered":"2024-08-20T04:59:21.904842+0000","last_unstale":"2024-08-20T05:01:30.356288+0000","last_undegraded":"2024-08-20T05:01:30.356288+0000","last_fullsized":"2024-08-20T05:01:30.356288+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:01:19.949949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355357+0000","last_change":"2024-08-20T04:59:12.788571+0000","last_active":"2024-08-20T05:01:30.355357+0000","last_peered":"2024-08-20T05:01:30.355357+0000","last_clean":"2024-08-20T05:01:30.355357+0000","last_became_active":"2024-08-20T04:59:12.784148+0000","last_became_peered":"2024-08-20T04:59:12.784148+0000","last_unstale":"2024-08-20T05:01:30.355357+0000","last_undegraded":"2024-08-20T05:01:30.355357+0000","last_fullsized":"2024-08-20T05:01:30.355357+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:10:51.565404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340278+0000","last_change":"2024-08-20T04:59:09.753842+0000","last_active":"2024-08-20T05:01:30.340278+0000","last_peered":"2024-08-20T05:01:30.340278+0000","last_clean":"2024-08-20T05:01:30.340278+0000","last_became_active":"2024-08-20T04:59:09.753439+0000","last_became_peered":"2024-08-20T04:59:09.753439+0000","last_unstale":"2024-08-20T05:01:30.340278+0000","last_undegraded":"2024-08-20T05:01:30.340278+0000","last_fullsized":"2024-08-20T05:01:30.340278+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:54.171964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356341+0000","last_change":"2024-08-20T04:59:21.909621+0000","last_active":"2024-08-20T05:01:30.356341+0000","last_peered":"2024-08-20T05:01:30.356341+0000","last_clean":"2024-08-20T05:01:30.356341+0000","last_became_active":"2024-08-20T04:59:21.909239+0000","last_became_peered":"2024-08-20T04:59:21.909239+0000","last_unstale":"2024-08-20T05:01:30.356341+0000","last_undegraded":"2024-08-20T05:01:30.356341+0000","last_fullsized":"2024-08-20T05:01:30.356341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:53:15.131163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356523+0000","last_change":"2024-08-20T04:59:12.796643+0000","last_active":"2024-08-20T05:01:30.356523+0000","last_peered":"2024-08-20T05:01:30.356523+0000","last_clean":"2024-08-20T05:01:30.356523+0000","last_became_active":"2024-08-20T04:59:12.796262+0000","last_became_peered":"2024-08-20T04:59:12.796262+0000","last_unstale":"2024-08-20T05:01:30.356523+0000","last_undegraded":"2024-08-20T05:01:30.356523+0000","last_fullsized":"2024-08-20T05:01:30.356523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:11:37.792359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357176+0000","last_change":"2024-08-20T04:59:09.750550+0000","last_active":"2024-08-20T05:01:30.357176+0000","last_peered":"2024-08-20T05:01:30.357176+0000","last_clean":"2024-08-20T05:01:30.357176+0000","last_became_active":"2024-08-20T04:59:09.750097+0000","last_became_peered":"2024-08-20T04:59:09.750097+0000","last_unstale":"2024-08-20T05:01:30.357176+0000","last_undegraded":"2024-08-20T05:01:30.357176+0000","last_fullsized":"2024-08-20T05:01:30.357176+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:32:22.826478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340442+0000","last_change":"2024-08-20T04:57:50.824023+0000","last_active":"2024-08-20T05:01:30.340442+0000","last_peered":"2024-08-20T05:01:30.340442+0000","last_clean":"2024-08-20T05:01:30.340442+0000","last_became_active":"2024-08-20T04:57:50.350587+0000","last_became_peered":"2024-08-20T04:57:50.350587+0000","last_unstale":"2024-08-20T05:01:30.340442+0000","last_undegraded":"2024-08-20T05:01:30.340442+0000","last_fullsized":"2024-08-20T05:01:30.340442+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_clean_scrub_stamp":"2024-08-20T04:54:17.224468+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:59:23.450117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340604+0000","last_change":"2024-08-20T05:00:29.866063+0000","last_active":"2024-08-20T05:01:30.340604+0000","last_peered":"2024-08-20T05:01:30.340604+0000","last_clean":"2024-08-20T05:01:30.340604+0000","last_became_active":"2024-08-20T05:00:29.861545+0000","last_became_peered":"2024-08-20T05:00:29.861545+0000","last_unstale":"2024-08-20T05:01:30.340604+0000","last_undegraded":"2024-08-20T05:01:30.340604+0000","last_fullsized":"2024-08-20T05:01:30.340604+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:02:18.516044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.341028+0000","last_change":"2024-08-20T04:59:12.793799+0000","last_active":"2024-08-20T05:01:30.341028+0000","last_peered":"2024-08-20T05:01:30.341028+0000","last_clean":"2024-08-20T05:01:30.341028+0000","last_became_active":"2024-08-20T04:59:12.793487+0000","last_became_peered":"2024-08-20T04:59:12.793487+0000","last_unstale":"2024-08-20T05:01:30.341028+0000","last_undegraded":"2024-08-20T05:01:30.341028+0000","last_fullsized":"2024-08-20T05:01:30.341028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:08:30.835824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'7","reported_seq":181,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:10.374561+0000","last_change":"2024-08-20T04:59:09.964586+0000","last_active":"2024-08-20T05:02:10.374561+0000","last_peered":"2024-08-20T05:02:10.374561+0000","last_clean":"2024-08-20T05:02:10.374561+0000","last_became_active":"2024-08-20T04:59:09.964258+0000","last_became_peered":"2024-08-20T04:59:09.964258+0000","last_unstale":"2024-08-20T05:02:10.374561+0000","last_undegraded":"2024-08-20T05:02:10.374561+0000","last_fullsized":"2024-08-20T05:02:10.374561+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:37:48.138019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":130,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357127+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T05:01:30.357127+0000","last_peered":"2024-08-20T05:01:30.357127+0000","last_clean":"2024-08-20T05:01:30.357127+0000","last_became_active":"2024-08-20T04:59:21.906197+0000","last_became_peered":"2024-08-20T04:59:21.906197+0000","last_unstale":"2024-08-20T05:01:30.357127+0000","last_undegraded":"2024-08-20T05:01:30.357127+0000","last_fullsized":"2024-08-20T05:01:30.357127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:10:45.819035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340707+0000","last_change":"2024-08-20T04:59:12.794221+0000","last_active":"2024-08-20T05:01:30.340707+0000","last_peered":"2024-08-20T05:01:30.340707+0000","last_clean":"2024-08-20T05:01:30.340707+0000","last_became_active":"2024-08-20T04:59:12.793680+0000","last_became_peered":"2024-08-20T04:59:12.793680+0000","last_unstale":"2024-08-20T05:01:30.340707+0000","last_undegraded":"2024-08-20T05:01:30.340707+0000","last_fullsized":"2024-08-20T05:01:30.340707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:45.435700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356414+0000","last_change":"2024-08-20T04:59:09.755955+0000","last_active":"2024-08-20T05:01:30.356414+0000","last_peered":"2024-08-20T05:01:30.356414+0000","last_clean":"2024-08-20T05:01:30.356414+0000","last_became_active":"2024-08-20T04:59:09.755614+0000","last_became_peered":"2024-08-20T04:59:09.755614+0000","last_unstale":"2024-08-20T05:01:30.356414+0000","last_undegraded":"2024-08-20T05:01:30.356414+0000","last_fullsized":"2024-08-20T05:01:30.356414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:15:06.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338518+0000","last_change":"2024-08-20T04:59:21.915952+0000","last_active":"2024-08-20T05:01:30.338518+0000","last_peered":"2024-08-20T05:01:30.338518+0000","last_clean":"2024-08-20T05:01:30.338518+0000","last_became_active":"2024-08-20T04:59:21.915533+0000","last_became_peered":"2024-08-20T04:59:21.915533+0000","last_unstale":"2024-08-20T05:01:30.338518+0000","last_undegraded":"2024-08-20T05:01:30.338518+0000","last_fullsized":"2024-08-20T05:01:30.338518+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:52:54.906061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340713+0000","last_change":"2024-08-20T04:59:12.782663+0000","last_active":"2024-08-20T05:01:30.340713+0000","last_peered":"2024-08-20T05:01:30.340713+0000","last_clean":"2024-08-20T05:01:30.340713+0000","last_became_active":"2024-08-20T04:59:12.782068+0000","last_became_peered":"2024-08-20T04:59:12.782068+0000","last_unstale":"2024-08-20T05:01:30.340713+0000","last_undegraded":"2024-08-20T05:01:30.340713+0000","last_fullsized":"2024-08-20T05:01:30.340713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:46:39.662033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356158+0000","last_change":"2024-08-20T04:59:09.747456+0000","last_active":"2024-08-20T05:01:30.356158+0000","last_peered":"2024-08-20T05:01:30.356158+0000","last_clean":"2024-08-20T05:01:30.356158+0000","last_became_active":"2024-08-20T04:59:09.747141+0000","last_became_peered":"2024-08-20T04:59:09.747141+0000","last_unstale":"2024-08-20T05:01:30.356158+0000","last_undegraded":"2024-08-20T05:01:30.356158+0000","last_fullsized":"2024-08-20T05:01:30.356158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:39:01.600831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355926+0000","last_change":"2024-08-20T04:59:21.898059+0000","last_active":"2024-08-20T05:01:30.355926+0000","last_peered":"2024-08-20T05:01:30.355926+0000","last_clean":"2024-08-20T05:01:30.355926+0000","last_became_active":"2024-08-20T04:59:21.897617+0000","last_became_peered":"2024-08-20T04:59:21.897617+0000","last_unstale":"2024-08-20T05:01:30.355926+0000","last_undegraded":"2024-08-20T05:01:30.355926+0000","last_fullsized":"2024-08-20T05:01:30.355926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:53:21.122106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340301+0000","last_change":"2024-08-20T05:00:29.372299+0000","last_active":"2024-08-20T05:01:30.340301+0000","last_peered":"2024-08-20T05:01:30.340301+0000","last_clean":"2024-08-20T05:01:30.340301+0000","last_became_active":"2024-08-20T05:00:29.371959+0000","last_became_peered":"2024-08-20T05:00:29.371959+0000","last_unstale":"2024-08-20T05:01:30.340301+0000","last_undegraded":"2024-08-20T05:01:30.340301+0000","last_fullsized":"2024-08-20T05:01:30.340301+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:03.996267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343839+0000","last_change":"2024-08-20T04:59:09.751943+0000","last_active":"2024-08-20T05:01:30.343839+0000","last_peered":"2024-08-20T05:01:30.343839+0000","last_clean":"2024-08-20T05:01:30.343839+0000","last_became_active":"2024-08-20T04:59:09.751586+0000","last_became_peered":"2024-08-20T04:59:09.751586+0000","last_unstale":"2024-08-20T05:01:30.343839+0000","last_undegraded":"2024-08-20T05:01:30.343839+0000","last_fullsized":"2024-08-20T05:01:30.343839+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:35:03.400574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355994+0000","last_change":"2024-08-20T04:59:21.901315+0000","last_active":"2024-08-20T05:01:30.355994+0000","last_peered":"2024-08-20T05:01:30.355994+0000","last_clean":"2024-08-20T05:01:30.355994+0000","last_became_active":"2024-08-20T04:59:21.900871+0000","last_became_peered":"2024-08-20T04:59:21.900871+0000","last_unstale":"2024-08-20T05:01:30.355994+0000","last_undegraded":"2024-08-20T05:01:30.355994+0000","last_fullsized":"2024-08-20T05:01:30.355994+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:39:30.940409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355957+0000","last_change":"2024-08-20T04:59:12.793140+0000","last_active":"2024-08-20T05:01:30.355957+0000","last_peered":"2024-08-20T05:01:30.355957+0000","last_clean":"2024-08-20T05:01:30.355957+0000","last_became_active":"2024-08-20T04:59:12.792678+0000","last_became_peered":"2024-08-20T04:59:12.792678+0000","last_unstale":"2024-08-20T05:01:30.355957+0000","last_undegraded":"2024-08-20T05:01:30.355957+0000","last_fullsized":"2024-08-20T05:01:30.355957+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:07:05.610634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342165+0000","last_change":"2024-08-20T04:59:09.946158+0000","last_active":"2024-08-20T05:01:30.342165+0000","last_peered":"2024-08-20T05:01:30.342165+0000","last_clean":"2024-08-20T05:01:30.342165+0000","last_became_active":"2024-08-20T04:59:09.945736+0000","last_became_peered":"2024-08-20T04:59:09.945736+0000","last_unstale":"2024-08-20T05:01:30.342165+0000","last_undegraded":"2024-08-20T05:01:30.342165+0000","last_fullsized":"2024-08-20T05:01:30.342165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:02.759879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356102+0000","last_change":"2024-08-20T04:59:21.913457+0000","last_active":"2024-08-20T05:01:30.356102+0000","last_peered":"2024-08-20T05:01:30.356102+0000","last_clean":"2024-08-20T05:01:30.356102+0000","last_became_active":"2024-08-20T04:59:21.910468+0000","last_became_peered":"2024-08-20T04:59:21.910468+0000","last_unstale":"2024-08-20T05:01:30.356102+0000","last_undegraded":"2024-08-20T05:01:30.356102+0000","last_fullsized":"2024-08-20T05:01:30.356102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:16:30.817166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340293+0000","last_change":"2024-08-20T04:59:12.788088+0000","last_active":"2024-08-20T05:01:30.340293+0000","last_peered":"2024-08-20T05:01:30.340293+0000","last_clean":"2024-08-20T05:01:30.340293+0000","last_became_active":"2024-08-20T04:59:12.787756+0000","last_became_peered":"2024-08-20T04:59:12.787756+0000","last_unstale":"2024-08-20T05:01:30.340293+0000","last_undegraded":"2024-08-20T05:01:30.340293+0000","last_fullsized":"2024-08-20T05:01:30.340293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:51.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'7","reported_seq":184,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:12.348516+0000","last_change":"2024-08-20T04:59:09.746896+0000","last_active":"2024-08-20T05:02:12.348516+0000","last_peered":"2024-08-20T05:02:12.348516+0000","last_clean":"2024-08-20T05:02:12.348516+0000","last_became_active":"2024-08-20T04:59:09.746570+0000","last_became_peered":"2024-08-20T04:59:09.746570+0000","last_unstale":"2024-08-20T05:02:12.348516+0000","last_undegraded":"2024-08-20T05:02:12.348516+0000","last_fullsized":"2024-08-20T05:02:12.348516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:06:02.395260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":133,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342767+0000","last_change":"2024-08-20T04:59:21.911747+0000","last_active":"2024-08-20T05:01:30.342767+0000","last_peered":"2024-08-20T05:01:30.342767+0000","last_clean":"2024-08-20T05:01:30.342767+0000","last_became_active":"2024-08-20T04:59:21.908861+0000","last_became_peered":"2024-08-20T04:59:21.908861+0000","last_unstale":"2024-08-20T05:01:30.342767+0000","last_undegraded":"2024-08-20T05:01:30.342767+0000","last_fullsized":"2024-08-20T05:01:30.342767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:22:17.336776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340612+0000","last_change":"2024-08-20T05:00:29.860903+0000","last_active":"2024-08-20T05:01:30.340612+0000","last_peered":"2024-08-20T05:01:30.340612+0000","last_clean":"2024-08-20T05:01:30.340612+0000","last_became_active":"2024-08-20T05:00:29.860359+0000","last_became_peered":"2024-08-20T05:00:29.860359+0000","last_unstale":"2024-08-20T05:01:30.340612+0000","last_undegraded":"2024-08-20T05:01:30.340612+0000","last_fullsized":"2024-08-20T05:01:30.340612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:27:02.976859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355985+0000","last_change":"2024-08-20T04:59:09.755225+0000","last_active":"2024-08-20T05:01:30.355985+0000","last_peered":"2024-08-20T05:01:30.355985+0000","last_clean":"2024-08-20T05:01:30.355985+0000","last_became_active":"2024-08-20T04:59:09.754580+0000","last_became_peered":"2024-08-20T04:59:09.754580+0000","last_unstale":"2024-08-20T05:01:30.355985+0000","last_undegraded":"2024-08-20T05:01:30.355985+0000","last_fullsized":"2024-08-20T05:01:30.355985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:54:53.606954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340025+0000","last_change":"2024-08-20T04:59:21.905200+0000","last_active":"2024-08-20T05:01:30.340025+0000","last_peered":"2024-08-20T05:01:30.340025+0000","last_clean":"2024-08-20T05:01:30.340025+0000","last_became_active":"2024-08-20T04:59:21.904724+0000","last_became_peered":"2024-08-20T04:59:21.904724+0000","last_unstale":"2024-08-20T05:01:30.340025+0000","last_undegraded":"2024-08-20T05:01:30.340025+0000","last_fullsized":"2024-08-20T05:01:30.340025+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:50:43.446750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355643+0000","last_change":"2024-08-20T04:59:12.787261+0000","last_active":"2024-08-20T05:01:30.355643+0000","last_peered":"2024-08-20T05:01:30.355643+0000","last_clean":"2024-08-20T05:01:30.355643+0000","last_became_active":"2024-08-20T04:59:12.786971+0000","last_became_peered":"2024-08-20T04:59:12.786971+0000","last_unstale":"2024-08-20T05:01:30.355643+0000","last_undegraded":"2024-08-20T05:01:30.355643+0000","last_fullsized":"2024-08-20T05:01:30.355643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:55:57.209321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343535+0000","last_change":"2024-08-20T04:59:09.749147+0000","last_active":"2024-08-20T05:01:30.343535+0000","last_peered":"2024-08-20T05:01:30.343535+0000","last_clean":"2024-08-20T05:01:30.343535+0000","last_became_active":"2024-08-20T04:59:09.748806+0000","last_became_peered":"2024-08-20T04:59:09.748806+0000","last_unstale":"2024-08-20T05:01:30.343535+0000","last_undegraded":"2024-08-20T05:01:30.343535+0000","last_fullsized":"2024-08-20T05:01:30.343535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:59:43.377105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356203+0000","last_change":"2024-08-20T04:59:21.905007+0000","last_active":"2024-08-20T05:01:30.356203+0000","last_peered":"2024-08-20T05:01:30.356203+0000","last_clean":"2024-08-20T05:01:30.356203+0000","last_became_active":"2024-08-20T04:59:21.904608+0000","last_became_peered":"2024-08-20T04:59:21.904608+0000","last_unstale":"2024-08-20T05:01:30.356203+0000","last_undegraded":"2024-08-20T05:01:30.356203+0000","last_fullsized":"2024-08-20T05:01:30.356203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:00:42.390966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342457+0000","last_change":"2024-08-20T04:59:12.783339+0000","last_active":"2024-08-20T05:01:30.342457+0000","last_peered":"2024-08-20T05:01:30.342457+0000","last_clean":"2024-08-20T05:01:30.342457+0000","last_became_active":"2024-08-20T04:59:12.783051+0000","last_became_peered":"2024-08-20T04:59:12.783051+0000","last_unstale":"2024-08-20T05:01:30.342457+0000","last_undegraded":"2024-08-20T05:01:30.342457+0000","last_fullsized":"2024-08-20T05:01:30.342457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:23:54.390491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'42","reported_seq":355,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:13.517451+0000","last_change":"2024-08-20T04:59:09.754340+0000","last_active":"2024-08-20T05:02:13.517451+0000","last_peered":"2024-08-20T05:02:13.517451+0000","last_clean":"2024-08-20T05:02:13.517451+0000","last_became_active":"2024-08-20T04:59:09.754000+0000","last_became_peered":"2024-08-20T04:59:09.754000+0000","last_unstale":"2024-08-20T05:02:13.517451+0000","last_undegraded":"2024-08-20T05:02:13.517451+0000","last_fullsized":"2024-08-20T05:02:13.517451+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:26:17.256961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69413,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":268,"num_read_kb":203,"num_write":44,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342495+0000","last_change":"2024-08-20T04:59:21.910369+0000","last_active":"2024-08-20T05:01:30.342495+0000","last_peered":"2024-08-20T05:01:30.342495+0000","last_clean":"2024-08-20T05:01:30.342495+0000","last_became_active":"2024-08-20T04:59:21.909941+0000","last_became_peered":"2024-08-20T04:59:21.909941+0000","last_unstale":"2024-08-20T05:01:30.342495+0000","last_undegraded":"2024-08-20T05:01:30.342495+0000","last_fullsized":"2024-08-20T05:01:30.342495+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:27:07.088021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356969+0000","last_change":"2024-08-20T04:59:12.787747+0000","last_active":"2024-08-20T05:01:30.356969+0000","last_peered":"2024-08-20T05:01:30.356969+0000","last_clean":"2024-08-20T05:01:30.356969+0000","last_became_active":"2024-08-20T04:59:12.786962+0000","last_became_peered":"2024-08-20T04:59:12.786962+0000","last_unstale":"2024-08-20T05:01:30.356969+0000","last_undegraded":"2024-08-20T05:01:30.356969+0000","last_fullsized":"2024-08-20T05:01:30.356969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:14:43.822829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356420+0000","last_change":"2024-08-20T04:59:09.947582+0000","last_active":"2024-08-20T05:01:30.356420+0000","last_peered":"2024-08-20T05:01:30.356420+0000","last_clean":"2024-08-20T05:01:30.356420+0000","last_became_active":"2024-08-20T04:59:09.947117+0000","last_became_peered":"2024-08-20T04:59:09.947117+0000","last_unstale":"2024-08-20T05:01:30.356420+0000","last_undegraded":"2024-08-20T05:01:30.356420+0000","last_fullsized":"2024-08-20T05:01:30.356420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:22:05.815486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357390+0000","last_change":"2024-08-20T04:59:21.910776+0000","last_active":"2024-08-20T05:01:30.357390+0000","last_peered":"2024-08-20T05:01:30.357390+0000","last_clean":"2024-08-20T05:01:30.357390+0000","last_became_active":"2024-08-20T04:59:21.909726+0000","last_became_peered":"2024-08-20T04:59:21.909726+0000","last_unstale":"2024-08-20T05:01:30.357390+0000","last_undegraded":"2024-08-20T05:01:30.357390+0000","last_fullsized":"2024-08-20T05:01:30.357390+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:03:04.042649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338903+0000","last_change":"2024-08-20T05:00:29.860637+0000","last_active":"2024-08-20T05:01:30.338903+0000","last_peered":"2024-08-20T05:01:30.338903+0000","last_clean":"2024-08-20T05:01:30.338903+0000","last_became_active":"2024-08-20T05:00:29.860250+0000","last_became_peered":"2024-08-20T05:00:29.860250+0000","last_unstale":"2024-08-20T05:01:30.338903+0000","last_undegraded":"2024-08-20T05:01:30.338903+0000","last_fullsized":"2024-08-20T05:01:30.338903+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:11:27.937844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340908+0000","last_change":"2024-08-20T04:59:09.747316+0000","last_active":"2024-08-20T05:01:30.340908+0000","last_peered":"2024-08-20T05:01:30.340908+0000","last_clean":"2024-08-20T05:01:30.340908+0000","last_became_active":"2024-08-20T04:59:09.746959+0000","last_became_peered":"2024-08-20T04:59:09.746959+0000","last_unstale":"2024-08-20T05:01:30.340908+0000","last_undegraded":"2024-08-20T05:01:30.340908+0000","last_fullsized":"2024-08-20T05:01:30.340908+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:28.480465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342302+0000","last_change":"2024-08-20T04:59:21.907940+0000","last_active":"2024-08-20T05:01:30.342302+0000","last_peered":"2024-08-20T05:01:30.342302+0000","last_clean":"2024-08-20T05:01:30.342302+0000","last_became_active":"2024-08-20T04:59:21.907591+0000","last_became_peered":"2024-08-20T04:59:21.907591+0000","last_unstale":"2024-08-20T05:01:30.342302+0000","last_undegraded":"2024-08-20T05:01:30.342302+0000","last_fullsized":"2024-08-20T05:01:30.342302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:33.583556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357523+0000","last_change":"2024-08-20T04:59:12.795662+0000","last_active":"2024-08-20T05:01:30.357523+0000","last_peered":"2024-08-20T05:01:30.357523+0000","last_clean":"2024-08-20T05:01:30.357523+0000","last_became_active":"2024-08-20T04:59:12.795321+0000","last_became_peered":"2024-08-20T04:59:12.795321+0000","last_unstale":"2024-08-20T05:01:30.357523+0000","last_undegraded":"2024-08-20T05:01:30.357523+0000","last_fullsized":"2024-08-20T05:01:30.357523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:40:30.561306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'5","reported_seq":306,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:13.378550+0000","last_change":"2024-08-20T04:59:09.754468+0000","last_active":"2024-08-20T05:02:13.378550+0000","last_peered":"2024-08-20T05:02:13.378550+0000","last_clean":"2024-08-20T05:02:13.378550+0000","last_became_active":"2024-08-20T04:59:09.754115+0000","last_became_peered":"2024-08-20T04:59:09.754115+0000","last_unstale":"2024-08-20T05:02:13.378550+0000","last_undegraded":"2024-08-20T05:02:13.378550+0000","last_fullsized":"2024-08-20T05:02:13.378550+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:50:21.301246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":256,"num_read_kb":256,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356257+0000","last_change":"2024-08-20T04:59:21.898785+0000","last_active":"2024-08-20T05:01:30.356257+0000","last_peered":"2024-08-20T05:01:30.356257+0000","last_clean":"2024-08-20T05:01:30.356257+0000","last_became_active":"2024-08-20T04:59:21.898423+0000","last_became_peered":"2024-08-20T04:59:21.898423+0000","last_unstale":"2024-08-20T05:01:30.356257+0000","last_undegraded":"2024-08-20T05:01:30.356257+0000","last_fullsized":"2024-08-20T05:01:30.356257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:52:58.800104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338624+0000","last_change":"2024-08-20T04:59:21.906208+0000","last_active":"2024-08-20T05:01:30.338624+0000","last_peered":"2024-08-20T05:01:30.338624+0000","last_clean":"2024-08-20T05:01:30.338624+0000","last_became_active":"2024-08-20T04:59:21.905041+0000","last_became_peered":"2024-08-20T04:59:21.905041+0000","last_unstale":"2024-08-20T05:01:30.338624+0000","last_undegraded":"2024-08-20T05:01:30.338624+0000","last_fullsized":"2024-08-20T05:01:30.338624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:05:28.971357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342413+0000","last_change":"2024-08-20T04:59:12.788130+0000","last_active":"2024-08-20T05:01:30.342413+0000","last_peered":"2024-08-20T05:01:30.342413+0000","last_clean":"2024-08-20T05:01:30.342413+0000","last_became_active":"2024-08-20T04:59:12.787665+0000","last_became_peered":"2024-08-20T04:59:12.787665+0000","last_unstale":"2024-08-20T05:01:30.342413+0000","last_undegraded":"2024-08-20T05:01:30.342413+0000","last_fullsized":"2024-08-20T05:01:30.342413+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:59:39.628781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356172+0000","last_change":"2024-08-20T04:59:09.754842+0000","last_active":"2024-08-20T05:01:30.356172+0000","last_peered":"2024-08-20T05:01:30.356172+0000","last_clean":"2024-08-20T05:01:30.356172+0000","last_became_active":"2024-08-20T04:59:09.754515+0000","last_became_peered":"2024-08-20T04:59:09.754515+0000","last_unstale":"2024-08-20T05:01:30.356172+0000","last_undegraded":"2024-08-20T05:01:30.356172+0000","last_fullsized":"2024-08-20T05:01:30.356172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:19:02.241567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340312+0000","last_change":"2024-08-20T04:59:21.900610+0000","last_active":"2024-08-20T05:01:30.340312+0000","last_peered":"2024-08-20T05:01:30.340312+0000","last_clean":"2024-08-20T05:01:30.340312+0000","last_became_active":"2024-08-20T04:59:21.900207+0000","last_became_peered":"2024-08-20T04:59:21.900207+0000","last_unstale":"2024-08-20T05:01:30.340312+0000","last_undegraded":"2024-08-20T05:01:30.340312+0000","last_fullsized":"2024-08-20T05:01:30.340312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:41:00.115344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356667+0000","last_change":"2024-08-20T04:59:12.780772+0000","last_active":"2024-08-20T05:01:30.356667+0000","last_peered":"2024-08-20T05:01:30.356667+0000","last_clean":"2024-08-20T05:01:30.356667+0000","last_became_active":"2024-08-20T04:59:12.780385+0000","last_became_peered":"2024-08-20T04:59:12.780385+0000","last_unstale":"2024-08-20T05:01:30.356667+0000","last_undegraded":"2024-08-20T05:01:30.356667+0000","last_fullsized":"2024-08-20T05:01:30.356667+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:23.680899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355522+0000","last_change":"2024-08-20T04:59:09.749567+0000","last_active":"2024-08-20T05:01:30.355522+0000","last_peered":"2024-08-20T05:01:30.355522+0000","last_clean":"2024-08-20T05:01:30.355522+0000","last_became_active":"2024-08-20T04:59:09.749204+0000","last_became_peered":"2024-08-20T04:59:09.749204+0000","last_unstale":"2024-08-20T05:01:30.355522+0000","last_undegraded":"2024-08-20T05:01:30.355522+0000","last_fullsized":"2024-08-20T05:01:30.355522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:57:51.236459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356327+0000","last_change":"2024-08-20T04:59:09.751622+0000","last_active":"2024-08-20T05:01:30.356327+0000","last_peered":"2024-08-20T05:01:30.356327+0000","last_clean":"2024-08-20T05:01:30.356327+0000","last_became_active":"2024-08-20T04:59:09.751227+0000","last_became_peered":"2024-08-20T04:59:09.751227+0000","last_unstale":"2024-08-20T05:01:30.356327+0000","last_undegraded":"2024-08-20T05:01:30.356327+0000","last_fullsized":"2024-08-20T05:01:30.356327+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:53:38.755122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356190+0000","last_change":"2024-08-20T04:59:12.789243+0000","last_active":"2024-08-20T05:01:30.356190+0000","last_peered":"2024-08-20T05:01:30.356190+0000","last_clean":"2024-08-20T05:01:30.356190+0000","last_became_active":"2024-08-20T04:59:12.788932+0000","last_became_peered":"2024-08-20T04:59:12.788932+0000","last_unstale":"2024-08-20T05:01:30.356190+0000","last_undegraded":"2024-08-20T05:01:30.356190+0000","last_fullsized":"2024-08-20T05:01:30.356190+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:27:00.122328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343578+0000","last_change":"2024-08-20T04:59:21.902847+0000","last_active":"2024-08-20T05:01:30.343578+0000","last_peered":"2024-08-20T05:01:30.343578+0000","last_clean":"2024-08-20T05:01:30.343578+0000","last_became_active":"2024-08-20T04:59:21.902426+0000","last_became_peered":"2024-08-20T04:59:21.902426+0000","last_unstale":"2024-08-20T05:01:30.343578+0000","last_undegraded":"2024-08-20T05:01:30.343578+0000","last_fullsized":"2024-08-20T05:01:30.343578+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:18:38.107358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":189,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:08.510197+0000","last_change":"2024-08-20T05:00:29.375139+0000","last_active":"2024-08-20T05:02:08.510197+0000","last_peered":"2024-08-20T05:02:08.510197+0000","last_clean":"2024-08-20T05:02:08.510197+0000","last_became_active":"2024-08-20T05:00:29.370896+0000","last_became_peered":"2024-08-20T05:00:29.370896+0000","last_unstale":"2024-08-20T05:02:08.510197+0000","last_undegraded":"2024-08-20T05:02:08.510197+0000","last_fullsized":"2024-08-20T05:02:08.510197+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:06:48.033558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342418+0000","last_change":"2024-08-20T04:59:12.785811+0000","last_active":"2024-08-20T05:01:30.342418+0000","last_peered":"2024-08-20T05:01:30.342418+0000","last_clean":"2024-08-20T05:01:30.342418+0000","last_became_active":"2024-08-20T04:59:12.785483+0000","last_became_peered":"2024-08-20T04:59:12.785483+0000","last_unstale":"2024-08-20T05:01:30.342418+0000","last_undegraded":"2024-08-20T05:01:30.342418+0000","last_fullsized":"2024-08-20T05:01:30.342418+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:31:25.355197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344575+0000","last_change":"2024-08-20T04:59:21.897832+0000","last_active":"2024-08-20T05:01:30.344575+0000","last_peered":"2024-08-20T05:01:30.344575+0000","last_clean":"2024-08-20T05:01:30.344575+0000","last_became_active":"2024-08-20T04:59:21.897457+0000","last_became_peered":"2024-08-20T04:59:21.897457+0000","last_unstale":"2024-08-20T05:01:30.344575+0000","last_undegraded":"2024-08-20T05:01:30.344575+0000","last_fullsized":"2024-08-20T05:01:30.344575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:39:51.934014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339787+0000","last_change":"2024-08-20T04:59:12.787671+0000","last_active":"2024-08-20T05:01:30.339787+0000","last_peered":"2024-08-20T05:01:30.339787+0000","last_clean":"2024-08-20T05:01:30.339787+0000","last_became_active":"2024-08-20T04:59:12.787372+0000","last_became_peered":"2024-08-20T04:59:12.787372+0000","last_unstale":"2024-08-20T05:01:30.339787+0000","last_undegraded":"2024-08-20T05:01:30.339787+0000","last_fullsized":"2024-08-20T05:01:30.339787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:16:55.031031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344513+0000","last_change":"2024-08-20T04:59:12.792192+0000","last_active":"2024-08-20T05:01:30.344513+0000","last_peered":"2024-08-20T05:01:30.344513+0000","last_clean":"2024-08-20T05:01:30.344513+0000","last_became_active":"2024-08-20T04:59:12.791447+0000","last_became_peered":"2024-08-20T04:59:12.791447+0000","last_unstale":"2024-08-20T05:01:30.344513+0000","last_undegraded":"2024-08-20T05:01:30.344513+0000","last_fullsized":"2024-08-20T05:01:30.344513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:03:32.559245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343399+0000","last_change":"2024-08-20T04:59:12.785393+0000","last_active":"2024-08-20T05:01:30.343399+0000","last_peered":"2024-08-20T05:01:30.343399+0000","last_clean":"2024-08-20T05:01:30.343399+0000","last_became_active":"2024-08-20T04:59:12.784998+0000","last_became_peered":"2024-08-20T04:59:12.784998+0000","last_unstale":"2024-08-20T05:01:30.343399+0000","last_undegraded":"2024-08-20T05:01:30.343399+0000","last_fullsized":"2024-08-20T05:01:30.343399+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:27:04.964290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338483+0000","last_change":"2024-08-20T04:59:12.784730+0000","last_active":"2024-08-20T05:01:30.338483+0000","last_peered":"2024-08-20T05:01:30.338483+0000","last_clean":"2024-08-20T05:01:30.338483+0000","last_became_active":"2024-08-20T04:59:12.784269+0000","last_became_peered":"2024-08-20T04:59:12.784269+0000","last_unstale":"2024-08-20T05:01:30.338483+0000","last_undegraded":"2024-08-20T05:01:30.338483+0000","last_fullsized":"2024-08-20T05:01:30.338483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:43:12.248033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355819+0000","last_change":"2024-08-20T04:59:12.786484+0000","last_active":"2024-08-20T05:01:30.355819+0000","last_peered":"2024-08-20T05:01:30.355819+0000","last_clean":"2024-08-20T05:01:30.355819+0000","last_became_active":"2024-08-20T04:59:12.786166+0000","last_became_peered":"2024-08-20T04:59:12.786166+0000","last_unstale":"2024-08-20T05:01:30.355819+0000","last_undegraded":"2024-08-20T05:01:30.355819+0000","last_fullsized":"2024-08-20T05:01:30.355819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:30.084519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340680+0000","last_change":"2024-08-20T04:59:12.786985+0000","last_active":"2024-08-20T05:01:30.340680+0000","last_peered":"2024-08-20T05:01:30.340680+0000","last_clean":"2024-08-20T05:01:30.340680+0000","last_became_active":"2024-08-20T04:59:12.786674+0000","last_became_peered":"2024-08-20T04:59:12.786674+0000","last_unstale":"2024-08-20T05:01:30.340680+0000","last_undegraded":"2024-08-20T05:01:30.340680+0000","last_fullsized":"2024-08-20T05:01:30.340680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:30:59.996149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344184+0000","last_change":"2024-08-20T04:59:12.796410+0000","last_active":"2024-08-20T05:01:30.344184+0000","last_peered":"2024-08-20T05:01:30.344184+0000","last_clean":"2024-08-20T05:01:30.344184+0000","last_became_active":"2024-08-20T04:59:12.796081+0000","last_became_peered":"2024-08-20T04:59:12.796081+0000","last_unstale":"2024-08-20T05:01:30.344184+0000","last_undegraded":"2024-08-20T05:01:30.344184+0000","last_fullsized":"2024-08-20T05:01:30.344184+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:49:09.706265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357071+0000","last_change":"2024-08-20T04:59:12.795994+0000","last_active":"2024-08-20T05:01:30.357071+0000","last_peered":"2024-08-20T05:01:30.357071+0000","last_clean":"2024-08-20T05:01:30.357071+0000","last_became_active":"2024-08-20T04:59:12.795604+0000","last_became_peered":"2024-08-20T04:59:12.795604+0000","last_unstale":"2024-08-20T05:01:30.357071+0000","last_undegraded":"2024-08-20T05:01:30.357071+0000","last_fullsized":"2024-08-20T05:01:30.357071+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:54:09.628743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355741+0000","last_change":"2024-08-20T04:59:12.788966+0000","last_active":"2024-08-20T05:01:30.355741+0000","last_peered":"2024-08-20T05:01:30.355741+0000","last_clean":"2024-08-20T05:01:30.355741+0000","last_became_active":"2024-08-20T04:59:12.788534+0000","last_became_peered":"2024-08-20T04:59:12.788534+0000","last_unstale":"2024-08-20T05:01:30.355741+0000","last_undegraded":"2024-08-20T05:01:30.355741+0000","last_fullsized":"2024-08-20T05:01:30.355741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.615399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356431+0000","last_change":"2024-08-20T04:59:12.785914+0000","last_active":"2024-08-20T05:01:30.356431+0000","last_peered":"2024-08-20T05:01:30.356431+0000","last_clean":"2024-08-20T05:01:30.356431+0000","last_became_active":"2024-08-20T04:59:12.785551+0000","last_became_peered":"2024-08-20T04:59:12.785551+0000","last_unstale":"2024-08-20T05:01:30.356431+0000","last_undegraded":"2024-08-20T05:01:30.356431+0000","last_fullsized":"2024-08-20T05:01:30.356431+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:30:32.072387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357188+0000","last_change":"2024-08-20T04:59:12.795635+0000","last_active":"2024-08-20T05:01:30.357188+0000","last_peered":"2024-08-20T05:01:30.357188+0000","last_clean":"2024-08-20T05:01:30.357188+0000","last_became_active":"2024-08-20T04:59:12.794805+0000","last_became_peered":"2024-08-20T04:59:12.794805+0000","last_unstale":"2024-08-20T05:01:30.357188+0000","last_undegraded":"2024-08-20T05:01:30.357188+0000","last_fullsized":"2024-08-20T05:01:30.357188+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:09:08.725503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355737+0000","last_change":"2024-08-20T04:59:12.785099+0000","last_active":"2024-08-20T05:01:30.355737+0000","last_peered":"2024-08-20T05:01:30.355737+0000","last_clean":"2024-08-20T05:01:30.355737+0000","last_became_active":"2024-08-20T04:59:12.784727+0000","last_became_peered":"2024-08-20T04:59:12.784727+0000","last_unstale":"2024-08-20T05:01:30.355737+0000","last_undegraded":"2024-08-20T05:01:30.355737+0000","last_fullsized":"2024-08-20T05:01:30.355737+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:24:36.227289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340160+0000","last_change":"2024-08-20T04:59:12.781832+0000","last_active":"2024-08-20T05:01:30.340160+0000","last_peered":"2024-08-20T05:01:30.340160+0000","last_clean":"2024-08-20T05:01:30.340160+0000","last_became_active":"2024-08-20T04:59:12.781342+0000","last_became_peered":"2024-08-20T04:59:12.781342+0000","last_unstale":"2024-08-20T05:01:30.340160+0000","last_undegraded":"2024-08-20T05:01:30.340160+0000","last_fullsized":"2024-08-20T05:01:30.340160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:26:17.762048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344755+0000","last_change":"2024-08-20T04:59:12.792350+0000","last_active":"2024-08-20T05:01:30.344755+0000","last_peered":"2024-08-20T05:01:30.344755+0000","last_clean":"2024-08-20T05:01:30.344755+0000","last_became_active":"2024-08-20T04:59:12.792028+0000","last_became_peered":"2024-08-20T04:59:12.792028+0000","last_unstale":"2024-08-20T05:01:30.344755+0000","last_undegraded":"2024-08-20T05:01:30.344755+0000","last_fullsized":"2024-08-20T05:01:30.344755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:16:23.173759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343346+0000","last_change":"2024-08-20T04:59:12.795047+0000","last_active":"2024-08-20T05:01:30.343346+0000","last_peered":"2024-08-20T05:01:30.343346+0000","last_clean":"2024-08-20T05:01:30.343346+0000","last_became_active":"2024-08-20T04:59:12.794705+0000","last_became_peered":"2024-08-20T04:59:12.794705+0000","last_unstale":"2024-08-20T05:01:30.343346+0000","last_undegraded":"2024-08-20T05:01:30.343346+0000","last_fullsized":"2024-08-20T05:01:30.343346+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:51:16.355892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340659+0000","last_change":"2024-08-20T04:59:12.785022+0000","last_active":"2024-08-20T05:01:30.340659+0000","last_peered":"2024-08-20T05:01:30.340659+0000","last_clean":"2024-08-20T05:01:30.340659+0000","last_became_active":"2024-08-20T04:59:12.784730+0000","last_became_peered":"2024-08-20T04:59:12.784730+0000","last_unstale":"2024-08-20T05:01:30.340659+0000","last_undegraded":"2024-08-20T05:01:30.340659+0000","last_fullsized":"2024-08-20T05:01:30.340659+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:21:53.053890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356636+0000","last_change":"2024-08-20T04:59:12.790825+0000","last_active":"2024-08-20T05:01:30.356636+0000","last_peered":"2024-08-20T05:01:30.356636+0000","last_clean":"2024-08-20T05:01:30.356636+0000","last_became_active":"2024-08-20T04:59:12.790299+0000","last_became_peered":"2024-08-20T04:59:12.790299+0000","last_unstale":"2024-08-20T05:01:30.356636+0000","last_undegraded":"2024-08-20T05:01:30.356636+0000","last_fullsized":"2024-08-20T05:01:30.356636+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:12.477186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338217+0000","last_change":"2024-08-20T05:00:29.374190+0000","last_active":"2024-08-20T05:01:30.338217+0000","last_peered":"2024-08-20T05:01:30.338217+0000","last_clean":"2024-08-20T05:01:30.338217+0000","last_became_active":"2024-08-20T05:00:29.373844+0000","last_became_peered":"2024-08-20T05:00:29.373844+0000","last_unstale":"2024-08-20T05:01:30.338217+0000","last_undegraded":"2024-08-20T05:01:30.338217+0000","last_fullsized":"2024-08-20T05:01:30.338217+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:03.131340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338379+0000","last_change":"2024-08-20T04:59:12.783355+0000","last_active":"2024-08-20T05:01:30.338379+0000","last_peered":"2024-08-20T05:01:30.338379+0000","last_clean":"2024-08-20T05:01:30.338379+0000","last_became_active":"2024-08-20T04:59:12.782992+0000","last_became_peered":"2024-08-20T04:59:12.782992+0000","last_unstale":"2024-08-20T05:01:30.338379+0000","last_undegraded":"2024-08-20T05:01:30.338379+0000","last_fullsized":"2024-08-20T05:01:30.338379+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:09:47.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355676+0000","last_change":"2024-08-20T04:59:12.783989+0000","last_active":"2024-08-20T05:01:30.355676+0000","last_peered":"2024-08-20T05:01:30.355676+0000","last_clean":"2024-08-20T05:01:30.355676+0000","last_became_active":"2024-08-20T04:59:12.783671+0000","last_became_peered":"2024-08-20T04:59:12.783671+0000","last_unstale":"2024-08-20T05:01:30.355676+0000","last_undegraded":"2024-08-20T05:01:30.355676+0000","last_fullsized":"2024-08-20T05:01:30.355676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:34:55.727599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357140+0000","last_change":"2024-08-20T04:59:12.787118+0000","last_active":"2024-08-20T05:01:30.357140+0000","last_peered":"2024-08-20T05:01:30.357140+0000","last_clean":"2024-08-20T05:01:30.357140+0000","last_became_active":"2024-08-20T04:59:12.786754+0000","last_became_peered":"2024-08-20T04:59:12.786754+0000","last_unstale":"2024-08-20T05:01:30.357140+0000","last_undegraded":"2024-08-20T05:01:30.357140+0000","last_fullsized":"2024-08-20T05:01:30.357140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:13:23.959972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340919+0000","last_change":"2024-08-20T04:59:12.793748+0000","last_active":"2024-08-20T05:01:30.340919+0000","last_peered":"2024-08-20T05:01:30.340919+0000","last_clean":"2024-08-20T05:01:30.340919+0000","last_became_active":"2024-08-20T04:59:12.792550+0000","last_became_peered":"2024-08-20T04:59:12.792550+0000","last_unstale":"2024-08-20T05:01:30.340919+0000","last_undegraded":"2024-08-20T05:01:30.340919+0000","last_fullsized":"2024-08-20T05:01:30.340919+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:59:24.226273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356824+0000","last_change":"2024-08-20T04:59:12.788827+0000","last_active":"2024-08-20T05:01:30.356824+0000","last_peered":"2024-08-20T05:01:30.356824+0000","last_clean":"2024-08-20T05:01:30.356824+0000","last_became_active":"2024-08-20T04:59:12.788395+0000","last_became_peered":"2024-08-20T04:59:12.788395+0000","last_unstale":"2024-08-20T05:01:30.356824+0000","last_undegraded":"2024-08-20T05:01:30.356824+0000","last_fullsized":"2024-08-20T05:01:30.356824+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:26.453063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357616+0000","last_change":"2024-08-20T04:59:12.795513+0000","last_active":"2024-08-20T05:01:30.357616+0000","last_peered":"2024-08-20T05:01:30.357616+0000","last_clean":"2024-08-20T05:01:30.357616+0000","last_became_active":"2024-08-20T04:59:12.795191+0000","last_became_peered":"2024-08-20T04:59:12.795191+0000","last_unstale":"2024-08-20T05:01:30.357616+0000","last_undegraded":"2024-08-20T05:01:30.357616+0000","last_fullsized":"2024-08-20T05:01:30.357616+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:04:00.893420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356614+0000","last_change":"2024-08-20T04:59:12.789825+0000","last_active":"2024-08-20T05:01:30.356614+0000","last_peered":"2024-08-20T05:01:30.356614+0000","last_clean":"2024-08-20T05:01:30.356614+0000","last_became_active":"2024-08-20T04:59:12.788198+0000","last_became_peered":"2024-08-20T04:59:12.788198+0000","last_unstale":"2024-08-20T05:01:30.356614+0000","last_undegraded":"2024-08-20T05:01:30.356614+0000","last_fullsized":"2024-08-20T05:01:30.356614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:10.898308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340338+0000","last_change":"2024-08-20T04:59:12.787707+0000","last_active":"2024-08-20T05:01:30.340338+0000","last_peered":"2024-08-20T05:01:30.340338+0000","last_clean":"2024-08-20T05:01:30.340338+0000","last_became_active":"2024-08-20T04:59:12.787035+0000","last_became_peered":"2024-08-20T04:59:12.787035+0000","last_unstale":"2024-08-20T05:01:30.340338+0000","last_undegraded":"2024-08-20T05:01:30.340338+0000","last_fullsized":"2024-08-20T05:01:30.340338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:16:52.451048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356216+0000","last_change":"2024-08-20T04:59:12.784012+0000","last_active":"2024-08-20T05:01:30.356216+0000","last_peered":"2024-08-20T05:01:30.356216+0000","last_clean":"2024-08-20T05:01:30.356216+0000","last_became_active":"2024-08-20T04:59:12.783599+0000","last_became_peered":"2024-08-20T04:59:12.783599+0000","last_unstale":"2024-08-20T05:01:30.356216+0000","last_undegraded":"2024-08-20T05:01:30.356216+0000","last_fullsized":"2024-08-20T05:01:30.356216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:23:15.271873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342676+0000","last_change":"2024-08-20T04:59:12.784987+0000","last_active":"2024-08-20T05:01:30.342676+0000","last_peered":"2024-08-20T05:01:30.342676+0000","last_clean":"2024-08-20T05:01:30.342676+0000","last_became_active":"2024-08-20T04:59:12.784693+0000","last_became_peered":"2024-08-20T04:59:12.784693+0000","last_unstale":"2024-08-20T05:01:30.342676+0000","last_undegraded":"2024-08-20T05:01:30.342676+0000","last_fullsized":"2024-08-20T05:01:30.342676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:07:51.624602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357088+0000","last_change":"2024-08-20T04:59:12.792466+0000","last_active":"2024-08-20T05:01:30.357088+0000","last_peered":"2024-08-20T05:01:30.357088+0000","last_clean":"2024-08-20T05:01:30.357088+0000","last_became_active":"2024-08-20T04:59:12.792114+0000","last_became_peered":"2024-08-20T04:59:12.792114+0000","last_unstale":"2024-08-20T05:01:30.357088+0000","last_undegraded":"2024-08-20T05:01:30.357088+0000","last_fullsized":"2024-08-20T05:01:30.357088+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:23:09.919907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338528+0000","last_change":"2024-08-20T04:59:12.793041+0000","last_active":"2024-08-20T05:01:30.338528+0000","last_peered":"2024-08-20T05:01:30.338528+0000","last_clean":"2024-08-20T05:01:30.338528+0000","last_became_active":"2024-08-20T04:59:12.792709+0000","last_became_peered":"2024-08-20T04:59:12.792709+0000","last_unstale":"2024-08-20T05:01:30.338528+0000","last_undegraded":"2024-08-20T05:01:30.338528+0000","last_fullsized":"2024-08-20T05:01:30.338528+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:09:04.523493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338652+0000","last_change":"2024-08-20T04:59:12.790256+0000","last_active":"2024-08-20T05:01:30.338652+0000","last_peered":"2024-08-20T05:01:30.338652+0000","last_clean":"2024-08-20T05:01:30.338652+0000","last_became_active":"2024-08-20T04:59:12.788467+0000","last_became_peered":"2024-08-20T04:59:12.788467+0000","last_unstale":"2024-08-20T05:01:30.338652+0000","last_undegraded":"2024-08-20T05:01:30.338652+0000","last_fullsized":"2024-08-20T05:01:30.338652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:55:31.386030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340563+0000","last_change":"2024-08-20T04:59:12.794882+0000","last_active":"2024-08-20T05:01:30.340563+0000","last_peered":"2024-08-20T05:01:30.340563+0000","last_clean":"2024-08-20T05:01:30.340563+0000","last_became_active":"2024-08-20T04:59:12.794564+0000","last_became_peered":"2024-08-20T04:59:12.794564+0000","last_unstale":"2024-08-20T05:01:30.340563+0000","last_undegraded":"2024-08-20T05:01:30.340563+0000","last_fullsized":"2024-08-20T05:01:30.340563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:36:47.515754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76899,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1305,"num_read_kb":741,"num_write":264,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":734,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":225324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743475,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1028096,"data_stored":510687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939704,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28708,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716444,"statfs":{"total":95995035648,"available":95965638656,"internally_reserved":0,"allocated":1724416,"data_stored":1170900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103230,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1044480,"data_stored":509973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299458,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1032192,"data_stored":510239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462983,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1638400,"data_stored":1106989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626509,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":505477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822738,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1646592,"data_stored":1102039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986263,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1036288,"data_stored":510705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182492,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1032192,"data_stored":505185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411427,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708732,"statfs":{"total":95995035648,"available":95957741568,"internally_reserved":0,"allocated":1101824,"data_stored":570677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28088,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717064,"statfs":{"total":95995035648,"available":95966273536,"internally_reserved":0,"allocated":1089536,"data_stored":570547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738475,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1044480,"data_stored":507465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":71681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T05:02:14.800 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:02:15.209 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:15.696 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:15 smithi037 ceph-mon[17265]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:15.696 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:15 smithi037 ceph-mon[17265]: pgmap v401: 129 pgs: 129 active+clean; 652 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-20T05:02:15.696 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:15 smithi037 ceph-mon[17265]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:15.758 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:15 smithi130 ceph-mon[22007]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:15.758 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:15 smithi130 ceph-mon[22007]: pgmap v401: 129 pgs: 129 active+clean; 652 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-20T05:02:15.758 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:15 smithi130 ceph-mon[22007]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:15.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.808+0000 7f4ce8a00640 1 -- 172.21.15.37:0/31525855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce410a6b0 msgr2=0x7f4ce410aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:15.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.808+0000 7f4ce8a00640 1 --2- 172.21.15.37:0/31525855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce410a6b0 0x7f4ce410aaf0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009900 tx=0x7f4cd002a410 comp rx=0 tx=0).stop 2024-08-20T05:02:15.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.808+0000 7f4ce8a00640 1 -- 172.21.15.37:0/31525855 shutdown_connections 2024-08-20T05:02:15.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.808+0000 7f4ce8a00640 1 --2- 172.21.15.37:0/31525855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ce410b030 0x7f4ce4111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:15.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.808+0000 7f4ce8a00640 1 --2- 172.21.15.37:0/31525855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce410a6b0 0x7f4ce410aaf0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:15.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.808+0000 7f4ce8a00640 1 --2- 172.21.15.37:0/31525855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce4104ca0 0x7f4ce4105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:15.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.808+0000 7f4ce8a00640 1 -- 172.21.15.37:0/31525855 >> 172.21.15.37:0/31525855 conn(0x7f4ce4100730 msgr2=0x7f4ce4102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:15.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.808+0000 7f4ce8a00640 1 -- 172.21.15.37:0/31525855 shutdown_connections 2024-08-20T05:02:15.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.808+0000 7f4ce8a00640 1 -- 172.21.15.37:0/31525855 wait complete. 2024-08-20T05:02:15.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.809+0000 7f4ce8a00640 1 Processor -- start 2024-08-20T05:02:15.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.809+0000 7f4ce8a00640 1 -- start start 2024-08-20T05:02:15.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.810+0000 7f4ce8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce4104ca0 0x7f4ce40773e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:15.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.810+0000 7f4ce8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce410a6b0 0x7f4ce4077920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:15.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.810+0000 7f4ce8a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ce410b030 0x7f4ce4077e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:15.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.810+0000 7f4ce8a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce4114c80 con 0x7f4ce4104ca0 2024-08-20T05:02:15.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.810+0000 7f4ce8a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce4114b00 con 0x7f4ce410b030 2024-08-20T05:02:15.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.810+0000 7f4ce8a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce4114e00 con 0x7f4ce410a6b0 2024-08-20T05:02:15.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.810+0000 7f4ce1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce4104ca0 0x7f4ce40773e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:15.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.810+0000 7f4ce1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce4104ca0 0x7f4ce40773e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35026/0 (socket says 172.21.15.37:35026) 2024-08-20T05:02:15.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.810+0000 7f4ce1e00640 1 -- 172.21.15.37:0/2295968355 learned_addr learned my addr 172.21.15.37:0/2295968355 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:15.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.810+0000 7f4ce2800640 1 --2- 172.21.15.37:0/2295968355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ce410b030 0x7f4ce4077e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:15.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.810+0000 7f4ce1400640 1 --2- 172.21.15.37:0/2295968355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce410a6b0 0x7f4ce4077920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:15.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.811+0000 7f4ce2800640 1 -- 172.21.15.37:0/2295968355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce410a6b0 msgr2=0x7f4ce4077920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:15.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.811+0000 7f4ce2800640 1 --2- 172.21.15.37:0/2295968355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce410a6b0 0x7f4ce4077920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.811+0000 7f4ce2800640 1 -- 172.21.15.37:0/2295968355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce4104ca0 msgr2=0x7f4ce40773e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.811+0000 7f4ce2800640 1 --2- 172.21.15.37:0/2295968355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce4104ca0 0x7f4ce40773e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.811+0000 7f4ce2800640 1 -- 172.21.15.37:0/2295968355 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce41ab760 con 0x7f4ce410b030 2024-08-20T05:02:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.811+0000 7f4ce1e00640 1 --2- 172.21.15.37:0/2295968355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce4104ca0 0x7f4ce40773e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.811+0000 7f4ce2800640 1 --2- 172.21.15.37:0/2295968355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ce410b030 0x7f4ce4077e60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009fd0 tx=0x7f4cdc00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.811+0000 7f4cdaa00640 1 -- 172.21.15.37:0/2295968355 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc00ce20 con 0x7f4ce410b030 2024-08-20T05:02:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.811+0000 7f4ce8a00640 1 -- 172.21.15.37:0/2295968355 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce41aba50 con 0x7f4ce410b030 2024-08-20T05:02:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.811+0000 7f4cdaa00640 1 -- 172.21.15.37:0/2295968355 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cdc005020 con 0x7f4ce410b030 2024-08-20T05:02:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.811+0000 7f4cdaa00640 1 -- 172.21.15.37:0/2295968355 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc010690 con 0x7f4ce410b030 2024-08-20T05:02:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.811+0000 7f4ce8a00640 1 -- 172.21.15.37:0/2295968355 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce41abf60 con 0x7f4ce410b030 2024-08-20T05:02:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.812+0000 7f4ce8a00640 1 -- 172.21.15.37:0/2295968355 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce4105080 con 0x7f4ce410b030 2024-08-20T05:02:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.815+0000 7f4cdaa00640 1 -- 172.21.15.37:0/2295968355 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4cdc0054d0 con 0x7f4ce410b030 2024-08-20T05:02:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.816+0000 7f4cdaa00640 1 --2- 172.21.15.37:0/2295968355 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4cc80b3c50 0x7f4cc80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:15.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.817+0000 7f4cdaa00640 1 -- 172.21.15.37:0/2295968355 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4cdc0e45f0 con 0x7f4ce410b030 2024-08-20T05:02:15.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.817+0000 7f4ce1e00640 1 --2- 172.21.15.37:0/2295968355 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4cc80b3c50 0x7f4cc80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:15.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.817+0000 7f4ce1e00640 1 --2- 172.21.15.37:0/2295968355 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4cc80b3c50 0x7f4cc80b6110 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4011550 tx=0x7f4cd4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:15.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:15.818+0000 7f4cdaa00640 1 -- 172.21.15.37:0/2295968355 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4cdc0ab840 con 0x7f4ce410b030 2024-08-20T05:02:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:15 smithi135 ceph-mon[22342]: from='client.15393 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:15 smithi135 ceph-mon[22342]: pgmap v401: 129 pgs: 129 active+clean; 652 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-20T05:02:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:15 smithi135 ceph-mon[22342]: from='client.15399 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:16.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:16.051+0000 7f4ce8a00640 1 -- 172.21.15.37:0/2295968355 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ce40786e0 con 0x7f4ce410b030 2024-08-20T05:02:16.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:16.052+0000 7f4cdaa00640 1 -- 172.21.15.37:0/2295968355 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f4cdc0ab140 con 0x7f4ce410b030 2024-08-20T05:02:16.054 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:16.054 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"btime":"2024-08-20T05:02:09:430035+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:02:09.143672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:02:16.054 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 29 2024-08-20T05:02:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:16.055+0000 7f4ce8a00640 1 -- 172.21.15.37:0/2295968355 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4cc80b3c50 msgr2=0x7f4cc80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:16.055+0000 7f4ce8a00640 1 --2- 172.21.15.37:0/2295968355 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4cc80b3c50 0x7f4cc80b6110 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4011550 tx=0x7f4cd4005f90 comp rx=0 tx=0).stop 2024-08-20T05:02:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:16.055+0000 7f4ce8a00640 1 -- 172.21.15.37:0/2295968355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ce410b030 msgr2=0x7f4ce4077e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:16.055+0000 7f4ce8a00640 1 --2- 172.21.15.37:0/2295968355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ce410b030 0x7f4ce4077e60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009fd0 tx=0x7f4cdc00ef10 comp rx=0 tx=0).stop 2024-08-20T05:02:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:16.055+0000 7f4ce8a00640 1 -- 172.21.15.37:0/2295968355 shutdown_connections 2024-08-20T05:02:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:16.055+0000 7f4ce8a00640 1 --2- 172.21.15.37:0/2295968355 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4cc80b3c50 0x7f4cc80b6110 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:16.055+0000 7f4ce8a00640 1 --2- 172.21.15.37:0/2295968355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4ce410b030 0x7f4ce4077e60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:16.055+0000 7f4ce8a00640 1 --2- 172.21.15.37:0/2295968355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4ce410a6b0 0x7f4ce4077920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:16.055+0000 7f4ce8a00640 1 --2- 172.21.15.37:0/2295968355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ce4104ca0 0x7f4ce40773e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:16.055+0000 7f4ce8a00640 1 -- 172.21.15.37:0/2295968355 >> 172.21.15.37:0/2295968355 conn(0x7f4ce4100730 msgr2=0x7f4ce4102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:16.056+0000 7f4ce8a00640 1 -- 172.21.15.37:0/2295968355 shutdown_connections 2024-08-20T05:02:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:16.056+0000 7f4ce8a00640 1 -- 172.21.15.37:0/2295968355 wait complete. 2024-08-20T05:02:16.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:16 smithi037 ceph-mon[17265]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:16.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:16 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2295968355' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:16.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:16 smithi135 ceph-mon[22342]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:16.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:16 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2295968355' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:16.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T05:02:16.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:16 smithi130 ceph-mon[22007]: from='client.15405 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:16.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:16 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2295968355' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:17.330 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:17.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:17 smithi037 ceph-mon[17265]: pgmap v402: 129 pgs: 129 active+clean; 652 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-20T05:02:17.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:17 smithi135 ceph-mon[22342]: pgmap v402: 129 pgs: 129 active+clean; 652 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-20T05:02:17.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.915+0000 7fe5a1a00640 1 -- 172.21.15.37:0/2716447406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe59c108cb0 msgr2=0x7fe59c10f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:17.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.915+0000 7fe5a1a00640 1 --2- 172.21.15.37:0/2716447406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe59c108cb0 0x7fe59c10f4b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe594009ca0 tx=0x7fe59402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:02:17.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.915+0000 7fe5a1a00640 1 -- 172.21.15.37:0/2716447406 shutdown_connections 2024-08-20T05:02:17.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.915+0000 7fe5a1a00640 1 --2- 172.21.15.37:0/2716447406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe59c108cb0 0x7fe59c10f4b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:17.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.915+0000 7fe5a1a00640 1 --2- 172.21.15.37:0/2716447406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59c108330 0x7fe59c108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:17.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.915+0000 7fe5a1a00640 1 --2- 172.21.15.37:0/2716447406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe59c102920 0x7fe59c102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:17.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.915+0000 7fe5a1a00640 1 -- 172.21.15.37:0/2716447406 >> 172.21.15.37:0/2716447406 conn(0x7fe59c0fe350 msgr2=0x7fe59c100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:17.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.916+0000 7fe5a1a00640 1 -- 172.21.15.37:0/2716447406 shutdown_connections 2024-08-20T05:02:17.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.916+0000 7fe5a1a00640 1 -- 172.21.15.37:0/2716447406 wait complete. 2024-08-20T05:02:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.917+0000 7fe5a1a00640 1 Processor -- start 2024-08-20T05:02:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.917+0000 7fe5a1a00640 1 -- start start 2024-08-20T05:02:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe5a1a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59c102920 0x7fe59c198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe5a1a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe59c108330 0x7fe59c199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe5a1a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe59c108cb0 0x7fe59c19e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe5a1a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c1129c0 con 0x7fe59c102920 2024-08-20T05:02:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe5a1a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c112840 con 0x7fe59c108cb0 2024-08-20T05:02:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe5a1a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe59c112b40 con 0x7fe59c108330 2024-08-20T05:02:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe59be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59c102920 0x7fe59c198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe593e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe59c108330 0x7fe59c199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe59be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59c102920 0x7fe59c198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35048/0 (socket says 172.21.15.37:35048) 2024-08-20T05:02:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe59be00640 1 -- 172.21.15.37:0/364377024 learned_addr learned my addr 172.21.15.37:0/364377024 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:17.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe593e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe59c108330 0x7fe59c199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43752/0 (socket says 172.21.15.37:43752) 2024-08-20T05:02:17.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe5a1000640 1 --2- 172.21.15.37:0/364377024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe59c108cb0 0x7fe59c19e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe593e00640 1 -- 172.21.15.37:0/364377024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe59c108cb0 msgr2=0x7fe59c19e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe593e00640 1 --2- 172.21.15.37:0/364377024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe59c108cb0 0x7fe59c19e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe593e00640 1 -- 172.21.15.37:0/364377024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59c102920 msgr2=0x7fe59c198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe593e00640 1 --2- 172.21.15.37:0/364377024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59c102920 0x7fe59c198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe593e00640 1 -- 172.21.15.37:0/364377024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe59c19eda0 con 0x7fe59c108330 2024-08-20T05:02:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.918+0000 7fe59be00640 1 --2- 172.21.15.37:0/364377024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59c102920 0x7fe59c198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.919+0000 7fe593e00640 1 --2- 172.21.15.37:0/364377024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe59c108330 0x7fe59c199230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe58400e9f0 tx=0x7fe58400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.919+0000 7fe599600640 1 -- 172.21.15.37:0/364377024 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58400ccc0 con 0x7fe59c108330 2024-08-20T05:02:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.919+0000 7fe599600640 1 -- 172.21.15.37:0/364377024 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe5840108e0 con 0x7fe59c108330 2024-08-20T05:02:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.919+0000 7fe5a1a00640 1 -- 172.21.15.37:0/364377024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe59c19f090 con 0x7fe59c108330 2024-08-20T05:02:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.919+0000 7fe599600640 1 -- 172.21.15.37:0/364377024 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe584018880 con 0x7fe59c108330 2024-08-20T05:02:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.919+0000 7fe5a1a00640 1 -- 172.21.15.37:0/364377024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe59c1a5750 con 0x7fe59c108330 2024-08-20T05:02:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.920+0000 7fe5a1a00640 1 -- 172.21.15.37:0/364377024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe59c102d00 con 0x7fe59c108330 2024-08-20T05:02:17.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.923+0000 7fe599600640 1 -- 172.21.15.37:0/364377024 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe584010430 con 0x7fe59c108330 2024-08-20T05:02:17.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.924+0000 7fe599600640 1 --2- 172.21.15.37:0/364377024 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe5800b3c70 0x7fe5800b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:17.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.924+0000 7fe599600640 1 -- 172.21.15.37:0/364377024 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe5840e4820 con 0x7fe59c108330 2024-08-20T05:02:17.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.924+0000 7fe59be00640 1 --2- 172.21.15.37:0/364377024 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe5800b3c70 0x7fe5800b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:17.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.925+0000 7fe59be00640 1 --2- 172.21.15.37:0/364377024 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe5800b3c70 0x7fe5800b6130 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0095f0 tx=0x7fe58c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:17.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:17.925+0000 7fe599600640 1 -- 172.21.15.37:0/364377024 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe5840aba70 con 0x7fe59c108330 2024-08-20T05:02:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:17 smithi130 ceph-mon[22007]: pgmap v402: 129 pgs: 129 active+clean; 652 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-20T05:02:18.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:18.125+0000 7fe5a1a00640 1 -- 172.21.15.37:0/364377024 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe59c1a5a80 con 0x7fe59c108330 2024-08-20T05:02:18.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:18.126+0000 7fe599600640 1 -- 172.21.15.37:0/364377024 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24873 (secure 0 0 0) 0x7fe5840ab370 con 0x7fe59c108330 2024-08-20T05:02:18.128 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:18.128 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":88,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","created":"2024-08-20T04:50:26.520303+0000","modified":"2024-08-20T05:01:30.328315+0000","last_up_change":"2024-08-20T04:58:12.250259+0000","last_in_change":"2024-08-20T04:57:49.724189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T04:54:16.381529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T04:59:08.598741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T04:59:10.793802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-20T04:59:19.888446+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a813e53b-68b3-43ff-a59b-aed00e98f2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6803","nonce":3569936373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6805","nonce":3569936373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6809","nonce":3569936373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6807","nonce":3569936373}]},"public_addr":"172.21.15.37:6803/3569936373","cluster_addr":"172.21.15.37:6805/3569936373","heartbeat_back_addr":"172.21.15.37:6809/3569936373","heartbeat_front_addr":"172.21.15.37:6807/3569936373","state":["exists","up"]},{"osd":1,"uuid":"c216a8d0-9685-467a-8161-700682ce617c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6801","nonce":4206461125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6803","nonce":4206461125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6807","nonce":4206461125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6805","nonce":4206461125}]},"public_addr":"172.21.15.130:6801/4206461125","cluster_addr":"172.21.15.130:6803/4206461125","heartbeat_back_addr":"172.21.15.130:6807/4206461125","heartbeat_front_addr":"172.21.15.130:6805/4206461125","state":["exists","up"]},{"osd":2,"uuid":"34402442-c652-40eb-865e-a607a28846b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6801","nonce":2653255199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6803","nonce":2653255199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6807","nonce":2653255199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6805","nonce":2653255199}]},"public_addr":"172.21.15.135:6801/2653255199","cluster_addr":"172.21.15.135:6803/2653255199","heartbeat_back_addr":"172.21.15.135:6807/2653255199","heartbeat_front_addr":"172.21.15.135:6805/2653255199","state":["exists","up"]},{"osd":3,"uuid":"ec7be9dc-96b5-4816-9065-8121baedcdc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6811","nonce":2601290990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6813","nonce":2601290990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6817","nonce":2601290990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6815","nonce":2601290990}]},"public_addr":"172.21.15.37:6811/2601290990","cluster_addr":"172.21.15.37:6813/2601290990","heartbeat_back_addr":"172.21.15.37:6817/2601290990","heartbeat_front_addr":"172.21.15.37:6815/2601290990","state":["exists","up"]},{"osd":4,"uuid":"2dbd47f9-8686-4707-8862-3c7a99a37d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6809","nonce":3542081474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6811","nonce":3542081474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6815","nonce":3542081474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6813","nonce":3542081474}]},"public_addr":"172.21.15.130:6809/3542081474","cluster_addr":"172.21.15.130:6811/3542081474","heartbeat_back_addr":"172.21.15.130:6815/3542081474","heartbeat_front_addr":"172.21.15.130:6813/3542081474","state":["exists","up"]},{"osd":5,"uuid":"9a07a137-d6b7-4aba-8678-4fd164597f27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6809","nonce":2507249148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6811","nonce":2507249148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6815","nonce":2507249148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6813","nonce":2507249148}]},"public_addr":"172.21.15.135:6809/2507249148","cluster_addr":"172.21.15.135:6811/2507249148","heartbeat_back_addr":"172.21.15.135:6815/2507249148","heartbeat_front_addr":"172.21.15.135:6813/2507249148","state":["exists","up"]},{"osd":6,"uuid":"6d6346e8-5418-4c30-9bb3-5af352b616a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6819","nonce":155932692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6821","nonce":155932692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6825","nonce":155932692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6823","nonce":155932692}]},"public_addr":"172.21.15.37:6819/155932692","cluster_addr":"172.21.15.37:6821/155932692","heartbeat_back_addr":"172.21.15.37:6825/155932692","heartbeat_front_addr":"172.21.15.37:6823/155932692","state":["exists","up"]},{"osd":7,"uuid":"c87804c2-d456-495e-b36e-33dbb3548347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6817","nonce":4148130245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6819","nonce":4148130245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6823","nonce":4148130245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6821","nonce":4148130245}]},"public_addr":"172.21.15.130:6817/4148130245","cluster_addr":"172.21.15.130:6819/4148130245","heartbeat_back_addr":"172.21.15.130:6823/4148130245","heartbeat_front_addr":"172.21.15.130:6821/4148130245","state":["exists","up"]},{"osd":8,"uuid":"a7d4c9c8-1826-4703-92ad-ded2800b4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6817","nonce":222884649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6819","nonce":222884649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6823","nonce":222884649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6821","nonce":222884649}]},"public_addr":"172.21.15.135:6817/222884649","cluster_addr":"172.21.15.135:6819/222884649","heartbeat_back_addr":"172.21.15.135:6823/222884649","heartbeat_front_addr":"172.21.15.135:6821/222884649","state":["exists","up"]},{"osd":9,"uuid":"f9e0c194-66b5-4e62-b2ae-816a4a4fffbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6827","nonce":2240773042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6829","nonce":2240773042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6833","nonce":2240773042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6831","nonce":2240773042}]},"public_addr":"172.21.15.37:6827/2240773042","cluster_addr":"172.21.15.37:6829/2240773042","heartbeat_back_addr":"172.21.15.37:6833/2240773042","heartbeat_front_addr":"172.21.15.37:6831/2240773042","state":["exists","up"]},{"osd":10,"uuid":"fa6a50a5-2b97-42d1-9b57-b5502b7083d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6825","nonce":2896730163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6827","nonce":2896730163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6831","nonce":2896730163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6829","nonce":2896730163}]},"public_addr":"172.21.15.130:6825/2896730163","cluster_addr":"172.21.15.130:6827/2896730163","heartbeat_back_addr":"172.21.15.130:6831/2896730163","heartbeat_front_addr":"172.21.15.130:6829/2896730163","state":["exists","up"]},{"osd":11,"uuid":"9a305d75-030d-41db-abfb-81bb71e8c6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6825","nonce":2532897645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6827","nonce":2532897645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6831","nonce":2532897645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6829","nonce":2532897645}]},"public_addr":"172.21.15.135:6825/2532897645","cluster_addr":"172.21.15.135:6827/2532897645","heartbeat_back_addr":"172.21.15.135:6831/2532897645","heartbeat_front_addr":"172.21.15.135:6829/2532897645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:26.455665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:51.456030+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:14.332699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:42.749386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:07.587091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:32.450249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:01.864489+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:26.830527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:51.206257+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:20.400020+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:46.329864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:58:11.086508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4282140105":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/1217599998":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/3737412906":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/58912454":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/2105948300":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/1480362562":"2024-08-21T04:50:59.520912+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T05:02:18.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:18.129+0000 7fe5a1a00640 1 -- 172.21.15.37:0/364377024 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe5800b3c70 msgr2=0x7fe5800b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:18.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:18.129+0000 7fe5a1a00640 1 --2- 172.21.15.37:0/364377024 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe5800b3c70 0x7fe5800b6130 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0095f0 tx=0x7fe58c005f90 comp rx=0 tx=0).stop 2024-08-20T05:02:18.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:18.129+0000 7fe5a1a00640 1 -- 172.21.15.37:0/364377024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe59c108330 msgr2=0x7fe59c199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:18.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:18.129+0000 7fe5a1a00640 1 --2- 172.21.15.37:0/364377024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe59c108330 0x7fe59c199230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe58400e9f0 tx=0x7fe58400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:02:18.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:18.129+0000 7fe5a1a00640 1 -- 172.21.15.37:0/364377024 shutdown_connections 2024-08-20T05:02:18.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:18.129+0000 7fe5a1a00640 1 --2- 172.21.15.37:0/364377024 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe5800b3c70 0x7fe5800b6130 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:18.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:18.129+0000 7fe5a1a00640 1 --2- 172.21.15.37:0/364377024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe59c108cb0 0x7fe59c19e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:18.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:18.129+0000 7fe5a1a00640 1 --2- 172.21.15.37:0/364377024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe59c108330 0x7fe59c199230 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:18.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:18.129+0000 7fe5a1a00640 1 --2- 172.21.15.37:0/364377024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe59c102920 0x7fe59c198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:18.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:18.129+0000 7fe5a1a00640 1 -- 172.21.15.37:0/364377024 >> 172.21.15.37:0/364377024 conn(0x7fe59c0fe350 msgr2=0x7fe59c101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:18.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:18.129+0000 7fe5a1a00640 1 -- 172.21.15.37:0/364377024 shutdown_connections 2024-08-20T05:02:18.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:18.129+0000 7fe5a1a00640 1 -- 172.21.15.37:0/364377024 wait complete. 2024-08-20T05:02:18.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:18 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/364377024' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:02:18.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:18 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/364377024' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:02:18.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:18 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/364377024' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:02:19.065 DEBUG:tasks.fwd_scrub:Yielding 2024-08-20T05:02:19.065 INFO:teuthology.run_tasks:Running task background_exec... 2024-08-20T05:02:19.076 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi037.front.sepia.ceph.com 2024-08-20T05:02:19.077 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-08-20T05:02:19.077 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-08-20T05:02:19.077 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T05:02:19.077 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T05:02:19.081 INFO:teuthology.run_tasks:Running task quiescer... 2024-08-20T05:02:19.094 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-20T05:02:19.094 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-20T05:02:19.527 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:19.531 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:19.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:19 smithi037 ceph-mon[17265]: pgmap v403: 129 pgs: 129 active+clean; 652 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-20T05:02:19.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:02:19.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:19 smithi135 ceph-mon[22342]: pgmap v403: 129 pgs: 129 active+clean; 652 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-20T05:02:19.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:02:19.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:19 smithi130 ceph-mon[22007]: pgmap v403: 129 pgs: 129 active+clean; 652 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 9 op/s 2024-08-20T05:02:19.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:02:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.318+0000 7fad7fc00640 1 -- 172.21.15.37:0/3230598543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad78077d20 msgr2=0x7fad78113150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.318+0000 7fad7fc00640 1 --2- 172.21.15.37:0/3230598543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad78077d20 0x7fad78113150 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fad64009900 tx=0x7fad6402a410 comp rx=0 tx=0).stop 2024-08-20T05:02:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.318+0000 7fad7fc00640 1 -- 172.21.15.37:0/3230598543 shutdown_connections 2024-08-20T05:02:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.318+0000 7fad7fc00640 1 --2- 172.21.15.37:0/3230598543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad78113690 0x7fad78115a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.318+0000 7fad7fc00640 1 --2- 172.21.15.37:0/3230598543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad78077d20 0x7fad78113150 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.318+0000 7fad7fc00640 1 --2- 172.21.15.37:0/3230598543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad78077400 0x7fad780777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.318+0000 7fad7fc00640 1 -- 172.21.15.37:0/3230598543 >> 172.21.15.37:0/3230598543 conn(0x7fad78100730 msgr2=0x7fad78102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:20.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.318+0000 7fad7fc00640 1 -- 172.21.15.37:0/3230598543 shutdown_connections 2024-08-20T05:02:20.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.319+0000 7fad7fc00640 1 -- 172.21.15.37:0/3230598543 wait complete. 2024-08-20T05:02:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.320+0000 7fad7fc00640 1 Processor -- start 2024-08-20T05:02:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.320+0000 7fad7fc00640 1 -- start start 2024-08-20T05:02:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.320+0000 7fad7fc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad78077400 0x7fad7819f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.320+0000 7fad7fc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad78077d20 0x7fad7819fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.320+0000 7fad7fc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad78113690 0x7fad781a4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.320+0000 7fad7fc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad781190c0 con 0x7fad78113690 2024-08-20T05:02:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.320+0000 7fad7fc00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fad78118f40 con 0x7fad78077d20 2024-08-20T05:02:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.320+0000 7fad7fc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad78119240 con 0x7fad78077400 2024-08-20T05:02:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.321+0000 7fad7d200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad78077400 0x7fad7819f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.321+0000 7fad7d200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad78077400 0x7fad7819f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43770/0 (socket says 172.21.15.37:43770) 2024-08-20T05:02:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.321+0000 7fad7d200640 1 -- 172.21.15.37:0/1454023922 learned_addr learned my addr 172.21.15.37:0/1454023922 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.321+0000 7fad77e00640 1 --2- 172.21.15.37:0/1454023922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad78077d20 0x7fad7819fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.321+0000 7fad7d200640 1 -- 172.21.15.37:0/1454023922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad78077d20 msgr2=0x7fad7819fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.321+0000 7fad7d200640 1 --2- 172.21.15.37:0/1454023922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad78077d20 0x7fad7819fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.321+0000 7fad7d200640 1 -- 172.21.15.37:0/1454023922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad78113690 msgr2=0x7fad781a4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.321+0000 7fad7d200640 1 --2- 172.21.15.37:0/1454023922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad78113690 0x7fad781a4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.321+0000 7fad7d200640 1 -- 172.21.15.37:0/1454023922 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad781a56c0 con 0x7fad78077400 2024-08-20T05:02:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.322+0000 7fad7d200640 1 --2- 172.21.15.37:0/1454023922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad78077400 0x7fad7819f610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00e9f0 tx=0x7fad6c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.322+0000 7fad75600640 1 -- 172.21.15.37:0/1454023922 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c00cd80 con 0x7fad78077400 2024-08-20T05:02:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.322+0000 7fad75600640 1 -- 172.21.15.37:0/1454023922 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad6c0108e0 con 0x7fad78077400 2024-08-20T05:02:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.322+0000 7fad7fc00640 1 -- 172.21.15.37:0/1454023922 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad781a59b0 con 0x7fad78077400 2024-08-20T05:02:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.322+0000 7fad75600640 1 -- 172.21.15.37:0/1454023922 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c018980 con 0x7fad78077400 2024-08-20T05:02:20.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.322+0000 7fad7fc00640 1 -- 172.21.15.37:0/1454023922 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad781ac240 con 0x7fad78077400 2024-08-20T05:02:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.325+0000 7fad825dc740 1 Processor -- start 2024-08-20T05:02:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.325+0000 7fad825dc740 1 -- start start 2024-08-20T05:02:20.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.325+0000 7fad75600640 1 -- 172.21.15.37:0/1454023922 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fad6c010430 con 0x7fad78077400 2024-08-20T05:02:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.326+0000 7fad825dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e39d0 0x55b2073e3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.326+0000 7fad825dc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e42f0 0x55b2073efd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.326+0000 7fad825dc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073f0280 0x55b2073f2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.326+0000 7fad825dc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b20735a870 con 0x55b2073e42f0 2024-08-20T05:02:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.326+0000 7fad825dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b207349d70 con 0x55b2073e39d0 2024-08-20T05:02:20.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.326+0000 7fad825dc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b20734ddb0 con 0x55b2073f0280 2024-08-20T05:02:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.326+0000 7fad7d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e42f0 0x55b2073efd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.326+0000 7fad77e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073f0280 0x55b2073f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.326+0000 7fad7d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e42f0 0x55b2073efd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35094/0 (socket says 172.21.15.37:35094) 2024-08-20T05:02:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.326+0000 7fad7d200640 1 -- 172.21.15.37:0/3283155937 learned_addr learned my addr 172.21.15.37:0/3283155937 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.326+0000 7fad7dc00640 1 --2- 172.21.15.37:0/3283155937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e39d0 0x55b2073e3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.327+0000 7fad77e00640 1 -- 172.21.15.37:0/3283155937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e39d0 msgr2=0x55b2073e3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:20.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.327+0000 7fad77e00640 1 --2- 172.21.15.37:0/3283155937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e39d0 0x55b2073e3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.327+0000 7fad77e00640 1 -- 172.21.15.37:0/3283155937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e42f0 msgr2=0x55b2073efd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.327+0000 7fad77e00640 1 --2- 172.21.15.37:0/3283155937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e42f0 0x55b2073efd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.327+0000 7fad77e00640 1 -- 172.21.15.37:0/3283155937 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2070a9930 con 0x55b2073f0280 2024-08-20T05:02:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.327+0000 7fad7dc00640 1 --2- 172.21.15.37:0/3283155937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e39d0 0x55b2073e3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:02:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.327+0000 7fad77e00640 1 --2- 172.21.15.37:0/3283155937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073f0280 0x55b2073f2670 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fad6402aa00 tx=0x7fad64005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d904e7d03e0e22de server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:20.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.327+0000 7fad6a000640 1 -- 172.21.15.37:0/3283155937 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64040070 con 0x55b2073f0280 2024-08-20T05:02:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.327+0000 7fad6a000640 1 -- 172.21.15.37:0/3283155937 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad64005500 con 0x55b2073f0280 2024-08-20T05:02:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.327+0000 7fad75600640 1 --2- 172.21.15.37:0/1454023922 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad600b3c50 0x7fad600b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.327+0000 7fad6a000640 1 -- 172.21.15.37:0/3283155937 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64035040 con 0x55b2073f0280 2024-08-20T05:02:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.328+0000 7fad75600640 1 -- 172.21.15.37:0/1454023922 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fad6c0e4330 con 0x7fad78077400 2024-08-20T05:02:20.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.328+0000 7fad7dc00640 1 --2- 172.21.15.37:0/1454023922 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad600b3c50 0x7fad600b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.328+0000 7fad825dc740 1 -- 172.21.15.37:0/3283155937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073f0280 msgr2=0x55b2073f2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.328+0000 7fad825dc740 1 --2- 172.21.15.37:0/3283155937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073f0280 0x55b2073f2670 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fad6402aa00 tx=0x7fad64005c00 comp rx=0 tx=0).stop 2024-08-20T05:02:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.328+0000 7fad825dc740 1 -- 172.21.15.37:0/3283155937 shutdown_connections 2024-08-20T05:02:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.328+0000 7fad825dc740 1 --2- 172.21.15.37:0/3283155937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073f0280 0x55b2073f2670 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.328+0000 7fad825dc740 1 --2- 172.21.15.37:0/3283155937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e42f0 0x55b2073efd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.328+0000 7fad825dc740 1 --2- 172.21.15.37:0/3283155937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e39d0 0x55b2073e3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.328+0000 7fad825dc740 1 -- 172.21.15.37:0/3283155937 >> 172.21.15.37:0/3283155937 conn(0x55b2073e1800 msgr2=0x55b2073e29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.329+0000 7fad825dc740 1 -- 172.21.15.37:0/3283155937 shutdown_connections 2024-08-20T05:02:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.329+0000 7fad825dc740 1 -- 172.21.15.37:0/3283155937 wait complete. 2024-08-20T05:02:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.329+0000 7fad7dc00640 1 --2- 172.21.15.37:0/1454023922 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad600b3c50 0x7fad600b6110 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fad7806be60 tx=0x7fad70009ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.329+0000 7fad825dc740 1 -- start start 2024-08-20T05:02:20.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.329+0000 7fad825dc740 1 Processor -- start 2024-08-20T05:02:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.330+0000 7fad825dc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073e39d0 0x55b2073efb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.330+0000 7fad825dc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e42f0 0x55b2073ecf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.330+0000 7fad825dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073f0280 0x55b2073ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.330+0000 7fad825dc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b2071ac890 con 0x55b2073e42f0 2024-08-20T05:02:20.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.330+0000 7fad825dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b2072d0b00 con 0x55b2073f0280 2024-08-20T05:02:20.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.330+0000 7fad825dc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b2073f2f70 con 0x55b2073e39d0 2024-08-20T05:02:20.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.330+0000 7fad825dc740 10 client.0 _ll_register_callbacks cb 0x55b207344dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:20.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.330+0000 7fad77e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e42f0 0x55b2073ecf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.330+0000 7fad7d200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073e39d0 0x55b2073efb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.330+0000 7fad7dc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073f0280 0x55b2073ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.330+0000 7fad7d200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073e39d0 0x55b2073efb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43786/0 (socket says 172.21.15.37:43786) 2024-08-20T05:02:20.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.330+0000 7fad7d200640 1 -- 172.21.15.37:0/176545854 learned_addr learned my addr 172.21.15.37:0/176545854 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:20.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.330+0000 7fad77e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e42f0 0x55b2073ecf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35102/0 (socket says 172.21.15.37:35102) 2024-08-20T05:02:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.330+0000 7fad7d200640 1 -- 172.21.15.37:0/176545854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073f0280 msgr2=0x55b2073ed4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.330+0000 7fad7d200640 1 --2- 172.21.15.37:0/176545854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073f0280 0x55b2073ed4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.331+0000 7fad7d200640 1 -- 172.21.15.37:0/176545854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e42f0 msgr2=0x55b2073ecf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.331+0000 7fad7d200640 1 --2- 172.21.15.37:0/176545854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e42f0 0x55b2073ecf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.331+0000 7fad7d200640 1 -- 172.21.15.37:0/176545854 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b207311a30 con 0x55b2073e39d0 2024-08-20T05:02:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.331+0000 7fad7d200640 1 --2- 172.21.15.37:0/176545854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073e39d0 0x55b2073efb00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0e45d0 tx=0x7fad6c0e7f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db37cc6bebbfcc92 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.331+0000 7fad5ea00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:02:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.331+0000 7fad5ea00640 1 -- 172.21.15.37:0/176545854 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6c0aa5f0 con 0x55b2073e39d0 2024-08-20T05:02:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.331+0000 7fad5ea00640 1 -- 172.21.15.37:0/176545854 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fad6c0aa2f0 con 0x55b2073e39d0 2024-08-20T05:02:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.331+0000 7fad825dc740 1 -- 172.21.15.37:0/176545854 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad64005500 con 0x55b2073e39d0 2024-08-20T05:02:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.331+0000 7fad5ea00640 1 -- 172.21.15.37:0/176545854 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fad6c0e4130 con 0x55b2073e39d0 2024-08-20T05:02:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.331+0000 7fad825dc740 10 client.25462 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:20.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.331+0000 7fad825dc740 1 -- 172.21.15.37:0/176545854 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b2073fe7b0 con 0x55b2073e39d0 2024-08-20T05:02:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.332+0000 7fad5ea00640 1 -- 172.21.15.37:0/176545854 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad64005500 con 0x55b2073e39d0 2024-08-20T05:02:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.332+0000 7fad5ea00640 1 -- 172.21.15.37:0/176545854 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fad6c0a67f0 con 0x55b2073e39d0 2024-08-20T05:02:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.332+0000 7fad825dc740 10 client.25462 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.332+0000 7fad825dc740 10 client.25462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:02:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.332+0000 7fad825dc740 20 client.25462 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.332+0000 7fad825dc740 1 --2- 172.21.15.37:0/176545854 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b2073ffc30 0x55b2074020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.332+0000 7fad825dc740 4 client.25462 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:02:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.332+0000 7fad825dc740 1 -- 172.21.15.37:0/176545854 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b20735c7c0 con 0x55b2073ffc30 2024-08-20T05:02:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.332+0000 7fad77e00640 1 --2- 172.21.15.37:0/176545854 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b2073ffc30 0x55b2074020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.333+0000 7fad77e00640 1 --2- 172.21.15.37:0/176545854 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b2073ffc30 0x55b2074020b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed53a6c9e88b59f7 server_cookie=d811b6a085965a04 in_seq=0 out_seq=0 2024-08-20T05:02:20.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.333+0000 7fad5ea00640 10 client.25462 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:20.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.333+0000 7fad5ea00640 1 -- 172.21.15.37:0/176545854 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b20735c7c0 con 0x55b2073ffc30 2024-08-20T05:02:20.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.333+0000 7fad5ea00640 10 client.25462 handle_command_reply: tid=0 2024-08-20T05:02:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.334+0000 7fad825dc740 1 client.25462 shutdown 2024-08-20T05:02:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.334+0000 7fad825dc740 1 -- 172.21.15.37:0/176545854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073e39d0 msgr2=0x55b2073efb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.334+0000 7fad825dc740 1 --2- 172.21.15.37:0/176545854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073e39d0 0x55b2073efb00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0e45d0 tx=0x7fad6c0e7f90 comp rx=0 tx=0).stop 2024-08-20T05:02:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.334+0000 7fad825dc740 1 -- 172.21.15.37:0/176545854 shutdown_connections 2024-08-20T05:02:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.334+0000 7fad825dc740 1 --2- 172.21.15.37:0/176545854 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b2073ffc30 0x55b2074020b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.334+0000 7fad825dc740 1 --2- 172.21.15.37:0/176545854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073f0280 0x55b2073ed4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.334+0000 7fad825dc740 1 --2- 172.21.15.37:0/176545854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e42f0 0x55b2073ecf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.334+0000 7fad825dc740 1 --2- 172.21.15.37:0/176545854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073e39d0 0x55b2073efb00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.334+0000 7fad825dc740 1 -- 172.21.15.37:0/176545854 >> 172.21.15.37:0/176545854 conn(0x55b2073e1800 msgr2=0x55b2073e73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:20.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.334+0000 7fad5ea00640 0 client.25462 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.334+0000 7fad825dc740 1 -- 172.21.15.37:0/176545854 shutdown_connections 2024-08-20T05:02:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.334+0000 7fad825dc740 1 -- 172.21.15.37:0/176545854 wait complete. 2024-08-20T05:02:20.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.334+0000 7fad825dc740 20 client.25462 trim_cache size 0 max 16384 2024-08-20T05:02:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.353+0000 7fad825dc740 1 Processor -- start 2024-08-20T05:02:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.353+0000 7fad825dc740 1 -- start start 2024-08-20T05:02:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.353+0000 7fad825dc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e39d0 0x55b2073e07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.353+0000 7fad825dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e42f0 0x55b2074079d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.353+0000 7fad825dc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073f0280 0x55b207407f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.353+0000 7fad825dc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad781b5e40 con 0x55b2073e39d0 2024-08-20T05:02:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.353+0000 7fad825dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fad781b7980 con 0x55b2073e42f0 2024-08-20T05:02:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.353+0000 7fad825dc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad781b6510 con 0x55b2073f0280 2024-08-20T05:02:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.354+0000 7fad7d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e39d0 0x55b2073e07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.354+0000 7fad77e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e42f0 0x55b2074079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.354+0000 7fad7d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e39d0 0x55b2073e07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35106/0 (socket says 172.21.15.37:35106) 2024-08-20T05:02:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.354+0000 7fad7d200640 1 -- 172.21.15.37:0/248765986 learned_addr learned my addr 172.21.15.37:0/248765986 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.354+0000 7fad77e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e42f0 0x55b2074079d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:52536/0 (socket says 172.21.15.37:52536) 2024-08-20T05:02:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.354+0000 7fad7dc00640 1 --2- 172.21.15.37:0/248765986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073f0280 0x55b207407f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.354+0000 7fad77e00640 1 -- 172.21.15.37:0/248765986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073f0280 msgr2=0x55b207407f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.354+0000 7fad77e00640 1 --2- 172.21.15.37:0/248765986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073f0280 0x55b207407f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.354+0000 7fad77e00640 1 -- 172.21.15.37:0/248765986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e39d0 msgr2=0x55b2073e07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.354+0000 7fad77e00640 1 --2- 172.21.15.37:0/248765986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e39d0 0x55b2073e07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.354+0000 7fad77e00640 1 -- 172.21.15.37:0/248765986 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2073efe70 con 0x55b2073e42f0 2024-08-20T05:02:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.354+0000 7fad7d200640 1 --2- 172.21.15.37:0/248765986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e39d0 0x55b2073e07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.354+0000 7fad77e00640 1 --2- 172.21.15.37:0/248765986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e42f0 0x55b2074079d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fad6402a930 tx=0x7fad64009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b43b07254dbb0767 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.355+0000 7fad69600640 1 -- 172.21.15.37:0/248765986 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64040040 con 0x55b2073e42f0 2024-08-20T05:02:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.355+0000 7fad69600640 1 -- 172.21.15.37:0/248765986 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad64051a60 con 0x55b2073e42f0 2024-08-20T05:02:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.355+0000 7fad69600640 1 -- 172.21.15.37:0/248765986 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad64035040 con 0x55b2073e42f0 2024-08-20T05:02:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.355+0000 7fad825dc740 1 -- 172.21.15.37:0/248765986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e42f0 msgr2=0x55b2074079d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.355+0000 7fad825dc740 1 --2- 172.21.15.37:0/248765986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e42f0 0x55b2074079d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fad6402a930 tx=0x7fad64009260 comp rx=0 tx=0).stop 2024-08-20T05:02:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.355+0000 7fad825dc740 1 -- 172.21.15.37:0/248765986 shutdown_connections 2024-08-20T05:02:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.355+0000 7fad825dc740 1 --2- 172.21.15.37:0/248765986 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073f0280 0x55b207407f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.355+0000 7fad825dc740 1 --2- 172.21.15.37:0/248765986 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e42f0 0x55b2074079d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.355+0000 7fad825dc740 1 --2- 172.21.15.37:0/248765986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073e39d0 0x55b2073e07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.356+0000 7fad825dc740 1 -- 172.21.15.37:0/248765986 >> 172.21.15.37:0/248765986 conn(0x55b2073e1800 msgr2=0x55b2073e00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.356+0000 7fad825dc740 1 -- 172.21.15.37:0/248765986 shutdown_connections 2024-08-20T05:02:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.356+0000 7fad825dc740 1 -- 172.21.15.37:0/248765986 wait complete. 2024-08-20T05:02:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.356+0000 7fad825dc740 1 -- start start 2024-08-20T05:02:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.356+0000 7fad825dc740 1 Processor -- start 2024-08-20T05:02:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.357+0000 7fad825dc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073e39d0 0x55b2073f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.357+0000 7fad825dc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e42f0 0x55b2073f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.357+0000 7fad825dc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073f0280 0x55b2074619d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.357+0000 7fad825dc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad781b72b0 con 0x55b2073f0280 2024-08-20T05:02:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.357+0000 7fad825dc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fad781b6be0 con 0x55b2073e42f0 2024-08-20T05:02:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.357+0000 7fad825dc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad781b3e20 con 0x55b2073e39d0 2024-08-20T05:02:20.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.357+0000 7fad825dc740 10 client.0 _ll_register_callbacks cb 0x7fad6c00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.357+0000 7fad7dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073f0280 0x55b2074619d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.357+0000 7fad7dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073f0280 0x55b2074619d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35112/0 (socket says 172.21.15.37:35112) 2024-08-20T05:02:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.357+0000 7fad7dc00640 1 -- 172.21.15.37:0/1708671119 learned_addr learned my addr 172.21.15.37:0/1708671119 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:20.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.358+0000 7fad7dc00640 1 -- 172.21.15.37:0/1708671119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073e39d0 msgr2=0x55b2073f5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.358+0000 7fad7dc00640 1 --2- 172.21.15.37:0/1708671119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073e39d0 0x55b2073f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.358+0000 7fad7dc00640 1 -- 172.21.15.37:0/1708671119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e42f0 msgr2=0x55b2073f61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.358+0000 7fad77e00640 1 --2- 172.21.15.37:0/1708671119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e42f0 0x55b2073f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.358+0000 7fad7dc00640 1 --2- 172.21.15.37:0/1708671119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e42f0 0x55b2073f61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.358+0000 7fad7dc00640 1 -- 172.21.15.37:0/1708671119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b207462110 con 0x55b2073f0280 2024-08-20T05:02:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.358+0000 7fad77e00640 1 --2- 172.21.15.37:0/1708671119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e42f0 0x55b2073f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:02:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.358+0000 7fad7dc00640 1 --2- 172.21.15.37:0/1708671119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073f0280 0x55b2074619d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fad700118f0 tx=0x7fad70009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a5773985d9a688 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.358+0000 7fad5ea00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:02:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.359+0000 7fad5ea00640 1 -- 172.21.15.37:0/1708671119 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad7001fb40 con 0x55b2073f0280 2024-08-20T05:02:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.359+0000 7fad5ea00640 1 -- 172.21.15.37:0/1708671119 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fad7001fce0 con 0x55b2073f0280 2024-08-20T05:02:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.359+0000 7fad825dc740 1 -- 172.21.15.37:0/1708671119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad64051a60 con 0x55b2073f0280 2024-08-20T05:02:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.359+0000 7fad5ea00640 1 -- 172.21.15.37:0/1708671119 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fad70029420 con 0x55b2073f0280 2024-08-20T05:02:20.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.359+0000 7fad825dc740 10 client.15432 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.359+0000 7fad825dc740 1 -- 172.21.15.37:0/1708671119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b20746a790 con 0x55b2073f0280 2024-08-20T05:02:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.359+0000 7fad5ea00640 1 -- 172.21.15.37:0/1708671119 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad64051a60 con 0x55b2073f0280 2024-08-20T05:02:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.359+0000 7fad5ea00640 1 -- 172.21.15.37:0/1708671119 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fad7001e5e0 con 0x55b2073f0280 2024-08-20T05:02:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.360+0000 7fad825dc740 10 client.15432 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.360+0000 7fad825dc740 10 client.15432 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:02:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.360+0000 7fad825dc740 20 client.15432 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.360+0000 7fad825dc740 1 --2- 172.21.15.37:0/1708671119 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b20746afc0 0x55b20746d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.360+0000 7fad825dc740 4 client.15432 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T05:02:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.360+0000 7fad825dc740 1 -- 172.21.15.37:0/1708671119 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b207358260 con 0x55b20746afc0 2024-08-20T05:02:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.360+0000 7fad7d200640 1 --2- 172.21.15.37:0/1708671119 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b20746afc0 0x55b20746d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.360+0000 7fad7d200640 1 --2- 172.21.15.37:0/1708671119 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b20746afc0 0x55b20746d400 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e55e44d38a90e44 server_cookie=514cda5d53f65185 in_seq=0 out_seq=0 2024-08-20T05:02:20.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.360+0000 7fad5ea00640 10 client.15432 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.361+0000 7fad5ea00640 1 -- 172.21.15.37:0/1708671119 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b207358260 con 0x55b20746afc0 2024-08-20T05:02:20.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.362+0000 7fad5ea00640 10 client.15432 handle_command_reply: tid=0 2024-08-20T05:02:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.362+0000 7fad825dc740 1 client.15432 shutdown 2024-08-20T05:02:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.362+0000 7fad825dc740 1 -- 172.21.15.37:0/1708671119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073f0280 msgr2=0x55b2074619d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.362+0000 7fad825dc740 1 --2- 172.21.15.37:0/1708671119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073f0280 0x55b2074619d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fad700118f0 tx=0x7fad70009500 comp rx=0 tx=0).stop 2024-08-20T05:02:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.362+0000 7fad825dc740 1 -- 172.21.15.37:0/1708671119 shutdown_connections 2024-08-20T05:02:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.362+0000 7fad825dc740 1 --2- 172.21.15.37:0/1708671119 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b20746afc0 0x55b20746d400 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.362+0000 7fad825dc740 1 --2- 172.21.15.37:0/1708671119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b2073f0280 0x55b2074619d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.362+0000 7fad825dc740 1 --2- 172.21.15.37:0/1708671119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b2073e42f0 0x55b2073f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.362+0000 7fad825dc740 1 --2- 172.21.15.37:0/1708671119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b2073e39d0 0x55b2073f5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.362+0000 7fad825dc740 1 -- 172.21.15.37:0/1708671119 >> 172.21.15.37:0/1708671119 conn(0x55b2073e1800 msgr2=0x55b2073e08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.362+0000 7fad5ea00640 0 client.15432 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.362+0000 7fad825dc740 1 -- 172.21.15.37:0/1708671119 shutdown_connections 2024-08-20T05:02:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.363+0000 7fad825dc740 1 -- 172.21.15.37:0/1708671119 wait complete. 2024-08-20T05:02:20.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.363+0000 7fad825dc740 20 client.15432 trim_cache size 0 max 16384 2024-08-20T05:02:20.366 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:02:20.366 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-20T05:02:20.366 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "5c67480d-82b2-4f25-94ac-84bf80480005", 2024-08-20T05:02:20.366 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-20T05:02:20.366 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:02:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.363+0000 7fad7fc00640 1 -- 172.21.15.37:0/1454023922 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad600b3c50 msgr2=0x7fad600b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.363+0000 7fad7fc00640 1 --2- 172.21.15.37:0/1454023922 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad600b3c50 0x7fad600b6110 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fad7806be60 tx=0x7fad70009ab0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.363+0000 7fad7fc00640 1 -- 172.21.15.37:0/1454023922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad78077400 msgr2=0x7fad7819f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.363+0000 7fad7fc00640 1 --2- 172.21.15.37:0/1454023922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad78077400 0x7fad7819f610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fad6c00e9f0 tx=0x7fad6c00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.364+0000 7fad7fc00640 1 -- 172.21.15.37:0/1454023922 shutdown_connections 2024-08-20T05:02:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.364+0000 7fad7fc00640 1 --2- 172.21.15.37:0/1454023922 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad600b3c50 0x7fad600b6110 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.364+0000 7fad7fc00640 1 --2- 172.21.15.37:0/1454023922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad78113690 0x7fad781a4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.364+0000 7fad7fc00640 1 --2- 172.21.15.37:0/1454023922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad78077d20 0x7fad7819fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.364+0000 7fad7fc00640 1 --2- 172.21.15.37:0/1454023922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad78077400 0x7fad7819f610 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.364+0000 7fad7fc00640 1 -- 172.21.15.37:0/1454023922 >> 172.21.15.37:0/1454023922 conn(0x7fad78100730 msgr2=0x7fad78102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.364+0000 7fad7fc00640 1 -- 172.21.15.37:0/1454023922 shutdown_connections 2024-08-20T05:02:20.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.364+0000 7fad7fc00640 1 -- 172.21.15.37:0/1454023922 wait complete. 2024-08-20T05:02:20.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.555+0000 7fcdb4000640 1 -- 172.21.15.37:0/444299774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdac101ee0 msgr2=0x7fcdac10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:20.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.555+0000 7fcdb4000640 1 --2- 172.21.15.37:0/444299774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdac101ee0 0x7fcdac10ec30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcd98009860 tx=0x7fcd9802a3d0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.555+0000 7fcdb4000640 1 -- 172.21.15.37:0/444299774 shutdown_connections 2024-08-20T05:02:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.555+0000 7fcdb4000640 1 --2- 172.21.15.37:0/444299774 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdac10f170 0x7fcdac111560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.555+0000 7fcdb4000640 1 --2- 172.21.15.37:0/444299774 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdac101ee0 0x7fcdac10ec30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.555+0000 7fcdb4000640 1 --2- 172.21.15.37:0/444299774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdac1015c0 0x7fcdac1019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.555+0000 7fcdb4000640 1 -- 172.21.15.37:0/444299774 >> 172.21.15.37:0/444299774 conn(0x7fcdac0fd410 msgr2=0x7fcdac0ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.555+0000 7fcdb4000640 1 -- 172.21.15.37:0/444299774 shutdown_connections 2024-08-20T05:02:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.556+0000 7fcdb4000640 1 -- 172.21.15.37:0/444299774 wait complete. 2024-08-20T05:02:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.556+0000 7fcdb4000640 1 Processor -- start 2024-08-20T05:02:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.557+0000 7fcdb4000640 1 -- start start 2024-08-20T05:02:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.557+0000 7fcdb4000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdac1015c0 0x7fcdac19b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.557+0000 7fcdb4000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdac101ee0 0x7fcdac19ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.557+0000 7fcdb4000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdac10f170 0x7fcdac1a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.557+0000 7fcdb4000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac114d00 con 0x7fcdac101ee0 2024-08-20T05:02:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.557+0000 7fcdb4000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac114b80 con 0x7fcdac10f170 2024-08-20T05:02:20.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.557+0000 7fcdb4000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac114e80 con 0x7fcdac1015c0 2024-08-20T05:02:20.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.557+0000 7fcdb0c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdac101ee0 0x7fcdac19ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.557+0000 7fcdb0c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdac101ee0 0x7fcdac19ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35126/0 (socket says 172.21.15.37:35126) 2024-08-20T05:02:20.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.557+0000 7fcdb1600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdac1015c0 0x7fcdac19b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.557+0000 7fcdb0c00640 1 -- 172.21.15.37:0/801526386 learned_addr learned my addr 172.21.15.37:0/801526386 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:20.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.557+0000 7fcdb2000640 1 --2- 172.21.15.37:0/801526386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdac10f170 0x7fcdac1a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.558+0000 7fcdb0c00640 1 -- 172.21.15.37:0/801526386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdac1015c0 msgr2=0x7fcdac19b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:20.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.558+0000 7fcdb0c00640 1 --2- 172.21.15.37:0/801526386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdac1015c0 0x7fcdac19b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.558+0000 7fcdb0c00640 1 -- 172.21.15.37:0/801526386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdac10f170 msgr2=0x7fcdac1a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:20.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.558+0000 7fcdb0c00640 1 --2- 172.21.15.37:0/801526386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdac10f170 0x7fcdac1a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.558+0000 7fcdb0c00640 1 -- 172.21.15.37:0/801526386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdac1a1590 con 0x7fcdac101ee0 2024-08-20T05:02:20.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.558+0000 7fcdb2000640 1 --2- 172.21.15.37:0/801526386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdac10f170 0x7fcdac1a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:20.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.558+0000 7fcdb0c00640 1 --2- 172.21.15.37:0/801526386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdac101ee0 0x7fcdac19ba20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcd98009980 tx=0x7fcd98030fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:20.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.558+0000 7fcdaa000640 1 -- 172.21.15.37:0/801526386 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd98040070 con 0x7fcdac101ee0 2024-08-20T05:02:20.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.559+0000 7fcdaa000640 1 -- 172.21.15.37:0/801526386 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd98005570 con 0x7fcdac101ee0 2024-08-20T05:02:20.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.559+0000 7fcdb4000640 1 -- 172.21.15.37:0/801526386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdac1a1820 con 0x7fcdac101ee0 2024-08-20T05:02:20.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.559+0000 7fcdaa000640 1 -- 172.21.15.37:0/801526386 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd980046c0 con 0x7fcdac101ee0 2024-08-20T05:02:20.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.559+0000 7fcdb4000640 1 -- 172.21.15.37:0/801526386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdac1a7f40 con 0x7fcdac101ee0 2024-08-20T05:02:20.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.560+0000 7fcdb4000640 1 -- 172.21.15.37:0/801526386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdac1019a0 con 0x7fcdac101ee0 2024-08-20T05:02:20.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.562+0000 7fcdaa000640 1 -- 172.21.15.37:0/801526386 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcd98043070 con 0x7fcdac101ee0 2024-08-20T05:02:20.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.564+0000 7fcdaa000640 1 --2- 172.21.15.37:0/801526386 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcd940b3c50 0x7fcd940b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:20.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.564+0000 7fcdaa000640 1 -- 172.21.15.37:0/801526386 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fcd98104a00 con 0x7fcdac101ee0 2024-08-20T05:02:20.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.564+0000 7fcdb1600640 1 --2- 172.21.15.37:0/801526386 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcd940b3c50 0x7fcd940b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:20.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:20 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:20.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:20 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:20.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:20 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:20.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:20 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:20.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:20 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:20.580 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:20 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:20.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.565+0000 7fcdb1600640 1 --2- 172.21.15.37:0/801526386 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcd940b3c50 0x7fcd940b6110 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009530 tx=0x7fcda0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:20.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.568+0000 7fcdaa000640 1 -- 172.21.15.37:0/801526386 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fcd980cb690 con 0x7fcdac101ee0 2024-08-20T05:02:20.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.794+0000 7fcdb4000640 1 -- 172.21.15.37:0/801526386 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcdac06ae90 con 0x7fcd940b3c50 2024-08-20T05:02:20.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.801+0000 7fcdaa000640 1 -- 172.21.15.37:0/801526386 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340543 (secure 0 0 0) 0x7fcdac06ae90 con 0x7fcd940b3c50 2024-08-20T05:02:20.806 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:20.808 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-20T05:02:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.805+0000 7fcdb4000640 1 -- 172.21.15.37:0/801526386 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcd940b3c50 msgr2=0x7fcd940b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.806+0000 7fcdb4000640 1 --2- 172.21.15.37:0/801526386 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcd940b3c50 0x7fcd940b6110 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009530 tx=0x7fcda0009260 comp rx=0 tx=0).stop 2024-08-20T05:02:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.806+0000 7fcdb4000640 1 -- 172.21.15.37:0/801526386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdac101ee0 msgr2=0x7fcdac19ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.806+0000 7fcdb4000640 1 --2- 172.21.15.37:0/801526386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdac101ee0 0x7fcdac19ba20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcd98009980 tx=0x7fcd98030fa0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.806+0000 7fcdb4000640 1 -- 172.21.15.37:0/801526386 shutdown_connections 2024-08-20T05:02:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.806+0000 7fcdb4000640 1 --2- 172.21.15.37:0/801526386 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcd940b3c50 0x7fcd940b6110 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.806+0000 7fcdb4000640 1 --2- 172.21.15.37:0/801526386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcdac10f170 0x7fcdac1a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.806+0000 7fcdb4000640 1 --2- 172.21.15.37:0/801526386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdac101ee0 0x7fcdac19ba20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.806+0000 7fcdb4000640 1 --2- 172.21.15.37:0/801526386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcdac1015c0 0x7fcdac19b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.806+0000 7fcdb4000640 1 -- 172.21.15.37:0/801526386 >> 172.21.15.37:0/801526386 conn(0x7fcdac0fd410 msgr2=0x7fcdac110590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.806+0000 7fcdb4000640 1 -- 172.21.15.37:0/801526386 shutdown_connections 2024-08-20T05:02:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:20.806+0000 7fcdb4000640 1 -- 172.21.15.37:0/801526386 wait complete. 2024-08-20T05:02:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:20 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:20 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:20 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:20 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:20.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:20 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:20.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:20 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:20.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:20 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:20.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:20 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:20.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:20 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:20.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:20 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:20.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:20 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:20.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:20 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:21.716 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:02:21.845 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:21 smithi037 ceph-mon[17265]: pgmap v404: 129 pgs: 129 active+clean; 652 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-20T05:02:21.846 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:21 smithi037 ceph-mon[17265]: scrub queued for path: / 2024-08-20T05:02:21.846 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:21 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:02:21.846 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:21 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:02:21.846 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:21 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:02:21.846 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:21 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:02:21.846 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:21 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:02:21.846 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:21 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:21 smithi135 ceph-mon[22342]: pgmap v404: 129 pgs: 129 active+clean; 652 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-20T05:02:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:21 smithi135 ceph-mon[22342]: scrub queued for path: / 2024-08-20T05:02:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:21 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:02:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:21 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:02:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:21 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:02:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:21 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:02:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:21 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:02:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:21 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:21 smithi130 ceph-mon[22007]: pgmap v404: 129 pgs: 129 active+clean; 652 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-20T05:02:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:21 smithi130 ceph-mon[22007]: scrub queued for path: / 2024-08-20T05:02:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:21 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:02:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:21 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:02:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:21 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:02:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:21 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:02:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:21 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:02:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:21 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:02:22.222 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":404,"stamp":"2024-08-20T05:02:20.021353+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":667501,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1436,"num_read_kb":835,"num_write":389,"num_write_kb":2312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952691,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":821,"ondisk_log_size":821,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367580,"kb_used_data":14108,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124574244,"statfs":{"total":1151940427776,"available":1151564025856,"internally_reserved":0,"allocated":14446592,"data_stored":8091629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5684,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":77,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003379"},"pg_stats":[{"pgid":"2.1f","version":"84'13","reported_seq":190,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:16.351749+0000","last_change":"2024-08-20T04:59:09.751382+0000","last_active":"2024-08-20T05:02:16.351749+0000","last_peered":"2024-08-20T05:02:16.351749+0000","last_clean":"2024-08-20T05:02:16.351749+0000","last_became_active":"2024-08-20T04:59:09.751026+0000","last_became_peered":"2024-08-20T04:59:09.751026+0000","last_unstale":"2024-08-20T05:02:16.351749+0000","last_undegraded":"2024-08-20T05:02:16.351749+0000","last_fullsized":"2024-08-20T05:02:16.351749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:14:50.107767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342960+0000","last_change":"2024-08-20T05:00:29.371826+0000","last_active":"2024-08-20T05:01:30.342960+0000","last_peered":"2024-08-20T05:01:30.342960+0000","last_clean":"2024-08-20T05:01:30.342960+0000","last_became_active":"2024-08-20T05:00:29.371618+0000","last_became_peered":"2024-08-20T05:00:29.371618+0000","last_unstale":"2024-08-20T05:01:30.342960+0000","last_undegraded":"2024-08-20T05:01:30.342960+0000","last_fullsized":"2024-08-20T05:01:30.342960+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:34:36.786900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344146+0000","last_change":"2024-08-20T04:59:21.902558+0000","last_active":"2024-08-20T05:01:30.344146+0000","last_peered":"2024-08-20T05:01:30.344146+0000","last_clean":"2024-08-20T05:01:30.344146+0000","last_became_active":"2024-08-20T04:59:21.902119+0000","last_became_peered":"2024-08-20T04:59:21.902119+0000","last_unstale":"2024-08-20T05:01:30.344146+0000","last_undegraded":"2024-08-20T05:01:30.344146+0000","last_fullsized":"2024-08-20T05:01:30.344146+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:53.765865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357136+0000","last_change":"2024-08-20T04:59:09.946282+0000","last_active":"2024-08-20T05:01:30.357136+0000","last_peered":"2024-08-20T05:01:30.357136+0000","last_clean":"2024-08-20T05:01:30.357136+0000","last_became_active":"2024-08-20T04:59:09.945867+0000","last_became_peered":"2024-08-20T04:59:09.945867+0000","last_unstale":"2024-08-20T05:01:30.357136+0000","last_undegraded":"2024-08-20T05:01:30.357136+0000","last_fullsized":"2024-08-20T05:01:30.357136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:29:08.119504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338826+0000","last_change":"2024-08-20T04:59:12.796121+0000","last_active":"2024-08-20T05:01:30.338826+0000","last_peered":"2024-08-20T05:01:30.338826+0000","last_clean":"2024-08-20T05:01:30.338826+0000","last_became_active":"2024-08-20T04:59:12.792764+0000","last_became_peered":"2024-08-20T04:59:12.792764+0000","last_unstale":"2024-08-20T05:01:30.338826+0000","last_undegraded":"2024-08-20T05:01:30.338826+0000","last_fullsized":"2024-08-20T05:01:30.338826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:01:53.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355898+0000","last_change":"2024-08-20T04:59:21.909607+0000","last_active":"2024-08-20T05:01:30.355898+0000","last_peered":"2024-08-20T05:01:30.355898+0000","last_clean":"2024-08-20T05:01:30.355898+0000","last_became_active":"2024-08-20T04:59:21.909175+0000","last_became_peered":"2024-08-20T04:59:21.909175+0000","last_unstale":"2024-08-20T05:01:30.355898+0000","last_undegraded":"2024-08-20T05:01:30.355898+0000","last_fullsized":"2024-08-20T05:01:30.355898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:29:49.940169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342724+0000","last_change":"2024-08-20T04:59:09.753233+0000","last_active":"2024-08-20T05:01:30.342724+0000","last_peered":"2024-08-20T05:01:30.342724+0000","last_clean":"2024-08-20T05:01:30.342724+0000","last_became_active":"2024-08-20T04:59:09.752614+0000","last_became_peered":"2024-08-20T04:59:09.752614+0000","last_unstale":"2024-08-20T05:01:30.342724+0000","last_undegraded":"2024-08-20T05:01:30.342724+0000","last_fullsized":"2024-08-20T05:01:30.342724+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:04:20.199669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356860+0000","last_change":"2024-08-20T04:59:12.799116+0000","last_active":"2024-08-20T05:01:30.356860+0000","last_peered":"2024-08-20T05:01:30.356860+0000","last_clean":"2024-08-20T05:01:30.356860+0000","last_became_active":"2024-08-20T04:59:12.798725+0000","last_became_peered":"2024-08-20T04:59:12.798725+0000","last_unstale":"2024-08-20T05:01:30.356860+0000","last_undegraded":"2024-08-20T05:01:30.356860+0000","last_fullsized":"2024-08-20T05:01:30.356860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:46.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356542+0000","last_change":"2024-08-20T05:00:29.372973+0000","last_active":"2024-08-20T05:01:30.356542+0000","last_peered":"2024-08-20T05:01:30.356542+0000","last_clean":"2024-08-20T05:01:30.356542+0000","last_became_active":"2024-08-20T05:00:29.372504+0000","last_became_peered":"2024-08-20T05:00:29.372504+0000","last_unstale":"2024-08-20T05:01:30.356542+0000","last_undegraded":"2024-08-20T05:01:30.356542+0000","last_fullsized":"2024-08-20T05:01:30.356542+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:22:22.410569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342961+0000","last_change":"2024-08-20T04:59:09.752771+0000","last_active":"2024-08-20T05:01:30.342961+0000","last_peered":"2024-08-20T05:01:30.342961+0000","last_clean":"2024-08-20T05:01:30.342961+0000","last_became_active":"2024-08-20T04:59:09.752415+0000","last_became_peered":"2024-08-20T04:59:09.752415+0000","last_unstale":"2024-08-20T05:01:30.342961+0000","last_undegraded":"2024-08-20T05:01:30.342961+0000","last_fullsized":"2024-08-20T05:01:30.342961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:13:18.843587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356341+0000","last_change":"2024-08-20T04:59:12.794418+0000","last_active":"2024-08-20T05:01:30.356341+0000","last_peered":"2024-08-20T05:01:30.356341+0000","last_clean":"2024-08-20T05:01:30.356341+0000","last_became_active":"2024-08-20T04:59:12.794117+0000","last_became_peered":"2024-08-20T04:59:12.794117+0000","last_unstale":"2024-08-20T05:01:30.356341+0000","last_undegraded":"2024-08-20T05:01:30.356341+0000","last_fullsized":"2024-08-20T05:01:30.356341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:18.209690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356247+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T05:01:30.356247+0000","last_peered":"2024-08-20T05:01:30.356247+0000","last_clean":"2024-08-20T05:01:30.356247+0000","last_became_active":"2024-08-20T04:59:21.906344+0000","last_became_peered":"2024-08-20T04:59:21.906344+0000","last_unstale":"2024-08-20T05:01:30.356247+0000","last_undegraded":"2024-08-20T05:01:30.356247+0000","last_fullsized":"2024-08-20T05:01:30.356247+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:48:34.982558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340475+0000","last_change":"2024-08-20T04:59:12.792719+0000","last_active":"2024-08-20T05:01:30.340475+0000","last_peered":"2024-08-20T05:01:30.340475+0000","last_clean":"2024-08-20T05:01:30.340475+0000","last_became_active":"2024-08-20T04:59:12.792294+0000","last_became_peered":"2024-08-20T04:59:12.792294+0000","last_unstale":"2024-08-20T05:01:30.340475+0000","last_undegraded":"2024-08-20T05:01:30.340475+0000","last_fullsized":"2024-08-20T05:01:30.340475+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:20:03.593798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.363468+0000","last_change":"2024-08-20T05:01:30.363065+0000","last_active":"2024-08-20T05:01:30.363468+0000","last_peered":"2024-08-20T05:01:30.363468+0000","last_clean":"2024-08-20T05:01:30.363468+0000","last_became_active":"2024-08-20T05:01:30.357909+0000","last_became_peered":"2024-08-20T05:01:30.357909+0000","last_unstale":"2024-08-20T05:01:30.363468+0000","last_undegraded":"2024-08-20T05:01:30.363468+0000","last_fullsized":"2024-08-20T05:01:30.363468+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:46:56.468529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356466+0000","last_change":"2024-08-20T04:59:21.902445+0000","last_active":"2024-08-20T05:01:30.356466+0000","last_peered":"2024-08-20T05:01:30.356466+0000","last_clean":"2024-08-20T05:01:30.356466+0000","last_became_active":"2024-08-20T04:59:21.901950+0000","last_became_peered":"2024-08-20T04:59:21.901950+0000","last_unstale":"2024-08-20T05:01:30.356466+0000","last_undegraded":"2024-08-20T05:01:30.356466+0000","last_fullsized":"2024-08-20T05:01:30.356466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:55:28.653841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356733+0000","last_change":"2024-08-20T04:59:12.784236+0000","last_active":"2024-08-20T05:01:30.356733+0000","last_peered":"2024-08-20T05:01:30.356733+0000","last_clean":"2024-08-20T05:01:30.356733+0000","last_became_active":"2024-08-20T04:59:12.783945+0000","last_became_peered":"2024-08-20T04:59:12.783945+0000","last_unstale":"2024-08-20T05:01:30.356733+0000","last_undegraded":"2024-08-20T05:01:30.356733+0000","last_fullsized":"2024-08-20T05:01:30.356733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:43:07.137543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343581+0000","last_change":"2024-08-20T04:59:09.751661+0000","last_active":"2024-08-20T05:01:30.343581+0000","last_peered":"2024-08-20T05:01:30.343581+0000","last_clean":"2024-08-20T05:01:30.343581+0000","last_became_active":"2024-08-20T04:59:09.751326+0000","last_became_peered":"2024-08-20T04:59:09.751326+0000","last_unstale":"2024-08-20T05:01:30.343581+0000","last_undegraded":"2024-08-20T05:01:30.343581+0000","last_fullsized":"2024-08-20T05:01:30.343581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:54.751929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356948+0000","last_change":"2024-08-20T04:59:21.913657+0000","last_active":"2024-08-20T05:01:30.356948+0000","last_peered":"2024-08-20T05:01:30.356948+0000","last_clean":"2024-08-20T05:01:30.356948+0000","last_became_active":"2024-08-20T04:59:21.913187+0000","last_became_peered":"2024-08-20T04:59:21.913187+0000","last_unstale":"2024-08-20T05:01:30.356948+0000","last_undegraded":"2024-08-20T05:01:30.356948+0000","last_fullsized":"2024-08-20T05:01:30.356948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:51:29.008810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339857+0000","last_change":"2024-08-20T04:59:12.780137+0000","last_active":"2024-08-20T05:01:30.339857+0000","last_peered":"2024-08-20T05:01:30.339857+0000","last_clean":"2024-08-20T05:01:30.339857+0000","last_became_active":"2024-08-20T04:59:12.779820+0000","last_became_peered":"2024-08-20T04:59:12.779820+0000","last_unstale":"2024-08-20T05:01:30.339857+0000","last_undegraded":"2024-08-20T05:01:30.339857+0000","last_fullsized":"2024-08-20T05:01:30.339857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:33:58.204255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356668+0000","last_change":"2024-08-20T04:59:09.750521+0000","last_active":"2024-08-20T05:01:30.356668+0000","last_peered":"2024-08-20T05:01:30.356668+0000","last_clean":"2024-08-20T05:01:30.356668+0000","last_became_active":"2024-08-20T04:59:09.750115+0000","last_became_peered":"2024-08-20T04:59:09.750115+0000","last_unstale":"2024-08-20T05:01:30.356668+0000","last_undegraded":"2024-08-20T05:01:30.356668+0000","last_fullsized":"2024-08-20T05:01:30.356668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:44:20.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342721+0000","last_change":"2024-08-20T04:59:21.910737+0000","last_active":"2024-08-20T05:01:30.342721+0000","last_peered":"2024-08-20T05:01:30.342721+0000","last_clean":"2024-08-20T05:01:30.342721+0000","last_became_active":"2024-08-20T04:59:21.910104+0000","last_became_peered":"2024-08-20T04:59:21.910104+0000","last_unstale":"2024-08-20T05:01:30.342721+0000","last_undegraded":"2024-08-20T05:01:30.342721+0000","last_fullsized":"2024-08-20T05:01:30.342721+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:17:40.436885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344499+0000","last_change":"2024-08-20T04:59:12.787285+0000","last_active":"2024-08-20T05:01:30.344499+0000","last_peered":"2024-08-20T05:01:30.344499+0000","last_clean":"2024-08-20T05:01:30.344499+0000","last_became_active":"2024-08-20T04:59:12.786998+0000","last_became_peered":"2024-08-20T04:59:12.786998+0000","last_unstale":"2024-08-20T05:01:30.344499+0000","last_undegraded":"2024-08-20T05:01:30.344499+0000","last_fullsized":"2024-08-20T05:01:30.344499+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:12:49.860291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356758+0000","last_change":"2024-08-20T04:59:09.947715+0000","last_active":"2024-08-20T05:01:30.356758+0000","last_peered":"2024-08-20T05:01:30.356758+0000","last_clean":"2024-08-20T05:01:30.356758+0000","last_became_active":"2024-08-20T04:59:09.947372+0000","last_became_peered":"2024-08-20T04:59:09.947372+0000","last_unstale":"2024-08-20T05:01:30.356758+0000","last_undegraded":"2024-08-20T05:01:30.356758+0000","last_fullsized":"2024-08-20T05:01:30.356758+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:42:04.352964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357308+0000","last_change":"2024-08-20T05:00:29.860562+0000","last_active":"2024-08-20T05:01:30.357308+0000","last_peered":"2024-08-20T05:01:30.357308+0000","last_clean":"2024-08-20T05:01:30.357308+0000","last_became_active":"2024-08-20T05:00:29.859944+0000","last_became_peered":"2024-08-20T05:00:29.859944+0000","last_unstale":"2024-08-20T05:01:30.357308+0000","last_undegraded":"2024-08-20T05:01:30.357308+0000","last_fullsized":"2024-08-20T05:01:30.357308+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:47.266712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338727+0000","last_change":"2024-08-20T04:59:12.785952+0000","last_active":"2024-08-20T05:01:30.338727+0000","last_peered":"2024-08-20T05:01:30.338727+0000","last_clean":"2024-08-20T05:01:30.338727+0000","last_became_active":"2024-08-20T04:59:12.785596+0000","last_became_peered":"2024-08-20T04:59:12.785596+0000","last_unstale":"2024-08-20T05:01:30.338727+0000","last_undegraded":"2024-08-20T05:01:30.338727+0000","last_fullsized":"2024-08-20T05:01:30.338727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:47.299560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356854+0000","last_change":"2024-08-20T04:59:09.964725+0000","last_active":"2024-08-20T05:01:30.356854+0000","last_peered":"2024-08-20T05:01:30.356854+0000","last_clean":"2024-08-20T05:01:30.356854+0000","last_became_active":"2024-08-20T04:59:09.964351+0000","last_became_peered":"2024-08-20T04:59:09.964351+0000","last_unstale":"2024-08-20T05:01:30.356854+0000","last_undegraded":"2024-08-20T05:01:30.356854+0000","last_fullsized":"2024-08-20T05:01:30.356854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:26:03.216378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344343+0000","last_change":"2024-08-20T04:59:21.898758+0000","last_active":"2024-08-20T05:01:30.344343+0000","last_peered":"2024-08-20T05:01:30.344343+0000","last_clean":"2024-08-20T05:01:30.344343+0000","last_became_active":"2024-08-20T04:59:21.898282+0000","last_became_peered":"2024-08-20T04:59:21.898282+0000","last_unstale":"2024-08-20T05:01:30.344343+0000","last_undegraded":"2024-08-20T05:01:30.344343+0000","last_fullsized":"2024-08-20T05:01:30.344343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:45:49.093459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357095+0000","last_change":"2024-08-20T04:59:12.793870+0000","last_active":"2024-08-20T05:01:30.357095+0000","last_peered":"2024-08-20T05:01:30.357095+0000","last_clean":"2024-08-20T05:01:30.357095+0000","last_became_active":"2024-08-20T04:59:12.792928+0000","last_became_peered":"2024-08-20T04:59:12.792928+0000","last_unstale":"2024-08-20T05:01:30.357095+0000","last_undegraded":"2024-08-20T05:01:30.357095+0000","last_fullsized":"2024-08-20T05:01:30.357095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:12:25.450347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'17","reported_seq":61,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343461+0000","last_change":"2024-08-20T04:59:09.751403+0000","last_active":"2024-08-20T05:01:30.343461+0000","last_peered":"2024-08-20T05:01:30.343461+0000","last_clean":"2024-08-20T05:01:30.343461+0000","last_became_active":"2024-08-20T04:59:09.750976+0000","last_became_peered":"2024-08-20T04:59:09.750976+0000","last_unstale":"2024-08-20T05:01:30.343461+0000","last_undegraded":"2024-08-20T05:01:30.343461+0000","last_fullsized":"2024-08-20T05:01:30.343461+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:58:54.627836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356432+0000","last_change":"2024-08-20T04:59:21.899813+0000","last_active":"2024-08-20T05:01:30.356432+0000","last_peered":"2024-08-20T05:01:30.356432+0000","last_clean":"2024-08-20T05:01:30.356432+0000","last_became_active":"2024-08-20T04:59:21.899462+0000","last_became_peered":"2024-08-20T04:59:21.899462+0000","last_unstale":"2024-08-20T05:01:30.356432+0000","last_undegraded":"2024-08-20T05:01:30.356432+0000","last_fullsized":"2024-08-20T05:01:30.356432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.468845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355826+0000","last_change":"2024-08-20T04:59:12.783953+0000","last_active":"2024-08-20T05:01:30.355826+0000","last_peered":"2024-08-20T05:01:30.355826+0000","last_clean":"2024-08-20T05:01:30.355826+0000","last_became_active":"2024-08-20T04:59:12.781445+0000","last_became_peered":"2024-08-20T04:59:12.781445+0000","last_unstale":"2024-08-20T05:01:30.355826+0000","last_undegraded":"2024-08-20T05:01:30.355826+0000","last_fullsized":"2024-08-20T05:01:30.355826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:04.792064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356223+0000","last_change":"2024-08-20T05:01:30.355578+0000","last_active":"2024-08-20T05:01:30.356223+0000","last_peered":"2024-08-20T05:01:30.356223+0000","last_clean":"2024-08-20T05:01:30.356223+0000","last_became_active":"2024-08-20T05:01:30.349099+0000","last_became_peered":"2024-08-20T05:01:30.349099+0000","last_unstale":"2024-08-20T05:01:30.356223+0000","last_undegraded":"2024-08-20T05:01:30.356223+0000","last_fullsized":"2024-08-20T05:01:30.356223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:17:57.165914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339956+0000","last_change":"2024-08-20T04:59:21.905202+0000","last_active":"2024-08-20T05:01:30.339956+0000","last_peered":"2024-08-20T05:01:30.339956+0000","last_clean":"2024-08-20T05:01:30.339956+0000","last_became_active":"2024-08-20T04:59:21.904771+0000","last_became_peered":"2024-08-20T04:59:21.904771+0000","last_unstale":"2024-08-20T05:01:30.339956+0000","last_undegraded":"2024-08-20T05:01:30.339956+0000","last_fullsized":"2024-08-20T05:01:30.339956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:35:56.887981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"86'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356122+0000","last_change":"2024-08-20T04:59:12.798301+0000","last_active":"2024-08-20T05:01:30.356122+0000","last_peered":"2024-08-20T05:01:30.356122+0000","last_clean":"2024-08-20T05:01:30.356122+0000","last_became_active":"2024-08-20T04:59:12.797934+0000","last_became_peered":"2024-08-20T04:59:12.797934+0000","last_unstale":"2024-08-20T05:01:30.356122+0000","last_undegraded":"2024-08-20T05:01:30.356122+0000","last_fullsized":"2024-08-20T05:01:30.356122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:41:24.465380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343575+0000","last_change":"2024-08-20T04:59:09.947602+0000","last_active":"2024-08-20T05:01:30.343575+0000","last_peered":"2024-08-20T05:01:30.343575+0000","last_clean":"2024-08-20T05:01:30.343575+0000","last_became_active":"2024-08-20T04:59:09.946795+0000","last_became_peered":"2024-08-20T04:59:09.946795+0000","last_unstale":"2024-08-20T05:01:30.343575+0000","last_undegraded":"2024-08-20T05:01:30.343575+0000","last_fullsized":"2024-08-20T05:01:30.343575+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:09:09.003266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344130+0000","last_change":"2024-08-20T05:00:29.860828+0000","last_active":"2024-08-20T05:01:30.344130+0000","last_peered":"2024-08-20T05:01:30.344130+0000","last_clean":"2024-08-20T05:01:30.344130+0000","last_became_active":"2024-08-20T05:00:29.860242+0000","last_became_peered":"2024-08-20T05:00:29.860242+0000","last_unstale":"2024-08-20T05:01:30.344130+0000","last_undegraded":"2024-08-20T05:01:30.344130+0000","last_fullsized":"2024-08-20T05:01:30.344130+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:09:42.311207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356682+0000","last_change":"2024-08-20T04:59:12.784852+0000","last_active":"2024-08-20T05:01:30.356682+0000","last_peered":"2024-08-20T05:01:30.356682+0000","last_clean":"2024-08-20T05:01:30.356682+0000","last_became_active":"2024-08-20T04:59:12.784496+0000","last_became_peered":"2024-08-20T04:59:12.784496+0000","last_unstale":"2024-08-20T05:01:30.356682+0000","last_undegraded":"2024-08-20T05:01:30.356682+0000","last_fullsized":"2024-08-20T05:01:30.356682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:41:42.421383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":183,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:17.353967+0000","last_change":"2024-08-20T04:59:09.750785+0000","last_active":"2024-08-20T05:02:17.353967+0000","last_peered":"2024-08-20T05:02:17.353967+0000","last_clean":"2024-08-20T05:02:17.353967+0000","last_became_active":"2024-08-20T04:59:09.750255+0000","last_became_peered":"2024-08-20T04:59:09.750255+0000","last_unstale":"2024-08-20T05:02:17.353967+0000","last_undegraded":"2024-08-20T05:02:17.353967+0000","last_fullsized":"2024-08-20T05:02:17.353967+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:20:17.900367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355715+0000","last_change":"2024-08-20T04:59:21.909409+0000","last_active":"2024-08-20T05:01:30.355715+0000","last_peered":"2024-08-20T05:01:30.355715+0000","last_clean":"2024-08-20T05:01:30.355715+0000","last_became_active":"2024-08-20T04:59:21.907934+0000","last_became_peered":"2024-08-20T04:59:21.907934+0000","last_unstale":"2024-08-20T05:01:30.355715+0000","last_undegraded":"2024-08-20T05:01:30.355715+0000","last_fullsized":"2024-08-20T05:01:30.355715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:26:36.768407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355879+0000","last_change":"2024-08-20T04:59:12.783496+0000","last_active":"2024-08-20T05:01:30.355879+0000","last_peered":"2024-08-20T05:01:30.355879+0000","last_clean":"2024-08-20T05:01:30.355879+0000","last_became_active":"2024-08-20T04:59:12.783211+0000","last_became_peered":"2024-08-20T04:59:12.783211+0000","last_unstale":"2024-08-20T05:01:30.355879+0000","last_undegraded":"2024-08-20T05:01:30.355879+0000","last_fullsized":"2024-08-20T05:01:30.355879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:45:49.514189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":186,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:18.357336+0000","last_change":"2024-08-20T04:59:09.948284+0000","last_active":"2024-08-20T05:02:18.357336+0000","last_peered":"2024-08-20T05:02:18.357336+0000","last_clean":"2024-08-20T05:02:18.357336+0000","last_became_active":"2024-08-20T04:59:09.947909+0000","last_became_peered":"2024-08-20T04:59:09.947909+0000","last_unstale":"2024-08-20T05:02:18.357336+0000","last_undegraded":"2024-08-20T05:02:18.357336+0000","last_fullsized":"2024-08-20T05:02:18.357336+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:24:04.344380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":135,"num_read_kb":135,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356288+0000","last_change":"2024-08-20T04:59:21.905282+0000","last_active":"2024-08-20T05:01:30.356288+0000","last_peered":"2024-08-20T05:01:30.356288+0000","last_clean":"2024-08-20T05:01:30.356288+0000","last_became_active":"2024-08-20T04:59:21.904842+0000","last_became_peered":"2024-08-20T04:59:21.904842+0000","last_unstale":"2024-08-20T05:01:30.356288+0000","last_undegraded":"2024-08-20T05:01:30.356288+0000","last_fullsized":"2024-08-20T05:01:30.356288+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:01:19.949949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355357+0000","last_change":"2024-08-20T04:59:12.788571+0000","last_active":"2024-08-20T05:01:30.355357+0000","last_peered":"2024-08-20T05:01:30.355357+0000","last_clean":"2024-08-20T05:01:30.355357+0000","last_became_active":"2024-08-20T04:59:12.784148+0000","last_became_peered":"2024-08-20T04:59:12.784148+0000","last_unstale":"2024-08-20T05:01:30.355357+0000","last_undegraded":"2024-08-20T05:01:30.355357+0000","last_fullsized":"2024-08-20T05:01:30.355357+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:10:51.565404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340278+0000","last_change":"2024-08-20T04:59:09.753842+0000","last_active":"2024-08-20T05:01:30.340278+0000","last_peered":"2024-08-20T05:01:30.340278+0000","last_clean":"2024-08-20T05:01:30.340278+0000","last_became_active":"2024-08-20T04:59:09.753439+0000","last_became_peered":"2024-08-20T04:59:09.753439+0000","last_unstale":"2024-08-20T05:01:30.340278+0000","last_undegraded":"2024-08-20T05:01:30.340278+0000","last_fullsized":"2024-08-20T05:01:30.340278+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:54.171964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356341+0000","last_change":"2024-08-20T04:59:21.909621+0000","last_active":"2024-08-20T05:01:30.356341+0000","last_peered":"2024-08-20T05:01:30.356341+0000","last_clean":"2024-08-20T05:01:30.356341+0000","last_became_active":"2024-08-20T04:59:21.909239+0000","last_became_peered":"2024-08-20T04:59:21.909239+0000","last_unstale":"2024-08-20T05:01:30.356341+0000","last_undegraded":"2024-08-20T05:01:30.356341+0000","last_fullsized":"2024-08-20T05:01:30.356341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:53:15.131163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356523+0000","last_change":"2024-08-20T04:59:12.796643+0000","last_active":"2024-08-20T05:01:30.356523+0000","last_peered":"2024-08-20T05:01:30.356523+0000","last_clean":"2024-08-20T05:01:30.356523+0000","last_became_active":"2024-08-20T04:59:12.796262+0000","last_became_peered":"2024-08-20T04:59:12.796262+0000","last_unstale":"2024-08-20T05:01:30.356523+0000","last_undegraded":"2024-08-20T05:01:30.356523+0000","last_fullsized":"2024-08-20T05:01:30.356523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:11:37.792359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357176+0000","last_change":"2024-08-20T04:59:09.750550+0000","last_active":"2024-08-20T05:01:30.357176+0000","last_peered":"2024-08-20T05:01:30.357176+0000","last_clean":"2024-08-20T05:01:30.357176+0000","last_became_active":"2024-08-20T04:59:09.750097+0000","last_became_peered":"2024-08-20T04:59:09.750097+0000","last_unstale":"2024-08-20T05:01:30.357176+0000","last_undegraded":"2024-08-20T05:01:30.357176+0000","last_fullsized":"2024-08-20T05:01:30.357176+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:32:22.826478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340442+0000","last_change":"2024-08-20T04:57:50.824023+0000","last_active":"2024-08-20T05:01:30.340442+0000","last_peered":"2024-08-20T05:01:30.340442+0000","last_clean":"2024-08-20T05:01:30.340442+0000","last_became_active":"2024-08-20T04:57:50.350587+0000","last_became_peered":"2024-08-20T04:57:50.350587+0000","last_unstale":"2024-08-20T05:01:30.340442+0000","last_undegraded":"2024-08-20T05:01:30.340442+0000","last_fullsized":"2024-08-20T05:01:30.340442+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_clean_scrub_stamp":"2024-08-20T04:54:17.224468+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:59:23.450117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340604+0000","last_change":"2024-08-20T05:00:29.866063+0000","last_active":"2024-08-20T05:01:30.340604+0000","last_peered":"2024-08-20T05:01:30.340604+0000","last_clean":"2024-08-20T05:01:30.340604+0000","last_became_active":"2024-08-20T05:00:29.861545+0000","last_became_peered":"2024-08-20T05:00:29.861545+0000","last_unstale":"2024-08-20T05:01:30.340604+0000","last_undegraded":"2024-08-20T05:01:30.340604+0000","last_fullsized":"2024-08-20T05:01:30.340604+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:02:18.516044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.341028+0000","last_change":"2024-08-20T04:59:12.793799+0000","last_active":"2024-08-20T05:01:30.341028+0000","last_peered":"2024-08-20T05:01:30.341028+0000","last_clean":"2024-08-20T05:01:30.341028+0000","last_became_active":"2024-08-20T04:59:12.793487+0000","last_became_peered":"2024-08-20T04:59:12.793487+0000","last_unstale":"2024-08-20T05:01:30.341028+0000","last_undegraded":"2024-08-20T05:01:30.341028+0000","last_fullsized":"2024-08-20T05:01:30.341028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:08:30.835824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'7","reported_seq":186,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:15.382842+0000","last_change":"2024-08-20T04:59:09.964586+0000","last_active":"2024-08-20T05:02:15.382842+0000","last_peered":"2024-08-20T05:02:15.382842+0000","last_clean":"2024-08-20T05:02:15.382842+0000","last_became_active":"2024-08-20T04:59:09.964258+0000","last_became_peered":"2024-08-20T04:59:09.964258+0000","last_unstale":"2024-08-20T05:02:15.382842+0000","last_undegraded":"2024-08-20T05:02:15.382842+0000","last_fullsized":"2024-08-20T05:02:15.382842+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:37:48.138019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":135,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357127+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T05:01:30.357127+0000","last_peered":"2024-08-20T05:01:30.357127+0000","last_clean":"2024-08-20T05:01:30.357127+0000","last_became_active":"2024-08-20T04:59:21.906197+0000","last_became_peered":"2024-08-20T04:59:21.906197+0000","last_unstale":"2024-08-20T05:01:30.357127+0000","last_undegraded":"2024-08-20T05:01:30.357127+0000","last_fullsized":"2024-08-20T05:01:30.357127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:10:45.819035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340707+0000","last_change":"2024-08-20T04:59:12.794221+0000","last_active":"2024-08-20T05:01:30.340707+0000","last_peered":"2024-08-20T05:01:30.340707+0000","last_clean":"2024-08-20T05:01:30.340707+0000","last_became_active":"2024-08-20T04:59:12.793680+0000","last_became_peered":"2024-08-20T04:59:12.793680+0000","last_unstale":"2024-08-20T05:01:30.340707+0000","last_undegraded":"2024-08-20T05:01:30.340707+0000","last_fullsized":"2024-08-20T05:01:30.340707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:45.435700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356414+0000","last_change":"2024-08-20T04:59:09.755955+0000","last_active":"2024-08-20T05:01:30.356414+0000","last_peered":"2024-08-20T05:01:30.356414+0000","last_clean":"2024-08-20T05:01:30.356414+0000","last_became_active":"2024-08-20T04:59:09.755614+0000","last_became_peered":"2024-08-20T04:59:09.755614+0000","last_unstale":"2024-08-20T05:01:30.356414+0000","last_undegraded":"2024-08-20T05:01:30.356414+0000","last_fullsized":"2024-08-20T05:01:30.356414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:15:06.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338518+0000","last_change":"2024-08-20T04:59:21.915952+0000","last_active":"2024-08-20T05:01:30.338518+0000","last_peered":"2024-08-20T05:01:30.338518+0000","last_clean":"2024-08-20T05:01:30.338518+0000","last_became_active":"2024-08-20T04:59:21.915533+0000","last_became_peered":"2024-08-20T04:59:21.915533+0000","last_unstale":"2024-08-20T05:01:30.338518+0000","last_undegraded":"2024-08-20T05:01:30.338518+0000","last_fullsized":"2024-08-20T05:01:30.338518+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:52:54.906061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340713+0000","last_change":"2024-08-20T04:59:12.782663+0000","last_active":"2024-08-20T05:01:30.340713+0000","last_peered":"2024-08-20T05:01:30.340713+0000","last_clean":"2024-08-20T05:01:30.340713+0000","last_became_active":"2024-08-20T04:59:12.782068+0000","last_became_peered":"2024-08-20T04:59:12.782068+0000","last_unstale":"2024-08-20T05:01:30.340713+0000","last_undegraded":"2024-08-20T05:01:30.340713+0000","last_fullsized":"2024-08-20T05:01:30.340713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:46:39.662033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356158+0000","last_change":"2024-08-20T04:59:09.747456+0000","last_active":"2024-08-20T05:01:30.356158+0000","last_peered":"2024-08-20T05:01:30.356158+0000","last_clean":"2024-08-20T05:01:30.356158+0000","last_became_active":"2024-08-20T04:59:09.747141+0000","last_became_peered":"2024-08-20T04:59:09.747141+0000","last_unstale":"2024-08-20T05:01:30.356158+0000","last_undegraded":"2024-08-20T05:01:30.356158+0000","last_fullsized":"2024-08-20T05:01:30.356158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:39:01.600831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355926+0000","last_change":"2024-08-20T04:59:21.898059+0000","last_active":"2024-08-20T05:01:30.355926+0000","last_peered":"2024-08-20T05:01:30.355926+0000","last_clean":"2024-08-20T05:01:30.355926+0000","last_became_active":"2024-08-20T04:59:21.897617+0000","last_became_peered":"2024-08-20T04:59:21.897617+0000","last_unstale":"2024-08-20T05:01:30.355926+0000","last_undegraded":"2024-08-20T05:01:30.355926+0000","last_fullsized":"2024-08-20T05:01:30.355926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:53:21.122106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340301+0000","last_change":"2024-08-20T05:00:29.372299+0000","last_active":"2024-08-20T05:01:30.340301+0000","last_peered":"2024-08-20T05:01:30.340301+0000","last_clean":"2024-08-20T05:01:30.340301+0000","last_became_active":"2024-08-20T05:00:29.371959+0000","last_became_peered":"2024-08-20T05:00:29.371959+0000","last_unstale":"2024-08-20T05:01:30.340301+0000","last_undegraded":"2024-08-20T05:01:30.340301+0000","last_fullsized":"2024-08-20T05:01:30.340301+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:03.996267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343839+0000","last_change":"2024-08-20T04:59:09.751943+0000","last_active":"2024-08-20T05:01:30.343839+0000","last_peered":"2024-08-20T05:01:30.343839+0000","last_clean":"2024-08-20T05:01:30.343839+0000","last_became_active":"2024-08-20T04:59:09.751586+0000","last_became_peered":"2024-08-20T04:59:09.751586+0000","last_unstale":"2024-08-20T05:01:30.343839+0000","last_undegraded":"2024-08-20T05:01:30.343839+0000","last_fullsized":"2024-08-20T05:01:30.343839+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:35:03.400574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355994+0000","last_change":"2024-08-20T04:59:21.901315+0000","last_active":"2024-08-20T05:01:30.355994+0000","last_peered":"2024-08-20T05:01:30.355994+0000","last_clean":"2024-08-20T05:01:30.355994+0000","last_became_active":"2024-08-20T04:59:21.900871+0000","last_became_peered":"2024-08-20T04:59:21.900871+0000","last_unstale":"2024-08-20T05:01:30.355994+0000","last_undegraded":"2024-08-20T05:01:30.355994+0000","last_fullsized":"2024-08-20T05:01:30.355994+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:39:30.940409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355957+0000","last_change":"2024-08-20T04:59:12.793140+0000","last_active":"2024-08-20T05:01:30.355957+0000","last_peered":"2024-08-20T05:01:30.355957+0000","last_clean":"2024-08-20T05:01:30.355957+0000","last_became_active":"2024-08-20T04:59:12.792678+0000","last_became_peered":"2024-08-20T04:59:12.792678+0000","last_unstale":"2024-08-20T05:01:30.355957+0000","last_undegraded":"2024-08-20T05:01:30.355957+0000","last_fullsized":"2024-08-20T05:01:30.355957+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:07:05.610634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342165+0000","last_change":"2024-08-20T04:59:09.946158+0000","last_active":"2024-08-20T05:01:30.342165+0000","last_peered":"2024-08-20T05:01:30.342165+0000","last_clean":"2024-08-20T05:01:30.342165+0000","last_became_active":"2024-08-20T04:59:09.945736+0000","last_became_peered":"2024-08-20T04:59:09.945736+0000","last_unstale":"2024-08-20T05:01:30.342165+0000","last_undegraded":"2024-08-20T05:01:30.342165+0000","last_fullsized":"2024-08-20T05:01:30.342165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:02.759879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356102+0000","last_change":"2024-08-20T04:59:21.913457+0000","last_active":"2024-08-20T05:01:30.356102+0000","last_peered":"2024-08-20T05:01:30.356102+0000","last_clean":"2024-08-20T05:01:30.356102+0000","last_became_active":"2024-08-20T04:59:21.910468+0000","last_became_peered":"2024-08-20T04:59:21.910468+0000","last_unstale":"2024-08-20T05:01:30.356102+0000","last_undegraded":"2024-08-20T05:01:30.356102+0000","last_fullsized":"2024-08-20T05:01:30.356102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:16:30.817166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340293+0000","last_change":"2024-08-20T04:59:12.788088+0000","last_active":"2024-08-20T05:01:30.340293+0000","last_peered":"2024-08-20T05:01:30.340293+0000","last_clean":"2024-08-20T05:01:30.340293+0000","last_became_active":"2024-08-20T04:59:12.787756+0000","last_became_peered":"2024-08-20T04:59:12.787756+0000","last_unstale":"2024-08-20T05:01:30.340293+0000","last_undegraded":"2024-08-20T05:01:30.340293+0000","last_fullsized":"2024-08-20T05:01:30.340293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:51.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'7","reported_seq":189,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:17.356275+0000","last_change":"2024-08-20T04:59:09.746896+0000","last_active":"2024-08-20T05:02:17.356275+0000","last_peered":"2024-08-20T05:02:17.356275+0000","last_clean":"2024-08-20T05:02:17.356275+0000","last_became_active":"2024-08-20T04:59:09.746570+0000","last_became_peered":"2024-08-20T04:59:09.746570+0000","last_unstale":"2024-08-20T05:02:17.356275+0000","last_undegraded":"2024-08-20T05:02:17.356275+0000","last_fullsized":"2024-08-20T05:02:17.356275+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:06:02.395260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":138,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342767+0000","last_change":"2024-08-20T04:59:21.911747+0000","last_active":"2024-08-20T05:01:30.342767+0000","last_peered":"2024-08-20T05:01:30.342767+0000","last_clean":"2024-08-20T05:01:30.342767+0000","last_became_active":"2024-08-20T04:59:21.908861+0000","last_became_peered":"2024-08-20T04:59:21.908861+0000","last_unstale":"2024-08-20T05:01:30.342767+0000","last_undegraded":"2024-08-20T05:01:30.342767+0000","last_fullsized":"2024-08-20T05:01:30.342767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:22:17.336776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340612+0000","last_change":"2024-08-20T05:00:29.860903+0000","last_active":"2024-08-20T05:01:30.340612+0000","last_peered":"2024-08-20T05:01:30.340612+0000","last_clean":"2024-08-20T05:01:30.340612+0000","last_became_active":"2024-08-20T05:00:29.860359+0000","last_became_peered":"2024-08-20T05:00:29.860359+0000","last_unstale":"2024-08-20T05:01:30.340612+0000","last_undegraded":"2024-08-20T05:01:30.340612+0000","last_fullsized":"2024-08-20T05:01:30.340612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:27:02.976859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355985+0000","last_change":"2024-08-20T04:59:09.755225+0000","last_active":"2024-08-20T05:01:30.355985+0000","last_peered":"2024-08-20T05:01:30.355985+0000","last_clean":"2024-08-20T05:01:30.355985+0000","last_became_active":"2024-08-20T04:59:09.754580+0000","last_became_peered":"2024-08-20T04:59:09.754580+0000","last_unstale":"2024-08-20T05:01:30.355985+0000","last_undegraded":"2024-08-20T05:01:30.355985+0000","last_fullsized":"2024-08-20T05:01:30.355985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:54:53.606954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340025+0000","last_change":"2024-08-20T04:59:21.905200+0000","last_active":"2024-08-20T05:01:30.340025+0000","last_peered":"2024-08-20T05:01:30.340025+0000","last_clean":"2024-08-20T05:01:30.340025+0000","last_became_active":"2024-08-20T04:59:21.904724+0000","last_became_peered":"2024-08-20T04:59:21.904724+0000","last_unstale":"2024-08-20T05:01:30.340025+0000","last_undegraded":"2024-08-20T05:01:30.340025+0000","last_fullsized":"2024-08-20T05:01:30.340025+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:50:43.446750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355643+0000","last_change":"2024-08-20T04:59:12.787261+0000","last_active":"2024-08-20T05:01:30.355643+0000","last_peered":"2024-08-20T05:01:30.355643+0000","last_clean":"2024-08-20T05:01:30.355643+0000","last_became_active":"2024-08-20T04:59:12.786971+0000","last_became_peered":"2024-08-20T04:59:12.786971+0000","last_unstale":"2024-08-20T05:01:30.355643+0000","last_undegraded":"2024-08-20T05:01:30.355643+0000","last_fullsized":"2024-08-20T05:01:30.355643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:55:57.209321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343535+0000","last_change":"2024-08-20T04:59:09.749147+0000","last_active":"2024-08-20T05:01:30.343535+0000","last_peered":"2024-08-20T05:01:30.343535+0000","last_clean":"2024-08-20T05:01:30.343535+0000","last_became_active":"2024-08-20T04:59:09.748806+0000","last_became_peered":"2024-08-20T04:59:09.748806+0000","last_unstale":"2024-08-20T05:01:30.343535+0000","last_undegraded":"2024-08-20T05:01:30.343535+0000","last_fullsized":"2024-08-20T05:01:30.343535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:59:43.377105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356203+0000","last_change":"2024-08-20T04:59:21.905007+0000","last_active":"2024-08-20T05:01:30.356203+0000","last_peered":"2024-08-20T05:01:30.356203+0000","last_clean":"2024-08-20T05:01:30.356203+0000","last_became_active":"2024-08-20T04:59:21.904608+0000","last_became_peered":"2024-08-20T04:59:21.904608+0000","last_unstale":"2024-08-20T05:01:30.356203+0000","last_undegraded":"2024-08-20T05:01:30.356203+0000","last_fullsized":"2024-08-20T05:01:30.356203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:00:42.390966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342457+0000","last_change":"2024-08-20T04:59:12.783339+0000","last_active":"2024-08-20T05:01:30.342457+0000","last_peered":"2024-08-20T05:01:30.342457+0000","last_clean":"2024-08-20T05:01:30.342457+0000","last_became_active":"2024-08-20T04:59:12.783051+0000","last_became_peered":"2024-08-20T04:59:12.783051+0000","last_unstale":"2024-08-20T05:01:30.342457+0000","last_undegraded":"2024-08-20T05:01:30.342457+0000","last_fullsized":"2024-08-20T05:01:30.342457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:23:54.390491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'42","reported_seq":365,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:18.524476+0000","last_change":"2024-08-20T04:59:09.754340+0000","last_active":"2024-08-20T05:02:18.524476+0000","last_peered":"2024-08-20T05:02:18.524476+0000","last_clean":"2024-08-20T05:02:18.524476+0000","last_became_active":"2024-08-20T04:59:09.754000+0000","last_became_peered":"2024-08-20T04:59:09.754000+0000","last_unstale":"2024-08-20T05:02:18.524476+0000","last_undegraded":"2024-08-20T05:02:18.524476+0000","last_fullsized":"2024-08-20T05:02:18.524476+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:26:17.256961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69413,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":278,"num_read_kb":208,"num_write":44,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342495+0000","last_change":"2024-08-20T04:59:21.910369+0000","last_active":"2024-08-20T05:01:30.342495+0000","last_peered":"2024-08-20T05:01:30.342495+0000","last_clean":"2024-08-20T05:01:30.342495+0000","last_became_active":"2024-08-20T04:59:21.909941+0000","last_became_peered":"2024-08-20T04:59:21.909941+0000","last_unstale":"2024-08-20T05:01:30.342495+0000","last_undegraded":"2024-08-20T05:01:30.342495+0000","last_fullsized":"2024-08-20T05:01:30.342495+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:27:07.088021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356969+0000","last_change":"2024-08-20T04:59:12.787747+0000","last_active":"2024-08-20T05:01:30.356969+0000","last_peered":"2024-08-20T05:01:30.356969+0000","last_clean":"2024-08-20T05:01:30.356969+0000","last_became_active":"2024-08-20T04:59:12.786962+0000","last_became_peered":"2024-08-20T04:59:12.786962+0000","last_unstale":"2024-08-20T05:01:30.356969+0000","last_undegraded":"2024-08-20T05:01:30.356969+0000","last_fullsized":"2024-08-20T05:01:30.356969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:14:43.822829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356420+0000","last_change":"2024-08-20T04:59:09.947582+0000","last_active":"2024-08-20T05:01:30.356420+0000","last_peered":"2024-08-20T05:01:30.356420+0000","last_clean":"2024-08-20T05:01:30.356420+0000","last_became_active":"2024-08-20T04:59:09.947117+0000","last_became_peered":"2024-08-20T04:59:09.947117+0000","last_unstale":"2024-08-20T05:01:30.356420+0000","last_undegraded":"2024-08-20T05:01:30.356420+0000","last_fullsized":"2024-08-20T05:01:30.356420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:22:05.815486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357390+0000","last_change":"2024-08-20T04:59:21.910776+0000","last_active":"2024-08-20T05:01:30.357390+0000","last_peered":"2024-08-20T05:01:30.357390+0000","last_clean":"2024-08-20T05:01:30.357390+0000","last_became_active":"2024-08-20T04:59:21.909726+0000","last_became_peered":"2024-08-20T04:59:21.909726+0000","last_unstale":"2024-08-20T05:01:30.357390+0000","last_undegraded":"2024-08-20T05:01:30.357390+0000","last_fullsized":"2024-08-20T05:01:30.357390+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:03:04.042649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338903+0000","last_change":"2024-08-20T05:00:29.860637+0000","last_active":"2024-08-20T05:01:30.338903+0000","last_peered":"2024-08-20T05:01:30.338903+0000","last_clean":"2024-08-20T05:01:30.338903+0000","last_became_active":"2024-08-20T05:00:29.860250+0000","last_became_peered":"2024-08-20T05:00:29.860250+0000","last_unstale":"2024-08-20T05:01:30.338903+0000","last_undegraded":"2024-08-20T05:01:30.338903+0000","last_fullsized":"2024-08-20T05:01:30.338903+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:11:27.937844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340908+0000","last_change":"2024-08-20T04:59:09.747316+0000","last_active":"2024-08-20T05:01:30.340908+0000","last_peered":"2024-08-20T05:01:30.340908+0000","last_clean":"2024-08-20T05:01:30.340908+0000","last_became_active":"2024-08-20T04:59:09.746959+0000","last_became_peered":"2024-08-20T04:59:09.746959+0000","last_unstale":"2024-08-20T05:01:30.340908+0000","last_undegraded":"2024-08-20T05:01:30.340908+0000","last_fullsized":"2024-08-20T05:01:30.340908+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:28.480465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342302+0000","last_change":"2024-08-20T04:59:21.907940+0000","last_active":"2024-08-20T05:01:30.342302+0000","last_peered":"2024-08-20T05:01:30.342302+0000","last_clean":"2024-08-20T05:01:30.342302+0000","last_became_active":"2024-08-20T04:59:21.907591+0000","last_became_peered":"2024-08-20T04:59:21.907591+0000","last_unstale":"2024-08-20T05:01:30.342302+0000","last_undegraded":"2024-08-20T05:01:30.342302+0000","last_fullsized":"2024-08-20T05:01:30.342302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:33.583556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357523+0000","last_change":"2024-08-20T04:59:12.795662+0000","last_active":"2024-08-20T05:01:30.357523+0000","last_peered":"2024-08-20T05:01:30.357523+0000","last_clean":"2024-08-20T05:01:30.357523+0000","last_became_active":"2024-08-20T04:59:12.795321+0000","last_became_peered":"2024-08-20T04:59:12.795321+0000","last_unstale":"2024-08-20T05:01:30.357523+0000","last_undegraded":"2024-08-20T05:01:30.357523+0000","last_fullsized":"2024-08-20T05:01:30.357523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:40:30.561306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'5","reported_seq":316,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:18.387501+0000","last_change":"2024-08-20T04:59:09.754468+0000","last_active":"2024-08-20T05:02:18.387501+0000","last_peered":"2024-08-20T05:02:18.387501+0000","last_clean":"2024-08-20T05:02:18.387501+0000","last_became_active":"2024-08-20T04:59:09.754115+0000","last_became_peered":"2024-08-20T04:59:09.754115+0000","last_unstale":"2024-08-20T05:02:18.387501+0000","last_undegraded":"2024-08-20T05:02:18.387501+0000","last_fullsized":"2024-08-20T05:02:18.387501+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:50:21.301246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":266,"num_read_kb":266,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356257+0000","last_change":"2024-08-20T04:59:21.898785+0000","last_active":"2024-08-20T05:01:30.356257+0000","last_peered":"2024-08-20T05:01:30.356257+0000","last_clean":"2024-08-20T05:01:30.356257+0000","last_became_active":"2024-08-20T04:59:21.898423+0000","last_became_peered":"2024-08-20T04:59:21.898423+0000","last_unstale":"2024-08-20T05:01:30.356257+0000","last_undegraded":"2024-08-20T05:01:30.356257+0000","last_fullsized":"2024-08-20T05:01:30.356257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:52:58.800104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338624+0000","last_change":"2024-08-20T04:59:21.906208+0000","last_active":"2024-08-20T05:01:30.338624+0000","last_peered":"2024-08-20T05:01:30.338624+0000","last_clean":"2024-08-20T05:01:30.338624+0000","last_became_active":"2024-08-20T04:59:21.905041+0000","last_became_peered":"2024-08-20T04:59:21.905041+0000","last_unstale":"2024-08-20T05:01:30.338624+0000","last_undegraded":"2024-08-20T05:01:30.338624+0000","last_fullsized":"2024-08-20T05:01:30.338624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:05:28.971357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342413+0000","last_change":"2024-08-20T04:59:12.788130+0000","last_active":"2024-08-20T05:01:30.342413+0000","last_peered":"2024-08-20T05:01:30.342413+0000","last_clean":"2024-08-20T05:01:30.342413+0000","last_became_active":"2024-08-20T04:59:12.787665+0000","last_became_peered":"2024-08-20T04:59:12.787665+0000","last_unstale":"2024-08-20T05:01:30.342413+0000","last_undegraded":"2024-08-20T05:01:30.342413+0000","last_fullsized":"2024-08-20T05:01:30.342413+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:59:39.628781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356172+0000","last_change":"2024-08-20T04:59:09.754842+0000","last_active":"2024-08-20T05:01:30.356172+0000","last_peered":"2024-08-20T05:01:30.356172+0000","last_clean":"2024-08-20T05:01:30.356172+0000","last_became_active":"2024-08-20T04:59:09.754515+0000","last_became_peered":"2024-08-20T04:59:09.754515+0000","last_unstale":"2024-08-20T05:01:30.356172+0000","last_undegraded":"2024-08-20T05:01:30.356172+0000","last_fullsized":"2024-08-20T05:01:30.356172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:19:02.241567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340312+0000","last_change":"2024-08-20T04:59:21.900610+0000","last_active":"2024-08-20T05:01:30.340312+0000","last_peered":"2024-08-20T05:01:30.340312+0000","last_clean":"2024-08-20T05:01:30.340312+0000","last_became_active":"2024-08-20T04:59:21.900207+0000","last_became_peered":"2024-08-20T04:59:21.900207+0000","last_unstale":"2024-08-20T05:01:30.340312+0000","last_undegraded":"2024-08-20T05:01:30.340312+0000","last_fullsized":"2024-08-20T05:01:30.340312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:41:00.115344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356667+0000","last_change":"2024-08-20T04:59:12.780772+0000","last_active":"2024-08-20T05:01:30.356667+0000","last_peered":"2024-08-20T05:01:30.356667+0000","last_clean":"2024-08-20T05:01:30.356667+0000","last_became_active":"2024-08-20T04:59:12.780385+0000","last_became_peered":"2024-08-20T04:59:12.780385+0000","last_unstale":"2024-08-20T05:01:30.356667+0000","last_undegraded":"2024-08-20T05:01:30.356667+0000","last_fullsized":"2024-08-20T05:01:30.356667+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:23.680899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355522+0000","last_change":"2024-08-20T04:59:09.749567+0000","last_active":"2024-08-20T05:01:30.355522+0000","last_peered":"2024-08-20T05:01:30.355522+0000","last_clean":"2024-08-20T05:01:30.355522+0000","last_became_active":"2024-08-20T04:59:09.749204+0000","last_became_peered":"2024-08-20T04:59:09.749204+0000","last_unstale":"2024-08-20T05:01:30.355522+0000","last_undegraded":"2024-08-20T05:01:30.355522+0000","last_fullsized":"2024-08-20T05:01:30.355522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:57:51.236459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356327+0000","last_change":"2024-08-20T04:59:09.751622+0000","last_active":"2024-08-20T05:01:30.356327+0000","last_peered":"2024-08-20T05:01:30.356327+0000","last_clean":"2024-08-20T05:01:30.356327+0000","last_became_active":"2024-08-20T04:59:09.751227+0000","last_became_peered":"2024-08-20T04:59:09.751227+0000","last_unstale":"2024-08-20T05:01:30.356327+0000","last_undegraded":"2024-08-20T05:01:30.356327+0000","last_fullsized":"2024-08-20T05:01:30.356327+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:53:38.755122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356190+0000","last_change":"2024-08-20T04:59:12.789243+0000","last_active":"2024-08-20T05:01:30.356190+0000","last_peered":"2024-08-20T05:01:30.356190+0000","last_clean":"2024-08-20T05:01:30.356190+0000","last_became_active":"2024-08-20T04:59:12.788932+0000","last_became_peered":"2024-08-20T04:59:12.788932+0000","last_unstale":"2024-08-20T05:01:30.356190+0000","last_undegraded":"2024-08-20T05:01:30.356190+0000","last_fullsized":"2024-08-20T05:01:30.356190+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:27:00.122328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343578+0000","last_change":"2024-08-20T04:59:21.902847+0000","last_active":"2024-08-20T05:01:30.343578+0000","last_peered":"2024-08-20T05:01:30.343578+0000","last_clean":"2024-08-20T05:01:30.343578+0000","last_became_active":"2024-08-20T04:59:21.902426+0000","last_became_peered":"2024-08-20T04:59:21.902426+0000","last_unstale":"2024-08-20T05:01:30.343578+0000","last_undegraded":"2024-08-20T05:01:30.343578+0000","last_fullsized":"2024-08-20T05:01:30.343578+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:18:38.107358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":194,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:13.517838+0000","last_change":"2024-08-20T05:00:29.375139+0000","last_active":"2024-08-20T05:02:13.517838+0000","last_peered":"2024-08-20T05:02:13.517838+0000","last_clean":"2024-08-20T05:02:13.517838+0000","last_became_active":"2024-08-20T05:00:29.370896+0000","last_became_peered":"2024-08-20T05:00:29.370896+0000","last_unstale":"2024-08-20T05:02:13.517838+0000","last_undegraded":"2024-08-20T05:02:13.517838+0000","last_fullsized":"2024-08-20T05:02:13.517838+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:06:48.033558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342418+0000","last_change":"2024-08-20T04:59:12.785811+0000","last_active":"2024-08-20T05:01:30.342418+0000","last_peered":"2024-08-20T05:01:30.342418+0000","last_clean":"2024-08-20T05:01:30.342418+0000","last_became_active":"2024-08-20T04:59:12.785483+0000","last_became_peered":"2024-08-20T04:59:12.785483+0000","last_unstale":"2024-08-20T05:01:30.342418+0000","last_undegraded":"2024-08-20T05:01:30.342418+0000","last_fullsized":"2024-08-20T05:01:30.342418+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:31:25.355197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344575+0000","last_change":"2024-08-20T04:59:21.897832+0000","last_active":"2024-08-20T05:01:30.344575+0000","last_peered":"2024-08-20T05:01:30.344575+0000","last_clean":"2024-08-20T05:01:30.344575+0000","last_became_active":"2024-08-20T04:59:21.897457+0000","last_became_peered":"2024-08-20T04:59:21.897457+0000","last_unstale":"2024-08-20T05:01:30.344575+0000","last_undegraded":"2024-08-20T05:01:30.344575+0000","last_fullsized":"2024-08-20T05:01:30.344575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:39:51.934014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339787+0000","last_change":"2024-08-20T04:59:12.787671+0000","last_active":"2024-08-20T05:01:30.339787+0000","last_peered":"2024-08-20T05:01:30.339787+0000","last_clean":"2024-08-20T05:01:30.339787+0000","last_became_active":"2024-08-20T04:59:12.787372+0000","last_became_peered":"2024-08-20T04:59:12.787372+0000","last_unstale":"2024-08-20T05:01:30.339787+0000","last_undegraded":"2024-08-20T05:01:30.339787+0000","last_fullsized":"2024-08-20T05:01:30.339787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:16:55.031031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344513+0000","last_change":"2024-08-20T04:59:12.792192+0000","last_active":"2024-08-20T05:01:30.344513+0000","last_peered":"2024-08-20T05:01:30.344513+0000","last_clean":"2024-08-20T05:01:30.344513+0000","last_became_active":"2024-08-20T04:59:12.791447+0000","last_became_peered":"2024-08-20T04:59:12.791447+0000","last_unstale":"2024-08-20T05:01:30.344513+0000","last_undegraded":"2024-08-20T05:01:30.344513+0000","last_fullsized":"2024-08-20T05:01:30.344513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:03:32.559245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343399+0000","last_change":"2024-08-20T04:59:12.785393+0000","last_active":"2024-08-20T05:01:30.343399+0000","last_peered":"2024-08-20T05:01:30.343399+0000","last_clean":"2024-08-20T05:01:30.343399+0000","last_became_active":"2024-08-20T04:59:12.784998+0000","last_became_peered":"2024-08-20T04:59:12.784998+0000","last_unstale":"2024-08-20T05:01:30.343399+0000","last_undegraded":"2024-08-20T05:01:30.343399+0000","last_fullsized":"2024-08-20T05:01:30.343399+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:27:04.964290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338483+0000","last_change":"2024-08-20T04:59:12.784730+0000","last_active":"2024-08-20T05:01:30.338483+0000","last_peered":"2024-08-20T05:01:30.338483+0000","last_clean":"2024-08-20T05:01:30.338483+0000","last_became_active":"2024-08-20T04:59:12.784269+0000","last_became_peered":"2024-08-20T04:59:12.784269+0000","last_unstale":"2024-08-20T05:01:30.338483+0000","last_undegraded":"2024-08-20T05:01:30.338483+0000","last_fullsized":"2024-08-20T05:01:30.338483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:43:12.248033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355819+0000","last_change":"2024-08-20T04:59:12.786484+0000","last_active":"2024-08-20T05:01:30.355819+0000","last_peered":"2024-08-20T05:01:30.355819+0000","last_clean":"2024-08-20T05:01:30.355819+0000","last_became_active":"2024-08-20T04:59:12.786166+0000","last_became_peered":"2024-08-20T04:59:12.786166+0000","last_unstale":"2024-08-20T05:01:30.355819+0000","last_undegraded":"2024-08-20T05:01:30.355819+0000","last_fullsized":"2024-08-20T05:01:30.355819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:30.084519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340680+0000","last_change":"2024-08-20T04:59:12.786985+0000","last_active":"2024-08-20T05:01:30.340680+0000","last_peered":"2024-08-20T05:01:30.340680+0000","last_clean":"2024-08-20T05:01:30.340680+0000","last_became_active":"2024-08-20T04:59:12.786674+0000","last_became_peered":"2024-08-20T04:59:12.786674+0000","last_unstale":"2024-08-20T05:01:30.340680+0000","last_undegraded":"2024-08-20T05:01:30.340680+0000","last_fullsized":"2024-08-20T05:01:30.340680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:30:59.996149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344184+0000","last_change":"2024-08-20T04:59:12.796410+0000","last_active":"2024-08-20T05:01:30.344184+0000","last_peered":"2024-08-20T05:01:30.344184+0000","last_clean":"2024-08-20T05:01:30.344184+0000","last_became_active":"2024-08-20T04:59:12.796081+0000","last_became_peered":"2024-08-20T04:59:12.796081+0000","last_unstale":"2024-08-20T05:01:30.344184+0000","last_undegraded":"2024-08-20T05:01:30.344184+0000","last_fullsized":"2024-08-20T05:01:30.344184+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:49:09.706265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357071+0000","last_change":"2024-08-20T04:59:12.795994+0000","last_active":"2024-08-20T05:01:30.357071+0000","last_peered":"2024-08-20T05:01:30.357071+0000","last_clean":"2024-08-20T05:01:30.357071+0000","last_became_active":"2024-08-20T04:59:12.795604+0000","last_became_peered":"2024-08-20T04:59:12.795604+0000","last_unstale":"2024-08-20T05:01:30.357071+0000","last_undegraded":"2024-08-20T05:01:30.357071+0000","last_fullsized":"2024-08-20T05:01:30.357071+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:54:09.628743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355741+0000","last_change":"2024-08-20T04:59:12.788966+0000","last_active":"2024-08-20T05:01:30.355741+0000","last_peered":"2024-08-20T05:01:30.355741+0000","last_clean":"2024-08-20T05:01:30.355741+0000","last_became_active":"2024-08-20T04:59:12.788534+0000","last_became_peered":"2024-08-20T04:59:12.788534+0000","last_unstale":"2024-08-20T05:01:30.355741+0000","last_undegraded":"2024-08-20T05:01:30.355741+0000","last_fullsized":"2024-08-20T05:01:30.355741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.615399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356431+0000","last_change":"2024-08-20T04:59:12.785914+0000","last_active":"2024-08-20T05:01:30.356431+0000","last_peered":"2024-08-20T05:01:30.356431+0000","last_clean":"2024-08-20T05:01:30.356431+0000","last_became_active":"2024-08-20T04:59:12.785551+0000","last_became_peered":"2024-08-20T04:59:12.785551+0000","last_unstale":"2024-08-20T05:01:30.356431+0000","last_undegraded":"2024-08-20T05:01:30.356431+0000","last_fullsized":"2024-08-20T05:01:30.356431+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:30:32.072387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357188+0000","last_change":"2024-08-20T04:59:12.795635+0000","last_active":"2024-08-20T05:01:30.357188+0000","last_peered":"2024-08-20T05:01:30.357188+0000","last_clean":"2024-08-20T05:01:30.357188+0000","last_became_active":"2024-08-20T04:59:12.794805+0000","last_became_peered":"2024-08-20T04:59:12.794805+0000","last_unstale":"2024-08-20T05:01:30.357188+0000","last_undegraded":"2024-08-20T05:01:30.357188+0000","last_fullsized":"2024-08-20T05:01:30.357188+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:09:08.725503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355737+0000","last_change":"2024-08-20T04:59:12.785099+0000","last_active":"2024-08-20T05:01:30.355737+0000","last_peered":"2024-08-20T05:01:30.355737+0000","last_clean":"2024-08-20T05:01:30.355737+0000","last_became_active":"2024-08-20T04:59:12.784727+0000","last_became_peered":"2024-08-20T04:59:12.784727+0000","last_unstale":"2024-08-20T05:01:30.355737+0000","last_undegraded":"2024-08-20T05:01:30.355737+0000","last_fullsized":"2024-08-20T05:01:30.355737+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:24:36.227289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340160+0000","last_change":"2024-08-20T04:59:12.781832+0000","last_active":"2024-08-20T05:01:30.340160+0000","last_peered":"2024-08-20T05:01:30.340160+0000","last_clean":"2024-08-20T05:01:30.340160+0000","last_became_active":"2024-08-20T04:59:12.781342+0000","last_became_peered":"2024-08-20T04:59:12.781342+0000","last_unstale":"2024-08-20T05:01:30.340160+0000","last_undegraded":"2024-08-20T05:01:30.340160+0000","last_fullsized":"2024-08-20T05:01:30.340160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:26:17.762048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344755+0000","last_change":"2024-08-20T04:59:12.792350+0000","last_active":"2024-08-20T05:01:30.344755+0000","last_peered":"2024-08-20T05:01:30.344755+0000","last_clean":"2024-08-20T05:01:30.344755+0000","last_became_active":"2024-08-20T04:59:12.792028+0000","last_became_peered":"2024-08-20T04:59:12.792028+0000","last_unstale":"2024-08-20T05:01:30.344755+0000","last_undegraded":"2024-08-20T05:01:30.344755+0000","last_fullsized":"2024-08-20T05:01:30.344755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:16:23.173759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343346+0000","last_change":"2024-08-20T04:59:12.795047+0000","last_active":"2024-08-20T05:01:30.343346+0000","last_peered":"2024-08-20T05:01:30.343346+0000","last_clean":"2024-08-20T05:01:30.343346+0000","last_became_active":"2024-08-20T04:59:12.794705+0000","last_became_peered":"2024-08-20T04:59:12.794705+0000","last_unstale":"2024-08-20T05:01:30.343346+0000","last_undegraded":"2024-08-20T05:01:30.343346+0000","last_fullsized":"2024-08-20T05:01:30.343346+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:51:16.355892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340659+0000","last_change":"2024-08-20T04:59:12.785022+0000","last_active":"2024-08-20T05:01:30.340659+0000","last_peered":"2024-08-20T05:01:30.340659+0000","last_clean":"2024-08-20T05:01:30.340659+0000","last_became_active":"2024-08-20T04:59:12.784730+0000","last_became_peered":"2024-08-20T04:59:12.784730+0000","last_unstale":"2024-08-20T05:01:30.340659+0000","last_undegraded":"2024-08-20T05:01:30.340659+0000","last_fullsized":"2024-08-20T05:01:30.340659+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:21:53.053890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356636+0000","last_change":"2024-08-20T04:59:12.790825+0000","last_active":"2024-08-20T05:01:30.356636+0000","last_peered":"2024-08-20T05:01:30.356636+0000","last_clean":"2024-08-20T05:01:30.356636+0000","last_became_active":"2024-08-20T04:59:12.790299+0000","last_became_peered":"2024-08-20T04:59:12.790299+0000","last_unstale":"2024-08-20T05:01:30.356636+0000","last_undegraded":"2024-08-20T05:01:30.356636+0000","last_fullsized":"2024-08-20T05:01:30.356636+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:12.477186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338217+0000","last_change":"2024-08-20T05:00:29.374190+0000","last_active":"2024-08-20T05:01:30.338217+0000","last_peered":"2024-08-20T05:01:30.338217+0000","last_clean":"2024-08-20T05:01:30.338217+0000","last_became_active":"2024-08-20T05:00:29.373844+0000","last_became_peered":"2024-08-20T05:00:29.373844+0000","last_unstale":"2024-08-20T05:01:30.338217+0000","last_undegraded":"2024-08-20T05:01:30.338217+0000","last_fullsized":"2024-08-20T05:01:30.338217+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:03.131340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338379+0000","last_change":"2024-08-20T04:59:12.783355+0000","last_active":"2024-08-20T05:01:30.338379+0000","last_peered":"2024-08-20T05:01:30.338379+0000","last_clean":"2024-08-20T05:01:30.338379+0000","last_became_active":"2024-08-20T04:59:12.782992+0000","last_became_peered":"2024-08-20T04:59:12.782992+0000","last_unstale":"2024-08-20T05:01:30.338379+0000","last_undegraded":"2024-08-20T05:01:30.338379+0000","last_fullsized":"2024-08-20T05:01:30.338379+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:09:47.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355676+0000","last_change":"2024-08-20T04:59:12.783989+0000","last_active":"2024-08-20T05:01:30.355676+0000","last_peered":"2024-08-20T05:01:30.355676+0000","last_clean":"2024-08-20T05:01:30.355676+0000","last_became_active":"2024-08-20T04:59:12.783671+0000","last_became_peered":"2024-08-20T04:59:12.783671+0000","last_unstale":"2024-08-20T05:01:30.355676+0000","last_undegraded":"2024-08-20T05:01:30.355676+0000","last_fullsized":"2024-08-20T05:01:30.355676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:34:55.727599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357140+0000","last_change":"2024-08-20T04:59:12.787118+0000","last_active":"2024-08-20T05:01:30.357140+0000","last_peered":"2024-08-20T05:01:30.357140+0000","last_clean":"2024-08-20T05:01:30.357140+0000","last_became_active":"2024-08-20T04:59:12.786754+0000","last_became_peered":"2024-08-20T04:59:12.786754+0000","last_unstale":"2024-08-20T05:01:30.357140+0000","last_undegraded":"2024-08-20T05:01:30.357140+0000","last_fullsized":"2024-08-20T05:01:30.357140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:13:23.959972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340919+0000","last_change":"2024-08-20T04:59:12.793748+0000","last_active":"2024-08-20T05:01:30.340919+0000","last_peered":"2024-08-20T05:01:30.340919+0000","last_clean":"2024-08-20T05:01:30.340919+0000","last_became_active":"2024-08-20T04:59:12.792550+0000","last_became_peered":"2024-08-20T04:59:12.792550+0000","last_unstale":"2024-08-20T05:01:30.340919+0000","last_undegraded":"2024-08-20T05:01:30.340919+0000","last_fullsized":"2024-08-20T05:01:30.340919+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:59:24.226273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356824+0000","last_change":"2024-08-20T04:59:12.788827+0000","last_active":"2024-08-20T05:01:30.356824+0000","last_peered":"2024-08-20T05:01:30.356824+0000","last_clean":"2024-08-20T05:01:30.356824+0000","last_became_active":"2024-08-20T04:59:12.788395+0000","last_became_peered":"2024-08-20T04:59:12.788395+0000","last_unstale":"2024-08-20T05:01:30.356824+0000","last_undegraded":"2024-08-20T05:01:30.356824+0000","last_fullsized":"2024-08-20T05:01:30.356824+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:26.453063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357616+0000","last_change":"2024-08-20T04:59:12.795513+0000","last_active":"2024-08-20T05:01:30.357616+0000","last_peered":"2024-08-20T05:01:30.357616+0000","last_clean":"2024-08-20T05:01:30.357616+0000","last_became_active":"2024-08-20T04:59:12.795191+0000","last_became_peered":"2024-08-20T04:59:12.795191+0000","last_unstale":"2024-08-20T05:01:30.357616+0000","last_undegraded":"2024-08-20T05:01:30.357616+0000","last_fullsized":"2024-08-20T05:01:30.357616+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:04:00.893420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356614+0000","last_change":"2024-08-20T04:59:12.789825+0000","last_active":"2024-08-20T05:01:30.356614+0000","last_peered":"2024-08-20T05:01:30.356614+0000","last_clean":"2024-08-20T05:01:30.356614+0000","last_became_active":"2024-08-20T04:59:12.788198+0000","last_became_peered":"2024-08-20T04:59:12.788198+0000","last_unstale":"2024-08-20T05:01:30.356614+0000","last_undegraded":"2024-08-20T05:01:30.356614+0000","last_fullsized":"2024-08-20T05:01:30.356614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:10.898308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340338+0000","last_change":"2024-08-20T04:59:12.787707+0000","last_active":"2024-08-20T05:01:30.340338+0000","last_peered":"2024-08-20T05:01:30.340338+0000","last_clean":"2024-08-20T05:01:30.340338+0000","last_became_active":"2024-08-20T04:59:12.787035+0000","last_became_peered":"2024-08-20T04:59:12.787035+0000","last_unstale":"2024-08-20T05:01:30.340338+0000","last_undegraded":"2024-08-20T05:01:30.340338+0000","last_fullsized":"2024-08-20T05:01:30.340338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:16:52.451048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356216+0000","last_change":"2024-08-20T04:59:12.784012+0000","last_active":"2024-08-20T05:01:30.356216+0000","last_peered":"2024-08-20T05:01:30.356216+0000","last_clean":"2024-08-20T05:01:30.356216+0000","last_became_active":"2024-08-20T04:59:12.783599+0000","last_became_peered":"2024-08-20T04:59:12.783599+0000","last_unstale":"2024-08-20T05:01:30.356216+0000","last_undegraded":"2024-08-20T05:01:30.356216+0000","last_fullsized":"2024-08-20T05:01:30.356216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:23:15.271873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342676+0000","last_change":"2024-08-20T04:59:12.784987+0000","last_active":"2024-08-20T05:01:30.342676+0000","last_peered":"2024-08-20T05:01:30.342676+0000","last_clean":"2024-08-20T05:01:30.342676+0000","last_became_active":"2024-08-20T04:59:12.784693+0000","last_became_peered":"2024-08-20T04:59:12.784693+0000","last_unstale":"2024-08-20T05:01:30.342676+0000","last_undegraded":"2024-08-20T05:01:30.342676+0000","last_fullsized":"2024-08-20T05:01:30.342676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:07:51.624602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357088+0000","last_change":"2024-08-20T04:59:12.792466+0000","last_active":"2024-08-20T05:01:30.357088+0000","last_peered":"2024-08-20T05:01:30.357088+0000","last_clean":"2024-08-20T05:01:30.357088+0000","last_became_active":"2024-08-20T04:59:12.792114+0000","last_became_peered":"2024-08-20T04:59:12.792114+0000","last_unstale":"2024-08-20T05:01:30.357088+0000","last_undegraded":"2024-08-20T05:01:30.357088+0000","last_fullsized":"2024-08-20T05:01:30.357088+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:23:09.919907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338528+0000","last_change":"2024-08-20T04:59:12.793041+0000","last_active":"2024-08-20T05:01:30.338528+0000","last_peered":"2024-08-20T05:01:30.338528+0000","last_clean":"2024-08-20T05:01:30.338528+0000","last_became_active":"2024-08-20T04:59:12.792709+0000","last_became_peered":"2024-08-20T04:59:12.792709+0000","last_unstale":"2024-08-20T05:01:30.338528+0000","last_undegraded":"2024-08-20T05:01:30.338528+0000","last_fullsized":"2024-08-20T05:01:30.338528+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:09:04.523493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338652+0000","last_change":"2024-08-20T04:59:12.790256+0000","last_active":"2024-08-20T05:01:30.338652+0000","last_peered":"2024-08-20T05:01:30.338652+0000","last_clean":"2024-08-20T05:01:30.338652+0000","last_became_active":"2024-08-20T04:59:12.788467+0000","last_became_peered":"2024-08-20T04:59:12.788467+0000","last_unstale":"2024-08-20T05:01:30.338652+0000","last_undegraded":"2024-08-20T05:01:30.338652+0000","last_fullsized":"2024-08-20T05:01:30.338652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:55:31.386030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340563+0000","last_change":"2024-08-20T04:59:12.794882+0000","last_active":"2024-08-20T05:01:30.340563+0000","last_peered":"2024-08-20T05:01:30.340563+0000","last_clean":"2024-08-20T05:01:30.340563+0000","last_became_active":"2024-08-20T04:59:12.794564+0000","last_became_peered":"2024-08-20T04:59:12.794564+0000","last_unstale":"2024-08-20T05:01:30.340563+0000","last_undegraded":"2024-08-20T05:01:30.340563+0000","last_fullsized":"2024-08-20T05:01:30.340563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:36:47.515754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":76899,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1360,"num_read_kb":771,"num_write":264,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":734,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":230697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743476,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1028096,"data_stored":510687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939705,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28708,"kb_used_data":1684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716444,"statfs":{"total":95995035648,"available":95965638656,"internally_reserved":0,"allocated":1724416,"data_stored":1170900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103231,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1044480,"data_stored":509973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299460,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1032192,"data_stored":510239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462984,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1638400,"data_stored":1106989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626511,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":505477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822739,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1646592,"data_stored":1102039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986264,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1036288,"data_stored":510705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182493,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1032192,"data_stored":505185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411428,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36424,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708728,"statfs":{"total":95995035648,"available":95957737472,"internally_reserved":0,"allocated":1105920,"data_stored":576050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":575920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738477,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1044480,"data_stored":507465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":71165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":71295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":71681,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T05:02:22.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-20T05:02:22.337 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:22.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:22 smithi037 ceph-mon[17265]: from='client.15438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:22.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:22 smithi135 ceph-mon[22342]: from='client.15438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:22.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.940+0000 7f68b4e00640 1 -- 172.21.15.37:0/3672010424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b010b030 msgr2=0x7f68b0111830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:22.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.940+0000 7f68b4e00640 1 --2- 172.21.15.37:0/3672010424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b010b030 0x7f68b0111830 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009ca0 tx=0x7f68a802a8c0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.941+0000 7f68b4e00640 1 -- 172.21.15.37:0/3672010424 shutdown_connections 2024-08-20T05:02:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.941+0000 7f68b4e00640 1 --2- 172.21.15.37:0/3672010424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b010b030 0x7f68b0111830 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.941+0000 7f68b4e00640 1 --2- 172.21.15.37:0/3672010424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68b010a6b0 0x7f68b010aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.941+0000 7f68b4e00640 1 --2- 172.21.15.37:0/3672010424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68b0104ca0 0x7f68b0105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.941+0000 7f68b4e00640 1 -- 172.21.15.37:0/3672010424 >> 172.21.15.37:0/3672010424 conn(0x7f68b0100730 msgr2=0x7f68b0102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.941+0000 7f68b4e00640 1 -- 172.21.15.37:0/3672010424 shutdown_connections 2024-08-20T05:02:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.941+0000 7f68b4e00640 1 -- 172.21.15.37:0/3672010424 wait complete. 2024-08-20T05:02:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.942+0000 7f68b4e00640 1 Processor -- start 2024-08-20T05:02:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.942+0000 7f68b4e00640 1 -- start start 2024-08-20T05:02:22.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.942+0000 7f68b4e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b0104ca0 0x7f68b019b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.942+0000 7f68b4e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68b010a6b0 0x7f68b019b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.942+0000 7f68b4e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68b010b030 0x7f68b01a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.942+0000 7f68b4e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f68b0114d00 con 0x7f68b0104ca0 2024-08-20T05:02:22.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.942+0000 7f68b4e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f68b0114b80 con 0x7f68b010b030 2024-08-20T05:02:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.942+0000 7f68b4e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f68b0114e80 con 0x7f68b010a6b0 2024-08-20T05:02:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.942+0000 7f68ade00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b0104ca0 0x7f68b019b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.943+0000 7f68ad400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68b010a6b0 0x7f68b019b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.943+0000 7f68ad400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68b010a6b0 0x7f68b019b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43572/0 (socket says 172.21.15.37:43572) 2024-08-20T05:02:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.943+0000 7f68ade00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b0104ca0 0x7f68b019b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52102/0 (socket says 172.21.15.37:52102) 2024-08-20T05:02:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.943+0000 7f68ad400640 1 -- 172.21.15.37:0/3237587766 learned_addr learned my addr 172.21.15.37:0/3237587766 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.943+0000 7f68ae800640 1 --2- 172.21.15.37:0/3237587766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68b010b030 0x7f68b01a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.943+0000 7f68ad400640 1 -- 172.21.15.37:0/3237587766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68b010b030 msgr2=0x7f68b01a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.943+0000 7f68ad400640 1 --2- 172.21.15.37:0/3237587766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68b010b030 0x7f68b01a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.943+0000 7f68ad400640 1 -- 172.21.15.37:0/3237587766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b0104ca0 msgr2=0x7f68b019b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.943+0000 7f68ad400640 1 --2- 172.21.15.37:0/3237587766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b0104ca0 0x7f68b019b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.943+0000 7f68ad400640 1 -- 172.21.15.37:0/3237587766 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b01a1260 con 0x7f68b010a6b0 2024-08-20T05:02:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.943+0000 7f68ade00640 1 --2- 172.21.15.37:0/3237587766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b0104ca0 0x7f68b019b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.944+0000 7f68ad400640 1 --2- 172.21.15.37:0/3237587766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68b010a6b0 0x7f68b019b6f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f689c00e9f0 tx=0x7f689c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.944+0000 7f68a6a00640 1 -- 172.21.15.37:0/3237587766 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c00cd80 con 0x7f68b010a6b0 2024-08-20T05:02:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.944+0000 7f68b4e00640 1 -- 172.21.15.37:0/3237587766 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b01a1550 con 0x7f68b010a6b0 2024-08-20T05:02:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.944+0000 7f68a6a00640 1 -- 172.21.15.37:0/3237587766 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f689c0108e0 con 0x7f68b010a6b0 2024-08-20T05:02:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.944+0000 7f68a6a00640 1 -- 172.21.15.37:0/3237587766 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689c018980 con 0x7f68b010a6b0 2024-08-20T05:02:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.944+0000 7f68b4e00640 1 -- 172.21.15.37:0/3237587766 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b01a7de0 con 0x7f68b010a6b0 2024-08-20T05:02:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.947+0000 7f68b7a34740 1 Processor -- start 2024-08-20T05:02:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.947+0000 7f68b7a34740 1 -- start start 2024-08-20T05:02:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.948+0000 7f68b7a34740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 0x55d3850dece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.948+0000 7f68b7a34740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850df220 0x55d3850eac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.948+0000 7f68b7a34740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850eb1b0 0x55d3850ed5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.948+0000 7f68b7a34740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d385054a60 con 0x55d3850de900 2024-08-20T05:02:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.948+0000 7f68b7a34740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d385043f60 con 0x55d3850df220 2024-08-20T05:02:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.948+0000 7f68b7a34740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d385047fa0 con 0x55d3850eb1b0 2024-08-20T05:02:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.948+0000 7f68ae800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 0x55d3850dece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.948+0000 7f68ae800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 0x55d3850dece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52118/0 (socket says 172.21.15.37:52118) 2024-08-20T05:02:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.948+0000 7f68ae800640 1 -- 172.21.15.37:0/3029237558 learned_addr learned my addr 172.21.15.37:0/3029237558 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.948+0000 7f68ade00640 1 --2- 172.21.15.37:0/3029237558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850df220 0x55d3850eac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.949+0000 7f68ae800640 1 -- 172.21.15.37:0/3029237558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850eb1b0 msgr2=0x55d3850ed5a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:02:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.949+0000 7f68ae800640 1 --2- 172.21.15.37:0/3029237558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850eb1b0 0x55d3850ed5a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.949+0000 7f68ae800640 1 -- 172.21.15.37:0/3029237558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850df220 msgr2=0x55d3850eac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.949+0000 7f68ae800640 1 --2- 172.21.15.37:0/3029237558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850df220 0x55d3850eac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.949+0000 7f68ae800640 1 -- 172.21.15.37:0/3029237558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d384fea3e0 con 0x55d3850de900 2024-08-20T05:02:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.949+0000 7f68ae800640 1 --2- 172.21.15.37:0/3029237558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 0x55d3850dece0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009ca0 tx=0x7f68a80093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70cb878ec1606ee server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:22.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.949+0000 7f689b400640 1 -- 172.21.15.37:0/3029237558 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8031cf0 con 0x55d3850de900 2024-08-20T05:02:22.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.949+0000 7f689b400640 1 -- 172.21.15.37:0/3029237558 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68a8036030 con 0x55d3850de900 2024-08-20T05:02:22.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.949+0000 7f68a6a00640 1 -- 172.21.15.37:0/3237587766 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f689c010430 con 0x7f68b010a6b0 2024-08-20T05:02:22.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.950+0000 7f689b400640 1 -- 172.21.15.37:0/3029237558 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8004240 con 0x55d3850de900 2024-08-20T05:02:22.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.950+0000 7f68b7a34740 1 -- 172.21.15.37:0/3029237558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 msgr2=0x55d3850dece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:22.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.950+0000 7f68b7a34740 1 --2- 172.21.15.37:0/3029237558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 0x55d3850dece0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009ca0 tx=0x7f68a80093e0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.950+0000 7f68b7a34740 1 -- 172.21.15.37:0/3029237558 shutdown_connections 2024-08-20T05:02:22.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.950+0000 7f68b7a34740 1 --2- 172.21.15.37:0/3029237558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850eb1b0 0x55d3850ed5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.950+0000 7f68b7a34740 1 --2- 172.21.15.37:0/3029237558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850df220 0x55d3850eac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.950+0000 7f68b7a34740 1 --2- 172.21.15.37:0/3029237558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 0x55d3850dece0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.950+0000 7f68b7a34740 1 -- 172.21.15.37:0/3029237558 >> 172.21.15.37:0/3029237558 conn(0x55d3850dc730 msgr2=0x55d3850dd8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:22.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.951+0000 7f68b7a34740 1 -- 172.21.15.37:0/3029237558 shutdown_connections 2024-08-20T05:02:22.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.951+0000 7f68b7a34740 1 -- 172.21.15.37:0/3029237558 wait complete. 2024-08-20T05:02:22.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.951+0000 7f68b7a34740 1 -- start start 2024-08-20T05:02:22.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.951+0000 7f68a6a00640 1 --2- 172.21.15.37:0/3237587766 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f68940b3b60 0x7f68940b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.951+0000 7f68b7a34740 1 Processor -- start 2024-08-20T05:02:22.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.952+0000 7f68a6a00640 1 -- 172.21.15.37:0/3237587766 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f689c0e41a0 con 0x7f68b010a6b0 2024-08-20T05:02:22.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.952+0000 7f68ae800640 1 --2- 172.21.15.37:0/3237587766 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f68940b3b60 0x7f68940b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:22.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.952+0000 7f68b7a34740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850de900 0x55d3850ea950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.952+0000 7f68b7a34740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850df220 0x55d3850e7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.952+0000 7f68b7a34740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850eb1b0 0x55d3850e8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.952+0000 7f68b7a34740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d384ea6700 con 0x55d3850df220 2024-08-20T05:02:22.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.952+0000 7f68b7a34740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d384fdf250 con 0x55d3850de900 2024-08-20T05:02:22.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.952+0000 7f68b7a34740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d3850edc50 con 0x55d3850eb1b0 2024-08-20T05:02:22.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.952+0000 7f68b7a34740 10 client.0 _ll_register_callbacks cb 0x55d38503e180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.952+0000 7f68ade00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850de900 0x55d3850ea950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.953+0000 7f68ade00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850de900 0x55d3850ea950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:34132/0 (socket says 172.21.15.37:34132) 2024-08-20T05:02:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.953+0000 7f68ade00640 1 -- 172.21.15.37:0/3664094826 learned_addr learned my addr 172.21.15.37:0/3664094826 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.953+0000 7f68ad400640 1 --2- 172.21.15.37:0/3664094826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850df220 0x55d3850e7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.953+0000 7f68ae800640 1 --2- 172.21.15.37:0/3237587766 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f68940b3b60 0x7f68940b6020 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f68a8003ca0 tx=0x7f68a8003da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.953+0000 7f68ae800640 1 --2- 172.21.15.37:0/3664094826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850eb1b0 0x55d3850e8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.953+0000 7f68ade00640 1 -- 172.21.15.37:0/3664094826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850eb1b0 msgr2=0x55d3850e8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.953+0000 7f68ade00640 1 --2- 172.21.15.37:0/3664094826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850eb1b0 0x55d3850e8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.953+0000 7f68ade00640 1 -- 172.21.15.37:0/3664094826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850df220 msgr2=0x55d3850e7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.953+0000 7f68ade00640 1 --2- 172.21.15.37:0/3664094826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850df220 0x55d3850e7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.953+0000 7f68ade00640 1 -- 172.21.15.37:0/3664094826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d384da3650 con 0x55d3850de900 2024-08-20T05:02:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.953+0000 7f68ad400640 1 --2- 172.21.15.37:0/3664094826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850df220 0x55d3850e7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.953+0000 7f68ae800640 1 --2- 172.21.15.37:0/3664094826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850eb1b0 0x55d3850e8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:02:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.953+0000 7f68ade00640 1 --2- 172.21.15.37:0/3664094826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850de900 0x55d3850ea950 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f68a0012d20 tx=0x7f68a000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=264c164c81684232 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.953+0000 7f688fe00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:02:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.954+0000 7f688fe00640 1 -- 172.21.15.37:0/3664094826 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a0012110 con 0x55d3850de900 2024-08-20T05:02:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.954+0000 7f688fe00640 1 -- 172.21.15.37:0/3664094826 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f68a0004030 con 0x55d3850de900 2024-08-20T05:02:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.954+0000 7f68b7a34740 1 -- 172.21.15.37:0/3664094826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68a8036030 con 0x55d3850de900 2024-08-20T05:02:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.954+0000 7f688fe00640 1 -- 172.21.15.37:0/3664094826 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f68a0025050 con 0x55d3850de900 2024-08-20T05:02:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.954+0000 7f68b7a34740 10 client.25475 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.954+0000 7f68b7a34740 1 -- 172.21.15.37:0/3664094826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d3850f9490 con 0x55d3850de900 2024-08-20T05:02:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.954+0000 7f688fe00640 1 -- 172.21.15.37:0/3664094826 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68a8036030 con 0x55d3850de900 2024-08-20T05:02:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.954+0000 7f688fe00640 1 -- 172.21.15.37:0/3664094826 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f68a0010430 con 0x55d3850de900 2024-08-20T05:02:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.954+0000 7f68b7a34740 10 client.25475 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.954+0000 7f68b7a34740 10 client.25475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:02:22.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.954+0000 7f68b7a34740 20 client.25475 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:22.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.955+0000 7f68b7a34740 1 --2- 172.21.15.37:0/3664094826 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d3850fa950 0x55d3850fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.955+0000 7f68b7a34740 4 client.25475 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:02:22.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.955+0000 7f68b7a34740 1 -- 172.21.15.37:0/3664094826 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3850569b0 con 0x55d3850fa950 2024-08-20T05:02:22.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.955+0000 7f68ad400640 1 --2- 172.21.15.37:0/3664094826 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d3850fa950 0x55d3850fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:22.958 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:22 smithi130 ceph-mon[22007]: from='client.15438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:22.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.955+0000 7f68ad400640 1 --2- 172.21.15.37:0/3664094826 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d3850fa950 0x55d3850fcd40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff9ebb881dddedf server_cookie=349012636b0ef47a in_seq=0 out_seq=0 2024-08-20T05:02:22.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.955+0000 7f688fe00640 10 client.25475 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:22.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.956+0000 7f688fe00640 1 -- 172.21.15.37:0/3664094826 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3850569b0 con 0x55d3850fa950 2024-08-20T05:02:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.956+0000 7f688fe00640 10 client.25475 handle_command_reply: tid=0 2024-08-20T05:02:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.956+0000 7f68b7a34740 1 client.25475 shutdown 2024-08-20T05:02:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.957+0000 7f68b7a34740 1 -- 172.21.15.37:0/3664094826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850de900 msgr2=0x55d3850ea950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.957+0000 7f68b7a34740 1 --2- 172.21.15.37:0/3664094826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850de900 0x55d3850ea950 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f68a0012d20 tx=0x7f68a000f790 comp rx=0 tx=0).stop 2024-08-20T05:02:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.957+0000 7f68b7a34740 1 -- 172.21.15.37:0/3664094826 shutdown_connections 2024-08-20T05:02:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.957+0000 7f68b7a34740 1 --2- 172.21.15.37:0/3664094826 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d3850fa950 0x55d3850fcd40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.957+0000 7f68b7a34740 1 --2- 172.21.15.37:0/3664094826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850eb1b0 0x55d3850e8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.957+0000 7f68b7a34740 1 --2- 172.21.15.37:0/3664094826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850df220 0x55d3850e7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.957+0000 7f688fe00640 0 client.25475 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.957+0000 7f68b7a34740 1 --2- 172.21.15.37:0/3664094826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850de900 0x55d3850ea950 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.957+0000 7f68b7a34740 1 -- 172.21.15.37:0/3664094826 >> 172.21.15.37:0/3664094826 conn(0x55d3850dc730 msgr2=0x55d3850e22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.957+0000 7f68b7a34740 1 -- 172.21.15.37:0/3664094826 shutdown_connections 2024-08-20T05:02:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.957+0000 7f68b7a34740 1 -- 172.21.15.37:0/3664094826 wait complete. 2024-08-20T05:02:22.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.957+0000 7f68b7a34740 20 client.25475 trim_cache size 0 max 16384 2024-08-20T05:02:22.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.977+0000 7f68b7a34740 1 Processor -- start 2024-08-20T05:02:22.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.977+0000 7f68b7a34740 1 -- start start 2024-08-20T05:02:22.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.977+0000 7f68b7a34740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 0x55d3850db700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.977+0000 7f68b7a34740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850df220 0x55d385102600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.977+0000 7f68b7a34740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850eb1b0 0x55d385102b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.977+0000 7f68b7a34740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f68b01b1a80 con 0x55d3850de900 2024-08-20T05:02:22.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.977+0000 7f68b7a34740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f68b01b35c0 con 0x55d3850eb1b0 2024-08-20T05:02:22.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.977+0000 7f68b7a34740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f68b01b2150 con 0x55d3850df220 2024-08-20T05:02:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.978+0000 7f68ad400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850df220 0x55d385102600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.978+0000 7f68ae800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850eb1b0 0x55d385102b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.978+0000 7f68ad400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850df220 0x55d385102600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43586/0 (socket says 172.21.15.37:43586) 2024-08-20T05:02:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.978+0000 7f68ad400640 1 -- 172.21.15.37:0/1042861758 learned_addr learned my addr 172.21.15.37:0/1042861758 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.978+0000 7f68ade00640 1 --2- 172.21.15.37:0/1042861758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 0x55d3850db700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.978+0000 7f68ae800640 1 -- 172.21.15.37:0/1042861758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850df220 msgr2=0x55d385102600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.978+0000 7f68ae800640 1 --2- 172.21.15.37:0/1042861758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850df220 0x55d385102600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.978+0000 7f68ae800640 1 -- 172.21.15.37:0/1042861758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 msgr2=0x55d3850db700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.978+0000 7f68ae800640 1 --2- 172.21.15.37:0/1042861758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 0x55d3850db700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.978+0000 7f68ae800640 1 -- 172.21.15.37:0/1042861758 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3850e6d20 con 0x55d3850eb1b0 2024-08-20T05:02:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.978+0000 7f68ad400640 1 --2- 172.21.15.37:0/1042861758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850df220 0x55d385102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.978+0000 7f68ade00640 1 --2- 172.21.15.37:0/1042861758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 0x55d3850db700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:02:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.979+0000 7f68ae800640 1 --2- 172.21.15.37:0/1042861758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850eb1b0 0x55d385102b40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f68a8004af0 tx=0x7f68a804c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe0d29742c086fe8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.979+0000 7f689aa00640 1 -- 172.21.15.37:0/1042861758 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a804a040 con 0x55d3850eb1b0 2024-08-20T05:02:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.979+0000 7f689aa00640 1 -- 172.21.15.37:0/1042861758 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68a805f070 con 0x55d3850eb1b0 2024-08-20T05:02:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.979+0000 7f689aa00640 1 -- 172.21.15.37:0/1042861758 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8030820 con 0x55d3850eb1b0 2024-08-20T05:02:22.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.980+0000 7f68b7a34740 1 -- 172.21.15.37:0/1042861758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850eb1b0 msgr2=0x55d385102b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:22.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.980+0000 7f68b7a34740 1 --2- 172.21.15.37:0/1042861758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850eb1b0 0x55d385102b40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f68a8004af0 tx=0x7f68a804c000 comp rx=0 tx=0).stop 2024-08-20T05:02:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.980+0000 7f68b7a34740 1 -- 172.21.15.37:0/1042861758 shutdown_connections 2024-08-20T05:02:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.980+0000 7f68b7a34740 1 --2- 172.21.15.37:0/1042861758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850eb1b0 0x55d385102b40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.980+0000 7f68b7a34740 1 --2- 172.21.15.37:0/1042861758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850df220 0x55d385102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.980+0000 7f68b7a34740 1 --2- 172.21.15.37:0/1042861758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 0x55d3850db700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.980+0000 7f68b7a34740 1 -- 172.21.15.37:0/1042861758 >> 172.21.15.37:0/1042861758 conn(0x55d3850dc730 msgr2=0x55d3850daff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.980+0000 7f68b7a34740 1 -- 172.21.15.37:0/1042861758 shutdown_connections 2024-08-20T05:02:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.980+0000 7f68b7a34740 1 -- 172.21.15.37:0/1042861758 wait complete. 2024-08-20T05:02:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.980+0000 7f68b7a34740 1 -- start start 2024-08-20T05:02:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.981+0000 7f68b7a34740 1 Processor -- start 2024-08-20T05:02:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.981+0000 7f68b7a34740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 0x55d3850f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.981+0000 7f68b7a34740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850df220 0x55d3850f0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.981+0000 7f68b7a34740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850eb1b0 0x55d38515c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.981+0000 7f68b7a34740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f68b01b2ef0 con 0x55d3850de900 2024-08-20T05:02:22.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.981+0000 7f68b7a34740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f68b01b2820 con 0x55d3850eb1b0 2024-08-20T05:02:22.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.981+0000 7f68b7a34740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f68b01afa60 con 0x55d3850df220 2024-08-20T05:02:22.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.981+0000 7f68b7a34740 10 client.0 _ll_register_callbacks cb 0x7f68a0009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:22.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.982+0000 7f68ade00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 0x55d3850f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:22.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.982+0000 7f68ae800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850eb1b0 0x55d38515c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:22.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.982+0000 7f68ae800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850eb1b0 0x55d38515c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:34152/0 (socket says 172.21.15.37:34152) 2024-08-20T05:02:22.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.982+0000 7f68ae800640 1 -- 172.21.15.37:0/2367419368 learned_addr learned my addr 172.21.15.37:0/2367419368 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:22.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.982+0000 7f68ad400640 1 --2- 172.21.15.37:0/2367419368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850df220 0x55d3850f0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:22.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.982+0000 7f68ae800640 1 -- 172.21.15.37:0/2367419368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850df220 msgr2=0x55d3850f0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:22.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.982+0000 7f68ae800640 1 --2- 172.21.15.37:0/2367419368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850df220 0x55d3850f0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.982+0000 7f68ae800640 1 -- 172.21.15.37:0/2367419368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 msgr2=0x55d3850f08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:22.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.982+0000 7f68ae800640 1 --2- 172.21.15.37:0/2367419368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 0x55d3850f08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.982+0000 7f68ae800640 1 -- 172.21.15.37:0/2367419368 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3850df050 con 0x55d3850eb1b0 2024-08-20T05:02:22.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.982+0000 7f68ae800640 1 --2- 172.21.15.37:0/2367419368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850eb1b0 0x55d38515c600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009bf0 tx=0x7f68a802f4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3816c73ade8984e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.982+0000 7f688fe00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:02:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.983+0000 7f688fe00640 1 -- 172.21.15.37:0/2367419368 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a804a040 con 0x55d3850eb1b0 2024-08-20T05:02:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.983+0000 7f688fe00640 1 -- 172.21.15.37:0/2367419368 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f68a802fd70 con 0x55d3850eb1b0 2024-08-20T05:02:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.983+0000 7f68b7a34740 1 -- 172.21.15.37:0/2367419368 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68a805f070 con 0x55d3850eb1b0 2024-08-20T05:02:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.983+0000 7f688fe00640 1 -- 172.21.15.37:0/2367419368 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f68a8073050 con 0x55d3850eb1b0 2024-08-20T05:02:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.983+0000 7f68b7a34740 10 client.25481 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.983+0000 7f68b7a34740 1 -- 172.21.15.37:0/2367419368 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d385165120 con 0x55d3850eb1b0 2024-08-20T05:02:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.984+0000 7f688fe00640 1 -- 172.21.15.37:0/2367419368 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68a805f070 con 0x55d3850eb1b0 2024-08-20T05:02:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.984+0000 7f688fe00640 1 -- 172.21.15.37:0/2367419368 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f68a804d030 con 0x55d3850eb1b0 2024-08-20T05:02:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.984+0000 7f68b7a34740 10 client.25481 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.984+0000 7f68b7a34740 10 client.25481 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:02:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.984+0000 7f68b7a34740 20 client.25481 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:22.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.984+0000 7f68b7a34740 1 --2- 172.21.15.37:0/2367419368 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d385165560 0x55d385167980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:22.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.984+0000 7f68b7a34740 4 client.25481 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:02:22.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.984+0000 7f68b7a34740 1 -- 172.21.15.37:0/2367419368 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d385052450 con 0x55d385165560 2024-08-20T05:02:22.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.984+0000 7f68ade00640 1 --2- 172.21.15.37:0/2367419368 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d385165560 0x55d385167980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.985+0000 7f68ade00640 1 --2- 172.21.15.37:0/2367419368 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d385165560 0x55d385167980 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ea31d7193389c81 server_cookie=580a17ee9d2b5758 in_seq=0 out_seq=0 2024-08-20T05:02:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.985+0000 7f688fe00640 10 client.25481 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.985+0000 7f688fe00640 1 -- 172.21.15.37:0/2367419368 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d385052450 con 0x55d385165560 2024-08-20T05:02:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.985+0000 7f688fe00640 10 client.25481 handle_command_reply: tid=0 2024-08-20T05:02:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.985+0000 7f68b7a34740 1 client.25481 shutdown 2024-08-20T05:02:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.985+0000 7f68b7a34740 1 -- 172.21.15.37:0/2367419368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850eb1b0 msgr2=0x55d38515c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.985+0000 7f68b7a34740 1 --2- 172.21.15.37:0/2367419368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850eb1b0 0x55d38515c600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f68a8009bf0 tx=0x7f68a802f4d0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.986+0000 7f68b7a34740 1 -- 172.21.15.37:0/2367419368 shutdown_connections 2024-08-20T05:02:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.986+0000 7f68b7a34740 1 --2- 172.21.15.37:0/2367419368 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d385165560 0x55d385167980 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.986+0000 7f68b7a34740 1 --2- 172.21.15.37:0/2367419368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d3850eb1b0 0x55d38515c600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.986+0000 7f68b7a34740 1 --2- 172.21.15.37:0/2367419368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d3850df220 0x55d3850f0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.986+0000 7f68b7a34740 1 --2- 172.21.15.37:0/2367419368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d3850de900 0x55d3850f08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.986+0000 7f68b7a34740 1 -- 172.21.15.37:0/2367419368 >> 172.21.15.37:0/2367419368 conn(0x55d3850dc730 msgr2=0x55d3850db810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:22.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.986+0000 7f688fe00640 0 client.25481 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:22.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.986+0000 7f68b7a34740 1 -- 172.21.15.37:0/2367419368 shutdown_connections 2024-08-20T05:02:22.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.986+0000 7f68b7a34740 1 -- 172.21.15.37:0/2367419368 wait complete. 2024-08-20T05:02:22.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.986+0000 7f68b7a34740 20 client.25481 trim_cache size 0 max 16384 2024-08-20T05:02:22.989 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:02:22.989 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T05:02:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-20T05:02:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "5c67480d-82b2-4f25-94ac-84bf80480005": { 2024-08-20T05:02:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-20T05:02:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "5c67480d-82b2-4f25-94ac-84bf80480005", 2024-08-20T05:02:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-20T05:02:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:02:22.990 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:02:22.990 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:02:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.987+0000 7f68b4e00640 1 -- 172.21.15.37:0/3237587766 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f68940b3b60 msgr2=0x7f68940b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.987+0000 7f68b4e00640 1 --2- 172.21.15.37:0/3237587766 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f68940b3b60 0x7f68940b6020 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f68a8003ca0 tx=0x7f68a8003da0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.987+0000 7f68b4e00640 1 -- 172.21.15.37:0/3237587766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68b010a6b0 msgr2=0x7f68b019b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.987+0000 7f68b4e00640 1 --2- 172.21.15.37:0/3237587766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68b010a6b0 0x7f68b019b6f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f689c00e9f0 tx=0x7f689c00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.987+0000 7f68b4e00640 1 -- 172.21.15.37:0/3237587766 shutdown_connections 2024-08-20T05:02:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.987+0000 7f68b4e00640 1 --2- 172.21.15.37:0/3237587766 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f68940b3b60 0x7f68940b6020 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.987+0000 7f68b4e00640 1 --2- 172.21.15.37:0/3237587766 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f68b010b030 0x7f68b01a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.987+0000 7f68b4e00640 1 --2- 172.21.15.37:0/3237587766 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f68b010a6b0 0x7f68b019b6f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.987+0000 7f68b4e00640 1 --2- 172.21.15.37:0/3237587766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b0104ca0 0x7f68b019b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.987+0000 7f68b4e00640 1 -- 172.21.15.37:0/3237587766 >> 172.21.15.37:0/3237587766 conn(0x7f68b0100730 msgr2=0x7f68b0101030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.987+0000 7f68b4e00640 1 -- 172.21.15.37:0/3237587766 shutdown_connections 2024-08-20T05:02:22.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:22.987+0000 7f68b4e00640 1 -- 172.21.15.37:0/3237587766 wait complete. 2024-08-20T05:02:22.998 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:23.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:23 smithi037 ceph-mon[17265]: pgmap v405: 129 pgs: 129 active+clean; 652 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-20T05:02:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:23 smithi135 ceph-mon[22342]: pgmap v405: 129 pgs: 129 active+clean; 652 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-20T05:02:23.918 INFO:tasks.cephfs.filesystem:scrub status for tag:5c67480d-82b2-4f25-94ac-84bf80480005 - {'path': '/', 'tag': '5c67480d-82b2-4f25-94ac-84bf80480005', 'options': 'recursive,force'} 2024-08-20T05:02:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:23 smithi130 ceph-mon[22007]: pgmap v405: 129 pgs: 129 active+clean; 652 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-20T05:02:24.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.501+0000 7f1bb9600640 1 -- 172.21.15.37:0/3347467355 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba80318a0 con 0x7f1bbc108310 2024-08-20T05:02:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.502+0000 7f1bbbe00640 1 -- 172.21.15.37:0/3347467355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bbc108310 msgr2=0x7f1bbc108750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.502+0000 7f1bbbe00640 1 --2- 172.21.15.37:0/3347467355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bbc108310 0x7f1bbc108750 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8009900 tx=0x7f1ba802a410 comp rx=0 tx=0).stop 2024-08-20T05:02:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.502+0000 7f1bbbe00640 1 -- 172.21.15.37:0/3347467355 shutdown_connections 2024-08-20T05:02:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.502+0000 7f1bbbe00640 1 --2- 172.21.15.37:0/3347467355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bbc108c90 0x7f1bbc10f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.502+0000 7f1bbbe00640 1 --2- 172.21.15.37:0/3347467355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bbc108310 0x7f1bbc108750 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.502+0000 7f1bbbe00640 1 --2- 172.21.15.37:0/3347467355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bbc102900 0x7f1bbc102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.502+0000 7f1bbbe00640 1 -- 172.21.15.37:0/3347467355 >> 172.21.15.37:0/3347467355 conn(0x7f1bbc0fe3b0 msgr2=0x7f1bbc1007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.502+0000 7f1bbbe00640 1 -- 172.21.15.37:0/3347467355 shutdown_connections 2024-08-20T05:02:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.502+0000 7f1bbbe00640 1 -- 172.21.15.37:0/3347467355 wait complete. 2024-08-20T05:02:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.503+0000 7f1bbbe00640 1 Processor -- start 2024-08-20T05:02:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.503+0000 7f1bbbe00640 1 -- start start 2024-08-20T05:02:24.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bbbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bbc102900 0x7f1bbc0751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:24.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bbbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bbc108310 0x7f1bbc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:24.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bbbe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bbc108c90 0x7f1bbc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:24.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bbbe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc112950 con 0x7f1bbc108310 2024-08-20T05:02:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bbbe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc1127d0 con 0x7f1bbc108c90 2024-08-20T05:02:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bbbe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc112ad0 con 0x7f1bbc102900 2024-08-20T05:02:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bba000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bbc108310 0x7f1bbc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bbaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bbc102900 0x7f1bbc0751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bba000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bbc108310 0x7f1bbc075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52160/0 (socket says 172.21.15.37:52160) 2024-08-20T05:02:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bba000640 1 -- 172.21.15.37:0/2721480460 learned_addr learned my addr 172.21.15.37:0/2721480460 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bbaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bbc102900 0x7f1bbc0751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43614/0 (socket says 172.21.15.37:43614) 2024-08-20T05:02:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bbb400640 1 --2- 172.21.15.37:0/2721480460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bbc108c90 0x7f1bbc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bbaa00640 1 -- 172.21.15.37:0/2721480460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bbc108c90 msgr2=0x7f1bbc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bbaa00640 1 --2- 172.21.15.37:0/2721480460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bbc108c90 0x7f1bbc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bbaa00640 1 -- 172.21.15.37:0/2721480460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bbc108310 msgr2=0x7f1bbc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bbaa00640 1 --2- 172.21.15.37:0/2721480460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bbc108310 0x7f1bbc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bbaa00640 1 -- 172.21.15.37:0/2721480460 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bbc1a7200 con 0x7f1bbc102900 2024-08-20T05:02:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.504+0000 7f1bba000640 1 --2- 172.21.15.37:0/2721480460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bbc108310 0x7f1bbc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.505+0000 7f1bbaa00640 1 --2- 172.21.15.37:0/2721480460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bbc102900 0x7f1bbc0751d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00e9f0 tx=0x7f1bac00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.505+0000 7f1bb3400640 1 -- 172.21.15.37:0/2721480460 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac00ccc0 con 0x7f1bbc102900 2024-08-20T05:02:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.505+0000 7f1bb3400640 1 -- 172.21.15.37:0/2721480460 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bac005020 con 0x7f1bbc102900 2024-08-20T05:02:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.505+0000 7f1bbbe00640 1 -- 172.21.15.37:0/2721480460 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bbc1a74f0 con 0x7f1bbc102900 2024-08-20T05:02:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.505+0000 7f1bb3400640 1 -- 172.21.15.37:0/2721480460 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac004a00 con 0x7f1bbc102900 2024-08-20T05:02:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.505+0000 7f1bbbe00640 1 -- 172.21.15.37:0/2721480460 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bbc1a79b0 con 0x7f1bbc102900 2024-08-20T05:02:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.506+0000 7f1bbbe00640 1 -- 172.21.15.37:0/2721480460 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bbc102ce0 con 0x7f1bbc102900 2024-08-20T05:02:24.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.509+0000 7f1bb3400640 1 -- 172.21.15.37:0/2721480460 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1bac004ba0 con 0x7f1bbc102900 2024-08-20T05:02:24.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.510+0000 7f1bb3400640 1 --2- 172.21.15.37:0/2721480460 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ba00b3c70 0x7f1ba00b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:24.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.510+0000 7f1bb3400640 1 -- 172.21.15.37:0/2721480460 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1bac0e40c0 con 0x7f1bbc102900 2024-08-20T05:02:24.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.510+0000 7f1bba000640 1 --2- 172.21.15.37:0/2721480460 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ba00b3c70 0x7f1ba00b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:24.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.511+0000 7f1bba000640 1 --2- 172.21.15.37:0/2721480460 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ba00b3c70 0x7f1ba00b6130 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8031440 tx=0x7f1ba80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:24.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.512+0000 7f1bb3400640 1 -- 172.21.15.37:0/2721480460 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f1bac0ab3a0 con 0x7f1bbc102900 2024-08-20T05:02:24.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.704+0000 7f1bbbe00640 1 -- 172.21.15.37:0/2721480460 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1bbc0632c0 con 0x7f1ba00b3c70 2024-08-20T05:02:24.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.709+0000 7f1bb3400640 1 -- 172.21.15.37:0/2721480460 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340543 (secure 0 0 0) 0x7f1bbc0632c0 con 0x7f1ba00b3c70 2024-08-20T05:02:24.715 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:24.717 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-20T05:02:24.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.714+0000 7f1bbbe00640 1 -- 172.21.15.37:0/2721480460 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ba00b3c70 msgr2=0x7f1ba00b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:24.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.714+0000 7f1bbbe00640 1 --2- 172.21.15.37:0/2721480460 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ba00b3c70 0x7f1ba00b6130 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1ba8031440 tx=0x7f1ba80058d0 comp rx=0 tx=0).stop 2024-08-20T05:02:24.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.715+0000 7f1bbbe00640 1 -- 172.21.15.37:0/2721480460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bbc102900 msgr2=0x7f1bbc0751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:24.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.715+0000 7f1bbbe00640 1 --2- 172.21.15.37:0/2721480460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bbc102900 0x7f1bbc0751d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00e9f0 tx=0x7f1bac00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:02:24.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.715+0000 7f1bbbe00640 1 -- 172.21.15.37:0/2721480460 shutdown_connections 2024-08-20T05:02:24.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.715+0000 7f1bbbe00640 1 --2- 172.21.15.37:0/2721480460 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ba00b3c70 0x7f1ba00b6130 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:24.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.715+0000 7f1bbbe00640 1 --2- 172.21.15.37:0/2721480460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bbc108c90 0x7f1bbc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:24.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.715+0000 7f1bbbe00640 1 --2- 172.21.15.37:0/2721480460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bbc108310 0x7f1bbc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:24.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.715+0000 7f1bbbe00640 1 --2- 172.21.15.37:0/2721480460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bbc102900 0x7f1bbc0751d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:24.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.715+0000 7f1bbbe00640 1 -- 172.21.15.37:0/2721480460 >> 172.21.15.37:0/2721480460 conn(0x7f1bbc0fe3b0 msgr2=0x7f1bbc1007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:24.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.715+0000 7f1bbbe00640 1 -- 172.21.15.37:0/2721480460 shutdown_connections 2024-08-20T05:02:24.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:24.715+0000 7f1bbbe00640 1 -- 172.21.15.37:0/2721480460 wait complete. 2024-08-20T05:02:25.685 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":406,"stamp":"2024-08-20T05:02:24.022635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668639,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1484,"num_read_kb":859,"num_write":390,"num_write_kb":2314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952691,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":822,"ondisk_log_size":822,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367588,"kb_used_data":14116,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124574236,"statfs":{"total":1151940427776,"available":1151564017664,"internally_reserved":0,"allocated":14454784,"data_stored":8093905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":6511,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":80,"num_write":4,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003439"},"pg_stats":[{"pgid":"2.1f","version":"84'13","reported_seq":196,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:21.360177+0000","last_change":"2024-08-20T04:59:09.751382+0000","last_active":"2024-08-20T05:02:21.360177+0000","last_peered":"2024-08-20T05:02:21.360177+0000","last_clean":"2024-08-20T05:02:21.360177+0000","last_became_active":"2024-08-20T04:59:09.751026+0000","last_became_peered":"2024-08-20T04:59:09.751026+0000","last_unstale":"2024-08-20T05:02:21.360177+0000","last_undegraded":"2024-08-20T05:02:21.360177+0000","last_fullsized":"2024-08-20T05:02:21.360177+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:14:50.107767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342960+0000","last_change":"2024-08-20T05:00:29.371826+0000","last_active":"2024-08-20T05:01:30.342960+0000","last_peered":"2024-08-20T05:01:30.342960+0000","last_clean":"2024-08-20T05:01:30.342960+0000","last_became_active":"2024-08-20T05:00:29.371618+0000","last_became_peered":"2024-08-20T05:00:29.371618+0000","last_unstale":"2024-08-20T05:01:30.342960+0000","last_undegraded":"2024-08-20T05:01:30.342960+0000","last_fullsized":"2024-08-20T05:01:30.342960+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:34:36.786900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344146+0000","last_change":"2024-08-20T04:59:21.902558+0000","last_active":"2024-08-20T05:01:30.344146+0000","last_peered":"2024-08-20T05:01:30.344146+0000","last_clean":"2024-08-20T05:01:30.344146+0000","last_became_active":"2024-08-20T04:59:21.902119+0000","last_became_peered":"2024-08-20T04:59:21.902119+0000","last_unstale":"2024-08-20T05:01:30.344146+0000","last_undegraded":"2024-08-20T05:01:30.344146+0000","last_fullsized":"2024-08-20T05:01:30.344146+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:53.765865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357136+0000","last_change":"2024-08-20T04:59:09.946282+0000","last_active":"2024-08-20T05:01:30.357136+0000","last_peered":"2024-08-20T05:01:30.357136+0000","last_clean":"2024-08-20T05:01:30.357136+0000","last_became_active":"2024-08-20T04:59:09.945867+0000","last_became_peered":"2024-08-20T04:59:09.945867+0000","last_unstale":"2024-08-20T05:01:30.357136+0000","last_undegraded":"2024-08-20T05:01:30.357136+0000","last_fullsized":"2024-08-20T05:01:30.357136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:29:08.119504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338826+0000","last_change":"2024-08-20T04:59:12.796121+0000","last_active":"2024-08-20T05:01:30.338826+0000","last_peered":"2024-08-20T05:01:30.338826+0000","last_clean":"2024-08-20T05:01:30.338826+0000","last_became_active":"2024-08-20T04:59:12.792764+0000","last_became_peered":"2024-08-20T04:59:12.792764+0000","last_unstale":"2024-08-20T05:01:30.338826+0000","last_undegraded":"2024-08-20T05:01:30.338826+0000","last_fullsized":"2024-08-20T05:01:30.338826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:01:53.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355898+0000","last_change":"2024-08-20T04:59:21.909607+0000","last_active":"2024-08-20T05:01:30.355898+0000","last_peered":"2024-08-20T05:01:30.355898+0000","last_clean":"2024-08-20T05:01:30.355898+0000","last_became_active":"2024-08-20T04:59:21.909175+0000","last_became_peered":"2024-08-20T04:59:21.909175+0000","last_unstale":"2024-08-20T05:01:30.355898+0000","last_undegraded":"2024-08-20T05:01:30.355898+0000","last_fullsized":"2024-08-20T05:01:30.355898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:29:49.940169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342724+0000","last_change":"2024-08-20T04:59:09.753233+0000","last_active":"2024-08-20T05:01:30.342724+0000","last_peered":"2024-08-20T05:01:30.342724+0000","last_clean":"2024-08-20T05:01:30.342724+0000","last_became_active":"2024-08-20T04:59:09.752614+0000","last_became_peered":"2024-08-20T04:59:09.752614+0000","last_unstale":"2024-08-20T05:01:30.342724+0000","last_undegraded":"2024-08-20T05:01:30.342724+0000","last_fullsized":"2024-08-20T05:01:30.342724+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:04:20.199669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356860+0000","last_change":"2024-08-20T04:59:12.799116+0000","last_active":"2024-08-20T05:01:30.356860+0000","last_peered":"2024-08-20T05:01:30.356860+0000","last_clean":"2024-08-20T05:01:30.356860+0000","last_became_active":"2024-08-20T04:59:12.798725+0000","last_became_peered":"2024-08-20T04:59:12.798725+0000","last_unstale":"2024-08-20T05:01:30.356860+0000","last_undegraded":"2024-08-20T05:01:30.356860+0000","last_fullsized":"2024-08-20T05:01:30.356860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:46.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356542+0000","last_change":"2024-08-20T05:00:29.372973+0000","last_active":"2024-08-20T05:01:30.356542+0000","last_peered":"2024-08-20T05:01:30.356542+0000","last_clean":"2024-08-20T05:01:30.356542+0000","last_became_active":"2024-08-20T05:00:29.372504+0000","last_became_peered":"2024-08-20T05:00:29.372504+0000","last_unstale":"2024-08-20T05:01:30.356542+0000","last_undegraded":"2024-08-20T05:01:30.356542+0000","last_fullsized":"2024-08-20T05:01:30.356542+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:22:22.410569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342961+0000","last_change":"2024-08-20T04:59:09.752771+0000","last_active":"2024-08-20T05:01:30.342961+0000","last_peered":"2024-08-20T05:01:30.342961+0000","last_clean":"2024-08-20T05:01:30.342961+0000","last_became_active":"2024-08-20T04:59:09.752415+0000","last_became_peered":"2024-08-20T04:59:09.752415+0000","last_unstale":"2024-08-20T05:01:30.342961+0000","last_undegraded":"2024-08-20T05:01:30.342961+0000","last_fullsized":"2024-08-20T05:01:30.342961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:13:18.843587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356341+0000","last_change":"2024-08-20T04:59:12.794418+0000","last_active":"2024-08-20T05:01:30.356341+0000","last_peered":"2024-08-20T05:01:30.356341+0000","last_clean":"2024-08-20T05:01:30.356341+0000","last_became_active":"2024-08-20T04:59:12.794117+0000","last_became_peered":"2024-08-20T04:59:12.794117+0000","last_unstale":"2024-08-20T05:01:30.356341+0000","last_undegraded":"2024-08-20T05:01:30.356341+0000","last_fullsized":"2024-08-20T05:01:30.356341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:18.209690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356247+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T05:01:30.356247+0000","last_peered":"2024-08-20T05:01:30.356247+0000","last_clean":"2024-08-20T05:01:30.356247+0000","last_became_active":"2024-08-20T04:59:21.906344+0000","last_became_peered":"2024-08-20T04:59:21.906344+0000","last_unstale":"2024-08-20T05:01:30.356247+0000","last_undegraded":"2024-08-20T05:01:30.356247+0000","last_fullsized":"2024-08-20T05:01:30.356247+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:48:34.982558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340475+0000","last_change":"2024-08-20T04:59:12.792719+0000","last_active":"2024-08-20T05:01:30.340475+0000","last_peered":"2024-08-20T05:01:30.340475+0000","last_clean":"2024-08-20T05:01:30.340475+0000","last_became_active":"2024-08-20T04:59:12.792294+0000","last_became_peered":"2024-08-20T04:59:12.792294+0000","last_unstale":"2024-08-20T05:01:30.340475+0000","last_undegraded":"2024-08-20T05:01:30.340475+0000","last_fullsized":"2024-08-20T05:01:30.340475+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:20:03.593798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.363468+0000","last_change":"2024-08-20T05:01:30.363065+0000","last_active":"2024-08-20T05:01:30.363468+0000","last_peered":"2024-08-20T05:01:30.363468+0000","last_clean":"2024-08-20T05:01:30.363468+0000","last_became_active":"2024-08-20T05:01:30.357909+0000","last_became_peered":"2024-08-20T05:01:30.357909+0000","last_unstale":"2024-08-20T05:01:30.363468+0000","last_undegraded":"2024-08-20T05:01:30.363468+0000","last_fullsized":"2024-08-20T05:01:30.363468+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:46:56.468529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356466+0000","last_change":"2024-08-20T04:59:21.902445+0000","last_active":"2024-08-20T05:01:30.356466+0000","last_peered":"2024-08-20T05:01:30.356466+0000","last_clean":"2024-08-20T05:01:30.356466+0000","last_became_active":"2024-08-20T04:59:21.901950+0000","last_became_peered":"2024-08-20T04:59:21.901950+0000","last_unstale":"2024-08-20T05:01:30.356466+0000","last_undegraded":"2024-08-20T05:01:30.356466+0000","last_fullsized":"2024-08-20T05:01:30.356466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:55:28.653841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356733+0000","last_change":"2024-08-20T04:59:12.784236+0000","last_active":"2024-08-20T05:01:30.356733+0000","last_peered":"2024-08-20T05:01:30.356733+0000","last_clean":"2024-08-20T05:01:30.356733+0000","last_became_active":"2024-08-20T04:59:12.783945+0000","last_became_peered":"2024-08-20T04:59:12.783945+0000","last_unstale":"2024-08-20T05:01:30.356733+0000","last_undegraded":"2024-08-20T05:01:30.356733+0000","last_fullsized":"2024-08-20T05:01:30.356733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:43:07.137543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343581+0000","last_change":"2024-08-20T04:59:09.751661+0000","last_active":"2024-08-20T05:01:30.343581+0000","last_peered":"2024-08-20T05:01:30.343581+0000","last_clean":"2024-08-20T05:01:30.343581+0000","last_became_active":"2024-08-20T04:59:09.751326+0000","last_became_peered":"2024-08-20T04:59:09.751326+0000","last_unstale":"2024-08-20T05:01:30.343581+0000","last_undegraded":"2024-08-20T05:01:30.343581+0000","last_fullsized":"2024-08-20T05:01:30.343581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:54.751929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356948+0000","last_change":"2024-08-20T04:59:21.913657+0000","last_active":"2024-08-20T05:01:30.356948+0000","last_peered":"2024-08-20T05:01:30.356948+0000","last_clean":"2024-08-20T05:01:30.356948+0000","last_became_active":"2024-08-20T04:59:21.913187+0000","last_became_peered":"2024-08-20T04:59:21.913187+0000","last_unstale":"2024-08-20T05:01:30.356948+0000","last_undegraded":"2024-08-20T05:01:30.356948+0000","last_fullsized":"2024-08-20T05:01:30.356948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:51:29.008810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339857+0000","last_change":"2024-08-20T04:59:12.780137+0000","last_active":"2024-08-20T05:01:30.339857+0000","last_peered":"2024-08-20T05:01:30.339857+0000","last_clean":"2024-08-20T05:01:30.339857+0000","last_became_active":"2024-08-20T04:59:12.779820+0000","last_became_peered":"2024-08-20T04:59:12.779820+0000","last_unstale":"2024-08-20T05:01:30.339857+0000","last_undegraded":"2024-08-20T05:01:30.339857+0000","last_fullsized":"2024-08-20T05:01:30.339857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:33:58.204255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356668+0000","last_change":"2024-08-20T04:59:09.750521+0000","last_active":"2024-08-20T05:01:30.356668+0000","last_peered":"2024-08-20T05:01:30.356668+0000","last_clean":"2024-08-20T05:01:30.356668+0000","last_became_active":"2024-08-20T04:59:09.750115+0000","last_became_peered":"2024-08-20T04:59:09.750115+0000","last_unstale":"2024-08-20T05:01:30.356668+0000","last_undegraded":"2024-08-20T05:01:30.356668+0000","last_fullsized":"2024-08-20T05:01:30.356668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:44:20.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342721+0000","last_change":"2024-08-20T04:59:21.910737+0000","last_active":"2024-08-20T05:01:30.342721+0000","last_peered":"2024-08-20T05:01:30.342721+0000","last_clean":"2024-08-20T05:01:30.342721+0000","last_became_active":"2024-08-20T04:59:21.910104+0000","last_became_peered":"2024-08-20T04:59:21.910104+0000","last_unstale":"2024-08-20T05:01:30.342721+0000","last_undegraded":"2024-08-20T05:01:30.342721+0000","last_fullsized":"2024-08-20T05:01:30.342721+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:17:40.436885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344499+0000","last_change":"2024-08-20T04:59:12.787285+0000","last_active":"2024-08-20T05:01:30.344499+0000","last_peered":"2024-08-20T05:01:30.344499+0000","last_clean":"2024-08-20T05:01:30.344499+0000","last_became_active":"2024-08-20T04:59:12.786998+0000","last_became_peered":"2024-08-20T04:59:12.786998+0000","last_unstale":"2024-08-20T05:01:30.344499+0000","last_undegraded":"2024-08-20T05:01:30.344499+0000","last_fullsized":"2024-08-20T05:01:30.344499+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:12:49.860291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356758+0000","last_change":"2024-08-20T04:59:09.947715+0000","last_active":"2024-08-20T05:01:30.356758+0000","last_peered":"2024-08-20T05:01:30.356758+0000","last_clean":"2024-08-20T05:01:30.356758+0000","last_became_active":"2024-08-20T04:59:09.947372+0000","last_became_peered":"2024-08-20T04:59:09.947372+0000","last_unstale":"2024-08-20T05:01:30.356758+0000","last_undegraded":"2024-08-20T05:01:30.356758+0000","last_fullsized":"2024-08-20T05:01:30.356758+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:42:04.352964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357308+0000","last_change":"2024-08-20T05:00:29.860562+0000","last_active":"2024-08-20T05:01:30.357308+0000","last_peered":"2024-08-20T05:01:30.357308+0000","last_clean":"2024-08-20T05:01:30.357308+0000","last_became_active":"2024-08-20T05:00:29.859944+0000","last_became_peered":"2024-08-20T05:00:29.859944+0000","last_unstale":"2024-08-20T05:01:30.357308+0000","last_undegraded":"2024-08-20T05:01:30.357308+0000","last_fullsized":"2024-08-20T05:01:30.357308+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:47.266712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338727+0000","last_change":"2024-08-20T04:59:12.785952+0000","last_active":"2024-08-20T05:01:30.338727+0000","last_peered":"2024-08-20T05:01:30.338727+0000","last_clean":"2024-08-20T05:01:30.338727+0000","last_became_active":"2024-08-20T04:59:12.785596+0000","last_became_peered":"2024-08-20T04:59:12.785596+0000","last_unstale":"2024-08-20T05:01:30.338727+0000","last_undegraded":"2024-08-20T05:01:30.338727+0000","last_fullsized":"2024-08-20T05:01:30.338727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:47.299560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356854+0000","last_change":"2024-08-20T04:59:09.964725+0000","last_active":"2024-08-20T05:01:30.356854+0000","last_peered":"2024-08-20T05:01:30.356854+0000","last_clean":"2024-08-20T05:01:30.356854+0000","last_became_active":"2024-08-20T04:59:09.964351+0000","last_became_peered":"2024-08-20T04:59:09.964351+0000","last_unstale":"2024-08-20T05:01:30.356854+0000","last_undegraded":"2024-08-20T05:01:30.356854+0000","last_fullsized":"2024-08-20T05:01:30.356854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:26:03.216378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344343+0000","last_change":"2024-08-20T04:59:21.898758+0000","last_active":"2024-08-20T05:01:30.344343+0000","last_peered":"2024-08-20T05:01:30.344343+0000","last_clean":"2024-08-20T05:01:30.344343+0000","last_became_active":"2024-08-20T04:59:21.898282+0000","last_became_peered":"2024-08-20T04:59:21.898282+0000","last_unstale":"2024-08-20T05:01:30.344343+0000","last_undegraded":"2024-08-20T05:01:30.344343+0000","last_fullsized":"2024-08-20T05:01:30.344343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:45:49.093459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357095+0000","last_change":"2024-08-20T04:59:12.793870+0000","last_active":"2024-08-20T05:01:30.357095+0000","last_peered":"2024-08-20T05:01:30.357095+0000","last_clean":"2024-08-20T05:01:30.357095+0000","last_became_active":"2024-08-20T04:59:12.792928+0000","last_became_peered":"2024-08-20T04:59:12.792928+0000","last_unstale":"2024-08-20T05:01:30.357095+0000","last_undegraded":"2024-08-20T05:01:30.357095+0000","last_fullsized":"2024-08-20T05:01:30.357095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:12:25.450347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'17","reported_seq":61,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343461+0000","last_change":"2024-08-20T04:59:09.751403+0000","last_active":"2024-08-20T05:01:30.343461+0000","last_peered":"2024-08-20T05:01:30.343461+0000","last_clean":"2024-08-20T05:01:30.343461+0000","last_became_active":"2024-08-20T04:59:09.750976+0000","last_became_peered":"2024-08-20T04:59:09.750976+0000","last_unstale":"2024-08-20T05:01:30.343461+0000","last_undegraded":"2024-08-20T05:01:30.343461+0000","last_fullsized":"2024-08-20T05:01:30.343461+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:58:54.627836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356432+0000","last_change":"2024-08-20T04:59:21.899813+0000","last_active":"2024-08-20T05:01:30.356432+0000","last_peered":"2024-08-20T05:01:30.356432+0000","last_clean":"2024-08-20T05:01:30.356432+0000","last_became_active":"2024-08-20T04:59:21.899462+0000","last_became_peered":"2024-08-20T04:59:21.899462+0000","last_unstale":"2024-08-20T05:01:30.356432+0000","last_undegraded":"2024-08-20T05:01:30.356432+0000","last_fullsized":"2024-08-20T05:01:30.356432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.468845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355826+0000","last_change":"2024-08-20T04:59:12.783953+0000","last_active":"2024-08-20T05:01:30.355826+0000","last_peered":"2024-08-20T05:01:30.355826+0000","last_clean":"2024-08-20T05:01:30.355826+0000","last_became_active":"2024-08-20T04:59:12.781445+0000","last_became_peered":"2024-08-20T04:59:12.781445+0000","last_unstale":"2024-08-20T05:01:30.355826+0000","last_undegraded":"2024-08-20T05:01:30.355826+0000","last_fullsized":"2024-08-20T05:01:30.355826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:04.792064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356223+0000","last_change":"2024-08-20T05:01:30.355578+0000","last_active":"2024-08-20T05:01:30.356223+0000","last_peered":"2024-08-20T05:01:30.356223+0000","last_clean":"2024-08-20T05:01:30.356223+0000","last_became_active":"2024-08-20T05:01:30.349099+0000","last_became_peered":"2024-08-20T05:01:30.349099+0000","last_unstale":"2024-08-20T05:01:30.356223+0000","last_undegraded":"2024-08-20T05:01:30.356223+0000","last_fullsized":"2024-08-20T05:01:30.356223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:17:57.165914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339956+0000","last_change":"2024-08-20T04:59:21.905202+0000","last_active":"2024-08-20T05:01:30.339956+0000","last_peered":"2024-08-20T05:01:30.339956+0000","last_clean":"2024-08-20T05:01:30.339956+0000","last_became_active":"2024-08-20T04:59:21.904771+0000","last_became_peered":"2024-08-20T04:59:21.904771+0000","last_unstale":"2024-08-20T05:01:30.339956+0000","last_undegraded":"2024-08-20T05:01:30.339956+0000","last_fullsized":"2024-08-20T05:01:30.339956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:35:56.887981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"86'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356122+0000","last_change":"2024-08-20T04:59:12.798301+0000","last_active":"2024-08-20T05:01:30.356122+0000","last_peered":"2024-08-20T05:01:30.356122+0000","last_clean":"2024-08-20T05:01:30.356122+0000","last_became_active":"2024-08-20T04:59:12.797934+0000","last_became_peered":"2024-08-20T04:59:12.797934+0000","last_unstale":"2024-08-20T05:01:30.356122+0000","last_undegraded":"2024-08-20T05:01:30.356122+0000","last_fullsized":"2024-08-20T05:01:30.356122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:41:24.465380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343575+0000","last_change":"2024-08-20T04:59:09.947602+0000","last_active":"2024-08-20T05:01:30.343575+0000","last_peered":"2024-08-20T05:01:30.343575+0000","last_clean":"2024-08-20T05:01:30.343575+0000","last_became_active":"2024-08-20T04:59:09.946795+0000","last_became_peered":"2024-08-20T04:59:09.946795+0000","last_unstale":"2024-08-20T05:01:30.343575+0000","last_undegraded":"2024-08-20T05:01:30.343575+0000","last_fullsized":"2024-08-20T05:01:30.343575+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:09:09.003266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344130+0000","last_change":"2024-08-20T05:00:29.860828+0000","last_active":"2024-08-20T05:01:30.344130+0000","last_peered":"2024-08-20T05:01:30.344130+0000","last_clean":"2024-08-20T05:01:30.344130+0000","last_became_active":"2024-08-20T05:00:29.860242+0000","last_became_peered":"2024-08-20T05:00:29.860242+0000","last_unstale":"2024-08-20T05:01:30.344130+0000","last_undegraded":"2024-08-20T05:01:30.344130+0000","last_fullsized":"2024-08-20T05:01:30.344130+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:09:42.311207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356682+0000","last_change":"2024-08-20T04:59:12.784852+0000","last_active":"2024-08-20T05:01:30.356682+0000","last_peered":"2024-08-20T05:01:30.356682+0000","last_clean":"2024-08-20T05:01:30.356682+0000","last_became_active":"2024-08-20T04:59:12.784496+0000","last_became_peered":"2024-08-20T04:59:12.784496+0000","last_unstale":"2024-08-20T05:01:30.356682+0000","last_undegraded":"2024-08-20T05:01:30.356682+0000","last_fullsized":"2024-08-20T05:01:30.356682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:41:42.421383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":188,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:22.362098+0000","last_change":"2024-08-20T04:59:09.750785+0000","last_active":"2024-08-20T05:02:22.362098+0000","last_peered":"2024-08-20T05:02:22.362098+0000","last_clean":"2024-08-20T05:02:22.362098+0000","last_became_active":"2024-08-20T04:59:09.750255+0000","last_became_peered":"2024-08-20T04:59:09.750255+0000","last_unstale":"2024-08-20T05:02:22.362098+0000","last_undegraded":"2024-08-20T05:02:22.362098+0000","last_fullsized":"2024-08-20T05:02:22.362098+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:20:17.900367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355715+0000","last_change":"2024-08-20T04:59:21.909409+0000","last_active":"2024-08-20T05:01:30.355715+0000","last_peered":"2024-08-20T05:01:30.355715+0000","last_clean":"2024-08-20T05:01:30.355715+0000","last_became_active":"2024-08-20T04:59:21.907934+0000","last_became_peered":"2024-08-20T04:59:21.907934+0000","last_unstale":"2024-08-20T05:01:30.355715+0000","last_undegraded":"2024-08-20T05:01:30.355715+0000","last_fullsized":"2024-08-20T05:01:30.355715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:26:36.768407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355879+0000","last_change":"2024-08-20T04:59:12.783496+0000","last_active":"2024-08-20T05:01:30.355879+0000","last_peered":"2024-08-20T05:01:30.355879+0000","last_clean":"2024-08-20T05:01:30.355879+0000","last_became_active":"2024-08-20T04:59:12.783211+0000","last_became_peered":"2024-08-20T04:59:12.783211+0000","last_unstale":"2024-08-20T05:01:30.355879+0000","last_undegraded":"2024-08-20T05:01:30.355879+0000","last_fullsized":"2024-08-20T05:01:30.355879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:45:49.514189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":186,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:18.357336+0000","last_change":"2024-08-20T04:59:09.948284+0000","last_active":"2024-08-20T05:02:18.357336+0000","last_peered":"2024-08-20T05:02:18.357336+0000","last_clean":"2024-08-20T05:02:18.357336+0000","last_became_active":"2024-08-20T04:59:09.947909+0000","last_became_peered":"2024-08-20T04:59:09.947909+0000","last_unstale":"2024-08-20T05:02:18.357336+0000","last_undegraded":"2024-08-20T05:02:18.357336+0000","last_fullsized":"2024-08-20T05:02:18.357336+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:24:04.344380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":135,"num_read_kb":135,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356288+0000","last_change":"2024-08-20T04:59:21.905282+0000","last_active":"2024-08-20T05:01:30.356288+0000","last_peered":"2024-08-20T05:01:30.356288+0000","last_clean":"2024-08-20T05:01:30.356288+0000","last_became_active":"2024-08-20T04:59:21.904842+0000","last_became_peered":"2024-08-20T04:59:21.904842+0000","last_unstale":"2024-08-20T05:01:30.356288+0000","last_undegraded":"2024-08-20T05:01:30.356288+0000","last_fullsized":"2024-08-20T05:01:30.356288+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:01:19.949949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355357+0000","last_change":"2024-08-20T04:59:12.788571+0000","last_active":"2024-08-20T05:01:30.355357+0000","last_peered":"2024-08-20T05:01:30.355357+0000","last_clean":"2024-08-20T05:01:30.355357+0000","last_became_active":"2024-08-20T04:59:12.784148+0000","last_became_peered":"2024-08-20T04:59:12.784148+0000","last_unstale":"2024-08-20T05:01:30.355357+0000","last_undegraded":"2024-08-20T05:01:30.355357+0000","last_fullsized":"2024-08-20T05:01:30.355357+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:10:51.565404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340278+0000","last_change":"2024-08-20T04:59:09.753842+0000","last_active":"2024-08-20T05:01:30.340278+0000","last_peered":"2024-08-20T05:01:30.340278+0000","last_clean":"2024-08-20T05:01:30.340278+0000","last_became_active":"2024-08-20T04:59:09.753439+0000","last_became_peered":"2024-08-20T04:59:09.753439+0000","last_unstale":"2024-08-20T05:01:30.340278+0000","last_undegraded":"2024-08-20T05:01:30.340278+0000","last_fullsized":"2024-08-20T05:01:30.340278+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:54.171964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356341+0000","last_change":"2024-08-20T04:59:21.909621+0000","last_active":"2024-08-20T05:01:30.356341+0000","last_peered":"2024-08-20T05:01:30.356341+0000","last_clean":"2024-08-20T05:01:30.356341+0000","last_became_active":"2024-08-20T04:59:21.909239+0000","last_became_peered":"2024-08-20T04:59:21.909239+0000","last_unstale":"2024-08-20T05:01:30.356341+0000","last_undegraded":"2024-08-20T05:01:30.356341+0000","last_fullsized":"2024-08-20T05:01:30.356341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:53:15.131163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356523+0000","last_change":"2024-08-20T04:59:12.796643+0000","last_active":"2024-08-20T05:01:30.356523+0000","last_peered":"2024-08-20T05:01:30.356523+0000","last_clean":"2024-08-20T05:01:30.356523+0000","last_became_active":"2024-08-20T04:59:12.796262+0000","last_became_peered":"2024-08-20T04:59:12.796262+0000","last_unstale":"2024-08-20T05:01:30.356523+0000","last_undegraded":"2024-08-20T05:01:30.356523+0000","last_fullsized":"2024-08-20T05:01:30.356523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:11:37.792359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357176+0000","last_change":"2024-08-20T04:59:09.750550+0000","last_active":"2024-08-20T05:01:30.357176+0000","last_peered":"2024-08-20T05:01:30.357176+0000","last_clean":"2024-08-20T05:01:30.357176+0000","last_became_active":"2024-08-20T04:59:09.750097+0000","last_became_peered":"2024-08-20T04:59:09.750097+0000","last_unstale":"2024-08-20T05:01:30.357176+0000","last_undegraded":"2024-08-20T05:01:30.357176+0000","last_fullsized":"2024-08-20T05:01:30.357176+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:32:22.826478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340442+0000","last_change":"2024-08-20T04:57:50.824023+0000","last_active":"2024-08-20T05:01:30.340442+0000","last_peered":"2024-08-20T05:01:30.340442+0000","last_clean":"2024-08-20T05:01:30.340442+0000","last_became_active":"2024-08-20T04:57:50.350587+0000","last_became_peered":"2024-08-20T04:57:50.350587+0000","last_unstale":"2024-08-20T05:01:30.340442+0000","last_undegraded":"2024-08-20T05:01:30.340442+0000","last_fullsized":"2024-08-20T05:01:30.340442+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_clean_scrub_stamp":"2024-08-20T04:54:17.224468+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:59:23.450117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340604+0000","last_change":"2024-08-20T05:00:29.866063+0000","last_active":"2024-08-20T05:01:30.340604+0000","last_peered":"2024-08-20T05:01:30.340604+0000","last_clean":"2024-08-20T05:01:30.340604+0000","last_became_active":"2024-08-20T05:00:29.861545+0000","last_became_peered":"2024-08-20T05:00:29.861545+0000","last_unstale":"2024-08-20T05:01:30.340604+0000","last_undegraded":"2024-08-20T05:01:30.340604+0000","last_fullsized":"2024-08-20T05:01:30.340604+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:02:18.516044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.341028+0000","last_change":"2024-08-20T04:59:12.793799+0000","last_active":"2024-08-20T05:01:30.341028+0000","last_peered":"2024-08-20T05:01:30.341028+0000","last_clean":"2024-08-20T05:01:30.341028+0000","last_became_active":"2024-08-20T04:59:12.793487+0000","last_became_peered":"2024-08-20T04:59:12.793487+0000","last_unstale":"2024-08-20T05:01:30.341028+0000","last_undegraded":"2024-08-20T05:01:30.341028+0000","last_fullsized":"2024-08-20T05:01:30.341028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:08:30.835824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'7","reported_seq":191,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:20.391189+0000","last_change":"2024-08-20T04:59:09.964586+0000","last_active":"2024-08-20T05:02:20.391189+0000","last_peered":"2024-08-20T05:02:20.391189+0000","last_clean":"2024-08-20T05:02:20.391189+0000","last_became_active":"2024-08-20T04:59:09.964258+0000","last_became_peered":"2024-08-20T04:59:09.964258+0000","last_unstale":"2024-08-20T05:02:20.391189+0000","last_undegraded":"2024-08-20T05:02:20.391189+0000","last_fullsized":"2024-08-20T05:02:20.391189+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:37:48.138019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357127+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T05:01:30.357127+0000","last_peered":"2024-08-20T05:01:30.357127+0000","last_clean":"2024-08-20T05:01:30.357127+0000","last_became_active":"2024-08-20T04:59:21.906197+0000","last_became_peered":"2024-08-20T04:59:21.906197+0000","last_unstale":"2024-08-20T05:01:30.357127+0000","last_undegraded":"2024-08-20T05:01:30.357127+0000","last_fullsized":"2024-08-20T05:01:30.357127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:10:45.819035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340707+0000","last_change":"2024-08-20T04:59:12.794221+0000","last_active":"2024-08-20T05:01:30.340707+0000","last_peered":"2024-08-20T05:01:30.340707+0000","last_clean":"2024-08-20T05:01:30.340707+0000","last_became_active":"2024-08-20T04:59:12.793680+0000","last_became_peered":"2024-08-20T04:59:12.793680+0000","last_unstale":"2024-08-20T05:01:30.340707+0000","last_undegraded":"2024-08-20T05:01:30.340707+0000","last_fullsized":"2024-08-20T05:01:30.340707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:45.435700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356414+0000","last_change":"2024-08-20T04:59:09.755955+0000","last_active":"2024-08-20T05:01:30.356414+0000","last_peered":"2024-08-20T05:01:30.356414+0000","last_clean":"2024-08-20T05:01:30.356414+0000","last_became_active":"2024-08-20T04:59:09.755614+0000","last_became_peered":"2024-08-20T04:59:09.755614+0000","last_unstale":"2024-08-20T05:01:30.356414+0000","last_undegraded":"2024-08-20T05:01:30.356414+0000","last_fullsized":"2024-08-20T05:01:30.356414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:15:06.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338518+0000","last_change":"2024-08-20T04:59:21.915952+0000","last_active":"2024-08-20T05:01:30.338518+0000","last_peered":"2024-08-20T05:01:30.338518+0000","last_clean":"2024-08-20T05:01:30.338518+0000","last_became_active":"2024-08-20T04:59:21.915533+0000","last_became_peered":"2024-08-20T04:59:21.915533+0000","last_unstale":"2024-08-20T05:01:30.338518+0000","last_undegraded":"2024-08-20T05:01:30.338518+0000","last_fullsized":"2024-08-20T05:01:30.338518+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:52:54.906061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340713+0000","last_change":"2024-08-20T04:59:12.782663+0000","last_active":"2024-08-20T05:01:30.340713+0000","last_peered":"2024-08-20T05:01:30.340713+0000","last_clean":"2024-08-20T05:01:30.340713+0000","last_became_active":"2024-08-20T04:59:12.782068+0000","last_became_peered":"2024-08-20T04:59:12.782068+0000","last_unstale":"2024-08-20T05:01:30.340713+0000","last_undegraded":"2024-08-20T05:01:30.340713+0000","last_fullsized":"2024-08-20T05:01:30.340713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:46:39.662033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356158+0000","last_change":"2024-08-20T04:59:09.747456+0000","last_active":"2024-08-20T05:01:30.356158+0000","last_peered":"2024-08-20T05:01:30.356158+0000","last_clean":"2024-08-20T05:01:30.356158+0000","last_became_active":"2024-08-20T04:59:09.747141+0000","last_became_peered":"2024-08-20T04:59:09.747141+0000","last_unstale":"2024-08-20T05:01:30.356158+0000","last_undegraded":"2024-08-20T05:01:30.356158+0000","last_fullsized":"2024-08-20T05:01:30.356158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:39:01.600831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355926+0000","last_change":"2024-08-20T04:59:21.898059+0000","last_active":"2024-08-20T05:01:30.355926+0000","last_peered":"2024-08-20T05:01:30.355926+0000","last_clean":"2024-08-20T05:01:30.355926+0000","last_became_active":"2024-08-20T04:59:21.897617+0000","last_became_peered":"2024-08-20T04:59:21.897617+0000","last_unstale":"2024-08-20T05:01:30.355926+0000","last_undegraded":"2024-08-20T05:01:30.355926+0000","last_fullsized":"2024-08-20T05:01:30.355926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:53:21.122106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340301+0000","last_change":"2024-08-20T05:00:29.372299+0000","last_active":"2024-08-20T05:01:30.340301+0000","last_peered":"2024-08-20T05:01:30.340301+0000","last_clean":"2024-08-20T05:01:30.340301+0000","last_became_active":"2024-08-20T05:00:29.371959+0000","last_became_peered":"2024-08-20T05:00:29.371959+0000","last_unstale":"2024-08-20T05:01:30.340301+0000","last_undegraded":"2024-08-20T05:01:30.340301+0000","last_fullsized":"2024-08-20T05:01:30.340301+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:03.996267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343839+0000","last_change":"2024-08-20T04:59:09.751943+0000","last_active":"2024-08-20T05:01:30.343839+0000","last_peered":"2024-08-20T05:01:30.343839+0000","last_clean":"2024-08-20T05:01:30.343839+0000","last_became_active":"2024-08-20T04:59:09.751586+0000","last_became_peered":"2024-08-20T04:59:09.751586+0000","last_unstale":"2024-08-20T05:01:30.343839+0000","last_undegraded":"2024-08-20T05:01:30.343839+0000","last_fullsized":"2024-08-20T05:01:30.343839+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:35:03.400574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355994+0000","last_change":"2024-08-20T04:59:21.901315+0000","last_active":"2024-08-20T05:01:30.355994+0000","last_peered":"2024-08-20T05:01:30.355994+0000","last_clean":"2024-08-20T05:01:30.355994+0000","last_became_active":"2024-08-20T04:59:21.900871+0000","last_became_peered":"2024-08-20T04:59:21.900871+0000","last_unstale":"2024-08-20T05:01:30.355994+0000","last_undegraded":"2024-08-20T05:01:30.355994+0000","last_fullsized":"2024-08-20T05:01:30.355994+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:39:30.940409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355957+0000","last_change":"2024-08-20T04:59:12.793140+0000","last_active":"2024-08-20T05:01:30.355957+0000","last_peered":"2024-08-20T05:01:30.355957+0000","last_clean":"2024-08-20T05:01:30.355957+0000","last_became_active":"2024-08-20T04:59:12.792678+0000","last_became_peered":"2024-08-20T04:59:12.792678+0000","last_unstale":"2024-08-20T05:01:30.355957+0000","last_undegraded":"2024-08-20T05:01:30.355957+0000","last_fullsized":"2024-08-20T05:01:30.355957+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:07:05.610634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342165+0000","last_change":"2024-08-20T04:59:09.946158+0000","last_active":"2024-08-20T05:01:30.342165+0000","last_peered":"2024-08-20T05:01:30.342165+0000","last_clean":"2024-08-20T05:01:30.342165+0000","last_became_active":"2024-08-20T04:59:09.945736+0000","last_became_peered":"2024-08-20T04:59:09.945736+0000","last_unstale":"2024-08-20T05:01:30.342165+0000","last_undegraded":"2024-08-20T05:01:30.342165+0000","last_fullsized":"2024-08-20T05:01:30.342165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:02.759879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356102+0000","last_change":"2024-08-20T04:59:21.913457+0000","last_active":"2024-08-20T05:01:30.356102+0000","last_peered":"2024-08-20T05:01:30.356102+0000","last_clean":"2024-08-20T05:01:30.356102+0000","last_became_active":"2024-08-20T04:59:21.910468+0000","last_became_peered":"2024-08-20T04:59:21.910468+0000","last_unstale":"2024-08-20T05:01:30.356102+0000","last_undegraded":"2024-08-20T05:01:30.356102+0000","last_fullsized":"2024-08-20T05:01:30.356102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:16:30.817166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340293+0000","last_change":"2024-08-20T04:59:12.788088+0000","last_active":"2024-08-20T05:01:30.340293+0000","last_peered":"2024-08-20T05:01:30.340293+0000","last_clean":"2024-08-20T05:01:30.340293+0000","last_became_active":"2024-08-20T04:59:12.787756+0000","last_became_peered":"2024-08-20T04:59:12.787756+0000","last_unstale":"2024-08-20T05:01:30.340293+0000","last_undegraded":"2024-08-20T05:01:30.340293+0000","last_fullsized":"2024-08-20T05:01:30.340293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:51.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'7","reported_seq":194,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:22.363226+0000","last_change":"2024-08-20T04:59:09.746896+0000","last_active":"2024-08-20T05:02:22.363226+0000","last_peered":"2024-08-20T05:02:22.363226+0000","last_clean":"2024-08-20T05:02:22.363226+0000","last_became_active":"2024-08-20T04:59:09.746570+0000","last_became_peered":"2024-08-20T04:59:09.746570+0000","last_unstale":"2024-08-20T05:02:22.363226+0000","last_undegraded":"2024-08-20T05:02:22.363226+0000","last_fullsized":"2024-08-20T05:02:22.363226+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:06:02.395260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342767+0000","last_change":"2024-08-20T04:59:21.911747+0000","last_active":"2024-08-20T05:01:30.342767+0000","last_peered":"2024-08-20T05:01:30.342767+0000","last_clean":"2024-08-20T05:01:30.342767+0000","last_became_active":"2024-08-20T04:59:21.908861+0000","last_became_peered":"2024-08-20T04:59:21.908861+0000","last_unstale":"2024-08-20T05:01:30.342767+0000","last_undegraded":"2024-08-20T05:01:30.342767+0000","last_fullsized":"2024-08-20T05:01:30.342767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:22:17.336776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340612+0000","last_change":"2024-08-20T05:00:29.860903+0000","last_active":"2024-08-20T05:01:30.340612+0000","last_peered":"2024-08-20T05:01:30.340612+0000","last_clean":"2024-08-20T05:01:30.340612+0000","last_became_active":"2024-08-20T05:00:29.860359+0000","last_became_peered":"2024-08-20T05:00:29.860359+0000","last_unstale":"2024-08-20T05:01:30.340612+0000","last_undegraded":"2024-08-20T05:01:30.340612+0000","last_fullsized":"2024-08-20T05:01:30.340612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:27:02.976859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355985+0000","last_change":"2024-08-20T04:59:09.755225+0000","last_active":"2024-08-20T05:01:30.355985+0000","last_peered":"2024-08-20T05:01:30.355985+0000","last_clean":"2024-08-20T05:01:30.355985+0000","last_became_active":"2024-08-20T04:59:09.754580+0000","last_became_peered":"2024-08-20T04:59:09.754580+0000","last_unstale":"2024-08-20T05:01:30.355985+0000","last_undegraded":"2024-08-20T05:01:30.355985+0000","last_fullsized":"2024-08-20T05:01:30.355985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:54:53.606954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340025+0000","last_change":"2024-08-20T04:59:21.905200+0000","last_active":"2024-08-20T05:01:30.340025+0000","last_peered":"2024-08-20T05:01:30.340025+0000","last_clean":"2024-08-20T05:01:30.340025+0000","last_became_active":"2024-08-20T04:59:21.904724+0000","last_became_peered":"2024-08-20T04:59:21.904724+0000","last_unstale":"2024-08-20T05:01:30.340025+0000","last_undegraded":"2024-08-20T05:01:30.340025+0000","last_fullsized":"2024-08-20T05:01:30.340025+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:50:43.446750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355643+0000","last_change":"2024-08-20T04:59:12.787261+0000","last_active":"2024-08-20T05:01:30.355643+0000","last_peered":"2024-08-20T05:01:30.355643+0000","last_clean":"2024-08-20T05:01:30.355643+0000","last_became_active":"2024-08-20T04:59:12.786971+0000","last_became_peered":"2024-08-20T04:59:12.786971+0000","last_unstale":"2024-08-20T05:01:30.355643+0000","last_undegraded":"2024-08-20T05:01:30.355643+0000","last_fullsized":"2024-08-20T05:01:30.355643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:55:57.209321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343535+0000","last_change":"2024-08-20T04:59:09.749147+0000","last_active":"2024-08-20T05:01:30.343535+0000","last_peered":"2024-08-20T05:01:30.343535+0000","last_clean":"2024-08-20T05:01:30.343535+0000","last_became_active":"2024-08-20T04:59:09.748806+0000","last_became_peered":"2024-08-20T04:59:09.748806+0000","last_unstale":"2024-08-20T05:01:30.343535+0000","last_undegraded":"2024-08-20T05:01:30.343535+0000","last_fullsized":"2024-08-20T05:01:30.343535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:59:43.377105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356203+0000","last_change":"2024-08-20T04:59:21.905007+0000","last_active":"2024-08-20T05:01:30.356203+0000","last_peered":"2024-08-20T05:01:30.356203+0000","last_clean":"2024-08-20T05:01:30.356203+0000","last_became_active":"2024-08-20T04:59:21.904608+0000","last_became_peered":"2024-08-20T04:59:21.904608+0000","last_unstale":"2024-08-20T05:01:30.356203+0000","last_undegraded":"2024-08-20T05:01:30.356203+0000","last_fullsized":"2024-08-20T05:01:30.356203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:00:42.390966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342457+0000","last_change":"2024-08-20T04:59:12.783339+0000","last_active":"2024-08-20T05:01:30.342457+0000","last_peered":"2024-08-20T05:01:30.342457+0000","last_clean":"2024-08-20T05:01:30.342457+0000","last_became_active":"2024-08-20T04:59:12.783051+0000","last_became_peered":"2024-08-20T04:59:12.783051+0000","last_unstale":"2024-08-20T05:01:30.342457+0000","last_undegraded":"2024-08-20T05:01:30.342457+0000","last_fullsized":"2024-08-20T05:01:30.342457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:23:54.390491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'43","reported_seq":378,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:23.530769+0000","last_change":"2024-08-20T04:59:09.754340+0000","last_active":"2024-08-20T05:02:23.530769+0000","last_peered":"2024-08-20T05:02:23.530769+0000","last_clean":"2024-08-20T05:02:23.530769+0000","last_became_active":"2024-08-20T04:59:09.754000+0000","last_became_peered":"2024-08-20T04:59:09.754000+0000","last_unstale":"2024-08-20T05:02:23.530769+0000","last_undegraded":"2024-08-20T05:02:23.530769+0000","last_fullsized":"2024-08-20T05:02:23.530769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:26:17.256961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70551,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":290,"num_read_kb":216,"num_write":45,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342495+0000","last_change":"2024-08-20T04:59:21.910369+0000","last_active":"2024-08-20T05:01:30.342495+0000","last_peered":"2024-08-20T05:01:30.342495+0000","last_clean":"2024-08-20T05:01:30.342495+0000","last_became_active":"2024-08-20T04:59:21.909941+0000","last_became_peered":"2024-08-20T04:59:21.909941+0000","last_unstale":"2024-08-20T05:01:30.342495+0000","last_undegraded":"2024-08-20T05:01:30.342495+0000","last_fullsized":"2024-08-20T05:01:30.342495+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:27:07.088021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356969+0000","last_change":"2024-08-20T04:59:12.787747+0000","last_active":"2024-08-20T05:01:30.356969+0000","last_peered":"2024-08-20T05:01:30.356969+0000","last_clean":"2024-08-20T05:01:30.356969+0000","last_became_active":"2024-08-20T04:59:12.786962+0000","last_became_peered":"2024-08-20T04:59:12.786962+0000","last_unstale":"2024-08-20T05:01:30.356969+0000","last_undegraded":"2024-08-20T05:01:30.356969+0000","last_fullsized":"2024-08-20T05:01:30.356969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:14:43.822829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356420+0000","last_change":"2024-08-20T04:59:09.947582+0000","last_active":"2024-08-20T05:01:30.356420+0000","last_peered":"2024-08-20T05:01:30.356420+0000","last_clean":"2024-08-20T05:01:30.356420+0000","last_became_active":"2024-08-20T04:59:09.947117+0000","last_became_peered":"2024-08-20T04:59:09.947117+0000","last_unstale":"2024-08-20T05:01:30.356420+0000","last_undegraded":"2024-08-20T05:01:30.356420+0000","last_fullsized":"2024-08-20T05:01:30.356420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:22:05.815486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357390+0000","last_change":"2024-08-20T04:59:21.910776+0000","last_active":"2024-08-20T05:01:30.357390+0000","last_peered":"2024-08-20T05:01:30.357390+0000","last_clean":"2024-08-20T05:01:30.357390+0000","last_became_active":"2024-08-20T04:59:21.909726+0000","last_became_peered":"2024-08-20T04:59:21.909726+0000","last_unstale":"2024-08-20T05:01:30.357390+0000","last_undegraded":"2024-08-20T05:01:30.357390+0000","last_fullsized":"2024-08-20T05:01:30.357390+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:03:04.042649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338903+0000","last_change":"2024-08-20T05:00:29.860637+0000","last_active":"2024-08-20T05:01:30.338903+0000","last_peered":"2024-08-20T05:01:30.338903+0000","last_clean":"2024-08-20T05:01:30.338903+0000","last_became_active":"2024-08-20T05:00:29.860250+0000","last_became_peered":"2024-08-20T05:00:29.860250+0000","last_unstale":"2024-08-20T05:01:30.338903+0000","last_undegraded":"2024-08-20T05:01:30.338903+0000","last_fullsized":"2024-08-20T05:01:30.338903+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:11:27.937844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340908+0000","last_change":"2024-08-20T04:59:09.747316+0000","last_active":"2024-08-20T05:01:30.340908+0000","last_peered":"2024-08-20T05:01:30.340908+0000","last_clean":"2024-08-20T05:01:30.340908+0000","last_became_active":"2024-08-20T04:59:09.746959+0000","last_became_peered":"2024-08-20T04:59:09.746959+0000","last_unstale":"2024-08-20T05:01:30.340908+0000","last_undegraded":"2024-08-20T05:01:30.340908+0000","last_fullsized":"2024-08-20T05:01:30.340908+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:28.480465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342302+0000","last_change":"2024-08-20T04:59:21.907940+0000","last_active":"2024-08-20T05:01:30.342302+0000","last_peered":"2024-08-20T05:01:30.342302+0000","last_clean":"2024-08-20T05:01:30.342302+0000","last_became_active":"2024-08-20T04:59:21.907591+0000","last_became_peered":"2024-08-20T04:59:21.907591+0000","last_unstale":"2024-08-20T05:01:30.342302+0000","last_undegraded":"2024-08-20T05:01:30.342302+0000","last_fullsized":"2024-08-20T05:01:30.342302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:33.583556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357523+0000","last_change":"2024-08-20T04:59:12.795662+0000","last_active":"2024-08-20T05:01:30.357523+0000","last_peered":"2024-08-20T05:01:30.357523+0000","last_clean":"2024-08-20T05:01:30.357523+0000","last_became_active":"2024-08-20T04:59:12.795321+0000","last_became_peered":"2024-08-20T04:59:12.795321+0000","last_unstale":"2024-08-20T05:01:30.357523+0000","last_undegraded":"2024-08-20T05:01:30.357523+0000","last_fullsized":"2024-08-20T05:01:30.357523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:40:30.561306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'5","reported_seq":326,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:23.396075+0000","last_change":"2024-08-20T04:59:09.754468+0000","last_active":"2024-08-20T05:02:23.396075+0000","last_peered":"2024-08-20T05:02:23.396075+0000","last_clean":"2024-08-20T05:02:23.396075+0000","last_became_active":"2024-08-20T04:59:09.754115+0000","last_became_peered":"2024-08-20T04:59:09.754115+0000","last_unstale":"2024-08-20T05:02:23.396075+0000","last_undegraded":"2024-08-20T05:02:23.396075+0000","last_fullsized":"2024-08-20T05:02:23.396075+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:50:21.301246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":276,"num_read_kb":276,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356257+0000","last_change":"2024-08-20T04:59:21.898785+0000","last_active":"2024-08-20T05:01:30.356257+0000","last_peered":"2024-08-20T05:01:30.356257+0000","last_clean":"2024-08-20T05:01:30.356257+0000","last_became_active":"2024-08-20T04:59:21.898423+0000","last_became_peered":"2024-08-20T04:59:21.898423+0000","last_unstale":"2024-08-20T05:01:30.356257+0000","last_undegraded":"2024-08-20T05:01:30.356257+0000","last_fullsized":"2024-08-20T05:01:30.356257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:52:58.800104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338624+0000","last_change":"2024-08-20T04:59:21.906208+0000","last_active":"2024-08-20T05:01:30.338624+0000","last_peered":"2024-08-20T05:01:30.338624+0000","last_clean":"2024-08-20T05:01:30.338624+0000","last_became_active":"2024-08-20T04:59:21.905041+0000","last_became_peered":"2024-08-20T04:59:21.905041+0000","last_unstale":"2024-08-20T05:01:30.338624+0000","last_undegraded":"2024-08-20T05:01:30.338624+0000","last_fullsized":"2024-08-20T05:01:30.338624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:05:28.971357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342413+0000","last_change":"2024-08-20T04:59:12.788130+0000","last_active":"2024-08-20T05:01:30.342413+0000","last_peered":"2024-08-20T05:01:30.342413+0000","last_clean":"2024-08-20T05:01:30.342413+0000","last_became_active":"2024-08-20T04:59:12.787665+0000","last_became_peered":"2024-08-20T04:59:12.787665+0000","last_unstale":"2024-08-20T05:01:30.342413+0000","last_undegraded":"2024-08-20T05:01:30.342413+0000","last_fullsized":"2024-08-20T05:01:30.342413+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:59:39.628781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356172+0000","last_change":"2024-08-20T04:59:09.754842+0000","last_active":"2024-08-20T05:01:30.356172+0000","last_peered":"2024-08-20T05:01:30.356172+0000","last_clean":"2024-08-20T05:01:30.356172+0000","last_became_active":"2024-08-20T04:59:09.754515+0000","last_became_peered":"2024-08-20T04:59:09.754515+0000","last_unstale":"2024-08-20T05:01:30.356172+0000","last_undegraded":"2024-08-20T05:01:30.356172+0000","last_fullsized":"2024-08-20T05:01:30.356172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:19:02.241567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340312+0000","last_change":"2024-08-20T04:59:21.900610+0000","last_active":"2024-08-20T05:01:30.340312+0000","last_peered":"2024-08-20T05:01:30.340312+0000","last_clean":"2024-08-20T05:01:30.340312+0000","last_became_active":"2024-08-20T04:59:21.900207+0000","last_became_peered":"2024-08-20T04:59:21.900207+0000","last_unstale":"2024-08-20T05:01:30.340312+0000","last_undegraded":"2024-08-20T05:01:30.340312+0000","last_fullsized":"2024-08-20T05:01:30.340312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:41:00.115344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356667+0000","last_change":"2024-08-20T04:59:12.780772+0000","last_active":"2024-08-20T05:01:30.356667+0000","last_peered":"2024-08-20T05:01:30.356667+0000","last_clean":"2024-08-20T05:01:30.356667+0000","last_became_active":"2024-08-20T04:59:12.780385+0000","last_became_peered":"2024-08-20T04:59:12.780385+0000","last_unstale":"2024-08-20T05:01:30.356667+0000","last_undegraded":"2024-08-20T05:01:30.356667+0000","last_fullsized":"2024-08-20T05:01:30.356667+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:23.680899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355522+0000","last_change":"2024-08-20T04:59:09.749567+0000","last_active":"2024-08-20T05:01:30.355522+0000","last_peered":"2024-08-20T05:01:30.355522+0000","last_clean":"2024-08-20T05:01:30.355522+0000","last_became_active":"2024-08-20T04:59:09.749204+0000","last_became_peered":"2024-08-20T04:59:09.749204+0000","last_unstale":"2024-08-20T05:01:30.355522+0000","last_undegraded":"2024-08-20T05:01:30.355522+0000","last_fullsized":"2024-08-20T05:01:30.355522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:57:51.236459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356327+0000","last_change":"2024-08-20T04:59:09.751622+0000","last_active":"2024-08-20T05:01:30.356327+0000","last_peered":"2024-08-20T05:01:30.356327+0000","last_clean":"2024-08-20T05:01:30.356327+0000","last_became_active":"2024-08-20T04:59:09.751227+0000","last_became_peered":"2024-08-20T04:59:09.751227+0000","last_unstale":"2024-08-20T05:01:30.356327+0000","last_undegraded":"2024-08-20T05:01:30.356327+0000","last_fullsized":"2024-08-20T05:01:30.356327+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:53:38.755122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356190+0000","last_change":"2024-08-20T04:59:12.789243+0000","last_active":"2024-08-20T05:01:30.356190+0000","last_peered":"2024-08-20T05:01:30.356190+0000","last_clean":"2024-08-20T05:01:30.356190+0000","last_became_active":"2024-08-20T04:59:12.788932+0000","last_became_peered":"2024-08-20T04:59:12.788932+0000","last_unstale":"2024-08-20T05:01:30.356190+0000","last_undegraded":"2024-08-20T05:01:30.356190+0000","last_fullsized":"2024-08-20T05:01:30.356190+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:27:00.122328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343578+0000","last_change":"2024-08-20T04:59:21.902847+0000","last_active":"2024-08-20T05:01:30.343578+0000","last_peered":"2024-08-20T05:01:30.343578+0000","last_clean":"2024-08-20T05:01:30.343578+0000","last_became_active":"2024-08-20T04:59:21.902426+0000","last_became_peered":"2024-08-20T04:59:21.902426+0000","last_unstale":"2024-08-20T05:01:30.343578+0000","last_undegraded":"2024-08-20T05:01:30.343578+0000","last_fullsized":"2024-08-20T05:01:30.343578+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:18:38.107358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":199,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:18.524940+0000","last_change":"2024-08-20T05:00:29.375139+0000","last_active":"2024-08-20T05:02:18.524940+0000","last_peered":"2024-08-20T05:02:18.524940+0000","last_clean":"2024-08-20T05:02:18.524940+0000","last_became_active":"2024-08-20T05:00:29.370896+0000","last_became_peered":"2024-08-20T05:00:29.370896+0000","last_unstale":"2024-08-20T05:02:18.524940+0000","last_undegraded":"2024-08-20T05:02:18.524940+0000","last_fullsized":"2024-08-20T05:02:18.524940+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:06:48.033558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342418+0000","last_change":"2024-08-20T04:59:12.785811+0000","last_active":"2024-08-20T05:01:30.342418+0000","last_peered":"2024-08-20T05:01:30.342418+0000","last_clean":"2024-08-20T05:01:30.342418+0000","last_became_active":"2024-08-20T04:59:12.785483+0000","last_became_peered":"2024-08-20T04:59:12.785483+0000","last_unstale":"2024-08-20T05:01:30.342418+0000","last_undegraded":"2024-08-20T05:01:30.342418+0000","last_fullsized":"2024-08-20T05:01:30.342418+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:31:25.355197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344575+0000","last_change":"2024-08-20T04:59:21.897832+0000","last_active":"2024-08-20T05:01:30.344575+0000","last_peered":"2024-08-20T05:01:30.344575+0000","last_clean":"2024-08-20T05:01:30.344575+0000","last_became_active":"2024-08-20T04:59:21.897457+0000","last_became_peered":"2024-08-20T04:59:21.897457+0000","last_unstale":"2024-08-20T05:01:30.344575+0000","last_undegraded":"2024-08-20T05:01:30.344575+0000","last_fullsized":"2024-08-20T05:01:30.344575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:39:51.934014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339787+0000","last_change":"2024-08-20T04:59:12.787671+0000","last_active":"2024-08-20T05:01:30.339787+0000","last_peered":"2024-08-20T05:01:30.339787+0000","last_clean":"2024-08-20T05:01:30.339787+0000","last_became_active":"2024-08-20T04:59:12.787372+0000","last_became_peered":"2024-08-20T04:59:12.787372+0000","last_unstale":"2024-08-20T05:01:30.339787+0000","last_undegraded":"2024-08-20T05:01:30.339787+0000","last_fullsized":"2024-08-20T05:01:30.339787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:16:55.031031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344513+0000","last_change":"2024-08-20T04:59:12.792192+0000","last_active":"2024-08-20T05:01:30.344513+0000","last_peered":"2024-08-20T05:01:30.344513+0000","last_clean":"2024-08-20T05:01:30.344513+0000","last_became_active":"2024-08-20T04:59:12.791447+0000","last_became_peered":"2024-08-20T04:59:12.791447+0000","last_unstale":"2024-08-20T05:01:30.344513+0000","last_undegraded":"2024-08-20T05:01:30.344513+0000","last_fullsized":"2024-08-20T05:01:30.344513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:03:32.559245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343399+0000","last_change":"2024-08-20T04:59:12.785393+0000","last_active":"2024-08-20T05:01:30.343399+0000","last_peered":"2024-08-20T05:01:30.343399+0000","last_clean":"2024-08-20T05:01:30.343399+0000","last_became_active":"2024-08-20T04:59:12.784998+0000","last_became_peered":"2024-08-20T04:59:12.784998+0000","last_unstale":"2024-08-20T05:01:30.343399+0000","last_undegraded":"2024-08-20T05:01:30.343399+0000","last_fullsized":"2024-08-20T05:01:30.343399+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:27:04.964290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338483+0000","last_change":"2024-08-20T04:59:12.784730+0000","last_active":"2024-08-20T05:01:30.338483+0000","last_peered":"2024-08-20T05:01:30.338483+0000","last_clean":"2024-08-20T05:01:30.338483+0000","last_became_active":"2024-08-20T04:59:12.784269+0000","last_became_peered":"2024-08-20T04:59:12.784269+0000","last_unstale":"2024-08-20T05:01:30.338483+0000","last_undegraded":"2024-08-20T05:01:30.338483+0000","last_fullsized":"2024-08-20T05:01:30.338483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:43:12.248033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355819+0000","last_change":"2024-08-20T04:59:12.786484+0000","last_active":"2024-08-20T05:01:30.355819+0000","last_peered":"2024-08-20T05:01:30.355819+0000","last_clean":"2024-08-20T05:01:30.355819+0000","last_became_active":"2024-08-20T04:59:12.786166+0000","last_became_peered":"2024-08-20T04:59:12.786166+0000","last_unstale":"2024-08-20T05:01:30.355819+0000","last_undegraded":"2024-08-20T05:01:30.355819+0000","last_fullsized":"2024-08-20T05:01:30.355819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:30.084519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340680+0000","last_change":"2024-08-20T04:59:12.786985+0000","last_active":"2024-08-20T05:01:30.340680+0000","last_peered":"2024-08-20T05:01:30.340680+0000","last_clean":"2024-08-20T05:01:30.340680+0000","last_became_active":"2024-08-20T04:59:12.786674+0000","last_became_peered":"2024-08-20T04:59:12.786674+0000","last_unstale":"2024-08-20T05:01:30.340680+0000","last_undegraded":"2024-08-20T05:01:30.340680+0000","last_fullsized":"2024-08-20T05:01:30.340680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:30:59.996149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344184+0000","last_change":"2024-08-20T04:59:12.796410+0000","last_active":"2024-08-20T05:01:30.344184+0000","last_peered":"2024-08-20T05:01:30.344184+0000","last_clean":"2024-08-20T05:01:30.344184+0000","last_became_active":"2024-08-20T04:59:12.796081+0000","last_became_peered":"2024-08-20T04:59:12.796081+0000","last_unstale":"2024-08-20T05:01:30.344184+0000","last_undegraded":"2024-08-20T05:01:30.344184+0000","last_fullsized":"2024-08-20T05:01:30.344184+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:49:09.706265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357071+0000","last_change":"2024-08-20T04:59:12.795994+0000","last_active":"2024-08-20T05:01:30.357071+0000","last_peered":"2024-08-20T05:01:30.357071+0000","last_clean":"2024-08-20T05:01:30.357071+0000","last_became_active":"2024-08-20T04:59:12.795604+0000","last_became_peered":"2024-08-20T04:59:12.795604+0000","last_unstale":"2024-08-20T05:01:30.357071+0000","last_undegraded":"2024-08-20T05:01:30.357071+0000","last_fullsized":"2024-08-20T05:01:30.357071+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:54:09.628743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355741+0000","last_change":"2024-08-20T04:59:12.788966+0000","last_active":"2024-08-20T05:01:30.355741+0000","last_peered":"2024-08-20T05:01:30.355741+0000","last_clean":"2024-08-20T05:01:30.355741+0000","last_became_active":"2024-08-20T04:59:12.788534+0000","last_became_peered":"2024-08-20T04:59:12.788534+0000","last_unstale":"2024-08-20T05:01:30.355741+0000","last_undegraded":"2024-08-20T05:01:30.355741+0000","last_fullsized":"2024-08-20T05:01:30.355741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.615399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356431+0000","last_change":"2024-08-20T04:59:12.785914+0000","last_active":"2024-08-20T05:01:30.356431+0000","last_peered":"2024-08-20T05:01:30.356431+0000","last_clean":"2024-08-20T05:01:30.356431+0000","last_became_active":"2024-08-20T04:59:12.785551+0000","last_became_peered":"2024-08-20T04:59:12.785551+0000","last_unstale":"2024-08-20T05:01:30.356431+0000","last_undegraded":"2024-08-20T05:01:30.356431+0000","last_fullsized":"2024-08-20T05:01:30.356431+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:30:32.072387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357188+0000","last_change":"2024-08-20T04:59:12.795635+0000","last_active":"2024-08-20T05:01:30.357188+0000","last_peered":"2024-08-20T05:01:30.357188+0000","last_clean":"2024-08-20T05:01:30.357188+0000","last_became_active":"2024-08-20T04:59:12.794805+0000","last_became_peered":"2024-08-20T04:59:12.794805+0000","last_unstale":"2024-08-20T05:01:30.357188+0000","last_undegraded":"2024-08-20T05:01:30.357188+0000","last_fullsized":"2024-08-20T05:01:30.357188+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:09:08.725503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355737+0000","last_change":"2024-08-20T04:59:12.785099+0000","last_active":"2024-08-20T05:01:30.355737+0000","last_peered":"2024-08-20T05:01:30.355737+0000","last_clean":"2024-08-20T05:01:30.355737+0000","last_became_active":"2024-08-20T04:59:12.784727+0000","last_became_peered":"2024-08-20T04:59:12.784727+0000","last_unstale":"2024-08-20T05:01:30.355737+0000","last_undegraded":"2024-08-20T05:01:30.355737+0000","last_fullsized":"2024-08-20T05:01:30.355737+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:24:36.227289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340160+0000","last_change":"2024-08-20T04:59:12.781832+0000","last_active":"2024-08-20T05:01:30.340160+0000","last_peered":"2024-08-20T05:01:30.340160+0000","last_clean":"2024-08-20T05:01:30.340160+0000","last_became_active":"2024-08-20T04:59:12.781342+0000","last_became_peered":"2024-08-20T04:59:12.781342+0000","last_unstale":"2024-08-20T05:01:30.340160+0000","last_undegraded":"2024-08-20T05:01:30.340160+0000","last_fullsized":"2024-08-20T05:01:30.340160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:26:17.762048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344755+0000","last_change":"2024-08-20T04:59:12.792350+0000","last_active":"2024-08-20T05:01:30.344755+0000","last_peered":"2024-08-20T05:01:30.344755+0000","last_clean":"2024-08-20T05:01:30.344755+0000","last_became_active":"2024-08-20T04:59:12.792028+0000","last_became_peered":"2024-08-20T04:59:12.792028+0000","last_unstale":"2024-08-20T05:01:30.344755+0000","last_undegraded":"2024-08-20T05:01:30.344755+0000","last_fullsized":"2024-08-20T05:01:30.344755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:16:23.173759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343346+0000","last_change":"2024-08-20T04:59:12.795047+0000","last_active":"2024-08-20T05:01:30.343346+0000","last_peered":"2024-08-20T05:01:30.343346+0000","last_clean":"2024-08-20T05:01:30.343346+0000","last_became_active":"2024-08-20T04:59:12.794705+0000","last_became_peered":"2024-08-20T04:59:12.794705+0000","last_unstale":"2024-08-20T05:01:30.343346+0000","last_undegraded":"2024-08-20T05:01:30.343346+0000","last_fullsized":"2024-08-20T05:01:30.343346+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:51:16.355892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340659+0000","last_change":"2024-08-20T04:59:12.785022+0000","last_active":"2024-08-20T05:01:30.340659+0000","last_peered":"2024-08-20T05:01:30.340659+0000","last_clean":"2024-08-20T05:01:30.340659+0000","last_became_active":"2024-08-20T04:59:12.784730+0000","last_became_peered":"2024-08-20T04:59:12.784730+0000","last_unstale":"2024-08-20T05:01:30.340659+0000","last_undegraded":"2024-08-20T05:01:30.340659+0000","last_fullsized":"2024-08-20T05:01:30.340659+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:21:53.053890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356636+0000","last_change":"2024-08-20T04:59:12.790825+0000","last_active":"2024-08-20T05:01:30.356636+0000","last_peered":"2024-08-20T05:01:30.356636+0000","last_clean":"2024-08-20T05:01:30.356636+0000","last_became_active":"2024-08-20T04:59:12.790299+0000","last_became_peered":"2024-08-20T04:59:12.790299+0000","last_unstale":"2024-08-20T05:01:30.356636+0000","last_undegraded":"2024-08-20T05:01:30.356636+0000","last_fullsized":"2024-08-20T05:01:30.356636+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:12.477186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338217+0000","last_change":"2024-08-20T05:00:29.374190+0000","last_active":"2024-08-20T05:01:30.338217+0000","last_peered":"2024-08-20T05:01:30.338217+0000","last_clean":"2024-08-20T05:01:30.338217+0000","last_became_active":"2024-08-20T05:00:29.373844+0000","last_became_peered":"2024-08-20T05:00:29.373844+0000","last_unstale":"2024-08-20T05:01:30.338217+0000","last_undegraded":"2024-08-20T05:01:30.338217+0000","last_fullsized":"2024-08-20T05:01:30.338217+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:03.131340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338379+0000","last_change":"2024-08-20T04:59:12.783355+0000","last_active":"2024-08-20T05:01:30.338379+0000","last_peered":"2024-08-20T05:01:30.338379+0000","last_clean":"2024-08-20T05:01:30.338379+0000","last_became_active":"2024-08-20T04:59:12.782992+0000","last_became_peered":"2024-08-20T04:59:12.782992+0000","last_unstale":"2024-08-20T05:01:30.338379+0000","last_undegraded":"2024-08-20T05:01:30.338379+0000","last_fullsized":"2024-08-20T05:01:30.338379+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:09:47.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355676+0000","last_change":"2024-08-20T04:59:12.783989+0000","last_active":"2024-08-20T05:01:30.355676+0000","last_peered":"2024-08-20T05:01:30.355676+0000","last_clean":"2024-08-20T05:01:30.355676+0000","last_became_active":"2024-08-20T04:59:12.783671+0000","last_became_peered":"2024-08-20T04:59:12.783671+0000","last_unstale":"2024-08-20T05:01:30.355676+0000","last_undegraded":"2024-08-20T05:01:30.355676+0000","last_fullsized":"2024-08-20T05:01:30.355676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:34:55.727599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357140+0000","last_change":"2024-08-20T04:59:12.787118+0000","last_active":"2024-08-20T05:01:30.357140+0000","last_peered":"2024-08-20T05:01:30.357140+0000","last_clean":"2024-08-20T05:01:30.357140+0000","last_became_active":"2024-08-20T04:59:12.786754+0000","last_became_peered":"2024-08-20T04:59:12.786754+0000","last_unstale":"2024-08-20T05:01:30.357140+0000","last_undegraded":"2024-08-20T05:01:30.357140+0000","last_fullsized":"2024-08-20T05:01:30.357140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:13:23.959972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340919+0000","last_change":"2024-08-20T04:59:12.793748+0000","last_active":"2024-08-20T05:01:30.340919+0000","last_peered":"2024-08-20T05:01:30.340919+0000","last_clean":"2024-08-20T05:01:30.340919+0000","last_became_active":"2024-08-20T04:59:12.792550+0000","last_became_peered":"2024-08-20T04:59:12.792550+0000","last_unstale":"2024-08-20T05:01:30.340919+0000","last_undegraded":"2024-08-20T05:01:30.340919+0000","last_fullsized":"2024-08-20T05:01:30.340919+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:59:24.226273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356824+0000","last_change":"2024-08-20T04:59:12.788827+0000","last_active":"2024-08-20T05:01:30.356824+0000","last_peered":"2024-08-20T05:01:30.356824+0000","last_clean":"2024-08-20T05:01:30.356824+0000","last_became_active":"2024-08-20T04:59:12.788395+0000","last_became_peered":"2024-08-20T04:59:12.788395+0000","last_unstale":"2024-08-20T05:01:30.356824+0000","last_undegraded":"2024-08-20T05:01:30.356824+0000","last_fullsized":"2024-08-20T05:01:30.356824+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:26.453063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357616+0000","last_change":"2024-08-20T04:59:12.795513+0000","last_active":"2024-08-20T05:01:30.357616+0000","last_peered":"2024-08-20T05:01:30.357616+0000","last_clean":"2024-08-20T05:01:30.357616+0000","last_became_active":"2024-08-20T04:59:12.795191+0000","last_became_peered":"2024-08-20T04:59:12.795191+0000","last_unstale":"2024-08-20T05:01:30.357616+0000","last_undegraded":"2024-08-20T05:01:30.357616+0000","last_fullsized":"2024-08-20T05:01:30.357616+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:04:00.893420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356614+0000","last_change":"2024-08-20T04:59:12.789825+0000","last_active":"2024-08-20T05:01:30.356614+0000","last_peered":"2024-08-20T05:01:30.356614+0000","last_clean":"2024-08-20T05:01:30.356614+0000","last_became_active":"2024-08-20T04:59:12.788198+0000","last_became_peered":"2024-08-20T04:59:12.788198+0000","last_unstale":"2024-08-20T05:01:30.356614+0000","last_undegraded":"2024-08-20T05:01:30.356614+0000","last_fullsized":"2024-08-20T05:01:30.356614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:10.898308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340338+0000","last_change":"2024-08-20T04:59:12.787707+0000","last_active":"2024-08-20T05:01:30.340338+0000","last_peered":"2024-08-20T05:01:30.340338+0000","last_clean":"2024-08-20T05:01:30.340338+0000","last_became_active":"2024-08-20T04:59:12.787035+0000","last_became_peered":"2024-08-20T04:59:12.787035+0000","last_unstale":"2024-08-20T05:01:30.340338+0000","last_undegraded":"2024-08-20T05:01:30.340338+0000","last_fullsized":"2024-08-20T05:01:30.340338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:16:52.451048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356216+0000","last_change":"2024-08-20T04:59:12.784012+0000","last_active":"2024-08-20T05:01:30.356216+0000","last_peered":"2024-08-20T05:01:30.356216+0000","last_clean":"2024-08-20T05:01:30.356216+0000","last_became_active":"2024-08-20T04:59:12.783599+0000","last_became_peered":"2024-08-20T04:59:12.783599+0000","last_unstale":"2024-08-20T05:01:30.356216+0000","last_undegraded":"2024-08-20T05:01:30.356216+0000","last_fullsized":"2024-08-20T05:01:30.356216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:23:15.271873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342676+0000","last_change":"2024-08-20T04:59:12.784987+0000","last_active":"2024-08-20T05:01:30.342676+0000","last_peered":"2024-08-20T05:01:30.342676+0000","last_clean":"2024-08-20T05:01:30.342676+0000","last_became_active":"2024-08-20T04:59:12.784693+0000","last_became_peered":"2024-08-20T04:59:12.784693+0000","last_unstale":"2024-08-20T05:01:30.342676+0000","last_undegraded":"2024-08-20T05:01:30.342676+0000","last_fullsized":"2024-08-20T05:01:30.342676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:07:51.624602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357088+0000","last_change":"2024-08-20T04:59:12.792466+0000","last_active":"2024-08-20T05:01:30.357088+0000","last_peered":"2024-08-20T05:01:30.357088+0000","last_clean":"2024-08-20T05:01:30.357088+0000","last_became_active":"2024-08-20T04:59:12.792114+0000","last_became_peered":"2024-08-20T04:59:12.792114+0000","last_unstale":"2024-08-20T05:01:30.357088+0000","last_undegraded":"2024-08-20T05:01:30.357088+0000","last_fullsized":"2024-08-20T05:01:30.357088+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:23:09.919907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338528+0000","last_change":"2024-08-20T04:59:12.793041+0000","last_active":"2024-08-20T05:01:30.338528+0000","last_peered":"2024-08-20T05:01:30.338528+0000","last_clean":"2024-08-20T05:01:30.338528+0000","last_became_active":"2024-08-20T04:59:12.792709+0000","last_became_peered":"2024-08-20T04:59:12.792709+0000","last_unstale":"2024-08-20T05:01:30.338528+0000","last_undegraded":"2024-08-20T05:01:30.338528+0000","last_fullsized":"2024-08-20T05:01:30.338528+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:09:04.523493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338652+0000","last_change":"2024-08-20T04:59:12.790256+0000","last_active":"2024-08-20T05:01:30.338652+0000","last_peered":"2024-08-20T05:01:30.338652+0000","last_clean":"2024-08-20T05:01:30.338652+0000","last_became_active":"2024-08-20T04:59:12.788467+0000","last_became_peered":"2024-08-20T04:59:12.788467+0000","last_unstale":"2024-08-20T05:01:30.338652+0000","last_undegraded":"2024-08-20T05:01:30.338652+0000","last_fullsized":"2024-08-20T05:01:30.338652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:55:31.386030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340563+0000","last_change":"2024-08-20T04:59:12.794882+0000","last_active":"2024-08-20T05:01:30.340563+0000","last_peered":"2024-08-20T05:01:30.340563+0000","last_clean":"2024-08-20T05:01:30.340563+0000","last_became_active":"2024-08-20T04:59:12.794564+0000","last_became_peered":"2024-08-20T04:59:12.794564+0000","last_unstale":"2024-08-20T05:01:30.340563+0000","last_undegraded":"2024-08-20T05:01:30.340563+0000","last_fullsized":"2024-08-20T05:01:30.340563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:36:47.515754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78037,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1408,"num_read_kb":795,"num_write":265,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":734,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":232973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743477,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1028096,"data_stored":510687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939706,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1728512,"data_stored":1172038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103232,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1044480,"data_stored":509973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299460,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1032192,"data_stored":510239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462985,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1638400,"data_stored":1106989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626511,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":505477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822740,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1646592,"data_stored":1102039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986265,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1036288,"data_stored":510705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182494,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1032192,"data_stored":505185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411429,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1110016,"data_stored":577188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1093632,"data_stored":575920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738477,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1044480,"data_stored":507465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":71165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":72433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":72819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T05:02:25.691 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-20T05:02:25.691 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph pg dump --format=json 2024-08-20T05:02:25.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:25 smithi135 ceph-mon[22342]: pgmap v406: 129 pgs: 129 active+clean; 653 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-20T05:02:25.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:25 smithi135 ceph-mon[22342]: from='client.25492 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:25.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:25 smithi130 ceph-mon[22007]: pgmap v406: 129 pgs: 129 active+clean; 653 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-20T05:02:25.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:25 smithi130 ceph-mon[22007]: from='client.25492 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:26.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:25 smithi037 ceph-mon[17265]: pgmap v406: 129 pgs: 129 active+clean; 653 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 767 B/s wr, 11 op/s 2024-08-20T05:02:26.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:25 smithi037 ceph-mon[17265]: from='client.25492 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:26.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.676+0000 7f35b5800640 1 -- 172.21.15.37:0/2372162542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b0102ab0 msgr2=0x7f35b0102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.676+0000 7f35b5800640 1 --2- 172.21.15.37:0/2372162542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b0102ab0 0x7f35b0102e90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f35a0009900 tx=0x7f35a002a410 comp rx=0 tx=0).stop 2024-08-20T05:02:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.677+0000 7f35b5800640 1 -- 172.21.15.37:0/2372162542 shutdown_connections 2024-08-20T05:02:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.677+0000 7f35b5800640 1 --2- 172.21.15.37:0/2372162542 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b0108e40 0x7f35b010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.677+0000 7f35b5800640 1 --2- 172.21.15.37:0/2372162542 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35b01084c0 0x7f35b0108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.677+0000 7f35b5800640 1 --2- 172.21.15.37:0/2372162542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b0102ab0 0x7f35b0102e90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.677+0000 7f35b5800640 1 -- 172.21.15.37:0/2372162542 >> 172.21.15.37:0/2372162542 conn(0x7f35b00fe500 msgr2=0x7f35b0100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.677+0000 7f35b5800640 1 -- 172.21.15.37:0/2372162542 shutdown_connections 2024-08-20T05:02:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.677+0000 7f35b5800640 1 -- 172.21.15.37:0/2372162542 wait complete. 2024-08-20T05:02:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.678+0000 7f35b5800640 1 Processor -- start 2024-08-20T05:02:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.678+0000 7f35b5800640 1 -- start start 2024-08-20T05:02:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.678+0000 7f35b5800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35b0102ab0 0x7f35b019b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.678+0000 7f35b5800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b01084c0 0x7f35b019b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.678+0000 7f35b5800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b0108e40 0x7f35b01a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.678+0000 7f35b5800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f35b0112b50 con 0x7f35b0108e40 2024-08-20T05:02:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.678+0000 7f35b5800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f35b01129d0 con 0x7f35b0102ab0 2024-08-20T05:02:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.678+0000 7f35b5800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f35b0112cd0 con 0x7f35b01084c0 2024-08-20T05:02:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.678+0000 7f35af400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b0108e40 0x7f35b01a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.678+0000 7f35a7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b01084c0 0x7f35b019b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.678+0000 7f35af400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b0108e40 0x7f35b01a0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52176/0 (socket says 172.21.15.37:52176) 2024-08-20T05:02:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.678+0000 7f35af400640 1 -- 172.21.15.37:0/3393202572 learned_addr learned my addr 172.21.15.37:0/3393202572 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.678+0000 7f35aea00640 1 --2- 172.21.15.37:0/3393202572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35b0102ab0 0x7f35b019b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.679+0000 7f35af400640 1 -- 172.21.15.37:0/3393202572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b01084c0 msgr2=0x7f35b019b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.679+0000 7f35af400640 1 --2- 172.21.15.37:0/3393202572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b01084c0 0x7f35b019b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.679+0000 7f35af400640 1 -- 172.21.15.37:0/3393202572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35b0102ab0 msgr2=0x7f35b019b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.679+0000 7f35af400640 1 --2- 172.21.15.37:0/3393202572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35b0102ab0 0x7f35b019b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.679+0000 7f35af400640 1 -- 172.21.15.37:0/3393202572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b01a1230 con 0x7f35b0108e40 2024-08-20T05:02:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.679+0000 7f35af400640 1 --2- 172.21.15.37:0/3393202572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b0108e40 0x7f35b01a0a60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f35a800eaa0 tx=0x7f35a800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.679+0000 7f35a7400640 1 -- 172.21.15.37:0/3393202572 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a800cdb0 con 0x7f35b0108e40 2024-08-20T05:02:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.680+0000 7f35a7400640 1 -- 172.21.15.37:0/3393202572 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35a8005020 con 0x7f35b0108e40 2024-08-20T05:02:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.680+0000 7f35b5800640 1 -- 172.21.15.37:0/3393202572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b01a1520 con 0x7f35b0108e40 2024-08-20T05:02:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.680+0000 7f35a7400640 1 -- 172.21.15.37:0/3393202572 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a80116d0 con 0x7f35b0108e40 2024-08-20T05:02:26.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.680+0000 7f35b5800640 1 -- 172.21.15.37:0/3393202572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b01a7be0 con 0x7f35b0108e40 2024-08-20T05:02:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.681+0000 7f35b5800640 1 -- 172.21.15.37:0/3393202572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35b0102e90 con 0x7f35b0108e40 2024-08-20T05:02:26.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.683+0000 7f35a7400640 1 -- 172.21.15.37:0/3393202572 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f35a80054f0 con 0x7f35b0108e40 2024-08-20T05:02:26.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.684+0000 7f35a7400640 1 --2- 172.21.15.37:0/3393202572 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f35940b3c50 0x7f35940b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:26.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.685+0000 7f35a7400640 1 -- 172.21.15.37:0/3393202572 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f35a80e3ff0 con 0x7f35b0108e40 2024-08-20T05:02:26.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.685+0000 7f35aea00640 1 --2- 172.21.15.37:0/3393202572 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f35940b3c50 0x7f35940b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:26.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.686+0000 7f35aea00640 1 --2- 172.21.15.37:0/3393202572 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f35940b3c50 0x7f35940b6110 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f35a0005ab0 tx=0x7f35a0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:26.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.687+0000 7f35a7400640 1 -- 172.21.15.37:0/3393202572 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f35a8016030 con 0x7f35b0108e40 2024-08-20T05:02:26.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.878+0000 7f35b5800640 1 -- 172.21.15.37:0/3393202572 --> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f35b0100290 con 0x7f35940b3c50 2024-08-20T05:02:26.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.885+0000 7f35a7400640 1 -- 172.21.15.37:0/3393202572 <== mgr.14150 v2:172.21.15.37:6800/839402922 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340543 (secure 0 0 0) 0x7f35b0100290 con 0x7f35940b3c50 2024-08-20T05:02:26.892 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:26.894 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-08-20T05:02:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.892+0000 7f35b5800640 1 -- 172.21.15.37:0/3393202572 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f35940b3c50 msgr2=0x7f35940b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.892+0000 7f35b5800640 1 --2- 172.21.15.37:0/3393202572 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f35940b3c50 0x7f35940b6110 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f35a0005ab0 tx=0x7f35a0005a20 comp rx=0 tx=0).stop 2024-08-20T05:02:26.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.892+0000 7f35b5800640 1 -- 172.21.15.37:0/3393202572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b0108e40 msgr2=0x7f35b01a0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:26.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.892+0000 7f35b5800640 1 --2- 172.21.15.37:0/3393202572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b0108e40 0x7f35b01a0a60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f35a800eaa0 tx=0x7f35a800ef60 comp rx=0 tx=0).stop 2024-08-20T05:02:26.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.892+0000 7f35b5800640 1 -- 172.21.15.37:0/3393202572 shutdown_connections 2024-08-20T05:02:26.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.892+0000 7f35b5800640 1 --2- 172.21.15.37:0/3393202572 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f35940b3c50 0x7f35940b6110 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:26.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.892+0000 7f35b5800640 1 --2- 172.21.15.37:0/3393202572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35b0108e40 0x7f35b01a0a60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:26.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.892+0000 7f35b5800640 1 --2- 172.21.15.37:0/3393202572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35b01084c0 0x7f35b019b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:26.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.892+0000 7f35b5800640 1 --2- 172.21.15.37:0/3393202572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35b0102ab0 0x7f35b019b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:26.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.892+0000 7f35b5800640 1 -- 172.21.15.37:0/3393202572 >> 172.21.15.37:0/3393202572 conn(0x7f35b00fe500 msgr2=0x7f35b00ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:26.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.892+0000 7f35b5800640 1 -- 172.21.15.37:0/3393202572 shutdown_connections 2024-08-20T05:02:26.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:26.892+0000 7f35b5800640 1 -- 172.21.15.37:0/3393202572 wait complete. 2024-08-20T05:02:27.704 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":407,"stamp":"2024-08-20T05:02:26.023301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668639,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1494,"num_read_kb":864,"num_write":390,"num_write_kb":2314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":2952691,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":822,"ondisk_log_size":822,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367592,"kb_used_data":14120,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124574232,"statfs":{"total":1151940427776,"available":1151564013568,"internally_reserved":0,"allocated":14458880,"data_stored":8095043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1138,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":59,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003612"},"pg_stats":[{"pgid":"2.1f","version":"84'13","reported_seq":196,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:21.360177+0000","last_change":"2024-08-20T04:59:09.751382+0000","last_active":"2024-08-20T05:02:21.360177+0000","last_peered":"2024-08-20T05:02:21.360177+0000","last_clean":"2024-08-20T05:02:21.360177+0000","last_became_active":"2024-08-20T04:59:09.751026+0000","last_became_peered":"2024-08-20T04:59:09.751026+0000","last_unstale":"2024-08-20T05:02:21.360177+0000","last_undegraded":"2024-08-20T05:02:21.360177+0000","last_fullsized":"2024-08-20T05:02:21.360177+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:14:50.107767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":139,"num_read_kb":139,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342960+0000","last_change":"2024-08-20T05:00:29.371826+0000","last_active":"2024-08-20T05:01:30.342960+0000","last_peered":"2024-08-20T05:01:30.342960+0000","last_clean":"2024-08-20T05:01:30.342960+0000","last_became_active":"2024-08-20T05:00:29.371618+0000","last_became_peered":"2024-08-20T05:00:29.371618+0000","last_unstale":"2024-08-20T05:01:30.342960+0000","last_undegraded":"2024-08-20T05:01:30.342960+0000","last_fullsized":"2024-08-20T05:01:30.342960+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:34:36.786900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344146+0000","last_change":"2024-08-20T04:59:21.902558+0000","last_active":"2024-08-20T05:01:30.344146+0000","last_peered":"2024-08-20T05:01:30.344146+0000","last_clean":"2024-08-20T05:01:30.344146+0000","last_became_active":"2024-08-20T04:59:21.902119+0000","last_became_peered":"2024-08-20T04:59:21.902119+0000","last_unstale":"2024-08-20T05:01:30.344146+0000","last_undegraded":"2024-08-20T05:01:30.344146+0000","last_fullsized":"2024-08-20T05:01:30.344146+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:53.765865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357136+0000","last_change":"2024-08-20T04:59:09.946282+0000","last_active":"2024-08-20T05:01:30.357136+0000","last_peered":"2024-08-20T05:01:30.357136+0000","last_clean":"2024-08-20T05:01:30.357136+0000","last_became_active":"2024-08-20T04:59:09.945867+0000","last_became_peered":"2024-08-20T04:59:09.945867+0000","last_unstale":"2024-08-20T05:01:30.357136+0000","last_undegraded":"2024-08-20T05:01:30.357136+0000","last_fullsized":"2024-08-20T05:01:30.357136+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:29:08.119504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338826+0000","last_change":"2024-08-20T04:59:12.796121+0000","last_active":"2024-08-20T05:01:30.338826+0000","last_peered":"2024-08-20T05:01:30.338826+0000","last_clean":"2024-08-20T05:01:30.338826+0000","last_became_active":"2024-08-20T04:59:12.792764+0000","last_became_peered":"2024-08-20T04:59:12.792764+0000","last_unstale":"2024-08-20T05:01:30.338826+0000","last_undegraded":"2024-08-20T05:01:30.338826+0000","last_fullsized":"2024-08-20T05:01:30.338826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:01:53.068133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355898+0000","last_change":"2024-08-20T04:59:21.909607+0000","last_active":"2024-08-20T05:01:30.355898+0000","last_peered":"2024-08-20T05:01:30.355898+0000","last_clean":"2024-08-20T05:01:30.355898+0000","last_became_active":"2024-08-20T04:59:21.909175+0000","last_became_peered":"2024-08-20T04:59:21.909175+0000","last_unstale":"2024-08-20T05:01:30.355898+0000","last_undegraded":"2024-08-20T05:01:30.355898+0000","last_fullsized":"2024-08-20T05:01:30.355898+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:29:49.940169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342724+0000","last_change":"2024-08-20T04:59:09.753233+0000","last_active":"2024-08-20T05:01:30.342724+0000","last_peered":"2024-08-20T05:01:30.342724+0000","last_clean":"2024-08-20T05:01:30.342724+0000","last_became_active":"2024-08-20T04:59:09.752614+0000","last_became_peered":"2024-08-20T04:59:09.752614+0000","last_unstale":"2024-08-20T05:01:30.342724+0000","last_undegraded":"2024-08-20T05:01:30.342724+0000","last_fullsized":"2024-08-20T05:01:30.342724+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:04:20.199669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356860+0000","last_change":"2024-08-20T04:59:12.799116+0000","last_active":"2024-08-20T05:01:30.356860+0000","last_peered":"2024-08-20T05:01:30.356860+0000","last_clean":"2024-08-20T05:01:30.356860+0000","last_became_active":"2024-08-20T04:59:12.798725+0000","last_became_peered":"2024-08-20T04:59:12.798725+0000","last_unstale":"2024-08-20T05:01:30.356860+0000","last_undegraded":"2024-08-20T05:01:30.356860+0000","last_fullsized":"2024-08-20T05:01:30.356860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:46.423627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356542+0000","last_change":"2024-08-20T05:00:29.372973+0000","last_active":"2024-08-20T05:01:30.356542+0000","last_peered":"2024-08-20T05:01:30.356542+0000","last_clean":"2024-08-20T05:01:30.356542+0000","last_became_active":"2024-08-20T05:00:29.372504+0000","last_became_peered":"2024-08-20T05:00:29.372504+0000","last_unstale":"2024-08-20T05:01:30.356542+0000","last_undegraded":"2024-08-20T05:01:30.356542+0000","last_fullsized":"2024-08-20T05:01:30.356542+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:22:22.410569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,8,5],"acting":[4,3,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342961+0000","last_change":"2024-08-20T04:59:09.752771+0000","last_active":"2024-08-20T05:01:30.342961+0000","last_peered":"2024-08-20T05:01:30.342961+0000","last_clean":"2024-08-20T05:01:30.342961+0000","last_became_active":"2024-08-20T04:59:09.752415+0000","last_became_peered":"2024-08-20T04:59:09.752415+0000","last_unstale":"2024-08-20T05:01:30.342961+0000","last_undegraded":"2024-08-20T05:01:30.342961+0000","last_fullsized":"2024-08-20T05:01:30.342961+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:13:18.843587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356341+0000","last_change":"2024-08-20T04:59:12.794418+0000","last_active":"2024-08-20T05:01:30.356341+0000","last_peered":"2024-08-20T05:01:30.356341+0000","last_clean":"2024-08-20T05:01:30.356341+0000","last_became_active":"2024-08-20T04:59:12.794117+0000","last_became_peered":"2024-08-20T04:59:12.794117+0000","last_unstale":"2024-08-20T05:01:30.356341+0000","last_undegraded":"2024-08-20T05:01:30.356341+0000","last_fullsized":"2024-08-20T05:01:30.356341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:18.209690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356247+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T05:01:30.356247+0000","last_peered":"2024-08-20T05:01:30.356247+0000","last_clean":"2024-08-20T05:01:30.356247+0000","last_became_active":"2024-08-20T04:59:21.906344+0000","last_became_peered":"2024-08-20T04:59:21.906344+0000","last_unstale":"2024-08-20T05:01:30.356247+0000","last_undegraded":"2024-08-20T05:01:30.356247+0000","last_fullsized":"2024-08-20T05:01:30.356247+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:48:34.982558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340475+0000","last_change":"2024-08-20T04:59:12.792719+0000","last_active":"2024-08-20T05:01:30.340475+0000","last_peered":"2024-08-20T05:01:30.340475+0000","last_clean":"2024-08-20T05:01:30.340475+0000","last_became_active":"2024-08-20T04:59:12.792294+0000","last_became_peered":"2024-08-20T04:59:12.792294+0000","last_unstale":"2024-08-20T05:01:30.340475+0000","last_undegraded":"2024-08-20T05:01:30.340475+0000","last_fullsized":"2024-08-20T05:01:30.340475+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:20:03.593798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.363468+0000","last_change":"2024-08-20T05:01:30.363065+0000","last_active":"2024-08-20T05:01:30.363468+0000","last_peered":"2024-08-20T05:01:30.363468+0000","last_clean":"2024-08-20T05:01:30.363468+0000","last_became_active":"2024-08-20T05:01:30.357909+0000","last_became_peered":"2024-08-20T05:01:30.357909+0000","last_unstale":"2024-08-20T05:01:30.363468+0000","last_undegraded":"2024-08-20T05:01:30.363468+0000","last_fullsized":"2024-08-20T05:01:30.363468+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:46:56.468529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356466+0000","last_change":"2024-08-20T04:59:21.902445+0000","last_active":"2024-08-20T05:01:30.356466+0000","last_peered":"2024-08-20T05:01:30.356466+0000","last_clean":"2024-08-20T05:01:30.356466+0000","last_became_active":"2024-08-20T04:59:21.901950+0000","last_became_peered":"2024-08-20T04:59:21.901950+0000","last_unstale":"2024-08-20T05:01:30.356466+0000","last_undegraded":"2024-08-20T05:01:30.356466+0000","last_fullsized":"2024-08-20T05:01:30.356466+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:55:28.653841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356733+0000","last_change":"2024-08-20T04:59:12.784236+0000","last_active":"2024-08-20T05:01:30.356733+0000","last_peered":"2024-08-20T05:01:30.356733+0000","last_clean":"2024-08-20T05:01:30.356733+0000","last_became_active":"2024-08-20T04:59:12.783945+0000","last_became_peered":"2024-08-20T04:59:12.783945+0000","last_unstale":"2024-08-20T05:01:30.356733+0000","last_undegraded":"2024-08-20T05:01:30.356733+0000","last_fullsized":"2024-08-20T05:01:30.356733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:43:07.137543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343581+0000","last_change":"2024-08-20T04:59:09.751661+0000","last_active":"2024-08-20T05:01:30.343581+0000","last_peered":"2024-08-20T05:01:30.343581+0000","last_clean":"2024-08-20T05:01:30.343581+0000","last_became_active":"2024-08-20T04:59:09.751326+0000","last_became_peered":"2024-08-20T04:59:09.751326+0000","last_unstale":"2024-08-20T05:01:30.343581+0000","last_undegraded":"2024-08-20T05:01:30.343581+0000","last_fullsized":"2024-08-20T05:01:30.343581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:36:54.751929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"84'1","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356948+0000","last_change":"2024-08-20T04:59:21.913657+0000","last_active":"2024-08-20T05:01:30.356948+0000","last_peered":"2024-08-20T05:01:30.356948+0000","last_clean":"2024-08-20T05:01:30.356948+0000","last_became_active":"2024-08-20T04:59:21.913187+0000","last_became_peered":"2024-08-20T04:59:21.913187+0000","last_unstale":"2024-08-20T05:01:30.356948+0000","last_undegraded":"2024-08-20T05:01:30.356948+0000","last_fullsized":"2024-08-20T05:01:30.356948+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:51:29.008810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339857+0000","last_change":"2024-08-20T04:59:12.780137+0000","last_active":"2024-08-20T05:01:30.339857+0000","last_peered":"2024-08-20T05:01:30.339857+0000","last_clean":"2024-08-20T05:01:30.339857+0000","last_became_active":"2024-08-20T04:59:12.779820+0000","last_became_peered":"2024-08-20T04:59:12.779820+0000","last_unstale":"2024-08-20T05:01:30.339857+0000","last_undegraded":"2024-08-20T05:01:30.339857+0000","last_fullsized":"2024-08-20T05:01:30.339857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:33:58.204255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356668+0000","last_change":"2024-08-20T04:59:09.750521+0000","last_active":"2024-08-20T05:01:30.356668+0000","last_peered":"2024-08-20T05:01:30.356668+0000","last_clean":"2024-08-20T05:01:30.356668+0000","last_became_active":"2024-08-20T04:59:09.750115+0000","last_became_peered":"2024-08-20T04:59:09.750115+0000","last_unstale":"2024-08-20T05:01:30.356668+0000","last_undegraded":"2024-08-20T05:01:30.356668+0000","last_fullsized":"2024-08-20T05:01:30.356668+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:44:20.513977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342721+0000","last_change":"2024-08-20T04:59:21.910737+0000","last_active":"2024-08-20T05:01:30.342721+0000","last_peered":"2024-08-20T05:01:30.342721+0000","last_clean":"2024-08-20T05:01:30.342721+0000","last_became_active":"2024-08-20T04:59:21.910104+0000","last_became_peered":"2024-08-20T04:59:21.910104+0000","last_unstale":"2024-08-20T05:01:30.342721+0000","last_undegraded":"2024-08-20T05:01:30.342721+0000","last_fullsized":"2024-08-20T05:01:30.342721+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:17:40.436885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344499+0000","last_change":"2024-08-20T04:59:12.787285+0000","last_active":"2024-08-20T05:01:30.344499+0000","last_peered":"2024-08-20T05:01:30.344499+0000","last_clean":"2024-08-20T05:01:30.344499+0000","last_became_active":"2024-08-20T04:59:12.786998+0000","last_became_peered":"2024-08-20T04:59:12.786998+0000","last_unstale":"2024-08-20T05:01:30.344499+0000","last_undegraded":"2024-08-20T05:01:30.344499+0000","last_fullsized":"2024-08-20T05:01:30.344499+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:12:49.860291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356758+0000","last_change":"2024-08-20T04:59:09.947715+0000","last_active":"2024-08-20T05:01:30.356758+0000","last_peered":"2024-08-20T05:01:30.356758+0000","last_clean":"2024-08-20T05:01:30.356758+0000","last_became_active":"2024-08-20T04:59:09.947372+0000","last_became_peered":"2024-08-20T04:59:09.947372+0000","last_unstale":"2024-08-20T05:01:30.356758+0000","last_undegraded":"2024-08-20T05:01:30.356758+0000","last_fullsized":"2024-08-20T05:01:30.356758+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:42:04.352964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357308+0000","last_change":"2024-08-20T05:00:29.860562+0000","last_active":"2024-08-20T05:01:30.357308+0000","last_peered":"2024-08-20T05:01:30.357308+0000","last_clean":"2024-08-20T05:01:30.357308+0000","last_became_active":"2024-08-20T05:00:29.859944+0000","last_became_peered":"2024-08-20T05:00:29.859944+0000","last_unstale":"2024-08-20T05:01:30.357308+0000","last_undegraded":"2024-08-20T05:01:30.357308+0000","last_fullsized":"2024-08-20T05:01:30.357308+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:47.266712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338727+0000","last_change":"2024-08-20T04:59:12.785952+0000","last_active":"2024-08-20T05:01:30.338727+0000","last_peered":"2024-08-20T05:01:30.338727+0000","last_clean":"2024-08-20T05:01:30.338727+0000","last_became_active":"2024-08-20T04:59:12.785596+0000","last_became_peered":"2024-08-20T04:59:12.785596+0000","last_unstale":"2024-08-20T05:01:30.338727+0000","last_undegraded":"2024-08-20T05:01:30.338727+0000","last_fullsized":"2024-08-20T05:01:30.338727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:19:47.299560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356854+0000","last_change":"2024-08-20T04:59:09.964725+0000","last_active":"2024-08-20T05:01:30.356854+0000","last_peered":"2024-08-20T05:01:30.356854+0000","last_clean":"2024-08-20T05:01:30.356854+0000","last_became_active":"2024-08-20T04:59:09.964351+0000","last_became_peered":"2024-08-20T04:59:09.964351+0000","last_unstale":"2024-08-20T05:01:30.356854+0000","last_undegraded":"2024-08-20T05:01:30.356854+0000","last_fullsized":"2024-08-20T05:01:30.356854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:26:03.216378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344343+0000","last_change":"2024-08-20T04:59:21.898758+0000","last_active":"2024-08-20T05:01:30.344343+0000","last_peered":"2024-08-20T05:01:30.344343+0000","last_clean":"2024-08-20T05:01:30.344343+0000","last_became_active":"2024-08-20T04:59:21.898282+0000","last_became_peered":"2024-08-20T04:59:21.898282+0000","last_unstale":"2024-08-20T05:01:30.344343+0000","last_undegraded":"2024-08-20T05:01:30.344343+0000","last_fullsized":"2024-08-20T05:01:30.344343+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:45:49.093459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357095+0000","last_change":"2024-08-20T04:59:12.793870+0000","last_active":"2024-08-20T05:01:30.357095+0000","last_peered":"2024-08-20T05:01:30.357095+0000","last_clean":"2024-08-20T05:01:30.357095+0000","last_became_active":"2024-08-20T04:59:12.792928+0000","last_became_peered":"2024-08-20T04:59:12.792928+0000","last_unstale":"2024-08-20T05:01:30.357095+0000","last_undegraded":"2024-08-20T05:01:30.357095+0000","last_fullsized":"2024-08-20T05:01:30.357095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:12:25.450347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"88'17","reported_seq":61,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343461+0000","last_change":"2024-08-20T04:59:09.751403+0000","last_active":"2024-08-20T05:01:30.343461+0000","last_peered":"2024-08-20T05:01:30.343461+0000","last_clean":"2024-08-20T05:01:30.343461+0000","last_became_active":"2024-08-20T04:59:09.750976+0000","last_became_peered":"2024-08-20T04:59:09.750976+0000","last_unstale":"2024-08-20T05:01:30.343461+0000","last_undegraded":"2024-08-20T05:01:30.343461+0000","last_fullsized":"2024-08-20T05:01:30.343461+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:58:54.627836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356432+0000","last_change":"2024-08-20T04:59:21.899813+0000","last_active":"2024-08-20T05:01:30.356432+0000","last_peered":"2024-08-20T05:01:30.356432+0000","last_clean":"2024-08-20T05:01:30.356432+0000","last_became_active":"2024-08-20T04:59:21.899462+0000","last_became_peered":"2024-08-20T04:59:21.899462+0000","last_unstale":"2024-08-20T05:01:30.356432+0000","last_undegraded":"2024-08-20T05:01:30.356432+0000","last_fullsized":"2024-08-20T05:01:30.356432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.468845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355826+0000","last_change":"2024-08-20T04:59:12.783953+0000","last_active":"2024-08-20T05:01:30.355826+0000","last_peered":"2024-08-20T05:01:30.355826+0000","last_clean":"2024-08-20T05:01:30.355826+0000","last_became_active":"2024-08-20T04:59:12.781445+0000","last_became_peered":"2024-08-20T04:59:12.781445+0000","last_unstale":"2024-08-20T05:01:30.355826+0000","last_undegraded":"2024-08-20T05:01:30.355826+0000","last_fullsized":"2024-08-20T05:01:30.355826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:04.792064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356223+0000","last_change":"2024-08-20T05:01:30.355578+0000","last_active":"2024-08-20T05:01:30.356223+0000","last_peered":"2024-08-20T05:01:30.356223+0000","last_clean":"2024-08-20T05:01:30.356223+0000","last_became_active":"2024-08-20T05:01:30.349099+0000","last_became_peered":"2024-08-20T05:01:30.349099+0000","last_unstale":"2024-08-20T05:01:30.356223+0000","last_undegraded":"2024-08-20T05:01:30.356223+0000","last_fullsized":"2024-08-20T05:01:30.356223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:17:57.165914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339956+0000","last_change":"2024-08-20T04:59:21.905202+0000","last_active":"2024-08-20T05:01:30.339956+0000","last_peered":"2024-08-20T05:01:30.339956+0000","last_clean":"2024-08-20T05:01:30.339956+0000","last_became_active":"2024-08-20T04:59:21.904771+0000","last_became_peered":"2024-08-20T04:59:21.904771+0000","last_unstale":"2024-08-20T05:01:30.339956+0000","last_undegraded":"2024-08-20T05:01:30.339956+0000","last_fullsized":"2024-08-20T05:01:30.339956+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:35:56.887981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"86'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356122+0000","last_change":"2024-08-20T04:59:12.798301+0000","last_active":"2024-08-20T05:01:30.356122+0000","last_peered":"2024-08-20T05:01:30.356122+0000","last_clean":"2024-08-20T05:01:30.356122+0000","last_became_active":"2024-08-20T04:59:12.797934+0000","last_became_peered":"2024-08-20T04:59:12.797934+0000","last_unstale":"2024-08-20T05:01:30.356122+0000","last_undegraded":"2024-08-20T05:01:30.356122+0000","last_fullsized":"2024-08-20T05:01:30.356122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:41:24.465380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343575+0000","last_change":"2024-08-20T04:59:09.947602+0000","last_active":"2024-08-20T05:01:30.343575+0000","last_peered":"2024-08-20T05:01:30.343575+0000","last_clean":"2024-08-20T05:01:30.343575+0000","last_became_active":"2024-08-20T04:59:09.946795+0000","last_became_peered":"2024-08-20T04:59:09.946795+0000","last_unstale":"2024-08-20T05:01:30.343575+0000","last_undegraded":"2024-08-20T05:01:30.343575+0000","last_fullsized":"2024-08-20T05:01:30.343575+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:09:09.003266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":38,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344130+0000","last_change":"2024-08-20T05:00:29.860828+0000","last_active":"2024-08-20T05:01:30.344130+0000","last_peered":"2024-08-20T05:01:30.344130+0000","last_clean":"2024-08-20T05:01:30.344130+0000","last_became_active":"2024-08-20T05:00:29.860242+0000","last_became_peered":"2024-08-20T05:00:29.860242+0000","last_unstale":"2024-08-20T05:01:30.344130+0000","last_undegraded":"2024-08-20T05:01:30.344130+0000","last_fullsized":"2024-08-20T05:01:30.344130+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:09:42.311207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356682+0000","last_change":"2024-08-20T04:59:12.784852+0000","last_active":"2024-08-20T05:01:30.356682+0000","last_peered":"2024-08-20T05:01:30.356682+0000","last_clean":"2024-08-20T05:01:30.356682+0000","last_became_active":"2024-08-20T04:59:12.784496+0000","last_became_peered":"2024-08-20T04:59:12.784496+0000","last_unstale":"2024-08-20T05:01:30.356682+0000","last_undegraded":"2024-08-20T05:01:30.356682+0000","last_fullsized":"2024-08-20T05:01:30.356682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:41:42.421383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":188,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:22.362098+0000","last_change":"2024-08-20T04:59:09.750785+0000","last_active":"2024-08-20T05:02:22.362098+0000","last_peered":"2024-08-20T05:02:22.362098+0000","last_clean":"2024-08-20T05:02:22.362098+0000","last_became_active":"2024-08-20T04:59:09.750255+0000","last_became_peered":"2024-08-20T04:59:09.750255+0000","last_unstale":"2024-08-20T05:02:22.362098+0000","last_undegraded":"2024-08-20T05:02:22.362098+0000","last_fullsized":"2024-08-20T05:02:22.362098+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:20:17.900367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355715+0000","last_change":"2024-08-20T04:59:21.909409+0000","last_active":"2024-08-20T05:01:30.355715+0000","last_peered":"2024-08-20T05:01:30.355715+0000","last_clean":"2024-08-20T05:01:30.355715+0000","last_became_active":"2024-08-20T04:59:21.907934+0000","last_became_peered":"2024-08-20T04:59:21.907934+0000","last_unstale":"2024-08-20T05:01:30.355715+0000","last_undegraded":"2024-08-20T05:01:30.355715+0000","last_fullsized":"2024-08-20T05:01:30.355715+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:26:36.768407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355879+0000","last_change":"2024-08-20T04:59:12.783496+0000","last_active":"2024-08-20T05:01:30.355879+0000","last_peered":"2024-08-20T05:01:30.355879+0000","last_clean":"2024-08-20T05:01:30.355879+0000","last_became_active":"2024-08-20T04:59:12.783211+0000","last_became_peered":"2024-08-20T04:59:12.783211+0000","last_unstale":"2024-08-20T05:01:30.355879+0000","last_undegraded":"2024-08-20T05:01:30.355879+0000","last_fullsized":"2024-08-20T05:01:30.355879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:45:49.514189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":191,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:23.364010+0000","last_change":"2024-08-20T04:59:09.948284+0000","last_active":"2024-08-20T05:02:23.364010+0000","last_peered":"2024-08-20T05:02:23.364010+0000","last_clean":"2024-08-20T05:02:23.364010+0000","last_became_active":"2024-08-20T04:59:09.947909+0000","last_became_peered":"2024-08-20T04:59:09.947909+0000","last_unstale":"2024-08-20T05:02:23.364010+0000","last_undegraded":"2024-08-20T05:02:23.364010+0000","last_fullsized":"2024-08-20T05:02:23.364010+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:24:04.344380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":140,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356288+0000","last_change":"2024-08-20T04:59:21.905282+0000","last_active":"2024-08-20T05:01:30.356288+0000","last_peered":"2024-08-20T05:01:30.356288+0000","last_clean":"2024-08-20T05:01:30.356288+0000","last_became_active":"2024-08-20T04:59:21.904842+0000","last_became_peered":"2024-08-20T04:59:21.904842+0000","last_unstale":"2024-08-20T05:01:30.356288+0000","last_undegraded":"2024-08-20T05:01:30.356288+0000","last_fullsized":"2024-08-20T05:01:30.356288+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:01:19.949949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355357+0000","last_change":"2024-08-20T04:59:12.788571+0000","last_active":"2024-08-20T05:01:30.355357+0000","last_peered":"2024-08-20T05:01:30.355357+0000","last_clean":"2024-08-20T05:01:30.355357+0000","last_became_active":"2024-08-20T04:59:12.784148+0000","last_became_peered":"2024-08-20T04:59:12.784148+0000","last_unstale":"2024-08-20T05:01:30.355357+0000","last_undegraded":"2024-08-20T05:01:30.355357+0000","last_fullsized":"2024-08-20T05:01:30.355357+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:10:51.565404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340278+0000","last_change":"2024-08-20T04:59:09.753842+0000","last_active":"2024-08-20T05:01:30.340278+0000","last_peered":"2024-08-20T05:01:30.340278+0000","last_clean":"2024-08-20T05:01:30.340278+0000","last_became_active":"2024-08-20T04:59:09.753439+0000","last_became_peered":"2024-08-20T04:59:09.753439+0000","last_unstale":"2024-08-20T05:01:30.340278+0000","last_undegraded":"2024-08-20T05:01:30.340278+0000","last_fullsized":"2024-08-20T05:01:30.340278+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:23:54.171964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356341+0000","last_change":"2024-08-20T04:59:21.909621+0000","last_active":"2024-08-20T05:01:30.356341+0000","last_peered":"2024-08-20T05:01:30.356341+0000","last_clean":"2024-08-20T05:01:30.356341+0000","last_became_active":"2024-08-20T04:59:21.909239+0000","last_became_peered":"2024-08-20T04:59:21.909239+0000","last_unstale":"2024-08-20T05:01:30.356341+0000","last_undegraded":"2024-08-20T05:01:30.356341+0000","last_fullsized":"2024-08-20T05:01:30.356341+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:53:15.131163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356523+0000","last_change":"2024-08-20T04:59:12.796643+0000","last_active":"2024-08-20T05:01:30.356523+0000","last_peered":"2024-08-20T05:01:30.356523+0000","last_clean":"2024-08-20T05:01:30.356523+0000","last_became_active":"2024-08-20T04:59:12.796262+0000","last_became_peered":"2024-08-20T04:59:12.796262+0000","last_unstale":"2024-08-20T05:01:30.356523+0000","last_undegraded":"2024-08-20T05:01:30.356523+0000","last_fullsized":"2024-08-20T05:01:30.356523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:11:37.792359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":54,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357176+0000","last_change":"2024-08-20T04:59:09.750550+0000","last_active":"2024-08-20T05:01:30.357176+0000","last_peered":"2024-08-20T05:01:30.357176+0000","last_clean":"2024-08-20T05:01:30.357176+0000","last_became_active":"2024-08-20T04:59:09.750097+0000","last_became_peered":"2024-08-20T04:59:09.750097+0000","last_unstale":"2024-08-20T05:01:30.357176+0000","last_undegraded":"2024-08-20T05:01:30.357176+0000","last_fullsized":"2024-08-20T05:01:30.357176+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:32:22.826478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":118,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340442+0000","last_change":"2024-08-20T04:57:50.824023+0000","last_active":"2024-08-20T05:01:30.340442+0000","last_peered":"2024-08-20T05:01:30.340442+0000","last_clean":"2024-08-20T05:01:30.340442+0000","last_became_active":"2024-08-20T04:57:50.350587+0000","last_became_peered":"2024-08-20T04:57:50.350587+0000","last_unstale":"2024-08-20T05:01:30.340442+0000","last_undegraded":"2024-08-20T05:01:30.340442+0000","last_fullsized":"2024-08-20T05:01:30.340442+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:54:17.224468+0000","last_clean_scrub_stamp":"2024-08-20T04:54:17.224468+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:59:23.450117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"84'1","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340604+0000","last_change":"2024-08-20T05:00:29.866063+0000","last_active":"2024-08-20T05:01:30.340604+0000","last_peered":"2024-08-20T05:01:30.340604+0000","last_clean":"2024-08-20T05:01:30.340604+0000","last_became_active":"2024-08-20T05:00:29.861545+0000","last_became_peered":"2024-08-20T05:00:29.861545+0000","last_unstale":"2024-08-20T05:01:30.340604+0000","last_undegraded":"2024-08-20T05:01:30.340604+0000","last_fullsized":"2024-08-20T05:01:30.340604+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:02:18.516044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,10],"acting":[7,5,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.341028+0000","last_change":"2024-08-20T04:59:12.793799+0000","last_active":"2024-08-20T05:01:30.341028+0000","last_peered":"2024-08-20T05:01:30.341028+0000","last_clean":"2024-08-20T05:01:30.341028+0000","last_became_active":"2024-08-20T04:59:12.793487+0000","last_became_peered":"2024-08-20T04:59:12.793487+0000","last_unstale":"2024-08-20T05:01:30.341028+0000","last_undegraded":"2024-08-20T05:01:30.341028+0000","last_fullsized":"2024-08-20T05:01:30.341028+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:08:30.835824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"86'7","reported_seq":191,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:20.391189+0000","last_change":"2024-08-20T04:59:09.964586+0000","last_active":"2024-08-20T05:02:20.391189+0000","last_peered":"2024-08-20T05:02:20.391189+0000","last_clean":"2024-08-20T05:02:20.391189+0000","last_became_active":"2024-08-20T04:59:09.964258+0000","last_became_peered":"2024-08-20T04:59:09.964258+0000","last_unstale":"2024-08-20T05:02:20.391189+0000","last_undegraded":"2024-08-20T05:02:20.391189+0000","last_fullsized":"2024-08-20T05:02:20.391189+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:37:48.138019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357127+0000","last_change":"2024-08-20T04:59:21.906724+0000","last_active":"2024-08-20T05:01:30.357127+0000","last_peered":"2024-08-20T05:01:30.357127+0000","last_clean":"2024-08-20T05:01:30.357127+0000","last_became_active":"2024-08-20T04:59:21.906197+0000","last_became_peered":"2024-08-20T04:59:21.906197+0000","last_unstale":"2024-08-20T05:01:30.357127+0000","last_undegraded":"2024-08-20T05:01:30.357127+0000","last_fullsized":"2024-08-20T05:01:30.357127+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:10:45.819035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340707+0000","last_change":"2024-08-20T04:59:12.794221+0000","last_active":"2024-08-20T05:01:30.340707+0000","last_peered":"2024-08-20T05:01:30.340707+0000","last_clean":"2024-08-20T05:01:30.340707+0000","last_became_active":"2024-08-20T04:59:12.793680+0000","last_became_peered":"2024-08-20T04:59:12.793680+0000","last_unstale":"2024-08-20T05:01:30.340707+0000","last_undegraded":"2024-08-20T05:01:30.340707+0000","last_fullsized":"2024-08-20T05:01:30.340707+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:45.435700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356414+0000","last_change":"2024-08-20T04:59:09.755955+0000","last_active":"2024-08-20T05:01:30.356414+0000","last_peered":"2024-08-20T05:01:30.356414+0000","last_clean":"2024-08-20T05:01:30.356414+0000","last_became_active":"2024-08-20T04:59:09.755614+0000","last_became_peered":"2024-08-20T04:59:09.755614+0000","last_unstale":"2024-08-20T05:01:30.356414+0000","last_undegraded":"2024-08-20T05:01:30.356414+0000","last_fullsized":"2024-08-20T05:01:30.356414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:15:06.977367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338518+0000","last_change":"2024-08-20T04:59:21.915952+0000","last_active":"2024-08-20T05:01:30.338518+0000","last_peered":"2024-08-20T05:01:30.338518+0000","last_clean":"2024-08-20T05:01:30.338518+0000","last_became_active":"2024-08-20T04:59:21.915533+0000","last_became_peered":"2024-08-20T04:59:21.915533+0000","last_unstale":"2024-08-20T05:01:30.338518+0000","last_undegraded":"2024-08-20T05:01:30.338518+0000","last_fullsized":"2024-08-20T05:01:30.338518+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:52:54.906061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340713+0000","last_change":"2024-08-20T04:59:12.782663+0000","last_active":"2024-08-20T05:01:30.340713+0000","last_peered":"2024-08-20T05:01:30.340713+0000","last_clean":"2024-08-20T05:01:30.340713+0000","last_became_active":"2024-08-20T04:59:12.782068+0000","last_became_peered":"2024-08-20T04:59:12.782068+0000","last_unstale":"2024-08-20T05:01:30.340713+0000","last_undegraded":"2024-08-20T05:01:30.340713+0000","last_fullsized":"2024-08-20T05:01:30.340713+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:46:39.662033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356158+0000","last_change":"2024-08-20T04:59:09.747456+0000","last_active":"2024-08-20T05:01:30.356158+0000","last_peered":"2024-08-20T05:01:30.356158+0000","last_clean":"2024-08-20T05:01:30.356158+0000","last_became_active":"2024-08-20T04:59:09.747141+0000","last_became_peered":"2024-08-20T04:59:09.747141+0000","last_unstale":"2024-08-20T05:01:30.356158+0000","last_undegraded":"2024-08-20T05:01:30.356158+0000","last_fullsized":"2024-08-20T05:01:30.356158+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:39:01.600831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355926+0000","last_change":"2024-08-20T04:59:21.898059+0000","last_active":"2024-08-20T05:01:30.355926+0000","last_peered":"2024-08-20T05:01:30.355926+0000","last_clean":"2024-08-20T05:01:30.355926+0000","last_became_active":"2024-08-20T04:59:21.897617+0000","last_became_peered":"2024-08-20T04:59:21.897617+0000","last_unstale":"2024-08-20T05:01:30.355926+0000","last_undegraded":"2024-08-20T05:01:30.355926+0000","last_fullsized":"2024-08-20T05:01:30.355926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:53:21.122106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340301+0000","last_change":"2024-08-20T05:00:29.372299+0000","last_active":"2024-08-20T05:01:30.340301+0000","last_peered":"2024-08-20T05:01:30.340301+0000","last_clean":"2024-08-20T05:01:30.340301+0000","last_became_active":"2024-08-20T05:00:29.371959+0000","last_became_peered":"2024-08-20T05:00:29.371959+0000","last_unstale":"2024-08-20T05:01:30.340301+0000","last_undegraded":"2024-08-20T05:01:30.340301+0000","last_fullsized":"2024-08-20T05:01:30.340301+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:03.996267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343839+0000","last_change":"2024-08-20T04:59:09.751943+0000","last_active":"2024-08-20T05:01:30.343839+0000","last_peered":"2024-08-20T05:01:30.343839+0000","last_clean":"2024-08-20T05:01:30.343839+0000","last_became_active":"2024-08-20T04:59:09.751586+0000","last_became_peered":"2024-08-20T04:59:09.751586+0000","last_unstale":"2024-08-20T05:01:30.343839+0000","last_undegraded":"2024-08-20T05:01:30.343839+0000","last_fullsized":"2024-08-20T05:01:30.343839+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:35:03.400574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355994+0000","last_change":"2024-08-20T04:59:21.901315+0000","last_active":"2024-08-20T05:01:30.355994+0000","last_peered":"2024-08-20T05:01:30.355994+0000","last_clean":"2024-08-20T05:01:30.355994+0000","last_became_active":"2024-08-20T04:59:21.900871+0000","last_became_peered":"2024-08-20T04:59:21.900871+0000","last_unstale":"2024-08-20T05:01:30.355994+0000","last_undegraded":"2024-08-20T05:01:30.355994+0000","last_fullsized":"2024-08-20T05:01:30.355994+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:39:30.940409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355957+0000","last_change":"2024-08-20T04:59:12.793140+0000","last_active":"2024-08-20T05:01:30.355957+0000","last_peered":"2024-08-20T05:01:30.355957+0000","last_clean":"2024-08-20T05:01:30.355957+0000","last_became_active":"2024-08-20T04:59:12.792678+0000","last_became_peered":"2024-08-20T04:59:12.792678+0000","last_unstale":"2024-08-20T05:01:30.355957+0000","last_undegraded":"2024-08-20T05:01:30.355957+0000","last_fullsized":"2024-08-20T05:01:30.355957+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:07:05.610634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":64,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342165+0000","last_change":"2024-08-20T04:59:09.946158+0000","last_active":"2024-08-20T05:01:30.342165+0000","last_peered":"2024-08-20T05:01:30.342165+0000","last_clean":"2024-08-20T05:01:30.342165+0000","last_became_active":"2024-08-20T04:59:09.945736+0000","last_became_peered":"2024-08-20T04:59:09.945736+0000","last_unstale":"2024-08-20T05:01:30.342165+0000","last_undegraded":"2024-08-20T05:01:30.342165+0000","last_fullsized":"2024-08-20T05:01:30.342165+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:02.759879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356102+0000","last_change":"2024-08-20T04:59:21.913457+0000","last_active":"2024-08-20T05:01:30.356102+0000","last_peered":"2024-08-20T05:01:30.356102+0000","last_clean":"2024-08-20T05:01:30.356102+0000","last_became_active":"2024-08-20T04:59:21.910468+0000","last_became_peered":"2024-08-20T04:59:21.910468+0000","last_unstale":"2024-08-20T05:01:30.356102+0000","last_undegraded":"2024-08-20T05:01:30.356102+0000","last_fullsized":"2024-08-20T05:01:30.356102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:16:30.817166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340293+0000","last_change":"2024-08-20T04:59:12.788088+0000","last_active":"2024-08-20T05:01:30.340293+0000","last_peered":"2024-08-20T05:01:30.340293+0000","last_clean":"2024-08-20T05:01:30.340293+0000","last_became_active":"2024-08-20T04:59:12.787756+0000","last_became_peered":"2024-08-20T04:59:12.787756+0000","last_unstale":"2024-08-20T05:01:30.340293+0000","last_undegraded":"2024-08-20T05:01:30.340293+0000","last_fullsized":"2024-08-20T05:01:30.340293+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:48:51.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'7","reported_seq":194,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:22.363226+0000","last_change":"2024-08-20T04:59:09.746896+0000","last_active":"2024-08-20T05:02:22.363226+0000","last_peered":"2024-08-20T05:02:22.363226+0000","last_clean":"2024-08-20T05:02:22.363226+0000","last_became_active":"2024-08-20T04:59:09.746570+0000","last_became_peered":"2024-08-20T04:59:09.746570+0000","last_unstale":"2024-08-20T05:02:22.363226+0000","last_undegraded":"2024-08-20T05:02:22.363226+0000","last_fullsized":"2024-08-20T05:02:22.363226+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:06:02.395260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342767+0000","last_change":"2024-08-20T04:59:21.911747+0000","last_active":"2024-08-20T05:01:30.342767+0000","last_peered":"2024-08-20T05:01:30.342767+0000","last_clean":"2024-08-20T05:01:30.342767+0000","last_became_active":"2024-08-20T04:59:21.908861+0000","last_became_peered":"2024-08-20T04:59:21.908861+0000","last_unstale":"2024-08-20T05:01:30.342767+0000","last_undegraded":"2024-08-20T05:01:30.342767+0000","last_fullsized":"2024-08-20T05:01:30.342767+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:22:17.336776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":59,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340612+0000","last_change":"2024-08-20T05:00:29.860903+0000","last_active":"2024-08-20T05:01:30.340612+0000","last_peered":"2024-08-20T05:01:30.340612+0000","last_clean":"2024-08-20T05:01:30.340612+0000","last_became_active":"2024-08-20T05:00:29.860359+0000","last_became_peered":"2024-08-20T05:00:29.860359+0000","last_unstale":"2024-08-20T05:01:30.340612+0000","last_undegraded":"2024-08-20T05:01:30.340612+0000","last_fullsized":"2024-08-20T05:01:30.340612+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:27:02.976859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355985+0000","last_change":"2024-08-20T04:59:09.755225+0000","last_active":"2024-08-20T05:01:30.355985+0000","last_peered":"2024-08-20T05:01:30.355985+0000","last_clean":"2024-08-20T05:01:30.355985+0000","last_became_active":"2024-08-20T04:59:09.754580+0000","last_became_peered":"2024-08-20T04:59:09.754580+0000","last_unstale":"2024-08-20T05:01:30.355985+0000","last_undegraded":"2024-08-20T05:01:30.355985+0000","last_fullsized":"2024-08-20T05:01:30.355985+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:54:53.606954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340025+0000","last_change":"2024-08-20T04:59:21.905200+0000","last_active":"2024-08-20T05:01:30.340025+0000","last_peered":"2024-08-20T05:01:30.340025+0000","last_clean":"2024-08-20T05:01:30.340025+0000","last_became_active":"2024-08-20T04:59:21.904724+0000","last_became_peered":"2024-08-20T04:59:21.904724+0000","last_unstale":"2024-08-20T05:01:30.340025+0000","last_undegraded":"2024-08-20T05:01:30.340025+0000","last_fullsized":"2024-08-20T05:01:30.340025+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:50:43.446750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355643+0000","last_change":"2024-08-20T04:59:12.787261+0000","last_active":"2024-08-20T05:01:30.355643+0000","last_peered":"2024-08-20T05:01:30.355643+0000","last_clean":"2024-08-20T05:01:30.355643+0000","last_became_active":"2024-08-20T04:59:12.786971+0000","last_became_peered":"2024-08-20T04:59:12.786971+0000","last_unstale":"2024-08-20T05:01:30.355643+0000","last_undegraded":"2024-08-20T05:01:30.355643+0000","last_fullsized":"2024-08-20T05:01:30.355643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:55:57.209321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343535+0000","last_change":"2024-08-20T04:59:09.749147+0000","last_active":"2024-08-20T05:01:30.343535+0000","last_peered":"2024-08-20T05:01:30.343535+0000","last_clean":"2024-08-20T05:01:30.343535+0000","last_became_active":"2024-08-20T04:59:09.748806+0000","last_became_peered":"2024-08-20T04:59:09.748806+0000","last_unstale":"2024-08-20T05:01:30.343535+0000","last_undegraded":"2024-08-20T05:01:30.343535+0000","last_fullsized":"2024-08-20T05:01:30.343535+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:59:43.377105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356203+0000","last_change":"2024-08-20T04:59:21.905007+0000","last_active":"2024-08-20T05:01:30.356203+0000","last_peered":"2024-08-20T05:01:30.356203+0000","last_clean":"2024-08-20T05:01:30.356203+0000","last_became_active":"2024-08-20T04:59:21.904608+0000","last_became_peered":"2024-08-20T04:59:21.904608+0000","last_unstale":"2024-08-20T05:01:30.356203+0000","last_undegraded":"2024-08-20T05:01:30.356203+0000","last_fullsized":"2024-08-20T05:01:30.356203+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:00:42.390966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342457+0000","last_change":"2024-08-20T04:59:12.783339+0000","last_active":"2024-08-20T05:01:30.342457+0000","last_peered":"2024-08-20T05:01:30.342457+0000","last_clean":"2024-08-20T05:01:30.342457+0000","last_became_active":"2024-08-20T04:59:12.783051+0000","last_became_peered":"2024-08-20T04:59:12.783051+0000","last_unstale":"2024-08-20T05:01:30.342457+0000","last_undegraded":"2024-08-20T05:01:30.342457+0000","last_fullsized":"2024-08-20T05:01:30.342457+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:23:54.390491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"88'43","reported_seq":378,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:23.530769+0000","last_change":"2024-08-20T04:59:09.754340+0000","last_active":"2024-08-20T05:02:23.530769+0000","last_peered":"2024-08-20T05:02:23.530769+0000","last_clean":"2024-08-20T05:02:23.530769+0000","last_became_active":"2024-08-20T04:59:09.754000+0000","last_became_peered":"2024-08-20T04:59:09.754000+0000","last_unstale":"2024-08-20T05:02:23.530769+0000","last_undegraded":"2024-08-20T05:02:23.530769+0000","last_fullsized":"2024-08-20T05:02:23.530769+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:26:17.256961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70551,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":290,"num_read_kb":216,"num_write":45,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342495+0000","last_change":"2024-08-20T04:59:21.910369+0000","last_active":"2024-08-20T05:01:30.342495+0000","last_peered":"2024-08-20T05:01:30.342495+0000","last_clean":"2024-08-20T05:01:30.342495+0000","last_became_active":"2024-08-20T04:59:21.909941+0000","last_became_peered":"2024-08-20T04:59:21.909941+0000","last_unstale":"2024-08-20T05:01:30.342495+0000","last_undegraded":"2024-08-20T05:01:30.342495+0000","last_fullsized":"2024-08-20T05:01:30.342495+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:27:07.088021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356969+0000","last_change":"2024-08-20T04:59:12.787747+0000","last_active":"2024-08-20T05:01:30.356969+0000","last_peered":"2024-08-20T05:01:30.356969+0000","last_clean":"2024-08-20T05:01:30.356969+0000","last_became_active":"2024-08-20T04:59:12.786962+0000","last_became_peered":"2024-08-20T04:59:12.786962+0000","last_unstale":"2024-08-20T05:01:30.356969+0000","last_undegraded":"2024-08-20T05:01:30.356969+0000","last_fullsized":"2024-08-20T05:01:30.356969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:14:43.822829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356420+0000","last_change":"2024-08-20T04:59:09.947582+0000","last_active":"2024-08-20T05:01:30.356420+0000","last_peered":"2024-08-20T05:01:30.356420+0000","last_clean":"2024-08-20T05:01:30.356420+0000","last_became_active":"2024-08-20T04:59:09.947117+0000","last_became_peered":"2024-08-20T04:59:09.947117+0000","last_unstale":"2024-08-20T05:01:30.356420+0000","last_undegraded":"2024-08-20T05:01:30.356420+0000","last_fullsized":"2024-08-20T05:01:30.356420+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:22:05.815486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357390+0000","last_change":"2024-08-20T04:59:21.910776+0000","last_active":"2024-08-20T05:01:30.357390+0000","last_peered":"2024-08-20T05:01:30.357390+0000","last_clean":"2024-08-20T05:01:30.357390+0000","last_became_active":"2024-08-20T04:59:21.909726+0000","last_became_peered":"2024-08-20T04:59:21.909726+0000","last_unstale":"2024-08-20T05:01:30.357390+0000","last_undegraded":"2024-08-20T05:01:30.357390+0000","last_fullsized":"2024-08-20T05:01:30.357390+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:03:04.042649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":53,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338903+0000","last_change":"2024-08-20T05:00:29.860637+0000","last_active":"2024-08-20T05:01:30.338903+0000","last_peered":"2024-08-20T05:01:30.338903+0000","last_clean":"2024-08-20T05:01:30.338903+0000","last_became_active":"2024-08-20T05:00:29.860250+0000","last_became_peered":"2024-08-20T05:00:29.860250+0000","last_unstale":"2024-08-20T05:01:30.338903+0000","last_undegraded":"2024-08-20T05:01:30.338903+0000","last_fullsized":"2024-08-20T05:01:30.338903+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:11:27.937844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340908+0000","last_change":"2024-08-20T04:59:09.747316+0000","last_active":"2024-08-20T05:01:30.340908+0000","last_peered":"2024-08-20T05:01:30.340908+0000","last_clean":"2024-08-20T05:01:30.340908+0000","last_became_active":"2024-08-20T04:59:09.746959+0000","last_became_peered":"2024-08-20T04:59:09.746959+0000","last_unstale":"2024-08-20T05:01:30.340908+0000","last_undegraded":"2024-08-20T05:01:30.340908+0000","last_fullsized":"2024-08-20T05:01:30.340908+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:35:28.480465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342302+0000","last_change":"2024-08-20T04:59:21.907940+0000","last_active":"2024-08-20T05:01:30.342302+0000","last_peered":"2024-08-20T05:01:30.342302+0000","last_clean":"2024-08-20T05:01:30.342302+0000","last_became_active":"2024-08-20T04:59:21.907591+0000","last_became_peered":"2024-08-20T04:59:21.907591+0000","last_unstale":"2024-08-20T05:01:30.342302+0000","last_undegraded":"2024-08-20T05:01:30.342302+0000","last_fullsized":"2024-08-20T05:01:30.342302+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:33.583556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357523+0000","last_change":"2024-08-20T04:59:12.795662+0000","last_active":"2024-08-20T05:01:30.357523+0000","last_peered":"2024-08-20T05:01:30.357523+0000","last_clean":"2024-08-20T05:01:30.357523+0000","last_became_active":"2024-08-20T04:59:12.795321+0000","last_became_peered":"2024-08-20T04:59:12.795321+0000","last_unstale":"2024-08-20T05:01:30.357523+0000","last_undegraded":"2024-08-20T05:01:30.357523+0000","last_fullsized":"2024-08-20T05:01:30.357523+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:40:30.561306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"86'5","reported_seq":326,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:23.396075+0000","last_change":"2024-08-20T04:59:09.754468+0000","last_active":"2024-08-20T05:02:23.396075+0000","last_peered":"2024-08-20T05:02:23.396075+0000","last_clean":"2024-08-20T05:02:23.396075+0000","last_became_active":"2024-08-20T04:59:09.754115+0000","last_became_peered":"2024-08-20T04:59:09.754115+0000","last_unstale":"2024-08-20T05:02:23.396075+0000","last_undegraded":"2024-08-20T05:02:23.396075+0000","last_fullsized":"2024-08-20T05:02:23.396075+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:50:21.301246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":276,"num_read_kb":276,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356257+0000","last_change":"2024-08-20T04:59:21.898785+0000","last_active":"2024-08-20T05:01:30.356257+0000","last_peered":"2024-08-20T05:01:30.356257+0000","last_clean":"2024-08-20T05:01:30.356257+0000","last_became_active":"2024-08-20T04:59:21.898423+0000","last_became_peered":"2024-08-20T04:59:21.898423+0000","last_unstale":"2024-08-20T05:01:30.356257+0000","last_undegraded":"2024-08-20T05:01:30.356257+0000","last_fullsized":"2024-08-20T05:01:30.356257+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:52:58.800104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338624+0000","last_change":"2024-08-20T04:59:21.906208+0000","last_active":"2024-08-20T05:01:30.338624+0000","last_peered":"2024-08-20T05:01:30.338624+0000","last_clean":"2024-08-20T05:01:30.338624+0000","last_became_active":"2024-08-20T04:59:21.905041+0000","last_became_peered":"2024-08-20T04:59:21.905041+0000","last_unstale":"2024-08-20T05:01:30.338624+0000","last_undegraded":"2024-08-20T05:01:30.338624+0000","last_fullsized":"2024-08-20T05:01:30.338624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:05:28.971357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342413+0000","last_change":"2024-08-20T04:59:12.788130+0000","last_active":"2024-08-20T05:01:30.342413+0000","last_peered":"2024-08-20T05:01:30.342413+0000","last_clean":"2024-08-20T05:01:30.342413+0000","last_became_active":"2024-08-20T04:59:12.787665+0000","last_became_peered":"2024-08-20T04:59:12.787665+0000","last_unstale":"2024-08-20T05:01:30.342413+0000","last_undegraded":"2024-08-20T05:01:30.342413+0000","last_fullsized":"2024-08-20T05:01:30.342413+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:59:39.628781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356172+0000","last_change":"2024-08-20T04:59:09.754842+0000","last_active":"2024-08-20T05:01:30.356172+0000","last_peered":"2024-08-20T05:01:30.356172+0000","last_clean":"2024-08-20T05:01:30.356172+0000","last_became_active":"2024-08-20T04:59:09.754515+0000","last_became_peered":"2024-08-20T04:59:09.754515+0000","last_unstale":"2024-08-20T05:01:30.356172+0000","last_undegraded":"2024-08-20T05:01:30.356172+0000","last_fullsized":"2024-08-20T05:01:30.356172+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:19:02.241567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340312+0000","last_change":"2024-08-20T04:59:21.900610+0000","last_active":"2024-08-20T05:01:30.340312+0000","last_peered":"2024-08-20T05:01:30.340312+0000","last_clean":"2024-08-20T05:01:30.340312+0000","last_became_active":"2024-08-20T04:59:21.900207+0000","last_became_peered":"2024-08-20T04:59:21.900207+0000","last_unstale":"2024-08-20T05:01:30.340312+0000","last_undegraded":"2024-08-20T05:01:30.340312+0000","last_fullsized":"2024-08-20T05:01:30.340312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:41:00.115344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356667+0000","last_change":"2024-08-20T04:59:12.780772+0000","last_active":"2024-08-20T05:01:30.356667+0000","last_peered":"2024-08-20T05:01:30.356667+0000","last_clean":"2024-08-20T05:01:30.356667+0000","last_became_active":"2024-08-20T04:59:12.780385+0000","last_became_peered":"2024-08-20T04:59:12.780385+0000","last_unstale":"2024-08-20T05:01:30.356667+0000","last_undegraded":"2024-08-20T05:01:30.356667+0000","last_fullsized":"2024-08-20T05:01:30.356667+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:27:23.680899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355522+0000","last_change":"2024-08-20T04:59:09.749567+0000","last_active":"2024-08-20T05:01:30.355522+0000","last_peered":"2024-08-20T05:01:30.355522+0000","last_clean":"2024-08-20T05:01:30.355522+0000","last_became_active":"2024-08-20T04:59:09.749204+0000","last_became_peered":"2024-08-20T04:59:09.749204+0000","last_unstale":"2024-08-20T05:01:30.355522+0000","last_undegraded":"2024-08-20T05:01:30.355522+0000","last_fullsized":"2024-08-20T05:01:30.355522+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:57:51.236459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356327+0000","last_change":"2024-08-20T04:59:09.751622+0000","last_active":"2024-08-20T05:01:30.356327+0000","last_peered":"2024-08-20T05:01:30.356327+0000","last_clean":"2024-08-20T05:01:30.356327+0000","last_became_active":"2024-08-20T04:59:09.751227+0000","last_became_peered":"2024-08-20T04:59:09.751227+0000","last_unstale":"2024-08-20T05:01:30.356327+0000","last_undegraded":"2024-08-20T05:01:30.356327+0000","last_fullsized":"2024-08-20T05:01:30.356327+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:53:38.755122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356190+0000","last_change":"2024-08-20T04:59:12.789243+0000","last_active":"2024-08-20T05:01:30.356190+0000","last_peered":"2024-08-20T05:01:30.356190+0000","last_clean":"2024-08-20T05:01:30.356190+0000","last_became_active":"2024-08-20T04:59:12.788932+0000","last_became_peered":"2024-08-20T04:59:12.788932+0000","last_unstale":"2024-08-20T05:01:30.356190+0000","last_undegraded":"2024-08-20T05:01:30.356190+0000","last_fullsized":"2024-08-20T05:01:30.356190+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:27:00.122328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343578+0000","last_change":"2024-08-20T04:59:21.902847+0000","last_active":"2024-08-20T05:01:30.343578+0000","last_peered":"2024-08-20T05:01:30.343578+0000","last_clean":"2024-08-20T05:01:30.343578+0000","last_became_active":"2024-08-20T04:59:21.902426+0000","last_became_peered":"2024-08-20T04:59:21.902426+0000","last_unstale":"2024-08-20T05:01:30.343578+0000","last_undegraded":"2024-08-20T05:01:30.343578+0000","last_fullsized":"2024-08-20T05:01:30.343578+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T12:18:38.107358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":204,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:02:23.531739+0000","last_change":"2024-08-20T05:00:29.375139+0000","last_active":"2024-08-20T05:02:23.531739+0000","last_peered":"2024-08-20T05:02:23.531739+0000","last_clean":"2024-08-20T05:02:23.531739+0000","last_became_active":"2024-08-20T05:00:29.370896+0000","last_became_peered":"2024-08-20T05:00:29.370896+0000","last_unstale":"2024-08-20T05:02:23.531739+0000","last_undegraded":"2024-08-20T05:02:23.531739+0000","last_fullsized":"2024-08-20T05:02:23.531739+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:08.723998+0000","last_clean_scrub_stamp":"2024-08-20T04:59:08.723998+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:06:48.033558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342418+0000","last_change":"2024-08-20T04:59:12.785811+0000","last_active":"2024-08-20T05:01:30.342418+0000","last_peered":"2024-08-20T05:01:30.342418+0000","last_clean":"2024-08-20T05:01:30.342418+0000","last_became_active":"2024-08-20T04:59:12.785483+0000","last_became_peered":"2024-08-20T04:59:12.785483+0000","last_unstale":"2024-08-20T05:01:30.342418+0000","last_undegraded":"2024-08-20T05:01:30.342418+0000","last_fullsized":"2024-08-20T05:01:30.342418+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:31:25.355197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":30,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344575+0000","last_change":"2024-08-20T04:59:21.897832+0000","last_active":"2024-08-20T05:01:30.344575+0000","last_peered":"2024-08-20T05:01:30.344575+0000","last_clean":"2024-08-20T05:01:30.344575+0000","last_became_active":"2024-08-20T04:59:21.897457+0000","last_became_peered":"2024-08-20T04:59:21.897457+0000","last_unstale":"2024-08-20T05:01:30.344575+0000","last_undegraded":"2024-08-20T05:01:30.344575+0000","last_fullsized":"2024-08-20T05:01:30.344575+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:20.876319+0000","last_clean_scrub_stamp":"2024-08-20T04:59:20.876319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:39:51.934014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.339787+0000","last_change":"2024-08-20T04:59:12.787671+0000","last_active":"2024-08-20T05:01:30.339787+0000","last_peered":"2024-08-20T05:01:30.339787+0000","last_clean":"2024-08-20T05:01:30.339787+0000","last_became_active":"2024-08-20T04:59:12.787372+0000","last_became_peered":"2024-08-20T04:59:12.787372+0000","last_unstale":"2024-08-20T05:01:30.339787+0000","last_undegraded":"2024-08-20T05:01:30.339787+0000","last_fullsized":"2024-08-20T05:01:30.339787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:16:55.031031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344513+0000","last_change":"2024-08-20T04:59:12.792192+0000","last_active":"2024-08-20T05:01:30.344513+0000","last_peered":"2024-08-20T05:01:30.344513+0000","last_clean":"2024-08-20T05:01:30.344513+0000","last_became_active":"2024-08-20T04:59:12.791447+0000","last_became_peered":"2024-08-20T04:59:12.791447+0000","last_unstale":"2024-08-20T05:01:30.344513+0000","last_undegraded":"2024-08-20T05:01:30.344513+0000","last_fullsized":"2024-08-20T05:01:30.344513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T07:03:32.559245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343399+0000","last_change":"2024-08-20T04:59:12.785393+0000","last_active":"2024-08-20T05:01:30.343399+0000","last_peered":"2024-08-20T05:01:30.343399+0000","last_clean":"2024-08-20T05:01:30.343399+0000","last_became_active":"2024-08-20T04:59:12.784998+0000","last_became_peered":"2024-08-20T04:59:12.784998+0000","last_unstale":"2024-08-20T05:01:30.343399+0000","last_undegraded":"2024-08-20T05:01:30.343399+0000","last_fullsized":"2024-08-20T05:01:30.343399+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:27:04.964290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338483+0000","last_change":"2024-08-20T04:59:12.784730+0000","last_active":"2024-08-20T05:01:30.338483+0000","last_peered":"2024-08-20T05:01:30.338483+0000","last_clean":"2024-08-20T05:01:30.338483+0000","last_became_active":"2024-08-20T04:59:12.784269+0000","last_became_peered":"2024-08-20T04:59:12.784269+0000","last_unstale":"2024-08-20T05:01:30.338483+0000","last_undegraded":"2024-08-20T05:01:30.338483+0000","last_fullsized":"2024-08-20T05:01:30.338483+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:43:12.248033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355819+0000","last_change":"2024-08-20T04:59:12.786484+0000","last_active":"2024-08-20T05:01:30.355819+0000","last_peered":"2024-08-20T05:01:30.355819+0000","last_clean":"2024-08-20T05:01:30.355819+0000","last_became_active":"2024-08-20T04:59:12.786166+0000","last_became_peered":"2024-08-20T04:59:12.786166+0000","last_unstale":"2024-08-20T05:01:30.355819+0000","last_undegraded":"2024-08-20T05:01:30.355819+0000","last_fullsized":"2024-08-20T05:01:30.355819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:44:30.084519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340680+0000","last_change":"2024-08-20T04:59:12.786985+0000","last_active":"2024-08-20T05:01:30.340680+0000","last_peered":"2024-08-20T05:01:30.340680+0000","last_clean":"2024-08-20T05:01:30.340680+0000","last_became_active":"2024-08-20T04:59:12.786674+0000","last_became_peered":"2024-08-20T04:59:12.786674+0000","last_unstale":"2024-08-20T05:01:30.340680+0000","last_undegraded":"2024-08-20T05:01:30.340680+0000","last_fullsized":"2024-08-20T05:01:30.340680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:30:59.996149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":52,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344184+0000","last_change":"2024-08-20T04:59:12.796410+0000","last_active":"2024-08-20T05:01:30.344184+0000","last_peered":"2024-08-20T05:01:30.344184+0000","last_clean":"2024-08-20T05:01:30.344184+0000","last_became_active":"2024-08-20T04:59:12.796081+0000","last_became_peered":"2024-08-20T04:59:12.796081+0000","last_unstale":"2024-08-20T05:01:30.344184+0000","last_undegraded":"2024-08-20T05:01:30.344184+0000","last_fullsized":"2024-08-20T05:01:30.344184+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:49:09.706265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357071+0000","last_change":"2024-08-20T04:59:12.795994+0000","last_active":"2024-08-20T05:01:30.357071+0000","last_peered":"2024-08-20T05:01:30.357071+0000","last_clean":"2024-08-20T05:01:30.357071+0000","last_became_active":"2024-08-20T04:59:12.795604+0000","last_became_peered":"2024-08-20T04:59:12.795604+0000","last_unstale":"2024-08-20T05:01:30.357071+0000","last_undegraded":"2024-08-20T05:01:30.357071+0000","last_fullsized":"2024-08-20T05:01:30.357071+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:54:09.628743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355741+0000","last_change":"2024-08-20T04:59:12.788966+0000","last_active":"2024-08-20T05:01:30.355741+0000","last_peered":"2024-08-20T05:01:30.355741+0000","last_clean":"2024-08-20T05:01:30.355741+0000","last_became_active":"2024-08-20T04:59:12.788534+0000","last_became_peered":"2024-08-20T04:59:12.788534+0000","last_unstale":"2024-08-20T05:01:30.355741+0000","last_undegraded":"2024-08-20T05:01:30.355741+0000","last_fullsized":"2024-08-20T05:01:30.355741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:11:57.615399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356431+0000","last_change":"2024-08-20T04:59:12.785914+0000","last_active":"2024-08-20T05:01:30.356431+0000","last_peered":"2024-08-20T05:01:30.356431+0000","last_clean":"2024-08-20T05:01:30.356431+0000","last_became_active":"2024-08-20T04:59:12.785551+0000","last_became_peered":"2024-08-20T04:59:12.785551+0000","last_unstale":"2024-08-20T05:01:30.356431+0000","last_undegraded":"2024-08-20T05:01:30.356431+0000","last_fullsized":"2024-08-20T05:01:30.356431+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:30:32.072387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357188+0000","last_change":"2024-08-20T04:59:12.795635+0000","last_active":"2024-08-20T05:01:30.357188+0000","last_peered":"2024-08-20T05:01:30.357188+0000","last_clean":"2024-08-20T05:01:30.357188+0000","last_became_active":"2024-08-20T04:59:12.794805+0000","last_became_peered":"2024-08-20T04:59:12.794805+0000","last_unstale":"2024-08-20T05:01:30.357188+0000","last_undegraded":"2024-08-20T05:01:30.357188+0000","last_fullsized":"2024-08-20T05:01:30.357188+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:09:08.725503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":50,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355737+0000","last_change":"2024-08-20T04:59:12.785099+0000","last_active":"2024-08-20T05:01:30.355737+0000","last_peered":"2024-08-20T05:01:30.355737+0000","last_clean":"2024-08-20T05:01:30.355737+0000","last_became_active":"2024-08-20T04:59:12.784727+0000","last_became_peered":"2024-08-20T04:59:12.784727+0000","last_unstale":"2024-08-20T05:01:30.355737+0000","last_undegraded":"2024-08-20T05:01:30.355737+0000","last_fullsized":"2024-08-20T05:01:30.355737+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:24:36.227289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340160+0000","last_change":"2024-08-20T04:59:12.781832+0000","last_active":"2024-08-20T05:01:30.340160+0000","last_peered":"2024-08-20T05:01:30.340160+0000","last_clean":"2024-08-20T05:01:30.340160+0000","last_became_active":"2024-08-20T04:59:12.781342+0000","last_became_peered":"2024-08-20T04:59:12.781342+0000","last_unstale":"2024-08-20T05:01:30.340160+0000","last_undegraded":"2024-08-20T05:01:30.340160+0000","last_fullsized":"2024-08-20T05:01:30.340160+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:26:17.762048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.344755+0000","last_change":"2024-08-20T04:59:12.792350+0000","last_active":"2024-08-20T05:01:30.344755+0000","last_peered":"2024-08-20T05:01:30.344755+0000","last_clean":"2024-08-20T05:01:30.344755+0000","last_became_active":"2024-08-20T04:59:12.792028+0000","last_became_peered":"2024-08-20T04:59:12.792028+0000","last_unstale":"2024-08-20T05:01:30.344755+0000","last_undegraded":"2024-08-20T05:01:30.344755+0000","last_fullsized":"2024-08-20T05:01:30.344755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:16:23.173759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":47,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.343346+0000","last_change":"2024-08-20T04:59:12.795047+0000","last_active":"2024-08-20T05:01:30.343346+0000","last_peered":"2024-08-20T05:01:30.343346+0000","last_clean":"2024-08-20T05:01:30.343346+0000","last_became_active":"2024-08-20T04:59:12.794705+0000","last_became_peered":"2024-08-20T04:59:12.794705+0000","last_unstale":"2024-08-20T05:01:30.343346+0000","last_undegraded":"2024-08-20T05:01:30.343346+0000","last_fullsized":"2024-08-20T05:01:30.343346+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T08:51:16.355892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340659+0000","last_change":"2024-08-20T04:59:12.785022+0000","last_active":"2024-08-20T05:01:30.340659+0000","last_peered":"2024-08-20T05:01:30.340659+0000","last_clean":"2024-08-20T05:01:30.340659+0000","last_became_active":"2024-08-20T04:59:12.784730+0000","last_became_peered":"2024-08-20T04:59:12.784730+0000","last_unstale":"2024-08-20T05:01:30.340659+0000","last_undegraded":"2024-08-20T05:01:30.340659+0000","last_fullsized":"2024-08-20T05:01:30.340659+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:21:53.053890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356636+0000","last_change":"2024-08-20T04:59:12.790825+0000","last_active":"2024-08-20T05:01:30.356636+0000","last_peered":"2024-08-20T05:01:30.356636+0000","last_clean":"2024-08-20T05:01:30.356636+0000","last_became_active":"2024-08-20T04:59:12.790299+0000","last_became_peered":"2024-08-20T04:59:12.790299+0000","last_unstale":"2024-08-20T05:01:30.356636+0000","last_undegraded":"2024-08-20T05:01:30.356636+0000","last_fullsized":"2024-08-20T05:01:30.356636+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:38:12.477186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338217+0000","last_change":"2024-08-20T05:00:29.374190+0000","last_active":"2024-08-20T05:01:30.338217+0000","last_peered":"2024-08-20T05:01:30.338217+0000","last_clean":"2024-08-20T05:01:30.338217+0000","last_became_active":"2024-08-20T05:00:29.373844+0000","last_became_peered":"2024-08-20T05:00:29.373844+0000","last_unstale":"2024-08-20T05:01:30.338217+0000","last_undegraded":"2024-08-20T05:01:30.338217+0000","last_fullsized":"2024-08-20T05:01:30.338217+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:56:03.131340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338379+0000","last_change":"2024-08-20T04:59:12.783355+0000","last_active":"2024-08-20T05:01:30.338379+0000","last_peered":"2024-08-20T05:01:30.338379+0000","last_clean":"2024-08-20T05:01:30.338379+0000","last_became_active":"2024-08-20T04:59:12.782992+0000","last_became_peered":"2024-08-20T04:59:12.782992+0000","last_unstale":"2024-08-20T05:01:30.338379+0000","last_undegraded":"2024-08-20T05:01:30.338379+0000","last_fullsized":"2024-08-20T05:01:30.338379+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T09:09:47.465235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.355676+0000","last_change":"2024-08-20T04:59:12.783989+0000","last_active":"2024-08-20T05:01:30.355676+0000","last_peered":"2024-08-20T05:01:30.355676+0000","last_clean":"2024-08-20T05:01:30.355676+0000","last_became_active":"2024-08-20T04:59:12.783671+0000","last_became_peered":"2024-08-20T04:59:12.783671+0000","last_unstale":"2024-08-20T05:01:30.355676+0000","last_undegraded":"2024-08-20T05:01:30.355676+0000","last_fullsized":"2024-08-20T05:01:30.355676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:34:55.727599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357140+0000","last_change":"2024-08-20T04:59:12.787118+0000","last_active":"2024-08-20T05:01:30.357140+0000","last_peered":"2024-08-20T05:01:30.357140+0000","last_clean":"2024-08-20T05:01:30.357140+0000","last_became_active":"2024-08-20T04:59:12.786754+0000","last_became_peered":"2024-08-20T04:59:12.786754+0000","last_unstale":"2024-08-20T05:01:30.357140+0000","last_undegraded":"2024-08-20T05:01:30.357140+0000","last_fullsized":"2024-08-20T05:01:30.357140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:13:23.959972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":43,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340919+0000","last_change":"2024-08-20T04:59:12.793748+0000","last_active":"2024-08-20T05:01:30.340919+0000","last_peered":"2024-08-20T05:01:30.340919+0000","last_clean":"2024-08-20T05:01:30.340919+0000","last_became_active":"2024-08-20T04:59:12.792550+0000","last_became_peered":"2024-08-20T04:59:12.792550+0000","last_unstale":"2024-08-20T05:01:30.340919+0000","last_undegraded":"2024-08-20T05:01:30.340919+0000","last_fullsized":"2024-08-20T05:01:30.340919+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:59:24.226273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":55,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356824+0000","last_change":"2024-08-20T04:59:12.788827+0000","last_active":"2024-08-20T05:01:30.356824+0000","last_peered":"2024-08-20T05:01:30.356824+0000","last_clean":"2024-08-20T05:01:30.356824+0000","last_became_active":"2024-08-20T04:59:12.788395+0000","last_became_peered":"2024-08-20T04:59:12.788395+0000","last_unstale":"2024-08-20T05:01:30.356824+0000","last_undegraded":"2024-08-20T05:01:30.356824+0000","last_fullsized":"2024-08-20T05:01:30.356824+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:57:26.453063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":51,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357616+0000","last_change":"2024-08-20T04:59:12.795513+0000","last_active":"2024-08-20T05:01:30.357616+0000","last_peered":"2024-08-20T05:01:30.357616+0000","last_clean":"2024-08-20T05:01:30.357616+0000","last_became_active":"2024-08-20T04:59:12.795191+0000","last_became_peered":"2024-08-20T04:59:12.795191+0000","last_unstale":"2024-08-20T05:01:30.357616+0000","last_undegraded":"2024-08-20T05:01:30.357616+0000","last_fullsized":"2024-08-20T05:01:30.357616+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T13:04:00.893420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":49,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356614+0000","last_change":"2024-08-20T04:59:12.789825+0000","last_active":"2024-08-20T05:01:30.356614+0000","last_peered":"2024-08-20T05:01:30.356614+0000","last_clean":"2024-08-20T05:01:30.356614+0000","last_became_active":"2024-08-20T04:59:12.788198+0000","last_became_peered":"2024-08-20T04:59:12.788198+0000","last_unstale":"2024-08-20T05:01:30.356614+0000","last_undegraded":"2024-08-20T05:01:30.356614+0000","last_fullsized":"2024-08-20T05:01:30.356614+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T11:24:10.898308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":42,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340338+0000","last_change":"2024-08-20T04:59:12.787707+0000","last_active":"2024-08-20T05:01:30.340338+0000","last_peered":"2024-08-20T05:01:30.340338+0000","last_clean":"2024-08-20T05:01:30.340338+0000","last_became_active":"2024-08-20T04:59:12.787035+0000","last_became_peered":"2024-08-20T04:59:12.787035+0000","last_unstale":"2024-08-20T05:01:30.340338+0000","last_undegraded":"2024-08-20T05:01:30.340338+0000","last_fullsized":"2024-08-20T05:01:30.340338+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T05:16:52.451048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":45,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.356216+0000","last_change":"2024-08-20T04:59:12.784012+0000","last_active":"2024-08-20T05:01:30.356216+0000","last_peered":"2024-08-20T05:01:30.356216+0000","last_clean":"2024-08-20T05:01:30.356216+0000","last_became_active":"2024-08-20T04:59:12.783599+0000","last_became_peered":"2024-08-20T04:59:12.783599+0000","last_unstale":"2024-08-20T05:01:30.356216+0000","last_undegraded":"2024-08-20T05:01:30.356216+0000","last_fullsized":"2024-08-20T05:01:30.356216+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T06:23:15.271873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.342676+0000","last_change":"2024-08-20T04:59:12.784987+0000","last_active":"2024-08-20T05:01:30.342676+0000","last_peered":"2024-08-20T05:01:30.342676+0000","last_clean":"2024-08-20T05:01:30.342676+0000","last_became_active":"2024-08-20T04:59:12.784693+0000","last_became_peered":"2024-08-20T04:59:12.784693+0000","last_unstale":"2024-08-20T05:01:30.342676+0000","last_undegraded":"2024-08-20T05:01:30.342676+0000","last_fullsized":"2024-08-20T05:01:30.342676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T16:07:51.624602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":46,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.357088+0000","last_change":"2024-08-20T04:59:12.792466+0000","last_active":"2024-08-20T05:01:30.357088+0000","last_peered":"2024-08-20T05:01:30.357088+0000","last_clean":"2024-08-20T05:01:30.357088+0000","last_became_active":"2024-08-20T04:59:12.792114+0000","last_became_peered":"2024-08-20T04:59:12.792114+0000","last_unstale":"2024-08-20T05:01:30.357088+0000","last_undegraded":"2024-08-20T05:01:30.357088+0000","last_fullsized":"2024-08-20T05:01:30.357088+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:23:09.919907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":44,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338528+0000","last_change":"2024-08-20T04:59:12.793041+0000","last_active":"2024-08-20T05:01:30.338528+0000","last_peered":"2024-08-20T05:01:30.338528+0000","last_clean":"2024-08-20T05:01:30.338528+0000","last_became_active":"2024-08-20T04:59:12.792709+0000","last_became_peered":"2024-08-20T04:59:12.792709+0000","last_unstale":"2024-08-20T05:01:30.338528+0000","last_undegraded":"2024-08-20T05:01:30.338528+0000","last_fullsized":"2024-08-20T05:01:30.338528+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T10:09:04.523493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.338652+0000","last_change":"2024-08-20T04:59:12.790256+0000","last_active":"2024-08-20T05:01:30.338652+0000","last_peered":"2024-08-20T05:01:30.338652+0000","last_clean":"2024-08-20T05:01:30.338652+0000","last_became_active":"2024-08-20T04:59:12.788467+0000","last_became_peered":"2024-08-20T04:59:12.788467+0000","last_unstale":"2024-08-20T05:01:30.338652+0000","last_undegraded":"2024-08-20T05:01:30.338652+0000","last_fullsized":"2024-08-20T05:01:30.338652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T15:55:31.386030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"86'8","reported_seq":48,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-08-20T05:01:30.340563+0000","last_change":"2024-08-20T04:59:12.794882+0000","last_active":"2024-08-20T05:01:30.340563+0000","last_peered":"2024-08-20T05:01:30.340563+0000","last_clean":"2024-08-20T05:01:30.340563+0000","last_became_active":"2024-08-20T04:59:12.794564+0000","last_became_peered":"2024-08-20T04:59:12.794564+0000","last_unstale":"2024-08-20T05:01:30.340563+0000","last_undegraded":"2024-08-20T05:01:30.340563+0000","last_fullsized":"2024-08-20T05:01:30.340563+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-20T04:59:11.745777+0000","last_clean_scrub_stamp":"2024-08-20T04:59:11.745777+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-21T14:36:47.515754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78037,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1418,"num_read_kb":800,"num_write":265,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":734,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":602112,"data_stored":234111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743477,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1028096,"data_stored":510687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939706,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28712,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716440,"statfs":{"total":95995035648,"available":95965634560,"internally_reserved":0,"allocated":1728512,"data_stored":1172038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103232,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1044480,"data_stored":509973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299461,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1032192,"data_stored":510239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462985,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28628,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716524,"statfs":{"total":95995035648,"available":95965720576,"internally_reserved":0,"allocated":1638400,"data_stored":1106989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626512,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":505477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822741,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1646592,"data_stored":1102039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986265,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1036288,"data_stored":510705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182495,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28040,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717112,"statfs":{"total":95995035648,"available":95966322688,"internally_reserved":0,"allocated":1032192,"data_stored":505185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411429,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36428,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708724,"statfs":{"total":95995035648,"available":95957733376,"internally_reserved":0,"allocated":1110016,"data_stored":577188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1097728,"data_stored":577058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738478,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1044480,"data_stored":507465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":72303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":72433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":72819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-20T05:02:27.710 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:02:27.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:27 smithi135 ceph-mon[22342]: pgmap v407: 129 pgs: 129 active+clean; 653 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-20T05:02:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:27 smithi130 ceph-mon[22007]: pgmap v407: 129 pgs: 129 active+clean; 653 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-20T05:02:28.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:27 smithi037 ceph-mon[17265]: pgmap v407: 129 pgs: 129 active+clean; 653 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-20T05:02:28.093 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:28.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.673+0000 7f0067200640 1 -- 172.21.15.37:0/1453966907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0068101cb0 msgr2=0x7f006810ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.673+0000 7f0067200640 1 --2- 172.21.15.37:0/1453966907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0068101cb0 0x7f006810ea00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0050009900 tx=0x7f005002a480 comp rx=0 tx=0).stop 2024-08-20T05:02:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.673+0000 7f0067200640 1 -- 172.21.15.37:0/1453966907 shutdown_connections 2024-08-20T05:02:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.673+0000 7f0067200640 1 --2- 172.21.15.37:0/1453966907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f006810ef40 0x7f0068111330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.673+0000 7f0067200640 1 --2- 172.21.15.37:0/1453966907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0068101cb0 0x7f006810ea00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.673+0000 7f0067200640 1 --2- 172.21.15.37:0/1453966907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0068101390 0x7f0068101770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.673+0000 7f0067200640 1 -- 172.21.15.37:0/1453966907 >> 172.21.15.37:0/1453966907 conn(0x7f00680fd2a0 msgr2=0x7f00680ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.673+0000 7f0067200640 1 -- 172.21.15.37:0/1453966907 shutdown_connections 2024-08-20T05:02:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.673+0000 7f0067200640 1 -- 172.21.15.37:0/1453966907 wait complete. 2024-08-20T05:02:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.674+0000 7f0067200640 1 Processor -- start 2024-08-20T05:02:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.674+0000 7f0067200640 1 -- start start 2024-08-20T05:02:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.675+0000 7f0067200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0068101390 0x7f006819af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.675+0000 7f0067200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0068101cb0 0x7f006819b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.675+0000 7f0067200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f006810ef40 0x7f00681a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.675+0000 7f0067200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0068114ad0 con 0x7f0068101cb0 2024-08-20T05:02:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.675+0000 7f0067200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0068114950 con 0x7f0068101390 2024-08-20T05:02:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.675+0000 7f0067200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0068114c50 con 0x7f006810ef40 2024-08-20T05:02:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.675+0000 7f005fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0068101cb0 0x7f006819b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.675+0000 7f005fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0068101cb0 0x7f006819b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52190/0 (socket says 172.21.15.37:52190) 2024-08-20T05:02:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.675+0000 7f005fe00640 1 -- 172.21.15.37:0/3535136910 learned_addr learned my addr 172.21.15.37:0/3535136910 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.675+0000 7f0066800640 1 --2- 172.21.15.37:0/3535136910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f006810ef40 0x7f00681a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:28.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.675+0000 7f0065e00640 1 --2- 172.21.15.37:0/3535136910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0068101390 0x7f006819af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.675+0000 7f005fe00640 1 -- 172.21.15.37:0/3535136910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f006810ef40 msgr2=0x7f00681a0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.675+0000 7f005fe00640 1 --2- 172.21.15.37:0/3535136910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f006810ef40 0x7f00681a0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.675+0000 7f005fe00640 1 -- 172.21.15.37:0/3535136910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0068101390 msgr2=0x7f006819af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.675+0000 7f005fe00640 1 --2- 172.21.15.37:0/3535136910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0068101390 0x7f006819af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.675+0000 7f005fe00640 1 -- 172.21.15.37:0/3535136910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00681a1030 con 0x7f0068101cb0 2024-08-20T05:02:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.675+0000 7f0066800640 1 --2- 172.21.15.37:0/3535136910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f006810ef40 0x7f00681a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.676+0000 7f005fe00640 1 --2- 172.21.15.37:0/3535136910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0068101cb0 0x7f006819b4c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0050005ab0 tx=0x7f0050003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.676+0000 7f005ea00640 1 -- 172.21.15.37:0/3535136910 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005003f070 con 0x7f0068101cb0 2024-08-20T05:02:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.676+0000 7f005ea00640 1 -- 172.21.15.37:0/3535136910 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0050031b60 con 0x7f0068101cb0 2024-08-20T05:02:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.676+0000 7f005ea00640 1 -- 172.21.15.37:0/3535136910 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050035030 con 0x7f0068101cb0 2024-08-20T05:02:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.676+0000 7f0067200640 1 -- 172.21.15.37:0/3535136910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00681a12c0 con 0x7f0068101cb0 2024-08-20T05:02:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.676+0000 7f0067200640 1 -- 172.21.15.37:0/3535136910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00681a79e0 con 0x7f0068101cb0 2024-08-20T05:02:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.677+0000 7f0067200640 1 -- 172.21.15.37:0/3535136910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0068101770 con 0x7f0068101cb0 2024-08-20T05:02:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.679+0000 7f005ea00640 1 -- 172.21.15.37:0/3535136910 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0050042070 con 0x7f0068101cb0 2024-08-20T05:02:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.681+0000 7f005ea00640 1 --2- 172.21.15.37:0/3535136910 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f004c0b3c70 0x7f004c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.681+0000 7f005ea00640 1 -- 172.21.15.37:0/3535136910 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f00501046d0 con 0x7f0068101cb0 2024-08-20T05:02:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.681+0000 7f0065e00640 1 --2- 172.21.15.37:0/3535136910 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f004c0b3c70 0x7f004c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.682+0000 7f0065e00640 1 --2- 172.21.15.37:0/3535136910 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f004c0b3c70 0x7f004c0b6130 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0058009bd0 tx=0x7f0058005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.685+0000 7f005ea00640 1 -- 172.21.15.37:0/3535136910 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f00500cb2d0 con 0x7f0068101cb0 2024-08-20T05:02:28.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:28 smithi135 ceph-mon[22342]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:28.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.917+0000 7f0067200640 1 -- 172.21.15.37:0/3535136910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00681a7c40 con 0x7f0068101cb0 2024-08-20T05:02:28.919 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:28 smithi037 ceph-mon[17265]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:28.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.918+0000 7f005ea00640 1 -- 172.21.15.37:0/3535136910 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f00500cf820 con 0x7f0068101cb0 2024-08-20T05:02:28.919 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:28.920 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"btime":"2024-08-20T05:02:09:430035+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:02:09.143672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:02:28.920 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 29 2024-08-20T05:02:28.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.921+0000 7f0067200640 1 -- 172.21.15.37:0/3535136910 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f004c0b3c70 msgr2=0x7f004c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:28.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.921+0000 7f0067200640 1 --2- 172.21.15.37:0/3535136910 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f004c0b3c70 0x7f004c0b6130 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0058009bd0 tx=0x7f0058005f90 comp rx=0 tx=0).stop 2024-08-20T05:02:28.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.921+0000 7f0067200640 1 -- 172.21.15.37:0/3535136910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0068101cb0 msgr2=0x7f006819b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:28.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.921+0000 7f0067200640 1 --2- 172.21.15.37:0/3535136910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0068101cb0 0x7f006819b4c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0050005ab0 tx=0x7f0050003c10 comp rx=0 tx=0).stop 2024-08-20T05:02:28.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.921+0000 7f0067200640 1 -- 172.21.15.37:0/3535136910 shutdown_connections 2024-08-20T05:02:28.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.921+0000 7f0067200640 1 --2- 172.21.15.37:0/3535136910 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f004c0b3c70 0x7f004c0b6130 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:28.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.921+0000 7f0067200640 1 --2- 172.21.15.37:0/3535136910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f006810ef40 0x7f00681a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:28.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.921+0000 7f0067200640 1 --2- 172.21.15.37:0/3535136910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0068101cb0 0x7f006819b4c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:28.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.921+0000 7f0067200640 1 --2- 172.21.15.37:0/3535136910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0068101390 0x7f006819af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:28.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.921+0000 7f0067200640 1 -- 172.21.15.37:0/3535136910 >> 172.21.15.37:0/3535136910 conn(0x7f00680fd2a0 msgr2=0x7f0068110240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:28.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.921+0000 7f0067200640 1 -- 172.21.15.37:0/3535136910 shutdown_connections 2024-08-20T05:02:28.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:28.921+0000 7f0067200640 1 -- 172.21.15.37:0/3535136910 wait complete. 2024-08-20T05:02:28.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:28 smithi130 ceph-mon[22007]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-20T05:02:29.706 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:29 smithi037 ceph-mon[17265]: pgmap v408: 129 pgs: 129 active+clean; 653 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-20T05:02:29.706 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:29 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3535136910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:29.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:02:29.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:29 smithi135 ceph-mon[22342]: pgmap v408: 129 pgs: 129 active+clean; 653 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-20T05:02:29.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:29 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3535136910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:29.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:29 smithi130 ceph-mon[22007]: pgmap v408: 129 pgs: 129 active+clean; 653 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-20T05:02:29.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:29 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3535136910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.719+0000 7fe724200640 1 -- 172.21.15.37:0/4064558349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe71c108e40 msgr2=0x7fe71c10f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.719+0000 7fe724200640 1 --2- 172.21.15.37:0/4064558349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe71c108e40 0x7fe71c10f640 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe714009ca0 tx=0x7fe71402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:02:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.719+0000 7fe724200640 1 -- 172.21.15.37:0/4064558349 shutdown_connections 2024-08-20T05:02:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.719+0000 7fe724200640 1 --2- 172.21.15.37:0/4064558349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe71c108e40 0x7fe71c10f640 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:30.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.719+0000 7fe724200640 1 --2- 172.21.15.37:0/4064558349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe71c1084c0 0x7fe71c108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:30.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.719+0000 7fe724200640 1 --2- 172.21.15.37:0/4064558349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe71c102ab0 0x7fe71c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:30.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.719+0000 7fe724200640 1 -- 172.21.15.37:0/4064558349 >> 172.21.15.37:0/4064558349 conn(0x7fe71c0fe500 msgr2=0x7fe71c100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:30.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.719+0000 7fe724200640 1 -- 172.21.15.37:0/4064558349 shutdown_connections 2024-08-20T05:02:30.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.719+0000 7fe724200640 1 -- 172.21.15.37:0/4064558349 wait complete. 2024-08-20T05:02:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.719+0000 7fe724200640 1 Processor -- start 2024-08-20T05:02:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.719+0000 7fe724200640 1 -- start start 2024-08-20T05:02:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.719+0000 7fe724200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe71c102ab0 0x7fe71c19b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.719+0000 7fe724200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe71c1084c0 0x7fe71c19b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.720+0000 7fe724200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe71c108e40 0x7fe71c1a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.720+0000 7fe724200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c112b10 con 0x7fe71c108e40 2024-08-20T05:02:30.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.720+0000 7fe724200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c112990 con 0x7fe71c1084c0 2024-08-20T05:02:30.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.720+0000 7fe724200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c112c90 con 0x7fe71c102ab0 2024-08-20T05:02:30.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.720+0000 7fe721800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe71c102ab0 0x7fe71c19b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:30.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.720+0000 7fe722200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe71c108e40 0x7fe71c1a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:30.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.720+0000 7fe721800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe71c102ab0 0x7fe71c19b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43680/0 (socket says 172.21.15.37:43680) 2024-08-20T05:02:30.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.720+0000 7fe721800640 1 -- 172.21.15.37:0/3457107963 learned_addr learned my addr 172.21.15.37:0/3457107963 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:30.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.720+0000 7fe720e00640 1 --2- 172.21.15.37:0/3457107963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe71c1084c0 0x7fe71c19b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:30.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.720+0000 7fe721800640 1 -- 172.21.15.37:0/3457107963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe71c1084c0 msgr2=0x7fe71c19b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:30.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.720+0000 7fe721800640 1 --2- 172.21.15.37:0/3457107963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe71c1084c0 0x7fe71c19b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:30.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.720+0000 7fe721800640 1 -- 172.21.15.37:0/3457107963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe71c108e40 msgr2=0x7fe71c1a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:30.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.720+0000 7fe721800640 1 --2- 172.21.15.37:0/3457107963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe71c108e40 0x7fe71c1a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:30.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.720+0000 7fe721800640 1 -- 172.21.15.37:0/3457107963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71c1a12a0 con 0x7fe71c102ab0 2024-08-20T05:02:30.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.720+0000 7fe720e00640 1 --2- 172.21.15.37:0/3457107963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe71c1084c0 0x7fe71c19b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.721+0000 7fe721800640 1 --2- 172.21.15.37:0/3457107963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe71c102ab0 0x7fe71c19b1f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe71000e9f0 tx=0x7fe71000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.721+0000 7fe71a000640 1 -- 172.21.15.37:0/3457107963 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71000cd80 con 0x7fe71c102ab0 2024-08-20T05:02:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.721+0000 7fe724200640 1 -- 172.21.15.37:0/3457107963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71c1a1590 con 0x7fe71c102ab0 2024-08-20T05:02:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.721+0000 7fe71a000640 1 -- 172.21.15.37:0/3457107963 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7100108e0 con 0x7fe71c102ab0 2024-08-20T05:02:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.721+0000 7fe71a000640 1 -- 172.21.15.37:0/3457107963 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe710018980 con 0x7fe71c102ab0 2024-08-20T05:02:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.721+0000 7fe724200640 1 -- 172.21.15.37:0/3457107963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe71c1a7e20 con 0x7fe71c102ab0 2024-08-20T05:02:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.722+0000 7fe724200640 1 -- 172.21.15.37:0/3457107963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe71c102e90 con 0x7fe71c102ab0 2024-08-20T05:02:30.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.724+0000 7fe71a000640 1 -- 172.21.15.37:0/3457107963 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe710010430 con 0x7fe71c102ab0 2024-08-20T05:02:30.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.726+0000 7fe71a000640 1 --2- 172.21.15.37:0/3457107963 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe7040b3bd0 0x7fe7040b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:30.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.726+0000 7fe71a000640 1 -- 172.21.15.37:0/3457107963 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe7100e47d0 con 0x7fe71c102ab0 2024-08-20T05:02:30.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.726+0000 7fe720e00640 1 --2- 172.21.15.37:0/3457107963 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe7040b3bd0 0x7fe7040b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:30.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.727+0000 7fe720e00640 1 --2- 172.21.15.37:0/3457107963 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe7040b3bd0 0x7fe7040b6090 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe71c104c00 tx=0x7fe708005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:30.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.727+0000 7fe71a000640 1 -- 172.21.15.37:0/3457107963 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe7100ab3d0 con 0x7fe71c102ab0 2024-08-20T05:02:30.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.960+0000 7fe724200640 1 -- 172.21.15.37:0/3457107963 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe71c19c320 con 0x7fe71c102ab0 2024-08-20T05:02:30.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.961+0000 7fe71a000640 1 -- 172.21.15.37:0/3457107963 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7fe7100af920 con 0x7fe71c102ab0 2024-08-20T05:02:30.964 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:30.964 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"btime":"2024-08-20T05:02:09:430035+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:02:09.143672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:02:30.964 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 29 2024-08-20T05:02:30.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.964+0000 7fe724200640 1 -- 172.21.15.37:0/3457107963 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe7040b3bd0 msgr2=0x7fe7040b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:30.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.964+0000 7fe724200640 1 --2- 172.21.15.37:0/3457107963 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe7040b3bd0 0x7fe7040b6090 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe71c104c00 tx=0x7fe708005f90 comp rx=0 tx=0).stop 2024-08-20T05:02:30.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.964+0000 7fe724200640 1 -- 172.21.15.37:0/3457107963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe71c102ab0 msgr2=0x7fe71c19b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:30.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.964+0000 7fe724200640 1 --2- 172.21.15.37:0/3457107963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe71c102ab0 0x7fe71c19b1f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe71000e9f0 tx=0x7fe71000eeb0 comp rx=0 tx=0).stop 2024-08-20T05:02:30.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.964+0000 7fe724200640 1 -- 172.21.15.37:0/3457107963 shutdown_connections 2024-08-20T05:02:30.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.964+0000 7fe724200640 1 --2- 172.21.15.37:0/3457107963 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe7040b3bd0 0x7fe7040b6090 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:30.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.964+0000 7fe724200640 1 --2- 172.21.15.37:0/3457107963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe71c108e40 0x7fe71c1a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:30.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.964+0000 7fe724200640 1 --2- 172.21.15.37:0/3457107963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe71c1084c0 0x7fe71c19b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:30.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.964+0000 7fe724200640 1 --2- 172.21.15.37:0/3457107963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe71c102ab0 0x7fe71c19b1f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:30.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.964+0000 7fe724200640 1 -- 172.21.15.37:0/3457107963 >> 172.21.15.37:0/3457107963 conn(0x7fe71c0fe500 msgr2=0x7fe71c0750e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:30.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.964+0000 7fe724200640 1 -- 172.21.15.37:0/3457107963 shutdown_connections 2024-08-20T05:02:30.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:30.964+0000 7fe724200640 1 -- 172.21.15.37:0/3457107963 wait complete. 2024-08-20T05:02:31.728 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:31 smithi037 ceph-mon[17265]: pgmap v409: 129 pgs: 129 active+clean; 653 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 11 op/s 2024-08-20T05:02:31.728 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:31 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3457107963' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:31.728 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:31 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:02:31.765 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T05:02:31.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:31 smithi135 ceph-mon[22342]: pgmap v409: 129 pgs: 129 active+clean; 653 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 11 op/s 2024-08-20T05:02:31.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:31 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3457107963' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:31.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:31 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:02:31.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:31 smithi130 ceph-mon[22007]: pgmap v409: 129 pgs: 129 active+clean; 653 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 170 B/s wr, 11 op/s 2024-08-20T05:02:31.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:31 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3457107963' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:31.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:31 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:02:32.146 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:32.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.281+0000 7fad52200640 1 -- 172.21.15.37:0/2983799390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad4c103fa0 msgr2=0x7fad4c10a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.281+0000 7fad52200640 1 --2- 172.21.15.37:0/2983799390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad4c103fa0 0x7fad4c10a920 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fad44009cd0 tx=0x7fad4402a8e0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.281+0000 7fad52200640 1 -- 172.21.15.37:0/2983799390 shutdown_connections 2024-08-20T05:02:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.281+0000 7fad52200640 1 --2- 172.21.15.37:0/2983799390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad4c103fa0 0x7fad4c10a920 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.281+0000 7fad52200640 1 --2- 172.21.15.37:0/2983799390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad4c1035e0 0x7fad4c103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.281+0000 7fad52200640 1 --2- 172.21.15.37:0/2983799390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad4c102490 0x7fad4c102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.281+0000 7fad52200640 1 -- 172.21.15.37:0/2983799390 >> 172.21.15.37:0/2983799390 conn(0x7fad4c0fdd30 msgr2=0x7fad4c100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.281+0000 7fad52200640 1 -- 172.21.15.37:0/2983799390 shutdown_connections 2024-08-20T05:02:32.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.281+0000 7fad52200640 1 -- 172.21.15.37:0/2983799390 wait complete. 2024-08-20T05:02:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.282+0000 7fad52200640 1 Processor -- start 2024-08-20T05:02:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.283+0000 7fad52200640 1 -- start start 2024-08-20T05:02:32.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.283+0000 7fad52200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad4c102490 0x7fad4c19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.283+0000 7fad52200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad4c1035e0 0x7fad4c19b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.283+0000 7fad52200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad4c103fa0 0x7fad4c19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.283+0000 7fad52200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c10e150 con 0x7fad4c103fa0 2024-08-20T05:02:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.283+0000 7fad52200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c10dfd0 con 0x7fad4c102490 2024-08-20T05:02:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.283+0000 7fad52200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c10e2d0 con 0x7fad4c1035e0 2024-08-20T05:02:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.283+0000 7fad51800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad4c103fa0 0x7fad4c19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.283+0000 7fad51800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad4c103fa0 0x7fad4c19bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52218/0 (socket says 172.21.15.37:52218) 2024-08-20T05:02:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.283+0000 7fad4be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad4c1035e0 0x7fad4c19b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.283+0000 7fad51800640 1 -- 172.21.15.37:0/3737218124 learned_addr learned my addr 172.21.15.37:0/3737218124 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.283+0000 7fad50e00640 1 --2- 172.21.15.37:0/3737218124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad4c102490 0x7fad4c19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.284+0000 7fad51800640 1 -- 172.21.15.37:0/3737218124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad4c1035e0 msgr2=0x7fad4c19b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.284+0000 7fad51800640 1 --2- 172.21.15.37:0/3737218124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad4c1035e0 0x7fad4c19b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.284+0000 7fad51800640 1 -- 172.21.15.37:0/3737218124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad4c102490 msgr2=0x7fad4c19aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.284+0000 7fad51800640 1 --2- 172.21.15.37:0/3737218124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad4c102490 0x7fad4c19aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.284+0000 7fad51800640 1 -- 172.21.15.37:0/3737218124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4c19c5d0 con 0x7fad4c103fa0 2024-08-20T05:02:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.284+0000 7fad4be00640 1 --2- 172.21.15.37:0/3737218124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad4c1035e0 0x7fad4c19b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.284+0000 7fad51800640 1 --2- 172.21.15.37:0/3737218124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad4c103fa0 0x7fad4c19bd10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fad4402ae00 tx=0x7fad44003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.284+0000 7fad49600640 1 -- 172.21.15.37:0/3737218124 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad44004040 con 0x7fad4c103fa0 2024-08-20T05:02:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.284+0000 7fad52200640 1 -- 172.21.15.37:0/3737218124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad4c19c860 con 0x7fad4c103fa0 2024-08-20T05:02:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.284+0000 7fad49600640 1 -- 172.21.15.37:0/3737218124 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad44004690 con 0x7fad4c103fa0 2024-08-20T05:02:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.284+0000 7fad49600640 1 -- 172.21.15.37:0/3737218124 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad44030de0 con 0x7fad4c103fa0 2024-08-20T05:02:32.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.285+0000 7fad52200640 1 -- 172.21.15.37:0/3737218124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad4c1a2f90 con 0x7fad4c103fa0 2024-08-20T05:02:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.288+0000 7fad56608740 1 Processor -- start 2024-08-20T05:02:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.289+0000 7fad49600640 1 -- 172.21.15.37:0/3737218124 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fad440305a0 con 0x7fad4c103fa0 2024-08-20T05:02:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.289+0000 7fad56608740 1 -- start start 2024-08-20T05:02:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.289+0000 7fad56608740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a20be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.289+0000 7fad56608740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a21120 0x55e7a8a23510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.289+0000 7fad56608740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a23b60 0x55e7a8a26020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.289+0000 7fad56608740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e7a8991210 con 0x55e7a8a23b60 2024-08-20T05:02:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.289+0000 7fad56608740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e7a8980710 con 0x55e7a8a21120 2024-08-20T05:02:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.289+0000 7fad56608740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e7a8984750 con 0x55e7a8a1e7f0 2024-08-20T05:02:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.290+0000 7fad4be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a23b60 0x55e7a8a26020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.290+0000 7fad50e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a21120 0x55e7a8a23510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.290+0000 7fad4be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a23b60 0x55e7a8a26020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52232/0 (socket says 172.21.15.37:52232) 2024-08-20T05:02:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.290+0000 7fad4be00640 1 -- 172.21.15.37:0/3587370094 learned_addr learned my addr 172.21.15.37:0/3587370094 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.290+0000 7fad4be00640 1 --2- 172.21.15.37:0/3587370094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a20be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.290+0000 7fad4be00640 1 -- 172.21.15.37:0/3587370094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a1e7f0 msgr2=0x55e7a8a20be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.290+0000 7fad4be00640 1 --2- 172.21.15.37:0/3587370094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a20be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.290+0000 7fad4be00640 1 -- 172.21.15.37:0/3587370094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a21120 msgr2=0x55e7a8a23510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.290+0000 7fad4be00640 1 --2- 172.21.15.37:0/3587370094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a21120 0x55e7a8a23510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.290+0000 7fad4be00640 1 -- 172.21.15.37:0/3587370094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7a894cde0 con 0x55e7a8a23b60 2024-08-20T05:02:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.290+0000 7fad4be00640 1 --2- 172.21.15.37:0/3587370094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a23b60 0x55e7a8a26020 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fad38011c40 tx=0x7fad38009bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ac3bf5127b7fe7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.291+0000 7fad42000640 1 -- 172.21.15.37:0/3587370094 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3800fc50 con 0x55e7a8a23b60 2024-08-20T05:02:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.291+0000 7fad42000640 1 -- 172.21.15.37:0/3587370094 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad3800fdf0 con 0x55e7a8a23b60 2024-08-20T05:02:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.291+0000 7fad42000640 1 -- 172.21.15.37:0/3587370094 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3800e610 con 0x55e7a8a23b60 2024-08-20T05:02:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.291+0000 7fad49600640 1 --2- 172.21.15.37:0/3737218124 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad300b3bd0 0x7fad300b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.291+0000 7fad49600640 1 -- 172.21.15.37:0/3737218124 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fad4402e030 con 0x7fad4c103fa0 2024-08-20T05:02:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.291+0000 7fad50e00640 1 --2- 172.21.15.37:0/3737218124 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad300b3bd0 0x7fad300b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.291+0000 7fad56608740 1 -- 172.21.15.37:0/3587370094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a23b60 msgr2=0x55e7a8a26020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.291+0000 7fad56608740 1 --2- 172.21.15.37:0/3587370094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a23b60 0x55e7a8a26020 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fad38011c40 tx=0x7fad38009bc0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.292+0000 7fad56608740 1 -- 172.21.15.37:0/3587370094 shutdown_connections 2024-08-20T05:02:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.292+0000 7fad56608740 1 --2- 172.21.15.37:0/3587370094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a23b60 0x55e7a8a26020 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.292+0000 7fad56608740 1 --2- 172.21.15.37:0/3587370094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a21120 0x55e7a8a23510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.292+0000 7fad56608740 1 --2- 172.21.15.37:0/3587370094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a20be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.292+0000 7fad56608740 1 -- 172.21.15.37:0/3587370094 >> 172.21.15.37:0/3587370094 conn(0x55e7a8a19940 msgr2=0x55e7a8a1a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.292+0000 7fad56608740 1 -- 172.21.15.37:0/3587370094 shutdown_connections 2024-08-20T05:02:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.292+0000 7fad56608740 1 -- 172.21.15.37:0/3587370094 wait complete. 2024-08-20T05:02:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.292+0000 7fad50e00640 1 --2- 172.21.15.37:0/3737218124 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad300b3bd0 0x7fad300b6090 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009da0 tx=0x7fad3c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.292+0000 7fad56608740 1 -- start start 2024-08-20T05:02:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.292+0000 7fad56608740 1 Processor -- start 2024-08-20T05:02:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.293+0000 7fad56608740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a27f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.293+0000 7fad56608740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 0x55e7a8a285c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.293+0000 7fad56608740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a23b60 0x55e7a8a29190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.293+0000 7fad56608740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e7a88b9ab0 con 0x55e7a8a1e7f0 2024-08-20T05:02:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.293+0000 7fad56608740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e7a8927140 con 0x55e7a8a23b60 2024-08-20T05:02:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.293+0000 7fad56608740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e7a8a26b40 con 0x55e7a8a21120 2024-08-20T05:02:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.293+0000 7fad56608740 10 client.0 _ll_register_callbacks cb 0x55e7a893a5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.293+0000 7fad50e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a27f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.293+0000 7fad50e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a27f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52234/0 (socket says 172.21.15.37:52234) 2024-08-20T05:02:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.293+0000 7fad50e00640 1 -- 172.21.15.37:0/3050413294 learned_addr learned my addr 172.21.15.37:0/3050413294 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.293+0000 7fad4be00640 1 --2- 172.21.15.37:0/3050413294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 0x55e7a8a285c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.293+0000 7fad51800640 1 --2- 172.21.15.37:0/3050413294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a23b60 0x55e7a8a29190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.294+0000 7fad4be00640 1 -- 172.21.15.37:0/3050413294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a23b60 msgr2=0x55e7a8a29190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.294+0000 7fad4be00640 1 --2- 172.21.15.37:0/3050413294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a23b60 0x55e7a8a29190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.294+0000 7fad4be00640 1 -- 172.21.15.37:0/3050413294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a1e7f0 msgr2=0x55e7a8a27f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.294+0000 7fad4be00640 1 --2- 172.21.15.37:0/3050413294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a27f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.294+0000 7fad4be00640 1 -- 172.21.15.37:0/3050413294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7a8928170 con 0x55e7a8a21120 2024-08-20T05:02:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.294+0000 7fad50e00640 1 --2- 172.21.15.37:0/3050413294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a27f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.294+0000 7fad4be00640 1 --2- 172.21.15.37:0/3050413294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 0x55e7a8a285c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fad38011c40 tx=0x7fad3801f8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cdbe65fbe75d222 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.294+0000 7fad36a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:02:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.294+0000 7fad36a00640 1 -- 172.21.15.37:0/3050413294 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38025070 con 0x55e7a8a21120 2024-08-20T05:02:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.294+0000 7fad56608740 1 -- 172.21.15.37:0/3050413294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad3800fdf0 con 0x55e7a8a21120 2024-08-20T05:02:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.294+0000 7fad36a00640 1 -- 172.21.15.37:0/3050413294 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fad38004020 con 0x55e7a8a21120 2024-08-20T05:02:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.294+0000 7fad36a00640 1 -- 172.21.15.37:0/3050413294 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fad38032050 con 0x55e7a8a21120 2024-08-20T05:02:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.294+0000 7fad56608740 10 client.25522 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.294+0000 7fad56608740 1 -- 172.21.15.37:0/3050413294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e7a86e3790 con 0x55e7a8a21120 2024-08-20T05:02:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.295+0000 7fad36a00640 1 -- 172.21.15.37:0/3050413294 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad3800fdf0 con 0x55e7a8a21120 2024-08-20T05:02:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.295+0000 7fad36a00640 1 -- 172.21.15.37:0/3050413294 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fad3801d020 con 0x55e7a8a21120 2024-08-20T05:02:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.295+0000 7fad56608740 10 client.25522 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.295+0000 7fad56608740 10 client.25522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:02:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.295+0000 7fad56608740 20 client.25522 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.295+0000 7fad56608740 1 --2- 172.21.15.37:0/3050413294 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e7a8a33870 0x55e7a8a35c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.295+0000 7fad56608740 4 client.25522 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:02:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.295+0000 7fad56608740 1 -- 172.21.15.37:0/3050413294 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7a8993160 con 0x55e7a8a33870 2024-08-20T05:02:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.295+0000 7fad50e00640 1 --2- 172.21.15.37:0/3050413294 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e7a8a33870 0x55e7a8a35c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.296+0000 7fad50e00640 1 --2- 172.21.15.37:0/3050413294 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e7a8a33870 0x55e7a8a35c60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b566e359161709fd server_cookie=381548211a10795d in_seq=0 out_seq=0 2024-08-20T05:02:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.296+0000 7fad36a00640 10 client.25522 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.297+0000 7fad36a00640 1 -- 172.21.15.37:0/3050413294 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7a8993160 con 0x55e7a8a33870 2024-08-20T05:02:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.297+0000 7fad36a00640 10 client.25522 handle_command_reply: tid=0 2024-08-20T05:02:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.297+0000 7fad56608740 1 client.25522 shutdown 2024-08-20T05:02:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.297+0000 7fad56608740 1 -- 172.21.15.37:0/3050413294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 msgr2=0x55e7a8a285c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.297+0000 7fad56608740 1 --2- 172.21.15.37:0/3050413294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 0x55e7a8a285c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fad38011c40 tx=0x7fad3801f8a0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.297+0000 7fad56608740 1 -- 172.21.15.37:0/3050413294 shutdown_connections 2024-08-20T05:02:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.297+0000 7fad56608740 1 --2- 172.21.15.37:0/3050413294 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e7a8a33870 0x55e7a8a35c60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.297+0000 7fad56608740 1 --2- 172.21.15.37:0/3050413294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a23b60 0x55e7a8a29190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.297+0000 7fad56608740 1 --2- 172.21.15.37:0/3050413294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 0x55e7a8a285c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.297+0000 7fad56608740 1 --2- 172.21.15.37:0/3050413294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a27f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.297+0000 7fad36a00640 0 client.25522 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.297+0000 7fad56608740 1 -- 172.21.15.37:0/3050413294 >> 172.21.15.37:0/3050413294 conn(0x55e7a8a19940 msgr2=0x55e7a8a189b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.297+0000 7fad56608740 1 -- 172.21.15.37:0/3050413294 shutdown_connections 2024-08-20T05:02:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.297+0000 7fad56608740 1 -- 172.21.15.37:0/3050413294 wait complete. 2024-08-20T05:02:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.297+0000 7fad56608740 20 client.25522 trim_cache size 0 max 16384 2024-08-20T05:02:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.313+0000 7fad56608740 1 Processor -- start 2024-08-20T05:02:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.313+0000 7fad56608740 1 -- start start 2024-08-20T05:02:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.313+0000 7fad56608740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a28630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.313+0000 7fad56608740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 0x55e7a8a1b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.313+0000 7fad56608740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a23b60 0x55e7a8a1bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.313+0000 7fad56608740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c1ad320 con 0x55e7a8a1e7f0 2024-08-20T05:02:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.313+0000 7fad56608740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c1aee60 con 0x55e7a8a23b60 2024-08-20T05:02:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.313+0000 7fad56608740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c1ad9f0 con 0x55e7a8a21120 2024-08-20T05:02:32.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.313+0000 7fad50e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a28630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.313+0000 7fad4be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 0x55e7a8a1b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.313+0000 7fad50e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a28630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52242/0 (socket says 172.21.15.37:52242) 2024-08-20T05:02:32.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.313+0000 7fad50e00640 1 -- 172.21.15.37:0/2807299480 learned_addr learned my addr 172.21.15.37:0/2807299480 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:32.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.314+0000 7fad51800640 1 --2- 172.21.15.37:0/2807299480 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a23b60 0x55e7a8a1bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.314+0000 7fad4be00640 1 -- 172.21.15.37:0/2807299480 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a23b60 msgr2=0x55e7a8a1bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:32.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.314+0000 7fad4be00640 1 --2- 172.21.15.37:0/2807299480 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a23b60 0x55e7a8a1bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.314+0000 7fad4be00640 1 -- 172.21.15.37:0/2807299480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a1e7f0 msgr2=0x55e7a8a28630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:32.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.314+0000 7fad4be00640 1 --2- 172.21.15.37:0/2807299480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a28630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.314+0000 7fad4be00640 1 -- 172.21.15.37:0/2807299480 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7a8a20f50 con 0x55e7a8a21120 2024-08-20T05:02:32.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.314+0000 7fad50e00640 1 --2- 172.21.15.37:0/2807299480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a28630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:32.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.314+0000 7fad4be00640 1 --2- 172.21.15.37:0/2807299480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 0x55e7a8a1b770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fad3800fc20 tx=0x7fad38011a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e725f0c83b31b10c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:32.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.315+0000 7fad41600640 1 -- 172.21.15.37:0/2807299480 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38004610 con 0x55e7a8a21120 2024-08-20T05:02:32.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.315+0000 7fad41600640 1 -- 172.21.15.37:0/2807299480 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad3801fca0 con 0x55e7a8a21120 2024-08-20T05:02:32.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.315+0000 7fad41600640 1 -- 172.21.15.37:0/2807299480 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38011290 con 0x55e7a8a21120 2024-08-20T05:02:32.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.315+0000 7fad56608740 1 -- 172.21.15.37:0/2807299480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 msgr2=0x55e7a8a1b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:32.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.315+0000 7fad56608740 1 --2- 172.21.15.37:0/2807299480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 0x55e7a8a1b770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fad3800fc20 tx=0x7fad38011a00 comp rx=0 tx=0).stop 2024-08-20T05:02:32.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.315+0000 7fad56608740 1 -- 172.21.15.37:0/2807299480 shutdown_connections 2024-08-20T05:02:32.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.315+0000 7fad56608740 1 --2- 172.21.15.37:0/2807299480 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a23b60 0x55e7a8a1bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.315+0000 7fad56608740 1 --2- 172.21.15.37:0/2807299480 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 0x55e7a8a1b770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.315+0000 7fad56608740 1 --2- 172.21.15.37:0/2807299480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a28630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.315+0000 7fad56608740 1 -- 172.21.15.37:0/2807299480 >> 172.21.15.37:0/2807299480 conn(0x55e7a8a19940 msgr2=0x55e7a8a27f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:32.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.316+0000 7fad56608740 1 -- 172.21.15.37:0/2807299480 shutdown_connections 2024-08-20T05:02:32.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.316+0000 7fad56608740 1 -- 172.21.15.37:0/2807299480 wait complete. 2024-08-20T05:02:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.316+0000 7fad56608740 1 -- start start 2024-08-20T05:02:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.316+0000 7fad56608740 1 Processor -- start 2024-08-20T05:02:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad56608740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a2d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad56608740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 0x55e7a8a2d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad56608740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a23b60 0x55e7a8a2e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad56608740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c1ae790 con 0x55e7a8a23b60 2024-08-20T05:02:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad56608740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c1ae0c0 con 0x55e7a8a1e7f0 2024-08-20T05:02:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad56608740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fad4c1ab300 con 0x55e7a8a21120 2024-08-20T05:02:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad56608740 10 client.0 _ll_register_callbacks cb 0x7fad3c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad51800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a23b60 0x55e7a8a2e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad4be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 0x55e7a8a2d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad51800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a23b60 0x55e7a8a2e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52246/0 (socket says 172.21.15.37:52246) 2024-08-20T05:02:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad51800640 1 -- 172.21.15.37:0/3231693880 learned_addr learned my addr 172.21.15.37:0/3231693880 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad50e00640 1 --2- 172.21.15.37:0/3231693880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a2d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad51800640 1 -- 172.21.15.37:0/3231693880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 msgr2=0x55e7a8a2d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad51800640 1 --2- 172.21.15.37:0/3231693880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 0x55e7a8a2d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad51800640 1 -- 172.21.15.37:0/3231693880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a1e7f0 msgr2=0x55e7a8a2d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad51800640 1 --2- 172.21.15.37:0/3231693880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a2d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad51800640 1 -- 172.21.15.37:0/3231693880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7a875c620 con 0x55e7a8a23b60 2024-08-20T05:02:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.317+0000 7fad4be00640 1 --2- 172.21.15.37:0/3231693880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 0x55e7a8a2d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.318+0000 7fad51800640 1 --2- 172.21.15.37:0/3231693880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a23b60 0x55e7a8a2e300 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fad440cbcb0 tx=0x7fad44009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a179bb7bf829804 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:32.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.318+0000 7fad36a00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:02:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.318+0000 7fad36a00640 1 -- 172.21.15.37:0/3231693880 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad440ee070 con 0x55e7a8a23b60 2024-08-20T05:02:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.318+0000 7fad56608740 1 -- 172.21.15.37:0/3231693880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e7a898ec00 con 0x55e7a8a23b60 2024-08-20T05:02:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.318+0000 7fad36a00640 1 -- 172.21.15.37:0/3231693880 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fad440043f0 con 0x55e7a8a23b60 2024-08-20T05:02:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.318+0000 7fad36a00640 1 -- 172.21.15.37:0/3231693880 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fad440d0050 con 0x55e7a8a23b60 2024-08-20T05:02:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.318+0000 7fad56608740 10 client.15498 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.318+0000 7fad56608740 1 -- 172.21.15.37:0/3231693880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e7a8a2fd90 con 0x55e7a8a23b60 2024-08-20T05:02:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.318+0000 7fad36a00640 1 -- 172.21.15.37:0/3231693880 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e7a898ec00 con 0x55e7a8a23b60 2024-08-20T05:02:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.319+0000 7fad36a00640 1 -- 172.21.15.37:0/3231693880 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fad44102ce0 con 0x55e7a8a23b60 2024-08-20T05:02:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.319+0000 7fad56608740 10 client.15498 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.319+0000 7fad56608740 10 client.15498 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:02:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.319+0000 7fad56608740 20 client.15498 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:32.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.319+0000 7fad56608740 1 --2- 172.21.15.37:0/3231693880 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e7a8a9e6a0 0x55e7a8aa0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.319+0000 7fad56608740 4 client.15498 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:02:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.319+0000 7fad56608740 1 -- 172.21.15.37:0/3231693880 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e7a898c340 con 0x55e7a8a9e6a0 2024-08-20T05:02:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.319+0000 7fad50e00640 1 --2- 172.21.15.37:0/3231693880 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e7a8a9e6a0 0x55e7a8aa0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.320+0000 7fad50e00640 1 --2- 172.21.15.37:0/3231693880 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e7a8a9e6a0 0x55e7a8aa0a90 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61c6fc2d1691988c server_cookie=512f6d11bc871714 in_seq=0 out_seq=0 2024-08-20T05:02:32.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.320+0000 7fad36a00640 10 client.15498 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.331+0000 7fad36a00640 1 -- 172.21.15.37:0/3231693880 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e7a898c340 con 0x55e7a8a9e6a0 2024-08-20T05:02:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.331+0000 7fad36a00640 10 client.15498 handle_command_reply: tid=0 2024-08-20T05:02:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.331+0000 7fad56608740 1 client.15498 shutdown 2024-08-20T05:02:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.331+0000 7fad56608740 1 -- 172.21.15.37:0/3231693880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a23b60 msgr2=0x55e7a8a2e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.331+0000 7fad56608740 1 --2- 172.21.15.37:0/3231693880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a23b60 0x55e7a8a2e300 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fad440cbcb0 tx=0x7fad44009870 comp rx=0 tx=0).stop 2024-08-20T05:02:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.331+0000 7fad56608740 1 -- 172.21.15.37:0/3231693880 shutdown_connections 2024-08-20T05:02:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.331+0000 7fad56608740 1 --2- 172.21.15.37:0/3231693880 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e7a8a9e6a0 0x55e7a8aa0a90 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.331+0000 7fad56608740 1 --2- 172.21.15.37:0/3231693880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7a8a23b60 0x55e7a8a2e300 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.331+0000 7fad36a00640 0 client.15498 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:32.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.331+0000 7fad56608740 1 --2- 172.21.15.37:0/3231693880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7a8a21120 0x55e7a8a2d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.331+0000 7fad56608740 1 --2- 172.21.15.37:0/3231693880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7a8a1e7f0 0x55e7a8a2d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.331+0000 7fad56608740 1 -- 172.21.15.37:0/3231693880 >> 172.21.15.37:0/3231693880 conn(0x55e7a8a19940 msgr2=0x55e7a8a18190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:32.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.332+0000 7fad56608740 1 -- 172.21.15.37:0/3231693880 shutdown_connections 2024-08-20T05:02:32.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.332+0000 7fad56608740 1 -- 172.21.15.37:0/3231693880 wait complete. 2024-08-20T05:02:32.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.332+0000 7fad56608740 20 client.15498 trim_cache size 0 max 16384 2024-08-20T05:02:32.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:02:32.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:02:32.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:02:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:02:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.332+0000 7fad52200640 1 -- 172.21.15.37:0/3737218124 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad300b3bd0 msgr2=0x7fad300b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.332+0000 7fad52200640 1 --2- 172.21.15.37:0/3737218124 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad300b3bd0 0x7fad300b6090 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009da0 tx=0x7fad3c005f90 comp rx=0 tx=0).stop 2024-08-20T05:02:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.332+0000 7fad52200640 1 -- 172.21.15.37:0/3737218124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad4c103fa0 msgr2=0x7fad4c19bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.332+0000 7fad52200640 1 --2- 172.21.15.37:0/3737218124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad4c103fa0 0x7fad4c19bd10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fad4402ae00 tx=0x7fad44003ba0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.333+0000 7fad52200640 1 -- 172.21.15.37:0/3737218124 shutdown_connections 2024-08-20T05:02:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.333+0000 7fad52200640 1 --2- 172.21.15.37:0/3737218124 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad300b3bd0 0x7fad300b6090 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.333+0000 7fad52200640 1 --2- 172.21.15.37:0/3737218124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad4c103fa0 0x7fad4c19bd10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.333+0000 7fad52200640 1 --2- 172.21.15.37:0/3737218124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fad4c1035e0 0x7fad4c19b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.333+0000 7fad52200640 1 --2- 172.21.15.37:0/3737218124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fad4c102490 0x7fad4c19aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.333+0000 7fad52200640 1 -- 172.21.15.37:0/3737218124 >> 172.21.15.37:0/3737218124 conn(0x7fad4c0fdd30 msgr2=0x7fad4c108ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.333+0000 7fad52200640 1 -- 172.21.15.37:0/3737218124 shutdown_connections 2024-08-20T05:02:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:32.333+0000 7fad52200640 1 -- 172.21.15.37:0/3737218124 wait complete. 2024-08-20T05:02:32.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.692+0000 7f56c3e00640 1 -- 172.21.15.37:0/3558086687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc113690 msgr2=0x7f56bc115a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:32.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.692+0000 7f56c3e00640 1 --2- 172.21.15.37:0/3558086687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc113690 0x7f56bc115a80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f56b4009ca0 tx=0x7f56b402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.692+0000 7f56c3e00640 1 -- 172.21.15.37:0/3558086687 shutdown_connections 2024-08-20T05:02:32.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.692+0000 7f56c3e00640 1 --2- 172.21.15.37:0/3558086687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc113690 0x7f56bc115a80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.692+0000 7f56c3e00640 1 --2- 172.21.15.37:0/3558086687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc077d20 0x7f56bc113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.692+0000 7f56c3e00640 1 --2- 172.21.15.37:0/3558086687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56bc077400 0x7f56bc0777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.692+0000 7f56c3e00640 1 -- 172.21.15.37:0/3558086687 >> 172.21.15.37:0/3558086687 conn(0x7f56bc100730 msgr2=0x7f56bc102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.693+0000 7f56c3e00640 1 -- 172.21.15.37:0/3558086687 shutdown_connections 2024-08-20T05:02:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.693+0000 7f56c3e00640 1 -- 172.21.15.37:0/3558086687 wait complete. 2024-08-20T05:02:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.693+0000 7f56c3e00640 1 Processor -- start 2024-08-20T05:02:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.694+0000 7f56c3e00640 1 -- start start 2024-08-20T05:02:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.694+0000 7f56c3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc077400 0x7f56bc19f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.694+0000 7f56c3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56bc077d20 0x7f56bc19fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.694+0000 7f56c3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc113690 0x7f56bc1a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.694+0000 7f56c3e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc1190c0 con 0x7f56bc113690 2024-08-20T05:02:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.694+0000 7f56c3e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc118f40 con 0x7f56bc077d20 2024-08-20T05:02:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.694+0000 7f56c3e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f56bc119240 con 0x7f56bc077400 2024-08-20T05:02:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.694+0000 7f56c1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc113690 0x7f56bc1a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.694+0000 7f56c1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc077400 0x7f56bc19f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.694+0000 7f56c1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc113690 0x7f56bc1a4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52262/0 (socket says 172.21.15.37:52262) 2024-08-20T05:02:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.694+0000 7f56c1e00640 1 -- 172.21.15.37:0/2564983495 learned_addr learned my addr 172.21.15.37:0/2564983495 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.694+0000 7f56c0a00640 1 --2- 172.21.15.37:0/2564983495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56bc077d20 0x7f56bc19fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.695+0000 7f56c1e00640 1 -- 172.21.15.37:0/2564983495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc077400 msgr2=0x7f56bc19f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.695+0000 7f56c1e00640 1 --2- 172.21.15.37:0/2564983495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc077400 0x7f56bc19f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.695+0000 7f56c1e00640 1 -- 172.21.15.37:0/2564983495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56bc077d20 msgr2=0x7f56bc19fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.695+0000 7f56c1e00640 1 --2- 172.21.15.37:0/2564983495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56bc077d20 0x7f56bc19fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.695+0000 7f56c1e00640 1 -- 172.21.15.37:0/2564983495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56bc1a5640 con 0x7f56bc113690 2024-08-20T05:02:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.695+0000 7f56c1e00640 1 --2- 172.21.15.37:0/2564983495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc113690 0x7f56bc1a4e70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f56b4005e30 tx=0x7f56b40317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.695+0000 7f56ba000640 1 -- 172.21.15.37:0/2564983495 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b4003b70 con 0x7f56bc113690 2024-08-20T05:02:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.695+0000 7f56ba000640 1 -- 172.21.15.37:0/2564983495 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56b4003d10 con 0x7f56bc113690 2024-08-20T05:02:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.695+0000 7f56ba000640 1 -- 172.21.15.37:0/2564983495 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b402f970 con 0x7f56bc113690 2024-08-20T05:02:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.695+0000 7f56c3e00640 1 -- 172.21.15.37:0/2564983495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56bc1a58d0 con 0x7f56bc113690 2024-08-20T05:02:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.696+0000 7f56c3e00640 1 -- 172.21.15.37:0/2564983495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56bc1abff0 con 0x7f56bc113690 2024-08-20T05:02:32.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.697+0000 7f56c3e00640 1 -- 172.21.15.37:0/2564983495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56bc0777e0 con 0x7f56bc113690 2024-08-20T05:02:32.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.699+0000 7f56ba000640 1 -- 172.21.15.37:0/2564983495 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f56b402fb10 con 0x7f56bc113690 2024-08-20T05:02:32.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.700+0000 7f56ba000640 1 --2- 172.21.15.37:0/2564983495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f56a40b3c50 0x7f56a40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:32.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.700+0000 7f56ba000640 1 -- 172.21.15.37:0/2564983495 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f56b41051f0 con 0x7f56bc113690 2024-08-20T05:02:32.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.701+0000 7f56c1400640 1 --2- 172.21.15.37:0/2564983495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f56a40b3c50 0x7f56a40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:32.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.701+0000 7f56c1400640 1 --2- 172.21.15.37:0/2564983495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f56a40b3c50 0x7f56a40b6110 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009bd0 tx=0x7f56b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:32.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.704+0000 7f56ba000640 1 -- 172.21.15.37:0/2564983495 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f56b40cc440 con 0x7f56bc113690 2024-08-20T05:02:32.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.905+0000 7f56c3e00640 1 -- 172.21.15.37:0/2564983495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f56bc1ac330 con 0x7f56bc113690 2024-08-20T05:02:32.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.907+0000 7f56ba000640 1 -- 172.21.15.37:0/2564983495 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24873 (secure 0 0 0) 0x7f56b40cbd40 con 0x7f56bc113690 2024-08-20T05:02:32.910 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:32.910 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":88,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","created":"2024-08-20T04:50:26.520303+0000","modified":"2024-08-20T05:01:30.328315+0000","last_up_change":"2024-08-20T04:58:12.250259+0000","last_in_change":"2024-08-20T04:57:49.724189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T04:54:16.381529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T04:59:08.598741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T04:59:10.793802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-20T04:59:19.888446+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a813e53b-68b3-43ff-a59b-aed00e98f2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6803","nonce":3569936373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6805","nonce":3569936373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6809","nonce":3569936373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6807","nonce":3569936373}]},"public_addr":"172.21.15.37:6803/3569936373","cluster_addr":"172.21.15.37:6805/3569936373","heartbeat_back_addr":"172.21.15.37:6809/3569936373","heartbeat_front_addr":"172.21.15.37:6807/3569936373","state":["exists","up"]},{"osd":1,"uuid":"c216a8d0-9685-467a-8161-700682ce617c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6801","nonce":4206461125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6803","nonce":4206461125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6807","nonce":4206461125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6805","nonce":4206461125}]},"public_addr":"172.21.15.130:6801/4206461125","cluster_addr":"172.21.15.130:6803/4206461125","heartbeat_back_addr":"172.21.15.130:6807/4206461125","heartbeat_front_addr":"172.21.15.130:6805/4206461125","state":["exists","up"]},{"osd":2,"uuid":"34402442-c652-40eb-865e-a607a28846b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6801","nonce":2653255199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6803","nonce":2653255199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6807","nonce":2653255199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6805","nonce":2653255199}]},"public_addr":"172.21.15.135:6801/2653255199","cluster_addr":"172.21.15.135:6803/2653255199","heartbeat_back_addr":"172.21.15.135:6807/2653255199","heartbeat_front_addr":"172.21.15.135:6805/2653255199","state":["exists","up"]},{"osd":3,"uuid":"ec7be9dc-96b5-4816-9065-8121baedcdc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6811","nonce":2601290990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6813","nonce":2601290990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6817","nonce":2601290990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6815","nonce":2601290990}]},"public_addr":"172.21.15.37:6811/2601290990","cluster_addr":"172.21.15.37:6813/2601290990","heartbeat_back_addr":"172.21.15.37:6817/2601290990","heartbeat_front_addr":"172.21.15.37:6815/2601290990","state":["exists","up"]},{"osd":4,"uuid":"2dbd47f9-8686-4707-8862-3c7a99a37d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6809","nonce":3542081474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6811","nonce":3542081474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6815","nonce":3542081474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6813","nonce":3542081474}]},"public_addr":"172.21.15.130:6809/3542081474","cluster_addr":"172.21.15.130:6811/3542081474","heartbeat_back_addr":"172.21.15.130:6815/3542081474","heartbeat_front_addr":"172.21.15.130:6813/3542081474","state":["exists","up"]},{"osd":5,"uuid":"9a07a137-d6b7-4aba-8678-4fd164597f27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6809","nonce":2507249148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6811","nonce":2507249148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6815","nonce":2507249148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6813","nonce":2507249148}]},"public_addr":"172.21.15.135:6809/2507249148","cluster_addr":"172.21.15.135:6811/2507249148","heartbeat_back_addr":"172.21.15.135:6815/2507249148","heartbeat_front_addr":"172.21.15.135:6813/2507249148","state":["exists","up"]},{"osd":6,"uuid":"6d6346e8-5418-4c30-9bb3-5af352b616a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6819","nonce":155932692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6821","nonce":155932692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6825","nonce":155932692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6823","nonce":155932692}]},"public_addr":"172.21.15.37:6819/155932692","cluster_addr":"172.21.15.37:6821/155932692","heartbeat_back_addr":"172.21.15.37:6825/155932692","heartbeat_front_addr":"172.21.15.37:6823/155932692","state":["exists","up"]},{"osd":7,"uuid":"c87804c2-d456-495e-b36e-33dbb3548347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6817","nonce":4148130245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6819","nonce":4148130245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6823","nonce":4148130245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6821","nonce":4148130245}]},"public_addr":"172.21.15.130:6817/4148130245","cluster_addr":"172.21.15.130:6819/4148130245","heartbeat_back_addr":"172.21.15.130:6823/4148130245","heartbeat_front_addr":"172.21.15.130:6821/4148130245","state":["exists","up"]},{"osd":8,"uuid":"a7d4c9c8-1826-4703-92ad-ded2800b4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6817","nonce":222884649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6819","nonce":222884649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6823","nonce":222884649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6821","nonce":222884649}]},"public_addr":"172.21.15.135:6817/222884649","cluster_addr":"172.21.15.135:6819/222884649","heartbeat_back_addr":"172.21.15.135:6823/222884649","heartbeat_front_addr":"172.21.15.135:6821/222884649","state":["exists","up"]},{"osd":9,"uuid":"f9e0c194-66b5-4e62-b2ae-816a4a4fffbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6827","nonce":2240773042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6829","nonce":2240773042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6833","nonce":2240773042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6831","nonce":2240773042}]},"public_addr":"172.21.15.37:6827/2240773042","cluster_addr":"172.21.15.37:6829/2240773042","heartbeat_back_addr":"172.21.15.37:6833/2240773042","heartbeat_front_addr":"172.21.15.37:6831/2240773042","state":["exists","up"]},{"osd":10,"uuid":"fa6a50a5-2b97-42d1-9b57-b5502b7083d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6825","nonce":2896730163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6827","nonce":2896730163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6831","nonce":2896730163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6829","nonce":2896730163}]},"public_addr":"172.21.15.130:6825/2896730163","cluster_addr":"172.21.15.130:6827/2896730163","heartbeat_back_addr":"172.21.15.130:6831/2896730163","heartbeat_front_addr":"172.21.15.130:6829/2896730163","state":["exists","up"]},{"osd":11,"uuid":"9a305d75-030d-41db-abfb-81bb71e8c6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6825","nonce":2532897645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6827","nonce":2532897645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6831","nonce":2532897645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6829","nonce":2532897645}]},"public_addr":"172.21.15.135:6825/2532897645","cluster_addr":"172.21.15.135:6827/2532897645","heartbeat_back_addr":"172.21.15.135:6831/2532897645","heartbeat_front_addr":"172.21.15.135:6829/2532897645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:26.455665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:51.456030+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:14.332699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:42.749386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:07.587091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:32.450249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:01.864489+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:26.830527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:51.206257+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:20.400020+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:46.329864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:58:11.086508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4282140105":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/1217599998":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/3737412906":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/58912454":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/2105948300":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/1480362562":"2024-08-21T04:50:59.520912+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T05:02:32.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.909+0000 7f56c3e00640 1 -- 172.21.15.37:0/2564983495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f56a40b3c50 msgr2=0x7f56a40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:32.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.910+0000 7f56c3e00640 1 --2- 172.21.15.37:0/2564983495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f56a40b3c50 0x7f56a40b6110 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f56b0009bd0 tx=0x7f56b0005f90 comp rx=0 tx=0).stop 2024-08-20T05:02:32.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.910+0000 7f56c3e00640 1 -- 172.21.15.37:0/2564983495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc113690 msgr2=0x7f56bc1a4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:32.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.910+0000 7f56c3e00640 1 --2- 172.21.15.37:0/2564983495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc113690 0x7f56bc1a4e70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f56b4005e30 tx=0x7f56b40317c0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.910+0000 7f56c3e00640 1 -- 172.21.15.37:0/2564983495 shutdown_connections 2024-08-20T05:02:32.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.910+0000 7f56c3e00640 1 --2- 172.21.15.37:0/2564983495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f56a40b3c50 0x7f56a40b6110 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.910+0000 7f56c3e00640 1 --2- 172.21.15.37:0/2564983495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56bc113690 0x7f56bc1a4e70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.910+0000 7f56c3e00640 1 --2- 172.21.15.37:0/2564983495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f56bc077d20 0x7f56bc19fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.910+0000 7f56c3e00640 1 --2- 172.21.15.37:0/2564983495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f56bc077400 0x7f56bc19f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:32.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.910+0000 7f56c3e00640 1 -- 172.21.15.37:0/2564983495 >> 172.21.15.37:0/2564983495 conn(0x7f56bc100730 msgr2=0x7f56bc102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:32.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.910+0000 7f56c3e00640 1 -- 172.21.15.37:0/2564983495 shutdown_connections 2024-08-20T05:02:32.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:32.910+0000 7f56c3e00640 1 -- 172.21.15.37:0/2564983495 wait complete. 2024-08-20T05:02:33.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:33 smithi037 ceph-mon[17265]: pgmap v410: 129 pgs: 129 active+clean; 653 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-20T05:02:33.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:33 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2564983495' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:02:33.765 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-08-20T05:02:33.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:33 smithi135 ceph-mon[22342]: pgmap v410: 129 pgs: 129 active+clean; 653 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-20T05:02:33.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:33 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2564983495' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:02:33.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:33 smithi130 ceph-mon[22007]: pgmap v410: 129 pgs: 129 active+clean; 653 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 170 B/s wr, 9 op/s 2024-08-20T05:02:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:33 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2564983495' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:02:34.151 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:35.601 INFO:teuthology.orchestra.run.smithi037.stdout:{"run_dir":"/var/run/ceph"} 2024-08-20T05:02:35.601 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-08-20T05:02:35.601 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 7244 2024-08-20T05:02:35.601 DEBUG:tasks.quiescer:Yielding 2024-08-20T05:02:35.602 INFO:teuthology.run_tasks:Running task exec... 2024-08-20T05:02:35.611 INFO:teuthology.task.exec:Executing custom commands... 2024-08-20T05:02:35.612 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi037.front.sepia.ceph.com 2024-08-20T05:02:35.612 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-08-20T05:02:35.612 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:02:35.689 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:35.722 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem Size Used Avail Use% Mounted on 2024-08-20T05:02:35.722 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:3300,172.21.15.130:3300,172.21.15.135:3300:/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0 1.1T 360M 1.1T 1% /tmp/cephfs 2024-08-20T05:02:35.727 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-08-20T05:02:35.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:35 smithi037 ceph-mon[17265]: pgmap v411: 129 pgs: 129 active+clean; 654 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-08-20T05:02:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:35 smithi135 ceph-mon[22342]: pgmap v411: 129 pgs: 129 active+clean; 654 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-08-20T05:02:35.879 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-08-20T05:02:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:35 smithi130 ceph-mon[22007]: pgmap v411: 129 pgs: 129 active+clean; 654 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 14 op/s 2024-08-20T05:02:35.969 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-08-20T05:02:36.008 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:36.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.633+0000 7f643c000640 1 -- 172.21.15.37:0/1549082829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6434104ca0 msgr2=0x7f6434105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:36.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.633+0000 7f643c000640 1 --2- 172.21.15.37:0/1549082829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6434104ca0 0x7f6434105080 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6428009900 tx=0x7f642802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:02:36.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.633+0000 7f643c000640 1 -- 172.21.15.37:0/1549082829 shutdown_connections 2024-08-20T05:02:36.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.633+0000 7f643c000640 1 --2- 172.21.15.37:0/1549082829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f643410b030 0x7f6434111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.633+0000 7f643c000640 1 --2- 172.21.15.37:0/1549082829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643410a6b0 0x7f643410aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.633+0000 7f643c000640 1 --2- 172.21.15.37:0/1549082829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6434104ca0 0x7f6434105080 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.633+0000 7f643c000640 1 -- 172.21.15.37:0/1549082829 >> 172.21.15.37:0/1549082829 conn(0x7f6434100730 msgr2=0x7f6434102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.633+0000 7f643c000640 1 -- 172.21.15.37:0/1549082829 shutdown_connections 2024-08-20T05:02:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.633+0000 7f643c000640 1 -- 172.21.15.37:0/1549082829 wait complete. 2024-08-20T05:02:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.634+0000 7f643c000640 1 Processor -- start 2024-08-20T05:02:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.634+0000 7f643c000640 1 -- start start 2024-08-20T05:02:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.635+0000 7f643c000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6434104ca0 0x7f643419b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.635+0000 7f643c000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643410a6b0 0x7f643419b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.635+0000 7f643c000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f643410b030 0x7f64341a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.635+0000 7f643c000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6434114d40 con 0x7f643410a6b0 2024-08-20T05:02:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.635+0000 7f643c000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6434114bc0 con 0x7f643410b030 2024-08-20T05:02:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.635+0000 7f643c000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6434114ec0 con 0x7f6434104ca0 2024-08-20T05:02:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.635+0000 7f6439600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6434104ca0 0x7f643419b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:36.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.635+0000 7f6439600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6434104ca0 0x7f643419b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50892/0 (socket says 172.21.15.37:50892) 2024-08-20T05:02:36.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.635+0000 7f6439600640 1 -- 172.21.15.37:0/3344244814 learned_addr learned my addr 172.21.15.37:0/3344244814 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:36.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.635+0000 7f6438c00640 1 --2- 172.21.15.37:0/3344244814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643410a6b0 0x7f643419b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:36.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.636+0000 7f643a000640 1 --2- 172.21.15.37:0/3344244814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f643410b030 0x7f64341a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:36.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.636+0000 7f6439600640 1 -- 172.21.15.37:0/3344244814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f643410b030 msgr2=0x7f64341a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:36.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.636+0000 7f6439600640 1 --2- 172.21.15.37:0/3344244814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f643410b030 0x7f64341a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:36.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.636+0000 7f6439600640 1 -- 172.21.15.37:0/3344244814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643410a6b0 msgr2=0x7f643419b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:36.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.636+0000 7f6439600640 1 --2- 172.21.15.37:0/3344244814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643410a6b0 0x7f643419b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:36.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.636+0000 7f6439600640 1 -- 172.21.15.37:0/3344244814 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64341a1240 con 0x7f6434104ca0 2024-08-20T05:02:36.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.636+0000 7f643a000640 1 --2- 172.21.15.37:0/3344244814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f643410b030 0x7f64341a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:02:36.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.636+0000 7f6439600640 1 --2- 172.21.15.37:0/3344244814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6434104ca0 0x7f643419b190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6428005ab0 tx=0x7f6428003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:36.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.636+0000 7f6432000640 1 -- 172.21.15.37:0/3344244814 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642803f070 con 0x7f6434104ca0 2024-08-20T05:02:36.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.636+0000 7f6432000640 1 -- 172.21.15.37:0/3344244814 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6428031b60 con 0x7f6434104ca0 2024-08-20T05:02:36.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.636+0000 7f6432000640 1 -- 172.21.15.37:0/3344244814 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6428035030 con 0x7f6434104ca0 2024-08-20T05:02:36.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.636+0000 7f643c000640 1 -- 172.21.15.37:0/3344244814 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64341a14d0 con 0x7f6434104ca0 2024-08-20T05:02:36.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.637+0000 7f643c000640 1 -- 172.21.15.37:0/3344244814 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64341a7bf0 con 0x7f6434104ca0 2024-08-20T05:02:36.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.638+0000 7f643c000640 1 -- 172.21.15.37:0/3344244814 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6434105080 con 0x7f6434104ca0 2024-08-20T05:02:36.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.640+0000 7f6432000640 1 -- 172.21.15.37:0/3344244814 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6428042070 con 0x7f6434104ca0 2024-08-20T05:02:36.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.641+0000 7f6432000640 1 --2- 172.21.15.37:0/3344244814 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f641c0b3bd0 0x7f641c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:36.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.642+0000 7f6432000640 1 -- 172.21.15.37:0/3344244814 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6428104b20 con 0x7f6434104ca0 2024-08-20T05:02:36.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.642+0000 7f6438c00640 1 --2- 172.21.15.37:0/3344244814 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f641c0b3bd0 0x7f641c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:36.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.642+0000 7f6438c00640 1 --2- 172.21.15.37:0/3344244814 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f641c0b3bd0 0x7f641c0b6090 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f643410a250 tx=0x7f6420005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:36.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.643+0000 7f6432000640 1 -- 172.21.15.37:0/3344244814 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f6428072070 con 0x7f6434104ca0 2024-08-20T05:02:36.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.948+0000 7f643c000640 1 -- 172.21.15.37:0/3344244814 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f643419c2c0 con 0x7f6434104ca0 2024-08-20T05:02:36.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.949+0000 7f6432000640 1 -- 172.21.15.37:0/3344244814 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11980 (secure 0 0 0) 0x7f64280cbd70 con 0x7f6434104ca0 2024-08-20T05:02:36.951 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:36.951 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"btime":"2024-08-20T05:02:09:430035+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:02:09.143672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:02:36.952 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 29 2024-08-20T05:02:36.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.952+0000 7f643c000640 1 -- 172.21.15.37:0/3344244814 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f641c0b3bd0 msgr2=0x7f641c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:36.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.952+0000 7f643c000640 1 --2- 172.21.15.37:0/3344244814 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f641c0b3bd0 0x7f641c0b6090 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f643410a250 tx=0x7f6420005f90 comp rx=0 tx=0).stop 2024-08-20T05:02:36.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.952+0000 7f643c000640 1 -- 172.21.15.37:0/3344244814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6434104ca0 msgr2=0x7f643419b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:36.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.952+0000 7f643c000640 1 --2- 172.21.15.37:0/3344244814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6434104ca0 0x7f643419b190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6428005ab0 tx=0x7f6428003c10 comp rx=0 tx=0).stop 2024-08-20T05:02:36.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.952+0000 7f643c000640 1 -- 172.21.15.37:0/3344244814 shutdown_connections 2024-08-20T05:02:36.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.952+0000 7f643c000640 1 --2- 172.21.15.37:0/3344244814 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f641c0b3bd0 0x7f641c0b6090 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:36.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.952+0000 7f643c000640 1 --2- 172.21.15.37:0/3344244814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f643410b030 0x7f64341a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:36.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.952+0000 7f643c000640 1 --2- 172.21.15.37:0/3344244814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643410a6b0 0x7f643419b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:36.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.952+0000 7f643c000640 1 --2- 172.21.15.37:0/3344244814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6434104ca0 0x7f643419b190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:36.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.952+0000 7f643c000640 1 -- 172.21.15.37:0/3344244814 >> 172.21.15.37:0/3344244814 conn(0x7f6434100730 msgr2=0x7f6434102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:36.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.952+0000 7f643c000640 1 -- 172.21.15.37:0/3344244814 shutdown_connections 2024-08-20T05:02:36.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:36.952+0000 7f643c000640 1 -- 172.21.15.37:0/3344244814 wait complete. 2024-08-20T05:02:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:37 smithi135 ceph-mon[22342]: pgmap v412: 129 pgs: 129 active+clean; 654 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-08-20T05:02:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:37 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3344244814' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:37.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:37 smithi130 ceph-mon[22007]: pgmap v412: 129 pgs: 129 active+clean; 654 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-08-20T05:02:37.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:37 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3344244814' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:37.979 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:37 smithi037 ceph-mon[17265]: pgmap v412: 129 pgs: 129 active+clean; 654 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-08-20T05:02:37.979 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:37 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3344244814' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:38.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-08-20T05:02:38.380 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-08-20T05:02:38.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-08-20T05:02:38.468 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-08-20T05:02:38.493 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-20T04:59:13.823062+0000', 'modified': '2024-08-20T05:02:09.143672+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24695, 'mds_1': 24664, 'mds_2': 24656, 'mds_3': 24649, 'mds_4': 24637}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14652': {'gid': 14652, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6839/1587848243', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6838', 'nonce': 1587848243}, {'type': 'v1', 'addr': '172.21.15.37:6839', 'nonce': 1587848243}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14664': {'gid': 14664, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.37:6841/466077750', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6840', 'nonce': 466077750}, {'type': 'v1', 'addr': '172.21.15.37:6841', 'nonce': 466077750}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24590': {'gid': 24590, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6833/1818782678', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6832', 'nonce': 1818782678}, {'type': 'v1', 'addr': '172.21.15.130:6833', 'nonce': 1818782678}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24592': {'gid': 24592, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.135:6833/4059666386', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6832', 'nonce': 4059666386}, {'type': 'v1', 'addr': '172.21.15.135:6833', 'nonce': 4059666386}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24626': {'gid': 24626, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.130:6835/538714148', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6834', 'nonce': 538714148}, {'type': 'v1', 'addr': '172.21.15.130:6835', 'nonce': 538714148}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24637': {'gid': 24637, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 22, 'addr': '172.21.15.135:6835/998113160', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6834', 'nonce': 998113160}, {'type': 'v1', 'addr': '172.21.15.135:6835', 'nonce': 998113160}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24649': {'gid': 24649, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 22, 'addr': '172.21.15.135:6837/894352067', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6836', 'nonce': 894352067}, {'type': 'v1', 'addr': '172.21.15.135:6837', 'nonce': 894352067}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24656': {'gid': 24656, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 21, 'addr': '172.21.15.130:6837/1513603753', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6836', 'nonce': 1513603753}, {'type': 'v1', 'addr': '172.21.15.130:6837', 'nonce': 1513603753}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24664': {'gid': 24664, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 20, 'addr': '172.21.15.135:6839/2602130726', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.135:6838', 'nonce': 2602130726}, {'type': 'v1', 'addr': '172.21.15.135:6839', 'nonce': 2602130726}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24695': {'gid': 24695, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.130:6839/2863850712', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.130:6838', 'nonce': 2863850712}, {'type': 'v1', 'addr': '172.21.15.130:6839', 'nonce': 2863850712}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24695, 'qdb_cluster': [24637, 24649, 24656, 24695, 24664]} 2024-08-20T05:02:38.493 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-08-20T05:02:38.494 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.f status 2024-08-20T05:02:38.547 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/: 2024-08-20T05:02:38.547 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:38.547 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 . 2024-08-20T05:02:38.547 INFO:teuthology.orchestra.run.smithi037.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 .. 2024-08-20T05:02:38.547 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 data 2024-08-20T05:02:38.548 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:38.548 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data: 2024-08-20T05:02:38.548 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:38.548 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:02:38.548 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 .. 2024-08-20T05:02:38.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-08-20T05:02:38.695 INFO:teuthology.orchestra.run.smithi037.stdout:[Service] 2024-08-20T05:02:38.695 INFO:teuthology.orchestra.run.smithi037.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-08-20T05:02:38.695 INFO:teuthology.orchestra.run.smithi037.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-08-20T05:02:38.700 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-08-20T05:02:38.906 INFO:teuthology.orchestra.run.smithi037.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-08-20T05:02:38.934 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:39.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.545+0000 7fbf0ba00640 1 -- 172.21.15.37:0/3933794593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0410a6b0 msgr2=0x7fbf0410aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:39.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.545+0000 7fbf0ba00640 1 --2- 172.21.15.37:0/3933794593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0410a6b0 0x7fbf0410aaf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009860 tx=0x7fbef002a340 comp rx=0 tx=0).stop 2024-08-20T05:02:39.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.545+0000 7fbf0ba00640 1 -- 172.21.15.37:0/3933794593 shutdown_connections 2024-08-20T05:02:39.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.545+0000 7fbf0ba00640 1 --2- 172.21.15.37:0/3933794593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf0410b030 0x7fbf04111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.545+0000 7fbf0ba00640 1 --2- 172.21.15.37:0/3933794593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0410a6b0 0x7fbf0410aaf0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.545+0000 7fbf0ba00640 1 --2- 172.21.15.37:0/3933794593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf04104ca0 0x7fbf04105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.545+0000 7fbf0ba00640 1 -- 172.21.15.37:0/3933794593 >> 172.21.15.37:0/3933794593 conn(0x7fbf04100730 msgr2=0x7fbf04102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.545+0000 7fbf0ba00640 1 -- 172.21.15.37:0/3933794593 shutdown_connections 2024-08-20T05:02:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.545+0000 7fbf0ba00640 1 -- 172.21.15.37:0/3933794593 wait complete. 2024-08-20T05:02:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.546+0000 7fbf0ba00640 1 Processor -- start 2024-08-20T05:02:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.546+0000 7fbf0ba00640 1 -- start start 2024-08-20T05:02:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.547+0000 7fbf0ba00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf04104ca0 0x7fbf0419b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.547+0000 7fbf0ba00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf0410a6b0 0x7fbf0419b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.547+0000 7fbf0ba00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf0410b030 0x7fbf041a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.547+0000 7fbf0ba00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbf04114cf0 con 0x7fbf04104ca0 2024-08-20T05:02:39.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.547+0000 7fbf0ba00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbf04114b70 con 0x7fbf0410a6b0 2024-08-20T05:02:39.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.547+0000 7fbf0ba00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbf04114e70 con 0x7fbf0410b030 2024-08-20T05:02:39.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.547+0000 7fbf03e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf0410a6b0 0x7fbf0419b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.547+0000 7fbf09000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf04104ca0 0x7fbf0419b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.547+0000 7fbf03e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf0410a6b0 0x7fbf0419b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56694/0 (socket says 172.21.15.37:56694) 2024-08-20T05:02:39.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.547+0000 7fbf03e00640 1 -- 172.21.15.37:0/4293032385 learned_addr learned my addr 172.21.15.37:0/4293032385 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:39.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.547+0000 7fbf09a00640 1 --2- 172.21.15.37:0/4293032385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf0410b030 0x7fbf041a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.547+0000 7fbf03e00640 1 -- 172.21.15.37:0/4293032385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf0410b030 msgr2=0x7fbf041a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:39.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.547+0000 7fbf03e00640 1 --2- 172.21.15.37:0/4293032385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf0410b030 0x7fbf041a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.547+0000 7fbf03e00640 1 -- 172.21.15.37:0/4293032385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf04104ca0 msgr2=0x7fbf0419b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:39.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.547+0000 7fbf03e00640 1 --2- 172.21.15.37:0/4293032385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf04104ca0 0x7fbf0419b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.547+0000 7fbf03e00640 1 -- 172.21.15.37:0/4293032385 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf041a1240 con 0x7fbf0410a6b0 2024-08-20T05:02:39.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.547+0000 7fbf09000640 1 --2- 172.21.15.37:0/4293032385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf04104ca0 0x7fbf0419b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.548+0000 7fbf03e00640 1 --2- 172.21.15.37:0/4293032385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf0410a6b0 0x7fbf0419b6d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbef0035040 tx=0x7fbef0032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.548+0000 7fbf01600640 1 -- 172.21.15.37:0/4293032385 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0037040 con 0x7fbf0410a6b0 2024-08-20T05:02:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.548+0000 7fbf0ba00640 1 -- 172.21.15.37:0/4293032385 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf041a14d0 con 0x7fbf0410a6b0 2024-08-20T05:02:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.548+0000 7fbf01600640 1 -- 172.21.15.37:0/4293032385 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbef0041070 con 0x7fbf0410a6b0 2024-08-20T05:02:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.548+0000 7fbf01600640 1 -- 172.21.15.37:0/4293032385 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0003850 con 0x7fbf0410a6b0 2024-08-20T05:02:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.548+0000 7fbf0ba00640 1 -- 172.21.15.37:0/4293032385 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf041a7bf0 con 0x7fbf0410a6b0 2024-08-20T05:02:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.552+0000 7fbf01600640 1 -- 172.21.15.37:0/4293032385 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbef00039f0 con 0x7fbf0410a6b0 2024-08-20T05:02:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.552+0000 7fbf0e64b740 1 Processor -- start 2024-08-20T05:02:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.552+0000 7fbf0e64b740 1 -- start start 2024-08-20T05:02:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.552+0000 7fbf0e64b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096cf10 0x563b2096d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.552+0000 7fbf0e64b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b2096d830 0x563b20979280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.552+0000 7fbf0e64b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b209797c0 0x563b2097bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.552+0000 7fbf0e64b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563b208e3840 con 0x563b2096d830 2024-08-20T05:02:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.552+0000 7fbf0e64b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563b208d2d40 con 0x563b209797c0 2024-08-20T05:02:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.552+0000 7fbf0e64b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563b208d6d80 con 0x563b2096cf10 2024-08-20T05:02:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.553+0000 7fbf09a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096cf10 0x563b2096d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.553+0000 7fbf03e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b209797c0 0x563b2097bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.553+0000 7fbf09a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096cf10 0x563b2096d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50918/0 (socket says 172.21.15.37:50918) 2024-08-20T05:02:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.553+0000 7fbf09a00640 1 -- 172.21.15.37:0/1723656580 learned_addr learned my addr 172.21.15.37:0/1723656580 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.553+0000 7fbf09000640 1 --2- 172.21.15.37:0/1723656580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b2096d830 0x563b20979280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.553+0000 7fbf03e00640 1 -- 172.21.15.37:0/1723656580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096cf10 msgr2=0x563b2096d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.553+0000 7fbf03e00640 1 --2- 172.21.15.37:0/1723656580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096cf10 0x563b2096d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.553+0000 7fbf03e00640 1 -- 172.21.15.37:0/1723656580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b2096d830 msgr2=0x563b20979280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.553+0000 7fbf03e00640 1 --2- 172.21.15.37:0/1723656580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b2096d830 0x563b20979280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.553+0000 7fbf03e00640 1 -- 172.21.15.37:0/1723656580 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b208791c0 con 0x563b209797c0 2024-08-20T05:02:39.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.553+0000 7fbf09a00640 1 --2- 172.21.15.37:0/1723656580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096cf10 0x563b2096d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:39.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.554+0000 7fbf03e00640 1 --2- 172.21.15.37:0/1723656580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b209797c0 0x563b2097bbb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbef01011a0 tx=0x7fbef0107b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aba2883048aeab1e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:39.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.554+0000 7fbf01600640 1 --2- 172.21.15.37:0/4293032385 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbeec0b3bd0 0x7fbeec0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.554+0000 7fbef6000640 1 -- 172.21.15.37:0/1723656580 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef00c6510 con 0x563b209797c0 2024-08-20T05:02:39.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.554+0000 7fbf09a00640 1 --2- 172.21.15.37:0/4293032385 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbeec0b3bd0 0x7fbeec0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.554+0000 7fbf01600640 1 -- 172.21.15.37:0/4293032385 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbef0103b00 con 0x7fbf0410a6b0 2024-08-20T05:02:39.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.554+0000 7fbef6000640 1 -- 172.21.15.37:0/1723656580 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbef010d040 con 0x563b209797c0 2024-08-20T05:02:39.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.554+0000 7fbef6000640 1 -- 172.21.15.37:0/1723656580 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef00c9dc0 con 0x563b209797c0 2024-08-20T05:02:39.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.555+0000 7fbf0e64b740 1 -- 172.21.15.37:0/1723656580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b209797c0 msgr2=0x563b2097bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:39.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.555+0000 7fbf09a00640 1 --2- 172.21.15.37:0/4293032385 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbeec0b3bd0 0x7fbeec0b6090 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbefc011890 tx=0x7fbefc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:39.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.555+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/1723656580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b209797c0 0x563b2097bbb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbef01011a0 tx=0x7fbef0107b30 comp rx=0 tx=0).stop 2024-08-20T05:02:39.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.555+0000 7fbf0e64b740 1 -- 172.21.15.37:0/1723656580 shutdown_connections 2024-08-20T05:02:39.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.555+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/1723656580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b209797c0 0x563b2097bbb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.555+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/1723656580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b2096d830 0x563b20979280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.555+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/1723656580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096cf10 0x563b2096d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.555+0000 7fbf0e64b740 1 -- 172.21.15.37:0/1723656580 >> 172.21.15.37:0/1723656580 conn(0x563b2096ad40 msgr2=0x563b2096bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:39.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.555+0000 7fbf0e64b740 1 -- 172.21.15.37:0/1723656580 shutdown_connections 2024-08-20T05:02:39.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.555+0000 7fbf0e64b740 1 -- 172.21.15.37:0/1723656580 wait complete. 2024-08-20T05:02:39.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.556+0000 7fbf0e64b740 1 -- start start 2024-08-20T05:02:39.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.556+0000 7fbf0e64b740 1 Processor -- start 2024-08-20T05:02:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.556+0000 7fbf0e64b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b2096cf10 0x563b20978f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.556+0000 7fbf0e64b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096d830 0x563b209763a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.556+0000 7fbf0e64b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b209797c0 0x563b209768e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.557+0000 7fbf0e64b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563b207355f0 con 0x563b209797c0 2024-08-20T05:02:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.557+0000 7fbf0e64b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563b2086e170 con 0x563b2096cf10 2024-08-20T05:02:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.557+0000 7fbf0e64b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563b2097c230 con 0x563b2096d830 2024-08-20T05:02:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.557+0000 7fbf0e64b740 10 client.0 _ll_register_callbacks cb 0x563b208cd8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.557+0000 7fbf03e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096d830 0x563b209763a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.557+0000 7fbf09000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b2096cf10 0x563b20978f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.557+0000 7fbf03e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096d830 0x563b209763a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50930/0 (socket says 172.21.15.37:50930) 2024-08-20T05:02:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.557+0000 7fbf03e00640 1 -- 172.21.15.37:0/380757924 learned_addr learned my addr 172.21.15.37:0/380757924 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.557+0000 7fbf09a00640 1 --2- 172.21.15.37:0/380757924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b209797c0 0x563b209768e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.557+0000 7fbf03e00640 1 -- 172.21.15.37:0/380757924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b2096cf10 msgr2=0x563b20978f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.557+0000 7fbf03e00640 1 --2- 172.21.15.37:0/380757924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b2096cf10 0x563b20978f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.557+0000 7fbf03e00640 1 -- 172.21.15.37:0/380757924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b209797c0 msgr2=0x563b209768e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.557+0000 7fbf03e00640 1 --2- 172.21.15.37:0/380757924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b209797c0 0x563b209768e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.557+0000 7fbf03e00640 1 -- 172.21.15.37:0/380757924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b20632540 con 0x563b2096d830 2024-08-20T05:02:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.557+0000 7fbf03e00640 1 --2- 172.21.15.37:0/380757924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096d830 0x563b209763a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbef01011d0 tx=0x7fbef0030630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45c36f64ac7feeb5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.557+0000 7fbeeaa00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:02:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.558+0000 7fbeeaa00640 1 -- 172.21.15.37:0/380757924 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef00c9fa0 con 0x563b2096d830 2024-08-20T05:02:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.558+0000 7fbf0e64b740 1 -- 172.21.15.37:0/380757924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbef010d040 con 0x563b2096d830 2024-08-20T05:02:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.558+0000 7fbeeaa00640 1 -- 172.21.15.37:0/380757924 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbef00c68e0 con 0x563b2096d830 2024-08-20T05:02:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.558+0000 7fbeeaa00640 1 -- 172.21.15.37:0/380757924 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbef00ca420 con 0x563b2096d830 2024-08-20T05:02:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.558+0000 7fbf0e64b740 10 client.25552 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:39.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.558+0000 7fbf0e64b740 1 -- 172.21.15.37:0/380757924 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563b20987940 con 0x563b2096d830 2024-08-20T05:02:39.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.558+0000 7fbeeaa00640 1 -- 172.21.15.37:0/380757924 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbef010d040 con 0x563b2096d830 2024-08-20T05:02:39.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.558+0000 7fbeeaa00640 1 -- 172.21.15.37:0/380757924 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbef00ca8b0 con 0x563b2096d830 2024-08-20T05:02:39.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.558+0000 7fbf0e64b740 10 client.25552 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:39.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.559+0000 7fbf0e64b740 10 client.25552 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-20T05:02:39.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.559+0000 7fbf0e64b740 20 client.25552 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:39.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.559+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/380757924 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x563b20989c30 0x563b2098b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.559+0000 7fbf0e64b740 4 client.25552 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:02:39.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.559+0000 7fbf0e64b740 1 -- 172.21.15.37:0/380757924 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b208e5790 con 0x563b20989c30 2024-08-20T05:02:39.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.559+0000 7fbf09000640 1 --2- 172.21.15.37:0/380757924 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x563b20989c30 0x563b2098b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.559+0000 7fbf09000640 1 --2- 172.21.15.37:0/380757924 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x563b20989c30 0x563b2098b0a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c79bd67e71d4683 server_cookie=93b785b21c791e84 in_seq=0 out_seq=0 2024-08-20T05:02:39.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.559+0000 7fbeeaa00640 10 client.25552 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:02:39.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.560+0000 7fbeeaa00640 1 -- 172.21.15.37:0/380757924 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563b208e5790 con 0x563b20989c30 2024-08-20T05:02:39.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.560+0000 7fbeeaa00640 10 client.25552 handle_command_reply: tid=0 2024-08-20T05:02:39.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.560+0000 7fbf0e64b740 1 client.25552 shutdown 2024-08-20T05:02:39.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.561+0000 7fbf0e64b740 1 -- 172.21.15.37:0/380757924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096d830 msgr2=0x563b209763a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:39.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.561+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/380757924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096d830 0x563b209763a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbef01011d0 tx=0x7fbef0030630 comp rx=0 tx=0).stop 2024-08-20T05:02:39.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.561+0000 7fbf0e64b740 1 -- 172.21.15.37:0/380757924 shutdown_connections 2024-08-20T05:02:39.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.561+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/380757924 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x563b20989c30 0x563b2098b0a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.561+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/380757924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b209797c0 0x563b209768e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.561+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/380757924 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096d830 0x563b209763a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.561+0000 7fbeeaa00640 0 client.25552 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:02:39.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.561+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/380757924 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b2096cf10 0x563b20978f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.561+0000 7fbf0e64b740 1 -- 172.21.15.37:0/380757924 >> 172.21.15.37:0/380757924 conn(0x563b2096ad40 msgr2=0x563b209708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:39.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.561+0000 7fbf0e64b740 1 -- 172.21.15.37:0/380757924 shutdown_connections 2024-08-20T05:02:39.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.561+0000 7fbf0e64b740 1 -- 172.21.15.37:0/380757924 wait complete. 2024-08-20T05:02:39.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.561+0000 7fbf0e64b740 20 client.25552 trim_cache size 0 max 16384 2024-08-20T05:02:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.580+0000 7fbf0e64b740 1 Processor -- start 2024-08-20T05:02:39.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.580+0000 7fbf0e64b740 1 -- start start 2024-08-20T05:02:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.580+0000 7fbf0e64b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096cf10 0x563b20965ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.580+0000 7fbf0e64b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b2096d830 0x563b20969cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.580+0000 7fbf0e64b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b209797c0 0x563b20993380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.580+0000 7fbf0e64b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563b209893e0 con 0x563b2096d830 2024-08-20T05:02:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.580+0000 7fbf0e64b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563b20989ab0 con 0x563b209797c0 2024-08-20T05:02:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.580+0000 7fbf0e64b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563b2098a180 con 0x563b2096cf10 2024-08-20T05:02:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.581+0000 7fbf09a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b209797c0 0x563b20993380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.581+0000 7fbf03e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b2096d830 0x563b20969cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.581+0000 7fbf09a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b209797c0 0x563b20993380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56720/0 (socket says 172.21.15.37:56720) 2024-08-20T05:02:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.581+0000 7fbf09a00640 1 -- 172.21.15.37:0/186244077 learned_addr learned my addr 172.21.15.37:0/186244077 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.581+0000 7fbf09000640 1 --2- 172.21.15.37:0/186244077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096cf10 0x563b20965ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.581+0000 7fbf09a00640 1 -- 172.21.15.37:0/186244077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096cf10 msgr2=0x563b20965ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.581+0000 7fbf09a00640 1 --2- 172.21.15.37:0/186244077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096cf10 0x563b20965ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.581+0000 7fbf09a00640 1 -- 172.21.15.37:0/186244077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b2096d830 msgr2=0x563b20969cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.581+0000 7fbf09a00640 1 --2- 172.21.15.37:0/186244077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b2096d830 0x563b20969cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.581+0000 7fbf09a00640 1 -- 172.21.15.37:0/186244077 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b20966370 con 0x563b209797c0 2024-08-20T05:02:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.581+0000 7fbf03e00640 1 --2- 172.21.15.37:0/186244077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b2096d830 0x563b20969cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:39.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.582+0000 7fbf09a00640 1 --2- 172.21.15.37:0/186244077 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b209797c0 0x563b20993380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00fa70 tx=0x7fbefc016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98fd67dc656843b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:39.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.585+0000 7fbef5600640 1 -- 172.21.15.37:0/186244077 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc004b20 con 0x563b209797c0 2024-08-20T05:02:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.585+0000 7fbef5600640 1 -- 172.21.15.37:0/186244077 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbefc004cc0 con 0x563b209797c0 2024-08-20T05:02:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.585+0000 7fbef5600640 1 -- 172.21.15.37:0/186244077 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbefc0051a0 con 0x563b209797c0 2024-08-20T05:02:39.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.586+0000 7fbf0e64b740 1 -- 172.21.15.37:0/186244077 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b209797c0 msgr2=0x563b20993380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.586+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/186244077 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b209797c0 0x563b20993380 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00fa70 tx=0x7fbefc016000 comp rx=0 tx=0).stop 2024-08-20T05:02:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.586+0000 7fbf0e64b740 1 -- 172.21.15.37:0/186244077 shutdown_connections 2024-08-20T05:02:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.586+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/186244077 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b209797c0 0x563b20993380 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.586+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/186244077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b2096d830 0x563b20969cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.586+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/186244077 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b2096cf10 0x563b20965ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.586+0000 7fbf0e64b740 1 -- 172.21.15.37:0/186244077 >> 172.21.15.37:0/186244077 conn(0x563b2096ad40 msgr2=0x563b209695e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.586+0000 7fbf0e64b740 1 -- 172.21.15.37:0/186244077 shutdown_connections 2024-08-20T05:02:39.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.586+0000 7fbf0e64b740 1 -- 172.21.15.37:0/186244077 wait complete. 2024-08-20T05:02:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.586+0000 7fbf0e64b740 1 -- start start 2024-08-20T05:02:39.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.587+0000 7fbf0e64b740 1 Processor -- start 2024-08-20T05:02:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.587+0000 7fbf0e64b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b2096cf10 0x563b20993b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.587+0000 7fbf0e64b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b2096d830 0x563b2098d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.587+0000 7fbf0e64b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b209797c0 0x563b2098d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.587+0000 7fbf0e64b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563b2098af20 con 0x563b2096cf10 2024-08-20T05:02:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.587+0000 7fbf0e64b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563b2098a850 con 0x563b2096d830 2024-08-20T05:02:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.587+0000 7fbf0e64b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563b2098b5f0 con 0x563b209797c0 2024-08-20T05:02:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.587+0000 7fbf0e64b740 10 client.0 _ll_register_callbacks cb 0x7fbef0105f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.588+0000 7fbf03e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b2096d830 0x563b2098d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.588+0000 7fbf03e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b2096d830 0x563b2098d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56726/0 (socket says 172.21.15.37:56726) 2024-08-20T05:02:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.588+0000 7fbf03e00640 1 -- 172.21.15.37:0/17295146 learned_addr learned my addr 172.21.15.37:0/17295146 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.588+0000 7fbf09a00640 1 --2- 172.21.15.37:0/17295146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b209797c0 0x563b2098d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.588+0000 7fbf09000640 1 --2- 172.21.15.37:0/17295146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b2096cf10 0x563b20993b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.588+0000 7fbf03e00640 1 -- 172.21.15.37:0/17295146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b209797c0 msgr2=0x563b2098d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.588+0000 7fbf03e00640 1 --2- 172.21.15.37:0/17295146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b209797c0 0x563b2098d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.588+0000 7fbf03e00640 1 -- 172.21.15.37:0/17295146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b2096cf10 msgr2=0x563b20993b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.588+0000 7fbf03e00640 1 --2- 172.21.15.37:0/17295146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b2096cf10 0x563b20993b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.588+0000 7fbf03e00640 1 -- 172.21.15.37:0/17295146 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b209927d0 con 0x563b2096d830 2024-08-20T05:02:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.588+0000 7fbf09a00640 1 --2- 172.21.15.37:0/17295146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b209797c0 0x563b2098d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.588+0000 7fbf03e00640 1 --2- 172.21.15.37:0/17295146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b2096d830 0x563b2098d040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbef0101200 tx=0x7fbef0009490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=804952f01aa51882 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.588+0000 7fbeeaa00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:02:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.589+0000 7fbeeaa00640 1 -- 172.21.15.37:0/17295146 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef00c9fa0 con 0x563b2096d830 2024-08-20T05:02:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.589+0000 7fbeeaa00640 1 -- 172.21.15.37:0/17295146 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbef00c68e0 con 0x563b2096d830 2024-08-20T05:02:39.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.589+0000 7fbf0e64b740 1 -- 172.21.15.37:0/17295146 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbefc004cc0 con 0x563b2096d830 2024-08-20T05:02:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.589+0000 7fbeeaa00640 1 -- 172.21.15.37:0/17295146 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbef00c9dc0 con 0x563b2096d830 2024-08-20T05:02:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.589+0000 7fbf0e64b740 10 client.25550 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.589+0000 7fbf0e64b740 1 -- 172.21.15.37:0/17295146 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x563b209927d0 con 0x563b2096d830 2024-08-20T05:02:39.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.589+0000 7fbeeaa00640 1 -- 172.21.15.37:0/17295146 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbef00e3020 con 0x563b2096d830 2024-08-20T05:02:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.589+0000 7fbeeaa00640 1 -- 172.21.15.37:0/17295146 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbef00d3270 con 0x563b2096d830 2024-08-20T05:02:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.590+0000 7fbf0e64b740 10 client.25550 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.590+0000 7fbf0e64b740 10 client.25550 resolve_mds: resolved name 'f' to daemon mds.f 2024-08-20T05:02:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.590+0000 7fbf0e64b740 20 client.25550 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.590+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/17295146 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x563b209f8cc0 0x563b209f79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.590+0000 7fbf0e64b740 4 client.25550 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T05:02:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.590+0000 7fbf0e64b740 1 -- 172.21.15.37:0/17295146 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "status"}) -- 0x563b208e1230 con 0x563b209f8cc0 2024-08-20T05:02:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.590+0000 7fbf09000640 1 --2- 172.21.15.37:0/17295146 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x563b209f8cc0 0x563b209f79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.591+0000 7fbf09000640 1 --2- 172.21.15.37:0/17295146 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x563b209f8cc0 0x563b209f79d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bd02505451c944fe server_cookie=58c264f9a1de7fe9 in_seq=0 out_seq=0 2024-08-20T05:02:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.591+0000 7fbeeaa00640 10 client.25550 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:02:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.591+0000 7fbeeaa00640 1 -- 172.21.15.37:0/17295146 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563b208e1230 con 0x563b209f8cc0 2024-08-20T05:02:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.591+0000 7fbeeaa00640 10 client.25550 handle_command_reply: tid=0 2024-08-20T05:02:39.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.591+0000 7fbf0e64b740 1 client.25550 shutdown 2024-08-20T05:02:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.591+0000 7fbf0e64b740 1 -- 172.21.15.37:0/17295146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b2096d830 msgr2=0x563b2098d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.591+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/17295146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b2096d830 0x563b2098d040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbef0101200 tx=0x7fbef0009490 comp rx=0 tx=0).stop 2024-08-20T05:02:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.592+0000 7fbf0e64b740 1 -- 172.21.15.37:0/17295146 shutdown_connections 2024-08-20T05:02:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.592+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/17295146 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x563b209f8cc0 0x563b209f79d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.592+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/17295146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563b209797c0 0x563b2098d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.592+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/17295146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563b2096d830 0x563b2098d040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.592+0000 7fbf0e64b740 1 --2- 172.21.15.37:0/17295146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b2096cf10 0x563b20993b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.592+0000 7fbeeaa00640 0 client.25550 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:02:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.592+0000 7fbf0e64b740 1 -- 172.21.15.37:0/17295146 >> 172.21.15.37:0/17295146 conn(0x563b2096ad40 msgr2=0x563b20969e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.592+0000 7fbf0e64b740 1 -- 172.21.15.37:0/17295146 shutdown_connections 2024-08-20T05:02:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.592+0000 7fbf0e64b740 1 -- 172.21.15.37:0/17295146 wait complete. 2024-08-20T05:02:39.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.592+0000 7fbf0e64b740 20 client.25550 trim_cache size 0 max 16384 2024-08-20T05:02:39.597 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:02:39.597 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T05:02:39.597 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 4, 2024-08-20T05:02:39.597 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24637, 2024-08-20T05:02:39.597 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-20T05:02:39.597 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-20T05:02:39.597 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-20T05:02:39.597 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 154.450563155, 2024-08-20T05:02:39.597 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 29, 2024-08-20T05:02:39.597 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 88, 2024-08-20T05:02:39.597 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 88, 2024-08-20T05:02:39.597 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 238.33321161699999 2024-08-20T05:02:39.598 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:02:39.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.593+0000 7fbf0ba00640 1 -- 172.21.15.37:0/4293032385 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbeec0b3bd0 msgr2=0x7fbeec0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:39.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.593+0000 7fbf0ba00640 1 --2- 172.21.15.37:0/4293032385 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbeec0b3bd0 0x7fbeec0b6090 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbefc011890 tx=0x7fbefc009500 comp rx=0 tx=0).stop 2024-08-20T05:02:39.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.593+0000 7fbf0ba00640 1 -- 172.21.15.37:0/4293032385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf0410a6b0 msgr2=0x7fbf0419b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:39.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.593+0000 7fbf0ba00640 1 --2- 172.21.15.37:0/4293032385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf0410a6b0 0x7fbf0419b6d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbef0035040 tx=0x7fbef0032d50 comp rx=0 tx=0).stop 2024-08-20T05:02:39.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.593+0000 7fbf0ba00640 1 -- 172.21.15.37:0/4293032385 shutdown_connections 2024-08-20T05:02:39.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.593+0000 7fbf0ba00640 1 --2- 172.21.15.37:0/4293032385 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbeec0b3bd0 0x7fbeec0b6090 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.593+0000 7fbf0ba00640 1 --2- 172.21.15.37:0/4293032385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf0410b030 0x7fbf041a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.593+0000 7fbf0ba00640 1 --2- 172.21.15.37:0/4293032385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf0410a6b0 0x7fbf0419b6d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.593+0000 7fbf0ba00640 1 --2- 172.21.15.37:0/4293032385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf04104ca0 0x7fbf0419b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:39.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.593+0000 7fbf0ba00640 1 -- 172.21.15.37:0/4293032385 >> 172.21.15.37:0/4293032385 conn(0x7fbf04100730 msgr2=0x7fbf04102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:39.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.593+0000 7fbf0ba00640 1 -- 172.21.15.37:0/4293032385 shutdown_connections 2024-08-20T05:02:39.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:39.593+0000 7fbf0ba00640 1 -- 172.21.15.37:0/4293032385 wait complete. 2024-08-20T05:02:39.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:39 smithi037 ceph-mon[17265]: pgmap v413: 129 pgs: 129 active+clean; 654 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-08-20T05:02:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:39 smithi135 ceph-mon[22342]: pgmap v413: 129 pgs: 129 active+clean; 654 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-08-20T05:02:39.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:39 smithi130 ceph-mon[22007]: pgmap v413: 129 pgs: 129 active+clean; 654 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.7 KiB/s wr, 13 op/s 2024-08-20T05:02:40.450 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.c status 2024-08-20T05:02:40.846 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:41.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.438+0000 7f0f24a00640 1 -- 172.21.15.37:0/4078144844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f2010b030 msgr2=0x7f0f20111830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:41.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.438+0000 7f0f24a00640 1 --2- 172.21.15.37:0/4078144844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f2010b030 0x7f0f20111830 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0f18009ca0 tx=0x7f0f1802a8c0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.439+0000 7f0f24a00640 1 -- 172.21.15.37:0/4078144844 shutdown_connections 2024-08-20T05:02:41.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.439+0000 7f0f24a00640 1 --2- 172.21.15.37:0/4078144844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f2010b030 0x7f0f20111830 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.439+0000 7f0f24a00640 1 --2- 172.21.15.37:0/4078144844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f2010a6b0 0x7f0f2010aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.439+0000 7f0f24a00640 1 --2- 172.21.15.37:0/4078144844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f20104ca0 0x7f0f20105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.439+0000 7f0f24a00640 1 -- 172.21.15.37:0/4078144844 >> 172.21.15.37:0/4078144844 conn(0x7f0f20100730 msgr2=0x7f0f20102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:41.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.439+0000 7f0f24a00640 1 -- 172.21.15.37:0/4078144844 shutdown_connections 2024-08-20T05:02:41.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.439+0000 7f0f24a00640 1 -- 172.21.15.37:0/4078144844 wait complete. 2024-08-20T05:02:41.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.440+0000 7f0f24a00640 1 Processor -- start 2024-08-20T05:02:41.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.440+0000 7f0f24a00640 1 -- start start 2024-08-20T05:02:41.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.440+0000 7f0f24a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f20104ca0 0x7f0f2019b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.440+0000 7f0f24a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f2010a6b0 0x7f0f2019b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.440+0000 7f0f24a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f2010b030 0x7f0f201a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.440+0000 7f0f24a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0f20114d00 con 0x7f0f2010b030 2024-08-20T05:02:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.440+0000 7f0f24a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0f20114b80 con 0x7f0f20104ca0 2024-08-20T05:02:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.440+0000 7f0f24a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f20114e80 con 0x7f0f2010a6b0 2024-08-20T05:02:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.441+0000 7f0f1d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f2010a6b0 0x7f0f2019b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.441+0000 7f0f1de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f20104ca0 0x7f0f2019b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.441+0000 7f0f1e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f2010b030 0x7f0f201a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.441+0000 7f0f1de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f20104ca0 0x7f0f2019b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56744/0 (socket says 172.21.15.37:56744) 2024-08-20T05:02:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.441+0000 7f0f1d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f2010a6b0 0x7f0f2019b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50972/0 (socket says 172.21.15.37:50972) 2024-08-20T05:02:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.441+0000 7f0f1de00640 1 -- 172.21.15.37:0/1554247912 learned_addr learned my addr 172.21.15.37:0/1554247912 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.441+0000 7f0f1d400640 1 -- 172.21.15.37:0/1554247912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f20104ca0 msgr2=0x7f0f2019b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.441+0000 7f0f1d400640 1 --2- 172.21.15.37:0/1554247912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f20104ca0 0x7f0f2019b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.441+0000 7f0f1d400640 1 -- 172.21.15.37:0/1554247912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f2010b030 msgr2=0x7f0f201a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:41.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.441+0000 7f0f1d400640 1 --2- 172.21.15.37:0/1554247912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f2010b030 0x7f0f201a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.441+0000 7f0f1d400640 1 -- 172.21.15.37:0/1554247912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f201a1260 con 0x7f0f2010a6b0 2024-08-20T05:02:41.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.441+0000 7f0f1de00640 1 --2- 172.21.15.37:0/1554247912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f20104ca0 0x7f0f2019b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:41.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.441+0000 7f0f1d400640 1 --2- 172.21.15.37:0/1554247912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f2010a6b0 0x7f0f2019b6f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c005fd0 tx=0x7f0f0c00dde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:41.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.442+0000 7f0f16a00640 1 -- 172.21.15.37:0/1554247912 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c009c30 con 0x7f0f2010a6b0 2024-08-20T05:02:41.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.442+0000 7f0f24a00640 1 -- 172.21.15.37:0/1554247912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f201a1550 con 0x7f0f2010a6b0 2024-08-20T05:02:41.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.442+0000 7f0f16a00640 1 -- 172.21.15.37:0/1554247912 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f0c009dd0 con 0x7f0f2010a6b0 2024-08-20T05:02:41.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.442+0000 7f0f16a00640 1 -- 172.21.15.37:0/1554247912 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c003e20 con 0x7f0f2010a6b0 2024-08-20T05:02:41.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.442+0000 7f0f24a00640 1 -- 172.21.15.37:0/1554247912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f201a7de0 con 0x7f0f2010a6b0 2024-08-20T05:02:41.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.445+0000 7f0f274a5740 1 Processor -- start 2024-08-20T05:02:41.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.445+0000 7f0f274a5740 1 -- start start 2024-08-20T05:02:41.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.445+0000 7f0f274a5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e96611f10 0x559e966122f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.445+0000 7f0f274a5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96612830 0x559e9661e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.445+0000 7f0f274a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9661e7c0 0x559e96620bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.445+0000 7f0f274a5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559e96588840 con 0x559e96611f10 2024-08-20T05:02:41.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.445+0000 7f0f274a5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559e96577d40 con 0x559e96612830 2024-08-20T05:02:41.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.445+0000 7f0f274a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559e9657bd80 con 0x559e9661e7c0 2024-08-20T05:02:41.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.446+0000 7f0f1e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e96611f10 0x559e966122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:41.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.446+0000 7f0f1de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96612830 0x559e9661e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:41.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.446+0000 7f0f1de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96612830 0x559e9661e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56754/0 (socket says 172.21.15.37:56754) 2024-08-20T05:02:41.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.446+0000 7f0f1de00640 1 -- 172.21.15.37:0/556352698 learned_addr learned my addr 172.21.15.37:0/556352698 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:41.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.446+0000 7f0f16a00640 1 -- 172.21.15.37:0/1554247912 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0f0c003fe0 con 0x7f0f2010a6b0 2024-08-20T05:02:41.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.446+0000 7f0f1e800640 1 -- 172.21.15.37:0/556352698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9661e7c0 msgr2=0x559e96620bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:02:41.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.446+0000 7f0f1e800640 1 --2- 172.21.15.37:0/556352698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9661e7c0 0x559e96620bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.446+0000 7f0f1e800640 1 -- 172.21.15.37:0/556352698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96612830 msgr2=0x559e9661e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:41.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.446+0000 7f0f1e800640 1 --2- 172.21.15.37:0/556352698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96612830 0x559e9661e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.446+0000 7f0f1e800640 1 -- 172.21.15.37:0/556352698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e9651e1c0 con 0x559e96611f10 2024-08-20T05:02:41.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.446+0000 7f0f1de00640 1 --2- 172.21.15.37:0/556352698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96612830 0x559e9661e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:41.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.447+0000 7f0f1e800640 1 --2- 172.21.15.37:0/556352698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e96611f10 0x559e966122f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0f1802ade0 tx=0x7f0f1802f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92942c63318ddf83 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:41.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.447+0000 7f0f0b000640 1 -- 172.21.15.37:0/556352698 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18031db0 con 0x559e96611f10 2024-08-20T05:02:41.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.447+0000 7f0f0b000640 1 -- 172.21.15.37:0/556352698 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f18036070 con 0x559e96611f10 2024-08-20T05:02:41.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.447+0000 7f0f0b000640 1 -- 172.21.15.37:0/556352698 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18004240 con 0x559e96611f10 2024-08-20T05:02:41.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.447+0000 7f0f274a5740 1 -- 172.21.15.37:0/556352698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e96611f10 msgr2=0x559e966122f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:41.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.447+0000 7f0f274a5740 1 --2- 172.21.15.37:0/556352698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e96611f10 0x559e966122f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0f1802ade0 tx=0x7f0f1802f3c0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.448+0000 7f0f274a5740 1 -- 172.21.15.37:0/556352698 shutdown_connections 2024-08-20T05:02:41.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.448+0000 7f0f274a5740 1 --2- 172.21.15.37:0/556352698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9661e7c0 0x559e96620bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.448+0000 7f0f274a5740 1 --2- 172.21.15.37:0/556352698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96612830 0x559e9661e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.448+0000 7f0f274a5740 1 --2- 172.21.15.37:0/556352698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e96611f10 0x559e966122f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.448+0000 7f0f274a5740 1 -- 172.21.15.37:0/556352698 >> 172.21.15.37:0/556352698 conn(0x559e9660fd40 msgr2=0x559e96610ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:41.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.448+0000 7f0f274a5740 1 -- 172.21.15.37:0/556352698 shutdown_connections 2024-08-20T05:02:41.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.448+0000 7f0f274a5740 1 -- 172.21.15.37:0/556352698 wait complete. 2024-08-20T05:02:41.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.448+0000 7f0f16a00640 1 --2- 172.21.15.37:0/1554247912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0f040b3b60 0x7f0f040b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.448+0000 7f0f16a00640 1 -- 172.21.15.37:0/1554247912 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0f0c0e39f0 con 0x7f0f2010a6b0 2024-08-20T05:02:41.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.448+0000 7f0f1de00640 1 --2- 172.21.15.37:0/1554247912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0f040b3b60 0x7f0f040b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:41.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.448+0000 7f0f274a5740 1 -- start start 2024-08-20T05:02:41.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.449+0000 7f0f274a5740 1 Processor -- start 2024-08-20T05:02:41.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.449+0000 7f0f1de00640 1 --2- 172.21.15.37:0/1554247912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0f040b3b60 0x7f0f040b6020 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0f100096e0 tx=0x7f0f10005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:41.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.449+0000 7f0f274a5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96611f10 0x559e9661e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.449+0000 7f0f274a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e96612830 0x559e9661b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.449+0000 7f0f274a5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e9661e7c0 0x559e9661ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.449+0000 7f0f274a5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559e963da5f0 con 0x559e9661e7c0 2024-08-20T05:02:41.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.449+0000 7f0f274a5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559e96513170 con 0x559e96611f10 2024-08-20T05:02:41.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.449+0000 7f0f274a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559e96621290 con 0x559e96612830 2024-08-20T05:02:41.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.449+0000 7f0f274a5740 10 client.0 _ll_register_callbacks cb 0x559e965728b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:41.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.450+0000 7f0f1e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e9661e7c0 0x559e9661ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:41.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.450+0000 7f0f1de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96611f10 0x559e9661e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:41.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.450+0000 7f0f1de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96611f10 0x559e9661e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56758/0 (socket says 172.21.15.37:56758) 2024-08-20T05:02:41.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.450+0000 7f0f1de00640 1 -- 172.21.15.37:0/1773645664 learned_addr learned my addr 172.21.15.37:0/1773645664 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:41.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.450+0000 7f0f1d400640 1 --2- 172.21.15.37:0/1773645664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e96612830 0x559e9661b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:41.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.450+0000 7f0f1de00640 1 -- 172.21.15.37:0/1773645664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e96612830 msgr2=0x559e9661b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:41.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.450+0000 7f0f1de00640 1 --2- 172.21.15.37:0/1773645664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e96612830 0x559e9661b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.450+0000 7f0f1de00640 1 -- 172.21.15.37:0/1773645664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e9661e7c0 msgr2=0x559e9661ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.450+0000 7f0f1de00640 1 --2- 172.21.15.37:0/1773645664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e9661e7c0 0x559e9661ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.450+0000 7f0f1de00640 1 -- 172.21.15.37:0/1773645664 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e962d7540 con 0x559e96611f10 2024-08-20T05:02:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.450+0000 7f0f1e800640 1 --2- 172.21.15.37:0/1773645664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e9661e7c0 0x559e9661ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.450+0000 7f0f1de00640 1 --2- 172.21.15.37:0/1773645664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96611f10 0x559e9661e040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000f7a0 tx=0x7f0f10004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93b9b4fe3b4ef024 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.450+0000 7f0eff400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:02:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.451+0000 7f0eff400640 1 -- 172.21.15.37:0/1773645664 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f10004020 con 0x559e96611f10 2024-08-20T05:02:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.451+0000 7f0f274a5740 1 -- 172.21.15.37:0/1773645664 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f18036070 con 0x559e96611f10 2024-08-20T05:02:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.451+0000 7f0eff400640 1 -- 172.21.15.37:0/1773645664 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0f100041c0 con 0x559e96611f10 2024-08-20T05:02:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.451+0000 7f0eff400640 1 -- 172.21.15.37:0/1773645664 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0f100043c0 con 0x559e96611f10 2024-08-20T05:02:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.451+0000 7f0f274a5740 10 client.25562 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.451+0000 7f0f274a5740 1 -- 172.21.15.37:0/1773645664 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559e96635420 con 0x559e96611f10 2024-08-20T05:02:41.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.451+0000 7f0eff400640 1 -- 172.21.15.37:0/1773645664 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f18036070 con 0x559e96611f10 2024-08-20T05:02:41.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.451+0000 7f0eff400640 1 -- 172.21.15.37:0/1773645664 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0f10027070 con 0x559e96611f10 2024-08-20T05:02:41.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.451+0000 7f0f274a5740 10 client.25562 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:41.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.451+0000 7f0f274a5740 10 client.25562 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-20T05:02:41.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.452+0000 7f0f274a5740 20 client.25562 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:41.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.452+0000 7f0f274a5740 1 --2- 172.21.15.37:0/1773645664 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x559e96637a30 0x559e96638ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.452+0000 7f0f274a5740 4 client.25562 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:02:41.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.452+0000 7f0f274a5740 1 -- 172.21.15.37:0/1773645664 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e9658a790 con 0x559e96637a30 2024-08-20T05:02:41.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.452+0000 7f0f1d400640 1 --2- 172.21.15.37:0/1773645664 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x559e96637a30 0x559e96638ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:41.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.452+0000 7f0eff400640 10 client.25562 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:02:41.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.452+0000 7f0f1d400640 1 --2- 172.21.15.37:0/1773645664 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x559e96637a30 0x559e96638ea0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9bee1413671a33a0 server_cookie=e033fbdae8eb54c5 in_seq=0 out_seq=0 2024-08-20T05:02:41.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.453+0000 7f0eff400640 1 -- 172.21.15.37:0/1773645664 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559e9658a790 con 0x559e96637a30 2024-08-20T05:02:41.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.453+0000 7f0eff400640 10 client.25562 handle_command_reply: tid=0 2024-08-20T05:02:41.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.453+0000 7f0f274a5740 1 client.25562 shutdown 2024-08-20T05:02:41.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.453+0000 7f0f274a5740 1 -- 172.21.15.37:0/1773645664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96611f10 msgr2=0x559e9661e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:41.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.453+0000 7f0f274a5740 1 --2- 172.21.15.37:0/1773645664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96611f10 0x559e9661e040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000f7a0 tx=0x7f0f10004730 comp rx=0 tx=0).stop 2024-08-20T05:02:41.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.453+0000 7f0f274a5740 1 -- 172.21.15.37:0/1773645664 shutdown_connections 2024-08-20T05:02:41.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.453+0000 7f0f274a5740 1 --2- 172.21.15.37:0/1773645664 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x559e96637a30 0x559e96638ea0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.453+0000 7f0f274a5740 1 --2- 172.21.15.37:0/1773645664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e9661e7c0 0x559e9661ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.453+0000 7f0f274a5740 1 --2- 172.21.15.37:0/1773645664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e96612830 0x559e9661b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.453+0000 7f0f274a5740 1 --2- 172.21.15.37:0/1773645664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96611f10 0x559e9661e040 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.453+0000 7f0eff400640 0 client.25562 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:02:41.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.453+0000 7f0f274a5740 1 -- 172.21.15.37:0/1773645664 >> 172.21.15.37:0/1773645664 conn(0x559e9660fd40 msgr2=0x559e966158e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:41.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.454+0000 7f0f274a5740 1 -- 172.21.15.37:0/1773645664 shutdown_connections 2024-08-20T05:02:41.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.454+0000 7f0f274a5740 1 -- 172.21.15.37:0/1773645664 wait complete. 2024-08-20T05:02:41.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.454+0000 7f0f274a5740 20 client.25562 trim_cache size 0 max 16384 2024-08-20T05:02:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.473+0000 7f0f274a5740 1 Processor -- start 2024-08-20T05:02:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.473+0000 7f0f274a5740 1 -- start start 2024-08-20T05:02:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.473+0000 7f0f274a5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e96611f10 0x559e966114a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.474+0000 7f0f274a5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96612830 0x559e9661a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.474+0000 7f0f274a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9661e7c0 0x559e9661b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.474+0000 7f0f274a5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559e966371e0 con 0x559e96611f10 2024-08-20T05:02:41.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.474+0000 7f0f274a5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559e966378b0 con 0x559e96612830 2024-08-20T05:02:41.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.474+0000 7f0f274a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559e96637f80 con 0x559e9661e7c0 2024-08-20T05:02:41.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.474+0000 7f0f1d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96612830 0x559e9661a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:41.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.474+0000 7f0f1e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9661e7c0 0x559e9661b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:41.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.474+0000 7f0f1e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9661e7c0 0x559e9661b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50988/0 (socket says 172.21.15.37:50988) 2024-08-20T05:02:41.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.474+0000 7f0f1e800640 1 -- 172.21.15.37:0/203764218 learned_addr learned my addr 172.21.15.37:0/203764218 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:41.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.475+0000 7f0f1e800640 1 -- 172.21.15.37:0/203764218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96612830 msgr2=0x559e9661a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:41.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.475+0000 7f0f1e800640 1 --2- 172.21.15.37:0/203764218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96612830 0x559e9661a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.475+0000 7f0f1e800640 1 -- 172.21.15.37:0/203764218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e96611f10 msgr2=0x559e966114a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:41.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.475+0000 7f0f1de00640 1 --2- 172.21.15.37:0/203764218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e96611f10 0x559e966114a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:41.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.476+0000 7f0f1e800640 1 --2- 172.21.15.37:0/203764218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e96611f10 0x559e966114a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.476+0000 7f0f1e800640 1 -- 172.21.15.37:0/203764218 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e966107c0 con 0x559e9661e7c0 2024-08-20T05:02:41.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.476+0000 7f0f1d400640 1 --2- 172.21.15.37:0/203764218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96612830 0x559e9661a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:02:41.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.476+0000 7f0f1de00640 1 --2- 172.21.15.37:0/203764218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e96611f10 0x559e966114a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:02:41.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.477+0000 7f0f1e800640 1 --2- 172.21.15.37:0/203764218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9661e7c0 0x559e9661b240 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0f1802aeb0 tx=0x7f0f18005df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8cbf98debad2b81 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:41.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.477+0000 7f0f0a600640 1 -- 172.21.15.37:0/203764218 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f18003b70 con 0x559e9661e7c0 2024-08-20T05:02:41.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.477+0000 7f0f0a600640 1 -- 172.21.15.37:0/203764218 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f18054070 con 0x559e9661e7c0 2024-08-20T05:02:41.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.477+0000 7f0f0a600640 1 -- 172.21.15.37:0/203764218 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f1802fd10 con 0x559e9661e7c0 2024-08-20T05:02:41.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.478+0000 7f0f274a5740 1 -- 172.21.15.37:0/203764218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9661e7c0 msgr2=0x559e9661b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:41.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.478+0000 7f0f274a5740 1 --2- 172.21.15.37:0/203764218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9661e7c0 0x559e9661b240 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0f1802aeb0 tx=0x7f0f18005df0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.478+0000 7f0f274a5740 1 -- 172.21.15.37:0/203764218 shutdown_connections 2024-08-20T05:02:41.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.478+0000 7f0f274a5740 1 --2- 172.21.15.37:0/203764218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e9661e7c0 0x559e9661b240 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.478+0000 7f0f274a5740 1 --2- 172.21.15.37:0/203764218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e96612830 0x559e9661a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.478+0000 7f0f274a5740 1 --2- 172.21.15.37:0/203764218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e96611f10 0x559e966114a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.478+0000 7f0f274a5740 1 -- 172.21.15.37:0/203764218 >> 172.21.15.37:0/203764218 conn(0x559e9660fd40 msgr2=0x559e96610d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:41.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.478+0000 7f0f274a5740 1 -- 172.21.15.37:0/203764218 shutdown_connections 2024-08-20T05:02:41.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.478+0000 7f0f274a5740 1 -- 172.21.15.37:0/203764218 wait complete. 2024-08-20T05:02:41.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.478+0000 7f0f274a5740 1 -- start start 2024-08-20T05:02:41.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.479+0000 7f0f274a5740 1 Processor -- start 2024-08-20T05:02:41.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.479+0000 7f0f274a5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e96611f10 0x559e96617880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.479+0000 7f0f274a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e96612830 0x559e96617dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.479+0000 7f0f274a5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e9661e7c0 0x559e96618300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.479+0000 7f0f274a5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559e96638d20 con 0x559e96611f10 2024-08-20T05:02:41.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.479+0000 7f0f274a5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559e96638650 con 0x559e9661e7c0 2024-08-20T05:02:41.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.479+0000 7f0f274a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559e966393f0 con 0x559e96612830 2024-08-20T05:02:41.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.479+0000 7f0f274a5740 10 client.0 _ll_register_callbacks cb 0x7f0f10005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:41.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.479+0000 7f0f1e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e9661e7c0 0x559e96618300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:41.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.479+0000 7f0f1d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e96612830 0x559e96617dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:41.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.479+0000 7f0f1e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e9661e7c0 0x559e96618300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56786/0 (socket says 172.21.15.37:56786) 2024-08-20T05:02:41.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.479+0000 7f0f1e800640 1 -- 172.21.15.37:0/2180199454 learned_addr learned my addr 172.21.15.37:0/2180199454 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:41.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.480+0000 7f0f1de00640 1 --2- 172.21.15.37:0/2180199454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e96611f10 0x559e96617880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:41.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.480+0000 7f0f1d400640 1 -- 172.21.15.37:0/2180199454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e9661e7c0 msgr2=0x559e96618300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:41.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.480+0000 7f0f1d400640 1 --2- 172.21.15.37:0/2180199454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e9661e7c0 0x559e96618300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.480+0000 7f0f1d400640 1 -- 172.21.15.37:0/2180199454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e96611f10 msgr2=0x559e96617880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.480+0000 7f0f1d400640 1 --2- 172.21.15.37:0/2180199454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e96611f10 0x559e96617880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.480+0000 7f0f1d400640 1 -- 172.21.15.37:0/2180199454 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e966402a0 con 0x559e96612830 2024-08-20T05:02:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.480+0000 7f0f1e800640 1 --2- 172.21.15.37:0/2180199454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e9661e7c0 0x559e96618300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.480+0000 7f0f1d400640 1 --2- 172.21.15.37:0/2180199454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e96612830 0x559e96617dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x559e96611ec0 tx=0x7f0f0c004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edc9b603f4766f34 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.480+0000 7f0eff400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:02:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.480+0000 7f0eff400640 1 -- 172.21.15.37:0/2180199454 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0c014030 con 0x559e96612830 2024-08-20T05:02:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.480+0000 7f0eff400640 1 -- 172.21.15.37:0/2180199454 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0f0c0a6be0 con 0x559e96612830 2024-08-20T05:02:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.480+0000 7f0f274a5740 1 -- 172.21.15.37:0/2180199454 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f18054070 con 0x559e96612830 2024-08-20T05:02:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.481+0000 7f0eff400640 1 -- 172.21.15.37:0/2180199454 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0f0c020040 con 0x559e96612830 2024-08-20T05:02:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.481+0000 7f0f274a5740 10 client.25573 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.481+0000 7f0f274a5740 1 -- 172.21.15.37:0/2180199454 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x559e96641510 con 0x559e96612830 2024-08-20T05:02:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.481+0000 7f0eff400640 1 -- 172.21.15.37:0/2180199454 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f18054070 con 0x559e96612830 2024-08-20T05:02:41.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.481+0000 7f0eff400640 1 -- 172.21.15.37:0/2180199454 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f0f0c0a6880 con 0x559e96612830 2024-08-20T05:02:41.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.481+0000 7f0f274a5740 10 client.25573 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:41.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.481+0000 7f0f274a5740 10 client.25573 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-20T05:02:41.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.481+0000 7f0f274a5740 20 client.25573 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:41.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.481+0000 7f0f274a5740 1 --2- 172.21.15.37:0/2180199454 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x559e966a61a0 0x559e966a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:41.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.481+0000 7f0f274a5740 4 client.25573 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T05:02:41.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.481+0000 7f0f274a5740 1 -- 172.21.15.37:0/2180199454 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "status"}) -- 0x559e96586230 con 0x559e966a61a0 2024-08-20T05:02:41.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.482+0000 7f0f1de00640 1 --2- 172.21.15.37:0/2180199454 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x559e966a61a0 0x559e966a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:41.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.482+0000 7f0f1de00640 1 --2- 172.21.15.37:0/2180199454 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x559e966a61a0 0x559e966a4eb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=239da65af7b34f23 server_cookie=2fd3b6dc29c623f3 in_seq=0 out_seq=0 2024-08-20T05:02:41.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.482+0000 7f0eff400640 10 client.25573 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:02:41.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.482+0000 7f0eff400640 1 -- 172.21.15.37:0/2180199454 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x559e96586230 con 0x559e966a61a0 2024-08-20T05:02:41.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.482+0000 7f0eff400640 10 client.25573 handle_command_reply: tid=0 2024-08-20T05:02:41.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.482+0000 7f0f274a5740 1 client.25573 shutdown 2024-08-20T05:02:41.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.483+0000 7f0f274a5740 1 -- 172.21.15.37:0/2180199454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e96612830 msgr2=0x559e96617dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:41.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.483+0000 7f0f274a5740 1 --2- 172.21.15.37:0/2180199454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e96612830 0x559e96617dc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x559e96611ec0 tx=0x7f0f0c004570 comp rx=0 tx=0).stop 2024-08-20T05:02:41.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.483+0000 7f0f274a5740 1 -- 172.21.15.37:0/2180199454 shutdown_connections 2024-08-20T05:02:41.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.483+0000 7f0f274a5740 1 --2- 172.21.15.37:0/2180199454 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x559e966a61a0 0x559e966a4eb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.483+0000 7f0f274a5740 1 --2- 172.21.15.37:0/2180199454 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e9661e7c0 0x559e96618300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.483+0000 7f0f274a5740 1 --2- 172.21.15.37:0/2180199454 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e96612830 0x559e96617dc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.483+0000 7f0f274a5740 1 --2- 172.21.15.37:0/2180199454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e96611f10 0x559e96617880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.483+0000 7f0eff400640 0 client.25573 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:02:41.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.483+0000 7f0f274a5740 1 -- 172.21.15.37:0/2180199454 >> 172.21.15.37:0/2180199454 conn(0x559e9660fd40 msgr2=0x559e9661b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:41.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.483+0000 7f0f274a5740 1 -- 172.21.15.37:0/2180199454 shutdown_connections 2024-08-20T05:02:41.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.483+0000 7f0f274a5740 1 -- 172.21.15.37:0/2180199454 wait complete. 2024-08-20T05:02:41.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.483+0000 7f0f274a5740 20 client.25573 trim_cache size 0 max 16384 2024-08-20T05:02:41.488 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:02:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T05:02:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 3, 2024-08-20T05:02:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24649, 2024-08-20T05:02:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-20T05:02:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-20T05:02:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-20T05:02:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 157.34852446900001, 2024-08-20T05:02:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 29, 2024-08-20T05:02:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 88, 2024-08-20T05:02:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 88, 2024-08-20T05:02:41.489 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 237.65535133399999 2024-08-20T05:02:41.489 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:02:41.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.484+0000 7f0f24a00640 1 -- 172.21.15.37:0/1554247912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0f040b3b60 msgr2=0x7f0f040b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:41.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.484+0000 7f0f24a00640 1 --2- 172.21.15.37:0/1554247912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0f040b3b60 0x7f0f040b6020 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0f100096e0 tx=0x7f0f10005f90 comp rx=0 tx=0).stop 2024-08-20T05:02:41.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.484+0000 7f0f24a00640 1 -- 172.21.15.37:0/1554247912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f2010a6b0 msgr2=0x7f0f2019b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:41.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.484+0000 7f0f24a00640 1 --2- 172.21.15.37:0/1554247912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f2010a6b0 0x7f0f2019b6f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c005fd0 tx=0x7f0f0c00dde0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.484+0000 7f0f24a00640 1 -- 172.21.15.37:0/1554247912 shutdown_connections 2024-08-20T05:02:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.484+0000 7f0f24a00640 1 --2- 172.21.15.37:0/1554247912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0f040b3b60 0x7f0f040b6020 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.484+0000 7f0f24a00640 1 --2- 172.21.15.37:0/1554247912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f2010b030 0x7f0f201a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.484+0000 7f0f24a00640 1 --2- 172.21.15.37:0/1554247912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f2010a6b0 0x7f0f2019b6f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.484+0000 7f0f24a00640 1 --2- 172.21.15.37:0/1554247912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f20104ca0 0x7f0f2019b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.484+0000 7f0f24a00640 1 -- 172.21.15.37:0/1554247912 >> 172.21.15.37:0/1554247912 conn(0x7f0f20100730 msgr2=0x7f0f20100f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.484+0000 7f0f24a00640 1 -- 172.21.15.37:0/1554247912 shutdown_connections 2024-08-20T05:02:41.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:41.484+0000 7f0f24a00640 1 -- 172.21.15.37:0/1554247912 wait complete. 2024-08-20T05:02:41.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:41 smithi135 ceph-mon[22342]: pgmap v414: 129 pgs: 129 active+clean; 664 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 16 op/s 2024-08-20T05:02:41.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:41 smithi130 ceph-mon[22007]: pgmap v414: 129 pgs: 129 active+clean; 664 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 16 op/s 2024-08-20T05:02:41.986 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:41 smithi037 ceph-mon[17265]: pgmap v414: 129 pgs: 129 active+clean; 664 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.8 KiB/s wr, 16 op/s 2024-08-20T05:02:42.489 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.h status 2024-08-20T05:02:42.874 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:43.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.484+0000 7f9b79e00640 1 -- 172.21.15.37:0/3611615372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b74113810 msgr2=0x7f9b74115c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:43.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.484+0000 7f9b79e00640 1 --2- 172.21.15.37:0/3611615372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b74113810 0x7f9b74115c00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c009ca0 tx=0x7f9b6c02a8c0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.484+0000 7f9b79e00640 1 -- 172.21.15.37:0/3611615372 shutdown_connections 2024-08-20T05:02:43.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.484+0000 7f9b79e00640 1 --2- 172.21.15.37:0/3611615372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b74113810 0x7f9b74115c00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.484+0000 7f9b79e00640 1 --2- 172.21.15.37:0/3611615372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b74075b90 0x7f9b741132d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.484+0000 7f9b79e00640 1 --2- 172.21.15.37:0/3611615372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b74075270 0x7f9b74075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.484+0000 7f9b79e00640 1 -- 172.21.15.37:0/3611615372 >> 172.21.15.37:0/3611615372 conn(0x7f9b740fe500 msgr2=0x7f9b74100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:43.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.484+0000 7f9b79e00640 1 -- 172.21.15.37:0/3611615372 shutdown_connections 2024-08-20T05:02:43.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.484+0000 7f9b79e00640 1 -- 172.21.15.37:0/3611615372 wait complete. 2024-08-20T05:02:43.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.485+0000 7f9b79e00640 1 Processor -- start 2024-08-20T05:02:43.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.485+0000 7f9b79e00640 1 -- start start 2024-08-20T05:02:43.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.486+0000 7f9b79e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b74075270 0x7f9b7419f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.486+0000 7f9b79e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b74075b90 0x7f9b7419fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.486+0000 7f9b79e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b74113810 0x7f9b741a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.486+0000 7f9b79e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9b741190d0 con 0x7f9b74113810 2024-08-20T05:02:43.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.486+0000 7f9b79e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9b74118f50 con 0x7f9b74075270 2024-08-20T05:02:43.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.486+0000 7f9b79e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9b74119250 con 0x7f9b74075b90 2024-08-20T05:02:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.486+0000 7f9b6a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b74075b90 0x7f9b7419fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.486+0000 7f9b73400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b74113810 0x7f9b741a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.486+0000 7f9b72a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b74075270 0x7f9b7419f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.486+0000 7f9b6a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b74075b90 0x7f9b7419fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42120/0 (socket says 172.21.15.37:42120) 2024-08-20T05:02:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.486+0000 7f9b6a000640 1 -- 172.21.15.37:0/1631555447 learned_addr learned my addr 172.21.15.37:0/1631555447 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.487+0000 7f9b72a00640 1 -- 172.21.15.37:0/1631555447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b74075b90 msgr2=0x7f9b7419fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.487+0000 7f9b72a00640 1 --2- 172.21.15.37:0/1631555447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b74075b90 0x7f9b7419fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.487+0000 7f9b72a00640 1 -- 172.21.15.37:0/1631555447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b74113810 msgr2=0x7f9b741a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.487+0000 7f9b72a00640 1 --2- 172.21.15.37:0/1631555447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b74113810 0x7f9b741a4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.487+0000 7f9b72a00640 1 -- 172.21.15.37:0/1631555447 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b741a5670 con 0x7f9b74075270 2024-08-20T05:02:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.487+0000 7f9b72a00640 1 --2- 172.21.15.37:0/1631555447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b74075270 0x7f9b7419f5c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400e9f0 tx=0x7f9b6400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.487+0000 7f9b78a00640 1 -- 172.21.15.37:0/1631555447 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6400ccc0 con 0x7f9b74075270 2024-08-20T05:02:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.487+0000 7f9b79e00640 1 -- 172.21.15.37:0/1631555447 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b741a5960 con 0x7f9b74075270 2024-08-20T05:02:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.487+0000 7f9b78a00640 1 -- 172.21.15.37:0/1631555447 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b640108e0 con 0x7f9b74075270 2024-08-20T05:02:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.487+0000 7f9b78a00640 1 -- 172.21.15.37:0/1631555447 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b64018880 con 0x7f9b74075270 2024-08-20T05:02:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.488+0000 7f9b79e00640 1 -- 172.21.15.37:0/1631555447 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b741ac1f0 con 0x7f9b74075270 2024-08-20T05:02:43.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.490+0000 7f9b7ca22740 1 Processor -- start 2024-08-20T05:02:43.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.491+0000 7f9b7ca22740 1 -- start start 2024-08-20T05:02:43.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.491+0000 7f9b7ca22740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b428f10 0x557e4b4292f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.491+0000 7f9b7ca22740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b429830 0x557e4b435280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.491+0000 7f9b7ca22740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b4357c0 0x557e4b437bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.491+0000 7f9b7ca22740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e4b39f840 con 0x557e4b428f10 2024-08-20T05:02:43.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.491+0000 7f9b7ca22740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557e4b38ed40 con 0x557e4b429830 2024-08-20T05:02:43.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.491+0000 7f9b7ca22740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557e4b392d80 con 0x557e4b4357c0 2024-08-20T05:02:43.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.491+0000 7f9b73400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b428f10 0x557e4b4292f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:43.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.491+0000 7f9b73400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b428f10 0x557e4b4292f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37010/0 (socket says 172.21.15.37:37010) 2024-08-20T05:02:43.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.491+0000 7f9b73400640 1 -- 172.21.15.37:0/125591792 learned_addr learned my addr 172.21.15.37:0/125591792 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:43.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.492+0000 7f9b78a00640 1 -- 172.21.15.37:0/1631555447 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9b64010430 con 0x7f9b74075270 2024-08-20T05:02:43.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.492+0000 7f9b6a000640 1 --2- 172.21.15.37:0/125591792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b4357c0 0x557e4b437bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:43.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.492+0000 7f9b73400640 1 -- 172.21.15.37:0/125591792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b4357c0 msgr2=0x557e4b437bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:43.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.492+0000 7f9b73400640 1 --2- 172.21.15.37:0/125591792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b4357c0 0x557e4b437bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.492+0000 7f9b73400640 1 -- 172.21.15.37:0/125591792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b429830 msgr2=0x557e4b435280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:02:43.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.492+0000 7f9b73400640 1 --2- 172.21.15.37:0/125591792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b429830 0x557e4b435280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.492+0000 7f9b73400640 1 -- 172.21.15.37:0/125591792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4b3351c0 con 0x557e4b428f10 2024-08-20T05:02:43.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.492+0000 7f9b6a000640 1 --2- 172.21.15.37:0/125591792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b4357c0 0x557e4b437bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:02:43.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.492+0000 7f9b73400640 1 --2- 172.21.15.37:0/125591792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b428f10 0x557e4b4292f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c035000 tx=0x7f9b6c005f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a97d32260f6413 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:43.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.492+0000 7f9b63e00640 1 -- 172.21.15.37:0/125591792 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c031cf0 con 0x557e4b428f10 2024-08-20T05:02:43.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.493+0000 7f9b63e00640 1 -- 172.21.15.37:0/125591792 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b6c036070 con 0x557e4b428f10 2024-08-20T05:02:43.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.493+0000 7f9b63e00640 1 -- 172.21.15.37:0/125591792 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c004280 con 0x557e4b428f10 2024-08-20T05:02:43.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.493+0000 7f9b7ca22740 1 -- 172.21.15.37:0/125591792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b428f10 msgr2=0x557e4b4292f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:43.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.493+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/125591792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b428f10 0x557e4b4292f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c035000 tx=0x7f9b6c005f80 comp rx=0 tx=0).stop 2024-08-20T05:02:43.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.493+0000 7f9b7ca22740 1 -- 172.21.15.37:0/125591792 shutdown_connections 2024-08-20T05:02:43.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.493+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/125591792 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b4357c0 0x557e4b437bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.493+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/125591792 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b429830 0x557e4b435280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.493+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/125591792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b428f10 0x557e4b4292f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.493+0000 7f9b7ca22740 1 -- 172.21.15.37:0/125591792 >> 172.21.15.37:0/125591792 conn(0x557e4b426d40 msgr2=0x557e4b427ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:43.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.493+0000 7f9b7ca22740 1 -- 172.21.15.37:0/125591792 shutdown_connections 2024-08-20T05:02:43.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.493+0000 7f9b7ca22740 1 -- 172.21.15.37:0/125591792 wait complete. 2024-08-20T05:02:43.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.494+0000 7f9b7ca22740 1 -- start start 2024-08-20T05:02:43.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.494+0000 7f9b78a00640 1 --2- 172.21.15.37:0/1631555447 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9b580b3ae0 0x7f9b580b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.494+0000 7f9b7ca22740 1 Processor -- start 2024-08-20T05:02:43.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.494+0000 7f9b78a00640 1 -- 172.21.15.37:0/1631555447 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9b640e4310 con 0x7f9b74075270 2024-08-20T05:02:43.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.494+0000 7f9b73400640 1 --2- 172.21.15.37:0/1631555447 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9b580b3ae0 0x7f9b580b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:43.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.495+0000 7f9b7ca22740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b428f10 0x557e4b435040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.495+0000 7f9b7ca22740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b429830 0x557e4b432490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.495+0000 7f9b7ca22740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b4357c0 0x557e4b432a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.495+0000 7f9b7ca22740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e4b1f15f0 con 0x557e4b4357c0 2024-08-20T05:02:43.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.495+0000 7f9b7ca22740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557e4b32a170 con 0x557e4b429830 2024-08-20T05:02:43.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.495+0000 7f9b7ca22740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557e4b438290 con 0x557e4b428f10 2024-08-20T05:02:43.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.495+0000 7f9b73400640 1 --2- 172.21.15.37:0/1631555447 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9b580b3ae0 0x7f9b580b5fa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c003ca0 tx=0x7f9b6c047040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:43.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.495+0000 7f9b7ca22740 10 client.0 _ll_register_callbacks cb 0x557e4b3898b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:43.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.495+0000 7f9b73400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b4357c0 0x557e4b432a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:43.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.495+0000 7f9b72a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b428f10 0x557e4b435040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:43.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.495+0000 7f9b72a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b428f10 0x557e4b435040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42132/0 (socket says 172.21.15.37:42132) 2024-08-20T05:02:43.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.495+0000 7f9b72a00640 1 -- 172.21.15.37:0/3610317271 learned_addr learned my addr 172.21.15.37:0/3610317271 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:43.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.495+0000 7f9b73400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b4357c0 0x557e4b432a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37022/0 (socket says 172.21.15.37:37022) 2024-08-20T05:02:43.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.495+0000 7f9b6a000640 1 --2- 172.21.15.37:0/3610317271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b429830 0x557e4b432490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:43.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.496+0000 7f9b72a00640 1 -- 172.21.15.37:0/3610317271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b429830 msgr2=0x557e4b432490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:43.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.496+0000 7f9b72a00640 1 --2- 172.21.15.37:0/3610317271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b429830 0x557e4b432490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.496+0000 7f9b72a00640 1 -- 172.21.15.37:0/3610317271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b4357c0 msgr2=0x557e4b432a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:43.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.496+0000 7f9b72a00640 1 --2- 172.21.15.37:0/3610317271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b4357c0 0x557e4b432a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.496+0000 7f9b72a00640 1 -- 172.21.15.37:0/3610317271 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e4b0ee540 con 0x557e4b428f10 2024-08-20T05:02:43.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.496+0000 7f9b72a00640 1 --2- 172.21.15.37:0/3610317271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b428f10 0x557e4b435040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9b640a81e0 tx=0x7f9b640107e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3d52cbe1187f52b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:43.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.496+0000 7f9b60c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:02:43.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.496+0000 7f9b60c00640 1 -- 172.21.15.37:0/3610317271 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b640e4150 con 0x557e4b428f10 2024-08-20T05:02:43.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.496+0000 7f9b7ca22740 1 -- 172.21.15.37:0/3610317271 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b6c036070 con 0x557e4b428f10 2024-08-20T05:02:43.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.496+0000 7f9b60c00640 1 -- 172.21.15.37:0/3610317271 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9b64010a90 con 0x557e4b428f10 2024-08-20T05:02:43.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.497+0000 7f9b60c00640 1 -- 172.21.15.37:0/3610317271 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9b640af4c0 con 0x557e4b428f10 2024-08-20T05:02:43.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.497+0000 7f9b7ca22740 10 client.25582 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:43.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.497+0000 7f9b7ca22740 1 -- 172.21.15.37:0/3610317271 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557e4b443b30 con 0x557e4b428f10 2024-08-20T05:02:43.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.497+0000 7f9b60c00640 1 -- 172.21.15.37:0/3610317271 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b6c036070 con 0x557e4b428f10 2024-08-20T05:02:43.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.497+0000 7f9b60c00640 1 -- 172.21.15.37:0/3610317271 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9b640af020 con 0x557e4b428f10 2024-08-20T05:02:43.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.497+0000 7f9b7ca22740 10 client.25582 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:43.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.497+0000 7f9b7ca22740 10 client.25582 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-20T05:02:43.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.497+0000 7f9b7ca22740 20 client.25582 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:43.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.497+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/3610317271 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x557e4b446080 0x557e4b4474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.497+0000 7f9b7ca22740 4 client.25582 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:02:43.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.497+0000 7f9b7ca22740 1 -- 172.21.15.37:0/3610317271 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e4b3a1790 con 0x557e4b446080 2024-08-20T05:02:43.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.498+0000 7f9b6a000640 1 --2- 172.21.15.37:0/3610317271 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x557e4b446080 0x557e4b4474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:43.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.498+0000 7f9b6a000640 1 --2- 172.21.15.37:0/3610317271 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x557e4b446080 0x557e4b4474f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8d2f572f894ede98 server_cookie=9a3fd96fc2bb9424 in_seq=0 out_seq=0 2024-08-20T05:02:43.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.498+0000 7f9b60c00640 10 client.25582 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:02:43.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.499+0000 7f9b60c00640 1 -- 172.21.15.37:0/3610317271 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557e4b3a1790 con 0x557e4b446080 2024-08-20T05:02:43.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.499+0000 7f9b60c00640 10 client.25582 handle_command_reply: tid=0 2024-08-20T05:02:43.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.499+0000 7f9b7ca22740 1 client.25582 shutdown 2024-08-20T05:02:43.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.499+0000 7f9b7ca22740 1 -- 172.21.15.37:0/3610317271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b428f10 msgr2=0x557e4b435040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:43.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.499+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/3610317271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b428f10 0x557e4b435040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9b640a81e0 tx=0x7f9b640107e0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.499+0000 7f9b7ca22740 1 -- 172.21.15.37:0/3610317271 shutdown_connections 2024-08-20T05:02:43.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.499+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/3610317271 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x557e4b446080 0x557e4b4474f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.499+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/3610317271 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b4357c0 0x557e4b432a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.499+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/3610317271 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b429830 0x557e4b432490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.499+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/3610317271 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b428f10 0x557e4b435040 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.499+0000 7f9b60c00640 0 client.25582 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:02:43.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.499+0000 7f9b7ca22740 1 -- 172.21.15.37:0/3610317271 >> 172.21.15.37:0/3610317271 conn(0x557e4b426d40 msgr2=0x557e4b42c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:43.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.499+0000 7f9b7ca22740 1 -- 172.21.15.37:0/3610317271 shutdown_connections 2024-08-20T05:02:43.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.499+0000 7f9b7ca22740 1 -- 172.21.15.37:0/3610317271 wait complete. 2024-08-20T05:02:43.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.499+0000 7f9b7ca22740 20 client.25582 trim_cache size 0 max 16384 2024-08-20T05:02:43.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.518+0000 7f9b7ca22740 1 Processor -- start 2024-08-20T05:02:43.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.518+0000 7f9b7ca22740 1 -- start start 2024-08-20T05:02:43.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.518+0000 7f9b7ca22740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b428f10 0x557e4b4474f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.519+0000 7f9b7ca22740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b429830 0x557e4b427d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.519+0000 7f9b7ca22740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b4357c0 0x557e4b4282d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.519+0000 7f9b7ca22740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e4b445830 con 0x557e4b428f10 2024-08-20T05:02:43.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.519+0000 7f9b7ca22740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557e4b445f00 con 0x557e4b4357c0 2024-08-20T05:02:43.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.519+0000 7f9b7ca22740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557e4b4465d0 con 0x557e4b429830 2024-08-20T05:02:43.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.519+0000 7f9b72a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b428f10 0x557e4b4474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:43.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.519+0000 7f9b72a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b428f10 0x557e4b4474f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37036/0 (socket says 172.21.15.37:37036) 2024-08-20T05:02:43.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.519+0000 7f9b72a00640 1 -- 172.21.15.37:0/1054437749 learned_addr learned my addr 172.21.15.37:0/1054437749 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:43.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.519+0000 7f9b6a000640 1 --2- 172.21.15.37:0/1054437749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b429830 0x557e4b427d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:43.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.519+0000 7f9b73400640 1 --2- 172.21.15.37:0/1054437749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b4357c0 0x557e4b4282d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:43.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.519+0000 7f9b72a00640 1 -- 172.21.15.37:0/1054437749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b429830 msgr2=0x557e4b427d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:43.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.519+0000 7f9b72a00640 1 --2- 172.21.15.37:0/1054437749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b429830 0x557e4b427d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.519+0000 7f9b72a00640 1 -- 172.21.15.37:0/1054437749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b4357c0 msgr2=0x557e4b4282d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:43.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.519+0000 7f9b72a00640 1 --2- 172.21.15.37:0/1054437749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b4357c0 0x557e4b4282d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.519+0000 7f9b72a00640 1 -- 172.21.15.37:0/1054437749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e4b4336d0 con 0x557e4b428f10 2024-08-20T05:02:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.520+0000 7f9b72a00640 1 --2- 172.21.15.37:0/1054437749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b428f10 0x557e4b4474f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9b640af680 tx=0x7f9b6400cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7825bf000c0617 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.520+0000 7f9b63400640 1 -- 172.21.15.37:0/1054437749 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b640aa8c0 con 0x557e4b428f10 2024-08-20T05:02:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.520+0000 7f9b63400640 1 -- 172.21.15.37:0/1054437749 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b640e4150 con 0x557e4b428f10 2024-08-20T05:02:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.520+0000 7f9b63400640 1 -- 172.21.15.37:0/1054437749 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b640a6e30 con 0x557e4b428f10 2024-08-20T05:02:43.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.520+0000 7f9b7ca22740 1 -- 172.21.15.37:0/1054437749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b428f10 msgr2=0x557e4b4474f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:43.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.520+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/1054437749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b428f10 0x557e4b4474f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9b640af680 tx=0x7f9b6400cef0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.521+0000 7f9b7ca22740 1 -- 172.21.15.37:0/1054437749 shutdown_connections 2024-08-20T05:02:43.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.521+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/1054437749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b4357c0 0x557e4b4282d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.521+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/1054437749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b429830 0x557e4b427d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.521+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/1054437749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b428f10 0x557e4b4474f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.521+0000 7f9b7ca22740 1 -- 172.21.15.37:0/1054437749 >> 172.21.15.37:0/1054437749 conn(0x557e4b426d40 msgr2=0x557e4b430d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:43.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.521+0000 7f9b7ca22740 1 -- 172.21.15.37:0/1054437749 shutdown_connections 2024-08-20T05:02:43.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.521+0000 7f9b7ca22740 1 -- 172.21.15.37:0/1054437749 wait complete. 2024-08-20T05:02:43.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.521+0000 7f9b7ca22740 1 -- start start 2024-08-20T05:02:43.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.521+0000 7f9b7ca22740 1 Processor -- start 2024-08-20T05:02:43.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.522+0000 7f9b7ca22740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b428f10 0x557e4b44b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.522+0000 7f9b7ca22740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b429830 0x557e4b44bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.522+0000 7f9b7ca22740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b4357c0 0x557e4b44c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.522+0000 7f9b7ca22740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e4b447370 con 0x557e4b429830 2024-08-20T05:02:43.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.522+0000 7f9b7ca22740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557e4b446ca0 con 0x557e4b4357c0 2024-08-20T05:02:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.522+0000 7f9b7ca22740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557e4b447a40 con 0x557e4b428f10 2024-08-20T05:02:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.522+0000 7f9b7ca22740 10 client.0 _ll_register_callbacks cb 0x7f9b6400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.522+0000 7f9b6a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b429830 0x557e4b44bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.522+0000 7f9b73400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b4357c0 0x557e4b44c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.522+0000 7f9b72a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b428f10 0x557e4b44b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.522+0000 7f9b73400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b4357c0 0x557e4b44c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33716/0 (socket says 172.21.15.37:33716) 2024-08-20T05:02:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.522+0000 7f9b73400640 1 -- 172.21.15.37:0/1098861712 learned_addr learned my addr 172.21.15.37:0/1098861712 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.523+0000 7f9b73400640 1 -- 172.21.15.37:0/1098861712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b428f10 msgr2=0x557e4b44b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.523+0000 7f9b73400640 1 --2- 172.21.15.37:0/1098861712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b428f10 0x557e4b44b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.523+0000 7f9b73400640 1 -- 172.21.15.37:0/1098861712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b429830 msgr2=0x557e4b44bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.523+0000 7f9b73400640 1 --2- 172.21.15.37:0/1098861712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b429830 0x557e4b44bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.523+0000 7f9b73400640 1 -- 172.21.15.37:0/1098861712 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e4b4af890 con 0x557e4b4357c0 2024-08-20T05:02:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.523+0000 7f9b73400640 1 --2- 172.21.15.37:0/1098861712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b4357c0 0x557e4b44c140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c003cd0 tx=0x7f9b6c003da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6a6d2c06a14d9d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.523+0000 7f9b60c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:02:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.523+0000 7f9b60c00640 1 -- 172.21.15.37:0/1098861712 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c05e060 con 0x557e4b4357c0 2024-08-20T05:02:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.523+0000 7f9b60c00640 1 -- 172.21.15.37:0/1098861712 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9b6c02f820 con 0x557e4b4357c0 2024-08-20T05:02:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.523+0000 7f9b7ca22740 1 -- 172.21.15.37:0/1098861712 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557e4b39d230 con 0x557e4b4357c0 2024-08-20T05:02:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.524+0000 7f9b60c00640 1 -- 172.21.15.37:0/1098861712 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9b6c031910 con 0x557e4b4357c0 2024-08-20T05:02:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.524+0000 7f9b7ca22740 10 client.25580 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.524+0000 7f9b7ca22740 1 -- 172.21.15.37:0/1098861712 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557e4b4b0b90 con 0x557e4b4357c0 2024-08-20T05:02:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.524+0000 7f9b60c00640 1 -- 172.21.15.37:0/1098861712 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557e4b39d230 con 0x557e4b4357c0 2024-08-20T05:02:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.524+0000 7f9b60c00640 1 -- 172.21.15.37:0/1098861712 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f9b6c04e070 con 0x557e4b4357c0 2024-08-20T05:02:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.524+0000 7f9b7ca22740 10 client.25580 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.524+0000 7f9b7ca22740 10 client.25580 resolve_mds: resolved name 'h' to daemon mds.h 2024-08-20T05:02:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.524+0000 7f9b7ca22740 20 client.25580 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.524+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/1098861712 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x557e4b4b5520 0x557e4b4b4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.524+0000 7f9b7ca22740 4 client.25580 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T05:02:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.524+0000 7f9b7ca22740 1 -- 172.21.15.37:0/1098861712 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "status"}) -- 0x557e4b39a970 con 0x557e4b4b5520 2024-08-20T05:02:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.525+0000 7f9b72a00640 1 --2- 172.21.15.37:0/1098861712 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x557e4b4b5520 0x557e4b4b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.525+0000 7f9b72a00640 1 --2- 172.21.15.37:0/1098861712 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x557e4b4b5520 0x557e4b4b4230 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=30f36cdd37134464 server_cookie=1c56a79288ccc691 in_seq=0 out_seq=0 2024-08-20T05:02:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.525+0000 7f9b60c00640 10 client.25580 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:02:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.525+0000 7f9b60c00640 1 -- 172.21.15.37:0/1098861712 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557e4b39a970 con 0x557e4b4b5520 2024-08-20T05:02:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.525+0000 7f9b60c00640 10 client.25580 handle_command_reply: tid=0 2024-08-20T05:02:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.525+0000 7f9b7ca22740 1 client.25580 shutdown 2024-08-20T05:02:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.525+0000 7f9b7ca22740 1 -- 172.21.15.37:0/1098861712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b4357c0 msgr2=0x557e4b44c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.525+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/1098861712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b4357c0 0x557e4b44c140 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c003cd0 tx=0x7f9b6c003da0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.526+0000 7f9b7ca22740 1 -- 172.21.15.37:0/1098861712 shutdown_connections 2024-08-20T05:02:43.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.526+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/1098861712 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x557e4b4b5520 0x557e4b4b4230 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.526+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/1098861712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e4b4357c0 0x557e4b44c140 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.526+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/1098861712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e4b429830 0x557e4b44bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.526+0000 7f9b7ca22740 1 --2- 172.21.15.37:0/1098861712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e4b428f10 0x557e4b44b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.526+0000 7f9b60c00640 0 client.25580 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:02:43.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.526+0000 7f9b7ca22740 1 -- 172.21.15.37:0/1098861712 >> 172.21.15.37:0/1098861712 conn(0x557e4b426d40 msgr2=0x557e4b427d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:43.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.526+0000 7f9b7ca22740 1 -- 172.21.15.37:0/1098861712 shutdown_connections 2024-08-20T05:02:43.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.526+0000 7f9b7ca22740 1 -- 172.21.15.37:0/1098861712 wait complete. 2024-08-20T05:02:43.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.526+0000 7f9b7ca22740 20 client.25580 trim_cache size 0 max 16384 2024-08-20T05:02:43.531 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:02:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T05:02:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 2, 2024-08-20T05:02:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24656, 2024-08-20T05:02:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-20T05:02:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-20T05:02:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-20T05:02:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 160.40437061599999, 2024-08-20T05:02:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 29, 2024-08-20T05:02:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 88, 2024-08-20T05:02:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 88, 2024-08-20T05:02:43.532 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 236.99473378299999 2024-08-20T05:02:43.532 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:02:43.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.526+0000 7f9b79e00640 1 -- 172.21.15.37:0/1631555447 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9b580b3ae0 msgr2=0x7f9b580b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:43.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.526+0000 7f9b79e00640 1 --2- 172.21.15.37:0/1631555447 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9b580b3ae0 0x7f9b580b5fa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c003ca0 tx=0x7f9b6c047040 comp rx=0 tx=0).stop 2024-08-20T05:02:43.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.526+0000 7f9b79e00640 1 -- 172.21.15.37:0/1631555447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b74075270 msgr2=0x7f9b7419f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:43.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.526+0000 7f9b79e00640 1 --2- 172.21.15.37:0/1631555447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b74075270 0x7f9b7419f5c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400e9f0 tx=0x7f9b6400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.527+0000 7f9b79e00640 1 -- 172.21.15.37:0/1631555447 shutdown_connections 2024-08-20T05:02:43.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.527+0000 7f9b79e00640 1 --2- 172.21.15.37:0/1631555447 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9b580b3ae0 0x7f9b580b5fa0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.527+0000 7f9b79e00640 1 --2- 172.21.15.37:0/1631555447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9b74113810 0x7f9b741a4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.527+0000 7f9b79e00640 1 --2- 172.21.15.37:0/1631555447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9b74075b90 0x7f9b7419fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.527+0000 7f9b79e00640 1 --2- 172.21.15.37:0/1631555447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9b74075270 0x7f9b7419f5c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:43.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.527+0000 7f9b79e00640 1 -- 172.21.15.37:0/1631555447 >> 172.21.15.37:0/1631555447 conn(0x7f9b740fe500 msgr2=0x7f9b740ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:43.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.527+0000 7f9b79e00640 1 -- 172.21.15.37:0/1631555447 shutdown_connections 2024-08-20T05:02:43.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:43.527+0000 7f9b79e00640 1 -- 172.21.15.37:0/1631555447 wait complete. 2024-08-20T05:02:43.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:43 smithi037 ceph-mon[17265]: pgmap v415: 129 pgs: 129 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 93 KiB/s wr, 16 op/s 2024-08-20T05:02:43.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:43 smithi135 ceph-mon[22342]: pgmap v415: 129 pgs: 129 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 93 KiB/s wr, 16 op/s 2024-08-20T05:02:43.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:43 smithi130 ceph-mon[22007]: pgmap v415: 129 pgs: 129 active+clean; 1.7 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 93 KiB/s wr, 16 op/s 2024-08-20T05:02:44.445 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.i status 2024-08-20T05:02:44.827 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:45.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.440+0000 7f4a65800640 1 -- 172.21.15.37:0/542086806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a6010a6b0 msgr2=0x7f4a6010aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.440+0000 7f4a65800640 1 --2- 172.21.15.37:0/542086806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a6010a6b0 0x7f4a6010aaf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009900 tx=0x7f4a4c02a410 comp rx=0 tx=0).stop 2024-08-20T05:02:45.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.440+0000 7f4a65800640 1 -- 172.21.15.37:0/542086806 shutdown_connections 2024-08-20T05:02:45.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.440+0000 7f4a65800640 1 --2- 172.21.15.37:0/542086806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a6010b030 0x7f4a60111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.440+0000 7f4a65800640 1 --2- 172.21.15.37:0/542086806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a6010a6b0 0x7f4a6010aaf0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.440+0000 7f4a65800640 1 --2- 172.21.15.37:0/542086806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a60104ca0 0x7f4a60105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.440+0000 7f4a65800640 1 -- 172.21.15.37:0/542086806 >> 172.21.15.37:0/542086806 conn(0x7f4a60100730 msgr2=0x7f4a60102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:45.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.440+0000 7f4a65800640 1 -- 172.21.15.37:0/542086806 shutdown_connections 2024-08-20T05:02:45.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.440+0000 7f4a65800640 1 -- 172.21.15.37:0/542086806 wait complete. 2024-08-20T05:02:45.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.441+0000 7f4a65800640 1 Processor -- start 2024-08-20T05:02:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.442+0000 7f4a65800640 1 -- start start 2024-08-20T05:02:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.442+0000 7f4a65800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a60104ca0 0x7f4a6019b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.442+0000 7f4a65800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a6010a6b0 0x7f4a6019b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.442+0000 7f4a65800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a6010b030 0x7f4a601a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.442+0000 7f4a65800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4a60114d40 con 0x7f4a60104ca0 2024-08-20T05:02:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.442+0000 7f4a65800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4a60114bc0 con 0x7f4a6010b030 2024-08-20T05:02:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.442+0000 7f4a65800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4a60114ec0 con 0x7f4a6010a6b0 2024-08-20T05:02:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.442+0000 7f4a5ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a60104ca0 0x7f4a6019b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.442+0000 7f4a5ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a60104ca0 0x7f4a6019b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37068/0 (socket says 172.21.15.37:37068) 2024-08-20T05:02:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.442+0000 7f4a5ea00640 1 -- 172.21.15.37:0/2419853214 learned_addr learned my addr 172.21.15.37:0/2419853214 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.442+0000 7f4a5e000640 1 --2- 172.21.15.37:0/2419853214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a6010a6b0 0x7f4a6019b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.442+0000 7f4a5f400640 1 --2- 172.21.15.37:0/2419853214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a6010b030 0x7f4a601a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.443+0000 7f4a5ea00640 1 -- 172.21.15.37:0/2419853214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a6010a6b0 msgr2=0x7f4a6019b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.443+0000 7f4a5ea00640 1 --2- 172.21.15.37:0/2419853214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a6010a6b0 0x7f4a6019b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.443+0000 7f4a5ea00640 1 -- 172.21.15.37:0/2419853214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a6010b030 msgr2=0x7f4a601a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.443+0000 7f4a5ea00640 1 --2- 172.21.15.37:0/2419853214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a6010b030 0x7f4a601a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.443+0000 7f4a5ea00640 1 -- 172.21.15.37:0/2419853214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a601a1220 con 0x7f4a60104ca0 2024-08-20T05:02:45.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.443+0000 7f4a5ea00640 1 --2- 172.21.15.37:0/2419853214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a60104ca0 0x7f4a6019b170 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000e9f0 tx=0x7f4a5000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.443+0000 7f4a57400640 1 -- 172.21.15.37:0/2419853214 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5000ccc0 con 0x7f4a60104ca0 2024-08-20T05:02:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.443+0000 7f4a57400640 1 -- 172.21.15.37:0/2419853214 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a500108e0 con 0x7f4a60104ca0 2024-08-20T05:02:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.443+0000 7f4a57400640 1 -- 172.21.15.37:0/2419853214 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a50018880 con 0x7f4a60104ca0 2024-08-20T05:02:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.443+0000 7f4a65800640 1 -- 172.21.15.37:0/2419853214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a601a1510 con 0x7f4a60104ca0 2024-08-20T05:02:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.444+0000 7f4a65800640 1 -- 172.21.15.37:0/2419853214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a601a7da0 con 0x7f4a60104ca0 2024-08-20T05:02:45.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.447+0000 7f4a683d0740 1 Processor -- start 2024-08-20T05:02:45.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.447+0000 7f4a683d0740 1 -- start start 2024-08-20T05:02:45.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.448+0000 7f4a57400640 1 -- 172.21.15.37:0/2419853214 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4a50010430 con 0x7f4a60104ca0 2024-08-20T05:02:45.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.448+0000 7f4a683d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957af10 0x56213957b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.448+0000 7f4a683d0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56213957b830 0x562139587280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.448+0000 7f4a683d0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621395877c0 0x562139589bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.448+0000 7f4a683d0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5621394f1840 con 0x5621395877c0 2024-08-20T05:02:45.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.448+0000 7f4a683d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5621394e0d40 con 0x56213957af10 2024-08-20T05:02:45.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.448+0000 7f4a683d0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5621394e4d80 con 0x56213957b830 2024-08-20T05:02:45.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.448+0000 7f4a5f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957af10 0x56213957b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.448+0000 7f4a5ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56213957b830 0x562139587280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.448+0000 7f4a5f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957af10 0x56213957b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33742/0 (socket says 172.21.15.37:33742) 2024-08-20T05:02:45.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.448+0000 7f4a5f400640 1 -- 172.21.15.37:0/2493514737 learned_addr learned my addr 172.21.15.37:0/2493514737 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:45.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.448+0000 7f4a5e000640 1 --2- 172.21.15.37:0/2493514737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621395877c0 0x562139589bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.449+0000 7f4a5f400640 1 -- 172.21.15.37:0/2493514737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56213957b830 msgr2=0x562139587280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:45.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.449+0000 7f4a5f400640 1 --2- 172.21.15.37:0/2493514737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56213957b830 0x562139587280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.449+0000 7f4a5f400640 1 -- 172.21.15.37:0/2493514737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621395877c0 msgr2=0x562139589bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:45.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.449+0000 7f4a5f400640 1 --2- 172.21.15.37:0/2493514737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621395877c0 0x562139589bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.449+0000 7f4a5f400640 1 -- 172.21.15.37:0/2493514737 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621394871c0 con 0x56213957af10 2024-08-20T05:02:45.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.449+0000 7f4a5e000640 1 --2- 172.21.15.37:0/2493514737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621395877c0 0x562139589bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:02:45.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.449+0000 7f4a5f400640 1 --2- 172.21.15.37:0/2493514737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957af10 0x56213957b2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a58011440 tx=0x7f4a58011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffce5fb70ca66a13 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:45.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.449+0000 7f4a4be00640 1 -- 172.21.15.37:0/2493514737 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a58003c30 con 0x56213957af10 2024-08-20T05:02:45.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.449+0000 7f4a4be00640 1 -- 172.21.15.37:0/2493514737 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a58003dd0 con 0x56213957af10 2024-08-20T05:02:45.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.449+0000 7f4a4be00640 1 -- 172.21.15.37:0/2493514737 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a5800fa10 con 0x56213957af10 2024-08-20T05:02:45.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.450+0000 7f4a57400640 1 --2- 172.21.15.37:0/2419853214 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a440b3c50 0x7f4a440b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.450+0000 7f4a57400640 1 -- 172.21.15.37:0/2419853214 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4a500e4320 con 0x7f4a60104ca0 2024-08-20T05:02:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.450+0000 7f4a5ea00640 1 --2- 172.21.15.37:0/2419853214 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a440b3c50 0x7f4a440b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.450+0000 7f4a683d0740 1 -- 172.21.15.37:0/2493514737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957af10 msgr2=0x56213957b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.450+0000 7f4a683d0740 1 --2- 172.21.15.37:0/2493514737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957af10 0x56213957b2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4a58011440 tx=0x7f4a58011900 comp rx=0 tx=0).stop 2024-08-20T05:02:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.451+0000 7f4a683d0740 1 -- 172.21.15.37:0/2493514737 shutdown_connections 2024-08-20T05:02:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.451+0000 7f4a683d0740 1 --2- 172.21.15.37:0/2493514737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5621395877c0 0x562139589bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.451+0000 7f4a683d0740 1 --2- 172.21.15.37:0/2493514737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56213957b830 0x562139587280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.451+0000 7f4a683d0740 1 --2- 172.21.15.37:0/2493514737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957af10 0x56213957b2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.451+0000 7f4a683d0740 1 -- 172.21.15.37:0/2493514737 >> 172.21.15.37:0/2493514737 conn(0x562139578d40 msgr2=0x562139579ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.451+0000 7f4a683d0740 1 -- 172.21.15.37:0/2493514737 shutdown_connections 2024-08-20T05:02:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.451+0000 7f4a683d0740 1 -- 172.21.15.37:0/2493514737 wait complete. 2024-08-20T05:02:45.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.451+0000 7f4a5ea00640 1 --2- 172.21.15.37:0/2419853214 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a440b3c50 0x7f4a440b6110 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4a500e1df0 tx=0x7f4a500e7e00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.451+0000 7f4a683d0740 1 -- start start 2024-08-20T05:02:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.452+0000 7f4a683d0740 1 Processor -- start 2024-08-20T05:02:45.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.452+0000 7f4a683d0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56213957af10 0x562139586fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.453+0000 7f4a683d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957b830 0x562139584430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.453+0000 7f4a683d0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621395877c0 0x562139584970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.453+0000 7f4a683d0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5621393435f0 con 0x56213957af10 2024-08-20T05:02:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.453+0000 7f4a683d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56213947c170 con 0x56213957b830 2024-08-20T05:02:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.453+0000 7f4a683d0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56213958a470 con 0x5621395877c0 2024-08-20T05:02:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.453+0000 7f4a683d0740 10 client.0 _ll_register_callbacks cb 0x5621394db8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.453+0000 7f4a5f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621395877c0 0x562139584970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.453+0000 7f4a5e000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957b830 0x562139584430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.453+0000 7f4a5f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56213957af10 0x562139586fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.453+0000 7f4a5e000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957b830 0x562139584430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33766/0 (socket says 172.21.15.37:33766) 2024-08-20T05:02:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.453+0000 7f4a5f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56213957af10 0x562139586fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37094/0 (socket says 172.21.15.37:37094) 2024-08-20T05:02:45.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.453+0000 7f4a5e000640 1 -- 172.21.15.37:0/2489499174 learned_addr learned my addr 172.21.15.37:0/2489499174 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:45.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.454+0000 7f4a5e000640 1 -- 172.21.15.37:0/2489499174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621395877c0 msgr2=0x562139584970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:45.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.454+0000 7f4a5e000640 1 --2- 172.21.15.37:0/2489499174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621395877c0 0x562139584970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.454+0000 7f4a5e000640 1 -- 172.21.15.37:0/2489499174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56213957af10 msgr2=0x562139586fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.454+0000 7f4a5e000640 1 --2- 172.21.15.37:0/2489499174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56213957af10 0x562139586fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.454+0000 7f4a5e000640 1 -- 172.21.15.37:0/2489499174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562139240540 con 0x56213957b830 2024-08-20T05:02:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.454+0000 7f4a5e000640 1 --2- 172.21.15.37:0/2489499174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957b830 0x562139584430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c000c00 tx=0x7f4a4c004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1581e43a2f564020 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.454+0000 7f4a48c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:02:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.454+0000 7f4a48c00640 1 -- 172.21.15.37:0/2489499174 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c035040 con 0x56213957b830 2024-08-20T05:02:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.454+0000 7f4a683d0740 1 -- 172.21.15.37:0/2489499174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a58003dd0 con 0x56213957b830 2024-08-20T05:02:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.454+0000 7f4a48c00640 1 -- 172.21.15.37:0/2489499174 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4a4c005450 con 0x56213957b830 2024-08-20T05:02:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.455+0000 7f4a48c00640 1 -- 172.21.15.37:0/2489499174 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4a4c005650 con 0x56213957b830 2024-08-20T05:02:45.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.455+0000 7f4a683d0740 10 client.25595 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.455+0000 7f4a683d0740 1 -- 172.21.15.37:0/2489499174 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562139595d30 con 0x56213957b830 2024-08-20T05:02:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.455+0000 7f4a48c00640 1 -- 172.21.15.37:0/2489499174 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a58003dd0 con 0x56213957b830 2024-08-20T05:02:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.455+0000 7f4a48c00640 1 -- 172.21.15.37:0/2489499174 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4a4c0039c0 con 0x56213957b830 2024-08-20T05:02:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.455+0000 7f4a683d0740 10 client.25595 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.455+0000 7f4a683d0740 10 client.25595 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-20T05:02:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.455+0000 7f4a683d0740 20 client.25595 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.455+0000 7f4a683d0740 1 --2- 172.21.15.37:0/2489499174 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5621395982e0 0x562139599750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.455+0000 7f4a683d0740 4 client.25595 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:02:45.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.455+0000 7f4a683d0740 1 -- 172.21.15.37:0/2489499174 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621394f3790 con 0x5621395982e0 2024-08-20T05:02:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.456+0000 7f2acca00640 1 -- 172.21.15.37:0/74676640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac8077750 msgr2=0x7f2ac8077b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.456+0000 7f2acca00640 1 --2- 172.21.15.37:0/74676640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac8077750 0x7f2ac8077b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009900 tx=0x7f2ab802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.456+0000 7f4a5f400640 1 --2- 172.21.15.37:0/2489499174 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5621395982e0 0x562139599750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.456+0000 7f2acca00640 1 -- 172.21.15.37:0/74676640 shutdown_connections 2024-08-20T05:02:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.456+0000 7f2acca00640 1 --2- 172.21.15.37:0/74676640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac8079260 0x7f2ac8079bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.456+0000 7f2acca00640 1 --2- 172.21.15.37:0/74676640 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ac80788a0 0x7f2ac8078d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.456+0000 7f2acca00640 1 --2- 172.21.15.37:0/74676640 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac8077750 0x7f2ac8077b50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.456+0000 7f2acca00640 1 -- 172.21.15.37:0/74676640 >> 172.21.15.37:0/74676640 conn(0x7f2ac80fff50 msgr2=0x7f2ac8102390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.456+0000 7f2acca00640 1 -- 172.21.15.37:0/74676640 shutdown_connections 2024-08-20T05:02:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.456+0000 7f2acca00640 1 -- 172.21.15.37:0/74676640 wait complete. 2024-08-20T05:02:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.456+0000 7f4a5f400640 1 --2- 172.21.15.37:0/2489499174 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5621395982e0 0x562139599750 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=34b9394b05dcaa0f server_cookie=2ca3a7aa261b263a in_seq=0 out_seq=0 2024-08-20T05:02:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.456+0000 7f4a48c00640 10 client.25595 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:02:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.457+0000 7f4a48c00640 1 -- 172.21.15.37:0/2489499174 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5621394f3790 con 0x5621395982e0 2024-08-20T05:02:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.457+0000 7f4a48c00640 10 client.25595 handle_command_reply: tid=0 2024-08-20T05:02:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.457+0000 7f4a683d0740 1 client.25595 shutdown 2024-08-20T05:02:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.457+0000 7f4a683d0740 1 -- 172.21.15.37:0/2489499174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957b830 msgr2=0x562139584430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.457+0000 7f4a683d0740 1 --2- 172.21.15.37:0/2489499174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957b830 0x562139584430 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c000c00 tx=0x7f4a4c004360 comp rx=0 tx=0).stop 2024-08-20T05:02:45.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.458+0000 7f2acca00640 1 Processor -- start 2024-08-20T05:02:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.457+0000 7f4a683d0740 1 -- 172.21.15.37:0/2489499174 shutdown_connections 2024-08-20T05:02:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.457+0000 7f4a683d0740 1 --2- 172.21.15.37:0/2489499174 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5621395982e0 0x562139599750 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.457+0000 7f4a683d0740 1 --2- 172.21.15.37:0/2489499174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621395877c0 0x562139584970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.458+0000 7f4a683d0740 1 --2- 172.21.15.37:0/2489499174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957b830 0x562139584430 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.458+0000 7f4a683d0740 1 --2- 172.21.15.37:0/2489499174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56213957af10 0x562139586fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.458+0000 7f4a683d0740 1 -- 172.21.15.37:0/2489499174 >> 172.21.15.37:0/2489499174 conn(0x562139578d40 msgr2=0x56213957e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.458+0000 7f4a48c00640 0 client.25595 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:02:45.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.458+0000 7f4a683d0740 1 -- 172.21.15.37:0/2489499174 shutdown_connections 2024-08-20T05:02:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.458+0000 7f2acca00640 1 -- start start 2024-08-20T05:02:45.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.458+0000 7f4a683d0740 1 -- 172.21.15.37:0/2489499174 wait complete. 2024-08-20T05:02:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.458+0000 7f2acca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ac8077750 0x7f2ac819ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.458+0000 7f2acca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac80788a0 0x7f2ac819f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.458+0000 7f2acca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac8079260 0x7f2ac81a0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.458+0000 7f2acca00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac81146f0 con 0x7f2ac80788a0 2024-08-20T05:02:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.458+0000 7f2acca00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac8114570 con 0x7f2ac8077750 2024-08-20T05:02:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.458+0000 7f2acca00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac8114870 con 0x7f2ac8079260 2024-08-20T05:02:45.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.458+0000 7f4a683d0740 20 client.25595 trim_cache size 0 max 16384 2024-08-20T05:02:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.458+0000 7f2ac6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac80788a0 0x7f2ac819f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.458+0000 7f2ac7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac8079260 0x7f2ac81a0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.459+0000 7f2ac7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac8079260 0x7f2ac81a0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42220/0 (socket says 172.21.15.37:42220) 2024-08-20T05:02:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.459+0000 7f2ac7e00640 1 -- 172.21.15.37:0/105587475 learned_addr learned my addr 172.21.15.37:0/105587475 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.459+0000 7f2ac7400640 1 --2- 172.21.15.37:0/105587475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ac8077750 0x7f2ac819ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.459+0000 7f2ac7e00640 1 -- 172.21.15.37:0/105587475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ac8077750 msgr2=0x7f2ac819ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.459+0000 7f2ac7e00640 1 --2- 172.21.15.37:0/105587475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ac8077750 0x7f2ac819ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.459+0000 7f2ac7e00640 1 -- 172.21.15.37:0/105587475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac80788a0 msgr2=0x7f2ac819f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.459+0000 7f2ac7e00640 1 --2- 172.21.15.37:0/105587475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac80788a0 0x7f2ac819f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.459+0000 7f2ac7e00640 1 -- 172.21.15.37:0/105587475 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac81a09d0 con 0x7f2ac8079260 2024-08-20T05:02:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.459+0000 7f2ac7400640 1 --2- 172.21.15.37:0/105587475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ac8077750 0x7f2ac819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:02:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.459+0000 7f2ac7e00640 1 --2- 172.21.15.37:0/105587475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac8079260 0x7f2ac81a0110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000eb10 tx=0x7f2ac000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.459+0000 7f2abfe00640 1 -- 172.21.15.37:0/105587475 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0004b20 con 0x7f2ac8079260 2024-08-20T05:02:45.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.460+0000 7f2abfe00640 1 -- 172.21.15.37:0/105587475 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ac0004cc0 con 0x7f2ac8079260 2024-08-20T05:02:45.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.460+0000 7f2acca00640 1 -- 172.21.15.37:0/105587475 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac81a0cc0 con 0x7f2ac8079260 2024-08-20T05:02:45.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.460+0000 7f2abfe00640 1 -- 172.21.15.37:0/105587475 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0010720 con 0x7f2ac8079260 2024-08-20T05:02:45.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.460+0000 7f2acca00640 1 -- 172.21.15.37:0/105587475 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac81a7390 con 0x7f2ac8079260 2024-08-20T05:02:45.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.463+0000 7f2ad0fbd740 1 Processor -- start 2024-08-20T05:02:45.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.464+0000 7f2abfe00640 1 -- 172.21.15.37:0/105587475 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2ac0005020 con 0x7f2ac8079260 2024-08-20T05:02:45.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.464+0000 7f2ad0fbd740 1 -- start start 2024-08-20T05:02:45.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.464+0000 7f2ad0fbd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4eabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.464+0000 7f2ad0fbd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4eb120 0x55ec2e4ed510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.464+0000 7f2ad0fbd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4edb60 0x55ec2e4f0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.464+0000 7f2ad0fbd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ec2e45b210 con 0x55ec2e4e87f0 2024-08-20T05:02:45.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.464+0000 7f2ad0fbd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ec2e44a710 con 0x55ec2e4edb60 2024-08-20T05:02:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.464+0000 7f2ad0fbd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ec2e44e750 con 0x55ec2e4eb120 2024-08-20T05:02:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.464+0000 7f2ac7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4eb120 0x55ec2e4ed510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.464+0000 7f2ac6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4eabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.464+0000 7f2ac7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4eb120 0x55ec2e4ed510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42224/0 (socket says 172.21.15.37:42224) 2024-08-20T05:02:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.465+0000 7f2ac7400640 1 -- 172.21.15.37:0/1026213724 learned_addr learned my addr 172.21.15.37:0/1026213724 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.465+0000 7f2ac6a00640 1 --2- 172.21.15.37:0/1026213724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4edb60 0x55ec2e4f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.465+0000 7f2ac7400640 1 -- 172.21.15.37:0/1026213724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4edb60 msgr2=0x55ec2e4f0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.465+0000 7f2ac7400640 1 --2- 172.21.15.37:0/1026213724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4edb60 0x55ec2e4f0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.465+0000 7f2ac7400640 1 -- 172.21.15.37:0/1026213724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4e87f0 msgr2=0x55ec2e4eabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.465+0000 7f2ac7400640 1 --2- 172.21.15.37:0/1026213724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4eabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.465+0000 7f2ac7400640 1 -- 172.21.15.37:0/1026213724 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec2e416de0 con 0x55ec2e4eb120 2024-08-20T05:02:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.465+0000 7f2ac7400640 1 --2- 172.21.15.37:0/1026213724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4eb120 0x55ec2e4ed510 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8006010 tx=0x7f2ab8032bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3399ecbcaea39c37 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.466+0000 7f2abfe00640 1 --2- 172.21.15.37:0/105587475 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2aac0b3bd0 0x7f2aac0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.466+0000 7f2ab3e00640 1 -- 172.21.15.37:0/1026213724 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab803f030 con 0x55ec2e4eb120 2024-08-20T05:02:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.466+0000 7f2ab3e00640 1 -- 172.21.15.37:0/1026213724 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ab8032da0 con 0x55ec2e4eb120 2024-08-20T05:02:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.466+0000 7f2ab3e00640 1 -- 172.21.15.37:0/1026213724 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8035070 con 0x55ec2e4eb120 2024-08-20T05:02:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.466+0000 7f2abfe00640 1 -- 172.21.15.37:0/105587475 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2ac00e4630 con 0x7f2ac8079260 2024-08-20T05:02:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.466+0000 7f2ac6a00640 1 --2- 172.21.15.37:0/105587475 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2aac0b3bd0 0x7f2aac0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.467+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/1026213724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4eb120 msgr2=0x55ec2e4ed510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.467+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/1026213724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4eb120 0x55ec2e4ed510 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8006010 tx=0x7f2ab8032bb0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.467+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/1026213724 shutdown_connections 2024-08-20T05:02:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.467+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/1026213724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4edb60 0x55ec2e4f0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.467+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/1026213724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4eb120 0x55ec2e4ed510 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.467+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/1026213724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4eabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.467+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/1026213724 >> 172.21.15.37:0/1026213724 conn(0x55ec2e4e3940 msgr2=0x55ec2e4e46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.467+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/1026213724 shutdown_connections 2024-08-20T05:02:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.467+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/1026213724 wait complete. 2024-08-20T05:02:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.467+0000 7f2ac6a00640 1 --2- 172.21.15.37:0/105587475 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2aac0b3bd0 0x7f2aac0b6090 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40058c0 tx=0x7f2ab4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.468+0000 7f2ad0fbd740 1 -- start start 2024-08-20T05:02:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.468+0000 7f2ad0fbd740 1 Processor -- start 2024-08-20T05:02:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.468+0000 7f2ad0fbd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.468+0000 7f2ad0fbd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4eb120 0x55ec2e4f2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.468+0000 7f2ad0fbd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4edb60 0x55ec2e4f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.468+0000 7f2ad0fbd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ec2e383ab0 con 0x55ec2e4edb60 2024-08-20T05:02:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.468+0000 7f2ad0fbd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ec2e3f1140 con 0x55ec2e4eb120 2024-08-20T05:02:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.468+0000 7f2ad0fbd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ec2e4f0ae0 con 0x55ec2e4e87f0 2024-08-20T05:02:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.469+0000 7f2ad0fbd740 10 client.0 _ll_register_callbacks cb 0x55ec2e4045d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.469+0000 7f2ac7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4edb60 0x55ec2e4f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.469+0000 7f2ac7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4edb60 0x55ec2e4f30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37120/0 (socket says 172.21.15.37:37120) 2024-08-20T05:02:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.469+0000 7f2ac7e00640 1 -- 172.21.15.37:0/2164516803 learned_addr learned my addr 172.21.15.37:0/2164516803 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.469+0000 7f2ac6a00640 1 --2- 172.21.15.37:0/2164516803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4eb120 0x55ec2e4f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.469+0000 7f2ac7400640 1 --2- 172.21.15.37:0/2164516803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.469+0000 7f2ac7e00640 1 -- 172.21.15.37:0/2164516803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 msgr2=0x55ec2e4f1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.469+0000 7f2ac7e00640 1 --2- 172.21.15.37:0/2164516803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4f1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.469+0000 7f2ac7e00640 1 -- 172.21.15.37:0/2164516803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4eb120 msgr2=0x55ec2e4f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.469+0000 7f2ac7e00640 1 --2- 172.21.15.37:0/2164516803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4eb120 0x55ec2e4f2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.469+0000 7f2ac7e00640 1 -- 172.21.15.37:0/2164516803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec2e3f2170 con 0x55ec2e4edb60 2024-08-20T05:02:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.470+0000 7f2ac7e00640 1 --2- 172.21.15.37:0/2164516803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4edb60 0x55ec2e4f30e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00aae80 tx=0x7f2ac00aa9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c330dd7670e54f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.470+0000 7f2ab0c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:02:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.470+0000 7f2ab0c00640 1 -- 172.21.15.37:0/2164516803 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00ab180 con 0x55ec2e4edb60 2024-08-20T05:02:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.470+0000 7f2ab0c00640 1 -- 172.21.15.37:0/2164516803 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2ac00b3da0 con 0x55ec2e4edb60 2024-08-20T05:02:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.470+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/2164516803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ab8032da0 con 0x55ec2e4edb60 2024-08-20T05:02:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.470+0000 7f2ab0c00640 1 -- 172.21.15.37:0/2164516803 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2ac00af780 con 0x55ec2e4edb60 2024-08-20T05:02:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.470+0000 7f2ad0fbd740 10 client.15585 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.470+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/2164516803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ec2e1ad790 con 0x55ec2e4edb60 2024-08-20T05:02:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.470+0000 7f2ab0c00640 1 -- 172.21.15.37:0/2164516803 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ab8032da0 con 0x55ec2e4edb60 2024-08-20T05:02:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.470+0000 7f2ab0c00640 1 -- 172.21.15.37:0/2164516803 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2ac00a6af0 con 0x55ec2e4edb60 2024-08-20T05:02:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.471+0000 7f2ad0fbd740 10 client.15585 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.471+0000 7f2ad0fbd740 10 client.15585 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:02:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.471+0000 7f2ad0fbd740 20 client.15585 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.471+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/2164516803 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ec2e4fdb30 0x55ec2e4fff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.471+0000 7f2ad0fbd740 4 client.15585 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:02:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.471+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/2164516803 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec2e45d160 con 0x55ec2e4fdb30 2024-08-20T05:02:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.471+0000 7f2ac7400640 1 --2- 172.21.15.37:0/2164516803 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ec2e4fdb30 0x55ec2e4fff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.472+0000 7f2ac7400640 1 --2- 172.21.15.37:0/2164516803 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ec2e4fdb30 0x55ec2e4fff60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d20640a7e8eaa10 server_cookie=a520f72d9a067239 in_seq=0 out_seq=0 2024-08-20T05:02:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.472+0000 7f2ab0c00640 10 client.15585 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.472+0000 7f2ab0c00640 1 -- 172.21.15.37:0/2164516803 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec2e45d160 con 0x55ec2e4fdb30 2024-08-20T05:02:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.472+0000 7f2ab0c00640 10 client.15585 handle_command_reply: tid=0 2024-08-20T05:02:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.473+0000 7f2ad0fbd740 1 client.15585 shutdown 2024-08-20T05:02:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.473+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/2164516803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4edb60 msgr2=0x55ec2e4f30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.473+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/2164516803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4edb60 0x55ec2e4f30e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00aae80 tx=0x7f2ac00aa9b0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.473+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/2164516803 shutdown_connections 2024-08-20T05:02:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.473+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/2164516803 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ec2e4fdb30 0x55ec2e4fff60 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.473+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/2164516803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4edb60 0x55ec2e4f30e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.473+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/2164516803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4eb120 0x55ec2e4f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.473+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/2164516803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.473+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/2164516803 >> 172.21.15.37:0/2164516803 conn(0x55ec2e4e3940 msgr2=0x55ec2e4e29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.473+0000 7f2ab0c00640 0 client.15585 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.473+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/2164516803 shutdown_connections 2024-08-20T05:02:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.473+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/2164516803 wait complete. 2024-08-20T05:02:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.473+0000 7f2ad0fbd740 20 client.15585 trim_cache size 0 max 16384 2024-08-20T05:02:45.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.480+0000 7f4a683d0740 1 Processor -- start 2024-08-20T05:02:45.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.480+0000 7f4a683d0740 1 -- start start 2024-08-20T05:02:45.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.481+0000 7f4a683d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957af10 0x562139599750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.481+0000 7f4a683d0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56213957b830 0x562139583920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.481+0000 7f4a683d0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621395877c0 0x562139582cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.481+0000 7f4a683d0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562139597a90 con 0x56213957b830 2024-08-20T05:02:45.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.481+0000 7f4a683d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562139598160 con 0x56213957af10 2024-08-20T05:02:45.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.481+0000 7f4a683d0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562139598830 con 0x5621395877c0 2024-08-20T05:02:45.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.481+0000 7f4a5f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957af10 0x562139599750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.481+0000 7f4a5f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957af10 0x562139599750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33798/0 (socket says 172.21.15.37:33798) 2024-08-20T05:02:45.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.481+0000 7f4a5f400640 1 -- 172.21.15.37:0/2316383940 learned_addr learned my addr 172.21.15.37:0/2316383940 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:45.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.481+0000 7f4a5e000640 1 --2- 172.21.15.37:0/2316383940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56213957b830 0x562139583920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.481+0000 7f4a5f400640 1 --2- 172.21.15.37:0/2316383940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621395877c0 0x562139582cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.482+0000 7f4a5e000640 1 -- 172.21.15.37:0/2316383940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621395877c0 msgr2=0x562139582cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:45.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.482+0000 7f4a5e000640 1 --2- 172.21.15.37:0/2316383940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621395877c0 0x562139582cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.482+0000 7f4a5e000640 1 -- 172.21.15.37:0/2316383940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957af10 msgr2=0x562139599750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:45.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.482+0000 7f4a5e000640 1 --2- 172.21.15.37:0/2316383940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957af10 0x562139599750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.482+0000 7f4a5e000640 1 -- 172.21.15.37:0/2316383940 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562139584f50 con 0x56213957b830 2024-08-20T05:02:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.482+0000 7f4a5f400640 1 --2- 172.21.15.37:0/2316383940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957af10 0x562139599750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.482+0000 7f4a5e000640 1 --2- 172.21.15.37:0/2316383940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56213957b830 0x562139583920 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c003d90 tx=0x7f4a4c005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbec1cd6a5062fb2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.482+0000 7f4a4b400640 1 -- 172.21.15.37:0/2316383940 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c035070 con 0x56213957b830 2024-08-20T05:02:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.482+0000 7f4a4b400640 1 -- 172.21.15.37:0/2316383940 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a4c040070 con 0x56213957b830 2024-08-20T05:02:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.482+0000 7f4a4b400640 1 -- 172.21.15.37:0/2316383940 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c0054b0 con 0x56213957b830 2024-08-20T05:02:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.483+0000 7f4a683d0740 1 -- 172.21.15.37:0/2316383940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56213957b830 msgr2=0x562139583920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.483+0000 7f4a683d0740 1 --2- 172.21.15.37:0/2316383940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56213957b830 0x562139583920 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c003d90 tx=0x7f4a4c005970 comp rx=0 tx=0).stop 2024-08-20T05:02:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.483+0000 7f4a683d0740 1 -- 172.21.15.37:0/2316383940 shutdown_connections 2024-08-20T05:02:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.483+0000 7f4a683d0740 1 --2- 172.21.15.37:0/2316383940 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5621395877c0 0x562139582cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.483+0000 7f4a683d0740 1 --2- 172.21.15.37:0/2316383940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56213957b830 0x562139583920 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.483+0000 7f4a683d0740 1 --2- 172.21.15.37:0/2316383940 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56213957af10 0x562139599750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.483+0000 7f4a683d0740 1 -- 172.21.15.37:0/2316383940 >> 172.21.15.37:0/2316383940 conn(0x562139578d40 msgr2=0x562139579d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:45.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.483+0000 7f4a683d0740 1 -- 172.21.15.37:0/2316383940 shutdown_connections 2024-08-20T05:02:45.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.483+0000 7f4a683d0740 1 -- 172.21.15.37:0/2316383940 wait complete. 2024-08-20T05:02:45.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.484+0000 7f4a683d0740 1 -- start start 2024-08-20T05:02:45.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.484+0000 7f4a683d0740 1 Processor -- start 2024-08-20T05:02:45.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.485+0000 7f4a683d0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56213957af10 0x56213959d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.485+0000 7f4a683d0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56213957b830 0x56213959d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.485+0000 7f4a683d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5621395877c0 0x5621395faab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.485+0000 7f4a683d0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5621395995d0 con 0x56213957b830 2024-08-20T05:02:45.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.485+0000 7f4a683d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562139598f00 con 0x5621395877c0 2024-08-20T05:02:45.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.485+0000 7f4a683d0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562139599ca0 con 0x56213957af10 2024-08-20T05:02:45.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.485+0000 7f4a683d0740 10 client.0 _ll_register_callbacks cb 0x7f4a50005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:45.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.485+0000 7f4a5f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5621395877c0 0x5621395faab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.485+0000 7f4a5f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5621395877c0 0x5621395faab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33804/0 (socket says 172.21.15.37:33804) 2024-08-20T05:02:45.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.485+0000 7f4a5f400640 1 -- 172.21.15.37:0/1621451730 learned_addr learned my addr 172.21.15.37:0/1621451730 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:45.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.485+0000 7f4a5f400640 1 --2- 172.21.15.37:0/1621451730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56213957af10 0x56213959d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.485+0000 7f4a5e000640 1 --2- 172.21.15.37:0/1621451730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56213957b830 0x56213959d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.485+0000 7f4a5f400640 1 -- 172.21.15.37:0/1621451730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56213957af10 msgr2=0x56213959d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:45.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.485+0000 7f4a5f400640 1 --2- 172.21.15.37:0/1621451730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56213957af10 0x56213959d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.485+0000 7f4a5f400640 1 -- 172.21.15.37:0/1621451730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56213957b830 msgr2=0x56213959d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.486+0000 7f4a5f400640 1 --2- 172.21.15.37:0/1621451730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56213957b830 0x56213959d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.486+0000 7f4a5f400640 1 -- 172.21.15.37:0/1621451730 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621395797c0 con 0x5621395877c0 2024-08-20T05:02:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.486+0000 7f4a5f400640 1 --2- 172.21.15.37:0/1621451730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5621395877c0 0x5621395faab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4a58005fd0 tx=0x7f4a58009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c579f517fdaf7bfd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.486+0000 7f4a48c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:02:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.486+0000 7f4a48c00640 1 -- 172.21.15.37:0/1621451730 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a58004590 con 0x5621395877c0 2024-08-20T05:02:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.486+0000 7f4a683d0740 1 -- 172.21.15.37:0/1621451730 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a4c040070 con 0x5621395877c0 2024-08-20T05:02:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.486+0000 7f4a48c00640 1 -- 172.21.15.37:0/1621451730 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4a5800f540 con 0x5621395877c0 2024-08-20T05:02:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.486+0000 7f4a48c00640 1 -- 172.21.15.37:0/1621451730 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4a58004730 con 0x5621395877c0 2024-08-20T05:02:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.486+0000 7f4a683d0740 10 client.25607 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:45.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.486+0000 7f4a683d0740 1 -- 172.21.15.37:0/1621451730 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562139602490 con 0x5621395877c0 2024-08-20T05:02:45.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.487+0000 7f4a48c00640 1 -- 172.21.15.37:0/1621451730 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a4c040070 con 0x5621395877c0 2024-08-20T05:02:45.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.487+0000 7f4a48c00640 1 -- 172.21.15.37:0/1621451730 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f4a58025040 con 0x5621395877c0 2024-08-20T05:02:45.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.487+0000 7f4a683d0740 10 client.25607 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:45.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.487+0000 7f4a683d0740 10 client.25607 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-20T05:02:45.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.487+0000 7f4a683d0740 20 client.25607 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:45.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.487+0000 7f4a683d0740 1 --2- 172.21.15.37:0/1621451730 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x562139606e50 0x562139605b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.487+0000 7f4a683d0740 4 client.25607 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T05:02:45.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.487+0000 7f4a683d0740 1 -- 172.21.15.37:0/1621451730 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "status"}) -- 0x5621394ef230 con 0x562139606e50 2024-08-20T05:02:45.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.488+0000 7f4a5e000640 1 --2- 172.21.15.37:0/1621451730 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x562139606e50 0x562139605b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.488+0000 7f4a5e000640 1 --2- 172.21.15.37:0/1621451730 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x562139606e50 0x562139605b60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=635e753a8f4c8095 server_cookie=8379a98a42eef24b in_seq=0 out_seq=0 2024-08-20T05:02:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.488+0000 7f4a48c00640 10 client.25607 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:02:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.489+0000 7f4a48c00640 1 -- 172.21.15.37:0/1621451730 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5621394ef230 con 0x562139606e50 2024-08-20T05:02:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.489+0000 7f4a48c00640 10 client.25607 handle_command_reply: tid=0 2024-08-20T05:02:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.489+0000 7f4a683d0740 1 client.25607 shutdown 2024-08-20T05:02:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.489+0000 7f4a683d0740 1 -- 172.21.15.37:0/1621451730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5621395877c0 msgr2=0x5621395faab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.489+0000 7f4a683d0740 1 --2- 172.21.15.37:0/1621451730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5621395877c0 0x5621395faab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4a58005fd0 tx=0x7f4a58009500 comp rx=0 tx=0).stop 2024-08-20T05:02:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.489+0000 7f4a683d0740 1 -- 172.21.15.37:0/1621451730 shutdown_connections 2024-08-20T05:02:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.489+0000 7f4a683d0740 1 --2- 172.21.15.37:0/1621451730 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x562139606e50 0x562139605b60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.489+0000 7f4a683d0740 1 --2- 172.21.15.37:0/1621451730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5621395877c0 0x5621395faab0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.489+0000 7f4a683d0740 1 --2- 172.21.15.37:0/1621451730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56213957b830 0x56213959d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.489+0000 7f4a683d0740 1 --2- 172.21.15.37:0/1621451730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56213957af10 0x56213959d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.489+0000 7f4a683d0740 1 -- 172.21.15.37:0/1621451730 >> 172.21.15.37:0/1621451730 conn(0x562139578d40 msgr2=0x562139585a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:45.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.489+0000 7f4a48c00640 0 client.25607 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:02:45.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.489+0000 7f4a683d0740 1 -- 172.21.15.37:0/1621451730 shutdown_connections 2024-08-20T05:02:45.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.489+0000 7f4a683d0740 1 -- 172.21.15.37:0/1621451730 wait complete. 2024-08-20T05:02:45.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.489+0000 7f4a683d0740 20 client.25607 trim_cache size 0 max 16384 2024-08-20T05:02:45.494 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:02:45.494 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T05:02:45.494 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 1, 2024-08-20T05:02:45.494 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24664, 2024-08-20T05:02:45.494 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-20T05:02:45.494 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-20T05:02:45.495 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-20T05:02:45.495 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 163.37474046700001, 2024-08-20T05:02:45.495 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 29, 2024-08-20T05:02:45.495 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 88, 2024-08-20T05:02:45.495 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 88, 2024-08-20T05:02:45.495 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 236.40501299100001 2024-08-20T05:02:45.495 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:02:45.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.490+0000 7f4a65800640 1 -- 172.21.15.37:0/2419853214 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a440b3c50 msgr2=0x7f4a440b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.490+0000 7f4a65800640 1 --2- 172.21.15.37:0/2419853214 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a440b3c50 0x7f4a440b6110 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4a500e1df0 tx=0x7f4a500e7e00 comp rx=0 tx=0).stop 2024-08-20T05:02:45.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.490+0000 7f4a65800640 1 -- 172.21.15.37:0/2419853214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a60104ca0 msgr2=0x7f4a6019b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.490+0000 7f4a65800640 1 --2- 172.21.15.37:0/2419853214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a60104ca0 0x7f4a6019b170 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000e9f0 tx=0x7f4a5000edf0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.490+0000 7f4a65800640 1 -- 172.21.15.37:0/2419853214 shutdown_connections 2024-08-20T05:02:45.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.490+0000 7f4a65800640 1 --2- 172.21.15.37:0/2419853214 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a440b3c50 0x7f4a440b6110 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.490+0000 7f4a65800640 1 --2- 172.21.15.37:0/2419853214 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a6010b030 0x7f4a601a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.490+0000 7f4a65800640 1 --2- 172.21.15.37:0/2419853214 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a6010a6b0 0x7f4a6019b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.490+0000 7f4a65800640 1 --2- 172.21.15.37:0/2419853214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a60104ca0 0x7f4a6019b170 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.490+0000 7f4a65800640 1 -- 172.21.15.37:0/2419853214 >> 172.21.15.37:0/2419853214 conn(0x7f4a60100730 msgr2=0x7f4a60102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:45.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.490+0000 7f4a65800640 1 -- 172.21.15.37:0/2419853214 shutdown_connections 2024-08-20T05:02:45.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:45.490+0000 7f4a65800640 1 -- 172.21.15.37:0/2419853214 wait complete. 2024-08-20T05:02:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.492+0000 7f2ad0fbd740 1 Processor -- start 2024-08-20T05:02:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.492+0000 7f2ad0fbd740 1 -- start start 2024-08-20T05:02:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.492+0000 7f2ad0fbd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4eebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.492+0000 7f2ad0fbd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4eb120 0x55ec2e4ef110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.492+0000 7f2ad0fbd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4edb60 0x55ec2e4ef650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.492+0000 7f2ad0fbd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac81b1740 con 0x55ec2e4edb60 2024-08-20T05:02:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.492+0000 7f2ad0fbd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac81b3280 con 0x55ec2e4eb120 2024-08-20T05:02:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.492+0000 7f2ad0fbd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac81b1e10 con 0x55ec2e4e87f0 2024-08-20T05:02:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.492+0000 7f2ac7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4eebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.492+0000 7f2ac7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4eebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42248/0 (socket says 172.21.15.37:42248) 2024-08-20T05:02:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.492+0000 7f2ac7400640 1 -- 172.21.15.37:0/3900190265 learned_addr learned my addr 172.21.15.37:0/3900190265 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.493+0000 7f2ac7e00640 1 --2- 172.21.15.37:0/3900190265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4edb60 0x55ec2e4ef650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.493+0000 7f2ac6a00640 1 --2- 172.21.15.37:0/3900190265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4eb120 0x55ec2e4ef110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.493+0000 7f2ac7400640 1 -- 172.21.15.37:0/3900190265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4eb120 msgr2=0x55ec2e4ef110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.493+0000 7f2ac7400640 1 --2- 172.21.15.37:0/3900190265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4eb120 0x55ec2e4ef110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.493+0000 7f2ac7400640 1 -- 172.21.15.37:0/3900190265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4edb60 msgr2=0x55ec2e4ef650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.493+0000 7f2ac7400640 1 --2- 172.21.15.37:0/3900190265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4edb60 0x55ec2e4ef650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.493+0000 7f2ac7400640 1 -- 172.21.15.37:0/3900190265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec2e226620 con 0x55ec2e4e87f0 2024-08-20T05:02:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.493+0000 7f2ac7400640 1 --2- 172.21.15.37:0/3900190265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4eebd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8006010 tx=0x7f2ab8005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69222bc46047e863 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.493+0000 7f2ab3400640 1 -- 172.21.15.37:0/3900190265 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8035050 con 0x55ec2e4e87f0 2024-08-20T05:02:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.494+0000 7f2ab3400640 1 -- 172.21.15.37:0/3900190265 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ab80054f0 con 0x55ec2e4e87f0 2024-08-20T05:02:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.494+0000 7f2ab3400640 1 -- 172.21.15.37:0/3900190265 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab803f040 con 0x55ec2e4e87f0 2024-08-20T05:02:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.494+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/3900190265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 msgr2=0x55ec2e4eebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.494+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/3900190265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4eebd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8006010 tx=0x7f2ab8005bd0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.494+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/3900190265 shutdown_connections 2024-08-20T05:02:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.494+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/3900190265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4edb60 0x55ec2e4ef650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.494+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/3900190265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4eb120 0x55ec2e4ef110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.494+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/3900190265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4eebd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.494+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/3900190265 >> 172.21.15.37:0/3900190265 conn(0x55ec2e4e3940 msgr2=0x55ec2e4edf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.494+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/3900190265 shutdown_connections 2024-08-20T05:02:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.494+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/3900190265 wait complete. 2024-08-20T05:02:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.495+0000 7f2ad0fbd740 1 -- start start 2024-08-20T05:02:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.495+0000 7f2ad0fbd740 1 Processor -- start 2024-08-20T05:02:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.495+0000 7f2ad0fbd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.495+0000 7f2ad0fbd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4eb120 0x55ec2e4f7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.495+0000 7f2ad0fbd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4edb60 0x55ec2e4f8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.496+0000 7f2ad0fbd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac81b2bb0 con 0x55ec2e4edb60 2024-08-20T05:02:45.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.496+0000 7f2ad0fbd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac81b24e0 con 0x55ec2e4eb120 2024-08-20T05:02:45.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.496+0000 7f2ad0fbd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac81af720 con 0x55ec2e4e87f0 2024-08-20T05:02:45.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.496+0000 7f2ad0fbd740 10 client.0 _ll_register_callbacks cb 0x7f2ac0004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:45.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.496+0000 7f2ac7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.496+0000 7f2ac7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4edb60 0x55ec2e4f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.496+0000 7f2ac7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4f71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42260/0 (socket says 172.21.15.37:42260) 2024-08-20T05:02:45.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.496+0000 7f2ac7400640 1 -- 172.21.15.37:0/2722116932 learned_addr learned my addr 172.21.15.37:0/2722116932 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:45.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.496+0000 7f2ac6a00640 1 --2- 172.21.15.37:0/2722116932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4eb120 0x55ec2e4f7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.496+0000 7f2ac7400640 1 -- 172.21.15.37:0/2722116932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4eb120 msgr2=0x55ec2e4f7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:45.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.496+0000 7f2ac7400640 1 --2- 172.21.15.37:0/2722116932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4eb120 0x55ec2e4f7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.496+0000 7f2ac7400640 1 -- 172.21.15.37:0/2722116932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4edb60 msgr2=0x55ec2e4f8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:45.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.496+0000 7f2ac7400640 1 --2- 172.21.15.37:0/2722116932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4edb60 0x55ec2e4f8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.496+0000 7f2ac7400640 1 -- 172.21.15.37:0/2722116932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec2e4f8c90 con 0x55ec2e4e87f0 2024-08-20T05:02:45.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.497+0000 7f2ac7400640 1 --2- 172.21.15.37:0/2722116932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4f71f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8005ab0 tx=0x7f2ab8032d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1da8c4576f41e7de server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:45.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.497+0000 7f2ab0c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:02:45.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.497+0000 7f2ab0c00640 1 -- 172.21.15.37:0/2722116932 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab805b060 con 0x55ec2e4e87f0 2024-08-20T05:02:45.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.497+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/2722116932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ab80054f0 con 0x55ec2e4e87f0 2024-08-20T05:02:45.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.497+0000 7f2ab0c00640 1 -- 172.21.15.37:0/2722116932 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2ab80048c0 con 0x55ec2e4e87f0 2024-08-20T05:02:45.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.497+0000 7f2ab0c00640 1 -- 172.21.15.37:0/2722116932 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2ab8062050 con 0x55ec2e4e87f0 2024-08-20T05:02:45.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.497+0000 7f2ad0fbd740 10 client.25624 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:45.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.497+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/2722116932 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ec2e4fa000 con 0x55ec2e4e87f0 2024-08-20T05:02:45.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.498+0000 7f2ab0c00640 1 -- 172.21.15.37:0/2722116932 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ab80054f0 con 0x55ec2e4e87f0 2024-08-20T05:02:45.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.498+0000 7f2ab0c00640 1 -- 172.21.15.37:0/2722116932 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f2ab804c900 con 0x55ec2e4e87f0 2024-08-20T05:02:45.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.498+0000 7f2ad0fbd740 10 client.25624 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.498+0000 7f2ad0fbd740 10 client.25624 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:02:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.498+0000 7f2ad0fbd740 20 client.25624 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.498+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/2722116932 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ec2e568950 0x55ec2e56ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.498+0000 7f2ad0fbd740 4 client.25624 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:02:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.498+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/2722116932 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ec2e458c00 con 0x55ec2e568950 2024-08-20T05:02:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.499+0000 7f2ac6a00640 1 --2- 172.21.15.37:0/2722116932 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ec2e568950 0x55ec2e56ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.499+0000 7f2ac6a00640 1 --2- 172.21.15.37:0/2722116932 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ec2e568950 0x55ec2e56ad40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9ad4977d8b27056 server_cookie=f9e51049f39065db in_seq=0 out_seq=0 2024-08-20T05:02:45.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.499+0000 7f2ab0c00640 10 client.25624 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:45.597 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:45 smithi037 ceph-mon[17265]: pgmap v416: 129 pgs: 129 active+clean; 11 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 877 KiB/s wr, 33 op/s 2024-08-20T05:02:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:45 smithi135 ceph-mon[22342]: pgmap v416: 129 pgs: 129 active+clean; 11 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 877 KiB/s wr, 33 op/s 2024-08-20T05:02:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.888+0000 7f2ab0c00640 1 -- 172.21.15.37:0/2722116932 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ec2e458c00 con 0x55ec2e568950 2024-08-20T05:02:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.888+0000 7f2ab0c00640 10 client.25624 handle_command_reply: tid=0 2024-08-20T05:02:45.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.888+0000 7f2ad0fbd740 1 client.25624 shutdown 2024-08-20T05:02:45.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.889+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/2722116932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 msgr2=0x55ec2e4f71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.889+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/2722116932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4f71f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8005ab0 tx=0x7f2ab8032d20 comp rx=0 tx=0).stop 2024-08-20T05:02:45.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.889+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/2722116932 shutdown_connections 2024-08-20T05:02:45.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.889+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/2722116932 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ec2e568950 0x55ec2e56ad40 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.889+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/2722116932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec2e4edb60 0x55ec2e4f8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.889+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/2722116932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec2e4eb120 0x55ec2e4f7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.889+0000 7f2ad0fbd740 1 --2- 172.21.15.37:0/2722116932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec2e4e87f0 0x55ec2e4f71f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.889+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/2722116932 >> 172.21.15.37:0/2722116932 conn(0x55ec2e4e3940 msgr2=0x55ec2e4e29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:45.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.889+0000 7f2ab0c00640 0 client.25624 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.889+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/2722116932 shutdown_connections 2024-08-20T05:02:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.889+0000 7f2ad0fbd740 1 -- 172.21.15.37:0/2722116932 wait complete. 2024-08-20T05:02:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.889+0000 7f2ad0fbd740 20 client.25624 trim_cache size 0 max 16384 2024-08-20T05:02:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:02:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:02:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:02:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:02:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.890+0000 7f2acca00640 1 -- 172.21.15.37:0/105587475 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2aac0b3bd0 msgr2=0x7f2aac0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.890+0000 7f2acca00640 1 --2- 172.21.15.37:0/105587475 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2aac0b3bd0 0x7f2aac0b6090 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2ab40058c0 tx=0x7f2ab4005850 comp rx=0 tx=0).stop 2024-08-20T05:02:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.890+0000 7f2acca00640 1 -- 172.21.15.37:0/105587475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac8079260 msgr2=0x7f2ac81a0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.890+0000 7f2acca00640 1 --2- 172.21.15.37:0/105587475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac8079260 0x7f2ac81a0110 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000eb10 tx=0x7f2ac000c2d0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.890+0000 7f2acca00640 1 -- 172.21.15.37:0/105587475 shutdown_connections 2024-08-20T05:02:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.890+0000 7f2acca00640 1 --2- 172.21.15.37:0/105587475 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2aac0b3bd0 0x7f2aac0b6090 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.890+0000 7f2acca00640 1 --2- 172.21.15.37:0/105587475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ac8079260 0x7f2ac81a0110 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.890+0000 7f2acca00640 1 --2- 172.21.15.37:0/105587475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ac80788a0 0x7f2ac819f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.890+0000 7f2acca00640 1 --2- 172.21.15.37:0/105587475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ac8077750 0x7f2ac819ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.890+0000 7f2acca00640 1 -- 172.21.15.37:0/105587475 >> 172.21.15.37:0/105587475 conn(0x7f2ac80fff50 msgr2=0x7f2ac8101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.890+0000 7f2acca00640 1 -- 172.21.15.37:0/105587475 shutdown_connections 2024-08-20T05:02:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:45.890+0000 7f2acca00640 1 -- 172.21.15.37:0/105587475 wait complete. 2024-08-20T05:02:45.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:45 smithi130 ceph-mon[22007]: pgmap v416: 129 pgs: 129 active+clean; 11 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 171 KiB/s rd, 877 KiB/s wr, 33 op/s 2024-08-20T05:02:46.403 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.b status 2024-08-20T05:02:46.696 INFO:teuthology.orchestra.run.smithi037.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-08-20T05:02:46.703 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-08-20T05:02:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:46.801 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/: 2024-08-20T05:02:46.801 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:46.801 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 . 2024-08-20T05:02:46.802 INFO:teuthology.orchestra.run.smithi037.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 .. 2024-08-20T05:02:46.802 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 data 2024-08-20T05:02:46.802 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.802 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data: 2024-08-20T05:02:46.802 INFO:teuthology.orchestra.run.smithi037.stdout:total 35 2024-08-20T05:02:46.802 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 . 2024-08-20T05:02:46.802 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 .. 2024-08-20T05:02:46.802 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:02 base 2024-08-20T05:02:46.802 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Aug 20 05:02 global 2024-08-20T05:02:46.802 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 log 2024-08-20T05:02:46.802 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_commit_ts 2024-08-20T05:02:46.802 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_dynshmem 2024-08-20T05:02:46.803 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Aug 20 05:02 pg_hba.conf 2024-08-20T05:02:46.803 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Aug 20 05:02 pg_ident.conf 2024-08-20T05:02:46.803 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:02 pg_logical 2024-08-20T05:02:46.803 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 20 05:02 pg_multixact 2024-08-20T05:02:46.803 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_notify 2024-08-20T05:02:46.803 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_replslot 2024-08-20T05:02:46.803 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_serial 2024-08-20T05:02:46.803 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_snapshots 2024-08-20T05:02:46.803 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_stat 2024-08-20T05:02:46.803 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_stat_tmp 2024-08-20T05:02:46.803 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 pg_subtrans 2024-08-20T05:02:46.803 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_tblspc 2024-08-20T05:02:46.803 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_twophase 2024-08-20T05:02:46.804 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:02 PG_VERSION 2024-08-20T05:02:46.804 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 20 05:02 pg_wal 2024-08-20T05:02:46.804 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 pg_xact 2024-08-20T05:02:46.804 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Aug 20 05:02 postgresql.auto.conf 2024-08-20T05:02:46.804 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Aug 20 05:02 postgresql.conf 2024-08-20T05:02:46.804 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.804 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base: 2024-08-20T05:02:46.804 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:46.804 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:02 . 2024-08-20T05:02:46.804 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.804 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 20 05:02 1 2024-08-20T05:02:46.804 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 20 05:02 13493 2024-08-20T05:02:46.804 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 20 05:02 13494 2024-08-20T05:02:46.804 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.805 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/1: 2024-08-20T05:02:46.805 INFO:teuthology.orchestra.run.smithi037.stdout:total 7777 2024-08-20T05:02:46.805 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 20 05:02 . 2024-08-20T05:02:46.805 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:02 .. 2024-08-20T05:02:46.805 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 112 2024-08-20T05:02:46.805 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 113 2024-08-20T05:02:46.805 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 20 05:02 1247 2024-08-20T05:02:46.805 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1247_fsm 2024-08-20T05:02:46.805 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1247_vm 2024-08-20T05:02:46.805 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Aug 20 05:02 1249 2024-08-20T05:02:46.805 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1249_fsm 2024-08-20T05:02:46.805 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1249_vm 2024-08-20T05:02:46.805 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Aug 20 05:02 1255 2024-08-20T05:02:46.805 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1255_fsm 2024-08-20T05:02:46.806 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1255_vm 2024-08-20T05:02:46.806 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 20 05:02 1259 2024-08-20T05:02:46.806 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1259_fsm 2024-08-20T05:02:46.806 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1259_vm 2024-08-20T05:02:46.806 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Aug 20 05:02 13344 2024-08-20T05:02:46.806 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13344_fsm 2024-08-20T05:02:46.806 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13344_vm 2024-08-20T05:02:46.806 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13346 2024-08-20T05:02:46.806 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13348 2024-08-20T05:02:46.806 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13349 2024-08-20T05:02:46.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13349_fsm 2024-08-20T05:02:46.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13349_vm 2024-08-20T05:02:46.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13351 2024-08-20T05:02:46.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13353 2024-08-20T05:02:46.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13354 2024-08-20T05:02:46.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13354_fsm 2024-08-20T05:02:46.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13354_vm 2024-08-20T05:02:46.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13356 2024-08-20T05:02:46.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13358 2024-08-20T05:02:46.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13359 2024-08-20T05:02:46.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13359_fsm 2024-08-20T05:02:46.807 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13359_vm 2024-08-20T05:02:46.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13361 2024-08-20T05:02:46.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13363 2024-08-20T05:02:46.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 1417 2024-08-20T05:02:46.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 1418 2024-08-20T05:02:46.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 174 2024-08-20T05:02:46.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 175 2024-08-20T05:02:46.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2187 2024-08-20T05:02:46.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2224 2024-08-20T05:02:46.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2328 2024-08-20T05:02:46.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2336 2024-08-20T05:02:46.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2337 2024-08-20T05:02:46.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2579 2024-08-20T05:02:46.808 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2600 2024-08-20T05:02:46.809 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2600_fsm 2024-08-20T05:02:46.809 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2600_vm 2024-08-20T05:02:46.809 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2601 2024-08-20T05:02:46.809 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2601_fsm 2024-08-20T05:02:46.809 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2601_vm 2024-08-20T05:02:46.809 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:02 2602 2024-08-20T05:02:46.809 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2602_fsm 2024-08-20T05:02:46.809 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2602_vm 2024-08-20T05:02:46.809 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2603 2024-08-20T05:02:46.810 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2603_fsm 2024-08-20T05:02:46.810 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2603_vm 2024-08-20T05:02:46.810 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2604 2024-08-20T05:02:46.810 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2605 2024-08-20T05:02:46.810 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2605_fsm 2024-08-20T05:02:46.810 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2605_vm 2024-08-20T05:02:46.810 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2606 2024-08-20T05:02:46.810 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2606_fsm 2024-08-20T05:02:46.810 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2606_vm 2024-08-20T05:02:46.810 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2607 2024-08-20T05:02:46.810 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2607_fsm 2024-08-20T05:02:46.810 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2607_vm 2024-08-20T05:02:46.811 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Aug 20 05:02 2608 2024-08-20T05:02:46.811 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2608_fsm 2024-08-20T05:02:46.811 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2608_vm 2024-08-20T05:02:46.811 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Aug 20 05:02 2609 2024-08-20T05:02:46.811 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2609_fsm 2024-08-20T05:02:46.811 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2609_vm 2024-08-20T05:02:46.811 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2610 2024-08-20T05:02:46.811 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2610_fsm 2024-08-20T05:02:46.811 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2610_vm 2024-08-20T05:02:46.811 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2611 2024-08-20T05:02:46.811 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2612 2024-08-20T05:02:46.811 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2612_fsm 2024-08-20T05:02:46.811 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2612_vm 2024-08-20T05:02:46.812 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2613 2024-08-20T05:02:46.812 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2615 2024-08-20T05:02:46.812 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2615_fsm 2024-08-20T05:02:46.812 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2615_vm 2024-08-20T05:02:46.812 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2616 2024-08-20T05:02:46.812 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2616_fsm 2024-08-20T05:02:46.812 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2616_vm 2024-08-20T05:02:46.812 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Aug 20 05:02 2617 2024-08-20T05:02:46.812 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2617_fsm 2024-08-20T05:02:46.812 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2617_vm 2024-08-20T05:02:46.812 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 20 05:02 2618 2024-08-20T05:02:46.812 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2618_fsm 2024-08-20T05:02:46.812 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2618_vm 2024-08-20T05:02:46.812 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Aug 20 05:02 2619 2024-08-20T05:02:46.812 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2619_fsm 2024-08-20T05:02:46.813 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2619_vm 2024-08-20T05:02:46.813 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2620 2024-08-20T05:02:46.813 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2650 2024-08-20T05:02:46.813 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2651 2024-08-20T05:02:46.813 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2652 2024-08-20T05:02:46.813 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2653 2024-08-20T05:02:46.813 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2654 2024-08-20T05:02:46.813 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2655 2024-08-20T05:02:46.813 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2656 2024-08-20T05:02:46.813 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2657 2024-08-20T05:02:46.813 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 20 05:02 2658 2024-08-20T05:02:46.813 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 20 05:02 2659 2024-08-20T05:02:46.813 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2660 2024-08-20T05:02:46.813 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2661 2024-08-20T05:02:46.814 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2662 2024-08-20T05:02:46.814 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:02 2663 2024-08-20T05:02:46.814 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2664 2024-08-20T05:02:46.814 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2665 2024-08-20T05:02:46.814 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2666 2024-08-20T05:02:46.814 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2667 2024-08-20T05:02:46.814 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2668 2024-08-20T05:02:46.814 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2669 2024-08-20T05:02:46.814 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2670 2024-08-20T05:02:46.814 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Aug 20 05:02 2673 2024-08-20T05:02:46.814 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Aug 20 05:02 2674 2024-08-20T05:02:46.814 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Aug 20 05:02 2675 2024-08-20T05:02:46.814 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2678 2024-08-20T05:02:46.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2679 2024-08-20T05:02:46.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2680 2024-08-20T05:02:46.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2681 2024-08-20T05:02:46.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2682 2024-08-20T05:02:46.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2683 2024-08-20T05:02:46.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2684 2024-08-20T05:02:46.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2685 2024-08-20T05:02:46.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2686 2024-08-20T05:02:46.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2687 2024-08-20T05:02:46.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2688 2024-08-20T05:02:46.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:02 2689 2024-08-20T05:02:46.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 20 05:02 2690 2024-08-20T05:02:46.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Aug 20 05:02 2691 2024-08-20T05:02:46.815 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2692 2024-08-20T05:02:46.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2693 2024-08-20T05:02:46.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2696 2024-08-20T05:02:46.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2699 2024-08-20T05:02:46.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2701 2024-08-20T05:02:46.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2702 2024-08-20T05:02:46.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2703 2024-08-20T05:02:46.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2704 2024-08-20T05:02:46.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2753 2024-08-20T05:02:46.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2753_fsm 2024-08-20T05:02:46.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2753_vm 2024-08-20T05:02:46.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2754 2024-08-20T05:02:46.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2755 2024-08-20T05:02:46.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2756 2024-08-20T05:02:46.816 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2757 2024-08-20T05:02:46.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2830 2024-08-20T05:02:46.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2831 2024-08-20T05:02:46.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2832 2024-08-20T05:02:46.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2833 2024-08-20T05:02:46.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2834 2024-08-20T05:02:46.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2835 2024-08-20T05:02:46.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2836 2024-08-20T05:02:46.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2837 2024-08-20T05:02:46.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Aug 20 05:02 2838 2024-08-20T05:02:46.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2838_fsm 2024-08-20T05:02:46.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2838_vm 2024-08-20T05:02:46.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2839 2024-08-20T05:02:46.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2840 2024-08-20T05:02:46.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2840_fsm 2024-08-20T05:02:46.817 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2840_vm 2024-08-20T05:02:46.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2841 2024-08-20T05:02:46.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2995 2024-08-20T05:02:46.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2996 2024-08-20T05:02:46.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3079 2024-08-20T05:02:46.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3079_fsm 2024-08-20T05:02:46.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3079_vm 2024-08-20T05:02:46.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3080 2024-08-20T05:02:46.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3081 2024-08-20T05:02:46.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 3085 2024-08-20T05:02:46.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3118 2024-08-20T05:02:46.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3119 2024-08-20T05:02:46.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 20 05:02 3164 2024-08-20T05:02:46.818 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3256 2024-08-20T05:02:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3257 2024-08-20T05:02:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3258 2024-08-20T05:02:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3350 2024-08-20T05:02:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3351 2024-08-20T05:02:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3379 2024-08-20T05:02:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3380 2024-08-20T05:02:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3381 2024-08-20T05:02:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3394 2024-08-20T05:02:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3394_fsm 2024-08-20T05:02:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3394_vm 2024-08-20T05:02:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3395 2024-08-20T05:02:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3429 2024-08-20T05:02:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3430 2024-08-20T05:02:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3431 2024-08-20T05:02:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3433 2024-08-20T05:02:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3439 2024-08-20T05:02:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3440 2024-08-20T05:02:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 3455 2024-08-20T05:02:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Aug 20 05:02 3456 2024-08-20T05:02:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3456_fsm 2024-08-20T05:02:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3456_vm 2024-08-20T05:02:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3466 2024-08-20T05:02:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3467 2024-08-20T05:02:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3468 2024-08-20T05:02:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3501 2024-08-20T05:02:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3502 2024-08-20T05:02:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3503 2024-08-20T05:02:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3534 2024-08-20T05:02:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3541 2024-08-20T05:02:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3541_fsm 2024-08-20T05:02:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3541_vm 2024-08-20T05:02:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3542 2024-08-20T05:02:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3574 2024-08-20T05:02:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3575 2024-08-20T05:02:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3576 2024-08-20T05:02:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3596 2024-08-20T05:02:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3597 2024-08-20T05:02:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3598 2024-08-20T05:02:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3599 2024-08-20T05:02:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3600 2024-08-20T05:02:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3600_fsm 2024-08-20T05:02:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3600_vm 2024-08-20T05:02:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3601 2024-08-20T05:02:46.822 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3601_fsm 2024-08-20T05:02:46.822 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3601_vm 2024-08-20T05:02:46.822 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3602 2024-08-20T05:02:46.822 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3602_fsm 2024-08-20T05:02:46.822 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3602_vm 2024-08-20T05:02:46.822 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3603 2024-08-20T05:02:46.822 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3603_fsm 2024-08-20T05:02:46.823 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3603_vm 2024-08-20T05:02:46.823 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3604 2024-08-20T05:02:46.823 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3605 2024-08-20T05:02:46.823 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3606 2024-08-20T05:02:46.823 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3607 2024-08-20T05:02:46.823 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3608 2024-08-20T05:02:46.823 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 3609 2024-08-20T05:02:46.823 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3712 2024-08-20T05:02:46.823 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3764 2024-08-20T05:02:46.823 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3764_fsm 2024-08-20T05:02:46.823 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3764_vm 2024-08-20T05:02:46.823 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3766 2024-08-20T05:02:46.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3767 2024-08-20T05:02:46.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3997 2024-08-20T05:02:46.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4143 2024-08-20T05:02:46.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4144 2024-08-20T05:02:46.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4145 2024-08-20T05:02:46.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4146 2024-08-20T05:02:46.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4147 2024-08-20T05:02:46.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4148 2024-08-20T05:02:46.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4149 2024-08-20T05:02:46.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4150 2024-08-20T05:02:46.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4151 2024-08-20T05:02:46.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4152 2024-08-20T05:02:46.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4153 2024-08-20T05:02:46.824 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4154 2024-08-20T05:02:46.825 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4155 2024-08-20T05:02:46.825 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4156 2024-08-20T05:02:46.825 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4157 2024-08-20T05:02:46.825 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4158 2024-08-20T05:02:46.825 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4159 2024-08-20T05:02:46.825 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4160 2024-08-20T05:02:46.825 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4161 2024-08-20T05:02:46.825 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4162 2024-08-20T05:02:46.825 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4163 2024-08-20T05:02:46.825 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4164 2024-08-20T05:02:46.825 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4165 2024-08-20T05:02:46.826 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4166 2024-08-20T05:02:46.826 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4167 2024-08-20T05:02:46.826 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4168 2024-08-20T05:02:46.826 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4169 2024-08-20T05:02:46.826 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4170 2024-08-20T05:02:46.826 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4171 2024-08-20T05:02:46.827 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4172 2024-08-20T05:02:46.827 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4173 2024-08-20T05:02:46.827 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4174 2024-08-20T05:02:46.827 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 5002 2024-08-20T05:02:46.827 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 548 2024-08-20T05:02:46.827 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 549 2024-08-20T05:02:46.827 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6102 2024-08-20T05:02:46.827 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6104 2024-08-20T05:02:46.827 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6106 2024-08-20T05:02:46.827 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6110 2024-08-20T05:02:46.827 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6111 2024-08-20T05:02:46.827 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6112 2024-08-20T05:02:46.827 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6113 2024-08-20T05:02:46.827 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6117 2024-08-20T05:02:46.827 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 826 2024-08-20T05:02:46.828 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 827 2024-08-20T05:02:46.828 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 828 2024-08-20T05:02:46.828 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 20 05:02 pg_filenode.map 2024-08-20T05:02:46.828 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:02 PG_VERSION 2024-08-20T05:02:46.828 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.828 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-08-20T05:02:46.828 INFO:teuthology.orchestra.run.smithi037.stdout:total 7777 2024-08-20T05:02:46.828 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 20 05:02 . 2024-08-20T05:02:46.828 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:02 .. 2024-08-20T05:02:46.828 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 112 2024-08-20T05:02:46.828 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 113 2024-08-20T05:02:46.828 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 20 05:02 1247 2024-08-20T05:02:46.828 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1247_fsm 2024-08-20T05:02:46.828 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1247_vm 2024-08-20T05:02:46.829 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Aug 20 05:02 1249 2024-08-20T05:02:46.829 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1249_fsm 2024-08-20T05:02:46.829 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1249_vm 2024-08-20T05:02:46.829 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Aug 20 05:02 1255 2024-08-20T05:02:46.829 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1255_fsm 2024-08-20T05:02:46.829 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1255_vm 2024-08-20T05:02:46.829 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 20 05:02 1259 2024-08-20T05:02:46.829 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1259_fsm 2024-08-20T05:02:46.829 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1259_vm 2024-08-20T05:02:46.829 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Aug 20 05:02 13344 2024-08-20T05:02:46.829 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13344_fsm 2024-08-20T05:02:46.829 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13344_vm 2024-08-20T05:02:46.830 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13346 2024-08-20T05:02:46.830 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13348 2024-08-20T05:02:46.830 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13349 2024-08-20T05:02:46.830 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13349_fsm 2024-08-20T05:02:46.830 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13349_vm 2024-08-20T05:02:46.830 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13351 2024-08-20T05:02:46.830 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13353 2024-08-20T05:02:46.830 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13354 2024-08-20T05:02:46.830 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13354_fsm 2024-08-20T05:02:46.831 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13354_vm 2024-08-20T05:02:46.831 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13356 2024-08-20T05:02:46.831 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13358 2024-08-20T05:02:46.831 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13359 2024-08-20T05:02:46.831 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13359_fsm 2024-08-20T05:02:46.831 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13359_vm 2024-08-20T05:02:46.831 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13361 2024-08-20T05:02:46.831 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13363 2024-08-20T05:02:46.831 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 1417 2024-08-20T05:02:46.831 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 1418 2024-08-20T05:02:46.831 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 174 2024-08-20T05:02:46.831 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 175 2024-08-20T05:02:46.831 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2187 2024-08-20T05:02:46.832 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2224 2024-08-20T05:02:46.832 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2328 2024-08-20T05:02:46.832 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2336 2024-08-20T05:02:46.832 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2337 2024-08-20T05:02:46.832 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2579 2024-08-20T05:02:46.832 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2600 2024-08-20T05:02:46.832 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2600_fsm 2024-08-20T05:02:46.832 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2600_vm 2024-08-20T05:02:46.832 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2601 2024-08-20T05:02:46.832 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2601_fsm 2024-08-20T05:02:46.832 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2601_vm 2024-08-20T05:02:46.832 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:02 2602 2024-08-20T05:02:46.832 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2602_fsm 2024-08-20T05:02:46.832 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2602_vm 2024-08-20T05:02:46.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2603 2024-08-20T05:02:46.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2603_fsm 2024-08-20T05:02:46.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2603_vm 2024-08-20T05:02:46.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2604 2024-08-20T05:02:46.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2605 2024-08-20T05:02:46.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2605_fsm 2024-08-20T05:02:46.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2605_vm 2024-08-20T05:02:46.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2606 2024-08-20T05:02:46.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2606_fsm 2024-08-20T05:02:46.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2606_vm 2024-08-20T05:02:46.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2607 2024-08-20T05:02:46.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2607_fsm 2024-08-20T05:02:46.833 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2607_vm 2024-08-20T05:02:46.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Aug 20 05:02 2608 2024-08-20T05:02:46.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2608_fsm 2024-08-20T05:02:46.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2608_vm 2024-08-20T05:02:46.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Aug 20 05:02 2609 2024-08-20T05:02:46.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2609_fsm 2024-08-20T05:02:46.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2609_vm 2024-08-20T05:02:46.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2610 2024-08-20T05:02:46.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2610_fsm 2024-08-20T05:02:46.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2610_vm 2024-08-20T05:02:46.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2611 2024-08-20T05:02:46.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2612 2024-08-20T05:02:46.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2612_fsm 2024-08-20T05:02:46.834 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2612_vm 2024-08-20T05:02:46.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2613 2024-08-20T05:02:46.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2615 2024-08-20T05:02:46.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2615_fsm 2024-08-20T05:02:46.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2615_vm 2024-08-20T05:02:46.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2616 2024-08-20T05:02:46.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2616_fsm 2024-08-20T05:02:46.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2616_vm 2024-08-20T05:02:46.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Aug 20 05:02 2617 2024-08-20T05:02:46.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2617_fsm 2024-08-20T05:02:46.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2617_vm 2024-08-20T05:02:46.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 20 05:02 2618 2024-08-20T05:02:46.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2618_fsm 2024-08-20T05:02:46.835 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2618_vm 2024-08-20T05:02:46.836 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Aug 20 05:02 2619 2024-08-20T05:02:46.836 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2619_fsm 2024-08-20T05:02:46.836 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2619_vm 2024-08-20T05:02:46.836 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2620 2024-08-20T05:02:46.836 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2650 2024-08-20T05:02:46.836 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2651 2024-08-20T05:02:46.836 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2652 2024-08-20T05:02:46.836 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2653 2024-08-20T05:02:46.836 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2654 2024-08-20T05:02:46.836 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2655 2024-08-20T05:02:46.836 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2656 2024-08-20T05:02:46.836 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2657 2024-08-20T05:02:46.836 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 20 05:02 2658 2024-08-20T05:02:46.837 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 20 05:02 2659 2024-08-20T05:02:46.837 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2660 2024-08-20T05:02:46.837 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2661 2024-08-20T05:02:46.837 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2662 2024-08-20T05:02:46.837 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:02 2663 2024-08-20T05:02:46.837 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2664 2024-08-20T05:02:46.837 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2665 2024-08-20T05:02:46.837 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2666 2024-08-20T05:02:46.837 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2667 2024-08-20T05:02:46.837 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2668 2024-08-20T05:02:46.837 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2669 2024-08-20T05:02:46.837 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2670 2024-08-20T05:02:46.837 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Aug 20 05:02 2673 2024-08-20T05:02:46.837 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Aug 20 05:02 2674 2024-08-20T05:02:46.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Aug 20 05:02 2675 2024-08-20T05:02:46.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2678 2024-08-20T05:02:46.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2679 2024-08-20T05:02:46.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2680 2024-08-20T05:02:46.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2681 2024-08-20T05:02:46.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2682 2024-08-20T05:02:46.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2683 2024-08-20T05:02:46.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2684 2024-08-20T05:02:46.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2685 2024-08-20T05:02:46.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2686 2024-08-20T05:02:46.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2687 2024-08-20T05:02:46.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2688 2024-08-20T05:02:46.838 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:02 2689 2024-08-20T05:02:46.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 20 05:02 2690 2024-08-20T05:02:46.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Aug 20 05:02 2691 2024-08-20T05:02:46.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2692 2024-08-20T05:02:46.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2693 2024-08-20T05:02:46.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2696 2024-08-20T05:02:46.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2699 2024-08-20T05:02:46.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2701 2024-08-20T05:02:46.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2702 2024-08-20T05:02:46.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2703 2024-08-20T05:02:46.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2704 2024-08-20T05:02:46.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2753 2024-08-20T05:02:46.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2753_fsm 2024-08-20T05:02:46.839 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2753_vm 2024-08-20T05:02:46.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2754 2024-08-20T05:02:46.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2755 2024-08-20T05:02:46.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2756 2024-08-20T05:02:46.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2757 2024-08-20T05:02:46.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2830 2024-08-20T05:02:46.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2831 2024-08-20T05:02:46.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2832 2024-08-20T05:02:46.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2833 2024-08-20T05:02:46.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2834 2024-08-20T05:02:46.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2835 2024-08-20T05:02:46.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2836 2024-08-20T05:02:46.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2837 2024-08-20T05:02:46.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Aug 20 05:02 2838 2024-08-20T05:02:46.840 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2838_fsm 2024-08-20T05:02:46.841 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2838_vm 2024-08-20T05:02:46.841 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2839 2024-08-20T05:02:46.841 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2840 2024-08-20T05:02:46.841 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2840_fsm 2024-08-20T05:02:46.841 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2840_vm 2024-08-20T05:02:46.841 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2841 2024-08-20T05:02:46.841 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2995 2024-08-20T05:02:46.841 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2996 2024-08-20T05:02:46.841 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3079 2024-08-20T05:02:46.841 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3079_fsm 2024-08-20T05:02:46.841 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3079_vm 2024-08-20T05:02:46.841 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3080 2024-08-20T05:02:46.841 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3081 2024-08-20T05:02:46.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 3085 2024-08-20T05:02:46.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3118 2024-08-20T05:02:46.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3119 2024-08-20T05:02:46.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 20 05:02 3164 2024-08-20T05:02:46.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3256 2024-08-20T05:02:46.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3257 2024-08-20T05:02:46.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3258 2024-08-20T05:02:46.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3350 2024-08-20T05:02:46.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3351 2024-08-20T05:02:46.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3379 2024-08-20T05:02:46.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3380 2024-08-20T05:02:46.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3381 2024-08-20T05:02:46.842 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3394 2024-08-20T05:02:46.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3394_fsm 2024-08-20T05:02:46.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3394_vm 2024-08-20T05:02:46.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3395 2024-08-20T05:02:46.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3429 2024-08-20T05:02:46.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3430 2024-08-20T05:02:46.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3431 2024-08-20T05:02:46.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3433 2024-08-20T05:02:46.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3439 2024-08-20T05:02:46.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3440 2024-08-20T05:02:46.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 3455 2024-08-20T05:02:46.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Aug 20 05:02 3456 2024-08-20T05:02:46.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3456_fsm 2024-08-20T05:02:46.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3456_vm 2024-08-20T05:02:46.843 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3466 2024-08-20T05:02:46.844 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3467 2024-08-20T05:02:46.844 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3468 2024-08-20T05:02:46.844 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3501 2024-08-20T05:02:46.844 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3502 2024-08-20T05:02:46.844 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3503 2024-08-20T05:02:46.844 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3534 2024-08-20T05:02:46.844 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3541 2024-08-20T05:02:46.844 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3541_fsm 2024-08-20T05:02:46.844 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3541_vm 2024-08-20T05:02:46.844 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3542 2024-08-20T05:02:46.844 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3574 2024-08-20T05:02:46.844 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3575 2024-08-20T05:02:46.844 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3576 2024-08-20T05:02:46.844 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3596 2024-08-20T05:02:46.845 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3597 2024-08-20T05:02:46.845 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3598 2024-08-20T05:02:46.845 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3599 2024-08-20T05:02:46.845 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3600 2024-08-20T05:02:46.845 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3600_fsm 2024-08-20T05:02:46.845 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3600_vm 2024-08-20T05:02:46.845 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3601 2024-08-20T05:02:46.845 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3601_fsm 2024-08-20T05:02:46.845 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3601_vm 2024-08-20T05:02:46.845 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3602 2024-08-20T05:02:46.845 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3602_fsm 2024-08-20T05:02:46.845 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3602_vm 2024-08-20T05:02:46.845 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3603 2024-08-20T05:02:46.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3603_fsm 2024-08-20T05:02:46.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3603_vm 2024-08-20T05:02:46.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3604 2024-08-20T05:02:46.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3605 2024-08-20T05:02:46.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3606 2024-08-20T05:02:46.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3607 2024-08-20T05:02:46.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3608 2024-08-20T05:02:46.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 3609 2024-08-20T05:02:46.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3712 2024-08-20T05:02:46.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3764 2024-08-20T05:02:46.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3764_fsm 2024-08-20T05:02:46.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3764_vm 2024-08-20T05:02:46.846 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3766 2024-08-20T05:02:46.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3767 2024-08-20T05:02:46.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3997 2024-08-20T05:02:46.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4143 2024-08-20T05:02:46.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4144 2024-08-20T05:02:46.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4145 2024-08-20T05:02:46.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4146 2024-08-20T05:02:46.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4147 2024-08-20T05:02:46.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4148 2024-08-20T05:02:46.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4149 2024-08-20T05:02:46.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4150 2024-08-20T05:02:46.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4151 2024-08-20T05:02:46.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4152 2024-08-20T05:02:46.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4153 2024-08-20T05:02:46.847 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4154 2024-08-20T05:02:46.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4155 2024-08-20T05:02:46.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4156 2024-08-20T05:02:46.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4157 2024-08-20T05:02:46.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4158 2024-08-20T05:02:46.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4159 2024-08-20T05:02:46.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4160 2024-08-20T05:02:46.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4161 2024-08-20T05:02:46.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4162 2024-08-20T05:02:46.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4163 2024-08-20T05:02:46.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4164 2024-08-20T05:02:46.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4165 2024-08-20T05:02:46.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4166 2024-08-20T05:02:46.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4167 2024-08-20T05:02:46.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4168 2024-08-20T05:02:46.848 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4169 2024-08-20T05:02:46.849 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4170 2024-08-20T05:02:46.849 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4171 2024-08-20T05:02:46.849 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4172 2024-08-20T05:02:46.849 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4173 2024-08-20T05:02:46.849 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4174 2024-08-20T05:02:46.849 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 5002 2024-08-20T05:02:46.849 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 548 2024-08-20T05:02:46.851 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 549 2024-08-20T05:02:46.851 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6102 2024-08-20T05:02:46.851 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6104 2024-08-20T05:02:46.851 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6106 2024-08-20T05:02:46.851 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6110 2024-08-20T05:02:46.851 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6111 2024-08-20T05:02:46.852 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6112 2024-08-20T05:02:46.852 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6113 2024-08-20T05:02:46.852 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6117 2024-08-20T05:02:46.852 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 826 2024-08-20T05:02:46.852 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 827 2024-08-20T05:02:46.852 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 828 2024-08-20T05:02:46.852 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 20 05:02 pg_filenode.map 2024-08-20T05:02:46.852 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:02 PG_VERSION 2024-08-20T05:02:46.852 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.852 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-08-20T05:02:46.852 INFO:teuthology.orchestra.run.smithi037.stdout:total 7777 2024-08-20T05:02:46.852 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 20 05:02 . 2024-08-20T05:02:46.852 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:02 .. 2024-08-20T05:02:46.853 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 112 2024-08-20T05:02:46.853 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 113 2024-08-20T05:02:46.853 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 20 05:02 1247 2024-08-20T05:02:46.853 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1247_fsm 2024-08-20T05:02:46.853 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1247_vm 2024-08-20T05:02:46.853 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Aug 20 05:02 1249 2024-08-20T05:02:46.853 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1249_fsm 2024-08-20T05:02:46.853 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1249_vm 2024-08-20T05:02:46.853 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Aug 20 05:02 1255 2024-08-20T05:02:46.853 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1255_fsm 2024-08-20T05:02:46.853 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1255_vm 2024-08-20T05:02:46.853 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 20 05:02 1259 2024-08-20T05:02:46.853 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1259_fsm 2024-08-20T05:02:46.854 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1259_vm 2024-08-20T05:02:46.854 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Aug 20 05:02 13344 2024-08-20T05:02:46.854 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13344_fsm 2024-08-20T05:02:46.854 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13344_vm 2024-08-20T05:02:46.854 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13346 2024-08-20T05:02:46.854 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13348 2024-08-20T05:02:46.854 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13349 2024-08-20T05:02:46.854 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13349_fsm 2024-08-20T05:02:46.854 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13349_vm 2024-08-20T05:02:46.854 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13351 2024-08-20T05:02:46.854 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13353 2024-08-20T05:02:46.854 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13354 2024-08-20T05:02:46.855 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13354_fsm 2024-08-20T05:02:46.855 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13354_vm 2024-08-20T05:02:46.855 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13356 2024-08-20T05:02:46.855 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13358 2024-08-20T05:02:46.855 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13359 2024-08-20T05:02:46.855 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13359_fsm 2024-08-20T05:02:46.855 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13359_vm 2024-08-20T05:02:46.855 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13361 2024-08-20T05:02:46.855 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13363 2024-08-20T05:02:46.855 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 1417 2024-08-20T05:02:46.855 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 1418 2024-08-20T05:02:46.855 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 174 2024-08-20T05:02:46.855 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 175 2024-08-20T05:02:46.856 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2187 2024-08-20T05:02:46.856 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2224 2024-08-20T05:02:46.856 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2328 2024-08-20T05:02:46.856 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2336 2024-08-20T05:02:46.856 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2337 2024-08-20T05:02:46.856 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2579 2024-08-20T05:02:46.856 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2600 2024-08-20T05:02:46.856 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2600_fsm 2024-08-20T05:02:46.856 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2600_vm 2024-08-20T05:02:46.856 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2601 2024-08-20T05:02:46.856 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2601_fsm 2024-08-20T05:02:46.856 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2601_vm 2024-08-20T05:02:46.856 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:02 2602 2024-08-20T05:02:46.856 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2602_fsm 2024-08-20T05:02:46.857 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2602_vm 2024-08-20T05:02:46.857 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2603 2024-08-20T05:02:46.857 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2603_fsm 2024-08-20T05:02:46.857 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2603_vm 2024-08-20T05:02:46.857 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2604 2024-08-20T05:02:46.857 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2605 2024-08-20T05:02:46.857 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2605_fsm 2024-08-20T05:02:46.857 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2605_vm 2024-08-20T05:02:46.857 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2606 2024-08-20T05:02:46.857 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2606_fsm 2024-08-20T05:02:46.857 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2606_vm 2024-08-20T05:02:46.857 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2607 2024-08-20T05:02:46.857 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2607_fsm 2024-08-20T05:02:46.857 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2607_vm 2024-08-20T05:02:46.857 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Aug 20 05:02 2608 2024-08-20T05:02:46.858 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2608_fsm 2024-08-20T05:02:46.858 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2608_vm 2024-08-20T05:02:46.858 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Aug 20 05:02 2609 2024-08-20T05:02:46.858 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2609_fsm 2024-08-20T05:02:46.858 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2609_vm 2024-08-20T05:02:46.858 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2610 2024-08-20T05:02:46.858 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2610_fsm 2024-08-20T05:02:46.858 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2610_vm 2024-08-20T05:02:46.858 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2611 2024-08-20T05:02:46.858 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2612 2024-08-20T05:02:46.858 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2612_fsm 2024-08-20T05:02:46.858 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2612_vm 2024-08-20T05:02:46.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2613 2024-08-20T05:02:46.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2615 2024-08-20T05:02:46.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2615_fsm 2024-08-20T05:02:46.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2615_vm 2024-08-20T05:02:46.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2616 2024-08-20T05:02:46.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2616_fsm 2024-08-20T05:02:46.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2616_vm 2024-08-20T05:02:46.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Aug 20 05:02 2617 2024-08-20T05:02:46.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2617_fsm 2024-08-20T05:02:46.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2617_vm 2024-08-20T05:02:46.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 20 05:02 2618 2024-08-20T05:02:46.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2618_fsm 2024-08-20T05:02:46.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2618_vm 2024-08-20T05:02:46.859 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Aug 20 05:02 2619 2024-08-20T05:02:46.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2619_fsm 2024-08-20T05:02:46.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2619_vm 2024-08-20T05:02:46.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2620 2024-08-20T05:02:46.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2650 2024-08-20T05:02:46.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2651 2024-08-20T05:02:46.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2652 2024-08-20T05:02:46.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2653 2024-08-20T05:02:46.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2654 2024-08-20T05:02:46.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2655 2024-08-20T05:02:46.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2656 2024-08-20T05:02:46.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2657 2024-08-20T05:02:46.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 20 05:02 2658 2024-08-20T05:02:46.860 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 20 05:02 2659 2024-08-20T05:02:46.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2660 2024-08-20T05:02:46.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2661 2024-08-20T05:02:46.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2662 2024-08-20T05:02:46.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:02 2663 2024-08-20T05:02:46.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2664 2024-08-20T05:02:46.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2665 2024-08-20T05:02:46.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2666 2024-08-20T05:02:46.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2667 2024-08-20T05:02:46.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2668 2024-08-20T05:02:46.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2669 2024-08-20T05:02:46.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2670 2024-08-20T05:02:46.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Aug 20 05:02 2673 2024-08-20T05:02:46.861 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Aug 20 05:02 2674 2024-08-20T05:02:46.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Aug 20 05:02 2675 2024-08-20T05:02:46.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2678 2024-08-20T05:02:46.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2679 2024-08-20T05:02:46.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2680 2024-08-20T05:02:46.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2681 2024-08-20T05:02:46.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2682 2024-08-20T05:02:46.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2683 2024-08-20T05:02:46.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2684 2024-08-20T05:02:46.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2685 2024-08-20T05:02:46.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2686 2024-08-20T05:02:46.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2687 2024-08-20T05:02:46.862 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2688 2024-08-20T05:02:46.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:02 2689 2024-08-20T05:02:46.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 20 05:02 2690 2024-08-20T05:02:46.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Aug 20 05:02 2691 2024-08-20T05:02:46.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2692 2024-08-20T05:02:46.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2693 2024-08-20T05:02:46.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2696 2024-08-20T05:02:46.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2699 2024-08-20T05:02:46.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2701 2024-08-20T05:02:46.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2702 2024-08-20T05:02:46.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2703 2024-08-20T05:02:46.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2704 2024-08-20T05:02:46.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2753 2024-08-20T05:02:46.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2753_fsm 2024-08-20T05:02:46.863 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2753_vm 2024-08-20T05:02:46.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2754 2024-08-20T05:02:46.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2755 2024-08-20T05:02:46.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2756 2024-08-20T05:02:46.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2757 2024-08-20T05:02:46.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2830 2024-08-20T05:02:46.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2831 2024-08-20T05:02:46.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2832 2024-08-20T05:02:46.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2833 2024-08-20T05:02:46.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2834 2024-08-20T05:02:46.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2835 2024-08-20T05:02:46.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2836 2024-08-20T05:02:46.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2837 2024-08-20T05:02:46.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Aug 20 05:02 2838 2024-08-20T05:02:46.864 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2838_fsm 2024-08-20T05:02:46.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2838_vm 2024-08-20T05:02:46.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2839 2024-08-20T05:02:46.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2840 2024-08-20T05:02:46.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2840_fsm 2024-08-20T05:02:46.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2840_vm 2024-08-20T05:02:46.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2841 2024-08-20T05:02:46.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2995 2024-08-20T05:02:46.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2996 2024-08-20T05:02:46.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3079 2024-08-20T05:02:46.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3079_fsm 2024-08-20T05:02:46.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3079_vm 2024-08-20T05:02:46.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3080 2024-08-20T05:02:46.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3081 2024-08-20T05:02:46.865 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 3085 2024-08-20T05:02:46.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3118 2024-08-20T05:02:46.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3119 2024-08-20T05:02:46.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 20 05:02 3164 2024-08-20T05:02:46.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3256 2024-08-20T05:02:46.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3257 2024-08-20T05:02:46.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3258 2024-08-20T05:02:46.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3350 2024-08-20T05:02:46.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3351 2024-08-20T05:02:46.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3379 2024-08-20T05:02:46.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3380 2024-08-20T05:02:46.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3381 2024-08-20T05:02:46.866 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3394 2024-08-20T05:02:46.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3394_fsm 2024-08-20T05:02:46.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3394_vm 2024-08-20T05:02:46.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3395 2024-08-20T05:02:46.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3429 2024-08-20T05:02:46.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3430 2024-08-20T05:02:46.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3431 2024-08-20T05:02:46.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3433 2024-08-20T05:02:46.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3439 2024-08-20T05:02:46.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3440 2024-08-20T05:02:46.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 3455 2024-08-20T05:02:46.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Aug 20 05:02 3456 2024-08-20T05:02:46.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3456_fsm 2024-08-20T05:02:46.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3456_vm 2024-08-20T05:02:46.867 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3466 2024-08-20T05:02:46.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3467 2024-08-20T05:02:46.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3468 2024-08-20T05:02:46.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3501 2024-08-20T05:02:46.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3502 2024-08-20T05:02:46.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3503 2024-08-20T05:02:46.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3534 2024-08-20T05:02:46.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3541 2024-08-20T05:02:46.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3541_fsm 2024-08-20T05:02:46.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3541_vm 2024-08-20T05:02:46.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3542 2024-08-20T05:02:46.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3574 2024-08-20T05:02:46.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3575 2024-08-20T05:02:46.868 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3576 2024-08-20T05:02:46.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3596 2024-08-20T05:02:46.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3597 2024-08-20T05:02:46.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3598 2024-08-20T05:02:46.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3599 2024-08-20T05:02:46.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3600 2024-08-20T05:02:46.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3600_fsm 2024-08-20T05:02:46.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3600_vm 2024-08-20T05:02:46.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3601 2024-08-20T05:02:46.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3601_fsm 2024-08-20T05:02:46.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3601_vm 2024-08-20T05:02:46.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3602 2024-08-20T05:02:46.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3602_fsm 2024-08-20T05:02:46.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3602_vm 2024-08-20T05:02:46.869 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3603 2024-08-20T05:02:46.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3603_fsm 2024-08-20T05:02:46.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3603_vm 2024-08-20T05:02:46.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3604 2024-08-20T05:02:46.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3605 2024-08-20T05:02:46.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3606 2024-08-20T05:02:46.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3607 2024-08-20T05:02:46.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3608 2024-08-20T05:02:46.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 3609 2024-08-20T05:02:46.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3712 2024-08-20T05:02:46.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3764 2024-08-20T05:02:46.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3764_fsm 2024-08-20T05:02:46.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3764_vm 2024-08-20T05:02:46.870 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3766 2024-08-20T05:02:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3767 2024-08-20T05:02:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3997 2024-08-20T05:02:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4143 2024-08-20T05:02:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4144 2024-08-20T05:02:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4145 2024-08-20T05:02:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4146 2024-08-20T05:02:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4147 2024-08-20T05:02:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4148 2024-08-20T05:02:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4149 2024-08-20T05:02:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4150 2024-08-20T05:02:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4151 2024-08-20T05:02:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4152 2024-08-20T05:02:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4153 2024-08-20T05:02:46.871 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4154 2024-08-20T05:02:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4155 2024-08-20T05:02:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4156 2024-08-20T05:02:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4157 2024-08-20T05:02:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4158 2024-08-20T05:02:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4159 2024-08-20T05:02:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4160 2024-08-20T05:02:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4161 2024-08-20T05:02:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4162 2024-08-20T05:02:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4163 2024-08-20T05:02:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4164 2024-08-20T05:02:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4165 2024-08-20T05:02:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4166 2024-08-20T05:02:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4167 2024-08-20T05:02:46.872 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4168 2024-08-20T05:02:46.873 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4169 2024-08-20T05:02:46.873 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4170 2024-08-20T05:02:46.873 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4171 2024-08-20T05:02:46.873 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4172 2024-08-20T05:02:46.873 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4173 2024-08-20T05:02:46.873 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4174 2024-08-20T05:02:46.873 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 5002 2024-08-20T05:02:46.873 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 548 2024-08-20T05:02:46.873 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 549 2024-08-20T05:02:46.873 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6102 2024-08-20T05:02:46.873 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6104 2024-08-20T05:02:46.873 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6106 2024-08-20T05:02:46.873 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6110 2024-08-20T05:02:46.873 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6111 2024-08-20T05:02:46.874 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6112 2024-08-20T05:02:46.874 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6113 2024-08-20T05:02:46.874 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6117 2024-08-20T05:02:46.874 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 826 2024-08-20T05:02:46.874 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 827 2024-08-20T05:02:46.874 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 828 2024-08-20T05:02:46.874 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 20 05:02 pg_filenode.map 2024-08-20T05:02:46.874 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:02 PG_VERSION 2024-08-20T05:02:46.874 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.874 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/global: 2024-08-20T05:02:46.874 INFO:teuthology.orchestra.run.smithi037.stdout:total 537 2024-08-20T05:02:46.875 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 Aug 20 05:02 . 2024-08-20T05:02:46.875 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.875 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1213 2024-08-20T05:02:46.875 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1213_fsm 2024-08-20T05:02:46.875 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1213_vm 2024-08-20T05:02:46.875 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1214 2024-08-20T05:02:46.875 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1214_fsm 2024-08-20T05:02:46.875 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1214_vm 2024-08-20T05:02:46.875 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 1232 2024-08-20T05:02:46.875 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 1233 2024-08-20T05:02:46.875 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1260 2024-08-20T05:02:46.875 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1260_fsm 2024-08-20T05:02:46.875 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1260_vm 2024-08-20T05:02:46.876 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1261 2024-08-20T05:02:46.876 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1261_fsm 2024-08-20T05:02:46.876 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1261_vm 2024-08-20T05:02:46.876 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1262 2024-08-20T05:02:46.876 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1262_fsm 2024-08-20T05:02:46.876 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1262_vm 2024-08-20T05:02:46.876 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2396 2024-08-20T05:02:46.876 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2396_fsm 2024-08-20T05:02:46.876 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2396_vm 2024-08-20T05:02:46.876 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2397 2024-08-20T05:02:46.876 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2671 2024-08-20T05:02:46.876 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2672 2024-08-20T05:02:46.876 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2676 2024-08-20T05:02:46.876 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2677 2024-08-20T05:02:46.877 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2694 2024-08-20T05:02:46.877 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2695 2024-08-20T05:02:46.877 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2697 2024-08-20T05:02:46.877 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2698 2024-08-20T05:02:46.877 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2846 2024-08-20T05:02:46.877 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2847 2024-08-20T05:02:46.877 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2964 2024-08-20T05:02:46.877 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2965 2024-08-20T05:02:46.877 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2966 2024-08-20T05:02:46.877 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2967 2024-08-20T05:02:46.877 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3592 2024-08-20T05:02:46.877 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3593 2024-08-20T05:02:46.877 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4060 2024-08-20T05:02:46.877 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4061 2024-08-20T05:02:46.878 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4175 2024-08-20T05:02:46.878 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4176 2024-08-20T05:02:46.878 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4177 2024-08-20T05:02:46.878 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4178 2024-08-20T05:02:46.878 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4181 2024-08-20T05:02:46.878 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4182 2024-08-20T05:02:46.878 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4183 2024-08-20T05:02:46.878 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4184 2024-08-20T05:02:46.878 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4185 2024-08-20T05:02:46.878 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4186 2024-08-20T05:02:46.878 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6000 2024-08-20T05:02:46.878 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6001 2024-08-20T05:02:46.878 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6002 2024-08-20T05:02:46.879 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6100 2024-08-20T05:02:46.879 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6114 2024-08-20T05:02:46.879 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6115 2024-08-20T05:02:46.879 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 pg_control 2024-08-20T05:02:46.879 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 20 05:02 pg_filenode.map 2024-08-20T05:02:46.879 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.879 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/log: 2024-08-20T05:02:46.879 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:46.879 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:02:46.879 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.879 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.879 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-08-20T05:02:46.879 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:46.879 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:02:46.880 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.880 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.880 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-08-20T05:02:46.880 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:46.880 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:02:46.880 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.880 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.880 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-08-20T05:02:46.880 INFO:teuthology.orchestra.run.smithi037.stdout:total 1 2024-08-20T05:02:46.880 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:02 . 2024-08-20T05:02:46.880 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.880 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 mappings 2024-08-20T05:02:46.880 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Aug 20 05:02 replorigin_checkpoint 2024-08-20T05:02:46.880 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 snapshots 2024-08-20T05:02:46.881 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.881 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-08-20T05:02:46.881 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:46.881 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:02:46.881 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:02 .. 2024-08-20T05:02:46.881 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.881 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-08-20T05:02:46.881 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:46.881 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:02:46.881 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:02 .. 2024-08-20T05:02:46.881 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.881 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-08-20T05:02:46.881 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:46.881 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 20 05:02 . 2024-08-20T05:02:46.881 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.882 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 members 2024-08-20T05:02:46.882 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 offsets 2024-08-20T05:02:46.882 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.882 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-08-20T05:02:46.882 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-08-20T05:02:46.882 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 . 2024-08-20T05:02:46.882 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 20 05:02 .. 2024-08-20T05:02:46.882 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 0000 2024-08-20T05:02:46.882 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.882 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-08-20T05:02:46.882 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-08-20T05:02:46.882 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 . 2024-08-20T05:02:46.882 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 20 05:02 .. 2024-08-20T05:02:46.883 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 0000 2024-08-20T05:02:46.883 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.883 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-08-20T05:02:46.883 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:46.883 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:02:46.883 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.883 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.883 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-08-20T05:02:46.883 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:46.883 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:02:46.883 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.883 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.883 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-08-20T05:02:46.883 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:46.883 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:02:46.884 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.884 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.884 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-08-20T05:02:46.884 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:46.884 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:02:46.884 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.884 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.884 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-08-20T05:02:46.884 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:46.884 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:02:46.884 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.884 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.884 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-08-20T05:02:46.884 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:46.884 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:02:46.885 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.885 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-08-20T05:02:46.885 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-08-20T05:02:46.885 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 . 2024-08-20T05:02:46.885 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.885 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 0000 2024-08-20T05:02:46.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.885 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-08-20T05:02:46.885 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:46.885 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:02:46.885 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.885 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-08-20T05:02:46.885 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:46.885 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:02:46.886 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.886 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.886 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-08-20T05:02:46.886 INFO:teuthology.orchestra.run.smithi037.stdout:total 16384 2024-08-20T05:02:46.886 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 20 05:02 . 2024-08-20T05:02:46.886 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.886 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:02 000000010000000000000001 2024-08-20T05:02:46.886 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 archive_status 2024-08-20T05:02:46.886 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.886 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-08-20T05:02:46.886 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:02:46.886 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:02:46.886 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 20 05:02 .. 2024-08-20T05:02:46.887 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:46.887 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-08-20T05:02:46.887 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-08-20T05:02:46.887 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 . 2024-08-20T05:02:46.887 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 Aug 20 05:02 .. 2024-08-20T05:02:46.887 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 0000 2024-08-20T05:02:46.887 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-08-20T05:02:47.125 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-08-20T05:02:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:dropping old tables... 2024-08-20T05:02:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-08-20T05:02:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-08-20T05:02:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-08-20T05:02:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-08-20T05:02:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:creating tables... 2024-08-20T05:02:47.238 INFO:teuthology.orchestra.run.smithi037.stderr:generating data (client-side)... 2024-08-20T05:02:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.11 s, remaining 3.50 s) 2024-08-20T05:02:47.692 INFO:teuthology.orchestra.run.smithi037.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.42 s, remaining 6.27 s) 2024-08-20T05:02:47.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.372+0000 7fba92000640 1 -- 172.21.15.37:0/1646450723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba8c10cc70 msgr2=0x7fba8c10f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:47.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.372+0000 7fba92000640 1 --2- 172.21.15.37:0/1646450723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba8c10cc70 0x7fba8c10f0d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fba84009be0 tx=0x7fba8402a6c0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.372+0000 7fba92000640 1 -- 172.21.15.37:0/1646450723 shutdown_connections 2024-08-20T05:02:47.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.372+0000 7fba92000640 1 --2- 172.21.15.37:0/1646450723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba8c10cc70 0x7fba8c10f0d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.372+0000 7fba92000640 1 --2- 172.21.15.37:0/1646450723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba8c104130 0x7fba8c10c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.372+0000 7fba92000640 1 --2- 172.21.15.37:0/1646450723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8c103810 0x7fba8c103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.372+0000 7fba92000640 1 -- 172.21.15.37:0/1646450723 >> 172.21.15.37:0/1646450723 conn(0x7fba8c0fd2d0 msgr2=0x7fba8c0ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:47.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.372+0000 7fba92000640 1 -- 172.21.15.37:0/1646450723 shutdown_connections 2024-08-20T05:02:47.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.372+0000 7fba92000640 1 -- 172.21.15.37:0/1646450723 wait complete. 2024-08-20T05:02:47.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.373+0000 7fba92000640 1 Processor -- start 2024-08-20T05:02:47.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.374+0000 7fba92000640 1 -- start start 2024-08-20T05:02:47.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.374+0000 7fba92000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba8c103810 0x7fba8c198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.374+0000 7fba92000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba8c104130 0x7fba8c199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.374+0000 7fba92000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8c10cc70 0x7fba8c19e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.374+0000 7fba92000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c1128e0 con 0x7fba8c103810 2024-08-20T05:02:47.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.374+0000 7fba92000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c112760 con 0x7fba8c10cc70 2024-08-20T05:02:47.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.374+0000 7fba92000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c112a60 con 0x7fba8c104130 2024-08-20T05:02:47.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.374+0000 7fba90c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba8c103810 0x7fba8c198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:47.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.374+0000 7fba8be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba8c104130 0x7fba8c199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:47.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.374+0000 7fba8be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba8c104130 0x7fba8c199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42282/0 (socket says 172.21.15.37:42282) 2024-08-20T05:02:47.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.374+0000 7fba8be00640 1 -- 172.21.15.37:0/1640343444 learned_addr learned my addr 172.21.15.37:0/1640343444 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:47.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.374+0000 7fba91600640 1 --2- 172.21.15.37:0/1640343444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8c10cc70 0x7fba8c19e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:47.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.375+0000 7fba8be00640 1 -- 172.21.15.37:0/1640343444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8c10cc70 msgr2=0x7fba8c19e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:47.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.375+0000 7fba8be00640 1 --2- 172.21.15.37:0/1640343444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8c10cc70 0x7fba8c19e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.375+0000 7fba8be00640 1 -- 172.21.15.37:0/1640343444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba8c103810 msgr2=0x7fba8c198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:47.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.375+0000 7fba8be00640 1 --2- 172.21.15.37:0/1640343444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba8c103810 0x7fba8c198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.375+0000 7fba8be00640 1 -- 172.21.15.37:0/1640343444 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8c19eda0 con 0x7fba8c104130 2024-08-20T05:02:47.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.375+0000 7fba90c00640 1 --2- 172.21.15.37:0/1640343444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba8c103810 0x7fba8c198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:47.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.375+0000 7fba8be00640 1 --2- 172.21.15.37:0/1640343444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba8c104130 0x7fba8c199230 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fba7800e9c0 tx=0x7fba7800ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:47.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.375+0000 7fba89600640 1 -- 172.21.15.37:0/1640343444 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7800cd80 con 0x7fba8c104130 2024-08-20T05:02:47.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.375+0000 7fba89600640 1 -- 172.21.15.37:0/1640343444 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba780108e0 con 0x7fba8c104130 2024-08-20T05:02:47.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.375+0000 7fba92000640 1 -- 172.21.15.37:0/1640343444 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba8c19f090 con 0x7fba8c104130 2024-08-20T05:02:47.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.375+0000 7fba89600640 1 -- 172.21.15.37:0/1640343444 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba780188e0 con 0x7fba8c104130 2024-08-20T05:02:47.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.376+0000 7fba92000640 1 -- 172.21.15.37:0/1640343444 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba8c1a5920 con 0x7fba8c104130 2024-08-20T05:02:47.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.379+0000 7fba9623b740 1 Processor -- start 2024-08-20T05:02:47.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.379+0000 7fba9623b740 1 -- start start 2024-08-20T05:02:47.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.379+0000 7fba9623b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208170 0x558728208550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.379+0000 7fba9623b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208a90 0x5587282144e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.379+0000 7fba9623b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728214a20 0x558728216e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.379+0000 7fba9623b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55872817e840 con 0x558728214a20 2024-08-20T05:02:47.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.379+0000 7fba9623b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55872816dd40 con 0x558728208170 2024-08-20T05:02:47.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.379+0000 7fba9623b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558728171d80 con 0x558728208a90 2024-08-20T05:02:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.379+0000 7fba91600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208170 0x558728208550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.379+0000 7fba91600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208170 0x558728208550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33838/0 (socket says 172.21.15.37:33838) 2024-08-20T05:02:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.379+0000 7fba91600640 1 -- 172.21.15.37:0/3625127712 learned_addr learned my addr 172.21.15.37:0/3625127712 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.379+0000 7fba90c00640 1 --2- 172.21.15.37:0/3625127712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208a90 0x5587282144e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.380+0000 7fba89600640 1 -- 172.21.15.37:0/1640343444 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fba7801f020 con 0x7fba8c104130 2024-08-20T05:02:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.380+0000 7fba91600640 1 -- 172.21.15.37:0/3625127712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208a90 msgr2=0x5587282144e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.380+0000 7fba91600640 1 --2- 172.21.15.37:0/3625127712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208a90 0x5587282144e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.380+0000 7fba91600640 1 -- 172.21.15.37:0/3625127712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728214a20 msgr2=0x558728216e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:02:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.380+0000 7fba91600640 1 --2- 172.21.15.37:0/3625127712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728214a20 0x558728216e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.380+0000 7fba91600640 1 -- 172.21.15.37:0/3625127712 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587281141c0 con 0x558728208170 2024-08-20T05:02:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.380+0000 7fba91600640 1 --2- 172.21.15.37:0/3625127712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208170 0x558728208550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fba84009be0 tx=0x7fba84030430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c33c0003a35d2443 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:47.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.381+0000 7fba7dc00640 1 -- 172.21.15.37:0/3625127712 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84041030 con 0x558728208170 2024-08-20T05:02:47.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.381+0000 7fba7dc00640 1 -- 172.21.15.37:0/3625127712 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba84003e20 con 0x558728208170 2024-08-20T05:02:47.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.381+0000 7fba7dc00640 1 -- 172.21.15.37:0/3625127712 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84036040 con 0x558728208170 2024-08-20T05:02:47.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.382+0000 7fba9623b740 1 -- 172.21.15.37:0/3625127712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208170 msgr2=0x558728208550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:47.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.382+0000 7fba9623b740 1 --2- 172.21.15.37:0/3625127712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208170 0x558728208550 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fba84009be0 tx=0x7fba84030430 comp rx=0 tx=0).stop 2024-08-20T05:02:47.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.382+0000 7fba9623b740 1 -- 172.21.15.37:0/3625127712 shutdown_connections 2024-08-20T05:02:47.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.382+0000 7fba9623b740 1 --2- 172.21.15.37:0/3625127712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728214a20 0x558728216e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.382+0000 7fba9623b740 1 --2- 172.21.15.37:0/3625127712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208a90 0x5587282144e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.382+0000 7fba9623b740 1 --2- 172.21.15.37:0/3625127712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208170 0x558728208550 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.382+0000 7fba9623b740 1 -- 172.21.15.37:0/3625127712 >> 172.21.15.37:0/3625127712 conn(0x558728205fa0 msgr2=0x558728207140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:47.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.382+0000 7fba9623b740 1 -- 172.21.15.37:0/3625127712 shutdown_connections 2024-08-20T05:02:47.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.382+0000 7fba9623b740 1 -- 172.21.15.37:0/3625127712 wait complete. 2024-08-20T05:02:47.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.382+0000 7fba89600640 1 --2- 172.21.15.37:0/1640343444 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fba740b3c00 0x7fba740b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.382+0000 7fba89600640 1 -- 172.21.15.37:0/1640343444 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fba780e3ee0 con 0x7fba8c104130 2024-08-20T05:02:47.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.382+0000 7fba9623b740 1 -- start start 2024-08-20T05:02:47.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.383+0000 7fba90c00640 1 --2- 172.21.15.37:0/1640343444 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fba740b3c00 0x7fba740b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:47.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.383+0000 7fba9623b740 1 Processor -- start 2024-08-20T05:02:47.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.383+0000 7fba90c00640 1 --2- 172.21.15.37:0/1640343444 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fba740b3c00 0x7fba740b60c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55872820b2f0 tx=0x7fba80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:47.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.383+0000 7fba9623b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728208170 0x5587282141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.383+0000 7fba9623b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208a90 0x5587282115f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.383+0000 7fba9623b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728214a20 0x558728211b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.383+0000 7fba9623b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558727fd05f0 con 0x558728208170 2024-08-20T05:02:47.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.383+0000 7fba9623b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558728109170 con 0x558728214a20 2024-08-20T05:02:47.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.383+0000 7fba9623b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558728217670 con 0x558728208a90 2024-08-20T05:02:47.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.383+0000 7fba9623b740 10 client.0 _ll_register_callbacks cb 0x5587281688b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:47.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.384+0000 7fba90c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728208170 0x5587282141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:47.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.384+0000 7fba91600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728214a20 0x558728211b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:47.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.384+0000 7fba91600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728214a20 0x558728211b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33850/0 (socket says 172.21.15.37:33850) 2024-08-20T05:02:47.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.384+0000 7fba91600640 1 -- 172.21.15.37:0/3295670930 learned_addr learned my addr 172.21.15.37:0/3295670930 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:47.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.384+0000 7fba8be00640 1 --2- 172.21.15.37:0/3295670930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208a90 0x5587282115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:47.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.384+0000 7fba91600640 1 -- 172.21.15.37:0/3295670930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208a90 msgr2=0x5587282115f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:47.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.384+0000 7fba91600640 1 --2- 172.21.15.37:0/3295670930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208a90 0x5587282115f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.384+0000 7fba91600640 1 -- 172.21.15.37:0/3295670930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728208170 msgr2=0x5587282141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:47.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.384+0000 7fba91600640 1 --2- 172.21.15.37:0/3295670930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728208170 0x5587282141a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.384+0000 7fba91600640 1 -- 172.21.15.37:0/3295670930 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558727ecd540 con 0x558728214a20 2024-08-20T05:02:47.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.384+0000 7fba91600640 1 --2- 172.21.15.37:0/3295670930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728214a20 0x558728211b30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fba84030cb0 tx=0x7fba84030af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=187a18068d96a023 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:47.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.384+0000 7fba72000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:02:47.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.385+0000 7fba72000640 1 -- 172.21.15.37:0/3295670930 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84041040 con 0x558728214a20 2024-08-20T05:02:47.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.385+0000 7fba9623b740 1 -- 172.21.15.37:0/3295670930 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba84003e20 con 0x558728214a20 2024-08-20T05:02:47.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.385+0000 7fba72000640 1 -- 172.21.15.37:0/3295670930 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fba84003970 con 0x558728214a20 2024-08-20T05:02:47.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.385+0000 7fba72000640 1 -- 172.21.15.37:0/3295670930 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fba84036040 con 0x558728214a20 2024-08-20T05:02:47.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.385+0000 7fba9623b740 10 client.25625 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:47.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.385+0000 7fba9623b740 1 -- 172.21.15.37:0/3295670930 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558728227280 con 0x558728214a20 2024-08-20T05:02:47.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.385+0000 7fba72000640 1 -- 172.21.15.37:0/3295670930 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba84003e20 con 0x558728214a20 2024-08-20T05:02:47.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.386+0000 7fba72000640 1 -- 172.21.15.37:0/3295670930 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fba8403d460 con 0x558728214a20 2024-08-20T05:02:47.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.386+0000 7fba9623b740 10 client.25625 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:47.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.386+0000 7fba9623b740 10 client.25625 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-20T05:02:47.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.386+0000 7fba9623b740 20 client.25625 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:47.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.386+0000 7fba9623b740 1 --2- 172.21.15.37:0/3295670930 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5587282293f0 0x55872822a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.386+0000 7fba9623b740 4 client.25625 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:02:47.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.386+0000 7fba9623b740 1 -- 172.21.15.37:0/3295670930 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558728180790 con 0x5587282293f0 2024-08-20T05:02:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.386+0000 7fba90c00640 1 --2- 172.21.15.37:0/3295670930 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5587282293f0 0x55872822a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.387+0000 7fba90c00640 1 --2- 172.21.15.37:0/3295670930 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5587282293f0 0x55872822a860 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23caa3f70a7b7269 server_cookie=afc7208c3539cdf6 in_seq=0 out_seq=0 2024-08-20T05:02:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.387+0000 7fba72000640 10 client.25625 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.387+0000 7fba72000640 1 -- 172.21.15.37:0/3295670930 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558728180790 con 0x5587282293f0 2024-08-20T05:02:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.387+0000 7fba72000640 10 client.25625 handle_command_reply: tid=0 2024-08-20T05:02:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.387+0000 7fba9623b740 1 client.25625 shutdown 2024-08-20T05:02:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.388+0000 7fba9623b740 1 -- 172.21.15.37:0/3295670930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728214a20 msgr2=0x558728211b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.388+0000 7fba9623b740 1 --2- 172.21.15.37:0/3295670930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728214a20 0x558728211b30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fba84030cb0 tx=0x7fba84030af0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.388+0000 7fba9623b740 1 -- 172.21.15.37:0/3295670930 shutdown_connections 2024-08-20T05:02:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.388+0000 7fba9623b740 1 --2- 172.21.15.37:0/3295670930 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5587282293f0 0x55872822a860 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.388+0000 7fba9623b740 1 --2- 172.21.15.37:0/3295670930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728214a20 0x558728211b30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.388+0000 7fba9623b740 1 --2- 172.21.15.37:0/3295670930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208a90 0x5587282115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.388+0000 7fba9623b740 1 --2- 172.21.15.37:0/3295670930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728208170 0x5587282141a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.388+0000 7fba72000640 0 client.25625 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:47.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.388+0000 7fba9623b740 1 -- 172.21.15.37:0/3295670930 >> 172.21.15.37:0/3295670930 conn(0x558728205fa0 msgr2=0x55872820bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:47.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.388+0000 7fba9623b740 1 -- 172.21.15.37:0/3295670930 shutdown_connections 2024-08-20T05:02:47.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.388+0000 7fba9623b740 1 -- 172.21.15.37:0/3295670930 wait complete. 2024-08-20T05:02:47.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.388+0000 7fba9623b740 20 client.25625 trim_cache size 0 max 16384 2024-08-20T05:02:47.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.407+0000 7fba9623b740 1 Processor -- start 2024-08-20T05:02:47.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.407+0000 7fba9623b740 1 -- start start 2024-08-20T05:02:47.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.408+0000 7fba9623b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208170 0x558728229ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.408+0000 7fba9623b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208a90 0x558728211bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.408+0000 7fba9623b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728214a20 0x55872820caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.408+0000 7fba9623b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558728228ba0 con 0x558728214a20 2024-08-20T05:02:47.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.408+0000 7fba9623b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558728229270 con 0x558728208a90 2024-08-20T05:02:47.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.408+0000 7fba9623b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558728229940 con 0x558728208170 2024-08-20T05:02:47.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.408+0000 7fba8be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208a90 0x558728211bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:47.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.408+0000 7fba90c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208170 0x558728229ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:47.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.408+0000 7fba8be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208a90 0x558728211bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33864/0 (socket says 172.21.15.37:33864) 2024-08-20T05:02:47.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.408+0000 7fba90c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208170 0x558728229ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42302/0 (socket says 172.21.15.37:42302) 2024-08-20T05:02:47.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.408+0000 7fba8be00640 1 -- 172.21.15.37:0/3483685647 learned_addr learned my addr 172.21.15.37:0/3483685647 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:47.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.408+0000 7fba91600640 1 --2- 172.21.15.37:0/3483685647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728214a20 0x55872820caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:47.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.408+0000 7fba8be00640 1 -- 172.21.15.37:0/3483685647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208170 msgr2=0x558728229ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:47.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.408+0000 7fba8be00640 1 --2- 172.21.15.37:0/3483685647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208170 0x558728229ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.408+0000 7fba8be00640 1 -- 172.21.15.37:0/3483685647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728214a20 msgr2=0x55872820caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:47.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.408+0000 7fba8be00640 1 --2- 172.21.15.37:0/3483685647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728214a20 0x55872820caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.409+0000 7fba8be00640 1 -- 172.21.15.37:0/3483685647 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558728206a20 con 0x558728208a90 2024-08-20T05:02:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.409+0000 7fba8be00640 1 --2- 172.21.15.37:0/3483685647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208a90 0x558728211bc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fba78004770 tx=0x7fba780046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6bbc2d246fa7eeb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.409+0000 7fba7d200640 1 -- 172.21.15.37:0/3483685647 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba780b3430 con 0x558728208a90 2024-08-20T05:02:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.409+0000 7fba7d200640 1 -- 172.21.15.37:0/3483685647 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba780aaa30 con 0x558728208a90 2024-08-20T05:02:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.409+0000 7fba7d200640 1 -- 172.21.15.37:0/3483685647 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba780920e0 con 0x558728208a90 2024-08-20T05:02:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.410+0000 7fba9623b740 1 -- 172.21.15.37:0/3483685647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208a90 msgr2=0x558728211bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.410+0000 7fba9623b740 1 --2- 172.21.15.37:0/3483685647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208a90 0x558728211bc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fba78004770 tx=0x7fba780046c0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.410+0000 7fba9623b740 1 -- 172.21.15.37:0/3483685647 shutdown_connections 2024-08-20T05:02:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.410+0000 7fba9623b740 1 --2- 172.21.15.37:0/3483685647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728214a20 0x55872820caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.410+0000 7fba9623b740 1 --2- 172.21.15.37:0/3483685647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208a90 0x558728211bc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.410+0000 7fba9623b740 1 --2- 172.21.15.37:0/3483685647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208170 0x558728229ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.410+0000 7fba9623b740 1 -- 172.21.15.37:0/3483685647 >> 172.21.15.37:0/3483685647 conn(0x558728205fa0 msgr2=0x55872820c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.410+0000 7fba9623b740 1 -- 172.21.15.37:0/3483685647 shutdown_connections 2024-08-20T05:02:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.410+0000 7fba9623b740 1 -- 172.21.15.37:0/3483685647 wait complete. 2024-08-20T05:02:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.410+0000 7fba9623b740 1 -- start start 2024-08-20T05:02:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.410+0000 7fba9623b740 1 Processor -- start 2024-08-20T05:02:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.411+0000 7fba9623b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208170 0x558728233000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.411+0000 7fba9623b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208a90 0x55872820bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.411+0000 7fba9623b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728214a20 0x55872820c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.411+0000 7fba9623b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55872822a6e0 con 0x558728214a20 2024-08-20T05:02:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.411+0000 7fba9623b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55872822a010 con 0x558728208170 2024-08-20T05:02:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.411+0000 7fba9623b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55872822adb0 con 0x558728208a90 2024-08-20T05:02:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.411+0000 7fba9623b740 10 client.0 _ll_register_callbacks cb 0x7fba80009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.411+0000 7fba90c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208170 0x558728233000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.411+0000 7fba90c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208170 0x558728233000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33866/0 (socket says 172.21.15.37:33866) 2024-08-20T05:02:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.411+0000 7fba90c00640 1 -- 172.21.15.37:0/1514462386 learned_addr learned my addr 172.21.15.37:0/1514462386 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.411+0000 7fba91600640 1 --2- 172.21.15.37:0/1514462386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728214a20 0x55872820c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.411+0000 7fba8be00640 1 --2- 172.21.15.37:0/1514462386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208a90 0x55872820bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.412+0000 7fba90c00640 1 -- 172.21.15.37:0/1514462386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208a90 msgr2=0x55872820bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.412+0000 7fba90c00640 1 --2- 172.21.15.37:0/1514462386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208a90 0x55872820bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.412+0000 7fba90c00640 1 -- 172.21.15.37:0/1514462386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728214a20 msgr2=0x55872820c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.412+0000 7fba90c00640 1 --2- 172.21.15.37:0/1514462386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728214a20 0x55872820c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.412+0000 7fba90c00640 1 -- 172.21.15.37:0/1514462386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55872820c940 con 0x558728208170 2024-08-20T05:02:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.412+0000 7fba90c00640 1 --2- 172.21.15.37:0/1514462386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208170 0x558728233000 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fba80012dc0 tx=0x7fba800046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeb67f7ee401981d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.412+0000 7fba72000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:02:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.412+0000 7fba72000640 1 -- 172.21.15.37:0/1514462386 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba80003e50 con 0x558728208170 2024-08-20T05:02:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.412+0000 7fba72000640 1 -- 172.21.15.37:0/1514462386 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fba8002b380 con 0x558728208170 2024-08-20T05:02:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.412+0000 7fba9623b740 1 -- 172.21.15.37:0/1514462386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba780aaa30 con 0x558728208170 2024-08-20T05:02:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.412+0000 7fba72000640 1 -- 172.21.15.37:0/1514462386 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fba8003c050 con 0x558728208170 2024-08-20T05:02:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.412+0000 7fba9623b740 10 client.25631 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.412+0000 7fba9623b740 1 -- 172.21.15.37:0/1514462386 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558728293b00 con 0x558728208170 2024-08-20T05:02:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.413+0000 7fba72000640 1 -- 172.21.15.37:0/1514462386 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba780aaa30 con 0x558728208170 2024-08-20T05:02:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.413+0000 7fba72000640 1 -- 172.21.15.37:0/1514462386 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fba8000f8c0 con 0x558728208170 2024-08-20T05:02:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.413+0000 7fba9623b740 10 client.25631 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.413+0000 7fba9623b740 10 client.25631 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-20T05:02:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.413+0000 7fba9623b740 20 client.25631 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.413+0000 7fba9623b740 1 --2- 172.21.15.37:0/1514462386 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5587282985e0 0x5587282972f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.413+0000 7fba9623b740 4 client.25631 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-20T05:02:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.413+0000 7fba9623b740 1 -- 172.21.15.37:0/1514462386 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "status"}) -- 0x55872817c230 con 0x5587282985e0 2024-08-20T05:02:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.413+0000 7fba8be00640 1 --2- 172.21.15.37:0/1514462386 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5587282985e0 0x5587282972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.414+0000 7fba8be00640 1 --2- 172.21.15.37:0/1514462386 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5587282985e0 0x5587282972f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=842073944c8877da server_cookie=d56cee846f8e2b36 in_seq=0 out_seq=0 2024-08-20T05:02:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.414+0000 7fba72000640 10 client.25631 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.414+0000 7fba72000640 1 -- 172.21.15.37:0/1514462386 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55872817c230 con 0x5587282985e0 2024-08-20T05:02:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.414+0000 7fba72000640 10 client.25631 handle_command_reply: tid=0 2024-08-20T05:02:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.414+0000 7fba9623b740 1 client.25631 shutdown 2024-08-20T05:02:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.414+0000 7fba9623b740 1 -- 172.21.15.37:0/1514462386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208170 msgr2=0x558728233000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.414+0000 7fba9623b740 1 --2- 172.21.15.37:0/1514462386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208170 0x558728233000 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fba80012dc0 tx=0x7fba800046c0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.414+0000 7fba9623b740 1 -- 172.21.15.37:0/1514462386 shutdown_connections 2024-08-20T05:02:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.414+0000 7fba9623b740 1 --2- 172.21.15.37:0/1514462386 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5587282985e0 0x5587282972f0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.414+0000 7fba9623b740 1 --2- 172.21.15.37:0/1514462386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558728214a20 0x55872820c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.414+0000 7fba9623b740 1 --2- 172.21.15.37:0/1514462386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558728208a90 0x55872820bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.414+0000 7fba72000640 0 client.25631 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.414+0000 7fba9623b740 1 --2- 172.21.15.37:0/1514462386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558728208170 0x558728233000 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.414+0000 7fba9623b740 1 -- 172.21.15.37:0/1514462386 >> 172.21.15.37:0/1514462386 conn(0x558728205fa0 msgr2=0x558728205060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.414+0000 7fba9623b740 1 -- 172.21.15.37:0/1514462386 shutdown_connections 2024-08-20T05:02:47.869 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:02:47.869 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "93c5cea6-5eaf-11ef-bccf-c7b262605968", 2024-08-20T05:02:47.869 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2024-08-20T05:02:47.869 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 24695, 2024-08-20T05:02:47.869 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2024-08-20T05:02:47.869 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2024-08-20T05:02:47.869 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2024-08-20T05:02:47.869 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 212.63601593199999, 2024-08-20T05:02:47.869 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 29, 2024-08-20T05:02:47.870 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 88, 2024-08-20T05:02:47.870 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 88, 2024-08-20T05:02:47.870 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 226.158062425 2024-08-20T05:02:47.870 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:02:47.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.415+0000 7fba9623b740 1 -- 172.21.15.37:0/1514462386 wait complete. 2024-08-20T05:02:47.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.415+0000 7fba9623b740 20 client.25631 trim_cache size 0 max 16384 2024-08-20T05:02:47.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.415+0000 7fba92000640 1 -- 172.21.15.37:0/1640343444 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fba740b3c00 msgr2=0x7fba740b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:47.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.415+0000 7fba92000640 1 --2- 172.21.15.37:0/1640343444 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fba740b3c00 0x7fba740b60c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x55872820b2f0 tx=0x7fba80005f90 comp rx=0 tx=0).stop 2024-08-20T05:02:47.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.415+0000 7fba92000640 1 -- 172.21.15.37:0/1640343444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba8c104130 msgr2=0x7fba8c199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:47.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.415+0000 7fba92000640 1 --2- 172.21.15.37:0/1640343444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba8c104130 0x7fba8c199230 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fba7800e9c0 tx=0x7fba7800ee80 comp rx=0 tx=0).stop 2024-08-20T05:02:47.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.416+0000 7fba92000640 1 -- 172.21.15.37:0/1640343444 shutdown_connections 2024-08-20T05:02:47.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.416+0000 7fba92000640 1 --2- 172.21.15.37:0/1640343444 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fba740b3c00 0x7fba740b60c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.416+0000 7fba92000640 1 --2- 172.21.15.37:0/1640343444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fba8c10cc70 0x7fba8c19e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.416+0000 7fba92000640 1 --2- 172.21.15.37:0/1640343444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fba8c104130 0x7fba8c199230 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.416+0000 7fba92000640 1 --2- 172.21.15.37:0/1640343444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba8c103810 0x7fba8c198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:47.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.416+0000 7fba92000640 1 -- 172.21.15.37:0/1640343444 >> 172.21.15.37:0/1640343444 conn(0x7fba8c0fd2d0 msgr2=0x7fba8c10ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:47.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.416+0000 7fba92000640 1 -- 172.21.15.37:0/1640343444 shutdown_connections 2024-08-20T05:02:47.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:47.416+0000 7fba92000640 1 -- 172.21.15.37:0/1640343444 wait complete. 2024-08-20T05:02:47.872 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:47 smithi037 ceph-mon[17265]: pgmap v417: 129 pgs: 129 active+clean; 26 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 2.1 MiB/s wr, 49 op/s 2024-08-20T05:02:47.873 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:47 smithi135 ceph-mon[22342]: pgmap v417: 129 pgs: 129 active+clean; 26 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 2.1 MiB/s wr, 49 op/s 2024-08-20T05:02:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:47 smithi130 ceph-mon[22007]: pgmap v417: 129 pgs: 129 active+clean; 26 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 2.1 MiB/s wr, 49 op/s 2024-08-20T05:02:47.975 INFO:teuthology.orchestra.run.smithi037.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.70 s, remaining 6.77 s) 2024-08-20T05:02:48.123 INFO:teuthology.orchestra.run.smithi037.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.85 s, remaining 5.94 s) 2024-08-20T05:02:48.341 INFO:teuthology.orchestra.run.smithi037.stderr:500000 of 3200000 tuples (15%) done (elapsed 1.07 s, remaining 5.76 s) 2024-08-20T05:02:48.517 INFO:teuthology.orchestra.run.smithi037.stderr:600000 of 3200000 tuples (18%) done (elapsed 1.24 s, remaining 5.38 s) 2024-08-20T05:02:48.684 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-08-20T05:02:48.775 INFO:teuthology.orchestra.run.smithi037.stderr:700000 of 3200000 tuples (21%) done (elapsed 1.50 s, remaining 5.36 s) 2024-08-20T05:02:49.068 INFO:teuthology.orchestra.run.smithi037.stderr:800000 of 3200000 tuples (25%) done (elapsed 1.79 s, remaining 5.38 s) 2024-08-20T05:02:49.249 INFO:teuthology.orchestra.run.smithi037.stderr:900000 of 3200000 tuples (28%) done (elapsed 1.97 s, remaining 5.05 s) 2024-08-20T05:02:49.546 INFO:teuthology.orchestra.run.smithi037.stderr:1000000 of 3200000 tuples (31%) done (elapsed 2.27 s, remaining 5.00 s) 2024-08-20T05:02:49.812 INFO:teuthology.orchestra.run.smithi037.stderr:1100000 of 3200000 tuples (34%) done (elapsed 2.54 s, remaining 4.84 s) 2024-08-20T05:02:49.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:49 smithi135 ceph-mon[22342]: pgmap v418: 129 pgs: 129 active+clean; 39 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 3.2 MiB/s wr, 105 op/s 2024-08-20T05:02:49.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:49 smithi130 ceph-mon[22007]: pgmap v418: 129 pgs: 129 active+clean; 39 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 3.2 MiB/s wr, 105 op/s 2024-08-20T05:02:49.979 INFO:teuthology.orchestra.run.smithi037.stderr:1200000 of 3200000 tuples (37%) done (elapsed 2.70 s, remaining 4.51 s) 2024-08-20T05:02:50.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:49 smithi037 ceph-mon[17265]: pgmap v418: 129 pgs: 129 active+clean; 39 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 3.2 MiB/s wr, 105 op/s 2024-08-20T05:02:50.179 INFO:teuthology.orchestra.run.smithi037.stderr:1300000 of 3200000 tuples (40%) done (elapsed 2.90 s, remaining 4.24 s) 2024-08-20T05:02:50.349 INFO:teuthology.orchestra.run.smithi037.stderr:1400000 of 3200000 tuples (43%) done (elapsed 3.07 s, remaining 3.95 s) 2024-08-20T05:02:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:1500000 of 3200000 tuples (46%) done (elapsed 3.31 s, remaining 3.75 s) 2024-08-20T05:02:50.849 INFO:teuthology.orchestra.run.smithi037.stderr:1600000 of 3200000 tuples (50%) done (elapsed 3.57 s, remaining 3.57 s) 2024-08-20T05:02:51.017 INFO:teuthology.orchestra.run.smithi037.stderr:1700000 of 3200000 tuples (53%) done (elapsed 3.74 s, remaining 3.30 s) 2024-08-20T05:02:51.289 INFO:teuthology.orchestra.run.smithi037.stderr:1800000 of 3200000 tuples (56%) done (elapsed 4.01 s, remaining 3.12 s) 2024-08-20T05:02:51.589 INFO:teuthology.orchestra.run.smithi037.stderr:1900000 of 3200000 tuples (59%) done (elapsed 4.31 s, remaining 2.95 s) 2024-08-20T05:02:51.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:51 smithi135 ceph-mon[22342]: pgmap v419: 129 pgs: 129 active+clean; 93 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 11 MiB/s wr, 310 op/s 2024-08-20T05:02:51.869 INFO:teuthology.orchestra.run.smithi037.stderr:2000000 of 3200000 tuples (62%) done (elapsed 4.59 s, remaining 2.76 s) 2024-08-20T05:02:51.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:51 smithi130 ceph-mon[22007]: pgmap v419: 129 pgs: 129 active+clean; 93 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 11 MiB/s wr, 310 op/s 2024-08-20T05:02:51.956 INFO:teuthology.orchestra.run.smithi037.stderr:2100000 of 3200000 tuples (65%) done (elapsed 4.68 s, remaining 2.45 s) 2024-08-20T05:02:52.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:51 smithi037 ceph-mon[17265]: pgmap v419: 129 pgs: 129 active+clean; 93 MiB data, 501 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 11 MiB/s wr, 310 op/s 2024-08-20T05:02:52.364 INFO:teuthology.orchestra.run.smithi037.stderr:2200000 of 3200000 tuples (68%) done (elapsed 5.09 s, remaining 2.31 s) 2024-08-20T05:02:52.459 INFO:teuthology.orchestra.run.smithi037.stderr:2300000 of 3200000 tuples (71%) done (elapsed 5.18 s, remaining 2.03 s) 2024-08-20T05:02:52.717 INFO:teuthology.orchestra.run.smithi037.stderr:2400000 of 3200000 tuples (75%) done (elapsed 5.44 s, remaining 1.81 s) 2024-08-20T05:02:52.980 INFO:teuthology.orchestra.run.smithi037.stderr:2500000 of 3200000 tuples (78%) done (elapsed 5.71 s, remaining 1.60 s) 2024-08-20T05:02:53.143 INFO:teuthology.orchestra.run.smithi037.stderr:2600000 of 3200000 tuples (81%) done (elapsed 5.87 s, remaining 1.35 s) 2024-08-20T05:02:53.438 INFO:teuthology.orchestra.run.smithi037.stderr:2700000 of 3200000 tuples (84%) done (elapsed 6.16 s, remaining 1.14 s) 2024-08-20T05:02:53.743 INFO:teuthology.orchestra.run.smithi037.stderr:2800000 of 3200000 tuples (87%) done (elapsed 6.47 s, remaining 0.92 s) 2024-08-20T05:02:53.834 INFO:teuthology.orchestra.run.smithi037.stderr:2900000 of 3200000 tuples (90%) done (elapsed 6.56 s, remaining 0.68 s) 2024-08-20T05:02:53.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:53 smithi135 ceph-mon[22342]: pgmap v420: 129 pgs: 129 active+clean; 136 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 17 MiB/s wr, 352 op/s 2024-08-20T05:02:53.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:02:53.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:53 smithi130 ceph-mon[22007]: pgmap v420: 129 pgs: 129 active+clean; 136 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 17 MiB/s wr, 352 op/s 2024-08-20T05:02:53.970 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:53 smithi037 ceph-mon[17265]: pgmap v420: 129 pgs: 129 active+clean; 136 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 17 MiB/s wr, 352 op/s 2024-08-20T05:02:54.218 INFO:teuthology.orchestra.run.smithi037.stderr:3000000 of 3200000 tuples (93%) done (elapsed 6.94 s, remaining 0.46 s) 2024-08-20T05:02:54.381 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:54.546 INFO:teuthology.orchestra.run.smithi037.stderr:3100000 of 3200000 tuples (96%) done (elapsed 7.27 s, remaining 0.23 s) 2024-08-20T05:02:54.645 INFO:teuthology.orchestra.run.smithi037.stderr:3200000 of 3200000 tuples (100%) done (elapsed 7.37 s, remaining 0.00 s) 2024-08-20T05:02:54.725 INFO:teuthology.orchestra.run.smithi037.stderr:vacuuming... 2024-08-20T05:02:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.012+0000 7fa83f000640 1 -- 172.21.15.37:0/3759200805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa838075b10 msgr2=0x7fa83810eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.012+0000 7fa83f000640 1 --2- 172.21.15.37:0/3759200805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa838075b10 0x7fa83810eb80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa820009860 tx=0x7fa82002a340 comp rx=0 tx=0).stop 2024-08-20T05:02:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.012+0000 7fa83f000640 1 -- 172.21.15.37:0/3759200805 shutdown_connections 2024-08-20T05:02:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.012+0000 7fa83f000640 1 --2- 172.21.15.37:0/3759200805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa83810f0c0 0x7fa8381114b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.012+0000 7fa83f000640 1 --2- 172.21.15.37:0/3759200805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa838075b10 0x7fa83810eb80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.012+0000 7fa83f000640 1 --2- 172.21.15.37:0/3759200805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8380751f0 0x7fa8380755d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.012+0000 7fa83f000640 1 -- 172.21.15.37:0/3759200805 >> 172.21.15.37:0/3759200805 conn(0x7fa8380fe500 msgr2=0x7fa838100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.012+0000 7fa83f000640 1 -- 172.21.15.37:0/3759200805 shutdown_connections 2024-08-20T05:02:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.012+0000 7fa83f000640 1 -- 172.21.15.37:0/3759200805 wait complete. 2024-08-20T05:02:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.013+0000 7fa83f000640 1 Processor -- start 2024-08-20T05:02:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.013+0000 7fa83f000640 1 -- start start 2024-08-20T05:02:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.013+0000 7fa83f000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8380751f0 0x7fa83819b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.013+0000 7fa83f000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa838075b10 0x7fa83819b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.013+0000 7fa83f000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa83810f0c0 0x7fa8381a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.013+0000 7fa83f000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa838114ca0 con 0x7fa8380751f0 2024-08-20T05:02:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.013+0000 7fa83f000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa838114b20 con 0x7fa83810f0c0 2024-08-20T05:02:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.014+0000 7fa83f000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa838114e20 con 0x7fa838075b10 2024-08-20T05:02:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.014+0000 7fa82f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa838075b10 0x7fa83819b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.014+0000 7fa82f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa838075b10 0x7fa83819b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52230/0 (socket says 172.21.15.37:52230) 2024-08-20T05:02:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.014+0000 7fa82f400640 1 -- 172.21.15.37:0/2938118665 learned_addr learned my addr 172.21.15.37:0/2938118665 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.014+0000 7fa83d000640 1 --2- 172.21.15.37:0/2938118665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa83810f0c0 0x7fa8381a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.014+0000 7fa837e00640 1 --2- 172.21.15.37:0/2938118665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8380751f0 0x7fa83819b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.014+0000 7fa82f400640 1 -- 172.21.15.37:0/2938118665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa83810f0c0 msgr2=0x7fa8381a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.014+0000 7fa82f400640 1 --2- 172.21.15.37:0/2938118665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa83810f0c0 0x7fa8381a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.014+0000 7fa82f400640 1 -- 172.21.15.37:0/2938118665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8380751f0 msgr2=0x7fa83819b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.014+0000 7fa82f400640 1 --2- 172.21.15.37:0/2938118665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8380751f0 0x7fa83819b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.014+0000 7fa82f400640 1 -- 172.21.15.37:0/2938118665 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8381a12a0 con 0x7fa838075b10 2024-08-20T05:02:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.014+0000 7fa83d000640 1 --2- 172.21.15.37:0/2938118665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa83810f0c0 0x7fa8381a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.015+0000 7fa82f400640 1 --2- 172.21.15.37:0/2938118665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa838075b10 0x7fa83819b730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa820035040 tx=0x7fa820032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.015+0000 7fa835600640 1 -- 172.21.15.37:0/2938118665 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820037040 con 0x7fa838075b10 2024-08-20T05:02:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.015+0000 7fa83f000640 1 -- 172.21.15.37:0/2938118665 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8381a1530 con 0x7fa838075b10 2024-08-20T05:02:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.015+0000 7fa835600640 1 -- 172.21.15.37:0/2938118665 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa820041070 con 0x7fa838075b10 2024-08-20T05:02:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.015+0000 7fa835600640 1 -- 172.21.15.37:0/2938118665 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820003850 con 0x7fa838075b10 2024-08-20T05:02:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.015+0000 7fa83f000640 1 -- 172.21.15.37:0/2938118665 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8381a7c50 con 0x7fa838075b10 2024-08-20T05:02:55.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.018+0000 7fa841a35740 1 Processor -- start 2024-08-20T05:02:55.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.018+0000 7fa841a35740 1 -- start start 2024-08-20T05:02:55.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.019+0000 7fa835600640 1 -- 172.21.15.37:0/2938118665 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa820004050 con 0x7fa838075b10 2024-08-20T05:02:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.019+0000 7fa841a35740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277d900 0x55c2f277dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.019+0000 7fa841a35740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277e220 0x55c2f2789c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.019+0000 7fa841a35740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f278a1b0 0x55c2f278c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.019+0000 7fa841a35740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c2f26f3a60 con 0x55c2f277d900 2024-08-20T05:02:55.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.019+0000 7fa841a35740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c2f26e2f60 con 0x55c2f278a1b0 2024-08-20T05:02:55.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.019+0000 7fa841a35740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c2f26e6fa0 con 0x55c2f277e220 2024-08-20T05:02:55.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.019+0000 7fa83d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277d900 0x55c2f277dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.019+0000 7fa83d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277d900 0x55c2f277dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43666/0 (socket says 172.21.15.37:43666) 2024-08-20T05:02:55.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.019+0000 7fa83d000640 1 -- 172.21.15.37:0/2379598935 learned_addr learned my addr 172.21.15.37:0/2379598935 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:55.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.019+0000 7fa837e00640 1 --2- 172.21.15.37:0/2379598935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277e220 0x55c2f2789c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.020+0000 7fa82f400640 1 --2- 172.21.15.37:0/2379598935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f278a1b0 0x55c2f278c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.020+0000 7fa83d000640 1 -- 172.21.15.37:0/2379598935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277e220 msgr2=0x55c2f2789c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.020+0000 7fa83d000640 1 --2- 172.21.15.37:0/2379598935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277e220 0x55c2f2789c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.020+0000 7fa83d000640 1 -- 172.21.15.37:0/2379598935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f278a1b0 msgr2=0x55c2f278c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.020+0000 7fa83d000640 1 --2- 172.21.15.37:0/2379598935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f278a1b0 0x55c2f278c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.020+0000 7fa83d000640 1 -- 172.21.15.37:0/2379598935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2f26893e0 con 0x55c2f277d900 2024-08-20T05:02:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.020+0000 7fa83d000640 1 --2- 172.21.15.37:0/2379598935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277d900 0x55c2f277dce0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa830011790 tx=0x7fa830011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c146e2b925b739 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:55.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.021+0000 7fa82d600640 1 -- 172.21.15.37:0/2379598935 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830003c30 con 0x55c2f277d900 2024-08-20T05:02:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.021+0000 7fa82d600640 1 -- 172.21.15.37:0/2379598935 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa83000fe50 con 0x55c2f277d900 2024-08-20T05:02:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.021+0000 7fa82d600640 1 -- 172.21.15.37:0/2379598935 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa830004820 con 0x55c2f277d900 2024-08-20T05:02:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.021+0000 7fa835600640 1 --2- 172.21.15.37:0/2938118665 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa81c0b3c50 0x7fa81c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.021+0000 7fa835600640 1 -- 172.21.15.37:0/2938118665 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa820103a40 con 0x7fa838075b10 2024-08-20T05:02:55.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.021+0000 7fa837e00640 1 --2- 172.21.15.37:0/2938118665 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa81c0b3c50 0x7fa81c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.022+0000 7fa841a35740 1 -- 172.21.15.37:0/2379598935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277d900 msgr2=0x55c2f277dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.022+0000 7fa841a35740 1 --2- 172.21.15.37:0/2379598935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277d900 0x55c2f277dce0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa830011790 tx=0x7fa830011c50 comp rx=0 tx=0).stop 2024-08-20T05:02:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.022+0000 7fa841a35740 1 -- 172.21.15.37:0/2379598935 shutdown_connections 2024-08-20T05:02:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.022+0000 7fa841a35740 1 --2- 172.21.15.37:0/2379598935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f278a1b0 0x55c2f278c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.022+0000 7fa841a35740 1 --2- 172.21.15.37:0/2379598935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277e220 0x55c2f2789c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.022+0000 7fa841a35740 1 --2- 172.21.15.37:0/2379598935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277d900 0x55c2f277dce0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.022+0000 7fa841a35740 1 -- 172.21.15.37:0/2379598935 >> 172.21.15.37:0/2379598935 conn(0x55c2f277b730 msgr2=0x55c2f277c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.022+0000 7fa837e00640 1 --2- 172.21.15.37:0/2938118665 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa81c0b3c50 0x7fa81c0b6110 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55c2f277c610 tx=0x7fa828009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.022+0000 7fa841a35740 1 -- 172.21.15.37:0/2379598935 shutdown_connections 2024-08-20T05:02:55.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.022+0000 7fa841a35740 1 -- 172.21.15.37:0/2379598935 wait complete. 2024-08-20T05:02:55.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.023+0000 7fa841a35740 1 -- start start 2024-08-20T05:02:55.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.023+0000 7fa841a35740 1 Processor -- start 2024-08-20T05:02:55.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.024+0000 7fa841a35740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277d900 0x55c2f2789950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.024+0000 7fa841a35740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277e220 0x55c2f2786da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.024+0000 7fa841a35740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f278a1b0 0x55c2f27872e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.024+0000 7fa841a35740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c2f2545700 con 0x55c2f277e220 2024-08-20T05:02:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.024+0000 7fa841a35740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c2f267e250 con 0x55c2f278a1b0 2024-08-20T05:02:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.024+0000 7fa841a35740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c2f278ce30 con 0x55c2f277d900 2024-08-20T05:02:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.024+0000 7fa841a35740 10 client.0 _ll_register_callbacks cb 0x55c2f26dd180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.024+0000 7fa837e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277d900 0x55c2f2789950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.024+0000 7fa82f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277e220 0x55c2f2786da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.024+0000 7fa837e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277d900 0x55c2f2789950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52244/0 (socket says 172.21.15.37:52244) 2024-08-20T05:02:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.024+0000 7fa837e00640 1 -- 172.21.15.37:0/3525208445 learned_addr learned my addr 172.21.15.37:0/3525208445 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.025+0000 7fa83d000640 1 --2- 172.21.15.37:0/3525208445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f278a1b0 0x55c2f27872e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.025+0000 7fa837e00640 1 -- 172.21.15.37:0/3525208445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f278a1b0 msgr2=0x55c2f27872e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.025+0000 7fa837e00640 1 --2- 172.21.15.37:0/3525208445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f278a1b0 0x55c2f27872e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.025+0000 7fa837e00640 1 -- 172.21.15.37:0/3525208445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277e220 msgr2=0x55c2f2786da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.025+0000 7fa837e00640 1 --2- 172.21.15.37:0/3525208445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277e220 0x55c2f2786da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.025+0000 7fa837e00640 1 -- 172.21.15.37:0/3525208445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2f2442650 con 0x55c2f277d900 2024-08-20T05:02:55.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.025+0000 7fa837e00640 1 --2- 172.21.15.37:0/3525208445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277d900 0x55c2f2789950 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa8280045e0 tx=0x7fa828004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d659d113ec1246e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.025+0000 7fa826000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:02:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.025+0000 7fa826000640 1 -- 172.21.15.37:0/3525208445 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa828009e60 con 0x55c2f277d900 2024-08-20T05:02:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.025+0000 7fa826000640 1 -- 172.21.15.37:0/3525208445 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa828020610 con 0x55c2f277d900 2024-08-20T05:02:55.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.025+0000 7fa841a35740 1 -- 172.21.15.37:0/3525208445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa83000fe50 con 0x55c2f277d900 2024-08-20T05:02:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.026+0000 7fa826000640 1 -- 172.21.15.37:0/3525208445 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa828032050 con 0x55c2f277d900 2024-08-20T05:02:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.026+0000 7fa841a35740 10 client.25654 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.026+0000 7fa841a35740 1 -- 172.21.15.37:0/3525208445 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c2f27986c0 con 0x55c2f277d900 2024-08-20T05:02:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.026+0000 7fa826000640 1 -- 172.21.15.37:0/3525208445 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa83000fe50 con 0x55c2f277d900 2024-08-20T05:02:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.026+0000 7fa826000640 1 -- 172.21.15.37:0/3525208445 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa82801c030 con 0x55c2f277d900 2024-08-20T05:02:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.027+0000 7fa841a35740 10 client.25654 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:55.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.027+0000 7fa841a35740 10 client.25654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:02:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.027+0000 7fa841a35740 20 client.25654 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.027+0000 7fa841a35740 1 --2- 172.21.15.37:0/3525208445 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c2f2799b80 0x55c2f279bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.027+0000 7fa841a35740 4 client.25654 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:02:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.027+0000 7fa841a35740 1 -- 172.21.15.37:0/3525208445 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2f26f59b0 con 0x55c2f2799b80 2024-08-20T05:02:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.027+0000 7fa82f400640 1 --2- 172.21.15.37:0/3525208445 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c2f2799b80 0x55c2f279bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.028+0000 7fa82f400640 1 --2- 172.21.15.37:0/3525208445 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c2f2799b80 0x55c2f279bf90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50f4ab2c1a52585b server_cookie=5fdbb0b7a0f0a61d in_seq=0 out_seq=0 2024-08-20T05:02:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.028+0000 7fa826000640 10 client.25654 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.028+0000 7fa826000640 1 -- 172.21.15.37:0/3525208445 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2f26f59b0 con 0x55c2f2799b80 2024-08-20T05:02:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.028+0000 7fa826000640 10 client.25654 handle_command_reply: tid=0 2024-08-20T05:02:55.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.028+0000 7fa841a35740 1 client.25654 shutdown 2024-08-20T05:02:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.029+0000 7fa841a35740 1 -- 172.21.15.37:0/3525208445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277d900 msgr2=0x55c2f2789950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.029+0000 7fa841a35740 1 --2- 172.21.15.37:0/3525208445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277d900 0x55c2f2789950 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa8280045e0 tx=0x7fa828004730 comp rx=0 tx=0).stop 2024-08-20T05:02:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.029+0000 7fa841a35740 1 -- 172.21.15.37:0/3525208445 shutdown_connections 2024-08-20T05:02:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.029+0000 7fa841a35740 1 --2- 172.21.15.37:0/3525208445 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c2f2799b80 0x55c2f279bf90 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.029+0000 7fa841a35740 1 --2- 172.21.15.37:0/3525208445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f278a1b0 0x55c2f27872e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.029+0000 7fa841a35740 1 --2- 172.21.15.37:0/3525208445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277e220 0x55c2f2786da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.029+0000 7fa841a35740 1 --2- 172.21.15.37:0/3525208445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277d900 0x55c2f2789950 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.029+0000 7fa826000640 0 client.25654 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.029+0000 7fa841a35740 1 -- 172.21.15.37:0/3525208445 >> 172.21.15.37:0/3525208445 conn(0x55c2f277b730 msgr2=0x55c2f27812a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.029+0000 7fa841a35740 1 -- 172.21.15.37:0/3525208445 shutdown_connections 2024-08-20T05:02:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.029+0000 7fa841a35740 1 -- 172.21.15.37:0/3525208445 wait complete. 2024-08-20T05:02:55.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.029+0000 7fa841a35740 20 client.25654 trim_cache size 0 max 16384 2024-08-20T05:02:55.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.065+0000 7fa841a35740 1 Processor -- start 2024-08-20T05:02:55.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.065+0000 7fa841a35740 1 -- start start 2024-08-20T05:02:55.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.066+0000 7fa841a35740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f277d900 0x55c2f2788ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.066+0000 7fa841a35740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277e220 0x55c2f27a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.066+0000 7fa841a35740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f278a1b0 0x55c2f27a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.066+0000 7fa841a35740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa8381b1910 con 0x55c2f278a1b0 2024-08-20T05:02:55.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.066+0000 7fa841a35740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa8381b3450 con 0x55c2f277d900 2024-08-20T05:02:55.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.066+0000 7fa841a35740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa8381b1fe0 con 0x55c2f277e220 2024-08-20T05:02:55.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.066+0000 7fa83d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f278a1b0 0x55c2f27a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.066+0000 7fa82f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277e220 0x55c2f27a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.066+0000 7fa83d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f278a1b0 0x55c2f27a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43682/0 (socket says 172.21.15.37:43682) 2024-08-20T05:02:55.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.066+0000 7fa83d000640 1 -- 172.21.15.37:0/666584424 learned_addr learned my addr 172.21.15.37:0/666584424 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:55.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.066+0000 7fa837e00640 1 --2- 172.21.15.37:0/666584424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f277d900 0x55c2f2788ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.067+0000 7fa82f400640 1 -- 172.21.15.37:0/666584424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f277d900 msgr2=0x55c2f2788ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:55.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.067+0000 7fa82f400640 1 --2- 172.21.15.37:0/666584424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f277d900 0x55c2f2788ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.067+0000 7fa82f400640 1 -- 172.21.15.37:0/666584424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f278a1b0 msgr2=0x55c2f27a1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:55.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.067+0000 7fa82f400640 1 --2- 172.21.15.37:0/666584424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f278a1b0 0x55c2f27a1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.067+0000 7fa82f400640 1 -- 172.21.15.37:0/666584424 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2f2789580 con 0x55c2f277e220 2024-08-20T05:02:55.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.067+0000 7fa82f400640 1 --2- 172.21.15.37:0/666584424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277e220 0x55c2f27a18b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa8201011f0 tx=0x7fa8200d3040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5b8c332134ed0a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:55.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.067+0000 7fa82cc00640 1 -- 172.21.15.37:0/666584424 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820030900 con 0x55c2f277e220 2024-08-20T05:02:55.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.067+0000 7fa82cc00640 1 -- 172.21.15.37:0/666584424 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa820030e70 con 0x55c2f277e220 2024-08-20T05:02:55.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.067+0000 7fa82cc00640 1 -- 172.21.15.37:0/666584424 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8200cebf0 con 0x55c2f277e220 2024-08-20T05:02:55.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.068+0000 7fa841a35740 1 -- 172.21.15.37:0/666584424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277e220 msgr2=0x55c2f27a18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:55.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.068+0000 7fa841a35740 1 --2- 172.21.15.37:0/666584424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277e220 0x55c2f27a18b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa8201011f0 tx=0x7fa8200d3040 comp rx=0 tx=0).stop 2024-08-20T05:02:55.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.068+0000 7fa841a35740 1 -- 172.21.15.37:0/666584424 shutdown_connections 2024-08-20T05:02:55.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.068+0000 7fa841a35740 1 --2- 172.21.15.37:0/666584424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f278a1b0 0x55c2f27a1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.068+0000 7fa841a35740 1 --2- 172.21.15.37:0/666584424 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f277e220 0x55c2f27a18b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.068+0000 7fa841a35740 1 --2- 172.21.15.37:0/666584424 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f277d900 0x55c2f2788ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.068+0000 7fa841a35740 1 -- 172.21.15.37:0/666584424 >> 172.21.15.37:0/666584424 conn(0x55c2f277b730 msgr2=0x55c2f27883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:55.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.068+0000 7fa841a35740 1 -- 172.21.15.37:0/666584424 shutdown_connections 2024-08-20T05:02:55.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.068+0000 7fa841a35740 1 -- 172.21.15.37:0/666584424 wait complete. 2024-08-20T05:02:55.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.069+0000 7fa841a35740 1 -- start start 2024-08-20T05:02:55.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.069+0000 7fa841a35740 1 Processor -- start 2024-08-20T05:02:55.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.069+0000 7fa841a35740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277d900 0x55c2f27928b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.069+0000 7fa841a35740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f277e220 0x55c2f278fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.069+0000 7fa841a35740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f278a1b0 0x55c2f2790470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.069+0000 7fa841a35740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa8381b2d80 con 0x55c2f277d900 2024-08-20T05:02:55.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.069+0000 7fa841a35740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa8381b26b0 con 0x55c2f277e220 2024-08-20T05:02:55.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.069+0000 7fa841a35740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa8381af8f0 con 0x55c2f278a1b0 2024-08-20T05:02:55.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.069+0000 7fa841a35740 10 client.0 _ll_register_callbacks cb 0x7fa828009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:55.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.070+0000 7fa837e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277d900 0x55c2f27928b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.070+0000 7fa837e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277d900 0x55c2f27928b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43684/0 (socket says 172.21.15.37:43684) 2024-08-20T05:02:55.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.070+0000 7fa82f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f277e220 0x55c2f278fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.070+0000 7fa837e00640 1 -- 172.21.15.37:0/3626421346 learned_addr learned my addr 172.21.15.37:0/3626421346 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:55.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.070+0000 7fa83d000640 1 --2- 172.21.15.37:0/3626421346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f278a1b0 0x55c2f2790470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.070+0000 7fa82f400640 1 -- 172.21.15.37:0/3626421346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f278a1b0 msgr2=0x55c2f2790470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:55.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.070+0000 7fa82f400640 1 --2- 172.21.15.37:0/3626421346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f278a1b0 0x55c2f2790470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.070+0000 7fa82f400640 1 -- 172.21.15.37:0/3626421346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277d900 msgr2=0x55c2f27928b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:55.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.070+0000 7fa82f400640 1 --2- 172.21.15.37:0/3626421346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277d900 0x55c2f27928b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.070+0000 7fa82f400640 1 -- 172.21.15.37:0/3626421346 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2f2803890 con 0x55c2f277e220 2024-08-20T05:02:55.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.070+0000 7fa837e00640 1 --2- 172.21.15.37:0/3626421346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277d900 0x55c2f27928b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:55.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.070+0000 7fa82f400640 1 --2- 172.21.15.37:0/3626421346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f277e220 0x55c2f278fda0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa8201011f0 tx=0x7fa8200095b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d5a382a06d31015 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:55.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.070+0000 7fa826000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:02:55.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.071+0000 7fa826000640 1 -- 172.21.15.37:0/3626421346 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8200e4060 con 0x55c2f277e220 2024-08-20T05:02:55.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.071+0000 7fa841a35740 1 -- 172.21.15.37:0/3626421346 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c2f26f1450 con 0x55c2f277e220 2024-08-20T05:02:55.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.071+0000 7fa826000640 1 -- 172.21.15.37:0/3626421346 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa820004340 con 0x55c2f277e220 2024-08-20T05:02:55.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.071+0000 7fa826000640 1 -- 172.21.15.37:0/3626421346 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa820030900 con 0x55c2f277e220 2024-08-20T05:02:55.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.071+0000 7fa841a35740 10 client.25649 fetch_fsmap learned FSMap version 29 2024-08-20T05:02:55.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.071+0000 7fa841a35740 1 -- 172.21.15.37:0/3626421346 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55c2f2804a60 con 0x55c2f277e220 2024-08-20T05:02:55.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.071+0000 7fa826000640 1 -- 172.21.15.37:0/3626421346 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55c2f26f1450 con 0x55c2f277e220 2024-08-20T05:02:55.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.071+0000 7fa826000640 1 -- 172.21.15.37:0/3626421346 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fa8200c6880 con 0x55c2f277e220 2024-08-20T05:02:55.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.071+0000 7fa841a35740 10 client.25649 fetch_fsmap finished waiting for FSMap version 29 2024-08-20T05:02:55.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.071+0000 7fa841a35740 10 client.25649 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:02:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.071+0000 7fa841a35740 20 client.25649 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.071+0000 7fa841a35740 1 --2- 172.21.15.37:0/3626421346 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c2f28050a0 0x55c2f28074c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.071+0000 7fa841a35740 4 client.25649 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:02:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.072+0000 7fa841a35740 1 -- 172.21.15.37:0/3626421346 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c2f26eeb90 con 0x55c2f28050a0 2024-08-20T05:02:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.072+0000 7fa837e00640 1 --2- 172.21.15.37:0/3626421346 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c2f28050a0 0x55c2f28074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.072+0000 7fa837e00640 1 --2- 172.21.15.37:0/3626421346 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c2f28050a0 0x55c2f28074c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f914a2fd8f62a768 server_cookie=f95a17b6ae3151cf in_seq=0 out_seq=0 2024-08-20T05:02:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.072+0000 7fa826000640 10 client.25649 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.072+0000 7fa826000640 1 -- 172.21.15.37:0/3626421346 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c2f26eeb90 con 0x55c2f28050a0 2024-08-20T05:02:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.072+0000 7fa826000640 10 client.25649 handle_command_reply: tid=0 2024-08-20T05:02:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.072+0000 7fa841a35740 1 client.25649 shutdown 2024-08-20T05:02:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.073+0000 7fa841a35740 1 -- 172.21.15.37:0/3626421346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f277e220 msgr2=0x55c2f278fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.073+0000 7fa841a35740 1 --2- 172.21.15.37:0/3626421346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f277e220 0x55c2f278fda0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa8201011f0 tx=0x7fa8200095b0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.073+0000 7fa841a35740 1 -- 172.21.15.37:0/3626421346 shutdown_connections 2024-08-20T05:02:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.073+0000 7fa841a35740 1 --2- 172.21.15.37:0/3626421346 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c2f28050a0 0x55c2f28074c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.073+0000 7fa841a35740 1 --2- 172.21.15.37:0/3626421346 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2f278a1b0 0x55c2f2790470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.073+0000 7fa841a35740 1 --2- 172.21.15.37:0/3626421346 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2f277e220 0x55c2f278fda0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.073+0000 7fa841a35740 1 --2- 172.21.15.37:0/3626421346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2f277d900 0x55c2f27928b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.073+0000 7fa826000640 0 client.25649 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:55.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.073+0000 7fa841a35740 1 -- 172.21.15.37:0/3626421346 >> 172.21.15.37:0/3626421346 conn(0x55c2f277b730 msgr2=0x55c2f2788bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:55.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.073+0000 7fa841a35740 1 -- 172.21.15.37:0/3626421346 shutdown_connections 2024-08-20T05:02:55.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.073+0000 7fa841a35740 1 -- 172.21.15.37:0/3626421346 wait complete. 2024-08-20T05:02:55.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.073+0000 7fa841a35740 20 client.25649 trim_cache size 0 max 16384 2024-08-20T05:02:55.078 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:02:55.078 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-20T05:02:55.078 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-08-20T05:02:55.078 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:02:55.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.074+0000 7fa83f000640 1 -- 172.21.15.37:0/2938118665 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa81c0b3c50 msgr2=0x7fa81c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:55.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.074+0000 7fa83f000640 1 --2- 172.21.15.37:0/2938118665 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa81c0b3c50 0x7fa81c0b6110 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55c2f277c610 tx=0x7fa828009260 comp rx=0 tx=0).stop 2024-08-20T05:02:55.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.074+0000 7fa83f000640 1 -- 172.21.15.37:0/2938118665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa838075b10 msgr2=0x7fa83819b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:55.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.074+0000 7fa83f000640 1 --2- 172.21.15.37:0/2938118665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa838075b10 0x7fa83819b730 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa820035040 tx=0x7fa820032d50 comp rx=0 tx=0).stop 2024-08-20T05:02:55.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.074+0000 7fa83f000640 1 -- 172.21.15.37:0/2938118665 shutdown_connections 2024-08-20T05:02:55.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.074+0000 7fa83f000640 1 --2- 172.21.15.37:0/2938118665 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa81c0b3c50 0x7fa81c0b6110 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.074+0000 7fa83f000640 1 --2- 172.21.15.37:0/2938118665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa83810f0c0 0x7fa8381a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.074+0000 7fa83f000640 1 --2- 172.21.15.37:0/2938118665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa838075b10 0x7fa83819b730 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.074+0000 7fa83f000640 1 --2- 172.21.15.37:0/2938118665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8380751f0 0x7fa83819b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:55.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.074+0000 7fa83f000640 1 -- 172.21.15.37:0/2938118665 >> 172.21.15.37:0/2938118665 conn(0x7fa8380fe500 msgr2=0x7fa8380ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:55.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.074+0000 7fa83f000640 1 -- 172.21.15.37:0/2938118665 shutdown_connections 2024-08-20T05:02:55.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:55.074+0000 7fa83f000640 1 -- 172.21.15.37:0/2938118665 wait complete. 2024-08-20T05:02:55.715 INFO:teuthology.orchestra.run.smithi037.stderr:creating primary keys... 2024-08-20T05:02:55.858 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:55 smithi037 ceph-mon[17265]: pgmap v421: 129 pgs: 129 active+clean; 220 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 33 MiB/s wr, 360 op/s 2024-08-20T05:02:55.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:55 smithi135 ceph-mon[22342]: pgmap v421: 129 pgs: 129 active+clean; 220 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 33 MiB/s wr, 360 op/s 2024-08-20T05:02:55.916 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T05:02:55.916 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:02:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:55 smithi130 ceph-mon[22007]: pgmap v421: 129 pgs: 129 active+clean; 220 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 33 MiB/s wr, 360 op/s 2024-08-20T05:02:56.325 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.924+0000 7fc561c00640 1 -- 172.21.15.37:0/380866876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc55c077400 msgr2=0x7fc55c0777e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.924+0000 7fc561c00640 1 --2- 172.21.15.37:0/380866876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc55c077400 0x7fc55c0777e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009860 tx=0x7fc54c02a340 comp rx=0 tx=0).stop 2024-08-20T05:02:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.924+0000 7fc561c00640 1 -- 172.21.15.37:0/380866876 shutdown_connections 2024-08-20T05:02:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.924+0000 7fc561c00640 1 --2- 172.21.15.37:0/380866876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc55c113500 0x7fc55c1158f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.924+0000 7fc561c00640 1 --2- 172.21.15.37:0/380866876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc55c077d20 0x7fc55c112fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.924+0000 7fc561c00640 1 --2- 172.21.15.37:0/380866876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc55c077400 0x7fc55c0777e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.924+0000 7fc561c00640 1 -- 172.21.15.37:0/380866876 >> 172.21.15.37:0/380866876 conn(0x7fc55c100540 msgr2=0x7fc55c102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.925+0000 7fc561c00640 1 -- 172.21.15.37:0/380866876 shutdown_connections 2024-08-20T05:02:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.925+0000 7fc561c00640 1 -- 172.21.15.37:0/380866876 wait complete. 2024-08-20T05:02:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.926+0000 7fc561c00640 1 Processor -- start 2024-08-20T05:02:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.926+0000 7fc561c00640 1 -- start start 2024-08-20T05:02:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.926+0000 7fc561c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc55c077400 0x7fc55c074490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.926+0000 7fc561c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc55c077d20 0x7fc55c0749d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.926+0000 7fc561c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc55c113500 0x7fc55c06d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.926+0000 7fc561c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c118ee0 con 0x7fc55c113500 2024-08-20T05:02:56.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.926+0000 7fc561c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c118d60 con 0x7fc55c077d20 2024-08-20T05:02:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.927+0000 7fc561c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc55c119060 con 0x7fc55c077400 2024-08-20T05:02:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.927+0000 7fc55b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc55c077d20 0x7fc55c0749d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.927+0000 7fc55be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc55c077400 0x7fc55c074490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.927+0000 7fc55b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc55c077d20 0x7fc55c0749d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:55994/0 (socket says 172.21.15.37:55994) 2024-08-20T05:02:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.927+0000 7fc55b400640 1 -- 172.21.15.37:0/2238075525 learned_addr learned my addr 172.21.15.37:0/2238075525 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.927+0000 7fc55be00640 1 -- 172.21.15.37:0/2238075525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc55c077d20 msgr2=0x7fc55c0749d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.927+0000 7fc55be00640 1 --2- 172.21.15.37:0/2238075525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc55c077d20 0x7fc55c0749d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.927+0000 7fc55be00640 1 -- 172.21.15.37:0/2238075525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc55c113500 msgr2=0x7fc55c06d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.927+0000 7fc55be00640 1 --2- 172.21.15.37:0/2238075525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc55c113500 0x7fc55c06d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.927+0000 7fc55be00640 1 -- 172.21.15.37:0/2238075525 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc55c06e0a0 con 0x7fc55c077400 2024-08-20T05:02:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.927+0000 7fc55b400640 1 --2- 172.21.15.37:0/2238075525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc55c077d20 0x7fc55c0749d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:02:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.928+0000 7fc55be00640 1 --2- 172.21.15.37:0/2238075525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc55c077400 0x7fc55c074490 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc54c035040 tx=0x7fc54c032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.928+0000 7fc558c00640 1 -- 172.21.15.37:0/2238075525 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c037040 con 0x7fc55c077400 2024-08-20T05:02:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.928+0000 7fc561c00640 1 -- 172.21.15.37:0/2238075525 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc55c06e330 con 0x7fc55c077400 2024-08-20T05:02:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.928+0000 7fc558c00640 1 -- 172.21.15.37:0/2238075525 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc54c030c10 con 0x7fc55c077400 2024-08-20T05:02:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.928+0000 7fc561c00640 1 -- 172.21.15.37:0/2238075525 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc55c0732d0 con 0x7fc55c077400 2024-08-20T05:02:56.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.929+0000 7fc558c00640 1 -- 172.21.15.37:0/2238075525 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc54c037040 con 0x7fc55c077400 2024-08-20T05:02:56.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.929+0000 7fc561c00640 1 -- 172.21.15.37:0/2238075525 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc55c0777e0 con 0x7fc55c077400 2024-08-20T05:02:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.933+0000 7fc558c00640 1 -- 172.21.15.37:0/2238075525 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc54c043060 con 0x7fc55c077400 2024-08-20T05:02:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.935+0000 7fc558c00640 1 --2- 172.21.15.37:0/2238075525 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5400b40a0 0x7fc5400b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.936+0000 7fc558c00640 1 -- 172.21.15.37:0/2238075525 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc54c041020 con 0x7fc55c077400 2024-08-20T05:02:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.936+0000 7fc55b400640 1 --2- 172.21.15.37:0/2238075525 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5400b40a0 0x7fc5400b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.936+0000 7fc558c00640 1 -- 172.21.15.37:0/2238075525 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fc54c102bf0 con 0x7fc55c077400 2024-08-20T05:02:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:56.937+0000 7fc55b400640 1 --2- 172.21.15.37:0/2238075525 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5400b40a0 0x7fc5400b6560 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc5480096c0 tx=0x7fc548009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:57.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:57.203+0000 7fc561c00640 1 -- 172.21.15.37:0/2238075525 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc55c073680 con 0x7fc55c077400 2024-08-20T05:02:57.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:57.204+0000 7fc558c00640 1 -- 172.21.15.37:0/2238075525 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11981 (secure 0 0 0) 0x7fc54c0c9d70 con 0x7fc55c077400 2024-08-20T05:02:57.206 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:02:57.206 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"btime":"2024-08-20T05:02:56:610047+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:02:56.269915+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:02:57.207 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 30 2024-08-20T05:02:57.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:57.208+0000 7fc561c00640 1 -- 172.21.15.37:0/2238075525 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5400b40a0 msgr2=0x7fc5400b6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:57.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:57.208+0000 7fc561c00640 1 --2- 172.21.15.37:0/2238075525 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5400b40a0 0x7fc5400b6560 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc5480096c0 tx=0x7fc548009260 comp rx=0 tx=0).stop 2024-08-20T05:02:57.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:57.208+0000 7fc561c00640 1 -- 172.21.15.37:0/2238075525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc55c077400 msgr2=0x7fc55c074490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:57.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:57.208+0000 7fc561c00640 1 --2- 172.21.15.37:0/2238075525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc55c077400 0x7fc55c074490 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc54c035040 tx=0x7fc54c032d50 comp rx=0 tx=0).stop 2024-08-20T05:02:57.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:57.208+0000 7fc561c00640 1 -- 172.21.15.37:0/2238075525 shutdown_connections 2024-08-20T05:02:57.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:57.208+0000 7fc561c00640 1 --2- 172.21.15.37:0/2238075525 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5400b40a0 0x7fc5400b6560 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:57.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:57.208+0000 7fc561c00640 1 --2- 172.21.15.37:0/2238075525 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc55c113500 0x7fc55c06d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:57.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:57.208+0000 7fc561c00640 1 --2- 172.21.15.37:0/2238075525 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc55c077d20 0x7fc55c0749d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:57.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:57.208+0000 7fc561c00640 1 --2- 172.21.15.37:0/2238075525 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc55c077400 0x7fc55c074490 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:57.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:57.208+0000 7fc561c00640 1 -- 172.21.15.37:0/2238075525 >> 172.21.15.37:0/2238075525 conn(0x7fc55c100540 msgr2=0x7fc55c102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:57.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:57.208+0000 7fc561c00640 1 -- 172.21.15.37:0/2238075525 shutdown_connections 2024-08-20T05:02:57.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:02:57.208+0000 7fc561c00640 1 -- 172.21.15.37:0/2238075525 wait complete. 2024-08-20T05:02:57.890 INFO:teuthology.orchestra.run.smithi037.stderr:done in 10.67 s (drop tables 0.00 s, create tables 0.02 s, client-side generate 7.49 s, vacuum 0.99 s, primary keys 2.17 s). 2024-08-20T05:02:57.892 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:57 smithi037 ceph-mon[17265]: pgmap v422: 129 pgs: 129 active+clean; 328 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 50 MiB/s wr, 358 op/s 2024-08-20T05:02:57.892 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:57 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:02:57.892 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:57 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2238075525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:57.896 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-08-20T05:02:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:57 smithi130 ceph-mon[22007]: pgmap v422: 129 pgs: 129 active+clean; 328 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 50 MiB/s wr, 358 op/s 2024-08-20T05:02:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:57 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:02:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:57 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2238075525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:58.040 INFO:teuthology.orchestra.run.smithi037.stderr:starting vacuum...end. 2024-08-20T05:02:58.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:57 smithi135 ceph-mon[22342]: pgmap v422: 129 pgs: 129 active+clean; 328 MiB data, 1019 MiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 50 MiB/s wr, 358 op/s 2024-08-20T05:02:58.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:57 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:02:58.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:57 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2238075525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:02:58.537 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T05:02:59.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.090+0000 7f5a55c00640 1 -- 172.21.15.37:0/571608597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a5010abd0 msgr2=0x7f5a50111530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.090+0000 7f5a55c00640 1 --2- 172.21.15.37:0/571608597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a5010abd0 0x7f5a50111530 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5a480077b0 tx=0x7f5a4802b410 comp rx=0 tx=0).stop 2024-08-20T05:02:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.091+0000 7f5a55c00640 1 -- 172.21.15.37:0/571608597 shutdown_connections 2024-08-20T05:02:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.091+0000 7f5a55c00640 1 --2- 172.21.15.37:0/571608597 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a5010abd0 0x7f5a50111530 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.092+0000 7f5a55c00640 1 --2- 172.21.15.37:0/571608597 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a5010a210 0x7f5a5010a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.092+0000 7f5a55c00640 1 --2- 172.21.15.37:0/571608597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a500742d0 0x7f5a500746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.092+0000 7f5a55c00640 1 -- 172.21.15.37:0/571608597 >> 172.21.15.37:0/571608597 conn(0x7f5a5006f740 msgr2=0x7f5a50071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:59.096 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.095+0000 7f5a55c00640 1 -- 172.21.15.37:0/571608597 shutdown_connections 2024-08-20T05:02:59.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.095+0000 7f5a55c00640 1 -- 172.21.15.37:0/571608597 wait complete. 2024-08-20T05:02:59.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.097+0000 7f5a55c00640 1 Processor -- start 2024-08-20T05:02:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.100+0000 7f5a55c00640 1 -- start start 2024-08-20T05:02:59.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.101+0000 7f5a55c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a500742d0 0x7f5a501a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.101+0000 7f5a55c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a5010a210 0x7f5a501a4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.101+0000 7f5a55c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a5010abd0 0x7f5a501a31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.101+0000 7f5a55c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5a501148b0 con 0x7f5a5010a210 2024-08-20T05:02:59.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.101+0000 7f5a55c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a50114730 con 0x7f5a500742d0 2024-08-20T05:02:59.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.101+0000 7f5a55c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a50114a30 con 0x7f5a5010abd0 2024-08-20T05:02:59.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.101+0000 7f5a4ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a500742d0 0x7f5a501a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:59.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.101+0000 7f5a4ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a500742d0 0x7f5a501a4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56012/0 (socket says 172.21.15.37:56012) 2024-08-20T05:02:59.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.101+0000 7f5a4ea00640 1 -- 172.21.15.37:0/1180219823 learned_addr learned my addr 172.21.15.37:0/1180219823 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:59.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.101+0000 7f5a4f400640 1 --2- 172.21.15.37:0/1180219823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a5010abd0 0x7f5a501a31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:59.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.102+0000 7f5a4e000640 1 --2- 172.21.15.37:0/1180219823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a5010a210 0x7f5a501a4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:59.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.102+0000 7f5a4ea00640 1 -- 172.21.15.37:0/1180219823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a5010abd0 msgr2=0x7f5a501a31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:59.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.102+0000 7f5a4ea00640 1 --2- 172.21.15.37:0/1180219823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a5010abd0 0x7f5a501a31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.102+0000 7f5a4ea00640 1 -- 172.21.15.37:0/1180219823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a5010a210 msgr2=0x7f5a501a4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:59.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.102+0000 7f5a4ea00640 1 --2- 172.21.15.37:0/1180219823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a5010a210 0x7f5a501a4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.102+0000 7f5a4ea00640 1 -- 172.21.15.37:0/1180219823 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a501a3730 con 0x7f5a500742d0 2024-08-20T05:02:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.102+0000 7f5a4e000640 1 --2- 172.21.15.37:0/1180219823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a5010a210 0x7f5a501a4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:02:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.103+0000 7f5a4ea00640 1 --2- 172.21.15.37:0/1180219823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a500742d0 0x7f5a501a4930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00e9f0 tx=0x7f5a3c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.103+0000 7f5a47400640 1 -- 172.21.15.37:0/1180219823 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c00cd80 con 0x7f5a500742d0 2024-08-20T05:02:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.104+0000 7f5a47400640 1 -- 172.21.15.37:0/1180219823 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a3c0108e0 con 0x7f5a500742d0 2024-08-20T05:02:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.104+0000 7f5a47400640 1 -- 172.21.15.37:0/1180219823 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c018980 con 0x7f5a500742d0 2024-08-20T05:02:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.104+0000 7f5a55c00640 1 -- 172.21.15.37:0/1180219823 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a501a3a20 con 0x7f5a500742d0 2024-08-20T05:02:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.104+0000 7f5a55c00640 1 -- 172.21.15.37:0/1180219823 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a501a3ef0 con 0x7f5a500742d0 2024-08-20T05:02:59.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.116+0000 7f5a58c6c740 1 Processor -- start 2024-08-20T05:02:59.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.117+0000 7f5a58c6c740 1 -- start start 2024-08-20T05:02:59.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.117+0000 7f5a58c6c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce22b0 0x564cc0ce46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.117+0000 7f5a58c6c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce4be0 0x564cc0ce6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.117+0000 7f5a58c6c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce7620 0x564cc0ce9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.117+0000 7f5a58c6c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564cc0c55210 con 0x564cc0ce7620 2024-08-20T05:02:59.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.117+0000 7f5a58c6c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564cc0c44710 con 0x564cc0ce22b0 2024-08-20T05:02:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.117+0000 7f5a58c6c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564cc0c48750 con 0x564cc0ce4be0 2024-08-20T05:02:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.117+0000 7f5a47400640 1 -- 172.21.15.37:0/1180219823 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5a3c010430 con 0x7f5a500742d0 2024-08-20T05:02:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.118+0000 7f5a4f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce22b0 0x564cc0ce46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.118+0000 7f5a4f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce22b0 0x564cc0ce46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56024/0 (socket says 172.21.15.37:56024) 2024-08-20T05:02:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.118+0000 7f5a4f400640 1 -- 172.21.15.37:0/552091555 learned_addr learned my addr 172.21.15.37:0/552091555 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.118+0000 7f5a4ea00640 1 --2- 172.21.15.37:0/552091555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce4be0 0x564cc0ce6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:59.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.118+0000 7f5a4f400640 1 -- 172.21.15.37:0/552091555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce4be0 msgr2=0x564cc0ce6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.118+0000 7f5a4f400640 1 --2- 172.21.15.37:0/552091555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce4be0 0x564cc0ce6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.118+0000 7f5a4f400640 1 -- 172.21.15.37:0/552091555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce7620 msgr2=0x564cc0ce9ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:02:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.119+0000 7f5a4e000640 1 --2- 172.21.15.37:0/552091555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce7620 0x564cc0ce9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.119+0000 7f5a4f400640 1 --2- 172.21.15.37:0/552091555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce7620 0x564cc0ce9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.120+0000 7f5a4f400640 1 -- 172.21.15.37:0/552091555 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cc0c10de0 con 0x564cc0ce22b0 2024-08-20T05:02:59.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.120+0000 7f5a4ea00640 1 --2- 172.21.15.37:0/552091555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce4be0 0x564cc0ce6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:02:59.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.121+0000 7f5a4f400640 1 --2- 172.21.15.37:0/552091555 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce22b0 0x564cc0ce46a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5a48035040 tx=0x7f5a4800ac80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5fec9a87cdb52ac server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:59.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.122+0000 7f5a47400640 1 --2- 172.21.15.37:0/1180219823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5a340b3c50 0x7f5a340b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.122+0000 7f5a3be00640 1 -- 172.21.15.37:0/552091555 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48040020 con 0x564cc0ce22b0 2024-08-20T05:02:59.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.122+0000 7f5a3be00640 1 -- 172.21.15.37:0/552091555 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a48038040 con 0x564cc0ce22b0 2024-08-20T05:02:59.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.123+0000 7f5a47400640 1 -- 172.21.15.37:0/1180219823 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5a3c0e43e0 con 0x7f5a500742d0 2024-08-20T05:02:59.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.123+0000 7f5a3be00640 1 -- 172.21.15.37:0/552091555 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48037070 con 0x564cc0ce22b0 2024-08-20T05:02:59.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.123+0000 7f5a4ea00640 1 --2- 172.21.15.37:0/1180219823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5a340b3c50 0x7f5a340b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.124+0000 7f5a58c6c740 1 -- 172.21.15.37:0/552091555 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce22b0 msgr2=0x564cc0ce46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.124+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/552091555 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce22b0 0x564cc0ce46a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5a48035040 tx=0x7f5a4800ac80 comp rx=0 tx=0).stop 2024-08-20T05:02:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.125+0000 7f5a58c6c740 1 -- 172.21.15.37:0/552091555 shutdown_connections 2024-08-20T05:02:59.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.125+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/552091555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce7620 0x564cc0ce9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.125+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/552091555 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce4be0 0x564cc0ce6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.125+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/552091555 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce22b0 0x564cc0ce46a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.125+0000 7f5a58c6c740 1 -- 172.21.15.37:0/552091555 >> 172.21.15.37:0/552091555 conn(0x564cc0cdd3b0 msgr2=0x564cc0cde190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.125+0000 7f5a58c6c740 1 -- 172.21.15.37:0/552091555 shutdown_connections 2024-08-20T05:02:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.126+0000 7f5a58c6c740 1 -- 172.21.15.37:0/552091555 wait complete. 2024-08-20T05:02:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.126+0000 7f5a4ea00640 1 --2- 172.21.15.37:0/1180219823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5a340b3c50 0x7f5a340b6110 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0e4680 tx=0x7f5a3c00cf20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.126+0000 7f5a58c6c740 1 -- start start 2024-08-20T05:02:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.127+0000 7f5a58c6c740 1 Processor -- start 2024-08-20T05:02:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.128+0000 7f5a58c6c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce22b0 0x564cc0cebd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.128+0000 7f5a58c6c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce4be0 0x564cc0cec3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.128+0000 7f5a58c6c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce7620 0x564cc0cecf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.128+0000 7f5a58c6c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564cc0b7dab0 con 0x564cc0ce22b0 2024-08-20T05:02:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.128+0000 7f5a58c6c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564cc0beb140 con 0x564cc0ce7620 2024-08-20T05:02:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.128+0000 7f5a58c6c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564cc0cea5a0 con 0x564cc0ce4be0 2024-08-20T05:02:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.128+0000 7f5a58c6c740 10 client.0 _ll_register_callbacks cb 0x564cc0bfe5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.129+0000 7f5a4e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce4be0 0x564cc0cec3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.129+0000 7f5a4e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce4be0 0x564cc0cec3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52310/0 (socket says 172.21.15.37:52310) 2024-08-20T05:02:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.129+0000 7f5a4e000640 1 -- 172.21.15.37:0/3500322319 learned_addr learned my addr 172.21.15.37:0/3500322319 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.129+0000 7f5a4f400640 1 --2- 172.21.15.37:0/3500322319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce22b0 0x564cc0cebd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.129+0000 7f5a4f400640 1 --2- 172.21.15.37:0/3500322319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce7620 0x564cc0cecf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:59.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.130+0000 7f5a4e000640 1 -- 172.21.15.37:0/3500322319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce7620 msgr2=0x564cc0cecf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:59.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.130+0000 7f5a4e000640 1 --2- 172.21.15.37:0/3500322319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce7620 0x564cc0cecf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.130+0000 7f5a4e000640 1 -- 172.21.15.37:0/3500322319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce22b0 msgr2=0x564cc0cebd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:59.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.130+0000 7f5a4e000640 1 --2- 172.21.15.37:0/3500322319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce22b0 0x564cc0cebd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.130+0000 7f5a4e000640 1 -- 172.21.15.37:0/3500322319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cc0bec170 con 0x564cc0ce4be0 2024-08-20T05:02:59.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.131+0000 7f5a4e000640 1 --2- 172.21.15.37:0/3500322319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce4be0 0x564cc0cec3b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5a40011480 tx=0x7f5a40011940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f57015dd4d9a786c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:59.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.131+0000 7f5a38c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:02:59.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.132+0000 7f5a38c00640 1 -- 172.21.15.37:0/3500322319 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4001f060 con 0x564cc0ce4be0 2024-08-20T05:02:59.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.132+0000 7f5a38c00640 1 -- 172.21.15.37:0/3500322319 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5a40012980 con 0x564cc0ce4be0 2024-08-20T05:02:59.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.133+0000 7f5a58c6c740 1 -- 172.21.15.37:0/3500322319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564cc0c1ba30 con 0x564cc0ce4be0 2024-08-20T05:02:59.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.133+0000 7f5a38c00640 1 -- 172.21.15.37:0/3500322319 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5a40012b80 con 0x564cc0ce4be0 2024-08-20T05:02:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.134+0000 7f5a58c6c740 10 client.25675 fetch_fsmap learned FSMap version 30 2024-08-20T05:02:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.134+0000 7f5a58c6c740 1 -- 172.21.15.37:0/3500322319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564cc09a7790 con 0x564cc0ce4be0 2024-08-20T05:02:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.135+0000 7f5a38c00640 1 -- 172.21.15.37:0/3500322319 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564cc0c1ba30 con 0x564cc0ce4be0 2024-08-20T05:02:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.135+0000 7f5a38c00640 1 -- 172.21.15.37:0/3500322319 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8374+0+0 (secure 0 0 0) 0x7f5a400233a0 con 0x564cc0ce4be0 2024-08-20T05:02:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.135+0000 7f5a58c6c740 10 client.25675 fetch_fsmap finished waiting for FSMap version 30 2024-08-20T05:02:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.135+0000 7f5a58c6c740 10 client.25675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:02:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.135+0000 7f5a58c6c740 20 client.25675 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.135+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/3500322319 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564cc0d088b0 0x564cc0d0ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.135+0000 7f5a58c6c740 4 client.25675 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:02:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.135+0000 7f5a58c6c740 1 -- 172.21.15.37:0/3500322319 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564cc0c57160 con 0x564cc0d088b0 2024-08-20T05:02:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.136+0000 7f5a4f400640 1 --2- 172.21.15.37:0/3500322319 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564cc0d088b0 0x564cc0d0ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.137+0000 7f5a4f400640 1 --2- 172.21.15.37:0/3500322319 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564cc0d088b0 0x564cc0d0ace0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ebca4716ab00bad server_cookie=c979a6167d2ae528 in_seq=0 out_seq=0 2024-08-20T05:02:59.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.137+0000 7f5a38c00640 10 client.25675 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:59.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.138+0000 7f5a38c00640 1 -- 172.21.15.37:0/3500322319 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564cc0c57160 con 0x564cc0d088b0 2024-08-20T05:02:59.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.138+0000 7f5a38c00640 10 client.25675 handle_command_reply: tid=0 2024-08-20T05:02:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.138+0000 7f5a58c6c740 1 client.25675 shutdown 2024-08-20T05:02:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.139+0000 7f5a58c6c740 1 -- 172.21.15.37:0/3500322319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce4be0 msgr2=0x564cc0cec3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.139+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/3500322319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce4be0 0x564cc0cec3b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5a40011480 tx=0x7f5a40011940 comp rx=0 tx=0).stop 2024-08-20T05:02:59.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.140+0000 7f5a58c6c740 1 -- 172.21.15.37:0/3500322319 shutdown_connections 2024-08-20T05:02:59.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.140+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/3500322319 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564cc0d088b0 0x564cc0d0ace0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.140+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/3500322319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce7620 0x564cc0cecf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.140+0000 7f5a38c00640 0 client.25675 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:59.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.140+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/3500322319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce4be0 0x564cc0cec3b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.140+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/3500322319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce22b0 0x564cc0cebd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.140+0000 7f5a58c6c740 1 -- 172.21.15.37:0/3500322319 >> 172.21.15.37:0/3500322319 conn(0x564cc0cdd3b0 msgr2=0x564cc0cdc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.141+0000 7f5a58c6c740 1 -- 172.21.15.37:0/3500322319 shutdown_connections 2024-08-20T05:02:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.141+0000 7f5a58c6c740 1 -- 172.21.15.37:0/3500322319 wait complete. 2024-08-20T05:02:59.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.141+0000 7f5a58c6c740 20 client.25675 trim_cache size 0 max 16384 2024-08-20T05:02:59.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.172+0000 7f5a58c6c740 1 Processor -- start 2024-08-20T05:02:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.172+0000 7f5a58c6c740 1 -- start start 2024-08-20T05:02:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.172+0000 7f5a58c6c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce22b0 0x564cc0cecf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.172+0000 7f5a58c6c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce4be0 0x564cc0cd8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.172+0000 7f5a58c6c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce7620 0x564cc0ce9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.172+0000 7f5a58c6c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5a501b1b50 con 0x564cc0ce22b0 2024-08-20T05:02:59.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.172+0000 7f5a58c6c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a501b36c0 con 0x564cc0ce4be0 2024-08-20T05:02:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.172+0000 7f5a58c6c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a501b2220 con 0x564cc0ce7620 2024-08-20T05:02:59.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.173+0000 7f5a4e000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce4be0 0x564cc0cd8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.174+0000 7f5a4f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce7620 0x564cc0ce9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.174+0000 7f5a4f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce7620 0x564cc0ce9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52314/0 (socket says 172.21.15.37:52314) 2024-08-20T05:02:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.174+0000 7f5a4f400640 1 -- 172.21.15.37:0/2888845731 learned_addr learned my addr 172.21.15.37:0/2888845731 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.174+0000 7f5a4f400640 1 --2- 172.21.15.37:0/2888845731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce22b0 0x564cc0cecf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.174+0000 7f5a4f400640 1 -- 172.21.15.37:0/2888845731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce4be0 msgr2=0x564cc0cd8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.174+0000 7f5a4f400640 1 --2- 172.21.15.37:0/2888845731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce4be0 0x564cc0cd8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.174+0000 7f5a4f400640 1 -- 172.21.15.37:0/2888845731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce22b0 msgr2=0x564cc0cecf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.174+0000 7f5a4f400640 1 --2- 172.21.15.37:0/2888845731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce22b0 0x564cc0cecf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.174+0000 7f5a4f400640 1 -- 172.21.15.37:0/2888845731 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cc0a20620 con 0x564cc0ce7620 2024-08-20T05:02:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.175+0000 7f5a4f400640 1 --2- 172.21.15.37:0/2888845731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce7620 0x564cc0ce9280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800c020 tx=0x7f5a4802b410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5955a158a455218 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.175+0000 7f5a3b400640 1 -- 172.21.15.37:0/2888845731 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48037040 con 0x564cc0ce7620 2024-08-20T05:02:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.176+0000 7f5a3b400640 1 -- 172.21.15.37:0/2888845731 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a48008040 con 0x564cc0ce7620 2024-08-20T05:02:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.176+0000 7f5a3b400640 1 -- 172.21.15.37:0/2888845731 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48040040 con 0x564cc0ce7620 2024-08-20T05:02:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.177+0000 7f5a58c6c740 1 -- 172.21.15.37:0/2888845731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce7620 msgr2=0x564cc0ce9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.177+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/2888845731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce7620 0x564cc0ce9280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800c020 tx=0x7f5a4802b410 comp rx=0 tx=0).stop 2024-08-20T05:02:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.177+0000 7f5a58c6c740 1 -- 172.21.15.37:0/2888845731 shutdown_connections 2024-08-20T05:02:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.177+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/2888845731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce7620 0x564cc0ce9280 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.178+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/2888845731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce4be0 0x564cc0cd8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.178+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/2888845731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce22b0 0x564cc0cecf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.178+0000 7f5a58c6c740 1 -- 172.21.15.37:0/2888845731 >> 172.21.15.37:0/2888845731 conn(0x564cc0cdd3b0 msgr2=0x564cc0cde090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.179+0000 7f5a58c6c740 1 -- 172.21.15.37:0/2888845731 shutdown_connections 2024-08-20T05:02:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.179+0000 7f5a58c6c740 1 -- 172.21.15.37:0/2888845731 wait complete. 2024-08-20T05:02:59.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.179+0000 7f5a58c6c740 1 -- start start 2024-08-20T05:02:59.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.179+0000 7f5a58c6c740 1 Processor -- start 2024-08-20T05:02:59.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.180+0000 7f5a58c6c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce22b0 0x564cc0cf08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.180+0000 7f5a58c6c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce4be0 0x564cc0cf0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.180+0000 7f5a58c6c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce7620 0x564cc0cf1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.180+0000 7f5a58c6c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5a501b2fc0 con 0x564cc0ce7620 2024-08-20T05:02:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.181+0000 7f5a58c6c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a501b28f0 con 0x564cc0ce4be0 2024-08-20T05:02:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.181+0000 7f5a58c6c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a501adb10 con 0x564cc0ce22b0 2024-08-20T05:02:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.181+0000 7f5a58c6c740 10 client.0 _ll_register_callbacks cb 0x7f5a40009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:02:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.181+0000 7f5a4f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce22b0 0x564cc0cf08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.181+0000 7f5a4f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce22b0 0x564cc0cf08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52322/0 (socket says 172.21.15.37:52322) 2024-08-20T05:02:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.181+0000 7f5a4f400640 1 -- 172.21.15.37:0/2838071451 learned_addr learned my addr 172.21.15.37:0/2838071451 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:02:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.181+0000 7f5a4e000640 1 --2- 172.21.15.37:0/2838071451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce4be0 0x564cc0cf0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.182+0000 7f5a4f400640 1 -- 172.21.15.37:0/2838071451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce4be0 msgr2=0x564cc0cf0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.182+0000 7f5a4f400640 1 --2- 172.21.15.37:0/2838071451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce4be0 0x564cc0cf0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.182+0000 7f5a4f400640 1 -- 172.21.15.37:0/2838071451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce7620 msgr2=0x564cc0cf1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:02:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.182+0000 7f5a4f400640 1 --2- 172.21.15.37:0/2838071451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce7620 0x564cc0cf1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.182+0000 7f5a4f400640 1 -- 172.21.15.37:0/2838071451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cc0cf2310 con 0x564cc0ce22b0 2024-08-20T05:02:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.182+0000 7f5a4e000640 1 --2- 172.21.15.37:0/2838071451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce4be0 0x564cc0cf0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:02:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.182+0000 7f5a4f400640 1 --2- 172.21.15.37:0/2838071451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce22b0 0x564cc0cf08e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5a48005e30 tx=0x7f5a48007470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d122156964d29401 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:02:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.182+0000 7f5a38c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:02:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.182+0000 7f5a38c00640 1 -- 172.21.15.37:0/2838071451 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a48055060 con 0x564cc0ce22b0 2024-08-20T05:02:59.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.183+0000 7f5a38c00640 1 -- 172.21.15.37:0/2838071451 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5a48007ca0 con 0x564cc0ce22b0 2024-08-20T05:02:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.183+0000 7f5a58c6c740 1 -- 172.21.15.37:0/2838071451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a48008040 con 0x564cc0ce22b0 2024-08-20T05:02:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.183+0000 7f5a38c00640 1 -- 172.21.15.37:0/2838071451 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5a48037040 con 0x564cc0ce22b0 2024-08-20T05:02:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.183+0000 7f5a58c6c740 10 client.25681 fetch_fsmap learned FSMap version 30 2024-08-20T05:02:59.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.183+0000 7f5a58c6c740 1 -- 172.21.15.37:0/2838071451 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564cc0cf36b0 con 0x564cc0ce22b0 2024-08-20T05:02:59.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.184+0000 7f5a38c00640 1 -- 172.21.15.37:0/2838071451 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a48003e20 con 0x564cc0ce22b0 2024-08-20T05:02:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.184+0000 7f5a38c00640 1 -- 172.21.15.37:0/2838071451 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8374+0+0 (secure 0 0 0) 0x7f5a48004020 con 0x564cc0ce22b0 2024-08-20T05:02:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.186+0000 7f5a58c6c740 10 client.25681 fetch_fsmap finished waiting for FSMap version 30 2024-08-20T05:02:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.186+0000 7f5a58c6c740 10 client.25681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:02:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.186+0000 7f5a58c6c740 20 client.25681 populate_metadata read hostname 'smithi037' 2024-08-20T05:02:59.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.186+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/2838071451 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564cc0d088b0 0x564cc0d755d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:02:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.187+0000 7f5a4e000640 1 --2- 172.21.15.37:0/2838071451 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564cc0d088b0 0x564cc0d755d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:02:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.187+0000 7f5a58c6c740 4 client.25681 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:02:59.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.187+0000 7f5a58c6c740 1 -- 172.21.15.37:0/2838071451 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f5a48008040 con 0x564cc0d088b0 2024-08-20T05:02:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.188+0000 7f5a4e000640 1 --2- 172.21.15.37:0/2838071451 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564cc0d088b0 0x564cc0d755d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59705381d5350beb server_cookie=e99d1fda6ebbc66d in_seq=0 out_seq=0 2024-08-20T05:02:59.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.189+0000 7f5a38c00640 10 client.25681 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:59.292 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:02:59.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.305+0000 7f5a38c00640 1 -- 172.21.15.37:0/2838071451 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f5a48008040 con 0x564cc0d088b0 2024-08-20T05:02:59.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.305+0000 7f5a38c00640 10 client.25681 handle_command_reply: tid=0 2024-08-20T05:02:59.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.305+0000 7f5a58c6c740 1 client.25681 shutdown 2024-08-20T05:02:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.309+0000 7f5a58c6c740 1 -- 172.21.15.37:0/2838071451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce22b0 msgr2=0x564cc0cf08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.309+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/2838071451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce22b0 0x564cc0cf08e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5a48005e30 tx=0x7f5a48007470 comp rx=0 tx=0).stop 2024-08-20T05:02:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.310+0000 7f5a58c6c740 1 -- 172.21.15.37:0/2838071451 shutdown_connections 2024-08-20T05:02:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.310+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/2838071451 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564cc0d088b0 0x564cc0d755d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.310+0000 7f5a38c00640 0 client.25681 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:02:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.310+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/2838071451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564cc0ce7620 0x564cc0cf1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.310+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/2838071451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564cc0ce4be0 0x564cc0cf0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.310+0000 7f5a58c6c740 1 --2- 172.21.15.37:0/2838071451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564cc0ce22b0 0x564cc0cf08e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.310+0000 7f5a58c6c740 1 -- 172.21.15.37:0/2838071451 >> 172.21.15.37:0/2838071451 conn(0x564cc0cdd3b0 msgr2=0x564cc0cd8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.312+0000 7f5a58c6c740 1 -- 172.21.15.37:0/2838071451 shutdown_connections 2024-08-20T05:02:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.312+0000 7f5a58c6c740 1 -- 172.21.15.37:0/2838071451 wait complete. 2024-08-20T05:02:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.312+0000 7f5a58c6c740 20 client.25681 trim_cache size 0 max 16384 2024-08-20T05:02:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:02:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:02:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:02:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:02:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.316+0000 7f5a55c00640 1 -- 172.21.15.37:0/1180219823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5a340b3c50 msgr2=0x7f5a340b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.316+0000 7f5a55c00640 1 --2- 172.21.15.37:0/1180219823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5a340b3c50 0x7f5a340b6110 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c0e4680 tx=0x7f5a3c00cf20 comp rx=0 tx=0).stop 2024-08-20T05:02:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.316+0000 7f5a55c00640 1 -- 172.21.15.37:0/1180219823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a500742d0 msgr2=0x7f5a501a4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:02:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.316+0000 7f5a55c00640 1 --2- 172.21.15.37:0/1180219823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a500742d0 0x7f5a501a4930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00e9f0 tx=0x7f5a3c00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.316+0000 7f5a55c00640 1 -- 172.21.15.37:0/1180219823 shutdown_connections 2024-08-20T05:02:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.316+0000 7f5a55c00640 1 --2- 172.21.15.37:0/1180219823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5a340b3c50 0x7f5a340b6110 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.316+0000 7f5a55c00640 1 --2- 172.21.15.37:0/1180219823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a5010abd0 0x7f5a501a31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.316+0000 7f5a55c00640 1 --2- 172.21.15.37:0/1180219823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a5010a210 0x7f5a501a4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.316+0000 7f5a55c00640 1 --2- 172.21.15.37:0/1180219823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a500742d0 0x7f5a501a4930 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:02:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.316+0000 7f5a55c00640 1 -- 172.21.15.37:0/1180219823 >> 172.21.15.37:0/1180219823 conn(0x7f5a5006f740 msgr2=0x7f5a5010d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:02:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.317+0000 7f5a55c00640 1 -- 172.21.15.37:0/1180219823 shutdown_connections 2024-08-20T05:02:59.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:02:59.317+0000 7f5a55c00640 1 -- 172.21.15.37:0/1180219823 wait complete. 2024-08-20T05:02:59.730 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:02:59 smithi037 ceph-mon[17265]: pgmap v423: 129 pgs: 129 active+clean; 360 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 54 MiB/s wr, 340 op/s 2024-08-20T05:02:59.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:02:59 smithi130 ceph-mon[22007]: pgmap v423: 129 pgs: 129 active+clean; 360 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 54 MiB/s wr, 340 op/s 2024-08-20T05:03:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.040+0000 7f715ec00640 1 -- 172.21.15.37:0/2930537630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715810aa50 msgr2=0x7f715810f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.040+0000 7f715ec00640 1 --2- 172.21.15.37:0/2930537630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715810aa50 0x7f715810f4f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7144009900 tx=0x7f714402b610 comp rx=0 tx=0).stop 2024-08-20T05:03:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.040+0000 7f715ec00640 1 -- 172.21.15.37:0/2930537630 shutdown_connections 2024-08-20T05:03:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.040+0000 7f715ec00640 1 --2- 172.21.15.37:0/2930537630 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7158114090 0x7f7158116480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.040+0000 7f715ec00640 1 --2- 172.21.15.37:0/2930537630 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715810aa50 0x7f715810f4f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.040+0000 7f715ec00640 1 --2- 172.21.15.37:0/2930537630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f715806a740 0x7f715810efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.040+0000 7f715ec00640 1 -- 172.21.15.37:0/2930537630 >> 172.21.15.37:0/2930537630 conn(0x7f715806dfe0 msgr2=0x7f715806e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.041+0000 7f715ec00640 1 -- 172.21.15.37:0/2930537630 shutdown_connections 2024-08-20T05:03:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.041+0000 7f715ec00640 1 -- 172.21.15.37:0/2930537630 wait complete. 2024-08-20T05:03:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.042+0000 7f715ec00640 1 Processor -- start 2024-08-20T05:03:00.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.043+0000 7f715ec00640 1 -- start start 2024-08-20T05:03:00.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.044+0000 7f715ec00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f715806a740 0x7f71581a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.044+0000 7f715ec00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715810aa50 0x7f71581a3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.044+0000 7f715ec00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7158114090 0x7f71581a91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.044+0000 7f715ec00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f71581190e0 con 0x7f715806a740 2024-08-20T05:03:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.044+0000 7f715ec00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7158118f60 con 0x7f7158114090 2024-08-20T05:03:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.044+0000 7f715ec00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7158119260 con 0x7f715810aa50 2024-08-20T05:03:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.044+0000 7f7157e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f715806a740 0x7f71581a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.045+0000 7f7157400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715810aa50 0x7f71581a3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.045+0000 7f7157e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f715806a740 0x7f71581a3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43776/0 (socket says 172.21.15.37:43776) 2024-08-20T05:03:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.045+0000 7f7157e00640 1 -- 172.21.15.37:0/1155636246 learned_addr learned my addr 172.21.15.37:0/1155636246 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.045+0000 7f715cc00640 1 --2- 172.21.15.37:0/1155636246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7158114090 0x7f71581a91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.045+0000 7f7157400640 1 -- 172.21.15.37:0/1155636246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7158114090 msgr2=0x7f71581a91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.045+0000 7f7157400640 1 --2- 172.21.15.37:0/1155636246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7158114090 0x7f71581a91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.045+0000 7f7157400640 1 -- 172.21.15.37:0/1155636246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f715806a740 msgr2=0x7f71581a3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.045+0000 7f7157400640 1 --2- 172.21.15.37:0/1155636246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f715806a740 0x7f71581a3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.045+0000 7f7157400640 1 -- 172.21.15.37:0/1155636246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71581a99b0 con 0x7f715810aa50 2024-08-20T05:03:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.046+0000 7f7157400640 1 --2- 172.21.15.37:0/1155636246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715810aa50 0x7f71581a3e40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f714402bb30 tx=0x7f71440315d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.046+0000 7f7154c00640 1 -- 172.21.15.37:0/1155636246 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714403f020 con 0x7f715810aa50 2024-08-20T05:03:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.046+0000 7f715ec00640 1 -- 172.21.15.37:0/1155636246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71581a9c40 con 0x7f715810aa50 2024-08-20T05:03:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.047+0000 7f715ec00640 1 -- 172.21.15.37:0/1155636246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f715819e590 con 0x7f715810aa50 2024-08-20T05:03:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.047+0000 7f7154c00640 1 -- 172.21.15.37:0/1155636246 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7144004460 con 0x7f715810aa50 2024-08-20T05:03:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.047+0000 7f7154c00640 1 -- 172.21.15.37:0/1155636246 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144036070 con 0x7f715810aa50 2024-08-20T05:03:00.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.051+0000 7f7161850740 1 Processor -- start 2024-08-20T05:03:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.052+0000 7f7161850740 1 -- start start 2024-08-20T05:03:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.052+0000 7f7161850740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f46940 0x55e471f46d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.052+0000 7f7161850740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f47260 0x55e471f52cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.052+0000 7f7161850740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f531f0 0x55e471f555e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.052+0000 7f7161850740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e471ebcaa0 con 0x55e471f531f0 2024-08-20T05:03:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.052+0000 7f7161850740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e471eabfa0 con 0x55e471f46940 2024-08-20T05:03:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.052+0000 7f7161850740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e471eaffe0 con 0x55e471f47260 2024-08-20T05:03:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.053+0000 7f715cc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f46940 0x55e471f46d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.053+0000 7f715cc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f46940 0x55e471f46d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56080/0 (socket says 172.21.15.37:56080) 2024-08-20T05:03:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.053+0000 7f715cc00640 1 -- 172.21.15.37:0/2110680155 learned_addr learned my addr 172.21.15.37:0/2110680155 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.053+0000 7f715cc00640 1 -- 172.21.15.37:0/2110680155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f47260 msgr2=0x55e471f52cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:03:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.053+0000 7f715cc00640 1 --2- 172.21.15.37:0/2110680155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f47260 0x55e471f52cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.053+0000 7f715cc00640 1 -- 172.21.15.37:0/2110680155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f531f0 msgr2=0x55e471f555e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:03:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.053+0000 7f715cc00640 1 --2- 172.21.15.37:0/2110680155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f531f0 0x55e471f555e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.053+0000 7f715cc00640 1 -- 172.21.15.37:0/2110680155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e471e52420 con 0x55e471f46940 2024-08-20T05:03:00.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.054+0000 7f715cc00640 1 --2- 172.21.15.37:0/2110680155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f46940 0x55e471f46d20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7150007ee0 tx=0x7f715000f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=898e24ab7fdd381 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.054+0000 7f714d200640 1 -- 172.21.15.37:0/2110680155 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7150010840 con 0x55e471f46940 2024-08-20T05:03:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.054+0000 7f714d200640 1 -- 172.21.15.37:0/2110680155 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71500183f0 con 0x55e471f46940 2024-08-20T05:03:00.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.055+0000 7f714d200640 1 -- 172.21.15.37:0/2110680155 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7150017600 con 0x55e471f46940 2024-08-20T05:03:00.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.056+0000 7f7161850740 1 -- 172.21.15.37:0/2110680155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f46940 msgr2=0x55e471f46d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:00.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.056+0000 7f7161850740 1 --2- 172.21.15.37:0/2110680155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f46940 0x55e471f46d20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7150007ee0 tx=0x7f715000f790 comp rx=0 tx=0).stop 2024-08-20T05:03:00.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.057+0000 7f7161850740 1 -- 172.21.15.37:0/2110680155 shutdown_connections 2024-08-20T05:03:00.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.057+0000 7f7161850740 1 --2- 172.21.15.37:0/2110680155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f531f0 0x55e471f555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.057+0000 7f7161850740 1 --2- 172.21.15.37:0/2110680155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f47260 0x55e471f52cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.057+0000 7f7161850740 1 --2- 172.21.15.37:0/2110680155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f46940 0x55e471f46d20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.057+0000 7f7161850740 1 -- 172.21.15.37:0/2110680155 >> 172.21.15.37:0/2110680155 conn(0x55e471f44770 msgr2=0x55e471f45910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:00.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.057+0000 7f7154c00640 1 -- 172.21.15.37:0/1155636246 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7144042020 con 0x7f715810aa50 2024-08-20T05:03:00.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.058+0000 7f7161850740 1 -- 172.21.15.37:0/2110680155 shutdown_connections 2024-08-20T05:03:00.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.058+0000 7f7161850740 1 -- 172.21.15.37:0/2110680155 wait complete. 2024-08-20T05:03:00.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.059+0000 7f7161850740 1 -- start start 2024-08-20T05:03:00.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.060+0000 7f7161850740 1 Processor -- start 2024-08-20T05:03:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.061+0000 7f7161850740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f46940 0x55e471f52b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.061+0000 7f7161850740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f47260 0x55e471f4ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.061+0000 7f7161850740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f50550 0x55e471f509d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.061+0000 7f715cc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f46940 0x55e471f52b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.061+0000 7f715cc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f46940 0x55e471f52b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52352/0 (socket says 172.21.15.37:52352) 2024-08-20T05:03:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.061+0000 7f7161850740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e471d0e700 con 0x55e471f47260 2024-08-20T05:03:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.061+0000 7f7161850740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e471e47290 con 0x55e471f50550 2024-08-20T05:03:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.061+0000 7f7161850740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e471f55e70 con 0x55e471f46940 2024-08-20T05:03:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.061+0000 7f7161850740 10 client.0 _ll_register_callbacks cb 0x55e471ea61c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.062+0000 7f715cc00640 1 -- 172.21.15.37:0/505427112 learned_addr learned my addr 172.21.15.37:0/505427112 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.062+0000 7f715cc00640 1 -- 172.21.15.37:0/505427112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f50550 msgr2=0x55e471f509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.062+0000 7f7157e00640 1 --2- 172.21.15.37:0/505427112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f47260 0x55e471f4ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.063+0000 7f7157400640 1 --2- 172.21.15.37:0/505427112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f50550 0x55e471f509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.063+0000 7f715cc00640 1 --2- 172.21.15.37:0/505427112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f50550 0x55e471f509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.063+0000 7f715cc00640 1 -- 172.21.15.37:0/505427112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f47260 msgr2=0x55e471f4ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.063+0000 7f715cc00640 1 --2- 172.21.15.37:0/505427112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f47260 0x55e471f4ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.063+0000 7f715cc00640 1 -- 172.21.15.37:0/505427112 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e471c0b650 con 0x55e471f46940 2024-08-20T05:03:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.063+0000 7f7157e00640 1 --2- 172.21.15.37:0/505427112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f47260 0x55e471f4ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:03:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.063+0000 7f7157400640 1 --2- 172.21.15.37:0/505427112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f50550 0x55e471f509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:03:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.065+0000 7f715cc00640 1 --2- 172.21.15.37:0/505427112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f46940 0x55e471f52b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7150007eb0 tx=0x7f7150018c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebc88fedc9a3e724 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.065+0000 7f7141600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:03:00.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.066+0000 7f7141600640 1 -- 172.21.15.37:0/505427112 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7150026070 con 0x55e471f46940 2024-08-20T05:03:00.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.066+0000 7f7141600640 1 -- 172.21.15.37:0/505427112 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7150004040 con 0x55e471f46940 2024-08-20T05:03:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.067+0000 7f7154c00640 1 --2- 172.21.15.37:0/1155636246 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f713c0b3b60 0x7f713c0b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.067+0000 7f7161850740 1 -- 172.21.15.37:0/505427112 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71500183f0 con 0x55e471f46940 2024-08-20T05:03:00.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.068+0000 7f7154c00640 1 -- 172.21.15.37:0/1155636246 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7144104330 con 0x7f715810aa50 2024-08-20T05:03:00.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.068+0000 7f7157e00640 1 --2- 172.21.15.37:0/1155636246 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f713c0b3b60 0x7f713c0b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:00.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.068+0000 7f7141600640 1 -- 172.21.15.37:0/505427112 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7150030050 con 0x55e471f46940 2024-08-20T05:03:00.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.069+0000 7f7161850740 10 client.25690 fetch_fsmap learned FSMap version 30 2024-08-20T05:03:00.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.069+0000 7f7161850740 1 -- 172.21.15.37:0/505427112 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e471f61c60 con 0x55e471f46940 2024-08-20T05:03:00.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.069+0000 7f7141600640 1 -- 172.21.15.37:0/505427112 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71500183f0 con 0x55e471f46940 2024-08-20T05:03:00.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.070+0000 7f7141600640 1 -- 172.21.15.37:0/505427112 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 30) ==== 8374+0+0 (secure 0 0 0) 0x7f71500109f0 con 0x55e471f46940 2024-08-20T05:03:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.070+0000 7f7161850740 10 client.25690 fetch_fsmap finished waiting for FSMap version 30 2024-08-20T05:03:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.070+0000 7f7161850740 10 client.25690 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:03:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.070+0000 7f7161850740 20 client.25690 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:00.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.070+0000 7f7161850740 1 --2- 172.21.15.37:0/505427112 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55e471f63010 0x55e471f65400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.070+0000 7f7161850740 4 client.25690 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:03:00.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.070+0000 7f7161850740 1 -- 172.21.15.37:0/505427112 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e471ebe9f0 con 0x55e471f63010 2024-08-20T05:03:00.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.070+0000 7f7157400640 1 --2- 172.21.15.37:0/505427112 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55e471f63010 0x55e471f65400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:00.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.071+0000 7f7141600640 10 client.25690 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:03:00.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.072+0000 7f7157400640 1 --2- 172.21.15.37:0/505427112 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55e471f63010 0x55e471f65400 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=85974313050e7111 server_cookie=4bd6131ef7abb859 in_seq=0 out_seq=0 2024-08-20T05:03:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.072+0000 7f7157e00640 1 --2- 172.21.15.37:0/1155636246 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f713c0b3b60 0x7f713c0b6020 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55e471f3ed50 tx=0x7f7148012040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:00.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.073+0000 7f7141600640 1 -- 172.21.15.37:0/505427112 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e471ebe9f0 con 0x55e471f63010 2024-08-20T05:03:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.073+0000 7f7141600640 10 client.25690 handle_command_reply: tid=0 2024-08-20T05:03:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.073+0000 7f7161850740 1 client.25690 shutdown 2024-08-20T05:03:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.073+0000 7f7161850740 1 -- 172.21.15.37:0/505427112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f46940 msgr2=0x55e471f52b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.073+0000 7f7161850740 1 --2- 172.21.15.37:0/505427112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f46940 0x55e471f52b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7150007eb0 tx=0x7f7150018c40 comp rx=0 tx=0).stop 2024-08-20T05:03:00.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.074+0000 7f7161850740 1 -- 172.21.15.37:0/505427112 shutdown_connections 2024-08-20T05:03:00.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.074+0000 7f7161850740 1 --2- 172.21.15.37:0/505427112 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55e471f63010 0x55e471f65400 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.074+0000 7f7161850740 1 --2- 172.21.15.37:0/505427112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f50550 0x55e471f509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.074+0000 7f7161850740 1 --2- 172.21.15.37:0/505427112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f47260 0x55e471f4ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.074+0000 7f7161850740 1 --2- 172.21.15.37:0/505427112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f46940 0x55e471f52b20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.074+0000 7f7161850740 1 -- 172.21.15.37:0/505427112 >> 172.21.15.37:0/505427112 conn(0x55e471f44770 msgr2=0x55e471f4a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:00.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.074+0000 7f7141600640 0 client.25690 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:03:00.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.075+0000 7f7161850740 1 -- 172.21.15.37:0/505427112 shutdown_connections 2024-08-20T05:03:00.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.075+0000 7f7161850740 1 -- 172.21.15.37:0/505427112 wait complete. 2024-08-20T05:03:00.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.076+0000 7f7161850740 20 client.25690 trim_cache size 0 max 16384 2024-08-20T05:03:00.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.110+0000 7f7161850740 1 Processor -- start 2024-08-20T05:03:00.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.110+0000 7f7161850740 1 -- start start 2024-08-20T05:03:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.110+0000 7f7161850740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f46940 0x55e471f5e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.110+0000 7f7161850740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f47260 0x55e471f5ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.110+0000 7f7161850740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f50550 0x55e471f6aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.110+0000 7f7161850740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f713800fc00 con 0x55e471f47260 2024-08-20T05:03:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.110+0000 7f7161850740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7138011770 con 0x55e471f46940 2024-08-20T05:03:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.110+0000 7f7161850740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f71380102d0 con 0x55e471f50550 2024-08-20T05:03:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.111+0000 7f7157e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f46940 0x55e471f5e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.111+0000 7f7157400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f47260 0x55e471f5ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.111+0000 7f7157e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f46940 0x55e471f5e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56102/0 (socket says 172.21.15.37:56102) 2024-08-20T05:03:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.111+0000 7f7157e00640 1 -- 172.21.15.37:0/2261858252 learned_addr learned my addr 172.21.15.37:0/2261858252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:00.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.112+0000 7f7157400640 1 -- 172.21.15.37:0/2261858252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f50550 msgr2=0x55e471f6aa60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:03:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.112+0000 7f715cc00640 1 --2- 172.21.15.37:0/2261858252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f50550 0x55e471f6aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.112+0000 7f7157400640 1 --2- 172.21.15.37:0/2261858252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f50550 0x55e471f6aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.112+0000 7f7157400640 1 -- 172.21.15.37:0/2261858252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f46940 msgr2=0x55e471f5e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.112+0000 7f7157400640 1 --2- 172.21.15.37:0/2261858252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f46940 0x55e471f5e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.112+0000 7f7157400640 1 -- 172.21.15.37:0/2261858252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e471f5f2d0 con 0x55e471f47260 2024-08-20T05:03:00.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.112+0000 7f7157e00640 1 --2- 172.21.15.37:0/2261858252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f46940 0x55e471f5e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:00.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.113+0000 7f715cc00640 1 --2- 172.21.15.37:0/2261858252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f50550 0x55e471f6aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:03:00.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.113+0000 7f7157400640 1 --2- 172.21.15.37:0/2261858252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f47260 0x55e471f5ec60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55e471f468b0 tx=0x7f714402b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5314d0ac2acdb189 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:02:59 smithi135 ceph-mon[22342]: pgmap v423: 129 pgs: 129 active+clean; 360 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 54 MiB/s wr, 340 op/s 2024-08-20T05:03:00.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.113+0000 7f7143e00640 1 -- 172.21.15.37:0/2261858252 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71440abe80 con 0x55e471f47260 2024-08-20T05:03:00.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.114+0000 7f7143e00640 1 -- 172.21.15.37:0/2261858252 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7144104160 con 0x55e471f47260 2024-08-20T05:03:00.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.114+0000 7f7143e00640 1 -- 172.21.15.37:0/2261858252 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71440035f0 con 0x55e471f47260 2024-08-20T05:03:00.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.115+0000 7f7161850740 1 -- 172.21.15.37:0/2261858252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f47260 msgr2=0x55e471f5ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:00.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.115+0000 7f7161850740 1 --2- 172.21.15.37:0/2261858252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f47260 0x55e471f5ec60 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55e471f468b0 tx=0x7f714402b610 comp rx=0 tx=0).stop 2024-08-20T05:03:00.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.116+0000 7f7161850740 1 -- 172.21.15.37:0/2261858252 shutdown_connections 2024-08-20T05:03:00.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.116+0000 7f7161850740 1 --2- 172.21.15.37:0/2261858252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f50550 0x55e471f6aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.116+0000 7f7161850740 1 --2- 172.21.15.37:0/2261858252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f47260 0x55e471f5ec60 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.116+0000 7f7161850740 1 --2- 172.21.15.37:0/2261858252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f46940 0x55e471f5e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.116+0000 7f7161850740 1 -- 172.21.15.37:0/2261858252 >> 172.21.15.37:0/2261858252 conn(0x55e471f44770 msgr2=0x55e471f5e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:00.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.116+0000 7f7161850740 1 -- 172.21.15.37:0/2261858252 shutdown_connections 2024-08-20T05:03:00.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.117+0000 7f7161850740 1 -- 172.21.15.37:0/2261858252 wait complete. 2024-08-20T05:03:00.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.117+0000 7f7161850740 1 -- start start 2024-08-20T05:03:00.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.118+0000 7f7161850740 1 Processor -- start 2024-08-20T05:03:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.122+0000 7f7161850740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f46940 0x55e471f58fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.122+0000 7f7161850740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f50550 0x55e471f594e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.122+0000 7f7161850740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f59a20 0x55e471fcca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.122+0000 7f7161850740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7138011070 con 0x55e471f50550 2024-08-20T05:03:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.122+0000 7f7161850740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f71380109a0 con 0x55e471f59a20 2024-08-20T05:03:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.122+0000 7f7161850740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f713800dbe0 con 0x55e471f46940 2024-08-20T05:03:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.123+0000 7f7161850740 10 client.0 _ll_register_callbacks cb 0x7f7150007d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.123+0000 7f7157e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f46940 0x55e471f58fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.123+0000 7f7157400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f50550 0x55e471f594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:00.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.123+0000 7f7157e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f46940 0x55e471f58fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52374/0 (socket says 172.21.15.37:52374) 2024-08-20T05:03:00.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.123+0000 7f7157400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f50550 0x55e471f594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43808/0 (socket says 172.21.15.37:43808) 2024-08-20T05:03:00.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.123+0000 7f7157e00640 1 -- 172.21.15.37:0/4236378379 learned_addr learned my addr 172.21.15.37:0/4236378379 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:00.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.123+0000 7f715cc00640 1 --2- 172.21.15.37:0/4236378379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f59a20 0x55e471fcca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:00.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.124+0000 7f7157400640 1 -- 172.21.15.37:0/4236378379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f46940 msgr2=0x55e471f58fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:00.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.124+0000 7f7157400640 1 --2- 172.21.15.37:0/4236378379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f46940 0x55e471f58fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.124+0000 7f7157400640 1 -- 172.21.15.37:0/4236378379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f59a20 msgr2=0x55e471fcca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:00.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.124+0000 7f7157400640 1 --2- 172.21.15.37:0/4236378379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f59a20 0x55e471fcca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.124+0000 7f7157400640 1 -- 172.21.15.37:0/4236378379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e471f45440 con 0x55e471f50550 2024-08-20T05:03:00.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.124+0000 7f7157e00640 1 --2- 172.21.15.37:0/4236378379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f46940 0x55e471f58fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:00.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.125+0000 7f7157400640 1 --2- 172.21.15.37:0/4236378379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f50550 0x55e471f594e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7144005ab0 tx=0x7f71440cf3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03c348a204d8609 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:00.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.125+0000 7f7141600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:03:00.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.125+0000 7f7141600640 1 -- 172.21.15.37:0/4236378379 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71440ea060 con 0x55e471f50550 2024-08-20T05:03:00.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.125+0000 7f7141600640 1 -- 172.21.15.37:0/4236378379 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f71440c7170 con 0x55e471f50550 2024-08-20T05:03:00.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.126+0000 7f7161850740 1 -- 172.21.15.37:0/4236378379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7144104160 con 0x55e471f50550 2024-08-20T05:03:00.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.126+0000 7f7141600640 1 -- 172.21.15.37:0/4236378379 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f71440a6050 con 0x55e471f50550 2024-08-20T05:03:00.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.126+0000 7f7161850740 10 client.15651 fetch_fsmap learned FSMap version 30 2024-08-20T05:03:00.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.126+0000 7f7161850740 1 -- 172.21.15.37:0/4236378379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55e471fcdf40 con 0x55e471f50550 2024-08-20T05:03:00.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.126+0000 7f7141600640 1 -- 172.21.15.37:0/4236378379 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7144104160 con 0x55e471f50550 2024-08-20T05:03:00.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.127+0000 7f7141600640 1 -- 172.21.15.37:0/4236378379 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 30) ==== 8374+0+0 (secure 0 0 0) 0x7f71440a9020 con 0x55e471f50550 2024-08-20T05:03:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.127+0000 7f7161850740 10 client.15651 fetch_fsmap finished waiting for FSMap version 30 2024-08-20T05:03:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.127+0000 7f7161850740 10 client.15651 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:03:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.127+0000 7f7161850740 20 client.15651 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.127+0000 7f7161850740 1 --2- 172.21.15.37:0/4236378379 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55e471fce490 0x55e471fd08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.128+0000 7f7161850740 4 client.15651 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:03:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.128+0000 7f7161850740 1 -- 172.21.15.37:0/4236378379 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e471eba490 con 0x55e471fce490 2024-08-20T05:03:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.128+0000 7f7157e00640 1 --2- 172.21.15.37:0/4236378379 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55e471fce490 0x55e471fd08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.129+0000 7f7157e00640 1 --2- 172.21.15.37:0/4236378379 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55e471fce490 0x55e471fd08b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3f73d3159c800abf server_cookie=a01a7c935569ece8 in_seq=0 out_seq=0 2024-08-20T05:03:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.129+0000 7f7141600640 10 client.15651 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:03:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.129+0000 7f7141600640 1 -- 172.21.15.37:0/4236378379 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e471eba490 con 0x55e471fce490 2024-08-20T05:03:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.129+0000 7f7141600640 10 client.15651 handle_command_reply: tid=0 2024-08-20T05:03:00.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.129+0000 7f7161850740 1 client.15651 shutdown 2024-08-20T05:03:00.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.130+0000 7f7161850740 1 -- 172.21.15.37:0/4236378379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f50550 msgr2=0x55e471f594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:00.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.130+0000 7f7161850740 1 --2- 172.21.15.37:0/4236378379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f50550 0x55e471f594e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7144005ab0 tx=0x7f71440cf3a0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.131+0000 7f7161850740 1 -- 172.21.15.37:0/4236378379 shutdown_connections 2024-08-20T05:03:00.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.131+0000 7f7161850740 1 --2- 172.21.15.37:0/4236378379 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55e471fce490 0x55e471fd08b0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.131+0000 7f7161850740 1 --2- 172.21.15.37:0/4236378379 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e471f59a20 0x55e471fcca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.131+0000 7f7161850740 1 --2- 172.21.15.37:0/4236378379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e471f50550 0x55e471f594e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.131+0000 7f7161850740 1 --2- 172.21.15.37:0/4236378379 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e471f46940 0x55e471f58fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.131+0000 7f7161850740 1 -- 172.21.15.37:0/4236378379 >> 172.21.15.37:0/4236378379 conn(0x55e471f44770 msgr2=0x55e471f5e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.131+0000 7f7141600640 0 client.15651 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:03:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.132+0000 7f7161850740 1 -- 172.21.15.37:0/4236378379 shutdown_connections 2024-08-20T05:03:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.132+0000 7f7161850740 1 -- 172.21.15.37:0/4236378379 wait complete. 2024-08-20T05:03:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.132+0000 7f7161850740 20 client.15651 trim_cache size 0 max 16384 2024-08-20T05:03:00.135 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:03:00.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.134+0000 7f715ec00640 1 -- 172.21.15.37:0/1155636246 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f713c0b3b60 msgr2=0x7f713c0b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.134+0000 7f715ec00640 1 --2- 172.21.15.37:0/1155636246 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f713c0b3b60 0x7f713c0b6020 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55e471f3ed50 tx=0x7f7148012040 comp rx=0 tx=0).stop 2024-08-20T05:03:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.134+0000 7f715ec00640 1 -- 172.21.15.37:0/1155636246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715810aa50 msgr2=0x7f71581a3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.134+0000 7f715ec00640 1 --2- 172.21.15.37:0/1155636246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715810aa50 0x7f71581a3e40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f714402bb30 tx=0x7f71440315d0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.134+0000 7f715ec00640 1 -- 172.21.15.37:0/1155636246 shutdown_connections 2024-08-20T05:03:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.134+0000 7f715ec00640 1 --2- 172.21.15.37:0/1155636246 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f713c0b3b60 0x7f713c0b6020 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.134+0000 7f715ec00640 1 --2- 172.21.15.37:0/1155636246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7158114090 0x7f71581a91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.134+0000 7f715ec00640 1 --2- 172.21.15.37:0/1155636246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715810aa50 0x7f71581a3e40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.134+0000 7f715ec00640 1 --2- 172.21.15.37:0/1155636246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f715806a740 0x7f71581a3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:00.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.134+0000 7f715ec00640 1 -- 172.21.15.37:0/1155636246 >> 172.21.15.37:0/1155636246 conn(0x7f715806dfe0 msgr2=0x7f715810ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:00.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.134+0000 7f715ec00640 1 -- 172.21.15.37:0/1155636246 shutdown_connections 2024-08-20T05:03:00.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:00.135+0000 7f715ec00640 1 -- 172.21.15.37:0/1155636246 wait complete. 2024-08-20T05:03:01.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T05:03:01.760 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:03:01.945 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:01 smithi037 ceph-mon[17265]: pgmap v424: 129 pgs: 129 active+clean; 445 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 64 MiB/s wr, 291 op/s 2024-08-20T05:03:01.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:01 smithi130 ceph-mon[22007]: pgmap v424: 129 pgs: 129 active+clean; 445 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 64 MiB/s wr, 291 op/s 2024-08-20T05:03:02.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:01 smithi135 ceph-mon[22342]: pgmap v424: 129 pgs: 129 active+clean; 445 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 208 KiB/s rd, 64 MiB/s wr, 291 op/s 2024-08-20T05:03:02.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.499+0000 7f5865c00640 1 -- 172.21.15.37:0/3416605318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5860108e80 msgr2=0x7f586010f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:02.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.499+0000 7f5865c00640 1 --2- 172.21.15.37:0/3416605318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5860108e80 0x7f586010f680 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5858009900 tx=0x7f585802a400 comp rx=0 tx=0).stop 2024-08-20T05:03:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.499+0000 7f5865c00640 1 -- 172.21.15.37:0/3416605318 shutdown_connections 2024-08-20T05:03:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.499+0000 7f5865c00640 1 --2- 172.21.15.37:0/3416605318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5860108e80 0x7f586010f680 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.499+0000 7f5865c00640 1 --2- 172.21.15.37:0/3416605318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5860108500 0x7f5860108940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.499+0000 7f5865c00640 1 --2- 172.21.15.37:0/3416605318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5860102af0 0x7f5860102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.499+0000 7f5865c00640 1 -- 172.21.15.37:0/3416605318 >> 172.21.15.37:0/3416605318 conn(0x7f58600fe540 msgr2=0x7f5860100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.499+0000 7f5865c00640 1 -- 172.21.15.37:0/3416605318 shutdown_connections 2024-08-20T05:03:02.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.500+0000 7f5865c00640 1 -- 172.21.15.37:0/3416605318 wait complete. 2024-08-20T05:03:02.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.502+0000 7f5865c00640 1 Processor -- start 2024-08-20T05:03:02.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.503+0000 7f5865c00640 1 -- start start 2024-08-20T05:03:02.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.504+0000 7f5865c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5860102af0 0x7f5860074490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.504+0000 7f5865c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5860108500 0x7f58600749d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.505+0000 7f5865c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5860108e80 0x7f586006e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.505+0000 7f585ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5860102af0 0x7f5860074490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.505+0000 7f585ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5860102af0 0x7f5860074490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52398/0 (socket says 172.21.15.37:52398) 2024-08-20T05:03:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.505+0000 7f585ea00640 1 -- 172.21.15.37:0/1785453776 learned_addr learned my addr 172.21.15.37:0/1785453776 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.505+0000 7f5865c00640 1 -- 172.21.15.37:0/1785453776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f586006d160 con 0x7f5860108500 2024-08-20T05:03:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.505+0000 7f585e000640 1 --2- 172.21.15.37:0/1785453776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5860108500 0x7f58600749d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.506+0000 7f5865c00640 1 -- 172.21.15.37:0/1785453776 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f586006cfe0 con 0x7f5860108e80 2024-08-20T05:03:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.506+0000 7f5865c00640 1 -- 172.21.15.37:0/1785453776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f586006d2e0 con 0x7f5860102af0 2024-08-20T05:03:02.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.506+0000 7f585f400640 1 --2- 172.21.15.37:0/1785453776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5860108e80 0x7f586006e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.507+0000 7f585ea00640 1 -- 172.21.15.37:0/1785453776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5860108e80 msgr2=0x7f586006e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:02.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.507+0000 7f585ea00640 1 --2- 172.21.15.37:0/1785453776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5860108e80 0x7f586006e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.507+0000 7f585ea00640 1 -- 172.21.15.37:0/1785453776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5860108500 msgr2=0x7f58600749d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:02.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.507+0000 7f585ea00640 1 --2- 172.21.15.37:0/1785453776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5860108500 0x7f58600749d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.507+0000 7f585ea00640 1 -- 172.21.15.37:0/1785453776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586006f090 con 0x7f5860102af0 2024-08-20T05:03:02.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.508+0000 7f585ea00640 1 --2- 172.21.15.37:0/1785453776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5860102af0 0x7f5860074490 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f585000c890 tx=0x7f585000cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:02.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.508+0000 7f5857400640 1 -- 172.21.15.37:0/1785453776 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5850004220 con 0x7f5860102af0 2024-08-20T05:03:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.509+0000 7f5857400640 1 -- 172.21.15.37:0/1785453776 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58500043c0 con 0x7f5860102af0 2024-08-20T05:03:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.509+0000 7f5857400640 1 -- 172.21.15.37:0/1785453776 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5850004a00 con 0x7f5860102af0 2024-08-20T05:03:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.509+0000 7f5865c00640 1 -- 172.21.15.37:0/1785453776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f586006f380 con 0x7f5860102af0 2024-08-20T05:03:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.509+0000 7f5865c00640 1 -- 172.21.15.37:0/1785453776 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5860075240 con 0x7f5860102af0 2024-08-20T05:03:02.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.514+0000 7f5857400640 1 -- 172.21.15.37:0/1785453776 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5850020020 con 0x7f5860102af0 2024-08-20T05:03:02.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.515+0000 7f5857400640 1 --2- 172.21.15.37:0/1785453776 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f58400b3d60 0x7f58400b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.516+0000 7f5857400640 1 -- 172.21.15.37:0/1785453776 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f58500e7a00 con 0x7f5860102af0 2024-08-20T05:03:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.517+0000 7f585e000640 1 --2- 172.21.15.37:0/1785453776 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f58400b3d60 0x7f58400b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.518+0000 7f585e000640 1 --2- 172.21.15.37:0/1785453776 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f58400b3d60 0x7f58400b6220 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5848005c40 tx=0x7f5848005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.518+0000 7f58685fb740 1 Processor -- start 2024-08-20T05:03:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.519+0000 7f58685fb740 1 -- start start 2024-08-20T05:03:02.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.521+0000 7f58685fb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8eef940 0x5599d8eefd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.521+0000 7f58685fb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8ef0260 0x5599d8efbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.521+0000 7f585ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8eef940 0x5599d8eefd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.521+0000 7f585ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8eef940 0x5599d8eefd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43850/0 (socket says 172.21.15.37:43850) 2024-08-20T05:03:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.521+0000 7f585ea00640 1 -- 172.21.15.37:0/1803072928 learned_addr learned my addr 172.21.15.37:0/1803072928 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.521+0000 7f585e000640 1 --2- 172.21.15.37:0/1803072928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8ef0260 0x5599d8efbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.521+0000 7f58685fb740 1 --2- 172.21.15.37:0/1803072928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8efc1f0 0x5599d8efe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.521+0000 7f58685fb740 1 -- 172.21.15.37:0/1803072928 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5599d8e65aa0 con 0x5599d8eef940 2024-08-20T05:03:02.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.521+0000 7f58685fb740 1 -- 172.21.15.37:0/1803072928 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5599d8e54fa0 con 0x5599d8efc1f0 2024-08-20T05:03:02.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.521+0000 7f58685fb740 1 -- 172.21.15.37:0/1803072928 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5599d8e58fe0 con 0x5599d8ef0260 2024-08-20T05:03:02.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.522+0000 7f585f400640 1 --2- 172.21.15.37:0/1803072928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8efc1f0 0x5599d8efe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.523+0000 7f585e000640 1 -- 172.21.15.37:0/1803072928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8efc1f0 msgr2=0x5599d8efe5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:02.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.523+0000 7f585e000640 1 --2- 172.21.15.37:0/1803072928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8efc1f0 0x5599d8efe5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.523+0000 7f585e000640 1 -- 172.21.15.37:0/1803072928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8eef940 msgr2=0x5599d8eefd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:02.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.523+0000 7f585e000640 1 --2- 172.21.15.37:0/1803072928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8eef940 0x5599d8eefd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.523+0000 7f585e000640 1 -- 172.21.15.37:0/1803072928 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599d8dfb420 con 0x5599d8ef0260 2024-08-20T05:03:02.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.523+0000 7f585e000640 1 --2- 172.21.15.37:0/1803072928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8ef0260 0x5599d8efbcb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f58600741e0 tx=0x7f5848013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67e8b1679c0cf13f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:02.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.524+0000 7f584fe00640 1 -- 172.21.15.37:0/1803072928 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584801f740 con 0x5599d8ef0260 2024-08-20T05:03:02.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.524+0000 7f584fe00640 1 -- 172.21.15.37:0/1803072928 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5848024070 con 0x5599d8ef0260 2024-08-20T05:03:02.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.524+0000 7f584fe00640 1 -- 172.21.15.37:0/1803072928 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584801ecf0 con 0x5599d8ef0260 2024-08-20T05:03:02.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.525+0000 7f58685fb740 1 -- 172.21.15.37:0/1803072928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8ef0260 msgr2=0x5599d8efbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:02.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.525+0000 7f58685fb740 1 --2- 172.21.15.37:0/1803072928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8ef0260 0x5599d8efbcb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f58600741e0 tx=0x7f5848013000 comp rx=0 tx=0).stop 2024-08-20T05:03:02.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.525+0000 7f58685fb740 1 -- 172.21.15.37:0/1803072928 shutdown_connections 2024-08-20T05:03:02.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.525+0000 7f58685fb740 1 --2- 172.21.15.37:0/1803072928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8efc1f0 0x5599d8efe5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.525+0000 7f58685fb740 1 --2- 172.21.15.37:0/1803072928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8ef0260 0x5599d8efbcb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.525+0000 7f58685fb740 1 --2- 172.21.15.37:0/1803072928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8eef940 0x5599d8eefd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.525+0000 7f58685fb740 1 -- 172.21.15.37:0/1803072928 >> 172.21.15.37:0/1803072928 conn(0x5599d8eed770 msgr2=0x5599d8eee910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:02.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.525+0000 7f58685fb740 1 -- 172.21.15.37:0/1803072928 shutdown_connections 2024-08-20T05:03:02.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.525+0000 7f58685fb740 1 -- 172.21.15.37:0/1803072928 wait complete. 2024-08-20T05:03:02.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.526+0000 7f58685fb740 1 -- start start 2024-08-20T05:03:02.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.526+0000 7f58685fb740 1 Processor -- start 2024-08-20T05:03:02.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.528+0000 7f58685fb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8eef940 0x5599d8efba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.528+0000 7f58685fb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8ef0260 0x5599d8ef8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.528+0000 7f58685fb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8efc1f0 0x5599d8ef93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.529+0000 7f585ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8eef940 0x5599d8efba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.529+0000 7f585ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8eef940 0x5599d8efba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43860/0 (socket says 172.21.15.37:43860) 2024-08-20T05:03:02.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.529+0000 7f585f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8efc1f0 0x5599d8ef93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.529+0000 7f585ea00640 1 -- 172.21.15.37:0/2091349374 learned_addr learned my addr 172.21.15.37:0/2091349374 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:02.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.529+0000 7f58685fb740 1 -- 172.21.15.37:0/2091349374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5599d8cb7700 con 0x5599d8eef940 2024-08-20T05:03:02.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.529+0000 7f58685fb740 1 -- 172.21.15.37:0/2091349374 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5599d8df0290 con 0x5599d8efc1f0 2024-08-20T05:03:02.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.529+0000 7f58685fb740 1 -- 172.21.15.37:0/2091349374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5599d8efee70 con 0x5599d8ef0260 2024-08-20T05:03:02.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.529+0000 7f585e000640 1 --2- 172.21.15.37:0/2091349374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8ef0260 0x5599d8ef8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.529+0000 7f58685fb740 10 client.0 _ll_register_callbacks cb 0x5599d8e4f1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:02.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.530+0000 7f585f400640 1 -- 172.21.15.37:0/2091349374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8ef0260 msgr2=0x5599d8ef8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:02.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.530+0000 7f585f400640 1 --2- 172.21.15.37:0/2091349374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8ef0260 0x5599d8ef8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.530+0000 7f585f400640 1 -- 172.21.15.37:0/2091349374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8eef940 msgr2=0x5599d8efba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:02.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.530+0000 7f585f400640 1 --2- 172.21.15.37:0/2091349374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8eef940 0x5599d8efba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.530+0000 7f585f400640 1 -- 172.21.15.37:0/2091349374 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599d8bb4650 con 0x5599d8efc1f0 2024-08-20T05:03:02.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.530+0000 7f58685fb740 1 -- 172.21.15.37:0/2091349374 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5848024070 con 0x5599d8efc1f0 2024-08-20T05:03:02.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.530+0000 7f585f400640 1 --2- 172.21.15.37:0/2091349374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8efc1f0 0x5599d8ef93f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5858009230 tx=0x7f5858004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7a3641ab17890f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:02.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.530+0000 7f584cc00640 10 client.25688 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:03:02.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.531+0000 7f584cc00640 1 -- 172.21.15.37:0/2091349374 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858035030 con 0x5599d8efc1f0 2024-08-20T05:03:02.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.531+0000 7f584cc00640 1 -- 172.21.15.37:0/2091349374 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f58580046c0 con 0x5599d8efc1f0 2024-08-20T05:03:02.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.531+0000 7f584cc00640 1 -- 172.21.15.37:0/2091349374 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5858004920 con 0x5599d8efc1f0 2024-08-20T05:03:02.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.531+0000 7f58685fb740 10 client.25688 fetch_fsmap learned FSMap version 31 2024-08-20T05:03:02.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.531+0000 7f58685fb740 1 -- 172.21.15.37:0/2091349374 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({fsmap=31}) -- 0x5599d8f12f00 con 0x5599d8efc1f0 2024-08-20T05:03:02.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.532+0000 7f584cc00640 1 -- 172.21.15.37:0/2091349374 <== mon.2 v2:172.21.15.130:3300/0 4 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f5858004ac0 con 0x5599d8efc1f0 2024-08-20T05:03:02.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.532+0000 7f58685fb740 10 client.25688 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T05:03:02.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.532+0000 7f58685fb740 10 client.25688 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:03:02.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.532+0000 7f58685fb740 20 client.25688 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:02.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.532+0000 7f58685fb740 1 --2- 172.21.15.37:0/2091349374 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5599d8f143a0 0x5599d8f16820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.532+0000 7f58685fb740 4 client.25688 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:03:02.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.532+0000 7f58685fb740 1 -- 172.21.15.37:0/2091349374 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599d8e679f0 con 0x5599d8f143a0 2024-08-20T05:03:02.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.533+0000 7f585ea00640 1 --2- 172.21.15.37:0/2091349374 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5599d8f143a0 0x5599d8f16820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.534+0000 7f585ea00640 1 --2- 172.21.15.37:0/2091349374 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5599d8f143a0 0x5599d8f16820 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=abe0b48e2b5b988a server_cookie=c570e7b9d93a4322 in_seq=0 out_seq=0 2024-08-20T05:03:02.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.535+0000 7f584cc00640 10 client.25688 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:03:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.535+0000 7f584cc00640 1 -- 172.21.15.37:0/2091349374 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5599d8e679f0 con 0x5599d8f143a0 2024-08-20T05:03:02.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.535+0000 7f584cc00640 10 client.25688 handle_command_reply: tid=0 2024-08-20T05:03:02.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.536+0000 7f58685fb740 1 client.25688 shutdown 2024-08-20T05:03:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.536+0000 7f58685fb740 1 -- 172.21.15.37:0/2091349374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8efc1f0 msgr2=0x5599d8ef93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.536+0000 7f58685fb740 1 --2- 172.21.15.37:0/2091349374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8efc1f0 0x5599d8ef93f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5858009230 tx=0x7f5858004610 comp rx=0 tx=0).stop 2024-08-20T05:03:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.537+0000 7f58685fb740 1 -- 172.21.15.37:0/2091349374 shutdown_connections 2024-08-20T05:03:02.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.537+0000 7f58685fb740 1 --2- 172.21.15.37:0/2091349374 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5599d8f143a0 0x5599d8f16820 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.537+0000 7f58685fb740 1 --2- 172.21.15.37:0/2091349374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8efc1f0 0x5599d8ef93f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.537+0000 7f58685fb740 1 --2- 172.21.15.37:0/2091349374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8ef0260 0x5599d8ef8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.537+0000 7f58685fb740 1 --2- 172.21.15.37:0/2091349374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8eef940 0x5599d8efba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.537+0000 7f58685fb740 1 -- 172.21.15.37:0/2091349374 >> 172.21.15.37:0/2091349374 conn(0x5599d8eed770 msgr2=0x5599d8ef32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.537+0000 7f584cc00640 0 client.25688 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:03:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.537+0000 7f58685fb740 1 -- 172.21.15.37:0/2091349374 shutdown_connections 2024-08-20T05:03:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.537+0000 7f58685fb740 1 -- 172.21.15.37:0/2091349374 wait complete. 2024-08-20T05:03:02.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.537+0000 7f58685fb740 20 client.25688 trim_cache size 0 max 16384 2024-08-20T05:03:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.561+0000 7f58685fb740 1 Processor -- start 2024-08-20T05:03:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.561+0000 7f58685fb740 1 -- start start 2024-08-20T05:03:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.561+0000 7f58685fb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8eef940 0x5599d8f08020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.561+0000 7f58685fb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8ef0260 0x5599d8ef4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.562+0000 7f58685fb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8efc1f0 0x5599d8f1c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.562+0000 7f58685fb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f583c00fbb0 con 0x5599d8eef940 2024-08-20T05:03:02.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.562+0000 7f58685fb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f583c011750 con 0x5599d8efc1f0 2024-08-20T05:03:02.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.562+0000 7f58685fb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f583c010280 con 0x5599d8ef0260 2024-08-20T05:03:02.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.562+0000 7f585ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8eef940 0x5599d8f08020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.562+0000 7f585f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8efc1f0 0x5599d8f1c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.562+0000 7f585f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8efc1f0 0x5599d8f1c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56142/0 (socket says 172.21.15.37:56142) 2024-08-20T05:03:02.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.562+0000 7f585e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8ef0260 0x5599d8ef4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.562+0000 7f585f400640 1 -- 172.21.15.37:0/2163799852 learned_addr learned my addr 172.21.15.37:0/2163799852 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.563+0000 7f585e000640 1 -- 172.21.15.37:0/2163799852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8efc1f0 msgr2=0x5599d8f1c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.563+0000 7f585e000640 1 --2- 172.21.15.37:0/2163799852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8efc1f0 0x5599d8f1c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.563+0000 7f585e000640 1 -- 172.21.15.37:0/2163799852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8eef940 msgr2=0x5599d8f08020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.563+0000 7f585e000640 1 --2- 172.21.15.37:0/2163799852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8eef940 0x5599d8f08020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.563+0000 7f585e000640 1 -- 172.21.15.37:0/2163799852 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599d8ee9110 con 0x5599d8ef0260 2024-08-20T05:03:02.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.564+0000 7f585e000640 1 --2- 172.21.15.37:0/2163799852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8ef0260 0x5599d8ef4370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f584801e870 tx=0x7f5848009670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec1b561b3cfa7920 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.565+0000 7f584f400640 1 -- 172.21.15.37:0/2163799852 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5848004a00 con 0x5599d8ef0260 2024-08-20T05:03:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.565+0000 7f584f400640 1 -- 172.21.15.37:0/2163799852 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f584801ed50 con 0x5599d8ef0260 2024-08-20T05:03:02.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.565+0000 7f584f400640 1 -- 172.21.15.37:0/2163799852 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f584801f9a0 con 0x5599d8ef0260 2024-08-20T05:03:02.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.568+0000 7f58685fb740 1 -- 172.21.15.37:0/2163799852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8ef0260 msgr2=0x5599d8ef4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:02.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.568+0000 7f58685fb740 1 --2- 172.21.15.37:0/2163799852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8ef0260 0x5599d8ef4370 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f584801e870 tx=0x7f5848009670 comp rx=0 tx=0).stop 2024-08-20T05:03:02.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.568+0000 7f58685fb740 1 -- 172.21.15.37:0/2163799852 shutdown_connections 2024-08-20T05:03:02.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.568+0000 7f58685fb740 1 --2- 172.21.15.37:0/2163799852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8efc1f0 0x5599d8f1c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.568+0000 7f58685fb740 1 --2- 172.21.15.37:0/2163799852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8ef0260 0x5599d8ef4370 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.568+0000 7f58685fb740 1 --2- 172.21.15.37:0/2163799852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8eef940 0x5599d8f08020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.568+0000 7f58685fb740 1 -- 172.21.15.37:0/2163799852 >> 172.21.15.37:0/2163799852 conn(0x5599d8eed770 msgr2=0x5599d8ef3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:02.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.568+0000 7f58685fb740 1 -- 172.21.15.37:0/2163799852 shutdown_connections 2024-08-20T05:03:02.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.568+0000 7f58685fb740 1 -- 172.21.15.37:0/2163799852 wait complete. 2024-08-20T05:03:02.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.569+0000 7f58685fb740 1 -- start start 2024-08-20T05:03:02.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.570+0000 7f58685fb740 1 Processor -- start 2024-08-20T05:03:02.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.570+0000 7f58685fb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8eef940 0x5599d8f00000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.570+0000 7f58685fb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8ef0260 0x5599d8f00540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.570+0000 7f58685fb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8efc1f0 0x5599d8f00a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.570+0000 7f58685fb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f583c011020 con 0x5599d8ef0260 2024-08-20T05:03:02.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.570+0000 7f58685fb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f583c010950 con 0x5599d8eef940 2024-08-20T05:03:02.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.570+0000 7f58685fb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f583c00db90 con 0x5599d8efc1f0 2024-08-20T05:03:02.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.571+0000 7f58685fb740 10 client.0 _ll_register_callbacks cb 0x7f5858009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:02.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.571+0000 7f585ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8eef940 0x5599d8f00000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.571+0000 7f585ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8eef940 0x5599d8f00000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56150/0 (socket says 172.21.15.37:56150) 2024-08-20T05:03:02.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.571+0000 7f585ea00640 1 -- 172.21.15.37:0/2296109377 learned_addr learned my addr 172.21.15.37:0/2296109377 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:02.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.571+0000 7f585f400640 1 --2- 172.21.15.37:0/2296109377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8efc1f0 0x5599d8f00a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.572+0000 7f585e000640 1 --2- 172.21.15.37:0/2296109377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8ef0260 0x5599d8f00540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.572+0000 7f585f400640 1 -- 172.21.15.37:0/2296109377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8eef940 msgr2=0x5599d8f00000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:02.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.572+0000 7f585f400640 1 --2- 172.21.15.37:0/2296109377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8eef940 0x5599d8f00000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.572+0000 7f585f400640 1 -- 172.21.15.37:0/2296109377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8ef0260 msgr2=0x5599d8f00540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:02.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.573+0000 7f585f400640 1 --2- 172.21.15.37:0/2296109377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8ef0260 0x5599d8f00540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.573+0000 7f585f400640 1 -- 172.21.15.37:0/2296109377 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599d8f7e140 con 0x5599d8efc1f0 2024-08-20T05:03:02.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.573+0000 7f585e000640 1 --2- 172.21.15.37:0/2296109377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8ef0260 0x5599d8f00540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:03:02.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.573+0000 7f585f400640 1 --2- 172.21.15.37:0/2296109377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8efc1f0 0x5599d8f00a80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5858005ec0 tx=0x7f5858009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d36eee52e21f577 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:02.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.573+0000 7f584cc00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:03:02.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.573+0000 7f584cc00640 1 -- 172.21.15.37:0/2296109377 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858035040 con 0x5599d8efc1f0 2024-08-20T05:03:02.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.574+0000 7f584cc00640 1 -- 172.21.15.37:0/2296109377 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5858003750 con 0x5599d8efc1f0 2024-08-20T05:03:02.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.574+0000 7f58685fb740 1 -- 172.21.15.37:0/2296109377 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f584801ed50 con 0x5599d8efc1f0 2024-08-20T05:03:02.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.574+0000 7f584cc00640 1 -- 172.21.15.37:0/2296109377 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5858003950 con 0x5599d8efc1f0 2024-08-20T05:03:02.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.574+0000 7f58685fb740 10 client.25711 fetch_fsmap learned FSMap version 31 2024-08-20T05:03:02.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.574+0000 7f58685fb740 1 -- 172.21.15.37:0/2296109377 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5599d8f7f420 con 0x5599d8efc1f0 2024-08-20T05:03:02.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.575+0000 7f584cc00640 1 -- 172.21.15.37:0/2296109377 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5848024070 con 0x5599d8efc1f0 2024-08-20T05:03:02.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.575+0000 7f584cc00640 1 -- 172.21.15.37:0/2296109377 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7f5858031c00 con 0x5599d8efc1f0 2024-08-20T05:03:02.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.576+0000 7f58685fb740 10 client.25711 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T05:03:02.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.576+0000 7f58685fb740 10 client.25711 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:03:02.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.576+0000 7f58685fb740 20 client.25711 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:02.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.576+0000 7f58685fb740 1 --2- 172.21.15.37:0/2296109377 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5599d8f7fb00 0x5599d8f81f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:02.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.576+0000 7f58685fb740 4 client.25711 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:03:02.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.576+0000 7f58685fb740 1 -- 172.21.15.37:0/2296109377 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f584801ed50 con 0x5599d8f7fb00 2024-08-20T05:03:02.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.577+0000 7f585ea00640 1 --2- 172.21.15.37:0/2296109377 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5599d8f7fb00 0x5599d8f81f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:02.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.578+0000 7f584cc00640 10 client.25711 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:03:02.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.578+0000 7f585ea00640 1 --2- 172.21.15.37:0/2296109377 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5599d8f7fb00 0x5599d8f81f20 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b11843511b78ab42 server_cookie=e6c5ee4cfe2c081c in_seq=0 out_seq=0 2024-08-20T05:03:02.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.578+0000 7f584cc00640 1 -- 172.21.15.37:0/2296109377 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f584801ed50 con 0x5599d8f7fb00 2024-08-20T05:03:02.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.578+0000 7f584cc00640 10 client.25711 handle_command_reply: tid=0 2024-08-20T05:03:02.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.578+0000 7f58685fb740 1 client.25711 shutdown 2024-08-20T05:03:02.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.579+0000 7f58685fb740 1 -- 172.21.15.37:0/2296109377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8efc1f0 msgr2=0x5599d8f00a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:02.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.579+0000 7f58685fb740 1 --2- 172.21.15.37:0/2296109377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8efc1f0 0x5599d8f00a80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5858005ec0 tx=0x7f5858009260 comp rx=0 tx=0).stop 2024-08-20T05:03:02.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.579+0000 7f58685fb740 1 -- 172.21.15.37:0/2296109377 shutdown_connections 2024-08-20T05:03:02.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.579+0000 7f58685fb740 1 --2- 172.21.15.37:0/2296109377 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5599d8f7fb00 0x5599d8f81f20 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.580+0000 7f58685fb740 1 --2- 172.21.15.37:0/2296109377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5599d8efc1f0 0x5599d8f00a80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.580+0000 7f58685fb740 1 --2- 172.21.15.37:0/2296109377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5599d8ef0260 0x5599d8f00540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.580+0000 7f584cc00640 0 client.25711 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:03:02.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.580+0000 7f58685fb740 1 --2- 172.21.15.37:0/2296109377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5599d8eef940 0x5599d8f00000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.580+0000 7f58685fb740 1 -- 172.21.15.37:0/2296109377 >> 172.21.15.37:0/2296109377 conn(0x5599d8eed770 msgr2=0x5599d8ef4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:02.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.583+0000 7f58685fb740 1 -- 172.21.15.37:0/2296109377 shutdown_connections 2024-08-20T05:03:02.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.583+0000 7f58685fb740 1 -- 172.21.15.37:0/2296109377 wait complete. 2024-08-20T05:03:02.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.583+0000 7f58685fb740 20 client.25711 trim_cache size 0 max 16384 2024-08-20T05:03:02.585 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:03:02.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.584+0000 7f5865c00640 1 -- 172.21.15.37:0/1785453776 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f58400b3d60 msgr2=0x7f58400b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:02.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.584+0000 7f5865c00640 1 --2- 172.21.15.37:0/1785453776 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f58400b3d60 0x7f58400b6220 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5848005c40 tx=0x7f5848005bd0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.584+0000 7f5865c00640 1 -- 172.21.15.37:0/1785453776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5860102af0 msgr2=0x7f5860074490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:02.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.584+0000 7f5865c00640 1 --2- 172.21.15.37:0/1785453776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5860102af0 0x7f5860074490 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f585000c890 tx=0x7f585000cd50 comp rx=0 tx=0).stop 2024-08-20T05:03:02.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.585+0000 7f5865c00640 1 -- 172.21.15.37:0/1785453776 shutdown_connections 2024-08-20T05:03:02.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.585+0000 7f5865c00640 1 --2- 172.21.15.37:0/1785453776 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f58400b3d60 0x7f58400b6220 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.585+0000 7f5865c00640 1 --2- 172.21.15.37:0/1785453776 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5860108e80 0x7f586006e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.585+0000 7f5865c00640 1 --2- 172.21.15.37:0/1785453776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5860108500 0x7f58600749d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.585+0000 7f5865c00640 1 --2- 172.21.15.37:0/1785453776 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5860102af0 0x7f5860074490 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:02.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.585+0000 7f5865c00640 1 -- 172.21.15.37:0/1785453776 >> 172.21.15.37:0/1785453776 conn(0x7f58600fe540 msgr2=0x7f5860104ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:02.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.587+0000 7f5865c00640 1 -- 172.21.15.37:0/1785453776 shutdown_connections 2024-08-20T05:03:02.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:02.588+0000 7f5865c00640 1 -- 172.21.15.37:0/1785453776 wait complete. 2024-08-20T05:03:02.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:02 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:03:03.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:02 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:03:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 5.0 s, 2594.9 tps, lat 37.084 ms stddev 43.702 2024-08-20T05:03:03.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:02 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:03:03.685 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-08-20T05:03:03.685 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:03:03.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:03 smithi130 ceph-mon[22007]: pgmap v425: 129 pgs: 129 active+clean; 499 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 63 MiB/s wr, 122 op/s 2024-08-20T05:03:04.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:03 smithi037 ceph-mon[17265]: pgmap v425: 129 pgs: 129 active+clean; 499 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 63 MiB/s wr, 122 op/s 2024-08-20T05:03:04.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:03 smithi135 ceph-mon[22342]: pgmap v425: 129 pgs: 129 active+clean; 499 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 63 MiB/s wr, 122 op/s 2024-08-20T05:03:04.211 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T05:03:04.419 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:03:05.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.234+0000 7f2d33c00640 1 -- 172.21.15.37:0/1624429493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d2c10aa00 msgr2=0x7f2d2c10efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:05.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.234+0000 7f2d33c00640 1 --2- 172.21.15.37:0/1624429493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d2c10aa00 0x7f2d2c10efb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009930 tx=0x7f2d1802a440 comp rx=0 tx=0).stop 2024-08-20T05:03:05.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.235+0000 7f2d33c00640 1 -- 172.21.15.37:0/1624429493 shutdown_connections 2024-08-20T05:03:05.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.235+0000 7f2d33c00640 1 --2- 172.21.15.37:0/1624429493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2c10f4f0 0x7f2d2c10f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:05.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.235+0000 7f2d33c00640 1 --2- 172.21.15.37:0/1624429493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d2c10aa00 0x7f2d2c10efb0 secure :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2d18009930 tx=0x7f2d1802a440 comp rx=0 tx=0).stop 2024-08-20T05:03:05.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.235+0000 7f2d33c00640 1 --2- 172.21.15.37:0/1624429493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d2c10a0e0 0x7f2d2c10a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:05.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.235+0000 7f2d33c00640 1 -- 172.21.15.37:0/1624429493 >> 172.21.15.37:0/1624429493 conn(0x7f2d2c06dfe0 msgr2=0x7f2d2c06e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:05.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.235+0000 7f2d33c00640 1 -- 172.21.15.37:0/1624429493 shutdown_connections 2024-08-20T05:03:05.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.237+0000 7f2d33c00640 1 -- 172.21.15.37:0/1624429493 wait complete. 2024-08-20T05:03:05.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.238+0000 7f2d33c00640 1 Processor -- start 2024-08-20T05:03:05.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.239+0000 7f2d33c00640 1 -- start start 2024-08-20T05:03:05.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.239+0000 7f2d33c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d2c10a0e0 0x7f2d2c117620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:05.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.239+0000 7f2d33c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2c10f4f0 0x7f2d2c117b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:05.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.240+0000 7f2d33c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d2c1180a0 0x7f2d2c1afb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:05.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.240+0000 7f2d31200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d2c10a0e0 0x7f2d2c117620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:05.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.240+0000 7f2d33c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c11b340 con 0x7f2d2c10a0e0 2024-08-20T05:03:05.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.240+0000 7f2d33c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c11b1c0 con 0x7f2d2c10f4f0 2024-08-20T05:03:05.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.240+0000 7f2d33c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2d2c11b4c0 con 0x7f2d2c1180a0 2024-08-20T05:03:05.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.240+0000 7f2d2be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2c10f4f0 0x7f2d2c117b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:05.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.240+0000 7f2d2be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2c10f4f0 0x7f2d2c117b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:35660/0 (socket says 172.21.15.37:35660) 2024-08-20T05:03:05.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.240+0000 7f2d2be00640 1 -- 172.21.15.37:0/1901223647 learned_addr learned my addr 172.21.15.37:0/1901223647 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:05.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.241+0000 7f2d31200640 1 -- 172.21.15.37:0/1901223647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d2c1180a0 msgr2=0x7f2d2c1afb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T05:03:05.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.241+0000 7f2d31200640 1 --2- 172.21.15.37:0/1901223647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d2c1180a0 0x7f2d2c1afb20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:05.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.241+0000 7f2d31200640 1 -- 172.21.15.37:0/1901223647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2c10f4f0 msgr2=0x7f2d2c117b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:05.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.241+0000 7f2d31200640 1 --2- 172.21.15.37:0/1901223647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2c10f4f0 0x7f2d2c117b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:05.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.241+0000 7f2d31200640 1 -- 172.21.15.37:0/1901223647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d2c1b0190 con 0x7f2d2c10a0e0 2024-08-20T05:03:05.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.241+0000 7f2d2be00640 1 --2- 172.21.15.37:0/1901223647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2c10f4f0 0x7f2d2c117b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:05.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.242+0000 7f2d31200640 1 --2- 172.21.15.37:0/1901223647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d2c10a0e0 0x7f2d2c117620 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000b3f0 tx=0x7f2d2000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:05.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.243+0000 7f2d29600640 1 -- 172.21.15.37:0/1901223647 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20015020 con 0x7f2d2c10a0e0 2024-08-20T05:03:05.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.243+0000 7f2d29600640 1 -- 172.21.15.37:0/1901223647 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d20011ce0 con 0x7f2d2c10a0e0 2024-08-20T05:03:05.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.243+0000 7f2d29600640 1 -- 172.21.15.37:0/1901223647 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d20010d80 con 0x7f2d2c10a0e0 2024-08-20T05:03:05.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.243+0000 7f2d33c00640 1 -- 172.21.15.37:0/1901223647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d2c1b0480 con 0x7f2d2c10a0e0 2024-08-20T05:03:05.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.243+0000 7f2d33c00640 1 -- 172.21.15.37:0/1901223647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d2c1b09c0 con 0x7f2d2c10a0e0 2024-08-20T05:03:05.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.245+0000 7f2d33c00640 1 -- 172.21.15.37:0/1901223647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d2c074990 con 0x7f2d2c10a0e0 2024-08-20T05:03:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.253+0000 7f2d29600640 1 -- 172.21.15.37:0/1901223647 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2d20018020 con 0x7f2d2c10a0e0 2024-08-20T05:03:05.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.256+0000 7f2d29600640 1 --2- 172.21.15.37:0/1901223647 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2d140b3d80 0x7f2d140b6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:05.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.256+0000 7f2d29600640 1 -- 172.21.15.37:0/1901223647 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2d200e3c70 con 0x7f2d2c10a0e0 2024-08-20T05:03:05.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.257+0000 7f2d2be00640 1 --2- 172.21.15.37:0/1901223647 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2d140b3d80 0x7f2d140b6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.259+0000 7f2d2be00640 1 --2- 172.21.15.37:0/1901223647 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2d140b3d80 0x7f2d140b6240 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2d18000c00 tx=0x7f2d18031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:05.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.263+0000 7f2d29600640 1 -- 172.21.15.37:0/1901223647 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f2d2001f020 con 0x7f2d2c10a0e0 2024-08-20T05:03:05.325 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:03:05.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.703+0000 7f2d33c00640 1 -- 172.21.15.37:0/1901223647 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d2c1b0e30 con 0x7f2d2c10a0e0 2024-08-20T05:03:05.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.705+0000 7f2d29600640 1 -- 172.21.15.37:0/1901223647 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11983 (secure 0 0 0) 0x7f2d200aafa0 con 0x7f2d2c10a0e0 2024-08-20T05:03:05.708 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:03:05.709 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"btime":"2024-08-20T05:03:01:630181+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:03:01.269814+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:03:05.709 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 31 2024-08-20T05:03:05.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.709+0000 7f2d33c00640 1 -- 172.21.15.37:0/1901223647 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2d140b3d80 msgr2=0x7f2d140b6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:05.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.709+0000 7f2d33c00640 1 --2- 172.21.15.37:0/1901223647 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2d140b3d80 0x7f2d140b6240 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2d18000c00 tx=0x7f2d18031400 comp rx=0 tx=0).stop 2024-08-20T05:03:05.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.709+0000 7f2d33c00640 1 -- 172.21.15.37:0/1901223647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d2c10a0e0 msgr2=0x7f2d2c117620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:05.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.709+0000 7f2d33c00640 1 --2- 172.21.15.37:0/1901223647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d2c10a0e0 0x7f2d2c117620 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000b3f0 tx=0x7f2d2000b8b0 comp rx=0 tx=0).stop 2024-08-20T05:03:05.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.710+0000 7f2d33c00640 1 -- 172.21.15.37:0/1901223647 shutdown_connections 2024-08-20T05:03:05.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.710+0000 7f2d33c00640 1 --2- 172.21.15.37:0/1901223647 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2d140b3d80 0x7f2d140b6240 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:05.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.710+0000 7f2d33c00640 1 --2- 172.21.15.37:0/1901223647 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d2c1180a0 0x7f2d2c1afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:05.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.710+0000 7f2d33c00640 1 --2- 172.21.15.37:0/1901223647 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d2c10f4f0 0x7f2d2c117b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:05.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.710+0000 7f2d33c00640 1 --2- 172.21.15.37:0/1901223647 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d2c10a0e0 0x7f2d2c117620 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:05.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.710+0000 7f2d33c00640 1 -- 172.21.15.37:0/1901223647 >> 172.21.15.37:0/1901223647 conn(0x7f2d2c06dfe0 msgr2=0x7f2d2c10ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:05.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.710+0000 7f2d33c00640 1 -- 172.21.15.37:0/1901223647 shutdown_connections 2024-08-20T05:03:05.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:05.710+0000 7f2d33c00640 1 -- 172.21.15.37:0/1901223647 wait complete. 2024-08-20T05:03:05.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:05 smithi037 ceph-mon[17265]: pgmap v426: 129 pgs: 129 active+clean; 679 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 60 MiB/s wr, 210 op/s 2024-08-20T05:03:05.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:05 smithi130 ceph-mon[22007]: pgmap v426: 129 pgs: 129 active+clean; 679 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 60 MiB/s wr, 210 op/s 2024-08-20T05:03:06.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:05 smithi135 ceph-mon[22342]: pgmap v426: 129 pgs: 129 active+clean; 679 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 60 MiB/s wr, 210 op/s 2024-08-20T05:03:06.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.278+0000 7fa2aaa00640 1 -- 172.21.15.37:0/4125035166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2a410a6d0 msgr2=0x7fa2a410ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:06.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.278+0000 7fa2aaa00640 1 --2- 172.21.15.37:0/4125035166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2a410a6d0 0x7fa2a410ab10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa294009900 tx=0x7fa29402a420 comp rx=0 tx=0).stop 2024-08-20T05:03:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.280+0000 7fa2aaa00640 1 -- 172.21.15.37:0/4125035166 shutdown_connections 2024-08-20T05:03:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.280+0000 7fa2aaa00640 1 --2- 172.21.15.37:0/4125035166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a410b050 0x7fa2a4111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.280+0000 7fa2aaa00640 1 --2- 172.21.15.37:0/4125035166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2a410a6d0 0x7fa2a410ab10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.280+0000 7fa2aaa00640 1 --2- 172.21.15.37:0/4125035166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2a4104cc0 0x7fa2a41050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.280+0000 7fa2aaa00640 1 -- 172.21.15.37:0/4125035166 >> 172.21.15.37:0/4125035166 conn(0x7fa2a41006f0 msgr2=0x7fa2a4102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.281+0000 7fa2aaa00640 1 -- 172.21.15.37:0/4125035166 shutdown_connections 2024-08-20T05:03:06.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.281+0000 7fa2aaa00640 1 -- 172.21.15.37:0/4125035166 wait complete. 2024-08-20T05:03:06.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.286+0000 7fa2aaa00640 1 Processor -- start 2024-08-20T05:03:06.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.286+0000 7fa2aaa00640 1 -- start start 2024-08-20T05:03:06.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.288+0000 7fa2aaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a4104cc0 0x7fa2a40773e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.288+0000 7fa2aaa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2a410a6d0 0x7fa2a4077920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.289+0000 7fa2a3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a4104cc0 0x7fa2a40773e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:06.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.290+0000 7fa29be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2a410a6d0 0x7fa2a4077920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:06.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.290+0000 7fa29be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2a410a6d0 0x7fa2a4077920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:35682/0 (socket says 172.21.15.37:35682) 2024-08-20T05:03:06.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.290+0000 7fa2a3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a4104cc0 0x7fa2a40773e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35670/0 (socket says 172.21.15.37:35670) 2024-08-20T05:03:06.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.290+0000 7fa2aaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2a410b050 0x7fa2a4077e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.290+0000 7fa2aaa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a4114d60 con 0x7fa2a410b050 2024-08-20T05:03:06.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.290+0000 7fa2aaa00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a4114be0 con 0x7fa2a410a6d0 2024-08-20T05:03:06.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.290+0000 7fa2aaa00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a4114ee0 con 0x7fa2a4104cc0 2024-08-20T05:03:06.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.290+0000 7fa29be00640 1 -- 172.21.15.37:0/2871599116 learned_addr learned my addr 172.21.15.37:0/2871599116 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:06.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.291+0000 7fa2a3e00640 1 -- 172.21.15.37:0/2871599116 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2a410a6d0 msgr2=0x7fa2a4077920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:06.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.291+0000 7fa2a3e00640 1 --2- 172.21.15.37:0/2871599116 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2a410a6d0 0x7fa2a4077920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.291+0000 7fa2a3e00640 1 -- 172.21.15.37:0/2871599116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2a410b050 msgr2=0x7fa2a4077e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:06.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.291+0000 7fa2a3e00640 1 --2- 172.21.15.37:0/2871599116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2a410b050 0x7fa2a4077e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.291+0000 7fa2a3e00640 1 -- 172.21.15.37:0/2871599116 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a41ab740 con 0x7fa2a4104cc0 2024-08-20T05:03:06.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.292+0000 7fa2a3e00640 1 --2- 172.21.15.37:0/2871599116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a4104cc0 0x7fa2a40773e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00c970 tx=0x7fa28c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:06.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.293+0000 7fa2a1600640 1 -- 172.21.15.37:0/2871599116 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c007bb0 con 0x7fa2a4104cc0 2024-08-20T05:03:06.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.293+0000 7fa2a1600640 1 -- 172.21.15.37:0/2871599116 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa28c007d50 con 0x7fa2a4104cc0 2024-08-20T05:03:06.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.293+0000 7fa2a1600640 1 -- 172.21.15.37:0/2871599116 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c018820 con 0x7fa2a4104cc0 2024-08-20T05:03:06.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.293+0000 7fa2aaa00640 1 -- 172.21.15.37:0/2871599116 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a41aba30 con 0x7fa2a4104cc0 2024-08-20T05:03:06.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.294+0000 7fa2aaa00640 1 -- 172.21.15.37:0/2871599116 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a41abf40 con 0x7fa2a4104cc0 2024-08-20T05:03:06.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.307+0000 7fa2a1600640 1 -- 172.21.15.37:0/2871599116 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa28c00f450 con 0x7fa2a4104cc0 2024-08-20T05:03:06.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.308+0000 7fa2ad5ff740 1 Processor -- start 2024-08-20T05:03:06.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.309+0000 7fa2ad5ff740 1 -- start start 2024-08-20T05:03:06.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.311+0000 7fa2ad5ff740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013d2990 0x5630013d2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.311+0000 7fa2a1600640 1 --2- 172.21.15.37:0/2871599116 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2880b3d10 0x7fa2880b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.311+0000 7fa2a1600640 1 -- 172.21.15.37:0/2871599116 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa28c046060 con 0x7fa2a4104cc0 2024-08-20T05:03:06.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.311+0000 7fa2ad5ff740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d32b0 0x5630013ded00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.311+0000 7fa2ad5ff740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013df240 0x5630013e1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.311+0000 7fa2ad5ff740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563001348aa0 con 0x5630013df240 2024-08-20T05:03:06.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.311+0000 7fa2ad5ff740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563001337fa0 con 0x5630013d2990 2024-08-20T05:03:06.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.311+0000 7fa2ad5ff740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56300133bfe0 con 0x5630013d32b0 2024-08-20T05:03:06.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.311+0000 7fa2a8a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013d2990 0x5630013d2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:06.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.311+0000 7fa2a8a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013d2990 0x5630013d2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:35688/0 (socket says 172.21.15.37:35688) 2024-08-20T05:03:06.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.311+0000 7fa2a8a00640 1 -- 172.21.15.37:0/3756483279 learned_addr learned my addr 172.21.15.37:0/3756483279 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:06.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.312+0000 7fa29be00640 1 --2- 172.21.15.37:0/3756483279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d32b0 0x5630013ded00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:06.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.313+0000 7fa29be00640 1 -- 172.21.15.37:0/3756483279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013d2990 msgr2=0x5630013d2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:06.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.313+0000 7fa2a8a00640 1 --2- 172.21.15.37:0/3756483279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013df240 0x5630013e1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:06.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.313+0000 7fa29be00640 1 --2- 172.21.15.37:0/3756483279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013d2990 0x5630013d2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.313+0000 7fa29be00640 1 -- 172.21.15.37:0/3756483279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013df240 msgr2=0x5630013e1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:06.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.313+0000 7fa29be00640 1 --2- 172.21.15.37:0/3756483279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013df240 0x5630013e1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.313+0000 7fa29be00640 1 -- 172.21.15.37:0/3756483279 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630012de420 con 0x5630013d32b0 2024-08-20T05:03:06.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.313+0000 7fa2a8a00640 1 --2- 172.21.15.37:0/3756483279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013df240 0x5630013e1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:03:06.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.314+0000 7fa29be00640 1 --2- 172.21.15.37:0/3756483279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d32b0 0x5630013ded00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa2a407aef0 tx=0x7fa294004310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f0bb7ffd88c87ae server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:06.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.315+0000 7fa299200640 1 -- 172.21.15.37:0/3756483279 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29403f070 con 0x5630013d32b0 2024-08-20T05:03:06.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.315+0000 7fa299200640 1 -- 172.21.15.37:0/3756483279 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2940047a0 con 0x5630013d32b0 2024-08-20T05:03:06.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.315+0000 7fa299200640 1 -- 172.21.15.37:0/3756483279 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294035070 con 0x5630013d32b0 2024-08-20T05:03:06.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.316+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/3756483279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d32b0 msgr2=0x5630013ded00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:06.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.316+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/3756483279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d32b0 0x5630013ded00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa2a407aef0 tx=0x7fa294004310 comp rx=0 tx=0).stop 2024-08-20T05:03:06.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.316+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/3756483279 shutdown_connections 2024-08-20T05:03:06.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.316+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/3756483279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013df240 0x5630013e1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.316+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/3756483279 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d32b0 0x5630013ded00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.316+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/3756483279 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013d2990 0x5630013d2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.316+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/3756483279 >> 172.21.15.37:0/3756483279 conn(0x5630013d07c0 msgr2=0x5630013d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:06.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.317+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/3756483279 shutdown_connections 2024-08-20T05:03:06.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.317+0000 7fa2a3e00640 1 --2- 172.21.15.37:0/2871599116 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2880b3d10 0x7fa2880b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:06.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.320+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/3756483279 wait complete. 2024-08-20T05:03:06.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.321+0000 7fa2ad5ff740 1 -- start start 2024-08-20T05:03:06.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.322+0000 7fa2ad5ff740 1 Processor -- start 2024-08-20T05:03:06.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.322+0000 7fa2ad5ff740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013d2990 0x5630013deac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.322+0000 7fa2ad5ff740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d32b0 0x5630013dbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.324+0000 7fa2ad5ff740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013df240 0x5630013dc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.324+0000 7fa2ad5ff740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56300119a700 con 0x5630013d2990 2024-08-20T05:03:06.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.324+0000 7fa2ad5ff740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5630012d3290 con 0x5630013df240 2024-08-20T05:03:06.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.324+0000 7fa2ad5ff740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5630013e1e60 con 0x5630013d32b0 2024-08-20T05:03:06.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.324+0000 7fa2ad5ff740 10 client.0 _ll_register_callbacks cb 0x5630013321c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:06.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.324+0000 7fa29be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d32b0 0x5630013dbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:06.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.324+0000 7fa29be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d32b0 0x5630013dbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35678/0 (socket says 172.21.15.37:35678) 2024-08-20T05:03:06.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.324+0000 7fa29be00640 1 -- 172.21.15.37:0/1702947394 learned_addr learned my addr 172.21.15.37:0/1702947394 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:06.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.324+0000 7fa2a8a00640 1 --2- 172.21.15.37:0/1702947394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013d2990 0x5630013deac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:06.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.325+0000 7fa2a8a00640 1 --2- 172.21.15.37:0/1702947394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013df240 0x5630013dc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:06.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.325+0000 7fa29be00640 1 -- 172.21.15.37:0/1702947394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013df240 msgr2=0x5630013dc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:06.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.325+0000 7fa29be00640 1 --2- 172.21.15.37:0/1702947394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013df240 0x5630013dc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.325+0000 7fa29be00640 1 -- 172.21.15.37:0/1702947394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013d2990 msgr2=0x5630013deac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:06.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.325+0000 7fa29be00640 1 --2- 172.21.15.37:0/1702947394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013d2990 0x5630013deac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.325+0000 7fa29be00640 1 -- 172.21.15.37:0/1702947394 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563001097650 con 0x5630013d32b0 2024-08-20T05:03:06.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.326+0000 7fa29be00640 1 --2- 172.21.15.37:0/1702947394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d32b0 0x5630013dbf10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa294031440 tx=0x7fa294005250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5344171de9bac23 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:06.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.326+0000 7fa291600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:03:06.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.326+0000 7fa291600640 1 -- 172.21.15.37:0/1702947394 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa294035070 con 0x5630013d32b0 2024-08-20T05:03:06.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.326+0000 7fa291600640 1 -- 172.21.15.37:0/1702947394 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa2940316a0 con 0x5630013d32b0 2024-08-20T05:03:06.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.327+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/1702947394 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2940047a0 con 0x5630013d32b0 2024-08-20T05:03:06.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.327+0000 7fa2a3e00640 1 --2- 172.21.15.37:0/2871599116 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2880b3d10 0x7fa2880b61d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0aa450 tx=0x7fa28c005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:06.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.327+0000 7fa291600640 1 -- 172.21.15.37:0/1702947394 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa29403f040 con 0x5630013d32b0 2024-08-20T05:03:06.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.327+0000 7fa2ad5ff740 10 client.25720 fetch_fsmap learned FSMap version 31 2024-08-20T05:03:06.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.327+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/1702947394 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5630013ed6a0 con 0x5630013d32b0 2024-08-20T05:03:06.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.328+0000 7fa291600640 1 -- 172.21.15.37:0/1702947394 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2940047a0 con 0x5630013d32b0 2024-08-20T05:03:06.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.329+0000 7fa291600640 1 -- 172.21.15.37:0/1702947394 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7fa29403b6d0 con 0x5630013d32b0 2024-08-20T05:03:06.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.329+0000 7fa2ad5ff740 10 client.25720 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T05:03:06.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.329+0000 7fa2ad5ff740 10 client.25720 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:03:06.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.329+0000 7fa2ad5ff740 20 client.25720 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:06.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.329+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/1702947394 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5630013ee9f0 0x5630013f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.329+0000 7fa2ad5ff740 4 client.25720 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:03:06.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.329+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/1702947394 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56300134a9f0 con 0x5630013ee9f0 2024-08-20T05:03:06.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.329+0000 7fa2a8a00640 1 --2- 172.21.15.37:0/1702947394 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5630013ee9f0 0x5630013f0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:06.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.330+0000 7fa2a8a00640 1 --2- 172.21.15.37:0/1702947394 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5630013ee9f0 0x5630013f0de0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9495dfcda4db3ddb server_cookie=7d89776da1db98d0 in_seq=0 out_seq=0 2024-08-20T05:03:06.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.330+0000 7fa291600640 10 client.25720 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:03:06.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.331+0000 7fa291600640 1 -- 172.21.15.37:0/1702947394 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56300134a9f0 con 0x5630013ee9f0 2024-08-20T05:03:06.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.331+0000 7fa291600640 10 client.25720 handle_command_reply: tid=0 2024-08-20T05:03:06.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.331+0000 7fa2ad5ff740 1 client.25720 shutdown 2024-08-20T05:03:06.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.331+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/1702947394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d32b0 msgr2=0x5630013dbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:06.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.331+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/1702947394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d32b0 0x5630013dbf10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa294031440 tx=0x7fa294005250 comp rx=0 tx=0).stop 2024-08-20T05:03:06.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.332+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/1702947394 shutdown_connections 2024-08-20T05:03:06.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.332+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/1702947394 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5630013ee9f0 0x5630013f0de0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.332+0000 7fa291600640 0 client.25720 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:03:06.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.332+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/1702947394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013df240 0x5630013dc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.332+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/1702947394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d32b0 0x5630013dbf10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.332+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/1702947394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013d2990 0x5630013deac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.332+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/1702947394 >> 172.21.15.37:0/1702947394 conn(0x5630013d07c0 msgr2=0x5630013d6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:06.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.333+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/1702947394 shutdown_connections 2024-08-20T05:03:06.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.333+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/1702947394 wait complete. 2024-08-20T05:03:06.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.333+0000 7fa2ad5ff740 20 client.25720 trim_cache size 0 max 16384 2024-08-20T05:03:06.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.369+0000 7fa2ad5ff740 1 Processor -- start 2024-08-20T05:03:06.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.369+0000 7fa2ad5ff740 1 -- start start 2024-08-20T05:03:06.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.369+0000 7fa2ad5ff740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d2990 0x5630013de010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.369+0000 7fa2ad5ff740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013d32b0 0x5630013d9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.369+0000 7fa2ad5ff740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013df240 0x5630013d9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.369+0000 7fa2ad5ff740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a41b5df0 con 0x5630013df240 2024-08-20T05:03:06.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.369+0000 7fa2ad5ff740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a41b7990 con 0x5630013d32b0 2024-08-20T05:03:06.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.369+0000 7fa2ad5ff740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a41b64c0 con 0x5630013d2990 2024-08-20T05:03:06.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.370+0000 7fa2a8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d2990 0x5630013de010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:06.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.370+0000 7fa2a8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d2990 0x5630013de010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35682/0 (socket says 172.21.15.37:35682) 2024-08-20T05:03:06.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.370+0000 7fa2a8a00640 1 -- 172.21.15.37:0/2223343381 learned_addr learned my addr 172.21.15.37:0/2223343381 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:06.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.370+0000 7fa2a8a00640 1 --2- 172.21.15.37:0/2223343381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013df240 0x5630013d9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:06.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.370+0000 7fa2a8a00640 1 -- 172.21.15.37:0/2223343381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013d32b0 msgr2=0x5630013d9140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:03:06.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.370+0000 7fa2a8a00640 1 --2- 172.21.15.37:0/2223343381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013d32b0 0x5630013d9140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.370+0000 7fa2a8a00640 1 -- 172.21.15.37:0/2223343381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013df240 msgr2=0x5630013d9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:06.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.370+0000 7fa2a8a00640 1 --2- 172.21.15.37:0/2223343381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013df240 0x5630013d9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.370+0000 7fa2a8a00640 1 -- 172.21.15.37:0/2223343381 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630013d05f0 con 0x5630013d2990 2024-08-20T05:03:06.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.371+0000 7fa2a8a00640 1 --2- 172.21.15.37:0/2223343381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d2990 0x5630013de010 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009620 tx=0x7fa29c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=311d933a54e43417 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:06.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.372+0000 7fa293e00640 1 -- 172.21.15.37:0/2223343381 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c012040 con 0x5630013d2990 2024-08-20T05:03:06.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.372+0000 7fa293e00640 1 -- 172.21.15.37:0/2223343381 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa29c02b070 con 0x5630013d2990 2024-08-20T05:03:06.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.372+0000 7fa293e00640 1 -- 172.21.15.37:0/2223343381 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c024bf0 con 0x5630013d2990 2024-08-20T05:03:06.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.374+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/2223343381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d2990 msgr2=0x5630013de010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:06.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.374+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/2223343381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d2990 0x5630013de010 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa29c009620 tx=0x7fa29c00b040 comp rx=0 tx=0).stop 2024-08-20T05:03:06.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.375+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/2223343381 shutdown_connections 2024-08-20T05:03:06.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.375+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/2223343381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013df240 0x5630013d9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.375+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/2223343381 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013d32b0 0x5630013d9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.375+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/2223343381 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d2990 0x5630013de010 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.375+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/2223343381 >> 172.21.15.37:0/2223343381 conn(0x5630013d07c0 msgr2=0x5630013cf940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:06.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.376+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/2223343381 shutdown_connections 2024-08-20T05:03:06.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.376+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/2223343381 wait complete. 2024-08-20T05:03:06.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.377+0000 7fa2ad5ff740 1 -- start start 2024-08-20T05:03:06.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.378+0000 7fa2ad5ff740 1 Processor -- start 2024-08-20T05:03:06.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.379+0000 7fa2ad5ff740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d2990 0x563001454310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.379+0000 7fa2ad5ff740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013d32b0 0x563001454850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.379+0000 7fa2ad5ff740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013df240 0x5630013f2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.379+0000 7fa2ad5ff740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a41b7260 con 0x5630013df240 2024-08-20T05:03:06.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.379+0000 7fa2ad5ff740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a41b6b90 con 0x5630013d32b0 2024-08-20T05:03:06.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.379+0000 7fa2ad5ff740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a41b3dd0 con 0x5630013d2990 2024-08-20T05:03:06.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.379+0000 7fa2ad5ff740 10 client.0 _ll_register_callbacks cb 0x7fa29c009650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:06.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.380+0000 7fa2a8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d2990 0x563001454310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:06.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.380+0000 7fa29be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013d32b0 0x563001454850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:06.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.380+0000 7fa2a8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d2990 0x563001454310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35696/0 (socket says 172.21.15.37:35696) 2024-08-20T05:03:06.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.380+0000 7fa2a8a00640 1 -- 172.21.15.37:0/466149091 learned_addr learned my addr 172.21.15.37:0/466149091 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:06.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.380+0000 7fa2a8a00640 1 --2- 172.21.15.37:0/466149091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013df240 0x5630013f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:06.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.380+0000 7fa2a8a00640 1 -- 172.21.15.37:0/466149091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013d32b0 msgr2=0x563001454850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:06.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.380+0000 7fa2a8a00640 1 --2- 172.21.15.37:0/466149091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013d32b0 0x563001454850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.380+0000 7fa2a8a00640 1 -- 172.21.15.37:0/466149091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013df240 msgr2=0x5630013f2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:06.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.380+0000 7fa2a8a00640 1 --2- 172.21.15.37:0/466149091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013df240 0x5630013f2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.380+0000 7fa2a8a00640 1 -- 172.21.15.37:0/466149091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630013d1240 con 0x5630013d2990 2024-08-20T05:03:06.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.380+0000 7fa2a8a00640 1 --2- 172.21.15.37:0/466149091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d2990 0x563001454310 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0244f0 tx=0x7fa29c0247d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cea1cb0085a95416 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:06.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.381+0000 7fa291600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:03:06.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.381+0000 7fa291600640 1 -- 172.21.15.37:0/466149091 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c01b840 con 0x5630013d2990 2024-08-20T05:03:06.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.381+0000 7fa291600640 1 -- 172.21.15.37:0/466149091 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa29c01b9e0 con 0x5630013d2990 2024-08-20T05:03:06.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.381+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/466149091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa29c02b070 con 0x5630013d2990 2024-08-20T05:03:06.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.381+0000 7fa291600640 1 -- 172.21.15.37:0/466149091 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa29c01bbe0 con 0x5630013d2990 2024-08-20T05:03:06.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.382+0000 7fa2ad5ff740 10 client.25726 fetch_fsmap learned FSMap version 31 2024-08-20T05:03:06.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.382+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/466149091 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56300146a970 con 0x5630013d2990 2024-08-20T05:03:06.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.382+0000 7fa291600640 1 -- 172.21.15.37:0/466149091 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa29c02b070 con 0x5630013d2990 2024-08-20T05:03:06.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.382+0000 7fa291600640 1 -- 172.21.15.37:0/466149091 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 31) ==== 8378+0+0 (secure 0 0 0) 0x7fa29c018040 con 0x5630013d2990 2024-08-20T05:03:06.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.382+0000 7fa2ad5ff740 10 client.25726 fetch_fsmap finished waiting for FSMap version 31 2024-08-20T05:03:06.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.382+0000 7fa2ad5ff740 10 client.25726 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:03:06.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.382+0000 7fa2ad5ff740 20 client.25726 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:06.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.383+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/466149091 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56300146afc0 0x56300146d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:06.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.383+0000 7fa2ad5ff740 4 client.25726 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:03:06.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.383+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/466149091 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563001346490 con 0x56300146afc0 2024-08-20T05:03:06.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.383+0000 7fa29be00640 1 --2- 172.21.15.37:0/466149091 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56300146afc0 0x56300146d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:06.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.384+0000 7fa29be00640 1 --2- 172.21.15.37:0/466149091 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56300146afc0 0x56300146d3e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7a4153c344c106a9 server_cookie=360c91fe8e5829ce in_seq=0 out_seq=0 2024-08-20T05:03:06.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.384+0000 7fa291600640 10 client.25726 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:03:06.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.384+0000 7fa291600640 1 -- 172.21.15.37:0/466149091 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563001346490 con 0x56300146afc0 2024-08-20T05:03:06.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.384+0000 7fa291600640 10 client.25726 handle_command_reply: tid=0 2024-08-20T05:03:06.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.384+0000 7fa2ad5ff740 1 client.25726 shutdown 2024-08-20T05:03:06.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.390+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/466149091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d2990 msgr2=0x563001454310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:06.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.390+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/466149091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d2990 0x563001454310 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0244f0 tx=0x7fa29c0247d0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.390+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/466149091 shutdown_connections 2024-08-20T05:03:06.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.390+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/466149091 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56300146afc0 0x56300146d3e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.390+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/466149091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5630013df240 0x5630013f2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.390+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/466149091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5630013d32b0 0x563001454850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.390+0000 7fa2ad5ff740 1 --2- 172.21.15.37:0/466149091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5630013d2990 0x563001454310 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.390+0000 7fa291600640 0 client.25726 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:03:06.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.390+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/466149091 >> 172.21.15.37:0/466149091 conn(0x5630013d07c0 msgr2=0x5630013d59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:06.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.391+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/466149091 shutdown_connections 2024-08-20T05:03:06.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.391+0000 7fa2ad5ff740 1 -- 172.21.15.37:0/466149091 wait complete. 2024-08-20T05:03:06.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.391+0000 7fa2ad5ff740 20 client.25726 trim_cache size 0 max 16384 2024-08-20T05:03:06.394 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:03:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.392+0000 7fa2aaa00640 1 -- 172.21.15.37:0/2871599116 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2880b3d10 msgr2=0x7fa2880b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.392+0000 7fa2aaa00640 1 --2- 172.21.15.37:0/2871599116 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2880b3d10 0x7fa2880b61d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0aa450 tx=0x7fa28c005d80 comp rx=0 tx=0).stop 2024-08-20T05:03:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.392+0000 7fa2aaa00640 1 -- 172.21.15.37:0/2871599116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a4104cc0 msgr2=0x7fa2a40773e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.392+0000 7fa2aaa00640 1 --2- 172.21.15.37:0/2871599116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a4104cc0 0x7fa2a40773e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00c970 tx=0x7fa28c00ce30 comp rx=0 tx=0).stop 2024-08-20T05:03:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.392+0000 7fa2aaa00640 1 -- 172.21.15.37:0/2871599116 shutdown_connections 2024-08-20T05:03:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.393+0000 7fa2aaa00640 1 --2- 172.21.15.37:0/2871599116 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2880b3d10 0x7fa2880b61d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.393+0000 7fa2aaa00640 1 --2- 172.21.15.37:0/2871599116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2a410b050 0x7fa2a4077e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.393+0000 7fa2aaa00640 1 --2- 172.21.15.37:0/2871599116 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2a410a6d0 0x7fa2a4077920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.393+0000 7fa2aaa00640 1 --2- 172.21.15.37:0/2871599116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2a4104cc0 0x7fa2a40773e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.393+0000 7fa2aaa00640 1 -- 172.21.15.37:0/2871599116 >> 172.21.15.37:0/2871599116 conn(0x7fa2a41006f0 msgr2=0x7fa2a4102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:06.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.394+0000 7fa2aaa00640 1 -- 172.21.15.37:0/2871599116 shutdown_connections 2024-08-20T05:03:06.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:06.395+0000 7fa2aaa00640 1 -- 172.21.15.37:0/2871599116 wait complete. 2024-08-20T05:03:06.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:06 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1901223647' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:03:07.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:06 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1901223647' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:03:07.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:06 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1901223647' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:03:07.334 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T05:03:07.728 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-08-20T05:03:07.728 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-08-20T05:03:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:07 smithi130 ceph-mon[22007]: pgmap v427: 129 pgs: 129 active+clean; 817 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 45 MiB/s wr, 255 op/s 2024-08-20T05:03:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:07 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:03:08.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:07 smithi037 ceph-mon[17265]: pgmap v427: 129 pgs: 129 active+clean; 817 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 45 MiB/s wr, 255 op/s 2024-08-20T05:03:08.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:07 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:03:08.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 10.0 s, 1967.6 tps, lat 50.304 ms stddev 57.569 2024-08-20T05:03:08.063 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:03:08.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:07 smithi135 ceph-mon[22342]: pgmap v427: 129 pgs: 129 active+clean; 817 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 45 MiB/s wr, 255 op/s 2024-08-20T05:03:08.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:07 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:03:09.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:09 smithi130 ceph-mon[22007]: pgmap v428: 129 pgs: 129 active+clean; 883 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 27 MiB/s wr, 326 op/s 2024-08-20T05:03:10.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:09 smithi037 ceph-mon[17265]: pgmap v428: 129 pgs: 129 active+clean; 883 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 27 MiB/s wr, 326 op/s 2024-08-20T05:03:10.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:09 smithi135 ceph-mon[22342]: pgmap v428: 129 pgs: 129 active+clean; 883 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 27 MiB/s wr, 326 op/s 2024-08-20T05:03:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.526+0000 7f592a200640 1 -- 172.21.15.37:0/3816492153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5924104ca0 msgr2=0x7f5924105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.526+0000 7f592a200640 1 --2- 172.21.15.37:0/3816492153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5924104ca0 0x7f5924105080 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5914009900 tx=0x7f591402a410 comp rx=0 tx=0).stop 2024-08-20T05:03:10.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.527+0000 7f592a200640 1 -- 172.21.15.37:0/3816492153 shutdown_connections 2024-08-20T05:03:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.527+0000 7f592a200640 1 --2- 172.21.15.37:0/3816492153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592410b030 0x7f5924111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.527+0000 7f592a200640 1 --2- 172.21.15.37:0/3816492153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f592410a6b0 0x7f592410aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.527+0000 7f592a200640 1 --2- 172.21.15.37:0/3816492153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5924104ca0 0x7f5924105080 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.527+0000 7f592a200640 1 -- 172.21.15.37:0/3816492153 >> 172.21.15.37:0/3816492153 conn(0x7f5924100730 msgr2=0x7f5924102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:10.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.528+0000 7f592a200640 1 -- 172.21.15.37:0/3816492153 shutdown_connections 2024-08-20T05:03:10.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.528+0000 7f592a200640 1 -- 172.21.15.37:0/3816492153 wait complete. 2024-08-20T05:03:10.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.531+0000 7f592a200640 1 Processor -- start 2024-08-20T05:03:10.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.531+0000 7f592a200640 1 -- start start 2024-08-20T05:03:10.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.531+0000 7f592a200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5924104ca0 0x7f592419b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.531+0000 7f592a200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592410a6b0 0x7f592419b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.531+0000 7f592a200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f592410b030 0x7f59241a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.531+0000 7f592a200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5924114d00 con 0x7f592410a6b0 2024-08-20T05:03:10.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.531+0000 7f592a200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5924114b80 con 0x7f592410b030 2024-08-20T05:03:10.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.531+0000 7f592a200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5924114e80 con 0x7f5924104ca0 2024-08-20T05:03:10.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.532+0000 7f5923e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f592410b030 0x7f59241a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:10.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.532+0000 7f5923e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f592410b030 0x7f59241a0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:35726/0 (socket says 172.21.15.37:35726) 2024-08-20T05:03:10.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.532+0000 7f5923e00640 1 -- 172.21.15.37:0/1836350164 learned_addr learned my addr 172.21.15.37:0/1836350164 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:10.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.533+0000 7f5923400640 1 --2- 172.21.15.37:0/1836350164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5924104ca0 0x7f592419b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:10.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.534+0000 7f5922a00640 1 --2- 172.21.15.37:0/1836350164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592410a6b0 0x7f592419b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.536+0000 7f5923e00640 1 -- 172.21.15.37:0/1836350164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5924104ca0 msgr2=0x7f592419b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:10.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.536+0000 7f5923e00640 1 --2- 172.21.15.37:0/1836350164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5924104ca0 0x7f592419b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.536+0000 7f5923e00640 1 -- 172.21.15.37:0/1836350164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592410a6b0 msgr2=0x7f592419b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.536+0000 7f5923e00640 1 --2- 172.21.15.37:0/1836350164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592410a6b0 0x7f592419b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.536+0000 7f5923e00640 1 -- 172.21.15.37:0/1836350164 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59241a1260 con 0x7f592410b030 2024-08-20T05:03:10.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.536+0000 7f5923400640 1 --2- 172.21.15.37:0/1836350164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5924104ca0 0x7f592419b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:10.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.536+0000 7f5922a00640 1 --2- 172.21.15.37:0/1836350164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592410a6b0 0x7f592419b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:10.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.537+0000 7f5923e00640 1 --2- 172.21.15.37:0/1836350164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f592410b030 0x7f59241a0a90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f591c00eb10 tx=0x7f591c00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:10.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.537+0000 7f591be00640 1 -- 172.21.15.37:0/1836350164 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c004b20 con 0x7f592410b030 2024-08-20T05:03:10.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.538+0000 7f592a200640 1 -- 172.21.15.37:0/1836350164 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59241a1550 con 0x7f592410b030 2024-08-20T05:03:10.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.538+0000 7f591be00640 1 -- 172.21.15.37:0/1836350164 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f591c004cc0 con 0x7f592410b030 2024-08-20T05:03:10.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.538+0000 7f591be00640 1 -- 172.21.15.37:0/1836350164 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c010670 con 0x7f592410b030 2024-08-20T05:03:10.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.538+0000 7f592a200640 1 -- 172.21.15.37:0/1836350164 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59241a7de0 con 0x7f592410b030 2024-08-20T05:03:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.547+0000 7f591be00640 1 -- 172.21.15.37:0/1836350164 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f591c005020 con 0x7f592410b030 2024-08-20T05:03:10.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.547+0000 7f592cbca740 1 Processor -- start 2024-08-20T05:03:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.548+0000 7f592cbca740 1 -- start start 2024-08-20T05:03:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.548+0000 7f592cbca740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31caa940 0x564d31caad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.548+0000 7f592cbca740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cab260 0x564d31cb6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.550+0000 7f592cbca740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31cb71f0 0x564d31cb95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.550+0000 7f592cbca740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564d31c20aa0 con 0x564d31cab260 2024-08-20T05:03:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.550+0000 7f592cbca740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564d31c0ffa0 con 0x564d31cb71f0 2024-08-20T05:03:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.550+0000 7f592cbca740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564d31c13fe0 con 0x564d31caa940 2024-08-20T05:03:10.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.550+0000 7f591be00640 1 --2- 172.21.15.37:0/1836350164 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f59080b3d10 0x7f59080b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.550+0000 7f591be00640 1 -- 172.21.15.37:0/1836350164 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f591c0e44f0 con 0x7f592410b030 2024-08-20T05:03:10.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.551+0000 7f5922a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31caa940 0x564d31caad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:10.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.551+0000 7f5922a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31caa940 0x564d31caad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35718/0 (socket says 172.21.15.37:35718) 2024-08-20T05:03:10.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.551+0000 7f5922a00640 1 -- 172.21.15.37:0/1616131595 learned_addr learned my addr 172.21.15.37:0/1616131595 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.551+0000 7f5922a00640 1 --2- 172.21.15.37:0/1616131595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31cb71f0 0x564d31cb95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.551+0000 7f5923e00640 1 --2- 172.21.15.37:0/1836350164 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f59080b3d10 0x7f59080b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.551+0000 7f5923400640 1 --2- 172.21.15.37:0/1616131595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cab260 0x564d31cb6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.552+0000 7f5922a00640 1 -- 172.21.15.37:0/1616131595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31caa940 msgr2=0x564d31caad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.552+0000 7f5922a00640 1 --2- 172.21.15.37:0/1616131595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31caa940 0x564d31caad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.552+0000 7f5922a00640 1 -- 172.21.15.37:0/1616131595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cab260 msgr2=0x564d31cb6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.552+0000 7f5922a00640 1 --2- 172.21.15.37:0/1616131595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cab260 0x564d31cb6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.552+0000 7f5922a00640 1 -- 172.21.15.37:0/1616131595 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d31bb6420 con 0x564d31cb71f0 2024-08-20T05:03:10.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.552+0000 7f5922a00640 1 --2- 172.21.15.37:0/1616131595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31cb71f0 0x564d31cb95e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f590c012b70 tx=0x7f590c00b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a7dfbda004cae06 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:10.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.552+0000 7f5923e00640 1 --2- 172.21.15.37:0/1836350164 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f59080b3d10 0x7f59080b61d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f591c004f90 tx=0x7f591c000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:10.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.553+0000 7f5913e00640 1 -- 172.21.15.37:0/1616131595 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c009b30 con 0x564d31cb71f0 2024-08-20T05:03:10.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.553+0000 7f5913e00640 1 -- 172.21.15.37:0/1616131595 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f590c012830 con 0x564d31cb71f0 2024-08-20T05:03:10.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.553+0000 7f5913e00640 1 -- 172.21.15.37:0/1616131595 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c003c00 con 0x564d31cb71f0 2024-08-20T05:03:10.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.554+0000 7f592cbca740 1 -- 172.21.15.37:0/1616131595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31cb71f0 msgr2=0x564d31cb95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:10.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.554+0000 7f592cbca740 1 --2- 172.21.15.37:0/1616131595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31cb71f0 0x564d31cb95e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f590c012b70 tx=0x7f590c00b390 comp rx=0 tx=0).stop 2024-08-20T05:03:10.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.554+0000 7f592cbca740 1 -- 172.21.15.37:0/1616131595 shutdown_connections 2024-08-20T05:03:10.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.554+0000 7f592cbca740 1 --2- 172.21.15.37:0/1616131595 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31cb71f0 0x564d31cb95e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.554+0000 7f592cbca740 1 --2- 172.21.15.37:0/1616131595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cab260 0x564d31cb6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.554+0000 7f592cbca740 1 --2- 172.21.15.37:0/1616131595 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31caa940 0x564d31caad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.554+0000 7f592cbca740 1 -- 172.21.15.37:0/1616131595 >> 172.21.15.37:0/1616131595 conn(0x564d31ca8770 msgr2=0x564d31ca9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.554+0000 7f592cbca740 1 -- 172.21.15.37:0/1616131595 shutdown_connections 2024-08-20T05:03:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.554+0000 7f592cbca740 1 -- 172.21.15.37:0/1616131595 wait complete. 2024-08-20T05:03:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.555+0000 7f592cbca740 1 -- start start 2024-08-20T05:03:10.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.556+0000 7f592cbca740 1 Processor -- start 2024-08-20T05:03:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.556+0000 7f592cbca740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31caa940 0x564d31cb6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.556+0000 7f592cbca740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cab260 0x564d31cb3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.556+0000 7f592cbca740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31cb71f0 0x564d31cb45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.556+0000 7f592cbca740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564d31a72700 con 0x564d31cab260 2024-08-20T05:03:10.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.556+0000 7f592cbca740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564d31bab290 con 0x564d31caa940 2024-08-20T05:03:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.556+0000 7f592cbca740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564d31cb9e70 con 0x564d31cb71f0 2024-08-20T05:03:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.556+0000 7f592cbca740 10 client.0 _ll_register_callbacks cb 0x564d31c0a1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.557+0000 7f5922a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31caa940 0x564d31cb6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.557+0000 7f5922a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31caa940 0x564d31cb6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:35742/0 (socket says 172.21.15.37:35742) 2024-08-20T05:03:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.557+0000 7f5922a00640 1 -- 172.21.15.37:0/2515055876 learned_addr learned my addr 172.21.15.37:0/2515055876 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:10.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.557+0000 7f5922a00640 1 --2- 172.21.15.37:0/2515055876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31cb71f0 0x564d31cb45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:10.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.558+0000 7f5923400640 1 --2- 172.21.15.37:0/2515055876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cab260 0x564d31cb3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:10.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.558+0000 7f5922a00640 1 -- 172.21.15.37:0/2515055876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31caa940 msgr2=0x564d31cb6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:10.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.559+0000 7f5922a00640 1 --2- 172.21.15.37:0/2515055876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31caa940 0x564d31cb6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.559+0000 7f5922a00640 1 -- 172.21.15.37:0/2515055876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cab260 msgr2=0x564d31cb3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:10.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.559+0000 7f5922a00640 1 --2- 172.21.15.37:0/2515055876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cab260 0x564d31cb3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.559+0000 7f5922a00640 1 -- 172.21.15.37:0/2515055876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d3196f650 con 0x564d31cb71f0 2024-08-20T05:03:10.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.559+0000 7f5923400640 1 --2- 172.21.15.37:0/2515055876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cab260 0x564d31cb3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:03:10.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.559+0000 7f5922a00640 1 --2- 172.21.15.37:0/2515055876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31cb71f0 0x564d31cb45f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f590c00be50 tx=0x7f590c0123f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25d18b7ea8f4b828 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:10.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.559+0000 7f5910c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:03:10.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.560+0000 7f5910c00640 1 -- 172.21.15.37:0/2515055876 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c016070 con 0x564d31cb71f0 2024-08-20T05:03:10.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.560+0000 7f5910c00640 1 -- 172.21.15.37:0/2515055876 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f590c01a070 con 0x564d31cb71f0 2024-08-20T05:03:10.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.560+0000 7f592cbca740 1 -- 172.21.15.37:0/2515055876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f590c012830 con 0x564d31cb71f0 2024-08-20T05:03:10.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.561+0000 7f5910c00640 1 -- 172.21.15.37:0/2515055876 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f590c005030 con 0x564d31cb71f0 2024-08-20T05:03:10.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.561+0000 7f592cbca740 10 client.25738 fetch_fsmap learned FSMap version 32 2024-08-20T05:03:10.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.561+0000 7f592cbca740 1 -- 172.21.15.37:0/2515055876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564d31ccdff0 con 0x564d31cb71f0 2024-08-20T05:03:10.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.561+0000 7f5910c00640 1 -- 172.21.15.37:0/2515055876 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f590c012830 con 0x564d31cb71f0 2024-08-20T05:03:10.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.562+0000 7f5910c00640 1 -- 172.21.15.37:0/2515055876 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) ==== 8382+0+0 (secure 0 0 0) 0x7f590c02a020 con 0x564d31cb71f0 2024-08-20T05:03:10.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.562+0000 7f592cbca740 10 client.25738 fetch_fsmap finished waiting for FSMap version 32 2024-08-20T05:03:10.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.562+0000 7f592cbca740 10 client.25738 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:03:10.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.562+0000 7f592cbca740 20 client.25738 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:10.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.562+0000 7f592cbca740 1 --2- 172.21.15.37:0/2515055876 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x564d31ccf340 0x564d31cd1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.562+0000 7f592cbca740 4 client.25738 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:03:10.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.562+0000 7f592cbca740 1 -- 172.21.15.37:0/2515055876 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d31c229f0 con 0x564d31ccf340 2024-08-20T05:03:10.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.563+0000 7f5923400640 1 --2- 172.21.15.37:0/2515055876 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x564d31ccf340 0x564d31cd1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.564+0000 7f5910c00640 10 client.25738 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:03:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.564+0000 7f5923400640 1 --2- 172.21.15.37:0/2515055876 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x564d31ccf340 0x564d31cd1730 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bc363483248d46c3 server_cookie=f1303bbce686c52b in_seq=0 out_seq=0 2024-08-20T05:03:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.565+0000 7f5910c00640 1 -- 172.21.15.37:0/2515055876 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564d31c229f0 con 0x564d31ccf340 2024-08-20T05:03:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.565+0000 7f5910c00640 10 client.25738 handle_command_reply: tid=0 2024-08-20T05:03:10.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.565+0000 7f592cbca740 1 client.25738 shutdown 2024-08-20T05:03:10.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.565+0000 7f592cbca740 1 -- 172.21.15.37:0/2515055876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31cb71f0 msgr2=0x564d31cb45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:10.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.565+0000 7f592cbca740 1 --2- 172.21.15.37:0/2515055876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31cb71f0 0x564d31cb45f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f590c00be50 tx=0x7f590c0123f0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.565+0000 7f592cbca740 1 -- 172.21.15.37:0/2515055876 shutdown_connections 2024-08-20T05:03:10.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.565+0000 7f592cbca740 1 --2- 172.21.15.37:0/2515055876 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x564d31ccf340 0x564d31cd1730 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.565+0000 7f592cbca740 1 --2- 172.21.15.37:0/2515055876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31cb71f0 0x564d31cb45f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.565+0000 7f592cbca740 1 --2- 172.21.15.37:0/2515055876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cab260 0x564d31cb3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.565+0000 7f592cbca740 1 --2- 172.21.15.37:0/2515055876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31caa940 0x564d31cb6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.565+0000 7f592cbca740 1 -- 172.21.15.37:0/2515055876 >> 172.21.15.37:0/2515055876 conn(0x564d31ca8770 msgr2=0x564d31cae310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:10.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.566+0000 7f5910c00640 0 client.25738 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:03:10.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.566+0000 7f592cbca740 1 -- 172.21.15.37:0/2515055876 shutdown_connections 2024-08-20T05:03:10.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.566+0000 7f592cbca740 1 -- 172.21.15.37:0/2515055876 wait complete. 2024-08-20T05:03:10.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.567+0000 7f592cbca740 20 client.25738 trim_cache size 0 max 16384 2024-08-20T05:03:10.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.596+0000 7f592cbca740 1 Processor -- start 2024-08-20T05:03:10.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.597+0000 7f592cbca740 1 -- start start 2024-08-20T05:03:10.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.597+0000 7f592cbca740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31caa940 0x564d31ccb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.597+0000 7f592cbca740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31cab260 0x564d31cb55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.597+0000 7f592cbca740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cb71f0 0x564d31cd6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.597+0000 7f592cbca740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f59241ad660 con 0x564d31cb71f0 2024-08-20T05:03:10.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.597+0000 7f592cbca740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f59241af230 con 0x564d31caa940 2024-08-20T05:03:10.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.597+0000 7f592cbca740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f59241add30 con 0x564d31cab260 2024-08-20T05:03:10.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.598+0000 7f5922a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31caa940 0x564d31ccb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:10.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.598+0000 7f5922a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31caa940 0x564d31ccb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:35754/0 (socket says 172.21.15.37:35754) 2024-08-20T05:03:10.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.598+0000 7f5922a00640 1 -- 172.21.15.37:0/146139011 learned_addr learned my addr 172.21.15.37:0/146139011 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:10.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.598+0000 7f5923400640 1 --2- 172.21.15.37:0/146139011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31cab260 0x564d31cb55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.600+0000 7f5923400640 1 -- 172.21.15.37:0/146139011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31caa940 msgr2=0x564d31ccb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.600+0000 7f5923400640 1 --2- 172.21.15.37:0/146139011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31caa940 0x564d31ccb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.600+0000 7f5923400640 1 -- 172.21.15.37:0/146139011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cb71f0 msgr2=0x564d31cd6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:10.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.600+0000 7f5923400640 1 --2- 172.21.15.37:0/146139011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cb71f0 0x564d31cd6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.600+0000 7f5923400640 1 -- 172.21.15.37:0/146139011 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d31ca91f0 con 0x564d31cab260 2024-08-20T05:03:10.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.601+0000 7f5922a00640 1 --2- 172.21.15.37:0/146139011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31caa940 0x564d31ccb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:10.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.601+0000 7f5923400640 1 --2- 172.21.15.37:0/146139011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31cab260 0x564d31cb55a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f591402aa00 tx=0x7f5914000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29775c9590e1f18c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:10.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.602+0000 7f5913400640 1 -- 172.21.15.37:0/146139011 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914049020 con 0x564d31cab260 2024-08-20T05:03:10.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.602+0000 7f5913400640 1 -- 172.21.15.37:0/146139011 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5914009520 con 0x564d31cab260 2024-08-20T05:03:10.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.602+0000 7f5913400640 1 -- 172.21.15.37:0/146139011 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914035040 con 0x564d31cab260 2024-08-20T05:03:10.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.603+0000 7f592cbca740 1 -- 172.21.15.37:0/146139011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31cab260 msgr2=0x564d31cb55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.603+0000 7f592cbca740 1 --2- 172.21.15.37:0/146139011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31cab260 0x564d31cb55a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f591402aa00 tx=0x7f5914000bc0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.603+0000 7f592cbca740 1 -- 172.21.15.37:0/146139011 shutdown_connections 2024-08-20T05:03:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.603+0000 7f592cbca740 1 --2- 172.21.15.37:0/146139011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cb71f0 0x564d31cd6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.603+0000 7f592cbca740 1 --2- 172.21.15.37:0/146139011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31cab260 0x564d31cb55a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.603+0000 7f592cbca740 1 --2- 172.21.15.37:0/146139011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31caa940 0x564d31ccb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.603+0000 7f592cbca740 1 -- 172.21.15.37:0/146139011 >> 172.21.15.37:0/146139011 conn(0x564d31ca8770 msgr2=0x564d31ca7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.604+0000 7f592cbca740 1 -- 172.21.15.37:0/146139011 shutdown_connections 2024-08-20T05:03:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.604+0000 7f592cbca740 1 -- 172.21.15.37:0/146139011 wait complete. 2024-08-20T05:03:10.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.605+0000 7f592cbca740 1 -- start start 2024-08-20T05:03:10.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.606+0000 7f592cbca740 1 Processor -- start 2024-08-20T05:03:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.608+0000 7f592cbca740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31caa940 0x564d31d32530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.608+0000 7f592cbca740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cab260 0x564d31d32a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.608+0000 7f592cbca740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31cb71f0 0x564d31cc6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.608+0000 7f592cbca740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f59241aead0 con 0x564d31cab260 2024-08-20T05:03:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.608+0000 7f592cbca740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f59241ae400 con 0x564d31cb71f0 2024-08-20T05:03:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.608+0000 7f592cbca740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f59241ab640 con 0x564d31caa940 2024-08-20T05:03:10.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.608+0000 7f592cbca740 10 client.0 _ll_register_callbacks cb 0x7f590c012a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:10.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.608+0000 7f5922a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31caa940 0x564d31d32530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:10.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.608+0000 7f5922a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31caa940 0x564d31d32530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35748/0 (socket says 172.21.15.37:35748) 2024-08-20T05:03:10.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.608+0000 7f5922a00640 1 -- 172.21.15.37:0/3680554831 learned_addr learned my addr 172.21.15.37:0/3680554831 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:10.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.608+0000 7f5922a00640 1 --2- 172.21.15.37:0/3680554831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31cb71f0 0x564d31cc6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:10.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.609+0000 7f5923400640 1 --2- 172.21.15.37:0/3680554831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cab260 0x564d31d32a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:10.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.609+0000 7f5922a00640 1 -- 172.21.15.37:0/3680554831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31cb71f0 msgr2=0x564d31cc6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:10.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.609+0000 7f5922a00640 1 --2- 172.21.15.37:0/3680554831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31cb71f0 0x564d31cc6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.609+0000 7f5922a00640 1 -- 172.21.15.37:0/3680554831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cab260 msgr2=0x564d31d32a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:10.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.610+0000 7f5922a00640 1 --2- 172.21.15.37:0/3680554831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cab260 0x564d31d32a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.610+0000 7f5922a00640 1 -- 172.21.15.37:0/3680554831 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d31ca3ef0 con 0x564d31caa940 2024-08-20T05:03:10.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.611+0000 7f5923400640 1 --2- 172.21.15.37:0/3680554831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cab260 0x564d31d32a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:03:10.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.612+0000 7f5922a00640 1 --2- 172.21.15.37:0/3680554831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31caa940 0x564d31d32530 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f590c005940 tx=0x7f590c00bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fabf412459bbfa4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:10.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.612+0000 7f5910c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:03:10.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.613+0000 7f5910c00640 1 -- 172.21.15.37:0/3680554831 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c03e060 con 0x564d31caa940 2024-08-20T05:03:10.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.613+0000 7f5910c00640 1 -- 172.21.15.37:0/3680554831 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f590c0051d0 con 0x564d31caa940 2024-08-20T05:03:10.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.613+0000 7f592cbca740 1 -- 172.21.15.37:0/3680554831 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5914009520 con 0x564d31caa940 2024-08-20T05:03:10.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.613+0000 7f5910c00640 1 -- 172.21.15.37:0/3680554831 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f590c016030 con 0x564d31caa940 2024-08-20T05:03:10.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.613+0000 7f592cbca740 10 client.25744 fetch_fsmap learned FSMap version 32 2024-08-20T05:03:10.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.613+0000 7f592cbca740 1 -- 172.21.15.37:0/3680554831 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x564d31cc80c0 con 0x564d31caa940 2024-08-20T05:03:10.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.614+0000 7f5910c00640 1 -- 172.21.15.37:0/3680554831 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5914009520 con 0x564d31caa940 2024-08-20T05:03:10.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.614+0000 7f5910c00640 1 -- 172.21.15.37:0/3680554831 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 32) ==== 8382+0+0 (secure 0 0 0) 0x7f590c02a040 con 0x564d31caa940 2024-08-20T05:03:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.614+0000 7f592cbca740 10 client.25744 fetch_fsmap finished waiting for FSMap version 32 2024-08-20T05:03:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.614+0000 7f592cbca740 10 client.25744 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:03:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.614+0000 7f592cbca740 20 client.25744 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.614+0000 7f592cbca740 1 --2- 172.21.15.37:0/3680554831 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x564d31d4add0 0x564d31d4d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.614+0000 7f592cbca740 4 client.25744 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:03:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.614+0000 7f592cbca740 1 -- 172.21.15.37:0/3680554831 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564d31c1e490 con 0x564d31d4add0 2024-08-20T05:03:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.615+0000 7f5923400640 1 --2- 172.21.15.37:0/3680554831 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x564d31d4add0 0x564d31d4d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.617+0000 7f5923400640 1 --2- 172.21.15.37:0/3680554831 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x564d31d4add0 0x564d31d4d1c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d74d1fa1b37e782a server_cookie=4ff030418420d007 in_seq=0 out_seq=0 2024-08-20T05:03:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.617+0000 7f5910c00640 10 client.25744 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:03:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.617+0000 7f5910c00640 1 -- 172.21.15.37:0/3680554831 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564d31c1e490 con 0x564d31d4add0 2024-08-20T05:03:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.617+0000 7f5910c00640 10 client.25744 handle_command_reply: tid=0 2024-08-20T05:03:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.617+0000 7f592cbca740 1 client.25744 shutdown 2024-08-20T05:03:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.618+0000 7f592cbca740 1 -- 172.21.15.37:0/3680554831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31caa940 msgr2=0x564d31d32530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.618+0000 7f592cbca740 1 --2- 172.21.15.37:0/3680554831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31caa940 0x564d31d32530 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f590c005940 tx=0x7f590c00bdc0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.618+0000 7f592cbca740 1 -- 172.21.15.37:0/3680554831 shutdown_connections 2024-08-20T05:03:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.618+0000 7f592cbca740 1 --2- 172.21.15.37:0/3680554831 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x564d31d4add0 0x564d31d4d1c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.618+0000 7f592cbca740 1 --2- 172.21.15.37:0/3680554831 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564d31cb71f0 0x564d31cc6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.618+0000 7f592cbca740 1 --2- 172.21.15.37:0/3680554831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d31cab260 0x564d31d32a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.618+0000 7f592cbca740 1 --2- 172.21.15.37:0/3680554831 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564d31caa940 0x564d31d32530 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.618+0000 7f592cbca740 1 -- 172.21.15.37:0/3680554831 >> 172.21.15.37:0/3680554831 conn(0x564d31ca8770 msgr2=0x564d31cb27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:10.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.618+0000 7f5910c00640 0 client.25744 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:03:10.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.619+0000 7f592cbca740 1 -- 172.21.15.37:0/3680554831 shutdown_connections 2024-08-20T05:03:10.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.619+0000 7f592cbca740 1 -- 172.21.15.37:0/3680554831 wait complete. 2024-08-20T05:03:10.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.620+0000 7f592cbca740 20 client.25744 trim_cache size 0 max 16384 2024-08-20T05:03:10.622 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:03:10.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.621+0000 7f592a200640 1 -- 172.21.15.37:0/1836350164 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f59080b3d10 msgr2=0x7f59080b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:10.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.621+0000 7f592a200640 1 --2- 172.21.15.37:0/1836350164 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f59080b3d10 0x7f59080b61d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f591c004f90 tx=0x7f591c000f40 comp rx=0 tx=0).stop 2024-08-20T05:03:10.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.621+0000 7f592a200640 1 -- 172.21.15.37:0/1836350164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f592410b030 msgr2=0x7f59241a0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:10.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.621+0000 7f592a200640 1 --2- 172.21.15.37:0/1836350164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f592410b030 0x7f59241a0a90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f591c00eb10 tx=0x7f591c00c2d0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.621+0000 7f592a200640 1 -- 172.21.15.37:0/1836350164 shutdown_connections 2024-08-20T05:03:10.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.621+0000 7f592a200640 1 --2- 172.21.15.37:0/1836350164 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f59080b3d10 0x7f59080b61d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.621+0000 7f592a200640 1 --2- 172.21.15.37:0/1836350164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f592410b030 0x7f59241a0a90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.621+0000 7f592a200640 1 --2- 172.21.15.37:0/1836350164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f592410a6b0 0x7f592419b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.621+0000 7f592a200640 1 --2- 172.21.15.37:0/1836350164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5924104ca0 0x7f592419b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:10.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.621+0000 7f592a200640 1 -- 172.21.15.37:0/1836350164 >> 172.21.15.37:0/1836350164 conn(0x7f5924100730 msgr2=0x7f5924102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:10.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.622+0000 7f592a200640 1 -- 172.21.15.37:0/1836350164 shutdown_connections 2024-08-20T05:03:10.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:10.622+0000 7f592a200640 1 -- 172.21.15.37:0/1836350164 wait complete. 2024-08-20T05:03:11.003 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:03:11.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T05:03:11.981 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:11 smithi037 ceph-mon[17265]: pgmap v429: 129 pgs: 129 active+clean; 901 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 23 MiB/s wr, 482 op/s 2024-08-20T05:03:12.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:11 smithi135 ceph-mon[22342]: pgmap v429: 129 pgs: 129 active+clean; 901 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 23 MiB/s wr, 482 op/s 2024-08-20T05:03:12.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:11 smithi130 ceph-mon[22007]: pgmap v429: 129 pgs: 129 active+clean; 901 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 23 MiB/s wr, 482 op/s 2024-08-20T05:03:12.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.535+0000 7f12bc200640 1 -- 172.21.15.37:0/2860162048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b410f0c0 msgr2=0x7f12b41114b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.535+0000 7f12bc200640 1 --2- 172.21.15.37:0/2860162048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b410f0c0 0x7f12b41114b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009be0 tx=0x7f12ac02a6e0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.536+0000 7f12bc200640 1 -- 172.21.15.37:0/2860162048 shutdown_connections 2024-08-20T05:03:12.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.536+0000 7f12bc200640 1 --2- 172.21.15.37:0/2860162048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b410f0c0 0x7f12b41114b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.536+0000 7f12bc200640 1 --2- 172.21.15.37:0/2860162048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12b4075b10 0x7f12b410eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.536+0000 7f12bc200640 1 --2- 172.21.15.37:0/2860162048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b40751f0 0x7f12b40755d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.536+0000 7f12bc200640 1 -- 172.21.15.37:0/2860162048 >> 172.21.15.37:0/2860162048 conn(0x7f12b40fe500 msgr2=0x7f12b4100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:12.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.537+0000 7f12bc200640 1 -- 172.21.15.37:0/2860162048 shutdown_connections 2024-08-20T05:03:12.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.541+0000 7f1e1e600640 1 -- 172.21.15.37:0/2884864460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e18079260 msgr2=0x7f1e18079bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:12.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.541+0000 7f1e1e600640 1 --2- 172.21.15.37:0/2884864460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e18079260 0x7f1e18079bb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1e10009ca0 tx=0x7f1e1002a8c0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.540+0000 7f12bc200640 1 -- 172.21.15.37:0/2860162048 wait complete. 2024-08-20T05:03:12.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.541+0000 7f12bc200640 1 Processor -- start 2024-08-20T05:03:12.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.541+0000 7f12bc200640 1 -- start start 2024-08-20T05:03:12.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.542+0000 7f12bc200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12b40751f0 0x7f12b4102830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.542+0000 7f12bc200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b4075b10 0x7f12b4102d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.542+0000 7f12bc200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b410f0c0 0x7f12b41032b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.542+0000 7f12bc200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12b4114ca0 con 0x7f12b40751f0 2024-08-20T05:03:12.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.542+0000 7f12bc200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f12b4114b20 con 0x7f12b410f0c0 2024-08-20T05:03:12.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.542+0000 7f12bc200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12b4114e20 con 0x7f12b4075b10 2024-08-20T05:03:12.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.543+0000 7f12b8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b4075b10 0x7f12b4102d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.543+0000 7f12b8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b4075b10 0x7f12b4102d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35768/0 (socket says 172.21.15.37:35768) 2024-08-20T05:03:12.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.543+0000 7f12b8e00640 1 -- 172.21.15.37:0/2690781710 learned_addr learned my addr 172.21.15.37:0/2690781710 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:12.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.543+0000 7f12ba200640 1 --2- 172.21.15.37:0/2690781710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b410f0c0 0x7f12b41032b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.543+0000 7f12b8e00640 1 -- 172.21.15.37:0/2690781710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b410f0c0 msgr2=0x7f12b41032b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:12.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.543+0000 7f12b8e00640 1 --2- 172.21.15.37:0/2690781710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b410f0c0 0x7f12b41032b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.543+0000 7f12b8e00640 1 -- 172.21.15.37:0/2690781710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12b40751f0 msgr2=0x7f12b4102830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:12.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.543+0000 7f12b8e00640 1 --2- 172.21.15.37:0/2690781710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12b40751f0 0x7f12b4102830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.543+0000 7f12b8e00640 1 -- 172.21.15.37:0/2690781710 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b419ae40 con 0x7f12b4075b10 2024-08-20T05:03:12.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.546+0000 7f1e1e600640 1 -- 172.21.15.37:0/2884864460 shutdown_connections 2024-08-20T05:03:12.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.546+0000 7f1e1e600640 1 --2- 172.21.15.37:0/2884864460 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e18079260 0x7f1e18079bb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.546+0000 7f1e1e600640 1 --2- 172.21.15.37:0/2884864460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e180788a0 0x7f1e18078d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.546+0000 7f1e1e600640 1 --2- 172.21.15.37:0/2884864460 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e18077750 0x7f1e18077b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.546+0000 7f1e1e600640 1 -- 172.21.15.37:0/2884864460 >> 172.21.15.37:0/2884864460 conn(0x7f1e18100140 msgr2=0x7f1e18102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:12.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.546+0000 7f1e1e600640 1 -- 172.21.15.37:0/2884864460 shutdown_connections 2024-08-20T05:03:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.546+0000 7f1e1e600640 1 -- 172.21.15.37:0/2884864460 wait complete. 2024-08-20T05:03:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.547+0000 7f1e1e600640 1 Processor -- start 2024-08-20T05:03:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.548+0000 7f1e1e600640 1 -- start start 2024-08-20T05:03:12.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.548+0000 7f12b8e00640 1 --2- 172.21.15.37:0/2690781710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b4075b10 0x7f12b4102d70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f12a000c920 tx=0x7f12a000cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.549+0000 7f1e1e600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e18077750 0x7f1e18071830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.549+0000 7f1e1e600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e180788a0 0x7f1e18071e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.549+0000 7f1e1e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e18079260 0x7f1e18072ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.549+0000 7f1e17400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e18077750 0x7f1e18071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.550+0000 7f1e17400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e18077750 0x7f1e18071830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35784/0 (socket says 172.21.15.37:35784) 2024-08-20T05:03:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.550+0000 7f1e17400640 1 -- 172.21.15.37:0/2285883911 learned_addr learned my addr 172.21.15.37:0/2285883911 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.550+0000 7f1e1e600640 1 -- 172.21.15.37:0/2285883911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e18114950 con 0x7f1e18079260 2024-08-20T05:03:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.550+0000 7f1e1e600640 1 -- 172.21.15.37:0/2285883911 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1e181147d0 con 0x7f1e180788a0 2024-08-20T05:03:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.550+0000 7f1e1e600640 1 -- 172.21.15.37:0/2285883911 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1e18114ad0 con 0x7f1e18077750 2024-08-20T05:03:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.550+0000 7f1e16a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e180788a0 0x7f1e18071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.550+0000 7f1e17e00640 1 --2- 172.21.15.37:0/2285883911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e18079260 0x7f1e18072ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.551+0000 7f1e17400640 1 -- 172.21.15.37:0/2285883911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e180788a0 msgr2=0x7f1e18071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.551+0000 7f1e17400640 1 --2- 172.21.15.37:0/2285883911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e180788a0 0x7f1e18071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.551+0000 7f1e17400640 1 -- 172.21.15.37:0/2285883911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e18079260 msgr2=0x7f1e18072ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.551+0000 7f1e17400640 1 --2- 172.21.15.37:0/2285883911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e18079260 0x7f1e18072ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.551+0000 7f1e17400640 1 -- 172.21.15.37:0/2285883911 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e18073370 con 0x7f1e18077750 2024-08-20T05:03:12.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.549+0000 7f12b2000640 1 -- 172.21.15.37:0/2690781710 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a0007c70 con 0x7f12b4075b10 2024-08-20T05:03:12.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.549+0000 7f12b2000640 1 -- 172.21.15.37:0/2690781710 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12a0007e10 con 0x7f12b4075b10 2024-08-20T05:03:12.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.549+0000 7f12b2000640 1 -- 172.21.15.37:0/2690781710 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a0018820 con 0x7f12b4075b10 2024-08-20T05:03:12.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.550+0000 7f12bc200640 1 -- 172.21.15.37:0/2690781710 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b419b130 con 0x7f12b4075b10 2024-08-20T05:03:12.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.550+0000 7f12bc200640 1 -- 172.21.15.37:0/2690781710 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b419b5f0 con 0x7f12b4075b10 2024-08-20T05:03:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.551+0000 7f1e16a00640 1 --2- 172.21.15.37:0/2285883911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e180788a0 0x7f1e18071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:03:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.551+0000 7f1e17400640 1 --2- 172.21.15.37:0/2285883911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e18077750 0x7f1e18071830 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800c920 tx=0x7f1e0800cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.552+0000 7f1e0fe00640 1 -- 172.21.15.37:0/2285883911 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e08007c70 con 0x7f1e18077750 2024-08-20T05:03:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.552+0000 7f1e0fe00640 1 -- 172.21.15.37:0/2285883911 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e08007e10 con 0x7f1e18077750 2024-08-20T05:03:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.552+0000 7f1e0fe00640 1 -- 172.21.15.37:0/2285883911 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e08018800 con 0x7f1e18077750 2024-08-20T05:03:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.552+0000 7f1e1e600640 1 -- 172.21.15.37:0/2285883911 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e18073660 con 0x7f1e18077750 2024-08-20T05:03:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.552+0000 7f1e1e600640 1 -- 172.21.15.37:0/2285883911 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e18073d00 con 0x7f1e18077750 2024-08-20T05:03:12.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.553+0000 7f1e17e00640 1 --2- 172.21.15.37:0/2285883911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e18079260 0x7f1e18072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:03:12.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.557+0000 7f12bec23740 1 Processor -- start 2024-08-20T05:03:12.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.557+0000 7f12bec23740 1 -- start start 2024-08-20T05:03:12.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.558+0000 7f12bec23740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f2543f0 0x558e1f2547d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.558+0000 7f12bec23740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f254d10 0x558e1f260760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.559+0000 7f1e0fe00640 1 -- 172.21.15.37:0/2285883911 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1e0800fb00 con 0x7f1e18077750 2024-08-20T05:03:12.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.558+0000 7f12bec23740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f260ca0 0x558e1f263090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.558+0000 7f12b2000640 1 -- 172.21.15.37:0/2690781710 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f12a000f450 con 0x7f12b4075b10 2024-08-20T05:03:12.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.559+0000 7f12b9800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f254d10 0x558e1f260760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.559+0000 7f12ba200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f2543f0 0x558e1f2547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.559+0000 7f12ba200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f2543f0 0x558e1f2547d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41508/0 (socket says 172.21.15.37:41508) 2024-08-20T05:03:12.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.559+0000 7f12b9800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f254d10 0x558e1f260760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:35824/0 (socket says 172.21.15.37:35824) 2024-08-20T05:03:12.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.560+0000 7f12ba200640 1 -- 172.21.15.37:0/359755475 learned_addr learned my addr 172.21.15.37:0/359755475 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:12.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.560+0000 7f12bec23740 1 -- 172.21.15.37:0/359755475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558e1f1f4670 con 0x558e1f2543f0 2024-08-20T05:03:12.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.560+0000 7f12bec23740 1 -- 172.21.15.37:0/359755475 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558e1f1c87c0 con 0x558e1f254d10 2024-08-20T05:03:12.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.560+0000 7f12bec23740 1 -- 172.21.15.37:0/359755475 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558e1f1b7cc0 con 0x558e1f260ca0 2024-08-20T05:03:12.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.560+0000 7f12b8e00640 1 --2- 172.21.15.37:0/359755475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f260ca0 0x558e1f263090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.561+0000 7f12ba200640 1 -- 172.21.15.37:0/359755475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f260ca0 msgr2=0x558e1f263090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.561+0000 7f12ba200640 1 --2- 172.21.15.37:0/359755475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f260ca0 0x558e1f263090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.562+0000 7f1e0fe00640 1 --2- 172.21.15.37:0/2285883911 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1dfc0b3c50 0x7f1dfc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.562+0000 7f1e0fe00640 1 -- 172.21.15.37:0/2285883911 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1e080e3fe0 con 0x7f1e18077750 2024-08-20T05:03:12.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.561+0000 7f12ba200640 1 -- 172.21.15.37:0/359755475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f254d10 msgr2=0x558e1f260760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:12.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.562+0000 7f12ba200640 1 --2- 172.21.15.37:0/359755475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f254d10 0x558e1f260760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.562+0000 7f12ba200640 1 -- 172.21.15.37:0/359755475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e1f14b110 con 0x558e1f2543f0 2024-08-20T05:03:12.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.562+0000 7f12b8e00640 1 --2- 172.21.15.37:0/359755475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f260ca0 0x558e1f263090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:03:12.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.563+0000 7f1e16a00640 1 --2- 172.21.15.37:0/2285883911 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1dfc0b3c50 0x7f1dfc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.562+0000 7f12b9800640 1 --2- 172.21.15.37:0/359755475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f254d10 0x558e1f260760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:12.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.564+0000 7f1e16a00640 1 --2- 172.21.15.37:0/2285883911 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1dfc0b3c50 0x7f1dfc0b6110 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1e040058c0 tx=0x7f1e04005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:12.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.564+0000 7f12ba200640 1 --2- 172.21.15.37:0/359755475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f2543f0 0x558e1f2547d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009be0 tx=0x7f12ac0304a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825c0c2f48d9e3d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:12.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.565+0000 7f12a6a00640 1 -- 172.21.15.37:0/359755475 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac040030 con 0x558e1f2543f0 2024-08-20T05:03:12.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.565+0000 7f12a6a00640 1 -- 172.21.15.37:0/359755475 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12ac030db0 con 0x558e1f2543f0 2024-08-20T05:03:12.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.565+0000 7f12a6a00640 1 -- 172.21.15.37:0/359755475 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac036040 con 0x558e1f2543f0 2024-08-20T05:03:12.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.567+0000 7f1e2149d740 1 Processor -- start 2024-08-20T05:03:12.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.565+0000 7f12b2000640 1 --2- 172.21.15.37:0/2690781710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f129c0b3d20 0x7f129c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.565+0000 7f12b2000640 1 -- 172.21.15.37:0/2690781710 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f12a00e3f30 con 0x7f12b4075b10 2024-08-20T05:03:12.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.566+0000 7f12bec23740 1 -- 172.21.15.37:0/359755475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f2543f0 msgr2=0x558e1f2547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:12.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.566+0000 7f12bec23740 1 --2- 172.21.15.37:0/359755475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f2543f0 0x558e1f2547d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009be0 tx=0x7f12ac0304a0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.566+0000 7f12b9800640 1 --2- 172.21.15.37:0/2690781710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f129c0b3d20 0x7f129c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.567+0000 7f12bec23740 1 -- 172.21.15.37:0/359755475 shutdown_connections 2024-08-20T05:03:12.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.567+0000 7f12bec23740 1 --2- 172.21.15.37:0/359755475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f260ca0 0x558e1f263090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.567+0000 7f12bec23740 1 --2- 172.21.15.37:0/359755475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f254d10 0x558e1f260760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.567+0000 7f12bec23740 1 --2- 172.21.15.37:0/359755475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f2543f0 0x558e1f2547d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.567+0000 7f12bec23740 1 -- 172.21.15.37:0/359755475 >> 172.21.15.37:0/359755475 conn(0x558e1f252220 msgr2=0x558e1f2533c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:12.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.567+0000 7f12bec23740 1 -- 172.21.15.37:0/359755475 shutdown_connections 2024-08-20T05:03:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.568+0000 7f1e2149d740 1 -- start start 2024-08-20T05:03:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.568+0000 7f1e2149d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 0x558b80d4ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.568+0000 7f1e2149d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d4bf40 0x558b80d4e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.568+0000 7f1e2149d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4e980 0x558b80d50e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.568+0000 7f1e2149d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558b80cbc210 con 0x558b80d4bf40 2024-08-20T05:03:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.568+0000 7f1e2149d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558b80cab710 con 0x558b80d4e980 2024-08-20T05:03:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.568+0000 7f1e2149d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558b80caf750 con 0x558b80d49610 2024-08-20T05:03:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.569+0000 7f1e17400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 0x558b80d4ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.569+0000 7f1e17400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 0x558b80d4ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35802/0 (socket says 172.21.15.37:35802) 2024-08-20T05:03:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.569+0000 7f1e17400640 1 -- 172.21.15.37:0/2722259565 learned_addr learned my addr 172.21.15.37:0/2722259565 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:12.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.569+0000 7f1e17e00640 1 --2- 172.21.15.37:0/2722259565 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4e980 0x558b80d50e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.569+0000 7f1e17400640 1 -- 172.21.15.37:0/2722259565 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4e980 msgr2=0x558b80d50e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:12.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.569+0000 7f1e17400640 1 --2- 172.21.15.37:0/2722259565 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4e980 0x558b80d50e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.569+0000 7f1e17400640 1 -- 172.21.15.37:0/2722259565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d4bf40 msgr2=0x558b80d4e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:12.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.569+0000 7f1e17400640 1 --2- 172.21.15.37:0/2722259565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d4bf40 0x558b80d4e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.569+0000 7f1e17400640 1 -- 172.21.15.37:0/2722259565 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b80c77de0 con 0x558b80d49610 2024-08-20T05:03:12.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.569+0000 7f12b9800640 1 --2- 172.21.15.37:0/2690781710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f129c0b3d20 0x7f129c0b61e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f12a80096f0 tx=0x7f12a8009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:12.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.569+0000 7f12bec23740 1 -- 172.21.15.37:0/359755475 wait complete. 2024-08-20T05:03:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.569+0000 7f1e17e00640 1 --2- 172.21.15.37:0/2722259565 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4e980 0x558b80d50e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:03:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.569+0000 7f1e17400640 1 --2- 172.21.15.37:0/2722259565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 0x558b80d4ba00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1e08005820 tx=0x7f1e080aa680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2b3a85ab71851dd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.570+0000 7f1e0cc00640 1 -- 172.21.15.37:0/2722259565 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e080aab70 con 0x558b80d49610 2024-08-20T05:03:12.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.569+0000 7f12bec23740 1 -- start start 2024-08-20T05:03:12.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.570+0000 7f12bec23740 1 Processor -- start 2024-08-20T05:03:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.570+0000 7f1e0cc00640 1 -- 172.21.15.37:0/2722259565 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e080af170 con 0x558b80d49610 2024-08-20T05:03:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.570+0000 7f1e0cc00640 1 -- 172.21.15.37:0/2722259565 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e080aab70 con 0x558b80d49610 2024-08-20T05:03:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.571+0000 7f1e2149d740 1 -- 172.21.15.37:0/2722259565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 msgr2=0x558b80d4ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.571+0000 7f1e2149d740 1 --2- 172.21.15.37:0/2722259565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 0x558b80d4ba00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1e08005820 tx=0x7f1e080aa680 comp rx=0 tx=0).stop 2024-08-20T05:03:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.572+0000 7f1e2149d740 1 -- 172.21.15.37:0/2722259565 shutdown_connections 2024-08-20T05:03:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.572+0000 7f1e2149d740 1 --2- 172.21.15.37:0/2722259565 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4e980 0x558b80d50e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.572+0000 7f1e2149d740 1 --2- 172.21.15.37:0/2722259565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d4bf40 0x558b80d4e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.572+0000 7f1e2149d740 1 --2- 172.21.15.37:0/2722259565 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 0x558b80d4ba00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.572+0000 7f1e2149d740 1 -- 172.21.15.37:0/2722259565 >> 172.21.15.37:0/2722259565 conn(0x558b80d44760 msgr2=0x558b80d454f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:12.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.571+0000 7f12bec23740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f2543f0 0x558e1f25dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.571+0000 7f12bec23740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f254d10 0x558e1f25e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.571+0000 7f12bec23740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f260ca0 0x558e1f25e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.571+0000 7f12bec23740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558e1f15d780 con 0x558e1f254d10 2024-08-20T05:03:12.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.571+0000 7f12bec23740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558e1f1bbd00 con 0x558e1f260ca0 2024-08-20T05:03:12.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.571+0000 7f12bec23740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558e1f01a7a0 con 0x558e1f2543f0 2024-08-20T05:03:12.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.572+0000 7f12bec23740 10 client.0 _ll_register_callbacks cb 0x558e1f165940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.573+0000 7f1e2149d740 1 -- 172.21.15.37:0/2722259565 shutdown_connections 2024-08-20T05:03:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.573+0000 7f1e2149d740 1 -- 172.21.15.37:0/2722259565 wait complete. 2024-08-20T05:03:12.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.573+0000 7f12b8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f254d10 0x558e1f25e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.573+0000 7f1e2149d740 1 -- start start 2024-08-20T05:03:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.574+0000 7f1e2149d740 1 Processor -- start 2024-08-20T05:03:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.573+0000 7f12ba200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f260ca0 0x558e1f25e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.573+0000 7f12b8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f254d10 0x558e1f25e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41524/0 (socket says 172.21.15.37:41524) 2024-08-20T05:03:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.573+0000 7f12b8e00640 1 -- 172.21.15.37:0/2812269364 learned_addr learned my addr 172.21.15.37:0/2812269364 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.573+0000 7f12b9800640 1 --2- 172.21.15.37:0/2812269364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f2543f0 0x558e1f25dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.573+0000 7f12b8e00640 1 -- 172.21.15.37:0/2812269364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f2543f0 msgr2=0x558e1f25dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.573+0000 7f12b8e00640 1 --2- 172.21.15.37:0/2812269364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f2543f0 0x558e1f25dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.574+0000 7f12b8e00640 1 -- 172.21.15.37:0/2812269364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f260ca0 msgr2=0x558e1f25e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.574+0000 7f12b8e00640 1 --2- 172.21.15.37:0/2812269364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f260ca0 0x558e1f25e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.574+0000 7f12b8e00640 1 -- 172.21.15.37:0/2812269364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e1f16a9c0 con 0x558e1f254d10 2024-08-20T05:03:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.574+0000 7f12b8e00640 1 --2- 172.21.15.37:0/2812269364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f254d10 0x558e1f25e1a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f12a00aaaf0 tx=0x7f12a00a63b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da05414d35f2f907 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.575+0000 7f129b400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:03:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.575+0000 7f1e2149d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 0x558b80d52da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.575+0000 7f1e2149d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4bf40 0x558b80d53440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.575+0000 7f1e2149d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d4e980 0x558b80d54010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.575+0000 7f1e2149d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558b80be4ab0 con 0x558b80d4e980 2024-08-20T05:03:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.575+0000 7f1e2149d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558b80c52140 con 0x558b80d4bf40 2024-08-20T05:03:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.575+0000 7f1e2149d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558b80d51900 con 0x558b80d49610 2024-08-20T05:03:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.575+0000 7f1e2149d740 10 client.0 _ll_register_callbacks cb 0x558b80c655d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.575+0000 7f1e16a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4bf40 0x558b80d53440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.576+0000 7f1e16a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4bf40 0x558b80d53440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:35842/0 (socket says 172.21.15.37:35842) 2024-08-20T05:03:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.576+0000 7f1e16a00640 1 -- 172.21.15.37:0/2526952739 learned_addr learned my addr 172.21.15.37:0/2526952739 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.576+0000 7f1e16a00640 1 -- 172.21.15.37:0/2526952739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 msgr2=0x558b80d52da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.576+0000 7f1e16a00640 1 --2- 172.21.15.37:0/2526952739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 0x558b80d52da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.576+0000 7f1e16a00640 1 -- 172.21.15.37:0/2526952739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d4e980 msgr2=0x558b80d54010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.577+0000 7f1e17e00640 1 --2- 172.21.15.37:0/2526952739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d4e980 0x558b80d54010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.576+0000 7f129b400640 1 -- 172.21.15.37:0/2812269364 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a00af160 con 0x558e1f254d10 2024-08-20T05:03:12.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.576+0000 7f129b400640 1 -- 172.21.15.37:0/2812269364 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f12a00b3780 con 0x558e1f254d10 2024-08-20T05:03:12.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.577+0000 7f12bec23740 1 -- 172.21.15.37:0/2812269364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12ac030db0 con 0x558e1f254d10 2024-08-20T05:03:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.577+0000 7f1e16a00640 1 --2- 172.21.15.37:0/2526952739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d4e980 0x558b80d54010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.577+0000 7f1e16a00640 1 -- 172.21.15.37:0/2526952739 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b80c53170 con 0x558b80d4bf40 2024-08-20T05:03:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.577+0000 7f1e17e00640 1 --2- 172.21.15.37:0/2526952739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d4e980 0x558b80d54010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:03:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.578+0000 7f1e16a00640 1 --2- 172.21.15.37:0/2526952739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4bf40 0x558b80d53440 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1e04010010 tx=0x7f1e04011a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf6c4377bbd4ba3b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:12.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.578+0000 7f1e01600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:03:12.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.577+0000 7f129b400640 1 -- 172.21.15.37:0/2812269364 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f12a00cb050 con 0x558e1f254d10 2024-08-20T05:03:12.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.578+0000 7f12bec23740 10 client.15702 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:12.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.578+0000 7f12bec23740 1 -- 172.21.15.37:0/2812269364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558e1ef26b90 con 0x558e1f254d10 2024-08-20T05:03:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.578+0000 7f1e01600640 1 -- 172.21.15.37:0/2526952739 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e04022070 con 0x558b80d4bf40 2024-08-20T05:03:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.579+0000 7f1e01600640 1 -- 172.21.15.37:0/2526952739 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1e040108a0 con 0x558b80d4bf40 2024-08-20T05:03:12.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.579+0000 7f129b400640 1 -- 172.21.15.37:0/2812269364 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12ac030db0 con 0x558e1f254d10 2024-08-20T05:03:12.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.579+0000 7f129b400640 1 -- 172.21.15.37:0/2812269364 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f12a0020020 con 0x558e1f254d10 2024-08-20T05:03:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.579+0000 7f1e2149d740 1 -- 172.21.15.37:0/2526952739 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e080af170 con 0x558b80d4bf40 2024-08-20T05:03:12.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.579+0000 7f12bec23740 10 client.15702 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:12.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.579+0000 7f12bec23740 10 client.15702 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:03:12.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.579+0000 7f12bec23740 20 client.15702 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:12.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.579+0000 7f12bec23740 1 --2- 172.21.15.37:0/2812269364 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558e1f2706b0 0x558e1f272af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.579+0000 7f12bec23740 4 client.15702 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:03:12.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.579+0000 7f12bec23740 1 -- 172.21.15.37:0/2812269364 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e1f1ca710 con 0x558e1f2706b0 2024-08-20T05:03:12.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.580+0000 7f1e01600640 1 -- 172.21.15.37:0/2526952739 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1e0402c050 con 0x558b80d4bf40 2024-08-20T05:03:12.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.580+0000 7f1e2149d740 10 client.25751 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:12.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.580+0000 7f1e2149d740 1 -- 172.21.15.37:0/2526952739 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558b80a0e790 con 0x558b80d4bf40 2024-08-20T05:03:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.579+0000 7f12b9800640 1 --2- 172.21.15.37:0/2812269364 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558e1f2706b0 0x558e1f272af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.580+0000 7f129b400640 10 client.15702 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.580+0000 7f12b9800640 1 --2- 172.21.15.37:0/2812269364 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558e1f2706b0 0x558e1f272af0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c365158535521db server_cookie=113f96e386985b9b in_seq=0 out_seq=0 2024-08-20T05:03:12.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.580+0000 7f1e01600640 1 -- 172.21.15.37:0/2526952739 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e080af170 con 0x558b80d4bf40 2024-08-20T05:03:12.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.581+0000 7f1e01600640 1 -- 172.21.15.37:0/2526952739 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f1e0401ec00 con 0x558b80d4bf40 2024-08-20T05:03:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.581+0000 7f1e2149d740 10 client.25751 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.581+0000 7f1e2149d740 10 client.25751 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:03:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.581+0000 7f1e2149d740 20 client.25751 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.581+0000 7f1e2149d740 1 --2- 172.21.15.37:0/2526952739 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558b80d5eab0 0x558b80d60f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.581+0000 7f1e2149d740 4 client.25751 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:03:12.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.581+0000 7f1e2149d740 1 -- 172.21.15.37:0/2526952739 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b80cbe160 con 0x558b80d5eab0 2024-08-20T05:03:12.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.581+0000 7f129b400640 1 -- 172.21.15.37:0/2812269364 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e1f1ca710 con 0x558e1f2706b0 2024-08-20T05:03:12.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.581+0000 7f129b400640 10 client.15702 handle_command_reply: tid=0 2024-08-20T05:03:12.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.581+0000 7f12bec23740 1 client.15702 shutdown 2024-08-20T05:03:12.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.581+0000 7f12bec23740 1 -- 172.21.15.37:0/2812269364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f254d10 msgr2=0x558e1f25e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:12.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.581+0000 7f12bec23740 1 --2- 172.21.15.37:0/2812269364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f254d10 0x558e1f25e1a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f12a00aaaf0 tx=0x7f12a00a63b0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.582+0000 7f1e17400640 1 --2- 172.21.15.37:0/2526952739 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558b80d5eab0 0x558b80d60f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.582+0000 7f12bec23740 1 -- 172.21.15.37:0/2812269364 shutdown_connections 2024-08-20T05:03:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.582+0000 7f12bec23740 1 --2- 172.21.15.37:0/2812269364 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558e1f2706b0 0x558e1f272af0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.582+0000 7f12bec23740 1 --2- 172.21.15.37:0/2812269364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f260ca0 0x558e1f25e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.582+0000 7f12bec23740 1 --2- 172.21.15.37:0/2812269364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f254d10 0x558e1f25e1a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.582+0000 7f12bec23740 1 --2- 172.21.15.37:0/2812269364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f2543f0 0x558e1f25dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.582+0000 7f12bec23740 1 -- 172.21.15.37:0/2812269364 >> 172.21.15.37:0/2812269364 conn(0x558e1f252220 msgr2=0x558e1f257d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.582+0000 7f129b400640 0 client.15702 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.583+0000 7f12bec23740 1 -- 172.21.15.37:0/2812269364 shutdown_connections 2024-08-20T05:03:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.583+0000 7f1e17400640 1 --2- 172.21.15.37:0/2526952739 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558b80d5eab0 0x558b80d60f30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ecc84fecf2eb905 server_cookie=d0b78891bff396c9 in_seq=0 out_seq=0 2024-08-20T05:03:12.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.583+0000 7f1e01600640 10 client.25751 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:12.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.583+0000 7f12bec23740 1 -- 172.21.15.37:0/2812269364 wait complete. 2024-08-20T05:03:12.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.583+0000 7f12bec23740 20 client.15702 trim_cache size 0 max 16384 2024-08-20T05:03:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.584+0000 7f1e01600640 1 -- 172.21.15.37:0/2526952739 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b80cbe160 con 0x558b80d5eab0 2024-08-20T05:03:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.584+0000 7f1e01600640 10 client.25751 handle_command_reply: tid=0 2024-08-20T05:03:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.584+0000 7f1e2149d740 1 client.25751 shutdown 2024-08-20T05:03:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.585+0000 7f1e2149d740 1 -- 172.21.15.37:0/2526952739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4bf40 msgr2=0x558b80d53440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.585+0000 7f1e2149d740 1 --2- 172.21.15.37:0/2526952739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4bf40 0x558b80d53440 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1e04010010 tx=0x7f1e04011a90 comp rx=0 tx=0).stop 2024-08-20T05:03:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.585+0000 7f1e2149d740 1 -- 172.21.15.37:0/2526952739 shutdown_connections 2024-08-20T05:03:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.585+0000 7f1e2149d740 1 --2- 172.21.15.37:0/2526952739 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558b80d5eab0 0x558b80d60f30 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.585+0000 7f1e2149d740 1 --2- 172.21.15.37:0/2526952739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d4e980 0x558b80d54010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.585+0000 7f1e01600640 0 client.25751 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.585+0000 7f1e2149d740 1 --2- 172.21.15.37:0/2526952739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4bf40 0x558b80d53440 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.585+0000 7f1e2149d740 1 --2- 172.21.15.37:0/2526952739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 0x558b80d52da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.586+0000 7f1e2149d740 1 -- 172.21.15.37:0/2526952739 >> 172.21.15.37:0/2526952739 conn(0x558b80d44760 msgr2=0x558b80d43760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.586+0000 7f1e2149d740 1 -- 172.21.15.37:0/2526952739 shutdown_connections 2024-08-20T05:03:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.586+0000 7f1e2149d740 1 -- 172.21.15.37:0/2526952739 wait complete. 2024-08-20T05:03:12.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.586+0000 7f1e2149d740 20 client.25751 trim_cache size 0 max 16384 2024-08-20T05:03:12.606 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:03:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.610+0000 7f1e2149d740 1 Processor -- start 2024-08-20T05:03:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.610+0000 7f1e2149d740 1 -- start start 2024-08-20T05:03:12.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.610+0000 7f1e2149d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d49610 0x558b80d4ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.610+0000 7f1e2149d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d4bf40 0x558b80d4f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.610+0000 7f1e2149d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4e980 0x558b80d4fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.610+0000 7f1e2149d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e181ba270 con 0x558b80d49610 2024-08-20T05:03:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.610+0000 7f1e2149d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1e181bbe70 con 0x558b80d4e980 2024-08-20T05:03:12.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.610+0000 7f1e2149d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1e181ba940 con 0x558b80d4bf40 2024-08-20T05:03:12.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.611+0000 7f1e16a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d4bf40 0x558b80d4f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.611+0000 7f1e16a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d4bf40 0x558b80d4f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35842/0 (socket says 172.21.15.37:35842) 2024-08-20T05:03:12.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.611+0000 7f1e16a00640 1 -- 172.21.15.37:0/1512494851 learned_addr learned my addr 172.21.15.37:0/1512494851 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:12.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.611+0000 7f1e17400640 1 --2- 172.21.15.37:0/1512494851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d49610 0x558b80d4ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.611+0000 7f1e17e00640 1 --2- 172.21.15.37:0/1512494851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4e980 0x558b80d4fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.612+0000 7f1e16a00640 1 -- 172.21.15.37:0/1512494851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4e980 msgr2=0x558b80d4fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.612+0000 7f1e16a00640 1 --2- 172.21.15.37:0/1512494851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4e980 0x558b80d4fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.613+0000 7f1e16a00640 1 -- 172.21.15.37:0/1512494851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d49610 msgr2=0x558b80d4ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.613+0000 7f1e16a00640 1 --2- 172.21.15.37:0/1512494851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d49610 0x558b80d4ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.613+0000 7f1e16a00640 1 -- 172.21.15.37:0/1512494851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b80a87620 con 0x558b80d4bf40 2024-08-20T05:03:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.613+0000 7f1e17e00640 1 --2- 172.21.15.37:0/1512494851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4e980 0x558b80d4fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.613+0000 7f1e17400640 1 --2- 172.21.15.37:0/1512494851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d49610 0x558b80d4ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:03:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.614+0000 7f1e16a00640 1 --2- 172.21.15.37:0/1512494851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d4bf40 0x558b80d4f2a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1e04011fb0 tx=0x7f1e0400be60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43a9950056455e00 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.614+0000 7f1e03e00640 1 -- 172.21.15.37:0/1512494851 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e04022040 con 0x558b80d4bf40 2024-08-20T05:03:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.615+0000 7f1e03e00640 1 -- 172.21.15.37:0/1512494851 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e040106a0 con 0x558b80d4bf40 2024-08-20T05:03:12.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.615+0000 7f1e03e00640 1 -- 172.21.15.37:0/1512494851 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e0401e690 con 0x558b80d4bf40 2024-08-20T05:03:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.616+0000 7f1e2149d740 1 -- 172.21.15.37:0/1512494851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d4bf40 msgr2=0x558b80d4f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.616+0000 7f1e2149d740 1 --2- 172.21.15.37:0/1512494851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d4bf40 0x558b80d4f2a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1e04011fb0 tx=0x7f1e0400be60 comp rx=0 tx=0).stop 2024-08-20T05:03:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.617+0000 7f1e2149d740 1 -- 172.21.15.37:0/1512494851 shutdown_connections 2024-08-20T05:03:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.617+0000 7f1e2149d740 1 --2- 172.21.15.37:0/1512494851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4e980 0x558b80d4fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.617+0000 7f1e2149d740 1 --2- 172.21.15.37:0/1512494851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d4bf40 0x558b80d4f2a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.617+0000 7f1e2149d740 1 --2- 172.21.15.37:0/1512494851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d49610 0x558b80d4ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.617+0000 7f1e2149d740 1 -- 172.21.15.37:0/1512494851 >> 172.21.15.37:0/1512494851 conn(0x558b80d44760 msgr2=0x558b80d51f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:12.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.612+0000 7f12bec23740 1 Processor -- start 2024-08-20T05:03:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.613+0000 7f12bec23740 1 -- start start 2024-08-20T05:03:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.613+0000 7f12bec23740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f2543f0 0x558e1f258490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.613+0000 7f12bec23740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f254d10 0x558e1f251290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.613+0000 7f12bec23740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f260ca0 0x558e1f2517d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.613+0000 7f12bec23740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12b41be610 con 0x558e1f254d10 2024-08-20T05:03:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.613+0000 7f12bec23740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f12b41c0210 con 0x558e1f260ca0 2024-08-20T05:03:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.613+0000 7f12bec23740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12b41bece0 con 0x558e1f2543f0 2024-08-20T05:03:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.614+0000 7f12b9800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f2543f0 0x558e1f258490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.614+0000 7f12ba200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f260ca0 0x558e1f2517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.614+0000 7f12ba200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f260ca0 0x558e1f2517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:35870/0 (socket says 172.21.15.37:35870) 2024-08-20T05:03:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.614+0000 7f12ba200640 1 -- 172.21.15.37:0/1181891999 learned_addr learned my addr 172.21.15.37:0/1181891999 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.614+0000 7f12b8e00640 1 --2- 172.21.15.37:0/1181891999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f254d10 0x558e1f251290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.615+0000 7f12b9800640 1 -- 172.21.15.37:0/1181891999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f260ca0 msgr2=0x558e1f2517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.615+0000 7f12b9800640 1 --2- 172.21.15.37:0/1181891999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f260ca0 0x558e1f2517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.615+0000 7f12b9800640 1 -- 172.21.15.37:0/1181891999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f254d10 msgr2=0x558e1f251290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.615+0000 7f12b9800640 1 --2- 172.21.15.37:0/1181891999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f254d10 0x558e1f251290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.615+0000 7f12b9800640 1 -- 172.21.15.37:0/1181891999 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e1f254b40 con 0x558e1f2543f0 2024-08-20T05:03:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.615+0000 7f12b8e00640 1 --2- 172.21.15.37:0/1181891999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f254d10 0x558e1f251290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:03:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.615+0000 7f12b9800640 1 --2- 172.21.15.37:0/1181891999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f2543f0 0x558e1f258490 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x558e1f270a90 tx=0x7f12a8014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a85964e26880b76 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.616+0000 7f12a6000640 1 -- 172.21.15.37:0/1181891999 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a80253d0 con 0x558e1f2543f0 2024-08-20T05:03:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.616+0000 7f12a6000640 1 -- 172.21.15.37:0/1181891999 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12a802b070 con 0x558e1f2543f0 2024-08-20T05:03:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.616+0000 7f12a6000640 1 -- 172.21.15.37:0/1181891999 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a80253d0 con 0x558e1f2543f0 2024-08-20T05:03:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.617+0000 7f12bec23740 1 -- 172.21.15.37:0/1181891999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f2543f0 msgr2=0x558e1f258490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.617+0000 7f12bec23740 1 --2- 172.21.15.37:0/1181891999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f2543f0 0x558e1f258490 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x558e1f270a90 tx=0x7f12a8014000 comp rx=0 tx=0).stop 2024-08-20T05:03:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.617+0000 7f12bec23740 1 -- 172.21.15.37:0/1181891999 shutdown_connections 2024-08-20T05:03:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.617+0000 7f12bec23740 1 --2- 172.21.15.37:0/1181891999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f260ca0 0x558e1f2517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.618+0000 7f12bec23740 1 --2- 172.21.15.37:0/1181891999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f254d10 0x558e1f251290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.618+0000 7f12bec23740 1 --2- 172.21.15.37:0/1181891999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f2543f0 0x558e1f258490 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.618+0000 7f12bec23740 1 -- 172.21.15.37:0/1181891999 >> 172.21.15.37:0/1181891999 conn(0x558e1f252220 msgr2=0x558e1f250b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.618+0000 7f12bec23740 1 -- 172.21.15.37:0/1181891999 shutdown_connections 2024-08-20T05:03:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.618+0000 7f12bec23740 1 -- 172.21.15.37:0/1181891999 wait complete. 2024-08-20T05:03:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.619+0000 7f12bec23740 1 -- start start 2024-08-20T05:03:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.619+0000 7f12bec23740 1 Processor -- start 2024-08-20T05:03:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.620+0000 7f12bec23740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f2543f0 0x558e1f265080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.620+0000 7f12bec23740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f254d10 0x558e1f2655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.620+0000 7f12bec23740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f260ca0 0x558e1f2da390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.620+0000 7f12bec23740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12b41bfa80 con 0x558e1f2543f0 2024-08-20T05:03:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.620+0000 7f12bec23740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f12b41bf3b0 con 0x558e1f254d10 2024-08-20T05:03:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.620+0000 7f12bec23740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12b4103b30 con 0x558e1f260ca0 2024-08-20T05:03:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.620+0000 7f12bec23740 10 client.0 _ll_register_callbacks cb 0x7f12a000cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.620+0000 7f12b8e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f254d10 0x558e1f2655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.620+0000 7f12ba200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f260ca0 0x558e1f2da390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.621+0000 7f12b9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f2543f0 0x558e1f265080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.621+0000 7f12ba200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f260ca0 0x558e1f2da390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35868/0 (socket says 172.21.15.37:35868) 2024-08-20T05:03:12.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.621+0000 7f1e2149d740 1 -- 172.21.15.37:0/1512494851 shutdown_connections 2024-08-20T05:03:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.621+0000 7f12b9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f2543f0 0x558e1f265080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41566/0 (socket says 172.21.15.37:41566) 2024-08-20T05:03:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.621+0000 7f12b9800640 1 -- 172.21.15.37:0/842819355 learned_addr learned my addr 172.21.15.37:0/842819355 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.621+0000 7f12b8e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f254d10 0x558e1f2655c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:35882/0 (socket says 172.21.15.37:35882) 2024-08-20T05:03:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.622+0000 7f12b8e00640 1 -- 172.21.15.37:0/842819355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f260ca0 msgr2=0x558e1f2da390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.622+0000 7f12b8e00640 1 --2- 172.21.15.37:0/842819355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f260ca0 0x558e1f2da390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.622+0000 7f12b8e00640 1 -- 172.21.15.37:0/842819355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f2543f0 msgr2=0x558e1f265080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.622+0000 7f12b8e00640 1 --2- 172.21.15.37:0/842819355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f2543f0 0x558e1f265080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.622+0000 7f12b8e00640 1 -- 172.21.15.37:0/842819355 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e1f2da950 con 0x558e1f254d10 2024-08-20T05:03:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.622+0000 7f12b9800640 1 --2- 172.21.15.37:0/842819355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f2543f0 0x558e1f265080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:03:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.622+0000 7f12b8e00640 1 --2- 172.21.15.37:0/842819355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f254d10 0x558e1f2655c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f12a00e1a00 tx=0x7f12a00a6420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b671ca08f75bbd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.622+0000 7f129b400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:03:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.622+0000 7f129b400640 1 -- 172.21.15.37:0/842819355 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a00b3e60 con 0x558e1f254d10 2024-08-20T05:03:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.622+0000 7f129b400640 1 -- 172.21.15.37:0/842819355 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f12a00e7110 con 0x558e1f254d10 2024-08-20T05:03:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.623+0000 7f12bec23740 1 -- 172.21.15.37:0/842819355 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12a802b070 con 0x558e1f254d10 2024-08-20T05:03:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.623+0000 7f129b400640 1 -- 172.21.15.37:0/842819355 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f12a00cb050 con 0x558e1f254d10 2024-08-20T05:03:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.623+0000 7f12bec23740 10 client.25760 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:12.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.623+0000 7f12bec23740 1 -- 172.21.15.37:0/842819355 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558e1f2dbc30 con 0x558e1f254d10 2024-08-20T05:03:12.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.621+0000 7f1e2149d740 1 -- 172.21.15.37:0/1512494851 wait complete. 2024-08-20T05:03:12.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.622+0000 7f1e2149d740 1 -- start start 2024-08-20T05:03:12.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.622+0000 7f1e2149d740 1 Processor -- start 2024-08-20T05:03:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.624+0000 7f129b400640 1 -- 172.21.15.37:0/842819355 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12a802b070 con 0x558e1f254d10 2024-08-20T05:03:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.624+0000 7f129b400640 1 -- 172.21.15.37:0/842819355 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f12a00cd2f0 con 0x558e1f254d10 2024-08-20T05:03:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.625+0000 7f12bec23740 10 client.25760 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.625+0000 7f12bec23740 10 client.25760 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:03:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.625+0000 7f12bec23740 20 client.25760 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.625+0000 7f12bec23740 1 --2- 172.21.15.37:0/842819355 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558e1f2dc360 0x558e1f2de780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.625+0000 7f12bec23740 4 client.25760 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-08-20T05:03:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.625+0000 7f12bec23740 1 -- 172.21.15.37:0/842819355 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x558e1f1c61b0 con 0x558e1f2dc360 2024-08-20T05:03:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.625+0000 7f1e2149d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 0x558b80d55aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.625+0000 7f1e2149d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4bf40 0x558b80d56140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.625+0000 7f1e2149d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d4e980 0x558b80d56cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.625+0000 7f12b9800640 1 --2- 172.21.15.37:0/842819355 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558e1f2dc360 0x558e1f2de780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.626+0000 7f1e17400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 0x558b80d55aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.626+0000 7f1e17400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 0x558b80d55aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35878/0 (socket says 172.21.15.37:35878) 2024-08-20T05:03:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.626+0000 7f1e17400640 1 -- 172.21.15.37:0/1400439707 learned_addr learned my addr 172.21.15.37:0/1400439707 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.626+0000 7f1e2149d740 1 -- 172.21.15.37:0/1400439707 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e181bb6e0 con 0x558b80d4e980 2024-08-20T05:03:12.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.626+0000 7f1e2149d740 1 -- 172.21.15.37:0/1400439707 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1e181bb010 con 0x558b80d4bf40 2024-08-20T05:03:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.626+0000 7f1e2149d740 1 -- 172.21.15.37:0/1400439707 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1e181b8250 con 0x558b80d49610 2024-08-20T05:03:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.626+0000 7f1e2149d740 10 client.0 _ll_register_callbacks cb 0x7f1e04015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.626+0000 7f1e17e00640 1 --2- 172.21.15.37:0/1400439707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d4e980 0x558b80d56cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.626+0000 7f1e16a00640 1 --2- 172.21.15.37:0/1400439707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4bf40 0x558b80d56140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.626+0000 7f1e17400640 1 -- 172.21.15.37:0/1400439707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4bf40 msgr2=0x558b80d56140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.626+0000 7f1e17400640 1 --2- 172.21.15.37:0/1400439707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4bf40 0x558b80d56140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.626+0000 7f1e17400640 1 -- 172.21.15.37:0/1400439707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d4e980 msgr2=0x558b80d56cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.626+0000 7f1e17400640 1 --2- 172.21.15.37:0/1400439707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d4e980 0x558b80d56cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.626+0000 7f1e17400640 1 -- 172.21.15.37:0/1400439707 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b80d574f0 con 0x558b80d49610 2024-08-20T05:03:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.627+0000 7f1e17400640 1 --2- 172.21.15.37:0/1400439707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 0x558b80d55aa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1e080aab00 tx=0x7f1e080b3cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5104d223e2ee841c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:12.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.627+0000 7f1e01600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:03:12.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.627+0000 7f12b9800640 1 --2- 172.21.15.37:0/842819355 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558e1f2dc360 0x558e1f2de780 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fed3b2137d554ba9 server_cookie=24c88a3540b2c20 in_seq=0 out_seq=0 2024-08-20T05:03:12.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:12.627+0000 7f129b400640 10 client.25760 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.627+0000 7f1e01600640 1 -- 172.21.15.37:0/1400439707 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e080af170 con 0x558b80d49610 2024-08-20T05:03:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.627+0000 7f1e01600640 1 -- 172.21.15.37:0/1400439707 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1e080a64e0 con 0x558b80d49610 2024-08-20T05:03:12.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.627+0000 7f1e2149d740 1 -- 172.21.15.37:0/1400439707 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e040106a0 con 0x558b80d49610 2024-08-20T05:03:12.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.628+0000 7f1e01600640 1 -- 172.21.15.37:0/1400439707 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1e080a66e0 con 0x558b80d49610 2024-08-20T05:03:12.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.628+0000 7f1e2149d740 10 client.25768 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:12.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.628+0000 7f1e2149d740 1 -- 172.21.15.37:0/1400439707 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558b80d5a940 con 0x558b80d49610 2024-08-20T05:03:12.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.628+0000 7f1e01600640 1 -- 172.21.15.37:0/1400439707 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e040106a0 con 0x558b80d49610 2024-08-20T05:03:12.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.628+0000 7f1e01600640 1 -- 172.21.15.37:0/1400439707 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f1e08020020 con 0x558b80d49610 2024-08-20T05:03:12.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.628+0000 7f1e2149d740 10 client.25768 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:12.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.628+0000 7f1e2149d740 10 client.25768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:03:12.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.628+0000 7f1e2149d740 20 client.25768 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:12.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.628+0000 7f1e2149d740 1 --2- 172.21.15.37:0/1400439707 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558b80d5eab0 0x558b80ddc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:12.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.629+0000 7f1e2149d740 4 client.25768 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:03:12.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.629+0000 7f1e2149d740 1 -- 172.21.15.37:0/1400439707 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558b80cb9c00 con 0x558b80d5eab0 2024-08-20T05:03:12.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.629+0000 7f1e16a00640 1 --2- 172.21.15.37:0/1400439707 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558b80d5eab0 0x558b80ddc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:12.683 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.630+0000 7f1e01600640 10 client.25768 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:12.683 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.630+0000 7f1e16a00640 1 --2- 172.21.15.37:0/1400439707 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558b80d5eab0 0x558b80ddc7f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=426aee436ad67317 server_cookie=1cfe62ae0e083156 in_seq=0 out_seq=0 2024-08-20T05:03:12.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.713+0000 7f1e01600640 1 -- 172.21.15.37:0/1400439707 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558b80cb9c00 con 0x558b80d5eab0 2024-08-20T05:03:12.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.713+0000 7f1e01600640 10 client.25768 handle_command_reply: tid=0 2024-08-20T05:03:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.713+0000 7f1e2149d740 1 client.25768 shutdown 2024-08-20T05:03:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.713+0000 7f1e2149d740 1 -- 172.21.15.37:0/1400439707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 msgr2=0x558b80d55aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.713+0000 7f1e2149d740 1 --2- 172.21.15.37:0/1400439707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 0x558b80d55aa0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1e080aab00 tx=0x7f1e080b3cc0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.713+0000 7f1e2149d740 1 -- 172.21.15.37:0/1400439707 shutdown_connections 2024-08-20T05:03:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.713+0000 7f1e2149d740 1 --2- 172.21.15.37:0/1400439707 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558b80d5eab0 0x558b80ddc7f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.713+0000 7f1e2149d740 1 --2- 172.21.15.37:0/1400439707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558b80d4e980 0x558b80d56cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.713+0000 7f1e2149d740 1 --2- 172.21.15.37:0/1400439707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558b80d4bf40 0x558b80d56140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.713+0000 7f1e01600640 0 client.25768 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.713+0000 7f1e2149d740 1 --2- 172.21.15.37:0/1400439707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558b80d49610 0x558b80d55aa0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.713+0000 7f1e2149d740 1 -- 172.21.15.37:0/1400439707 >> 172.21.15.37:0/1400439707 conn(0x558b80d44760 msgr2=0x558b80d48750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.713+0000 7f1e2149d740 1 -- 172.21.15.37:0/1400439707 shutdown_connections 2024-08-20T05:03:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.714+0000 7f1e2149d740 1 -- 172.21.15.37:0/1400439707 wait complete. 2024-08-20T05:03:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.714+0000 7f1e2149d740 20 client.25768 trim_cache size 0 max 16384 2024-08-20T05:03:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:03:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:03:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:03:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:03:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.714+0000 7f1e1e600640 1 -- 172.21.15.37:0/2285883911 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1dfc0b3c50 msgr2=0x7f1dfc0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.714+0000 7f1e1e600640 1 --2- 172.21.15.37:0/2285883911 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1dfc0b3c50 0x7f1dfc0b6110 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1e040058c0 tx=0x7f1e04005850 comp rx=0 tx=0).stop 2024-08-20T05:03:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.714+0000 7f1e1e600640 1 -- 172.21.15.37:0/2285883911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e18077750 msgr2=0x7f1e18071830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.714+0000 7f1e1e600640 1 --2- 172.21.15.37:0/2285883911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e18077750 0x7f1e18071830 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800c920 tx=0x7f1e0800cde0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.714+0000 7f1e1e600640 1 -- 172.21.15.37:0/2285883911 shutdown_connections 2024-08-20T05:03:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.714+0000 7f1e1e600640 1 --2- 172.21.15.37:0/2285883911 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1dfc0b3c50 0x7f1dfc0b6110 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.714+0000 7f1e1e600640 1 --2- 172.21.15.37:0/2285883911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e18079260 0x7f1e18072ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.714+0000 7f1e1e600640 1 --2- 172.21.15.37:0/2285883911 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e180788a0 0x7f1e18071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.714+0000 7f1e1e600640 1 --2- 172.21.15.37:0/2285883911 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e18077750 0x7f1e18071830 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.714+0000 7f1e1e600640 1 -- 172.21.15.37:0/2285883911 >> 172.21.15.37:0/2285883911 conn(0x7f1e18100140 msgr2=0x7f1e18101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.715+0000 7f1e1e600640 1 -- 172.21.15.37:0/2285883911 shutdown_connections 2024-08-20T05:03:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:12.715+0000 7f1e1e600640 1 -- 172.21.15.37:0/2285883911 wait complete. 2024-08-20T05:03:13.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:12 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:03:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 15.0 s, 1333.2 tps, lat 69.295 ms stddev 87.507 2024-08-20T05:03:13.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:12 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:03:13.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:12 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:03:13.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.300+0000 7f129b400640 1 -- 172.21.15.37:0/842819355 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x558e1f1c61b0 con 0x558e1f2dc360 2024-08-20T05:03:13.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.300+0000 7f129b400640 10 client.25760 handle_command_reply: tid=0 2024-08-20T05:03:13.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.301+0000 7f12bec23740 1 client.25760 shutdown 2024-08-20T05:03:13.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.301+0000 7f12bec23740 1 -- 172.21.15.37:0/842819355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f254d10 msgr2=0x558e1f2655c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:13.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.301+0000 7f12bec23740 1 --2- 172.21.15.37:0/842819355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f254d10 0x558e1f2655c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f12a00e1a00 tx=0x7f12a00a6420 comp rx=0 tx=0).stop 2024-08-20T05:03:13.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.301+0000 7f12bec23740 1 -- 172.21.15.37:0/842819355 shutdown_connections 2024-08-20T05:03:13.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.301+0000 7f12bec23740 1 --2- 172.21.15.37:0/842819355 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558e1f2dc360 0x558e1f2de780 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:13.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.301+0000 7f12bec23740 1 --2- 172.21.15.37:0/842819355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558e1f260ca0 0x558e1f2da390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:13.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.301+0000 7f12bec23740 1 --2- 172.21.15.37:0/842819355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558e1f254d10 0x558e1f2655c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:13.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.301+0000 7f129b400640 0 client.25760 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:13.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.301+0000 7f12bec23740 1 --2- 172.21.15.37:0/842819355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558e1f2543f0 0x558e1f265080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:13.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.301+0000 7f12bec23740 1 -- 172.21.15.37:0/842819355 >> 172.21.15.37:0/842819355 conn(0x558e1f252220 msgr2=0x558e1f2513a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:13.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.301+0000 7f12bec23740 1 -- 172.21.15.37:0/842819355 shutdown_connections 2024-08-20T05:03:13.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.301+0000 7f12bec23740 1 -- 172.21.15.37:0/842819355 wait complete. 2024-08-20T05:03:13.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.301+0000 7f12bec23740 20 client.25760 trim_cache size 0 max 16384 2024-08-20T05:03:13.305 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:03:13.305 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-08-20T05:03:13.305 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:03:13.305 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 2, 2024-08-20T05:03:13.305 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:03:13.305 INFO:teuthology.orchestra.run.smithi037.stdout: "74fa0cc4": { 2024-08-20T05:03:13.305 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 2, 2024-08-20T05:03:13.305 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:03:13.305 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:03:13.305 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:03:13.305 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:03:13.306 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:03:13.306 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:03:13.306 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 130.0, 2024-08-20T05:03:13.306 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:03:13.306 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:03:13.306 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:03:13.306 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:03:13.306 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:03:13.306 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:03:13.306 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:13.306 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:13.306 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:13.306 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:13.307 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:03:13.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.302+0000 7f12bc200640 1 -- 172.21.15.37:0/2690781710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f129c0b3d20 msgr2=0x7f129c0b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:13.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.302+0000 7f12bc200640 1 --2- 172.21.15.37:0/2690781710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f129c0b3d20 0x7f129c0b61e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f12a80096f0 tx=0x7f12a8009680 comp rx=0 tx=0).stop 2024-08-20T05:03:13.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.302+0000 7f12bc200640 1 -- 172.21.15.37:0/2690781710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b4075b10 msgr2=0x7f12b4102d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:13.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.302+0000 7f12bc200640 1 --2- 172.21.15.37:0/2690781710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b4075b10 0x7f12b4102d70 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f12a000c920 tx=0x7f12a000cde0 comp rx=0 tx=0).stop 2024-08-20T05:03:13.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.302+0000 7f12bc200640 1 -- 172.21.15.37:0/2690781710 shutdown_connections 2024-08-20T05:03:13.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.302+0000 7f12bc200640 1 --2- 172.21.15.37:0/2690781710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f129c0b3d20 0x7f129c0b61e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:13.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.302+0000 7f12bc200640 1 --2- 172.21.15.37:0/2690781710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b410f0c0 0x7f12b41032b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:13.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.302+0000 7f12bc200640 1 --2- 172.21.15.37:0/2690781710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b4075b10 0x7f12b4102d70 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:13.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.302+0000 7f12bc200640 1 --2- 172.21.15.37:0/2690781710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12b40751f0 0x7f12b4102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:13.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.302+0000 7f12bc200640 1 -- 172.21.15.37:0/2690781710 >> 172.21.15.37:0/2690781710 conn(0x7f12b40fe500 msgr2=0x7f12b4111270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:13.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.302+0000 7f12bc200640 1 -- 172.21.15.37:0/2690781710 shutdown_connections 2024-08-20T05:03:13.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:13.302+0000 7f12bc200640 1 -- 172.21.15.37:0/2690781710 wait complete. 2024-08-20T05:03:14.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:13 smithi037 ceph-mon[17265]: pgmap v430: 129 pgs: 129 active+clean; 908 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 13 MiB/s wr, 529 op/s 2024-08-20T05:03:14.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:13 smithi135 ceph-mon[22342]: pgmap v430: 129 pgs: 129 active+clean; 908 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 13 MiB/s wr, 529 op/s 2024-08-20T05:03:14.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:13 smithi130 ceph-mon[22007]: pgmap v430: 129 pgs: 129 active+clean; 908 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 13 MiB/s wr, 529 op/s 2024-08-20T05:03:14.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.316+0000 7fa2fe800640 1 -- 172.21.15.37:0/1263879132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f810cc70 msgr2=0x7fa2f810f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:14.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.316+0000 7fa2fe800640 1 --2- 172.21.15.37:0/1263879132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f810cc70 0x7fa2f810f0d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009ca0 tx=0x7fa2f002a8c0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.316+0000 7fa2fe800640 1 -- 172.21.15.37:0/1263879132 shutdown_connections 2024-08-20T05:03:14.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.316+0000 7fa2fe800640 1 --2- 172.21.15.37:0/1263879132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f810cc70 0x7fa2f810f0d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.316+0000 7fa2fe800640 1 --2- 172.21.15.37:0/1263879132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2f8104130 0x7fa2f810c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.316+0000 7fa2fe800640 1 --2- 172.21.15.37:0/1263879132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2f8103810 0x7fa2f8103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.316+0000 7fa2fe800640 1 -- 172.21.15.37:0/1263879132 >> 172.21.15.37:0/1263879132 conn(0x7fa2f80fd2d0 msgr2=0x7fa2f80ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:14.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.316+0000 7fa2fe800640 1 -- 172.21.15.37:0/1263879132 shutdown_connections 2024-08-20T05:03:14.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.316+0000 7fa2fe800640 1 -- 172.21.15.37:0/1263879132 wait complete. 2024-08-20T05:03:14.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.317+0000 7fa2fe800640 1 Processor -- start 2024-08-20T05:03:14.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.317+0000 7fa2fe800640 1 -- start start 2024-08-20T05:03:14.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.318+0000 7fa2fe800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2f8103810 0x7fa2f8198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.318+0000 7fa2fe800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f8104130 0x7fa2f8199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.318+0000 7fa2fe800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2f810cc70 0x7fa2f819e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.318+0000 7fa2fe800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f81128e0 con 0x7fa2f8104130 2024-08-20T05:03:14.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.318+0000 7fa2fe800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f8112760 con 0x7fa2f8103810 2024-08-20T05:03:14.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.318+0000 7fa2fe800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f8112a60 con 0x7fa2f810cc70 2024-08-20T05:03:14.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.318+0000 7fa2fca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f8104130 0x7fa2f8199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:14.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.318+0000 7fa2fca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f8104130 0x7fa2f8199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50654/0 (socket says 172.21.15.37:50654) 2024-08-20T05:03:14.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.318+0000 7fa2fca00640 1 -- 172.21.15.37:0/820181856 learned_addr learned my addr 172.21.15.37:0/820181856 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:14.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.318+0000 7fa2fd400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2f8103810 0x7fa2f8198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:14.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.318+0000 7fa2fde00640 1 --2- 172.21.15.37:0/820181856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2f810cc70 0x7fa2f819e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:14.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.318+0000 7fa2fd400640 1 -- 172.21.15.37:0/820181856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2f810cc70 msgr2=0x7fa2f819e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:14.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.318+0000 7fa2fd400640 1 --2- 172.21.15.37:0/820181856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2f810cc70 0x7fa2f819e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.318+0000 7fa2fd400640 1 -- 172.21.15.37:0/820181856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f8104130 msgr2=0x7fa2f8199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:14.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.318+0000 7fa2fd400640 1 --2- 172.21.15.37:0/820181856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f8104130 0x7fa2f8199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.318+0000 7fa2fd400640 1 -- 172.21.15.37:0/820181856 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f819eda0 con 0x7fa2f8103810 2024-08-20T05:03:14.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.319+0000 7fa2fca00640 1 --2- 172.21.15.37:0/820181856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f8104130 0x7fa2f8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:14.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.319+0000 7fa2fd400640 1 --2- 172.21.15.37:0/820181856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2f8103810 0x7fa2f8198cf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00e9f0 tx=0x7fa2ec00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:14.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.319+0000 7fa2f6000640 1 -- 172.21.15.37:0/820181856 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec00ccc0 con 0x7fa2f8103810 2024-08-20T05:03:14.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.319+0000 7fa2fe800640 1 -- 172.21.15.37:0/820181856 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f819f090 con 0x7fa2f8103810 2024-08-20T05:03:14.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.319+0000 7fa2f6000640 1 -- 172.21.15.37:0/820181856 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2ec0108e0 con 0x7fa2f8103810 2024-08-20T05:03:14.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.319+0000 7fa2f6000640 1 -- 172.21.15.37:0/820181856 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec018880 con 0x7fa2f8103810 2024-08-20T05:03:14.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.319+0000 7fa2fe800640 1 -- 172.21.15.37:0/820181856 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f81a5920 con 0x7fa2f8103810 2024-08-20T05:03:14.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.322+0000 7fa302831740 1 Processor -- start 2024-08-20T05:03:14.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.323+0000 7fa302831740 1 -- start start 2024-08-20T05:03:14.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.323+0000 7fa302831740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15ded0 0x55ef7e15e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.323+0000 7fa302831740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e15e7f0 0x55ef7e16a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.323+0000 7fa302831740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e16a780 0x55ef7e16cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.323+0000 7fa302831740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ef7e0cfaa0 con 0x55ef7e16a780 2024-08-20T05:03:14.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.323+0000 7fa302831740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ef7e0befa0 con 0x55ef7e15e7f0 2024-08-20T05:03:14.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.323+0000 7fa302831740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ef7e0c2fe0 con 0x55ef7e15ded0 2024-08-20T05:03:14.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.323+0000 7fa2f6000640 1 -- 172.21.15.37:0/820181856 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa2ec010430 con 0x7fa2f8103810 2024-08-20T05:03:14.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.323+0000 7fa2fde00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15ded0 0x55ef7e15e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:14.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.323+0000 7fa2fde00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15ded0 0x55ef7e15e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41024/0 (socket says 172.21.15.37:41024) 2024-08-20T05:03:14.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.323+0000 7fa2fde00640 1 -- 172.21.15.37:0/3598865671 learned_addr learned my addr 172.21.15.37:0/3598865671 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:14.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.323+0000 7fa2fca00640 1 --2- 172.21.15.37:0/3598865671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e16a780 0x55ef7e16cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:14.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.324+0000 7fa2fd400640 1 --2- 172.21.15.37:0/3598865671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e15e7f0 0x55ef7e16a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:14.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.324+0000 7fa2fde00640 1 -- 172.21.15.37:0/3598865671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e15e7f0 msgr2=0x55ef7e16a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:14.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.324+0000 7fa2fde00640 1 --2- 172.21.15.37:0/3598865671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e15e7f0 0x55ef7e16a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.324+0000 7fa2fde00640 1 -- 172.21.15.37:0/3598865671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e16a780 msgr2=0x55ef7e16cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:14.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.324+0000 7fa2fde00640 1 --2- 172.21.15.37:0/3598865671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e16a780 0x55ef7e16cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.324+0000 7fa2fde00640 1 -- 172.21.15.37:0/3598865671 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef7e065420 con 0x55ef7e15ded0 2024-08-20T05:03:14.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.324+0000 7fa2fd400640 1 --2- 172.21.15.37:0/3598865671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e15e7f0 0x55ef7e16a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:03:14.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.324+0000 7fa2fde00640 1 --2- 172.21.15.37:0/3598865671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15ded0 0x55ef7e15e2b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009410 tx=0x7fa2f0005ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec5adebf5244266f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:14.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.324+0000 7fa2ea600640 1 -- 172.21.15.37:0/3598865671 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0031cf0 con 0x55ef7e15ded0 2024-08-20T05:03:14.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.325+0000 7fa2ea600640 1 -- 172.21.15.37:0/3598865671 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2f0036030 con 0x55ef7e15ded0 2024-08-20T05:03:14.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.325+0000 7fa2ea600640 1 -- 172.21.15.37:0/3598865671 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f00042a0 con 0x55ef7e15ded0 2024-08-20T05:03:14.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.325+0000 7fa2f6000640 1 --2- 172.21.15.37:0/820181856 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2e00b3cf0 0x7fa2e00b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.325+0000 7fa302831740 1 -- 172.21.15.37:0/3598865671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15ded0 msgr2=0x55ef7e15e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:14.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.325+0000 7fa302831740 1 --2- 172.21.15.37:0/3598865671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15ded0 0x55ef7e15e2b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009410 tx=0x7fa2f0005ef0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.325+0000 7fa2f6000640 1 -- 172.21.15.37:0/820181856 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa2ec0e4270 con 0x7fa2f8103810 2024-08-20T05:03:14.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.325+0000 7fa302831740 1 -- 172.21.15.37:0/3598865671 shutdown_connections 2024-08-20T05:03:14.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.325+0000 7fa302831740 1 --2- 172.21.15.37:0/3598865671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e16a780 0x55ef7e16cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.325+0000 7fa302831740 1 --2- 172.21.15.37:0/3598865671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e15e7f0 0x55ef7e16a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.325+0000 7fa302831740 1 --2- 172.21.15.37:0/3598865671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15ded0 0x55ef7e15e2b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.325+0000 7fa302831740 1 -- 172.21.15.37:0/3598865671 >> 172.21.15.37:0/3598865671 conn(0x55ef7e15bd00 msgr2=0x55ef7e15cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:14.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.325+0000 7fa2fd400640 1 --2- 172.21.15.37:0/820181856 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2e00b3cf0 0x7fa2e00b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:14.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.326+0000 7fa302831740 1 -- 172.21.15.37:0/3598865671 shutdown_connections 2024-08-20T05:03:14.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.326+0000 7fa302831740 1 -- 172.21.15.37:0/3598865671 wait complete. 2024-08-20T05:03:14.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.326+0000 7fa2fd400640 1 --2- 172.21.15.37:0/820181856 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2e00b3cf0 0x7fa2e00b61b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0e1d40 tx=0x7fa2ec009700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:14.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.326+0000 7fa302831740 1 -- start start 2024-08-20T05:03:14.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.326+0000 7fa302831740 1 Processor -- start 2024-08-20T05:03:14.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.327+0000 7fa302831740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e15ded0 0x55ef7e169f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.327+0000 7fa302831740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e15e7f0 0x55ef7e167380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.327+0000 7fa302831740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e16a780 0x55ef7e1678c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.327+0000 7fa302831740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ef7df21700 con 0x55ef7e15ded0 2024-08-20T05:03:14.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.327+0000 7fa302831740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ef7e05a290 con 0x55ef7e15e7f0 2024-08-20T05:03:14.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.327+0000 7fa302831740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ef7e16d220 con 0x55ef7e16a780 2024-08-20T05:03:14.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.327+0000 7fa302831740 10 client.0 _ll_register_callbacks cb 0x55ef7e0b91c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:14.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.327+0000 7fa2fde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e15ded0 0x55ef7e169f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:14.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.327+0000 7fa2fde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e15ded0 0x55ef7e169f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50668/0 (socket says 172.21.15.37:50668) 2024-08-20T05:03:14.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.327+0000 7fa2fde00640 1 -- 172.21.15.37:0/1927197714 learned_addr learned my addr 172.21.15.37:0/1927197714 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:14.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.327+0000 7fa2fde00640 1 --2- 172.21.15.37:0/1927197714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e16a780 0x55ef7e1678c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:14.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.327+0000 7fa2fca00640 1 --2- 172.21.15.37:0/1927197714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e15e7f0 0x55ef7e167380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:14.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.328+0000 7fa2fde00640 1 -- 172.21.15.37:0/1927197714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e16a780 msgr2=0x55ef7e1678c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:14.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.328+0000 7fa2fde00640 1 --2- 172.21.15.37:0/1927197714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e16a780 0x55ef7e1678c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.328+0000 7fa2fde00640 1 -- 172.21.15.37:0/1927197714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e15e7f0 msgr2=0x55ef7e167380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:14.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.328+0000 7fa2fde00640 1 --2- 172.21.15.37:0/1927197714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e15e7f0 0x55ef7e167380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.328+0000 7fa2fde00640 1 -- 172.21.15.37:0/1927197714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef7de1e650 con 0x55ef7e15ded0 2024-08-20T05:03:14.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.328+0000 7fa2fca00640 1 --2- 172.21.15.37:0/1927197714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e15e7f0 0x55ef7e167380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:14.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.328+0000 7fa2fde00640 1 --2- 172.21.15.37:0/1927197714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e15ded0 0x55ef7e169f30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0003d90 tx=0x7fa2f0003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fecbbf9b69f5ccf1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:14.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.328+0000 7fa2dea00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:03:14.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.328+0000 7fa2dea00640 1 -- 172.21.15.37:0/1927197714 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0059060 con 0x55ef7e15ded0 2024-08-20T05:03:14.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.328+0000 7fa302831740 1 -- 172.21.15.37:0/1927197714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2f0036030 con 0x55ef7e15ded0 2024-08-20T05:03:14.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.328+0000 7fa2dea00640 1 -- 172.21.15.37:0/1927197714 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa2f002f860 con 0x55ef7e15ded0 2024-08-20T05:03:14.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.329+0000 7fa2dea00640 1 -- 172.21.15.37:0/1927197714 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa2f0031900 con 0x55ef7e15ded0 2024-08-20T05:03:14.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.329+0000 7fa302831740 10 client.15723 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:14.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.329+0000 7fa302831740 1 -- 172.21.15.37:0/1927197714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ef7e1789e0 con 0x55ef7e15ded0 2024-08-20T05:03:14.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.329+0000 7fa2dea00640 1 -- 172.21.15.37:0/1927197714 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2f0036030 con 0x55ef7e15ded0 2024-08-20T05:03:14.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.329+0000 7fa2dea00640 1 -- 172.21.15.37:0/1927197714 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fa2f0043070 con 0x55ef7e15ded0 2024-08-20T05:03:14.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.329+0000 7fa302831740 10 client.15723 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:14.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.329+0000 7fa302831740 10 client.15723 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:03:14.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.329+0000 7fa302831740 20 client.15723 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:14.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.329+0000 7fa302831740 1 --2- 172.21.15.37:0/1927197714 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ef7e179d30 0x55ef7e17c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.329+0000 7fa302831740 4 client.15723 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:03:14.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.329+0000 7fa302831740 1 -- 172.21.15.37:0/1927197714 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef7e0d19f0 con 0x55ef7e179d30 2024-08-20T05:03:14.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.330+0000 7fa2fca00640 1 --2- 172.21.15.37:0/1927197714 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ef7e179d30 0x55ef7e17c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:14.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.330+0000 7fa2fca00640 1 --2- 172.21.15.37:0/1927197714 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ef7e179d30 0x55ef7e17c120 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15f4d11b9fc5dc9f server_cookie=dd4adf91480f880a in_seq=0 out_seq=0 2024-08-20T05:03:14.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.330+0000 7fa2dea00640 10 client.15723 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:14.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.331+0000 7fa2dea00640 1 -- 172.21.15.37:0/1927197714 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ef7e0d19f0 con 0x55ef7e179d30 2024-08-20T05:03:14.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.331+0000 7fa2dea00640 10 client.15723 handle_command_reply: tid=0 2024-08-20T05:03:14.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.331+0000 7fa302831740 1 client.15723 shutdown 2024-08-20T05:03:14.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.332+0000 7fa302831740 1 -- 172.21.15.37:0/1927197714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e15ded0 msgr2=0x55ef7e169f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:14.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.332+0000 7fa302831740 1 --2- 172.21.15.37:0/1927197714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e15ded0 0x55ef7e169f30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0003d90 tx=0x7fa2f0003c90 comp rx=0 tx=0).stop 2024-08-20T05:03:14.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.332+0000 7fa302831740 1 -- 172.21.15.37:0/1927197714 shutdown_connections 2024-08-20T05:03:14.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.332+0000 7fa302831740 1 --2- 172.21.15.37:0/1927197714 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ef7e179d30 0x55ef7e17c120 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.332+0000 7fa302831740 1 --2- 172.21.15.37:0/1927197714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e16a780 0x55ef7e1678c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.332+0000 7fa302831740 1 --2- 172.21.15.37:0/1927197714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e15e7f0 0x55ef7e167380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.332+0000 7fa302831740 1 --2- 172.21.15.37:0/1927197714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e15ded0 0x55ef7e169f30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.332+0000 7fa302831740 1 -- 172.21.15.37:0/1927197714 >> 172.21.15.37:0/1927197714 conn(0x55ef7e15bd00 msgr2=0x55ef7e156ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:14.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.332+0000 7fa2dea00640 0 client.15723 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:14.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.332+0000 7fa302831740 1 -- 172.21.15.37:0/1927197714 shutdown_connections 2024-08-20T05:03:14.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.332+0000 7fa302831740 1 -- 172.21.15.37:0/1927197714 wait complete. 2024-08-20T05:03:14.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.333+0000 7fa302831740 20 client.15723 trim_cache size 0 max 16384 2024-08-20T05:03:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.347+0000 7fa302831740 1 Processor -- start 2024-08-20T05:03:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.347+0000 7fa302831740 1 -- start start 2024-08-20T05:03:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.348+0000 7fa302831740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e15ded0 0x55ef7e1763a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.348+0000 7fa302831740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15e7f0 0x55ef7e15d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.348+0000 7fa302831740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e16a780 0x55ef7e162900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.348+0000 7fa302831740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f81ad380 con 0x55ef7e15ded0 2024-08-20T05:03:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.348+0000 7fa302831740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f81aef80 con 0x55ef7e16a780 2024-08-20T05:03:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.348+0000 7fa302831740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f81ada50 con 0x55ef7e15e7f0 2024-08-20T05:03:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.348+0000 7fa2fde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e15ded0 0x55ef7e1763a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.348+0000 7fa2fca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15e7f0 0x55ef7e15d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.348+0000 7fa2fde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e15ded0 0x55ef7e1763a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50676/0 (socket says 172.21.15.37:50676) 2024-08-20T05:03:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.348+0000 7fa2fde00640 1 -- 172.21.15.37:0/2762569504 learned_addr learned my addr 172.21.15.37:0/2762569504 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.348+0000 7fa2fde00640 1 --2- 172.21.15.37:0/2762569504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e16a780 0x55ef7e162900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.348+0000 7fa2fca00640 1 -- 172.21.15.37:0/2762569504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e16a780 msgr2=0x55ef7e162900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.348+0000 7fa2fca00640 1 --2- 172.21.15.37:0/2762569504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e16a780 0x55ef7e162900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.348+0000 7fa2fca00640 1 -- 172.21.15.37:0/2762569504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e15ded0 msgr2=0x55ef7e1763a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.348+0000 7fa2fca00640 1 --2- 172.21.15.37:0/2762569504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e15ded0 0x55ef7e1763a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.348+0000 7fa2fca00640 1 -- 172.21.15.37:0/2762569504 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef7e167130 con 0x55ef7e15e7f0 2024-08-20T05:03:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.348+0000 7fa2fde00640 1 --2- 172.21.15.37:0/2762569504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e16a780 0x55ef7e162900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:14.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.349+0000 7fa2fca00640 1 --2- 172.21.15.37:0/2762569504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15e7f0 0x55ef7e15d430 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55ef7e17c850 tx=0x7fa2e4005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dccbf0982f15088e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.349+0000 7fa2e9c00640 1 -- 172.21.15.37:0/2762569504 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40120d0 con 0x55ef7e15e7f0 2024-08-20T05:03:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.349+0000 7fa2e9c00640 1 -- 172.21.15.37:0/2762569504 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2e4012270 con 0x55ef7e15e7f0 2024-08-20T05:03:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.349+0000 7fa2e9c00640 1 -- 172.21.15.37:0/2762569504 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4004a00 con 0x55ef7e15e7f0 2024-08-20T05:03:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.350+0000 7fa302831740 1 -- 172.21.15.37:0/2762569504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15e7f0 msgr2=0x55ef7e15d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.350+0000 7fa302831740 1 --2- 172.21.15.37:0/2762569504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15e7f0 0x55ef7e15d430 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55ef7e17c850 tx=0x7fa2e4005f90 comp rx=0 tx=0).stop 2024-08-20T05:03:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.350+0000 7fa302831740 1 -- 172.21.15.37:0/2762569504 shutdown_connections 2024-08-20T05:03:14.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.350+0000 7fa302831740 1 --2- 172.21.15.37:0/2762569504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e16a780 0x55ef7e162900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.350+0000 7fa302831740 1 --2- 172.21.15.37:0/2762569504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15e7f0 0x55ef7e15d430 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.350+0000 7fa302831740 1 --2- 172.21.15.37:0/2762569504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e15ded0 0x55ef7e1763a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.350+0000 7fa302831740 1 -- 172.21.15.37:0/2762569504 >> 172.21.15.37:0/2762569504 conn(0x55ef7e15bd00 msgr2=0x55ef7e1621f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.350+0000 7fa302831740 1 -- 172.21.15.37:0/2762569504 shutdown_connections 2024-08-20T05:03:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.350+0000 7fa302831740 1 -- 172.21.15.37:0/2762569504 wait complete. 2024-08-20T05:03:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.351+0000 7fa302831740 1 -- start start 2024-08-20T05:03:14.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.351+0000 7fa302831740 1 Processor -- start 2024-08-20T05:03:14.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.351+0000 7fa302831740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15ded0 0x55ef7e172970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.351+0000 7fa302831740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e15e7f0 0x55ef7e16de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.351+0000 7fa302831740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e16a780 0x55ef7e16e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.351+0000 7fa302831740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f81ae7f0 con 0x55ef7e16a780 2024-08-20T05:03:14.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.351+0000 7fa302831740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f81ae120 con 0x55ef7e15e7f0 2024-08-20T05:03:14.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.351+0000 7fa302831740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f81ab360 con 0x55ef7e15ded0 2024-08-20T05:03:14.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.351+0000 7fa302831740 10 client.0 _ll_register_callbacks cb 0x7fa2e4009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:14.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.352+0000 7fa2fde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e16a780 0x55ef7e16e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.352+0000 7fa2fde00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15ded0 0x55ef7e172970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.352+0000 7fa2fde00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15ded0 0x55ef7e172970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41048/0 (socket says 172.21.15.37:41048) 2024-08-20T05:03:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.352+0000 7fa2fde00640 1 -- 172.21.15.37:0/142610054 learned_addr learned my addr 172.21.15.37:0/142610054 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.352+0000 7fa2fde00640 1 -- 172.21.15.37:0/142610054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e15e7f0 msgr2=0x55ef7e16de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.352+0000 7fa2fde00640 1 --2- 172.21.15.37:0/142610054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e15e7f0 0x55ef7e16de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.352+0000 7fa2fde00640 1 -- 172.21.15.37:0/142610054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e16a780 msgr2=0x55ef7e16e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.352+0000 7fa2fde00640 1 --2- 172.21.15.37:0/142610054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e16a780 0x55ef7e16e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.352+0000 7fa2fde00640 1 -- 172.21.15.37:0/142610054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef7e16e970 con 0x55ef7e15ded0 2024-08-20T05:03:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.353+0000 7fa2fde00640 1 --2- 172.21.15.37:0/142610054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15ded0 0x55ef7e172970 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0005cc0 tx=0x7fa2f002a8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6fe802b0129c5ea server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.353+0000 7fa2dea00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:03:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.353+0000 7fa2dea00640 1 -- 172.21.15.37:0/142610054 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0059070 con 0x55ef7e15ded0 2024-08-20T05:03:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.353+0000 7fa302831740 1 -- 172.21.15.37:0/142610054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2e4012270 con 0x55ef7e15ded0 2024-08-20T05:03:14.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.353+0000 7fa2dea00640 1 -- 172.21.15.37:0/142610054 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa2f0031e00 con 0x55ef7e15ded0 2024-08-20T05:03:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.353+0000 7fa2dea00640 1 -- 172.21.15.37:0/142610054 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fa2f0009540 con 0x55ef7e15ded0 2024-08-20T05:03:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.353+0000 7fa302831740 10 client.25786 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.353+0000 7fa302831740 1 -- 172.21.15.37:0/142610054 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ef7e1e46d0 con 0x55ef7e15ded0 2024-08-20T05:03:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.353+0000 7fa2dea00640 1 -- 172.21.15.37:0/142610054 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2e4012270 con 0x55ef7e15ded0 2024-08-20T05:03:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.354+0000 7fa2dea00640 1 -- 172.21.15.37:0/142610054 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fa2f0043070 con 0x55ef7e15ded0 2024-08-20T05:03:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.354+0000 7fa302831740 10 client.25786 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.354+0000 7fa302831740 10 client.25786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:03:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.354+0000 7fa302831740 20 client.25786 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.354+0000 7fa302831740 1 --2- 172.21.15.37:0/142610054 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ef7e1e4bc0 0x55ef7e1e6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.354+0000 7fa302831740 4 client.25786 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:03:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.354+0000 7fa302831740 1 -- 172.21.15.37:0/142610054 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ef7e0cd490 con 0x55ef7e1e4bc0 2024-08-20T05:03:14.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.354+0000 7fa2fca00640 1 --2- 172.21.15.37:0/142610054 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ef7e1e4bc0 0x55ef7e1e6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:14.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.355+0000 7fa2fca00640 1 --2- 172.21.15.37:0/142610054 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ef7e1e4bc0 0x55ef7e1e6fe0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5f511ac60e5ddbb server_cookie=a18e5a9c0b86b800 in_seq=0 out_seq=0 2024-08-20T05:03:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.355+0000 7fa2dea00640 10 client.25786 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.355+0000 7fa2dea00640 1 -- 172.21.15.37:0/142610054 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ef7e0cd490 con 0x55ef7e1e4bc0 2024-08-20T05:03:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.355+0000 7fa2dea00640 10 client.25786 handle_command_reply: tid=0 2024-08-20T05:03:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.355+0000 7fa302831740 1 client.25786 shutdown 2024-08-20T05:03:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.355+0000 7fa302831740 1 -- 172.21.15.37:0/142610054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15ded0 msgr2=0x55ef7e172970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.355+0000 7fa302831740 1 --2- 172.21.15.37:0/142610054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15ded0 0x55ef7e172970 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0005cc0 tx=0x7fa2f002a8c0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.355+0000 7fa302831740 1 -- 172.21.15.37:0/142610054 shutdown_connections 2024-08-20T05:03:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.355+0000 7fa302831740 1 --2- 172.21.15.37:0/142610054 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ef7e1e4bc0 0x55ef7e1e6fe0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.355+0000 7fa302831740 1 --2- 172.21.15.37:0/142610054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef7e16a780 0x55ef7e16e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.355+0000 7fa302831740 1 --2- 172.21.15.37:0/142610054 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ef7e15e7f0 0x55ef7e16de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.355+0000 7fa302831740 1 --2- 172.21.15.37:0/142610054 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ef7e15ded0 0x55ef7e172970 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.355+0000 7fa2dea00640 0 client.25786 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.355+0000 7fa302831740 1 -- 172.21.15.37:0/142610054 >> 172.21.15.37:0/142610054 conn(0x55ef7e15bd00 msgr2=0x55ef7e156ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:14.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.356+0000 7fa302831740 1 -- 172.21.15.37:0/142610054 shutdown_connections 2024-08-20T05:03:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.356+0000 7fa302831740 1 -- 172.21.15.37:0/142610054 wait complete. 2024-08-20T05:03:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.356+0000 7fa302831740 20 client.25786 trim_cache size 0 max 16384 2024-08-20T05:03:14.361 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:03:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.356+0000 7fa2fe800640 1 -- 172.21.15.37:0/820181856 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2e00b3cf0 msgr2=0x7fa2e00b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.356+0000 7fa2fe800640 1 --2- 172.21.15.37:0/820181856 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2e00b3cf0 0x7fa2e00b61b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0e1d40 tx=0x7fa2ec009700 comp rx=0 tx=0).stop 2024-08-20T05:03:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.356+0000 7fa2fe800640 1 -- 172.21.15.37:0/820181856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2f8103810 msgr2=0x7fa2f8198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.356+0000 7fa2fe800640 1 --2- 172.21.15.37:0/820181856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2f8103810 0x7fa2f8198cf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00e9f0 tx=0x7fa2ec00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.357+0000 7fa2fe800640 1 -- 172.21.15.37:0/820181856 shutdown_connections 2024-08-20T05:03:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.357+0000 7fa2fe800640 1 --2- 172.21.15.37:0/820181856 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2e00b3cf0 0x7fa2e00b61b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.357+0000 7fa2fe800640 1 --2- 172.21.15.37:0/820181856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2f810cc70 0x7fa2f819e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.357+0000 7fa2fe800640 1 --2- 172.21.15.37:0/820181856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2f8104130 0x7fa2f8199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.357+0000 7fa2fe800640 1 --2- 172.21.15.37:0/820181856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2f8103810 0x7fa2f8198cf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.357+0000 7fa2fe800640 1 -- 172.21.15.37:0/820181856 >> 172.21.15.37:0/820181856 conn(0x7fa2f80fd2d0 msgr2=0x7fa2f810eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.357+0000 7fa2fe800640 1 -- 172.21.15.37:0/820181856 shutdown_connections 2024-08-20T05:03:14.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:14.357+0000 7fa2fe800640 1 -- 172.21.15.37:0/820181856 wait complete. 2024-08-20T05:03:16.008 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:15 smithi130 ceph-mon[22007]: pgmap v431: 129 pgs: 129 active+clean; 920 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 9.3 MiB/s wr, 686 op/s 2024-08-20T05:03:16.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:15 smithi037 ceph-mon[17265]: pgmap v431: 129 pgs: 129 active+clean; 920 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 9.3 MiB/s wr, 686 op/s 2024-08-20T05:03:16.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:15 smithi135 ceph-mon[22342]: pgmap v431: 129 pgs: 129 active+clean; 920 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 9.3 MiB/s wr, 686 op/s 2024-08-20T05:03:16.514 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '74fa0cc4', quiesce took 12.8 seconds. Will release after: -2.8000000000000007 2024-08-20T05:03:16.514 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:03:16.899 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:03:16.920 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T05:03:16.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T05:03:17.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.539+0000 7fd79b800640 1 -- 172.21.15.37:0/4180828133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd794102ab0 msgr2=0x7fd794102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.539+0000 7fd79b800640 1 --2- 172.21.15.37:0/4180828133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd794102ab0 0x7fd794102e90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd788009900 tx=0x7fd78802a410 comp rx=0 tx=0).stop 2024-08-20T05:03:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.540+0000 7fd79b800640 1 -- 172.21.15.37:0/4180828133 shutdown_connections 2024-08-20T05:03:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.540+0000 7fd79b800640 1 --2- 172.21.15.37:0/4180828133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd794108e40 0x7fd79410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.540+0000 7fd79b800640 1 --2- 172.21.15.37:0/4180828133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7941084c0 0x7fd794108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.540+0000 7fd79b800640 1 --2- 172.21.15.37:0/4180828133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd794102ab0 0x7fd794102e90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.540+0000 7fd79b800640 1 -- 172.21.15.37:0/4180828133 >> 172.21.15.37:0/4180828133 conn(0x7fd7940fe500 msgr2=0x7fd794100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.540+0000 7fd79b800640 1 -- 172.21.15.37:0/4180828133 shutdown_connections 2024-08-20T05:03:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.540+0000 7fd79b800640 1 -- 172.21.15.37:0/4180828133 wait complete. 2024-08-20T05:03:17.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.542+0000 7fd79b800640 1 Processor -- start 2024-08-20T05:03:17.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.542+0000 7fd79b800640 1 -- start start 2024-08-20T05:03:17.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.543+0000 7fd79b800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd794102ab0 0x7fd794198ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:17.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.543+0000 7fd79b800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7941084c0 0x7fd794199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:17.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.543+0000 7fd79b800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd794108e40 0x7fd79419e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:17.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.543+0000 7fd79b800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd794112b50 con 0x7fd794102ab0 2024-08-20T05:03:17.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.543+0000 7fd79b800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd7941129d0 con 0x7fd794108e40 2024-08-20T05:03:17.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.543+0000 7fd79b800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd794112cd0 con 0x7fd7941084c0 2024-08-20T05:03:17.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.544+0000 7fd799800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd794108e40 0x7fd79419e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:17.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.544+0000 7fd798e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd794102ab0 0x7fd794198ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:17.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.544+0000 7fd799800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd794108e40 0x7fd79419e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42548/0 (socket says 172.21.15.37:42548) 2024-08-20T05:03:17.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.544+0000 7fd799800640 1 -- 172.21.15.37:0/2455528149 learned_addr learned my addr 172.21.15.37:0/2455528149 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:17.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.544+0000 7fd798e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd794102ab0 0x7fd794198ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50696/0 (socket says 172.21.15.37:50696) 2024-08-20T05:03:17.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.544+0000 7fd793e00640 1 --2- 172.21.15.37:0/2455528149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7941084c0 0x7fd794199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:17.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.545+0000 7fd799800640 1 -- 172.21.15.37:0/2455528149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7941084c0 msgr2=0x7fd794199530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:17.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.545+0000 7fd799800640 1 --2- 172.21.15.37:0/2455528149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7941084c0 0x7fd794199530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:17.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.545+0000 7fd799800640 1 -- 172.21.15.37:0/2455528149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd794102ab0 msgr2=0x7fd794198ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:17.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.545+0000 7fd799800640 1 --2- 172.21.15.37:0/2455528149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd794102ab0 0x7fd794198ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:17.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.545+0000 7fd799800640 1 -- 172.21.15.37:0/2455528149 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd79419f0a0 con 0x7fd794108e40 2024-08-20T05:03:17.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.545+0000 7fd799800640 1 --2- 172.21.15.37:0/2455528149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd794108e40 0x7fd79419e8d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00b990 tx=0x7fd78c00be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:17.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.546+0000 7fd791600640 1 -- 172.21.15.37:0/2455528149 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c01d070 con 0x7fd794108e40 2024-08-20T05:03:17.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.546+0000 7fd791600640 1 -- 172.21.15.37:0/2455528149 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd78c0188f0 con 0x7fd794108e40 2024-08-20T05:03:17.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.546+0000 7fd791600640 1 -- 172.21.15.37:0/2455528149 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0079e0 con 0x7fd794108e40 2024-08-20T05:03:17.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.547+0000 7fd79b800640 1 -- 172.21.15.37:0/2455528149 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd79419f390 con 0x7fd794108e40 2024-08-20T05:03:17.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.547+0000 7fd79b800640 1 -- 172.21.15.37:0/2455528149 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7940750b0 con 0x7fd794108e40 2024-08-20T05:03:17.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.548+0000 7fd79b800640 1 -- 172.21.15.37:0/2455528149 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd794102e90 con 0x7fd794108e40 2024-08-20T05:03:17.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.551+0000 7fd791600640 1 -- 172.21.15.37:0/2455528149 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd78c018aa0 con 0x7fd794108e40 2024-08-20T05:03:17.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.552+0000 7fd791600640 1 --2- 172.21.15.37:0/2455528149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd77c0b3bd0 0x7fd77c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:17.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.553+0000 7fd791600640 1 -- 172.21.15.37:0/2455528149 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd78c0e82b0 con 0x7fd794108e40 2024-08-20T05:03:17.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.553+0000 7fd798e00640 1 --2- 172.21.15.37:0/2455528149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd77c0b3bd0 0x7fd77c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:17.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.554+0000 7fd798e00640 1 --2- 172.21.15.37:0/2455528149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd77c0b3bd0 0x7fd77c0b6090 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd788005ab0 tx=0x7fd788005a00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:17.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.554+0000 7fd791600640 1 -- 172.21.15.37:0/2455528149 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd78c0aeeb0 con 0x7fd794108e40 2024-08-20T05:03:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:03:17.807 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:17 smithi037 ceph-mon[17265]: pgmap v432: 129 pgs: 129 active+clean; 934 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 8.0 MiB/s wr, 665 op/s 2024-08-20T05:03:17.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.825+0000 7fd79b800640 1 -- 172.21.15.37:0/2455528149 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd79419a120 con 0x7fd794108e40 2024-08-20T05:03:17.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.826+0000 7fd791600640 1 -- 172.21.15.37:0/2455528149 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11987 (secure 0 0 0) 0x7fd78c0b3400 con 0x7fd794108e40 2024-08-20T05:03:17.828 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:03:17.828 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":33,"btime":"2024-08-20T05:03:11:706710+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:03:11.271814+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:03:17.828 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 33 2024-08-20T05:03:17.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.828+0000 7fd79b800640 1 -- 172.21.15.37:0/2455528149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd77c0b3bd0 msgr2=0x7fd77c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:17.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.828+0000 7fd79b800640 1 --2- 172.21.15.37:0/2455528149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd77c0b3bd0 0x7fd77c0b6090 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd788005ab0 tx=0x7fd788005a00 comp rx=0 tx=0).stop 2024-08-20T05:03:17.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.828+0000 7fd79b800640 1 -- 172.21.15.37:0/2455528149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd794108e40 msgr2=0x7fd79419e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:17.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.828+0000 7fd79b800640 1 --2- 172.21.15.37:0/2455528149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd794108e40 0x7fd79419e8d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00b990 tx=0x7fd78c00be50 comp rx=0 tx=0).stop 2024-08-20T05:03:17.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.828+0000 7fd79b800640 1 -- 172.21.15.37:0/2455528149 shutdown_connections 2024-08-20T05:03:17.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.828+0000 7fd79b800640 1 --2- 172.21.15.37:0/2455528149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd77c0b3bd0 0x7fd77c0b6090 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:17.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.828+0000 7fd79b800640 1 --2- 172.21.15.37:0/2455528149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd794108e40 0x7fd79419e8d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:17.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.828+0000 7fd79b800640 1 --2- 172.21.15.37:0/2455528149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7941084c0 0x7fd794199530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:17.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.828+0000 7fd79b800640 1 --2- 172.21.15.37:0/2455528149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd794102ab0 0x7fd794198ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:17.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.828+0000 7fd79b800640 1 -- 172.21.15.37:0/2455528149 >> 172.21.15.37:0/2455528149 conn(0x7fd7940fe500 msgr2=0x7fd7940fee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:17.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.828+0000 7fd79b800640 1 -- 172.21.15.37:0/2455528149 shutdown_connections 2024-08-20T05:03:17.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:17.829+0000 7fd79b800640 1 -- 172.21.15.37:0/2455528149 wait complete. 2024-08-20T05:03:18.044 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 20.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:03:18.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:17 smithi135 ceph-mon[22342]: pgmap v432: 129 pgs: 129 active+clean; 934 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 8.0 MiB/s wr, 665 op/s 2024-08-20T05:03:18.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:17 smithi130 ceph-mon[22007]: pgmap v432: 129 pgs: 129 active+clean; 934 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 8.0 MiB/s wr, 665 op/s 2024-08-20T05:03:18.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.461+0000 7f705b000640 1 -- 172.21.15.37:0/4000927326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70541039d0 msgr2=0x7f7054103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:18.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.461+0000 7f705b000640 1 --2- 172.21.15.37:0/4000927326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70541039d0 0x7f7054103db0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7044009900 tx=0x7f704402a410 comp rx=0 tx=0).stop 2024-08-20T05:03:18.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.461+0000 7f705b000640 1 -- 172.21.15.37:0/4000927326 shutdown_connections 2024-08-20T05:03:18.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.461+0000 7f705b000640 1 --2- 172.21.15.37:0/4000927326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f705410ce30 0x7f705410f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.461+0000 7f705b000640 1 --2- 172.21.15.37:0/4000927326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70541042f0 0x7f705410c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.461+0000 7f705b000640 1 --2- 172.21.15.37:0/4000927326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70541039d0 0x7f7054103db0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.461+0000 7f705b000640 1 -- 172.21.15.37:0/4000927326 >> 172.21.15.37:0/4000927326 conn(0x7f70540fd410 msgr2=0x7f70540ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:18.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.461+0000 7f705b000640 1 -- 172.21.15.37:0/4000927326 shutdown_connections 2024-08-20T05:03:18.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.461+0000 7f705b000640 1 -- 172.21.15.37:0/4000927326 wait complete. 2024-08-20T05:03:18.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.462+0000 7f705b000640 1 Processor -- start 2024-08-20T05:03:18.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.462+0000 7f705b000640 1 -- start start 2024-08-20T05:03:18.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.462+0000 7f705b000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70541039d0 0x7f705419b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.462+0000 7f705b000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70541042f0 0x7f705419b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.462+0000 7f705b000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f705410ce30 0x7f70541a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.462+0000 7f705b000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7054112af0 con 0x7f705410ce30 2024-08-20T05:03:18.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.462+0000 7f705b000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7054112970 con 0x7f70541042f0 2024-08-20T05:03:18.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.462+0000 7f705b000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7054112c70 con 0x7f70541039d0 2024-08-20T05:03:18.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.462+0000 7f7053e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70541039d0 0x7f705419b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.463+0000 7f7053e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70541039d0 0x7f705419b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41086/0 (socket says 172.21.15.37:41086) 2024-08-20T05:03:18.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.463+0000 7f7053e00640 1 -- 172.21.15.37:0/2472736345 learned_addr learned my addr 172.21.15.37:0/2472736345 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.463+0000 7f704b400640 1 --2- 172.21.15.37:0/2472736345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70541042f0 0x7f705419b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.463+0000 7f7059000640 1 --2- 172.21.15.37:0/2472736345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f705410ce30 0x7f70541a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.463+0000 7f7053e00640 1 -- 172.21.15.37:0/2472736345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70541042f0 msgr2=0x7f705419b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.463+0000 7f7053e00640 1 --2- 172.21.15.37:0/2472736345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70541042f0 0x7f705419b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.463+0000 7f7053e00640 1 -- 172.21.15.37:0/2472736345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f705410ce30 msgr2=0x7f70541a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.463+0000 7f7053e00640 1 --2- 172.21.15.37:0/2472736345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f705410ce30 0x7f70541a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.463+0000 7f7053e00640 1 -- 172.21.15.37:0/2472736345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70541a1290 con 0x7f70541039d0 2024-08-20T05:03:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.463+0000 7f7053e00640 1 --2- 172.21.15.37:0/2472736345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70541039d0 0x7f705419b1e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7044005ab0 tx=0x7f7044003c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:18.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.463+0000 7f7051600640 1 -- 172.21.15.37:0/2472736345 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704403f070 con 0x7f70541039d0 2024-08-20T05:03:18.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.463+0000 7f705b000640 1 -- 172.21.15.37:0/2472736345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70541a1520 con 0x7f70541039d0 2024-08-20T05:03:18.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.464+0000 7f7051600640 1 -- 172.21.15.37:0/2472736345 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7044031d60 con 0x7f70541039d0 2024-08-20T05:03:18.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.464+0000 7f7051600640 1 -- 172.21.15.37:0/2472736345 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7044035030 con 0x7f70541039d0 2024-08-20T05:03:18.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.464+0000 7f705b000640 1 -- 172.21.15.37:0/2472736345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70541a7c40 con 0x7f70541039d0 2024-08-20T05:03:18.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.467+0000 7f705dbcb740 1 Processor -- start 2024-08-20T05:03:18.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.467+0000 7f705dbcb740 1 -- start start 2024-08-20T05:03:18.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.467+0000 7f705dbcb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4949d0 0x55b1bf494db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.467+0000 7f705dbcb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4952f0 0x55b1bf4a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.467+0000 7f705dbcb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4a1280 0x55b1bf4a3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.467+0000 7f705dbcb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b1bf40b870 con 0x55b1bf4a1280 2024-08-20T05:03:18.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.467+0000 7f705dbcb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b1bf3fad70 con 0x55b1bf4949d0 2024-08-20T05:03:18.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.467+0000 7f705dbcb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b1bf3fedb0 con 0x55b1bf4952f0 2024-08-20T05:03:18.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.467+0000 7f7051600640 1 -- 172.21.15.37:0/2472736345 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7044042070 con 0x7f70541039d0 2024-08-20T05:03:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.468+0000 7f7059000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4949d0 0x55b1bf494db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.468+0000 7f7059000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4949d0 0x55b1bf494db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42586/0 (socket says 172.21.15.37:42586) 2024-08-20T05:03:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.468+0000 7f7059000640 1 -- 172.21.15.37:0/4212810025 learned_addr learned my addr 172.21.15.37:0/4212810025 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.468+0000 7f7053e00640 1 --2- 172.21.15.37:0/4212810025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4952f0 0x55b1bf4a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.468+0000 7f704b400640 1 --2- 172.21.15.37:0/4212810025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4a1280 0x55b1bf4a3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.468+0000 7f7059000640 1 -- 172.21.15.37:0/4212810025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4952f0 msgr2=0x55b1bf4a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.468+0000 7f7059000640 1 --2- 172.21.15.37:0/4212810025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4952f0 0x55b1bf4a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.468+0000 7f7059000640 1 -- 172.21.15.37:0/4212810025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4a1280 msgr2=0x55b1bf4a3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.468+0000 7f7059000640 1 --2- 172.21.15.37:0/4212810025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4a1280 0x55b1bf4a3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.468+0000 7f7059000640 1 -- 172.21.15.37:0/4212810025 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1bf15a930 con 0x55b1bf4949d0 2024-08-20T05:03:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.468+0000 7f704b400640 1 --2- 172.21.15.37:0/4212810025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4a1280 0x55b1bf4a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:03:18.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.468+0000 7f7059000640 1 --2- 172.21.15.37:0/4212810025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4949d0 0x55b1bf494db0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f704c009ee0 tx=0x7f704c010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=786cc59a7890f1ee server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:18.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.469+0000 7f7049600640 1 -- 172.21.15.37:0/4212810025 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c016070 con 0x55b1bf4949d0 2024-08-20T05:03:18.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.469+0000 7f7049600640 1 -- 172.21.15.37:0/4212810025 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f704c004d20 con 0x55b1bf4949d0 2024-08-20T05:03:18.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.469+0000 7f7049600640 1 -- 172.21.15.37:0/4212810025 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c0126b0 con 0x55b1bf4949d0 2024-08-20T05:03:18.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.469+0000 7f7051600640 1 --2- 172.21.15.37:0/2472736345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70380b3c50 0x7f70380b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.469+0000 7f705dbcb740 1 -- 172.21.15.37:0/4212810025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4949d0 msgr2=0x55b1bf494db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:18.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.469+0000 7f705dbcb740 1 --2- 172.21.15.37:0/4212810025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4949d0 0x55b1bf494db0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f704c009ee0 tx=0x7f704c010740 comp rx=0 tx=0).stop 2024-08-20T05:03:18.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.469+0000 7f7051600640 1 -- 172.21.15.37:0/2472736345 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f70441047a0 con 0x7f70541039d0 2024-08-20T05:03:18.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.470+0000 7f705dbcb740 1 -- 172.21.15.37:0/4212810025 shutdown_connections 2024-08-20T05:03:18.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.470+0000 7f705dbcb740 1 --2- 172.21.15.37:0/4212810025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4a1280 0x55b1bf4a3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.470+0000 7f705dbcb740 1 --2- 172.21.15.37:0/4212810025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4952f0 0x55b1bf4a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.470+0000 7f705dbcb740 1 --2- 172.21.15.37:0/4212810025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4949d0 0x55b1bf494db0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.470+0000 7f705dbcb740 1 -- 172.21.15.37:0/4212810025 >> 172.21.15.37:0/4212810025 conn(0x55b1bf492800 msgr2=0x55b1bf4939a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:18.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.470+0000 7f7053e00640 1 --2- 172.21.15.37:0/2472736345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70380b3c50 0x7f70380b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.470+0000 7f705dbcb740 1 -- 172.21.15.37:0/4212810025 shutdown_connections 2024-08-20T05:03:18.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.470+0000 7f705dbcb740 1 -- 172.21.15.37:0/4212810025 wait complete. 2024-08-20T05:03:18.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.470+0000 7f7053e00640 1 --2- 172.21.15.37:0/2472736345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70380b3c50 0x7f70380b6110 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7044101ea0 tx=0x7f704410a530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:18.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.470+0000 7f705dbcb740 1 -- start start 2024-08-20T05:03:18.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.471+0000 7f705dbcb740 1 Processor -- start 2024-08-20T05:03:18.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.471+0000 7f705dbcb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4949d0 0x55b1bf4a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.471+0000 7f705dbcb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4952f0 0x55b1bf49df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.471+0000 7f705dbcb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4a1280 0x55b1bf49e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.471+0000 7f705dbcb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b1bf25d890 con 0x55b1bf4a1280 2024-08-20T05:03:18.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.471+0000 7f705dbcb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b1bf381b00 con 0x55b1bf4952f0 2024-08-20T05:03:18.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.471+0000 7f705dbcb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b1bf4a3fd0 con 0x55b1bf4949d0 2024-08-20T05:03:18.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.471+0000 7f705dbcb740 10 client.0 _ll_register_callbacks cb 0x55b1bf3f5dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.471+0000 7f7059000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4949d0 0x55b1bf4a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.472+0000 7f7059000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4a1280 0x55b1bf49e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.472+0000 7f7059000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4949d0 0x55b1bf4a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41096/0 (socket says 172.21.15.37:41096) 2024-08-20T05:03:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.472+0000 7f7059000640 1 -- 172.21.15.37:0/2045502137 learned_addr learned my addr 172.21.15.37:0/2045502137 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.472+0000 7f704b400640 1 --2- 172.21.15.37:0/2045502137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4952f0 0x55b1bf49df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.472+0000 7f7059000640 1 -- 172.21.15.37:0/2045502137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4952f0 msgr2=0x55b1bf49df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.472+0000 7f7059000640 1 --2- 172.21.15.37:0/2045502137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4952f0 0x55b1bf49df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.472+0000 7f7059000640 1 -- 172.21.15.37:0/2045502137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4a1280 msgr2=0x55b1bf49e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.472+0000 7f7059000640 1 --2- 172.21.15.37:0/2045502137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4a1280 0x55b1bf49e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.472+0000 7f7059000640 1 -- 172.21.15.37:0/2045502137 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1bf3c2a30 con 0x55b1bf4949d0 2024-08-20T05:03:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.473+0000 7f7059000640 1 --2- 172.21.15.37:0/2045502137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4949d0 0x55b1bf4a0b10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f704c009c80 tx=0x7f704c005980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0946ace5d90fb73 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.473+0000 7f7042000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:03:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.473+0000 7f7042000640 1 -- 172.21.15.37:0/2045502137 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704c022040 con 0x55b1bf4949d0 2024-08-20T05:03:18.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.473+0000 7f705dbcb740 1 -- 172.21.15.37:0/2045502137 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f704c004d20 con 0x55b1bf4949d0 2024-08-20T05:03:18.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.473+0000 7f7042000640 1 -- 172.21.15.37:0/2045502137 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f704c012b20 con 0x55b1bf4949d0 2024-08-20T05:03:18.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.473+0000 7f7042000640 1 -- 172.21.15.37:0/2045502137 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f704c016040 con 0x55b1bf4949d0 2024-08-20T05:03:18.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.473+0000 7f705dbcb740 10 client.25801 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:18.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.473+0000 7f705dbcb740 1 -- 172.21.15.37:0/2045502137 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b1bf4af8d0 con 0x55b1bf4949d0 2024-08-20T05:03:18.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.473+0000 7f7042000640 1 -- 172.21.15.37:0/2045502137 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f704c004d20 con 0x55b1bf4949d0 2024-08-20T05:03:18.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.474+0000 7f7042000640 1 -- 172.21.15.37:0/2045502137 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f704c034070 con 0x55b1bf4949d0 2024-08-20T05:03:18.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.474+0000 7f705dbcb740 10 client.25801 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:18.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.474+0000 7f705dbcb740 10 client.25801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:03:18.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.474+0000 7f705dbcb740 20 client.25801 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:18.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.474+0000 7f705dbcb740 1 --2- 172.21.15.37:0/2045502137 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b1bf4b0c80 0x55b1bf4b3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.474+0000 7f705dbcb740 4 client.25801 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:03:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.474+0000 7f705dbcb740 1 -- 172.21.15.37:0/2045502137 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1bf40d7c0 con 0x55b1bf4b0c80 2024-08-20T05:03:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.474+0000 7f704b400640 1 --2- 172.21.15.37:0/2045502137 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b1bf4b0c80 0x55b1bf4b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.475+0000 7f7042000640 10 client.25801 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.475+0000 7f704b400640 1 --2- 172.21.15.37:0/2045502137 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b1bf4b0c80 0x55b1bf4b3070 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae8b438b37d46768 server_cookie=d900e940b1a31edf in_seq=0 out_seq=0 2024-08-20T05:03:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.476+0000 7f7042000640 1 -- 172.21.15.37:0/2045502137 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b1bf40d7c0 con 0x55b1bf4b0c80 2024-08-20T05:03:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.476+0000 7f7042000640 10 client.25801 handle_command_reply: tid=0 2024-08-20T05:03:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.476+0000 7f705dbcb740 1 client.25801 shutdown 2024-08-20T05:03:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.477+0000 7f705dbcb740 1 -- 172.21.15.37:0/2045502137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4949d0 msgr2=0x55b1bf4a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.477+0000 7f705dbcb740 1 --2- 172.21.15.37:0/2045502137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4949d0 0x55b1bf4a0b10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f704c009c80 tx=0x7f704c005980 comp rx=0 tx=0).stop 2024-08-20T05:03:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.477+0000 7f705dbcb740 1 -- 172.21.15.37:0/2045502137 shutdown_connections 2024-08-20T05:03:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.477+0000 7f705dbcb740 1 --2- 172.21.15.37:0/2045502137 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b1bf4b0c80 0x55b1bf4b3070 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.477+0000 7f705dbcb740 1 --2- 172.21.15.37:0/2045502137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4a1280 0x55b1bf49e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.477+0000 7f705dbcb740 1 --2- 172.21.15.37:0/2045502137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4952f0 0x55b1bf49df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.477+0000 7f705dbcb740 1 --2- 172.21.15.37:0/2045502137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4949d0 0x55b1bf4a0b10 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.477+0000 7f705dbcb740 1 -- 172.21.15.37:0/2045502137 >> 172.21.15.37:0/2045502137 conn(0x55b1bf492800 msgr2=0x55b1bf4983a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.477+0000 7f7042000640 0 client.25801 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.477+0000 7f705dbcb740 1 -- 172.21.15.37:0/2045502137 shutdown_connections 2024-08-20T05:03:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.477+0000 7f705dbcb740 1 -- 172.21.15.37:0/2045502137 wait complete. 2024-08-20T05:03:18.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.477+0000 7f705dbcb740 20 client.25801 trim_cache size 0 max 16384 2024-08-20T05:03:18.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.496+0000 7f705dbcb740 1 Processor -- start 2024-08-20T05:03:18.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.496+0000 7f705dbcb740 1 -- start start 2024-08-20T05:03:18.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.497+0000 7f705dbcb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4949d0 0x55b1bf499360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.497+0000 7f705dbcb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4952f0 0x55b1bf4ad120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.497+0000 7f705dbcb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4a1280 0x55b1bf49fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.497+0000 7f705dbcb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70541ad690 con 0x55b1bf4952f0 2024-08-20T05:03:18.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.497+0000 7f705dbcb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70541af290 con 0x55b1bf4a1280 2024-08-20T05:03:18.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.497+0000 7f705dbcb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70541add60 con 0x55b1bf4949d0 2024-08-20T05:03:18.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.497+0000 7f704b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4952f0 0x55b1bf4ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.497+0000 7f7059000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4949d0 0x55b1bf499360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.497+0000 7f704b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4952f0 0x55b1bf4ad120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50738/0 (socket says 172.21.15.37:50738) 2024-08-20T05:03:18.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.497+0000 7f704b400640 1 -- 172.21.15.37:0/2028156934 learned_addr learned my addr 172.21.15.37:0/2028156934 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:18.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.497+0000 7f7059000640 1 --2- 172.21.15.37:0/2028156934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4a1280 0x55b1bf49fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.497+0000 7f704b400640 1 -- 172.21.15.37:0/2028156934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4949d0 msgr2=0x55b1bf499360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:18.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.497+0000 7f704b400640 1 --2- 172.21.15.37:0/2028156934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4949d0 0x55b1bf499360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.497+0000 7f704b400640 1 -- 172.21.15.37:0/2028156934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4a1280 msgr2=0x55b1bf49fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:18.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.497+0000 7f704b400640 1 --2- 172.21.15.37:0/2028156934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4a1280 0x55b1bf49fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.497+0000 7f704b400640 1 -- 172.21.15.37:0/2028156934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1bf493ee0 con 0x55b1bf4952f0 2024-08-20T05:03:18.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.497+0000 7f7059000640 1 --2- 172.21.15.37:0/2028156934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4a1280 0x55b1bf49fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:03:18.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.498+0000 7f704b400640 1 --2- 172.21.15.37:0/2028156934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4952f0 0x55b1bf4ad120 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f703c005d00 tx=0x7f703c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b2af1a43438d21 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:18.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.498+0000 7f7048c00640 1 -- 172.21.15.37:0/2028156934 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703c004310 con 0x55b1bf4952f0 2024-08-20T05:03:18.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.498+0000 7f7048c00640 1 -- 172.21.15.37:0/2028156934 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f703c0044b0 con 0x55b1bf4952f0 2024-08-20T05:03:18.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.498+0000 7f7048c00640 1 -- 172.21.15.37:0/2028156934 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703c01e950 con 0x55b1bf4952f0 2024-08-20T05:03:18.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.499+0000 7f705dbcb740 1 -- 172.21.15.37:0/2028156934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4952f0 msgr2=0x55b1bf4ad120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.499+0000 7f705dbcb740 1 --2- 172.21.15.37:0/2028156934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4952f0 0x55b1bf4ad120 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f703c005d00 tx=0x7f703c005f90 comp rx=0 tx=0).stop 2024-08-20T05:03:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.499+0000 7f705dbcb740 1 -- 172.21.15.37:0/2028156934 shutdown_connections 2024-08-20T05:03:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.499+0000 7f705dbcb740 1 --2- 172.21.15.37:0/2028156934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4a1280 0x55b1bf49fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.499+0000 7f705dbcb740 1 --2- 172.21.15.37:0/2028156934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4952f0 0x55b1bf4ad120 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.499+0000 7f705dbcb740 1 --2- 172.21.15.37:0/2028156934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4949d0 0x55b1bf499360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.499+0000 7f705dbcb740 1 -- 172.21.15.37:0/2028156934 >> 172.21.15.37:0/2028156934 conn(0x55b1bf492800 msgr2=0x55b1bf49f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.499+0000 7f705dbcb740 1 -- 172.21.15.37:0/2028156934 shutdown_connections 2024-08-20T05:03:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.499+0000 7f705dbcb740 1 -- 172.21.15.37:0/2028156934 wait complete. 2024-08-20T05:03:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.500+0000 7f705dbcb740 1 -- start start 2024-08-20T05:03:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.500+0000 7f705dbcb740 1 Processor -- start 2024-08-20T05:03:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.500+0000 7f705dbcb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4949d0 0x55b1bf4a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.500+0000 7f705dbcb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4952f0 0x55b1bf4a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.500+0000 7f705dbcb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4a1280 0x55b1bf4a5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.500+0000 7f705dbcb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70541aeb00 con 0x55b1bf4952f0 2024-08-20T05:03:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.500+0000 7f705dbcb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70541ae430 con 0x55b1bf4a1280 2024-08-20T05:03:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.500+0000 7f705dbcb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70541ab6b0 con 0x55b1bf4949d0 2024-08-20T05:03:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.500+0000 7f705dbcb740 10 client.0 _ll_register_callbacks cb 0x7f704410a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.501+0000 7f704b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4952f0 0x55b1bf4a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.501+0000 7f704b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4952f0 0x55b1bf4a4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50748/0 (socket says 172.21.15.37:50748) 2024-08-20T05:03:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.501+0000 7f704b400640 1 -- 172.21.15.37:0/4091118724 learned_addr learned my addr 172.21.15.37:0/4091118724 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.501+0000 7f7059000640 1 --2- 172.21.15.37:0/4091118724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4949d0 0x55b1bf4a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.501+0000 7f7059000640 1 --2- 172.21.15.37:0/4091118724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4a1280 0x55b1bf4a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.501+0000 7f704b400640 1 -- 172.21.15.37:0/4091118724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4949d0 msgr2=0x55b1bf4a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.501+0000 7f704b400640 1 --2- 172.21.15.37:0/4091118724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4949d0 0x55b1bf4a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.501+0000 7f704b400640 1 -- 172.21.15.37:0/4091118724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4a1280 msgr2=0x55b1bf4a5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.501+0000 7f704b400640 1 --2- 172.21.15.37:0/4091118724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4a1280 0x55b1bf4a5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.501+0000 7f704b400640 1 -- 172.21.15.37:0/4091118724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1bf49e870 con 0x55b1bf4952f0 2024-08-20T05:03:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.501+0000 7f7059000640 1 --2- 172.21.15.37:0/4091118724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4a1280 0x55b1bf4a5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:03:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.501+0000 7f704b400640 1 --2- 172.21.15.37:0/4091118724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4952f0 0x55b1bf4a4e80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f703c009d10 tx=0x7f703c004110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b582c660635380c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.501+0000 7f7042000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:03:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.502+0000 7f7042000640 1 -- 172.21.15.37:0/4091118724 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703c004300 con 0x55b1bf4952f0 2024-08-20T05:03:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.502+0000 7f7042000640 1 -- 172.21.15.37:0/4091118724 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f703c005240 con 0x55b1bf4952f0 2024-08-20T05:03:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.502+0000 7f705dbcb740 1 -- 172.21.15.37:0/4091118724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f703c0044b0 con 0x55b1bf4952f0 2024-08-20T05:03:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.502+0000 7f7042000640 1 -- 172.21.15.37:0/4091118724 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f703c03c050 con 0x55b1bf4952f0 2024-08-20T05:03:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.502+0000 7f705dbcb740 10 client.15753 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.502+0000 7f705dbcb740 1 -- 172.21.15.37:0/4091118724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b1bf51b780 con 0x55b1bf4952f0 2024-08-20T05:03:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.502+0000 7f7042000640 1 -- 172.21.15.37:0/4091118724 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f703c0044b0 con 0x55b1bf4952f0 2024-08-20T05:03:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.503+0000 7f7042000640 1 -- 172.21.15.37:0/4091118724 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f703c026070 con 0x55b1bf4952f0 2024-08-20T05:03:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.503+0000 7f705dbcb740 10 client.15753 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.503+0000 7f705dbcb740 10 client.15753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:03:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.503+0000 7f705dbcb740 20 client.15753 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.503+0000 7f705dbcb740 1 --2- 172.21.15.37:0/4091118724 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b1bf51bf40 0x55b1bf51e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.503+0000 7f705dbcb740 4 client.15753 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T05:03:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.503+0000 7f705dbcb740 1 -- 172.21.15.37:0/4091118724 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b1bf409260 con 0x55b1bf51bf40 2024-08-20T05:03:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.503+0000 7f7059000640 1 --2- 172.21.15.37:0/4091118724 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b1bf51bf40 0x55b1bf51e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.504+0000 7f7059000640 1 --2- 172.21.15.37:0/4091118724 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b1bf51bf40 0x55b1bf51e360 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=152d46854a2d0a77 server_cookie=4b3a44ec901e45a0 in_seq=0 out_seq=0 2024-08-20T05:03:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.504+0000 7f7042000640 10 client.15753 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.504+0000 7f7042000640 1 -- 172.21.15.37:0/4091118724 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b1bf409260 con 0x55b1bf51bf40 2024-08-20T05:03:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.504+0000 7f7042000640 10 client.15753 handle_command_reply: tid=0 2024-08-20T05:03:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.504+0000 7f705dbcb740 1 client.15753 shutdown 2024-08-20T05:03:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.505+0000 7f705dbcb740 1 -- 172.21.15.37:0/4091118724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4952f0 msgr2=0x55b1bf4a4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.505+0000 7f705dbcb740 1 --2- 172.21.15.37:0/4091118724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4952f0 0x55b1bf4a4e80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f703c009d10 tx=0x7f703c004110 comp rx=0 tx=0).stop 2024-08-20T05:03:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.505+0000 7f705dbcb740 1 -- 172.21.15.37:0/4091118724 shutdown_connections 2024-08-20T05:03:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.505+0000 7f705dbcb740 1 --2- 172.21.15.37:0/4091118724 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b1bf51bf40 0x55b1bf51e360 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.505+0000 7f705dbcb740 1 --2- 172.21.15.37:0/4091118724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b1bf4a1280 0x55b1bf4a5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.505+0000 7f705dbcb740 1 --2- 172.21.15.37:0/4091118724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1bf4952f0 0x55b1bf4a4e80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.505+0000 7f705dbcb740 1 --2- 172.21.15.37:0/4091118724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b1bf4949d0 0x55b1bf4a99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.505+0000 7f705dbcb740 1 -- 172.21.15.37:0/4091118724 >> 172.21.15.37:0/4091118724 conn(0x55b1bf492800 msgr2=0x55b1bf4983a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:18.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.505+0000 7f7042000640 0 client.15753 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:18.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.505+0000 7f705dbcb740 1 -- 172.21.15.37:0/4091118724 shutdown_connections 2024-08-20T05:03:18.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.505+0000 7f705dbcb740 1 -- 172.21.15.37:0/4091118724 wait complete. 2024-08-20T05:03:18.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.505+0000 7f705dbcb740 20 client.15753 trim_cache size 0 max 16384 2024-08-20T05:03:18.510 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:03:18.510 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-20T05:03:18.511 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "efcfedd0-cd9b-4b28-9e0a-99da401b7f48", 2024-08-20T05:03:18.511 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-20T05:03:18.511 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:03:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.506+0000 7f705b000640 1 -- 172.21.15.37:0/2472736345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70380b3c50 msgr2=0x7f70380b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.506+0000 7f705b000640 1 --2- 172.21.15.37:0/2472736345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70380b3c50 0x7f70380b6110 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7044101ea0 tx=0x7f704410a530 comp rx=0 tx=0).stop 2024-08-20T05:03:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.506+0000 7f705b000640 1 -- 172.21.15.37:0/2472736345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70541039d0 msgr2=0x7f705419b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.506+0000 7f705b000640 1 --2- 172.21.15.37:0/2472736345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70541039d0 0x7f705419b1e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7044005ab0 tx=0x7f7044003c80 comp rx=0 tx=0).stop 2024-08-20T05:03:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.506+0000 7f705b000640 1 -- 172.21.15.37:0/2472736345 shutdown_connections 2024-08-20T05:03:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.506+0000 7f705b000640 1 --2- 172.21.15.37:0/2472736345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70380b3c50 0x7f70380b6110 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.506+0000 7f705b000640 1 --2- 172.21.15.37:0/2472736345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f705410ce30 0x7f70541a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.506+0000 7f705b000640 1 --2- 172.21.15.37:0/2472736345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70541042f0 0x7f705419b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.506+0000 7f705b000640 1 --2- 172.21.15.37:0/2472736345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70541039d0 0x7f705419b1e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.506+0000 7f705b000640 1 -- 172.21.15.37:0/2472736345 >> 172.21.15.37:0/2472736345 conn(0x7f70540fd410 msgr2=0x7f705410f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.506+0000 7f705b000640 1 -- 172.21.15.37:0/2472736345 shutdown_connections 2024-08-20T05:03:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:18.506+0000 7f705b000640 1 -- 172.21.15.37:0/2472736345 wait complete. 2024-08-20T05:03:18.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:18 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2455528149' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:03:18.999 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:18 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:03:19.000 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:18 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:19.038 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id 74fa0cc4 --release --await' 2024-08-20T05:03:19.038 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id 74fa0cc4 --release --await 2024-08-20T05:03:19.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:18 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2455528149' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:03:19.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:18 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:03:19.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:18 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:19.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:18 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2455528149' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:03:19.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:18 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:03:19.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:18 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:20.013 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:19 smithi037 ceph-mon[17265]: pgmap v433: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 7.8 MiB/s wr, 634 op/s 2024-08-20T05:03:20.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:19 smithi037 ceph-mon[17265]: scrub queued for path: / 2024-08-20T05:03:20.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:19 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:20.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:19 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:03:20.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:19 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:03:20.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:19 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:03:20.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:19 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:03:20.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:19 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:20.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:19 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:20.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:19 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:20.014 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:19 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:20.057 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:03:20.084 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:03:20.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:19 smithi135 ceph-mon[22342]: pgmap v433: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 7.8 MiB/s wr, 634 op/s 2024-08-20T05:03:20.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:19 smithi135 ceph-mon[22342]: scrub queued for path: / 2024-08-20T05:03:20.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:19 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:20.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:19 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:03:20.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:19 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:03:20.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:19 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:03:20.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:19 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:03:20.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:19 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:20.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:19 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:20.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:19 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:20.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:19 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:20.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:19 smithi130 ceph-mon[22007]: pgmap v433: 129 pgs: 129 active+clean; 935 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 7.8 MiB/s wr, 634 op/s 2024-08-20T05:03:20.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:19 smithi130 ceph-mon[22007]: scrub queued for path: / 2024-08-20T05:03:20.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:19 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:20.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:19 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:03:20.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:19 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:03:20.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:19 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:03:20.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:19 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:03:20.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:19 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:20.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:19 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:20.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:19 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:20.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:19 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:03:20.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.695+0000 7effdda00640 1 -- 172.21.15.37:0/1323488352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effd81039a0 msgr2=0x7effd8103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.695+0000 7effdda00640 1 --2- 172.21.15.37:0/1323488352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effd81039a0 0x7effd8103d80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7effc8009900 tx=0x7effc802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.695+0000 7effdda00640 1 -- 172.21.15.37:0/1323488352 shutdown_connections 2024-08-20T05:03:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.695+0000 7effdda00640 1 --2- 172.21.15.37:0/1323488352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effd810ce00 0x7effd810f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.695+0000 7effdda00640 1 --2- 172.21.15.37:0/1323488352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effd81042c0 0x7effd810c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.695+0000 7effdda00640 1 --2- 172.21.15.37:0/1323488352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effd81039a0 0x7effd8103d80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.695+0000 7effdda00640 1 -- 172.21.15.37:0/1323488352 >> 172.21.15.37:0/1323488352 conn(0x7effd80fd400 msgr2=0x7effd80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.695+0000 7effdda00640 1 -- 172.21.15.37:0/1323488352 shutdown_connections 2024-08-20T05:03:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.695+0000 7effdda00640 1 -- 172.21.15.37:0/1323488352 wait complete. 2024-08-20T05:03:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.696+0000 7effdda00640 1 Processor -- start 2024-08-20T05:03:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.696+0000 7effdda00640 1 -- start start 2024-08-20T05:03:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.697+0000 7effdda00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effd81039a0 0x7effd819b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.697+0000 7effdda00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effd81042c0 0x7effd819b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.697+0000 7effdda00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effd810ce00 0x7effd81a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.697+0000 7effdda00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7effd8112a70 con 0x7effd81039a0 2024-08-20T05:03:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.697+0000 7effdda00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7effd81128f0 con 0x7effd810ce00 2024-08-20T05:03:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.697+0000 7effdda00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7effd8112bf0 con 0x7effd81042c0 2024-08-20T05:03:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.697+0000 7effd6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effd81039a0 0x7effd819b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.697+0000 7effd7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effd810ce00 0x7effd81a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.697+0000 7effd6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effd81039a0 0x7effd819b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50762/0 (socket says 172.21.15.37:50762) 2024-08-20T05:03:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.697+0000 7effd6a00640 1 -- 172.21.15.37:0/3890090102 learned_addr learned my addr 172.21.15.37:0/3890090102 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.697+0000 7effd7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effd810ce00 0x7effd81a0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42610/0 (socket says 172.21.15.37:42610) 2024-08-20T05:03:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.697+0000 7effd6000640 1 --2- 172.21.15.37:0/3890090102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effd81042c0 0x7effd819b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.698+0000 7effd7400640 1 -- 172.21.15.37:0/3890090102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effd81042c0 msgr2=0x7effd819b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.698+0000 7effd7400640 1 --2- 172.21.15.37:0/3890090102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effd81042c0 0x7effd819b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.698+0000 7effd7400640 1 -- 172.21.15.37:0/3890090102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effd81039a0 msgr2=0x7effd819b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.698+0000 7effd7400640 1 --2- 172.21.15.37:0/3890090102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effd81039a0 0x7effd819b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.698+0000 7effd7400640 1 -- 172.21.15.37:0/3890090102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd81a1240 con 0x7effd810ce00 2024-08-20T05:03:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.698+0000 7effd7400640 1 --2- 172.21.15.37:0/3890090102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effd810ce00 0x7effd81a0a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7effd000e940 tx=0x7effd000ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:20.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.698+0000 7effcf400640 1 -- 172.21.15.37:0/3890090102 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd0004d20 con 0x7effd810ce00 2024-08-20T05:03:20.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.698+0000 7effdda00640 1 -- 172.21.15.37:0/3890090102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd81a1530 con 0x7effd810ce00 2024-08-20T05:03:20.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.699+0000 7effcf400640 1 -- 172.21.15.37:0/3890090102 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effd0005020 con 0x7effd810ce00 2024-08-20T05:03:20.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.699+0000 7effcf400640 1 -- 172.21.15.37:0/3890090102 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd00116d0 con 0x7effd810ce00 2024-08-20T05:03:20.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.699+0000 7effdda00640 1 -- 172.21.15.37:0/3890090102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd81a7bf0 con 0x7effd810ce00 2024-08-20T05:03:20.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.702+0000 7effcf400640 1 -- 172.21.15.37:0/3890090102 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7effd000cb20 con 0x7effd810ce00 2024-08-20T05:03:20.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.703+0000 7effe0601740 1 Processor -- start 2024-08-20T05:03:20.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.703+0000 7effe0601740 1 -- start start 2024-08-20T05:03:20.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.704+0000 7effe0601740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fd4cf0 0x560d21fd50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.704+0000 7effe0601740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 0x560d21fe1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.704+0000 7effe0601740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fe15a0 0x560d21fe3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.704+0000 7effe0601740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560d21f76670 con 0x560d21fe15a0 2024-08-20T05:03:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.704+0000 7effe0601740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560d21f4ad70 con 0x560d21fd4cf0 2024-08-20T05:03:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.704+0000 7effe0601740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560d21f3a270 con 0x560d21fd5610 2024-08-20T05:03:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.704+0000 7effcf400640 1 --2- 172.21.15.37:0/3890090102 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7effbc0b3bd0 0x7effbc0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.704+0000 7effd6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 0x560d21fe1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.704+0000 7effd6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 0x560d21fe1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41132/0 (socket says 172.21.15.37:41132) 2024-08-20T05:03:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.704+0000 7effd6a00640 1 -- 172.21.15.37:0/4198921636 learned_addr learned my addr 172.21.15.37:0/4198921636 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.704+0000 7effd6000640 1 --2- 172.21.15.37:0/4198921636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fd4cf0 0x560d21fd50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.704+0000 7effcf400640 1 -- 172.21.15.37:0/3890090102 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7effd00e3ef0 con 0x7effd810ce00 2024-08-20T05:03:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.705+0000 7effd6000640 1 --2- 172.21.15.37:0/4198921636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fe15a0 0x560d21fe3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.705+0000 7effd6a00640 1 -- 172.21.15.37:0/4198921636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fd4cf0 msgr2=0x560d21fd50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.705+0000 7effd6a00640 1 --2- 172.21.15.37:0/4198921636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fd4cf0 0x560d21fd50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.705+0000 7effd6a00640 1 -- 172.21.15.37:0/4198921636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fe15a0 msgr2=0x560d21fe3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.705+0000 7effd6a00640 1 --2- 172.21.15.37:0/4198921636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fe15a0 0x560d21fe3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.704+0000 7effd7400640 1 --2- 172.21.15.37:0/3890090102 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7effbc0b3bd0 0x7effbc0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.705+0000 7effd6a00640 1 -- 172.21.15.37:0/4198921636 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d21ed6870 con 0x560d21fd5610 2024-08-20T05:03:20.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.705+0000 7effd6a00640 1 --2- 172.21.15.37:0/4198921636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 0x560d21fe1060 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7effc8000c00 tx=0x7effc8031c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=771aae7b150122f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.706+0000 7effc3e00640 1 -- 172.21.15.37:0/4198921636 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8040070 con 0x560d21fd5610 2024-08-20T05:03:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.706+0000 7effc3e00640 1 -- 172.21.15.37:0/4198921636 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effc80316a0 con 0x560d21fd5610 2024-08-20T05:03:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.706+0000 7effd7400640 1 --2- 172.21.15.37:0/3890090102 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7effbc0b3bd0 0x7effbc0b6090 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7effd0004af0 tx=0x7effd0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.706+0000 7effc3e00640 1 -- 172.21.15.37:0/4198921636 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8035040 con 0x560d21fd5610 2024-08-20T05:03:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.707+0000 7effe0601740 1 -- 172.21.15.37:0/4198921636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 msgr2=0x560d21fe1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.707+0000 7effe0601740 1 --2- 172.21.15.37:0/4198921636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 0x560d21fe1060 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7effc8000c00 tx=0x7effc8031c40 comp rx=0 tx=0).stop 2024-08-20T05:03:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.707+0000 7effe0601740 1 -- 172.21.15.37:0/4198921636 shutdown_connections 2024-08-20T05:03:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.707+0000 7effe0601740 1 --2- 172.21.15.37:0/4198921636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fe15a0 0x560d21fe3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.707+0000 7effe0601740 1 --2- 172.21.15.37:0/4198921636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 0x560d21fe1060 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.707+0000 7effe0601740 1 --2- 172.21.15.37:0/4198921636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fd4cf0 0x560d21fd50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.707+0000 7effe0601740 1 -- 172.21.15.37:0/4198921636 >> 172.21.15.37:0/4198921636 conn(0x560d21fd2b20 msgr2=0x560d21fd3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.707+0000 7effe0601740 1 -- 172.21.15.37:0/4198921636 shutdown_connections 2024-08-20T05:03:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.707+0000 7effe0601740 1 -- 172.21.15.37:0/4198921636 wait complete. 2024-08-20T05:03:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.707+0000 7effe0601740 1 -- start start 2024-08-20T05:03:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.708+0000 7effe0601740 1 Processor -- start 2024-08-20T05:03:20.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.708+0000 7effe0601740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fd4cf0 0x560d21fe0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.708+0000 7effe0601740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 0x560d21fde0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.708+0000 7effe0601740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fe15a0 0x560d21fde630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.708+0000 7effe0601740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560d21ec0ff0 con 0x560d21fe15a0 2024-08-20T05:03:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.708+0000 7effe0601740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560d21f3e2b0 con 0x560d21fd4cf0 2024-08-20T05:03:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.708+0000 7effe0601740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560d21d9cbb0 con 0x560d21fd5610 2024-08-20T05:03:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.708+0000 7effe0601740 10 client.0 _ll_register_callbacks cb 0x560d21c45d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.708+0000 7effd6000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fd4cf0 0x560d21fe0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.708+0000 7effd6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fe15a0 0x560d21fde630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.709+0000 7effd6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fe15a0 0x560d21fde630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50782/0 (socket says 172.21.15.37:50782) 2024-08-20T05:03:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.709+0000 7effd6000640 1 -- 172.21.15.37:0/2855761305 learned_addr learned my addr 172.21.15.37:0/2855761305 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.709+0000 7effd6a00640 1 --2- 172.21.15.37:0/2855761305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 0x560d21fde0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.709+0000 7effd6000640 1 -- 172.21.15.37:0/2855761305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 msgr2=0x560d21fde0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.709+0000 7effd6000640 1 --2- 172.21.15.37:0/2855761305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 0x560d21fde0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.709+0000 7effd6000640 1 -- 172.21.15.37:0/2855761305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fd4cf0 msgr2=0x560d21fe0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.709+0000 7effd6000640 1 --2- 172.21.15.37:0/2855761305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fd4cf0 0x560d21fe0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.709+0000 7effd6000640 1 -- 172.21.15.37:0/2855761305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d21c99b00 con 0x560d21fe15a0 2024-08-20T05:03:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.709+0000 7effd6a00640 1 --2- 172.21.15.37:0/2855761305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 0x560d21fde0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.709+0000 7effd6000640 1 --2- 172.21.15.37:0/2855761305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fe15a0 0x560d21fde630 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7effc4005bc0 tx=0x7effc4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33711bf74002741c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.709+0000 7effc0c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:03:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.709+0000 7effc0c00640 1 -- 172.21.15.37:0/2855761305 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc4004230 con 0x560d21fe15a0 2024-08-20T05:03:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.710+0000 7effc0c00640 1 -- 172.21.15.37:0/2855761305 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7effc40043d0 con 0x560d21fe15a0 2024-08-20T05:03:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.710+0000 7effe0601740 1 -- 172.21.15.37:0/2855761305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effc80316a0 con 0x560d21fe15a0 2024-08-20T05:03:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.710+0000 7effc0c00640 1 -- 172.21.15.37:0/2855761305 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7effc402b050 con 0x560d21fe15a0 2024-08-20T05:03:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.710+0000 7effe0601740 10 client.15765 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:20.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.710+0000 7effe0601740 1 -- 172.21.15.37:0/2855761305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560d21d10960 con 0x560d21fe15a0 2024-08-20T05:03:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.710+0000 7effc0c00640 1 -- 172.21.15.37:0/2855761305 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effc80316a0 con 0x560d21fe15a0 2024-08-20T05:03:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.710+0000 7effc0c00640 1 -- 172.21.15.37:0/2855761305 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7effc4003b70 con 0x560d21fe15a0 2024-08-20T05:03:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.710+0000 7effe0601740 10 client.15765 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.710+0000 7effe0601740 10 client.15765 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:03:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.710+0000 7effe0601740 20 client.15765 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.711+0000 7effe0601740 1 --2- 172.21.15.37:0/2855761305 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560d21ff0c40 0x560d21ff30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.711+0000 7effe0601740 4 client.15765 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:03:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.711+0000 7effe0601740 1 -- 172.21.15.37:0/2855761305 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d21f4ccc0 con 0x560d21ff0c40 2024-08-20T05:03:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.711+0000 7effd6a00640 1 --2- 172.21.15.37:0/2855761305 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560d21ff0c40 0x560d21ff30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.712+0000 7effd6a00640 1 --2- 172.21.15.37:0/2855761305 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560d21ff0c40 0x560d21ff30c0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3074680a12e3e5e4 server_cookie=5a09d2bf8db04ccf in_seq=0 out_seq=0 2024-08-20T05:03:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.712+0000 7effc0c00640 10 client.15765 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.712+0000 7effc0c00640 1 -- 172.21.15.37:0/2855761305 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560d21f4ccc0 con 0x560d21ff0c40 2024-08-20T05:03:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.712+0000 7effc0c00640 10 client.15765 handle_command_reply: tid=0 2024-08-20T05:03:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.712+0000 7effe0601740 1 client.15765 shutdown 2024-08-20T05:03:20.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.713+0000 7effe0601740 1 -- 172.21.15.37:0/2855761305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fe15a0 msgr2=0x560d21fde630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.713+0000 7effe0601740 1 --2- 172.21.15.37:0/2855761305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fe15a0 0x560d21fde630 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7effc4005bc0 tx=0x7effc4005f90 comp rx=0 tx=0).stop 2024-08-20T05:03:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.713+0000 7effe0601740 1 -- 172.21.15.37:0/2855761305 shutdown_connections 2024-08-20T05:03:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.713+0000 7effe0601740 1 --2- 172.21.15.37:0/2855761305 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560d21ff0c40 0x560d21ff30c0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.713+0000 7effe0601740 1 --2- 172.21.15.37:0/2855761305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fe15a0 0x560d21fde630 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.713+0000 7effe0601740 1 --2- 172.21.15.37:0/2855761305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 0x560d21fde0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.713+0000 7effe0601740 1 --2- 172.21.15.37:0/2855761305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fd4cf0 0x560d21fe0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.713+0000 7effc0c00640 0 client.15765 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.713+0000 7effe0601740 1 -- 172.21.15.37:0/2855761305 >> 172.21.15.37:0/2855761305 conn(0x560d21fd2b20 msgr2=0x560d21fd8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.713+0000 7effe0601740 1 -- 172.21.15.37:0/2855761305 shutdown_connections 2024-08-20T05:03:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.713+0000 7effe0601740 1 -- 172.21.15.37:0/2855761305 wait complete. 2024-08-20T05:03:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.713+0000 7effe0601740 20 client.15765 trim_cache size 0 max 16384 2024-08-20T05:03:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.732+0000 7effe0601740 1 Processor -- start 2024-08-20T05:03:20.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.732+0000 7effe0601740 1 -- start start 2024-08-20T05:03:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.733+0000 7effe0601740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd4cf0 0x560d21fdfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.733+0000 7effe0601740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fd5610 0x560d21ff8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.733+0000 7effe0601740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fe15a0 0x560d21ff8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.733+0000 7effe0601740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7effb800fbd0 con 0x560d21fe15a0 2024-08-20T05:03:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.733+0000 7effe0601740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7effb80117d0 con 0x560d21fd5610 2024-08-20T05:03:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.733+0000 7effe0601740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7effb80102a0 con 0x560d21fd4cf0 2024-08-20T05:03:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.733+0000 7effd6000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd4cf0 0x560d21fdfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.733+0000 7effd6a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fd5610 0x560d21ff8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.733+0000 7effd6000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd4cf0 0x560d21fdfd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41160/0 (socket says 172.21.15.37:41160) 2024-08-20T05:03:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.733+0000 7effd6000640 1 -- 172.21.15.37:0/3146971748 learned_addr learned my addr 172.21.15.37:0/3146971748 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.733+0000 7effd6000640 1 --2- 172.21.15.37:0/3146971748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fe15a0 0x560d21ff8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.734+0000 7effd6a00640 1 -- 172.21.15.37:0/3146971748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd4cf0 msgr2=0x560d21fdfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.734+0000 7effd6a00640 1 --2- 172.21.15.37:0/3146971748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd4cf0 0x560d21fdfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.734+0000 7effd6a00640 1 -- 172.21.15.37:0/3146971748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fe15a0 msgr2=0x560d21ff8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.734+0000 7effd6a00640 1 --2- 172.21.15.37:0/3146971748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fe15a0 0x560d21ff8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.734+0000 7effd6a00640 1 -- 172.21.15.37:0/3146971748 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d21fd35a0 con 0x560d21fd5610 2024-08-20T05:03:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.734+0000 7effd6000640 1 --2- 172.21.15.37:0/3146971748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd4cf0 0x560d21fdfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:03:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.734+0000 7effd6a00640 1 --2- 172.21.15.37:0/3146971748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fd5610 0x560d21ff8990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7effc8031440 tx=0x7effc802a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a68b59fd7360f0d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.734+0000 7effc3400640 1 -- 172.21.15.37:0/3146971748 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8040040 con 0x560d21fd5610 2024-08-20T05:03:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.734+0000 7effc3400640 1 -- 172.21.15.37:0/3146971748 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effc8004050 con 0x560d21fd5610 2024-08-20T05:03:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.735+0000 7effc3400640 1 -- 172.21.15.37:0/3146971748 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8035040 con 0x560d21fd5610 2024-08-20T05:03:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.735+0000 7effe0601740 1 -- 172.21.15.37:0/3146971748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fd5610 msgr2=0x560d21ff8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.735+0000 7effe0601740 1 --2- 172.21.15.37:0/3146971748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fd5610 0x560d21ff8990 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7effc8031440 tx=0x7effc802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.735+0000 7effe0601740 1 -- 172.21.15.37:0/3146971748 shutdown_connections 2024-08-20T05:03:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.735+0000 7effe0601740 1 --2- 172.21.15.37:0/3146971748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fe15a0 0x560d21ff8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.735+0000 7effe0601740 1 --2- 172.21.15.37:0/3146971748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fd5610 0x560d21ff8990 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.735+0000 7effe0601740 1 --2- 172.21.15.37:0/3146971748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd4cf0 0x560d21fdfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.735+0000 7effe0601740 1 -- 172.21.15.37:0/3146971748 >> 172.21.15.37:0/3146971748 conn(0x560d21fd2b20 msgr2=0x560d21fd1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.736+0000 7effe0601740 1 -- 172.21.15.37:0/3146971748 shutdown_connections 2024-08-20T05:03:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.736+0000 7effe0601740 1 -- 172.21.15.37:0/3146971748 wait complete. 2024-08-20T05:03:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.736+0000 7effe0601740 1 -- start start 2024-08-20T05:03:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.736+0000 7effe0601740 1 Processor -- start 2024-08-20T05:03:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.737+0000 7effe0601740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fd4cf0 0x560d21fe99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.737+0000 7effe0601740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 0x560d21fe6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.738+0000 7effe0601740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fe15a0 0x560d21fe73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.738+0000 7effd6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 0x560d21fe6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.738+0000 7effe0601740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7effb8011040 con 0x560d21fd4cf0 2024-08-20T05:03:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.738+0000 7effd6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 0x560d21fe6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41166/0 (socket says 172.21.15.37:41166) 2024-08-20T05:03:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.738+0000 7effd6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fd4cf0 0x560d21fe99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.738+0000 7effe0601740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7effb8010970 con 0x560d21fe15a0 2024-08-20T05:03:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.738+0000 7effd6a00640 1 -- 172.21.15.37:0/541438785 learned_addr learned my addr 172.21.15.37:0/541438785 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.738+0000 7effe0601740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7effb800dbb0 con 0x560d21fd5610 2024-08-20T05:03:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.738+0000 7effe0601740 10 client.0 _ll_register_callbacks cb 0x7effc4009bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.738+0000 7effd6a00640 1 -- 172.21.15.37:0/541438785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fe15a0 msgr2=0x560d21fe73e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:03:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.738+0000 7effd6a00640 1 --2- 172.21.15.37:0/541438785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fe15a0 0x560d21fe73e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.738+0000 7effd6a00640 1 -- 172.21.15.37:0/541438785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fd4cf0 msgr2=0x560d21fe99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.739+0000 7effd6a00640 1 --2- 172.21.15.37:0/541438785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fd4cf0 0x560d21fe99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.739+0000 7effd6a00640 1 -- 172.21.15.37:0/541438785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d21fe7bc0 con 0x560d21fd5610 2024-08-20T05:03:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.739+0000 7effd6000640 1 --2- 172.21.15.37:0/541438785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fd4cf0 0x560d21fe99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.739+0000 7effd6a00640 1 --2- 172.21.15.37:0/541438785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 0x560d21fe6ea0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7effc80096c0 tx=0x7effc8031820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33882ce71457e7ee server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.739+0000 7effc0c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:03:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.742+0000 7effc0c00640 1 -- 172.21.15.37:0/541438785 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc805d060 con 0x560d21fd5610 2024-08-20T05:03:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.742+0000 7effc0c00640 1 -- 172.21.15.37:0/541438785 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7effc8005200 con 0x560d21fd5610 2024-08-20T05:03:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.742+0000 7effe0601740 1 -- 172.21.15.37:0/541438785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7effc8004050 con 0x560d21fd5610 2024-08-20T05:03:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.742+0000 7effc0c00640 1 -- 172.21.15.37:0/541438785 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7effc8064050 con 0x560d21fd5610 2024-08-20T05:03:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.742+0000 7effe0601740 10 client.25825 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.742+0000 7effe0601740 1 -- 172.21.15.37:0/541438785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560d2205b9a0 con 0x560d21fd5610 2024-08-20T05:03:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.743+0000 7effc0c00640 1 -- 172.21.15.37:0/541438785 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effc8004050 con 0x560d21fd5610 2024-08-20T05:03:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.743+0000 7effc0c00640 1 -- 172.21.15.37:0/541438785 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7effc80035f0 con 0x560d21fd5610 2024-08-20T05:03:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.743+0000 7effe0601740 10 client.25825 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.743+0000 7effe0601740 10 client.25825 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:03:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.743+0000 7effe0601740 20 client.25825 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.743+0000 7effe0601740 1 --2- 172.21.15.37:0/541438785 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560d2205bcd0 0x560d2205e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.743+0000 7effe0601740 4 client.25825 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "74fa0cc4", "release": true, "await": true}] 2024-08-20T05:03:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.743+0000 7effe0601740 1 -- 172.21.15.37:0/541438785 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "set_id": "74fa0cc4", "release": true, "await": true}) -- 0x560d21f48760 con 0x560d2205bcd0 2024-08-20T05:03:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.743+0000 7effd6000640 1 --2- 172.21.15.37:0/541438785 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560d2205bcd0 0x560d2205e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.744+0000 7effd6000640 1 --2- 172.21.15.37:0/541438785 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560d2205bcd0 0x560d2205e0e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=276c08392d703736 server_cookie=6848b9b55c0f0088 in_seq=0 out_seq=0 2024-08-20T05:03:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.744+0000 7effc0c00640 10 client.25825 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:03:20.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.772+0000 7effc0c00640 1 -- 172.21.15.37:0/541438785 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x560d21f48760 con 0x560d2205bcd0 2024-08-20T05:03:20.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.772+0000 7effc0c00640 10 client.25825 handle_command_reply: tid=0 2024-08-20T05:03:20.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.773+0000 7effe0601740 1 client.25825 shutdown 2024-08-20T05:03:20.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.774+0000 7effe0601740 1 -- 172.21.15.37:0/541438785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 msgr2=0x560d21fe6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:20.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.774+0000 7effe0601740 1 --2- 172.21.15.37:0/541438785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 0x560d21fe6ea0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7effc80096c0 tx=0x7effc8031820 comp rx=0 tx=0).stop 2024-08-20T05:03:20.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.774+0000 7effe0601740 1 -- 172.21.15.37:0/541438785 shutdown_connections 2024-08-20T05:03:20.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.774+0000 7effe0601740 1 --2- 172.21.15.37:0/541438785 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560d2205bcd0 0x560d2205e0e0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.774+0000 7effe0601740 1 --2- 172.21.15.37:0/541438785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d21fe15a0 0x560d21fe73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.774+0000 7effe0601740 1 --2- 172.21.15.37:0/541438785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d21fd5610 0x560d21fe6ea0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.774+0000 7effe0601740 1 --2- 172.21.15.37:0/541438785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d21fd4cf0 0x560d21fe99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.774+0000 7effe0601740 1 -- 172.21.15.37:0/541438785 >> 172.21.15.37:0/541438785 conn(0x560d21fd2b20 msgr2=0x560d21fdc840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:20.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.775+0000 7effc0c00640 0 client.25825 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:20.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.775+0000 7effe0601740 1 -- 172.21.15.37:0/541438785 shutdown_connections 2024-08-20T05:03:20.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.775+0000 7effe0601740 1 -- 172.21.15.37:0/541438785 wait complete. 2024-08-20T05:03:20.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.776+0000 7effe0601740 20 client.25825 trim_cache size 0 max 16384 2024-08-20T05:03:20.780 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:03:20.781 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-08-20T05:03:20.781 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:03:20.781 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 4, 2024-08-20T05:03:20.781 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:03:20.781 INFO:teuthology.orchestra.run.smithi037.stdout: "74fa0cc4": { 2024-08-20T05:03:20.781 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 4, 2024-08-20T05:03:20.781 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:03:20.781 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:03:20.781 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:03:20.781 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:03:20.781 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:03:20.781 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:03:20.781 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 130.0, 2024-08-20T05:03:20.782 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:03:20.782 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:03:20.782 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:03:20.782 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:03:20.782 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:03:20.782 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:03:20.782 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:20.782 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:20.782 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:20.782 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:20.782 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:20.782 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:03:20.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.778+0000 7effdda00640 1 -- 172.21.15.37:0/3890090102 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7effbc0b3bd0 msgr2=0x7effbc0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:20.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.778+0000 7effdda00640 1 --2- 172.21.15.37:0/3890090102 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7effbc0b3bd0 0x7effbc0b6090 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7effd0004af0 tx=0x7effd0004a40 comp rx=0 tx=0).stop 2024-08-20T05:03:20.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.778+0000 7effdda00640 1 -- 172.21.15.37:0/3890090102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effd810ce00 msgr2=0x7effd81a0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:20.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.778+0000 7effdda00640 1 --2- 172.21.15.37:0/3890090102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effd810ce00 0x7effd81a0a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7effd000e940 tx=0x7effd000ee00 comp rx=0 tx=0).stop 2024-08-20T05:03:20.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.778+0000 7effdda00640 1 -- 172.21.15.37:0/3890090102 shutdown_connections 2024-08-20T05:03:20.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.778+0000 7effdda00640 1 --2- 172.21.15.37:0/3890090102 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7effbc0b3bd0 0x7effbc0b6090 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.778+0000 7effdda00640 1 --2- 172.21.15.37:0/3890090102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effd810ce00 0x7effd81a0a70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.778+0000 7effdda00640 1 --2- 172.21.15.37:0/3890090102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effd81042c0 0x7effd819b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.778+0000 7effdda00640 1 --2- 172.21.15.37:0/3890090102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effd81039a0 0x7effd819b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:20.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.778+0000 7effdda00640 1 -- 172.21.15.37:0/3890090102 >> 172.21.15.37:0/3890090102 conn(0x7effd80fd400 msgr2=0x7effd80fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:20.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.778+0000 7effdda00640 1 -- 172.21.15.37:0/3890090102 shutdown_connections 2024-08-20T05:03:20.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:20.778+0000 7effdda00640 1 -- 172.21.15.37:0/3890090102 wait complete. 2024-08-20T05:03:22.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:21 smithi037 ceph-mon[17265]: pgmap v434: 129 pgs: 129 active+clean; 947 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 7.9 MiB/s wr, 589 op/s 2024-08-20T05:03:22.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:21 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:03:22.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.051+0000 7f7166000640 1 -- 172.21.15.37:0/1616039543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f716010a260 msgr2=0x7f716010a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:22.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.051+0000 7f7166000640 1 --2- 172.21.15.37:0/1616039543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f716010a260 0x7f716010a6a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f714c009900 tx=0x7f714c02a400 comp rx=0 tx=0).stop 2024-08-20T05:03:22.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.051+0000 7f7166000640 1 -- 172.21.15.37:0/1616039543 shutdown_connections 2024-08-20T05:03:22.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.051+0000 7f7166000640 1 --2- 172.21.15.37:0/1616039543 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f716011bdd0 0x7f716011e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.051+0000 7f7166000640 1 --2- 172.21.15.37:0/1616039543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f716010a260 0x7f716010a6a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.051+0000 7f7166000640 1 --2- 172.21.15.37:0/1616039543 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7160109e80 0x7f7160110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.052+0000 7f7166000640 1 -- 172.21.15.37:0/1616039543 >> 172.21.15.37:0/1616039543 conn(0x7f716006c830 msgr2=0x7f716006cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:22.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.052+0000 7f7166000640 1 -- 172.21.15.37:0/1616039543 shutdown_connections 2024-08-20T05:03:22.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.052+0000 7f7166000640 1 -- 172.21.15.37:0/1616039543 wait complete. 2024-08-20T05:03:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.053+0000 7f7166000640 1 Processor -- start 2024-08-20T05:03:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.053+0000 7f7166000640 1 -- start start 2024-08-20T05:03:22.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.054+0000 7f7166000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7160109e80 0x7f71601a7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.054+0000 7f7166000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f716010a260 0x7f71601a80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.054+0000 7f7166000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716011bdd0 0x7f71601ad490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.054+0000 7f7164c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7160109e80 0x7f71601a7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.055+0000 7f7164c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7160109e80 0x7f71601a7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50820/0 (socket says 172.21.15.37:50820) 2024-08-20T05:03:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.055+0000 7f715fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f716010a260 0x7f71601a80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.055+0000 7f7165600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716011bdd0 0x7f71601ad490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.055+0000 7f715fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f716010a260 0x7f71601a80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42650/0 (socket says 172.21.15.37:42650) 2024-08-20T05:03:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.055+0000 7f7165600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716011bdd0 0x7f71601ad490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41192/0 (socket says 172.21.15.37:41192) 2024-08-20T05:03:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.055+0000 7f7164c00640 1 -- 172.21.15.37:0/503261562 learned_addr learned my addr 172.21.15.37:0/503261562 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.055+0000 7f7166000640 1 -- 172.21.15.37:0/503261562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7160121720 con 0x7f7160109e80 2024-08-20T05:03:22.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.055+0000 7f7166000640 1 -- 172.21.15.37:0/503261562 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f71601215a0 con 0x7f716010a260 2024-08-20T05:03:22.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.055+0000 7f7166000640 1 -- 172.21.15.37:0/503261562 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f71601218a0 con 0x7f716011bdd0 2024-08-20T05:03:22.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.056+0000 7f715fe00640 1 -- 172.21.15.37:0/503261562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716011bdd0 msgr2=0x7f71601ad490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:22.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.056+0000 7f715fe00640 1 --2- 172.21.15.37:0/503261562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716011bdd0 0x7f71601ad490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.056+0000 7f715fe00640 1 -- 172.21.15.37:0/503261562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7160109e80 msgr2=0x7f71601a7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:22.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.056+0000 7f715fe00640 1 --2- 172.21.15.37:0/503261562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7160109e80 0x7f71601a7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.056+0000 7f715fe00640 1 -- 172.21.15.37:0/503261562 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71601adc60 con 0x7f716010a260 2024-08-20T05:03:22.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.056+0000 7f7165600640 1 --2- 172.21.15.37:0/503261562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716011bdd0 0x7f71601ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:22.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.057+0000 7f715fe00640 1 --2- 172.21.15.37:0/503261562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f716010a260 0x7f71601a80f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f714c006010 tx=0x7f714c0040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:22.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.058+0000 7f715d600640 1 -- 172.21.15.37:0/503261562 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c03f030 con 0x7f716010a260 2024-08-20T05:03:22.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.058+0000 7f715d600640 1 -- 172.21.15.37:0/503261562 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f714c0044c0 con 0x7f716010a260 2024-08-20T05:03:22.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.058+0000 7f715d600640 1 -- 172.21.15.37:0/503261562 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c035070 con 0x7f716010a260 2024-08-20T05:03:22.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.059+0000 7f7166000640 1 -- 172.21.15.37:0/503261562 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71601adef0 con 0x7f716010a260 2024-08-20T05:03:22.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.059+0000 7f7166000640 1 -- 172.21.15.37:0/503261562 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71601b4610 con 0x7f716010a260 2024-08-20T05:03:22.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.068+0000 7f716a219740 1 Processor -- start 2024-08-20T05:03:22.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.070+0000 7f715d600640 1 -- 172.21.15.37:0/503261562 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f714c042030 con 0x7f716010a260 2024-08-20T05:03:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.071+0000 7f716a219740 1 -- start start 2024-08-20T05:03:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.072+0000 7f716a219740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 0x5627b0ccae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.072+0000 7f716a219740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 0x5627b0cd6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.072+0000 7f716a219740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0cd7330 0x5627b0cd9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.073+0000 7f7165600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 0x5627b0ccae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.073+0000 7f7164c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 0x5627b0cd6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.073+0000 7f7164c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 0x5627b0cd6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42660/0 (socket says 172.21.15.37:42660) 2024-08-20T05:03:22.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.073+0000 7f7165600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 0x5627b0ccae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41196/0 (socket says 172.21.15.37:41196) 2024-08-20T05:03:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.076+0000 7f7164c00640 1 -- 172.21.15.37:0/862684930 learned_addr learned my addr 172.21.15.37:0/862684930 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.076+0000 7f716a219740 1 -- 172.21.15.37:0/862684930 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5627b0c40a60 con 0x5627b0cd7330 2024-08-20T05:03:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.076+0000 7f716a219740 1 -- 172.21.15.37:0/862684930 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5627b0c2ff60 con 0x5627b0ccb3a0 2024-08-20T05:03:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.076+0000 7f716a219740 1 -- 172.21.15.37:0/862684930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5627b0c33fa0 con 0x5627b0ccaa80 2024-08-20T05:03:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.077+0000 7f7165600640 1 -- 172.21.15.37:0/862684930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 msgr2=0x5627b0cd6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.077+0000 7f7165600640 1 --2- 172.21.15.37:0/862684930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 0x5627b0cd6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.077+0000 7f7165600640 1 -- 172.21.15.37:0/862684930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0cd7330 msgr2=0x5627b0cd9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.077+0000 7f7165600640 1 --2- 172.21.15.37:0/862684930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0cd7330 0x5627b0cd9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.077+0000 7f7165600640 1 -- 172.21.15.37:0/862684930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b0bd63e0 con 0x5627b0ccaa80 2024-08-20T05:03:22.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.077+0000 7f7165600640 1 --2- 172.21.15.37:0/862684930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 0x5627b0ccae60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7158010690 tx=0x7f7158010b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7312cd39e275bf0c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:22.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.078+0000 7f7151c00640 1 -- 172.21.15.37:0/862684930 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7158004b20 con 0x5627b0ccaa80 2024-08-20T05:03:22.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.078+0000 7f7151c00640 1 -- 172.21.15.37:0/862684930 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f715800ed80 con 0x5627b0ccaa80 2024-08-20T05:03:22.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.078+0000 7f7151c00640 1 -- 172.21.15.37:0/862684930 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7158005780 con 0x5627b0ccaa80 2024-08-20T05:03:22.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.079+0000 7f716a219740 1 -- 172.21.15.37:0/862684930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 msgr2=0x5627b0ccae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:22.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.079+0000 7f716a219740 1 --2- 172.21.15.37:0/862684930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 0x5627b0ccae60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7158010690 tx=0x7f7158010b50 comp rx=0 tx=0).stop 2024-08-20T05:03:22.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.081+0000 7f715d600640 1 --2- 172.21.15.37:0/503261562 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71480b3dc0 0x7f71480b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.081+0000 7f715d600640 1 -- 172.21.15.37:0/503261562 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f714c103e70 con 0x7f716010a260 2024-08-20T05:03:22.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.082+0000 7f716a219740 1 -- 172.21.15.37:0/862684930 shutdown_connections 2024-08-20T05:03:22.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.082+0000 7f716a219740 1 --2- 172.21.15.37:0/862684930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0cd7330 0x5627b0cd9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.082+0000 7f716a219740 1 --2- 172.21.15.37:0/862684930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 0x5627b0cd6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.082+0000 7f716a219740 1 --2- 172.21.15.37:0/862684930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 0x5627b0ccae60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.082+0000 7f716a219740 1 -- 172.21.15.37:0/862684930 >> 172.21.15.37:0/862684930 conn(0x5627b0cc88b0 msgr2=0x5627b0cc9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:22.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.083+0000 7f7165600640 1 --2- 172.21.15.37:0/503261562 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71480b3dc0 0x7f71480b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:22.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.083+0000 7f716a219740 1 -- 172.21.15.37:0/862684930 shutdown_connections 2024-08-20T05:03:22.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.083+0000 7f716a219740 1 -- 172.21.15.37:0/862684930 wait complete. 2024-08-20T05:03:22.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.084+0000 7f716a219740 1 -- start start 2024-08-20T05:03:22.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.084+0000 7f716a219740 1 Processor -- start 2024-08-20T05:03:22.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.085+0000 7f7165600640 1 --2- 172.21.15.37:0/503261562 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71480b3dc0 0x7f71480b6280 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f71580053e0 tx=0x7f7158005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:22.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.088+0000 7f716a219740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 0x5627b0cd6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.089+0000 7f716a219740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 0x5627b0cd4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.089+0000 7f716a219740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0cd7330 0x5627b0cd45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.090+0000 7f716a219740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5627b0a92700 con 0x5627b0cd7330 2024-08-20T05:03:22.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.090+0000 7f716a219740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5627b0bcb250 con 0x5627b0ccb3a0 2024-08-20T05:03:22.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.090+0000 7f7164c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 0x5627b0cd6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:22.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.090+0000 7f716a219740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5627b0cd9fb0 con 0x5627b0ccaa80 2024-08-20T05:03:22.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.090+0000 7f7165600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0cd7330 0x5627b0cd45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:22.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.091+0000 7f7165600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0cd7330 0x5627b0cd45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50846/0 (socket says 172.21.15.37:50846) 2024-08-20T05:03:22.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.091+0000 7f7165600640 1 -- 172.21.15.37:0/113324809 learned_addr learned my addr 172.21.15.37:0/113324809 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:22.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.091+0000 7f715fe00640 1 --2- 172.21.15.37:0/113324809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 0x5627b0cd4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:22.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.092+0000 7f716a219740 10 client.0 _ll_register_callbacks cb 0x5627b0c2a180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:22.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.093+0000 7f7165600640 1 -- 172.21.15.37:0/113324809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 msgr2=0x5627b0cd6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:22.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.093+0000 7f7165600640 1 --2- 172.21.15.37:0/113324809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 0x5627b0cd6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.093+0000 7f7165600640 1 -- 172.21.15.37:0/113324809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 msgr2=0x5627b0cd4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:22.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.093+0000 7f7165600640 1 --2- 172.21.15.37:0/113324809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 0x5627b0cd4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.093+0000 7f7165600640 1 -- 172.21.15.37:0/113324809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627b098f650 con 0x5627b0cd7330 2024-08-20T05:03:22.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.093+0000 7f715fe00640 1 --2- 172.21.15.37:0/113324809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 0x5627b0cd4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:03:22.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.094+0000 7f7165600640 1 --2- 172.21.15.37:0/113324809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0cd7330 0x5627b0cd45e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f715800ed50 tx=0x7f7158010b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dad9bf50afe25f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:22.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.094+0000 7f7146000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:03:22.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.095+0000 7f7146000640 1 -- 172.21.15.37:0/113324809 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71580059d0 con 0x5627b0cd7330 2024-08-20T05:03:22.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.095+0000 7f716a219740 1 -- 172.21.15.37:0/113324809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f715800ed80 con 0x5627b0cd7330 2024-08-20T05:03:22.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.096+0000 7f7146000640 1 -- 172.21.15.37:0/113324809 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7158013460 con 0x5627b0cd7330 2024-08-20T05:03:22.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.097+0000 7f7146000640 1 -- 172.21.15.37:0/113324809 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7158013660 con 0x5627b0cd7330 2024-08-20T05:03:22.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.101+0000 7f716a219740 10 client.15780 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:22.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.101+0000 7f716a219740 1 -- 172.21.15.37:0/113324809 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5627b0ce58b0 con 0x5627b0cd7330 2024-08-20T05:03:22.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.102+0000 7f7146000640 1 -- 172.21.15.37:0/113324809 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f715800ed80 con 0x5627b0cd7330 2024-08-20T05:03:22.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.105+0000 7f7146000640 1 -- 172.21.15.37:0/113324809 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f7158032070 con 0x5627b0cd7330 2024-08-20T05:03:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.106+0000 7f716a219740 10 client.15780 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.106+0000 7f716a219740 10 client.15780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:03:22.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.106+0000 7f716a219740 20 client.15780 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.106+0000 7f716a219740 1 --2- 172.21.15.37:0/113324809 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5627b0ce6c60 0x5627b0ce90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.106+0000 7f716a219740 4 client.15780 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:03:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.106+0000 7f716a219740 1 -- 172.21.15.37:0/113324809 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627b0c429b0 con 0x5627b0ce6c60 2024-08-20T05:03:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.106+0000 7f7164c00640 1 --2- 172.21.15.37:0/113324809 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5627b0ce6c60 0x5627b0ce90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.107+0000 7f7164c00640 1 --2- 172.21.15.37:0/113324809 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5627b0ce6c60 0x5627b0ce90b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db543bbe00eef063 server_cookie=e365669a9ed4738c in_seq=0 out_seq=0 2024-08-20T05:03:22.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.107+0000 7f7146000640 10 client.15780 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.108+0000 7f7146000640 1 -- 172.21.15.37:0/113324809 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5627b0c429b0 con 0x5627b0ce6c60 2024-08-20T05:03:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.108+0000 7f7146000640 10 client.15780 handle_command_reply: tid=0 2024-08-20T05:03:22.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.108+0000 7f716a219740 1 client.15780 shutdown 2024-08-20T05:03:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.109+0000 7f716a219740 1 -- 172.21.15.37:0/113324809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0cd7330 msgr2=0x5627b0cd45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.109+0000 7f716a219740 1 --2- 172.21.15.37:0/113324809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0cd7330 0x5627b0cd45e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f715800ed50 tx=0x7f7158010b50 comp rx=0 tx=0).stop 2024-08-20T05:03:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.109+0000 7f716a219740 1 -- 172.21.15.37:0/113324809 shutdown_connections 2024-08-20T05:03:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.109+0000 7f716a219740 1 --2- 172.21.15.37:0/113324809 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5627b0ce6c60 0x5627b0ce90b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.109+0000 7f716a219740 1 --2- 172.21.15.37:0/113324809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0cd7330 0x5627b0cd45e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.109+0000 7f716a219740 1 --2- 172.21.15.37:0/113324809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 0x5627b0cd4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.109+0000 7f716a219740 1 --2- 172.21.15.37:0/113324809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 0x5627b0cd6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.109+0000 7f716a219740 1 -- 172.21.15.37:0/113324809 >> 172.21.15.37:0/113324809 conn(0x5627b0cc88b0 msgr2=0x5627b0cce420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.109+0000 7f7146000640 0 client.15780 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:22.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.109+0000 7f716a219740 1 -- 172.21.15.37:0/113324809 shutdown_connections 2024-08-20T05:03:22.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.109+0000 7f716a219740 1 -- 172.21.15.37:0/113324809 wait complete. 2024-08-20T05:03:22.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.111+0000 7f716a219740 20 client.15780 trim_cache size 0 max 16384 2024-08-20T05:03:22.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:21 smithi135 ceph-mon[22342]: pgmap v434: 129 pgs: 129 active+clean; 947 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 7.9 MiB/s wr, 589 op/s 2024-08-20T05:03:22.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:21 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:03:22.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.147+0000 7f716a219740 1 Processor -- start 2024-08-20T05:03:22.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.147+0000 7f716a219740 1 -- start start 2024-08-20T05:03:22.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.148+0000 7f716a219740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 0x5627b0cee980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.148+0000 7f716a219740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 0x5627b0ceeec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.148+0000 7f716a219740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0cd7330 0x5627b0cd1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.148+0000 7f716a219740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f71601be3d0 con 0x5627b0cd7330 2024-08-20T05:03:22.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.148+0000 7f716a219740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f71601bffd0 con 0x5627b0ccb3a0 2024-08-20T05:03:22.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.148+0000 7f716a219740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f71601beaa0 con 0x5627b0ccaa80 2024-08-20T05:03:22.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.149+0000 7f7164c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 0x5627b0cee980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:22.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.149+0000 7f7164c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 0x5627b0cee980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41210/0 (socket says 172.21.15.37:41210) 2024-08-20T05:03:22.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.149+0000 7f715fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 0x5627b0ceeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:22.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.149+0000 7f715fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 0x5627b0ceeec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42690/0 (socket says 172.21.15.37:42690) 2024-08-20T05:03:22.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.149+0000 7f715fe00640 1 -- 172.21.15.37:0/2756303152 learned_addr learned my addr 172.21.15.37:0/2756303152 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:22.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.150+0000 7f7165600640 1 --2- 172.21.15.37:0/2756303152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0cd7330 0x5627b0cd1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:22.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.150+0000 7f7164c00640 1 -- 172.21.15.37:0/2756303152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 msgr2=0x5627b0ceeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:22.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.150+0000 7f7164c00640 1 --2- 172.21.15.37:0/2756303152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 0x5627b0ceeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.151+0000 7f7164c00640 1 -- 172.21.15.37:0/2756303152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0cd7330 msgr2=0x5627b0cd1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:22.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.151+0000 7f7164c00640 1 --2- 172.21.15.37:0/2756303152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0cd7330 0x5627b0cd1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.151+0000 7f7164c00640 1 -- 172.21.15.37:0/2756303152 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627b0cc9330 con 0x5627b0ccaa80 2024-08-20T05:03:22.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.154+0000 7f7164c00640 1 --2- 172.21.15.37:0/2756303152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 0x5627b0cee980 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x5627b0a92850 tx=0x7f715400b480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f4aea3e218675ca server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:22.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.154+0000 7f7151200640 1 -- 172.21.15.37:0/2756303152 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154003d60 con 0x5627b0ccaa80 2024-08-20T05:03:22.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.154+0000 7f7151200640 1 -- 172.21.15.37:0/2756303152 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71540118f0 con 0x5627b0ccaa80 2024-08-20T05:03:22.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.154+0000 7f7151200640 1 -- 172.21.15.37:0/2756303152 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715401d880 con 0x5627b0ccaa80 2024-08-20T05:03:22.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.155+0000 7f716a219740 1 -- 172.21.15.37:0/2756303152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 msgr2=0x5627b0cee980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:22.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.155+0000 7f716a219740 1 --2- 172.21.15.37:0/2756303152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 0x5627b0cee980 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x5627b0a92850 tx=0x7f715400b480 comp rx=0 tx=0).stop 2024-08-20T05:03:22.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.156+0000 7f716a219740 1 -- 172.21.15.37:0/2756303152 shutdown_connections 2024-08-20T05:03:22.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.156+0000 7f716a219740 1 --2- 172.21.15.37:0/2756303152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0cd7330 0x5627b0cd1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.156+0000 7f716a219740 1 --2- 172.21.15.37:0/2756303152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccb3a0 0x5627b0ceeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.156+0000 7f716a219740 1 --2- 172.21.15.37:0/2756303152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0ccaa80 0x5627b0cee980 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.156+0000 7f716a219740 1 -- 172.21.15.37:0/2756303152 >> 172.21.15.37:0/2756303152 conn(0x5627b0cc88b0 msgr2=0x5627b0cc7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:22.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.156+0000 7f716a219740 1 -- 172.21.15.37:0/2756303152 shutdown_connections 2024-08-20T05:03:22.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.156+0000 7f716a219740 1 -- 172.21.15.37:0/2756303152 wait complete. 2024-08-20T05:03:22.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.156+0000 7f716a219740 1 -- start start 2024-08-20T05:03:22.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.157+0000 7f716a219740 1 Processor -- start 2024-08-20T05:03:22.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.157+0000 7f716a219740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccaa80 0x5627b0cdf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.158+0000 7f716a219740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0ccb3a0 0x5627b0cdced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.158+0000 7f716a219740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0cd7330 0x5627b0cdd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.158+0000 7f716a219740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f71601bf840 con 0x5627b0ccb3a0 2024-08-20T05:03:22.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.158+0000 7f716a219740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f71601bf170 con 0x5627b0ccaa80 2024-08-20T05:03:22.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.158+0000 7f716a219740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f71601bc3b0 con 0x5627b0cd7330 2024-08-20T05:03:22.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.158+0000 7f7164c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccaa80 0x5627b0cdf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:22.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.158+0000 7f7164c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccaa80 0x5627b0cdf9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42694/0 (socket says 172.21.15.37:42694) 2024-08-20T05:03:22.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.158+0000 7f7164c00640 1 -- 172.21.15.37:0/3555526689 learned_addr learned my addr 172.21.15.37:0/3555526689 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:22.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.158+0000 7f7165600640 1 --2- 172.21.15.37:0/3555526689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0cd7330 0x5627b0cdd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:22.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.159+0000 7f716a219740 10 client.0 _ll_register_callbacks cb 0x7f7158016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:22.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.159+0000 7f7165600640 1 -- 172.21.15.37:0/3555526689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccaa80 msgr2=0x5627b0cdf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:22.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.161+0000 7f7165600640 1 --2- 172.21.15.37:0/3555526689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccaa80 0x5627b0cdf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.161+0000 7f7165600640 1 -- 172.21.15.37:0/3555526689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0ccb3a0 msgr2=0x5627b0cdced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:22.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.159+0000 7f715fe00640 1 --2- 172.21.15.37:0/3555526689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0ccb3a0 0x5627b0cdced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:22.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.162+0000 7f7165600640 1 --2- 172.21.15.37:0/3555526689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0ccb3a0 0x5627b0cdced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.162+0000 7f7165600640 1 -- 172.21.15.37:0/3555526689 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627b0cddd10 con 0x5627b0cd7330 2024-08-20T05:03:22.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.162+0000 7f7164c00640 1 --2- 172.21.15.37:0/3555526689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccaa80 0x5627b0cdf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:22.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.162+0000 7f715fe00640 1 --2- 172.21.15.37:0/3555526689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0ccb3a0 0x5627b0cdced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:03:22.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.162+0000 7f7165600640 1 --2- 172.21.15.37:0/3555526689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0cd7330 0x5627b0cdd4e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f715800f010 tx=0x7f71580346d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6035c081510d5338 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:22.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.163+0000 7f7146000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:03:22.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.163+0000 7f7146000640 1 -- 172.21.15.37:0/3555526689 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715800ed80 con 0x5627b0cd7330 2024-08-20T05:03:22.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.163+0000 7f7146000640 1 -- 172.21.15.37:0/3555526689 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f71580059d0 con 0x5627b0cd7330 2024-08-20T05:03:22.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.163+0000 7f716a219740 1 -- 172.21.15.37:0/3555526689 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71540118f0 con 0x5627b0cd7330 2024-08-20T05:03:22.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.164+0000 7f7146000640 1 -- 172.21.15.37:0/3555526689 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7158048050 con 0x5627b0cd7330 2024-08-20T05:03:22.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.164+0000 7f716a219740 10 client.25843 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:22.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.164+0000 7f716a219740 1 -- 172.21.15.37:0/3555526689 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5627b0d51a60 con 0x5627b0cd7330 2024-08-20T05:03:22.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.164+0000 7f7146000640 1 -- 172.21.15.37:0/3555526689 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71540118f0 con 0x5627b0cd7330 2024-08-20T05:03:22.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.165+0000 7f7146000640 1 -- 172.21.15.37:0/3555526689 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f7158032040 con 0x5627b0cd7330 2024-08-20T05:03:22.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.165+0000 7f716a219740 10 client.25843 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:22.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.165+0000 7f716a219740 10 client.25843 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:03:22.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.165+0000 7f716a219740 20 client.25843 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:22.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.165+0000 7f716a219740 1 --2- 172.21.15.37:0/3555526689 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5627b0d52170 0x5627b0d54590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:22.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.165+0000 7f716a219740 4 client.25843 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:03:22.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.165+0000 7f716a219740 1 -- 172.21.15.37:0/3555526689 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5627b0c3e450 con 0x5627b0d52170 2024-08-20T05:03:22.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.166+0000 7f7164c00640 1 --2- 172.21.15.37:0/3555526689 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5627b0d52170 0x5627b0d54590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:22.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.167+0000 7f7164c00640 1 --2- 172.21.15.37:0/3555526689 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5627b0d52170 0x5627b0d54590 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b59db89a351d412 server_cookie=13a0ae9865cad75e in_seq=0 out_seq=0 2024-08-20T05:03:22.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.167+0000 7f7146000640 10 client.25843 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:22.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.167+0000 7f7146000640 1 -- 172.21.15.37:0/3555526689 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5627b0c3e450 con 0x5627b0d52170 2024-08-20T05:03:22.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.167+0000 7f7146000640 10 client.25843 handle_command_reply: tid=0 2024-08-20T05:03:22.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.167+0000 7f716a219740 1 client.25843 shutdown 2024-08-20T05:03:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.169+0000 7f716a219740 1 -- 172.21.15.37:0/3555526689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0cd7330 msgr2=0x5627b0cdd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.169+0000 7f716a219740 1 --2- 172.21.15.37:0/3555526689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0cd7330 0x5627b0cdd4e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f715800f010 tx=0x7f71580346d0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.169+0000 7f716a219740 1 -- 172.21.15.37:0/3555526689 shutdown_connections 2024-08-20T05:03:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.169+0000 7f716a219740 1 --2- 172.21.15.37:0/3555526689 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5627b0d52170 0x5627b0d54590 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.169+0000 7f716a219740 1 --2- 172.21.15.37:0/3555526689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5627b0cd7330 0x5627b0cdd4e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.169+0000 7f716a219740 1 --2- 172.21.15.37:0/3555526689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627b0ccb3a0 0x5627b0cdced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.169+0000 7f716a219740 1 --2- 172.21.15.37:0/3555526689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5627b0ccaa80 0x5627b0cdf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.169+0000 7f716a219740 1 -- 172.21.15.37:0/3555526689 >> 172.21.15.37:0/3555526689 conn(0x5627b0cc88b0 msgr2=0x5627b0cd28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:22.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.169+0000 7f7146000640 0 client.25843 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:22.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.170+0000 7f716a219740 1 -- 172.21.15.37:0/3555526689 shutdown_connections 2024-08-20T05:03:22.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.170+0000 7f716a219740 1 -- 172.21.15.37:0/3555526689 wait complete. 2024-08-20T05:03:22.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.170+0000 7f716a219740 20 client.25843 trim_cache size 0 max 16384 2024-08-20T05:03:22.174 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:03:22.175 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T05:03:22.175 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-20T05:03:22.175 INFO:teuthology.orchestra.run.smithi037.stdout: "efcfedd0-cd9b-4b28-9e0a-99da401b7f48": { 2024-08-20T05:03:22.175 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-20T05:03:22.175 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "efcfedd0-cd9b-4b28-9e0a-99da401b7f48", 2024-08-20T05:03:22.175 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-20T05:03:22.175 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:22.175 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:22.175 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:03:22.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.173+0000 7f7166000640 1 -- 172.21.15.37:0/503261562 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71480b3dc0 msgr2=0x7f71480b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:22.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.173+0000 7f7166000640 1 --2- 172.21.15.37:0/503261562 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71480b3dc0 0x7f71480b6280 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f71580053e0 tx=0x7f7158005bd0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.173+0000 7f7166000640 1 -- 172.21.15.37:0/503261562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f716010a260 msgr2=0x7f71601a80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:22.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.173+0000 7f7166000640 1 --2- 172.21.15.37:0/503261562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f716010a260 0x7f71601a80f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f714c006010 tx=0x7f714c0040c0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.173+0000 7f7166000640 1 -- 172.21.15.37:0/503261562 shutdown_connections 2024-08-20T05:03:22.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.173+0000 7f7166000640 1 --2- 172.21.15.37:0/503261562 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71480b3dc0 0x7f71480b6280 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.173+0000 7f7166000640 1 --2- 172.21.15.37:0/503261562 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f716011bdd0 0x7f71601ad490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.173+0000 7f7166000640 1 --2- 172.21.15.37:0/503261562 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f716010a260 0x7f71601a80f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.173+0000 7f7166000640 1 --2- 172.21.15.37:0/503261562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7160109e80 0x7f71601a7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:22.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.173+0000 7f7166000640 1 -- 172.21.15.37:0/503261562 >> 172.21.15.37:0/503261562 conn(0x7f716006c830 msgr2=0x7f716011c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:22.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.173+0000 7f7166000640 1 -- 172.21.15.37:0/503261562 shutdown_connections 2024-08-20T05:03:22.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:22.173+0000 7f7166000640 1 -- 172.21.15.37:0/503261562 wait complete. 2024-08-20T05:03:22.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:21 smithi130 ceph-mon[22007]: pgmap v434: 129 pgs: 129 active+clean; 947 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 7.9 MiB/s wr, 589 op/s 2024-08-20T05:03:22.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:21 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:03:22.238 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '74fa0cc4', total seconds elapsed: 18.6 2024-08-20T05:03:22.977 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:03:22.977 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:03:22.978 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:03:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 25.0 s, 749.6 tps, lat 277.256 ms stddev 1329.569 2024-08-20T05:03:23.042 INFO:tasks.cephfs.filesystem:scrub status for tag:efcfedd0-cd9b-4b28-9e0a-99da401b7f48 - {'path': '/', 'tag': 'efcfedd0-cd9b-4b28-9e0a-99da401b7f48', 'options': 'recursive,force'} 2024-08-20T05:03:23.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:03:23.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:03:23.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:03:23.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:03:23.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:03:23.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:03:24.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:23 smithi135 ceph-mon[22342]: pgmap v435: 129 pgs: 129 active+clean; 955 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 7.9 MiB/s wr, 476 op/s 2024-08-20T05:03:24.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:23 smithi130 ceph-mon[22007]: pgmap v435: 129 pgs: 129 active+clean; 955 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 7.9 MiB/s wr, 476 op/s 2024-08-20T05:03:24.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:23 smithi037 ceph-mon[17265]: pgmap v435: 129 pgs: 129 active+clean; 955 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 7.9 MiB/s wr, 476 op/s 2024-08-20T05:03:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.905+0000 7f1c1aa00640 1 -- 172.21.15.37:0/3183174812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c14076cc0 msgr2=0x7f1c14075310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.905+0000 7f1c1aa00640 1 --2- 172.21.15.37:0/3183174812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c14076cc0 0x7f1c14075310 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009900 tx=0x7f1bfc02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.905+0000 7f1c1aa00640 1 -- 172.21.15.37:0/3183174812 shutdown_connections 2024-08-20T05:03:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.905+0000 7f1c1aa00640 1 --2- 172.21.15.37:0/3183174812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c1410a5a0 0x7f1c1410ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.905+0000 7f1c1aa00640 1 --2- 172.21.15.37:0/3183174812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c14075850 0x7f1c14075cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.905+0000 7f1c1aa00640 1 --2- 172.21.15.37:0/3183174812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c14076cc0 0x7f1c14075310 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.905+0000 7f1c1aa00640 1 -- 172.21.15.37:0/3183174812 >> 172.21.15.37:0/3183174812 conn(0x7f1c140fdf40 msgr2=0x7f1c14100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.905+0000 7f1c1aa00640 1 -- 172.21.15.37:0/3183174812 shutdown_connections 2024-08-20T05:03:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.905+0000 7f1c1aa00640 1 -- 172.21.15.37:0/3183174812 wait complete. 2024-08-20T05:03:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.906+0000 7f1c1aa00640 1 Processor -- start 2024-08-20T05:03:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.907+0000 7f1c1aa00640 1 -- start start 2024-08-20T05:03:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.908+0000 7f1c1aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c14075850 0x7f1c1419f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.908+0000 7f1c1aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c14076cc0 0x7f1c1419f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.908+0000 7f1c13e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c14075850 0x7f1c1419f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.908+0000 7f1c13400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c14076cc0 0x7f1c1419f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.908+0000 7f1c13e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c14075850 0x7f1c1419f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53002/0 (socket says 172.21.15.37:53002) 2024-08-20T05:03:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.908+0000 7f1c13400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c14076cc0 0x7f1c1419f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41704/0 (socket says 172.21.15.37:41704) 2024-08-20T05:03:25.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.908+0000 7f1c1aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c1410a5a0 0x7f1c141a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.909+0000 7f1c1aa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1c14110540 con 0x7f1c1410a5a0 2024-08-20T05:03:25.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.909+0000 7f1c1aa00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1c141103c0 con 0x7f1c14075850 2024-08-20T05:03:25.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.909+0000 7f1c1aa00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c141106c0 con 0x7f1c14076cc0 2024-08-20T05:03:25.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.909+0000 7f1c13e00640 1 -- 172.21.15.37:0/242055299 learned_addr learned my addr 172.21.15.37:0/242055299 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:25.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.909+0000 7f1c18a00640 1 --2- 172.21.15.37:0/242055299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c1410a5a0 0x7f1c141a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:25.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.909+0000 7f1c13400640 1 -- 172.21.15.37:0/242055299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c14075850 msgr2=0x7f1c1419f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.909+0000 7f1c13400640 1 --2- 172.21.15.37:0/242055299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c14075850 0x7f1c1419f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.909+0000 7f1c13400640 1 -- 172.21.15.37:0/242055299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c1410a5a0 msgr2=0x7f1c141a02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.909+0000 7f1c13400640 1 --2- 172.21.15.37:0/242055299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c1410a5a0 0x7f1c141a02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.909+0000 7f1c13400640 1 -- 172.21.15.37:0/242055299 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c141a0ba0 con 0x7f1c14076cc0 2024-08-20T05:03:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.910+0000 7f1c13400640 1 --2- 172.21.15.37:0/242055299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c14076cc0 0x7f1c1419f6b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400e9f0 tx=0x7f1c0400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:25.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.911+0000 7f1c10c00640 1 -- 172.21.15.37:0/242055299 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0400cd80 con 0x7f1c14076cc0 2024-08-20T05:03:25.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.911+0000 7f1c10c00640 1 -- 172.21.15.37:0/242055299 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c040035f0 con 0x7f1c14076cc0 2024-08-20T05:03:25.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.911+0000 7f1c10c00640 1 -- 172.21.15.37:0/242055299 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c04010670 con 0x7f1c14076cc0 2024-08-20T05:03:25.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.911+0000 7f1c1aa00640 1 -- 172.21.15.37:0/242055299 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c141a0e90 con 0x7f1c14076cc0 2024-08-20T05:03:25.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.911+0000 7f1c1aa00640 1 -- 172.21.15.37:0/242055299 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c141a7560 con 0x7f1c14076cc0 2024-08-20T05:03:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.916+0000 7f1c1d8bd740 1 Processor -- start 2024-08-20T05:03:25.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.916+0000 7f1c1d8bd740 1 -- start start 2024-08-20T05:03:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.917+0000 7f1c1d8bd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 0x55b28a4eea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.917+0000 7f1c1d8bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 0x55b28a4f1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.917+0000 7f1c1d8bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4f1980 0x55b28a4f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.917+0000 7f1c1d8bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b28a45f210 con 0x55b28a4f1980 2024-08-20T05:03:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.917+0000 7f1c1d8bd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b28a44e710 con 0x55b28a4ec610 2024-08-20T05:03:25.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.917+0000 7f1c1d8bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b28a452750 con 0x55b28a4eef40 2024-08-20T05:03:25.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.917+0000 7f1c18a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 0x55b28a4eea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:25.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.918+0000 7f1c18a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 0x55b28a4eea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53018/0 (socket says 172.21.15.37:53018) 2024-08-20T05:03:25.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.918+0000 7f1c18a00640 1 -- 172.21.15.37:0/2068779280 learned_addr learned my addr 172.21.15.37:0/2068779280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:25.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.918+0000 7f1c13e00640 1 --2- 172.21.15.37:0/2068779280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 0x55b28a4f1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:25.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.918+0000 7f1c13e00640 1 -- 172.21.15.37:0/2068779280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 msgr2=0x55b28a4eea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:25.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.918+0000 7f1c13e00640 1 --2- 172.21.15.37:0/2068779280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 0x55b28a4eea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.918+0000 7f1c13e00640 1 -- 172.21.15.37:0/2068779280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4f1980 msgr2=0x55b28a4f3e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:03:25.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.918+0000 7f1c13e00640 1 --2- 172.21.15.37:0/2068779280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4f1980 0x55b28a4f3e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.918+0000 7f1c13e00640 1 -- 172.21.15.37:0/2068779280 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b28a41ade0 con 0x55b28a4eef40 2024-08-20T05:03:25.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.919+0000 7f1c13e00640 1 --2- 172.21.15.37:0/2068779280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 0x55b28a4f1330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc005ab0 tx=0x7f1bfc0040d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d09dd97013e890da server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:25.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.919+0000 7f1c09200640 1 -- 172.21.15.37:0/2068779280 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc035030 con 0x55b28a4eef40 2024-08-20T05:03:25.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.919+0000 7f1c09200640 1 -- 172.21.15.37:0/2068779280 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bfc0044c0 con 0x55b28a4eef40 2024-08-20T05:03:25.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.919+0000 7f1c09200640 1 -- 172.21.15.37:0/2068779280 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc003850 con 0x55b28a4eef40 2024-08-20T05:03:25.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.919+0000 7f1c10c00640 1 -- 172.21.15.37:0/242055299 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1c040037a0 con 0x7f1c14076cc0 2024-08-20T05:03:25.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.920+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/2068779280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 msgr2=0x55b28a4f1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:25.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.921+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/2068779280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 0x55b28a4f1330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc005ab0 tx=0x7f1bfc0040d0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.921+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/2068779280 shutdown_connections 2024-08-20T05:03:25.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.921+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/2068779280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4f1980 0x55b28a4f3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.921+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/2068779280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 0x55b28a4f1330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.922+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/2068779280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 0x55b28a4eea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.922+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/2068779280 >> 172.21.15.37:0/2068779280 conn(0x55b28a4e7760 msgr2=0x55b28a4e84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:25.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.923+0000 7f1c10c00640 1 --2- 172.21.15.37:0/242055299 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1bf80b3de0 0x7f1bf80b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.923+0000 7f1c10c00640 1 -- 172.21.15.37:0/242055299 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1c040e45e0 con 0x7f1c14076cc0 2024-08-20T05:03:25.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.924+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/2068779280 shutdown_connections 2024-08-20T05:03:25.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.924+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/2068779280 wait complete. 2024-08-20T05:03:25.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.925+0000 7f1c13e00640 1 --2- 172.21.15.37:0/242055299 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1bf80b3de0 0x7f1bf80b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:25.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.925+0000 7f1c1d8bd740 1 -- start start 2024-08-20T05:03:25.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.925+0000 7f1c1d8bd740 1 Processor -- start 2024-08-20T05:03:25.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.926+0000 7f1c1d8bd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 0x55b28a506cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.927+0000 7f1c1d8bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4eef40 0x55b28a507360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.927+0000 7f1c13e00640 1 --2- 172.21.15.37:0/242055299 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1bf80b3de0 0x7f1bf80b62a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0096c0 tx=0x7f1bfc02a3f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.927+0000 7f1c1d8bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4f1980 0x55b28a507f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.927+0000 7f1c1d8bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b28a387ab0 con 0x55b28a4eef40 2024-08-20T05:03:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.927+0000 7f1c1d8bd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b28a3f5140 con 0x55b28a4ec610 2024-08-20T05:03:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.927+0000 7f1c1d8bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b28a505910 con 0x55b28a4f1980 2024-08-20T05:03:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.927+0000 7f1c1d8bd740 10 client.0 _ll_register_callbacks cb 0x55b28a4085d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.927+0000 7f1c18a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4f1980 0x55b28a507f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.927+0000 7f1c18a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4f1980 0x55b28a507f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41720/0 (socket says 172.21.15.37:41720) 2024-08-20T05:03:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.927+0000 7f1c18a00640 1 -- 172.21.15.37:0/4039796701 learned_addr learned my addr 172.21.15.37:0/4039796701 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.927+0000 7f1c13400640 1 --2- 172.21.15.37:0/4039796701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4eef40 0x55b28a507360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.928+0000 7f1c13e00640 1 --2- 172.21.15.37:0/4039796701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 0x55b28a506cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.928+0000 7f1c18a00640 1 -- 172.21.15.37:0/4039796701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 msgr2=0x55b28a506cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.928+0000 7f1c18a00640 1 --2- 172.21.15.37:0/4039796701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 0x55b28a506cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.928+0000 7f1c18a00640 1 -- 172.21.15.37:0/4039796701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4eef40 msgr2=0x55b28a507360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:25.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.928+0000 7f1c18a00640 1 --2- 172.21.15.37:0/4039796701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4eef40 0x55b28a507360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.928+0000 7f1c18a00640 1 -- 172.21.15.37:0/4039796701 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b28a3f6170 con 0x55b28a4f1980 2024-08-20T05:03:25.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.928+0000 7f1c13400640 1 --2- 172.21.15.37:0/4039796701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4eef40 0x55b28a507360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:03:25.933 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.928+0000 7f1c13e00640 1 --2- 172.21.15.37:0/4039796701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 0x55b28a506cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:03:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.929+0000 7f1c18a00640 1 --2- 172.21.15.37:0/4039796701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4f1980 0x55b28a507f30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c012a30 tx=0x7f1c0c012ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=317ed4f635a4272d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.929+0000 7f1c01600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:03:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.930+0000 7f1c01600640 1 -- 172.21.15.37:0/4039796701 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c01c3f0 con 0x55b28a4f1980 2024-08-20T05:03:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.930+0000 7f1c01600640 1 -- 172.21.15.37:0/4039796701 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1c0c01c590 con 0x55b28a4f1980 2024-08-20T05:03:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.930+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/4039796701 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b28a461160 con 0x55b28a4f1980 2024-08-20T05:03:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.930+0000 7f1c01600640 1 -- 172.21.15.37:0/4039796701 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1c0c01c7d0 con 0x55b28a4f1980 2024-08-20T05:03:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.930+0000 7f1c1d8bd740 10 client.25855 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.930+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/4039796701 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b28a1b1790 con 0x55b28a4f1980 2024-08-20T05:03:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.930+0000 7f1c01600640 1 -- 172.21.15.37:0/4039796701 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b28a461160 con 0x55b28a4f1980 2024-08-20T05:03:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.932+0000 7f1c01600640 1 -- 172.21.15.37:0/4039796701 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f1c0c00f040 con 0x55b28a4f1980 2024-08-20T05:03:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.932+0000 7f1c1d8bd740 10 client.25855 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.932+0000 7f1c1d8bd740 10 client.25855 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:03:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.932+0000 7f1c1d8bd740 20 client.25855 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.932+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/4039796701 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b28a512ab0 0x55b28a514f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.932+0000 7f1c1d8bd740 4 client.25855 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:03:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.932+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/4039796701 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b28a45cc00 con 0x55b28a512ab0 2024-08-20T05:03:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.932+0000 7f1c13e00640 1 --2- 172.21.15.37:0/4039796701 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b28a512ab0 0x55b28a514f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.933+0000 7f1c13e00640 1 --2- 172.21.15.37:0/4039796701 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b28a512ab0 0x55b28a514f20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=942caea3b24acaf1 server_cookie=d6b678d7f098e32b in_seq=0 out_seq=0 2024-08-20T05:03:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.933+0000 7f1c01600640 10 client.25855 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.934+0000 7f1c01600640 1 -- 172.21.15.37:0/4039796701 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b28a45cc00 con 0x55b28a512ab0 2024-08-20T05:03:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.934+0000 7f1c01600640 10 client.25855 handle_command_reply: tid=0 2024-08-20T05:03:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.934+0000 7f1c1d8bd740 1 client.25855 shutdown 2024-08-20T05:03:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.935+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/4039796701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4f1980 msgr2=0x55b28a507f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.935+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/4039796701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4f1980 0x55b28a507f30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c012a30 tx=0x7f1c0c012ef0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.935+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/4039796701 shutdown_connections 2024-08-20T05:03:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.935+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/4039796701 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b28a512ab0 0x55b28a514f20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.935+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/4039796701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4f1980 0x55b28a507f30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.935+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/4039796701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4eef40 0x55b28a507360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.935+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/4039796701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 0x55b28a506cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.935+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/4039796701 >> 172.21.15.37:0/4039796701 conn(0x55b28a4e7760 msgr2=0x55b28a4e6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:25.942 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.935+0000 7f1c01600640 0 client.25855 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:25.943 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.935+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/4039796701 shutdown_connections 2024-08-20T05:03:25.943 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.936+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/4039796701 wait complete. 2024-08-20T05:03:25.943 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.936+0000 7f1c1d8bd740 20 client.25855 trim_cache size 0 max 16384 2024-08-20T05:03:25.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.970+0000 7f1c1d8bd740 1 Processor -- start 2024-08-20T05:03:25.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.971+0000 7f1c1d8bd740 1 -- start start 2024-08-20T05:03:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.971+0000 7f1c1d8bd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 0x55b28a4e6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.971+0000 7f1c1d8bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 0x55b28a4e6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.971+0000 7f1c1d8bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4f1980 0x55b28a5197e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.971+0000 7f1c1d8bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1c141a90a0 con 0x55b28a4f1980 2024-08-20T05:03:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.971+0000 7f1c1d8bd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1c141aaca0 con 0x55b28a4ec610 2024-08-20T05:03:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.971+0000 7f1c1d8bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c141a9770 con 0x55b28a4eef40 2024-08-20T05:03:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.972+0000 7f1c13400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 0x55b28a4e6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.972+0000 7f1c13e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 0x55b28a4e6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.972+0000 7f1c13400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 0x55b28a4e6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41726/0 (socket says 172.21.15.37:41726) 2024-08-20T05:03:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.972+0000 7f1c13400640 1 -- 172.21.15.37:0/3280189957 learned_addr learned my addr 172.21.15.37:0/3280189957 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.972+0000 7f1c18a00640 1 --2- 172.21.15.37:0/3280189957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4f1980 0x55b28a5197e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.972+0000 7f1c13e00640 1 -- 172.21.15.37:0/3280189957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 msgr2=0x55b28a4e6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.972+0000 7f1c13e00640 1 --2- 172.21.15.37:0/3280189957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 0x55b28a4e6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.972+0000 7f1c13e00640 1 -- 172.21.15.37:0/3280189957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4f1980 msgr2=0x55b28a5197e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.972+0000 7f1c13e00640 1 --2- 172.21.15.37:0/3280189957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4f1980 0x55b28a5197e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.972+0000 7f1c13e00640 1 -- 172.21.15.37:0/3280189957 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b28a22a620 con 0x55b28a4ec610 2024-08-20T05:03:25.977 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.973+0000 7f1c13e00640 1 --2- 172.21.15.37:0/3280189957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 0x55b28a4e6650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55b28a515730 tx=0x7f1bfc04c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da01cb65ef9d6d98 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.974+0000 7f1c03e00640 1 -- 172.21.15.37:0/3280189957 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc035040 con 0x55b28a4ec610 2024-08-20T05:03:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.974+0000 7f1c03e00640 1 -- 172.21.15.37:0/3280189957 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bfc064070 con 0x55b28a4ec610 2024-08-20T05:03:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.974+0000 7f1c03e00640 1 -- 172.21.15.37:0/3280189957 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc003c30 con 0x55b28a4ec610 2024-08-20T05:03:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.975+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/3280189957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 msgr2=0x55b28a4e6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.975+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/3280189957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 0x55b28a4e6650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55b28a515730 tx=0x7f1bfc04c000 comp rx=0 tx=0).stop 2024-08-20T05:03:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.975+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/3280189957 shutdown_connections 2024-08-20T05:03:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.975+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/3280189957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4f1980 0x55b28a5197e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.975+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/3280189957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 0x55b28a4e6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.975+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/3280189957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4ec610 0x55b28a4e6650 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.975+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/3280189957 >> 172.21.15.37:0/3280189957 conn(0x55b28a4e7760 msgr2=0x55b28a4e5f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:25.978 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.976+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/3280189957 shutdown_connections 2024-08-20T05:03:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.976+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/3280189957 wait complete. 2024-08-20T05:03:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.977+0000 7f1c1d8bd740 1 -- start start 2024-08-20T05:03:25.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.977+0000 7f1c1d8bd740 1 Processor -- start 2024-08-20T05:03:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.978+0000 7f1c1d8bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4ec610 0x55b28a50e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.978+0000 7f1c1d8bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 0x55b28a50d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.978+0000 7f1c1d8bd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4f1980 0x55b28a50dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.978+0000 7f1c1d8bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1c141aa510 con 0x55b28a4ec610 2024-08-20T05:03:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.978+0000 7f1c1d8bd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1c141a9e40 con 0x55b28a4f1980 2024-08-20T05:03:25.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.978+0000 7f1c1d8bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1419dd10 con 0x55b28a4eef40 2024-08-20T05:03:25.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.978+0000 7f1c1d8bd740 10 client.0 _ll_register_callbacks cb 0x7f1c0c009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:25.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.979+0000 7f1c18a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4f1980 0x55b28a50dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:25.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.979+0000 7f1c18a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4f1980 0x55b28a50dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53034/0 (socket says 172.21.15.37:53034) 2024-08-20T05:03:25.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.979+0000 7f1c18a00640 1 -- 172.21.15.37:0/638824636 learned_addr learned my addr 172.21.15.37:0/638824636 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:25.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.979+0000 7f1c13400640 1 --2- 172.21.15.37:0/638824636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 0x55b28a50d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:25.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.979+0000 7f1c13e00640 1 --2- 172.21.15.37:0/638824636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4ec610 0x55b28a50e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.980+0000 7f1c18a00640 1 -- 172.21.15.37:0/638824636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 msgr2=0x55b28a50d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.980+0000 7f1c18a00640 1 --2- 172.21.15.37:0/638824636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 0x55b28a50d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.980+0000 7f1c18a00640 1 -- 172.21.15.37:0/638824636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4ec610 msgr2=0x55b28a50e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.980+0000 7f1c18a00640 1 --2- 172.21.15.37:0/638824636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4ec610 0x55b28a50e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.980+0000 7f1c18a00640 1 -- 172.21.15.37:0/638824636 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b28a50c0a0 con 0x55b28a4f1980 2024-08-20T05:03:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.980+0000 7f1c13400640 1 --2- 172.21.15.37:0/638824636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 0x55b28a50d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:03:25.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.980+0000 7f1c18a00640 1 --2- 172.21.15.37:0/638824636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4f1980 0x55b28a50dca0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009c60 tx=0x7f1c0c018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39111c17c05324c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.980+0000 7f1c01600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:03:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.981+0000 7f1c01600640 1 -- 172.21.15.37:0/638824636 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c01c3f0 con 0x55b28a4f1980 2024-08-20T05:03:25.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.981+0000 7f1c01600640 1 -- 172.21.15.37:0/638824636 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1c0c02b070 con 0x55b28a4f1980 2024-08-20T05:03:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.981+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/638824636 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bfc064070 con 0x55b28a4f1980 2024-08-20T05:03:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.982+0000 7f1c01600640 1 -- 172.21.15.37:0/638824636 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1c0c01c590 con 0x55b28a4f1980 2024-08-20T05:03:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.982+0000 7f1c1d8bd740 10 client.25844 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.982+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/638824636 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b28a57da80 con 0x55b28a4f1980 2024-08-20T05:03:25.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.982+0000 7f1c01600640 1 -- 172.21.15.37:0/638824636 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bfc064070 con 0x55b28a4f1980 2024-08-20T05:03:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.983+0000 7f1c01600640 1 -- 172.21.15.37:0/638824636 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f1c0c010ce0 con 0x55b28a4f1980 2024-08-20T05:03:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.983+0000 7f1c1d8bd740 10 client.25844 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.983+0000 7f1c1d8bd740 10 client.25844 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:03:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.983+0000 7f1c1d8bd740 20 client.25844 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.983+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/638824636 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b28a57e520 0x55b28a580940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:25.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.983+0000 7f1c1d8bd740 4 client.25844 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:03:25.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.983+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/638824636 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b28a45a340 con 0x55b28a57e520 2024-08-20T05:03:25.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.984+0000 7f1c13e00640 1 --2- 172.21.15.37:0/638824636 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b28a57e520 0x55b28a580940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:25.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.985+0000 7f1c13e00640 1 --2- 172.21.15.37:0/638824636 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b28a57e520 0x55b28a580940 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cf36aa0cdee8b12 server_cookie=c218e4c7d8478fc0 in_seq=0 out_seq=0 2024-08-20T05:03:25.987 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:25.985+0000 7f1c01600640 10 client.25844 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:26.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.045+0000 7f1c01600640 1 -- 172.21.15.37:0/638824636 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b28a45a340 con 0x55b28a57e520 2024-08-20T05:03:26.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.045+0000 7f1c01600640 10 client.25844 handle_command_reply: tid=0 2024-08-20T05:03:26.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.045+0000 7f1c1d8bd740 1 client.25844 shutdown 2024-08-20T05:03:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.046+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/638824636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4f1980 msgr2=0x55b28a50dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.046+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/638824636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4f1980 0x55b28a50dca0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009c60 tx=0x7f1c0c018000 comp rx=0 tx=0).stop 2024-08-20T05:03:26.050 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.047+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/638824636 shutdown_connections 2024-08-20T05:03:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.047+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/638824636 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b28a57e520 0x55b28a580940 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.047+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/638824636 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b28a4f1980 0x55b28a50dca0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.047+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/638824636 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b28a4eef40 0x55b28a50d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.047+0000 7f1c01600640 0 client.25844 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.047+0000 7f1c1d8bd740 1 --2- 172.21.15.37:0/638824636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b28a4ec610 0x55b28a50e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:26.051 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.047+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/638824636 >> 172.21.15.37:0/638824636 conn(0x55b28a4e7760 msgr2=0x55b28a4e6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.047+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/638824636 shutdown_connections 2024-08-20T05:03:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.048+0000 7f1c1d8bd740 1 -- 172.21.15.37:0/638824636 wait complete. 2024-08-20T05:03:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.048+0000 7f1c1d8bd740 20 client.25844 trim_cache size 0 max 16384 2024-08-20T05:03:26.052 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:03:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:03:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:03:26.053 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:03:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.050+0000 7f1c1aa00640 1 -- 172.21.15.37:0/242055299 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1bf80b3de0 msgr2=0x7f1bf80b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.050+0000 7f1c1aa00640 1 --2- 172.21.15.37:0/242055299 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1bf80b3de0 0x7f1bf80b62a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0096c0 tx=0x7f1bfc02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:03:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.050+0000 7f1c1aa00640 1 -- 172.21.15.37:0/242055299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c14076cc0 msgr2=0x7f1c1419f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:26.054 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.050+0000 7f1c1aa00640 1 --2- 172.21.15.37:0/242055299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c14076cc0 0x7f1c1419f6b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1c0400e9f0 tx=0x7f1c0400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:03:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.050+0000 7f1c1aa00640 1 -- 172.21.15.37:0/242055299 shutdown_connections 2024-08-20T05:03:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.050+0000 7f1c1aa00640 1 --2- 172.21.15.37:0/242055299 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1bf80b3de0 0x7f1bf80b62a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.050+0000 7f1c1aa00640 1 --2- 172.21.15.37:0/242055299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c1410a5a0 0x7f1c141a02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.050+0000 7f1c1aa00640 1 --2- 172.21.15.37:0/242055299 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1c14076cc0 0x7f1c1419f6b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.050+0000 7f1c1aa00640 1 --2- 172.21.15.37:0/242055299 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1c14075850 0x7f1c1419f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.050+0000 7f1c1aa00640 1 -- 172.21.15.37:0/242055299 >> 172.21.15.37:0/242055299 conn(0x7f1c140fdf40 msgr2=0x7f1c14102170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:26.055 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.051+0000 7f1c1aa00640 1 -- 172.21.15.37:0/242055299 shutdown_connections 2024-08-20T05:03:26.056 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:26.051+0000 7f1c1aa00640 1 -- 172.21.15.37:0/242055299 wait complete. 2024-08-20T05:03:26.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:25 smithi135 ceph-mon[22342]: pgmap v436: 129 pgs: 129 active+clean; 960 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 8.2 MiB/s wr, 487 op/s 2024-08-20T05:03:26.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:25 smithi130 ceph-mon[22007]: pgmap v436: 129 pgs: 129 active+clean; 960 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 8.2 MiB/s wr, 487 op/s 2024-08-20T05:03:26.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:25 smithi037 ceph-mon[17265]: pgmap v436: 129 pgs: 129 active+clean; 960 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 8.2 MiB/s wr, 487 op/s 2024-08-20T05:03:27.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:26 smithi037 ceph-mon[17265]: pgmap v437: 129 pgs: 129 active+clean; 969 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 6.9 MiB/s wr, 369 op/s 2024-08-20T05:03:27.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:26 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:03:27.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:26 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:03:27.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:26 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:03:27.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:26 smithi135 ceph-mon[22342]: pgmap v437: 129 pgs: 129 active+clean; 969 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 6.9 MiB/s wr, 369 op/s 2024-08-20T05:03:27.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:26 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:03:27.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:26 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:03:27.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:26 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:03:27.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:26 smithi130 ceph-mon[22007]: pgmap v437: 129 pgs: 129 active+clean; 969 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 6.9 MiB/s wr, 369 op/s 2024-08-20T05:03:27.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:26 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:03:27.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:26 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:03:27.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:26 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:03:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 30.0 s, 2383.0 tps, lat 42.255 ms stddev 49.777 2024-08-20T05:03:28.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:27 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:03:28.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:27 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:03:28.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:27 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:03:28.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:27 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:03:28.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:27 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:03:28.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:27 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:03:29.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:28 smithi135 ceph-mon[22342]: pgmap v438: 129 pgs: 129 active+clean; 971 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 6.0 MiB/s wr, 371 op/s 2024-08-20T05:03:29.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:28 smithi130 ceph-mon[22007]: pgmap v438: 129 pgs: 129 active+clean; 971 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 6.0 MiB/s wr, 371 op/s 2024-08-20T05:03:29.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:28 smithi037 ceph-mon[17265]: pgmap v438: 129 pgs: 129 active+clean; 971 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 6.0 MiB/s wr, 371 op/s 2024-08-20T05:03:31.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:31 smithi130 ceph-mon[22007]: pgmap v439: 129 pgs: 129 active+clean; 972 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 6.9 MiB/s wr, 471 op/s 2024-08-20T05:03:31.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:31 smithi037 ceph-mon[17265]: pgmap v439: 129 pgs: 129 active+clean; 972 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 6.9 MiB/s wr, 471 op/s 2024-08-20T05:03:31.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:31 smithi135 ceph-mon[22342]: pgmap v439: 129 pgs: 129 active+clean; 972 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 6.9 MiB/s wr, 471 op/s 2024-08-20T05:03:33.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 35.0 s, 2111.4 tps, lat 47.525 ms stddev 53.800 2024-08-20T05:03:33.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:33 smithi130 ceph-mon[22007]: pgmap v440: 129 pgs: 129 active+clean; 973 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.7 MiB/s wr, 584 op/s 2024-08-20T05:03:33.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:33 smithi037 ceph-mon[17265]: pgmap v440: 129 pgs: 129 active+clean; 973 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.7 MiB/s wr, 584 op/s 2024-08-20T05:03:33.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:33 smithi135 ceph-mon[22342]: pgmap v440: 129 pgs: 129 active+clean; 973 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.7 MiB/s wr, 584 op/s 2024-08-20T05:03:35.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:35 smithi130 ceph-mon[22007]: pgmap v441: 129 pgs: 129 active+clean; 973 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.0 MiB/s wr, 640 op/s 2024-08-20T05:03:35.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:35 smithi037 ceph-mon[17265]: pgmap v441: 129 pgs: 129 active+clean; 973 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.0 MiB/s wr, 640 op/s 2024-08-20T05:03:35.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:35 smithi135 ceph-mon[22342]: pgmap v441: 129 pgs: 129 active+clean; 973 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.0 MiB/s wr, 640 op/s 2024-08-20T05:03:37.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:37 smithi130 ceph-mon[22007]: pgmap v442: 129 pgs: 129 active+clean; 974 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 701 op/s 2024-08-20T05:03:37.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:37 smithi037 ceph-mon[17265]: pgmap v442: 129 pgs: 129 active+clean; 974 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 701 op/s 2024-08-20T05:03:37.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:37 smithi135 ceph-mon[22342]: pgmap v442: 129 pgs: 129 active+clean; 974 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.6 MiB/s wr, 701 op/s 2024-08-20T05:03:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 40.0 s, 2344.6 tps, lat 42.665 ms stddev 48.273 2024-08-20T05:03:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.262+0000 7f55b4600640 1 -- 172.21.15.37:0/1253498527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55ac10a840 msgr2=0x7f55ac1133e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.263+0000 7f55b4600640 1 --2- 172.21.15.37:0/1253498527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55ac10a840 0x7f55ac1133e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f55a4009ca0 tx=0x7f55a402a8b0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.264+0000 7f55b4600640 1 -- 172.21.15.37:0/1253498527 shutdown_connections 2024-08-20T05:03:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.264+0000 7f55b4600640 1 --2- 172.21.15.37:0/1253498527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55ac10a840 0x7f55ac1133e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.264+0000 7f55b4600640 1 --2- 172.21.15.37:0/1253498527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ac109e80 0x7f55ac10a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.264+0000 7f55b4600640 1 --2- 172.21.15.37:0/1253498527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55ac074190 0x7f55ac074590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.264+0000 7f55b4600640 1 -- 172.21.15.37:0/1253498527 >> 172.21.15.37:0/1253498527 conn(0x7f55ac06fcc0 msgr2=0x7f55ac072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.265+0000 7f55b4600640 1 -- 172.21.15.37:0/1253498527 shutdown_connections 2024-08-20T05:03:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.265+0000 7f55b4600640 1 -- 172.21.15.37:0/1253498527 wait complete. 2024-08-20T05:03:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.269+0000 7f55b4600640 1 Processor -- start 2024-08-20T05:03:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.270+0000 7f55b4600640 1 -- start start 2024-08-20T05:03:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.271+0000 7f55b4600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55ac074190 0x7f55ac1a7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.271+0000 7f55b4600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55ac109e80 0x7f55ac1a7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.271+0000 7f55b4600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ac10a840 0x7f55ac1a8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.271+0000 7f55b4600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac10cac0 con 0x7f55ac109e80 2024-08-20T05:03:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.271+0000 7f55b4600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac10c940 con 0x7f55ac074190 2024-08-20T05:03:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.271+0000 7f55b4600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac10cc40 con 0x7f55ac10a840 2024-08-20T05:03:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.272+0000 7f55b2600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ac10a840 0x7f55ac1a8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.272+0000 7f55b2600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ac10a840 0x7f55ac1a8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35632/0 (socket says 172.21.15.37:35632) 2024-08-20T05:03:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.272+0000 7f55b2600640 1 -- 172.21.15.37:0/4018526208 learned_addr learned my addr 172.21.15.37:0/4018526208 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:39.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.272+0000 7f55b1c00640 1 --2- 172.21.15.37:0/4018526208 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55ac074190 0x7f55ac1a7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.273+0000 7f55b1200640 1 --2- 172.21.15.37:0/4018526208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55ac109e80 0x7f55ac1a7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.273+0000 7f55b2600640 1 -- 172.21.15.37:0/4018526208 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55ac074190 msgr2=0x7f55ac1a7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.273+0000 7f55b2600640 1 --2- 172.21.15.37:0/4018526208 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55ac074190 0x7f55ac1a7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.273+0000 7f55b2600640 1 -- 172.21.15.37:0/4018526208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55ac109e80 msgr2=0x7f55ac1a7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.273+0000 7f55b2600640 1 --2- 172.21.15.37:0/4018526208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55ac109e80 0x7f55ac1a7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.273+0000 7f55b2600640 1 -- 172.21.15.37:0/4018526208 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ac1a9360 con 0x7f55ac10a840 2024-08-20T05:03:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.274+0000 7f55b2600640 1 --2- 172.21.15.37:0/4018526208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ac10a840 0x7f55ac1a8aa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f55a4003c10 tx=0x7f55a4003c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.275+0000 7f55aa000640 1 -- 172.21.15.37:0/4018526208 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4004450 con 0x7f55ac10a840 2024-08-20T05:03:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.275+0000 7f55aa000640 1 -- 172.21.15.37:0/4018526208 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55a4040070 con 0x7f55ac10a840 2024-08-20T05:03:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.275+0000 7f55b4600640 1 -- 172.21.15.37:0/4018526208 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55ac1a95f0 con 0x7f55ac10a840 2024-08-20T05:03:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.275+0000 7f55aa000640 1 -- 172.21.15.37:0/4018526208 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4004450 con 0x7f55ac10a840 2024-08-20T05:03:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.276+0000 7f55b4600640 1 -- 172.21.15.37:0/4018526208 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55ac1afd20 con 0x7f55ac10a840 2024-08-20T05:03:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.286+0000 7f55b75c7740 1 Processor -- start 2024-08-20T05:03:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.287+0000 7f55aa000640 1 -- 172.21.15.37:0/4018526208 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f55a4031c80 con 0x7f55ac10a840 2024-08-20T05:03:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.290+0000 7f55aa000640 1 --2- 172.21.15.37:0/4018526208 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55940b3e50 0x7f55940b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.290+0000 7f55aa000640 1 -- 172.21.15.37:0/4018526208 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f55a41051d0 con 0x7f55ac10a840 2024-08-20T05:03:39.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.291+0000 7f55b75c7740 1 -- start start 2024-08-20T05:03:39.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.292+0000 7f55b1200640 1 --2- 172.21.15.37:0/4018526208 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55940b3e50 0x7f55940b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:39.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.294+0000 7f55b75c7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f8132b0 0x55c56f8156a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.294+0000 7f55b75c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f815be0 0x55c56f817fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.294+0000 7f55b75c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f818620 0x55c56f81aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.294+0000 7f55b75c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c56f786210 con 0x55c56f818620 2024-08-20T05:03:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.294+0000 7f55b75c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c56f775710 con 0x55c56f815be0 2024-08-20T05:03:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.294+0000 7f55b75c7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c56f779750 con 0x55c56f8132b0 2024-08-20T05:03:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.295+0000 7f55b1c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f8132b0 0x55c56f8156a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:39.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.295+0000 7f55b1c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f8132b0 0x55c56f8156a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35634/0 (socket says 172.21.15.37:35634) 2024-08-20T05:03:39.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.295+0000 7f55b1c00640 1 -- 172.21.15.37:0/1432527438 learned_addr learned my addr 172.21.15.37:0/1432527438 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:39.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.295+0000 7f55b2600640 1 --2- 172.21.15.37:0/1432527438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f818620 0x55c56f81aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:39.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.296+0000 7f55b2600640 1 -- 172.21.15.37:0/1432527438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f8132b0 msgr2=0x55c56f8156a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:39.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.296+0000 7f55b2600640 1 --2- 172.21.15.37:0/1432527438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f8132b0 0x55c56f8156a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.296+0000 7f55b2600640 1 -- 172.21.15.37:0/1432527438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f815be0 msgr2=0x55c56f817fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:03:39.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.296+0000 7f55b2600640 1 --2- 172.21.15.37:0/1432527438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f815be0 0x55c56f817fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.296+0000 7f55b2600640 1 -- 172.21.15.37:0/1432527438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c56f741de0 con 0x55c56f818620 2024-08-20T05:03:39.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.296+0000 7f55b1200640 1 --2- 172.21.15.37:0/4018526208 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55940b3e50 0x7f55940b6310 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f55980058c0 tx=0x7f5598005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:39.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.297+0000 7f55b2600640 1 --2- 172.21.15.37:0/1432527438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f818620 0x55c56f81aae0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f55a41028d0 tx=0x7f55a40098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d146cd9bb9f6e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:39.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.297+0000 7f559ea00640 1 -- 172.21.15.37:0/1432527438 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a40cbd20 con 0x55c56f818620 2024-08-20T05:03:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.298+0000 7f559ea00640 1 -- 172.21.15.37:0/1432527438 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55a4036040 con 0x55c56f818620 2024-08-20T05:03:39.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.298+0000 7f559ea00640 1 -- 172.21.15.37:0/1432527438 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a40cbf80 con 0x55c56f818620 2024-08-20T05:03:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.299+0000 7f55b75c7740 1 -- 172.21.15.37:0/1432527438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f818620 msgr2=0x55c56f81aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.299+0000 7f55b75c7740 1 --2- 172.21.15.37:0/1432527438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f818620 0x55c56f81aae0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f55a41028d0 tx=0x7f55a40098d0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.300+0000 7f55b75c7740 1 -- 172.21.15.37:0/1432527438 shutdown_connections 2024-08-20T05:03:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.300+0000 7f55b75c7740 1 --2- 172.21.15.37:0/1432527438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f818620 0x55c56f81aae0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.300+0000 7f55b75c7740 1 --2- 172.21.15.37:0/1432527438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f815be0 0x55c56f817fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.300+0000 7f55b75c7740 1 --2- 172.21.15.37:0/1432527438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f8132b0 0x55c56f8156a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.300+0000 7f55b75c7740 1 -- 172.21.15.37:0/1432527438 >> 172.21.15.37:0/1432527438 conn(0x55c56f80e3b0 msgr2=0x55c56f80f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.300+0000 7f55b75c7740 1 -- 172.21.15.37:0/1432527438 shutdown_connections 2024-08-20T05:03:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.301+0000 7f55b75c7740 1 -- 172.21.15.37:0/1432527438 wait complete. 2024-08-20T05:03:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.301+0000 7f55b75c7740 1 -- start start 2024-08-20T05:03:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.302+0000 7f55b75c7740 1 Processor -- start 2024-08-20T05:03:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.303+0000 7f55b75c7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f8132b0 0x55c56f81caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.304+0000 7f55b75c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f815be0 0x55c56f81d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.304+0000 7f55b75c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f818620 0x55c56f81dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.304+0000 7f55b1c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f8132b0 0x55c56f81caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.304+0000 7f55b2600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f818620 0x55c56f81dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.304+0000 7f55b1c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f8132b0 0x55c56f81caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35636/0 (socket says 172.21.15.37:35636) 2024-08-20T05:03:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.304+0000 7f55b1c00640 1 -- 172.21.15.37:0/1642268748 learned_addr learned my addr 172.21.15.37:0/1642268748 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.304+0000 7f55b75c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c56f6aeab0 con 0x55c56f815be0 2024-08-20T05:03:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.304+0000 7f55b75c7740 1 -- 172.21.15.37:0/1642268748 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c56f71c140 con 0x55c56f818620 2024-08-20T05:03:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.304+0000 7f55b75c7740 1 -- 172.21.15.37:0/1642268748 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c56f81b3c0 con 0x55c56f8132b0 2024-08-20T05:03:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.305+0000 7f55b75c7740 10 client.0 _ll_register_callbacks cb 0x55c56f72f5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.305+0000 7f55b1200640 1 --2- 172.21.15.37:0/1642268748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f815be0 0x55c56f81d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.305+0000 7f55b2600640 1 -- 172.21.15.37:0/1642268748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f8132b0 msgr2=0x55c56f81caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.305+0000 7f55b2600640 1 --2- 172.21.15.37:0/1642268748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f8132b0 0x55c56f81caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.305+0000 7f55b2600640 1 -- 172.21.15.37:0/1642268748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f815be0 msgr2=0x55c56f81d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.305+0000 7f55b2600640 1 --2- 172.21.15.37:0/1642268748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f815be0 0x55c56f81d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.305+0000 7f55b2600640 1 -- 172.21.15.37:0/1642268748 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c56f71d170 con 0x55c56f818620 2024-08-20T05:03:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.307+0000 7f55b2600640 1 --2- 172.21.15.37:0/1642268748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f818620 0x55c56f81dd10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f55a40c7ce0 tx=0x7f55a40cb990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b8959fa3ec19cff server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.307+0000 7f5593400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:03:39.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.307+0000 7f5593400640 1 -- 172.21.15.37:0/1642268748 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a40046f0 con 0x55c56f818620 2024-08-20T05:03:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.307+0000 7f5593400640 1 -- 172.21.15.37:0/1642268748 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f55a40d4b50 con 0x55c56f818620 2024-08-20T05:03:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.307+0000 7f55b75c7740 1 -- 172.21.15.37:0/1642268748 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c56f74ca30 con 0x55c56f818620 2024-08-20T05:03:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.308+0000 7f5593400640 1 -- 172.21.15.37:0/1642268748 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f55a40cbd20 con 0x55c56f818620 2024-08-20T05:03:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.308+0000 7f55b75c7740 10 client.25850 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.308+0000 7f55b75c7740 1 -- 172.21.15.37:0/1642268748 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c56f4d8790 con 0x55c56f818620 2024-08-20T05:03:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.309+0000 7f5593400640 1 -- 172.21.15.37:0/1642268748 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55c56f74ca30 con 0x55c56f818620 2024-08-20T05:03:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.309+0000 7f5593400640 1 -- 172.21.15.37:0/1642268748 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f55a40c7690 con 0x55c56f818620 2024-08-20T05:03:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.309+0000 7f55b75c7740 10 client.25850 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.309+0000 7f55b75c7740 10 client.25850 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:03:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.309+0000 7f55b75c7740 20 client.25850 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.309+0000 7f55b75c7740 1 --2- 172.21.15.37:0/1642268748 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c56f8284b0 0x55c56f82a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.309+0000 7f55b75c7740 4 client.25850 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:03:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.309+0000 7f55b75c7740 1 -- 172.21.15.37:0/1642268748 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c56f788160 con 0x55c56f8284b0 2024-08-20T05:03:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.310+0000 7f55b1c00640 1 --2- 172.21.15.37:0/1642268748 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c56f8284b0 0x55c56f82a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.311+0000 7f55b1c00640 1 --2- 172.21.15.37:0/1642268748 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c56f8284b0 0x55c56f82a8c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ef13ede04e8799f server_cookie=11ac08a42426bf2f in_seq=0 out_seq=0 2024-08-20T05:03:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.311+0000 7f5593400640 10 client.25850 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.312+0000 7f5593400640 1 -- 172.21.15.37:0/1642268748 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c56f788160 con 0x55c56f8284b0 2024-08-20T05:03:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.312+0000 7f5593400640 10 client.25850 handle_command_reply: tid=0 2024-08-20T05:03:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.313+0000 7f55b75c7740 1 client.25850 shutdown 2024-08-20T05:03:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.313+0000 7f55b75c7740 1 -- 172.21.15.37:0/1642268748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f818620 msgr2=0x55c56f81dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.313+0000 7f55b75c7740 1 --2- 172.21.15.37:0/1642268748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f818620 0x55c56f81dd10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f55a40c7ce0 tx=0x7f55a40cb990 comp rx=0 tx=0).stop 2024-08-20T05:03:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.314+0000 7f55b75c7740 1 -- 172.21.15.37:0/1642268748 shutdown_connections 2024-08-20T05:03:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.314+0000 7f55b75c7740 1 --2- 172.21.15.37:0/1642268748 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c56f8284b0 0x55c56f82a8c0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.314+0000 7f55b75c7740 1 --2- 172.21.15.37:0/1642268748 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f818620 0x55c56f81dd10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.314+0000 7f55b75c7740 1 --2- 172.21.15.37:0/1642268748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f815be0 0x55c56f81d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.314+0000 7f5593400640 0 client.25850 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.314+0000 7f55b75c7740 1 --2- 172.21.15.37:0/1642268748 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f8132b0 0x55c56f81caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.314+0000 7f55b75c7740 1 -- 172.21.15.37:0/1642268748 >> 172.21.15.37:0/1642268748 conn(0x55c56f80e3b0 msgr2=0x55c56f80d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.314+0000 7f55b75c7740 1 -- 172.21.15.37:0/1642268748 shutdown_connections 2024-08-20T05:03:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.315+0000 7f55b75c7740 1 -- 172.21.15.37:0/1642268748 wait complete. 2024-08-20T05:03:39.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.315+0000 7f55b75c7740 20 client.25850 trim_cache size 0 max 16384 2024-08-20T05:03:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.349+0000 7f55b75c7740 1 Processor -- start 2024-08-20T05:03:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.349+0000 7f55b75c7740 1 -- start start 2024-08-20T05:03:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.350+0000 7f55b75c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f8132b0 0x55c56f81a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.350+0000 7f55b75c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f815be0 0x55c56f81a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.350+0000 7f55b75c7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f818620 0x55c56f818a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.350+0000 7f55b75c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac1ba040 con 0x55c56f8132b0 2024-08-20T05:03:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.350+0000 7f55b75c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac1bbc40 con 0x55c56f815be0 2024-08-20T05:03:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.350+0000 7f55b75c7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac1ba710 con 0x55c56f818620 2024-08-20T05:03:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.350+0000 7f55b2600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f818620 0x55c56f818a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:39.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.350+0000 7f55b1200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f815be0 0x55c56f81a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:39.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.351+0000 7f55b1200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f815be0 0x55c56f81a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47238/0 (socket says 172.21.15.37:47238) 2024-08-20T05:03:39.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.351+0000 7f55b1200640 1 -- 172.21.15.37:0/3120752992 learned_addr learned my addr 172.21.15.37:0/3120752992 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:39.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.351+0000 7f55b2600640 1 -- 172.21.15.37:0/3120752992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f815be0 msgr2=0x55c56f81a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:39.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.351+0000 7f55b2600640 1 --2- 172.21.15.37:0/3120752992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f815be0 0x55c56f81a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.351+0000 7f55b2600640 1 -- 172.21.15.37:0/3120752992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f8132b0 msgr2=0x55c56f81a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:39.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.351+0000 7f55b2600640 1 --2- 172.21.15.37:0/3120752992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f8132b0 0x55c56f81a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.351+0000 7f55b2600640 1 -- 172.21.15.37:0/3120752992 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c56f551620 con 0x55c56f818620 2024-08-20T05:03:39.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.352+0000 7f55b2600640 1 --2- 172.21.15.37:0/3120752992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f818620 0x55c56f818a50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f55a40306c0 tx=0x7f55a40095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e43dd0539b7caee4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:39.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.352+0000 7f559e000640 1 -- 172.21.15.37:0/3120752992 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a40d4b50 con 0x55c56f818620 2024-08-20T05:03:39.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.353+0000 7f559e000640 1 -- 172.21.15.37:0/3120752992 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55a40d0020 con 0x55c56f818620 2024-08-20T05:03:39.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.353+0000 7f559e000640 1 -- 172.21.15.37:0/3120752992 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4031440 con 0x55c56f818620 2024-08-20T05:03:39.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.354+0000 7f55b75c7740 1 -- 172.21.15.37:0/3120752992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f818620 msgr2=0x55c56f818a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:39.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.354+0000 7f55b75c7740 1 --2- 172.21.15.37:0/3120752992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f818620 0x55c56f818a50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f55a40306c0 tx=0x7f55a40095c0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.354+0000 7f55b75c7740 1 -- 172.21.15.37:0/3120752992 shutdown_connections 2024-08-20T05:03:39.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.354+0000 7f55b75c7740 1 --2- 172.21.15.37:0/3120752992 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f818620 0x55c56f818a50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.354+0000 7f55b75c7740 1 --2- 172.21.15.37:0/3120752992 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f815be0 0x55c56f81a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.354+0000 7f55b75c7740 1 --2- 172.21.15.37:0/3120752992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f8132b0 0x55c56f81a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.354+0000 7f55b75c7740 1 -- 172.21.15.37:0/3120752992 >> 172.21.15.37:0/3120752992 conn(0x55c56f80e3b0 msgr2=0x55c56f80f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.355+0000 7f55b75c7740 1 -- 172.21.15.37:0/3120752992 shutdown_connections 2024-08-20T05:03:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.355+0000 7f55b75c7740 1 -- 172.21.15.37:0/3120752992 wait complete. 2024-08-20T05:03:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.356+0000 7f55b75c7740 1 -- start start 2024-08-20T05:03:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.356+0000 7f55b75c7740 1 Processor -- start 2024-08-20T05:03:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.357+0000 7f55b75c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f8132b0 0x55c56f81f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.357+0000 7f55b75c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f815be0 0x55c56f81faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.358+0000 7f55b75c7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f818620 0x55c56f820670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.358+0000 7f55b75c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac1bb4b0 con 0x55c56f8132b0 2024-08-20T05:03:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.358+0000 7f55b75c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac1bade0 con 0x55c56f815be0 2024-08-20T05:03:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.358+0000 7f55b75c7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55ac1b8020 con 0x55c56f818620 2024-08-20T05:03:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.358+0000 7f55b75c7740 10 client.0 _ll_register_callbacks cb 0x7f55a000a670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.358+0000 7f55b2600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f818620 0x55c56f820670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.358+0000 7f55b2600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f818620 0x55c56f820670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35648/0 (socket says 172.21.15.37:35648) 2024-08-20T05:03:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.358+0000 7f55b2600640 1 -- 172.21.15.37:0/1502412649 learned_addr learned my addr 172.21.15.37:0/1502412649 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.358+0000 7f55b1200640 1 --2- 172.21.15.37:0/1502412649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f815be0 0x55c56f81faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.359+0000 7f55b2600640 1 -- 172.21.15.37:0/1502412649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f815be0 msgr2=0x55c56f81faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.359+0000 7f55b2600640 1 --2- 172.21.15.37:0/1502412649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f815be0 0x55c56f81faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.359+0000 7f55b2600640 1 -- 172.21.15.37:0/1502412649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f8132b0 msgr2=0x55c56f81f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:39.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.359+0000 7f55b1c00640 1 --2- 172.21.15.37:0/1502412649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f8132b0 0x55c56f81f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.359+0000 7f55b2600640 1 --2- 172.21.15.37:0/1502412649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f8132b0 0x55c56f81f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.359+0000 7f55b2600640 1 -- 172.21.15.37:0/1502412649 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c56f820ea0 con 0x55c56f818620 2024-08-20T05:03:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.359+0000 7f55b1200640 1 --2- 172.21.15.37:0/1502412649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f815be0 0x55c56f81faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.360+0000 7f55b1c00640 1 --2- 172.21.15.37:0/1502412649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f8132b0 0x55c56f81f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:03:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.360+0000 7f55b2600640 1 --2- 172.21.15.37:0/1502412649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f818620 0x55c56f820670 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f55a40cba20 tx=0x7f55a40c7fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b32fd52d4610d52 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.360+0000 7f5593400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:03:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.360+0000 7f5593400640 1 -- 172.21.15.37:0/1502412649 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a4031440 con 0x55c56f818620 2024-08-20T05:03:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.361+0000 7f55b75c7740 1 -- 172.21.15.37:0/1502412649 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55a40d0020 con 0x55c56f818620 2024-08-20T05:03:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.361+0000 7f5593400640 1 -- 172.21.15.37:0/1502412649 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f55a40c8310 con 0x55c56f818620 2024-08-20T05:03:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.361+0000 7f5593400640 1 -- 172.21.15.37:0/1502412649 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f55a40caf80 con 0x55c56f818620 2024-08-20T05:03:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.361+0000 7f55b75c7740 10 client.25873 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.362+0000 7f55b75c7740 1 -- 172.21.15.37:0/1502412649 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c56f820ea0 con 0x55c56f818620 2024-08-20T05:03:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.362+0000 7f5593400640 1 -- 172.21.15.37:0/1502412649 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55a40d0020 con 0x55c56f818620 2024-08-20T05:03:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.362+0000 7f5593400640 1 -- 172.21.15.37:0/1502412649 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f55a40d14b0 con 0x55c56f818620 2024-08-20T05:03:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.362+0000 7f55b75c7740 10 client.25873 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.362+0000 7f55b75c7740 10 client.25873 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:03:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.362+0000 7f55b75c7740 20 client.25873 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.362+0000 7f55b75c7740 1 --2- 172.21.15.37:0/1502412649 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c56f8284b0 0x55c56f8247e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.363+0000 7f55b75c7740 4 client.25873 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:03:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.363+0000 7f55b75c7740 1 -- 172.21.15.37:0/1502412649 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c56f783c00 con 0x55c56f8284b0 2024-08-20T05:03:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.363+0000 7f55b1c00640 1 --2- 172.21.15.37:0/1502412649 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c56f8284b0 0x55c56f8247e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.364+0000 7f55b1c00640 1 --2- 172.21.15.37:0/1502412649 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c56f8284b0 0x55c56f8247e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=959d6a754cfd4b7a server_cookie=bb93bbb7d1c638c9 in_seq=0 out_seq=0 2024-08-20T05:03:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.364+0000 7f5593400640 10 client.25873 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:39.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.398+0000 7f5593400640 1 -- 172.21.15.37:0/1502412649 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c56f783c00 con 0x55c56f8284b0 2024-08-20T05:03:39.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.398+0000 7f5593400640 10 client.25873 handle_command_reply: tid=0 2024-08-20T05:03:39.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.398+0000 7f55b75c7740 1 client.25873 shutdown 2024-08-20T05:03:39.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.399+0000 7f55b75c7740 1 -- 172.21.15.37:0/1502412649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f818620 msgr2=0x55c56f820670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:39.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.399+0000 7f55b75c7740 1 --2- 172.21.15.37:0/1502412649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f818620 0x55c56f820670 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f55a40cba20 tx=0x7f55a40c7fb0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.399+0000 7f55b75c7740 1 -- 172.21.15.37:0/1502412649 shutdown_connections 2024-08-20T05:03:39.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.400+0000 7f55b75c7740 1 --2- 172.21.15.37:0/1502412649 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c56f8284b0 0x55c56f8247e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.400+0000 7f55b75c7740 1 --2- 172.21.15.37:0/1502412649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c56f818620 0x55c56f820670 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.400+0000 7f55b75c7740 1 --2- 172.21.15.37:0/1502412649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c56f815be0 0x55c56f81faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.400+0000 7f55b75c7740 1 --2- 172.21.15.37:0/1502412649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c56f8132b0 0x55c56f81f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.400+0000 7f55b75c7740 1 -- 172.21.15.37:0/1502412649 >> 172.21.15.37:0/1502412649 conn(0x55c56f80e3b0 msgr2=0x55c56f81a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:39.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.400+0000 7f5593400640 0 client.25873 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:39.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.400+0000 7f55b75c7740 1 -- 172.21.15.37:0/1502412649 shutdown_connections 2024-08-20T05:03:39.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.400+0000 7f55b75c7740 1 -- 172.21.15.37:0/1502412649 wait complete. 2024-08-20T05:03:39.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.400+0000 7f55b75c7740 20 client.25873 trim_cache size 0 max 16384 2024-08-20T05:03:39.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:03:39.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:03:39.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:03:39.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:03:39.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.402+0000 7f55b4600640 1 -- 172.21.15.37:0/4018526208 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55940b3e50 msgr2=0x7f55940b6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:39.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.402+0000 7f55b4600640 1 --2- 172.21.15.37:0/4018526208 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55940b3e50 0x7f55940b6310 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f55980058c0 tx=0x7f5598005c60 comp rx=0 tx=0).stop 2024-08-20T05:03:39.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.402+0000 7f55b4600640 1 -- 172.21.15.37:0/4018526208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ac10a840 msgr2=0x7f55ac1a8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:39.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.402+0000 7f55b4600640 1 --2- 172.21.15.37:0/4018526208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ac10a840 0x7f55ac1a8aa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f55a4003c10 tx=0x7f55a4003c40 comp rx=0 tx=0).stop 2024-08-20T05:03:39.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.402+0000 7f55b4600640 1 -- 172.21.15.37:0/4018526208 shutdown_connections 2024-08-20T05:03:39.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.402+0000 7f55b4600640 1 --2- 172.21.15.37:0/4018526208 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55940b3e50 0x7f55940b6310 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.402+0000 7f55b4600640 1 --2- 172.21.15.37:0/4018526208 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ac10a840 0x7f55ac1a8aa0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.402+0000 7f55b4600640 1 --2- 172.21.15.37:0/4018526208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55ac109e80 0x7f55ac1a7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.402+0000 7f55b4600640 1 --2- 172.21.15.37:0/4018526208 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55ac074190 0x7f55ac1a7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:39.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.402+0000 7f55b4600640 1 -- 172.21.15.37:0/4018526208 >> 172.21.15.37:0/4018526208 conn(0x7f55ac06fcc0 msgr2=0x7f55ac117350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:39.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.402+0000 7f55b4600640 1 -- 172.21.15.37:0/4018526208 shutdown_connections 2024-08-20T05:03:39.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:39.402+0000 7f55b4600640 1 -- 172.21.15.37:0/4018526208 wait complete. 2024-08-20T05:03:39.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:39 smithi130 ceph-mon[22007]: pgmap v443: 129 pgs: 129 active+clean; 974 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.9 MiB/s wr, 693 op/s 2024-08-20T05:03:39.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:39 smithi037 ceph-mon[17265]: pgmap v443: 129 pgs: 129 active+clean; 974 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.9 MiB/s wr, 693 op/s 2024-08-20T05:03:39.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:39 smithi135 ceph-mon[22342]: pgmap v443: 129 pgs: 129 active+clean; 974 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.9 MiB/s wr, 693 op/s 2024-08-20T05:03:40.811 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-08-20T05:03:40.811 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:03:41.270 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:41 smithi037 ceph-mon[17265]: pgmap v444: 129 pgs: 129 active+clean; 983 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.9 MiB/s wr, 736 op/s 2024-08-20T05:03:41.417 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:41 smithi135 ceph-mon[22342]: pgmap v444: 129 pgs: 129 active+clean; 983 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.9 MiB/s wr, 736 op/s 2024-08-20T05:03:41.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:41 smithi130 ceph-mon[22007]: pgmap v444: 129 pgs: 129 active+clean; 983 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.9 MiB/s wr, 736 op/s 2024-08-20T05:03:41.522 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:03:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.278+0000 7f4a92c00640 1 -- 172.21.15.37:0/2680793040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a8c10eaf0 msgr2=0x7f4a8c10ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.278+0000 7f4a92c00640 1 --2- 172.21.15.37:0/2680793040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a8c10eaf0 0x7f4a8c10ef30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4a78009900 tx=0x7f4a7802a400 comp rx=0 tx=0).stop 2024-08-20T05:03:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.279+0000 7f4a92c00640 1 -- 172.21.15.37:0/2680793040 shutdown_connections 2024-08-20T05:03:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.279+0000 7f4a92c00640 1 --2- 172.21.15.37:0/2680793040 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a8c10f470 0x7f4a8c115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.279+0000 7f4a92c00640 1 --2- 172.21.15.37:0/2680793040 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a8c10eaf0 0x7f4a8c10ef30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.279+0000 7f4a92c00640 1 --2- 172.21.15.37:0/2680793040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a8c1090e0 0x7f4a8c1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.279+0000 7f4a92c00640 1 -- 172.21.15.37:0/2680793040 >> 172.21.15.37:0/2680793040 conn(0x7f4a8c078760 msgr2=0x7f4a8c07ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.279+0000 7f4a92c00640 1 -- 172.21.15.37:0/2680793040 shutdown_connections 2024-08-20T05:03:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.279+0000 7f4a92c00640 1 -- 172.21.15.37:0/2680793040 wait complete. 2024-08-20T05:03:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.280+0000 7f4a92c00640 1 Processor -- start 2024-08-20T05:03:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.280+0000 7f4a92c00640 1 -- start start 2024-08-20T05:03:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.281+0000 7f4a92c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a8c1090e0 0x7f4a8c0832f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.281+0000 7f4a92c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a8c10eaf0 0x7f4a8c083830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.281+0000 7f4a92c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a8c10f470 0x7f4a8c07c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.281+0000 7f4a92c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c119140 con 0x7f4a8c1090e0 2024-08-20T05:03:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.281+0000 7f4a92c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c118fc0 con 0x7f4a8c10eaf0 2024-08-20T05:03:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.281+0000 7f4a92c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4a8c1192c0 con 0x7f4a8c10f470 2024-08-20T05:03:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.282+0000 7f4a8b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a8c10eaf0 0x7f4a8c083830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.282+0000 7f4a90c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a8c10f470 0x7f4a8c07c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.282+0000 7f4a90c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a8c10f470 0x7f4a8c07c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35660/0 (socket says 172.21.15.37:35660) 2024-08-20T05:03:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.282+0000 7f4a8b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a8c10eaf0 0x7f4a8c083830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47266/0 (socket says 172.21.15.37:47266) 2024-08-20T05:03:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.282+0000 7f4a90c00640 1 -- 172.21.15.37:0/1417637138 learned_addr learned my addr 172.21.15.37:0/1417637138 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.282+0000 7f4a90c00640 1 -- 172.21.15.37:0/1417637138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a8c10eaf0 msgr2=0x7f4a8c083830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.282+0000 7f4a90c00640 1 --2- 172.21.15.37:0/1417637138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a8c10eaf0 0x7f4a8c083830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.282+0000 7f4a90c00640 1 -- 172.21.15.37:0/1417637138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a8c1090e0 msgr2=0x7f4a8c0832f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.282+0000 7f4a90c00640 1 --2- 172.21.15.37:0/1417637138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a8c1090e0 0x7f4a8c0832f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.282+0000 7f4a90c00640 1 -- 172.21.15.37:0/1417637138 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a8c07cf30 con 0x7f4a8c10f470 2024-08-20T05:03:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.282+0000 7f4a8b400640 1 --2- 172.21.15.37:0/1417637138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a8c10eaf0 0x7f4a8c083830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.283+0000 7f4a90c00640 1 --2- 172.21.15.37:0/1417637138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a8c10f470 0x7f4a8c07c670 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400eaa0 tx=0x7f4a8400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.283+0000 7f4a88c00640 1 -- 172.21.15.37:0/1417637138 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a8400cdb0 con 0x7f4a8c10f470 2024-08-20T05:03:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.284+0000 7f4a88c00640 1 -- 172.21.15.37:0/1417637138 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a84005020 con 0x7f4a8c10f470 2024-08-20T05:03:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.284+0000 7f4a88c00640 1 -- 172.21.15.37:0/1417637138 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a840116d0 con 0x7f4a8c10f470 2024-08-20T05:03:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.284+0000 7f4a92c00640 1 -- 172.21.15.37:0/1417637138 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a8c07d220 con 0x7f4a8c10f470 2024-08-20T05:03:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.284+0000 7f4a92c00640 1 -- 172.21.15.37:0/1417637138 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a8c0821b0 con 0x7f4a8c10f470 2024-08-20T05:03:42.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.289+0000 7f4a92c00640 1 -- 172.21.15.37:0/1417637138 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a8c10a390 con 0x7f4a8c10f470 2024-08-20T05:03:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.291+0000 7f4a88c00640 1 -- 172.21.15.37:0/1417637138 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4a84011870 con 0x7f4a8c10f470 2024-08-20T05:03:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.294+0000 7f4a88c00640 1 --2- 172.21.15.37:0/1417637138 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a700b3c50 0x7f4a700b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.294+0000 7f4a88c00640 1 -- 172.21.15.37:0/1417637138 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4a840e4100 con 0x7f4a8c10f470 2024-08-20T05:03:42.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.294+0000 7f4a8be00640 1 --2- 172.21.15.37:0/1417637138 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a700b3c50 0x7f4a700b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.295+0000 7f4a8be00640 1 --2- 172.21.15.37:0/1417637138 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a700b3c50 0x7f4a700b6110 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009710 tx=0x7f4a7c006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.296+0000 7f4a88c00640 1 -- 172.21.15.37:0/1417637138 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4a84016030 con 0x7f4a8c10f470 2024-08-20T05:03:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.737+0000 7f4a92c00640 1 -- 172.21.15.37:0/1417637138 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a8c082d00 con 0x7f4a8c10f470 2024-08-20T05:03:42.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.738+0000 7f4a88c00640 1 -- 172.21.15.37:0/1417637138 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11987 (secure 0 0 0) 0x7f4a840cd070 con 0x7f4a8c10f470 2024-08-20T05:03:42.741 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:03:42.741 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":33,"btime":"2024-08-20T05:03:11:706710+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:03:11.271814+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:03:42.741 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 33 2024-08-20T05:03:42.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.743+0000 7f4a92c00640 1 -- 172.21.15.37:0/1417637138 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a700b3c50 msgr2=0x7f4a700b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:42.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.743+0000 7f4a92c00640 1 --2- 172.21.15.37:0/1417637138 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a700b3c50 0x7f4a700b6110 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4a7c009710 tx=0x7f4a7c006c90 comp rx=0 tx=0).stop 2024-08-20T05:03:42.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.743+0000 7f4a92c00640 1 -- 172.21.15.37:0/1417637138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a8c10f470 msgr2=0x7f4a8c07c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:42.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.743+0000 7f4a92c00640 1 --2- 172.21.15.37:0/1417637138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a8c10f470 0x7f4a8c07c670 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400eaa0 tx=0x7f4a8400ef60 comp rx=0 tx=0).stop 2024-08-20T05:03:42.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.744+0000 7f4a92c00640 1 -- 172.21.15.37:0/1417637138 shutdown_connections 2024-08-20T05:03:42.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.744+0000 7f4a92c00640 1 --2- 172.21.15.37:0/1417637138 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4a700b3c50 0x7f4a700b6110 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:42.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.744+0000 7f4a92c00640 1 --2- 172.21.15.37:0/1417637138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4a8c10f470 0x7f4a8c07c670 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:42.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.744+0000 7f4a92c00640 1 --2- 172.21.15.37:0/1417637138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4a8c10eaf0 0x7f4a8c083830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:42.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.744+0000 7f4a92c00640 1 --2- 172.21.15.37:0/1417637138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a8c1090e0 0x7f4a8c0832f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:42.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.744+0000 7f4a92c00640 1 -- 172.21.15.37:0/1417637138 >> 172.21.15.37:0/1417637138 conn(0x7f4a8c078760 msgr2=0x7f4a8c07ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:42.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.745+0000 7f4a92c00640 1 -- 172.21.15.37:0/1417637138 shutdown_connections 2024-08-20T05:03:42.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:42.745+0000 7f4a92c00640 1 -- 172.21.15.37:0/1417637138 wait complete. 2024-08-20T05:03:43.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 45.0 s, 2737.6 tps, lat 36.323 ms stddev 37.607 2024-08-20T05:03:43.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:43 smithi130 ceph-mon[22007]: pgmap v445: 129 pgs: 129 active+clean; 992 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.5 MiB/s wr, 719 op/s 2024-08-20T05:03:43.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:43 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1417637138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:03:43.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:43 smithi037 ceph-mon[17265]: pgmap v445: 129 pgs: 129 active+clean; 992 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.5 MiB/s wr, 719 op/s 2024-08-20T05:03:43.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:43 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1417637138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:03:43.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:43 smithi135 ceph-mon[22342]: pgmap v445: 129 pgs: 129 active+clean; 992 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 8.5 MiB/s wr, 719 op/s 2024-08-20T05:03:43.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:43 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1417637138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:03:43.712 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-08-20T05:03:43.713 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-08-20T05:03:45.179 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:03:45.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:45 smithi130 ceph-mon[22007]: pgmap v446: 129 pgs: 129 active+clean; 997 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.9 MiB/s wr, 666 op/s 2024-08-20T05:03:45.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:45 smithi037 ceph-mon[17265]: pgmap v446: 129 pgs: 129 active+clean; 997 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.9 MiB/s wr, 666 op/s 2024-08-20T05:03:45.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:45 smithi135 ceph-mon[22342]: pgmap v446: 129 pgs: 129 active+clean; 997 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.9 MiB/s wr, 666 op/s 2024-08-20T05:03:47.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:47 smithi130 ceph-mon[22007]: pgmap v447: 129 pgs: 129 active+clean; 1001 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.4 MiB/s wr, 730 op/s 2024-08-20T05:03:47.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:47 smithi037 ceph-mon[17265]: pgmap v447: 129 pgs: 129 active+clean; 1001 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.4 MiB/s wr, 730 op/s 2024-08-20T05:03:47.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:47 smithi135 ceph-mon[22342]: pgmap v447: 129 pgs: 129 active+clean; 1001 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.4 MiB/s wr, 730 op/s 2024-08-20T05:03:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 50.0 s, 1968.8 tps, lat 50.660 ms stddev 63.988 2024-08-20T05:03:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.288+0000 7f2273e00640 1 -- 172.21.15.37:0/2680854305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2274077d20 msgr2=0x7f2274112fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.288+0000 7f2273e00640 1 --2- 172.21.15.37:0/2680854305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2274077d20 0x7f2274112fc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2260009900 tx=0x7f226002a410 comp rx=0 tx=0).stop 2024-08-20T05:03:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.289+0000 7f2273e00640 1 -- 172.21.15.37:0/2680854305 shutdown_connections 2024-08-20T05:03:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.289+0000 7f2273e00640 1 --2- 172.21.15.37:0/2680854305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2274113500 0x7f22741158f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.289+0000 7f2273e00640 1 --2- 172.21.15.37:0/2680854305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2274077d20 0x7f2274112fc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.289+0000 7f2273e00640 1 --2- 172.21.15.37:0/2680854305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2274077400 0x7f22740777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.289+0000 7f2273e00640 1 -- 172.21.15.37:0/2680854305 >> 172.21.15.37:0/2680854305 conn(0x7f2274100540 msgr2=0x7f2274102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.289+0000 7f2273e00640 1 -- 172.21.15.37:0/2680854305 shutdown_connections 2024-08-20T05:03:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.289+0000 7f2273e00640 1 -- 172.21.15.37:0/2680854305 wait complete. 2024-08-20T05:03:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.290+0000 7f2273e00640 1 Processor -- start 2024-08-20T05:03:49.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.291+0000 7f2273e00640 1 -- start start 2024-08-20T05:03:49.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.291+0000 7f2273e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2274077400 0x7f227419f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.291+0000 7f2273e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2274077d20 0x7f227419f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.291+0000 7f2273e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2274113500 0x7f22741a4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.291+0000 7f2273e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2274118f30 con 0x7f2274077d20 2024-08-20T05:03:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.291+0000 7f2273e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2274118db0 con 0x7f2274077400 2024-08-20T05:03:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.291+0000 7f2273e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22741190b0 con 0x7f2274113500 2024-08-20T05:03:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.292+0000 7f2272a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2274077400 0x7f227419f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.292+0000 7f2272a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2274077400 0x7f227419f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43702/0 (socket says 172.21.15.37:43702) 2024-08-20T05:03:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.292+0000 7f2272a00640 1 -- 172.21.15.37:0/4005154912 learned_addr learned my addr 172.21.15.37:0/4005154912 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.292+0000 7f2273400640 1 --2- 172.21.15.37:0/4005154912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2274113500 0x7f22741a4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.293+0000 7f2272000640 1 --2- 172.21.15.37:0/4005154912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2274077d20 0x7f227419f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.293+0000 7f2272a00640 1 -- 172.21.15.37:0/4005154912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2274113500 msgr2=0x7f22741a4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.293+0000 7f2272a00640 1 --2- 172.21.15.37:0/4005154912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2274113500 0x7f22741a4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.293+0000 7f2272a00640 1 -- 172.21.15.37:0/4005154912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2274077d20 msgr2=0x7f227419f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.293+0000 7f2272a00640 1 --2- 172.21.15.37:0/4005154912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2274077d20 0x7f227419f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.293+0000 7f2272a00640 1 -- 172.21.15.37:0/4005154912 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22741a53f0 con 0x7f2274077400 2024-08-20T05:03:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.293+0000 7f2272000640 1 --2- 172.21.15.37:0/4005154912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2274077d20 0x7f227419f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:03:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.293+0000 7f2273400640 1 --2- 172.21.15.37:0/4005154912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2274113500 0x7f22741a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.294+0000 7f2272a00640 1 --2- 172.21.15.37:0/4005154912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2274077400 0x7f227419f340 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f226400e9f0 tx=0x7f226400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.294+0000 7f226b400640 1 -- 172.21.15.37:0/4005154912 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226400cd80 con 0x7f2274077400 2024-08-20T05:03:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.294+0000 7f226b400640 1 -- 172.21.15.37:0/4005154912 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22640108e0 con 0x7f2274077400 2024-08-20T05:03:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.294+0000 7f226b400640 1 -- 172.21.15.37:0/4005154912 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264018980 con 0x7f2274077400 2024-08-20T05:03:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.294+0000 7f2273e00640 1 -- 172.21.15.37:0/4005154912 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22741a56e0 con 0x7f2274077400 2024-08-20T05:03:49.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.294+0000 7f2273e00640 1 -- 172.21.15.37:0/4005154912 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22741abda0 con 0x7f2274077400 2024-08-20T05:03:49.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.298+0000 7f226b400640 1 -- 172.21.15.37:0/4005154912 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2264010430 con 0x7f2274077400 2024-08-20T05:03:49.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.301+0000 7f226b400640 1 --2- 172.21.15.37:0/4005154912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22580b3cf0 0x7f22580b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.301+0000 7f226b400640 1 -- 172.21.15.37:0/4005154912 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f22640e4330 con 0x7f2274077400 2024-08-20T05:03:49.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.302+0000 7f227c4ae740 1 Processor -- start 2024-08-20T05:03:49.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.302+0000 7f227c4ae740 1 -- start start 2024-08-20T05:03:49.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.302+0000 7f227c4ae740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39a75d0 0x5642d39a79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.302+0000 7f2272000640 1 --2- 172.21.15.37:0/4005154912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22580b3cf0 0x7f22580b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:49.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.302+0000 7f227c4ae740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a7ef0 0x5642d39c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.302+0000 7f227c4ae740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39c4e90 0x5642d39c7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.303+0000 7f227c4ae740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5642d3947670 con 0x5642d39a75d0 2024-08-20T05:03:49.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.303+0000 7f227c4ae740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5642d391b7c0 con 0x5642d39a7ef0 2024-08-20T05:03:49.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.303+0000 7f227c4ae740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5642d390acc0 con 0x5642d39c4e90 2024-08-20T05:03:49.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.303+0000 7f2273400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39c4e90 0x5642d39c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:49.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.303+0000 7f2272000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a7ef0 0x5642d39c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:49.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.303+0000 7f2273400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39c4e90 0x5642d39c7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34916/0 (socket says 172.21.15.37:34916) 2024-08-20T05:03:49.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.303+0000 7f2273400640 1 -- 172.21.15.37:0/2739291810 learned_addr learned my addr 172.21.15.37:0/2739291810 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:49.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.303+0000 7f2273400640 1 -- 172.21.15.37:0/2739291810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a7ef0 msgr2=0x5642d39c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:49.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.303+0000 7f2273400640 1 --2- 172.21.15.37:0/2739291810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a7ef0 0x5642d39c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.303+0000 7f2273400640 1 -- 172.21.15.37:0/2739291810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39a75d0 msgr2=0x5642d39a79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:49.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.303+0000 7f2273400640 1 --2- 172.21.15.37:0/2739291810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39a75d0 0x5642d39a79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.303+0000 7f2273400640 1 -- 172.21.15.37:0/2739291810 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d389e110 con 0x5642d39c4e90 2024-08-20T05:03:49.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.304+0000 7f2273400640 1 --2- 172.21.15.37:0/2739291810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39c4e90 0x5642d39c7280 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f226c010770 tx=0x7f226c010c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7094ef1241654e93 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:49.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.304+0000 7f225fe00640 1 -- 172.21.15.37:0/2739291810 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c00ead0 con 0x5642d39c4e90 2024-08-20T05:03:49.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.304+0000 7f225fe00640 1 -- 172.21.15.37:0/2739291810 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f226c010e80 con 0x5642d39c4e90 2024-08-20T05:03:49.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.304+0000 7f225fe00640 1 -- 172.21.15.37:0/2739291810 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c01c450 con 0x5642d39c4e90 2024-08-20T05:03:49.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.305+0000 7f227c4ae740 1 -- 172.21.15.37:0/2739291810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39c4e90 msgr2=0x5642d39c7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:49.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.305+0000 7f227c4ae740 1 --2- 172.21.15.37:0/2739291810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39c4e90 0x5642d39c7280 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f226c010770 tx=0x7f226c010c30 comp rx=0 tx=0).stop 2024-08-20T05:03:49.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.305+0000 7f227c4ae740 1 -- 172.21.15.37:0/2739291810 shutdown_connections 2024-08-20T05:03:49.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.305+0000 7f227c4ae740 1 --2- 172.21.15.37:0/2739291810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39c4e90 0x5642d39c7280 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.305+0000 7f227c4ae740 1 --2- 172.21.15.37:0/2739291810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a7ef0 0x5642d39c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.305+0000 7f227c4ae740 1 --2- 172.21.15.37:0/2739291810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39a75d0 0x5642d39a79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.305+0000 7f227c4ae740 1 -- 172.21.15.37:0/2739291810 >> 172.21.15.37:0/2739291810 conn(0x5642d39a5400 msgr2=0x5642d39a65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:49.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.305+0000 7f227c4ae740 1 -- 172.21.15.37:0/2739291810 shutdown_connections 2024-08-20T05:03:49.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.305+0000 7f227c4ae740 1 -- 172.21.15.37:0/2739291810 wait complete. 2024-08-20T05:03:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.306+0000 7f227c4ae740 1 -- start start 2024-08-20T05:03:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.306+0000 7f227c4ae740 1 Processor -- start 2024-08-20T05:03:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.306+0000 7f227c4ae740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a75d0 0x5642d39c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.306+0000 7f227c4ae740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39a7ef0 0x5642d39c2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.306+0000 7f227c4ae740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39c4e90 0x5642d39c29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.306+0000 7f227c4ae740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5642d38b0780 con 0x5642d39c4e90 2024-08-20T05:03:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.306+0000 7f227c4ae740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5642d390ed00 con 0x5642d39a75d0 2024-08-20T05:03:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.306+0000 7f227c4ae740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5642d376d7a0 con 0x5642d39a7ef0 2024-08-20T05:03:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.307+0000 7f227c4ae740 10 client.0 _ll_register_callbacks cb 0x5642d38b8940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.307+0000 7f2272a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a75d0 0x5642d39c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.307+0000 7f2272a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a75d0 0x5642d39c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43726/0 (socket says 172.21.15.37:43726) 2024-08-20T05:03:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.307+0000 7f2272a00640 1 -- 172.21.15.37:0/2464524844 learned_addr learned my addr 172.21.15.37:0/2464524844 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.307+0000 7f2272a00640 1 -- 172.21.15.37:0/2464524844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39a7ef0 msgr2=0x5642d39c2490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:03:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.307+0000 7f2272a00640 1 --2- 172.21.15.37:0/2464524844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39a7ef0 0x5642d39c2490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.307+0000 7f2272a00640 1 -- 172.21.15.37:0/2464524844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39c4e90 msgr2=0x5642d39c29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.307+0000 7f2272a00640 1 --2- 172.21.15.37:0/2464524844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39c4e90 0x5642d39c29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.307+0000 7f2272a00640 1 -- 172.21.15.37:0/2464524844 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642d38bd9c0 con 0x5642d39a75d0 2024-08-20T05:03:49.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.307+0000 7f2272000640 1 --2- 172.21.15.37:0/4005154912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22580b3cf0 0x7f22580b61b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2260033040 tx=0x7f2260000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.308+0000 7f2272a00640 1 --2- 172.21.15.37:0/2464524844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a75d0 0x5642d39c1f50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f22640a6f00 tx=0x7f2264010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92f8d2c9cfccaeb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.308+0000 7f225cc00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:03:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.308+0000 7f225cc00640 1 -- 172.21.15.37:0/2464524844 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22640af480 con 0x5642d39a75d0 2024-08-20T05:03:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.308+0000 7f225cc00640 1 -- 172.21.15.37:0/2464524844 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f22640aa0e0 con 0x5642d39a75d0 2024-08-20T05:03:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.308+0000 7f227c4ae740 1 -- 172.21.15.37:0/2464524844 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5642d391d710 con 0x5642d39a75d0 2024-08-20T05:03:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.308+0000 7f225cc00640 1 -- 172.21.15.37:0/2464524844 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f22640c5050 con 0x5642d39a75d0 2024-08-20T05:03:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.308+0000 7f227c4ae740 10 client.25874 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.308+0000 7f227c4ae740 1 -- 172.21.15.37:0/2464524844 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5642d3679b90 con 0x5642d39a75d0 2024-08-20T05:03:49.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.308+0000 7f225cc00640 1 -- 172.21.15.37:0/2464524844 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5642d391d710 con 0x5642d39a75d0 2024-08-20T05:03:49.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.309+0000 7f225cc00640 1 -- 172.21.15.37:0/2464524844 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f22640a67f0 con 0x5642d39a75d0 2024-08-20T05:03:49.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.309+0000 7f227c4ae740 10 client.25874 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:49.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.309+0000 7f227c4ae740 10 client.25874 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:03:49.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.309+0000 7f227c4ae740 20 client.25874 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:49.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.310+0000 7f227c4ae740 1 --2- 172.21.15.37:0/2464524844 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5642d39d4a90 0x5642d39d6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.310+0000 7f227c4ae740 4 client.25874 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:03:49.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.310+0000 7f227c4ae740 1 -- 172.21.15.37:0/2464524844 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642d39191b0 con 0x5642d39d4a90 2024-08-20T05:03:49.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.310+0000 7f2272000640 1 --2- 172.21.15.37:0/2464524844 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5642d39d4a90 0x5642d39d6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:49.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.310+0000 7f225cc00640 10 client.25874 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:49.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.310+0000 7f2272000640 1 --2- 172.21.15.37:0/2464524844 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5642d39d4a90 0x5642d39d6ed0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf34df19d3759cd6 server_cookie=437c69aaac0a169b in_seq=0 out_seq=0 2024-08-20T05:03:49.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.311+0000 7f225cc00640 1 -- 172.21.15.37:0/2464524844 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5642d39191b0 con 0x5642d39d4a90 2024-08-20T05:03:49.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.311+0000 7f225cc00640 10 client.25874 handle_command_reply: tid=0 2024-08-20T05:03:49.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.311+0000 7f227c4ae740 1 client.25874 shutdown 2024-08-20T05:03:49.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.312+0000 7f227c4ae740 1 -- 172.21.15.37:0/2464524844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a75d0 msgr2=0x5642d39c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:49.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.312+0000 7f227c4ae740 1 --2- 172.21.15.37:0/2464524844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a75d0 0x5642d39c1f50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f22640a6f00 tx=0x7f2264010860 comp rx=0 tx=0).stop 2024-08-20T05:03:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.312+0000 7f227c4ae740 1 -- 172.21.15.37:0/2464524844 shutdown_connections 2024-08-20T05:03:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.312+0000 7f227c4ae740 1 --2- 172.21.15.37:0/2464524844 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5642d39d4a90 0x5642d39d6ed0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.312+0000 7f227c4ae740 1 --2- 172.21.15.37:0/2464524844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39c4e90 0x5642d39c29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.312+0000 7f227c4ae740 1 --2- 172.21.15.37:0/2464524844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39a7ef0 0x5642d39c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.312+0000 7f227c4ae740 1 --2- 172.21.15.37:0/2464524844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a75d0 0x5642d39c1f50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.312+0000 7f227c4ae740 1 -- 172.21.15.37:0/2464524844 >> 172.21.15.37:0/2464524844 conn(0x5642d39a5400 msgr2=0x5642d39aaf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.312+0000 7f225cc00640 0 client.25874 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:49.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.312+0000 7f227c4ae740 1 -- 172.21.15.37:0/2464524844 shutdown_connections 2024-08-20T05:03:49.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.312+0000 7f227c4ae740 1 -- 172.21.15.37:0/2464524844 wait complete. 2024-08-20T05:03:49.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.312+0000 7f227c4ae740 20 client.25874 trim_cache size 0 max 16384 2024-08-20T05:03:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.350+0000 7f227c4ae740 1 Processor -- start 2024-08-20T05:03:49.353 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:49 smithi037 ceph-mon[17265]: pgmap v448: 129 pgs: 129 active+clean; 1001 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.9 MiB/s wr, 669 op/s 2024-08-20T05:03:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.351+0000 7f227c4ae740 1 -- start start 2024-08-20T05:03:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.352+0000 7f227c4ae740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39a75d0 0x5642d39c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.352+0000 7f227c4ae740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a7ef0 0x5642d39bf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.352+0000 7f227c4ae740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39c4e90 0x5642d39aae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.352+0000 7f227c4ae740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f22741ad3d0 con 0x5642d39c4e90 2024-08-20T05:03:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.352+0000 7f227c4ae740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f22741aefd0 con 0x5642d39a7ef0 2024-08-20T05:03:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.352+0000 7f227c4ae740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22741adaa0 con 0x5642d39a75d0 2024-08-20T05:03:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.352+0000 7f2272a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39a75d0 0x5642d39c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.352+0000 7f2272a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39a75d0 0x5642d39c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34938/0 (socket says 172.21.15.37:34938) 2024-08-20T05:03:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.352+0000 7f2272a00640 1 -- 172.21.15.37:0/1114644411 learned_addr learned my addr 172.21.15.37:0/1114644411 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.352+0000 7f2272000640 1 --2- 172.21.15.37:0/1114644411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a7ef0 0x5642d39bf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.353+0000 7f2272a00640 1 -- 172.21.15.37:0/1114644411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a7ef0 msgr2=0x5642d39bf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.353+0000 7f2272a00640 1 --2- 172.21.15.37:0/1114644411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a7ef0 0x5642d39bf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.353+0000 7f2272a00640 1 -- 172.21.15.37:0/1114644411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39c4e90 msgr2=0x5642d39aae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.353+0000 7f2272a00640 1 --2- 172.21.15.37:0/1114644411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39c4e90 0x5642d39aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.353+0000 7f2272a00640 1 -- 172.21.15.37:0/1114644411 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642d39c0ed0 con 0x5642d39a75d0 2024-08-20T05:03:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.353+0000 7f2272a00640 1 --2- 172.21.15.37:0/1114644411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39a75d0 0x5642d39c54b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f22640aae10 tx=0x7f226400cf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3a845828a39ab4a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.354+0000 7f225f400640 1 -- 172.21.15.37:0/1114644411 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22640ca080 con 0x5642d39a75d0 2024-08-20T05:03:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.354+0000 7f225f400640 1 -- 172.21.15.37:0/1114644411 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22640ab580 con 0x5642d39a75d0 2024-08-20T05:03:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.354+0000 7f225f400640 1 -- 172.21.15.37:0/1114644411 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22640a9ba0 con 0x5642d39a75d0 2024-08-20T05:03:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.354+0000 7f227c4ae740 1 -- 172.21.15.37:0/1114644411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39a75d0 msgr2=0x5642d39c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.354+0000 7f227c4ae740 1 --2- 172.21.15.37:0/1114644411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39a75d0 0x5642d39c54b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f22640aae10 tx=0x7f226400cf20 comp rx=0 tx=0).stop 2024-08-20T05:03:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.355+0000 7f227c4ae740 1 -- 172.21.15.37:0/1114644411 shutdown_connections 2024-08-20T05:03:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.355+0000 7f227c4ae740 1 --2- 172.21.15.37:0/1114644411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39c4e90 0x5642d39aae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.355+0000 7f227c4ae740 1 --2- 172.21.15.37:0/1114644411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a7ef0 0x5642d39bf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.355+0000 7f227c4ae740 1 --2- 172.21.15.37:0/1114644411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39a75d0 0x5642d39c54b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.355+0000 7f227c4ae740 1 -- 172.21.15.37:0/1114644411 >> 172.21.15.37:0/1114644411 conn(0x5642d39a5400 msgr2=0x5642d39aa710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.355+0000 7f227c4ae740 1 -- 172.21.15.37:0/1114644411 shutdown_connections 2024-08-20T05:03:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.355+0000 7f227c4ae740 1 -- 172.21.15.37:0/1114644411 wait complete. 2024-08-20T05:03:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.356+0000 7f227c4ae740 1 -- start start 2024-08-20T05:03:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.356+0000 7f227c4ae740 1 Processor -- start 2024-08-20T05:03:49.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.358+0000 7f227c4ae740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a75d0 0x5642d39cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.359+0000 7f227c4ae740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39a7ef0 0x5642d39cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.359+0000 7f227c4ae740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39c4e90 0x5642d39c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.359+0000 7f2273400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39c4e90 0x5642d39c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.359+0000 7f2273400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39c4e90 0x5642d39c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47664/0 (socket says 172.21.15.37:47664) 2024-08-20T05:03:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.360+0000 7f2272a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a75d0 0x5642d39cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.360+0000 7f2272a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a75d0 0x5642d39cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43750/0 (socket says 172.21.15.37:43750) 2024-08-20T05:03:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.360+0000 7f2273400640 1 -- 172.21.15.37:0/4283992570 learned_addr learned my addr 172.21.15.37:0/4283992570 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.360+0000 7f227c4ae740 1 -- 172.21.15.37:0/4283992570 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f22741ae840 con 0x5642d39c4e90 2024-08-20T05:03:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.360+0000 7f227c4ae740 1 -- 172.21.15.37:0/4283992570 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f22741ae170 con 0x5642d39a75d0 2024-08-20T05:03:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.360+0000 7f227c4ae740 1 -- 172.21.15.37:0/4283992570 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22741a0470 con 0x5642d39a7ef0 2024-08-20T05:03:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.360+0000 7f2272000640 1 --2- 172.21.15.37:0/4283992570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39a7ef0 0x5642d39cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.361+0000 7f227c4ae740 10 client.0 _ll_register_callbacks cb 0x7f2264009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.362+0000 7f2272a00640 1 -- 172.21.15.37:0/4283992570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39a7ef0 msgr2=0x5642d39cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.362+0000 7f2272a00640 1 --2- 172.21.15.37:0/4283992570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39a7ef0 0x5642d39cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.362+0000 7f2272a00640 1 -- 172.21.15.37:0/4283992570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39c4e90 msgr2=0x5642d39c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.362+0000 7f2272a00640 1 --2- 172.21.15.37:0/4283992570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39c4e90 0x5642d39c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.362+0000 7f2272a00640 1 -- 172.21.15.37:0/4283992570 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642d39dd340 con 0x5642d39a75d0 2024-08-20T05:03:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.363+0000 7f2272000640 1 --2- 172.21.15.37:0/4283992570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39a7ef0 0x5642d39cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:03:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.363+0000 7f2272a00640 1 --2- 172.21.15.37:0/4283992570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a75d0 0x5642d39cccf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f22640a6f00 tx=0x7f22640aa390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3377d1b930f50291 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:49.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.363+0000 7f225cc00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:03:49.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.364+0000 7f225cc00640 1 -- 172.21.15.37:0/4283992570 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22640ca070 con 0x5642d39a75d0 2024-08-20T05:03:49.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.364+0000 7f225cc00640 1 -- 172.21.15.37:0/4283992570 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f22640a7470 con 0x5642d39a75d0 2024-08-20T05:03:49.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.365+0000 7f227c4ae740 1 -- 172.21.15.37:0/4283992570 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22640ab580 con 0x5642d39a75d0 2024-08-20T05:03:49.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.365+0000 7f225cc00640 1 -- 172.21.15.37:0/4283992570 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f22640af480 con 0x5642d39a75d0 2024-08-20T05:03:49.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.365+0000 7f227c4ae740 10 client.25880 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:49.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.365+0000 7f227c4ae740 1 -- 172.21.15.37:0/4283992570 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5642d3a3fcd0 con 0x5642d39a75d0 2024-08-20T05:03:49.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.366+0000 7f225cc00640 1 -- 172.21.15.37:0/4283992570 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22640ab580 con 0x5642d39a75d0 2024-08-20T05:03:49.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.366+0000 7f225cc00640 1 -- 172.21.15.37:0/4283992570 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f22640b0820 con 0x5642d39a75d0 2024-08-20T05:03:49.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.366+0000 7f227c4ae740 10 client.25880 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:49.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.366+0000 7f227c4ae740 10 client.25880 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:03:49.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.366+0000 7f227c4ae740 20 client.25880 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:49.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.366+0000 7f227c4ae740 1 --2- 172.21.15.37:0/4283992570 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5642d3a402a0 0x5642d3a426c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:49.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.367+0000 7f227c4ae740 4 client.25880 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-08-20T05:03:49.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.367+0000 7f227c4ae740 1 -- 172.21.15.37:0/4283992570 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x5642d39168f0 con 0x5642d3a402a0 2024-08-20T05:03:49.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.367+0000 7f2272000640 1 --2- 172.21.15.37:0/4283992570 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5642d3a402a0 0x5642d3a426c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:49.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.369+0000 7f2272000640 1 --2- 172.21.15.37:0/4283992570 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5642d3a402a0 0x5642d3a426c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40f3ad357813798a server_cookie=b8c31f754183032d in_seq=0 out_seq=0 2024-08-20T05:03:49.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.369+0000 7f225cc00640 10 client.25880 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:49.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:49 smithi130 ceph-mon[22007]: pgmap v448: 129 pgs: 129 active+clean; 1001 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.9 MiB/s wr, 669 op/s 2024-08-20T05:03:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.521+0000 7f225cc00640 1 -- 172.21.15.37:0/4283992570 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5642d39168f0 con 0x5642d3a402a0 2024-08-20T05:03:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.521+0000 7f225cc00640 10 client.25880 handle_command_reply: tid=0 2024-08-20T05:03:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.521+0000 7f227c4ae740 1 client.25880 shutdown 2024-08-20T05:03:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.521+0000 7f227c4ae740 1 -- 172.21.15.37:0/4283992570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a75d0 msgr2=0x5642d39cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.521+0000 7f227c4ae740 1 --2- 172.21.15.37:0/4283992570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a75d0 0x5642d39cccf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f22640a6f00 tx=0x7f22640aa390 comp rx=0 tx=0).stop 2024-08-20T05:03:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.521+0000 7f227c4ae740 1 -- 172.21.15.37:0/4283992570 shutdown_connections 2024-08-20T05:03:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.521+0000 7f227c4ae740 1 --2- 172.21.15.37:0/4283992570 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5642d3a402a0 0x5642d3a426c0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.521+0000 7f227c4ae740 1 --2- 172.21.15.37:0/4283992570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642d39c4e90 0x5642d39c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.521+0000 7f227c4ae740 1 --2- 172.21.15.37:0/4283992570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642d39a7ef0 0x5642d39cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.521+0000 7f227c4ae740 1 --2- 172.21.15.37:0/4283992570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642d39a75d0 0x5642d39cccf0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.521+0000 7f225cc00640 0 client.25880 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.521+0000 7f227c4ae740 1 -- 172.21.15.37:0/4283992570 >> 172.21.15.37:0/4283992570 conn(0x5642d39a5400 msgr2=0x5642d39c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.521+0000 7f227c4ae740 1 -- 172.21.15.37:0/4283992570 shutdown_connections 2024-08-20T05:03:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.522+0000 7f227c4ae740 1 -- 172.21.15.37:0/4283992570 wait complete. 2024-08-20T05:03:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.522+0000 7f227c4ae740 20 client.25880 trim_cache size 0 max 16384 2024-08-20T05:03:49.525 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:03:49.526 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-08-20T05:03:49.526 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:03:49.526 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 6, 2024-08-20T05:03:49.526 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:03:49.526 INFO:teuthology.orchestra.run.smithi037.stdout: "2ba15856": { 2024-08-20T05:03:49.526 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 6, 2024-08-20T05:03:49.526 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:03:49.526 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:03:49.526 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:03:49.526 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:03:49.526 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:03:49.526 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:03:49.527 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 130.0, 2024-08-20T05:03:49.527 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:03:49.527 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:03:49.527 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:03:49.527 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:03:49.527 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:03:49.527 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:03:49.527 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:49.527 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:49.527 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:49.527 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:49.527 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:49.527 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:03:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.522+0000 7f2273e00640 1 -- 172.21.15.37:0/4005154912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22580b3cf0 msgr2=0x7f22580b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.522+0000 7f2273e00640 1 --2- 172.21.15.37:0/4005154912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22580b3cf0 0x7f22580b61b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2260033040 tx=0x7f2260000bc0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.522+0000 7f2273e00640 1 -- 172.21.15.37:0/4005154912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2274077400 msgr2=0x7f227419f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.522+0000 7f2273e00640 1 --2- 172.21.15.37:0/4005154912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2274077400 0x7f227419f340 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f226400e9f0 tx=0x7f226400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.523+0000 7f2273e00640 1 -- 172.21.15.37:0/4005154912 shutdown_connections 2024-08-20T05:03:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.523+0000 7f2273e00640 1 --2- 172.21.15.37:0/4005154912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22580b3cf0 0x7f22580b61b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.523+0000 7f2273e00640 1 --2- 172.21.15.37:0/4005154912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2274113500 0x7f22741a4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.523+0000 7f2273e00640 1 --2- 172.21.15.37:0/4005154912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2274077d20 0x7f227419f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.523+0000 7f2273e00640 1 --2- 172.21.15.37:0/4005154912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2274077400 0x7f227419f340 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:49.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.523+0000 7f2273e00640 1 -- 172.21.15.37:0/4005154912 >> 172.21.15.37:0/4005154912 conn(0x7f2274100540 msgr2=0x7f2274102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:49.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.523+0000 7f2273e00640 1 -- 172.21.15.37:0/4005154912 shutdown_connections 2024-08-20T05:03:49.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:49.523+0000 7f2273e00640 1 -- 172.21.15.37:0/4005154912 wait complete. 2024-08-20T05:03:49.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:49 smithi135 ceph-mon[22342]: pgmap v448: 129 pgs: 129 active+clean; 1001 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 8.9 MiB/s wr, 669 op/s 2024-08-20T05:03:50.457 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '2ba15856', quiesce took 9.6 seconds. Will release after: 0.40000000000000036 2024-08-20T05:03:50.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:03:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:03:51.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:51 smithi130 ceph-mon[22007]: pgmap v449: 129 pgs: 129 active+clean; 991 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 12 MiB/s wr, 789 op/s 2024-08-20T05:03:51.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:51 smithi037 ceph-mon[17265]: pgmap v449: 129 pgs: 129 active+clean; 991 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 12 MiB/s wr, 789 op/s 2024-08-20T05:03:51.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:51 smithi135 ceph-mon[22342]: pgmap v449: 129 pgs: 129 active+clean; 991 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 12 MiB/s wr, 789 op/s 2024-08-20T05:03:52.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.485+0000 7f2295200640 1 -- 172.21.15.37:0/1651798211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2290077400 msgr2=0x7f22900777e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.485+0000 7f2295200640 1 --2- 172.21.15.37:0/1651798211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2290077400 0x7f22900777e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2280009900 tx=0x7f228002a410 comp rx=0 tx=0).stop 2024-08-20T05:03:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.485+0000 7f2295200640 1 -- 172.21.15.37:0/1651798211 shutdown_connections 2024-08-20T05:03:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.485+0000 7f2295200640 1 --2- 172.21.15.37:0/1651798211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2290113690 0x7f2290115a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.485+0000 7f2295200640 1 --2- 172.21.15.37:0/1651798211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2290077d20 0x7f2290113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.485+0000 7f2295200640 1 --2- 172.21.15.37:0/1651798211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2290077400 0x7f22900777e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.485+0000 7f2295200640 1 -- 172.21.15.37:0/1651798211 >> 172.21.15.37:0/1651798211 conn(0x7f2290100730 msgr2=0x7f2290102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.485+0000 7f2295200640 1 -- 172.21.15.37:0/1651798211 shutdown_connections 2024-08-20T05:03:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.485+0000 7f2295200640 1 -- 172.21.15.37:0/1651798211 wait complete. 2024-08-20T05:03:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.486+0000 7f2295200640 1 Processor -- start 2024-08-20T05:03:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.487+0000 7f2295200640 1 -- start start 2024-08-20T05:03:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.487+0000 7f2295200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2290077400 0x7f229019f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.487+0000 7f2295200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2290077d20 0x7f229019fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.487+0000 7f2295200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2290113690 0x7f22901a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.487+0000 7f2295200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f22901190d0 con 0x7f2290077d20 2024-08-20T05:03:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.487+0000 7f2295200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2290118f50 con 0x7f2290113690 2024-08-20T05:03:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.487+0000 7f2295200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2290119250 con 0x7f2290077400 2024-08-20T05:03:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.487+0000 7f228de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2290077400 0x7f229019f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.487+0000 7f228d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2290077d20 0x7f229019fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.487+0000 7f228de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2290077400 0x7f229019f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34964/0 (socket says 172.21.15.37:34964) 2024-08-20T05:03:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.487+0000 7f228d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2290077d20 0x7f229019fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47680/0 (socket says 172.21.15.37:47680) 2024-08-20T05:03:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.487+0000 7f228de00640 1 -- 172.21.15.37:0/4059179060 learned_addr learned my addr 172.21.15.37:0/4059179060 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.488+0000 7f228e800640 1 --2- 172.21.15.37:0/4059179060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2290113690 0x7f22901a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.488+0000 7f228de00640 1 -- 172.21.15.37:0/4059179060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2290113690 msgr2=0x7f22901a4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.488+0000 7f228de00640 1 --2- 172.21.15.37:0/4059179060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2290113690 0x7f22901a4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.488+0000 7f228de00640 1 -- 172.21.15.37:0/4059179060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2290077d20 msgr2=0x7f229019fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.488+0000 7f228de00640 1 --2- 172.21.15.37:0/4059179060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2290077d20 0x7f229019fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.488+0000 7f228de00640 1 -- 172.21.15.37:0/4059179060 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22901a5650 con 0x7f2290077400 2024-08-20T05:03:52.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.488+0000 7f228d400640 1 --2- 172.21.15.37:0/4059179060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2290077d20 0x7f229019fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:52.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.488+0000 7f228de00640 1 --2- 172.21.15.37:0/4059179060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2290077400 0x7f229019f5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2280005ab0 tx=0x7f2280003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:52.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.488+0000 7f2286a00640 1 -- 172.21.15.37:0/4059179060 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228003f070 con 0x7f2290077400 2024-08-20T05:03:52.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.489+0000 7f2286a00640 1 -- 172.21.15.37:0/4059179060 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2280031b60 con 0x7f2290077400 2024-08-20T05:03:52.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.489+0000 7f2295200640 1 -- 172.21.15.37:0/4059179060 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22901a58e0 con 0x7f2290077400 2024-08-20T05:03:52.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.489+0000 7f2286a00640 1 -- 172.21.15.37:0/4059179060 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2280035030 con 0x7f2290077400 2024-08-20T05:03:52.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.489+0000 7f2295200640 1 -- 172.21.15.37:0/4059179060 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22901ac000 con 0x7f2290077400 2024-08-20T05:03:52.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.490+0000 7f2295200640 1 -- 172.21.15.37:0/4059179060 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22900777e0 con 0x7f2290077400 2024-08-20T05:03:52.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.492+0000 7f2286a00640 1 -- 172.21.15.37:0/4059179060 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2280042070 con 0x7f2290077400 2024-08-20T05:03:52.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.494+0000 7f2286a00640 1 --2- 172.21.15.37:0/4059179060 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22740b3bd0 0x7f22740b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.494+0000 7f2286a00640 1 -- 172.21.15.37:0/4059179060 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2280104b10 con 0x7f2290077400 2024-08-20T05:03:52.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.494+0000 7f228d400640 1 --2- 172.21.15.37:0/4059179060 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22740b3bd0 0x7f22740b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.495+0000 7f228d400640 1 --2- 172.21.15.37:0/4059179060 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22740b3bd0 0x7f22740b6090 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f227c0095f0 tx=0x7f227c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:52.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.495+0000 7f2286a00640 1 -- 172.21.15.37:0/4059179060 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f22800cb710 con 0x7f2290077400 2024-08-20T05:03:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.537+0000 7f20eb200640 1 -- 172.21.15.37:0/2879384601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20ec06b060 msgr2=0x7f20ec107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.537+0000 7f20eb200640 1 --2- 172.21.15.37:0/2879384601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20ec06b060 0x7f20ec107460 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009900 tx=0x7f20dc02a410 comp rx=0 tx=0).stop 2024-08-20T05:03:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.538+0000 7f20eb200640 1 -- 172.21.15.37:0/2879384601 shutdown_connections 2024-08-20T05:03:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.538+0000 7f20eb200640 1 --2- 172.21.15.37:0/2879384601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20ec10a3e0 0x7f20ec10c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.538+0000 7f20eb200640 1 --2- 172.21.15.37:0/2879384601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec1079a0 0x7f20ec109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.538+0000 7f20eb200640 1 --2- 172.21.15.37:0/2879384601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20ec06b060 0x7f20ec107460 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.538+0000 7f20eb200640 1 -- 172.21.15.37:0/2879384601 >> 172.21.15.37:0/2879384601 conn(0x7f20ec0fcc50 msgr2=0x7f20ec0ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.538+0000 7f20eb200640 1 -- 172.21.15.37:0/2879384601 shutdown_connections 2024-08-20T05:03:52.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.538+0000 7f20eb200640 1 -- 172.21.15.37:0/2879384601 wait complete. 2024-08-20T05:03:52.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.539+0000 7f20eb200640 1 Processor -- start 2024-08-20T05:03:52.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.539+0000 7f20eb200640 1 -- start start 2024-08-20T05:03:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.539+0000 7f20eb200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20ec06b060 0x7f20ec19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.539+0000 7f20eb200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec1079a0 0x7f20ec19b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.539+0000 7f20eb200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20ec10a3e0 0x7f20ec19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.539+0000 7f20eb200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec110360 con 0x7f20ec06b060 2024-08-20T05:03:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.539+0000 7f20eb200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec1101e0 con 0x7f20ec1079a0 2024-08-20T05:03:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.539+0000 7f20eb200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec1104e0 con 0x7f20ec10a3e0 2024-08-20T05:03:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.539+0000 7f20e9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20ec06b060 0x7f20ec19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.539+0000 7f20ea800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20ec10a3e0 0x7f20ec19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.539+0000 7f20e9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20ec06b060 0x7f20ec19aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47700/0 (socket says 172.21.15.37:47700) 2024-08-20T05:03:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.540+0000 7f20e9e00640 1 -- 172.21.15.37:0/155342615 learned_addr learned my addr 172.21.15.37:0/155342615 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.539+0000 7f20ea800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20ec10a3e0 0x7f20ec19bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34988/0 (socket says 172.21.15.37:34988) 2024-08-20T05:03:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.540+0000 7f20e9400640 1 --2- 172.21.15.37:0/155342615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec1079a0 0x7f20ec19b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.540+0000 7f20ea800640 1 -- 172.21.15.37:0/155342615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec1079a0 msgr2=0x7f20ec19b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.540+0000 7f20ea800640 1 --2- 172.21.15.37:0/155342615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec1079a0 0x7f20ec19b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.540+0000 7f20ea800640 1 -- 172.21.15.37:0/155342615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20ec06b060 msgr2=0x7f20ec19aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.540+0000 7f20ea800640 1 --2- 172.21.15.37:0/155342615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20ec06b060 0x7f20ec19aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.540+0000 7f20ea800640 1 -- 172.21.15.37:0/155342615 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20ec19c5d0 con 0x7f20ec10a3e0 2024-08-20T05:03:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.540+0000 7f20ea800640 1 --2- 172.21.15.37:0/155342615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20ec10a3e0 0x7f20ec19bd10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f20e400ec50 tx=0x7f20e400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.541+0000 7f20e2a00640 1 -- 172.21.15.37:0/155342615 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4003b70 con 0x7f20ec10a3e0 2024-08-20T05:03:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.541+0000 7f20eb200640 1 -- 172.21.15.37:0/155342615 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20ec19c8c0 con 0x7f20ec10a3e0 2024-08-20T05:03:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.541+0000 7f20e2a00640 1 -- 172.21.15.37:0/155342615 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20e4003d10 con 0x7f20ec10a3e0 2024-08-20T05:03:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.541+0000 7f20e2a00640 1 -- 172.21.15.37:0/155342615 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e4010830 con 0x7f20ec10a3e0 2024-08-20T05:03:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.541+0000 7f20eb200640 1 -- 172.21.15.37:0/155342615 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20ec1a2f90 con 0x7f20ec10a3e0 2024-08-20T05:03:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.544+0000 7f20f3c7d740 1 Processor -- start 2024-08-20T05:03:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.544+0000 7f20e2a00640 1 -- 172.21.15.37:0/155342615 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f20e40109d0 con 0x7f20ec10a3e0 2024-08-20T05:03:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.545+0000 7f20f3c7d740 1 -- start start 2024-08-20T05:03:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.545+0000 7f20f3c7d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f574877f0 0x564f57489be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.545+0000 7f20f3c7d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f5748a120 0x564f5748c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.545+0000 7f20f3c7d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 0x564f5748f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.545+0000 7f20f3c7d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564f573fa210 con 0x564f5748a120 2024-08-20T05:03:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.545+0000 7f20f3c7d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564f573e9710 con 0x564f574877f0 2024-08-20T05:03:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.545+0000 7f20f3c7d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564f573ed750 con 0x564f5748cb60 2024-08-20T05:03:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.545+0000 7f20e9400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f574877f0 0x564f57489be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.545+0000 7f20e9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f5748a120 0x564f5748c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.545+0000 7f20e9400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f574877f0 0x564f57489be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43800/0 (socket says 172.21.15.37:43800) 2024-08-20T05:03:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.545+0000 7f20e9400640 1 -- 172.21.15.37:0/187399631 learned_addr learned my addr 172.21.15.37:0/187399631 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.545+0000 7f20e9400640 1 --2- 172.21.15.37:0/187399631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 0x564f5748f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.546+0000 7f20e9400640 1 -- 172.21.15.37:0/187399631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 msgr2=0x564f5748f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.546+0000 7f20e9400640 1 --2- 172.21.15.37:0/187399631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 0x564f5748f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.546+0000 7f20e9400640 1 -- 172.21.15.37:0/187399631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f5748a120 msgr2=0x564f5748c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.546+0000 7f20e9400640 1 --2- 172.21.15.37:0/187399631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f5748a120 0x564f5748c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.546+0000 7f20e9400640 1 -- 172.21.15.37:0/187399631 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f573b5de0 con 0x564f574877f0 2024-08-20T05:03:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.546+0000 7f20e9400640 1 --2- 172.21.15.37:0/187399631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f574877f0 0x564f57489be0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009f90 tx=0x7f20d8005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f305a1a0a159a54f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.546+0000 7f20d7000640 1 -- 172.21.15.37:0/187399631 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d8004030 con 0x564f574877f0 2024-08-20T05:03:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.546+0000 7f20d7000640 1 -- 172.21.15.37:0/187399631 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20d80041d0 con 0x564f574877f0 2024-08-20T05:03:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.546+0000 7f20d7000640 1 -- 172.21.15.37:0/187399631 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d800f5c0 con 0x564f574877f0 2024-08-20T05:03:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.546+0000 7f20e2a00640 1 --2- 172.21.15.37:0/155342615 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20d00b3bd0 0x7f20d00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.547+0000 7f20e2a00640 1 -- 172.21.15.37:0/155342615 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f20e40e4520 con 0x7f20ec10a3e0 2024-08-20T05:03:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.547+0000 7f20e9e00640 1 --2- 172.21.15.37:0/155342615 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20d00b3bd0 0x7f20d00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.547+0000 7f20f3c7d740 1 -- 172.21.15.37:0/187399631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f574877f0 msgr2=0x564f57489be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.547+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/187399631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f574877f0 0x564f57489be0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009f90 tx=0x7f20d8005850 comp rx=0 tx=0).stop 2024-08-20T05:03:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.547+0000 7f20f3c7d740 1 -- 172.21.15.37:0/187399631 shutdown_connections 2024-08-20T05:03:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.547+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/187399631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 0x564f5748f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.547+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/187399631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f5748a120 0x564f5748c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.547+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/187399631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f574877f0 0x564f57489be0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.547+0000 7f20f3c7d740 1 -- 172.21.15.37:0/187399631 >> 172.21.15.37:0/187399631 conn(0x564f57482940 msgr2=0x564f574836d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.547+0000 7f20f3c7d740 1 -- 172.21.15.37:0/187399631 shutdown_connections 2024-08-20T05:03:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.548+0000 7f20f3c7d740 1 -- 172.21.15.37:0/187399631 wait complete. 2024-08-20T05:03:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.548+0000 7f20e9e00640 1 --2- 172.21.15.37:0/155342615 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20d00b3bd0 0x7f20d00b6090 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0096c0 tx=0x7f20dc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.548+0000 7f20f3c7d740 1 -- start start 2024-08-20T05:03:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.548+0000 7f20f3c7d740 1 Processor -- start 2024-08-20T05:03:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20f3c7d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f574877f0 0x564f57490ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20f3c7d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f5748a120 0x564f57491590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20f3c7d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 0x564f57492160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20f3c7d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564f57322ab0 con 0x564f5748a120 2024-08-20T05:03:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20f3c7d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564f57390140 con 0x564f574877f0 2024-08-20T05:03:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20f3c7d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564f5748fb40 con 0x564f5748cb60 2024-08-20T05:03:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20f3c7d740 10 client.0 _ll_register_callbacks cb 0x564f573a35d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20e9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f5748a120 0x564f57491590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20ea800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 0x564f57492160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20ea800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 0x564f57492160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35014/0 (socket says 172.21.15.37:35014) 2024-08-20T05:03:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20ea800640 1 -- 172.21.15.37:0/534047305 learned_addr learned my addr 172.21.15.37:0/534047305 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20e9e00640 1 --2- 172.21.15.37:0/534047305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f574877f0 0x564f57490ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20ea800640 1 -- 172.21.15.37:0/534047305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f574877f0 msgr2=0x564f57490ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20ea800640 1 --2- 172.21.15.37:0/534047305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f574877f0 0x564f57490ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20ea800640 1 -- 172.21.15.37:0/534047305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f5748a120 msgr2=0x564f57491590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20ea800640 1 --2- 172.21.15.37:0/534047305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f5748a120 0x564f57491590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20ea800640 1 -- 172.21.15.37:0/534047305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f57391170 con 0x564f5748cb60 2024-08-20T05:03:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.549+0000 7f20e9e00640 1 --2- 172.21.15.37:0/534047305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f574877f0 0x564f57490ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:03:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.550+0000 7f20ea800640 1 --2- 172.21.15.37:0/534047305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 0x564f57492160 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f20e40a70f0 tx=0x7f20e4009820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9152ac5550438a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.550+0000 7f20cb400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:03:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.550+0000 7f20cb400640 1 -- 172.21.15.37:0/534047305 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20e40c4020 con 0x564f5748cb60 2024-08-20T05:03:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.550+0000 7f20cb400640 1 -- 172.21.15.37:0/534047305 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f20e40a7300 con 0x564f5748cb60 2024-08-20T05:03:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.550+0000 7f20f3c7d740 1 -- 172.21.15.37:0/534047305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20d80041d0 con 0x564f5748cb60 2024-08-20T05:03:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.550+0000 7f20cb400640 1 -- 172.21.15.37:0/534047305 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f20e40ab770 con 0x564f5748cb60 2024-08-20T05:03:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.550+0000 7f20f3c7d740 10 client.25912 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.550+0000 7f20f3c7d740 1 -- 172.21.15.37:0/534047305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564f5714c790 con 0x564f5748cb60 2024-08-20T05:03:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.550+0000 7f20cb400640 1 -- 172.21.15.37:0/534047305 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20d80041d0 con 0x564f5748cb60 2024-08-20T05:03:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.550+0000 7f20cb400640 1 -- 172.21.15.37:0/534047305 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f20e40cc0d0 con 0x564f5748cb60 2024-08-20T05:03:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.551+0000 7f20f3c7d740 10 client.25912 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.551+0000 7f20f3c7d740 10 client.25912 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:03:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.551+0000 7f20f3c7d740 20 client.25912 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.551+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/534047305 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564f5749cc70 0x564f5749f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.551+0000 7f20f3c7d740 4 client.25912 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:03:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.551+0000 7f20f3c7d740 1 -- 172.21.15.37:0/534047305 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f573fc160 con 0x564f5749cc70 2024-08-20T05:03:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.551+0000 7f20e9e00640 1 --2- 172.21.15.37:0/534047305 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564f5749cc70 0x564f5749f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.552+0000 7f20e9e00640 1 --2- 172.21.15.37:0/534047305 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564f5749cc70 0x564f5749f0d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a0aad777ddcb498 server_cookie=9201480b5c3f1722 in_seq=0 out_seq=0 2024-08-20T05:03:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.552+0000 7f20cb400640 10 client.25912 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.553+0000 7f20cb400640 1 -- 172.21.15.37:0/534047305 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f573fc160 con 0x564f5749cc70 2024-08-20T05:03:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.553+0000 7f20cb400640 10 client.25912 handle_command_reply: tid=0 2024-08-20T05:03:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.553+0000 7f20f3c7d740 1 client.25912 shutdown 2024-08-20T05:03:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.553+0000 7f20f3c7d740 1 -- 172.21.15.37:0/534047305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 msgr2=0x564f57492160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.553+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/534047305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 0x564f57492160 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f20e40a70f0 tx=0x7f20e4009820 comp rx=0 tx=0).stop 2024-08-20T05:03:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.553+0000 7f20f3c7d740 1 -- 172.21.15.37:0/534047305 shutdown_connections 2024-08-20T05:03:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.553+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/534047305 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564f5749cc70 0x564f5749f0d0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.553+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/534047305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 0x564f57492160 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.553+0000 7f20cb400640 0 client.25912 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.553+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/534047305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f5748a120 0x564f57491590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.553+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/534047305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f574877f0 0x564f57490ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.553+0000 7f20f3c7d740 1 -- 172.21.15.37:0/534047305 >> 172.21.15.37:0/534047305 conn(0x564f57482940 msgr2=0x564f574819b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.553+0000 7f20f3c7d740 1 -- 172.21.15.37:0/534047305 shutdown_connections 2024-08-20T05:03:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.553+0000 7f20f3c7d740 1 -- 172.21.15.37:0/534047305 wait complete. 2024-08-20T05:03:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.553+0000 7f20f3c7d740 20 client.25912 trim_cache size 0 max 16384 2024-08-20T05:03:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.569+0000 7f20f3c7d740 1 Processor -- start 2024-08-20T05:03:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.569+0000 7f20f3c7d740 1 -- start start 2024-08-20T05:03:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.569+0000 7f20f3c7d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f574877f0 0x564f57492140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.569+0000 7f20f3c7d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f5748a120 0x564f5748fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.569+0000 7f20f3c7d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f5748cb60 0x564f57490420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.569+0000 7f20f3c7d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec1ad300 con 0x564f5748cb60 2024-08-20T05:03:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.569+0000 7f20f3c7d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec1aef00 con 0x564f5748a120 2024-08-20T05:03:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.569+0000 7f20f3c7d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec1ad9d0 con 0x564f574877f0 2024-08-20T05:03:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.569+0000 7f20ea800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f5748cb60 0x564f57490420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.569+0000 7f20e9400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f5748a120 0x564f5748fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.569+0000 7f20ea800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f5748cb60 0x564f57490420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47724/0 (socket says 172.21.15.37:47724) 2024-08-20T05:03:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.569+0000 7f20ea800640 1 -- 172.21.15.37:0/3115362133 learned_addr learned my addr 172.21.15.37:0/3115362133 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.569+0000 7f20e9e00640 1 --2- 172.21.15.37:0/3115362133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f574877f0 0x564f57492140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.570+0000 7f20e9400640 1 -- 172.21.15.37:0/3115362133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f574877f0 msgr2=0x564f57492140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.570+0000 7f20e9400640 1 --2- 172.21.15.37:0/3115362133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f574877f0 0x564f57492140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.570+0000 7f20e9400640 1 -- 172.21.15.37:0/3115362133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f5748cb60 msgr2=0x564f57490420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.570+0000 7f20e9400640 1 --2- 172.21.15.37:0/3115362133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f5748cb60 0x564f57490420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.570+0000 7f20e9400640 1 -- 172.21.15.37:0/3115362133 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f571c5620 con 0x564f5748a120 2024-08-20T05:03:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.570+0000 7f20ea800640 1 --2- 172.21.15.37:0/3115362133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f5748cb60 0x564f57490420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:52.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.570+0000 7f20e9400640 1 --2- 172.21.15.37:0/3115362133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f5748a120 0x564f5748fee0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009d60 tx=0x7f20d8003850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ac9992007a25270 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.570+0000 7f20d6600640 1 -- 172.21.15.37:0/3115362133 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d80038c0 con 0x564f5748a120 2024-08-20T05:03:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.570+0000 7f20d6600640 1 -- 172.21.15.37:0/3115362133 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20d8005520 con 0x564f5748a120 2024-08-20T05:03:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.570+0000 7f20d6600640 1 -- 172.21.15.37:0/3115362133 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d801e7a0 con 0x564f5748a120 2024-08-20T05:03:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.571+0000 7f20f3c7d740 1 -- 172.21.15.37:0/3115362133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f5748a120 msgr2=0x564f5748fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.571+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/3115362133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f5748a120 0x564f5748fee0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009d60 tx=0x7f20d8003850 comp rx=0 tx=0).stop 2024-08-20T05:03:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.571+0000 7f20f3c7d740 1 -- 172.21.15.37:0/3115362133 shutdown_connections 2024-08-20T05:03:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.571+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/3115362133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f5748cb60 0x564f57490420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.571+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/3115362133 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f5748a120 0x564f5748fee0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.571+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/3115362133 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f574877f0 0x564f57492140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.571+0000 7f20f3c7d740 1 -- 172.21.15.37:0/3115362133 >> 172.21.15.37:0/3115362133 conn(0x564f57482940 msgr2=0x564f5748cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.571+0000 7f20f3c7d740 1 -- 172.21.15.37:0/3115362133 shutdown_connections 2024-08-20T05:03:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.571+0000 7f20f3c7d740 1 -- 172.21.15.37:0/3115362133 wait complete. 2024-08-20T05:03:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.572+0000 7f20f3c7d740 1 -- start start 2024-08-20T05:03:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.572+0000 7f20f3c7d740 1 Processor -- start 2024-08-20T05:03:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.572+0000 7f20f3c7d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f574877f0 0x564f57495820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.572+0000 7f20f3c7d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f5748a120 0x564f57495ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.572+0000 7f20f3c7d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 0x564f57496a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.572+0000 7f20f3c7d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec1ae770 con 0x564f574877f0 2024-08-20T05:03:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.572+0000 7f20f3c7d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec1ae0a0 con 0x564f5748a120 2024-08-20T05:03:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.572+0000 7f20f3c7d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f20ec1ab2e0 con 0x564f5748cb60 2024-08-20T05:03:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.572+0000 7f20f3c7d740 10 client.0 _ll_register_callbacks cb 0x7f20e4004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.572+0000 7f20e9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f574877f0 0x564f57495820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.572+0000 7f20e9400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f5748a120 0x564f57495ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.573+0000 7f20e9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f574877f0 0x564f57495820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47734/0 (socket says 172.21.15.37:47734) 2024-08-20T05:03:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.573+0000 7f20e9400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f5748a120 0x564f57495ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43814/0 (socket says 172.21.15.37:43814) 2024-08-20T05:03:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.573+0000 7f20e9e00640 1 -- 172.21.15.37:0/1987691817 learned_addr learned my addr 172.21.15.37:0/1987691817 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.573+0000 7f20ea800640 1 --2- 172.21.15.37:0/1987691817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 0x564f57496a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.573+0000 7f20e9e00640 1 -- 172.21.15.37:0/1987691817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 msgr2=0x564f57496a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.573+0000 7f20e9e00640 1 --2- 172.21.15.37:0/1987691817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 0x564f57496a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.573+0000 7f20e9e00640 1 -- 172.21.15.37:0/1987691817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f5748a120 msgr2=0x564f57495ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.573+0000 7f20e9e00640 1 --2- 172.21.15.37:0/1987691817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f5748a120 0x564f57495ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.573+0000 7f20e9e00640 1 -- 172.21.15.37:0/1987691817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f574972c0 con 0x564f574877f0 2024-08-20T05:03:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.573+0000 7f20ea800640 1 --2- 172.21.15.37:0/1987691817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 0x564f57496a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.573+0000 7f20e9e00640 1 --2- 172.21.15.37:0/1987691817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f574877f0 0x564f57495820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f20dc02aa00 tx=0x7f20dc03f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbfd50e577a1a0dc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.573+0000 7f20cb400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:03:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.574+0000 7f20cb400640 1 -- 172.21.15.37:0/1987691817 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20dc055070 con 0x564f574877f0 2024-08-20T05:03:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.574+0000 7f20cb400640 1 -- 172.21.15.37:0/1987691817 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f20dc0315a0 con 0x564f574877f0 2024-08-20T05:03:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.574+0000 7f20f3c7d740 1 -- 172.21.15.37:0/1987691817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20d8005520 con 0x564f574877f0 2024-08-20T05:03:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.574+0000 7f20cb400640 1 -- 172.21.15.37:0/1987691817 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f20dc05e050 con 0x564f574877f0 2024-08-20T05:03:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.574+0000 7f20f3c7d740 10 client.15828 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.574+0000 7f20f3c7d740 1 -- 172.21.15.37:0/1987691817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564f57498700 con 0x564f574877f0 2024-08-20T05:03:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.574+0000 7f20cb400640 1 -- 172.21.15.37:0/1987691817 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20d8005520 con 0x564f574877f0 2024-08-20T05:03:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.574+0000 7f20cb400640 1 -- 172.21.15.37:0/1987691817 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f20dc058020 con 0x564f574877f0 2024-08-20T05:03:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.575+0000 7f20f3c7d740 10 client.15828 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.575+0000 7f20f3c7d740 10 client.15828 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:03:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.575+0000 7f20f3c7d740 20 client.15828 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.575+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/1987691817 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564f57507b10 0x564f57509f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.575+0000 7f20f3c7d740 4 client.15828 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:03:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.575+0000 7f20f3c7d740 1 -- 172.21.15.37:0/1987691817 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564f573f7c00 con 0x564f57507b10 2024-08-20T05:03:52.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.575+0000 7f20e9400640 1 --2- 172.21.15.37:0/1987691817 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564f57507b10 0x564f57509f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.576+0000 7f20e9400640 1 --2- 172.21.15.37:0/1987691817 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564f57507b10 0x564f57509f30 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=160a1fdc0d3b21da server_cookie=a3d1b4b12a178364 in_seq=0 out_seq=0 2024-08-20T05:03:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.576+0000 7f20cb400640 10 client.15828 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.593+0000 7f20cb400640 1 -- 172.21.15.37:0/1987691817 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564f573f7c00 con 0x564f57507b10 2024-08-20T05:03:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.594+0000 7f20cb400640 10 client.15828 handle_command_reply: tid=0 2024-08-20T05:03:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.594+0000 7f20f3c7d740 1 client.15828 shutdown 2024-08-20T05:03:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.594+0000 7f20f3c7d740 1 -- 172.21.15.37:0/1987691817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f574877f0 msgr2=0x564f57495820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.594+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/1987691817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f574877f0 0x564f57495820 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f20dc02aa00 tx=0x7f20dc03f040 comp rx=0 tx=0).stop 2024-08-20T05:03:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.594+0000 7f20f3c7d740 1 -- 172.21.15.37:0/1987691817 shutdown_connections 2024-08-20T05:03:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.594+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/1987691817 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564f57507b10 0x564f57509f30 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.594+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/1987691817 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f5748cb60 0x564f57496a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.594+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/1987691817 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f5748a120 0x564f57495ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.594+0000 7f20f3c7d740 1 --2- 172.21.15.37:0/1987691817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f574877f0 0x564f57495820 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.594+0000 7f20f3c7d740 1 -- 172.21.15.37:0/1987691817 >> 172.21.15.37:0/1987691817 conn(0x564f57482940 msgr2=0x564f57481190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.594+0000 7f20cb400640 0 client.15828 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.594+0000 7f20f3c7d740 1 -- 172.21.15.37:0/1987691817 shutdown_connections 2024-08-20T05:03:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.594+0000 7f20f3c7d740 1 -- 172.21.15.37:0/1987691817 wait complete. 2024-08-20T05:03:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.594+0000 7f20f3c7d740 20 client.15828 trim_cache size 0 max 16384 2024-08-20T05:03:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:03:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:03:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:03:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:03:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.595+0000 7f20eb200640 1 -- 172.21.15.37:0/155342615 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20d00b3bd0 msgr2=0x7f20d00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.595+0000 7f20eb200640 1 --2- 172.21.15.37:0/155342615 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20d00b3bd0 0x7f20d00b6090 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0096c0 tx=0x7f20dc005a20 comp rx=0 tx=0).stop 2024-08-20T05:03:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.595+0000 7f20eb200640 1 -- 172.21.15.37:0/155342615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20ec10a3e0 msgr2=0x7f20ec19bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.595+0000 7f20eb200640 1 --2- 172.21.15.37:0/155342615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20ec10a3e0 0x7f20ec19bd10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f20e400ec50 tx=0x7f20e400c6a0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.595+0000 7f20eb200640 1 -- 172.21.15.37:0/155342615 shutdown_connections 2024-08-20T05:03:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.595+0000 7f20eb200640 1 --2- 172.21.15.37:0/155342615 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20d00b3bd0 0x7f20d00b6090 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.595+0000 7f20eb200640 1 --2- 172.21.15.37:0/155342615 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20ec10a3e0 0x7f20ec19bd10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.595+0000 7f20eb200640 1 --2- 172.21.15.37:0/155342615 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20ec1079a0 0x7f20ec19b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.595+0000 7f20eb200640 1 --2- 172.21.15.37:0/155342615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20ec06b060 0x7f20ec19aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.595+0000 7f20eb200640 1 -- 172.21.15.37:0/155342615 >> 172.21.15.37:0/155342615 conn(0x7f20ec0fcc50 msgr2=0x7f20ec1085a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.595+0000 7f20eb200640 1 -- 172.21.15.37:0/155342615 shutdown_connections 2024-08-20T05:03:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:03:52.595+0000 7f20eb200640 1 -- 172.21.15.37:0/155342615 wait complete. 2024-08-20T05:03:52.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.741+0000 7f2295200640 1 -- 172.21.15.37:0/4059179060 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22901ac2a0 con 0x7f2290077400 2024-08-20T05:03:52.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.742+0000 7f2286a00640 1 -- 172.21.15.37:0/4059179060 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11987 (secure 0 0 0) 0x7f22800cfc60 con 0x7f2290077400 2024-08-20T05:03:52.745 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:03:52.745 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":33,"btime":"2024-08-20T05:03:11:706710+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:03:11.271814+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:03:52.745 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 33 2024-08-20T05:03:52.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.745+0000 7f2295200640 1 -- 172.21.15.37:0/4059179060 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22740b3bd0 msgr2=0x7f22740b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:52.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.745+0000 7f2295200640 1 --2- 172.21.15.37:0/4059179060 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22740b3bd0 0x7f22740b6090 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f227c0095f0 tx=0x7f227c005f90 comp rx=0 tx=0).stop 2024-08-20T05:03:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.745+0000 7f2295200640 1 -- 172.21.15.37:0/4059179060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2290077400 msgr2=0x7f229019f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.745+0000 7f2295200640 1 --2- 172.21.15.37:0/4059179060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2290077400 0x7f229019f5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2280005ab0 tx=0x7f2280003c10 comp rx=0 tx=0).stop 2024-08-20T05:03:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.745+0000 7f2295200640 1 -- 172.21.15.37:0/4059179060 shutdown_connections 2024-08-20T05:03:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.745+0000 7f2295200640 1 --2- 172.21.15.37:0/4059179060 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22740b3bd0 0x7f22740b6090 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.745+0000 7f2295200640 1 --2- 172.21.15.37:0/4059179060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2290113690 0x7f22901a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.745+0000 7f2295200640 1 --2- 172.21.15.37:0/4059179060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2290077d20 0x7f229019fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.745+0000 7f2295200640 1 --2- 172.21.15.37:0/4059179060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2290077400 0x7f229019f5a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.745+0000 7f2295200640 1 -- 172.21.15.37:0/4059179060 >> 172.21.15.37:0/4059179060 conn(0x7f2290100730 msgr2=0x7f2290102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.746+0000 7f2295200640 1 -- 172.21.15.37:0/4059179060 shutdown_connections 2024-08-20T05:03:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:52.746+0000 7f2295200640 1 -- 172.21.15.37:0/4059179060 wait complete. 2024-08-20T05:03:53.043 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:03:53.044 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 55.0 s, 360.8 tps, lat 75.871 ms stddev 99.048 2024-08-20T05:03:53.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:53 smithi130 ceph-mon[22007]: pgmap v450: 129 pgs: 129 active+clean; 992 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 693 op/s 2024-08-20T05:03:53.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:53 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/4059179060' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:03:53.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:53 smithi037 ceph-mon[17265]: pgmap v450: 129 pgs: 129 active+clean; 992 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 693 op/s 2024-08-20T05:03:53.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:53 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/4059179060' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:03:53.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:53 smithi135 ceph-mon[22342]: pgmap v450: 129 pgs: 129 active+clean; 992 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 12 MiB/s wr, 693 op/s 2024-08-20T05:03:53.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:53 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/4059179060' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:03:53.729 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id 2ba15856 --release --await' 2024-08-20T05:03:53.729 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id 2ba15856 --release --await 2024-08-20T05:03:53.866 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:03:54.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.476+0000 7f61fd200640 1 -- 172.21.15.37:0/2981705552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f8108cb0 msgr2=0x7f61f810f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.476+0000 7f61fd200640 1 --2- 172.21.15.37:0/2981705552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f8108cb0 0x7f61f810f4b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009ca0 tx=0x7f61f002a8c0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.476+0000 7f61fd200640 1 -- 172.21.15.37:0/2981705552 shutdown_connections 2024-08-20T05:03:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.476+0000 7f61fd200640 1 --2- 172.21.15.37:0/2981705552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f8108cb0 0x7f61f810f4b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.476+0000 7f61fd200640 1 --2- 172.21.15.37:0/2981705552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61f8108330 0x7f61f8108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.476+0000 7f61fd200640 1 --2- 172.21.15.37:0/2981705552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61f8102920 0x7f61f8102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.476+0000 7f61fd200640 1 -- 172.21.15.37:0/2981705552 >> 172.21.15.37:0/2981705552 conn(0x7f61f80fe350 msgr2=0x7f61f8100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.476+0000 7f61fd200640 1 -- 172.21.15.37:0/2981705552 shutdown_connections 2024-08-20T05:03:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.476+0000 7f61fd200640 1 -- 172.21.15.37:0/2981705552 wait complete. 2024-08-20T05:03:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.477+0000 7f61fd200640 1 Processor -- start 2024-08-20T05:03:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.477+0000 7f61fd200640 1 -- start start 2024-08-20T05:03:54.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.477+0000 7f61fd200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61f8102920 0x7f61f80751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.477+0000 7f61fd200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61f8108330 0x7f61f8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.477+0000 7f61fd200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f8108cb0 0x7f61f8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.477+0000 7f61fd200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f61f8112970 con 0x7f61f8108cb0 2024-08-20T05:03:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.477+0000 7f61fd200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f61f81127f0 con 0x7f61f8102920 2024-08-20T05:03:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.478+0000 7f61fd200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f61f8112af0 con 0x7f61f8108330 2024-08-20T05:03:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.478+0000 7f61f7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f8108cb0 0x7f61f8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.478+0000 7f61f7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f8108cb0 0x7f61f8075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35432/0 (socket says 172.21.15.37:35432) 2024-08-20T05:03:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.478+0000 7f61f7e00640 1 -- 172.21.15.37:0/1618399896 learned_addr learned my addr 172.21.15.37:0/1618399896 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.478+0000 7f61f7400640 1 --2- 172.21.15.37:0/1618399896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61f8102920 0x7f61f80751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.478+0000 7f61efe00640 1 --2- 172.21.15.37:0/1618399896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61f8108330 0x7f61f8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.478+0000 7f61f7400640 1 -- 172.21.15.37:0/1618399896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61f8108330 msgr2=0x7f61f8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.478+0000 7f61f7400640 1 --2- 172.21.15.37:0/1618399896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61f8108330 0x7f61f8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.478+0000 7f61f7400640 1 -- 172.21.15.37:0/1618399896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f8108cb0 msgr2=0x7f61f8075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.478+0000 7f61f7400640 1 --2- 172.21.15.37:0/1618399896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f8108cb0 0x7f61f8075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.478+0000 7f61f7400640 1 -- 172.21.15.37:0/1618399896 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f81a7180 con 0x7f61f8102920 2024-08-20T05:03:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.478+0000 7f61f7e00640 1 --2- 172.21.15.37:0/1618399896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f8108cb0 0x7f61f8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.479+0000 7f61f7400640 1 --2- 172.21.15.37:0/1618399896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61f8102920 0x7f61f80751d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f61e800e9f0 tx=0x7f61e800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.479+0000 7f61f4c00640 1 -- 172.21.15.37:0/1618399896 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e800ccc0 con 0x7f61f8102920 2024-08-20T05:03:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.479+0000 7f61fd200640 1 -- 172.21.15.37:0/1618399896 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f81a7470 con 0x7f61f8102920 2024-08-20T05:03:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.479+0000 7f61f4c00640 1 -- 172.21.15.37:0/1618399896 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61e8005020 con 0x7f61f8102920 2024-08-20T05:03:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.479+0000 7f61f4c00640 1 -- 172.21.15.37:0/1618399896 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e8004a00 con 0x7f61f8102920 2024-08-20T05:03:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.479+0000 7f61fd200640 1 -- 172.21.15.37:0/1618399896 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f81a7960 con 0x7f61f8102920 2024-08-20T05:03:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.482+0000 7f62012cd740 1 Processor -- start 2024-08-20T05:03:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.482+0000 7f62012cd740 1 -- start start 2024-08-20T05:03:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.482+0000 7f62012cd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42082ba80 0x55e42082be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.482+0000 7f62012cd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 0x55e420837df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.482+0000 7f62012cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e420838330 0x55e42083a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.482+0000 7f62012cd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e4207a1a60 con 0x55e42082c3a0 2024-08-20T05:03:54.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.482+0000 7f62012cd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e420790f60 con 0x55e42082ba80 2024-08-20T05:03:54.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.482+0000 7f62012cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e420794fa0 con 0x55e420838330 2024-08-20T05:03:54.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.483+0000 7f61f4c00640 1 -- 172.21.15.37:0/1618399896 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f61e8004ba0 con 0x7f61f8102920 2024-08-20T05:03:54.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.483+0000 7f61f7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42082ba80 0x55e42082be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.483+0000 7f61f7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42082ba80 0x55e42082be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42620/0 (socket says 172.21.15.37:42620) 2024-08-20T05:03:54.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.483+0000 7f61f7e00640 1 -- 172.21.15.37:0/2328007599 learned_addr learned my addr 172.21.15.37:0/2328007599 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:54.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.483+0000 7f61efe00640 1 --2- 172.21.15.37:0/2328007599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e420838330 0x55e42083a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.483+0000 7f61f7400640 1 --2- 172.21.15.37:0/2328007599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 0x55e420837df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.483+0000 7f61f7e00640 1 -- 172.21.15.37:0/2328007599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e420838330 msgr2=0x55e42083a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:54.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.483+0000 7f61f7e00640 1 --2- 172.21.15.37:0/2328007599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e420838330 0x55e42083a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.483+0000 7f61f7e00640 1 -- 172.21.15.37:0/2328007599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 msgr2=0x55e420837df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:54.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.483+0000 7f61f7e00640 1 --2- 172.21.15.37:0/2328007599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 0x55e420837df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.483+0000 7f61f7e00640 1 -- 172.21.15.37:0/2328007599 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4207373e0 con 0x55e42082ba80 2024-08-20T05:03:54.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.483+0000 7f61f7400640 1 --2- 172.21.15.37:0/2328007599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 0x55e420837df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:03:54.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.484+0000 7f61f7e00640 1 --2- 172.21.15.37:0/2328007599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42082ba80 0x55e42082be60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f61f0033040 tx=0x7f61f002f310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7defaa958b93dac9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:54.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.484+0000 7f61ecc00640 1 -- 172.21.15.37:0/2328007599 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0031450 con 0x55e42082ba80 2024-08-20T05:03:54.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.484+0000 7f61ecc00640 1 -- 172.21.15.37:0/2328007599 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61f0036040 con 0x55e42082ba80 2024-08-20T05:03:54.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.484+0000 7f61ecc00640 1 -- 172.21.15.37:0/2328007599 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f0004430 con 0x55e42082ba80 2024-08-20T05:03:54.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.485+0000 7f62012cd740 1 -- 172.21.15.37:0/2328007599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42082ba80 msgr2=0x55e42082be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:54.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.485+0000 7f62012cd740 1 --2- 172.21.15.37:0/2328007599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42082ba80 0x55e42082be60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f61f0033040 tx=0x7f61f002f310 comp rx=0 tx=0).stop 2024-08-20T05:03:54.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.485+0000 7f61f4c00640 1 --2- 172.21.15.37:0/1618399896 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f61dc0b3c70 0x7f61dc0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.485+0000 7f62012cd740 1 -- 172.21.15.37:0/2328007599 shutdown_connections 2024-08-20T05:03:54.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.485+0000 7f62012cd740 1 --2- 172.21.15.37:0/2328007599 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e420838330 0x55e42083a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.485+0000 7f62012cd740 1 --2- 172.21.15.37:0/2328007599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 0x55e420837df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.485+0000 7f62012cd740 1 --2- 172.21.15.37:0/2328007599 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42082ba80 0x55e42082be60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.485+0000 7f61f4c00640 1 -- 172.21.15.37:0/1618399896 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f61e80e3fe0 con 0x7f61f8102920 2024-08-20T05:03:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.485+0000 7f62012cd740 1 -- 172.21.15.37:0/2328007599 >> 172.21.15.37:0/2328007599 conn(0x55e4208298b0 msgr2=0x55e42082aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.485+0000 7f61f7e00640 1 --2- 172.21.15.37:0/1618399896 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f61dc0b3c70 0x7f61dc0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.485+0000 7f62012cd740 1 -- 172.21.15.37:0/2328007599 shutdown_connections 2024-08-20T05:03:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.485+0000 7f62012cd740 1 -- 172.21.15.37:0/2328007599 wait complete. 2024-08-20T05:03:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.486+0000 7f61f7e00640 1 --2- 172.21.15.37:0/1618399896 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f61dc0b3c70 0x7f61dc0b6130 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f61f0003f10 tx=0x7f61f002a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.486+0000 7f62012cd740 1 -- start start 2024-08-20T05:03:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.486+0000 7f62012cd740 1 Processor -- start 2024-08-20T05:03:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.487+0000 7f62012cd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42082ba80 0x55e420837a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.487+0000 7f62012cd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 0x55e420834e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.487+0000 7f62012cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e420838330 0x55e4208353a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.487+0000 7f62012cd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e4205f3700 con 0x55e42082c3a0 2024-08-20T05:03:54.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.487+0000 7f62012cd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e42072c250 con 0x55e42082ba80 2024-08-20T05:03:54.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.487+0000 7f62012cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e42083add0 con 0x55e420838330 2024-08-20T05:03:54.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.487+0000 7f62012cd740 10 client.0 _ll_register_callbacks cb 0x55e42078b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:54.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.487+0000 7f61efe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 0x55e420834e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.487+0000 7f61efe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 0x55e420834e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35456/0 (socket says 172.21.15.37:35456) 2024-08-20T05:03:54.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.487+0000 7f61efe00640 1 -- 172.21.15.37:0/722426828 learned_addr learned my addr 172.21.15.37:0/722426828 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:54.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.487+0000 7f61f7e00640 1 --2- 172.21.15.37:0/722426828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e420838330 0x55e4208353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.487+0000 7f61f7400640 1 --2- 172.21.15.37:0/722426828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42082ba80 0x55e420837a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.487+0000 7f61efe00640 1 -- 172.21.15.37:0/722426828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e420838330 msgr2=0x55e4208353a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:54.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.487+0000 7f61efe00640 1 --2- 172.21.15.37:0/722426828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e420838330 0x55e4208353a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.488+0000 7f61efe00640 1 -- 172.21.15.37:0/722426828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42082ba80 msgr2=0x55e420837a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:54.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.488+0000 7f61efe00640 1 --2- 172.21.15.37:0/722426828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42082ba80 0x55e420837a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.488+0000 7f61efe00640 1 -- 172.21.15.37:0/722426828 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4204f0650 con 0x55e42082c3a0 2024-08-20T05:03:54.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.488+0000 7f61efe00640 1 --2- 172.21.15.37:0/722426828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 0x55e420834e60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f61e00126d0 tx=0x7f61e0012b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770892a74b87dd43 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:54.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.488+0000 7f61e5600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:03:54.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.488+0000 7f61e5600640 1 -- 172.21.15.37:0/722426828 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0004050 con 0x55e42082c3a0 2024-08-20T05:03:54.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.488+0000 7f61e5600640 1 -- 172.21.15.37:0/722426828 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f61e00041f0 con 0x55e42082c3a0 2024-08-20T05:03:54.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.488+0000 7f62012cd740 1 -- 172.21.15.37:0/722426828 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61f0036040 con 0x55e42082c3a0 2024-08-20T05:03:54.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.488+0000 7f61e5600640 1 -- 172.21.15.37:0/722426828 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f61e0025050 con 0x55e42082c3a0 2024-08-20T05:03:54.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.488+0000 7f62012cd740 10 client.15837 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:54.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.488+0000 7f62012cd740 1 -- 172.21.15.37:0/722426828 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e420846500 con 0x55e42082c3a0 2024-08-20T05:03:54.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.489+0000 7f61e5600640 1 -- 172.21.15.37:0/722426828 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61f0036040 con 0x55e42082c3a0 2024-08-20T05:03:54.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.489+0000 7f61e5600640 1 -- 172.21.15.37:0/722426828 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f61e0003960 con 0x55e42082c3a0 2024-08-20T05:03:54.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.489+0000 7f62012cd740 10 client.15837 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:54.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.489+0000 7f62012cd740 10 client.15837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:03:54.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.489+0000 7f62012cd740 20 client.15837 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:54.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.489+0000 7f62012cd740 1 --2- 172.21.15.37:0/722426828 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e420847ab0 0x55e420849f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.489+0000 7f62012cd740 4 client.15837 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:03:54.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.489+0000 7f62012cd740 1 -- 172.21.15.37:0/722426828 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e4207a39b0 con 0x55e420847ab0 2024-08-20T05:03:54.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.489+0000 7f61f7400640 1 --2- 172.21.15.37:0/722426828 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e420847ab0 0x55e420849f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.490+0000 7f61f7400640 1 --2- 172.21.15.37:0/722426828 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e420847ab0 0x55e420849f10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d43b78ffc83157a server_cookie=cb5723f6de9b2b77 in_seq=0 out_seq=0 2024-08-20T05:03:54.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.490+0000 7f61e5600640 10 client.15837 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:54.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.491+0000 7f61e5600640 1 -- 172.21.15.37:0/722426828 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e4207a39b0 con 0x55e420847ab0 2024-08-20T05:03:54.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.491+0000 7f61e5600640 10 client.15837 handle_command_reply: tid=0 2024-08-20T05:03:54.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.491+0000 7f62012cd740 1 client.15837 shutdown 2024-08-20T05:03:54.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.491+0000 7f62012cd740 1 -- 172.21.15.37:0/722426828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 msgr2=0x55e420834e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:54.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.491+0000 7f62012cd740 1 --2- 172.21.15.37:0/722426828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 0x55e420834e60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f61e00126d0 tx=0x7f61e0012b90 comp rx=0 tx=0).stop 2024-08-20T05:03:54.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.491+0000 7f62012cd740 1 -- 172.21.15.37:0/722426828 shutdown_connections 2024-08-20T05:03:54.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.491+0000 7f62012cd740 1 --2- 172.21.15.37:0/722426828 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e420847ab0 0x55e420849f10 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.491+0000 7f62012cd740 1 --2- 172.21.15.37:0/722426828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e420838330 0x55e4208353a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.491+0000 7f62012cd740 1 --2- 172.21.15.37:0/722426828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 0x55e420834e60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.491+0000 7f61e5600640 0 client.15837 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:54.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.491+0000 7f62012cd740 1 --2- 172.21.15.37:0/722426828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e42082ba80 0x55e420837a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.491+0000 7f62012cd740 1 -- 172.21.15.37:0/722426828 >> 172.21.15.37:0/722426828 conn(0x55e4208298b0 msgr2=0x55e42082f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:54.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.491+0000 7f62012cd740 1 -- 172.21.15.37:0/722426828 shutdown_connections 2024-08-20T05:03:54.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.491+0000 7f62012cd740 1 -- 172.21.15.37:0/722426828 wait complete. 2024-08-20T05:03:54.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.492+0000 7f62012cd740 20 client.15837 trim_cache size 0 max 16384 2024-08-20T05:03:54.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.509+0000 7f62012cd740 1 Processor -- start 2024-08-20T05:03:54.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.510+0000 7f62012cd740 1 -- start start 2024-08-20T05:03:54.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.510+0000 7f62012cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e42082ba80 0x55e42084f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.510+0000 7f62012cd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 0x55e42084fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.510+0000 7f62012cd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e420838330 0x55e420832070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.510+0000 7f62012cd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f61f81b1740 con 0x55e42082c3a0 2024-08-20T05:03:54.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.510+0000 7f62012cd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f61f81b3340 con 0x55e420838330 2024-08-20T05:03:54.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.510+0000 7f62012cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f61f81b1e10 con 0x55e42082ba80 2024-08-20T05:03:54.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.510+0000 7f61efe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 0x55e42084fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.510+0000 7f61efe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 0x55e42084fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35462/0 (socket says 172.21.15.37:35462) 2024-08-20T05:03:54.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.510+0000 7f61efe00640 1 -- 172.21.15.37:0/1239576164 learned_addr learned my addr 172.21.15.37:0/1239576164 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:54.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.510+0000 7f61f7400640 1 --2- 172.21.15.37:0/1239576164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e42082ba80 0x55e42084f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.510+0000 7f61f7e00640 1 --2- 172.21.15.37:0/1239576164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e420838330 0x55e420832070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.511+0000 7f61f7400640 1 -- 172.21.15.37:0/1239576164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e420838330 msgr2=0x55e420832070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:54.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.511+0000 7f61f7400640 1 --2- 172.21.15.37:0/1239576164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e420838330 0x55e420832070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.511+0000 7f61f7400640 1 -- 172.21.15.37:0/1239576164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 msgr2=0x55e42084fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:54.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.511+0000 7f61f7400640 1 --2- 172.21.15.37:0/1239576164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 0x55e42084fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.511+0000 7f61f7400640 1 -- 172.21.15.37:0/1239576164 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e42082a330 con 0x55e42082ba80 2024-08-20T05:03:54.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.511+0000 7f61efe00640 1 --2- 172.21.15.37:0/1239576164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 0x55e42084fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:54.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.511+0000 7f61f7400640 1 --2- 172.21.15.37:0/1239576164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e42082ba80 0x55e42084f7e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f61e80e16b0 tx=0x7f61e8005460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b20560cc3631c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:54.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.511+0000 7f61e7e00640 1 -- 172.21.15.37:0/1239576164 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e80abe60 con 0x55e42082ba80 2024-08-20T05:03:54.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.511+0000 7f61e7e00640 1 -- 172.21.15.37:0/1239576164 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61e80ab230 con 0x55e42082ba80 2024-08-20T05:03:54.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.511+0000 7f61e7e00640 1 -- 172.21.15.37:0/1239576164 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e801c040 con 0x55e42082ba80 2024-08-20T05:03:54.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.512+0000 7f62012cd740 1 -- 172.21.15.37:0/1239576164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e42082ba80 msgr2=0x55e42084f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:54.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.512+0000 7f62012cd740 1 --2- 172.21.15.37:0/1239576164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e42082ba80 0x55e42084f7e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f61e80e16b0 tx=0x7f61e8005460 comp rx=0 tx=0).stop 2024-08-20T05:03:54.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.512+0000 7f62012cd740 1 -- 172.21.15.37:0/1239576164 shutdown_connections 2024-08-20T05:03:54.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.512+0000 7f62012cd740 1 --2- 172.21.15.37:0/1239576164 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e420838330 0x55e420832070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.512+0000 7f62012cd740 1 --2- 172.21.15.37:0/1239576164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082c3a0 0x55e42084fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.512+0000 7f62012cd740 1 --2- 172.21.15.37:0/1239576164 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e42082ba80 0x55e42084f7e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.512+0000 7f62012cd740 1 -- 172.21.15.37:0/1239576164 >> 172.21.15.37:0/1239576164 conn(0x55e4208298b0 msgr2=0x55e420836cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:54.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.512+0000 7f62012cd740 1 -- 172.21.15.37:0/1239576164 shutdown_connections 2024-08-20T05:03:54.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.512+0000 7f62012cd740 1 -- 172.21.15.37:0/1239576164 wait complete. 2024-08-20T05:03:54.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.513+0000 7f62012cd740 1 -- start start 2024-08-20T05:03:54.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.513+0000 7f62012cd740 1 Processor -- start 2024-08-20T05:03:54.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.513+0000 7f62012cd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082ba80 0x55e420840770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.513+0000 7f62012cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e42082c3a0 0x55e42083bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.513+0000 7f62012cd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e420838330 0x55e42083c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.513+0000 7f62012cd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f61f81b2bb0 con 0x55e42082ba80 2024-08-20T05:03:54.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.513+0000 7f62012cd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f61f81b24e0 con 0x55e420838330 2024-08-20T05:03:54.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.513+0000 7f62012cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f61f81af720 con 0x55e42082c3a0 2024-08-20T05:03:54.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.514+0000 7f62012cd740 10 client.0 _ll_register_callbacks cb 0x7f61e00097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:54.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.514+0000 7f61efe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e42082c3a0 0x55e42083bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.514+0000 7f61efe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e42082c3a0 0x55e42083bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46284/0 (socket says 172.21.15.37:46284) 2024-08-20T05:03:54.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.514+0000 7f61efe00640 1 -- 172.21.15.37:0/538742266 learned_addr learned my addr 172.21.15.37:0/538742266 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:54.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.514+0000 7f61f7e00640 1 --2- 172.21.15.37:0/538742266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e420838330 0x55e42083c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.514+0000 7f61f7400640 1 --2- 172.21.15.37:0/538742266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082ba80 0x55e420840770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.514+0000 7f61efe00640 1 -- 172.21.15.37:0/538742266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e420838330 msgr2=0x55e42083c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:54.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.514+0000 7f61efe00640 1 --2- 172.21.15.37:0/538742266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e420838330 0x55e42083c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.514+0000 7f61efe00640 1 -- 172.21.15.37:0/538742266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082ba80 msgr2=0x55e420840770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:54.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.514+0000 7f61efe00640 1 --2- 172.21.15.37:0/538742266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082ba80 0x55e420840770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.514+0000 7f61efe00640 1 -- 172.21.15.37:0/538742266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e42081b060 con 0x55e42082c3a0 2024-08-20T05:03:54.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.514+0000 7f61f7e00640 1 --2- 172.21.15.37:0/538742266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e420838330 0x55e42083c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:54.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.514+0000 7f61f7400640 1 --2- 172.21.15.37:0/538742266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082ba80 0x55e420840770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:54.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.515+0000 7f61efe00640 1 --2- 172.21.15.37:0/538742266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e42082c3a0 0x55e42083bc40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f61e0003f20 tx=0x7f61e0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e658141ba7c83e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:54.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.515+0000 7f61e5600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:03:54.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.515+0000 7f61e5600640 1 -- 172.21.15.37:0/538742266 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e00035f0 con 0x55e42082c3a0 2024-08-20T05:03:54.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.515+0000 7f61e5600640 1 -- 172.21.15.37:0/538742266 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f61e0022070 con 0x55e42082c3a0 2024-08-20T05:03:54.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.515+0000 7f62012cd740 1 -- 172.21.15.37:0/538742266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61e80ab230 con 0x55e42082c3a0 2024-08-20T05:03:54.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.516+0000 7f61e5600640 1 -- 172.21.15.37:0/538742266 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f61e0039050 con 0x55e42082c3a0 2024-08-20T05:03:54.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.516+0000 7f62012cd740 10 client.25936 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:54.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.516+0000 7f62012cd740 1 -- 172.21.15.37:0/538742266 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55e4208b2690 con 0x55e42082c3a0 2024-08-20T05:03:54.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.516+0000 7f61e5600640 1 -- 172.21.15.37:0/538742266 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61e80ab230 con 0x55e42082c3a0 2024-08-20T05:03:54.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.516+0000 7f61e5600640 1 -- 172.21.15.37:0/538742266 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f61e0005140 con 0x55e42082c3a0 2024-08-20T05:03:54.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.516+0000 7f62012cd740 10 client.25936 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:54.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.516+0000 7f62012cd740 10 client.25936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:03:54.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.516+0000 7f62012cd740 20 client.25936 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:54.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.516+0000 7f62012cd740 1 --2- 172.21.15.37:0/538742266 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e4208b2e40 0x55e4208b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:54.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.516+0000 7f62012cd740 4 client.25936 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:03:54.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.516+0000 7f62012cd740 1 -- 172.21.15.37:0/538742266 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e42079f450 con 0x55e4208b2e40 2024-08-20T05:03:54.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.517+0000 7f61f7400640 1 --2- 172.21.15.37:0/538742266 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e4208b2e40 0x55e4208b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:54.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.517+0000 7f61f7400640 1 --2- 172.21.15.37:0/538742266 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e4208b2e40 0x55e4208b5260 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e015c876ebe44dbe server_cookie=bbd3f4bfc185cd5b in_seq=0 out_seq=0 2024-08-20T05:03:54.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.517+0000 7f61e5600640 10 client.25936 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:54.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.517+0000 7f61e5600640 1 -- 172.21.15.37:0/538742266 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e42079f450 con 0x55e4208b2e40 2024-08-20T05:03:54.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.517+0000 7f61e5600640 10 client.25936 handle_command_reply: tid=0 2024-08-20T05:03:54.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.517+0000 7f62012cd740 1 client.25936 shutdown 2024-08-20T05:03:54.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.518+0000 7f62012cd740 1 -- 172.21.15.37:0/538742266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e42082c3a0 msgr2=0x55e42083bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:54.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.518+0000 7f62012cd740 1 --2- 172.21.15.37:0/538742266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e42082c3a0 0x55e42083bc40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f61e0003f20 tx=0x7f61e0009260 comp rx=0 tx=0).stop 2024-08-20T05:03:54.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.518+0000 7f62012cd740 1 -- 172.21.15.37:0/538742266 shutdown_connections 2024-08-20T05:03:54.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.518+0000 7f62012cd740 1 --2- 172.21.15.37:0/538742266 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e4208b2e40 0x55e4208b5260 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.518+0000 7f62012cd740 1 --2- 172.21.15.37:0/538742266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e420838330 0x55e42083c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.518+0000 7f62012cd740 1 --2- 172.21.15.37:0/538742266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e42082c3a0 0x55e42083bc40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.518+0000 7f62012cd740 1 --2- 172.21.15.37:0/538742266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e42082ba80 0x55e420840770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.518+0000 7f62012cd740 1 -- 172.21.15.37:0/538742266 >> 172.21.15.37:0/538742266 conn(0x55e4208298b0 msgr2=0x55e420828270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:54.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.518+0000 7f61e5600640 0 client.25936 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:54.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.518+0000 7f62012cd740 1 -- 172.21.15.37:0/538742266 shutdown_connections 2024-08-20T05:03:54.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.519+0000 7f62012cd740 1 -- 172.21.15.37:0/538742266 wait complete. 2024-08-20T05:03:54.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.519+0000 7f62012cd740 20 client.25936 trim_cache size 0 max 16384 2024-08-20T05:03:54.533 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:03:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-20T05:03:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-08-20T05:03:54.534 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:03:54.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.519+0000 7f61fd200640 1 -- 172.21.15.37:0/1618399896 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f61dc0b3c70 msgr2=0x7f61dc0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:54.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.519+0000 7f61fd200640 1 --2- 172.21.15.37:0/1618399896 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f61dc0b3c70 0x7f61dc0b6130 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f61f0003f10 tx=0x7f61f002a8c0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.519+0000 7f61fd200640 1 -- 172.21.15.37:0/1618399896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61f8102920 msgr2=0x7f61f80751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:54.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.519+0000 7f61fd200640 1 --2- 172.21.15.37:0/1618399896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61f8102920 0x7f61f80751d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f61e800e9f0 tx=0x7f61e800eeb0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.519+0000 7f61fd200640 1 -- 172.21.15.37:0/1618399896 shutdown_connections 2024-08-20T05:03:54.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.520+0000 7f61fd200640 1 --2- 172.21.15.37:0/1618399896 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f61dc0b3c70 0x7f61dc0b6130 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.520+0000 7f61fd200640 1 --2- 172.21.15.37:0/1618399896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61f8108cb0 0x7f61f8075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.520+0000 7f61fd200640 1 --2- 172.21.15.37:0/1618399896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f61f8108330 0x7f61f8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.520+0000 7f61fd200640 1 --2- 172.21.15.37:0/1618399896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f61f8102920 0x7f61f80751d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:54.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.520+0000 7f61fd200640 1 -- 172.21.15.37:0/1618399896 >> 172.21.15.37:0/1618399896 conn(0x7f61f80fe350 msgr2=0x7f61f8101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:54.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.520+0000 7f61fd200640 1 -- 172.21.15.37:0/1618399896 shutdown_connections 2024-08-20T05:03:54.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:54.520+0000 7f61fd200640 1 -- 172.21.15.37:0/1618399896 wait complete. 2024-08-20T05:03:54.810 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:03:55.436 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T05:03:55.437 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:03:55.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:55 smithi130 ceph-mon[22007]: pgmap v451: 129 pgs: 129 active+clean; 962 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 11 MiB/s wr, 635 op/s 2024-08-20T05:03:55.486 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:55 smithi037 ceph-mon[17265]: pgmap v451: 129 pgs: 129 active+clean; 962 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 11 MiB/s wr, 635 op/s 2024-08-20T05:03:55.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:55 smithi135 ceph-mon[22342]: pgmap v451: 129 pgs: 129 active+clean; 962 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 11 MiB/s wr, 635 op/s 2024-08-20T05:03:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.000+0000 7f4591600640 1 -- 172.21.15.37:0/498069186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f458c113690 msgr2=0x7f458c115a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.000+0000 7f4591600640 1 --2- 172.21.15.37:0/498069186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f458c113690 0x7f458c115a80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4584009ca0 tx=0x7f458402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.000+0000 7f4591600640 1 -- 172.21.15.37:0/498069186 shutdown_connections 2024-08-20T05:03:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.000+0000 7f4591600640 1 --2- 172.21.15.37:0/498069186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f458c113690 0x7f458c115a80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.000+0000 7f4591600640 1 --2- 172.21.15.37:0/498069186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f458c077d20 0x7f458c113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.000+0000 7f4591600640 1 --2- 172.21.15.37:0/498069186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f458c077400 0x7f458c0777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.000+0000 7f4591600640 1 -- 172.21.15.37:0/498069186 >> 172.21.15.37:0/498069186 conn(0x7f458c100730 msgr2=0x7f458c102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.000+0000 7f4591600640 1 -- 172.21.15.37:0/498069186 shutdown_connections 2024-08-20T05:03:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.000+0000 7f4591600640 1 -- 172.21.15.37:0/498069186 wait complete. 2024-08-20T05:03:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.001+0000 7f4591600640 1 Processor -- start 2024-08-20T05:03:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.001+0000 7f4591600640 1 -- start start 2024-08-20T05:03:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.002+0000 7f4591600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f458c077400 0x7f458c19f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.002+0000 7f4591600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f458c077d20 0x7f458c19faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.002+0000 7f4591600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f458c113690 0x7f458c1a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.002+0000 7f4591600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f458c119070 con 0x7f458c077400 2024-08-20T05:03:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.002+0000 7f4591600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f458c118ef0 con 0x7f458c113690 2024-08-20T05:03:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.002+0000 7f4591600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1191f0 con 0x7f458c077d20 2024-08-20T05:03:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.002+0000 7f458aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f458c077400 0x7f458c19f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.002+0000 7f458aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f458c077400 0x7f458c19f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35500/0 (socket says 172.21.15.37:35500) 2024-08-20T05:03:56.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.002+0000 7f458aa00640 1 -- 172.21.15.37:0/2543637307 learned_addr learned my addr 172.21.15.37:0/2543637307 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.002+0000 7f4583e00640 1 --2- 172.21.15.37:0/2543637307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f458c077d20 0x7f458c19faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.003+0000 7f458aa00640 1 -- 172.21.15.37:0/2543637307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f458c077d20 msgr2=0x7f458c19faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.003+0000 7f458aa00640 1 --2- 172.21.15.37:0/2543637307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f458c077d20 0x7f458c19faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.003+0000 7f458aa00640 1 -- 172.21.15.37:0/2543637307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f458c113690 msgr2=0x7f458c1a4e40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T05:03:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.003+0000 7f458aa00640 1 --2- 172.21.15.37:0/2543637307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f458c113690 0x7f458c1a4e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.003+0000 7f458aa00640 1 -- 172.21.15.37:0/2543637307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f458c1a5610 con 0x7f458c077400 2024-08-20T05:03:56.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.003+0000 7f458aa00640 1 --2- 172.21.15.37:0/2543637307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f458c077400 0x7f458c19f560 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f457c00e9f0 tx=0x7f457c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:56.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.003+0000 7f4583400640 1 -- 172.21.15.37:0/2543637307 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c00cd80 con 0x7f458c077400 2024-08-20T05:03:56.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.003+0000 7f4583400640 1 -- 172.21.15.37:0/2543637307 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f457c0054d0 con 0x7f458c077400 2024-08-20T05:03:56.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.003+0000 7f4591600640 1 -- 172.21.15.37:0/2543637307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f458c1a5900 con 0x7f458c077400 2024-08-20T05:03:56.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.003+0000 7f4583400640 1 -- 172.21.15.37:0/2543637307 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c010430 con 0x7f458c077400 2024-08-20T05:03:56.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.004+0000 7f4591600640 1 -- 172.21.15.37:0/2543637307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f458c1abfc0 con 0x7f458c077400 2024-08-20T05:03:56.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.007+0000 7f4594045740 1 Processor -- start 2024-08-20T05:03:56.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.007+0000 7f4594045740 1 -- start start 2024-08-20T05:03:56.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.007+0000 7f4583400640 1 -- 172.21.15.37:0/2543637307 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f457c005000 con 0x7f458c077400 2024-08-20T05:03:56.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.007+0000 7f4594045740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a0cf0 0x5608fc3a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.007+0000 7f4594045740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3a1610 0x5608fc3ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.007+0000 7f4594045740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3ad5a0 0x5608fc3af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.007+0000 7f4594045740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5608fc342670 con 0x5608fc3a0cf0 2024-08-20T05:03:56.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.007+0000 7f4594045740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5608fc316d70 con 0x5608fc3ad5a0 2024-08-20T05:03:56.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.007+0000 7f4594045740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5608fc306270 con 0x5608fc3a1610 2024-08-20T05:03:56.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.008+0000 7f458aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3a1610 0x5608fc3ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:56.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.008+0000 7f458b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a0cf0 0x5608fc3a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:56.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.008+0000 7f458aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3a1610 0x5608fc3ad060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46308/0 (socket says 172.21.15.37:46308) 2024-08-20T05:03:56.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.008+0000 7f458aa00640 1 -- 172.21.15.37:0/3690109764 learned_addr learned my addr 172.21.15.37:0/3690109764 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:56.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.008+0000 7f4583e00640 1 --2- 172.21.15.37:0/3690109764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3ad5a0 0x5608fc3af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:56.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.008+0000 7f458aa00640 1 -- 172.21.15.37:0/3690109764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3ad5a0 msgr2=0x5608fc3af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:56.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.008+0000 7f458aa00640 1 --2- 172.21.15.37:0/3690109764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3ad5a0 0x5608fc3af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.008+0000 7f458aa00640 1 -- 172.21.15.37:0/3690109764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a0cf0 msgr2=0x5608fc3a10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:56.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.008+0000 7f458aa00640 1 --2- 172.21.15.37:0/3690109764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a0cf0 0x5608fc3a10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.008+0000 7f458aa00640 1 -- 172.21.15.37:0/3690109764 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608fc2a2870 con 0x5608fc3a1610 2024-08-20T05:03:56.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.008+0000 7f458b400640 1 --2- 172.21.15.37:0/3690109764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a0cf0 0x5608fc3a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:56.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.009+0000 7f458aa00640 1 --2- 172.21.15.37:0/3690109764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3a1610 0x5608fc3ad060 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f457c0ec420 tx=0x7f457c0ec510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ad961eedff4ef76 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:56.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.009+0000 7f457b400640 1 -- 172.21.15.37:0/3690109764 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c0f8070 con 0x5608fc3a1610 2024-08-20T05:03:56.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.009+0000 7f457b400640 1 -- 172.21.15.37:0/3690109764 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f457c0e60d0 con 0x5608fc3a1610 2024-08-20T05:03:56.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.009+0000 7f457b400640 1 -- 172.21.15.37:0/3690109764 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c0f07c0 con 0x5608fc3a1610 2024-08-20T05:03:56.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.009+0000 7f4583400640 1 --2- 172.21.15.37:0/2543637307 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f45700b3bd0 0x7f45700b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.010+0000 7f4583400640 1 -- 172.21.15.37:0/2543637307 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f457c0e4490 con 0x7f458c077400 2024-08-20T05:03:56.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.010+0000 7f458b400640 1 --2- 172.21.15.37:0/2543637307 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f45700b3bd0 0x7f45700b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:56.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.010+0000 7f4594045740 1 -- 172.21.15.37:0/3690109764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3a1610 msgr2=0x5608fc3ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:56.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.010+0000 7f4594045740 1 --2- 172.21.15.37:0/3690109764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3a1610 0x5608fc3ad060 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f457c0ec420 tx=0x7f457c0ec510 comp rx=0 tx=0).stop 2024-08-20T05:03:56.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.010+0000 7f4594045740 1 -- 172.21.15.37:0/3690109764 shutdown_connections 2024-08-20T05:03:56.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.010+0000 7f4594045740 1 --2- 172.21.15.37:0/3690109764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3ad5a0 0x5608fc3af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.010+0000 7f4594045740 1 --2- 172.21.15.37:0/3690109764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3a1610 0x5608fc3ad060 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.010+0000 7f4594045740 1 --2- 172.21.15.37:0/3690109764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a0cf0 0x5608fc3a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.010+0000 7f4594045740 1 -- 172.21.15.37:0/3690109764 >> 172.21.15.37:0/3690109764 conn(0x5608fc39eb20 msgr2=0x5608fc39fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:56.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.010+0000 7f4594045740 1 -- 172.21.15.37:0/3690109764 shutdown_connections 2024-08-20T05:03:56.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.011+0000 7f4594045740 1 -- 172.21.15.37:0/3690109764 wait complete. 2024-08-20T05:03:56.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.011+0000 7f458b400640 1 --2- 172.21.15.37:0/2543637307 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f45700b3bd0 0x7f45700b6090 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4584006010 tx=0x7f4584005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:56.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.011+0000 7f4594045740 1 -- start start 2024-08-20T05:03:56.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.011+0000 7f4594045740 1 Processor -- start 2024-08-20T05:03:56.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f4594045740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a0cf0 0x5608fc3ace00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f4594045740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a1610 0x5608fc3aa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f4594045740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3ad5a0 0x5608fc3aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f4594045740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5608fc28cff0 con 0x5608fc3a1610 2024-08-20T05:03:56.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f4594045740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5608fc30a2b0 con 0x5608fc3a0cf0 2024-08-20T05:03:56.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f4594045740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5608fc168bb0 con 0x5608fc3ad5a0 2024-08-20T05:03:56.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f4594045740 10 client.0 _ll_register_callbacks cb 0x5608fc011d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:56.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f4583e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a1610 0x5608fc3aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:56.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f458aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a0cf0 0x5608fc3ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:56.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f4583e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a1610 0x5608fc3aa250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35518/0 (socket says 172.21.15.37:35518) 2024-08-20T05:03:56.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f458b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3ad5a0 0x5608fc3aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:56.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f4583e00640 1 -- 172.21.15.37:0/2395840187 learned_addr learned my addr 172.21.15.37:0/2395840187 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f458aa00640 1 -- 172.21.15.37:0/2395840187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3ad5a0 msgr2=0x5608fc3aa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f458aa00640 1 --2- 172.21.15.37:0/2395840187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3ad5a0 0x5608fc3aa7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f458aa00640 1 -- 172.21.15.37:0/2395840187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a1610 msgr2=0x5608fc3aa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f458aa00640 1 --2- 172.21.15.37:0/2395840187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a1610 0x5608fc3aa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f458aa00640 1 -- 172.21.15.37:0/2395840187 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608fc065b00 con 0x5608fc3a0cf0 2024-08-20T05:03:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.012+0000 7f4583e00640 1 --2- 172.21.15.37:0/2395840187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a1610 0x5608fc3aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.013+0000 7f458aa00640 1 --2- 172.21.15.37:0/2395840187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a0cf0 0x5608fc3ace00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f457c00c6a0 tx=0x7f457c0e7a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f454dd1e0dc4c9d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.013+0000 7f456fe00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:03:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.013+0000 7f456fe00640 1 -- 172.21.15.37:0/2395840187 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c0a6ea0 con 0x5608fc3a0cf0 2024-08-20T05:03:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.013+0000 7f4594045740 1 -- 172.21.15.37:0/2395840187 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f457c0e60d0 con 0x5608fc3a0cf0 2024-08-20T05:03:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.013+0000 7f456fe00640 1 -- 172.21.15.37:0/2395840187 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f457c0e1ca0 con 0x5608fc3a0cf0 2024-08-20T05:03:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.013+0000 7f456fe00640 1 -- 172.21.15.37:0/2395840187 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f457c0aa750 con 0x5608fc3a0cf0 2024-08-20T05:03:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.013+0000 7f4594045740 10 client.25931 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:56.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.013+0000 7f4594045740 1 -- 172.21.15.37:0/2395840187 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5608fc0dc960 con 0x5608fc3a0cf0 2024-08-20T05:03:56.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.014+0000 7f456fe00640 1 -- 172.21.15.37:0/2395840187 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f457c0e60d0 con 0x5608fc3a0cf0 2024-08-20T05:03:56.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.014+0000 7f456fe00640 1 -- 172.21.15.37:0/2395840187 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f457c0ab240 con 0x5608fc3a0cf0 2024-08-20T05:03:56.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.014+0000 7f4594045740 10 client.25931 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:56.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.014+0000 7f4594045740 10 client.25931 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:03:56.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.014+0000 7f4594045740 20 client.25931 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:56.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.014+0000 7f4594045740 1 --2- 172.21.15.37:0/2395840187 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5608fc3bcad0 0x5608fc3beec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.014+0000 7f4594045740 4 client.25931 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:03:56.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.014+0000 7f4594045740 1 -- 172.21.15.37:0/2395840187 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608fc318cc0 con 0x5608fc3bcad0 2024-08-20T05:03:56.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.014+0000 7f4583e00640 1 --2- 172.21.15.37:0/2395840187 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5608fc3bcad0 0x5608fc3beec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:56.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.015+0000 7f4583e00640 1 --2- 172.21.15.37:0/2395840187 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5608fc3bcad0 0x5608fc3beec0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed73d7e16af89163 server_cookie=2526a86205577bbc in_seq=0 out_seq=0 2024-08-20T05:03:56.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.015+0000 7f456fe00640 10 client.25931 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:56.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.016+0000 7f456fe00640 1 -- 172.21.15.37:0/2395840187 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608fc318cc0 con 0x5608fc3bcad0 2024-08-20T05:03:56.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.016+0000 7f456fe00640 10 client.25931 handle_command_reply: tid=0 2024-08-20T05:03:56.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.016+0000 7f4594045740 1 client.25931 shutdown 2024-08-20T05:03:56.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.016+0000 7f4594045740 1 -- 172.21.15.37:0/2395840187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a0cf0 msgr2=0x5608fc3ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:56.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.016+0000 7f4594045740 1 --2- 172.21.15.37:0/2395840187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a0cf0 0x5608fc3ace00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f457c00c6a0 tx=0x7f457c0e7a00 comp rx=0 tx=0).stop 2024-08-20T05:03:56.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.016+0000 7f4594045740 1 -- 172.21.15.37:0/2395840187 shutdown_connections 2024-08-20T05:03:56.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.016+0000 7f4594045740 1 --2- 172.21.15.37:0/2395840187 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5608fc3bcad0 0x5608fc3beec0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.016+0000 7f4594045740 1 --2- 172.21.15.37:0/2395840187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3ad5a0 0x5608fc3aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.016+0000 7f4594045740 1 --2- 172.21.15.37:0/2395840187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a1610 0x5608fc3aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.016+0000 7f4594045740 1 --2- 172.21.15.37:0/2395840187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a0cf0 0x5608fc3ace00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.016+0000 7f456fe00640 0 client.25931 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:56.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.016+0000 7f4594045740 1 -- 172.21.15.37:0/2395840187 >> 172.21.15.37:0/2395840187 conn(0x5608fc39eb20 msgr2=0x5608fc3a4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:56.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.016+0000 7f4594045740 1 -- 172.21.15.37:0/2395840187 shutdown_connections 2024-08-20T05:03:56.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.016+0000 7f4594045740 1 -- 172.21.15.37:0/2395840187 wait complete. 2024-08-20T05:03:56.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.016+0000 7f4594045740 20 client.25931 trim_cache size 0 max 16384 2024-08-20T05:03:56.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.034+0000 7f4594045740 1 Processor -- start 2024-08-20T05:03:56.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.035+0000 7f4594045740 1 -- start start 2024-08-20T05:03:56.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.035+0000 7f4594045740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a0cf0 0x5608fc3c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.035+0000 7f4594045740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a1610 0x5608fc3c2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.035+0000 7f4594045740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3ad5a0 0x5608fc3a7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.035+0000 7f4594045740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1b5da0 con 0x5608fc3a0cf0 2024-08-20T05:03:56.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.035+0000 7f4594045740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1b79a0 con 0x5608fc3a1610 2024-08-20T05:03:56.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.035+0000 7f4594045740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1b6470 con 0x5608fc3ad5a0 2024-08-20T05:03:56.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.035+0000 7f458aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a0cf0 0x5608fc3c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:56.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.035+0000 7f4583e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a1610 0x5608fc3c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:56.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.035+0000 7f458aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a0cf0 0x5608fc3c1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35530/0 (socket says 172.21.15.37:35530) 2024-08-20T05:03:56.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.035+0000 7f458aa00640 1 -- 172.21.15.37:0/245425422 learned_addr learned my addr 172.21.15.37:0/245425422 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:56.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.035+0000 7f458b400640 1 --2- 172.21.15.37:0/245425422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3ad5a0 0x5608fc3a7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:56.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.036+0000 7f4583e00640 1 -- 172.21.15.37:0/245425422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3ad5a0 msgr2=0x5608fc3a7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:56.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.036+0000 7f4583e00640 1 --2- 172.21.15.37:0/245425422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3ad5a0 0x5608fc3a7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.036+0000 7f4583e00640 1 -- 172.21.15.37:0/245425422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a0cf0 msgr2=0x5608fc3c1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:56.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.036+0000 7f4583e00640 1 --2- 172.21.15.37:0/245425422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a0cf0 0x5608fc3c1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.036+0000 7f4583e00640 1 -- 172.21.15.37:0/245425422 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608fc3ad170 con 0x5608fc3a1610 2024-08-20T05:03:56.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.036+0000 7f458aa00640 1 --2- 172.21.15.37:0/245425422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a0cf0 0x5608fc3c1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:56.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.036+0000 7f4583e00640 1 --2- 172.21.15.37:0/245425422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a1610 0x5608fc3c2420 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4574009fd0 tx=0x7f4574005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fc370f9d1505127 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:56.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.036+0000 7f457aa00640 1 -- 172.21.15.37:0/245425422 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4574012e60 con 0x5608fc3a1610 2024-08-20T05:03:56.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.036+0000 7f457aa00640 1 -- 172.21.15.37:0/245425422 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45740123f0 con 0x5608fc3a1610 2024-08-20T05:03:56.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.036+0000 7f457aa00640 1 -- 172.21.15.37:0/245425422 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4574003850 con 0x5608fc3a1610 2024-08-20T05:03:56.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.037+0000 7f4594045740 1 -- 172.21.15.37:0/245425422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a1610 msgr2=0x5608fc3c2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:56.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.037+0000 7f4594045740 1 --2- 172.21.15.37:0/245425422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a1610 0x5608fc3c2420 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4574009fd0 tx=0x7f4574005f90 comp rx=0 tx=0).stop 2024-08-20T05:03:56.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.037+0000 7f4594045740 1 -- 172.21.15.37:0/245425422 shutdown_connections 2024-08-20T05:03:56.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.037+0000 7f4594045740 1 --2- 172.21.15.37:0/245425422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3ad5a0 0x5608fc3a7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.037+0000 7f4594045740 1 --2- 172.21.15.37:0/245425422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a1610 0x5608fc3c2420 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.037+0000 7f4594045740 1 --2- 172.21.15.37:0/245425422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3a0cf0 0x5608fc3c1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.037+0000 7f4594045740 1 -- 172.21.15.37:0/245425422 >> 172.21.15.37:0/245425422 conn(0x5608fc39eb20 msgr2=0x5608fc3a5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:56.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.037+0000 7f4594045740 1 -- 172.21.15.37:0/245425422 shutdown_connections 2024-08-20T05:03:56.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.037+0000 7f4594045740 1 -- 172.21.15.37:0/245425422 wait complete. 2024-08-20T05:03:56.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.038+0000 7f4594045740 1 -- start start 2024-08-20T05:03:56.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.038+0000 7f4594045740 1 Processor -- start 2024-08-20T05:03:56.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f4594045740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3a0cf0 0x5608fc3c0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f4594045740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a1610 0x5608fc3c07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f4594045740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3ad5a0 0x5608fc426410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f4594045740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1b7210 con 0x5608fc3ad5a0 2024-08-20T05:03:56.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f4594045740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1b6b40 con 0x5608fc3a1610 2024-08-20T05:03:56.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f4594045740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f458c1b3d80 con 0x5608fc3a0cf0 2024-08-20T05:03:56.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f4594045740 10 client.0 _ll_register_callbacks cb 0x7f457c0f6070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:03:56.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f4583e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a1610 0x5608fc3c07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:56.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f458aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3a0cf0 0x5608fc3c0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:56.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f4583e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a1610 0x5608fc3c07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42706/0 (socket says 172.21.15.37:42706) 2024-08-20T05:03:56.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f4583e00640 1 -- 172.21.15.37:0/3240786416 learned_addr learned my addr 172.21.15.37:0/3240786416 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:56.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f458b400640 1 --2- 172.21.15.37:0/3240786416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3ad5a0 0x5608fc426410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:56.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f458aa00640 1 -- 172.21.15.37:0/3240786416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a1610 msgr2=0x5608fc3c07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:56.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f458aa00640 1 --2- 172.21.15.37:0/3240786416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a1610 0x5608fc3c07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f458aa00640 1 -- 172.21.15.37:0/3240786416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3ad5a0 msgr2=0x5608fc426410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:03:56.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f458aa00640 1 --2- 172.21.15.37:0/3240786416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3ad5a0 0x5608fc426410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f458aa00640 1 -- 172.21.15.37:0/3240786416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608fc3a1440 con 0x5608fc3a0cf0 2024-08-20T05:03:56.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f4583e00640 1 --2- 172.21.15.37:0/3240786416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a1610 0x5608fc3c07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:56.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.039+0000 7f458b400640 1 --2- 172.21.15.37:0/3240786416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3ad5a0 0x5608fc426410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:03:56.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.040+0000 7f458aa00640 1 --2- 172.21.15.37:0/3240786416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3a0cf0 0x5608fc3c0260 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f457c0f4040 tx=0x7f457c0e4710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8682759923e59ebe server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:56.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.040+0000 7f456fe00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:03:56.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.040+0000 7f456fe00640 1 -- 172.21.15.37:0/3240786416 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457c0aa930 con 0x5608fc3a0cf0 2024-08-20T05:03:56.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.040+0000 7f4594045740 1 -- 172.21.15.37:0/3240786416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5608fc314760 con 0x5608fc3a0cf0 2024-08-20T05:03:56.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.040+0000 7f456fe00640 1 -- 172.21.15.37:0/3240786416 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f457c0e7ca0 con 0x5608fc3a0cf0 2024-08-20T05:03:56.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.040+0000 7f456fe00640 1 -- 172.21.15.37:0/3240786416 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f457c0aadb0 con 0x5608fc3a0cf0 2024-08-20T05:03:56.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.040+0000 7f4594045740 10 client.25954 fetch_fsmap learned FSMap version 33 2024-08-20T05:03:56.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.040+0000 7f4594045740 1 -- 172.21.15.37:0/3240786416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5608fc427a70 con 0x5608fc3a0cf0 2024-08-20T05:03:56.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.041+0000 7f456fe00640 1 -- 172.21.15.37:0/3240786416 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5608fc314760 con 0x5608fc3a0cf0 2024-08-20T05:03:56.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.041+0000 7f456fe00640 1 -- 172.21.15.37:0/3240786416 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f457c070190 con 0x5608fc3a0cf0 2024-08-20T05:03:56.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.041+0000 7f4594045740 10 client.25954 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:03:56.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.041+0000 7f4594045740 10 client.25954 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:03:56.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.041+0000 7f4594045740 20 client.25954 populate_metadata read hostname 'smithi037' 2024-08-20T05:03:56.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.041+0000 7f4594045740 1 --2- 172.21.15.37:0/3240786416 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5608fc428050 0x5608fc42a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:56.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.041+0000 7f4594045740 4 client.25954 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "2ba15856", "release": true, "await": true}] 2024-08-20T05:03:56.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.041+0000 7f4594045740 1 -- 172.21.15.37:0/3240786416 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "set_id": "2ba15856", "release": true, "await": true}) -- 0x5608fc311ea0 con 0x5608fc428050 2024-08-20T05:03:56.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.042+0000 7f4583e00640 1 --2- 172.21.15.37:0/3240786416 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5608fc428050 0x5608fc42a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:56.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.042+0000 7f4583e00640 1 --2- 172.21.15.37:0/3240786416 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5608fc428050 0x5608fc42a470 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b4b0727485bb2c1 server_cookie=d1be8d9ea39072f3 in_seq=0 out_seq=0 2024-08-20T05:03:56.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.042+0000 7f456fe00640 10 client.25954 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:56.095 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:03:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-08-20T05:03:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:03:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 8, 2024-08-20T05:03:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:03:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "2ba15856": { 2024-08-20T05:03:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 8, 2024-08-20T05:03:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:03:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:03:56.095 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:03:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:03:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:03:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:03:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 130.0, 2024-08-20T05:03:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:03:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:03:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:03:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:03:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:03:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:03:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:56.096 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:56.097 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:03:56.097 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:03:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.081+0000 7f456fe00640 1 -- 172.21.15.37:0/3240786416 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5608fc311ea0 con 0x5608fc428050 2024-08-20T05:03:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.081+0000 7f456fe00640 10 client.25954 handle_command_reply: tid=0 2024-08-20T05:03:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.081+0000 7f4594045740 1 client.25954 shutdown 2024-08-20T05:03:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.082+0000 7f4594045740 1 -- 172.21.15.37:0/3240786416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3a0cf0 msgr2=0x5608fc3c0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.082+0000 7f4594045740 1 --2- 172.21.15.37:0/3240786416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3a0cf0 0x5608fc3c0260 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f457c0f4040 tx=0x7f457c0e4710 comp rx=0 tx=0).stop 2024-08-20T05:03:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.082+0000 7f4594045740 1 -- 172.21.15.37:0/3240786416 shutdown_connections 2024-08-20T05:03:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.082+0000 7f4594045740 1 --2- 172.21.15.37:0/3240786416 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5608fc428050 0x5608fc42a470 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.082+0000 7f4594045740 1 --2- 172.21.15.37:0/3240786416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608fc3ad5a0 0x5608fc426410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.082+0000 7f4594045740 1 --2- 172.21.15.37:0/3240786416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608fc3a1610 0x5608fc3c07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.082+0000 7f4594045740 1 --2- 172.21.15.37:0/3240786416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608fc3a0cf0 0x5608fc3c0260 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f457c0f4040 tx=0x7f457c0e4710 comp rx=0 tx=0).stop 2024-08-20T05:03:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.082+0000 7f4594045740 1 -- 172.21.15.37:0/3240786416 >> 172.21.15.37:0/3240786416 conn(0x5608fc39eb20 msgr2=0x5608fc3ac0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.082+0000 7f456fe00640 0 client.25954 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:03:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.086+0000 7f4594045740 1 -- 172.21.15.37:0/3240786416 shutdown_connections 2024-08-20T05:03:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.086+0000 7f4594045740 1 -- 172.21.15.37:0/3240786416 wait complete. 2024-08-20T05:03:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.087+0000 7f4594045740 20 client.25954 trim_cache size 0 max 16384 2024-08-20T05:03:56.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.093+0000 7f4591600640 1 -- 172.21.15.37:0/2543637307 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f45700b3bd0 msgr2=0x7f45700b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.093+0000 7f4591600640 1 --2- 172.21.15.37:0/2543637307 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f45700b3bd0 0x7f45700b6090 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4584006010 tx=0x7f4584005c50 comp rx=0 tx=0).stop 2024-08-20T05:03:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.093+0000 7f4591600640 1 -- 172.21.15.37:0/2543637307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f458c077400 msgr2=0x7f458c19f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.093+0000 7f4591600640 1 --2- 172.21.15.37:0/2543637307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f458c077400 0x7f458c19f560 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f457c00e9f0 tx=0x7f457c00edf0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.094+0000 7f4591600640 1 -- 172.21.15.37:0/2543637307 shutdown_connections 2024-08-20T05:03:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.094+0000 7f4591600640 1 --2- 172.21.15.37:0/2543637307 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f45700b3bd0 0x7f45700b6090 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.094+0000 7f4591600640 1 --2- 172.21.15.37:0/2543637307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f458c113690 0x7f458c1a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.094+0000 7f4591600640 1 --2- 172.21.15.37:0/2543637307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f458c077d20 0x7f458c19faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.094+0000 7f4591600640 1 --2- 172.21.15.37:0/2543637307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f458c077400 0x7f458c19f560 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.094+0000 7f4591600640 1 -- 172.21.15.37:0/2543637307 >> 172.21.15.37:0/2543637307 conn(0x7f458c100730 msgr2=0x7f458c102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.096+0000 7f4591600640 1 -- 172.21.15.37:0/2543637307 shutdown_connections 2024-08-20T05:03:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:56.098+0000 7f4591600640 1 -- 172.21.15.37:0/2543637307 wait complete. 2024-08-20T05:03:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:03:57.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:57 smithi037 ceph-mon[17265]: pgmap v452: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 10 MiB/s wr, 540 op/s 2024-08-20T05:03:57.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:57 smithi130 ceph-mon[22007]: pgmap v452: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 10 MiB/s wr, 540 op/s 2024-08-20T05:03:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.294+0000 7f1057e00640 1 -- 172.21.15.37:0/2427049720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1058108330 msgr2=0x7f1058108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.294+0000 7f1057e00640 1 --2- 172.21.15.37:0/2427049720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1058108330 0x7f1058108770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1044009860 tx=0x7f104402a340 comp rx=0 tx=0).stop 2024-08-20T05:03:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.295+0000 7f1057e00640 1 -- 172.21.15.37:0/2427049720 shutdown_connections 2024-08-20T05:03:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.295+0000 7f1057e00640 1 --2- 172.21.15.37:0/2427049720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1058108cb0 0x7f105810f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.295+0000 7f1057e00640 1 --2- 172.21.15.37:0/2427049720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1058108330 0x7f1058108770 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.295+0000 7f1057e00640 1 --2- 172.21.15.37:0/2427049720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1058102920 0x7f1058102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.295+0000 7f1057e00640 1 -- 172.21.15.37:0/2427049720 >> 172.21.15.37:0/2427049720 conn(0x7f10580fe350 msgr2=0x7f1058100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.295+0000 7f1057e00640 1 -- 172.21.15.37:0/2427049720 shutdown_connections 2024-08-20T05:03:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.295+0000 7f1057e00640 1 -- 172.21.15.37:0/2427049720 wait complete. 2024-08-20T05:03:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.296+0000 7f1057e00640 1 Processor -- start 2024-08-20T05:03:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.296+0000 7f1057e00640 1 -- start start 2024-08-20T05:03:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.296+0000 7f1057e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1058102920 0x7f10580751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.297+0000 7f1057e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1058108330 0x7f1058075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.297+0000 7f1057e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1058108cb0 0x7f1058075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.297+0000 7f1057e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1058112900 con 0x7f1058108330 2024-08-20T05:03:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.297+0000 7f1057e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1058112780 con 0x7f1058102920 2024-08-20T05:03:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.297+0000 7f1057e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1058112a80 con 0x7f1058108cb0 2024-08-20T05:03:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.297+0000 7f1056a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1058102920 0x7f10580751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.297+0000 7f1056a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1058102920 0x7f10580751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42730/0 (socket says 172.21.15.37:42730) 2024-08-20T05:03:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.297+0000 7f1056a00640 1 -- 172.21.15.37:0/4139570033 learned_addr learned my addr 172.21.15.37:0/4139570033 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:03:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.297+0000 7f1057400640 1 --2- 172.21.15.37:0/4139570033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1058108cb0 0x7f1058075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.297+0000 7f1056000640 1 --2- 172.21.15.37:0/4139570033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1058108330 0x7f1058075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.297+0000 7f1056a00640 1 -- 172.21.15.37:0/4139570033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1058108cb0 msgr2=0x7f1058075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.297+0000 7f1056a00640 1 --2- 172.21.15.37:0/4139570033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1058108cb0 0x7f1058075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.297+0000 7f1056a00640 1 -- 172.21.15.37:0/4139570033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1058108330 msgr2=0x7f1058075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.297+0000 7f1056a00640 1 --2- 172.21.15.37:0/4139570033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1058108330 0x7f1058075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.297+0000 7f1056a00640 1 -- 172.21.15.37:0/4139570033 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10581a7150 con 0x7f1058102920 2024-08-20T05:03:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.298+0000 7f1056a00640 1 --2- 172.21.15.37:0/4139570033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1058102920 0x7f10580751d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f104800e9c0 tx=0x7f104800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.298+0000 7f104f400640 1 -- 172.21.15.37:0/4139570033 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f104800cde0 con 0x7f1058102920 2024-08-20T05:03:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.298+0000 7f104f400640 1 -- 172.21.15.37:0/4139570033 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10480035f0 con 0x7f1058102920 2024-08-20T05:03:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.298+0000 7f1057e00640 1 -- 172.21.15.37:0/4139570033 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10581a7440 con 0x7f1058102920 2024-08-20T05:03:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.298+0000 7f104f400640 1 -- 172.21.15.37:0/4139570033 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1048010690 con 0x7f1058102920 2024-08-20T05:03:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.298+0000 7f1057e00640 1 -- 172.21.15.37:0/4139570033 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10581a7980 con 0x7f1058102920 2024-08-20T05:03:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.300+0000 7f1057e00640 1 -- 172.21.15.37:0/4139570033 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1058102d00 con 0x7f1058102920 2024-08-20T05:03:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.301+0000 7f104f400640 1 -- 172.21.15.37:0/4139570033 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1048004000 con 0x7f1058102920 2024-08-20T05:03:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.303+0000 7f104f400640 1 --2- 172.21.15.37:0/4139570033 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f103c0b3c70 0x7f103c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:03:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.303+0000 7f104f400640 1 -- 172.21.15.37:0/4139570033 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f10480e4410 con 0x7f1058102920 2024-08-20T05:03:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.303+0000 7f1056000640 1 --2- 172.21.15.37:0/4139570033 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f103c0b3c70 0x7f103c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:03:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.304+0000 7f1056000640 1 --2- 172.21.15.37:0/4139570033 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f103c0b3c70 0x7f103c0b6130 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1044005940 tx=0x7f10440058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:03:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.306+0000 7f104f400640 1 -- 172.21.15.37:0/4139570033 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f1048009510 con 0x7f1058102920 2024-08-20T05:03:57.618 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:57 smithi135 ceph-mon[22342]: pgmap v452: 129 pgs: 129 active+clean; 963 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 10 MiB/s wr, 540 op/s 2024-08-20T05:03:57.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.754+0000 7f1057e00640 1 -- 172.21.15.37:0/4139570033 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10581a7d10 con 0x7f1058102920 2024-08-20T05:03:57.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.757+0000 7f104f400640 1 -- 172.21.15.37:0/4139570033 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11987 (secure 0 0 0) 0x7f10480ab6c0 con 0x7f1058102920 2024-08-20T05:03:57.764 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:03:57.764 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":33,"btime":"2024-08-20T05:03:11:706710+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:03:11.271814+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:03:57.765 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 33 2024-08-20T05:03:57.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.764+0000 7f1057e00640 1 -- 172.21.15.37:0/4139570033 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f103c0b3c70 msgr2=0x7f103c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.764+0000 7f1057e00640 1 --2- 172.21.15.37:0/4139570033 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f103c0b3c70 0x7f103c0b6130 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1044005940 tx=0x7f10440058b0 comp rx=0 tx=0).stop 2024-08-20T05:03:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.764+0000 7f1057e00640 1 -- 172.21.15.37:0/4139570033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1058102920 msgr2=0x7f10580751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:03:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.764+0000 7f1057e00640 1 --2- 172.21.15.37:0/4139570033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1058102920 0x7f10580751d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f104800e9c0 tx=0x7f104800ee80 comp rx=0 tx=0).stop 2024-08-20T05:03:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.764+0000 7f1057e00640 1 -- 172.21.15.37:0/4139570033 shutdown_connections 2024-08-20T05:03:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.764+0000 7f1057e00640 1 --2- 172.21.15.37:0/4139570033 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f103c0b3c70 0x7f103c0b6130 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1044005940 tx=0x7f10440058b0 comp rx=0 tx=0).stop 2024-08-20T05:03:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.764+0000 7f1057e00640 1 --2- 172.21.15.37:0/4139570033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1058108cb0 0x7f1058075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.764+0000 7f1057e00640 1 --2- 172.21.15.37:0/4139570033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1058108330 0x7f1058075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.764+0000 7f1057e00640 1 --2- 172.21.15.37:0/4139570033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1058102920 0x7f10580751d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:03:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.764+0000 7f1057e00640 1 -- 172.21.15.37:0/4139570033 >> 172.21.15.37:0/4139570033 conn(0x7f10580fe350 msgr2=0x7f1058100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:03:57.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.765+0000 7f1057e00640 1 -- 172.21.15.37:0/4139570033 shutdown_connections 2024-08-20T05:03:57.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:03:57.767+0000 7f1057e00640 1 -- 172.21.15.37:0/4139570033 wait complete. 2024-08-20T05:03:57.865 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '2ba15856', total seconds elapsed: 17.1 2024-08-20T05:03:58.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 60.0 s, 590.3 tps, lat 290.996 ms stddev 1229.794 2024-08-20T05:03:58.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:58 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/4139570033' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:03:58.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:58 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/4139570033' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:03:58.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T05:03:58.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:58 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/4139570033' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:03:59.331 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:03:59.494 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:03:59 smithi037 ceph-mon[17265]: pgmap v453: 129 pgs: 129 active+clean; 971 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 8.6 MiB/s wr, 396 op/s 2024-08-20T05:03:59.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:03:59 smithi135 ceph-mon[22342]: pgmap v453: 129 pgs: 129 active+clean; 971 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 8.6 MiB/s wr, 396 op/s 2024-08-20T05:03:59.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:03:59 smithi130 ceph-mon[22007]: pgmap v453: 129 pgs: 129 active+clean; 971 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 8.6 MiB/s wr, 396 op/s 2024-08-20T05:04:00.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.179+0000 7ff532e00640 1 -- 172.21.15.37:0/986974203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c10aea0 msgr2=0x7ff52c1116a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:00.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.179+0000 7ff532e00640 1 --2- 172.21.15.37:0/986974203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c10aea0 0x7ff52c1116a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff524009be0 tx=0x7ff52402a6d0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.179+0000 7ff532e00640 1 -- 172.21.15.37:0/986974203 shutdown_connections 2024-08-20T05:04:00.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.179+0000 7ff532e00640 1 --2- 172.21.15.37:0/986974203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c10aea0 0x7ff52c1116a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.179+0000 7ff532e00640 1 --2- 172.21.15.37:0/986974203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52c10a520 0x7ff52c10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.179+0000 7ff532e00640 1 --2- 172.21.15.37:0/986974203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff52c104b10 0x7ff52c104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.179+0000 7ff532e00640 1 -- 172.21.15.37:0/986974203 >> 172.21.15.37:0/986974203 conn(0x7ff52c100540 msgr2=0x7ff52c102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.180+0000 7ff532e00640 1 -- 172.21.15.37:0/986974203 shutdown_connections 2024-08-20T05:04:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.180+0000 7ff532e00640 1 -- 172.21.15.37:0/986974203 wait complete. 2024-08-20T05:04:00.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.182+0000 7ff532e00640 1 Processor -- start 2024-08-20T05:04:00.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.182+0000 7ff532e00640 1 -- start start 2024-08-20T05:04:00.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.183+0000 7ff532e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff52c104b10 0x7ff52c19aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.183+0000 7ff532e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52c10a520 0x7ff52c19b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.184+0000 7ff532e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c10aea0 0x7ff52c1a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.184+0000 7ff531000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52c10a520 0x7ff52c19b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:00.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.184+0000 7ff532e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c114b60 con 0x7ff52c10a520 2024-08-20T05:04:00.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.184+0000 7ff532e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c1149e0 con 0x7ff52c10aea0 2024-08-20T05:04:00.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.184+0000 7ff532e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c114ce0 con 0x7ff52c104b10 2024-08-20T05:04:00.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.184+0000 7ff531000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52c10a520 0x7ff52c19b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35566/0 (socket says 172.21.15.37:35566) 2024-08-20T05:04:00.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.184+0000 7ff531000640 1 -- 172.21.15.37:0/4081068936 learned_addr learned my addr 172.21.15.37:0/4081068936 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:00.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.184+0000 7ff532400640 1 --2- 172.21.15.37:0/4081068936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c10aea0 0x7ff52c1a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:00.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.185+0000 7ff531a00640 1 --2- 172.21.15.37:0/4081068936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff52c104b10 0x7ff52c19aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:00.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.185+0000 7ff531000640 1 -- 172.21.15.37:0/4081068936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff52c104b10 msgr2=0x7ff52c19aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:00.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.185+0000 7ff531000640 1 --2- 172.21.15.37:0/4081068936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff52c104b10 0x7ff52c19aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.185+0000 7ff531000640 1 -- 172.21.15.37:0/4081068936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c10aea0 msgr2=0x7ff52c1a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:00.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.185+0000 7ff531000640 1 --2- 172.21.15.37:0/4081068936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c10aea0 0x7ff52c1a0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.185+0000 7ff531000640 1 -- 172.21.15.37:0/4081068936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52c1a0f60 con 0x7ff52c10a520 2024-08-20T05:04:00.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.186+0000 7ff531000640 1 --2- 172.21.15.37:0/4081068936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52c10a520 0x7ff52c19b3f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff51800d950 tx=0x7ff51800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:00.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.186+0000 7ff52a000640 1 -- 172.21.15.37:0/4081068936 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff518017070 con 0x7ff52c10a520 2024-08-20T05:04:00.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.186+0000 7ff52a000640 1 -- 172.21.15.37:0/4081068936 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff518009c30 con 0x7ff52c10a520 2024-08-20T05:04:00.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.186+0000 7ff52a000640 1 -- 172.21.15.37:0/4081068936 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51800f620 con 0x7ff52c10a520 2024-08-20T05:04:00.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.187+0000 7ff532e00640 1 -- 172.21.15.37:0/4081068936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff52c1a1250 con 0x7ff52c10a520 2024-08-20T05:04:00.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.187+0000 7ff532e00640 1 -- 172.21.15.37:0/4081068936 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff52c1a7910 con 0x7ff52c10a520 2024-08-20T05:04:00.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.192+0000 7ff537012740 1 Processor -- start 2024-08-20T05:04:00.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.192+0000 7ff537012740 1 -- start start 2024-08-20T05:04:00.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.193+0000 7ff537012740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.194+0000 7ff537012740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4c5440 0x55ee7a4d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.194+0000 7ff532400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:00.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.194+0000 7ff532400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4c4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46382/0 (socket says 172.21.15.37:46382) 2024-08-20T05:04:00.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.194+0000 7ff537012740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4d13d0 0x55ee7a4d37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.195+0000 7ff537012740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ee7a43aaa0 con 0x55ee7a4c5440 2024-08-20T05:04:00.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.195+0000 7ff537012740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ee7a429fa0 con 0x55ee7a4d13d0 2024-08-20T05:04:00.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.195+0000 7ff537012740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ee7a42dfe0 con 0x55ee7a4c4b20 2024-08-20T05:04:00.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.195+0000 7ff532400640 1 -- 172.21.15.37:0/1161038843 learned_addr learned my addr 172.21.15.37:0/1161038843 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:00.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.197+0000 7ff531a00640 1 --2- 172.21.15.37:0/1161038843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4c5440 0x55ee7a4d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.198+0000 7ff52a000640 1 -- 172.21.15.37:0/4081068936 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff518010460 con 0x7ff52c10a520 2024-08-20T05:04:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.198+0000 7ff532400640 1 -- 172.21.15.37:0/1161038843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4d13d0 msgr2=0x55ee7a4d37c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:04:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.198+0000 7ff532400640 1 --2- 172.21.15.37:0/1161038843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4d13d0 0x55ee7a4d37c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.198+0000 7ff532400640 1 -- 172.21.15.37:0/1161038843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4c5440 msgr2=0x55ee7a4d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.198+0000 7ff532400640 1 --2- 172.21.15.37:0/1161038843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4c5440 0x55ee7a4d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.198+0000 7ff532400640 1 -- 172.21.15.37:0/1161038843 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee7a3d0420 con 0x55ee7a4c4b20 2024-08-20T05:04:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.199+0000 7ff532400640 1 --2- 172.21.15.37:0/1161038843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4c4f00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff524009be0 tx=0x7ff524030430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efe4e3527880b58e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.199+0000 7ff51ea00640 1 -- 172.21.15.37:0/1161038843 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524041030 con 0x55ee7a4c4b20 2024-08-20T05:04:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.199+0000 7ff51ea00640 1 -- 172.21.15.37:0/1161038843 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff524003e20 con 0x55ee7a4c4b20 2024-08-20T05:04:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.199+0000 7ff51ea00640 1 -- 172.21.15.37:0/1161038843 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524036040 con 0x55ee7a4c4b20 2024-08-20T05:04:00.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.200+0000 7ff537012740 1 -- 172.21.15.37:0/1161038843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c4b20 msgr2=0x55ee7a4c4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.200+0000 7ff537012740 1 --2- 172.21.15.37:0/1161038843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4c4f00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff524009be0 tx=0x7ff524030430 comp rx=0 tx=0).stop 2024-08-20T05:04:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.201+0000 7ff537012740 1 -- 172.21.15.37:0/1161038843 shutdown_connections 2024-08-20T05:04:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.201+0000 7ff537012740 1 --2- 172.21.15.37:0/1161038843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4d13d0 0x55ee7a4d37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.201+0000 7ff537012740 1 --2- 172.21.15.37:0/1161038843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4c5440 0x55ee7a4d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.201+0000 7ff537012740 1 --2- 172.21.15.37:0/1161038843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4c4f00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.201+0000 7ff537012740 1 -- 172.21.15.37:0/1161038843 >> 172.21.15.37:0/1161038843 conn(0x55ee7a4c2950 msgr2=0x55ee7a4c3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.202+0000 7ff537012740 1 -- 172.21.15.37:0/1161038843 shutdown_connections 2024-08-20T05:04:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.203+0000 7ff537012740 1 -- 172.21.15.37:0/1161038843 wait complete. 2024-08-20T05:04:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.203+0000 7ff52a000640 1 --2- 172.21.15.37:0/4081068936 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5140b3cd0 0x7ff5140b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.204+0000 7ff537012740 1 -- start start 2024-08-20T05:04:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.204+0000 7ff537012740 1 Processor -- start 2024-08-20T05:04:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.204+0000 7ff531a00640 1 --2- 172.21.15.37:0/4081068936 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5140b3cd0 0x7ff5140b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.204+0000 7ff52a000640 1 -- 172.21.15.37:0/4081068936 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff5180e37f0 con 0x7ff52c10a520 2024-08-20T05:04:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.204+0000 7ff537012740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.204+0000 7ff537012740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4c5440 0x55ee7a4ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.204+0000 7ff537012740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4ce760 0x55ee7a4cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.205+0000 7ff537012740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ee7a28c700 con 0x55ee7a4ce760 2024-08-20T05:04:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.205+0000 7ff537012740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ee7a3c5290 con 0x55ee7a4c5440 2024-08-20T05:04:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.205+0000 7ff537012740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ee7a4d3ff0 con 0x55ee7a4c4b20 2024-08-20T05:04:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.205+0000 7ff537012740 10 client.0 _ll_register_callbacks cb 0x55ee7a4241c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.205+0000 7ff531000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4c5440 0x55ee7a4ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.205+0000 7ff531000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4c5440 0x55ee7a4ce180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42754/0 (socket says 172.21.15.37:42754) 2024-08-20T05:04:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.205+0000 7ff531000640 1 -- 172.21.15.37:0/527240950 learned_addr learned my addr 172.21.15.37:0/527240950 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.205+0000 7ff531a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.205+0000 7ff532400640 1 --2- 172.21.15.37:0/527240950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4ce760 0x55ee7a4cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.205+0000 7ff531000640 1 -- 172.21.15.37:0/527240950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c4b20 msgr2=0x55ee7a4d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.205+0000 7ff531000640 1 --2- 172.21.15.37:0/527240950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4d0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.205+0000 7ff531000640 1 -- 172.21.15.37:0/527240950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4ce760 msgr2=0x55ee7a4cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.205+0000 7ff531000640 1 --2- 172.21.15.37:0/527240950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4ce760 0x55ee7a4cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.205+0000 7ff531000640 1 -- 172.21.15.37:0/527240950 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee7a189650 con 0x55ee7a4c5440 2024-08-20T05:04:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.205+0000 7ff531a00640 1 --2- 172.21.15.37:0/4081068936 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5140b3cd0 0x7ff5140b6190 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff5200096c0 tx=0x7ff520009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.205+0000 7ff531000640 1 --2- 172.21.15.37:0/527240950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4c5440 0x55ee7a4ce180 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff5180e3b10 tx=0x7ff5180a9ff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dadd98e3294e0d41 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.206+0000 7ff513400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:04:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.206+0000 7ff513400640 1 -- 172.21.15.37:0/527240950 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5180aa420 con 0x55ee7a4c5440 2024-08-20T05:04:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.206+0000 7ff513400640 1 -- 172.21.15.37:0/527240950 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff5180a4b40 con 0x55ee7a4c5440 2024-08-20T05:04:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.206+0000 7ff537012740 1 -- 172.21.15.37:0/527240950 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff524003e20 con 0x55ee7a4c5440 2024-08-20T05:04:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.206+0000 7ff513400640 1 -- 172.21.15.37:0/527240950 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff5180aea20 con 0x55ee7a4c5440 2024-08-20T05:04:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.206+0000 7ff537012740 10 client.25952 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.206+0000 7ff537012740 1 -- 172.21.15.37:0/527240950 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ee7a4f0de0 con 0x55ee7a4c5440 2024-08-20T05:04:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.207+0000 7ff513400640 1 -- 172.21.15.37:0/527240950 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff524003e20 con 0x55ee7a4c5440 2024-08-20T05:04:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.208+0000 7ff513400640 1 -- 172.21.15.37:0/527240950 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7ff5180bfac0 con 0x55ee7a4c5440 2024-08-20T05:04:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.208+0000 7ff537012740 10 client.25952 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.208+0000 7ff537012740 10 client.25952 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:04:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.208+0000 7ff537012740 20 client.25952 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.208+0000 7ff537012740 1 --2- 172.21.15.37:0/527240950 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55ee7a4f2750 0x55ee7a4f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.208+0000 7ff537012740 4 client.25952 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:04:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.208+0000 7ff537012740 1 -- 172.21.15.37:0/527240950 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee7a43c9f0 con 0x55ee7a4f2750 2024-08-20T05:04:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.209+0000 7ff531a00640 1 --2- 172.21.15.37:0/527240950 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55ee7a4f2750 0x55ee7a4f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.210+0000 7ff531a00640 1 --2- 172.21.15.37:0/527240950 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55ee7a4f2750 0x55ee7a4f4b70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=926c0e0a9e6dd045 server_cookie=64290d8675cb6b5d in_seq=0 out_seq=0 2024-08-20T05:04:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.210+0000 7ff513400640 10 client.25952 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:04:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.211+0000 7ff513400640 1 -- 172.21.15.37:0/527240950 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee7a43c9f0 con 0x55ee7a4f2750 2024-08-20T05:04:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.211+0000 7ff513400640 10 client.25952 handle_command_reply: tid=0 2024-08-20T05:04:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.212+0000 7ff537012740 1 client.25952 shutdown 2024-08-20T05:04:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.212+0000 7ff537012740 1 -- 172.21.15.37:0/527240950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4c5440 msgr2=0x55ee7a4ce180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:00.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.212+0000 7ff537012740 1 --2- 172.21.15.37:0/527240950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4c5440 0x55ee7a4ce180 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff5180e3b10 tx=0x7ff5180a9ff0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.212+0000 7ff537012740 1 -- 172.21.15.37:0/527240950 shutdown_connections 2024-08-20T05:04:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.212+0000 7ff537012740 1 --2- 172.21.15.37:0/527240950 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55ee7a4f2750 0x55ee7a4f4b70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.212+0000 7ff537012740 1 --2- 172.21.15.37:0/527240950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4ce760 0x55ee7a4cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.212+0000 7ff537012740 1 --2- 172.21.15.37:0/527240950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4c5440 0x55ee7a4ce180 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.212+0000 7ff537012740 1 --2- 172.21.15.37:0/527240950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4d0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.212+0000 7ff537012740 1 -- 172.21.15.37:0/527240950 >> 172.21.15.37:0/527240950 conn(0x55ee7a4c2950 msgr2=0x55ee7a4c1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.212+0000 7ff513400640 0 client.25952 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:04:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.213+0000 7ff537012740 1 -- 172.21.15.37:0/527240950 shutdown_connections 2024-08-20T05:04:00.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.214+0000 7ff537012740 1 -- 172.21.15.37:0/527240950 wait complete. 2024-08-20T05:04:00.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.214+0000 7ff537012740 20 client.25952 trim_cache size 0 max 16384 2024-08-20T05:04:00.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.241+0000 7ff537012740 1 Processor -- start 2024-08-20T05:04:00.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.241+0000 7ff537012740 1 -- start start 2024-08-20T05:04:00.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.241+0000 7ff537012740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4c2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.241+0000 7ff537012740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c5440 0x55ee7a4c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.241+0000 7ff537012740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4ce760 0x55ee7a4fa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.241+0000 7ff537012740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c1ad340 con 0x55ee7a4ce760 2024-08-20T05:04:00.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.241+0000 7ff537012740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c1aef40 con 0x55ee7a4c4b20 2024-08-20T05:04:00.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.241+0000 7ff537012740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c1ada10 con 0x55ee7a4c5440 2024-08-20T05:04:00.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.242+0000 7ff532400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4ce760 0x55ee7a4fa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:00.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.242+0000 7ff532400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4ce760 0x55ee7a4fa460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35590/0 (socket says 172.21.15.37:35590) 2024-08-20T05:04:00.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.242+0000 7ff532400640 1 -- 172.21.15.37:0/2827233457 learned_addr learned my addr 172.21.15.37:0/2827233457 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:00.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.242+0000 7ff531000640 1 --2- 172.21.15.37:0/2827233457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c5440 0x55ee7a4c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:00.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.242+0000 7ff531a00640 1 --2- 172.21.15.37:0/2827233457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:00.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.243+0000 7ff532400640 1 -- 172.21.15.37:0/2827233457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c5440 msgr2=0x55ee7a4c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:00.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.243+0000 7ff532400640 1 --2- 172.21.15.37:0/2827233457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c5440 0x55ee7a4c3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.243+0000 7ff532400640 1 -- 172.21.15.37:0/2827233457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4c4b20 msgr2=0x55ee7a4c2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:00.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.243+0000 7ff532400640 1 --2- 172.21.15.37:0/2827233457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4c2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.243+0000 7ff532400640 1 -- 172.21.15.37:0/2827233457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee7a4f51d0 con 0x55ee7a4ce760 2024-08-20T05:04:00.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.243+0000 7ff531000640 1 --2- 172.21.15.37:0/2827233457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c5440 0x55ee7a4c3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:04:00.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.243+0000 7ff532400640 1 --2- 172.21.15.37:0/2827233457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4ce760 0x55ee7a4fa460 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff524000f80 tx=0x7ff5240307e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d01773b6271b22b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:00.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.244+0000 7ff51e000640 1 -- 172.21.15.37:0/2827233457 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524036070 con 0x55ee7a4ce760 2024-08-20T05:04:00.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.244+0000 7ff51e000640 1 -- 172.21.15.37:0/2827233457 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff52404a070 con 0x55ee7a4ce760 2024-08-20T05:04:00.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.244+0000 7ff51e000640 1 -- 172.21.15.37:0/2827233457 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524041050 con 0x55ee7a4ce760 2024-08-20T05:04:00.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.245+0000 7ff537012740 1 -- 172.21.15.37:0/2827233457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4ce760 msgr2=0x55ee7a4fa460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:00.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.245+0000 7ff537012740 1 --2- 172.21.15.37:0/2827233457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4ce760 0x55ee7a4fa460 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff524000f80 tx=0x7ff5240307e0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.246+0000 7ff537012740 1 -- 172.21.15.37:0/2827233457 shutdown_connections 2024-08-20T05:04:00.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.246+0000 7ff537012740 1 --2- 172.21.15.37:0/2827233457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4ce760 0x55ee7a4fa460 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.246+0000 7ff537012740 1 --2- 172.21.15.37:0/2827233457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4c5440 0x55ee7a4c3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.246+0000 7ff537012740 1 --2- 172.21.15.37:0/2827233457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4c2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.246+0000 7ff537012740 1 -- 172.21.15.37:0/2827233457 >> 172.21.15.37:0/2827233457 conn(0x55ee7a4c2950 msgr2=0x55ee7a4cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:00.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.247+0000 7ff537012740 1 -- 172.21.15.37:0/2827233457 shutdown_connections 2024-08-20T05:04:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.247+0000 7ff537012740 1 -- 172.21.15.37:0/2827233457 wait complete. 2024-08-20T05:04:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.247+0000 7ff537012740 1 -- start start 2024-08-20T05:04:00.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.248+0000 7ff537012740 1 Processor -- start 2024-08-20T05:04:00.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.249+0000 7ff537012740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4eac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.249+0000 7ff537012740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4c5440 0x55ee7a4e6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.250+0000 7ff537012740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4ce760 0x55ee7a4e68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.250+0000 7ff532400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4ce760 0x55ee7a4e68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:00.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.250+0000 7ff532400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4ce760 0x55ee7a4e68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46410/0 (socket says 172.21.15.37:46410) 2024-08-20T05:04:00.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.250+0000 7ff532400640 1 -- 172.21.15.37:0/4048874427 learned_addr learned my addr 172.21.15.37:0/4048874427 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:00.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.250+0000 7ff531000640 1 --2- 172.21.15.37:0/4048874427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4c5440 0x55ee7a4e6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:00.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.250+0000 7ff537012740 1 -- 172.21.15.37:0/4048874427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c1ae7b0 con 0x55ee7a4c5440 2024-08-20T05:04:00.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.250+0000 7ff537012740 1 -- 172.21.15.37:0/4048874427 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c1ae0e0 con 0x55ee7a4c4b20 2024-08-20T05:04:00.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.250+0000 7ff531a00640 1 --2- 172.21.15.37:0/4048874427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:00.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.250+0000 7ff537012740 1 -- 172.21.15.37:0/4048874427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c1ab380 con 0x55ee7a4ce760 2024-08-20T05:04:00.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.251+0000 7ff537012740 10 client.0 _ll_register_callbacks cb 0x7ff51800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:00.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.251+0000 7ff532400640 1 -- 172.21.15.37:0/4048874427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4c4b20 msgr2=0x55ee7a4eac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:00.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.251+0000 7ff532400640 1 --2- 172.21.15.37:0/4048874427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4eac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.251+0000 7ff532400640 1 -- 172.21.15.37:0/4048874427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4c5440 msgr2=0x55ee7a4e6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:00.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.251+0000 7ff532400640 1 --2- 172.21.15.37:0/4048874427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4c5440 0x55ee7a4e6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.251+0000 7ff532400640 1 -- 172.21.15.37:0/4048874427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee7a4c8b10 con 0x55ee7a4ce760 2024-08-20T05:04:00.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.251+0000 7ff531000640 1 --2- 172.21.15.37:0/4048874427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4c5440 0x55ee7a4e6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:04:00.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.252+0000 7ff532400640 1 --2- 172.21.15.37:0/4048874427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4ce760 0x55ee7a4e68c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff5240098f0 tx=0x7ff5240308d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5782f83e50e51dee server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:00.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.252+0000 7ff513400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:04:00.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.253+0000 7ff513400640 1 -- 172.21.15.37:0/4048874427 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524041070 con 0x55ee7a4ce760 2024-08-20T05:04:00.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.253+0000 7ff513400640 1 -- 172.21.15.37:0/4048874427 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff524030b70 con 0x55ee7a4ce760 2024-08-20T05:04:00.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.254+0000 7ff537012740 1 -- 172.21.15.37:0/4048874427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff52404a070 con 0x55ee7a4ce760 2024-08-20T05:04:00.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.254+0000 7ff513400640 1 -- 172.21.15.37:0/4048874427 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff52405f050 con 0x55ee7a4ce760 2024-08-20T05:04:00.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.254+0000 7ff537012740 10 client.25975 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:00.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.254+0000 7ff537012740 1 -- 172.21.15.37:0/4048874427 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ee7a55d4f0 con 0x55ee7a4ce760 2024-08-20T05:04:00.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.255+0000 7ff513400640 1 -- 172.21.15.37:0/4048874427 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff52404a070 con 0x55ee7a4ce760 2024-08-20T05:04:00.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.255+0000 7ff513400640 1 -- 172.21.15.37:0/4048874427 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7ff5240594e0 con 0x55ee7a4ce760 2024-08-20T05:04:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.255+0000 7ff537012740 10 client.25975 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.255+0000 7ff537012740 10 client.25975 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:04:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.256+0000 7ff537012740 20 client.25975 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.256+0000 7ff537012740 1 --2- 172.21.15.37:0/4048874427 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55ee7a55d6c0 0x55ee7a55fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.256+0000 7ff537012740 4 client.25975 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:04:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.256+0000 7ff537012740 1 -- 172.21.15.37:0/4048874427 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ee7a438490 con 0x55ee7a55d6c0 2024-08-20T05:04:00.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.256+0000 7ff531a00640 1 --2- 172.21.15.37:0/4048874427 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55ee7a55d6c0 0x55ee7a55fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:00.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.256+0000 7ff531a00640 1 --2- 172.21.15.37:0/4048874427 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55ee7a55d6c0 0x55ee7a55fab0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=31ae789da4282c49 server_cookie=14820939f84faf74 in_seq=0 out_seq=0 2024-08-20T05:04:00.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.256+0000 7ff513400640 10 client.25975 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:04:00.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.257+0000 7ff513400640 1 -- 172.21.15.37:0/4048874427 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ee7a438490 con 0x55ee7a55d6c0 2024-08-20T05:04:00.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.257+0000 7ff513400640 10 client.25975 handle_command_reply: tid=0 2024-08-20T05:04:00.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.257+0000 7ff537012740 1 client.25975 shutdown 2024-08-20T05:04:00.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.257+0000 7ff537012740 1 -- 172.21.15.37:0/4048874427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4ce760 msgr2=0x55ee7a4e68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:00.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.257+0000 7ff537012740 1 --2- 172.21.15.37:0/4048874427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4ce760 0x55ee7a4e68c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff5240098f0 tx=0x7ff5240308d0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.257+0000 7ff537012740 1 -- 172.21.15.37:0/4048874427 shutdown_connections 2024-08-20T05:04:00.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.257+0000 7ff537012740 1 --2- 172.21.15.37:0/4048874427 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55ee7a55d6c0 0x55ee7a55fab0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.257+0000 7ff537012740 1 --2- 172.21.15.37:0/4048874427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ee7a4ce760 0x55ee7a4e68c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.257+0000 7ff537012740 1 --2- 172.21.15.37:0/4048874427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee7a4c5440 0x55ee7a4e6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.257+0000 7ff537012740 1 --2- 172.21.15.37:0/4048874427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ee7a4c4b20 0x55ee7a4eac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.257+0000 7ff537012740 1 -- 172.21.15.37:0/4048874427 >> 172.21.15.37:0/4048874427 conn(0x55ee7a4c2950 msgr2=0x55ee7a4c7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:00.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.257+0000 7ff513400640 0 client.25975 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:04:00.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.258+0000 7ff537012740 1 -- 172.21.15.37:0/4048874427 shutdown_connections 2024-08-20T05:04:00.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.258+0000 7ff537012740 1 -- 172.21.15.37:0/4048874427 wait complete. 2024-08-20T05:04:00.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.259+0000 7ff537012740 20 client.25975 trim_cache size 0 max 16384 2024-08-20T05:04:00.261 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:04:00.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.259+0000 7ff532e00640 1 -- 172.21.15.37:0/4081068936 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5140b3cd0 msgr2=0x7ff5140b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:00.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.259+0000 7ff532e00640 1 --2- 172.21.15.37:0/4081068936 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5140b3cd0 0x7ff5140b6190 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff5200096c0 tx=0x7ff520009260 comp rx=0 tx=0).stop 2024-08-20T05:04:00.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.259+0000 7ff532e00640 1 -- 172.21.15.37:0/4081068936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52c10a520 msgr2=0x7ff52c19b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:00.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.259+0000 7ff532e00640 1 --2- 172.21.15.37:0/4081068936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52c10a520 0x7ff52c19b3f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff51800d950 tx=0x7ff51800de10 comp rx=0 tx=0).stop 2024-08-20T05:04:00.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.260+0000 7ff532e00640 1 -- 172.21.15.37:0/4081068936 shutdown_connections 2024-08-20T05:04:00.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.260+0000 7ff532e00640 1 --2- 172.21.15.37:0/4081068936 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5140b3cd0 0x7ff5140b6190 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.260+0000 7ff532e00640 1 --2- 172.21.15.37:0/4081068936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff52c10aea0 0x7ff52c1a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.260+0000 7ff532e00640 1 --2- 172.21.15.37:0/4081068936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52c10a520 0x7ff52c19b3f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.260+0000 7ff532e00640 1 --2- 172.21.15.37:0/4081068936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff52c104b10 0x7ff52c19aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:00.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.260+0000 7ff532e00640 1 -- 172.21.15.37:0/4081068936 >> 172.21.15.37:0/4081068936 conn(0x7ff52c100540 msgr2=0x7ff52c103a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:00.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.260+0000 7ff532e00640 1 -- 172.21.15.37:0/4081068936 shutdown_connections 2024-08-20T05:04:00.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:00.260+0000 7ff532e00640 1 -- 172.21.15.37:0/4081068936 wait complete. 2024-08-20T05:04:01.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T05:04:01.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:01 smithi037 ceph-mon[17265]: pgmap v454: 129 pgs: 129 active+clean; 975 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 8.7 MiB/s wr, 406 op/s 2024-08-20T05:04:01.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:01 smithi135 ceph-mon[22342]: pgmap v454: 129 pgs: 129 active+clean; 975 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 8.7 MiB/s wr, 406 op/s 2024-08-20T05:04:01.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:01 smithi130 ceph-mon[22007]: pgmap v454: 129 pgs: 129 active+clean; 975 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 8.7 MiB/s wr, 406 op/s 2024-08-20T05:04:01.978 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:04:02.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.756+0000 7f4c1d600640 1 -- 172.21.15.37:0/3287233359 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c037070 con 0x7f4c20108320 2024-08-20T05:04:02.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.757+0000 7f4c1fe00640 1 -- 172.21.15.37:0/3287233359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c20108320 msgr2=0x7f4c20108760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:02.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.757+0000 7f4c1fe00640 1 --2- 172.21.15.37:0/3287233359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c20108320 0x7f4c20108760 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009860 tx=0x7f4c0c02a340 comp rx=0 tx=0).stop 2024-08-20T05:04:02.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.757+0000 7f4c1fe00640 1 -- 172.21.15.37:0/3287233359 shutdown_connections 2024-08-20T05:04:02.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.757+0000 7f4c1fe00640 1 --2- 172.21.15.37:0/3287233359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c20108ca0 0x7f4c2010f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.758+0000 7f4c1fe00640 1 --2- 172.21.15.37:0/3287233359 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c20108320 0x7f4c20108760 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.758+0000 7f4c1fe00640 1 --2- 172.21.15.37:0/3287233359 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c20102910 0x7f4c20102cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.758+0000 7f4c1fe00640 1 -- 172.21.15.37:0/3287233359 >> 172.21.15.37:0/3287233359 conn(0x7f4c200fe3c0 msgr2=0x7f4c201007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:02.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.758+0000 7f4c1fe00640 1 -- 172.21.15.37:0/3287233359 shutdown_connections 2024-08-20T05:04:02.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.758+0000 7f4c1fe00640 1 -- 172.21.15.37:0/3287233359 wait complete. 2024-08-20T05:04:02.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.761+0000 7f4c1fe00640 1 Processor -- start 2024-08-20T05:04:02.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.762+0000 7f4c1fe00640 1 -- start start 2024-08-20T05:04:02.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.763+0000 7f4c1fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c20102910 0x7f4c2010c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.763+0000 7f4c1fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c20108320 0x7f4c2010c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.763+0000 7f4c1fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c20108ca0 0x7f4c201a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.763+0000 7f4c1fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4c20076a80 con 0x7f4c20108320 2024-08-20T05:04:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.763+0000 7f4c1fe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4c20076900 con 0x7f4c20108ca0 2024-08-20T05:04:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.763+0000 7f4c1fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4c20076c00 con 0x7f4c20102910 2024-08-20T05:04:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.763+0000 7f4c1ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c20102910 0x7f4c2010c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.763+0000 7f4c1ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c20102910 0x7f4c2010c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46432/0 (socket says 172.21.15.37:46432) 2024-08-20T05:04:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.763+0000 7f4c1ea00640 1 -- 172.21.15.37:0/884864065 learned_addr learned my addr 172.21.15.37:0/884864065 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.763+0000 7f4c1f400640 1 --2- 172.21.15.37:0/884864065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c20108ca0 0x7f4c201a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.763+0000 7f4c1ea00640 1 -- 172.21.15.37:0/884864065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c20108ca0 msgr2=0x7f4c201a3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.763+0000 7f4c1ea00640 1 --2- 172.21.15.37:0/884864065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c20108ca0 0x7f4c201a3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.763+0000 7f4c1ea00640 1 -- 172.21.15.37:0/884864065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c20108320 msgr2=0x7f4c2010c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.763+0000 7f4c1ea00640 1 --2- 172.21.15.37:0/884864065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c20108320 0x7f4c2010c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.764+0000 7f4c1ea00640 1 -- 172.21.15.37:0/884864065 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c201a40e0 con 0x7f4c20102910 2024-08-20T05:04:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.764+0000 7f4c1ea00640 1 --2- 172.21.15.37:0/884864065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c20102910 0x7f4c2010c250 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000d950 tx=0x7f4c1000de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.764+0000 7f4c17400640 1 -- 172.21.15.37:0/884864065 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c10017070 con 0x7f4c20102910 2024-08-20T05:04:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.764+0000 7f4c17400640 1 -- 172.21.15.37:0/884864065 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c10009c30 con 0x7f4c20102910 2024-08-20T05:04:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.764+0000 7f4c17400640 1 -- 172.21.15.37:0/884864065 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000f620 con 0x7f4c20102910 2024-08-20T05:04:02.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.764+0000 7f4c1fe00640 1 -- 172.21.15.37:0/884864065 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c201a43d0 con 0x7f4c20102910 2024-08-20T05:04:02.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.764+0000 7f4c1fe00640 1 -- 172.21.15.37:0/884864065 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c201abb60 con 0x7f4c20102910 2024-08-20T05:04:02.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.770+0000 7f4c2888f740 1 Processor -- start 2024-08-20T05:04:02.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.770+0000 7f4c17400640 1 -- 172.21.15.37:0/884864065 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4c10010460 con 0x7f4c20102910 2024-08-20T05:04:02.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.770+0000 7f4c2888f740 1 -- start start 2024-08-20T05:04:02.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.771+0000 7f4c2888f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c1ac0 0x5588ec5c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.771+0000 7f4c2888f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5c23e0 0x5588ec5cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.771+0000 7f4c2888f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5ce370 0x5588ec5d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.771+0000 7f4c2888f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5588ec537aa0 con 0x5588ec5ce370 2024-08-20T05:04:02.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.771+0000 7f4c2888f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5588ec526fa0 con 0x5588ec5c23e0 2024-08-20T05:04:02.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.771+0000 7f4c2888f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5588ec52afe0 con 0x5588ec5c1ac0 2024-08-20T05:04:02.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.771+0000 7f4c1f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c1ac0 0x5588ec5c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:02.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.771+0000 7f4c1f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c1ac0 0x5588ec5c1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46448/0 (socket says 172.21.15.37:46448) 2024-08-20T05:04:02.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.771+0000 7f4c1f400640 1 -- 172.21.15.37:0/2187332579 learned_addr learned my addr 172.21.15.37:0/2187332579 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:02.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.772+0000 7f4c1e000640 1 --2- 172.21.15.37:0/2187332579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5ce370 0x5588ec5d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:02.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.772+0000 7f4c17400640 1 --2- 172.21.15.37:0/884864065 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4c040b3d70 0x7f4c040b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.772+0000 7f4c1f400640 1 -- 172.21.15.37:0/2187332579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5c23e0 msgr2=0x5588ec5cde30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:04:02.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.772+0000 7f4c1f400640 1 --2- 172.21.15.37:0/2187332579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5c23e0 0x5588ec5cde30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.772+0000 7f4c1f400640 1 -- 172.21.15.37:0/2187332579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5ce370 msgr2=0x5588ec5d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:02.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.772+0000 7f4c1f400640 1 --2- 172.21.15.37:0/2187332579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5ce370 0x5588ec5d0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.772+0000 7f4c1f400640 1 -- 172.21.15.37:0/2187332579 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ec4cd420 con 0x5588ec5c1ac0 2024-08-20T05:04:02.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.772+0000 7f4c17400640 1 -- 172.21.15.37:0/884864065 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4c100e3c80 con 0x7f4c20102910 2024-08-20T05:04:02.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.772+0000 7f4c1f400640 1 --2- 172.21.15.37:0/2187332579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c1ac0 0x5588ec5c1ea0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009fc0 tx=0x7f4c18010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ca6599be7f32752 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:02.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.772+0000 7f4c1f400640 1 --2- 172.21.15.37:0/884864065 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4c040b3d70 0x7f4c040b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:02.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.774+0000 7f4c0be00640 1 -- 172.21.15.37:0/2187332579 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c18024070 con 0x5588ec5c1ac0 2024-08-20T05:04:02.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.774+0000 7f4c0be00640 1 -- 172.21.15.37:0/2187332579 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c180044f0 con 0x5588ec5c1ac0 2024-08-20T05:04:02.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.774+0000 7f4c0be00640 1 -- 172.21.15.37:0/2187332579 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1801d3a0 con 0x5588ec5c1ac0 2024-08-20T05:04:02.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.775+0000 7f4c2888f740 1 -- 172.21.15.37:0/2187332579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c1ac0 msgr2=0x5588ec5c1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:02.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.775+0000 7f4c1f400640 1 --2- 172.21.15.37:0/884864065 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4c040b3d70 0x7f4c040b6230 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4c18021000 tx=0x7f4c1801d680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:02.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.775+0000 7f4c2888f740 1 --2- 172.21.15.37:0/2187332579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c1ac0 0x5588ec5c1ea0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4c18009fc0 tx=0x7f4c18010860 comp rx=0 tx=0).stop 2024-08-20T05:04:02.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.775+0000 7f4c2888f740 1 -- 172.21.15.37:0/2187332579 shutdown_connections 2024-08-20T05:04:02.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.775+0000 7f4c2888f740 1 --2- 172.21.15.37:0/2187332579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5ce370 0x5588ec5d0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.775+0000 7f4c2888f740 1 --2- 172.21.15.37:0/2187332579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5c23e0 0x5588ec5cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.775+0000 7f4c2888f740 1 --2- 172.21.15.37:0/2187332579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c1ac0 0x5588ec5c1ea0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.775+0000 7f4c2888f740 1 -- 172.21.15.37:0/2187332579 >> 172.21.15.37:0/2187332579 conn(0x5588ec5bf8f0 msgr2=0x5588ec5c0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:02.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.776+0000 7f4c2888f740 1 -- 172.21.15.37:0/2187332579 shutdown_connections 2024-08-20T05:04:02.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.776+0000 7f4c2888f740 1 -- 172.21.15.37:0/2187332579 wait complete. 2024-08-20T05:04:02.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.776+0000 7f4c2888f740 1 -- start start 2024-08-20T05:04:02.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.777+0000 7f4c2888f740 1 Processor -- start 2024-08-20T05:04:02.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.777+0000 7f4c2888f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5c1ac0 0x5588ec5cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.778+0000 7f4c2888f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5c23e0 0x5588ec5cb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.778+0000 7f4c2888f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5ce370 0x5588ec5cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.778+0000 7f4c2888f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5588ec389700 con 0x5588ec5c1ac0 2024-08-20T05:04:02.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.778+0000 7f4c2888f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5588ec4c2290 con 0x5588ec5c23e0 2024-08-20T05:04:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.778+0000 7f4c1ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5c1ac0 0x5588ec5cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.778+0000 7f4c1ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5c1ac0 0x5588ec5cdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35628/0 (socket says 172.21.15.37:35628) 2024-08-20T05:04:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.778+0000 7f4c1ea00640 1 -- 172.21.15.37:0/1651217657 learned_addr learned my addr 172.21.15.37:0/1651217657 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.778+0000 7f4c1e000640 1 --2- 172.21.15.37:0/1651217657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5c23e0 0x5588ec5cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.778+0000 7f4c1f400640 1 --2- 172.21.15.37:0/1651217657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5ce370 0x5588ec5cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.778+0000 7f4c2888f740 1 -- 172.21.15.37:0/1651217657 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5588ec5d0ff0 con 0x5588ec5ce370 2024-08-20T05:04:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.778+0000 7f4c2888f740 10 client.0 _ll_register_callbacks cb 0x5588ec5211c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.779+0000 7f4c1ea00640 1 -- 172.21.15.37:0/1651217657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5ce370 msgr2=0x5588ec5cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.779+0000 7f4c1ea00640 1 --2- 172.21.15.37:0/1651217657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5ce370 0x5588ec5cb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.779+0000 7f4c1ea00640 1 -- 172.21.15.37:0/1651217657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5c23e0 msgr2=0x5588ec5cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:02.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.779+0000 7f4c1ea00640 1 --2- 172.21.15.37:0/1651217657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5c23e0 0x5588ec5cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.779+0000 7f4c1ea00640 1 -- 172.21.15.37:0/1651217657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588ec286650 con 0x5588ec5c1ac0 2024-08-20T05:04:02.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.779+0000 7f4c1e000640 1 --2- 172.21.15.37:0/1651217657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5c23e0 0x5588ec5cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:04:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.781+0000 7f4c1ea00640 1 --2- 172.21.15.37:0/1651217657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5c1ac0 0x5588ec5cdbe0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4c100aa4d0 tx=0x7f4c100aa420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91149ac2fb28e5ba server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:02.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.781+0000 7f4c08c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:04:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.783+0000 7f4c08c00640 1 -- 172.21.15.37:0/1651217657 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c10020070 con 0x5588ec5c1ac0 2024-08-20T05:04:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.783+0000 7f4c08c00640 1 -- 172.21.15.37:0/1651217657 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4c100cd0a0 con 0x5588ec5c1ac0 2024-08-20T05:04:02.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.783+0000 7f4c2888f740 1 -- 172.21.15.37:0/1651217657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c180044f0 con 0x5588ec5c1ac0 2024-08-20T05:04:02.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.784+0000 7f4c08c00640 1 -- 172.21.15.37:0/1651217657 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4c100aa7d0 con 0x5588ec5c1ac0 2024-08-20T05:04:02.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.784+0000 7f4c2888f740 10 client.15891 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:02.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.784+0000 7f4c2888f740 1 -- 172.21.15.37:0/1651217657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5588ec5dc8a0 con 0x5588ec5c1ac0 2024-08-20T05:04:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.785+0000 7f4c08c00640 1 -- 172.21.15.37:0/1651217657 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c180044f0 con 0x5588ec5c1ac0 2024-08-20T05:04:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.785+0000 7f4c08c00640 1 -- 172.21.15.37:0/1651217657 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f4c10010750 con 0x5588ec5c1ac0 2024-08-20T05:04:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.785+0000 7f4c2888f740 10 client.15891 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.785+0000 7f4c2888f740 10 client.15891 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:04:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.785+0000 7f4c2888f740 20 client.15891 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.785+0000 7f4c2888f740 1 --2- 172.21.15.37:0/1651217657 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5588ec5ddd00 0x5588ec5e0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.785+0000 7f4c2888f740 4 client.15891 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:04:02.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.785+0000 7f4c2888f740 1 -- 172.21.15.37:0/1651217657 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588ec5399f0 con 0x5588ec5ddd00 2024-08-20T05:04:02.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.786+0000 7f4c1e000640 1 --2- 172.21.15.37:0/1651217657 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5588ec5ddd00 0x5588ec5e0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:02.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.787+0000 7f4c1e000640 1 --2- 172.21.15.37:0/1651217657 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5588ec5ddd00 0x5588ec5e0110 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8809bc544e32051 server_cookie=cc44962aa4ae89cd in_seq=0 out_seq=0 2024-08-20T05:04:02.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.787+0000 7f4c08c00640 10 client.15891 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:04:02.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.788+0000 7f4c08c00640 1 -- 172.21.15.37:0/1651217657 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5588ec5399f0 con 0x5588ec5ddd00 2024-08-20T05:04:02.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.788+0000 7f4c08c00640 10 client.15891 handle_command_reply: tid=0 2024-08-20T05:04:02.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.788+0000 7f4c2888f740 1 client.15891 shutdown 2024-08-20T05:04:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.789+0000 7f4c2888f740 1 -- 172.21.15.37:0/1651217657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5c1ac0 msgr2=0x5588ec5cdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.789+0000 7f4c2888f740 1 --2- 172.21.15.37:0/1651217657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5c1ac0 0x5588ec5cdbe0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4c100aa4d0 tx=0x7f4c100aa420 comp rx=0 tx=0).stop 2024-08-20T05:04:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.789+0000 7f4c2888f740 1 -- 172.21.15.37:0/1651217657 shutdown_connections 2024-08-20T05:04:02.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.789+0000 7f4c2888f740 1 --2- 172.21.15.37:0/1651217657 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5588ec5ddd00 0x5588ec5e0110 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.789+0000 7f4c2888f740 1 --2- 172.21.15.37:0/1651217657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5ce370 0x5588ec5cb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.789+0000 7f4c2888f740 1 --2- 172.21.15.37:0/1651217657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5c23e0 0x5588ec5cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.789+0000 7f4c2888f740 1 --2- 172.21.15.37:0/1651217657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5c1ac0 0x5588ec5cdbe0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.789+0000 7f4c2888f740 1 -- 172.21.15.37:0/1651217657 >> 172.21.15.37:0/1651217657 conn(0x5588ec5bf8f0 msgr2=0x5588ec5c5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.789+0000 7f4c08c00640 0 client.15891 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:04:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.789+0000 7f4c2888f740 1 -- 172.21.15.37:0/1651217657 shutdown_connections 2024-08-20T05:04:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.789+0000 7f4c2888f740 1 -- 172.21.15.37:0/1651217657 wait complete. 2024-08-20T05:04:02.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.790+0000 7f4c2888f740 20 client.15891 trim_cache size 0 max 16384 2024-08-20T05:04:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.809+0000 7f4c2888f740 1 Processor -- start 2024-08-20T05:04:02.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.809+0000 7f4c2888f740 1 -- start start 2024-08-20T05:04:02.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.810+0000 7f4c2888f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5c1ac0 0x5588ec5ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.810+0000 7f4c2888f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c23e0 0x5588ec5e59e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.810+0000 7f4c2888f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5ce370 0x5588ec5e5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.810+0000 7f4c2888f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b5be0 con 0x5588ec5c1ac0 2024-08-20T05:04:02.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.810+0000 7f4c2888f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b77e0 con 0x5588ec5ce370 2024-08-20T05:04:02.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.810+0000 7f4c2888f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b62b0 con 0x5588ec5c23e0 2024-08-20T05:04:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.810+0000 7f4c1e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c23e0 0x5588ec5e59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.810+0000 7f4c1e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c23e0 0x5588ec5e59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46472/0 (socket says 172.21.15.37:46472) 2024-08-20T05:04:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.811+0000 7f4c1e000640 1 -- 172.21.15.37:0/3772514895 learned_addr learned my addr 172.21.15.37:0/3772514895 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.811+0000 7f4c1f400640 1 --2- 172.21.15.37:0/3772514895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5ce370 0x5588ec5e5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:02.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.811+0000 7f4c1e000640 1 -- 172.21.15.37:0/3772514895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5ce370 msgr2=0x5588ec5e5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:02.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.811+0000 7f4c1e000640 1 --2- 172.21.15.37:0/3772514895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5ce370 0x5588ec5e5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.811+0000 7f4c1e000640 1 -- 172.21.15.37:0/3772514895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5c1ac0 msgr2=0x5588ec5ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:02.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.811+0000 7f4c1e000640 1 --2- 172.21.15.37:0/3772514895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5c1ac0 0x5588ec5ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.811+0000 7f4c1e000640 1 -- 172.21.15.37:0/3772514895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ec5c0370 con 0x5588ec5c23e0 2024-08-20T05:04:02.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.811+0000 7f4c1e000640 1 --2- 172.21.15.37:0/3772514895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c23e0 0x5588ec5e59e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c035040 tx=0x7f4c0c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb859ed6f4ebb2df server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:02.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.812+0000 7f4c0b400640 1 -- 172.21.15.37:0/3772514895 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c037040 con 0x5588ec5c23e0 2024-08-20T05:04:02.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.812+0000 7f4c0b400640 1 -- 172.21.15.37:0/3772514895 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c0c030340 con 0x5588ec5c23e0 2024-08-20T05:04:02.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.812+0000 7f4c0b400640 1 -- 172.21.15.37:0/3772514895 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c030780 con 0x5588ec5c23e0 2024-08-20T05:04:02.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.813+0000 7f4c2888f740 1 -- 172.21.15.37:0/3772514895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c23e0 msgr2=0x5588ec5e59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:02.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.813+0000 7f4c2888f740 1 --2- 172.21.15.37:0/3772514895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c23e0 0x5588ec5e59e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c035040 tx=0x7f4c0c00b040 comp rx=0 tx=0).stop 2024-08-20T05:04:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.815+0000 7f4c2888f740 1 -- 172.21.15.37:0/3772514895 shutdown_connections 2024-08-20T05:04:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.815+0000 7f4c2888f740 1 --2- 172.21.15.37:0/3772514895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5ce370 0x5588ec5e5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.815+0000 7f4c2888f740 1 --2- 172.21.15.37:0/3772514895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c23e0 0x5588ec5e59e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.815+0000 7f4c2888f740 1 --2- 172.21.15.37:0/3772514895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5c1ac0 0x5588ec5ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.815+0000 7f4c2888f740 1 -- 172.21.15.37:0/3772514895 >> 172.21.15.37:0/3772514895 conn(0x5588ec5bf8f0 msgr2=0x5588ec5cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.816+0000 7f4c2888f740 1 -- 172.21.15.37:0/3772514895 shutdown_connections 2024-08-20T05:04:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.816+0000 7f4c2888f740 1 -- 172.21.15.37:0/3772514895 wait complete. 2024-08-20T05:04:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.816+0000 7f4c2888f740 1 -- start start 2024-08-20T05:04:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.817+0000 7f4c2888f740 1 Processor -- start 2024-08-20T05:04:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.817+0000 7f4c2888f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c1ac0 0x5588ec5d39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.817+0000 7f4c2888f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5c23e0 0x5588ec5d3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.817+0000 7f4c2888f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5ce370 0x5588ec6469b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.817+0000 7f4c2888f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b7050 con 0x5588ec5c23e0 2024-08-20T05:04:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.817+0000 7f4c2888f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b6980 con 0x5588ec5ce370 2024-08-20T05:04:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.817+0000 7f4c2888f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4c201b3bc0 con 0x5588ec5c1ac0 2024-08-20T05:04:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.817+0000 7f4c2888f740 10 client.0 _ll_register_callbacks cb 0x7f4c1000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.818+0000 7f4c1ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c1ac0 0x5588ec5d39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.818+0000 7f4c1ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c1ac0 0x5588ec5d39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33088/0 (socket says 172.21.15.37:33088) 2024-08-20T05:04:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.818+0000 7f4c1ea00640 1 -- 172.21.15.37:0/3125063257 learned_addr learned my addr 172.21.15.37:0/3125063257 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.818+0000 7f4c1f400640 1 --2- 172.21.15.37:0/3125063257 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5ce370 0x5588ec6469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.818+0000 7f4c1e000640 1 --2- 172.21.15.37:0/3125063257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5c23e0 0x5588ec5d3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.818+0000 7f4c1ea00640 1 -- 172.21.15.37:0/3125063257 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5ce370 msgr2=0x5588ec6469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.818+0000 7f4c1ea00640 1 --2- 172.21.15.37:0/3125063257 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5ce370 0x5588ec6469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.818+0000 7f4c1ea00640 1 -- 172.21.15.37:0/3125063257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5c23e0 msgr2=0x5588ec5d3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.818+0000 7f4c1ea00640 1 --2- 172.21.15.37:0/3125063257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5c23e0 0x5588ec5d3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.818+0000 7f4c1ea00640 1 -- 172.21.15.37:0/3125063257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588ec6470c0 con 0x5588ec5c1ac0 2024-08-20T05:04:02.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.819+0000 7f4c1ea00640 1 --2- 172.21.15.37:0/3125063257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c1ac0 0x5588ec5d39e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4c100aa760 tx=0x7f4c100a6370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a513addac9c016a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:02.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.819+0000 7f4c08c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:04:02.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.821+0000 7f4c08c00640 1 -- 172.21.15.37:0/3125063257 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c10014020 con 0x5588ec5c1ac0 2024-08-20T05:04:02.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.821+0000 7f4c08c00640 1 -- 172.21.15.37:0/3125063257 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4c100a97f0 con 0x5588ec5c1ac0 2024-08-20T05:04:02.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.821+0000 7f4c2888f740 1 -- 172.21.15.37:0/3125063257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c0c030340 con 0x5588ec5c1ac0 2024-08-20T05:04:02.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.822+0000 7f4c08c00640 1 -- 172.21.15.37:0/3125063257 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4c10020030 con 0x5588ec5c1ac0 2024-08-20T05:04:02.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.822+0000 7f4c2888f740 10 client.25993 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:02.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.822+0000 7f4c2888f740 1 -- 172.21.15.37:0/3125063257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5588ec6483c0 con 0x5588ec5c1ac0 2024-08-20T05:04:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.822+0000 7f4c08c00640 1 -- 172.21.15.37:0/3125063257 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c0c030340 con 0x5588ec5c1ac0 2024-08-20T05:04:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.823+0000 7f4c08c00640 1 -- 172.21.15.37:0/3125063257 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f4c100cd170 con 0x5588ec5c1ac0 2024-08-20T05:04:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.823+0000 7f4c2888f740 10 client.25993 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.823+0000 7f4c2888f740 10 client.25993 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:04:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.823+0000 7f4c2888f740 20 client.25993 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.823+0000 7f4c2888f740 1 --2- 172.21.15.37:0/3125063257 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5588ec6489e0 0x5588ec64ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.823+0000 7f4c2888f740 4 client.25993 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:04:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.823+0000 7f4c2888f740 1 -- 172.21.15.37:0/3125063257 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5588ec535490 con 0x5588ec6489e0 2024-08-20T05:04:02.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.823+0000 7f4c1e000640 1 --2- 172.21.15.37:0/3125063257 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5588ec6489e0 0x5588ec64ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:02.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.824+0000 7f4c08c00640 10 client.25993 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:04:02.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.824+0000 7f4c1e000640 1 --2- 172.21.15.37:0/3125063257 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5588ec6489e0 0x5588ec64ae00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dc957d1c423f327e server_cookie=c1b7f8392337495 in_seq=0 out_seq=0 2024-08-20T05:04:02.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.825+0000 7f4c08c00640 1 -- 172.21.15.37:0/3125063257 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5588ec535490 con 0x5588ec6489e0 2024-08-20T05:04:02.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.825+0000 7f4c08c00640 10 client.25993 handle_command_reply: tid=0 2024-08-20T05:04:02.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.825+0000 7f4c2888f740 1 client.25993 shutdown 2024-08-20T05:04:02.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.825+0000 7f4c2888f740 1 -- 172.21.15.37:0/3125063257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c1ac0 msgr2=0x5588ec5d39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:02.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.825+0000 7f4c2888f740 1 --2- 172.21.15.37:0/3125063257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c1ac0 0x5588ec5d39e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4c100aa760 tx=0x7f4c100a6370 comp rx=0 tx=0).stop 2024-08-20T05:04:02.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.825+0000 7f4c2888f740 1 -- 172.21.15.37:0/3125063257 shutdown_connections 2024-08-20T05:04:02.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.825+0000 7f4c2888f740 1 --2- 172.21.15.37:0/3125063257 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5588ec6489e0 0x5588ec64ae00 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.825+0000 7f4c2888f740 1 --2- 172.21.15.37:0/3125063257 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5588ec5ce370 0x5588ec6469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.825+0000 7f4c08c00640 0 client.25993 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:04:02.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.825+0000 7f4c2888f740 1 --2- 172.21.15.37:0/3125063257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5588ec5c23e0 0x5588ec5d3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.825+0000 7f4c2888f740 1 --2- 172.21.15.37:0/3125063257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5588ec5c1ac0 0x5588ec5d39e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.825+0000 7f4c2888f740 1 -- 172.21.15.37:0/3125063257 >> 172.21.15.37:0/3125063257 conn(0x5588ec5bf8f0 msgr2=0x5588ec5be2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:02.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.825+0000 7f4c2888f740 1 -- 172.21.15.37:0/3125063257 shutdown_connections 2024-08-20T05:04:02.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.825+0000 7f4c2888f740 1 -- 172.21.15.37:0/3125063257 wait complete. 2024-08-20T05:04:02.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.825+0000 7f4c2888f740 20 client.25993 trim_cache size 0 max 16384 2024-08-20T05:04:02.829 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:04:02.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.826+0000 7f4c1fe00640 1 -- 172.21.15.37:0/884864065 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4c040b3d70 msgr2=0x7f4c040b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:02.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.826+0000 7f4c1fe00640 1 --2- 172.21.15.37:0/884864065 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4c040b3d70 0x7f4c040b6230 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4c18021000 tx=0x7f4c1801d680 comp rx=0 tx=0).stop 2024-08-20T05:04:02.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.826+0000 7f4c1fe00640 1 -- 172.21.15.37:0/884864065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c20102910 msgr2=0x7f4c2010c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:02.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.826+0000 7f4c1fe00640 1 --2- 172.21.15.37:0/884864065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c20102910 0x7f4c2010c250 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000d950 tx=0x7f4c1000de10 comp rx=0 tx=0).stop 2024-08-20T05:04:02.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.826+0000 7f4c1fe00640 1 -- 172.21.15.37:0/884864065 shutdown_connections 2024-08-20T05:04:02.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.826+0000 7f4c1fe00640 1 --2- 172.21.15.37:0/884864065 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4c040b3d70 0x7f4c040b6230 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.826+0000 7f4c1fe00640 1 --2- 172.21.15.37:0/884864065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c20108ca0 0x7f4c201a3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.826+0000 7f4c1fe00640 1 --2- 172.21.15.37:0/884864065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c20108320 0x7f4c2010c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.826+0000 7f4c1fe00640 1 --2- 172.21.15.37:0/884864065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c20102910 0x7f4c2010c250 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:02.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.826+0000 7f4c1fe00640 1 -- 172.21.15.37:0/884864065 >> 172.21.15.37:0/884864065 conn(0x7f4c200fe3c0 msgr2=0x7f4c20106130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:02.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.827+0000 7f4c1fe00640 1 -- 172.21.15.37:0/884864065 shutdown_connections 2024-08-20T05:04:02.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:02.827+0000 7f4c1fe00640 1 -- 172.21.15.37:0/884864065 wait complete. 2024-08-20T05:04:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 65.0 s, 1830.0 tps, lat 55.110 ms stddev 61.752 2024-08-20T05:04:03.220 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:03 smithi037 ceph-mon[17265]: pgmap v455: 129 pgs: 129 active+clean; 979 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.6 MiB/s wr, 279 op/s 2024-08-20T05:04:03.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:03 smithi135 ceph-mon[22342]: pgmap v455: 129 pgs: 129 active+clean; 979 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.6 MiB/s wr, 279 op/s 2024-08-20T05:04:03.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:03 smithi130 ceph-mon[22007]: pgmap v455: 129 pgs: 129 active+clean; 979 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.6 MiB/s wr, 279 op/s 2024-08-20T05:04:03.908 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T05:04:04.606 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:04:05.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.340+0000 7f5170000640 1 -- 172.21.15.37:0/3905936437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5168117b30 msgr2=0x7f5168119f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.340+0000 7f5170000640 1 --2- 172.21.15.37:0/3905936437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5168117b30 0x7f5168119f20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5160009be0 tx=0x7f516002a770 comp rx=0 tx=0).stop 2024-08-20T05:04:05.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.341+0000 7f5170000640 1 -- 172.21.15.37:0/3905936437 shutdown_connections 2024-08-20T05:04:05.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.341+0000 7f5170000640 1 --2- 172.21.15.37:0/3905936437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5168117b30 0x7f5168119f20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.341+0000 7f5170000640 1 --2- 172.21.15.37:0/3905936437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f516810a7a0 0x7f51681175f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.341+0000 7f5170000640 1 --2- 172.21.15.37:0/3905936437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5168109e80 0x7f516810a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.341+0000 7f5170000640 1 -- 172.21.15.37:0/3905936437 >> 172.21.15.37:0/3905936437 conn(0x7f516806dfe0 msgr2=0x7f516806e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:05.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.341+0000 7f5170000640 1 -- 172.21.15.37:0/3905936437 shutdown_connections 2024-08-20T05:04:05.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.341+0000 7f5170000640 1 -- 172.21.15.37:0/3905936437 wait complete. 2024-08-20T05:04:05.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.342+0000 7f5170000640 1 Processor -- start 2024-08-20T05:04:05.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.342+0000 7f5170000640 1 -- start start 2024-08-20T05:04:05.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.343+0000 7f5170000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5168109e80 0x7f5168117310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.343+0000 7f5170000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f516810a7a0 0x7f5168114560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.343+0000 7f5170000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5168117b30 0x7f5168114aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.343+0000 7f5170000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f516811d450 con 0x7f5168109e80 2024-08-20T05:04:05.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.343+0000 7f5170000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f516811d2d0 con 0x7f516810a7a0 2024-08-20T05:04:05.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.343+0000 7f5170000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f516811d5d0 con 0x7f5168117b30 2024-08-20T05:04:05.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.343+0000 7f516cc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f516810a7a0 0x7f5168114560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.343+0000 7f516cc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f516810a7a0 0x7f5168114560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47262/0 (socket says 172.21.15.37:47262) 2024-08-20T05:04:05.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.343+0000 7f516cc00640 1 -- 172.21.15.37:0/1472935710 learned_addr learned my addr 172.21.15.37:0/1472935710 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:05.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.343+0000 7f516e000640 1 --2- 172.21.15.37:0/1472935710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5168117b30 0x7f5168114aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.344+0000 7f516cc00640 1 -- 172.21.15.37:0/1472935710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5168117b30 msgr2=0x7f5168114aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.344+0000 7f516cc00640 1 --2- 172.21.15.37:0/1472935710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5168117b30 0x7f5168114aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.344+0000 7f516cc00640 1 -- 172.21.15.37:0/1472935710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5168109e80 msgr2=0x7f5168117310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.344+0000 7f516cc00640 1 --2- 172.21.15.37:0/1472935710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5168109e80 0x7f5168117310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.344+0000 7f516cc00640 1 -- 172.21.15.37:0/1472935710 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5168115360 con 0x7f516810a7a0 2024-08-20T05:04:05.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.344+0000 7f516cc00640 1 --2- 172.21.15.37:0/1472935710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f516810a7a0 0x7f5168114560 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f515400e9c0 tx=0x7f515400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:05.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.344+0000 7f5166000640 1 -- 172.21.15.37:0/1472935710 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515400cde0 con 0x7f516810a7a0 2024-08-20T05:04:05.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.344+0000 7f5166000640 1 -- 172.21.15.37:0/1472935710 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51540035f0 con 0x7f516810a7a0 2024-08-20T05:04:05.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.344+0000 7f5166000640 1 -- 172.21.15.37:0/1472935710 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5154010690 con 0x7f516810a7a0 2024-08-20T05:04:05.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.344+0000 7f5170000640 1 -- 172.21.15.37:0/1472935710 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51681b4250 con 0x7f516810a7a0 2024-08-20T05:04:05.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.344+0000 7f5170000640 1 -- 172.21.15.37:0/1472935710 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51681b4710 con 0x7f516810a7a0 2024-08-20T05:04:05.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.349+0000 7f5166000640 1 -- 172.21.15.37:0/1472935710 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5154004000 con 0x7f516810a7a0 2024-08-20T05:04:05.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.351+0000 7f5172bbb740 1 Processor -- start 2024-08-20T05:04:05.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.351+0000 7f5172bbb740 1 -- start start 2024-08-20T05:04:05.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.351+0000 7f5172bbb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 0x56154b3dad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.352+0000 7f5172bbb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 0x56154b3e6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.352+0000 7f5172bbb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3e71f0 0x56154b3e95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.352+0000 7f5172bbb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56154b350aa0 con 0x56154b3da940 2024-08-20T05:04:05.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.352+0000 7f5172bbb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56154b33ffa0 con 0x56154b3db260 2024-08-20T05:04:05.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.352+0000 7f5172bbb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56154b343fe0 con 0x56154b3e71f0 2024-08-20T05:04:05.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.352+0000 7f516e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 0x56154b3dad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.352+0000 7f516e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 0x56154b3dad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33800/0 (socket says 172.21.15.37:33800) 2024-08-20T05:04:05.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.352+0000 7f516e000640 1 -- 172.21.15.37:0/307327954 learned_addr learned my addr 172.21.15.37:0/307327954 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:05.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.352+0000 7f516cc00640 1 --2- 172.21.15.37:0/307327954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3e71f0 0x56154b3e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.352+0000 7f5166000640 1 --2- 172.21.15.37:0/1472935710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f51500b3cd0 0x7f51500b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.353+0000 7f5166000640 1 -- 172.21.15.37:0/1472935710 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f51540e42c0 con 0x7f516810a7a0 2024-08-20T05:04:05.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.353+0000 7f516e000640 1 -- 172.21.15.37:0/307327954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3e71f0 msgr2=0x56154b3e95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:05.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.353+0000 7f516e000640 1 --2- 172.21.15.37:0/307327954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3e71f0 0x56154b3e95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.353+0000 7f516e000640 1 -- 172.21.15.37:0/307327954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 msgr2=0x56154b3e6cb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:04:05.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.353+0000 7f516e000640 1 --2- 172.21.15.37:0/307327954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 0x56154b3e6cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.353+0000 7f516e000640 1 -- 172.21.15.37:0/307327954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56154b2e6420 con 0x56154b3da940 2024-08-20T05:04:05.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.354+0000 7f516e000640 1 --2- 172.21.15.37:0/307327954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 0x56154b3dad20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5160009be0 tx=0x7f5160030480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9347a02a3ca58b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:05.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.354+0000 7f516e000640 1 --2- 172.21.15.37:0/1472935710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f51500b3cd0 0x7f51500b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.354+0000 7f515a600640 1 -- 172.21.15.37:0/307327954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5160064070 con 0x56154b3da940 2024-08-20T05:04:05.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.354+0000 7f515a600640 1 -- 172.21.15.37:0/307327954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5160030e50 con 0x56154b3da940 2024-08-20T05:04:05.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.354+0000 7f515a600640 1 -- 172.21.15.37:0/307327954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5160036040 con 0x56154b3da940 2024-08-20T05:04:05.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.356+0000 7f5172bbb740 1 -- 172.21.15.37:0/307327954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 msgr2=0x56154b3dad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.356+0000 7f5172bbb740 1 --2- 172.21.15.37:0/307327954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 0x56154b3dad20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f5160009be0 tx=0x7f5160030480 comp rx=0 tx=0).stop 2024-08-20T05:04:05.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.356+0000 7f516e000640 1 --2- 172.21.15.37:0/1472935710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f51500b3cd0 0x7f51500b6190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5160068000 tx=0x7f5160069460 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:05.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.356+0000 7f5172bbb740 1 -- 172.21.15.37:0/307327954 shutdown_connections 2024-08-20T05:04:05.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.356+0000 7f5172bbb740 1 --2- 172.21.15.37:0/307327954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3e71f0 0x56154b3e95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.356+0000 7f5172bbb740 1 --2- 172.21.15.37:0/307327954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 0x56154b3e6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.356+0000 7f5172bbb740 1 --2- 172.21.15.37:0/307327954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 0x56154b3dad20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.356+0000 7f5172bbb740 1 -- 172.21.15.37:0/307327954 >> 172.21.15.37:0/307327954 conn(0x56154b3d8770 msgr2=0x56154b3d9910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:05.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.357+0000 7f5172bbb740 1 -- 172.21.15.37:0/307327954 shutdown_connections 2024-08-20T05:04:05.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.357+0000 7f5172bbb740 1 -- 172.21.15.37:0/307327954 wait complete. 2024-08-20T05:04:05.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.358+0000 7f5172bbb740 1 -- start start 2024-08-20T05:04:05.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.359+0000 7f5172bbb740 1 Processor -- start 2024-08-20T05:04:05.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.360+0000 7f5172bbb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3da940 0x56154b3e69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.360+0000 7f5172bbb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 0x56154b3e3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.360+0000 7f5172bbb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3e71f0 0x56154b3e4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.360+0000 7f5172bbb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56154b1a2700 con 0x56154b3e71f0 2024-08-20T05:04:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.360+0000 7f5172bbb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56154b2db290 con 0x56154b3db260 2024-08-20T05:04:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.360+0000 7f5172bbb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56154b3e9e10 con 0x56154b3da940 2024-08-20T05:04:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.360+0000 7f516cc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 0x56154b3e3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.360+0000 7f516cc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 0x56154b3e3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47278/0 (socket says 172.21.15.37:47278) 2024-08-20T05:04:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.360+0000 7f516cc00640 1 -- 172.21.15.37:0/409095005 learned_addr learned my addr 172.21.15.37:0/409095005 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.360+0000 7f516d600640 1 --2- 172.21.15.37:0/409095005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3da940 0x56154b3e69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.360+0000 7f5172bbb740 10 client.0 _ll_register_callbacks cb 0x56154b33a1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.360+0000 7f516cc00640 1 -- 172.21.15.37:0/409095005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3da940 msgr2=0x56154b3e69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.360+0000 7f516cc00640 1 --2- 172.21.15.37:0/409095005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3da940 0x56154b3e69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.360+0000 7f516cc00640 1 -- 172.21.15.37:0/409095005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3e71f0 msgr2=0x56154b3e4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:05.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.360+0000 7f516cc00640 1 --2- 172.21.15.37:0/409095005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3e71f0 0x56154b3e4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.360+0000 7f516cc00640 1 -- 172.21.15.37:0/409095005 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56154b09f650 con 0x56154b3db260 2024-08-20T05:04:05.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.361+0000 7f516cc00640 1 --2- 172.21.15.37:0/409095005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 0x56154b3e3e30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f51540aad50 tx=0x7f51540aa920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bf7164e25d70cf1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:05.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.361+0000 7f514ea00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:04:05.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.361+0000 7f514ea00640 1 -- 172.21.15.37:0/409095005 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51540b3ec0 con 0x56154b3db260 2024-08-20T05:04:05.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.361+0000 7f514ea00640 1 -- 172.21.15.37:0/409095005 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f51540042f0 con 0x56154b3db260 2024-08-20T05:04:05.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.361+0000 7f5172bbb740 1 -- 172.21.15.37:0/409095005 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5160030e50 con 0x56154b3db260 2024-08-20T05:04:05.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.362+0000 7f514ea00640 1 -- 172.21.15.37:0/409095005 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f51540aae10 con 0x56154b3db260 2024-08-20T05:04:05.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.362+0000 7f5172bbb740 10 client.25979 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:05.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.362+0000 7f5172bbb740 1 -- 172.21.15.37:0/409095005 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56154b3f5680 con 0x56154b3db260 2024-08-20T05:04:05.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.362+0000 7f514ea00640 1 -- 172.21.15.37:0/409095005 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5160030e50 con 0x56154b3db260 2024-08-20T05:04:05.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.362+0000 7f514ea00640 1 -- 172.21.15.37:0/409095005 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f51540a9ae0 con 0x56154b3db260 2024-08-20T05:04:05.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.362+0000 7f5172bbb740 10 client.25979 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:05.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.362+0000 7f5172bbb740 10 client.25979 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:04:05.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.362+0000 7f5172bbb740 20 client.25979 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:05.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.362+0000 7f5172bbb740 1 --2- 172.21.15.37:0/409095005 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56154b3f6b40 0x56154b3f8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.362+0000 7f5172bbb740 4 client.25979 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:04:05.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.362+0000 7f5172bbb740 1 -- 172.21.15.37:0/409095005 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56154b3529f0 con 0x56154b3f6b40 2024-08-20T05:04:05.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.363+0000 7f516d600640 1 --2- 172.21.15.37:0/409095005 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56154b3f6b40 0x56154b3f8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.364+0000 7f516d600640 1 --2- 172.21.15.37:0/409095005 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56154b3f6b40 0x56154b3f8fb0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c03803853a01691a server_cookie=553bcfc4be9d3bf9 in_seq=0 out_seq=0 2024-08-20T05:04:05.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.364+0000 7f514ea00640 10 client.25979 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:04:05.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.365+0000 7f514ea00640 1 -- 172.21.15.37:0/409095005 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56154b3529f0 con 0x56154b3f6b40 2024-08-20T05:04:05.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.365+0000 7f514ea00640 10 client.25979 handle_command_reply: tid=0 2024-08-20T05:04:05.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.365+0000 7f5172bbb740 1 client.25979 shutdown 2024-08-20T05:04:05.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.366+0000 7f5172bbb740 1 -- 172.21.15.37:0/409095005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 msgr2=0x56154b3e3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.366+0000 7f5172bbb740 1 --2- 172.21.15.37:0/409095005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 0x56154b3e3e30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f51540aad50 tx=0x7f51540aa920 comp rx=0 tx=0).stop 2024-08-20T05:04:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.367+0000 7f5172bbb740 1 -- 172.21.15.37:0/409095005 shutdown_connections 2024-08-20T05:04:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.367+0000 7f5172bbb740 1 --2- 172.21.15.37:0/409095005 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56154b3f6b40 0x56154b3f8fb0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.367+0000 7f5172bbb740 1 --2- 172.21.15.37:0/409095005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3e71f0 0x56154b3e4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.367+0000 7f5172bbb740 1 --2- 172.21.15.37:0/409095005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 0x56154b3e3e30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.367+0000 7f5172bbb740 1 --2- 172.21.15.37:0/409095005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3da940 0x56154b3e69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.367+0000 7f514ea00640 0 client.25979 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:04:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.367+0000 7f5172bbb740 1 -- 172.21.15.37:0/409095005 >> 172.21.15.37:0/409095005 conn(0x56154b3d8770 msgr2=0x56154b3de310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:05.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.367+0000 7f5172bbb740 1 -- 172.21.15.37:0/409095005 shutdown_connections 2024-08-20T05:04:05.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.367+0000 7f5172bbb740 1 -- 172.21.15.37:0/409095005 wait complete. 2024-08-20T05:04:05.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.367+0000 7f5172bbb740 20 client.25979 trim_cache size 0 max 16384 2024-08-20T05:04:05.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.389+0000 7f5172bbb740 1 Processor -- start 2024-08-20T05:04:05.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.390+0000 7f5172bbb740 1 -- start start 2024-08-20T05:04:05.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.390+0000 7f5172bbb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 0x56154b3f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.390+0000 7f5172bbb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3db260 0x56154b3fe880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.390+0000 7f5172bbb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3e71f0 0x56154b3fedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.390+0000 7f5172bbb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f516807edb0 con 0x56154b3da940 2024-08-20T05:04:05.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.390+0000 7f5172bbb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f51680809b0 con 0x56154b3e71f0 2024-08-20T05:04:05.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.390+0000 7f5172bbb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f516807f480 con 0x56154b3db260 2024-08-20T05:04:05.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.391+0000 7f516e000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3e71f0 0x56154b3fedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.391+0000 7f516e000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3e71f0 0x56154b3fedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47290/0 (socket says 172.21.15.37:47290) 2024-08-20T05:04:05.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.391+0000 7f516e000640 1 -- 172.21.15.37:0/2804180737 learned_addr learned my addr 172.21.15.37:0/2804180737 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:05.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.391+0000 7f516d600640 1 --2- 172.21.15.37:0/2804180737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 0x56154b3f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.391+0000 7f516e000640 1 -- 172.21.15.37:0/2804180737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3db260 msgr2=0x56154b3fe880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:04:05.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.392+0000 7f516e000640 1 --2- 172.21.15.37:0/2804180737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3db260 0x56154b3fe880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.392+0000 7f516e000640 1 -- 172.21.15.37:0/2804180737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 msgr2=0x56154b3f2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:05.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.392+0000 7f516e000640 1 --2- 172.21.15.37:0/2804180737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 0x56154b3f2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.392+0000 7f516e000640 1 -- 172.21.15.37:0/2804180737 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56154b3e46b0 con 0x56154b3e71f0 2024-08-20T05:04:05.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.392+0000 7f516d600640 1 --2- 172.21.15.37:0/2804180737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 0x56154b3f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:04:05.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.392+0000 7f516e000640 1 --2- 172.21.15.37:0/2804180737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3e71f0 0x56154b3fedc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f51600096c0 tx=0x7f5160070000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b6f6c19f288f87f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:05.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.392+0000 7f5159c00640 1 -- 172.21.15.37:0/2804180737 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5160079070 con 0x56154b3e71f0 2024-08-20T05:04:05.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.392+0000 7f5159c00640 1 -- 172.21.15.37:0/2804180737 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5160030e50 con 0x56154b3e71f0 2024-08-20T05:04:05.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.392+0000 7f5159c00640 1 -- 172.21.15.37:0/2804180737 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5160064070 con 0x56154b3e71f0 2024-08-20T05:04:05.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.393+0000 7f5172bbb740 1 -- 172.21.15.37:0/2804180737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3e71f0 msgr2=0x56154b3fedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.393+0000 7f5172bbb740 1 --2- 172.21.15.37:0/2804180737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3e71f0 0x56154b3fedc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f51600096c0 tx=0x7f5160070000 comp rx=0 tx=0).stop 2024-08-20T05:04:05.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.394+0000 7f5172bbb740 1 -- 172.21.15.37:0/2804180737 shutdown_connections 2024-08-20T05:04:05.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.394+0000 7f5172bbb740 1 --2- 172.21.15.37:0/2804180737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3e71f0 0x56154b3fedc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.394+0000 7f5172bbb740 1 --2- 172.21.15.37:0/2804180737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3db260 0x56154b3fe880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.394+0000 7f5172bbb740 1 --2- 172.21.15.37:0/2804180737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 0x56154b3f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.394+0000 7f5172bbb740 1 -- 172.21.15.37:0/2804180737 >> 172.21.15.37:0/2804180737 conn(0x56154b3d8770 msgr2=0x56154b3df410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:05.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.395+0000 7f5172bbb740 1 -- 172.21.15.37:0/2804180737 shutdown_connections 2024-08-20T05:04:05.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.395+0000 7f5172bbb740 1 -- 172.21.15.37:0/2804180737 wait complete. 2024-08-20T05:04:05.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.396+0000 7f5172bbb740 1 -- start start 2024-08-20T05:04:05.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.396+0000 7f5172bbb740 1 Processor -- start 2024-08-20T05:04:05.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.397+0000 7f5172bbb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 0x56154b3ebdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.397+0000 7f5172bbb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 0x56154b3ec370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.397+0000 7f5172bbb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3e71f0 0x56154b459880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.397+0000 7f5172bbb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5168080220 con 0x56154b3da940 2024-08-20T05:04:05.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.397+0000 7f5172bbb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f516807fb50 con 0x56154b3db260 2024-08-20T05:04:05.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.397+0000 7f5172bbb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5168115860 con 0x56154b3e71f0 2024-08-20T05:04:05.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.397+0000 7f5172bbb740 10 client.0 _ll_register_callbacks cb 0x7f51540aa7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.397+0000 7f516cc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 0x56154b3ec370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.398+0000 7f516cc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 0x56154b3ec370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47300/0 (socket says 172.21.15.37:47300) 2024-08-20T05:04:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.398+0000 7f516cc00640 1 -- 172.21.15.37:0/443942579 learned_addr learned my addr 172.21.15.37:0/443942579 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.398+0000 7f516e000640 1 --2- 172.21.15.37:0/443942579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3e71f0 0x56154b459880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.398+0000 7f516d600640 1 --2- 172.21.15.37:0/443942579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 0x56154b3ebdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.398+0000 7f516cc00640 1 -- 172.21.15.37:0/443942579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3e71f0 msgr2=0x56154b459880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.398+0000 7f516cc00640 1 --2- 172.21.15.37:0/443942579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3e71f0 0x56154b459880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.398+0000 7f516cc00640 1 -- 172.21.15.37:0/443942579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 msgr2=0x56154b3ebdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.398+0000 7f516cc00640 1 --2- 172.21.15.37:0/443942579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 0x56154b3ebdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.398+0000 7f516cc00640 1 -- 172.21.15.37:0/443942579 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56154b459f90 con 0x56154b3db260 2024-08-20T05:04:05.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.399+0000 7f516cc00640 1 --2- 172.21.15.37:0/443942579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 0x56154b3ec370 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f51540aada0 tx=0x7f51540af2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb7497d4b9696494 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:05.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.399+0000 7f514ea00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:04:05.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.400+0000 7f514ea00640 1 -- 172.21.15.37:0/443942579 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51540c9020 con 0x56154b3db260 2024-08-20T05:04:05.402 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:05 smithi037 ceph-mon[17265]: pgmap v456: 129 pgs: 129 active+clean; 979 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.6 MiB/s wr, 356 op/s 2024-08-20T05:04:05.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.401+0000 7f514ea00640 1 -- 172.21.15.37:0/443942579 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f51540a7400 con 0x56154b3db260 2024-08-20T05:04:05.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.401+0000 7f5172bbb740 1 -- 172.21.15.37:0/443942579 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5160030e50 con 0x56154b3db260 2024-08-20T05:04:05.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.404+0000 7f514ea00640 1 -- 172.21.15.37:0/443942579 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f51540b3ec0 con 0x56154b3db260 2024-08-20T05:04:05.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.404+0000 7f5172bbb740 10 client.25985 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:05.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.404+0000 7f5172bbb740 1 -- 172.21.15.37:0/443942579 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56154b472340 con 0x56154b3db260 2024-08-20T05:04:05.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.404+0000 7f514ea00640 1 -- 172.21.15.37:0/443942579 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5154088070 con 0x56154b3db260 2024-08-20T05:04:05.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.405+0000 7f514ea00640 1 -- 172.21.15.37:0/443942579 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f51540b0700 con 0x56154b3db260 2024-08-20T05:04:05.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.405+0000 7f5172bbb740 10 client.25985 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:05.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.405+0000 7f5172bbb740 10 client.25985 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:04:05.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.405+0000 7f5172bbb740 20 client.25985 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:05.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.406+0000 7f5172bbb740 1 --2- 172.21.15.37:0/443942579 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56154b472870 0x56154b474c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.406+0000 7f5172bbb740 4 client.25985 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:04:05.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.406+0000 7f5172bbb740 1 -- 172.21.15.37:0/443942579 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56154b34e490 con 0x56154b472870 2024-08-20T05:04:05.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.406+0000 7f516d600640 1 --2- 172.21.15.37:0/443942579 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56154b472870 0x56154b474c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.410+0000 7f516d600640 1 --2- 172.21.15.37:0/443942579 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56154b472870 0x56154b474c60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b618d3bcd789b39c server_cookie=d866a581146048c0 in_seq=0 out_seq=0 2024-08-20T05:04:05.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.410+0000 7f514ea00640 10 client.25985 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:04:05.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.414+0000 7f514ea00640 1 -- 172.21.15.37:0/443942579 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56154b34e490 con 0x56154b472870 2024-08-20T05:04:05.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.414+0000 7f514ea00640 10 client.25985 handle_command_reply: tid=0 2024-08-20T05:04:05.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.414+0000 7f5172bbb740 1 client.25985 shutdown 2024-08-20T05:04:05.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.415+0000 7f5172bbb740 1 -- 172.21.15.37:0/443942579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 msgr2=0x56154b3ec370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.415+0000 7f5172bbb740 1 --2- 172.21.15.37:0/443942579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 0x56154b3ec370 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f51540aada0 tx=0x7f51540af2e0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.416+0000 7f5172bbb740 1 -- 172.21.15.37:0/443942579 shutdown_connections 2024-08-20T05:04:05.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.416+0000 7f5172bbb740 1 --2- 172.21.15.37:0/443942579 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x56154b472870 0x56154b474c60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.416+0000 7f514ea00640 0 client.25985 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:04:05.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.416+0000 7f5172bbb740 1 --2- 172.21.15.37:0/443942579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56154b3e71f0 0x56154b459880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.416+0000 7f5172bbb740 1 --2- 172.21.15.37:0/443942579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56154b3db260 0x56154b3ec370 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.416+0000 7f5172bbb740 1 --2- 172.21.15.37:0/443942579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56154b3da940 0x56154b3ebdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.416+0000 7f5172bbb740 1 -- 172.21.15.37:0/443942579 >> 172.21.15.37:0/443942579 conn(0x56154b3d8770 msgr2=0x56154b3e5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:05.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.419+0000 7f5172bbb740 1 -- 172.21.15.37:0/443942579 shutdown_connections 2024-08-20T05:04:05.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.419+0000 7f5172bbb740 1 -- 172.21.15.37:0/443942579 wait complete. 2024-08-20T05:04:05.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.419+0000 7f5172bbb740 20 client.25985 trim_cache size 0 max 16384 2024-08-20T05:04:05.421 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:04:05.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.421+0000 7f5170000640 1 -- 172.21.15.37:0/1472935710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f51500b3cd0 msgr2=0x7f51500b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.421+0000 7f5170000640 1 --2- 172.21.15.37:0/1472935710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f51500b3cd0 0x7f51500b6190 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5160068000 tx=0x7f5160069460 comp rx=0 tx=0).stop 2024-08-20T05:04:05.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.421+0000 7f5170000640 1 -- 172.21.15.37:0/1472935710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f516810a7a0 msgr2=0x7f5168114560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.421+0000 7f5170000640 1 --2- 172.21.15.37:0/1472935710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f516810a7a0 0x7f5168114560 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f515400e9c0 tx=0x7f515400ee80 comp rx=0 tx=0).stop 2024-08-20T05:04:05.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.422+0000 7f5170000640 1 -- 172.21.15.37:0/1472935710 shutdown_connections 2024-08-20T05:04:05.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.422+0000 7f5170000640 1 --2- 172.21.15.37:0/1472935710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f51500b3cd0 0x7f51500b6190 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.422+0000 7f5170000640 1 --2- 172.21.15.37:0/1472935710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5168117b30 0x7f5168114aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.422+0000 7f5170000640 1 --2- 172.21.15.37:0/1472935710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f516810a7a0 0x7f5168114560 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.422+0000 7f5170000640 1 --2- 172.21.15.37:0/1472935710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5168109e80 0x7f5168117310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.422+0000 7f5170000640 1 -- 172.21.15.37:0/1472935710 >> 172.21.15.37:0/1472935710 conn(0x7f516806dfe0 msgr2=0x7f5168118080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:05.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.422+0000 7f5170000640 1 -- 172.21.15.37:0/1472935710 shutdown_connections 2024-08-20T05:04:05.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:05.422+0000 7f5170000640 1 -- 172.21.15.37:0/1472935710 wait complete. 2024-08-20T05:04:05.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:05 smithi135 ceph-mon[22342]: pgmap v456: 129 pgs: 129 active+clean; 979 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.6 MiB/s wr, 356 op/s 2024-08-20T05:04:05.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:05 smithi130 ceph-mon[22007]: pgmap v456: 129 pgs: 129 active+clean; 979 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.6 MiB/s wr, 356 op/s 2024-08-20T05:04:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.782+0000 7f1e50a00640 1 -- 172.21.15.37:0/4133840365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e4c102680 msgr2=0x7f1e4c102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.782+0000 7f1e50a00640 1 --2- 172.21.15.37:0/4133840365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e4c102680 0x7f1e4c102a80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009930 tx=0x7f1e3c02a420 comp rx=0 tx=0).stop 2024-08-20T05:04:05.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.782+0000 7f1e50a00640 1 -- 172.21.15.37:0/4133840365 shutdown_connections 2024-08-20T05:04:05.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.782+0000 7f1e50a00640 1 --2- 172.21.15.37:0/4133840365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4c104190 0x7f1e4c10ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.782+0000 7f1e50a00640 1 --2- 172.21.15.37:0/4133840365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e4c1037d0 0x7f1e4c103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.782+0000 7f1e50a00640 1 --2- 172.21.15.37:0/4133840365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e4c102680 0x7f1e4c102a80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.782+0000 7f1e50a00640 1 -- 172.21.15.37:0/4133840365 >> 172.21.15.37:0/4133840365 conn(0x7f1e4c0fdf40 msgr2=0x7f1e4c100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:05.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.783+0000 7f1e50a00640 1 -- 172.21.15.37:0/4133840365 shutdown_connections 2024-08-20T05:04:05.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.783+0000 7f1e50a00640 1 -- 172.21.15.37:0/4133840365 wait complete. 2024-08-20T05:04:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.784+0000 7f1e50a00640 1 Processor -- start 2024-08-20T05:04:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.784+0000 7f1e50a00640 1 -- start start 2024-08-20T05:04:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.784+0000 7f1e50a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e4c1037d0 0x7f1e4c19af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.784+0000 7f1e50a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4c104190 0x7f1e4c19b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.784+0000 7f1e50a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e4c19c180 0x7f1e4c19c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.784+0000 7f1e50a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c10e340 con 0x7f1e4c19c180 2024-08-20T05:04:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.784+0000 7f1e50a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c10e1c0 con 0x7f1e4c104190 2024-08-20T05:04:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.784+0000 7f1e50a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c10e4c0 con 0x7f1e4c1037d0 2024-08-20T05:04:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.785+0000 7f1e49400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4c104190 0x7f1e4c19b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.785+0000 7f1e49400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4c104190 0x7f1e4c19b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47316/0 (socket says 172.21.15.37:47316) 2024-08-20T05:04:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.785+0000 7f1e49400640 1 -- 172.21.15.37:0/3359907665 learned_addr learned my addr 172.21.15.37:0/3359907665 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.785+0000 7f1e4a800640 1 --2- 172.21.15.37:0/3359907665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e4c19c180 0x7f1e4c19c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.785+0000 7f1e49e00640 1 --2- 172.21.15.37:0/3359907665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e4c1037d0 0x7f1e4c19af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.785+0000 7f1e49400640 1 -- 172.21.15.37:0/3359907665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e4c1037d0 msgr2=0x7f1e4c19af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.785+0000 7f1e49400640 1 --2- 172.21.15.37:0/3359907665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e4c1037d0 0x7f1e4c19af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.785+0000 7f1e49400640 1 -- 172.21.15.37:0/3359907665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e4c19c180 msgr2=0x7f1e4c19c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.785+0000 7f1e49400640 1 --2- 172.21.15.37:0/3359907665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e4c19c180 0x7f1e4c19c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.785+0000 7f1e49400640 1 -- 172.21.15.37:0/3359907665 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c19ce30 con 0x7f1e4c104190 2024-08-20T05:04:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.786+0000 7f1e49400640 1 --2- 172.21.15.37:0/3359907665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4c104190 0x7f1e4c19b5c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800e9f0 tx=0x7f1e3800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.786+0000 7f1e42a00640 1 -- 172.21.15.37:0/3359907665 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3800cd80 con 0x7f1e4c104190 2024-08-20T05:04:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.786+0000 7f1e42a00640 1 -- 172.21.15.37:0/3359907665 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e380108e0 con 0x7f1e4c104190 2024-08-20T05:04:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.786+0000 7f1e50a00640 1 -- 172.21.15.37:0/3359907665 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4c1a3220 con 0x7f1e4c104190 2024-08-20T05:04:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.786+0000 7f1e42a00640 1 -- 172.21.15.37:0/3359907665 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e38018980 con 0x7f1e4c104190 2024-08-20T05:04:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.786+0000 7f1e50a00640 1 -- 172.21.15.37:0/3359907665 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e4c1a3760 con 0x7f1e4c104190 2024-08-20T05:04:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.792+0000 7f1e42a00640 1 -- 172.21.15.37:0/3359907665 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1e38010430 con 0x7f1e4c104190 2024-08-20T05:04:05.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.796+0000 7f1e42a00640 1 --2- 172.21.15.37:0/3359907665 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e300b3c90 0x7f1e300b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.796+0000 7f1e49e00640 1 --2- 172.21.15.37:0/3359907665 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e300b3c90 0x7f1e300b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.797+0000 7f1e42a00640 1 -- 172.21.15.37:0/3359907665 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1e380e4220 con 0x7f1e4c104190 2024-08-20T05:04:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.797+0000 7f1e49e00640 1 --2- 172.21.15.37:0/3359907665 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e300b3c90 0x7f1e300b6150 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009230 tx=0x7f1e3c0314c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.798+0000 7f1e538a9740 1 Processor -- start 2024-08-20T05:04:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.799+0000 7f1e538a9740 1 -- start start 2024-08-20T05:04:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.799+0000 7f1e538a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdcfe20 0x55d65bdd2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.799+0000 7f1e538a9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdd2750 0x55d65bdd4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.799+0000 7f1e538a9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd5190 0x55d65bdd7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.799+0000 7f1e538a9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d65bd3a210 con 0x55d65bdd2750 2024-08-20T05:04:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.799+0000 7f1e538a9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d65bd29710 con 0x55d65bdcfe20 2024-08-20T05:04:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.799+0000 7f1e538a9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d65bd2d750 con 0x55d65bdd5190 2024-08-20T05:04:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.799+0000 7f1e49e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdcfe20 0x55d65bdd2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.799+0000 7f1e49e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdcfe20 0x55d65bdd2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47324/0 (socket says 172.21.15.37:47324) 2024-08-20T05:04:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.799+0000 7f1e49e00640 1 -- 172.21.15.37:0/1369331574 learned_addr learned my addr 172.21.15.37:0/1369331574 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.799+0000 7f1e49400640 1 --2- 172.21.15.37:0/1369331574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdd2750 0x55d65bdd4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.800+0000 7f1e4a800640 1 --2- 172.21.15.37:0/1369331574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd5190 0x55d65bdd7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.800+0000 7f1e49e00640 1 -- 172.21.15.37:0/1369331574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd5190 msgr2=0x55d65bdd7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.800+0000 7f1e49e00640 1 --2- 172.21.15.37:0/1369331574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd5190 0x55d65bdd7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.800+0000 7f1e49e00640 1 -- 172.21.15.37:0/1369331574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdd2750 msgr2=0x55d65bdd4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.800+0000 7f1e49e00640 1 --2- 172.21.15.37:0/1369331574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdd2750 0x55d65bdd4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.800+0000 7f1e49e00640 1 -- 172.21.15.37:0/1369331574 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d65bcf5de0 con 0x55d65bdcfe20 2024-08-20T05:04:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.800+0000 7f1e49400640 1 --2- 172.21.15.37:0/1369331574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdd2750 0x55d65bdd4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:04:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.800+0000 7f1e49e00640 1 --2- 172.21.15.37:0/1369331574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdcfe20 0x55d65bdd2210 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c02a990 tx=0x7f1e3c02a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8976824b611822c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.801+0000 7f1e37000640 1 -- 172.21.15.37:0/1369331574 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c04d070 con 0x55d65bdcfe20 2024-08-20T05:04:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.801+0000 7f1e37000640 1 -- 172.21.15.37:0/1369331574 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e3c003d40 con 0x55d65bdcfe20 2024-08-20T05:04:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.801+0000 7f1e37000640 1 -- 172.21.15.37:0/1369331574 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c035050 con 0x55d65bdcfe20 2024-08-20T05:04:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.802+0000 7f1e538a9740 1 -- 172.21.15.37:0/1369331574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdcfe20 msgr2=0x55d65bdd2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.802+0000 7f1e538a9740 1 --2- 172.21.15.37:0/1369331574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdcfe20 0x55d65bdd2210 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c02a990 tx=0x7f1e3c02a420 comp rx=0 tx=0).stop 2024-08-20T05:04:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.803+0000 7f1e538a9740 1 -- 172.21.15.37:0/1369331574 shutdown_connections 2024-08-20T05:04:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.803+0000 7f1e538a9740 1 --2- 172.21.15.37:0/1369331574 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd5190 0x55d65bdd7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.803+0000 7f1e538a9740 1 --2- 172.21.15.37:0/1369331574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdd2750 0x55d65bdd4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.803+0000 7f1e538a9740 1 --2- 172.21.15.37:0/1369331574 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdcfe20 0x55d65bdd2210 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.803+0000 7f1e538a9740 1 -- 172.21.15.37:0/1369331574 >> 172.21.15.37:0/1369331574 conn(0x55d65bdc2760 msgr2=0x55d65bdc34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.803+0000 7f1e538a9740 1 -- 172.21.15.37:0/1369331574 shutdown_connections 2024-08-20T05:04:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.803+0000 7f1e538a9740 1 -- 172.21.15.37:0/1369331574 wait complete. 2024-08-20T05:04:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.804+0000 7f1e538a9740 1 -- start start 2024-08-20T05:04:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.804+0000 7f1e538a9740 1 Processor -- start 2024-08-20T05:04:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.805+0000 7f1e538a9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdcfe20 0x55d65bdc8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.805+0000 7f1e538a9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd2750 0x55d65bdc9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.805+0000 7f1e538a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdd5190 0x55d65bdcf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.805+0000 7f1e49400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd2750 0x55d65bdc9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.805+0000 7f1e49400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd2750 0x55d65bdc9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33164/0 (socket says 172.21.15.37:33164) 2024-08-20T05:04:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.805+0000 7f1e49400640 1 -- 172.21.15.37:0/4074390703 learned_addr learned my addr 172.21.15.37:0/4074390703 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.805+0000 7f1e4a800640 1 --2- 172.21.15.37:0/4074390703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdd5190 0x55d65bdcf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.805+0000 7f1e538a9740 1 -- 172.21.15.37:0/4074390703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d65bc62ab0 con 0x55d65bdcfe20 2024-08-20T05:04:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.805+0000 7f1e538a9740 1 -- 172.21.15.37:0/4074390703 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d65bcd0140 con 0x55d65bdd5190 2024-08-20T05:04:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.805+0000 7f1e538a9740 1 -- 172.21.15.37:0/4074390703 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d65bdc79b0 con 0x55d65bdd2750 2024-08-20T05:04:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.805+0000 7f1e538a9740 10 client.0 _ll_register_callbacks cb 0x55d65bce35d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.806+0000 7f1e49e00640 1 --2- 172.21.15.37:0/4074390703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdcfe20 0x55d65bdc8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.806+0000 7f1e4a800640 1 -- 172.21.15.37:0/4074390703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd2750 msgr2=0x55d65bdc9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.806+0000 7f1e4a800640 1 --2- 172.21.15.37:0/4074390703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd2750 0x55d65bdc9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.806+0000 7f1e4a800640 1 -- 172.21.15.37:0/4074390703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdcfe20 msgr2=0x55d65bdc8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.806+0000 7f1e4a800640 1 --2- 172.21.15.37:0/4074390703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdcfe20 0x55d65bdc8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.806+0000 7f1e4a800640 1 -- 172.21.15.37:0/4074390703 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d65bcd1170 con 0x55d65bdd5190 2024-08-20T05:04:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.806+0000 7f1e4a800640 1 --2- 172.21.15.37:0/4074390703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdd5190 0x55d65bdcf070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1e44011ce0 tx=0x7f1e4400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=735cf8cd6c32d27b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.806+0000 7f1e2b400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:04:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.806+0000 7f1e2b400640 1 -- 172.21.15.37:0/4074390703 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4400fe60 con 0x55d65bdd5190 2024-08-20T05:04:05.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.806+0000 7f1e2b400640 1 -- 172.21.15.37:0/4074390703 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1e44004b20 con 0x55d65bdd5190 2024-08-20T05:04:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.807+0000 7f1e538a9740 1 -- 172.21.15.37:0/4074390703 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e3c003d40 con 0x55d65bdd5190 2024-08-20T05:04:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.808+0000 7f1e2b400640 1 -- 172.21.15.37:0/4074390703 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1e44004d20 con 0x55d65bdd5190 2024-08-20T05:04:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.808+0000 7f1e538a9740 10 client.25997 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.808+0000 7f1e538a9740 1 -- 172.21.15.37:0/4074390703 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d65ba8c790 con 0x55d65bdd5190 2024-08-20T05:04:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.809+0000 7f1e2b400640 1 -- 172.21.15.37:0/4074390703 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e3c003d40 con 0x55d65bdd5190 2024-08-20T05:04:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.809+0000 7f1e2b400640 1 -- 172.21.15.37:0/4074390703 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f1e44019070 con 0x55d65bdd5190 2024-08-20T05:04:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.809+0000 7f1e538a9740 10 client.25997 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.809+0000 7f1e538a9740 10 client.25997 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:04:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.809+0000 7f1e538a9740 20 client.25997 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.809+0000 7f1e538a9740 1 --2- 172.21.15.37:0/4074390703 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d65bdeda50 0x55d65bdefed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.809+0000 7f1e538a9740 4 client.25997 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:04:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.809+0000 7f1e538a9740 1 -- 172.21.15.37:0/4074390703 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d65bd3c160 con 0x55d65bdeda50 2024-08-20T05:04:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.810+0000 7f1e49e00640 1 --2- 172.21.15.37:0/4074390703 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d65bdeda50 0x55d65bdefed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.811+0000 7f1e2b400640 10 client.25997 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.811+0000 7f1e49e00640 1 --2- 172.21.15.37:0/4074390703 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d65bdeda50 0x55d65bdefed0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3ea430bc208f926 server_cookie=800c4d794f359edd in_seq=0 out_seq=0 2024-08-20T05:04:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.812+0000 7f1e2b400640 1 -- 172.21.15.37:0/4074390703 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d65bd3c160 con 0x55d65bdeda50 2024-08-20T05:04:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.812+0000 7f1e2b400640 10 client.25997 handle_command_reply: tid=0 2024-08-20T05:04:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.812+0000 7f1e538a9740 1 client.25997 shutdown 2024-08-20T05:04:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.812+0000 7f1e538a9740 1 -- 172.21.15.37:0/4074390703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdd5190 msgr2=0x55d65bdcf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.812+0000 7f1e538a9740 1 --2- 172.21.15.37:0/4074390703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdd5190 0x55d65bdcf070 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1e44011ce0 tx=0x7f1e4400f790 comp rx=0 tx=0).stop 2024-08-20T05:04:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.812+0000 7f1e538a9740 1 -- 172.21.15.37:0/4074390703 shutdown_connections 2024-08-20T05:04:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.812+0000 7f1e538a9740 1 --2- 172.21.15.37:0/4074390703 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d65bdeda50 0x55d65bdefed0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.812+0000 7f1e538a9740 1 --2- 172.21.15.37:0/4074390703 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdd5190 0x55d65bdcf070 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.812+0000 7f1e2b400640 0 client.25997 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.812+0000 7f1e538a9740 1 --2- 172.21.15.37:0/4074390703 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd2750 0x55d65bdc9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.812+0000 7f1e538a9740 1 --2- 172.21.15.37:0/4074390703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdcfe20 0x55d65bdc8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.812+0000 7f1e538a9740 1 -- 172.21.15.37:0/4074390703 >> 172.21.15.37:0/4074390703 conn(0x55d65bdc2760 msgr2=0x55d65bdc1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:05.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.813+0000 7f1e538a9740 1 -- 172.21.15.37:0/4074390703 shutdown_connections 2024-08-20T05:04:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.813+0000 7f1e538a9740 1 -- 172.21.15.37:0/4074390703 wait complete. 2024-08-20T05:04:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.813+0000 7f1e538a9740 20 client.25997 trim_cache size 0 max 16384 2024-08-20T05:04:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.855+0000 7f1e538a9740 1 Processor -- start 2024-08-20T05:04:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.855+0000 7f1e538a9740 1 -- start start 2024-08-20T05:04:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e538a9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdcfe20 0x55d65bdd5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e538a9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd2750 0x55d65bdd5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e538a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdd5190 0x55d65bdc0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e538a9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c1a9830 con 0x55d65bdcfe20 2024-08-20T05:04:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e538a9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c1ab430 con 0x55d65bdd5190 2024-08-20T05:04:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e538a9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c1a9f00 con 0x55d65bdd2750 2024-08-20T05:04:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e4a800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdd5190 0x55d65bdc0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e4a800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdd5190 0x55d65bdc0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47334/0 (socket says 172.21.15.37:47334) 2024-08-20T05:04:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e4a800640 1 -- 172.21.15.37:0/3434955252 learned_addr learned my addr 172.21.15.37:0/3434955252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e4a800640 1 -- 172.21.15.37:0/3434955252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd2750 msgr2=0x55d65bdd5ab0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:04:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e4a800640 1 --2- 172.21.15.37:0/3434955252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd2750 0x55d65bdd5ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e4a800640 1 -- 172.21.15.37:0/3434955252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdcfe20 msgr2=0x55d65bdd5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e4a800640 1 --2- 172.21.15.37:0/3434955252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdcfe20 0x55d65bdd5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e4a800640 1 -- 172.21.15.37:0/3434955252 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d65bdc9780 con 0x55d65bdd5190 2024-08-20T05:04:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e4a800640 1 --2- 172.21.15.37:0/3434955252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdd5190 0x55d65bdc0f40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1e44006010 tx=0x7f1e44011980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb5f12db502599ee server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e36600640 1 -- 172.21.15.37:0/3434955252 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44004ac0 con 0x55d65bdd5190 2024-08-20T05:04:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e36600640 1 -- 172.21.15.37:0/3434955252 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e4402d920 con 0x55d65bdd5190 2024-08-20T05:04:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e36600640 1 -- 172.21.15.37:0/3434955252 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e44024a40 con 0x55d65bdd5190 2024-08-20T05:04:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e538a9740 1 -- 172.21.15.37:0/3434955252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdd5190 msgr2=0x55d65bdc0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e538a9740 1 --2- 172.21.15.37:0/3434955252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdd5190 0x55d65bdc0f40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1e44006010 tx=0x7f1e44011980 comp rx=0 tx=0).stop 2024-08-20T05:04:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e538a9740 1 -- 172.21.15.37:0/3434955252 shutdown_connections 2024-08-20T05:04:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e538a9740 1 --2- 172.21.15.37:0/3434955252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdd5190 0x55d65bdc0f40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e538a9740 1 --2- 172.21.15.37:0/3434955252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd2750 0x55d65bdd5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e538a9740 1 --2- 172.21.15.37:0/3434955252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdcfe20 0x55d65bdd5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e538a9740 1 -- 172.21.15.37:0/3434955252 >> 172.21.15.37:0/3434955252 conn(0x55d65bdc2760 msgr2=0x55d65bdc2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e538a9740 1 -- 172.21.15.37:0/3434955252 shutdown_connections 2024-08-20T05:04:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e538a9740 1 -- 172.21.15.37:0/3434955252 wait complete. 2024-08-20T05:04:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.857+0000 7f1e538a9740 1 -- start start 2024-08-20T05:04:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.862+0000 7f1e538a9740 1 Processor -- start 2024-08-20T05:04:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.862+0000 7f1e538a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdcfe20 0x55d65bdff000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.862+0000 7f1e538a9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd2750 0x55d65bdff6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.862+0000 7f1e538a9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdd5190 0x55d65be00270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.862+0000 7f1e49e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdcfe20 0x55d65bdff000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.862+0000 7f1e49e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdcfe20 0x55d65bdff000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47344/0 (socket says 172.21.15.37:47344) 2024-08-20T05:04:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e49400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd2750 0x55d65bdff6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e49400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd2750 0x55d65bdff6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33176/0 (socket says 172.21.15.37:33176) 2024-08-20T05:04:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e49e00640 1 -- 172.21.15.37:0/1243181982 learned_addr learned my addr 172.21.15.37:0/1243181982 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e4a800640 1 --2- 172.21.15.37:0/1243181982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdd5190 0x55d65be00270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e538a9740 1 -- 172.21.15.37:0/1243181982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c1aaca0 con 0x55d65bdd5190 2024-08-20T05:04:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e538a9740 1 -- 172.21.15.37:0/1243181982 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c1aa5d0 con 0x55d65bdcfe20 2024-08-20T05:04:05.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e538a9740 1 -- 172.21.15.37:0/1243181982 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c1a7830 con 0x55d65bdd2750 2024-08-20T05:04:05.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e538a9740 10 client.0 _ll_register_callbacks cb 0x7f1e44009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:05.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e4a800640 1 -- 172.21.15.37:0/1243181982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd2750 msgr2=0x55d65bdff6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:05.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e4a800640 1 --2- 172.21.15.37:0/1243181982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd2750 0x55d65bdff6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e4a800640 1 -- 172.21.15.37:0/1243181982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdcfe20 msgr2=0x55d65bdff000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:05.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e4a800640 1 --2- 172.21.15.37:0/1243181982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdcfe20 0x55d65bdff000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e4a800640 1 -- 172.21.15.37:0/1243181982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d65bdd4eb0 con 0x55d65bdd5190 2024-08-20T05:04:05.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e4a800640 1 --2- 172.21.15.37:0/1243181982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdd5190 0x55d65be00270 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1e44002230 tx=0x7f1e44011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1caa9c041727c5dc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e2b400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:04:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e2b400640 1 -- 172.21.15.37:0/1243181982 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4403b060 con 0x55d65bdd5190 2024-08-20T05:04:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e538a9740 1 -- 172.21.15.37:0/1243181982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e4402d920 con 0x55d65bdd5190 2024-08-20T05:04:05.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e2b400640 1 -- 172.21.15.37:0/1243181982 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1e440247c0 con 0x55d65bdd5190 2024-08-20T05:04:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e2b400640 1 -- 172.21.15.37:0/1243181982 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1e44042050 con 0x55d65bdd5190 2024-08-20T05:04:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e538a9740 10 client.15915 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:05.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.864+0000 7f1e538a9740 1 -- 172.21.15.37:0/1243181982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d65bb05620 con 0x55d65bdd5190 2024-08-20T05:04:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.869+0000 7f1e2b400640 1 -- 172.21.15.37:0/1243181982 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e4402d920 con 0x55d65bdd5190 2024-08-20T05:04:05.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.869+0000 7f1e2b400640 1 -- 172.21.15.37:0/1243181982 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f1e44035030 con 0x55d65bdd5190 2024-08-20T05:04:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.869+0000 7f1e538a9740 10 client.15915 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.871+0000 7f1e538a9740 10 client.15915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:04:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.871+0000 7f1e538a9740 20 client.15915 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.871+0000 7f1e538a9740 1 --2- 172.21.15.37:0/1243181982 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d65bdeda50 0x55d65be6b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.871+0000 7f1e538a9740 4 client.15915 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:04:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.871+0000 7f1e538a9740 1 -- 172.21.15.37:0/1243181982 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d65bd37c00 con 0x55d65bdeda50 2024-08-20T05:04:05.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.871+0000 7f1e49e00640 1 --2- 172.21.15.37:0/1243181982 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d65bdeda50 0x55d65be6b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.871+0000 7f1e49e00640 1 --2- 172.21.15.37:0/1243181982 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d65bdeda50 0x55d65be6b660 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffee47d069a44c6d server_cookie=7cb01e292a59bca4 in_seq=0 out_seq=0 2024-08-20T05:04:05.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.871+0000 7f1e2b400640 10 client.15915 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:05.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.906+0000 7f1e2b400640 1 -- 172.21.15.37:0/1243181982 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d65bd37c00 con 0x55d65bdeda50 2024-08-20T05:04:05.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.907+0000 7f1e2b400640 10 client.15915 handle_command_reply: tid=0 2024-08-20T05:04:05.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.907+0000 7f1e538a9740 1 client.15915 shutdown 2024-08-20T05:04:05.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.907+0000 7f1e538a9740 1 -- 172.21.15.37:0/1243181982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdd5190 msgr2=0x55d65be00270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.907+0000 7f1e538a9740 1 --2- 172.21.15.37:0/1243181982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdd5190 0x55d65be00270 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1e44002230 tx=0x7f1e44011860 comp rx=0 tx=0).stop 2024-08-20T05:04:05.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.907+0000 7f1e538a9740 1 -- 172.21.15.37:0/1243181982 shutdown_connections 2024-08-20T05:04:05.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.907+0000 7f1e538a9740 1 --2- 172.21.15.37:0/1243181982 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d65bdeda50 0x55d65be6b660 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.907+0000 7f1e538a9740 1 --2- 172.21.15.37:0/1243181982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d65bdd5190 0x55d65be00270 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.907+0000 7f1e538a9740 1 --2- 172.21.15.37:0/1243181982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d65bdd2750 0x55d65bdff6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.907+0000 7f1e538a9740 1 --2- 172.21.15.37:0/1243181982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d65bdcfe20 0x55d65bdff000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.907+0000 7f1e538a9740 1 -- 172.21.15.37:0/1243181982 >> 172.21.15.37:0/1243181982 conn(0x55d65bdc2760 msgr2=0x55d65bdc0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:05.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.907+0000 7f1e2b400640 0 client.15915 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:05.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.907+0000 7f1e538a9740 1 -- 172.21.15.37:0/1243181982 shutdown_connections 2024-08-20T05:04:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.908+0000 7f1e538a9740 1 -- 172.21.15.37:0/1243181982 wait complete. 2024-08-20T05:04:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.908+0000 7f1e538a9740 20 client.15915 trim_cache size 0 max 16384 2024-08-20T05:04:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:04:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:04:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:04:05.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:04:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.909+0000 7f1e50a00640 1 -- 172.21.15.37:0/3359907665 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e300b3c90 msgr2=0x7f1e300b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.909+0000 7f1e50a00640 1 --2- 172.21.15.37:0/3359907665 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e300b3c90 0x7f1e300b6150 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c009230 tx=0x7f1e3c0314c0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.909+0000 7f1e50a00640 1 -- 172.21.15.37:0/3359907665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4c104190 msgr2=0x7f1e4c19b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.909+0000 7f1e50a00640 1 --2- 172.21.15.37:0/3359907665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4c104190 0x7f1e4c19b5c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1e3800e9f0 tx=0x7f1e3800eeb0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.909+0000 7f1e50a00640 1 -- 172.21.15.37:0/3359907665 shutdown_connections 2024-08-20T05:04:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.909+0000 7f1e50a00640 1 --2- 172.21.15.37:0/3359907665 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e300b3c90 0x7f1e300b6150 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.909+0000 7f1e50a00640 1 --2- 172.21.15.37:0/3359907665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e4c19c180 0x7f1e4c19c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.909+0000 7f1e50a00640 1 --2- 172.21.15.37:0/3359907665 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4c104190 0x7f1e4c19b5c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.909+0000 7f1e50a00640 1 --2- 172.21.15.37:0/3359907665 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e4c1037d0 0x7f1e4c19af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.909+0000 7f1e50a00640 1 -- 172.21.15.37:0/3359907665 >> 172.21.15.37:0/3359907665 conn(0x7f1e4c0fdf40 msgr2=0x7f1e4c0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.909+0000 7f1e50a00640 1 -- 172.21.15.37:0/3359907665 shutdown_connections 2024-08-20T05:04:05.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:05.909+0000 7f1e50a00640 1 -- 172.21.15.37:0/3359907665 wait complete. 2024-08-20T05:04:06.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T05:04:07.311 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:04:07.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:07 smithi037 ceph-mon[17265]: pgmap v457: 129 pgs: 129 active+clean; 980 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.2 MiB/s wr, 430 op/s 2024-08-20T05:04:07.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:07 smithi135 ceph-mon[22342]: pgmap v457: 129 pgs: 129 active+clean; 980 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.2 MiB/s wr, 430 op/s 2024-08-20T05:04:07.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:07 smithi130 ceph-mon[22007]: pgmap v457: 129 pgs: 129 active+clean; 980 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.2 MiB/s wr, 430 op/s 2024-08-20T05:04:08.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 70.0 s, 1713.9 tps, lat 58.272 ms stddev 73.150 2024-08-20T05:04:08.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.665+0000 7f343ec00640 1 -- 172.21.15.37:0/2636814193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3438104b10 msgr2=0x7f3438104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:08.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.665+0000 7f343ec00640 1 --2- 172.21.15.37:0/2636814193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3438104b10 0x7f3438104ef0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f342c009900 tx=0x7f342c02a420 comp rx=0 tx=0).stop 2024-08-20T05:04:08.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.665+0000 7f343ec00640 1 -- 172.21.15.37:0/2636814193 shutdown_connections 2024-08-20T05:04:08.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.665+0000 7f343ec00640 1 --2- 172.21.15.37:0/2636814193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f343810aea0 0x7f34381116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.665+0000 7f343ec00640 1 --2- 172.21.15.37:0/2636814193 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f343810a520 0x7f343810a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.665+0000 7f343ec00640 1 --2- 172.21.15.37:0/2636814193 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3438104b10 0x7f3438104ef0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.665+0000 7f343ec00640 1 -- 172.21.15.37:0/2636814193 >> 172.21.15.37:0/2636814193 conn(0x7f3438100540 msgr2=0x7f3438102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:08.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.665+0000 7f343ec00640 1 -- 172.21.15.37:0/2636814193 shutdown_connections 2024-08-20T05:04:08.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.665+0000 7f343ec00640 1 -- 172.21.15.37:0/2636814193 wait complete. 2024-08-20T05:04:08.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.667+0000 7f343ec00640 1 Processor -- start 2024-08-20T05:04:08.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.668+0000 7f343ec00640 1 -- start start 2024-08-20T05:04:08.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.669+0000 7f343ec00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3438104b10 0x7f343806c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.669+0000 7f343ec00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f343810a520 0x7f343806cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.670+0000 7f343ec00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f343810aea0 0x7f343806f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.670+0000 7f343ec00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3438079a70 con 0x7f343810a520 2024-08-20T05:04:08.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.670+0000 7f343ec00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f34380798f0 con 0x7f343810aea0 2024-08-20T05:04:08.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.670+0000 7f343ec00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3438079bf0 con 0x7f3438104b10 2024-08-20T05:04:08.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.670+0000 7f343e200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f343810aea0 0x7f343806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.670+0000 7f343e200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f343810aea0 0x7f343806f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47354/0 (socket says 172.21.15.37:47354) 2024-08-20T05:04:08.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.670+0000 7f343e200640 1 -- 172.21.15.37:0/1151312586 learned_addr learned my addr 172.21.15.37:0/1151312586 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:08.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.671+0000 7f343e200640 1 -- 172.21.15.37:0/1151312586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3438104b10 msgr2=0x7f343806c8a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T05:04:08.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.672+0000 7f343ce00640 1 --2- 172.21.15.37:0/1151312586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f343810a520 0x7f343806cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.672+0000 7f343d800640 1 --2- 172.21.15.37:0/1151312586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3438104b10 0x7f343806c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.673+0000 7f343e200640 1 --2- 172.21.15.37:0/1151312586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3438104b10 0x7f343806c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.673+0000 7f343e200640 1 -- 172.21.15.37:0/1151312586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f343810a520 msgr2=0x7f343806cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.673+0000 7f343e200640 1 --2- 172.21.15.37:0/1151312586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f343810a520 0x7f343806cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.673+0000 7f343e200640 1 -- 172.21.15.37:0/1151312586 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f343806fea0 con 0x7f343810aea0 2024-08-20T05:04:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.673+0000 7f343ce00640 1 --2- 172.21.15.37:0/1151312586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f343810a520 0x7f343806cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:04:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.675+0000 7f343d800640 1 --2- 172.21.15.37:0/1151312586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3438104b10 0x7f343806c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:04:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.675+0000 7f343e200640 1 --2- 172.21.15.37:0/1151312586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f343810aea0 0x7f343806f960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f343000b970 tx=0x7f343000be30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.677+0000 7f3436000640 1 -- 172.21.15.37:0/1151312586 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3430019070 con 0x7f343810aea0 2024-08-20T05:04:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.678+0000 7f3436000640 1 -- 172.21.15.37:0/1151312586 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3430014440 con 0x7f343810aea0 2024-08-20T05:04:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.678+0000 7f3436000640 1 -- 172.21.15.37:0/1151312586 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34300075d0 con 0x7f343810aea0 2024-08-20T05:04:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.679+0000 7f343ec00640 1 -- 172.21.15.37:0/1151312586 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3438070190 con 0x7f343810aea0 2024-08-20T05:04:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.680+0000 7f343ec00640 1 -- 172.21.15.37:0/1151312586 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3438070650 con 0x7f343810aea0 2024-08-20T05:04:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.687+0000 7f3436000640 1 -- 172.21.15.37:0/1151312586 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f343000cb40 con 0x7f343810aea0 2024-08-20T05:04:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.687+0000 7f3442c45740 1 Processor -- start 2024-08-20T05:04:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.687+0000 7f3442c45740 1 -- start start 2024-08-20T05:04:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.688+0000 7f3442c45740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b716ac0 0x55679b716ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.688+0000 7f3442c45740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 0x55679b722e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.688+0000 7f3442c45740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b723370 0x55679b725760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.688+0000 7f3442c45740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55679b68caa0 con 0x55679b716ac0 2024-08-20T05:04:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.688+0000 7f3442c45740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55679b67bfa0 con 0x55679b7173e0 2024-08-20T05:04:08.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.688+0000 7f3442c45740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55679b67ffe0 con 0x55679b723370 2024-08-20T05:04:08.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.688+0000 7f343ce00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b723370 0x55679b725760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.689+0000 7f343ce00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b723370 0x55679b725760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33210/0 (socket says 172.21.15.37:33210) 2024-08-20T05:04:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.689+0000 7f343ce00640 1 -- 172.21.15.37:0/176373668 learned_addr learned my addr 172.21.15.37:0/176373668 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.689+0000 7f343d800640 1 --2- 172.21.15.37:0/176373668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 0x55679b722e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.689+0000 7f3436000640 1 --2- 172.21.15.37:0/1151312586 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f34200b3e40 0x7f34200b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.689+0000 7f343ce00640 1 --2- 172.21.15.37:0/176373668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b716ac0 0x55679b716ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.689+0000 7f343d800640 1 -- 172.21.15.37:0/176373668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b723370 msgr2=0x55679b725760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.689+0000 7f343d800640 1 --2- 172.21.15.37:0/176373668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b723370 0x55679b725760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.689+0000 7f343d800640 1 -- 172.21.15.37:0/176373668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b716ac0 msgr2=0x55679b716ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.690+0000 7f343d800640 1 --2- 172.21.15.37:0/176373668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b716ac0 0x55679b716ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.690+0000 7f343d800640 1 -- 172.21.15.37:0/176373668 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679b622420 con 0x55679b7173e0 2024-08-20T05:04:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.690+0000 7f343ce00640 1 --2- 172.21.15.37:0/176373668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b716ac0 0x55679b716ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:04:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.690+0000 7f3436000640 1 -- 172.21.15.37:0/1151312586 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f34300e34d0 con 0x7f343810aea0 2024-08-20T05:04:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.690+0000 7f343e200640 1 --2- 172.21.15.37:0/1151312586 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f34200b3e40 0x7f34200b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.690+0000 7f343d800640 1 --2- 172.21.15.37:0/176373668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 0x55679b722e30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f342c02a940 tx=0x7f342c00b0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=198daf7ae3c3555 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.691+0000 7f343e200640 1 --2- 172.21.15.37:0/1151312586 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f34200b3e40 0x7f34200b6300 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f343000b940 tx=0x7f3430014d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.691+0000 7f342aa00640 1 -- 172.21.15.37:0/176373668 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c0046c0 con 0x55679b7173e0 2024-08-20T05:04:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.691+0000 7f342aa00640 1 -- 172.21.15.37:0/176373668 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f342c042070 con 0x55679b7173e0 2024-08-20T05:04:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.691+0000 7f342aa00640 1 -- 172.21.15.37:0/176373668 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342c005600 con 0x55679b7173e0 2024-08-20T05:04:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.694+0000 7f3442c45740 1 -- 172.21.15.37:0/176373668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 msgr2=0x55679b722e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.694+0000 7f3442c45740 1 --2- 172.21.15.37:0/176373668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 0x55679b722e30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f342c02a940 tx=0x7f342c00b0b0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.695+0000 7f3442c45740 1 -- 172.21.15.37:0/176373668 shutdown_connections 2024-08-20T05:04:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.695+0000 7f3442c45740 1 --2- 172.21.15.37:0/176373668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b723370 0x55679b725760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.695+0000 7f3442c45740 1 --2- 172.21.15.37:0/176373668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 0x55679b722e30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.695+0000 7f3442c45740 1 --2- 172.21.15.37:0/176373668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b716ac0 0x55679b716ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.695+0000 7f3442c45740 1 -- 172.21.15.37:0/176373668 >> 172.21.15.37:0/176373668 conn(0x55679b7148f0 msgr2=0x55679b715a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.695+0000 7f3442c45740 1 -- 172.21.15.37:0/176373668 shutdown_connections 2024-08-20T05:04:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.695+0000 7f3442c45740 1 -- 172.21.15.37:0/176373668 wait complete. 2024-08-20T05:04:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.696+0000 7f3442c45740 1 -- start start 2024-08-20T05:04:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.696+0000 7f3442c45740 1 Processor -- start 2024-08-20T05:04:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.697+0000 7f3442c45740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b716ac0 0x55679b722b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.697+0000 7f3442c45740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 0x55679b71ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.697+0000 7f3442c45740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b723370 0x55679b7204f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.697+0000 7f3442c45740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55679b4de700 con 0x55679b723370 2024-08-20T05:04:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.697+0000 7f3442c45740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55679b617290 con 0x55679b7173e0 2024-08-20T05:04:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.697+0000 7f3442c45740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55679b725f90 con 0x55679b716ac0 2024-08-20T05:04:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.697+0000 7f3442c45740 10 client.0 _ll_register_callbacks cb 0x55679b6761c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.698+0000 7f343ce00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b716ac0 0x55679b722b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.698+0000 7f343ce00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b716ac0 0x55679b722b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33224/0 (socket says 172.21.15.37:33224) 2024-08-20T05:04:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.698+0000 7f343ce00640 1 -- 172.21.15.37:0/1508022917 learned_addr learned my addr 172.21.15.37:0/1508022917 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.698+0000 7f343d800640 1 --2- 172.21.15.37:0/1508022917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 0x55679b71ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.699+0000 7f343ce00640 1 --2- 172.21.15.37:0/1508022917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b723370 0x55679b7204f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.699+0000 7f343ce00640 1 -- 172.21.15.37:0/1508022917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 msgr2=0x55679b71ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:08.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.699+0000 7f343ce00640 1 --2- 172.21.15.37:0/1508022917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 0x55679b71ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.699+0000 7f343ce00640 1 -- 172.21.15.37:0/1508022917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b723370 msgr2=0x55679b7204f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:08.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.699+0000 7f343ce00640 1 --2- 172.21.15.37:0/1508022917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b723370 0x55679b7204f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.701+0000 7f343ce00640 1 -- 172.21.15.37:0/1508022917 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55679b3db650 con 0x55679b716ac0 2024-08-20T05:04:08.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.701+0000 7f343d800640 1 --2- 172.21.15.37:0/1508022917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 0x55679b71ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:04:08.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.701+0000 7f343ce00640 1 --2- 172.21.15.37:0/1508022917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b716ac0 0x55679b722b60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3424009ec0 tx=0x7f3424004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25b4efc3fcff44a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.701+0000 7f341f400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:04:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.702+0000 7f341f400640 1 -- 172.21.15.37:0/1508022917 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3424011d70 con 0x55679b716ac0 2024-08-20T05:04:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.702+0000 7f341f400640 1 -- 172.21.15.37:0/1508022917 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f342401f420 con 0x55679b716ac0 2024-08-20T05:04:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.702+0000 7f3442c45740 1 -- 172.21.15.37:0/1508022917 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f342c042070 con 0x55679b716ac0 2024-08-20T05:04:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.702+0000 7f341f400640 1 -- 172.21.15.37:0/1508022917 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f342401f620 con 0x55679b716ac0 2024-08-20T05:04:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.702+0000 7f3442c45740 10 client.26032 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.703+0000 7f3442c45740 1 -- 172.21.15.37:0/1508022917 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55679b7317e0 con 0x55679b716ac0 2024-08-20T05:04:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.703+0000 7f341f400640 1 -- 172.21.15.37:0/1508022917 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f342c042070 con 0x55679b716ac0 2024-08-20T05:04:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.703+0000 7f341f400640 1 -- 172.21.15.37:0/1508022917 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f34240296f0 con 0x55679b716ac0 2024-08-20T05:04:08.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.703+0000 7f3442c45740 10 client.26032 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:08.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.703+0000 7f3442c45740 10 client.26032 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:04:08.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.703+0000 7f3442c45740 20 client.26032 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:08.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.703+0000 7f3442c45740 1 --2- 172.21.15.37:0/1508022917 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55679b732ca0 0x55679b735090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.703+0000 7f3442c45740 4 client.26032 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:04:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.703+0000 7f3442c45740 1 -- 172.21.15.37:0/1508022917 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55679b68e9f0 con 0x55679b732ca0 2024-08-20T05:04:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.704+0000 7f343d800640 1 --2- 172.21.15.37:0/1508022917 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55679b732ca0 0x55679b735090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.704+0000 7f343d800640 1 --2- 172.21.15.37:0/1508022917 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55679b732ca0 0x55679b735090 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac0bc7864283fc66 server_cookie=2fad9cc09f668559 in_seq=0 out_seq=0 2024-08-20T05:04:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.704+0000 7f341f400640 10 client.26032 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:04:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.705+0000 7f341f400640 1 -- 172.21.15.37:0/1508022917 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55679b68e9f0 con 0x55679b732ca0 2024-08-20T05:04:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.705+0000 7f341f400640 10 client.26032 handle_command_reply: tid=0 2024-08-20T05:04:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.705+0000 7f3442c45740 1 client.26032 shutdown 2024-08-20T05:04:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.706+0000 7f3442c45740 1 -- 172.21.15.37:0/1508022917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b716ac0 msgr2=0x55679b722b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.706+0000 7f3442c45740 1 --2- 172.21.15.37:0/1508022917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b716ac0 0x55679b722b60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3424009ec0 tx=0x7f3424004730 comp rx=0 tx=0).stop 2024-08-20T05:04:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.706+0000 7f3442c45740 1 -- 172.21.15.37:0/1508022917 shutdown_connections 2024-08-20T05:04:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.706+0000 7f3442c45740 1 --2- 172.21.15.37:0/1508022917 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55679b732ca0 0x55679b735090 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.706+0000 7f341f400640 0 client.26032 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:04:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.706+0000 7f3442c45740 1 --2- 172.21.15.37:0/1508022917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b723370 0x55679b7204f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.706+0000 7f3442c45740 1 --2- 172.21.15.37:0/1508022917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 0x55679b71ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.706+0000 7f3442c45740 1 --2- 172.21.15.37:0/1508022917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b716ac0 0x55679b722b60 secure :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3424009ec0 tx=0x7f3424004730 comp rx=0 tx=0).stop 2024-08-20T05:04:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.706+0000 7f3442c45740 1 -- 172.21.15.37:0/1508022917 >> 172.21.15.37:0/1508022917 conn(0x55679b7148f0 msgr2=0x55679b71a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.706+0000 7f3442c45740 1 -- 172.21.15.37:0/1508022917 shutdown_connections 2024-08-20T05:04:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.706+0000 7f3442c45740 1 -- 172.21.15.37:0/1508022917 wait complete. 2024-08-20T05:04:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.707+0000 7f3442c45740 20 client.26032 trim_cache size 0 max 16384 2024-08-20T05:04:08.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.735+0000 7f3442c45740 1 Processor -- start 2024-08-20T05:04:08.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.735+0000 7f3442c45740 1 -- start start 2024-08-20T05:04:08.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.737+0000 7f3442c45740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b7173e0 0x55679b72f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.737+0000 7f3442c45740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b723370 0x55679b73a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.737+0000 7f3442c45740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b716090 0x55679b73ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.737+0000 7f3442c45740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f34381c6d50 con 0x55679b7173e0 2024-08-20T05:04:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.737+0000 7f3442c45740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f34381c8950 con 0x55679b723370 2024-08-20T05:04:08.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.737+0000 7f3442c45740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f34381c7420 con 0x55679b716090 2024-08-20T05:04:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.738+0000 7f343d800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b723370 0x55679b73a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.738+0000 7f343d800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b723370 0x55679b73a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47376/0 (socket says 172.21.15.37:47376) 2024-08-20T05:04:08.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.738+0000 7f343d800640 1 -- 172.21.15.37:0/1119323524 learned_addr learned my addr 172.21.15.37:0/1119323524 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.739+0000 7f343ce00640 1 --2- 172.21.15.37:0/1119323524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b7173e0 0x55679b72f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.739+0000 7f343ce00640 1 --2- 172.21.15.37:0/1119323524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b716090 0x55679b73ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.739+0000 7f343ce00640 1 -- 172.21.15.37:0/1119323524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b716090 msgr2=0x55679b73ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.739+0000 7f343ce00640 1 --2- 172.21.15.37:0/1119323524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b716090 0x55679b73ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.739+0000 7f343ce00640 1 -- 172.21.15.37:0/1119323524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b723370 msgr2=0x55679b73a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:08.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.739+0000 7f343ce00640 1 --2- 172.21.15.37:0/1119323524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b723370 0x55679b73a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.739+0000 7f343ce00640 1 -- 172.21.15.37:0/1119323524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55679b7356f0 con 0x55679b7173e0 2024-08-20T05:04:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.741+0000 7f343ce00640 1 --2- 172.21.15.37:0/1119323524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b7173e0 0x55679b72f0b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3424029ac0 tx=0x7f34240129e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fc20119f4af43b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.741+0000 7f342a000640 1 -- 172.21.15.37:0/1119323524 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3424000e60 con 0x55679b7173e0 2024-08-20T05:04:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.741+0000 7f342a000640 1 -- 172.21.15.37:0/1119323524 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3424009470 con 0x55679b7173e0 2024-08-20T05:04:08.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.741+0000 7f342a000640 1 -- 172.21.15.37:0/1119323524 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f342401f620 con 0x55679b7173e0 2024-08-20T05:04:08.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.744+0000 7f3442c45740 1 -- 172.21.15.37:0/1119323524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b7173e0 msgr2=0x55679b72f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:08.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.744+0000 7f3442c45740 1 --2- 172.21.15.37:0/1119323524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b7173e0 0x55679b72f0b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3424029ac0 tx=0x7f34240129e0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.745+0000 7f3442c45740 1 -- 172.21.15.37:0/1119323524 shutdown_connections 2024-08-20T05:04:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.745+0000 7f3442c45740 1 --2- 172.21.15.37:0/1119323524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b716090 0x55679b73ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.745+0000 7f3442c45740 1 --2- 172.21.15.37:0/1119323524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b723370 0x55679b73a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.745+0000 7f3442c45740 1 --2- 172.21.15.37:0/1119323524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b7173e0 0x55679b72f0b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.745+0000 7f3442c45740 1 -- 172.21.15.37:0/1119323524 >> 172.21.15.37:0/1119323524 conn(0x55679b7148f0 msgr2=0x55679b71f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.746+0000 7f3442c45740 1 -- 172.21.15.37:0/1119323524 shutdown_connections 2024-08-20T05:04:08.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.746+0000 7f3442c45740 1 -- 172.21.15.37:0/1119323524 wait complete. 2024-08-20T05:04:08.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.747+0000 7f3442c45740 1 -- start start 2024-08-20T05:04:08.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.747+0000 7f3442c45740 1 Processor -- start 2024-08-20T05:04:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.748+0000 7f3442c45740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b716090 0x55679b72b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.748+0000 7f3442c45740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 0x55679b726d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.748+0000 7f3442c45740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b723370 0x55679b727290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.748+0000 7f3442c45740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f34381c81c0 con 0x55679b716090 2024-08-20T05:04:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.748+0000 7f3442c45740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f34381c7af0 con 0x55679b7173e0 2024-08-20T05:04:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.748+0000 7f3442c45740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f34381c4d70 con 0x55679b723370 2024-08-20T05:04:08.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.748+0000 7f3442c45740 10 client.0 _ll_register_callbacks cb 0x7f3424009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:08.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.751+0000 7f343ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b716090 0x55679b72b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.751+0000 7f343d800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 0x55679b726d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.751+0000 7f343d800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 0x55679b726d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47390/0 (socket says 172.21.15.37:47390) 2024-08-20T05:04:08.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.751+0000 7f343d800640 1 -- 172.21.15.37:0/3609579566 learned_addr learned my addr 172.21.15.37:0/3609579566 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:08.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.751+0000 7f343ce00640 1 --2- 172.21.15.37:0/3609579566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b723370 0x55679b727290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.752+0000 7f343ce00640 1 -- 172.21.15.37:0/3609579566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 msgr2=0x55679b726d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:08.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.752+0000 7f343ce00640 1 --2- 172.21.15.37:0/3609579566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 0x55679b726d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.752+0000 7f343ce00640 1 -- 172.21.15.37:0/3609579566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b716090 msgr2=0x55679b72b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:08.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.753+0000 7f343ce00640 1 --2- 172.21.15.37:0/3609579566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b716090 0x55679b72b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.753+0000 7f343ce00640 1 -- 172.21.15.37:0/3609579566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55679b727ac0 con 0x55679b723370 2024-08-20T05:04:08.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.753+0000 7f343d800640 1 --2- 172.21.15.37:0/3609579566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 0x55679b726d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:04:08.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.754+0000 7f343ce00640 1 --2- 172.21.15.37:0/3609579566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b723370 0x55679b727290 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3424009cb0 tx=0x7f3424000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=218912f3565278f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:08.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.755+0000 7f341f400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:04:08.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.755+0000 7f341f400640 1 -- 172.21.15.37:0/3609579566 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3424004230 con 0x55679b723370 2024-08-20T05:04:08.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.755+0000 7f341f400640 1 -- 172.21.15.37:0/3609579566 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f34240043d0 con 0x55679b723370 2024-08-20T05:04:08.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.755+0000 7f3442c45740 1 -- 172.21.15.37:0/3609579566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3424009470 con 0x55679b723370 2024-08-20T05:04:08.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.756+0000 7f341f400640 1 -- 172.21.15.37:0/3609579566 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3424029420 con 0x55679b723370 2024-08-20T05:04:08.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.756+0000 7f3442c45740 10 client.26038 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:08.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.756+0000 7f3442c45740 1 -- 172.21.15.37:0/3609579566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55679b79d8c0 con 0x55679b723370 2024-08-20T05:04:08.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.757+0000 7f341f400640 1 -- 172.21.15.37:0/3609579566 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3424009470 con 0x55679b723370 2024-08-20T05:04:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.757+0000 7f341f400640 1 -- 172.21.15.37:0/3609579566 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f3424005430 con 0x55679b723370 2024-08-20T05:04:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.757+0000 7f3442c45740 10 client.26038 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.757+0000 7f3442c45740 10 client.26038 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:04:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.757+0000 7f3442c45740 20 client.26038 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.757+0000 7f3442c45740 1 --2- 172.21.15.37:0/3609579566 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55679b79de20 0x55679b7a0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.757+0000 7f3442c45740 4 client.26038 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:04:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.757+0000 7f3442c45740 1 -- 172.21.15.37:0/3609579566 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55679b68a490 con 0x55679b79de20 2024-08-20T05:04:08.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.757+0000 7f343d800640 1 --2- 172.21.15.37:0/3609579566 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55679b79de20 0x55679b7a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:08.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.759+0000 7f343d800640 1 --2- 172.21.15.37:0/3609579566 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55679b79de20 0x55679b7a0210 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=374f4b72908822a1 server_cookie=91d5022aa7b0c0ea in_seq=0 out_seq=0 2024-08-20T05:04:08.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.759+0000 7f341f400640 10 client.26038 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:04:08.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.759+0000 7f341f400640 1 -- 172.21.15.37:0/3609579566 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55679b68a490 con 0x55679b79de20 2024-08-20T05:04:08.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.759+0000 7f341f400640 10 client.26038 handle_command_reply: tid=0 2024-08-20T05:04:08.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.759+0000 7f3442c45740 1 client.26038 shutdown 2024-08-20T05:04:08.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.760+0000 7f3442c45740 1 -- 172.21.15.37:0/3609579566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b723370 msgr2=0x55679b727290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:08.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.760+0000 7f3442c45740 1 --2- 172.21.15.37:0/3609579566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b723370 0x55679b727290 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3424009cb0 tx=0x7f3424000bc0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.760+0000 7f3442c45740 1 -- 172.21.15.37:0/3609579566 shutdown_connections 2024-08-20T05:04:08.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.760+0000 7f3442c45740 1 --2- 172.21.15.37:0/3609579566 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55679b79de20 0x55679b7a0210 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.760+0000 7f3442c45740 1 --2- 172.21.15.37:0/3609579566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55679b723370 0x55679b727290 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.760+0000 7f3442c45740 1 --2- 172.21.15.37:0/3609579566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55679b7173e0 0x55679b726d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.760+0000 7f3442c45740 1 --2- 172.21.15.37:0/3609579566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55679b716090 0x55679b72b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.760+0000 7f3442c45740 1 -- 172.21.15.37:0/3609579566 >> 172.21.15.37:0/3609579566 conn(0x55679b7148f0 msgr2=0x55679b7215e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:08.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.762+0000 7f341f400640 0 client.26038 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:04:08.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.762+0000 7f3442c45740 1 -- 172.21.15.37:0/3609579566 shutdown_connections 2024-08-20T05:04:08.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.762+0000 7f3442c45740 1 -- 172.21.15.37:0/3609579566 wait complete. 2024-08-20T05:04:08.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.762+0000 7f3442c45740 20 client.26038 trim_cache size 0 max 16384 2024-08-20T05:04:08.766 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:04:08.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.764+0000 7f343ec00640 1 -- 172.21.15.37:0/1151312586 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f34200b3e40 msgr2=0x7f34200b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:08.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.764+0000 7f343ec00640 1 --2- 172.21.15.37:0/1151312586 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f34200b3e40 0x7f34200b6300 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f343000b940 tx=0x7f3430014d00 comp rx=0 tx=0).stop 2024-08-20T05:04:08.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.764+0000 7f343ec00640 1 -- 172.21.15.37:0/1151312586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f343810aea0 msgr2=0x7f343806f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:08.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.764+0000 7f343ec00640 1 --2- 172.21.15.37:0/1151312586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f343810aea0 0x7f343806f960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f343000b970 tx=0x7f343000be30 comp rx=0 tx=0).stop 2024-08-20T05:04:08.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.765+0000 7f343ec00640 1 -- 172.21.15.37:0/1151312586 shutdown_connections 2024-08-20T05:04:08.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.765+0000 7f343ec00640 1 --2- 172.21.15.37:0/1151312586 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f34200b3e40 0x7f34200b6300 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.765+0000 7f343ec00640 1 --2- 172.21.15.37:0/1151312586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f343810aea0 0x7f343806f960 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.765+0000 7f343ec00640 1 --2- 172.21.15.37:0/1151312586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f343810a520 0x7f343806cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.765+0000 7f343ec00640 1 --2- 172.21.15.37:0/1151312586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3438104b10 0x7f343806c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:08.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.765+0000 7f343ec00640 1 -- 172.21.15.37:0/1151312586 >> 172.21.15.37:0/1151312586 conn(0x7f3438100540 msgr2=0x7f3438102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:08.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.766+0000 7f343ec00640 1 -- 172.21.15.37:0/1151312586 shutdown_connections 2024-08-20T05:04:08.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:08.766+0000 7f343ec00640 1 -- 172.21.15.37:0/1151312586 wait complete. 2024-08-20T05:04:09.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:09 smithi037 ceph-mon[17265]: pgmap v458: 129 pgs: 129 active+clean; 980 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 487 op/s 2024-08-20T05:04:09.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:09 smithi135 ceph-mon[22342]: pgmap v458: 129 pgs: 129 active+clean; 980 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 487 op/s 2024-08-20T05:04:09.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:09 smithi130 ceph-mon[22007]: pgmap v458: 129 pgs: 129 active+clean; 980 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.7 MiB/s wr, 487 op/s 2024-08-20T05:04:10.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T05:04:10.985 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:04:11.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:11 smithi037 ceph-mon[17265]: pgmap v459: 129 pgs: 129 active+clean; 981 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.0 MiB/s wr, 595 op/s 2024-08-20T05:04:11.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:11 smithi135 ceph-mon[22342]: pgmap v459: 129 pgs: 129 active+clean; 981 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.0 MiB/s wr, 595 op/s 2024-08-20T05:04:11.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:11 smithi130 ceph-mon[22007]: pgmap v459: 129 pgs: 129 active+clean; 981 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.0 MiB/s wr, 595 op/s 2024-08-20T05:04:12.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.084+0000 7fd336800640 1 -- 172.21.15.37:0/359940183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd33010eaf0 msgr2=0x7fd33010ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:12.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.084+0000 7fd336800640 1 --2- 172.21.15.37:0/359940183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd33010eaf0 0x7fd33010ef30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd318009860 tx=0x7fd31802a340 comp rx=0 tx=0).stop 2024-08-20T05:04:12.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.084+0000 7fd336800640 1 -- 172.21.15.37:0/359940183 shutdown_connections 2024-08-20T05:04:12.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.084+0000 7fd336800640 1 --2- 172.21.15.37:0/359940183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd33010f470 0x7fd330115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.084+0000 7fd336800640 1 --2- 172.21.15.37:0/359940183 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd33010eaf0 0x7fd33010ef30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.084+0000 7fd336800640 1 --2- 172.21.15.37:0/359940183 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd3301090e0 0x7fd3301094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.084+0000 7fd336800640 1 -- 172.21.15.37:0/359940183 >> 172.21.15.37:0/359940183 conn(0x7fd330078760 msgr2=0x7fd33007ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.084+0000 7fd336800640 1 -- 172.21.15.37:0/359940183 shutdown_connections 2024-08-20T05:04:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.084+0000 7fd336800640 1 -- 172.21.15.37:0/359940183 wait complete. 2024-08-20T05:04:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.085+0000 7fd336800640 1 Processor -- start 2024-08-20T05:04:12.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.086+0000 7fd336800640 1 -- start start 2024-08-20T05:04:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.086+0000 7fd336800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3301090e0 0x7fd33019f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.086+0000 7fd336800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd33010eaf0 0x7fd33019f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.086+0000 7fd336800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33010f470 0x7fd3301a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.086+0000 7fd336800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd330119070 con 0x7fd3301090e0 2024-08-20T05:04:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.086+0000 7fd336800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd330118ef0 con 0x7fd33010eaf0 2024-08-20T05:04:12.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.086+0000 7fd336800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd3301191f0 con 0x7fd33010f470 2024-08-20T05:04:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.087+0000 7fd32fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33010f470 0x7fd3301a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.087+0000 7fd32fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33010f470 0x7fd3301a4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33250/0 (socket says 172.21.15.37:33250) 2024-08-20T05:04:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.087+0000 7fd32fe00640 1 -- 172.21.15.37:0/265826347 learned_addr learned my addr 172.21.15.37:0/265826347 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.087+0000 7fd326a00640 1 --2- 172.21.15.37:0/265826347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd33010eaf0 0x7fd33019f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.087+0000 7fd32fe00640 1 -- 172.21.15.37:0/265826347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd33010eaf0 msgr2=0x7fd33019f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.087+0000 7fd32fe00640 1 --2- 172.21.15.37:0/265826347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd33010eaf0 0x7fd33019f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.087+0000 7fd32fe00640 1 -- 172.21.15.37:0/265826347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3301090e0 msgr2=0x7fd33019f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.087+0000 7fd32fe00640 1 --2- 172.21.15.37:0/265826347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3301090e0 0x7fd33019f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.087+0000 7fd32fe00640 1 -- 172.21.15.37:0/265826347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3301a5450 con 0x7fd33010f470 2024-08-20T05:04:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.088+0000 7fd32fe00640 1 --2- 172.21.15.37:0/265826347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33010f470 0x7fd3301a4c80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd32800e970 tx=0x7fd32800ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.088+0000 7fd32cc00640 1 -- 172.21.15.37:0/265826347 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32800ccc0 con 0x7fd33010f470 2024-08-20T05:04:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.088+0000 7fd32cc00640 1 -- 172.21.15.37:0/265826347 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd32800ce60 con 0x7fd33010f470 2024-08-20T05:04:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.088+0000 7fd32cc00640 1 -- 172.21.15.37:0/265826347 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd328010430 con 0x7fd33010f470 2024-08-20T05:04:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.088+0000 7fd336800640 1 -- 172.21.15.37:0/265826347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3301a5740 con 0x7fd33010f470 2024-08-20T05:04:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.089+0000 7fd336800640 1 -- 172.21.15.37:0/265826347 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3301abe00 con 0x7fd33010f470 2024-08-20T05:04:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.093+0000 7fd32cc00640 1 -- 172.21.15.37:0/265826347 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd3280105d0 con 0x7fd33010f470 2024-08-20T05:04:12.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.093+0000 7fd339408740 1 Processor -- start 2024-08-20T05:04:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.094+0000 7fd339408740 1 -- start start 2024-08-20T05:04:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.094+0000 7fd339408740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37ede940 0x561a37eded20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.094+0000 7fd339408740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37edf260 0x561a37eeacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.095+0000 7fd339408740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37eeb1f0 0x561a37eed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.095+0000 7fd339408740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561a37e54aa0 con 0x561a37eeb1f0 2024-08-20T05:04:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.095+0000 7fd339408740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561a37e43fa0 con 0x561a37ede940 2024-08-20T05:04:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.095+0000 7fd339408740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561a37e47fe0 con 0x561a37edf260 2024-08-20T05:04:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.095+0000 7fd32f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37edf260 0x561a37eeacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.095+0000 7fd32f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37edf260 0x561a37eeacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33252/0 (socket says 172.21.15.37:33252) 2024-08-20T05:04:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.095+0000 7fd32f400640 1 -- 172.21.15.37:0/2073150174 learned_addr learned my addr 172.21.15.37:0/2073150174 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.095+0000 7fd32f400640 1 -- 172.21.15.37:0/2073150174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37ede940 msgr2=0x561a37eded20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.095+0000 7fd32f400640 1 --2- 172.21.15.37:0/2073150174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37ede940 0x561a37eded20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.095+0000 7fd32f400640 1 -- 172.21.15.37:0/2073150174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37eeb1f0 msgr2=0x561a37eed5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:04:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.095+0000 7fd32f400640 1 --2- 172.21.15.37:0/2073150174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37eeb1f0 0x561a37eed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.095+0000 7fd32f400640 1 -- 172.21.15.37:0/2073150174 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a37dea420 con 0x561a37edf260 2024-08-20T05:04:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.096+0000 7fd32f400640 1 --2- 172.21.15.37:0/2073150174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37edf260 0x561a37eeacb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd320009ee0 tx=0x7fd32000e7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2242ae8606bd291 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:12.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.096+0000 7fd324c00640 1 -- 172.21.15.37:0/2073150174 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32001b070 con 0x561a37edf260 2024-08-20T05:04:12.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.097+0000 7fd324c00640 1 -- 172.21.15.37:0/2073150174 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd32000ca30 con 0x561a37edf260 2024-08-20T05:04:12.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.097+0000 7fd324c00640 1 -- 172.21.15.37:0/2073150174 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd320016c00 con 0x561a37edf260 2024-08-20T05:04:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.098+0000 7fd339408740 1 -- 172.21.15.37:0/2073150174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37edf260 msgr2=0x561a37eeacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.098+0000 7fd339408740 1 --2- 172.21.15.37:0/2073150174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37edf260 0x561a37eeacb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd320009ee0 tx=0x7fd32000e7c0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.099+0000 7fd339408740 1 -- 172.21.15.37:0/2073150174 shutdown_connections 2024-08-20T05:04:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.099+0000 7fd339408740 1 --2- 172.21.15.37:0/2073150174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37eeb1f0 0x561a37eed5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.099+0000 7fd339408740 1 --2- 172.21.15.37:0/2073150174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37edf260 0x561a37eeacb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.099+0000 7fd339408740 1 --2- 172.21.15.37:0/2073150174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37ede940 0x561a37eded20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.099+0000 7fd339408740 1 -- 172.21.15.37:0/2073150174 >> 172.21.15.37:0/2073150174 conn(0x561a37edc770 msgr2=0x561a37edd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:12.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.100+0000 7fd339408740 1 -- 172.21.15.37:0/2073150174 shutdown_connections 2024-08-20T05:04:12.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.100+0000 7fd339408740 1 -- 172.21.15.37:0/2073150174 wait complete. 2024-08-20T05:04:12.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.101+0000 7fd339408740 1 -- start start 2024-08-20T05:04:12.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.101+0000 7fd339408740 1 Processor -- start 2024-08-20T05:04:12.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.101+0000 7fd32cc00640 1 --2- 172.21.15.37:0/265826347 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd3140b3b60 0x7fd3140b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.102+0000 7fd32cc00640 1 -- 172.21.15.37:0/265826347 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd3280e43a0 con 0x7fd33010f470 2024-08-20T05:04:12.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.102+0000 7fd326a00640 1 --2- 172.21.15.37:0/265826347 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd3140b3b60 0x7fd3140b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:12.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.102+0000 7fd339408740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37ede940 0x561a37eeaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.102+0000 7fd339408740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37edf260 0x561a37ee7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.102+0000 7fd339408740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37eeb1f0 0x561a37ee83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.102+0000 7fd339408740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561a37ca6700 con 0x561a37edf260 2024-08-20T05:04:12.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.102+0000 7fd339408740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561a37ddf290 con 0x561a37eeb1f0 2024-08-20T05:04:12.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.102+0000 7fd339408740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561a37eede70 con 0x561a37ede940 2024-08-20T05:04:12.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.103+0000 7fd339408740 10 client.0 _ll_register_callbacks cb 0x561a37e3e1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:12.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.103+0000 7fd32f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37ede940 0x561a37eeaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:12.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.103+0000 7fd32f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37ede940 0x561a37eeaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33262/0 (socket says 172.21.15.37:33262) 2024-08-20T05:04:12.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.103+0000 7fd32f400640 1 -- 172.21.15.37:0/4020735046 learned_addr learned my addr 172.21.15.37:0/4020735046 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:12.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.103+0000 7fd32fe00640 1 --2- 172.21.15.37:0/4020735046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37eeb1f0 0x561a37ee83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:12.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.103+0000 7fd32f400640 1 -- 172.21.15.37:0/4020735046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37eeb1f0 msgr2=0x561a37ee83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:12.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.103+0000 7fd32f400640 1 --2- 172.21.15.37:0/4020735046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37eeb1f0 0x561a37ee83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.103+0000 7fd32f400640 1 -- 172.21.15.37:0/4020735046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37edf260 msgr2=0x561a37ee7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:12.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.103+0000 7fd32f400640 1 --2- 172.21.15.37:0/4020735046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37edf260 0x561a37ee7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.103+0000 7fd32f400640 1 -- 172.21.15.37:0/4020735046 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a37ba3650 con 0x561a37ede940 2024-08-20T05:04:12.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.104+0000 7fd326a00640 1 --2- 172.21.15.37:0/265826347 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd3140b3b60 0x7fd3140b6020 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd318009830 tx=0x7fd318000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:12.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.104+0000 7fd32f400640 1 --2- 172.21.15.37:0/4020735046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37ede940 0x561a37eeaa00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd320006010 tx=0x7fd320016640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edd7189151c354a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:12.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.104+0000 7fd31d600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:04:12.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.104+0000 7fd31d600640 1 -- 172.21.15.37:0/4020735046 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32001b040 con 0x561a37ede940 2024-08-20T05:04:12.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.105+0000 7fd31d600640 1 -- 172.21.15.37:0/4020735046 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd320013050 con 0x561a37ede940 2024-08-20T05:04:12.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.105+0000 7fd339408740 1 -- 172.21.15.37:0/4020735046 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd32000ca30 con 0x561a37ede940 2024-08-20T05:04:12.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.105+0000 7fd31d600640 1 -- 172.21.15.37:0/4020735046 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd32002e050 con 0x561a37ede940 2024-08-20T05:04:12.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.105+0000 7fd339408740 10 client.26050 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:12.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.105+0000 7fd339408740 1 -- 172.21.15.37:0/4020735046 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561a37ef96c0 con 0x561a37ede940 2024-08-20T05:04:12.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.105+0000 7fd31d600640 1 -- 172.21.15.37:0/4020735046 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd32000ca30 con 0x561a37ede940 2024-08-20T05:04:12.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.106+0000 7fd31d600640 1 -- 172.21.15.37:0/4020735046 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fd32001e030 con 0x561a37ede940 2024-08-20T05:04:12.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.106+0000 7fd339408740 10 client.26050 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:12.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.106+0000 7fd339408740 10 client.26050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:04:12.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.106+0000 7fd339408740 20 client.26050 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:12.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.106+0000 7fd339408740 1 --2- 172.21.15.37:0/4020735046 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561a37efaac0 0x561a37efceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.107+0000 7fd339408740 4 client.26050 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:04:12.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.107+0000 7fd339408740 1 -- 172.21.15.37:0/4020735046 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a37e569f0 con 0x561a37efaac0 2024-08-20T05:04:12.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.107+0000 7fd326a00640 1 --2- 172.21.15.37:0/4020735046 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561a37efaac0 0x561a37efceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:12.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.108+0000 7fd326a00640 1 --2- 172.21.15.37:0/4020735046 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561a37efaac0 0x561a37efceb0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5775cece10e291db server_cookie=753a2615a44dc334 in_seq=0 out_seq=0 2024-08-20T05:04:12.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.108+0000 7fd31d600640 10 client.26050 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:12.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.109+0000 7fd31d600640 1 -- 172.21.15.37:0/4020735046 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561a37e569f0 con 0x561a37efaac0 2024-08-20T05:04:12.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.109+0000 7fd31d600640 10 client.26050 handle_command_reply: tid=0 2024-08-20T05:04:12.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.109+0000 7fd339408740 1 client.26050 shutdown 2024-08-20T05:04:12.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.109+0000 7fd339408740 1 -- 172.21.15.37:0/4020735046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37ede940 msgr2=0x561a37eeaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:12.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.109+0000 7fd339408740 1 --2- 172.21.15.37:0/4020735046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37ede940 0x561a37eeaa00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd320006010 tx=0x7fd320016640 comp rx=0 tx=0).stop 2024-08-20T05:04:12.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.109+0000 7fd339408740 1 -- 172.21.15.37:0/4020735046 shutdown_connections 2024-08-20T05:04:12.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.109+0000 7fd339408740 1 --2- 172.21.15.37:0/4020735046 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561a37efaac0 0x561a37efceb0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.109+0000 7fd339408740 1 --2- 172.21.15.37:0/4020735046 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37eeb1f0 0x561a37ee83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.109+0000 7fd339408740 1 --2- 172.21.15.37:0/4020735046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37edf260 0x561a37ee7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.109+0000 7fd339408740 1 --2- 172.21.15.37:0/4020735046 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37ede940 0x561a37eeaa00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.109+0000 7fd339408740 1 -- 172.21.15.37:0/4020735046 >> 172.21.15.37:0/4020735046 conn(0x561a37edc770 msgr2=0x561a37ee22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:12.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.109+0000 7fd31d600640 0 client.26050 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:12.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.110+0000 7fd339408740 1 -- 172.21.15.37:0/4020735046 shutdown_connections 2024-08-20T05:04:12.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.110+0000 7fd339408740 1 -- 172.21.15.37:0/4020735046 wait complete. 2024-08-20T05:04:12.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.111+0000 7fd339408740 20 client.26050 trim_cache size 0 max 16384 2024-08-20T05:04:12.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.134+0000 7fd339408740 1 Processor -- start 2024-08-20T05:04:12.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.134+0000 7fd339408740 1 -- start start 2024-08-20T05:04:12.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.135+0000 7fd339408740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37ede940 0x561a37edb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.135+0000 7fd339408740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37edf260 0x561a37f026b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.135+0000 7fd339408740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37eeb1f0 0x561a37f02bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.135+0000 7fd339408740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd3301b5f00 con 0x561a37edf260 2024-08-20T05:04:12.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.135+0000 7fd339408740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd3301b7b00 con 0x561a37ede940 2024-08-20T05:04:12.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.135+0000 7fd339408740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd3301b65d0 con 0x561a37eeb1f0 2024-08-20T05:04:12.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.136+0000 7fd32fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37eeb1f0 0x561a37f02bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:12.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.136+0000 7fd32f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37ede940 0x561a37edb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:12.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.136+0000 7fd32f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37ede940 0x561a37edb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47442/0 (socket says 172.21.15.37:47442) 2024-08-20T05:04:12.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.136+0000 7fd32f400640 1 -- 172.21.15.37:0/3071984561 learned_addr learned my addr 172.21.15.37:0/3071984561 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:12.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.136+0000 7fd326a00640 1 --2- 172.21.15.37:0/3071984561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37edf260 0x561a37f026b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:12.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.137+0000 7fd32f400640 1 -- 172.21.15.37:0/3071984561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37eeb1f0 msgr2=0x561a37f02bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:12.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.137+0000 7fd32f400640 1 --2- 172.21.15.37:0/3071984561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37eeb1f0 0x561a37f02bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.137+0000 7fd32f400640 1 -- 172.21.15.37:0/3071984561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37edf260 msgr2=0x561a37f026b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:12.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.137+0000 7fd32f400640 1 --2- 172.21.15.37:0/3071984561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37edf260 0x561a37f026b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.137+0000 7fd32f400640 1 -- 172.21.15.37:0/3071984561 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a37ee9130 con 0x561a37ede940 2024-08-20T05:04:12.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.137+0000 7fd326a00640 1 --2- 172.21.15.37:0/3071984561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37edf260 0x561a37f026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:04:12.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.138+0000 7fd32fe00640 1 --2- 172.21.15.37:0/3071984561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37eeb1f0 0x561a37f02bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:04:12.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.138+0000 7fd32f400640 1 --2- 172.21.15.37:0/3071984561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37ede940 0x561a37edb740 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd32000e800 tx=0x7fd320009ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=469995f200217cf8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:12.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.138+0000 7fd31fe00640 1 -- 172.21.15.37:0/3071984561 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32001b040 con 0x561a37ede940 2024-08-20T05:04:12.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.138+0000 7fd31fe00640 1 -- 172.21.15.37:0/3071984561 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd320016810 con 0x561a37ede940 2024-08-20T05:04:12.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.138+0000 7fd31fe00640 1 -- 172.21.15.37:0/3071984561 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32000c580 con 0x561a37ede940 2024-08-20T05:04:12.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.139+0000 7fd339408740 1 -- 172.21.15.37:0/3071984561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37ede940 msgr2=0x561a37edb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:12.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.139+0000 7fd339408740 1 --2- 172.21.15.37:0/3071984561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37ede940 0x561a37edb740 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd32000e800 tx=0x7fd320009ba0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.139+0000 7fd339408740 1 -- 172.21.15.37:0/3071984561 shutdown_connections 2024-08-20T05:04:12.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.139+0000 7fd339408740 1 --2- 172.21.15.37:0/3071984561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37eeb1f0 0x561a37f02bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.139+0000 7fd339408740 1 --2- 172.21.15.37:0/3071984561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37edf260 0x561a37f026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.139+0000 7fd339408740 1 --2- 172.21.15.37:0/3071984561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37ede940 0x561a37edb740 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.139+0000 7fd339408740 1 -- 172.21.15.37:0/3071984561 >> 172.21.15.37:0/3071984561 conn(0x561a37edc770 msgr2=0x561a37edb030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:12.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.139+0000 7fd339408740 1 -- 172.21.15.37:0/3071984561 shutdown_connections 2024-08-20T05:04:12.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.139+0000 7fd339408740 1 -- 172.21.15.37:0/3071984561 wait complete. 2024-08-20T05:04:12.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.140+0000 7fd339408740 1 -- start start 2024-08-20T05:04:12.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.140+0000 7fd339408740 1 Processor -- start 2024-08-20T05:04:12.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.141+0000 7fd339408740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37ede940 0x561a37ef0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.141+0000 7fd339408740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37edf260 0x561a37ef0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.141+0000 7fd339408740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37eeb1f0 0x561a37f5d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.141+0000 7fd339408740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd3301b7370 con 0x561a37edf260 2024-08-20T05:04:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.141+0000 7fd339408740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd3301b6ca0 con 0x561a37ede940 2024-08-20T05:04:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.141+0000 7fd339408740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd3301b3ee0 con 0x561a37eeb1f0 2024-08-20T05:04:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.142+0000 7fd326a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37edf260 0x561a37ef0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.142+0000 7fd32f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37ede940 0x561a37ef0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.142+0000 7fd32fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37eeb1f0 0x561a37f5d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.142+0000 7fd32fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37eeb1f0 0x561a37f5d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33280/0 (socket says 172.21.15.37:33280) 2024-08-20T05:04:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.142+0000 7fd32fe00640 1 -- 172.21.15.37:0/3133051456 learned_addr learned my addr 172.21.15.37:0/3133051456 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.142+0000 7fd339408740 10 client.0 _ll_register_callbacks cb 0x7fd320019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.142+0000 7fd32fe00640 1 -- 172.21.15.37:0/3133051456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37ede940 msgr2=0x561a37ef0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.142+0000 7fd32fe00640 1 --2- 172.21.15.37:0/3133051456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37ede940 0x561a37ef0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.142+0000 7fd32fe00640 1 -- 172.21.15.37:0/3133051456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37edf260 msgr2=0x561a37ef0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.142+0000 7fd32fe00640 1 --2- 172.21.15.37:0/3133051456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37edf260 0x561a37ef0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.142+0000 7fd32fe00640 1 -- 172.21.15.37:0/3133051456 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a37f5de40 con 0x561a37eeb1f0 2024-08-20T05:04:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.143+0000 7fd32fe00640 1 --2- 172.21.15.37:0/3133051456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37eeb1f0 0x561a37f5d730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd3280a6fd0 tx=0x7fd3280ab650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdd1797b8fbb6856 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:12.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.143+0000 7fd31d600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:04:12.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.143+0000 7fd31d600640 1 -- 172.21.15.37:0/3133051456 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3280b4000 con 0x561a37eeb1f0 2024-08-20T05:04:12.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.143+0000 7fd31d600640 1 -- 172.21.15.37:0/3133051456 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd3280ab3c0 con 0x561a37eeb1f0 2024-08-20T05:04:12.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.143+0000 7fd339408740 1 -- 172.21.15.37:0/3133051456 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd320016810 con 0x561a37eeb1f0 2024-08-20T05:04:12.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.144+0000 7fd31d600640 1 -- 172.21.15.37:0/3133051456 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd3280b3b70 con 0x561a37eeb1f0 2024-08-20T05:04:12.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.144+0000 7fd339408740 10 client.26056 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:12.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.144+0000 7fd339408740 1 -- 172.21.15.37:0/3133051456 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561a37f65260 con 0x561a37eeb1f0 2024-08-20T05:04:12.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.144+0000 7fd31d600640 1 -- 172.21.15.37:0/3133051456 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd320016810 con 0x561a37eeb1f0 2024-08-20T05:04:12.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.144+0000 7fd31d600640 1 -- 172.21.15.37:0/3133051456 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fd3280ae040 con 0x561a37eeb1f0 2024-08-20T05:04:12.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.144+0000 7fd339408740 10 client.26056 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:12.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.144+0000 7fd339408740 10 client.26056 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:04:12.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.144+0000 7fd339408740 20 client.26056 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:12.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.144+0000 7fd339408740 1 --2- 172.21.15.37:0/3133051456 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561a37f65b90 0x561a37f67fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:12.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.144+0000 7fd339408740 4 client.26056 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:04:12.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.144+0000 7fd339408740 1 -- 172.21.15.37:0/3133051456 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561a37e52490 con 0x561a37f65b90 2024-08-20T05:04:12.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.145+0000 7fd32f400640 1 --2- 172.21.15.37:0/3133051456 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561a37f65b90 0x561a37f67fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:12.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.145+0000 7fd31d600640 10 client.26056 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.146+0000 7fd32f400640 1 --2- 172.21.15.37:0/3133051456 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561a37f65b90 0x561a37f67fb0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afb48b30ad6ccef0 server_cookie=c39e3e5385a617c8 in_seq=0 out_seq=0 2024-08-20T05:04:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.146+0000 7fd31d600640 1 -- 172.21.15.37:0/3133051456 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561a37e52490 con 0x561a37f65b90 2024-08-20T05:04:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.146+0000 7fd31d600640 10 client.26056 handle_command_reply: tid=0 2024-08-20T05:04:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.146+0000 7fd339408740 1 client.26056 shutdown 2024-08-20T05:04:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.147+0000 7fd339408740 1 -- 172.21.15.37:0/3133051456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37eeb1f0 msgr2=0x561a37f5d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.147+0000 7fd339408740 1 --2- 172.21.15.37:0/3133051456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37eeb1f0 0x561a37f5d730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd3280a6fd0 tx=0x7fd3280ab650 comp rx=0 tx=0).stop 2024-08-20T05:04:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.147+0000 7fd339408740 1 -- 172.21.15.37:0/3133051456 shutdown_connections 2024-08-20T05:04:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.147+0000 7fd339408740 1 --2- 172.21.15.37:0/3133051456 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561a37f65b90 0x561a37f67fb0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.147+0000 7fd339408740 1 --2- 172.21.15.37:0/3133051456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561a37eeb1f0 0x561a37f5d730 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.147+0000 7fd339408740 1 --2- 172.21.15.37:0/3133051456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a37edf260 0x561a37ef0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.147+0000 7fd339408740 1 --2- 172.21.15.37:0/3133051456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561a37ede940 0x561a37ef0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.147+0000 7fd339408740 1 -- 172.21.15.37:0/3133051456 >> 172.21.15.37:0/3133051456 conn(0x561a37edc770 msgr2=0x561a37edb030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:12.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.147+0000 7fd31d600640 0 client.26056 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:12.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.148+0000 7fd339408740 1 -- 172.21.15.37:0/3133051456 shutdown_connections 2024-08-20T05:04:12.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.148+0000 7fd339408740 1 -- 172.21.15.37:0/3133051456 wait complete. 2024-08-20T05:04:12.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.149+0000 7fd339408740 20 client.26056 trim_cache size 0 max 16384 2024-08-20T05:04:12.152 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:04:12.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.150+0000 7fd336800640 1 -- 172.21.15.37:0/265826347 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd3140b3b60 msgr2=0x7fd3140b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:12.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.150+0000 7fd336800640 1 --2- 172.21.15.37:0/265826347 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd3140b3b60 0x7fd3140b6020 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd318009830 tx=0x7fd318000bc0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.150+0000 7fd336800640 1 -- 172.21.15.37:0/265826347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33010f470 msgr2=0x7fd3301a4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:12.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.150+0000 7fd336800640 1 --2- 172.21.15.37:0/265826347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33010f470 0x7fd3301a4c80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd32800e970 tx=0x7fd32800ed70 comp rx=0 tx=0).stop 2024-08-20T05:04:12.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.151+0000 7fd336800640 1 -- 172.21.15.37:0/265826347 shutdown_connections 2024-08-20T05:04:12.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.151+0000 7fd336800640 1 --2- 172.21.15.37:0/265826347 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd3140b3b60 0x7fd3140b6020 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.151+0000 7fd336800640 1 --2- 172.21.15.37:0/265826347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd33010f470 0x7fd3301a4c80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.151+0000 7fd336800640 1 --2- 172.21.15.37:0/265826347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd33010eaf0 0x7fd33019f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.151+0000 7fd336800640 1 --2- 172.21.15.37:0/265826347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3301090e0 0x7fd33019f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:12.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.151+0000 7fd336800640 1 -- 172.21.15.37:0/265826347 >> 172.21.15.37:0/265826347 conn(0x7fd330078760 msgr2=0x7fd33007ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:12.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.151+0000 7fd336800640 1 -- 172.21.15.37:0/265826347 shutdown_connections 2024-08-20T05:04:12.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:12.151+0000 7fd336800640 1 -- 172.21.15.37:0/265826347 wait complete. 2024-08-20T05:04:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 75.0 s, 1691.8 tps, lat 59.086 ms stddev 74.952 2024-08-20T05:04:13.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:13 smithi037 ceph-mon[17265]: pgmap v460: 129 pgs: 129 active+clean; 981 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 607 op/s 2024-08-20T05:04:13.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:13 smithi135 ceph-mon[22342]: pgmap v460: 129 pgs: 129 active+clean; 981 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 607 op/s 2024-08-20T05:04:13.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:13 smithi130 ceph-mon[22007]: pgmap v460: 129 pgs: 129 active+clean; 981 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 607 op/s 2024-08-20T05:04:14.248 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T05:04:14.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T05:04:14.891 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:04:15.312 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:15 smithi037 ceph-mon[17265]: pgmap v461: 129 pgs: 129 active+clean; 983 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.3 MiB/s wr, 741 op/s 2024-08-20T05:04:15.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.586+0000 7f97c5a00640 1 -- 172.21.15.37:0/1963395958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97c01084c0 msgr2=0x7f97c0108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:15.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.586+0000 7f97c5a00640 1 --2- 172.21.15.37:0/1963395958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97c01084c0 0x7f97c0108900 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009900 tx=0x7f97ac02a420 comp rx=0 tx=0).stop 2024-08-20T05:04:15.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.586+0000 7f97c5a00640 1 -- 172.21.15.37:0/1963395958 shutdown_connections 2024-08-20T05:04:15.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.586+0000 7f97c5a00640 1 --2- 172.21.15.37:0/1963395958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97c0108e40 0x7f97c010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.586+0000 7f97c5a00640 1 --2- 172.21.15.37:0/1963395958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97c01084c0 0x7f97c0108900 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.586+0000 7f97c5a00640 1 --2- 172.21.15.37:0/1963395958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c0102ab0 0x7f97c0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.586+0000 7f97c5a00640 1 -- 172.21.15.37:0/1963395958 >> 172.21.15.37:0/1963395958 conn(0x7f97c00fe520 msgr2=0x7f97c0100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:15.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.588+0000 7f97c5a00640 1 -- 172.21.15.37:0/1963395958 shutdown_connections 2024-08-20T05:04:15.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.588+0000 7f97c5a00640 1 -- 172.21.15.37:0/1963395958 wait complete. 2024-08-20T05:04:15.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.589+0000 7f97c5a00640 1 Processor -- start 2024-08-20T05:04:15.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.590+0000 7f97c5a00640 1 -- start start 2024-08-20T05:04:15.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.590+0000 7f97c5a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97c0102ab0 0x7f97c0115b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.590+0000 7f97c5a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c01084c0 0x7f97c0111e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.591+0000 7f97c5a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97c0108e40 0x7f97c0112470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.591+0000 7f97c5a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0075d00 con 0x7f97c01084c0 2024-08-20T05:04:15.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.591+0000 7f97c5a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0075b80 con 0x7f97c0102ab0 2024-08-20T05:04:15.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.591+0000 7f97bea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97c0102ab0 0x7f97c0115b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.591+0000 7f97bea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97c0102ab0 0x7f97c0115b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56290/0 (socket says 172.21.15.37:56290) 2024-08-20T05:04:15.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.591+0000 7f97bea00640 1 -- 172.21.15.37:0/1423758718 learned_addr learned my addr 172.21.15.37:0/1423758718 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:15.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.591+0000 7f97c5a00640 1 -- 172.21.15.37:0/1423758718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0075e80 con 0x7f97c0108e40 2024-08-20T05:04:15.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.591+0000 7f97be000640 1 --2- 172.21.15.37:0/1423758718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c01084c0 0x7f97c0111e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.591+0000 7f97bf400640 1 --2- 172.21.15.37:0/1423758718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97c0108e40 0x7f97c0112470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.596+0000 7f97bea00640 1 -- 172.21.15.37:0/1423758718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97c0108e40 msgr2=0x7f97c0112470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:15.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.596+0000 7f97bea00640 1 --2- 172.21.15.37:0/1423758718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97c0108e40 0x7f97c0112470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.596+0000 7f97bea00640 1 -- 172.21.15.37:0/1423758718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c01084c0 msgr2=0x7f97c0111e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:15.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.596+0000 7f97bea00640 1 --2- 172.21.15.37:0/1423758718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c01084c0 0x7f97c0111e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.596+0000 7f97bea00640 1 -- 172.21.15.37:0/1423758718 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c01ab810 con 0x7f97c0102ab0 2024-08-20T05:04:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.596+0000 7f97be000640 1 --2- 172.21.15.37:0/1423758718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c01084c0 0x7f97c0111e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:04:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.597+0000 7f97bea00640 1 --2- 172.21.15.37:0/1423758718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97c0102ab0 0x7f97c0115b70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f97b000d950 tx=0x7f97b000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.597+0000 7f97b7400640 1 -- 172.21.15.37:0/1423758718 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b0017070 con 0x7f97c0102ab0 2024-08-20T05:04:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.597+0000 7f97b7400640 1 -- 172.21.15.37:0/1423758718 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97b0009c30 con 0x7f97c0102ab0 2024-08-20T05:04:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.597+0000 7f97b7400640 1 -- 172.21.15.37:0/1423758718 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b000f620 con 0x7f97c0102ab0 2024-08-20T05:04:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.598+0000 7f97c5a00640 1 -- 172.21.15.37:0/1423758718 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c01ab9e0 con 0x7f97c0102ab0 2024-08-20T05:04:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.598+0000 7f97c5a00640 1 -- 172.21.15.37:0/1423758718 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c01abea0 con 0x7f97c0102ab0 2024-08-20T05:04:15.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.604+0000 7f97b7400640 1 -- 172.21.15.37:0/1423758718 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f97b0010460 con 0x7f97c0102ab0 2024-08-20T05:04:15.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.605+0000 7f97c85bb740 1 Processor -- start 2024-08-20T05:04:15.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.605+0000 7f97c85bb740 1 -- start start 2024-08-20T05:04:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.606+0000 7f97c85bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74c99d0 0x5650c74c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.606+0000 7f97c85bb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74ca2f0 0x5650c74d5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.606+0000 7f97c85bb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74d6280 0x5650c74d8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.606+0000 7f97c85bb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5650c7440870 con 0x5650c74ca2f0 2024-08-20T05:04:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.606+0000 7f97c85bb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5650c742fd70 con 0x5650c74d6280 2024-08-20T05:04:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.606+0000 7f97c85bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5650c7433db0 con 0x5650c74c99d0 2024-08-20T05:04:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.607+0000 7f97bea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74ca2f0 0x5650c74d5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.607+0000 7f97bea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74ca2f0 0x5650c74d5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46096/0 (socket says 172.21.15.37:46096) 2024-08-20T05:04:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.607+0000 7f97bea00640 1 -- 172.21.15.37:0/1347761427 learned_addr learned my addr 172.21.15.37:0/1347761427 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.608+0000 7f97bf400640 1 --2- 172.21.15.37:0/1347761427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74c99d0 0x5650c74c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.608+0000 7f97be000640 1 --2- 172.21.15.37:0/1347761427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74d6280 0x5650c74d8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.608+0000 7f97b7400640 1 --2- 172.21.15.37:0/1423758718 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f97a40b3c50 0x7f97a40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.609+0000 7f97be000640 1 -- 172.21.15.37:0/1347761427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74c99d0 msgr2=0x5650c74c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.609+0000 7f97be000640 1 --2- 172.21.15.37:0/1347761427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74c99d0 0x5650c74c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.609+0000 7f97be000640 1 -- 172.21.15.37:0/1347761427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74ca2f0 msgr2=0x5650c74d5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.609+0000 7f97be000640 1 --2- 172.21.15.37:0/1347761427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74ca2f0 0x5650c74d5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.609+0000 7f97be000640 1 -- 172.21.15.37:0/1347761427 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650c718f930 con 0x5650c74d6280 2024-08-20T05:04:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.609+0000 7f97bf400640 1 --2- 172.21.15.37:0/1347761427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74c99d0 0x5650c74c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:04:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.609+0000 7f97b7400640 1 -- 172.21.15.37:0/1423758718 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f97b00e38b0 con 0x7f97c0102ab0 2024-08-20T05:04:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.610+0000 7f97bf400640 1 --2- 172.21.15.37:0/1423758718 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f97a40b3c50 0x7f97a40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.610+0000 7f97be000640 1 --2- 172.21.15.37:0/1347761427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74d6280 0x5650c74d8670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f97ac000c00 tx=0x7f97ac00b180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28ed2dd93305f901 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:15.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.611+0000 7f97abe00640 1 -- 172.21.15.37:0/1347761427 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac040070 con 0x5650c74d6280 2024-08-20T05:04:15.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.611+0000 7f97abe00640 1 -- 172.21.15.37:0/1347761427 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97ac005550 con 0x5650c74d6280 2024-08-20T05:04:15.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.611+0000 7f97abe00640 1 -- 172.21.15.37:0/1347761427 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac035040 con 0x5650c74d6280 2024-08-20T05:04:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.612+0000 7f97c85bb740 1 -- 172.21.15.37:0/1347761427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74d6280 msgr2=0x5650c74d8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.612+0000 7f97c85bb740 1 --2- 172.21.15.37:0/1347761427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74d6280 0x5650c74d8670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f97ac000c00 tx=0x7f97ac00b180 comp rx=0 tx=0).stop 2024-08-20T05:04:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.612+0000 7f97bf400640 1 --2- 172.21.15.37:0/1423758718 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f97a40b3c50 0x7f97a40b6110 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f97b8005fd0 tx=0x7f97b8004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.612+0000 7f97c85bb740 1 -- 172.21.15.37:0/1347761427 shutdown_connections 2024-08-20T05:04:15.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.612+0000 7f97c85bb740 1 --2- 172.21.15.37:0/1347761427 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74d6280 0x5650c74d8670 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.612+0000 7f97c85bb740 1 --2- 172.21.15.37:0/1347761427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74ca2f0 0x5650c74d5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.612+0000 7f97c85bb740 1 --2- 172.21.15.37:0/1347761427 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74c99d0 0x5650c74c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.613+0000 7f97c85bb740 1 -- 172.21.15.37:0/1347761427 >> 172.21.15.37:0/1347761427 conn(0x5650c74c7800 msgr2=0x5650c74c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:15.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:15 smithi135 ceph-mon[22342]: pgmap v461: 129 pgs: 129 active+clean; 983 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.3 MiB/s wr, 741 op/s 2024-08-20T05:04:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.613+0000 7f97c85bb740 1 -- 172.21.15.37:0/1347761427 shutdown_connections 2024-08-20T05:04:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.614+0000 7f97c85bb740 1 -- 172.21.15.37:0/1347761427 wait complete. 2024-08-20T05:04:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.614+0000 7f97c85bb740 1 -- start start 2024-08-20T05:04:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.615+0000 7f97c85bb740 1 Processor -- start 2024-08-20T05:04:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.617+0000 7f97c85bb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74c99d0 0x5650c74d5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.617+0000 7f97c85bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74ca2f0 0x5650c74d2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.617+0000 7f97c85bb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74d6280 0x5650c74d3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.618+0000 7f97bea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74c99d0 0x5650c74d5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.617+0000 7f97be000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74ca2f0 0x5650c74d2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.618+0000 7f97be000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74ca2f0 0x5650c74d2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:59358/0 (socket says 172.21.15.37:59358) 2024-08-20T05:04:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.618+0000 7f97bea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74c99d0 0x5650c74d5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46098/0 (socket says 172.21.15.37:46098) 2024-08-20T05:04:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.618+0000 7f97bea00640 1 -- 172.21.15.37:0/2336330147 learned_addr learned my addr 172.21.15.37:0/2336330147 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.618+0000 7f97bf400640 1 --2- 172.21.15.37:0/2336330147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74d6280 0x5650c74d3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.618+0000 7f97c85bb740 1 -- 172.21.15.37:0/2336330147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5650c7292890 con 0x5650c74c99d0 2024-08-20T05:04:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.618+0000 7f97c85bb740 1 -- 172.21.15.37:0/2336330147 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5650c73b6b00 con 0x5650c74d6280 2024-08-20T05:04:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.618+0000 7f97c85bb740 1 -- 172.21.15.37:0/2336330147 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5650c74d8f70 con 0x5650c74ca2f0 2024-08-20T05:04:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.618+0000 7f97c85bb740 10 client.0 _ll_register_callbacks cb 0x5650c742adc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.619+0000 7f97bea00640 1 -- 172.21.15.37:0/2336330147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74ca2f0 msgr2=0x5650c74d2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.619+0000 7f97bea00640 1 --2- 172.21.15.37:0/2336330147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74ca2f0 0x5650c74d2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.619+0000 7f97bea00640 1 -- 172.21.15.37:0/2336330147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74d6280 msgr2=0x5650c74d3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.619+0000 7f97bea00640 1 --2- 172.21.15.37:0/2336330147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74d6280 0x5650c74d3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.619+0000 7f97bea00640 1 -- 172.21.15.37:0/2336330147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650c73f7a30 con 0x5650c74c99d0 2024-08-20T05:04:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.619+0000 7f97bf400640 1 --2- 172.21.15.37:0/2336330147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74d6280 0x5650c74d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:04:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.619+0000 7f97be000640 1 --2- 172.21.15.37:0/2336330147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74ca2f0 0x5650c74d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:04:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.619+0000 7f97bea00640 1 --2- 172.21.15.37:0/2336330147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74c99d0 0x5650c74d5ab0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f97b0000c00 tx=0x7f97b00e7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53daf3a347f87460 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.619+0000 7f97a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:04:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.619+0000 7f97c85bb740 1 -- 172.21.15.37:0/2336330147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97ac005550 con 0x5650c74c99d0 2024-08-20T05:04:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.619+0000 7f97a8c00640 1 -- 172.21.15.37:0/2336330147 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b00a9b70 con 0x5650c74c99d0 2024-08-20T05:04:15.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.619+0000 7f97a8c00640 1 -- 172.21.15.37:0/2336330147 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f97b00a9870 con 0x5650c74c99d0 2024-08-20T05:04:15.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.619+0000 7f97a8c00640 1 -- 172.21.15.37:0/2336330147 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f97b00a9f10 con 0x5650c74c99d0 2024-08-20T05:04:15.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.619+0000 7f97c85bb740 10 client.15945 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:15.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.619+0000 7f97c85bb740 1 -- 172.21.15.37:0/2336330147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=33}) -- 0x5650c74e47a0 con 0x5650c74c99d0 2024-08-20T05:04:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.620+0000 7f97a8c00640 1 -- 172.21.15.37:0/2336330147 <== mon.0 v2:172.21.15.37:3300/0 4 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f97b00a4b20 con 0x5650c74c99d0 2024-08-20T05:04:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.620+0000 7f97c85bb740 10 client.15945 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.620+0000 7f97c85bb740 10 client.15945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:04:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.620+0000 7f97c85bb740 20 client.15945 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.620+0000 7f97c85bb740 1 --2- 172.21.15.37:0/2336330147 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5650c74e5c20 0x5650c74e80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.620+0000 7f97c85bb740 4 client.15945 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:04:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.621+0000 7f97c85bb740 1 -- 172.21.15.37:0/2336330147 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650c74427c0 con 0x5650c74e5c20 2024-08-20T05:04:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.621+0000 7f97be000640 1 --2- 172.21.15.37:0/2336330147 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5650c74e5c20 0x5650c74e80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.621+0000 7f97be000640 1 --2- 172.21.15.37:0/2336330147 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5650c74e5c20 0x5650c74e80e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dabc80ff30837937 server_cookie=3819322c1bf5c18f in_seq=0 out_seq=0 2024-08-20T05:04:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.621+0000 7f97a8c00640 10 client.15945 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.622+0000 7f97a8c00640 1 -- 172.21.15.37:0/2336330147 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5650c74427c0 con 0x5650c74e5c20 2024-08-20T05:04:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.622+0000 7f97a8c00640 10 client.15945 handle_command_reply: tid=0 2024-08-20T05:04:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.622+0000 7f97c85bb740 1 client.15945 shutdown 2024-08-20T05:04:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.623+0000 7f97c85bb740 1 -- 172.21.15.37:0/2336330147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74c99d0 msgr2=0x5650c74d5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.623+0000 7f97c85bb740 1 --2- 172.21.15.37:0/2336330147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74c99d0 0x5650c74d5ab0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f97b0000c00 tx=0x7f97b00e7040 comp rx=0 tx=0).stop 2024-08-20T05:04:15.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.623+0000 7f97c85bb740 1 -- 172.21.15.37:0/2336330147 shutdown_connections 2024-08-20T05:04:15.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.623+0000 7f97c85bb740 1 --2- 172.21.15.37:0/2336330147 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5650c74e5c20 0x5650c74e80e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.624+0000 7f97c85bb740 1 --2- 172.21.15.37:0/2336330147 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74d6280 0x5650c74d3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.624+0000 7f97c85bb740 1 --2- 172.21.15.37:0/2336330147 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74ca2f0 0x5650c74d2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.624+0000 7f97c85bb740 1 --2- 172.21.15.37:0/2336330147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74c99d0 0x5650c74d5ab0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.624+0000 7f97c85bb740 1 -- 172.21.15.37:0/2336330147 >> 172.21.15.37:0/2336330147 conn(0x5650c74c7800 msgr2=0x5650c74cd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.624+0000 7f97a8c00640 0 client.15945 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.625+0000 7f97c85bb740 1 -- 172.21.15.37:0/2336330147 shutdown_connections 2024-08-20T05:04:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.625+0000 7f97c85bb740 1 -- 172.21.15.37:0/2336330147 wait complete. 2024-08-20T05:04:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.625+0000 7f97c85bb740 20 client.15945 trim_cache size 0 max 16384 2024-08-20T05:04:15.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.661+0000 7f97c85bb740 1 Processor -- start 2024-08-20T05:04:15.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.661+0000 7f97c85bb740 1 -- start start 2024-08-20T05:04:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.661+0000 7f97c85bb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74ca2f0 0x5650c74d4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.662+0000 7f97c85bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74d6280 0x5650c74ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.662+0000 7f97c85bb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74d34d0 0x5650c74edef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.662+0000 7f97c85bb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97c01b5ea0 con 0x5650c74d34d0 2024-08-20T05:04:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.662+0000 7f97c85bb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f97c01b7aa0 con 0x5650c74ca2f0 2024-08-20T05:04:15.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.662+0000 7f97c85bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f97c01b6570 con 0x5650c74d6280 2024-08-20T05:04:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.662+0000 7f97bf400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74d34d0 0x5650c74edef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.662+0000 7f97bf400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74d34d0 0x5650c74edef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46114/0 (socket says 172.21.15.37:46114) 2024-08-20T05:04:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.662+0000 7f97bf400640 1 -- 172.21.15.37:0/2552643145 learned_addr learned my addr 172.21.15.37:0/2552643145 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.662+0000 7f97be000640 1 --2- 172.21.15.37:0/2552643145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74d6280 0x5650c74ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.662+0000 7f97bea00640 1 --2- 172.21.15.37:0/2552643145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74ca2f0 0x5650c74d4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.663+0000 7f97be000640 1 -- 172.21.15.37:0/2552643145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74ca2f0 msgr2=0x5650c74d4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.663+0000 7f97be000640 1 --2- 172.21.15.37:0/2552643145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74ca2f0 0x5650c74d4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.663+0000 7f97be000640 1 -- 172.21.15.37:0/2552643145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74d34d0 msgr2=0x5650c74edef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.663+0000 7f97be000640 1 --2- 172.21.15.37:0/2552643145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74d34d0 0x5650c74edef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.663+0000 7f97be000640 1 -- 172.21.15.37:0/2552643145 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650c74d5e20 con 0x5650c74d6280 2024-08-20T05:04:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.663+0000 7f97bea00640 1 --2- 172.21.15.37:0/2552643145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74ca2f0 0x5650c74d4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:04:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.664+0000 7f97be000640 1 --2- 172.21.15.37:0/2552643145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74d6280 0x5650c74ed9b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f97ac02a940 tx=0x7f97ac0049e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd22936b1d7212e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.664+0000 7f97ab400640 1 -- 172.21.15.37:0/2552643145 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac040040 con 0x5650c74d6280 2024-08-20T05:04:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.664+0000 7f97ab400640 1 -- 172.21.15.37:0/2552643145 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97ac004c50 con 0x5650c74d6280 2024-08-20T05:04:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.664+0000 7f97ab400640 1 -- 172.21.15.37:0/2552643145 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac035040 con 0x5650c74d6280 2024-08-20T05:04:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.665+0000 7f97c85bb740 1 -- 172.21.15.37:0/2552643145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74d6280 msgr2=0x5650c74ed9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.665+0000 7f97c85bb740 1 --2- 172.21.15.37:0/2552643145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74d6280 0x5650c74ed9b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f97ac02a940 tx=0x7f97ac0049e0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.665+0000 7f97c85bb740 1 -- 172.21.15.37:0/2552643145 shutdown_connections 2024-08-20T05:04:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.665+0000 7f97c85bb740 1 --2- 172.21.15.37:0/2552643145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74d34d0 0x5650c74edef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.665+0000 7f97c85bb740 1 --2- 172.21.15.37:0/2552643145 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74d6280 0x5650c74ed9b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.665+0000 7f97c85bb740 1 --2- 172.21.15.37:0/2552643145 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74ca2f0 0x5650c74d4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.665+0000 7f97c85bb740 1 -- 172.21.15.37:0/2552643145 >> 172.21.15.37:0/2552643145 conn(0x5650c74c7800 msgr2=0x5650c74d4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.666+0000 7f97c85bb740 1 -- 172.21.15.37:0/2552643145 shutdown_connections 2024-08-20T05:04:15.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.666+0000 7f97c85bb740 1 -- 172.21.15.37:0/2552643145 wait complete. 2024-08-20T05:04:15.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.666+0000 7f97c85bb740 1 -- start start 2024-08-20T05:04:15.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.667+0000 7f97c85bb740 1 Processor -- start 2024-08-20T05:04:15.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.667+0000 7f97c85bb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74ca2f0 0x5650c74dc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.668+0000 7f97c85bb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74d34d0 0x5650c74dca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.668+0000 7f97c85bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74d6280 0x5650c754f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.668+0000 7f97c85bb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f97c01b7310 con 0x5650c74ca2f0 2024-08-20T05:04:15.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.668+0000 7f97c85bb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f97c01b6c40 con 0x5650c74d34d0 2024-08-20T05:04:15.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.668+0000 7f97c85bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f97c01b3e80 con 0x5650c74d6280 2024-08-20T05:04:15.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.668+0000 7f97c85bb740 10 client.0 _ll_register_callbacks cb 0x7f97b00e9220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:15.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.669+0000 7f97be000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74d34d0 0x5650c74dca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.669+0000 7f97bf400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74d6280 0x5650c754f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.669+0000 7f97bf400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74d6280 0x5650c754f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:59382/0 (socket says 172.21.15.37:59382) 2024-08-20T05:04:15.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.669+0000 7f97bf400640 1 -- 172.21.15.37:0/3109971676 learned_addr learned my addr 172.21.15.37:0/3109971676 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:15.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.669+0000 7f97bea00640 1 --2- 172.21.15.37:0/3109971676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74ca2f0 0x5650c74dc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.670+0000 7f97bf400640 1 -- 172.21.15.37:0/3109971676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74d34d0 msgr2=0x5650c74dca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.670+0000 7f97bf400640 1 --2- 172.21.15.37:0/3109971676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74d34d0 0x5650c74dca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.670+0000 7f97bf400640 1 -- 172.21.15.37:0/3109971676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74ca2f0 msgr2=0x5650c74dc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:15.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.670+0000 7f97bf400640 1 --2- 172.21.15.37:0/3109971676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74ca2f0 0x5650c74dc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.671+0000 7f97bf400640 1 -- 172.21.15.37:0/3109971676 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650c74ca120 con 0x5650c74d6280 2024-08-20T05:04:15.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.674+0000 7f97bf400640 1 --2- 172.21.15.37:0/3109971676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74d6280 0x5650c754f990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f97b8010000 tx=0x7f97b8004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9546df306ae90a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:15.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.674+0000 7f97a8c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:04:15.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.674+0000 7f97a8c00640 1 -- 172.21.15.37:0/3109971676 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b801dcb0 con 0x5650c74d6280 2024-08-20T05:04:15.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.674+0000 7f97a8c00640 1 -- 172.21.15.37:0/3109971676 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f97b8029450 con 0x5650c74d6280 2024-08-20T05:04:15.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.675+0000 7f97c85bb740 1 -- 172.21.15.37:0/3109971676 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97ac004c50 con 0x5650c74d6280 2024-08-20T05:04:15.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.675+0000 7f97a8c00640 1 -- 172.21.15.37:0/3109971676 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f97b801de50 con 0x5650c74d6280 2024-08-20T05:04:15.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.675+0000 7f97c85bb740 10 client.26071 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:15.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.675+0000 7f97c85bb740 1 -- 172.21.15.37:0/3109971676 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5650c7550f80 con 0x5650c74d6280 2024-08-20T05:04:15.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.676+0000 7f97a8c00640 1 -- 172.21.15.37:0/3109971676 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97ac004c50 con 0x5650c74d6280 2024-08-20T05:04:15.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.676+0000 7f97a8c00640 1 -- 172.21.15.37:0/3109971676 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f97b80337c0 con 0x5650c74d6280 2024-08-20T05:04:15.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.676+0000 7f97c85bb740 10 client.26071 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:15.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.676+0000 7f97c85bb740 10 client.26071 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:04:15.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.676+0000 7f97c85bb740 20 client.26071 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:15.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.676+0000 7f97c85bb740 1 --2- 172.21.15.37:0/3109971676 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5650c7551820 0x5650c7553c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:15.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.676+0000 7f97c85bb740 4 client.26071 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T05:04:15.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.676+0000 7f97c85bb740 1 -- 172.21.15.37:0/3109971676 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5650c743e260 con 0x5650c7551820 2024-08-20T05:04:15.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.677+0000 7f97bea00640 1 --2- 172.21.15.37:0/3109971676 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5650c7551820 0x5650c7553c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:15.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.679+0000 7f97bea00640 1 --2- 172.21.15.37:0/3109971676 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5650c7551820 0x5650c7553c40 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaf6c445b1c70925 server_cookie=63a0298ac18f8ff8 in_seq=0 out_seq=0 2024-08-20T05:04:15.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.679+0000 7f97a8c00640 10 client.26071 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:15.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.681+0000 7f97a8c00640 1 -- 172.21.15.37:0/3109971676 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5650c743e260 con 0x5650c7551820 2024-08-20T05:04:15.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.681+0000 7f97a8c00640 10 client.26071 handle_command_reply: tid=0 2024-08-20T05:04:15.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.681+0000 7f97c85bb740 1 client.26071 shutdown 2024-08-20T05:04:15.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.682+0000 7f97c85bb740 1 -- 172.21.15.37:0/3109971676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74d6280 msgr2=0x5650c754f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:15.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.682+0000 7f97c85bb740 1 --2- 172.21.15.37:0/3109971676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74d6280 0x5650c754f990 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f97b8010000 tx=0x7f97b8004ab0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.682+0000 7f97c85bb740 1 -- 172.21.15.37:0/3109971676 shutdown_connections 2024-08-20T05:04:15.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.682+0000 7f97c85bb740 1 --2- 172.21.15.37:0/3109971676 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5650c7551820 0x5650c7553c40 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.682+0000 7f97c85bb740 1 --2- 172.21.15.37:0/3109971676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5650c74d6280 0x5650c754f990 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.682+0000 7f97a8c00640 0 client.26071 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:15.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.682+0000 7f97c85bb740 1 --2- 172.21.15.37:0/3109971676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5650c74d34d0 0x5650c74dca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.682+0000 7f97c85bb740 1 --2- 172.21.15.37:0/3109971676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5650c74ca2f0 0x5650c74dc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.682+0000 7f97c85bb740 1 -- 172.21.15.37:0/3109971676 >> 172.21.15.37:0/3109971676 conn(0x5650c74c7800 msgr2=0x5650c74d4d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:15.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.683+0000 7f97c85bb740 1 -- 172.21.15.37:0/3109971676 shutdown_connections 2024-08-20T05:04:15.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.683+0000 7f97c85bb740 1 -- 172.21.15.37:0/3109971676 wait complete. 2024-08-20T05:04:15.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.683+0000 7f97c85bb740 20 client.26071 trim_cache size 0 max 16384 2024-08-20T05:04:15.686 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:04:15.686 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-20T05:04:15.686 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "88fc0555-c03b-4837-8535-2852e609ac9e", 2024-08-20T05:04:15.686 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-20T05:04:15.686 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:04:15.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.684+0000 7f97c5a00640 1 -- 172.21.15.37:0/1423758718 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f97a40b3c50 msgr2=0x7f97a40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:15.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.684+0000 7f97c5a00640 1 --2- 172.21.15.37:0/1423758718 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f97a40b3c50 0x7f97a40b6110 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f97b8005fd0 tx=0x7f97b8004a40 comp rx=0 tx=0).stop 2024-08-20T05:04:15.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.684+0000 7f97c5a00640 1 -- 172.21.15.37:0/1423758718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97c0102ab0 msgr2=0x7f97c0115b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:15.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.684+0000 7f97c5a00640 1 --2- 172.21.15.37:0/1423758718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97c0102ab0 0x7f97c0115b70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f97b000d950 tx=0x7f97b000de10 comp rx=0 tx=0).stop 2024-08-20T05:04:15.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.684+0000 7f97c5a00640 1 -- 172.21.15.37:0/1423758718 shutdown_connections 2024-08-20T05:04:15.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.684+0000 7f97c5a00640 1 --2- 172.21.15.37:0/1423758718 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f97a40b3c50 0x7f97a40b6110 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.684+0000 7f97c5a00640 1 --2- 172.21.15.37:0/1423758718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f97c0108e40 0x7f97c0112470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.684+0000 7f97c5a00640 1 --2- 172.21.15.37:0/1423758718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f97c01084c0 0x7f97c0111e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.684+0000 7f97c5a00640 1 --2- 172.21.15.37:0/1423758718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f97c0102ab0 0x7f97c0115b70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:15.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.684+0000 7f97c5a00640 1 -- 172.21.15.37:0/1423758718 >> 172.21.15.37:0/1423758718 conn(0x7f97c00fe520 msgr2=0x7f97c0100910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:15.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.685+0000 7f97c5a00640 1 -- 172.21.15.37:0/1423758718 shutdown_connections 2024-08-20T05:04:15.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:15.685+0000 7f97c5a00640 1 -- 172.21.15.37:0/1423758718 wait complete. 2024-08-20T05:04:15.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:15 smithi130 ceph-mon[22007]: pgmap v461: 129 pgs: 129 active+clean; 983 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.3 MiB/s wr, 741 op/s 2024-08-20T05:04:16.438 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10.2 2024-08-20T05:04:16.438 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:04:16.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:16 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:04:16.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:16 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:16.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:16 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:04:16.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:16 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:16.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:16 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:04:16.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:16 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:04:16.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:16 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:16.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:16 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:16.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:16 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:04:16.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:16 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:16.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:16 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:04:16.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:16 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:16.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:16 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:04:16.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:16 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:04:16.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:16 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:16.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:16 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:16.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:16 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:04:16.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:16 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:16.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:16 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:04:16.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:16 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:16.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:16 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:04:16.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:16 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:04:16.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:16 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:16.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:16 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:16.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:04:17.123 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:04:17.547 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:17 smithi037 ceph-mon[17265]: scrub queued for path: / 2024-08-20T05:04:17.547 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:17 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:17.547 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:17 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:04:17.547 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:17 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:04:17.547 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:17 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:17.547 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:17 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:04:17.547 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:17 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:04:17.548 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:17 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:17.548 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:17 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:17.548 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:17 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:17.548 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:17 smithi037 ceph-mon[17265]: pgmap v462: 129 pgs: 129 active+clean; 984 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.7 MiB/s wr, 691 op/s 2024-08-20T05:04:17.607 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:17 smithi130 ceph-mon[22007]: scrub queued for path: / 2024-08-20T05:04:17.607 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:17 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:17.607 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:17 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:04:17.607 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:17 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:04:17.607 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:17 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:17.607 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:17 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:04:17.607 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:17 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:04:17.607 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:17 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:17.607 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:17 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:17.608 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:17 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:17.608 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:17 smithi130 ceph-mon[22007]: pgmap v462: 129 pgs: 129 active+clean; 984 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.7 MiB/s wr, 691 op/s 2024-08-20T05:04:17.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:17 smithi135 ceph-mon[22342]: scrub queued for path: / 2024-08-20T05:04:17.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:17 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:17.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:17 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:04:17.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:17 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:04:17.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:17 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:17.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:17 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:04:17.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:17 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:04:17.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:17 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:17.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:17 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:17.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:17 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:04:17.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:17 smithi135 ceph-mon[22342]: pgmap v462: 129 pgs: 129 active+clean; 984 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.7 MiB/s wr, 691 op/s 2024-08-20T05:04:17.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.873+0000 7f4090800640 1 -- 172.21.15.37:0/1613536939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f408810a0e0 msgr2=0x7f408810a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:17.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.873+0000 7f4090800640 1 --2- 172.21.15.37:0/1613536939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f408810a0e0 0x7f408810a4c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f407c00b9f0 tx=0x7f407c02c0a0 comp rx=0 tx=0).stop 2024-08-20T05:04:17.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.873+0000 7f4090800640 1 -- 172.21.15.37:0/1613536939 shutdown_connections 2024-08-20T05:04:17.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.874+0000 7f4090800640 1 --2- 172.21.15.37:0/1613536939 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f408810f8c0 0x7f4088116050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:17.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.874+0000 7f4090800640 1 --2- 172.21.15.37:0/1613536939 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f408810ef40 0x7f408810f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:17.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.874+0000 7f4090800640 1 --2- 172.21.15.37:0/1613536939 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f408810a0e0 0x7f408810a4c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:17.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.874+0000 7f4090800640 1 -- 172.21.15.37:0/1613536939 >> 172.21.15.37:0/1613536939 conn(0x7f408806dcc0 msgr2=0x7f408806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:17.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.874+0000 7f4090800640 1 -- 172.21.15.37:0/1613536939 shutdown_connections 2024-08-20T05:04:17.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.875+0000 7f4090800640 1 -- 172.21.15.37:0/1613536939 wait complete. 2024-08-20T05:04:17.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.878+0000 7f4090800640 1 Processor -- start 2024-08-20T05:04:17.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.878+0000 7f4090800640 1 -- start start 2024-08-20T05:04:17.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.879+0000 7f4090800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f408810a0e0 0x7f40881a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:17.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.879+0000 7f4090800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f408810ef40 0x7f40881a3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:17.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.879+0000 7f4090800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f408810f8c0 0x7f40881a9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:17.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.879+0000 7f4090800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4088119010 con 0x7f408810a0e0 2024-08-20T05:04:17.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.879+0000 7f4090800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4088118e90 con 0x7f408810ef40 2024-08-20T05:04:17.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.879+0000 7f4090800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4088119190 con 0x7f408810f8c0 2024-08-20T05:04:17.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.880+0000 7f408e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f408810f8c0 0x7f40881a9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:17.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.880+0000 7f408e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f408810f8c0 0x7f40881a9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:59402/0 (socket says 172.21.15.37:59402) 2024-08-20T05:04:17.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.880+0000 7f408e800640 1 -- 172.21.15.37:0/285724297 learned_addr learned my addr 172.21.15.37:0/285724297 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:17.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.880+0000 7f408d400640 1 --2- 172.21.15.37:0/285724297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f408810ef40 0x7f40881a3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:17.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.880+0000 7f408de00640 1 --2- 172.21.15.37:0/285724297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f408810a0e0 0x7f40881a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:17.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.881+0000 7f408e800640 1 -- 172.21.15.37:0/285724297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f408810ef40 msgr2=0x7f40881a3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:17.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.881+0000 7f408e800640 1 --2- 172.21.15.37:0/285724297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f408810ef40 0x7f40881a3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:17.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.881+0000 7f408e800640 1 -- 172.21.15.37:0/285724297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f408810a0e0 msgr2=0x7f40881a3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:17.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.881+0000 7f408e800640 1 --2- 172.21.15.37:0/285724297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f408810a0e0 0x7f40881a3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:17.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.881+0000 7f408e800640 1 -- 172.21.15.37:0/285724297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40881a99e0 con 0x7f408810f8c0 2024-08-20T05:04:17.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.881+0000 7f408d400640 1 --2- 172.21.15.37:0/285724297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f408810ef40 0x7f40881a3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:04:17.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.881+0000 7f408de00640 1 --2- 172.21.15.37:0/285724297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f408810a0e0 0x7f40881a3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:04:17.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.882+0000 7f408e800640 1 --2- 172.21.15.37:0/285724297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f408810f8c0 0x7f40881a9210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f408400eaa0 tx=0x7f408400ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:17.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.882+0000 7f4082a00640 1 -- 172.21.15.37:0/285724297 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408400cdb0 con 0x7f408810f8c0 2024-08-20T05:04:17.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.882+0000 7f4082a00640 1 -- 172.21.15.37:0/285724297 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4084005020 con 0x7f408810f8c0 2024-08-20T05:04:17.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.882+0000 7f4082a00640 1 -- 172.21.15.37:0/285724297 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40840116d0 con 0x7f408810f8c0 2024-08-20T05:04:17.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.882+0000 7f4090800640 1 -- 172.21.15.37:0/285724297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40881a9cd0 con 0x7f408810f8c0 2024-08-20T05:04:17.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.883+0000 7f4090800640 1 -- 172.21.15.37:0/285724297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40881a1240 con 0x7f408810f8c0 2024-08-20T05:04:17.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.885+0000 7f4090800640 1 -- 172.21.15.37:0/285724297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f408810a4c0 con 0x7f408810f8c0 2024-08-20T05:04:17.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.888+0000 7f4082a00640 1 -- 172.21.15.37:0/285724297 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f40840051d0 con 0x7f408810f8c0 2024-08-20T05:04:17.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.891+0000 7f4082a00640 1 --2- 172.21.15.37:0/285724297 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f40700b3c50 0x7f40700b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:17.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.891+0000 7f4082a00640 1 -- 172.21.15.37:0/285724297 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f40840e4180 con 0x7f408810f8c0 2024-08-20T05:04:17.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.892+0000 7f408de00640 1 --2- 172.21.15.37:0/285724297 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f40700b3c50 0x7f40700b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:17.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.894+0000 7f408de00640 1 --2- 172.21.15.37:0/285724297 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f40700b3c50 0x7f40700b6110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f407c000c00 tx=0x7f407c005a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:17.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:17.895+0000 7f4082a00640 1 -- 172.21.15.37:0/285724297 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4084016030 con 0x7f408810f8c0 2024-08-20T05:04:17.943 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:04:18.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 80.0 s, 1518.0 tps, lat 65.806 ms stddev 83.099 2024-08-20T05:04:18.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.324+0000 7f4090800640 1 -- 172.21.15.37:0/285724297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40881a4a60 con 0x7f408810f8c0 2024-08-20T05:04:18.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.325+0000 7f4082a00640 1 -- 172.21.15.37:0/285724297 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11987 (secure 0 0 0) 0x7f4084090e20 con 0x7f408810f8c0 2024-08-20T05:04:18.328 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:04:18.328 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":33,"btime":"2024-08-20T05:03:11:706710+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:03:11.271814+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:04:18.329 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 33 2024-08-20T05:04:18.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.329+0000 7f4090800640 1 -- 172.21.15.37:0/285724297 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f40700b3c50 msgr2=0x7f40700b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:18.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.329+0000 7f4090800640 1 --2- 172.21.15.37:0/285724297 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f40700b3c50 0x7f40700b6110 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f407c000c00 tx=0x7f407c005a90 comp rx=0 tx=0).stop 2024-08-20T05:04:18.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.329+0000 7f4090800640 1 -- 172.21.15.37:0/285724297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f408810f8c0 msgr2=0x7f40881a9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:18.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.329+0000 7f4090800640 1 --2- 172.21.15.37:0/285724297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f408810f8c0 0x7f40881a9210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f408400eaa0 tx=0x7f408400ef60 comp rx=0 tx=0).stop 2024-08-20T05:04:18.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.330+0000 7f4090800640 1 -- 172.21.15.37:0/285724297 shutdown_connections 2024-08-20T05:04:18.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.330+0000 7f4090800640 1 --2- 172.21.15.37:0/285724297 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f40700b3c50 0x7f40700b6110 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:18.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.330+0000 7f4090800640 1 --2- 172.21.15.37:0/285724297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f408810f8c0 0x7f40881a9210 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:18.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.330+0000 7f4090800640 1 --2- 172.21.15.37:0/285724297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f408810ef40 0x7f40881a3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:18.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.330+0000 7f4090800640 1 --2- 172.21.15.37:0/285724297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f408810a0e0 0x7f40881a3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:18.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.330+0000 7f4090800640 1 -- 172.21.15.37:0/285724297 >> 172.21.15.37:0/285724297 conn(0x7f408806dcc0 msgr2=0x7f408810d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:18.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.331+0000 7f4090800640 1 -- 172.21.15.37:0/285724297 shutdown_connections 2024-08-20T05:04:18.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.331+0000 7f4090800640 1 -- 172.21.15.37:0/285724297 wait complete. 2024-08-20T05:04:19.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.630+0000 7ff9fb800640 1 -- 172.21.15.37:0/3110172149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9f410f470 msgr2=0x7ff9f4115c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.630+0000 7ff9fb800640 1 --2- 172.21.15.37:0/3110172149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9f410f470 0x7ff9f4115c70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009ca0 tx=0x7ff9ec02a8b0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.632+0000 7ff9fb800640 1 -- 172.21.15.37:0/3110172149 shutdown_connections 2024-08-20T05:04:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.632+0000 7ff9fb800640 1 --2- 172.21.15.37:0/3110172149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9f410f470 0x7ff9f4115c70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.632+0000 7ff9fb800640 1 --2- 172.21.15.37:0/3110172149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9f410eaf0 0x7ff9f410ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.632+0000 7ff9fb800640 1 --2- 172.21.15.37:0/3110172149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f41090e0 0x7ff9f41094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.632+0000 7ff9fb800640 1 -- 172.21.15.37:0/3110172149 >> 172.21.15.37:0/3110172149 conn(0x7ff9f4078760 msgr2=0x7ff9f407ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.632+0000 7ff9fb800640 1 -- 172.21.15.37:0/3110172149 shutdown_connections 2024-08-20T05:04:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.632+0000 7ff9fb800640 1 -- 172.21.15.37:0/3110172149 wait complete. 2024-08-20T05:04:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.633+0000 7ff9fb800640 1 Processor -- start 2024-08-20T05:04:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.634+0000 7ff9fb800640 1 -- start start 2024-08-20T05:04:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.634+0000 7ff9fb800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9f41090e0 0x7ff9f419f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.634+0000 7ff9fb800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9f410eaf0 0x7ff9f419fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.634+0000 7ff9fb800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f410f470 0x7ff9f41a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.635+0000 7ff9f3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9f410eaf0 0x7ff9f419fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.635+0000 7ff9f3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9f410eaf0 0x7ff9f419fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56366/0 (socket says 172.21.15.37:56366) 2024-08-20T05:04:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.635+0000 7ff9f8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9f41090e0 0x7ff9f419f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.635+0000 7ff9f8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9f41090e0 0x7ff9f419f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:59422/0 (socket says 172.21.15.37:59422) 2024-08-20T05:04:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.636+0000 7ff9fb800640 1 -- 172.21.15.37:0/2514941017 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f41190f0 con 0x7ff9f410f470 2024-08-20T05:04:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.636+0000 7ff9f3e00640 1 -- 172.21.15.37:0/2514941017 learned_addr learned my addr 172.21.15.37:0/2514941017 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.636+0000 7ff9fb800640 1 -- 172.21.15.37:0/2514941017 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f4118f70 con 0x7ff9f410eaf0 2024-08-20T05:04:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.636+0000 7ff9fb800640 1 -- 172.21.15.37:0/2514941017 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f4119270 con 0x7ff9f41090e0 2024-08-20T05:04:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.637+0000 7ff9f9800640 1 --2- 172.21.15.37:0/2514941017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f410f470 0x7ff9f41a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.638+0000 7ff9f8e00640 1 -- 172.21.15.37:0/2514941017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9f410eaf0 msgr2=0x7ff9f419fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.639+0000 7ff9f8e00640 1 --2- 172.21.15.37:0/2514941017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9f410eaf0 0x7ff9f419fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.639+0000 7ff9f8e00640 1 -- 172.21.15.37:0/2514941017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f410f470 msgr2=0x7ff9f41a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.639+0000 7ff9f8e00640 1 --2- 172.21.15.37:0/2514941017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f410f470 0x7ff9f41a4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.639+0000 7ff9f8e00640 1 -- 172.21.15.37:0/2514941017 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f41a55f0 con 0x7ff9f41090e0 2024-08-20T05:04:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.639+0000 7ff9f9800640 1 --2- 172.21.15.37:0/2514941017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f410f470 0x7ff9f41a4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:04:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.639+0000 7ff9f3e00640 1 --2- 172.21.15.37:0/2514941017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9f410eaf0 0x7ff9f419fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:04:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.640+0000 7ff9f8e00640 1 --2- 172.21.15.37:0/2514941017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9f41090e0 0x7ff9f419f540 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800c970 tx=0x7ff9e800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.641+0000 7ff9f1600640 1 -- 172.21.15.37:0/2514941017 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8007bb0 con 0x7ff9f41090e0 2024-08-20T05:04:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.641+0000 7ff9fb800640 1 -- 172.21.15.37:0/2514941017 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f41a58e0 con 0x7ff9f41090e0 2024-08-20T05:04:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.641+0000 7ff9fb800640 1 -- 172.21.15.37:0/2514941017 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f41ac170 con 0x7ff9f41090e0 2024-08-20T05:04:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.642+0000 7ff9f1600640 1 -- 172.21.15.37:0/2514941017 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e8007d50 con 0x7ff9f41090e0 2024-08-20T05:04:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.642+0000 7ff9f1600640 1 -- 172.21.15.37:0/2514941017 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e8007bb0 con 0x7ff9f41090e0 2024-08-20T05:04:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.649+0000 7ff9fe473740 1 Processor -- start 2024-08-20T05:04:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.650+0000 7ff9fe473740 1 -- start start 2024-08-20T05:04:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.650+0000 7ff9fe473740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a137900 0x557b4a137ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.650+0000 7ff9fe473740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a138220 0x557b4a154c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.651+0000 7ff9fe473740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a1575b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.651+0000 7ff9fe473740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557b4a0ada60 con 0x557b4a137900 2024-08-20T05:04:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.651+0000 7ff9fe473740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557b4a09cf60 con 0x557b4a1551c0 2024-08-20T05:04:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.651+0000 7ff9fe473740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557b4a0a0fa0 con 0x557b4a138220 2024-08-20T05:04:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.652+0000 7ff9f1600640 1 -- 172.21.15.37:0/2514941017 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff9e8004ca0 con 0x7ff9f41090e0 2024-08-20T05:04:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.653+0000 7ff9f3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a1575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.653+0000 7ff9f3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a1575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56382/0 (socket says 172.21.15.37:56382) 2024-08-20T05:04:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.653+0000 7ff9f3e00640 1 -- 172.21.15.37:0/2853824892 learned_addr learned my addr 172.21.15.37:0/2853824892 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.653+0000 7ff9f9800640 1 --2- 172.21.15.37:0/2853824892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a137900 0x557b4a137ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.655+0000 7ff9f8e00640 1 --2- 172.21.15.37:0/2853824892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a138220 0x557b4a154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.657+0000 7ff9f3e00640 1 -- 172.21.15.37:0/2853824892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a138220 msgr2=0x557b4a154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:19.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.657+0000 7ff9f3e00640 1 --2- 172.21.15.37:0/2853824892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a138220 0x557b4a154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.657+0000 7ff9f3e00640 1 -- 172.21.15.37:0/2853824892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a137900 msgr2=0x557b4a137ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:19.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.657+0000 7ff9f3e00640 1 --2- 172.21.15.37:0/2853824892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a137900 0x557b4a137ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.657+0000 7ff9f3e00640 1 -- 172.21.15.37:0/2853824892 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b4a0433e0 con 0x557b4a1551c0 2024-08-20T05:04:19.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.657+0000 7ff9f9800640 1 --2- 172.21.15.37:0/2853824892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a137900 0x557b4a137ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:04:19.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.658+0000 7ff9f3e00640 1 --2- 172.21.15.37:0/2853824892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a1575b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00115f0 tx=0x7ff9e0011ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3a8b268a212c75d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:19.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.659+0000 7ff9f1600640 1 --2- 172.21.15.37:0/2514941017 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9dc0b3ed0 0x7ff9dc0b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.660+0000 7ff9f1600640 1 -- 172.21.15.37:0/2514941017 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff9e80e3b20 con 0x7ff9f41090e0 2024-08-20T05:04:19.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.660+0000 7ff9e6000640 1 -- 172.21.15.37:0/2853824892 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e001e070 con 0x557b4a1551c0 2024-08-20T05:04:19.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.660+0000 7ff9e6000640 1 -- 172.21.15.37:0/2853824892 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e000fb70 con 0x557b4a1551c0 2024-08-20T05:04:19.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.660+0000 7ff9e6000640 1 -- 172.21.15.37:0/2853824892 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0019c00 con 0x557b4a1551c0 2024-08-20T05:04:19.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.660+0000 7ff9f9800640 1 --2- 172.21.15.37:0/2514941017 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9dc0b3ed0 0x7ff9dc0b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.661+0000 7ff9fe473740 1 -- 172.21.15.37:0/2853824892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 msgr2=0x557b4a1575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.661+0000 7ff9fe473740 1 --2- 172.21.15.37:0/2853824892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a1575b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00115f0 tx=0x7ff9e0011ab0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.661+0000 7ff9fe473740 1 -- 172.21.15.37:0/2853824892 shutdown_connections 2024-08-20T05:04:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.661+0000 7ff9fe473740 1 --2- 172.21.15.37:0/2853824892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a1575b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.661+0000 7ff9fe473740 1 --2- 172.21.15.37:0/2853824892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a138220 0x557b4a154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.661+0000 7ff9fe473740 1 --2- 172.21.15.37:0/2853824892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a137900 0x557b4a137ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.661+0000 7ff9fe473740 1 -- 172.21.15.37:0/2853824892 >> 172.21.15.37:0/2853824892 conn(0x557b4a135730 msgr2=0x557b4a1368d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.662+0000 7ff9fe473740 1 -- 172.21.15.37:0/2853824892 shutdown_connections 2024-08-20T05:04:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.663+0000 7ff9fe473740 1 -- 172.21.15.37:0/2853824892 wait complete. 2024-08-20T05:04:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.663+0000 7ff9fe473740 1 -- start start 2024-08-20T05:04:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.664+0000 7ff9fe473740 1 Processor -- start 2024-08-20T05:04:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.664+0000 7ff9f9800640 1 --2- 172.21.15.37:0/2514941017 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9dc0b3ed0 0x7ff9dc0b6390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009430 tx=0x7ff9ec009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.665+0000 7ff9fe473740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a137900 0x557b4a154940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.665+0000 7ff9fe473740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a138220 0x557b4a151d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.665+0000 7ff9f8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a137900 0x557b4a154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.666+0000 7ff9f8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a137900 0x557b4a154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:59434/0 (socket says 172.21.15.37:59434) 2024-08-20T05:04:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.666+0000 7ff9fe473740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a1522d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.666+0000 7ff9fe473740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557b49eff700 con 0x557b4a138220 2024-08-20T05:04:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.666+0000 7ff9f8e00640 1 -- 172.21.15.37:0/3738876273 learned_addr learned my addr 172.21.15.37:0/3738876273 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.666+0000 7ff9f9800640 1 --2- 172.21.15.37:0/3738876273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a1522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.666+0000 7ff9fe473740 1 -- 172.21.15.37:0/3738876273 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557b4a038250 con 0x557b4a1551c0 2024-08-20T05:04:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.666+0000 7ff9fe473740 1 -- 172.21.15.37:0/3738876273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557b4a157e70 con 0x557b4a137900 2024-08-20T05:04:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.667+0000 7ff9fe473740 10 client.0 _ll_register_callbacks cb 0x557b4a097180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.667+0000 7ff9f3e00640 1 --2- 172.21.15.37:0/3738876273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a138220 0x557b4a151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.667+0000 7ff9f8e00640 1 -- 172.21.15.37:0/3738876273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 msgr2=0x557b4a1522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.667+0000 7ff9f8e00640 1 --2- 172.21.15.37:0/3738876273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a1522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.667+0000 7ff9f8e00640 1 -- 172.21.15.37:0/3738876273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a138220 msgr2=0x557b4a151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.667+0000 7ff9f8e00640 1 --2- 172.21.15.37:0/3738876273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a138220 0x557b4a151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.667+0000 7ff9f8e00640 1 -- 172.21.15.37:0/3738876273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b49dfc650 con 0x557b4a137900 2024-08-20T05:04:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.667+0000 7ff9f9800640 1 --2- 172.21.15.37:0/3738876273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a1522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:04:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.668+0000 7ff9f3e00640 1 --2- 172.21.15.37:0/3738876273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a138220 0x557b4a151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:04:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.668+0000 7ff9f8e00640 1 --2- 172.21.15.37:0/3738876273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a137900 0x557b4a154940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80a7350 tx=0x7ff9e8007f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88b4c49684dc2ec6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.668+0000 7ff9daa00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:04:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.668+0000 7ff9daa00640 1 -- 172.21.15.37:0/3738876273 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e801d070 con 0x557b4a137900 2024-08-20T05:04:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.669+0000 7ff9daa00640 1 -- 172.21.15.37:0/3738876273 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff9e80046c0 con 0x557b4a137900 2024-08-20T05:04:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.669+0000 7ff9fe473740 1 -- 172.21.15.37:0/3738876273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9e000fb70 con 0x557b4a137900 2024-08-20T05:04:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.669+0000 7ff9daa00640 1 -- 172.21.15.37:0/3738876273 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff9e80aac20 con 0x557b4a137900 2024-08-20T05:04:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.669+0000 7ff9fe473740 10 client.26089 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.669+0000 7ff9fe473740 1 -- 172.21.15.37:0/3738876273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557b4a163730 con 0x557b4a137900 2024-08-20T05:04:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.670+0000 7ff9daa00640 1 -- 172.21.15.37:0/3738876273 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e80aec90 con 0x557b4a137900 2024-08-20T05:04:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.670+0000 7ff9daa00640 1 -- 172.21.15.37:0/3738876273 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7ff9e80cd070 con 0x557b4a137900 2024-08-20T05:04:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.670+0000 7ff9fe473740 10 client.26089 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.670+0000 7ff9fe473740 10 client.26089 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:04:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.670+0000 7ff9fe473740 20 client.26089 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.670+0000 7ff9fe473740 1 --2- 172.21.15.37:0/3738876273 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557b4a164cc0 0x557b4a167160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.670+0000 7ff9fe473740 4 client.26089 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:04:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.670+0000 7ff9fe473740 1 -- 172.21.15.37:0/3738876273 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff9e000fb70 con 0x557b4a164cc0 2024-08-20T05:04:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.672+0000 7ff9f3e00640 1 --2- 172.21.15.37:0/3738876273 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557b4a164cc0 0x557b4a167160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.673+0000 7ff9daa00640 10 client.26089 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.675+0000 7ff9f3e00640 1 --2- 172.21.15.37:0/3738876273 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557b4a164cc0 0x557b4a167160 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca885ba752545382 server_cookie=edc0092b7e37af15 in_seq=0 out_seq=0 2024-08-20T05:04:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.678+0000 7ff9daa00640 1 -- 172.21.15.37:0/3738876273 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7ff9e000fb70 con 0x557b4a164cc0 2024-08-20T05:04:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.678+0000 7ff9daa00640 10 client.26089 handle_command_reply: tid=0 2024-08-20T05:04:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.678+0000 7ff9fe473740 1 client.26089 shutdown 2024-08-20T05:04:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.678+0000 7ff9fe473740 1 -- 172.21.15.37:0/3738876273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a137900 msgr2=0x557b4a154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.678+0000 7ff9fe473740 1 --2- 172.21.15.37:0/3738876273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a137900 0x557b4a154940 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff9e80a7350 tx=0x7ff9e8007f70 comp rx=0 tx=0).stop 2024-08-20T05:04:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.680+0000 7ff9fe473740 1 -- 172.21.15.37:0/3738876273 shutdown_connections 2024-08-20T05:04:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.680+0000 7ff9fe473740 1 --2- 172.21.15.37:0/3738876273 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557b4a164cc0 0x557b4a167160 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.680+0000 7ff9fe473740 1 --2- 172.21.15.37:0/3738876273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a1522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.680+0000 7ff9fe473740 1 --2- 172.21.15.37:0/3738876273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a138220 0x557b4a151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.680+0000 7ff9fe473740 1 --2- 172.21.15.37:0/3738876273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a137900 0x557b4a154940 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.680+0000 7ff9fe473740 1 -- 172.21.15.37:0/3738876273 >> 172.21.15.37:0/3738876273 conn(0x557b4a135730 msgr2=0x557b4a13b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:19.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.680+0000 7ff9daa00640 0 client.26089 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.680+0000 7ff9fe473740 1 -- 172.21.15.37:0/3738876273 shutdown_connections 2024-08-20T05:04:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.680+0000 7ff9fe473740 1 -- 172.21.15.37:0/3738876273 wait complete. 2024-08-20T05:04:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.681+0000 7ff9fe473740 20 client.26089 trim_cache size 0 max 16384 2024-08-20T05:04:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.713+0000 7ff9fe473740 1 Processor -- start 2024-08-20T05:04:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.714+0000 7ff9fe473740 1 -- start start 2024-08-20T05:04:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.714+0000 7ff9fe473740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a137900 0x557b4a157570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.714+0000 7ff9fe473740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a138220 0x557b4a161020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.714+0000 7ff9fe473740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a1533c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.714+0000 7ff9fe473740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d400fbb0 con 0x557b4a137900 2024-08-20T05:04:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.714+0000 7ff9fe473740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d40117b0 con 0x557b4a1551c0 2024-08-20T05:04:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.714+0000 7ff9fe473740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d4010280 con 0x557b4a138220 2024-08-20T05:04:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.715+0000 7ff9f9800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a1533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.715+0000 7ff9f3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a138220 0x557b4a161020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.715+0000 7ff9f3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a138220 0x557b4a161020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:59444/0 (socket says 172.21.15.37:59444) 2024-08-20T05:04:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.715+0000 7ff9f3e00640 1 -- 172.21.15.37:0/1327773589 learned_addr learned my addr 172.21.15.37:0/1327773589 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.716+0000 7ff9f3e00640 1 -- 172.21.15.37:0/1327773589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 msgr2=0x557b4a1533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.716+0000 7ff9f3e00640 1 --2- 172.21.15.37:0/1327773589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a1533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.717+0000 7ff9f3e00640 1 -- 172.21.15.37:0/1327773589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a137900 msgr2=0x557b4a157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.717+0000 7ff9f3e00640 1 --2- 172.21.15.37:0/1327773589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a137900 0x557b4a157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.717+0000 7ff9f3e00640 1 -- 172.21.15.37:0/1327773589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b4a13da60 con 0x557b4a138220 2024-08-20T05:04:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.717+0000 7ff9f3e00640 1 --2- 172.21.15.37:0/1327773589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a138220 0x557b4a161020 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00115f0 tx=0x7ff9e0009870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90de05ff7d41da7f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.718+0000 7ff9e5600640 1 -- 172.21.15.37:0/1327773589 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e001e040 con 0x557b4a138220 2024-08-20T05:04:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.718+0000 7ff9e5600640 1 -- 172.21.15.37:0/1327773589 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e0029070 con 0x557b4a138220 2024-08-20T05:04:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.718+0000 7ff9e5600640 1 -- 172.21.15.37:0/1327773589 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0019dd0 con 0x557b4a138220 2024-08-20T05:04:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.719+0000 7ff9fe473740 1 -- 172.21.15.37:0/1327773589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a138220 msgr2=0x557b4a161020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.719+0000 7ff9fe473740 1 --2- 172.21.15.37:0/1327773589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a138220 0x557b4a161020 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00115f0 tx=0x7ff9e0009870 comp rx=0 tx=0).stop 2024-08-20T05:04:19.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.720+0000 7ff9fe473740 1 -- 172.21.15.37:0/1327773589 shutdown_connections 2024-08-20T05:04:19.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.720+0000 7ff9fe473740 1 --2- 172.21.15.37:0/1327773589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a1533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.720+0000 7ff9fe473740 1 --2- 172.21.15.37:0/1327773589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a138220 0x557b4a161020 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.720+0000 7ff9fe473740 1 --2- 172.21.15.37:0/1327773589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a137900 0x557b4a157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.720+0000 7ff9fe473740 1 -- 172.21.15.37:0/1327773589 >> 172.21.15.37:0/1327773589 conn(0x557b4a135730 msgr2=0x557b4a156e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:19.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.721+0000 7ff9fe473740 1 -- 172.21.15.37:0/1327773589 shutdown_connections 2024-08-20T05:04:19.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.721+0000 7ff9fe473740 1 -- 172.21.15.37:0/1327773589 wait complete. 2024-08-20T05:04:19.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.721+0000 7ff9fe473740 1 -- start start 2024-08-20T05:04:19.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.722+0000 7ff9fe473740 1 Processor -- start 2024-08-20T05:04:19.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.723+0000 7ff9fe473740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a137900 0x557b4a16cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.723+0000 7ff9fe473740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a138220 0x557b4a15d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.723+0000 7ff9fe473740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.723+0000 7ff9fe473740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d4011020 con 0x557b4a138220 2024-08-20T05:04:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.723+0000 7ff9fe473740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d4010950 con 0x557b4a1551c0 2024-08-20T05:04:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.723+0000 7ff9fe473740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d400db90 con 0x557b4a137900 2024-08-20T05:04:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.724+0000 7ff9fe473740 10 client.0 _ll_register_callbacks cb 0x7ff9e800af20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.724+0000 7ff9f8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a137900 0x557b4a16cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.724+0000 7ff9f9800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.724+0000 7ff9f9800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a15d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56410/0 (socket says 172.21.15.37:56410) 2024-08-20T05:04:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.724+0000 7ff9f9800640 1 -- 172.21.15.37:0/2114774674 learned_addr learned my addr 172.21.15.37:0/2114774674 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.725+0000 7ff9f9800640 1 -- 172.21.15.37:0/2114774674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a137900 msgr2=0x557b4a16cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.725+0000 7ff9f9800640 1 --2- 172.21.15.37:0/2114774674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a137900 0x557b4a16cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.725+0000 7ff9f9800640 1 -- 172.21.15.37:0/2114774674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a138220 msgr2=0x557b4a15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.725+0000 7ff9f9800640 1 --2- 172.21.15.37:0/2114774674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a138220 0x557b4a15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.725+0000 7ff9f9800640 1 -- 172.21.15.37:0/2114774674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b4a15ddc0 con 0x557b4a1551c0 2024-08-20T05:04:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.727+0000 7ff9f9800640 1 --2- 172.21.15.37:0/2114774674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a15d6d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec035000 tx=0x7ff9ec0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eac5f33fa8b591cf server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.727+0000 7ff9daa00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:04:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.727+0000 7ff9daa00640 1 -- 172.21.15.37:0/2114774674 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec004250 con 0x557b4a1551c0 2024-08-20T05:04:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.728+0000 7ff9daa00640 1 -- 172.21.15.37:0/2114774674 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff9ec0043f0 con 0x557b4a1551c0 2024-08-20T05:04:19.026 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:04:19.027 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T05:04:19.027 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-20T05:04:19.027 INFO:teuthology.orchestra.run.smithi037.stdout: "88fc0555-c03b-4837-8535-2852e609ac9e": { 2024-08-20T05:04:19.027 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-20T05:04:19.027 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "88fc0555-c03b-4837-8535-2852e609ac9e", 2024-08-20T05:04:19.027 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-20T05:04:19.027 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:04:19.027 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:04:19.027 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:04:19.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.728+0000 7ff9fe473740 1 -- 172.21.15.37:0/2114774674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9e0029070 con 0x557b4a1551c0 2024-08-20T05:04:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.729+0000 7ff9daa00640 1 -- 172.21.15.37:0/2114774674 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff9ec004630 con 0x557b4a1551c0 2024-08-20T05:04:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.729+0000 7ff9fe473740 10 client.26075 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.729+0000 7ff9fe473740 1 -- 172.21.15.37:0/2114774674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557b4a1e0b30 con 0x557b4a1551c0 2024-08-20T05:04:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.730+0000 7ff9daa00640 1 -- 172.21.15.37:0/2114774674 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9e0029070 con 0x557b4a1551c0 2024-08-20T05:04:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.730+0000 7ff9daa00640 1 -- 172.21.15.37:0/2114774674 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7ff9ec044040 con 0x557b4a1551c0 2024-08-20T05:04:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.731+0000 7ff9fe473740 10 client.26075 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.733+0000 7ff9fe473740 10 client.26075 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:04:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.733+0000 7ff9fe473740 20 client.26075 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.733+0000 7ff9fe473740 1 --2- 172.21.15.37:0/2114774674 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557b4a1e13f0 0x557b4a1e3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.733+0000 7ff9fe473740 4 client.26075 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:04:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.733+0000 7ff9fe473740 1 -- 172.21.15.37:0/2114774674 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557b4a0af9b0 con 0x557b4a1e13f0 2024-08-20T05:04:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.733+0000 7ff9f8e00640 1 --2- 172.21.15.37:0/2114774674 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557b4a1e13f0 0x557b4a1e3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.734+0000 7ff9f8e00640 1 --2- 172.21.15.37:0/2114774674 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557b4a1e13f0 0x557b4a1e3810 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74d48cf489939c42 server_cookie=f3a0e701c2bc989e in_seq=0 out_seq=0 2024-08-20T05:04:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.734+0000 7ff9daa00640 10 client.26075 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.735+0000 7ff9daa00640 1 -- 172.21.15.37:0/2114774674 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x557b4a0af9b0 con 0x557b4a1e13f0 2024-08-20T05:04:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.735+0000 7ff9daa00640 10 client.26075 handle_command_reply: tid=0 2024-08-20T05:04:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.735+0000 7ff9fe473740 1 client.26075 shutdown 2024-08-20T05:04:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.735+0000 7ff9fe473740 1 -- 172.21.15.37:0/2114774674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 msgr2=0x557b4a15d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.735+0000 7ff9fe473740 1 --2- 172.21.15.37:0/2114774674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a15d6d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec035000 tx=0x7ff9ec0095c0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.735+0000 7ff9fe473740 1 -- 172.21.15.37:0/2114774674 shutdown_connections 2024-08-20T05:04:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.735+0000 7ff9fe473740 1 --2- 172.21.15.37:0/2114774674 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557b4a1e13f0 0x557b4a1e3810 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.735+0000 7ff9fe473740 1 --2- 172.21.15.37:0/2114774674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557b4a1551c0 0x557b4a15d6d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.735+0000 7ff9fe473740 1 --2- 172.21.15.37:0/2114774674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557b4a138220 0x557b4a15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.735+0000 7ff9fe473740 1 --2- 172.21.15.37:0/2114774674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557b4a137900 0x557b4a16cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.735+0000 7ff9fe473740 1 -- 172.21.15.37:0/2114774674 >> 172.21.15.37:0/2114774674 conn(0x557b4a135730 msgr2=0x557b4a133ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.735+0000 7ff9daa00640 0 client.26075 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.736+0000 7ff9fe473740 1 -- 172.21.15.37:0/2114774674 shutdown_connections 2024-08-20T05:04:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.736+0000 7ff9fe473740 1 -- 172.21.15.37:0/2114774674 wait complete. 2024-08-20T05:04:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.736+0000 7ff9fe473740 20 client.26075 trim_cache size 0 max 16384 2024-08-20T05:04:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.739+0000 7ff9fb800640 1 -- 172.21.15.37:0/2514941017 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9dc0b3ed0 msgr2=0x7ff9dc0b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.739+0000 7ff9fb800640 1 --2- 172.21.15.37:0/2514941017 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9dc0b3ed0 0x7ff9dc0b6390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009430 tx=0x7ff9ec009360 comp rx=0 tx=0).stop 2024-08-20T05:04:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.739+0000 7ff9fb800640 1 -- 172.21.15.37:0/2514941017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9f41090e0 msgr2=0x7ff9f419f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.739+0000 7ff9fb800640 1 --2- 172.21.15.37:0/2514941017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9f41090e0 0x7ff9f419f540 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff9e800c970 tx=0x7ff9e800ce30 comp rx=0 tx=0).stop 2024-08-20T05:04:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.742+0000 7ff9fb800640 1 -- 172.21.15.37:0/2514941017 shutdown_connections 2024-08-20T05:04:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.742+0000 7ff9fb800640 1 --2- 172.21.15.37:0/2514941017 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff9dc0b3ed0 0x7ff9dc0b6390 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.742+0000 7ff9fb800640 1 --2- 172.21.15.37:0/2514941017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9f410f470 0x7ff9f41a4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.742+0000 7ff9fb800640 1 --2- 172.21.15.37:0/2514941017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff9f410eaf0 0x7ff9f419fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.742+0000 7ff9fb800640 1 --2- 172.21.15.37:0/2514941017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff9f41090e0 0x7ff9f419f540 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.742+0000 7ff9fb800640 1 -- 172.21.15.37:0/2514941017 >> 172.21.15.37:0/2514941017 conn(0x7ff9f4078760 msgr2=0x7ff9f407ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.743+0000 7ff9fb800640 1 -- 172.21.15.37:0/2514941017 shutdown_connections 2024-08-20T05:04:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:18.743+0000 7ff9fb800640 1 -- 172.21.15.37:0/2514941017 wait complete. 2024-08-20T05:04:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.114+0000 7fca5e800640 1 -- 172.21.15.37:0/2467421711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca581026b0 msgr2=0x7fca58102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.114+0000 7fca5e800640 1 --2- 172.21.15.37:0/2467421711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca581026b0 0x7fca58102b30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fca40009930 tx=0x7fca4002a440 comp rx=0 tx=0).stop 2024-08-20T05:04:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.114+0000 7fca5e800640 1 -- 172.21.15.37:0/2467421711 shutdown_connections 2024-08-20T05:04:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.114+0000 7fca5e800640 1 --2- 172.21.15.37:0/2467421711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca58103070 0x7fca581099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.114+0000 7fca5e800640 1 --2- 172.21.15.37:0/2467421711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca581026b0 0x7fca58102b30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.114+0000 7fca5e800640 1 --2- 172.21.15.37:0/2467421711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca58101560 0x7fca58101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.114+0000 7fca5e800640 1 -- 172.21.15.37:0/2467421711 >> 172.21.15.37:0/2467421711 conn(0x7fca580fce40 msgr2=0x7fca580ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.114+0000 7fca5e800640 1 -- 172.21.15.37:0/2467421711 shutdown_connections 2024-08-20T05:04:19.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.115+0000 7fca5e800640 1 -- 172.21.15.37:0/2467421711 wait complete. 2024-08-20T05:04:19.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.116+0000 7fca5e800640 1 Processor -- start 2024-08-20T05:04:19.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.117+0000 7fca5e800640 1 -- start start 2024-08-20T05:04:19.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.118+0000 7fca5e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca58101560 0x7fca5819acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.118+0000 7fca5e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca581026b0 0x7fca5819b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.119+0000 7fca5e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca58103070 0x7fca5819bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.119+0000 7fca5e800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fca58110540 con 0x7fca58101560 2024-08-20T05:04:19.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.119+0000 7fca5e800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fca581103c0 con 0x7fca58103070 2024-08-20T05:04:19.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.119+0000 7fca5e800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca581106c0 con 0x7fca581026b0 2024-08-20T05:04:19.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.119+0000 7fca57400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca58101560 0x7fca5819acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.120+0000 7fca57400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca58101560 0x7fca5819acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46202/0 (socket says 172.21.15.37:46202) 2024-08-20T05:04:19.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.120+0000 7fca57400640 1 -- 172.21.15.37:0/1330401815 learned_addr learned my addr 172.21.15.37:0/1330401815 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:19.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.120+0000 7fca57400640 1 -- 172.21.15.37:0/1330401815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca581026b0 msgr2=0x7fca5819b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.120+0000 7fca57400640 1 --2- 172.21.15.37:0/1330401815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca581026b0 0x7fca5819b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.120+0000 7fca57400640 1 -- 172.21.15.37:0/1330401815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca58103070 msgr2=0x7fca5819bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.120+0000 7fca57400640 1 --2- 172.21.15.37:0/1330401815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca58103070 0x7fca5819bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.120+0000 7fca57400640 1 -- 172.21.15.37:0/1330401815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5819c7f0 con 0x7fca58101560 2024-08-20T05:04:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.121+0000 7fca57400640 1 --2- 172.21.15.37:0/1330401815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca58101560 0x7fca5819acb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fca4800eab0 tx=0x7fca4800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.121+0000 7fca54c00640 1 -- 172.21.15.37:0/1330401815 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4800ce40 con 0x7fca58101560 2024-08-20T05:04:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.121+0000 7fca54c00640 1 -- 172.21.15.37:0/1330401815 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca48011920 con 0x7fca58101560 2024-08-20T05:04:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.121+0000 7fca54c00640 1 -- 172.21.15.37:0/1330401815 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48010a30 con 0x7fca58101560 2024-08-20T05:04:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.121+0000 7fca5e800640 1 -- 172.21.15.37:0/1330401815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca5819cae0 con 0x7fca58101560 2024-08-20T05:04:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.122+0000 7fca5e800640 1 -- 172.21.15.37:0/1330401815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca581a31b0 con 0x7fca58101560 2024-08-20T05:04:19.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.129+0000 7fca54c00640 1 -- 172.21.15.37:0/1330401815 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fca48010bd0 con 0x7fca58101560 2024-08-20T05:04:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.130+0000 7fca6185e740 1 Processor -- start 2024-08-20T05:04:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.130+0000 7fca6185e740 1 -- start start 2024-08-20T05:04:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.131+0000 7fca6185e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f3620 0x55b3b68f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.131+0000 7fca6185e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f5f50 0x55b3b68f8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.131+0000 7fca6185e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f8990 0x55b3b68fae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.132+0000 7fca6185e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b3b6855210 con 0x55b3b68f8990 2024-08-20T05:04:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.132+0000 7fca6185e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b3b6844710 con 0x55b3b68f5f50 2024-08-20T05:04:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.132+0000 7fca6185e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b3b6848750 con 0x55b3b68f3620 2024-08-20T05:04:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.132+0000 7fca57e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f3620 0x55b3b68f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.132+0000 7fca57e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f3620 0x55b3b68f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:59464/0 (socket says 172.21.15.37:59464) 2024-08-20T05:04:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.132+0000 7fca57e00640 1 -- 172.21.15.37:0/1375077613 learned_addr learned my addr 172.21.15.37:0/1375077613 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.133+0000 7fca4ea00640 1 --2- 172.21.15.37:0/1375077613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f8990 0x55b3b68fae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.133+0000 7fca57400640 1 --2- 172.21.15.37:0/1375077613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f5f50 0x55b3b68f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.134+0000 7fca54c00640 1 --2- 172.21.15.37:0/1330401815 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca3c0b3d60 0x7fca3c0b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.134+0000 7fca54c00640 1 -- 172.21.15.37:0/1330401815 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fca480e4590 con 0x7fca58101560 2024-08-20T05:04:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.135+0000 7fca57e00640 1 -- 172.21.15.37:0/1375077613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f5f50 msgr2=0x55b3b68f8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.135+0000 7fca57e00640 1 --2- 172.21.15.37:0/1375077613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f5f50 0x55b3b68f8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.135+0000 7fca57e00640 1 -- 172.21.15.37:0/1375077613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f8990 msgr2=0x55b3b68fae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.135+0000 7fca57e00640 1 --2- 172.21.15.37:0/1375077613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f8990 0x55b3b68fae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.135+0000 7fca57e00640 1 -- 172.21.15.37:0/1375077613 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3b6810de0 con 0x55b3b68f3620 2024-08-20T05:04:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.136+0000 7fca57400640 1 --2- 172.21.15.37:0/1375077613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f5f50 0x55b3b68f8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:04:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.136+0000 7fca4ea00640 1 --2- 172.21.15.37:0/1375077613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f8990 0x55b3b68fae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:04:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.137+0000 7fca57e00640 1 --2- 172.21.15.37:0/1330401815 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca3c0b3d60 0x7fca3c0b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.137+0000 7fca57e00640 1 --2- 172.21.15.37:0/1375077613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f3620 0x55b3b68f5a10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fca5000bbc0 tx=0x7fca5000d6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3aa5c589c8017759 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.139+0000 7fca4cc00640 1 -- 172.21.15.37:0/1375077613 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50012680 con 0x55b3b68f3620 2024-08-20T05:04:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.142+0000 7fca4cc00640 1 -- 172.21.15.37:0/1375077613 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca50018040 con 0x55b3b68f3620 2024-08-20T05:04:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.142+0000 7fca4cc00640 1 -- 172.21.15.37:0/1375077613 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50012680 con 0x55b3b68f3620 2024-08-20T05:04:19.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.143+0000 7fca57e00640 1 --2- 172.21.15.37:0/1330401815 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca3c0b3d60 0x7fca3c0b6220 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fca5001c000 tx=0x7fca5001dcf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.144+0000 7fca6185e740 1 -- 172.21.15.37:0/1375077613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f3620 msgr2=0x55b3b68f5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.144+0000 7fca6185e740 1 --2- 172.21.15.37:0/1375077613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f3620 0x55b3b68f5a10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fca5000bbc0 tx=0x7fca5000d6b0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.146+0000 7fca6185e740 1 -- 172.21.15.37:0/1375077613 shutdown_connections 2024-08-20T05:04:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.146+0000 7fca6185e740 1 --2- 172.21.15.37:0/1375077613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f8990 0x55b3b68fae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.146+0000 7fca6185e740 1 --2- 172.21.15.37:0/1375077613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f5f50 0x55b3b68f8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.146+0000 7fca6185e740 1 --2- 172.21.15.37:0/1375077613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f3620 0x55b3b68f5a10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.146+0000 7fca6185e740 1 -- 172.21.15.37:0/1375077613 >> 172.21.15.37:0/1375077613 conn(0x55b3b68dd760 msgr2=0x55b3b68de4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.146+0000 7fca6185e740 1 -- 172.21.15.37:0/1375077613 shutdown_connections 2024-08-20T05:04:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.147+0000 7fca6185e740 1 -- 172.21.15.37:0/1375077613 wait complete. 2024-08-20T05:04:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.147+0000 7fca6185e740 1 -- start start 2024-08-20T05:04:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.148+0000 7fca6185e740 1 Processor -- start 2024-08-20T05:04:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.148+0000 7fca6185e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f3620 0x55b3b6905510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.148+0000 7fca6185e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f5f50 0x55b3b6905bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.148+0000 7fca6185e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f8990 0x55b3b6906780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.149+0000 7fca6185e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b3b677dab0 con 0x55b3b68f5f50 2024-08-20T05:04:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.149+0000 7fca6185e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b3b67eb140 con 0x55b3b68f3620 2024-08-20T05:04:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.149+0000 7fca6185e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b3b68fb970 con 0x55b3b68f8990 2024-08-20T05:04:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.149+0000 7fca6185e740 10 client.0 _ll_register_callbacks cb 0x55b3b67fe5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.149+0000 7fca57e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f8990 0x55b3b6906780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.149+0000 7fca57e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f8990 0x55b3b6906780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:59480/0 (socket says 172.21.15.37:59480) 2024-08-20T05:04:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.149+0000 7fca57e00640 1 -- 172.21.15.37:0/2653361440 learned_addr learned my addr 172.21.15.37:0/2653361440 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.149+0000 7fca57400640 1 --2- 172.21.15.37:0/2653361440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f3620 0x55b3b6905510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.149+0000 7fca57400640 1 -- 172.21.15.37:0/2653361440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f8990 msgr2=0x55b3b6906780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.149+0000 7fca57400640 1 --2- 172.21.15.37:0/2653361440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f8990 0x55b3b6906780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.149+0000 7fca57400640 1 -- 172.21.15.37:0/2653361440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f5f50 msgr2=0x55b3b6905bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.149+0000 7fca57400640 1 --2- 172.21.15.37:0/2653361440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f5f50 0x55b3b6905bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.149+0000 7fca57400640 1 -- 172.21.15.37:0/2653361440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3b67ec170 con 0x55b3b68f3620 2024-08-20T05:04:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.151+0000 7fca57400640 1 --2- 172.21.15.37:0/2653361440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f3620 0x55b3b6905510 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fca480e1d40 tx=0x7fca480aa970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b39c200ecf8bb6c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.151+0000 7fca45600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:04:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.152+0000 7fca45600640 1 -- 172.21.15.37:0/2653361440 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca480af740 con 0x55b3b68f3620 2024-08-20T05:04:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.152+0000 7fca45600640 1 -- 172.21.15.37:0/2653361440 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fca480e42f0 con 0x55b3b68f3620 2024-08-20T05:04:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.152+0000 7fca6185e740 1 -- 172.21.15.37:0/2653361440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca50018040 con 0x55b3b68f3620 2024-08-20T05:04:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.152+0000 7fca45600640 1 -- 172.21.15.37:0/2653361440 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fca480b41f0 con 0x55b3b68f3620 2024-08-20T05:04:19.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.152+0000 7fca6185e740 10 client.26081 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.153+0000 7fca6185e740 1 -- 172.21.15.37:0/2653361440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b3b65a7790 con 0x55b3b68f3620 2024-08-20T05:04:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.153+0000 7fca45600640 1 -- 172.21.15.37:0/2653361440 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca50018040 con 0x55b3b68f3620 2024-08-20T05:04:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.153+0000 7fca45600640 1 -- 172.21.15.37:0/2653361440 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fca4800f040 con 0x55b3b68f3620 2024-08-20T05:04:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.153+0000 7fca6185e740 10 client.26081 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.153+0000 7fca6185e740 10 client.26081 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:04:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.153+0000 7fca6185e740 20 client.26081 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.153+0000 7fca6185e740 1 --2- 172.21.15.37:0/2653361440 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b3b69111e0 0x55b3b69136a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.153+0000 7fca6185e740 4 client.26081 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:04:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.153+0000 7fca6185e740 1 -- 172.21.15.37:0/2653361440 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3b6857160 con 0x55b3b69111e0 2024-08-20T05:04:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.156+0000 7fca4ea00640 1 --2- 172.21.15.37:0/2653361440 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b3b69111e0 0x55b3b69136a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.156+0000 7fca4ea00640 1 --2- 172.21.15.37:0/2653361440 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b3b69111e0 0x55b3b69136a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28ce724af02a17d6 server_cookie=d0fa5a9c84bee8b in_seq=0 out_seq=0 2024-08-20T05:04:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.157+0000 7fca45600640 10 client.26081 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.157+0000 7fca45600640 1 -- 172.21.15.37:0/2653361440 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b3b6857160 con 0x55b3b69111e0 2024-08-20T05:04:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.157+0000 7fca45600640 10 client.26081 handle_command_reply: tid=0 2024-08-20T05:04:19.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.158+0000 7fca6185e740 1 client.26081 shutdown 2024-08-20T05:04:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.159+0000 7fca6185e740 1 -- 172.21.15.37:0/2653361440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f3620 msgr2=0x55b3b6905510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.159+0000 7fca6185e740 1 --2- 172.21.15.37:0/2653361440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f3620 0x55b3b6905510 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fca480e1d40 tx=0x7fca480aa970 comp rx=0 tx=0).stop 2024-08-20T05:04:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.160+0000 7fca6185e740 1 -- 172.21.15.37:0/2653361440 shutdown_connections 2024-08-20T05:04:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.160+0000 7fca6185e740 1 --2- 172.21.15.37:0/2653361440 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b3b69111e0 0x55b3b69136a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.160+0000 7fca6185e740 1 --2- 172.21.15.37:0/2653361440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f8990 0x55b3b6906780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.160+0000 7fca6185e740 1 --2- 172.21.15.37:0/2653361440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f5f50 0x55b3b6905bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.160+0000 7fca6185e740 1 --2- 172.21.15.37:0/2653361440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f3620 0x55b3b6905510 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.160+0000 7fca6185e740 1 -- 172.21.15.37:0/2653361440 >> 172.21.15.37:0/2653361440 conn(0x55b3b68dd760 msgr2=0x55b3b68dc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.160+0000 7fca45600640 0 client.26081 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.160+0000 7fca6185e740 1 -- 172.21.15.37:0/2653361440 shutdown_connections 2024-08-20T05:04:19.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.160+0000 7fca6185e740 1 -- 172.21.15.37:0/2653361440 wait complete. 2024-08-20T05:04:19.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.160+0000 7fca6185e740 20 client.26081 trim_cache size 0 max 16384 2024-08-20T05:04:19.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.207+0000 7fca6185e740 1 Processor -- start 2024-08-20T05:04:19.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.207+0000 7fca6185e740 1 -- start start 2024-08-20T05:04:19.209 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.208+0000 7fca6185e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f3620 0x55b3b6905280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.208+0000 7fca6185e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f5f50 0x55b3b68f8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.208+0000 7fca6185e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f8990 0x55b3b68f92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.208+0000 7fca6185e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fca580726f0 con 0x55b3b68f5f50 2024-08-20T05:04:19.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.208+0000 7fca6185e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fca580742f0 con 0x55b3b68f3620 2024-08-20T05:04:19.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.208+0000 7fca6185e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca58072dc0 con 0x55b3b68f8990 2024-08-20T05:04:19.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.208+0000 7fca57e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f8990 0x55b3b68f92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.208+0000 7fca57e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f8990 0x55b3b68f92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:59488/0 (socket says 172.21.15.37:59488) 2024-08-20T05:04:19.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.208+0000 7fca57e00640 1 -- 172.21.15.37:0/1969463316 learned_addr learned my addr 172.21.15.37:0/1969463316 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:19.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.209+0000 7fca57e00640 1 -- 172.21.15.37:0/1969463316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f3620 msgr2=0x55b3b6905280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:04:19.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.209+0000 7fca57e00640 1 --2- 172.21.15.37:0/1969463316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f3620 0x55b3b6905280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.209+0000 7fca57e00640 1 -- 172.21.15.37:0/1969463316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f5f50 msgr2=0x55b3b68f8d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:04:19.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.209+0000 7fca57e00640 1 --2- 172.21.15.37:0/1969463316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f5f50 0x55b3b68f8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.209+0000 7fca57e00640 1 -- 172.21.15.37:0/1969463316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3b6620620 con 0x55b3b68f8990 2024-08-20T05:04:19.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.210+0000 7fca57e00640 1 --2- 172.21.15.37:0/1969463316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f8990 0x55b3b68f92b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fca5000dbb0 tx=0x7fca50010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=656f057421e39fd2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:19.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.210+0000 7fca47e00640 1 -- 172.21.15.37:0/1969463316 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5001d640 con 0x55b3b68f8990 2024-08-20T05:04:19.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.210+0000 7fca47e00640 1 -- 172.21.15.37:0/1969463316 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca500044f0 con 0x55b3b68f8990 2024-08-20T05:04:19.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.211+0000 7fca47e00640 1 -- 172.21.15.37:0/1969463316 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca500035f0 con 0x55b3b68f8990 2024-08-20T05:04:19.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.211+0000 7fca6185e740 1 -- 172.21.15.37:0/1969463316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f8990 msgr2=0x55b3b68f92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.211+0000 7fca6185e740 1 --2- 172.21.15.37:0/1969463316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f8990 0x55b3b68f92b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fca5000dbb0 tx=0x7fca50010000 comp rx=0 tx=0).stop 2024-08-20T05:04:19.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.211+0000 7fca6185e740 1 -- 172.21.15.37:0/1969463316 shutdown_connections 2024-08-20T05:04:19.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.211+0000 7fca6185e740 1 --2- 172.21.15.37:0/1969463316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f8990 0x55b3b68f92b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.211+0000 7fca6185e740 1 --2- 172.21.15.37:0/1969463316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f5f50 0x55b3b68f8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.211+0000 7fca6185e740 1 --2- 172.21.15.37:0/1969463316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f3620 0x55b3b6905280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.211+0000 7fca6185e740 1 -- 172.21.15.37:0/1969463316 >> 172.21.15.37:0/1969463316 conn(0x55b3b68dd760 msgr2=0x55b3b68e1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:19.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.211+0000 7fca6185e740 1 -- 172.21.15.37:0/1969463316 shutdown_connections 2024-08-20T05:04:19.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.211+0000 7fca6185e740 1 -- 172.21.15.37:0/1969463316 wait complete. 2024-08-20T05:04:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.212+0000 7fca6185e740 1 -- start start 2024-08-20T05:04:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.212+0000 7fca6185e740 1 Processor -- start 2024-08-20T05:04:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.212+0000 7fca6185e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f3620 0x55b3b690a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.212+0000 7fca6185e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f5f50 0x55b3b690a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.212+0000 7fca6185e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f8990 0x55b3b690b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.212+0000 7fca6185e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fca58073b60 con 0x55b3b68f3620 2024-08-20T05:04:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.212+0000 7fca6185e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fca58073490 con 0x55b3b68f8990 2024-08-20T05:04:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.212+0000 7fca6185e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca580706d0 con 0x55b3b68f5f50 2024-08-20T05:04:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.213+0000 7fca6185e740 10 client.0 _ll_register_callbacks cb 0x7fca4800ea00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.213+0000 7fca57e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f8990 0x55b3b690b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.213+0000 7fca57e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f8990 0x55b3b690b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56476/0 (socket says 172.21.15.37:56476) 2024-08-20T05:04:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.213+0000 7fca57e00640 1 -- 172.21.15.37:0/1989145157 learned_addr learned my addr 172.21.15.37:0/1989145157 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.213+0000 7fca4ea00640 1 --2- 172.21.15.37:0/1989145157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f5f50 0x55b3b690a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.213+0000 7fca57e00640 1 -- 172.21.15.37:0/1989145157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f5f50 msgr2=0x55b3b690a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.214+0000 7fca57400640 1 --2- 172.21.15.37:0/1989145157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f3620 0x55b3b690a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.214+0000 7fca57e00640 1 --2- 172.21.15.37:0/1989145157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f5f50 0x55b3b690a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.214+0000 7fca57e00640 1 -- 172.21.15.37:0/1989145157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f3620 msgr2=0x55b3b690a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.214+0000 7fca57e00640 1 --2- 172.21.15.37:0/1989145157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f3620 0x55b3b690a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.214+0000 7fca57e00640 1 -- 172.21.15.37:0/1989145157 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3b690bde0 con 0x55b3b68f8990 2024-08-20T05:04:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.214+0000 7fca4ea00640 1 --2- 172.21.15.37:0/1989145157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f5f50 0x55b3b690a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:04:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.215+0000 7fca57e00640 1 --2- 172.21.15.37:0/1989145157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f8990 0x55b3b690b5b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fca50004700 tx=0x7fca5001dc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b65fe5544a155030 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.215+0000 7fca45600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:04:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.215+0000 7fca45600640 1 -- 172.21.15.37:0/1989145157 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5001d440 con 0x55b3b68f8990 2024-08-20T05:04:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.216+0000 7fca45600640 1 -- 172.21.15.37:0/1989145157 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fca50035040 con 0x55b3b68f8990 2024-08-20T05:04:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.216+0000 7fca6185e740 1 -- 172.21.15.37:0/1989145157 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca500044f0 con 0x55b3b68f8990 2024-08-20T05:04:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.216+0000 7fca45600640 1 -- 172.21.15.37:0/1989145157 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fca5001d5e0 con 0x55b3b68f8990 2024-08-20T05:04:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.216+0000 7fca6185e740 10 client.26084 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.217+0000 7fca6185e740 1 -- 172.21.15.37:0/1989145157 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b3b690d150 con 0x55b3b68f8990 2024-08-20T05:04:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.217+0000 7fca45600640 1 -- 172.21.15.37:0/1989145157 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca500044f0 con 0x55b3b68f8990 2024-08-20T05:04:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.217+0000 7fca45600640 1 -- 172.21.15.37:0/1989145157 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fca5001b020 con 0x55b3b68f8990 2024-08-20T05:04:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.217+0000 7fca6185e740 10 client.26084 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.217+0000 7fca6185e740 10 client.26084 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:04:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.217+0000 7fca6185e740 20 client.26084 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:19.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.217+0000 7fca6185e740 1 --2- 172.21.15.37:0/1989145157 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b3b697bf40 0x55b3b697e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:19.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.218+0000 7fca6185e740 4 client.26084 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:04:19.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.218+0000 7fca6185e740 1 -- 172.21.15.37:0/1989145157 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b3b6852c00 con 0x55b3b697bf40 2024-08-20T05:04:19.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.220+0000 7fca57400640 1 --2- 172.21.15.37:0/1989145157 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b3b697bf40 0x55b3b697e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:19.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.220+0000 7fca45600640 10 client.26084 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:19.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.220+0000 7fca57400640 1 --2- 172.21.15.37:0/1989145157 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b3b697bf40 0x55b3b697e330 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a2fc7e8c51cc356 server_cookie=35de090bb0d07c06 in_seq=0 out_seq=0 2024-08-20T05:04:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.238+0000 7fca45600640 1 -- 172.21.15.37:0/1989145157 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b3b6852c00 con 0x55b3b697bf40 2024-08-20T05:04:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.238+0000 7fca45600640 10 client.26084 handle_command_reply: tid=0 2024-08-20T05:04:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.238+0000 7fca6185e740 1 client.26084 shutdown 2024-08-20T05:04:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.238+0000 7fca6185e740 1 -- 172.21.15.37:0/1989145157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f8990 msgr2=0x55b3b690b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.238+0000 7fca6185e740 1 --2- 172.21.15.37:0/1989145157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f8990 0x55b3b690b5b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fca50004700 tx=0x7fca5001dc40 comp rx=0 tx=0).stop 2024-08-20T05:04:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.238+0000 7fca6185e740 1 -- 172.21.15.37:0/1989145157 shutdown_connections 2024-08-20T05:04:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.238+0000 7fca6185e740 1 --2- 172.21.15.37:0/1989145157 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b3b697bf40 0x55b3b697e330 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.238+0000 7fca6185e740 1 --2- 172.21.15.37:0/1989145157 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3b68f8990 0x55b3b690b5b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.238+0000 7fca6185e740 1 --2- 172.21.15.37:0/1989145157 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3b68f5f50 0x55b3b690a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.238+0000 7fca6185e740 1 --2- 172.21.15.37:0/1989145157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3b68f3620 0x55b3b690a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.238+0000 7fca6185e740 1 -- 172.21.15.37:0/1989145157 >> 172.21.15.37:0/1989145157 conn(0x55b3b68dd760 msgr2=0x55b3b68e19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.239+0000 7fca45600640 0 client.26084 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.239+0000 7fca6185e740 1 -- 172.21.15.37:0/1989145157 shutdown_connections 2024-08-20T05:04:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.239+0000 7fca6185e740 1 -- 172.21.15.37:0/1989145157 wait complete. 2024-08-20T05:04:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.239+0000 7fca6185e740 20 client.26084 trim_cache size 0 max 16384 2024-08-20T05:04:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:04:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:04:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:04:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:04:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.240+0000 7fca5e800640 1 -- 172.21.15.37:0/1330401815 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca3c0b3d60 msgr2=0x7fca3c0b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.240+0000 7fca5e800640 1 --2- 172.21.15.37:0/1330401815 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca3c0b3d60 0x7fca3c0b6220 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fca5001c000 tx=0x7fca5001dcf0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.240+0000 7fca5e800640 1 -- 172.21.15.37:0/1330401815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca58101560 msgr2=0x7fca5819acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.240+0000 7fca5e800640 1 --2- 172.21.15.37:0/1330401815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca58101560 0x7fca5819acb0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fca4800eab0 tx=0x7fca4800ef70 comp rx=0 tx=0).stop 2024-08-20T05:04:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.241+0000 7fca5e800640 1 -- 172.21.15.37:0/1330401815 shutdown_connections 2024-08-20T05:04:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.241+0000 7fca5e800640 1 --2- 172.21.15.37:0/1330401815 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca3c0b3d60 0x7fca3c0b6220 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.241+0000 7fca5e800640 1 --2- 172.21.15.37:0/1330401815 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca58103070 0x7fca5819bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.241+0000 7fca5e800640 1 --2- 172.21.15.37:0/1330401815 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca581026b0 0x7fca5819b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.241+0000 7fca5e800640 1 --2- 172.21.15.37:0/1330401815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca58101560 0x7fca5819acb0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.241+0000 7fca5e800640 1 -- 172.21.15.37:0/1330401815 >> 172.21.15.37:0/1330401815 conn(0x7fca580fce40 msgr2=0x7fca58105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.241+0000 7fca5e800640 1 -- 172.21.15.37:0/1330401815 shutdown_connections 2024-08-20T05:04:19.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:19.241+0000 7fca5e800640 1 -- 172.21.15.37:0/1330401815 wait complete. 2024-08-20T05:04:19.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:19 smithi135 ceph-mon[22342]: pgmap v463: 129 pgs: 129 active+clean; 984 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.7 MiB/s wr, 699 op/s 2024-08-20T05:04:19.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:19 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/285724297' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:04:19.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:19 smithi130 ceph-mon[22007]: pgmap v463: 129 pgs: 129 active+clean; 984 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.7 MiB/s wr, 699 op/s 2024-08-20T05:04:19.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:19 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/285724297' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:04:19.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:19 smithi037 ceph-mon[17265]: pgmap v463: 129 pgs: 129 active+clean; 984 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.7 MiB/s wr, 699 op/s 2024-08-20T05:04:19.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:19 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/285724297' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:04:21.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:21 smithi135 ceph-mon[22342]: pgmap v464: 129 pgs: 129 active+clean; 1000 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 800 op/s 2024-08-20T05:04:21.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:21 smithi130 ceph-mon[22007]: pgmap v464: 129 pgs: 129 active+clean; 1000 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 800 op/s 2024-08-20T05:04:21.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:21 smithi037 ceph-mon[17265]: pgmap v464: 129 pgs: 129 active+clean; 1000 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 800 op/s 2024-08-20T05:04:22.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:22 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:04:22.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:22 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:04:22.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:22 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:04:22.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:22 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:04:22.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:22 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:04:22.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:22 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:04:22.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:22 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:04:22.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:22 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:04:22.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:22 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:04:22.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:22 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:04:22.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:22 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:04:22.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:22 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:04:22.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:22 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:04:22.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:22 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:04:22.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:22 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:04:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 85.0 s, 1942.4 tps, lat 51.006 ms stddev 63.344 2024-08-20T05:04:23.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:23 smithi135 ceph-mon[22342]: pgmap v465: 129 pgs: 129 active+clean; 1000 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 9.8 MiB/s wr, 738 op/s 2024-08-20T05:04:23.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:04:23.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:23 smithi130 ceph-mon[22007]: pgmap v465: 129 pgs: 129 active+clean; 1000 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 9.8 MiB/s wr, 738 op/s 2024-08-20T05:04:23.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:04:23.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:23 smithi037 ceph-mon[17265]: pgmap v465: 129 pgs: 129 active+clean; 1000 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 9.8 MiB/s wr, 738 op/s 2024-08-20T05:04:23.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:04:25.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:25 smithi135 ceph-mon[22342]: pgmap v466: 129 pgs: 129 active+clean; 1000 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 9.6 MiB/s wr, 803 op/s 2024-08-20T05:04:25.675 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:25 smithi037 ceph-mon[17265]: pgmap v466: 129 pgs: 129 active+clean; 1000 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 9.6 MiB/s wr, 803 op/s 2024-08-20T05:04:25.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:25 smithi130 ceph-mon[22007]: pgmap v466: 129 pgs: 129 active+clean; 1000 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 9.6 MiB/s wr, 803 op/s 2024-08-20T05:04:25.740 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 130.2 --await-for 45.0' 2024-08-20T05:04:25.740 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 130.2 --await-for 45.0 2024-08-20T05:04:26.395 INFO:tasks.cephfs.filesystem:scrub status for tag:88fc0555-c03b-4837-8535-2852e609ac9e - {'path': '/', 'tag': '88fc0555-c03b-4837-8535-2852e609ac9e', 'options': 'recursive,force'} 2024-08-20T05:04:26.569 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:04:27.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.375+0000 7f098bc00640 1 -- 172.21.15.37:0/2665779691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09841084c0 msgr2=0x7f0984108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:27.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.375+0000 7f098bc00640 1 --2- 172.21.15.37:0/2665779691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09841084c0 0x7f0984108900 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f097000dc90 tx=0x7f097002e370 comp rx=0 tx=0).stop 2024-08-20T05:04:27.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.376+0000 7f098bc00640 1 -- 172.21.15.37:0/2665779691 shutdown_connections 2024-08-20T05:04:27.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.376+0000 7f098bc00640 1 --2- 172.21.15.37:0/2665779691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0984108e40 0x7f098410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.376+0000 7f098bc00640 1 --2- 172.21.15.37:0/2665779691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09841084c0 0x7f0984108900 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.376+0000 7f098bc00640 1 --2- 172.21.15.37:0/2665779691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0984102ab0 0x7f0984102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.376+0000 7f098bc00640 1 -- 172.21.15.37:0/2665779691 >> 172.21.15.37:0/2665779691 conn(0x7f09840fe500 msgr2=0x7f0984100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:27.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.376+0000 7f098bc00640 1 -- 172.21.15.37:0/2665779691 shutdown_connections 2024-08-20T05:04:27.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.376+0000 7f098bc00640 1 -- 172.21.15.37:0/2665779691 wait complete. 2024-08-20T05:04:27.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.377+0000 7f098bc00640 1 Processor -- start 2024-08-20T05:04:27.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.378+0000 7f098bc00640 1 -- start start 2024-08-20T05:04:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.378+0000 7f098bc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0984102ab0 0x7f098419f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.379+0000 7f098bc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09841084c0 0x7f098419faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.379+0000 7f098bc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0984108e40 0x7f09841a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.379+0000 7f098bc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0984110940 con 0x7f0984108e40 2024-08-20T05:04:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.379+0000 7f098bc00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f09841107c0 con 0x7f0984102ab0 2024-08-20T05:04:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.379+0000 7f098bc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0984110ac0 con 0x7f09841084c0 2024-08-20T05:04:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.379+0000 7f0989200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0984102ab0 0x7f098419f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:27.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.379+0000 7f0989200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0984102ab0 0x7f098419f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:34874/0 (socket says 172.21.15.37:34874) 2024-08-20T05:04:27.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.379+0000 7f0989200640 1 -- 172.21.15.37:0/63981847 learned_addr learned my addr 172.21.15.37:0/63981847 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:27.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.379+0000 7f0983e00640 1 --2- 172.21.15.37:0/63981847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09841084c0 0x7f098419faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:27.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.379+0000 7f0989c00640 1 --2- 172.21.15.37:0/63981847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0984108e40 0x7f09841a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:27.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.380+0000 7f0983e00640 1 -- 172.21.15.37:0/63981847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0984102ab0 msgr2=0x7f098419f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:27.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.380+0000 7f0983e00640 1 --2- 172.21.15.37:0/63981847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0984102ab0 0x7f098419f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.380+0000 7f0983e00640 1 -- 172.21.15.37:0/63981847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0984108e40 msgr2=0x7f09841a4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:27.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.380+0000 7f0983e00640 1 --2- 172.21.15.37:0/63981847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0984108e40 0x7f09841a4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.380+0000 7f0983e00640 1 -- 172.21.15.37:0/63981847 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09841a5610 con 0x7f09841084c0 2024-08-20T05:04:27.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.380+0000 7f0983e00640 1 --2- 172.21.15.37:0/63981847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09841084c0 0x7f098419faa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0970006010 tx=0x7f0970004e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:27.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.381+0000 7f0981600640 1 -- 172.21.15.37:0/63981847 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0970005d50 con 0x7f09841084c0 2024-08-20T05:04:27.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.381+0000 7f0981600640 1 -- 172.21.15.37:0/63981847 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f097000d440 con 0x7f09841084c0 2024-08-20T05:04:27.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.381+0000 7f0981600640 1 -- 172.21.15.37:0/63981847 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097003f450 con 0x7f09841084c0 2024-08-20T05:04:27.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.381+0000 7f098bc00640 1 -- 172.21.15.37:0/63981847 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09841a58a0 con 0x7f09841084c0 2024-08-20T05:04:27.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.381+0000 7f098bc00640 1 -- 172.21.15.37:0/63981847 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09841abfc0 con 0x7f09841084c0 2024-08-20T05:04:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.386+0000 7f098e619740 1 Processor -- start 2024-08-20T05:04:27.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.388+0000 7f098e619740 1 -- start start 2024-08-20T05:04:27.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.388+0000 7f0981600640 1 -- 172.21.15.37:0/63981847 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0970003710 con 0x7f09841084c0 2024-08-20T05:04:27.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.389+0000 7f098e619740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a433f0 0x556540a437d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.389+0000 7f098e619740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a43d10 0x556540a4f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.389+0000 7f098e619740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a4fca0 0x556540a52090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.389+0000 7f098e619740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5565409e3670 con 0x556540a4fca0 2024-08-20T05:04:27.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.389+0000 7f098e619740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5565409b77c0 con 0x556540a433f0 2024-08-20T05:04:27.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.389+0000 7f098e619740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5565409a6cc0 con 0x556540a43d10 2024-08-20T05:04:27.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.389+0000 7f0989c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a433f0 0x556540a437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:27.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.389+0000 7f0989200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a43d10 0x556540a4f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.389+0000 7f0989200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a43d10 0x556540a4f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36614/0 (socket says 172.21.15.37:36614) 2024-08-20T05:04:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.389+0000 7f0989200640 1 -- 172.21.15.37:0/3205521188 learned_addr learned my addr 172.21.15.37:0/3205521188 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.390+0000 7f0989c00640 1 -- 172.21.15.37:0/3205521188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a43d10 msgr2=0x556540a4f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.390+0000 7f0989c00640 1 --2- 172.21.15.37:0/3205521188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a43d10 0x556540a4f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.390+0000 7f0989c00640 1 -- 172.21.15.37:0/3205521188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a4fca0 msgr2=0x556540a52090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.390+0000 7f0989c00640 1 --2- 172.21.15.37:0/3205521188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a4fca0 0x556540a52090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.390+0000 7f0989c00640 1 -- 172.21.15.37:0/3205521188 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55654093a110 con 0x556540a433f0 2024-08-20T05:04:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.390+0000 7f0989c00640 1 --2- 172.21.15.37:0/3205521188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a433f0 0x556540a437d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f097c009e10 tx=0x7f097c00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=200b7fc725b668c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.391+0000 7f0976000640 1 -- 172.21.15.37:0/3205521188 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c003b70 con 0x556540a433f0 2024-08-20T05:04:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.391+0000 7f0976000640 1 -- 172.21.15.37:0/3205521188 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f097c003d10 con 0x556540a433f0 2024-08-20T05:04:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.391+0000 7f0976000640 1 -- 172.21.15.37:0/3205521188 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c011860 con 0x556540a433f0 2024-08-20T05:04:27.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.391+0000 7f0981600640 1 --2- 172.21.15.37:0/63981847 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f096c0b3d20 0x7f096c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.391+0000 7f0981600640 1 -- 172.21.15.37:0/63981847 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0970103fb0 con 0x7f09841084c0 2024-08-20T05:04:27.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.391+0000 7f0989200640 1 --2- 172.21.15.37:0/63981847 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f096c0b3d20 0x7f096c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:27.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.392+0000 7f098e619740 1 -- 172.21.15.37:0/3205521188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a433f0 msgr2=0x556540a437d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:27.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.392+0000 7f098e619740 1 --2- 172.21.15.37:0/3205521188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a433f0 0x556540a437d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f097c009e10 tx=0x7f097c00f730 comp rx=0 tx=0).stop 2024-08-20T05:04:27.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.392+0000 7f098e619740 1 -- 172.21.15.37:0/3205521188 shutdown_connections 2024-08-20T05:04:27.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.392+0000 7f098e619740 1 --2- 172.21.15.37:0/3205521188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a4fca0 0x556540a52090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.392+0000 7f098e619740 1 --2- 172.21.15.37:0/3205521188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a43d10 0x556540a4f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.392+0000 7f098e619740 1 --2- 172.21.15.37:0/3205521188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a433f0 0x556540a437d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.392+0000 7f098e619740 1 -- 172.21.15.37:0/3205521188 >> 172.21.15.37:0/3205521188 conn(0x556540a41220 msgr2=0x556540a423c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:27.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.392+0000 7f098e619740 1 -- 172.21.15.37:0/3205521188 shutdown_connections 2024-08-20T05:04:27.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.392+0000 7f098e619740 1 -- 172.21.15.37:0/3205521188 wait complete. 2024-08-20T05:04:27.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.393+0000 7f0989200640 1 --2- 172.21.15.37:0/63981847 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f096c0b3d20 0x7f096c0b61e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x556540a42100 tx=0x7f097800b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:27.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.393+0000 7f098e619740 1 -- start start 2024-08-20T05:04:27.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.393+0000 7f098e619740 1 Processor -- start 2024-08-20T05:04:27.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.394+0000 7f098e619740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a433f0 0x556540a4ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.394+0000 7f098e619740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a43d10 0x556540a4d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.394+0000 7f098e619740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a4fca0 0x556540a4d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.394+0000 7f098e619740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55654094c780 con 0x556540a433f0 2024-08-20T05:04:27.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.394+0000 7f098e619740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5565409aad00 con 0x556540a4fca0 2024-08-20T05:04:27.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.394+0000 7f098e619740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5565408097a0 con 0x556540a43d10 2024-08-20T05:04:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.394+0000 7f098e619740 10 client.0 _ll_register_callbacks cb 0x556540954940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.394+0000 7f0983e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a43d10 0x556540a4d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.394+0000 7f0983e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a43d10 0x556540a4d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36622/0 (socket says 172.21.15.37:36622) 2024-08-20T05:04:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.394+0000 7f0983e00640 1 -- 172.21.15.37:0/3758283512 learned_addr learned my addr 172.21.15.37:0/3758283512 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.395+0000 7f0989c00640 1 --2- 172.21.15.37:0/3758283512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a4fca0 0x556540a4d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.395+0000 7f0983e00640 1 -- 172.21.15.37:0/3758283512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a4fca0 msgr2=0x556540a4d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.395+0000 7f0983e00640 1 --2- 172.21.15.37:0/3758283512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a4fca0 0x556540a4d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.395+0000 7f0983e00640 1 -- 172.21.15.37:0/3758283512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a433f0 msgr2=0x556540a4ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.395+0000 7f0983e00640 1 --2- 172.21.15.37:0/3758283512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a433f0 0x556540a4ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.395+0000 7f0983e00640 1 -- 172.21.15.37:0/3758283512 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565409599c0 con 0x556540a43d10 2024-08-20T05:04:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.395+0000 7f0989c00640 1 --2- 172.21.15.37:0/3758283512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a4fca0 0x556540a4d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:04:27.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.395+0000 7f0983e00640 1 --2- 172.21.15.37:0/3758283512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a43d10 0x556540a4d200 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f09700c7dd0 tx=0x7f09700caa30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8392ad8e97386932 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:27.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.395+0000 7f096aa00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:04:27.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.395+0000 7f096aa00640 1 -- 172.21.15.37:0/3758283512 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09700054d0 con 0x556540a43d10 2024-08-20T05:04:27.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.395+0000 7f096aa00640 1 -- 172.21.15.37:0/3758283512 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0970101bd0 con 0x556540a43d10 2024-08-20T05:04:27.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.396+0000 7f098e619740 1 -- 172.21.15.37:0/3758283512 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f097c003d10 con 0x556540a43d10 2024-08-20T05:04:27.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.396+0000 7f096aa00640 1 -- 172.21.15.37:0/3758283512 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f09700d3e60 con 0x556540a43d10 2024-08-20T05:04:27.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.396+0000 7f098e619740 10 client.26119 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:27.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.396+0000 7f098e619740 1 -- 172.21.15.37:0/3758283512 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556540715b90 con 0x556540a43d10 2024-08-20T05:04:27.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.396+0000 7f096aa00640 1 -- 172.21.15.37:0/3758283512 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f097c003d10 con 0x556540a43d10 2024-08-20T05:04:27.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.397+0000 7f096aa00640 1 -- 172.21.15.37:0/3758283512 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f0970047030 con 0x556540a43d10 2024-08-20T05:04:27.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.397+0000 7f098e619740 10 client.26119 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:27.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.397+0000 7f098e619740 10 client.26119 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:04:27.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.397+0000 7f098e619740 20 client.26119 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:27.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.397+0000 7f098e619740 1 --2- 172.21.15.37:0/3758283512 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556540a707a0 0x556540a72c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.397+0000 7f098e619740 4 client.26119 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:04:27.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.397+0000 7f098e619740 1 -- 172.21.15.37:0/3758283512 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565409b9710 con 0x556540a707a0 2024-08-20T05:04:27.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.397+0000 7f0989200640 1 --2- 172.21.15.37:0/3758283512 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556540a707a0 0x556540a72c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:27.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.398+0000 7f0989200640 1 --2- 172.21.15.37:0/3758283512 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556540a707a0 0x556540a72c40 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73d380ab35fcb321 server_cookie=d8493af6fe5adebe in_seq=0 out_seq=0 2024-08-20T05:04:27.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.398+0000 7f096aa00640 10 client.26119 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:27.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.399+0000 7f096aa00640 1 -- 172.21.15.37:0/3758283512 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5565409b9710 con 0x556540a707a0 2024-08-20T05:04:27.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.399+0000 7f096aa00640 10 client.26119 handle_command_reply: tid=0 2024-08-20T05:04:27.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.399+0000 7f098e619740 1 client.26119 shutdown 2024-08-20T05:04:27.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.399+0000 7f098e619740 1 -- 172.21.15.37:0/3758283512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a43d10 msgr2=0x556540a4d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:27.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.399+0000 7f098e619740 1 --2- 172.21.15.37:0/3758283512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a43d10 0x556540a4d200 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f09700c7dd0 tx=0x7f09700caa30 comp rx=0 tx=0).stop 2024-08-20T05:04:27.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.399+0000 7f098e619740 1 -- 172.21.15.37:0/3758283512 shutdown_connections 2024-08-20T05:04:27.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.399+0000 7f098e619740 1 --2- 172.21.15.37:0/3758283512 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556540a707a0 0x556540a72c40 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.399+0000 7f098e619740 1 --2- 172.21.15.37:0/3758283512 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a4fca0 0x556540a4d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.399+0000 7f098e619740 1 --2- 172.21.15.37:0/3758283512 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a43d10 0x556540a4d200 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.399+0000 7f098e619740 1 --2- 172.21.15.37:0/3758283512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a433f0 0x556540a4ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.399+0000 7f098e619740 1 -- 172.21.15.37:0/3758283512 >> 172.21.15.37:0/3758283512 conn(0x556540a41220 msgr2=0x556540a46d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:27.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.399+0000 7f096aa00640 0 client.26119 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:27.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.400+0000 7f098e619740 1 -- 172.21.15.37:0/3758283512 shutdown_connections 2024-08-20T05:04:27.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.400+0000 7f098e619740 1 -- 172.21.15.37:0/3758283512 wait complete. 2024-08-20T05:04:27.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.400+0000 7f098e619740 20 client.26119 trim_cache size 0 max 16384 2024-08-20T05:04:27.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.426+0000 7f098e619740 1 Processor -- start 2024-08-20T05:04:27.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.426+0000 7f098e619740 1 -- start start 2024-08-20T05:04:27.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.427+0000 7f098e619740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a433f0 0x556540a78510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.427+0000 7f098e619740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a4fca0 0x556540a78a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.427+0000 7f098e619740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a49ed0 0x556540a4a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.427+0000 7f098e619740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f09841ad430 con 0x556540a433f0 2024-08-20T05:04:27.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.427+0000 7f098e619740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f09841af030 con 0x556540a4fca0 2024-08-20T05:04:27.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.427+0000 7f098e619740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f09841adb00 con 0x556540a49ed0 2024-08-20T05:04:27.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.429+0000 7f0989c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a49ed0 0x556540a4a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:27.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.429+0000 7f0989200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a433f0 0x556540a78510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:27.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.429+0000 7f0989200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a433f0 0x556540a78510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56952/0 (socket says 172.21.15.37:56952) 2024-08-20T05:04:27.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.429+0000 7f0989200640 1 -- 172.21.15.37:0/3593561530 learned_addr learned my addr 172.21.15.37:0/3593561530 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:27.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.432+0000 7f0989c00640 1 -- 172.21.15.37:0/3593561530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a4fca0 msgr2=0x556540a78a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:27.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.432+0000 7f0989c00640 1 --2- 172.21.15.37:0/3593561530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a4fca0 0x556540a78a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.432+0000 7f0989c00640 1 -- 172.21.15.37:0/3593561530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a433f0 msgr2=0x556540a78510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:27.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.432+0000 7f0989c00640 1 --2- 172.21.15.37:0/3593561530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a433f0 0x556540a78510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.432+0000 7f0989c00640 1 -- 172.21.15.37:0/3593561530 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556540a43b40 con 0x556540a49ed0 2024-08-20T05:04:27.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.436+0000 7f0989c00640 1 --2- 172.21.15.37:0/3593561530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a49ed0 0x556540a4a330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f097c006010 tx=0x7f097c009940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b9805f544ffbe04 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:27.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.437+0000 7f0975600640 1 -- 172.21.15.37:0/3593561530 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c029070 con 0x556540a49ed0 2024-08-20T05:04:27.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.439+0000 7f0975600640 1 -- 172.21.15.37:0/3593561530 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f097c003e20 con 0x556540a49ed0 2024-08-20T05:04:27.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.439+0000 7f0975600640 1 -- 172.21.15.37:0/3593561530 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c011440 con 0x556540a49ed0 2024-08-20T05:04:27.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.440+0000 7f098e619740 1 -- 172.21.15.37:0/3593561530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a49ed0 msgr2=0x556540a4a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:27.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.440+0000 7f098e619740 1 --2- 172.21.15.37:0/3593561530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a49ed0 0x556540a4a330 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f097c006010 tx=0x7f097c009940 comp rx=0 tx=0).stop 2024-08-20T05:04:27.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.440+0000 7f098e619740 1 -- 172.21.15.37:0/3593561530 shutdown_connections 2024-08-20T05:04:27.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.440+0000 7f098e619740 1 --2- 172.21.15.37:0/3593561530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a49ed0 0x556540a4a330 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.440+0000 7f098e619740 1 --2- 172.21.15.37:0/3593561530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a4fca0 0x556540a78a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.440+0000 7f098e619740 1 --2- 172.21.15.37:0/3593561530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a433f0 0x556540a78510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.440+0000 7f098e619740 1 -- 172.21.15.37:0/3593561530 >> 172.21.15.37:0/3593561530 conn(0x556540a41220 msgr2=0x556540a4eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.441+0000 7f098e619740 1 -- 172.21.15.37:0/3593561530 shutdown_connections 2024-08-20T05:04:27.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.441+0000 7f098e619740 1 -- 172.21.15.37:0/3593561530 wait complete. 2024-08-20T05:04:27.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.442+0000 7f098e619740 1 -- start start 2024-08-20T05:04:27.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.442+0000 7f098e619740 1 Processor -- start 2024-08-20T05:04:27.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.444+0000 7f098e619740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a433f0 0x556540a68cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.444+0000 7f098e619740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a49ed0 0x556540a69230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.444+0000 7f098e619740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a4fca0 0x556540a65ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.444+0000 7f098e619740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f09841ae8a0 con 0x556540a433f0 2024-08-20T05:04:27.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.444+0000 7f098e619740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f09841ae1d0 con 0x556540a49ed0 2024-08-20T05:04:27.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.444+0000 7f098e619740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f098419e4e0 con 0x556540a4fca0 2024-08-20T05:04:27.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.444+0000 7f098e619740 10 client.0 _ll_register_callbacks cb 0x7f097000d5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:27.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.445+0000 7f0989c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a4fca0 0x556540a65ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:27.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.445+0000 7f0989c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a4fca0 0x556540a65ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36636/0 (socket says 172.21.15.37:36636) 2024-08-20T05:04:27.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.445+0000 7f0989c00640 1 -- 172.21.15.37:0/2940434971 learned_addr learned my addr 172.21.15.37:0/2940434971 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:27.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.445+0000 7f0983e00640 1 --2- 172.21.15.37:0/2940434971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a49ed0 0x556540a69230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:27.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.447+0000 7f0989200640 1 --2- 172.21.15.37:0/2940434971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a433f0 0x556540a68cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.448+0000 7f0989c00640 1 -- 172.21.15.37:0/2940434971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a49ed0 msgr2=0x556540a69230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.448+0000 7f0989c00640 1 --2- 172.21.15.37:0/2940434971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a49ed0 0x556540a69230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.448+0000 7f0989c00640 1 -- 172.21.15.37:0/2940434971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a433f0 msgr2=0x556540a68cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.448+0000 7f0989c00640 1 --2- 172.21.15.37:0/2940434971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a433f0 0x556540a68cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.448+0000 7f0989c00640 1 -- 172.21.15.37:0/2940434971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556540a66220 con 0x556540a4fca0 2024-08-20T05:04:27.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.448+0000 7f0989200640 1 --2- 172.21.15.37:0/2940434971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a433f0 0x556540a68cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:04:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.448+0000 7f0989c00640 1 --2- 172.21.15.37:0/2940434971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a4fca0 0x556540a65ae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f097c005a40 tx=0x7f097c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db49557de9f8326 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.448+0000 7f096aa00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:04:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.449+0000 7f096aa00640 1 -- 172.21.15.37:0/2940434971 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c029040 con 0x556540a4fca0 2024-08-20T05:04:27.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.449+0000 7f096aa00640 1 -- 172.21.15.37:0/2940434971 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f097c0039f0 con 0x556540a4fca0 2024-08-20T05:04:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.449+0000 7f098e619740 1 -- 172.21.15.37:0/2940434971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f097c003e20 con 0x556540a4fca0 2024-08-20T05:04:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.449+0000 7f096aa00640 1 -- 172.21.15.37:0/2940434971 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f097c003bf0 con 0x556540a4fca0 2024-08-20T05:04:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.450+0000 7f098e619740 10 client.26125 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:27.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.450+0000 7f098e619740 1 -- 172.21.15.37:0/2940434971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556540adbf10 con 0x556540a4fca0 2024-08-20T05:04:27.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.450+0000 7f096aa00640 1 -- 172.21.15.37:0/2940434971 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f097c003e20 con 0x556540a4fca0 2024-08-20T05:04:27.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.450+0000 7f096aa00640 1 -- 172.21.15.37:0/2940434971 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f097c011af0 con 0x556540a4fca0 2024-08-20T05:04:27.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.450+0000 7f098e619740 10 client.26125 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:27.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.450+0000 7f098e619740 10 client.26125 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:04:27.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.450+0000 7f098e619740 20 client.26125 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:27.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.450+0000 7f098e619740 1 --2- 172.21.15.37:0/2940434971 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556540adc500 0x556540ade920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:27.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.450+0000 7f098e619740 4 client.26125 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.2, "await_for": 45.0}] 2024-08-20T05:04:27.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.450+0000 7f098e619740 1 -- 172.21.15.37:0/2940434971 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.2, "await_for": 45.0}) -- 0x5565409b51b0 con 0x556540adc500 2024-08-20T05:04:27.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.452+0000 7f0989200640 1 --2- 172.21.15.37:0/2940434971 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556540adc500 0x556540ade920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:27.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.453+0000 7f0989200640 1 --2- 172.21.15.37:0/2940434971 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556540adc500 0x556540ade920 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9a72680b308f682 server_cookie=97459898d736cdf0 in_seq=0 out_seq=0 2024-08-20T05:04:27.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.453+0000 7f096aa00640 10 client.26125 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.583+0000 7f096aa00640 1 -- 172.21.15.37:0/2940434971 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5565409b51b0 con 0x556540adc500 2024-08-20T05:04:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.583+0000 7f096aa00640 10 client.26125 handle_command_reply: tid=0 2024-08-20T05:04:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.584+0000 7f098e619740 1 client.26125 shutdown 2024-08-20T05:04:27.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:27 smithi037 ceph-mon[17265]: pgmap v467: 129 pgs: 129 active+clean; 1000 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.4 MiB/s wr, 750 op/s 2024-08-20T05:04:27.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:04:27.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:04:27.586 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:04:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.584+0000 7f098e619740 1 -- 172.21.15.37:0/2940434971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a4fca0 msgr2=0x556540a65ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.584+0000 7f098e619740 1 --2- 172.21.15.37:0/2940434971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a4fca0 0x556540a65ae0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f097c005a40 tx=0x7f097c009bd0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.584+0000 7f098e619740 1 -- 172.21.15.37:0/2940434971 shutdown_connections 2024-08-20T05:04:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.584+0000 7f098e619740 1 --2- 172.21.15.37:0/2940434971 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556540adc500 0x556540ade920 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.584+0000 7f098e619740 1 --2- 172.21.15.37:0/2940434971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556540a4fca0 0x556540a65ae0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.584+0000 7f098e619740 1 --2- 172.21.15.37:0/2940434971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556540a49ed0 0x556540a69230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.584+0000 7f098e619740 1 --2- 172.21.15.37:0/2940434971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556540a433f0 0x556540a68cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.584+0000 7f096aa00640 0 client.26125 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.584+0000 7f098e619740 1 -- 172.21.15.37:0/2940434971 >> 172.21.15.37:0/2940434971 conn(0x556540a41220 msgr2=0x556540a4eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.584+0000 7f098e619740 1 -- 172.21.15.37:0/2940434971 shutdown_connections 2024-08-20T05:04:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.584+0000 7f098e619740 1 -- 172.21.15.37:0/2940434971 wait complete. 2024-08-20T05:04:27.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.584+0000 7f098e619740 20 client.26125 trim_cache size 0 max 16384 2024-08-20T05:04:27.588 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:04:27.588 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-08-20T05:04:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:04:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 10, 2024-08-20T05:04:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:04:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "b90570f6": { 2024-08-20T05:04:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 10, 2024-08-20T05:04:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:04:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:04:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:04:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:04:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:04:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:04:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 130.2, 2024-08-20T05:04:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:04:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:04:27.589 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:04:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:04:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:04:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:04:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:04:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:04:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:04:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:04:27.590 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:04:27.590 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:04:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.585+0000 7f098bc00640 1 -- 172.21.15.37:0/63981847 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f096c0b3d20 msgr2=0x7f096c0b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.585+0000 7f098bc00640 1 --2- 172.21.15.37:0/63981847 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f096c0b3d20 0x7f096c0b61e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x556540a42100 tx=0x7f097800b480 comp rx=0 tx=0).stop 2024-08-20T05:04:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.585+0000 7f098bc00640 1 -- 172.21.15.37:0/63981847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09841084c0 msgr2=0x7f098419faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.585+0000 7f098bc00640 1 --2- 172.21.15.37:0/63981847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09841084c0 0x7f098419faa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0970006010 tx=0x7f0970004e20 comp rx=0 tx=0).stop 2024-08-20T05:04:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.585+0000 7f098bc00640 1 -- 172.21.15.37:0/63981847 shutdown_connections 2024-08-20T05:04:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.585+0000 7f098bc00640 1 --2- 172.21.15.37:0/63981847 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f096c0b3d20 0x7f096c0b61e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.585+0000 7f098bc00640 1 --2- 172.21.15.37:0/63981847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0984108e40 0x7f09841a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.585+0000 7f098bc00640 1 --2- 172.21.15.37:0/63981847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f09841084c0 0x7f098419faa0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.585+0000 7f098bc00640 1 --2- 172.21.15.37:0/63981847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0984102ab0 0x7f098419f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.585+0000 7f098bc00640 1 -- 172.21.15.37:0/63981847 >> 172.21.15.37:0/63981847 conn(0x7f09840fe500 msgr2=0x7f09841008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.586+0000 7f098bc00640 1 -- 172.21.15.37:0/63981847 shutdown_connections 2024-08-20T05:04:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:27.586+0000 7f098bc00640 1 -- 172.21.15.37:0/63981847 wait complete. 2024-08-20T05:04:27.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:27 smithi135 ceph-mon[22342]: pgmap v467: 129 pgs: 129 active+clean; 1000 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.4 MiB/s wr, 750 op/s 2024-08-20T05:04:27.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:04:27.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:04:27.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:04:27.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:27 smithi130 ceph-mon[22007]: pgmap v467: 129 pgs: 129 active+clean; 1000 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.4 MiB/s wr, 750 op/s 2024-08-20T05:04:27.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:04:27.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:04:27.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:04:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 90.0 s, 681.5 tps, lat 131.016 ms stddev 287.524 2024-08-20T05:04:29.026 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b90570f6', quiesce took 12.6 seconds. Will release after: -2.4000000000000004 2024-08-20T05:04:29.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:04:29.416 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:04:29.613 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:29 smithi037 ceph-mon[17265]: pgmap v468: 129 pgs: 129 active+clean; 1000 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 11 MiB/s wr, 816 op/s 2024-08-20T05:04:29.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:29 smithi135 ceph-mon[22342]: pgmap v468: 129 pgs: 129 active+clean; 1000 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 11 MiB/s wr, 816 op/s 2024-08-20T05:04:29.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:29 smithi130 ceph-mon[22007]: pgmap v468: 129 pgs: 129 active+clean; 1000 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 11 MiB/s wr, 816 op/s 2024-08-20T05:04:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.014+0000 7fdb25200640 1 -- 172.21.15.37:0/948885773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb20113810 msgr2=0x7fdb20115c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.014+0000 7fdb25200640 1 --2- 172.21.15.37:0/948885773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb20113810 0x7fdb20115c00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009ca0 tx=0x7fdb1802a8c0 comp rx=0 tx=0).stop 2024-08-20T05:04:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.014+0000 7fdb25200640 1 -- 172.21.15.37:0/948885773 shutdown_connections 2024-08-20T05:04:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.014+0000 7fdb25200640 1 --2- 172.21.15.37:0/948885773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb20113810 0x7fdb20115c00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.014+0000 7fdb25200640 1 --2- 172.21.15.37:0/948885773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb20075b90 0x7fdb201132d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.014+0000 7fdb25200640 1 --2- 172.21.15.37:0/948885773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb20075270 0x7fdb20075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.014+0000 7fdb25200640 1 -- 172.21.15.37:0/948885773 >> 172.21.15.37:0/948885773 conn(0x7fdb200fe500 msgr2=0x7fdb20100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:30.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.014+0000 7fdb25200640 1 -- 172.21.15.37:0/948885773 shutdown_connections 2024-08-20T05:04:30.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.014+0000 7fdb25200640 1 -- 172.21.15.37:0/948885773 wait complete. 2024-08-20T05:04:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.015+0000 7fdb25200640 1 Processor -- start 2024-08-20T05:04:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.015+0000 7fdb25200640 1 -- start start 2024-08-20T05:04:30.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.015+0000 7fdb25200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb20075270 0x7fdb2019f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.015+0000 7fdb25200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb20075b90 0x7fdb2019fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.016+0000 7fdb25200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb20113810 0x7fdb201a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.016+0000 7fdb25200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdb201190c0 con 0x7fdb20075b90 2024-08-20T05:04:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.016+0000 7fdb25200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdb20118f40 con 0x7fdb20113810 2024-08-20T05:04:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.016+0000 7fdb25200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdb20119240 con 0x7fdb20075270 2024-08-20T05:04:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.016+0000 7fdb15400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb20075b90 0x7fdb2019fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.016+0000 7fdb1de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb20075270 0x7fdb2019f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.016+0000 7fdb15400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb20075b90 0x7fdb2019fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56970/0 (socket says 172.21.15.37:56970) 2024-08-20T05:04:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.016+0000 7fdb15400640 1 -- 172.21.15.37:0/1552067002 learned_addr learned my addr 172.21.15.37:0/1552067002 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.016+0000 7fdb1e800640 1 --2- 172.21.15.37:0/1552067002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb20113810 0x7fdb201a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.016+0000 7fdb1de00640 1 -- 172.21.15.37:0/1552067002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb20113810 msgr2=0x7fdb201a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.016+0000 7fdb1de00640 1 --2- 172.21.15.37:0/1552067002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb20113810 0x7fdb201a4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:30.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.016+0000 7fdb1de00640 1 -- 172.21.15.37:0/1552067002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb20075b90 msgr2=0x7fdb2019fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.016+0000 7fdb1de00640 1 --2- 172.21.15.37:0/1552067002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb20075b90 0x7fdb2019fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.016+0000 7fdb1de00640 1 -- 172.21.15.37:0/1552067002 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb201a5620 con 0x7fdb20075270 2024-08-20T05:04:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.016+0000 7fdb1e800640 1 --2- 172.21.15.37:0/1552067002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb20113810 0x7fdb201a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:04:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.016+0000 7fdb15400640 1 --2- 172.21.15.37:0/1552067002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb20075b90 0x7fdb2019fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:04:30.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.017+0000 7fdb1de00640 1 --2- 172.21.15.37:0/1552067002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb20075270 0x7fdb2019f570 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000e9f0 tx=0x7fdb1000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.017+0000 7fdb17400640 1 -- 172.21.15.37:0/1552067002 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1000ccc0 con 0x7fdb20075270 2024-08-20T05:04:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.017+0000 7fdb25200640 1 -- 172.21.15.37:0/1552067002 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb201a5910 con 0x7fdb20075270 2024-08-20T05:04:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.017+0000 7fdb17400640 1 -- 172.21.15.37:0/1552067002 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb100108e0 con 0x7fdb20075270 2024-08-20T05:04:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.017+0000 7fdb17400640 1 -- 172.21.15.37:0/1552067002 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb10018880 con 0x7fdb20075270 2024-08-20T05:04:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.017+0000 7fdb25200640 1 -- 172.21.15.37:0/1552067002 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb201ac1a0 con 0x7fdb20075270 2024-08-20T05:04:30.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.018+0000 7fdb25200640 1 -- 172.21.15.37:0/1552067002 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb20076780 con 0x7fdb20075270 2024-08-20T05:04:30.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.021+0000 7fdb17400640 1 -- 172.21.15.37:0/1552067002 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdb10010430 con 0x7fdb20075270 2024-08-20T05:04:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.022+0000 7fdb17400640 1 --2- 172.21.15.37:0/1552067002 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdb040b3c50 0x7fdb040b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.022+0000 7fdb17400640 1 -- 172.21.15.37:0/1552067002 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fdb100e4800 con 0x7fdb20075270 2024-08-20T05:04:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.022+0000 7fdb15400640 1 --2- 172.21.15.37:0/1552067002 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdb040b3c50 0x7fdb040b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:30.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.023+0000 7fdb15400640 1 --2- 172.21.15.37:0/1552067002 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdb040b3c50 0x7fdb040b6110 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdb20115de0 tx=0x7fdb08005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:30.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.024+0000 7fdb17400640 1 -- 172.21.15.37:0/1552067002 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fdb100aba50 con 0x7fdb20075270 2024-08-20T05:04:30.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.260+0000 7fdb25200640 1 -- 172.21.15.37:0/1552067002 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb201ac420 con 0x7fdb20075270 2024-08-20T05:04:30.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.261+0000 7fdb17400640 1 -- 172.21.15.37:0/1552067002 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11987 (secure 0 0 0) 0x7fdb100ab350 con 0x7fdb20075270 2024-08-20T05:04:30.264 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:04:30.264 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":33,"btime":"2024-08-20T05:03:11:706710+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:03:11.271814+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:04:30.264 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 33 2024-08-20T05:04:30.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.264+0000 7fdb25200640 1 -- 172.21.15.37:0/1552067002 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdb040b3c50 msgr2=0x7fdb040b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:30.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.264+0000 7fdb25200640 1 --2- 172.21.15.37:0/1552067002 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdb040b3c50 0x7fdb040b6110 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdb20115de0 tx=0x7fdb08005f90 comp rx=0 tx=0).stop 2024-08-20T05:04:30.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.264+0000 7fdb25200640 1 -- 172.21.15.37:0/1552067002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb20075270 msgr2=0x7fdb2019f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:30.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.264+0000 7fdb25200640 1 --2- 172.21.15.37:0/1552067002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb20075270 0x7fdb2019f570 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000e9f0 tx=0x7fdb1000eeb0 comp rx=0 tx=0).stop 2024-08-20T05:04:30.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.264+0000 7fdb25200640 1 -- 172.21.15.37:0/1552067002 shutdown_connections 2024-08-20T05:04:30.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.264+0000 7fdb25200640 1 --2- 172.21.15.37:0/1552067002 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdb040b3c50 0x7fdb040b6110 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:30.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.264+0000 7fdb25200640 1 --2- 172.21.15.37:0/1552067002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdb20113810 0x7fdb201a4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:30.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.264+0000 7fdb25200640 1 --2- 172.21.15.37:0/1552067002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb20075b90 0x7fdb2019fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:30.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.264+0000 7fdb25200640 1 --2- 172.21.15.37:0/1552067002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdb20075270 0x7fdb2019f570 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:30.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.264+0000 7fdb25200640 1 -- 172.21.15.37:0/1552067002 >> 172.21.15.37:0/1552067002 conn(0x7fdb200fe500 msgr2=0x7fdb200ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:30.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.264+0000 7fdb25200640 1 -- 172.21.15.37:0/1552067002 shutdown_connections 2024-08-20T05:04:30.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:30.264+0000 7fdb25200640 1 -- 172.21.15.37:0/1552067002 wait complete. 2024-08-20T05:04:30.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:30 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1552067002' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:04:30.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:30 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1552067002' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:04:30.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:30 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1552067002' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:04:31.151 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id b90570f6 --release --await' 2024-08-20T05:04:31.151 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id b90570f6 --release --await 2024-08-20T05:04:31.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:31 smithi037 ceph-mon[17265]: pgmap v469: 129 pgs: 129 active+clean; 1002 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 16 MiB/s wr, 988 op/s 2024-08-20T05:04:31.532 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:04:31.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:31 smithi135 ceph-mon[22342]: pgmap v469: 129 pgs: 129 active+clean; 1002 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 16 MiB/s wr, 988 op/s 2024-08-20T05:04:31.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:31 smithi130 ceph-mon[22007]: pgmap v469: 129 pgs: 129 active+clean; 1002 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 16 MiB/s wr, 988 op/s 2024-08-20T05:04:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.137+0000 7f3bdea00640 1 -- 172.21.15.37:0/747914225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bd810b030 msgr2=0x7f3bd8111830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.137+0000 7f3bdea00640 1 --2- 172.21.15.37:0/747914225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bd810b030 0x7f3bd8111830 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f3bd0009900 tx=0x7f3bd002a3f0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.137+0000 7f3bdea00640 1 -- 172.21.15.37:0/747914225 shutdown_connections 2024-08-20T05:04:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.137+0000 7f3bdea00640 1 --2- 172.21.15.37:0/747914225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bd810b030 0x7f3bd8111830 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.137+0000 7f3bdea00640 1 --2- 172.21.15.37:0/747914225 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bd810a6b0 0x7f3bd810aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.137+0000 7f3bdea00640 1 --2- 172.21.15.37:0/747914225 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bd8104ca0 0x7f3bd8105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.137+0000 7f3bdea00640 1 -- 172.21.15.37:0/747914225 >> 172.21.15.37:0/747914225 conn(0x7f3bd8100730 msgr2=0x7f3bd8102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.137+0000 7f3bdea00640 1 -- 172.21.15.37:0/747914225 shutdown_connections 2024-08-20T05:04:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.137+0000 7f3bdea00640 1 -- 172.21.15.37:0/747914225 wait complete. 2024-08-20T05:04:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.138+0000 7f3bdea00640 1 Processor -- start 2024-08-20T05:04:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.138+0000 7f3bdea00640 1 -- start start 2024-08-20T05:04:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.139+0000 7f3bdea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bd8104ca0 0x7f3bd819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.139+0000 7f3bdea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bd810a6b0 0x7f3bd819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.139+0000 7f3bdea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bd810b030 0x7f3bd81a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.139+0000 7f3bdea00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd8114d40 con 0x7f3bd810a6b0 2024-08-20T05:04:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.139+0000 7f3bdea00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd8114bc0 con 0x7f3bd810b030 2024-08-20T05:04:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.139+0000 7f3bdea00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd8114ec0 con 0x7f3bd8104ca0 2024-08-20T05:04:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.139+0000 7f3bcf400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bd810a6b0 0x7f3bd819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.139+0000 7f3bd7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bd8104ca0 0x7f3bd819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.139+0000 7f3bd7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bd8104ca0 0x7f3bd819b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36670/0 (socket says 172.21.15.37:36670) 2024-08-20T05:04:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.139+0000 7f3bd7e00640 1 -- 172.21.15.37:0/3005017586 learned_addr learned my addr 172.21.15.37:0/3005017586 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.139+0000 7f3bdca00640 1 --2- 172.21.15.37:0/3005017586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bd810b030 0x7f3bd81a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.139+0000 7f3bd7e00640 1 -- 172.21.15.37:0/3005017586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bd810b030 msgr2=0x7f3bd81a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.139+0000 7f3bd7e00640 1 --2- 172.21.15.37:0/3005017586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bd810b030 0x7f3bd81a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.139+0000 7f3bd7e00640 1 -- 172.21.15.37:0/3005017586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bd810a6b0 msgr2=0x7f3bd819b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.139+0000 7f3bd7e00640 1 --2- 172.21.15.37:0/3005017586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bd810a6b0 0x7f3bd819b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.139+0000 7f3bd7e00640 1 -- 172.21.15.37:0/3005017586 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd81a1220 con 0x7f3bd8104ca0 2024-08-20T05:04:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.140+0000 7f3bd7e00640 1 --2- 172.21.15.37:0/3005017586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bd8104ca0 0x7f3bd819b170 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800db80 tx=0x7f3bc800b630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.140+0000 7f3bd5600640 1 -- 172.21.15.37:0/3005017586 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8017070 con 0x7f3bd8104ca0 2024-08-20T05:04:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.140+0000 7f3bdea00640 1 -- 172.21.15.37:0/3005017586 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd81a1510 con 0x7f3bd8104ca0 2024-08-20T05:04:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.140+0000 7f3bd5600640 1 -- 172.21.15.37:0/3005017586 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bc8003b70 con 0x7f3bd8104ca0 2024-08-20T05:04:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.140+0000 7f3bd5600640 1 -- 172.21.15.37:0/3005017586 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80106c0 con 0x7f3bd8104ca0 2024-08-20T05:04:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.140+0000 7f3bdea00640 1 -- 172.21.15.37:0/3005017586 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd81a7da0 con 0x7f3bd8104ca0 2024-08-20T05:04:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.143+0000 7f3be1667740 1 Processor -- start 2024-08-20T05:04:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.143+0000 7f3be1667740 1 -- start start 2024-08-20T05:04:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.143+0000 7f3be1667740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01acf0 0x561f3f01b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.143+0000 7f3be1667740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f01b610 0x561f3f027060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.143+0000 7f3be1667740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f0275a0 0x561f3f029990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.143+0000 7f3be1667740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f3efbc670 con 0x561f3f01b610 2024-08-20T05:04:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.143+0000 7f3be1667740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561f3ef90d70 con 0x561f3f01acf0 2024-08-20T05:04:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.143+0000 7f3be1667740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561f3ef80270 con 0x561f3f0275a0 2024-08-20T05:04:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.144+0000 7f3bcf400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f0275a0 0x561f3f029990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.144+0000 7f3bcf400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f0275a0 0x561f3f029990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36680/0 (socket says 172.21.15.37:36680) 2024-08-20T05:04:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.144+0000 7f3bcf400640 1 -- 172.21.15.37:0/3537370394 learned_addr learned my addr 172.21.15.37:0/3537370394 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.144+0000 7f3bdca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01acf0 0x561f3f01b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.144+0000 7f3bd5600640 1 -- 172.21.15.37:0/3005017586 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3bc8004020 con 0x7f3bd8104ca0 2024-08-20T05:04:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.144+0000 7f3bdca00640 1 -- 172.21.15.37:0/3537370394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f0275a0 msgr2=0x561f3f029990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.144+0000 7f3bdca00640 1 --2- 172.21.15.37:0/3537370394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f0275a0 0x561f3f029990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.144+0000 7f3bdca00640 1 -- 172.21.15.37:0/3537370394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f01b610 msgr2=0x561f3f027060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.144+0000 7f3bdca00640 1 --2- 172.21.15.37:0/3537370394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f01b610 0x561f3f027060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.144+0000 7f3bdca00640 1 -- 172.21.15.37:0/3537370394 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f3ef1c870 con 0x561f3f01acf0 2024-08-20T05:04:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.144+0000 7f3bdca00640 1 --2- 172.21.15.37:0/3537370394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01acf0 0x561f3f01b0d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3bd002a910 tx=0x7f3bd0004130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b732707dc42be1f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.145+0000 7f3bcd200640 1 -- 172.21.15.37:0/3537370394 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0040070 con 0x561f3f01acf0 2024-08-20T05:04:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.145+0000 7f3bcd200640 1 -- 172.21.15.37:0/3537370394 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bd00054d0 con 0x561f3f01acf0 2024-08-20T05:04:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.145+0000 7f3bcd200640 1 -- 172.21.15.37:0/3537370394 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0035040 con 0x561f3f01acf0 2024-08-20T05:04:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.146+0000 7f3be1667740 1 -- 172.21.15.37:0/3537370394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01acf0 msgr2=0x561f3f01b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.146+0000 7f3be1667740 1 --2- 172.21.15.37:0/3537370394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01acf0 0x561f3f01b0d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3bd002a910 tx=0x7f3bd0004130 comp rx=0 tx=0).stop 2024-08-20T05:04:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.146+0000 7f3be1667740 1 -- 172.21.15.37:0/3537370394 shutdown_connections 2024-08-20T05:04:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.146+0000 7f3be1667740 1 --2- 172.21.15.37:0/3537370394 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f0275a0 0x561f3f029990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.146+0000 7f3be1667740 1 --2- 172.21.15.37:0/3537370394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f01b610 0x561f3f027060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.146+0000 7f3be1667740 1 --2- 172.21.15.37:0/3537370394 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01acf0 0x561f3f01b0d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.146+0000 7f3be1667740 1 -- 172.21.15.37:0/3537370394 >> 172.21.15.37:0/3537370394 conn(0x561f3f018b20 msgr2=0x561f3f019cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.146+0000 7f3be1667740 1 -- 172.21.15.37:0/3537370394 shutdown_connections 2024-08-20T05:04:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.146+0000 7f3be1667740 1 -- 172.21.15.37:0/3537370394 wait complete. 2024-08-20T05:04:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.146+0000 7f3bd5600640 1 --2- 172.21.15.37:0/3005017586 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3bbc0b3b60 0x7f3bbc0b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.146+0000 7f3be1667740 1 -- start start 2024-08-20T05:04:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.146+0000 7f3bd5600640 1 -- 172.21.15.37:0/3005017586 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3bc80e3fc0 con 0x7f3bd8104ca0 2024-08-20T05:04:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.146+0000 7f3bcf400640 1 --2- 172.21.15.37:0/3005017586 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3bbc0b3b60 0x7f3bbc0b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.147+0000 7f3be1667740 1 Processor -- start 2024-08-20T05:04:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.147+0000 7f3bcf400640 1 --2- 172.21.15.37:0/3005017586 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3bbc0b3b60 0x7f3bbc0b6020 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009cc0 tx=0x7f3bc0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:32.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.147+0000 7f3be1667740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f01acf0 0x561f3f026e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.147+0000 7f3be1667740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f01b610 0x561f3f0242a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.147+0000 7f3be1667740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f0275a0 0x561f3f024860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.147+0000 7f3be1667740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f3ef06ff0 con 0x561f3f01b610 2024-08-20T05:04:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.147+0000 7f3be1667740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561f3ef842b0 con 0x561f3f0275a0 2024-08-20T05:04:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.147+0000 7f3be1667740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561f3ede2bb0 con 0x561f3f01acf0 2024-08-20T05:04:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.147+0000 7f3be1667740 10 client.0 _ll_register_callbacks cb 0x561f3ec8bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.148+0000 7f3bd7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f01acf0 0x561f3f026e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.148+0000 7f3bd7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f01acf0 0x561f3f026e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36688/0 (socket says 172.21.15.37:36688) 2024-08-20T05:04:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.148+0000 7f3bd7e00640 1 -- 172.21.15.37:0/2607641646 learned_addr learned my addr 172.21.15.37:0/2607641646 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.148+0000 7f3bcf400640 1 --2- 172.21.15.37:0/2607641646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f01b610 0x561f3f0242a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.148+0000 7f3bdca00640 1 --2- 172.21.15.37:0/2607641646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f0275a0 0x561f3f024860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.148+0000 7f3bd7e00640 1 -- 172.21.15.37:0/2607641646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f0275a0 msgr2=0x561f3f024860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:32.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.148+0000 7f3bd7e00640 1 --2- 172.21.15.37:0/2607641646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f0275a0 0x561f3f024860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.148+0000 7f3bd7e00640 1 -- 172.21.15.37:0/2607641646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f01b610 msgr2=0x561f3f0242a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.148+0000 7f3bd7e00640 1 --2- 172.21.15.37:0/2607641646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f01b610 0x561f3f0242a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.148+0000 7f3bd7e00640 1 -- 172.21.15.37:0/2607641646 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f3ecdfb00 con 0x561f3f01acf0 2024-08-20T05:04:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.148+0000 7f3bd7e00640 1 --2- 172.21.15.37:0/2607641646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f01acf0 0x561f3f026e50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80a6b90 tx=0x7f3bc80aa550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fb30e89aa34ef30 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.148+0000 7f3bc5600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:04:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.148+0000 7f3bc5600640 1 -- 172.21.15.37:0/2607641646 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80aab10 con 0x561f3f01acf0 2024-08-20T05:04:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.149+0000 7f3bc5600640 1 -- 172.21.15.37:0/2607641646 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3bc8003d20 con 0x561f3f01acf0 2024-08-20T05:04:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.149+0000 7f3be1667740 1 -- 172.21.15.37:0/2607641646 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bd00054d0 con 0x561f3f01acf0 2024-08-20T05:04:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.149+0000 7f3bc5600640 1 -- 172.21.15.37:0/2607641646 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3bc80af110 con 0x561f3f01acf0 2024-08-20T05:04:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.149+0000 7f3be1667740 10 client.26143 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.149+0000 7f3be1667740 1 -- 172.21.15.37:0/2607641646 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561f3ed56960 con 0x561f3f01acf0 2024-08-20T05:04:32.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.149+0000 7f3bc5600640 1 -- 172.21.15.37:0/2607641646 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bd00054d0 con 0x561f3f01acf0 2024-08-20T05:04:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.149+0000 7f3bc5600640 1 -- 172.21.15.37:0/2607641646 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f3bc8023060 con 0x561f3f01acf0 2024-08-20T05:04:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.149+0000 7f3be1667740 10 client.26143 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.149+0000 7f3be1667740 10 client.26143 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:04:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.149+0000 7f3be1667740 20 client.26143 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.149+0000 7f3be1667740 1 --2- 172.21.15.37:0/2607641646 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561f3f036bb0 0x561f3f038fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.149+0000 7f3be1667740 4 client.26143 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:04:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.149+0000 7f3be1667740 1 -- 172.21.15.37:0/2607641646 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f3ef92cc0 con 0x561f3f036bb0 2024-08-20T05:04:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.150+0000 7f3bcf400640 1 --2- 172.21.15.37:0/2607641646 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561f3f036bb0 0x561f3f038fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.150+0000 7f3bcf400640 1 --2- 172.21.15.37:0/2607641646 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561f3f036bb0 0x561f3f038fd0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7446bcb3cf3b8a0 server_cookie=b6b446df9063a3b4 in_seq=0 out_seq=0 2024-08-20T05:04:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.150+0000 7f3bc5600640 10 client.26143 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.151+0000 7f3bc5600640 1 -- 172.21.15.37:0/2607641646 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561f3ef92cc0 con 0x561f3f036bb0 2024-08-20T05:04:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.151+0000 7f3bc5600640 10 client.26143 handle_command_reply: tid=0 2024-08-20T05:04:32.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.151+0000 7f3be1667740 1 client.26143 shutdown 2024-08-20T05:04:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.151+0000 7f3be1667740 1 -- 172.21.15.37:0/2607641646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f01acf0 msgr2=0x561f3f026e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.151+0000 7f3be1667740 1 --2- 172.21.15.37:0/2607641646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f01acf0 0x561f3f026e50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80a6b90 tx=0x7f3bc80aa550 comp rx=0 tx=0).stop 2024-08-20T05:04:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.151+0000 7f3be1667740 1 -- 172.21.15.37:0/2607641646 shutdown_connections 2024-08-20T05:04:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.151+0000 7f3be1667740 1 --2- 172.21.15.37:0/2607641646 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561f3f036bb0 0x561f3f038fd0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.151+0000 7f3be1667740 1 --2- 172.21.15.37:0/2607641646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f0275a0 0x561f3f024860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.151+0000 7f3be1667740 1 --2- 172.21.15.37:0/2607641646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f01b610 0x561f3f0242a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.151+0000 7f3be1667740 1 --2- 172.21.15.37:0/2607641646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f01acf0 0x561f3f026e50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.151+0000 7f3bc5600640 0 client.26143 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.151+0000 7f3be1667740 1 -- 172.21.15.37:0/2607641646 >> 172.21.15.37:0/2607641646 conn(0x561f3f018b20 msgr2=0x561f3f01e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.151+0000 7f3be1667740 1 -- 172.21.15.37:0/2607641646 shutdown_connections 2024-08-20T05:04:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.151+0000 7f3be1667740 1 -- 172.21.15.37:0/2607641646 wait complete. 2024-08-20T05:04:32.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.151+0000 7f3be1667740 20 client.26143 trim_cache size 0 max 16384 2024-08-20T05:04:32.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.170+0000 7f3be1667740 1 Processor -- start 2024-08-20T05:04:32.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.170+0000 7f3be1667740 1 -- start start 2024-08-20T05:04:32.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.170+0000 7f3be1667740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01acf0 0x561f3f033160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.170+0000 7f3be1667740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f01b610 0x561f3f017b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.170+0000 7f3be1667740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f0275a0 0x561f3f018070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.170+0000 7f3be1667740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd81b1950 con 0x561f3f01b610 2024-08-20T05:04:32.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.170+0000 7f3be1667740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd81b3550 con 0x561f3f01acf0 2024-08-20T05:04:32.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.170+0000 7f3be1667740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd81b2020 con 0x561f3f0275a0 2024-08-20T05:04:32.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.170+0000 7f3bcf400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f01b610 0x561f3f017b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.170+0000 7f3bcf400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f01b610 0x561f3f017b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57004/0 (socket says 172.21.15.37:57004) 2024-08-20T05:04:32.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.170+0000 7f3bcf400640 1 -- 172.21.15.37:0/1253714126 learned_addr learned my addr 172.21.15.37:0/1253714126 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:32.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.170+0000 7f3bd7e00640 1 --2- 172.21.15.37:0/1253714126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01acf0 0x561f3f033160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.171+0000 7f3bdca00640 1 --2- 172.21.15.37:0/1253714126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f0275a0 0x561f3f018070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.171+0000 7f3bcf400640 1 -- 172.21.15.37:0/1253714126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f0275a0 msgr2=0x561f3f018070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.171+0000 7f3bcf400640 1 --2- 172.21.15.37:0/1253714126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f0275a0 0x561f3f018070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.171+0000 7f3bcf400640 1 -- 172.21.15.37:0/1253714126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01acf0 msgr2=0x561f3f033160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.171+0000 7f3bcf400640 1 --2- 172.21.15.37:0/1253714126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01acf0 0x561f3f033160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.171+0000 7f3bcf400640 1 -- 172.21.15.37:0/1253714126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f3f024bd0 con 0x561f3f01b610 2024-08-20T05:04:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.171+0000 7f3bd7e00640 1 --2- 172.21.15.37:0/1253714126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01acf0 0x561f3f033160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:04:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.171+0000 7f3bcf400640 1 --2- 172.21.15.37:0/1253714126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f01b610 0x561f3f017b30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0004180 tx=0x7f3bc0022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f549469866523f52 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.171+0000 7f3bc7e00640 1 -- 172.21.15.37:0/1253714126 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0003ac0 con 0x561f3f01b610 2024-08-20T05:04:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.171+0000 7f3bc7e00640 1 -- 172.21.15.37:0/1253714126 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bc0003c60 con 0x561f3f01b610 2024-08-20T05:04:32.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.171+0000 7f3bc7e00640 1 -- 172.21.15.37:0/1253714126 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc001f7a0 con 0x561f3f01b610 2024-08-20T05:04:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.172+0000 7f3be1667740 1 -- 172.21.15.37:0/1253714126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f01b610 msgr2=0x561f3f017b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.172+0000 7f3be1667740 1 --2- 172.21.15.37:0/1253714126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f01b610 0x561f3f017b30 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0004180 tx=0x7f3bc0022040 comp rx=0 tx=0).stop 2024-08-20T05:04:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.172+0000 7f3be1667740 1 -- 172.21.15.37:0/1253714126 shutdown_connections 2024-08-20T05:04:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.172+0000 7f3be1667740 1 --2- 172.21.15.37:0/1253714126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f0275a0 0x561f3f018070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.172+0000 7f3be1667740 1 --2- 172.21.15.37:0/1253714126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f01b610 0x561f3f017b30 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.172+0000 7f3be1667740 1 --2- 172.21.15.37:0/1253714126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01acf0 0x561f3f033160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.172+0000 7f3be1667740 1 -- 172.21.15.37:0/1253714126 >> 172.21.15.37:0/1253714126 conn(0x561f3f018b20 msgr2=0x561f3f017420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.172+0000 7f3be1667740 1 -- 172.21.15.37:0/1253714126 shutdown_connections 2024-08-20T05:04:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.172+0000 7f3be1667740 1 -- 172.21.15.37:0/1253714126 wait complete. 2024-08-20T05:04:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.173+0000 7f3be1667740 1 -- start start 2024-08-20T05:04:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.173+0000 7f3be1667740 1 Processor -- start 2024-08-20T05:04:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.173+0000 7f3be1667740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f01acf0 0x561f3f02d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.173+0000 7f3be1667740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01b610 0x561f3f02d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.173+0000 7f3be1667740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f0275a0 0x561f3f02dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.173+0000 7f3be1667740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd81b2dc0 con 0x561f3f0275a0 2024-08-20T05:04:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.173+0000 7f3be1667740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd81b26f0 con 0x561f3f01b610 2024-08-20T05:04:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.173+0000 7f3be1667740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd81af930 con 0x561f3f01acf0 2024-08-20T05:04:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.173+0000 7f3be1667740 10 client.0 _ll_register_callbacks cb 0x7f3bc80099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.174+0000 7f3bd7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f01acf0 0x561f3f02d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.174+0000 7f3bdca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f0275a0 0x561f3f02dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.174+0000 7f3bcf400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01b610 0x561f3f02d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.174+0000 7f3bd7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f01acf0 0x561f3f02d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36718/0 (socket says 172.21.15.37:36718) 2024-08-20T05:04:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.174+0000 7f3bcf400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01b610 0x561f3f02d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:34982/0 (socket says 172.21.15.37:34982) 2024-08-20T05:04:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.174+0000 7f3bd7e00640 1 -- 172.21.15.37:0/3447750305 learned_addr learned my addr 172.21.15.37:0/3447750305 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.174+0000 7f3bd7e00640 1 -- 172.21.15.37:0/3447750305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01b610 msgr2=0x561f3f02d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.174+0000 7f3bd7e00640 1 --2- 172.21.15.37:0/3447750305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01b610 0x561f3f02d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.174+0000 7f3bd7e00640 1 -- 172.21.15.37:0/3447750305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f0275a0 msgr2=0x561f3f02dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.174+0000 7f3bd7e00640 1 --2- 172.21.15.37:0/3447750305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f0275a0 0x561f3f02dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.174+0000 7f3bd7e00640 1 -- 172.21.15.37:0/3447750305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f3f0a0900 con 0x561f3f01acf0 2024-08-20T05:04:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.174+0000 7f3bd7e00640 1 --2- 172.21.15.37:0/3447750305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f01acf0 0x561f3f02d160 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80af2d0 tx=0x7f3bc8009870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8afd02a6a58051bd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.174+0000 7f3bc5600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:04:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.174+0000 7f3bc5600640 1 -- 172.21.15.37:0/3447750305 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc80aa8e0 con 0x561f3f01acf0 2024-08-20T05:04:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.174+0000 7f3bc5600640 1 -- 172.21.15.37:0/3447750305 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3bc80a6480 con 0x561f3f01acf0 2024-08-20T05:04:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.175+0000 7f3be1667740 1 -- 172.21.15.37:0/3447750305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bc0003c60 con 0x561f3f01acf0 2024-08-20T05:04:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.175+0000 7f3bc5600640 1 -- 172.21.15.37:0/3447750305 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3bc80b8050 con 0x561f3f01acf0 2024-08-20T05:04:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.175+0000 7f3be1667740 10 client.26149 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.175+0000 7f3be1667740 1 -- 172.21.15.37:0/3447750305 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561f3f0a1c20 con 0x561f3f01acf0 2024-08-20T05:04:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.175+0000 7f3bc5600640 1 -- 172.21.15.37:0/3447750305 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bc0003c60 con 0x561f3f01acf0 2024-08-20T05:04:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.175+0000 7f3bc5600640 1 -- 172.21.15.37:0/3447750305 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f3bc80b02a0 con 0x561f3f01acf0 2024-08-20T05:04:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.175+0000 7f3be1667740 10 client.26149 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.175+0000 7f3be1667740 10 client.26149 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:04:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.175+0000 7f3be1667740 20 client.26149 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.175+0000 7f3be1667740 1 --2- 172.21.15.37:0/3447750305 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561f3f0a22e0 0x561f3f0a4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.175+0000 7f3be1667740 4 client.26149 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b90570f6", "release": true, "await": true}] 2024-08-20T05:04:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.175+0000 7f3be1667740 1 -- 172.21.15.37:0/3447750305 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b90570f6", "release": true, "await": true}) -- 0x561f3ef8e760 con 0x561f3f0a22e0 2024-08-20T05:04:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.176+0000 7f3bcf400640 1 --2- 172.21.15.37:0/3447750305 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561f3f0a22e0 0x561f3f0a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.176+0000 7f3bcf400640 1 --2- 172.21.15.37:0/3447750305 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561f3f0a22e0 0x561f3f0a4700 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eccae18b44131834 server_cookie=c51ed272409c85a3 in_seq=0 out_seq=0 2024-08-20T05:04:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.176+0000 7f3bc5600640 10 client.26149 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:32.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.200+0000 7f3bc5600640 1 -- 172.21.15.37:0/3447750305 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561f3ef8e760 con 0x561f3f0a22e0 2024-08-20T05:04:32.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.200+0000 7f3bc5600640 10 client.26149 handle_command_reply: tid=0 2024-08-20T05:04:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.200+0000 7f3be1667740 1 client.26149 shutdown 2024-08-20T05:04:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.200+0000 7f3be1667740 1 -- 172.21.15.37:0/3447750305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f01acf0 msgr2=0x561f3f02d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.200+0000 7f3be1667740 1 --2- 172.21.15.37:0/3447750305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f01acf0 0x561f3f02d160 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80af2d0 tx=0x7f3bc8009870 comp rx=0 tx=0).stop 2024-08-20T05:04:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.201+0000 7f3be1667740 1 -- 172.21.15.37:0/3447750305 shutdown_connections 2024-08-20T05:04:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.201+0000 7f3be1667740 1 --2- 172.21.15.37:0/3447750305 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561f3f0a22e0 0x561f3f0a4700 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.201+0000 7f3be1667740 1 --2- 172.21.15.37:0/3447750305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3f0275a0 0x561f3f02dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.201+0000 7f3be1667740 1 --2- 172.21.15.37:0/3447750305 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3f01b610 0x561f3f02d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.201+0000 7f3be1667740 1 --2- 172.21.15.37:0/3447750305 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3f01acf0 0x561f3f02d160 secure :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80af2d0 tx=0x7f3bc8009870 comp rx=0 tx=0).stop 2024-08-20T05:04:32.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.201+0000 7f3be1667740 1 -- 172.21.15.37:0/3447750305 >> 172.21.15.37:0/3447750305 conn(0x561f3f018b20 msgr2=0x561f3f017c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.202+0000 7f3bc5600640 0 client.26149 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.202+0000 7f3be1667740 1 -- 172.21.15.37:0/3447750305 shutdown_connections 2024-08-20T05:04:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.203+0000 7f3be1667740 1 -- 172.21.15.37:0/3447750305 wait complete. 2024-08-20T05:04:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.203+0000 7f3be1667740 20 client.26149 trim_cache size 0 max 16384 2024-08-20T05:04:32.208 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:04:32.208 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-08-20T05:04:32.208 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:04:32.208 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 12, 2024-08-20T05:04:32.208 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:04:32.208 INFO:teuthology.orchestra.run.smithi037.stdout: "b90570f6": { 2024-08-20T05:04:32.208 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 12, 2024-08-20T05:04:32.208 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:04:32.209 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:04:32.209 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:04:32.209 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:04:32.209 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:04:32.209 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:04:32.209 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 130.2, 2024-08-20T05:04:32.209 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:04:32.209 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:04:32.209 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:04:32.209 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:04:32.209 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:04:32.209 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:04:32.209 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:04:32.209 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:04:32.210 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:04:32.210 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:04:32.210 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:04:32.210 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:04:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.207+0000 7f3bdea00640 1 -- 172.21.15.37:0/3005017586 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3bbc0b3b60 msgr2=0x7f3bbc0b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.207+0000 7f3bdea00640 1 --2- 172.21.15.37:0/3005017586 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3bbc0b3b60 0x7f3bbc0b6020 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0009cc0 tx=0x7f3bc0005f90 comp rx=0 tx=0).stop 2024-08-20T05:04:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.207+0000 7f3bdea00640 1 -- 172.21.15.37:0/3005017586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bd8104ca0 msgr2=0x7f3bd819b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.207+0000 7f3bdea00640 1 --2- 172.21.15.37:0/3005017586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bd8104ca0 0x7f3bd819b170 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800db80 tx=0x7f3bc800b630 comp rx=0 tx=0).stop 2024-08-20T05:04:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.208+0000 7f3bdea00640 1 -- 172.21.15.37:0/3005017586 shutdown_connections 2024-08-20T05:04:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.208+0000 7f3bdea00640 1 --2- 172.21.15.37:0/3005017586 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3bbc0b3b60 0x7f3bbc0b6020 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.208+0000 7f3bdea00640 1 --2- 172.21.15.37:0/3005017586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3bd810b030 0x7f3bd81a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.208+0000 7f3bdea00640 1 --2- 172.21.15.37:0/3005017586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bd810a6b0 0x7f3bd819b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.208+0000 7f3bdea00640 1 --2- 172.21.15.37:0/3005017586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3bd8104ca0 0x7f3bd819b170 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.208+0000 7f3bdea00640 1 -- 172.21.15.37:0/3005017586 >> 172.21.15.37:0/3005017586 conn(0x7f3bd8100730 msgr2=0x7f3bd8102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:32.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.208+0000 7f3bdea00640 1 -- 172.21.15.37:0/3005017586 shutdown_connections 2024-08-20T05:04:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:32.208+0000 7f3bdea00640 1 -- 172.21.15.37:0/3005017586 wait complete. 2024-08-20T05:04:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.442+0000 7f8a60c00640 1 -- 172.21.15.37:0/2840434408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a5c076c60 msgr2=0x7f8a5c0752b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.442+0000 7f8a60c00640 1 --2- 172.21.15.37:0/2840434408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a5c076c60 0x7f8a5c0752b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c009900 tx=0x7f8a4c02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.444+0000 7f8a60c00640 1 -- 172.21.15.37:0/2840434408 shutdown_connections 2024-08-20T05:04:32.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.444+0000 7f8a60c00640 1 --2- 172.21.15.37:0/2840434408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a5c10a410 0x7f8a5c10c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.444+0000 7f8a60c00640 1 --2- 172.21.15.37:0/2840434408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c0757f0 0x7f8a5c075c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.444+0000 7f8a60c00640 1 --2- 172.21.15.37:0/2840434408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a5c076c60 0x7f8a5c0752b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.444+0000 7f8a60c00640 1 -- 172.21.15.37:0/2840434408 >> 172.21.15.37:0/2840434408 conn(0x7f8a5c0fdd30 msgr2=0x7f8a5c100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:32.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.444+0000 7f8a60c00640 1 -- 172.21.15.37:0/2840434408 shutdown_connections 2024-08-20T05:04:32.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.444+0000 7f8a60c00640 1 -- 172.21.15.37:0/2840434408 wait complete. 2024-08-20T05:04:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.446+0000 7f8a60c00640 1 Processor -- start 2024-08-20T05:04:32.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.446+0000 7f8a60c00640 1 -- start start 2024-08-20T05:04:32.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.446+0000 7f8a60c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a5c0757f0 0x7f8a5c19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.446+0000 7f8a60c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a5c076c60 0x7f8a5c19b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.446+0000 7f8a60c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c10a410 0x7f8a5c19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.446+0000 7f8a60c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c110350 con 0x7f8a5c10a410 2024-08-20T05:04:32.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.446+0000 7f8a60c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c1101d0 con 0x7f8a5c0757f0 2024-08-20T05:04:32.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.446+0000 7f8a60c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c1104d0 con 0x7f8a5c076c60 2024-08-20T05:04:32.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.447+0000 7f8a5b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a5c0757f0 0x7f8a5c19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.447+0000 7f8a5b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a5c0757f0 0x7f8a5c19aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:35000/0 (socket says 172.21.15.37:35000) 2024-08-20T05:04:32.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.447+0000 7f8a5b400640 1 -- 172.21.15.37:0/1544126486 learned_addr learned my addr 172.21.15.37:0/1544126486 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:32.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.447+0000 7f8a5be00640 1 --2- 172.21.15.37:0/1544126486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c10a410 0x7f8a5c19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.447+0000 7f8a53e00640 1 --2- 172.21.15.37:0/1544126486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a5c076c60 0x7f8a5c19b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.448+0000 7f8a5b400640 1 -- 172.21.15.37:0/1544126486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a5c076c60 msgr2=0x7f8a5c19b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.448+0000 7f8a5b400640 1 --2- 172.21.15.37:0/1544126486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a5c076c60 0x7f8a5c19b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.448+0000 7f8a5b400640 1 -- 172.21.15.37:0/1544126486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c10a410 msgr2=0x7f8a5c19bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.448+0000 7f8a5b400640 1 --2- 172.21.15.37:0/1544126486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c10a410 0x7f8a5c19bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.448+0000 7f8a5b400640 1 -- 172.21.15.37:0/1544126486 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c19c610 con 0x7f8a5c0757f0 2024-08-20T05:04:32.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.448+0000 7f8a5b400640 1 --2- 172.21.15.37:0/1544126486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a5c0757f0 0x7f8a5c19aad0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c02a9e0 tx=0x7f8a4c003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.450+0000 7f8a58c00640 1 -- 172.21.15.37:0/1544126486 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c03f070 con 0x7f8a5c0757f0 2024-08-20T05:04:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.450+0000 7f8a58c00640 1 -- 172.21.15.37:0/1544126486 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a4c031c50 con 0x7f8a5c0757f0 2024-08-20T05:04:32.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.450+0000 7f8a58c00640 1 -- 172.21.15.37:0/1544126486 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c035030 con 0x7f8a5c0757f0 2024-08-20T05:04:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.450+0000 7f8a60c00640 1 -- 172.21.15.37:0/1544126486 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a5c19c8a0 con 0x7f8a5c0757f0 2024-08-20T05:04:32.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.450+0000 7f8a60c00640 1 -- 172.21.15.37:0/1544126486 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a5c1a2df0 con 0x7f8a5c0757f0 2024-08-20T05:04:32.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.455+0000 7f8a651d8740 1 Processor -- start 2024-08-20T05:04:32.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.456+0000 7f8a651d8740 1 -- start start 2024-08-20T05:04:32.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.457+0000 7f8a651d8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c93b4b0 0x56160c93d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.457+0000 7f8a651d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93dde0 0x56160c9401d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.457+0000 7f8a651d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c940820 0x56160c942ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.457+0000 7f8a651d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56160c8ae210 con 0x56160c940820 2024-08-20T05:04:32.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.457+0000 7f8a651d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56160c89d710 con 0x56160c93dde0 2024-08-20T05:04:32.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.457+0000 7f8a651d8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56160c8a1750 con 0x56160c93b4b0 2024-08-20T05:04:32.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.457+0000 7f8a5be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c93b4b0 0x56160c93d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.457+0000 7f8a5be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c93b4b0 0x56160c93d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36764/0 (socket says 172.21.15.37:36764) 2024-08-20T05:04:32.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.457+0000 7f8a5be00640 1 -- 172.21.15.37:0/611678943 learned_addr learned my addr 172.21.15.37:0/611678943 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:32.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.458+0000 7f8a5be00640 1 -- 172.21.15.37:0/611678943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93dde0 msgr2=0x56160c9401d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:04:32.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.458+0000 7f8a53e00640 1 --2- 172.21.15.37:0/611678943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c940820 0x56160c942ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.458+0000 7f8a5be00640 1 --2- 172.21.15.37:0/611678943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93dde0 0x56160c9401d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.458+0000 7f8a5be00640 1 -- 172.21.15.37:0/611678943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c940820 msgr2=0x56160c942ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.458+0000 7f8a5be00640 1 --2- 172.21.15.37:0/611678943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c940820 0x56160c942ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.458+0000 7f8a5be00640 1 -- 172.21.15.37:0/611678943 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56160c869de0 con 0x56160c93b4b0 2024-08-20T05:04:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.458+0000 7f8a53e00640 1 --2- 172.21.15.37:0/611678943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c940820 0x56160c942ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:04:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.459+0000 7f8a58c00640 1 -- 172.21.15.37:0/1544126486 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8a4c042070 con 0x7f8a5c0757f0 2024-08-20T05:04:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.459+0000 7f8a5be00640 1 --2- 172.21.15.37:0/611678943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c93b4b0 0x56160c93d8a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8a54009f90 tx=0x7f8a540118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3782ac57e9fb2cd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:32.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.459+0000 7f8a4be00640 1 -- 172.21.15.37:0/611678943 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54004b20 con 0x56160c93b4b0 2024-08-20T05:04:32.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.459+0000 7f8a4be00640 1 -- 172.21.15.37:0/611678943 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a54004cc0 con 0x56160c93b4b0 2024-08-20T05:04:32.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.459+0000 7f8a4be00640 1 -- 172.21.15.37:0/611678943 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a54005020 con 0x56160c93b4b0 2024-08-20T05:04:32.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.460+0000 7f8a651d8740 1 -- 172.21.15.37:0/611678943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c93b4b0 msgr2=0x56160c93d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.460+0000 7f8a651d8740 1 --2- 172.21.15.37:0/611678943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c93b4b0 0x56160c93d8a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8a54009f90 tx=0x7f8a540118d0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.461+0000 7f8a651d8740 1 -- 172.21.15.37:0/611678943 shutdown_connections 2024-08-20T05:04:32.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.461+0000 7f8a651d8740 1 --2- 172.21.15.37:0/611678943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c940820 0x56160c942ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.461+0000 7f8a651d8740 1 --2- 172.21.15.37:0/611678943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93dde0 0x56160c9401d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.461+0000 7f8a651d8740 1 --2- 172.21.15.37:0/611678943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c93b4b0 0x56160c93d8a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.461+0000 7f8a651d8740 1 -- 172.21.15.37:0/611678943 >> 172.21.15.37:0/611678943 conn(0x56160c936600 msgr2=0x56160c937390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:32.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.461+0000 7f8a651d8740 1 -- 172.21.15.37:0/611678943 shutdown_connections 2024-08-20T05:04:32.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.464+0000 7f8a651d8740 1 -- 172.21.15.37:0/611678943 wait complete. 2024-08-20T05:04:32.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.464+0000 7f8a58c00640 1 --2- 172.21.15.37:0/1544126486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8a400bc480 0x7f8a400be940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.465+0000 7f8a651d8740 1 -- start start 2024-08-20T05:04:32.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.465+0000 7f8a651d8740 1 Processor -- start 2024-08-20T05:04:32.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.467+0000 7f8a58c00640 1 -- 172.21.15.37:0/1544126486 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8a4c104740 con 0x7f8a5c0757f0 2024-08-20T05:04:32.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.468+0000 7f8a651d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c93b4b0 0x56160c944fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.468+0000 7f8a651d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93dde0 0x56160c945670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.468+0000 7f8a651d8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c940820 0x56160c946240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.468+0000 7f8a651d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56160c7d6ab0 con 0x56160c93b4b0 2024-08-20T05:04:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.468+0000 7f8a651d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56160c844140 con 0x56160c93dde0 2024-08-20T05:04:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.468+0000 7f8a651d8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56160c943800 con 0x56160c940820 2024-08-20T05:04:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.468+0000 7f8a651d8740 10 client.0 _ll_register_callbacks cb 0x56160c8575d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:32.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.468+0000 7f8a5be00640 1 --2- 172.21.15.37:0/1544126486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8a400bc480 0x7f8a400be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.469+0000 7f8a5be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c940820 0x56160c946240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.469+0000 7f8a53e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93dde0 0x56160c945670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.469+0000 7f8a53e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93dde0 0x56160c945670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:35016/0 (socket says 172.21.15.37:35016) 2024-08-20T05:04:32.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.469+0000 7f8a53e00640 1 -- 172.21.15.37:0/2779319994 learned_addr learned my addr 172.21.15.37:0/2779319994 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:32.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.470+0000 7f8a53e00640 1 -- 172.21.15.37:0/2779319994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c940820 msgr2=0x56160c946240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:32.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.470+0000 7f8a53e00640 1 --2- 172.21.15.37:0/2779319994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c940820 0x56160c946240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.470+0000 7f8a53e00640 1 -- 172.21.15.37:0/2779319994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c93b4b0 msgr2=0x56160c944fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:32.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.470+0000 7f8a53e00640 1 --2- 172.21.15.37:0/2779319994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c93b4b0 0x56160c944fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.470+0000 7f8a53e00640 1 -- 172.21.15.37:0/2779319994 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56160c845170 con 0x56160c93dde0 2024-08-20T05:04:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.470+0000 7f8a53e00640 1 --2- 172.21.15.37:0/2779319994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93dde0 0x56160c945670 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400afd0 tx=0x7f8a44011b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54c84aaa801c3259 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.470+0000 7f8a48c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:04:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.470+0000 7f8a48c00640 1 -- 172.21.15.37:0/2779319994 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4401f060 con 0x56160c93dde0 2024-08-20T05:04:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.471+0000 7f8a48c00640 1 -- 172.21.15.37:0/2779319994 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8a4400fb40 con 0x56160c93dde0 2024-08-20T05:04:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.472+0000 7f8a651d8740 1 -- 172.21.15.37:0/2779319994 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56160c874a30 con 0x56160c93dde0 2024-08-20T05:04:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.472+0000 7f8a5be00640 1 --2- 172.21.15.37:0/1544126486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8a400bc480 0x7f8a400be940 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8a5401b040 tx=0x7f8a54004ba0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.472+0000 7f8a48c00640 1 -- 172.21.15.37:0/2779319994 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8a4400fd40 con 0x56160c93dde0 2024-08-20T05:04:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.472+0000 7f8a651d8740 10 client.26129 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.473+0000 7f8a651d8740 1 -- 172.21.15.37:0/2779319994 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56160c600790 con 0x56160c93dde0 2024-08-20T05:04:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.473+0000 7f8a48c00640 1 -- 172.21.15.37:0/2779319994 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x56160c874a30 con 0x56160c93dde0 2024-08-20T05:04:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.474+0000 7f8a48c00640 1 -- 172.21.15.37:0/2779319994 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f8a440234c0 con 0x56160c93dde0 2024-08-20T05:04:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.474+0000 7f8a651d8740 10 client.26129 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.474+0000 7f8a651d8740 10 client.26129 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:04:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.474+0000 7f8a651d8740 20 client.26129 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.475+0000 7f8a651d8740 1 --2- 172.21.15.37:0/2779319994 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56160c961c30 0x56160c964040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.475+0000 7f8a651d8740 4 client.26129 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:04:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.475+0000 7f8a651d8740 1 -- 172.21.15.37:0/2779319994 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56160c8b0160 con 0x56160c961c30 2024-08-20T05:04:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.475+0000 7f8a5b400640 1 --2- 172.21.15.37:0/2779319994 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56160c961c30 0x56160c964040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.475+0000 7f8a5b400640 1 --2- 172.21.15.37:0/2779319994 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56160c961c30 0x56160c964040 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=215b798e73a5728f server_cookie=348b54f87cc27287 in_seq=0 out_seq=0 2024-08-20T05:04:32.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.476+0000 7f8a48c00640 10 client.26129 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.476+0000 7f8a48c00640 1 -- 172.21.15.37:0/2779319994 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56160c8b0160 con 0x56160c961c30 2024-08-20T05:04:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.476+0000 7f8a48c00640 10 client.26129 handle_command_reply: tid=0 2024-08-20T05:04:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.476+0000 7f8a651d8740 1 client.26129 shutdown 2024-08-20T05:04:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.477+0000 7f8a651d8740 1 -- 172.21.15.37:0/2779319994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93dde0 msgr2=0x56160c945670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.477+0000 7f8a651d8740 1 --2- 172.21.15.37:0/2779319994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93dde0 0x56160c945670 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8a4400afd0 tx=0x7f8a44011b60 comp rx=0 tx=0).stop 2024-08-20T05:04:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.477+0000 7f8a651d8740 1 -- 172.21.15.37:0/2779319994 shutdown_connections 2024-08-20T05:04:32.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.477+0000 7f8a651d8740 1 --2- 172.21.15.37:0/2779319994 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56160c961c30 0x56160c964040 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.477+0000 7f8a651d8740 1 --2- 172.21.15.37:0/2779319994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c940820 0x56160c946240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.477+0000 7f8a651d8740 1 --2- 172.21.15.37:0/2779319994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93dde0 0x56160c945670 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.477+0000 7f8a651d8740 1 --2- 172.21.15.37:0/2779319994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c93b4b0 0x56160c944fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.477+0000 7f8a651d8740 1 -- 172.21.15.37:0/2779319994 >> 172.21.15.37:0/2779319994 conn(0x56160c936600 msgr2=0x56160c935590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.477+0000 7f8a48c00640 0 client.26129 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.477+0000 7f8a651d8740 1 -- 172.21.15.37:0/2779319994 shutdown_connections 2024-08-20T05:04:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.477+0000 7f8a651d8740 1 -- 172.21.15.37:0/2779319994 wait complete. 2024-08-20T05:04:32.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.477+0000 7f8a651d8740 20 client.26129 trim_cache size 0 max 16384 2024-08-20T05:04:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.506+0000 7f8a651d8740 1 Processor -- start 2024-08-20T05:04:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.506+0000 7f8a651d8740 1 -- start start 2024-08-20T05:04:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.506+0000 7f8a651d8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c936600 0x56160c944fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.506+0000 7f8a651d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c93b4b0 0x56160c9454f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.506+0000 7f8a651d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93dde0 0x56160c934d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.506+0000 7f8a651d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c1a8df0 con 0x56160c93b4b0 2024-08-20T05:04:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.506+0000 7f8a651d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c1aa9f0 con 0x56160c93dde0 2024-08-20T05:04:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.506+0000 7f8a651d8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c1a94c0 con 0x56160c936600 2024-08-20T05:04:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.507+0000 7f8a5b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c936600 0x56160c944fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.507+0000 7f8a5be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93dde0 0x56160c934d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.507+0000 7f8a5b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c936600 0x56160c944fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36780/0 (socket says 172.21.15.37:36780) 2024-08-20T05:04:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.507+0000 7f8a5b400640 1 -- 172.21.15.37:0/2610025821 learned_addr learned my addr 172.21.15.37:0/2610025821 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.507+0000 7f8a53e00640 1 --2- 172.21.15.37:0/2610025821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c93b4b0 0x56160c9454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.507+0000 7f8a5b400640 1 -- 172.21.15.37:0/2610025821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93dde0 msgr2=0x56160c934d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.508+0000 7f8a5b400640 1 --2- 172.21.15.37:0/2610025821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93dde0 0x56160c934d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.508+0000 7f8a5b400640 1 -- 172.21.15.37:0/2610025821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c93b4b0 msgr2=0x56160c9454f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.508+0000 7f8a5b400640 1 --2- 172.21.15.37:0/2610025821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c93b4b0 0x56160c9454f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.508+0000 7f8a5b400640 1 -- 172.21.15.37:0/2610025821 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56160c679620 con 0x56160c936600 2024-08-20T05:04:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.508+0000 7f8a5be00640 1 --2- 172.21.15.37:0/2610025821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93dde0 0x56160c934d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:04:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.508+0000 7f8a5b400640 1 --2- 172.21.15.37:0/2610025821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c936600 0x56160c944fb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c101e40 tx=0x7f8a4c046040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9a28995556717ea server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.509+0000 7f8a4b400640 1 -- 172.21.15.37:0/2610025821 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c0e4070 con 0x56160c936600 2024-08-20T05:04:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.509+0000 7f8a4b400640 1 -- 172.21.15.37:0/2610025821 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a4c0cf890 con 0x56160c936600 2024-08-20T05:04:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.509+0000 7f8a4b400640 1 -- 172.21.15.37:0/2610025821 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c049070 con 0x56160c936600 2024-08-20T05:04:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.510+0000 7f8a651d8740 1 -- 172.21.15.37:0/2610025821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c936600 msgr2=0x56160c944fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.510+0000 7f8a651d8740 1 --2- 172.21.15.37:0/2610025821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c936600 0x56160c944fb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c101e40 tx=0x7f8a4c046040 comp rx=0 tx=0).stop 2024-08-20T05:04:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.512+0000 7f8a651d8740 1 -- 172.21.15.37:0/2610025821 shutdown_connections 2024-08-20T05:04:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.512+0000 7f8a651d8740 1 --2- 172.21.15.37:0/2610025821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93dde0 0x56160c934d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.512+0000 7f8a651d8740 1 --2- 172.21.15.37:0/2610025821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c93b4b0 0x56160c9454f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.512+0000 7f8a651d8740 1 --2- 172.21.15.37:0/2610025821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c936600 0x56160c944fb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.512+0000 7f8a651d8740 1 -- 172.21.15.37:0/2610025821 >> 172.21.15.37:0/2610025821 conn(0x56160c93b090 msgr2=0x56160c940c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:32.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.512+0000 7f8a651d8740 1 -- 172.21.15.37:0/2610025821 shutdown_connections 2024-08-20T05:04:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.513+0000 7f8a651d8740 1 -- 172.21.15.37:0/2610025821 wait complete. 2024-08-20T05:04:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.514+0000 7f8a651d8740 1 -- start start 2024-08-20T05:04:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.516+0000 7f8a651d8740 1 Processor -- start 2024-08-20T05:04:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.517+0000 7f8a651d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c936600 0x56160c949b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.518+0000 7f8a651d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93b4b0 0x56160c94a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.518+0000 7f8a651d8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c93dde0 0x56160c94ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.518+0000 7f8a5b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c936600 0x56160c949b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.519+0000 7f8a53e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93b4b0 0x56160c94a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.519+0000 7f8a53e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93b4b0 0x56160c94a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:35038/0 (socket says 172.21.15.37:35038) 2024-08-20T05:04:32.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.519+0000 7f8a5b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c936600 0x56160c949b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57054/0 (socket says 172.21.15.37:57054) 2024-08-20T05:04:32.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.519+0000 7f8a651d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c1aa260 con 0x56160c936600 2024-08-20T05:04:32.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.519+0000 7f8a651d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c1a9b90 con 0x56160c93b4b0 2024-08-20T05:04:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.519+0000 7f8a651d8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c1a6ec0 con 0x56160c93dde0 2024-08-20T05:04:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.519+0000 7f8a651d8740 10 client.0 _ll_register_callbacks cb 0x7f8a4400a570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.519+0000 7f8a5be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c93dde0 0x56160c94ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.519+0000 7f8a5be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c93dde0 0x56160c94ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36796/0 (socket says 172.21.15.37:36796) 2024-08-20T05:04:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.519+0000 7f8a5be00640 1 -- 172.21.15.37:0/661776448 learned_addr learned my addr 172.21.15.37:0/661776448 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.520+0000 7f8a5b400640 1 -- 172.21.15.37:0/661776448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c93dde0 msgr2=0x56160c94ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.520+0000 7f8a5b400640 1 --2- 172.21.15.37:0/661776448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c93dde0 0x56160c94ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.520+0000 7f8a5b400640 1 -- 172.21.15.37:0/661776448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93b4b0 msgr2=0x56160c94a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.520+0000 7f8a5b400640 1 --2- 172.21.15.37:0/661776448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93b4b0 0x56160c94a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.520+0000 7f8a5b400640 1 -- 172.21.15.37:0/661776448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56160c94b5b0 con 0x56160c936600 2024-08-20T05:04:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.520+0000 7f8a53e00640 1 --2- 172.21.15.37:0/661776448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93b4b0 0x56160c94a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:04:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.521+0000 7f8a5be00640 1 --2- 172.21.15.37:0/661776448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c93dde0 0x56160c94ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:04:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.521+0000 7f8a5b400640 1 --2- 172.21.15.37:0/661776448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c936600 0x56160c949b60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c031f90 tx=0x7f8a4c02a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f939df7ea81c697e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.521+0000 7f8a48c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:04:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.522+0000 7f8a48c00640 1 -- 172.21.15.37:0/661776448 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c049070 con 0x56160c936600 2024-08-20T05:04:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.522+0000 7f8a48c00640 1 -- 172.21.15.37:0/661776448 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8a4c0c7930 con 0x56160c936600 2024-08-20T05:04:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.522+0000 7f8a651d8740 1 -- 172.21.15.37:0/661776448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a4c0cf890 con 0x56160c936600 2024-08-20T05:04:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.523+0000 7f8a48c00640 1 -- 172.21.15.37:0/661776448 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8a4c0e4040 con 0x56160c936600 2024-08-20T05:04:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.523+0000 7f8a651d8740 10 client.16011 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.524+0000 7f8a651d8740 1 -- 172.21.15.37:0/661776448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56160c94c990 con 0x56160c936600 2024-08-20T05:04:32.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.525+0000 7f8a48c00640 1 -- 172.21.15.37:0/661776448 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a4c0cf890 con 0x56160c936600 2024-08-20T05:04:32.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.525+0000 7f8a48c00640 1 -- 172.21.15.37:0/661776448 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f8a4c03bce0 con 0x56160c936600 2024-08-20T05:04:32.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.526+0000 7f8a651d8740 10 client.16011 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:32.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.526+0000 7f8a651d8740 10 client.16011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:04:32.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.526+0000 7f8a651d8740 20 client.16011 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:32.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.526+0000 7f8a651d8740 1 --2- 172.21.15.37:0/661776448 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56160c940820 0x56160c9ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:32.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.526+0000 7f8a651d8740 4 client.16011 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:04:32.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.526+0000 7f8a651d8740 1 -- 172.21.15.37:0/661776448 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56160c8abc00 con 0x56160c940820 2024-08-20T05:04:32.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.526+0000 7f8a53e00640 1 --2- 172.21.15.37:0/661776448 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56160c940820 0x56160c9ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.528+0000 7f8a53e00640 1 --2- 172.21.15.37:0/661776448 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56160c940820 0x56160c9ce9e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cac96655ada2b60 server_cookie=dd410f59bfacf175 in_seq=0 out_seq=0 2024-08-20T05:04:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.528+0000 7f8a48c00640 10 client.16011 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:32.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.541+0000 7f8a48c00640 1 -- 172.21.15.37:0/661776448 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56160c8abc00 con 0x56160c940820 2024-08-20T05:04:32.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.541+0000 7f8a48c00640 10 client.16011 handle_command_reply: tid=0 2024-08-20T05:04:32.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.541+0000 7f8a651d8740 1 client.16011 shutdown 2024-08-20T05:04:32.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.541+0000 7f8a651d8740 1 -- 172.21.15.37:0/661776448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c936600 msgr2=0x56160c949b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.541+0000 7f8a651d8740 1 --2- 172.21.15.37:0/661776448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c936600 0x56160c949b60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c031f90 tx=0x7f8a4c02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.542+0000 7f8a651d8740 1 -- 172.21.15.37:0/661776448 shutdown_connections 2024-08-20T05:04:32.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.542+0000 7f8a651d8740 1 --2- 172.21.15.37:0/661776448 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56160c940820 0x56160c9ce9e0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.542+0000 7f8a651d8740 1 --2- 172.21.15.37:0/661776448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56160c93dde0 0x56160c94ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.542+0000 7f8a651d8740 1 --2- 172.21.15.37:0/661776448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56160c93b4b0 0x56160c94a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.542+0000 7f8a651d8740 1 --2- 172.21.15.37:0/661776448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56160c936600 0x56160c949b60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.543+0000 7f8a651d8740 1 -- 172.21.15.37:0/661776448 >> 172.21.15.37:0/661776448 conn(0x56160c93b090 msgr2=0x56160c944f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.543+0000 7f8a48c00640 0 client.16011 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:32.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.543+0000 7f8a651d8740 1 -- 172.21.15.37:0/661776448 shutdown_connections 2024-08-20T05:04:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.544+0000 7f8a651d8740 1 -- 172.21.15.37:0/661776448 wait complete. 2024-08-20T05:04:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.544+0000 7f8a651d8740 20 client.16011 trim_cache size 0 max 16384 2024-08-20T05:04:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:04:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:04:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:04:32.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:04:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.545+0000 7f8a60c00640 1 -- 172.21.15.37:0/1544126486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8a400bc480 msgr2=0x7f8a400be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.545+0000 7f8a60c00640 1 --2- 172.21.15.37:0/1544126486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8a400bc480 0x7f8a400be940 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8a5401b040 tx=0x7f8a54004ba0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.545+0000 7f8a60c00640 1 -- 172.21.15.37:0/1544126486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a5c0757f0 msgr2=0x7f8a5c19aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.545+0000 7f8a60c00640 1 --2- 172.21.15.37:0/1544126486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a5c0757f0 0x7f8a5c19aad0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c02a9e0 tx=0x7f8a4c003b90 comp rx=0 tx=0).stop 2024-08-20T05:04:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.545+0000 7f8a60c00640 1 -- 172.21.15.37:0/1544126486 shutdown_connections 2024-08-20T05:04:32.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.545+0000 7f8a60c00640 1 --2- 172.21.15.37:0/1544126486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8a400bc480 0x7f8a400be940 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.545+0000 7f8a60c00640 1 --2- 172.21.15.37:0/1544126486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c10a410 0x7f8a5c19bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.545+0000 7f8a60c00640 1 --2- 172.21.15.37:0/1544126486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8a5c076c60 0x7f8a5c19b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.545+0000 7f8a60c00640 1 --2- 172.21.15.37:0/1544126486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8a5c0757f0 0x7f8a5c19aad0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:32.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.545+0000 7f8a60c00640 1 -- 172.21.15.37:0/1544126486 >> 172.21.15.37:0/1544126486 conn(0x7f8a5c0fdd30 msgr2=0x7f8a5c0fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:32.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.545+0000 7f8a60c00640 1 -- 172.21.15.37:0/1544126486 shutdown_connections 2024-08-20T05:04:32.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:32.545+0000 7f8a60c00640 1 -- 172.21.15.37:0/1544126486 wait complete. 2024-08-20T05:04:33.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 95.0 s, 230.0 tps, lat 487.775 ms stddev 1371.846 2024-08-20T05:04:33.301 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b90570f6', total seconds elapsed: 16.9 2024-08-20T05:04:33.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:33 smithi037 ceph-mon[17265]: pgmap v470: 129 pgs: 129 active+clean; 1002 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 863 op/s 2024-08-20T05:04:33.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:33 smithi135 ceph-mon[22342]: pgmap v470: 129 pgs: 129 active+clean; 1002 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 863 op/s 2024-08-20T05:04:33.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:33 smithi130 ceph-mon[22007]: pgmap v470: 129 pgs: 129 active+clean; 1002 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 15 MiB/s wr, 863 op/s 2024-08-20T05:04:35.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:35 smithi135 ceph-mon[22342]: pgmap v471: 129 pgs: 129 active+clean; 1002 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 828 op/s 2024-08-20T05:04:35.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:35 smithi130 ceph-mon[22007]: pgmap v471: 129 pgs: 129 active+clean; 1002 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 828 op/s 2024-08-20T05:04:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:35 smithi037 ceph-mon[17265]: pgmap v471: 129 pgs: 129 active+clean; 1002 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 828 op/s 2024-08-20T05:04:37.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:37 smithi135 ceph-mon[22342]: pgmap v472: 129 pgs: 129 active+clean; 1002 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 733 op/s 2024-08-20T05:04:37.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:37 smithi130 ceph-mon[22007]: pgmap v472: 129 pgs: 129 active+clean; 1002 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 733 op/s 2024-08-20T05:04:37.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:37 smithi037 ceph-mon[17265]: pgmap v472: 129 pgs: 129 active+clean; 1002 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 733 op/s 2024-08-20T05:04:38.042 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 100.0 s, 2544.1 tps, lat 38.983 ms stddev 46.452 2024-08-20T05:04:39.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:39 smithi130 ceph-mon[22007]: pgmap v473: 129 pgs: 129 active+clean; 1002 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 650 op/s 2024-08-20T05:04:39.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:39 smithi037 ceph-mon[17265]: pgmap v473: 129 pgs: 129 active+clean; 1002 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 650 op/s 2024-08-20T05:04:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:39 smithi135 ceph-mon[22342]: pgmap v473: 129 pgs: 129 active+clean; 1002 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 650 op/s 2024-08-20T05:04:41.668 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:41 smithi135 ceph-mon[22342]: pgmap v474: 129 pgs: 129 active+clean; 1002 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 692 op/s 2024-08-20T05:04:41.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:41 smithi130 ceph-mon[22007]: pgmap v474: 129 pgs: 129 active+clean; 1002 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 692 op/s 2024-08-20T05:04:41.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:41 smithi037 ceph-mon[17265]: pgmap v474: 129 pgs: 129 active+clean; 1002 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 MiB/s wr, 692 op/s 2024-08-20T05:04:43.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 105.0 s, 1492.2 tps, lat 66.768 ms stddev 75.326 2024-08-20T05:04:43.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:43 smithi130 ceph-mon[22007]: pgmap v475: 129 pgs: 129 active+clean; 1002 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.5 MiB/s wr, 448 op/s 2024-08-20T05:04:43.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:43 smithi037 ceph-mon[17265]: pgmap v475: 129 pgs: 129 active+clean; 1002 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.5 MiB/s wr, 448 op/s 2024-08-20T05:04:43.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:43 smithi135 ceph-mon[22342]: pgmap v475: 129 pgs: 129 active+clean; 1002 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.5 MiB/s wr, 448 op/s 2024-08-20T05:04:45.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:45 smithi130 ceph-mon[22007]: pgmap v476: 129 pgs: 129 active+clean; 1006 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 562 op/s 2024-08-20T05:04:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.765+0000 7f12bf000640 1 -- 172.21.15.37:0/2142151793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b0095540 msgr2=0x7f12b0095940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:45.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.765+0000 7f12bf000640 1 --2- 172.21.15.37:0/2142151793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b0095540 0x7f12b0095940 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009910 tx=0x7f12ac02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:45 smithi037 ceph-mon[17265]: pgmap v476: 129 pgs: 129 active+clean; 1006 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 562 op/s 2024-08-20T05:04:45.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.767+0000 7f12bf000640 1 -- 172.21.15.37:0/2142151793 shutdown_connections 2024-08-20T05:04:45.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.767+0000 7f12bf000640 1 --2- 172.21.15.37:0/2142151793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12b0097050 0x7f12b009d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.767+0000 7f12bf000640 1 --2- 172.21.15.37:0/2142151793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b0096690 0x7f12b0096b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.767+0000 7f12bf000640 1 --2- 172.21.15.37:0/2142151793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b0095540 0x7f12b0095940 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.767+0000 7f12bf000640 1 -- 172.21.15.37:0/2142151793 >> 172.21.15.37:0/2142151793 conn(0x7f12b0090de0 msgr2=0x7f12b0093220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:45.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.767+0000 7f12bf000640 1 -- 172.21.15.37:0/2142151793 shutdown_connections 2024-08-20T05:04:45.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.768+0000 7f12bf000640 1 -- 172.21.15.37:0/2142151793 wait complete. 2024-08-20T05:04:45.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.770+0000 7f12bf000640 1 Processor -- start 2024-08-20T05:04:45.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.771+0000 7f12bf000640 1 -- start start 2024-08-20T05:04:45.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.771+0000 7f12bf000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b0095540 0x7f12b0142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.772+0000 7f12bf000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b0096690 0x7f12b01434f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.772+0000 7f12bdc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b0095540 0x7f12b0142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:45.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.772+0000 7f12bdc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b0095540 0x7f12b0142ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:48778/0 (socket says 172.21.15.37:48778) 2024-08-20T05:04:45.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.772+0000 7f12bdc00640 1 -- 172.21.15.37:0/3068270047 learned_addr learned my addr 172.21.15.37:0/3068270047 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:45.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.772+0000 7f12bf000640 1 --2- 172.21.15.37:0/3068270047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12b0097050 0x7f12b0144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.772+0000 7f12bf000640 1 -- 172.21.15.37:0/3068270047 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12b00b2240 con 0x7f12b0097050 2024-08-20T05:04:45.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.772+0000 7f12bf000640 1 -- 172.21.15.37:0/3068270047 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f12b00b20c0 con 0x7f12b0095540 2024-08-20T05:04:45.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.772+0000 7f12bf000640 1 -- 172.21.15.37:0/3068270047 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12b00b23c0 con 0x7f12b0096690 2024-08-20T05:04:45.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.772+0000 7f12bd200640 1 --2- 172.21.15.37:0/3068270047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b0096690 0x7f12b01434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:45.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.773+0000 7f12be600640 1 --2- 172.21.15.37:0/3068270047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12b0097050 0x7f12b0144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:45.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.773+0000 7f12bdc00640 1 -- 172.21.15.37:0/3068270047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b0096690 msgr2=0x7f12b01434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:45.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.773+0000 7f12bdc00640 1 --2- 172.21.15.37:0/3068270047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b0096690 0x7f12b01434f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.773+0000 7f12bdc00640 1 -- 172.21.15.37:0/3068270047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12b0097050 msgr2=0x7f12b0144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:45.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.774+0000 7f12bdc00640 1 --2- 172.21.15.37:0/3068270047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12b0097050 0x7f12b0144120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.774+0000 7f12bdc00640 1 -- 172.21.15.37:0/3068270047 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12b01449e0 con 0x7f12b0095540 2024-08-20T05:04:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.774+0000 7f12be600640 1 --2- 172.21.15.37:0/3068270047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12b0097050 0x7f12b0144120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:04:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.774+0000 7f12bdc00640 1 --2- 172.21.15.37:0/3068270047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b0095540 0x7f12b0142ea0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009a30 tx=0x7f12ac005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.775+0000 7f12b6000640 1 -- 172.21.15.37:0/3068270047 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac005640 con 0x7f12b0095540 2024-08-20T05:04:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.775+0000 7f12bf000640 1 -- 172.21.15.37:0/3068270047 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12b0144c70 con 0x7f12b0095540 2024-08-20T05:04:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.775+0000 7f12b6000640 1 -- 172.21.15.37:0/3068270047 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12ac031400 con 0x7f12b0095540 2024-08-20T05:04:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.775+0000 7f12b6000640 1 -- 172.21.15.37:0/3068270047 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac004a30 con 0x7f12b0095540 2024-08-20T05:04:45.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.775+0000 7f12bf000640 1 -- 172.21.15.37:0/3068270047 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12b014b3a0 con 0x7f12b0095540 2024-08-20T05:04:45.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.782+0000 7f12c348b740 1 Processor -- start 2024-08-20T05:04:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.783+0000 7f12c348b740 1 -- start start 2024-08-20T05:04:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.783+0000 7f12c348b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613dc480 0x5631613de870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.783+0000 7f12c348b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dedb0 0x5631613e11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.783+0000 7f12c348b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613e17f0 0x5631613e3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.783+0000 7f12c348b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56316134f210 con 0x5631613dedb0 2024-08-20T05:04:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.783+0000 7f12c348b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56316133e710 con 0x5631613dc480 2024-08-20T05:04:45.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.783+0000 7f12c348b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563161342750 con 0x5631613e17f0 2024-08-20T05:04:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.783+0000 7f12bd200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613e17f0 0x5631613e3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.784+0000 7f12bd200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613e17f0 0x5631613e3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46014/0 (socket says 172.21.15.37:46014) 2024-08-20T05:04:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.784+0000 7f12bd200640 1 -- 172.21.15.37:0/1675400479 learned_addr learned my addr 172.21.15.37:0/1675400479 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.784+0000 7f12be600640 1 --2- 172.21.15.37:0/1675400479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613dc480 0x5631613de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:45.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.784+0000 7f12bd200640 1 -- 172.21.15.37:0/1675400479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613dc480 msgr2=0x5631613de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.784+0000 7f12bd200640 1 --2- 172.21.15.37:0/1675400479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613dc480 0x5631613de870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.784+0000 7f12bd200640 1 -- 172.21.15.37:0/1675400479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dedb0 msgr2=0x5631613e11a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:04:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.784+0000 7f12bd200640 1 --2- 172.21.15.37:0/1675400479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dedb0 0x5631613e11a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.784+0000 7f12bd200640 1 -- 172.21.15.37:0/1675400479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56316130ade0 con 0x5631613e17f0 2024-08-20T05:04:45.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.784+0000 7f12bd200640 1 --2- 172.21.15.37:0/1675400479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613e17f0 0x5631613e3cb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009d20 tx=0x7f12a4011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aeac001201c3fb90 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.786+0000 7f12aaa00640 1 -- 172.21.15.37:0/1675400479 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a401e070 con 0x5631613e17f0 2024-08-20T05:04:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.787+0000 7f12aaa00640 1 -- 172.21.15.37:0/1675400479 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12a4019ae0 con 0x5631613e17f0 2024-08-20T05:04:45.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.787+0000 7f12aaa00640 1 -- 172.21.15.37:0/1675400479 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a400ea80 con 0x5631613e17f0 2024-08-20T05:04:45.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.788+0000 7f12b6000640 1 -- 172.21.15.37:0/3068270047 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f12ac039040 con 0x7f12b0095540 2024-08-20T05:04:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.792+0000 7f12b6000640 1 --2- 172.21.15.37:0/3068270047 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f12a00b3c90 0x7f12a00b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.793+0000 7f12b6000640 1 -- 172.21.15.37:0/3068270047 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f12ac104e60 con 0x7f12b0095540 2024-08-20T05:04:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.793+0000 7f12c348b740 1 -- 172.21.15.37:0/1675400479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613e17f0 msgr2=0x5631613e3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:45.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.793+0000 7f12c348b740 1 --2- 172.21.15.37:0/1675400479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613e17f0 0x5631613e3cb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f12a4009d20 tx=0x7f12a4011810 comp rx=0 tx=0).stop 2024-08-20T05:04:45.795 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.794+0000 7f12be600640 1 --2- 172.21.15.37:0/3068270047 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f12a00b3c90 0x7f12a00b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.795+0000 7f12c348b740 1 -- 172.21.15.37:0/1675400479 shutdown_connections 2024-08-20T05:04:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.795+0000 7f12c348b740 1 --2- 172.21.15.37:0/1675400479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613e17f0 0x5631613e3cb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.795+0000 7f12c348b740 1 --2- 172.21.15.37:0/1675400479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dedb0 0x5631613e11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.795+0000 7f12c348b740 1 --2- 172.21.15.37:0/1675400479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613dc480 0x5631613de870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.796 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.795+0000 7f12c348b740 1 -- 172.21.15.37:0/1675400479 >> 172.21.15.37:0/1675400479 conn(0x5631613d7580 msgr2=0x5631613d8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.796+0000 7f12c348b740 1 -- 172.21.15.37:0/1675400479 shutdown_connections 2024-08-20T05:04:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.796+0000 7f12c348b740 1 -- 172.21.15.37:0/1675400479 wait complete. 2024-08-20T05:04:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.796+0000 7f12be600640 1 --2- 172.21.15.37:0/3068270047 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f12a00b3c90 0x7f12a00b6150 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f12b8068b40 tx=0x7f12b806d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:45.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.796+0000 7f12c348b740 1 -- start start 2024-08-20T05:04:45.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.797+0000 7f12c348b740 1 Processor -- start 2024-08-20T05:04:45.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.798+0000 7f12c348b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dc480 0x5631613e5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.798+0000 7f12c348b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613dedb0 0x5631613e6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.798+0000 7f12c348b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613e17f0 0x5631613e7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.798+0000 7f12c348b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563161277ab0 con 0x5631613dc480 2024-08-20T05:04:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.798+0000 7f12c348b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5631612e5140 con 0x5631613e17f0 2024-08-20T05:04:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.798+0000 7f12c348b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5631613e47d0 con 0x5631613dedb0 2024-08-20T05:04:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.798+0000 7f12c348b740 10 client.0 _ll_register_callbacks cb 0x5631612f85d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.798+0000 7f12bdc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dc480 0x5631613e5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.799+0000 7f12bdc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dc480 0x5631613e5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42488/0 (socket says 172.21.15.37:42488) 2024-08-20T05:04:45.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.799+0000 7f12bdc00640 1 -- 172.21.15.37:0/3020281500 learned_addr learned my addr 172.21.15.37:0/3020281500 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.800+0000 7f12bd200640 1 --2- 172.21.15.37:0/3020281500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613dedb0 0x5631613e6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.800+0000 7f12bdc00640 1 -- 172.21.15.37:0/3020281500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613dedb0 msgr2=0x5631613e6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.800+0000 7f12bdc00640 1 --2- 172.21.15.37:0/3020281500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613dedb0 0x5631613e6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.800+0000 7f12bdc00640 1 -- 172.21.15.37:0/3020281500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613e17f0 msgr2=0x5631613e7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.800+0000 7f12bdc00640 1 --2- 172.21.15.37:0/3020281500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613e17f0 0x5631613e7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.800+0000 7f12bdc00640 1 -- 172.21.15.37:0/3020281500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631612e6170 con 0x5631613dc480 2024-08-20T05:04:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.800+0000 7f12bdc00640 1 --2- 172.21.15.37:0/3020281500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dc480 0x5631613e5fa0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f12ac02a9e0 tx=0x7f12ac0d4400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d54df3828ccaf1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:45.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.801+0000 7f129f400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:04:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.802+0000 7f129f400640 1 -- 172.21.15.37:0/3020281500 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac0cc110 con 0x5631613dc480 2024-08-20T05:04:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.802+0000 7f129f400640 1 -- 172.21.15.37:0/3020281500 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f12ac0318b0 con 0x5631613dc480 2024-08-20T05:04:45.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.802+0000 7f12c348b740 1 -- 172.21.15.37:0/3020281500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563161315a30 con 0x5631613dc480 2024-08-20T05:04:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.803+0000 7f129f400640 1 -- 172.21.15.37:0/3020281500 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f12ac0eb050 con 0x5631613dc480 2024-08-20T05:04:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.804+0000 7f12c348b740 10 client.16017 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:45.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.804+0000 7f12c348b740 1 -- 172.21.15.37:0/3020281500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5631610a1790 con 0x5631613dc480 2024-08-20T05:04:45.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.805+0000 7f129f400640 1 -- 172.21.15.37:0/3020281500 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563161315a30 con 0x5631613dc480 2024-08-20T05:04:45.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.805+0000 7f129f400640 1 -- 172.21.15.37:0/3020281500 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f12ac04c030 con 0x5631613dc480 2024-08-20T05:04:45.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.805+0000 7f12c348b740 10 client.16017 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:45.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.805+0000 7f12c348b740 10 client.16017 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:04:45.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.805+0000 7f12c348b740 20 client.16017 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:45.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.805+0000 7f12c348b740 1 --2- 172.21.15.37:0/3020281500 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5631613f1c00 0x5631613f40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.805+0000 7f12c348b740 4 client.16017 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:04:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.805+0000 7f12c348b740 1 -- 172.21.15.37:0/3020281500 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563161351160 con 0x5631613f1c00 2024-08-20T05:04:45.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.806+0000 7f12bd200640 1 --2- 172.21.15.37:0/3020281500 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5631613f1c00 0x5631613f40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.807+0000 7f12bd200640 1 --2- 172.21.15.37:0/3020281500 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5631613f1c00 0x5631613f40c0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f390807759861504 server_cookie=c69124d3abd03bce in_seq=0 out_seq=0 2024-08-20T05:04:45.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.807+0000 7f129f400640 10 client.16017 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.808+0000 7f129f400640 1 -- 172.21.15.37:0/3020281500 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563161351160 con 0x5631613f1c00 2024-08-20T05:04:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.808+0000 7f129f400640 10 client.16017 handle_command_reply: tid=0 2024-08-20T05:04:45.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.809+0000 7f12c348b740 1 client.16017 shutdown 2024-08-20T05:04:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.809+0000 7f12c348b740 1 -- 172.21.15.37:0/3020281500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dc480 msgr2=0x5631613e5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.809+0000 7f12c348b740 1 --2- 172.21.15.37:0/3020281500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dc480 0x5631613e5fa0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f12ac02a9e0 tx=0x7f12ac0d4400 comp rx=0 tx=0).stop 2024-08-20T05:04:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.809+0000 7f12c348b740 1 -- 172.21.15.37:0/3020281500 shutdown_connections 2024-08-20T05:04:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.809+0000 7f12c348b740 1 --2- 172.21.15.37:0/3020281500 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5631613f1c00 0x5631613f40c0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.809+0000 7f12c348b740 1 --2- 172.21.15.37:0/3020281500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613e17f0 0x5631613e7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.809+0000 7f12c348b740 1 --2- 172.21.15.37:0/3020281500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613dedb0 0x5631613e6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.809+0000 7f12c348b740 1 --2- 172.21.15.37:0/3020281500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dc480 0x5631613e5fa0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.809+0000 7f12c348b740 1 -- 172.21.15.37:0/3020281500 >> 172.21.15.37:0/3020281500 conn(0x5631613d7580 msgr2=0x5631613d66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.810+0000 7f129f400640 0 client.16017 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.810+0000 7f12c348b740 1 -- 172.21.15.37:0/3020281500 shutdown_connections 2024-08-20T05:04:45.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.810+0000 7f12c348b740 1 -- 172.21.15.37:0/3020281500 wait complete. 2024-08-20T05:04:45.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.810+0000 7f12c348b740 20 client.16017 trim_cache size 0 max 16384 2024-08-20T05:04:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.843+0000 7f12c348b740 1 Processor -- start 2024-08-20T05:04:45.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.843+0000 7f12c348b740 1 -- start start 2024-08-20T05:04:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.843+0000 7f12c348b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dc480 0x5631613d7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.843+0000 7f12c348b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613dedb0 0x5631613d8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.843+0000 7f12c348b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613e17f0 0x5631613da7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.843+0000 7f12c348b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12b0155680 con 0x5631613dc480 2024-08-20T05:04:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.843+0000 7f12c348b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f12b0157280 con 0x5631613e17f0 2024-08-20T05:04:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.843+0000 7f12c348b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12b0155d50 con 0x5631613dedb0 2024-08-20T05:04:45.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.844+0000 7f12be600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613e17f0 0x5631613da7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.844+0000 7f12be600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613e17f0 0x5631613da7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:48806/0 (socket says 172.21.15.37:48806) 2024-08-20T05:04:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.844+0000 7f12be600640 1 -- 172.21.15.37:0/2944511528 learned_addr learned my addr 172.21.15.37:0/2944511528 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.844+0000 7f12bd200640 1 --2- 172.21.15.37:0/2944511528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613dedb0 0x5631613d8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:45.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.845+0000 7f12bdc00640 1 --2- 172.21.15.37:0/2944511528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dc480 0x5631613d7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.845+0000 7f12be600640 1 -- 172.21.15.37:0/2944511528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613dedb0 msgr2=0x5631613d8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.845+0000 7f12be600640 1 --2- 172.21.15.37:0/2944511528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613dedb0 0x5631613d8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.845+0000 7f12be600640 1 -- 172.21.15.37:0/2944511528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dc480 msgr2=0x5631613d7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.845+0000 7f12be600640 1 --2- 172.21.15.37:0/2944511528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dc480 0x5631613d7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.845+0000 7f12be600640 1 -- 172.21.15.37:0/2944511528 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56316111a620 con 0x5631613e17f0 2024-08-20T05:04:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.848+0000 7f12be600640 1 --2- 172.21.15.37:0/2944511528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613e17f0 0x5631613da7f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f12b8052510 tx=0x7f12b8068df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96eff5816c00a24d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.848+0000 7f12aa000640 1 -- 172.21.15.37:0/2944511528 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b8089070 con 0x5631613e17f0 2024-08-20T05:04:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.849+0000 7f12aa000640 1 -- 172.21.15.37:0/2944511528 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12b807bdb0 con 0x5631613e17f0 2024-08-20T05:04:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.849+0000 7f12aa000640 1 -- 172.21.15.37:0/2944511528 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b807e040 con 0x5631613e17f0 2024-08-20T05:04:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.850+0000 7f12c348b740 1 -- 172.21.15.37:0/2944511528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613e17f0 msgr2=0x5631613da7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.850+0000 7f12c348b740 1 --2- 172.21.15.37:0/2944511528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613e17f0 0x5631613da7f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f12b8052510 tx=0x7f12b8068df0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.850+0000 7f12c348b740 1 -- 172.21.15.37:0/2944511528 shutdown_connections 2024-08-20T05:04:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.850+0000 7f12c348b740 1 --2- 172.21.15.37:0/2944511528 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613e17f0 0x5631613da7f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.850+0000 7f12c348b740 1 --2- 172.21.15.37:0/2944511528 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613dedb0 0x5631613d8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.850+0000 7f12c348b740 1 --2- 172.21.15.37:0/2944511528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dc480 0x5631613d7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.851+0000 7f12c348b740 1 -- 172.21.15.37:0/2944511528 >> 172.21.15.37:0/2944511528 conn(0x5631613d7580 msgr2=0x5631613e1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.851+0000 7f12c348b740 1 -- 172.21.15.37:0/2944511528 shutdown_connections 2024-08-20T05:04:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.851+0000 7f12c348b740 1 -- 172.21.15.37:0/2944511528 wait complete. 2024-08-20T05:04:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.852+0000 7f12c348b740 1 -- start start 2024-08-20T05:04:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.852+0000 7f12c348b740 1 Processor -- start 2024-08-20T05:04:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.853+0000 7f12c348b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dc480 0x5631613ed500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.853+0000 7f12c348b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613dedb0 0x5631613edb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.854+0000 7f12c348b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613e17f0 0x56316145a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.854+0000 7f12c348b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12b0156af0 con 0x5631613dc480 2024-08-20T05:04:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.854+0000 7f12c348b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f12b0156420 con 0x5631613dedb0 2024-08-20T05:04:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.854+0000 7f12c348b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12b0153660 con 0x5631613e17f0 2024-08-20T05:04:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.854+0000 7f12be600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613e17f0 0x56316145a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.854+0000 7f12be600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613e17f0 0x56316145a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46036/0 (socket says 172.21.15.37:46036) 2024-08-20T05:04:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.854+0000 7f12be600640 1 -- 172.21.15.37:0/3290358011 learned_addr learned my addr 172.21.15.37:0/3290358011 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.854+0000 7f12c348b740 10 client.0 _ll_register_callbacks cb 0x7f12ac005b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.854+0000 7f12bd200640 1 --2- 172.21.15.37:0/3290358011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613dedb0 0x5631613edb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.855+0000 7f12be600640 1 -- 172.21.15.37:0/3290358011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613dedb0 msgr2=0x5631613edb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.855+0000 7f12be600640 1 --2- 172.21.15.37:0/3290358011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613dedb0 0x5631613edb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.855+0000 7f12be600640 1 -- 172.21.15.37:0/3290358011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dc480 msgr2=0x5631613ed500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.855+0000 7f12be600640 1 --2- 172.21.15.37:0/3290358011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dc480 0x5631613ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.855+0000 7f12be600640 1 -- 172.21.15.37:0/3290358011 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56316145aed0 con 0x5631613e17f0 2024-08-20T05:04:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.855+0000 7f12be600640 1 --2- 172.21.15.37:0/3290358011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613e17f0 0x56316145a990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f12b80685f0 tx=0x7f12b8064400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70b5a4d607dce3b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:45.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.855+0000 7f129f400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:04:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.856+0000 7f129f400640 1 -- 172.21.15.37:0/3290358011 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b8089050 con 0x5631613e17f0 2024-08-20T05:04:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.857+0000 7f129f400640 1 -- 172.21.15.37:0/3290358011 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f12b80855e0 con 0x5631613e17f0 2024-08-20T05:04:45.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.857+0000 7f12c348b740 1 -- 172.21.15.37:0/3290358011 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12b807bdb0 con 0x5631613e17f0 2024-08-20T05:04:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.858+0000 7f129f400640 1 -- 172.21.15.37:0/3290358011 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f12b807e040 con 0x5631613e17f0 2024-08-20T05:04:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.858+0000 7f12c348b740 10 client.26182 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:45.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.858+0000 7f12c348b740 1 -- 172.21.15.37:0/3290358011 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56316145c0a0 con 0x5631613e17f0 2024-08-20T05:04:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.859+0000 7f129f400640 1 -- 172.21.15.37:0/3290358011 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12b807bdb0 con 0x5631613e17f0 2024-08-20T05:04:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.859+0000 7f129f400640 1 -- 172.21.15.37:0/3290358011 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f12b8084040 con 0x5631613e17f0 2024-08-20T05:04:45.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.859+0000 7f12c348b740 10 client.26182 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.859+0000 7f12c348b740 10 client.26182 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:04:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.859+0000 7f12c348b740 20 client.26182 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.860+0000 7f12c348b740 1 --2- 172.21.15.37:0/3290358011 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56316145cac0 0x56316145eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.860+0000 7f12c348b740 4 client.26182 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:04:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.860+0000 7f12c348b740 1 -- 172.21.15.37:0/3290358011 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5631613dc260 con 0x56316145cac0 2024-08-20T05:04:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.860+0000 7f12bdc00640 1 --2- 172.21.15.37:0/3290358011 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56316145cac0 0x56316145eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.861+0000 7f12bdc00640 1 --2- 172.21.15.37:0/3290358011 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56316145cac0 0x56316145eee0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=350a400f93bf2caf server_cookie=3296fccce302b173 in_seq=0 out_seq=0 2024-08-20T05:04:45.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.861+0000 7f129f400640 10 client.26182 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:45 smithi135 ceph-mon[22342]: pgmap v476: 129 pgs: 129 active+clean; 1006 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 562 op/s 2024-08-20T05:04:45.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.893+0000 7f129f400640 1 -- 172.21.15.37:0/3290358011 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5631613dc260 con 0x56316145cac0 2024-08-20T05:04:45.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.893+0000 7f129f400640 10 client.26182 handle_command_reply: tid=0 2024-08-20T05:04:45.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.894+0000 7f12c348b740 1 client.26182 shutdown 2024-08-20T05:04:45.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.894+0000 7f12c348b740 1 -- 172.21.15.37:0/3290358011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613e17f0 msgr2=0x56316145a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:45.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.894+0000 7f12c348b740 1 --2- 172.21.15.37:0/3290358011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613e17f0 0x56316145a990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f12b80685f0 tx=0x7f12b8064400 comp rx=0 tx=0).stop 2024-08-20T05:04:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.895+0000 7f12c348b740 1 -- 172.21.15.37:0/3290358011 shutdown_connections 2024-08-20T05:04:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.895+0000 7f12c348b740 1 --2- 172.21.15.37:0/3290358011 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56316145cac0 0x56316145eee0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.895+0000 7f129f400640 0 client.26182 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.895+0000 7f12c348b740 1 --2- 172.21.15.37:0/3290358011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631613e17f0 0x56316145a990 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.895+0000 7f12c348b740 1 --2- 172.21.15.37:0/3290358011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631613dedb0 0x5631613edb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.895+0000 7f12c348b740 1 --2- 172.21.15.37:0/3290358011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631613dc480 0x5631613ed500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.895+0000 7f12c348b740 1 -- 172.21.15.37:0/3290358011 >> 172.21.15.37:0/3290358011 conn(0x5631613d7580 msgr2=0x5631613e1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.896+0000 7f12c348b740 1 -- 172.21.15.37:0/3290358011 shutdown_connections 2024-08-20T05:04:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.896+0000 7f12c348b740 1 -- 172.21.15.37:0/3290358011 wait complete. 2024-08-20T05:04:45.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.896+0000 7f12c348b740 20 client.26182 trim_cache size 0 max 16384 2024-08-20T05:04:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:04:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:04:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:04:45.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.898+0000 7f12bf000640 1 -- 172.21.15.37:0/3068270047 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f12a00b3c90 msgr2=0x7f12a00b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.898+0000 7f12bf000640 1 --2- 172.21.15.37:0/3068270047 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f12a00b3c90 0x7f12a00b6150 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f12b8068b40 tx=0x7f12b806d040 comp rx=0 tx=0).stop 2024-08-20T05:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.898+0000 7f12bf000640 1 -- 172.21.15.37:0/3068270047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b0095540 msgr2=0x7f12b0142ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.898+0000 7f12bf000640 1 --2- 172.21.15.37:0/3068270047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b0095540 0x7f12b0142ea0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009a30 tx=0x7f12ac005040 comp rx=0 tx=0).stop 2024-08-20T05:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.898+0000 7f12bf000640 1 -- 172.21.15.37:0/3068270047 shutdown_connections 2024-08-20T05:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.898+0000 7f12bf000640 1 --2- 172.21.15.37:0/3068270047 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f12a00b3c90 0x7f12a00b6150 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.898+0000 7f12bf000640 1 --2- 172.21.15.37:0/3068270047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12b0097050 0x7f12b0144120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.898+0000 7f12bf000640 1 --2- 172.21.15.37:0/3068270047 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12b0096690 0x7f12b01434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.898+0000 7f12bf000640 1 --2- 172.21.15.37:0/3068270047 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12b0095540 0x7f12b0142ea0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.898+0000 7f12bf000640 1 -- 172.21.15.37:0/3068270047 >> 172.21.15.37:0/3068270047 conn(0x7f12b0090de0 msgr2=0x7f12b0092d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.899+0000 7f12bf000640 1 -- 172.21.15.37:0/3068270047 shutdown_connections 2024-08-20T05:04:45.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:45.899+0000 7f12bf000640 1 -- 172.21.15.37:0/3068270047 wait complete. 2024-08-20T05:04:47.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:47 smithi130 ceph-mon[22007]: pgmap v477: 129 pgs: 129 active+clean; 1014 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 671 op/s 2024-08-20T05:04:47.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:47 smithi037 ceph-mon[17265]: pgmap v477: 129 pgs: 129 active+clean; 1014 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 671 op/s 2024-08-20T05:04:47.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:47 smithi135 ceph-mon[22342]: pgmap v477: 129 pgs: 129 active+clean; 1014 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 671 op/s 2024-08-20T05:04:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 110.0 s, 3247.2 tps, lat 31.264 ms stddev 32.365 2024-08-20T05:04:49.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:49 smithi130 ceph-mon[22007]: pgmap v478: 129 pgs: 129 active+clean; 1018 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 8.3 MiB/s wr, 697 op/s 2024-08-20T05:04:49.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:49 smithi037 ceph-mon[17265]: pgmap v478: 129 pgs: 129 active+clean; 1018 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 8.3 MiB/s wr, 697 op/s 2024-08-20T05:04:49.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:49 smithi135 ceph-mon[22342]: pgmap v478: 129 pgs: 129 active+clean; 1018 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 8.3 MiB/s wr, 697 op/s 2024-08-20T05:04:51.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:51 smithi130 ceph-mon[22007]: pgmap v479: 129 pgs: 129 active+clean; 1019 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.8 MiB/s wr, 751 op/s 2024-08-20T05:04:51.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:51 smithi037 ceph-mon[17265]: pgmap v479: 129 pgs: 129 active+clean; 1019 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.8 MiB/s wr, 751 op/s 2024-08-20T05:04:51.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:51 smithi135 ceph-mon[22342]: pgmap v479: 129 pgs: 129 active+clean; 1019 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 8.8 MiB/s wr, 751 op/s 2024-08-20T05:04:52.245 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.4 2024-08-20T05:04:52.245 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:04:52.933 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:04:53.040 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 115.0 s, 1536.6 tps, lat 63.340 ms stddev 75.418 2024-08-20T05:04:53.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:53 smithi130 ceph-mon[22007]: pgmap v480: 129 pgs: 129 active+clean; 1019 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 660 op/s 2024-08-20T05:04:53.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:53 smithi037 ceph-mon[17265]: pgmap v480: 129 pgs: 129 active+clean; 1019 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 660 op/s 2024-08-20T05:04:53.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:53 smithi135 ceph-mon[22342]: pgmap v480: 129 pgs: 129 active+clean; 1019 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 660 op/s 2024-08-20T05:04:55.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:55 smithi130 ceph-mon[22007]: pgmap v481: 129 pgs: 129 active+clean; 1019 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.7 MiB/s wr, 744 op/s 2024-08-20T05:04:55.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:55 smithi037 ceph-mon[17265]: pgmap v481: 129 pgs: 129 active+clean; 1019 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.7 MiB/s wr, 744 op/s 2024-08-20T05:04:55.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:55 smithi135 ceph-mon[22342]: pgmap v481: 129 pgs: 129 active+clean; 1019 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.7 MiB/s wr, 744 op/s 2024-08-20T05:04:56.396 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:04:57.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:57 smithi130 ceph-mon[22007]: pgmap v482: 129 pgs: 129 active+clean; 1020 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.1 MiB/s wr, 660 op/s 2024-08-20T05:04:57.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:57 smithi037 ceph-mon[17265]: pgmap v482: 129 pgs: 129 active+clean; 1020 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.1 MiB/s wr, 660 op/s 2024-08-20T05:04:57.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:57 smithi135 ceph-mon[22342]: pgmap v482: 129 pgs: 129 active+clean; 1020 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.1 MiB/s wr, 660 op/s 2024-08-20T05:04:58.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 120.0 s, 554.8 tps, lat 159.730 ms stddev 285.919 2024-08-20T05:04:58.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.727+0000 7ff5d4e00640 1 -- 172.21.15.37:0/3580308689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5d0107cd0 msgr2=0x7ff5d01131f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:58.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.727+0000 7ff5d4e00640 1 --2- 172.21.15.37:0/3580308689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5d0107cd0 0x7ff5d01131f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8009860 tx=0x7ff5b802a360 comp rx=0 tx=0).stop 2024-08-20T05:04:58.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.730+0000 7ff5d4e00640 1 -- 172.21.15.37:0/3580308689 shutdown_connections 2024-08-20T05:04:58.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.731+0000 7ff5d4e00640 1 --2- 172.21.15.37:0/3580308689 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5d0113730 0x7ff5d0115b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:58.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.731+0000 7ff5d4e00640 1 --2- 172.21.15.37:0/3580308689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5d0107cd0 0x7ff5d01131f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:58.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.731+0000 7ff5d4e00640 1 --2- 172.21.15.37:0/3580308689 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d01073b0 0x7ff5d0107790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:58.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.731+0000 7ff5d4e00640 1 -- 172.21.15.37:0/3580308689 >> 172.21.15.37:0/3580308689 conn(0x7ff5d0076cc0 msgr2=0x7ff5d00770d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:58.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.731+0000 7ff5d4e00640 1 -- 172.21.15.37:0/3580308689 shutdown_connections 2024-08-20T05:04:58.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.731+0000 7ff5d4e00640 1 -- 172.21.15.37:0/3580308689 wait complete. 2024-08-20T05:04:58.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.733+0000 7ff5d4e00640 1 Processor -- start 2024-08-20T05:04:58.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.733+0000 7ff5d4e00640 1 -- start start 2024-08-20T05:04:58.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.733+0000 7ff5d4e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5d01073b0 0x7ff5d0102bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:58.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.733+0000 7ff5d4e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d0107cd0 0x7ff5d0103100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:58.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.734+0000 7ff5d4e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5d0113730 0x7ff5d019c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:58.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.734+0000 7ff5d4e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d010b270 con 0x7ff5d0113730 2024-08-20T05:04:58.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.734+0000 7ff5d4e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d010b0f0 con 0x7ff5d01073b0 2024-08-20T05:04:58.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.734+0000 7ff5d4e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d010b3f0 con 0x7ff5d0107cd0 2024-08-20T05:04:58.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.734+0000 7ff5cde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5d01073b0 0x7ff5d0102bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:58.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.734+0000 7ff5cde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5d01073b0 0x7ff5d0102bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:57270/0 (socket says 172.21.15.37:57270) 2024-08-20T05:04:58.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.734+0000 7ff5cde00640 1 -- 172.21.15.37:0/2668690922 learned_addr learned my addr 172.21.15.37:0/2668690922 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:58.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.734+0000 7ff5cd400640 1 --2- 172.21.15.37:0/2668690922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d0107cd0 0x7ff5d0103100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:58.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.734+0000 7ff5ce800640 1 --2- 172.21.15.37:0/2668690922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5d0113730 0x7ff5d019c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:58.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.735+0000 7ff5ce800640 1 -- 172.21.15.37:0/2668690922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d0107cd0 msgr2=0x7ff5d0103100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:58.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.735+0000 7ff5ce800640 1 --2- 172.21.15.37:0/2668690922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d0107cd0 0x7ff5d0103100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:58.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.735+0000 7ff5ce800640 1 -- 172.21.15.37:0/2668690922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5d01073b0 msgr2=0x7ff5d0102bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:58.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.735+0000 7ff5ce800640 1 --2- 172.21.15.37:0/2668690922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5d01073b0 0x7ff5d0102bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:58.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.735+0000 7ff5ce800640 1 -- 172.21.15.37:0/2668690922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d019cef0 con 0x7ff5d0113730 2024-08-20T05:04:58.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.736+0000 7ff5ce800640 1 --2- 172.21.15.37:0/2668690922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5d0113730 0x7ff5d019c720 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800bdf0 tx=0x7ff5c800bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:58.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.737+0000 7ff5c6a00640 1 -- 172.21.15.37:0/2668690922 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8019070 con 0x7ff5d0113730 2024-08-20T05:04:58.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.737+0000 7ff5c6a00640 1 -- 172.21.15.37:0/2668690922 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5c80148f0 con 0x7ff5d0113730 2024-08-20T05:04:58.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.737+0000 7ff5c6a00640 1 -- 172.21.15.37:0/2668690922 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c80128c0 con 0x7ff5d0113730 2024-08-20T05:04:58.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.738+0000 7ff5d4e00640 1 -- 172.21.15.37:0/2668690922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d019d1e0 con 0x7ff5d0113730 2024-08-20T05:04:58.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.738+0000 7ff5d4e00640 1 -- 172.21.15.37:0/2668690922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d01a38a0 con 0x7ff5d0113730 2024-08-20T05:04:58.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.746+0000 7ff5d4e00640 1 -- 172.21.15.37:0/2668690922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5d006abb0 con 0x7ff5d0113730 2024-08-20T05:04:58.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.747+0000 7ff5c6a00640 1 -- 172.21.15.37:0/2668690922 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff5c8014aa0 con 0x7ff5d0113730 2024-08-20T05:04:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.751+0000 7ff5c6a00640 1 --2- 172.21.15.37:0/2668690922 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5b40b3d20 0x7ff5b40b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:58.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.751+0000 7ff5c6a00640 1 -- 172.21.15.37:0/2668690922 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff5c80e39c0 con 0x7ff5d0113730 2024-08-20T05:04:58.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.753+0000 7ff5cde00640 1 --2- 172.21.15.37:0/2668690922 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5b40b3d20 0x7ff5b40b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:58.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.758+0000 7ff5cde00640 1 --2- 172.21.15.37:0/2668690922 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5b40b3d20 0x7ff5b40b61e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0005fd0 tx=0x7ff5c001c2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:58.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:58.766+0000 7ff5c6a00640 1 -- 172.21.15.37:0/2668690922 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff5c8051e20 con 0x7ff5d0113730 2024-08-20T05:04:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:04:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.103+0000 7fdc80e00640 1 -- 172.21.15.37:0/529588313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc7c10abd0 msgr2=0x7fdc7c111530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.103+0000 7fdc80e00640 1 --2- 172.21.15.37:0/529588313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc7c10abd0 0x7fdc7c111530 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdc74009ca0 tx=0x7fdc7402a8d0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.104+0000 7fdc80e00640 1 -- 172.21.15.37:0/529588313 shutdown_connections 2024-08-20T05:04:59.105 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.104+0000 7fdc80e00640 1 --2- 172.21.15.37:0/529588313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc7c10abd0 0x7fdc7c111530 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.104+0000 7fdc80e00640 1 --2- 172.21.15.37:0/529588313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc7c10a210 0x7fdc7c10a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.105+0000 7fdc80e00640 1 --2- 172.21.15.37:0/529588313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c0742d0 0x7fdc7c0746d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.105+0000 7fdc80e00640 1 -- 172.21.15.37:0/529588313 >> 172.21.15.37:0/529588313 conn(0x7fdc7c06f740 msgr2=0x7fdc7c071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:59.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.107+0000 7fdc80e00640 1 -- 172.21.15.37:0/529588313 shutdown_connections 2024-08-20T05:04:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.107+0000 7fdc80e00640 1 -- 172.21.15.37:0/529588313 wait complete. 2024-08-20T05:04:59.109 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.108+0000 7fdc80e00640 1 Processor -- start 2024-08-20T05:04:59.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.109+0000 7fdc80e00640 1 -- start start 2024-08-20T05:04:59.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.109+0000 7fdc80e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c0742d0 0x7fdc7c19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.110+0000 7fdc80e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc7c10a210 0x7fdc7c19f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.110+0000 7fdc80e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc7c10abd0 0x7fdc7c1a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.110+0000 7fdc80e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1148f0 con 0x7fdc7c0742d0 2024-08-20T05:04:59.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.110+0000 7fdc80e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c114770 con 0x7fdc7c10abd0 2024-08-20T05:04:59.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.110+0000 7fdc80e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c114a70 con 0x7fdc7c10a210 2024-08-20T05:04:59.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.111+0000 7fdc79400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc7c10a210 0x7fdc7c19f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.111+0000 7fdc79e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c0742d0 0x7fdc7c19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.111+0000 7fdc79e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c0742d0 0x7fdc7c19efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35252/0 (socket says 172.21.15.37:35252) 2024-08-20T05:04:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.111+0000 7fdc79e00640 1 -- 172.21.15.37:0/2404073117 learned_addr learned my addr 172.21.15.37:0/2404073117 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.112+0000 7fdc7a800640 1 --2- 172.21.15.37:0/2404073117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc7c10abd0 0x7fdc7c1a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.112+0000 7fdc79e00640 1 -- 172.21.15.37:0/2404073117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc7c10a210 msgr2=0x7fdc7c19f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.112+0000 7fdc79e00640 1 --2- 172.21.15.37:0/2404073117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc7c10a210 0x7fdc7c19f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.112+0000 7fdc79e00640 1 -- 172.21.15.37:0/2404073117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc7c10abd0 msgr2=0x7fdc7c1a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.112+0000 7fdc79e00640 1 --2- 172.21.15.37:0/2404073117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc7c10abd0 0x7fdc7c1a0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.112+0000 7fdc79e00640 1 -- 172.21.15.37:0/2404073117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7c1a0af0 con 0x7fdc7c0742d0 2024-08-20T05:04:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.113+0000 7fdc79e00640 1 --2- 172.21.15.37:0/2404073117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c0742d0 0x7fdc7c19efb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c00ea60 tx=0x7fdc6c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.114+0000 7fdc72a00640 1 -- 172.21.15.37:0/2404073117 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c00cde0 con 0x7fdc7c0742d0 2024-08-20T05:04:59.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.114+0000 7fdc80e00640 1 -- 172.21.15.37:0/2404073117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc7c1a0de0 con 0x7fdc7c0742d0 2024-08-20T05:04:59.115 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.114+0000 7fdc72a00640 1 -- 172.21.15.37:0/2404073117 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc6c0035f0 con 0x7fdc7c0742d0 2024-08-20T05:04:59.115 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.114+0000 7fdc72a00640 1 -- 172.21.15.37:0/2404073117 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c018690 con 0x7fdc7c0742d0 2024-08-20T05:04:59.115 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.115+0000 7fdc80e00640 1 -- 172.21.15.37:0/2404073117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc7c1a54a0 con 0x7fdc7c0742d0 2024-08-20T05:04:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.126+0000 7fdc83c01740 1 Processor -- start 2024-08-20T05:04:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.128+0000 7fdc72a00640 1 -- 172.21.15.37:0/2404073117 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdc6c003a10 con 0x7fdc7c0742d0 2024-08-20T05:04:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.128+0000 7fdc83c01740 1 -- start start 2024-08-20T05:04:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.129+0000 7fdc83c01740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 0x55c00f12fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.129+0000 7fdc83c01740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c00f12ff40 0x55c00f132330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.129+0000 7fdc83c01740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f132980 0x55c00f134e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.129+0000 7fdc83c01740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c00f0a0210 con 0x55c00f12ff40 2024-08-20T05:04:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.129+0000 7fdc83c01740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c00f08f710 con 0x55c00f12d610 2024-08-20T05:04:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.129+0000 7fdc83c01740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c00f093750 con 0x55c00f132980 2024-08-20T05:04:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.129+0000 7fdc7a800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 0x55c00f12fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.130+0000 7fdc7a800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 0x55c00f12fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:57304/0 (socket says 172.21.15.37:57304) 2024-08-20T05:04:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.130+0000 7fdc7a800640 1 -- 172.21.15.37:0/488959261 learned_addr learned my addr 172.21.15.37:0/488959261 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.130+0000 7fdc79400640 1 --2- 172.21.15.37:0/488959261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f132980 0x55c00f134e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.131+0000 7fdc7a800640 1 -- 172.21.15.37:0/488959261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f132980 msgr2=0x55c00f134e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:59.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.131+0000 7fdc7a800640 1 --2- 172.21.15.37:0/488959261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f132980 0x55c00f134e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.131+0000 7fdc7a800640 1 -- 172.21.15.37:0/488959261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c00f12ff40 msgr2=0x55c00f132330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:59.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.131+0000 7fdc7a800640 1 --2- 172.21.15.37:0/488959261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c00f12ff40 0x55c00f132330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.131+0000 7fdc7a800640 1 -- 172.21.15.37:0/488959261 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c00f05bde0 con 0x55c00f12d610 2024-08-20T05:04:59.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.132+0000 7fdc72a00640 1 --2- 172.21.15.37:0/2404073117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc600b3c40 0x7fdc600b6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.133+0000 7fdc72a00640 1 -- 172.21.15.37:0/2404073117 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fdc6c0e4480 con 0x7fdc7c0742d0 2024-08-20T05:04:59.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.133+0000 7fdc7a800640 1 --2- 172.21.15.37:0/488959261 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 0x55c00f12fa00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdc74009ca0 tx=0x7fdc74009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95383ff0eafd3345 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:59.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.134+0000 7fdc79e00640 1 --2- 172.21.15.37:0/2404073117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc600b3c40 0x7fdc600b6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.135+0000 7fdc67400640 1 -- 172.21.15.37:0/488959261 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc740305a0 con 0x55c00f12d610 2024-08-20T05:04:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.135+0000 7fdc67400640 1 -- 172.21.15.37:0/488959261 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc74036040 con 0x55c00f12d610 2024-08-20T05:04:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.135+0000 7fdc67400640 1 -- 172.21.15.37:0/488959261 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc74004500 con 0x55c00f12d610 2024-08-20T05:04:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.136+0000 7fdc83c01740 1 -- 172.21.15.37:0/488959261 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 msgr2=0x55c00f12fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.136+0000 7fdc83c01740 1 --2- 172.21.15.37:0/488959261 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 0x55c00f12fa00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdc74009ca0 tx=0x7fdc74009a20 comp rx=0 tx=0).stop 2024-08-20T05:04:59.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.139+0000 7fdc83c01740 1 -- 172.21.15.37:0/488959261 shutdown_connections 2024-08-20T05:04:59.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.139+0000 7fdc83c01740 1 --2- 172.21.15.37:0/488959261 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f132980 0x55c00f134e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.139+0000 7fdc83c01740 1 --2- 172.21.15.37:0/488959261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c00f12ff40 0x55c00f132330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.139+0000 7fdc83c01740 1 --2- 172.21.15.37:0/488959261 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 0x55c00f12fa00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.139+0000 7fdc83c01740 1 -- 172.21.15.37:0/488959261 >> 172.21.15.37:0/488959261 conn(0x55c00f128760 msgr2=0x55c00f1294f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.139+0000 7fdc79e00640 1 --2- 172.21.15.37:0/2404073117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc600b3c40 0x7fdc600b6100 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0a7050 tx=0x7fdc6c003980 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.139+0000 7fdc83c01740 1 -- 172.21.15.37:0/488959261 shutdown_connections 2024-08-20T05:04:59.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.140+0000 7fdc83c01740 1 -- 172.21.15.37:0/488959261 wait complete. 2024-08-20T05:04:59.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.141+0000 7fdc83c01740 1 -- start start 2024-08-20T05:04:59.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.141+0000 7fdc83c01740 1 Processor -- start 2024-08-20T05:04:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.144+0000 7fdc83c01740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12d610 0x55c00f136cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.144+0000 7fdc83c01740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c00f12ff40 0x55c00f137390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.144+0000 7fdc83c01740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f132980 0x55c00f137f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.144+0000 7fdc83c01740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c00efc8ab0 con 0x55c00f12ff40 2024-08-20T05:04:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.144+0000 7fdc83c01740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c00f036140 con 0x55c00f132980 2024-08-20T05:04:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.144+0000 7fdc83c01740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c00f135900 con 0x55c00f12d610 2024-08-20T05:04:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.144+0000 7fdc83c01740 10 client.0 _ll_register_callbacks cb 0x55c00f0495d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.144+0000 7fdc7a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12d610 0x55c00f136cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.144+0000 7fdc7a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12d610 0x55c00f136cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50320/0 (socket says 172.21.15.37:50320) 2024-08-20T05:04:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.144+0000 7fdc7a800640 1 -- 172.21.15.37:0/2941356459 learned_addr learned my addr 172.21.15.37:0/2941356459 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.145+0000 7fdc7a800640 1 --2- 172.21.15.37:0/2941356459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f132980 0x55c00f137f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.145+0000 7fdc7a800640 1 -- 172.21.15.37:0/2941356459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f132980 msgr2=0x55c00f137f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.145+0000 7fdc7a800640 1 --2- 172.21.15.37:0/2941356459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f132980 0x55c00f137f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.145+0000 7fdc7a800640 1 -- 172.21.15.37:0/2941356459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c00f12ff40 msgr2=0x55c00f137390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:04:59.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.145+0000 7fdc7a800640 1 --2- 172.21.15.37:0/2941356459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c00f12ff40 0x55c00f137390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.145+0000 7fdc7a800640 1 -- 172.21.15.37:0/2941356459 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c00f037170 con 0x55c00f12d610 2024-08-20T05:04:59.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.146+0000 7fdc7a800640 1 --2- 172.21.15.37:0/2941356459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12d610 0x55c00f136cf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdc74031040 tx=0x7fdc740095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c41c053086c4ab2b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:59.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.147+0000 7fdc5be00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:04:59.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.147+0000 7fdc5be00640 1 -- 172.21.15.37:0/2941356459 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc74058060 con 0x55c00f12d610 2024-08-20T05:04:59.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.149+0000 7fdc5be00640 1 -- 172.21.15.37:0/2941356459 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fdc74004520 con 0x55c00f12d610 2024-08-20T05:04:59.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.149+0000 7fdc83c01740 1 -- 172.21.15.37:0/2941356459 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc74036040 con 0x55c00f12d610 2024-08-20T05:04:59.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.150+0000 7fdc5be00640 1 -- 172.21.15.37:0/2941356459 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdc74058060 con 0x55c00f12d610 2024-08-20T05:04:59.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.150+0000 7fdc83c01740 10 client.26197 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:59.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.150+0000 7fdc83c01740 1 -- 172.21.15.37:0/2941356459 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c00edf2790 con 0x55c00f12d610 2024-08-20T05:04:59.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.151+0000 7fdc5be00640 1 -- 172.21.15.37:0/2941356459 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc74030960 con 0x55c00f12d610 2024-08-20T05:04:59.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.151+0000 7fdc5be00640 1 -- 172.21.15.37:0/2941356459 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fdc74050070 con 0x55c00f12d610 2024-08-20T05:04:59.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.151+0000 7fdc83c01740 10 client.26197 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:59.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.151+0000 7fdc83c01740 10 client.26197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:04:59.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.153+0000 7fdc83c01740 20 client.26197 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:59.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.153+0000 7fdc83c01740 1 --2- 172.21.15.37:0/2941356459 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c00f142560 0x55c00f144950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.153+0000 7fdc83c01740 4 client.26197 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:04:59.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.153+0000 7fdc83c01740 1 -- 172.21.15.37:0/2941356459 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fdc74036040 con 0x55c00f142560 2024-08-20T05:04:59.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.156+0000 7fdc79400640 1 --2- 172.21.15.37:0/2941356459 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c00f142560 0x55c00f144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.161+0000 7fdc79400640 1 --2- 172.21.15.37:0/2941356459 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c00f142560 0x55c00f144950 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=414498cbf80596de server_cookie=715288637da813bf in_seq=0 out_seq=0 2024-08-20T05:04:59.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.161+0000 7fdc5be00640 10 client.26197 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:59.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.163+0000 7fdc5be00640 1 -- 172.21.15.37:0/2941356459 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fdc74036040 con 0x55c00f142560 2024-08-20T05:04:59.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.163+0000 7fdc5be00640 10 client.26197 handle_command_reply: tid=0 2024-08-20T05:04:59.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.164+0000 7fdc83c01740 1 client.26197 shutdown 2024-08-20T05:04:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.166+0000 7fdc83c01740 1 -- 172.21.15.37:0/2941356459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12d610 msgr2=0x55c00f136cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.166+0000 7fdc83c01740 1 --2- 172.21.15.37:0/2941356459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12d610 0x55c00f136cf0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdc74031040 tx=0x7fdc740095c0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.166+0000 7fdc83c01740 1 -- 172.21.15.37:0/2941356459 shutdown_connections 2024-08-20T05:04:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.166+0000 7fdc83c01740 1 --2- 172.21.15.37:0/2941356459 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c00f142560 0x55c00f144950 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.166+0000 7fdc5be00640 0 client.26197 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.166+0000 7fdc83c01740 1 --2- 172.21.15.37:0/2941356459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f132980 0x55c00f137f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.166+0000 7fdc83c01740 1 --2- 172.21.15.37:0/2941356459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c00f12ff40 0x55c00f137390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.166+0000 7fdc83c01740 1 --2- 172.21.15.37:0/2941356459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12d610 0x55c00f136cf0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.166+0000 7fdc83c01740 1 -- 172.21.15.37:0/2941356459 >> 172.21.15.37:0/2941356459 conn(0x55c00f128760 msgr2=0x55c00f127760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:59.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.170+0000 7fdc83c01740 1 -- 172.21.15.37:0/2941356459 shutdown_connections 2024-08-20T05:04:59.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.170+0000 7fdc83c01740 1 -- 172.21.15.37:0/2941356459 wait complete. 2024-08-20T05:04:59.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.170+0000 7fdc83c01740 20 client.26197 trim_cache size 0 max 16384 2024-08-20T05:04:59.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.182+0000 7ff5d4e00640 1 -- 172.21.15.37:0/2668690922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5d010f3f0 con 0x7ff5d0113730 2024-08-20T05:04:59.187 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:04:59.187 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":33,"btime":"2024-08-20T05:03:11:706710+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:03:11.271814+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:04:59.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.185+0000 7ff5c6a00640 1 -- 172.21.15.37:0/2668690922 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11987 (secure 0 0 0) 0x7ff5c80e5e20 con 0x7ff5d0113730 2024-08-20T05:04:59.187 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 33 2024-08-20T05:04:59.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.193+0000 7ff5d4e00640 1 -- 172.21.15.37:0/2668690922 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5b40b3d20 msgr2=0x7ff5b40b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:59.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.193+0000 7ff5d4e00640 1 --2- 172.21.15.37:0/2668690922 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5b40b3d20 0x7ff5b40b61e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0005fd0 tx=0x7ff5c001c2d0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.193+0000 7ff5d4e00640 1 -- 172.21.15.37:0/2668690922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5d0113730 msgr2=0x7ff5d019c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:59.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.193+0000 7ff5d4e00640 1 --2- 172.21.15.37:0/2668690922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5d0113730 0x7ff5d019c720 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff5c800bdf0 tx=0x7ff5c800bee0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.193+0000 7ff5d4e00640 1 -- 172.21.15.37:0/2668690922 shutdown_connections 2024-08-20T05:04:59.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.193+0000 7ff5d4e00640 1 --2- 172.21.15.37:0/2668690922 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5b40b3d20 0x7ff5b40b61e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.193+0000 7ff5d4e00640 1 --2- 172.21.15.37:0/2668690922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5d0113730 0x7ff5d019c720 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.193+0000 7ff5d4e00640 1 --2- 172.21.15.37:0/2668690922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5d0107cd0 0x7ff5d0103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.193+0000 7ff5d4e00640 1 --2- 172.21.15.37:0/2668690922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5d01073b0 0x7ff5d0102bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.193+0000 7ff5d4e00640 1 -- 172.21.15.37:0/2668690922 >> 172.21.15.37:0/2668690922 conn(0x7ff5d0076cc0 msgr2=0x7ff5d0112e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:59.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.195+0000 7ff5d4e00640 1 -- 172.21.15.37:0/2668690922 shutdown_connections 2024-08-20T05:04:59.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.195+0000 7ff5d4e00640 1 -- 172.21.15.37:0/2668690922 wait complete. 2024-08-20T05:04:59.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.219+0000 7fdc83c01740 1 Processor -- start 2024-08-20T05:04:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.219+0000 7fdc83c01740 1 -- start start 2024-08-20T05:04:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.221+0000 7fdc83c01740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 0x55c00f123880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.221+0000 7fdc83c01740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12ff40 0x55c00f12a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.221+0000 7fdc83c01740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c00f132980 0x55c00f12aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.221+0000 7fdc83c01740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1c2a20 con 0x55c00f132980 2024-08-20T05:04:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.221+0000 7fdc83c01740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1c4620 con 0x55c00f12d610 2024-08-20T05:04:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.221+0000 7fdc83c01740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1c30f0 con 0x55c00f12ff40 2024-08-20T05:04:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.221+0000 7fdc79400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12ff40 0x55c00f12a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.221+0000 7fdc79400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12ff40 0x55c00f12a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50326/0 (socket says 172.21.15.37:50326) 2024-08-20T05:04:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.221+0000 7fdc79400640 1 -- 172.21.15.37:0/1869847848 learned_addr learned my addr 172.21.15.37:0/1869847848 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.222+0000 7fdc79400640 1 -- 172.21.15.37:0/1869847848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 msgr2=0x55c00f123880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:04:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.222+0000 7fdc79400640 1 --2- 172.21.15.37:0/1869847848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 0x55c00f123880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.222+0000 7fdc79400640 1 -- 172.21.15.37:0/1869847848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c00f132980 msgr2=0x55c00f12aad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:04:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.222+0000 7fdc79400640 1 --2- 172.21.15.37:0/1869847848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c00f132980 0x55c00f12aad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.222+0000 7fdc79400640 1 -- 172.21.15.37:0/1869847848 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c00f144cc0 con 0x55c00f12ff40 2024-08-20T05:04:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.222+0000 7fdc79400640 1 --2- 172.21.15.37:0/1869847848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12ff40 0x55c00f12a590 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55c00f1451a0 tx=0x7fdc6800e4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84d1dfbaca296f31 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.223+0000 7fdc66a00640 1 -- 172.21.15.37:0/1869847848 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc68005020 con 0x55c00f12ff40 2024-08-20T05:04:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.223+0000 7fdc66a00640 1 -- 172.21.15.37:0/1869847848 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc68004730 con 0x55c00f12ff40 2024-08-20T05:04:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.223+0000 7fdc66a00640 1 -- 172.21.15.37:0/1869847848 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc68019630 con 0x55c00f12ff40 2024-08-20T05:04:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.224+0000 7fdc83c01740 1 -- 172.21.15.37:0/1869847848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12ff40 msgr2=0x55c00f12a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.224+0000 7fdc83c01740 1 --2- 172.21.15.37:0/1869847848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12ff40 0x55c00f12a590 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55c00f1451a0 tx=0x7fdc6800e4a0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.225+0000 7fdc83c01740 1 -- 172.21.15.37:0/1869847848 shutdown_connections 2024-08-20T05:04:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.225+0000 7fdc83c01740 1 --2- 172.21.15.37:0/1869847848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c00f132980 0x55c00f12aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.225+0000 7fdc83c01740 1 --2- 172.21.15.37:0/1869847848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12ff40 0x55c00f12a590 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.225+0000 7fdc83c01740 1 --2- 172.21.15.37:0/1869847848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 0x55c00f123880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.225+0000 7fdc83c01740 1 -- 172.21.15.37:0/1869847848 >> 172.21.15.37:0/1869847848 conn(0x55c00f128760 msgr2=0x55c00f1291b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.225+0000 7fdc83c01740 1 -- 172.21.15.37:0/1869847848 shutdown_connections 2024-08-20T05:04:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.226+0000 7fdc83c01740 1 -- 172.21.15.37:0/1869847848 wait complete. 2024-08-20T05:04:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.227+0000 7fdc83c01740 1 -- start start 2024-08-20T05:04:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.227+0000 7fdc83c01740 1 Processor -- start 2024-08-20T05:04:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.228+0000 7fdc83c01740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 0x55c00f13daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.229+0000 7fdc83c01740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12ff40 0x55c00f13e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.229+0000 7fdc83c01740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c00f132980 0x55c00f1ab200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.229+0000 7fdc83c01740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1c3e90 con 0x55c00f132980 2024-08-20T05:04:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.229+0000 7fdc83c01740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1c37c0 con 0x55c00f12d610 2024-08-20T05:04:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.229+0000 7fdc83c01740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c1c0a00 con 0x55c00f12ff40 2024-08-20T05:04:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.229+0000 7fdc83c01740 10 client.0 _ll_register_callbacks cb 0x7fdc74009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.229+0000 7fdc7a800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 0x55c00f13daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.229+0000 7fdc79400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12ff40 0x55c00f13e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.229+0000 7fdc7a800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 0x55c00f13daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:57332/0 (socket says 172.21.15.37:57332) 2024-08-20T05:04:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.229+0000 7fdc7a800640 1 -- 172.21.15.37:0/2335767062 learned_addr learned my addr 172.21.15.37:0/2335767062 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.231+0000 7fdc7a800640 1 --2- 172.21.15.37:0/2335767062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c00f132980 0x55c00f1ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.231+0000 7fdc7a800640 1 -- 172.21.15.37:0/2335767062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12ff40 msgr2=0x55c00f13e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.231+0000 7fdc7a800640 1 --2- 172.21.15.37:0/2335767062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12ff40 0x55c00f13e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.231+0000 7fdc7a800640 1 -- 172.21.15.37:0/2335767062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c00f132980 msgr2=0x55c00f1ab200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.231+0000 7fdc7a800640 1 --2- 172.21.15.37:0/2335767062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c00f132980 0x55c00f1ab200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.231+0000 7fdc7a800640 1 -- 172.21.15.37:0/2335767062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c00ee6b620 con 0x55c00f12d610 2024-08-20T05:04:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.231+0000 7fdc79400640 1 --2- 172.21.15.37:0/2335767062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12ff40 0x55c00f13e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:04:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.232+0000 7fdc7a800640 1 --2- 172.21.15.37:0/2335767062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 0x55c00f13daf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdc74009ca0 tx=0x7fdc740021d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6f9497ef4af0b2e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.232+0000 7fdc5be00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:04:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.232+0000 7fdc5be00640 1 -- 172.21.15.37:0/2335767062 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7404a040 con 0x55c00f12d610 2024-08-20T05:04:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.232+0000 7fdc5be00640 1 -- 172.21.15.37:0/2335767062 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fdc74004d40 con 0x55c00f12d610 2024-08-20T05:04:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.232+0000 7fdc83c01740 1 -- 172.21.15.37:0/2335767062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc68004730 con 0x55c00f12d610 2024-08-20T05:04:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.233+0000 7fdc5be00640 1 -- 172.21.15.37:0/2335767062 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdc74003970 con 0x55c00f12d610 2024-08-20T05:04:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.233+0000 7fdc83c01740 10 client.26168 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.233+0000 7fdc83c01740 1 -- 172.21.15.37:0/2335767062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55c00f1acb20 con 0x55c00f12d610 2024-08-20T05:04:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.234+0000 7fdc5be00640 1 -- 172.21.15.37:0/2335767062 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc68004730 con 0x55c00f12d610 2024-08-20T05:04:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.234+0000 7fdc5be00640 1 -- 172.21.15.37:0/2335767062 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fdc74050040 con 0x55c00f12d610 2024-08-20T05:04:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.234+0000 7fdc83c01740 10 client.26168 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.234+0000 7fdc83c01740 10 client.26168 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:04:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.234+0000 7fdc83c01740 20 client.26168 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.234+0000 7fdc83c01740 1 --2- 172.21.15.37:0/2335767062 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c00f1ad420 0x55c00f1af840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.234+0000 7fdc83c01740 4 client.26168 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:04:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.234+0000 7fdc83c01740 1 -- 172.21.15.37:0/2335767062 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c00f0a2160 con 0x55c00f1ad420 2024-08-20T05:04:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.234+0000 7fdc79400640 1 --2- 172.21.15.37:0/2335767062 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c00f1ad420 0x55c00f1af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.236+0000 7fdc79400640 1 --2- 172.21.15.37:0/2335767062 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c00f1ad420 0x55c00f1af840 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20079e3c282d157f server_cookie=5924a9c6877b08ea in_seq=0 out_seq=0 2024-08-20T05:04:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.236+0000 7fdc5be00640 10 client.26168 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.261+0000 7fdc5be00640 1 -- 172.21.15.37:0/2335767062 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c00f0a2160 con 0x55c00f1ad420 2024-08-20T05:04:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.261+0000 7fdc5be00640 10 client.26168 handle_command_reply: tid=0 2024-08-20T05:04:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.261+0000 7fdc83c01740 1 client.26168 shutdown 2024-08-20T05:04:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.261+0000 7fdc83c01740 1 -- 172.21.15.37:0/2335767062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 msgr2=0x55c00f13daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.261+0000 7fdc83c01740 1 --2- 172.21.15.37:0/2335767062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 0x55c00f13daf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdc74009ca0 tx=0x7fdc740021d0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.261+0000 7fdc83c01740 1 -- 172.21.15.37:0/2335767062 shutdown_connections 2024-08-20T05:04:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.262+0000 7fdc83c01740 1 --2- 172.21.15.37:0/2335767062 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c00f1ad420 0x55c00f1af840 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.262+0000 7fdc83c01740 1 --2- 172.21.15.37:0/2335767062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c00f132980 0x55c00f1ab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.262+0000 7fdc83c01740 1 --2- 172.21.15.37:0/2335767062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c00f12ff40 0x55c00f13e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.262+0000 7fdc5be00640 0 client.26168 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.262+0000 7fdc83c01740 1 --2- 172.21.15.37:0/2335767062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c00f12d610 0x55c00f13daf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.262+0000 7fdc83c01740 1 -- 172.21.15.37:0/2335767062 >> 172.21.15.37:0/2335767062 conn(0x55c00f128760 msgr2=0x55c00f129100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.262+0000 7fdc83c01740 1 -- 172.21.15.37:0/2335767062 shutdown_connections 2024-08-20T05:04:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.262+0000 7fdc83c01740 1 -- 172.21.15.37:0/2335767062 wait complete. 2024-08-20T05:04:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.262+0000 7fdc83c01740 20 client.26168 trim_cache size 0 max 16384 2024-08-20T05:04:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:04:59.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:04:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:04:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:04:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.263+0000 7fdc80e00640 1 -- 172.21.15.37:0/2404073117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc600b3c40 msgr2=0x7fdc600b6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.263+0000 7fdc80e00640 1 --2- 172.21.15.37:0/2404073117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc600b3c40 0x7fdc600b6100 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0a7050 tx=0x7fdc6c003980 comp rx=0 tx=0).stop 2024-08-20T05:04:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.263+0000 7fdc80e00640 1 -- 172.21.15.37:0/2404073117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c0742d0 msgr2=0x7fdc7c19efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.263+0000 7fdc80e00640 1 --2- 172.21.15.37:0/2404073117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c0742d0 0x7fdc7c19efb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c00ea60 tx=0x7fdc6c00ef20 comp rx=0 tx=0).stop 2024-08-20T05:04:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.264+0000 7fdc80e00640 1 -- 172.21.15.37:0/2404073117 shutdown_connections 2024-08-20T05:04:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.264+0000 7fdc80e00640 1 --2- 172.21.15.37:0/2404073117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc600b3c40 0x7fdc600b6100 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.264+0000 7fdc80e00640 1 --2- 172.21.15.37:0/2404073117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc7c10abd0 0x7fdc7c1a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.264+0000 7fdc80e00640 1 --2- 172.21.15.37:0/2404073117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc7c10a210 0x7fdc7c19f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.264+0000 7fdc80e00640 1 --2- 172.21.15.37:0/2404073117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc7c0742d0 0x7fdc7c19efb0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.264+0000 7fdc80e00640 1 -- 172.21.15.37:0/2404073117 >> 172.21.15.37:0/2404073117 conn(0x7fdc7c06f740 msgr2=0x7fdc7c199f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.264+0000 7fdc80e00640 1 -- 172.21.15.37:0/2404073117 shutdown_connections 2024-08-20T05:04:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:04:59.264+0000 7fdc80e00640 1 -- 172.21.15.37:0/2404073117 wait complete. 2024-08-20T05:04:59.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:59 smithi037 ceph-mon[17265]: pgmap v483: 129 pgs: 129 active+clean; 1020 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.1 MiB/s wr, 697 op/s 2024-08-20T05:04:59.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:04:59 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2668690922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:04:59.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:59 smithi130 ceph-mon[22007]: pgmap v483: 129 pgs: 129 active+clean; 1020 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.1 MiB/s wr, 697 op/s 2024-08-20T05:04:59.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:04:59 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2668690922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:04:59.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:59 smithi135 ceph-mon[22342]: pgmap v483: 129 pgs: 129 active+clean; 1020 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.1 MiB/s wr, 697 op/s 2024-08-20T05:04:59.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:04:59 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2668690922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:04:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.949+0000 7efeea000640 1 -- 172.21.15.37:0/3530622242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efee4113810 msgr2=0x7efee4115c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:59.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.949+0000 7efeea000640 1 --2- 172.21.15.37:0/3530622242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efee4113810 0x7efee4115c00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efedc009be0 tx=0x7efedc02a6c0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.950+0000 7efeea000640 1 -- 172.21.15.37:0/3530622242 shutdown_connections 2024-08-20T05:04:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.950+0000 7efeea000640 1 --2- 172.21.15.37:0/3530622242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efee4113810 0x7efee4115c00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.950+0000 7efeea000640 1 --2- 172.21.15.37:0/3530622242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee4075b90 0x7efee41132d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.950+0000 7efeea000640 1 --2- 172.21.15.37:0/3530622242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efee4075270 0x7efee4075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.950+0000 7efeea000640 1 -- 172.21.15.37:0/3530622242 >> 172.21.15.37:0/3530622242 conn(0x7efee40fe520 msgr2=0x7efee4100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.952+0000 7efeea000640 1 -- 172.21.15.37:0/3530622242 shutdown_connections 2024-08-20T05:04:59.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.952+0000 7efeea000640 1 -- 172.21.15.37:0/3530622242 wait complete. 2024-08-20T05:04:59.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.953+0000 7efeea000640 1 Processor -- start 2024-08-20T05:04:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.955+0000 7efeea000640 1 -- start start 2024-08-20T05:04:59.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.955+0000 7efeea000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee4075270 0x7efee419f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.955+0000 7efeea000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efee4075b90 0x7efee419fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.955+0000 7efeea000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efee4113810 0x7efee41a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.955+0000 7efeea000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efee4119070 con 0x7efee4075b90 2024-08-20T05:04:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.955+0000 7efeea000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efee4118ef0 con 0x7efee4113810 2024-08-20T05:04:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.955+0000 7efeea000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efee41191f0 con 0x7efee4075270 2024-08-20T05:04:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.956+0000 7efedbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efee4075b90 0x7efee419fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.956+0000 7efedbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efee4075b90 0x7efee419fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35284/0 (socket says 172.21.15.37:35284) 2024-08-20T05:04:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.956+0000 7efedbe00640 1 -- 172.21.15.37:0/3110725859 learned_addr learned my addr 172.21.15.37:0/3110725859 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:59.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.956+0000 7efee3e00640 1 --2- 172.21.15.37:0/3110725859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efee4113810 0x7efee41a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.956+0000 7efee3400640 1 --2- 172.21.15.37:0/3110725859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee4075270 0x7efee419f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.956+0000 7efee3e00640 1 -- 172.21.15.37:0/3110725859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee4075270 msgr2=0x7efee419f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.956+0000 7efee3e00640 1 --2- 172.21.15.37:0/3110725859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee4075270 0x7efee419f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.956+0000 7efee3e00640 1 -- 172.21.15.37:0/3110725859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efee4075b90 msgr2=0x7efee419fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.956+0000 7efee3e00640 1 --2- 172.21.15.37:0/3110725859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efee4075b90 0x7efee419fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.956+0000 7efee3e00640 1 -- 172.21.15.37:0/3110725859 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee41a5670 con 0x7efee4113810 2024-08-20T05:04:59.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.957+0000 7efee3400640 1 --2- 172.21.15.37:0/3110725859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee4075270 0x7efee419f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:04:59.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.958+0000 7efee3e00640 1 --2- 172.21.15.37:0/3110725859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efee4113810 0x7efee41a4ea0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efedc034040 tx=0x7efedc003c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:59.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.958+0000 7efee0c00640 1 -- 172.21.15.37:0/3110725859 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc041020 con 0x7efee4113810 2024-08-20T05:04:59.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.958+0000 7efee0c00640 1 -- 172.21.15.37:0/3110725859 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efedc0318f0 con 0x7efee4113810 2024-08-20T05:04:59.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.958+0000 7efee0c00640 1 -- 172.21.15.37:0/3110725859 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc036040 con 0x7efee4113810 2024-08-20T05:04:59.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.958+0000 7efeea000640 1 -- 172.21.15.37:0/3110725859 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee41a5900 con 0x7efee4113810 2024-08-20T05:04:59.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.959+0000 7efeea000640 1 -- 172.21.15.37:0/3110725859 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee41ac020 con 0x7efee4113810 2024-08-20T05:04:59.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.963+0000 7efeeca3f740 1 Processor -- start 2024-08-20T05:04:59.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.966+0000 7efee0c00640 1 -- 172.21.15.37:0/3110725859 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7efedc044020 con 0x7efee4113810 2024-08-20T05:04:59.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.966+0000 7efeeca3f740 1 -- start start 2024-08-20T05:04:59.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.967+0000 7efeeca3f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d168960900 0x55d168960ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.967+0000 7efeeca3f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d168961220 0x55d16896cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.967+0000 7efeeca3f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d16896d1b0 0x55d16896f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.967+0000 7efeeca3f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d1688d6a60 con 0x55d16896d1b0 2024-08-20T05:04:59.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.967+0000 7efeeca3f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d1688c5f60 con 0x55d168961220 2024-08-20T05:04:59.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.967+0000 7efeeca3f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d1688c9fa0 con 0x55d168960900 2024-08-20T05:04:59.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.967+0000 7efedbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d168960900 0x55d168960ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.967+0000 7efedbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d168960900 0x55d168960ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50366/0 (socket says 172.21.15.37:50366) 2024-08-20T05:04:59.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.967+0000 7efedbe00640 1 -- 172.21.15.37:0/239187589 learned_addr learned my addr 172.21.15.37:0/239187589 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:59.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.968+0000 7efedbe00640 1 -- 172.21.15.37:0/239187589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d168961220 msgr2=0x55d16896cc70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:04:59.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.968+0000 7efedbe00640 1 --2- 172.21.15.37:0/239187589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d168961220 0x55d16896cc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.968+0000 7efedbe00640 1 -- 172.21.15.37:0/239187589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d16896d1b0 msgr2=0x55d16896f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:59.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.968+0000 7efedbe00640 1 --2- 172.21.15.37:0/239187589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d16896d1b0 0x55d16896f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.968+0000 7efedbe00640 1 -- 172.21.15.37:0/239187589 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d16886c3e0 con 0x55d168960900 2024-08-20T05:04:59.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.968+0000 7efedbe00640 1 --2- 172.21.15.37:0/239187589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d168960900 0x55d168960ce0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efecc009da0 tx=0x7efecc013830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9826ec35e64da7d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:59.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.969+0000 7efed3e00640 1 -- 172.21.15.37:0/239187589 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc004020 con 0x55d168960900 2024-08-20T05:04:59.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.969+0000 7efed3e00640 1 -- 172.21.15.37:0/239187589 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efecc0054d0 con 0x55d168960900 2024-08-20T05:04:59.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.969+0000 7efed3e00640 1 -- 172.21.15.37:0/239187589 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efecc004cb0 con 0x55d168960900 2024-08-20T05:04:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.970+0000 7efeeca3f740 1 -- 172.21.15.37:0/239187589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d168960900 msgr2=0x55d168960ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:59.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.970+0000 7efeeca3f740 1 --2- 172.21.15.37:0/239187589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d168960900 0x55d168960ce0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7efecc009da0 tx=0x7efecc013830 comp rx=0 tx=0).stop 2024-08-20T05:04:59.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.971+0000 7efee0c00640 1 --2- 172.21.15.37:0/3110725859 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efec80b3cd0 0x7efec80b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.971+0000 7efee0c00640 1 -- 172.21.15.37:0/3110725859 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7efedc104800 con 0x7efee4113810 2024-08-20T05:04:59.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.971+0000 7efedbe00640 1 --2- 172.21.15.37:0/3110725859 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efec80b3cd0 0x7efec80b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.972+0000 7efedbe00640 1 --2- 172.21.15.37:0/3110725859 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efec80b3cd0 0x7efec80b6190 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efecc0057c0 tx=0x7efecc005a50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.974+0000 7efeeca3f740 1 -- 172.21.15.37:0/239187589 shutdown_connections 2024-08-20T05:04:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.974+0000 7efeeca3f740 1 --2- 172.21.15.37:0/239187589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d16896d1b0 0x55d16896f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.974+0000 7efeeca3f740 1 --2- 172.21.15.37:0/239187589 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d168961220 0x55d16896cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.974+0000 7efeeca3f740 1 --2- 172.21.15.37:0/239187589 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d168960900 0x55d168960ce0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.974+0000 7efeeca3f740 1 -- 172.21.15.37:0/239187589 >> 172.21.15.37:0/239187589 conn(0x55d16895e730 msgr2=0x55d16895f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:59.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.976+0000 7efeeca3f740 1 -- 172.21.15.37:0/239187589 shutdown_connections 2024-08-20T05:04:59.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.976+0000 7efeeca3f740 1 -- 172.21.15.37:0/239187589 wait complete. 2024-08-20T05:04:59.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.977+0000 7efeeca3f740 1 -- start start 2024-08-20T05:04:59.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.977+0000 7efeeca3f740 1 Processor -- start 2024-08-20T05:04:59.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.979+0000 7efeeca3f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d168960900 0x55d16896cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.979+0000 7efeeca3f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d16896d1b0 0x55d168969f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.979+0000 7efeeca3f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d16896a540 0x55d16896a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.979+0000 7efee3400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d168960900 0x55d16896cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.979+0000 7efee3400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d168960900 0x55d16896cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:57364/0 (socket says 172.21.15.37:57364) 2024-08-20T05:04:59.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.980+0000 7efee3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d16896a540 0x55d16896a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.980+0000 7efee3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d16896a540 0x55d16896a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50370/0 (socket says 172.21.15.37:50370) 2024-08-20T05:04:59.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.980+0000 7efeeca3f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d168728700 con 0x55d16896d1b0 2024-08-20T05:04:59.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.980+0000 7efee3400640 1 -- 172.21.15.37:0/3640725593 learned_addr learned my addr 172.21.15.37:0/3640725593 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:04:59.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.981+0000 7efeeca3f740 1 -- 172.21.15.37:0/3640725593 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d168861250 con 0x55d168960900 2024-08-20T05:04:59.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.981+0000 7efeeca3f740 1 -- 172.21.15.37:0/3640725593 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d16896fe30 con 0x55d16896a540 2024-08-20T05:04:59.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.981+0000 7efee3e00640 1 -- 172.21.15.37:0/3640725593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d168960900 msgr2=0x55d16896cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:59.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.981+0000 7efee3e00640 1 --2- 172.21.15.37:0/3640725593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d168960900 0x55d16896cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.981+0000 7efee3e00640 1 -- 172.21.15.37:0/3640725593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d16896d1b0 msgr2=0x55d168969f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:04:59.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.981+0000 7efee3e00640 1 --2- 172.21.15.37:0/3640725593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d16896d1b0 0x55d168969f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.981+0000 7efee3e00640 1 -- 172.21.15.37:0/3640725593 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d168625650 con 0x55d16896a540 2024-08-20T05:04:59.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.982+0000 7efee3e00640 1 --2- 172.21.15.37:0/3640725593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d16896a540 0x55d16896a9c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efedc031040 tx=0x7efedc0cae60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efc622d6331d5bf1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:04:59.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.982+0000 7efeeca3f740 10 client.0 _ll_register_callbacks cb 0x55d1688c0180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:04:59.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.982+0000 7efeeca3f740 1 -- 172.21.15.37:0/3640725593 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efecc0054d0 con 0x55d16896a540 2024-08-20T05:04:59.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.983+0000 7efed0c00640 10 client.26215 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:04:59.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.983+0000 7efed0c00640 1 -- 172.21.15.37:0/3640725593 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc0cf950 con 0x55d16896a540 2024-08-20T05:04:59.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.983+0000 7efed0c00640 1 -- 172.21.15.37:0/3640725593 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7efedc0d3f70 con 0x55d16896a540 2024-08-20T05:04:59.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.983+0000 7efed0c00640 1 -- 172.21.15.37:0/3640725593 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7efedc0d4400 con 0x55d16896a540 2024-08-20T05:04:59.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.983+0000 7efeeca3f740 10 client.26215 fetch_fsmap learned FSMap version 33 2024-08-20T05:04:59.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.983+0000 7efeeca3f740 1 -- 172.21.15.37:0/3640725593 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({fsmap=33}) -- 0x55d16897b7d0 con 0x55d16896a540 2024-08-20T05:04:59.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.984+0000 7efed0c00640 1 -- 172.21.15.37:0/3640725593 <== mon.1 v2:172.21.15.135:3300/0 4 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7efedc031440 con 0x55d16896a540 2024-08-20T05:04:59.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.984+0000 7efeeca3f740 10 client.26215 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:04:59.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.984+0000 7efeeca3f740 10 client.26215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:04:59.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.984+0000 7efeeca3f740 20 client.26215 populate_metadata read hostname 'smithi037' 2024-08-20T05:04:59.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.984+0000 7efeeca3f740 1 --2- 172.21.15.37:0/3640725593 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d16897cf20 0x55d16897f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:04:59.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.984+0000 7efeeca3f740 4 client.26215 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:04:59.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.984+0000 7efeeca3f740 1 -- 172.21.15.37:0/3640725593 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1688d89b0 con 0x55d16897cf20 2024-08-20T05:04:59.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.984+0000 7efee3400640 1 --2- 172.21.15.37:0/3640725593 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d16897cf20 0x55d16897f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:04:59.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.985+0000 7efee3400640 1 --2- 172.21.15.37:0/3640725593 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d16897cf20 0x55d16897f3e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24c7faf2f7398c45 server_cookie=55388f08938c0ff8 in_seq=0 out_seq=0 2024-08-20T05:04:59.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.985+0000 7efed0c00640 10 client.26215 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:59.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.986+0000 7efed0c00640 1 -- 172.21.15.37:0/3640725593 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d1688d89b0 con 0x55d16897cf20 2024-08-20T05:04:59.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.986+0000 7efed0c00640 10 client.26215 handle_command_reply: tid=0 2024-08-20T05:04:59.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.986+0000 7efeeca3f740 1 client.26215 shutdown 2024-08-20T05:04:59.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.986+0000 7efeeca3f740 1 -- 172.21.15.37:0/3640725593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d16896a540 msgr2=0x55d16896a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:04:59.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.986+0000 7efeeca3f740 1 --2- 172.21.15.37:0/3640725593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d16896a540 0x55d16896a9c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efedc031040 tx=0x7efedc0cae60 comp rx=0 tx=0).stop 2024-08-20T05:04:59.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.986+0000 7efeeca3f740 1 -- 172.21.15.37:0/3640725593 shutdown_connections 2024-08-20T05:04:59.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.986+0000 7efeeca3f740 1 --2- 172.21.15.37:0/3640725593 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d16897cf20 0x55d16897f3e0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.986+0000 7efeeca3f740 1 --2- 172.21.15.37:0/3640725593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d16896a540 0x55d16896a9c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.986+0000 7efeeca3f740 1 --2- 172.21.15.37:0/3640725593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d16896d1b0 0x55d168969f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.986+0000 7efeeca3f740 1 --2- 172.21.15.37:0/3640725593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d168960900 0x55d16896cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:04:59.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.986+0000 7efeeca3f740 1 -- 172.21.15.37:0/3640725593 >> 172.21.15.37:0/3640725593 conn(0x55d16895e730 msgr2=0x55d1689642a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:04:59.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.987+0000 7efed0c00640 0 client.26215 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:04:59.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.987+0000 7efeeca3f740 1 -- 172.21.15.37:0/3640725593 shutdown_connections 2024-08-20T05:04:59.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.987+0000 7efeeca3f740 1 -- 172.21.15.37:0/3640725593 wait complete. 2024-08-20T05:04:59.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:04:59.987+0000 7efeeca3f740 20 client.26215 trim_cache size 0 max 16384 2024-08-20T05:05:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.032+0000 7efeeca3f740 1 Processor -- start 2024-08-20T05:05:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.032+0000 7efeeca3f740 1 -- start start 2024-08-20T05:05:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.033+0000 7efeeca3f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d168960900 0x55d16896b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.033+0000 7efeeca3f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d16896a540 0x55d168984cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.033+0000 7efeeca3f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d16896d1b0 0x55d1689851f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.033+0000 7efeeca3f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efee41b5e30 con 0x55d16896a540 2024-08-20T05:05:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.033+0000 7efeeca3f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efee41b7a30 con 0x55d16896d1b0 2024-08-20T05:05:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.033+0000 7efeeca3f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efee41b6500 con 0x55d168960900 2024-08-20T05:05:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.033+0000 7efee3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d16896d1b0 0x55d1689851f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.034+0000 7efee3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d168960900 0x55d16896b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.034+0000 7efee3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d168960900 0x55d16896b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50380/0 (socket says 172.21.15.37:50380) 2024-08-20T05:05:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.034+0000 7efee3400640 1 -- 172.21.15.37:0/4055706463 learned_addr learned my addr 172.21.15.37:0/4055706463 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.034+0000 7efedbe00640 1 --2- 172.21.15.37:0/4055706463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d16896a540 0x55d168984cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.034+0000 7efee3400640 1 -- 172.21.15.37:0/4055706463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d16896d1b0 msgr2=0x55d1689851f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.034+0000 7efee3400640 1 --2- 172.21.15.37:0/4055706463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d16896d1b0 0x55d1689851f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.034+0000 7efee3400640 1 -- 172.21.15.37:0/4055706463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d16896a540 msgr2=0x55d168984cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.034+0000 7efee3400640 1 --2- 172.21.15.37:0/4055706463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d16896a540 0x55d168984cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.034+0000 7efee3400640 1 -- 172.21.15.37:0/4055706463 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d16895f1b0 con 0x55d168960900 2024-08-20T05:05:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.035+0000 7efedbe00640 1 --2- 172.21.15.37:0/4055706463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d16896a540 0x55d168984cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:05:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.035+0000 7efee3400640 1 --2- 172.21.15.37:0/4055706463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d168960900 0x55d16896b590 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efed400bb10 tx=0x7efed4005c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5379bf576e1c7204 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.035+0000 7efed3400640 1 -- 172.21.15.37:0/4055706463 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4003de0 con 0x55d168960900 2024-08-20T05:05:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.035+0000 7efed3400640 1 -- 172.21.15.37:0/4055706463 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efed401b8a0 con 0x55d168960900 2024-08-20T05:05:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.035+0000 7efed3400640 1 -- 172.21.15.37:0/4055706463 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4012a90 con 0x55d168960900 2024-08-20T05:05:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.036+0000 7efeeca3f740 1 -- 172.21.15.37:0/4055706463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d168960900 msgr2=0x55d16896b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.036+0000 7efeeca3f740 1 --2- 172.21.15.37:0/4055706463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d168960900 0x55d16896b590 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efed400bb10 tx=0x7efed4005c50 comp rx=0 tx=0).stop 2024-08-20T05:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.037+0000 7efeeca3f740 1 -- 172.21.15.37:0/4055706463 shutdown_connections 2024-08-20T05:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.037+0000 7efeeca3f740 1 --2- 172.21.15.37:0/4055706463 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d16896d1b0 0x55d1689851f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.037+0000 7efeeca3f740 1 --2- 172.21.15.37:0/4055706463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d16896a540 0x55d168984cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.037+0000 7efeeca3f740 1 --2- 172.21.15.37:0/4055706463 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d168960900 0x55d16896b590 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.037+0000 7efeeca3f740 1 -- 172.21.15.37:0/4055706463 >> 172.21.15.37:0/4055706463 conn(0x55d16895e730 msgr2=0x55d16895d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.037+0000 7efeeca3f740 1 -- 172.21.15.37:0/4055706463 shutdown_connections 2024-08-20T05:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.037+0000 7efeeca3f740 1 -- 172.21.15.37:0/4055706463 wait complete. 2024-08-20T05:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.038+0000 7efeeca3f740 1 -- start start 2024-08-20T05:05:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.038+0000 7efeeca3f740 1 Processor -- start 2024-08-20T05:05:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.039+0000 7efeeca3f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d168960900 0x55d1689e2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.039+0000 7efeeca3f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d16896a540 0x55d1689e31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.039+0000 7efeeca3f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d16896d1b0 0x55d168973350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.039+0000 7efeeca3f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efee41b72a0 con 0x55d168960900 2024-08-20T05:05:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.039+0000 7efeeca3f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efee41b6bd0 con 0x55d16896d1b0 2024-08-20T05:05:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.039+0000 7efeeca3f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efee41b3e10 con 0x55d16896a540 2024-08-20T05:05:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.039+0000 7efeeca3f740 10 client.0 _ll_register_callbacks cb 0x7efedc009840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.039+0000 7efedbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d16896a540 0x55d1689e31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.040+0000 7efedbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d16896a540 0x55d1689e31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50396/0 (socket says 172.21.15.37:50396) 2024-08-20T05:05:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.040+0000 7efedbe00640 1 -- 172.21.15.37:0/793524795 learned_addr learned my addr 172.21.15.37:0/793524795 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:00.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.040+0000 7efee3e00640 1 --2- 172.21.15.37:0/793524795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d16896d1b0 0x55d168973350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.040+0000 7efee3400640 1 --2- 172.21.15.37:0/793524795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d168960900 0x55d1689e2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.040+0000 7efee3400640 1 -- 172.21.15.37:0/793524795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d16896a540 msgr2=0x55d1689e31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.040+0000 7efee3400640 1 --2- 172.21.15.37:0/793524795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d16896a540 0x55d1689e31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.040+0000 7efee3400640 1 -- 172.21.15.37:0/793524795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d16896d1b0 msgr2=0x55d168973350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.040+0000 7efee3400640 1 --2- 172.21.15.37:0/793524795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d16896d1b0 0x55d168973350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.040+0000 7efee3400640 1 -- 172.21.15.37:0/793524795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d168973890 con 0x55d168960900 2024-08-20T05:05:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.041+0000 7efee3400640 1 --2- 172.21.15.37:0/793524795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d168960900 0x55d1689e2c70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efed401e040 tx=0x7efed40125b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f40ab2f804c221f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.041+0000 7efed0c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:05:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.042+0000 7efed0c00640 1 -- 172.21.15.37:0/793524795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed401bc60 con 0x55d168960900 2024-08-20T05:05:00.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.042+0000 7efeeca3f740 1 -- 172.21.15.37:0/793524795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efed401b8a0 con 0x55d168960900 2024-08-20T05:05:00.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.042+0000 7efed0c00640 1 -- 172.21.15.37:0/793524795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7efed4003de0 con 0x55d168960900 2024-08-20T05:05:00.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.043+0000 7efed0c00640 1 -- 172.21.15.37:0/793524795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7efed401b3f0 con 0x55d168960900 2024-08-20T05:05:00.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.043+0000 7efeeca3f740 10 client.16044 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:00.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.043+0000 7efeeca3f740 1 -- 172.21.15.37:0/793524795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d1689f92c0 con 0x55d168960900 2024-08-20T05:05:00.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.044+0000 7efed0c00640 1 -- 172.21.15.37:0/793524795 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efed401b8a0 con 0x55d168960900 2024-08-20T05:05:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.044+0000 7efed0c00640 1 -- 172.21.15.37:0/793524795 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7efed40306f0 con 0x55d168960900 2024-08-20T05:05:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.045+0000 7efeeca3f740 10 client.16044 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.045+0000 7efeeca3f740 10 client.16044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:05:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.045+0000 7efeeca3f740 20 client.16044 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.045+0000 7efeeca3f740 1 --2- 172.21.15.37:0/793524795 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d1689f9970 0x55d1689fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.045+0000 7efeeca3f740 4 client.16044 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:05:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.045+0000 7efeeca3f740 1 -- 172.21.15.37:0/793524795 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d1688d4450 con 0x55d1689f9970 2024-08-20T05:05:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.047+0000 7efedbe00640 1 --2- 172.21.15.37:0/793524795 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d1689f9970 0x55d1689fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.048+0000 7efedbe00640 1 --2- 172.21.15.37:0/793524795 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d1689f9970 0x55d1689fbd90 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1387e648b0200024 server_cookie=6df2831c613334c3 in_seq=0 out_seq=0 2024-08-20T05:05:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.048+0000 7efed0c00640 10 client.16044 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.048+0000 7efed0c00640 1 -- 172.21.15.37:0/793524795 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d1688d4450 con 0x55d1689f9970 2024-08-20T05:05:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.048+0000 7efed0c00640 10 client.16044 handle_command_reply: tid=0 2024-08-20T05:05:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.048+0000 7efeeca3f740 1 client.16044 shutdown 2024-08-20T05:05:00.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.049+0000 7efeeca3f740 1 -- 172.21.15.37:0/793524795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d168960900 msgr2=0x55d1689e2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:00.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.049+0000 7efeeca3f740 1 --2- 172.21.15.37:0/793524795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d168960900 0x55d1689e2c70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efed401e040 tx=0x7efed40125b0 comp rx=0 tx=0).stop 2024-08-20T05:05:00.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.050+0000 7efeeca3f740 1 -- 172.21.15.37:0/793524795 shutdown_connections 2024-08-20T05:05:00.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.050+0000 7efeeca3f740 1 --2- 172.21.15.37:0/793524795 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d1689f9970 0x55d1689fbd90 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:00.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.050+0000 7efeeca3f740 1 --2- 172.21.15.37:0/793524795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d16896d1b0 0x55d168973350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:00.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.050+0000 7efeeca3f740 1 --2- 172.21.15.37:0/793524795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d16896a540 0x55d1689e31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:00.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.050+0000 7efeeca3f740 1 --2- 172.21.15.37:0/793524795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d168960900 0x55d1689e2c70 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:00.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.050+0000 7efed0c00640 0 client.16044 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:00.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.050+0000 7efeeca3f740 1 -- 172.21.15.37:0/793524795 >> 172.21.15.37:0/793524795 conn(0x55d16895e730 msgr2=0x55d168977f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.051+0000 7efeeca3f740 1 -- 172.21.15.37:0/793524795 shutdown_connections 2024-08-20T05:05:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.051+0000 7efeeca3f740 1 -- 172.21.15.37:0/793524795 wait complete. 2024-08-20T05:05:00.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.051+0000 7efeeca3f740 20 client.16044 trim_cache size 0 max 16384 2024-08-20T05:05:00.052 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:05:00.052 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-20T05:05:00.053 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-08-20T05:05:00.053 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:05:00.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.052+0000 7efeea000640 1 -- 172.21.15.37:0/3110725859 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efec80b3cd0 msgr2=0x7efec80b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:00.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.052+0000 7efeea000640 1 --2- 172.21.15.37:0/3110725859 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efec80b3cd0 0x7efec80b6190 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efecc0057c0 tx=0x7efecc005a50 comp rx=0 tx=0).stop 2024-08-20T05:05:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.052+0000 7efeea000640 1 -- 172.21.15.37:0/3110725859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efee4113810 msgr2=0x7efee41a4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.052+0000 7efeea000640 1 --2- 172.21.15.37:0/3110725859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efee4113810 0x7efee41a4ea0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efedc034040 tx=0x7efedc003c30 comp rx=0 tx=0).stop 2024-08-20T05:05:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.053+0000 7efeea000640 1 -- 172.21.15.37:0/3110725859 shutdown_connections 2024-08-20T05:05:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.053+0000 7efeea000640 1 --2- 172.21.15.37:0/3110725859 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efec80b3cd0 0x7efec80b6190 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.053+0000 7efeea000640 1 --2- 172.21.15.37:0/3110725859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efee4113810 0x7efee41a4ea0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.053+0000 7efeea000640 1 --2- 172.21.15.37:0/3110725859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efee4075b90 0x7efee419fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.053+0000 7efeea000640 1 --2- 172.21.15.37:0/3110725859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efee4075270 0x7efee419f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.053+0000 7efeea000640 1 -- 172.21.15.37:0/3110725859 >> 172.21.15.37:0/3110725859 conn(0x7efee40fe520 msgr2=0x7efee40ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.054+0000 7efeea000640 1 -- 172.21.15.37:0/3110725859 shutdown_connections 2024-08-20T05:05:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:00.054+0000 7efeea000640 1 -- 172.21.15.37:0/3110725859 wait complete. 2024-08-20T05:05:01.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:01 smithi130 ceph-mon[22007]: pgmap v484: 129 pgs: 129 active+clean; 1022 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2024-08-20T05:05:01.709 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:01 smithi037 ceph-mon[17265]: pgmap v484: 129 pgs: 129 active+clean; 1022 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2024-08-20T05:05:01.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:01 smithi135 ceph-mon[22342]: pgmap v484: 129 pgs: 129 active+clean; 1022 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2024-08-20T05:05:02.821 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 136.4 --await-for 45.0' 2024-08-20T05:05:02.821 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 136.4 --await-for 45.0 2024-08-20T05:05:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 125.0 s, 1016.1 tps, lat 110.808 ms stddev 215.550 2024-08-20T05:05:03.702 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:03 smithi037 ceph-mon[17265]: pgmap v485: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 16 MiB/s wr, 994 op/s 2024-08-20T05:05:03.703 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T05:05:03.704 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:05:03.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:03 smithi130 ceph-mon[22007]: pgmap v485: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 16 MiB/s wr, 994 op/s 2024-08-20T05:05:03.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:03 smithi135 ceph-mon[22342]: pgmap v485: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 16 MiB/s wr, 994 op/s 2024-08-20T05:05:03.900 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:05:04.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.662+0000 7f5763200640 1 -- 172.21.15.37:0/1426435161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5764108c90 msgr2=0x7f576410f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:04.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.662+0000 7f5763200640 1 --2- 172.21.15.37:0/1426435161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5764108c90 0x7f576410f490 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f575c009ca0 tx=0x7f575c02a8b0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.666+0000 7f5763200640 1 -- 172.21.15.37:0/1426435161 shutdown_connections 2024-08-20T05:05:04.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.666+0000 7f5763200640 1 --2- 172.21.15.37:0/1426435161 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5764108c90 0x7f576410f490 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.666+0000 7f5763200640 1 --2- 172.21.15.37:0/1426435161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5764108310 0x7f5764108750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.666+0000 7f5763200640 1 --2- 172.21.15.37:0/1426435161 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5764102900 0x7f5764102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.666+0000 7f5763200640 1 -- 172.21.15.37:0/1426435161 >> 172.21.15.37:0/1426435161 conn(0x7f57640fe390 msgr2=0x7f57641007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:04.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.667+0000 7f5763200640 1 -- 172.21.15.37:0/1426435161 shutdown_connections 2024-08-20T05:05:04.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.667+0000 7f5763200640 1 -- 172.21.15.37:0/1426435161 wait complete. 2024-08-20T05:05:04.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.669+0000 7f5763200640 1 Processor -- start 2024-08-20T05:05:04.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.669+0000 7f5763200640 1 -- start start 2024-08-20T05:05:04.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.671+0000 7f5763200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5764102900 0x7f5764198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.671+0000 7f5763200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5764108310 0x7f5764199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.671+0000 7f5763200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5764108c90 0x7f576419e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.671+0000 7f5763200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f57641129a0 con 0x7f5764102900 2024-08-20T05:05:04.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.671+0000 7f5761400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5764108310 0x7f5764199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.671+0000 7f5763200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5764112820 con 0x7f5764108310 2024-08-20T05:05:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.672+0000 7f5761400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5764108310 0x7f5764199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:41318/0 (socket says 172.21.15.37:41318) 2024-08-20T05:05:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.672+0000 7f5763200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5764112b20 con 0x7f5764108c90 2024-08-20T05:05:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.672+0000 7f5761400640 1 -- 172.21.15.37:0/3997918505 learned_addr learned my addr 172.21.15.37:0/3997918505 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.672+0000 7f5762800640 1 --2- 172.21.15.37:0/3997918505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5764108c90 0x7f576419e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.672+0000 7f5761e00640 1 --2- 172.21.15.37:0/3997918505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5764102900 0x7f5764198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.672+0000 7f5762800640 1 -- 172.21.15.37:0/3997918505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5764108310 msgr2=0x7f5764199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.672+0000 7f5762800640 1 --2- 172.21.15.37:0/3997918505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5764108310 0x7f5764199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.672+0000 7f5762800640 1 -- 172.21.15.37:0/3997918505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5764102900 msgr2=0x7f5764198bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.672+0000 7f5762800640 1 --2- 172.21.15.37:0/3997918505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5764102900 0x7f5764198bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.672+0000 7f5762800640 1 -- 172.21.15.37:0/3997918505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f576419eca0 con 0x7f5764108c90 2024-08-20T05:05:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.673+0000 7f5762800640 1 --2- 172.21.15.37:0/3997918505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5764108c90 0x7f576419e4d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f575c005e30 tx=0x7f575c003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.673+0000 7f575aa00640 1 -- 172.21.15.37:0/3997918505 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575c004240 con 0x7f5764108c90 2024-08-20T05:05:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.673+0000 7f575aa00640 1 -- 172.21.15.37:0/3997918505 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f575c040070 con 0x7f5764108c90 2024-08-20T05:05:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.673+0000 7f575aa00640 1 -- 172.21.15.37:0/3997918505 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575c045b50 con 0x7f5764108c90 2024-08-20T05:05:04.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.673+0000 7f5763200640 1 -- 172.21.15.37:0/3997918505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f576419ef30 con 0x7f5764108c90 2024-08-20T05:05:04.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.674+0000 7f5763200640 1 -- 172.21.15.37:0/3997918505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57641a5650 con 0x7f5764108c90 2024-08-20T05:05:04.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.686+0000 7f576b8c9740 1 Processor -- start 2024-08-20T05:05:04.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.687+0000 7f575aa00640 1 -- 172.21.15.37:0/3997918505 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f575c045cf0 con 0x7f5764108c90 2024-08-20T05:05:04.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.688+0000 7f576b8c9740 1 -- start start 2024-08-20T05:05:04.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.689+0000 7f576b8c9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa56b9e0 0x560baa56bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.689+0000 7f576b8c9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa568d60 0x560baa56c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.690+0000 7f576b8c9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa57c530 0x560baa57e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.690+0000 7f576b8c9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560baa507670 con 0x560baa56b9e0 2024-08-20T05:05:04.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.690+0000 7f576b8c9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560baa4db7c0 con 0x560baa57c530 2024-08-20T05:05:04.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.690+0000 7f576b8c9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560baa4cacc0 con 0x560baa568d60 2024-08-20T05:05:04.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.690+0000 7f5761e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa568d60 0x560baa56c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:04.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.690+0000 7f5761e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa568d60 0x560baa56c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35584/0 (socket says 172.21.15.37:35584) 2024-08-20T05:05:04.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.690+0000 7f5761e00640 1 -- 172.21.15.37:0/1707344524 learned_addr learned my addr 172.21.15.37:0/1707344524 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:04.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.690+0000 7f5761e00640 1 -- 172.21.15.37:0/1707344524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa57c530 msgr2=0x560baa57e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:04.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.690+0000 7f5761e00640 1 --2- 172.21.15.37:0/1707344524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa57c530 0x560baa57e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.690+0000 7f5761e00640 1 -- 172.21.15.37:0/1707344524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa56b9e0 msgr2=0x560baa56bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:04.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.690+0000 7f5761e00640 1 --2- 172.21.15.37:0/1707344524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa56b9e0 0x560baa56bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.690+0000 7f5761e00640 1 -- 172.21.15.37:0/1707344524 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560baa45e110 con 0x560baa568d60 2024-08-20T05:05:04.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.691+0000 7f575aa00640 1 --2- 172.21.15.37:0/3997918505 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57480b3cf0 0x7f57480b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.691+0000 7f5761e00640 1 --2- 172.21.15.37:0/1707344524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa568d60 0x560baa56c300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f575400bcb0 tx=0x7f575400f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ed014e462d758cf server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:04.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.691+0000 7f575aa00640 1 -- 172.21.15.37:0/3997918505 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f575c105150 con 0x7f5764108c90 2024-08-20T05:05:04.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.691+0000 7f574f400640 1 -- 172.21.15.37:0/1707344524 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754015070 con 0x560baa568d60 2024-08-20T05:05:04.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.692+0000 7f574f400640 1 -- 172.21.15.37:0/1707344524 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57540118f0 con 0x560baa568d60 2024-08-20T05:05:04.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.692+0000 7f5761400640 1 --2- 172.21.15.37:0/3997918505 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57480b3cf0 0x7f57480b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:04.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.693+0000 7f576b8c9740 1 -- 172.21.15.37:0/1707344524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa568d60 msgr2=0x560baa56c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:04.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.693+0000 7f576b8c9740 1 --2- 172.21.15.37:0/1707344524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa568d60 0x560baa56c300 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f575400bcb0 tx=0x7f575400f730 comp rx=0 tx=0).stop 2024-08-20T05:05:04.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.693+0000 7f5761400640 1 --2- 172.21.15.37:0/3997918505 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57480b3cf0 0x7f57480b61b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5750005fb0 tx=0x7f5750005f00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.695+0000 7f576b8c9740 1 -- 172.21.15.37:0/1707344524 shutdown_connections 2024-08-20T05:05:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.695+0000 7f576b8c9740 1 --2- 172.21.15.37:0/1707344524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa57c530 0x560baa57e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.695+0000 7f576b8c9740 1 --2- 172.21.15.37:0/1707344524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa568d60 0x560baa56c300 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.695+0000 7f576b8c9740 1 --2- 172.21.15.37:0/1707344524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa56b9e0 0x560baa56bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.695+0000 7f576b8c9740 1 -- 172.21.15.37:0/1707344524 >> 172.21.15.37:0/1707344524 conn(0x560baa569810 msgr2=0x560baa56a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:04.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.695+0000 7f576b8c9740 1 -- 172.21.15.37:0/1707344524 shutdown_connections 2024-08-20T05:05:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.696+0000 7f576b8c9740 1 -- 172.21.15.37:0/1707344524 wait complete. 2024-08-20T05:05:04.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.697+0000 7f576b8c9740 1 -- start start 2024-08-20T05:05:04.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.697+0000 7f576b8c9740 1 Processor -- start 2024-08-20T05:05:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.700+0000 7f576b8c9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa568d60 0x560baa568800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.700+0000 7f576b8c9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa56b9e0 0x560baa565c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.700+0000 7f576b8c9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa57c530 0x560baa566400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.701+0000 7f5761e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa568d60 0x560baa568800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.701+0000 7f5761e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa568d60 0x560baa568800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:41336/0 (socket says 172.21.15.37:41336) 2024-08-20T05:05:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.703+0000 7f5761e00640 1 -- 172.21.15.37:0/4054727605 learned_addr learned my addr 172.21.15.37:0/4054727605 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.703+0000 7f576b8c9740 1 -- 172.21.15.37:0/4054727605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560baa470780 con 0x560baa56b9e0 2024-08-20T05:05:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.703+0000 7f576b8c9740 1 -- 172.21.15.37:0/4054727605 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560baa4ced00 con 0x560baa568d60 2024-08-20T05:05:04.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.703+0000 7f576b8c9740 1 -- 172.21.15.37:0/4054727605 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560baa32d7a0 con 0x560baa57c530 2024-08-20T05:05:04.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.703+0000 7f5762800640 1 --2- 172.21.15.37:0/4054727605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa57c530 0x560baa566400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:04.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.703+0000 7f576b8c9740 10 client.0 _ll_register_callbacks cb 0x560baa478940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:04.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.704+0000 7f5761400640 1 --2- 172.21.15.37:0/4054727605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa56b9e0 0x560baa565c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.704+0000 7f5762800640 1 -- 172.21.15.37:0/4054727605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa568d60 msgr2=0x560baa568800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.704+0000 7f5762800640 1 --2- 172.21.15.37:0/4054727605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa568d60 0x560baa568800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.704+0000 7f5762800640 1 -- 172.21.15.37:0/4054727605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa56b9e0 msgr2=0x560baa565c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.704+0000 7f5762800640 1 --2- 172.21.15.37:0/4054727605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa56b9e0 0x560baa565c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.705+0000 7f5762800640 1 -- 172.21.15.37:0/4054727605 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560baa47d9c0 con 0x560baa57c530 2024-08-20T05:05:04.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.705+0000 7f576b8c9740 1 -- 172.21.15.37:0/4054727605 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57540118f0 con 0x560baa57c530 2024-08-20T05:05:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.706+0000 7f5762800640 1 --2- 172.21.15.37:0/4054727605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa57c530 0x560baa566400 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f575c0c8f10 tx=0x7f575c030cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c045bb0242dd6a4a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.706+0000 7f5743e00640 10 client.26233 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:05:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.706+0000 7f5743e00640 1 -- 172.21.15.37:0/4054727605 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575c0d0020 con 0x560baa57c530 2024-08-20T05:05:04.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.706+0000 7f5743e00640 1 -- 172.21.15.37:0/4054727605 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f575c0cc110 con 0x560baa57c530 2024-08-20T05:05:04.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.706+0000 7f5743e00640 1 -- 172.21.15.37:0/4054727605 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f575c0cc3a0 con 0x560baa57c530 2024-08-20T05:05:04.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.707+0000 7f576b8c9740 10 client.26233 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:04.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.707+0000 7f576b8c9740 1 -- 172.21.15.37:0/4054727605 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({fsmap=33}) -- 0x560baa239b90 con 0x560baa57c530 2024-08-20T05:05:04.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.708+0000 7f5743e00640 1 -- 172.21.15.37:0/4054727605 <== mon.1 v2:172.21.15.135:3300/0 4 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f575c04d030 con 0x560baa57c530 2024-08-20T05:05:04.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.708+0000 7f576b8c9740 10 client.26233 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.708+0000 7f576b8c9740 10 client.26233 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:05:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.708+0000 7f576b8c9740 20 client.26233 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.708+0000 7f576b8c9740 1 --2- 172.21.15.37:0/4054727605 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560baa58c060 0x560baa58e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.708+0000 7f576b8c9740 4 client.26233 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:05:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.708+0000 7f576b8c9740 1 -- 172.21.15.37:0/4054727605 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560baa4dd710 con 0x560baa58c060 2024-08-20T05:05:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.708+0000 7f5761e00640 1 --2- 172.21.15.37:0/4054727605 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560baa58c060 0x560baa58e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:04.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.710+0000 7f5761e00640 1 --2- 172.21.15.37:0/4054727605 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560baa58c060 0x560baa58e4c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14787fe514477dd8 server_cookie=50e6a0cbe6f4388d in_seq=0 out_seq=0 2024-08-20T05:05:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.710+0000 7f5743e00640 10 client.26233 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:04.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.710+0000 7f5743e00640 1 -- 172.21.15.37:0/4054727605 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560baa4dd710 con 0x560baa58c060 2024-08-20T05:05:04.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.710+0000 7f5743e00640 10 client.26233 handle_command_reply: tid=0 2024-08-20T05:05:04.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.711+0000 7f576b8c9740 1 client.26233 shutdown 2024-08-20T05:05:04.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.711+0000 7f576b8c9740 1 -- 172.21.15.37:0/4054727605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa57c530 msgr2=0x560baa566400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:04.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.711+0000 7f576b8c9740 1 --2- 172.21.15.37:0/4054727605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa57c530 0x560baa566400 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f575c0c8f10 tx=0x7f575c030cb0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.712+0000 7f576b8c9740 1 -- 172.21.15.37:0/4054727605 shutdown_connections 2024-08-20T05:05:04.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.712+0000 7f576b8c9740 1 --2- 172.21.15.37:0/4054727605 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560baa58c060 0x560baa58e4c0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.712+0000 7f576b8c9740 1 --2- 172.21.15.37:0/4054727605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa57c530 0x560baa566400 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.712+0000 7f576b8c9740 1 --2- 172.21.15.37:0/4054727605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa56b9e0 0x560baa565c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.712+0000 7f5743e00640 0 client.26233 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:04.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.712+0000 7f576b8c9740 1 --2- 172.21.15.37:0/4054727605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa568d60 0x560baa568800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.712+0000 7f576b8c9740 1 -- 172.21.15.37:0/4054727605 >> 172.21.15.37:0/4054727605 conn(0x560baa569810 msgr2=0x560baa56eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:04.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.712+0000 7f576b8c9740 1 -- 172.21.15.37:0/4054727605 shutdown_connections 2024-08-20T05:05:04.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.713+0000 7f576b8c9740 1 -- 172.21.15.37:0/4054727605 wait complete. 2024-08-20T05:05:04.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.713+0000 7f576b8c9740 20 client.26233 trim_cache size 0 max 16384 2024-08-20T05:05:04.742 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:05:04.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.749+0000 7f576b8c9740 1 Processor -- start 2024-08-20T05:05:04.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.750+0000 7f576b8c9740 1 -- start start 2024-08-20T05:05:04.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.750+0000 7f576b8c9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa568d60 0x560baa56a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.750+0000 7f576b8c9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa56b9e0 0x560baa567990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.750+0000 7f576b8c9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa57c530 0x560baa57dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.750+0000 7f576b8c9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f57641ad230 con 0x560baa57c530 2024-08-20T05:05:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.750+0000 7f576b8c9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f57641aee30 con 0x560baa568d60 2024-08-20T05:05:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.750+0000 7f576b8c9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f57641ad900 con 0x560baa56b9e0 2024-08-20T05:05:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.751+0000 7f5762800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa57c530 0x560baa57dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:04.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.751+0000 7f5762800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa57c530 0x560baa57dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34836/0 (socket says 172.21.15.37:34836) 2024-08-20T05:05:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.751+0000 7f5762800640 1 -- 172.21.15.37:0/214497473 learned_addr learned my addr 172.21.15.37:0/214497473 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.751+0000 7f5761400640 1 --2- 172.21.15.37:0/214497473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa56b9e0 0x560baa567990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.751+0000 7f5761400640 1 -- 172.21.15.37:0/214497473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa568d60 msgr2=0x560baa56a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.751+0000 7f5761400640 1 --2- 172.21.15.37:0/214497473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa568d60 0x560baa56a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.751+0000 7f5761400640 1 -- 172.21.15.37:0/214497473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa57c530 msgr2=0x560baa57dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.751+0000 7f5761400640 1 --2- 172.21.15.37:0/214497473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa57c530 0x560baa57dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.751+0000 7f5761400640 1 -- 172.21.15.37:0/214497473 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560baa568b70 con 0x560baa56b9e0 2024-08-20T05:05:04.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.752+0000 7f5762800640 1 --2- 172.21.15.37:0/214497473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa57c530 0x560baa57dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:04.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.752+0000 7f5761400640 1 --2- 172.21.15.37:0/214497473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa56b9e0 0x560baa567990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f575000a760 tx=0x7f5750012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a014162b0d291ad2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:04.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.752+0000 7f574ea00640 1 -- 172.21.15.37:0/214497473 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5750016070 con 0x560baa56b9e0 2024-08-20T05:05:04.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.752+0000 7f574ea00640 1 -- 172.21.15.37:0/214497473 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5750021070 con 0x560baa56b9e0 2024-08-20T05:05:04.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.752+0000 7f574ea00640 1 -- 172.21.15.37:0/214497473 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575001d760 con 0x560baa56b9e0 2024-08-20T05:05:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.754+0000 7f576b8c9740 1 -- 172.21.15.37:0/214497473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa56b9e0 msgr2=0x560baa567990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.754+0000 7f576b8c9740 1 --2- 172.21.15.37:0/214497473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa56b9e0 0x560baa567990 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f575000a760 tx=0x7f5750012000 comp rx=0 tx=0).stop 2024-08-20T05:05:04.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.754+0000 7f576b8c9740 1 -- 172.21.15.37:0/214497473 shutdown_connections 2024-08-20T05:05:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.754+0000 7f576b8c9740 1 --2- 172.21.15.37:0/214497473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa57c530 0x560baa57dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.754+0000 7f576b8c9740 1 --2- 172.21.15.37:0/214497473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa56b9e0 0x560baa567990 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.754+0000 7f576b8c9740 1 --2- 172.21.15.37:0/214497473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa568d60 0x560baa56a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.754+0000 7f576b8c9740 1 -- 172.21.15.37:0/214497473 >> 172.21.15.37:0/214497473 conn(0x560baa569810 msgr2=0x560baa567280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:04.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.755+0000 7f576b8c9740 1 -- 172.21.15.37:0/214497473 shutdown_connections 2024-08-20T05:05:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.755+0000 7f576b8c9740 1 -- 172.21.15.37:0/214497473 wait complete. 2024-08-20T05:05:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.756+0000 7f576b8c9740 1 -- start start 2024-08-20T05:05:04.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.756+0000 7f576b8c9740 1 Processor -- start 2024-08-20T05:05:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.757+0000 7f576b8c9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa568d60 0x560baa5847d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.757+0000 7f576b8c9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa56b9e0 0x560baa584d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.757+0000 7f576b8c9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa57c530 0x560baa5815c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.757+0000 7f576b8c9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f57641ae6a0 con 0x560baa568d60 2024-08-20T05:05:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.757+0000 7f576b8c9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f57641adfd0 con 0x560baa56b9e0 2024-08-20T05:05:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.757+0000 7f576b8c9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f57641ab210 con 0x560baa57c530 2024-08-20T05:05:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.757+0000 7f576b8c9740 10 client.0 _ll_register_callbacks cb 0x7f575c003ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.758+0000 7f5761e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa568d60 0x560baa5847d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.758+0000 7f5761400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa56b9e0 0x560baa584d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.758+0000 7f5761400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa56b9e0 0x560baa584d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:41350/0 (socket says 172.21.15.37:41350) 2024-08-20T05:05:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.758+0000 7f5761400640 1 -- 172.21.15.37:0/3522157125 learned_addr learned my addr 172.21.15.37:0/3522157125 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.758+0000 7f5762800640 1 --2- 172.21.15.37:0/3522157125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa57c530 0x560baa5815c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.758+0000 7f5761e00640 1 -- 172.21.15.37:0/3522157125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa57c530 msgr2=0x560baa5815c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.758+0000 7f5761e00640 1 --2- 172.21.15.37:0/3522157125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa57c530 0x560baa5815c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.759+0000 7f5761e00640 1 -- 172.21.15.37:0/3522157125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa56b9e0 msgr2=0x560baa584d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.759+0000 7f5761e00640 1 --2- 172.21.15.37:0/3522157125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa56b9e0 0x560baa584d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.759+0000 7f5761e00640 1 -- 172.21.15.37:0/3522157125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560baa581d30 con 0x560baa568d60 2024-08-20T05:05:04.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.759+0000 7f5761e00640 1 --2- 172.21.15.37:0/3522157125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa568d60 0x560baa5847d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x560baa58ed30 tx=0x7f575400b470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e9cee8187744bd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:04.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.759+0000 7f5743e00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:05:04.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.760+0000 7f5743e00640 1 -- 172.21.15.37:0/3522157125 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754015070 con 0x560baa568d60 2024-08-20T05:05:04.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.760+0000 7f5743e00640 1 -- 172.21.15.37:0/3522157125 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5754010a50 con 0x560baa568d60 2024-08-20T05:05:04.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.760+0000 7f576b8c9740 1 -- 172.21.15.37:0/3522157125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5750021070 con 0x560baa568d60 2024-08-20T05:05:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.760+0000 7f5743e00640 1 -- 172.21.15.37:0/3522157125 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f575400b8a0 con 0x560baa568d60 2024-08-20T05:05:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.760+0000 7f576b8c9740 10 client.16053 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.760+0000 7f576b8c9740 1 -- 172.21.15.37:0/3522157125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560baa5f77b0 con 0x560baa568d60 2024-08-20T05:05:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.761+0000 7f5743e00640 1 -- 172.21.15.37:0/3522157125 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5754010c50 con 0x560baa568d60 2024-08-20T05:05:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.761+0000 7f5743e00640 1 -- 172.21.15.37:0/3522157125 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f5754005040 con 0x560baa568d60 2024-08-20T05:05:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.761+0000 7f576b8c9740 10 client.16053 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.761+0000 7f576b8c9740 10 client.16053 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:05:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.761+0000 7f576b8c9740 20 client.16053 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.761+0000 7f576b8c9740 1 --2- 172.21.15.37:0/3522157125 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560baa5f7c10 0x560baa5fa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.761+0000 7f576b8c9740 4 client.16053 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.4, "await_for": 45.0}] 2024-08-20T05:05:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.761+0000 7f576b8c9740 1 -- 172.21.15.37:0/3522157125 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.4, "await_for": 45.0}) -- 0x7f5750021070 con 0x560baa5f7c10 2024-08-20T05:05:04.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.761+0000 7f5761400640 1 --2- 172.21.15.37:0/3522157125 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560baa5f7c10 0x560baa5fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:04.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.762+0000 7f5761400640 1 --2- 172.21.15.37:0/3522157125 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560baa5f7c10 0x560baa5fa000 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=176c98f857abbb03 server_cookie=37ebc6305092d82e in_seq=0 out_seq=0 2024-08-20T05:05:04.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.762+0000 7f5743e00640 10 client.16053 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:04.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.902+0000 7f5743e00640 1 -- 172.21.15.37:0/3522157125 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f5750021070 con 0x560baa5f7c10 2024-08-20T05:05:04.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.902+0000 7f5743e00640 10 client.16053 handle_command_reply: tid=0 2024-08-20T05:05:04.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.902+0000 7f576b8c9740 1 client.16053 shutdown 2024-08-20T05:05:04.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.902+0000 7f576b8c9740 1 -- 172.21.15.37:0/3522157125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa568d60 msgr2=0x560baa5847d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:04.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.902+0000 7f576b8c9740 1 --2- 172.21.15.37:0/3522157125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa568d60 0x560baa5847d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x560baa58ed30 tx=0x7f575400b470 comp rx=0 tx=0).stop 2024-08-20T05:05:04.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.902+0000 7f576b8c9740 1 -- 172.21.15.37:0/3522157125 shutdown_connections 2024-08-20T05:05:04.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.902+0000 7f576b8c9740 1 --2- 172.21.15.37:0/3522157125 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560baa5f7c10 0x560baa5fa000 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.902+0000 7f576b8c9740 1 --2- 172.21.15.37:0/3522157125 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560baa57c530 0x560baa5815c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.902+0000 7f576b8c9740 1 --2- 172.21.15.37:0/3522157125 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560baa56b9e0 0x560baa584d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.902+0000 7f576b8c9740 1 --2- 172.21.15.37:0/3522157125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560baa568d60 0x560baa5847d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.902+0000 7f5743e00640 0 client.16053 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:04.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.902+0000 7f576b8c9740 1 -- 172.21.15.37:0/3522157125 >> 172.21.15.37:0/3522157125 conn(0x560baa569810 msgr2=0x560baa567aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:04.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.903+0000 7f576b8c9740 1 -- 172.21.15.37:0/3522157125 shutdown_connections 2024-08-20T05:05:04.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.903+0000 7f576b8c9740 1 -- 172.21.15.37:0/3522157125 wait complete. 2024-08-20T05:05:04.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.903+0000 7f576b8c9740 20 client.16053 trim_cache size 0 max 16384 2024-08-20T05:05:04.906 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:05:04.907 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-08-20T05:05:04.907 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:05:04.907 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 14, 2024-08-20T05:05:04.907 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:05:04.907 INFO:teuthology.orchestra.run.smithi037.stdout: "6a321e2e": { 2024-08-20T05:05:04.907 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 14, 2024-08-20T05:05:04.907 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:05:04.907 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:05:04.907 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:05:04.907 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:05:04.907 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:05:04.907 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:05:04.907 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 136.4, 2024-08-20T05:05:04.908 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:05:04.908 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:05:04.908 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:05:04.908 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:05:04.908 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:05:04.908 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:05:04.908 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:05:04.908 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:05:04.908 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:05:04.908 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:05:04.908 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:05:04.908 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:05:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.904+0000 7f5763200640 1 -- 172.21.15.37:0/3997918505 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57480b3cf0 msgr2=0x7f57480b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.904+0000 7f5763200640 1 --2- 172.21.15.37:0/3997918505 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57480b3cf0 0x7f57480b61b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5750005fb0 tx=0x7f5750005f00 comp rx=0 tx=0).stop 2024-08-20T05:05:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.904+0000 7f5763200640 1 -- 172.21.15.37:0/3997918505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5764108c90 msgr2=0x7f576419e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.904+0000 7f5763200640 1 --2- 172.21.15.37:0/3997918505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5764108c90 0x7f576419e4d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f575c005e30 tx=0x7f575c003ba0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.904+0000 7f5763200640 1 -- 172.21.15.37:0/3997918505 shutdown_connections 2024-08-20T05:05:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.904+0000 7f5763200640 1 --2- 172.21.15.37:0/3997918505 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57480b3cf0 0x7f57480b61b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.904+0000 7f5763200640 1 --2- 172.21.15.37:0/3997918505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5764108c90 0x7f576419e4d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.904+0000 7f5763200640 1 --2- 172.21.15.37:0/3997918505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5764108310 0x7f5764199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.904+0000 7f5763200640 1 --2- 172.21.15.37:0/3997918505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5764102900 0x7f5764198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.904+0000 7f5763200640 1 -- 172.21.15.37:0/3997918505 >> 172.21.15.37:0/3997918505 conn(0x7f57640fe390 msgr2=0x7f57640fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.904+0000 7f5763200640 1 -- 172.21.15.37:0/3997918505 shutdown_connections 2024-08-20T05:05:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:04.904+0000 7f5763200640 1 -- 172.21.15.37:0/3997918505 wait complete. 2024-08-20T05:05:05.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.458+0000 7fabcc800640 1 -- 172.21.15.37:0/1324567783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc4102ab0 msgr2=0x7fabc4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:05.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.458+0000 7fabcc800640 1 --2- 172.21.15.37:0/1324567783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc4102ab0 0x7fabc4102e90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009900 tx=0x7fabb802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:05:05.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.458+0000 7fabcc800640 1 -- 172.21.15.37:0/1324567783 shutdown_connections 2024-08-20T05:05:05.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.458+0000 7fabcc800640 1 --2- 172.21.15.37:0/1324567783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fabc4108e40 0x7fabc410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:05.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.458+0000 7fabcc800640 1 --2- 172.21.15.37:0/1324567783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc41084c0 0x7fabc4108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:05.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.458+0000 7fabcc800640 1 --2- 172.21.15.37:0/1324567783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc4102ab0 0x7fabc4102e90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:05.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.458+0000 7fabcc800640 1 -- 172.21.15.37:0/1324567783 >> 172.21.15.37:0/1324567783 conn(0x7fabc40fe500 msgr2=0x7fabc4100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:05.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.458+0000 7fabcc800640 1 -- 172.21.15.37:0/1324567783 shutdown_connections 2024-08-20T05:05:05.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.458+0000 7fabcc800640 1 -- 172.21.15.37:0/1324567783 wait complete. 2024-08-20T05:05:05.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.459+0000 7fabcc800640 1 Processor -- start 2024-08-20T05:05:05.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.459+0000 7fabcc800640 1 -- start start 2024-08-20T05:05:05.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.460+0000 7fabcc800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc4102ab0 0x7fabc40751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:05.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.460+0000 7fabcc800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc41084c0 0x7fabc4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:05.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.460+0000 7fabcc800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fabc4108e40 0x7fabc4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.460+0000 7fabcc800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fabc4112b50 con 0x7fabc4102ab0 2024-08-20T05:05:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.460+0000 7fabcc800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fabc41129d0 con 0x7fabc4108e40 2024-08-20T05:05:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.460+0000 7fabcc800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fabc4112cd0 con 0x7fabc41084c0 2024-08-20T05:05:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.460+0000 7fabc9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc4102ab0 0x7fabc40751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.460+0000 7fabc9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc4102ab0 0x7fabc40751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34866/0 (socket says 172.21.15.37:34866) 2024-08-20T05:05:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.460+0000 7fabc9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc41084c0 0x7fabc4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.460+0000 7fabc9e00640 1 -- 172.21.15.37:0/1856287758 learned_addr learned my addr 172.21.15.37:0/1856287758 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.460+0000 7fabca800640 1 --2- 172.21.15.37:0/1856287758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fabc4108e40 0x7fabc4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.460+0000 7fabc9e00640 1 -- 172.21.15.37:0/1856287758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc41084c0 msgr2=0x7fabc4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.460+0000 7fabc9e00640 1 --2- 172.21.15.37:0/1856287758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc41084c0 0x7fabc4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.460+0000 7fabc9e00640 1 -- 172.21.15.37:0/1856287758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fabc4108e40 msgr2=0x7fabc4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.460+0000 7fabc9e00640 1 --2- 172.21.15.37:0/1856287758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fabc4108e40 0x7fabc4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:05.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.461+0000 7fabc9e00640 1 -- 172.21.15.37:0/1856287758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc41a7380 con 0x7fabc4102ab0 2024-08-20T05:05:05.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.461+0000 7fabc9e00640 1 --2- 172.21.15.37:0/1856287758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc4102ab0 0x7fabc40751d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fabb8005ab0 tx=0x7fabb8003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:05.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.461+0000 7fabbea00640 1 -- 172.21.15.37:0/1856287758 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb803f070 con 0x7fabc4102ab0 2024-08-20T05:05:05.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.461+0000 7fabbea00640 1 -- 172.21.15.37:0/1856287758 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabb8031d60 con 0x7fabc4102ab0 2024-08-20T05:05:05.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.461+0000 7fabcc800640 1 -- 172.21.15.37:0/1856287758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc41a7610 con 0x7fabc4102ab0 2024-08-20T05:05:05.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.461+0000 7fabbea00640 1 -- 172.21.15.37:0/1856287758 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb8035030 con 0x7fabc4102ab0 2024-08-20T05:05:05.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.461+0000 7fabcc800640 1 -- 172.21.15.37:0/1856287758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc41a7af0 con 0x7fabc4102ab0 2024-08-20T05:05:05.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.462+0000 7fabcc800640 1 -- 172.21.15.37:0/1856287758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabc4102e90 con 0x7fabc4102ab0 2024-08-20T05:05:05.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.464+0000 7fabbea00640 1 -- 172.21.15.37:0/1856287758 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fabb8042070 con 0x7fabc4102ab0 2024-08-20T05:05:05.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.466+0000 7fabbea00640 1 --2- 172.21.15.37:0/1856287758 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fabac0b3bd0 0x7fabac0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:05.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.466+0000 7fabbea00640 1 -- 172.21.15.37:0/1856287758 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fabb8104ea0 con 0x7fabc4102ab0 2024-08-20T05:05:05.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.466+0000 7fabc9400640 1 --2- 172.21.15.37:0/1856287758 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fabac0b3bd0 0x7fabac0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:05.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.467+0000 7fabc9400640 1 --2- 172.21.15.37:0/1856287758 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fabac0b3bd0 0x7fabac0b6090 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fabc4076cc0 tx=0x7fabb400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:05.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.468+0000 7fabbea00640 1 -- 172.21.15.37:0/1856287758 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fabb80cc0f0 con 0x7fabc4102ab0 2024-08-20T05:05:05.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.701+0000 7fabcc800640 1 -- 172.21.15.37:0/1856287758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabc41a7e60 con 0x7fabc4102ab0 2024-08-20T05:05:05.703 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:05 smithi037 ceph-mon[17265]: pgmap v486: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 994 op/s 2024-08-20T05:05:05.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.702+0000 7fabbea00640 1 -- 172.21.15.37:0/1856287758 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11987 (secure 0 0 0) 0x7fabb80cb9f0 con 0x7fabc4102ab0 2024-08-20T05:05:05.705 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:05:05.705 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":33,"btime":"2024-08-20T05:03:11:706710+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:03:11.271814+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:05:05.705 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 33 2024-08-20T05:05:05.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:05 smithi130 ceph-mon[22007]: pgmap v486: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 994 op/s 2024-08-20T05:05:05.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.705+0000 7fabcc800640 1 -- 172.21.15.37:0/1856287758 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fabac0b3bd0 msgr2=0x7fabac0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:05.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.705+0000 7fabcc800640 1 --2- 172.21.15.37:0/1856287758 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fabac0b3bd0 0x7fabac0b6090 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fabc4076cc0 tx=0x7fabb400b390 comp rx=0 tx=0).stop 2024-08-20T05:05:05.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.705+0000 7fabcc800640 1 -- 172.21.15.37:0/1856287758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc4102ab0 msgr2=0x7fabc40751d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:05.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.705+0000 7fabcc800640 1 --2- 172.21.15.37:0/1856287758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc4102ab0 0x7fabc40751d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fabb8005ab0 tx=0x7fabb8003c80 comp rx=0 tx=0).stop 2024-08-20T05:05:05.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.705+0000 7fabcc800640 1 -- 172.21.15.37:0/1856287758 shutdown_connections 2024-08-20T05:05:05.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.705+0000 7fabcc800640 1 --2- 172.21.15.37:0/1856287758 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fabac0b3bd0 0x7fabac0b6090 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:05.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.705+0000 7fabcc800640 1 --2- 172.21.15.37:0/1856287758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fabc4108e40 0x7fabc4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:05.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.705+0000 7fabcc800640 1 --2- 172.21.15.37:0/1856287758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fabc41084c0 0x7fabc4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:05.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.705+0000 7fabcc800640 1 --2- 172.21.15.37:0/1856287758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc4102ab0 0x7fabc40751d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:05.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.705+0000 7fabcc800640 1 -- 172.21.15.37:0/1856287758 >> 172.21.15.37:0/1856287758 conn(0x7fabc40fe500 msgr2=0x7fabc40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:05.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.705+0000 7fabcc800640 1 -- 172.21.15.37:0/1856287758 shutdown_connections 2024-08-20T05:05:05.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:05.705+0000 7fabcc800640 1 -- 172.21.15.37:0/1856287758 wait complete. 2024-08-20T05:05:05.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:05 smithi135 ceph-mon[22342]: pgmap v486: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 994 op/s 2024-08-20T05:05:06.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:06 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1856287758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:05:06.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:06 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1856287758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:05:06.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:06 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1856287758' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:05:07.278 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6a321e2e', quiesce took 15.0 seconds. Will release after: 1.3999999999999986 2024-08-20T05:05:07.489 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:07 smithi037 ceph-mon[17265]: pgmap v487: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 15 MiB/s wr, 943 op/s 2024-08-20T05:05:07.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:07 smithi135 ceph-mon[22342]: pgmap v487: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 15 MiB/s wr, 943 op/s 2024-08-20T05:05:07.879 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T05:05:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:07 smithi130 ceph-mon[22007]: pgmap v487: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 15 MiB/s wr, 943 op/s 2024-08-20T05:05:08.044 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 130.0 s, 354.4 tps, lat 97.962 ms stddev 117.878 2024-08-20T05:05:08.258 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:05:08.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:05:08.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.862+0000 7f8d1fe00640 1 -- 172.21.15.37:0/1219388466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d18104ca0 msgr2=0x7f8d18105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:08.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.862+0000 7f8d1fe00640 1 --2- 172.21.15.37:0/1219388466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d18104ca0 0x7f8d18105080 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009900 tx=0x7f8d0c02a410 comp rx=0 tx=0).stop 2024-08-20T05:05:08.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.862+0000 7f8d1fe00640 1 -- 172.21.15.37:0/1219388466 shutdown_connections 2024-08-20T05:05:08.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.862+0000 7f8d1fe00640 1 --2- 172.21.15.37:0/1219388466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d1810b030 0x7f8d18111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.862+0000 7f8d1fe00640 1 --2- 172.21.15.37:0/1219388466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d1810a6b0 0x7f8d1810aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.862+0000 7f8d1fe00640 1 --2- 172.21.15.37:0/1219388466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d18104ca0 0x7f8d18105080 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.862+0000 7f8d1fe00640 1 -- 172.21.15.37:0/1219388466 >> 172.21.15.37:0/1219388466 conn(0x7f8d18100730 msgr2=0x7f8d18102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.862+0000 7f8d1fe00640 1 -- 172.21.15.37:0/1219388466 shutdown_connections 2024-08-20T05:05:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.862+0000 7f8d1fe00640 1 -- 172.21.15.37:0/1219388466 wait complete. 2024-08-20T05:05:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.863+0000 7f8d1fe00640 1 Processor -- start 2024-08-20T05:05:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.863+0000 7f8d1fe00640 1 -- start start 2024-08-20T05:05:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.863+0000 7f8d1fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d18104ca0 0x7f8d1819b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.863+0000 7f8d1fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d1810a6b0 0x7f8d1819b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.863+0000 7f8d1fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d1810b030 0x7f8d181a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.863+0000 7f8d1fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d18114cf0 con 0x7f8d1810a6b0 2024-08-20T05:05:08.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.863+0000 7f8d1fe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8d18114b70 con 0x7f8d18104ca0 2024-08-20T05:05:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.863+0000 7f8d1fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8d18114e70 con 0x7f8d1810b030 2024-08-20T05:05:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.864+0000 7f8d1d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d18104ca0 0x7f8d1819b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.864+0000 7f8d1ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d1810a6b0 0x7f8d1819b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.864+0000 7f8d1d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d18104ca0 0x7f8d1819b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:41362/0 (socket says 172.21.15.37:41362) 2024-08-20T05:05:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.864+0000 7f8d1d400640 1 -- 172.21.15.37:0/4197924038 learned_addr learned my addr 172.21.15.37:0/4197924038 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.864+0000 7f8d1de00640 1 --2- 172.21.15.37:0/4197924038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d1810b030 0x7f8d181a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.864+0000 7f8d1ca00640 1 -- 172.21.15.37:0/4197924038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d1810b030 msgr2=0x7f8d181a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.864+0000 7f8d1ca00640 1 --2- 172.21.15.37:0/4197924038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d1810b030 0x7f8d181a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.864+0000 7f8d1ca00640 1 -- 172.21.15.37:0/4197924038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d18104ca0 msgr2=0x7f8d1819b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.864+0000 7f8d1ca00640 1 --2- 172.21.15.37:0/4197924038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d18104ca0 0x7f8d1819b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.864+0000 7f8d1ca00640 1 -- 172.21.15.37:0/4197924038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d181a1210 con 0x7f8d1810a6b0 2024-08-20T05:05:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.864+0000 7f8d1d400640 1 --2- 172.21.15.37:0/4197924038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d18104ca0 0x7f8d1819b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.864+0000 7f8d1ca00640 1 --2- 172.21.15.37:0/4197924038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d1810a6b0 0x7f8d1819b6a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400e9f0 tx=0x7f8d0400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.865+0000 7f8d16000640 1 -- 172.21.15.37:0/4197924038 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0400ccc0 con 0x7f8d1810a6b0 2024-08-20T05:05:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.865+0000 7f8d1fe00640 1 -- 172.21.15.37:0/4197924038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d181a1500 con 0x7f8d1810a6b0 2024-08-20T05:05:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.865+0000 7f8d16000640 1 -- 172.21.15.37:0/4197924038 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d040108e0 con 0x7f8d1810a6b0 2024-08-20T05:05:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.865+0000 7f8d16000640 1 -- 172.21.15.37:0/4197924038 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d04018880 con 0x7f8d1810a6b0 2024-08-20T05:05:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.865+0000 7f8d1fe00640 1 -- 172.21.15.37:0/4197924038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d181a7bc0 con 0x7f8d1810a6b0 2024-08-20T05:05:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.868+0000 7f8d22897740 1 Processor -- start 2024-08-20T05:05:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.869+0000 7f8d22897740 1 -- start start 2024-08-20T05:05:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.869+0000 7f8d16000640 1 -- 172.21.15.37:0/4197924038 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8d04010430 con 0x7f8d1810a6b0 2024-08-20T05:05:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.869+0000 7f8d22897740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2d940 0x558afac2dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.869+0000 7f8d22897740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2e260 0x558afac39cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.869+0000 7f8d22897740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac3a1f0 0x558afac3c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.869+0000 7f8d22897740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558afaba3aa0 con 0x558afac2e260 2024-08-20T05:05:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.869+0000 7f8d22897740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558afab92fa0 con 0x558afac3a1f0 2024-08-20T05:05:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.869+0000 7f8d22897740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558afab96fe0 con 0x558afac2d940 2024-08-20T05:05:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.869+0000 7f8d1d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2e260 0x558afac39cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.869+0000 7f8d1de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2d940 0x558afac2dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.869+0000 7f8d1d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2e260 0x558afac39cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34884/0 (socket says 172.21.15.37:34884) 2024-08-20T05:05:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.869+0000 7f8d1d400640 1 -- 172.21.15.37:0/938360085 learned_addr learned my addr 172.21.15.37:0/938360085 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.870+0000 7f8d1ca00640 1 --2- 172.21.15.37:0/938360085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac3a1f0 0x558afac3c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.870+0000 7f8d1de00640 1 -- 172.21.15.37:0/938360085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac3a1f0 msgr2=0x558afac3c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.870+0000 7f8d1de00640 1 --2- 172.21.15.37:0/938360085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac3a1f0 0x558afac3c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.870+0000 7f8d1de00640 1 -- 172.21.15.37:0/938360085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2e260 msgr2=0x558afac39cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.870+0000 7f8d1de00640 1 --2- 172.21.15.37:0/938360085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2e260 0x558afac39cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.870+0000 7f8d1de00640 1 -- 172.21.15.37:0/938360085 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558afab39420 con 0x558afac2d940 2024-08-20T05:05:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.870+0000 7f8d1de00640 1 --2- 172.21.15.37:0/938360085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2d940 0x558afac2dd20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8d10009f00 tx=0x7f8d10011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0dc67e0c8e09a96 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.870+0000 7f8d0a600640 1 -- 172.21.15.37:0/938360085 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d10004d20 con 0x558afac2d940 2024-08-20T05:05:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.871+0000 7f8d0a600640 1 -- 172.21.15.37:0/938360085 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d10004030 con 0x558afac2d940 2024-08-20T05:05:08.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.871+0000 7f8d0a600640 1 -- 172.21.15.37:0/938360085 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d10005220 con 0x558afac2d940 2024-08-20T05:05:08.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.871+0000 7f8d22897740 1 -- 172.21.15.37:0/938360085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2d940 msgr2=0x558afac2dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:08.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.871+0000 7f8d22897740 1 --2- 172.21.15.37:0/938360085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2d940 0x558afac2dd20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8d10009f00 tx=0x7f8d10011810 comp rx=0 tx=0).stop 2024-08-20T05:05:08.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.871+0000 7f8d22897740 1 -- 172.21.15.37:0/938360085 shutdown_connections 2024-08-20T05:05:08.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.871+0000 7f8d22897740 1 --2- 172.21.15.37:0/938360085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac3a1f0 0x558afac3c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.871+0000 7f8d22897740 1 --2- 172.21.15.37:0/938360085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2e260 0x558afac39cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.871+0000 7f8d22897740 1 --2- 172.21.15.37:0/938360085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2d940 0x558afac2dd20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.871+0000 7f8d22897740 1 -- 172.21.15.37:0/938360085 >> 172.21.15.37:0/938360085 conn(0x558afac2b770 msgr2=0x558afac2c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:08.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.871+0000 7f8d16000640 1 --2- 172.21.15.37:0/4197924038 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8d000b3bd0 0x7f8d000b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.872+0000 7f8d22897740 1 -- 172.21.15.37:0/938360085 shutdown_connections 2024-08-20T05:05:08.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.872+0000 7f8d22897740 1 -- 172.21.15.37:0/938360085 wait complete. 2024-08-20T05:05:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.872+0000 7f8d16000640 1 -- 172.21.15.37:0/4197924038 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8d040e4310 con 0x7f8d1810a6b0 2024-08-20T05:05:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.872+0000 7f8d1de00640 1 --2- 172.21.15.37:0/4197924038 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8d000b3bd0 0x7f8d000b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.872+0000 7f8d22897740 1 -- start start 2024-08-20T05:05:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.873+0000 7f8d22897740 1 Processor -- start 2024-08-20T05:05:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.873+0000 7f8d1de00640 1 --2- 172.21.15.37:0/4197924038 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8d000b3bd0 0x7f8d000b6090 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8d10009270 tx=0x7f8d10004970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.873+0000 7f8d22897740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac2d940 0x558afac39930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.873+0000 7f8d22897740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2e260 0x558afac36d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.873+0000 7f8d22897740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac3a1f0 0x558afac372c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.873+0000 7f8d22897740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558afa9f5700 con 0x558afac3a1f0 2024-08-20T05:05:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.873+0000 7f8d22897740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558afab2e290 con 0x558afac2d940 2024-08-20T05:05:08.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.873+0000 7f8d22897740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558afac3ce70 con 0x558afac2e260 2024-08-20T05:05:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.873+0000 7f8d22897740 10 client.0 _ll_register_callbacks cb 0x558afab8d1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.873+0000 7f8d1de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac3a1f0 0x558afac372c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.873+0000 7f8d1ca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2e260 0x558afac36d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.874+0000 7f8d1d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac2d940 0x558afac39930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.874+0000 7f8d1de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac3a1f0 0x558afac372c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34896/0 (socket says 172.21.15.37:34896) 2024-08-20T05:05:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.874+0000 7f8d1de00640 1 -- 172.21.15.37:0/1825732889 learned_addr learned my addr 172.21.15.37:0/1825732889 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.874+0000 7f8d1de00640 1 -- 172.21.15.37:0/1825732889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2e260 msgr2=0x558afac36d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.874+0000 7f8d1de00640 1 --2- 172.21.15.37:0/1825732889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2e260 0x558afac36d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.874+0000 7f8d1de00640 1 -- 172.21.15.37:0/1825732889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac2d940 msgr2=0x558afac39930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.874+0000 7f8d1de00640 1 --2- 172.21.15.37:0/1825732889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac2d940 0x558afac39930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.874+0000 7f8d1de00640 1 -- 172.21.15.37:0/1825732889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558afa8f2650 con 0x558afac3a1f0 2024-08-20T05:05:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.874+0000 7f8d1de00640 1 --2- 172.21.15.37:0/1825732889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac3a1f0 0x558afac372c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8d10019000 tx=0x7f8d10011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3d937e964a238d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.874+0000 7f8cfea00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:05:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.875+0000 7f8cfea00640 1 -- 172.21.15.37:0/1825732889 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1002a050 con 0x558afac3a1f0 2024-08-20T05:05:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.875+0000 7f8d22897740 1 -- 172.21.15.37:0/1825732889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d10004030 con 0x558afac3a1f0 2024-08-20T05:05:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.875+0000 7f8cfea00640 1 -- 172.21.15.37:0/1825732889 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8d10005950 con 0x558afac3a1f0 2024-08-20T05:05:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.875+0000 7f8cfea00640 1 -- 172.21.15.37:0/1825732889 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8d1003d050 con 0x558afac3a1f0 2024-08-20T05:05:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.875+0000 7f8d22897740 10 client.16071 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.875+0000 7f8d22897740 1 -- 172.21.15.37:0/1825732889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558afac486a0 con 0x558afac3a1f0 2024-08-20T05:05:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.875+0000 7f8cfea00640 1 -- 172.21.15.37:0/1825732889 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d10004030 con 0x558afac3a1f0 2024-08-20T05:05:08.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.875+0000 7f8cfea00640 1 -- 172.21.15.37:0/1825732889 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f8d10018070 con 0x558afac3a1f0 2024-08-20T05:05:08.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.876+0000 7f8d22897740 10 client.16071 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:08.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.876+0000 7f8d22897740 10 client.16071 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:05:08.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.876+0000 7f8d22897740 20 client.16071 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:08.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.876+0000 7f8d22897740 1 --2- 172.21.15.37:0/1825732889 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x558afac49a50 0x558afac4be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.876+0000 7f8d22897740 4 client.16071 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:05:08.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.876+0000 7f8d22897740 1 -- 172.21.15.37:0/1825732889 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558afaba59f0 con 0x558afac49a50 2024-08-20T05:05:08.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.876+0000 7f8d1d400640 1 --2- 172.21.15.37:0/1825732889 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x558afac49a50 0x558afac4be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.877+0000 7f8d1d400640 1 --2- 172.21.15.37:0/1825732889 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x558afac49a50 0x558afac4be40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=35cbb03ec811e9c server_cookie=98bd95182a1b0acd in_seq=0 out_seq=0 2024-08-20T05:05:08.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.877+0000 7f8cfea00640 10 client.16071 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:05:08.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.877+0000 7f8cfea00640 1 -- 172.21.15.37:0/1825732889 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558afaba59f0 con 0x558afac49a50 2024-08-20T05:05:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.877+0000 7f8cfea00640 10 client.16071 handle_command_reply: tid=0 2024-08-20T05:05:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.878+0000 7f8d22897740 1 client.16071 shutdown 2024-08-20T05:05:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.878+0000 7f8d22897740 1 -- 172.21.15.37:0/1825732889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac3a1f0 msgr2=0x558afac372c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.878+0000 7f8d22897740 1 --2- 172.21.15.37:0/1825732889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac3a1f0 0x558afac372c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8d10019000 tx=0x7f8d10011810 comp rx=0 tx=0).stop 2024-08-20T05:05:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.878+0000 7f8d22897740 1 -- 172.21.15.37:0/1825732889 shutdown_connections 2024-08-20T05:05:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.878+0000 7f8d22897740 1 --2- 172.21.15.37:0/1825732889 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x558afac49a50 0x558afac4be40 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.878+0000 7f8d22897740 1 --2- 172.21.15.37:0/1825732889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac3a1f0 0x558afac372c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.878+0000 7f8d22897740 1 --2- 172.21.15.37:0/1825732889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2e260 0x558afac36d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.878+0000 7f8d22897740 1 --2- 172.21.15.37:0/1825732889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac2d940 0x558afac39930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.878+0000 7f8d22897740 1 -- 172.21.15.37:0/1825732889 >> 172.21.15.37:0/1825732889 conn(0x558afac2b770 msgr2=0x558afac31310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.878+0000 7f8cfea00640 0 client.16071 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:05:08.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.878+0000 7f8d22897740 1 -- 172.21.15.37:0/1825732889 shutdown_connections 2024-08-20T05:05:08.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.878+0000 7f8d22897740 1 -- 172.21.15.37:0/1825732889 wait complete. 2024-08-20T05:05:08.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.878+0000 7f8d22897740 20 client.16071 trim_cache size 0 max 16384 2024-08-20T05:05:08.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.892+0000 7f8d22897740 1 Processor -- start 2024-08-20T05:05:08.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.893+0000 7f8d22897740 1 -- start start 2024-08-20T05:05:08.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.893+0000 7f8d22897740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2d940 0x558afac516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.893+0000 7f8d22897740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2e260 0x558afac51c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.893+0000 7f8d22897740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac3a1f0 0x558afac42150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.893+0000 7f8d22897740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d181b1a00 con 0x558afac2e260 2024-08-20T05:05:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.893+0000 7f8d22897740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8d181b3600 con 0x558afac3a1f0 2024-08-20T05:05:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.893+0000 7f8d22897740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8d181b20d0 con 0x558afac2d940 2024-08-20T05:05:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.893+0000 7f8d1ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2e260 0x558afac51c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.893+0000 7f8d1d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2d940 0x558afac516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.893+0000 7f8d1ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2e260 0x558afac51c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34900/0 (socket says 172.21.15.37:34900) 2024-08-20T05:05:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.893+0000 7f8d1d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2d940 0x558afac516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35674/0 (socket says 172.21.15.37:35674) 2024-08-20T05:05:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.893+0000 7f8d1ca00640 1 -- 172.21.15.37:0/3037713060 learned_addr learned my addr 172.21.15.37:0/3037713060 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.893+0000 7f8d1de00640 1 --2- 172.21.15.37:0/3037713060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac3a1f0 0x558afac42150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.894+0000 7f8d1ca00640 1 -- 172.21.15.37:0/3037713060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2d940 msgr2=0x558afac516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:08.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.894+0000 7f8d1ca00640 1 --2- 172.21.15.37:0/3037713060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2d940 0x558afac516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.894+0000 7f8d1ca00640 1 -- 172.21.15.37:0/3037713060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac3a1f0 msgr2=0x558afac42150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:08.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.894+0000 7f8d1ca00640 1 --2- 172.21.15.37:0/3037713060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac3a1f0 0x558afac42150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.894+0000 7f8d1ca00640 1 -- 172.21.15.37:0/3037713060 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558afac39ca0 con 0x558afac2e260 2024-08-20T05:05:08.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.894+0000 7f8d1d400640 1 --2- 172.21.15.37:0/3037713060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2d940 0x558afac516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:08.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.894+0000 7f8d1ca00640 1 --2- 172.21.15.37:0/3037713060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2e260 0x558afac51c00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8d040aaf00 tx=0x7f8d040e79b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ac0ef22d63cb27 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:08.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.894+0000 7f8d09c00640 1 -- 172.21.15.37:0/3037713060 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d040e4170 con 0x558afac2e260 2024-08-20T05:05:08.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.894+0000 7f8d09c00640 1 -- 172.21.15.37:0/3037713060 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d040aaf70 con 0x558afac2e260 2024-08-20T05:05:08.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.894+0000 7f8d09c00640 1 -- 172.21.15.37:0/3037713060 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d040e7b20 con 0x558afac2e260 2024-08-20T05:05:08.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.895+0000 7f8d22897740 1 -- 172.21.15.37:0/3037713060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2e260 msgr2=0x558afac51c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:08.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.895+0000 7f8d22897740 1 --2- 172.21.15.37:0/3037713060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2e260 0x558afac51c00 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8d040aaf00 tx=0x7f8d040e79b0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.895+0000 7f8d22897740 1 -- 172.21.15.37:0/3037713060 shutdown_connections 2024-08-20T05:05:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.895+0000 7f8d22897740 1 --2- 172.21.15.37:0/3037713060 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac3a1f0 0x558afac42150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.895+0000 7f8d22897740 1 --2- 172.21.15.37:0/3037713060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2e260 0x558afac51c00 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.895+0000 7f8d22897740 1 --2- 172.21.15.37:0/3037713060 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2d940 0x558afac516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.895+0000 7f8d22897740 1 -- 172.21.15.37:0/3037713060 >> 172.21.15.37:0/3037713060 conn(0x558afac2b770 msgr2=0x558afac2a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.895+0000 7f8d22897740 1 -- 172.21.15.37:0/3037713060 shutdown_connections 2024-08-20T05:05:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.895+0000 7f8d22897740 1 -- 172.21.15.37:0/3037713060 wait complete. 2024-08-20T05:05:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.896+0000 7f8d22897740 1 -- start start 2024-08-20T05:05:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.896+0000 7f8d22897740 1 Processor -- start 2024-08-20T05:05:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.896+0000 7f8d22897740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2d940 0x558afac3f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.897+0000 7f8d22897740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2e260 0x558afac3faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.897+0000 7f8d22897740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac3a1f0 0x558afacb2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.897+0000 7f8d22897740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8d181b2e70 con 0x558afac2d940 2024-08-20T05:05:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.897+0000 7f8d22897740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8d181b27a0 con 0x558afac3a1f0 2024-08-20T05:05:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.897+0000 7f8d22897740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8d181af9e0 con 0x558afac2e260 2024-08-20T05:05:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.897+0000 7f8d22897740 10 client.0 _ll_register_callbacks cb 0x7f8d100093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.897+0000 7f8d1d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2d940 0x558afac3f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.897+0000 7f8d1d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2d940 0x558afac3f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34914/0 (socket says 172.21.15.37:34914) 2024-08-20T05:05:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.897+0000 7f8d1d400640 1 -- 172.21.15.37:0/639298128 learned_addr learned my addr 172.21.15.37:0/639298128 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.897+0000 7f8d1ca00640 1 --2- 172.21.15.37:0/639298128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2e260 0x558afac3faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.897+0000 7f8d1de00640 1 --2- 172.21.15.37:0/639298128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac3a1f0 0x558afacb2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.897+0000 7f8d1d400640 1 -- 172.21.15.37:0/639298128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2e260 msgr2=0x558afac3faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:08.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.897+0000 7f8d1d400640 1 --2- 172.21.15.37:0/639298128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2e260 0x558afac3faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.897+0000 7f8d1d400640 1 -- 172.21.15.37:0/639298128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac3a1f0 msgr2=0x558afacb2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:08.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.897+0000 7f8d1d400640 1 --2- 172.21.15.37:0/639298128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac3a1f0 0x558afacb2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.897+0000 7f8d1d400640 1 -- 172.21.15.37:0/639298128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558afacb2bd0 con 0x558afac2d940 2024-08-20T05:05:08.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.898+0000 7f8d1d400640 1 --2- 172.21.15.37:0/639298128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2d940 0x558afac3f560 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c006010 tx=0x7f8d0c0043e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5bb81e4dbae30bd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:08.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.898+0000 7f8cfea00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:05:08.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.898+0000 7f8cfea00640 1 -- 172.21.15.37:0/639298128 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c035040 con 0x558afac2d940 2024-08-20T05:05:08.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.898+0000 7f8cfea00640 1 -- 172.21.15.37:0/639298128 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8d0c005450 con 0x558afac2d940 2024-08-20T05:05:08.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.898+0000 7f8d22897740 1 -- 172.21.15.37:0/639298128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d040aaf70 con 0x558afac2d940 2024-08-20T05:05:08.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.898+0000 7f8cfea00640 1 -- 172.21.15.37:0/639298128 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8d0c059050 con 0x558afac2d940 2024-08-20T05:05:08.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.899+0000 7f8d22897740 10 client.16077 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:08.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.899+0000 7f8d22897740 1 -- 172.21.15.37:0/639298128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558afacb3ea0 con 0x558afac2d940 2024-08-20T05:05:08.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.899+0000 7f8cfea00640 1 -- 172.21.15.37:0/639298128 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d040aaf70 con 0x558afac2d940 2024-08-20T05:05:08.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.899+0000 7f8cfea00640 1 -- 172.21.15.37:0/639298128 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f8d0c051020 con 0x558afac2d940 2024-08-20T05:05:08.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.899+0000 7f8d22897740 10 client.16077 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:08.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.899+0000 7f8d22897740 10 client.16077 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:05:08.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.899+0000 7f8d22897740 20 client.16077 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:08.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.899+0000 7f8d22897740 1 --2- 172.21.15.37:0/639298128 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x558afacb46a0 0x558afacb6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:08.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.899+0000 7f8d22897740 4 client.16077 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:05:08.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.899+0000 7f8d22897740 1 -- 172.21.15.37:0/639298128 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558afaba1490 con 0x558afacb46a0 2024-08-20T05:05:08.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.899+0000 7f8d1ca00640 1 --2- 172.21.15.37:0/639298128 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x558afacb46a0 0x558afacb6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:08.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.900+0000 7f8d1ca00640 1 --2- 172.21.15.37:0/639298128 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x558afacb46a0 0x558afacb6ac0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=364d46e83da033b5 server_cookie=e153bacafacd98f2 in_seq=0 out_seq=0 2024-08-20T05:05:08.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.900+0000 7f8cfea00640 10 client.16077 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:05:08.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.900+0000 7f8cfea00640 1 -- 172.21.15.37:0/639298128 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558afaba1490 con 0x558afacb46a0 2024-08-20T05:05:08.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.900+0000 7f8cfea00640 10 client.16077 handle_command_reply: tid=0 2024-08-20T05:05:08.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.900+0000 7f8d22897740 1 client.16077 shutdown 2024-08-20T05:05:08.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.900+0000 7f8d22897740 1 -- 172.21.15.37:0/639298128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2d940 msgr2=0x558afac3f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:08.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.900+0000 7f8d22897740 1 --2- 172.21.15.37:0/639298128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2d940 0x558afac3f560 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c006010 tx=0x7f8d0c0043e0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.901+0000 7f8d22897740 1 -- 172.21.15.37:0/639298128 shutdown_connections 2024-08-20T05:05:08.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.901+0000 7f8d22897740 1 --2- 172.21.15.37:0/639298128 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x558afacb46a0 0x558afacb6ac0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.901+0000 7f8cfea00640 0 client.16077 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:05:08.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.901+0000 7f8d22897740 1 --2- 172.21.15.37:0/639298128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558afac3a1f0 0x558afacb2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.901+0000 7f8d22897740 1 --2- 172.21.15.37:0/639298128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558afac2e260 0x558afac3faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.901+0000 7f8d22897740 1 --2- 172.21.15.37:0/639298128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558afac2d940 0x558afac3f560 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.901+0000 7f8d22897740 1 -- 172.21.15.37:0/639298128 >> 172.21.15.37:0/639298128 conn(0x558afac2b770 msgr2=0x558afac383b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:08.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.901+0000 7f8d22897740 1 -- 172.21.15.37:0/639298128 shutdown_connections 2024-08-20T05:05:08.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.901+0000 7f8d22897740 1 -- 172.21.15.37:0/639298128 wait complete. 2024-08-20T05:05:08.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.901+0000 7f8d22897740 20 client.16077 trim_cache size 0 max 16384 2024-08-20T05:05:08.917 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:05:08.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.902+0000 7f8d1fe00640 1 -- 172.21.15.37:0/4197924038 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8d000b3bd0 msgr2=0x7f8d000b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:08.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.902+0000 7f8d1fe00640 1 --2- 172.21.15.37:0/4197924038 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8d000b3bd0 0x7f8d000b6090 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8d10009270 tx=0x7f8d10004970 comp rx=0 tx=0).stop 2024-08-20T05:05:08.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.902+0000 7f8d1fe00640 1 -- 172.21.15.37:0/4197924038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d1810a6b0 msgr2=0x7f8d1819b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:08.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.902+0000 7f8d1fe00640 1 --2- 172.21.15.37:0/4197924038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d1810a6b0 0x7f8d1819b6a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8d0400e9f0 tx=0x7f8d0400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.902+0000 7f8d1fe00640 1 -- 172.21.15.37:0/4197924038 shutdown_connections 2024-08-20T05:05:08.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.902+0000 7f8d1fe00640 1 --2- 172.21.15.37:0/4197924038 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8d000b3bd0 0x7f8d000b6090 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.902+0000 7f8d1fe00640 1 --2- 172.21.15.37:0/4197924038 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8d1810b030 0x7f8d181a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.902+0000 7f8d1fe00640 1 --2- 172.21.15.37:0/4197924038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d1810a6b0 0x7f8d1819b6a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.902+0000 7f8d1fe00640 1 --2- 172.21.15.37:0/4197924038 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8d18104ca0 0x7f8d1819b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:08.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.902+0000 7f8d1fe00640 1 -- 172.21.15.37:0/4197924038 >> 172.21.15.37:0/4197924038 conn(0x7f8d18100730 msgr2=0x7f8d18101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:08.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.903+0000 7f8d1fe00640 1 -- 172.21.15.37:0/4197924038 shutdown_connections 2024-08-20T05:05:08.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:08.903+0000 7f8d1fe00640 1 -- 172.21.15.37:0/4197924038 wait complete. 2024-08-20T05:05:09.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:09 smithi037 ceph-mon[17265]: pgmap v488: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 917 op/s 2024-08-20T05:05:09.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:09 smithi135 ceph-mon[22342]: pgmap v488: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 917 op/s 2024-08-20T05:05:09.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T05:05:09.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:09 smithi130 ceph-mon[22007]: pgmap v488: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 15 MiB/s wr, 917 op/s 2024-08-20T05:05:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:05:10.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.498+0000 7f6c7fe00640 1 -- 172.21.15.37:0/3437122032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c801013a0 msgr2=0x7f6c80101780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:10.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.498+0000 7f6c7fe00640 1 --2- 172.21.15.37:0/3437122032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c801013a0 0x7f6c80101780 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009900 tx=0x7f6c7002a480 comp rx=0 tx=0).stop 2024-08-20T05:05:10.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.498+0000 7f6c7fe00640 1 -- 172.21.15.37:0/3437122032 shutdown_connections 2024-08-20T05:05:10.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.498+0000 7f6c7fe00640 1 --2- 172.21.15.37:0/3437122032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c8010ef50 0x7f6c80111340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:10.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.498+0000 7f6c7fe00640 1 --2- 172.21.15.37:0/3437122032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c80101cc0 0x7f6c8010ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:10.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.498+0000 7f6c7fe00640 1 --2- 172.21.15.37:0/3437122032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c801013a0 0x7f6c80101780 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:10.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.498+0000 7f6c7fe00640 1 -- 172.21.15.37:0/3437122032 >> 172.21.15.37:0/3437122032 conn(0x7f6c800fd2d0 msgr2=0x7f6c800ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:10.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.499+0000 7f6c7fe00640 1 -- 172.21.15.37:0/3437122032 shutdown_connections 2024-08-20T05:05:10.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.499+0000 7f6c7fe00640 1 -- 172.21.15.37:0/3437122032 wait complete. 2024-08-20T05:05:10.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.500+0000 7f6c7fe00640 1 Processor -- start 2024-08-20T05:05:10.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.500+0000 7f6c7fe00640 1 -- start start 2024-08-20T05:05:10.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.500+0000 7f6c7fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c801013a0 0x7f6c8019aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:10.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.500+0000 7f6c7fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c80101cc0 0x7f6c8019b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:10.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.500+0000 7f6c7fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c8010ef50 0x7f6c801a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:10.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.501+0000 7f6c7fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6c80114b20 con 0x7f6c80101cc0 2024-08-20T05:05:10.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.501+0000 7f6c7fe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6c801149a0 con 0x7f6c801013a0 2024-08-20T05:05:10.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.501+0000 7f6c7fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6c80114ca0 con 0x7f6c8010ef50 2024-08-20T05:05:10.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.501+0000 7f6c7e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c80101cc0 0x7f6c8019b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:10.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.501+0000 7f6c7ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c801013a0 0x7f6c8019aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:10.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.501+0000 7f6c7f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c8010ef50 0x7f6c801a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:10.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.501+0000 7f6c7e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c80101cc0 0x7f6c8019b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34938/0 (socket says 172.21.15.37:34938) 2024-08-20T05:05:10.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.501+0000 7f6c7ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c801013a0 0x7f6c8019aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:41408/0 (socket says 172.21.15.37:41408) 2024-08-20T05:05:10.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.501+0000 7f6c7e000640 1 -- 172.21.15.37:0/790627739 learned_addr learned my addr 172.21.15.37:0/790627739 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:10.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.501+0000 7f6c7ea00640 1 -- 172.21.15.37:0/790627739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c8010ef50 msgr2=0x7f6c801a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:10.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.501+0000 7f6c7ea00640 1 --2- 172.21.15.37:0/790627739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c8010ef50 0x7f6c801a07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:10.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.501+0000 7f6c7ea00640 1 -- 172.21.15.37:0/790627739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c80101cc0 msgr2=0x7f6c8019b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:10.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.502+0000 7f6c7ea00640 1 --2- 172.21.15.37:0/790627739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c80101cc0 0x7f6c8019b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:10.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.502+0000 7f6c7ea00640 1 -- 172.21.15.37:0/790627739 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c801a0fa0 con 0x7f6c801013a0 2024-08-20T05:05:10.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.502+0000 7f6c7f400640 1 --2- 172.21.15.37:0/790627739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c8010ef50 0x7f6c801a07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:10.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.502+0000 7f6c7e000640 1 --2- 172.21.15.37:0/790627739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c80101cc0 0x7f6c8019b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:10.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.502+0000 7f6c7ea00640 1 --2- 172.21.15.37:0/790627739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c801013a0 0x7f6c8019aef0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6c7002aa70 tx=0x7f6c70003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:10.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.502+0000 7f6c77400640 1 -- 172.21.15.37:0/790627739 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c7003f070 con 0x7f6c801013a0 2024-08-20T05:05:10.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.502+0000 7f6c77400640 1 -- 172.21.15.37:0/790627739 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c70031b50 con 0x7f6c801013a0 2024-08-20T05:05:10.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.502+0000 7f6c7fe00640 1 -- 172.21.15.37:0/790627739 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c801a1230 con 0x7f6c801013a0 2024-08-20T05:05:10.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.503+0000 7f6c77400640 1 -- 172.21.15.37:0/790627739 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c70035030 con 0x7f6c801013a0 2024-08-20T05:05:10.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.503+0000 7f6c7fe00640 1 -- 172.21.15.37:0/790627739 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c801a7950 con 0x7f6c801013a0 2024-08-20T05:05:10.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.504+0000 7f6c7fe00640 1 -- 172.21.15.37:0/790627739 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c80101780 con 0x7f6c801013a0 2024-08-20T05:05:10.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.506+0000 7f6c77400640 1 -- 172.21.15.37:0/790627739 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6c70042070 con 0x7f6c801013a0 2024-08-20T05:05:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.508+0000 7f6c77400640 1 --2- 172.21.15.37:0/790627739 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6c640b3cf0 0x7f6c640b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.509+0000 7f6c77400640 1 -- 172.21.15.37:0/790627739 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6c70104430 con 0x7f6c801013a0 2024-08-20T05:05:10.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.509+0000 7f6c7e000640 1 --2- 172.21.15.37:0/790627739 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6c640b3cf0 0x7f6c640b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:10.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.509+0000 7f6c7e000640 1 --2- 172.21.15.37:0/790627739 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6c640b3cf0 0x7f6c640b61b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6c8010f590 tx=0x7f6c6c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:10.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.511+0000 7f6c77400640 1 -- 172.21.15.37:0/790627739 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f6c70031d00 con 0x7f6c801013a0 2024-08-20T05:05:10.560 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:05:10.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.762+0000 7f6c7fe00640 1 -- 172.21.15.37:0/790627739 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c801a7b80 con 0x7f6c801013a0 2024-08-20T05:05:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.763+0000 7f6c77400640 1 -- 172.21.15.37:0/790627739 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11987 (secure 0 0 0) 0x7f6c700cb090 con 0x7f6c801013a0 2024-08-20T05:05:10.765 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:05:10.765 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":33,"btime":"2024-08-20T05:03:11:706710+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:03:11.271814+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:05:10.765 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 33 2024-08-20T05:05:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.765+0000 7f6c7fe00640 1 -- 172.21.15.37:0/790627739 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6c640b3cf0 msgr2=0x7f6c640b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.765+0000 7f6c7fe00640 1 --2- 172.21.15.37:0/790627739 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6c640b3cf0 0x7f6c640b61b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6c8010f590 tx=0x7f6c6c005f90 comp rx=0 tx=0).stop 2024-08-20T05:05:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.765+0000 7f6c7fe00640 1 -- 172.21.15.37:0/790627739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c801013a0 msgr2=0x7f6c8019aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.765+0000 7f6c7fe00640 1 --2- 172.21.15.37:0/790627739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c801013a0 0x7f6c8019aef0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6c7002aa70 tx=0x7f6c70003b90 comp rx=0 tx=0).stop 2024-08-20T05:05:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.766+0000 7f6c7fe00640 1 -- 172.21.15.37:0/790627739 shutdown_connections 2024-08-20T05:05:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.766+0000 7f6c7fe00640 1 --2- 172.21.15.37:0/790627739 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6c640b3cf0 0x7f6c640b61b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.766+0000 7f6c7fe00640 1 --2- 172.21.15.37:0/790627739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6c8010ef50 0x7f6c801a07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.766+0000 7f6c7fe00640 1 --2- 172.21.15.37:0/790627739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c80101cc0 0x7f6c8019b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.766+0000 7f6c7fe00640 1 --2- 172.21.15.37:0/790627739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6c801013a0 0x7f6c8019aef0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.766+0000 7f6c7fe00640 1 -- 172.21.15.37:0/790627739 >> 172.21.15.37:0/790627739 conn(0x7f6c800fd2d0 msgr2=0x7f6c801110a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.766+0000 7f6c7fe00640 1 -- 172.21.15.37:0/790627739 shutdown_connections 2024-08-20T05:05:10.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:10.766+0000 7f6c7fe00640 1 -- 172.21.15.37:0/790627739 wait complete. 2024-08-20T05:05:11.718 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:11 smithi037 ceph-mon[17265]: pgmap v489: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 760 op/s 2024-08-20T05:05:11.719 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:11 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/790627739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:05:11.757 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id 6a321e2e --release --await' 2024-08-20T05:05:11.757 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id 6a321e2e --release --await 2024-08-20T05:05:11.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:11 smithi135 ceph-mon[22342]: pgmap v489: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 760 op/s 2024-08-20T05:05:11.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:11 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/790627739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:05:11.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:11 smithi130 ceph-mon[22007]: pgmap v489: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 760 op/s 2024-08-20T05:05:11.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:11 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/790627739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:05:11.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.988+0000 7fb5aca00640 1 -- 172.21.15.37:0/680579708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5a8077400 msgr2=0x7fb5a80777e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:11.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.988+0000 7fb5aca00640 1 --2- 172.21.15.37:0/680579708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5a8077400 0x7fb5a80777e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb598009900 tx=0x7fb59802a410 comp rx=0 tx=0).stop 2024-08-20T05:05:11.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.988+0000 7fb5aca00640 1 -- 172.21.15.37:0/680579708 shutdown_connections 2024-08-20T05:05:11.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.988+0000 7fb5aca00640 1 --2- 172.21.15.37:0/680579708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a8113680 0x7fb5a8115a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:11.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.988+0000 7fb5aca00640 1 --2- 172.21.15.37:0/680579708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a8077d20 0x7fb5a8113140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:11.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.988+0000 7fb5aca00640 1 --2- 172.21.15.37:0/680579708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5a8077400 0x7fb5a80777e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:11.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.988+0000 7fb5aca00640 1 -- 172.21.15.37:0/680579708 >> 172.21.15.37:0/680579708 conn(0x7fb5a81006c0 msgr2=0x7fb5a8102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:11.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.988+0000 7fb5aca00640 1 -- 172.21.15.37:0/680579708 shutdown_connections 2024-08-20T05:05:11.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.988+0000 7fb5aca00640 1 -- 172.21.15.37:0/680579708 wait complete. 2024-08-20T05:05:11.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.989+0000 7fb5aca00640 1 Processor -- start 2024-08-20T05:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.989+0000 7fb5aca00640 1 -- start start 2024-08-20T05:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.990+0000 7fb5aca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a8077400 0x7fb5a819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.990+0000 7fb5aca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5a8077d20 0x7fb5a819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.990+0000 7fb5aca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a8113680 0x7fb5a81a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.990+0000 7fb5aca00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a81190c0 con 0x7fb5a8077d20 2024-08-20T05:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.990+0000 7fb5aca00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a8118f40 con 0x7fb5a8077400 2024-08-20T05:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.990+0000 7fb5aca00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a8119240 con 0x7fb5a8113680 2024-08-20T05:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.990+0000 7fb5a5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5a8077d20 0x7fb5a819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.990+0000 7fb5a5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5a8077d20 0x7fb5a819fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34960/0 (socket says 172.21.15.37:34960) 2024-08-20T05:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.990+0000 7fb5a5400640 1 -- 172.21.15.37:0/4218231538 learned_addr learned my addr 172.21.15.37:0/4218231538 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.990+0000 7fb5a6800640 1 --2- 172.21.15.37:0/4218231538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a8113680 0x7fb5a81a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:11.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.990+0000 7fb5a5e00640 1 --2- 172.21.15.37:0/4218231538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a8077400 0x7fb5a819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:11.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.991+0000 7fb5a5400640 1 -- 172.21.15.37:0/4218231538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a8113680 msgr2=0x7fb5a81a4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:11.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.991+0000 7fb5a5400640 1 --2- 172.21.15.37:0/4218231538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a8113680 0x7fb5a81a4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:11.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.991+0000 7fb5a5400640 1 -- 172.21.15.37:0/4218231538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a8077400 msgr2=0x7fb5a819f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:11.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.991+0000 7fb5a5400640 1 --2- 172.21.15.37:0/4218231538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a8077400 0x7fb5a819f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:11.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.991+0000 7fb5a5400640 1 -- 172.21.15.37:0/4218231538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a81a55e0 con 0x7fb5a8077d20 2024-08-20T05:05:11.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.991+0000 7fb5a5400640 1 --2- 172.21.15.37:0/4218231538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5a8077d20 0x7fb5a819fa70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb59400e9f0 tx=0x7fb59400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:11.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.991+0000 7fb59ea00640 1 -- 172.21.15.37:0/4218231538 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59400cd80 con 0x7fb5a8077d20 2024-08-20T05:05:11.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.991+0000 7fb5aca00640 1 -- 172.21.15.37:0/4218231538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a81a58d0 con 0x7fb5a8077d20 2024-08-20T05:05:11.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.991+0000 7fb59ea00640 1 -- 172.21.15.37:0/4218231538 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5940108e0 con 0x7fb5a8077d20 2024-08-20T05:05:11.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.991+0000 7fb59ea00640 1 -- 172.21.15.37:0/4218231538 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594018980 con 0x7fb5a8077d20 2024-08-20T05:05:11.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.991+0000 7fb5aca00640 1 -- 172.21.15.37:0/4218231538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a81abf90 con 0x7fb5a8077d20 2024-08-20T05:05:11.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.995+0000 7fb5af673740 1 Processor -- start 2024-08-20T05:05:11.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.996+0000 7fb5af673740 1 -- start start 2024-08-20T05:05:11.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.996+0000 7fb5af673740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4e990 0x560637c4ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:11.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.996+0000 7fb5af673740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c4f2b0 0x560637c5ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:11.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.996+0000 7fb5af673740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c5b240 0x560637c5d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:11.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.996+0000 7fb5af673740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560637bc4aa0 con 0x560637c5b240 2024-08-20T05:05:11.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.996+0000 7fb5af673740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560637bb3fa0 con 0x560637c4f2b0 2024-08-20T05:05:11.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.996+0000 7fb5af673740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560637bb7fe0 con 0x560637c4e990 2024-08-20T05:05:12.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.996+0000 7fb5a6800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4e990 0x560637c4ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.996+0000 7fb59ea00640 1 -- 172.21.15.37:0/4218231538 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb594010430 con 0x7fb5a8077d20 2024-08-20T05:05:12.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.996+0000 7fb5a6800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4e990 0x560637c4ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35724/0 (socket says 172.21.15.37:35724) 2024-08-20T05:05:12.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.997+0000 7fb5a6800640 1 -- 172.21.15.37:0/3059888580 learned_addr learned my addr 172.21.15.37:0/3059888580 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:12.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.997+0000 7fb5a5e00640 1 --2- 172.21.15.37:0/3059888580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c4f2b0 0x560637c5ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.997+0000 7fb5a6800640 1 -- 172.21.15.37:0/3059888580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c4f2b0 msgr2=0x560637c5ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:12.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.997+0000 7fb5a6800640 1 --2- 172.21.15.37:0/3059888580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c4f2b0 0x560637c5ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.997+0000 7fb5a6800640 1 -- 172.21.15.37:0/3059888580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c5b240 msgr2=0x560637c5d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:12.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.997+0000 7fb5a5400640 1 --2- 172.21.15.37:0/3059888580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c5b240 0x560637c5d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.997+0000 7fb5a6800640 1 --2- 172.21.15.37:0/3059888580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c5b240 0x560637c5d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.997+0000 7fb5a6800640 1 -- 172.21.15.37:0/3059888580 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560637b5a420 con 0x560637c4e990 2024-08-20T05:05:12.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.997+0000 7fb5a5e00640 1 --2- 172.21.15.37:0/3059888580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c4f2b0 0x560637c5ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:05:12.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.997+0000 7fb5a5400640 1 --2- 172.21.15.37:0/3059888580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c5b240 0x560637c5d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:05:12.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.998+0000 7fb5a6800640 1 --2- 172.21.15.37:0/3059888580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4e990 0x560637c4ed70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0009f90 tx=0x7fb5a00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5dbe734f8e3aba4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:12.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.998+0000 7fb593000640 1 -- 172.21.15.37:0/3059888580 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0004d20 con 0x560637c4e990 2024-08-20T05:05:12.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.998+0000 7fb593000640 1 -- 172.21.15.37:0/3059888580 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5a0004050 con 0x560637c4e990 2024-08-20T05:05:12.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.998+0000 7fb593000640 1 -- 172.21.15.37:0/3059888580 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0005240 con 0x560637c4e990 2024-08-20T05:05:12.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.998+0000 7fb59ea00640 1 --2- 172.21.15.37:0/4218231538 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb58c0b3c50 0x7fb58c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.999+0000 7fb59ea00640 1 -- 172.21.15.37:0/4218231538 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb5940e43f0 con 0x7fb5a8077d20 2024-08-20T05:05:12.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.999+0000 7fb5af673740 1 -- 172.21.15.37:0/3059888580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4e990 msgr2=0x560637c4ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:12.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.999+0000 7fb5af673740 1 --2- 172.21.15.37:0/3059888580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4e990 0x560637c4ed70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb5a0009f90 tx=0x7fb5a00118d0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.999+0000 7fb5a5e00640 1 --2- 172.21.15.37:0/4218231538 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb58c0b3c50 0x7fb58c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.999+0000 7fb5af673740 1 -- 172.21.15.37:0/3059888580 shutdown_connections 2024-08-20T05:05:12.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.999+0000 7fb5af673740 1 --2- 172.21.15.37:0/3059888580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c5b240 0x560637c5d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.999+0000 7fb5af673740 1 --2- 172.21.15.37:0/3059888580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c4f2b0 0x560637c5ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.999+0000 7fb5af673740 1 --2- 172.21.15.37:0/3059888580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4e990 0x560637c4ed70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.999+0000 7fb5af673740 1 -- 172.21.15.37:0/3059888580 >> 172.21.15.37:0/3059888580 conn(0x560637c4c7c0 msgr2=0x560637c4d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:12.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.999+0000 7fb5af673740 1 -- 172.21.15.37:0/3059888580 shutdown_connections 2024-08-20T05:05:12.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:11.999+0000 7fb5af673740 1 -- 172.21.15.37:0/3059888580 wait complete. 2024-08-20T05:05:12.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.000+0000 7fb5af673740 1 -- start start 2024-08-20T05:05:12.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.000+0000 7fb5a5e00640 1 --2- 172.21.15.37:0/4218231538 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb58c0b3c50 0x7fb58c0b6110 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb598005ab0 tx=0x7fb598005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:12.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.000+0000 7fb5af673740 1 Processor -- start 2024-08-20T05:05:12.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.000+0000 7fb5af673740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4e990 0x560637c5aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.000+0000 7fb5af673740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c4f2b0 0x560637c57ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.001+0000 7fb5af673740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c5b240 0x560637c583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.001+0000 7fb5af673740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560637a16700 con 0x560637c4e990 2024-08-20T05:05:12.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.001+0000 7fb5af673740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560637b4f290 con 0x560637c4f2b0 2024-08-20T05:05:12.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.001+0000 7fb5af673740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560637c5dec0 con 0x560637c5b240 2024-08-20T05:05:12.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.001+0000 7fb5af673740 10 client.0 _ll_register_callbacks cb 0x560637bae1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:12.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.001+0000 7fb5a6800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c5b240 0x560637c583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.001+0000 7fb5a5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4e990 0x560637c5aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.001+0000 7fb5a6800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c5b240 0x560637c583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35740/0 (socket says 172.21.15.37:35740) 2024-08-20T05:05:12.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.001+0000 7fb5a6800640 1 -- 172.21.15.37:0/81009252 learned_addr learned my addr 172.21.15.37:0/81009252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:12.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.001+0000 7fb5a5400640 1 --2- 172.21.15.37:0/81009252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c4f2b0 0x560637c57ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.001+0000 7fb5a6800640 1 -- 172.21.15.37:0/81009252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c4f2b0 msgr2=0x560637c57ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:12.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.001+0000 7fb5a6800640 1 --2- 172.21.15.37:0/81009252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c4f2b0 0x560637c57ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.001+0000 7fb5a6800640 1 -- 172.21.15.37:0/81009252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4e990 msgr2=0x560637c5aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:12.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.001+0000 7fb5a6800640 1 --2- 172.21.15.37:0/81009252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4e990 0x560637c5aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.001+0000 7fb5a6800640 1 -- 172.21.15.37:0/81009252 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560637913650 con 0x560637c5b240 2024-08-20T05:05:12.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.002+0000 7fb5a6800640 1 --2- 172.21.15.37:0/81009252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c5b240 0x560637c583e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb5a001b040 tx=0x7fb5a0003ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e25a2ae21205c5a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:12.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.002+0000 7fb587400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:05:12.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.002+0000 7fb587400640 1 -- 172.21.15.37:0/81009252 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a0028070 con 0x560637c5b240 2024-08-20T05:05:12.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.002+0000 7fb5af673740 1 -- 172.21.15.37:0/81009252 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5a0004050 con 0x560637c5b240 2024-08-20T05:05:12.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.002+0000 7fb587400640 1 -- 172.21.15.37:0/81009252 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb5a0005040 con 0x560637c5b240 2024-08-20T05:05:12.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.003+0000 7fb587400640 1 -- 172.21.15.37:0/81009252 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb5a0033050 con 0x560637c5b240 2024-08-20T05:05:12.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.003+0000 7fb5af673740 10 client.26281 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:12.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.003+0000 7fb5af673740 1 -- 172.21.15.37:0/81009252 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560637c69680 con 0x560637c5b240 2024-08-20T05:05:12.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.003+0000 7fb587400640 1 -- 172.21.15.37:0/81009252 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5a0004050 con 0x560637c5b240 2024-08-20T05:05:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.003+0000 7fb587400640 1 -- 172.21.15.37:0/81009252 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fb5a000f570 con 0x560637c5b240 2024-08-20T05:05:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.003+0000 7fb5af673740 10 client.26281 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.003+0000 7fb5af673740 10 client.26281 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:05:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.003+0000 7fb5af673740 20 client.26281 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.003+0000 7fb5af673740 1 --2- 172.21.15.37:0/81009252 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x560637c6aa90 0x560637c6ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.003+0000 7fb5af673740 4 client.26281 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:05:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.003+0000 7fb5af673740 1 -- 172.21.15.37:0/81009252 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560637bc69f0 con 0x560637c6aa90 2024-08-20T05:05:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.004+0000 7fb5a5e00640 1 --2- 172.21.15.37:0/81009252 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x560637c6aa90 0x560637c6ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.004+0000 7fb5a5e00640 1 --2- 172.21.15.37:0/81009252 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x560637c6aa90 0x560637c6ce80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=af32358a55ec1a6f server_cookie=8cd56ca3ec4baf69 in_seq=0 out_seq=0 2024-08-20T05:05:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.004+0000 7fb587400640 10 client.26281 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:05:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.005+0000 7fb587400640 1 -- 172.21.15.37:0/81009252 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560637bc69f0 con 0x560637c6aa90 2024-08-20T05:05:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.005+0000 7fb587400640 10 client.26281 handle_command_reply: tid=0 2024-08-20T05:05:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.005+0000 7fb5af673740 1 client.26281 shutdown 2024-08-20T05:05:12.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.005+0000 7fb5af673740 1 -- 172.21.15.37:0/81009252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c5b240 msgr2=0x560637c583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:12.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.005+0000 7fb5af673740 1 --2- 172.21.15.37:0/81009252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c5b240 0x560637c583e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb5a001b040 tx=0x7fb5a0003ce0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.006+0000 7fb5af673740 1 -- 172.21.15.37:0/81009252 shutdown_connections 2024-08-20T05:05:12.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.006+0000 7fb5af673740 1 --2- 172.21.15.37:0/81009252 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x560637c6aa90 0x560637c6ce80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.006+0000 7fb5af673740 1 --2- 172.21.15.37:0/81009252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c5b240 0x560637c583e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.006+0000 7fb5af673740 1 --2- 172.21.15.37:0/81009252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c4f2b0 0x560637c57ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.006+0000 7fb5af673740 1 --2- 172.21.15.37:0/81009252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4e990 0x560637c5aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.006+0000 7fb5af673740 1 -- 172.21.15.37:0/81009252 >> 172.21.15.37:0/81009252 conn(0x560637c4c7c0 msgr2=0x560637c52360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:12.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.006+0000 7fb587400640 0 client.26281 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:05:12.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.006+0000 7fb5af673740 1 -- 172.21.15.37:0/81009252 shutdown_connections 2024-08-20T05:05:12.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.006+0000 7fb5af673740 1 -- 172.21.15.37:0/81009252 wait complete. 2024-08-20T05:05:12.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.006+0000 7fb5af673740 20 client.26281 trim_cache size 0 max 16384 2024-08-20T05:05:12.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.020+0000 7fb5af673740 1 Processor -- start 2024-08-20T05:05:12.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.020+0000 7fb5af673740 1 -- start start 2024-08-20T05:05:12.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.020+0000 7fb5af673740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4e990 0x560637c66fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.020+0000 7fb5af673740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4f2b0 0x560637c594d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.020+0000 7fb5af673740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c5b240 0x560637c725f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.020+0000 7fb5af673740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a81b5e50 con 0x560637c4e990 2024-08-20T05:05:12.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.020+0000 7fb5af673740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a81b7a50 con 0x560637c5b240 2024-08-20T05:05:12.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.020+0000 7fb5af673740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a81b6520 con 0x560637c4f2b0 2024-08-20T05:05:12.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.020+0000 7fb5a5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4e990 0x560637c66fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.020+0000 7fb5a5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4e990 0x560637c66fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34982/0 (socket says 172.21.15.37:34982) 2024-08-20T05:05:12.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.020+0000 7fb5a5e00640 1 -- 172.21.15.37:0/959985316 learned_addr learned my addr 172.21.15.37:0/959985316 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:12.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.021+0000 7fb5a5400640 1 --2- 172.21.15.37:0/959985316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4f2b0 0x560637c594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.021+0000 7fb5a6800640 1 --2- 172.21.15.37:0/959985316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c5b240 0x560637c725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.021+0000 7fb5a5e00640 1 -- 172.21.15.37:0/959985316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4f2b0 msgr2=0x560637c594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:12.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.021+0000 7fb5a5e00640 1 --2- 172.21.15.37:0/959985316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4f2b0 0x560637c594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.021+0000 7fb5a5e00640 1 -- 172.21.15.37:0/959985316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c5b240 msgr2=0x560637c725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:12.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.021+0000 7fb5a5e00640 1 --2- 172.21.15.37:0/959985316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c5b240 0x560637c725f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.021+0000 7fb5a5e00640 1 -- 172.21.15.37:0/959985316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560637c4c5f0 con 0x560637c4e990 2024-08-20T05:05:12.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.021+0000 7fb5a5400640 1 --2- 172.21.15.37:0/959985316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4f2b0 0x560637c594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:12.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.021+0000 7fb5a6800640 1 --2- 172.21.15.37:0/959985316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c5b240 0x560637c725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:05:12.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.021+0000 7fb5a5e00640 1 --2- 172.21.15.37:0/959985316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4e990 0x560637c66fe0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb598053fd0 tx=0x7fb59803e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e888dd6340f2b12 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:12.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.022+0000 7fb592600640 1 -- 172.21.15.37:0/959985316 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598035040 con 0x560637c4e990 2024-08-20T05:05:12.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.022+0000 7fb592600640 1 -- 172.21.15.37:0/959985316 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5980054d0 con 0x560637c4e990 2024-08-20T05:05:12.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.022+0000 7fb592600640 1 -- 172.21.15.37:0/959985316 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5980039f0 con 0x560637c4e990 2024-08-20T05:05:12.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.022+0000 7fb5af673740 1 -- 172.21.15.37:0/959985316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4e990 msgr2=0x560637c66fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:12.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.022+0000 7fb5af673740 1 --2- 172.21.15.37:0/959985316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4e990 0x560637c66fe0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb598053fd0 tx=0x7fb59803e000 comp rx=0 tx=0).stop 2024-08-20T05:05:12.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.022+0000 7fb5af673740 1 -- 172.21.15.37:0/959985316 shutdown_connections 2024-08-20T05:05:12.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.022+0000 7fb5af673740 1 --2- 172.21.15.37:0/959985316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c5b240 0x560637c725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.022+0000 7fb5af673740 1 --2- 172.21.15.37:0/959985316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4f2b0 0x560637c594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.022+0000 7fb5af673740 1 --2- 172.21.15.37:0/959985316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4e990 0x560637c66fe0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.022+0000 7fb5af673740 1 -- 172.21.15.37:0/959985316 >> 172.21.15.37:0/959985316 conn(0x560637c4c7c0 msgr2=0x560637c4b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:12.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.023+0000 7fb5af673740 1 -- 172.21.15.37:0/959985316 shutdown_connections 2024-08-20T05:05:12.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.023+0000 7fb5af673740 1 -- 172.21.15.37:0/959985316 wait complete. 2024-08-20T05:05:12.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.023+0000 7fb5af673740 1 -- start start 2024-08-20T05:05:12.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.023+0000 7fb5af673740 1 Processor -- start 2024-08-20T05:05:12.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.024+0000 7fb5af673740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4e990 0x560637c635b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.024+0000 7fb5af673740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4f2b0 0x560637c60aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.024+0000 7fb5af673740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c5b240 0x560637c60fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.024+0000 7fb5af673740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a81b72c0 con 0x560637c4f2b0 2024-08-20T05:05:12.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.024+0000 7fb5af673740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a81b6bf0 con 0x560637c5b240 2024-08-20T05:05:12.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.024+0000 7fb5af673740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a81b3e30 con 0x560637c4e990 2024-08-20T05:05:12.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.024+0000 7fb5af673740 10 client.0 _ll_register_callbacks cb 0x7fb5a0009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:12.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.024+0000 7fb5a5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4f2b0 0x560637c60aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.024+0000 7fb5a5e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4e990 0x560637c635b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.024+0000 7fb5a6800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c5b240 0x560637c60fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.024+0000 7fb5a5e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4e990 0x560637c635b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35746/0 (socket says 172.21.15.37:35746) 2024-08-20T05:05:12.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.024+0000 7fb5a5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4f2b0 0x560637c60aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34988/0 (socket says 172.21.15.37:34988) 2024-08-20T05:05:12.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.024+0000 7fb5a5e00640 1 -- 172.21.15.37:0/3146168462 learned_addr learned my addr 172.21.15.37:0/3146168462 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:12.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.025+0000 7fb5a6800640 1 -- 172.21.15.37:0/3146168462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4e990 msgr2=0x560637c635b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:12.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.025+0000 7fb5a6800640 1 --2- 172.21.15.37:0/3146168462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4e990 0x560637c635b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.025+0000 7fb5a6800640 1 -- 172.21.15.37:0/3146168462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4f2b0 msgr2=0x560637c60aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:12.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.025+0000 7fb5a6800640 1 --2- 172.21.15.37:0/3146168462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4f2b0 0x560637c60aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.025+0000 7fb5a6800640 1 -- 172.21.15.37:0/3146168462 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560637c4d240 con 0x560637c5b240 2024-08-20T05:05:12.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.025+0000 7fb5a6800640 1 --2- 172.21.15.37:0/3146168462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c5b240 0x560637c60fe0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000fae0 tx=0x7fb5a0011f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40b7d0ffc5167156 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:12.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.025+0000 7fb587400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:05:12.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.025+0000 7fb587400640 1 -- 172.21.15.37:0/3146168462 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a003c060 con 0x560637c5b240 2024-08-20T05:05:12.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.025+0000 7fb5af673740 1 -- 172.21.15.37:0/3146168462 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5980054d0 con 0x560637c5b240 2024-08-20T05:05:12.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.025+0000 7fb587400640 1 -- 172.21.15.37:0/3146168462 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb5a0009b30 con 0x560637c5b240 2024-08-20T05:05:12.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.026+0000 7fb587400640 1 -- 172.21.15.37:0/3146168462 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb5a0043050 con 0x560637c5b240 2024-08-20T05:05:12.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.026+0000 7fb5af673740 10 client.26243 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:12.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.026+0000 7fb5af673740 1 -- 172.21.15.37:0/3146168462 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560637cd5230 con 0x560637c5b240 2024-08-20T05:05:12.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.026+0000 7fb587400640 1 -- 172.21.15.37:0/3146168462 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5980054d0 con 0x560637c5b240 2024-08-20T05:05:12.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.026+0000 7fb587400640 1 -- 172.21.15.37:0/3146168462 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fb5a0024650 con 0x560637c5b240 2024-08-20T05:05:12.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.026+0000 7fb5af673740 10 client.26243 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:12.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.026+0000 7fb5af673740 10 client.26243 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:05:12.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.026+0000 7fb5af673740 20 client.26243 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:12.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.026+0000 7fb5af673740 1 --2- 172.21.15.37:0/3146168462 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x560637cd5950 0x560637cd7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.026+0000 7fb5af673740 4 client.26243 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:05:12.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.026+0000 7fb5af673740 1 -- 172.21.15.37:0/3146168462 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560637bc2490 con 0x560637cd5950 2024-08-20T05:05:12.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.027+0000 7fb5a5e00640 1 --2- 172.21.15.37:0/3146168462 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x560637cd5950 0x560637cd7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.027+0000 7fb5a5e00640 1 --2- 172.21.15.37:0/3146168462 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x560637cd5950 0x560637cd7d40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b650c04685be7014 server_cookie=6c104cc59400f8ae in_seq=0 out_seq=0 2024-08-20T05:05:12.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.027+0000 7fb587400640 10 client.26243 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:05:12.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.028+0000 7fb587400640 1 -- 172.21.15.37:0/3146168462 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560637bc2490 con 0x560637cd5950 2024-08-20T05:05:12.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.028+0000 7fb587400640 10 client.26243 handle_command_reply: tid=0 2024-08-20T05:05:12.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.028+0000 7fb5af673740 1 client.26243 shutdown 2024-08-20T05:05:12.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.028+0000 7fb5af673740 1 -- 172.21.15.37:0/3146168462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c5b240 msgr2=0x560637c60fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:12.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.028+0000 7fb5af673740 1 --2- 172.21.15.37:0/3146168462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c5b240 0x560637c60fe0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb5a000fae0 tx=0x7fb5a0011f10 comp rx=0 tx=0).stop 2024-08-20T05:05:12.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.028+0000 7fb5af673740 1 -- 172.21.15.37:0/3146168462 shutdown_connections 2024-08-20T05:05:12.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.028+0000 7fb5af673740 1 --2- 172.21.15.37:0/3146168462 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x560637cd5950 0x560637cd7d40 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.028+0000 7fb5af673740 1 --2- 172.21.15.37:0/3146168462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560637c5b240 0x560637c60fe0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.028+0000 7fb5af673740 1 --2- 172.21.15.37:0/3146168462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560637c4f2b0 0x560637c60aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.028+0000 7fb5af673740 1 --2- 172.21.15.37:0/3146168462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560637c4e990 0x560637c635b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.028+0000 7fb587400640 0 client.26243 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:05:12.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.028+0000 7fb5af673740 1 -- 172.21.15.37:0/3146168462 >> 172.21.15.37:0/3146168462 conn(0x560637c4c7c0 msgr2=0x560637c65fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:12.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.028+0000 7fb5af673740 1 -- 172.21.15.37:0/3146168462 shutdown_connections 2024-08-20T05:05:12.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.028+0000 7fb5af673740 1 -- 172.21.15.37:0/3146168462 wait complete. 2024-08-20T05:05:12.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.028+0000 7fb5af673740 20 client.26243 trim_cache size 0 max 16384 2024-08-20T05:05:12.033 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:05:12.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.029+0000 7fb5aca00640 1 -- 172.21.15.37:0/4218231538 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb58c0b3c50 msgr2=0x7fb58c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:12.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.029+0000 7fb5aca00640 1 --2- 172.21.15.37:0/4218231538 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb58c0b3c50 0x7fb58c0b6110 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb598005ab0 tx=0x7fb598005a20 comp rx=0 tx=0).stop 2024-08-20T05:05:12.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.029+0000 7fb5aca00640 1 -- 172.21.15.37:0/4218231538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5a8077d20 msgr2=0x7fb5a819fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:12.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.029+0000 7fb5aca00640 1 --2- 172.21.15.37:0/4218231538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5a8077d20 0x7fb5a819fa70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb59400e9f0 tx=0x7fb59400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.029+0000 7fb5aca00640 1 -- 172.21.15.37:0/4218231538 shutdown_connections 2024-08-20T05:05:12.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.029+0000 7fb5aca00640 1 --2- 172.21.15.37:0/4218231538 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb58c0b3c50 0x7fb58c0b6110 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.029+0000 7fb5aca00640 1 --2- 172.21.15.37:0/4218231538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5a8113680 0x7fb5a81a4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.029+0000 7fb5aca00640 1 --2- 172.21.15.37:0/4218231538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5a8077d20 0x7fb5a819fa70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.029+0000 7fb5aca00640 1 --2- 172.21.15.37:0/4218231538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5a8077400 0x7fb5a819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.029+0000 7fb5aca00640 1 -- 172.21.15.37:0/4218231538 >> 172.21.15.37:0/4218231538 conn(0x7fb5a81006c0 msgr2=0x7fb5a8102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:12.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.029+0000 7fb5aca00640 1 -- 172.21.15.37:0/4218231538 shutdown_connections 2024-08-20T05:05:12.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:12.029+0000 7fb5aca00640 1 -- 172.21.15.37:0/4218231538 wait complete. 2024-08-20T05:05:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.394+0000 7f8c94200640 1 -- 172.21.15.37:0/723730958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c8c1059f0 msgr2=0x7f8c8c105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.394+0000 7f8c94200640 1 --2- 172.21.15.37:0/723730958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c8c1059f0 0x7f8c8c105e70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009930 tx=0x7f8c7802a420 comp rx=0 tx=0).stop 2024-08-20T05:05:12.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.394+0000 7f8c94200640 1 -- 172.21.15.37:0/723730958 shutdown_connections 2024-08-20T05:05:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.394+0000 7f8c94200640 1 --2- 172.21.15.37:0/723730958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c8c1063b0 0x7f8c8c10cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.394+0000 7f8c94200640 1 --2- 172.21.15.37:0/723730958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c8c1059f0 0x7f8c8c105e70 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.394+0000 7f8c94200640 1 --2- 172.21.15.37:0/723730958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c8c1048a0 0x7f8c8c104ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.394+0000 7f8c94200640 1 -- 172.21.15.37:0/723730958 >> 172.21.15.37:0/723730958 conn(0x7f8c8c100160 msgr2=0x7f8c8c102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.394+0000 7f8c94200640 1 -- 172.21.15.37:0/723730958 shutdown_connections 2024-08-20T05:05:12.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.394+0000 7f8c94200640 1 -- 172.21.15.37:0/723730958 wait complete. 2024-08-20T05:05:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.395+0000 7f8c94200640 1 Processor -- start 2024-08-20T05:05:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.395+0000 7f8c94200640 1 -- start start 2024-08-20T05:05:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.395+0000 7f8c94200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c8c1048a0 0x7f8c8c19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.395+0000 7f8c94200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c8c1059f0 0x7f8c8c19b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.395+0000 7f8c94200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c8c1063b0 0x7f8c8c19bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.395+0000 7f8c94200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c110560 con 0x7f8c8c1059f0 2024-08-20T05:05:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.395+0000 7f8c94200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1103e0 con 0x7f8c8c1063b0 2024-08-20T05:05:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.395+0000 7f8c94200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1106e0 con 0x7f8c8c1048a0 2024-08-20T05:05:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.396+0000 7f8c90e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c8c1059f0 0x7f8c8c19b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.396+0000 7f8c91800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c8c1048a0 0x7f8c8c19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.396+0000 7f8c92200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c8c1063b0 0x7f8c8c19bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.396+0000 7f8c92200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c8c1063b0 0x7f8c8c19bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:41472/0 (socket says 172.21.15.37:41472) 2024-08-20T05:05:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.396+0000 7f8c92200640 1 -- 172.21.15.37:0/265505331 learned_addr learned my addr 172.21.15.37:0/265505331 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.396+0000 7f8c91800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c8c1048a0 0x7f8c8c19ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35756/0 (socket says 172.21.15.37:35756) 2024-08-20T05:05:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.396+0000 7f8c92200640 1 -- 172.21.15.37:0/265505331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c8c1048a0 msgr2=0x7f8c8c19ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.396+0000 7f8c92200640 1 --2- 172.21.15.37:0/265505331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c8c1048a0 0x7f8c8c19ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.396+0000 7f8c92200640 1 -- 172.21.15.37:0/265505331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c8c1059f0 msgr2=0x7f8c8c19b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.396+0000 7f8c92200640 1 --2- 172.21.15.37:0/265505331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c8c1059f0 0x7f8c8c19b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.396+0000 7f8c92200640 1 -- 172.21.15.37:0/265505331 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8c19c7c0 con 0x7f8c8c1063b0 2024-08-20T05:05:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.396+0000 7f8c91800640 1 --2- 172.21.15.37:0/265505331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c8c1048a0 0x7f8c8c19ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.397+0000 7f8c92200640 1 --2- 172.21.15.37:0/265505331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c8c1063b0 0x7f8c8c19bf00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400eb10 tx=0x7f8c8400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.397+0000 7f8c8a000640 1 -- 172.21.15.37:0/265505331 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84004b20 con 0x7f8c8c1063b0 2024-08-20T05:05:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.397+0000 7f8c94200640 1 -- 172.21.15.37:0/265505331 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8c19cab0 con 0x7f8c8c1063b0 2024-08-20T05:05:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.397+0000 7f8c8a000640 1 -- 172.21.15.37:0/265505331 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c84004cc0 con 0x7f8c8c1063b0 2024-08-20T05:05:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.397+0000 7f8c8a000640 1 -- 172.21.15.37:0/265505331 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84010690 con 0x7f8c8c1063b0 2024-08-20T05:05:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.397+0000 7f8c94200640 1 -- 172.21.15.37:0/265505331 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c8c1a3180 con 0x7f8c8c1063b0 2024-08-20T05:05:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.400+0000 7f8c971c3740 1 Processor -- start 2024-08-20T05:05:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.400+0000 7f8c8a000640 1 -- 172.21.15.37:0/265505331 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8c84005020 con 0x7f8c8c1063b0 2024-08-20T05:05:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.400+0000 7f8c971c3740 1 -- start start 2024-08-20T05:05:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.401+0000 7f8c971c3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc7452b0 0x563afc7476a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.401+0000 7f8c971c3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc747be0 0x563afc749fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.401+0000 7f8c971c3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc74a620 0x563afc74cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.401+0000 7f8c971c3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563afc6b8210 con 0x563afc7452b0 2024-08-20T05:05:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.401+0000 7f8c971c3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563afc6a7710 con 0x563afc747be0 2024-08-20T05:05:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.401+0000 7f8c971c3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563afc6ab750 con 0x563afc74a620 2024-08-20T05:05:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.401+0000 7f8c90e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc7452b0 0x563afc7476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.401+0000 7f8c90e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc7452b0 0x563afc7476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35014/0 (socket says 172.21.15.37:35014) 2024-08-20T05:05:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.401+0000 7f8c90e00640 1 -- 172.21.15.37:0/3716516654 learned_addr learned my addr 172.21.15.37:0/3716516654 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.401+0000 7f8c91800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc747be0 0x563afc749fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.401+0000 7f8c90e00640 1 --2- 172.21.15.37:0/3716516654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc74a620 0x563afc74cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.401+0000 7f8c91800640 1 -- 172.21.15.37:0/3716516654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc74a620 msgr2=0x563afc74cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.401+0000 7f8c91800640 1 --2- 172.21.15.37:0/3716516654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc74a620 0x563afc74cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.401+0000 7f8c91800640 1 -- 172.21.15.37:0/3716516654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc7452b0 msgr2=0x563afc7476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.401+0000 7f8c91800640 1 --2- 172.21.15.37:0/3716516654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc7452b0 0x563afc7476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.402+0000 7f8c91800640 1 -- 172.21.15.37:0/3716516654 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563afc673de0 con 0x563afc747be0 2024-08-20T05:05:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.402+0000 7f8c90e00640 1 --2- 172.21.15.37:0/3716516654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc7452b0 0x563afc7476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.402+0000 7f8c91800640 1 --2- 172.21.15.37:0/3716516654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc747be0 0x563afc749fd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8c80005fd0 tx=0x7f8c80010930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96ec5d319405ab29 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.402+0000 7f8c8a000640 1 --2- 172.21.15.37:0/265505331 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8c740b3bd0 0x7f8c740b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.402+0000 7f8c7ea00640 1 -- 172.21.15.37:0/3716516654 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c80011760 con 0x563afc747be0 2024-08-20T05:05:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.402+0000 7f8c7ea00640 1 -- 172.21.15.37:0/3716516654 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c80011db0 con 0x563afc747be0 2024-08-20T05:05:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.402+0000 7f8c7ea00640 1 -- 172.21.15.37:0/3716516654 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8001a380 con 0x563afc747be0 2024-08-20T05:05:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.402+0000 7f8c8a000640 1 -- 172.21.15.37:0/265505331 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8c840e4510 con 0x7f8c8c1063b0 2024-08-20T05:05:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.402+0000 7f8c90e00640 1 --2- 172.21.15.37:0/265505331 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8c740b3bd0 0x7f8c740b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.403+0000 7f8c971c3740 1 -- 172.21.15.37:0/3716516654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc747be0 msgr2=0x563afc749fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.403+0000 7f8c971c3740 1 --2- 172.21.15.37:0/3716516654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc747be0 0x563afc749fd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8c80005fd0 tx=0x7f8c80010930 comp rx=0 tx=0).stop 2024-08-20T05:05:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.403+0000 7f8c971c3740 1 -- 172.21.15.37:0/3716516654 shutdown_connections 2024-08-20T05:05:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.403+0000 7f8c971c3740 1 --2- 172.21.15.37:0/3716516654 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc74a620 0x563afc74cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.403+0000 7f8c971c3740 1 --2- 172.21.15.37:0/3716516654 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc747be0 0x563afc749fd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.403+0000 7f8c971c3740 1 --2- 172.21.15.37:0/3716516654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc7452b0 0x563afc7476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.403+0000 7f8c971c3740 1 -- 172.21.15.37:0/3716516654 >> 172.21.15.37:0/3716516654 conn(0x563afc7403b0 msgr2=0x563afc741190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.403+0000 7f8c90e00640 1 --2- 172.21.15.37:0/265505331 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8c740b3bd0 0x7f8c740b6090 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8c78000c00 tx=0x7f8c78005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.403+0000 7f8c971c3740 1 -- 172.21.15.37:0/3716516654 shutdown_connections 2024-08-20T05:05:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.403+0000 7f8c971c3740 1 -- 172.21.15.37:0/3716516654 wait complete. 2024-08-20T05:05:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.404+0000 7f8c971c3740 1 -- start start 2024-08-20T05:05:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.404+0000 7f8c971c3740 1 Processor -- start 2024-08-20T05:05:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.404+0000 7f8c971c3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc7452b0 0x563afc74ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.404+0000 7f8c971c3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc747be0 0x563afc74f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.404+0000 7f8c971c3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc74a620 0x563afc74ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.404+0000 7f8c971c3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563afc5e0ab0 con 0x563afc747be0 2024-08-20T05:05:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.404+0000 7f8c971c3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563afc64e140 con 0x563afc74a620 2024-08-20T05:05:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.404+0000 7f8c971c3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563afc74d600 con 0x563afc7452b0 2024-08-20T05:05:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.404+0000 7f8c971c3740 10 client.0 _ll_register_callbacks cb 0x563afc6615d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.405+0000 7f8c91800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc7452b0 0x563afc74ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.405+0000 7f8c90e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc747be0 0x563afc74f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.405+0000 7f8c91800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc7452b0 0x563afc74ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35770/0 (socket says 172.21.15.37:35770) 2024-08-20T05:05:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.405+0000 7f8c91800640 1 -- 172.21.15.37:0/451835534 learned_addr learned my addr 172.21.15.37:0/451835534 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.405+0000 7f8c92200640 1 --2- 172.21.15.37:0/451835534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc74a620 0x563afc74ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.405+0000 7f8c91800640 1 -- 172.21.15.37:0/451835534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc74a620 msgr2=0x563afc74ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.405+0000 7f8c91800640 1 --2- 172.21.15.37:0/451835534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc74a620 0x563afc74ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.405+0000 7f8c91800640 1 -- 172.21.15.37:0/451835534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc747be0 msgr2=0x563afc74f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.405+0000 7f8c91800640 1 --2- 172.21.15.37:0/451835534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc747be0 0x563afc74f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.405+0000 7f8c91800640 1 -- 172.21.15.37:0/451835534 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563afc64f170 con 0x563afc7452b0 2024-08-20T05:05:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.405+0000 7f8c91800640 1 --2- 172.21.15.37:0/451835534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc7452b0 0x563afc74ecc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8c8001c740 tx=0x7f8c8001c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c51bcd3e342662a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.405+0000 7f8c73400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.405+0000 7f8c73400640 1 -- 172.21.15.37:0/451835534 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8002a060 con 0x563afc7452b0 2024-08-20T05:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.406+0000 7f8c971c3740 1 -- 172.21.15.37:0/451835534 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563afc67ea30 con 0x563afc7452b0 2024-08-20T05:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.406+0000 7f8c73400640 1 -- 172.21.15.37:0/451835534 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8c80005260 con 0x563afc7452b0 2024-08-20T05:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.406+0000 7f8c73400640 1 -- 172.21.15.37:0/451835534 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8c80031050 con 0x563afc7452b0 2024-08-20T05:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.406+0000 7f8c971c3740 10 client.26299 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.406+0000 7f8c971c3740 1 -- 172.21.15.37:0/451835534 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563afc40a790 con 0x563afc7452b0 2024-08-20T05:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.406+0000 7f8c73400640 1 -- 172.21.15.37:0/451835534 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563afc67ea30 con 0x563afc7452b0 2024-08-20T05:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.406+0000 7f8c73400640 1 -- 172.21.15.37:0/451835534 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f8c800116a0 con 0x563afc7452b0 2024-08-20T05:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.407+0000 7f8c971c3740 10 client.26299 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.407+0000 7f8c971c3740 10 client.26299 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.407+0000 7f8c971c3740 20 client.26299 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.407+0000 7f8c971c3740 1 --2- 172.21.15.37:0/451835534 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563afc75a5f0 0x563afc75c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.407+0000 7f8c971c3740 4 client.26299 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:05:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.407+0000 7f8c971c3740 1 -- 172.21.15.37:0/451835534 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563afc6ba160 con 0x563afc75a5f0 2024-08-20T05:05:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.407+0000 7f8c90e00640 1 --2- 172.21.15.37:0/451835534 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563afc75a5f0 0x563afc75c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.407+0000 7f8c90e00640 1 --2- 172.21.15.37:0/451835534 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563afc75a5f0 0x563afc75c9e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8db58ff45f281714 server_cookie=b7a7d52e789d3484 in_seq=0 out_seq=0 2024-08-20T05:05:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.407+0000 7f8c73400640 10 client.26299 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.408+0000 7f8c73400640 1 -- 172.21.15.37:0/451835534 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563afc6ba160 con 0x563afc75a5f0 2024-08-20T05:05:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.408+0000 7f8c73400640 10 client.26299 handle_command_reply: tid=0 2024-08-20T05:05:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.409+0000 7f8c971c3740 1 client.26299 shutdown 2024-08-20T05:05:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.409+0000 7f8c971c3740 1 -- 172.21.15.37:0/451835534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc7452b0 msgr2=0x563afc74ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.409+0000 7f8c971c3740 1 --2- 172.21.15.37:0/451835534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc7452b0 0x563afc74ecc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8c8001c740 tx=0x7f8c8001c770 comp rx=0 tx=0).stop 2024-08-20T05:05:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.409+0000 7f8c971c3740 1 -- 172.21.15.37:0/451835534 shutdown_connections 2024-08-20T05:05:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.409+0000 7f8c971c3740 1 --2- 172.21.15.37:0/451835534 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563afc75a5f0 0x563afc75c9e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.409+0000 7f8c971c3740 1 --2- 172.21.15.37:0/451835534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc74a620 0x563afc74ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.409+0000 7f8c971c3740 1 --2- 172.21.15.37:0/451835534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc747be0 0x563afc74f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.409+0000 7f8c73400640 0 client.26299 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.409+0000 7f8c971c3740 1 --2- 172.21.15.37:0/451835534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc7452b0 0x563afc74ecc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.409+0000 7f8c971c3740 1 -- 172.21.15.37:0/451835534 >> 172.21.15.37:0/451835534 conn(0x563afc7403b0 msgr2=0x563afc73f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.409+0000 7f8c971c3740 1 -- 172.21.15.37:0/451835534 shutdown_connections 2024-08-20T05:05:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.409+0000 7f8c971c3740 1 -- 172.21.15.37:0/451835534 wait complete. 2024-08-20T05:05:12.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.409+0000 7f8c971c3740 20 client.26299 trim_cache size 0 max 16384 2024-08-20T05:05:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.424+0000 7f8c971c3740 1 Processor -- start 2024-08-20T05:05:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.424+0000 7f8c971c3740 1 -- start start 2024-08-20T05:05:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.424+0000 7f8c971c3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc7452b0 0x563afc74de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.424+0000 7f8c971c3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc747be0 0x563afc74e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.424+0000 7f8c971c3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc74a620 0x563afc74c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.424+0000 7f8c971c3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1ad5a0 con 0x563afc74a620 2024-08-20T05:05:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.424+0000 7f8c971c3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1af1a0 con 0x563afc7452b0 2024-08-20T05:05:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.424+0000 7f8c971c3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1adc70 con 0x563afc747be0 2024-08-20T05:05:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.425+0000 7f8c92200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc74a620 0x563afc74c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.425+0000 7f8c90e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc747be0 0x563afc74e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.425+0000 7f8c92200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc74a620 0x563afc74c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35032/0 (socket says 172.21.15.37:35032) 2024-08-20T05:05:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.425+0000 7f8c92200640 1 -- 172.21.15.37:0/3155100761 learned_addr learned my addr 172.21.15.37:0/3155100761 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.425+0000 7f8c91800640 1 --2- 172.21.15.37:0/3155100761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc7452b0 0x563afc74de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.425+0000 7f8c92200640 1 -- 172.21.15.37:0/3155100761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc747be0 msgr2=0x563afc74e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.425+0000 7f8c92200640 1 --2- 172.21.15.37:0/3155100761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc747be0 0x563afc74e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.425+0000 7f8c92200640 1 -- 172.21.15.37:0/3155100761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc7452b0 msgr2=0x563afc74de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.425+0000 7f8c92200640 1 --2- 172.21.15.37:0/3155100761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc7452b0 0x563afc74de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.425+0000 7f8c92200640 1 -- 172.21.15.37:0/3155100761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563afc483620 con 0x563afc74a620 2024-08-20T05:05:12.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.425+0000 7f8c92200640 1 --2- 172.21.15.37:0/3155100761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc74a620 0x563afc74c2c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8c840049d0 tx=0x7f8c8400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a89f0fec2328396 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.425+0000 7f8c7e000640 1 -- 172.21.15.37:0/3155100761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c840c4070 con 0x563afc74a620 2024-08-20T05:05:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.426+0000 7f8c7e000640 1 -- 172.21.15.37:0/3155100761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c840aab70 con 0x563afc74a620 2024-08-20T05:05:12.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.426+0000 7f8c7e000640 1 -- 172.21.15.37:0/3155100761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c840a72f0 con 0x563afc74a620 2024-08-20T05:05:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.426+0000 7f8c971c3740 1 -- 172.21.15.37:0/3155100761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc74a620 msgr2=0x563afc74c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.426+0000 7f8c971c3740 1 --2- 172.21.15.37:0/3155100761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc74a620 0x563afc74c2c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8c840049d0 tx=0x7f8c8400cf70 comp rx=0 tx=0).stop 2024-08-20T05:05:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.426+0000 7f8c971c3740 1 -- 172.21.15.37:0/3155100761 shutdown_connections 2024-08-20T05:05:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.426+0000 7f8c971c3740 1 --2- 172.21.15.37:0/3155100761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc74a620 0x563afc74c2c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.426+0000 7f8c971c3740 1 --2- 172.21.15.37:0/3155100761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc747be0 0x563afc74e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.426+0000 7f8c971c3740 1 --2- 172.21.15.37:0/3155100761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc7452b0 0x563afc74de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.426+0000 7f8c971c3740 1 -- 172.21.15.37:0/3155100761 >> 172.21.15.37:0/3155100761 conn(0x563afc7403b0 msgr2=0x563afc740e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:12.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.426+0000 7f8c971c3740 1 -- 172.21.15.37:0/3155100761 shutdown_connections 2024-08-20T05:05:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.426+0000 7f8c971c3740 1 -- 172.21.15.37:0/3155100761 wait complete. 2024-08-20T05:05:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.427+0000 7f8c971c3740 1 -- start start 2024-08-20T05:05:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.427+0000 7f8c971c3740 1 Processor -- start 2024-08-20T05:05:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.427+0000 7f8c971c3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc7452b0 0x563afc753b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.427+0000 7f8c971c3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc747be0 0x563afc7541b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.427+0000 7f8c971c3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc74a620 0x563afc754ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.427+0000 7f8c971c3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1aea10 con 0x563afc747be0 2024-08-20T05:05:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.427+0000 7f8c971c3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1ae340 con 0x563afc7452b0 2024-08-20T05:05:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.427+0000 7f8c971c3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c1ab580 con 0x563afc74a620 2024-08-20T05:05:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.427+0000 7f8c971c3740 10 client.0 _ll_register_callbacks cb 0x7f8c78009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.427+0000 7f8c90e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc747be0 0x563afc7541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.427+0000 7f8c91800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc7452b0 0x563afc753b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.428+0000 7f8c91800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc7452b0 0x563afc753b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:41512/0 (socket says 172.21.15.37:41512) 2024-08-20T05:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.428+0000 7f8c91800640 1 -- 172.21.15.37:0/3831029809 learned_addr learned my addr 172.21.15.37:0/3831029809 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.428+0000 7f8c92200640 1 --2- 172.21.15.37:0/3831029809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc74a620 0x563afc754ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.428+0000 7f8c91800640 1 -- 172.21.15.37:0/3831029809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc74a620 msgr2=0x563afc754ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.428+0000 7f8c91800640 1 --2- 172.21.15.37:0/3831029809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc74a620 0x563afc754ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.428+0000 7f8c91800640 1 -- 172.21.15.37:0/3831029809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc747be0 msgr2=0x563afc7541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.428+0000 7f8c91800640 1 --2- 172.21.15.37:0/3831029809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc747be0 0x563afc7541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.428+0000 7f8c91800640 1 -- 172.21.15.37:0/3831029809 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563afc755510 con 0x563afc7452b0 2024-08-20T05:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.428+0000 7f8c91800640 1 --2- 172.21.15.37:0/3831029809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc7452b0 0x563afc753b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c80011c10 tx=0x7f8c8000bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6063bac36567707b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.428+0000 7f8c73400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.428+0000 7f8c73400640 1 -- 172.21.15.37:0/3831029809 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8002a070 con 0x563afc7452b0 2024-08-20T05:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.429+0000 7f8c971c3740 1 -- 172.21.15.37:0/3831029809 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c840aab70 con 0x563afc7452b0 2024-08-20T05:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.429+0000 7f8c73400640 1 -- 172.21.15.37:0/3831029809 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8c8001c9f0 con 0x563afc7452b0 2024-08-20T05:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.429+0000 7f8c73400640 1 -- 172.21.15.37:0/3831029809 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8c80011560 con 0x563afc7452b0 2024-08-20T05:05:12.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.429+0000 7f8c971c3740 10 client.26261 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.429+0000 7f8c971c3740 1 -- 172.21.15.37:0/3831029809 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563afc756880 con 0x563afc7452b0 2024-08-20T05:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.429+0000 7f8c73400640 1 -- 172.21.15.37:0/3831029809 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c840aab70 con 0x563afc7452b0 2024-08-20T05:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.429+0000 7f8c73400640 1 -- 172.21.15.37:0/3831029809 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f8c800046d0 con 0x563afc7452b0 2024-08-20T05:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.429+0000 7f8c971c3740 10 client.26261 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.429+0000 7f8c971c3740 10 client.26261 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.429+0000 7f8c971c3740 20 client.26261 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.429+0000 7f8c971c3740 1 --2- 172.21.15.37:0/3831029809 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563afc7c5260 0x563afc7c7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.429+0000 7f8c971c3740 4 client.26261 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.429+0000 7f8c971c3740 1 -- 172.21.15.37:0/3831029809 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563afc6b5c00 con 0x563afc7c5260 2024-08-20T05:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.430+0000 7f8c90e00640 1 --2- 172.21.15.37:0/3831029809 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563afc7c5260 0x563afc7c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.430+0000 7f8c90e00640 1 --2- 172.21.15.37:0/3831029809 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563afc7c5260 0x563afc7c7650 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76439149c2e29ef2 server_cookie=92608fa4396d14be in_seq=0 out_seq=0 2024-08-20T05:05:12.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.430+0000 7f8c73400640 10 client.26261 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:12.445 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.440+0000 7f8c73400640 1 -- 172.21.15.37:0/3831029809 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563afc6b5c00 con 0x563afc7c5260 2024-08-20T05:05:12.445 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.440+0000 7f8c73400640 10 client.26261 handle_command_reply: tid=0 2024-08-20T05:05:12.445 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.440+0000 7f8c971c3740 1 client.26261 shutdown 2024-08-20T05:05:12.445 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c971c3740 1 -- 172.21.15.37:0/3831029809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc7452b0 msgr2=0x563afc753b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:12.445 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c971c3740 1 --2- 172.21.15.37:0/3831029809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc7452b0 0x563afc753b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8c80011c10 tx=0x7f8c8000bf10 comp rx=0 tx=0).stop 2024-08-20T05:05:12.445 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c971c3740 1 -- 172.21.15.37:0/3831029809 shutdown_connections 2024-08-20T05:05:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c971c3740 1 --2- 172.21.15.37:0/3831029809 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563afc7c5260 0x563afc7c7650 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c971c3740 1 --2- 172.21.15.37:0/3831029809 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563afc74a620 0x563afc754ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c971c3740 1 --2- 172.21.15.37:0/3831029809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563afc747be0 0x563afc7541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c971c3740 1 --2- 172.21.15.37:0/3831029809 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563afc7452b0 0x563afc753b10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c73400640 0 client.26261 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c971c3740 1 -- 172.21.15.37:0/3831029809 >> 172.21.15.37:0/3831029809 conn(0x563afc7403b0 msgr2=0x563afc74c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c971c3740 1 -- 172.21.15.37:0/3831029809 shutdown_connections 2024-08-20T05:05:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c971c3740 1 -- 172.21.15.37:0/3831029809 wait complete. 2024-08-20T05:05:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c971c3740 20 client.26261 trim_cache size 0 max 16384 2024-08-20T05:05:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:05:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:05:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:05:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:05:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c94200640 1 -- 172.21.15.37:0/265505331 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8c740b3bd0 msgr2=0x7f8c740b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c94200640 1 --2- 172.21.15.37:0/265505331 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8c740b3bd0 0x7f8c740b6090 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8c78000c00 tx=0x7f8c78005d50 comp rx=0 tx=0).stop 2024-08-20T05:05:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c94200640 1 -- 172.21.15.37:0/265505331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c8c1063b0 msgr2=0x7f8c8c19bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c94200640 1 --2- 172.21.15.37:0/265505331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c8c1063b0 0x7f8c8c19bf00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400eb10 tx=0x7f8c8400c2d0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c94200640 1 -- 172.21.15.37:0/265505331 shutdown_connections 2024-08-20T05:05:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c94200640 1 --2- 172.21.15.37:0/265505331 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8c740b3bd0 0x7f8c740b6090 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c94200640 1 --2- 172.21.15.37:0/265505331 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8c8c1063b0 0x7f8c8c19bf00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c94200640 1 --2- 172.21.15.37:0/265505331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c8c1059f0 0x7f8c8c19b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c94200640 1 --2- 172.21.15.37:0/265505331 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8c8c1048a0 0x7f8c8c19ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.443+0000 7f8c94200640 1 -- 172.21.15.37:0/265505331 >> 172.21.15.37:0/265505331 conn(0x7f8c8c100160 msgr2=0x7f8c8c108d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.444+0000 7f8c94200640 1 -- 172.21.15.37:0/265505331 shutdown_connections 2024-08-20T05:05:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:12.444+0000 7f8c94200640 1 -- 172.21.15.37:0/265505331 wait complete. 2024-08-20T05:05:12.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T05:05:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:05:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 135.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:05:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.516+0000 7f554f000640 1 -- 172.21.15.37:0/1431326237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5548102ab0 msgr2=0x7f5548102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.516+0000 7f554f000640 1 --2- 172.21.15.37:0/1431326237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5548102ab0 0x7f5548102e90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5538009ca0 tx=0x7f553802a8c0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.517+0000 7f554f000640 1 -- 172.21.15.37:0/1431326237 shutdown_connections 2024-08-20T05:05:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.517+0000 7f554f000640 1 --2- 172.21.15.37:0/1431326237 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5548108e40 0x7f554810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.517+0000 7f554f000640 1 --2- 172.21.15.37:0/1431326237 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55481084c0 0x7f5548108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.517+0000 7f554f000640 1 --2- 172.21.15.37:0/1431326237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5548102ab0 0x7f5548102e90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.517+0000 7f554f000640 1 -- 172.21.15.37:0/1431326237 >> 172.21.15.37:0/1431326237 conn(0x7f55480fe500 msgr2=0x7f5548100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.517+0000 7f554f000640 1 -- 172.21.15.37:0/1431326237 shutdown_connections 2024-08-20T05:05:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.517+0000 7f554f000640 1 -- 172.21.15.37:0/1431326237 wait complete. 2024-08-20T05:05:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.518+0000 7f554f000640 1 Processor -- start 2024-08-20T05:05:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.518+0000 7f554f000640 1 -- start start 2024-08-20T05:05:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.518+0000 7f554f000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5548102ab0 0x7f554819b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.518+0000 7f554f000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55481084c0 0x7f554819b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.518+0000 7f554f000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5548108e40 0x7f55481a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.518+0000 7f554f000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5548112b10 con 0x7f5548102ab0 2024-08-20T05:05:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.518+0000 7f554f000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5548112990 con 0x7f5548108e40 2024-08-20T05:05:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.518+0000 7f554f000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5548112c90 con 0x7f55481084c0 2024-08-20T05:05:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.518+0000 7f553f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55481084c0 0x7f554819b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.518+0000 7f5547e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5548102ab0 0x7f554819b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.518+0000 7f553f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55481084c0 0x7f554819b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34562/0 (socket says 172.21.15.37:34562) 2024-08-20T05:05:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.518+0000 7f553f400640 1 -- 172.21.15.37:0/2593673903 learned_addr learned my addr 172.21.15.37:0/2593673903 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.519+0000 7f554d000640 1 --2- 172.21.15.37:0/2593673903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5548108e40 0x7f55481a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.519+0000 7f553f400640 1 -- 172.21.15.37:0/2593673903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5548108e40 msgr2=0x7f55481a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.519+0000 7f553f400640 1 --2- 172.21.15.37:0/2593673903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5548108e40 0x7f55481a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.519+0000 7f553f400640 1 -- 172.21.15.37:0/2593673903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5548102ab0 msgr2=0x7f554819b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.519+0000 7f553f400640 1 --2- 172.21.15.37:0/2593673903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5548102ab0 0x7f554819b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.519+0000 7f553f400640 1 -- 172.21.15.37:0/2593673903 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55481a12a0 con 0x7f55481084c0 2024-08-20T05:05:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.519+0000 7f553f400640 1 --2- 172.21.15.37:0/2593673903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55481084c0 0x7f554819b730 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f553000ea60 tx=0x7f553000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.519+0000 7f5545600640 1 -- 172.21.15.37:0/2593673903 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553000cde0 con 0x7f55481084c0 2024-08-20T05:05:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.520+0000 7f554f000640 1 -- 172.21.15.37:0/2593673903 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55481a1590 con 0x7f55481084c0 2024-08-20T05:05:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.520+0000 7f5545600640 1 -- 172.21.15.37:0/2593673903 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55300035f0 con 0x7f55481084c0 2024-08-20T05:05:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.520+0000 7f5545600640 1 -- 172.21.15.37:0/2593673903 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5530010690 con 0x7f55481084c0 2024-08-20T05:05:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.520+0000 7f554f000640 1 -- 172.21.15.37:0/2593673903 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55481a7e20 con 0x7f55481084c0 2024-08-20T05:05:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.522+0000 7f5551a71740 1 Processor -- start 2024-08-20T05:05:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.523+0000 7f5551a71740 1 -- start start 2024-08-20T05:05:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.523+0000 7f5545600640 1 -- 172.21.15.37:0/2593673903 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f55300037a0 con 0x7f55481084c0 2024-08-20T05:05:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.523+0000 7f5551a71740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e155cf0 0x560e5e1560d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.523+0000 7f5551a71740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e156610 0x560e5e162060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.523+0000 7f5551a71740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e1625a0 0x560e5e164990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.523+0000 7f5551a71740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560e5e0f7670 con 0x560e5e1625a0 2024-08-20T05:05:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.523+0000 7f5551a71740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560e5e0cbd70 con 0x560e5e156610 2024-08-20T05:05:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.523+0000 7f5551a71740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560e5e0bb270 con 0x560e5e155cf0 2024-08-20T05:05:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.523+0000 7f553f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e1625a0 0x560e5e164990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.523+0000 7f554d000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e155cf0 0x560e5e1560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.523+0000 7f553f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e1625a0 0x560e5e164990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50514/0 (socket says 172.21.15.37:50514) 2024-08-20T05:05:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.523+0000 7f553f400640 1 -- 172.21.15.37:0/2883854292 learned_addr learned my addr 172.21.15.37:0/2883854292 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.524+0000 7f5547e00640 1 --2- 172.21.15.37:0/2883854292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e156610 0x560e5e162060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.524+0000 7f553f400640 1 -- 172.21.15.37:0/2883854292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e155cf0 msgr2=0x560e5e1560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.524+0000 7f553f400640 1 --2- 172.21.15.37:0/2883854292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e155cf0 0x560e5e1560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.524+0000 7f553f400640 1 -- 172.21.15.37:0/2883854292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e156610 msgr2=0x560e5e162060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.524+0000 7f553f400640 1 --2- 172.21.15.37:0/2883854292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e156610 0x560e5e162060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.524+0000 7f553f400640 1 -- 172.21.15.37:0/2883854292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e5e057870 con 0x560e5e1625a0 2024-08-20T05:05:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.524+0000 7f553f400640 1 --2- 172.21.15.37:0/2883854292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e1625a0 0x560e5e164990 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f55300ec320 tx=0x7f55300e7f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb6f8c5ee34ae1f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.524+0000 7f553d600640 1 -- 172.21.15.37:0/2883854292 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55300f7070 con 0x560e5e1625a0 2024-08-20T05:05:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.525+0000 7f553d600640 1 -- 172.21.15.37:0/2883854292 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55300e64e0 con 0x560e5e1625a0 2024-08-20T05:05:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.525+0000 7f553d600640 1 -- 172.21.15.37:0/2883854292 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55300f29a0 con 0x560e5e1625a0 2024-08-20T05:05:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.525+0000 7f5545600640 1 --2- 172.21.15.37:0/2593673903 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f552c0b3bd0 0x7f552c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.525+0000 7f5545600640 1 -- 172.21.15.37:0/2593673903 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f55300e42c0 con 0x7f55481084c0 2024-08-20T05:05:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.525+0000 7f554d000640 1 --2- 172.21.15.37:0/2593673903 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f552c0b3bd0 0x7f552c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.525+0000 7f5551a71740 1 -- 172.21.15.37:0/2883854292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e1625a0 msgr2=0x560e5e164990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.525+0000 7f5551a71740 1 --2- 172.21.15.37:0/2883854292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e1625a0 0x560e5e164990 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f55300ec320 tx=0x7f55300e7f90 comp rx=0 tx=0).stop 2024-08-20T05:05:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.525+0000 7f5551a71740 1 -- 172.21.15.37:0/2883854292 shutdown_connections 2024-08-20T05:05:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.525+0000 7f5551a71740 1 --2- 172.21.15.37:0/2883854292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e1625a0 0x560e5e164990 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.525+0000 7f5551a71740 1 --2- 172.21.15.37:0/2883854292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e156610 0x560e5e162060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.525+0000 7f5551a71740 1 --2- 172.21.15.37:0/2883854292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e155cf0 0x560e5e1560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.525+0000 7f5551a71740 1 -- 172.21.15.37:0/2883854292 >> 172.21.15.37:0/2883854292 conn(0x560e5e153b20 msgr2=0x560e5e154cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.526+0000 7f5551a71740 1 -- 172.21.15.37:0/2883854292 shutdown_connections 2024-08-20T05:05:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.526+0000 7f5551a71740 1 -- 172.21.15.37:0/2883854292 wait complete. 2024-08-20T05:05:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.526+0000 7f554d000640 1 --2- 172.21.15.37:0/2593673903 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f552c0b3bd0 0x7f552c0b6090 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5540009da0 tx=0x7f5540005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.526+0000 7f5551a71740 1 -- start start 2024-08-20T05:05:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.527+0000 7f5551a71740 1 Processor -- start 2024-08-20T05:05:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.527+0000 7f5551a71740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e155cf0 0x560e5e161e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.527+0000 7f5551a71740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e156610 0x560e5e15f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.527+0000 7f5551a71740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e1625a0 0x560e5e15f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.527+0000 7f5551a71740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560e5e041ff0 con 0x560e5e156610 2024-08-20T05:05:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.527+0000 7f5551a71740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560e5e0bf2b0 con 0x560e5e155cf0 2024-08-20T05:05:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.527+0000 7f5551a71740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560e5df1dbb0 con 0x560e5e1625a0 2024-08-20T05:05:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.527+0000 7f5551a71740 10 client.0 _ll_register_callbacks cb 0x560e5ddc6d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.528+0000 7f553f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e156610 0x560e5e15f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.528+0000 7f553f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e156610 0x560e5e15f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50516/0 (socket says 172.21.15.37:50516) 2024-08-20T05:05:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.528+0000 7f553f400640 1 -- 172.21.15.37:0/3012759719 learned_addr learned my addr 172.21.15.37:0/3012759719 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.528+0000 7f5547e00640 1 --2- 172.21.15.37:0/3012759719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e155cf0 0x560e5e161e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.528+0000 7f554d000640 1 --2- 172.21.15.37:0/3012759719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e1625a0 0x560e5e15f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.528+0000 7f553f400640 1 -- 172.21.15.37:0/3012759719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e1625a0 msgr2=0x560e5e15f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.528+0000 7f553f400640 1 --2- 172.21.15.37:0/3012759719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e1625a0 0x560e5e15f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.528+0000 7f553f400640 1 -- 172.21.15.37:0/3012759719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e155cf0 msgr2=0x560e5e161e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.528+0000 7f553f400640 1 --2- 172.21.15.37:0/3012759719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e155cf0 0x560e5e161e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.528+0000 7f553f400640 1 -- 172.21.15.37:0/3012759719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e5de1ab00 con 0x560e5e156610 2024-08-20T05:05:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.528+0000 7f554d000640 1 --2- 172.21.15.37:0/3012759719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e1625a0 0x560e5e15f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:05:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.528+0000 7f553f400640 1 --2- 172.21.15.37:0/3012759719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e156610 0x560e5e15f270 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f55300aab10 tx=0x7f55300f2400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e514d361e30975 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.528+0000 7f5536000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:05:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.529+0000 7f5536000640 1 -- 172.21.15.37:0/3012759719 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55300a6cd0 con 0x560e5e156610 2024-08-20T05:05:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.529+0000 7f5551a71740 1 -- 172.21.15.37:0/3012759719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55300e64e0 con 0x560e5e156610 2024-08-20T05:05:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.529+0000 7f5536000640 1 -- 172.21.15.37:0/3012759719 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f55300e62e0 con 0x560e5e156610 2024-08-20T05:05:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.529+0000 7f5536000640 1 -- 172.21.15.37:0/3012759719 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f55300aa580 con 0x560e5e156610 2024-08-20T05:05:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.529+0000 7f5551a71740 10 client.16128 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.529+0000 7f5551a71740 1 -- 172.21.15.37:0/3012759719 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560e5de91960 con 0x560e5e156610 2024-08-20T05:05:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.529+0000 7f5536000640 1 -- 172.21.15.37:0/3012759719 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55300e64e0 con 0x560e5e156610 2024-08-20T05:05:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.530+0000 7f5536000640 1 -- 172.21.15.37:0/3012759719 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f55300a70a0 con 0x560e5e156610 2024-08-20T05:05:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.530+0000 7f5551a71740 10 client.16128 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.530+0000 7f5551a71740 10 client.16128 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:05:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.530+0000 7f5551a71740 20 client.16128 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.530+0000 7f5551a71740 1 --2- 172.21.15.37:0/3012759719 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560e5e17a300 0x560e5e17c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.530+0000 7f5551a71740 4 client.16128 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:05:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.530+0000 7f5551a71740 1 -- 172.21.15.37:0/3012759719 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e5e0cdcc0 con 0x560e5e17a300 2024-08-20T05:05:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.530+0000 7f5547e00640 1 --2- 172.21.15.37:0/3012759719 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560e5e17a300 0x560e5e17c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.531+0000 7f5547e00640 1 --2- 172.21.15.37:0/3012759719 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560e5e17a300 0x560e5e17c6f0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3700fe6168762867 server_cookie=54111cdb8eb806c7 in_seq=0 out_seq=0 2024-08-20T05:05:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.531+0000 7f5536000640 10 client.16128 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.532+0000 7f5536000640 1 -- 172.21.15.37:0/3012759719 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560e5e0cdcc0 con 0x560e5e17a300 2024-08-20T05:05:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.532+0000 7f5536000640 10 client.16128 handle_command_reply: tid=0 2024-08-20T05:05:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.532+0000 7f5551a71740 1 client.16128 shutdown 2024-08-20T05:05:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.532+0000 7f5551a71740 1 -- 172.21.15.37:0/3012759719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e156610 msgr2=0x560e5e15f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.532+0000 7f5551a71740 1 --2- 172.21.15.37:0/3012759719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e156610 0x560e5e15f270 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f55300aab10 tx=0x7f55300f2400 comp rx=0 tx=0).stop 2024-08-20T05:05:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.532+0000 7f5551a71740 1 -- 172.21.15.37:0/3012759719 shutdown_connections 2024-08-20T05:05:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.532+0000 7f5551a71740 1 --2- 172.21.15.37:0/3012759719 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560e5e17a300 0x560e5e17c6f0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.532+0000 7f5551a71740 1 --2- 172.21.15.37:0/3012759719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e1625a0 0x560e5e15f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.532+0000 7f5551a71740 1 --2- 172.21.15.37:0/3012759719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e156610 0x560e5e15f270 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.532+0000 7f5551a71740 1 --2- 172.21.15.37:0/3012759719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e155cf0 0x560e5e161e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.532+0000 7f5551a71740 1 -- 172.21.15.37:0/3012759719 >> 172.21.15.37:0/3012759719 conn(0x560e5e153b20 msgr2=0x560e5e1596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.532+0000 7f5536000640 0 client.16128 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.532+0000 7f5551a71740 1 -- 172.21.15.37:0/3012759719 shutdown_connections 2024-08-20T05:05:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.533+0000 7f5551a71740 1 -- 172.21.15.37:0/3012759719 wait complete. 2024-08-20T05:05:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.533+0000 7f5551a71740 20 client.16128 trim_cache size 0 max 16384 2024-08-20T05:05:13.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.554+0000 7f5551a71740 1 Processor -- start 2024-08-20T05:05:13.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.554+0000 7f5551a71740 1 -- start start 2024-08-20T05:05:13.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.554+0000 7f5551a71740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e155cf0 0x560e5e176a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.554+0000 7f5551a71740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e156610 0x560e5e15e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.554+0000 7f5551a71740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e1625a0 0x560e5e181c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.554+0000 7f5551a71740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55481ad720 con 0x560e5e1625a0 2024-08-20T05:05:13.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.554+0000 7f5551a71740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f55481af320 con 0x560e5e155cf0 2024-08-20T05:05:13.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.554+0000 7f5551a71740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55481addf0 con 0x560e5e156610 2024-08-20T05:05:13.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.555+0000 7f5547e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e155cf0 0x560e5e176a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.555+0000 7f5547e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e155cf0 0x560e5e176a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:41920/0 (socket says 172.21.15.37:41920) 2024-08-20T05:05:13.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.555+0000 7f553f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e156610 0x560e5e15e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.555+0000 7f5547e00640 1 -- 172.21.15.37:0/1369194421 learned_addr learned my addr 172.21.15.37:0/1369194421 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:13.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.555+0000 7f554d000640 1 --2- 172.21.15.37:0/1369194421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e1625a0 0x560e5e181c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.555+0000 7f5547e00640 1 -- 172.21.15.37:0/1369194421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e156610 msgr2=0x560e5e15e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:13.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.555+0000 7f5547e00640 1 --2- 172.21.15.37:0/1369194421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e156610 0x560e5e15e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.555+0000 7f5547e00640 1 -- 172.21.15.37:0/1369194421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e1625a0 msgr2=0x560e5e181c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:13.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.555+0000 7f5547e00640 1 --2- 172.21.15.37:0/1369194421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e1625a0 0x560e5e181c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.555+0000 7f5547e00640 1 -- 172.21.15.37:0/1369194421 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e5e1600e0 con 0x560e5e155cf0 2024-08-20T05:05:13.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.555+0000 7f553f400640 1 --2- 172.21.15.37:0/1369194421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e156610 0x560e5e15e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:13.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.556+0000 7f5547e00640 1 --2- 172.21.15.37:0/1369194421 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e155cf0 0x560e5e176a50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f553802f4a0 tx=0x7f5538009820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99c0c7a497e54c4e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:13.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.556+0000 7f553cc00640 1 -- 172.21.15.37:0/1369194421 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538031650 con 0x560e5e155cf0 2024-08-20T05:05:13.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.556+0000 7f553cc00640 1 -- 172.21.15.37:0/1369194421 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5538036040 con 0x560e5e155cf0 2024-08-20T05:05:13.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.556+0000 7f553cc00640 1 -- 172.21.15.37:0/1369194421 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538004430 con 0x560e5e155cf0 2024-08-20T05:05:13.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.557+0000 7f5551a71740 1 -- 172.21.15.37:0/1369194421 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e155cf0 msgr2=0x560e5e176a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:13.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.557+0000 7f5551a71740 1 --2- 172.21.15.37:0/1369194421 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e155cf0 0x560e5e176a50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f553802f4a0 tx=0x7f5538009820 comp rx=0 tx=0).stop 2024-08-20T05:05:13.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.557+0000 7f5551a71740 1 -- 172.21.15.37:0/1369194421 shutdown_connections 2024-08-20T05:05:13.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.557+0000 7f5551a71740 1 --2- 172.21.15.37:0/1369194421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e1625a0 0x560e5e181c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.557+0000 7f5551a71740 1 --2- 172.21.15.37:0/1369194421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e156610 0x560e5e15e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.557+0000 7f5551a71740 1 --2- 172.21.15.37:0/1369194421 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e155cf0 0x560e5e176a50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.557+0000 7f5551a71740 1 -- 172.21.15.37:0/1369194421 >> 172.21.15.37:0/1369194421 conn(0x560e5e153b20 msgr2=0x560e5e15daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:13.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.557+0000 7f5551a71740 1 -- 172.21.15.37:0/1369194421 shutdown_connections 2024-08-20T05:05:13.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.557+0000 7f5551a71740 1 -- 172.21.15.37:0/1369194421 wait complete. 2024-08-20T05:05:13.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.558+0000 7f5551a71740 1 -- start start 2024-08-20T05:05:13.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.558+0000 7f5551a71740 1 Processor -- start 2024-08-20T05:05:13.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.558+0000 7f5551a71740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e155cf0 0x560e5e16eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.558+0000 7f5551a71740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e156610 0x560e5e16f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.558+0000 7f5551a71740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e1625a0 0x560e5e16f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.558+0000 7f5551a71740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55481aeb90 con 0x560e5e155cf0 2024-08-20T05:05:13.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.558+0000 7f5551a71740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f55481ae4c0 con 0x560e5e1625a0 2024-08-20T05:05:13.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.558+0000 7f5551a71740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55481ab700 con 0x560e5e156610 2024-08-20T05:05:13.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.558+0000 7f5551a71740 10 client.0 _ll_register_callbacks cb 0x7f55300f5070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:13.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.559+0000 7f554d000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e1625a0 0x560e5e16f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.559+0000 7f554d000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e1625a0 0x560e5e16f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:41932/0 (socket says 172.21.15.37:41932) 2024-08-20T05:05:13.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.559+0000 7f553f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e156610 0x560e5e16f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.559+0000 7f554d000640 1 -- 172.21.15.37:0/774234441 learned_addr learned my addr 172.21.15.37:0/774234441 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:13.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.559+0000 7f5547e00640 1 --2- 172.21.15.37:0/774234441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e155cf0 0x560e5e16eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.559+0000 7f554d000640 1 -- 172.21.15.37:0/774234441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e156610 msgr2=0x560e5e16f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:13.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.559+0000 7f554d000640 1 --2- 172.21.15.37:0/774234441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e156610 0x560e5e16f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.559+0000 7f554d000640 1 -- 172.21.15.37:0/774234441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e155cf0 msgr2=0x560e5e16eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.559+0000 7f554d000640 1 --2- 172.21.15.37:0/774234441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e155cf0 0x560e5e16eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.559+0000 7f554d000640 1 -- 172.21.15.37:0/774234441 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e5e1e3dc0 con 0x560e5e1625a0 2024-08-20T05:05:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.559+0000 7f553f400640 1 --2- 172.21.15.37:0/774234441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e156610 0x560e5e16f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.559+0000 7f554d000640 1 --2- 172.21.15.37:0/774234441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e1625a0 0x560e5e16f590 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f554001d9c0 tx=0x7f55400046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c66f4c1650329d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.559+0000 7f5536000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:05:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.560+0000 7f5536000640 1 -- 172.21.15.37:0/774234441 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55400285e0 con 0x560e5e1625a0 2024-08-20T05:05:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.560+0000 7f5551a71740 1 -- 172.21.15.37:0/774234441 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5538036040 con 0x560e5e1625a0 2024-08-20T05:05:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.560+0000 7f5536000640 1 -- 172.21.15.37:0/774234441 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5540028780 con 0x560e5e1625a0 2024-08-20T05:05:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.560+0000 7f5536000640 1 -- 172.21.15.37:0/774234441 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5540037050 con 0x560e5e1625a0 2024-08-20T05:05:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.560+0000 7f5551a71740 10 client.26279 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.560+0000 7f5551a71740 1 -- 172.21.15.37:0/774234441 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560e5e1e5190 con 0x560e5e1625a0 2024-08-20T05:05:13.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.560+0000 7f5536000640 1 -- 172.21.15.37:0/774234441 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5538036040 con 0x560e5e1625a0 2024-08-20T05:05:13.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.561+0000 7f5536000640 1 -- 172.21.15.37:0/774234441 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f5540029ac0 con 0x560e5e1625a0 2024-08-20T05:05:13.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.561+0000 7f5551a71740 10 client.26279 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:13.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.561+0000 7f5551a71740 10 client.26279 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:05:13.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.561+0000 7f5551a71740 20 client.26279 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:13.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.561+0000 7f5551a71740 1 --2- 172.21.15.37:0/774234441 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560e5e1e59d0 0x560e5e1e7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:13.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.561+0000 7f5551a71740 4 client.26279 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6a321e2e", "release": true, "await": true}] 2024-08-20T05:05:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.561+0000 7f5551a71740 1 -- 172.21.15.37:0/774234441 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6a321e2e", "release": true, "await": true}) -- 0x560e5e0c9760 con 0x560e5e1e59d0 2024-08-20T05:05:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.562+0000 7f5547e00640 1 --2- 172.21.15.37:0/774234441 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560e5e1e59d0 0x560e5e1e7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.562+0000 7f5547e00640 1 --2- 172.21.15.37:0/774234441 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560e5e1e59d0 0x560e5e1e7df0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=383b72c12ce8ed6a server_cookie=33c241635d9d89a7 in_seq=0 out_seq=0 2024-08-20T05:05:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.562+0000 7f5536000640 10 client.26279 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:13.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.604+0000 7f5536000640 1 -- 172.21.15.37:0/774234441 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x560e5e0c9760 con 0x560e5e1e59d0 2024-08-20T05:05:13.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.604+0000 7f5536000640 10 client.26279 handle_command_reply: tid=0 2024-08-20T05:05:13.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.604+0000 7f5551a71740 1 client.26279 shutdown 2024-08-20T05:05:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.604+0000 7f5551a71740 1 -- 172.21.15.37:0/774234441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e1625a0 msgr2=0x560e5e16f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.604+0000 7f5551a71740 1 --2- 172.21.15.37:0/774234441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e1625a0 0x560e5e16f590 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f554001d9c0 tx=0x7f55400046c0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.607+0000 7f5551a71740 1 -- 172.21.15.37:0/774234441 shutdown_connections 2024-08-20T05:05:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.607+0000 7f5551a71740 1 --2- 172.21.15.37:0/774234441 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560e5e1e59d0 0x560e5e1e7df0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.607+0000 7f5551a71740 1 --2- 172.21.15.37:0/774234441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560e5e1625a0 0x560e5e16f590 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.607+0000 7f5551a71740 1 --2- 172.21.15.37:0/774234441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560e5e156610 0x560e5e16f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.607+0000 7f5551a71740 1 --2- 172.21.15.37:0/774234441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560e5e155cf0 0x560e5e16eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.607+0000 7f5551a71740 1 -- 172.21.15.37:0/774234441 >> 172.21.15.37:0/774234441 conn(0x560e5e153b20 msgr2=0x560e5e15e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.607+0000 7f5536000640 0 client.26279 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:13.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.607+0000 7f5551a71740 1 -- 172.21.15.37:0/774234441 shutdown_connections 2024-08-20T05:05:13.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.607+0000 7f5551a71740 1 -- 172.21.15.37:0/774234441 wait complete. 2024-08-20T05:05:13.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.608+0000 7f5551a71740 20 client.26279 trim_cache size 0 max 16384 2024-08-20T05:05:13.610 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:05:13.610 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 33, 2024-08-20T05:05:13.611 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:05:13.611 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 16, 2024-08-20T05:05:13.611 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:05:13.611 INFO:teuthology.orchestra.run.smithi037.stdout: "6a321e2e": { 2024-08-20T05:05:13.611 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 16, 2024-08-20T05:05:13.611 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:05:13.611 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:05:13.611 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:05:13.611 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:05:13.611 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:05:13.611 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:05:13.611 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 136.4, 2024-08-20T05:05:13.611 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:05:13.611 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:05:13.612 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:05:13.612 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:05:13.612 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:05:13.612 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:05:13.612 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:05:13.612 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:05:13.612 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:05:13.612 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:05:13.612 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:05:13.612 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:05:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.609+0000 7f554f000640 1 -- 172.21.15.37:0/2593673903 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f552c0b3bd0 msgr2=0x7f552c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.609+0000 7f554f000640 1 --2- 172.21.15.37:0/2593673903 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f552c0b3bd0 0x7f552c0b6090 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5540009da0 tx=0x7f5540005f90 comp rx=0 tx=0).stop 2024-08-20T05:05:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.609+0000 7f554f000640 1 -- 172.21.15.37:0/2593673903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55481084c0 msgr2=0x7f554819b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.609+0000 7f554f000640 1 --2- 172.21.15.37:0/2593673903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55481084c0 0x7f554819b730 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f553000ea60 tx=0x7f553000ef20 comp rx=0 tx=0).stop 2024-08-20T05:05:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.610+0000 7f554f000640 1 -- 172.21.15.37:0/2593673903 shutdown_connections 2024-08-20T05:05:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.610+0000 7f554f000640 1 --2- 172.21.15.37:0/2593673903 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f552c0b3bd0 0x7f552c0b6090 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.610+0000 7f554f000640 1 --2- 172.21.15.37:0/2593673903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5548108e40 0x7f55481a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.610+0000 7f554f000640 1 --2- 172.21.15.37:0/2593673903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55481084c0 0x7f554819b730 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.610+0000 7f554f000640 1 --2- 172.21.15.37:0/2593673903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5548102ab0 0x7f554819b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.610+0000 7f554f000640 1 -- 172.21.15.37:0/2593673903 >> 172.21.15.37:0/2593673903 conn(0x7f55480fe500 msgr2=0x7f5548104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.611+0000 7f554f000640 1 -- 172.21.15.37:0/2593673903 shutdown_connections 2024-08-20T05:05:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:13.612+0000 7f554f000640 1 -- 172.21.15.37:0/2593673903 wait complete. 2024-08-20T05:05:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:05:13.711 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:13 smithi037 ceph-mon[17265]: pgmap v490: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.4 MiB/s wr, 357 op/s 2024-08-20T05:05:13.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:13 smithi135 ceph-mon[22342]: pgmap v490: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.4 MiB/s wr, 357 op/s 2024-08-20T05:05:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:13 smithi130 ceph-mon[22007]: pgmap v490: 129 pgs: 129 active+clean; 1022 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.4 MiB/s wr, 357 op/s 2024-08-20T05:05:14.740 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6a321e2e', total seconds elapsed: 22.5 2024-08-20T05:05:15.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.299+0000 7fb2eb800640 1 -- 172.21.15.37:0/2504637547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2e410f950 msgr2=0x7fb2e41160a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:15.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.301+0000 7fb2eb800640 1 --2- 172.21.15.37:0/2504637547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2e410f950 0x7fb2e41160a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc005fd0 tx=0x7fb2dc02b400 comp rx=0 tx=0).stop 2024-08-20T05:05:15.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.302+0000 7fb2eb800640 1 -- 172.21.15.37:0/2504637547 shutdown_connections 2024-08-20T05:05:15.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.302+0000 7fb2eb800640 1 --2- 172.21.15.37:0/2504637547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2e410f950 0x7fb2e41160a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.303+0000 7fb2eb800640 1 --2- 172.21.15.37:0/2504637547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e410efb0 0x7fb2e410f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.303+0000 7fb2eb800640 1 --2- 172.21.15.37:0/2504637547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2e410a0e0 0x7fb2e410a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.303+0000 7fb2eb800640 1 -- 172.21.15.37:0/2504637547 >> 172.21.15.37:0/2504637547 conn(0x7fb2e406dfe0 msgr2=0x7fb2e406e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:15.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.304+0000 7fb2eb800640 1 -- 172.21.15.37:0/2504637547 shutdown_connections 2024-08-20T05:05:15.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.304+0000 7fb2eb800640 1 -- 172.21.15.37:0/2504637547 wait complete. 2024-08-20T05:05:15.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.308+0000 7fb2eb800640 1 Processor -- start 2024-08-20T05:05:15.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.308+0000 7fb2eb800640 1 -- start start 2024-08-20T05:05:15.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.310+0000 7fb2eb800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2e410a0e0 0x7fb2e41a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.311+0000 7fb2eb800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e410efb0 0x7fb2e41a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.312+0000 7fb2e3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e410efb0 0x7fb2e41a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:15.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.313+0000 7fb2e3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e410efb0 0x7fb2e41a1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50554/0 (socket says 172.21.15.37:50554) 2024-08-20T05:05:15.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.313+0000 7fb2eb800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2e410f950 0x7fb2e41a6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.314+0000 7fb2e8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2e410a0e0 0x7fb2e41a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:15.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.314+0000 7fb2e3e00640 1 -- 172.21.15.37:0/796832698 learned_addr learned my addr 172.21.15.37:0/796832698 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:15.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.315+0000 7fb2eb800640 1 -- 172.21.15.37:0/796832698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e4119020 con 0x7fb2e410efb0 2024-08-20T05:05:15.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.315+0000 7fb2eb800640 1 -- 172.21.15.37:0/796832698 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e4118ea0 con 0x7fb2e410f950 2024-08-20T05:05:15.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.315+0000 7fb2eb800640 1 -- 172.21.15.37:0/796832698 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb2e41191a0 con 0x7fb2e410a0e0 2024-08-20T05:05:15.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.316+0000 7fb2e9800640 1 --2- 172.21.15.37:0/796832698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2e410f950 0x7fb2e41a6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:15.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.318+0000 7fb2e9800640 1 -- 172.21.15.37:0/796832698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2e410a0e0 msgr2=0x7fb2e41a1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:15.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.318+0000 7fb2e9800640 1 --2- 172.21.15.37:0/796832698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2e410a0e0 0x7fb2e41a1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.318+0000 7fb2e9800640 1 -- 172.21.15.37:0/796832698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e410efb0 msgr2=0x7fb2e41a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:15.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.318+0000 7fb2e9800640 1 --2- 172.21.15.37:0/796832698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e410efb0 0x7fb2e41a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.318+0000 7fb2e9800640 1 -- 172.21.15.37:0/796832698 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2e41a77c0 con 0x7fb2e410f950 2024-08-20T05:05:15.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.318+0000 7fb2e3e00640 1 --2- 172.21.15.37:0/796832698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e410efb0 0x7fb2e41a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:05:15.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.318+0000 7fb2e8e00640 1 --2- 172.21.15.37:0/796832698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2e410a0e0 0x7fb2e41a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:05:15.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.321+0000 7fb2e9800640 1 --2- 172.21.15.37:0/796832698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2e410f950 0x7fb2e41a6ff0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc035040 tx=0x7fb2dc007c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:15.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.321+0000 7fb2e1600640 1 -- 172.21.15.37:0/796832698 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc037040 con 0x7fb2e410f950 2024-08-20T05:05:15.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.322+0000 7fb2eb800640 1 -- 172.21.15.37:0/796832698 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2e41a7a50 con 0x7fb2e410f950 2024-08-20T05:05:15.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.322+0000 7fb2eb800640 1 -- 172.21.15.37:0/796832698 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2e41ae170 con 0x7fb2e410f950 2024-08-20T05:05:15.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.322+0000 7fb2e1600640 1 -- 172.21.15.37:0/796832698 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2dc032bb0 con 0x7fb2e410f950 2024-08-20T05:05:15.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.322+0000 7fb2e1600640 1 -- 172.21.15.37:0/796832698 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc004310 con 0x7fb2e410f950 2024-08-20T05:05:15.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.327+0000 7fb2ee468740 1 Processor -- start 2024-08-20T05:05:15.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.330+0000 7fb2e1600640 1 -- 172.21.15.37:0/796832698 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb2dc044060 con 0x7fb2e410f950 2024-08-20T05:05:15.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.331+0000 7fb2ee468740 1 -- start start 2024-08-20T05:05:15.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.332+0000 7fb2ee468740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f21940 0x557e49f21d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.332+0000 7fb2ee468740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f22260 0x557e49f2dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.332+0000 7fb2ee468740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f2e1f0 0x557e49f305e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.332+0000 7fb2ee468740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e49e97aa0 con 0x557e49f22260 2024-08-20T05:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.332+0000 7fb2ee468740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557e49e86fa0 con 0x557e49f21940 2024-08-20T05:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.332+0000 7fb2ee468740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557e49e8afe0 con 0x557e49f2e1f0 2024-08-20T05:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.333+0000 7fb2e3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f2e1f0 0x557e49f305e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.333+0000 7fb2e3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f21940 0x557e49f21d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.333+0000 7fb2e3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f21940 0x557e49f21d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:41952/0 (socket says 172.21.15.37:41952) 2024-08-20T05:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.333+0000 7fb2e3e00640 1 -- 172.21.15.37:0/2691000629 learned_addr learned my addr 172.21.15.37:0/2691000629 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.333+0000 7fb2e1600640 1 --2- 172.21.15.37:0/796832698 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2c80b3d60 0x7fb2c80b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.333+0000 7fb2e1600640 1 -- 172.21.15.37:0/796832698 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb2dc1037b0 con 0x7fb2e410f950 2024-08-20T05:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.333+0000 7fb2e8e00640 1 --2- 172.21.15.37:0/2691000629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f22260 0x557e49f2dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.334+0000 7fb2e3e00640 1 -- 172.21.15.37:0/2691000629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f2e1f0 msgr2=0x557e49f305e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.334+0000 7fb2e3e00640 1 --2- 172.21.15.37:0/2691000629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f2e1f0 0x557e49f305e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.334+0000 7fb2e3e00640 1 -- 172.21.15.37:0/2691000629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f22260 msgr2=0x557e49f2dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.334+0000 7fb2e3e00640 1 --2- 172.21.15.37:0/2691000629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f22260 0x557e49f2dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.334+0000 7fb2e3e00640 1 -- 172.21.15.37:0/2691000629 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e49e2d420 con 0x557e49f21940 2024-08-20T05:05:15.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.334+0000 7fb2e8e00640 1 --2- 172.21.15.37:0/2691000629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f22260 0x557e49f2dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:05:15.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.334+0000 7fb2e3e00640 1 --2- 172.21.15.37:0/2691000629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f21940 0x557e49f21d20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4005870 tx=0x7fb2d4005e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=403079695c251bca server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:15.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.335+0000 7fb2da000640 1 -- 172.21.15.37:0/2691000629 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d403a020 con 0x557e49f21940 2024-08-20T05:05:15.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.335+0000 7fb2da000640 1 -- 172.21.15.37:0/2691000629 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2d4010850 con 0x557e49f21940 2024-08-20T05:05:15.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.335+0000 7fb2da000640 1 -- 172.21.15.37:0/2691000629 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d403a020 con 0x557e49f21940 2024-08-20T05:05:15.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.336+0000 7fb2ee468740 1 -- 172.21.15.37:0/2691000629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f21940 msgr2=0x557e49f21d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:15.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.336+0000 7fb2ee468740 1 --2- 172.21.15.37:0/2691000629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f21940 0x557e49f21d20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4005870 tx=0x7fb2d4005e60 comp rx=0 tx=0).stop 2024-08-20T05:05:15.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.336+0000 7fb2e9800640 1 --2- 172.21.15.37:0/796832698 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2c80b3d60 0x7fb2c80b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:15.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.337+0000 7fb2ee468740 1 -- 172.21.15.37:0/2691000629 shutdown_connections 2024-08-20T05:05:15.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.337+0000 7fb2ee468740 1 --2- 172.21.15.37:0/2691000629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f2e1f0 0x557e49f305e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.337+0000 7fb2ee468740 1 --2- 172.21.15.37:0/2691000629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f22260 0x557e49f2dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.337+0000 7fb2ee468740 1 --2- 172.21.15.37:0/2691000629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f21940 0x557e49f21d20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.337+0000 7fb2ee468740 1 -- 172.21.15.37:0/2691000629 >> 172.21.15.37:0/2691000629 conn(0x557e49f1f770 msgr2=0x557e49f20910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:15.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.337+0000 7fb2ee468740 1 -- 172.21.15.37:0/2691000629 shutdown_connections 2024-08-20T05:05:15.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.337+0000 7fb2ee468740 1 -- 172.21.15.37:0/2691000629 wait complete. 2024-08-20T05:05:15.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.338+0000 7fb2e9800640 1 --2- 172.21.15.37:0/796832698 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2c80b3d60 0x7fb2c80b6220 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0ca2f0 tx=0x7fb2dc00aec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:15.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.338+0000 7fb2ee468740 1 -- start start 2024-08-20T05:05:15.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.338+0000 7fb2ee468740 1 Processor -- start 2024-08-20T05:05:15.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.340+0000 7fb2ee468740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 0x557e49f2d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.342+0000 7fb2ee468740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f22260 0x557e49f2ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.342+0000 7fb2ee468740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f2e1f0 0x557e49f2b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.342+0000 7fb2ee468740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e49ce9700 con 0x557e49f2e1f0 2024-08-20T05:05:15.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.342+0000 7fb2ee468740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557e49e22290 con 0x557e49f22260 2024-08-20T05:05:15.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.342+0000 7fb2e3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 0x557e49f2d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:15.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.342+0000 7fb2e3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 0x557e49f2d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34632/0 (socket says 172.21.15.37:34632) 2024-08-20T05:05:15.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.342+0000 7fb2e3e00640 1 -- 172.21.15.37:0/2176141432 learned_addr learned my addr 172.21.15.37:0/2176141432 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:15.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.343+0000 7fb2ee468740 1 -- 172.21.15.37:0/2176141432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557e49f30ec0 con 0x557e49f21940 2024-08-20T05:05:15.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.343+0000 7fb2e8e00640 1 --2- 172.21.15.37:0/2176141432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f22260 0x557e49f2ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:15.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.343+0000 7fb2ee468740 10 client.0 _ll_register_callbacks cb 0x557e49e811c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:15.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.344+0000 7fb2e3e00640 1 --2- 172.21.15.37:0/2176141432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f2e1f0 0x557e49f2b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:15.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.345+0000 7fb2e8e00640 1 -- 172.21.15.37:0/2176141432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 msgr2=0x557e49f2d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:15.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.345+0000 7fb2e8e00640 1 --2- 172.21.15.37:0/2176141432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 0x557e49f2d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.345+0000 7fb2e8e00640 1 -- 172.21.15.37:0/2176141432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f2e1f0 msgr2=0x557e49f2b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:15.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.345+0000 7fb2e8e00640 1 --2- 172.21.15.37:0/2176141432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f2e1f0 0x557e49f2b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.345+0000 7fb2e8e00640 1 -- 172.21.15.37:0/2176141432 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e49be6650 con 0x557e49f22260 2024-08-20T05:05:15.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.346+0000 7fb2e8e00640 1 --2- 172.21.15.37:0/2176141432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f22260 0x557e49f2ad00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00058c0 tx=0x7fb2d000f8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef0c0ff2c5a9bc95 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:15.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.346+0000 7fb2cea00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:05:15.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.347+0000 7fb2cea00640 1 -- 172.21.15.37:0/2176141432 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0005220 con 0x557e49f22260 2024-08-20T05:05:15.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.347+0000 7fb2ee468740 1 -- 172.21.15.37:0/2176141432 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2d4010850 con 0x557e49f22260 2024-08-20T05:05:15.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.347+0000 7fb2cea00640 1 -- 172.21.15.37:0/2176141432 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb2d00053c0 con 0x557e49f22260 2024-08-20T05:05:15.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.348+0000 7fb2cea00640 1 -- 172.21.15.37:0/2176141432 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb2d00055c0 con 0x557e49f22260 2024-08-20T05:05:15.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.348+0000 7fb2ee468740 10 client.26288 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:15.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.348+0000 7fb2ee468740 1 -- 172.21.15.37:0/2176141432 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557e49f44f10 con 0x557e49f22260 2024-08-20T05:05:15.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.348+0000 7fb2cea00640 1 -- 172.21.15.37:0/2176141432 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2d4010850 con 0x557e49f22260 2024-08-20T05:05:15.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.349+0000 7fb2cea00640 1 -- 172.21.15.37:0/2176141432 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fb2d0011b20 con 0x557e49f22260 2024-08-20T05:05:15.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.349+0000 7fb2ee468740 10 client.26288 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.349+0000 7fb2ee468740 10 client.26288 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:05:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.349+0000 7fb2ee468740 20 client.26288 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.349+0000 7fb2ee468740 1 --2- 172.21.15.37:0/2176141432 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x557e49f463c0 0x557e49f487b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.349+0000 7fb2ee468740 4 client.26288 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:05:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.349+0000 7fb2ee468740 1 -- 172.21.15.37:0/2176141432 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e49e999f0 con 0x557e49f463c0 2024-08-20T05:05:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.349+0000 7fb2e3e00640 1 --2- 172.21.15.37:0/2176141432 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x557e49f463c0 0x557e49f487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.350+0000 7fb2e3e00640 1 --2- 172.21.15.37:0/2176141432 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x557e49f463c0 0x557e49f487b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7d40423c167a671 server_cookie=5c85d9b23d18aa9a in_seq=0 out_seq=0 2024-08-20T05:05:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.350+0000 7fb2cea00640 10 client.26288 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:05:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.351+0000 7fb2cea00640 1 -- 172.21.15.37:0/2176141432 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557e49e999f0 con 0x557e49f463c0 2024-08-20T05:05:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.351+0000 7fb2cea00640 10 client.26288 handle_command_reply: tid=0 2024-08-20T05:05:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.351+0000 7fb2ee468740 1 client.26288 shutdown 2024-08-20T05:05:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.352+0000 7fb2ee468740 1 -- 172.21.15.37:0/2176141432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f22260 msgr2=0x557e49f2ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.352+0000 7fb2ee468740 1 --2- 172.21.15.37:0/2176141432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f22260 0x557e49f2ad00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00058c0 tx=0x7fb2d000f8c0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.352+0000 7fb2ee468740 1 -- 172.21.15.37:0/2176141432 shutdown_connections 2024-08-20T05:05:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.352+0000 7fb2ee468740 1 --2- 172.21.15.37:0/2176141432 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x557e49f463c0 0x557e49f487b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.352+0000 7fb2ee468740 1 --2- 172.21.15.37:0/2176141432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f2e1f0 0x557e49f2b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.352+0000 7fb2ee468740 1 --2- 172.21.15.37:0/2176141432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f22260 0x557e49f2ad00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.352+0000 7fb2ee468740 1 --2- 172.21.15.37:0/2176141432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 0x557e49f2d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.352+0000 7fb2ee468740 1 -- 172.21.15.37:0/2176141432 >> 172.21.15.37:0/2176141432 conn(0x557e49f1f770 msgr2=0x557e49f252e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:15.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.352+0000 7fb2cea00640 0 client.26288 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:05:15.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.355+0000 7fb2ee468740 1 -- 172.21.15.37:0/2176141432 shutdown_connections 2024-08-20T05:05:15.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.355+0000 7fb2ee468740 1 -- 172.21.15.37:0/2176141432 wait complete. 2024-08-20T05:05:15.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.355+0000 7fb2ee468740 20 client.26288 trim_cache size 0 max 16384 2024-08-20T05:05:15.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.379+0000 7fb2ee468740 1 Processor -- start 2024-08-20T05:05:15.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.379+0000 7fb2ee468740 1 -- start start 2024-08-20T05:05:15.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.380+0000 7fb2ee468740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 0x557e49f26370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.380+0000 7fb2ee468740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f2e1f0 0x557e49f4e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.380+0000 7fb2ee468740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f2b520 0x557e49f4e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.380+0000 7fb2ee468740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c400fc80 con 0x557e49f2e1f0 2024-08-20T05:05:15.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.380+0000 7fb2ee468740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c4011880 con 0x557e49f2b520 2024-08-20T05:05:15.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.380+0000 7fb2ee468740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c4010350 con 0x557e49f21940 2024-08-20T05:05:15.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.380+0000 7fb2e3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 0x557e49f26370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:15.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.380+0000 7fb2e3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 0x557e49f26370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34634/0 (socket says 172.21.15.37:34634) 2024-08-20T05:05:15.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.380+0000 7fb2e3e00640 1 -- 172.21.15.37:0/1291722209 learned_addr learned my addr 172.21.15.37:0/1291722209 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:15.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.380+0000 7fb2e3e00640 1 --2- 172.21.15.37:0/1291722209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f2b520 0x557e49f4e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:15.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.381+0000 7fb2e3e00640 1 -- 172.21.15.37:0/1291722209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f2b520 msgr2=0x557e49f4e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:15.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.381+0000 7fb2e3e00640 1 --2- 172.21.15.37:0/1291722209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f2b520 0x557e49f4e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.381+0000 7fb2e3e00640 1 -- 172.21.15.37:0/1291722209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f2e1f0 msgr2=0x557e49f4e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:15.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.381+0000 7fb2e3e00640 1 --2- 172.21.15.37:0/1291722209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f2e1f0 0x557e49f4e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.381+0000 7fb2e3e00640 1 -- 172.21.15.37:0/1291722209 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e49f48b20 con 0x557e49f21940 2024-08-20T05:05:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.381+0000 7fb2e3e00640 1 --2- 172.21.15.37:0/1291722209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 0x557e49f26370 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4016090 tx=0x7fb2d4043040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bd03979779d6ce server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.382+0000 7fb2d9600640 1 -- 172.21.15.37:0/1291722209 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d403a040 con 0x557e49f21940 2024-08-20T05:05:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.382+0000 7fb2d9600640 1 -- 172.21.15.37:0/1291722209 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2d4010d50 con 0x557e49f21940 2024-08-20T05:05:15.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.382+0000 7fb2d9600640 1 -- 172.21.15.37:0/1291722209 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d40116a0 con 0x557e49f21940 2024-08-20T05:05:15.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.383+0000 7fb2ee468740 1 -- 172.21.15.37:0/1291722209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 msgr2=0x557e49f26370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:15.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.383+0000 7fb2ee468740 1 --2- 172.21.15.37:0/1291722209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 0x557e49f26370 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4016090 tx=0x7fb2d4043040 comp rx=0 tx=0).stop 2024-08-20T05:05:15.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.383+0000 7fb2ee468740 1 -- 172.21.15.37:0/1291722209 shutdown_connections 2024-08-20T05:05:15.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.383+0000 7fb2ee468740 1 --2- 172.21.15.37:0/1291722209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f2b520 0x557e49f4e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.383+0000 7fb2ee468740 1 --2- 172.21.15.37:0/1291722209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f2e1f0 0x557e49f4e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.383+0000 7fb2ee468740 1 --2- 172.21.15.37:0/1291722209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 0x557e49f26370 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.383+0000 7fb2ee468740 1 -- 172.21.15.37:0/1291722209 >> 172.21.15.37:0/1291722209 conn(0x557e49f1f770 msgr2=0x557e49f25c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:15.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.383+0000 7fb2ee468740 1 -- 172.21.15.37:0/1291722209 shutdown_connections 2024-08-20T05:05:15.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.384+0000 7fb2ee468740 1 -- 172.21.15.37:0/1291722209 wait complete. 2024-08-20T05:05:15.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.384+0000 7fb2ee468740 1 -- start start 2024-08-20T05:05:15.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.384+0000 7fb2ee468740 1 Processor -- start 2024-08-20T05:05:15.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.385+0000 7fb2ee468740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 0x557e49f3aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.385+0000 7fb2ee468740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f2b520 0x557e49f3af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.385+0000 7fb2ee468740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f2e1f0 0x557e49f3b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.385+0000 7fb2ee468740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c40110f0 con 0x557e49f2e1f0 2024-08-20T05:05:15.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.385+0000 7fb2ee468740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c4010a20 con 0x557e49f2b520 2024-08-20T05:05:15.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.385+0000 7fb2ee468740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c400dc00 con 0x557e49f21940 2024-08-20T05:05:15.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.385+0000 7fb2ee468740 10 client.0 _ll_register_callbacks cb 0x7fb2d000a3d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:15.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.386+0000 7fb2e8e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f2b520 0x557e49f3af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:15.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.386+0000 7fb2e3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 0x557e49f3aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:15.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.386+0000 7fb2e8e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f2b520 0x557e49f3af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:41976/0 (socket says 172.21.15.37:41976) 2024-08-20T05:05:15.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.386+0000 7fb2e8e00640 1 -- 172.21.15.37:0/2283857479 learned_addr learned my addr 172.21.15.37:0/2283857479 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.387+0000 7fb2e3e00640 1 -- 172.21.15.37:0/2283857479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f2b520 msgr2=0x557e49f3af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.387+0000 7fb2e3e00640 1 --2- 172.21.15.37:0/2283857479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f2b520 0x557e49f3af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.387+0000 7fb2e3e00640 1 -- 172.21.15.37:0/2283857479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f2e1f0 msgr2=0x557e49f3b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.387+0000 7fb2e3e00640 1 --2- 172.21.15.37:0/2283857479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f2e1f0 0x557e49f3b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.387+0000 7fb2e3e00640 1 -- 172.21.15.37:0/2283857479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e49fb01d0 con 0x557e49f21940 2024-08-20T05:05:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.388+0000 7fb2e3e00640 1 --2- 172.21.15.37:0/2283857479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 0x557e49f3aa50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400dba0 tx=0x7fb2d400d6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f53d87bf6057039 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:15.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.388+0000 7fb2cea00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:05:15.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.389+0000 7fb2cea00640 1 -- 172.21.15.37:0/2283857479 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2d403a070 con 0x557e49f21940 2024-08-20T05:05:15.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.389+0000 7fb2cea00640 1 -- 172.21.15.37:0/2283857479 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb2d4010b50 con 0x557e49f21940 2024-08-20T05:05:15.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.389+0000 7fb2ee468740 1 -- 172.21.15.37:0/2283857479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2d4010d50 con 0x557e49f21940 2024-08-20T05:05:15.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.390+0000 7fb2cea00640 1 -- 172.21.15.37:0/2283857479 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb2d40050d0 con 0x557e49f21940 2024-08-20T05:05:15.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.390+0000 7fb2ee468740 10 client.26338 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:15.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.390+0000 7fb2ee468740 1 -- 172.21.15.37:0/2283857479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557e49fb14d0 con 0x557e49f21940 2024-08-20T05:05:15.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.390+0000 7fb2cea00640 1 -- 172.21.15.37:0/2283857479 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2d4010d50 con 0x557e49f21940 2024-08-20T05:05:15.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.390+0000 7fb2cea00640 1 -- 172.21.15.37:0/2283857479 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fb2d40035f0 con 0x557e49f21940 2024-08-20T05:05:15.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.390+0000 7fb2ee468740 10 client.26338 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:15.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.390+0000 7fb2ee468740 10 client.26338 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:05:15.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.390+0000 7fb2ee468740 20 client.26338 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.391+0000 7fb2ee468740 1 --2- 172.21.15.37:0/2283857479 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x557e49fb18b0 0x557e49fb3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.391+0000 7fb2ee468740 4 client.26338 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:05:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.391+0000 7fb2ee468740 1 -- 172.21.15.37:0/2283857479 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557e49e95490 con 0x557e49fb18b0 2024-08-20T05:05:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.391+0000 7fb2e8e00640 1 --2- 172.21.15.37:0/2283857479 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x557e49fb18b0 0x557e49fb3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.392+0000 7fb2e8e00640 1 --2- 172.21.15.37:0/2283857479 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x557e49fb18b0 0x557e49fb3cd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=493087c6fd836632 server_cookie=f97020ac7b25895c in_seq=0 out_seq=0 2024-08-20T05:05:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.392+0000 7fb2cea00640 10 client.26338 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:05:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.392+0000 7fb2cea00640 1 -- 172.21.15.37:0/2283857479 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557e49e95490 con 0x557e49fb18b0 2024-08-20T05:05:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.392+0000 7fb2cea00640 10 client.26338 handle_command_reply: tid=0 2024-08-20T05:05:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.392+0000 7fb2ee468740 1 client.26338 shutdown 2024-08-20T05:05:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.393+0000 7fb2ee468740 1 -- 172.21.15.37:0/2283857479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 msgr2=0x557e49f3aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.393+0000 7fb2ee468740 1 --2- 172.21.15.37:0/2283857479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 0x557e49f3aa50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb2d400dba0 tx=0x7fb2d400d6d0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.393+0000 7fb2ee468740 1 -- 172.21.15.37:0/2283857479 shutdown_connections 2024-08-20T05:05:15.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.393+0000 7fb2ee468740 1 --2- 172.21.15.37:0/2283857479 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x557e49fb18b0 0x557e49fb3cd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.393+0000 7fb2ee468740 1 --2- 172.21.15.37:0/2283857479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e49f2e1f0 0x557e49f3b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.393+0000 7fb2ee468740 1 --2- 172.21.15.37:0/2283857479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e49f2b520 0x557e49f3af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.393+0000 7fb2ee468740 1 --2- 172.21.15.37:0/2283857479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e49f21940 0x557e49f3aa50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.393+0000 7fb2ee468740 1 -- 172.21.15.37:0/2283857479 >> 172.21.15.37:0/2283857479 conn(0x557e49f1f770 msgr2=0x557e49f1e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:15.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.395+0000 7fb2cea00640 0 client.26338 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:05:15.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.395+0000 7fb2ee468740 1 -- 172.21.15.37:0/2283857479 shutdown_connections 2024-08-20T05:05:15.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.395+0000 7fb2ee468740 1 -- 172.21.15.37:0/2283857479 wait complete. 2024-08-20T05:05:15.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.395+0000 7fb2ee468740 20 client.26338 trim_cache size 0 max 16384 2024-08-20T05:05:15.399 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:05:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.397+0000 7fb2eb800640 1 -- 172.21.15.37:0/796832698 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2c80b3d60 msgr2=0x7fb2c80b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.397+0000 7fb2eb800640 1 --2- 172.21.15.37:0/796832698 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2c80b3d60 0x7fb2c80b6220 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc0ca2f0 tx=0x7fb2dc00aec0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.397+0000 7fb2eb800640 1 -- 172.21.15.37:0/796832698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2e410f950 msgr2=0x7fb2e41a6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.397+0000 7fb2eb800640 1 --2- 172.21.15.37:0/796832698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2e410f950 0x7fb2e41a6ff0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc035040 tx=0x7fb2dc007c80 comp rx=0 tx=0).stop 2024-08-20T05:05:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.397+0000 7fb2eb800640 1 -- 172.21.15.37:0/796832698 shutdown_connections 2024-08-20T05:05:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.397+0000 7fb2eb800640 1 --2- 172.21.15.37:0/796832698 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2c80b3d60 0x7fb2c80b6220 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.397+0000 7fb2eb800640 1 --2- 172.21.15.37:0/796832698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2e410f950 0x7fb2e41a6ff0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.397+0000 7fb2eb800640 1 --2- 172.21.15.37:0/796832698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e410efb0 0x7fb2e41a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.397+0000 7fb2eb800640 1 --2- 172.21.15.37:0/796832698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2e410a0e0 0x7fb2e41a1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.397+0000 7fb2eb800640 1 -- 172.21.15.37:0/796832698 >> 172.21.15.37:0/796832698 conn(0x7fb2e406dfe0 msgr2=0x7fb2e4073260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.398+0000 7fb2eb800640 1 -- 172.21.15.37:0/796832698 shutdown_connections 2024-08-20T05:05:15.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:15.399+0000 7fb2eb800640 1 -- 172.21.15.37:0/796832698 wait complete. 2024-08-20T05:05:15.476 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:15 smithi037 ceph-mon[17265]: pgmap v491: 129 pgs: 129 active+clean; 1022 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.2 MiB/s wr, 277 op/s 2024-08-20T05:05:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:15 smithi135 ceph-mon[22342]: pgmap v491: 129 pgs: 129 active+clean; 1022 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.2 MiB/s wr, 277 op/s 2024-08-20T05:05:15.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:15 smithi130 ceph-mon[22007]: pgmap v491: 129 pgs: 129 active+clean; 1022 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.2 MiB/s wr, 277 op/s 2024-08-20T05:05:16.473 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T05:05:17.118 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:05:17.756 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:17 smithi130 ceph-mon[22007]: pgmap v492: 129 pgs: 129 active+clean; 1022 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.1 MiB/s wr, 208 op/s 2024-08-20T05:05:17.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:17 smithi037 ceph-mon[17265]: pgmap v492: 129 pgs: 129 active+clean; 1022 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.1 MiB/s wr, 208 op/s 2024-08-20T05:05:17.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:17 smithi135 ceph-mon[22342]: pgmap v492: 129 pgs: 129 active+clean; 1022 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.1 MiB/s wr, 208 op/s 2024-08-20T05:05:18.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 140.0 s, 858.4 tps, lat 310.221 ms stddev 1355.228 2024-08-20T05:05:18.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.950+0000 7f5b96200640 1 -- 172.21.15.37:0/1923639813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b901090e0 msgr2=0x7f5b901094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:18.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.950+0000 7f5b96200640 1 --2- 172.21.15.37:0/1923639813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b901090e0 0x7f5b901094c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009860 tx=0x7f5b8002a340 comp rx=0 tx=0).stop 2024-08-20T05:05:18.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.950+0000 7f5b96200640 1 -- 172.21.15.37:0/1923639813 shutdown_connections 2024-08-20T05:05:18.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.950+0000 7f5b96200640 1 --2- 172.21.15.37:0/1923639813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9010f470 0x7f5b90115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:18.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.950+0000 7f5b96200640 1 --2- 172.21.15.37:0/1923639813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b9010eaf0 0x7f5b9010ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.950+0000 7f5b96200640 1 --2- 172.21.15.37:0/1923639813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b901090e0 0x7f5b901094c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.950+0000 7f5b96200640 1 -- 172.21.15.37:0/1923639813 >> 172.21.15.37:0/1923639813 conn(0x7f5b90078760 msgr2=0x7f5b9007ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.951+0000 7f5b96200640 1 -- 172.21.15.37:0/1923639813 shutdown_connections 2024-08-20T05:05:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.951+0000 7f5b96200640 1 -- 172.21.15.37:0/1923639813 wait complete. 2024-08-20T05:05:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.952+0000 7f5b96200640 1 Processor -- start 2024-08-20T05:05:18.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.952+0000 7f5b96200640 1 -- start start 2024-08-20T05:05:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.952+0000 7f5b96200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b901090e0 0x7f5b9019f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.952+0000 7f5b96200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9010eaf0 0x7f5b9019fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.952+0000 7f5b96200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b9010f470 0x7f5b901a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.952+0000 7f5b96200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5b901190d0 con 0x7f5b9010eaf0 2024-08-20T05:05:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.952+0000 7f5b96200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5b90118f50 con 0x7f5b9010f470 2024-08-20T05:05:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.952+0000 7f5b96200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5b90119250 con 0x7f5b901090e0 2024-08-20T05:05:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.953+0000 7f5b8fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b9010f470 0x7f5b901a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:18.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.953+0000 7f5b8f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b901090e0 0x7f5b9019f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.953+0000 7f5b8f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b901090e0 0x7f5b9019f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34668/0 (socket says 172.21.15.37:34668) 2024-08-20T05:05:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.953+0000 7f5b8f400640 1 -- 172.21.15.37:0/858609520 learned_addr learned my addr 172.21.15.37:0/858609520 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.953+0000 7f5b8ea00640 1 --2- 172.21.15.37:0/858609520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9010eaf0 0x7f5b9019fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.954+0000 7f5b8f400640 1 -- 172.21.15.37:0/858609520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b9010f470 msgr2=0x7f5b901a4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.954+0000 7f5b8f400640 1 --2- 172.21.15.37:0/858609520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b9010f470 0x7f5b901a4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.954+0000 7f5b8f400640 1 -- 172.21.15.37:0/858609520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9010eaf0 msgr2=0x7f5b9019fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.954+0000 7f5b8f400640 1 --2- 172.21.15.37:0/858609520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9010eaf0 0x7f5b9019fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.954+0000 7f5b8f400640 1 -- 172.21.15.37:0/858609520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b901a56b0 con 0x7f5b901090e0 2024-08-20T05:05:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.954+0000 7f5b8fe00640 1 --2- 172.21.15.37:0/858609520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b9010f470 0x7f5b901a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:05:18.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.954+0000 7f5b8ea00640 1 --2- 172.21.15.37:0/858609520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9010eaf0 0x7f5b9019fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.954+0000 7f5b8f400640 1 --2- 172.21.15.37:0/858609520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b901090e0 0x7f5b9019f600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5b8002a8b0 tx=0x7f5b80032e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.955+0000 7f5b87e00640 1 -- 172.21.15.37:0/858609520 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80042070 con 0x7f5b901090e0 2024-08-20T05:05:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.955+0000 7f5b87e00640 1 -- 172.21.15.37:0/858609520 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b80030450 con 0x7f5b901090e0 2024-08-20T05:05:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.955+0000 7f5b96200640 1 -- 172.21.15.37:0/858609520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b901a5940 con 0x7f5b901090e0 2024-08-20T05:05:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.955+0000 7f5b87e00640 1 -- 172.21.15.37:0/858609520 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80037040 con 0x7f5b901090e0 2024-08-20T05:05:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.955+0000 7f5b96200640 1 -- 172.21.15.37:0/858609520 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b901ac060 con 0x7f5b901090e0 2024-08-20T05:05:18.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.962+0000 7f5b87e00640 1 -- 172.21.15.37:0/858609520 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5b80005430 con 0x7f5b901090e0 2024-08-20T05:05:18.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.964+0000 7f5b87e00640 1 --2- 172.21.15.37:0/858609520 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5b740b3c90 0x7f5b740b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:18.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.964+0000 7f5b98e36740 1 Processor -- start 2024-08-20T05:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.965+0000 7f5b87e00640 1 -- 172.21.15.37:0/858609520 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5b801036e0 con 0x7f5b901090e0 2024-08-20T05:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.965+0000 7f5b98e36740 1 -- start start 2024-08-20T05:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.965+0000 7f5b98e36740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b8940 0x560d3b5b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:18.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.965+0000 7f5b98e36740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5b9260 0x560d3b5c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:18.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.965+0000 7f5b98e36740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5c51f0 0x560d3b5c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:18.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.965+0000 7f5b98e36740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560d3b52eaa0 con 0x560d3b5b9260 2024-08-20T05:05:18.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.965+0000 7f5b98e36740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560d3b51dfa0 con 0x560d3b5b8940 2024-08-20T05:05:18.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.965+0000 7f5b98e36740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560d3b521fe0 con 0x560d3b5c51f0 2024-08-20T05:05:18.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.965+0000 7f5b8ea00640 1 --2- 172.21.15.37:0/858609520 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5b740b3c90 0x7f5b740b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:18.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.966+0000 7f5b8f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b8940 0x560d3b5b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:18.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.966+0000 7f5b8f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b8940 0x560d3b5b8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42000/0 (socket says 172.21.15.37:42000) 2024-08-20T05:05:18.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.966+0000 7f5b8f400640 1 -- 172.21.15.37:0/2139235844 learned_addr learned my addr 172.21.15.37:0/2139235844 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:18.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.966+0000 7f5b8ea00640 1 --2- 172.21.15.37:0/2139235844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5b9260 0x560d3b5c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.966+0000 7f5b8f400640 1 -- 172.21.15.37:0/2139235844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5c51f0 msgr2=0x560d3b5c75e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:05:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.966+0000 7f5b8f400640 1 --2- 172.21.15.37:0/2139235844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5c51f0 0x560d3b5c75e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.966+0000 7f5b8f400640 1 -- 172.21.15.37:0/2139235844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5b9260 msgr2=0x560d3b5c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.966+0000 7f5b8f400640 1 --2- 172.21.15.37:0/2139235844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5b9260 0x560d3b5c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.966+0000 7f5b8f400640 1 -- 172.21.15.37:0/2139235844 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d3b4c4420 con 0x560d3b5b8940 2024-08-20T05:05:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.966+0000 7f5b8ea00640 1 --2- 172.21.15.37:0/2139235844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5b9260 0x560d3b5c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:05:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.966+0000 7f5b8f400640 1 --2- 172.21.15.37:0/2139235844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b8940 0x560d3b5b8d20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5b80035040 tx=0x7f5b8002a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5162fb002d0ee814 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.967+0000 7f5b7be00640 1 -- 172.21.15.37:0/2139235844 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b800c9da0 con 0x560d3b5b8940 2024-08-20T05:05:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.967+0000 7f5b7be00640 1 -- 172.21.15.37:0/2139235844 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b800ca990 con 0x560d3b5b8940 2024-08-20T05:05:18.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.967+0000 7f5b7be00640 1 -- 172.21.15.37:0/2139235844 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b80103530 con 0x560d3b5b8940 2024-08-20T05:05:18.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.968+0000 7f5b98e36740 1 -- 172.21.15.37:0/2139235844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b8940 msgr2=0x560d3b5b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:18.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.968+0000 7f5b98e36740 1 --2- 172.21.15.37:0/2139235844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b8940 0x560d3b5b8d20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5b80035040 tx=0x7f5b8002a340 comp rx=0 tx=0).stop 2024-08-20T05:05:18.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.968+0000 7f5b8ea00640 1 --2- 172.21.15.37:0/858609520 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5b740b3c90 0x7f5b740b6150 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x560d3b5b7650 tx=0x7f5b7c009ca0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:18.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.968+0000 7f5b98e36740 1 -- 172.21.15.37:0/2139235844 shutdown_connections 2024-08-20T05:05:18.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.968+0000 7f5b98e36740 1 --2- 172.21.15.37:0/2139235844 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5c51f0 0x560d3b5c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.968+0000 7f5b98e36740 1 --2- 172.21.15.37:0/2139235844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5b9260 0x560d3b5c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.968+0000 7f5b98e36740 1 --2- 172.21.15.37:0/2139235844 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b8940 0x560d3b5b8d20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.968+0000 7f5b98e36740 1 -- 172.21.15.37:0/2139235844 >> 172.21.15.37:0/2139235844 conn(0x560d3b5b6770 msgr2=0x560d3b5b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.968+0000 7f5b98e36740 1 -- 172.21.15.37:0/2139235844 shutdown_connections 2024-08-20T05:05:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.968+0000 7f5b98e36740 1 -- 172.21.15.37:0/2139235844 wait complete. 2024-08-20T05:05:18.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.969+0000 7f5b98e36740 1 -- start start 2024-08-20T05:05:18.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.969+0000 7f5b98e36740 1 Processor -- start 2024-08-20T05:05:18.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.970+0000 7f5b98e36740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b8940 0x560d3b5c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:18.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.970+0000 7f5b98e36740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5b9260 0x560d3b5c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:18.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.970+0000 7f5b98e36740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5c51f0 0x560d3b5c2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:18.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.970+0000 7f5b98e36740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560d3b380700 con 0x560d3b5c51f0 2024-08-20T05:05:18.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.970+0000 7f5b98e36740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560d3b4b9290 con 0x560d3b5b8940 2024-08-20T05:05:18.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.970+0000 7f5b98e36740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560d3b5c7c30 con 0x560d3b5b9260 2024-08-20T05:05:18.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.970+0000 7f5b98e36740 10 client.0 _ll_register_callbacks cb 0x560d3b5181c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:18.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.970+0000 7f5b8f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b8940 0x560d3b5c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:18.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.970+0000 7f5b8f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b8940 0x560d3b5c4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42008/0 (socket says 172.21.15.37:42008) 2024-08-20T05:05:18.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.970+0000 7f5b8f400640 1 -- 172.21.15.37:0/1863042110 learned_addr learned my addr 172.21.15.37:0/1863042110 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:18.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.970+0000 7f5b8fe00640 1 --2- 172.21.15.37:0/1863042110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5c51f0 0x560d3b5c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:18.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.971+0000 7f5b8ea00640 1 --2- 172.21.15.37:0/1863042110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5b9260 0x560d3b5c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:18.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.971+0000 7f5b8f400640 1 -- 172.21.15.37:0/1863042110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5b9260 msgr2=0x560d3b5c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:18.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.971+0000 7f5b8f400640 1 --2- 172.21.15.37:0/1863042110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5b9260 0x560d3b5c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:18.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.971+0000 7f5b8f400640 1 -- 172.21.15.37:0/1863042110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5c51f0 msgr2=0x560d3b5c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:18.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.971+0000 7f5b8f400640 1 --2- 172.21.15.37:0/1863042110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5c51f0 0x560d3b5c2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:18.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.971+0000 7f5b8f400640 1 -- 172.21.15.37:0/1863042110 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d3b27d650 con 0x560d3b5b8940 2024-08-20T05:05:18.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.971+0000 7f5b8ea00640 1 --2- 172.21.15.37:0/1863042110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5b9260 0x560d3b5c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:18.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.972+0000 7f5b8f400640 1 --2- 172.21.15.37:0/1863042110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b8940 0x560d3b5c4a80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009830 tx=0x7f5b80030e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4af1d0356772e370 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:18.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.972+0000 7f5b78c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:05:18.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.972+0000 7f5b78c00640 1 -- 172.21.15.37:0/1863042110 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b800ce890 con 0x560d3b5b8940 2024-08-20T05:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.972+0000 7f5b78c00640 1 -- 172.21.15.37:0/1863042110 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5b800d2eb0 con 0x560d3b5b8940 2024-08-20T05:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.972+0000 7f5b98e36740 1 -- 172.21.15.37:0/1863042110 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b800ca990 con 0x560d3b5b8940 2024-08-20T05:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.972+0000 7f5b78c00640 1 -- 172.21.15.37:0/1863042110 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5b800d30b0 con 0x560d3b5b8940 2024-08-20T05:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.973+0000 7f5b98e36740 10 client.26306 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.973+0000 7f5b98e36740 1 -- 172.21.15.37:0/1863042110 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560d3b5d3440 con 0x560d3b5b8940 2024-08-20T05:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.973+0000 7f5b78c00640 1 -- 172.21.15.37:0/1863042110 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b800ca990 con 0x560d3b5b8940 2024-08-20T05:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.973+0000 7f5b78c00640 1 -- 172.21.15.37:0/1863042110 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f5b800c9190 con 0x560d3b5b8940 2024-08-20T05:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.973+0000 7f5b98e36740 10 client.26306 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.973+0000 7f5b98e36740 10 client.26306 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.973+0000 7f5b98e36740 20 client.26306 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.973+0000 7f5b98e36740 1 --2- 172.21.15.37:0/1863042110 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x560d3b5d4790 0x560d3b5d6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.973+0000 7f5b98e36740 4 client.26306 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:05:18.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.973+0000 7f5b98e36740 1 -- 172.21.15.37:0/1863042110 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d3b5309f0 con 0x560d3b5d4790 2024-08-20T05:05:18.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.974+0000 7f5b8ea00640 1 --2- 172.21.15.37:0/1863042110 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x560d3b5d4790 0x560d3b5d6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:18.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.975+0000 7f5b8ea00640 1 --2- 172.21.15.37:0/1863042110 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x560d3b5d4790 0x560d3b5d6b80 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d68963d751d18f58 server_cookie=7818c614648782dc in_seq=0 out_seq=0 2024-08-20T05:05:18.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.975+0000 7f5b78c00640 10 client.26306 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:05:18.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.976+0000 7f5b78c00640 1 -- 172.21.15.37:0/1863042110 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560d3b5309f0 con 0x560d3b5d4790 2024-08-20T05:05:18.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.976+0000 7f5b78c00640 10 client.26306 handle_command_reply: tid=0 2024-08-20T05:05:18.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.976+0000 7f5b98e36740 1 client.26306 shutdown 2024-08-20T05:05:18.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.978+0000 7f5b98e36740 1 -- 172.21.15.37:0/1863042110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b8940 msgr2=0x560d3b5c4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:18.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.978+0000 7f5b98e36740 1 --2- 172.21.15.37:0/1863042110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b8940 0x560d3b5c4a80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5b80009830 tx=0x7f5b80030e90 comp rx=0 tx=0).stop 2024-08-20T05:05:18.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.978+0000 7f5b98e36740 1 -- 172.21.15.37:0/1863042110 shutdown_connections 2024-08-20T05:05:18.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.978+0000 7f5b98e36740 1 --2- 172.21.15.37:0/1863042110 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x560d3b5d4790 0x560d3b5d6b80 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.978+0000 7f5b98e36740 1 --2- 172.21.15.37:0/1863042110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5c51f0 0x560d3b5c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.978+0000 7f5b98e36740 1 --2- 172.21.15.37:0/1863042110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5b9260 0x560d3b5c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.978+0000 7f5b98e36740 1 --2- 172.21.15.37:0/1863042110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b8940 0x560d3b5c4a80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.978+0000 7f5b98e36740 1 -- 172.21.15.37:0/1863042110 >> 172.21.15.37:0/1863042110 conn(0x560d3b5b6770 msgr2=0x560d3b5bc310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.978+0000 7f5b78c00640 0 client.26306 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:05:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.979+0000 7f5b98e36740 1 -- 172.21.15.37:0/1863042110 shutdown_connections 2024-08-20T05:05:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.979+0000 7f5b98e36740 1 -- 172.21.15.37:0/1863042110 wait complete. 2024-08-20T05:05:18.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:18.980+0000 7f5b98e36740 20 client.26306 trim_cache size 0 max 16384 2024-08-20T05:05:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.001+0000 7f5b98e36740 1 Processor -- start 2024-08-20T05:05:19.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.001+0000 7f5b98e36740 1 -- start start 2024-08-20T05:05:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.002+0000 7f5b98e36740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5b8940 0x560d3b5b5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.002+0000 7f5b98e36740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5b9260 0x560d3b5b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.002+0000 7f5b98e36740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5c51f0 0x560d3b5dc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.002+0000 7f5b98e36740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5b901b5e30 con 0x560d3b5b9260 2024-08-20T05:05:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.002+0000 7f5b98e36740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5b901b7a30 con 0x560d3b5c51f0 2024-08-20T05:05:19.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.002+0000 7f5b98e36740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5b901b6500 con 0x560d3b5b8940 2024-08-20T05:05:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.002+0000 7f5b8fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5c51f0 0x560d3b5dc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.002+0000 7f5b8fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5c51f0 0x560d3b5dc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42016/0 (socket says 172.21.15.37:42016) 2024-08-20T05:05:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.002+0000 7f5b8fe00640 1 -- 172.21.15.37:0/501246979 learned_addr learned my addr 172.21.15.37:0/501246979 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.002+0000 7f5b8f400640 1 --2- 172.21.15.37:0/501246979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5b8940 0x560d3b5b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.003+0000 7f5b8ea00640 1 --2- 172.21.15.37:0/501246979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5b9260 0x560d3b5b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.003+0000 7f5b8fe00640 1 -- 172.21.15.37:0/501246979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5b8940 msgr2=0x560d3b5b5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:19.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.003+0000 7f5b8fe00640 1 --2- 172.21.15.37:0/501246979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5b8940 0x560d3b5b5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:19.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.003+0000 7f5b8fe00640 1 -- 172.21.15.37:0/501246979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5b9260 msgr2=0x560d3b5b5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:19.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.003+0000 7f5b8fe00640 1 --2- 172.21.15.37:0/501246979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5b9260 0x560d3b5b5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:19.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.003+0000 7f5b8fe00640 1 -- 172.21.15.37:0/501246979 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d3b5b61c0 con 0x560d3b5c51f0 2024-08-20T05:05:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.003+0000 7f5b8fe00640 1 --2- 172.21.15.37:0/501246979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5c51f0 0x560d3b5dc310 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009f40 tx=0x7f5b880138f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8333044907f4b5d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.004+0000 7f5b7b400640 1 -- 172.21.15.37:0/501246979 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b88004d20 con 0x560d3b5c51f0 2024-08-20T05:05:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.004+0000 7f5b7b400640 1 -- 172.21.15.37:0/501246979 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b88011950 con 0x560d3b5c51f0 2024-08-20T05:05:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.004+0000 7f5b7b400640 1 -- 172.21.15.37:0/501246979 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8801ba20 con 0x560d3b5c51f0 2024-08-20T05:05:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.005+0000 7f5b98e36740 1 -- 172.21.15.37:0/501246979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5c51f0 msgr2=0x560d3b5dc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.005+0000 7f5b98e36740 1 --2- 172.21.15.37:0/501246979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5c51f0 0x560d3b5dc310 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009f40 tx=0x7f5b880138f0 comp rx=0 tx=0).stop 2024-08-20T05:05:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.005+0000 7f5b98e36740 1 -- 172.21.15.37:0/501246979 shutdown_connections 2024-08-20T05:05:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.005+0000 7f5b98e36740 1 --2- 172.21.15.37:0/501246979 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5c51f0 0x560d3b5dc310 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.005+0000 7f5b98e36740 1 --2- 172.21.15.37:0/501246979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5b9260 0x560d3b5b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.005+0000 7f5b98e36740 1 --2- 172.21.15.37:0/501246979 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5b8940 0x560d3b5b5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.005+0000 7f5b98e36740 1 -- 172.21.15.37:0/501246979 >> 172.21.15.37:0/501246979 conn(0x560d3b5b6770 msgr2=0x560d3b5b5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:19.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.005+0000 7f5b98e36740 1 -- 172.21.15.37:0/501246979 shutdown_connections 2024-08-20T05:05:19.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.005+0000 7f5b98e36740 1 -- 172.21.15.37:0/501246979 wait complete. 2024-08-20T05:05:19.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.005+0000 7f5b98e36740 1 -- start start 2024-08-20T05:05:19.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.006+0000 7f5b98e36740 1 Processor -- start 2024-08-20T05:05:19.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.006+0000 7f5b98e36740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5b8940 0x560d3b5cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:19.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.006+0000 7f5b98e36740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b9260 0x560d3b5ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:19.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.006+0000 7f5b98e36740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5c51f0 0x560d3b5cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:19.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.006+0000 7f5b98e36740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5b901b72a0 con 0x560d3b5c51f0 2024-08-20T05:05:19.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.006+0000 7f5b98e36740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5b901b6bd0 con 0x560d3b5b9260 2024-08-20T05:05:19.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.006+0000 7f5b98e36740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5b901b3e10 con 0x560d3b5b8940 2024-08-20T05:05:19.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.007+0000 7f5b98e36740 10 client.0 _ll_register_callbacks cb 0x7f5b800ca060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:19.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.007+0000 7f5b8ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b9260 0x560d3b5ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:19.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.007+0000 7f5b8f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5b8940 0x560d3b5cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:19.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.007+0000 7f5b8ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b9260 0x560d3b5ca830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42022/0 (socket says 172.21.15.37:42022) 2024-08-20T05:05:19.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.007+0000 7f5b8ea00640 1 -- 172.21.15.37:0/2815301097 learned_addr learned my addr 172.21.15.37:0/2815301097 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:19.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.007+0000 7f5b8fe00640 1 --2- 172.21.15.37:0/2815301097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5c51f0 0x560d3b5cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:19.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.008+0000 7f5b8ea00640 1 -- 172.21.15.37:0/2815301097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5b8940 msgr2=0x560d3b5cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:19.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.008+0000 7f5b8ea00640 1 --2- 172.21.15.37:0/2815301097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5b8940 0x560d3b5cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:19.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.008+0000 7f5b8ea00640 1 -- 172.21.15.37:0/2815301097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5c51f0 msgr2=0x560d3b5cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:19.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.008+0000 7f5b8ea00640 1 --2- 172.21.15.37:0/2815301097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5c51f0 0x560d3b5cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:19.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.008+0000 7f5b8ea00640 1 -- 172.21.15.37:0/2815301097 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d3b5cb330 con 0x560d3b5b9260 2024-08-20T05:05:19.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.008+0000 7f5b8ea00640 1 --2- 172.21.15.37:0/2815301097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b9260 0x560d3b5ca830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5b9010e6f0 tx=0x7f5b7c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9b686e6f5cdef0c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:19.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.008+0000 7f5b78c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:05:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.008+0000 7f5b8f400640 1 --2- 172.21.15.37:0/2815301097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5b8940 0x560d3b5cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:05:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.008+0000 7f5b78c00640 1 -- 172.21.15.37:0/2815301097 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c004020 con 0x560d3b5b9260 2024-08-20T05:05:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.008+0000 7f5b78c00640 1 -- 172.21.15.37:0/2815301097 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5b7c0041c0 con 0x560d3b5b9260 2024-08-20T05:05:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.009+0000 7f5b98e36740 1 -- 172.21.15.37:0/2815301097 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b88011950 con 0x560d3b5b9260 2024-08-20T05:05:19.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.009+0000 7f5b78c00640 1 -- 172.21.15.37:0/2815301097 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5b7c03b050 con 0x560d3b5b9260 2024-08-20T05:05:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.009+0000 7f5b98e36740 10 client.26312 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.009+0000 7f5b98e36740 1 -- 172.21.15.37:0/2815301097 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560d3b63f110 con 0x560d3b5b9260 2024-08-20T05:05:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.010+0000 7f5b78c00640 1 -- 172.21.15.37:0/2815301097 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b88011950 con 0x560d3b5b9260 2024-08-20T05:05:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.010+0000 7f5b78c00640 1 -- 172.21.15.37:0/2815301097 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f5b7c01b040 con 0x560d3b5b9260 2024-08-20T05:05:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.010+0000 7f5b98e36740 10 client.26312 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.010+0000 7f5b98e36740 10 client.26312 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:05:19.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.010+0000 7f5b98e36740 20 client.26312 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.011+0000 7f5b98e36740 1 --2- 172.21.15.37:0/2815301097 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x560d3b63f8f0 0x560d3b641d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.011+0000 7f5b98e36740 4 client.26312 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:05:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.011+0000 7f5b98e36740 1 -- 172.21.15.37:0/2815301097 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560d3b52c490 con 0x560d3b63f8f0 2024-08-20T05:05:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.011+0000 7f5b8f400640 1 --2- 172.21.15.37:0/2815301097 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x560d3b63f8f0 0x560d3b641d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:19.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.012+0000 7f5b78c00640 10 client.26312 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:05:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.013+0000 7f5b8f400640 1 --2- 172.21.15.37:0/2815301097 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x560d3b63f8f0 0x560d3b641d10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fbefd74f8e85c00a server_cookie=74747a894463953 in_seq=0 out_seq=0 2024-08-20T05:05:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.013+0000 7f5b78c00640 1 -- 172.21.15.37:0/2815301097 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560d3b52c490 con 0x560d3b63f8f0 2024-08-20T05:05:19.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.013+0000 7f5b78c00640 10 client.26312 handle_command_reply: tid=0 2024-08-20T05:05:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.013+0000 7f5b98e36740 1 client.26312 shutdown 2024-08-20T05:05:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.014+0000 7f5b98e36740 1 -- 172.21.15.37:0/2815301097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b9260 msgr2=0x560d3b5ca830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.014+0000 7f5b98e36740 1 --2- 172.21.15.37:0/2815301097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b9260 0x560d3b5ca830 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5b9010e6f0 tx=0x7f5b7c009260 comp rx=0 tx=0).stop 2024-08-20T05:05:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.015+0000 7f5b98e36740 1 -- 172.21.15.37:0/2815301097 shutdown_connections 2024-08-20T05:05:19.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.015+0000 7f5b98e36740 1 --2- 172.21.15.37:0/2815301097 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x560d3b63f8f0 0x560d3b641d10 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.015+0000 7f5b98e36740 1 --2- 172.21.15.37:0/2815301097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560d3b5c51f0 0x560d3b5cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.015+0000 7f5b98e36740 1 --2- 172.21.15.37:0/2815301097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560d3b5b9260 0x560d3b5ca830 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.015+0000 7f5b98e36740 1 --2- 172.21.15.37:0/2815301097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560d3b5b8940 0x560d3b5cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.015+0000 7f5b98e36740 1 -- 172.21.15.37:0/2815301097 >> 172.21.15.37:0/2815301097 conn(0x560d3b5b6770 msgr2=0x560d3b5b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.015+0000 7f5b78c00640 0 client.26312 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:05:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.015+0000 7f5b98e36740 1 -- 172.21.15.37:0/2815301097 shutdown_connections 2024-08-20T05:05:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.015+0000 7f5b98e36740 1 -- 172.21.15.37:0/2815301097 wait complete. 2024-08-20T05:05:19.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.015+0000 7f5b98e36740 20 client.26312 trim_cache size 0 max 16384 2024-08-20T05:05:19.018 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:05:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.017+0000 7f5b96200640 1 -- 172.21.15.37:0/858609520 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5b740b3c90 msgr2=0x7f5b740b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.017+0000 7f5b96200640 1 --2- 172.21.15.37:0/858609520 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5b740b3c90 0x7f5b740b6150 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x560d3b5b7650 tx=0x7f5b7c009ca0 comp rx=0 tx=0).stop 2024-08-20T05:05:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.017+0000 7f5b96200640 1 -- 172.21.15.37:0/858609520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b901090e0 msgr2=0x7f5b9019f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.017+0000 7f5b96200640 1 --2- 172.21.15.37:0/858609520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b901090e0 0x7f5b9019f600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5b8002a8b0 tx=0x7f5b80032e10 comp rx=0 tx=0).stop 2024-08-20T05:05:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.017+0000 7f5b96200640 1 -- 172.21.15.37:0/858609520 shutdown_connections 2024-08-20T05:05:19.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.017+0000 7f5b96200640 1 --2- 172.21.15.37:0/858609520 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5b740b3c90 0x7f5b740b6150 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.017+0000 7f5b96200640 1 --2- 172.21.15.37:0/858609520 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5b9010f470 0x7f5b901a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.017+0000 7f5b96200640 1 --2- 172.21.15.37:0/858609520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b9010eaf0 0x7f5b9019fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.017+0000 7f5b96200640 1 --2- 172.21.15.37:0/858609520 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5b901090e0 0x7f5b9019f600 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.017+0000 7f5b96200640 1 -- 172.21.15.37:0/858609520 >> 172.21.15.37:0/858609520 conn(0x7f5b90078760 msgr2=0x7f5b90079080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.017+0000 7f5b96200640 1 -- 172.21.15.37:0/858609520 shutdown_connections 2024-08-20T05:05:19.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:19.017+0000 7f5b96200640 1 -- 172.21.15.37:0/858609520 wait complete. 2024-08-20T05:05:19.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:19 smithi037 ceph-mon[17265]: pgmap v493: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.2 MiB/s wr, 149 op/s 2024-08-20T05:05:19.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:19 smithi135 ceph-mon[22342]: pgmap v493: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.2 MiB/s wr, 149 op/s 2024-08-20T05:05:19.951 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T05:05:19.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:19 smithi130 ceph-mon[22007]: pgmap v493: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.2 MiB/s wr, 149 op/s 2024-08-20T05:05:20.582 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:05:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.304+0000 7f6f2d000640 1 -- 172.21.15.37:0/4026548006 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f28075b30 msgr2=0x7f6f2810e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.304+0000 7f6f2d000640 1 --2- 172.21.15.37:0/4026548006 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f28075b30 0x7f6f2810e9d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009900 tx=0x7f6f1402a420 comp rx=0 tx=0).stop 2024-08-20T05:05:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.305+0000 7f6f2d000640 1 -- 172.21.15.37:0/4026548006 shutdown_connections 2024-08-20T05:05:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.305+0000 7f6f2d000640 1 --2- 172.21.15.37:0/4026548006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f2810ef10 0x7f6f28111300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.305+0000 7f6f2d000640 1 --2- 172.21.15.37:0/4026548006 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f28075b30 0x7f6f2810e9d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.305+0000 7f6f2d000640 1 --2- 172.21.15.37:0/4026548006 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f28075210 0x7f6f280755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.305+0000 7f6f2d000640 1 -- 172.21.15.37:0/4026548006 >> 172.21.15.37:0/4026548006 conn(0x7f6f280fe350 msgr2=0x7f6f28100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.306+0000 7f6f2d000640 1 -- 172.21.15.37:0/4026548006 shutdown_connections 2024-08-20T05:05:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.306+0000 7f6f2d000640 1 -- 172.21.15.37:0/4026548006 wait complete. 2024-08-20T05:05:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.307+0000 7f6f2d000640 1 Processor -- start 2024-08-20T05:05:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.308+0000 7f6f2d000640 1 -- start start 2024-08-20T05:05:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.308+0000 7f6f2d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f28075210 0x7f6f2810e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.308+0000 7f6f2d000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f28075b30 0x7f6f2810e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.308+0000 7f6f2d000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f2810ef10 0x7f6f28108630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.308+0000 7f6f2d000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2806d160 con 0x7f6f28075210 2024-08-20T05:05:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.308+0000 7f6f2d000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2806cfe0 con 0x7f6f28075b30 2024-08-20T05:05:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.308+0000 7f6f2d000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2806d2e0 con 0x7f6f2810ef10 2024-08-20T05:05:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.309+0000 7f6f27e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f2810ef10 0x7f6f28108630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.309+0000 7f6f27e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f2810ef10 0x7f6f28108630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34718/0 (socket says 172.21.15.37:34718) 2024-08-20T05:05:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.309+0000 7f6f27e00640 1 -- 172.21.15.37:0/2974216105 learned_addr learned my addr 172.21.15.37:0/2974216105 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.309+0000 7f6f27400640 1 --2- 172.21.15.37:0/2974216105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f28075210 0x7f6f2810e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.309+0000 7f6f26a00640 1 --2- 172.21.15.37:0/2974216105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f28075b30 0x7f6f2810e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.309+0000 7f6f27e00640 1 -- 172.21.15.37:0/2974216105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f28075b30 msgr2=0x7f6f2810e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.309+0000 7f6f27e00640 1 --2- 172.21.15.37:0/2974216105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f28075b30 0x7f6f2810e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.309+0000 7f6f27e00640 1 -- 172.21.15.37:0/2974216105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f28075210 msgr2=0x7f6f2810e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:21.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.309+0000 7f6f27e00640 1 --2- 172.21.15.37:0/2974216105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f28075210 0x7f6f2810e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.309+0000 7f6f27e00640 1 -- 172.21.15.37:0/2974216105 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f28108ef0 con 0x7f6f2810ef10 2024-08-20T05:05:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.309+0000 7f6f27e00640 1 --2- 172.21.15.37:0/2974216105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f2810ef10 0x7f6f28108630 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000eb40 tx=0x7f6f2000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.310+0000 7f6f1fe00640 1 -- 172.21.15.37:0/2974216105 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20004b20 con 0x7f6f2810ef10 2024-08-20T05:05:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.310+0000 7f6f1fe00640 1 -- 172.21.15.37:0/2974216105 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f20004cc0 con 0x7f6f2810ef10 2024-08-20T05:05:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.310+0000 7f6f1fe00640 1 -- 172.21.15.37:0/2974216105 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20018760 con 0x7f6f2810ef10 2024-08-20T05:05:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.310+0000 7f6f2d000640 1 -- 172.21.15.37:0/2974216105 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f281091e0 con 0x7f6f2810ef10 2024-08-20T05:05:21.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.310+0000 7f6f2d000640 1 -- 172.21.15.37:0/2974216105 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f281b01a0 con 0x7f6f2810ef10 2024-08-20T05:05:21.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.315+0000 7f6f311d5740 1 Processor -- start 2024-08-20T05:05:21.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.316+0000 7f6f1fe00640 1 -- 172.21.15.37:0/2974216105 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6f20005560 con 0x7f6f2810ef10 2024-08-20T05:05:21.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.316+0000 7f6f311d5740 1 -- start start 2024-08-20T05:05:21.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.317+0000 7f6f311d5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc63ac0 0x56072dc63ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.317+0000 7f6f311d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc643e0 0x56072dc6fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.317+0000 7f6f311d5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc70370 0x56072dc72760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.317+0000 7f6f311d5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56072dbd9aa0 con 0x56072dc70370 2024-08-20T05:05:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.317+0000 7f6f311d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56072dbc8fa0 con 0x56072dc643e0 2024-08-20T05:05:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.317+0000 7f6f311d5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56072dbccfe0 con 0x56072dc63ac0 2024-08-20T05:05:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.317+0000 7f6f26a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc63ac0 0x56072dc63ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.317+0000 7f6f26a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc63ac0 0x56072dc63ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34726/0 (socket says 172.21.15.37:34726) 2024-08-20T05:05:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.317+0000 7f6f26a00640 1 -- 172.21.15.37:0/3885175861 learned_addr learned my addr 172.21.15.37:0/3885175861 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.318+0000 7f6f26a00640 1 -- 172.21.15.37:0/3885175861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc643e0 msgr2=0x56072dc6fe30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:05:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.318+0000 7f6f26a00640 1 --2- 172.21.15.37:0/3885175861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc643e0 0x56072dc6fe30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.318+0000 7f6f26a00640 1 -- 172.21.15.37:0/3885175861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc70370 msgr2=0x56072dc72760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.318+0000 7f6f26a00640 1 --2- 172.21.15.37:0/3885175861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc70370 0x56072dc72760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.318+0000 7f6f26a00640 1 -- 172.21.15.37:0/3885175861 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072db6f420 con 0x56072dc63ac0 2024-08-20T05:05:21.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.318+0000 7f6f26a00640 1 --2- 172.21.15.37:0/3885175861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc63ac0 0x56072dc63ea0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6f140057a0 tx=0x7f6f14004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6e7429815f0c6ec server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:21.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.318+0000 7f6f1fe00640 1 --2- 172.21.15.37:0/2974216105 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6f0c0b3d40 0x7f6f0c0b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.318+0000 7f6f1cc00640 1 -- 172.21.15.37:0/3885175861 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14035040 con 0x56072dc63ac0 2024-08-20T05:05:21.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.318+0000 7f6f1cc00640 1 -- 172.21.15.37:0/3885175861 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f14042070 con 0x56072dc63ac0 2024-08-20T05:05:21.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.318+0000 7f6f1cc00640 1 -- 172.21.15.37:0/3885175861 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14004db0 con 0x56072dc63ac0 2024-08-20T05:05:21.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.318+0000 7f6f1fe00640 1 -- 172.21.15.37:0/2974216105 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6f200e4740 con 0x7f6f2810ef10 2024-08-20T05:05:21.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.318+0000 7f6f27400640 1 --2- 172.21.15.37:0/2974216105 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6f0c0b3d40 0x7f6f0c0b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:21.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.319+0000 7f6f311d5740 1 -- 172.21.15.37:0/3885175861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc63ac0 msgr2=0x56072dc63ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:21.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.319+0000 7f6f311d5740 1 --2- 172.21.15.37:0/3885175861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc63ac0 0x56072dc63ea0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6f140057a0 tx=0x7f6f14004040 comp rx=0 tx=0).stop 2024-08-20T05:05:21.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.320+0000 7f6f311d5740 1 -- 172.21.15.37:0/3885175861 shutdown_connections 2024-08-20T05:05:21.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.320+0000 7f6f311d5740 1 --2- 172.21.15.37:0/3885175861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc70370 0x56072dc72760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.320+0000 7f6f311d5740 1 --2- 172.21.15.37:0/3885175861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc643e0 0x56072dc6fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.320+0000 7f6f311d5740 1 --2- 172.21.15.37:0/3885175861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc63ac0 0x56072dc63ea0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.320+0000 7f6f311d5740 1 -- 172.21.15.37:0/3885175861 >> 172.21.15.37:0/3885175861 conn(0x56072dc618f0 msgr2=0x56072dc62a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.321+0000 7f6f27400640 1 --2- 172.21.15.37:0/2974216105 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6f0c0b3d40 0x7f6f0c0b6200 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x56072dc627d0 tx=0x7f6f18005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.321+0000 7f6f311d5740 1 -- 172.21.15.37:0/3885175861 shutdown_connections 2024-08-20T05:05:21.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.321+0000 7f6f311d5740 1 -- 172.21.15.37:0/3885175861 wait complete. 2024-08-20T05:05:21.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.322+0000 7f6f311d5740 1 -- start start 2024-08-20T05:05:21.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.323+0000 7f6f311d5740 1 Processor -- start 2024-08-20T05:05:21.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.325+0000 7f6f311d5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 0x56072dc6fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.325+0000 7f6f311d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc643e0 0x56072dc6d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.325+0000 7f6f311d5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc70370 0x56072dc6d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.325+0000 7f6f311d5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56072da2b700 con 0x56072dc63ac0 2024-08-20T05:05:21.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.325+0000 7f6f311d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56072db64290 con 0x56072dc643e0 2024-08-20T05:05:21.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.325+0000 7f6f311d5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56072dc7b710 con 0x56072dc70370 2024-08-20T05:05:21.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.325+0000 7f6f311d5740 10 client.0 _ll_register_callbacks cb 0x56072dbc31c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.326+0000 7f6f26a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc643e0 0x56072dc6d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.326+0000 7f6f27400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 0x56072dc6fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.327+0000 7f6f26a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc643e0 0x56072dc6d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42066/0 (socket says 172.21.15.37:42066) 2024-08-20T05:05:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.327+0000 7f6f26a00640 1 -- 172.21.15.37:0/3708949626 learned_addr learned my addr 172.21.15.37:0/3708949626 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:21.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.326+0000 7f6f27e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc70370 0x56072dc6d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.328+0000 7f6f27e00640 1 -- 172.21.15.37:0/3708949626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc643e0 msgr2=0x56072dc6d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.328+0000 7f6f27e00640 1 --2- 172.21.15.37:0/3708949626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc643e0 0x56072dc6d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.328+0000 7f6f27e00640 1 -- 172.21.15.37:0/3708949626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 msgr2=0x56072dc6fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.328+0000 7f6f27e00640 1 --2- 172.21.15.37:0/3708949626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 0x56072dc6fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.328+0000 7f6f27e00640 1 -- 172.21.15.37:0/3708949626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56072d928650 con 0x56072dc70370 2024-08-20T05:05:21.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.328+0000 7f6f27400640 1 --2- 172.21.15.37:0/3708949626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 0x56072dc6fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:21.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.329+0000 7f6f27e00640 1 --2- 172.21.15.37:0/3708949626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc70370 0x56072dc6d600 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c7d0 tx=0x7f6f200aab00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90544ce2dbb8c235 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:21.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.329+0000 7f6f11600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:05:21.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.329+0000 7f6f11600640 1 -- 172.21.15.37:0/3708949626 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f200c4030 con 0x56072dc70370 2024-08-20T05:05:21.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.329+0000 7f6f11600640 1 -- 172.21.15.37:0/3708949626 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6f200a7880 con 0x56072dc70370 2024-08-20T05:05:21.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.329+0000 7f6f311d5740 1 -- 172.21.15.37:0/3708949626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f14042070 con 0x56072dc70370 2024-08-20T05:05:21.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.330+0000 7f6f11600640 1 -- 172.21.15.37:0/3708949626 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6f200af890 con 0x56072dc70370 2024-08-20T05:05:21.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.330+0000 7f6f311d5740 10 client.26365 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:21.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.330+0000 7f6f311d5740 1 -- 172.21.15.37:0/3708949626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56072dc870f0 con 0x56072dc70370 2024-08-20T05:05:21.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.330+0000 7f6f11600640 1 -- 172.21.15.37:0/3708949626 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f14042070 con 0x56072dc70370 2024-08-20T05:05:21.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.330+0000 7f6f11600640 1 -- 172.21.15.37:0/3708949626 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f6f20020030 con 0x56072dc70370 2024-08-20T05:05:21.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.331+0000 7f6f311d5740 10 client.26365 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:21.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.331+0000 7f6f311d5740 10 client.26365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:05:21.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.331+0000 7f6f311d5740 20 client.26365 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:21.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.331+0000 7f6f311d5740 1 --2- 172.21.15.37:0/3708949626 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56072dc885a0 0x56072dc8aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.331+0000 7f6f311d5740 4 client.26365 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:05:21.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.331+0000 7f6f311d5740 1 -- 172.21.15.37:0/3708949626 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56072dbdb9f0 con 0x56072dc885a0 2024-08-20T05:05:21.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.333+0000 7f6f27400640 1 --2- 172.21.15.37:0/3708949626 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56072dc885a0 0x56072dc8aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:21.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.333+0000 7f6f27400640 1 --2- 172.21.15.37:0/3708949626 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56072dc885a0 0x56072dc8aa00 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a57134e9c0cf7ee3 server_cookie=f733d9d07d767779 in_seq=0 out_seq=0 2024-08-20T05:05:21.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.333+0000 7f6f11600640 10 client.26365 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:21.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.334+0000 7f6f11600640 1 -- 172.21.15.37:0/3708949626 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56072dbdb9f0 con 0x56072dc885a0 2024-08-20T05:05:21.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.334+0000 7f6f11600640 10 client.26365 handle_command_reply: tid=0 2024-08-20T05:05:21.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.334+0000 7f6f311d5740 1 client.26365 shutdown 2024-08-20T05:05:21.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.334+0000 7f6f311d5740 1 -- 172.21.15.37:0/3708949626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc70370 msgr2=0x56072dc6d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:21.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.335+0000 7f6f311d5740 1 --2- 172.21.15.37:0/3708949626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc70370 0x56072dc6d600 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000c7d0 tx=0x7f6f200aab00 comp rx=0 tx=0).stop 2024-08-20T05:05:21.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.335+0000 7f6f311d5740 1 -- 172.21.15.37:0/3708949626 shutdown_connections 2024-08-20T05:05:21.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.335+0000 7f6f311d5740 1 --2- 172.21.15.37:0/3708949626 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56072dc885a0 0x56072dc8aa00 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.335+0000 7f6f11600640 0 client.26365 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:21.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.335+0000 7f6f311d5740 1 --2- 172.21.15.37:0/3708949626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc70370 0x56072dc6d600 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.335+0000 7f6f311d5740 1 --2- 172.21.15.37:0/3708949626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc643e0 0x56072dc6d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.335+0000 7f6f311d5740 1 --2- 172.21.15.37:0/3708949626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 0x56072dc6fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.335+0000 7f6f311d5740 1 -- 172.21.15.37:0/3708949626 >> 172.21.15.37:0/3708949626 conn(0x56072dc618f0 msgr2=0x56072dc67460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:21.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.335+0000 7f6f311d5740 1 -- 172.21.15.37:0/3708949626 shutdown_connections 2024-08-20T05:05:21.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.335+0000 7f6f311d5740 1 -- 172.21.15.37:0/3708949626 wait complete. 2024-08-20T05:05:21.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.335+0000 7f6f311d5740 20 client.26365 trim_cache size 0 max 16384 2024-08-20T05:05:21.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.360+0000 7f6f311d5740 1 Processor -- start 2024-08-20T05:05:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.360+0000 7f6f311d5740 1 -- start start 2024-08-20T05:05:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.361+0000 7f6f311d5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 0x56072dc6e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.361+0000 7f6f311d5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc643e0 0x56072dc902d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.361+0000 7f6f311d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc70370 0x56072dc90810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.361+0000 7f6f311d5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6f281b5a60 con 0x56072dc63ac0 2024-08-20T05:05:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.361+0000 7f6f311d5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6f281b7660 con 0x56072dc70370 2024-08-20T05:05:21.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.361+0000 7f6f311d5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f281b6130 con 0x56072dc643e0 2024-08-20T05:05:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.362+0000 7f6f27400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 0x56072dc6e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.362+0000 7f6f27400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 0x56072dc6e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50676/0 (socket says 172.21.15.37:50676) 2024-08-20T05:05:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.362+0000 7f6f27400640 1 -- 172.21.15.37:0/3918724211 learned_addr learned my addr 172.21.15.37:0/3918724211 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.362+0000 7f6f26a00640 1 --2- 172.21.15.37:0/3918724211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc643e0 0x56072dc902d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.362+0000 7f6f26a00640 1 -- 172.21.15.37:0/3918724211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc70370 msgr2=0x56072dc90810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.362+0000 7f6f26a00640 1 --2- 172.21.15.37:0/3918724211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc70370 0x56072dc90810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.362+0000 7f6f26a00640 1 -- 172.21.15.37:0/3918724211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 msgr2=0x56072dc6e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.362+0000 7f6f26a00640 1 --2- 172.21.15.37:0/3918724211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 0x56072dc6e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.362+0000 7f6f26a00640 1 -- 172.21.15.37:0/3918724211 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56072dc6f470 con 0x56072dc643e0 2024-08-20T05:05:21.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.362+0000 7f6f27400640 1 --2- 172.21.15.37:0/3918724211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 0x56072dc6e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:21.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.363+0000 7f6f26a00640 1 --2- 172.21.15.37:0/3918724211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc643e0 0x56072dc902d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009900 tx=0x7f6f14005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=651beac2833513ae server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:21.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.363+0000 7f6f13e00640 1 -- 172.21.15.37:0/3918724211 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14035040 con 0x56072dc643e0 2024-08-20T05:05:21.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.363+0000 7f6f13e00640 1 -- 172.21.15.37:0/3918724211 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f1404b030 con 0x56072dc643e0 2024-08-20T05:05:21.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.363+0000 7f6f13e00640 1 -- 172.21.15.37:0/3918724211 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14004dd0 con 0x56072dc643e0 2024-08-20T05:05:21.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.364+0000 7f6f311d5740 1 -- 172.21.15.37:0/3918724211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc643e0 msgr2=0x56072dc902d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:21.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.364+0000 7f6f311d5740 1 --2- 172.21.15.37:0/3918724211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc643e0 0x56072dc902d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009900 tx=0x7f6f14005c00 comp rx=0 tx=0).stop 2024-08-20T05:05:21.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.364+0000 7f6f311d5740 1 -- 172.21.15.37:0/3918724211 shutdown_connections 2024-08-20T05:05:21.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.364+0000 7f6f311d5740 1 --2- 172.21.15.37:0/3918724211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc70370 0x56072dc90810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.364+0000 7f6f311d5740 1 --2- 172.21.15.37:0/3918724211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc643e0 0x56072dc902d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.364+0000 7f6f311d5740 1 --2- 172.21.15.37:0/3918724211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 0x56072dc6e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.364+0000 7f6f311d5740 1 -- 172.21.15.37:0/3918724211 >> 172.21.15.37:0/3918724211 conn(0x56072dc618f0 msgr2=0x56072dc60ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:21.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.365+0000 7f6f311d5740 1 -- 172.21.15.37:0/3918724211 shutdown_connections 2024-08-20T05:05:21.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.365+0000 7f6f311d5740 1 -- 172.21.15.37:0/3918724211 wait complete. 2024-08-20T05:05:21.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.365+0000 7f6f311d5740 1 -- start start 2024-08-20T05:05:21.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.366+0000 7f6f311d5740 1 Processor -- start 2024-08-20T05:05:21.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.366+0000 7f6f311d5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 0x56072dc7e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.366+0000 7f6f311d5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc643e0 0x56072dc7e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.367+0000 7f6f26a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc643e0 0x56072dc7e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:21.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.367+0000 7f6f26a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc643e0 0x56072dc7e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42092/0 (socket says 172.21.15.37:42092) 2024-08-20T05:05:21.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.366+0000 7f6f311d5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc70370 0x56072dcea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.367+0000 7f6f26a00640 1 -- 172.21.15.37:0/4201438418 learned_addr learned my addr 172.21.15.37:0/4201438418 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:21.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.367+0000 7f6f27400640 1 --2- 172.21.15.37:0/4201438418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 0x56072dc7e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:21.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.367+0000 7f6f311d5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6f281b6ed0 con 0x56072dc63ac0 2024-08-20T05:05:21.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.367+0000 7f6f311d5740 1 -- 172.21.15.37:0/4201438418 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6f281b6800 con 0x56072dc643e0 2024-08-20T05:05:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.367+0000 7f6f311d5740 1 -- 172.21.15.37:0/4201438418 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6f281b3a60 con 0x56072dc70370 2024-08-20T05:05:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.367+0000 7f6f311d5740 10 client.0 _ll_register_callbacks cb 0x7f6f2000ceb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.368+0000 7f6f27e00640 1 --2- 172.21.15.37:0/4201438418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc70370 0x56072dcea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.368+0000 7f6f26a00640 1 -- 172.21.15.37:0/4201438418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc70370 msgr2=0x56072dcea2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.368+0000 7f6f26a00640 1 --2- 172.21.15.37:0/4201438418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc70370 0x56072dcea2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.368+0000 7f6f26a00640 1 -- 172.21.15.37:0/4201438418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 msgr2=0x56072dc7e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.368+0000 7f6f26a00640 1 --2- 172.21.15.37:0/4201438418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 0x56072dc7e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.368+0000 7f6f26a00640 1 -- 172.21.15.37:0/4201438418 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56072dceaa10 con 0x56072dc643e0 2024-08-20T05:05:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.368+0000 7f6f27400640 1 --2- 172.21.15.37:0/4201438418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 0x56072dc7e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.369+0000 7f6f26a00640 1 --2- 172.21.15.37:0/4201438418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc643e0 0x56072dc7e9e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6f1403f040 tx=0x7f6f14003b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=267cb1626ed158c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:21.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.369+0000 7f6f11600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:05:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.369+0000 7f6f11600640 1 -- 172.21.15.37:0/4201438418 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14035070 con 0x56072dc643e0 2024-08-20T05:05:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.369+0000 7f6f311d5740 1 -- 172.21.15.37:0/4201438418 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f1404b030 con 0x56072dc643e0 2024-08-20T05:05:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.369+0000 7f6f11600640 1 -- 172.21.15.37:0/4201438418 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6f14003d70 con 0x56072dc643e0 2024-08-20T05:05:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.369+0000 7f6f11600640 1 -- 172.21.15.37:0/4201438418 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6f14060050 con 0x56072dc643e0 2024-08-20T05:05:21.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.370+0000 7f6f311d5740 10 client.26321 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:21.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.370+0000 7f6f311d5740 1 -- 172.21.15.37:0/4201438418 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56072dcf2f60 con 0x56072dc643e0 2024-08-20T05:05:21.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.370+0000 7f6f11600640 1 -- 172.21.15.37:0/4201438418 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f1404b030 con 0x56072dc643e0 2024-08-20T05:05:21.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.370+0000 7f6f11600640 1 -- 172.21.15.37:0/4201438418 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f6f1403a030 con 0x56072dc643e0 2024-08-20T05:05:21.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.371+0000 7f6f311d5740 10 client.26321 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:21.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.371+0000 7f6f311d5740 10 client.26321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:05:21.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.371+0000 7f6f311d5740 20 client.26321 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:21.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.371+0000 7f6f311d5740 1 --2- 172.21.15.37:0/4201438418 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56072dcf3190 0x56072dcf55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:21.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.371+0000 7f6f311d5740 4 client.26321 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:05:21.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.371+0000 7f6f311d5740 1 -- 172.21.15.37:0/4201438418 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56072dbd7490 con 0x56072dcf3190 2024-08-20T05:05:21.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.372+0000 7f6f27400640 1 --2- 172.21.15.37:0/4201438418 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56072dcf3190 0x56072dcf55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:21.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.374+0000 7f6f27400640 1 --2- 172.21.15.37:0/4201438418 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56072dcf3190 0x56072dcf55b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3fffbf005ee6fcb server_cookie=54130bb78c81a661 in_seq=0 out_seq=0 2024-08-20T05:05:21.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.374+0000 7f6f11600640 10 client.26321 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:21.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.376+0000 7f6f11600640 1 -- 172.21.15.37:0/4201438418 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56072dbd7490 con 0x56072dcf3190 2024-08-20T05:05:21.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.376+0000 7f6f11600640 10 client.26321 handle_command_reply: tid=0 2024-08-20T05:05:21.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.376+0000 7f6f311d5740 1 client.26321 shutdown 2024-08-20T05:05:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.377+0000 7f6f311d5740 1 -- 172.21.15.37:0/4201438418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc643e0 msgr2=0x56072dc7e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.377+0000 7f6f311d5740 1 --2- 172.21.15.37:0/4201438418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc643e0 0x56072dc7e9e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6f1403f040 tx=0x7f6f14003b80 comp rx=0 tx=0).stop 2024-08-20T05:05:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.378+0000 7f6f311d5740 1 -- 172.21.15.37:0/4201438418 shutdown_connections 2024-08-20T05:05:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.378+0000 7f6f311d5740 1 --2- 172.21.15.37:0/4201438418 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56072dcf3190 0x56072dcf55b0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.378+0000 7f6f311d5740 1 --2- 172.21.15.37:0/4201438418 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56072dc70370 0x56072dcea2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.378+0000 7f6f311d5740 1 --2- 172.21.15.37:0/4201438418 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56072dc643e0 0x56072dc7e9e0 secure :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6f1403f040 tx=0x7f6f14003b80 comp rx=0 tx=0).stop 2024-08-20T05:05:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.378+0000 7f6f311d5740 1 --2- 172.21.15.37:0/4201438418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56072dc63ac0 0x56072dc7e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.378+0000 7f6f311d5740 1 -- 172.21.15.37:0/4201438418 >> 172.21.15.37:0/4201438418 conn(0x56072dc618f0 msgr2=0x56072dc60ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:21.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.378+0000 7f6f11600640 0 client.26321 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:21.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.378+0000 7f6f311d5740 1 -- 172.21.15.37:0/4201438418 shutdown_connections 2024-08-20T05:05:21.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.379+0000 7f6f311d5740 1 -- 172.21.15.37:0/4201438418 wait complete. 2024-08-20T05:05:21.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.379+0000 7f6f311d5740 20 client.26321 trim_cache size 0 max 16384 2024-08-20T05:05:21.382 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:05:21.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.380+0000 7f6f2d000640 1 -- 172.21.15.37:0/2974216105 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6f0c0b3d40 msgr2=0x7f6f0c0b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:21.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.380+0000 7f6f2d000640 1 --2- 172.21.15.37:0/2974216105 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6f0c0b3d40 0x7f6f0c0b6200 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x56072dc627d0 tx=0x7f6f18005f90 comp rx=0 tx=0).stop 2024-08-20T05:05:21.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.380+0000 7f6f2d000640 1 -- 172.21.15.37:0/2974216105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f2810ef10 msgr2=0x7f6f28108630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:21.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.380+0000 7f6f2d000640 1 --2- 172.21.15.37:0/2974216105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f2810ef10 0x7f6f28108630 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000eb40 tx=0x7f6f2000c2d0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.380+0000 7f6f2d000640 1 -- 172.21.15.37:0/2974216105 shutdown_connections 2024-08-20T05:05:21.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.380+0000 7f6f2d000640 1 --2- 172.21.15.37:0/2974216105 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6f0c0b3d40 0x7f6f0c0b6200 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.380+0000 7f6f2d000640 1 --2- 172.21.15.37:0/2974216105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6f2810ef10 0x7f6f28108630 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.380+0000 7f6f2d000640 1 --2- 172.21.15.37:0/2974216105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6f28075b30 0x7f6f2810e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.380+0000 7f6f2d000640 1 --2- 172.21.15.37:0/2974216105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f28075210 0x7f6f2810e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:21.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.380+0000 7f6f2d000640 1 -- 172.21.15.37:0/2974216105 >> 172.21.15.37:0/2974216105 conn(0x7f6f280fe350 msgr2=0x7f6f280fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:21.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.381+0000 7f6f2d000640 1 -- 172.21.15.37:0/2974216105 shutdown_connections 2024-08-20T05:05:21.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:21.381+0000 7f6f2d000640 1 -- 172.21.15.37:0/2974216105 wait complete. 2024-08-20T05:05:21.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:21 smithi037 ceph-mon[17265]: pgmap v494: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.1 MiB/s wr, 287 op/s 2024-08-20T05:05:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:21 smithi135 ceph-mon[22342]: pgmap v494: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.1 MiB/s wr, 287 op/s 2024-08-20T05:05:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:21 smithi130 ceph-mon[22007]: pgmap v494: 129 pgs: 129 active+clean; 1.0 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.1 MiB/s wr, 287 op/s 2024-08-20T05:05:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 145.0 s, 1066.8 tps, lat 92.776 ms stddev 116.693 2024-08-20T05:05:23.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:23 smithi037 ceph-mon[17265]: pgmap v495: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.4 MiB/s wr, 324 op/s 2024-08-20T05:05:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:23 smithi135 ceph-mon[22342]: pgmap v495: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.4 MiB/s wr, 324 op/s 2024-08-20T05:05:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:23 smithi130 ceph-mon[22007]: pgmap v495: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.4 MiB/s wr, 324 op/s 2024-08-20T05:05:25.017 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T05:05:25.018 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T05:05:25.510 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:25 smithi037 ceph-mon[17265]: pgmap v496: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 422 op/s 2024-08-20T05:05:25.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.741+0000 7f7bf3200640 1 -- 172.21.15.37:0/2076566097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bec09bb20 msgr2=0x7f7bec09bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.741+0000 7f7bf3200640 1 --2- 172.21.15.37:0/2076566097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bec09bb20 0x7f7bec09bf20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009900 tx=0x7f7be402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.742+0000 7f7bf3200640 1 -- 172.21.15.37:0/2076566097 shutdown_connections 2024-08-20T05:05:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.742+0000 7f7bf3200640 1 --2- 172.21.15.37:0/2076566097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bec09d630 0x7f7bec0a3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.742+0000 7f7bf3200640 1 --2- 172.21.15.37:0/2076566097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bec09cc70 0x7f7bec09d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.742+0000 7f7bf3200640 1 --2- 172.21.15.37:0/2076566097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bec09bb20 0x7f7bec09bf20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.742+0000 7f7bf3200640 1 -- 172.21.15.37:0/2076566097 >> 172.21.15.37:0/2076566097 conn(0x7f7bec00ae90 msgr2=0x7f7bec00d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.742+0000 7f7bf3200640 1 -- 172.21.15.37:0/2076566097 shutdown_connections 2024-08-20T05:05:25.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.743+0000 7f7bf3200640 1 -- 172.21.15.37:0/2076566097 wait complete. 2024-08-20T05:05:25.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.744+0000 7f7bf3200640 1 Processor -- start 2024-08-20T05:05:25.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.745+0000 7f7bf3200640 1 -- start start 2024-08-20T05:05:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.746+0000 7f7bf3200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bec09bb20 0x7f7bec131e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.746+0000 7f7bf3200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bec09cc70 0x7f7bec132490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.746+0000 7f7bf3200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bec09d630 0x7f7bec1330c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.746+0000 7f7bf3200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec0a77e0 con 0x7f7bec09bb20 2024-08-20T05:05:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.746+0000 7f7bf3200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec0a7660 con 0x7f7bec09d630 2024-08-20T05:05:25.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.746+0000 7f7bf3200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec0a7960 con 0x7f7bec09cc70 2024-08-20T05:05:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.748+0000 7f7bf1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bec09cc70 0x7f7bec132490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.748+0000 7f7bf1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bec09cc70 0x7f7bec132490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:37648/0 (socket says 172.21.15.37:37648) 2024-08-20T05:05:25.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.748+0000 7f7bf1400640 1 -- 172.21.15.37:0/2726645775 learned_addr learned my addr 172.21.15.37:0/2726645775 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.748+0000 7f7bf1400640 1 -- 172.21.15.37:0/2726645775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bec09d630 msgr2=0x7f7bec1330c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T05:05:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.748+0000 7f7bf1400640 1 --2- 172.21.15.37:0/2726645775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bec09d630 0x7f7bec1330c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.748+0000 7f7bf1400640 1 -- 172.21.15.37:0/2726645775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bec09bb20 msgr2=0x7f7bec131e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.748+0000 7f7bf1400640 1 --2- 172.21.15.37:0/2726645775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bec09bb20 0x7f7bec131e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.748+0000 7f7bf1400640 1 -- 172.21.15.37:0/2726645775 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bec133980 con 0x7f7bec09cc70 2024-08-20T05:05:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.749+0000 7f7bf1400640 1 --2- 172.21.15.37:0/2726645775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bec09cc70 0x7f7bec132490 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7be000ea60 tx=0x7f7be000ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:25.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.749+0000 7f7beaa00640 1 -- 172.21.15.37:0/2726645775 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be000cde0 con 0x7f7bec09cc70 2024-08-20T05:05:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.749+0000 7f7beaa00640 1 -- 172.21.15.37:0/2726645775 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7be00035f0 con 0x7f7bec09cc70 2024-08-20T05:05:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.749+0000 7f7beaa00640 1 -- 172.21.15.37:0/2726645775 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be000cde0 con 0x7f7bec09cc70 2024-08-20T05:05:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.750+0000 7f7bf3200640 1 -- 172.21.15.37:0/2726645775 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bec133c70 con 0x7f7bec09cc70 2024-08-20T05:05:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.750+0000 7f7bf3200640 1 -- 172.21.15.37:0/2726645775 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bec133f00 con 0x7f7bec09cc70 2024-08-20T05:05:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.767+0000 7f7bfb9c7740 1 Processor -- start 2024-08-20T05:05:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.767+0000 7f7bfb9c7740 1 -- start start 2024-08-20T05:05:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.768+0000 7f7beaa00640 1 -- 172.21.15.37:0/2726645775 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7be0004020 con 0x7f7bec09cc70 2024-08-20T05:05:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.769+0000 7f7bfb9c7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948a7f0 0x56041948cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.769+0000 7f7bfb9c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56041948d120 0x56041948f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.769+0000 7f7bfb9c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56041948fb60 0x560419492020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.769+0000 7f7bfb9c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5604193fd210 con 0x56041948d120 2024-08-20T05:05:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.769+0000 7f7bfb9c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5604193ec710 con 0x56041948fb60 2024-08-20T05:05:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.769+0000 7f7bfb9c7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5604193f0750 con 0x56041948a7f0 2024-08-20T05:05:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.769+0000 7f7bf1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56041948fb60 0x560419492020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.769+0000 7f7bf2800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948a7f0 0x56041948cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.770+0000 7f7bf1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56041948fb60 0x560419492020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:34318/0 (socket says 172.21.15.37:34318) 2024-08-20T05:05:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.770+0000 7f7bf1400640 1 -- 172.21.15.37:0/1439575266 learned_addr learned my addr 172.21.15.37:0/1439575266 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.771+0000 7f7bf1e00640 1 --2- 172.21.15.37:0/1439575266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56041948d120 0x56041948f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.772+0000 7f7bf1400640 1 -- 172.21.15.37:0/1439575266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948a7f0 msgr2=0x56041948cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.772+0000 7f7bf1400640 1 --2- 172.21.15.37:0/1439575266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948a7f0 0x56041948cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.772+0000 7f7bf1400640 1 -- 172.21.15.37:0/1439575266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56041948d120 msgr2=0x56041948f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.772+0000 7f7bf1400640 1 --2- 172.21.15.37:0/1439575266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56041948d120 0x56041948f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.772+0000 7f7bf1400640 1 -- 172.21.15.37:0/1439575266 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604193b8de0 con 0x56041948fb60 2024-08-20T05:05:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.772+0000 7f7beaa00640 1 --2- 172.21.15.37:0/2726645775 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bd80b3ea0 0x7f7bd80b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.772+0000 7f7bf1400640 1 --2- 172.21.15.37:0/1439575266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56041948fb60 0x560419492020 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7be00ec160 tx=0x7f7be00e7f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d0fbd8fb48f4427 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.773+0000 7f7bdf000640 1 -- 172.21.15.37:0/1439575266 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be00f7070 con 0x56041948fb60 2024-08-20T05:05:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.773+0000 7f7beaa00640 1 -- 172.21.15.37:0/2726645775 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7be00e3fb0 con 0x7f7bec09cc70 2024-08-20T05:05:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.773+0000 7f7bdf000640 1 -- 172.21.15.37:0/1439575266 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7be009b2f0 con 0x56041948fb60 2024-08-20T05:05:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.773+0000 7f7bdf000640 1 -- 172.21.15.37:0/1439575266 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be00f7070 con 0x56041948fb60 2024-08-20T05:05:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.774+0000 7f7bf1e00640 1 --2- 172.21.15.37:0/1439575266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56041948d120 0x56041948f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:05:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.774+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/1439575266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56041948fb60 msgr2=0x560419492020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.774+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/1439575266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56041948fb60 0x560419492020 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7be00ec160 tx=0x7f7be00e7f90 comp rx=0 tx=0).stop 2024-08-20T05:05:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.775+0000 7f7bf2800640 1 --2- 172.21.15.37:0/2726645775 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bd80b3ea0 0x7f7bd80b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.775+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/1439575266 shutdown_connections 2024-08-20T05:05:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.775+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/1439575266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56041948fb60 0x560419492020 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.775+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/1439575266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56041948d120 0x56041948f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.775+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/1439575266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948a7f0 0x56041948cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.775+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/1439575266 >> 172.21.15.37:0/1439575266 conn(0x560419485940 msgr2=0x5604194866d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.775+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/1439575266 shutdown_connections 2024-08-20T05:05:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.776+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/1439575266 wait complete. 2024-08-20T05:05:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.776+0000 7f7bfb9c7740 1 -- start start 2024-08-20T05:05:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.777+0000 7f7bf2800640 1 --2- 172.21.15.37:0/2726645775 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bd80b3ea0 0x7f7bd80b6360 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4068b40 tx=0x7f7bf4051270 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.777+0000 7f7bfb9c7740 1 Processor -- start 2024-08-20T05:05:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.777+0000 7f7bfb9c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56041948a7f0 0x560419494090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.777+0000 7f7bfb9c7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948d120 0x560419494730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.777+0000 7f7bfb9c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604194952e0 0x560419495760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.777+0000 7f7bfb9c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560419325ab0 con 0x5604194952e0 2024-08-20T05:05:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.777+0000 7f7bfb9c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560419393140 con 0x56041948a7f0 2024-08-20T05:05:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.777+0000 7f7bfb9c7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560419492b40 con 0x56041948d120 2024-08-20T05:05:25.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.778+0000 7f7bfb9c7740 10 client.0 _ll_register_callbacks cb 0x5604193a65d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:25.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.778+0000 7f7bf1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948d120 0x560419494730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:25.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.778+0000 7f7bf1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948d120 0x560419494730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:37666/0 (socket says 172.21.15.37:37666) 2024-08-20T05:05:25.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.778+0000 7f7bf1400640 1 -- 172.21.15.37:0/335648977 learned_addr learned my addr 172.21.15.37:0/335648977 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:25.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.778+0000 7f7bf1e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56041948a7f0 0x560419494090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:25.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.779+0000 7f7bf1400640 1 -- 172.21.15.37:0/335648977 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56041948a7f0 msgr2=0x560419494090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:25.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.779+0000 7f7bf2800640 1 --2- 172.21.15.37:0/335648977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604194952e0 0x560419495760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:25.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.779+0000 7f7bf1400640 1 --2- 172.21.15.37:0/335648977 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56041948a7f0 0x560419494090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.779+0000 7f7bf1400640 1 -- 172.21.15.37:0/335648977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604194952e0 msgr2=0x560419495760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:25.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.779+0000 7f7bf1400640 1 --2- 172.21.15.37:0/335648977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604194952e0 0x560419495760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.779+0000 7f7bf1400640 1 -- 172.21.15.37:0/335648977 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560419394170 con 0x56041948d120 2024-08-20T05:05:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.779+0000 7f7bf1400640 1 --2- 172.21.15.37:0/335648977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948d120 0x560419494730 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7be00e1760 tx=0x7f7be00e42b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cf131a94a248406 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.779+0000 7f7bd3400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:05:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.779+0000 7f7bd3400640 1 -- 172.21.15.37:0/335648977 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be0000ed0 con 0x56041948d120 2024-08-20T05:05:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.780+0000 7f7bd3400640 1 -- 172.21.15.37:0/335648977 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7be00037a0 con 0x56041948d120 2024-08-20T05:05:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.780+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/335648977 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7be009b2f0 con 0x56041948d120 2024-08-20T05:05:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.780+0000 7f7bd3400640 1 -- 172.21.15.37:0/335648977 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7be00aa930 con 0x56041948d120 2024-08-20T05:05:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.780+0000 7f7bfb9c7740 10 client.26383 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.780+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/335648977 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56041914f790 con 0x56041948d120 2024-08-20T05:05:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.780+0000 7f7bf2800640 1 --2- 172.21.15.37:0/335648977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604194952e0 0x560419495760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:05:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.781+0000 7f7bd3400640 1 -- 172.21.15.37:0/335648977 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7be009b2f0 con 0x56041948d120 2024-08-20T05:05:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.781+0000 7f7bd3400640 1 -- 172.21.15.37:0/335648977 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f7be00a6df0 con 0x56041948d120 2024-08-20T05:05:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.781+0000 7f7bfb9c7740 10 client.26383 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.781+0000 7f7bfb9c7740 10 client.26383 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:05:25.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.781+0000 7f7bfb9c7740 20 client.26383 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:25.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.781+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/335648977 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56041949fbf0 0x5604194a1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.781+0000 7f7bfb9c7740 4 client.26383 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:05:25.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.781+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/335648977 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604193ff160 con 0x56041949fbf0 2024-08-20T05:05:25.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.782+0000 7f7bf1e00640 1 --2- 172.21.15.37:0/335648977 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56041949fbf0 0x5604194a1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:25.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.782+0000 7f7bd3400640 10 client.26383 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:25.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.783+0000 7f7bf1e00640 1 --2- 172.21.15.37:0/335648977 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56041949fbf0 0x5604194a1fe0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f2533d96a4ba7bf server_cookie=c126ffc5ca2b5634 in_seq=0 out_seq=0 2024-08-20T05:05:25.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.784+0000 7f7bd3400640 1 -- 172.21.15.37:0/335648977 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604193ff160 con 0x56041949fbf0 2024-08-20T05:05:25.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.784+0000 7f7bd3400640 10 client.26383 handle_command_reply: tid=0 2024-08-20T05:05:25.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.784+0000 7f7bfb9c7740 1 client.26383 shutdown 2024-08-20T05:05:25.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.785+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/335648977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948d120 msgr2=0x560419494730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:25.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.785+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/335648977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948d120 0x560419494730 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7be00e1760 tx=0x7f7be00e42b0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.785+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/335648977 shutdown_connections 2024-08-20T05:05:25.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.785+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/335648977 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56041949fbf0 0x5604194a1fe0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.785+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/335648977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604194952e0 0x560419495760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.785+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/335648977 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948d120 0x560419494730 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.785+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/335648977 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56041948a7f0 0x560419494090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.785+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/335648977 >> 172.21.15.37:0/335648977 conn(0x560419485940 msgr2=0x5604194849b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:25.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.785+0000 7f7bd3400640 0 client.26383 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:25.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.786+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/335648977 shutdown_connections 2024-08-20T05:05:25.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.786+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/335648977 wait complete. 2024-08-20T05:05:25.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.787+0000 7f7bfb9c7740 20 client.26383 trim_cache size 0 max 16384 2024-08-20T05:05:25.826 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:05:25.837 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.835+0000 7f7bfb9c7740 1 Processor -- start 2024-08-20T05:05:25.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.835+0000 7f7bfb9c7740 1 -- start start 2024-08-20T05:05:25.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.836+0000 7f7bfb9c7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948a7f0 0x5604194808b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.836+0000 7f7bfb9c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56041948d120 0x560419484190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.836+0000 7f7bfb9c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604194952e0 0x5604194846d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.836+0000 7f7bfb9c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec144870 con 0x56041948d120 2024-08-20T05:05:25.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.836+0000 7f7bfb9c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec146470 con 0x5604194952e0 2024-08-20T05:05:25.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.836+0000 7f7bfb9c7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec144f40 con 0x56041948a7f0 2024-08-20T05:05:25.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.837+0000 7f7bf1e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948a7f0 0x5604194808b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:25.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.837+0000 7f7bf2800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604194952e0 0x5604194846d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:25.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.837+0000 7f7bf2800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604194952e0 0x5604194846d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:34338/0 (socket says 172.21.15.37:34338) 2024-08-20T05:05:25.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.837+0000 7f7bf2800640 1 -- 172.21.15.37:0/1261966856 learned_addr learned my addr 172.21.15.37:0/1261966856 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:25.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.837+0000 7f7bf1e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948a7f0 0x5604194808b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:37672/0 (socket says 172.21.15.37:37672) 2024-08-20T05:05:25.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.838+0000 7f7bf1e00640 1 -- 172.21.15.37:0/1261966856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604194952e0 msgr2=0x5604194846d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:25.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.838+0000 7f7bf1e00640 1 --2- 172.21.15.37:0/1261966856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604194952e0 0x5604194846d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.838+0000 7f7bf1e00640 1 -- 172.21.15.37:0/1261966856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56041948d120 msgr2=0x560419484190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:25.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.838+0000 7f7bf1e00640 1 --2- 172.21.15.37:0/1261966856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56041948d120 0x560419484190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.838+0000 7f7bf1e00640 1 -- 172.21.15.37:0/1261966856 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56041948cf50 con 0x56041948a7f0 2024-08-20T05:05:25.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.838+0000 7f7bf2800640 1 --2- 172.21.15.37:0/1261966856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604194952e0 0x5604194846d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:25.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.839+0000 7f7bf1e00640 1 --2- 172.21.15.37:0/1261966856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948a7f0 0x5604194808b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009850 tx=0x7f7be402a910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=999a5cd5e422c0f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:25.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.840+0000 7f7bde600640 1 -- 172.21.15.37:0/1261966856 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be4035040 con 0x56041948a7f0 2024-08-20T05:05:25.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.840+0000 7f7bde600640 1 -- 172.21.15.37:0/1261966856 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7be4046030 con 0x56041948a7f0 2024-08-20T05:05:25.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.840+0000 7f7bde600640 1 -- 172.21.15.37:0/1261966856 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be403c7e0 con 0x56041948a7f0 2024-08-20T05:05:25.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.841+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/1261966856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948a7f0 msgr2=0x5604194808b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:25.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.841+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/1261966856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948a7f0 0x5604194808b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009850 tx=0x7f7be402a910 comp rx=0 tx=0).stop 2024-08-20T05:05:25.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.842+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/1261966856 shutdown_connections 2024-08-20T05:05:25.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.842+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/1261966856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604194952e0 0x5604194846d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.842+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/1261966856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56041948d120 0x560419484190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.842+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/1261966856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948a7f0 0x5604194808b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.842+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/1261966856 >> 172.21.15.37:0/1261966856 conn(0x560419485940 msgr2=0x56041948ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.842+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/1261966856 shutdown_connections 2024-08-20T05:05:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.842+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/1261966856 wait complete. 2024-08-20T05:05:25.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.842+0000 7f7bfb9c7740 1 -- start start 2024-08-20T05:05:25.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.843+0000 7f7bfb9c7740 1 Processor -- start 2024-08-20T05:05:25.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.843+0000 7f7bfb9c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56041948a7f0 0x56041949b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.843+0000 7f7bfb9c7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948d120 0x56041949bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.843+0000 7f7bfb9c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604194952e0 0x560419497350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.843+0000 7f7bfb9c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec145ce0 con 0x5604194952e0 2024-08-20T05:05:25.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.843+0000 7f7bfb9c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec145610 con 0x56041948a7f0 2024-08-20T05:05:25.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.843+0000 7f7bfb9c7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec142830 con 0x56041948d120 2024-08-20T05:05:25.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.843+0000 7f7bfb9c7740 10 client.0 _ll_register_callbacks cb 0x7f7be00f5070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:25.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.844+0000 7f7bf1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948d120 0x56041949bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:25.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.844+0000 7f7bf1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948d120 0x56041949bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:37678/0 (socket says 172.21.15.37:37678) 2024-08-20T05:05:25.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.844+0000 7f7bf1400640 1 -- 172.21.15.37:0/2253368534 learned_addr learned my addr 172.21.15.37:0/2253368534 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:25.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.844+0000 7f7bf1e00640 1 --2- 172.21.15.37:0/2253368534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56041948a7f0 0x56041949b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.844+0000 7f7bf2800640 1 --2- 172.21.15.37:0/2253368534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604194952e0 0x560419497350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.844+0000 7f7bf1400640 1 -- 172.21.15.37:0/2253368534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56041948a7f0 msgr2=0x56041949b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.844+0000 7f7bf1400640 1 --2- 172.21.15.37:0/2253368534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56041948a7f0 0x56041949b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.844+0000 7f7bf1400640 1 -- 172.21.15.37:0/2253368534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604194952e0 msgr2=0x560419497350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.844+0000 7f7bf1400640 1 --2- 172.21.15.37:0/2253368534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604194952e0 0x560419497350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.844+0000 7f7bf1400640 1 -- 172.21.15.37:0/2253368534 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604191c8620 con 0x56041948d120 2024-08-20T05:05:25.847 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.844+0000 7f7bf2800640 1 --2- 172.21.15.37:0/2253368534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604194952e0 0x560419497350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:05:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.844+0000 7f7bf1400640 1 --2- 172.21.15.37:0/2253368534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948d120 0x56041949bca0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7be000c760 tx=0x7f7be00aac60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9274b8ca108cf77 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.844+0000 7f7bd3400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:05:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.845+0000 7f7bd3400640 1 -- 172.21.15.37:0/2253368534 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be00aa930 con 0x56041948d120 2024-08-20T05:05:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.845+0000 7f7bd3400640 1 -- 172.21.15.37:0/2253368534 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7be00a6df0 con 0x56041948d120 2024-08-20T05:05:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.845+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/2253368534 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7be4046030 con 0x56041948d120 2024-08-20T05:05:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.846+0000 7f7bd3400640 1 -- 172.21.15.37:0/2253368534 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7be00aa4b0 con 0x56041948d120 2024-08-20T05:05:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.846+0000 7f7bfb9c7740 10 client.26389 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.846+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/2253368534 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5604191c8620 con 0x56041948d120 2024-08-20T05:05:25.848 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.846+0000 7f7bd3400640 1 -- 172.21.15.37:0/2253368534 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7be4046030 con 0x56041948d120 2024-08-20T05:05:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.846+0000 7f7bd3400640 1 -- 172.21.15.37:0/2253368534 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f7be00e77a0 con 0x56041948d120 2024-08-20T05:05:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.847+0000 7f7bfb9c7740 10 client.26389 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.847+0000 7f7bfb9c7740 10 client.26389 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:05:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.847+0000 7f7bfb9c7740 20 client.26389 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.847+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/2253368534 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56041951ba70 0x56041951de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:25.849 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.847+0000 7f7bfb9c7740 4 client.26389 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:05:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.847+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/2253368534 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5604193fac00 con 0x56041951ba70 2024-08-20T05:05:25.850 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.848+0000 7f7bf1e00640 1 --2- 172.21.15.37:0/2253368534 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56041951ba70 0x56041951de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.850+0000 7f7bf1e00640 1 --2- 172.21.15.37:0/2253368534 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56041951ba70 0x56041951de90 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc41d5d0db7533d5 server_cookie=99ecb1489d27cf2 in_seq=0 out_seq=0 2024-08-20T05:05:25.851 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.850+0000 7f7bd3400640 10 client.26389 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:25.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:25 smithi135 ceph-mon[22342]: pgmap v496: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 422 op/s 2024-08-20T05:05:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.863+0000 7f7bd3400640 1 -- 172.21.15.37:0/2253368534 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5604193fac00 con 0x56041951ba70 2024-08-20T05:05:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.863+0000 7f7bd3400640 10 client.26389 handle_command_reply: tid=0 2024-08-20T05:05:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.863+0000 7f7bfb9c7740 1 client.26389 shutdown 2024-08-20T05:05:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.865+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/2253368534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948d120 msgr2=0x56041949bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:25.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.865+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/2253368534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948d120 0x56041949bca0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7be000c760 tx=0x7f7be00aac60 comp rx=0 tx=0).stop 2024-08-20T05:05:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.865+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/2253368534 shutdown_connections 2024-08-20T05:05:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.865+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/2253368534 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56041951ba70 0x56041951de90 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.865+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/2253368534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604194952e0 0x560419497350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.865+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/2253368534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56041948d120 0x56041949bca0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.865+0000 7f7bfb9c7740 1 --2- 172.21.15.37:0/2253368534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56041948a7f0 0x56041949b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.865+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/2253368534 >> 172.21.15.37:0/2253368534 conn(0x560419485940 msgr2=0x5604194849b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:25.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.865+0000 7f7bd3400640 0 client.26389 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.866+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/2253368534 shutdown_connections 2024-08-20T05:05:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.866+0000 7f7bfb9c7740 1 -- 172.21.15.37:0/2253368534 wait complete. 2024-08-20T05:05:25.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.867+0000 7f7bfb9c7740 20 client.26389 trim_cache size 0 max 16384 2024-08-20T05:05:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:05:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:05:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:05:25.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:05:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.869+0000 7f7bf3200640 1 -- 172.21.15.37:0/2726645775 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bd80b3ea0 msgr2=0x7f7bd80b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.869+0000 7f7bf3200640 1 --2- 172.21.15.37:0/2726645775 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bd80b3ea0 0x7f7bd80b6360 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4068b40 tx=0x7f7bf4051270 comp rx=0 tx=0).stop 2024-08-20T05:05:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.869+0000 7f7bf3200640 1 -- 172.21.15.37:0/2726645775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bec09cc70 msgr2=0x7f7bec132490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.869+0000 7f7bf3200640 1 --2- 172.21.15.37:0/2726645775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bec09cc70 0x7f7bec132490 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7be000ea60 tx=0x7f7be000ef20 comp rx=0 tx=0).stop 2024-08-20T05:05:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.869+0000 7f7bf3200640 1 -- 172.21.15.37:0/2726645775 shutdown_connections 2024-08-20T05:05:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.869+0000 7f7bf3200640 1 --2- 172.21.15.37:0/2726645775 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bd80b3ea0 0x7f7bd80b6360 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.869+0000 7f7bf3200640 1 --2- 172.21.15.37:0/2726645775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bec09d630 0x7f7bec1330c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.869+0000 7f7bf3200640 1 --2- 172.21.15.37:0/2726645775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bec09cc70 0x7f7bec132490 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.869+0000 7f7bf3200640 1 --2- 172.21.15.37:0/2726645775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bec09bb20 0x7f7bec131e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.869+0000 7f7bf3200640 1 -- 172.21.15.37:0/2726645775 >> 172.21.15.37:0/2726645775 conn(0x7f7bec00ae90 msgr2=0x7f7bec09ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:25.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.871+0000 7f7bf3200640 1 -- 172.21.15.37:0/2726645775 shutdown_connections 2024-08-20T05:05:25.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:25.871+0000 7f7bf3200640 1 -- 172.21.15.37:0/2726645775 wait complete. 2024-08-20T05:05:25.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:25 smithi130 ceph-mon[22007]: pgmap v496: 129 pgs: 129 active+clean; 1.0 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.2 MiB/s wr, 422 op/s 2024-08-20T05:05:27.047 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:05:27.047 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-20T05:05:27.048 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "bff57296-4e25-4c74-83c3-018a9b1012e6", 2024-08-20T05:05:27.048 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-20T05:05:27.048 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:05:27.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.677+0000 7fd8d5c00640 1 -- 172.21.15.37:0/448359486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8d0106540 msgr2=0x7fd8d0106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.677+0000 7fd8d5c00640 1 --2- 172.21.15.37:0/448359486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8d0106540 0x7fd8d0106980 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd8c001a910 tx=0x7fd8c003b430 comp rx=0 tx=0).stop 2024-08-20T05:05:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.677+0000 7fd8d5c00640 1 -- 172.21.15.37:0/448359486 shutdown_connections 2024-08-20T05:05:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.677+0000 7fd8d5c00640 1 --2- 172.21.15.37:0/448359486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8d0106ec0 0x7fd8d010d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.677+0000 7fd8d5c00640 1 --2- 172.21.15.37:0/448359486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8d0106540 0x7fd8d0106980 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.677+0000 7fd8d5c00640 1 --2- 172.21.15.37:0/448359486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8d0100b30 0x7fd8d0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.677+0000 7fd8d5c00640 1 -- 172.21.15.37:0/448359486 >> 172.21.15.37:0/448359486 conn(0x7fd8d00fc5c0 msgr2=0x7fd8d00fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.680+0000 7fd8d5c00640 1 -- 172.21.15.37:0/448359486 shutdown_connections 2024-08-20T05:05:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.680+0000 7fd8d5c00640 1 -- 172.21.15.37:0/448359486 wait complete. 2024-08-20T05:05:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.681+0000 7fd8d5c00640 1 Processor -- start 2024-08-20T05:05:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.682+0000 7fd8d5c00640 1 -- start start 2024-08-20T05:05:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.682+0000 7fd8d5c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8d0100b30 0x7fd8d0108c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.682+0000 7fd8d5c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8d0106540 0x7fd8d01091a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.682+0000 7fd8d5c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8d0106ec0 0x7fd8d01a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.682+0000 7fd8d5c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d006ece0 con 0x7fd8d0106540 2024-08-20T05:05:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.683+0000 7fd8d5c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d006eb60 con 0x7fd8d0106ec0 2024-08-20T05:05:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.683+0000 7fd8d5c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d006ee60 con 0x7fd8d0100b30 2024-08-20T05:05:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.684+0000 7fd8d5200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8d0106ec0 0x7fd8d01a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.684+0000 7fd8d5200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8d0106ec0 0x7fd8d01a28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:34360/0 (socket says 172.21.15.37:34360) 2024-08-20T05:05:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.684+0000 7fd8d5200640 1 -- 172.21.15.37:0/2276169413 learned_addr learned my addr 172.21.15.37:0/2276169413 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.684+0000 7fd8cfe00640 1 --2- 172.21.15.37:0/2276169413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8d0100b30 0x7fd8d0108c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.685+0000 7fd8cfe00640 1 -- 172.21.15.37:0/2276169413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8d0106ec0 msgr2=0x7fd8d01a28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.685+0000 7fd8cfe00640 1 --2- 172.21.15.37:0/2276169413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8d0106ec0 0x7fd8d01a28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.685+0000 7fd8cfe00640 1 -- 172.21.15.37:0/2276169413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8d0106540 msgr2=0x7fd8d01091a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.685+0000 7fd8cfe00640 1 --2- 172.21.15.37:0/2276169413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8d0106540 0x7fd8d01091a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.685+0000 7fd8cfe00640 1 -- 172.21.15.37:0/2276169413 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d0193050 con 0x7fd8d0100b30 2024-08-20T05:05:27.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.686+0000 7fd8cfe00640 1 --2- 172.21.15.37:0/2276169413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8d0100b30 0x7fd8d0108c60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800c970 tx=0x7fd8b800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.687+0000 7fd8ccc00640 1 -- 172.21.15.37:0/2276169413 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8007bb0 con 0x7fd8d0100b30 2024-08-20T05:05:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.687+0000 7fd8d5c00640 1 -- 172.21.15.37:0/2276169413 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d0193340 con 0x7fd8d0100b30 2024-08-20T05:05:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.687+0000 7fd8ccc00640 1 -- 172.21.15.37:0/2276169413 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8b8007d50 con 0x7fd8d0100b30 2024-08-20T05:05:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.687+0000 7fd8d5c00640 1 -- 172.21.15.37:0/2276169413 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d01938d0 con 0x7fd8d0100b30 2024-08-20T05:05:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.689+0000 7fd8ccc00640 1 -- 172.21.15.37:0/2276169413 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8007bb0 con 0x7fd8d0100b30 2024-08-20T05:05:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.694+0000 7fd8d9bdc740 1 Processor -- start 2024-08-20T05:05:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.695+0000 7fd8d9bdc740 1 -- start start 2024-08-20T05:05:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.696+0000 7fd8d9bdc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282c8ba0 0x5563282c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.696+0000 7fd8d9bdc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282c94c0 0x5563282d4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.696+0000 7fd8d9bdc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d5450 0x5563282d7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.696+0000 7fd8d9bdc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55632823f870 con 0x5563282c8ba0 2024-08-20T05:05:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.696+0000 7fd8ccc00640 1 -- 172.21.15.37:0/2276169413 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd8b800fa00 con 0x7fd8d0100b30 2024-08-20T05:05:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.696+0000 7fd8d9bdc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55632822ed70 con 0x5563282d5450 2024-08-20T05:05:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.696+0000 7fd8d9bdc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556328232db0 con 0x5563282c94c0 2024-08-20T05:05:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.697+0000 7fd8cf400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d5450 0x5563282d7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.697+0000 7fd8cf400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d5450 0x5563282d7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:34370/0 (socket says 172.21.15.37:34370) 2024-08-20T05:05:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.697+0000 7fd8cf400640 1 -- 172.21.15.37:0/1062446958 learned_addr learned my addr 172.21.15.37:0/1062446958 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.698+0000 7fd8cf400640 1 -- 172.21.15.37:0/1062446958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282c94c0 msgr2=0x5563282d4f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:05:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.698+0000 7fd8cf400640 1 --2- 172.21.15.37:0/1062446958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282c94c0 0x5563282d4f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.698+0000 7fd8cf400640 1 -- 172.21.15.37:0/1062446958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282c8ba0 msgr2=0x5563282c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.698+0000 7fd8cf400640 1 --2- 172.21.15.37:0/1062446958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282c8ba0 0x5563282c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.698+0000 7fd8cf400640 1 -- 172.21.15.37:0/1062446958 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556327f8e930 con 0x5563282d5450 2024-08-20T05:05:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.698+0000 7fd8cf400640 1 --2- 172.21.15.37:0/1062446958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d5450 0x5563282d7840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00046f0 tx=0x7fd8c0004720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12edd2352b766e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.699+0000 7fd8c5600640 1 -- 172.21.15.37:0/1062446958 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0071020 con 0x5563282d5450 2024-08-20T05:05:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.699+0000 7fd8c5600640 1 -- 172.21.15.37:0/1062446958 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8c0004e20 con 0x5563282d5450 2024-08-20T05:05:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.699+0000 7fd8c5600640 1 -- 172.21.15.37:0/1062446958 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0046070 con 0x5563282d5450 2024-08-20T05:05:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.700+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/1062446958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d5450 msgr2=0x5563282d7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.700+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/1062446958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d5450 0x5563282d7840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00046f0 tx=0x7fd8c0004720 comp rx=0 tx=0).stop 2024-08-20T05:05:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.700+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/1062446958 shutdown_connections 2024-08-20T05:05:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.700+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/1062446958 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d5450 0x5563282d7840 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.700+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/1062446958 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282c94c0 0x5563282d4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.700+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/1062446958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282c8ba0 0x5563282c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.700+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/1062446958 >> 172.21.15.37:0/1062446958 conn(0x5563282c69d0 msgr2=0x5563282c7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.701+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/1062446958 shutdown_connections 2024-08-20T05:05:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.701+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/1062446958 wait complete. 2024-08-20T05:05:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.702+0000 7fd8d9bdc740 1 -- start start 2024-08-20T05:05:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.704+0000 7fd8d9bdc740 1 Processor -- start 2024-08-20T05:05:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.704+0000 7fd8ccc00640 1 --2- 172.21.15.37:0/2276169413 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd8b40b3e00 0x7fd8b40b62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.705+0000 7fd8ccc00640 1 -- 172.21.15.37:0/2276169413 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd8b80e3140 con 0x7fd8d0100b30 2024-08-20T05:05:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.706+0000 7fd8d9bdc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282c8ba0 0x5563282d4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.706+0000 7fd8d9bdc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282d5450 0x5563282d2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.706+0000 7fd8d9bdc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282d2880 0x5563282d2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.706+0000 7fd8d9bdc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556328091890 con 0x5563282d5450 2024-08-20T05:05:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.706+0000 7fd8d9bdc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5563281b5b00 con 0x5563282c8ba0 2024-08-20T05:05:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.706+0000 7fd8d9bdc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5563282d8140 con 0x5563282d2880 2024-08-20T05:05:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.706+0000 7fd8d9bdc740 10 client.0 _ll_register_callbacks cb 0x556328229dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.706+0000 7fd8d5200640 1 --2- 172.21.15.37:0/2276169413 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd8b40b3e00 0x7fd8b40b62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.707+0000 7fd8d5200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282d2880 0x5563282d2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.707+0000 7fd8cfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282c8ba0 0x5563282d4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.708+0000 7fd8d5200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282d2880 0x5563282d2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:37698/0 (socket says 172.21.15.37:37698) 2024-08-20T05:05:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.708+0000 7fd8d5200640 1 -- 172.21.15.37:0/3251332249 learned_addr learned my addr 172.21.15.37:0/3251332249 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.708+0000 7fd8cf400640 1 --2- 172.21.15.37:0/3251332249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282d5450 0x5563282d2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.709+0000 7fd8cfe00640 1 -- 172.21.15.37:0/3251332249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282d2880 msgr2=0x5563282d2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.709+0000 7fd8cfe00640 1 --2- 172.21.15.37:0/3251332249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282d2880 0x5563282d2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.709+0000 7fd8cfe00640 1 -- 172.21.15.37:0/3251332249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282d5450 msgr2=0x5563282d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.709+0000 7fd8cfe00640 1 --2- 172.21.15.37:0/3251332249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282d5450 0x5563282d2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.709+0000 7fd8cfe00640 1 -- 172.21.15.37:0/3251332249 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563281f6a30 con 0x5563282c8ba0 2024-08-20T05:05:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.709+0000 7fd8cf400640 1 --2- 172.21.15.37:0/3251332249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282d5450 0x5563282d2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:05:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.710+0000 7fd8d5200640 1 --2- 172.21.15.37:0/2276169413 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd8b40b3e00 0x7fd8b40b62c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8013d20 tx=0x7fd8c8009810 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.710+0000 7fd8cfe00640 1 --2- 172.21.15.37:0/3251332249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282c8ba0 0x5563282d4e00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x5563282cbd20 tx=0x7fd8b80a98f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61addef8355d0820 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.710+0000 7fd8be000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:05:27.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.710+0000 7fd8be000640 1 -- 172.21.15.37:0/3251332249 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80ae320 con 0x5563282c8ba0 2024-08-20T05:05:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.711+0000 7fd8be000640 1 -- 172.21.15.37:0/3251332249 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd8b80a8f80 con 0x5563282c8ba0 2024-08-20T05:05:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.711+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/3251332249 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8c0004e20 con 0x5563282c8ba0 2024-08-20T05:05:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.711+0000 7fd8be000640 1 -- 172.21.15.37:0/3251332249 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd8b80b2d40 con 0x5563282c8ba0 2024-08-20T05:05:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.711+0000 7fd8d9bdc740 10 client.26348 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.711+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/3251332249 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5563282e3f50 con 0x5563282c8ba0 2024-08-20T05:05:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.712+0000 7fd8be000640 1 -- 172.21.15.37:0/3251332249 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8c0004e20 con 0x5563282c8ba0 2024-08-20T05:05:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.713+0000 7fd8be000640 1 -- 172.21.15.37:0/3251332249 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fd8b800f450 con 0x5563282c8ba0 2024-08-20T05:05:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.713+0000 7fd8d9bdc740 10 client.26348 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.713+0000 7fd8d9bdc740 10 client.26348 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:05:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.714+0000 7fd8d9bdc740 20 client.26348 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.714+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/3251332249 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5563282e5410 0x5563282e7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.714+0000 7fd8d9bdc740 4 client.26348 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:05:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.714+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/3251332249 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563282417c0 con 0x5563282e5410 2024-08-20T05:05:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.715+0000 7fd8cf400640 1 --2- 172.21.15.37:0/3251332249 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5563282e5410 0x5563282e7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.717+0000 7fd8cf400640 1 --2- 172.21.15.37:0/3251332249 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5563282e5410 0x5563282e7800 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=795cd2f294c8d654 server_cookie=ab54271b96591d61 in_seq=0 out_seq=0 2024-08-20T05:05:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.717+0000 7fd8be000640 10 client.26348 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.718+0000 7fd8be000640 1 -- 172.21.15.37:0/3251332249 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5563282417c0 con 0x5563282e5410 2024-08-20T05:05:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.718+0000 7fd8be000640 10 client.26348 handle_command_reply: tid=0 2024-08-20T05:05:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.718+0000 7fd8d9bdc740 1 client.26348 shutdown 2024-08-20T05:05:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.719+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/3251332249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282c8ba0 msgr2=0x5563282d4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.719+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/3251332249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282c8ba0 0x5563282d4e00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x5563282cbd20 tx=0x7fd8b80a98f0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.719+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/3251332249 shutdown_connections 2024-08-20T05:05:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.719+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/3251332249 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5563282e5410 0x5563282e7800 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.719+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/3251332249 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282d2880 0x5563282d2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.719+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/3251332249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282d5450 0x5563282d2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.719+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/3251332249 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282c8ba0 0x5563282d4e00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.719+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/3251332249 >> 172.21.15.37:0/3251332249 conn(0x5563282c69d0 msgr2=0x5563282cc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.719+0000 7fd8be000640 0 client.26348 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.720+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/3251332249 shutdown_connections 2024-08-20T05:05:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.720+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/3251332249 wait complete. 2024-08-20T05:05:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.720+0000 7fd8d9bdc740 20 client.26348 trim_cache size 0 max 16384 2024-08-20T05:05:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.774+0000 7fd8d9bdc740 1 Processor -- start 2024-08-20T05:05:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.775+0000 7fd8d9bdc740 1 -- start start 2024-08-20T05:05:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.775+0000 7fd8d9bdc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282c8ba0 0x5563282cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.775+0000 7fd8d9bdc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282d2880 0x5563282ed080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.775+0000 7fd8d9bdc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d5450 0x5563282ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.775+0000 7fd8d9bdc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d01a4840 con 0x5563282c8ba0 2024-08-20T05:05:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.775+0000 7fd8d9bdc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d01a6440 con 0x5563282d5450 2024-08-20T05:05:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.775+0000 7fd8d9bdc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d01a4f10 con 0x5563282d2880 2024-08-20T05:05:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.776+0000 7fd8d5200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d5450 0x5563282ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.776+0000 7fd8d5200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d5450 0x5563282ed5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:34384/0 (socket says 172.21.15.37:34384) 2024-08-20T05:05:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.776+0000 7fd8d5200640 1 -- 172.21.15.37:0/2895635771 learned_addr learned my addr 172.21.15.37:0/2895635771 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.777+0000 7fd8d5200640 1 -- 172.21.15.37:0/2895635771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282d2880 msgr2=0x5563282ed080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:05:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.777+0000 7fd8d5200640 1 --2- 172.21.15.37:0/2895635771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282d2880 0x5563282ed080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.777+0000 7fd8d5200640 1 -- 172.21.15.37:0/2895635771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282c8ba0 msgr2=0x5563282cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.777+0000 7fd8d5200640 1 --2- 172.21.15.37:0/2895635771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282c8ba0 0x5563282cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.777+0000 7fd8d5200640 1 -- 172.21.15.37:0/2895635771 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563282c7450 con 0x5563282d5450 2024-08-20T05:05:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.780+0000 7fd8d5200640 1 --2- 172.21.15.37:0/2895635771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d5450 0x5563282ed5c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80094f0 tx=0x7fd8c8021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1b94741cf0874a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.780+0000 7fd8c4c00640 1 -- 172.21.15.37:0/2895635771 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8013d50 con 0x5563282d5450 2024-08-20T05:05:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.780+0000 7fd8c4c00640 1 -- 172.21.15.37:0/2895635771 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8c8010de0 con 0x5563282d5450 2024-08-20T05:05:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.780+0000 7fd8c4c00640 1 -- 172.21.15.37:0/2895635771 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c801fc40 con 0x5563282d5450 2024-08-20T05:05:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.782+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/2895635771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d5450 msgr2=0x5563282ed5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.782+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/2895635771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d5450 0x5563282ed5c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd8c80094f0 tx=0x7fd8c8021000 comp rx=0 tx=0).stop 2024-08-20T05:05:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.783+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/2895635771 shutdown_connections 2024-08-20T05:05:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.783+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/2895635771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d5450 0x5563282ed5c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.783+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/2895635771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282d2880 0x5563282ed080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.783+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/2895635771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282c8ba0 0x5563282cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.783+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/2895635771 >> 172.21.15.37:0/2895635771 conn(0x5563282c69d0 msgr2=0x5563282ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.785+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/2895635771 shutdown_connections 2024-08-20T05:05:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.785+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/2895635771 wait complete. 2024-08-20T05:05:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.786+0000 7fd8d9bdc740 1 -- start start 2024-08-20T05:05:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.786+0000 7fd8d9bdc740 1 Processor -- start 2024-08-20T05:05:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.788+0000 7fd8d9bdc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282c8ba0 0x5563282ddcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.789+0000 7fd8d9bdc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d2880 0x5563282d91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.789+0000 7fd8d9bdc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282d5450 0x5563282d9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.789+0000 7fd8d9bdc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d01a5cb0 con 0x5563282c8ba0 2024-08-20T05:05:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.789+0000 7fd8d9bdc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d01a55e0 con 0x5563282d2880 2024-08-20T05:05:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.789+0000 7fd8d9bdc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d0100f10 con 0x5563282d5450 2024-08-20T05:05:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.789+0000 7fd8d9bdc740 10 client.0 _ll_register_callbacks cb 0x7fd8b80a9490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.789+0000 7fd8cfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282c8ba0 0x5563282ddcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.789+0000 7fd8cfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282c8ba0 0x5563282ddcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49434/0 (socket says 172.21.15.37:49434) 2024-08-20T05:05:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.789+0000 7fd8cfe00640 1 -- 172.21.15.37:0/418131838 learned_addr learned my addr 172.21.15.37:0/418131838 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.789+0000 7fd8cfe00640 1 -- 172.21.15.37:0/418131838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282d5450 msgr2=0x5563282d9970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:05:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.789+0000 7fd8cfe00640 1 --2- 172.21.15.37:0/418131838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282d5450 0x5563282d9970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.790+0000 7fd8cfe00640 1 -- 172.21.15.37:0/418131838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d2880 msgr2=0x5563282d91e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:05:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.790+0000 7fd8cfe00640 1 --2- 172.21.15.37:0/418131838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d2880 0x5563282d91e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.790+0000 7fd8cfe00640 1 -- 172.21.15.37:0/418131838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55632834f050 con 0x5563282c8ba0 2024-08-20T05:05:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.791+0000 7fd8cfe00640 1 --2- 172.21.15.37:0/418131838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282c8ba0 0x5563282ddcc0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800f960 tx=0x7fd8b80915a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6be2587802de7e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.791+0000 7fd8be000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:05:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.792+0000 7fd8be000640 1 -- 172.21.15.37:0/418131838 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b80ae320 con 0x5563282c8ba0 2024-08-20T05:05:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.792+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/418131838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8c8010de0 con 0x5563282c8ba0 2024-08-20T05:05:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.793+0000 7fd8be000640 1 -- 172.21.15.37:0/418131838 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd8b80a6310 con 0x5563282c8ba0 2024-08-20T05:05:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.793+0000 7fd8be000640 1 -- 172.21.15.37:0/418131838 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd8b80ae320 con 0x5563282c8ba0 2024-08-20T05:05:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.793+0000 7fd8d9bdc740 10 client.16176 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.793+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/418131838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556328350310 con 0x5563282c8ba0 2024-08-20T05:05:27.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.793+0000 7fd8be000640 1 -- 172.21.15.37:0/418131838 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8c8010de0 con 0x5563282c8ba0 2024-08-20T05:05:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.793+0000 7fd8be000640 1 -- 172.21.15.37:0/418131838 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fd8b80a8b90 con 0x5563282c8ba0 2024-08-20T05:05:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.794+0000 7fd8d9bdc740 10 client.16176 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.794+0000 7fd8d9bdc740 10 client.16176 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:05:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.794+0000 7fd8d9bdc740 20 client.16176 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.794+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/418131838 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556328350920 0x556328352d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.794+0000 7fd8d9bdc740 4 client.16176 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T05:05:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.794+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/418131838 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55632823d260 con 0x556328350920 2024-08-20T05:05:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.794+0000 7fd8cf400640 1 --2- 172.21.15.37:0/418131838 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556328350920 0x556328352d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.795+0000 7fd8be000640 10 client.16176 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.798+0000 7fd8cf400640 1 --2- 172.21.15.37:0/418131838 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556328350920 0x556328352d40 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=642327d2ef8d734 server_cookie=8d97cab31a9c8d86 in_seq=0 out_seq=0 2024-08-20T05:05:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.800+0000 7fd8be000640 1 -- 172.21.15.37:0/418131838 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55632823d260 con 0x556328350920 2024-08-20T05:05:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.800+0000 7fd8be000640 10 client.16176 handle_command_reply: tid=0 2024-08-20T05:05:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.800+0000 7fd8d9bdc740 1 client.16176 shutdown 2024-08-20T05:05:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.800+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/418131838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282c8ba0 msgr2=0x5563282ddcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.800+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/418131838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282c8ba0 0x5563282ddcc0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800f960 tx=0x7fd8b80915a0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.800+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/418131838 shutdown_connections 2024-08-20T05:05:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.800+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/418131838 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556328350920 0x556328352d40 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.800+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/418131838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5563282d5450 0x5563282d9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.800+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/418131838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5563282d2880 0x5563282d91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.800+0000 7fd8d9bdc740 1 --2- 172.21.15.37:0/418131838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5563282c8ba0 0x5563282ddcc0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.800+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/418131838 >> 172.21.15.37:0/418131838 conn(0x5563282c69d0 msgr2=0x5563282cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.800+0000 7fd8be000640 0 client.16176 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.801+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/418131838 shutdown_connections 2024-08-20T05:05:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.801+0000 7fd8d9bdc740 1 -- 172.21.15.37:0/418131838 wait complete. 2024-08-20T05:05:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.801+0000 7fd8d9bdc740 20 client.16176 trim_cache size 0 max 16384 2024-08-20T05:05:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.804+0000 7fd8d5c00640 1 -- 172.21.15.37:0/2276169413 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd8b40b3e00 msgr2=0x7fd8b40b62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.804+0000 7fd8d5c00640 1 --2- 172.21.15.37:0/2276169413 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd8b40b3e00 0x7fd8b40b62c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8013d20 tx=0x7fd8c8009810 comp rx=0 tx=0).stop 2024-08-20T05:05:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.804+0000 7fd8d5c00640 1 -- 172.21.15.37:0/2276169413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8d0100b30 msgr2=0x7fd8d0108c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.804+0000 7fd8d5c00640 1 --2- 172.21.15.37:0/2276169413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8d0100b30 0x7fd8d0108c60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800c970 tx=0x7fd8b800ce30 comp rx=0 tx=0).stop 2024-08-20T05:05:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.805+0000 7fd8d5c00640 1 -- 172.21.15.37:0/2276169413 shutdown_connections 2024-08-20T05:05:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.805+0000 7fd8d5c00640 1 --2- 172.21.15.37:0/2276169413 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd8b40b3e00 0x7fd8b40b62c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.805+0000 7fd8d5c00640 1 --2- 172.21.15.37:0/2276169413 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd8d0106ec0 0x7fd8d01a28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.805+0000 7fd8d5c00640 1 --2- 172.21.15.37:0/2276169413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8d0106540 0x7fd8d01091a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.805+0000 7fd8d5c00640 1 --2- 172.21.15.37:0/2276169413 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd8d0100b30 0x7fd8d0108c60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.805+0000 7fd8d5c00640 1 -- 172.21.15.37:0/2276169413 >> 172.21.15.37:0/2276169413 conn(0x7fd8d00fc5c0 msgr2=0x7fd8d0102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.806+0000 7fd8d5c00640 1 -- 172.21.15.37:0/2276169413 shutdown_connections 2024-08-20T05:05:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:26.806+0000 7fd8d5c00640 1 -- 172.21.15.37:0/2276169413 wait complete. 2024-08-20T05:05:27.205 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 05:05:26 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b[51794]: 2024-08-20T05:05:26.852+0000 7fabbc466640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/pg_wal/ auth{1=1} v1320 ap=2 f(v7 m2024-08-20T05:05:15.676807+0000 33=32+1) n(v13 rc2024-08-20T05:05:15.676807+0000 b536870912 34=32+2) (inest sync->mix g=1) caps={25373=pAsLsXsFs/pAsLsXsFsxcral@174} mcw={1=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55dc3d210000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000007:[<0x10000000006/pg_wal v298>,<0x10000000005/data v74>,<0x100000001fb/postgres v10>,<0x100000001fa/091b5016-889b-437d-8bd4-e6363dc551f0 v29>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v36>,<0x1/volumes v34>]//[]","memoryvalue":"(2)0x10000000007:[<0x10000000006/pg_wal v1320>,<0x10000000005/data v314>,<0x100000001fb/postgres v177>,<0x100000001fa/091b5016-889b-437d-8bd4-e6363dc551f0 v197>,<0x10000000001/sv_1 v207>,<0x10000000000/qa v204>,<0x1/volumes v183>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-20T05:04:43.015235+0000 32=31+1)","ondisk_value.rstat":"n(v0 rc2024-08-20T05:05:15.676807+0000 b536870912 34=32+2)","memory_value.dirstat":"f(v7 m2024-08-20T05:05:15.676807+0000 33=32+1)","memory_value.rstat":"n(v13 rc2024-08-20T05:05:15.676807+0000 b536870912 34=32+2)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-20T05:05:27.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:27 smithi037 ceph-mon[17265]: pgmap v497: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 500 op/s 2024-08-20T05:05:27.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:27 smithi037 ceph-mon[17265]: scrub queued for path: / 2024-08-20T05:05:27.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:27 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:27 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:05:27.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:27 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:05:27.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:27 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:27 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:05:27.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:27 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:27 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:05:27.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:27 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:27 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:05:27.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:27 smithi037 ceph-mon[17265]: Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/pg_wal) see mds.b log and `damage ls` output for details 2024-08-20T05:05:27.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:27 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:05:27.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:27 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:27 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:27 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:05:27.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:27 smithi135 ceph-mon[22342]: pgmap v497: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 500 op/s 2024-08-20T05:05:27.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:27 smithi135 ceph-mon[22342]: scrub queued for path: / 2024-08-20T05:05:27.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:27 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:27 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:05:27.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:27 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:05:27.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:27 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:27 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:05:27.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:27 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:27 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:05:27.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:27 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:27 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:05:27.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:27 smithi135 ceph-mon[22342]: Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/pg_wal) see mds.b log and `damage ls` output for details 2024-08-20T05:05:27.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:27 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:05:27.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:27 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:27 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:27 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:05:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:27 smithi130 ceph-mon[22007]: pgmap v497: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 500 op/s 2024-08-20T05:05:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:27 smithi130 ceph-mon[22007]: scrub queued for path: / 2024-08-20T05:05:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:27 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:27 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:05:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:27 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:05:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:27 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:27 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:05:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:27 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:27 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:05:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:27 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:27 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:05:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:27 smithi130 ceph-mon[22007]: Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/pg_wal) see mds.b log and `damage ls` output for details 2024-08-20T05:05:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:27 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:05:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:27 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:27 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:27 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:05:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 150.0 s, 2047.0 tps, lat 48.984 ms stddev 61.751 2024-08-20T05:05:28.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:05:28.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:28 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:05:28.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:28 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:05:28.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:28 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:28.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:28 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:28.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:28 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:05:28.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:28 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:05:28.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:28 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:28.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:28 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:28.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:28 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:05:28.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:28 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:05:28.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:28 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:28.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:28 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:05:29.133 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:05:29.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:29 smithi037 ceph-mon[17265]: pgmap v498: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.3 MiB/s wr, 555 op/s 2024-08-20T05:05:29.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:05:29.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:05:29.577 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:05:29.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:29 smithi135 ceph-mon[22342]: pgmap v498: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.3 MiB/s wr, 555 op/s 2024-08-20T05:05:29.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:05:29.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:05:29.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:05:29.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.890+0000 7fdc4d800640 1 -- 172.21.15.37:0/826287378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc48108330 msgr2=0x7fdc48108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:29.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.890+0000 7fdc4d800640 1 --2- 172.21.15.37:0/826287378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc48108330 0x7fdc48108770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdc30009900 tx=0x7fdc3002a410 comp rx=0 tx=0).stop 2024-08-20T05:05:29.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.891+0000 7fdc4d800640 1 -- 172.21.15.37:0/826287378 shutdown_connections 2024-08-20T05:05:29.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.891+0000 7fdc4d800640 1 --2- 172.21.15.37:0/826287378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc48108cb0 0x7fdc4810f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.891+0000 7fdc4d800640 1 --2- 172.21.15.37:0/826287378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc48108330 0x7fdc48108770 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.891+0000 7fdc4d800640 1 --2- 172.21.15.37:0/826287378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc48102920 0x7fdc48102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.891+0000 7fdc4d800640 1 -- 172.21.15.37:0/826287378 >> 172.21.15.37:0/826287378 conn(0x7fdc480fe350 msgr2=0x7fdc48100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:29.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.891+0000 7fdc4d800640 1 -- 172.21.15.37:0/826287378 shutdown_connections 2024-08-20T05:05:29.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.892+0000 7fdc4d800640 1 -- 172.21.15.37:0/826287378 wait complete. 2024-08-20T05:05:29.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.893+0000 7fdc4d800640 1 Processor -- start 2024-08-20T05:05:29.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.893+0000 7fdc4d800640 1 -- start start 2024-08-20T05:05:29.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.893+0000 7fdc4d800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc48102920 0x7fdc4819b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.893+0000 7fdc4d800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc48108cb0 0x7fdc4819b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.893+0000 7fdc4d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc481a0a10 0x7fdc481a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.893+0000 7fdc4d800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc48112950 con 0x7fdc481a0a10 2024-08-20T05:05:29.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.893+0000 7fdc4d800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc481127d0 con 0x7fdc48108cb0 2024-08-20T05:05:29.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.893+0000 7fdc4d800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdc48112ad0 con 0x7fdc48102920 2024-08-20T05:05:29.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.894+0000 7fdc47e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc48102920 0x7fdc4819b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:29.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.894+0000 7fdc47e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc48102920 0x7fdc4819b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:37754/0 (socket says 172.21.15.37:37754) 2024-08-20T05:05:29.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.894+0000 7fdc47e00640 1 -- 172.21.15.37:0/3701776242 learned_addr learned my addr 172.21.15.37:0/3701776242 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:29.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.894+0000 7fdc3fe00640 1 --2- 172.21.15.37:0/3701776242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc48108cb0 0x7fdc4819b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:29.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.894+0000 7fdc4ce00640 1 --2- 172.21.15.37:0/3701776242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc481a0a10 0x7fdc481a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:29.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.894+0000 7fdc47e00640 1 -- 172.21.15.37:0/3701776242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc48108cb0 msgr2=0x7fdc4819b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:29.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.894+0000 7fdc47e00640 1 --2- 172.21.15.37:0/3701776242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc48108cb0 0x7fdc4819b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.894+0000 7fdc47e00640 1 -- 172.21.15.37:0/3701776242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc481a0a10 msgr2=0x7fdc481a0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:29.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.894+0000 7fdc47e00640 1 --2- 172.21.15.37:0/3701776242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc481a0a10 0x7fdc481a0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.894+0000 7fdc47e00640 1 -- 172.21.15.37:0/3701776242 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc481a15a0 con 0x7fdc48102920 2024-08-20T05:05:29.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.895+0000 7fdc47e00640 1 --2- 172.21.15.37:0/3701776242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc48102920 0x7fdc4819b130 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdc38009fd0 tx=0x7fdc3800edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:29.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.895+0000 7fdc45600640 1 -- 172.21.15.37:0/3701776242 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc38024070 con 0x7fdc48102920 2024-08-20T05:05:29.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.895+0000 7fdc45600640 1 -- 172.21.15.37:0/3701776242 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc3801f440 con 0x7fdc48102920 2024-08-20T05:05:29.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.895+0000 7fdc4d800640 1 -- 172.21.15.37:0/3701776242 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc48109380 con 0x7fdc48102920 2024-08-20T05:05:29.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.895+0000 7fdc45600640 1 -- 172.21.15.37:0/3701776242 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3801d5a0 con 0x7fdc48102920 2024-08-20T05:05:29.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.896+0000 7fdc4d800640 1 -- 172.21.15.37:0/3701776242 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc481098e0 con 0x7fdc48102920 2024-08-20T05:05:29.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.904+0000 7fdc45600640 1 -- 172.21.15.37:0/3701776242 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdc38027070 con 0x7fdc48102920 2024-08-20T05:05:29.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.906+0000 7fdc518c2740 1 Processor -- start 2024-08-20T05:05:29.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.907+0000 7fdc518c2740 1 -- start start 2024-08-20T05:05:29.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.907+0000 7fdc518c2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721df6ae0 0x55a721df6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.907+0000 7fdc518c2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df7400 0x55a721e02e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.907+0000 7fdc518c2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721e03390 0x55a721e05780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.907+0000 7fdc518c2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a721d6ca60 con 0x55a721df7400 2024-08-20T05:05:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.907+0000 7fdc518c2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a721d5bf60 con 0x55a721df6ae0 2024-08-20T05:05:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.907+0000 7fdc518c2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a721d5ffa0 con 0x55a721e03390 2024-08-20T05:05:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.908+0000 7fdc4ce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721df6ae0 0x55a721df6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.908+0000 7fdc3fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721e03390 0x55a721e05780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:29.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.908+0000 7fdc3fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721e03390 0x55a721e05780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:37766/0 (socket says 172.21.15.37:37766) 2024-08-20T05:05:29.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.908+0000 7fdc4ce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721df6ae0 0x55a721df6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:34404/0 (socket says 172.21.15.37:34404) 2024-08-20T05:05:29.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.908+0000 7fdc4ce00640 1 -- 172.21.15.37:0/2996798339 learned_addr learned my addr 172.21.15.37:0/2996798339 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:29.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.908+0000 7fdc45600640 1 --2- 172.21.15.37:0/3701776242 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc2c0b3cf0 0x7fdc2c0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.909+0000 7fdc45600640 1 -- 172.21.15.37:0/3701776242 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fdc380ec500 con 0x7fdc48102920 2024-08-20T05:05:29.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.909+0000 7fdc4ce00640 1 -- 172.21.15.37:0/2996798339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721e03390 msgr2=0x55a721e05780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:29.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.909+0000 7fdc4ce00640 1 --2- 172.21.15.37:0/2996798339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721e03390 0x55a721e05780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.909+0000 7fdc4ce00640 1 -- 172.21.15.37:0/2996798339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df7400 msgr2=0x55a721e02e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:29.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.909+0000 7fdc4ce00640 1 --2- 172.21.15.37:0/2996798339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df7400 0x55a721e02e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.909+0000 7fdc4ce00640 1 -- 172.21.15.37:0/2996798339 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a721d023e0 con 0x55a721df6ae0 2024-08-20T05:05:29.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.909+0000 7fdc4ce00640 1 --2- 172.21.15.37:0/3701776242 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc2c0b3cf0 0x7fdc2c0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:29.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.909+0000 7fdc3fe00640 1 --2- 172.21.15.37:0/2996798339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721e03390 0x55a721e05780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:05:29.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.909+0000 7fdc4ce00640 1 --2- 172.21.15.37:0/2996798339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721df6ae0 0x55a721df6ec0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdc400104f0 tx=0x7fdc400109b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fca9f7a602e2b2c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:29.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.910+0000 7fdc3d600640 1 -- 172.21.15.37:0/2996798339 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40019070 con 0x55a721df6ae0 2024-08-20T05:05:29.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.910+0000 7fdc3d600640 1 -- 172.21.15.37:0/2996798339 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc4000edb0 con 0x55a721df6ae0 2024-08-20T05:05:29.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.910+0000 7fdc3d600640 1 -- 172.21.15.37:0/2996798339 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4001dae0 con 0x55a721df6ae0 2024-08-20T05:05:29.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.910+0000 7fdc4ce00640 1 --2- 172.21.15.37:0/3701776242 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc2c0b3cf0 0x7fdc2c0b61b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdc40021000 tx=0x7fdc4001e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:29.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.911+0000 7fdc518c2740 1 -- 172.21.15.37:0/2996798339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721df6ae0 msgr2=0x55a721df6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:29.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.911+0000 7fdc518c2740 1 --2- 172.21.15.37:0/2996798339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721df6ae0 0x55a721df6ec0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdc400104f0 tx=0x7fdc400109b0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.912+0000 7fdc518c2740 1 -- 172.21.15.37:0/2996798339 shutdown_connections 2024-08-20T05:05:29.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.912+0000 7fdc518c2740 1 --2- 172.21.15.37:0/2996798339 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721e03390 0x55a721e05780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.912+0000 7fdc518c2740 1 --2- 172.21.15.37:0/2996798339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df7400 0x55a721e02e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.912+0000 7fdc518c2740 1 --2- 172.21.15.37:0/2996798339 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721df6ae0 0x55a721df6ec0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.912+0000 7fdc518c2740 1 -- 172.21.15.37:0/2996798339 >> 172.21.15.37:0/2996798339 conn(0x55a721df4910 msgr2=0x55a721df5ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:29.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.912+0000 7fdc518c2740 1 -- 172.21.15.37:0/2996798339 shutdown_connections 2024-08-20T05:05:29.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.912+0000 7fdc518c2740 1 -- 172.21.15.37:0/2996798339 wait complete. 2024-08-20T05:05:29.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.914+0000 7fdc518c2740 1 -- start start 2024-08-20T05:05:29.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.914+0000 7fdc518c2740 1 Processor -- start 2024-08-20T05:05:29.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.915+0000 7fdc518c2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df6ae0 0x55a721e02c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.916+0000 7fdc518c2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df7400 0x55a721e00070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.916+0000 7fdc518c2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 0x55a721e00610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.916+0000 7fdc4ce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 0x55a721e00610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:29.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.916+0000 7fdc4ce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 0x55a721e00610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:34408/0 (socket says 172.21.15.37:34408) 2024-08-20T05:05:29.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.916+0000 7fdc3fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df7400 0x55a721e00070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:29.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.916+0000 7fdc3fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df7400 0x55a721e00070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49462/0 (socket says 172.21.15.37:49462) 2024-08-20T05:05:29.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.917+0000 7fdc4ce00640 1 -- 172.21.15.37:0/2490126652 learned_addr learned my addr 172.21.15.37:0/2490126652 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:29.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.917+0000 7fdc518c2740 1 -- 172.21.15.37:0/2490126652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a721bbe700 con 0x55a721df7400 2024-08-20T05:05:29.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.917+0000 7fdc518c2740 1 -- 172.21.15.37:0/2490126652 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a721cf7250 con 0x55a721e03390 2024-08-20T05:05:29.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.917+0000 7fdc518c2740 1 -- 172.21.15.37:0/2490126652 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a721e06010 con 0x55a721df6ae0 2024-08-20T05:05:29.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.917+0000 7fdc518c2740 10 client.0 _ll_register_callbacks cb 0x55a721d56180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:29.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.917+0000 7fdc47e00640 1 --2- 172.21.15.37:0/2490126652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df6ae0 0x55a721e02c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:29.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.918+0000 7fdc3fe00640 1 -- 172.21.15.37:0/2490126652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df6ae0 msgr2=0x55a721e02c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:29.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.918+0000 7fdc3fe00640 1 --2- 172.21.15.37:0/2490126652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df6ae0 0x55a721e02c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.918+0000 7fdc3fe00640 1 -- 172.21.15.37:0/2490126652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 msgr2=0x55a721e00610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:29.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.918+0000 7fdc3fe00640 1 --2- 172.21.15.37:0/2490126652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 0x55a721e00610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.918+0000 7fdc3fe00640 1 -- 172.21.15.37:0/2490126652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a721abb650 con 0x55a721df7400 2024-08-20T05:05:29.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.919+0000 7fdc4ce00640 1 --2- 172.21.15.37:0/2490126652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 0x55a721e00610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:29.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.919+0000 7fdc3fe00640 1 --2- 172.21.15.37:0/2490126652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df7400 0x55a721e00070 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdc30008000 tx=0x7fdc300052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb53705678b0d5f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:29.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.919+0000 7fdc36000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:05:29.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.920+0000 7fdc36000640 1 -- 172.21.15.37:0/2490126652 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc30035070 con 0x55a721df7400 2024-08-20T05:05:29.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.920+0000 7fdc36000640 1 -- 172.21.15.37:0/2490126652 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fdc300048c0 con 0x55a721df7400 2024-08-20T05:05:29.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.920+0000 7fdc518c2740 1 -- 172.21.15.37:0/2490126652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc4000edb0 con 0x55a721df7400 2024-08-20T05:05:29.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.921+0000 7fdc36000640 1 -- 172.21.15.37:0/2490126652 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdc3004c050 con 0x55a721df7400 2024-08-20T05:05:29.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.921+0000 7fdc518c2740 10 client.16185 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:29.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.921+0000 7fdc518c2740 1 -- 172.21.15.37:0/2490126652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a721e118e0 con 0x55a721df7400 2024-08-20T05:05:29.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.921+0000 7fdc36000640 1 -- 172.21.15.37:0/2490126652 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc4000edb0 con 0x55a721df7400 2024-08-20T05:05:29.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.921+0000 7fdc36000640 1 -- 172.21.15.37:0/2490126652 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fdc30003ab0 con 0x55a721df7400 2024-08-20T05:05:29.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.921+0000 7fdc518c2740 10 client.16185 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:29.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.921+0000 7fdc518c2740 10 client.16185 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:05:29.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.922+0000 7fdc518c2740 20 client.16185 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:29.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.922+0000 7fdc518c2740 1 --2- 172.21.15.37:0/2490126652 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a721e12e50 0x55a721e15270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.922+0000 7fdc518c2740 4 client.16185 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:05:29.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.922+0000 7fdc518c2740 1 -- 172.21.15.37:0/2490126652 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a721d6e9b0 con 0x55a721e12e50 2024-08-20T05:05:29.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.922+0000 7fdc47e00640 1 --2- 172.21.15.37:0/2490126652 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a721e12e50 0x55a721e15270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.922+0000 7fdc47e00640 1 --2- 172.21.15.37:0/2490126652 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a721e12e50 0x55a721e15270 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2271164ed31b44d1 server_cookie=854ff8ef7582d805 in_seq=0 out_seq=0 2024-08-20T05:05:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.922+0000 7fdc36000640 10 client.16185 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.923+0000 7fdc36000640 1 -- 172.21.15.37:0/2490126652 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a721d6e9b0 con 0x55a721e12e50 2024-08-20T05:05:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.923+0000 7fdc36000640 10 client.16185 handle_command_reply: tid=0 2024-08-20T05:05:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.923+0000 7fdc518c2740 1 client.16185 shutdown 2024-08-20T05:05:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.923+0000 7fdc518c2740 1 -- 172.21.15.37:0/2490126652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df7400 msgr2=0x55a721e00070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.923+0000 7fdc518c2740 1 --2- 172.21.15.37:0/2490126652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df7400 0x55a721e00070 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdc30008000 tx=0x7fdc300052f0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.924+0000 7fdc518c2740 1 -- 172.21.15.37:0/2490126652 shutdown_connections 2024-08-20T05:05:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.924+0000 7fdc518c2740 1 --2- 172.21.15.37:0/2490126652 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a721e12e50 0x55a721e15270 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.924+0000 7fdc518c2740 1 --2- 172.21.15.37:0/2490126652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 0x55a721e00610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.924+0000 7fdc518c2740 1 --2- 172.21.15.37:0/2490126652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df7400 0x55a721e00070 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.924+0000 7fdc518c2740 1 --2- 172.21.15.37:0/2490126652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df6ae0 0x55a721e02c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.924+0000 7fdc36000640 0 client.16185 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.924+0000 7fdc518c2740 1 -- 172.21.15.37:0/2490126652 >> 172.21.15.37:0/2490126652 conn(0x55a721df4910 msgr2=0x55a721df3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:29.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.924+0000 7fdc518c2740 1 -- 172.21.15.37:0/2490126652 shutdown_connections 2024-08-20T05:05:29.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.925+0000 7fdc518c2740 1 -- 172.21.15.37:0/2490126652 wait complete. 2024-08-20T05:05:29.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.925+0000 7fdc518c2740 20 client.16185 trim_cache size 0 max 16384 2024-08-20T05:05:29.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:29 smithi130 ceph-mon[22007]: pgmap v498: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.3 MiB/s wr, 555 op/s 2024-08-20T05:05:29.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:05:29.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:05:29.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:05:29.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.956+0000 7fdc518c2740 1 Processor -- start 2024-08-20T05:05:29.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.956+0000 7fdc518c2740 1 -- start start 2024-08-20T05:05:29.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.957+0000 7fdc518c2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df6ae0 0x55a721e0f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.957+0000 7fdc518c2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df7400 0x55a721dfa250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.957+0000 7fdc518c2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 0x55a721e1ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.957+0000 7fdc518c2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc481ad910 con 0x55a721df6ae0 2024-08-20T05:05:29.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.957+0000 7fdc518c2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc481af510 con 0x55a721e03390 2024-08-20T05:05:29.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.957+0000 7fdc518c2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdc481adfe0 con 0x55a721df7400 2024-08-20T05:05:29.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.957+0000 7fdc4ce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 0x55a721e1ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:29.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.957+0000 7fdc47e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df6ae0 0x55a721e0f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:29.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.957+0000 7fdc3fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df7400 0x55a721dfa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:29.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.957+0000 7fdc4ce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 0x55a721e1ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:34414/0 (socket says 172.21.15.37:34414) 2024-08-20T05:05:29.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.957+0000 7fdc4ce00640 1 -- 172.21.15.37:0/3462656052 learned_addr learned my addr 172.21.15.37:0/3462656052 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:29.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.958+0000 7fdc4ce00640 1 -- 172.21.15.37:0/3462656052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df7400 msgr2=0x55a721dfa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:29.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.958+0000 7fdc4ce00640 1 --2- 172.21.15.37:0/3462656052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df7400 0x55a721dfa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.958+0000 7fdc4ce00640 1 -- 172.21.15.37:0/3462656052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df6ae0 msgr2=0x55a721e0f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:29.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.958+0000 7fdc4ce00640 1 --2- 172.21.15.37:0/3462656052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df6ae0 0x55a721e0f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.958+0000 7fdc4ce00640 1 -- 172.21.15.37:0/3462656052 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a721e158d0 con 0x55a721e03390 2024-08-20T05:05:29.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.958+0000 7fdc3fe00640 1 --2- 172.21.15.37:0/3462656052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df7400 0x55a721dfa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:29.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.959+0000 7fdc4ce00640 1 --2- 172.21.15.37:0/3462656052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 0x55a721e1ab00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdc4001d790 tx=0x7fdc40013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fac2e6c738729f86 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:29.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.959+0000 7fdc3cc00640 1 -- 172.21.15.37:0/3462656052 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40019050 con 0x55a721e03390 2024-08-20T05:05:29.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.959+0000 7fdc3cc00640 1 -- 172.21.15.37:0/3462656052 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc400099e0 con 0x55a721e03390 2024-08-20T05:05:29.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.959+0000 7fdc3cc00640 1 -- 172.21.15.37:0/3462656052 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4002d040 con 0x55a721e03390 2024-08-20T05:05:29.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.960+0000 7fdc518c2740 1 -- 172.21.15.37:0/3462656052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 msgr2=0x55a721e1ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:29.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.960+0000 7fdc518c2740 1 --2- 172.21.15.37:0/3462656052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 0x55a721e1ab00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdc4001d790 tx=0x7fdc40013000 comp rx=0 tx=0).stop 2024-08-20T05:05:29.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.961+0000 7fdc518c2740 1 -- 172.21.15.37:0/3462656052 shutdown_connections 2024-08-20T05:05:29.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.961+0000 7fdc518c2740 1 --2- 172.21.15.37:0/3462656052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 0x55a721e1ab00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.961+0000 7fdc518c2740 1 --2- 172.21.15.37:0/3462656052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df7400 0x55a721dfa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.961+0000 7fdc518c2740 1 --2- 172.21.15.37:0/3462656052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df6ae0 0x55a721e0f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.961+0000 7fdc518c2740 1 -- 172.21.15.37:0/3462656052 >> 172.21.15.37:0/3462656052 conn(0x55a721df4910 msgr2=0x55a721df9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:29.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.961+0000 7fdc518c2740 1 -- 172.21.15.37:0/3462656052 shutdown_connections 2024-08-20T05:05:29.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.961+0000 7fdc518c2740 1 -- 172.21.15.37:0/3462656052 wait complete. 2024-08-20T05:05:29.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.962+0000 7fdc518c2740 1 -- start start 2024-08-20T05:05:29.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.962+0000 7fdc518c2740 1 Processor -- start 2024-08-20T05:05:29.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.963+0000 7fdc518c2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df6ae0 0x55a721e0b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.964+0000 7fdc518c2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df7400 0x55a721e06dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.964+0000 7fdc47e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df6ae0 0x55a721e0b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:29.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.964+0000 7fdc47e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df6ae0 0x55a721e0b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:37788/0 (socket says 172.21.15.37:37788) 2024-08-20T05:05:29.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.964+0000 7fdc47e00640 1 -- 172.21.15.37:0/1096039548 learned_addr learned my addr 172.21.15.37:0/1096039548 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:29.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.964+0000 7fdc518c2740 1 --2- 172.21.15.37:0/1096039548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 0x55a721e07310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.965+0000 7fdc518c2740 1 -- 172.21.15.37:0/1096039548 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdc481aed80 con 0x55a721df7400 2024-08-20T05:05:29.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.965+0000 7fdc518c2740 1 -- 172.21.15.37:0/1096039548 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdc481ae6b0 con 0x55a721e03390 2024-08-20T05:05:29.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.965+0000 7fdc518c2740 1 -- 172.21.15.37:0/1096039548 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdc481ab8f0 con 0x55a721df6ae0 2024-08-20T05:05:29.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.965+0000 7fdc518c2740 10 client.0 _ll_register_callbacks cb 0x7fdc38005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:29.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.965+0000 7fdc4ce00640 1 --2- 172.21.15.37:0/1096039548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 0x55a721e07310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:29.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.966+0000 7fdc3fe00640 1 --2- 172.21.15.37:0/1096039548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df7400 0x55a721e06dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:29.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.966+0000 7fdc4ce00640 1 -- 172.21.15.37:0/1096039548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df6ae0 msgr2=0x55a721e0b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:29.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.966+0000 7fdc4ce00640 1 --2- 172.21.15.37:0/1096039548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df6ae0 0x55a721e0b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.966+0000 7fdc4ce00640 1 -- 172.21.15.37:0/1096039548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df7400 msgr2=0x55a721e06dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:29.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.966+0000 7fdc4ce00640 1 --2- 172.21.15.37:0/1096039548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df7400 0x55a721e06dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.966+0000 7fdc4ce00640 1 -- 172.21.15.37:0/1096039548 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a721df5390 con 0x55a721e03390 2024-08-20T05:05:29.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.966+0000 7fdc47e00640 1 --2- 172.21.15.37:0/1096039548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df6ae0 0x55a721e0b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:05:29.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.967+0000 7fdc3fe00640 1 --2- 172.21.15.37:0/1096039548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df7400 0x55a721e06dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:05:29.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.968+0000 7fdc4ce00640 1 --2- 172.21.15.37:0/1096039548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 0x55a721e07310 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdc40016010 tx=0x7fdc4001dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c84f260667728f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:29.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.968+0000 7fdc36000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:05:29.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.968+0000 7fdc36000640 1 -- 172.21.15.37:0/1096039548 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40041070 con 0x55a721e03390 2024-08-20T05:05:29.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.968+0000 7fdc36000640 1 -- 172.21.15.37:0/1096039548 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fdc400049e0 con 0x55a721e03390 2024-08-20T05:05:29.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.969+0000 7fdc518c2740 1 -- 172.21.15.37:0/1096039548 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdc400099e0 con 0x55a721e03390 2024-08-20T05:05:29.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.969+0000 7fdc36000640 1 -- 172.21.15.37:0/1096039548 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdc40019020 con 0x55a721e03390 2024-08-20T05:05:29.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.971+0000 7fdc518c2740 10 client.26369 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:29.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.971+0000 7fdc518c2740 1 -- 172.21.15.37:0/1096039548 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a721e7d890 con 0x55a721e03390 2024-08-20T05:05:29.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.972+0000 7fdc36000640 1 -- 172.21.15.37:0/1096039548 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdc400099e0 con 0x55a721e03390 2024-08-20T05:05:29.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.972+0000 7fdc36000640 1 -- 172.21.15.37:0/1096039548 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7fdc400277e0 con 0x55a721e03390 2024-08-20T05:05:29.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.972+0000 7fdc518c2740 10 client.26369 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:29.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.972+0000 7fdc518c2740 10 client.26369 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:05:29.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.972+0000 7fdc518c2740 20 client.26369 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:29.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.973+0000 7fdc518c2740 1 --2- 172.21.15.37:0/1096039548 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a721e7dd90 0x55a721e801b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:29.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.973+0000 7fdc518c2740 4 client.26369 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:05:29.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.973+0000 7fdc518c2740 1 -- 172.21.15.37:0/1096039548 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a721d6a450 con 0x55a721e7dd90 2024-08-20T05:05:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.973+0000 7fdc47e00640 1 --2- 172.21.15.37:0/1096039548 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a721e7dd90 0x55a721e801b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.974+0000 7fdc47e00640 1 --2- 172.21.15.37:0/1096039548 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a721e7dd90 0x55a721e801b0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34c0b6275ceb9754 server_cookie=d71b645db24a8a4f in_seq=0 out_seq=0 2024-08-20T05:05:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.974+0000 7fdc36000640 10 client.26369 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.974+0000 7fdc36000640 1 -- 172.21.15.37:0/1096039548 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a721d6a450 con 0x55a721e7dd90 2024-08-20T05:05:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.974+0000 7fdc36000640 10 client.26369 handle_command_reply: tid=0 2024-08-20T05:05:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.974+0000 7fdc518c2740 1 client.26369 shutdown 2024-08-20T05:05:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.975+0000 7fdc518c2740 1 -- 172.21.15.37:0/1096039548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 msgr2=0x55a721e07310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.975+0000 7fdc518c2740 1 --2- 172.21.15.37:0/1096039548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 0x55a721e07310 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdc40016010 tx=0x7fdc4001dc30 comp rx=0 tx=0).stop 2024-08-20T05:05:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.975+0000 7fdc518c2740 1 -- 172.21.15.37:0/1096039548 shutdown_connections 2024-08-20T05:05:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.976+0000 7fdc518c2740 1 --2- 172.21.15.37:0/1096039548 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a721e7dd90 0x55a721e801b0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.976+0000 7fdc518c2740 1 --2- 172.21.15.37:0/1096039548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a721e03390 0x55a721e07310 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.976+0000 7fdc518c2740 1 --2- 172.21.15.37:0/1096039548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a721df7400 0x55a721e06dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.976+0000 7fdc36000640 0 client.26369 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:29.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.976+0000 7fdc518c2740 1 --2- 172.21.15.37:0/1096039548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a721df6ae0 0x55a721e0b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.976+0000 7fdc518c2740 1 -- 172.21.15.37:0/1096039548 >> 172.21.15.37:0/1096039548 conn(0x55a721df4910 msgr2=0x55a721dfa360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:29.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.976+0000 7fdc518c2740 1 -- 172.21.15.37:0/1096039548 shutdown_connections 2024-08-20T05:05:29.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.977+0000 7fdc518c2740 1 -- 172.21.15.37:0/1096039548 wait complete. 2024-08-20T05:05:29.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.977+0000 7fdc518c2740 20 client.26369 trim_cache size 0 max 16384 2024-08-20T05:05:29.985 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:05:29.985 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T05:05:29.985 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-20T05:05:29.985 INFO:teuthology.orchestra.run.smithi037.stdout: "bff57296-4e25-4c74-83c3-018a9b1012e6": { 2024-08-20T05:05:29.986 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-20T05:05:29.986 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "bff57296-4e25-4c74-83c3-018a9b1012e6", 2024-08-20T05:05:29.986 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-20T05:05:29.986 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:05:29.986 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:05:29.986 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:05:29.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.984+0000 7fdc4d800640 1 -- 172.21.15.37:0/3701776242 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc2c0b3cf0 msgr2=0x7fdc2c0b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:29.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.984+0000 7fdc4d800640 1 --2- 172.21.15.37:0/3701776242 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc2c0b3cf0 0x7fdc2c0b61b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdc40021000 tx=0x7fdc4001e000 comp rx=0 tx=0).stop 2024-08-20T05:05:29.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.984+0000 7fdc4d800640 1 -- 172.21.15.37:0/3701776242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc48102920 msgr2=0x7fdc4819b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:29.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.984+0000 7fdc4d800640 1 --2- 172.21.15.37:0/3701776242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc48102920 0x7fdc4819b130 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdc38009fd0 tx=0x7fdc3800edd0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.985+0000 7fdc4d800640 1 -- 172.21.15.37:0/3701776242 shutdown_connections 2024-08-20T05:05:29.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.985+0000 7fdc4d800640 1 --2- 172.21.15.37:0/3701776242 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc2c0b3cf0 0x7fdc2c0b61b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.985+0000 7fdc4d800640 1 --2- 172.21.15.37:0/3701776242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc481a0a10 0x7fdc481a0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.985+0000 7fdc4d800640 1 --2- 172.21.15.37:0/3701776242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdc48108cb0 0x7fdc4819b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.985+0000 7fdc4d800640 1 --2- 172.21.15.37:0/3701776242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdc48102920 0x7fdc4819b130 secure :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdc38009fd0 tx=0x7fdc3800edd0 comp rx=0 tx=0).stop 2024-08-20T05:05:29.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.985+0000 7fdc4d800640 1 -- 172.21.15.37:0/3701776242 >> 172.21.15.37:0/3701776242 conn(0x7fdc480fe350 msgr2=0x7fdc48105910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:29.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.985+0000 7fdc4d800640 1 -- 172.21.15.37:0/3701776242 shutdown_connections 2024-08-20T05:05:29.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:29.986+0000 7fdc4d800640 1 -- 172.21.15.37:0/3701776242 wait complete. 2024-08-20T05:05:31.033 INFO:tasks.cephfs.filesystem:scrub status for tag:bff57296-4e25-4c74-83c3-018a9b1012e6 - {'path': '/', 'tag': 'bff57296-4e25-4c74-83c3-018a9b1012e6', 'options': 'recursive,force'} 2024-08-20T05:05:31.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:31 smithi135 ceph-mon[22342]: pgmap v499: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 6.5 MiB/s wr, 741 op/s 2024-08-20T05:05:31.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:31 smithi130 ceph-mon[22007]: pgmap v499: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 6.5 MiB/s wr, 741 op/s 2024-08-20T05:05:32.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:31 smithi037 ceph-mon[17265]: pgmap v499: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 6.5 MiB/s wr, 741 op/s 2024-08-20T05:05:33.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 155.0 s, 1108.8 tps, lat 89.836 ms stddev 117.155 2024-08-20T05:05:33.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:33 smithi135 ceph-mon[22342]: pgmap v500: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.5 MiB/s wr, 708 op/s 2024-08-20T05:05:33.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:33 smithi130 ceph-mon[22007]: pgmap v500: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.5 MiB/s wr, 708 op/s 2024-08-20T05:05:34.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:33 smithi037 ceph-mon[17265]: pgmap v500: 129 pgs: 129 active+clean; 1.0 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.5 MiB/s wr, 708 op/s 2024-08-20T05:05:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:35 smithi135 ceph-mon[22342]: pgmap v501: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.1 MiB/s wr, 746 op/s 2024-08-20T05:05:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:35 smithi130 ceph-mon[22007]: pgmap v501: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.1 MiB/s wr, 746 op/s 2024-08-20T05:05:36.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:35 smithi037 ceph-mon[17265]: pgmap v501: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.1 MiB/s wr, 746 op/s 2024-08-20T05:05:36.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:36 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:05:36.578 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:36 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:05:36.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:36 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:05:36.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:36 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:05:36.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:36 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:05:36.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:36 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:05:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:37 smithi135 ceph-mon[22342]: pgmap v502: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.1 MiB/s wr, 706 op/s 2024-08-20T05:05:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:37 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:05:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:37 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:05:37.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:37 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:05:37.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:37 smithi130 ceph-mon[22007]: pgmap v502: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.1 MiB/s wr, 706 op/s 2024-08-20T05:05:37.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:37 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:05:37.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:37 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:05:37.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:37 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:05:38.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:37 smithi037 ceph-mon[17265]: pgmap v502: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.1 MiB/s wr, 706 op/s 2024-08-20T05:05:38.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:37 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:05:38.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:37 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:05:38.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:37 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:05:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 160.0 s, 1323.4 tps, lat 75.472 ms stddev 92.880 2024-08-20T05:05:39.055 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.053+0000 7f3122600640 1 -- 172.21.15.37:0/1121383488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f311c10a840 msgr2=0x7f311c119dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.053+0000 7f3122600640 1 --2- 172.21.15.37:0/1121383488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f311c10a840 0x7f311c119dc0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3114009ca0 tx=0x7f311402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.054+0000 7f3122600640 1 -- 172.21.15.37:0/1121383488 shutdown_connections 2024-08-20T05:05:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.054+0000 7f3122600640 1 --2- 172.21.15.37:0/1121383488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f311c10a840 0x7f311c119dc0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.056 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.054+0000 7f3122600640 1 --2- 172.21.15.37:0/1121383488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f311c109e80 0x7f311c10a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.054+0000 7f3122600640 1 --2- 172.21.15.37:0/1121383488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f311c073fb0 0x7f311c0743b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.054+0000 7f3122600640 1 -- 172.21.15.37:0/1121383488 >> 172.21.15.37:0/1121383488 conn(0x7f311c06f740 msgr2=0x7f311c071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.054+0000 7f3122600640 1 -- 172.21.15.37:0/1121383488 shutdown_connections 2024-08-20T05:05:39.057 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.055+0000 7f3122600640 1 -- 172.21.15.37:0/1121383488 wait complete. 2024-08-20T05:05:39.059 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.058+0000 7f3122600640 1 Processor -- start 2024-08-20T05:05:39.060 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.058+0000 7f3122600640 1 -- start start 2024-08-20T05:05:39.061 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.059+0000 7f3122600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f311c073fb0 0x7f311c1a77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.061 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.059+0000 7f3122600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f311c109e80 0x7f311c1a7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.061 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.059+0000 7f3122600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f311c10a840 0x7f311c1a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.061 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.059+0000 7f3122600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f311c11d120 con 0x7f311c109e80 2024-08-20T05:05:39.061 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.059+0000 7f3122600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f311c11cfa0 con 0x7f311c10a840 2024-08-20T05:05:39.061 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.059+0000 7f3122600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f311c11d2a0 con 0x7f311c073fb0 2024-08-20T05:05:39.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.060+0000 7f311b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f311c073fb0 0x7f311c1a77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:39.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.060+0000 7f311b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f311c073fb0 0x7f311c1a77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:60684/0 (socket says 172.21.15.37:60684) 2024-08-20T05:05:39.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.060+0000 7f311b400640 1 -- 172.21.15.37:0/2144960056 learned_addr learned my addr 172.21.15.37:0/2144960056 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:39.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.060+0000 7f311be00640 1 --2- 172.21.15.37:0/2144960056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f311c10a840 0x7f311c1a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:39.062 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.060+0000 7f311b400640 1 -- 172.21.15.37:0/2144960056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f311c10a840 msgr2=0x7f311c1a8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:39.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.060+0000 7f311b400640 1 --2- 172.21.15.37:0/2144960056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f311c10a840 0x7f311c1a8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.060+0000 7f311b400640 1 -- 172.21.15.37:0/2144960056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f311c109e80 msgr2=0x7f311c1a7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:39.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.060+0000 7f311b400640 1 --2- 172.21.15.37:0/2144960056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f311c109e80 0x7f311c1a7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.060+0000 7f311b400640 1 -- 172.21.15.37:0/2144960056 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311c1a9320 con 0x7f311c073fb0 2024-08-20T05:05:39.063 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.061+0000 7f311b400640 1 --2- 172.21.15.37:0/2144960056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f311c073fb0 0x7f311c1a77e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f310c00e9f0 tx=0x7f310c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.061+0000 7f3113e00640 1 -- 172.21.15.37:0/2144960056 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c00cd80 con 0x7f311c073fb0 2024-08-20T05:05:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.062+0000 7f3113e00640 1 -- 172.21.15.37:0/2144960056 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f310c0054d0 con 0x7f311c073fb0 2024-08-20T05:05:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.062+0000 7f3122600640 1 -- 172.21.15.37:0/2144960056 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311c1a9610 con 0x7f311c073fb0 2024-08-20T05:05:39.064 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.062+0000 7f3113e00640 1 -- 172.21.15.37:0/2144960056 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c010690 con 0x7f311c073fb0 2024-08-20T05:05:39.066 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.062+0000 7f3122600640 1 -- 172.21.15.37:0/2144960056 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f311c1afce0 con 0x7f311c073fb0 2024-08-20T05:05:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.075+0000 7f31255c4740 1 Processor -- start 2024-08-20T05:05:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.075+0000 7f31255c4740 1 -- start start 2024-08-20T05:05:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.077+0000 7f3113e00640 1 -- 172.21.15.37:0/2144960056 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f310c004e90 con 0x7f311c073fb0 2024-08-20T05:05:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.077+0000 7f31255c4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0107610 0x5571a0109a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.077+0000 7f31255c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0109f40 0x5571a010c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.077+0000 7f31255c4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a010ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.077+0000 7f31255c4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5571a007a210 con 0x5571a0107610 2024-08-20T05:05:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.077+0000 7f31255c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5571a0069710 con 0x5571a0109f40 2024-08-20T05:05:39.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.077+0000 7f31255c4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5571a006d750 con 0x5571a010c980 2024-08-20T05:05:39.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.078+0000 7f311b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0109f40 0x5571a010c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:39.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.078+0000 7f311b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0109f40 0x5571a010c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:46554/0 (socket says 172.21.15.37:46554) 2024-08-20T05:05:39.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.078+0000 7f311b400640 1 -- 172.21.15.37:0/3263811576 learned_addr learned my addr 172.21.15.37:0/3263811576 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:39.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.079+0000 7f3113e00640 1 --2- 172.21.15.37:0/2144960056 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f31000b3cd0 0x7f31000b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.079+0000 7f311b400640 1 -- 172.21.15.37:0/3263811576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 msgr2=0x5571a010ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:39.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.079+0000 7f311b400640 1 --2- 172.21.15.37:0/3263811576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a010ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.079+0000 7f311b400640 1 -- 172.21.15.37:0/3263811576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0107610 msgr2=0x5571a0109a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:39.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.079+0000 7f311b400640 1 --2- 172.21.15.37:0/3263811576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0107610 0x5571a0109a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.079+0000 7f311b400640 1 -- 172.21.15.37:0/3263811576 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571a0035de0 con 0x5571a0109f40 2024-08-20T05:05:39.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.080+0000 7f311b400640 1 --2- 172.21.15.37:0/3263811576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0109f40 0x5571a010c330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f310c0ec380 tx=0x7f310c0ec470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84893c638994b2c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:39.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.081+0000 7f3113e00640 1 -- 172.21.15.37:0/2144960056 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f310c0e4400 con 0x7f311c073fb0 2024-08-20T05:05:39.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.083+0000 7f3110c00640 1 -- 172.21.15.37:0/3263811576 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c0a6e10 con 0x5571a0109f40 2024-08-20T05:05:39.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.084+0000 7f3110c00640 1 -- 172.21.15.37:0/3263811576 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f310c0aaa60 con 0x5571a0109f40 2024-08-20T05:05:39.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.084+0000 7f3110c00640 1 -- 172.21.15.37:0/3263811576 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c0a6e10 con 0x5571a0109f40 2024-08-20T05:05:39.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.086+0000 7f31255c4740 1 -- 172.21.15.37:0/3263811576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0109f40 msgr2=0x5571a010c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:39.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.086+0000 7f31255c4740 1 --2- 172.21.15.37:0/3263811576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0109f40 0x5571a010c330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f310c0ec380 tx=0x7f310c0ec470 comp rx=0 tx=0).stop 2024-08-20T05:05:39.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.086+0000 7f31255c4740 1 -- 172.21.15.37:0/3263811576 shutdown_connections 2024-08-20T05:05:39.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.086+0000 7f31255c4740 1 --2- 172.21.15.37:0/3263811576 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a010ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.086+0000 7f31255c4740 1 --2- 172.21.15.37:0/3263811576 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0109f40 0x5571a010c330 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.086+0000 7f31255c4740 1 --2- 172.21.15.37:0/3263811576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0107610 0x5571a0109a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.086+0000 7f31255c4740 1 -- 172.21.15.37:0/3263811576 >> 172.21.15.37:0/3263811576 conn(0x5571a0102760 msgr2=0x5571a01034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.086+0000 7f311be00640 1 --2- 172.21.15.37:0/2144960056 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f31000b3cd0 0x7f31000b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:39.089 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.087+0000 7f31255c4740 1 -- 172.21.15.37:0/3263811576 shutdown_connections 2024-08-20T05:05:39.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.087+0000 7f31255c4740 1 -- 172.21.15.37:0/3263811576 wait complete. 2024-08-20T05:05:39.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.087+0000 7f31255c4740 1 -- start start 2024-08-20T05:05:39.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.088+0000 7f31255c4740 1 Processor -- start 2024-08-20T05:05:39.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.088+0000 7f311be00640 1 --2- 172.21.15.37:0/2144960056 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f31000b3cd0 0x7f31000b6190 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3114005e30 tx=0x7f31140095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:39.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.088+0000 7f31255c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0107610 0x5571a0110c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.089+0000 7f31255c4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0109f40 0x5571a0111320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.089+0000 7f31255c4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0111ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.089+0000 7f31255c4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55719ffa2ab0 con 0x5571a0109f40 2024-08-20T05:05:39.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.089+0000 7f31255c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5571a0010140 con 0x5571a0107610 2024-08-20T05:05:39.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.089+0000 7f31255c4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5571a010f960 con 0x5571a010c980 2024-08-20T05:05:39.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.089+0000 7f31255c4740 10 client.0 _ll_register_callbacks cb 0x5571a00235d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:39.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.089+0000 7f311be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0111ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.089+0000 7f311be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0111ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:60706/0 (socket says 172.21.15.37:60706) 2024-08-20T05:05:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.089+0000 7f311be00640 1 -- 172.21.15.37:0/430663270 learned_addr learned my addr 172.21.15.37:0/430663270 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.089+0000 7f311aa00640 1 --2- 172.21.15.37:0/430663270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0109f40 0x5571a0111320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:39.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.090+0000 7f311b400640 1 --2- 172.21.15.37:0/430663270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0107610 0x5571a0110c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.090+0000 7f311b400640 1 -- 172.21.15.37:0/430663270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 msgr2=0x5571a0111ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.090+0000 7f311b400640 1 --2- 172.21.15.37:0/430663270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0111ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.090+0000 7f311b400640 1 -- 172.21.15.37:0/430663270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0109f40 msgr2=0x5571a0111320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.091+0000 7f311b400640 1 --2- 172.21.15.37:0/430663270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0109f40 0x5571a0111320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.091+0000 7f311b400640 1 -- 172.21.15.37:0/430663270 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571a0011170 con 0x5571a0107610 2024-08-20T05:05:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.091+0000 7f311be00640 1 --2- 172.21.15.37:0/430663270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0111ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:39.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.091+0000 7f311aa00640 1 --2- 172.21.15.37:0/430663270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0109f40 0x5571a0111320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:39.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.095+0000 7f311b400640 1 --2- 172.21.15.37:0/430663270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0107610 0x5571a0110c80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f310c0e7fa0 tx=0x7f310c0e7b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b41604a0d2be7f74 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:39.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.095+0000 7f3105600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:05:39.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.095+0000 7f3105600640 1 -- 172.21.15.37:0/430663270 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310c0a6e10 con 0x5571a0107610 2024-08-20T05:05:39.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.095+0000 7f31255c4740 1 -- 172.21.15.37:0/430663270 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f310c0aaa60 con 0x5571a0107610 2024-08-20T05:05:39.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.095+0000 7f3105600640 1 -- 172.21.15.37:0/430663270 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f310c0e4120 con 0x5571a0107610 2024-08-20T05:05:39.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.096+0000 7f3105600640 1 -- 172.21.15.37:0/430663270 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f310c005180 con 0x5571a0107610 2024-08-20T05:05:39.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.096+0000 7f31255c4740 10 client.26381 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:39.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.096+0000 7f31255c4740 1 -- 172.21.15.37:0/430663270 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55719fdcc790 con 0x5571a0107610 2024-08-20T05:05:39.100 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.099+0000 7f3105600640 1 -- 172.21.15.37:0/430663270 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f310c0aaa60 con 0x5571a0107610 2024-08-20T05:05:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.099+0000 7f3105600640 1 -- 172.21.15.37:0/430663270 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f310c0ab1b0 con 0x5571a0107610 2024-08-20T05:05:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.100+0000 7f31255c4740 10 client.26381 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.100+0000 7f31255c4740 10 client.26381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:05:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.100+0000 7f31255c4740 20 client.26381 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.100+0000 7f31255c4740 1 --2- 172.21.15.37:0/430663270 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5571a011c4a0 0x5571a011e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.100+0000 7f31255c4740 4 client.26381 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:05:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.100+0000 7f31255c4740 1 -- 172.21.15.37:0/430663270 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571a007c160 con 0x5571a011c4a0 2024-08-20T05:05:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.101+0000 7f311aa00640 1 --2- 172.21.15.37:0/430663270 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5571a011c4a0 0x5571a011e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:39.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.103+0000 7f311aa00640 1 --2- 172.21.15.37:0/430663270 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5571a011c4a0 0x5571a011e8e0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b497e59fee8fed8 server_cookie=c2f8d2d32fd24279 in_seq=0 out_seq=0 2024-08-20T05:05:39.104 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.103+0000 7f3105600640 10 client.26381 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.104+0000 7f3105600640 1 -- 172.21.15.37:0/430663270 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5571a007c160 con 0x5571a011c4a0 2024-08-20T05:05:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.104+0000 7f3105600640 10 client.26381 handle_command_reply: tid=0 2024-08-20T05:05:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.104+0000 7f31255c4740 1 client.26381 shutdown 2024-08-20T05:05:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.104+0000 7f31255c4740 1 -- 172.21.15.37:0/430663270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0107610 msgr2=0x5571a0110c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:39.106 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.104+0000 7f31255c4740 1 --2- 172.21.15.37:0/430663270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0107610 0x5571a0110c80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f310c0e7fa0 tx=0x7f310c0e7b90 comp rx=0 tx=0).stop 2024-08-20T05:05:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.105+0000 7f31255c4740 1 -- 172.21.15.37:0/430663270 shutdown_connections 2024-08-20T05:05:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.105+0000 7f31255c4740 1 --2- 172.21.15.37:0/430663270 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5571a011c4a0 0x5571a011e8e0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.105+0000 7f31255c4740 1 --2- 172.21.15.37:0/430663270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0111ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.105+0000 7f31255c4740 1 --2- 172.21.15.37:0/430663270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0109f40 0x5571a0111320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.105+0000 7f31255c4740 1 --2- 172.21.15.37:0/430663270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0107610 0x5571a0110c80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.105+0000 7f3105600640 0 client.26381 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.105+0000 7f31255c4740 1 -- 172.21.15.37:0/430663270 >> 172.21.15.37:0/430663270 conn(0x5571a0102760 msgr2=0x5571a0101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.106+0000 7f31255c4740 1 -- 172.21.15.37:0/430663270 shutdown_connections 2024-08-20T05:05:39.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.106+0000 7f31255c4740 1 -- 172.21.15.37:0/430663270 wait complete. 2024-08-20T05:05:39.109 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.107+0000 7f31255c4740 20 client.26381 trim_cache size 0 max 16384 2024-08-20T05:05:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.150+0000 7f31255c4740 1 Processor -- start 2024-08-20T05:05:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.150+0000 7f31255c4740 1 -- start start 2024-08-20T05:05:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.150+0000 7f31255c4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0107610 0x5571a010fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.150+0000 7f31255c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0109f40 0x5571a0100f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.150+0000 7f31255c4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0101480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.150+0000 7f31255c4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1ba1a0 con 0x5571a0107610 2024-08-20T05:05:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.150+0000 7f31255c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1bbda0 con 0x5571a0109f40 2024-08-20T05:05:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.150+0000 7f31255c4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1ba870 con 0x5571a010c980 2024-08-20T05:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.150+0000 7f311be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.151+0000 7f311be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:60712/0 (socket says 172.21.15.37:60712) 2024-08-20T05:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.151+0000 7f311be00640 1 -- 172.21.15.37:0/756525548 learned_addr learned my addr 172.21.15.37:0/756525548 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.151+0000 7f311b400640 1 --2- 172.21.15.37:0/756525548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0107610 0x5571a010fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.151+0000 7f311aa00640 1 --2- 172.21.15.37:0/756525548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0109f40 0x5571a0100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.151+0000 7f311be00640 1 -- 172.21.15.37:0/756525548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0109f40 msgr2=0x5571a0100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.151+0000 7f311be00640 1 --2- 172.21.15.37:0/756525548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0109f40 0x5571a0100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.151+0000 7f311be00640 1 -- 172.21.15.37:0/756525548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0107610 msgr2=0x5571a010fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.151+0000 7f311be00640 1 --2- 172.21.15.37:0/756525548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0107610 0x5571a010fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.151+0000 7f311be00640 1 -- 172.21.15.37:0/756525548 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55719fe45620 con 0x5571a010c980 2024-08-20T05:05:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.151+0000 7f311b400640 1 --2- 172.21.15.37:0/756525548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0107610 0x5571a010fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.152+0000 7f311be00640 1 --2- 172.21.15.37:0/756525548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0101480 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3114031a20 tx=0x7f3114040000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45e4519809c4c01 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.152+0000 7f3107e00640 1 -- 172.21.15.37:0/756525548 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114051070 con 0x5571a010c980 2024-08-20T05:05:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.153+0000 7f3107e00640 1 -- 172.21.15.37:0/756525548 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3114036040 con 0x5571a010c980 2024-08-20T05:05:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.153+0000 7f3107e00640 1 -- 172.21.15.37:0/756525548 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311402f870 con 0x5571a010c980 2024-08-20T05:05:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.154+0000 7f31255c4740 1 -- 172.21.15.37:0/756525548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 msgr2=0x5571a0101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.154+0000 7f31255c4740 1 --2- 172.21.15.37:0/756525548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0101480 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3114031a20 tx=0x7f3114040000 comp rx=0 tx=0).stop 2024-08-20T05:05:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.154+0000 7f31255c4740 1 -- 172.21.15.37:0/756525548 shutdown_connections 2024-08-20T05:05:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.154+0000 7f31255c4740 1 --2- 172.21.15.37:0/756525548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0101480 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.154+0000 7f31255c4740 1 --2- 172.21.15.37:0/756525548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0109f40 0x5571a0100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.155+0000 7f31255c4740 1 --2- 172.21.15.37:0/756525548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0107610 0x5571a010fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.155+0000 7f31255c4740 1 -- 172.21.15.37:0/756525548 >> 172.21.15.37:0/756525548 conn(0x5571a0102760 msgr2=0x5571a0106a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.155+0000 7f31255c4740 1 -- 172.21.15.37:0/756525548 shutdown_connections 2024-08-20T05:05:39.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.156+0000 7f31255c4740 1 -- 172.21.15.37:0/756525548 wait complete. 2024-08-20T05:05:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.157+0000 7f31255c4740 1 -- start start 2024-08-20T05:05:39.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.157+0000 7f31255c4740 1 Processor -- start 2024-08-20T05:05:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.158+0000 7f31255c4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0107610 0x5571a0115e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.158+0000 7f31255c4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0109f40 0x5571a01164b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.158+0000 7f31255c4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0117030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.158+0000 7f31255c4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1bb610 con 0x5571a0107610 2024-08-20T05:05:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.158+0000 7f31255c4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1baf40 con 0x5571a0109f40 2024-08-20T05:05:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.158+0000 7f31255c4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f311c1b8180 con 0x5571a010c980 2024-08-20T05:05:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.158+0000 7f31255c4740 10 client.0 _ll_register_callbacks cb 0x7f310c0ec1d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:39.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.158+0000 7f311aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0109f40 0x5571a01164b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:39.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.158+0000 7f311be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0117030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:39.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.158+0000 7f311be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0117030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:60718/0 (socket says 172.21.15.37:60718) 2024-08-20T05:05:39.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.158+0000 7f311be00640 1 -- 172.21.15.37:0/1861523799 learned_addr learned my addr 172.21.15.37:0/1861523799 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:39.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.159+0000 7f311be00640 1 -- 172.21.15.37:0/1861523799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0109f40 msgr2=0x5571a01164b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:39.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.159+0000 7f311be00640 1 --2- 172.21.15.37:0/1861523799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0109f40 0x5571a01164b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.159+0000 7f311be00640 1 -- 172.21.15.37:0/1861523799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0107610 msgr2=0x5571a0115e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.159+0000 7f311be00640 1 --2- 172.21.15.37:0/1861523799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0107610 0x5571a0115e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.159+0000 7f311be00640 1 -- 172.21.15.37:0/1861523799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571a0117860 con 0x5571a010c980 2024-08-20T05:05:39.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.161+0000 7f311be00640 1 --2- 172.21.15.37:0/1861523799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0117030 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f311402f9e0 tx=0x7f311402fa10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f52fa130bf4478cd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:39.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.162+0000 7f3105600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:05:39.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.162+0000 7f3105600640 1 -- 172.21.15.37:0/1861523799 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114051070 con 0x5571a010c980 2024-08-20T05:05:39.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.162+0000 7f31255c4740 1 -- 172.21.15.37:0/1861523799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3114036040 con 0x5571a010c980 2024-08-20T05:05:39.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.162+0000 7f3105600640 1 -- 172.21.15.37:0/1861523799 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f31140305c0 con 0x5571a010c980 2024-08-20T05:05:39.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.163+0000 7f3105600640 1 -- 172.21.15.37:0/1861523799 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3114064050 con 0x5571a010c980 2024-08-20T05:05:39.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.163+0000 7f31255c4740 10 client.26431 fetch_fsmap learned FSMap version 33 2024-08-20T05:05:39.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.163+0000 7f31255c4740 1 -- 172.21.15.37:0/1861523799 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5571a0118c70 con 0x5571a010c980 2024-08-20T05:05:39.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.163+0000 7f3105600640 1 -- 172.21.15.37:0/1861523799 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3114036040 con 0x5571a010c980 2024-08-20T05:05:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.165+0000 7f3105600640 1 -- 172.21.15.37:0/1861523799 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 33) ==== 8386+0+0 (secure 0 0 0) 0x7f3114056a60 con 0x5571a010c980 2024-08-20T05:05:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.165+0000 7f31255c4740 10 client.26431 fetch_fsmap finished waiting for FSMap version 33 2024-08-20T05:05:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.165+0000 7f31255c4740 10 client.26431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:05:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.165+0000 7f31255c4740 20 client.26431 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.165+0000 7f31255c4740 1 --2- 172.21.15.37:0/1861523799 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5571a0187540 0x5571a0189960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.165+0000 7f31255c4740 4 client.26431 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:05:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.165+0000 7f31255c4740 1 -- 172.21.15.37:0/1861523799 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5571a0077c00 con 0x5571a0187540 2024-08-20T05:05:39.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.166+0000 7f311b400640 1 --2- 172.21.15.37:0/1861523799 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5571a0187540 0x5571a0189960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.168+0000 7f3105600640 10 client.26431 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:39.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.168+0000 7f311b400640 1 --2- 172.21.15.37:0/1861523799 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5571a0187540 0x5571a0189960 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7498c34be0337c server_cookie=3e4e3e3f8c7981b6 in_seq=0 out_seq=0 2024-08-20T05:05:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.180+0000 7f3105600640 1 -- 172.21.15.37:0/1861523799 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5571a0077c00 con 0x5571a0187540 2024-08-20T05:05:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.180+0000 7f3105600640 10 client.26431 handle_command_reply: tid=0 2024-08-20T05:05:39.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.180+0000 7f31255c4740 1 client.26431 shutdown 2024-08-20T05:05:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.180+0000 7f31255c4740 1 -- 172.21.15.37:0/1861523799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 msgr2=0x5571a0117030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.180+0000 7f31255c4740 1 --2- 172.21.15.37:0/1861523799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0117030 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f311402f9e0 tx=0x7f311402fa10 comp rx=0 tx=0).stop 2024-08-20T05:05:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.180+0000 7f31255c4740 1 -- 172.21.15.37:0/1861523799 shutdown_connections 2024-08-20T05:05:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.180+0000 7f31255c4740 1 --2- 172.21.15.37:0/1861523799 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5571a0187540 0x5571a0189960 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.180+0000 7f31255c4740 1 --2- 172.21.15.37:0/1861523799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5571a010c980 0x5571a0117030 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.180+0000 7f3105600640 0 client.26431 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.180+0000 7f31255c4740 1 --2- 172.21.15.37:0/1861523799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5571a0109f40 0x5571a01164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.180+0000 7f31255c4740 1 --2- 172.21.15.37:0/1861523799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5571a0107610 0x5571a0115e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.180+0000 7f31255c4740 1 -- 172.21.15.37:0/1861523799 >> 172.21.15.37:0/1861523799 conn(0x5571a0102760 msgr2=0x5571a0101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.180+0000 7f31255c4740 1 -- 172.21.15.37:0/1861523799 shutdown_connections 2024-08-20T05:05:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.180+0000 7f31255c4740 1 -- 172.21.15.37:0/1861523799 wait complete. 2024-08-20T05:05:39.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.181+0000 7f31255c4740 20 client.26431 trim_cache size 0 max 16384 2024-08-20T05:05:39.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:05:39.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:05:39.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:05:39.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:05:39.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.181+0000 7f3122600640 1 -- 172.21.15.37:0/2144960056 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f31000b3cd0 msgr2=0x7f31000b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:39.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.181+0000 7f3122600640 1 --2- 172.21.15.37:0/2144960056 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f31000b3cd0 0x7f31000b6190 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3114005e30 tx=0x7f31140095c0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.181+0000 7f3122600640 1 -- 172.21.15.37:0/2144960056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f311c073fb0 msgr2=0x7f311c1a77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:39.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.181+0000 7f3122600640 1 --2- 172.21.15.37:0/2144960056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f311c073fb0 0x7f311c1a77e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f310c00e9f0 tx=0x7f310c00edf0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.181+0000 7f3122600640 1 -- 172.21.15.37:0/2144960056 shutdown_connections 2024-08-20T05:05:39.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.181+0000 7f3122600640 1 --2- 172.21.15.37:0/2144960056 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f31000b3cd0 0x7f31000b6190 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.181+0000 7f3122600640 1 --2- 172.21.15.37:0/2144960056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f311c10a840 0x7f311c1a8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.181+0000 7f3122600640 1 --2- 172.21.15.37:0/2144960056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f311c109e80 0x7f311c1a7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.181+0000 7f3122600640 1 --2- 172.21.15.37:0/2144960056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f311c073fb0 0x7f311c1a77e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:39.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.181+0000 7f3122600640 1 -- 172.21.15.37:0/2144960056 >> 172.21.15.37:0/2144960056 conn(0x7f311c06f740 msgr2=0x7f311c0711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:39.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.182+0000 7f3122600640 1 -- 172.21.15.37:0/2144960056 shutdown_connections 2024-08-20T05:05:39.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:39.182+0000 7f3122600640 1 -- 172.21.15.37:0/2144960056 wait complete. 2024-08-20T05:05:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:39 smithi135 ceph-mon[22342]: pgmap v503: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 6.0 MiB/s wr, 692 op/s 2024-08-20T05:05:39.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:39 smithi130 ceph-mon[22007]: pgmap v503: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 6.0 MiB/s wr, 692 op/s 2024-08-20T05:05:40.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:39 smithi037 ceph-mon[17265]: pgmap v503: 129 pgs: 129 active+clean; 1.0 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 6.0 MiB/s wr, 692 op/s 2024-08-20T05:05:41.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:41 smithi135 ceph-mon[22342]: pgmap v504: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 6.4 MiB/s wr, 765 op/s 2024-08-20T05:05:41.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:41 smithi130 ceph-mon[22007]: pgmap v504: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 6.4 MiB/s wr, 765 op/s 2024-08-20T05:05:42.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:41 smithi037 ceph-mon[17265]: pgmap v504: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 6.4 MiB/s wr, 765 op/s 2024-08-20T05:05:43.045 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 165.0 s, 1479.1 tps, lat 68.045 ms stddev 80.087 2024-08-20T05:05:43.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:43 smithi135 ceph-mon[22342]: pgmap v505: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.6 MiB/s wr, 609 op/s 2024-08-20T05:05:43.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:43 smithi130 ceph-mon[22007]: pgmap v505: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.6 MiB/s wr, 609 op/s 2024-08-20T05:05:44.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:43 smithi037 ceph-mon[17265]: pgmap v505: 129 pgs: 129 active+clean; 1.0 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.6 MiB/s wr, 609 op/s 2024-08-20T05:05:45.198 INFO:tasks.quiescer.fs.[cephfs]:Total duration (39.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-20T05:05:45.198 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.85 2024-08-20T05:05:45.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:05:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:45 smithi135 ceph-mon[22342]: pgmap v506: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.9 MiB/s wr, 615 op/s 2024-08-20T05:05:45.915 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:05:45.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:45 smithi130 ceph-mon[22007]: pgmap v506: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.9 MiB/s wr, 615 op/s 2024-08-20T05:05:46.019 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:45 smithi037 ceph-mon[17265]: pgmap v506: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.9 MiB/s wr, 615 op/s 2024-08-20T05:05:46.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.747+0000 7f1fd3600640 1 -- 172.21.15.37:0/2471959948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fcc10ce00 msgr2=0x7f1fcc10f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:46.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.747+0000 7f1fd3600640 1 --2- 172.21.15.37:0/2471959948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fcc10ce00 0x7f1fcc10f260 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009ca0 tx=0x7f1fc402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:05:46.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.747+0000 7f1fd3600640 1 -- 172.21.15.37:0/2471959948 shutdown_connections 2024-08-20T05:05:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.747+0000 7f1fd3600640 1 --2- 172.21.15.37:0/2471959948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fcc10ce00 0x7f1fcc10f260 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.747+0000 7f1fd3600640 1 --2- 172.21.15.37:0/2471959948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fcc1042c0 0x7f1fcc10c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.747+0000 7f1fd3600640 1 --2- 172.21.15.37:0/2471959948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fcc1039a0 0x7f1fcc103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.747+0000 7f1fd3600640 1 -- 172.21.15.37:0/2471959948 >> 172.21.15.37:0/2471959948 conn(0x7f1fcc0fd400 msgr2=0x7f1fcc0ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.748+0000 7f1fd3600640 1 -- 172.21.15.37:0/2471959948 shutdown_connections 2024-08-20T05:05:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.748+0000 7f1fd3600640 1 -- 172.21.15.37:0/2471959948 wait complete. 2024-08-20T05:05:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.749+0000 7f1fd3600640 1 Processor -- start 2024-08-20T05:05:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.750+0000 7f1fd3600640 1 -- start start 2024-08-20T05:05:46.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.752+0000 7f1fd3600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fcc1039a0 0x7f1fcc10c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:46.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.753+0000 7f1fd3600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fcc1042c0 0x7f1fcc109740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.754+0000 7f1fd3600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fcc10ce00 0x7f1fcc109c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.754+0000 7f1fd1600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fcc10ce00 0x7f1fcc109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.754+0000 7f1fd1600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fcc10ce00 0x7f1fcc109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:58062/0 (socket says 172.21.15.37:58062) 2024-08-20T05:05:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.756+0000 7f1fd3600640 1 -- 172.21.15.37:0/3639859409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc102f80 con 0x7f1fcc1039a0 2024-08-20T05:05:46.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.756+0000 7f1fd3600640 1 -- 172.21.15.37:0/3639859409 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc102e00 con 0x7f1fcc1042c0 2024-08-20T05:05:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.756+0000 7f1fd3600640 1 -- 172.21.15.37:0/3639859409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc103100 con 0x7f1fcc10ce00 2024-08-20T05:05:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.756+0000 7f1fd1600640 1 -- 172.21.15.37:0/3639859409 learned_addr learned my addr 172.21.15.37:0/3639859409 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.756+0000 7f1fd0c00640 1 --2- 172.21.15.37:0/3639859409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fcc1039a0 0x7f1fcc10c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:46.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.756+0000 7f1fcbe00640 1 --2- 172.21.15.37:0/3639859409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fcc1042c0 0x7f1fcc109740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:46.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.758+0000 7f1fcbe00640 1 -- 172.21.15.37:0/3639859409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fcc10ce00 msgr2=0x7f1fcc109c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.758+0000 7f1fcbe00640 1 --2- 172.21.15.37:0/3639859409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fcc10ce00 0x7f1fcc109c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.758+0000 7f1fcbe00640 1 -- 172.21.15.37:0/3639859409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fcc1039a0 msgr2=0x7f1fcc10c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.758+0000 7f1fcbe00640 1 --2- 172.21.15.37:0/3639859409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fcc1039a0 0x7f1fcc10c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.758+0000 7f1fcbe00640 1 -- 172.21.15.37:0/3639859409 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fcc10a4b0 con 0x7f1fcc1042c0 2024-08-20T05:05:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.758+0000 7f1fd0c00640 1 --2- 172.21.15.37:0/3639859409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fcc1039a0 0x7f1fcc10c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.760+0000 7f1fcbe00640 1 --2- 172.21.15.37:0/3639859409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fcc1042c0 0x7f1fcc109740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800e770 tx=0x7f1fb800ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:46.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.761+0000 7f1fc9600640 1 -- 172.21.15.37:0/3639859409 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800ccc0 con 0x7f1fcc1042c0 2024-08-20T05:05:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.761+0000 7f1fd3600640 1 -- 172.21.15.37:0/3639859409 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fcc11c340 con 0x7f1fcc1042c0 2024-08-20T05:05:46.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.761+0000 7f1fc9600640 1 -- 172.21.15.37:0/3639859409 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1fb8009530 con 0x7f1fcc1042c0 2024-08-20T05:05:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.761+0000 7f1fd3600640 1 -- 172.21.15.37:0/3639859409 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fcc11c8d0 con 0x7f1fcc1042c0 2024-08-20T05:05:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.761+0000 7f1fc9600640 1 -- 172.21.15.37:0/3639859409 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8003e40 con 0x7f1fcc1042c0 2024-08-20T05:05:46.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.763+0000 7f1fd3600640 1 -- 172.21.15.37:0/3639859409 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fac0052c0 con 0x7f1fcc1042c0 2024-08-20T05:05:46.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.770+0000 7f1fc9600640 1 -- 172.21.15.37:0/3639859409 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1fb80035f0 con 0x7f1fcc1042c0 2024-08-20T05:05:46.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.775+0000 7f1fc9600640 1 --2- 172.21.15.37:0/3639859409 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1fb00b3bd0 0x7f1fb00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:46.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.775+0000 7f1fc9600640 1 -- 172.21.15.37:0/3639859409 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1fb80e40b0 con 0x7f1fcc1042c0 2024-08-20T05:05:46.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.776+0000 7f1fc9600640 1 -- 172.21.15.37:0/3639859409 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f1fb80e45b0 con 0x7f1fcc1042c0 2024-08-20T05:05:46.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.776+0000 7f1fd0c00640 1 --2- 172.21.15.37:0/3639859409 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1fb00b3bd0 0x7f1fb00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:46.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:46.777+0000 7f1fd0c00640 1 --2- 172.21.15.37:0/3639859409 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1fb00b3bd0 0x7f1fb00b6090 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009fc0 tx=0x7f1fbc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:47.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:47.231+0000 7f1fd3600640 1 -- 172.21.15.37:0/3639859409 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fac0055b0 con 0x7f1fcc1042c0 2024-08-20T05:05:47.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:47.232+0000 7f1fc9600640 1 -- 172.21.15.37:0/3639859409 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11985 (secure 0 0 0) 0x7f1fb80ab3f0 con 0x7f1fcc1042c0 2024-08-20T05:05:47.238 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:05:47.238 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 34 2024-08-20T05:05:47.238 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"btime":"2024-08-20T05:05:46:612786+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:05:46.276531+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:05:47.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:47.237+0000 7f1fd3600640 1 -- 172.21.15.37:0/3639859409 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1fb00b3bd0 msgr2=0x7f1fb00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:47.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:47.237+0000 7f1fd3600640 1 --2- 172.21.15.37:0/3639859409 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1fb00b3bd0 0x7f1fb00b6090 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc009fc0 tx=0x7f1fbc005f90 comp rx=0 tx=0).stop 2024-08-20T05:05:47.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:47.237+0000 7f1fd3600640 1 -- 172.21.15.37:0/3639859409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fcc1042c0 msgr2=0x7f1fcc109740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:47.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:47.237+0000 7f1fd3600640 1 --2- 172.21.15.37:0/3639859409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fcc1042c0 0x7f1fcc109740 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1fb800e770 tx=0x7f1fb800ec30 comp rx=0 tx=0).stop 2024-08-20T05:05:47.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:47.237+0000 7f1fd3600640 1 -- 172.21.15.37:0/3639859409 shutdown_connections 2024-08-20T05:05:47.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:47.237+0000 7f1fd3600640 1 --2- 172.21.15.37:0/3639859409 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1fb00b3bd0 0x7f1fb00b6090 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:47.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:47.237+0000 7f1fd3600640 1 --2- 172.21.15.37:0/3639859409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1fcc10ce00 0x7f1fcc109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:47.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:47.237+0000 7f1fd3600640 1 --2- 172.21.15.37:0/3639859409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1fcc1042c0 0x7f1fcc109740 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:47.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:47.237+0000 7f1fd3600640 1 --2- 172.21.15.37:0/3639859409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fcc1039a0 0x7f1fcc10c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:47.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:47.237+0000 7f1fd3600640 1 -- 172.21.15.37:0/3639859409 >> 172.21.15.37:0/3639859409 conn(0x7f1fcc0fd400 msgr2=0x7f1fcc111020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:47.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:47.238+0000 7f1fd3600640 1 -- 172.21.15.37:0/3639859409 shutdown_connections 2024-08-20T05:05:47.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:47.239+0000 7f1fd3600640 1 -- 172.21.15.37:0/3639859409 wait complete. 2024-08-20T05:05:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:47 smithi130 ceph-mon[22007]: pgmap v507: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.7 MiB/s wr, 577 op/s 2024-08-20T05:05:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:47 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:05:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:47 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3639859409' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:05:48.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:47 smithi037 ceph-mon[17265]: pgmap v507: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.7 MiB/s wr, 577 op/s 2024-08-20T05:05:48.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:47 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:05:48.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:47 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3639859409' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:05:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 170.0 s, 1379.1 tps, lat 72.297 ms stddev 86.083 2024-08-20T05:05:48.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:47 smithi135 ceph-mon[22342]: pgmap v507: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.7 MiB/s wr, 577 op/s 2024-08-20T05:05:48.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:47 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:05:48.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:47 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3639859409' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:05:48.319 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 139.85 --await-for 45.0' 2024-08-20T05:05:48.320 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 139.85 --await-for 45.0 2024-08-20T05:05:49.006 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:05:49.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:49 smithi037 ceph-mon[17265]: pgmap v508: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 573 op/s 2024-08-20T05:05:49.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:49 smithi130 ceph-mon[22007]: pgmap v508: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 573 op/s 2024-08-20T05:05:50.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:49 smithi135 ceph-mon[22342]: pgmap v508: 129 pgs: 129 active+clean; 1.0 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 573 op/s 2024-08-20T05:05:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.612+0000 7f968c800640 1 -- 172.21.15.37:0/4143253008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9684108e40 msgr2=0x7f968410f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.612+0000 7f968c800640 1 --2- 172.21.15.37:0/4143253008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9684108e40 0x7f968410f640 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9680009ca0 tx=0x7f968002a8d0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.612+0000 7f968c800640 1 -- 172.21.15.37:0/4143253008 shutdown_connections 2024-08-20T05:05:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.612+0000 7f968c800640 1 --2- 172.21.15.37:0/4143253008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9684108e40 0x7f968410f640 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.612+0000 7f968c800640 1 --2- 172.21.15.37:0/4143253008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96841084c0 0x7f9684108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.612+0000 7f968c800640 1 --2- 172.21.15.37:0/4143253008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9684102ab0 0x7f9684102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.612+0000 7f968c800640 1 -- 172.21.15.37:0/4143253008 >> 172.21.15.37:0/4143253008 conn(0x7f96840fe500 msgr2=0x7f9684100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.613+0000 7f968c800640 1 -- 172.21.15.37:0/4143253008 shutdown_connections 2024-08-20T05:05:50.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.613+0000 7f968c800640 1 -- 172.21.15.37:0/4143253008 wait complete. 2024-08-20T05:05:50.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.615+0000 7f968c800640 1 Processor -- start 2024-08-20T05:05:50.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.616+0000 7f968c800640 1 -- start start 2024-08-20T05:05:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.617+0000 7f968c800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9684102ab0 0x7f968410e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.617+0000 7f968c800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96841084c0 0x7f968410ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.618+0000 7f968c800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9684108e40 0x7f96841a1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.618+0000 7f9689e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9684102ab0 0x7f968410e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:50.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.618+0000 7f9689e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9684102ab0 0x7f968410e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:58084/0 (socket says 172.21.15.37:58084) 2024-08-20T05:05:50.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.618+0000 7f968c800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9684112b50 con 0x7f96841084c0 2024-08-20T05:05:50.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.618+0000 7f968c800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f96841129d0 con 0x7f9684108e40 2024-08-20T05:05:50.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.618+0000 7f968c800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9684112cd0 con 0x7f9684102ab0 2024-08-20T05:05:50.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.618+0000 7f9689e00640 1 -- 172.21.15.37:0/2100489657 learned_addr learned my addr 172.21.15.37:0/2100489657 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:50.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.619+0000 7f968a800640 1 --2- 172.21.15.37:0/2100489657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9684108e40 0x7f96841a1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.619+0000 7f9689400640 1 --2- 172.21.15.37:0/2100489657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96841084c0 0x7f968410ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.619+0000 7f968a800640 1 -- 172.21.15.37:0/2100489657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9684102ab0 msgr2=0x7f968410e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.619+0000 7f968a800640 1 --2- 172.21.15.37:0/2100489657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9684102ab0 0x7f968410e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.620+0000 7f968a800640 1 -- 172.21.15.37:0/2100489657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96841084c0 msgr2=0x7f968410ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:50.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.620+0000 7f968a800640 1 --2- 172.21.15.37:0/2100489657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96841084c0 0x7f968410ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.620+0000 7f968a800640 1 -- 172.21.15.37:0/2100489657 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96841a22c0 con 0x7f9684108e40 2024-08-20T05:05:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.620+0000 7f9689400640 1 --2- 172.21.15.37:0/2100489657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96841084c0 0x7f968410ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.620+0000 7f9689e00640 1 --2- 172.21.15.37:0/2100489657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9684102ab0 0x7f968410e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:05:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.621+0000 7f968a800640 1 --2- 172.21.15.37:0/2100489657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9684108e40 0x7f96841a1af0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9680009bf0 tx=0x7f9680003970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:50.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.621+0000 7f967ea00640 1 -- 172.21.15.37:0/2100489657 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9680003ce0 con 0x7f9684108e40 2024-08-20T05:05:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.622+0000 7f967ea00640 1 -- 172.21.15.37:0/2100489657 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96800044f0 con 0x7f9684108e40 2024-08-20T05:05:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.622+0000 7f967ea00640 1 -- 172.21.15.37:0/2100489657 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968002fd40 con 0x7f9684108e40 2024-08-20T05:05:50.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.622+0000 7f968c800640 1 -- 172.21.15.37:0/2100489657 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96841a2550 con 0x7f9684108e40 2024-08-20T05:05:50.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.623+0000 7f968c800640 1 -- 172.21.15.37:0/2100489657 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96841abe90 con 0x7f9684108e40 2024-08-20T05:05:50.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.628+0000 7f968f1de740 1 Processor -- start 2024-08-20T05:05:50.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.631+0000 7f967ea00640 1 -- 172.21.15.37:0/2100489657 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9680004040 con 0x7f9684108e40 2024-08-20T05:05:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.632+0000 7f968f1de740 1 -- start start 2024-08-20T05:05:50.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.632+0000 7f968f1de740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5922e40 0x5567f5923220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.632+0000 7f968f1de740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5923760 0x5567f592f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.632+0000 7f968f1de740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f592f6f0 0x5567f5931ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.632+0000 7f968f1de740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5567f5898600 con 0x5567f592f6f0 2024-08-20T05:05:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.632+0000 7f968f1de740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5567f5887b00 con 0x5567f5922e40 2024-08-20T05:05:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.632+0000 7f968f1de740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5567f588bb40 con 0x5567f5923760 2024-08-20T05:05:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.634+0000 7f9689e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5923760 0x5567f592f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.634+0000 7f9689400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5922e40 0x5567f5923220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.634+0000 7f9689400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5922e40 0x5567f5923220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44450/0 (socket says 172.21.15.37:44450) 2024-08-20T05:05:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.634+0000 7f9689400640 1 -- 172.21.15.37:0/1256284724 learned_addr learned my addr 172.21.15.37:0/1256284724 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.634+0000 7f967ea00640 1 --2- 172.21.15.37:0/2100489657 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f966c0b3c50 0x7f966c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.634+0000 7f967ea00640 1 -- 172.21.15.37:0/2100489657 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9680105270 con 0x7f9684108e40 2024-08-20T05:05:50.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.634+0000 7f9689e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5923760 0x5567f592f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:58086/0 (socket says 172.21.15.37:58086) 2024-08-20T05:05:50.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.635+0000 7f9689400640 1 -- 172.21.15.37:0/1256284724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5923760 msgr2=0x5567f592f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:50.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.635+0000 7f9689400640 1 --2- 172.21.15.37:0/1256284724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5923760 0x5567f592f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.635+0000 7f9689400640 1 -- 172.21.15.37:0/1256284724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f592f6f0 msgr2=0x5567f5931ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.635+0000 7f9689400640 1 --2- 172.21.15.37:0/1256284724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f592f6f0 0x5567f5931ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.635+0000 7f9689400640 1 -- 172.21.15.37:0/1256284724 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567f582dee0 con 0x5567f5922e40 2024-08-20T05:05:50.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.636+0000 7f968a800640 1 --2- 172.21.15.37:0/2100489657 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f966c0b3c50 0x7f966c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:50.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.636+0000 7f9689400640 1 --2- 172.21.15.37:0/1256284724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5922e40 0x5567f5923220 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9674009e60 tx=0x7f9674010620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e1e591b5c5f870e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:50.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.636+0000 7f9673000640 1 -- 172.21.15.37:0/1256284724 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9674018020 con 0x5567f5922e40 2024-08-20T05:05:50.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.637+0000 7f9673000640 1 -- 172.21.15.37:0/1256284724 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9674014920 con 0x5567f5922e40 2024-08-20T05:05:50.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.637+0000 7f9673000640 1 -- 172.21.15.37:0/1256284724 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9674013950 con 0x5567f5922e40 2024-08-20T05:05:50.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.638+0000 7f968f1de740 1 -- 172.21.15.37:0/1256284724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5922e40 msgr2=0x5567f5923220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:50.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.638+0000 7f968f1de740 1 --2- 172.21.15.37:0/1256284724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5922e40 0x5567f5923220 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9674009e60 tx=0x7f9674010620 comp rx=0 tx=0).stop 2024-08-20T05:05:50.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.638+0000 7f968a800640 1 --2- 172.21.15.37:0/2100489657 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f966c0b3c50 0x7f966c0b6110 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f96800c7e40 tx=0x7f968002a8d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:50.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.639+0000 7f968f1de740 1 -- 172.21.15.37:0/1256284724 shutdown_connections 2024-08-20T05:05:50.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.639+0000 7f968f1de740 1 --2- 172.21.15.37:0/1256284724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f592f6f0 0x5567f5931ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.639+0000 7f968f1de740 1 --2- 172.21.15.37:0/1256284724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5923760 0x5567f592f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.639+0000 7f968f1de740 1 --2- 172.21.15.37:0/1256284724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5922e40 0x5567f5923220 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.639+0000 7f968f1de740 1 -- 172.21.15.37:0/1256284724 >> 172.21.15.37:0/1256284724 conn(0x5567f5920c70 msgr2=0x5567f5921e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:50.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.639+0000 7f968f1de740 1 -- 172.21.15.37:0/1256284724 shutdown_connections 2024-08-20T05:05:50.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.640+0000 7f968f1de740 1 -- 172.21.15.37:0/1256284724 wait complete. 2024-08-20T05:05:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.640+0000 7f968f1de740 1 -- start start 2024-08-20T05:05:50.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.641+0000 7f968f1de740 1 Processor -- start 2024-08-20T05:05:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.642+0000 7f968f1de740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5922e40 0x5567f592c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.642+0000 7f968f1de740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f5923760 0x5567f592cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.642+0000 7f968f1de740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f592f6f0 0x5567f592d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.642+0000 7f968f1de740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5567f56ea7b0 con 0x5567f5923760 2024-08-20T05:05:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.642+0000 7f968f1de740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5567f5822dd0 con 0x5567f592f6f0 2024-08-20T05:05:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.642+0000 7f968f1de740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5567f5943380 con 0x5567f5922e40 2024-08-20T05:05:50.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.643+0000 7f968f1de740 10 client.0 _ll_register_callbacks cb 0x5567f55940a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:50.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.643+0000 7f9689400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5922e40 0x5567f592c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:50.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.644+0000 7f9689400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5922e40 0x5567f592c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:58100/0 (socket says 172.21.15.37:58100) 2024-08-20T05:05:50.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.644+0000 7f9689400640 1 -- 172.21.15.37:0/146552628 learned_addr learned my addr 172.21.15.37:0/146552628 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:50.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.644+0000 7f9689400640 1 --2- 172.21.15.37:0/146552628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f592f6f0 0x5567f592d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:50.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.645+0000 7f9689e00640 1 --2- 172.21.15.37:0/146552628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f5923760 0x5567f592cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.646+0000 7f9689400640 1 -- 172.21.15.37:0/146552628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f592f6f0 msgr2=0x5567f592d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.646+0000 7f9689400640 1 --2- 172.21.15.37:0/146552628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f592f6f0 0x5567f592d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.646+0000 7f9689400640 1 -- 172.21.15.37:0/146552628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f5923760 msgr2=0x5567f592cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.646+0000 7f9689400640 1 --2- 172.21.15.37:0/146552628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f5923760 0x5567f592cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.646+0000 7f9689400640 1 -- 172.21.15.37:0/146552628 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567f55f6ba0 con 0x5567f5922e40 2024-08-20T05:05:50.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.646+0000 7f9689e00640 1 --2- 172.21.15.37:0/146552628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f5923760 0x5567f592cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:50.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.646+0000 7f9689400640 1 --2- 172.21.15.37:0/146552628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5922e40 0x5567f592c6b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9674013590 tx=0x7f9674009fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55909738392efe33 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:50.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.646+0000 7f9667400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:05:50.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.647+0000 7f9667400640 1 -- 172.21.15.37:0/146552628 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9674018030 con 0x5567f5922e40 2024-08-20T05:05:50.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.647+0000 7f9667400640 1 -- 172.21.15.37:0/146552628 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9674014ce0 con 0x5567f5922e40 2024-08-20T05:05:50.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.648+0000 7f968f1de740 1 -- 172.21.15.37:0/146552628 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9674014920 con 0x5567f5922e40 2024-08-20T05:05:50.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.648+0000 7f9667400640 1 -- 172.21.15.37:0/146552628 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9674013af0 con 0x5567f5922e40 2024-08-20T05:05:50.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.648+0000 7f968f1de740 10 client.26449 fetch_fsmap learned FSMap version 34 2024-08-20T05:05:50.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.649+0000 7f968f1de740 1 -- 172.21.15.37:0/146552628 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5567f595ffb0 con 0x5567f5922e40 2024-08-20T05:05:50.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.649+0000 7f9667400640 1 -- 172.21.15.37:0/146552628 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9674023030 con 0x5567f5922e40 2024-08-20T05:05:50.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.649+0000 7f9667400640 1 -- 172.21.15.37:0/146552628 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f967401dba0 con 0x5567f5922e40 2024-08-20T05:05:50.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.649+0000 7f968f1de740 10 client.26449 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T05:05:50.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.650+0000 7f968f1de740 10 client.26449 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:05:50.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.650+0000 7f968f1de740 20 client.26449 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:50.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.650+0000 7f968f1de740 1 --2- 172.21.15.37:0/146552628 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5567f5961300 0x5567f59636f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.650+0000 7f968f1de740 4 client.26449 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:05:50.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.650+0000 7f968f1de740 1 -- 172.21.15.37:0/146552628 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f9674014920 con 0x5567f5961300 2024-08-20T05:05:50.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.650+0000 7f9689e00640 1 --2- 172.21.15.37:0/146552628 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5567f5961300 0x5567f59636f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:50.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.651+0000 7f9689e00640 1 --2- 172.21.15.37:0/146552628 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5567f5961300 0x5567f59636f0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b792518ff00b0d1d server_cookie=31b187c8b5cd8fba in_seq=0 out_seq=0 2024-08-20T05:05:50.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.651+0000 7f9667400640 10 client.26449 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:50.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.652+0000 7f9667400640 1 -- 172.21.15.37:0/146552628 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f9674014920 con 0x5567f5961300 2024-08-20T05:05:50.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.652+0000 7f9667400640 10 client.26449 handle_command_reply: tid=0 2024-08-20T05:05:50.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.652+0000 7f968f1de740 1 client.26449 shutdown 2024-08-20T05:05:50.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.653+0000 7f968f1de740 1 -- 172.21.15.37:0/146552628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5922e40 msgr2=0x5567f592c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:50.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.653+0000 7f968f1de740 1 --2- 172.21.15.37:0/146552628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5922e40 0x5567f592c6b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9674013590 tx=0x7f9674009fb0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.653+0000 7f968f1de740 1 -- 172.21.15.37:0/146552628 shutdown_connections 2024-08-20T05:05:50.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.653+0000 7f968f1de740 1 --2- 172.21.15.37:0/146552628 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5567f5961300 0x5567f59636f0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.653+0000 7f968f1de740 1 --2- 172.21.15.37:0/146552628 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f592f6f0 0x5567f592d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.653+0000 7f968f1de740 1 --2- 172.21.15.37:0/146552628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f5923760 0x5567f592cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.653+0000 7f968f1de740 1 --2- 172.21.15.37:0/146552628 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5922e40 0x5567f592c6b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.653+0000 7f968f1de740 1 -- 172.21.15.37:0/146552628 >> 172.21.15.37:0/146552628 conn(0x5567f5920c70 msgr2=0x5567f59267e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:50.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.653+0000 7f9667400640 0 client.26449 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:50.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.654+0000 7f968f1de740 1 -- 172.21.15.37:0/146552628 shutdown_connections 2024-08-20T05:05:50.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.654+0000 7f968f1de740 1 -- 172.21.15.37:0/146552628 wait complete. 2024-08-20T05:05:50.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.654+0000 7f968f1de740 20 client.26449 trim_cache size 0 max 16384 2024-08-20T05:05:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.687+0000 7f968f1de740 1 Processor -- start 2024-08-20T05:05:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.687+0000 7f968f1de740 1 -- start start 2024-08-20T05:05:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.687+0000 7f968f1de740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f5922e40 0x5567f5926e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.687+0000 7f968f1de740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5923760 0x5567f594bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.687+0000 7f968f1de740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f592f6f0 0x5567f594c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.688+0000 7f968f1de740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f96840712f0 con 0x5567f5922e40 2024-08-20T05:05:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.688+0000 7f968f1de740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f968406f050 con 0x5567f5923760 2024-08-20T05:05:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.688+0000 7f968f1de740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9684070c20 con 0x5567f592f6f0 2024-08-20T05:05:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.688+0000 7f9689e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5923760 0x5567f594bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.688+0000 7f9689e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5923760 0x5567f594bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44456/0 (socket says 172.21.15.37:44456) 2024-08-20T05:05:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.688+0000 7f9689e00640 1 -- 172.21.15.37:0/2061902521 learned_addr learned my addr 172.21.15.37:0/2061902521 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.688+0000 7f9689400640 1 --2- 172.21.15.37:0/2061902521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f592f6f0 0x5567f594c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.688+0000 7f9689e00640 1 -- 172.21.15.37:0/2061902521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f592f6f0 msgr2=0x5567f594c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.688+0000 7f9689e00640 1 --2- 172.21.15.37:0/2061902521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f592f6f0 0x5567f594c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.688+0000 7f9689e00640 1 -- 172.21.15.37:0/2061902521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f5922e40 msgr2=0x5567f5926e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.688+0000 7f9689e00640 1 --2- 172.21.15.37:0/2061902521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f5922e40 0x5567f5926e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.688+0000 7f9689e00640 1 -- 172.21.15.37:0/2061902521 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567f59216f0 con 0x5567f5923760 2024-08-20T05:05:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.688+0000 7f9689400640 1 --2- 172.21.15.37:0/2061902521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f592f6f0 0x5567f594c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:05:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.689+0000 7f9689e00640 1 --2- 172.21.15.37:0/2061902521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5923760 0x5567f594bc00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9678003ae0 tx=0x7f9678014840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85719a1434b11a34 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:50.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.689+0000 7f9672600640 1 -- 172.21.15.37:0/2061902521 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678003d30 con 0x5567f5923760 2024-08-20T05:05:50.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.689+0000 7f9672600640 1 -- 172.21.15.37:0/2061902521 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96780054d0 con 0x5567f5923760 2024-08-20T05:05:50.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.689+0000 7f9672600640 1 -- 172.21.15.37:0/2061902521 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9678004c30 con 0x5567f5923760 2024-08-20T05:05:50.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.690+0000 7f968f1de740 1 -- 172.21.15.37:0/2061902521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5923760 msgr2=0x5567f594bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:50.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.690+0000 7f968f1de740 1 --2- 172.21.15.37:0/2061902521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5923760 0x5567f594bc00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9678003ae0 tx=0x7f9678014840 comp rx=0 tx=0).stop 2024-08-20T05:05:50.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.691+0000 7f968f1de740 1 -- 172.21.15.37:0/2061902521 shutdown_connections 2024-08-20T05:05:50.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.691+0000 7f968f1de740 1 --2- 172.21.15.37:0/2061902521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f592f6f0 0x5567f594c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.691+0000 7f968f1de740 1 --2- 172.21.15.37:0/2061902521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5923760 0x5567f594bc00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.691+0000 7f968f1de740 1 --2- 172.21.15.37:0/2061902521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f5922e40 0x5567f5926e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.691+0000 7f968f1de740 1 -- 172.21.15.37:0/2061902521 >> 172.21.15.37:0/2061902521 conn(0x5567f5920c70 msgr2=0x5567f594b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:50.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.691+0000 7f968f1de740 1 -- 172.21.15.37:0/2061902521 shutdown_connections 2024-08-20T05:05:50.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.691+0000 7f968f1de740 1 -- 172.21.15.37:0/2061902521 wait complete. 2024-08-20T05:05:50.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.692+0000 7f968f1de740 1 -- start start 2024-08-20T05:05:50.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.692+0000 7f968f1de740 1 Processor -- start 2024-08-20T05:05:50.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.693+0000 7f968f1de740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5922e40 0x5567f59445d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.693+0000 7f968f1de740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5923760 0x5567f5944b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.693+0000 7f968f1de740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f592f6f0 0x5567f5945050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.693+0000 7f968f1de740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f968406fdf0 con 0x5567f592f6f0 2024-08-20T05:05:50.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.693+0000 7f968f1de740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f968406f720 con 0x5567f5923760 2024-08-20T05:05:50.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.693+0000 7f968f1de740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f96840704c0 con 0x5567f5922e40 2024-08-20T05:05:50.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.693+0000 7f968f1de740 10 client.0 _ll_register_callbacks cb 0x7f9674009d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:50.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.694+0000 7f9689400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5922e40 0x5567f59445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:50.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.694+0000 7f9689400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5922e40 0x5567f59445d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:58112/0 (socket says 172.21.15.37:58112) 2024-08-20T05:05:50.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.694+0000 7f9689400640 1 -- 172.21.15.37:0/3996086452 learned_addr learned my addr 172.21.15.37:0/3996086452 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:50.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.694+0000 7f9689e00640 1 --2- 172.21.15.37:0/3996086452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5923760 0x5567f5944b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:50.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.694+0000 7f9689400640 1 --2- 172.21.15.37:0/3996086452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f592f6f0 0x5567f5945050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:50.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.694+0000 7f9689400640 1 -- 172.21.15.37:0/3996086452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5923760 msgr2=0x5567f5944b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:50.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.694+0000 7f9689400640 1 --2- 172.21.15.37:0/3996086452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5923760 0x5567f5944b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.694+0000 7f9689400640 1 -- 172.21.15.37:0/3996086452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f592f6f0 msgr2=0x5567f5945050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:50.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.694+0000 7f9689400640 1 --2- 172.21.15.37:0/3996086452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f592f6f0 0x5567f5945050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.694+0000 7f9689400640 1 -- 172.21.15.37:0/3996086452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567f59caeb0 con 0x5567f5922e40 2024-08-20T05:05:50.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.695+0000 7f9689400640 1 --2- 172.21.15.37:0/3996086452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5922e40 0x5567f59445d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9674001f70 tx=0x7f9674010620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=660f45abd1129701 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:50.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.695+0000 7f9667400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:05:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.695+0000 7f9667400640 1 -- 172.21.15.37:0/3996086452 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9674018070 con 0x5567f5922e40 2024-08-20T05:05:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.695+0000 7f9667400640 1 -- 172.21.15.37:0/3996086452 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f96740134c0 con 0x5567f5922e40 2024-08-20T05:05:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.695+0000 7f968f1de740 1 -- 172.21.15.37:0/3996086452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96780054d0 con 0x5567f5922e40 2024-08-20T05:05:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.695+0000 7f9667400640 1 -- 172.21.15.37:0/3996086452 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9674012eb0 con 0x5567f5922e40 2024-08-20T05:05:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.695+0000 7f968f1de740 10 client.26452 fetch_fsmap learned FSMap version 34 2024-08-20T05:05:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.696+0000 7f968f1de740 1 -- 172.21.15.37:0/3996086452 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5567f59cc100 con 0x5567f5922e40 2024-08-20T05:05:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.697+0000 7f9667400640 1 -- 172.21.15.37:0/3996086452 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96780054d0 con 0x5567f5922e40 2024-08-20T05:05:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.697+0000 7f9667400640 1 -- 172.21.15.37:0/3996086452 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7f9674014ce0 con 0x5567f5922e40 2024-08-20T05:05:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.698+0000 7f968f1de740 10 client.26452 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T05:05:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.698+0000 7f968f1de740 10 client.26452 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:05:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.698+0000 7f968f1de740 20 client.26452 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:50.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.698+0000 7f968f1de740 1 --2- 172.21.15.37:0/3996086452 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5567f59cc7b0 0x5567f59cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:50.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.698+0000 7f968f1de740 4 client.26452 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.85, "await_for": 45.0}] 2024-08-20T05:05:50.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.698+0000 7f968f1de740 1 -- 172.21.15.37:0/3996086452 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.85, "await_for": 45.0}) -- 0x5567f589a550 con 0x5567f59cc7b0 2024-08-20T05:05:50.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.699+0000 7f9689e00640 1 --2- 172.21.15.37:0/3996086452 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5567f59cc7b0 0x5567f59cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:50.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.701+0000 7f9667400640 10 client.26452 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:50.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.701+0000 7f9689e00640 1 --2- 172.21.15.37:0/3996086452 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5567f59cc7b0 0x5567f59cebd0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dc525d17d5b1a6 server_cookie=ad4e708abc46267e in_seq=0 out_seq=0 2024-08-20T05:05:50.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.875+0000 7f9667400640 1 -- 172.21.15.37:0/3996086452 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5567f589a550 con 0x5567f59cc7b0 2024-08-20T05:05:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.875+0000 7f9667400640 10 client.26452 handle_command_reply: tid=0 2024-08-20T05:05:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.875+0000 7f968f1de740 1 client.26452 shutdown 2024-08-20T05:05:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.875+0000 7f968f1de740 1 -- 172.21.15.37:0/3996086452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5922e40 msgr2=0x5567f59445d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.875+0000 7f968f1de740 1 --2- 172.21.15.37:0/3996086452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5922e40 0x5567f59445d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9674001f70 tx=0x7f9674010620 comp rx=0 tx=0).stop 2024-08-20T05:05:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.875+0000 7f968f1de740 1 -- 172.21.15.37:0/3996086452 shutdown_connections 2024-08-20T05:05:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.875+0000 7f968f1de740 1 --2- 172.21.15.37:0/3996086452 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5567f59cc7b0 0x5567f59cebd0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.875+0000 7f968f1de740 1 --2- 172.21.15.37:0/3996086452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567f592f6f0 0x5567f5945050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.875+0000 7f968f1de740 1 --2- 172.21.15.37:0/3996086452 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567f5923760 0x5567f5944b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.875+0000 7f968f1de740 1 --2- 172.21.15.37:0/3996086452 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567f5922e40 0x5567f59445d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.875+0000 7f9667400640 0 client.26452 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:50.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.875+0000 7f968f1de740 1 -- 172.21.15.37:0/3996086452 >> 172.21.15.37:0/3996086452 conn(0x5567f5920c70 msgr2=0x5567f594bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:50.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.875+0000 7f968f1de740 1 -- 172.21.15.37:0/3996086452 shutdown_connections 2024-08-20T05:05:50.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.875+0000 7f968f1de740 1 -- 172.21.15.37:0/3996086452 wait complete. 2024-08-20T05:05:50.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.876+0000 7f968f1de740 20 client.26452 trim_cache size 0 max 16384 2024-08-20T05:05:50.879 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:05:50.879 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 34, 2024-08-20T05:05:50.880 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:05:50.880 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 18, 2024-08-20T05:05:50.880 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:05:50.880 INFO:teuthology.orchestra.run.smithi037.stdout: "fda19290": { 2024-08-20T05:05:50.880 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 18, 2024-08-20T05:05:50.880 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:05:50.880 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:05:50.880 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:05:50.880 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:05:50.880 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:05:50.880 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:05:50.880 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 139.8, 2024-08-20T05:05:50.881 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:05:50.881 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:05:50.881 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:05:50.881 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:05:50.881 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:05:50.881 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:05:50.881 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:05:50.881 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:05:50.881 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:05:50.881 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:05:50.881 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:05:50.881 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:05:50.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.876+0000 7f968c800640 1 -- 172.21.15.37:0/2100489657 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f966c0b3c50 msgr2=0x7f966c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:50.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.876+0000 7f968c800640 1 --2- 172.21.15.37:0/2100489657 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f966c0b3c50 0x7f966c0b6110 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f96800c7e40 tx=0x7f968002a8d0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.876+0000 7f968c800640 1 -- 172.21.15.37:0/2100489657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9684108e40 msgr2=0x7f96841a1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:50.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.876+0000 7f968c800640 1 --2- 172.21.15.37:0/2100489657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9684108e40 0x7f96841a1af0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9680009bf0 tx=0x7f9680003970 comp rx=0 tx=0).stop 2024-08-20T05:05:50.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.876+0000 7f968c800640 1 -- 172.21.15.37:0/2100489657 shutdown_connections 2024-08-20T05:05:50.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.876+0000 7f968c800640 1 --2- 172.21.15.37:0/2100489657 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f966c0b3c50 0x7f966c0b6110 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.876+0000 7f968c800640 1 --2- 172.21.15.37:0/2100489657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9684108e40 0x7f96841a1af0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.876+0000 7f968c800640 1 --2- 172.21.15.37:0/2100489657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96841084c0 0x7f968410ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.876+0000 7f968c800640 1 --2- 172.21.15.37:0/2100489657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9684102ab0 0x7f968410e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:50.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.876+0000 7f968c800640 1 -- 172.21.15.37:0/2100489657 >> 172.21.15.37:0/2100489657 conn(0x7f96840fe500 msgr2=0x7f96841010d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:50.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.877+0000 7f968c800640 1 -- 172.21.15.37:0/2100489657 shutdown_connections 2024-08-20T05:05:50.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:05:50.877+0000 7f968c800640 1 -- 172.21.15.37:0/2100489657 wait complete. 2024-08-20T05:05:51.924 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:51 smithi037 ceph-mon[17265]: pgmap v509: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.5 MiB/s wr, 686 op/s 2024-08-20T05:05:51.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:51 smithi130 ceph-mon[22007]: pgmap v509: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.5 MiB/s wr, 686 op/s 2024-08-20T05:05:51.963 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fda19290', quiesce took 6.8 seconds. Will release after: 13.05 2024-08-20T05:05:52.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:51 smithi135 ceph-mon[22342]: pgmap v509: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.5 MiB/s wr, 686 op/s 2024-08-20T05:05:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.314+0000 7faf63c00640 1 -- 172.21.15.37:0/2156670707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf5c102680 msgr2=0x7faf5c102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.314+0000 7faf63c00640 1 --2- 172.21.15.37:0/2156670707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf5c102680 0x7faf5c102a80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009930 tx=0x7faf4c02a440 comp rx=0 tx=0).stop 2024-08-20T05:05:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.314+0000 7faf63c00640 1 -- 172.21.15.37:0/2156670707 shutdown_connections 2024-08-20T05:05:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.314+0000 7faf63c00640 1 --2- 172.21.15.37:0/2156670707 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf5c104190 0x7faf5c10ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.314+0000 7faf63c00640 1 --2- 172.21.15.37:0/2156670707 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf5c1037d0 0x7faf5c103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.314+0000 7faf63c00640 1 --2- 172.21.15.37:0/2156670707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf5c102680 0x7faf5c102a80 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.314+0000 7faf63c00640 1 -- 172.21.15.37:0/2156670707 >> 172.21.15.37:0/2156670707 conn(0x7faf5c0fdf40 msgr2=0x7faf5c100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.314+0000 7faf63c00640 1 -- 172.21.15.37:0/2156670707 shutdown_connections 2024-08-20T05:05:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.314+0000 7faf63c00640 1 -- 172.21.15.37:0/2156670707 wait complete. 2024-08-20T05:05:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.315+0000 7faf63c00640 1 Processor -- start 2024-08-20T05:05:52.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.315+0000 7faf63c00640 1 -- start start 2024-08-20T05:05:52.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.315+0000 7faf63c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf5c102680 0x7faf5c198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.315+0000 7faf63c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf5c1037d0 0x7faf5c1990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.315+0000 7faf63c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf5c104190 0x7faf5c199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.315+0000 7faf63c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c10e340 con 0x7faf5c102680 2024-08-20T05:05:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.315+0000 7faf63c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c10e1c0 con 0x7faf5c1037d0 2024-08-20T05:05:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.315+0000 7faf63c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c10e4c0 con 0x7faf5c104190 2024-08-20T05:05:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.316+0000 7faf61200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf5c102680 0x7faf5c198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.316+0000 7faf61200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf5c102680 0x7faf5c198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41776/0 (socket says 172.21.15.37:41776) 2024-08-20T05:05:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.316+0000 7faf61200640 1 -- 172.21.15.37:0/2564844270 learned_addr learned my addr 172.21.15.37:0/2564844270 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.316+0000 7faf61c00640 1 --2- 172.21.15.37:0/2564844270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf5c104190 0x7faf5c199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.316+0000 7faf53e00640 1 --2- 172.21.15.37:0/2564844270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf5c1037d0 0x7faf5c1990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.316+0000 7faf61200640 1 -- 172.21.15.37:0/2564844270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf5c104190 msgr2=0x7faf5c199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.316+0000 7faf61200640 1 --2- 172.21.15.37:0/2564844270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf5c104190 0x7faf5c199d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.316+0000 7faf61200640 1 -- 172.21.15.37:0/2564844270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf5c1037d0 msgr2=0x7faf5c1990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.316+0000 7faf61200640 1 --2- 172.21.15.37:0/2564844270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf5c1037d0 0x7faf5c1990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.316+0000 7faf61200640 1 -- 172.21.15.37:0/2564844270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5c19a5d0 con 0x7faf5c102680 2024-08-20T05:05:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.316+0000 7faf61200640 1 --2- 172.21.15.37:0/2564844270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf5c102680 0x7faf5c198a90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7faf4c031500 tx=0x7faf4c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.317+0000 7faf5a000640 1 -- 172.21.15.37:0/2564844270 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c03f070 con 0x7faf5c102680 2024-08-20T05:05:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.317+0000 7faf5a000640 1 -- 172.21.15.37:0/2564844270 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf4c031c50 con 0x7faf5c102680 2024-08-20T05:05:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.317+0000 7faf63c00640 1 -- 172.21.15.37:0/2564844270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5c19a860 con 0x7faf5c102680 2024-08-20T05:05:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.317+0000 7faf5a000640 1 -- 172.21.15.37:0/2564844270 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c035030 con 0x7faf5c102680 2024-08-20T05:05:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.317+0000 7faf63c00640 1 -- 172.21.15.37:0/2564844270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf5c1a0f90 con 0x7faf5c102680 2024-08-20T05:05:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.320+0000 7faf66a41740 1 Processor -- start 2024-08-20T05:05:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.320+0000 7faf66a41740 1 -- start start 2024-08-20T05:05:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.320+0000 7faf5a000640 1 -- 172.21.15.37:0/2564844270 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7faf4c042070 con 0x7faf5c102680 2024-08-20T05:05:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.321+0000 7faf66a41740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55691301da20 0x55691301fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.321+0000 7faf66a41740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556913020350 0x556913022740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.321+0000 7faf66a41740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x556913025250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.321+0000 7faf66a41740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556912f8c210 con 0x556913022d90 2024-08-20T05:05:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.321+0000 7faf66a41740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556912f7b710 con 0x55691301da20 2024-08-20T05:05:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.321+0000 7faf66a41740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556912f7f750 con 0x556913020350 2024-08-20T05:05:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.321+0000 7faf53e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x556913025250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.321+0000 7faf61200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556913020350 0x556913022740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.321+0000 7faf53e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x556913025250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41788/0 (socket says 172.21.15.37:41788) 2024-08-20T05:05:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.321+0000 7faf61c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55691301da20 0x55691301fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.321+0000 7faf53e00640 1 -- 172.21.15.37:0/1854121174 learned_addr learned my addr 172.21.15.37:0/1854121174 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.321+0000 7faf53e00640 1 -- 172.21.15.37:0/1854121174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556913020350 msgr2=0x556913022740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.321+0000 7faf53e00640 1 --2- 172.21.15.37:0/1854121174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556913020350 0x556913022740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.321+0000 7faf53e00640 1 -- 172.21.15.37:0/1854121174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55691301da20 msgr2=0x55691301fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.321+0000 7faf53e00640 1 --2- 172.21.15.37:0/1854121174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55691301da20 0x55691301fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.322+0000 7faf53e00640 1 -- 172.21.15.37:0/1854121174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556912f47de0 con 0x556913022d90 2024-08-20T05:05:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.322+0000 7faf61c00640 1 --2- 172.21.15.37:0/1854121174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55691301da20 0x55691301fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.322+0000 7faf53e00640 1 --2- 172.21.15.37:0/1854121174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x556913025250 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7faf44009cf0 tx=0x7faf44011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9b88b845ee6c74 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.322+0000 7faf52000640 1 -- 172.21.15.37:0/1854121174 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf44004230 con 0x556913022d90 2024-08-20T05:05:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.322+0000 7faf52000640 1 -- 172.21.15.37:0/1854121174 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf440043d0 con 0x556913022d90 2024-08-20T05:05:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.322+0000 7faf52000640 1 -- 172.21.15.37:0/1854121174 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf44019880 con 0x556913022d90 2024-08-20T05:05:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.322+0000 7faf5a000640 1 --2- 172.21.15.37:0/2564844270 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faf400b3bd0 0x7faf400b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.323+0000 7faf5a000640 1 -- 172.21.15.37:0/2564844270 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7faf4c1046e0 con 0x7faf5c102680 2024-08-20T05:05:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.323+0000 7faf61c00640 1 --2- 172.21.15.37:0/2564844270 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faf400b3bd0 0x7faf400b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.323+0000 7faf66a41740 1 -- 172.21.15.37:0/1854121174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 msgr2=0x556913025250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.323+0000 7faf66a41740 1 --2- 172.21.15.37:0/1854121174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x556913025250 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7faf44009cf0 tx=0x7faf44011810 comp rx=0 tx=0).stop 2024-08-20T05:05:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.323+0000 7faf66a41740 1 -- 172.21.15.37:0/1854121174 shutdown_connections 2024-08-20T05:05:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.323+0000 7faf66a41740 1 --2- 172.21.15.37:0/1854121174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x556913025250 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.323+0000 7faf66a41740 1 --2- 172.21.15.37:0/1854121174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556913020350 0x556913022740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.323+0000 7faf66a41740 1 --2- 172.21.15.37:0/1854121174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55691301da20 0x55691301fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.323+0000 7faf66a41740 1 -- 172.21.15.37:0/1854121174 >> 172.21.15.37:0/1854121174 conn(0x556913018b70 msgr2=0x556913019900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.323+0000 7faf66a41740 1 -- 172.21.15.37:0/1854121174 shutdown_connections 2024-08-20T05:05:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.323+0000 7faf66a41740 1 -- 172.21.15.37:0/1854121174 wait complete. 2024-08-20T05:05:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.323+0000 7faf61c00640 1 --2- 172.21.15.37:0/2564844270 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faf400b3bd0 0x7faf400b6090 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7faf54009fd0 tx=0x7faf54009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:52.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.324+0000 7faf66a41740 1 -- start start 2024-08-20T05:05:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.324+0000 7faf66a41740 1 Processor -- start 2024-08-20T05:05:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.324+0000 7faf66a41740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55691301da20 0x5569130271b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.324+0000 7faf66a41740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556913020350 0x556913027850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.324+0000 7faf66a41740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x5569130283b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.324+0000 7faf66a41740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556912eb4ab0 con 0x556913022d90 2024-08-20T05:05:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.324+0000 7faf66a41740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556912f22140 con 0x55691301da20 2024-08-20T05:05:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.324+0000 7faf66a41740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556913025d70 con 0x556913020350 2024-08-20T05:05:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.325+0000 7faf66a41740 10 client.0 _ll_register_callbacks cb 0x556912f355d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.325+0000 7faf61c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x5569130283b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.325+0000 7faf61c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x5569130283b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41796/0 (socket says 172.21.15.37:41796) 2024-08-20T05:05:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.325+0000 7faf61200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55691301da20 0x5569130271b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.325+0000 7faf61c00640 1 -- 172.21.15.37:0/1578021309 learned_addr learned my addr 172.21.15.37:0/1578021309 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.325+0000 7faf53e00640 1 --2- 172.21.15.37:0/1578021309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556913020350 0x556913027850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.325+0000 7faf61c00640 1 -- 172.21.15.37:0/1578021309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556913020350 msgr2=0x556913027850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.325+0000 7faf61c00640 1 --2- 172.21.15.37:0/1578021309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556913020350 0x556913027850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.325+0000 7faf61c00640 1 -- 172.21.15.37:0/1578021309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55691301da20 msgr2=0x5569130271b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.325+0000 7faf61c00640 1 --2- 172.21.15.37:0/1578021309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55691301da20 0x5569130271b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.325+0000 7faf61c00640 1 -- 172.21.15.37:0/1578021309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556912f23170 con 0x556913022d90 2024-08-20T05:05:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.325+0000 7faf61200640 1 --2- 172.21.15.37:0/1578021309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55691301da20 0x5569130271b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:05:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.325+0000 7faf61c00640 1 --2- 172.21.15.37:0/1578021309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x5569130283b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7faf5400f6f0 tx=0x7faf54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9773f3501d8c3a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.325+0000 7faf4aa00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:05:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.326+0000 7faf4aa00640 1 -- 172.21.15.37:0/1578021309 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54003b80 con 0x556913022d90 2024-08-20T05:05:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.326+0000 7faf4aa00640 1 -- 172.21.15.37:0/1578021309 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7faf54003d20 con 0x556913022d90 2024-08-20T05:05:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.326+0000 7faf66a41740 1 -- 172.21.15.37:0/1578021309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf440043d0 con 0x556913022d90 2024-08-20T05:05:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.326+0000 7faf4aa00640 1 -- 172.21.15.37:0/1578021309 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7faf54004b20 con 0x556913022d90 2024-08-20T05:05:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.326+0000 7faf66a41740 10 client.16224 fetch_fsmap learned FSMap version 34 2024-08-20T05:05:52.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.326+0000 7faf66a41740 1 -- 172.21.15.37:0/1578021309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556912cde790 con 0x556913022d90 2024-08-20T05:05:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.326+0000 7faf4aa00640 1 -- 172.21.15.37:0/1578021309 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf440043d0 con 0x556913022d90 2024-08-20T05:05:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.326+0000 7faf4aa00640 1 -- 172.21.15.37:0/1578021309 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7faf54026070 con 0x556913022d90 2024-08-20T05:05:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.327+0000 7faf66a41740 10 client.16224 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T05:05:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.327+0000 7faf66a41740 10 client.16224 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:05:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.327+0000 7faf66a41740 20 client.16224 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.327+0000 7faf66a41740 1 --2- 172.21.15.37:0/1578021309 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556913032ee0 0x556913035360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.327+0000 7faf66a41740 4 client.16224 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:05:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.327+0000 7faf66a41740 1 -- 172.21.15.37:0/1578021309 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556912f8e160 con 0x556913032ee0 2024-08-20T05:05:52.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.327+0000 7faf61200640 1 --2- 172.21.15.37:0/1578021309 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556913032ee0 0x556913035360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.328+0000 7faf61200640 1 --2- 172.21.15.37:0/1578021309 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556913032ee0 0x556913035360 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab952b66ee598e8 server_cookie=3ee2b62030bf603 in_seq=0 out_seq=0 2024-08-20T05:05:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.328+0000 7faf4aa00640 10 client.16224 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.328+0000 7faf4aa00640 1 -- 172.21.15.37:0/1578021309 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556912f8e160 con 0x556913032ee0 2024-08-20T05:05:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.328+0000 7faf4aa00640 10 client.16224 handle_command_reply: tid=0 2024-08-20T05:05:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.329+0000 7faf66a41740 1 client.16224 shutdown 2024-08-20T05:05:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.329+0000 7faf66a41740 1 -- 172.21.15.37:0/1578021309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 msgr2=0x5569130283b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.329+0000 7faf66a41740 1 --2- 172.21.15.37:0/1578021309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x5569130283b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7faf5400f6f0 tx=0x7faf54004a40 comp rx=0 tx=0).stop 2024-08-20T05:05:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.329+0000 7faf66a41740 1 -- 172.21.15.37:0/1578021309 shutdown_connections 2024-08-20T05:05:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.329+0000 7faf66a41740 1 --2- 172.21.15.37:0/1578021309 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556913032ee0 0x556913035360 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.329+0000 7faf66a41740 1 --2- 172.21.15.37:0/1578021309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x5569130283b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.329+0000 7faf66a41740 1 --2- 172.21.15.37:0/1578021309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556913020350 0x556913027850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.329+0000 7faf4aa00640 0 client.16224 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.329+0000 7faf66a41740 1 --2- 172.21.15.37:0/1578021309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55691301da20 0x5569130271b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.329+0000 7faf66a41740 1 -- 172.21.15.37:0/1578021309 >> 172.21.15.37:0/1578021309 conn(0x556913018b70 msgr2=0x556913013760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.329+0000 7faf66a41740 1 -- 172.21.15.37:0/1578021309 shutdown_connections 2024-08-20T05:05:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.329+0000 7faf66a41740 1 -- 172.21.15.37:0/1578021309 wait complete. 2024-08-20T05:05:52.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.329+0000 7faf66a41740 20 client.16224 trim_cache size 0 max 16384 2024-08-20T05:05:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.344+0000 7faf66a41740 1 Processor -- start 2024-08-20T05:05:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.344+0000 7faf66a41740 1 -- start start 2024-08-20T05:05:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.344+0000 7faf66a41740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55691301da20 0x55691300f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.344+0000 7faf66a41740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556913020350 0x556913023d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.344+0000 7faf66a41740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x5569130242c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.345+0000 7faf66a41740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c1a91e0 con 0x556913022d90 2024-08-20T05:05:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.345+0000 7faf66a41740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c1aadb0 con 0x556913020350 2024-08-20T05:05:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.345+0000 7faf66a41740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c1a98b0 con 0x55691301da20 2024-08-20T05:05:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.345+0000 7faf61c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x5569130242c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.345+0000 7faf61c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x5569130242c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41800/0 (socket says 172.21.15.37:41800) 2024-08-20T05:05:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.345+0000 7faf61c00640 1 -- 172.21.15.37:0/705095841 learned_addr learned my addr 172.21.15.37:0/705095841 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.345+0000 7faf53e00640 1 --2- 172.21.15.37:0/705095841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556913020350 0x556913023d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.345+0000 7faf61200640 1 --2- 172.21.15.37:0/705095841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55691301da20 0x55691300f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.345+0000 7faf61c00640 1 -- 172.21.15.37:0/705095841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55691301da20 msgr2=0x55691300f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.345+0000 7faf61c00640 1 --2- 172.21.15.37:0/705095841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55691301da20 0x55691300f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.345+0000 7faf61c00640 1 -- 172.21.15.37:0/705095841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556913020350 msgr2=0x556913023d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.345+0000 7faf61c00640 1 --2- 172.21.15.37:0/705095841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556913020350 0x556913023d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.345+0000 7faf61c00640 1 -- 172.21.15.37:0/705095841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556913023850 con 0x556913022d90 2024-08-20T05:05:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.345+0000 7faf61c00640 1 --2- 172.21.15.37:0/705095841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x5569130242c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7faf540042c0 tx=0x7faf5401f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3869841a4d542f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.346+0000 7faf51600640 1 -- 172.21.15.37:0/705095841 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf540046b0 con 0x556913022d90 2024-08-20T05:05:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.346+0000 7faf51600640 1 -- 172.21.15.37:0/705095841 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf54004030 con 0x556913022d90 2024-08-20T05:05:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.346+0000 7faf51600640 1 -- 172.21.15.37:0/705095841 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf5401c650 con 0x556913022d90 2024-08-20T05:05:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.346+0000 7faf66a41740 1 -- 172.21.15.37:0/705095841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 msgr2=0x5569130242c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.346+0000 7faf66a41740 1 --2- 172.21.15.37:0/705095841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x5569130242c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7faf540042c0 tx=0x7faf5401f4b0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.346+0000 7faf66a41740 1 -- 172.21.15.37:0/705095841 shutdown_connections 2024-08-20T05:05:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.346+0000 7faf66a41740 1 --2- 172.21.15.37:0/705095841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556913022d90 0x5569130242c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.346+0000 7faf66a41740 1 --2- 172.21.15.37:0/705095841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556913020350 0x556913023d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.346+0000 7faf66a41740 1 --2- 172.21.15.37:0/705095841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55691301da20 0x55691300f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.346+0000 7faf66a41740 1 -- 172.21.15.37:0/705095841 >> 172.21.15.37:0/705095841 conn(0x556913018b70 msgr2=0x5569130193d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.346+0000 7faf66a41740 1 -- 172.21.15.37:0/705095841 shutdown_connections 2024-08-20T05:05:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.347+0000 7faf66a41740 1 -- 172.21.15.37:0/705095841 wait complete. 2024-08-20T05:05:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.347+0000 7faf66a41740 1 -- start start 2024-08-20T05:05:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.347+0000 7faf66a41740 1 Processor -- start 2024-08-20T05:05:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.347+0000 7faf66a41740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55691301da20 0x55691302eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.347+0000 7faf66a41740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556913020350 0x55691302d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.347+0000 7faf66a41740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556913022d90 0x55691302dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.347+0000 7faf66a41740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c1aa650 con 0x55691301da20 2024-08-20T05:05:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.347+0000 7faf66a41740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c1a9f80 con 0x556913022d90 2024-08-20T05:05:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.347+0000 7faf66a41740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faf5c1a71c0 con 0x556913020350 2024-08-20T05:05:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.347+0000 7faf66a41740 10 client.0 _ll_register_callbacks cb 0x7faf54011050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:05:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.348+0000 7faf61200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55691301da20 0x55691302eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.348+0000 7faf61200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55691301da20 0x55691302eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41804/0 (socket says 172.21.15.37:41804) 2024-08-20T05:05:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.348+0000 7faf61200640 1 -- 172.21.15.37:0/846980510 learned_addr learned my addr 172.21.15.37:0/846980510 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:05:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.348+0000 7faf61c00640 1 --2- 172.21.15.37:0/846980510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556913022d90 0x55691302dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.348+0000 7faf53e00640 1 --2- 172.21.15.37:0/846980510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556913020350 0x55691302d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.348+0000 7faf61200640 1 -- 172.21.15.37:0/846980510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556913020350 msgr2=0x55691302d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.348+0000 7faf61200640 1 --2- 172.21.15.37:0/846980510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556913020350 0x55691302d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.348+0000 7faf61200640 1 -- 172.21.15.37:0/846980510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556913022d90 msgr2=0x55691302dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.348+0000 7faf61200640 1 --2- 172.21.15.37:0/846980510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556913022d90 0x55691302dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.348+0000 7faf61200640 1 -- 172.21.15.37:0/846980510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556912d57620 con 0x55691301da20 2024-08-20T05:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.348+0000 7faf61c00640 1 --2- 172.21.15.37:0/846980510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556913022d90 0x55691302dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.348+0000 7faf61200640 1 --2- 172.21.15.37:0/846980510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55691301da20 0x55691302eb30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0c7360 tx=0x7faf4c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ae223a07dd028a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.348+0000 7faf4aa00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.348+0000 7faf4aa00640 1 -- 172.21.15.37:0/846980510 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c049040 con 0x55691301da20 2024-08-20T05:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.348+0000 7faf4aa00640 1 -- 172.21.15.37:0/846980510 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7faf4c1043c0 con 0x55691301da20 2024-08-20T05:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.348+0000 7faf66a41740 1 -- 172.21.15.37:0/846980510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556912f89c00 con 0x55691301da20 2024-08-20T05:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.349+0000 7faf4aa00640 1 -- 172.21.15.37:0/846980510 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7faf4c031e00 con 0x55691301da20 2024-08-20T05:05:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.349+0000 7faf66a41740 10 client.16230 fetch_fsmap learned FSMap version 34 2024-08-20T05:05:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.349+0000 7faf66a41740 1 -- 172.21.15.37:0/846980510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55691302d050 con 0x55691301da20 2024-08-20T05:05:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.349+0000 7faf4aa00640 1 -- 172.21.15.37:0/846980510 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556912f89c00 con 0x55691301da20 2024-08-20T05:05:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.349+0000 7faf4aa00640 1 -- 172.21.15.37:0/846980510 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 34) ==== 8382+0+0 (secure 0 0 0) 0x7faf4c03b460 con 0x55691301da20 2024-08-20T05:05:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.349+0000 7faf66a41740 10 client.16230 fetch_fsmap finished waiting for FSMap version 34 2024-08-20T05:05:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.349+0000 7faf66a41740 10 client.16230 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:05:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.349+0000 7faf66a41740 20 client.16230 populate_metadata read hostname 'smithi037' 2024-08-20T05:05:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.349+0000 7faf66a41740 1 --2- 172.21.15.37:0/846980510 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55691309e350 0x5569130a0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:05:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.349+0000 7faf66a41740 4 client.16230 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:05:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.349+0000 7faf66a41740 1 -- 172.21.15.37:0/846980510 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556912f87340 con 0x55691309e350 2024-08-20T05:05:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.350+0000 7faf53e00640 1 --2- 172.21.15.37:0/846980510 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55691309e350 0x5569130a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:05:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.350+0000 7faf53e00640 1 --2- 172.21.15.37:0/846980510 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55691309e350 0x5569130a0770 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a631a26d7079b3d1 server_cookie=506ab8d65b708a97 in_seq=0 out_seq=0 2024-08-20T05:05:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.350+0000 7faf4aa00640 10 client.16230 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.363+0000 7faf4aa00640 1 -- 172.21.15.37:0/846980510 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556912f87340 con 0x55691309e350 2024-08-20T05:05:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.363+0000 7faf4aa00640 10 client.16230 handle_command_reply: tid=0 2024-08-20T05:05:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.364+0000 7faf66a41740 1 client.16230 shutdown 2024-08-20T05:05:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.364+0000 7faf66a41740 1 -- 172.21.15.37:0/846980510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55691301da20 msgr2=0x55691302eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.364+0000 7faf66a41740 1 --2- 172.21.15.37:0/846980510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55691301da20 0x55691302eb30 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0c7360 tx=0x7faf4c009260 comp rx=0 tx=0).stop 2024-08-20T05:05:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.364+0000 7faf66a41740 1 -- 172.21.15.37:0/846980510 shutdown_connections 2024-08-20T05:05:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.364+0000 7faf66a41740 1 --2- 172.21.15.37:0/846980510 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55691309e350 0x5569130a0770 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.364+0000 7faf66a41740 1 --2- 172.21.15.37:0/846980510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556913022d90 0x55691302dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.364+0000 7faf66a41740 1 --2- 172.21.15.37:0/846980510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556913020350 0x55691302d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.364+0000 7faf66a41740 1 --2- 172.21.15.37:0/846980510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55691301da20 0x55691302eb30 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.364+0000 7faf4aa00640 0 client.16230 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:05:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.364+0000 7faf66a41740 1 -- 172.21.15.37:0/846980510 >> 172.21.15.37:0/846980510 conn(0x556913018b70 msgr2=0x55691301cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.364+0000 7faf66a41740 1 -- 172.21.15.37:0/846980510 shutdown_connections 2024-08-20T05:05:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.364+0000 7faf66a41740 1 -- 172.21.15.37:0/846980510 wait complete. 2024-08-20T05:05:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.364+0000 7faf66a41740 20 client.16230 trim_cache size 0 max 16384 2024-08-20T05:05:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:05:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:05:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:05:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:05:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.365+0000 7faf63c00640 1 -- 172.21.15.37:0/2564844270 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faf400b3bd0 msgr2=0x7faf400b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.365+0000 7faf63c00640 1 --2- 172.21.15.37:0/2564844270 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faf400b3bd0 0x7faf400b6090 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7faf54009fd0 tx=0x7faf54009500 comp rx=0 tx=0).stop 2024-08-20T05:05:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.365+0000 7faf63c00640 1 -- 172.21.15.37:0/2564844270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf5c102680 msgr2=0x7faf5c198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:05:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.365+0000 7faf63c00640 1 --2- 172.21.15.37:0/2564844270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf5c102680 0x7faf5c198a90 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7faf4c031500 tx=0x7faf4c003c10 comp rx=0 tx=0).stop 2024-08-20T05:05:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.365+0000 7faf63c00640 1 -- 172.21.15.37:0/2564844270 shutdown_connections 2024-08-20T05:05:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.365+0000 7faf63c00640 1 --2- 172.21.15.37:0/2564844270 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7faf400b3bd0 0x7faf400b6090 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.365+0000 7faf63c00640 1 --2- 172.21.15.37:0/2564844270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faf5c104190 0x7faf5c199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.365+0000 7faf63c00640 1 --2- 172.21.15.37:0/2564844270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faf5c1037d0 0x7faf5c1990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.365+0000 7faf63c00640 1 --2- 172.21.15.37:0/2564844270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf5c102680 0x7faf5c198a90 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:05:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.365+0000 7faf63c00640 1 -- 172.21.15.37:0/2564844270 >> 172.21.15.37:0/2564844270 conn(0x7faf5c0fdf40 msgr2=0x7faf5c106bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:05:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.365+0000 7faf63c00640 1 -- 172.21.15.37:0/2564844270 shutdown_connections 2024-08-20T05:05:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:05:52.365+0000 7faf63c00640 1 -- 172.21.15.37:0/2564844270 wait complete. 2024-08-20T05:05:53.043 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 175.0 s, 588.9 tps, lat 91.415 ms stddev 110.318 2024-08-20T05:05:53.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:53 smithi130 ceph-mon[22007]: pgmap v510: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.4 MiB/s wr, 575 op/s 2024-08-20T05:05:54.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:53 smithi037 ceph-mon[17265]: pgmap v510: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.4 MiB/s wr, 575 op/s 2024-08-20T05:05:54.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:53 smithi135 ceph-mon[22342]: pgmap v510: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.4 MiB/s wr, 575 op/s 2024-08-20T05:05:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:55 smithi130 ceph-mon[22007]: pgmap v511: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.6 MiB/s wr, 580 op/s 2024-08-20T05:05:56.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:55 smithi037 ceph-mon[17265]: pgmap v511: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.6 MiB/s wr, 580 op/s 2024-08-20T05:05:56.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:55 smithi135 ceph-mon[22342]: pgmap v511: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.6 MiB/s wr, 580 op/s 2024-08-20T05:05:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:57 smithi130 ceph-mon[22007]: pgmap v512: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.2 MiB/s wr, 444 op/s 2024-08-20T05:05:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:57 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:05:58.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:57 smithi037 ceph-mon[17265]: pgmap v512: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.2 MiB/s wr, 444 op/s 2024-08-20T05:05:58.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:57 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:05:58.045 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 180.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:05:58.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:57 smithi135 ceph-mon[22342]: pgmap v512: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 4.2 MiB/s wr, 444 op/s 2024-08-20T05:05:58.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:57 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:05:59.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:05:59 smithi037 ceph-mon[17265]: pgmap v513: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 3.4 MiB/s wr, 386 op/s 2024-08-20T05:05:59.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:05:59 smithi130 ceph-mon[22007]: pgmap v513: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 3.4 MiB/s wr, 386 op/s 2024-08-20T05:06:00.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:05:59 smithi135 ceph-mon[22342]: pgmap v513: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 3.4 MiB/s wr, 386 op/s 2024-08-20T05:06:01.037 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:06:01.438 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:06:01.926 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:01 smithi037 ceph-mon[17265]: pgmap v514: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.8 MiB/s wr, 510 op/s 2024-08-20T05:06:01.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:01 smithi130 ceph-mon[22007]: pgmap v514: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.8 MiB/s wr, 510 op/s 2024-08-20T05:06:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.041+0000 7f1ee0a00640 1 -- 172.21.15.37:0/3059855302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc10b050 msgr2=0x7f1edc111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.041+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/3059855302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc10b050 0x7f1edc111850 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009ca0 tx=0x7f1ed402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.041+0000 7f1ee0a00640 1 -- 172.21.15.37:0/3059855302 shutdown_connections 2024-08-20T05:06:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.041+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/3059855302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc10b050 0x7f1edc111850 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.041+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/3059855302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1edc10a6d0 0x7f1edc10ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.041+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/3059855302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1edc104cc0 0x7f1edc1050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.042+0000 7f1ee0a00640 1 -- 172.21.15.37:0/3059855302 >> 172.21.15.37:0/3059855302 conn(0x7f1edc1006b0 msgr2=0x7f1edc102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:02.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.042+0000 7f1ee0a00640 1 -- 172.21.15.37:0/3059855302 shutdown_connections 2024-08-20T05:06:02.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.042+0000 7f1ee0a00640 1 -- 172.21.15.37:0/3059855302 wait complete. 2024-08-20T05:06:02.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.043+0000 7f1ee0a00640 1 Processor -- start 2024-08-20T05:06:02.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.043+0000 7f1ee0a00640 1 -- start start 2024-08-20T05:06:02.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.044+0000 7f1ee0a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1edc104cc0 0x7f1edc19b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.044+0000 7f1ee0a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc10a6d0 0x7f1edc19b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.044+0000 7f1ee0a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1edc10b050 0x7f1edc1a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.044+0000 7f1ee0a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc114cd0 con 0x7f1edc10a6d0 2024-08-20T05:06:02.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.044+0000 7f1ee0a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc114b50 con 0x7f1edc10b050 2024-08-20T05:06:02.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.044+0000 7f1ee0a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc114e50 con 0x7f1edc104cc0 2024-08-20T05:06:02.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.044+0000 7f1ed9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc10a6d0 0x7f1edc19b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:02.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.044+0000 7f1ed9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1edc104cc0 0x7f1edc19b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.044+0000 7f1ed9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1edc104cc0 0x7f1edc19b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:54136/0 (socket says 172.21.15.37:54136) 2024-08-20T05:06:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.044+0000 7f1ed9e00640 1 -- 172.21.15.37:0/8183785 learned_addr learned my addr 172.21.15.37:0/8183785 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.044+0000 7f1eda800640 1 --2- 172.21.15.37:0/8183785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1edc10b050 0x7f1edc1a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.044+0000 7f1ed9e00640 1 -- 172.21.15.37:0/8183785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1edc10b050 msgr2=0x7f1edc1a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.044+0000 7f1ed9e00640 1 --2- 172.21.15.37:0/8183785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1edc10b050 0x7f1edc1a0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.044+0000 7f1ed9e00640 1 -- 172.21.15.37:0/8183785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc10a6d0 msgr2=0x7f1edc19b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.044+0000 7f1ed9e00640 1 --2- 172.21.15.37:0/8183785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc10a6d0 0x7f1edc19b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.045+0000 7f1ed9e00640 1 -- 172.21.15.37:0/8183785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1edc1a1310 con 0x7f1edc104cc0 2024-08-20T05:06:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.045+0000 7f1ed9400640 1 --2- 172.21.15.37:0/8183785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc10a6d0 0x7f1edc19b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.045+0000 7f1ed9e00640 1 --2- 172.21.15.37:0/8183785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1edc104cc0 0x7f1edc19b260 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc00e9f0 tx=0x7f1ecc00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.045+0000 7f1ed2a00640 1 -- 172.21.15.37:0/8183785 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc00cd80 con 0x7f1edc104cc0 2024-08-20T05:06:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.045+0000 7f1ee0a00640 1 -- 172.21.15.37:0/8183785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1edc1a1600 con 0x7f1edc104cc0 2024-08-20T05:06:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.045+0000 7f1ed2a00640 1 -- 172.21.15.37:0/8183785 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ecc0054d0 con 0x7f1edc104cc0 2024-08-20T05:06:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.045+0000 7f1ed2a00640 1 -- 172.21.15.37:0/8183785 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc010690 con 0x7f1edc104cc0 2024-08-20T05:06:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.045+0000 7f1ee0a00640 1 -- 172.21.15.37:0/8183785 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1edc1a7cc0 con 0x7f1edc104cc0 2024-08-20T05:06:02.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.048+0000 7f1ee344e740 1 Processor -- start 2024-08-20T05:06:02.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.048+0000 7f1ee344e740 1 -- start start 2024-08-20T05:06:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.049+0000 7f1ee344e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 0x55b4bba3bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.049+0000 7f1ee344e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba3c220 0x55b4bba47c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.049+0000 7f1ee344e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba481b0 0x55b4bba4a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.049+0000 7f1ee344e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b4bb9b1a60 con 0x55b4bba3b900 2024-08-20T05:06:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.049+0000 7f1ee344e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b4bb9a0f60 con 0x55b4bba481b0 2024-08-20T05:06:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.049+0000 7f1ee344e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b4bb9a4fa0 con 0x55b4bba3c220 2024-08-20T05:06:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.049+0000 7f1eda800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 0x55b4bba3bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:02.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.049+0000 7f1eda800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 0x55b4bba3bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58220/0 (socket says 172.21.15.37:58220) 2024-08-20T05:06:02.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.049+0000 7f1eda800640 1 -- 172.21.15.37:0/2726669003 learned_addr learned my addr 172.21.15.37:0/2726669003 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:02.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.049+0000 7f1ed2a00640 1 -- 172.21.15.37:0/8183785 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1ecc004e90 con 0x7f1edc104cc0 2024-08-20T05:06:02.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.049+0000 7f1ed9400640 1 --2- 172.21.15.37:0/2726669003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba481b0 0x55b4bba4a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:02.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.050+0000 7f1eda800640 1 -- 172.21.15.37:0/2726669003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba3c220 msgr2=0x55b4bba47c70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:06:02.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.050+0000 7f1eda800640 1 --2- 172.21.15.37:0/2726669003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba3c220 0x55b4bba47c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.050+0000 7f1eda800640 1 -- 172.21.15.37:0/2726669003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba481b0 msgr2=0x55b4bba4a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:02.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.050+0000 7f1eda800640 1 --2- 172.21.15.37:0/2726669003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba481b0 0x55b4bba4a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.050+0000 7f1eda800640 1 -- 172.21.15.37:0/2726669003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4bb9473e0 con 0x55b4bba3b900 2024-08-20T05:06:02.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.050+0000 7f1ed9400640 1 --2- 172.21.15.37:0/2726669003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba481b0 0x55b4bba4a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:06:02.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.050+0000 7f1eda800640 1 --2- 172.21.15.37:0/2726669003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 0x55b4bba3bce0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009410 tx=0x7f1ed4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1680037102c42a65 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:02.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.050+0000 7f1ec7000640 1 -- 172.21.15.37:0/2726669003 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4031cf0 con 0x55b4bba3b900 2024-08-20T05:06:02.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.050+0000 7f1ec7000640 1 -- 172.21.15.37:0/2726669003 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ed4036030 con 0x55b4bba3b900 2024-08-20T05:06:02.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.050+0000 7f1ec7000640 1 -- 172.21.15.37:0/2726669003 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed40042a0 con 0x55b4bba3b900 2024-08-20T05:06:02.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.051+0000 7f1ee344e740 1 -- 172.21.15.37:0/2726669003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 msgr2=0x55b4bba3bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:02.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.051+0000 7f1ee344e740 1 --2- 172.21.15.37:0/2726669003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 0x55b4bba3bce0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4009410 tx=0x7f1ed4005ef0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.051+0000 7f1ed2a00640 1 --2- 172.21.15.37:0/8183785 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ec00b3c50 0x7f1ec00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.051+0000 7f1ed2a00640 1 -- 172.21.15.37:0/8183785 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1ecc0e4320 con 0x7f1edc104cc0 2024-08-20T05:06:02.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.051+0000 7f1ee344e740 1 -- 172.21.15.37:0/2726669003 shutdown_connections 2024-08-20T05:06:02.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.051+0000 7f1ee344e740 1 --2- 172.21.15.37:0/2726669003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba481b0 0x55b4bba4a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.051+0000 7f1ee344e740 1 --2- 172.21.15.37:0/2726669003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba3c220 0x55b4bba47c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.051+0000 7f1ee344e740 1 --2- 172.21.15.37:0/2726669003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 0x55b4bba3bce0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.051+0000 7f1ee344e740 1 -- 172.21.15.37:0/2726669003 >> 172.21.15.37:0/2726669003 conn(0x55b4bba39730 msgr2=0x55b4bba3a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:02.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.051+0000 7f1eda800640 1 --2- 172.21.15.37:0/8183785 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ec00b3c50 0x7f1ec00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:02.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.052+0000 7f1ee344e740 1 -- 172.21.15.37:0/2726669003 shutdown_connections 2024-08-20T05:06:02.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.052+0000 7f1ee344e740 1 -- 172.21.15.37:0/2726669003 wait complete. 2024-08-20T05:06:02.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.052+0000 7f1ee344e740 1 -- start start 2024-08-20T05:06:02.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.052+0000 7f1eda800640 1 --2- 172.21.15.37:0/8183785 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ec00b3c50 0x7f1ec00b6110 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4006010 tx=0x7f1ed402a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:02.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.052+0000 7f1ee344e740 1 Processor -- start 2024-08-20T05:06:02.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.053+0000 7f1ee344e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba3b900 0x55b4bba47a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.053+0000 7f1ee344e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba3c220 0x55b4bba44e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.053+0000 7f1ee344e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba481b0 0x55b4bba45430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.053+0000 7f1ee344e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b4bb803700 con 0x55b4bba481b0 2024-08-20T05:06:02.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.053+0000 7f1ee344e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b4bb93c250 con 0x55b4bba3c220 2024-08-20T05:06:02.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.053+0000 7f1ee344e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b4bba4ac50 con 0x55b4bba3b900 2024-08-20T05:06:02.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.053+0000 7f1ee344e740 10 client.0 _ll_register_callbacks cb 0x55b4bb99b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:02.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.053+0000 7f1ed9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba3b900 0x55b4bba47a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:02.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.053+0000 7f1ed9400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba3c220 0x55b4bba44e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:02.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.053+0000 7f1ed9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba3b900 0x55b4bba47a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:54162/0 (socket says 172.21.15.37:54162) 2024-08-20T05:06:02.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.053+0000 7f1ed9e00640 1 -- 172.21.15.37:0/42551055 learned_addr learned my addr 172.21.15.37:0/42551055 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:02.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.053+0000 7f1eda800640 1 --2- 172.21.15.37:0/42551055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba481b0 0x55b4bba45430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:02.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.054+0000 7f1ed9e00640 1 -- 172.21.15.37:0/42551055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba3c220 msgr2=0x55b4bba44e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:02.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.054+0000 7f1ed9e00640 1 --2- 172.21.15.37:0/42551055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba3c220 0x55b4bba44e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.054+0000 7f1ed9e00640 1 -- 172.21.15.37:0/42551055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba481b0 msgr2=0x55b4bba45430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:02.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.054+0000 7f1ed9e00640 1 --2- 172.21.15.37:0/42551055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba481b0 0x55b4bba45430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.054+0000 7f1ed9e00640 1 -- 172.21.15.37:0/42551055 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4bb700650 con 0x55b4bba3b900 2024-08-20T05:06:02.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.054+0000 7f1ed9e00640 1 --2- 172.21.15.37:0/42551055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba3b900 0x55b4bba47a40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0097d0 tx=0x7f1ecc0aa8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c1299e62221ce94 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:02.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.054+0000 7f1ebb400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:06:02.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.054+0000 7f1ebb400640 1 -- 172.21.15.37:0/42551055 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc0e4160 con 0x55b4bba3b900 2024-08-20T05:06:02.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.054+0000 7f1ebb400640 1 -- 172.21.15.37:0/42551055 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1ecc0b3af0 con 0x55b4bba3b900 2024-08-20T05:06:02.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.054+0000 7f1ee344e740 1 -- 172.21.15.37:0/42551055 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ed4036030 con 0x55b4bba3b900 2024-08-20T05:06:02.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.055+0000 7f1ebb400640 1 -- 172.21.15.37:0/42551055 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1ecc0af2b0 con 0x55b4bba3b900 2024-08-20T05:06:02.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.055+0000 7f1ee344e740 10 client.26479 fetch_fsmap learned FSMap version 35 2024-08-20T05:06:02.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.055+0000 7f1ee344e740 1 -- 172.21.15.37:0/42551055 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b4bba56580 con 0x55b4bba3b900 2024-08-20T05:06:02.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.055+0000 7f1ebb400640 1 -- 172.21.15.37:0/42551055 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ed4036030 con 0x55b4bba3b900 2024-08-20T05:06:02.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.055+0000 7f1ebb400640 1 -- 172.21.15.37:0/42551055 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 35) ==== 8374+0+0 (secure 0 0 0) 0x7f1ecc0a6840 con 0x55b4bba3b900 2024-08-20T05:06:02.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.055+0000 7f1ee344e740 10 client.26479 fetch_fsmap finished waiting for FSMap version 35 2024-08-20T05:06:02.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.055+0000 7f1ee344e740 10 client.26479 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:02.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.055+0000 7f1ee344e740 20 client.26479 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.055+0000 7f1ee344e740 1 --2- 172.21.15.37:0/42551055 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b4bba57ae0 0x55b4bba59ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.055+0000 7f1ee344e740 4 client.26479 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:06:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.055+0000 7f1ee344e740 1 -- 172.21.15.37:0/42551055 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4bb9b39b0 con 0x55b4bba57ae0 2024-08-20T05:06:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.056+0000 7f1ed9400640 1 --2- 172.21.15.37:0/42551055 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b4bba57ae0 0x55b4bba59ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.056+0000 7f1ed9400640 1 --2- 172.21.15.37:0/42551055 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b4bba57ae0 0x55b4bba59ed0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e70816266bafd9bf server_cookie=6e9d0fc5d87a9af1 in_seq=0 out_seq=0 2024-08-20T05:06:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.056+0000 7f1ebb400640 10 client.26479 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.057+0000 7f1ebb400640 1 -- 172.21.15.37:0/42551055 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b4bb9b39b0 con 0x55b4bba57ae0 2024-08-20T05:06:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.057+0000 7f1ebb400640 10 client.26479 handle_command_reply: tid=0 2024-08-20T05:06:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.057+0000 7f1ee344e740 1 client.26479 shutdown 2024-08-20T05:06:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.057+0000 7f1ee344e740 1 -- 172.21.15.37:0/42551055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba3b900 msgr2=0x55b4bba47a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.057+0000 7f1ee344e740 1 --2- 172.21.15.37:0/42551055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba3b900 0x55b4bba47a40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0097d0 tx=0x7f1ecc0aa8e0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.057+0000 7f1ee344e740 1 -- 172.21.15.37:0/42551055 shutdown_connections 2024-08-20T05:06:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.057+0000 7f1ee344e740 1 --2- 172.21.15.37:0/42551055 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b4bba57ae0 0x55b4bba59ed0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.057+0000 7f1ee344e740 1 --2- 172.21.15.37:0/42551055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba481b0 0x55b4bba45430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.057+0000 7f1ee344e740 1 --2- 172.21.15.37:0/42551055 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba3c220 0x55b4bba44e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.057+0000 7f1ee344e740 1 --2- 172.21.15.37:0/42551055 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba3b900 0x55b4bba47a40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.057+0000 7f1ee344e740 1 -- 172.21.15.37:0/42551055 >> 172.21.15.37:0/42551055 conn(0x55b4bba39730 msgr2=0x55b4bba3f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:02.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.057+0000 7f1ebb400640 0 client.26479 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:02.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.057+0000 7f1ee344e740 1 -- 172.21.15.37:0/42551055 shutdown_connections 2024-08-20T05:06:02.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.057+0000 7f1ee344e740 1 -- 172.21.15.37:0/42551055 wait complete. 2024-08-20T05:06:02.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.057+0000 7f1ee344e740 20 client.26479 trim_cache size 0 max 16384 2024-08-20T05:06:02.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.075+0000 7f1ee344e740 1 Processor -- start 2024-08-20T05:06:02.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.076+0000 7f1ee344e740 1 -- start start 2024-08-20T05:06:02.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.076+0000 7f1ee344e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 0x55b4bba53d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.076+0000 7f1ee344e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba3c220 0x55b4bba5f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.076+0000 7f1ee344e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba481b0 0x55b4bba5fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.076+0000 7f1ee344e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc1b19d0 con 0x55b4bba3b900 2024-08-20T05:06:02.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.076+0000 7f1ee344e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc1b3540 con 0x55b4bba3c220 2024-08-20T05:06:02.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.076+0000 7f1ee344e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc1b20a0 con 0x55b4bba481b0 2024-08-20T05:06:02.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.076+0000 7f1ed9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 0x55b4bba53d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:02.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.076+0000 7f1ed9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 0x55b4bba53d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58244/0 (socket says 172.21.15.37:58244) 2024-08-20T05:06:02.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.076+0000 7f1ed9e00640 1 -- 172.21.15.37:0/1814595711 learned_addr learned my addr 172.21.15.37:0/1814595711 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:02.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.076+0000 7f1ed9400640 1 --2- 172.21.15.37:0/1814595711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba3c220 0x55b4bba5f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:02.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.076+0000 7f1eda800640 1 --2- 172.21.15.37:0/1814595711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba481b0 0x55b4bba5fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:02.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.077+0000 7f1ed9e00640 1 -- 172.21.15.37:0/1814595711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba481b0 msgr2=0x55b4bba5fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:02.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.077+0000 7f1ed9e00640 1 --2- 172.21.15.37:0/1814595711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba481b0 0x55b4bba5fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.077+0000 7f1ed9e00640 1 -- 172.21.15.37:0/1814595711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba3c220 msgr2=0x55b4bba5f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:02.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.077+0000 7f1ed9e00640 1 --2- 172.21.15.37:0/1814595711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba3c220 0x55b4bba5f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.077+0000 7f1ed9e00640 1 -- 172.21.15.37:0/1814595711 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4bba34e90 con 0x55b4bba3b900 2024-08-20T05:06:02.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.077+0000 7f1eda800640 1 --2- 172.21.15.37:0/1814595711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba481b0 0x55b4bba5fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:06:02.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.077+0000 7f1ed9e00640 1 --2- 172.21.15.37:0/1814595711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 0x55b4bba53d70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0e1df0 tx=0x7f1ecc0aa950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8f8d0aa2aed6dc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:02.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.077+0000 7f1ec6600640 1 -- 172.21.15.37:0/1814595711 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc005180 con 0x55b4bba3b900 2024-08-20T05:06:02.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.077+0000 7f1ec6600640 1 -- 172.21.15.37:0/1814595711 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ecc0e4160 con 0x55b4bba3b900 2024-08-20T05:06:02.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.077+0000 7f1ec6600640 1 -- 172.21.15.37:0/1814595711 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ecc0a9e20 con 0x55b4bba3b900 2024-08-20T05:06:02.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.078+0000 7f1ee344e740 1 -- 172.21.15.37:0/1814595711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 msgr2=0x55b4bba53d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:02.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.078+0000 7f1ee344e740 1 --2- 172.21.15.37:0/1814595711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 0x55b4bba53d70 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc0e1df0 tx=0x7f1ecc0aa950 comp rx=0 tx=0).stop 2024-08-20T05:06:02.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.078+0000 7f1ee344e740 1 -- 172.21.15.37:0/1814595711 shutdown_connections 2024-08-20T05:06:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.078+0000 7f1ee344e740 1 --2- 172.21.15.37:0/1814595711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba481b0 0x55b4bba5fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.078+0000 7f1ee344e740 1 --2- 172.21.15.37:0/1814595711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba3c220 0x55b4bba5f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.078+0000 7f1ee344e740 1 --2- 172.21.15.37:0/1814595711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 0x55b4bba53d70 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.078+0000 7f1ee344e740 1 -- 172.21.15.37:0/1814595711 >> 172.21.15.37:0/1814595711 conn(0x55b4bba39730 msgr2=0x55b4bba37ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.078+0000 7f1ee344e740 1 -- 172.21.15.37:0/1814595711 shutdown_connections 2024-08-20T05:06:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.078+0000 7f1ee344e740 1 -- 172.21.15.37:0/1814595711 wait complete. 2024-08-20T05:06:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.079+0000 7f1ee344e740 1 -- start start 2024-08-20T05:06:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.079+0000 7f1ee344e740 1 Processor -- start 2024-08-20T05:06:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.079+0000 7f1ee344e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 0x55b4bba50500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.079+0000 7f1ee344e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba3c220 0x55b4bba4b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.079+0000 7f1ee344e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba481b0 0x55b4bba4bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.079+0000 7f1ee344e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc1b2e40 con 0x55b4bba3b900 2024-08-20T05:06:02.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.079+0000 7f1ee344e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc1b2770 con 0x55b4bba481b0 2024-08-20T05:06:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.079+0000 7f1ee344e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1edc1af9b0 con 0x55b4bba3c220 2024-08-20T05:06:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.079+0000 7f1ee344e740 10 client.0 _ll_register_callbacks cb 0x7f1ecc009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.080+0000 7f1ed9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 0x55b4bba50500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.080+0000 7f1ed9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba3c220 0x55b4bba4b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.080+0000 7f1ed9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 0x55b4bba50500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58254/0 (socket says 172.21.15.37:58254) 2024-08-20T05:06:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.080+0000 7f1ed9e00640 1 -- 172.21.15.37:0/2760388129 learned_addr learned my addr 172.21.15.37:0/2760388129 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.080+0000 7f1eda800640 1 --2- 172.21.15.37:0/2760388129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba481b0 0x55b4bba4bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.080+0000 7f1ed9400640 1 -- 172.21.15.37:0/2760388129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba481b0 msgr2=0x55b4bba4bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.080+0000 7f1ed9400640 1 --2- 172.21.15.37:0/2760388129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba481b0 0x55b4bba4bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.080+0000 7f1ed9400640 1 -- 172.21.15.37:0/2760388129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 msgr2=0x55b4bba50500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.080+0000 7f1ed9400640 1 --2- 172.21.15.37:0/2760388129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 0x55b4bba50500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.080+0000 7f1ed9400640 1 -- 172.21.15.37:0/2760388129 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4bba4c740 con 0x55b4bba3c220 2024-08-20T05:06:02.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.080+0000 7f1ed9400640 1 --2- 172.21.15.37:0/2760388129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba3c220 0x55b4bba4b9d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55b4bba5a4b0 tx=0x7f1ec8012e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6592b6836ff7be2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.080+0000 7f1ebb400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:06:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.081+0000 7f1ebb400640 1 -- 172.21.15.37:0/2760388129 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ec801ea80 con 0x55b4bba3c220 2024-08-20T05:06:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.081+0000 7f1ebb400640 1 -- 172.21.15.37:0/2760388129 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1ec801ec20 con 0x55b4bba3c220 2024-08-20T05:06:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.081+0000 7f1ee344e740 1 -- 172.21.15.37:0/2760388129 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b4bb9af450 con 0x55b4bba3c220 2024-08-20T05:06:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.081+0000 7f1ebb400640 1 -- 172.21.15.37:0/2760388129 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f1ec801ee20 con 0x55b4bba3c220 2024-08-20T05:06:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.081+0000 7f1ee344e740 10 client.26485 fetch_fsmap learned FSMap version 35 2024-08-20T05:06:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.081+0000 7f1ee344e740 1 -- 172.21.15.37:0/2760388129 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55b4bbac2720 con 0x55b4bba3c220 2024-08-20T05:06:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.081+0000 7f1ebb400640 1 -- 172.21.15.37:0/2760388129 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b4bb9af450 con 0x55b4bba3c220 2024-08-20T05:06:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.081+0000 7f1ebb400640 1 -- 172.21.15.37:0/2760388129 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 35) ==== 8374+0+0 (secure 0 0 0) 0x7f1ec8025070 con 0x55b4bba3c220 2024-08-20T05:06:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.081+0000 7f1ee344e740 10 client.26485 fetch_fsmap finished waiting for FSMap version 35 2024-08-20T05:06:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.081+0000 7f1ee344e740 10 client.26485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.081+0000 7f1ee344e740 20 client.26485 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.081+0000 7f1ee344e740 1 --2- 172.21.15.37:0/2760388129 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b4bbac2ea0 0x55b4bbac52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:02.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.082+0000 7f1ee344e740 4 client.26485 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:06:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.082+0000 7f1ee344e740 1 -- 172.21.15.37:0/2760388129 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b4bb9acb90 con 0x55b4bbac2ea0 2024-08-20T05:06:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.082+0000 7f1ed9e00640 1 --2- 172.21.15.37:0/2760388129 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b4bbac2ea0 0x55b4bbac52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.082+0000 7f1ed9e00640 1 --2- 172.21.15.37:0/2760388129 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b4bbac2ea0 0x55b4bbac52c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c80efa4f7e87ca6 server_cookie=34593e674cbbb96a in_seq=0 out_seq=0 2024-08-20T05:06:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.082+0000 7f1ebb400640 10 client.26485 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.083+0000 7f1ebb400640 1 -- 172.21.15.37:0/2760388129 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b4bb9acb90 con 0x55b4bbac2ea0 2024-08-20T05:06:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.083+0000 7f1ebb400640 10 client.26485 handle_command_reply: tid=0 2024-08-20T05:06:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.083+0000 7f1ee344e740 1 client.26485 shutdown 2024-08-20T05:06:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.083+0000 7f1ee344e740 1 -- 172.21.15.37:0/2760388129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba3c220 msgr2=0x55b4bba4b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.083+0000 7f1ee344e740 1 --2- 172.21.15.37:0/2760388129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba3c220 0x55b4bba4b9d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x55b4bba5a4b0 tx=0x7f1ec8012e70 comp rx=0 tx=0).stop 2024-08-20T05:06:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.083+0000 7f1ee344e740 1 -- 172.21.15.37:0/2760388129 shutdown_connections 2024-08-20T05:06:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.083+0000 7f1ee344e740 1 --2- 172.21.15.37:0/2760388129 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b4bbac2ea0 0x55b4bbac52c0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.083+0000 7f1ee344e740 1 --2- 172.21.15.37:0/2760388129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b4bba481b0 0x55b4bba4bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.083+0000 7f1ee344e740 1 --2- 172.21.15.37:0/2760388129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b4bba3c220 0x55b4bba4b9d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.083+0000 7f1ee344e740 1 --2- 172.21.15.37:0/2760388129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b4bba3b900 0x55b4bba50500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.083+0000 7f1ebb400640 0 client.26485 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.083+0000 7f1ee344e740 1 -- 172.21.15.37:0/2760388129 >> 172.21.15.37:0/2760388129 conn(0x55b4bba39730 msgr2=0x55b4bba464c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.083+0000 7f1ee344e740 1 -- 172.21.15.37:0/2760388129 shutdown_connections 2024-08-20T05:06:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.083+0000 7f1ee344e740 1 -- 172.21.15.37:0/2760388129 wait complete. 2024-08-20T05:06:02.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.083+0000 7f1ee344e740 20 client.26485 trim_cache size 0 max 16384 2024-08-20T05:06:02.090 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:06:02.090 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-20T05:06:02.090 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-08-20T05:06:02.091 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:06:02.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.084+0000 7f1ee0a00640 1 -- 172.21.15.37:0/8183785 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ec00b3c50 msgr2=0x7f1ec00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:02.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.084+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/8183785 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ec00b3c50 0x7f1ec00b6110 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4006010 tx=0x7f1ed402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.084+0000 7f1ee0a00640 1 -- 172.21.15.37:0/8183785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1edc104cc0 msgr2=0x7f1edc19b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:02.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.084+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/8183785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1edc104cc0 0x7f1edc19b260 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc00e9f0 tx=0x7f1ecc00edf0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.084+0000 7f1ee0a00640 1 -- 172.21.15.37:0/8183785 shutdown_connections 2024-08-20T05:06:02.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.084+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/8183785 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1ec00b3c50 0x7f1ec00b6110 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.084+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/8183785 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1edc10b050 0x7f1edc1a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.084+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/8183785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1edc10a6d0 0x7f1edc19b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.084+0000 7f1ee0a00640 1 --2- 172.21.15.37:0/8183785 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1edc104cc0 0x7f1edc19b260 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:02.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.084+0000 7f1ee0a00640 1 -- 172.21.15.37:0/8183785 >> 172.21.15.37:0/8183785 conn(0x7f1edc1006b0 msgr2=0x7f1edc101110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:02.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.084+0000 7f1ee0a00640 1 -- 172.21.15.37:0/8183785 shutdown_connections 2024-08-20T05:06:02.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:02.084+0000 7f1ee0a00640 1 -- 172.21.15.37:0/8183785 wait complete. 2024-08-20T05:06:02.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:01 smithi135 ceph-mon[22342]: pgmap v514: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.8 MiB/s wr, 510 op/s 2024-08-20T05:06:03.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 185.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:06:03.113 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T05:06:03.113 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:06:03.493 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:06:03.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:03 smithi130 ceph-mon[22007]: pgmap v515: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.1 MiB/s wr, 429 op/s 2024-08-20T05:06:04.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:03 smithi037 ceph-mon[17265]: pgmap v515: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.1 MiB/s wr, 429 op/s 2024-08-20T05:06:04.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:03 smithi135 ceph-mon[22342]: pgmap v515: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.1 MiB/s wr, 429 op/s 2024-08-20T05:06:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.116+0000 7f2af4c00640 1 -- 172.21.15.37:0/3558523513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2af0104b00 msgr2=0x7f2af0104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.116+0000 7f2af4c00640 1 --2- 172.21.15.37:0/3558523513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2af0104b00 0x7f2af0104ee0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009900 tx=0x7f2ae002a410 comp rx=0 tx=0).stop 2024-08-20T05:06:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.116+0000 7f2af4c00640 1 -- 172.21.15.37:0/3558523513 shutdown_connections 2024-08-20T05:06:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.116+0000 7f2af4c00640 1 --2- 172.21.15.37:0/3558523513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2af010ae90 0x7f2af0111690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.116+0000 7f2af4c00640 1 --2- 172.21.15.37:0/3558523513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2af010a510 0x7f2af010a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.116+0000 7f2af4c00640 1 --2- 172.21.15.37:0/3558523513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2af0104b00 0x7f2af0104ee0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.116+0000 7f2af4c00640 1 -- 172.21.15.37:0/3558523513 >> 172.21.15.37:0/3558523513 conn(0x7f2af0100550 msgr2=0x7f2af0102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.116+0000 7f2af4c00640 1 -- 172.21.15.37:0/3558523513 shutdown_connections 2024-08-20T05:06:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.116+0000 7f2af4c00640 1 -- 172.21.15.37:0/3558523513 wait complete. 2024-08-20T05:06:04.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.117+0000 7f2af4c00640 1 Processor -- start 2024-08-20T05:06:04.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.117+0000 7f2af4c00640 1 -- start start 2024-08-20T05:06:04.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.117+0000 7f2af4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2af0104b00 0x7f2af019af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:04.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.118+0000 7f2af4c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2af010a510 0x7f2af019b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:04.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.118+0000 7f2af4c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2af010ae90 0x7f2af01a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:04.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.118+0000 7f2af4c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2af0114ba0 con 0x7f2af0104b00 2024-08-20T05:06:04.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.118+0000 7f2af4c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2af0114a20 con 0x7f2af010a510 2024-08-20T05:06:04.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.118+0000 7f2af4c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2af0114d20 con 0x7f2af010ae90 2024-08-20T05:06:04.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.118+0000 7f2aef400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2af0104b00 0x7f2af019af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:04.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.118+0000 7f2aef400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2af0104b00 0x7f2af019af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55906/0 (socket says 172.21.15.37:55906) 2024-08-20T05:06:04.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.118+0000 7f2aef400640 1 -- 172.21.15.37:0/2196689563 learned_addr learned my addr 172.21.15.37:0/2196689563 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:04.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.118+0000 7f2ae7e00640 1 --2- 172.21.15.37:0/2196689563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2af010a510 0x7f2af019b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:04.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.118+0000 7f2aefe00640 1 --2- 172.21.15.37:0/2196689563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2af010ae90 0x7f2af01a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.118+0000 7f2aef400640 1 -- 172.21.15.37:0/2196689563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2af010ae90 msgr2=0x7f2af01a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.118+0000 7f2aef400640 1 --2- 172.21.15.37:0/2196689563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2af010ae90 0x7f2af01a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.118+0000 7f2aef400640 1 -- 172.21.15.37:0/2196689563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2af010a510 msgr2=0x7f2af019b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.118+0000 7f2aef400640 1 --2- 172.21.15.37:0/2196689563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2af010a510 0x7f2af019b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.118+0000 7f2aef400640 1 -- 172.21.15.37:0/2196689563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af01a0fc0 con 0x7f2af0104b00 2024-08-20T05:06:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.119+0000 7f2aef400640 1 --2- 172.21.15.37:0/2196689563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2af0104b00 0x7f2af019af10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0005ab0 tx=0x7f2ae0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.119+0000 7f2aecc00640 1 -- 172.21.15.37:0/2196689563 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae003f070 con 0x7f2af0104b00 2024-08-20T05:06:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.119+0000 7f2aecc00640 1 -- 172.21.15.37:0/2196689563 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ae0031b60 con 0x7f2af0104b00 2024-08-20T05:06:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.119+0000 7f2aecc00640 1 -- 172.21.15.37:0/2196689563 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0035030 con 0x7f2af0104b00 2024-08-20T05:06:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.119+0000 7f2af4c00640 1 -- 172.21.15.37:0/2196689563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2af01a1250 con 0x7f2af0104b00 2024-08-20T05:06:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.119+0000 7f2af4c00640 1 -- 172.21.15.37:0/2196689563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2af01a7970 con 0x7f2af0104b00 2024-08-20T05:06:04.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.120+0000 7f2af4c00640 1 -- 172.21.15.37:0/2196689563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2af0104ee0 con 0x7f2af0104b00 2024-08-20T05:06:04.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.122+0000 7f2aecc00640 1 -- 172.21.15.37:0/2196689563 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2ae0042070 con 0x7f2af0104b00 2024-08-20T05:06:04.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.125+0000 7f2aecc00640 1 --2- 172.21.15.37:0/2196689563 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2ad40b3cf0 0x7f2ad40b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:04.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.125+0000 7f2aecc00640 1 -- 172.21.15.37:0/2196689563 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2ae0104650 con 0x7f2af0104b00 2024-08-20T05:06:04.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.125+0000 7f2ae7e00640 1 --2- 172.21.15.37:0/2196689563 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2ad40b3cf0 0x7f2ad40b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:04.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.126+0000 7f2ae7e00640 1 --2- 172.21.15.37:0/2196689563 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2ad40b3cf0 0x7f2ad40b61b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2af0103ea0 tx=0x7f2ad8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:04.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.129+0000 7f2aecc00640 1 -- 172.21.15.37:0/2196689563 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f2ae00cb250 con 0x7f2af0104b00 2024-08-20T05:06:04.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.366+0000 7f2af4c00640 1 -- 172.21.15.37:0/2196689563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2af01a7bd0 con 0x7f2af0104b00 2024-08-20T05:06:04.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.367+0000 7f2aecc00640 1 -- 172.21.15.37:0/2196689563 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11981 (secure 0 0 0) 0x7f2ae00cf7a0 con 0x7f2af0104b00 2024-08-20T05:06:04.368 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:06:04.368 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":35,"btime":"2024-08-20T05:05:56:649446+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:05:56.276671+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:06:04.368 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 35 2024-08-20T05:06:04.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.369+0000 7f2af4c00640 1 -- 172.21.15.37:0/2196689563 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2ad40b3cf0 msgr2=0x7f2ad40b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:04.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.369+0000 7f2af4c00640 1 --2- 172.21.15.37:0/2196689563 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2ad40b3cf0 0x7f2ad40b61b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2af0103ea0 tx=0x7f2ad8005f90 comp rx=0 tx=0).stop 2024-08-20T05:06:04.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.369+0000 7f2af4c00640 1 -- 172.21.15.37:0/2196689563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2af0104b00 msgr2=0x7f2af019af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:04.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.369+0000 7f2af4c00640 1 --2- 172.21.15.37:0/2196689563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2af0104b00 0x7f2af019af10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0005ab0 tx=0x7f2ae0003c10 comp rx=0 tx=0).stop 2024-08-20T05:06:04.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.369+0000 7f2af4c00640 1 -- 172.21.15.37:0/2196689563 shutdown_connections 2024-08-20T05:06:04.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.369+0000 7f2af4c00640 1 --2- 172.21.15.37:0/2196689563 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2ad40b3cf0 0x7f2ad40b61b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:04.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.369+0000 7f2af4c00640 1 --2- 172.21.15.37:0/2196689563 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2af010ae90 0x7f2af01a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:04.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.369+0000 7f2af4c00640 1 --2- 172.21.15.37:0/2196689563 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2af010a510 0x7f2af019b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:04.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.369+0000 7f2af4c00640 1 --2- 172.21.15.37:0/2196689563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2af0104b00 0x7f2af019af10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:04.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.369+0000 7f2af4c00640 1 -- 172.21.15.37:0/2196689563 >> 172.21.15.37:0/2196689563 conn(0x7f2af0100550 msgr2=0x7f2af0101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:04.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.369+0000 7f2af4c00640 1 -- 172.21.15.37:0/2196689563 shutdown_connections 2024-08-20T05:06:04.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:04.369+0000 7f2af4c00640 1 -- 172.21.15.37:0/2196689563 wait complete. 2024-08-20T05:06:04.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:04 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2196689563' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:06:05.014 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:06:05.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:04 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2196689563' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:06:05.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:04 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2196689563' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:06:05.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T05:06:05.407 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:06:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.496+0000 7fe9aa200640 1 -- 172.21.15.37:0/3644319793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9a410a3e0 msgr2=0x7fe9a410c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.496+0000 7fe9aa200640 1 --2- 172.21.15.37:0/3644319793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9a410a3e0 0x7fe9a410c880 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009ca0 tx=0x7fe99c02a8c0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.496+0000 7fe9aa200640 1 -- 172.21.15.37:0/3644319793 shutdown_connections 2024-08-20T05:06:05.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.496+0000 7fe9aa200640 1 --2- 172.21.15.37:0/3644319793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9a410a3e0 0x7fe9a410c880 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.496+0000 7fe9aa200640 1 --2- 172.21.15.37:0/3644319793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9a41079a0 0x7fe9a4109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.496+0000 7fe9aa200640 1 --2- 172.21.15.37:0/3644319793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9a406b060 0x7fe9a4107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.496+0000 7fe9aa200640 1 -- 172.21.15.37:0/3644319793 >> 172.21.15.37:0/3644319793 conn(0x7fe9a40fcc50 msgr2=0x7fe9a40ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.496+0000 7fe9aa200640 1 -- 172.21.15.37:0/3644319793 shutdown_connections 2024-08-20T05:06:05.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.496+0000 7fe9aa200640 1 -- 172.21.15.37:0/3644319793 wait complete. 2024-08-20T05:06:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.497+0000 7fe9aa200640 1 Processor -- start 2024-08-20T05:06:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.497+0000 7fe9aa200640 1 -- start start 2024-08-20T05:06:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.497+0000 7fe9aa200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9a406b060 0x7fe9a419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.497+0000 7fe9aa200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9a41079a0 0x7fe9a419b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.497+0000 7fe9aa200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9a410a3e0 0x7fe9a419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.497+0000 7fe9aa200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a4110390 con 0x7fe9a41079a0 2024-08-20T05:06:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.497+0000 7fe9aa200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a4110210 con 0x7fe9a410a3e0 2024-08-20T05:06:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.497+0000 7fe9aa200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a4110510 con 0x7fe9a406b060 2024-08-20T05:06:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.498+0000 7fe9a8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9a406b060 0x7fe9a419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.498+0000 7fe9a8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9a406b060 0x7fe9a419aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51164/0 (socket says 172.21.15.37:51164) 2024-08-20T05:06:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.498+0000 7fe9a8e00640 1 -- 172.21.15.37:0/2227846715 learned_addr learned my addr 172.21.15.37:0/2227846715 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.498+0000 7fe99be00640 1 --2- 172.21.15.37:0/2227846715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9a41079a0 0x7fe9a419b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.498+0000 7fe9a9800640 1 --2- 172.21.15.37:0/2227846715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9a410a3e0 0x7fe9a419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.498+0000 7fe9a8e00640 1 -- 172.21.15.37:0/2227846715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9a410a3e0 msgr2=0x7fe9a419bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.498+0000 7fe9a8e00640 1 --2- 172.21.15.37:0/2227846715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9a410a3e0 0x7fe9a419bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.498+0000 7fe9a8e00640 1 -- 172.21.15.37:0/2227846715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9a41079a0 msgr2=0x7fe9a419b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.498+0000 7fe9a8e00640 1 --2- 172.21.15.37:0/2227846715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9a41079a0 0x7fe9a419b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.498+0000 7fe9a8e00640 1 -- 172.21.15.37:0/2227846715 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a419c620 con 0x7fe9a406b060 2024-08-20T05:06:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.498+0000 7fe99be00640 1 --2- 172.21.15.37:0/2227846715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9a41079a0 0x7fe9a419b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.498+0000 7fe9a8e00640 1 --2- 172.21.15.37:0/2227846715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9a406b060 0x7fe9a419aae0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe99400e9f0 tx=0x7fe99400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.499+0000 7fe9a2000640 1 -- 172.21.15.37:0/2227846715 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99400cd80 con 0x7fe9a406b060 2024-08-20T05:06:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.499+0000 7fe9aa200640 1 -- 172.21.15.37:0/2227846715 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a419c910 con 0x7fe9a406b060 2024-08-20T05:06:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.499+0000 7fe9a2000640 1 -- 172.21.15.37:0/2227846715 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9940108e0 con 0x7fe9a406b060 2024-08-20T05:06:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.499+0000 7fe9a2000640 1 -- 172.21.15.37:0/2227846715 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe994018980 con 0x7fe9a406b060 2024-08-20T05:06:05.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.499+0000 7fe9aa200640 1 -- 172.21.15.37:0/2227846715 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a41a2fe0 con 0x7fe9a406b060 2024-08-20T05:06:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.502+0000 7fe9ae7c6740 1 Processor -- start 2024-08-20T05:06:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.502+0000 7fe9ae7c6740 1 -- start start 2024-08-20T05:06:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.502+0000 7fe9ae7c6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f57f0 0x55d09c1f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.502+0000 7fe9ae7c6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1f8120 0x55d09c1fa510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.502+0000 7fe9ae7c6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1fab60 0x55d09c1fd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.502+0000 7fe9ae7c6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d09c168210 con 0x55d09c1f8120 2024-08-20T05:06:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.502+0000 7fe9ae7c6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d09c157710 con 0x55d09c1f57f0 2024-08-20T05:06:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.502+0000 7fe9ae7c6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d09c15b750 con 0x55d09c1fab60 2024-08-20T05:06:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.502+0000 7fe9a2000640 1 -- 172.21.15.37:0/2227846715 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe994010430 con 0x7fe9a406b060 2024-08-20T05:06:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.502+0000 7fe99be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1fab60 0x55d09c1fd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.502+0000 7fe9a9800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f57f0 0x55d09c1f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.502+0000 7fe9a9800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f57f0 0x55d09c1f7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:39648/0 (socket says 172.21.15.37:39648) 2024-08-20T05:06:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.502+0000 7fe9a9800640 1 -- 172.21.15.37:0/3277694268 learned_addr learned my addr 172.21.15.37:0/3277694268 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.503+0000 7fe9a8e00640 1 --2- 172.21.15.37:0/3277694268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1f8120 0x55d09c1fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.503+0000 7fe9a9800640 1 -- 172.21.15.37:0/3277694268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1fab60 msgr2=0x55d09c1fd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.503+0000 7fe9a9800640 1 --2- 172.21.15.37:0/3277694268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1fab60 0x55d09c1fd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.503+0000 7fe9a9800640 1 -- 172.21.15.37:0/3277694268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1f8120 msgr2=0x55d09c1fa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:05.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.503+0000 7fe9a9800640 1 --2- 172.21.15.37:0/3277694268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1f8120 0x55d09c1fa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.503+0000 7fe9a9800640 1 -- 172.21.15.37:0/3277694268 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d09c123de0 con 0x55d09c1f57f0 2024-08-20T05:06:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.503+0000 7fe9a9800640 1 --2- 172.21.15.37:0/3277694268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f57f0 0x55d09c1f7be0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009ca0 tx=0x7fe99c0093c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95150cb9dd9b403b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.503+0000 7fe99a000640 1 -- 172.21.15.37:0/3277694268 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c031650 con 0x55d09c1f57f0 2024-08-20T05:06:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.503+0000 7fe99a000640 1 -- 172.21.15.37:0/3277694268 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe99c036030 con 0x55d09c1f57f0 2024-08-20T05:06:05.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.503+0000 7fe99a000640 1 -- 172.21.15.37:0/3277694268 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c004680 con 0x55d09c1f57f0 2024-08-20T05:06:05.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.504+0000 7fe9a2000640 1 --2- 172.21.15.37:0/2227846715 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9880b3bd0 0x7fe9880b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.504+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/3277694268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f57f0 msgr2=0x55d09c1f7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.504+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/3277694268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f57f0 0x55d09c1f7be0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009ca0 tx=0x7fe99c0093c0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.504+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/3277694268 shutdown_connections 2024-08-20T05:06:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.504+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/3277694268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1fab60 0x55d09c1fd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.504+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/3277694268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1f8120 0x55d09c1fa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.504+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/3277694268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f57f0 0x55d09c1f7be0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.504+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/3277694268 >> 172.21.15.37:0/3277694268 conn(0x55d09c1f0940 msgr2=0x55d09c1f16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.504+0000 7fe9a2000640 1 -- 172.21.15.37:0/2227846715 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe9940e4300 con 0x7fe9a406b060 2024-08-20T05:06:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.504+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/3277694268 shutdown_connections 2024-08-20T05:06:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.504+0000 7fe9a8e00640 1 --2- 172.21.15.37:0/2227846715 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9880b3bd0 0x7fe9880b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.504+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/3277694268 wait complete. 2024-08-20T05:06:05.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.505+0000 7fe9ae7c6740 1 -- start start 2024-08-20T05:06:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.505+0000 7fe9a8e00640 1 --2- 172.21.15.37:0/2227846715 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9880b3bd0 0x7fe9880b6090 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe9940a6f80 tx=0x7fe994000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.505+0000 7fe9ae7c6740 1 Processor -- start 2024-08-20T05:06:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.505+0000 7fe9ae7c6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f57f0 0x55d09c1fecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.505+0000 7fe9ae7c6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1f8120 0x55d09c1ff390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.505+0000 7fe9ae7c6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1fab60 0x55d09c1fff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.505+0000 7fe9ae7c6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d09c090ab0 con 0x55d09c1fab60 2024-08-20T05:06:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.505+0000 7fe9ae7c6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d09c0fe140 con 0x55d09c1f57f0 2024-08-20T05:06:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.505+0000 7fe9ae7c6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d09c1fd960 con 0x55d09c1f8120 2024-08-20T05:06:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.506+0000 7fe9ae7c6740 10 client.0 _ll_register_callbacks cb 0x55d09c1115d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.506+0000 7fe9a9800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f57f0 0x55d09c1fecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.506+0000 7fe9a9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1fab60 0x55d09c1fff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.506+0000 7fe9a9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1fab60 0x55d09c1fff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55944/0 (socket says 172.21.15.37:55944) 2024-08-20T05:06:05.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.506+0000 7fe9a9800640 1 -- 172.21.15.37:0/251889199 learned_addr learned my addr 172.21.15.37:0/251889199 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.506+0000 7fe99be00640 1 --2- 172.21.15.37:0/251889199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1f8120 0x55d09c1ff390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.506+0000 7fe99be00640 1 -- 172.21.15.37:0/251889199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f57f0 msgr2=0x55d09c1fecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.506+0000 7fe99be00640 1 --2- 172.21.15.37:0/251889199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f57f0 0x55d09c1fecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.506+0000 7fe99be00640 1 -- 172.21.15.37:0/251889199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1fab60 msgr2=0x55d09c1fff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.506+0000 7fe99be00640 1 --2- 172.21.15.37:0/251889199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1fab60 0x55d09c1fff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.506+0000 7fe99be00640 1 -- 172.21.15.37:0/251889199 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d09c0ff170 con 0x55d09c1f8120 2024-08-20T05:06:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.506+0000 7fe9a9800640 1 --2- 172.21.15.37:0/251889199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1fab60 0x55d09c1fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.507+0000 7fe99be00640 1 --2- 172.21.15.37:0/251889199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1f8120 0x55d09c1ff390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe98c012cf0 tx=0x7fe98c00f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69a23b4e0d3fc325 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.507+0000 7fe992a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:06:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.507+0000 7fe992a00640 1 -- 172.21.15.37:0/251889199 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c00fe60 con 0x55d09c1f8120 2024-08-20T05:06:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.507+0000 7fe992a00640 1 -- 172.21.15.37:0/251889199 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe98c0120d0 con 0x55d09c1f8120 2024-08-20T05:06:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.507+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/251889199 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe99c036030 con 0x55d09c1f8120 2024-08-20T05:06:05.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.507+0000 7fe992a00640 1 -- 172.21.15.37:0/251889199 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe98c025050 con 0x55d09c1f8120 2024-08-20T05:06:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.507+0000 7fe9ae7c6740 10 client.26503 fetch_fsmap learned FSMap version 35 2024-08-20T05:06:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.507+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/251889199 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d09beba790 con 0x55d09c1f8120 2024-08-20T05:06:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.507+0000 7fe992a00640 1 -- 172.21.15.37:0/251889199 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe99c036030 con 0x55d09c1f8120 2024-08-20T05:06:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.508+0000 7fe992a00640 1 -- 172.21.15.37:0/251889199 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 35) ==== 8374+0+0 (secure 0 0 0) 0x7fe98c0104c0 con 0x55d09c1f8120 2024-08-20T05:06:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.508+0000 7fe9ae7c6740 10 client.26503 fetch_fsmap finished waiting for FSMap version 35 2024-08-20T05:06:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.508+0000 7fe9ae7c6740 10 client.26503 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.508+0000 7fe9ae7c6740 20 client.26503 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.508+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/251889199 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d09c20aa50 0x55d09c20ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.508+0000 7fe9ae7c6740 4 client.26503 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:06:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.508+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/251889199 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d09c16a160 con 0x55d09c20aa50 2024-08-20T05:06:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.508+0000 7fe9a9800640 1 --2- 172.21.15.37:0/251889199 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d09c20aa50 0x55d09c20ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.509+0000 7fe9a9800640 1 --2- 172.21.15.37:0/251889199 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d09c20aa50 0x55d09c20ceb0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87ff01a64d90c306 server_cookie=f0d2a2e7e6439839 in_seq=0 out_seq=0 2024-08-20T05:06:05.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.509+0000 7fe992a00640 10 client.26503 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.510+0000 7fe992a00640 1 -- 172.21.15.37:0/251889199 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d09c16a160 con 0x55d09c20aa50 2024-08-20T05:06:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.510+0000 7fe992a00640 10 client.26503 handle_command_reply: tid=0 2024-08-20T05:06:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.510+0000 7fe9ae7c6740 1 client.26503 shutdown 2024-08-20T05:06:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.510+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/251889199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1f8120 msgr2=0x55d09c1ff390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.510+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/251889199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1f8120 0x55d09c1ff390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe98c012cf0 tx=0x7fe98c00f790 comp rx=0 tx=0).stop 2024-08-20T05:06:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.510+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/251889199 shutdown_connections 2024-08-20T05:06:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.510+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/251889199 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d09c20aa50 0x55d09c20ceb0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.510+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/251889199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1fab60 0x55d09c1fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.510+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/251889199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1f8120 0x55d09c1ff390 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.510+0000 7fe992a00640 0 client.26503 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.510+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/251889199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f57f0 0x55d09c1fecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.510+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/251889199 >> 172.21.15.37:0/251889199 conn(0x55d09c1f0940 msgr2=0x55d09c1ef9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.510+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/251889199 shutdown_connections 2024-08-20T05:06:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.510+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/251889199 wait complete. 2024-08-20T05:06:05.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.510+0000 7fe9ae7c6740 20 client.26503 trim_cache size 0 max 16384 2024-08-20T05:06:05.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.525+0000 7fe9ae7c6740 1 Processor -- start 2024-08-20T05:06:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.526+0000 7fe9ae7c6740 1 -- start start 2024-08-20T05:06:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.526+0000 7fe9ae7c6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1f57f0 0x55d09c1ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.526+0000 7fe9ae7c6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f8120 0x55d09c1efde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.526+0000 7fe9ae7c6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1fab60 0x55d09c1f2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.526+0000 7fe9ae7c6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a41ad370 con 0x55d09c1fab60 2024-08-20T05:06:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.526+0000 7fe9ae7c6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a41aeee0 con 0x55d09c1f8120 2024-08-20T05:06:05.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.526+0000 7fe9ae7c6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a41ada40 con 0x55d09c1f57f0 2024-08-20T05:06:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.526+0000 7fe9a9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1fab60 0x55d09c1f2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.526+0000 7fe9a9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1fab60 0x55d09c1f2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55950/0 (socket says 172.21.15.37:55950) 2024-08-20T05:06:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.526+0000 7fe9a9800640 1 -- 172.21.15.37:0/1170324170 learned_addr learned my addr 172.21.15.37:0/1170324170 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.526+0000 7fe9a9800640 1 --2- 172.21.15.37:0/1170324170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1f57f0 0x55d09c1ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.526+0000 7fe99be00640 1 --2- 172.21.15.37:0/1170324170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f8120 0x55d09c1efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.527+0000 7fe9a9800640 1 -- 172.21.15.37:0/1170324170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1f57f0 msgr2=0x55d09c1ef8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.527+0000 7fe9a9800640 1 --2- 172.21.15.37:0/1170324170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1f57f0 0x55d09c1ef8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.527+0000 7fe9a9800640 1 -- 172.21.15.37:0/1170324170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f8120 msgr2=0x55d09c1efde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.527+0000 7fe9a9800640 1 --2- 172.21.15.37:0/1170324170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f8120 0x55d09c1efde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.527+0000 7fe9a9800640 1 -- 172.21.15.37:0/1170324170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d09c1f1ba0 con 0x55d09c1fab60 2024-08-20T05:06:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.527+0000 7fe9a9800640 1 --2- 172.21.15.37:0/1170324170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1fab60 0x55d09c1f2770 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009ca0 tx=0x7fe99c009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4e4be6cb7a996a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.527+0000 7fe999600640 1 -- 172.21.15.37:0/1170324170 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c04a040 con 0x55d09c1fab60 2024-08-20T05:06:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.527+0000 7fe999600640 1 -- 172.21.15.37:0/1170324170 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe99c036050 con 0x55d09c1fab60 2024-08-20T05:06:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.527+0000 7fe999600640 1 -- 172.21.15.37:0/1170324170 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c02f870 con 0x55d09c1fab60 2024-08-20T05:06:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.528+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/1170324170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1fab60 msgr2=0x55d09c1f2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.528+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/1170324170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1fab60 0x55d09c1f2770 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009ca0 tx=0x7fe99c009a20 comp rx=0 tx=0).stop 2024-08-20T05:06:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.528+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/1170324170 shutdown_connections 2024-08-20T05:06:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.528+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/1170324170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1fab60 0x55d09c1f2770 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.528+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/1170324170 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f8120 0x55d09c1efde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.528+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/1170324170 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1f57f0 0x55d09c1ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.528+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/1170324170 >> 172.21.15.37:0/1170324170 conn(0x55d09c1f0940 msgr2=0x55d09c1ef190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:05.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.528+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/1170324170 shutdown_connections 2024-08-20T05:06:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.528+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/1170324170 wait complete. 2024-08-20T05:06:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.528+0000 7fe9ae7c6740 1 -- start start 2024-08-20T05:06:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.528+0000 7fe9ae7c6740 1 Processor -- start 2024-08-20T05:06:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe9ae7c6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f57f0 0x55d09c206880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe9ae7c6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1f8120 0x55d09c205580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe9ae7c6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1fab60 0x55d09c205ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe9ae7c6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a41ae7e0 con 0x55d09c1f8120 2024-08-20T05:06:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe9ae7c6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a41ae110 con 0x55d09c1f57f0 2024-08-20T05:06:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe9ae7c6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a41ab350 con 0x55d09c1fab60 2024-08-20T05:06:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe9ae7c6740 10 client.0 _ll_register_callbacks cb 0x7fe98c009cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe99be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1f8120 0x55d09c205580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe99be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1f8120 0x55d09c205580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55962/0 (socket says 172.21.15.37:55962) 2024-08-20T05:06:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe99be00640 1 -- 172.21.15.37:0/2601472445 learned_addr learned my addr 172.21.15.37:0/2601472445 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe9a9800640 1 --2- 172.21.15.37:0/2601472445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f57f0 0x55d09c206880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe99be00640 1 -- 172.21.15.37:0/2601472445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1fab60 msgr2=0x55d09c205ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe9a9800640 1 --2- 172.21.15.37:0/2601472445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1fab60 0x55d09c205ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe99be00640 1 --2- 172.21.15.37:0/2601472445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1fab60 0x55d09c205ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe99be00640 1 -- 172.21.15.37:0/2601472445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f57f0 msgr2=0x55d09c206880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe99be00640 1 --2- 172.21.15.37:0/2601472445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f57f0 0x55d09c206880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe99be00640 1 -- 172.21.15.37:0/2601472445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d09c2002d0 con 0x55d09c1f8120 2024-08-20T05:06:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.529+0000 7fe9a9800640 1 --2- 172.21.15.37:0/2601472445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1fab60 0x55d09c205ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:06:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.530+0000 7fe99be00640 1 --2- 172.21.15.37:0/2601472445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1f8120 0x55d09c205580 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe98c0059f0 tx=0x7fe98c012300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e847e64fefc95ed server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:05.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.530+0000 7fe992a00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:06:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.530+0000 7fe992a00640 1 -- 172.21.15.37:0/2601472445 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c010640 con 0x55d09c1f8120 2024-08-20T05:06:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.530+0000 7fe992a00640 1 -- 172.21.15.37:0/2601472445 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe98c018070 con 0x55d09c1f8120 2024-08-20T05:06:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.530+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/2601472445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe99c036050 con 0x55d09c1f8120 2024-08-20T05:06:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.530+0000 7fe992a00640 1 -- 172.21.15.37:0/2601472445 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fe98c00fe60 con 0x55d09c1f8120 2024-08-20T05:06:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.530+0000 7fe9ae7c6740 10 client.16272 fetch_fsmap learned FSMap version 35 2024-08-20T05:06:05.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.530+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/2601472445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55d09bf33620 con 0x55d09c1f8120 2024-08-20T05:06:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.530+0000 7fe992a00640 1 -- 172.21.15.37:0/2601472445 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe99c036050 con 0x55d09c1f8120 2024-08-20T05:06:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.531+0000 7fe992a00640 1 -- 172.21.15.37:0/2601472445 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 35) ==== 8374+0+0 (secure 0 0 0) 0x7fe98c0035f0 con 0x55d09c1f8120 2024-08-20T05:06:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.531+0000 7fe9ae7c6740 10 client.16272 fetch_fsmap finished waiting for FSMap version 35 2024-08-20T05:06:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.531+0000 7fe9ae7c6740 10 client.16272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.531+0000 7fe9ae7c6740 20 client.16272 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:05.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.531+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/2601472445 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d09c275c00 0x55d09c278020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.531+0000 7fe9ae7c6740 4 client.16272 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:06:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.531+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/2601472445 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d09c165c00 con 0x55d09c275c00 2024-08-20T05:06:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.531+0000 7fe9a9800640 1 --2- 172.21.15.37:0/2601472445 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d09c275c00 0x55d09c278020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.532+0000 7fe9a9800640 1 --2- 172.21.15.37:0/2601472445 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d09c275c00 0x55d09c278020 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab4128e8d8c7cb35 server_cookie=65c1b9da0c1bf7a3 in_seq=0 out_seq=0 2024-08-20T05:06:05.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.532+0000 7fe992a00640 10 client.16272 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:05.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.543+0000 7fe992a00640 1 -- 172.21.15.37:0/2601472445 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d09c165c00 con 0x55d09c275c00 2024-08-20T05:06:05.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.543+0000 7fe992a00640 10 client.16272 handle_command_reply: tid=0 2024-08-20T05:06:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.543+0000 7fe9ae7c6740 1 client.16272 shutdown 2024-08-20T05:06:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.543+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/2601472445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1f8120 msgr2=0x55d09c205580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.543+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/2601472445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1f8120 0x55d09c205580 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fe98c0059f0 tx=0x7fe98c012300 comp rx=0 tx=0).stop 2024-08-20T05:06:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.543+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/2601472445 shutdown_connections 2024-08-20T05:06:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.543+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/2601472445 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d09c275c00 0x55d09c278020 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.543+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/2601472445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d09c1fab60 0x55d09c205ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.543+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/2601472445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d09c1f8120 0x55d09c205580 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.543+0000 7fe9ae7c6740 1 --2- 172.21.15.37:0/2601472445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d09c1f57f0 0x55d09c206880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.543+0000 7fe992a00640 0 client.16272 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.543+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/2601472445 >> 172.21.15.37:0/2601472445 conn(0x55d09c1f0940 msgr2=0x55d09c211770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.543+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/2601472445 shutdown_connections 2024-08-20T05:06:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.543+0000 7fe9ae7c6740 1 -- 172.21.15.37:0/2601472445 wait complete. 2024-08-20T05:06:05.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.544+0000 7fe9ae7c6740 20 client.16272 trim_cache size 0 max 16384 2024-08-20T05:06:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:06:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:06:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:06:05.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:06:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.544+0000 7fe9aa200640 1 -- 172.21.15.37:0/2227846715 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9880b3bd0 msgr2=0x7fe9880b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.544+0000 7fe9aa200640 1 --2- 172.21.15.37:0/2227846715 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9880b3bd0 0x7fe9880b6090 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe9940a6f80 tx=0x7fe994000bc0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.544+0000 7fe9aa200640 1 -- 172.21.15.37:0/2227846715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9a406b060 msgr2=0x7fe9a419aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.544+0000 7fe9aa200640 1 --2- 172.21.15.37:0/2227846715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9a406b060 0x7fe9a419aae0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe99400e9f0 tx=0x7fe99400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.544+0000 7fe9aa200640 1 -- 172.21.15.37:0/2227846715 shutdown_connections 2024-08-20T05:06:05.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.544+0000 7fe9aa200640 1 --2- 172.21.15.37:0/2227846715 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9880b3bd0 0x7fe9880b6090 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.544+0000 7fe9aa200640 1 --2- 172.21.15.37:0/2227846715 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9a410a3e0 0x7fe9a419bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.544+0000 7fe9aa200640 1 --2- 172.21.15.37:0/2227846715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9a41079a0 0x7fe9a419b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.544+0000 7fe9aa200640 1 --2- 172.21.15.37:0/2227846715 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9a406b060 0x7fe9a419aae0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.544+0000 7fe9aa200640 1 -- 172.21.15.37:0/2227846715 >> 172.21.15.37:0/2227846715 conn(0x7fe9a40fcc50 msgr2=0x7fe9a4108600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.545+0000 7fe9aa200640 1 -- 172.21.15.37:0/2227846715 shutdown_connections 2024-08-20T05:06:05.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:05.545+0000 7fe9aa200640 1 -- 172.21.15.37:0/2227846715 wait complete. 2024-08-20T05:06:05.878 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:05 smithi037 ceph-mon[17265]: pgmap v516: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.7 MiB/s wr, 430 op/s 2024-08-20T05:06:05.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:05 smithi130 ceph-mon[22007]: pgmap v516: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.7 MiB/s wr, 430 op/s 2024-08-20T05:06:06.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.992+0000 7f2fc9200640 1 -- 172.21.15.37:0/635904609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fc4104b00 msgr2=0x7f2fc4104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:06.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.992+0000 7f2fc9200640 1 --2- 172.21.15.37:0/635904609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fc4104b00 0x7f2fc4104ee0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009900 tx=0x7f2fb402a410 comp rx=0 tx=0).stop 2024-08-20T05:06:06.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.992+0000 7f2fc9200640 1 -- 172.21.15.37:0/635904609 shutdown_connections 2024-08-20T05:06:06.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.992+0000 7f2fc9200640 1 --2- 172.21.15.37:0/635904609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fc410ae90 0x7f2fc4111690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.992+0000 7f2fc9200640 1 --2- 172.21.15.37:0/635904609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2fc410a510 0x7f2fc410a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.992+0000 7f2fc9200640 1 --2- 172.21.15.37:0/635904609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fc4104b00 0x7f2fc4104ee0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.992+0000 7f2fc9200640 1 -- 172.21.15.37:0/635904609 >> 172.21.15.37:0/635904609 conn(0x7f2fc4100550 msgr2=0x7f2fc4102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.992+0000 7f2fc9200640 1 -- 172.21.15.37:0/635904609 shutdown_connections 2024-08-20T05:06:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.992+0000 7f2fc9200640 1 -- 172.21.15.37:0/635904609 wait complete. 2024-08-20T05:06:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.993+0000 7f2fc9200640 1 Processor -- start 2024-08-20T05:06:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.993+0000 7f2fc9200640 1 -- start start 2024-08-20T05:06:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.993+0000 7f2fc9200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2fc4104b00 0x7f2fc40773e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.993+0000 7f2fc9200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fc410a510 0x7f2fc4077920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.993+0000 7f2fc9200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fc410ae90 0x7f2fc4077e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.993+0000 7f2fc9200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc4114b60 con 0x7f2fc410ae90 2024-08-20T05:06:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.993+0000 7f2fc9200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc41149e0 con 0x7f2fc410a510 2024-08-20T05:06:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.993+0000 7f2fc9200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc4114ce0 con 0x7f2fc4104b00 2024-08-20T05:06:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.994+0000 7f2fc3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fc410ae90 0x7f2fc4077e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.994+0000 7f2fc3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fc410ae90 0x7f2fc4077e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55978/0 (socket says 172.21.15.37:55978) 2024-08-20T05:06:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.994+0000 7f2fc3e00640 1 -- 172.21.15.37:0/1362947300 learned_addr learned my addr 172.21.15.37:0/1362947300 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.994+0000 7f2fc3400640 1 --2- 172.21.15.37:0/1362947300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2fc4104b00 0x7f2fc40773e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.994+0000 7f2fbaa00640 1 --2- 172.21.15.37:0/1362947300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fc410a510 0x7f2fc4077920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.994+0000 7f2fc3e00640 1 -- 172.21.15.37:0/1362947300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2fc4104b00 msgr2=0x7f2fc40773e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.994+0000 7f2fc3e00640 1 --2- 172.21.15.37:0/1362947300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2fc4104b00 0x7f2fc40773e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.994+0000 7f2fc3e00640 1 -- 172.21.15.37:0/1362947300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fc410a510 msgr2=0x7f2fc4077920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.994+0000 7f2fc3e00640 1 --2- 172.21.15.37:0/1362947300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fc410a510 0x7f2fc4077920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.994+0000 7f2fc3e00640 1 -- 172.21.15.37:0/1362947300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc41ab520 con 0x7f2fc410ae90 2024-08-20T05:06:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.994+0000 7f2fc3e00640 1 --2- 172.21.15.37:0/1362947300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fc410ae90 0x7f2fc4077e60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00eb10 tx=0x7f2fbc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.995+0000 7f2fc0c00640 1 -- 172.21.15.37:0/1362947300 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc004b20 con 0x7f2fc410ae90 2024-08-20T05:06:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.995+0000 7f2fc0c00640 1 -- 172.21.15.37:0/1362947300 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fbc004cc0 con 0x7f2fc410ae90 2024-08-20T05:06:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.995+0000 7f2fc0c00640 1 -- 172.21.15.37:0/1362947300 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc010670 con 0x7f2fc410ae90 2024-08-20T05:06:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.995+0000 7f2fc9200640 1 -- 172.21.15.37:0/1362947300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc41ab810 con 0x7f2fc410ae90 2024-08-20T05:06:06.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.995+0000 7f2fc9200640 1 -- 172.21.15.37:0/1362947300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc41abd00 con 0x7f2fc410ae90 2024-08-20T05:06:06.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.996+0000 7f2fc9200640 1 -- 172.21.15.37:0/1362947300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc4104ee0 con 0x7f2fc410ae90 2024-08-20T05:06:06.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:05.998+0000 7f2fc0c00640 1 -- 172.21.15.37:0/1362947300 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2fbc005020 con 0x7f2fc410ae90 2024-08-20T05:06:06.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.000+0000 7f2fc0c00640 1 --2- 172.21.15.37:0/1362947300 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2fa80b3c70 0x7f2fa80b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.000+0000 7f2fc0c00640 1 -- 172.21.15.37:0/1362947300 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2fbc0e45c0 con 0x7f2fc410ae90 2024-08-20T05:06:06.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.000+0000 7f2fc3400640 1 --2- 172.21.15.37:0/1362947300 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2fa80b3c70 0x7f2fa80b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.001+0000 7f2fc3400640 1 --2- 172.21.15.37:0/1362947300 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2fa80b3c70 0x7f2fa80b6130 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4005ab0 tx=0x7f2fb4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:06.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.004+0000 7f2fc0c00640 1 -- 172.21.15.37:0/1362947300 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f2fbc0ab810 con 0x7f2fc410ae90 2024-08-20T05:06:06.084 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:06:06.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:05 smithi135 ceph-mon[22342]: pgmap v516: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.7 MiB/s wr, 430 op/s 2024-08-20T05:06:06.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.244+0000 7f2fc9200640 1 -- 172.21.15.37:0/1362947300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fc402e340 con 0x7f2fc410ae90 2024-08-20T05:06:06.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.245+0000 7f2fc0c00640 1 -- 172.21.15.37:0/1362947300 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11981 (secure 0 0 0) 0x7f2fbc0ab110 con 0x7f2fc410ae90 2024-08-20T05:06:06.246 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:06:06.247 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":35,"btime":"2024-08-20T05:05:56:649446+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:05:56.276671+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:06:06.247 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 35 2024-08-20T05:06:06.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.248+0000 7f2fc9200640 1 -- 172.21.15.37:0/1362947300 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2fa80b3c70 msgr2=0x7f2fa80b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:06.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.248+0000 7f2fc9200640 1 --2- 172.21.15.37:0/1362947300 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2fa80b3c70 0x7f2fa80b6130 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4005ab0 tx=0x7f2fb4005a20 comp rx=0 tx=0).stop 2024-08-20T05:06:06.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.248+0000 7f2fc9200640 1 -- 172.21.15.37:0/1362947300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fc410ae90 msgr2=0x7f2fc4077e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:06.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.248+0000 7f2fc9200640 1 --2- 172.21.15.37:0/1362947300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fc410ae90 0x7f2fc4077e60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00eb10 tx=0x7f2fbc00c2d0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.248+0000 7f2fc9200640 1 -- 172.21.15.37:0/1362947300 shutdown_connections 2024-08-20T05:06:06.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.248+0000 7f2fc9200640 1 --2- 172.21.15.37:0/1362947300 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2fa80b3c70 0x7f2fa80b6130 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.248+0000 7f2fc9200640 1 --2- 172.21.15.37:0/1362947300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2fc410ae90 0x7f2fc4077e60 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.248+0000 7f2fc9200640 1 --2- 172.21.15.37:0/1362947300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2fc410a510 0x7f2fc4077920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.248+0000 7f2fc9200640 1 --2- 172.21.15.37:0/1362947300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2fc4104b00 0x7f2fc40773e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.248+0000 7f2fc9200640 1 -- 172.21.15.37:0/1362947300 >> 172.21.15.37:0/1362947300 conn(0x7f2fc4100550 msgr2=0x7f2fc4106ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:06.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.248+0000 7f2fc9200640 1 -- 172.21.15.37:0/1362947300 shutdown_connections 2024-08-20T05:06:06.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.248+0000 7f2fc9200640 1 -- 172.21.15.37:0/1362947300 wait complete. 2024-08-20T05:06:06.817 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:06 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1362947300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:06:06.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.833+0000 7fe76b600640 1 -- 172.21.15.37:0/4048805714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe76410a6c0 msgr2=0x7fe76410ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:06.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.833+0000 7fe76b600640 1 --2- 172.21.15.37:0/4048805714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe76410a6c0 0x7fe76410ab00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe750009900 tx=0x7fe75002a410 comp rx=0 tx=0).stop 2024-08-20T05:06:06.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.833+0000 7fe76b600640 1 -- 172.21.15.37:0/4048805714 shutdown_connections 2024-08-20T05:06:06.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.833+0000 7fe76b600640 1 --2- 172.21.15.37:0/4048805714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe76410b040 0x7fe764111840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.833+0000 7fe76b600640 1 --2- 172.21.15.37:0/4048805714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe76410a6c0 0x7fe76410ab00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.833+0000 7fe76b600640 1 --2- 172.21.15.37:0/4048805714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe764104cb0 0x7fe764105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.833+0000 7fe76b600640 1 -- 172.21.15.37:0/4048805714 >> 172.21.15.37:0/4048805714 conn(0x7fe764100720 msgr2=0x7fe764102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:06.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.833+0000 7fe76b600640 1 -- 172.21.15.37:0/4048805714 shutdown_connections 2024-08-20T05:06:06.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.833+0000 7fe76b600640 1 -- 172.21.15.37:0/4048805714 wait complete. 2024-08-20T05:06:06.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.834+0000 7fe76b600640 1 Processor -- start 2024-08-20T05:06:06.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.834+0000 7fe76b600640 1 -- start start 2024-08-20T05:06:06.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.835+0000 7fe76b600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe764104cb0 0x7fe76419b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.835+0000 7fe76b600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe76410a6c0 0x7fe76419b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.835+0000 7fe76b600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe76410b040 0x7fe7641a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.835+0000 7fe76b600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe764114d10 con 0x7fe76410b040 2024-08-20T05:06:06.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.835+0000 7fe76b600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe764114b90 con 0x7fe76410a6c0 2024-08-20T05:06:06.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.835+0000 7fe76b600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe764114e90 con 0x7fe764104cb0 2024-08-20T05:06:06.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.835+0000 7fe768c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe764104cb0 0x7fe76419b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.835+0000 7fe768c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe764104cb0 0x7fe76419b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51224/0 (socket says 172.21.15.37:51224) 2024-08-20T05:06:06.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.835+0000 7fe768c00640 1 -- 172.21.15.37:0/4219370908 learned_addr learned my addr 172.21.15.37:0/4219370908 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:06.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.836+0000 7fe763e00640 1 --2- 172.21.15.37:0/4219370908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe76410a6c0 0x7fe76419b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.836+0000 7fe768c00640 1 -- 172.21.15.37:0/4219370908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe76410a6c0 msgr2=0x7fe76419b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:06.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.836+0000 7fe768c00640 1 --2- 172.21.15.37:0/4219370908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe76410a6c0 0x7fe76419b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.836+0000 7fe768c00640 1 -- 172.21.15.37:0/4219370908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe76410b040 msgr2=0x7fe7641a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:06.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.836+0000 7fe768c00640 1 --2- 172.21.15.37:0/4219370908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe76410b040 0x7fe7641a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.836+0000 7fe768c00640 1 -- 172.21.15.37:0/4219370908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7641a1210 con 0x7fe764104cb0 2024-08-20T05:06:06.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.836+0000 7fe768c00640 1 --2- 172.21.15.37:0/4219370908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe764104cb0 0x7fe76419b160 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe75800e9f0 tx=0x7fe75800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:06.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.837+0000 7fe761600640 1 -- 172.21.15.37:0/4219370908 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75800cd80 con 0x7fe764104cb0 2024-08-20T05:06:06.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.837+0000 7fe76b600640 1 -- 172.21.15.37:0/4219370908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7641a1500 con 0x7fe764104cb0 2024-08-20T05:06:06.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.837+0000 7fe761600640 1 -- 172.21.15.37:0/4219370908 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7580108e0 con 0x7fe764104cb0 2024-08-20T05:06:06.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.837+0000 7fe76b600640 1 -- 172.21.15.37:0/4219370908 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7641a7d90 con 0x7fe764104cb0 2024-08-20T05:06:06.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.837+0000 7fe761600640 1 -- 172.21.15.37:0/4219370908 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe758018980 con 0x7fe764104cb0 2024-08-20T05:06:06.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.841+0000 7fe76e1c7740 1 Processor -- start 2024-08-20T05:06:06.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.841+0000 7fe761600640 1 -- 172.21.15.37:0/4219370908 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe758010430 con 0x7fe764104cb0 2024-08-20T05:06:06.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.841+0000 7fe76e1c7740 1 -- start start 2024-08-20T05:06:06.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.841+0000 7fe76e1c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 0x564ad015fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.841+0000 7fe76e1c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad0160260 0x564ad016bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.841+0000 7fe76e1c7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad016c1f0 0x564ad016e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.841+0000 7fe76e1c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564ad00d5aa0 con 0x564ad0160260 2024-08-20T05:06:06.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.841+0000 7fe76e1c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564ad00c4fa0 con 0x564ad015f940 2024-08-20T05:06:06.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.841+0000 7fe76e1c7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564ad00c8fe0 con 0x564ad016c1f0 2024-08-20T05:06:06.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.842+0000 7fe769600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 0x564ad015fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.842+0000 7fe769600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 0x564ad015fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:39712/0 (socket says 172.21.15.37:39712) 2024-08-20T05:06:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.842+0000 7fe769600640 1 -- 172.21.15.37:0/2679888243 learned_addr learned my addr 172.21.15.37:0/2679888243 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.842+0000 7fe763e00640 1 --2- 172.21.15.37:0/2679888243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad016c1f0 0x564ad016e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.842+0000 7fe769600640 1 -- 172.21.15.37:0/2679888243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad016c1f0 msgr2=0x564ad016e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.842+0000 7fe769600640 1 --2- 172.21.15.37:0/2679888243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad016c1f0 0x564ad016e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.842+0000 7fe769600640 1 -- 172.21.15.37:0/2679888243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad0160260 msgr2=0x564ad016bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.842+0000 7fe768c00640 1 --2- 172.21.15.37:0/2679888243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad0160260 0x564ad016bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.842+0000 7fe769600640 1 --2- 172.21.15.37:0/2679888243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad0160260 0x564ad016bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.842+0000 7fe769600640 1 -- 172.21.15.37:0/2679888243 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad006b420 con 0x564ad015f940 2024-08-20T05:06:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.843+0000 7fe768c00640 1 --2- 172.21.15.37:0/2679888243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad0160260 0x564ad016bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:06:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.843+0000 7fe769600640 1 --2- 172.21.15.37:0/2679888243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 0x564ad015fd20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009ea0 tx=0x7fe75c009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c8df8bd4753f2c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:06.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.843+0000 7fe755c00640 1 -- 172.21.15.37:0/2679888243 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c004d20 con 0x564ad015f940 2024-08-20T05:06:06.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.843+0000 7fe755c00640 1 -- 172.21.15.37:0/2679888243 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe75c00ee60 con 0x564ad015f940 2024-08-20T05:06:06.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.843+0000 7fe761600640 1 --2- 172.21.15.37:0/4219370908 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe74c0b3c50 0x7fe74c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.843+0000 7fe755c00640 1 -- 172.21.15.37:0/2679888243 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c010830 con 0x564ad015f940 2024-08-20T05:06:06.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.844+0000 7fe768c00640 1 --2- 172.21.15.37:0/4219370908 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe74c0b3c50 0x7fe74c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.844+0000 7fe761600640 1 -- 172.21.15.37:0/4219370908 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe7580e4190 con 0x7fe764104cb0 2024-08-20T05:06:06.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.844+0000 7fe76e1c7740 1 -- 172.21.15.37:0/2679888243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 msgr2=0x564ad015fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:06.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.844+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/2679888243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 0x564ad015fd20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009ea0 tx=0x7fe75c009f90 comp rx=0 tx=0).stop 2024-08-20T05:06:06.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.844+0000 7fe76e1c7740 1 -- 172.21.15.37:0/2679888243 shutdown_connections 2024-08-20T05:06:06.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.844+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/2679888243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad016c1f0 0x564ad016e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.844+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/2679888243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad0160260 0x564ad016bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.844+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/2679888243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 0x564ad015fd20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.844+0000 7fe76e1c7740 1 -- 172.21.15.37:0/2679888243 >> 172.21.15.37:0/2679888243 conn(0x564ad015d770 msgr2=0x564ad015e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:06.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.844+0000 7fe76e1c7740 1 -- 172.21.15.37:0/2679888243 shutdown_connections 2024-08-20T05:06:06.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.844+0000 7fe768c00640 1 --2- 172.21.15.37:0/4219370908 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe74c0b3c50 0x7fe74c0b6110 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe7580aa9e0 tx=0x7fe758000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:06.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.844+0000 7fe76e1c7740 1 -- 172.21.15.37:0/2679888243 wait complete. 2024-08-20T05:06:06.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.845+0000 7fe76e1c7740 1 -- start start 2024-08-20T05:06:06.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.845+0000 7fe76e1c7740 1 Processor -- start 2024-08-20T05:06:06.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.846+0000 7fe76e1c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 0x564ad016b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.846+0000 7fe76e1c7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad0160260 0x564ad0168dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.846+0000 7fe76e1c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad016c1f0 0x564ad0169310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.846+0000 7fe76e1c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564acff27700 con 0x564ad016c1f0 2024-08-20T05:06:06.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.846+0000 7fe76e1c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564ad0060290 con 0x564ad015f940 2024-08-20T05:06:06.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.846+0000 7fe76e1c7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564ad016ee70 con 0x564ad0160260 2024-08-20T05:06:06.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.846+0000 7fe76e1c7740 10 client.0 _ll_register_callbacks cb 0x564ad00bf1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:06.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.846+0000 7fe769600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad016c1f0 0x564ad0169310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.846+0000 7fe769600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad016c1f0 0x564ad0169310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56008/0 (socket says 172.21.15.37:56008) 2024-08-20T05:06:06.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.846+0000 7fe769600640 1 -- 172.21.15.37:0/3838596652 learned_addr learned my addr 172.21.15.37:0/3838596652 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:06.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.846+0000 7fe769600640 1 --2- 172.21.15.37:0/3838596652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 0x564ad016b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.846+0000 7fe763e00640 1 --2- 172.21.15.37:0/3838596652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad0160260 0x564ad0168dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.846+0000 7fe769600640 1 -- 172.21.15.37:0/3838596652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad0160260 msgr2=0x564ad0168dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:06.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.846+0000 7fe769600640 1 --2- 172.21.15.37:0/3838596652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad0160260 0x564ad0168dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.846+0000 7fe769600640 1 -- 172.21.15.37:0/3838596652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 msgr2=0x564ad016b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:06.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.847+0000 7fe769600640 1 --2- 172.21.15.37:0/3838596652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 0x564ad016b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.847+0000 7fe769600640 1 -- 172.21.15.37:0/3838596652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564acfe24650 con 0x564ad016c1f0 2024-08-20T05:06:06.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.847+0000 7fe769600640 1 --2- 172.21.15.37:0/3838596652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad016c1f0 0x564ad0169310 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009560 tx=0x7fe75c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5520ffe57e7dc6c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:06.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.847+0000 7fe74a000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:06:06.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.847+0000 7fe74a000640 1 -- 172.21.15.37:0/3838596652 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c010a10 con 0x564ad016c1f0 2024-08-20T05:06:06.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.847+0000 7fe74a000640 1 -- 172.21.15.37:0/3838596652 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe75c010bb0 con 0x564ad016c1f0 2024-08-20T05:06:06.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.847+0000 7fe76e1c7740 1 -- 172.21.15.37:0/3838596652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe75c00ee60 con 0x564ad016c1f0 2024-08-20T05:06:06.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.847+0000 7fe74a000640 1 -- 172.21.15.37:0/3838596652 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe75c010db0 con 0x564ad016c1f0 2024-08-20T05:06:06.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.847+0000 7fe76e1c7740 10 client.16284 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:06.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.847+0000 7fe76e1c7740 1 -- 172.21.15.37:0/3838596652 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x564ad017a640 con 0x564ad016c1f0 2024-08-20T05:06:06.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.848+0000 7fe74a000640 1 -- 172.21.15.37:0/3838596652 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe75c00ee60 con 0x564ad016c1f0 2024-08-20T05:06:06.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.848+0000 7fe74a000640 1 -- 172.21.15.37:0/3838596652 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fe75c004450 con 0x564ad016c1f0 2024-08-20T05:06:06.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.848+0000 7fe76e1c7740 10 client.16284 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:06.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.848+0000 7fe76e1c7740 10 client.16284 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:06:06.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.848+0000 7fe76e1c7740 20 client.16284 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:06.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.848+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/3838596652 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x564ad017baa0 0x564ad017de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.848+0000 7fe76e1c7740 4 client.16284 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:06:06.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.848+0000 7fe76e1c7740 1 -- 172.21.15.37:0/3838596652 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ad00d79f0 con 0x564ad017baa0 2024-08-20T05:06:06.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.849+0000 7fe763e00640 1 --2- 172.21.15.37:0/3838596652 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x564ad017baa0 0x564ad017de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.849+0000 7fe763e00640 1 --2- 172.21.15.37:0/3838596652 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x564ad017baa0 0x564ad017de90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c1e2492556da6b0f server_cookie=e6cb12cea156da10 in_seq=0 out_seq=0 2024-08-20T05:06:06.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.849+0000 7fe74a000640 10 client.16284 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:06:06.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.850+0000 7fe74a000640 1 -- 172.21.15.37:0/3838596652 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ad00d79f0 con 0x564ad017baa0 2024-08-20T05:06:06.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.850+0000 7fe74a000640 10 client.16284 handle_command_reply: tid=0 2024-08-20T05:06:06.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.850+0000 7fe76e1c7740 1 client.16284 shutdown 2024-08-20T05:06:06.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.850+0000 7fe76e1c7740 1 -- 172.21.15.37:0/3838596652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad016c1f0 msgr2=0x564ad0169310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:06.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.850+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/3838596652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad016c1f0 0x564ad0169310 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009560 tx=0x7fe75c009ae0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.850+0000 7fe76e1c7740 1 -- 172.21.15.37:0/3838596652 shutdown_connections 2024-08-20T05:06:06.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.850+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/3838596652 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x564ad017baa0 0x564ad017de90 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.850+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/3838596652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad016c1f0 0x564ad0169310 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.850+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/3838596652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad0160260 0x564ad0168dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.850+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/3838596652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 0x564ad016b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.850+0000 7fe76e1c7740 1 -- 172.21.15.37:0/3838596652 >> 172.21.15.37:0/3838596652 conn(0x564ad015d770 msgr2=0x564ad01632e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:06.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.850+0000 7fe74a000640 0 client.16284 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:06:06.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.851+0000 7fe76e1c7740 1 -- 172.21.15.37:0/3838596652 shutdown_connections 2024-08-20T05:06:06.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.851+0000 7fe76e1c7740 1 -- 172.21.15.37:0/3838596652 wait complete. 2024-08-20T05:06:06.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.851+0000 7fe76e1c7740 20 client.16284 trim_cache size 0 max 16384 2024-08-20T05:06:06.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.865+0000 7fe76e1c7740 1 Processor -- start 2024-08-20T05:06:06.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.865+0000 7fe76e1c7740 1 -- start start 2024-08-20T05:06:06.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.865+0000 7fe76e1c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 0x564ad0178020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.865+0000 7fe76e1c7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad0160260 0x564ad015ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.865+0000 7fe76e1c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad016c1f0 0x564ad01834c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.865+0000 7fe76e1c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe74400fba0 con 0x564ad016c1f0 2024-08-20T05:06:06.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.865+0000 7fe76e1c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe7440116e0 con 0x564ad015f940 2024-08-20T05:06:06.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.865+0000 7fe76e1c7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe744010270 con 0x564ad0160260 2024-08-20T05:06:06.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.866+0000 7fe769600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 0x564ad0178020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.866+0000 7fe763e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad0160260 0x564ad015ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.866+0000 7fe769600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 0x564ad0178020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:39740/0 (socket says 172.21.15.37:39740) 2024-08-20T05:06:06.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.866+0000 7fe769600640 1 -- 172.21.15.37:0/3649814447 learned_addr learned my addr 172.21.15.37:0/3649814447 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:06.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.866+0000 7fe769600640 1 --2- 172.21.15.37:0/3649814447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad016c1f0 0x564ad01834c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.866+0000 7fe763e00640 1 -- 172.21.15.37:0/3649814447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 msgr2=0x564ad0178020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:06.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.866+0000 7fe763e00640 1 --2- 172.21.15.37:0/3649814447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 0x564ad0178020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.866+0000 7fe763e00640 1 -- 172.21.15.37:0/3649814447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad016c1f0 msgr2=0x564ad01834c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:06.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.866+0000 7fe763e00640 1 --2- 172.21.15.37:0/3649814447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad016c1f0 0x564ad01834c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.866+0000 7fe763e00640 1 -- 172.21.15.37:0/3649814447 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad015f2d0 con 0x564ad0160260 2024-08-20T05:06:06.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.866+0000 7fe769600640 1 --2- 172.21.15.37:0/3649814447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad016c1f0 0x564ad01834c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:06:06.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.866+0000 7fe763e00640 1 --2- 172.21.15.37:0/3649814447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad0160260 0x564ad015ed90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe75002aa00 tx=0x7fe750005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2486ced00acce0e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:06.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.867+0000 7fe755200640 1 -- 172.21.15.37:0/3649814447 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe750035040 con 0x564ad0160260 2024-08-20T05:06:06.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.867+0000 7fe755200640 1 -- 172.21.15.37:0/3649814447 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe75004b070 con 0x564ad0160260 2024-08-20T05:06:06.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.867+0000 7fe755200640 1 -- 172.21.15.37:0/3649814447 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7500035f0 con 0x564ad0160260 2024-08-20T05:06:06.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.867+0000 7fe76e1c7740 1 -- 172.21.15.37:0/3649814447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad0160260 msgr2=0x564ad015ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:06.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.867+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/3649814447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad0160260 0x564ad015ed90 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe75002aa00 tx=0x7fe750005a20 comp rx=0 tx=0).stop 2024-08-20T05:06:06.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.867+0000 7fe76e1c7740 1 -- 172.21.15.37:0/3649814447 shutdown_connections 2024-08-20T05:06:06.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.867+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/3649814447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad016c1f0 0x564ad01834c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.867+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/3649814447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad0160260 0x564ad015ed90 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.867+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/3649814447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad015f940 0x564ad0178020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.867+0000 7fe76e1c7740 1 -- 172.21.15.37:0/3649814447 >> 172.21.15.37:0/3649814447 conn(0x564ad015d770 msgr2=0x564ad015e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:06.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.868+0000 7fe76e1c7740 1 -- 172.21.15.37:0/3649814447 shutdown_connections 2024-08-20T05:06:06.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.868+0000 7fe76e1c7740 1 -- 172.21.15.37:0/3649814447 wait complete. 2024-08-20T05:06:06.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.868+0000 7fe76e1c7740 1 -- start start 2024-08-20T05:06:06.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.868+0000 7fe76e1c7740 1 Processor -- start 2024-08-20T05:06:06.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.869+0000 7fe76e1c7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad015f940 0x564ad01713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.869+0000 7fe76e1c7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad0160260 0x564ad01718f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.869+0000 7fe76e1c7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad016c1f0 0x564ad01e4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.869+0000 7fe76e1c7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe744011010 con 0x564ad015f940 2024-08-20T05:06:06.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.869+0000 7fe76e1c7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe744010940 con 0x564ad016c1f0 2024-08-20T05:06:06.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.869+0000 7fe76e1c7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe74400db80 con 0x564ad0160260 2024-08-20T05:06:06.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.869+0000 7fe76e1c7740 10 client.0 _ll_register_callbacks cb 0x7fe75c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:06.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.869+0000 7fe769600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad015f940 0x564ad01713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.869+0000 7fe769600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad015f940 0x564ad01713b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56032/0 (socket says 172.21.15.37:56032) 2024-08-20T05:06:06.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.869+0000 7fe769600640 1 -- 172.21.15.37:0/333076306 learned_addr learned my addr 172.21.15.37:0/333076306 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:06.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.869+0000 7fe763e00640 1 --2- 172.21.15.37:0/333076306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad0160260 0x564ad01718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.869+0000 7fe769600640 1 --2- 172.21.15.37:0/333076306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad016c1f0 0x564ad01e4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.869+0000 7fe769600640 1 -- 172.21.15.37:0/333076306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad0160260 msgr2=0x564ad01718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:06.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.869+0000 7fe769600640 1 --2- 172.21.15.37:0/333076306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad0160260 0x564ad01718f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.869+0000 7fe769600640 1 -- 172.21.15.37:0/333076306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad016c1f0 msgr2=0x564ad01e4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:06.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.869+0000 7fe769600640 1 --2- 172.21.15.37:0/333076306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad016c1f0 0x564ad01e4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.869+0000 7fe769600640 1 -- 172.21.15.37:0/333076306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ad01e49d0 con 0x564ad015f940 2024-08-20T05:06:06.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.870+0000 7fe769600640 1 --2- 172.21.15.37:0/333076306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad015f940 0x564ad01713b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009560 tx=0x7fe75c000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e0f3d28dccf695 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:06.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.870+0000 7fe74a000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:06:06.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.870+0000 7fe74a000640 1 -- 172.21.15.37:0/333076306 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75c010990 con 0x564ad015f940 2024-08-20T05:06:06.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.870+0000 7fe74a000640 1 -- 172.21.15.37:0/333076306 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe75c002030 con 0x564ad015f940 2024-08-20T05:06:06.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.870+0000 7fe76e1c7740 1 -- 172.21.15.37:0/333076306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe75004b070 con 0x564ad015f940 2024-08-20T05:06:06.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.870+0000 7fe74a000640 1 -- 172.21.15.37:0/333076306 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe75c047050 con 0x564ad015f940 2024-08-20T05:06:06.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.870+0000 7fe76e1c7740 10 client.16290 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:06.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.870+0000 7fe76e1c7740 1 -- 172.21.15.37:0/333076306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x564ad01e5b90 con 0x564ad015f940 2024-08-20T05:06:06.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.871+0000 7fe74a000640 1 -- 172.21.15.37:0/333076306 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe75004b070 con 0x564ad015f940 2024-08-20T05:06:06.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.871+0000 7fe74a000640 1 -- 172.21.15.37:0/333076306 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fe75c036430 con 0x564ad015f940 2024-08-20T05:06:06.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.871+0000 7fe76e1c7740 10 client.16290 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:06.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.871+0000 7fe76e1c7740 10 client.16290 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:06:06.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.871+0000 7fe76e1c7740 20 client.16290 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:06.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.871+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/333076306 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x564ad01e62e0 0x564ad01e8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:06.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.871+0000 7fe76e1c7740 4 client.16290 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:06:06.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.871+0000 7fe76e1c7740 1 -- 172.21.15.37:0/333076306 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564ad00d3490 con 0x564ad01e62e0 2024-08-20T05:06:06.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.871+0000 7fe763e00640 1 --2- 172.21.15.37:0/333076306 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x564ad01e62e0 0x564ad01e8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:06.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.872+0000 7fe763e00640 1 --2- 172.21.15.37:0/333076306 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x564ad01e62e0 0x564ad01e8700 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5254ff434b32af10 server_cookie=b6b8e1cbecff7196 in_seq=0 out_seq=0 2024-08-20T05:06:06.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.872+0000 7fe74a000640 10 client.16290 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:06:06.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.872+0000 7fe74a000640 1 -- 172.21.15.37:0/333076306 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564ad00d3490 con 0x564ad01e62e0 2024-08-20T05:06:06.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.872+0000 7fe74a000640 10 client.16290 handle_command_reply: tid=0 2024-08-20T05:06:06.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.872+0000 7fe76e1c7740 1 client.16290 shutdown 2024-08-20T05:06:06.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.872+0000 7fe76e1c7740 1 -- 172.21.15.37:0/333076306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad015f940 msgr2=0x564ad01713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:06.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.872+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/333076306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad015f940 0x564ad01713b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe75c009560 tx=0x7fe75c000f40 comp rx=0 tx=0).stop 2024-08-20T05:06:06.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.872+0000 7fe76e1c7740 1 -- 172.21.15.37:0/333076306 shutdown_connections 2024-08-20T05:06:06.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.872+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/333076306 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x564ad01e62e0 0x564ad01e8700 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.872+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/333076306 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564ad016c1f0 0x564ad01e4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.872+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/333076306 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564ad0160260 0x564ad01718f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.872+0000 7fe76e1c7740 1 --2- 172.21.15.37:0/333076306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564ad015f940 0x564ad01713b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.872+0000 7fe76e1c7740 1 -- 172.21.15.37:0/333076306 >> 172.21.15.37:0/333076306 conn(0x564ad015d770 msgr2=0x564ad016a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:06.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.872+0000 7fe74a000640 0 client.16290 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:06:06.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.873+0000 7fe76e1c7740 1 -- 172.21.15.37:0/333076306 shutdown_connections 2024-08-20T05:06:06.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.873+0000 7fe76e1c7740 1 -- 172.21.15.37:0/333076306 wait complete. 2024-08-20T05:06:06.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.873+0000 7fe76e1c7740 20 client.16290 trim_cache size 0 max 16384 2024-08-20T05:06:06.879 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:06:06.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.873+0000 7fe76b600640 1 -- 172.21.15.37:0/4219370908 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe74c0b3c50 msgr2=0x7fe74c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:06.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.873+0000 7fe76b600640 1 --2- 172.21.15.37:0/4219370908 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe74c0b3c50 0x7fe74c0b6110 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe7580aa9e0 tx=0x7fe758000bc0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.873+0000 7fe76b600640 1 -- 172.21.15.37:0/4219370908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe764104cb0 msgr2=0x7fe76419b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:06.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.873+0000 7fe76b600640 1 --2- 172.21.15.37:0/4219370908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe764104cb0 0x7fe76419b160 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe75800e9f0 tx=0x7fe75800eeb0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.873+0000 7fe76b600640 1 -- 172.21.15.37:0/4219370908 shutdown_connections 2024-08-20T05:06:06.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.873+0000 7fe76b600640 1 --2- 172.21.15.37:0/4219370908 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe74c0b3c50 0x7fe74c0b6110 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.873+0000 7fe76b600640 1 --2- 172.21.15.37:0/4219370908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe76410b040 0x7fe7641a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.873+0000 7fe76b600640 1 --2- 172.21.15.37:0/4219370908 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe76410a6c0 0x7fe76419b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.873+0000 7fe76b600640 1 --2- 172.21.15.37:0/4219370908 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe764104cb0 0x7fe76419b160 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:06.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.873+0000 7fe76b600640 1 -- 172.21.15.37:0/4219370908 >> 172.21.15.37:0/4219370908 conn(0x7fe764100720 msgr2=0x7fe764102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:06.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.874+0000 7fe76b600640 1 -- 172.21.15.37:0/4219370908 shutdown_connections 2024-08-20T05:06:06.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:06.874+0000 7fe76b600640 1 -- 172.21.15.37:0/4219370908 wait complete. 2024-08-20T05:06:06.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:06 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1362947300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:06:07.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:06 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1362947300' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:06:07.788 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id fda19290 --release --await' 2024-08-20T05:06:07.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id fda19290 --release --await 2024-08-20T05:06:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:07 smithi130 ceph-mon[22007]: pgmap v517: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.2 MiB/s wr, 364 op/s 2024-08-20T05:06:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:07 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:06:08.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:07 smithi037 ceph-mon[17265]: pgmap v517: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.2 MiB/s wr, 364 op/s 2024-08-20T05:06:08.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:07 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:06:08.045 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 190.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:06:08.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:07 smithi135 ceph-mon[22342]: pgmap v517: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.2 MiB/s wr, 364 op/s 2024-08-20T05:06:08.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:07 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:06:08.419 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T05:06:08.508 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:06:09.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.068+0000 7f4e75a00640 1 -- 172.21.15.37:0/2615303963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e7010a6b0 msgr2=0x7f4e7010aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:09.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.068+0000 7f4e75a00640 1 --2- 172.21.15.37:0/2615303963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e7010a6b0 0x7f4e7010aaf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009900 tx=0x7f4e5c02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.068+0000 7f4e75a00640 1 -- 172.21.15.37:0/2615303963 shutdown_connections 2024-08-20T05:06:09.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.068+0000 7f4e75a00640 1 --2- 172.21.15.37:0/2615303963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e7010b030 0x7f4e70111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.068+0000 7f4e75a00640 1 --2- 172.21.15.37:0/2615303963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e7010a6b0 0x7f4e7010aaf0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.068+0000 7f4e75a00640 1 --2- 172.21.15.37:0/2615303963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e70104ca0 0x7f4e70105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.068+0000 7f4e75a00640 1 -- 172.21.15.37:0/2615303963 >> 172.21.15.37:0/2615303963 conn(0x7f4e70100730 msgr2=0x7f4e70102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:09.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.068+0000 7f4e75a00640 1 -- 172.21.15.37:0/2615303963 shutdown_connections 2024-08-20T05:06:09.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.068+0000 7f4e75a00640 1 -- 172.21.15.37:0/2615303963 wait complete. 2024-08-20T05:06:09.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.070+0000 7f4e75a00640 1 Processor -- start 2024-08-20T05:06:09.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.070+0000 7f4e75a00640 1 -- start start 2024-08-20T05:06:09.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.070+0000 7f4e75a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e70104ca0 0x7f4e7019b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.070+0000 7f4e75a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e7010a6b0 0x7f4e7019b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.070+0000 7f4e75a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e7010b030 0x7f4e701a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.070+0000 7f4e75a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4e70114cf0 con 0x7f4e7010a6b0 2024-08-20T05:06:09.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.070+0000 7f4e75a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4e70114b70 con 0x7f4e70104ca0 2024-08-20T05:06:09.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.070+0000 7f4e75a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4e70114e70 con 0x7f4e7010b030 2024-08-20T05:06:09.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.071+0000 7f4e6e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e7010a6b0 0x7f4e7019b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.071+0000 7f4e6e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e7010a6b0 0x7f4e7019b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56048/0 (socket says 172.21.15.37:56048) 2024-08-20T05:06:09.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.071+0000 7f4e6e000640 1 -- 172.21.15.37:0/2864198365 learned_addr learned my addr 172.21.15.37:0/2864198365 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:09.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.071+0000 7f4e6f400640 1 --2- 172.21.15.37:0/2864198365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e7010b030 0x7f4e701a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.071+0000 7f4e6ea00640 1 --2- 172.21.15.37:0/2864198365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e70104ca0 0x7f4e7019b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.071+0000 7f4e6f400640 1 -- 172.21.15.37:0/2864198365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e70104ca0 msgr2=0x7f4e7019b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:09.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.071+0000 7f4e6f400640 1 --2- 172.21.15.37:0/2864198365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e70104ca0 0x7f4e7019b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.071+0000 7f4e6f400640 1 -- 172.21.15.37:0/2864198365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e7010a6b0 msgr2=0x7f4e7019b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:09.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.071+0000 7f4e6f400640 1 --2- 172.21.15.37:0/2864198365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e7010a6b0 0x7f4e7019b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.071+0000 7f4e6f400640 1 -- 172.21.15.37:0/2864198365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e701a1230 con 0x7f4e7010b030 2024-08-20T05:06:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.071+0000 7f4e6f400640 1 --2- 172.21.15.37:0/2864198365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e7010b030 0x7f4e701a0a60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009fd0 tx=0x7f4e6800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.072+0000 7f4e67400640 1 -- 172.21.15.37:0/2864198365 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6800ce20 con 0x7f4e7010b030 2024-08-20T05:06:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.072+0000 7f4e75a00640 1 -- 172.21.15.37:0/2864198365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e701a1520 con 0x7f4e7010b030 2024-08-20T05:06:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.072+0000 7f4e67400640 1 -- 172.21.15.37:0/2864198365 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e68005020 con 0x7f4e7010b030 2024-08-20T05:06:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.072+0000 7f4e67400640 1 -- 172.21.15.37:0/2864198365 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68010690 con 0x7f4e7010b030 2024-08-20T05:06:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.072+0000 7f4e75a00640 1 -- 172.21.15.37:0/2864198365 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e701a7be0 con 0x7f4e7010b030 2024-08-20T05:06:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.075+0000 7f4e785bb740 1 Processor -- start 2024-08-20T05:06:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.076+0000 7f4e67400640 1 -- 172.21.15.37:0/2864198365 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4e680054d0 con 0x7f4e7010b030 2024-08-20T05:06:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.076+0000 7f4e785bb740 1 -- start start 2024-08-20T05:06:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.076+0000 7f4e785bb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 0x55e8444c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.076+0000 7f4e785bb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444c3610 0x55e8444cf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.076+0000 7f4e785bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444cf5a0 0x55e8444d1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.076+0000 7f4e785bb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e844464670 con 0x55e8444c2cf0 2024-08-20T05:06:09.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.076+0000 7f4e785bb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e844438d70 con 0x55e8444c3610 2024-08-20T05:06:09.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.076+0000 7f4e785bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e844428270 con 0x55e8444cf5a0 2024-08-20T05:06:09.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.077+0000 7f4e6e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 0x55e8444c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.077+0000 7f4e6e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 0x55e8444c30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56060/0 (socket says 172.21.15.37:56060) 2024-08-20T05:06:09.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.077+0000 7f4e6e000640 1 -- 172.21.15.37:0/1922561081 learned_addr learned my addr 172.21.15.37:0/1922561081 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:09.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.077+0000 7f4e6ea00640 1 --2- 172.21.15.37:0/1922561081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444c3610 0x55e8444cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.077+0000 7f4e6e000640 1 --2- 172.21.15.37:0/1922561081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444cf5a0 0x55e8444d1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.077+0000 7f4e6ea00640 1 -- 172.21.15.37:0/1922561081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444cf5a0 msgr2=0x55e8444d1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:09.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.077+0000 7f4e6ea00640 1 --2- 172.21.15.37:0/1922561081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444cf5a0 0x55e8444d1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.077+0000 7f4e6ea00640 1 -- 172.21.15.37:0/1922561081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 msgr2=0x55e8444c30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:09.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.077+0000 7f4e6ea00640 1 --2- 172.21.15.37:0/1922561081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 0x55e8444c30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.077+0000 7f4e6ea00640 1 -- 172.21.15.37:0/1922561081 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8443c4870 con 0x55e8444c3610 2024-08-20T05:06:09.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.077+0000 7f4e6e000640 1 --2- 172.21.15.37:0/1922561081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 0x55e8444c30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:09.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.078+0000 7f4e6ea00640 1 --2- 172.21.15.37:0/1922561081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444c3610 0x55e8444cf060 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4e60005fd0 tx=0x7f4e600107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d686bd8375f07f0d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:09.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.078+0000 7f4e67400640 1 --2- 172.21.15.37:0/2864198365 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4e540b3bd0 0x7f4e540b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.078+0000 7f4e67400640 1 -- 172.21.15.37:0/2864198365 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4e680e4640 con 0x7f4e7010b030 2024-08-20T05:06:09.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.078+0000 7f4e5be00640 1 -- 172.21.15.37:0/1922561081 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6001c680 con 0x55e8444c3610 2024-08-20T05:06:09.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.078+0000 7f4e6e000640 1 --2- 172.21.15.37:0/2864198365 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4e540b3bd0 0x7f4e540b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.078+0000 7f4e5be00640 1 -- 172.21.15.37:0/1922561081 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e6000be20 con 0x55e8444c3610 2024-08-20T05:06:09.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.078+0000 7f4e5be00640 1 -- 172.21.15.37:0/1922561081 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60011ba0 con 0x55e8444c3610 2024-08-20T05:06:09.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.078+0000 7f4e785bb740 1 -- 172.21.15.37:0/1922561081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444c3610 msgr2=0x55e8444cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:09.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.078+0000 7f4e6e000640 1 --2- 172.21.15.37:0/2864198365 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4e540b3bd0 0x7f4e540b6090 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c032fd0 tx=0x7f4e5c040040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:09.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.078+0000 7f4e785bb740 1 --2- 172.21.15.37:0/1922561081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444c3610 0x55e8444cf060 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4e60005fd0 tx=0x7f4e600107a0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.079+0000 7f4e785bb740 1 -- 172.21.15.37:0/1922561081 shutdown_connections 2024-08-20T05:06:09.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.079+0000 7f4e785bb740 1 --2- 172.21.15.37:0/1922561081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444cf5a0 0x55e8444d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.079+0000 7f4e785bb740 1 --2- 172.21.15.37:0/1922561081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444c3610 0x55e8444cf060 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.079+0000 7f4e785bb740 1 --2- 172.21.15.37:0/1922561081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 0x55e8444c30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.079+0000 7f4e785bb740 1 -- 172.21.15.37:0/1922561081 >> 172.21.15.37:0/1922561081 conn(0x55e8444c0b20 msgr2=0x55e8444c1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.079+0000 7f4e785bb740 1 -- 172.21.15.37:0/1922561081 shutdown_connections 2024-08-20T05:06:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.079+0000 7f4e785bb740 1 -- 172.21.15.37:0/1922561081 wait complete. 2024-08-20T05:06:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.079+0000 7f4e785bb740 1 -- start start 2024-08-20T05:06:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.079+0000 7f4e785bb740 1 Processor -- start 2024-08-20T05:06:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.080+0000 7f4e785bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444c2cf0 0x55e8444ced70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.080+0000 7f4e785bb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c3610 0x55e8444cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.080+0000 7f4e785bb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444cf5a0 0x55e8444cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.080+0000 7f4e785bb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e8443aeff0 con 0x55e8444c3610 2024-08-20T05:06:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.080+0000 7f4e785bb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e84442c2b0 con 0x55e8444cf5a0 2024-08-20T05:06:09.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.080+0000 7f4e785bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e84428abb0 con 0x55e8444c2cf0 2024-08-20T05:06:09.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.080+0000 7f4e785bb740 10 client.0 _ll_register_callbacks cb 0x55e844133d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:09.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.080+0000 7f4e6e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c3610 0x55e8444cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.080+0000 7f4e6e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c3610 0x55e8444cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56062/0 (socket says 172.21.15.37:56062) 2024-08-20T05:06:09.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.080+0000 7f4e6e000640 1 -- 172.21.15.37:0/1187239191 learned_addr learned my addr 172.21.15.37:0/1187239191 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:09.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.080+0000 7f4e6ea00640 1 --2- 172.21.15.37:0/1187239191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444c2cf0 0x55e8444ced70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.080+0000 7f4e6f400640 1 --2- 172.21.15.37:0/1187239191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444cf5a0 0x55e8444cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.081+0000 7f4e6e000640 1 -- 172.21.15.37:0/1187239191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444c2cf0 msgr2=0x55e8444ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:09.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.081+0000 7f4e6e000640 1 --2- 172.21.15.37:0/1187239191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444c2cf0 0x55e8444ced70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.081+0000 7f4e6e000640 1 -- 172.21.15.37:0/1187239191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444cf5a0 msgr2=0x55e8444cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:09.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.081+0000 7f4e6e000640 1 --2- 172.21.15.37:0/1187239191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444cf5a0 0x55e8444cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.081+0000 7f4e6e000640 1 -- 172.21.15.37:0/1187239191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e844187b00 con 0x55e8444c3610 2024-08-20T05:06:09.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.081+0000 7f4e6e000640 1 --2- 172.21.15.37:0/1187239191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c3610 0x55e8444cc1c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c031440 tx=0x7f4e5c005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6f6e25fd961776 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.081+0000 7f4e58c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:06:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.081+0000 7f4e58c00640 1 -- 172.21.15.37:0/1187239191 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c044030 con 0x55e8444c3610 2024-08-20T05:06:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.081+0000 7f4e58c00640 1 -- 172.21.15.37:0/1187239191 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4e5c003800 con 0x55e8444c3610 2024-08-20T05:06:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.081+0000 7f4e785bb740 1 -- 172.21.15.37:0/1187239191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e6000be20 con 0x55e8444c3610 2024-08-20T05:06:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.082+0000 7f4e58c00640 1 -- 172.21.15.37:0/1187239191 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f4e5c035040 con 0x55e8444c3610 2024-08-20T05:06:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.082+0000 7f4e785bb740 10 client.16302 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.082+0000 7f4e785bb740 1 -- 172.21.15.37:0/1187239191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e8441fe960 con 0x55e8444c3610 2024-08-20T05:06:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.082+0000 7f4e58c00640 1 -- 172.21.15.37:0/1187239191 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e6000be20 con 0x55e8444c3610 2024-08-20T05:06:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.082+0000 7f4e58c00640 1 -- 172.21.15.37:0/1187239191 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f4e5c04a070 con 0x55e8444c3610 2024-08-20T05:06:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.082+0000 7f4e785bb740 10 client.16302 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.082+0000 7f4e785bb740 10 client.16302 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:06:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.082+0000 7f4e785bb740 20 client.16302 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:09.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.082+0000 7f4e785bb740 1 --2- 172.21.15.37:0/1187239191 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e8444decc0 0x55e8444e10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.082+0000 7f4e785bb740 4 client.16302 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:06:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.082+0000 7f4e785bb740 1 -- 172.21.15.37:0/1187239191 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e84443acc0 con 0x55e8444decc0 2024-08-20T05:06:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.083+0000 7f4e6ea00640 1 --2- 172.21.15.37:0/1187239191 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e8444decc0 0x55e8444e10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.083+0000 7f4e6ea00640 1 --2- 172.21.15.37:0/1187239191 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e8444decc0 0x55e8444e10b0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce16bf0fb65b8cdd server_cookie=839981aa97bc0d51 in_seq=0 out_seq=0 2024-08-20T05:06:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.083+0000 7f4e58c00640 10 client.16302 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.084+0000 7f4e58c00640 1 -- 172.21.15.37:0/1187239191 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e84443acc0 con 0x55e8444decc0 2024-08-20T05:06:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.084+0000 7f4e58c00640 10 client.16302 handle_command_reply: tid=0 2024-08-20T05:06:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.084+0000 7f4e785bb740 1 client.16302 shutdown 2024-08-20T05:06:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.084+0000 7f4e785bb740 1 -- 172.21.15.37:0/1187239191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c3610 msgr2=0x55e8444cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.084+0000 7f4e785bb740 1 --2- 172.21.15.37:0/1187239191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c3610 0x55e8444cc1c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c031440 tx=0x7f4e5c005e50 comp rx=0 tx=0).stop 2024-08-20T05:06:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.084+0000 7f4e785bb740 1 -- 172.21.15.37:0/1187239191 shutdown_connections 2024-08-20T05:06:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.085+0000 7f4e785bb740 1 --2- 172.21.15.37:0/1187239191 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e8444decc0 0x55e8444e10b0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.085+0000 7f4e785bb740 1 --2- 172.21.15.37:0/1187239191 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444cf5a0 0x55e8444cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.085+0000 7f4e785bb740 1 --2- 172.21.15.37:0/1187239191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c3610 0x55e8444cc1c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.085+0000 7f4e785bb740 1 --2- 172.21.15.37:0/1187239191 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444c2cf0 0x55e8444ced70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.085+0000 7f4e58c00640 0 client.16302 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.085+0000 7f4e785bb740 1 -- 172.21.15.37:0/1187239191 >> 172.21.15.37:0/1187239191 conn(0x55e8444c0b20 msgr2=0x55e8444c6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.085+0000 7f4e785bb740 1 -- 172.21.15.37:0/1187239191 shutdown_connections 2024-08-20T05:06:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.085+0000 7f4e785bb740 1 -- 172.21.15.37:0/1187239191 wait complete. 2024-08-20T05:06:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.085+0000 7f4e785bb740 20 client.16302 trim_cache size 0 max 16384 2024-08-20T05:06:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.103+0000 7f4e785bb740 1 Processor -- start 2024-08-20T05:06:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.103+0000 7f4e785bb740 1 -- start start 2024-08-20T05:06:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.103+0000 7f4e785bb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 0x55e8444db240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.103+0000 7f4e785bb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444c3610 0x55e8444e6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.103+0000 7f4e785bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444cf5a0 0x55e8444e6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.103+0000 7f4e785bb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4e701b1950 con 0x55e8444c2cf0 2024-08-20T05:06:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.103+0000 7f4e785bb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4e701b3490 con 0x55e8444c3610 2024-08-20T05:06:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.103+0000 7f4e785bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4e701b2020 con 0x55e8444cf5a0 2024-08-20T05:06:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.103+0000 7f4e6ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 0x55e8444db240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.103+0000 7f4e6ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 0x55e8444db240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56064/0 (socket says 172.21.15.37:56064) 2024-08-20T05:06:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.103+0000 7f4e6ea00640 1 -- 172.21.15.37:0/271585932 learned_addr learned my addr 172.21.15.37:0/271585932 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.103+0000 7f4e6e000640 1 --2- 172.21.15.37:0/271585932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444c3610 0x55e8444e6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.103+0000 7f4e6f400640 1 --2- 172.21.15.37:0/271585932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444cf5a0 0x55e8444e6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.104+0000 7f4e6ea00640 1 -- 172.21.15.37:0/271585932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444cf5a0 msgr2=0x55e8444e6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.104+0000 7f4e6ea00640 1 --2- 172.21.15.37:0/271585932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444cf5a0 0x55e8444e6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.104+0000 7f4e6ea00640 1 -- 172.21.15.37:0/271585932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444c3610 msgr2=0x55e8444e6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.104+0000 7f4e6ea00640 1 --2- 172.21.15.37:0/271585932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444c3610 0x55e8444e6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.104+0000 7f4e6ea00640 1 -- 172.21.15.37:0/271585932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8444c3440 con 0x55e8444c2cf0 2024-08-20T05:06:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.104+0000 7f4e6ea00640 1 --2- 172.21.15.37:0/271585932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 0x55e8444db240 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4e60005fd0 tx=0x7f4e6000b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8617c01dea2f37c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.104+0000 7f4e5b400640 1 -- 172.21.15.37:0/271585932 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e600118b0 con 0x55e8444c2cf0 2024-08-20T05:06:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.104+0000 7f4e5b400640 1 -- 172.21.15.37:0/271585932 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e60005040 con 0x55e8444c2cf0 2024-08-20T05:06:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.104+0000 7f4e5b400640 1 -- 172.21.15.37:0/271585932 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e600048c0 con 0x55e8444c2cf0 2024-08-20T05:06:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.105+0000 7f4e785bb740 1 -- 172.21.15.37:0/271585932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 msgr2=0x55e8444db240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.105+0000 7f4e785bb740 1 --2- 172.21.15.37:0/271585932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 0x55e8444db240 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f4e60005fd0 tx=0x7f4e6000b410 comp rx=0 tx=0).stop 2024-08-20T05:06:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.105+0000 7f4e785bb740 1 -- 172.21.15.37:0/271585932 shutdown_connections 2024-08-20T05:06:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.105+0000 7f4e785bb740 1 --2- 172.21.15.37:0/271585932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444cf5a0 0x55e8444e6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.105+0000 7f4e785bb740 1 --2- 172.21.15.37:0/271585932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444c3610 0x55e8444e6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.105+0000 7f4e785bb740 1 --2- 172.21.15.37:0/271585932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 0x55e8444db240 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.105+0000 7f4e785bb740 1 -- 172.21.15.37:0/271585932 >> 172.21.15.37:0/271585932 conn(0x55e8444c0b20 msgr2=0x55e8444ce010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.105+0000 7f4e785bb740 1 -- 172.21.15.37:0/271585932 shutdown_connections 2024-08-20T05:06:09.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.105+0000 7f4e785bb740 1 -- 172.21.15.37:0/271585932 wait complete. 2024-08-20T05:06:09.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.105+0000 7f4e785bb740 1 -- start start 2024-08-20T05:06:09.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.106+0000 7f4e785bb740 1 Processor -- start 2024-08-20T05:06:09.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.106+0000 7f4e785bb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 0x55e8444d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.106+0000 7f4e785bb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444c3610 0x55e8444d37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.106+0000 7f4e785bb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444cf5a0 0x55e8444d3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.106+0000 7f4e785bb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4e701b2dc0 con 0x55e8444c2cf0 2024-08-20T05:06:09.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.106+0000 7f4e785bb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4e701b26f0 con 0x55e8444cf5a0 2024-08-20T05:06:09.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.106+0000 7f4e785bb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4e701af930 con 0x55e8444c3610 2024-08-20T05:06:09.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.106+0000 7f4e785bb740 10 client.0 _ll_register_callbacks cb 0x7f4e5c005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:09.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.106+0000 7f4e6ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 0x55e8444d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.106+0000 7f4e6e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444c3610 0x55e8444d37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.106+0000 7f4e6e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444c3610 0x55e8444d37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51316/0 (socket says 172.21.15.37:51316) 2024-08-20T05:06:09.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.106+0000 7f4e6e000640 1 -- 172.21.15.37:0/3929098787 learned_addr learned my addr 172.21.15.37:0/3929098787 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:09.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.106+0000 7f4e6f400640 1 --2- 172.21.15.37:0/3929098787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444cf5a0 0x55e8444d3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.107+0000 7f4e6ea00640 1 -- 172.21.15.37:0/3929098787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444c3610 msgr2=0x55e8444d37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:09.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.107+0000 7f4e6ea00640 1 --2- 172.21.15.37:0/3929098787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444c3610 0x55e8444d37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.107+0000 7f4e6ea00640 1 -- 172.21.15.37:0/3929098787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444cf5a0 msgr2=0x55e8444d3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:09.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.107+0000 7f4e6ea00640 1 --2- 172.21.15.37:0/3929098787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444cf5a0 0x55e8444d3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.107+0000 7f4e6ea00640 1 -- 172.21.15.37:0/3929098787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e844548a50 con 0x55e8444c2cf0 2024-08-20T05:06:09.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.107+0000 7f4e6e000640 1 --2- 172.21.15.37:0/3929098787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444c3610 0x55e8444d37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:09.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.107+0000 7f4e6ea00640 1 --2- 172.21.15.37:0/3929098787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 0x55e8444d32b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4e60013010 tx=0x7f4e60005c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45001822fe63ba7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:09.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.107+0000 7f4e58c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:06:09.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.107+0000 7f4e58c00640 1 -- 172.21.15.37:0/3929098787 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e600053f0 con 0x55e8444c2cf0 2024-08-20T05:06:09.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.108+0000 7f4e785bb740 1 -- 172.21.15.37:0/3929098787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e60005040 con 0x55e8444c2cf0 2024-08-20T05:06:09.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.108+0000 7f4e58c00640 1 -- 172.21.15.37:0/3929098787 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4e60005590 con 0x55e8444c2cf0 2024-08-20T05:06:09.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.108+0000 7f4e58c00640 1 -- 172.21.15.37:0/3929098787 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f4e60004020 con 0x55e8444c2cf0 2024-08-20T05:06:09.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.108+0000 7f4e785bb740 10 client.16308 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:09.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.108+0000 7f4e785bb740 1 -- 172.21.15.37:0/3929098787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e844549d90 con 0x55e8444c2cf0 2024-08-20T05:06:09.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.108+0000 7f4e58c00640 1 -- 172.21.15.37:0/3929098787 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e60005040 con 0x55e8444c2cf0 2024-08-20T05:06:09.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.108+0000 7f4e58c00640 1 -- 172.21.15.37:0/3929098787 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f4e600046f0 con 0x55e8444c2cf0 2024-08-20T05:06:09.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.108+0000 7f4e785bb740 10 client.16308 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:09.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.108+0000 7f4e785bb740 10 client.16308 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:06:09.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.108+0000 7f4e785bb740 20 client.16308 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:09.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.108+0000 7f4e785bb740 1 --2- 172.21.15.37:0/3929098787 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e84454a210 0x55e84454c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:09.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.108+0000 7f4e785bb740 4 client.16308 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fda19290", "release": true, "await": true}] 2024-08-20T05:06:09.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.108+0000 7f4e785bb740 1 -- 172.21.15.37:0/3929098787 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fda19290", "release": true, "await": true}) -- 0x55e844436760 con 0x55e84454a210 2024-08-20T05:06:09.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.109+0000 7f4e6e000640 1 --2- 172.21.15.37:0/3929098787 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e84454a210 0x55e84454c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:09.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.109+0000 7f4e6e000640 1 --2- 172.21.15.37:0/3929098787 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e84454a210 0x55e84454c600 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=547dc4d04812f309 server_cookie=711cceda7030e0e in_seq=0 out_seq=0 2024-08-20T05:06:09.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.109+0000 7f4e58c00640 10 client.16308 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:09.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.131+0000 7f4e58c00640 1 -- 172.21.15.37:0/3929098787 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e844436760 con 0x55e84454a210 2024-08-20T05:06:09.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.131+0000 7f4e58c00640 10 client.16308 handle_command_reply: tid=0 2024-08-20T05:06:09.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.131+0000 7f4e785bb740 1 client.16308 shutdown 2024-08-20T05:06:09.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.131+0000 7f4e785bb740 1 -- 172.21.15.37:0/3929098787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 msgr2=0x55e8444d32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:09.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.131+0000 7f4e785bb740 1 --2- 172.21.15.37:0/3929098787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 0x55e8444d32b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4e60013010 tx=0x7f4e60005c10 comp rx=0 tx=0).stop 2024-08-20T05:06:09.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.132+0000 7f4e785bb740 1 -- 172.21.15.37:0/3929098787 shutdown_connections 2024-08-20T05:06:09.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.132+0000 7f4e785bb740 1 --2- 172.21.15.37:0/3929098787 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e84454a210 0x55e84454c600 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.132+0000 7f4e785bb740 1 --2- 172.21.15.37:0/3929098787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e8444cf5a0 0x55e8444d3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.132+0000 7f4e785bb740 1 --2- 172.21.15.37:0/3929098787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e8444c3610 0x55e8444d37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.132+0000 7f4e785bb740 1 --2- 172.21.15.37:0/3929098787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e8444c2cf0 0x55e8444d32b0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.132+0000 7f4e785bb740 1 -- 172.21.15.37:0/3929098787 >> 172.21.15.37:0/3929098787 conn(0x55e8444c0b20 msgr2=0x55e8444caa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:09.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.132+0000 7f4e58c00640 0 client.16308 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:09.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.132+0000 7f4e785bb740 1 -- 172.21.15.37:0/3929098787 shutdown_connections 2024-08-20T05:06:09.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.132+0000 7f4e785bb740 1 -- 172.21.15.37:0/3929098787 wait complete. 2024-08-20T05:06:09.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.133+0000 7f4e785bb740 20 client.16308 trim_cache size 0 max 16384 2024-08-20T05:06:09.142 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:06:09.142 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 36, 2024-08-20T05:06:09.142 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:06:09.142 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 20, 2024-08-20T05:06:09.142 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:06:09.142 INFO:teuthology.orchestra.run.smithi037.stdout: "fda19290": { 2024-08-20T05:06:09.142 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 20, 2024-08-20T05:06:09.143 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:06:09.143 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:06:09.143 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:06:09.143 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:06:09.143 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:06:09.143 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:06:09.143 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 139.8, 2024-08-20T05:06:09.143 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:06:09.143 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:06:09.143 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:06:09.143 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:06:09.143 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:06:09.143 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:06:09.144 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:06:09.144 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:06:09.144 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:06:09.144 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:06:09.144 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:06:09.144 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:06:09.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.135+0000 7f4e75a00640 1 -- 172.21.15.37:0/2864198365 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4e540b3bd0 msgr2=0x7f4e540b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:09.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.135+0000 7f4e75a00640 1 --2- 172.21.15.37:0/2864198365 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4e540b3bd0 0x7f4e540b6090 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c032fd0 tx=0x7f4e5c040040 comp rx=0 tx=0).stop 2024-08-20T05:06:09.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.135+0000 7f4e75a00640 1 -- 172.21.15.37:0/2864198365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e7010b030 msgr2=0x7f4e701a0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:09.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.135+0000 7f4e75a00640 1 --2- 172.21.15.37:0/2864198365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e7010b030 0x7f4e701a0a60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009fd0 tx=0x7f4e6800ef10 comp rx=0 tx=0).stop 2024-08-20T05:06:09.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.136+0000 7f4e75a00640 1 -- 172.21.15.37:0/2864198365 shutdown_connections 2024-08-20T05:06:09.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.136+0000 7f4e75a00640 1 --2- 172.21.15.37:0/2864198365 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4e540b3bd0 0x7f4e540b6090 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.136+0000 7f4e75a00640 1 --2- 172.21.15.37:0/2864198365 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e7010b030 0x7f4e701a0a60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.136+0000 7f4e75a00640 1 --2- 172.21.15.37:0/2864198365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e7010a6b0 0x7f4e7019b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.136+0000 7f4e75a00640 1 --2- 172.21.15.37:0/2864198365 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e70104ca0 0x7f4e7019b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:09.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.136+0000 7f4e75a00640 1 -- 172.21.15.37:0/2864198365 >> 172.21.15.37:0/2864198365 conn(0x7f4e70100730 msgr2=0x7f4e70102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:09.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.136+0000 7f4e75a00640 1 -- 172.21.15.37:0/2864198365 shutdown_connections 2024-08-20T05:06:09.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:09.136+0000 7f4e75a00640 1 -- 172.21.15.37:0/2864198365 wait complete. 2024-08-20T05:06:09.588 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:06:09.949 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:09 smithi037 ceph-mon[17265]: pgmap v518: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.1 MiB/s wr, 349 op/s 2024-08-20T05:06:09.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:09 smithi130 ceph-mon[22007]: pgmap v518: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.1 MiB/s wr, 349 op/s 2024-08-20T05:06:10.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:09 smithi135 ceph-mon[22342]: pgmap v518: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.1 MiB/s wr, 349 op/s 2024-08-20T05:06:10.309 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fda19290', total seconds elapsed: 25.1 2024-08-20T05:06:10.309 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.85 2024-08-20T05:06:10.310 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:06:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.275+0000 7fb4f9200640 1 -- 172.21.15.37:0/3401260351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4f411bdd0 msgr2=0x7fb4f411e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.275+0000 7fb4f9200640 1 --2- 172.21.15.37:0/3401260351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4f411bdd0 0x7fb4f411e1c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009ca0 tx=0x7fb4ec02a950 comp rx=0 tx=0).stop 2024-08-20T05:06:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.276+0000 7fb4f9200640 1 -- 172.21.15.37:0/3401260351 shutdown_connections 2024-08-20T05:06:11.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.276+0000 7fb4f9200640 1 --2- 172.21.15.37:0/3401260351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4f411bdd0 0x7fb4f411e1c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.276+0000 7fb4f9200640 1 --2- 172.21.15.37:0/3401260351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4f410a260 0x7fb4f410a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.279+0000 7fb4f9200640 1 --2- 172.21.15.37:0/3401260351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4f4109e80 0x7fb4f4110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.279+0000 7fb4f9200640 1 -- 172.21.15.37:0/3401260351 >> 172.21.15.37:0/3401260351 conn(0x7fb4f406dcc0 msgr2=0x7fb4f406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:11.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.280+0000 7fb4f9200640 1 -- 172.21.15.37:0/3401260351 shutdown_connections 2024-08-20T05:06:11.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.280+0000 7fb4f9200640 1 -- 172.21.15.37:0/3401260351 wait complete. 2024-08-20T05:06:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.282+0000 7fb4f9200640 1 Processor -- start 2024-08-20T05:06:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.283+0000 7fb4f9200640 1 -- start start 2024-08-20T05:06:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.284+0000 7fb4f9200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4f4109e80 0x7fb4f41a7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.285+0000 7fb4f9200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4f410a260 0x7fb4f41a8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.285+0000 7fb4f9200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4f411bdd0 0x7fb4f41ad6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.285+0000 7fb4f9200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f41218f0 con 0x7fb4f411bdd0 2024-08-20T05:06:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.285+0000 7fb4f9200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f4121770 con 0x7fb4f410a260 2024-08-20T05:06:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.285+0000 7fb4f9200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f4121a70 con 0x7fb4f4109e80 2024-08-20T05:06:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.285+0000 7fb4f1e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4f4109e80 0x7fb4f41a7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:11.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.285+0000 7fb4f2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4f411bdd0 0x7fb4f41ad6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:11.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.286+0000 7fb4f2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4f411bdd0 0x7fb4f41ad6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56100/0 (socket says 172.21.15.37:56100) 2024-08-20T05:06:11.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.286+0000 7fb4f2800640 1 -- 172.21.15.37:0/731975376 learned_addr learned my addr 172.21.15.37:0/731975376 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:11.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.285+0000 7fb4f1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4f410a260 0x7fb4f41a8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:11.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.287+0000 7fb4f1e00640 1 -- 172.21.15.37:0/731975376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4f410a260 msgr2=0x7fb4f41a8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:11.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.287+0000 7fb4f1e00640 1 --2- 172.21.15.37:0/731975376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4f410a260 0x7fb4f41a8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.287+0000 7fb4f1e00640 1 -- 172.21.15.37:0/731975376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4f411bdd0 msgr2=0x7fb4f41ad6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:11.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.287+0000 7fb4f1e00640 1 --2- 172.21.15.37:0/731975376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4f411bdd0 0x7fb4f41ad6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.287+0000 7fb4f1e00640 1 -- 172.21.15.37:0/731975376 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f41adeb0 con 0x7fb4f4109e80 2024-08-20T05:06:11.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.287+0000 7fb4f1e00640 1 --2- 172.21.15.37:0/731975376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4f4109e80 0x7fb4f41a7e00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400e9f0 tx=0x7fb4e400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:11.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.288+0000 7fb4eaa00640 1 -- 172.21.15.37:0/731975376 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e400cd80 con 0x7fb4f4109e80 2024-08-20T05:06:11.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.288+0000 7fb4eaa00640 1 -- 172.21.15.37:0/731975376 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4e40035f0 con 0x7fb4f4109e80 2024-08-20T05:06:11.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.288+0000 7fb4eaa00640 1 -- 172.21.15.37:0/731975376 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e4010670 con 0x7fb4f4109e80 2024-08-20T05:06:11.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.289+0000 7fb4f9200640 1 -- 172.21.15.37:0/731975376 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f41ae1a0 con 0x7fb4f4109e80 2024-08-20T05:06:11.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.289+0000 7fb4f9200640 1 -- 172.21.15.37:0/731975376 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f41b4860 con 0x7fb4f4109e80 2024-08-20T05:06:11.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.294+0000 7fb4fbc4f740 1 Processor -- start 2024-08-20T05:06:11.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.295+0000 7fb4fbc4f740 1 -- start start 2024-08-20T05:06:11.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.295+0000 7fb4fbc4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e209940 0x55f73e209d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.296+0000 7fb4fbc4f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f73e20a260 0x55f73e215cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.296+0000 7fb4fbc4f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e2161f0 0x55f73e2185e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.296+0000 7fb4fbc4f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f73e17faa0 con 0x55f73e20a260 2024-08-20T05:06:11.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.296+0000 7fb4fbc4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f73e16efa0 con 0x55f73e209940 2024-08-20T05:06:11.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.296+0000 7fb4fbc4f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f73e172fe0 con 0x55f73e2161f0 2024-08-20T05:06:11.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.296+0000 7fb4f2800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e209940 0x55f73e209d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:11.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.296+0000 7fb4f2800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e209940 0x55f73e209d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:39842/0 (socket says 172.21.15.37:39842) 2024-08-20T05:06:11.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.296+0000 7fb4f2800640 1 -- 172.21.15.37:0/264191702 learned_addr learned my addr 172.21.15.37:0/264191702 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:11.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.296+0000 7fb4eaa00640 1 -- 172.21.15.37:0/731975376 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb4e40037a0 con 0x7fb4f4109e80 2024-08-20T05:06:11.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.296+0000 7fb4f1400640 1 --2- 172.21.15.37:0/264191702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e2161f0 0x55f73e2185e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:11.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.297+0000 7fb4f2800640 1 -- 172.21.15.37:0/264191702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e2161f0 msgr2=0x55f73e2185e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:11.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.297+0000 7fb4f2800640 1 --2- 172.21.15.37:0/264191702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e2161f0 0x55f73e2185e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.297+0000 7fb4f2800640 1 -- 172.21.15.37:0/264191702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f73e20a260 msgr2=0x55f73e215cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:06:11.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.297+0000 7fb4f2800640 1 --2- 172.21.15.37:0/264191702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f73e20a260 0x55f73e215cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.297+0000 7fb4f2800640 1 -- 172.21.15.37:0/264191702 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f73e115420 con 0x55f73e209940 2024-08-20T05:06:11.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.297+0000 7fb4f2800640 1 --2- 172.21.15.37:0/264191702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e209940 0x55f73e209d20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec02f710 tx=0x7fb4ec02f740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6877df3889e2233c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:11.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.299+0000 7fb4eaa00640 1 --2- 172.21.15.37:0/731975376 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4d80b3c50 0x7fb4d80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.300+0000 7fb4eaa00640 1 -- 172.21.15.37:0/731975376 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb4e40e41d0 con 0x7fb4f4109e80 2024-08-20T05:06:11.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.300+0000 7fb4df400640 1 -- 172.21.15.37:0/264191702 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec048070 con 0x55f73e209940 2024-08-20T05:06:11.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.300+0000 7fb4df400640 1 -- 172.21.15.37:0/264191702 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4ec003e20 con 0x55f73e209940 2024-08-20T05:06:11.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.300+0000 7fb4df400640 1 -- 172.21.15.37:0/264191702 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec034040 con 0x55f73e209940 2024-08-20T05:06:11.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.300+0000 7fb4f1e00640 1 --2- 172.21.15.37:0/731975376 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4d80b3c50 0x7fb4d80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:11.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.303+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/264191702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e209940 msgr2=0x55f73e209d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:11.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.303+0000 7fb4f1e00640 1 --2- 172.21.15.37:0/731975376 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4d80b3c50 0x7fb4d80b6110 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40a6e00 tx=0x7fb4e4003e00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:11.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.303+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/264191702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e209940 0x55f73e209d20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec02f710 tx=0x7fb4ec02f740 comp rx=0 tx=0).stop 2024-08-20T05:06:11.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.306+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/264191702 shutdown_connections 2024-08-20T05:06:11.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.306+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/264191702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e2161f0 0x55f73e2185e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.306+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/264191702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f73e20a260 0x55f73e215cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.306+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/264191702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e209940 0x55f73e209d20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.306+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/264191702 >> 172.21.15.37:0/264191702 conn(0x55f73e207770 msgr2=0x55f73e208910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:11.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.306+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/264191702 shutdown_connections 2024-08-20T05:06:11.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.306+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/264191702 wait complete. 2024-08-20T05:06:11.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.307+0000 7fb4fbc4f740 1 -- start start 2024-08-20T05:06:11.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.307+0000 7fb4fbc4f740 1 Processor -- start 2024-08-20T05:06:11.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.312+0000 7fb4fbc4f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e209940 0x55f73e215a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.313+0000 7fb4f2800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e209940 0x55f73e215a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:11.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.313+0000 7fb4f2800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e209940 0x55f73e215a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51360/0 (socket says 172.21.15.37:51360) 2024-08-20T05:06:11.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.313+0000 7fb4fbc4f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f73e20a260 0x55f73e212ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.314+0000 7fb4f2800640 1 -- 172.21.15.37:0/763127389 learned_addr learned my addr 172.21.15.37:0/763127389 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:11.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.315+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/763127389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e2161f0 0x55f73e213470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.315+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/763127389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f73dfd1700 con 0x55f73e20a260 2024-08-20T05:06:11.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.315+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/763127389 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f73e10a290 con 0x55f73e2161f0 2024-08-20T05:06:11.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.315+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/763127389 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f73e218e10 con 0x55f73e209940 2024-08-20T05:06:11.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.315+0000 7fb4fbc4f740 10 client.0 _ll_register_callbacks cb 0x55f73e1691c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:11.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.316+0000 7fb4f2800640 1 --2- 172.21.15.37:0/763127389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e2161f0 0x55f73e213470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:11.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.316+0000 7fb4f2800640 1 -- 172.21.15.37:0/763127389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e2161f0 msgr2=0x55f73e213470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:11.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.316+0000 7fb4f2800640 1 --2- 172.21.15.37:0/763127389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e2161f0 0x55f73e213470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.316+0000 7fb4f2800640 1 -- 172.21.15.37:0/763127389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f73e20a260 msgr2=0x55f73e212ed0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:06:11.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.316+0000 7fb4f2800640 1 --2- 172.21.15.37:0/763127389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f73e20a260 0x55f73e212ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.316+0000 7fb4f2800640 1 -- 172.21.15.37:0/763127389 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f73dece650 con 0x55f73e209940 2024-08-20T05:06:11.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.317+0000 7fb4f2800640 1 --2- 172.21.15.37:0/763127389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e209940 0x55f73e215a80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009620 tx=0x7fb4ec02fd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b80075156c0ea2a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:11.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.317+0000 7fb4d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:06:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.317+0000 7fb4d3e00640 1 -- 172.21.15.37:0/763127389 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec048030 con 0x55f73e209940 2024-08-20T05:06:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.317+0000 7fb4d3e00640 1 -- 172.21.15.37:0/763127389 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb4ec040040 con 0x55f73e209940 2024-08-20T05:06:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.318+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/763127389 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4ec003e20 con 0x55f73e209940 2024-08-20T05:06:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.318+0000 7fb4d3e00640 1 -- 172.21.15.37:0/763127389 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fb4ec059050 con 0x55f73e209940 2024-08-20T05:06:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.319+0000 7fb4fbc4f740 10 client.26560 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.319+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/763127389 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f73e224730 con 0x55f73e209940 2024-08-20T05:06:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.320+0000 7fb4d3e00640 1 -- 172.21.15.37:0/763127389 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4ec003e20 con 0x55f73e209940 2024-08-20T05:06:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.320+0000 7fb4d3e00640 1 -- 172.21.15.37:0/763127389 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fb4ec0309a0 con 0x55f73e209940 2024-08-20T05:06:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.320+0000 7fb4fbc4f740 10 client.26560 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.320+0000 7fb4fbc4f740 10 client.26560 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:06:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.321+0000 7fb4fbc4f740 20 client.26560 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.321+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/763127389 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55f73e225a80 0x55f73e227e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.321+0000 7fb4fbc4f740 4 client.26560 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:06:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.321+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/763127389 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f73e1819f0 con 0x55f73e225a80 2024-08-20T05:06:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.321+0000 7fb4f1400640 1 --2- 172.21.15.37:0/763127389 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55f73e225a80 0x55f73e227e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:11.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.322+0000 7fb4f1400640 1 --2- 172.21.15.37:0/763127389 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55f73e225a80 0x55f73e227e70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5f744b041a032a5 server_cookie=c206c0530a616881 in_seq=0 out_seq=0 2024-08-20T05:06:11.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.322+0000 7fb4d3e00640 10 client.26560 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:06:11.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.322+0000 7fb4d3e00640 1 -- 172.21.15.37:0/763127389 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f73e1819f0 con 0x55f73e225a80 2024-08-20T05:06:11.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.322+0000 7fb4d3e00640 10 client.26560 handle_command_reply: tid=0 2024-08-20T05:06:11.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.323+0000 7fb4fbc4f740 1 client.26560 shutdown 2024-08-20T05:06:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.323+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/763127389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e209940 msgr2=0x55f73e215a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.323+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/763127389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e209940 0x55f73e215a80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec009620 tx=0x7fb4ec02fd90 comp rx=0 tx=0).stop 2024-08-20T05:06:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.323+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/763127389 shutdown_connections 2024-08-20T05:06:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.323+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/763127389 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55f73e225a80 0x55f73e227e70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.323+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/763127389 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e2161f0 0x55f73e213470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.323+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/763127389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f73e20a260 0x55f73e212ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.323+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/763127389 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e209940 0x55f73e215a80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.323+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/763127389 >> 172.21.15.37:0/763127389 conn(0x55f73e207770 msgr2=0x55f73e20d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.323+0000 7fb4d3e00640 0 client.26560 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:06:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.324+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/763127389 shutdown_connections 2024-08-20T05:06:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.324+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/763127389 wait complete. 2024-08-20T05:06:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.324+0000 7fb4fbc4f740 20 client.26560 trim_cache size 0 max 16384 2024-08-20T05:06:11.348 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:06:11.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.357+0000 7fb4fbc4f740 1 Processor -- start 2024-08-20T05:06:11.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.357+0000 7fb4fbc4f740 1 -- start start 2024-08-20T05:06:11.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.357+0000 7fb4fbc4f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e209940 0x55f73e22ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.357+0000 7fb4fbc4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e20a260 0x55f73e22b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.357+0000 7fb4fbc4f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f73e2161f0 0x55f73e2100e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.357+0000 7fb4fbc4f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f41be710 con 0x55f73e2161f0 2024-08-20T05:06:11.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.357+0000 7fb4fbc4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f41c0250 con 0x55f73e20a260 2024-08-20T05:06:11.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.357+0000 7fb4fbc4f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f41bede0 con 0x55f73e209940 2024-08-20T05:06:11.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.358+0000 7fb4f2800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e209940 0x55f73e22ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:11.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.358+0000 7fb4f2800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e209940 0x55f73e22ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51374/0 (socket says 172.21.15.37:51374) 2024-08-20T05:06:11.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.358+0000 7fb4f2800640 1 -- 172.21.15.37:0/195900437 learned_addr learned my addr 172.21.15.37:0/195900437 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:11.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.358+0000 7fb4f2800640 1 --2- 172.21.15.37:0/195900437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f73e2161f0 0x55f73e2100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:11.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.358+0000 7fb4f1400640 1 --2- 172.21.15.37:0/195900437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e20a260 0x55f73e22b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:11.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.359+0000 7fb4f2800640 1 -- 172.21.15.37:0/195900437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e20a260 msgr2=0x55f73e22b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:11.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.359+0000 7fb4f2800640 1 --2- 172.21.15.37:0/195900437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e20a260 0x55f73e22b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.359+0000 7fb4f2800640 1 -- 172.21.15.37:0/195900437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f73e2161f0 msgr2=0x55f73e2100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.359+0000 7fb4f2800640 1 --2- 172.21.15.37:0/195900437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f73e2161f0 0x55f73e2100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.360+0000 7fb4f2800640 1 -- 172.21.15.37:0/195900437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f73e20a090 con 0x55f73e209940 2024-08-20T05:06:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.360+0000 7fb4f1400640 1 --2- 172.21.15.37:0/195900437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e20a260 0x55f73e22b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.360+0000 7fb4f2800640 1 --2- 172.21.15.37:0/195900437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e209940 0x55f73e22ae90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec030da0 tx=0x7fb4ec030f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2d0b7a3fe50c604 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.360+0000 7fb4dea00640 1 -- 172.21.15.37:0/195900437 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec048030 con 0x55f73e209940 2024-08-20T05:06:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.360+0000 7fb4dea00640 1 -- 172.21.15.37:0/195900437 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4ec049040 con 0x55f73e209940 2024-08-20T05:06:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.360+0000 7fb4dea00640 1 -- 172.21.15.37:0/195900437 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec034070 con 0x55f73e209940 2024-08-20T05:06:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.362+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/195900437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e209940 msgr2=0x55f73e22ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.362+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/195900437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e209940 0x55f73e22ae90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec030da0 tx=0x7fb4ec030f90 comp rx=0 tx=0).stop 2024-08-20T05:06:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.362+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/195900437 shutdown_connections 2024-08-20T05:06:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.362+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/195900437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f73e2161f0 0x55f73e2100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.362+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/195900437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e20a260 0x55f73e22b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.362+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/195900437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e209940 0x55f73e22ae90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.362+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/195900437 >> 172.21.15.37:0/195900437 conn(0x55f73e207770 msgr2=0x55f73e20e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:11.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.363+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/195900437 shutdown_connections 2024-08-20T05:06:11.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.363+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/195900437 wait complete. 2024-08-20T05:06:11.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.364+0000 7fb4fbc4f740 1 -- start start 2024-08-20T05:06:11.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.365+0000 7fb4fbc4f740 1 Processor -- start 2024-08-20T05:06:11.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.366+0000 7fb4fbc4f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f73e209940 0x55f73e22b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.366+0000 7fb4fbc4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e20a260 0x55f73e228a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.366+0000 7fb4fbc4f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e2161f0 0x55f73e228f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.366+0000 7fb4fbc4f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f41bfb80 con 0x55f73e209940 2024-08-20T05:06:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.366+0000 7fb4fbc4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f41bf4b0 con 0x55f73e20a260 2024-08-20T05:06:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.366+0000 7fb4fbc4f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f41bc6f0 con 0x55f73e2161f0 2024-08-20T05:06:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.366+0000 7fb4fbc4f740 10 client.0 _ll_register_callbacks cb 0x7fb4ec046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.366+0000 7fb4f1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e20a260 0x55f73e228a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.366+0000 7fb4f1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e20a260 0x55f73e228a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:39870/0 (socket says 172.21.15.37:39870) 2024-08-20T05:06:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.366+0000 7fb4f1400640 1 -- 172.21.15.37:0/3016074117 learned_addr learned my addr 172.21.15.37:0/3016074117 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.367+0000 7fb4f1400640 1 -- 172.21.15.37:0/3016074117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e2161f0 msgr2=0x55f73e228f90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:06:11.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.367+0000 7fb4f1400640 1 --2- 172.21.15.37:0/3016074117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e2161f0 0x55f73e228f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.367+0000 7fb4f1400640 1 -- 172.21.15.37:0/3016074117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f73e209940 msgr2=0x55f73e22b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:11.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.367+0000 7fb4f1400640 1 --2- 172.21.15.37:0/3016074117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f73e209940 0x55f73e22b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.367+0000 7fb4f1400640 1 -- 172.21.15.37:0/3016074117 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f73e211e30 con 0x55f73e20a260 2024-08-20T05:06:11.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.368+0000 7fb4f1400640 1 --2- 172.21.15.37:0/3016074117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e20a260 0x55f73e228a50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0000c00 tx=0x7fb4e000bcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7ea597315867e15 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.368+0000 7fb4d3e00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:06:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.368+0000 7fb4d3e00640 1 -- 172.21.15.37:0/3016074117 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0022020 con 0x55f73e20a260 2024-08-20T05:06:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.368+0000 7fb4d3e00640 1 -- 172.21.15.37:0/3016074117 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb4e0015ae0 con 0x55f73e20a260 2024-08-20T05:06:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.368+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/3016074117 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4ec049040 con 0x55f73e20a260 2024-08-20T05:06:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.368+0000 7fb4d3e00640 1 -- 172.21.15.37:0/3016074117 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fb4e002d050 con 0x55f73e20a260 2024-08-20T05:06:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.368+0000 7fb4fbc4f740 10 client.26531 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.368+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/3016074117 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f73e290220 con 0x55f73e20a260 2024-08-20T05:06:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.369+0000 7fb4d3e00640 1 -- 172.21.15.37:0/3016074117 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4ec049040 con 0x55f73e20a260 2024-08-20T05:06:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.369+0000 7fb4d3e00640 1 -- 172.21.15.37:0/3016074117 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fb4e0014420 con 0x55f73e20a260 2024-08-20T05:06:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.369+0000 7fb4fbc4f740 10 client.26531 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.369+0000 7fb4fbc4f740 10 client.26531 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:06:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.369+0000 7fb4fbc4f740 20 client.26531 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.369+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/3016074117 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55f73e2909d0 0x55f73e292e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.369+0000 7fb4fbc4f740 4 client.26531 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:06:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.369+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/3016074117 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f73e17d490 con 0x55f73e2909d0 2024-08-20T05:06:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.369+0000 7fb4f2800640 1 --2- 172.21.15.37:0/3016074117 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55f73e2909d0 0x55f73e292e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.370+0000 7fb4d3e00640 10 client.26531 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:06:11.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.372+0000 7fb4f2800640 1 --2- 172.21.15.37:0/3016074117 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55f73e2909d0 0x55f73e292e10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a7b2b11eea4cc92b server_cookie=5277a68190cbc11f in_seq=0 out_seq=0 2024-08-20T05:06:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.373+0000 7fb4d3e00640 1 -- 172.21.15.37:0/3016074117 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f73e17d490 con 0x55f73e2909d0 2024-08-20T05:06:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.373+0000 7fb4d3e00640 10 client.26531 handle_command_reply: tid=0 2024-08-20T05:06:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.373+0000 7fb4fbc4f740 1 client.26531 shutdown 2024-08-20T05:06:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.374+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/3016074117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e20a260 msgr2=0x55f73e228a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.374+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/3016074117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e20a260 0x55f73e228a50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0000c00 tx=0x7fb4e000bcc0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.374+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/3016074117 shutdown_connections 2024-08-20T05:06:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.374+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/3016074117 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55f73e2909d0 0x55f73e292e10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.374+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/3016074117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f73e2161f0 0x55f73e228f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.374+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/3016074117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f73e20a260 0x55f73e228a50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.374+0000 7fb4fbc4f740 1 --2- 172.21.15.37:0/3016074117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f73e209940 0x55f73e22b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.374+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/3016074117 >> 172.21.15.37:0/3016074117 conn(0x55f73e207770 msgr2=0x55f73e206030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.374+0000 7fb4d3e00640 0 client.26531 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:06:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.374+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/3016074117 shutdown_connections 2024-08-20T05:06:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.374+0000 7fb4fbc4f740 1 -- 172.21.15.37:0/3016074117 wait complete. 2024-08-20T05:06:11.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.375+0000 7fb4fbc4f740 20 client.26531 trim_cache size 0 max 16384 2024-08-20T05:06:11.377 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:06:11.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.378+0000 7fb4f9200640 1 -- 172.21.15.37:0/731975376 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4d80b3c50 msgr2=0x7fb4d80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:11.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.378+0000 7fb4f9200640 1 --2- 172.21.15.37:0/731975376 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4d80b3c50 0x7fb4d80b6110 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40a6e00 tx=0x7fb4e4003e00 comp rx=0 tx=0).stop 2024-08-20T05:06:11.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.378+0000 7fb4f9200640 1 -- 172.21.15.37:0/731975376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4f4109e80 msgr2=0x7fb4f41a7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:11.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.378+0000 7fb4f9200640 1 --2- 172.21.15.37:0/731975376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4f4109e80 0x7fb4f41a7e00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb4e400e9f0 tx=0x7fb4e400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.378+0000 7fb4f9200640 1 -- 172.21.15.37:0/731975376 shutdown_connections 2024-08-20T05:06:11.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.378+0000 7fb4f9200640 1 --2- 172.21.15.37:0/731975376 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4d80b3c50 0x7fb4d80b6110 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.378+0000 7fb4f9200640 1 --2- 172.21.15.37:0/731975376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4f411bdd0 0x7fb4f41ad6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.378+0000 7fb4f9200640 1 --2- 172.21.15.37:0/731975376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb4f410a260 0x7fb4f41a8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.378+0000 7fb4f9200640 1 --2- 172.21.15.37:0/731975376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb4f4109e80 0x7fb4f41a7e00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.378+0000 7fb4f9200640 1 -- 172.21.15.37:0/731975376 >> 172.21.15.37:0/731975376 conn(0x7fb4f406dcc0 msgr2=0x7fb4f411c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.378+0000 7fb4f9200640 1 -- 172.21.15.37:0/731975376 shutdown_connections 2024-08-20T05:06:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:11.378+0000 7fb4f9200640 1 -- 172.21.15.37:0/731975376 wait complete. 2024-08-20T05:06:11.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:11 smithi130 ceph-mon[22007]: pgmap v519: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.1 MiB/s wr, 356 op/s 2024-08-20T05:06:12.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:11 smithi037 ceph-mon[17265]: pgmap v519: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.1 MiB/s wr, 356 op/s 2024-08-20T05:06:12.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:11 smithi135 ceph-mon[22342]: pgmap v519: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.1 MiB/s wr, 356 op/s 2024-08-20T05:06:12.376 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T05:06:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 195.0 s, 797.2 tps, lat 557.489 ms stddev 2892.288 2024-08-20T05:06:13.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.081+0000 7f4462200640 1 -- 172.21.15.37:0/3292369695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f445c108e40 msgr2=0x7f445c10f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:13.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.081+0000 7f4462200640 1 --2- 172.21.15.37:0/3292369695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f445c108e40 0x7f445c10f640 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f444c009860 tx=0x7f444c02a340 comp rx=0 tx=0).stop 2024-08-20T05:06:13.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.081+0000 7f4462200640 1 -- 172.21.15.37:0/3292369695 shutdown_connections 2024-08-20T05:06:13.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.081+0000 7f4462200640 1 --2- 172.21.15.37:0/3292369695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f445c108e40 0x7f445c10f640 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:13.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.081+0000 7f4462200640 1 --2- 172.21.15.37:0/3292369695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f445c1084c0 0x7f445c108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:13.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.081+0000 7f4462200640 1 --2- 172.21.15.37:0/3292369695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f445c102ab0 0x7f445c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:13.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.081+0000 7f4462200640 1 -- 172.21.15.37:0/3292369695 >> 172.21.15.37:0/3292369695 conn(0x7f445c0fe500 msgr2=0x7f445c100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:13.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.082+0000 7f4462200640 1 -- 172.21.15.37:0/3292369695 shutdown_connections 2024-08-20T05:06:13.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.082+0000 7f4462200640 1 -- 172.21.15.37:0/3292369695 wait complete. 2024-08-20T05:06:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.084+0000 7f4462200640 1 Processor -- start 2024-08-20T05:06:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.084+0000 7f4462200640 1 -- start start 2024-08-20T05:06:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.084+0000 7f4462200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f445c102ab0 0x7f445c196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.084+0000 7f4462200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f445c1084c0 0x7f445c1972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.084+0000 7f4462200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f445c108e40 0x7f445c19c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.084+0000 7f4462200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f445c110910 con 0x7f445c1084c0 2024-08-20T05:06:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.084+0000 7f4462200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f445c110790 con 0x7f445c102ab0 2024-08-20T05:06:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.084+0000 7f4462200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f445c110a90 con 0x7f445c108e40 2024-08-20T05:06:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.085+0000 7f445b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f445c102ab0 0x7f445c196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.085+0000 7f445b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f445c102ab0 0x7f445c196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56390/0 (socket says 172.21.15.37:56390) 2024-08-20T05:06:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.085+0000 7f445b400640 1 -- 172.21.15.37:0/1807233002 learned_addr learned my addr 172.21.15.37:0/1807233002 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:13.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.085+0000 7f445b400640 1 -- 172.21.15.37:0/1807233002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f445c108e40 msgr2=0x7f445c19c640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T05:06:13.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.085+0000 7f445aa00640 1 --2- 172.21.15.37:0/1807233002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f445c1084c0 0x7f445c1972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.086+0000 7f445b400640 1 --2- 172.21.15.37:0/1807233002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f445c108e40 0x7f445c19c640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.086+0000 7f445b400640 1 -- 172.21.15.37:0/1807233002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f445c1084c0 msgr2=0x7f445c1972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.086+0000 7f445b400640 1 --2- 172.21.15.37:0/1807233002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f445c1084c0 0x7f445c1972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.086+0000 7f445b400640 1 -- 172.21.15.37:0/1807233002 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445c19ce10 con 0x7f445c102ab0 2024-08-20T05:06:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.086+0000 7f445aa00640 1 --2- 172.21.15.37:0/1807233002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f445c1084c0 0x7f445c1972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:06:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.086+0000 7f445b400640 1 --2- 172.21.15.37:0/1807233002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f445c102ab0 0x7f445c196d60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f445400c420 tx=0x7f4454009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.086+0000 7f4453e00640 1 -- 172.21.15.37:0/1807233002 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4454003970 con 0x7f445c102ab0 2024-08-20T05:06:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.086+0000 7f4453e00640 1 -- 172.21.15.37:0/1807233002 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4454004020 con 0x7f445c102ab0 2024-08-20T05:06:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.086+0000 7f4453e00640 1 -- 172.21.15.37:0/1807233002 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f445400b980 con 0x7f445c102ab0 2024-08-20T05:06:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.086+0000 7f4462200640 1 -- 172.21.15.37:0/1807233002 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f445c19d100 con 0x7f445c102ab0 2024-08-20T05:06:13.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.087+0000 7f4462200640 1 -- 172.21.15.37:0/1807233002 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f445c1a3990 con 0x7f445c102ab0 2024-08-20T05:06:13.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.091+0000 7f4462200640 1 -- 172.21.15.37:0/1807233002 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f445c102e90 con 0x7f445c102ab0 2024-08-20T05:06:13.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.093+0000 7f4453e00640 1 -- 172.21.15.37:0/1807233002 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f445401d020 con 0x7f445c102ab0 2024-08-20T05:06:13.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.096+0000 7f4453e00640 1 --2- 172.21.15.37:0/1807233002 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f44400b8060 0x7f44400ba520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:13.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.096+0000 7f4453e00640 1 -- 172.21.15.37:0/1807233002 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f44540e3f60 con 0x7f445c102ab0 2024-08-20T05:06:13.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.096+0000 7f445aa00640 1 --2- 172.21.15.37:0/1807233002 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f44400b8060 0x7f44400ba520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:13.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.097+0000 7f445aa00640 1 --2- 172.21.15.37:0/1807233002 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f44400b8060 0x7f44400ba520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f445c107b20 tx=0x7f4448005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:13.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.099+0000 7f4453e00640 1 -- 172.21.15.37:0/1807233002 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f44540ab1b0 con 0x7f445c102ab0 2024-08-20T05:06:13.255 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:06:13.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.580+0000 7f4462200640 1 -- 172.21.15.37:0/1807233002 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f445c1a3b60 con 0x7f445c102ab0 2024-08-20T05:06:13.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.581+0000 7f4453e00640 1 -- 172.21.15.37:0/1807233002 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11980 (secure 0 0 0) 0x7f44540aaab0 con 0x7f445c102ab0 2024-08-20T05:06:13.583 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:06:13.583 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"btime":"2024-08-20T05:06:06:678364+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:06:06.276613+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:06:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 36 2024-08-20T05:06:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.586+0000 7f4462200640 1 -- 172.21.15.37:0/1807233002 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f44400b8060 msgr2=0x7f44400ba520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.586+0000 7f4462200640 1 --2- 172.21.15.37:0/1807233002 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f44400b8060 0x7f44400ba520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f445c107b20 tx=0x7f4448005f90 comp rx=0 tx=0).stop 2024-08-20T05:06:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.586+0000 7f4462200640 1 -- 172.21.15.37:0/1807233002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f445c102ab0 msgr2=0x7f445c196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.586+0000 7f4462200640 1 --2- 172.21.15.37:0/1807233002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f445c102ab0 0x7f445c196d60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f445400c420 tx=0x7f4454009f90 comp rx=0 tx=0).stop 2024-08-20T05:06:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.586+0000 7f4462200640 1 -- 172.21.15.37:0/1807233002 shutdown_connections 2024-08-20T05:06:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.586+0000 7f4462200640 1 --2- 172.21.15.37:0/1807233002 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f44400b8060 0x7f44400ba520 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.586+0000 7f4462200640 1 --2- 172.21.15.37:0/1807233002 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f445c108e40 0x7f445c19c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.586+0000 7f4462200640 1 --2- 172.21.15.37:0/1807233002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f445c1084c0 0x7f445c1972a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.586+0000 7f4462200640 1 --2- 172.21.15.37:0/1807233002 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f445c102ab0 0x7f445c196d60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.586+0000 7f4462200640 1 -- 172.21.15.37:0/1807233002 >> 172.21.15.37:0/1807233002 conn(0x7f445c0fe500 msgr2=0x7f445c1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.587+0000 7f4462200640 1 -- 172.21.15.37:0/1807233002 shutdown_connections 2024-08-20T05:06:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:13.587+0000 7f4462200640 1 -- 172.21.15.37:0/1807233002 wait complete. 2024-08-20T05:06:13.934 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:13 smithi037 ceph-mon[17265]: pgmap v520: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.3 MiB/s wr, 202 op/s 2024-08-20T05:06:13.934 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:13 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1807233002' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:06:14.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:13 smithi135 ceph-mon[22342]: pgmap v520: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.3 MiB/s wr, 202 op/s 2024-08-20T05:06:14.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:13 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1807233002' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:06:14.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.154+0000 7f0f56200640 1 -- 172.21.15.37:0/488188897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f480b74c0 msgr2=0x7f0f480b98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:14.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.154+0000 7f0f56200640 1 --2- 172.21.15.37:0/488188897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f480b74c0 0x7f0f480b98b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0f50068ce0 tx=0x7f0f5008f220 comp rx=0 tx=0).stop 2024-08-20T05:06:14.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.154+0000 7f0f56200640 1 -- 172.21.15.37:0/488188897 shutdown_connections 2024-08-20T05:06:14.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.154+0000 7f0f56200640 1 --2- 172.21.15.37:0/488188897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f480b74c0 0x7f0f480b98b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.154+0000 7f0f56200640 1 --2- 172.21.15.37:0/488188897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f480a50c0 0x7f0f480b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.154+0000 7f0f56200640 1 --2- 172.21.15.37:0/488188897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f480a47a0 0x7f0f480a4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.154+0000 7f0f56200640 1 -- 172.21.15.37:0/488188897 >> 172.21.15.37:0/488188897 conn(0x7f0f4801a050 msgr2=0x7f0f4801c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:14.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.155+0000 7f0f56200640 1 -- 172.21.15.37:0/488188897 shutdown_connections 2024-08-20T05:06:14.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.155+0000 7f0f56200640 1 -- 172.21.15.37:0/488188897 wait complete. 2024-08-20T05:06:14.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.156+0000 7f0f56200640 1 Processor -- start 2024-08-20T05:06:14.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.157+0000 7f0f56200640 1 -- start start 2024-08-20T05:06:14.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.158+0000 7f0f56200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f480a47a0 0x7f0f481430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.159+0000 7f0f56200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f480a50c0 0x7f0f48143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.159+0000 7f0f56200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f481489b0 0x7f0f48148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.159+0000 7f0f56200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0f480bce00 con 0x7f0f480a47a0 2024-08-20T05:06:14.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.159+0000 7f0f56200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0f480bcc80 con 0x7f0f481489b0 2024-08-20T05:06:14.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.159+0000 7f0f56200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f480bcf80 con 0x7f0f480a50c0 2024-08-20T05:06:14.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.160+0000 7f0f55800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f481489b0 0x7f0f48148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:14.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.160+0000 7f0f55800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f481489b0 0x7f0f48148e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56416/0 (socket says 172.21.15.37:56416) 2024-08-20T05:06:14.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.160+0000 7f0f55800640 1 -- 172.21.15.37:0/641050168 learned_addr learned my addr 172.21.15.37:0/641050168 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:14.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.164+0000 7f0f55800640 1 -- 172.21.15.37:0/641050168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f480a50c0 msgr2=0x7f0f48143610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T05:06:14.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.164+0000 7f0f55800640 1 --2- 172.21.15.37:0/641050168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f480a50c0 0x7f0f48143610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.164+0000 7f0f55800640 1 -- 172.21.15.37:0/641050168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f480a47a0 msgr2=0x7f0f481430d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T05:06:14.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.164+0000 7f0f55800640 1 --2- 172.21.15.37:0/641050168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f480a47a0 0x7f0f481430d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.164+0000 7f0f55800640 1 -- 172.21.15.37:0/641050168 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f481495e0 con 0x7f0f481489b0 2024-08-20T05:06:14.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.165+0000 7f0f55800640 1 --2- 172.21.15.37:0/641050168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f481489b0 0x7f0f48148e60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0f50068b50 tx=0x7f0f50097e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:14.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.166+0000 7f0f4d600640 1 -- 172.21.15.37:0/641050168 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5008fd30 con 0x7f0f481489b0 2024-08-20T05:06:14.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.167+0000 7f0f4d600640 1 -- 172.21.15.37:0/641050168 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f50093050 con 0x7f0f481489b0 2024-08-20T05:06:14.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.167+0000 7f0f56200640 1 -- 172.21.15.37:0/641050168 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4814fb30 con 0x7f0f481489b0 2024-08-20T05:06:14.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.167+0000 7f0f56200640 1 -- 172.21.15.37:0/641050168 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f4814ff20 con 0x7f0f481489b0 2024-08-20T05:06:14.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.167+0000 7f0f4d600640 1 -- 172.21.15.37:0/641050168 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f50098830 con 0x7f0f481489b0 2024-08-20T05:06:14.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.179+0000 7f0f4d600640 1 -- 172.21.15.37:0/641050168 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0f50091650 con 0x7f0f481489b0 2024-08-20T05:06:14.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.181+0000 7f0f5a240740 1 Processor -- start 2024-08-20T05:06:14.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.181+0000 7f0f5a240740 1 -- start start 2024-08-20T05:06:14.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.182+0000 7f0f5a240740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56860bb00 0x55b56860bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.183+0000 7f0f5a240740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b56860c420 0x55b568617e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.183+0000 7f0f4fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56860bb00 0x55b56860bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:14.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.183+0000 7f0f4fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56860bb00 0x55b56860bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:37910/0 (socket says 172.21.15.37:37910) 2024-08-20T05:06:14.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.184+0000 7f0f4fe00640 1 -- 172.21.15.37:0/473629553 learned_addr learned my addr 172.21.15.37:0/473629553 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:14.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.184+0000 7f0f5a240740 1 --2- 172.21.15.37:0/473629553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b5686183b0 0x55b56861a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.184+0000 7f0f5a240740 1 -- 172.21.15.37:0/473629553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b568581aa0 con 0x55b56860c420 2024-08-20T05:06:14.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.184+0000 7f0f5a240740 1 -- 172.21.15.37:0/473629553 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b568570fa0 con 0x55b5686183b0 2024-08-20T05:06:14.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.184+0000 7f0f5a240740 1 -- 172.21.15.37:0/473629553 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b568574fe0 con 0x55b56860bb00 2024-08-20T05:06:14.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.185+0000 7f0f54e00640 1 --2- 172.21.15.37:0/473629553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b56860c420 0x55b568617e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:14.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.185+0000 7f0f4fe00640 1 --2- 172.21.15.37:0/473629553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b5686183b0 0x55b56861a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:14.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.186+0000 7f0f4d600640 1 --2- 172.21.15.37:0/641050168 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0f380b3c80 0x7f0f380b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.187+0000 7f0f4fe00640 1 -- 172.21.15.37:0/473629553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b5686183b0 msgr2=0x55b56861a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.187+0000 7f0f4fe00640 1 --2- 172.21.15.37:0/473629553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b5686183b0 0x55b56861a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.187+0000 7f0f4fe00640 1 -- 172.21.15.37:0/473629553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b56860c420 msgr2=0x55b568617e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.187+0000 7f0f4fe00640 1 --2- 172.21.15.37:0/473629553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b56860c420 0x55b568617e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.187+0000 7f0f4fe00640 1 -- 172.21.15.37:0/473629553 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b568517420 con 0x55b56860bb00 2024-08-20T05:06:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.188+0000 7f0f4d600640 1 -- 172.21.15.37:0/641050168 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0f5016b170 con 0x7f0f481489b0 2024-08-20T05:06:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.188+0000 7f0f55800640 1 --2- 172.21.15.37:0/641050168 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0f380b3c80 0x7f0f380b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.188+0000 7f0f54e00640 1 --2- 172.21.15.37:0/473629553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b56860c420 0x55b568617e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:06:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.188+0000 7f0f4fe00640 1 --2- 172.21.15.37:0/473629553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56860bb00 0x55b56860bee0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009f20 tx=0x7f0f3c009870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=739ae0082b6a9923 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.189+0000 7f0f42000640 1 -- 172.21.15.37:0/473629553 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c018030 con 0x55b56860bb00 2024-08-20T05:06:14.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.190+0000 7f0f55800640 1 --2- 172.21.15.37:0/641050168 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0f380b3c80 0x7f0f380b6140 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0f5012e630 tx=0x7f0f5008f220 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:14.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.191+0000 7f0f42000640 1 -- 172.21.15.37:0/473629553 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f3c0054d0 con 0x55b56860bb00 2024-08-20T05:06:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.192+0000 7f0f5a240740 1 -- 172.21.15.37:0/473629553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56860bb00 msgr2=0x55b56860bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.192+0000 7f0f5a240740 1 --2- 172.21.15.37:0/473629553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56860bb00 0x55b56860bee0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009f20 tx=0x7f0f3c009870 comp rx=0 tx=0).stop 2024-08-20T05:06:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.192+0000 7f0f5a240740 1 -- 172.21.15.37:0/473629553 shutdown_connections 2024-08-20T05:06:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.192+0000 7f0f5a240740 1 --2- 172.21.15.37:0/473629553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b5686183b0 0x55b56861a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.192+0000 7f0f5a240740 1 --2- 172.21.15.37:0/473629553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b56860c420 0x55b568617e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.192+0000 7f0f5a240740 1 --2- 172.21.15.37:0/473629553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56860bb00 0x55b56860bee0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.192+0000 7f0f5a240740 1 -- 172.21.15.37:0/473629553 >> 172.21.15.37:0/473629553 conn(0x55b568609930 msgr2=0x55b56860aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.193+0000 7f0f5a240740 1 -- 172.21.15.37:0/473629553 shutdown_connections 2024-08-20T05:06:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.193+0000 7f0f5a240740 1 -- 172.21.15.37:0/473629553 wait complete. 2024-08-20T05:06:14.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.194+0000 7f0f5a240740 1 -- start start 2024-08-20T05:06:14.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.194+0000 7f0f5a240740 1 Processor -- start 2024-08-20T05:06:14.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.195+0000 7f0f5a240740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860bb00 0x55b568617ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.196+0000 7f0f5a240740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56860c420 0x55b568614f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.196+0000 7f0f5a240740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5686183b0 0x55b568615470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.196+0000 7f0f5a240740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b5683d3700 con 0x55b5686183b0 2024-08-20T05:06:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.196+0000 7f0f5a240740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b56850c290 con 0x55b56860bb00 2024-08-20T05:06:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.196+0000 7f0f5a240740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b56861b0d0 con 0x55b56860c420 2024-08-20T05:06:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.196+0000 7f0f5a240740 10 client.0 _ll_register_callbacks cb 0x55b56856b1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.196+0000 7f0f4fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860bb00 0x55b568617ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.196+0000 7f0f4fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860bb00 0x55b568617ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56432/0 (socket says 172.21.15.37:56432) 2024-08-20T05:06:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.196+0000 7f0f4fe00640 1 -- 172.21.15.37:0/2535959611 learned_addr learned my addr 172.21.15.37:0/2535959611 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.196+0000 7f0f54e00640 1 --2- 172.21.15.37:0/2535959611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56860c420 0x55b568614f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.197+0000 7f0f4fe00640 1 --2- 172.21.15.37:0/2535959611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5686183b0 0x55b568615470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.197+0000 7f0f4fe00640 1 -- 172.21.15.37:0/2535959611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56860c420 msgr2=0x55b568614f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.197+0000 7f0f4fe00640 1 --2- 172.21.15.37:0/2535959611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56860c420 0x55b568614f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.197+0000 7f0f4fe00640 1 -- 172.21.15.37:0/2535959611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5686183b0 msgr2=0x55b568615470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.197+0000 7f0f4fe00640 1 --2- 172.21.15.37:0/2535959611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5686183b0 0x55b568615470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.198+0000 7f0f4fe00640 1 -- 172.21.15.37:0/2535959611 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5682d0650 con 0x55b56860bb00 2024-08-20T05:06:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.198+0000 7f0f54e00640 1 --2- 172.21.15.37:0/2535959611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56860c420 0x55b568614f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.198+0000 7f0f4fe00640 1 --2- 172.21.15.37:0/2535959611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860bb00 0x55b568617ae0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0058c0 tx=0x7f0f3c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73570b0de1d31a9a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.198+0000 7f0f36a00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:06:14.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.199+0000 7f0f36a00640 1 -- 172.21.15.37:0/2535959611 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c014070 con 0x55b56860bb00 2024-08-20T05:06:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.199+0000 7f0f36a00640 1 -- 172.21.15.37:0/2535959611 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0f3c004680 con 0x55b56860bb00 2024-08-20T05:06:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.199+0000 7f0f5a240740 1 -- 172.21.15.37:0/2535959611 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f3c0054d0 con 0x55b56860bb00 2024-08-20T05:06:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.200+0000 7f0f36a00640 1 -- 172.21.15.37:0/2535959611 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0f3c02d050 con 0x55b56860bb00 2024-08-20T05:06:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.200+0000 7f0f5a240740 10 client.26549 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.200+0000 7f0f5a240740 1 -- 172.21.15.37:0/2535959611 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b5686268a0 con 0x55b56860bb00 2024-08-20T05:06:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.201+0000 7f0f36a00640 1 -- 172.21.15.37:0/2535959611 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f3c0054d0 con 0x55b56860bb00 2024-08-20T05:06:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.201+0000 7f0f36a00640 1 -- 172.21.15.37:0/2535959611 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f0f3c01d510 con 0x55b56860bb00 2024-08-20T05:06:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.202+0000 7f0f5a240740 10 client.26549 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.202+0000 7f0f5a240740 10 client.26549 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:06:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.202+0000 7f0f5a240740 20 client.26549 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.202+0000 7f0f5a240740 1 --2- 172.21.15.37:0/2535959611 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55b568627bf0 0x55b568629fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.202+0000 7f0f5a240740 4 client.26549 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:06:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.202+0000 7f0f5a240740 1 -- 172.21.15.37:0/2535959611 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5685839f0 con 0x55b568627bf0 2024-08-20T05:06:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.203+0000 7f0f54e00640 1 --2- 172.21.15.37:0/2535959611 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55b568627bf0 0x55b568629fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:14.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:13 smithi130 ceph-mon[22007]: pgmap v520: 129 pgs: 129 active+clean; 1.0 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.3 MiB/s wr, 202 op/s 2024-08-20T05:06:14.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:13 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1807233002' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:06:14.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.204+0000 7f0f54e00640 1 --2- 172.21.15.37:0/2535959611 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55b568627bf0 0x55b568629fe0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9e9be1bd9dd1a94 server_cookie=61bb568a1d714e62 in_seq=0 out_seq=0 2024-08-20T05:06:14.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.204+0000 7f0f36a00640 10 client.26549 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:06:14.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.205+0000 7f0f36a00640 1 -- 172.21.15.37:0/2535959611 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5685839f0 con 0x55b568627bf0 2024-08-20T05:06:14.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.205+0000 7f0f36a00640 10 client.26549 handle_command_reply: tid=0 2024-08-20T05:06:14.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.205+0000 7f0f5a240740 1 client.26549 shutdown 2024-08-20T05:06:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.206+0000 7f0f5a240740 1 -- 172.21.15.37:0/2535959611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860bb00 msgr2=0x55b568617ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.206+0000 7f0f5a240740 1 --2- 172.21.15.37:0/2535959611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860bb00 0x55b568617ae0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0058c0 tx=0x7f0f3c005f90 comp rx=0 tx=0).stop 2024-08-20T05:06:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.206+0000 7f0f5a240740 1 -- 172.21.15.37:0/2535959611 shutdown_connections 2024-08-20T05:06:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.206+0000 7f0f5a240740 1 --2- 172.21.15.37:0/2535959611 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55b568627bf0 0x55b568629fe0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.206+0000 7f0f5a240740 1 --2- 172.21.15.37:0/2535959611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5686183b0 0x55b568615470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.206+0000 7f0f36a00640 0 client.26549 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:06:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.206+0000 7f0f5a240740 1 --2- 172.21.15.37:0/2535959611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56860c420 0x55b568614f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.206+0000 7f0f5a240740 1 --2- 172.21.15.37:0/2535959611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860bb00 0x55b568617ae0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.206+0000 7f0f5a240740 1 -- 172.21.15.37:0/2535959611 >> 172.21.15.37:0/2535959611 conn(0x55b568609930 msgr2=0x55b56860f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:14.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.207+0000 7f0f5a240740 1 -- 172.21.15.37:0/2535959611 shutdown_connections 2024-08-20T05:06:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.207+0000 7f0f5a240740 1 -- 172.21.15.37:0/2535959611 wait complete. 2024-08-20T05:06:14.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.208+0000 7f0f5a240740 20 client.26549 trim_cache size 0 max 16384 2024-08-20T05:06:14.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.242+0000 7f0f5a240740 1 Processor -- start 2024-08-20T05:06:14.243 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.242+0000 7f0f5a240740 1 -- start start 2024-08-20T05:06:14.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.243+0000 7f0f5a240740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860c420 0x55b56860a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.243+0000 7f0f5a240740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5686183b0 0x55b56862f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.243+0000 7f0f5a240740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56862fac0 0x55b568612140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.243+0000 7f0f5a240740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48159e70 con 0x55b5686183b0 2024-08-20T05:06:14.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.243+0000 7f0f5a240740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4815b9b0 con 0x55b56860c420 2024-08-20T05:06:14.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.243+0000 7f0f5a240740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4815a540 con 0x55b56862fac0 2024-08-20T05:06:14.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.244+0000 7f0f4fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860c420 0x55b56860a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:14.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.244+0000 7f0f54e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5686183b0 0x55b56862f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:14.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.244+0000 7f0f54e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5686183b0 0x55b56862f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40670/0 (socket says 172.21.15.37:40670) 2024-08-20T05:06:14.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.244+0000 7f0f54e00640 1 -- 172.21.15.37:0/2469178298 learned_addr learned my addr 172.21.15.37:0/2469178298 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.244+0000 7f0f4fe00640 1 --2- 172.21.15.37:0/2469178298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56862fac0 0x55b568612140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.245+0000 7f0f4fe00640 1 -- 172.21.15.37:0/2469178298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56862fac0 msgr2=0x55b568612140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.245+0000 7f0f4fe00640 1 --2- 172.21.15.37:0/2469178298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56862fac0 0x55b568612140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.246+0000 7f0f4fe00640 1 -- 172.21.15.37:0/2469178298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5686183b0 msgr2=0x55b56862f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:14.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.246+0000 7f0f4fe00640 1 --2- 172.21.15.37:0/2469178298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5686183b0 0x55b56862f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.246+0000 7f0f4fe00640 1 -- 172.21.15.37:0/2469178298 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b568613e90 con 0x55b56860c420 2024-08-20T05:06:14.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.246+0000 7f0f54e00640 1 --2- 172.21.15.37:0/2469178298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5686183b0 0x55b56862f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:14.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.247+0000 7f0f4fe00640 1 --2- 172.21.15.37:0/2469178298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860c420 0x55b56860a9f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c01dad0 tx=0x7f0f3c005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c37a923c3a4bf6a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:14.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.247+0000 7f0f41600640 1 -- 172.21.15.37:0/2469178298 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c014070 con 0x55b56860c420 2024-08-20T05:06:14.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.248+0000 7f0f41600640 1 -- 172.21.15.37:0/2469178298 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f3c019040 con 0x55b56860c420 2024-08-20T05:06:14.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.248+0000 7f0f41600640 1 -- 172.21.15.37:0/2469178298 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c018070 con 0x55b56860c420 2024-08-20T05:06:14.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.249+0000 7f0f5a240740 1 -- 172.21.15.37:0/2469178298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860c420 msgr2=0x55b56860a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:14.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.249+0000 7f0f5a240740 1 --2- 172.21.15.37:0/2469178298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860c420 0x55b56860a9f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c01dad0 tx=0x7f0f3c005850 comp rx=0 tx=0).stop 2024-08-20T05:06:14.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.249+0000 7f0f5a240740 1 -- 172.21.15.37:0/2469178298 shutdown_connections 2024-08-20T05:06:14.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.249+0000 7f0f5a240740 1 --2- 172.21.15.37:0/2469178298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56862fac0 0x55b568612140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.249+0000 7f0f5a240740 1 --2- 172.21.15.37:0/2469178298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5686183b0 0x55b56862f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.249+0000 7f0f5a240740 1 --2- 172.21.15.37:0/2469178298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860c420 0x55b56860a9f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.249+0000 7f0f5a240740 1 -- 172.21.15.37:0/2469178298 >> 172.21.15.37:0/2469178298 conn(0x55b568609930 msgr2=0x55b568616d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:14.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.250+0000 7f0f5a240740 1 -- 172.21.15.37:0/2469178298 shutdown_connections 2024-08-20T05:06:14.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.250+0000 7f0f5a240740 1 -- 172.21.15.37:0/2469178298 wait complete. 2024-08-20T05:06:14.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.251+0000 7f0f5a240740 1 -- start start 2024-08-20T05:06:14.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.251+0000 7f0f5a240740 1 Processor -- start 2024-08-20T05:06:14.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.252+0000 7f0f5a240740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860c420 0x55b56861e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.252+0000 7f0f5a240740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5686183b0 0x55b56861eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.252+0000 7f0f5a240740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56862fac0 0x55b568691560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.252+0000 7f0f5a240740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4815b2e0 con 0x55b5686183b0 2024-08-20T05:06:14.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.252+0000 7f0f5a240740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0f4815ac10 con 0x55b56860c420 2024-08-20T05:06:14.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.252+0000 7f0f5a240740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48157e50 con 0x55b56862fac0 2024-08-20T05:06:14.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.252+0000 7f0f5a240740 10 client.0 _ll_register_callbacks cb 0x7f0f3c009dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:14.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.252+0000 7f0f4fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860c420 0x55b56861e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:14.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.252+0000 7f0f4fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860c420 0x55b56861e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56446/0 (socket says 172.21.15.37:56446) 2024-08-20T05:06:14.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.252+0000 7f0f4fe00640 1 -- 172.21.15.37:0/274956326 learned_addr learned my addr 172.21.15.37:0/274956326 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:14.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.252+0000 7f0f4fe00640 1 --2- 172.21.15.37:0/274956326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56862fac0 0x55b568691560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:14.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.256+0000 7f0f54e00640 1 --2- 172.21.15.37:0/274956326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5686183b0 0x55b56861eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:14.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.256+0000 7f0f4fe00640 1 -- 172.21.15.37:0/274956326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56862fac0 msgr2=0x55b568691560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:14.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.256+0000 7f0f4fe00640 1 --2- 172.21.15.37:0/274956326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56862fac0 0x55b568691560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.256+0000 7f0f4fe00640 1 -- 172.21.15.37:0/274956326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5686183b0 msgr2=0x55b56861eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:14.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.256+0000 7f0f4fe00640 1 --2- 172.21.15.37:0/274956326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5686183b0 0x55b56861eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.257+0000 7f0f4fe00640 1 -- 172.21.15.37:0/274956326 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b568617e50 con 0x55b56860c420 2024-08-20T05:06:14.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.259+0000 7f0f4fe00640 1 --2- 172.21.15.37:0/274956326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860c420 0x55b56861e5e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c005430 tx=0x7f0f3c0097d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=394ddfaf69fa354f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:14.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.259+0000 7f0f36a00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:06:14.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.261+0000 7f0f36a00640 1 -- 172.21.15.37:0/274956326 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c018070 con 0x55b56860c420 2024-08-20T05:06:14.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.261+0000 7f0f36a00640 1 -- 172.21.15.37:0/274956326 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0f3c004480 con 0x55b56860c420 2024-08-20T05:06:14.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.263+0000 7f0f5a240740 1 -- 172.21.15.37:0/274956326 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f3c019040 con 0x55b56860c420 2024-08-20T05:06:14.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.264+0000 7f0f36a00640 1 -- 172.21.15.37:0/274956326 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0f3c014040 con 0x55b56860c420 2024-08-20T05:06:14.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.264+0000 7f0f5a240740 10 client.26555 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:14.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.264+0000 7f0f5a240740 1 -- 172.21.15.37:0/274956326 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b56860c250 con 0x55b56860c420 2024-08-20T05:06:14.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.265+0000 7f0f36a00640 1 -- 172.21.15.37:0/274956326 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f3c019040 con 0x55b56860c420 2024-08-20T05:06:14.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.265+0000 7f0f36a00640 1 -- 172.21.15.37:0/274956326 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f0f3c003b70 con 0x55b56860c420 2024-08-20T05:06:14.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.265+0000 7f0f5a240740 10 client.26555 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:14.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.265+0000 7f0f5a240740 10 client.26555 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:06:14.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.266+0000 7f0f5a240740 20 client.26555 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:14.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.266+0000 7f0f5a240740 1 --2- 172.21.15.37:0/274956326 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55b568692e50 0x55b568695270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:14.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.266+0000 7f0f5a240740 4 client.26555 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:06:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.267+0000 7f0f5a240740 1 -- 172.21.15.37:0/274956326 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b56857f490 con 0x55b568692e50 2024-08-20T05:06:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.266+0000 7f0f54e00640 1 --2- 172.21.15.37:0/274956326 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55b568692e50 0x55b568695270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.269+0000 7f0f54e00640 1 --2- 172.21.15.37:0/274956326 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55b568692e50 0x55b568695270 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=600694de20164cea server_cookie=8e3b01cccefcc9b2 in_seq=0 out_seq=0 2024-08-20T05:06:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.269+0000 7f0f36a00640 10 client.26555 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:06:14.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.270+0000 7f0f36a00640 1 -- 172.21.15.37:0/274956326 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b56857f490 con 0x55b568692e50 2024-08-20T05:06:14.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.270+0000 7f0f36a00640 10 client.26555 handle_command_reply: tid=0 2024-08-20T05:06:14.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.270+0000 7f0f5a240740 1 client.26555 shutdown 2024-08-20T05:06:14.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.271+0000 7f0f5a240740 1 -- 172.21.15.37:0/274956326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860c420 msgr2=0x55b56861e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:14.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.271+0000 7f0f5a240740 1 --2- 172.21.15.37:0/274956326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860c420 0x55b56861e5e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c005430 tx=0x7f0f3c0097d0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.271+0000 7f0f5a240740 1 -- 172.21.15.37:0/274956326 shutdown_connections 2024-08-20T05:06:14.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.271+0000 7f0f5a240740 1 --2- 172.21.15.37:0/274956326 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55b568692e50 0x55b568695270 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.271+0000 7f0f5a240740 1 --2- 172.21.15.37:0/274956326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b56862fac0 0x55b568691560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.271+0000 7f0f5a240740 1 --2- 172.21.15.37:0/274956326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b5686183b0 0x55b56861eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.271+0000 7f0f5a240740 1 --2- 172.21.15.37:0/274956326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b56860c420 0x55b56861e5e0 secure :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c005430 tx=0x7f0f3c0097d0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.271+0000 7f0f5a240740 1 -- 172.21.15.37:0/274956326 >> 172.21.15.37:0/274956326 conn(0x55b568609930 msgr2=0x55b5686082b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:14.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.271+0000 7f0f36a00640 0 client.26555 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:06:14.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.272+0000 7f0f5a240740 1 -- 172.21.15.37:0/274956326 shutdown_connections 2024-08-20T05:06:14.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.272+0000 7f0f5a240740 1 -- 172.21.15.37:0/274956326 wait complete. 2024-08-20T05:06:14.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.272+0000 7f0f5a240740 20 client.26555 trim_cache size 0 max 16384 2024-08-20T05:06:14.274 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:06:14.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.273+0000 7f0f56200640 1 -- 172.21.15.37:0/641050168 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0f380b3c80 msgr2=0x7f0f380b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:14.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.273+0000 7f0f56200640 1 --2- 172.21.15.37:0/641050168 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0f380b3c80 0x7f0f380b6140 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0f5012e630 tx=0x7f0f5008f220 comp rx=0 tx=0).stop 2024-08-20T05:06:14.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.273+0000 7f0f56200640 1 -- 172.21.15.37:0/641050168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f481489b0 msgr2=0x7f0f48148e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:14.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.273+0000 7f0f56200640 1 --2- 172.21.15.37:0/641050168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f481489b0 0x7f0f48148e60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0f50068b50 tx=0x7f0f50097e60 comp rx=0 tx=0).stop 2024-08-20T05:06:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.274+0000 7f0f56200640 1 -- 172.21.15.37:0/641050168 shutdown_connections 2024-08-20T05:06:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.274+0000 7f0f56200640 1 --2- 172.21.15.37:0/641050168 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0f380b3c80 0x7f0f380b6140 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.274+0000 7f0f56200640 1 --2- 172.21.15.37:0/641050168 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0f481489b0 0x7f0f48148e60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.274+0000 7f0f56200640 1 --2- 172.21.15.37:0/641050168 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0f480a50c0 0x7f0f48143610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.274+0000 7f0f56200640 1 --2- 172.21.15.37:0/641050168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f480a47a0 0x7f0f481430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.274+0000 7f0f56200640 1 -- 172.21.15.37:0/641050168 >> 172.21.15.37:0/641050168 conn(0x7f0f4801a050 msgr2=0x7f0f480a2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:14.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.275+0000 7f0f56200640 1 -- 172.21.15.37:0/641050168 shutdown_connections 2024-08-20T05:06:14.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:14.275+0000 7f0f56200640 1 -- 172.21.15.37:0/641050168 wait complete. 2024-08-20T05:06:14.864 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 139.85 --await-for 45.0' 2024-08-20T05:06:14.864 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 139.85 --await-for 45.0 2024-08-20T05:06:15.696 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T05:06:15.911 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:06:16.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:15 smithi037 ceph-mon[17265]: pgmap v521: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.4 MiB/s wr, 220 op/s 2024-08-20T05:06:16.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:15 smithi135 ceph-mon[22342]: pgmap v521: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.4 MiB/s wr, 220 op/s 2024-08-20T05:06:16.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:15 smithi130 ceph-mon[22007]: pgmap v521: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.4 MiB/s wr, 220 op/s 2024-08-20T05:06:17.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.301+0000 7fc135200640 1 -- 172.21.15.37:0/2724492198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1301084c0 msgr2=0x7fc130108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:17.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.301+0000 7fc135200640 1 --2- 172.21.15.37:0/2724492198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1301084c0 0x7fc130108900 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009900 tx=0x7fc11c02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.301+0000 7fc135200640 1 -- 172.21.15.37:0/2724492198 shutdown_connections 2024-08-20T05:06:17.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.301+0000 7fc135200640 1 --2- 172.21.15.37:0/2724492198 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc130108e40 0x7fc13010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.301+0000 7fc135200640 1 --2- 172.21.15.37:0/2724492198 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc1301084c0 0x7fc130108900 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.301+0000 7fc135200640 1 --2- 172.21.15.37:0/2724492198 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc130102ab0 0x7fc130102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.301+0000 7fc135200640 1 -- 172.21.15.37:0/2724492198 >> 172.21.15.37:0/2724492198 conn(0x7fc1300fe500 msgr2=0x7fc130100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:17.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.301+0000 7fc135200640 1 -- 172.21.15.37:0/2724492198 shutdown_connections 2024-08-20T05:06:17.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.302+0000 7fc135200640 1 -- 172.21.15.37:0/2724492198 wait complete. 2024-08-20T05:06:17.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.303+0000 7fc135200640 1 Processor -- start 2024-08-20T05:06:17.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.304+0000 7fc135200640 1 -- start start 2024-08-20T05:06:17.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.305+0000 7fc135200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc130102ab0 0x7fc13010e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.306+0000 7fc135200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1301084c0 0x7fc13010eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.306+0000 7fc135200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc130108e40 0x7fc1301a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.306+0000 7fc135200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc130112ae0 con 0x7fc1301084c0 2024-08-20T05:06:17.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.306+0000 7fc135200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc130112960 con 0x7fc130102ab0 2024-08-20T05:06:17.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.306+0000 7fc135200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc130112c60 con 0x7fc130108e40 2024-08-20T05:06:17.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.306+0000 7fc12de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc130102ab0 0x7fc13010e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:17.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.306+0000 7fc12de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc130102ab0 0x7fc13010e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56462/0 (socket says 172.21.15.37:56462) 2024-08-20T05:06:17.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.306+0000 7fc12de00640 1 -- 172.21.15.37:0/1093433724 learned_addr learned my addr 172.21.15.37:0/1093433724 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:17.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.307+0000 7fc12d400640 1 --2- 172.21.15.37:0/1093433724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1301084c0 0x7fc13010eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:17.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.307+0000 7fc12e800640 1 --2- 172.21.15.37:0/1093433724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc130108e40 0x7fc1301a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:17.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.307+0000 7fc12de00640 1 -- 172.21.15.37:0/1093433724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc130108e40 msgr2=0x7fc1301a4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:17.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.307+0000 7fc12de00640 1 --2- 172.21.15.37:0/1093433724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc130108e40 0x7fc1301a4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.307+0000 7fc12de00640 1 -- 172.21.15.37:0/1093433724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1301084c0 msgr2=0x7fc13010eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:17.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.307+0000 7fc12de00640 1 --2- 172.21.15.37:0/1093433724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1301084c0 0x7fc13010eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.307+0000 7fc12de00640 1 -- 172.21.15.37:0/1093433724 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1301a5630 con 0x7fc130102ab0 2024-08-20T05:06:17.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.308+0000 7fc12d400640 1 --2- 172.21.15.37:0/1093433724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1301084c0 0x7fc13010eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:06:17.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.308+0000 7fc12e800640 1 --2- 172.21.15.37:0/1093433724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc130108e40 0x7fc1301a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:06:17.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.309+0000 7fc12de00640 1 --2- 172.21.15.37:0/1093433724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc130102ab0 0x7fc13010e980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc12000ea60 tx=0x7fc12000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:17.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.309+0000 7fc126a00640 1 -- 172.21.15.37:0/1093433724 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12000cde0 con 0x7fc130102ab0 2024-08-20T05:06:17.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.309+0000 7fc135200640 1 -- 172.21.15.37:0/1093433724 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1301a5920 con 0x7fc130102ab0 2024-08-20T05:06:17.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.310+0000 7fc135200640 1 -- 172.21.15.37:0/1093433724 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1301ac1b0 con 0x7fc130102ab0 2024-08-20T05:06:17.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.310+0000 7fc126a00640 1 -- 172.21.15.37:0/1093433724 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1200035f0 con 0x7fc130102ab0 2024-08-20T05:06:17.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.310+0000 7fc126a00640 1 -- 172.21.15.37:0/1093433724 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12000cde0 con 0x7fc130102ab0 2024-08-20T05:06:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.321+0000 7fc137e63740 1 Processor -- start 2024-08-20T05:06:17.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.321+0000 7fc137e63740 1 -- start start 2024-08-20T05:06:17.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.322+0000 7fc137e63740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fec0e40 0x55b78fec1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.322+0000 7fc137e63740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec1760 0x55b78fecd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.322+0000 7fc137e63740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fecd6f0 0x55b78fecfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.322+0000 7fc137e63740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b78fe36600 con 0x55b78fecd6f0 2024-08-20T05:06:17.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.322+0000 7fc137e63740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b78fe25b00 con 0x55b78fec0e40 2024-08-20T05:06:17.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.322+0000 7fc137e63740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b78fe29b40 con 0x55b78fec1760 2024-08-20T05:06:17.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.323+0000 7fc12de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec1760 0x55b78fecd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:17.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.324+0000 7fc12e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fec0e40 0x55b78fec1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:17.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.324+0000 7fc12e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fec0e40 0x55b78fec1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56468/0 (socket says 172.21.15.37:56468) 2024-08-20T05:06:17.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.324+0000 7fc12e800640 1 -- 172.21.15.37:0/935937171 learned_addr learned my addr 172.21.15.37:0/935937171 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:17.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.324+0000 7fc126a00640 1 -- 172.21.15.37:0/1093433724 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc120018430 con 0x7fc130102ab0 2024-08-20T05:06:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.325+0000 7fc12d400640 1 --2- 172.21.15.37:0/935937171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fecd6f0 0x55b78fecfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.325+0000 7fc12e800640 1 -- 172.21.15.37:0/935937171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec1760 msgr2=0x55b78fecd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:17.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.325+0000 7fc12e800640 1 --2- 172.21.15.37:0/935937171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec1760 0x55b78fecd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.325+0000 7fc12e800640 1 -- 172.21.15.37:0/935937171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fecd6f0 msgr2=0x55b78fecfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:17.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.325+0000 7fc12e800640 1 --2- 172.21.15.37:0/935937171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fecd6f0 0x55b78fecfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.326+0000 7fc12e800640 1 -- 172.21.15.37:0/935937171 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b78fdcbee0 con 0x55b78fec0e40 2024-08-20T05:06:17.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.327+0000 7fc126a00640 1 --2- 172.21.15.37:0/1093433724 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc1140b3f00 0x7fc1140b63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.327+0000 7fc126a00640 1 -- 172.21.15.37:0/1093433724 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc1200e4000 con 0x7fc130102ab0 2024-08-20T05:06:17.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.329+0000 7fc12e800640 1 --2- 172.21.15.37:0/935937171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fec0e40 0x55b78fec1220 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc128009fb0 tx=0x7fc128010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36b2c36549aaec4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:17.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.329+0000 7fc11b400640 1 -- 172.21.15.37:0/935937171 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128016070 con 0x55b78fec0e40 2024-08-20T05:06:17.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.329+0000 7fc11b400640 1 -- 172.21.15.37:0/935937171 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc128012bc0 con 0x55b78fec0e40 2024-08-20T05:06:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.330+0000 7fc11b400640 1 -- 172.21.15.37:0/935937171 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128011ba0 con 0x55b78fec0e40 2024-08-20T05:06:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.330+0000 7fc12de00640 1 --2- 172.21.15.37:0/1093433724 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc1140b3f00 0x7fc1140b63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.334+0000 7fc137e63740 1 -- 172.21.15.37:0/935937171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fec0e40 msgr2=0x55b78fec1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.334+0000 7fc137e63740 1 --2- 172.21.15.37:0/935937171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fec0e40 0x55b78fec1220 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc128009fb0 tx=0x7fc128010800 comp rx=0 tx=0).stop 2024-08-20T05:06:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.335+0000 7fc137e63740 1 -- 172.21.15.37:0/935937171 shutdown_connections 2024-08-20T05:06:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.335+0000 7fc137e63740 1 --2- 172.21.15.37:0/935937171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fecd6f0 0x55b78fecfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.335+0000 7fc137e63740 1 --2- 172.21.15.37:0/935937171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec1760 0x55b78fecd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.335+0000 7fc137e63740 1 --2- 172.21.15.37:0/935937171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fec0e40 0x55b78fec1220 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.335+0000 7fc137e63740 1 -- 172.21.15.37:0/935937171 >> 172.21.15.37:0/935937171 conn(0x55b78febec70 msgr2=0x55b78febfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:17.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.335+0000 7fc12de00640 1 --2- 172.21.15.37:0/1093433724 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc1140b3f00 0x7fc1140b63c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc1200aba40 tx=0x7fc1200e79c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:17.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.336+0000 7fc137e63740 1 -- 172.21.15.37:0/935937171 shutdown_connections 2024-08-20T05:06:17.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.336+0000 7fc137e63740 1 -- 172.21.15.37:0/935937171 wait complete. 2024-08-20T05:06:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.338+0000 7fc137e63740 1 -- start start 2024-08-20T05:06:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.339+0000 7fc137e63740 1 Processor -- start 2024-08-20T05:06:17.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.339+0000 7fc137e63740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fec0e40 0x55b78feca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.341+0000 7fc137e63740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec1760 0x55b78fecabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.341+0000 7fc137e63740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fecd6f0 0x55b78fecb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.341+0000 7fc137e63740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b78fc887b0 con 0x55b78fec0e40 2024-08-20T05:06:17.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.341+0000 7fc137e63740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b78fdc0dd0 con 0x55b78fecd6f0 2024-08-20T05:06:17.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.341+0000 7fc137e63740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b78fee1380 con 0x55b78fec1760 2024-08-20T05:06:17.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.341+0000 7fc137e63740 10 client.0 _ll_register_callbacks cb 0x55b78fb320a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:17.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.341+0000 7fc12e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fecd6f0 0x55b78fecb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:17.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.342+0000 7fc12e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fecd6f0 0x55b78fecb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56478/0 (socket says 172.21.15.37:56478) 2024-08-20T05:06:17.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.342+0000 7fc12e800640 1 -- 172.21.15.37:0/2392578067 learned_addr learned my addr 172.21.15.37:0/2392578067 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:17.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.342+0000 7fc12d400640 1 --2- 172.21.15.37:0/2392578067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec1760 0x55b78fecabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:17.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.342+0000 7fc12e800640 1 -- 172.21.15.37:0/2392578067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec1760 msgr2=0x55b78fecabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:17.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.342+0000 7fc12e800640 1 --2- 172.21.15.37:0/2392578067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec1760 0x55b78fecabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.343+0000 7fc12e800640 1 -- 172.21.15.37:0/2392578067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fec0e40 msgr2=0x55b78feca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:17.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.343+0000 7fc12e800640 1 --2- 172.21.15.37:0/2392578067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fec0e40 0x55b78feca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.343+0000 7fc12e800640 1 -- 172.21.15.37:0/2392578067 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b78fb94ba0 con 0x55b78fecd6f0 2024-08-20T05:06:17.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.343+0000 7fc12e800640 1 --2- 172.21.15.37:0/2392578067 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fecd6f0 0x55b78fecb130 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc128005c20 tx=0x7fc1280114b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f67941cb4bc19a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:17.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.343+0000 7fc10fe00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:06:17.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.344+0000 7fc10fe00640 1 -- 172.21.15.37:0/2392578067 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128016070 con 0x55b78fecd6f0 2024-08-20T05:06:17.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.344+0000 7fc10fe00640 1 -- 172.21.15.37:0/2392578067 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc128004a40 con 0x55b78fecd6f0 2024-08-20T05:06:17.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.345+0000 7fc137e63740 1 -- 172.21.15.37:0/2392578067 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc128012bc0 con 0x55b78fecd6f0 2024-08-20T05:06:17.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.347+0000 7fc10fe00640 1 -- 172.21.15.37:0/2392578067 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc1280129e0 con 0x55b78fecd6f0 2024-08-20T05:06:17.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.347+0000 7fc137e63740 10 client.26567 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:17.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.347+0000 7fc137e63740 1 -- 172.21.15.37:0/2392578067 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b78feecf50 con 0x55b78fecd6f0 2024-08-20T05:06:17.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.348+0000 7fc10fe00640 1 -- 172.21.15.37:0/2392578067 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc128012bc0 con 0x55b78fecd6f0 2024-08-20T05:06:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.349+0000 7fc10fe00640 1 -- 172.21.15.37:0/2392578067 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fc12802c030 con 0x55b78fecd6f0 2024-08-20T05:06:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.350+0000 7fc137e63740 10 client.26567 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.350+0000 7fc137e63740 10 client.26567 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:06:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.350+0000 7fc137e63740 20 client.26567 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.350+0000 7fc137e63740 1 --2- 172.21.15.37:0/2392578067 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b78feee2f0 0x55b78fef06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.350+0000 7fc137e63740 4 client.26567 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:06:17.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.350+0000 7fc137e63740 1 -- 172.21.15.37:0/2392578067 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b78fe38550 con 0x55b78feee2f0 2024-08-20T05:06:17.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.352+0000 7fc12d400640 1 --2- 172.21.15.37:0/2392578067 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b78feee2f0 0x55b78fef06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:17.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.355+0000 7fc12d400640 1 --2- 172.21.15.37:0/2392578067 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b78feee2f0 0x55b78fef06e0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb51b22f73cfa428 server_cookie=b7401c69c7153dcd in_seq=0 out_seq=0 2024-08-20T05:06:17.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.355+0000 7fc10fe00640 10 client.26567 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:17.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.357+0000 7fc10fe00640 1 -- 172.21.15.37:0/2392578067 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b78fe38550 con 0x55b78feee2f0 2024-08-20T05:06:17.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.357+0000 7fc10fe00640 10 client.26567 handle_command_reply: tid=0 2024-08-20T05:06:17.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.357+0000 7fc137e63740 1 client.26567 shutdown 2024-08-20T05:06:17.360 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:06:17.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.359+0000 7fc137e63740 1 -- 172.21.15.37:0/2392578067 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fecd6f0 msgr2=0x55b78fecb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:17.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.359+0000 7fc137e63740 1 --2- 172.21.15.37:0/2392578067 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fecd6f0 0x55b78fecb130 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc128005c20 tx=0x7fc1280114b0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.360+0000 7fc137e63740 1 -- 172.21.15.37:0/2392578067 shutdown_connections 2024-08-20T05:06:17.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.360+0000 7fc137e63740 1 --2- 172.21.15.37:0/2392578067 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b78feee2f0 0x55b78fef06e0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.360+0000 7fc137e63740 1 --2- 172.21.15.37:0/2392578067 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fecd6f0 0x55b78fecb130 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.360+0000 7fc137e63740 1 --2- 172.21.15.37:0/2392578067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec1760 0x55b78fecabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.360+0000 7fc137e63740 1 --2- 172.21.15.37:0/2392578067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fec0e40 0x55b78feca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.360+0000 7fc137e63740 1 -- 172.21.15.37:0/2392578067 >> 172.21.15.37:0/2392578067 conn(0x55b78febec70 msgr2=0x55b78fec47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:17.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.360+0000 7fc10fe00640 0 client.26567 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:17.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.360+0000 7fc137e63740 1 -- 172.21.15.37:0/2392578067 shutdown_connections 2024-08-20T05:06:17.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.360+0000 7fc137e63740 1 -- 172.21.15.37:0/2392578067 wait complete. 2024-08-20T05:06:17.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.361+0000 7fc137e63740 20 client.26567 trim_cache size 0 max 16384 2024-08-20T05:06:17.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.398+0000 7fc137e63740 1 Processor -- start 2024-08-20T05:06:17.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.399+0000 7fc137e63740 1 -- start start 2024-08-20T05:06:17.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.399+0000 7fc137e63740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec0e40 0x55b78fec9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.399+0000 7fc137e63740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fec1760 0x55b78fee9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.399+0000 7fc137e63740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fecd6f0 0x55b78feea110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.399+0000 7fc137e63740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc1301ad5f0 con 0x55b78fecd6f0 2024-08-20T05:06:17.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.399+0000 7fc137e63740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc1301af130 con 0x55b78fec1760 2024-08-20T05:06:17.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.399+0000 7fc137e63740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc1301adcc0 con 0x55b78fec0e40 2024-08-20T05:06:17.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.400+0000 7fc12d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fec1760 0x55b78fee9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:17.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.400+0000 7fc12d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fec1760 0x55b78fee9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56494/0 (socket says 172.21.15.37:56494) 2024-08-20T05:06:17.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.400+0000 7fc12d400640 1 -- 172.21.15.37:0/2367857653 learned_addr learned my addr 172.21.15.37:0/2367857653 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.401+0000 7fc12d400640 1 -- 172.21.15.37:0/2367857653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec0e40 msgr2=0x55b78fec9e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:06:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.401+0000 7fc12d400640 1 --2- 172.21.15.37:0/2367857653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec0e40 0x55b78fec9e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.401+0000 7fc12d400640 1 -- 172.21.15.37:0/2367857653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fecd6f0 msgr2=0x55b78feea110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:06:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.402+0000 7fc12d400640 1 --2- 172.21.15.37:0/2367857653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fecd6f0 0x55b78feea110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.402+0000 7fc12d400640 1 -- 172.21.15.37:0/2367857653 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b78fec1590 con 0x55b78fec1760 2024-08-20T05:06:17.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.403+0000 7fc12d400640 1 --2- 172.21.15.37:0/2367857653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fec1760 0x55b78fee9bd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009230 tx=0x7fc11c004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c5845155ce064a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:17.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.403+0000 7fc11aa00640 1 -- 172.21.15.37:0/2367857653 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c035070 con 0x55b78fec1760 2024-08-20T05:06:17.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.404+0000 7fc11aa00640 1 -- 172.21.15.37:0/2367857653 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc11c048070 con 0x55b78fec1760 2024-08-20T05:06:17.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.404+0000 7fc11aa00640 1 -- 172.21.15.37:0/2367857653 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc11c004e60 con 0x55b78fec1760 2024-08-20T05:06:17.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.405+0000 7fc137e63740 1 -- 172.21.15.37:0/2367857653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fec1760 msgr2=0x55b78fee9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:17.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.405+0000 7fc137e63740 1 --2- 172.21.15.37:0/2367857653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fec1760 0x55b78fee9bd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc11c009230 tx=0x7fc11c004040 comp rx=0 tx=0).stop 2024-08-20T05:06:17.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.406+0000 7fc137e63740 1 -- 172.21.15.37:0/2367857653 shutdown_connections 2024-08-20T05:06:17.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.406+0000 7fc137e63740 1 --2- 172.21.15.37:0/2367857653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fecd6f0 0x55b78feea110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.406+0000 7fc137e63740 1 --2- 172.21.15.37:0/2367857653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fec1760 0x55b78fee9bd0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.406+0000 7fc137e63740 1 --2- 172.21.15.37:0/2367857653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec0e40 0x55b78fec9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.406+0000 7fc137e63740 1 -- 172.21.15.37:0/2367857653 >> 172.21.15.37:0/2367857653 conn(0x55b78febec70 msgr2=0x55b78fee94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:17.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.407+0000 7fc137e63740 1 -- 172.21.15.37:0/2367857653 shutdown_connections 2024-08-20T05:06:17.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.407+0000 7fc137e63740 1 -- 172.21.15.37:0/2367857653 wait complete. 2024-08-20T05:06:17.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.407+0000 7fc137e63740 1 -- start start 2024-08-20T05:06:17.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.408+0000 7fc137e63740 1 Processor -- start 2024-08-20T05:06:17.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.408+0000 7fc137e63740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec0e40 0x55b78fee6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.408+0000 7fc137e63740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fec1760 0x55b78fee2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.408+0000 7fc137e63740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fecd6f0 0x55b78fee2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.408+0000 7fc137e63740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc1301aea60 con 0x55b78fec1760 2024-08-20T05:06:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.408+0000 7fc137e63740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc1301ae390 con 0x55b78fecd6f0 2024-08-20T05:06:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.408+0000 7fc137e63740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc1300743b0 con 0x55b78fec0e40 2024-08-20T05:06:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.408+0000 7fc137e63740 10 client.0 _ll_register_callbacks cb 0x7fc1200e7890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.410+0000 7fc12e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fecd6f0 0x55b78fee2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.410+0000 7fc12e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fecd6f0 0x55b78fee2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56496/0 (socket says 172.21.15.37:56496) 2024-08-20T05:06:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.410+0000 7fc12e800640 1 -- 172.21.15.37:0/587139753 learned_addr learned my addr 172.21.15.37:0/587139753 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:17.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.410+0000 7fc12e800640 1 --2- 172.21.15.37:0/587139753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec0e40 0x55b78fee6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.411+0000 7fc12e800640 1 -- 172.21.15.37:0/587139753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec0e40 msgr2=0x55b78fee6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.411+0000 7fc12d400640 1 --2- 172.21.15.37:0/587139753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fec1760 0x55b78fee2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.412+0000 7fc12e800640 1 --2- 172.21.15.37:0/587139753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec0e40 0x55b78fee6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.412+0000 7fc12e800640 1 -- 172.21.15.37:0/587139753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fec1760 msgr2=0x55b78fee2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.412+0000 7fc12e800640 1 --2- 172.21.15.37:0/587139753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fec1760 0x55b78fee2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.412+0000 7fc12e800640 1 -- 172.21.15.37:0/587139753 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b78ff57df0 con 0x55b78fecd6f0 2024-08-20T05:06:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.412+0000 7fc12d400640 1 --2- 172.21.15.37:0/587139753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fec1760 0x55b78fee2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:06:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.412+0000 7fc12e800640 1 --2- 172.21.15.37:0/587139753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fecd6f0 0x55b78fee2b00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc1280129b0 tx=0x7fc128009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97a87a838d671b9e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.412+0000 7fc10fe00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:06:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.413+0000 7fc10fe00640 1 -- 172.21.15.37:0/587139753 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128016070 con 0x55b78fecd6f0 2024-08-20T05:06:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.413+0000 7fc137e63740 1 -- 172.21.15.37:0/587139753 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc11c048070 con 0x55b78fecd6f0 2024-08-20T05:06:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.415+0000 7fc10fe00640 1 -- 172.21.15.37:0/587139753 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc128004c00 con 0x55b78fecd6f0 2024-08-20T05:06:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.415+0000 7fc10fe00640 1 -- 172.21.15.37:0/587139753 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc128004e00 con 0x55b78fecd6f0 2024-08-20T05:06:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.416+0000 7fc137e63740 10 client.26573 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.416+0000 7fc137e63740 1 -- 172.21.15.37:0/587139753 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b78ff58ff0 con 0x55b78fecd6f0 2024-08-20T05:06:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.417+0000 7fc10fe00640 1 -- 172.21.15.37:0/587139753 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc11c048070 con 0x55b78fecd6f0 2024-08-20T05:06:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.417+0000 7fc10fe00640 1 -- 172.21.15.37:0/587139753 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fc128035040 con 0x55b78fecd6f0 2024-08-20T05:06:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.417+0000 7fc137e63740 10 client.26573 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.417+0000 7fc137e63740 10 client.26573 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:06:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.417+0000 7fc137e63740 20 client.26573 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.417+0000 7fc137e63740 1 --2- 172.21.15.37:0/587139753 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b78ff59690 0x55b78ff5bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.417+0000 7fc137e63740 4 client.26573 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.85, "await_for": 45.0}] 2024-08-20T05:06:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.417+0000 7fc137e63740 1 -- 172.21.15.37:0/587139753 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.85, "await_for": 45.0}) -- 0x55b78fe33ff0 con 0x55b78ff59690 2024-08-20T05:06:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.417+0000 7fc12d400640 1 --2- 172.21.15.37:0/587139753 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b78ff59690 0x55b78ff5bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.418+0000 7fc10fe00640 10 client.26573 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.418+0000 7fc12d400640 1 --2- 172.21.15.37:0/587139753 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b78ff59690 0x55b78ff5bab0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5040eb546b319cd8 server_cookie=58b0baec12bf347 in_seq=0 out_seq=0 2024-08-20T05:06:17.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.552+0000 7fc10fe00640 1 -- 172.21.15.37:0/587139753 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b78fe33ff0 con 0x55b78ff59690 2024-08-20T05:06:17.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.552+0000 7fc10fe00640 10 client.26573 handle_command_reply: tid=0 2024-08-20T05:06:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.552+0000 7fc137e63740 1 client.26573 shutdown 2024-08-20T05:06:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.553+0000 7fc137e63740 1 -- 172.21.15.37:0/587139753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fecd6f0 msgr2=0x55b78fee2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.553+0000 7fc137e63740 1 --2- 172.21.15.37:0/587139753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fecd6f0 0x55b78fee2b00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc1280129b0 tx=0x7fc128009cd0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.553+0000 7fc137e63740 1 -- 172.21.15.37:0/587139753 shutdown_connections 2024-08-20T05:06:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.553+0000 7fc137e63740 1 --2- 172.21.15.37:0/587139753 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b78ff59690 0x55b78ff5bab0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.553+0000 7fc137e63740 1 --2- 172.21.15.37:0/587139753 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b78fecd6f0 0x55b78fee2b00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.553+0000 7fc137e63740 1 --2- 172.21.15.37:0/587139753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b78fec1760 0x55b78fee2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.553+0000 7fc10fe00640 0 client.26573 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.553+0000 7fc137e63740 1 --2- 172.21.15.37:0/587139753 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b78fec0e40 0x55b78fee6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.553+0000 7fc137e63740 1 -- 172.21.15.37:0/587139753 >> 172.21.15.37:0/587139753 conn(0x55b78febec70 msgr2=0x55b78fec46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.553+0000 7fc137e63740 1 -- 172.21.15.37:0/587139753 shutdown_connections 2024-08-20T05:06:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.553+0000 7fc137e63740 1 -- 172.21.15.37:0/587139753 wait complete. 2024-08-20T05:06:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.553+0000 7fc137e63740 20 client.26573 trim_cache size 0 max 16384 2024-08-20T05:06:17.556 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:06:17.556 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 36, 2024-08-20T05:06:17.556 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:06:17.556 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 22, 2024-08-20T05:06:17.556 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:06:17.556 INFO:teuthology.orchestra.run.smithi037.stdout: "d2ab4b2f": { 2024-08-20T05:06:17.557 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 22, 2024-08-20T05:06:17.557 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:06:17.557 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:06:17.557 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:06:17.557 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:06:17.557 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:06:17.557 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:06:17.557 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 139.8, 2024-08-20T05:06:17.557 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:06:17.557 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:06:17.557 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:06:17.557 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:06:17.557 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:06:17.557 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:06:17.558 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:06:17.558 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:06:17.558 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:06:17.558 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:06:17.558 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:06:17.558 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:06:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.554+0000 7fc135200640 1 -- 172.21.15.37:0/1093433724 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc1140b3f00 msgr2=0x7fc1140b63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.554+0000 7fc135200640 1 --2- 172.21.15.37:0/1093433724 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc1140b3f00 0x7fc1140b63c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc1200aba40 tx=0x7fc1200e79c0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.554+0000 7fc135200640 1 -- 172.21.15.37:0/1093433724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc130102ab0 msgr2=0x7fc13010e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.554+0000 7fc135200640 1 --2- 172.21.15.37:0/1093433724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc130102ab0 0x7fc13010e980 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc12000ea60 tx=0x7fc12000ef20 comp rx=0 tx=0).stop 2024-08-20T05:06:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.554+0000 7fc135200640 1 -- 172.21.15.37:0/1093433724 shutdown_connections 2024-08-20T05:06:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.554+0000 7fc135200640 1 --2- 172.21.15.37:0/1093433724 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc1140b3f00 0x7fc1140b63c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.554+0000 7fc135200640 1 --2- 172.21.15.37:0/1093433724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc130108e40 0x7fc1301a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.554+0000 7fc135200640 1 --2- 172.21.15.37:0/1093433724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1301084c0 0x7fc13010eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.554+0000 7fc135200640 1 --2- 172.21.15.37:0/1093433724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc130102ab0 0x7fc13010e980 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.554+0000 7fc135200640 1 -- 172.21.15.37:0/1093433724 >> 172.21.15.37:0/1093433724 conn(0x7fc1300fe500 msgr2=0x7fc130105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.554+0000 7fc135200640 1 -- 172.21.15.37:0/1093433724 shutdown_connections 2024-08-20T05:06:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:17.554+0000 7fc135200640 1 -- 172.21.15.37:0/1093433724 wait complete. 2024-08-20T05:06:18.007 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:17 smithi130 ceph-mon[22007]: pgmap v522: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.0 MiB/s wr, 227 op/s 2024-08-20T05:06:18.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:17 smithi037 ceph-mon[17265]: pgmap v522: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.0 MiB/s wr, 227 op/s 2024-08-20T05:06:18.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 200.0 s, 826.7 tps, lat 108.852 ms stddev 134.878 2024-08-20T05:06:18.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:17 smithi135 ceph-mon[22342]: pgmap v522: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.0 MiB/s wr, 227 op/s 2024-08-20T05:06:18.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.249+0000 7f64abe00640 1 -- 172.21.15.37:0/873629572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64ac077400 msgr2=0x7f64ac0777e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.249+0000 7f64abe00640 1 --2- 172.21.15.37:0/873629572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64ac077400 0x7f64ac0777e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f649c009900 tx=0x7f649c02a410 comp rx=0 tx=0).stop 2024-08-20T05:06:18.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.249+0000 7f64abe00640 1 -- 172.21.15.37:0/873629572 shutdown_connections 2024-08-20T05:06:18.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.249+0000 7f64abe00640 1 --2- 172.21.15.37:0/873629572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64ac1134f0 0x7f64ac1158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.249+0000 7f64abe00640 1 --2- 172.21.15.37:0/873629572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64ac077d20 0x7f64ac112fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.249+0000 7f64abe00640 1 --2- 172.21.15.37:0/873629572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64ac077400 0x7f64ac0777e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.249+0000 7f64abe00640 1 -- 172.21.15.37:0/873629572 >> 172.21.15.37:0/873629572 conn(0x7f64ac100550 msgr2=0x7f64ac102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.249+0000 7f64abe00640 1 -- 172.21.15.37:0/873629572 shutdown_connections 2024-08-20T05:06:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.249+0000 7f64abe00640 1 -- 172.21.15.37:0/873629572 wait complete. 2024-08-20T05:06:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.250+0000 7f64abe00640 1 Processor -- start 2024-08-20T05:06:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.250+0000 7f64abe00640 1 -- start start 2024-08-20T05:06:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.251+0000 7f64abe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64ac077400 0x7f64ac19f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.251+0000 7f64abe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64ac077d20 0x7f64ac19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.251+0000 7f64abe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64ac1134f0 0x7f64ac1a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.251+0000 7f64abe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac118f00 con 0x7f64ac077400 2024-08-20T05:06:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.251+0000 7f64abe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac118d80 con 0x7f64ac077d20 2024-08-20T05:06:18.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.251+0000 7f64abe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac119080 con 0x7f64ac1134f0 2024-08-20T05:06:18.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.251+0000 7f64aaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64ac077400 0x7f64ac19f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.251+0000 7f64aaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64ac077400 0x7f64ac19f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40742/0 (socket says 172.21.15.37:40742) 2024-08-20T05:06:18.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.251+0000 7f64aaa00640 1 -- 172.21.15.37:0/3595136222 learned_addr learned my addr 172.21.15.37:0/3595136222 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:18.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.251+0000 7f64ab400640 1 --2- 172.21.15.37:0/3595136222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64ac1134f0 0x7f64ac1a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.251+0000 7f64a3e00640 1 --2- 172.21.15.37:0/3595136222 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64ac077d20 0x7f64ac19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.251+0000 7f64aaa00640 1 -- 172.21.15.37:0/3595136222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64ac1134f0 msgr2=0x7f64ac1a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.251+0000 7f64aaa00640 1 --2- 172.21.15.37:0/3595136222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64ac1134f0 0x7f64ac1a4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.251+0000 7f64aaa00640 1 -- 172.21.15.37:0/3595136222 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64ac077d20 msgr2=0x7f64ac19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.251+0000 7f64aaa00640 1 --2- 172.21.15.37:0/3595136222 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64ac077d20 0x7f64ac19f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.251+0000 7f64aaa00640 1 -- 172.21.15.37:0/3595136222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ac1a5390 con 0x7f64ac077400 2024-08-20T05:06:18.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.252+0000 7f64aaa00640 1 --2- 172.21.15.37:0/3595136222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64ac077400 0x7f64ac19f2e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f649c005940 tx=0x7f649c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:18.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.252+0000 7f64a3400640 1 -- 172.21.15.37:0/3595136222 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c03f030 con 0x7f64ac077400 2024-08-20T05:06:18.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.252+0000 7f64abe00640 1 -- 172.21.15.37:0/3595136222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ac1a5620 con 0x7f64ac077400 2024-08-20T05:06:18.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.252+0000 7f64a3400640 1 -- 172.21.15.37:0/3595136222 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f649c003cb0 con 0x7f64ac077400 2024-08-20T05:06:18.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.252+0000 7f64a3400640 1 -- 172.21.15.37:0/3595136222 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c035070 con 0x7f64ac077400 2024-08-20T05:06:18.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.252+0000 7f64abe00640 1 -- 172.21.15.37:0/3595136222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ac1abd40 con 0x7f64ac077400 2024-08-20T05:06:18.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.255+0000 7f64b4679740 1 Processor -- start 2024-08-20T05:06:18.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.255+0000 7f64b4679740 1 -- start start 2024-08-20T05:06:18.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.256+0000 7f64a3400640 1 -- 172.21.15.37:0/3595136222 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f649c042030 con 0x7f64ac077400 2024-08-20T05:06:18.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.256+0000 7f64b4679740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f9889ac0 0x5611f9889ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.256+0000 7f64b4679740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f988a3e0 0x5611f9895e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.256+0000 7f64b4679740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9896370 0x5611f9898760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.256+0000 7f64b4679740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5611f97ffaa0 con 0x5611f988a3e0 2024-08-20T05:06:18.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.256+0000 7f64b4679740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5611f97eefa0 con 0x5611f9889ac0 2024-08-20T05:06:18.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.256+0000 7f64b4679740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5611f97f2fe0 con 0x5611f9896370 2024-08-20T05:06:18.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.256+0000 7f64aaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f988a3e0 0x5611f9895e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.256+0000 7f64a3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9896370 0x5611f9898760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.256+0000 7f64ab400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f9889ac0 0x5611f9889ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.256+0000 7f64a3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9896370 0x5611f9898760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:38008/0 (socket says 172.21.15.37:38008) 2024-08-20T05:06:18.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.256+0000 7f64a3e00640 1 -- 172.21.15.37:0/2722967586 learned_addr learned my addr 172.21.15.37:0/2722967586 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:18.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.257+0000 7f64a3e00640 1 -- 172.21.15.37:0/2722967586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f9889ac0 msgr2=0x5611f9889ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:18.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.257+0000 7f64a3e00640 1 --2- 172.21.15.37:0/2722967586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f9889ac0 0x5611f9889ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.257+0000 7f64a3e00640 1 -- 172.21.15.37:0/2722967586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f988a3e0 msgr2=0x5611f9895e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:18.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.257+0000 7f64a3e00640 1 --2- 172.21.15.37:0/2722967586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f988a3e0 0x5611f9895e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.257+0000 7f64a3e00640 1 -- 172.21.15.37:0/2722967586 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611f9795420 con 0x5611f9896370 2024-08-20T05:06:18.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.257+0000 7f64a3e00640 1 --2- 172.21.15.37:0/2722967586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9896370 0x5611f9898760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f649400bd10 tx=0x7f64940107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=454443777442f4b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:18.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.257+0000 7f649be00640 1 -- 172.21.15.37:0/2722967586 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494005220 con 0x5611f9896370 2024-08-20T05:06:18.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.257+0000 7f649be00640 1 -- 172.21.15.37:0/2722967586 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6494004c50 con 0x5611f9896370 2024-08-20T05:06:18.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.257+0000 7f649be00640 1 -- 172.21.15.37:0/2722967586 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494011820 con 0x5611f9896370 2024-08-20T05:06:18.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.258+0000 7f64a3400640 1 --2- 172.21.15.37:0/3595136222 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f64900b3cf0 0x7f64900b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.258+0000 7f64a3400640 1 -- 172.21.15.37:0/3595136222 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f649c104730 con 0x7f64ac077400 2024-08-20T05:06:18.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.258+0000 7f64ab400640 1 --2- 172.21.15.37:0/3595136222 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f64900b3cf0 0x7f64900b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.258+0000 7f64b4679740 1 -- 172.21.15.37:0/2722967586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9896370 msgr2=0x5611f9898760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.258+0000 7f64b4679740 1 --2- 172.21.15.37:0/2722967586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9896370 0x5611f9898760 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f649400bd10 tx=0x7f64940107a0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.258+0000 7f64b4679740 1 -- 172.21.15.37:0/2722967586 shutdown_connections 2024-08-20T05:06:18.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.259+0000 7f64b4679740 1 --2- 172.21.15.37:0/2722967586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9896370 0x5611f9898760 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.259+0000 7f64b4679740 1 --2- 172.21.15.37:0/2722967586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f988a3e0 0x5611f9895e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.259+0000 7f64b4679740 1 --2- 172.21.15.37:0/2722967586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f9889ac0 0x5611f9889ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.259+0000 7f64b4679740 1 -- 172.21.15.37:0/2722967586 >> 172.21.15.37:0/2722967586 conn(0x5611f98878f0 msgr2=0x5611f9888a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:18.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.259+0000 7f64ab400640 1 --2- 172.21.15.37:0/3595136222 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f64900b3cf0 0x7f64900b61b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f64ac06bc20 tx=0x7f64a4009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:18.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.259+0000 7f64b4679740 1 -- 172.21.15.37:0/2722967586 shutdown_connections 2024-08-20T05:06:18.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.259+0000 7f64b4679740 1 -- 172.21.15.37:0/2722967586 wait complete. 2024-08-20T05:06:18.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.259+0000 7f64b4679740 1 -- start start 2024-08-20T05:06:18.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.260+0000 7f64b4679740 1 Processor -- start 2024-08-20T05:06:18.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.260+0000 7f64b4679740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9889ac0 0x5611f9895aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.260+0000 7f64b4679740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f988a3e0 0x5611f9892ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.260+0000 7f64b4679740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f9896370 0x5611f9893430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.260+0000 7f64b4679740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5611f9651700 con 0x5611f988a3e0 2024-08-20T05:06:18.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.260+0000 7f64b4679740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5611f978a290 con 0x5611f9896370 2024-08-20T05:06:18.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.260+0000 7f64b4679740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5611f9898ff0 con 0x5611f9889ac0 2024-08-20T05:06:18.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.260+0000 7f64b4679740 10 client.0 _ll_register_callbacks cb 0x5611f97e91c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:18.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.260+0000 7f64aaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9889ac0 0x5611f9895aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.260+0000 7f64a3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f988a3e0 0x5611f9892ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.260+0000 7f64aaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9889ac0 0x5611f9895aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:38024/0 (socket says 172.21.15.37:38024) 2024-08-20T05:06:18.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.260+0000 7f64aaa00640 1 -- 172.21.15.37:0/1840231559 learned_addr learned my addr 172.21.15.37:0/1840231559 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:18.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.260+0000 7f64ab400640 1 --2- 172.21.15.37:0/1840231559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f9896370 0x5611f9893430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.261+0000 7f64aaa00640 1 -- 172.21.15.37:0/1840231559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f9896370 msgr2=0x5611f9893430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:18.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.261+0000 7f64aaa00640 1 --2- 172.21.15.37:0/1840231559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f9896370 0x5611f9893430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.261+0000 7f64aaa00640 1 -- 172.21.15.37:0/1840231559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f988a3e0 msgr2=0x5611f9892ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:18.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.261+0000 7f64aaa00640 1 --2- 172.21.15.37:0/1840231559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f988a3e0 0x5611f9892ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.261+0000 7f64aaa00640 1 -- 172.21.15.37:0/1840231559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611f954e650 con 0x5611f9889ac0 2024-08-20T05:06:18.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.261+0000 7f64aaa00640 1 --2- 172.21.15.37:0/1840231559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9889ac0 0x5611f9895aa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f649c003fd0 tx=0x7f649c003f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b31f4c2ccb094db server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:18.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.261+0000 7f6498c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:06:18.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.261+0000 7f6498c00640 1 -- 172.21.15.37:0/1840231559 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c10a020 con 0x5611f9889ac0 2024-08-20T05:06:18.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.261+0000 7f64b4679740 1 -- 172.21.15.37:0/1840231559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6494004c50 con 0x5611f9889ac0 2024-08-20T05:06:18.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.261+0000 7f6498c00640 1 -- 172.21.15.37:0/1840231559 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f649c0c7620 con 0x5611f9889ac0 2024-08-20T05:06:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.262+0000 7f6498c00640 1 -- 172.21.15.37:0/1840231559 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f649c049070 con 0x5611f9889ac0 2024-08-20T05:06:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.262+0000 7f64b4679740 10 client.26608 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.262+0000 7f64b4679740 1 -- 172.21.15.37:0/1840231559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5611f98a47a0 con 0x5611f9889ac0 2024-08-20T05:06:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.262+0000 7f6498c00640 1 -- 172.21.15.37:0/1840231559 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6494004c50 con 0x5611f9889ac0 2024-08-20T05:06:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.262+0000 7f6498c00640 1 -- 172.21.15.37:0/1840231559 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f649c03bbf0 con 0x5611f9889ac0 2024-08-20T05:06:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.262+0000 7f64b4679740 10 client.26608 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.262+0000 7f64b4679740 10 client.26608 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:06:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.262+0000 7f64b4679740 20 client.26608 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.262+0000 7f64b4679740 1 --2- 172.21.15.37:0/1840231559 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5611f98a5c30 0x5611f98a8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.262+0000 7f64b4679740 4 client.26608 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:06:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.262+0000 7f64b4679740 1 -- 172.21.15.37:0/1840231559 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611f98019f0 con 0x5611f98a5c30 2024-08-20T05:06:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.263+0000 7f64a3e00640 1 --2- 172.21.15.37:0/1840231559 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5611f98a5c30 0x5611f98a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.263+0000 7f64a3e00640 1 --2- 172.21.15.37:0/1840231559 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5611f98a5c30 0x5611f98a8080 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=654f4ee6de4e724a server_cookie=5a5e49c05f0308a in_seq=0 out_seq=0 2024-08-20T05:06:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.263+0000 7f6498c00640 10 client.26608 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:06:18.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.264+0000 7f6498c00640 1 -- 172.21.15.37:0/1840231559 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5611f98019f0 con 0x5611f98a5c30 2024-08-20T05:06:18.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.264+0000 7f6498c00640 10 client.26608 handle_command_reply: tid=0 2024-08-20T05:06:18.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.264+0000 7f64b4679740 1 client.26608 shutdown 2024-08-20T05:06:18.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.264+0000 7f64b4679740 1 -- 172.21.15.37:0/1840231559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9889ac0 msgr2=0x5611f9895aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.264+0000 7f64b4679740 1 --2- 172.21.15.37:0/1840231559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9889ac0 0x5611f9895aa0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f649c003fd0 tx=0x7f649c003f20 comp rx=0 tx=0).stop 2024-08-20T05:06:18.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.264+0000 7f64b4679740 1 -- 172.21.15.37:0/1840231559 shutdown_connections 2024-08-20T05:06:18.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.264+0000 7f64b4679740 1 --2- 172.21.15.37:0/1840231559 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5611f98a5c30 0x5611f98a8080 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.264+0000 7f64b4679740 1 --2- 172.21.15.37:0/1840231559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f9896370 0x5611f9893430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.264+0000 7f64b4679740 1 --2- 172.21.15.37:0/1840231559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f988a3e0 0x5611f9892ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.264+0000 7f6498c00640 0 client.26608 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:06:18.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.264+0000 7f64b4679740 1 --2- 172.21.15.37:0/1840231559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9889ac0 0x5611f9895aa0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.264+0000 7f64b4679740 1 -- 172.21.15.37:0/1840231559 >> 172.21.15.37:0/1840231559 conn(0x5611f98878f0 msgr2=0x5611f988d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:18.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.264+0000 7f64b4679740 1 -- 172.21.15.37:0/1840231559 shutdown_connections 2024-08-20T05:06:18.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.264+0000 7f64b4679740 1 -- 172.21.15.37:0/1840231559 wait complete. 2024-08-20T05:06:18.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.265+0000 7f64b4679740 20 client.26608 trim_cache size 0 max 16384 2024-08-20T05:06:18.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.279+0000 7f64b4679740 1 Processor -- start 2024-08-20T05:06:18.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.279+0000 7f64b4679740 1 -- start start 2024-08-20T05:06:18.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.279+0000 7f64b4679740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9889ac0 0x5611f98ad950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.279+0000 7f64b4679740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f988a3e0 0x5611f98ade90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.279+0000 7f64b4679740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f9896370 0x5611f988dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.279+0000 7f64b4679740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac1b5b30 con 0x5611f988a3e0 2024-08-20T05:06:18.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.279+0000 7f64b4679740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac1b7670 con 0x5611f9896370 2024-08-20T05:06:18.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.279+0000 7f64b4679740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac1b6200 con 0x5611f9889ac0 2024-08-20T05:06:18.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.279+0000 7f64a3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f988a3e0 0x5611f98ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.279+0000 7f64aaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9889ac0 0x5611f98ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.279+0000 7f64a3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f988a3e0 0x5611f98ade90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40762/0 (socket says 172.21.15.37:40762) 2024-08-20T05:06:18.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.279+0000 7f64a3e00640 1 -- 172.21.15.37:0/3348886758 learned_addr learned my addr 172.21.15.37:0/3348886758 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:18.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.280+0000 7f64ab400640 1 --2- 172.21.15.37:0/3348886758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f9896370 0x5611f988dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.280+0000 7f64aaa00640 1 -- 172.21.15.37:0/3348886758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f9896370 msgr2=0x5611f988dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:18.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.280+0000 7f64aaa00640 1 --2- 172.21.15.37:0/3348886758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f9896370 0x5611f988dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.280+0000 7f64aaa00640 1 -- 172.21.15.37:0/3348886758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f988a3e0 msgr2=0x5611f98ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:18.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.280+0000 7f64aaa00640 1 --2- 172.21.15.37:0/3348886758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f988a3e0 0x5611f98ade90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.280+0000 7f64aaa00640 1 -- 172.21.15.37:0/3348886758 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611f988a210 con 0x5611f9889ac0 2024-08-20T05:06:18.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.280+0000 7f64aaa00640 1 --2- 172.21.15.37:0/3348886758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9889ac0 0x5611f98ad950 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f649c102200 tx=0x7f649c0045a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c7acd599295cf7a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:18.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.280+0000 7f649b400640 1 -- 172.21.15.37:0/3348886758 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c10a040 con 0x5611f9889ac0 2024-08-20T05:06:18.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.280+0000 7f649b400640 1 -- 172.21.15.37:0/3348886758 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f649c0caea0 con 0x5611f9889ac0 2024-08-20T05:06:18.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.280+0000 7f649b400640 1 -- 172.21.15.37:0/3348886758 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649c0c7620 con 0x5611f9889ac0 2024-08-20T05:06:18.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.281+0000 7f64b4679740 1 -- 172.21.15.37:0/3348886758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9889ac0 msgr2=0x5611f98ad950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.281+0000 7f64b4679740 1 --2- 172.21.15.37:0/3348886758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9889ac0 0x5611f98ad950 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f649c102200 tx=0x7f649c0045a0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.281+0000 7f64b4679740 1 -- 172.21.15.37:0/3348886758 shutdown_connections 2024-08-20T05:06:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.281+0000 7f64b4679740 1 --2- 172.21.15.37:0/3348886758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f9896370 0x5611f988dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.281+0000 7f64b4679740 1 --2- 172.21.15.37:0/3348886758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f988a3e0 0x5611f98ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.281+0000 7f64b4679740 1 --2- 172.21.15.37:0/3348886758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9889ac0 0x5611f98ad950 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.281+0000 7f64b4679740 1 -- 172.21.15.37:0/3348886758 >> 172.21.15.37:0/3348886758 conn(0x5611f98878f0 msgr2=0x5611f9891790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.281+0000 7f64b4679740 1 -- 172.21.15.37:0/3348886758 shutdown_connections 2024-08-20T05:06:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.281+0000 7f64b4679740 1 -- 172.21.15.37:0/3348886758 wait complete. 2024-08-20T05:06:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.281+0000 7f64b4679740 1 -- start start 2024-08-20T05:06:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.282+0000 7f64b4679740 1 Processor -- start 2024-08-20T05:06:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.282+0000 7f64b4679740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f9889ac0 0x5611f989e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.282+0000 7f64b4679740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f988a3e0 0x5611f9899de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.282+0000 7f64b4679740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9896370 0x5611f989a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.282+0000 7f64b4679740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac1b6fa0 con 0x5611f9889ac0 2024-08-20T05:06:18.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.282+0000 7f64b4679740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac1b68d0 con 0x5611f988a3e0 2024-08-20T05:06:18.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.282+0000 7f64b4679740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac1b3b10 con 0x5611f9896370 2024-08-20T05:06:18.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.282+0000 7f64b4679740 10 client.0 _ll_register_callbacks cb 0x7f649c10a240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:18.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.283+0000 7f64ab400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9896370 0x5611f989a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.283+0000 7f64ab400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9896370 0x5611f989a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:38032/0 (socket says 172.21.15.37:38032) 2024-08-20T05:06:18.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.283+0000 7f64ab400640 1 -- 172.21.15.37:0/3186936633 learned_addr learned my addr 172.21.15.37:0/3186936633 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:18.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.283+0000 7f64aaa00640 1 --2- 172.21.15.37:0/3186936633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f9889ac0 0x5611f989e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.283+0000 7f64a3e00640 1 --2- 172.21.15.37:0/3186936633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f988a3e0 0x5611f9899de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.283+0000 7f64ab400640 1 -- 172.21.15.37:0/3186936633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f988a3e0 msgr2=0x5611f9899de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:18.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.283+0000 7f64ab400640 1 --2- 172.21.15.37:0/3186936633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f988a3e0 0x5611f9899de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.283+0000 7f64ab400640 1 -- 172.21.15.37:0/3186936633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f9889ac0 msgr2=0x5611f989e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:18.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.283+0000 7f64ab400640 1 --2- 172.21.15.37:0/3186936633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f9889ac0 0x5611f989e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.283+0000 7f64ab400640 1 -- 172.21.15.37:0/3186936633 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611f989ab50 con 0x5611f9896370 2024-08-20T05:06:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.283+0000 7f64ab400640 1 --2- 172.21.15.37:0/3186936633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9896370 0x5611f989a320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f64a4011ee0 tx=0x7f64a4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4976a4c0f2d5a95 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.283+0000 7f6498c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:06:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.284+0000 7f6498c00640 1 -- 172.21.15.37:0/3186936633 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a402f060 con 0x5611f9896370 2024-08-20T05:06:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.284+0000 7f6498c00640 1 -- 172.21.15.37:0/3186936633 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f64a4021c00 con 0x5611f9896370 2024-08-20T05:06:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.284+0000 7f64b4679740 1 -- 172.21.15.37:0/3186936633 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f649c0caea0 con 0x5611f9896370 2024-08-20T05:06:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.284+0000 7f6498c00640 1 -- 172.21.15.37:0/3186936633 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f64a4036050 con 0x5611f9896370 2024-08-20T05:06:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.284+0000 7f64b4679740 10 client.26614 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.284+0000 7f64b4679740 1 -- 172.21.15.37:0/3186936633 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5611f9910950 con 0x5611f9896370 2024-08-20T05:06:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.284+0000 7f6498c00640 1 -- 172.21.15.37:0/3186936633 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f649c0caea0 con 0x5611f9896370 2024-08-20T05:06:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.285+0000 7f6498c00640 1 -- 172.21.15.37:0/3186936633 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f64a400f040 con 0x5611f9896370 2024-08-20T05:06:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.285+0000 7f64b4679740 10 client.26614 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.285+0000 7f64b4679740 10 client.26614 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:06:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.285+0000 7f64b4679740 20 client.26614 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.285+0000 7f64b4679740 1 --2- 172.21.15.37:0/3186936633 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5611f9911130 0x5611f9913550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.285+0000 7f64b4679740 4 client.26614 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:06:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.285+0000 7f64b4679740 1 -- 172.21.15.37:0/3186936633 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5611f97fd490 con 0x5611f9911130 2024-08-20T05:06:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.285+0000 7f64aaa00640 1 --2- 172.21.15.37:0/3186936633 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5611f9911130 0x5611f9913550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.286+0000 7f64aaa00640 1 --2- 172.21.15.37:0/3186936633 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5611f9911130 0x5611f9913550 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c73898990c75c411 server_cookie=1f5bf4ea1ee92d1b in_seq=0 out_seq=0 2024-08-20T05:06:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.286+0000 7f6498c00640 10 client.26614 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:06:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.286+0000 7f6498c00640 1 -- 172.21.15.37:0/3186936633 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5611f97fd490 con 0x5611f9911130 2024-08-20T05:06:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.286+0000 7f6498c00640 10 client.26614 handle_command_reply: tid=0 2024-08-20T05:06:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.286+0000 7f64b4679740 1 client.26614 shutdown 2024-08-20T05:06:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.286+0000 7f64b4679740 1 -- 172.21.15.37:0/3186936633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9896370 msgr2=0x5611f989a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.286+0000 7f64b4679740 1 --2- 172.21.15.37:0/3186936633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9896370 0x5611f989a320 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f64a4011ee0 tx=0x7f64a4004a40 comp rx=0 tx=0).stop 2024-08-20T05:06:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.286+0000 7f64b4679740 1 -- 172.21.15.37:0/3186936633 shutdown_connections 2024-08-20T05:06:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.286+0000 7f64b4679740 1 --2- 172.21.15.37:0/3186936633 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5611f9911130 0x5611f9913550 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.286+0000 7f64b4679740 1 --2- 172.21.15.37:0/3186936633 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5611f9896370 0x5611f989a320 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.286+0000 7f64b4679740 1 --2- 172.21.15.37:0/3186936633 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5611f988a3e0 0x5611f9899de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.286+0000 7f64b4679740 1 --2- 172.21.15.37:0/3186936633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5611f9889ac0 0x5611f989e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.286+0000 7f6498c00640 0 client.26614 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:06:18.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.286+0000 7f64b4679740 1 -- 172.21.15.37:0/3186936633 >> 172.21.15.37:0/3186936633 conn(0x5611f98878f0 msgr2=0x5611f9894520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:18.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.286+0000 7f64b4679740 1 -- 172.21.15.37:0/3186936633 shutdown_connections 2024-08-20T05:06:18.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.286+0000 7f64b4679740 1 -- 172.21.15.37:0/3186936633 wait complete. 2024-08-20T05:06:18.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.286+0000 7f64b4679740 20 client.26614 trim_cache size 0 max 16384 2024-08-20T05:06:18.304 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:06:18.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.287+0000 7f64abe00640 1 -- 172.21.15.37:0/3595136222 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f64900b3cf0 msgr2=0x7f64900b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.287+0000 7f64abe00640 1 --2- 172.21.15.37:0/3595136222 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f64900b3cf0 0x7f64900b61b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f64ac06bc20 tx=0x7f64a4009600 comp rx=0 tx=0).stop 2024-08-20T05:06:18.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.287+0000 7f64abe00640 1 -- 172.21.15.37:0/3595136222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64ac077400 msgr2=0x7f64ac19f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.287+0000 7f64abe00640 1 --2- 172.21.15.37:0/3595136222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64ac077400 0x7f64ac19f2e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f649c005940 tx=0x7f649c0042f0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.287+0000 7f64abe00640 1 -- 172.21.15.37:0/3595136222 shutdown_connections 2024-08-20T05:06:18.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.287+0000 7f64abe00640 1 --2- 172.21.15.37:0/3595136222 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f64900b3cf0 0x7f64900b61b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.287+0000 7f64abe00640 1 --2- 172.21.15.37:0/3595136222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64ac1134f0 0x7f64ac1a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.287+0000 7f64abe00640 1 --2- 172.21.15.37:0/3595136222 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64ac077d20 0x7f64ac19f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.287+0000 7f64abe00640 1 --2- 172.21.15.37:0/3595136222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64ac077400 0x7f64ac19f2e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.287+0000 7f64abe00640 1 -- 172.21.15.37:0/3595136222 >> 172.21.15.37:0/3595136222 conn(0x7f64ac100550 msgr2=0x7f64ac102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:18.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.287+0000 7f64abe00640 1 -- 172.21.15.37:0/3595136222 shutdown_connections 2024-08-20T05:06:18.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:18.287+0000 7f64abe00640 1 -- 172.21.15.37:0/3595136222 wait complete. 2024-08-20T05:06:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.661+0000 7f9ff3200640 1 -- 172.21.15.37:0/817654875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff4103fa0 msgr2=0x7f9ff410a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.661+0000 7f9ff3200640 1 --2- 172.21.15.37:0/817654875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff4103fa0 0x7f9ff410a920 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009cd0 tx=0x7f9fec02a8e0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.661+0000 7f9ff3200640 1 -- 172.21.15.37:0/817654875 shutdown_connections 2024-08-20T05:06:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.661+0000 7f9ff3200640 1 --2- 172.21.15.37:0/817654875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff4103fa0 0x7f9ff410a920 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.661+0000 7f9ff3200640 1 --2- 172.21.15.37:0/817654875 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ff41035e0 0x7f9ff4103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.661+0000 7f9ff3200640 1 --2- 172.21.15.37:0/817654875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ff4102490 0x7f9ff4102890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.661+0000 7f9ff3200640 1 -- 172.21.15.37:0/817654875 >> 172.21.15.37:0/817654875 conn(0x7f9ff40fdd30 msgr2=0x7f9ff4100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.661+0000 7f9ff3200640 1 -- 172.21.15.37:0/817654875 shutdown_connections 2024-08-20T05:06:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.661+0000 7f9ff3200640 1 -- 172.21.15.37:0/817654875 wait complete. 2024-08-20T05:06:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.662+0000 7f9ff3200640 1 Processor -- start 2024-08-20T05:06:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.662+0000 7f9ff3200640 1 -- start start 2024-08-20T05:06:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.663+0000 7f9ff3200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ff4102490 0x7f9ff419aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.663+0000 7f9ff3200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff41035e0 0x7f9ff419b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.663+0000 7f9ff3200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ff4103fa0 0x7f9ff419bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.663+0000 7f9ff3200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff410e150 con 0x7f9ff4102490 2024-08-20T05:06:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.663+0000 7f9ff3200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff410dfd0 con 0x7f9ff4103fa0 2024-08-20T05:06:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.663+0000 7f9ff3200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff410e2d0 con 0x7f9ff41035e0 2024-08-20T05:06:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.663+0000 7f9ff1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ff4102490 0x7f9ff419aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.663+0000 7f9ff1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff41035e0 0x7f9ff419b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.663+0000 7f9ff1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ff4102490 0x7f9ff419aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40778/0 (socket says 172.21.15.37:40778) 2024-08-20T05:06:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.663+0000 7f9ff1e00640 1 -- 172.21.15.37:0/957445773 learned_addr learned my addr 172.21.15.37:0/957445773 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.663+0000 7f9ff2800640 1 --2- 172.21.15.37:0/957445773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ff4103fa0 0x7f9ff419bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.663+0000 7f9ff1400640 1 -- 172.21.15.37:0/957445773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ff4103fa0 msgr2=0x7f9ff419bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.663+0000 7f9ff1400640 1 --2- 172.21.15.37:0/957445773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ff4103fa0 0x7f9ff419bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.663+0000 7f9ff1400640 1 -- 172.21.15.37:0/957445773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ff4102490 msgr2=0x7f9ff419aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.663+0000 7f9ff1400640 1 --2- 172.21.15.37:0/957445773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ff4102490 0x7f9ff419aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.663+0000 7f9ff1400640 1 -- 172.21.15.37:0/957445773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ff419c5b0 con 0x7f9ff41035e0 2024-08-20T05:06:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.664+0000 7f9ff1400640 1 --2- 172.21.15.37:0/957445773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff41035e0 0x7f9ff419b0c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00e9f0 tx=0x7f9fdc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.664+0000 7f9feaa00640 1 -- 172.21.15.37:0/957445773 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc00ccc0 con 0x7f9ff41035e0 2024-08-20T05:06:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.664+0000 7f9ff3200640 1 -- 172.21.15.37:0/957445773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ff419c8a0 con 0x7f9ff41035e0 2024-08-20T05:06:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.664+0000 7f9feaa00640 1 -- 172.21.15.37:0/957445773 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fdc005020 con 0x7f9ff41035e0 2024-08-20T05:06:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.664+0000 7f9feaa00640 1 -- 172.21.15.37:0/957445773 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc004a00 con 0x7f9ff41035e0 2024-08-20T05:06:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.664+0000 7f9ff3200640 1 -- 172.21.15.37:0/957445773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ff41a2f70 con 0x7f9ff41035e0 2024-08-20T05:06:18.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.668+0000 7f9ffc046740 1 Processor -- start 2024-08-20T05:06:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.668+0000 7f9ffc046740 1 -- start start 2024-08-20T05:06:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.668+0000 7f9ffc046740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 0x562fde788be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.668+0000 7f9ffc046740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 0x562fde78b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.668+0000 7f9ffc046740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde78bb60 0x562fde78e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.668+0000 7f9ffc046740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562fde6f9210 con 0x562fde789120 2024-08-20T05:06:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.668+0000 7f9ffc046740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562fde6e8710 con 0x562fde7867f0 2024-08-20T05:06:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.668+0000 7f9ffc046740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562fde6ec750 con 0x562fde78bb60 2024-08-20T05:06:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.669+0000 7f9ff2800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 0x562fde788be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.669+0000 7f9ff1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 0x562fde78b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.669+0000 7f9ff2800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 0x562fde788be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56562/0 (socket says 172.21.15.37:56562) 2024-08-20T05:06:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.669+0000 7f9ff2800640 1 -- 172.21.15.37:0/2143750155 learned_addr learned my addr 172.21.15.37:0/2143750155 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.669+0000 7f9feaa00640 1 -- 172.21.15.37:0/957445773 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9fdc004ba0 con 0x7f9ff41035e0 2024-08-20T05:06:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.669+0000 7f9ff2800640 1 -- 172.21.15.37:0/2143750155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde78bb60 msgr2=0x562fde78e020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:06:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.669+0000 7f9ff2800640 1 --2- 172.21.15.37:0/2143750155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde78bb60 0x562fde78e020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.669+0000 7f9ff2800640 1 -- 172.21.15.37:0/2143750155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 msgr2=0x562fde78b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.669+0000 7f9ff2800640 1 --2- 172.21.15.37:0/2143750155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 0x562fde78b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.669+0000 7f9ff2800640 1 -- 172.21.15.37:0/2143750155 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fde6b4de0 con 0x562fde7867f0 2024-08-20T05:06:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.669+0000 7f9ff1e00640 1 --2- 172.21.15.37:0/2143750155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 0x562fde78b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.669+0000 7f9ff2800640 1 --2- 172.21.15.37:0/2143750155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 0x562fde788be0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9fec02aed0 tx=0x7f9fec009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be936a2705f1b698 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.670+0000 7f9fe3400640 1 -- 172.21.15.37:0/2143750155 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec048070 con 0x562fde7867f0 2024-08-20T05:06:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.670+0000 7f9fe3400640 1 -- 172.21.15.37:0/2143750155 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fec036070 con 0x562fde7867f0 2024-08-20T05:06:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.670+0000 7f9fe3400640 1 -- 172.21.15.37:0/2143750155 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec004320 con 0x562fde7867f0 2024-08-20T05:06:18.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.671+0000 7f9ffc046740 1 -- 172.21.15.37:0/2143750155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 msgr2=0x562fde788be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.671+0000 7f9ffc046740 1 --2- 172.21.15.37:0/2143750155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 0x562fde788be0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9fec02aed0 tx=0x7f9fec009a20 comp rx=0 tx=0).stop 2024-08-20T05:06:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.671+0000 7f9ffc046740 1 -- 172.21.15.37:0/2143750155 shutdown_connections 2024-08-20T05:06:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.671+0000 7f9ffc046740 1 --2- 172.21.15.37:0/2143750155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde78bb60 0x562fde78e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.671+0000 7f9ffc046740 1 --2- 172.21.15.37:0/2143750155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 0x562fde78b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.671+0000 7f9ffc046740 1 --2- 172.21.15.37:0/2143750155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 0x562fde788be0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.671+0000 7f9feaa00640 1 --2- 172.21.15.37:0/957445773 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9fd80b3bd0 0x7f9fd80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.671+0000 7f9ffc046740 1 -- 172.21.15.37:0/2143750155 >> 172.21.15.37:0/2143750155 conn(0x562fde781940 msgr2=0x562fde7826d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.671+0000 7f9feaa00640 1 -- 172.21.15.37:0/957445773 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9fdc0e3f80 con 0x7f9ff41035e0 2024-08-20T05:06:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.671+0000 7f9ffc046740 1 -- 172.21.15.37:0/2143750155 shutdown_connections 2024-08-20T05:06:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.671+0000 7f9ff2800640 1 --2- 172.21.15.37:0/957445773 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9fd80b3bd0 0x7f9fd80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.671+0000 7f9ffc046740 1 -- 172.21.15.37:0/2143750155 wait complete. 2024-08-20T05:06:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.672+0000 7f9ffc046740 1 -- start start 2024-08-20T05:06:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.672+0000 7f9ffc046740 1 Processor -- start 2024-08-20T05:06:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.672+0000 7f9ff2800640 1 --2- 172.21.15.37:0/957445773 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9fd80b3bd0 0x7f9fd80b6090 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009960 tx=0x7f9fec02a8e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.672+0000 7f9ffc046740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 0x562fde78fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.672+0000 7f9ffc046740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 0x562fde790570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.672+0000 7f9ffc046740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde78bb60 0x562fde791140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.672+0000 7f9ffc046740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562fde621ab0 con 0x562fde789120 2024-08-20T05:06:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.672+0000 7f9ffc046740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562fde68f140 con 0x562fde7867f0 2024-08-20T05:06:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.672+0000 7f9ffc046740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562fde78eae0 con 0x562fde78bb60 2024-08-20T05:06:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.672+0000 7f9ffc046740 10 client.0 _ll_register_callbacks cb 0x562fde6a25d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.673+0000 7f9ff1e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 0x562fde78fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.673+0000 7f9ff1e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 0x562fde78fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56574/0 (socket says 172.21.15.37:56574) 2024-08-20T05:06:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.673+0000 7f9ff1e00640 1 -- 172.21.15.37:0/3403023160 learned_addr learned my addr 172.21.15.37:0/3403023160 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.673+0000 7f9ff1400640 1 --2- 172.21.15.37:0/3403023160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 0x562fde790570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.673+0000 7f9ff2800640 1 --2- 172.21.15.37:0/3403023160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde78bb60 0x562fde791140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.673+0000 7f9ff1e00640 1 -- 172.21.15.37:0/3403023160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde78bb60 msgr2=0x562fde791140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.673+0000 7f9ff1e00640 1 --2- 172.21.15.37:0/3403023160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde78bb60 0x562fde791140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.673+0000 7f9ff1e00640 1 -- 172.21.15.37:0/3403023160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 msgr2=0x562fde790570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.673+0000 7f9ff1e00640 1 --2- 172.21.15.37:0/3403023160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 0x562fde790570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.673+0000 7f9ff1e00640 1 -- 172.21.15.37:0/3403023160 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fde690170 con 0x562fde7867f0 2024-08-20T05:06:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.673+0000 7f9ff2800640 1 --2- 172.21.15.37:0/3403023160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde78bb60 0x562fde791140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:06:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.673+0000 7f9ff1400640 1 --2- 172.21.15.37:0/3403023160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 0x562fde790570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.673+0000 7f9ff1e00640 1 --2- 172.21.15.37:0/3403023160 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 0x562fde78fed0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4012860 tx=0x7f9fe4012d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73422f862f750d34 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.673+0000 7f9fd7e00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:06:18.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.673+0000 7f9fd7e00640 1 -- 172.21.15.37:0/3403023160 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4004020 con 0x562fde7867f0 2024-08-20T05:06:18.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.674+0000 7f9ffc046740 1 -- 172.21.15.37:0/3403023160 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fec036070 con 0x562fde7867f0 2024-08-20T05:06:18.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.674+0000 7f9fd7e00640 1 -- 172.21.15.37:0/3403023160 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9fe40041c0 con 0x562fde7867f0 2024-08-20T05:06:18.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.674+0000 7f9fd7e00640 1 -- 172.21.15.37:0/3403023160 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f9fe4025050 con 0x562fde7867f0 2024-08-20T05:06:18.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.674+0000 7f9ffc046740 10 client.26603 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:18.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.674+0000 7f9ffc046740 1 -- 172.21.15.37:0/3403023160 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x562fde44b790 con 0x562fde7867f0 2024-08-20T05:06:18.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.674+0000 7f9fd7e00640 1 -- 172.21.15.37:0/3403023160 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fec036070 con 0x562fde7867f0 2024-08-20T05:06:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.674+0000 7f9fd7e00640 1 -- 172.21.15.37:0/3403023160 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f9fe4003a30 con 0x562fde7867f0 2024-08-20T05:06:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.675+0000 7f9ffc046740 10 client.26603 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.675+0000 7f9ffc046740 10 client.26603 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.675+0000 7f9ffc046740 20 client.26603 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.675+0000 7f9ffc046740 1 --2- 172.21.15.37:0/3403023160 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562fde79bc60 0x562fde79e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.675+0000 7f9ffc046740 4 client.26603 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:06:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.675+0000 7f9ffc046740 1 -- 172.21.15.37:0/3403023160 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562fde6fb160 con 0x562fde79bc60 2024-08-20T05:06:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.675+0000 7f9ff1400640 1 --2- 172.21.15.37:0/3403023160 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562fde79bc60 0x562fde79e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.675+0000 7f9ff1400640 1 --2- 172.21.15.37:0/3403023160 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562fde79bc60 0x562fde79e080 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7e4cb04dc095a54 server_cookie=dcffb85a3d450cd7 in_seq=0 out_seq=0 2024-08-20T05:06:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.675+0000 7f9fd7e00640 10 client.26603 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.676+0000 7f9fd7e00640 1 -- 172.21.15.37:0/3403023160 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562fde6fb160 con 0x562fde79bc60 2024-08-20T05:06:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.676+0000 7f9fd7e00640 10 client.26603 handle_command_reply: tid=0 2024-08-20T05:06:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.676+0000 7f9ffc046740 1 client.26603 shutdown 2024-08-20T05:06:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.676+0000 7f9ffc046740 1 -- 172.21.15.37:0/3403023160 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 msgr2=0x562fde78fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.676+0000 7f9ffc046740 1 --2- 172.21.15.37:0/3403023160 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 0x562fde78fed0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4012860 tx=0x7f9fe4012d20 comp rx=0 tx=0).stop 2024-08-20T05:06:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.676+0000 7f9ffc046740 1 -- 172.21.15.37:0/3403023160 shutdown_connections 2024-08-20T05:06:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.676+0000 7f9ffc046740 1 --2- 172.21.15.37:0/3403023160 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562fde79bc60 0x562fde79e080 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.676+0000 7f9ffc046740 1 --2- 172.21.15.37:0/3403023160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde78bb60 0x562fde791140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.676+0000 7f9ffc046740 1 --2- 172.21.15.37:0/3403023160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 0x562fde790570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.676+0000 7f9ffc046740 1 --2- 172.21.15.37:0/3403023160 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 0x562fde78fed0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.676+0000 7f9fd7e00640 0 client.26603 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.676+0000 7f9ffc046740 1 -- 172.21.15.37:0/3403023160 >> 172.21.15.37:0/3403023160 conn(0x562fde781940 msgr2=0x562fde7809b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.677+0000 7f9ffc046740 1 -- 172.21.15.37:0/3403023160 shutdown_connections 2024-08-20T05:06:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.677+0000 7f9ffc046740 1 -- 172.21.15.37:0/3403023160 wait complete. 2024-08-20T05:06:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.677+0000 7f9ffc046740 20 client.26603 trim_cache size 0 max 16384 2024-08-20T05:06:18.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ffc046740 1 Processor -- start 2024-08-20T05:06:18.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ffc046740 1 -- start start 2024-08-20T05:06:18.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ffc046740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde7867f0 0x562fde7808a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ffc046740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde789120 0x562fde780de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ffc046740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde78bb60 0x562fde783770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ffc046740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff41ad260 con 0x562fde7867f0 2024-08-20T05:06:18.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ffc046740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff41aeda0 con 0x562fde78bb60 2024-08-20T05:06:18.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ffc046740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff41ad930 con 0x562fde789120 2024-08-20T05:06:18.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ff2800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde78bb60 0x562fde783770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ff1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde7867f0 0x562fde7808a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ff2800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde78bb60 0x562fde783770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56578/0 (socket says 172.21.15.37:56578) 2024-08-20T05:06:18.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ff2800640 1 -- 172.21.15.37:0/2012839790 learned_addr learned my addr 172.21.15.37:0/2012839790 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:18.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ff2800640 1 -- 172.21.15.37:0/2012839790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde789120 msgr2=0x562fde780de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:06:18.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ff2800640 1 --2- 172.21.15.37:0/2012839790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde789120 0x562fde780de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ff2800640 1 -- 172.21.15.37:0/2012839790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde7867f0 msgr2=0x562fde7808a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:18.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ff2800640 1 --2- 172.21.15.37:0/2012839790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde7867f0 0x562fde7808a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ff2800640 1 -- 172.21.15.37:0/2012839790 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562fde782ba0 con 0x562fde78bb60 2024-08-20T05:06:18.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.693+0000 7f9ff1e00640 1 --2- 172.21.15.37:0/2012839790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde7867f0 0x562fde7808a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ff2800640 1 --2- 172.21.15.37:0/2012839790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde78bb60 0x562fde783770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009cd0 tx=0x7f9fec04a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d45370d512df06da server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9fe2a00640 1 -- 172.21.15.37:0/2012839790 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec05f070 con 0x562fde78bb60 2024-08-20T05:06:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9fe2a00640 1 -- 172.21.15.37:0/2012839790 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fec036040 con 0x562fde78bb60 2024-08-20T05:06:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9fe2a00640 1 -- 172.21.15.37:0/2012839790 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fec048040 con 0x562fde78bb60 2024-08-20T05:06:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 -- 172.21.15.37:0/2012839790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde78bb60 msgr2=0x562fde783770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 --2- 172.21.15.37:0/2012839790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde78bb60 0x562fde783770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009cd0 tx=0x7f9fec04a000 comp rx=0 tx=0).stop 2024-08-20T05:06:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 -- 172.21.15.37:0/2012839790 shutdown_connections 2024-08-20T05:06:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 --2- 172.21.15.37:0/2012839790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde78bb60 0x562fde783770 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 --2- 172.21.15.37:0/2012839790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde789120 0x562fde780de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 --2- 172.21.15.37:0/2012839790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde7867f0 0x562fde7808a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 -- 172.21.15.37:0/2012839790 >> 172.21.15.37:0/2012839790 conn(0x562fde781940 msgr2=0x562fde780190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 -- 172.21.15.37:0/2012839790 shutdown_connections 2024-08-20T05:06:18.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 -- 172.21.15.37:0/2012839790 wait complete. 2024-08-20T05:06:18.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 -- start start 2024-08-20T05:06:18.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 Processor -- start 2024-08-20T05:06:18.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 0x562fde797e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 0x562fde796b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde78bb60 0x562fde7971a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff41ae6d0 con 0x562fde789120 2024-08-20T05:06:18.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff41ae000 con 0x562fde7867f0 2024-08-20T05:06:18.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9ff41ab240 con 0x562fde78bb60 2024-08-20T05:06:18.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 10 client.0 _ll_register_callbacks cb 0x7f9fe4009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:18.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ff1400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 0x562fde796b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ff1400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 0x562fde796b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40814/0 (socket says 172.21.15.37:40814) 2024-08-20T05:06:18.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ff1400640 1 -- 172.21.15.37:0/3781065377 learned_addr learned my addr 172.21.15.37:0/3781065377 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:18.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ff2800640 1 --2- 172.21.15.37:0/3781065377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde78bb60 0x562fde7971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ff1400640 1 -- 172.21.15.37:0/3781065377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde78bb60 msgr2=0x562fde7971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:18.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ff1400640 1 --2- 172.21.15.37:0/3781065377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde78bb60 0x562fde7971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ff1400640 1 -- 172.21.15.37:0/3781065377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 msgr2=0x562fde797e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:06:18.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ff1400640 1 --2- 172.21.15.37:0/3781065377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 0x562fde797e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ff1400640 1 -- 172.21.15.37:0/3781065377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562fde4c4620 con 0x562fde789120 2024-08-20T05:06:18.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ff1400640 1 --2- 172.21.15.37:0/3781065377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 0x562fde796b20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00c6a0 tx=0x7f9fdc0af050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a2773437f91c3b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:18.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9fd7e00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:06:18.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9fd7e00640 1 -- 172.21.15.37:0/3781065377 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc0abe60 con 0x562fde789120 2024-08-20T05:06:18.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9fd7e00640 1 -- 172.21.15.37:0/3781065377 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9fdc0a7120 con 0x562fde789120 2024-08-20T05:06:18.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 -- 172.21.15.37:0/3781065377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fec036040 con 0x562fde789120 2024-08-20T05:06:18.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9fd7e00640 1 -- 172.21.15.37:0/3781065377 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f9fdc01c040 con 0x562fde789120 2024-08-20T05:06:18.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 10 client.16368 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:18.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 -- 172.21.15.37:0/3781065377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x562fde806970 con 0x562fde789120 2024-08-20T05:06:18.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9fd7e00640 1 -- 172.21.15.37:0/3781065377 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fec036040 con 0x562fde789120 2024-08-20T05:06:18.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9fd7e00640 1 -- 172.21.15.37:0/3781065377 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f9fdc0aad90 con 0x562fde789120 2024-08-20T05:06:18.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 10 client.16368 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:18.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 10 client.16368 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:18.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 20 client.16368 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:18.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 --2- 172.21.15.37:0/3781065377 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562fde807320 0x562fde809740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:18.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 4 client.16368 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:06:18.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.694+0000 7f9ffc046740 1 -- 172.21.15.37:0/3781065377 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562fde6f6c00 con 0x562fde807320 2024-08-20T05:06:18.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.708+0000 7f9ff1e00640 1 --2- 172.21.15.37:0/3781065377 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562fde807320 0x562fde809740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:18.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.715+0000 7f9ff1e00640 1 --2- 172.21.15.37:0/3781065377 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562fde807320 0x562fde809740 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc9f061e861cc2b2 server_cookie=e7e4dd3d2561eaa2 in_seq=0 out_seq=0 2024-08-20T05:06:18.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.715+0000 7f9fd7e00640 10 client.16368 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:18.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.730+0000 7f9fd7e00640 1 -- 172.21.15.37:0/3781065377 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562fde6f6c00 con 0x562fde807320 2024-08-20T05:06:18.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.730+0000 7f9fd7e00640 10 client.16368 handle_command_reply: tid=0 2024-08-20T05:06:18.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.730+0000 7f9ffc046740 1 client.16368 shutdown 2024-08-20T05:06:18.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.730+0000 7f9ffc046740 1 -- 172.21.15.37:0/3781065377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 msgr2=0x562fde796b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.730+0000 7f9ffc046740 1 --2- 172.21.15.37:0/3781065377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 0x562fde796b20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00c6a0 tx=0x7f9fdc0af050 comp rx=0 tx=0).stop 2024-08-20T05:06:18.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.730+0000 7f9ffc046740 1 -- 172.21.15.37:0/3781065377 shutdown_connections 2024-08-20T05:06:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.730+0000 7f9ffc046740 1 --2- 172.21.15.37:0/3781065377 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562fde807320 0x562fde809740 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.730+0000 7f9ffc046740 1 --2- 172.21.15.37:0/3781065377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562fde78bb60 0x562fde7971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.730+0000 7f9ffc046740 1 --2- 172.21.15.37:0/3781065377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562fde789120 0x562fde796b20 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.730+0000 7f9fd7e00640 0 client.16368 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.730+0000 7f9ffc046740 1 --2- 172.21.15.37:0/3781065377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562fde7867f0 0x562fde797e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.730+0000 7f9ffc046740 1 -- 172.21.15.37:0/3781065377 >> 172.21.15.37:0/3781065377 conn(0x562fde781940 msgr2=0x562fde7a2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.730+0000 7f9ffc046740 1 -- 172.21.15.37:0/3781065377 shutdown_connections 2024-08-20T05:06:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.730+0000 7f9ffc046740 1 -- 172.21.15.37:0/3781065377 wait complete. 2024-08-20T05:06:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.730+0000 7f9ffc046740 20 client.16368 trim_cache size 0 max 16384 2024-08-20T05:06:18.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:06:18.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:06:18.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:06:18.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:06:18.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.731+0000 7f9ff3200640 1 -- 172.21.15.37:0/957445773 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9fd80b3bd0 msgr2=0x7f9fd80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.731+0000 7f9ff3200640 1 --2- 172.21.15.37:0/957445773 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9fd80b3bd0 0x7f9fd80b6090 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9fec009960 tx=0x7f9fec02a8e0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.731+0000 7f9ff3200640 1 -- 172.21.15.37:0/957445773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff41035e0 msgr2=0x7f9ff419b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.731+0000 7f9ff3200640 1 --2- 172.21.15.37:0/957445773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff41035e0 0x7f9ff419b0c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00e9f0 tx=0x7f9fdc00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.731+0000 7f9ff3200640 1 -- 172.21.15.37:0/957445773 shutdown_connections 2024-08-20T05:06:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.731+0000 7f9ff3200640 1 --2- 172.21.15.37:0/957445773 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9fd80b3bd0 0x7f9fd80b6090 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.731+0000 7f9ff3200640 1 --2- 172.21.15.37:0/957445773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9ff4103fa0 0x7f9ff419bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.731+0000 7f9ff3200640 1 --2- 172.21.15.37:0/957445773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9ff41035e0 0x7f9ff419b0c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.731+0000 7f9ff3200640 1 --2- 172.21.15.37:0/957445773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ff4102490 0x7f9ff419aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.731+0000 7f9ff3200640 1 -- 172.21.15.37:0/957445773 >> 172.21.15.37:0/957445773 conn(0x7f9ff40fdd30 msgr2=0x7f9ff40750b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.731+0000 7f9ff3200640 1 -- 172.21.15.37:0/957445773 shutdown_connections 2024-08-20T05:06:18.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:18.731+0000 7f9ff3200640 1 -- 172.21.15.37:0/957445773 wait complete. 2024-08-20T05:06:19.332 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T05:06:19.990 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:19 smithi037 ceph-mon[17265]: pgmap v523: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.3 MiB/s wr, 267 op/s 2024-08-20T05:06:19.992 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd2ab4b2f', quiesce took 9.7 seconds. Will release after: 10.150000000000002 2024-08-20T05:06:20.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:19 smithi135 ceph-mon[22342]: pgmap v523: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.3 MiB/s wr, 267 op/s 2024-08-20T05:06:20.142 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:06:20.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:19 smithi130 ceph-mon[22007]: pgmap v523: 129 pgs: 129 active+clean; 1.0 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.3 MiB/s wr, 267 op/s 2024-08-20T05:06:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.704+0000 7f0087200640 1 -- 172.21.15.37:0/3981239074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0088104b00 msgr2=0x7f0088104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.704+0000 7f0087200640 1 --2- 172.21.15.37:0/3981239074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0088104b00 0x7f0088104ee0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0078009900 tx=0x7f007802a410 comp rx=0 tx=0).stop 2024-08-20T05:06:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.704+0000 7f0087200640 1 -- 172.21.15.37:0/3981239074 shutdown_connections 2024-08-20T05:06:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.704+0000 7f0087200640 1 --2- 172.21.15.37:0/3981239074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f008810ae90 0x7f0088111690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.704+0000 7f0087200640 1 --2- 172.21.15.37:0/3981239074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f008810a510 0x7f008810a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.704+0000 7f0087200640 1 --2- 172.21.15.37:0/3981239074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0088104b00 0x7f0088104ee0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.704+0000 7f0087200640 1 -- 172.21.15.37:0/3981239074 >> 172.21.15.37:0/3981239074 conn(0x7f0088100550 msgr2=0x7f0088102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.704+0000 7f0087200640 1 -- 172.21.15.37:0/3981239074 shutdown_connections 2024-08-20T05:06:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.704+0000 7f0087200640 1 -- 172.21.15.37:0/3981239074 wait complete. 2024-08-20T05:06:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.705+0000 7f0087200640 1 Processor -- start 2024-08-20T05:06:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.706+0000 7f0087200640 1 -- start start 2024-08-20T05:06:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.706+0000 7f0087200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0088104b00 0x7f008819af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.706+0000 7f0087200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f008810a510 0x7f008819b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.706+0000 7f0087200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f008810ae90 0x7f00881a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.706+0000 7f0087200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0088114ba0 con 0x7f0088104b00 2024-08-20T05:06:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.706+0000 7f0087200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0088114a20 con 0x7f008810a510 2024-08-20T05:06:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.706+0000 7f0087200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0088114d20 con 0x7f008810ae90 2024-08-20T05:06:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.706+0000 7f0085e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0088104b00 0x7f008819af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.706+0000 7f0085e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0088104b00 0x7f008819af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40840/0 (socket says 172.21.15.37:40840) 2024-08-20T05:06:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.706+0000 7f0085e00640 1 -- 172.21.15.37:0/4248602627 learned_addr learned my addr 172.21.15.37:0/4248602627 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:20.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.706+0000 7f0086800640 1 --2- 172.21.15.37:0/4248602627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f008810ae90 0x7f00881a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.706+0000 7f007fe00640 1 --2- 172.21.15.37:0/4248602627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f008810a510 0x7f008819b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.707+0000 7f0085e00640 1 -- 172.21.15.37:0/4248602627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f008810ae90 msgr2=0x7f00881a0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.707+0000 7f0085e00640 1 --2- 172.21.15.37:0/4248602627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f008810ae90 0x7f00881a0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.707+0000 7f0085e00640 1 -- 172.21.15.37:0/4248602627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f008810a510 msgr2=0x7f008819b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.707+0000 7f0085e00640 1 --2- 172.21.15.37:0/4248602627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f008810a510 0x7f008819b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.707+0000 7f0085e00640 1 -- 172.21.15.37:0/4248602627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00881a0ff0 con 0x7f0088104b00 2024-08-20T05:06:20.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.707+0000 7f0085e00640 1 --2- 172.21.15.37:0/4248602627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0088104b00 0x7f008819af40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0078005ab0 tx=0x7f0078003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:20.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.707+0000 7f007ea00640 1 -- 172.21.15.37:0/4248602627 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007803f070 con 0x7f0088104b00 2024-08-20T05:06:20.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.707+0000 7f007ea00640 1 -- 172.21.15.37:0/4248602627 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0078031b60 con 0x7f0088104b00 2024-08-20T05:06:20.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.707+0000 7f0087200640 1 -- 172.21.15.37:0/4248602627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00881a1280 con 0x7f0088104b00 2024-08-20T05:06:20.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.707+0000 7f007ea00640 1 -- 172.21.15.37:0/4248602627 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0078035030 con 0x7f0088104b00 2024-08-20T05:06:20.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.708+0000 7f0087200640 1 -- 172.21.15.37:0/4248602627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00881a79a0 con 0x7f0088104b00 2024-08-20T05:06:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.710+0000 7f008f45b740 1 Processor -- start 2024-08-20T05:06:20.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.711+0000 7f008f45b740 1 -- start start 2024-08-20T05:06:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.711+0000 7f007ea00640 1 -- 172.21.15.37:0/4248602627 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0078042070 con 0x7f0088104b00 2024-08-20T05:06:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.711+0000 7f008f45b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d8ac0 0x559cab0d8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.711+0000 7f008f45b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d93e0 0x559cab0e4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.711+0000 7f008f45b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 0x559cab0e7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.711+0000 7f008f45b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559cab04eaa0 con 0x559cab0e5370 2024-08-20T05:06:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.711+0000 7f008f45b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559cab03dfa0 con 0x559cab0d8ac0 2024-08-20T05:06:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.711+0000 7f008f45b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559cab041fe0 con 0x559cab0d93e0 2024-08-20T05:06:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.711+0000 7f0086800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d8ac0 0x559cab0d8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.711+0000 7f0086800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d8ac0 0x559cab0d8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56608/0 (socket says 172.21.15.37:56608) 2024-08-20T05:06:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.711+0000 7f0086800640 1 -- 172.21.15.37:0/514664882 learned_addr learned my addr 172.21.15.37:0/514664882 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.712+0000 7f007fe00640 1 --2- 172.21.15.37:0/514664882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 0x559cab0e7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.712+0000 7f0085e00640 1 --2- 172.21.15.37:0/514664882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d93e0 0x559cab0e4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.712+0000 7f0086800640 1 -- 172.21.15.37:0/514664882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d93e0 msgr2=0x559cab0e4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.712+0000 7f0086800640 1 --2- 172.21.15.37:0/514664882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d93e0 0x559cab0e4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.712+0000 7f0086800640 1 -- 172.21.15.37:0/514664882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 msgr2=0x559cab0e7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.712+0000 7f0086800640 1 --2- 172.21.15.37:0/514664882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 0x559cab0e7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.712+0000 7f0086800640 1 -- 172.21.15.37:0/514664882 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559caafe4420 con 0x559cab0d8ac0 2024-08-20T05:06:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.712+0000 7f0086800640 1 --2- 172.21.15.37:0/514664882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d8ac0 0x559cab0d8ea0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0080009fd0 tx=0x7f00800118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88d36a823c9fa778 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.712+0000 7f0077000640 1 -- 172.21.15.37:0/514664882 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0080004d20 con 0x559cab0d8ac0 2024-08-20T05:06:20.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.713+0000 7f0077000640 1 -- 172.21.15.37:0/514664882 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0080004050 con 0x559cab0d8ac0 2024-08-20T05:06:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.713+0000 7f0077000640 1 -- 172.21.15.37:0/514664882 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0080005280 con 0x559cab0d8ac0 2024-08-20T05:06:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.713+0000 7f007ea00640 1 --2- 172.21.15.37:0/4248602627 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f006c0b3cf0 0x7f006c0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.713+0000 7f007ea00640 1 -- 172.21.15.37:0/4248602627 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0078104600 con 0x7f0088104b00 2024-08-20T05:06:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.713+0000 7f008f45b740 1 -- 172.21.15.37:0/514664882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d8ac0 msgr2=0x559cab0d8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.713+0000 7f0085e00640 1 --2- 172.21.15.37:0/4248602627 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f006c0b3cf0 0x7f006c0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.713+0000 7f008f45b740 1 --2- 172.21.15.37:0/514664882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d8ac0 0x559cab0d8ea0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0080009fd0 tx=0x7f00800118d0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.713+0000 7f008f45b740 1 -- 172.21.15.37:0/514664882 shutdown_connections 2024-08-20T05:06:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.713+0000 7f008f45b740 1 --2- 172.21.15.37:0/514664882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 0x559cab0e7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.713+0000 7f008f45b740 1 --2- 172.21.15.37:0/514664882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d93e0 0x559cab0e4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.713+0000 7f008f45b740 1 --2- 172.21.15.37:0/514664882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d8ac0 0x559cab0d8ea0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.714+0000 7f008f45b740 1 -- 172.21.15.37:0/514664882 >> 172.21.15.37:0/514664882 conn(0x559cab0d68f0 msgr2=0x559cab0d7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.714+0000 7f008f45b740 1 -- 172.21.15.37:0/514664882 shutdown_connections 2024-08-20T05:06:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.714+0000 7f008f45b740 1 -- 172.21.15.37:0/514664882 wait complete. 2024-08-20T05:06:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.714+0000 7f0085e00640 1 --2- 172.21.15.37:0/4248602627 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f006c0b3cf0 0x7f006c0b61b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f00780cb190 tx=0x7f0078009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.714+0000 7f008f45b740 1 -- start start 2024-08-20T05:06:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.714+0000 7f008f45b740 1 Processor -- start 2024-08-20T05:06:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.715+0000 7f008f45b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0d8ac0 0x559cab0e4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.715+0000 7f008f45b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d93e0 0x559cab0e1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.715+0000 7f008f45b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0e5370 0x559cab0e24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.715+0000 7f008f45b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559caaea0700 con 0x559cab0d8ac0 2024-08-20T05:06:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.715+0000 7f008f45b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559caafd9290 con 0x559cab0e5370 2024-08-20T05:06:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.715+0000 7f008f45b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559cab0e7ff0 con 0x559cab0d93e0 2024-08-20T05:06:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.715+0000 7f008f45b740 10 client.0 _ll_register_callbacks cb 0x559cab0381c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:20.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.715+0000 7f0086800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0d8ac0 0x559cab0e4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.715+0000 7f0086800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0d8ac0 0x559cab0e4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40864/0 (socket says 172.21.15.37:40864) 2024-08-20T05:06:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.715+0000 7f0086800640 1 -- 172.21.15.37:0/875323455 learned_addr learned my addr 172.21.15.37:0/875323455 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.715+0000 7f007fe00640 1 --2- 172.21.15.37:0/875323455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d93e0 0x559cab0e1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.715+0000 7f0086800640 1 --2- 172.21.15.37:0/875323455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0e5370 0x559cab0e24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.715+0000 7f0086800640 1 -- 172.21.15.37:0/875323455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d93e0 msgr2=0x559cab0e1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.716+0000 7f0086800640 1 --2- 172.21.15.37:0/875323455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d93e0 0x559cab0e1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.716+0000 7f0086800640 1 -- 172.21.15.37:0/875323455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0e5370 msgr2=0x559cab0e24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.716+0000 7f0086800640 1 --2- 172.21.15.37:0/875323455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0e5370 0x559cab0e24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.716+0000 7f0086800640 1 -- 172.21.15.37:0/875323455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559caad9d650 con 0x559cab0d8ac0 2024-08-20T05:06:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.716+0000 7f0086800640 1 --2- 172.21.15.37:0/875323455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0d8ac0 0x559cab0e4b30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f00800049d0 tx=0x7f0080003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12b00a3d7c53064 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.716+0000 7f006b400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:06:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.716+0000 7f006b400640 1 -- 172.21.15.37:0/875323455 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0080004e50 con 0x559cab0d8ac0 2024-08-20T05:06:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.716+0000 7f006b400640 1 -- 172.21.15.37:0/875323455 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0080005040 con 0x559cab0d8ac0 2024-08-20T05:06:20.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.716+0000 7f008f45b740 1 -- 172.21.15.37:0/875323455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0080004050 con 0x559cab0d8ac0 2024-08-20T05:06:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.716+0000 7f006b400640 1 -- 172.21.15.37:0/875323455 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0080035050 con 0x559cab0d8ac0 2024-08-20T05:06:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.716+0000 7f008f45b740 10 client.16380 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.716+0000 7f008f45b740 1 -- 172.21.15.37:0/875323455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x559cab0f3860 con 0x559cab0d8ac0 2024-08-20T05:06:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.717+0000 7f006b400640 1 -- 172.21.15.37:0/875323455 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0080004050 con 0x559cab0d8ac0 2024-08-20T05:06:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.717+0000 7f006b400640 1 -- 172.21.15.37:0/875323455 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f008000f7e0 con 0x559cab0d8ac0 2024-08-20T05:06:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.717+0000 7f008f45b740 10 client.16380 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.717+0000 7f008f45b740 10 client.16380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.717+0000 7f008f45b740 20 client.16380 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.717+0000 7f008f45b740 1 --2- 172.21.15.37:0/875323455 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559cab0f4c60 0x559cab0f7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.717+0000 7f008f45b740 4 client.16380 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:06:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.717+0000 7f008f45b740 1 -- 172.21.15.37:0/875323455 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559cab0509f0 con 0x559cab0f4c60 2024-08-20T05:06:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.718+0000 7f007fe00640 1 --2- 172.21.15.37:0/875323455 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559cab0f4c60 0x559cab0f7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.718+0000 7f007fe00640 1 --2- 172.21.15.37:0/875323455 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559cab0f4c60 0x559cab0f7050 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0f476e43f8514d9 server_cookie=9f6a23a5e4eeaf0c in_seq=0 out_seq=0 2024-08-20T05:06:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.718+0000 7f006b400640 10 client.16380 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.719+0000 7f006b400640 1 -- 172.21.15.37:0/875323455 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559cab0509f0 con 0x559cab0f4c60 2024-08-20T05:06:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.719+0000 7f006b400640 10 client.16380 handle_command_reply: tid=0 2024-08-20T05:06:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.719+0000 7f008f45b740 1 client.16380 shutdown 2024-08-20T05:06:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.719+0000 7f008f45b740 1 -- 172.21.15.37:0/875323455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0d8ac0 msgr2=0x559cab0e4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.719+0000 7f008f45b740 1 --2- 172.21.15.37:0/875323455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0d8ac0 0x559cab0e4b30 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f00800049d0 tx=0x7f0080003f70 comp rx=0 tx=0).stop 2024-08-20T05:06:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.720+0000 7f008f45b740 1 -- 172.21.15.37:0/875323455 shutdown_connections 2024-08-20T05:06:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.720+0000 7f008f45b740 1 --2- 172.21.15.37:0/875323455 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559cab0f4c60 0x559cab0f7050 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.720+0000 7f008f45b740 1 --2- 172.21.15.37:0/875323455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0e5370 0x559cab0e24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.720+0000 7f008f45b740 1 --2- 172.21.15.37:0/875323455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d93e0 0x559cab0e1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.720+0000 7f008f45b740 1 --2- 172.21.15.37:0/875323455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0d8ac0 0x559cab0e4b30 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.720+0000 7f008f45b740 1 -- 172.21.15.37:0/875323455 >> 172.21.15.37:0/875323455 conn(0x559cab0d68f0 msgr2=0x559cab0dc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:20.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.720+0000 7f006b400640 0 client.16380 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:20.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.720+0000 7f008f45b740 1 -- 172.21.15.37:0/875323455 shutdown_connections 2024-08-20T05:06:20.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.720+0000 7f008f45b740 1 -- 172.21.15.37:0/875323455 wait complete. 2024-08-20T05:06:20.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.720+0000 7f008f45b740 20 client.16380 trim_cache size 0 max 16384 2024-08-20T05:06:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.734+0000 7f008f45b740 1 Processor -- start 2024-08-20T05:06:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.734+0000 7f008f45b740 1 -- start start 2024-08-20T05:06:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.734+0000 7f008f45b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d8ac0 0x559cab0f1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.734+0000 7f008f45b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d93e0 0x559cab0fc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.734+0000 7f008f45b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 0x559cab0fcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.734+0000 7f008f45b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f00881b17f0 con 0x559cab0e5370 2024-08-20T05:06:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.734+0000 7f008f45b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f00881b3330 con 0x559cab0d93e0 2024-08-20T05:06:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.734+0000 7f008f45b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f00881b1ec0 con 0x559cab0d8ac0 2024-08-20T05:06:20.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.735+0000 7f007fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d93e0 0x559cab0fc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.735+0000 7f0086800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 0x559cab0fcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.735+0000 7f007fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d93e0 0x559cab0fc810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56612/0 (socket says 172.21.15.37:56612) 2024-08-20T05:06:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.735+0000 7f007fe00640 1 -- 172.21.15.37:0/1565373902 learned_addr learned my addr 172.21.15.37:0/1565373902 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.735+0000 7f0086800640 1 --2- 172.21.15.37:0/1565373902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d8ac0 0x559cab0f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.735+0000 7f007fe00640 1 -- 172.21.15.37:0/1565373902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d8ac0 msgr2=0x559cab0f1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.735+0000 7f007fe00640 1 --2- 172.21.15.37:0/1565373902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d8ac0 0x559cab0f1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.735+0000 7f007fe00640 1 -- 172.21.15.37:0/1565373902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 msgr2=0x559cab0fcd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.735+0000 7f007fe00640 1 --2- 172.21.15.37:0/1565373902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 0x559cab0fcd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.735+0000 7f007fe00640 1 -- 172.21.15.37:0/1565373902 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559cab0e1d30 con 0x559cab0d93e0 2024-08-20T05:06:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.735+0000 7f0086800640 1 --2- 172.21.15.37:0/1565373902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 0x559cab0fcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:06:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.735+0000 7f007fe00640 1 --2- 172.21.15.37:0/1565373902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d93e0 0x559cab0fc810 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0070009cc0 tx=0x7f00700046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27e8c217a49ea65 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:20.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.736+0000 7f0076600640 1 -- 172.21.15.37:0/1565373902 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0070010430 con 0x559cab0d93e0 2024-08-20T05:06:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.736+0000 7f0076600640 1 -- 172.21.15.37:0/1565373902 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0070010a80 con 0x559cab0d93e0 2024-08-20T05:06:20.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.736+0000 7f0076600640 1 -- 172.21.15.37:0/1565373902 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f007001e950 con 0x559cab0d93e0 2024-08-20T05:06:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.736+0000 7f008f45b740 1 -- 172.21.15.37:0/1565373902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d93e0 msgr2=0x559cab0fc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.736+0000 7f008f45b740 1 --2- 172.21.15.37:0/1565373902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d93e0 0x559cab0fc810 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0070009cc0 tx=0x7f00700046c0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.736+0000 7f008f45b740 1 -- 172.21.15.37:0/1565373902 shutdown_connections 2024-08-20T05:06:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.736+0000 7f008f45b740 1 --2- 172.21.15.37:0/1565373902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 0x559cab0fcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.736+0000 7f008f45b740 1 --2- 172.21.15.37:0/1565373902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d93e0 0x559cab0fc810 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.737+0000 7f008f45b740 1 --2- 172.21.15.37:0/1565373902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d8ac0 0x559cab0f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.737+0000 7f008f45b740 1 -- 172.21.15.37:0/1565373902 >> 172.21.15.37:0/1565373902 conn(0x559cab0d68f0 msgr2=0x559cab0dd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:20.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.737+0000 7f008f45b740 1 -- 172.21.15.37:0/1565373902 shutdown_connections 2024-08-20T05:06:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.737+0000 7f008f45b740 1 -- 172.21.15.37:0/1565373902 wait complete. 2024-08-20T05:06:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.737+0000 7f008f45b740 1 -- start start 2024-08-20T05:06:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.737+0000 7f008f45b740 1 Processor -- start 2024-08-20T05:06:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.738+0000 7f008f45b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d8ac0 0x559cab0e83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.738+0000 7f008f45b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d93e0 0x559cab0e8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.738+0000 7f008f45b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 0x559cab15d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.738+0000 7f008f45b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f00881b2c60 con 0x559cab0e5370 2024-08-20T05:06:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.738+0000 7f008f45b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f00881b2590 con 0x559cab0d93e0 2024-08-20T05:06:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.738+0000 7f008f45b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f00881af7d0 con 0x559cab0d8ac0 2024-08-20T05:06:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.738+0000 7f008f45b740 10 client.0 _ll_register_callbacks cb 0x7f0070009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.738+0000 7f0086800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 0x559cab15d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.738+0000 7f0086800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 0x559cab15d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40886/0 (socket says 172.21.15.37:40886) 2024-08-20T05:06:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.738+0000 7f0086800640 1 -- 172.21.15.37:0/191221171 learned_addr learned my addr 172.21.15.37:0/191221171 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.738+0000 7f007fe00640 1 --2- 172.21.15.37:0/191221171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d93e0 0x559cab0e8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.738+0000 7f0086800640 1 --2- 172.21.15.37:0/191221171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d8ac0 0x559cab0e83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.739+0000 7f007fe00640 1 -- 172.21.15.37:0/191221171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d8ac0 msgr2=0x559cab0e83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.739+0000 7f007fe00640 1 --2- 172.21.15.37:0/191221171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d8ac0 0x559cab0e83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.739+0000 7f007fe00640 1 -- 172.21.15.37:0/191221171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 msgr2=0x559cab15d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.739+0000 7f007fe00640 1 --2- 172.21.15.37:0/191221171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 0x559cab15d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.739+0000 7f007fe00640 1 -- 172.21.15.37:0/191221171 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559cab0e91e0 con 0x559cab0d93e0 2024-08-20T05:06:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.739+0000 7f0086800640 1 --2- 172.21.15.37:0/191221171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 0x559cab15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.739+0000 7f007fe00640 1 --2- 172.21.15.37:0/191221171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d93e0 0x559cab0e8930 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0070009c90 tx=0x7f0070005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=778a3f65cc694859 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.739+0000 7f006b400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:06:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.739+0000 7f006b400640 1 -- 172.21.15.37:0/191221171 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0070035060 con 0x559cab0d93e0 2024-08-20T05:06:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.739+0000 7f008f45b740 1 -- 172.21.15.37:0/191221171 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0070010a80 con 0x559cab0d93e0 2024-08-20T05:06:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.739+0000 7f006b400640 1 -- 172.21.15.37:0/191221171 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0070003c70 con 0x559cab0d93e0 2024-08-20T05:06:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.739+0000 7f006b400640 1 -- 172.21.15.37:0/191221171 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f007003c050 con 0x559cab0d93e0 2024-08-20T05:06:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.740+0000 7f008f45b740 10 client.26624 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.740+0000 7f008f45b740 1 -- 172.21.15.37:0/191221171 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x559cab15ed60 con 0x559cab0d93e0 2024-08-20T05:06:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.740+0000 7f006b400640 1 -- 172.21.15.37:0/191221171 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0070010a80 con 0x559cab0d93e0 2024-08-20T05:06:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.740+0000 7f006b400640 1 -- 172.21.15.37:0/191221171 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f007001eac0 con 0x559cab0d93e0 2024-08-20T05:06:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.740+0000 7f008f45b740 10 client.26624 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.740+0000 7f008f45b740 10 client.26624 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:20.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.740+0000 7f008f45b740 20 client.26624 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.740+0000 7f008f45b740 1 --2- 172.21.15.37:0/191221171 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559cab15f400 0x559cab161820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.740+0000 7f008f45b740 4 client.26624 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:06:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.740+0000 7f008f45b740 1 -- 172.21.15.37:0/191221171 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559cab04c490 con 0x559cab15f400 2024-08-20T05:06:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.740+0000 7f0086800640 1 --2- 172.21.15.37:0/191221171 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559cab15f400 0x559cab161820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.741+0000 7f0086800640 1 --2- 172.21.15.37:0/191221171 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559cab15f400 0x559cab161820 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e625efc1f0c11e7 server_cookie=b78cf86bb1e1dcb0 in_seq=0 out_seq=0 2024-08-20T05:06:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.741+0000 7f006b400640 10 client.26624 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.741+0000 7f006b400640 1 -- 172.21.15.37:0/191221171 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559cab04c490 con 0x559cab15f400 2024-08-20T05:06:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.741+0000 7f006b400640 10 client.26624 handle_command_reply: tid=0 2024-08-20T05:06:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.741+0000 7f008f45b740 1 client.26624 shutdown 2024-08-20T05:06:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.741+0000 7f008f45b740 1 -- 172.21.15.37:0/191221171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d93e0 msgr2=0x559cab0e8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.741+0000 7f008f45b740 1 --2- 172.21.15.37:0/191221171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d93e0 0x559cab0e8930 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0070009c90 tx=0x7f0070005fa0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.741+0000 7f008f45b740 1 -- 172.21.15.37:0/191221171 shutdown_connections 2024-08-20T05:06:20.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.741+0000 7f008f45b740 1 --2- 172.21.15.37:0/191221171 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559cab15f400 0x559cab161820 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.741+0000 7f008f45b740 1 --2- 172.21.15.37:0/191221171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559cab0e5370 0x559cab15d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.741+0000 7f008f45b740 1 --2- 172.21.15.37:0/191221171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559cab0d93e0 0x559cab0e8930 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.742+0000 7f008f45b740 1 --2- 172.21.15.37:0/191221171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559cab0d8ac0 0x559cab0e83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.742+0000 7f006b400640 0 client.26624 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.742+0000 7f008f45b740 1 -- 172.21.15.37:0/191221171 >> 172.21.15.37:0/191221171 conn(0x559cab0d68f0 msgr2=0x559cab0d52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.742+0000 7f008f45b740 1 -- 172.21.15.37:0/191221171 shutdown_connections 2024-08-20T05:06:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.742+0000 7f008f45b740 1 -- 172.21.15.37:0/191221171 wait complete. 2024-08-20T05:06:20.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.742+0000 7f008f45b740 20 client.26624 trim_cache size 0 max 16384 2024-08-20T05:06:20.747 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:06:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.743+0000 7f0087200640 1 -- 172.21.15.37:0/4248602627 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f006c0b3cf0 msgr2=0x7f006c0b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.743+0000 7f0087200640 1 --2- 172.21.15.37:0/4248602627 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f006c0b3cf0 0x7f006c0b61b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f00780cb190 tx=0x7f0078009260 comp rx=0 tx=0).stop 2024-08-20T05:06:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.743+0000 7f0087200640 1 -- 172.21.15.37:0/4248602627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0088104b00 msgr2=0x7f008819af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.743+0000 7f0087200640 1 --2- 172.21.15.37:0/4248602627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0088104b00 0x7f008819af40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0078005ab0 tx=0x7f0078003c10 comp rx=0 tx=0).stop 2024-08-20T05:06:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.743+0000 7f0087200640 1 -- 172.21.15.37:0/4248602627 shutdown_connections 2024-08-20T05:06:20.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.743+0000 7f0087200640 1 --2- 172.21.15.37:0/4248602627 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f006c0b3cf0 0x7f006c0b61b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.743+0000 7f0087200640 1 --2- 172.21.15.37:0/4248602627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f008810ae90 0x7f00881a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.743+0000 7f0087200640 1 --2- 172.21.15.37:0/4248602627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f008810a510 0x7f008819b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.743+0000 7f0087200640 1 --2- 172.21.15.37:0/4248602627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0088104b00 0x7f008819af40 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.743+0000 7f0087200640 1 -- 172.21.15.37:0/4248602627 >> 172.21.15.37:0/4248602627 conn(0x7f0088100550 msgr2=0x7f0088109c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.743+0000 7f0087200640 1 -- 172.21.15.37:0/4248602627 shutdown_connections 2024-08-20T05:06:20.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:20.743+0000 7f0087200640 1 -- 172.21.15.37:0/4248602627 wait complete. 2024-08-20T05:06:22.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:21 smithi037 ceph-mon[17265]: pgmap v524: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 3.4 MiB/s wr, 397 op/s 2024-08-20T05:06:22.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:21 smithi135 ceph-mon[22342]: pgmap v524: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 3.4 MiB/s wr, 397 op/s 2024-08-20T05:06:22.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:21 smithi130 ceph-mon[22007]: pgmap v524: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 3.4 MiB/s wr, 397 op/s 2024-08-20T05:06:23.042 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 205.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:06:23.409 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T05:06:23.410 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T05:06:23.801 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:06:24.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:23 smithi037 ceph-mon[17265]: pgmap v525: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 3.5 MiB/s wr, 407 op/s 2024-08-20T05:06:24.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:23 smithi135 ceph-mon[22342]: pgmap v525: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 3.5 MiB/s wr, 407 op/s 2024-08-20T05:06:24.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:23 smithi130 ceph-mon[22007]: pgmap v525: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 3.5 MiB/s wr, 407 op/s 2024-08-20T05:06:24.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.384+0000 7fdd2a000640 1 -- 172.21.15.37:0/1969488976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd2410eaf0 msgr2=0x7fdd2410ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:24.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.384+0000 7fdd2a000640 1 --2- 172.21.15.37:0/1969488976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd2410eaf0 0x7fdd2410ef30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009900 tx=0x7fdd0c02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.384+0000 7fdd2a000640 1 -- 172.21.15.37:0/1969488976 shutdown_connections 2024-08-20T05:06:24.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.384+0000 7fdd2a000640 1 --2- 172.21.15.37:0/1969488976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd2410f470 0x7fdd24115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.384+0000 7fdd2a000640 1 --2- 172.21.15.37:0/1969488976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd2410eaf0 0x7fdd2410ef30 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.384+0000 7fdd2a000640 1 --2- 172.21.15.37:0/1969488976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd241090e0 0x7fdd241094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.384+0000 7fdd2a000640 1 -- 172.21.15.37:0/1969488976 >> 172.21.15.37:0/1969488976 conn(0x7fdd24078760 msgr2=0x7fdd2407ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:24.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.384+0000 7fdd2a000640 1 -- 172.21.15.37:0/1969488976 shutdown_connections 2024-08-20T05:06:24.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.385+0000 7fdd2a000640 1 -- 172.21.15.37:0/1969488976 wait complete. 2024-08-20T05:06:24.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.386+0000 7fdd2a000640 1 Processor -- start 2024-08-20T05:06:24.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.388+0000 7fdd2a000640 1 -- start start 2024-08-20T05:06:24.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.390+0000 7fdd2a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd241090e0 0x7fdd2419f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.390+0000 7fdd2a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd2410eaf0 0x7fdd2419fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.390+0000 7fdd2a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd2410f470 0x7fdd241a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.390+0000 7fdd2a000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241190e0 con 0x7fdd2410f470 2024-08-20T05:06:24.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.390+0000 7fdd2a000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdd24118f60 con 0x7fdd241090e0 2024-08-20T05:06:24.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.390+0000 7fdd2a000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdd24119260 con 0x7fdd2410eaf0 2024-08-20T05:06:24.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.391+0000 7fdd1aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd2410eaf0 0x7fdd2419fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:24.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.391+0000 7fdd1aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd2410eaf0 0x7fdd2419fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42442/0 (socket says 172.21.15.37:42442) 2024-08-20T05:06:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.391+0000 7fdd1aa00640 1 -- 172.21.15.37:0/696804352 learned_addr learned my addr 172.21.15.37:0/696804352 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.391+0000 7fdd23e00640 1 --2- 172.21.15.37:0/696804352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd2410f470 0x7fdd241a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.393+0000 7fdd23400640 1 --2- 172.21.15.37:0/696804352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd241090e0 0x7fdd2419f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.395+0000 7fdd1aa00640 1 -- 172.21.15.37:0/696804352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd241090e0 msgr2=0x7fdd2419f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.395+0000 7fdd1aa00640 1 --2- 172.21.15.37:0/696804352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd241090e0 0x7fdd2419f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.395+0000 7fdd1aa00640 1 -- 172.21.15.37:0/696804352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd2410f470 msgr2=0x7fdd241a4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.395+0000 7fdd1aa00640 1 --2- 172.21.15.37:0/696804352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd2410f470 0x7fdd241a4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.395+0000 7fdd1aa00640 1 -- 172.21.15.37:0/696804352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd241a5680 con 0x7fdd2410eaf0 2024-08-20T05:06:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.396+0000 7fdd1aa00640 1 --2- 172.21.15.37:0/696804352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd2410eaf0 0x7fdd2419fb10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c005ab0 tx=0x7fdd0c003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.396+0000 7fdd20c00640 1 -- 172.21.15.37:0/696804352 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c03f070 con 0x7fdd2410eaf0 2024-08-20T05:06:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.397+0000 7fdd20c00640 1 -- 172.21.15.37:0/696804352 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd0c031d60 con 0x7fdd2410eaf0 2024-08-20T05:06:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.397+0000 7fdd20c00640 1 -- 172.21.15.37:0/696804352 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c035030 con 0x7fdd2410eaf0 2024-08-20T05:06:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.398+0000 7fdd2a000640 1 -- 172.21.15.37:0/696804352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd241a5910 con 0x7fdd2410eaf0 2024-08-20T05:06:24.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.398+0000 7fdd2a000640 1 -- 172.21.15.37:0/696804352 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd241ac030 con 0x7fdd2410eaf0 2024-08-20T05:06:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.405+0000 7fdd2cbf0740 1 Processor -- start 2024-08-20T05:06:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.405+0000 7fdd2cbf0740 1 -- start start 2024-08-20T05:06:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.405+0000 7fdd2cbf0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a5839d0 0x561f3a583db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.405+0000 7fdd2cbf0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5842f0 0x561f3a58fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.405+0000 7fdd2cbf0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a590280 0x561f3a592670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.405+0000 7fdd2cbf0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f3a4fa870 con 0x561f3a590280 2024-08-20T05:06:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.405+0000 7fdd2cbf0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561f3a4e9d70 con 0x561f3a5839d0 2024-08-20T05:06:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.406+0000 7fdd2cbf0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561f3a4eddb0 con 0x561f3a5842f0 2024-08-20T05:06:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.406+0000 7fdd23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5842f0 0x561f3a58fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.406+0000 7fdd23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5842f0 0x561f3a58fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42450/0 (socket says 172.21.15.37:42450) 2024-08-20T05:06:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.406+0000 7fdd23400640 1 -- 172.21.15.37:0/173629842 learned_addr learned my addr 172.21.15.37:0/173629842 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.407+0000 7fdd23e00640 1 --2- 172.21.15.37:0/173629842 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a5839d0 0x561f3a583db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:24.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.407+0000 7fdd23400640 1 -- 172.21.15.37:0/173629842 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a5839d0 msgr2=0x561f3a583db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.407+0000 7fdd23400640 1 --2- 172.21.15.37:0/173629842 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a5839d0 0x561f3a583db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.407+0000 7fdd23400640 1 -- 172.21.15.37:0/173629842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a590280 msgr2=0x561f3a592670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:06:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.407+0000 7fdd23400640 1 --2- 172.21.15.37:0/173629842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a590280 0x561f3a592670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.407+0000 7fdd23400640 1 -- 172.21.15.37:0/173629842 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f3a249930 con 0x561f3a5842f0 2024-08-20T05:06:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.407+0000 7fdd23400640 1 --2- 172.21.15.37:0/173629842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5842f0 0x561f3a58fd40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009cc0 tx=0x7fdd140117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87d4caf1a75e952e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.408+0000 7fdd13e00640 1 -- 172.21.15.37:0/173629842 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1401b470 con 0x561f3a5842f0 2024-08-20T05:06:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.408+0000 7fdd13e00640 1 -- 172.21.15.37:0/173629842 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd14016070 con 0x561f3a5842f0 2024-08-20T05:06:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.408+0000 7fdd13e00640 1 -- 172.21.15.37:0/173629842 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14012a50 con 0x561f3a5842f0 2024-08-20T05:06:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.408+0000 7fdd20c00640 1 -- 172.21.15.37:0/696804352 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdd0c03bd10 con 0x7fdd2410eaf0 2024-08-20T05:06:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.410+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/173629842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5842f0 msgr2=0x561f3a58fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.410+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/173629842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5842f0 0x561f3a58fd40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009cc0 tx=0x7fdd140117b0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.410+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/173629842 shutdown_connections 2024-08-20T05:06:24.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.410+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/173629842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a590280 0x561f3a592670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.410+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/173629842 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5842f0 0x561f3a58fd40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.410+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/173629842 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a5839d0 0x561f3a583db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.410+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/173629842 >> 172.21.15.37:0/173629842 conn(0x561f3a581800 msgr2=0x561f3a5829a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.410+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/173629842 shutdown_connections 2024-08-20T05:06:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.410+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/173629842 wait complete. 2024-08-20T05:06:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.411+0000 7fdd2cbf0740 1 -- start start 2024-08-20T05:06:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.411+0000 7fdd2cbf0740 1 Processor -- start 2024-08-20T05:06:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.412+0000 7fdd2cbf0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5839d0 0x561f3a58d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.412+0000 7fdd2cbf0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a590280 0x561f3a58d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.412+0000 7fdd2cbf0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a58dc50 0x561f3a5ad340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.412+0000 7fdd2cbf0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f3a34c890 con 0x561f3a58dc50 2024-08-20T05:06:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.412+0000 7fdd2cbf0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561f3a470b00 con 0x561f3a590280 2024-08-20T05:06:24.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.412+0000 7fdd2cbf0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561f3a5a3fe0 con 0x561f3a5839d0 2024-08-20T05:06:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.412+0000 7fdd2cbf0740 10 client.0 _ll_register_callbacks cb 0x561f3a4e4dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.413+0000 7fdd20c00640 1 --2- 172.21.15.37:0/696804352 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd080b3b60 0x7fdd080b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.413+0000 7fdd23400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a590280 0x561f3a58d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.413+0000 7fdd23400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a590280 0x561f3a58d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:60672/0 (socket says 172.21.15.37:60672) 2024-08-20T05:06:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.413+0000 7fdd23400640 1 -- 172.21.15.37:0/324333370 learned_addr learned my addr 172.21.15.37:0/324333370 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.413+0000 7fdd20c00640 1 -- 172.21.15.37:0/696804352 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fdd0c104820 con 0x7fdd2410eaf0 2024-08-20T05:06:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.413+0000 7fdd23e00640 1 --2- 172.21.15.37:0/324333370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5839d0 0x561f3a58d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.414+0000 7fdd23400640 1 -- 172.21.15.37:0/324333370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5839d0 msgr2=0x561f3a58d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.414+0000 7fdd23400640 1 --2- 172.21.15.37:0/324333370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5839d0 0x561f3a58d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.414+0000 7fdd23400640 1 -- 172.21.15.37:0/324333370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a58dc50 msgr2=0x561f3a5ad340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.414+0000 7fdd23400640 1 --2- 172.21.15.37:0/324333370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a58dc50 0x561f3a5ad340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.414+0000 7fdd23400640 1 -- 172.21.15.37:0/324333370 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f3a4b1a30 con 0x561f3a590280 2024-08-20T05:06:24.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.414+0000 7fdd23e00640 1 --2- 172.21.15.37:0/696804352 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd080b3b60 0x7fdd080b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.414+0000 7fdd23400640 1 --2- 172.21.15.37:0/324333370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a590280 0x561f3a58d710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdd14012630 tx=0x7fdd140056d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e8f03f0445bf87d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.414+0000 7fdd10c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:06:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.415+0000 7fdd10c00640 1 -- 172.21.15.37:0/324333370 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14027020 con 0x561f3a590280 2024-08-20T05:06:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.415+0000 7fdd10c00640 1 -- 172.21.15.37:0/324333370 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fdd1401b670 con 0x561f3a590280 2024-08-20T05:06:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.415+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/324333370 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd14016070 con 0x561f3a590280 2024-08-20T05:06:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.415+0000 7fdd10c00640 1 -- 172.21.15.37:0/324333370 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fdd14004020 con 0x561f3a590280 2024-08-20T05:06:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.415+0000 7fdd2cbf0740 10 client.26633 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.415+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/324333370 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x561f3a5aff40 con 0x561f3a590280 2024-08-20T05:06:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.416+0000 7fdd10c00640 1 -- 172.21.15.37:0/324333370 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd14016070 con 0x561f3a590280 2024-08-20T05:06:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.416+0000 7fdd10c00640 1 -- 172.21.15.37:0/324333370 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fdd140035f0 con 0x561f3a590280 2024-08-20T05:06:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.416+0000 7fdd2cbf0740 10 client.26633 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.416+0000 7fdd2cbf0740 10 client.26633 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:24.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.416+0000 7fdd2cbf0740 20 client.26633 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.416+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/324333370 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561f3a5b12f0 0x561f3a5b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.416+0000 7fdd2cbf0740 4 client.26633 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:06:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.416+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/324333370 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f3a4fc7c0 con 0x561f3a5b12f0 2024-08-20T05:06:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.417+0000 7fdd1aa00640 1 --2- 172.21.15.37:0/324333370 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561f3a5b12f0 0x561f3a5b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.420+0000 7fdd10c00640 10 client.26633 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.420+0000 7fdd1aa00640 1 --2- 172.21.15.37:0/324333370 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561f3a5b12f0 0x561f3a5b36e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2902c63c463eaeb5 server_cookie=302af4ab679f30c8 in_seq=0 out_seq=0 2024-08-20T05:06:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.423+0000 7fdd10c00640 1 -- 172.21.15.37:0/324333370 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561f3a4fc7c0 con 0x561f3a5b12f0 2024-08-20T05:06:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.423+0000 7fdd10c00640 10 client.26633 handle_command_reply: tid=0 2024-08-20T05:06:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.423+0000 7fdd2cbf0740 1 client.26633 shutdown 2024-08-20T05:06:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.425+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/324333370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a590280 msgr2=0x561f3a58d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.425+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/324333370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a590280 0x561f3a58d710 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdd14012630 tx=0x7fdd140056d0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.426+0000 7fdd23e00640 1 --2- 172.21.15.37:0/696804352 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd080b3b60 0x7fdd080b6020 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c005c40 tx=0x7fdd1c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:24.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.426+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/324333370 shutdown_connections 2024-08-20T05:06:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.426+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/324333370 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561f3a5b12f0 0x561f3a5b36e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.426+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/324333370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a58dc50 0x561f3a5ad340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.426+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/324333370 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a590280 0x561f3a58d710 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.426+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/324333370 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5839d0 0x561f3a58d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.427+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/324333370 >> 172.21.15.37:0/324333370 conn(0x561f3a581800 msgr2=0x561f3a5873a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.427+0000 7fdd10c00640 0 client.26633 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.427+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/324333370 shutdown_connections 2024-08-20T05:06:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.427+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/324333370 wait complete. 2024-08-20T05:06:24.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.428+0000 7fdd2cbf0740 20 client.26633 trim_cache size 0 max 16384 2024-08-20T05:06:24.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.498+0000 7fdd2cbf0740 1 Processor -- start 2024-08-20T05:06:24.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.501+0000 7fdd2cbf0740 1 -- start start 2024-08-20T05:06:24.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.502+0000 7fdd2cbf0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a5839d0 0x561f3a58c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.502+0000 7fdd2cbf0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a58dc50 0x561f3a588400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.502+0000 7fdd2cbf0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a590280 0x561f3a588940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.502+0000 7fdd2cbf0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241ad600 con 0x561f3a5839d0 2024-08-20T05:06:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.502+0000 7fdd2cbf0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241af140 con 0x561f3a590280 2024-08-20T05:06:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.502+0000 7fdd2cbf0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241adcd0 con 0x561f3a58dc50 2024-08-20T05:06:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.503+0000 7fdd23400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a5839d0 0x561f3a58c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.503+0000 7fdd23400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a5839d0 0x561f3a58c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54598/0 (socket says 172.21.15.37:54598) 2024-08-20T05:06:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.503+0000 7fdd23400640 1 -- 172.21.15.37:0/1582701944 learned_addr learned my addr 172.21.15.37:0/1582701944 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:24.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.511+0000 7fdd23e00640 1 --2- 172.21.15.37:0/1582701944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a590280 0x561f3a588940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:24.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.511+0000 7fdd1aa00640 1 --2- 172.21.15.37:0/1582701944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a58dc50 0x561f3a588400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:24.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.512+0000 7fdd23e00640 1 -- 172.21.15.37:0/1582701944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a58dc50 msgr2=0x561f3a588400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:24.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.512+0000 7fdd23e00640 1 --2- 172.21.15.37:0/1582701944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a58dc50 0x561f3a588400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.512+0000 7fdd23e00640 1 -- 172.21.15.37:0/1582701944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a5839d0 msgr2=0x561f3a58c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:24.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.512+0000 7fdd23e00640 1 --2- 172.21.15.37:0/1582701944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a5839d0 0x561f3a58c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.512+0000 7fdd23e00640 1 -- 172.21.15.37:0/1582701944 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f3a584770 con 0x561f3a590280 2024-08-20T05:06:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.512+0000 7fdd23e00640 1 --2- 172.21.15.37:0/1582701944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a590280 0x561f3a588940 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c014000 tx=0x7fdd1c009a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db993a0062fc7763 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.516+0000 7fdd13400640 1 -- 172.21.15.37:0/1582701944 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c026070 con 0x561f3a590280 2024-08-20T05:06:24.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.516+0000 7fdd13400640 1 -- 172.21.15.37:0/1582701944 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd1c01b070 con 0x561f3a590280 2024-08-20T05:06:24.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.516+0000 7fdd13400640 1 -- 172.21.15.37:0/1582701944 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c005280 con 0x561f3a590280 2024-08-20T05:06:24.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.517+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/1582701944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a590280 msgr2=0x561f3a588940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:24.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.517+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/1582701944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a590280 0x561f3a588940 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c014000 tx=0x7fdd1c009a60 comp rx=0 tx=0).stop 2024-08-20T05:06:24.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.518+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/1582701944 shutdown_connections 2024-08-20T05:06:24.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.518+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/1582701944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a590280 0x561f3a588940 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.518+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/1582701944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a58dc50 0x561f3a588400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.518+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/1582701944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a5839d0 0x561f3a58c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.518+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/1582701944 >> 172.21.15.37:0/1582701944 conn(0x561f3a581800 msgr2=0x561f3a587cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.520+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/1582701944 shutdown_connections 2024-08-20T05:06:24.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.520+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/1582701944 wait complete. 2024-08-20T05:06:24.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.521+0000 7fdd2cbf0740 1 -- start start 2024-08-20T05:06:24.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.521+0000 7fdd2cbf0740 1 Processor -- start 2024-08-20T05:06:24.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.522+0000 7fdd2cbf0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5839d0 0x561f3a5a9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.522+0000 7fdd2cbf0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a58dc50 0x561f3a589db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.522+0000 7fdd2cbf0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a590280 0x561f3a58a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.523+0000 7fdd1aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a58dc50 0x561f3a589db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.523+0000 7fdd1aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a58dc50 0x561f3a589db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:60688/0 (socket says 172.21.15.37:60688) 2024-08-20T05:06:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.523+0000 7fdd23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5839d0 0x561f3a5a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:24.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.523+0000 7fdd2cbf0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241aea70 con 0x561f3a590280 2024-08-20T05:06:24.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.523+0000 7fdd2cbf0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdd241ae3a0 con 0x561f3a58dc50 2024-08-20T05:06:24.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.523+0000 7fdd2cbf0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdd24074480 con 0x561f3a5839d0 2024-08-20T05:06:24.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.523+0000 7fdd2cbf0740 10 client.0 _ll_register_callbacks cb 0x7fdd14009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:24.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.523+0000 7fdd23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5839d0 0x561f3a5a9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42472/0 (socket says 172.21.15.37:42472) 2024-08-20T05:06:24.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.523+0000 7fdd23400640 1 -- 172.21.15.37:0/1768699307 learned_addr learned my addr 172.21.15.37:0/1768699307 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.524+0000 7fdd23e00640 1 --2- 172.21.15.37:0/1768699307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a590280 0x561f3a58a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.524+0000 7fdd23400640 1 -- 172.21.15.37:0/1768699307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a58dc50 msgr2=0x561f3a589db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.524+0000 7fdd23400640 1 --2- 172.21.15.37:0/1768699307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a58dc50 0x561f3a589db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.524+0000 7fdd23400640 1 -- 172.21.15.37:0/1768699307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a590280 msgr2=0x561f3a58a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:24.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.524+0000 7fdd23400640 1 --2- 172.21.15.37:0/1768699307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a590280 0x561f3a58a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.524+0000 7fdd23400640 1 -- 172.21.15.37:0/1768699307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f3a58a8e0 con 0x561f3a5839d0 2024-08-20T05:06:24.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.524+0000 7fdd23400640 1 --2- 172.21.15.37:0/1768699307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5839d0 0x561f3a5a9700 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdd14003a60 tx=0x7fdd14009bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7780860bcfc0a64b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:24.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.524+0000 7fdd1aa00640 1 --2- 172.21.15.37:0/1768699307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a58dc50 0x561f3a589db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-08-20T05:06:24.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.524+0000 7fdd10c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:06:24.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.525+0000 7fdd10c00640 1 -- 172.21.15.37:0/1768699307 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd14039020 con 0x561f3a5839d0 2024-08-20T05:06:24.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.527+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/1768699307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd1c01b070 con 0x561f3a5839d0 2024-08-20T05:06:24.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.527+0000 7fdd10c00640 1 -- 172.21.15.37:0/1768699307 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fdd14005230 con 0x561f3a5839d0 2024-08-20T05:06:24.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.528+0000 7fdd10c00640 1 -- 172.21.15.37:0/1768699307 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fdd14027040 con 0x561f3a5839d0 2024-08-20T05:06:24.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.528+0000 7fdd2cbf0740 10 client.26662 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.528+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/1768699307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x561f3a61bb20 con 0x561f3a5839d0 2024-08-20T05:06:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.528+0000 7fdd10c00640 1 -- 172.21.15.37:0/1768699307 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd1c01b070 con 0x561f3a5839d0 2024-08-20T05:06:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.529+0000 7fdd10c00640 1 -- 172.21.15.37:0/1768699307 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fdd14035480 con 0x561f3a5839d0 2024-08-20T05:06:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.529+0000 7fdd2cbf0740 10 client.26662 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.529+0000 7fdd2cbf0740 10 client.26662 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.529+0000 7fdd2cbf0740 20 client.26662 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.529+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/1768699307 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561f3a61bff0 0x561f3a61e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.529+0000 7fdd2cbf0740 4 client.26662 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T05:06:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.529+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/1768699307 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x561f3a4f8260 con 0x561f3a61bff0 2024-08-20T05:06:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.530+0000 7fdd1aa00640 1 --2- 172.21.15.37:0/1768699307 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561f3a61bff0 0x561f3a61e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.530+0000 7fdd1aa00640 1 --2- 172.21.15.37:0/1768699307 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561f3a61bff0 0x561f3a61e3e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1639f3f61498849 server_cookie=ec822227f51c1c4c in_seq=0 out_seq=0 2024-08-20T05:06:24.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.531+0000 7fdd10c00640 10 client.26662 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:24.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.532+0000 7fdd10c00640 1 -- 172.21.15.37:0/1768699307 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x561f3a4f8260 con 0x561f3a61bff0 2024-08-20T05:06:24.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.532+0000 7fdd10c00640 10 client.26662 handle_command_reply: tid=0 2024-08-20T05:06:24.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.532+0000 7fdd2cbf0740 1 client.26662 shutdown 2024-08-20T05:06:24.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.532+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/1768699307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5839d0 msgr2=0x561f3a5a9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:24.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.532+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/1768699307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5839d0 0x561f3a5a9700 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdd14003a60 tx=0x7fdd14009bb0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.533+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/1768699307 shutdown_connections 2024-08-20T05:06:24.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.533+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/1768699307 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561f3a61bff0 0x561f3a61e3e0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.533+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/1768699307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f3a590280 0x561f3a58a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.533+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/1768699307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561f3a58dc50 0x561f3a589db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.533+0000 7fdd2cbf0740 1 --2- 172.21.15.37:0/1768699307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561f3a5839d0 0x561f3a5a9700 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.533+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/1768699307 >> 172.21.15.37:0/1768699307 conn(0x561f3a581800 msgr2=0x561f3a588510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.533+0000 7fdd10c00640 0 client.26662 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.533+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/1768699307 shutdown_connections 2024-08-20T05:06:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.533+0000 7fdd2cbf0740 1 -- 172.21.15.37:0/1768699307 wait complete. 2024-08-20T05:06:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.533+0000 7fdd2cbf0740 20 client.26662 trim_cache size 0 max 16384 2024-08-20T05:06:24.537 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:06:24.537 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-20T05:06:24.537 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "d6962eba-e3e9-4e96-a1da-fdfaceb7306c", 2024-08-20T05:06:24.537 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-20T05:06:24.537 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:06:24.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.535+0000 7fdd2a000640 1 -- 172.21.15.37:0/696804352 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd080b3b60 msgr2=0x7fdd080b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:24.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.535+0000 7fdd2a000640 1 --2- 172.21.15.37:0/696804352 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd080b3b60 0x7fdd080b6020 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c005c40 tx=0x7fdd1c009500 comp rx=0 tx=0).stop 2024-08-20T05:06:24.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.535+0000 7fdd2a000640 1 -- 172.21.15.37:0/696804352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd2410eaf0 msgr2=0x7fdd2419fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:24.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.535+0000 7fdd2a000640 1 --2- 172.21.15.37:0/696804352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd2410eaf0 0x7fdd2419fb10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c005ab0 tx=0x7fdd0c003c10 comp rx=0 tx=0).stop 2024-08-20T05:06:24.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.535+0000 7fdd2a000640 1 -- 172.21.15.37:0/696804352 shutdown_connections 2024-08-20T05:06:24.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.535+0000 7fdd2a000640 1 --2- 172.21.15.37:0/696804352 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd080b3b60 0x7fdd080b6020 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.535+0000 7fdd2a000640 1 --2- 172.21.15.37:0/696804352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd2410f470 0x7fdd241a4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.535+0000 7fdd2a000640 1 --2- 172.21.15.37:0/696804352 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd2410eaf0 0x7fdd2419fb10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.535+0000 7fdd2a000640 1 --2- 172.21.15.37:0/696804352 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd241090e0 0x7fdd2419f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:24.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.535+0000 7fdd2a000640 1 -- 172.21.15.37:0/696804352 >> 172.21.15.37:0/696804352 conn(0x7fdd24078760 msgr2=0x7fdd2407ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:24.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.535+0000 7fdd2a000640 1 -- 172.21.15.37:0/696804352 shutdown_connections 2024-08-20T05:06:24.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:24.536+0000 7fdd2a000640 1 -- 172.21.15.37:0/696804352 wait complete. 2024-08-20T05:06:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:25 smithi037 ceph-mon[17265]: pgmap v526: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 3.3 MiB/s wr, 384 op/s 2024-08-20T05:06:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:25 smithi037 ceph-mon[17265]: scrub queued for path: / 2024-08-20T05:06:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:25 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:25 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:06:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:25 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:06:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:25 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:25 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:06:26.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:25 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:25 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:06:26.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:25 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:25 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:06:26.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:25 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:06:26.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:25 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:06:26.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:25 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:25 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:25 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:25 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:25 smithi135 ceph-mon[22342]: pgmap v526: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 3.3 MiB/s wr, 384 op/s 2024-08-20T05:06:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:25 smithi135 ceph-mon[22342]: scrub queued for path: / 2024-08-20T05:06:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:25 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:25 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:06:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:25 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:06:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:25 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:25 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:06:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:25 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:25 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:06:26.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:25 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:25 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:06:26.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:25 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:06:26.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:25 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:06:26.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:25 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:25 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:25 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:25 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:25 smithi130 ceph-mon[22007]: pgmap v526: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 3.3 MiB/s wr, 384 op/s 2024-08-20T05:06:26.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:25 smithi130 ceph-mon[22007]: scrub queued for path: / 2024-08-20T05:06:26.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:25 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:25 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:06:26.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:25 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:06:26.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:25 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:25 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:06:26.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:25 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:25 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:06:26.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:25 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:25 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:06:26.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:25 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:06:26.207 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:25 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:06:26.207 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:25 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.207 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:25 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.207 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:25 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.207 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:25 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.546 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:06:26.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:26 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:06:26.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:26 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:26.934 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:06:27.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:26 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:06:27.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:26 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:27.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:26 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:06:27.320 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:26 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:06:28.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:27 smithi037 ceph-mon[17265]: pgmap v527: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.2 MiB/s wr, 326 op/s 2024-08-20T05:06:28.045 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 210.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:06:28.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.106+0000 7f7009a00640 1 -- 172.21.15.37:0/1399659268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7004102ab0 msgr2=0x7f7004102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:28.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.106+0000 7f7009a00640 1 --2- 172.21.15.37:0/1399659268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7004102ab0 0x7f7004102e90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4009900 tx=0x7f6ff402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.107+0000 7f7009a00640 1 -- 172.21.15.37:0/1399659268 shutdown_connections 2024-08-20T05:06:28.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.107+0000 7f7009a00640 1 --2- 172.21.15.37:0/1399659268 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7004108e40 0x7f700410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.107+0000 7f7009a00640 1 --2- 172.21.15.37:0/1399659268 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70041084c0 0x7f7004108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.107+0000 7f7009a00640 1 --2- 172.21.15.37:0/1399659268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7004102ab0 0x7f7004102e90 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.107+0000 7f7009a00640 1 -- 172.21.15.37:0/1399659268 >> 172.21.15.37:0/1399659268 conn(0x7f70040fe500 msgr2=0x7f7004100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:28.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.107+0000 7f7009a00640 1 -- 172.21.15.37:0/1399659268 shutdown_connections 2024-08-20T05:06:28.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.107+0000 7f7009a00640 1 -- 172.21.15.37:0/1399659268 wait complete. 2024-08-20T05:06:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.108+0000 7f7009a00640 1 Processor -- start 2024-08-20T05:06:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.108+0000 7f7009a00640 1 -- start start 2024-08-20T05:06:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.108+0000 7f7009a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7004102ab0 0x7f700419b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.108+0000 7f7009a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70041084c0 0x7f700419b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.108+0000 7f7009a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7004108e40 0x7f70041a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.108+0000 7f7009a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7004112b00 con 0x7f7004102ab0 2024-08-20T05:06:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.108+0000 7f7009a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7004112980 con 0x7f70041084c0 2024-08-20T05:06:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.108+0000 7f7009a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7004112c80 con 0x7f7004108e40 2024-08-20T05:06:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.108+0000 7f7002a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7004102ab0 0x7f700419b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.108+0000 7f7002a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7004102ab0 0x7f700419b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54622/0 (socket says 172.21.15.37:54622) 2024-08-20T05:06:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.108+0000 7f7002a00640 1 -- 172.21.15.37:0/2968633614 learned_addr learned my addr 172.21.15.37:0/2968633614 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.108+0000 7f7002000640 1 --2- 172.21.15.37:0/2968633614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70041084c0 0x7f700419b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.108+0000 7f7003400640 1 --2- 172.21.15.37:0/2968633614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7004108e40 0x7f70041a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.109+0000 7f7002a00640 1 -- 172.21.15.37:0/2968633614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7004108e40 msgr2=0x7f70041a0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.109+0000 7f7002a00640 1 --2- 172.21.15.37:0/2968633614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7004108e40 0x7f70041a0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.109+0000 7f7002a00640 1 -- 172.21.15.37:0/2968633614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70041084c0 msgr2=0x7f700419b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.109+0000 7f7002a00640 1 --2- 172.21.15.37:0/2968633614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70041084c0 0x7f700419b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.109+0000 7f7002a00640 1 -- 172.21.15.37:0/2968633614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70041a1270 con 0x7f7004102ab0 2024-08-20T05:06:28.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.109+0000 7f7003400640 1 --2- 172.21.15.37:0/2968633614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7004108e40 0x7f70041a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.109+0000 7f7002a00640 1 --2- 172.21.15.37:0/2968633614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7004102ab0 0x7f700419b1c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4005940 tx=0x7f6ff4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.110+0000 7f6ffb400640 1 -- 172.21.15.37:0/2968633614 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff403f030 con 0x7f7004102ab0 2024-08-20T05:06:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.110+0000 7f7009a00640 1 -- 172.21.15.37:0/2968633614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70041a1500 con 0x7f7004102ab0 2024-08-20T05:06:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.110+0000 7f6ffb400640 1 -- 172.21.15.37:0/2968633614 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ff4003aa0 con 0x7f7004102ab0 2024-08-20T05:06:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.110+0000 7f6ffb400640 1 -- 172.21.15.37:0/2968633614 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4035070 con 0x7f7004102ab0 2024-08-20T05:06:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.110+0000 7f7009a00640 1 -- 172.21.15.37:0/2968633614 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70041a7c20 con 0x7f7004102ab0 2024-08-20T05:06:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.113+0000 7f700c649740 1 Processor -- start 2024-08-20T05:06:28.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.113+0000 7f700c649740 1 -- start start 2024-08-20T05:06:28.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:27 smithi135 ceph-mon[22342]: pgmap v527: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.2 MiB/s wr, 326 op/s 2024-08-20T05:06:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.113+0000 7f700c649740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c681630900 0x55c681630ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.113+0000 7f700c649740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c68163cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.113+0000 7f700c649740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c68163d1b0 0x55c68163f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.113+0000 7f700c649740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c6815a6a60 con 0x55c681631220 2024-08-20T05:06:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.113+0000 7f700c649740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c681595f60 con 0x55c68163d1b0 2024-08-20T05:06:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.113+0000 7f700c649740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c681599fa0 con 0x55c681630900 2024-08-20T05:06:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.113+0000 7f6ffb400640 1 -- 172.21.15.37:0/2968633614 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6ff4042030 con 0x7f7004102ab0 2024-08-20T05:06:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.114+0000 7f7003400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c681630900 0x55c681630ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.114+0000 7f7003400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c681630900 0x55c681630ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42496/0 (socket says 172.21.15.37:42496) 2024-08-20T05:06:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.114+0000 7f7003400640 1 -- 172.21.15.37:0/280772146 learned_addr learned my addr 172.21.15.37:0/280772146 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.114+0000 7f7002a00640 1 --2- 172.21.15.37:0/280772146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c68163cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.114+0000 7f7002000640 1 --2- 172.21.15.37:0/280772146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c68163d1b0 0x55c68163f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.114+0000 7f7003400640 1 -- 172.21.15.37:0/280772146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c68163d1b0 msgr2=0x55c68163f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.114+0000 7f7003400640 1 --2- 172.21.15.37:0/280772146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c68163d1b0 0x55c68163f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.114+0000 7f7003400640 1 -- 172.21.15.37:0/280772146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 msgr2=0x55c68163cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.114+0000 7f7003400640 1 --2- 172.21.15.37:0/280772146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c68163cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.114+0000 7f7003400640 1 -- 172.21.15.37:0/280772146 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c68153c3e0 con 0x55c681630900 2024-08-20T05:06:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.114+0000 7f7002a00640 1 --2- 172.21.15.37:0/280772146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c68163cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:06:28.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.115+0000 7f7003400640 1 --2- 172.21.15.37:0/280772146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c681630900 0x55c681630ce0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0117e0 tx=0x7f6ffc011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8cecb891df0aaf2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.115+0000 7f6fefe00640 1 -- 172.21.15.37:0/280772146 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc011310 con 0x55c681630900 2024-08-20T05:06:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.115+0000 7f6fefe00640 1 -- 172.21.15.37:0/280772146 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ffc003e20 con 0x55c681630900 2024-08-20T05:06:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.115+0000 7f6fefe00640 1 -- 172.21.15.37:0/280772146 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc0044b0 con 0x55c681630900 2024-08-20T05:06:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.116+0000 7f700c649740 1 -- 172.21.15.37:0/280772146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c681630900 msgr2=0x55c681630ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.116+0000 7f700c649740 1 --2- 172.21.15.37:0/280772146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c681630900 0x55c681630ce0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0117e0 tx=0x7f6ffc011ca0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.116+0000 7f6ffb400640 1 --2- 172.21.15.37:0/2968633614 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6fe80b3c50 0x7f6fe80b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.116+0000 7f700c649740 1 -- 172.21.15.37:0/280772146 shutdown_connections 2024-08-20T05:06:28.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.116+0000 7f700c649740 1 --2- 172.21.15.37:0/280772146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c68163d1b0 0x55c68163f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.116+0000 7f6ffb400640 1 -- 172.21.15.37:0/2968633614 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6ff4104590 con 0x7f7004102ab0 2024-08-20T05:06:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.116+0000 7f700c649740 1 --2- 172.21.15.37:0/280772146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c68163cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.116+0000 7f700c649740 1 --2- 172.21.15.37:0/280772146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c681630900 0x55c681630ce0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.116+0000 7f700c649740 1 -- 172.21.15.37:0/280772146 >> 172.21.15.37:0/280772146 conn(0x55c68162e730 msgr2=0x55c68162f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.116+0000 7f7003400640 1 --2- 172.21.15.37:0/2968633614 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6fe80b3c50 0x7f6fe80b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.116+0000 7f700c649740 1 -- 172.21.15.37:0/280772146 shutdown_connections 2024-08-20T05:06:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.117+0000 7f700c649740 1 -- 172.21.15.37:0/280772146 wait complete. 2024-08-20T05:06:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.117+0000 7f7003400640 1 --2- 172.21.15.37:0/2968633614 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6fe80b3c50 0x7f6fe80b6110 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc009fd0 tx=0x7f6ffc0040d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.117+0000 7f700c649740 1 -- start start 2024-08-20T05:06:28.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.117+0000 7f700c649740 1 Processor -- start 2024-08-20T05:06:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.118+0000 7f700c649740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c681630900 0x55c68163c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.118+0000 7f700c649740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c681639db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.118+0000 7f700c649740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c68163d1b0 0x55c68163a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.118+0000 7f700c649740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c6813f8700 con 0x55c681631220 2024-08-20T05:06:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.118+0000 7f700c649740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c681531250 con 0x55c681630900 2024-08-20T05:06:28.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.118+0000 7f700c649740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c68163fe30 con 0x55c68163d1b0 2024-08-20T05:06:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.118+0000 7f700c649740 10 client.0 _ll_register_callbacks cb 0x55c681590180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.118+0000 7f7002000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c681639db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.118+0000 7f7003400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c68163d1b0 0x55c68163a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.118+0000 7f7003400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c68163d1b0 0x55c68163a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42510/0 (socket says 172.21.15.37:42510) 2024-08-20T05:06:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.118+0000 7f7002000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c681639db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54638/0 (socket says 172.21.15.37:54638) 2024-08-20T05:06:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.118+0000 7f7003400640 1 -- 172.21.15.37:0/2857249044 learned_addr learned my addr 172.21.15.37:0/2857249044 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.118+0000 7f7002a00640 1 --2- 172.21.15.37:0/2857249044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c681630900 0x55c68163c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.119+0000 7f7003400640 1 -- 172.21.15.37:0/2857249044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c681630900 msgr2=0x55c68163c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.119+0000 7f7003400640 1 --2- 172.21.15.37:0/2857249044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c681630900 0x55c68163c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.119+0000 7f7003400640 1 -- 172.21.15.37:0/2857249044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 msgr2=0x55c681639db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.119+0000 7f7003400640 1 --2- 172.21.15.37:0/2857249044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c681639db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.119+0000 7f7003400640 1 -- 172.21.15.37:0/2857249044 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6812f5650 con 0x55c68163d1b0 2024-08-20T05:06:28.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.119+0000 7f7003400640 1 --2- 172.21.15.37:0/2857249044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c68163d1b0 0x55c68163a2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc003cf0 tx=0x7f6ffc011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51295ee621867a55 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.119+0000 7f6fecc00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:06:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.119+0000 7f6fecc00640 1 -- 172.21.15.37:0/2857249044 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc00fbb0 con 0x55c68163d1b0 2024-08-20T05:06:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.119+0000 7f700c649740 1 -- 172.21.15.37:0/2857249044 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ffc003e20 con 0x55c68163d1b0 2024-08-20T05:06:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.119+0000 7f6fecc00640 1 -- 172.21.15.37:0/2857249044 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6ffc00fd50 con 0x55c68163d1b0 2024-08-20T05:06:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.120+0000 7f6fecc00640 1 -- 172.21.15.37:0/2857249044 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6ffc004250 con 0x55c68163d1b0 2024-08-20T05:06:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.120+0000 7f700c649740 10 client.26674 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.120+0000 7f700c649740 1 -- 172.21.15.37:0/2857249044 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55c681653e60 con 0x55c68163d1b0 2024-08-20T05:06:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.120+0000 7f6fecc00640 1 -- 172.21.15.37:0/2857249044 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ffc003e20 con 0x55c68163d1b0 2024-08-20T05:06:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.120+0000 7f6fecc00640 1 -- 172.21.15.37:0/2857249044 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f6ffc018020 con 0x55c68163d1b0 2024-08-20T05:06:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.120+0000 7f700c649740 10 client.26674 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.120+0000 7f700c649740 10 client.26674 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.120+0000 7f700c649740 20 client.26674 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.120+0000 7f700c649740 1 --2- 172.21.15.37:0/2857249044 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c6816551b0 0x55c6816575a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.120+0000 7f700c649740 4 client.26674 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:06:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.120+0000 7f700c649740 1 -- 172.21.15.37:0/2857249044 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6815a89b0 con 0x55c6816551b0 2024-08-20T05:06:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.121+0000 7f7002a00640 1 --2- 172.21.15.37:0/2857249044 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c6816551b0 0x55c6816575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.121+0000 7f7002a00640 1 --2- 172.21.15.37:0/2857249044 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c6816551b0 0x55c6816575a0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7572f99ac8f83886 server_cookie=da81059aaf2d606d in_seq=0 out_seq=0 2024-08-20T05:06:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.121+0000 7f6fecc00640 10 client.26674 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.122+0000 7f6fecc00640 1 -- 172.21.15.37:0/2857249044 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c6815a89b0 con 0x55c6816551b0 2024-08-20T05:06:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.122+0000 7f6fecc00640 10 client.26674 handle_command_reply: tid=0 2024-08-20T05:06:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.122+0000 7f700c649740 1 client.26674 shutdown 2024-08-20T05:06:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.122+0000 7f700c649740 1 -- 172.21.15.37:0/2857249044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c68163d1b0 msgr2=0x55c68163a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.122+0000 7f700c649740 1 --2- 172.21.15.37:0/2857249044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c68163d1b0 0x55c68163a2f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc003cf0 tx=0x7f6ffc011ca0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.122+0000 7f700c649740 1 -- 172.21.15.37:0/2857249044 shutdown_connections 2024-08-20T05:06:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.122+0000 7f700c649740 1 --2- 172.21.15.37:0/2857249044 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c6816551b0 0x55c6816575a0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.122+0000 7f700c649740 1 --2- 172.21.15.37:0/2857249044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c68163d1b0 0x55c68163a2f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.122+0000 7f700c649740 1 --2- 172.21.15.37:0/2857249044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c681639db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.122+0000 7f700c649740 1 --2- 172.21.15.37:0/2857249044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c681630900 0x55c68163c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.122+0000 7f700c649740 1 -- 172.21.15.37:0/2857249044 >> 172.21.15.37:0/2857249044 conn(0x55c68162e730 msgr2=0x55c6816342d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.122+0000 7f6fecc00640 0 client.26674 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.123+0000 7f700c649740 1 -- 172.21.15.37:0/2857249044 shutdown_connections 2024-08-20T05:06:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.123+0000 7f700c649740 1 -- 172.21.15.37:0/2857249044 wait complete. 2024-08-20T05:06:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.123+0000 7f700c649740 20 client.26674 trim_cache size 0 max 16384 2024-08-20T05:06:28.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.141+0000 7f700c649740 1 Processor -- start 2024-08-20T05:06:28.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.141+0000 7f700c649740 1 -- start start 2024-08-20T05:06:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.141+0000 7f700c649740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c681630900 0x55c68163beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.141+0000 7f700c649740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c68165ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.141+0000 7f700c649740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c68163d1b0 0x55c68165d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.141+0000 7f700c649740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70041ad600 con 0x55c681631220 2024-08-20T05:06:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.141+0000 7f700c649740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70041af140 con 0x55c681630900 2024-08-20T05:06:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.141+0000 7f700c649740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70041adcd0 con 0x55c68163d1b0 2024-08-20T05:06:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.142+0000 7f7002000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c68165ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.142+0000 7f7002000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c68165ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54654/0 (socket says 172.21.15.37:54654) 2024-08-20T05:06:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.142+0000 7f7002000640 1 -- 172.21.15.37:0/2563737738 learned_addr learned my addr 172.21.15.37:0/2563737738 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.142+0000 7f7002a00640 1 --2- 172.21.15.37:0/2563737738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c681630900 0x55c68163beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.142+0000 7f7003400640 1 --2- 172.21.15.37:0/2563737738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c68163d1b0 0x55c68165d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.142+0000 7f7002000640 1 -- 172.21.15.37:0/2563737738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c68163d1b0 msgr2=0x55c68165d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.142+0000 7f7002000640 1 --2- 172.21.15.37:0/2563737738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c68163d1b0 0x55c68165d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.142+0000 7f7002000640 1 -- 172.21.15.37:0/2563737738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c681630900 msgr2=0x55c68163beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.142+0000 7f7002000640 1 --2- 172.21.15.37:0/2563737738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c681630900 0x55c68163beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.142+0000 7f7002000640 1 -- 172.21.15.37:0/2563737738 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c681639b60 con 0x55c681631220 2024-08-20T05:06:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.142+0000 7f7002a00640 1 --2- 172.21.15.37:0/2563737738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c681630900 0x55c68163beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.143+0000 7f7002000640 1 --2- 172.21.15.37:0/2563737738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c68165ce00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6ff000b870 tx=0x7f6ff000bc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2dd0836cf1c5027 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.143+0000 7f6fef400640 1 -- 172.21.15.37:0/2563737738 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0003d50 con 0x55c681631220 2024-08-20T05:06:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.143+0000 7f6fef400640 1 -- 172.21.15.37:0/2563737738 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ff0020070 con 0x55c681631220 2024-08-20T05:06:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.143+0000 7f6fef400640 1 -- 172.21.15.37:0/2563737738 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff001b620 con 0x55c681631220 2024-08-20T05:06:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.144+0000 7f700c649740 1 -- 172.21.15.37:0/2563737738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 msgr2=0x55c68165ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.144+0000 7f700c649740 1 --2- 172.21.15.37:0/2563737738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c68165ce00 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6ff000b870 tx=0x7f6ff000bc70 comp rx=0 tx=0).stop 2024-08-20T05:06:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.144+0000 7f700c649740 1 -- 172.21.15.37:0/2563737738 shutdown_connections 2024-08-20T05:06:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.144+0000 7f700c649740 1 --2- 172.21.15.37:0/2563737738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c68163d1b0 0x55c68165d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.144+0000 7f700c649740 1 --2- 172.21.15.37:0/2563737738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c68165ce00 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.144+0000 7f700c649740 1 --2- 172.21.15.37:0/2563737738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c681630900 0x55c68163beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.144+0000 7f700c649740 1 -- 172.21.15.37:0/2563737738 >> 172.21.15.37:0/2563737738 conn(0x55c68162e730 msgr2=0x55c68162d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:28.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.144+0000 7f700c649740 1 -- 172.21.15.37:0/2563737738 shutdown_connections 2024-08-20T05:06:28.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.144+0000 7f700c649740 1 -- 172.21.15.37:0/2563737738 wait complete. 2024-08-20T05:06:28.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.144+0000 7f700c649740 1 -- start start 2024-08-20T05:06:28.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.145+0000 7f700c649740 1 Processor -- start 2024-08-20T05:06:28.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.145+0000 7f700c649740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c681630900 0x55c68164c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.145+0000 7f700c649740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c68164cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.145+0000 7f700c649740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c68163d1b0 0x55c6816b7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.145+0000 7f700c649740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70041aea70 con 0x55c681631220 2024-08-20T05:06:28.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.145+0000 7f700c649740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70041ae3a0 con 0x55c68163d1b0 2024-08-20T05:06:28.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.145+0000 7f700c649740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70041ab5e0 con 0x55c681630900 2024-08-20T05:06:28.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.145+0000 7f700c649740 10 client.0 _ll_register_callbacks cb 0x7f6ff000b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:28.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.145+0000 7f7002000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c68164cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.145+0000 7f7002a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c681630900 0x55c68164c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.145+0000 7f7002000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c68164cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54662/0 (socket says 172.21.15.37:54662) 2024-08-20T05:06:28.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.145+0000 7f7002000640 1 -- 172.21.15.37:0/2744998885 learned_addr learned my addr 172.21.15.37:0/2744998885 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:28.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.145+0000 7f7003400640 1 --2- 172.21.15.37:0/2744998885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c68163d1b0 0x55c6816b7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.146+0000 7f7002a00640 1 -- 172.21.15.37:0/2744998885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c68163d1b0 msgr2=0x55c6816b7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:28.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.146+0000 7f7002a00640 1 --2- 172.21.15.37:0/2744998885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c68163d1b0 0x55c6816b7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.146+0000 7f7002a00640 1 -- 172.21.15.37:0/2744998885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 msgr2=0x55c68164cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:28.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.146+0000 7f7002a00640 1 --2- 172.21.15.37:0/2744998885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c68164cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.146+0000 7f7002a00640 1 -- 172.21.15.37:0/2744998885 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6816b84e0 con 0x55c681630900 2024-08-20T05:06:28.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.146+0000 7f7002a00640 1 --2- 172.21.15.37:0/2744998885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c681630900 0x55c68164c760 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55c68162f610 tx=0x7f6ff4005cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4234221050815321 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:28.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.146+0000 7f6fecc00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:06:28.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.146+0000 7f6fecc00640 1 -- 172.21.15.37:0/2744998885 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4049040 con 0x55c681630900 2024-08-20T05:06:28.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.146+0000 7f6fecc00640 1 -- 172.21.15.37:0/2744998885 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6ff4101da0 con 0x55c681630900 2024-08-20T05:06:28.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.146+0000 7f700c649740 1 -- 172.21.15.37:0/2744998885 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ff0020070 con 0x55c681630900 2024-08-20T05:06:28.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.147+0000 7f6fecc00640 1 -- 172.21.15.37:0/2744998885 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6ff40caae0 con 0x55c681630900 2024-08-20T05:06:28.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.147+0000 7f700c649740 10 client.26680 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:28.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.147+0000 7f700c649740 1 -- 172.21.15.37:0/2744998885 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55c6816bf9b0 con 0x55c681630900 2024-08-20T05:06:28.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.147+0000 7f6fecc00640 1 -- 172.21.15.37:0/2744998885 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ff0020070 con 0x55c681630900 2024-08-20T05:06:28.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.147+0000 7f6fecc00640 1 -- 172.21.15.37:0/2744998885 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f6ff40c7420 con 0x55c681630900 2024-08-20T05:06:28.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.147+0000 7f700c649740 10 client.26680 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:28.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.147+0000 7f700c649740 10 client.26680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:28.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.147+0000 7f700c649740 20 client.26680 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:28.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.147+0000 7f700c649740 1 --2- 172.21.15.37:0/2744998885 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c6816c00d0 0x55c6816c24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:28.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.147+0000 7f700c649740 4 client.26680 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:06:28.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.147+0000 7f700c649740 1 -- 172.21.15.37:0/2744998885 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c6815a4450 con 0x55c6816c00d0 2024-08-20T05:06:28.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.147+0000 7f7002000640 1 --2- 172.21.15.37:0/2744998885 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c6816c00d0 0x55c6816c24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:28.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.148+0000 7f7002000640 1 --2- 172.21.15.37:0/2744998885 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c6816c00d0 0x55c6816c24c0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9295e072912fda80 server_cookie=3893a4e2e80e8ff3 in_seq=0 out_seq=0 2024-08-20T05:06:28.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.148+0000 7f6fecc00640 10 client.26680 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:28.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.148+0000 7f6fecc00640 1 -- 172.21.15.37:0/2744998885 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55c6815a4450 con 0x55c6816c00d0 2024-08-20T05:06:28.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.148+0000 7f6fecc00640 10 client.26680 handle_command_reply: tid=0 2024-08-20T05:06:28.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.148+0000 7f700c649740 1 client.26680 shutdown 2024-08-20T05:06:28.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.148+0000 7f700c649740 1 -- 172.21.15.37:0/2744998885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c681630900 msgr2=0x55c68164c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:28.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.148+0000 7f700c649740 1 --2- 172.21.15.37:0/2744998885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c681630900 0x55c68164c760 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x55c68162f610 tx=0x7f6ff4005cb0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.148+0000 7f700c649740 1 -- 172.21.15.37:0/2744998885 shutdown_connections 2024-08-20T05:06:28.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.148+0000 7f700c649740 1 --2- 172.21.15.37:0/2744998885 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c6816c00d0 0x55c6816c24c0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.148+0000 7f700c649740 1 --2- 172.21.15.37:0/2744998885 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c68163d1b0 0x55c6816b7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.148+0000 7f700c649740 1 --2- 172.21.15.37:0/2744998885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c681631220 0x55c68164cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.148+0000 7f700c649740 1 --2- 172.21.15.37:0/2744998885 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c681630900 0x55c68164c760 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.148+0000 7f6fecc00640 0 client.26680 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:28.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.148+0000 7f700c649740 1 -- 172.21.15.37:0/2744998885 >> 172.21.15.37:0/2744998885 conn(0x55c68162e730 msgr2=0x55c681638500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:28.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.149+0000 7f700c649740 1 -- 172.21.15.37:0/2744998885 shutdown_connections 2024-08-20T05:06:28.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.149+0000 7f700c649740 1 -- 172.21.15.37:0/2744998885 wait complete. 2024-08-20T05:06:28.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.149+0000 7f700c649740 20 client.26680 trim_cache size 0 max 16384 2024-08-20T05:06:28.154 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:06:28.155 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T05:06:28.155 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-20T05:06:28.155 INFO:teuthology.orchestra.run.smithi037.stdout: "d6962eba-e3e9-4e96-a1da-fdfaceb7306c": { 2024-08-20T05:06:28.155 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-20T05:06:28.155 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "d6962eba-e3e9-4e96-a1da-fdfaceb7306c", 2024-08-20T05:06:28.155 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-20T05:06:28.155 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:06:28.155 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:06:28.155 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:06:28.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.149+0000 7f7009a00640 1 -- 172.21.15.37:0/2968633614 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6fe80b3c50 msgr2=0x7f6fe80b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:28.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.149+0000 7f7009a00640 1 --2- 172.21.15.37:0/2968633614 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6fe80b3c50 0x7f6fe80b6110 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc009fd0 tx=0x7f6ffc0040d0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.149+0000 7f7009a00640 1 -- 172.21.15.37:0/2968633614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7004102ab0 msgr2=0x7f700419b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:28.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.149+0000 7f7009a00640 1 --2- 172.21.15.37:0/2968633614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7004102ab0 0x7f700419b1c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6ff4005940 tx=0x7f6ff4004270 comp rx=0 tx=0).stop 2024-08-20T05:06:28.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.150+0000 7f7009a00640 1 -- 172.21.15.37:0/2968633614 shutdown_connections 2024-08-20T05:06:28.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.150+0000 7f7009a00640 1 --2- 172.21.15.37:0/2968633614 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6fe80b3c50 0x7f6fe80b6110 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.150+0000 7f7009a00640 1 --2- 172.21.15.37:0/2968633614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7004108e40 0x7f70041a0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.150+0000 7f7009a00640 1 --2- 172.21.15.37:0/2968633614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70041084c0 0x7f700419b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.150+0000 7f7009a00640 1 --2- 172.21.15.37:0/2968633614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7004102ab0 0x7f700419b1c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:28.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.150+0000 7f7009a00640 1 -- 172.21.15.37:0/2968633614 >> 172.21.15.37:0/2968633614 conn(0x7f70040fe500 msgr2=0x7f7004104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:28.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.150+0000 7f7009a00640 1 -- 172.21.15.37:0/2968633614 shutdown_connections 2024-08-20T05:06:28.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:28.150+0000 7f7009a00640 1 -- 172.21.15.37:0/2968633614 wait complete. 2024-08-20T05:06:28.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:27 smithi130 ceph-mon[22007]: pgmap v527: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.2 MiB/s wr, 326 op/s 2024-08-20T05:06:29.112 INFO:tasks.cephfs.filesystem:scrub status for tag:d6962eba-e3e9-4e96-a1da-fdfaceb7306c - {'path': '/', 'tag': 'd6962eba-e3e9-4e96-a1da-fdfaceb7306c', 'options': 'recursive,force'} 2024-08-20T05:06:30.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:29 smithi037 ceph-mon[17265]: pgmap v528: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 3.7 MiB/s wr, 341 op/s 2024-08-20T05:06:30.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:06:30.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:29 smithi135 ceph-mon[22342]: pgmap v528: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 3.7 MiB/s wr, 341 op/s 2024-08-20T05:06:30.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:06:30.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:06:30.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:29 smithi130 ceph-mon[22007]: pgmap v528: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 3.7 MiB/s wr, 341 op/s 2024-08-20T05:06:30.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:06:30.551 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:06:30.841 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:06:30.841 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:06:30.841 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:06:31.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:06:31.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:06:31.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:06:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.100+0000 7f1867000640 1 -- 172.21.15.37:0/4212288704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f186010a520 msgr2=0x7f186010a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.100+0000 7f1867000640 1 --2- 172.21.15.37:0/4212288704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f186010a520 0x7f186010a960 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f184c009900 tx=0x7f184c02a410 comp rx=0 tx=0).stop 2024-08-20T05:06:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.100+0000 7f1867000640 1 -- 172.21.15.37:0/4212288704 shutdown_connections 2024-08-20T05:06:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.100+0000 7f1867000640 1 --2- 172.21.15.37:0/4212288704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f186010aea0 0x7f18601116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.100+0000 7f1867000640 1 --2- 172.21.15.37:0/4212288704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f186010a520 0x7f186010a960 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.100+0000 7f1867000640 1 --2- 172.21.15.37:0/4212288704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1860104b10 0x7f1860104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.100+0000 7f1867000640 1 -- 172.21.15.37:0/4212288704 >> 172.21.15.37:0/4212288704 conn(0x7f1860100540 msgr2=0x7f1860102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.100+0000 7f1867000640 1 -- 172.21.15.37:0/4212288704 shutdown_connections 2024-08-20T05:06:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.100+0000 7f1867000640 1 -- 172.21.15.37:0/4212288704 wait complete. 2024-08-20T05:06:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.101+0000 7f1867000640 1 Processor -- start 2024-08-20T05:06:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.101+0000 7f1867000640 1 -- start start 2024-08-20T05:06:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.102+0000 7f1867000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1860104b10 0x7f186019af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.102+0000 7f1867000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f186010a520 0x7f186019b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.102+0000 7f1867000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f186010aea0 0x7f18601a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.102+0000 7f1867000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1860114b70 con 0x7f186010a520 2024-08-20T05:06:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.102+0000 7f1867000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f18601149f0 con 0x7f186010aea0 2024-08-20T05:06:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.102+0000 7f1867000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1860114cf0 con 0x7f1860104b10 2024-08-20T05:06:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.102+0000 7f1865200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f186010a520 0x7f186019b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.102+0000 7f1865200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f186010a520 0x7f186019b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54668/0 (socket says 172.21.15.37:54668) 2024-08-20T05:06:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.102+0000 7f1865200640 1 -- 172.21.15.37:0/2785619328 learned_addr learned my addr 172.21.15.37:0/2785619328 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.102+0000 7f1865c00640 1 --2- 172.21.15.37:0/2785619328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1860104b10 0x7f186019af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.102+0000 7f1866600640 1 --2- 172.21.15.37:0/2785619328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f186010aea0 0x7f18601a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.102+0000 7f1865200640 1 -- 172.21.15.37:0/2785619328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1860104b10 msgr2=0x7f186019af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.102+0000 7f1865200640 1 --2- 172.21.15.37:0/2785619328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1860104b10 0x7f186019af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.102+0000 7f1865200640 1 -- 172.21.15.37:0/2785619328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f186010aea0 msgr2=0x7f18601a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.102+0000 7f1865200640 1 --2- 172.21.15.37:0/2785619328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f186010aea0 0x7f18601a0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.103+0000 7f1865200640 1 -- 172.21.15.37:0/2785619328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18601a0fd0 con 0x7f186010a520 2024-08-20T05:06:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.103+0000 7f1865200640 1 --2- 172.21.15.37:0/2785619328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f186010a520 0x7f186019b460 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f184c005ab0 tx=0x7f184c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.103+0000 7f185e000640 1 -- 172.21.15.37:0/2785619328 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c03f070 con 0x7f186010a520 2024-08-20T05:06:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.103+0000 7f185e000640 1 -- 172.21.15.37:0/2785619328 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f184c031b60 con 0x7f186010a520 2024-08-20T05:06:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.103+0000 7f185e000640 1 -- 172.21.15.37:0/2785619328 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c035030 con 0x7f186010a520 2024-08-20T05:06:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.103+0000 7f1867000640 1 -- 172.21.15.37:0/2785619328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18601a1260 con 0x7f186010a520 2024-08-20T05:06:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.104+0000 7f1867000640 1 -- 172.21.15.37:0/2785619328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18601a7980 con 0x7f186010a520 2024-08-20T05:06:31.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.105+0000 7f1867000640 1 -- 172.21.15.37:0/2785619328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1860104ef0 con 0x7f186010a520 2024-08-20T05:06:31.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.107+0000 7f185e000640 1 -- 172.21.15.37:0/2785619328 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f184c042070 con 0x7f186010a520 2024-08-20T05:06:31.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.109+0000 7f185e000640 1 --2- 172.21.15.37:0/2785619328 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f18480b3c70 0x7f18480b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.109+0000 7f185e000640 1 -- 172.21.15.37:0/2785619328 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f184c104d80 con 0x7f186010a520 2024-08-20T05:06:31.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.109+0000 7f1865c00640 1 --2- 172.21.15.37:0/2785619328 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f18480b3c70 0x7f18480b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.110+0000 7f1865c00640 1 --2- 172.21.15.37:0/2785619328 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f18480b3c70 0x7f18480b6130 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1854009bd0 tx=0x7f1854005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:31.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.110+0000 7f185e000640 1 -- 172.21.15.37:0/2785619328 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f184c0cb980 con 0x7f186010a520 2024-08-20T05:06:31.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:06:31.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:06:31.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:06:31.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.342+0000 7f1867000640 1 -- 172.21.15.37:0/2785619328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18601a7c40 con 0x7f186010a520 2024-08-20T05:06:31.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.343+0000 7f185e000640 1 -- 172.21.15.37:0/2785619328 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11980 (secure 0 0 0) 0x7f184c0cfed0 con 0x7f186010a520 2024-08-20T05:06:31.345 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:06:31.345 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"btime":"2024-08-20T05:06:06:678364+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:06:06.276613+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:06:31.345 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 36 2024-08-20T05:06:31.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.345+0000 7f1867000640 1 -- 172.21.15.37:0/2785619328 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f18480b3c70 msgr2=0x7f18480b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:31.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.345+0000 7f1867000640 1 --2- 172.21.15.37:0/2785619328 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f18480b3c70 0x7f18480b6130 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1854009bd0 tx=0x7f1854005f90 comp rx=0 tx=0).stop 2024-08-20T05:06:31.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.345+0000 7f1867000640 1 -- 172.21.15.37:0/2785619328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f186010a520 msgr2=0x7f186019b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:31.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.345+0000 7f1867000640 1 --2- 172.21.15.37:0/2785619328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f186010a520 0x7f186019b460 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f184c005ab0 tx=0x7f184c003c10 comp rx=0 tx=0).stop 2024-08-20T05:06:31.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.345+0000 7f1867000640 1 -- 172.21.15.37:0/2785619328 shutdown_connections 2024-08-20T05:06:31.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.345+0000 7f1867000640 1 --2- 172.21.15.37:0/2785619328 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f18480b3c70 0x7f18480b6130 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.345+0000 7f1867000640 1 --2- 172.21.15.37:0/2785619328 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f186010aea0 0x7f18601a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.345+0000 7f1867000640 1 --2- 172.21.15.37:0/2785619328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f186010a520 0x7f186019b460 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.345+0000 7f1867000640 1 --2- 172.21.15.37:0/2785619328 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1860104b10 0x7f186019af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.345+0000 7f1867000640 1 -- 172.21.15.37:0/2785619328 >> 172.21.15.37:0/2785619328 conn(0x7f1860100540 msgr2=0x7f1860102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:31.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.345+0000 7f1867000640 1 -- 172.21.15.37:0/2785619328 shutdown_connections 2024-08-20T05:06:31.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:31.345+0000 7f1867000640 1 -- 172.21.15.37:0/2785619328 wait complete. 2024-08-20T05:06:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.851+0000 7fc531800640 1 -- 172.21.15.37:0/2180536616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc52c077750 msgr2=0x7fc52c077b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.851+0000 7fc531800640 1 --2- 172.21.15.37:0/2180536616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc52c077750 0x7fc52c077b50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc51c009860 tx=0x7fc51c02a340 comp rx=0 tx=0).stop 2024-08-20T05:06:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.851+0000 7fc531800640 1 -- 172.21.15.37:0/2180536616 shutdown_connections 2024-08-20T05:06:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.851+0000 7fc531800640 1 --2- 172.21.15.37:0/2180536616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc52c079260 0x7fc52c079bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.851+0000 7fc531800640 1 --2- 172.21.15.37:0/2180536616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc52c0788a0 0x7fc52c078d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.851+0000 7fc531800640 1 --2- 172.21.15.37:0/2180536616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc52c077750 0x7fc52c077b50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.851+0000 7fc531800640 1 -- 172.21.15.37:0/2180536616 >> 172.21.15.37:0/2180536616 conn(0x7fc52c100170 msgr2=0x7fc52c102590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.851+0000 7fc531800640 1 -- 172.21.15.37:0/2180536616 shutdown_connections 2024-08-20T05:06:31.854 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.851+0000 7fc531800640 1 -- 172.21.15.37:0/2180536616 wait complete. 2024-08-20T05:06:31.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.852+0000 7fc531800640 1 Processor -- start 2024-08-20T05:06:31.856 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.853+0000 7fc531800640 1 -- start start 2024-08-20T05:06:31.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.853+0000 7fc531800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc52c077750 0x7fc52c19f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.853+0000 7fc531800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc52c0788a0 0x7fc52c19f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.853+0000 7fc531800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc52c079260 0x7fc52c1a0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.853+0000 7fc531800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c114910 con 0x7fc52c077750 2024-08-20T05:06:31.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.853+0000 7fc531800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c114790 con 0x7fc52c0788a0 2024-08-20T05:06:31.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.853+0000 7fc531800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c114a90 con 0x7fc52c079260 2024-08-20T05:06:31.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.853+0000 7fc52b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc52c079260 0x7fc52c1a0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.853+0000 7fc52aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc52c077750 0x7fc52c19f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.853+0000 7fc52b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc52c079260 0x7fc52c1a0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42572/0 (socket says 172.21.15.37:42572) 2024-08-20T05:06:31.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.853+0000 7fc52b400640 1 -- 172.21.15.37:0/3834969107 learned_addr learned my addr 172.21.15.37:0/3834969107 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:31.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.853+0000 7fc52a000640 1 --2- 172.21.15.37:0/3834969107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc52c0788a0 0x7fc52c19f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.857 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.853+0000 7fc52b400640 1 -- 172.21.15.37:0/3834969107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc52c0788a0 msgr2=0x7fc52c19f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.853+0000 7fc52b400640 1 --2- 172.21.15.37:0/3834969107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc52c0788a0 0x7fc52c19f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.854+0000 7fc52b400640 1 -- 172.21.15.37:0/3834969107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc52c077750 msgr2=0x7fc52c19f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.854+0000 7fc52b400640 1 --2- 172.21.15.37:0/3834969107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc52c077750 0x7fc52c19f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.854+0000 7fc52b400640 1 -- 172.21.15.37:0/3834969107 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52c1a0c10 con 0x7fc52c079260 2024-08-20T05:06:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.854+0000 7fc52b400640 1 --2- 172.21.15.37:0/3834969107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc52c079260 0x7fc52c1a0350 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc52400efc0 tx=0x7fc52400c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.854+0000 7fc523400640 1 -- 172.21.15.37:0/3834969107 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc524003970 con 0x7fc52c079260 2024-08-20T05:06:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.854+0000 7fc523400640 1 -- 172.21.15.37:0/3834969107 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc524004020 con 0x7fc52c079260 2024-08-20T05:06:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.854+0000 7fc531800640 1 -- 172.21.15.37:0/3834969107 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc52c1a0f00 con 0x7fc52c079260 2024-08-20T05:06:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.854+0000 7fc523400640 1 -- 172.21.15.37:0/3834969107 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52400b940 con 0x7fc52c079260 2024-08-20T05:06:31.858 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.854+0000 7fc531800640 1 -- 172.21.15.37:0/3834969107 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc52c1a75d0 con 0x7fc52c079260 2024-08-20T05:06:31.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.857+0000 7fc5347ff740 1 Processor -- start 2024-08-20T05:06:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.858+0000 7fc523400640 1 -- 172.21.15.37:0/3834969107 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc52401d020 con 0x7fc52c079260 2024-08-20T05:06:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.858+0000 7fc5347ff740 1 -- start start 2024-08-20T05:06:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.858+0000 7fc5347ff740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec4610 0x5633aaec6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.858+0000 7fc5347ff740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec6f40 0x5633aaec9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.858+0000 7fc5347ff740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec9980 0x5633aaecbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.858+0000 7fc5347ff740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5633aae37210 con 0x5633aaec9980 2024-08-20T05:06:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.858+0000 7fc5347ff740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5633aae26710 con 0x5633aaec6f40 2024-08-20T05:06:31.860 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.858+0000 7fc5347ff740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5633aae2a750 con 0x5633aaec4610 2024-08-20T05:06:31.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.858+0000 7fc52a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec4610 0x5633aaec6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.858+0000 7fc52aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec6f40 0x5633aaec9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.858+0000 7fc52a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec4610 0x5633aaec6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42588/0 (socket says 172.21.15.37:42588) 2024-08-20T05:06:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.858+0000 7fc52a000640 1 -- 172.21.15.37:0/2230258138 learned_addr learned my addr 172.21.15.37:0/2230258138 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.858+0000 7fc52a000640 1 --2- 172.21.15.37:0/2230258138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec9980 0x5633aaecbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.859+0000 7fc52aa00640 1 -- 172.21.15.37:0/2230258138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec4610 msgr2=0x5633aaec6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.859+0000 7fc52aa00640 1 --2- 172.21.15.37:0/2230258138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec4610 0x5633aaec6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.859+0000 7fc52aa00640 1 -- 172.21.15.37:0/2230258138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec9980 msgr2=0x5633aaecbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.859+0000 7fc52aa00640 1 --2- 172.21.15.37:0/2230258138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec9980 0x5633aaecbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.859+0000 7fc52aa00640 1 -- 172.21.15.37:0/2230258138 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633aadf2de0 con 0x5633aaec6f40 2024-08-20T05:06:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.859+0000 7fc52a000640 1 --2- 172.21.15.37:0/2230258138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec9980 0x5633aaecbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:06:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.859+0000 7fc52aa00640 1 --2- 172.21.15.37:0/2230258138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec6f40 0x5633aaec9330 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc51c035040 tx=0x7fc51c009490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc807704ba0dcb96 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:31.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.859+0000 7fc523400640 1 --2- 172.21.15.37:0/3834969107 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5100b3bd0 0x7fc5100b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.859+0000 7fc517e00640 1 -- 172.21.15.37:0/2230258138 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51c041020 con 0x5633aaec6f40 2024-08-20T05:06:31.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.859+0000 7fc517e00640 1 -- 172.21.15.37:0/2230258138 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc51c004040 con 0x5633aaec6f40 2024-08-20T05:06:31.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.859+0000 7fc517e00640 1 -- 172.21.15.37:0/2230258138 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51c037040 con 0x5633aaec6f40 2024-08-20T05:06:31.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.860+0000 7fc523400640 1 -- 172.21.15.37:0/3834969107 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc5240e3f50 con 0x7fc52c079260 2024-08-20T05:06:31.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.860+0000 7fc52a000640 1 --2- 172.21.15.37:0/3834969107 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5100b3bd0 0x7fc5100b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.860+0000 7fc5347ff740 1 -- 172.21.15.37:0/2230258138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec6f40 msgr2=0x5633aaec9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:31.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.860+0000 7fc5347ff740 1 --2- 172.21.15.37:0/2230258138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec6f40 0x5633aaec9330 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc51c035040 tx=0x7fc51c009490 comp rx=0 tx=0).stop 2024-08-20T05:06:31.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.860+0000 7fc52a000640 1 --2- 172.21.15.37:0/3834969107 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5100b3bd0 0x7fc5100b6090 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc518011620 tx=0x7fc518005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:31.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.860+0000 7fc5347ff740 1 -- 172.21.15.37:0/2230258138 shutdown_connections 2024-08-20T05:06:31.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.860+0000 7fc5347ff740 1 --2- 172.21.15.37:0/2230258138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec9980 0x5633aaecbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.860+0000 7fc5347ff740 1 --2- 172.21.15.37:0/2230258138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec6f40 0x5633aaec9330 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.860+0000 7fc5347ff740 1 --2- 172.21.15.37:0/2230258138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec4610 0x5633aaec6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.860+0000 7fc5347ff740 1 -- 172.21.15.37:0/2230258138 >> 172.21.15.37:0/2230258138 conn(0x5633aaebf760 msgr2=0x5633aaec04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:31.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.860+0000 7fc5347ff740 1 -- 172.21.15.37:0/2230258138 shutdown_connections 2024-08-20T05:06:31.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.860+0000 7fc5347ff740 1 -- 172.21.15.37:0/2230258138 wait complete. 2024-08-20T05:06:31.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.861+0000 7fc5347ff740 1 -- start start 2024-08-20T05:06:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.861+0000 7fc5347ff740 1 Processor -- start 2024-08-20T05:06:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.862+0000 7fc5347ff740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec4610 0x5633aaecdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.862+0000 7fc5347ff740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec6f40 0x5633aaece300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.862+0000 7fc5347ff740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec9980 0x5633aaeceed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.862+0000 7fc5347ff740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5633aad5fab0 con 0x5633aaec6f40 2024-08-20T05:06:31.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.862+0000 7fc5347ff740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5633aadcd140 con 0x5633aaec9980 2024-08-20T05:06:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.862+0000 7fc5347ff740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5633aaecc900 con 0x5633aaec4610 2024-08-20T05:06:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.862+0000 7fc5347ff740 10 client.0 _ll_register_callbacks cb 0x5633aade05d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.862+0000 7fc52a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec6f40 0x5633aaece300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.862+0000 7fc52a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec6f40 0x5633aaece300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54710/0 (socket says 172.21.15.37:54710) 2024-08-20T05:06:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.862+0000 7fc52a000640 1 -- 172.21.15.37:0/876072284 learned_addr learned my addr 172.21.15.37:0/876072284 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.862+0000 7fc52aa00640 1 --2- 172.21.15.37:0/876072284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec4610 0x5633aaecdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.862+0000 7fc52b400640 1 --2- 172.21.15.37:0/876072284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec9980 0x5633aaeceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.863+0000 7fc52aa00640 1 -- 172.21.15.37:0/876072284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec9980 msgr2=0x5633aaeceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:31.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.863+0000 7fc52aa00640 1 --2- 172.21.15.37:0/876072284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec9980 0x5633aaeceed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.863+0000 7fc52aa00640 1 -- 172.21.15.37:0/876072284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec6f40 msgr2=0x5633aaece300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.863+0000 7fc52aa00640 1 --2- 172.21.15.37:0/876072284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec6f40 0x5633aaece300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.863+0000 7fc52aa00640 1 -- 172.21.15.37:0/876072284 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633aadce170 con 0x5633aaec4610 2024-08-20T05:06:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.863+0000 7fc52b400640 1 --2- 172.21.15.37:0/876072284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec9980 0x5633aaeceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.863+0000 7fc52aa00640 1 --2- 172.21.15.37:0/876072284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec4610 0x5633aaecdc60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc51c035040 tx=0x7fc51c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d14490d313f13d23 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.863+0000 7fc514c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:06:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.863+0000 7fc514c00640 1 -- 172.21.15.37:0/876072284 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc51c041030 con 0x5633aaec4610 2024-08-20T05:06:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.863+0000 7fc5347ff740 1 -- 172.21.15.37:0/876072284 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc51c004040 con 0x5633aaec4610 2024-08-20T05:06:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.863+0000 7fc514c00640 1 -- 172.21.15.37:0/876072284 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc51c030750 con 0x5633aaec4610 2024-08-20T05:06:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.864+0000 7fc514c00640 1 -- 172.21.15.37:0/876072284 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc51c058050 con 0x5633aaec4610 2024-08-20T05:06:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.864+0000 7fc5347ff740 10 client.26698 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.864+0000 7fc5347ff740 1 -- 172.21.15.37:0/876072284 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5633aab89790 con 0x5633aaec4610 2024-08-20T05:06:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.864+0000 7fc514c00640 1 -- 172.21.15.37:0/876072284 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc51c004040 con 0x5633aaec4610 2024-08-20T05:06:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.864+0000 7fc514c00640 1 -- 172.21.15.37:0/876072284 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fc51c03d840 con 0x5633aaec4610 2024-08-20T05:06:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.864+0000 7fc5347ff740 10 client.26698 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.864+0000 7fc5347ff740 10 client.26698 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.864+0000 7fc5347ff740 20 client.26698 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.864+0000 7fc5347ff740 1 --2- 172.21.15.37:0/876072284 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5633aaed9480 0x5633aaedb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.864+0000 7fc5347ff740 4 client.26698 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:06:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.864+0000 7fc5347ff740 1 -- 172.21.15.37:0/876072284 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633aae39160 con 0x5633aaed9480 2024-08-20T05:06:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.865+0000 7fc52a000640 1 --2- 172.21.15.37:0/876072284 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5633aaed9480 0x5633aaedb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.865+0000 7fc52a000640 1 --2- 172.21.15.37:0/876072284 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5633aaed9480 0x5633aaedb870 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eea024966d075de9 server_cookie=71abe067cf85d2e8 in_seq=0 out_seq=0 2024-08-20T05:06:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.865+0000 7fc514c00640 10 client.26698 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.866+0000 7fc514c00640 1 -- 172.21.15.37:0/876072284 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5633aae39160 con 0x5633aaed9480 2024-08-20T05:06:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.866+0000 7fc514c00640 10 client.26698 handle_command_reply: tid=0 2024-08-20T05:06:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.866+0000 7fc5347ff740 1 client.26698 shutdown 2024-08-20T05:06:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.866+0000 7fc5347ff740 1 -- 172.21.15.37:0/876072284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec4610 msgr2=0x5633aaecdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.866+0000 7fc5347ff740 1 --2- 172.21.15.37:0/876072284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec4610 0x5633aaecdc60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fc51c035040 tx=0x7fc51c000bc0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.866+0000 7fc5347ff740 1 -- 172.21.15.37:0/876072284 shutdown_connections 2024-08-20T05:06:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.866+0000 7fc5347ff740 1 --2- 172.21.15.37:0/876072284 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5633aaed9480 0x5633aaedb870 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.866+0000 7fc5347ff740 1 --2- 172.21.15.37:0/876072284 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec9980 0x5633aaeceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.866+0000 7fc5347ff740 1 --2- 172.21.15.37:0/876072284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec6f40 0x5633aaece300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.866+0000 7fc514c00640 0 client.26698 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.866+0000 7fc5347ff740 1 --2- 172.21.15.37:0/876072284 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec4610 0x5633aaecdc60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.866+0000 7fc5347ff740 1 -- 172.21.15.37:0/876072284 >> 172.21.15.37:0/876072284 conn(0x5633aaebf760 msgr2=0x5633aaebe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.866+0000 7fc5347ff740 1 -- 172.21.15.37:0/876072284 shutdown_connections 2024-08-20T05:06:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.866+0000 7fc5347ff740 1 -- 172.21.15.37:0/876072284 wait complete. 2024-08-20T05:06:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.867+0000 7fc5347ff740 20 client.26698 trim_cache size 0 max 16384 2024-08-20T05:06:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.891+0000 7fc5347ff740 1 Processor -- start 2024-08-20T05:06:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.891+0000 7fc5347ff740 1 -- start start 2024-08-20T05:06:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.892+0000 7fc5347ff740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec4610 0x5633aaebe650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.892+0000 7fc5347ff740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec6f40 0x5633aaebeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.892+0000 7fc5347ff740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec9980 0x5633aaec25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.892+0000 7fc5347ff740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c1b1940 con 0x5633aaec6f40 2024-08-20T05:06:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.892+0000 7fc5347ff740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c1b3480 con 0x5633aaec4610 2024-08-20T05:06:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.892+0000 7fc5347ff740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c1b2010 con 0x5633aaec9980 2024-08-20T05:06:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.892+0000 7fc52a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec6f40 0x5633aaebeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.892+0000 7fc52a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec6f40 0x5633aaebeb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54716/0 (socket says 172.21.15.37:54716) 2024-08-20T05:06:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.892+0000 7fc52a000640 1 -- 172.21.15.37:0/4046560828 learned_addr learned my addr 172.21.15.37:0/4046560828 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.892+0000 7fc52b400640 1 --2- 172.21.15.37:0/4046560828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec9980 0x5633aaec25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.892+0000 7fc52aa00640 1 --2- 172.21.15.37:0/4046560828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec4610 0x5633aaebe650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.892+0000 7fc52a000640 1 -- 172.21.15.37:0/4046560828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec9980 msgr2=0x5633aaec25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.892+0000 7fc52a000640 1 --2- 172.21.15.37:0/4046560828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec9980 0x5633aaec25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.892+0000 7fc52a000640 1 -- 172.21.15.37:0/4046560828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec4610 msgr2=0x5633aaebe650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.892+0000 7fc52a000640 1 --2- 172.21.15.37:0/4046560828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec4610 0x5633aaebe650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.892+0000 7fc52a000640 1 -- 172.21.15.37:0/4046560828 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633aac02620 con 0x5633aaec6f40 2024-08-20T05:06:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.892+0000 7fc52aa00640 1 --2- 172.21.15.37:0/4046560828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec4610 0x5633aaebe650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:06:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.893+0000 7fc52a000640 1 --2- 172.21.15.37:0/4046560828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec6f40 0x5633aaebeb90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc518005940 tx=0x7fc5180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c31413e7aa18eca server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.893+0000 7fc517400640 1 -- 172.21.15.37:0/4046560828 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc518031070 con 0x5633aaec6f40 2024-08-20T05:06:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.893+0000 7fc517400640 1 -- 172.21.15.37:0/4046560828 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc518010e00 con 0x5633aaec6f40 2024-08-20T05:06:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.893+0000 7fc517400640 1 -- 172.21.15.37:0/4046560828 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc518022750 con 0x5633aaec6f40 2024-08-20T05:06:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.893+0000 7fc5347ff740 1 -- 172.21.15.37:0/4046560828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec6f40 msgr2=0x5633aaebeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.893+0000 7fc5347ff740 1 --2- 172.21.15.37:0/4046560828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec6f40 0x5633aaebeb90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc518005940 tx=0x7fc5180046c0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.893+0000 7fc5347ff740 1 -- 172.21.15.37:0/4046560828 shutdown_connections 2024-08-20T05:06:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.893+0000 7fc5347ff740 1 --2- 172.21.15.37:0/4046560828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec9980 0x5633aaec25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.893+0000 7fc5347ff740 1 --2- 172.21.15.37:0/4046560828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec6f40 0x5633aaebeb90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.893+0000 7fc5347ff740 1 --2- 172.21.15.37:0/4046560828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec4610 0x5633aaebe650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.893+0000 7fc5347ff740 1 -- 172.21.15.37:0/4046560828 >> 172.21.15.37:0/4046560828 conn(0x5633aaebf760 msgr2=0x5633aaebdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.894+0000 7fc5347ff740 1 -- 172.21.15.37:0/4046560828 shutdown_connections 2024-08-20T05:06:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.894+0000 7fc5347ff740 1 -- 172.21.15.37:0/4046560828 wait complete. 2024-08-20T05:06:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.894+0000 7fc5347ff740 1 -- start start 2024-08-20T05:06:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.894+0000 7fc5347ff740 1 Processor -- start 2024-08-20T05:06:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.894+0000 7fc5347ff740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec4610 0x5633aaed59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.894+0000 7fc5347ff740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec6f40 0x5633aaed46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.894+0000 7fc5347ff740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec9980 0x5633aaed4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.895+0000 7fc5347ff740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c1b2db0 con 0x5633aaec9980 2024-08-20T05:06:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.895+0000 7fc5347ff740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c1b26e0 con 0x5633aaec4610 2024-08-20T05:06:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.895+0000 7fc5347ff740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc52c1af920 con 0x5633aaec6f40 2024-08-20T05:06:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.895+0000 7fc5347ff740 10 client.0 _ll_register_callbacks cb 0x7fc518009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.895+0000 7fc52b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec9980 0x5633aaed4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.895+0000 7fc52aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec4610 0x5633aaed59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.895+0000 7fc52b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec9980 0x5633aaed4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54732/0 (socket says 172.21.15.37:54732) 2024-08-20T05:06:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.895+0000 7fc52aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec4610 0x5633aaed59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:60834/0 (socket says 172.21.15.37:60834) 2024-08-20T05:06:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.895+0000 7fc52b400640 1 -- 172.21.15.37:0/333883399 learned_addr learned my addr 172.21.15.37:0/333883399 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.895+0000 7fc52a000640 1 --2- 172.21.15.37:0/333883399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec6f40 0x5633aaed46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.895+0000 7fc52b400640 1 -- 172.21.15.37:0/333883399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec6f40 msgr2=0x5633aaed46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.895+0000 7fc52b400640 1 --2- 172.21.15.37:0/333883399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec6f40 0x5633aaed46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.895+0000 7fc52b400640 1 -- 172.21.15.37:0/333883399 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec4610 msgr2=0x5633aaed59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.895+0000 7fc52b400640 1 --2- 172.21.15.37:0/333883399 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec4610 0x5633aaed59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.895+0000 7fc52b400640 1 -- 172.21.15.37:0/333883399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633aaed5380 con 0x5633aaec9980 2024-08-20T05:06:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.895+0000 7fc52aa00640 1 --2- 172.21.15.37:0/333883399 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec4610 0x5633aaed59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.895+0000 7fc52b400640 1 --2- 172.21.15.37:0/333883399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec9980 0x5633aaed4c10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc5240a7d10 tx=0x7fc524004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253fbec9e30eec40 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.896+0000 7fc514c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:06:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.896+0000 7fc514c00640 1 -- 172.21.15.37:0/333883399 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5240aaaa0 con 0x5633aaec9980 2024-08-20T05:06:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.896+0000 7fc514c00640 1 -- 172.21.15.37:0/333883399 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc5240b36c0 con 0x5633aaec9980 2024-08-20T05:06:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.896+0000 7fc5347ff740 1 -- 172.21.15.37:0/333883399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc518010e00 con 0x5633aaec9980 2024-08-20T05:06:31.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.896+0000 7fc514c00640 1 -- 172.21.15.37:0/333883399 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc5240af0a0 con 0x5633aaec9980 2024-08-20T05:06:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.896+0000 7fc5347ff740 10 client.16437 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.896+0000 7fc5347ff740 1 -- 172.21.15.37:0/333883399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5633aaf44120 con 0x5633aaec9980 2024-08-20T05:06:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.896+0000 7fc514c00640 1 -- 172.21.15.37:0/333883399 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc518010e00 con 0x5633aaec9980 2024-08-20T05:06:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.896+0000 7fc514c00640 1 -- 172.21.15.37:0/333883399 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fc52400b040 con 0x5633aaec9980 2024-08-20T05:06:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.896+0000 7fc5347ff740 10 client.16437 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.896+0000 7fc5347ff740 10 client.16437 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.896+0000 7fc5347ff740 20 client.16437 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.896+0000 7fc5347ff740 1 --2- 172.21.15.37:0/333883399 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5633aaf44b00 0x5633aaf46f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.896+0000 7fc5347ff740 4 client.16437 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:06:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.896+0000 7fc5347ff740 1 -- 172.21.15.37:0/333883399 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5633aae34c00 con 0x5633aaf44b00 2024-08-20T05:06:31.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.897+0000 7fc52aa00640 1 --2- 172.21.15.37:0/333883399 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5633aaf44b00 0x5633aaf46f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.898+0000 7fc514c00640 10 client.16437 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:31.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.898+0000 7fc52aa00640 1 --2- 172.21.15.37:0/333883399 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5633aaf44b00 0x5633aaf46f20 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a67d4a203d31c09 server_cookie=77e4dd14c54bac0 in_seq=0 out_seq=0 2024-08-20T05:06:31.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.908+0000 7fc514c00640 1 -- 172.21.15.37:0/333883399 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5633aae34c00 con 0x5633aaf44b00 2024-08-20T05:06:31.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.908+0000 7fc514c00640 10 client.16437 handle_command_reply: tid=0 2024-08-20T05:06:31.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.909+0000 7fc5347ff740 1 client.16437 shutdown 2024-08-20T05:06:31.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.909+0000 7fc5347ff740 1 -- 172.21.15.37:0/333883399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec9980 msgr2=0x5633aaed4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:31.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.909+0000 7fc5347ff740 1 --2- 172.21.15.37:0/333883399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec9980 0x5633aaed4c10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc5240a7d10 tx=0x7fc524004700 comp rx=0 tx=0).stop 2024-08-20T05:06:31.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.909+0000 7fc5347ff740 1 -- 172.21.15.37:0/333883399 shutdown_connections 2024-08-20T05:06:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.909+0000 7fc5347ff740 1 --2- 172.21.15.37:0/333883399 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5633aaf44b00 0x5633aaf46f20 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.909+0000 7fc5347ff740 1 --2- 172.21.15.37:0/333883399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633aaec9980 0x5633aaed4c10 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.909+0000 7fc5347ff740 1 --2- 172.21.15.37:0/333883399 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633aaec6f40 0x5633aaed46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.909+0000 7fc514c00640 0 client.16437 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.909+0000 7fc5347ff740 1 --2- 172.21.15.37:0/333883399 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633aaec4610 0x5633aaed59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.909+0000 7fc5347ff740 1 -- 172.21.15.37:0/333883399 >> 172.21.15.37:0/333883399 conn(0x5633aaebf760 msgr2=0x5633aaebe760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.909+0000 7fc5347ff740 1 -- 172.21.15.37:0/333883399 shutdown_connections 2024-08-20T05:06:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.909+0000 7fc5347ff740 1 -- 172.21.15.37:0/333883399 wait complete. 2024-08-20T05:06:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.909+0000 7fc5347ff740 20 client.16437 trim_cache size 0 max 16384 2024-08-20T05:06:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:06:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:06:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:06:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:06:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.910+0000 7fc531800640 1 -- 172.21.15.37:0/3834969107 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5100b3bd0 msgr2=0x7fc5100b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.910+0000 7fc531800640 1 --2- 172.21.15.37:0/3834969107 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5100b3bd0 0x7fc5100b6090 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc518011620 tx=0x7fc518005f90 comp rx=0 tx=0).stop 2024-08-20T05:06:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.910+0000 7fc531800640 1 -- 172.21.15.37:0/3834969107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc52c079260 msgr2=0x7fc52c1a0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.910+0000 7fc531800640 1 --2- 172.21.15.37:0/3834969107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc52c079260 0x7fc52c1a0350 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc52400efc0 tx=0x7fc52400c800 comp rx=0 tx=0).stop 2024-08-20T05:06:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.910+0000 7fc531800640 1 -- 172.21.15.37:0/3834969107 shutdown_connections 2024-08-20T05:06:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.910+0000 7fc531800640 1 --2- 172.21.15.37:0/3834969107 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc5100b3bd0 0x7fc5100b6090 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.910+0000 7fc531800640 1 --2- 172.21.15.37:0/3834969107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc52c079260 0x7fc52c1a0350 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.910+0000 7fc531800640 1 --2- 172.21.15.37:0/3834969107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc52c0788a0 0x7fc52c19f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.910+0000 7fc531800640 1 --2- 172.21.15.37:0/3834969107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc52c077750 0x7fc52c19f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.910+0000 7fc531800640 1 -- 172.21.15.37:0/3834969107 >> 172.21.15.37:0/3834969107 conn(0x7fc52c100170 msgr2=0x7fc52c101c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.910+0000 7fc531800640 1 -- 172.21.15.37:0/3834969107 shutdown_connections 2024-08-20T05:06:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:31.910+0000 7fc531800640 1 -- 172.21.15.37:0/3834969107 wait complete. 2024-08-20T05:06:32.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:31 smithi037 ceph-mon[17265]: pgmap v529: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 6.1 MiB/s wr, 516 op/s 2024-08-20T05:06:32.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:31 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:06:32.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:31 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:06:32.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:31 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:06:32.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:31 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2785619328' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:06:32.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:31 smithi135 ceph-mon[22342]: pgmap v529: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 6.1 MiB/s wr, 516 op/s 2024-08-20T05:06:32.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:31 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:06:32.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:31 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:06:32.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:31 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:06:32.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:31 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2785619328' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:06:32.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:31 smithi130 ceph-mon[22007]: pgmap v529: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 6.1 MiB/s wr, 516 op/s 2024-08-20T05:06:32.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:31 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:06:32.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:31 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:06:32.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:31 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:06:32.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:31 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2785619328' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:06:32.341 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id d2ab4b2f --release --await' 2024-08-20T05:06:32.341 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id d2ab4b2f --release --await 2024-08-20T05:06:32.725 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:06:33.035 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:32 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:06:33.035 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:32 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:06:33.045 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 215.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:06:33.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:32 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:06:33.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:32 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:06:33.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:32 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:06:33.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:32 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:06:33.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.319+0000 7f7fbb600640 1 -- 172.21.15.37:0/2027349777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb4108e40 msgr2=0x7f7fb410f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:33.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.319+0000 7f7fbb600640 1 --2- 172.21.15.37:0/2027349777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb4108e40 0x7f7fb410f640 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009ca0 tx=0x7f7fac02a8c0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.319+0000 7f7fbb600640 1 -- 172.21.15.37:0/2027349777 shutdown_connections 2024-08-20T05:06:33.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.319+0000 7f7fbb600640 1 --2- 172.21.15.37:0/2027349777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb4108e40 0x7f7fb410f640 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.319+0000 7f7fbb600640 1 --2- 172.21.15.37:0/2027349777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fb41084c0 0x7f7fb4108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.319+0000 7f7fbb600640 1 --2- 172.21.15.37:0/2027349777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fb4102ab0 0x7f7fb4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.319+0000 7f7fbb600640 1 -- 172.21.15.37:0/2027349777 >> 172.21.15.37:0/2027349777 conn(0x7f7fb40fe500 msgr2=0x7f7fb4100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:33.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.319+0000 7f7fbb600640 1 -- 172.21.15.37:0/2027349777 shutdown_connections 2024-08-20T05:06:33.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.319+0000 7f7fbb600640 1 -- 172.21.15.37:0/2027349777 wait complete. 2024-08-20T05:06:33.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.321+0000 7f7fbb600640 1 Processor -- start 2024-08-20T05:06:33.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.321+0000 7f7fbb600640 1 -- start start 2024-08-20T05:06:33.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.321+0000 7f7fbb600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fb4102ab0 0x7f7fb419b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.321+0000 7f7fbb600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fb41084c0 0x7f7fb419b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.321+0000 7f7fbb600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb4108e40 0x7f7fb41a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.321+0000 7f7fbb600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb4112b50 con 0x7f7fb4108e40 2024-08-20T05:06:33.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.321+0000 7f7fbb600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb41129d0 con 0x7f7fb4102ab0 2024-08-20T05:06:33.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.321+0000 7f7fbb600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb4112cd0 con 0x7f7fb41084c0 2024-08-20T05:06:33.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.321+0000 7f7fb8c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fb4102ab0 0x7f7fb419b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:33.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.321+0000 7f7fb9600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb4108e40 0x7f7fb41a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:33.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.321+0000 7f7fb8c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fb4102ab0 0x7f7fb419b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:34818/0 (socket says 172.21.15.37:34818) 2024-08-20T05:06:33.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.321+0000 7f7fb9600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb4108e40 0x7f7fb41a0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54650/0 (socket says 172.21.15.37:54650) 2024-08-20T05:06:33.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.321+0000 7f7fb8c00640 1 -- 172.21.15.37:0/4119908373 learned_addr learned my addr 172.21.15.37:0/4119908373 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:33.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.321+0000 7f7fb3e00640 1 --2- 172.21.15.37:0/4119908373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fb41084c0 0x7f7fb419b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:33.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.322+0000 7f7fb8c00640 1 -- 172.21.15.37:0/4119908373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fb41084c0 msgr2=0x7f7fb419b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:33.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.322+0000 7f7fb8c00640 1 --2- 172.21.15.37:0/4119908373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fb41084c0 0x7f7fb419b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.322+0000 7f7fb8c00640 1 -- 172.21.15.37:0/4119908373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb4108e40 msgr2=0x7f7fb41a0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:33.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.322+0000 7f7fb8c00640 1 --2- 172.21.15.37:0/4119908373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb4108e40 0x7f7fb41a0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.322+0000 7f7fb8c00640 1 -- 172.21.15.37:0/4119908373 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb41a11d0 con 0x7f7fb4102ab0 2024-08-20T05:06:33.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.322+0000 7f7fb3e00640 1 --2- 172.21.15.37:0/4119908373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fb41084c0 0x7f7fb419b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:33.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.322+0000 7f7fb8c00640 1 --2- 172.21.15.37:0/4119908373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fb4102ab0 0x7f7fb419b120 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800e9f0 tx=0x7f7fa800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:33.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.322+0000 7f7fb1600640 1 -- 172.21.15.37:0/4119908373 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa800cd80 con 0x7f7fb4102ab0 2024-08-20T05:06:33.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.322+0000 7f7fbb600640 1 -- 172.21.15.37:0/4119908373 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb41a14c0 con 0x7f7fb4102ab0 2024-08-20T05:06:33.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.323+0000 7f7fb1600640 1 -- 172.21.15.37:0/4119908373 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fa80054d0 con 0x7f7fb4102ab0 2024-08-20T05:06:33.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.323+0000 7f7fb1600640 1 -- 172.21.15.37:0/4119908373 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa8010690 con 0x7f7fb4102ab0 2024-08-20T05:06:33.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.323+0000 7f7fbb600640 1 -- 172.21.15.37:0/4119908373 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb41a7b80 con 0x7f7fb4102ab0 2024-08-20T05:06:33.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.326+0000 7f7fbdfd4740 1 Processor -- start 2024-08-20T05:06:33.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.326+0000 7f7fbdfd4740 1 -- start start 2024-08-20T05:06:33.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.327+0000 7f7fbdfd4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999cfbcf0 0x55f999cfc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.327+0000 7f7fbdfd4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 0x55f999d08060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.327+0000 7f7fbdfd4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999d085a0 0x55f999d0a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.327+0000 7f7fbdfd4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f999c9d670 con 0x55f999d085a0 2024-08-20T05:06:33.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.327+0000 7f7fbdfd4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f999c71d70 con 0x55f999cfbcf0 2024-08-20T05:06:33.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.327+0000 7f7fbdfd4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f999c61270 con 0x55f999cfc610 2024-08-20T05:06:33.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.327+0000 7f7fb3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999d085a0 0x55f999d0a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:33.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.327+0000 7f7fb3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999d085a0 0x55f999d0a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54664/0 (socket says 172.21.15.37:54664) 2024-08-20T05:06:33.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.327+0000 7f7fb3e00640 1 -- 172.21.15.37:0/2728523818 learned_addr learned my addr 172.21.15.37:0/2728523818 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:33.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.327+0000 7f7fb9600640 1 --2- 172.21.15.37:0/2728523818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999cfbcf0 0x55f999cfc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.328+0000 7f7fb3e00640 1 -- 172.21.15.37:0/2728523818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 msgr2=0x55f999d08060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:06:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.328+0000 7f7fb3e00640 1 --2- 172.21.15.37:0/2728523818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 0x55f999d08060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.328+0000 7f7fb3e00640 1 -- 172.21.15.37:0/2728523818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999cfbcf0 msgr2=0x55f999cfc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.328+0000 7f7fb3e00640 1 --2- 172.21.15.37:0/2728523818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999cfbcf0 0x55f999cfc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.328+0000 7f7fb3e00640 1 -- 172.21.15.37:0/2728523818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f999bfd870 con 0x55f999d085a0 2024-08-20T05:06:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.328+0000 7f7fb1600640 1 -- 172.21.15.37:0/4119908373 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7fa8004e90 con 0x7f7fb4102ab0 2024-08-20T05:06:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.328+0000 7f7fb3e00640 1 --2- 172.21.15.37:0/2728523818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999d085a0 0x55f999d0a990 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00114f0 tx=0x7f7fa00119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6d21dc39e2c0cc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.328+0000 7f7fa5c00640 1 -- 172.21.15.37:0/2728523818 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa001e070 con 0x55f999d085a0 2024-08-20T05:06:33.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.328+0000 7f7fa5c00640 1 -- 172.21.15.37:0/2728523818 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fa00035f0 con 0x55f999d085a0 2024-08-20T05:06:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.328+0000 7f7fa5c00640 1 -- 172.21.15.37:0/2728523818 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa000f820 con 0x55f999d085a0 2024-08-20T05:06:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.329+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/2728523818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999d085a0 msgr2=0x55f999d0a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.329+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/2728523818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999d085a0 0x55f999d0a990 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00114f0 tx=0x7f7fa00119b0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.329+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/2728523818 shutdown_connections 2024-08-20T05:06:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.329+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/2728523818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999d085a0 0x55f999d0a990 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.329+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/2728523818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 0x55f999d08060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.329+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/2728523818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999cfbcf0 0x55f999cfc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.329+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/2728523818 >> 172.21.15.37:0/2728523818 conn(0x55f999cf9b20 msgr2=0x55f999cfacc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.329+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/2728523818 shutdown_connections 2024-08-20T05:06:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.329+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/2728523818 wait complete. 2024-08-20T05:06:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.330+0000 7f7fbdfd4740 1 -- start start 2024-08-20T05:06:33.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.330+0000 7f7fbdfd4740 1 Processor -- start 2024-08-20T05:06:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.330+0000 7f7fb1600640 1 --2- 172.21.15.37:0/4119908373 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f9c0b3ae0 0x7f7f9c0b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.330+0000 7f7fb1600640 1 -- 172.21.15.37:0/4119908373 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7fa80e43d0 con 0x7f7fb4102ab0 2024-08-20T05:06:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.330+0000 7f7fb9600640 1 --2- 172.21.15.37:0/4119908373 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f9c0b3ae0 0x7f7f9c0b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.330+0000 7f7fbdfd4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 0x55f999d07ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.330+0000 7f7fbdfd4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 0x55f999d052f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.330+0000 7f7fbdfd4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999d085a0 0x55f999d05900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.331+0000 7f7fbdfd4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f999be7ff0 con 0x55f999cfbcf0 2024-08-20T05:06:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.331+0000 7f7fbdfd4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f999c652b0 con 0x55f999d085a0 2024-08-20T05:06:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.331+0000 7f7fbdfd4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f999ac3bb0 con 0x55f999cfc610 2024-08-20T05:06:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.331+0000 7f7fbdfd4740 10 client.0 _ll_register_callbacks cb 0x55f99996cd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.331+0000 7f7fb3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 0x55f999d052f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:33.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.331+0000 7f7fb3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 0x55f999d052f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:54152/0 (socket says 172.21.15.37:54152) 2024-08-20T05:06:33.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.331+0000 7f7fb8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 0x55f999d07ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:33.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.331+0000 7f7fb3e00640 1 -- 172.21.15.37:0/2277747828 learned_addr learned my addr 172.21.15.37:0/2277747828 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:33.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.331+0000 7f7fb9600640 1 --2- 172.21.15.37:0/2277747828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999d085a0 0x55f999d05900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:33.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.331+0000 7f7fb3e00640 1 -- 172.21.15.37:0/2277747828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999d085a0 msgr2=0x55f999d05900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:33.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.331+0000 7f7fb3e00640 1 --2- 172.21.15.37:0/2277747828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999d085a0 0x55f999d05900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.331+0000 7f7fb3e00640 1 -- 172.21.15.37:0/2277747828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 msgr2=0x55f999d07ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:33.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.331+0000 7f7fb3e00640 1 --2- 172.21.15.37:0/2277747828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 0x55f999d07ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.331+0000 7f7fb3e00640 1 -- 172.21.15.37:0/2277747828 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9999c0b00 con 0x55f999cfc610 2024-08-20T05:06:33.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.331+0000 7f7fb9600640 1 --2- 172.21.15.37:0/4119908373 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f9c0b3ae0 0x7f7f9c0b5fa0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7fac006010 tx=0x7f7fac005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.332+0000 7f7fb3e00640 1 --2- 172.21.15.37:0/2277747828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 0x55f999d052f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00041a0 tx=0x7f7fa00041d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cf16daa69142d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.332+0000 7f7f9a000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:06:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.332+0000 7f7f9a000640 1 -- 172.21.15.37:0/2277747828 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa001e040 con 0x55f999cfc610 2024-08-20T05:06:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.332+0000 7f7f9a000640 1 -- 172.21.15.37:0/2277747828 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7fa00043f0 con 0x55f999cfc610 2024-08-20T05:06:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.332+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/2277747828 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fa00035f0 con 0x55f999cfc610 2024-08-20T05:06:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.332+0000 7f7f9a000640 1 -- 172.21.15.37:0/2277747828 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f7fa0032050 con 0x55f999cfc610 2024-08-20T05:06:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.332+0000 7f7fbdfd4740 10 client.26713 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.332+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/2277747828 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f999a37960 con 0x55f999cfc610 2024-08-20T05:06:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.332+0000 7f7f9a000640 1 -- 172.21.15.37:0/2277747828 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fa00035f0 con 0x55f999cfc610 2024-08-20T05:06:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.333+0000 7f7f9a000640 1 -- 172.21.15.37:0/2277747828 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f7fa0021030 con 0x55f999cfc610 2024-08-20T05:06:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.333+0000 7f7fbdfd4740 10 client.26713 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.333+0000 7f7fbdfd4740 10 client.26713 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:06:33.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.333+0000 7f7fbdfd4740 20 client.26713 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:33.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.333+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/2277747828 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f999d17b50 0x55f999d19f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.333+0000 7f7fbdfd4740 4 client.26713 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:06:33.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.333+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/2277747828 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f999c73cc0 con 0x55f999d17b50 2024-08-20T05:06:33.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.333+0000 7f7fb8c00640 1 --2- 172.21.15.37:0/2277747828 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f999d17b50 0x55f999d19f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:33.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.334+0000 7f7fb8c00640 1 --2- 172.21.15.37:0/2277747828 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f999d17b50 0x55f999d19f40 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0b11d3f152c633b server_cookie=6cc4b3a118c9075a in_seq=0 out_seq=0 2024-08-20T05:06:33.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.334+0000 7f7f9a000640 10 client.26713 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:33.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.334+0000 7f7f9a000640 1 -- 172.21.15.37:0/2277747828 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f999c73cc0 con 0x55f999d17b50 2024-08-20T05:06:33.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.334+0000 7f7f9a000640 10 client.26713 handle_command_reply: tid=0 2024-08-20T05:06:33.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.335+0000 7f7fbdfd4740 1 client.26713 shutdown 2024-08-20T05:06:33.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.335+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/2277747828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 msgr2=0x55f999d052f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:33.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.335+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/2277747828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 0x55f999d052f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00041a0 tx=0x7f7fa00041d0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.335+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/2277747828 shutdown_connections 2024-08-20T05:06:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.335+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/2277747828 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f999d17b50 0x55f999d19f40 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.335+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/2277747828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999d085a0 0x55f999d05900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.335+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/2277747828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 0x55f999d052f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.335+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/2277747828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 0x55f999d07ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.335+0000 7f7f9a000640 0 client.26713 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.335+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/2277747828 >> 172.21.15.37:0/2277747828 conn(0x55f999cf9b20 msgr2=0x55f999cff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.335+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/2277747828 shutdown_connections 2024-08-20T05:06:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.335+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/2277747828 wait complete. 2024-08-20T05:06:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.335+0000 7f7fbdfd4740 20 client.26713 trim_cache size 0 max 16384 2024-08-20T05:06:33.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.353+0000 7f7fbdfd4740 1 Processor -- start 2024-08-20T05:06:33.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.353+0000 7f7fbdfd4740 1 -- start start 2024-08-20T05:06:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.354+0000 7f7fbdfd4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 0x55f999d06f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.354+0000 7f7fbdfd4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 0x55f999d00470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.354+0000 7f7fbdfd4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999d085a0 0x55f999d141c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.354+0000 7f7fbdfd4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb41b1a10 con 0x55f999cfbcf0 2024-08-20T05:06:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.354+0000 7f7fbdfd4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb41b3550 con 0x55f999d085a0 2024-08-20T05:06:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.354+0000 7f7fbdfd4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb41b20e0 con 0x55f999cfc610 2024-08-20T05:06:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.354+0000 7f7fb8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 0x55f999d06f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.354+0000 7f7fb8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 0x55f999d06f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54686/0 (socket says 172.21.15.37:54686) 2024-08-20T05:06:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.354+0000 7f7fb8c00640 1 -- 172.21.15.37:0/4029758695 learned_addr learned my addr 172.21.15.37:0/4029758695 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:33.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.354+0000 7f7fb3e00640 1 --2- 172.21.15.37:0/4029758695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 0x55f999d00470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:33.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.354+0000 7f7fb9600640 1 --2- 172.21.15.37:0/4029758695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999d085a0 0x55f999d141c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:33.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.354+0000 7f7fb8c00640 1 -- 172.21.15.37:0/4029758695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 msgr2=0x55f999d00470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:33.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.354+0000 7f7fb8c00640 1 --2- 172.21.15.37:0/4029758695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 0x55f999d00470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.354+0000 7f7fb8c00640 1 -- 172.21.15.37:0/4029758695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999d085a0 msgr2=0x55f999d141c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:33.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.354+0000 7f7fb8c00640 1 --2- 172.21.15.37:0/4029758695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999d085a0 0x55f999d141c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.354+0000 7f7fb8c00640 1 -- 172.21.15.37:0/4029758695 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f999d05c70 con 0x55f999cfbcf0 2024-08-20T05:06:33.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.355+0000 7f7fb8c00640 1 --2- 172.21.15.37:0/4029758695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 0x55f999d06f90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80aaeb0 tx=0x7f7fa8004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40b43aeeee73585 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:33.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.355+0000 7f7fa5200640 1 -- 172.21.15.37:0/4029758695 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80ab620 con 0x55f999cfbcf0 2024-08-20T05:06:33.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.355+0000 7f7fa5200640 1 -- 172.21.15.37:0/4029758695 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fa80c0320 con 0x55f999cfbcf0 2024-08-20T05:06:33.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.355+0000 7f7fa5200640 1 -- 172.21.15.37:0/4029758695 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80e1be0 con 0x55f999cfbcf0 2024-08-20T05:06:33.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.355+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/4029758695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 msgr2=0x55f999d06f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:33.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.355+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/4029758695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 0x55f999d06f90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80aaeb0 tx=0x7f7fa8004990 comp rx=0 tx=0).stop 2024-08-20T05:06:33.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.356+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/4029758695 shutdown_connections 2024-08-20T05:06:33.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.356+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/4029758695 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999d085a0 0x55f999d141c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.356+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/4029758695 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 0x55f999d00470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.356+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/4029758695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 0x55f999d06f90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.356+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/4029758695 >> 172.21.15.37:0/4029758695 conn(0x55f999cf9b20 msgr2=0x55f999cff5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:33.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.356+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/4029758695 shutdown_connections 2024-08-20T05:06:33.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.356+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/4029758695 wait complete. 2024-08-20T05:06:33.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.356+0000 7f7fbdfd4740 1 -- start start 2024-08-20T05:06:33.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.356+0000 7f7fbdfd4740 1 Processor -- start 2024-08-20T05:06:33.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.357+0000 7f7fbdfd4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 0x55f999d109d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.357+0000 7f7fbdfd4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 0x55f999d0bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.357+0000 7f7fbdfd4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999d085a0 0x55f999d0c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.357+0000 7f7fbdfd4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb41b2e80 con 0x55f999cfbcf0 2024-08-20T05:06:33.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.357+0000 7f7fbdfd4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb41b27b0 con 0x55f999d085a0 2024-08-20T05:06:33.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.357+0000 7f7fbdfd4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb41af9f0 con 0x55f999cfc610 2024-08-20T05:06:33.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.357+0000 7f7fbdfd4740 10 client.0 _ll_register_callbacks cb 0x7f7fa001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:33.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.357+0000 7f7fb8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 0x55f999d109d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:33.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.357+0000 7f7fb8c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 0x55f999d109d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54694/0 (socket says 172.21.15.37:54694) 2024-08-20T05:06:33.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.357+0000 7f7fb8c00640 1 -- 172.21.15.37:0/30121637 learned_addr learned my addr 172.21.15.37:0/30121637 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:33.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.357+0000 7f7fb3e00640 1 --2- 172.21.15.37:0/30121637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 0x55f999d0bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:33.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.357+0000 7f7fb9600640 1 --2- 172.21.15.37:0/30121637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999d085a0 0x55f999d0c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:33.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.358+0000 7f7fb8c00640 1 -- 172.21.15.37:0/30121637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 msgr2=0x55f999d0bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:33.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.358+0000 7f7fb8c00640 1 --2- 172.21.15.37:0/30121637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 0x55f999d0bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.358+0000 7f7fb8c00640 1 -- 172.21.15.37:0/30121637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999d085a0 msgr2=0x55f999d0c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:33.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.358+0000 7f7fb8c00640 1 --2- 172.21.15.37:0/30121637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999d085a0 0x55f999d0c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.358+0000 7f7fb8c00640 1 -- 172.21.15.37:0/30121637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f999d0cc60 con 0x55f999cfbcf0 2024-08-20T05:06:33.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.358+0000 7f7fb9600640 1 --2- 172.21.15.37:0/30121637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999d085a0 0x55f999d0c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:06:33.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.358+0000 7f7fb8c00640 1 --2- 172.21.15.37:0/30121637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 0x55f999d109d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800e9c0 tx=0x7f7fa80af520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e395b5a1653b9f1e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:33.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.358+0000 7f7f9a000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:06:33.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.358+0000 7f7f9a000640 1 -- 172.21.15.37:0/30121637 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80ab620 con 0x55f999cfbcf0 2024-08-20T05:06:33.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.358+0000 7f7f9a000640 1 -- 172.21.15.37:0/30121637 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7fa80a7510 con 0x55f999cfbcf0 2024-08-20T05:06:33.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.358+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/30121637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fa80c0320 con 0x55f999cfbcf0 2024-08-20T05:06:33.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.358+0000 7f7f9a000640 1 -- 172.21.15.37:0/30121637 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f7fa80aaf20 con 0x55f999cfbcf0 2024-08-20T05:06:33.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.359+0000 7f7fbdfd4740 10 client.16455 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:33.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.359+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/30121637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f999d82770 con 0x55f999cfbcf0 2024-08-20T05:06:33.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.359+0000 7f7f9a000640 1 -- 172.21.15.37:0/30121637 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fa80c0320 con 0x55f999cfbcf0 2024-08-20T05:06:33.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.359+0000 7f7f9a000640 1 -- 172.21.15.37:0/30121637 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f7fa80ae070 con 0x55f999cfbcf0 2024-08-20T05:06:33.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.359+0000 7f7fbdfd4740 10 client.16455 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:33.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.359+0000 7f7fbdfd4740 10 client.16455 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:06:33.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.359+0000 7f7fbdfd4740 20 client.16455 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:33.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.359+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/30121637 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f999d82ec0 0x55f999d852e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:33.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.359+0000 7f7fbdfd4740 4 client.16455 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d2ab4b2f", "release": true, "await": true}] 2024-08-20T05:06:33.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.359+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/30121637 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d2ab4b2f", "release": true, "await": true}) -- 0x55f999c6f760 con 0x55f999d82ec0 2024-08-20T05:06:33.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.360+0000 7f7fb3e00640 1 --2- 172.21.15.37:0/30121637 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f999d82ec0 0x55f999d852e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:33.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.360+0000 7f7fb3e00640 1 --2- 172.21.15.37:0/30121637 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f999d82ec0 0x55f999d852e0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84f849417d458f5 server_cookie=e77e3a6502624fc9 in_seq=0 out_seq=0 2024-08-20T05:06:33.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.360+0000 7f7f9a000640 10 client.16455 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.389+0000 7f7f9a000640 1 -- 172.21.15.37:0/30121637 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f999c6f760 con 0x55f999d82ec0 2024-08-20T05:06:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.389+0000 7f7f9a000640 10 client.16455 handle_command_reply: tid=0 2024-08-20T05:06:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.389+0000 7f7fbdfd4740 1 client.16455 shutdown 2024-08-20T05:06:33.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.398+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/30121637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 msgr2=0x55f999d109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:33.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.398+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/30121637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 0x55f999d109d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800e9c0 tx=0x7f7fa80af520 comp rx=0 tx=0).stop 2024-08-20T05:06:33.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.398+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/30121637 shutdown_connections 2024-08-20T05:06:33.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.398+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/30121637 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f999d82ec0 0x55f999d852e0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.398+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/30121637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f999d085a0 0x55f999d0c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.398+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/30121637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f999cfc610 0x55f999d0bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.398+0000 7f7fbdfd4740 1 --2- 172.21.15.37:0/30121637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f999cfbcf0 0x55f999d109d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.398+0000 7f7f9a000640 0 client.16455 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:33.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.398+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/30121637 >> 172.21.15.37:0/30121637 conn(0x55f999cf9b20 msgr2=0x55f999cf8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:33.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.398+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/30121637 shutdown_connections 2024-08-20T05:06:33.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.398+0000 7f7fbdfd4740 1 -- 172.21.15.37:0/30121637 wait complete. 2024-08-20T05:06:33.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.398+0000 7f7fbdfd4740 20 client.16455 trim_cache size 0 max 16384 2024-08-20T05:06:33.401 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:06:33.401 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 36, 2024-08-20T05:06:33.402 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:06:33.402 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 24, 2024-08-20T05:06:33.402 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:06:33.402 INFO:teuthology.orchestra.run.smithi037.stdout: "d2ab4b2f": { 2024-08-20T05:06:33.402 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 24, 2024-08-20T05:06:33.402 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:06:33.402 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:06:33.402 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:06:33.402 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:06:33.402 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:06:33.402 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:06:33.402 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 139.8, 2024-08-20T05:06:33.402 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:06:33.403 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:06:33.403 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:06:33.403 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:06:33.403 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:06:33.403 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:06:33.403 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:06:33.403 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:06:33.403 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:06:33.403 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:06:33.403 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:06:33.403 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:06:33.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.402+0000 7f7fbb600640 1 -- 172.21.15.37:0/4119908373 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f9c0b3ae0 msgr2=0x7f7f9c0b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:33.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.402+0000 7f7fbb600640 1 --2- 172.21.15.37:0/4119908373 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f9c0b3ae0 0x7f7f9c0b5fa0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7fac006010 tx=0x7f7fac005d80 comp rx=0 tx=0).stop 2024-08-20T05:06:33.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.402+0000 7f7fbb600640 1 -- 172.21.15.37:0/4119908373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fb4102ab0 msgr2=0x7f7fb419b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.402+0000 7f7fbb600640 1 --2- 172.21.15.37:0/4119908373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fb4102ab0 0x7f7fb419b120 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7fa800e9f0 tx=0x7f7fa800edf0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.402+0000 7f7fbb600640 1 -- 172.21.15.37:0/4119908373 shutdown_connections 2024-08-20T05:06:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.402+0000 7f7fbb600640 1 --2- 172.21.15.37:0/4119908373 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f9c0b3ae0 0x7f7f9c0b5fa0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.402+0000 7f7fbb600640 1 --2- 172.21.15.37:0/4119908373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fb4108e40 0x7f7fb41a0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.402+0000 7f7fbb600640 1 --2- 172.21.15.37:0/4119908373 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7fb41084c0 0x7f7fb419b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.402+0000 7f7fbb600640 1 --2- 172.21.15.37:0/4119908373 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7fb4102ab0 0x7f7fb419b120 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.402+0000 7f7fbb600640 1 -- 172.21.15.37:0/4119908373 >> 172.21.15.37:0/4119908373 conn(0x7f7fb40fe500 msgr2=0x7f7fb4104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.403+0000 7f7fbb600640 1 -- 172.21.15.37:0/4119908373 shutdown_connections 2024-08-20T05:06:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:06:33.403+0000 7f7fbb600640 1 -- 172.21.15.37:0/4119908373 wait complete. 2024-08-20T05:06:34.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:33 smithi135 ceph-mon[22342]: pgmap v530: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.9 MiB/s wr, 387 op/s 2024-08-20T05:06:34.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:33 smithi130 ceph-mon[22007]: pgmap v530: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.9 MiB/s wr, 387 op/s 2024-08-20T05:06:34.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:33 smithi037 ceph-mon[17265]: pgmap v530: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.9 MiB/s wr, 387 op/s 2024-08-20T05:06:34.474 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd2ab4b2f', total seconds elapsed: 24.2 2024-08-20T05:06:36.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:35 smithi135 ceph-mon[22342]: pgmap v531: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 4.9 MiB/s wr, 389 op/s 2024-08-20T05:06:36.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:35 smithi130 ceph-mon[22007]: pgmap v531: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 4.9 MiB/s wr, 389 op/s 2024-08-20T05:06:36.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:35 smithi037 ceph-mon[17265]: pgmap v531: 129 pgs: 129 active+clean; 1.0 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 4.9 MiB/s wr, 389 op/s 2024-08-20T05:06:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 220.0 s, 1687.8 tps, lat 244.830 ms stddev 1745.221 2024-08-20T05:06:38.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:37 smithi135 ceph-mon[22342]: pgmap v532: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 5.1 MiB/s wr, 408 op/s 2024-08-20T05:06:38.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:37 smithi130 ceph-mon[22007]: pgmap v532: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 5.1 MiB/s wr, 408 op/s 2024-08-20T05:06:38.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:37 smithi037 ceph-mon[17265]: pgmap v532: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 5.1 MiB/s wr, 408 op/s 2024-08-20T05:06:40.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:39 smithi135 ceph-mon[22342]: pgmap v533: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.3 MiB/s wr, 369 op/s 2024-08-20T05:06:40.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:39 smithi130 ceph-mon[22007]: pgmap v533: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.3 MiB/s wr, 369 op/s 2024-08-20T05:06:40.270 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:39 smithi037 ceph-mon[17265]: pgmap v533: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.3 MiB/s wr, 369 op/s 2024-08-20T05:06:42.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:41 smithi135 ceph-mon[22342]: pgmap v534: 129 pgs: 129 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 5.2 MiB/s wr, 496 op/s 2024-08-20T05:06:42.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:41 smithi130 ceph-mon[22007]: pgmap v534: 129 pgs: 129 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 5.2 MiB/s wr, 496 op/s 2024-08-20T05:06:42.268 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:41 smithi037 ceph-mon[17265]: pgmap v534: 129 pgs: 129 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 5.2 MiB/s wr, 496 op/s 2024-08-20T05:06:43.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 225.0 s, 1811.8 tps, lat 55.158 ms stddev 68.583 2024-08-20T05:06:44.069 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:43 smithi037 ceph-mon[17265]: pgmap v535: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.0 MiB/s wr, 343 op/s 2024-08-20T05:06:44.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:43 smithi135 ceph-mon[22342]: pgmap v535: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.0 MiB/s wr, 343 op/s 2024-08-20T05:06:44.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:43 smithi130 ceph-mon[22007]: pgmap v535: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.0 MiB/s wr, 343 op/s 2024-08-20T05:06:45.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.108+0000 7f7cb5a00640 1 -- 172.21.15.37:0/3619285533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb0104890 msgr2=0x7f7cb0104c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:45.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.108+0000 7f7cb5a00640 1 --2- 172.21.15.37:0/3619285533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb0104890 0x7f7cb0104c90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009930 tx=0x7f7ca002a460 comp rx=0 tx=0).stop 2024-08-20T05:06:45.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.109+0000 7f7cb5a00640 1 -- 172.21.15.37:0/3619285533 shutdown_connections 2024-08-20T05:06:45.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.110+0000 7f7cb5a00640 1 --2- 172.21.15.37:0/3619285533 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cb01063a0 0x7f7cb010cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.111+0000 7f7cb5a00640 1 --2- 172.21.15.37:0/3619285533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cb01059e0 0x7f7cb0105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.111+0000 7f7cb5a00640 1 --2- 172.21.15.37:0/3619285533 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb0104890 0x7f7cb0104c90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.113 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.111+0000 7f7cb5a00640 1 -- 172.21.15.37:0/3619285533 >> 172.21.15.37:0/3619285533 conn(0x7f7cb0100130 msgr2=0x7f7cb0102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:45.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.111+0000 7f7cb5a00640 1 -- 172.21.15.37:0/3619285533 shutdown_connections 2024-08-20T05:06:45.114 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.112+0000 7f7cb5a00640 1 -- 172.21.15.37:0/3619285533 wait complete. 2024-08-20T05:06:45.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.113+0000 7f7cb5a00640 1 Processor -- start 2024-08-20T05:06:45.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.114+0000 7f7cb5a00640 1 -- start start 2024-08-20T05:06:45.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.117+0000 7f7cb5a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb0104890 0x7f7cb0196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.117+0000 7f7cb5a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cb01059e0 0x7f7cb01970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.117+0000 7f7cb5a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cb01063a0 0x7f7cb0197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.117+0000 7f7cb5a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb0110650 con 0x7f7cb01063a0 2024-08-20T05:06:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.117+0000 7f7cb5a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01104d0 con 0x7f7cb01059e0 2024-08-20T05:06:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.117+0000 7f7cb5a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01107d0 con 0x7f7cb0104890 2024-08-20T05:06:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.118+0000 7f7caea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb0104890 0x7f7cb0196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.118+0000 7f7caea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb0104890 0x7f7cb0196a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:54900/0 (socket says 172.21.15.37:54900) 2024-08-20T05:06:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.118+0000 7f7caea00640 1 -- 172.21.15.37:0/4223303667 learned_addr learned my addr 172.21.15.37:0/4223303667 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.118+0000 7f7cae000640 1 --2- 172.21.15.37:0/4223303667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cb01059e0 0x7f7cb01970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.118+0000 7f7caf400640 1 --2- 172.21.15.37:0/4223303667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cb01063a0 0x7f7cb0197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.119+0000 7f7cae000640 1 -- 172.21.15.37:0/4223303667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb0104890 msgr2=0x7f7cb0196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.119+0000 7f7cae000640 1 --2- 172.21.15.37:0/4223303667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb0104890 0x7f7cb0196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.119+0000 7f7cae000640 1 -- 172.21.15.37:0/4223303667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cb01063a0 msgr2=0x7f7cb0197cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.119+0000 7f7cae000640 1 --2- 172.21.15.37:0/4223303667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cb01063a0 0x7f7cb0197cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.119+0000 7f7cae000640 1 -- 172.21.15.37:0/4223303667 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb0198590 con 0x7f7cb01059e0 2024-08-20T05:06:45.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.120+0000 7f7cae000640 1 --2- 172.21.15.37:0/4223303667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cb01059e0 0x7f7cb01970a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00b3f0 tx=0x7f7c9c00b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:45.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.120+0000 7f7ca7400640 1 -- 172.21.15.37:0/4223303667 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c015020 con 0x7f7cb01059e0 2024-08-20T05:06:45.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.120+0000 7f7ca7400640 1 -- 172.21.15.37:0/4223303667 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c9c011ce0 con 0x7f7cb01059e0 2024-08-20T05:06:45.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.120+0000 7f7ca7400640 1 -- 172.21.15.37:0/4223303667 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c010de0 con 0x7f7cb01059e0 2024-08-20T05:06:45.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.120+0000 7f7cb5a00640 1 -- 172.21.15.37:0/4223303667 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb0198880 con 0x7f7cb01059e0 2024-08-20T05:06:45.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.120+0000 7f7cb5a00640 1 -- 172.21.15.37:0/4223303667 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb019cfc0 con 0x7f7cb01059e0 2024-08-20T05:06:45.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.127+0000 7f7cb88a9740 1 Processor -- start 2024-08-20T05:06:45.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.128+0000 7f7cb88a9740 1 -- start start 2024-08-20T05:06:45.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.128+0000 7f7cb88a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a602a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.128+0000 7f7cb88a9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a602f40 0x55c87a605330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.128+0000 7f7cb88a9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a605980 0x55c87a607e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.128+0000 7f7cb88a9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c87a573210 con 0x55c87a605980 2024-08-20T05:06:45.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.128+0000 7f7cb88a9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c87a562710 con 0x55c87a600610 2024-08-20T05:06:45.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.128+0000 7f7cb88a9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c87a566750 con 0x55c87a602f40 2024-08-20T05:06:45.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.128+0000 7f7caf400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a602a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.129+0000 7f7caf400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a602a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47966/0 (socket says 172.21.15.37:47966) 2024-08-20T05:06:45.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.129+0000 7f7caf400640 1 -- 172.21.15.37:0/3969294843 learned_addr learned my addr 172.21.15.37:0/3969294843 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:45.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.129+0000 7f7caea00640 1 --2- 172.21.15.37:0/3969294843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a602f40 0x55c87a605330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.129+0000 7f7ca7400640 1 -- 172.21.15.37:0/4223303667 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7c9c018020 con 0x7f7cb01059e0 2024-08-20T05:06:45.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.129+0000 7f7caf400640 1 -- 172.21.15.37:0/3969294843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a602f40 msgr2=0x55c87a605330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:45.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.129+0000 7f7caf400640 1 --2- 172.21.15.37:0/3969294843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a602f40 0x55c87a605330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.129+0000 7f7caf400640 1 -- 172.21.15.37:0/3969294843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a605980 msgr2=0x55c87a607e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:06:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.130+0000 7f7cae000640 1 --2- 172.21.15.37:0/3969294843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a605980 0x55c87a607e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.130+0000 7f7caf400640 1 --2- 172.21.15.37:0/3969294843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a605980 0x55c87a607e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.130+0000 7f7caf400640 1 -- 172.21.15.37:0/3969294843 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c87a52ede0 con 0x55c87a600610 2024-08-20T05:06:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.130+0000 7f7cae000640 1 --2- 172.21.15.37:0/3969294843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a605980 0x55c87a607e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:06:45.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.130+0000 7f7caf400640 1 --2- 172.21.15.37:0/3969294843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a602a00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009f30 tx=0x7f7ca800c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de42ccd46e236766 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:45.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.131+0000 7f7c9be00640 1 -- 172.21.15.37:0/3969294843 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca801a070 con 0x55c87a600610 2024-08-20T05:06:45.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.131+0000 7f7c9be00640 1 -- 172.21.15.37:0/3969294843 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ca80158c0 con 0x55c87a600610 2024-08-20T05:06:45.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.131+0000 7f7c9be00640 1 -- 172.21.15.37:0/3969294843 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800a7e0 con 0x55c87a600610 2024-08-20T05:06:45.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.131+0000 7f7cb88a9740 1 -- 172.21.15.37:0/3969294843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 msgr2=0x55c87a602a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.131+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/3969294843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a602a00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009f30 tx=0x7f7ca800c8b0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.132+0000 7f7cb88a9740 1 -- 172.21.15.37:0/3969294843 shutdown_connections 2024-08-20T05:06:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.132+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/3969294843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a605980 0x55c87a607e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.132+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/3969294843 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a602f40 0x55c87a605330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.132+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/3969294843 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a602a00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.132+0000 7f7cb88a9740 1 -- 172.21.15.37:0/3969294843 >> 172.21.15.37:0/3969294843 conn(0x55c87a5fb760 msgr2=0x55c87a5fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.132+0000 7f7cb88a9740 1 -- 172.21.15.37:0/3969294843 shutdown_connections 2024-08-20T05:06:45.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.132+0000 7f7cb88a9740 1 -- 172.21.15.37:0/3969294843 wait complete. 2024-08-20T05:06:45.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.133+0000 7f7cb88a9740 1 -- start start 2024-08-20T05:06:45.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.134+0000 7f7ca7400640 1 --2- 172.21.15.37:0/4223303667 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7c940b3be0 0x7f7c940b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.134+0000 7f7cb88a9740 1 Processor -- start 2024-08-20T05:06:45.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.135+0000 7f7caf400640 1 --2- 172.21.15.37:0/4223303667 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7c940b3be0 0x7f7c940b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.136+0000 7f7cb88a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a609d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.136+0000 7f7ca7400640 1 -- 172.21.15.37:0/4223303667 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7c9c0e3600 con 0x7f7cb01059e0 2024-08-20T05:06:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.137+0000 7f7cb88a9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a602f40 0x55c87a60a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.137+0000 7f7caf400640 1 --2- 172.21.15.37:0/4223303667 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7c940b3be0 0x7f7c940b60a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8018040 tx=0x7f7ca8000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.137+0000 7f7caea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a609d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.137+0000 7f7caea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a609d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47972/0 (socket says 172.21.15.37:47972) 2024-08-20T05:06:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.137+0000 7f7cb88a9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a605980 0x55c87a60afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.137+0000 7f7caea00640 1 -- 172.21.15.37:0/3050372294 learned_addr learned my addr 172.21.15.37:0/3050372294 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.137+0000 7f7cae000640 1 --2- 172.21.15.37:0/3050372294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a602f40 0x55c87a60a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.137+0000 7f7cb88a9740 1 -- 172.21.15.37:0/3050372294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c87a49bab0 con 0x55c87a602f40 2024-08-20T05:06:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.137+0000 7f7cb88a9740 1 -- 172.21.15.37:0/3050372294 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c87a509140 con 0x55c87a600610 2024-08-20T05:06:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.137+0000 7f7cb88a9740 1 -- 172.21.15.37:0/3050372294 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c87a608960 con 0x55c87a605980 2024-08-20T05:06:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.138+0000 7f7cb88a9740 10 client.0 _ll_register_callbacks cb 0x55c87a51c5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.138+0000 7f7caf400640 1 --2- 172.21.15.37:0/3050372294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a605980 0x55c87a60afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.138+0000 7f7cae000640 1 -- 172.21.15.37:0/3050372294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a605980 msgr2=0x55c87a60afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.138+0000 7f7cae000640 1 --2- 172.21.15.37:0/3050372294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a605980 0x55c87a60afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.138+0000 7f7cae000640 1 -- 172.21.15.37:0/3050372294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 msgr2=0x55c87a609d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.138+0000 7f7cae000640 1 --2- 172.21.15.37:0/3050372294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a609d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.138+0000 7f7cae000640 1 -- 172.21.15.37:0/3050372294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c87a50a170 con 0x55c87a602f40 2024-08-20T05:06:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.138+0000 7f7caea00640 1 --2- 172.21.15.37:0/3050372294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a609d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:06:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.138+0000 7f7cb88a9740 1 -- 172.21.15.37:0/3050372294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ca80158c0 con 0x55c87a602f40 2024-08-20T05:06:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.138+0000 7f7cae000640 1 --2- 172.21.15.37:0/3050372294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a602f40 0x55c87a60a3d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0a73c0 tx=0x7f7c9c0a6140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc1d72f5f27f1a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:45.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.138+0000 7f7c98c00640 10 client.16461 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:06:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.139+0000 7f7c98c00640 1 -- 172.21.15.37:0/3050372294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c0aa150 con 0x55c87a602f40 2024-08-20T05:06:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.139+0000 7f7c98c00640 1 -- 172.21.15.37:0/3050372294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7c9c0104a0 con 0x55c87a602f40 2024-08-20T05:06:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.139+0000 7f7c98c00640 1 -- 172.21.15.37:0/3050372294 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f7c9c0ae750 con 0x55c87a602f40 2024-08-20T05:06:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.140+0000 7f7cb88a9740 10 client.16461 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.140+0000 7f7cb88a9740 1 -- 172.21.15.37:0/3050372294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=36}) -- 0x55c87a2c5790 con 0x55c87a602f40 2024-08-20T05:06:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.141+0000 7f7c98c00640 1 -- 172.21.15.37:0/3050372294 <== mon.0 v2:172.21.15.37:3300/0 4 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f7c9c011830 con 0x55c87a602f40 2024-08-20T05:06:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.141+0000 7f7cb88a9740 10 client.16461 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.141+0000 7f7cb88a9740 10 client.16461 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.141+0000 7f7cb88a9740 20 client.16461 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.141+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/3050372294 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c87a615bd0 0x55c87a617fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.141+0000 7f7cb88a9740 4 client.16461 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:06:45.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.141+0000 7f7cb88a9740 1 -- 172.21.15.37:0/3050372294 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c87a575160 con 0x55c87a615bd0 2024-08-20T05:06:45.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.142+0000 7f7caea00640 1 --2- 172.21.15.37:0/3050372294 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c87a615bd0 0x55c87a617fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.143+0000 7f7caea00640 1 --2- 172.21.15.37:0/3050372294 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c87a615bd0 0x55c87a617fe0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb3427854d4f8a4e server_cookie=aa4b6d2452a9b446 in_seq=0 out_seq=0 2024-08-20T05:06:45.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.143+0000 7f7c98c00640 10 client.16461 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.144+0000 7f7c98c00640 1 -- 172.21.15.37:0/3050372294 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c87a575160 con 0x55c87a615bd0 2024-08-20T05:06:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.144+0000 7f7c98c00640 10 client.16461 handle_command_reply: tid=0 2024-08-20T05:06:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.144+0000 7f7cb88a9740 1 client.16461 shutdown 2024-08-20T05:06:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.145+0000 7f7cb88a9740 1 -- 172.21.15.37:0/3050372294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a602f40 msgr2=0x55c87a60a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.145+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/3050372294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a602f40 0x55c87a60a3d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0a73c0 tx=0x7f7c9c0a6140 comp rx=0 tx=0).stop 2024-08-20T05:06:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.145+0000 7f7cb88a9740 1 -- 172.21.15.37:0/3050372294 shutdown_connections 2024-08-20T05:06:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.145+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/3050372294 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c87a615bd0 0x55c87a617fe0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.145+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/3050372294 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a605980 0x55c87a60afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.145+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/3050372294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a602f40 0x55c87a60a3d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.145+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/3050372294 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a609d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.145+0000 7f7c98c00640 0 client.16461 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.145+0000 7f7cb88a9740 1 -- 172.21.15.37:0/3050372294 >> 172.21.15.37:0/3050372294 conn(0x55c87a5fb760 msgr2=0x55c87a5fa760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.145+0000 7f7cb88a9740 1 -- 172.21.15.37:0/3050372294 shutdown_connections 2024-08-20T05:06:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.145+0000 7f7cb88a9740 1 -- 172.21.15.37:0/3050372294 wait complete. 2024-08-20T05:06:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.146+0000 7f7cb88a9740 20 client.16461 trim_cache size 0 max 16384 2024-08-20T05:06:45.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.183+0000 7f7cb88a9740 1 Processor -- start 2024-08-20T05:06:45.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.183+0000 7f7cb88a9740 1 -- start start 2024-08-20T05:06:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.184+0000 7f7cb88a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a609470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.184+0000 7f7cb88a9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a602f40 0x55c87a61c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.184+0000 7f7cb88a9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a605980 0x55c87a61cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.186 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.184+0000 7f7cb88a9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01ba250 con 0x55c87a602f40 2024-08-20T05:06:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.184+0000 7f7cb88a9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01bbd90 con 0x55c87a600610 2024-08-20T05:06:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.184+0000 7f7cb88a9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01ba920 con 0x55c87a605980 2024-08-20T05:06:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.185+0000 7f7caea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a609470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.185+0000 7f7caea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a609470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47984/0 (socket says 172.21.15.37:47984) 2024-08-20T05:06:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.185+0000 7f7caea00640 1 -- 172.21.15.37:0/1526891104 learned_addr learned my addr 172.21.15.37:0/1526891104 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:45.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.185+0000 7f7caf400640 1 --2- 172.21.15.37:0/1526891104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a605980 0x55c87a61cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.185+0000 7f7cae000640 1 --2- 172.21.15.37:0/1526891104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a602f40 0x55c87a61c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.186+0000 7f7caf400640 1 -- 172.21.15.37:0/1526891104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 msgr2=0x55c87a609470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:45.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.186+0000 7f7caf400640 1 --2- 172.21.15.37:0/1526891104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a609470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.186+0000 7f7caf400640 1 -- 172.21.15.37:0/1526891104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a602f40 msgr2=0x55c87a61c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:45.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.186+0000 7f7caf400640 1 --2- 172.21.15.37:0/1526891104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a602f40 0x55c87a61c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.186+0000 7f7caf400640 1 -- 172.21.15.37:0/1526891104 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c87a602d70 con 0x55c87a605980 2024-08-20T05:06:45.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.186+0000 7f7caea00640 1 --2- 172.21.15.37:0/1526891104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a609470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:45.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.187+0000 7f7caf400640 1 --2- 172.21.15.37:0/1526891104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a605980 0x55c87a61cdf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009f00 tx=0x7f7ca801c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e64c4c039d07682 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:45.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.188+0000 7f7c9b400640 1 -- 172.21.15.37:0/1526891104 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca801a040 con 0x55c87a605980 2024-08-20T05:06:45.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.189+0000 7f7c9b400640 1 -- 172.21.15.37:0/1526891104 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ca8030070 con 0x55c87a605980 2024-08-20T05:06:45.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.189+0000 7f7c9b400640 1 -- 172.21.15.37:0/1526891104 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca801a040 con 0x55c87a605980 2024-08-20T05:06:45.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.190+0000 7f7cb88a9740 1 -- 172.21.15.37:0/1526891104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a605980 msgr2=0x55c87a61cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:45.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.190+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/1526891104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a605980 0x55c87a61cdf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8009f00 tx=0x7f7ca801c000 comp rx=0 tx=0).stop 2024-08-20T05:06:45.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.190+0000 7f7cb88a9740 1 -- 172.21.15.37:0/1526891104 shutdown_connections 2024-08-20T05:06:45.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.190+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/1526891104 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a605980 0x55c87a61cdf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.190+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/1526891104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a602f40 0x55c87a61c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.190+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/1526891104 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a600610 0x55c87a609470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.190+0000 7f7cb88a9740 1 -- 172.21.15.37:0/1526891104 >> 172.21.15.37:0/1526891104 conn(0x55c87a5fb760 msgr2=0x55c87a608d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:45.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.190+0000 7f7cb88a9740 1 -- 172.21.15.37:0/1526891104 shutdown_connections 2024-08-20T05:06:45.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.190+0000 7f7cb88a9740 1 -- 172.21.15.37:0/1526891104 wait complete. 2024-08-20T05:06:45.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.191+0000 7f7cb88a9740 1 -- start start 2024-08-20T05:06:45.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.191+0000 7f7cb88a9740 1 Processor -- start 2024-08-20T05:06:45.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.193+0000 7f7cb88a9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a600610 0x55c87a610bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.194+0000 7f7cb88a9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a602f40 0x55c87a6111e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.196+0000 7f7cb88a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a605980 0x55c87a67e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.196+0000 7f7caea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a600610 0x55c87a610bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.196+0000 7f7caea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a600610 0x55c87a610bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:54936/0 (socket says 172.21.15.37:54936) 2024-08-20T05:06:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.196+0000 7f7cae000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a602f40 0x55c87a6111e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.196+0000 7f7cae000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a602f40 0x55c87a6111e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34056/0 (socket says 172.21.15.37:34056) 2024-08-20T05:06:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.196+0000 7f7caea00640 1 -- 172.21.15.37:0/2326668287 learned_addr learned my addr 172.21.15.37:0/2326668287 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.196+0000 7f7cb88a9740 1 -- 172.21.15.37:0/2326668287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01bb6c0 con 0x55c87a602f40 2024-08-20T05:06:45.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.196+0000 7f7cb88a9740 1 -- 172.21.15.37:0/2326668287 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01baff0 con 0x55c87a605980 2024-08-20T05:06:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.196+0000 7f7cb88a9740 1 -- 172.21.15.37:0/2326668287 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb01b8230 con 0x55c87a600610 2024-08-20T05:06:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.196+0000 7f7cb88a9740 10 client.0 _ll_register_callbacks cb 0x7f7c9c0a9aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.197+0000 7f7caf400640 1 --2- 172.21.15.37:0/2326668287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a605980 0x55c87a67e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.197+0000 7f7caea00640 1 -- 172.21.15.37:0/2326668287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a605980 msgr2=0x55c87a67e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.197+0000 7f7caea00640 1 --2- 172.21.15.37:0/2326668287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a605980 0x55c87a67e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.197+0000 7f7caea00640 1 -- 172.21.15.37:0/2326668287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a602f40 msgr2=0x55c87a6111e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:45.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.197+0000 7f7caea00640 1 --2- 172.21.15.37:0/2326668287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a602f40 0x55c87a6111e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.197+0000 7f7caea00640 1 -- 172.21.15.37:0/2326668287 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c87a33e620 con 0x55c87a600610 2024-08-20T05:06:45.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.198+0000 7f7caea00640 1 --2- 172.21.15.37:0/2326668287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a600610 0x55c87a610bb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0004470 tx=0x7f7ca0031870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8997cc2b735d9fc1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:45.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.198+0000 7f7c98c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:06:45.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.198+0000 7f7c98c00640 1 -- 172.21.15.37:0/2326668287 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0054060 con 0x55c87a600610 2024-08-20T05:06:45.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.199+0000 7f7c98c00640 1 -- 172.21.15.37:0/2326668287 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7ca0031cb0 con 0x55c87a600610 2024-08-20T05:06:45.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.199+0000 7f7cb88a9740 1 -- 172.21.15.37:0/2326668287 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ca8030070 con 0x55c87a600610 2024-08-20T05:06:45.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.200+0000 7f7c98c00640 1 -- 172.21.15.37:0/2326668287 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f7ca0035040 con 0x55c87a600610 2024-08-20T05:06:45.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.200+0000 7f7cb88a9740 10 client.26737 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:45.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.200+0000 7f7cb88a9740 1 -- 172.21.15.37:0/2326668287 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55c87a67ffd0 con 0x55c87a600610 2024-08-20T05:06:45.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.201+0000 7f7c98c00640 1 -- 172.21.15.37:0/2326668287 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ca8030070 con 0x55c87a600610 2024-08-20T05:06:45.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.201+0000 7f7c98c00640 1 -- 172.21.15.37:0/2326668287 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f7ca00485f0 con 0x55c87a600610 2024-08-20T05:06:45.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.202+0000 7f7cb88a9740 10 client.26737 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:45.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.202+0000 7f7cb88a9740 10 client.26737 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:45.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.202+0000 7f7cb88a9740 20 client.26737 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:45.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.202+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/2326668287 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c87a6808b0 0x55c87a682cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:45.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.202+0000 7f7cb88a9740 4 client.26737 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:06:45.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.202+0000 7f7cb88a9740 1 -- 172.21.15.37:0/2326668287 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c87a570c00 con 0x55c87a6808b0 2024-08-20T05:06:45.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.202+0000 7f7cae000640 1 --2- 172.21.15.37:0/2326668287 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c87a6808b0 0x55c87a682cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.204+0000 7f7c98c00640 10 client.26737 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:45.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.204+0000 7f7cae000640 1 --2- 172.21.15.37:0/2326668287 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c87a6808b0 0x55c87a682cd0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=324c4773929f446 server_cookie=4b73d522158f631 in_seq=0 out_seq=0 2024-08-20T05:06:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.239+0000 7f7c98c00640 1 -- 172.21.15.37:0/2326668287 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c87a570c00 con 0x55c87a6808b0 2024-08-20T05:06:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.239+0000 7f7c98c00640 10 client.26737 handle_command_reply: tid=0 2024-08-20T05:06:45.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.239+0000 7f7cb88a9740 1 client.26737 shutdown 2024-08-20T05:06:45.242 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.239+0000 7f7cb88a9740 1 -- 172.21.15.37:0/2326668287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a600610 msgr2=0x55c87a610bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.239+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/2326668287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a600610 0x55c87a610bb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0004470 tx=0x7f7ca0031870 comp rx=0 tx=0).stop 2024-08-20T05:06:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.240+0000 7f7cb88a9740 1 -- 172.21.15.37:0/2326668287 shutdown_connections 2024-08-20T05:06:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.240+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/2326668287 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c87a6808b0 0x55c87a682cd0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.240+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/2326668287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c87a605980 0x55c87a67e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.240+0000 7f7c98c00640 0 client.26737 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.240+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/2326668287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c87a602f40 0x55c87a6111e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.240+0000 7f7cb88a9740 1 --2- 172.21.15.37:0/2326668287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c87a600610 0x55c87a610bb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.240+0000 7f7cb88a9740 1 -- 172.21.15.37:0/2326668287 >> 172.21.15.37:0/2326668287 conn(0x55c87a5fb760 msgr2=0x55c87a5f9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:45.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.240+0000 7f7cb88a9740 1 -- 172.21.15.37:0/2326668287 shutdown_connections 2024-08-20T05:06:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.241+0000 7f7cb88a9740 1 -- 172.21.15.37:0/2326668287 wait complete. 2024-08-20T05:06:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.241+0000 7f7cb88a9740 20 client.26737 trim_cache size 0 max 16384 2024-08-20T05:06:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:06:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:06:45.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:06:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:06:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.242+0000 7f7cb5a00640 1 -- 172.21.15.37:0/4223303667 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7c940b3be0 msgr2=0x7f7c940b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.242+0000 7f7cb5a00640 1 --2- 172.21.15.37:0/4223303667 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7c940b3be0 0x7f7c940b60a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8018040 tx=0x7f7ca8000f40 comp rx=0 tx=0).stop 2024-08-20T05:06:45.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.242+0000 7f7cb5a00640 1 -- 172.21.15.37:0/4223303667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cb01059e0 msgr2=0x7f7cb01970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.242+0000 7f7cb5a00640 1 --2- 172.21.15.37:0/4223303667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cb01059e0 0x7f7cb01970a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00b3f0 tx=0x7f7c9c00b8b0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.243+0000 7f7cb5a00640 1 -- 172.21.15.37:0/4223303667 shutdown_connections 2024-08-20T05:06:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.243+0000 7f7cb5a00640 1 --2- 172.21.15.37:0/4223303667 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7c940b3be0 0x7f7c940b60a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.243+0000 7f7cb5a00640 1 --2- 172.21.15.37:0/4223303667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cb01063a0 0x7f7cb0197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.243+0000 7f7cb5a00640 1 --2- 172.21.15.37:0/4223303667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cb01059e0 0x7f7cb01970a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.243+0000 7f7cb5a00640 1 --2- 172.21.15.37:0/4223303667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cb0104890 0x7f7cb0196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.243+0000 7f7cb5a00640 1 -- 172.21.15.37:0/4223303667 >> 172.21.15.37:0/4223303667 conn(0x7f7cb0100130 msgr2=0x7f7cb00792d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.243+0000 7f7cb5a00640 1 -- 172.21.15.37:0/4223303667 shutdown_connections 2024-08-20T05:06:45.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:45.243+0000 7f7cb5a00640 1 -- 172.21.15.37:0/4223303667 wait complete. 2024-08-20T05:06:46.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:45 smithi037 ceph-mon[17265]: pgmap v536: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 460 op/s 2024-08-20T05:06:46.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:45 smithi135 ceph-mon[22342]: pgmap v536: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 460 op/s 2024-08-20T05:06:46.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:45 smithi130 ceph-mon[22007]: pgmap v536: 129 pgs: 129 active+clean; 1.0 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 460 op/s 2024-08-20T05:06:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 230.0 s, 1411.0 tps, lat 70.788 ms stddev 84.880 2024-08-20T05:06:48.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:47 smithi135 ceph-mon[22342]: pgmap v537: 129 pgs: 129 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 544 op/s 2024-08-20T05:06:48.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:47 smithi130 ceph-mon[22007]: pgmap v537: 129 pgs: 129 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 544 op/s 2024-08-20T05:06:48.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:47 smithi037 ceph-mon[17265]: pgmap v537: 129 pgs: 129 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 544 op/s 2024-08-20T05:06:50.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:49 smithi135 ceph-mon[22342]: pgmap v538: 129 pgs: 129 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.4 MiB/s wr, 562 op/s 2024-08-20T05:06:50.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:49 smithi130 ceph-mon[22007]: pgmap v538: 129 pgs: 129 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.4 MiB/s wr, 562 op/s 2024-08-20T05:06:50.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:49 smithi037 ceph-mon[17265]: pgmap v538: 129 pgs: 129 active+clean; 1.0 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 6.4 MiB/s wr, 562 op/s 2024-08-20T05:06:52.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:51 smithi135 ceph-mon[22342]: pgmap v539: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.9 MiB/s wr, 725 op/s 2024-08-20T05:06:52.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:51 smithi130 ceph-mon[22007]: pgmap v539: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.9 MiB/s wr, 725 op/s 2024-08-20T05:06:52.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:51 smithi037 ceph-mon[17265]: pgmap v539: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.9 MiB/s wr, 725 op/s 2024-08-20T05:06:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 235.0 s, 1946.8 tps, lat 51.213 ms stddev 58.374 2024-08-20T05:06:54.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:53 smithi135 ceph-mon[22342]: pgmap v540: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.1 MiB/s wr, 629 op/s 2024-08-20T05:06:54.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:53 smithi130 ceph-mon[22007]: pgmap v540: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.1 MiB/s wr, 629 op/s 2024-08-20T05:06:54.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:53 smithi037 ceph-mon[17265]: pgmap v540: 129 pgs: 129 active+clean; 1.1 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.1 MiB/s wr, 629 op/s 2024-08-20T05:06:56.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:55 smithi135 ceph-mon[22342]: pgmap v541: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 7.4 MiB/s wr, 673 op/s 2024-08-20T05:06:56.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:55 smithi130 ceph-mon[22007]: pgmap v541: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 7.4 MiB/s wr, 673 op/s 2024-08-20T05:06:56.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:55 smithi037 ceph-mon[17265]: pgmap v541: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 7.4 MiB/s wr, 673 op/s 2024-08-20T05:06:58.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:57 smithi037 ceph-mon[17265]: pgmap v542: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 6.5 MiB/s wr, 640 op/s 2024-08-20T05:06:58.040 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 240.0 s, 1456.8 tps, lat 68.575 ms stddev 83.342 2024-08-20T05:06:58.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:57 smithi135 ceph-mon[22342]: pgmap v542: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 6.5 MiB/s wr, 640 op/s 2024-08-20T05:06:58.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:57 smithi130 ceph-mon[22007]: pgmap v542: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 6.5 MiB/s wr, 640 op/s 2024-08-20T05:06:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.447+0000 7f8362000640 1 -- 172.21.15.37:0/3269822975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c108f90 msgr2=0x7f835c109390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.447+0000 7f8362000640 1 --2- 172.21.15.37:0/3269822975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c108f90 0x7f835c109390 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f834c009900 tx=0x7f834c02a410 comp rx=0 tx=0).stop 2024-08-20T05:06:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.447+0000 7f8362000640 1 -- 172.21.15.37:0/3269822975 shutdown_connections 2024-08-20T05:06:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.447+0000 7f8362000640 1 --2- 172.21.15.37:0/3269822975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835c10a780 0x7f835c111100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.447+0000 7f8362000640 1 --2- 172.21.15.37:0/3269822975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f835c109dc0 0x7f835c10a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.447+0000 7f8362000640 1 --2- 172.21.15.37:0/3269822975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c108f90 0x7f835c109390 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.447+0000 7f8362000640 1 -- 172.21.15.37:0/3269822975 >> 172.21.15.37:0/3269822975 conn(0x7f835c078030 msgr2=0x7f835c07a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:58.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.447+0000 7f8362000640 1 -- 172.21.15.37:0/3269822975 shutdown_connections 2024-08-20T05:06:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.447+0000 7f8362000640 1 -- 172.21.15.37:0/3269822975 wait complete. 2024-08-20T05:06:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.448+0000 7f8362000640 1 Processor -- start 2024-08-20T05:06:58.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.449+0000 7f8362000640 1 -- start start 2024-08-20T05:06:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.449+0000 7f8362000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c109dc0 0x7f835c19f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.449+0000 7f8362000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835c10a780 0x7f835c19f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.449+0000 7f8362000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f835c1a0500 0x7f835c1a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.449+0000 7f8362000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f835c114940 con 0x7f835c109dc0 2024-08-20T05:06:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.449+0000 7f8362000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f835c1147c0 con 0x7f835c10a780 2024-08-20T05:06:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.449+0000 7f8362000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f835c114ac0 con 0x7f835c1a0500 2024-08-20T05:06:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.449+0000 7f835aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835c10a780 0x7f835c19f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.449+0000 7f835b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c109dc0 0x7f835c19f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.449+0000 7f835aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835c10a780 0x7f835c19f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43974/0 (socket says 172.21.15.37:43974) 2024-08-20T05:06:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.449+0000 7f835aa00640 1 -- 172.21.15.37:0/2649862823 learned_addr learned my addr 172.21.15.37:0/2649862823 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.449+0000 7f835be00640 1 --2- 172.21.15.37:0/2649862823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f835c1a0500 0x7f835c1a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.450+0000 7f835be00640 1 -- 172.21.15.37:0/2649862823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835c10a780 msgr2=0x7f835c19f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.450+0000 7f835be00640 1 --2- 172.21.15.37:0/2649862823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835c10a780 0x7f835c19f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.450+0000 7f835be00640 1 -- 172.21.15.37:0/2649862823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c109dc0 msgr2=0x7f835c19f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.450+0000 7f835be00640 1 --2- 172.21.15.37:0/2649862823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c109dc0 0x7f835c19f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.450+0000 7f835be00640 1 -- 172.21.15.37:0/2649862823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835c1a11b0 con 0x7f835c1a0500 2024-08-20T05:06:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.451+0000 7f835be00640 1 --2- 172.21.15.37:0/2649862823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f835c1a0500 0x7f835c1a09b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8354005fd0 tx=0x7f835400ee60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.451+0000 7f8353e00640 1 -- 172.21.15.37:0/2649862823 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f835400cd80 con 0x7f835c1a0500 2024-08-20T05:06:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.451+0000 7f8353e00640 1 -- 172.21.15.37:0/2649862823 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8354005020 con 0x7f835c1a0500 2024-08-20T05:06:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.451+0000 7f8353e00640 1 -- 172.21.15.37:0/2649862823 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8354010690 con 0x7f835c1a0500 2024-08-20T05:06:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.452+0000 7f8362000640 1 -- 172.21.15.37:0/2649862823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835c1a75a0 con 0x7f835c1a0500 2024-08-20T05:06:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.453+0000 7f8362000640 1 -- 172.21.15.37:0/2649862823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f835c1a7a10 con 0x7f835c1a0500 2024-08-20T05:06:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.459+0000 7f8365041740 1 Processor -- start 2024-08-20T05:06:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.461+0000 7f8353e00640 1 -- 172.21.15.37:0/2649862823 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f83540054d0 con 0x7f835c1a0500 2024-08-20T05:06:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.462+0000 7f8365041740 1 -- start start 2024-08-20T05:06:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.462+0000 7f8365041740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed54610 0x55a06ed56a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.462+0000 7f8365041740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed56f40 0x55a06ed59330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.462+0000 7f8365041740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed59980 0x55a06ed5be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.462+0000 7f8365041740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a06ecc7210 con 0x55a06ed56f40 2024-08-20T05:06:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.462+0000 7f8365041740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a06ecb6710 con 0x55a06ed59980 2024-08-20T05:06:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.462+0000 7f8365041740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a06ecba750 con 0x55a06ed54610 2024-08-20T05:06:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.463+0000 7f835aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed54610 0x55a06ed56a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.463+0000 7f835aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed54610 0x55a06ed56a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34578/0 (socket says 172.21.15.37:34578) 2024-08-20T05:06:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.463+0000 7f835aa00640 1 -- 172.21.15.37:0/1125821150 learned_addr learned my addr 172.21.15.37:0/1125821150 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.463+0000 7f835aa00640 1 --2- 172.21.15.37:0/1125821150 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed59980 0x55a06ed5be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.463+0000 7f835b400640 1 --2- 172.21.15.37:0/1125821150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed56f40 0x55a06ed59330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.464+0000 7f8353e00640 1 --2- 172.21.15.37:0/2649862823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83400b3d60 0x7f83400b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.464+0000 7f8353e00640 1 -- 172.21.15.37:0/2649862823 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f83540e47d0 con 0x7f835c1a0500 2024-08-20T05:06:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.464+0000 7f835aa00640 1 -- 172.21.15.37:0/1125821150 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed59980 msgr2=0x55a06ed5be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.464+0000 7f835aa00640 1 --2- 172.21.15.37:0/1125821150 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed59980 0x55a06ed5be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.464+0000 7f835aa00640 1 -- 172.21.15.37:0/1125821150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed56f40 msgr2=0x55a06ed59330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.464+0000 7f835aa00640 1 --2- 172.21.15.37:0/1125821150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed56f40 0x55a06ed59330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.464+0000 7f835be00640 1 --2- 172.21.15.37:0/2649862823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83400b3d60 0x7f83400b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.464+0000 7f835aa00640 1 -- 172.21.15.37:0/1125821150 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a06ec82de0 con 0x55a06ed54610 2024-08-20T05:06:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.464+0000 7f835aa00640 1 --2- 172.21.15.37:0/1125821150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed54610 0x55a06ed56a00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8348011980 tx=0x7f8348004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59b6087194f1e7ed server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.465+0000 7f8347e00640 1 -- 172.21.15.37:0/1125821150 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834800f7c0 con 0x55a06ed54610 2024-08-20T05:06:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.465+0000 7f8347e00640 1 -- 172.21.15.37:0/1125821150 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f834800fe10 con 0x55a06ed54610 2024-08-20T05:06:58.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.465+0000 7f8347e00640 1 -- 172.21.15.37:0/1125821150 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834801fd10 con 0x55a06ed54610 2024-08-20T05:06:58.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.466+0000 7f8365041740 1 -- 172.21.15.37:0/1125821150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed54610 msgr2=0x55a06ed56a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:58.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.466+0000 7f8365041740 1 --2- 172.21.15.37:0/1125821150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed54610 0x55a06ed56a00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8348011980 tx=0x7f8348004730 comp rx=0 tx=0).stop 2024-08-20T05:06:58.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.466+0000 7f835be00640 1 --2- 172.21.15.37:0/2649862823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83400b3d60 0x7f83400b6220 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8354005820 tx=0x7f8354005870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:58.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.466+0000 7f8365041740 1 -- 172.21.15.37:0/1125821150 shutdown_connections 2024-08-20T05:06:58.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.466+0000 7f8365041740 1 --2- 172.21.15.37:0/1125821150 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed59980 0x55a06ed5be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.466+0000 7f8365041740 1 --2- 172.21.15.37:0/1125821150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed56f40 0x55a06ed59330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.466+0000 7f8365041740 1 --2- 172.21.15.37:0/1125821150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed54610 0x55a06ed56a00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.466+0000 7f8365041740 1 -- 172.21.15.37:0/1125821150 >> 172.21.15.37:0/1125821150 conn(0x55a06ed4f760 msgr2=0x55a06ed504f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:58.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.466+0000 7f8365041740 1 -- 172.21.15.37:0/1125821150 shutdown_connections 2024-08-20T05:06:58.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.466+0000 7f8365041740 1 -- 172.21.15.37:0/1125821150 wait complete. 2024-08-20T05:06:58.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.467+0000 7f8365041740 1 -- start start 2024-08-20T05:06:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.467+0000 7f8365041740 1 Processor -- start 2024-08-20T05:06:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.468+0000 7f8365041740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed54610 0x55a06ed6edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.468+0000 7f8365041740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed56f40 0x55a06ed6f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.468+0000 7f8365041740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed59980 0x55a06ed70020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.468+0000 7f8365041740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a06ebefab0 con 0x55a06ed59980 2024-08-20T05:06:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.468+0000 7f8365041740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a06ec5d140 con 0x55a06ed56f40 2024-08-20T05:06:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.468+0000 7f8365041740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a06ed6d970 con 0x55a06ed54610 2024-08-20T05:06:58.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.468+0000 7f8365041740 10 client.0 _ll_register_callbacks cb 0x55a06ec705d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:58.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.469+0000 7f835b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed56f40 0x55a06ed6f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:58.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.469+0000 7f835b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed56f40 0x55a06ed6f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43984/0 (socket says 172.21.15.37:43984) 2024-08-20T05:06:58.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.469+0000 7f835b400640 1 -- 172.21.15.37:0/2579682616 learned_addr learned my addr 172.21.15.37:0/2579682616 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:58.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.469+0000 7f835aa00640 1 --2- 172.21.15.37:0/2579682616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed59980 0x55a06ed70020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:58.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.469+0000 7f835b400640 1 -- 172.21.15.37:0/2579682616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed54610 msgr2=0x55a06ed6edb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:06:58.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.470+0000 7f835aa00640 1 --2- 172.21.15.37:0/2579682616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed54610 0x55a06ed6edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:58.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.470+0000 7f835b400640 1 --2- 172.21.15.37:0/2579682616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed54610 0x55a06ed6edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.470+0000 7f835b400640 1 -- 172.21.15.37:0/2579682616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed59980 msgr2=0x55a06ed70020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:58.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.470+0000 7f835b400640 1 --2- 172.21.15.37:0/2579682616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed59980 0x55a06ed70020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.470+0000 7f835b400640 1 -- 172.21.15.37:0/2579682616 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a06ec5e170 con 0x55a06ed56f40 2024-08-20T05:06:58.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.470+0000 7f835aa00640 1 --2- 172.21.15.37:0/2579682616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed54610 0x55a06ed6edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:06:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.471+0000 7f835b400640 1 --2- 172.21.15.37:0/2579682616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed56f40 0x55a06ed6f450 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f834c009230 tx=0x7f834c004510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=134bf02e6fdb8e63 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.471+0000 7f8344c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:06:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.471+0000 7f8344c00640 1 -- 172.21.15.37:0/2579682616 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c035070 con 0x55a06ed56f40 2024-08-20T05:06:58.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.472+0000 7f8344c00640 1 -- 172.21.15.37:0/2579682616 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f834c003a00 con 0x55a06ed56f40 2024-08-20T05:06:58.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.472+0000 7f8365041740 1 -- 172.21.15.37:0/2579682616 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f834800fe10 con 0x55a06ed56f40 2024-08-20T05:06:58.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.472+0000 7f8344c00640 1 -- 172.21.15.37:0/2579682616 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f834c003c20 con 0x55a06ed56f40 2024-08-20T05:06:58.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.473+0000 7f8365041740 10 client.26720 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:58.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.473+0000 7f8365041740 1 -- 172.21.15.37:0/2579682616 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a06ea19790 con 0x55a06ed56f40 2024-08-20T05:06:58.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.473+0000 7f8344c00640 1 -- 172.21.15.37:0/2579682616 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f834800fe10 con 0x55a06ed56f40 2024-08-20T05:06:58.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.473+0000 7f8344c00640 1 -- 172.21.15.37:0/2579682616 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f834c03c440 con 0x55a06ed56f40 2024-08-20T05:06:58.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.473+0000 7f8365041740 10 client.26720 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.473+0000 7f8365041740 10 client.26720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.473+0000 7f8365041740 20 client.26720 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.473+0000 7f8365041740 1 --2- 172.21.15.37:0/2579682616 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a06ed7aa30 0x55a06ed7ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.473+0000 7f8365041740 4 client.26720 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:06:58.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.473+0000 7f8365041740 1 -- 172.21.15.37:0/2579682616 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a06ecc9160 con 0x55a06ed7aa30 2024-08-20T05:06:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.475+0000 7f835aa00640 1 --2- 172.21.15.37:0/2579682616 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a06ed7aa30 0x55a06ed7ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.479+0000 7f835aa00640 1 --2- 172.21.15.37:0/2579682616 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a06ed7aa30 0x55a06ed7ce20 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1c294ed9477ec64 server_cookie=a6101b3f3e9bd4bd in_seq=0 out_seq=0 2024-08-20T05:06:58.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.479+0000 7f8344c00640 10 client.26720 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.483+0000 7f8344c00640 1 -- 172.21.15.37:0/2579682616 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a06ecc9160 con 0x55a06ed7aa30 2024-08-20T05:06:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.483+0000 7f8344c00640 10 client.26720 handle_command_reply: tid=0 2024-08-20T05:06:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.484+0000 7f8365041740 1 client.26720 shutdown 2024-08-20T05:06:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.484+0000 7f8365041740 1 -- 172.21.15.37:0/2579682616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed56f40 msgr2=0x55a06ed6f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.484+0000 7f8365041740 1 --2- 172.21.15.37:0/2579682616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed56f40 0x55a06ed6f450 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f834c009230 tx=0x7f834c004510 comp rx=0 tx=0).stop 2024-08-20T05:06:58.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.484+0000 7f8365041740 1 -- 172.21.15.37:0/2579682616 shutdown_connections 2024-08-20T05:06:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.484+0000 7f8365041740 1 --2- 172.21.15.37:0/2579682616 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a06ed7aa30 0x55a06ed7ce20 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.484+0000 7f8365041740 1 --2- 172.21.15.37:0/2579682616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed59980 0x55a06ed70020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.484+0000 7f8365041740 1 --2- 172.21.15.37:0/2579682616 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed56f40 0x55a06ed6f450 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.484+0000 7f8365041740 1 --2- 172.21.15.37:0/2579682616 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed54610 0x55a06ed6edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.484+0000 7f8365041740 1 -- 172.21.15.37:0/2579682616 >> 172.21.15.37:0/2579682616 conn(0x55a06ed4f760 msgr2=0x55a06ed4e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.484+0000 7f8344c00640 0 client.26720 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:58.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.485+0000 7f8365041740 1 -- 172.21.15.37:0/2579682616 shutdown_connections 2024-08-20T05:06:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.486+0000 7f8365041740 1 -- 172.21.15.37:0/2579682616 wait complete. 2024-08-20T05:06:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.486+0000 7f8365041740 20 client.26720 trim_cache size 0 max 16384 2024-08-20T05:06:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.523+0000 7f8365041740 1 Processor -- start 2024-08-20T05:06:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.524+0000 7f8365041740 1 -- start start 2024-08-20T05:06:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.525+0000 7f8365041740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed54610 0x55a06ed506d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.525+0000 7f8365041740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed56f40 0x55a06ed4df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.525+0000 7f8365041740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed59980 0x55a06ed4e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.525+0000 7f8365041740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f835c1a9780 con 0x55a06ed54610 2024-08-20T05:06:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.525+0000 7f8365041740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f835c1ab2c0 con 0x55a06ed59980 2024-08-20T05:06:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.525+0000 7f8365041740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f835c1a9e50 con 0x55a06ed56f40 2024-08-20T05:06:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.525+0000 7f835b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed56f40 0x55a06ed4df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.526+0000 7f835b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed56f40 0x55a06ed4df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34592/0 (socket says 172.21.15.37:34592) 2024-08-20T05:06:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.526+0000 7f835b400640 1 -- 172.21.15.37:0/1910243281 learned_addr learned my addr 172.21.15.37:0/1910243281 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:58.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.526+0000 7f835aa00640 1 --2- 172.21.15.37:0/1910243281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed59980 0x55a06ed4e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.527+0000 7f835aa00640 1 -- 172.21.15.37:0/1910243281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed56f40 msgr2=0x55a06ed4df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.527+0000 7f835aa00640 1 --2- 172.21.15.37:0/1910243281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed56f40 0x55a06ed4df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.527+0000 7f835aa00640 1 -- 172.21.15.37:0/1910243281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed54610 msgr2=0x55a06ed506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.527+0000 7f835aa00640 1 --2- 172.21.15.37:0/1910243281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed54610 0x55a06ed506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.527+0000 7f835aa00640 1 -- 172.21.15.37:0/1910243281 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a06ea92620 con 0x55a06ed59980 2024-08-20T05:06:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.527+0000 7f835b400640 1 --2- 172.21.15.37:0/1910243281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed56f40 0x55a06ed4df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:06:58.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.527+0000 7f835aa00640 1 --2- 172.21.15.37:0/1910243281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed59980 0x55a06ed4e480 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55a06ed7d690 tx=0x7f834801f960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40f6cf5413713384 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:58.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.532+0000 7f8347400640 1 -- 172.21.15.37:0/1910243281 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8348009c10 con 0x55a06ed59980 2024-08-20T05:06:58.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.532+0000 7f8347400640 1 -- 172.21.15.37:0/1910243281 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f834801f4e0 con 0x55a06ed59980 2024-08-20T05:06:58.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.532+0000 7f8347400640 1 -- 172.21.15.37:0/1910243281 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83480043d0 con 0x55a06ed59980 2024-08-20T05:06:58.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.533+0000 7f8365041740 1 -- 172.21.15.37:0/1910243281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed59980 msgr2=0x55a06ed4e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:58.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.533+0000 7f8365041740 1 --2- 172.21.15.37:0/1910243281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed59980 0x55a06ed4e480 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x55a06ed7d690 tx=0x7f834801f960 comp rx=0 tx=0).stop 2024-08-20T05:06:58.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.533+0000 7f8365041740 1 -- 172.21.15.37:0/1910243281 shutdown_connections 2024-08-20T05:06:58.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.533+0000 7f8365041740 1 --2- 172.21.15.37:0/1910243281 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed59980 0x55a06ed4e480 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.533+0000 7f8365041740 1 --2- 172.21.15.37:0/1910243281 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed56f40 0x55a06ed4df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.533+0000 7f8365041740 1 --2- 172.21.15.37:0/1910243281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed54610 0x55a06ed506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.533+0000 7f8365041740 1 -- 172.21.15.37:0/1910243281 >> 172.21.15.37:0/1910243281 conn(0x55a06ed4f760 msgr2=0x55a06ed4ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:58.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.533+0000 7f8365041740 1 -- 172.21.15.37:0/1910243281 shutdown_connections 2024-08-20T05:06:58.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.534+0000 7f8365041740 1 -- 172.21.15.37:0/1910243281 wait complete. 2024-08-20T05:06:58.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.537+0000 7f8365041740 1 -- start start 2024-08-20T05:06:58.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.537+0000 7f8365041740 1 Processor -- start 2024-08-20T05:06:58.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.538+0000 7f8365041740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed54610 0x55a06ed74160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.538+0000 7f8365041740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed56f40 0x55a06ed74800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.538+0000 7f8365041740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed59980 0x55a06ed753d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.538+0000 7f8365041740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f835c1aabf0 con 0x55a06ed54610 2024-08-20T05:06:58.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.538+0000 7f8365041740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f835c1aa520 con 0x55a06ed56f40 2024-08-20T05:06:58.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.538+0000 7f8365041740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f835c074ae0 con 0x55a06ed59980 2024-08-20T05:06:58.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.538+0000 7f8365041740 10 client.0 _ll_register_callbacks cb 0x7f834c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:06:58.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.540+0000 7f835b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed56f40 0x55a06ed74800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:58.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.540+0000 7f835b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed56f40 0x55a06ed74800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44002/0 (socket says 172.21.15.37:44002) 2024-08-20T05:06:58.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.540+0000 7f835b400640 1 -- 172.21.15.37:0/3302816134 learned_addr learned my addr 172.21.15.37:0/3302816134 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:06:58.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.540+0000 7f835aa00640 1 --2- 172.21.15.37:0/3302816134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed59980 0x55a06ed753d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:58.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.541+0000 7f835b400640 1 -- 172.21.15.37:0/3302816134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed59980 msgr2=0x55a06ed753d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:58.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.541+0000 7f835b400640 1 --2- 172.21.15.37:0/3302816134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed59980 0x55a06ed753d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.541+0000 7f835b400640 1 -- 172.21.15.37:0/3302816134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed54610 msgr2=0x55a06ed74160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:06:58.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.541+0000 7f835b400640 1 --2- 172.21.15.37:0/3302816134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed54610 0x55a06ed74160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.541+0000 7f835b400640 1 -- 172.21.15.37:0/3302816134 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a06ed75c00 con 0x55a06ed56f40 2024-08-20T05:06:58.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.542+0000 7f835b400640 1 --2- 172.21.15.37:0/3302816134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed56f40 0x55a06ed74800 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f834c03c9d0 tx=0x7f834c03c670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11b12bf5c6b5eae9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:06:58.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.542+0000 7f8344c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:06:58.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.543+0000 7f8344c00640 1 -- 172.21.15.37:0/3302816134 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c035040 con 0x55a06ed56f40 2024-08-20T05:06:58.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.544+0000 7f8344c00640 1 -- 172.21.15.37:0/3302816134 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f834c003a00 con 0x55a06ed56f40 2024-08-20T05:06:58.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.544+0000 7f8365041740 1 -- 172.21.15.37:0/3302816134 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f834801f4e0 con 0x55a06ed56f40 2024-08-20T05:06:58.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.546+0000 7f8344c00640 1 -- 172.21.15.37:0/3302816134 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f834c05d050 con 0x55a06ed56f40 2024-08-20T05:06:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.546+0000 7f8365041740 10 client.26726 fetch_fsmap learned FSMap version 36 2024-08-20T05:06:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.546+0000 7f8365041740 1 -- 172.21.15.37:0/3302816134 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a06ed77010 con 0x55a06ed56f40 2024-08-20T05:06:58.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.547+0000 7f8344c00640 1 -- 172.21.15.37:0/3302816134 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f834801f4e0 con 0x55a06ed56f40 2024-08-20T05:06:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.547+0000 7f8344c00640 1 -- 172.21.15.37:0/3302816134 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f834c031990 con 0x55a06ed56f40 2024-08-20T05:06:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.547+0000 7f8365041740 10 client.26726 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:06:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.547+0000 7f8365041740 10 client.26726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:06:58.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.547+0000 7f8365041740 20 client.26726 populate_metadata read hostname 'smithi037' 2024-08-20T05:06:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.547+0000 7f8365041740 1 --2- 172.21.15.37:0/3302816134 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a06ede5cc0 0x55a06ede80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:06:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.547+0000 7f8365041740 4 client.26726 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:06:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.547+0000 7f8365041740 1 -- 172.21.15.37:0/3302816134 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a06ecc4c00 con 0x55a06ede5cc0 2024-08-20T05:06:58.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.549+0000 7f835aa00640 1 --2- 172.21.15.37:0/3302816134 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a06ede5cc0 0x55a06ede80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:06:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.550+0000 7f835aa00640 1 --2- 172.21.15.37:0/3302816134 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a06ede5cc0 0x55a06ede80e0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c13dbfaa7501a8b server_cookie=30577f82bf8b99c1 in_seq=0 out_seq=0 2024-08-20T05:06:58.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.550+0000 7f8344c00640 10 client.26726 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.587+0000 7f8344c00640 1 -- 172.21.15.37:0/3302816134 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a06ecc4c00 con 0x55a06ede5cc0 2024-08-20T05:06:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.587+0000 7f8344c00640 10 client.26726 handle_command_reply: tid=0 2024-08-20T05:06:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.587+0000 7f8365041740 1 client.26726 shutdown 2024-08-20T05:06:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.587+0000 7f8365041740 1 -- 172.21.15.37:0/3302816134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed56f40 msgr2=0x55a06ed74800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.587+0000 7f8365041740 1 --2- 172.21.15.37:0/3302816134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed56f40 0x55a06ed74800 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f834c03c9d0 tx=0x7f834c03c670 comp rx=0 tx=0).stop 2024-08-20T05:06:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.587+0000 7f8365041740 1 -- 172.21.15.37:0/3302816134 shutdown_connections 2024-08-20T05:06:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.588+0000 7f8365041740 1 --2- 172.21.15.37:0/3302816134 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a06ede5cc0 0x55a06ede80e0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.588+0000 7f8365041740 1 --2- 172.21.15.37:0/3302816134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a06ed59980 0x55a06ed753d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.588+0000 7f8365041740 1 --2- 172.21.15.37:0/3302816134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a06ed56f40 0x55a06ed74800 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.588+0000 7f8365041740 1 --2- 172.21.15.37:0/3302816134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a06ed54610 0x55a06ed74160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.588+0000 7f8344c00640 0 client.26726 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:06:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.588+0000 7f8365041740 1 -- 172.21.15.37:0/3302816134 >> 172.21.15.37:0/3302816134 conn(0x55a06ed4f760 msgr2=0x55a06ed4e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.589+0000 7f8365041740 1 -- 172.21.15.37:0/3302816134 shutdown_connections 2024-08-20T05:06:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.589+0000 7f8365041740 1 -- 172.21.15.37:0/3302816134 wait complete. 2024-08-20T05:06:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.590+0000 7f8365041740 20 client.26726 trim_cache size 0 max 16384 2024-08-20T05:06:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:06:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:06:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:06:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:06:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.591+0000 7f8362000640 1 -- 172.21.15.37:0/2649862823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83400b3d60 msgr2=0x7f83400b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.592+0000 7f8362000640 1 --2- 172.21.15.37:0/2649862823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83400b3d60 0x7f83400b6220 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8354005820 tx=0x7f8354005870 comp rx=0 tx=0).stop 2024-08-20T05:06:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.592+0000 7f8362000640 1 -- 172.21.15.37:0/2649862823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f835c1a0500 msgr2=0x7f835c1a09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:06:58.594 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.592+0000 7f8362000640 1 --2- 172.21.15.37:0/2649862823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f835c1a0500 0x7f835c1a09b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8354005fd0 tx=0x7f835400ee60 comp rx=0 tx=0).stop 2024-08-20T05:06:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.592+0000 7f8362000640 1 -- 172.21.15.37:0/2649862823 shutdown_connections 2024-08-20T05:06:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.592+0000 7f8362000640 1 --2- 172.21.15.37:0/2649862823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83400b3d60 0x7f83400b6220 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.592+0000 7f8362000640 1 --2- 172.21.15.37:0/2649862823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f835c1a0500 0x7f835c1a09b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.592+0000 7f8362000640 1 --2- 172.21.15.37:0/2649862823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f835c10a780 0x7f835c19f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.592+0000 7f8362000640 1 --2- 172.21.15.37:0/2649862823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c109dc0 0x7f835c19f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:06:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.592+0000 7f8362000640 1 -- 172.21.15.37:0/2649862823 >> 172.21.15.37:0/2649862823 conn(0x7f835c078030 msgr2=0x7f835c10d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:06:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.593+0000 7f8362000640 1 -- 172.21.15.37:0/2649862823 shutdown_connections 2024-08-20T05:06:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:06:58.593+0000 7f8362000640 1 -- 172.21.15.37:0/2649862823 wait complete. 2024-08-20T05:06:59.113 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:06:59.789 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:07:00.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:06:59 smithi135 ceph-mon[22342]: pgmap v543: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 5.6 MiB/s wr, 589 op/s 2024-08-20T05:07:00.191 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:06:59 smithi037 ceph-mon[17265]: pgmap v543: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 5.6 MiB/s wr, 589 op/s 2024-08-20T05:07:00.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:06:59 smithi130 ceph-mon[22007]: pgmap v543: 129 pgs: 129 active+clean; 1.1 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 5.6 MiB/s wr, 589 op/s 2024-08-20T05:07:00.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.630+0000 7f487fc00640 1 -- 172.21.15.37:0/138458818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f487810f0a0 msgr2=0x7f4878111490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:00.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.630+0000 7f487fc00640 1 --2- 172.21.15.37:0/138458818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f487810f0a0 0x7f4878111490 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4870009ca0 tx=0x7f487002a8d0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.631+0000 7f487fc00640 1 -- 172.21.15.37:0/138458818 shutdown_connections 2024-08-20T05:07:00.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.631+0000 7f487fc00640 1 --2- 172.21.15.37:0/138458818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f487810f0a0 0x7f4878111490 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.631+0000 7f487fc00640 1 --2- 172.21.15.37:0/138458818 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4878075b30 0x7f487810eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.631+0000 7f487fc00640 1 --2- 172.21.15.37:0/138458818 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4878075210 0x7f48780755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.631+0000 7f487fc00640 1 -- 172.21.15.37:0/138458818 >> 172.21.15.37:0/138458818 conn(0x7f48780fe500 msgr2=0x7f4878100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:00.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.632+0000 7f487fc00640 1 -- 172.21.15.37:0/138458818 shutdown_connections 2024-08-20T05:07:00.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.632+0000 7f487fc00640 1 -- 172.21.15.37:0/138458818 wait complete. 2024-08-20T05:07:00.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.634+0000 7f487fc00640 1 Processor -- start 2024-08-20T05:07:00.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.635+0000 7f487fc00640 1 -- start start 2024-08-20T05:07:00.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.635+0000 7f487fc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4878075210 0x7f4878104670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.635+0000 7f487fc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4878075b30 0x7f4878104bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.635+0000 7f487fc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f487810f0a0 0x7f4878109f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.636+0000 7f487fc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4878103140 con 0x7f487810f0a0 2024-08-20T05:07:00.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.636+0000 7f487fc00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4878102fc0 con 0x7f4878075b30 2024-08-20T05:07:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.636+0000 7f487fc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f48781032c0 con 0x7f4878075210 2024-08-20T05:07:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.636+0000 7f4877e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4878075b30 0x7f4878104bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.636+0000 7f4877e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4878075b30 0x7f4878104bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44004/0 (socket says 172.21.15.37:44004) 2024-08-20T05:07:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.636+0000 7f4877e00640 1 -- 172.21.15.37:0/2163819255 learned_addr learned my addr 172.21.15.37:0/2163819255 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.636+0000 7f487dc00640 1 --2- 172.21.15.37:0/2163819255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f487810f0a0 0x7f4878109f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.636+0000 7f4877e00640 1 -- 172.21.15.37:0/2163819255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4878075210 msgr2=0x7f4878104670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T05:07:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.637+0000 7f4877e00640 1 --2- 172.21.15.37:0/2163819255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4878075210 0x7f4878104670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.637+0000 7f4877e00640 1 -- 172.21.15.37:0/2163819255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f487810f0a0 msgr2=0x7f4878109f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.637+0000 7f4877e00640 1 --2- 172.21.15.37:0/2163819255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f487810f0a0 0x7f4878109f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.637+0000 7f4877e00640 1 -- 172.21.15.37:0/2163819255 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487810a6d0 con 0x7f4878075b30 2024-08-20T05:07:00.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.638+0000 7f4877e00640 1 --2- 172.21.15.37:0/2163819255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4878075b30 0x7f4878104bb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f486400b450 tx=0x7f486400b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:00.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.639+0000 7f4875600640 1 -- 172.21.15.37:0/2163819255 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864015020 con 0x7f4878075b30 2024-08-20T05:07:00.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.639+0000 7f4875600640 1 -- 172.21.15.37:0/2163819255 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4864011d40 con 0x7f4878075b30 2024-08-20T05:07:00.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.639+0000 7f4875600640 1 -- 172.21.15.37:0/2163819255 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486400f340 con 0x7f4878075b30 2024-08-20T05:07:00.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.640+0000 7f487fc00640 1 -- 172.21.15.37:0/2163819255 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f487810a9c0 con 0x7f4878075b30 2024-08-20T05:07:00.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.640+0000 7f487fc00640 1 -- 172.21.15.37:0/2163819255 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f487810d0d0 con 0x7f4878075b30 2024-08-20T05:07:00.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.649+0000 7f48826a6740 1 Processor -- start 2024-08-20T05:07:00.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.650+0000 7f4875600640 1 -- 172.21.15.37:0/2163819255 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4864018020 con 0x7f4878075b30 2024-08-20T05:07:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.651+0000 7f48826a6740 1 -- start start 2024-08-20T05:07:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.651+0000 7f48826a6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a10900 0x5642a6a10ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.651+0000 7f48826a6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a11220 0x5642a6a1cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.651+0000 7f48826a6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a1d1b0 0x5642a6a1f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.651+0000 7f48826a6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5642a6986a60 con 0x5642a6a10900 2024-08-20T05:07:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.651+0000 7f48826a6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5642a6975f60 con 0x5642a6a1d1b0 2024-08-20T05:07:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.651+0000 7f48826a6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5642a6979fa0 con 0x5642a6a11220 2024-08-20T05:07:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.652+0000 7f487d200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a11220 0x5642a6a1cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.652+0000 7f487d200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a11220 0x5642a6a1cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34638/0 (socket says 172.21.15.37:34638) 2024-08-20T05:07:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.652+0000 7f487d200640 1 -- 172.21.15.37:0/59457552 learned_addr learned my addr 172.21.15.37:0/59457552 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:00.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.652+0000 7f4877e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a1d1b0 0x5642a6a1f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:00.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.653+0000 7f487dc00640 1 --2- 172.21.15.37:0/59457552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a10900 0x5642a6a10ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:00.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.654+0000 7f487d200640 1 -- 172.21.15.37:0/59457552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a1d1b0 msgr2=0x5642a6a1f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:00.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.654+0000 7f487d200640 1 --2- 172.21.15.37:0/59457552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a1d1b0 0x5642a6a1f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.655+0000 7f487d200640 1 -- 172.21.15.37:0/59457552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a10900 msgr2=0x5642a6a10ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:00.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.655+0000 7f487d200640 1 --2- 172.21.15.37:0/59457552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a10900 0x5642a6a10ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.655+0000 7f487d200640 1 -- 172.21.15.37:0/59457552 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642a691c3e0 con 0x5642a6a11220 2024-08-20T05:07:00.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.655+0000 7f487dc00640 1 --2- 172.21.15.37:0/59457552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a10900 0x5642a6a10ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:07:00.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.656+0000 7f487d200640 1 --2- 172.21.15.37:0/59457552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a11220 0x5642a6a1cc70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f486c00a980 tx=0x7f486c00ae40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f02cafbe4b00f7e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:00.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.657+0000 7f486a000640 1 -- 172.21.15.37:0/59457552 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c00cd80 con 0x5642a6a11220 2024-08-20T05:07:00.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.657+0000 7f486a000640 1 -- 172.21.15.37:0/59457552 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f486c00f900 con 0x5642a6a11220 2024-08-20T05:07:00.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.657+0000 7f486a000640 1 -- 172.21.15.37:0/59457552 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c018900 con 0x5642a6a11220 2024-08-20T05:07:00.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.657+0000 7f4875600640 1 --2- 172.21.15.37:0/2163819255 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f48600b3cd0 0x7f48600b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.658+0000 7f48826a6740 1 -- 172.21.15.37:0/59457552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a11220 msgr2=0x5642a6a1cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:00.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.658+0000 7f48826a6740 1 --2- 172.21.15.37:0/59457552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a11220 0x5642a6a1cc70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f486c00a980 tx=0x7f486c00ae40 comp rx=0 tx=0).stop 2024-08-20T05:07:00.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.658+0000 7f487dc00640 1 --2- 172.21.15.37:0/2163819255 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f48600b3cd0 0x7f48600b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:00.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.658+0000 7f48826a6740 1 -- 172.21.15.37:0/59457552 shutdown_connections 2024-08-20T05:07:00.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.658+0000 7f48826a6740 1 --2- 172.21.15.37:0/59457552 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a1d1b0 0x5642a6a1f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.658+0000 7f48826a6740 1 --2- 172.21.15.37:0/59457552 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a11220 0x5642a6a1cc70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.658+0000 7f48826a6740 1 --2- 172.21.15.37:0/59457552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a10900 0x5642a6a10ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.658+0000 7f48826a6740 1 -- 172.21.15.37:0/59457552 >> 172.21.15.37:0/59457552 conn(0x5642a6a0e730 msgr2=0x5642a6a0f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:00.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.659+0000 7f48826a6740 1 -- 172.21.15.37:0/59457552 shutdown_connections 2024-08-20T05:07:00.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.659+0000 7f4875600640 1 -- 172.21.15.37:0/2163819255 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f48640e38f0 con 0x7f4878075b30 2024-08-20T05:07:00.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.660+0000 7f48826a6740 1 -- 172.21.15.37:0/59457552 wait complete. 2024-08-20T05:07:00.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.661+0000 7f48826a6740 1 -- start start 2024-08-20T05:07:00.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.661+0000 7f487dc00640 1 --2- 172.21.15.37:0/2163819255 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f48600b3cd0 0x7f48600b6190 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4870006010 tx=0x7f4870009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:00.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.661+0000 7f48826a6740 1 Processor -- start 2024-08-20T05:07:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.663+0000 7f48826a6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a10900 0x5642a6a1ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.663+0000 7f48826a6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 0x5642a6a19e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.663+0000 7f48826a6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a1d1b0 0x5642a6a1a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.663+0000 7f48826a6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5642a67d8700 con 0x5642a6a10900 2024-08-20T05:07:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.663+0000 7f48826a6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5642a6911250 con 0x5642a6a11220 2024-08-20T05:07:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.663+0000 7f48826a6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5642a6a1fe30 con 0x5642a6a1d1b0 2024-08-20T05:07:00.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.663+0000 7f48826a6740 10 client.0 _ll_register_callbacks cb 0x5642a6970180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:00.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.663+0000 7f487dc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a1d1b0 0x5642a6a1a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:00.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.663+0000 7f487dc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a1d1b0 0x5642a6a1a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34648/0 (socket says 172.21.15.37:34648) 2024-08-20T05:07:00.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.663+0000 7f487dc00640 1 -- 172.21.15.37:0/2581825131 learned_addr learned my addr 172.21.15.37:0/2581825131 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:00.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.663+0000 7f4877e00640 1 --2- 172.21.15.37:0/2581825131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 0x5642a6a19e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:00.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.664+0000 7f487d200640 1 --2- 172.21.15.37:0/2581825131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a10900 0x5642a6a1ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:00.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.664+0000 7f487dc00640 1 -- 172.21.15.37:0/2581825131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 msgr2=0x5642a6a19e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:00.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.664+0000 7f487dc00640 1 --2- 172.21.15.37:0/2581825131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 0x5642a6a19e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.665+0000 7f487dc00640 1 -- 172.21.15.37:0/2581825131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a10900 msgr2=0x5642a6a1ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:00.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.665+0000 7f487dc00640 1 --2- 172.21.15.37:0/2581825131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a10900 0x5642a6a1ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.665+0000 7f487dc00640 1 -- 172.21.15.37:0/2581825131 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642a66d5650 con 0x5642a6a1d1b0 2024-08-20T05:07:00.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.665+0000 7f487d200640 1 --2- 172.21.15.37:0/2581825131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a10900 0x5642a6a1ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:00.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.665+0000 7f487dc00640 1 --2- 172.21.15.37:0/2581825131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a1d1b0 0x5642a6a1a420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f48780761f0 tx=0x7f487002a8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbd06feb33894e8a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:00.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.665+0000 7f485ea00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:07:00.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.666+0000 7f485ea00640 1 -- 172.21.15.37:0/2581825131 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487002f620 con 0x5642a6a1d1b0 2024-08-20T05:07:00.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.666+0000 7f485ea00640 1 -- 172.21.15.37:0/2581825131 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f487002f7c0 con 0x5642a6a1d1b0 2024-08-20T05:07:00.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.667+0000 7f48826a6740 1 -- 172.21.15.37:0/2581825131 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f486c00f900 con 0x5642a6a1d1b0 2024-08-20T05:07:00.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.667+0000 7f485ea00640 1 -- 172.21.15.37:0/2581825131 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f487002f9c0 con 0x5642a6a1d1b0 2024-08-20T05:07:00.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.667+0000 7f48826a6740 10 client.26758 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:00.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.667+0000 7f48826a6740 1 -- 172.21.15.37:0/2581825131 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5642a6a2b730 con 0x5642a6a1d1b0 2024-08-20T05:07:00.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.668+0000 7f485ea00640 1 -- 172.21.15.37:0/2581825131 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f486c00f900 con 0x5642a6a1d1b0 2024-08-20T05:07:00.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.668+0000 7f485ea00640 1 -- 172.21.15.37:0/2581825131 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f4870051070 con 0x5642a6a1d1b0 2024-08-20T05:07:00.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.669+0000 7f48826a6740 10 client.26758 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:00.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.669+0000 7f48826a6740 10 client.26758 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:07:00.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.669+0000 7f48826a6740 20 client.26758 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:00.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.669+0000 7f48826a6740 1 --2- 172.21.15.37:0/2581825131 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5642a6a2cbe0 0x5642a6a2f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.669+0000 7f48826a6740 4 client.26758 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:07:00.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.669+0000 7f48826a6740 1 -- 172.21.15.37:0/2581825131 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642a69889b0 con 0x5642a6a2cbe0 2024-08-20T05:07:00.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.669+0000 7f487d200640 1 --2- 172.21.15.37:0/2581825131 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5642a6a2cbe0 0x5642a6a2f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:00.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.670+0000 7f485ea00640 10 client.26758 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:00.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.670+0000 7f487d200640 1 --2- 172.21.15.37:0/2581825131 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5642a6a2cbe0 0x5642a6a2f010 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e8c81891ae7e3c5 server_cookie=ea9b5f8c52d20540 in_seq=0 out_seq=0 2024-08-20T05:07:00.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.671+0000 7f485ea00640 1 -- 172.21.15.37:0/2581825131 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5642a69889b0 con 0x5642a6a2cbe0 2024-08-20T05:07:00.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.671+0000 7f485ea00640 10 client.26758 handle_command_reply: tid=0 2024-08-20T05:07:00.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.671+0000 7f48826a6740 1 client.26758 shutdown 2024-08-20T05:07:00.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.672+0000 7f48826a6740 1 -- 172.21.15.37:0/2581825131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a1d1b0 msgr2=0x5642a6a1a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:00.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.672+0000 7f48826a6740 1 --2- 172.21.15.37:0/2581825131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a1d1b0 0x5642a6a1a420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f48780761f0 tx=0x7f487002a8d0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.672+0000 7f48826a6740 1 -- 172.21.15.37:0/2581825131 shutdown_connections 2024-08-20T05:07:00.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.672+0000 7f48826a6740 1 --2- 172.21.15.37:0/2581825131 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5642a6a2cbe0 0x5642a6a2f010 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.672+0000 7f48826a6740 1 --2- 172.21.15.37:0/2581825131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a1d1b0 0x5642a6a1a420 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.672+0000 7f48826a6740 1 --2- 172.21.15.37:0/2581825131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 0x5642a6a19e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.672+0000 7f485ea00640 0 client.26758 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:00.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.672+0000 7f48826a6740 1 --2- 172.21.15.37:0/2581825131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a10900 0x5642a6a1ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.672+0000 7f48826a6740 1 -- 172.21.15.37:0/2581825131 >> 172.21.15.37:0/2581825131 conn(0x5642a6a0e730 msgr2=0x5642a6a142a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:00.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.673+0000 7f48826a6740 1 -- 172.21.15.37:0/2581825131 shutdown_connections 2024-08-20T05:07:00.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.673+0000 7f48826a6740 1 -- 172.21.15.37:0/2581825131 wait complete. 2024-08-20T05:07:00.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.673+0000 7f48826a6740 20 client.26758 trim_cache size 0 max 16384 2024-08-20T05:07:00.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.703+0000 7f48826a6740 1 Processor -- start 2024-08-20T05:07:00.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.703+0000 7f48826a6740 1 -- start start 2024-08-20T05:07:00.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.704+0000 7f48826a6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a10900 0x5642a6a1b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.704+0000 7f48826a6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 0x5642a6a348e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.704+0000 7f48826a6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a1d1b0 0x5642a6a34e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.704+0000 7f48826a6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f48781be780 con 0x5642a6a1d1b0 2024-08-20T05:07:00.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.704+0000 7f48826a6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f48781c02c0 con 0x5642a6a11220 2024-08-20T05:07:00.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.704+0000 7f48826a6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f48781bee50 con 0x5642a6a10900 2024-08-20T05:07:00.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.705+0000 7f4877e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 0x5642a6a348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:00.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.705+0000 7f4877e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 0x5642a6a348e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44034/0 (socket says 172.21.15.37:44034) 2024-08-20T05:07:00.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.705+0000 7f4877e00640 1 -- 172.21.15.37:0/1918186102 learned_addr learned my addr 172.21.15.37:0/1918186102 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:00.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.705+0000 7f487d200640 1 --2- 172.21.15.37:0/1918186102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a10900 0x5642a6a1b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:00.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.705+0000 7f487dc00640 1 --2- 172.21.15.37:0/1918186102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a1d1b0 0x5642a6a34e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:00.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.705+0000 7f4877e00640 1 -- 172.21.15.37:0/1918186102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a10900 msgr2=0x5642a6a1b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:00.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.705+0000 7f4877e00640 1 --2- 172.21.15.37:0/1918186102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a10900 0x5642a6a1b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.705+0000 7f4877e00640 1 -- 172.21.15.37:0/1918186102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a1d1b0 msgr2=0x5642a6a34e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:00.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.706+0000 7f4877e00640 1 --2- 172.21.15.37:0/1918186102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a1d1b0 0x5642a6a34e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.706+0000 7f4877e00640 1 -- 172.21.15.37:0/1918186102 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642a6a09e90 con 0x5642a6a11220 2024-08-20T05:07:00.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.706+0000 7f4877e00640 1 --2- 172.21.15.37:0/1918186102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 0x5642a6a348e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f486400be10 tx=0x7f48640e9530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30dedcff2b831423 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:00.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.706+0000 7f4869600640 1 -- 172.21.15.37:0/1918186102 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4864010eb0 con 0x5642a6a11220 2024-08-20T05:07:00.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.707+0000 7f4869600640 1 -- 172.21.15.37:0/1918186102 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48640a9f50 con 0x5642a6a11220 2024-08-20T05:07:00.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.707+0000 7f4869600640 1 -- 172.21.15.37:0/1918186102 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48640a4b60 con 0x5642a6a11220 2024-08-20T05:07:00.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.708+0000 7f48826a6740 1 -- 172.21.15.37:0/1918186102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 msgr2=0x5642a6a348e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:00.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.708+0000 7f48826a6740 1 --2- 172.21.15.37:0/1918186102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 0x5642a6a348e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f486400be10 tx=0x7f48640e9530 comp rx=0 tx=0).stop 2024-08-20T05:07:00.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.708+0000 7f48826a6740 1 -- 172.21.15.37:0/1918186102 shutdown_connections 2024-08-20T05:07:00.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.708+0000 7f48826a6740 1 --2- 172.21.15.37:0/1918186102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a1d1b0 0x5642a6a34e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.708+0000 7f48826a6740 1 --2- 172.21.15.37:0/1918186102 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 0x5642a6a348e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.708+0000 7f48826a6740 1 --2- 172.21.15.37:0/1918186102 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a10900 0x5642a6a1b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.708+0000 7f48826a6740 1 -- 172.21.15.37:0/1918186102 >> 172.21.15.37:0/1918186102 conn(0x5642a6a0e730 msgr2=0x5642a6a18f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:00.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.708+0000 7f48826a6740 1 -- 172.21.15.37:0/1918186102 shutdown_connections 2024-08-20T05:07:00.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.708+0000 7f48826a6740 1 -- 172.21.15.37:0/1918186102 wait complete. 2024-08-20T05:07:00.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.709+0000 7f48826a6740 1 -- start start 2024-08-20T05:07:00.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.709+0000 7f48826a6740 1 Processor -- start 2024-08-20T05:07:00.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.709+0000 7f48826a6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a10900 0x5642a6a25570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.710+0000 7f48826a6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 0x5642a6a22a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.710+0000 7f48826a6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a1d1b0 0x5642a6a22fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.710+0000 7f48826a6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f48781bfbf0 con 0x5642a6a10900 2024-08-20T05:07:00.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.710+0000 7f48826a6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f48781bf520 con 0x5642a6a11220 2024-08-20T05:07:00.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.710+0000 7f48826a6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f48781bc760 con 0x5642a6a1d1b0 2024-08-20T05:07:00.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.710+0000 7f48826a6740 10 client.0 _ll_register_callbacks cb 0x7f4870005eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:00.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.710+0000 7f4877e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 0x5642a6a22a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:00.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.710+0000 7f4877e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 0x5642a6a22a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44038/0 (socket says 172.21.15.37:44038) 2024-08-20T05:07:00.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.710+0000 7f4877e00640 1 -- 172.21.15.37:0/639230808 learned_addr learned my addr 172.21.15.37:0/639230808 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:00.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.710+0000 7f487d200640 1 --2- 172.21.15.37:0/639230808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a10900 0x5642a6a25570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:00.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.710+0000 7f487dc00640 1 --2- 172.21.15.37:0/639230808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a1d1b0 0x5642a6a22fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:00.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.710+0000 7f4877e00640 1 -- 172.21.15.37:0/639230808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a1d1b0 msgr2=0x5642a6a22fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:00.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.710+0000 7f4877e00640 1 --2- 172.21.15.37:0/639230808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a1d1b0 0x5642a6a22fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.710+0000 7f4877e00640 1 -- 172.21.15.37:0/639230808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a10900 msgr2=0x5642a6a25570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:00.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.710+0000 7f4877e00640 1 --2- 172.21.15.37:0/639230808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a10900 0x5642a6a25570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.710+0000 7f4877e00640 1 -- 172.21.15.37:0/639230808 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642a6a235b0 con 0x5642a6a11220 2024-08-20T05:07:00.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.710+0000 7f487dc00640 1 --2- 172.21.15.37:0/639230808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a1d1b0 0x5642a6a22fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:07:00.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.711+0000 7f4877e00640 1 --2- 172.21.15.37:0/639230808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 0x5642a6a22a60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f48640a64c0 tx=0x7f4864010730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f0206511fd1f9ee server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:00.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.711+0000 7f485ea00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:07:00.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.711+0000 7f485ea00640 1 -- 172.21.15.37:0/639230808 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48640aab40 con 0x5642a6a11220 2024-08-20T05:07:00.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.711+0000 7f485ea00640 1 -- 172.21.15.37:0/639230808 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f48640a4d70 con 0x5642a6a11220 2024-08-20T05:07:00.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.712+0000 7f48826a6740 1 -- 172.21.15.37:0/639230808 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48640a9f50 con 0x5642a6a11220 2024-08-20T05:07:00.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.712+0000 7f485ea00640 1 -- 172.21.15.37:0/639230808 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f48640b34f0 con 0x5642a6a11220 2024-08-20T05:07:00.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.712+0000 7f48826a6740 10 client.26741 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:00.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.712+0000 7f48826a6740 1 -- 172.21.15.37:0/639230808 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5642a6a97720 con 0x5642a6a11220 2024-08-20T05:07:00.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.712+0000 7f485ea00640 1 -- 172.21.15.37:0/639230808 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48640a9f50 con 0x5642a6a11220 2024-08-20T05:07:00.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.713+0000 7f485ea00640 1 -- 172.21.15.37:0/639230808 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f4864022060 con 0x5642a6a11220 2024-08-20T05:07:00.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.713+0000 7f48826a6740 10 client.26741 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:00.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.713+0000 7f48826a6740 10 client.26741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:07:00.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.713+0000 7f48826a6740 20 client.26741 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:00.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.713+0000 7f48826a6740 1 --2- 172.21.15.37:0/639230808 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5642a6a97c60 0x5642a6a9a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:00.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.713+0000 7f48826a6740 4 client.26741 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:07:00.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.713+0000 7f48826a6740 1 -- 172.21.15.37:0/639230808 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5642a6984450 con 0x5642a6a97c60 2024-08-20T05:07:00.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.713+0000 7f487d200640 1 --2- 172.21.15.37:0/639230808 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5642a6a97c60 0x5642a6a9a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.714+0000 7f487d200640 1 --2- 172.21.15.37:0/639230808 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5642a6a97c60 0x5642a6a9a080 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28a05f744f34a080 server_cookie=d43172eea41eae96 in_seq=0 out_seq=0 2024-08-20T05:07:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.714+0000 7f485ea00640 10 client.26741 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.715+0000 7f485ea00640 1 -- 172.21.15.37:0/639230808 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5642a6984450 con 0x5642a6a97c60 2024-08-20T05:07:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.715+0000 7f485ea00640 10 client.26741 handle_command_reply: tid=0 2024-08-20T05:07:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.715+0000 7f48826a6740 1 client.26741 shutdown 2024-08-20T05:07:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.715+0000 7f48826a6740 1 -- 172.21.15.37:0/639230808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 msgr2=0x5642a6a22a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:00.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.715+0000 7f48826a6740 1 --2- 172.21.15.37:0/639230808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 0x5642a6a22a60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f48640a64c0 tx=0x7f4864010730 comp rx=0 tx=0).stop 2024-08-20T05:07:00.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.715+0000 7f48826a6740 1 -- 172.21.15.37:0/639230808 shutdown_connections 2024-08-20T05:07:00.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.715+0000 7f48826a6740 1 --2- 172.21.15.37:0/639230808 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5642a6a97c60 0x5642a6a9a080 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.715+0000 7f48826a6740 1 --2- 172.21.15.37:0/639230808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642a6a1d1b0 0x5642a6a22fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.715+0000 7f48826a6740 1 --2- 172.21.15.37:0/639230808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642a6a11220 0x5642a6a22a60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.715+0000 7f48826a6740 1 --2- 172.21.15.37:0/639230808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642a6a10900 0x5642a6a25570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.715+0000 7f485ea00640 0 client.26741 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:00.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.715+0000 7f48826a6740 1 -- 172.21.15.37:0/639230808 >> 172.21.15.37:0/639230808 conn(0x5642a6a0e730 msgr2=0x5642a6a0cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:00.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.715+0000 7f48826a6740 1 -- 172.21.15.37:0/639230808 shutdown_connections 2024-08-20T05:07:00.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.715+0000 7f48826a6740 1 -- 172.21.15.37:0/639230808 wait complete. 2024-08-20T05:07:00.719 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:07:00.719 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-20T05:07:00.719 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-08-20T05:07:00.719 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:07:00.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.715+0000 7f48826a6740 20 client.26741 trim_cache size 0 max 16384 2024-08-20T05:07:00.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.716+0000 7f487fc00640 1 -- 172.21.15.37:0/2163819255 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f48600b3cd0 msgr2=0x7f48600b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:00.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.716+0000 7f487fc00640 1 --2- 172.21.15.37:0/2163819255 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f48600b3cd0 0x7f48600b6190 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4870006010 tx=0x7f4870009800 comp rx=0 tx=0).stop 2024-08-20T05:07:00.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.716+0000 7f487fc00640 1 -- 172.21.15.37:0/2163819255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4878075b30 msgr2=0x7f4878104bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:00.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.716+0000 7f487fc00640 1 --2- 172.21.15.37:0/2163819255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4878075b30 0x7f4878104bb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f486400b450 tx=0x7f486400b910 comp rx=0 tx=0).stop 2024-08-20T05:07:00.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.716+0000 7f487fc00640 1 -- 172.21.15.37:0/2163819255 shutdown_connections 2024-08-20T05:07:00.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.716+0000 7f487fc00640 1 --2- 172.21.15.37:0/2163819255 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f48600b3cd0 0x7f48600b6190 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.716+0000 7f487fc00640 1 --2- 172.21.15.37:0/2163819255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f487810f0a0 0x7f4878109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.716+0000 7f487fc00640 1 --2- 172.21.15.37:0/2163819255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4878075b30 0x7f4878104bb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.716+0000 7f487fc00640 1 --2- 172.21.15.37:0/2163819255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4878075210 0x7f4878104670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:00.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.716+0000 7f487fc00640 1 -- 172.21.15.37:0/2163819255 >> 172.21.15.37:0/2163819255 conn(0x7f48780fe500 msgr2=0x7f4878111260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:00.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.717+0000 7f487fc00640 1 -- 172.21.15.37:0/2163819255 shutdown_connections 2024-08-20T05:07:00.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:00.717+0000 7f487fc00640 1 -- 172.21.15.37:0/2163819255 wait complete. 2024-08-20T05:07:01.173 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:00 smithi037 ceph-mon[17265]: pgmap v544: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 6.1 MiB/s wr, 695 op/s 2024-08-20T05:07:01.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:00 smithi130 ceph-mon[22007]: pgmap v544: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 6.1 MiB/s wr, 695 op/s 2024-08-20T05:07:01.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:00 smithi135 ceph-mon[22342]: pgmap v544: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 6.1 MiB/s wr, 695 op/s 2024-08-20T05:07:02.401 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T05:07:02.401 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:07:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 245.0 s, 1162.0 tps, lat 85.873 ms stddev 102.099 2024-08-20T05:07:03.083 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:07:03.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:03 smithi037 ceph-mon[17265]: pgmap v545: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.2 MiB/s wr, 593 op/s 2024-08-20T05:07:03.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:03 smithi135 ceph-mon[22342]: pgmap v545: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.2 MiB/s wr, 593 op/s 2024-08-20T05:07:03.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:03 smithi130 ceph-mon[22007]: pgmap v545: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.2 MiB/s wr, 593 op/s 2024-08-20T05:07:05.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:05 smithi037 ceph-mon[17265]: pgmap v546: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.2 MiB/s wr, 606 op/s 2024-08-20T05:07:05.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:05 smithi135 ceph-mon[22342]: pgmap v546: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.2 MiB/s wr, 606 op/s 2024-08-20T05:07:05.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:05 smithi130 ceph-mon[22007]: pgmap v546: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.2 MiB/s wr, 606 op/s 2024-08-20T05:07:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.555+0000 7f83cda00640 1 -- 172.21.15.37:0/4022490067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c81036a0 msgr2=0x7f83c8103a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.555+0000 7f83cda00640 1 --2- 172.21.15.37:0/4022490067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c81036a0 0x7f83c8103a80 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009900 tx=0x7f83b802a400 comp rx=0 tx=0).stop 2024-08-20T05:07:06.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.556+0000 7f83cda00640 1 -- 172.21.15.37:0/4022490067 shutdown_connections 2024-08-20T05:07:06.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.556+0000 7f83cda00640 1 --2- 172.21.15.37:0/4022490067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83c810cc50 0x7f83c810f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:06.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.556+0000 7f83cda00640 1 --2- 172.21.15.37:0/4022490067 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83c81040a0 0x7f83c810c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:06.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.556+0000 7f83cda00640 1 --2- 172.21.15.37:0/4022490067 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c81036a0 0x7f83c8103a80 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:06.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.557+0000 7f83cda00640 1 -- 172.21.15.37:0/4022490067 >> 172.21.15.37:0/4022490067 conn(0x7f83c80fd2d0 msgr2=0x7f83c80ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:06.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.557+0000 7f83cda00640 1 -- 172.21.15.37:0/4022490067 shutdown_connections 2024-08-20T05:07:06.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.558+0000 7f83cda00640 1 -- 172.21.15.37:0/4022490067 wait complete. 2024-08-20T05:07:06.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.559+0000 7f83cda00640 1 Processor -- start 2024-08-20T05:07:06.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.560+0000 7f83cda00640 1 -- start start 2024-08-20T05:07:06.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.561+0000 7f83cda00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83c81036a0 0x7f83c8196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:06.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.561+0000 7f83cda00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c81040a0 0x7f83c8197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:06.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.561+0000 7f83cda00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83c810cc50 0x7f83c819c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:06.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.561+0000 7f83cda00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f83c8110710 con 0x7f83c81036a0 2024-08-20T05:07:06.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.561+0000 7f83cda00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f83c8110590 con 0x7f83c810cc50 2024-08-20T05:07:06.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.561+0000 7f83cda00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f83c8110890 con 0x7f83c81040a0 2024-08-20T05:07:06.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.562+0000 7f83bfe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c81040a0 0x7f83c8197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:06.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.562+0000 7f83bfe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c81040a0 0x7f83c8197080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41164/0 (socket says 172.21.15.37:41164) 2024-08-20T05:07:06.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.562+0000 7f83bfe00640 1 -- 172.21.15.37:0/1793234374 learned_addr learned my addr 172.21.15.37:0/1793234374 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:06.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.562+0000 7f83c7e00640 1 --2- 172.21.15.37:0/1793234374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83c81036a0 0x7f83c8196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:06.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.562+0000 7f83bfe00640 1 -- 172.21.15.37:0/1793234374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83c810cc50 msgr2=0x7f83c819c420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T05:07:06.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.562+0000 7f83bfe00640 1 --2- 172.21.15.37:0/1793234374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83c810cc50 0x7f83c819c420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:06.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.562+0000 7f83bfe00640 1 -- 172.21.15.37:0/1793234374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83c81036a0 msgr2=0x7f83c8196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:06.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.562+0000 7f83bfe00640 1 --2- 172.21.15.37:0/1793234374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83c81036a0 0x7f83c8196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:06.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.562+0000 7f83bfe00640 1 -- 172.21.15.37:0/1793234374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83c819cbf0 con 0x7f83c81040a0 2024-08-20T05:07:06.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.562+0000 7f83c7e00640 1 --2- 172.21.15.37:0/1793234374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83c81036a0 0x7f83c8196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:06.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.563+0000 7f83bfe00640 1 --2- 172.21.15.37:0/1793234374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c81040a0 0x7f83c8197080 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f83b000e9f0 tx=0x7f83b000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:06.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.564+0000 7f83c5600640 1 -- 172.21.15.37:0/1793234374 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b000cd80 con 0x7f83c81040a0 2024-08-20T05:07:06.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.564+0000 7f83c5600640 1 -- 172.21.15.37:0/1793234374 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83b00108e0 con 0x7f83c81040a0 2024-08-20T05:07:06.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.564+0000 7f83c5600640 1 -- 172.21.15.37:0/1793234374 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83b0018980 con 0x7f83c81040a0 2024-08-20T05:07:06.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.564+0000 7f83cda00640 1 -- 172.21.15.37:0/1793234374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83c819cee0 con 0x7f83c81040a0 2024-08-20T05:07:06.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.565+0000 7f83cda00640 1 -- 172.21.15.37:0/1793234374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83c81a35a0 con 0x7f83c81040a0 2024-08-20T05:07:06.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.568+0000 7f83cda00640 1 -- 172.21.15.37:0/1793234374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83c8103a80 con 0x7f83c81040a0 2024-08-20T05:07:06.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.571+0000 7f83c5600640 1 -- 172.21.15.37:0/1793234374 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f83b0010430 con 0x7f83c81040a0 2024-08-20T05:07:06.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.574+0000 7f83c5600640 1 --2- 172.21.15.37:0/1793234374 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83ac0b3e90 0x7f83ac0b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:06.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.575+0000 7f83c5600640 1 -- 172.21.15.37:0/1793234374 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f83b00e45c0 con 0x7f83c81040a0 2024-08-20T05:07:06.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.575+0000 7f83c7e00640 1 --2- 172.21.15.37:0/1793234374 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83ac0b3e90 0x7f83ac0b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:06.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.577+0000 7f83c5600640 1 -- 172.21.15.37:0/1793234374 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f83b00ab810 con 0x7f83c81040a0 2024-08-20T05:07:06.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.579+0000 7f83c7e00640 1 --2- 172.21.15.37:0/1793234374 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83ac0b3e90 0x7f83ac0b6350 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009850 tx=0x7f83b8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:06.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.991+0000 7f83cda00640 1 -- 172.21.15.37:0/1793234374 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83c81a38c0 con 0x7f83c81040a0 2024-08-20T05:07:06.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.992+0000 7f83c5600640 1 -- 172.21.15.37:0/1793234374 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11980 (secure 0 0 0) 0x7f83b00ab110 con 0x7f83c81040a0 2024-08-20T05:07:06.998 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:07:06.999 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 36 2024-08-20T05:07:06.999 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"btime":"2024-08-20T05:06:06:678364+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:06:06.276613+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:07:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.997+0000 7f83cda00640 1 -- 172.21.15.37:0/1793234374 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83ac0b3e90 msgr2=0x7f83ac0b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.997+0000 7f83cda00640 1 --2- 172.21.15.37:0/1793234374 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83ac0b3e90 0x7f83ac0b6350 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f83b8009850 tx=0x7f83b8000bc0 comp rx=0 tx=0).stop 2024-08-20T05:07:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.997+0000 7f83cda00640 1 -- 172.21.15.37:0/1793234374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c81040a0 msgr2=0x7f83c8197080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.997+0000 7f83cda00640 1 --2- 172.21.15.37:0/1793234374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c81040a0 0x7f83c8197080 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f83b000e9f0 tx=0x7f83b000eeb0 comp rx=0 tx=0).stop 2024-08-20T05:07:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.997+0000 7f83cda00640 1 -- 172.21.15.37:0/1793234374 shutdown_connections 2024-08-20T05:07:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.997+0000 7f83cda00640 1 --2- 172.21.15.37:0/1793234374 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83ac0b3e90 0x7f83ac0b6350 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.997+0000 7f83cda00640 1 --2- 172.21.15.37:0/1793234374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83c810cc50 0x7f83c819c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.997+0000 7f83cda00640 1 --2- 172.21.15.37:0/1793234374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83c81040a0 0x7f83c8197080 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.997+0000 7f83cda00640 1 --2- 172.21.15.37:0/1793234374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83c81036a0 0x7f83c8196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.997+0000 7f83cda00640 1 -- 172.21.15.37:0/1793234374 >> 172.21.15.37:0/1793234374 conn(0x7f83c80fd2d0 msgr2=0x7f83c810ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.997+0000 7f83cda00640 1 -- 172.21.15.37:0/1793234374 shutdown_connections 2024-08-20T05:07:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:06.997+0000 7f83cda00640 1 -- 172.21.15.37:0/1793234374 wait complete. 2024-08-20T05:07:07.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:07 smithi037 ceph-mon[17265]: pgmap v547: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.9 MiB/s wr, 565 op/s 2024-08-20T05:07:07.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:07 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1793234374' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:07:07.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:07 smithi135 ceph-mon[22342]: pgmap v547: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.9 MiB/s wr, 565 op/s 2024-08-20T05:07:07.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:07 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1793234374' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:07:07.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:07 smithi130 ceph-mon[22007]: pgmap v547: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.9 MiB/s wr, 565 op/s 2024-08-20T05:07:07.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:07 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1793234374' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:07:08.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 250.0 s, 1001.0 tps, lat 99.336 ms stddev 133.626 2024-08-20T05:07:08.419 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T05:07:09.105 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:07:09.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:09 smithi037 ceph-mon[17265]: pgmap v548: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 569 op/s 2024-08-20T05:07:09.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:09 smithi135 ceph-mon[22342]: pgmap v548: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 569 op/s 2024-08-20T05:07:09.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:09 smithi130 ceph-mon[22007]: pgmap v548: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 569 op/s 2024-08-20T05:07:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.354+0000 7f8e79800640 1 -- 172.21.15.37:0/3061234510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e741084a0 msgr2=0x7f8e741088e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.354+0000 7f8e79800640 1 --2- 172.21.15.37:0/3061234510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e741084a0 0x7f8e741088e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c009ca0 tx=0x7f8e6c02a8d0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.354+0000 7f8e79800640 1 -- 172.21.15.37:0/3061234510 shutdown_connections 2024-08-20T05:07:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.354+0000 7f8e79800640 1 --2- 172.21.15.37:0/3061234510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e74108e20 0x7f8e7410f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.354+0000 7f8e79800640 1 --2- 172.21.15.37:0/3061234510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e741084a0 0x7f8e741088e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.354+0000 7f8e79800640 1 --2- 172.21.15.37:0/3061234510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e74102a90 0x7f8e74102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.354+0000 7f8e79800640 1 -- 172.21.15.37:0/3061234510 >> 172.21.15.37:0/3061234510 conn(0x7f8e740fe540 msgr2=0x7f8e74100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.355+0000 7f8e79800640 1 -- 172.21.15.37:0/3061234510 shutdown_connections 2024-08-20T05:07:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.355+0000 7f8e79800640 1 -- 172.21.15.37:0/3061234510 wait complete. 2024-08-20T05:07:10.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.356+0000 7f8e79800640 1 Processor -- start 2024-08-20T05:07:10.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.357+0000 7f8e79800640 1 -- start start 2024-08-20T05:07:10.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.357+0000 7f8e79800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e74102a90 0x7f8e7410fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.357+0000 7f8e79800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e741084a0 0x7f8e74110340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.357+0000 7f8e79800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e74108e20 0x7f8e74110880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.357+0000 7f8e79800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e74114cd0 con 0x7f8e74102a90 2024-08-20T05:07:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.357+0000 7f8e79800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8e74114b50 con 0x7f8e74108e20 2024-08-20T05:07:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.357+0000 7f8e79800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8e74114e50 con 0x7f8e741084a0 2024-08-20T05:07:10.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.358+0000 7f8e72000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e741084a0 0x7f8e74110340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:10.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.358+0000 7f8e72000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e741084a0 0x7f8e74110340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41184/0 (socket says 172.21.15.37:41184) 2024-08-20T05:07:10.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.358+0000 7f8e72000640 1 -- 172.21.15.37:0/4099599626 learned_addr learned my addr 172.21.15.37:0/4099599626 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:10.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.358+0000 7f8e73400640 1 --2- 172.21.15.37:0/4099599626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e74108e20 0x7f8e74110880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:10.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.358+0000 7f8e72000640 1 -- 172.21.15.37:0/4099599626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e74108e20 msgr2=0x7f8e74110880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:10.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.358+0000 7f8e72000640 1 --2- 172.21.15.37:0/4099599626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e74108e20 0x7f8e74110880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.358+0000 7f8e72000640 1 -- 172.21.15.37:0/4099599626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e74102a90 msgr2=0x7f8e7410fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:10.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.358+0000 7f8e72000640 1 --2- 172.21.15.37:0/4099599626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e74102a90 0x7f8e7410fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.358+0000 7f8e72000640 1 -- 172.21.15.37:0/4099599626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e741ab810 con 0x7f8e741084a0 2024-08-20T05:07:10.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.359+0000 7f8e72000640 1 --2- 172.21.15.37:0/4099599626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e741084a0 0x7f8e74110340 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0319a0 tx=0x7f8e6c009870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:10.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.360+0000 7f8e6b400640 1 -- 172.21.15.37:0/4099599626 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c030ae0 con 0x7f8e741084a0 2024-08-20T05:07:10.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.360+0000 7f8e6b400640 1 -- 172.21.15.37:0/4099599626 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e6c030c80 con 0x7f8e741084a0 2024-08-20T05:07:10.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.360+0000 7f8e79800640 1 -- 172.21.15.37:0/4099599626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e741abaa0 con 0x7f8e741084a0 2024-08-20T05:07:10.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.360+0000 7f8e6b400640 1 -- 172.21.15.37:0/4099599626 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c03b660 con 0x7f8e741084a0 2024-08-20T05:07:10.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.360+0000 7f8e79800640 1 -- 172.21.15.37:0/4099599626 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e741abfe0 con 0x7f8e741084a0 2024-08-20T05:07:10.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.365+0000 7f8e7c423740 1 Processor -- start 2024-08-20T05:07:10.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.367+0000 7f8e7c423740 1 -- start start 2024-08-20T05:07:10.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.371+0000 7f8e7c423740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 0x5647f02d8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.371+0000 7f8e7c423740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02d9260 0x5647f02e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.371+0000 7f8e7c423740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02e51f0 0x5647f02e75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.371+0000 7f8e7c423740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5647f024eaa0 con 0x5647f02e51f0 2024-08-20T05:07:10.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.371+0000 7f8e7c423740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5647f023dfa0 con 0x5647f02d9260 2024-08-20T05:07:10.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.371+0000 7f8e7c423740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5647f0241fe0 con 0x5647f02d8940 2024-08-20T05:07:10.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.371+0000 7f8e73400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 0x5647f02d8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:10.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.371+0000 7f8e73400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 0x5647f02d8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41198/0 (socket says 172.21.15.37:41198) 2024-08-20T05:07:10.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.371+0000 7f8e73400640 1 -- 172.21.15.37:0/2759343518 learned_addr learned my addr 172.21.15.37:0/2759343518 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:10.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.371+0000 7f8e72a00640 1 --2- 172.21.15.37:0/2759343518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02d9260 0x5647f02e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:10.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.372+0000 7f8e73400640 1 -- 172.21.15.37:0/2759343518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02d9260 msgr2=0x5647f02e4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:10.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.372+0000 7f8e73400640 1 --2- 172.21.15.37:0/2759343518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02d9260 0x5647f02e4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.372+0000 7f8e73400640 1 -- 172.21.15.37:0/2759343518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02e51f0 msgr2=0x5647f02e75e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:07:10.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.372+0000 7f8e73400640 1 --2- 172.21.15.37:0/2759343518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02e51f0 0x5647f02e75e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.372+0000 7f8e73400640 1 -- 172.21.15.37:0/2759343518 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f01e4420 con 0x5647f02d8940 2024-08-20T05:07:10.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.373+0000 7f8e73400640 1 --2- 172.21.15.37:0/2759343518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 0x5647f02d8d20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009c20 tx=0x7f8e64011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d92f0fb8dca9a5be server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:10.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.374+0000 7f8e63e00640 1 -- 172.21.15.37:0/2759343518 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6401e070 con 0x5647f02d8940 2024-08-20T05:07:10.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.374+0000 7f8e63e00640 1 -- 172.21.15.37:0/2759343518 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e64019ae0 con 0x5647f02d8940 2024-08-20T05:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.376+0000 7f8e6b400640 1 -- 172.21.15.37:0/4099599626 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8e6c03b8c0 con 0x7f8e741084a0 2024-08-20T05:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.377+0000 7f8e7c423740 1 -- 172.21.15.37:0/2759343518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 msgr2=0x5647f02d8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.377+0000 7f8e7c423740 1 --2- 172.21.15.37:0/2759343518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 0x5647f02d8d20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8e64009c20 tx=0x7f8e64011810 comp rx=0 tx=0).stop 2024-08-20T05:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.376+0000 7f8e63e00640 1 -- 172.21.15.37:0/2759343518 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6401e070 con 0x5647f02d8940 2024-08-20T05:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.377+0000 7f8e7c423740 1 -- 172.21.15.37:0/2759343518 shutdown_connections 2024-08-20T05:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.377+0000 7f8e7c423740 1 --2- 172.21.15.37:0/2759343518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02e51f0 0x5647f02e75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.377+0000 7f8e7c423740 1 --2- 172.21.15.37:0/2759343518 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02d9260 0x5647f02e4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.377+0000 7f8e7c423740 1 --2- 172.21.15.37:0/2759343518 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 0x5647f02d8d20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.377+0000 7f8e7c423740 1 -- 172.21.15.37:0/2759343518 >> 172.21.15.37:0/2759343518 conn(0x5647f02d6770 msgr2=0x5647f02d7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.380+0000 7f8e6b400640 1 --2- 172.21.15.37:0/4099599626 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8e540b3d20 0x7f8e540b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.381+0000 7f8e7c423740 1 -- 172.21.15.37:0/2759343518 shutdown_connections 2024-08-20T05:07:10.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.381+0000 7f8e6b400640 1 -- 172.21.15.37:0/4099599626 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8e6c104af0 con 0x7f8e741084a0 2024-08-20T05:07:10.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.382+0000 7f8e7c423740 1 -- 172.21.15.37:0/2759343518 wait complete. 2024-08-20T05:07:10.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.382+0000 7f8e72a00640 1 --2- 172.21.15.37:0/4099599626 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8e540b3d20 0x7f8e540b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:10.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.382+0000 7f8e7c423740 1 -- start start 2024-08-20T05:07:10.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.383+0000 7f8e7c423740 1 Processor -- start 2024-08-20T05:07:10.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.385+0000 7f8e72a00640 1 --2- 172.21.15.37:0/4099599626 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8e540b3d20 0x7f8e540b61e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x5647f02d7650 tx=0x7f8e5c009620 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:10.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.385+0000 7f8e7c423740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 0x5647f02e4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.386+0000 7f8e7c423740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02d9260 0x5647f02e1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.386+0000 7f8e72a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 0x5647f02e4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:10.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.386+0000 7f8e72a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 0x5647f02e4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41208/0 (socket says 172.21.15.37:41208) 2024-08-20T05:07:10.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.386+0000 7f8e72a00640 1 -- 172.21.15.37:0/3502731882 learned_addr learned my addr 172.21.15.37:0/3502731882 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:10.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.386+0000 7f8e7c423740 1 --2- 172.21.15.37:0/3502731882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02e51f0 0x5647f02e22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.387+0000 7f8e72000640 1 --2- 172.21.15.37:0/3502731882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02d9260 0x5647f02e1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:10.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.387+0000 7f8e73400640 1 --2- 172.21.15.37:0/3502731882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02e51f0 0x5647f02e22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.387+0000 7f8e7c423740 1 -- 172.21.15.37:0/3502731882 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5647f00a0700 con 0x5647f02d9260 2024-08-20T05:07:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.387+0000 7f8e7c423740 1 -- 172.21.15.37:0/3502731882 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5647f01d9290 con 0x5647f02e51f0 2024-08-20T05:07:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.387+0000 7f8e7c423740 1 -- 172.21.15.37:0/3502731882 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5647f02e7ec0 con 0x5647f02d8940 2024-08-20T05:07:10.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.387+0000 7f8e7c423740 10 client.0 _ll_register_callbacks cb 0x5647f02381c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.388+0000 7f8e72a00640 1 -- 172.21.15.37:0/3502731882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02e51f0 msgr2=0x5647f02e22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.388+0000 7f8e72a00640 1 --2- 172.21.15.37:0/3502731882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02e51f0 0x5647f02e22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.388+0000 7f8e72a00640 1 -- 172.21.15.37:0/3502731882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02d9260 msgr2=0x5647f02e1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.388+0000 7f8e72a00640 1 --2- 172.21.15.37:0/3502731882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02d9260 0x5647f02e1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.388+0000 7f8e72a00640 1 -- 172.21.15.37:0/3502731882 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647eff9d650 con 0x5647f02d8940 2024-08-20T05:07:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.389+0000 7f8e72a00640 1 --2- 172.21.15.37:0/3502731882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 0x5647f02e4940 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c004450 tx=0x7f8e5c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=313b3ee00c4d828c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.389+0000 7f8e60c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:07:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.390+0000 7f8e60c00640 1 -- 172.21.15.37:0/3502731882 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c01e800 con 0x5647f02d8940 2024-08-20T05:07:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.391+0000 7f8e60c00640 1 -- 172.21.15.37:0/3502731882 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8e5c01e9a0 con 0x5647f02d8940 2024-08-20T05:07:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.391+0000 7f8e7c423740 1 -- 172.21.15.37:0/3502731882 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e64019ae0 con 0x5647f02d8940 2024-08-20T05:07:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.391+0000 7f8e60c00640 1 -- 172.21.15.37:0/3502731882 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8e5c01eba0 con 0x5647f02d8940 2024-08-20T05:07:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.391+0000 7f8e7c423740 10 client.26782 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.391+0000 7f8e7c423740 1 -- 172.21.15.37:0/3502731882 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5647f02f3700 con 0x5647f02d8940 2024-08-20T05:07:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.392+0000 7f8e60c00640 1 -- 172.21.15.37:0/3502731882 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e64019ae0 con 0x5647f02d8940 2024-08-20T05:07:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.392+0000 7f8e60c00640 1 -- 172.21.15.37:0/3502731882 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f8e5c00e3b0 con 0x5647f02d8940 2024-08-20T05:07:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.392+0000 7f8e7c423740 10 client.26782 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.392+0000 7f8e7c423740 10 client.26782 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:07:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.392+0000 7f8e7c423740 20 client.26782 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.392+0000 7f8e7c423740 1 --2- 172.21.15.37:0/3502731882 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5647f02f4bc0 0x5647f02f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.393+0000 7f8e7c423740 4 client.26782 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:07:10.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.393+0000 7f8e7c423740 1 -- 172.21.15.37:0/3502731882 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647f02509f0 con 0x5647f02f4bc0 2024-08-20T05:07:10.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.393+0000 7f8e72000640 1 --2- 172.21.15.37:0/3502731882 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5647f02f4bc0 0x5647f02f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:10.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.394+0000 7f8e60c00640 10 client.26782 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:07:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.396+0000 7f8e72000640 1 --2- 172.21.15.37:0/3502731882 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5647f02f4bc0 0x5647f02f6ff0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=de1f4d4c399df1f2 server_cookie=103005bd40d1f389 in_seq=0 out_seq=0 2024-08-20T05:07:10.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.397+0000 7f8e60c00640 1 -- 172.21.15.37:0/3502731882 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5647f02509f0 con 0x5647f02f4bc0 2024-08-20T05:07:10.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.397+0000 7f8e60c00640 10 client.26782 handle_command_reply: tid=0 2024-08-20T05:07:10.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.397+0000 7f8e7c423740 1 client.26782 shutdown 2024-08-20T05:07:10.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.397+0000 7f8e7c423740 1 -- 172.21.15.37:0/3502731882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 msgr2=0x5647f02e4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:10.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.397+0000 7f8e7c423740 1 --2- 172.21.15.37:0/3502731882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 0x5647f02e4940 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c004450 tx=0x7f8e5c0046c0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.397+0000 7f8e7c423740 1 -- 172.21.15.37:0/3502731882 shutdown_connections 2024-08-20T05:07:10.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.397+0000 7f8e7c423740 1 --2- 172.21.15.37:0/3502731882 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5647f02f4bc0 0x5647f02f6ff0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.398+0000 7f8e7c423740 1 --2- 172.21.15.37:0/3502731882 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02e51f0 0x5647f02e22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.398+0000 7f8e7c423740 1 --2- 172.21.15.37:0/3502731882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02d9260 0x5647f02e1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.398+0000 7f8e7c423740 1 --2- 172.21.15.37:0/3502731882 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 0x5647f02e4940 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.398+0000 7f8e7c423740 1 -- 172.21.15.37:0/3502731882 >> 172.21.15.37:0/3502731882 conn(0x5647f02d6770 msgr2=0x5647f02dc310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.398+0000 7f8e60c00640 0 client.26782 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:07:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.398+0000 7f8e7c423740 1 -- 172.21.15.37:0/3502731882 shutdown_connections 2024-08-20T05:07:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.398+0000 7f8e7c423740 1 -- 172.21.15.37:0/3502731882 wait complete. 2024-08-20T05:07:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.398+0000 7f8e7c423740 20 client.26782 trim_cache size 0 max 16384 2024-08-20T05:07:10.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.425+0000 7f8e7c423740 1 Processor -- start 2024-08-20T05:07:10.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.425+0000 7f8e7c423740 1 -- start start 2024-08-20T05:07:10.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.426+0000 7f8e7c423740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02d8940 0x5647f02fc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.426+0000 7f8e7c423740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02d9260 0x5647f02fce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.426+0000 7f8e7c423740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02e51f0 0x5647f02defa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.426+0000 7f8e7c423740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e741b5eb0 con 0x5647f02d9260 2024-08-20T05:07:10.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.426+0000 7f8e7c423740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8e741b79f0 con 0x5647f02d8940 2024-08-20T05:07:10.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.426+0000 7f8e7c423740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8e741b6580 con 0x5647f02e51f0 2024-08-20T05:07:10.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.427+0000 7f8e72a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02d8940 0x5647f02fc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:10.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.427+0000 7f8e73400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02e51f0 0x5647f02defa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:10.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.427+0000 7f8e72a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02d8940 0x5647f02fc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:54564/0 (socket says 172.21.15.37:54564) 2024-08-20T05:07:10.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.427+0000 7f8e72a00640 1 -- 172.21.15.37:0/2612591090 learned_addr learned my addr 172.21.15.37:0/2612591090 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:10.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.427+0000 7f8e73400640 1 --2- 172.21.15.37:0/2612591090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02e51f0 0x5647f02defa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41220/0 (socket says 172.21.15.37:41220) 2024-08-20T05:07:10.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.427+0000 7f8e72000640 1 --2- 172.21.15.37:0/2612591090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02d9260 0x5647f02fce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:10.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.428+0000 7f8e72a00640 1 -- 172.21.15.37:0/2612591090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02e51f0 msgr2=0x5647f02defa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:10.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.428+0000 7f8e72a00640 1 --2- 172.21.15.37:0/2612591090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02e51f0 0x5647f02defa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.428+0000 7f8e72a00640 1 -- 172.21.15.37:0/2612591090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02d9260 msgr2=0x5647f02fce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:10.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.428+0000 7f8e72a00640 1 --2- 172.21.15.37:0/2612591090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02d9260 0x5647f02fce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.428+0000 7f8e72a00640 1 -- 172.21.15.37:0/2612591090 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647f02d1ed0 con 0x5647f02d8940 2024-08-20T05:07:10.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.429+0000 7f8e72a00640 1 --2- 172.21.15.37:0/2612591090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02d8940 0x5647f02fc8c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00e7d0 tx=0x7f8e5c011a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e25275ab9e4241 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:10.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.429+0000 7f8e63400640 1 -- 172.21.15.37:0/2612591090 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c00e3b0 con 0x5647f02d8940 2024-08-20T05:07:10.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.430+0000 7f8e63400640 1 -- 172.21.15.37:0/2612591090 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e5c00e550 con 0x5647f02d8940 2024-08-20T05:07:10.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.430+0000 7f8e63400640 1 -- 172.21.15.37:0/2612591090 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c0337e0 con 0x5647f02d8940 2024-08-20T05:07:10.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.431+0000 7f8e7c423740 1 -- 172.21.15.37:0/2612591090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02d8940 msgr2=0x5647f02fc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:10.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.431+0000 7f8e7c423740 1 --2- 172.21.15.37:0/2612591090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02d8940 0x5647f02fc8c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00e7d0 tx=0x7f8e5c011a80 comp rx=0 tx=0).stop 2024-08-20T05:07:10.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.431+0000 7f8e7c423740 1 -- 172.21.15.37:0/2612591090 shutdown_connections 2024-08-20T05:07:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.431+0000 7f8e7c423740 1 --2- 172.21.15.37:0/2612591090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02e51f0 0x5647f02defa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.431+0000 7f8e7c423740 1 --2- 172.21.15.37:0/2612591090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02d9260 0x5647f02fce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.431+0000 7f8e7c423740 1 --2- 172.21.15.37:0/2612591090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02d8940 0x5647f02fc8c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.431+0000 7f8e7c423740 1 -- 172.21.15.37:0/2612591090 >> 172.21.15.37:0/2612591090 conn(0x5647f02d6770 msgr2=0x5647f02e3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.432+0000 7f8e7c423740 1 -- 172.21.15.37:0/2612591090 shutdown_connections 2024-08-20T05:07:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.432+0000 7f8e7c423740 1 -- 172.21.15.37:0/2612591090 wait complete. 2024-08-20T05:07:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.433+0000 7f8e7c423740 1 -- start start 2024-08-20T05:07:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.433+0000 7f8e7c423740 1 Processor -- start 2024-08-20T05:07:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.434+0000 7f8e7c423740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 0x5647f02ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.434+0000 7f8e7c423740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02d9260 0x5647f02eaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.434+0000 7f8e7c423740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02e51f0 0x5647f02eb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.434+0000 7f8e7c423740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e741b7320 con 0x5647f02d9260 2024-08-20T05:07:10.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.434+0000 7f8e7c423740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8e741b6c50 con 0x5647f02e51f0 2024-08-20T05:07:10.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.434+0000 7f8e7c423740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8e741b3e90 con 0x5647f02d8940 2024-08-20T05:07:10.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.434+0000 7f8e7c423740 10 client.0 _ll_register_callbacks cb 0x7f8e5c004100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:10.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.434+0000 7f8e72000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02d9260 0x5647f02eaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:10.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.434+0000 7f8e73400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02e51f0 0x5647f02eb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:10.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.434+0000 7f8e72000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02d9260 0x5647f02eaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39652/0 (socket says 172.21.15.37:39652) 2024-08-20T05:07:10.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.434+0000 7f8e72000640 1 -- 172.21.15.37:0/2268831694 learned_addr learned my addr 172.21.15.37:0/2268831694 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:10.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.435+0000 7f8e72a00640 1 --2- 172.21.15.37:0/2268831694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 0x5647f02ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:10.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.435+0000 7f8e72000640 1 -- 172.21.15.37:0/2268831694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 msgr2=0x5647f02ed9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:10.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.435+0000 7f8e72000640 1 --2- 172.21.15.37:0/2268831694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 0x5647f02ed9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.435+0000 7f8e72000640 1 -- 172.21.15.37:0/2268831694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02e51f0 msgr2=0x5647f02eb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.435+0000 7f8e72000640 1 --2- 172.21.15.37:0/2268831694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02e51f0 0x5647f02eb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.435+0000 7f8e72000640 1 -- 172.21.15.37:0/2268831694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647f035e8a0 con 0x5647f02d9260 2024-08-20T05:07:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.436+0000 7f8e72000640 1 --2- 172.21.15.37:0/2268831694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02d9260 0x5647f02eaf00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0c7720 tx=0x7f8e6c045ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad78cb38f4fea2a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.436+0000 7f8e60c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:07:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.436+0000 7f8e60c00640 1 -- 172.21.15.37:0/2268831694 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0e5060 con 0x5647f02d9260 2024-08-20T05:07:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.436+0000 7f8e60c00640 1 -- 172.21.15.37:0/2268831694 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8e6c0c7930 con 0x5647f02d9260 2024-08-20T05:07:10.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.437+0000 7f8e7c423740 1 -- 172.21.15.37:0/2268831694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e5c00e550 con 0x5647f02d9260 2024-08-20T05:07:10.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.437+0000 7f8e60c00640 1 -- 172.21.15.37:0/2268831694 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8e6c0cb6a0 con 0x5647f02d9260 2024-08-20T05:07:10.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.439+0000 7f8e7c423740 10 client.16506 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:10.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.439+0000 7f8e7c423740 1 -- 172.21.15.37:0/2268831694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5647f035fb00 con 0x5647f02d9260 2024-08-20T05:07:10.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.440+0000 7f8e60c00640 1 -- 172.21.15.37:0/2268831694 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e5c00e550 con 0x5647f02d9260 2024-08-20T05:07:10.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.440+0000 7f8e60c00640 1 -- 172.21.15.37:0/2268831694 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f8e6c04d060 con 0x5647f02d9260 2024-08-20T05:07:10.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.440+0000 7f8e7c423740 10 client.16506 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.440+0000 7f8e7c423740 10 client.16506 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:07:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.440+0000 7f8e7c423740 20 client.16506 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.440+0000 7f8e7c423740 1 --2- 172.21.15.37:0/2268831694 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5647f0360170 0x5647f0362590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.441+0000 7f8e7c423740 4 client.16506 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:07:10.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.441+0000 7f8e7c423740 1 -- 172.21.15.37:0/2268831694 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5647f024c490 con 0x5647f0360170 2024-08-20T05:07:10.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.441+0000 7f8e72a00640 1 --2- 172.21.15.37:0/2268831694 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5647f0360170 0x5647f0362590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:10.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.442+0000 7f8e60c00640 10 client.16506 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:07:10.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.442+0000 7f8e72a00640 1 --2- 172.21.15.37:0/2268831694 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5647f0360170 0x5647f0362590 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=aa111ac3e9a6c44b server_cookie=639dc4dd8759eef4 in_seq=0 out_seq=0 2024-08-20T05:07:10.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.442+0000 7f8e60c00640 1 -- 172.21.15.37:0/2268831694 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5647f024c490 con 0x5647f0360170 2024-08-20T05:07:10.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.442+0000 7f8e60c00640 10 client.16506 handle_command_reply: tid=0 2024-08-20T05:07:10.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.442+0000 7f8e7c423740 1 client.16506 shutdown 2024-08-20T05:07:10.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.442+0000 7f8e7c423740 1 -- 172.21.15.37:0/2268831694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02d9260 msgr2=0x5647f02eaf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.442+0000 7f8e7c423740 1 --2- 172.21.15.37:0/2268831694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02d9260 0x5647f02eaf00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0c7720 tx=0x7f8e6c045ce0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.443+0000 7f8e7c423740 1 -- 172.21.15.37:0/2268831694 shutdown_connections 2024-08-20T05:07:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.443+0000 7f8e7c423740 1 --2- 172.21.15.37:0/2268831694 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5647f0360170 0x5647f0362590 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.443+0000 7f8e7c423740 1 --2- 172.21.15.37:0/2268831694 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647f02e51f0 0x5647f02eb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.443+0000 7f8e7c423740 1 --2- 172.21.15.37:0/2268831694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647f02d9260 0x5647f02eaf00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.443+0000 7f8e7c423740 1 --2- 172.21.15.37:0/2268831694 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647f02d8940 0x5647f02ed9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.443+0000 7f8e7c423740 1 -- 172.21.15.37:0/2268831694 >> 172.21.15.37:0/2268831694 conn(0x5647f02d6770 msgr2=0x5647f02d5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.443+0000 7f8e60c00640 0 client.16506 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:07:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.443+0000 7f8e7c423740 1 -- 172.21.15.37:0/2268831694 shutdown_connections 2024-08-20T05:07:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.443+0000 7f8e7c423740 1 -- 172.21.15.37:0/2268831694 wait complete. 2024-08-20T05:07:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.444+0000 7f8e7c423740 20 client.16506 trim_cache size 0 max 16384 2024-08-20T05:07:10.447 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:07:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.446+0000 7f8e79800640 1 -- 172.21.15.37:0/4099599626 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8e540b3d20 msgr2=0x7f8e540b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.446+0000 7f8e79800640 1 --2- 172.21.15.37:0/4099599626 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8e540b3d20 0x7f8e540b61e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x5647f02d7650 tx=0x7f8e5c009620 comp rx=0 tx=0).stop 2024-08-20T05:07:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.446+0000 7f8e79800640 1 -- 172.21.15.37:0/4099599626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e741084a0 msgr2=0x7f8e74110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.446+0000 7f8e79800640 1 --2- 172.21.15.37:0/4099599626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e741084a0 0x7f8e74110340 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0319a0 tx=0x7f8e6c009870 comp rx=0 tx=0).stop 2024-08-20T05:07:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.446+0000 7f8e79800640 1 -- 172.21.15.37:0/4099599626 shutdown_connections 2024-08-20T05:07:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.446+0000 7f8e79800640 1 --2- 172.21.15.37:0/4099599626 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8e540b3d20 0x7f8e540b61e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.447+0000 7f8e79800640 1 --2- 172.21.15.37:0/4099599626 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e74108e20 0x7f8e74110880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.447+0000 7f8e79800640 1 --2- 172.21.15.37:0/4099599626 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e741084a0 0x7f8e74110340 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.447+0000 7f8e79800640 1 --2- 172.21.15.37:0/4099599626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e74102a90 0x7f8e7410fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.447+0000 7f8e79800640 1 -- 172.21.15.37:0/4099599626 >> 172.21.15.37:0/4099599626 conn(0x7f8e740fe540 msgr2=0x7f8e74100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:10.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.447+0000 7f8e79800640 1 -- 172.21.15.37:0/4099599626 shutdown_connections 2024-08-20T05:07:10.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:10.447+0000 7f8e79800640 1 -- 172.21.15.37:0/4099599626 wait complete. 2024-08-20T05:07:11.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:11 smithi037 ceph-mon[17265]: pgmap v549: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 927 op/s 2024-08-20T05:07:11.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:11 smithi135 ceph-mon[22342]: pgmap v549: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 927 op/s 2024-08-20T05:07:11.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:11 smithi130 ceph-mon[22007]: pgmap v549: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 927 op/s 2024-08-20T05:07:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.776+0000 7fe0e2e00640 1 -- 172.21.15.37:0/913347952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0dc106160 msgr2=0x7fe0dc106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:11.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.776+0000 7fe0e2e00640 1 --2- 172.21.15.37:0/913347952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0dc106160 0x7fe0dc106610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009ca0 tx=0x7fe0d402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.778+0000 7fe0e2e00640 1 -- 172.21.15.37:0/913347952 shutdown_connections 2024-08-20T05:07:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.778+0000 7fe0e2e00640 1 --2- 172.21.15.37:0/913347952 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0dc106160 0x7fe0dc106610 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.778+0000 7fe0e2e00640 1 --2- 172.21.15.37:0/913347952 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc1035b0 0x7fe0dc105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.778+0000 7fe0e2e00640 1 --2- 172.21.15.37:0/913347952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0dc06b990 0x7fe0dc103020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.778+0000 7fe0e2e00640 1 -- 172.21.15.37:0/913347952 >> 172.21.15.37:0/913347952 conn(0x7fe0dc0fce20 msgr2=0x7fe0dc0ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:11.780 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.778+0000 7fe0e2e00640 1 -- 172.21.15.37:0/913347952 shutdown_connections 2024-08-20T05:07:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.778+0000 7fe0e2e00640 1 -- 172.21.15.37:0/913347952 wait complete. 2024-08-20T05:07:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.779+0000 7fe0e2e00640 1 Processor -- start 2024-08-20T05:07:11.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.780+0000 7fe0e2e00640 1 -- start start 2024-08-20T05:07:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.780+0000 7fe0e2e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc06b990 0x7fe0dc19eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.780+0000 7fe0e2e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0dc1035b0 0x7fe0dc19f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.780+0000 7fe0e2e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0dc106160 0x7fe0dc1a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.780+0000 7fe0e2e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1148f0 con 0x7fe0dc106160 2024-08-20T05:07:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.780+0000 7fe0e2e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc114770 con 0x7fe0dc1035b0 2024-08-20T05:07:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.780+0000 7fe0e2e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc114a70 con 0x7fe0dc06b990 2024-08-20T05:07:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.781+0000 7fe0dbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc06b990 0x7fe0dc19eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.781+0000 7fe0dbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc06b990 0x7fe0dc19eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41260/0 (socket says 172.21.15.37:41260) 2024-08-20T05:07:11.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.781+0000 7fe0dbe00640 1 -- 172.21.15.37:0/2224627920 learned_addr learned my addr 172.21.15.37:0/2224627920 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.781+0000 7fe0dbe00640 1 -- 172.21.15.37:0/2224627920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0dc1035b0 msgr2=0x7fe0dc19f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.781+0000 7fe0dbe00640 1 --2- 172.21.15.37:0/2224627920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0dc1035b0 0x7fe0dc19f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.781+0000 7fe0dbe00640 1 -- 172.21.15.37:0/2224627920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0dc106160 msgr2=0x7fe0dc1a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.781+0000 7fe0dbe00640 1 --2- 172.21.15.37:0/2224627920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0dc106160 0x7fe0dc1a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.781+0000 7fe0dbe00640 1 -- 172.21.15.37:0/2224627920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc1a0b30 con 0x7fe0dc06b990 2024-08-20T05:07:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.782+0000 7fe0dbe00640 1 --2- 172.21.15.37:0/2224627920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc06b990 0x7fe0dc19eff0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00e9f0 tx=0x7fe0cc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.782+0000 7fe0d8c00640 1 -- 172.21.15.37:0/2224627920 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc00cd80 con 0x7fe0dc06b990 2024-08-20T05:07:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.782+0000 7fe0d8c00640 1 -- 172.21.15.37:0/2224627920 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0cc0108e0 con 0x7fe0dc06b990 2024-08-20T05:07:11.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.782+0000 7fe0d8c00640 1 -- 172.21.15.37:0/2224627920 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc018860 con 0x7fe0dc06b990 2024-08-20T05:07:11.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.784+0000 7fe0e2e00640 1 -- 172.21.15.37:0/2224627920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0dc1a0e20 con 0x7fe0dc06b990 2024-08-20T05:07:11.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.784+0000 7fe0e2e00640 1 -- 172.21.15.37:0/2224627920 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc1a74f0 con 0x7fe0dc06b990 2024-08-20T05:07:11.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.800+0000 7fe0e5c14740 1 Processor -- start 2024-08-20T05:07:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.800+0000 7fe0e5c14740 1 -- start start 2024-08-20T05:07:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.800+0000 7fe0e5c14740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548986610 0x55f548988a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.800+0000 7fe0e5c14740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548988f40 0x55f54898b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.800+0000 7fe0e5c14740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 0x55f54898de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.800+0000 7fe0e5c14740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f5488f9210 con 0x55f548986610 2024-08-20T05:07:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.800+0000 7fe0e5c14740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f5488e8710 con 0x55f54898b980 2024-08-20T05:07:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.800+0000 7fe0e5c14740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f5488ec750 con 0x55f548988f40 2024-08-20T05:07:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.801+0000 7fe0db400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 0x55f54898de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.801+0000 7fe0db400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 0x55f54898de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:54602/0 (socket says 172.21.15.37:54602) 2024-08-20T05:07:11.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.801+0000 7fe0db400640 1 -- 172.21.15.37:0/1328114410 learned_addr learned my addr 172.21.15.37:0/1328114410 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.802+0000 7fe0d8c00640 1 -- 172.21.15.37:0/2224627920 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe0cc010430 con 0x7fe0dc06b990 2024-08-20T05:07:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.802+0000 7fe0db400640 1 -- 172.21.15.37:0/1328114410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548988f40 msgr2=0x55f54898b330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:07:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.804+0000 7fe0d8c00640 1 --2- 172.21.15.37:0/2224627920 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe0c00b3cd0 0x7fe0c00b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.806+0000 7fe0dbe00640 1 --2- 172.21.15.37:0/1328114410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548988f40 0x55f54898b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:11.808 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.806+0000 7fe0db400640 1 --2- 172.21.15.37:0/1328114410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548988f40 0x55f54898b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.806+0000 7fe0db400640 1 -- 172.21.15.37:0/1328114410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548986610 msgr2=0x55f548988a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.806+0000 7fe0db400640 1 --2- 172.21.15.37:0/1328114410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548986610 0x55f548988a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.806+0000 7fe0db400640 1 -- 172.21.15.37:0/1328114410 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5488b4de0 con 0x55f54898b980 2024-08-20T05:07:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.806+0000 7fe0dbe00640 1 --2- 172.21.15.37:0/1328114410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548988f40 0x55f54898b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.806+0000 7fe0db400640 1 --2- 172.21.15.37:0/1328114410 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 0x55f54898de40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009c40 tx=0x7fe0c800e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9145261a607ef3b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:11.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.807+0000 7fe0d1600640 1 -- 172.21.15.37:0/1328114410 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8005020 con 0x55f54898b980 2024-08-20T05:07:11.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.807+0000 7fe0d1600640 1 -- 172.21.15.37:0/1328114410 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0c80047a0 con 0x55f54898b980 2024-08-20T05:07:11.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.807+0000 7fe0d8c00640 1 -- 172.21.15.37:0/2224627920 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe0cc0e46c0 con 0x7fe0dc06b990 2024-08-20T05:07:11.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.808+0000 7fe0e0e00640 1 --2- 172.21.15.37:0/2224627920 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe0c00b3cd0 0x7fe0c00b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:11.811 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.809+0000 7fe0d1600640 1 -- 172.21.15.37:0/1328114410 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8010690 con 0x55f54898b980 2024-08-20T05:07:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.810+0000 7fe0e5c14740 1 -- 172.21.15.37:0/1328114410 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 msgr2=0x55f54898de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.810+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/1328114410 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 0x55f54898de40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009c40 tx=0x7fe0c800e720 comp rx=0 tx=0).stop 2024-08-20T05:07:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.810+0000 7fe0e5c14740 1 -- 172.21.15.37:0/1328114410 shutdown_connections 2024-08-20T05:07:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.810+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/1328114410 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 0x55f54898de40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.810+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/1328114410 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548988f40 0x55f54898b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.810+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/1328114410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548986610 0x55f548988a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.810+0000 7fe0e5c14740 1 -- 172.21.15.37:0/1328114410 >> 172.21.15.37:0/1328114410 conn(0x55f548981760 msgr2=0x55f5489824f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.811+0000 7fe0e0e00640 1 --2- 172.21.15.37:0/2224627920 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe0c00b3cd0 0x7fe0c00b6190 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009430 tx=0x7fe0d4031f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.811+0000 7fe0e5c14740 1 -- 172.21.15.37:0/1328114410 shutdown_connections 2024-08-20T05:07:11.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.811+0000 7fe0e5c14740 1 -- 172.21.15.37:0/1328114410 wait complete. 2024-08-20T05:07:11.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.812+0000 7fe0e5c14740 1 -- start start 2024-08-20T05:07:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.813+0000 7fe0e5c14740 1 Processor -- start 2024-08-20T05:07:11.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.813+0000 7fe0e5c14740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548986610 0x55f5489a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.814+0000 7fe0e5c14740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548988f40 0x55f5489a1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.814+0000 7fe0e5c14740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 0x55f5489a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.814+0000 7fe0dbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548986610 0x55f5489a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:11.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.815+0000 7fe0dbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548986610 0x55f5489a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39692/0 (socket says 172.21.15.37:39692) 2024-08-20T05:07:11.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.815+0000 7fe0db400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548988f40 0x55f5489a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.815+0000 7fe0db400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548988f40 0x55f5489a1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41288/0 (socket says 172.21.15.37:41288) 2024-08-20T05:07:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.815+0000 7fe0dbe00640 1 -- 172.21.15.37:0/742678501 learned_addr learned my addr 172.21.15.37:0/742678501 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.815+0000 7fe0e5c14740 1 -- 172.21.15.37:0/742678501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f548821ab0 con 0x55f548986610 2024-08-20T05:07:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.815+0000 7fe0e5c14740 1 -- 172.21.15.37:0/742678501 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f54888f140 con 0x55f54898b980 2024-08-20T05:07:11.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.815+0000 7fe0e5c14740 1 -- 172.21.15.37:0/742678501 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f54899f970 con 0x55f548988f40 2024-08-20T05:07:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.815+0000 7fe0e5c14740 10 client.0 _ll_register_callbacks cb 0x55f5488a25d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.815+0000 7fe0e0e00640 1 --2- 172.21.15.37:0/742678501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 0x55f5489a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:11.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.816+0000 7fe0db400640 1 -- 172.21.15.37:0/742678501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 msgr2=0x55f5489a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.816+0000 7fe0db400640 1 --2- 172.21.15.37:0/742678501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 0x55f5489a1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.816+0000 7fe0db400640 1 -- 172.21.15.37:0/742678501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548986610 msgr2=0x55f5489a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.816+0000 7fe0db400640 1 --2- 172.21.15.37:0/742678501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548986610 0x55f5489a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.816+0000 7fe0db400640 1 -- 172.21.15.37:0/742678501 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f548890170 con 0x55f548988f40 2024-08-20T05:07:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.818+0000 7fe0db400640 1 --2- 172.21.15.37:0/742678501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548988f40 0x55f5489a1390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8006010 tx=0x7fe0c80098a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e067466736e4c717 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:11.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.818+0000 7fe0c6000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:07:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.819+0000 7fe0c6000640 1 -- 172.21.15.37:0/742678501 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8025020 con 0x55f548988f40 2024-08-20T05:07:11.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.820+0000 7fe0c6000640 1 -- 172.21.15.37:0/742678501 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe0c8004250 con 0x55f548988f40 2024-08-20T05:07:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.820+0000 7fe0e5c14740 1 -- 172.21.15.37:0/742678501 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0c80047a0 con 0x55f548988f40 2024-08-20T05:07:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.821+0000 7fe0c6000640 1 -- 172.21.15.37:0/742678501 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe0c8004450 con 0x55f548988f40 2024-08-20T05:07:11.822 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.821+0000 7fe0e5c14740 10 client.26797 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.821+0000 7fe0e5c14740 1 -- 172.21.15.37:0/742678501 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f54864b790 con 0x55f548988f40 2024-08-20T05:07:11.823 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.821+0000 7fe0c6000640 1 -- 172.21.15.37:0/742678501 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0c80047a0 con 0x55f548988f40 2024-08-20T05:07:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.824+0000 7fe0c6000640 1 -- 172.21.15.37:0/742678501 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fe0c8003ad0 con 0x55f548988f40 2024-08-20T05:07:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.824+0000 7fe0e5c14740 10 client.26797 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.824+0000 7fe0e5c14740 10 client.26797 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:07:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.824+0000 7fe0e5c14740 20 client.26797 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.824+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/742678501 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f5489ac590 0x55f5489ae980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.824+0000 7fe0e5c14740 4 client.26797 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:07:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.824+0000 7fe0e5c14740 1 -- 172.21.15.37:0/742678501 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5488fb160 con 0x55f5489ac590 2024-08-20T05:07:11.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.824+0000 7fe0dbe00640 1 --2- 172.21.15.37:0/742678501 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f5489ac590 0x55f5489ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.825+0000 7fe0c6000640 10 client.26797 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:11.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.825+0000 7fe0dbe00640 1 --2- 172.21.15.37:0/742678501 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f5489ac590 0x55f5489ae980 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb0d135322aed23b server_cookie=b38c1dd699c828dd in_seq=0 out_seq=0 2024-08-20T05:07:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.827+0000 7fe0c6000640 1 -- 172.21.15.37:0/742678501 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f5488fb160 con 0x55f5489ac590 2024-08-20T05:07:11.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.827+0000 7fe0c6000640 10 client.26797 handle_command_reply: tid=0 2024-08-20T05:07:11.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.828+0000 7fe0e5c14740 1 client.26797 shutdown 2024-08-20T05:07:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.829+0000 7fe0e5c14740 1 -- 172.21.15.37:0/742678501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548988f40 msgr2=0x55f5489a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:11.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.829+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/742678501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548988f40 0x55f5489a1390 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8006010 tx=0x7fe0c80098a0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.831+0000 7fe0e5c14740 1 -- 172.21.15.37:0/742678501 shutdown_connections 2024-08-20T05:07:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.831+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/742678501 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f5489ac590 0x55f5489ae980 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.831+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/742678501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 0x55f5489a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.831+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/742678501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548988f40 0x55f5489a1390 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.831+0000 7fe0c6000640 0 client.26797 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.831+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/742678501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548986610 0x55f5489a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.831+0000 7fe0e5c14740 1 -- 172.21.15.37:0/742678501 >> 172.21.15.37:0/742678501 conn(0x55f548981760 msgr2=0x55f548980760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.831+0000 7fe0e5c14740 1 -- 172.21.15.37:0/742678501 shutdown_connections 2024-08-20T05:07:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.831+0000 7fe0e5c14740 1 -- 172.21.15.37:0/742678501 wait complete. 2024-08-20T05:07:11.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.832+0000 7fe0e5c14740 20 client.26797 trim_cache size 0 max 16384 2024-08-20T05:07:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.864+0000 7fe0e5c14740 1 Processor -- start 2024-08-20T05:07:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.864+0000 7fe0e5c14740 1 -- start start 2024-08-20T05:07:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.864+0000 7fe0e5c14740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f548986610 0x55f5489a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.864+0000 7fe0e5c14740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548988f40 0x55f5489a1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.864+0000 7fe0e5c14740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f54898b980 0x55f54898c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.864+0000 7fe0e5c14740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1a91a0 con 0x55f548988f40 2024-08-20T05:07:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.864+0000 7fe0e5c14740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1aace0 con 0x55f548986610 2024-08-20T05:07:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.864+0000 7fe0e5c14740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1a9870 con 0x55f54898b980 2024-08-20T05:07:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.864+0000 7fe0dbe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f548986610 0x55f5489a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.865+0000 7fe0db400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548988f40 0x55f5489a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.865+0000 7fe0dbe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f548986610 0x55f5489a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:54624/0 (socket says 172.21.15.37:54624) 2024-08-20T05:07:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.865+0000 7fe0dbe00640 1 -- 172.21.15.37:0/3716035171 learned_addr learned my addr 172.21.15.37:0/3716035171 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:11.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.865+0000 7fe0dbe00640 1 -- 172.21.15.37:0/3716035171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f54898b980 msgr2=0x55f54898c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.865+0000 7fe0dbe00640 1 --2- 172.21.15.37:0/3716035171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f54898b980 0x55f54898c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.865+0000 7fe0dbe00640 1 -- 172.21.15.37:0/3716035171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548988f40 msgr2=0x55f5489a1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.865+0000 7fe0dbe00640 1 --2- 172.21.15.37:0/3716035171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548988f40 0x55f5489a1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.865+0000 7fe0dbe00640 1 -- 172.21.15.37:0/3716035171 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5486c4620 con 0x55f548986610 2024-08-20T05:07:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.865+0000 7fe0db400640 1 --2- 172.21.15.37:0/3716035171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548988f40 0x55f5489a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:07:11.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.866+0000 7fe0dbe00640 1 --2- 172.21.15.37:0/3716035171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f548986610 0x55f5489a0cf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00e9c0 tx=0x7fe0cc009590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da3aecb73c2dc3e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.866+0000 7fe0d0c00640 1 -- 172.21.15.37:0/3716035171 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0b42c0 con 0x55f548986610 2024-08-20T05:07:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.866+0000 7fe0d0c00640 1 -- 172.21.15.37:0/3716035171 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0cc0e1ed0 con 0x55f548986610 2024-08-20T05:07:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.866+0000 7fe0d0c00640 1 -- 172.21.15.37:0/3716035171 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc0e7bc0 con 0x55f548986610 2024-08-20T05:07:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.867+0000 7fe0e5c14740 1 -- 172.21.15.37:0/3716035171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f548986610 msgr2=0x55f5489a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:11.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.867+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/3716035171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f548986610 0x55f5489a0cf0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00e9c0 tx=0x7fe0cc009590 comp rx=0 tx=0).stop 2024-08-20T05:07:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.868+0000 7fe0e5c14740 1 -- 172.21.15.37:0/3716035171 shutdown_connections 2024-08-20T05:07:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.868+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/3716035171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f54898b980 0x55f54898c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.868+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/3716035171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548988f40 0x55f5489a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.868+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/3716035171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f548986610 0x55f5489a0cf0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.868+0000 7fe0e5c14740 1 -- 172.21.15.37:0/3716035171 >> 172.21.15.37:0/3716035171 conn(0x55f548981760 msgr2=0x55f548985a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.868+0000 7fe0e5c14740 1 -- 172.21.15.37:0/3716035171 shutdown_connections 2024-08-20T05:07:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.868+0000 7fe0e5c14740 1 -- 172.21.15.37:0/3716035171 wait complete. 2024-08-20T05:07:11.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.868+0000 7fe0e5c14740 1 -- start start 2024-08-20T05:07:11.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.869+0000 7fe0e5c14740 1 Processor -- start 2024-08-20T05:07:11.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.871+0000 7fe0e5c14740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548986610 0x55f5489a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.871+0000 7fe0e5c14740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548988f40 0x55f5489a6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.871+0000 7fe0e5c14740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 0x55f5489a6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.871+0000 7fe0e5c14740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1aa610 con 0x55f548988f40 2024-08-20T05:07:11.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.871+0000 7fe0e5c14740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1a9f40 con 0x55f54898b980 2024-08-20T05:07:11.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.871+0000 7fe0e5c14740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc074ac0 con 0x55f548986610 2024-08-20T05:07:11.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.871+0000 7fe0e5c14740 10 client.0 _ll_register_callbacks cb 0x7fe0c8009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:11.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.872+0000 7fe0db400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548988f40 0x55f5489a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:11.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.872+0000 7fe0e0e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 0x55f5489a6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:11.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.872+0000 7fe0e0e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 0x55f5489a6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:54636/0 (socket says 172.21.15.37:54636) 2024-08-20T05:07:11.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.872+0000 7fe0e0e00640 1 -- 172.21.15.37:0/3493285494 learned_addr learned my addr 172.21.15.37:0/3493285494 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:11.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.872+0000 7fe0dbe00640 1 --2- 172.21.15.37:0/3493285494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548986610 0x55f5489a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.873+0000 7fe0e0e00640 1 -- 172.21.15.37:0/3493285494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548986610 msgr2=0x55f5489a5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.873+0000 7fe0e0e00640 1 --2- 172.21.15.37:0/3493285494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548986610 0x55f5489a5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.873+0000 7fe0e0e00640 1 -- 172.21.15.37:0/3493285494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548988f40 msgr2=0x55f5489a6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.873+0000 7fe0e0e00640 1 --2- 172.21.15.37:0/3493285494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548988f40 0x55f5489a6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.873+0000 7fe0e0e00640 1 -- 172.21.15.37:0/3493285494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5489a74e0 con 0x55f54898b980 2024-08-20T05:07:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.874+0000 7fe0dbe00640 1 --2- 172.21.15.37:0/3493285494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548986610 0x55f5489a5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:11.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.874+0000 7fe0db400640 1 --2- 172.21.15.37:0/3493285494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548988f40 0x55f5489a6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:07:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.875+0000 7fe0e0e00640 1 --2- 172.21.15.37:0/3493285494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 0x55f5489a6cb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009ca0 tx=0x7fe0d4030990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=976c04b98ba6b0fc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.875+0000 7fe0c6000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:07:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.876+0000 7fe0c6000640 1 -- 172.21.15.37:0/3493285494 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4047830 con 0x55f54898b980 2024-08-20T05:07:11.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.876+0000 7fe0e5c14740 1 -- 172.21.15.37:0/3493285494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0cc0e1ed0 con 0x55f54898b980 2024-08-20T05:07:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.877+0000 7fe0c6000640 1 -- 172.21.15.37:0/3493285494 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe0d4047630 con 0x55f54898b980 2024-08-20T05:07:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.877+0000 7fe0c6000640 1 -- 172.21.15.37:0/3493285494 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe0d4047830 con 0x55f54898b980 2024-08-20T05:07:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.877+0000 7fe0e5c14740 10 client.26777 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:11.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.877+0000 7fe0e5c14740 1 -- 172.21.15.37:0/3493285494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f5489a8940 con 0x55f54898b980 2024-08-20T05:07:11.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.878+0000 7fe0c6000640 1 -- 172.21.15.37:0/3493285494 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe0cc0e1ed0 con 0x55f54898b980 2024-08-20T05:07:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.879+0000 7fe0c6000640 1 -- 172.21.15.37:0/3493285494 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fe0d404f070 con 0x55f54898b980 2024-08-20T05:07:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.879+0000 7fe0e5c14740 10 client.26777 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.879+0000 7fe0e5c14740 10 client.26777 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:07:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.879+0000 7fe0e5c14740 20 client.26777 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:11.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.879+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/3493285494 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f548a17110 0x55f548a19500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.879+0000 7fe0e5c14740 4 client.26777 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:07:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.879+0000 7fe0e5c14740 1 -- 172.21.15.37:0/3493285494 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f5488f6c00 con 0x55f548a17110 2024-08-20T05:07:11.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.880+0000 7fe0dbe00640 1 --2- 172.21.15.37:0/3493285494 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f548a17110 0x55f548a19500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.880+0000 7fe0dbe00640 1 --2- 172.21.15.37:0/3493285494 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f548a17110 0x55f548a19500 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62a62a438baa6f72 server_cookie=737f409680d76db8 in_seq=0 out_seq=0 2024-08-20T05:07:11.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.881+0000 7fe0c6000640 10 client.26777 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:11.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.918+0000 7fe0c6000640 1 -- 172.21.15.37:0/3493285494 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f5488f6c00 con 0x55f548a17110 2024-08-20T05:07:11.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.918+0000 7fe0c6000640 10 client.26777 handle_command_reply: tid=0 2024-08-20T05:07:11.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.918+0000 7fe0e5c14740 1 client.26777 shutdown 2024-08-20T05:07:11.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.919+0000 7fe0e5c14740 1 -- 172.21.15.37:0/3493285494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 msgr2=0x55f5489a6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.919+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/3493285494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 0x55f5489a6cb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009ca0 tx=0x7fe0d4030990 comp rx=0 tx=0).stop 2024-08-20T05:07:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.919+0000 7fe0e5c14740 1 -- 172.21.15.37:0/3493285494 shutdown_connections 2024-08-20T05:07:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.919+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/3493285494 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f548a17110 0x55f548a19500 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.919+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/3493285494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f54898b980 0x55f5489a6cb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.919+0000 7fe0c6000640 0 client.26777 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.919+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/3493285494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f548988f40 0x55f5489a6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.919+0000 7fe0e5c14740 1 --2- 172.21.15.37:0/3493285494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f548986610 0x55f5489a5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.920+0000 7fe0e5c14740 1 -- 172.21.15.37:0/3493285494 >> 172.21.15.37:0/3493285494 conn(0x55f548981760 msgr2=0x55f54897ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.920+0000 7fe0e5c14740 1 -- 172.21.15.37:0/3493285494 shutdown_connections 2024-08-20T05:07:11.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.920+0000 7fe0e5c14740 1 -- 172.21.15.37:0/3493285494 wait complete. 2024-08-20T05:07:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.920+0000 7fe0e5c14740 20 client.26777 trim_cache size 0 max 16384 2024-08-20T05:07:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:07:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:07:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:07:11.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:07:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.922+0000 7fe0e2e00640 1 -- 172.21.15.37:0/2224627920 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe0c00b3cd0 msgr2=0x7fe0c00b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.922+0000 7fe0e2e00640 1 --2- 172.21.15.37:0/2224627920 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe0c00b3cd0 0x7fe0c00b6190 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009430 tx=0x7fe0d4031f90 comp rx=0 tx=0).stop 2024-08-20T05:07:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.922+0000 7fe0e2e00640 1 -- 172.21.15.37:0/2224627920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc06b990 msgr2=0x7fe0dc19eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.922+0000 7fe0e2e00640 1 --2- 172.21.15.37:0/2224627920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc06b990 0x7fe0dc19eff0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00e9f0 tx=0x7fe0cc00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.922+0000 7fe0e2e00640 1 -- 172.21.15.37:0/2224627920 shutdown_connections 2024-08-20T05:07:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.922+0000 7fe0e2e00640 1 --2- 172.21.15.37:0/2224627920 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe0c00b3cd0 0x7fe0c00b6190 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.922+0000 7fe0e2e00640 1 --2- 172.21.15.37:0/2224627920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0dc106160 0x7fe0dc1a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.922+0000 7fe0e2e00640 1 --2- 172.21.15.37:0/2224627920 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe0dc1035b0 0x7fe0dc19f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.922+0000 7fe0e2e00640 1 --2- 172.21.15.37:0/2224627920 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe0dc06b990 0x7fe0dc19eff0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.922+0000 7fe0e2e00640 1 -- 172.21.15.37:0/2224627920 >> 172.21.15.37:0/2224627920 conn(0x7fe0dc0fce20 msgr2=0x7fe0dc101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.922+0000 7fe0e2e00640 1 -- 172.21.15.37:0/2224627920 shutdown_connections 2024-08-20T05:07:11.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:11.922+0000 7fe0e2e00640 1 -- 172.21.15.37:0/2224627920 wait complete. 2024-08-20T05:07:12.149 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T05:07:12.845 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:07:13.042 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 255.0 s, 1101.8 tps, lat 88.107 ms stddev 95.915 2024-08-20T05:07:13.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:13 smithi135 ceph-mon[22342]: pgmap v550: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 882 op/s 2024-08-20T05:07:13.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.614+0000 7fb235600640 1 -- 172.21.15.37:0/4217151301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2301090e0 msgr2=0x7fb2301094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:13.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.614+0000 7fb235600640 1 --2- 172.21.15.37:0/4217151301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2301090e0 0x7fb2301094c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb220009900 tx=0x7fb22002a410 comp rx=0 tx=0).stop 2024-08-20T05:07:13.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.615+0000 7fb235600640 1 -- 172.21.15.37:0/4217151301 shutdown_connections 2024-08-20T05:07:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.615+0000 7fb235600640 1 --2- 172.21.15.37:0/4217151301 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb23010f470 0x7fb230115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.615+0000 7fb235600640 1 --2- 172.21.15.37:0/4217151301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb23010eaf0 0x7fb23010ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.615+0000 7fb235600640 1 --2- 172.21.15.37:0/4217151301 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2301090e0 0x7fb2301094c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.615+0000 7fb235600640 1 -- 172.21.15.37:0/4217151301 >> 172.21.15.37:0/4217151301 conn(0x7fb230078760 msgr2=0x7fb23007ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:13.618 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:13 smithi037 ceph-mon[17265]: pgmap v550: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 882 op/s 2024-08-20T05:07:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.616+0000 7fb235600640 1 -- 172.21.15.37:0/4217151301 shutdown_connections 2024-08-20T05:07:13.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.616+0000 7fb235600640 1 -- 172.21.15.37:0/4217151301 wait complete. 2024-08-20T05:07:13.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.618+0000 7fb235600640 1 Processor -- start 2024-08-20T05:07:13.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.618+0000 7fb235600640 1 -- start start 2024-08-20T05:07:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.619+0000 7fb235600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2301090e0 0x7fb23019f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.619+0000 7fb235600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb23010eaf0 0x7fb23019faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.619+0000 7fb235600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb23010f470 0x7fb2301a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.619+0000 7fb235600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2301190d0 con 0x7fb23010f470 2024-08-20T05:07:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.619+0000 7fb235600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb230118f50 con 0x7fb2301090e0 2024-08-20T05:07:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.619+0000 7fb235600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb230119250 con 0x7fb23010eaf0 2024-08-20T05:07:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.619+0000 7fb22e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb23010eaf0 0x7fb23019faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.619+0000 7fb22e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb23010eaf0 0x7fb23019faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52450/0 (socket says 172.21.15.37:52450) 2024-08-20T05:07:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.619+0000 7fb22e000640 1 -- 172.21.15.37:0/3156896930 learned_addr learned my addr 172.21.15.37:0/3156896930 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.619+0000 7fb22ea00640 1 --2- 172.21.15.37:0/3156896930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2301090e0 0x7fb23019f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.619+0000 7fb22f400640 1 --2- 172.21.15.37:0/3156896930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb23010f470 0x7fb2301a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.620+0000 7fb22ea00640 1 -- 172.21.15.37:0/3156896930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb23010eaf0 msgr2=0x7fb23019faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.620+0000 7fb22ea00640 1 --2- 172.21.15.37:0/3156896930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb23010eaf0 0x7fb23019faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.620+0000 7fb22ea00640 1 -- 172.21.15.37:0/3156896930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb23010f470 msgr2=0x7fb2301a4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.620+0000 7fb22ea00640 1 --2- 172.21.15.37:0/3156896930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb23010f470 0x7fb2301a4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.620+0000 7fb22ea00640 1 -- 172.21.15.37:0/3156896930 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2301a5610 con 0x7fb2301090e0 2024-08-20T05:07:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.620+0000 7fb22f400640 1 --2- 172.21.15.37:0/3156896930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb23010f470 0x7fb2301a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:07:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.621+0000 7fb22ea00640 1 --2- 172.21.15.37:0/3156896930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2301090e0 0x7fb23019f560 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb22002aa00 tx=0x7fb220003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:13.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.623+0000 7fb227400640 1 -- 172.21.15.37:0/3156896930 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22003f070 con 0x7fb2301090e0 2024-08-20T05:07:13.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.624+0000 7fb227400640 1 -- 172.21.15.37:0/3156896930 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb220031b50 con 0x7fb2301090e0 2024-08-20T05:07:13.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.624+0000 7fb227400640 1 -- 172.21.15.37:0/3156896930 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220035030 con 0x7fb2301090e0 2024-08-20T05:07:13.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.624+0000 7fb235600640 1 -- 172.21.15.37:0/3156896930 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2301a58a0 con 0x7fb2301090e0 2024-08-20T05:07:13.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.625+0000 7fb235600640 1 -- 172.21.15.37:0/3156896930 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2301abfc0 con 0x7fb2301090e0 2024-08-20T05:07:13.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.630+0000 7fb227400640 1 -- 172.21.15.37:0/3156896930 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb220042070 con 0x7fb2301090e0 2024-08-20T05:07:13.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.632+0000 7fb227400640 1 --2- 172.21.15.37:0/3156896930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2140b3da0 0x7fb2140b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.632+0000 7fb23800c740 1 Processor -- start 2024-08-20T05:07:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.632+0000 7fb227400640 1 -- 172.21.15.37:0/3156896930 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb220104460 con 0x7fb2301090e0 2024-08-20T05:07:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.632+0000 7fb23800c740 1 -- start start 2024-08-20T05:07:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.633+0000 7fb22e000640 1 --2- 172.21.15.37:0/3156896930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2140b3da0 0x7fb2140b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.633+0000 7fb23800c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7948990 0x5619d7948d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.633+0000 7fb23800c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d79492b0 0x5619d7954d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.633+0000 7fb23800c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d7955240 0x5619d7957630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.633+0000 7fb23800c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5619d78beaa0 con 0x5619d7948990 2024-08-20T05:07:13.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.633+0000 7fb23800c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5619d78adfa0 con 0x5619d79492b0 2024-08-20T05:07:13.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.633+0000 7fb23800c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5619d78b1fe0 con 0x5619d7955240 2024-08-20T05:07:13.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.633+0000 7fb22ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7948990 0x5619d7948d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.633+0000 7fb22ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7948990 0x5619d7948d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58500/0 (socket says 172.21.15.37:58500) 2024-08-20T05:07:13.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.633+0000 7fb22ea00640 1 -- 172.21.15.37:0/4256995980 learned_addr learned my addr 172.21.15.37:0/4256995980 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:13.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.633+0000 7fb22e000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d79492b0 0x5619d7954d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.633+0000 7fb22f400640 1 --2- 172.21.15.37:0/4256995980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d7955240 0x5619d7957630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.634+0000 7fb22ea00640 1 -- 172.21.15.37:0/4256995980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d7955240 msgr2=0x5619d7957630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:13.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.634+0000 7fb22ea00640 1 --2- 172.21.15.37:0/4256995980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d7955240 0x5619d7957630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.634+0000 7fb22ea00640 1 -- 172.21.15.37:0/4256995980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d79492b0 msgr2=0x5619d7954d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:13.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.634+0000 7fb22ea00640 1 --2- 172.21.15.37:0/4256995980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d79492b0 0x5619d7954d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.634+0000 7fb22ea00640 1 -- 172.21.15.37:0/4256995980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619d7854420 con 0x5619d7948990 2024-08-20T05:07:13.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.634+0000 7fb22ea00640 1 --2- 172.21.15.37:0/4256995980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7948990 0x5619d7948d70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb2200caf40 tx=0x7fb22002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720f5651519c654d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:13.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.635+0000 7fb21b400640 1 -- 172.21.15.37:0/4256995980 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220049040 con 0x5619d7948990 2024-08-20T05:07:13.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.635+0000 7fb21b400640 1 -- 172.21.15.37:0/4256995980 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb220031d00 con 0x5619d7948990 2024-08-20T05:07:13.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.635+0000 7fb21b400640 1 -- 172.21.15.37:0/4256995980 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2200c7240 con 0x5619d7948990 2024-08-20T05:07:13.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.636+0000 7fb23800c740 1 -- 172.21.15.37:0/4256995980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7948990 msgr2=0x5619d7948d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:13.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.636+0000 7fb23800c740 1 --2- 172.21.15.37:0/4256995980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7948990 0x5619d7948d70 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb2200caf40 tx=0x7fb22002a410 comp rx=0 tx=0).stop 2024-08-20T05:07:13.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.639+0000 7fb23800c740 1 -- 172.21.15.37:0/4256995980 shutdown_connections 2024-08-20T05:07:13.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.639+0000 7fb23800c740 1 --2- 172.21.15.37:0/4256995980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d7955240 0x5619d7957630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.639+0000 7fb23800c740 1 --2- 172.21.15.37:0/4256995980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d79492b0 0x5619d7954d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.639+0000 7fb23800c740 1 --2- 172.21.15.37:0/4256995980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7948990 0x5619d7948d70 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.639+0000 7fb23800c740 1 -- 172.21.15.37:0/4256995980 >> 172.21.15.37:0/4256995980 conn(0x5619d79467c0 msgr2=0x5619d7947960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:13.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.639+0000 7fb22e000640 1 --2- 172.21.15.37:0/3156896930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2140b3da0 0x7fb2140b6260 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb21c004650 tx=0x7fb21c009bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:13.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.640+0000 7fb23800c740 1 -- 172.21.15.37:0/4256995980 shutdown_connections 2024-08-20T05:07:13.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.640+0000 7fb23800c740 1 -- 172.21.15.37:0/4256995980 wait complete. 2024-08-20T05:07:13.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.641+0000 7fb23800c740 1 -- start start 2024-08-20T05:07:13.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.641+0000 7fb23800c740 1 Processor -- start 2024-08-20T05:07:13.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.642+0000 7fb23800c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d7948990 0x5619d7954a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.642+0000 7fb23800c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d79492b0 0x5619d7951ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.642+0000 7fb23800c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7955240 0x5619d7952430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.642+0000 7fb23800c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5619d7710700 con 0x5619d7955240 2024-08-20T05:07:13.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.642+0000 7fb23800c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5619d7849290 con 0x5619d7948990 2024-08-20T05:07:13.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.642+0000 7fb23800c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5619d7957c80 con 0x5619d79492b0 2024-08-20T05:07:13.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.642+0000 7fb23800c740 10 client.0 _ll_register_callbacks cb 0x5619d78a81c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:13.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.642+0000 7fb22e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d79492b0 0x5619d7951ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.642+0000 7fb22e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d79492b0 0x5619d7951ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52472/0 (socket says 172.21.15.37:52472) 2024-08-20T05:07:13.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.642+0000 7fb22e000640 1 -- 172.21.15.37:0/3686759974 learned_addr learned my addr 172.21.15.37:0/3686759974 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:13.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.643+0000 7fb22ea00640 1 --2- 172.21.15.37:0/3686759974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d7948990 0x5619d7954a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.643+0000 7fb22f400640 1 --2- 172.21.15.37:0/3686759974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7955240 0x5619d7952430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.643+0000 7fb22e000640 1 -- 172.21.15.37:0/3686759974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d7948990 msgr2=0x5619d7954a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.643+0000 7fb22e000640 1 --2- 172.21.15.37:0/3686759974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d7948990 0x5619d7954a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.643+0000 7fb22e000640 1 -- 172.21.15.37:0/3686759974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7955240 msgr2=0x5619d7952430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:13.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.643+0000 7fb22e000640 1 --2- 172.21.15.37:0/3686759974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7955240 0x5619d7952430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.643+0000 7fb22e000640 1 -- 172.21.15.37:0/3686759974 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619d760d650 con 0x5619d79492b0 2024-08-20T05:07:13.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.643+0000 7fb22ea00640 1 --2- 172.21.15.37:0/3686759974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d7948990 0x5619d7954a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:13.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.644+0000 7fb22f400640 1 --2- 172.21.15.37:0/3686759974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7955240 0x5619d7952430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:13.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.644+0000 7fb22e000640 1 --2- 172.21.15.37:0/3686759974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d79492b0 0x5619d7951ed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0099c0 tx=0x7fb21c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd1489ccca76189 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:13.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.644+0000 7fb20fe00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:07:13.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.645+0000 7fb20fe00640 1 -- 172.21.15.37:0/3686759974 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c0132b0 con 0x5619d79492b0 2024-08-20T05:07:13.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.645+0000 7fb20fe00640 1 -- 172.21.15.37:0/3686759974 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb21c020430 con 0x5619d79492b0 2024-08-20T05:07:13.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.646+0000 7fb23800c740 1 -- 172.21.15.37:0/3686759974 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb220031d00 con 0x5619d79492b0 2024-08-20T05:07:13.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.647+0000 7fb20fe00640 1 -- 172.21.15.37:0/3686759974 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fb21c020630 con 0x5619d79492b0 2024-08-20T05:07:13.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.647+0000 7fb23800c740 10 client.26809 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:13.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.647+0000 7fb23800c740 1 -- 172.21.15.37:0/3686759974 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5619d79634e0 con 0x5619d79492b0 2024-08-20T05:07:13.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.647+0000 7fb20fe00640 1 -- 172.21.15.37:0/3686759974 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb220031d00 con 0x5619d79492b0 2024-08-20T05:07:13.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.647+0000 7fb20fe00640 1 -- 172.21.15.37:0/3686759974 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fb21c033020 con 0x5619d79492b0 2024-08-20T05:07:13.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.647+0000 7fb23800c740 10 client.26809 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:13.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.647+0000 7fb23800c740 10 client.26809 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:07:13.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.647+0000 7fb23800c740 20 client.26809 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:13.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.647+0000 7fb23800c740 1 --2- 172.21.15.37:0/3686759974 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5619d7964a40 0x5619d7966ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.647+0000 7fb23800c740 4 client.26809 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:07:13.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.647+0000 7fb23800c740 1 -- 172.21.15.37:0/3686759974 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619d78c09f0 con 0x5619d7964a40 2024-08-20T05:07:13.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.648+0000 7fb22ea00640 1 --2- 172.21.15.37:0/3686759974 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5619d7964a40 0x5619d7966ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.648+0000 7fb20fe00640 10 client.26809 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:07:13.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.649+0000 7fb22ea00640 1 --2- 172.21.15.37:0/3686759974 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5619d7964a40 0x5619d7966ec0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=493bc9e4c3999b44 server_cookie=e19d12c01803650f in_seq=0 out_seq=0 2024-08-20T05:07:13.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.650+0000 7fb20fe00640 1 -- 172.21.15.37:0/3686759974 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5619d78c09f0 con 0x5619d7964a40 2024-08-20T05:07:13.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.650+0000 7fb20fe00640 10 client.26809 handle_command_reply: tid=0 2024-08-20T05:07:13.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.653+0000 7fb23800c740 1 client.26809 shutdown 2024-08-20T05:07:13.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.654+0000 7fb23800c740 1 -- 172.21.15.37:0/3686759974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d79492b0 msgr2=0x5619d7951ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:13.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.654+0000 7fb23800c740 1 --2- 172.21.15.37:0/3686759974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d79492b0 0x5619d7951ed0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0099c0 tx=0x7fb21c004730 comp rx=0 tx=0).stop 2024-08-20T05:07:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.656+0000 7fb23800c740 1 -- 172.21.15.37:0/3686759974 shutdown_connections 2024-08-20T05:07:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.657+0000 7fb23800c740 1 --2- 172.21.15.37:0/3686759974 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5619d7964a40 0x5619d7966ec0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.657+0000 7fb23800c740 1 --2- 172.21.15.37:0/3686759974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7955240 0x5619d7952430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.657+0000 7fb23800c740 1 --2- 172.21.15.37:0/3686759974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d79492b0 0x5619d7951ed0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.657+0000 7fb23800c740 1 --2- 172.21.15.37:0/3686759974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d7948990 0x5619d7954a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.657+0000 7fb23800c740 1 -- 172.21.15.37:0/3686759974 >> 172.21.15.37:0/3686759974 conn(0x5619d79467c0 msgr2=0x5619d794c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:13.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.657+0000 7fb20fe00640 0 client.26809 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:07:13.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.658+0000 7fb23800c740 1 -- 172.21.15.37:0/3686759974 shutdown_connections 2024-08-20T05:07:13.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.658+0000 7fb23800c740 1 -- 172.21.15.37:0/3686759974 wait complete. 2024-08-20T05:07:13.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.658+0000 7fb23800c740 20 client.26809 trim_cache size 0 max 16384 2024-08-20T05:07:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.696+0000 7fb23800c740 1 Processor -- start 2024-08-20T05:07:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.696+0000 7fb23800c740 1 -- start start 2024-08-20T05:07:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.696+0000 7fb23800c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d7948990 0x5619d7950dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.696+0000 7fb23800c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d79492b0 0x5619d7953c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.696+0000 7fb23800c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d7955240 0x5619d796c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.696+0000 7fb23800c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2301b5d70 con 0x5619d79492b0 2024-08-20T05:07:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.696+0000 7fb23800c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb2301b78b0 con 0x5619d7955240 2024-08-20T05:07:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.696+0000 7fb23800c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb2301b6440 con 0x5619d7948990 2024-08-20T05:07:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.697+0000 7fb22f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d7955240 0x5619d796c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.697+0000 7fb22f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d7955240 0x5619d796c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43184/0 (socket says 172.21.15.37:43184) 2024-08-20T05:07:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.697+0000 7fb22f400640 1 -- 172.21.15.37:0/3647208451 learned_addr learned my addr 172.21.15.37:0/3647208451 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.697+0000 7fb22e000640 1 --2- 172.21.15.37:0/3647208451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d79492b0 0x5619d7953c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.697+0000 7fb22ea00640 1 --2- 172.21.15.37:0/3647208451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d7948990 0x5619d7950dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.698+0000 7fb22f400640 1 -- 172.21.15.37:0/3647208451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d7948990 msgr2=0x5619d7950dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.699+0000 7fb22f400640 1 --2- 172.21.15.37:0/3647208451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d7948990 0x5619d7950dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.699+0000 7fb22f400640 1 -- 172.21.15.37:0/3647208451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d79492b0 msgr2=0x5619d7953c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.699+0000 7fb22f400640 1 --2- 172.21.15.37:0/3647208451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d79492b0 0x5619d7953c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.699+0000 7fb22f400640 1 -- 172.21.15.37:0/3647208451 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619d79527a0 con 0x5619d7955240 2024-08-20T05:07:13.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.699+0000 7fb22e000640 1 --2- 172.21.15.37:0/3647208451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d79492b0 0x5619d7953c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:07:13.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.700+0000 7fb22ea00640 1 --2- 172.21.15.37:0/3647208451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d7948990 0x5619d7950dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:13.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.702+0000 7fb22f400640 1 --2- 172.21.15.37:0/3647208451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d7955240 0x5619d796c790 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb228012610 tx=0x7fb228012ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf97244f594892e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:13.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:13 smithi130 ceph-mon[22007]: pgmap v550: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 882 op/s 2024-08-20T05:07:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.703+0000 7fb21aa00640 1 -- 172.21.15.37:0/3647208451 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228004b20 con 0x5619d7955240 2024-08-20T05:07:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.703+0000 7fb21aa00640 1 -- 172.21.15.37:0/3647208451 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb228004cc0 con 0x5619d7955240 2024-08-20T05:07:13.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.703+0000 7fb21aa00640 1 -- 172.21.15.37:0/3647208451 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2280054d0 con 0x5619d7955240 2024-08-20T05:07:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.705+0000 7fb23800c740 1 -- 172.21.15.37:0/3647208451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d7955240 msgr2=0x5619d796c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.705+0000 7fb23800c740 1 --2- 172.21.15.37:0/3647208451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d7955240 0x5619d796c790 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb228012610 tx=0x7fb228012ad0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.705+0000 7fb23800c740 1 -- 172.21.15.37:0/3647208451 shutdown_connections 2024-08-20T05:07:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.705+0000 7fb23800c740 1 --2- 172.21.15.37:0/3647208451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d7955240 0x5619d796c790 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.705+0000 7fb23800c740 1 --2- 172.21.15.37:0/3647208451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d79492b0 0x5619d7953c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.705+0000 7fb23800c740 1 --2- 172.21.15.37:0/3647208451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d7948990 0x5619d7950dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.705+0000 7fb23800c740 1 -- 172.21.15.37:0/3647208451 >> 172.21.15.37:0/3647208451 conn(0x5619d79467c0 msgr2=0x5619d7953500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.705+0000 7fb23800c740 1 -- 172.21.15.37:0/3647208451 shutdown_connections 2024-08-20T05:07:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.705+0000 7fb23800c740 1 -- 172.21.15.37:0/3647208451 wait complete. 2024-08-20T05:07:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.706+0000 7fb23800c740 1 -- start start 2024-08-20T05:07:13.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.706+0000 7fb23800c740 1 Processor -- start 2024-08-20T05:07:13.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.707+0000 7fb23800c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7948990 0x5619d795a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.708+0000 7fb23800c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d79492b0 0x5619d795a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.708+0000 7fb23800c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d7955240 0x5619d79cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.708+0000 7fb23800c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2301b71e0 con 0x5619d7948990 2024-08-20T05:07:13.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.708+0000 7fb22ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7948990 0x5619d795a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.708+0000 7fb22e000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d79492b0 0x5619d795a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.710+0000 7fb22e000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d79492b0 0x5619d795a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43190/0 (socket says 172.21.15.37:43190) 2024-08-20T05:07:13.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.710+0000 7fb22e000640 1 -- 172.21.15.37:0/3619498827 learned_addr learned my addr 172.21.15.37:0/3619498827 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:13.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.710+0000 7fb22f400640 1 --2- 172.21.15.37:0/3619498827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d7955240 0x5619d79cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.711+0000 7fb23800c740 1 -- 172.21.15.37:0/3619498827 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb2301b6b10 con 0x5619d79492b0 2024-08-20T05:07:13.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.711+0000 7fb23800c740 1 -- 172.21.15.37:0/3619498827 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb2301b3d50 con 0x5619d7955240 2024-08-20T05:07:13.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.712+0000 7fb23800c740 10 client.0 _ll_register_callbacks cb 0x7fb21c009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:13.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.708+0000 7fb22ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7948990 0x5619d795a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58532/0 (socket says 172.21.15.37:58532) 2024-08-20T05:07:13.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.712+0000 7fb22e000640 1 -- 172.21.15.37:0/3619498827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d7955240 msgr2=0x5619d79cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:13.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.712+0000 7fb22e000640 1 --2- 172.21.15.37:0/3619498827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d7955240 0x5619d79cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.712+0000 7fb22e000640 1 -- 172.21.15.37:0/3619498827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7948990 msgr2=0x5619d795a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:13.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.712+0000 7fb22e000640 1 --2- 172.21.15.37:0/3619498827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7948990 0x5619d795a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.712+0000 7fb22e000640 1 -- 172.21.15.37:0/3619498827 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619d79cdca0 con 0x5619d79492b0 2024-08-20T05:07:13.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.713+0000 7fb22f400640 1 --2- 172.21.15.37:0/3619498827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d7955240 0x5619d79cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:07:13.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.713+0000 7fb22ea00640 1 --2- 172.21.15.37:0/3619498827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7948990 0x5619d795a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:07:13.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.714+0000 7fb22e000640 1 --2- 172.21.15.37:0/3619498827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d79492b0 0x5619d795a6f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb21c02b800 tx=0x7fb21c02bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eec8b63d3b49abb3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:13.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.714+0000 7fb20fe00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:07:13.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.714+0000 7fb20fe00640 1 -- 172.21.15.37:0/3619498827 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c05a030 con 0x5619d79492b0 2024-08-20T05:07:13.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.714+0000 7fb20fe00640 1 -- 172.21.15.37:0/3619498827 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb21c0132c0 con 0x5619d79492b0 2024-08-20T05:07:13.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.715+0000 7fb23800c740 1 -- 172.21.15.37:0/3619498827 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb228004cc0 con 0x5619d79492b0 2024-08-20T05:07:13.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.715+0000 7fb20fe00640 1 -- 172.21.15.37:0/3619498827 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fb21c005020 con 0x5619d79492b0 2024-08-20T05:07:13.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.716+0000 7fb23800c740 10 client.26792 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:13.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.716+0000 7fb23800c740 1 -- 172.21.15.37:0/3619498827 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5619d79ceec0 con 0x5619d79492b0 2024-08-20T05:07:13.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.717+0000 7fb20fe00640 1 -- 172.21.15.37:0/3619498827 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb228004cc0 con 0x5619d79492b0 2024-08-20T05:07:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.717+0000 7fb20fe00640 1 -- 172.21.15.37:0/3619498827 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fb21c033040 con 0x5619d79492b0 2024-08-20T05:07:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.717+0000 7fb23800c740 10 client.26792 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.717+0000 7fb23800c740 10 client.26792 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:07:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.717+0000 7fb23800c740 20 client.26792 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.717+0000 7fb23800c740 1 --2- 172.21.15.37:0/3619498827 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5619d79cf6c0 0x5619d79d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.717+0000 7fb23800c740 4 client.26792 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:07:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.717+0000 7fb23800c740 1 -- 172.21.15.37:0/3619498827 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5619d78bc490 con 0x5619d79cf6c0 2024-08-20T05:07:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.718+0000 7fb22ea00640 1 --2- 172.21.15.37:0/3619498827 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5619d79cf6c0 0x5619d79d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:13.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.718+0000 7fb22ea00640 1 --2- 172.21.15.37:0/3619498827 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5619d79cf6c0 0x5619d79d1ae0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f3d301a974dc03bc server_cookie=ac69a8b3e7e19e13 in_seq=0 out_seq=0 2024-08-20T05:07:13.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.718+0000 7fb20fe00640 10 client.26792 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:07:13.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.719+0000 7fb20fe00640 1 -- 172.21.15.37:0/3619498827 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5619d78bc490 con 0x5619d79cf6c0 2024-08-20T05:07:13.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.719+0000 7fb20fe00640 10 client.26792 handle_command_reply: tid=0 2024-08-20T05:07:13.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.719+0000 7fb23800c740 1 client.26792 shutdown 2024-08-20T05:07:13.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.719+0000 7fb23800c740 1 -- 172.21.15.37:0/3619498827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d79492b0 msgr2=0x5619d795a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:13.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.719+0000 7fb23800c740 1 --2- 172.21.15.37:0/3619498827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d79492b0 0x5619d795a6f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb21c02b800 tx=0x7fb21c02bc80 comp rx=0 tx=0).stop 2024-08-20T05:07:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.719+0000 7fb23800c740 1 -- 172.21.15.37:0/3619498827 shutdown_connections 2024-08-20T05:07:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.719+0000 7fb23800c740 1 --2- 172.21.15.37:0/3619498827 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5619d79cf6c0 0x5619d79d1ae0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.719+0000 7fb23800c740 1 --2- 172.21.15.37:0/3619498827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5619d7955240 0x5619d79cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.719+0000 7fb23800c740 1 --2- 172.21.15.37:0/3619498827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5619d79492b0 0x5619d795a6f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.719+0000 7fb23800c740 1 --2- 172.21.15.37:0/3619498827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5619d7948990 0x5619d795a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.719+0000 7fb20fe00640 0 client.26792 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:07:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.719+0000 7fb23800c740 1 -- 172.21.15.37:0/3619498827 >> 172.21.15.37:0/3619498827 conn(0x5619d79467c0 msgr2=0x5619d7953d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.720+0000 7fb23800c740 1 -- 172.21.15.37:0/3619498827 shutdown_connections 2024-08-20T05:07:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.721+0000 7fb23800c740 1 -- 172.21.15.37:0/3619498827 wait complete. 2024-08-20T05:07:13.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.721+0000 7fb23800c740 20 client.26792 trim_cache size 0 max 16384 2024-08-20T05:07:13.724 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:07:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.723+0000 7fb235600640 1 -- 172.21.15.37:0/3156896930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2140b3da0 msgr2=0x7fb2140b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.723+0000 7fb235600640 1 --2- 172.21.15.37:0/3156896930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2140b3da0 0x7fb2140b6260 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb21c004650 tx=0x7fb21c009bb0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.723+0000 7fb235600640 1 -- 172.21.15.37:0/3156896930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2301090e0 msgr2=0x7fb23019f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:13.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.723+0000 7fb235600640 1 --2- 172.21.15.37:0/3156896930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2301090e0 0x7fb23019f560 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb22002aa00 tx=0x7fb220003b90 comp rx=0 tx=0).stop 2024-08-20T05:07:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.723+0000 7fb235600640 1 -- 172.21.15.37:0/3156896930 shutdown_connections 2024-08-20T05:07:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.723+0000 7fb235600640 1 --2- 172.21.15.37:0/3156896930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2140b3da0 0x7fb2140b6260 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.723+0000 7fb235600640 1 --2- 172.21.15.37:0/3156896930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb23010f470 0x7fb2301a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.723+0000 7fb235600640 1 --2- 172.21.15.37:0/3156896930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb23010eaf0 0x7fb23019faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.723+0000 7fb235600640 1 --2- 172.21.15.37:0/3156896930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2301090e0 0x7fb23019f560 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.723+0000 7fb235600640 1 -- 172.21.15.37:0/3156896930 >> 172.21.15.37:0/3156896930 conn(0x7fb230078760 msgr2=0x7fb230078fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:13.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.724+0000 7fb235600640 1 -- 172.21.15.37:0/3156896930 shutdown_connections 2024-08-20T05:07:13.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:13.724+0000 7fb235600640 1 -- 172.21.15.37:0/3156896930 wait complete. 2024-08-20T05:07:14.740 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T05:07:15.448 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:07:15.613 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:15 smithi037 ceph-mon[17265]: pgmap v551: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 852 op/s 2024-08-20T05:07:15.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:15 smithi135 ceph-mon[22342]: pgmap v551: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 852 op/s 2024-08-20T05:07:15.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:15 smithi130 ceph-mon[22007]: pgmap v551: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 852 op/s 2024-08-20T05:07:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.125+0000 7f70c6c00640 1 -- 172.21.15.37:0/897734879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c01084c0 msgr2=0x7f70c0108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:16.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.125+0000 7f70c6c00640 1 --2- 172.21.15.37:0/897734879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c01084c0 0x7f70c0108900 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f70a8013150 tx=0x7f70a80327a0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.125+0000 7f70c6c00640 1 -- 172.21.15.37:0/897734879 shutdown_connections 2024-08-20T05:07:16.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.125+0000 7f70c6c00640 1 --2- 172.21.15.37:0/897734879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70c0108e40 0x7f70c010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.125+0000 7f70c6c00640 1 --2- 172.21.15.37:0/897734879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c01084c0 0x7f70c0108900 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.125+0000 7f70c6c00640 1 --2- 172.21.15.37:0/897734879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70c0102ab0 0x7f70c0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.125+0000 7f70c6c00640 1 -- 172.21.15.37:0/897734879 >> 172.21.15.37:0/897734879 conn(0x7f70c00fe500 msgr2=0x7f70c0100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:16.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.126+0000 7f70c6c00640 1 -- 172.21.15.37:0/897734879 shutdown_connections 2024-08-20T05:07:16.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.126+0000 7f70c6c00640 1 -- 172.21.15.37:0/897734879 wait complete. 2024-08-20T05:07:16.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.127+0000 7f70c6c00640 1 Processor -- start 2024-08-20T05:07:16.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.127+0000 7f70c6c00640 1 -- start start 2024-08-20T05:07:16.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.128+0000 7f70c6c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70c0102ab0 0x7f70c0196c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.128+0000 7f70c6c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70c01084c0 0x7f70c0197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.128+0000 7f70c6c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c0108e40 0x7f70c019c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.128+0000 7f70c6c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70c0110920 con 0x7f70c01084c0 2024-08-20T05:07:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.128+0000 7f70c6c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70c01107a0 con 0x7f70c0102ab0 2024-08-20T05:07:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.128+0000 7f70c6c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70c0110aa0 con 0x7f70c0108e40 2024-08-20T05:07:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.128+0000 7f70bfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70c0102ab0 0x7f70c0196c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.128+0000 7f70bfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70c0102ab0 0x7f70c0196c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43214/0 (socket says 172.21.15.37:43214) 2024-08-20T05:07:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.128+0000 7f70bfe00640 1 -- 172.21.15.37:0/4254816934 learned_addr learned my addr 172.21.15.37:0/4254816934 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.129+0000 7f70bfe00640 1 -- 172.21.15.37:0/4254816934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c0108e40 msgr2=0x7f70c019c4f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T05:07:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.129+0000 7f70bfe00640 1 --2- 172.21.15.37:0/4254816934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c0108e40 0x7f70c019c4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.129+0000 7f70bfe00640 1 -- 172.21.15.37:0/4254816934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70c01084c0 msgr2=0x7f70c0197150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.129+0000 7f70bfe00640 1 --2- 172.21.15.37:0/4254816934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70c01084c0 0x7f70c0197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.129+0000 7f70bfe00640 1 -- 172.21.15.37:0/4254816934 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c019ccc0 con 0x7f70c0102ab0 2024-08-20T05:07:16.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.129+0000 7f70bfe00640 1 --2- 172.21.15.37:0/4254816934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70c0102ab0 0x7f70c0196c10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f70b000e9f0 tx=0x7f70b000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:16.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.130+0000 7f70bd600640 1 -- 172.21.15.37:0/4254816934 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b000cd80 con 0x7f70c0102ab0 2024-08-20T05:07:16.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.130+0000 7f70bd600640 1 -- 172.21.15.37:0/4254816934 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70b00108e0 con 0x7f70c0102ab0 2024-08-20T05:07:16.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.130+0000 7f70bd600640 1 -- 172.21.15.37:0/4254816934 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b0018860 con 0x7f70c0102ab0 2024-08-20T05:07:16.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.130+0000 7f70c6c00640 1 -- 172.21.15.37:0/4254816934 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c019cfb0 con 0x7f70c0102ab0 2024-08-20T05:07:16.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.130+0000 7f70c6c00640 1 -- 172.21.15.37:0/4254816934 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c01a3670 con 0x7f70c0102ab0 2024-08-20T05:07:16.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.141+0000 7f70bd600640 1 -- 172.21.15.37:0/4254816934 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f70b0010430 con 0x7f70c0102ab0 2024-08-20T05:07:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.143+0000 7f70c9637740 1 Processor -- start 2024-08-20T05:07:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.144+0000 7f70c9637740 1 -- start start 2024-08-20T05:07:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.145+0000 7f70bd600640 1 --2- 172.21.15.37:0/4254816934 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70a40b3c50 0x7f70a40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.146+0000 7f70c9637740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af72b990 0x55c3af72bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.146+0000 7f70c9637740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af72c2b0 0x55c3af737d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.146+0000 7f70c9637740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af738240 0x55c3af73a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.146+0000 7f70c9637740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c3af6a1aa0 con 0x55c3af72c2b0 2024-08-20T05:07:16.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.146+0000 7f70c9637740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c3af690fa0 con 0x55c3af738240 2024-08-20T05:07:16.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.146+0000 7f70c9637740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c3af694fe0 con 0x55c3af72b990 2024-08-20T05:07:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.147+0000 7f70c4c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af738240 0x55c3af73a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.147+0000 7f70c4c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af738240 0x55c3af73a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43216/0 (socket says 172.21.15.37:43216) 2024-08-20T05:07:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.147+0000 7f70c4c00640 1 -- 172.21.15.37:0/1921876605 learned_addr learned my addr 172.21.15.37:0/1921876605 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.147+0000 7f70c4c00640 1 -- 172.21.15.37:0/1921876605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af72b990 msgr2=0x55c3af72bd70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:07:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.147+0000 7f70c4c00640 1 --2- 172.21.15.37:0/1921876605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af72b990 0x55c3af72bd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.148+0000 7f70b7e00640 1 --2- 172.21.15.37:0/1921876605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af72c2b0 0x55c3af737d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:16.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.148+0000 7f70c4c00640 1 -- 172.21.15.37:0/1921876605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af72c2b0 msgr2=0x55c3af737d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:16.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.148+0000 7f70bd600640 1 -- 172.21.15.37:0/4254816934 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f70b00e4360 con 0x7f70c0102ab0 2024-08-20T05:07:16.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.149+0000 7f70c4c00640 1 --2- 172.21.15.37:0/1921876605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af72c2b0 0x55c3af737d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.150+0000 7f70c4c00640 1 -- 172.21.15.37:0/1921876605 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3af637420 con 0x55c3af738240 2024-08-20T05:07:16.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.150+0000 7f70c4c00640 1 --2- 172.21.15.37:0/4254816934 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70a40b3c50 0x7f70a40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:16.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.151+0000 7f70c4c00640 1 --2- 172.21.15.37:0/1921876605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af738240 0x55c3af73a630 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f70b8009da0 tx=0x7f70b800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acd19ee938ebe8cf server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:16.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.151+0000 7f70b7e00640 1 --2- 172.21.15.37:0/1921876605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af72c2b0 0x55c3af737d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:16.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.152+0000 7f70b5200640 1 -- 172.21.15.37:0/1921876605 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b80118c0 con 0x55c3af738240 2024-08-20T05:07:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.152+0000 7f70b5200640 1 -- 172.21.15.37:0/1921876605 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70b801c400 con 0x55c3af738240 2024-08-20T05:07:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.155+0000 7f70b5200640 1 -- 172.21.15.37:0/1921876605 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b800d640 con 0x55c3af738240 2024-08-20T05:07:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.155+0000 7f70c9637740 1 -- 172.21.15.37:0/1921876605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af738240 msgr2=0x55c3af73a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.155+0000 7f70c9637740 1 --2- 172.21.15.37:0/1921876605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af738240 0x55c3af73a630 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f70b8009da0 tx=0x7f70b800f730 comp rx=0 tx=0).stop 2024-08-20T05:07:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.156+0000 7f70c9637740 1 -- 172.21.15.37:0/1921876605 shutdown_connections 2024-08-20T05:07:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.156+0000 7f70c9637740 1 --2- 172.21.15.37:0/1921876605 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af738240 0x55c3af73a630 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.156+0000 7f70c9637740 1 --2- 172.21.15.37:0/1921876605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af72c2b0 0x55c3af737d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.157+0000 7f70c9637740 1 --2- 172.21.15.37:0/1921876605 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af72b990 0x55c3af72bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.157+0000 7f70c9637740 1 -- 172.21.15.37:0/1921876605 >> 172.21.15.37:0/1921876605 conn(0x55c3af7297c0 msgr2=0x55c3af72a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:16.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.158+0000 7f70c4c00640 1 --2- 172.21.15.37:0/4254816934 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70a40b3c50 0x7f70a40b6110 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f70b801d000 tx=0x7f70b800ddb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:16.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.158+0000 7f70c9637740 1 -- 172.21.15.37:0/1921876605 shutdown_connections 2024-08-20T05:07:16.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.158+0000 7f70c9637740 1 -- 172.21.15.37:0/1921876605 wait complete. 2024-08-20T05:07:16.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.159+0000 7f70c9637740 1 -- start start 2024-08-20T05:07:16.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.159+0000 7f70c9637740 1 Processor -- start 2024-08-20T05:07:16.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.160+0000 7f70c9637740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af72b990 0x55c3af7378f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.161+0000 7f70c9637740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 0x55c3af734d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.161+0000 7f70c9637740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af738240 0x55c3af735280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.161+0000 7f70bfe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af72b990 0x55c3af7378f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:16.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.161+0000 7f70bfe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af72b990 0x55c3af7378f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52506/0 (socket says 172.21.15.37:52506) 2024-08-20T05:07:16.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.162+0000 7f70c4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af738240 0x55c3af735280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:16.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.162+0000 7f70c4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af738240 0x55c3af735280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58564/0 (socket says 172.21.15.37:58564) 2024-08-20T05:07:16.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.162+0000 7f70b7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 0x55c3af734d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:16.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.162+0000 7f70c9637740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c3af4f3700 con 0x55c3af738240 2024-08-20T05:07:16.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.162+0000 7f70b7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 0x55c3af734d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43224/0 (socket says 172.21.15.37:43224) 2024-08-20T05:07:16.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.162+0000 7f70c9637740 1 -- 172.21.15.37:0/917822257 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c3af62c290 con 0x55c3af72c2b0 2024-08-20T05:07:16.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.162+0000 7f70b7e00640 1 -- 172.21.15.37:0/917822257 learned_addr learned my addr 172.21.15.37:0/917822257 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:16.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.162+0000 7f70c9637740 1 -- 172.21.15.37:0/917822257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c3af73af60 con 0x55c3af72b990 2024-08-20T05:07:16.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.162+0000 7f70c9637740 10 client.0 _ll_register_callbacks cb 0x55c3af68b1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:16.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.162+0000 7f70b7e00640 1 -- 172.21.15.37:0/917822257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af72b990 msgr2=0x55c3af7378f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:16.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.162+0000 7f70b7e00640 1 --2- 172.21.15.37:0/917822257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af72b990 0x55c3af7378f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.163+0000 7f70b7e00640 1 -- 172.21.15.37:0/917822257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af738240 msgr2=0x55c3af735280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:16.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.163+0000 7f70b7e00640 1 --2- 172.21.15.37:0/917822257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af738240 0x55c3af735280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.163+0000 7f70b7e00640 1 -- 172.21.15.37:0/917822257 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3af3f0650 con 0x55c3af72c2b0 2024-08-20T05:07:16.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.164+0000 7f70ad600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:07:16.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.164+0000 7f70b7e00640 1 --2- 172.21.15.37:0/917822257 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 0x55c3af734d40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f70a8005ab0 tx=0x7f70a80053b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9fb6b3e4a907578 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:16.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.164+0000 7f70ad600640 1 -- 172.21.15.37:0/917822257 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8047020 con 0x55c3af72c2b0 2024-08-20T05:07:16.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.164+0000 7f70ad600640 1 -- 172.21.15.37:0/917822257 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f70a80110d0 con 0x55c3af72c2b0 2024-08-20T05:07:16.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.164+0000 7f70c9637740 1 -- 172.21.15.37:0/917822257 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70b801c400 con 0x55c3af72c2b0 2024-08-20T05:07:16.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.164+0000 7f70ad600640 1 -- 172.21.15.37:0/917822257 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f70a8052050 con 0x55c3af72c2b0 2024-08-20T05:07:16.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.164+0000 7f70c9637740 10 client.26804 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:16.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.164+0000 7f70c9637740 1 -- 172.21.15.37:0/917822257 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55c3af746620 con 0x55c3af72c2b0 2024-08-20T05:07:16.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.165+0000 7f70ad600640 1 -- 172.21.15.37:0/917822257 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70b801c400 con 0x55c3af72c2b0 2024-08-20T05:07:16.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.166+0000 7f70ad600640 1 -- 172.21.15.37:0/917822257 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f70a8004c60 con 0x55c3af72c2b0 2024-08-20T05:07:16.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.168+0000 7f70c9637740 10 client.26804 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:16.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.168+0000 7f70c9637740 10 client.26804 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:07:16.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.168+0000 7f70c9637740 20 client.26804 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:16.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.168+0000 7f70c9637740 1 --2- 172.21.15.37:0/917822257 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55c3af747b80 0x55c3af749fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.168+0000 7f70c9637740 4 client.26804 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:07:16.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.168+0000 7f70c9637740 1 -- 172.21.15.37:0/917822257 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3af6a39f0 con 0x55c3af747b80 2024-08-20T05:07:16.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.168+0000 7f70bfe00640 1 --2- 172.21.15.37:0/917822257 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55c3af747b80 0x55c3af749fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:16.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.169+0000 7f70bfe00640 1 --2- 172.21.15.37:0/917822257 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55c3af747b80 0x55c3af749fd0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=55bab04d502ffd70 server_cookie=9cc07981cdd311e9 in_seq=0 out_seq=0 2024-08-20T05:07:16.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.169+0000 7f70ad600640 10 client.26804 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:07:16.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.170+0000 7f70ad600640 1 -- 172.21.15.37:0/917822257 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c3af6a39f0 con 0x55c3af747b80 2024-08-20T05:07:16.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.170+0000 7f70ad600640 10 client.26804 handle_command_reply: tid=0 2024-08-20T05:07:16.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.170+0000 7f70c9637740 1 client.26804 shutdown 2024-08-20T05:07:16.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.170+0000 7f70c9637740 1 -- 172.21.15.37:0/917822257 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 msgr2=0x55c3af734d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:16.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.170+0000 7f70c9637740 1 --2- 172.21.15.37:0/917822257 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 0x55c3af734d40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f70a8005ab0 tx=0x7f70a80053b0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.171+0000 7f70c9637740 1 -- 172.21.15.37:0/917822257 shutdown_connections 2024-08-20T05:07:16.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.171+0000 7f70c9637740 1 --2- 172.21.15.37:0/917822257 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55c3af747b80 0x55c3af749fd0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.171+0000 7f70c9637740 1 --2- 172.21.15.37:0/917822257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af738240 0x55c3af735280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.171+0000 7f70c9637740 1 --2- 172.21.15.37:0/917822257 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 0x55c3af734d40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.171+0000 7f70c9637740 1 --2- 172.21.15.37:0/917822257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af72b990 0x55c3af7378f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.171+0000 7f70c9637740 1 -- 172.21.15.37:0/917822257 >> 172.21.15.37:0/917822257 conn(0x55c3af7297c0 msgr2=0x55c3af72f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:16.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.171+0000 7f70ad600640 0 client.26804 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:07:16.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.171+0000 7f70c9637740 1 -- 172.21.15.37:0/917822257 shutdown_connections 2024-08-20T05:07:16.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.171+0000 7f70c9637740 1 -- 172.21.15.37:0/917822257 wait complete. 2024-08-20T05:07:16.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.172+0000 7f70c9637740 20 client.26804 trim_cache size 0 max 16384 2024-08-20T05:07:16.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.198+0000 7f70c9637740 1 Processor -- start 2024-08-20T05:07:16.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.198+0000 7f70c9637740 1 -- start start 2024-08-20T05:07:16.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.199+0000 7f70c9637740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af72b990 0x55c3af74f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.199+0000 7f70c9637740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 0x55c3af74fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.199+0000 7f70c9637740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af738240 0x55c3af739630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.199+0000 7f70c9637740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70c01ad5b0 con 0x55c3af72b990 2024-08-20T05:07:16.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.199+0000 7f70c9637740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70c01af0f0 con 0x55c3af72c2b0 2024-08-20T05:07:16.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.199+0000 7f70c9637740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70c01adc80 con 0x55c3af738240 2024-08-20T05:07:16.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.199+0000 7f70b7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 0x55c3af74fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:16.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.199+0000 7f70c4c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af738240 0x55c3af739630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:16.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.199+0000 7f70c4c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af738240 0x55c3af739630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52512/0 (socket says 172.21.15.37:52512) 2024-08-20T05:07:16.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.199+0000 7f70c4c00640 1 -- 172.21.15.37:0/2043205336 learned_addr learned my addr 172.21.15.37:0/2043205336 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:16.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.199+0000 7f70bfe00640 1 --2- 172.21.15.37:0/2043205336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af72b990 0x55c3af74f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:16.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.200+0000 7f70b7e00640 1 -- 172.21.15.37:0/2043205336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af738240 msgr2=0x55c3af739630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:16.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.200+0000 7f70b7e00640 1 --2- 172.21.15.37:0/2043205336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af738240 0x55c3af739630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.200+0000 7f70b7e00640 1 -- 172.21.15.37:0/2043205336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af72b990 msgr2=0x55c3af74f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.200+0000 7f70b7e00640 1 --2- 172.21.15.37:0/2043205336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af72b990 0x55c3af74f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.200+0000 7f70b7e00640 1 -- 172.21.15.37:0/2043205336 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3af72a240 con 0x55c3af72c2b0 2024-08-20T05:07:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.201+0000 7f70c4c00640 1 --2- 172.21.15.37:0/2043205336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af738240 0x55c3af739630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:07:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.201+0000 7f70bfe00640 1 --2- 172.21.15.37:0/2043205336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af72b990 0x55c3af74f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:07:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.201+0000 7f70b7e00640 1 --2- 172.21.15.37:0/2043205336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 0x55c3af74fde0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f70a8032cc0 tx=0x7f70a8011a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fa8d29d6a94d256 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.201+0000 7f70afe00640 1 -- 172.21.15.37:0/2043205336 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a8047070 con 0x55c3af72c2b0 2024-08-20T05:07:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.201+0000 7f70afe00640 1 -- 172.21.15.37:0/2043205336 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70a8043680 con 0x55c3af72c2b0 2024-08-20T05:07:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.201+0000 7f70afe00640 1 -- 172.21.15.37:0/2043205336 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a803e040 con 0x55c3af72c2b0 2024-08-20T05:07:16.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.202+0000 7f70c9637740 1 -- 172.21.15.37:0/2043205336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 msgr2=0x55c3af74fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:16.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.202+0000 7f70c9637740 1 --2- 172.21.15.37:0/2043205336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 0x55c3af74fde0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f70a8032cc0 tx=0x7f70a8011a70 comp rx=0 tx=0).stop 2024-08-20T05:07:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.205+0000 7f70c9637740 1 -- 172.21.15.37:0/2043205336 shutdown_connections 2024-08-20T05:07:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.205+0000 7f70c9637740 1 --2- 172.21.15.37:0/2043205336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af738240 0x55c3af739630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.205+0000 7f70c9637740 1 --2- 172.21.15.37:0/2043205336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 0x55c3af74fde0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.205+0000 7f70c9637740 1 --2- 172.21.15.37:0/2043205336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af72b990 0x55c3af74f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.205+0000 7f70c9637740 1 -- 172.21.15.37:0/2043205336 >> 172.21.15.37:0/2043205336 conn(0x55c3af7297c0 msgr2=0x55c3af736b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.206+0000 7f70c9637740 1 -- 172.21.15.37:0/2043205336 shutdown_connections 2024-08-20T05:07:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.206+0000 7f70c9637740 1 -- 172.21.15.37:0/2043205336 wait complete. 2024-08-20T05:07:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.207+0000 7f70c9637740 1 -- start start 2024-08-20T05:07:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.207+0000 7f70c9637740 1 Processor -- start 2024-08-20T05:07:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.213+0000 7f70c9637740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af72b990 0x55c3af740280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.213+0000 7f70c9637740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 0x55c3af7407c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.213+0000 7f70c9637740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af738240 0x55c3af73b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.213+0000 7f70c9637740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70c01aea20 con 0x55c3af738240 2024-08-20T05:07:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.213+0000 7f70c9637740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70c01ae350 con 0x55c3af72c2b0 2024-08-20T05:07:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.213+0000 7f70c9637740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70c01ab590 con 0x55c3af72b990 2024-08-20T05:07:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.213+0000 7f70c9637740 10 client.0 _ll_register_callbacks cb 0x7f70b0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.214+0000 7f70bfe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af72b990 0x55c3af740280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.214+0000 7f70bfe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af72b990 0x55c3af740280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52520/0 (socket says 172.21.15.37:52520) 2024-08-20T05:07:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.214+0000 7f70bfe00640 1 -- 172.21.15.37:0/1996416491 learned_addr learned my addr 172.21.15.37:0/1996416491 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:16.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.215+0000 7f70c4c00640 1 --2- 172.21.15.37:0/1996416491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af738240 0x55c3af73b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:16.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.215+0000 7f70b7e00640 1 --2- 172.21.15.37:0/1996416491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 0x55c3af7407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:16.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.217+0000 7f70bfe00640 1 -- 172.21.15.37:0/1996416491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 msgr2=0x55c3af7407c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:16.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.217+0000 7f70bfe00640 1 --2- 172.21.15.37:0/1996416491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 0x55c3af7407c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.217+0000 7f70bfe00640 1 -- 172.21.15.37:0/1996416491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af738240 msgr2=0x55c3af73b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:16.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.217+0000 7f70bfe00640 1 --2- 172.21.15.37:0/1996416491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af738240 0x55c3af73b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.217+0000 7f70bfe00640 1 -- 172.21.15.37:0/1996416491 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3af73a280 con 0x55c3af72b990 2024-08-20T05:07:16.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.218+0000 7f70bfe00640 1 --2- 172.21.15.37:0/1996416491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af72b990 0x55c3af740280 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f70b00e1b10 tx=0x7f70b00ab6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed8bd653393076 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:16.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.218+0000 7f70ad600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:07:16.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.218+0000 7f70ad600640 1 -- 172.21.15.37:0/1996416491 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b00af2d0 con 0x55c3af72b990 2024-08-20T05:07:16.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.218+0000 7f70ad600640 1 -- 172.21.15.37:0/1996416491 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f70b0010a90 con 0x55c3af72b990 2024-08-20T05:07:16.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.218+0000 7f70c9637740 1 -- 172.21.15.37:0/1996416491 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70a8043680 con 0x55c3af72b990 2024-08-20T05:07:16.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.219+0000 7f70ad600640 1 -- 172.21.15.37:0/1996416491 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f70b00b3fc0 con 0x55c3af72b990 2024-08-20T05:07:16.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.220+0000 7f70b7e00640 1 --2- 172.21.15.37:0/1996416491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 0x55c3af7407c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:16.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.220+0000 7f70c9637740 10 client.26824 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:16.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.220+0000 7f70c9637740 1 -- 172.21.15.37:0/1996416491 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55c3af7c3e00 con 0x55c3af72b990 2024-08-20T05:07:16.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.220+0000 7f70ad600640 1 -- 172.21.15.37:0/1996416491 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70a8043680 con 0x55c3af72b990 2024-08-20T05:07:16.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.220+0000 7f70ad600640 1 -- 172.21.15.37:0/1996416491 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f70b00a9be0 con 0x55c3af72b990 2024-08-20T05:07:16.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.221+0000 7f70c4c00640 1 --2- 172.21.15.37:0/1996416491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af738240 0x55c3af73b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:16.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.221+0000 7f70c9637740 10 client.26824 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:16.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.221+0000 7f70c9637740 10 client.26824 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:07:16.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.221+0000 7f70c9637740 20 client.26824 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:16.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.221+0000 7f70c9637740 1 --2- 172.21.15.37:0/1996416491 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55c3af7c4600 0x55c3af7c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:16.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.221+0000 7f70c9637740 4 client.26824 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:07:16.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.221+0000 7f70c9637740 1 -- 172.21.15.37:0/1996416491 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c3af69f490 con 0x55c3af7c4600 2024-08-20T05:07:16.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.222+0000 7f70b7e00640 1 --2- 172.21.15.37:0/1996416491 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55c3af7c4600 0x55c3af7c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:16.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.223+0000 7f70b7e00640 1 --2- 172.21.15.37:0/1996416491 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55c3af7c4600 0x55c3af7c6aa0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4fd320181c74e76a server_cookie=d5ac7e22086b477e in_seq=0 out_seq=0 2024-08-20T05:07:16.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.226+0000 7f70ad600640 10 client.26824 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:07:16.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.226+0000 7f70ad600640 1 -- 172.21.15.37:0/1996416491 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c3af69f490 con 0x55c3af7c4600 2024-08-20T05:07:16.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.226+0000 7f70ad600640 10 client.26824 handle_command_reply: tid=0 2024-08-20T05:07:16.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.226+0000 7f70c9637740 1 client.26824 shutdown 2024-08-20T05:07:16.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.228+0000 7f70c9637740 1 -- 172.21.15.37:0/1996416491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af72b990 msgr2=0x55c3af740280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:16.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.228+0000 7f70c9637740 1 --2- 172.21.15.37:0/1996416491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af72b990 0x55c3af740280 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f70b00e1b10 tx=0x7f70b00ab6d0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.228+0000 7f70c9637740 1 -- 172.21.15.37:0/1996416491 shutdown_connections 2024-08-20T05:07:16.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.228+0000 7f70c9637740 1 --2- 172.21.15.37:0/1996416491 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55c3af7c4600 0x55c3af7c6aa0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.228+0000 7f70c9637740 1 --2- 172.21.15.37:0/1996416491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3af738240 0x55c3af73b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.228+0000 7f70c9637740 1 --2- 172.21.15.37:0/1996416491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c3af72c2b0 0x55c3af7407c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.228+0000 7f70c9637740 1 --2- 172.21.15.37:0/1996416491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c3af72b990 0x55c3af740280 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.228+0000 7f70ad600640 0 client.26824 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:07:16.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.228+0000 7f70c9637740 1 -- 172.21.15.37:0/1996416491 >> 172.21.15.37:0/1996416491 conn(0x55c3af7297c0 msgr2=0x55c3af728120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.229+0000 7f70c9637740 1 -- 172.21.15.37:0/1996416491 shutdown_connections 2024-08-20T05:07:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.229+0000 7f70c9637740 1 -- 172.21.15.37:0/1996416491 wait complete. 2024-08-20T05:07:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.229+0000 7f70c9637740 20 client.26824 trim_cache size 0 max 16384 2024-08-20T05:07:16.232 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:07:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.230+0000 7f70c6c00640 1 -- 172.21.15.37:0/4254816934 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70a40b3c50 msgr2=0x7f70a40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.230+0000 7f70c6c00640 1 --2- 172.21.15.37:0/4254816934 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70a40b3c50 0x7f70a40b6110 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f70b801d000 tx=0x7f70b800ddb0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.230+0000 7f70c6c00640 1 -- 172.21.15.37:0/4254816934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70c0102ab0 msgr2=0x7f70c0196c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.230+0000 7f70c6c00640 1 --2- 172.21.15.37:0/4254816934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70c0102ab0 0x7f70c0196c10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f70b000e9f0 tx=0x7f70b000eeb0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.231+0000 7f70c6c00640 1 -- 172.21.15.37:0/4254816934 shutdown_connections 2024-08-20T05:07:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.231+0000 7f70c6c00640 1 --2- 172.21.15.37:0/4254816934 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70a40b3c50 0x7f70a40b6110 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.231+0000 7f70c6c00640 1 --2- 172.21.15.37:0/4254816934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70c0108e40 0x7f70c019c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.231+0000 7f70c6c00640 1 --2- 172.21.15.37:0/4254816934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70c01084c0 0x7f70c0197150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.231+0000 7f70c6c00640 1 --2- 172.21.15.37:0/4254816934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70c0102ab0 0x7f70c0196c10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:16.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.231+0000 7f70c6c00640 1 -- 172.21.15.37:0/4254816934 >> 172.21.15.37:0/4254816934 conn(0x7f70c00fe500 msgr2=0x7f70c00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:16.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.231+0000 7f70c6c00640 1 -- 172.21.15.37:0/4254816934 shutdown_connections 2024-08-20T05:07:16.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:16.231+0000 7f70c6c00640 1 -- 172.21.15.37:0/4254816934 wait complete. 2024-08-20T05:07:17.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:17 smithi135 ceph-mon[22342]: pgmap v552: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 862 op/s 2024-08-20T05:07:17.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:17 smithi130 ceph-mon[22007]: pgmap v552: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 862 op/s 2024-08-20T05:07:17.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:17 smithi037 ceph-mon[17265]: pgmap v552: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 862 op/s 2024-08-20T05:07:18.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 260.0 s, 1348.0 tps, lat 76.893 ms stddev 102.297 2024-08-20T05:07:18.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T05:07:19.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:19 smithi135 ceph-mon[22342]: pgmap v553: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 839 op/s 2024-08-20T05:07:19.694 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:07:19.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:19 smithi130 ceph-mon[22007]: pgmap v553: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 839 op/s 2024-08-20T05:07:19.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:19 smithi037 ceph-mon[17265]: pgmap v553: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 839 op/s 2024-08-20T05:07:21.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.095+0000 7fcb49c00640 1 -- 172.21.15.37:0/925041085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb441039b0 msgr2=0x7fcb44103d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:21.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.095+0000 7fcb49c00640 1 --2- 172.21.15.37:0/925041085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb441039b0 0x7fcb44103d90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcb30009900 tx=0x7fcb3002a420 comp rx=0 tx=0).stop 2024-08-20T05:07:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.100+0000 7fcb49c00640 1 -- 172.21.15.37:0/925041085 shutdown_connections 2024-08-20T05:07:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.100+0000 7fcb49c00640 1 --2- 172.21.15.37:0/925041085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb4410ce10 0x7fcb4410f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.100+0000 7fcb49c00640 1 --2- 172.21.15.37:0/925041085 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb441042d0 0x7fcb4410c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.100+0000 7fcb49c00640 1 --2- 172.21.15.37:0/925041085 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb441039b0 0x7fcb44103d90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.100+0000 7fcb49c00640 1 -- 172.21.15.37:0/925041085 >> 172.21.15.37:0/925041085 conn(0x7fcb440fd430 msgr2=0x7fcb440ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.100+0000 7fcb49c00640 1 -- 172.21.15.37:0/925041085 shutdown_connections 2024-08-20T05:07:21.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.100+0000 7fcb49c00640 1 -- 172.21.15.37:0/925041085 wait complete. 2024-08-20T05:07:21.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.101+0000 7fcb49c00640 1 Processor -- start 2024-08-20T05:07:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.101+0000 7fcb49c00640 1 -- start start 2024-08-20T05:07:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.102+0000 7fcb49c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb441039b0 0x7fcb44103110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.102+0000 7fcb49c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb441042d0 0x7fcb44101660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.102+0000 7fcb49c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb4410ce10 0x7fcb44101c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.102+0000 7fcb49c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcb44112bb0 con 0x7fcb441039b0 2024-08-20T05:07:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.102+0000 7fcb49c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcb44112a30 con 0x7fcb4410ce10 2024-08-20T05:07:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.102+0000 7fcb49c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcb44112d30 con 0x7fcb441042d0 2024-08-20T05:07:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.102+0000 7fcb42000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb441042d0 0x7fcb44101660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.102+0000 7fcb43400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb4410ce10 0x7fcb44101c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.102+0000 7fcb42000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb441042d0 0x7fcb44101660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52536/0 (socket says 172.21.15.37:52536) 2024-08-20T05:07:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.102+0000 7fcb42000640 1 -- 172.21.15.37:0/3310209011 learned_addr learned my addr 172.21.15.37:0/3310209011 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:21.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.103+0000 7fcb42000640 1 -- 172.21.15.37:0/3310209011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb4410ce10 msgr2=0x7fcb44101c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.103+0000 7fcb42000640 1 --2- 172.21.15.37:0/3310209011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb4410ce10 0x7fcb44101c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.103+0000 7fcb42000640 1 -- 172.21.15.37:0/3310209011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb441039b0 msgr2=0x7fcb44103110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T05:07:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.103+0000 7fcb42000640 1 --2- 172.21.15.37:0/3310209011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb441039b0 0x7fcb44103110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.103+0000 7fcb42000640 1 -- 172.21.15.37:0/3310209011 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4419d220 con 0x7fcb441042d0 2024-08-20T05:07:21.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.104+0000 7fcb42000640 1 --2- 172.21.15.37:0/3310209011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb441042d0 0x7fcb44101660 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009fd0 tx=0x7fcb3400b870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:21.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.106+0000 7fcb3b400640 1 -- 172.21.15.37:0/3310209011 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb34015020 con 0x7fcb441042d0 2024-08-20T05:07:21.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.106+0000 7fcb3b400640 1 -- 172.21.15.37:0/3310209011 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb34011ce0 con 0x7fcb441042d0 2024-08-20T05:07:21.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.106+0000 7fcb3b400640 1 -- 172.21.15.37:0/3310209011 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb34010dc0 con 0x7fcb441042d0 2024-08-20T05:07:21.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.107+0000 7fcb49c00640 1 -- 172.21.15.37:0/3310209011 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4419d510 con 0x7fcb441042d0 2024-08-20T05:07:21.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.107+0000 7fcb49c00640 1 -- 172.21.15.37:0/3310209011 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4419da80 con 0x7fcb441042d0 2024-08-20T05:07:21.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.116+0000 7fcb4c641740 1 Processor -- start 2024-08-20T05:07:21.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.116+0000 7fcb4c641740 1 -- start start 2024-08-20T05:07:21.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.117+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b888940 0x55df9b888d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.117+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b889260 0x55df9b894cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.117+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b8951f0 0x55df9b8975e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.117+0000 7fcb4c641740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55df9b7feaa0 con 0x55df9b889260 2024-08-20T05:07:21.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.117+0000 7fcb4c641740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55df9b7edfa0 con 0x55df9b8951f0 2024-08-20T05:07:21.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.117+0000 7fcb4c641740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55df9b7f1fe0 con 0x55df9b888940 2024-08-20T05:07:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.117+0000 7fcb42a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b889260 0x55df9b894cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.118+0000 7fcb42a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b889260 0x55df9b894cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58612/0 (socket says 172.21.15.37:58612) 2024-08-20T05:07:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.118+0000 7fcb42a00640 1 -- 172.21.15.37:0/4066571300 learned_addr learned my addr 172.21.15.37:0/4066571300 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.118+0000 7fcb42a00640 1 -- 172.21.15.37:0/4066571300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b888940 msgr2=0x55df9b888d20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:07:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.118+0000 7fcb42a00640 1 --2- 172.21.15.37:0/4066571300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b888940 0x55df9b888d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.118+0000 7fcb42a00640 1 -- 172.21.15.37:0/4066571300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b8951f0 msgr2=0x55df9b8975e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:07:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.118+0000 7fcb42a00640 1 --2- 172.21.15.37:0/4066571300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b8951f0 0x55df9b8975e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.118+0000 7fcb42a00640 1 -- 172.21.15.37:0/4066571300 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df9b794420 con 0x55df9b889260 2024-08-20T05:07:21.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.118+0000 7fcb3b400640 1 -- 172.21.15.37:0/3310209011 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcb34018020 con 0x7fcb441042d0 2024-08-20T05:07:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.121+0000 7fcb3b400640 1 --2- 172.21.15.37:0/3310209011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcb280b3d20 0x7fcb280b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.122+0000 7fcb3b400640 1 -- 172.21.15.37:0/3310209011 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fcb340e33a0 con 0x7fcb441042d0 2024-08-20T05:07:21.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.122+0000 7fcb43400640 1 --2- 172.21.15.37:0/3310209011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcb280b3d20 0x7fcb280b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.124+0000 7fcb42a00640 1 --2- 172.21.15.37:0/4066571300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b889260 0x55df9b894cb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcb30009a20 tx=0x7fcb30000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39ed14ed1070556 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.124+0000 7fcb43400640 1 --2- 172.21.15.37:0/3310209011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcb280b3d20 0x7fcb280b61e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009f60 tx=0x7fcb3c00d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.125+0000 7fcb2fe00640 1 -- 172.21.15.37:0/4066571300 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3003e070 con 0x55df9b889260 2024-08-20T05:07:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.125+0000 7fcb2fe00640 1 -- 172.21.15.37:0/4066571300 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb30005500 con 0x55df9b889260 2024-08-20T05:07:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.125+0000 7fcb2fe00640 1 -- 172.21.15.37:0/4066571300 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3003e070 con 0x55df9b889260 2024-08-20T05:07:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.126+0000 7fcb4c641740 1 -- 172.21.15.37:0/4066571300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b889260 msgr2=0x55df9b894cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.126+0000 7fcb4c641740 1 --2- 172.21.15.37:0/4066571300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b889260 0x55df9b894cb0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcb30009a20 tx=0x7fcb30000bc0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.126+0000 7fcb4c641740 1 -- 172.21.15.37:0/4066571300 shutdown_connections 2024-08-20T05:07:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.126+0000 7fcb4c641740 1 --2- 172.21.15.37:0/4066571300 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b8951f0 0x55df9b8975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.126+0000 7fcb4c641740 1 --2- 172.21.15.37:0/4066571300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b889260 0x55df9b894cb0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.126+0000 7fcb4c641740 1 --2- 172.21.15.37:0/4066571300 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b888940 0x55df9b888d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.126+0000 7fcb4c641740 1 -- 172.21.15.37:0/4066571300 >> 172.21.15.37:0/4066571300 conn(0x55df9b886770 msgr2=0x55df9b887910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.127+0000 7fcb4c641740 1 -- 172.21.15.37:0/4066571300 shutdown_connections 2024-08-20T05:07:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.127+0000 7fcb4c641740 1 -- 172.21.15.37:0/4066571300 wait complete. 2024-08-20T05:07:21.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.127+0000 7fcb4c641740 1 -- start start 2024-08-20T05:07:21.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.128+0000 7fcb4c641740 1 Processor -- start 2024-08-20T05:07:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.129+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b888940 0x55df9b894a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.130+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b889260 0x55df9b891e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.130+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b8951f0 0x55df9b8923a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.130+0000 7fcb4c641740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55df9b650700 con 0x55df9b888940 2024-08-20T05:07:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.130+0000 7fcb4c641740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55df9b789290 con 0x55df9b889260 2024-08-20T05:07:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.130+0000 7fcb4c641740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55df9b897e10 con 0x55df9b8951f0 2024-08-20T05:07:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.132+0000 7fcb4c641740 10 client.0 _ll_register_callbacks cb 0x55df9b7e81c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.130+0000 7fcb42a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b888940 0x55df9b894a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.135+0000 7fcb42a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b888940 0x55df9b894a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58620/0 (socket says 172.21.15.37:58620) 2024-08-20T05:07:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.135+0000 7fcb42a00640 1 -- 172.21.15.37:0/3837769354 learned_addr learned my addr 172.21.15.37:0/3837769354 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.131+0000 7fcb43400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b8951f0 0x55df9b8923a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:21.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.130+0000 7fcb42000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b889260 0x55df9b891e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:21.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.136+0000 7fcb43400640 1 -- 172.21.15.37:0/3837769354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b889260 msgr2=0x55df9b891e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:21.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.136+0000 7fcb43400640 1 --2- 172.21.15.37:0/3837769354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b889260 0x55df9b891e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.136+0000 7fcb43400640 1 -- 172.21.15.37:0/3837769354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b888940 msgr2=0x55df9b894a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.136+0000 7fcb43400640 1 --2- 172.21.15.37:0/3837769354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b888940 0x55df9b894a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.136+0000 7fcb43400640 1 -- 172.21.15.37:0/3837769354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df9b54d650 con 0x55df9b8951f0 2024-08-20T05:07:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.136+0000 7fcb42a00640 1 --2- 172.21.15.37:0/3837769354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b888940 0x55df9b894a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:07:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.136+0000 7fcb43400640 1 --2- 172.21.15.37:0/3837769354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b8951f0 0x55df9b8923a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c016de0 tx=0x7fcb3c004b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19aa1e1178900189 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.136+0000 7fcb2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:07:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.137+0000 7fcb2cc00640 1 -- 172.21.15.37:0/3837769354 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c025060 con 0x55df9b8951f0 2024-08-20T05:07:21.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.137+0000 7fcb4c641740 1 -- 172.21.15.37:0/3837769354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb30005500 con 0x55df9b8951f0 2024-08-20T05:07:21.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.137+0000 7fcb2cc00640 1 -- 172.21.15.37:0/3837769354 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fcb3c0205f0 con 0x55df9b8951f0 2024-08-20T05:07:21.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.141+0000 7fcb2cc00640 1 -- 172.21.15.37:0/3837769354 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fcb3c02c050 con 0x55df9b8951f0 2024-08-20T05:07:21.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.141+0000 7fcb4c641740 10 client.26830 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:21.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.141+0000 7fcb4c641740 1 -- 172.21.15.37:0/3837769354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55df9b8a37c0 con 0x55df9b8951f0 2024-08-20T05:07:21.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.141+0000 7fcb2cc00640 1 -- 172.21.15.37:0/3837769354 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb30005500 con 0x55df9b8951f0 2024-08-20T05:07:21.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.143+0000 7fcb2cc00640 1 -- 172.21.15.37:0/3837769354 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fcb3c02e2e0 con 0x55df9b8951f0 2024-08-20T05:07:21.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.143+0000 7fcb4c641740 10 client.26830 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:21.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.143+0000 7fcb4c641740 10 client.26830 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:07:21.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.143+0000 7fcb4c641740 20 client.26830 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:21.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.143+0000 7fcb4c641740 1 --2- 172.21.15.37:0/3837769354 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55df9b8a4cc0 0x55df9b8a70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.143+0000 7fcb4c641740 4 client.26830 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:07:21.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.143+0000 7fcb4c641740 1 -- 172.21.15.37:0/3837769354 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df9b8009f0 con 0x55df9b8a4cc0 2024-08-20T05:07:21.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.144+0000 7fcb42a00640 1 --2- 172.21.15.37:0/3837769354 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55df9b8a4cc0 0x55df9b8a70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:21.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.145+0000 7fcb42a00640 1 --2- 172.21.15.37:0/3837769354 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55df9b8a4cc0 0x55df9b8a70e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ccc3dbf8ea316381 server_cookie=292f76b331769649 in_seq=0 out_seq=0 2024-08-20T05:07:21.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.145+0000 7fcb2cc00640 10 client.26830 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:07:21.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.146+0000 7fcb2cc00640 1 -- 172.21.15.37:0/3837769354 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55df9b8009f0 con 0x55df9b8a4cc0 2024-08-20T05:07:21.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.146+0000 7fcb2cc00640 10 client.26830 handle_command_reply: tid=0 2024-08-20T05:07:21.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.146+0000 7fcb4c641740 1 client.26830 shutdown 2024-08-20T05:07:21.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.147+0000 7fcb4c641740 1 -- 172.21.15.37:0/3837769354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b8951f0 msgr2=0x55df9b8923a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:21.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.147+0000 7fcb4c641740 1 --2- 172.21.15.37:0/3837769354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b8951f0 0x55df9b8923a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c016de0 tx=0x7fcb3c004b50 comp rx=0 tx=0).stop 2024-08-20T05:07:21.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.147+0000 7fcb4c641740 1 -- 172.21.15.37:0/3837769354 shutdown_connections 2024-08-20T05:07:21.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.147+0000 7fcb4c641740 1 --2- 172.21.15.37:0/3837769354 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55df9b8a4cc0 0x55df9b8a70e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.148+0000 7fcb4c641740 1 --2- 172.21.15.37:0/3837769354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b8951f0 0x55df9b8923a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.148+0000 7fcb4c641740 1 --2- 172.21.15.37:0/3837769354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b889260 0x55df9b891e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.148+0000 7fcb4c641740 1 --2- 172.21.15.37:0/3837769354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b888940 0x55df9b894a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.148+0000 7fcb4c641740 1 -- 172.21.15.37:0/3837769354 >> 172.21.15.37:0/3837769354 conn(0x55df9b886770 msgr2=0x55df9b88c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:21.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.149+0000 7fcb2cc00640 0 client.26830 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:07:21.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.149+0000 7fcb4c641740 1 -- 172.21.15.37:0/3837769354 shutdown_connections 2024-08-20T05:07:21.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.149+0000 7fcb4c641740 1 -- 172.21.15.37:0/3837769354 wait complete. 2024-08-20T05:07:21.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.149+0000 7fcb4c641740 20 client.26830 trim_cache size 0 max 16384 2024-08-20T05:07:21.184 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.183+0000 7fcb4c641740 1 Processor -- start 2024-08-20T05:07:21.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.184+0000 7fcb4c641740 1 -- start start 2024-08-20T05:07:21.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.185+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b888940 0x55df9b8a0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.185+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b889260 0x55df9b885740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.185+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b8951f0 0x55df9b8ac9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.185+0000 7fcb4c641740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2400fbd0 con 0x55df9b889260 2024-08-20T05:07:21.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.185+0000 7fcb4c641740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcb24011710 con 0x55df9b888940 2024-08-20T05:07:21.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.185+0000 7fcb4c641740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcb240102a0 con 0x55df9b8951f0 2024-08-20T05:07:21.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.186+0000 7fcb43400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b8951f0 0x55df9b8ac9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:21.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.186+0000 7fcb43400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b8951f0 0x55df9b8ac9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52554/0 (socket says 172.21.15.37:52554) 2024-08-20T05:07:21.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.186+0000 7fcb42a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b888940 0x55df9b8a0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:21.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.186+0000 7fcb43400640 1 -- 172.21.15.37:0/1992297862 learned_addr learned my addr 172.21.15.37:0/1992297862 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:21.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.187+0000 7fcb42a00640 1 -- 172.21.15.37:0/1992297862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b8951f0 msgr2=0x55df9b8ac9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:21.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.187+0000 7fcb42a00640 1 --2- 172.21.15.37:0/1992297862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b8951f0 0x55df9b8ac9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.187+0000 7fcb42a00640 1 -- 172.21.15.37:0/1992297862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b889260 msgr2=0x55df9b885740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:21.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.187+0000 7fcb42a00640 1 --2- 172.21.15.37:0/1992297862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b889260 0x55df9b885740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.187+0000 7fcb42a00640 1 -- 172.21.15.37:0/1992297862 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df9b8865a0 con 0x55df9b888940 2024-08-20T05:07:21.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.187+0000 7fcb42a00640 1 --2- 172.21.15.37:0/1992297862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b888940 0x55df9b8a0fc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55df9b8a7920 tx=0x7fcb30004c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f64832302290e0a2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:21.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.188+0000 7fcb2f400640 1 -- 172.21.15.37:0/1992297862 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3003e040 con 0x55df9b888940 2024-08-20T05:07:21.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.188+0000 7fcb2f400640 1 -- 172.21.15.37:0/1992297862 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb300035f0 con 0x55df9b888940 2024-08-20T05:07:21.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.188+0000 7fcb2f400640 1 -- 172.21.15.37:0/1992297862 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb30035040 con 0x55df9b888940 2024-08-20T05:07:21.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.189+0000 7fcb4c641740 1 -- 172.21.15.37:0/1992297862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b888940 msgr2=0x55df9b8a0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:21.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.189+0000 7fcb4c641740 1 --2- 172.21.15.37:0/1992297862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b888940 0x55df9b8a0fc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55df9b8a7920 tx=0x7fcb30004c30 comp rx=0 tx=0).stop 2024-08-20T05:07:21.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.189+0000 7fcb4c641740 1 -- 172.21.15.37:0/1992297862 shutdown_connections 2024-08-20T05:07:21.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.189+0000 7fcb4c641740 1 --2- 172.21.15.37:0/1992297862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b8951f0 0x55df9b8ac9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.189+0000 7fcb4c641740 1 --2- 172.21.15.37:0/1992297862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b889260 0x55df9b885740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.190+0000 7fcb4c641740 1 --2- 172.21.15.37:0/1992297862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b888940 0x55df9b8a0fc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.190+0000 7fcb4c641740 1 -- 172.21.15.37:0/1992297862 >> 172.21.15.37:0/1992297862 conn(0x55df9b886770 msgr2=0x55df9b885030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:21.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.190+0000 7fcb4c641740 1 -- 172.21.15.37:0/1992297862 shutdown_connections 2024-08-20T05:07:21.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.190+0000 7fcb4c641740 1 -- 172.21.15.37:0/1992297862 wait complete. 2024-08-20T05:07:21.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.191+0000 7fcb4c641740 1 -- start start 2024-08-20T05:07:21.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.191+0000 7fcb4c641740 1 Processor -- start 2024-08-20T05:07:21.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.192+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b888940 0x55df9b89d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.192+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b889260 0x55df9b89d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.192+0000 7fcb4c641740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b8951f0 0x55df9b908210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.192+0000 7fcb4c641740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcb24011040 con 0x55df9b888940 2024-08-20T05:07:21.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.192+0000 7fcb4c641740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcb24010970 con 0x55df9b889260 2024-08-20T05:07:21.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.192+0000 7fcb4c641740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2400dbb0 con 0x55df9b8951f0 2024-08-20T05:07:21.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.192+0000 7fcb4c641740 10 client.0 _ll_register_callbacks cb 0x7fcb3c00af50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:21.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.193+0000 7fcb42000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b889260 0x55df9b89d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:21.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.193+0000 7fcb42000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b889260 0x55df9b89d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43272/0 (socket says 172.21.15.37:43272) 2024-08-20T05:07:21.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.193+0000 7fcb42000640 1 -- 172.21.15.37:0/1413409063 learned_addr learned my addr 172.21.15.37:0/1413409063 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:21.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.193+0000 7fcb43400640 1 --2- 172.21.15.37:0/1413409063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b8951f0 0x55df9b908210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:21.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.193+0000 7fcb42a00640 1 --2- 172.21.15.37:0/1413409063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b888940 0x55df9b89d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:21.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.193+0000 7fcb42000640 1 -- 172.21.15.37:0/1413409063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b8951f0 msgr2=0x55df9b908210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:21.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.193+0000 7fcb42000640 1 --2- 172.21.15.37:0/1413409063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b8951f0 0x55df9b908210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.194+0000 7fcb42000640 1 -- 172.21.15.37:0/1413409063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b888940 msgr2=0x55df9b89d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:21.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.194+0000 7fcb42000640 1 --2- 172.21.15.37:0/1413409063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b888940 0x55df9b89d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.194+0000 7fcb42000640 1 -- 172.21.15.37:0/1413409063 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df9b908a40 con 0x55df9b889260 2024-08-20T05:07:21.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.194+0000 7fcb42a00640 1 --2- 172.21.15.37:0/1413409063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b888940 0x55df9b89d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:07:21.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.194+0000 7fcb42000640 1 --2- 172.21.15.37:0/1413409063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b889260 0x55df9b89d950 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcb340047b0 tx=0x7fcb340a9780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfc0a898c3fa7d3b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:21.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.194+0000 7fcb2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:07:21.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.194+0000 7fcb2cc00640 1 -- 172.21.15.37:0/1413409063 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb340c3070 con 0x55df9b889260 2024-08-20T05:07:21.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.195+0000 7fcb2cc00640 1 -- 172.21.15.37:0/1413409063 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fcb34011a40 con 0x55df9b889260 2024-08-20T05:07:21.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.195+0000 7fcb4c641740 1 -- 172.21.15.37:0/1413409063 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb300035f0 con 0x55df9b889260 2024-08-20T05:07:21.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.195+0000 7fcb2cc00640 1 -- 172.21.15.37:0/1413409063 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fcb340a9ef0 con 0x55df9b889260 2024-08-20T05:07:21.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.195+0000 7fcb4c641740 10 client.26822 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:21.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.195+0000 7fcb4c641740 1 -- 172.21.15.37:0/1413409063 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55df9b89adc0 con 0x55df9b889260 2024-08-20T05:07:21.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.195+0000 7fcb2cc00640 1 -- 172.21.15.37:0/1413409063 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb300035f0 con 0x55df9b889260 2024-08-20T05:07:21.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.195+0000 7fcb2cc00640 1 -- 172.21.15.37:0/1413409063 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fcb340b6050 con 0x55df9b889260 2024-08-20T05:07:21.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.196+0000 7fcb4c641740 10 client.26822 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:21.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.196+0000 7fcb4c641740 10 client.26822 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:07:21.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.196+0000 7fcb4c641740 20 client.26822 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:21.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.196+0000 7fcb4c641740 1 --2- 172.21.15.37:0/1413409063 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55df9b920e20 0x55df9b923240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:21.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.196+0000 7fcb4c641740 4 client.26822 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:07:21.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.196+0000 7fcb4c641740 1 -- 172.21.15.37:0/1413409063 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55df9b7fc490 con 0x55df9b920e20 2024-08-20T05:07:21.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.196+0000 7fcb42a00640 1 --2- 172.21.15.37:0/1413409063 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55df9b920e20 0x55df9b923240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:21.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.197+0000 7fcb42a00640 1 --2- 172.21.15.37:0/1413409063 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55df9b920e20 0x55df9b923240 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f3448ec5e6e462e7 server_cookie=6c74113ebe65463 in_seq=0 out_seq=0 2024-08-20T05:07:21.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.197+0000 7fcb2cc00640 10 client.26822 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:07:21.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.197+0000 7fcb2cc00640 1 -- 172.21.15.37:0/1413409063 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55df9b7fc490 con 0x55df9b920e20 2024-08-20T05:07:21.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.197+0000 7fcb2cc00640 10 client.26822 handle_command_reply: tid=0 2024-08-20T05:07:21.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.198+0000 7fcb4c641740 1 client.26822 shutdown 2024-08-20T05:07:21.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.198+0000 7fcb4c641740 1 -- 172.21.15.37:0/1413409063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b889260 msgr2=0x55df9b89d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:21.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.198+0000 7fcb4c641740 1 --2- 172.21.15.37:0/1413409063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b889260 0x55df9b89d950 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcb340047b0 tx=0x7fcb340a9780 comp rx=0 tx=0).stop 2024-08-20T05:07:21.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.198+0000 7fcb4c641740 1 -- 172.21.15.37:0/1413409063 shutdown_connections 2024-08-20T05:07:21.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.198+0000 7fcb4c641740 1 --2- 172.21.15.37:0/1413409063 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55df9b920e20 0x55df9b923240 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.198+0000 7fcb4c641740 1 --2- 172.21.15.37:0/1413409063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df9b8951f0 0x55df9b908210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.198+0000 7fcb2cc00640 0 client.26822 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:07:21.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.198+0000 7fcb4c641740 1 --2- 172.21.15.37:0/1413409063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df9b889260 0x55df9b89d950 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.198+0000 7fcb4c641740 1 --2- 172.21.15.37:0/1413409063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df9b888940 0x55df9b89d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.198+0000 7fcb4c641740 1 -- 172.21.15.37:0/1413409063 >> 172.21.15.37:0/1413409063 conn(0x55df9b886770 msgr2=0x55df9b893cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:21.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.198+0000 7fcb4c641740 1 -- 172.21.15.37:0/1413409063 shutdown_connections 2024-08-20T05:07:21.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.199+0000 7fcb4c641740 1 -- 172.21.15.37:0/1413409063 wait complete. 2024-08-20T05:07:21.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.199+0000 7fcb4c641740 20 client.26822 trim_cache size 0 max 16384 2024-08-20T05:07:21.201 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:07:21.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.200+0000 7fcb49c00640 1 -- 172.21.15.37:0/3310209011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcb280b3d20 msgr2=0x7fcb280b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:21.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.200+0000 7fcb49c00640 1 --2- 172.21.15.37:0/3310209011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcb280b3d20 0x7fcb280b61e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009f60 tx=0x7fcb3c00d040 comp rx=0 tx=0).stop 2024-08-20T05:07:21.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.200+0000 7fcb49c00640 1 -- 172.21.15.37:0/3310209011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb441042d0 msgr2=0x7fcb44101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:21.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.200+0000 7fcb49c00640 1 --2- 172.21.15.37:0/3310209011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb441042d0 0x7fcb44101660 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcb34009fd0 tx=0x7fcb3400b870 comp rx=0 tx=0).stop 2024-08-20T05:07:21.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.200+0000 7fcb49c00640 1 -- 172.21.15.37:0/3310209011 shutdown_connections 2024-08-20T05:07:21.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.200+0000 7fcb49c00640 1 --2- 172.21.15.37:0/3310209011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcb280b3d20 0x7fcb280b61e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.200+0000 7fcb49c00640 1 --2- 172.21.15.37:0/3310209011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcb4410ce10 0x7fcb44101c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.200+0000 7fcb49c00640 1 --2- 172.21.15.37:0/3310209011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcb441042d0 0x7fcb44101660 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.200+0000 7fcb49c00640 1 --2- 172.21.15.37:0/3310209011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb441039b0 0x7fcb44103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:21.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.200+0000 7fcb49c00640 1 -- 172.21.15.37:0/3310209011 >> 172.21.15.37:0/3310209011 conn(0x7fcb440fd430 msgr2=0x7fcb440fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:21.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.200+0000 7fcb49c00640 1 -- 172.21.15.37:0/3310209011 shutdown_connections 2024-08-20T05:07:21.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:21.201+0000 7fcb49c00640 1 -- 172.21.15.37:0/3310209011 wait complete. 2024-08-20T05:07:21.517 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:21 smithi037 ceph-mon[17265]: pgmap v554: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 917 op/s 2024-08-20T05:07:21.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:21 smithi135 ceph-mon[22342]: pgmap v554: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 917 op/s 2024-08-20T05:07:21.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:21 smithi130 ceph-mon[22007]: pgmap v554: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 MiB/s wr, 917 op/s 2024-08-20T05:07:22.243 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T05:07:22.906 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:07:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 265.0 s, 1445.1 tps, lat 67.700 ms stddev 86.438 2024-08-20T05:07:23.614 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:23 smithi037 ceph-mon[17265]: pgmap v555: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 586 op/s 2024-08-20T05:07:23.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:23 smithi135 ceph-mon[22342]: pgmap v555: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 586 op/s 2024-08-20T05:07:23.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:23 smithi130 ceph-mon[22007]: pgmap v555: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 586 op/s 2024-08-20T05:07:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.961+0000 7f12d5e00640 1 -- 172.21.15.37:0/1902449290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d010ce00 msgr2=0x7f12d010f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.961+0000 7f12d5e00640 1 --2- 172.21.15.37:0/1902449290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d010ce00 0x7f12d010f260 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009ca0 tx=0x7f12c802a8c0 comp rx=0 tx=0).stop 2024-08-20T05:07:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.961+0000 7f12d5e00640 1 -- 172.21.15.37:0/1902449290 shutdown_connections 2024-08-20T05:07:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.961+0000 7f12d5e00640 1 --2- 172.21.15.37:0/1902449290 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d010ce00 0x7f12d010f260 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.961+0000 7f12d5e00640 1 --2- 172.21.15.37:0/1902449290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d01042c0 0x7f12d010c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.961+0000 7f12d5e00640 1 --2- 172.21.15.37:0/1902449290 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12d01039a0 0x7f12d0103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.961+0000 7f12d5e00640 1 -- 172.21.15.37:0/1902449290 >> 172.21.15.37:0/1902449290 conn(0x7f12d00fd400 msgr2=0x7f12d00ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.962+0000 7f12d5e00640 1 -- 172.21.15.37:0/1902449290 shutdown_connections 2024-08-20T05:07:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.962+0000 7f12d5e00640 1 -- 172.21.15.37:0/1902449290 wait complete. 2024-08-20T05:07:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.963+0000 7f12d5e00640 1 Processor -- start 2024-08-20T05:07:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.963+0000 7f12d5e00640 1 -- start start 2024-08-20T05:07:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.964+0000 7f12d5e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12d01039a0 0x7f12d010c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.964+0000 7f12d5e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d01042c0 0x7f12d010a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.964+0000 7f12d5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d010ce00 0x7f12d010aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.964+0000 7f12d5e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12d0110840 con 0x7f12d010ce00 2024-08-20T05:07:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.964+0000 7f12d5e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01106c0 con 0x7f12d01039a0 2024-08-20T05:07:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.964+0000 7f12d5e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01109c0 con 0x7f12d01042c0 2024-08-20T05:07:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.964+0000 7f12ce000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d01042c0 0x7f12d010a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.964+0000 7f12ce000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d01042c0 0x7f12d010a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33386/0 (socket says 172.21.15.37:33386) 2024-08-20T05:07:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.964+0000 7f12ce000640 1 -- 172.21.15.37:0/470194905 learned_addr learned my addr 172.21.15.37:0/470194905 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.964+0000 7f12cea00640 1 --2- 172.21.15.37:0/470194905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12d01039a0 0x7f12d010c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.964+0000 7f12cf400640 1 --2- 172.21.15.37:0/470194905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d010ce00 0x7f12d010aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.965+0000 7f12ce000640 1 -- 172.21.15.37:0/470194905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12d01039a0 msgr2=0x7f12d010c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.965+0000 7f12ce000640 1 --2- 172.21.15.37:0/470194905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12d01039a0 0x7f12d010c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.965+0000 7f12ce000640 1 -- 172.21.15.37:0/470194905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d010ce00 msgr2=0x7f12d010aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.965+0000 7f12ce000640 1 --2- 172.21.15.37:0/470194905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d010ce00 0x7f12d010aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.965+0000 7f12ce000640 1 -- 172.21.15.37:0/470194905 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d010b0d0 con 0x7f12d01042c0 2024-08-20T05:07:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.965+0000 7f12cf400640 1 --2- 172.21.15.37:0/470194905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d010ce00 0x7f12d010aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:07:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.966+0000 7f12ce000640 1 --2- 172.21.15.37:0/470194905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d01042c0 0x7f12d010a520 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00e9c0 tx=0x7f12bc00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.966+0000 7f12d4a00640 1 -- 172.21.15.37:0/470194905 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00ccc0 con 0x7f12d01042c0 2024-08-20T05:07:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.966+0000 7f12d4a00640 1 -- 172.21.15.37:0/470194905 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12bc0035f0 con 0x7f12d01042c0 2024-08-20T05:07:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.966+0000 7f12d4a00640 1 -- 172.21.15.37:0/470194905 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc00ce60 con 0x7f12d01042c0 2024-08-20T05:07:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.967+0000 7f12d5e00640 1 -- 172.21.15.37:0/470194905 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d01abbd0 con 0x7f12d01042c0 2024-08-20T05:07:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.967+0000 7f12d5e00640 1 -- 172.21.15.37:0/470194905 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d01abf70 con 0x7f12d01042c0 2024-08-20T05:07:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.970+0000 7f12d87f5740 1 Processor -- start 2024-08-20T05:07:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.971+0000 7f12d87f5740 1 -- start start 2024-08-20T05:07:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.971+0000 7f12d87f5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e8c940 0x555ee2e8cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.971+0000 7f12d87f5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e8d260 0x555ee2e98cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.971+0000 7f12d87f5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e991f0 0x555ee2e9b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.971+0000 7f12d87f5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555ee2e02aa0 con 0x555ee2e991f0 2024-08-20T05:07:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.971+0000 7f12d87f5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555ee2df1fa0 con 0x555ee2e8d260 2024-08-20T05:07:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.971+0000 7f12d87f5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555ee2df5fe0 con 0x555ee2e8c940 2024-08-20T05:07:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.972+0000 7f12cf400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e8c940 0x555ee2e8cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.972+0000 7f12cf400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e8c940 0x555ee2e8cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33388/0 (socket says 172.21.15.37:33388) 2024-08-20T05:07:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.972+0000 7f12cf400640 1 -- 172.21.15.37:0/389082691 learned_addr learned my addr 172.21.15.37:0/389082691 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.972+0000 7f12cea00640 1 --2- 172.21.15.37:0/389082691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e8d260 0x555ee2e98cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.972+0000 7f12cf400640 1 -- 172.21.15.37:0/389082691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e8d260 msgr2=0x555ee2e98cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:23.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.972+0000 7f12cf400640 1 --2- 172.21.15.37:0/389082691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e8d260 0x555ee2e98cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.972+0000 7f12cf400640 1 -- 172.21.15.37:0/389082691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e991f0 msgr2=0x555ee2e9b5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:07:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.972+0000 7f12cf400640 1 --2- 172.21.15.37:0/389082691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e991f0 0x555ee2e9b5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.972+0000 7f12cf400640 1 -- 172.21.15.37:0/389082691 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ee2d98420 con 0x555ee2e8c940 2024-08-20T05:07:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.973+0000 7f12cf400640 1 --2- 172.21.15.37:0/389082691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e8c940 0x555ee2e8cd20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f12c8035000 tx=0x7f12c8009870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=594377cfd3d17449 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.975+0000 7f12bbe00640 1 -- 172.21.15.37:0/389082691 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c8031cf0 con 0x555ee2e8c940 2024-08-20T05:07:23.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.975+0000 7f12bbe00640 1 -- 172.21.15.37:0/389082691 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12c8036040 con 0x555ee2e8c940 2024-08-20T05:07:23.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.975+0000 7f12bbe00640 1 -- 172.21.15.37:0/389082691 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c8031cf0 con 0x555ee2e8c940 2024-08-20T05:07:23.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.981+0000 7f12d87f5740 1 -- 172.21.15.37:0/389082691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e8c940 msgr2=0x555ee2e8cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:23.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.981+0000 7f12d87f5740 1 --2- 172.21.15.37:0/389082691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e8c940 0x555ee2e8cd20 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f12c8035000 tx=0x7f12c8009870 comp rx=0 tx=0).stop 2024-08-20T05:07:23.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.981+0000 7f12d4a00640 1 -- 172.21.15.37:0/470194905 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f12bc004000 con 0x7f12d01042c0 2024-08-20T05:07:23.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.983+0000 7f12d87f5740 1 -- 172.21.15.37:0/389082691 shutdown_connections 2024-08-20T05:07:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.983+0000 7f12d87f5740 1 --2- 172.21.15.37:0/389082691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e991f0 0x555ee2e9b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.983+0000 7f12d87f5740 1 --2- 172.21.15.37:0/389082691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e8d260 0x555ee2e98cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.983+0000 7f12d87f5740 1 --2- 172.21.15.37:0/389082691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e8c940 0x555ee2e8cd20 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.983+0000 7f12d87f5740 1 -- 172.21.15.37:0/389082691 >> 172.21.15.37:0/389082691 conn(0x555ee2e8a770 msgr2=0x555ee2e8b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.983+0000 7f12d4a00640 1 --2- 172.21.15.37:0/470194905 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f12b40b3de0 0x7f12b40b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:23.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.985+0000 7f12d87f5740 1 -- 172.21.15.37:0/389082691 shutdown_connections 2024-08-20T05:07:23.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.985+0000 7f12d87f5740 1 -- 172.21.15.37:0/389082691 wait complete. 2024-08-20T05:07:23.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.985+0000 7f12d4a00640 1 -- 172.21.15.37:0/470194905 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f12bc0e4260 con 0x7f12d01042c0 2024-08-20T05:07:23.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.986+0000 7f12d87f5740 1 -- start start 2024-08-20T05:07:23.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.986+0000 7f12d87f5740 1 Processor -- start 2024-08-20T05:07:23.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.986+0000 7f12cea00640 1 --2- 172.21.15.37:0/470194905 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f12b40b3de0 0x7f12b40b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:23.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.987+0000 7f12d87f5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 0x555ee2e98990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:23.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.987+0000 7f12d87f5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e8d260 0x555ee2e95de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:23.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.987+0000 7f12d87f5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e991f0 0x555ee2e96320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:23.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.987+0000 7f12d87f5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555ee2c54700 con 0x555ee2e8c940 2024-08-20T05:07:23.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.987+0000 7f12d87f5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555ee2d8d290 con 0x555ee2e8d260 2024-08-20T05:07:23.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.987+0000 7f12d87f5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555ee2e9be10 con 0x555ee2e991f0 2024-08-20T05:07:23.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.987+0000 7f12d87f5740 10 client.0 _ll_register_callbacks cb 0x555ee2dec1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:23.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.987+0000 7f12cf400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e991f0 0x555ee2e96320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:23.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.987+0000 7f12cf400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e991f0 0x555ee2e96320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33396/0 (socket says 172.21.15.37:33396) 2024-08-20T05:07:23.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.987+0000 7f12cf400640 1 -- 172.21.15.37:0/2825098371 learned_addr learned my addr 172.21.15.37:0/2825098371 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:23.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.988+0000 7f12ce000640 1 --2- 172.21.15.37:0/2825098371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e8d260 0x555ee2e95de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.990+0000 7f12cea00640 1 --2- 172.21.15.37:0/2825098371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 0x555ee2e98990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:23.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.990+0000 7f12ce000640 1 -- 172.21.15.37:0/2825098371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e991f0 msgr2=0x555ee2e96320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:23.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.990+0000 7f12ce000640 1 --2- 172.21.15.37:0/2825098371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e991f0 0x555ee2e96320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:23.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.991+0000 7f12ce000640 1 -- 172.21.15.37:0/2825098371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 msgr2=0x555ee2e98990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:23.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.991+0000 7f12ce000640 1 --2- 172.21.15.37:0/2825098371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 0x555ee2e98990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:23.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.991+0000 7f12ce000640 1 -- 172.21.15.37:0/2825098371 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ee2b51650 con 0x555ee2e8d260 2024-08-20T05:07:23.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.991+0000 7f12cea00640 1 --2- 172.21.15.37:0/2825098371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 0x555ee2e98990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:23.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.991+0000 7f12cea00640 1 --2- 172.21.15.37:0/470194905 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f12b40b3de0 0x7f12b40b62a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x555ee2e8b650 tx=0x7f12c0009f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:23.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.992+0000 7f12ce000640 1 --2- 172.21.15.37:0/2825098371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e8d260 0x555ee2e95de0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0058c0 tx=0x7f12bc0aaa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec0ea29eb975e196 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:23.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.992+0000 7f12b8c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:07:23.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.993+0000 7f12b8c00640 1 -- 172.21.15.37:0/2825098371 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12bc0aadb0 con 0x555ee2e8d260 2024-08-20T05:07:23.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.993+0000 7f12b8c00640 1 -- 172.21.15.37:0/2825098371 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f12bc003a50 con 0x555ee2e8d260 2024-08-20T05:07:23.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.993+0000 7f12d87f5740 1 -- 172.21.15.37:0/2825098371 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12c8036040 con 0x555ee2e8d260 2024-08-20T05:07:23.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.993+0000 7f12b8c00640 1 -- 172.21.15.37:0/2825098371 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f12bc0af3b0 con 0x555ee2e8d260 2024-08-20T05:07:23.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.994+0000 7f12d87f5740 10 client.26831 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:23.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.994+0000 7f12d87f5740 1 -- 172.21.15.37:0/2825098371 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x555ee2ea75e0 con 0x555ee2e8d260 2024-08-20T05:07:23.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.995+0000 7f12b8c00640 1 -- 172.21.15.37:0/2825098371 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12c8036040 con 0x555ee2e8d260 2024-08-20T05:07:23.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.997+0000 7f12b8c00640 1 -- 172.21.15.37:0/2825098371 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f12bc0a9a80 con 0x555ee2e8d260 2024-08-20T05:07:24.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.999+0000 7f12d87f5740 10 client.26831 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:24.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.999+0000 7f12d87f5740 10 client.26831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:07:24.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.999+0000 7f12d87f5740 20 client.26831 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:24.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.999+0000 7f12d87f5740 1 --2- 172.21.15.37:0/2825098371 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x555ee2ea8aa0 0x555ee2eaaee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:24.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:23.999+0000 7f12d87f5740 4 client.26831 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:07:24.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.000+0000 7f12cea00640 1 --2- 172.21.15.37:0/2825098371 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x555ee2ea8aa0 0x555ee2eaaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:24.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.000+0000 7f12d87f5740 1 -- 172.21.15.37:0/2825098371 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ee2e049f0 con 0x555ee2ea8aa0 2024-08-20T05:07:24.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.000+0000 7f12cea00640 1 --2- 172.21.15.37:0/2825098371 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x555ee2ea8aa0 0x555ee2eaaee0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53b2f27643ce1635 server_cookie=cae8ba033e78ae7d in_seq=0 out_seq=0 2024-08-20T05:07:24.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.001+0000 7f12b8c00640 10 client.26831 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:24.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.002+0000 7f12b8c00640 1 -- 172.21.15.37:0/2825098371 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555ee2e049f0 con 0x555ee2ea8aa0 2024-08-20T05:07:24.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.002+0000 7f12b8c00640 10 client.26831 handle_command_reply: tid=0 2024-08-20T05:07:24.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.002+0000 7f12d87f5740 1 client.26831 shutdown 2024-08-20T05:07:24.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.002+0000 7f12d87f5740 1 -- 172.21.15.37:0/2825098371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e8d260 msgr2=0x555ee2e95de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:24.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.002+0000 7f12d87f5740 1 --2- 172.21.15.37:0/2825098371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e8d260 0x555ee2e95de0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0058c0 tx=0x7f12bc0aaa00 comp rx=0 tx=0).stop 2024-08-20T05:07:24.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.003+0000 7f12d87f5740 1 -- 172.21.15.37:0/2825098371 shutdown_connections 2024-08-20T05:07:24.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.003+0000 7f12d87f5740 1 --2- 172.21.15.37:0/2825098371 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x555ee2ea8aa0 0x555ee2eaaee0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.003+0000 7f12d87f5740 1 --2- 172.21.15.37:0/2825098371 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e991f0 0x555ee2e96320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.003+0000 7f12d87f5740 1 --2- 172.21.15.37:0/2825098371 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e8d260 0x555ee2e95de0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.003+0000 7f12d87f5740 1 --2- 172.21.15.37:0/2825098371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 0x555ee2e98990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.003+0000 7f12b8c00640 0 client.26831 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:24.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.003+0000 7f12d87f5740 1 -- 172.21.15.37:0/2825098371 >> 172.21.15.37:0/2825098371 conn(0x555ee2e8a770 msgr2=0x555ee2e90310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:24.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.003+0000 7f12d87f5740 1 -- 172.21.15.37:0/2825098371 shutdown_connections 2024-08-20T05:07:24.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.004+0000 7f12d87f5740 1 -- 172.21.15.37:0/2825098371 wait complete. 2024-08-20T05:07:24.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.004+0000 7f12d87f5740 20 client.26831 trim_cache size 0 max 16384 2024-08-20T05:07:24.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.051+0000 7f12d87f5740 1 Processor -- start 2024-08-20T05:07:24.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.051+0000 7f12d87f5740 1 -- start start 2024-08-20T05:07:24.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.052+0000 7f12d87f5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 0x555ee2ea4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:24.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.052+0000 7f12d87f5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e8d260 0x555ee2e91480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:24.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.052+0000 7f12d87f5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e991f0 0x555ee2e97b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:24.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.052+0000 7f12d87f5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01b5d90 con 0x555ee2e8c940 2024-08-20T05:07:24.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.052+0000 7f12d87f5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01b78d0 con 0x555ee2e8d260 2024-08-20T05:07:24.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.052+0000 7f12d87f5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01b6460 con 0x555ee2e991f0 2024-08-20T05:07:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.052+0000 7f12cf400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e991f0 0x555ee2e97b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.052+0000 7f12cf400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e991f0 0x555ee2e97b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33408/0 (socket says 172.21.15.37:33408) 2024-08-20T05:07:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.052+0000 7f12cf400640 1 -- 172.21.15.37:0/732094082 learned_addr learned my addr 172.21.15.37:0/732094082 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.053+0000 7f12cf400640 1 -- 172.21.15.37:0/732094082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e8d260 msgr2=0x555ee2e91480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.053+0000 7f12ce000640 1 --2- 172.21.15.37:0/732094082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e8d260 0x555ee2e91480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.053+0000 7f12cf400640 1 --2- 172.21.15.37:0/732094082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e8d260 0x555ee2e91480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.053+0000 7f12cf400640 1 -- 172.21.15.37:0/732094082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 msgr2=0x555ee2ea4f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:07:24.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.053+0000 7f12cea00640 1 --2- 172.21.15.37:0/732094082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 0x555ee2ea4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:24.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.053+0000 7f12cf400640 1 --2- 172.21.15.37:0/732094082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 0x555ee2ea4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.053+0000 7f12cf400640 1 -- 172.21.15.37:0/732094082 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ee2e8b450 con 0x555ee2e991f0 2024-08-20T05:07:24.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.054+0000 7f12cf400640 1 --2- 172.21.15.37:0/732094082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e991f0 0x555ee2e97b20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009bf0 tx=0x7f12c8003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af7b6a8be13531a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:24.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.054+0000 7f12ce000640 1 --2- 172.21.15.37:0/732094082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e8d260 0x555ee2e91480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:24.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.054+0000 7f12bb400640 1 -- 172.21.15.37:0/732094082 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c8052020 con 0x555ee2e991f0 2024-08-20T05:07:24.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.054+0000 7f12bb400640 1 -- 172.21.15.37:0/732094082 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12c8036040 con 0x555ee2e991f0 2024-08-20T05:07:24.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.054+0000 7f12bb400640 1 -- 172.21.15.37:0/732094082 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c804a040 con 0x555ee2e991f0 2024-08-20T05:07:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.056+0000 7f12d87f5740 1 -- 172.21.15.37:0/732094082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e991f0 msgr2=0x555ee2e97b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:24.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.056+0000 7f12d87f5740 1 --2- 172.21.15.37:0/732094082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e991f0 0x555ee2e97b20 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009bf0 tx=0x7f12c8003970 comp rx=0 tx=0).stop 2024-08-20T05:07:24.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.057+0000 7f12d87f5740 1 -- 172.21.15.37:0/732094082 shutdown_connections 2024-08-20T05:07:24.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.057+0000 7f12d87f5740 1 --2- 172.21.15.37:0/732094082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e991f0 0x555ee2e97b20 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.057+0000 7f12d87f5740 1 --2- 172.21.15.37:0/732094082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e8d260 0x555ee2e91480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.057+0000 7f12d87f5740 1 --2- 172.21.15.37:0/732094082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 0x555ee2ea4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.057+0000 7f12d87f5740 1 -- 172.21.15.37:0/732094082 >> 172.21.15.37:0/732094082 conn(0x555ee2e8a770 msgr2=0x555ee2e97410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:24.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.057+0000 7f12d87f5740 1 -- 172.21.15.37:0/732094082 shutdown_connections 2024-08-20T05:07:24.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.057+0000 7f12d87f5740 1 -- 172.21.15.37:0/732094082 wait complete. 2024-08-20T05:07:24.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.057+0000 7f12d87f5740 1 -- start start 2024-08-20T05:07:24.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.058+0000 7f12d87f5740 1 Processor -- start 2024-08-20T05:07:24.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.058+0000 7f12d87f5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 0x555ee2e9d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:24.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.059+0000 7f12d87f5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e8d260 0x555ee2e9d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:24.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.061+0000 7f12cea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 0x555ee2e9d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:24.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.061+0000 7f12d87f5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e991f0 0x555ee2e9daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:24.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.061+0000 7f12d87f5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01b7200 con 0x555ee2e8c940 2024-08-20T05:07:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.061+0000 7f12d87f5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01b6b30 con 0x555ee2e991f0 2024-08-20T05:07:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.061+0000 7f12d87f5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01b3d70 con 0x555ee2e8d260 2024-08-20T05:07:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.061+0000 7f12cea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 0x555ee2e9d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35634/0 (socket says 172.21.15.37:35634) 2024-08-20T05:07:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.061+0000 7f12cea00640 1 -- 172.21.15.37:0/2998605852 learned_addr learned my addr 172.21.15.37:0/2998605852 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.061+0000 7f12d87f5740 10 client.0 _ll_register_callbacks cb 0x7f12bc0aa520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.062+0000 7f12ce000640 1 --2- 172.21.15.37:0/2998605852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e8d260 0x555ee2e9d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.062+0000 7f12cea00640 1 -- 172.21.15.37:0/2998605852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e8d260 msgr2=0x555ee2e9d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.062+0000 7f12cea00640 1 --2- 172.21.15.37:0/2998605852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e8d260 0x555ee2e9d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.062+0000 7f12cea00640 1 -- 172.21.15.37:0/2998605852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e991f0 msgr2=0x555ee2e9daf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:07:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.062+0000 7f12cea00640 1 --2- 172.21.15.37:0/2998605852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e991f0 0x555ee2e9daf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.062+0000 7f12cea00640 1 -- 172.21.15.37:0/2998605852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ee2f12980 con 0x555ee2e8c940 2024-08-20T05:07:24.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.062+0000 7f12ce000640 1 --2- 172.21.15.37:0/2998605852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e8d260 0x555ee2e9d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.065+0000 7f12cea00640 1 --2- 172.21.15.37:0/2998605852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 0x555ee2e9d070 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f12c00138f0 tx=0x7f12c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356eaba013d1365b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.065+0000 7f12b8c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:07:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.065+0000 7f12b8c00640 1 -- 172.21.15.37:0/2998605852 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c0019040 con 0x555ee2e8c940 2024-08-20T05:07:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.065+0000 7f12d87f5740 1 -- 172.21.15.37:0/2998605852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12c8036040 con 0x555ee2e8c940 2024-08-20T05:07:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.066+0000 7f12b8c00640 1 -- 172.21.15.37:0/2998605852 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f12c00297c0 con 0x555ee2e8c940 2024-08-20T05:07:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.066+0000 7f12b8c00640 1 -- 172.21.15.37:0/2998605852 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f12c0038050 con 0x555ee2e8c940 2024-08-20T05:07:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.066+0000 7f12d87f5740 10 client.16560 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.066+0000 7f12d87f5740 1 -- 172.21.15.37:0/2998605852 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x555ee2f13c90 con 0x555ee2e8c940 2024-08-20T05:07:24.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.067+0000 7f12b8c00640 1 -- 172.21.15.37:0/2998605852 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12c8036040 con 0x555ee2e8c940 2024-08-20T05:07:24.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.067+0000 7f12b8c00640 1 -- 172.21.15.37:0/2998605852 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f12c0020c10 con 0x555ee2e8c940 2024-08-20T05:07:24.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.067+0000 7f12d87f5740 10 client.16560 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:24.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.067+0000 7f12d87f5740 10 client.16560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:07:24.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.067+0000 7f12d87f5740 20 client.16560 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:24.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.067+0000 7f12d87f5740 1 --2- 172.21.15.37:0/2998605852 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x555ee2f14440 0x555ee2f16860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:24.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.067+0000 7f12d87f5740 4 client.16560 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:07:24.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.067+0000 7f12d87f5740 1 -- 172.21.15.37:0/2998605852 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555ee2e00490 con 0x555ee2f14440 2024-08-20T05:07:24.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.068+0000 7f12ce000640 1 --2- 172.21.15.37:0/2998605852 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x555ee2f14440 0x555ee2f16860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:24.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.068+0000 7f12ce000640 1 --2- 172.21.15.37:0/2998605852 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x555ee2f14440 0x555ee2f16860 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a347c2abeb5ebcbf server_cookie=b14cc7048a0b97db in_seq=0 out_seq=0 2024-08-20T05:07:24.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.068+0000 7f12b8c00640 10 client.16560 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:24.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.070+0000 7f12b8c00640 1 -- 172.21.15.37:0/2998605852 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555ee2e00490 con 0x555ee2f14440 2024-08-20T05:07:24.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.070+0000 7f12b8c00640 10 client.16560 handle_command_reply: tid=0 2024-08-20T05:07:24.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.070+0000 7f12d87f5740 1 client.16560 shutdown 2024-08-20T05:07:24.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.070+0000 7f12d87f5740 1 -- 172.21.15.37:0/2998605852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 msgr2=0x555ee2e9d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:24.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.070+0000 7f12d87f5740 1 --2- 172.21.15.37:0/2998605852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 0x555ee2e9d070 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f12c00138f0 tx=0x7f12c00046c0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.070+0000 7f12d87f5740 1 -- 172.21.15.37:0/2998605852 shutdown_connections 2024-08-20T05:07:24.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.070+0000 7f12d87f5740 1 --2- 172.21.15.37:0/2998605852 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x555ee2f14440 0x555ee2f16860 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.070+0000 7f12d87f5740 1 --2- 172.21.15.37:0/2998605852 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555ee2e991f0 0x555ee2e9daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.070+0000 7f12d87f5740 1 --2- 172.21.15.37:0/2998605852 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555ee2e8d260 0x555ee2e9d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.070+0000 7f12d87f5740 1 --2- 172.21.15.37:0/2998605852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555ee2e8c940 0x555ee2e9d070 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.070+0000 7f12d87f5740 1 -- 172.21.15.37:0/2998605852 >> 172.21.15.37:0/2998605852 conn(0x555ee2e8a770 msgr2=0x555ee2e97c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:24.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.070+0000 7f12b8c00640 0 client.16560 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:24.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.071+0000 7f12d87f5740 1 -- 172.21.15.37:0/2998605852 shutdown_connections 2024-08-20T05:07:24.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.071+0000 7f12d87f5740 1 -- 172.21.15.37:0/2998605852 wait complete. 2024-08-20T05:07:24.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.071+0000 7f12d87f5740 20 client.16560 trim_cache size 0 max 16384 2024-08-20T05:07:24.074 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:07:24.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.072+0000 7f12d5e00640 1 -- 172.21.15.37:0/470194905 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f12b40b3de0 msgr2=0x7f12b40b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:24.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.072+0000 7f12d5e00640 1 --2- 172.21.15.37:0/470194905 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f12b40b3de0 0x7f12b40b62a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x555ee2e8b650 tx=0x7f12c0009f50 comp rx=0 tx=0).stop 2024-08-20T05:07:24.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.072+0000 7f12d5e00640 1 -- 172.21.15.37:0/470194905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d01042c0 msgr2=0x7f12d010a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:24.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.072+0000 7f12d5e00640 1 --2- 172.21.15.37:0/470194905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d01042c0 0x7f12d010a520 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f12bc00e9c0 tx=0x7f12bc00ee80 comp rx=0 tx=0).stop 2024-08-20T05:07:24.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.072+0000 7f12d5e00640 1 -- 172.21.15.37:0/470194905 shutdown_connections 2024-08-20T05:07:24.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.072+0000 7f12d5e00640 1 --2- 172.21.15.37:0/470194905 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f12b40b3de0 0x7f12b40b62a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.072+0000 7f12d5e00640 1 --2- 172.21.15.37:0/470194905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12d010ce00 0x7f12d010aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.072+0000 7f12d5e00640 1 --2- 172.21.15.37:0/470194905 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f12d01042c0 0x7f12d010a520 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.072+0000 7f12d5e00640 1 --2- 172.21.15.37:0/470194905 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f12d01039a0 0x7f12d010c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:24.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.072+0000 7f12d5e00640 1 -- 172.21.15.37:0/470194905 >> 172.21.15.37:0/470194905 conn(0x7f12d00fd400 msgr2=0x7f12d0113010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:24.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.073+0000 7f12d5e00640 1 -- 172.21.15.37:0/470194905 shutdown_connections 2024-08-20T05:07:24.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:24.074+0000 7f12d5e00640 1 -- 172.21.15.37:0/470194905 wait complete. 2024-08-20T05:07:25.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.122+0000 7fe2a4000640 1 -- 172.21.15.37:0/3514988351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c10a5b0 msgr2=0x7fe29c10ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:25.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.122+0000 7fe2a4000640 1 --2- 172.21.15.37:0/3514988351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c10a5b0 0x7fe29c10ca50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe294009be0 tx=0x7fe29402a6c0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.123+0000 7fe2a4000640 1 -- 172.21.15.37:0/3514988351 shutdown_connections 2024-08-20T05:07:25.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.123+0000 7fe2a4000640 1 --2- 172.21.15.37:0/3514988351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c10a5b0 0x7fe29c10ca50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.123+0000 7fe2a4000640 1 --2- 172.21.15.37:0/3514988351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe29c1035b0 0x7fe29c109ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.123+0000 7fe2a4000640 1 --2- 172.21.15.37:0/3514988351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe29c102c70 0x7fe29c103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.123+0000 7fe2a4000640 1 -- 172.21.15.37:0/3514988351 >> 172.21.15.37:0/3514988351 conn(0x7fe29c0fc580 msgr2=0x7fe29c0fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:25.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.123+0000 7fe2a4000640 1 -- 172.21.15.37:0/3514988351 shutdown_connections 2024-08-20T05:07:25.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.124+0000 7fe2a4000640 1 -- 172.21.15.37:0/3514988351 wait complete. 2024-08-20T05:07:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.126+0000 7fe2a4000640 1 Processor -- start 2024-08-20T05:07:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.126+0000 7fe2a4000640 1 -- start start 2024-08-20T05:07:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.126+0000 7fe2a4000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe29c102c70 0x7fe29c19ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.126+0000 7fe2a4000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe29c1035b0 0x7fe29c19b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.126+0000 7fe2a4000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c10a5b0 0x7fe29c19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.126+0000 7fe2a4000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1104c0 con 0x7fe29c1035b0 2024-08-20T05:07:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.126+0000 7fe2a4000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c110340 con 0x7fe29c102c70 2024-08-20T05:07:25.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.126+0000 7fe2a4000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c110640 con 0x7fe29c10a5b0 2024-08-20T05:07:25.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.127+0000 7fe2a1600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe29c102c70 0x7fe29c19ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:25.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.127+0000 7fe2a1600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe29c102c70 0x7fe29c19ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:57980/0 (socket says 172.21.15.37:57980) 2024-08-20T05:07:25.128 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.127+0000 7fe2a1600640 1 -- 172.21.15.37:0/499701672 learned_addr learned my addr 172.21.15.37:0/499701672 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.127+0000 7fe2a0c00640 1 --2- 172.21.15.37:0/499701672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe29c1035b0 0x7fe29c19b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.127+0000 7fe2a2000640 1 --2- 172.21.15.37:0/499701672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c10a5b0 0x7fe29c19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.127+0000 7fe2a1600640 1 -- 172.21.15.37:0/499701672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c10a5b0 msgr2=0x7fe29c19be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.127+0000 7fe2a1600640 1 --2- 172.21.15.37:0/499701672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c10a5b0 0x7fe29c19be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.127+0000 7fe2a1600640 1 -- 172.21.15.37:0/499701672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe29c1035b0 msgr2=0x7fe29c19b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.127+0000 7fe2a1600640 1 --2- 172.21.15.37:0/499701672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe29c1035b0 0x7fe29c19b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.127+0000 7fe2a1600640 1 -- 172.21.15.37:0/499701672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe29c19c750 con 0x7fe29c102c70 2024-08-20T05:07:25.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.128+0000 7fe2a1600640 1 --2- 172.21.15.37:0/499701672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe29c102c70 0x7fe29c19ac10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe29000e9c0 tx=0x7fe29000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.128+0000 7fe29a000640 1 -- 172.21.15.37:0/499701672 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29000cde0 con 0x7fe29c102c70 2024-08-20T05:07:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.128+0000 7fe29a000640 1 -- 172.21.15.37:0/499701672 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2900035f0 con 0x7fe29c102c70 2024-08-20T05:07:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.128+0000 7fe2a4000640 1 -- 172.21.15.37:0/499701672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe29c19ca40 con 0x7fe29c102c70 2024-08-20T05:07:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.128+0000 7fe29a000640 1 -- 172.21.15.37:0/499701672 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe290010690 con 0x7fe29c102c70 2024-08-20T05:07:25.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.128+0000 7fe2a4000640 1 -- 172.21.15.37:0/499701672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe29c1a3110 con 0x7fe29c102c70 2024-08-20T05:07:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.134+0000 7fe2a6ff6740 1 Processor -- start 2024-08-20T05:07:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.135+0000 7fe2a6ff6740 1 -- start start 2024-08-20T05:07:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.135+0000 7fe2a6ff6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e34032b0 0x5572e34056a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.135+0000 7fe2a6ff6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3405be0 0x5572e3407fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.135+0000 7fe2a6ff6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3408620 0x5572e340aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.135+0000 7fe2a6ff6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5572e3376210 con 0x5572e34032b0 2024-08-20T05:07:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.135+0000 7fe2a6ff6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5572e3365710 con 0x5572e3408620 2024-08-20T05:07:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.135+0000 7fe2a6ff6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5572e3369750 con 0x5572e3405be0 2024-08-20T05:07:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.136+0000 7fe2a0c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3408620 0x5572e340aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.136+0000 7fe2a0c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3408620 0x5572e340aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:57988/0 (socket says 172.21.15.37:57988) 2024-08-20T05:07:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.136+0000 7fe2a0c00640 1 -- 172.21.15.37:0/1138962039 learned_addr learned my addr 172.21.15.37:0/1138962039 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.136+0000 7fe2a2000640 1 --2- 172.21.15.37:0/1138962039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e34032b0 0x5572e34056a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.136+0000 7fe2a0c00640 1 -- 172.21.15.37:0/1138962039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3405be0 msgr2=0x5572e3407fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:07:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.136+0000 7fe2a0c00640 1 --2- 172.21.15.37:0/1138962039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3405be0 0x5572e3407fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.136+0000 7fe2a0c00640 1 -- 172.21.15.37:0/1138962039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e34032b0 msgr2=0x5572e34056a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.136+0000 7fe2a0c00640 1 --2- 172.21.15.37:0/1138962039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e34032b0 0x5572e34056a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.136+0000 7fe2a0c00640 1 -- 172.21.15.37:0/1138962039 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572e3331de0 con 0x5572e3408620 2024-08-20T05:07:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.136+0000 7fe2a0c00640 1 --2- 172.21.15.37:0/1138962039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3408620 0x5572e340aae0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe288009780 tx=0x7fe288009c40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce8f4b4488f333ab server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.137+0000 7fe28e600640 1 -- 172.21.15.37:0/1138962039 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe288014070 con 0x5572e3408620 2024-08-20T05:07:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.137+0000 7fe28e600640 1 -- 172.21.15.37:0/1138962039 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe288017360 con 0x5572e3408620 2024-08-20T05:07:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.137+0000 7fe28e600640 1 -- 172.21.15.37:0/1138962039 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe28800f810 con 0x5572e3408620 2024-08-20T05:07:25.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.138+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/1138962039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3408620 msgr2=0x5572e340aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:25.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.138+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/1138962039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3408620 0x5572e340aae0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe288009780 tx=0x7fe288009c40 comp rx=0 tx=0).stop 2024-08-20T05:07:25.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.139+0000 7fe29a000640 1 -- 172.21.15.37:0/499701672 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe290004020 con 0x7fe29c102c70 2024-08-20T05:07:25.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.141+0000 7fe29a000640 1 --2- 172.21.15.37:0/499701672 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe2840b3d60 0x7fe2840b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.142+0000 7fe29a000640 1 -- 172.21.15.37:0/499701672 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe2900e4380 con 0x7fe29c102c70 2024-08-20T05:07:25.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.142+0000 7fe2a2000640 1 --2- 172.21.15.37:0/499701672 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe2840b3d60 0x7fe2840b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:25.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.144+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/1138962039 shutdown_connections 2024-08-20T05:07:25.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.144+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/1138962039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3408620 0x5572e340aae0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.144+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/1138962039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3405be0 0x5572e3407fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.144+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/1138962039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e34032b0 0x5572e34056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.144+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/1138962039 >> 172.21.15.37:0/1138962039 conn(0x5572e33fe3b0 msgr2=0x5572e33ff190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:25.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.144+0000 7fe2a2000640 1 --2- 172.21.15.37:0/499701672 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe2840b3d60 0x7fe2840b6220 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe294006010 tx=0x7fe294005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:25.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.145+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/1138962039 shutdown_connections 2024-08-20T05:07:25.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.145+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/1138962039 wait complete. 2024-08-20T05:07:25.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.146+0000 7fe2a6ff6740 1 -- start start 2024-08-20T05:07:25.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.147+0000 7fe2a6ff6740 1 Processor -- start 2024-08-20T05:07:25.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.148+0000 7fe2a6ff6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e34032b0 0x5572e340cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.149+0000 7fe2a6ff6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3405be0 0x5572e340d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.149+0000 7fe2a6ff6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3408620 0x5572e340df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.149+0000 7fe2a6ff6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5572e329eab0 con 0x5572e34032b0 2024-08-20T05:07:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.149+0000 7fe2a6ff6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5572e330c140 con 0x5572e3405be0 2024-08-20T05:07:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.149+0000 7fe2a6ff6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5572e340b600 con 0x5572e3408620 2024-08-20T05:07:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.149+0000 7fe2a2000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3408620 0x5572e340df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.149+0000 7fe2a0c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3405be0 0x5572e340d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.149+0000 7fe2a2000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3408620 0x5572e340df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33450/0 (socket says 172.21.15.37:33450) 2024-08-20T05:07:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.149+0000 7fe2a0c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3405be0 0x5572e340d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:57994/0 (socket says 172.21.15.37:57994) 2024-08-20T05:07:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.149+0000 7fe2a2000640 1 -- 172.21.15.37:0/4059718577 learned_addr learned my addr 172.21.15.37:0/4059718577 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.149+0000 7fe2a2000640 1 -- 172.21.15.37:0/4059718577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3405be0 msgr2=0x5572e340d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:25.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.149+0000 7fe2a2000640 1 --2- 172.21.15.37:0/4059718577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3405be0 0x5572e340d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.149+0000 7fe2a2000640 1 -- 172.21.15.37:0/4059718577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e34032b0 msgr2=0x5572e340cd10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:07:25.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.149+0000 7fe2a2000640 1 --2- 172.21.15.37:0/4059718577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e34032b0 0x5572e340cd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.149+0000 7fe2a2000640 1 -- 172.21.15.37:0/4059718577 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572e330d170 con 0x5572e3408620 2024-08-20T05:07:25.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.150+0000 7fe2a6ff6740 10 client.0 _ll_register_callbacks cb 0x5572e331f5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:25.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.150+0000 7fe2a2000640 1 --2- 172.21.15.37:0/4059718577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3408620 0x5572e340df80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe294009be0 tx=0x7fe29402a6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c75c8607f95ac3d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:25.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.150+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/4059718577 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5572e333ca30 con 0x5572e3408620 2024-08-20T05:07:25.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.150+0000 7fe282a00640 10 client.26860 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:07:25.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.150+0000 7fe282a00640 1 -- 172.21.15.37:0/4059718577 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe294036040 con 0x5572e3408620 2024-08-20T05:07:25.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.150+0000 7fe282a00640 1 -- 172.21.15.37:0/4059718577 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe294004040 con 0x5572e3408620 2024-08-20T05:07:25.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.150+0000 7fe282a00640 1 -- 172.21.15.37:0/4059718577 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe294004240 con 0x5572e3408620 2024-08-20T05:07:25.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.151+0000 7fe2a6ff6740 10 client.26860 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:25.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.151+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/4059718577 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({fsmap=36}) -- 0x5572e30c8790 con 0x5572e3408620 2024-08-20T05:07:25.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.152+0000 7fe282a00640 1 -- 172.21.15.37:0/4059718577 <== mon.1 v2:172.21.15.135:3300/0 4 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fe29403c040 con 0x5572e3408620 2024-08-20T05:07:25.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.152+0000 7fe2a6ff6740 10 client.26860 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:25.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.152+0000 7fe2a6ff6740 10 client.26860 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:07:25.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.152+0000 7fe2a6ff6740 20 client.26860 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:25.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.152+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/4059718577 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5572e34187f0 0x5572e341ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.152+0000 7fe2a6ff6740 4 client.26860 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:07:25.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.152+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/4059718577 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572e3378160 con 0x5572e34187f0 2024-08-20T05:07:25.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.152+0000 7fe2a1600640 1 --2- 172.21.15.37:0/4059718577 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5572e34187f0 0x5572e341ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:25.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.153+0000 7fe2a1600640 1 --2- 172.21.15.37:0/4059718577 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5572e34187f0 0x5572e341ac90 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d824d90755b900de server_cookie=5cd9eca95b1a8b56 in_seq=0 out_seq=0 2024-08-20T05:07:25.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.153+0000 7fe282a00640 10 client.26860 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:25.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.154+0000 7fe282a00640 1 -- 172.21.15.37:0/4059718577 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572e3378160 con 0x5572e34187f0 2024-08-20T05:07:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.154+0000 7fe282a00640 10 client.26860 handle_command_reply: tid=0 2024-08-20T05:07:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.154+0000 7fe2a6ff6740 1 client.26860 shutdown 2024-08-20T05:07:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.155+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/4059718577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3408620 msgr2=0x5572e340df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.155+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/4059718577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3408620 0x5572e340df80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe294009be0 tx=0x7fe29402a6c0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.155+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/4059718577 shutdown_connections 2024-08-20T05:07:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.155+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/4059718577 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5572e34187f0 0x5572e341ac90 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.155+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/4059718577 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3408620 0x5572e340df80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.155+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/4059718577 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3405be0 0x5572e340d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.155+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/4059718577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e34032b0 0x5572e340cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.155+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/4059718577 >> 172.21.15.37:0/4059718577 conn(0x5572e33fe3b0 msgr2=0x5572e33fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:25.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.155+0000 7fe282a00640 0 client.26860 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:25.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.156+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/4059718577 shutdown_connections 2024-08-20T05:07:25.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.156+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/4059718577 wait complete. 2024-08-20T05:07:25.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.156+0000 7fe2a6ff6740 20 client.26860 trim_cache size 0 max 16384 2024-08-20T05:07:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.189+0000 7fe2a6ff6740 1 Processor -- start 2024-08-20T05:07:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.189+0000 7fe2a6ff6740 1 -- start start 2024-08-20T05:07:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.189+0000 7fe2a6ff6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e34032b0 0x5572e340beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.189+0000 7fe2a6ff6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3405be0 0x5572e340c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.189+0000 7fe2a6ff6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e3408620 0x5572e3408a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.189+0000 7fe2a6ff6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1a90c0 con 0x5572e3408620 2024-08-20T05:07:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.189+0000 7fe2a6ff6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1aac00 con 0x5572e34032b0 2024-08-20T05:07:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.189+0000 7fe2a6ff6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1a9790 con 0x5572e3405be0 2024-08-20T05:07:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.189+0000 7fe2a0c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3405be0 0x5572e340c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.190+0000 7fe2a0c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3405be0 0x5572e340c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33456/0 (socket says 172.21.15.37:33456) 2024-08-20T05:07:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.190+0000 7fe2a0c00640 1 -- 172.21.15.37:0/2879455767 learned_addr learned my addr 172.21.15.37:0/2879455767 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.190+0000 7fe2a2000640 1 --2- 172.21.15.37:0/2879455767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e3408620 0x5572e3408a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.190+0000 7fe2a1600640 1 --2- 172.21.15.37:0/2879455767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e34032b0 0x5572e340beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.190+0000 7fe2a0c00640 1 -- 172.21.15.37:0/2879455767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e34032b0 msgr2=0x5572e340beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.190+0000 7fe2a0c00640 1 --2- 172.21.15.37:0/2879455767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e34032b0 0x5572e340beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.190+0000 7fe2a0c00640 1 -- 172.21.15.37:0/2879455767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e3408620 msgr2=0x5572e3408a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.190+0000 7fe2a0c00640 1 --2- 172.21.15.37:0/2879455767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e3408620 0x5572e3408a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.190+0000 7fe2a0c00640 1 -- 172.21.15.37:0/2879455767 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572e3141620 con 0x5572e3405be0 2024-08-20T05:07:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.190+0000 7fe2a0c00640 1 --2- 172.21.15.37:0/2879455767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3405be0 0x5572e340c3f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe288009780 tx=0x7fe2880050f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5268699dc03bbccd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.192+0000 7fe28dc00640 1 -- 172.21.15.37:0/2879455767 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe288036070 con 0x5572e3405be0 2024-08-20T05:07:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.192+0000 7fe28dc00640 1 -- 172.21.15.37:0/2879455767 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2880054a0 con 0x5572e3405be0 2024-08-20T05:07:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.192+0000 7fe28dc00640 1 -- 172.21.15.37:0/2879455767 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe288014050 con 0x5572e3405be0 2024-08-20T05:07:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.194+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/2879455767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3405be0 msgr2=0x5572e340c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.194+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/2879455767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3405be0 0x5572e340c3f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe288009780 tx=0x7fe2880050f0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.194+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/2879455767 shutdown_connections 2024-08-20T05:07:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.194+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/2879455767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e3408620 0x5572e3408a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.194+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/2879455767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e3405be0 0x5572e340c3f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.194+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/2879455767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e34032b0 0x5572e340beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.194+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/2879455767 >> 172.21.15.37:0/2879455767 conn(0x5572e33fe3b0 msgr2=0x5572e33f9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.195+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/2879455767 shutdown_connections 2024-08-20T05:07:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.195+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/2879455767 wait complete. 2024-08-20T05:07:25.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.195+0000 7fe2a6ff6740 1 -- start start 2024-08-20T05:07:25.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.195+0000 7fe2a6ff6740 1 Processor -- start 2024-08-20T05:07:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.196+0000 7fe2a6ff6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e34032b0 0x5572e3414040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.196+0000 7fe2a6ff6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3405be0 0x5572e3414580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.196+0000 7fe2a6ff6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e3408620 0x5572e3414ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.196+0000 7fe2a6ff6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1aa530 con 0x5572e3408620 2024-08-20T05:07:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.196+0000 7fe2a6ff6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1a9e60 con 0x5572e3405be0 2024-08-20T05:07:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.196+0000 7fe2a6ff6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe29c1a70a0 con 0x5572e34032b0 2024-08-20T05:07:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.196+0000 7fe2a6ff6740 10 client.0 _ll_register_callbacks cb 0x7fe294034070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.196+0000 7fe2a0c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3405be0 0x5572e3414580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.196+0000 7fe2a0c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3405be0 0x5572e3414580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:58012/0 (socket says 172.21.15.37:58012) 2024-08-20T05:07:25.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.196+0000 7fe2a0c00640 1 -- 172.21.15.37:0/651902081 learned_addr learned my addr 172.21.15.37:0/651902081 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.196+0000 7fe2a1600640 1 --2- 172.21.15.37:0/651902081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e34032b0 0x5572e3414040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.197+0000 7fe2a2000640 1 --2- 172.21.15.37:0/651902081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e3408620 0x5572e3414ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.197+0000 7fe2a0c00640 1 -- 172.21.15.37:0/651902081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e34032b0 msgr2=0x5572e3414040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.197+0000 7fe2a0c00640 1 --2- 172.21.15.37:0/651902081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e34032b0 0x5572e3414040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.197+0000 7fe2a0c00640 1 -- 172.21.15.37:0/651902081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e3408620 msgr2=0x5572e3414ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.197+0000 7fe2a0c00640 1 --2- 172.21.15.37:0/651902081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e3408620 0x5572e3414ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.197+0000 7fe2a0c00640 1 -- 172.21.15.37:0/651902081 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572e3481800 con 0x5572e3405be0 2024-08-20T05:07:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.197+0000 7fe2a2000640 1 --2- 172.21.15.37:0/651902081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e3408620 0x5572e3414ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.197+0000 7fe2a0c00640 1 --2- 172.21.15.37:0/651902081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3405be0 0x5572e3414580 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe288009c80 tx=0x7fe2880057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=975005d5b020989d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.197+0000 7fe282a00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:07:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.198+0000 7fe282a00640 1 -- 172.21.15.37:0/651902081 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe288036050 con 0x5572e3405be0 2024-08-20T05:07:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.198+0000 7fe282a00640 1 -- 172.21.15.37:0/651902081 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe288017560 con 0x5572e3405be0 2024-08-20T05:07:25.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.198+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/651902081 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2880054a0 con 0x5572e3405be0 2024-08-20T05:07:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.198+0000 7fe282a00640 1 -- 172.21.15.37:0/651902081 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fe288017760 con 0x5572e3405be0 2024-08-20T05:07:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.198+0000 7fe2a6ff6740 10 client.26849 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.198+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/651902081 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5572e3482af0 con 0x5572e3405be0 2024-08-20T05:07:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.198+0000 7fe282a00640 1 -- 172.21.15.37:0/651902081 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2880054a0 con 0x5572e3405be0 2024-08-20T05:07:25.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.199+0000 7fe282a00640 1 -- 172.21.15.37:0/651902081 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fe28803b450 con 0x5572e3405be0 2024-08-20T05:07:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.199+0000 7fe2a6ff6740 10 client.26849 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.199+0000 7fe2a6ff6740 10 client.26849 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:07:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.199+0000 7fe2a6ff6740 20 client.26849 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.199+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/651902081 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5572e3483230 0x5572e3485650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.199+0000 7fe2a6ff6740 4 client.26849 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:07:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.199+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/651902081 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5572e3373c00 con 0x5572e3483230 2024-08-20T05:07:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.199+0000 7fe2a1600640 1 --2- 172.21.15.37:0/651902081 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5572e3483230 0x5572e3485650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.200+0000 7fe2a1600640 1 --2- 172.21.15.37:0/651902081 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5572e3483230 0x5572e3485650 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e22f0156ef4960a5 server_cookie=a47e05ce0968cd77 in_seq=0 out_seq=0 2024-08-20T05:07:25.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.200+0000 7fe282a00640 10 client.26849 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.212+0000 7fe282a00640 1 -- 172.21.15.37:0/651902081 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5572e3373c00 con 0x5572e3483230 2024-08-20T05:07:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.212+0000 7fe282a00640 10 client.26849 handle_command_reply: tid=0 2024-08-20T05:07:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.212+0000 7fe2a6ff6740 1 client.26849 shutdown 2024-08-20T05:07:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.214+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/651902081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3405be0 msgr2=0x5572e3414580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.214+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/651902081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3405be0 0x5572e3414580 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe288009c80 tx=0x7fe2880057f0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.214+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/651902081 shutdown_connections 2024-08-20T05:07:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.214+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/651902081 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5572e3483230 0x5572e3485650 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.214+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/651902081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572e3408620 0x5572e3414ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.214+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/651902081 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572e3405be0 0x5572e3414580 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.214+0000 7fe2a6ff6740 1 --2- 172.21.15.37:0/651902081 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572e34032b0 0x5572e3414040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.214+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/651902081 >> 172.21.15.37:0/651902081 conn(0x5572e33fe3b0 msgr2=0x5572e33f9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.214+0000 7fe282a00640 0 client.26849 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.215+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/651902081 shutdown_connections 2024-08-20T05:07:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.215+0000 7fe2a6ff6740 1 -- 172.21.15.37:0/651902081 wait complete. 2024-08-20T05:07:25.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.215+0000 7fe2a6ff6740 20 client.26849 trim_cache size 0 max 16384 2024-08-20T05:07:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:07:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:07:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:07:25.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:07:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.216+0000 7fe2a4000640 1 -- 172.21.15.37:0/499701672 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe2840b3d60 msgr2=0x7fe2840b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.216+0000 7fe2a4000640 1 --2- 172.21.15.37:0/499701672 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe2840b3d60 0x7fe2840b6220 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe294006010 tx=0x7fe294005ec0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.216+0000 7fe2a4000640 1 -- 172.21.15.37:0/499701672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe29c102c70 msgr2=0x7fe29c19ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.216+0000 7fe2a4000640 1 --2- 172.21.15.37:0/499701672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe29c102c70 0x7fe29c19ac10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe29000e9c0 tx=0x7fe29000ee80 comp rx=0 tx=0).stop 2024-08-20T05:07:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.216+0000 7fe2a4000640 1 -- 172.21.15.37:0/499701672 shutdown_connections 2024-08-20T05:07:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.216+0000 7fe2a4000640 1 --2- 172.21.15.37:0/499701672 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe2840b3d60 0x7fe2840b6220 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.216+0000 7fe2a4000640 1 --2- 172.21.15.37:0/499701672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe29c10a5b0 0x7fe29c19be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.216+0000 7fe2a4000640 1 --2- 172.21.15.37:0/499701672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe29c1035b0 0x7fe29c19b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.216+0000 7fe2a4000640 1 --2- 172.21.15.37:0/499701672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe29c102c70 0x7fe29c19ac10 secure :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe29000e9c0 tx=0x7fe29000ee80 comp rx=0 tx=0).stop 2024-08-20T05:07:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.216+0000 7fe2a4000640 1 -- 172.21.15.37:0/499701672 >> 172.21.15.37:0/499701672 conn(0x7fe29c0fc580 msgr2=0x7fe29c1087c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.217+0000 7fe2a4000640 1 -- 172.21.15.37:0/499701672 shutdown_connections 2024-08-20T05:07:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:25.217+0000 7fe2a4000640 1 -- 172.21.15.37:0/499701672 wait complete. 2024-08-20T05:07:25.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:25 smithi135 ceph-mon[22342]: pgmap v556: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 578 op/s 2024-08-20T05:07:25.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:25 smithi130 ceph-mon[22007]: pgmap v556: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 578 op/s 2024-08-20T05:07:25.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:25 smithi037 ceph-mon[17265]: pgmap v556: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.0 MiB/s wr, 578 op/s 2024-08-20T05:07:26.068 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T05:07:26.069 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T05:07:26.753 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:07:27.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:27 smithi037 ceph-mon[17265]: pgmap v557: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 647 op/s 2024-08-20T05:07:27.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:27 smithi130 ceph-mon[22007]: pgmap v557: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 647 op/s 2024-08-20T05:07:27.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.442+0000 7f54cf200640 1 -- 172.21.15.37:0/2569903642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54d010a510 msgr2=0x7f54d010a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:27.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.442+0000 7f54cf200640 1 --2- 172.21.15.37:0/2569903642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54d010a510 0x7f54d010a950 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009900 tx=0x7f54bc02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.442+0000 7f54cf200640 1 -- 172.21.15.37:0/2569903642 shutdown_connections 2024-08-20T05:07:27.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.442+0000 7f54cf200640 1 --2- 172.21.15.37:0/2569903642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54d010ae90 0x7f54d0111690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.442+0000 7f54cf200640 1 --2- 172.21.15.37:0/2569903642 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54d010a510 0x7f54d010a950 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.442+0000 7f54cf200640 1 --2- 172.21.15.37:0/2569903642 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d0104b00 0x7f54d0104ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.442+0000 7f54cf200640 1 -- 172.21.15.37:0/2569903642 >> 172.21.15.37:0/2569903642 conn(0x7f54d0100550 msgr2=0x7f54d0102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:27.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.442+0000 7f54cf200640 1 -- 172.21.15.37:0/2569903642 shutdown_connections 2024-08-20T05:07:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.442+0000 7f54cf200640 1 -- 172.21.15.37:0/2569903642 wait complete. 2024-08-20T05:07:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.443+0000 7f54cf200640 1 Processor -- start 2024-08-20T05:07:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.443+0000 7f54cf200640 1 -- start start 2024-08-20T05:07:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.444+0000 7f54cf200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54d0104b00 0x7f54d019aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.444+0000 7f54cf200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d010a510 0x7f54d019b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.444+0000 7f54cf200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54d010ae90 0x7f54d01a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.444+0000 7f54cf200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54d0114ba0 con 0x7f54d010ae90 2024-08-20T05:07:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.444+0000 7f54cf200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54d0114a20 con 0x7f54d0104b00 2024-08-20T05:07:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.444+0000 7f54cf200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54d0114d20 con 0x7f54d010a510 2024-08-20T05:07:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.444+0000 7f54ce800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54d010ae90 0x7f54d01a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.444+0000 7f54cde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54d0104b00 0x7f54d019aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.444+0000 7f54cde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54d0104b00 0x7f54d019aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:58028/0 (socket says 172.21.15.37:58028) 2024-08-20T05:07:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.444+0000 7f54cde00640 1 -- 172.21.15.37:0/2387874645 learned_addr learned my addr 172.21.15.37:0/2387874645 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.444+0000 7f54cd400640 1 --2- 172.21.15.37:0/2387874645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d010a510 0x7f54d019b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.444+0000 7f54cde00640 1 -- 172.21.15.37:0/2387874645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d010a510 msgr2=0x7f54d019b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.444+0000 7f54cde00640 1 --2- 172.21.15.37:0/2387874645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d010a510 0x7f54d019b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.444+0000 7f54cde00640 1 -- 172.21.15.37:0/2387874645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54d010ae90 msgr2=0x7f54d01a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.444+0000 7f54cde00640 1 --2- 172.21.15.37:0/2387874645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54d010ae90 0x7f54d01a07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.444+0000 7f54cde00640 1 -- 172.21.15.37:0/2387874645 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d01a0f80 con 0x7f54d0104b00 2024-08-20T05:07:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.445+0000 7f54cde00640 1 --2- 172.21.15.37:0/2387874645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54d0104b00 0x7f54d019aed0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f54c000e9f0 tx=0x7f54c000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.445+0000 7f54c6a00640 1 -- 172.21.15.37:0/2387874645 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c000cd80 con 0x7f54d0104b00 2024-08-20T05:07:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.445+0000 7f54c6a00640 1 -- 172.21.15.37:0/2387874645 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54c00054d0 con 0x7f54d0104b00 2024-08-20T05:07:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.445+0000 7f54cf200640 1 -- 172.21.15.37:0/2387874645 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d01a1270 con 0x7f54d0104b00 2024-08-20T05:07:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.445+0000 7f54c6a00640 1 -- 172.21.15.37:0/2387874645 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c0010690 con 0x7f54d0104b00 2024-08-20T05:07:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.445+0000 7f54cf200640 1 -- 172.21.15.37:0/2387874645 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d01a7930 con 0x7f54d0104b00 2024-08-20T05:07:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.448+0000 7f54d7670740 1 Processor -- start 2024-08-20T05:07:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.448+0000 7f54d7670740 1 -- start start 2024-08-20T05:07:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.449+0000 7f54c6a00640 1 -- 172.21.15.37:0/2387874645 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f54c0004e90 con 0x7f54d0104b00 2024-08-20T05:07:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.449+0000 7f54d7670740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 0x56042879ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.449+0000 7f54d7670740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56042879f4c0 0x5604287aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.449+0000 7f54d7670740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604287ab450 0x5604287ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.449+0000 7f54d7670740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560428715870 con 0x56042879eba0 2024-08-20T05:07:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.449+0000 7f54d7670740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560428704d70 con 0x5604287ab450 2024-08-20T05:07:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.449+0000 7f54d7670740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560428708db0 con 0x56042879f4c0 2024-08-20T05:07:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.449+0000 7f54ce800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 0x56042879ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.449+0000 7f54ce800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 0x56042879ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35704/0 (socket says 172.21.15.37:35704) 2024-08-20T05:07:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.449+0000 7f54ce800640 1 -- 172.21.15.37:0/77970347 learned_addr learned my addr 172.21.15.37:0/77970347 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.449+0000 7f54cde00640 1 --2- 172.21.15.37:0/77970347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56042879f4c0 0x5604287aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.449+0000 7f54cd400640 1 --2- 172.21.15.37:0/77970347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604287ab450 0x5604287ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.450+0000 7f54ce800640 1 -- 172.21.15.37:0/77970347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56042879f4c0 msgr2=0x5604287aaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.450+0000 7f54ce800640 1 --2- 172.21.15.37:0/77970347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56042879f4c0 0x5604287aaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.450+0000 7f54ce800640 1 -- 172.21.15.37:0/77970347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604287ab450 msgr2=0x5604287ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.450+0000 7f54ce800640 1 --2- 172.21.15.37:0/77970347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604287ab450 0x5604287ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.450+0000 7f54ce800640 1 -- 172.21.15.37:0/77970347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560428464930 con 0x56042879eba0 2024-08-20T05:07:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.450+0000 7f54cd400640 1 --2- 172.21.15.37:0/77970347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604287ab450 0x5604287ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:07:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.450+0000 7f54ce800640 1 --2- 172.21.15.37:0/77970347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 0x56042879ef80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f54c8011440 tx=0x7f54c8011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc1cf3f9314bb29 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.450+0000 7f54bb000640 1 -- 172.21.15.37:0/77970347 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c8004d20 con 0x56042879eba0 2024-08-20T05:07:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.451+0000 7f54bb000640 1 -- 172.21.15.37:0/77970347 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54c8004050 con 0x56042879eba0 2024-08-20T05:07:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.451+0000 7f54bb000640 1 -- 172.21.15.37:0/77970347 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c800f7a0 con 0x56042879eba0 2024-08-20T05:07:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.451+0000 7f54c6a00640 1 --2- 172.21.15.37:0/2387874645 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54b40b3c70 0x7f54b40b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.451+0000 7f54cde00640 1 --2- 172.21.15.37:0/2387874645 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54b40b3c70 0x7f54b40b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.451+0000 7f54c6a00640 1 -- 172.21.15.37:0/2387874645 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f54c00e43d0 con 0x7f54d0104b00 2024-08-20T05:07:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.451+0000 7f54d7670740 1 -- 172.21.15.37:0/77970347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 msgr2=0x56042879ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.451+0000 7f54d7670740 1 --2- 172.21.15.37:0/77970347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 0x56042879ef80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f54c8011440 tx=0x7f54c8011900 comp rx=0 tx=0).stop 2024-08-20T05:07:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.452+0000 7f54d7670740 1 -- 172.21.15.37:0/77970347 shutdown_connections 2024-08-20T05:07:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.452+0000 7f54d7670740 1 --2- 172.21.15.37:0/77970347 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5604287ab450 0x5604287ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.452+0000 7f54d7670740 1 --2- 172.21.15.37:0/77970347 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56042879f4c0 0x5604287aaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.452+0000 7f54d7670740 1 --2- 172.21.15.37:0/77970347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 0x56042879ef80 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.452+0000 7f54d7670740 1 -- 172.21.15.37:0/77970347 >> 172.21.15.37:0/77970347 conn(0x56042879c9d0 msgr2=0x56042879db70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.452+0000 7f54cde00640 1 --2- 172.21.15.37:0/2387874645 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54b40b3c70 0x7f54b40b6130 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f54c00aaeb0 tx=0x7f54c00e7e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.452+0000 7f54d7670740 1 -- 172.21.15.37:0/77970347 shutdown_connections 2024-08-20T05:07:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.452+0000 7f54d7670740 1 -- 172.21.15.37:0/77970347 wait complete. 2024-08-20T05:07:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.452+0000 7f54d7670740 1 -- start start 2024-08-20T05:07:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.452+0000 7f54d7670740 1 Processor -- start 2024-08-20T05:07:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.453+0000 7f54d7670740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 0x5604287aad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.453+0000 7f54d7670740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879f4c0 0x5604287a8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.453+0000 7f54d7670740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604287ab450 0x5604287a87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.453+0000 7f54d7670740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560428567890 con 0x56042879eba0 2024-08-20T05:07:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.453+0000 7f54d7670740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56042868bb00 con 0x56042879f4c0 2024-08-20T05:07:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.453+0000 7f54d7670740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5604287ae1a0 con 0x5604287ab450 2024-08-20T05:07:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.453+0000 7f54d7670740 10 client.0 _ll_register_callbacks cb 0x5604286ffdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.453+0000 7f54ce800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 0x5604287aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.453+0000 7f54cd400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879f4c0 0x5604287a8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.453+0000 7f54cd400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879f4c0 0x5604287a8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:58050/0 (socket says 172.21.15.37:58050) 2024-08-20T05:07:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.453+0000 7f54cd400640 1 -- 172.21.15.37:0/1407424062 learned_addr learned my addr 172.21.15.37:0/1407424062 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.454+0000 7f54ce800640 1 --2- 172.21.15.37:0/1407424062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604287ab450 0x5604287a87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.454+0000 7f54cd400640 1 -- 172.21.15.37:0/1407424062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604287ab450 msgr2=0x5604287a87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.454+0000 7f54cd400640 1 --2- 172.21.15.37:0/1407424062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604287ab450 0x5604287a87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.454+0000 7f54cd400640 1 -- 172.21.15.37:0/1407424062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 msgr2=0x5604287aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.454+0000 7f54cd400640 1 --2- 172.21.15.37:0/1407424062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 0x5604287aad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.454+0000 7f54cd400640 1 -- 172.21.15.37:0/1407424062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604286cca30 con 0x56042879f4c0 2024-08-20T05:07:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.454+0000 7f54ce800640 1 --2- 172.21.15.37:0/1407424062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604287ab450 0x5604287a87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.454+0000 7f54cd400640 1 --2- 172.21.15.37:0/1407424062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879f4c0 0x5604287a8180 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009230 tx=0x7f54bc004440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d6d2b405eb2ef2b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.454+0000 7f54af400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:07:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.454+0000 7f54af400640 1 -- 172.21.15.37:0/1407424062 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc035040 con 0x56042879f4c0 2024-08-20T05:07:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.454+0000 7f54d7670740 1 -- 172.21.15.37:0/1407424062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54c8004050 con 0x56042879f4c0 2024-08-20T05:07:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.454+0000 7f54af400640 1 -- 172.21.15.37:0/1407424062 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f54bc005510 con 0x56042879f4c0 2024-08-20T05:07:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.455+0000 7f54af400640 1 -- 172.21.15.37:0/1407424062 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f54bc04f050 con 0x56042879f4c0 2024-08-20T05:07:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.455+0000 7f54d7670740 10 client.26861 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.455+0000 7f54d7670740 1 -- 172.21.15.37:0/1407424062 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5604287b9b10 con 0x56042879f4c0 2024-08-20T05:07:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.455+0000 7f54af400640 1 -- 172.21.15.37:0/1407424062 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54c8004050 con 0x56042879f4c0 2024-08-20T05:07:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.455+0000 7f54af400640 1 -- 172.21.15.37:0/1407424062 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f54bc0039c0 con 0x56042879f4c0 2024-08-20T05:07:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.455+0000 7f54d7670740 10 client.26861 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.455+0000 7f54d7670740 10 client.26861 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:07:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.455+0000 7f54d7670740 20 client.26861 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.455+0000 7f54d7670740 1 --2- 172.21.15.37:0/1407424062 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5604287baf20 0x5604287bd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.455+0000 7f54d7670740 4 client.26861 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:07:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.455+0000 7f54d7670740 1 -- 172.21.15.37:0/1407424062 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604287177c0 con 0x5604287baf20 2024-08-20T05:07:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.456+0000 7f54ce800640 1 --2- 172.21.15.37:0/1407424062 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5604287baf20 0x5604287bd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.456+0000 7f54ce800640 1 --2- 172.21.15.37:0/1407424062 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5604287baf20 0x5604287bd310 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=149a36635e68fa0c server_cookie=9afce9c8b8bfd9a0 in_seq=0 out_seq=0 2024-08-20T05:07:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.456+0000 7f54af400640 10 client.26861 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.457+0000 7f54af400640 1 -- 172.21.15.37:0/1407424062 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604287177c0 con 0x5604287baf20 2024-08-20T05:07:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.457+0000 7f54af400640 10 client.26861 handle_command_reply: tid=0 2024-08-20T05:07:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.457+0000 7f54d7670740 1 client.26861 shutdown 2024-08-20T05:07:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.457+0000 7f54d7670740 1 -- 172.21.15.37:0/1407424062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879f4c0 msgr2=0x5604287a8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.457+0000 7f54d7670740 1 --2- 172.21.15.37:0/1407424062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879f4c0 0x5604287a8180 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009230 tx=0x7f54bc004440 comp rx=0 tx=0).stop 2024-08-20T05:07:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.457+0000 7f54d7670740 1 -- 172.21.15.37:0/1407424062 shutdown_connections 2024-08-20T05:07:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.457+0000 7f54d7670740 1 --2- 172.21.15.37:0/1407424062 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5604287baf20 0x5604287bd310 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.457+0000 7f54d7670740 1 --2- 172.21.15.37:0/1407424062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604287ab450 0x5604287a87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.457+0000 7f54d7670740 1 --2- 172.21.15.37:0/1407424062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879f4c0 0x5604287a8180 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.457+0000 7f54d7670740 1 --2- 172.21.15.37:0/1407424062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 0x5604287aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.457+0000 7f54d7670740 1 -- 172.21.15.37:0/1407424062 >> 172.21.15.37:0/1407424062 conn(0x56042879c9d0 msgr2=0x5604287a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.457+0000 7f54af400640 0 client.26861 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.457+0000 7f54d7670740 1 -- 172.21.15.37:0/1407424062 shutdown_connections 2024-08-20T05:07:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.457+0000 7f54d7670740 1 -- 172.21.15.37:0/1407424062 wait complete. 2024-08-20T05:07:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.457+0000 7f54d7670740 20 client.26861 trim_cache size 0 max 16384 2024-08-20T05:07:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.476+0000 7f54d7670740 1 Processor -- start 2024-08-20T05:07:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.476+0000 7f54d7670740 1 -- start start 2024-08-20T05:07:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.477+0000 7f54d7670740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 0x5604287b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.477+0000 7f54d7670740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879f4c0 0x5604287a2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.477+0000 7f54d7670740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604287ab450 0x5604287c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.477+0000 7f54d7670740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54d01b16f0 con 0x56042879eba0 2024-08-20T05:07:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.477+0000 7f54d7670740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54d01b3230 con 0x56042879f4c0 2024-08-20T05:07:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.477+0000 7f54d7670740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54d01b1dc0 con 0x5604287ab450 2024-08-20T05:07:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.477+0000 7f54ce800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 0x5604287b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.477+0000 7f54ce800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 0x5604287b72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35722/0 (socket says 172.21.15.37:35722) 2024-08-20T05:07:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.477+0000 7f54ce800640 1 -- 172.21.15.37:0/2789410513 learned_addr learned my addr 172.21.15.37:0/2789410513 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.477+0000 7f54cd400640 1 --2- 172.21.15.37:0/2789410513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879f4c0 0x5604287a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.477+0000 7f54ce800640 1 --2- 172.21.15.37:0/2789410513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604287ab450 0x5604287c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.478+0000 7f54ce800640 1 -- 172.21.15.37:0/2789410513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604287ab450 msgr2=0x5604287c2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.478+0000 7f54ce800640 1 --2- 172.21.15.37:0/2789410513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604287ab450 0x5604287c2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.478+0000 7f54ce800640 1 -- 172.21.15.37:0/2789410513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879f4c0 msgr2=0x5604287a2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.478+0000 7f54ce800640 1 --2- 172.21.15.37:0/2789410513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879f4c0 0x5604287a2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.478+0000 7f54ce800640 1 -- 172.21.15.37:0/2789410513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56042879d450 con 0x56042879eba0 2024-08-20T05:07:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.478+0000 7f54cd400640 1 --2- 172.21.15.37:0/2789410513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879f4c0 0x5604287a2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:07:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.478+0000 7f54ce800640 1 --2- 172.21.15.37:0/2789410513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 0x5604287b72c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f54c8006010 tx=0x7f54c8009fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5bf5414d16dd21 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.478+0000 7f54ba600640 1 -- 172.21.15.37:0/2789410513 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c8037070 con 0x56042879eba0 2024-08-20T05:07:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.478+0000 7f54ba600640 1 -- 172.21.15.37:0/2789410513 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54c800fbf0 con 0x56042879eba0 2024-08-20T05:07:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.478+0000 7f54ba600640 1 -- 172.21.15.37:0/2789410513 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c802b070 con 0x56042879eba0 2024-08-20T05:07:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.479+0000 7f54d7670740 1 -- 172.21.15.37:0/2789410513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 msgr2=0x5604287b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.479+0000 7f54d7670740 1 --2- 172.21.15.37:0/2789410513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 0x5604287b72c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f54c8006010 tx=0x7f54c8009fa0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.479+0000 7f54d7670740 1 -- 172.21.15.37:0/2789410513 shutdown_connections 2024-08-20T05:07:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.479+0000 7f54d7670740 1 --2- 172.21.15.37:0/2789410513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604287ab450 0x5604287c2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.479+0000 7f54d7670740 1 --2- 172.21.15.37:0/2789410513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879f4c0 0x5604287a2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.479+0000 7f54d7670740 1 --2- 172.21.15.37:0/2789410513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879eba0 0x5604287b72c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.479+0000 7f54d7670740 1 -- 172.21.15.37:0/2789410513 >> 172.21.15.37:0/2789410513 conn(0x56042879c9d0 msgr2=0x5604287a1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.479+0000 7f54d7670740 1 -- 172.21.15.37:0/2789410513 shutdown_connections 2024-08-20T05:07:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.479+0000 7f54d7670740 1 -- 172.21.15.37:0/2789410513 wait complete. 2024-08-20T05:07:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.479+0000 7f54d7670740 1 -- start start 2024-08-20T05:07:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.480+0000 7f54d7670740 1 Processor -- start 2024-08-20T05:07:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.480+0000 7f54d7670740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879eba0 0x5604287af750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.480+0000 7f54d7670740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879f4c0 0x5604287afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.480+0000 7f54d7670740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604287ab450 0x560428824bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.480+0000 7f54d7670740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54d01b2b60 con 0x56042879f4c0 2024-08-20T05:07:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.480+0000 7f54d7670740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54d01b2490 con 0x56042879eba0 2024-08-20T05:07:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.480+0000 7f54d7670740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54d01af6d0 con 0x5604287ab450 2024-08-20T05:07:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.480+0000 7f54d7670740 10 client.0 _ll_register_callbacks cb 0x7f54bc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.480+0000 7f54cd400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879f4c0 0x5604287afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.480+0000 7f54ce800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879eba0 0x5604287af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.480+0000 7f54ce800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879eba0 0x5604287af750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:58066/0 (socket says 172.21.15.37:58066) 2024-08-20T05:07:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.480+0000 7f54ce800640 1 -- 172.21.15.37:0/258429623 learned_addr learned my addr 172.21.15.37:0/258429623 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.480+0000 7f54ce800640 1 --2- 172.21.15.37:0/258429623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604287ab450 0x560428824bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.481+0000 7f54cd400640 1 -- 172.21.15.37:0/258429623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604287ab450 msgr2=0x560428824bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.481+0000 7f54cd400640 1 --2- 172.21.15.37:0/258429623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604287ab450 0x560428824bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.481+0000 7f54cd400640 1 -- 172.21.15.37:0/258429623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879eba0 msgr2=0x5604287af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.481+0000 7f54cd400640 1 --2- 172.21.15.37:0/258429623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879eba0 0x5604287af750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.481+0000 7f54cd400640 1 -- 172.21.15.37:0/258429623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604288250f0 con 0x56042879f4c0 2024-08-20T05:07:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.481+0000 7f54ce800640 1 --2- 172.21.15.37:0/258429623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879eba0 0x5604287af750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:07:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.481+0000 7f54cd400640 1 --2- 172.21.15.37:0/258429623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879f4c0 0x5604287afcb0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f54bc005ab0 tx=0x7f54bc005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e743511f4bfc0f50 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.481+0000 7f54af400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:07:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.481+0000 7f54af400640 1 -- 172.21.15.37:0/258429623 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc057070 con 0x56042879f4c0 2024-08-20T05:07:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.481+0000 7f54d7670740 1 -- 172.21.15.37:0/258429623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54c800fbf0 con 0x56042879f4c0 2024-08-20T05:07:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.481+0000 7f54af400640 1 -- 172.21.15.37:0/258429623 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f54bc005310 con 0x56042879f4c0 2024-08-20T05:07:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.482+0000 7f54af400640 1 -- 172.21.15.37:0/258429623 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f54bc060050 con 0x56042879f4c0 2024-08-20T05:07:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.482+0000 7f54d7670740 10 client.16590 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.482+0000 7f54d7670740 1 -- 172.21.15.37:0/258429623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x560428826400 con 0x56042879f4c0 2024-08-20T05:07:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.482+0000 7f54af400640 1 -- 172.21.15.37:0/258429623 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54c800fbf0 con 0x56042879f4c0 2024-08-20T05:07:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.482+0000 7f54af400640 1 -- 172.21.15.37:0/258429623 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f54bc05a020 con 0x56042879f4c0 2024-08-20T05:07:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.482+0000 7f54d7670740 10 client.16590 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.482+0000 7f54d7670740 10 client.16590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:07:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.482+0000 7f54d7670740 20 client.16590 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.482+0000 7f54d7670740 1 --2- 172.21.15.37:0/258429623 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560428826ba0 0x560428828fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.482+0000 7f54d7670740 4 client.16590 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T05:07:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.482+0000 7f54d7670740 1 -- 172.21.15.37:0/258429623 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560428713260 con 0x560428826ba0 2024-08-20T05:07:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.483+0000 7f54ce800640 1 --2- 172.21.15.37:0/258429623 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560428826ba0 0x560428828fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.483+0000 7f54ce800640 1 --2- 172.21.15.37:0/258429623 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560428826ba0 0x560428828fc0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc6aefc7af9f7646 server_cookie=13c32a931533dd6a in_seq=0 out_seq=0 2024-08-20T05:07:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.483+0000 7f54af400640 10 client.16590 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.484+0000 7f54af400640 1 -- 172.21.15.37:0/258429623 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560428713260 con 0x560428826ba0 2024-08-20T05:07:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.484+0000 7f54af400640 10 client.16590 handle_command_reply: tid=0 2024-08-20T05:07:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.484+0000 7f54d7670740 1 client.16590 shutdown 2024-08-20T05:07:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.484+0000 7f54d7670740 1 -- 172.21.15.37:0/258429623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879f4c0 msgr2=0x5604287afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.484+0000 7f54d7670740 1 --2- 172.21.15.37:0/258429623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879f4c0 0x5604287afcb0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f54bc005ab0 tx=0x7f54bc005bc0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.846 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:07:27.847 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-20T05:07:27.847 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "d241705b-86e7-4821-83e1-e9c737ea2144", 2024-08-20T05:07:27.847 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-20T05:07:27.847 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:07:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.484+0000 7f54d7670740 1 -- 172.21.15.37:0/258429623 shutdown_connections 2024-08-20T05:07:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.484+0000 7f54d7670740 1 --2- 172.21.15.37:0/258429623 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560428826ba0 0x560428828fc0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.484+0000 7f54d7670740 1 --2- 172.21.15.37:0/258429623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5604287ab450 0x560428824bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.484+0000 7f54d7670740 1 --2- 172.21.15.37:0/258429623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56042879f4c0 0x5604287afcb0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.484+0000 7f54d7670740 1 --2- 172.21.15.37:0/258429623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56042879eba0 0x5604287af750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.484+0000 7f54d7670740 1 -- 172.21.15.37:0/258429623 >> 172.21.15.37:0/258429623 conn(0x56042879c9d0 msgr2=0x56042879ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.484+0000 7f54af400640 0 client.16590 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.484+0000 7f54d7670740 1 -- 172.21.15.37:0/258429623 shutdown_connections 2024-08-20T05:07:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.484+0000 7f54d7670740 1 -- 172.21.15.37:0/258429623 wait complete. 2024-08-20T05:07:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.484+0000 7f54d7670740 20 client.16590 trim_cache size 0 max 16384 2024-08-20T05:07:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.485+0000 7f54cf200640 1 -- 172.21.15.37:0/2387874645 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54b40b3c70 msgr2=0x7f54b40b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.485+0000 7f54cf200640 1 --2- 172.21.15.37:0/2387874645 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54b40b3c70 0x7f54b40b6130 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f54c00aaeb0 tx=0x7f54c00e7e10 comp rx=0 tx=0).stop 2024-08-20T05:07:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.485+0000 7f54cf200640 1 -- 172.21.15.37:0/2387874645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54d0104b00 msgr2=0x7f54d019aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.485+0000 7f54cf200640 1 --2- 172.21.15.37:0/2387874645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54d0104b00 0x7f54d019aed0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f54c000e9f0 tx=0x7f54c000edf0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.485+0000 7f54cf200640 1 -- 172.21.15.37:0/2387874645 shutdown_connections 2024-08-20T05:07:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.485+0000 7f54cf200640 1 --2- 172.21.15.37:0/2387874645 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54b40b3c70 0x7f54b40b6130 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.485+0000 7f54cf200640 1 --2- 172.21.15.37:0/2387874645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54d010ae90 0x7f54d01a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.485+0000 7f54cf200640 1 --2- 172.21.15.37:0/2387874645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54d010a510 0x7f54d019b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.485+0000 7f54cf200640 1 --2- 172.21.15.37:0/2387874645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54d0104b00 0x7f54d019aed0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.485+0000 7f54cf200640 1 -- 172.21.15.37:0/2387874645 >> 172.21.15.37:0/2387874645 conn(0x7f54d0100550 msgr2=0x7f54d01039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.485+0000 7f54cf200640 1 -- 172.21.15.37:0/2387874645 shutdown_connections 2024-08-20T05:07:27.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:27.485+0000 7f54cf200640 1 -- 172.21.15.37:0/2387874645 wait complete. 2024-08-20T05:07:27.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:27 smithi135 ceph-mon[22342]: pgmap v557: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 647 op/s 2024-08-20T05:07:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 270.0 s, 755.1 tps, lat 126.175 ms stddev 150.303 2024-08-20T05:07:28.205 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 05:07:27 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b[51794]: 2024-08-20T05:07:27.911+0000 7fabbc466640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/pg_wal/ auth{1=1} v1425 ap=2 f(v10 m2024-08-20T05:07:07.657358+0000 36=35+1) n(v19 rc2024-08-20T05:07:07.657358+0000 b587202560 37=35+2) (inest sync->mix g=1) caps={25373=pAsLsXsFs/pAsLsXsFsxcral@186} mcw={1=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55dc3d210000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000007:[<0x10000000006/pg_wal v298>,<0x10000000005/data v74>,<0x100000001fb/postgres v10>,<0x100000001fa/091b5016-889b-437d-8bd4-e6363dc551f0 v29>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v36>,<0x1/volumes v34>]//[]","memoryvalue":"(2)0x10000000007:[<0x10000000006/pg_wal v1425>,<0x10000000005/data v413>,<0x100000001fb/postgres v262>,<0x100000001fa/091b5016-889b-437d-8bd4-e6363dc551f0 v281>,<0x10000000001/sv_1 v289>,<0x10000000000/qa v287>,<0x1/volumes v271>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-20T05:06:42.060686+0000 35=34+1)","ondisk_value.rstat":"n(v0 rc2024-08-20T05:07:07.657358+0000 b587202560 37=35+2)","memory_value.dirstat":"f(v10 m2024-08-20T05:07:07.657358+0000 36=35+1)","memory_value.rstat":"n(v19 rc2024-08-20T05:07:07.657358+0000 b587202560 37=35+2)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-20T05:07:28.206 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 05:07:27 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b[51794]: 2024-08-20T05:07:27.920+0000 7fabbc466640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000004a7 [...2,head] /volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/base/13494/ auth{1=1,2=1,3=1} fragtree_t(*^3) v3924 ap=2 f(v1 m2024-08-20T05:04:01.295789+0000 310=310+0) n(v22 rc2024-08-20T05:07:17.223236+0000 b537260591 311=310+1) (inest sync->mix g=1,2,3) caps={25373=pAsLsXsFs/pAsLsXsFs@459} mcw={1=AsLsXsFs,2=AsLsXsFs,3=AsLsXsFs} | dirtyscattered=0 request=0 lock=0 dirfrag=8 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55dc3d90c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x100000004a7:[<0x10000000014/13494 v1856>,<0x10000000006/base v344>,<0x10000000005/data v74>,<0x100000001fb/postgres v10>,<0x100000001fa/091b5016-889b-437d-8bd4-e6363dc551f0 v29>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v36>,<0x1/volumes v34>]//[]","memoryvalue":"(2)0x100000004a7:[<0x10000000014/13494 v3924>,<0x10000000006/base v1429>,<0x10000000005/data v413>,<0x100000001fb/postgres v262>,<0x100000001fa/091b5016-889b-437d-8bd4-e6363dc551f0 v281>,<0x10000000001/sv_1 v289>,<0x10000000000/qa v287>,<0x1/volumes v271>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-20T05:02:58.260630+0000 309=309+0)","ondisk_value.rstat":"n(v0 rc2024-08-20T05:07:17.223236+0000 b537260591 311=310+1)","memory_value.dirstat":"f(v1 m2024-08-20T05:04:01.295789+0000 310=310+0)","memory_value.rstat":"n(v22 rc2024-08-20T05:07:17.223236+0000 b537260591 311=310+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-20T05:07:28.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:28 smithi130 ceph-mon[22007]: scrub queued for path: / 2024-08-20T05:07:28.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:28 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:28 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:07:28.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:28 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:07:28.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:28 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:28 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:07:28.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:28 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:28 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:07:28.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:28 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:28 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:07:28.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:28 smithi130 ceph-mon[22007]: Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/pg_wal) see mds.b log and `damage ls` output for details 2024-08-20T05:07:28.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:28 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:07:28.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:28 smithi130 ceph-mon[22007]: Scrub error on inode 0x100000004a7 (/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/base/13494) see mds.b log and `damage ls` output for details 2024-08-20T05:07:28.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:28 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:28 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.707 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:28 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:28 smithi037 ceph-mon[17265]: scrub queued for path: / 2024-08-20T05:07:28.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:28 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:28 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:07:28.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:28 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:07:28.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:28 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:28 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:07:28.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:28 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:28 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:07:28.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:28 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:28 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:07:28.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:28 smithi037 ceph-mon[17265]: Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/pg_wal) see mds.b log and `damage ls` output for details 2024-08-20T05:07:28.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:28 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:07:28.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:28 smithi037 ceph-mon[17265]: Scrub error on inode 0x100000004a7 (/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/base/13494) see mds.b log and `damage ls` output for details 2024-08-20T05:07:28.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:28 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:28 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:28 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:28 smithi135 ceph-mon[22342]: scrub queued for path: / 2024-08-20T05:07:28.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:28 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:28 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:07:28.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:28 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:07:28.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:28 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:28 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:07:28.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:28 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:28 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:07:28.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:28 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:28 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:07:28.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:28 smithi135 ceph-mon[22342]: Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/pg_wal) see mds.b log and `damage ls` output for details 2024-08-20T05:07:28.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:28 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:07:28.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:28 smithi135 ceph-mon[22342]: Scrub error on inode 0x100000004a7 (/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/base/13494) see mds.b log and `damage ls` output for details 2024-08-20T05:07:28.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:28 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:28 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:28 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:28.946 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:07:29.592 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:07:29.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:29 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:07:29.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:29 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:07:29.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:29 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:29.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:29 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:29.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:29 smithi130 ceph-mon[22007]: pgmap v558: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.8 MiB/s wr, 557 op/s 2024-08-20T05:07:29.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:29 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:07:29.751 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:29 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:07:29.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:29 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:29.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:29 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:29.752 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:29 smithi037 ceph-mon[17265]: pgmap v558: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.8 MiB/s wr, 557 op/s 2024-08-20T05:07:29.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:29 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:07:29.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:29 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:07:29.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:29 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:29.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:29 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:07:29.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:29 smithi135 ceph-mon[22342]: pgmap v558: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.8 MiB/s wr, 557 op/s 2024-08-20T05:07:30.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.361+0000 7f871ac00640 1 -- 172.21.15.37:0/1285232938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f871411bdd0 msgr2=0x7f871411e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:30.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.362+0000 7f871ac00640 1 --2- 172.21.15.37:0/1285232938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f871411bdd0 0x7f871411e1c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f870c009ca0 tx=0x7f870c02a980 comp rx=0 tx=0).stop 2024-08-20T05:07:30.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.363+0000 7f871ac00640 1 -- 172.21.15.37:0/1285232938 shutdown_connections 2024-08-20T05:07:30.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.364+0000 7f871ac00640 1 --2- 172.21.15.37:0/1285232938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f871411bdd0 0x7f871411e1c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.364+0000 7f871ac00640 1 --2- 172.21.15.37:0/1285232938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f871410a260 0x7f871410a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.364+0000 7f871ac00640 1 --2- 172.21.15.37:0/1285232938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8714109e80 0x7f8714110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.364+0000 7f871ac00640 1 -- 172.21.15.37:0/1285232938 >> 172.21.15.37:0/1285232938 conn(0x7f871406dcc0 msgr2=0x7f871406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:30.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.365+0000 7f871ac00640 1 -- 172.21.15.37:0/1285232938 shutdown_connections 2024-08-20T05:07:30.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.365+0000 7f871ac00640 1 -- 172.21.15.37:0/1285232938 wait complete. 2024-08-20T05:07:30.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.367+0000 7f871ac00640 1 Processor -- start 2024-08-20T05:07:30.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.367+0000 7f871ac00640 1 -- start start 2024-08-20T05:07:30.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.368+0000 7f871ac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8714109e80 0x7f87141a7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.368+0000 7f871ac00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f871410a260 0x7f87141a8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.368+0000 7f871ac00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f871411bdd0 0x7f87141ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.369+0000 7f870be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f871410a260 0x7f87141a8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:30.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.369+0000 7f870be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f871410a260 0x7f87141a8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33554/0 (socket says 172.21.15.37:33554) 2024-08-20T05:07:30.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.369+0000 7f8718c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f871411bdd0 0x7f87141ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.369+0000 7f870be00640 1 -- 172.21.15.37:0/1897112143 learned_addr learned my addr 172.21.15.37:0/1897112143 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.369+0000 7f871ac00640 1 -- 172.21.15.37:0/1897112143 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8714121990 con 0x7f8714109e80 2024-08-20T05:07:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.369+0000 7f871ac00640 1 -- 172.21.15.37:0/1897112143 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8714121810 con 0x7f871411bdd0 2024-08-20T05:07:30.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.369+0000 7f871ac00640 1 -- 172.21.15.37:0/1897112143 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8714121b10 con 0x7f871410a260 2024-08-20T05:07:30.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.371+0000 7f8713e00640 1 --2- 172.21.15.37:0/1897112143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8714109e80 0x7f87141a7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:30.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.373+0000 7f8718c00640 1 -- 172.21.15.37:0/1897112143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f871410a260 msgr2=0x7f87141a8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:30.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.373+0000 7f8718c00640 1 --2- 172.21.15.37:0/1897112143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f871410a260 0x7f87141a8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.373+0000 7f8718c00640 1 -- 172.21.15.37:0/1897112143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8714109e80 msgr2=0x7f87141a7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:30.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.374+0000 7f8718c00640 1 --2- 172.21.15.37:0/1897112143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8714109e80 0x7f87141a7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.374+0000 7f8718c00640 1 -- 172.21.15.37:0/1897112143 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87141adf90 con 0x7f871411bdd0 2024-08-20T05:07:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.374+0000 7f8713e00640 1 --2- 172.21.15.37:0/1897112143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8714109e80 0x7f87141a7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:07:30.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.376+0000 7f8718c00640 1 --2- 172.21.15.37:0/1897112143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f871411bdd0 0x7f87141ad7c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f870c02aea0 tx=0x7f870c0308b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:30.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.378+0000 7f8711600640 1 -- 172.21.15.37:0/1897112143 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c034050 con 0x7f871411bdd0 2024-08-20T05:07:30.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.378+0000 7f8711600640 1 -- 172.21.15.37:0/1897112143 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f870c0398d0 con 0x7f871411bdd0 2024-08-20T05:07:30.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.378+0000 7f8711600640 1 -- 172.21.15.37:0/1897112143 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870c0427e0 con 0x7f871411bdd0 2024-08-20T05:07:30.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.378+0000 7f871ac00640 1 -- 172.21.15.37:0/1897112143 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87141ae220 con 0x7f871411bdd0 2024-08-20T05:07:30.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.378+0000 7f871ac00640 1 -- 172.21.15.37:0/1897112143 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87141b4940 con 0x7f871411bdd0 2024-08-20T05:07:30.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.384+0000 7f871d87d740 1 Processor -- start 2024-08-20T05:07:30.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.390+0000 7f8711600640 1 -- 172.21.15.37:0/1897112143 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f870c037020 con 0x7f871411bdd0 2024-08-20T05:07:30.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.390+0000 7f871d87d740 1 -- start start 2024-08-20T05:07:30.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.391+0000 7f871d87d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a98f5900 0x55c6a98f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.391+0000 7f871d87d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a98f6220 0x55c6a9901c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.391+0000 7f871d87d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a99021b0 0x55c6a99045a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.391+0000 7f871d87d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c6a986ba60 con 0x55c6a98f6220 2024-08-20T05:07:30.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.391+0000 7f871d87d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c6a985af60 con 0x55c6a98f5900 2024-08-20T05:07:30.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.391+0000 7f871d87d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c6a985efa0 con 0x55c6a99021b0 2024-08-20T05:07:30.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.393+0000 7f8711600640 1 --2- 172.21.15.37:0/1897112143 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f86f80b3d20 0x7f86f80b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.393+0000 7f870be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a98f5900 0x55c6a98f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:30.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.393+0000 7f870be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a98f5900 0x55c6a98f5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:58086/0 (socket says 172.21.15.37:58086) 2024-08-20T05:07:30.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.393+0000 7f870be00640 1 -- 172.21.15.37:0/1850536384 learned_addr learned my addr 172.21.15.37:0/1850536384 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:30.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.394+0000 7f870be00640 1 --2- 172.21.15.37:0/1850536384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a99021b0 0x55c6a99045a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:30.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.394+0000 7f870be00640 1 -- 172.21.15.37:0/1850536384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a99021b0 msgr2=0x55c6a99045a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:30.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.394+0000 7f870be00640 1 --2- 172.21.15.37:0/1850536384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a99021b0 0x55c6a99045a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.394+0000 7f870be00640 1 -- 172.21.15.37:0/1850536384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a98f6220 msgr2=0x55c6a9901c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:30.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.394+0000 7f870be00640 1 --2- 172.21.15.37:0/1850536384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a98f6220 0x55c6a9901c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.394+0000 7f870be00640 1 -- 172.21.15.37:0/1850536384 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6a98013e0 con 0x55c6a98f5900 2024-08-20T05:07:30.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.395+0000 7f870be00640 1 --2- 172.21.15.37:0/1850536384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a98f5900 0x55c6a98f5ce0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f87040177a0 tx=0x7f87040095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56707eea8d780e8c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:30.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.395+0000 7f8711600640 1 -- 172.21.15.37:0/1897112143 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f870c104f60 con 0x7f871411bdd0 2024-08-20T05:07:30.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.398+0000 7f8709200640 1 -- 172.21.15.37:0/1850536384 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87040157c0 con 0x55c6a98f5900 2024-08-20T05:07:30.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.398+0000 7f8718c00640 1 --2- 172.21.15.37:0/1897112143 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f86f80b3d20 0x7f86f80b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:30.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.399+0000 7f8709200640 1 -- 172.21.15.37:0/1850536384 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f870401d070 con 0x55c6a98f5900 2024-08-20T05:07:30.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.399+0000 7f8709200640 1 -- 172.21.15.37:0/1850536384 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8704018ab0 con 0x55c6a98f5900 2024-08-20T05:07:30.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.400+0000 7f871d87d740 1 -- 172.21.15.37:0/1850536384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a98f5900 msgr2=0x55c6a98f5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:30.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.400+0000 7f871d87d740 1 --2- 172.21.15.37:0/1850536384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a98f5900 0x55c6a98f5ce0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f87040177a0 tx=0x7f87040095c0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.401+0000 7f871d87d740 1 -- 172.21.15.37:0/1850536384 shutdown_connections 2024-08-20T05:07:30.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.401+0000 7f871d87d740 1 --2- 172.21.15.37:0/1850536384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a99021b0 0x55c6a99045a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.401+0000 7f871d87d740 1 --2- 172.21.15.37:0/1850536384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a98f6220 0x55c6a9901c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.401+0000 7f871d87d740 1 --2- 172.21.15.37:0/1850536384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a98f5900 0x55c6a98f5ce0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.401+0000 7f871d87d740 1 -- 172.21.15.37:0/1850536384 >> 172.21.15.37:0/1850536384 conn(0x55c6a98f3730 msgr2=0x55c6a98f48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.401+0000 7f871d87d740 1 -- 172.21.15.37:0/1850536384 shutdown_connections 2024-08-20T05:07:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.401+0000 7f871d87d740 1 -- 172.21.15.37:0/1850536384 wait complete. 2024-08-20T05:07:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.402+0000 7f871d87d740 1 -- start start 2024-08-20T05:07:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.402+0000 7f871d87d740 1 Processor -- start 2024-08-20T05:07:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.403+0000 7f871d87d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f5900 0x55c6a9901a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.403+0000 7f871d87d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a98f6220 0x55c6a98feeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.403+0000 7f871d87d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a99021b0 0x55c6a98ff470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.403+0000 7f871d87d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c6a96bd700 con 0x55c6a99021b0 2024-08-20T05:07:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.403+0000 7f871d87d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c6a97f6250 con 0x55c6a98f6220 2024-08-20T05:07:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.403+0000 7f871d87d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c6a9904dd0 con 0x55c6a98f5900 2024-08-20T05:07:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.403+0000 7f871d87d740 10 client.0 _ll_register_callbacks cb 0x55c6a9855180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.403+0000 7f870be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f5900 0x55c6a9901a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.403+0000 7f870be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f5900 0x55c6a9901a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33580/0 (socket says 172.21.15.37:33580) 2024-08-20T05:07:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.403+0000 7f870be00640 1 -- 172.21.15.37:0/1517654138 learned_addr learned my addr 172.21.15.37:0/1517654138 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.403+0000 7f8713e00640 1 --2- 172.21.15.37:0/1517654138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a98f6220 0x55c6a98feeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:30.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.404+0000 7f8713e00640 1 -- 172.21.15.37:0/1517654138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f5900 msgr2=0x55c6a9901a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.404+0000 7f8713e00640 1 --2- 172.21.15.37:0/1517654138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f5900 0x55c6a9901a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.404+0000 7f8713e00640 1 -- 172.21.15.37:0/1517654138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a99021b0 msgr2=0x55c6a98ff470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:07:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.404+0000 7f870be00640 1 --2- 172.21.15.37:0/1517654138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a99021b0 0x55c6a98ff470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.404+0000 7f8713e00640 1 --2- 172.21.15.37:0/1517654138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a99021b0 0x55c6a98ff470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.404+0000 7f8718c00640 1 --2- 172.21.15.37:0/1897112143 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f86f80b3d20 0x7f86f80b61e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f870c006010 tx=0x7f870c0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.405+0000 7f8713e00640 1 -- 172.21.15.37:0/1517654138 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6a95ba650 con 0x55c6a98f6220 2024-08-20T05:07:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.405+0000 7f870be00640 1 --2- 172.21.15.37:0/1517654138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a99021b0 0x55c6a98ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.405+0000 7f8713e00640 1 --2- 172.21.15.37:0/1517654138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a98f6220 0x55c6a98feeb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55c6a98f4610 tx=0x7f86fc00d5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e18409e8c140902a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.405+0000 7f8701600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:07:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.406+0000 7f8701600640 1 -- 172.21.15.37:0/1517654138 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc012420 con 0x55c6a98f6220 2024-08-20T05:07:30.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.406+0000 7f8701600640 1 -- 172.21.15.37:0/1517654138 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f86fc0125c0 con 0x55c6a98f6220 2024-08-20T05:07:30.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.407+0000 7f871d87d740 1 -- 172.21.15.37:0/1517654138 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f870401d070 con 0x55c6a98f6220 2024-08-20T05:07:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.421+0000 7f8701600640 1 -- 172.21.15.37:0/1517654138 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f86fc0127c0 con 0x55c6a98f6220 2024-08-20T05:07:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.421+0000 7f871d87d740 10 client.26876 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:30.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.421+0000 7f871d87d740 1 -- 172.21.15.37:0/1517654138 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55c6a9910780 con 0x55c6a98f6220 2024-08-20T05:07:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.422+0000 7f8701600640 1 -- 172.21.15.37:0/1517654138 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f870401d070 con 0x55c6a98f6220 2024-08-20T05:07:30.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.422+0000 7f8701600640 1 -- 172.21.15.37:0/1517654138 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f86fc01c030 con 0x55c6a98f6220 2024-08-20T05:07:30.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.423+0000 7f871d87d740 10 client.26876 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:30.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.423+0000 7f871d87d740 10 client.26876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:07:30.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.423+0000 7f871d87d740 20 client.26876 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:30.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.423+0000 7f871d87d740 1 --2- 172.21.15.37:0/1517654138 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c6a9911c90 0x55c6a99140b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.424+0000 7f871d87d740 4 client.26876 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:07:30.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.424+0000 7f871d87d740 1 -- 172.21.15.37:0/1517654138 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c6a986d9b0 con 0x55c6a9911c90 2024-08-20T05:07:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.424+0000 7f870be00640 1 --2- 172.21.15.37:0/1517654138 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c6a9911c90 0x55c6a99140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.425+0000 7f870be00640 1 --2- 172.21.15.37:0/1517654138 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c6a9911c90 0x55c6a99140b0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7026539407db651 server_cookie=af696ca7a715e009 in_seq=0 out_seq=0 2024-08-20T05:07:30.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.425+0000 7f8701600640 10 client.26876 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.428+0000 7f8701600640 1 -- 172.21.15.37:0/1517654138 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c6a986d9b0 con 0x55c6a9911c90 2024-08-20T05:07:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.428+0000 7f8701600640 10 client.26876 handle_command_reply: tid=0 2024-08-20T05:07:30.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.428+0000 7f871d87d740 1 client.26876 shutdown 2024-08-20T05:07:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.428+0000 7f871d87d740 1 -- 172.21.15.37:0/1517654138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a98f6220 msgr2=0x55c6a98feeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.428+0000 7f871d87d740 1 --2- 172.21.15.37:0/1517654138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a98f6220 0x55c6a98feeb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55c6a98f4610 tx=0x7f86fc00d5f0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.429+0000 7f871d87d740 1 -- 172.21.15.37:0/1517654138 shutdown_connections 2024-08-20T05:07:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.429+0000 7f871d87d740 1 --2- 172.21.15.37:0/1517654138 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c6a9911c90 0x55c6a99140b0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.429+0000 7f8701600640 0 client.26876 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.429+0000 7f871d87d740 1 --2- 172.21.15.37:0/1517654138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a99021b0 0x55c6a98ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.429+0000 7f871d87d740 1 --2- 172.21.15.37:0/1517654138 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a98f6220 0x55c6a98feeb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.429+0000 7f871d87d740 1 --2- 172.21.15.37:0/1517654138 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f5900 0x55c6a9901a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.429+0000 7f871d87d740 1 -- 172.21.15.37:0/1517654138 >> 172.21.15.37:0/1517654138 conn(0x55c6a98f3730 msgr2=0x55c6a98f92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:30.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.431+0000 7f871d87d740 1 -- 172.21.15.37:0/1517654138 shutdown_connections 2024-08-20T05:07:30.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.431+0000 7f871d87d740 1 -- 172.21.15.37:0/1517654138 wait complete. 2024-08-20T05:07:30.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.432+0000 7f871d87d740 20 client.26876 trim_cache size 0 max 16384 2024-08-20T05:07:30.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.470+0000 7f871d87d740 1 Processor -- start 2024-08-20T05:07:30.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.471+0000 7f871d87d740 1 -- start start 2024-08-20T05:07:30.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.471+0000 7f871d87d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a98f5900 0x55c6a990df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.471+0000 7f871d87d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f6220 0x55c6a9900bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.471+0000 7f871d87d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a99021b0 0x55c6a9919980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.471+0000 7f871d87d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f87141be7e0 con 0x55c6a98f5900 2024-08-20T05:07:30.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.471+0000 7f871d87d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f87141c0320 con 0x55c6a99021b0 2024-08-20T05:07:30.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.471+0000 7f871d87d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f87141beeb0 con 0x55c6a98f6220 2024-08-20T05:07:30.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.472+0000 7f8713e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f6220 0x55c6a9900bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:30.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.472+0000 7f8713e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f6220 0x55c6a9900bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33590/0 (socket says 172.21.15.37:33590) 2024-08-20T05:07:30.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.472+0000 7f8713e00640 1 -- 172.21.15.37:0/3414575438 learned_addr learned my addr 172.21.15.37:0/3414575438 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:30.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.472+0000 7f870be00640 1 --2- 172.21.15.37:0/3414575438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a99021b0 0x55c6a9919980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:30.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.473+0000 7f870be00640 1 --2- 172.21.15.37:0/3414575438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a98f5900 0x55c6a990df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:30.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.473+0000 7f8713e00640 1 -- 172.21.15.37:0/3414575438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a99021b0 msgr2=0x55c6a9919980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:30.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.473+0000 7f8713e00640 1 --2- 172.21.15.37:0/3414575438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a99021b0 0x55c6a9919980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.473+0000 7f8713e00640 1 -- 172.21.15.37:0/3414575438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a98f5900 msgr2=0x55c6a990df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:30.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.473+0000 7f8713e00640 1 --2- 172.21.15.37:0/3414575438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a98f5900 0x55c6a990df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.473+0000 7f8713e00640 1 -- 172.21.15.37:0/3414575438 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6a98f41b0 con 0x55c6a98f6220 2024-08-20T05:07:30.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.473+0000 7f8713e00640 1 --2- 172.21.15.37:0/3414575438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f6220 0x55c6a9900bf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f86fc014d30 tx=0x7f86fc00bb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=545976a32993113c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:30.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.474+0000 7f8703e00640 1 -- 172.21.15.37:0/3414575438 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc02b070 con 0x55c6a98f6220 2024-08-20T05:07:30.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.474+0000 7f8703e00640 1 -- 172.21.15.37:0/3414575438 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86fc012e10 con 0x55c6a98f6220 2024-08-20T05:07:30.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.475+0000 7f8703e00640 1 -- 172.21.15.37:0/3414575438 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0143f0 con 0x55c6a98f6220 2024-08-20T05:07:30.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.475+0000 7f871d87d740 1 -- 172.21.15.37:0/3414575438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f6220 msgr2=0x55c6a9900bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:30.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.475+0000 7f871d87d740 1 --2- 172.21.15.37:0/3414575438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f6220 0x55c6a9900bf0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f86fc014d30 tx=0x7f86fc00bb70 comp rx=0 tx=0).stop 2024-08-20T05:07:30.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.476+0000 7f871d87d740 1 -- 172.21.15.37:0/3414575438 shutdown_connections 2024-08-20T05:07:30.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.476+0000 7f871d87d740 1 --2- 172.21.15.37:0/3414575438 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a99021b0 0x55c6a9919980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.476+0000 7f871d87d740 1 --2- 172.21.15.37:0/3414575438 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f6220 0x55c6a9900bf0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.476+0000 7f871d87d740 1 --2- 172.21.15.37:0/3414575438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a98f5900 0x55c6a990df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.476+0000 7f871d87d740 1 -- 172.21.15.37:0/3414575438 >> 172.21.15.37:0/3414575438 conn(0x55c6a98f3730 msgr2=0x55c6a99004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:30.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.477+0000 7f871d87d740 1 -- 172.21.15.37:0/3414575438 shutdown_connections 2024-08-20T05:07:30.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.477+0000 7f871d87d740 1 -- 172.21.15.37:0/3414575438 wait complete. 2024-08-20T05:07:30.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.478+0000 7f871d87d740 1 -- start start 2024-08-20T05:07:30.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.478+0000 7f871d87d740 1 Processor -- start 2024-08-20T05:07:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.479+0000 7f871d87d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a98f5900 0x55c6a9905fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.479+0000 7f871d87d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f6220 0x55c6a9906500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.479+0000 7f871d87d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a99021b0 0x55c6a9906a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.479+0000 7f871d87d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f87141bfc50 con 0x55c6a98f5900 2024-08-20T05:07:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.479+0000 7f871d87d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f87141bf580 con 0x55c6a99021b0 2024-08-20T05:07:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.479+0000 7f871d87d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f87141bc7c0 con 0x55c6a98f6220 2024-08-20T05:07:30.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.479+0000 7f871d87d740 10 client.0 _ll_register_callbacks cb 0x7f86fc00b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:30.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.480+0000 7f870be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a98f5900 0x55c6a9905fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:30.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.480+0000 7f870be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a98f5900 0x55c6a9905fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35780/0 (socket says 172.21.15.37:35780) 2024-08-20T05:07:30.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.480+0000 7f870be00640 1 -- 172.21.15.37:0/1931772254 learned_addr learned my addr 172.21.15.37:0/1931772254 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:30.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.480+0000 7f8713e00640 1 --2- 172.21.15.37:0/1931772254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f6220 0x55c6a9906500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:30.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.481+0000 7f8713e00640 1 -- 172.21.15.37:0/1931772254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a99021b0 msgr2=0x55c6a9906a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.481+0000 7f8713e00640 1 --2- 172.21.15.37:0/1931772254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a99021b0 0x55c6a9906a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.481+0000 7f8713e00640 1 -- 172.21.15.37:0/1931772254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a98f5900 msgr2=0x55c6a9905fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.481+0000 7f8713e00640 1 --2- 172.21.15.37:0/1931772254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a98f5900 0x55c6a9905fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.481+0000 7f8713e00640 1 -- 172.21.15.37:0/1931772254 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6a9904910 con 0x55c6a98f6220 2024-08-20T05:07:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.481+0000 7f870be00640 1 --2- 172.21.15.37:0/1931772254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a98f5900 0x55c6a9905fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:07:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.482+0000 7f8713e00640 1 --2- 172.21.15.37:0/1931772254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f6220 0x55c6a9906500 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f86fc029040 tx=0x7f86fc004290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a73f105e1d9d8dea server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.482+0000 7f8701600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:07:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.482+0000 7f8701600640 1 -- 172.21.15.37:0/1931772254 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc02b030 con 0x55c6a98f6220 2024-08-20T05:07:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.482+0000 7f8701600640 1 -- 172.21.15.37:0/1931772254 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f86fc012960 con 0x55c6a98f6220 2024-08-20T05:07:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.482+0000 7f871d87d740 1 -- 172.21.15.37:0/1931772254 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86fc012e10 con 0x55c6a98f6220 2024-08-20T05:07:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.482+0000 7f8701600640 1 -- 172.21.15.37:0/1931772254 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f86fc012ba0 con 0x55c6a98f6220 2024-08-20T05:07:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.482+0000 7f871d87d740 10 client.26899 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.482+0000 7f871d87d740 1 -- 172.21.15.37:0/1931772254 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55c6a997cbc0 con 0x55c6a98f6220 2024-08-20T05:07:30.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.483+0000 7f8701600640 1 -- 172.21.15.37:0/1931772254 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86fc012e10 con 0x55c6a98f6220 2024-08-20T05:07:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.483+0000 7f8701600640 1 -- 172.21.15.37:0/1931772254 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f86fc01c040 con 0x55c6a98f6220 2024-08-20T05:07:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.483+0000 7f871d87d740 10 client.26899 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.483+0000 7f871d87d740 10 client.26899 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:07:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.483+0000 7f871d87d740 20 client.26899 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.483+0000 7f871d87d740 1 --2- 172.21.15.37:0/1931772254 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c6a9911c90 0x55c6a997f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.483+0000 7f871d87d740 4 client.26899 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:07:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.483+0000 7f871d87d740 1 -- 172.21.15.37:0/1931772254 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c6a9869450 con 0x55c6a9911c90 2024-08-20T05:07:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.483+0000 7f870be00640 1 --2- 172.21.15.37:0/1931772254 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c6a9911c90 0x55c6a997f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.484+0000 7f870be00640 1 --2- 172.21.15.37:0/1931772254 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c6a9911c90 0x55c6a997f240 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f18d79aab82b34b1 server_cookie=c8839e7350240468 in_seq=0 out_seq=0 2024-08-20T05:07:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.484+0000 7f8701600640 10 client.26899 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.484+0000 7f8701600640 1 -- 172.21.15.37:0/1931772254 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55c6a9869450 con 0x55c6a9911c90 2024-08-20T05:07:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.484+0000 7f8701600640 10 client.26899 handle_command_reply: tid=0 2024-08-20T05:07:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.484+0000 7f871d87d740 1 client.26899 shutdown 2024-08-20T05:07:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.485+0000 7f871d87d740 1 -- 172.21.15.37:0/1931772254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f6220 msgr2=0x55c6a9906500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.485+0000 7f871d87d740 1 --2- 172.21.15.37:0/1931772254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f6220 0x55c6a9906500 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f86fc029040 tx=0x7f86fc004290 comp rx=0 tx=0).stop 2024-08-20T05:07:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.485+0000 7f871d87d740 1 -- 172.21.15.37:0/1931772254 shutdown_connections 2024-08-20T05:07:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.485+0000 7f871d87d740 1 --2- 172.21.15.37:0/1931772254 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c6a9911c90 0x55c6a997f240 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.485+0000 7f871d87d740 1 --2- 172.21.15.37:0/1931772254 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c6a99021b0 0x55c6a9906a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.485+0000 7f871d87d740 1 --2- 172.21.15.37:0/1931772254 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c6a98f6220 0x55c6a9906500 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.485+0000 7f871d87d740 1 --2- 172.21.15.37:0/1931772254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6a98f5900 0x55c6a9905fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.485+0000 7f871d87d740 1 -- 172.21.15.37:0/1931772254 >> 172.21.15.37:0/1931772254 conn(0x55c6a98f3730 msgr2=0x55c6a98f1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.485+0000 7f8701600640 0 client.26899 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.485+0000 7f871d87d740 1 -- 172.21.15.37:0/1931772254 shutdown_connections 2024-08-20T05:07:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.486+0000 7f871d87d740 1 -- 172.21.15.37:0/1931772254 wait complete. 2024-08-20T05:07:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.486+0000 7f871d87d740 20 client.26899 trim_cache size 0 max 16384 2024-08-20T05:07:30.488 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:07:30.488 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T05:07:30.488 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-20T05:07:30.488 INFO:teuthology.orchestra.run.smithi037.stdout: "d241705b-86e7-4821-83e1-e9c737ea2144": { 2024-08-20T05:07:30.488 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-20T05:07:30.488 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "d241705b-86e7-4821-83e1-e9c737ea2144", 2024-08-20T05:07:30.488 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-20T05:07:30.488 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:07:30.488 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:07:30.488 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:07:30.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.488+0000 7f871ac00640 1 -- 172.21.15.37:0/1897112143 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f86f80b3d20 msgr2=0x7f86f80b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:30.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.488+0000 7f871ac00640 1 --2- 172.21.15.37:0/1897112143 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f86f80b3d20 0x7f86f80b61e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f870c006010 tx=0x7f870c0095c0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.488+0000 7f871ac00640 1 -- 172.21.15.37:0/1897112143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f871411bdd0 msgr2=0x7f87141ad7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:30.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.488+0000 7f871ac00640 1 --2- 172.21.15.37:0/1897112143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f871411bdd0 0x7f87141ad7c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f870c02aea0 tx=0x7f870c0308b0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.489+0000 7f871ac00640 1 -- 172.21.15.37:0/1897112143 shutdown_connections 2024-08-20T05:07:30.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.489+0000 7f871ac00640 1 --2- 172.21.15.37:0/1897112143 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f86f80b3d20 0x7f86f80b61e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.489+0000 7f871ac00640 1 --2- 172.21.15.37:0/1897112143 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f871411bdd0 0x7f87141ad7c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.489+0000 7f871ac00640 1 --2- 172.21.15.37:0/1897112143 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f871410a260 0x7f87141a8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.489+0000 7f871ac00640 1 --2- 172.21.15.37:0/1897112143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8714109e80 0x7f87141a7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.489+0000 7f871ac00640 1 -- 172.21.15.37:0/1897112143 >> 172.21.15.37:0/1897112143 conn(0x7f871406dcc0 msgr2=0x7f871411c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.490+0000 7f871ac00640 1 -- 172.21.15.37:0/1897112143 shutdown_connections 2024-08-20T05:07:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:30.490+0000 7f871ac00640 1 -- 172.21.15.37:0/1897112143 wait complete. 2024-08-20T05:07:30.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:07:30.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:07:30.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:07:31.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:31 smithi037 ceph-mon[17265]: pgmap v559: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.7 MiB/s wr, 706 op/s 2024-08-20T05:07:31.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:31 smithi130 ceph-mon[22007]: pgmap v559: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.7 MiB/s wr, 706 op/s 2024-08-20T05:07:31.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:31 smithi135 ceph-mon[22342]: pgmap v559: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 5.7 MiB/s wr, 706 op/s 2024-08-20T05:07:32.215 INFO:tasks.cephfs.filesystem:scrub status for tag:d241705b-86e7-4821-83e1-e9c737ea2144 - {'path': '/', 'tag': 'd241705b-86e7-4821-83e1-e9c737ea2144', 'options': 'recursive,force'} 2024-08-20T05:07:32.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T05:07:32.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T05:07:32.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T05:07:32.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T05:07:32.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:07:32.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:07:32.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:07:32.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T05:07:32.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T05:07:32.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T05:07:32.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T05:07:32.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:07:32.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:07:32.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:07:32.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T05:07:32.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T05:07:32.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T05:07:32.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T05:07:32.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:07:32.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:07:32.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:07:33.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 275.0 s, 742.4 tps, lat 143.800 ms stddev 179.474 2024-08-20T05:07:33.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:33 smithi130 ceph-mon[22007]: Adjusting osd_memory_target on smithi037 to 177.5M 2024-08-20T05:07:33.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:33 smithi130 ceph-mon[22007]: Unable to set osd_memory_target on smithi037 to 186146508: error parsing value: Value '186146508' is below minimum 939524096 2024-08-20T05:07:33.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:33 smithi130 ceph-mon[22007]: pgmap v560: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 4.8 MiB/s wr, 648 op/s 2024-08-20T05:07:33.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:33 smithi037 ceph-mon[17265]: Adjusting osd_memory_target on smithi037 to 177.5M 2024-08-20T05:07:33.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:33 smithi037 ceph-mon[17265]: Unable to set osd_memory_target on smithi037 to 186146508: error parsing value: Value '186146508' is below minimum 939524096 2024-08-20T05:07:33.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:33 smithi037 ceph-mon[17265]: pgmap v560: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 4.8 MiB/s wr, 648 op/s 2024-08-20T05:07:33.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:33 smithi135 ceph-mon[22342]: Adjusting osd_memory_target on smithi037 to 177.5M 2024-08-20T05:07:33.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:33 smithi135 ceph-mon[22342]: Unable to set osd_memory_target on smithi037 to 186146508: error parsing value: Value '186146508' is below minimum 939524096 2024-08-20T05:07:33.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:33 smithi135 ceph-mon[22342]: pgmap v560: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 4.8 MiB/s wr, 648 op/s 2024-08-20T05:07:35.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:35 smithi130 ceph-mon[22007]: pgmap v561: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 4.6 MiB/s wr, 627 op/s 2024-08-20T05:07:35.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:35 smithi037 ceph-mon[17265]: pgmap v561: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 4.6 MiB/s wr, 627 op/s 2024-08-20T05:07:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:35 smithi135 ceph-mon[22342]: pgmap v561: 129 pgs: 129 active+clean; 1.1 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 4.6 MiB/s wr, 627 op/s 2024-08-20T05:07:36.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:36 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:07:36.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:36 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:07:36.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:36 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:07:36.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:36 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:07:36.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:36 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:07:36.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:36 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:07:37.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:37 smithi130 ceph-mon[22007]: pgmap v562: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 4.7 MiB/s wr, 647 op/s 2024-08-20T05:07:37.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:37 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:07:37.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:37 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:07:37.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:37 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:07:37.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:37 smithi037 ceph-mon[17265]: pgmap v562: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 4.7 MiB/s wr, 647 op/s 2024-08-20T05:07:37.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:37 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:07:37.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:37 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:07:37.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:37 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:07:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:37 smithi135 ceph-mon[22342]: pgmap v562: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 4.7 MiB/s wr, 647 op/s 2024-08-20T05:07:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:37 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:07:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:37 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:07:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:37 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:07:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 280.0 s, 1359.8 tps, lat 73.287 ms stddev 85.477 2024-08-20T05:07:38.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.417+0000 7fcbb2400640 1 -- 172.21.15.37:0/1004376318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbac079260 msgr2=0x7fcbac079bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.417+0000 7fcbb2400640 1 --2- 172.21.15.37:0/1004376318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbac079260 0x7fcbac079bb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c009900 tx=0x7fcb9c02a410 comp rx=0 tx=0).stop 2024-08-20T05:07:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.417+0000 7fcbb2400640 1 -- 172.21.15.37:0/1004376318 shutdown_connections 2024-08-20T05:07:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.417+0000 7fcbb2400640 1 --2- 172.21.15.37:0/1004376318 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbac079260 0x7fcbac079bb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.418+0000 7fcbb2400640 1 --2- 172.21.15.37:0/1004376318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbac0788a0 0x7fcbac078d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.418+0000 7fcbb2400640 1 --2- 172.21.15.37:0/1004376318 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbac077750 0x7fcbac077b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.418+0000 7fcbb2400640 1 -- 172.21.15.37:0/1004376318 >> 172.21.15.37:0/1004376318 conn(0x7fcbac100170 msgr2=0x7fcbac102590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.418+0000 7fcbb2400640 1 -- 172.21.15.37:0/1004376318 shutdown_connections 2024-08-20T05:07:38.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.418+0000 7fcbb2400640 1 -- 172.21.15.37:0/1004376318 wait complete. 2024-08-20T05:07:38.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.422+0000 7fcbb2400640 1 Processor -- start 2024-08-20T05:07:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.422+0000 7fcbb2400640 1 -- start start 2024-08-20T05:07:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.423+0000 7fcbb2400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbac077750 0x7fcbac19f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.423+0000 7fcbb2400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbac0788a0 0x7fcbac19f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.423+0000 7fcbb2400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbac079260 0x7fcbac1a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.423+0000 7fcbb2400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac114a20 con 0x7fcbac079260 2024-08-20T05:07:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.423+0000 7fcbb2400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac1148a0 con 0x7fcbac077750 2024-08-20T05:07:38.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.423+0000 7fcbb2400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac114ba0 con 0x7fcbac0788a0 2024-08-20T05:07:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.423+0000 7fcbab400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbac077750 0x7fcbac19f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.423+0000 7fcbaaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbac0788a0 0x7fcbac19f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.423+0000 7fcbab400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbac077750 0x7fcbac19f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:58304/0 (socket says 172.21.15.37:58304) 2024-08-20T05:07:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.423+0000 7fcbab400640 1 -- 172.21.15.37:0/1790613149 learned_addr learned my addr 172.21.15.37:0/1790613149 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.424+0000 7fcbabe00640 1 --2- 172.21.15.37:0/1790613149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbac079260 0x7fcbac1a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.424+0000 7fcbab400640 1 -- 172.21.15.37:0/1790613149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbac0788a0 msgr2=0x7fcbac19f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.424+0000 7fcbab400640 1 --2- 172.21.15.37:0/1790613149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbac0788a0 0x7fcbac19f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.424+0000 7fcbab400640 1 -- 172.21.15.37:0/1790613149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbac079260 msgr2=0x7fcbac1a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:38.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.424+0000 7fcbab400640 1 --2- 172.21.15.37:0/1790613149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbac079260 0x7fcbac1a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.424+0000 7fcbab400640 1 -- 172.21.15.37:0/1790613149 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbac1a0ce0 con 0x7fcbac077750 2024-08-20T05:07:38.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.424+0000 7fcbaaa00640 1 --2- 172.21.15.37:0/1790613149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbac0788a0 0x7fcbac19f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:07:38.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.424+0000 7fcbab400640 1 --2- 172.21.15.37:0/1790613149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbac077750 0x7fcbac19f1a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcb9800b4a0 tx=0x7fcb9800b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:38.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.426+0000 7fcba3e00640 1 -- 172.21.15.37:0/1790613149 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98014070 con 0x7fcbac077750 2024-08-20T05:07:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.426+0000 7fcba3e00640 1 -- 172.21.15.37:0/1790613149 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb98010ac0 con 0x7fcbac077750 2024-08-20T05:07:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.426+0000 7fcba3e00640 1 -- 172.21.15.37:0/1790613149 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb98017c30 con 0x7fcbac077750 2024-08-20T05:07:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.426+0000 7fcbb2400640 1 -- 172.21.15.37:0/1790613149 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbac1a0fd0 con 0x7fcbac077750 2024-08-20T05:07:38.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.426+0000 7fcbb2400640 1 -- 172.21.15.37:0/1790613149 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbac104660 con 0x7fcbac077750 2024-08-20T05:07:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.435+0000 7fcbb5400740 1 Processor -- start 2024-08-20T05:07:38.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.436+0000 7fcbb5400740 1 -- start start 2024-08-20T05:07:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.436+0000 7fcbb5400740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8c2b0 0x561b01e8e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.436+0000 7fcbb5400740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e8ebe0 0x561b01e90fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.436+0000 7fcbb5400740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e91620 0x561b01e93ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.436+0000 7fcbb5400740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561b01dff210 con 0x561b01e91620 2024-08-20T05:07:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.436+0000 7fcbb5400740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561b01dee710 con 0x561b01e8ebe0 2024-08-20T05:07:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.436+0000 7fcbb5400740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561b01df2750 con 0x561b01e8c2b0 2024-08-20T05:07:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.437+0000 7fcbabe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8c2b0 0x561b01e8e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.437+0000 7fcbabe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8c2b0 0x561b01e8e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:60794/0 (socket says 172.21.15.37:60794) 2024-08-20T05:07:38.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.437+0000 7fcbabe00640 1 -- 172.21.15.37:0/1345750061 learned_addr learned my addr 172.21.15.37:0/1345750061 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:38.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.438+0000 7fcbabe00640 1 -- 172.21.15.37:0/1345750061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e8ebe0 msgr2=0x561b01e90fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:07:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.438+0000 7fcbabe00640 1 --2- 172.21.15.37:0/1345750061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e8ebe0 0x561b01e90fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.438+0000 7fcbabe00640 1 -- 172.21.15.37:0/1345750061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e91620 msgr2=0x561b01e93ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:07:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.438+0000 7fcbabe00640 1 --2- 172.21.15.37:0/1345750061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e91620 0x561b01e93ae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.438+0000 7fcbabe00640 1 -- 172.21.15.37:0/1345750061 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b01dbade0 con 0x561b01e8c2b0 2024-08-20T05:07:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.439+0000 7fcba3e00640 1 -- 172.21.15.37:0/1790613149 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcb98017070 con 0x7fcbac077750 2024-08-20T05:07:38.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.439+0000 7fcbabe00640 1 --2- 172.21.15.37:0/1345750061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8c2b0 0x561b01e8e6a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c005ab0 tx=0x7fcb9c004180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=810e9054c21345d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:38.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.440+0000 7fcba0c00640 1 -- 172.21.15.37:0/1345750061 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c03f070 con 0x561b01e8c2b0 2024-08-20T05:07:38.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.440+0000 7fcba0c00640 1 -- 172.21.15.37:0/1345750061 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb9c0054f0 con 0x561b01e8c2b0 2024-08-20T05:07:38.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.440+0000 7fcba0c00640 1 -- 172.21.15.37:0/1345750061 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c035030 con 0x561b01e8c2b0 2024-08-20T05:07:38.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.445+0000 7fcba3e00640 1 --2- 172.21.15.37:0/1790613149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcb900b3c50 0x7fcb900b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.446+0000 7fcbab400640 1 --2- 172.21.15.37:0/1790613149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcb900b3c50 0x7fcb900b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:38.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.446+0000 7fcbb5400740 1 -- 172.21.15.37:0/1345750061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8c2b0 msgr2=0x561b01e8e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:38.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.446+0000 7fcbb5400740 1 --2- 172.21.15.37:0/1345750061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8c2b0 0x561b01e8e6a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c005ab0 tx=0x7fcb9c004180 comp rx=0 tx=0).stop 2024-08-20T05:07:38.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.446+0000 7fcba3e00640 1 -- 172.21.15.37:0/1790613149 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fcb980e32f0 con 0x7fcbac077750 2024-08-20T05:07:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.447+0000 7fcbb5400740 1 -- 172.21.15.37:0/1345750061 shutdown_connections 2024-08-20T05:07:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.447+0000 7fcbb5400740 1 --2- 172.21.15.37:0/1345750061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e91620 0x561b01e93ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.447+0000 7fcbb5400740 1 --2- 172.21.15.37:0/1345750061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e8ebe0 0x561b01e90fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.447+0000 7fcbb5400740 1 --2- 172.21.15.37:0/1345750061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8c2b0 0x561b01e8e6a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.447+0000 7fcbb5400740 1 -- 172.21.15.37:0/1345750061 >> 172.21.15.37:0/1345750061 conn(0x561b01e873b0 msgr2=0x561b01e88190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:38.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.447+0000 7fcbb5400740 1 -- 172.21.15.37:0/1345750061 shutdown_connections 2024-08-20T05:07:38.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.448+0000 7fcbb5400740 1 -- 172.21.15.37:0/1345750061 wait complete. 2024-08-20T05:07:38.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.449+0000 7fcbab400640 1 --2- 172.21.15.37:0/1790613149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcb900b3c50 0x7fcb900b6110 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcb980a9e30 tx=0x7fcb98010f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:38.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.449+0000 7fcbb5400740 1 -- start start 2024-08-20T05:07:38.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.450+0000 7fcbb5400740 1 Processor -- start 2024-08-20T05:07:38.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.451+0000 7fcbb5400740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e8c2b0 0x561b01e95cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.451+0000 7fcbb5400740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8ebe0 0x561b01e96360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.451+0000 7fcbb5400740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e91620 0x561b01e96f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.451+0000 7fcbb5400740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561b01d27ab0 con 0x561b01e8c2b0 2024-08-20T05:07:38.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.451+0000 7fcbb5400740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561b01d95140 con 0x561b01e91620 2024-08-20T05:07:38.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.451+0000 7fcbb5400740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561b01e945a0 con 0x561b01e8ebe0 2024-08-20T05:07:38.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.451+0000 7fcbb5400740 10 client.0 _ll_register_callbacks cb 0x561b01da85d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.452+0000 7fcbaaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8ebe0 0x561b01e96360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.452+0000 7fcbaaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8ebe0 0x561b01e96360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:60800/0 (socket says 172.21.15.37:60800) 2024-08-20T05:07:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.452+0000 7fcbaaa00640 1 -- 172.21.15.37:0/2462419354 learned_addr learned my addr 172.21.15.37:0/2462419354 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:38.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.452+0000 7fcbabe00640 1 --2- 172.21.15.37:0/2462419354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e91620 0x561b01e96f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.453+0000 7fcbaaa00640 1 -- 172.21.15.37:0/2462419354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e91620 msgr2=0x561b01e96f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.453+0000 7fcbaaa00640 1 --2- 172.21.15.37:0/2462419354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e91620 0x561b01e96f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.453+0000 7fcbaaa00640 1 -- 172.21.15.37:0/2462419354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e8c2b0 msgr2=0x561b01e95cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.453+0000 7fcbaaa00640 1 --2- 172.21.15.37:0/2462419354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e8c2b0 0x561b01e95cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.453+0000 7fcbaaa00640 1 -- 172.21.15.37:0/2462419354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b01d96170 con 0x561b01e8ebe0 2024-08-20T05:07:38.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.453+0000 7fcbaaa00640 1 --2- 172.21.15.37:0/2462419354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8ebe0 0x561b01e96360 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcba400af10 tx=0x7fcba400e490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b239326ec95a2517 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:38.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.453+0000 7fcb95600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:07:38.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.454+0000 7fcb95600640 1 -- 172.21.15.37:0/2462419354 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba4018020 con 0x561b01e8ebe0 2024-08-20T05:07:38.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.454+0000 7fcb95600640 1 -- 172.21.15.37:0/2462419354 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fcba4014600 con 0x561b01e8ebe0 2024-08-20T05:07:38.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.454+0000 7fcbabe00640 1 --2- 172.21.15.37:0/2462419354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e91620 0x561b01e96f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:07:38.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.457+0000 7fcbb5400740 1 -- 172.21.15.37:0/2462419354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561b01dc5a30 con 0x561b01e8ebe0 2024-08-20T05:07:38.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.459+0000 7fcb95600640 1 -- 172.21.15.37:0/2462419354 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fcba4014800 con 0x561b01e8ebe0 2024-08-20T05:07:38.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.459+0000 7fcbb5400740 10 client.26908 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:38.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.459+0000 7fcbb5400740 1 -- 172.21.15.37:0/2462419354 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x561b01b51790 con 0x561b01e8ebe0 2024-08-20T05:07:38.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.460+0000 7fcb95600640 1 -- 172.21.15.37:0/2462419354 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x561b01dc5a30 con 0x561b01e8ebe0 2024-08-20T05:07:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.460+0000 7fcb95600640 1 -- 172.21.15.37:0/2462419354 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fcba401cad0 con 0x561b01e8ebe0 2024-08-20T05:07:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.461+0000 7fcbb5400740 10 client.26908 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.461+0000 7fcbb5400740 10 client.26908 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:07:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.461+0000 7fcbb5400740 20 client.26908 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.461+0000 7fcbb5400740 1 --2- 172.21.15.37:0/2462419354 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561b01ea19a0 0x561b01ea3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.461+0000 7fcbb5400740 4 client.26908 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:07:38.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.461+0000 7fcbb5400740 1 -- 172.21.15.37:0/2462419354 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b01e01160 con 0x561b01ea19a0 2024-08-20T05:07:38.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.462+0000 7fcbabe00640 1 --2- 172.21.15.37:0/2462419354 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561b01ea19a0 0x561b01ea3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.463+0000 7fcbabe00640 1 --2- 172.21.15.37:0/2462419354 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561b01ea19a0 0x561b01ea3d90 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95db06686599b8f7 server_cookie=c554657e3a582b52 in_seq=0 out_seq=0 2024-08-20T05:07:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.463+0000 7fcb95600640 10 client.26908 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:38.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.464+0000 7fcb95600640 1 -- 172.21.15.37:0/2462419354 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561b01e01160 con 0x561b01ea19a0 2024-08-20T05:07:38.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.464+0000 7fcb95600640 10 client.26908 handle_command_reply: tid=0 2024-08-20T05:07:38.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.464+0000 7fcbb5400740 1 client.26908 shutdown 2024-08-20T05:07:38.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.467+0000 7fcbb5400740 1 -- 172.21.15.37:0/2462419354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8ebe0 msgr2=0x561b01e96360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.468+0000 7fcbb5400740 1 --2- 172.21.15.37:0/2462419354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8ebe0 0x561b01e96360 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcba400af10 tx=0x7fcba400e490 comp rx=0 tx=0).stop 2024-08-20T05:07:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.468+0000 7fcbb5400740 1 -- 172.21.15.37:0/2462419354 shutdown_connections 2024-08-20T05:07:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.468+0000 7fcbb5400740 1 --2- 172.21.15.37:0/2462419354 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561b01ea19a0 0x561b01ea3d90 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.468+0000 7fcbb5400740 1 --2- 172.21.15.37:0/2462419354 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e91620 0x561b01e96f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.468+0000 7fcbb5400740 1 --2- 172.21.15.37:0/2462419354 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8ebe0 0x561b01e96360 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.468+0000 7fcbb5400740 1 --2- 172.21.15.37:0/2462419354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e8c2b0 0x561b01e95cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.468+0000 7fcbb5400740 1 -- 172.21.15.37:0/2462419354 >> 172.21.15.37:0/2462419354 conn(0x561b01e873b0 msgr2=0x561b01e864d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:38.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.468+0000 7fcb95600640 0 client.26908 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:38.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.469+0000 7fcbb5400740 1 -- 172.21.15.37:0/2462419354 shutdown_connections 2024-08-20T05:07:38.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.470+0000 7fcbb5400740 1 -- 172.21.15.37:0/2462419354 wait complete. 2024-08-20T05:07:38.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.470+0000 7fcbb5400740 20 client.26908 trim_cache size 0 max 16384 2024-08-20T05:07:38.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.507+0000 7fcbb5400740 1 Processor -- start 2024-08-20T05:07:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.508+0000 7fcbb5400740 1 -- start start 2024-08-20T05:07:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.508+0000 7fcbb5400740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8c2b0 0x561b01e880c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.509+0000 7fcbb5400740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e8ebe0 0x561b01e932f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.509+0000 7fcbb5400740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e91620 0x561b01e93830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.509+0000 7fcbb5400740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac1ba270 con 0x561b01e91620 2024-08-20T05:07:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.509+0000 7fcbb5400740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac1bbdb0 con 0x561b01e8ebe0 2024-08-20T05:07:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.509+0000 7fcbb5400740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac1ba940 con 0x561b01e8c2b0 2024-08-20T05:07:38.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.509+0000 7fcbabe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8c2b0 0x561b01e880c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.509+0000 7fcbabe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8c2b0 0x561b01e880c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:60814/0 (socket says 172.21.15.37:60814) 2024-08-20T05:07:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.509+0000 7fcbabe00640 1 -- 172.21.15.37:0/2972621907 learned_addr learned my addr 172.21.15.37:0/2972621907 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.509+0000 7fcbaaa00640 1 --2- 172.21.15.37:0/2972621907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e8ebe0 0x561b01e932f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:38.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.510+0000 7fcbaaa00640 1 -- 172.21.15.37:0/2972621907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8c2b0 msgr2=0x561b01e880c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.510+0000 7fcbaaa00640 1 --2- 172.21.15.37:0/2972621907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8c2b0 0x561b01e880c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.510+0000 7fcbaaa00640 1 -- 172.21.15.37:0/2972621907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e91620 msgr2=0x561b01e93830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.510+0000 7fcbaaa00640 1 --2- 172.21.15.37:0/2972621907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e91620 0x561b01e93830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.510+0000 7fcbaaa00640 1 -- 172.21.15.37:0/2972621907 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b01e8ea10 con 0x561b01e8ebe0 2024-08-20T05:07:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.510+0000 7fcbaaa00640 1 --2- 172.21.15.37:0/2972621907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e8ebe0 0x561b01e932f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcba401f040 tx=0x7fcba400ab00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53626f3b7960f5d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.511+0000 7fcb97e00640 1 -- 172.21.15.37:0/2972621907 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba402a020 con 0x561b01e8ebe0 2024-08-20T05:07:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.511+0000 7fcb97e00640 1 -- 172.21.15.37:0/2972621907 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcba4014e50 con 0x561b01e8ebe0 2024-08-20T05:07:38.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.511+0000 7fcb97e00640 1 -- 172.21.15.37:0/2972621907 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba4018040 con 0x561b01e8ebe0 2024-08-20T05:07:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.512+0000 7fcbb5400740 1 -- 172.21.15.37:0/2972621907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e8ebe0 msgr2=0x561b01e932f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.512+0000 7fcbb5400740 1 --2- 172.21.15.37:0/2972621907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e8ebe0 0x561b01e932f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcba401f040 tx=0x7fcba400ab00 comp rx=0 tx=0).stop 2024-08-20T05:07:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.512+0000 7fcbb5400740 1 -- 172.21.15.37:0/2972621907 shutdown_connections 2024-08-20T05:07:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.512+0000 7fcbb5400740 1 --2- 172.21.15.37:0/2972621907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e91620 0x561b01e93830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.512+0000 7fcbb5400740 1 --2- 172.21.15.37:0/2972621907 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e8ebe0 0x561b01e932f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.514 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.512+0000 7fcbb5400740 1 --2- 172.21.15.37:0/2972621907 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8c2b0 0x561b01e880c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.512+0000 7fcbb5400740 1 -- 172.21.15.37:0/2972621907 >> 172.21.15.37:0/2972621907 conn(0x561b01e873b0 msgr2=0x561b01e82230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.512+0000 7fcbb5400740 1 -- 172.21.15.37:0/2972621907 shutdown_connections 2024-08-20T05:07:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.512+0000 7fcbb5400740 1 -- 172.21.15.37:0/2972621907 wait complete. 2024-08-20T05:07:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.513+0000 7fcbb5400740 1 -- start start 2024-08-20T05:07:38.515 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.513+0000 7fcbb5400740 1 Processor -- start 2024-08-20T05:07:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.514+0000 7fcbb5400740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e8c2b0 0x561b01e9a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.514+0000 7fcbb5400740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8ebe0 0x561b01e9b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.514+0000 7fcbb5400740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e91620 0x561b01e9bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.514+0000 7fcbb5400740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac1bb6e0 con 0x561b01e8c2b0 2024-08-20T05:07:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.514+0000 7fcbb5400740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac1bb010 con 0x561b01e91620 2024-08-20T05:07:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.514+0000 7fcbb5400740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcbac10c980 con 0x561b01e8ebe0 2024-08-20T05:07:38.516 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.514+0000 7fcbb5400740 10 client.0 _ll_register_callbacks cb 0x7fcba4009e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.515+0000 7fcbaaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8ebe0 0x561b01e9b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.515+0000 7fcbaaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8ebe0 0x561b01e9b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:60818/0 (socket says 172.21.15.37:60818) 2024-08-20T05:07:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.515+0000 7fcbaaa00640 1 -- 172.21.15.37:0/3202092590 learned_addr learned my addr 172.21.15.37:0/3202092590 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:38.517 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.515+0000 7fcbabe00640 1 --2- 172.21.15.37:0/3202092590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e8c2b0 0x561b01e9a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.516+0000 7fcbaaa00640 1 -- 172.21.15.37:0/3202092590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e91620 msgr2=0x561b01e9bbd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:07:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.516+0000 7fcbaaa00640 1 --2- 172.21.15.37:0/3202092590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e91620 0x561b01e9bbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.516+0000 7fcbaaa00640 1 -- 172.21.15.37:0/3202092590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e8c2b0 msgr2=0x561b01e9a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.516+0000 7fcbaaa00640 1 --2- 172.21.15.37:0/3202092590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e8c2b0 0x561b01e9a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.516+0000 7fcbaaa00640 1 -- 172.21.15.37:0/3202092590 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b01bca620 con 0x561b01e8ebe0 2024-08-20T05:07:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.516+0000 7fcbabe00640 1 --2- 172.21.15.37:0/3202092590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e8c2b0 0x561b01e9a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:07:38.518 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.517+0000 7fcbaaa00640 1 --2- 172.21.15.37:0/3202092590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8ebe0 0x561b01e9b000 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcba40133b0 tx=0x7fcba4004b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f544683ae724ff2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:38.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.517+0000 7fcb95600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:07:38.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.517+0000 7fcb95600640 1 -- 172.21.15.37:0/3202092590 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba402a030 con 0x561b01e8ebe0 2024-08-20T05:07:38.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.517+0000 7fcb95600640 1 -- 172.21.15.37:0/3202092590 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fcba4013dc0 con 0x561b01e8ebe0 2024-08-20T05:07:38.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.518+0000 7fcbb5400740 1 -- 172.21.15.37:0/3202092590 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcba4014e50 con 0x561b01e8ebe0 2024-08-20T05:07:38.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.519+0000 7fcb95600640 1 -- 172.21.15.37:0/3202092590 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fcba403d050 con 0x561b01e8ebe0 2024-08-20T05:07:38.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.519+0000 7fcbb5400740 10 client.26914 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:38.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.519+0000 7fcbb5400740 1 -- 172.21.15.37:0/3202092590 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x561b01e9d5f0 con 0x561b01e8ebe0 2024-08-20T05:07:38.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.519+0000 7fcb95600640 1 -- 172.21.15.37:0/3202092590 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcba4014e50 con 0x561b01e8ebe0 2024-08-20T05:07:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.519+0000 7fcb95600640 1 -- 172.21.15.37:0/3202092590 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fcba4026430 con 0x561b01e8ebe0 2024-08-20T05:07:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.520+0000 7fcbb5400740 10 client.26914 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.520+0000 7fcbb5400740 10 client.26914 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:07:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.520+0000 7fcbb5400740 20 client.26914 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.520+0000 7fcbb5400740 1 --2- 172.21.15.37:0/3202092590 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561b01f0c630 0x561b01f0ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.520+0000 7fcbb5400740 4 client.26914 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:07:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.520+0000 7fcbb5400740 1 -- 172.21.15.37:0/3202092590 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561b01dfcc00 con 0x561b01f0c630 2024-08-20T05:07:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.520+0000 7fcbabe00640 1 --2- 172.21.15.37:0/3202092590 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561b01f0c630 0x561b01f0ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.521+0000 7fcb95600640 10 client.26914 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.521+0000 7fcbabe00640 1 --2- 172.21.15.37:0/3202092590 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561b01f0c630 0x561b01f0ea20 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adecec2a035881bc server_cookie=3e7d854dcb8035f2 in_seq=0 out_seq=0 2024-08-20T05:07:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.535+0000 7fcb95600640 1 -- 172.21.15.37:0/3202092590 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561b01dfcc00 con 0x561b01f0c630 2024-08-20T05:07:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.535+0000 7fcb95600640 10 client.26914 handle_command_reply: tid=0 2024-08-20T05:07:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.535+0000 7fcbb5400740 1 client.26914 shutdown 2024-08-20T05:07:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.535+0000 7fcbb5400740 1 -- 172.21.15.37:0/3202092590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8ebe0 msgr2=0x561b01e9b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.535+0000 7fcbb5400740 1 --2- 172.21.15.37:0/3202092590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8ebe0 0x561b01e9b000 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcba40133b0 tx=0x7fcba4004b50 comp rx=0 tx=0).stop 2024-08-20T05:07:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.535+0000 7fcbb5400740 1 -- 172.21.15.37:0/3202092590 shutdown_connections 2024-08-20T05:07:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.535+0000 7fcbb5400740 1 --2- 172.21.15.37:0/3202092590 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561b01f0c630 0x561b01f0ea20 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.535+0000 7fcbb5400740 1 --2- 172.21.15.37:0/3202092590 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561b01e91620 0x561b01e9bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.535+0000 7fcb95600640 0 client.26914 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.535+0000 7fcbb5400740 1 --2- 172.21.15.37:0/3202092590 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561b01e8ebe0 0x561b01e9b000 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.535+0000 7fcbb5400740 1 --2- 172.21.15.37:0/3202092590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561b01e8c2b0 0x561b01e9a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.535+0000 7fcbb5400740 1 -- 172.21.15.37:0/3202092590 >> 172.21.15.37:0/3202092590 conn(0x561b01e873b0 msgr2=0x561b01e932f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.535+0000 7fcbb5400740 1 -- 172.21.15.37:0/3202092590 shutdown_connections 2024-08-20T05:07:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.536+0000 7fcbb5400740 1 -- 172.21.15.37:0/3202092590 wait complete. 2024-08-20T05:07:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.536+0000 7fcbb5400740 20 client.26914 trim_cache size 0 max 16384 2024-08-20T05:07:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:07:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:07:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:07:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:07:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.538+0000 7fcbb2400640 1 -- 172.21.15.37:0/1790613149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcb900b3c50 msgr2=0x7fcb900b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.538+0000 7fcbb2400640 1 --2- 172.21.15.37:0/1790613149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcb900b3c50 0x7fcb900b6110 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fcb980a9e30 tx=0x7fcb98010f90 comp rx=0 tx=0).stop 2024-08-20T05:07:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.538+0000 7fcbb2400640 1 -- 172.21.15.37:0/1790613149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbac077750 msgr2=0x7fcbac19f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.538+0000 7fcbb2400640 1 --2- 172.21.15.37:0/1790613149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbac077750 0x7fcbac19f1a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcb9800b4a0 tx=0x7fcb9800b960 comp rx=0 tx=0).stop 2024-08-20T05:07:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.538+0000 7fcbb2400640 1 -- 172.21.15.37:0/1790613149 shutdown_connections 2024-08-20T05:07:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.538+0000 7fcbb2400640 1 --2- 172.21.15.37:0/1790613149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcb900b3c50 0x7fcb900b6110 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.538+0000 7fcbb2400640 1 --2- 172.21.15.37:0/1790613149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbac079260 0x7fcbac1a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.538+0000 7fcbb2400640 1 --2- 172.21.15.37:0/1790613149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcbac0788a0 0x7fcbac19f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.538+0000 7fcbb2400640 1 --2- 172.21.15.37:0/1790613149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcbac077750 0x7fcbac19f1a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.538+0000 7fcbb2400640 1 -- 172.21.15.37:0/1790613149 >> 172.21.15.37:0/1790613149 conn(0x7fcbac100170 msgr2=0x7fcbac101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.539+0000 7fcbb2400640 1 -- 172.21.15.37:0/1790613149 shutdown_connections 2024-08-20T05:07:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:38.539+0000 7fcbb2400640 1 -- 172.21.15.37:0/1790613149 wait complete. 2024-08-20T05:07:39.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:39 smithi037 ceph-mon[17265]: pgmap v563: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 4.4 MiB/s wr, 594 op/s 2024-08-20T05:07:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:39 smithi135 ceph-mon[22342]: pgmap v563: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 4.4 MiB/s wr, 594 op/s 2024-08-20T05:07:39.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:39 smithi130 ceph-mon[22007]: pgmap v563: 129 pgs: 129 active+clean; 1.1 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 4.4 MiB/s wr, 594 op/s 2024-08-20T05:07:41.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:41 smithi037 ceph-mon[17265]: pgmap v564: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.8 MiB/s wr, 714 op/s 2024-08-20T05:07:41.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:41 smithi135 ceph-mon[22342]: pgmap v564: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.8 MiB/s wr, 714 op/s 2024-08-20T05:07:41.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:41 smithi130 ceph-mon[22007]: pgmap v564: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.8 MiB/s wr, 714 op/s 2024-08-20T05:07:43.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 285.0 s, 1215.0 tps, lat 82.089 ms stddev 115.128 2024-08-20T05:07:43.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:43 smithi037 ceph-mon[17265]: pgmap v565: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.4 MiB/s wr, 650 op/s 2024-08-20T05:07:43.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:43 smithi135 ceph-mon[22342]: pgmap v565: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.4 MiB/s wr, 650 op/s 2024-08-20T05:07:43.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:43 smithi130 ceph-mon[22007]: pgmap v565: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.4 MiB/s wr, 650 op/s 2024-08-20T05:07:45.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:45 smithi037 ceph-mon[17265]: pgmap v566: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 603 op/s 2024-08-20T05:07:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:45 smithi135 ceph-mon[22342]: pgmap v566: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 603 op/s 2024-08-20T05:07:45.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:45 smithi130 ceph-mon[22007]: pgmap v566: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 603 op/s 2024-08-20T05:07:47.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:47 smithi135 ceph-mon[22342]: pgmap v567: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.7 MiB/s wr, 685 op/s 2024-08-20T05:07:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:47 smithi130 ceph-mon[22007]: pgmap v567: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.7 MiB/s wr, 685 op/s 2024-08-20T05:07:48.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:47 smithi037 ceph-mon[17265]: pgmap v567: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 7.7 MiB/s wr, 685 op/s 2024-08-20T05:07:48.040 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 290.0 s, 1247.2 tps, lat 79.644 ms stddev 104.356 2024-08-20T05:07:48.203 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-20T05:07:48.204 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-08-20T05:07:48.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:07:48.916 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:07:49.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:49 smithi135 ceph-mon[22342]: pgmap v568: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.1 MiB/s wr, 617 op/s 2024-08-20T05:07:49.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:49 smithi130 ceph-mon[22007]: pgmap v568: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.1 MiB/s wr, 617 op/s 2024-08-20T05:07:50.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:49 smithi037 ceph-mon[17265]: pgmap v568: 129 pgs: 129 active+clean; 1.1 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.1 MiB/s wr, 617 op/s 2024-08-20T05:07:51.669 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:51 smithi037 ceph-mon[17265]: pgmap v569: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 MiB/s wr, 688 op/s 2024-08-20T05:07:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.766+0000 7f7f4b200640 1 -- 172.21.15.37:0/3427380711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f4c1081a0 msgr2=0x7f7f4c10a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.766+0000 7f7f4b200640 1 --2- 172.21.15.37:0/3427380711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f4c1081a0 0x7f7f4c10a660 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7f44009be0 tx=0x7f7f4402a6c0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.766+0000 7f7f4b200640 1 -- 172.21.15.37:0/3427380711 shutdown_connections 2024-08-20T05:07:51.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.766+0000 7f7f4b200640 1 --2- 172.21.15.37:0/3427380711 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f4c1081a0 0x7f7f4c10a660 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.766+0000 7f7f4b200640 1 --2- 172.21.15.37:0/3427380711 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f4c1055f0 0x7f7f4c107a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.766+0000 7f7f4b200640 1 --2- 172.21.15.37:0/3427380711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f4c06b170 0x7f7f4c105060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.766+0000 7f7f4b200640 1 -- 172.21.15.37:0/3427380711 >> 172.21.15.37:0/3427380711 conn(0x7f7f4c0fcc50 msgr2=0x7f7f4c0ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.767+0000 7f7f4b200640 1 -- 172.21.15.37:0/3427380711 shutdown_connections 2024-08-20T05:07:51.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.767+0000 7f7f4b200640 1 -- 172.21.15.37:0/3427380711 wait complete. 2024-08-20T05:07:51.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.768+0000 7f7f4b200640 1 Processor -- start 2024-08-20T05:07:51.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.768+0000 7f7f4b200640 1 -- start start 2024-08-20T05:07:51.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.769+0000 7f7f4b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f4c06b170 0x7f7f4c112b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.769+0000 7f7f4b200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f4c1055f0 0x7f7f4c113140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.769+0000 7f7f4b200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f4c1081a0 0x7f7f4c111650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.769+0000 7f7f49e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f4c06b170 0x7f7f4c112b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.769+0000 7f7f49e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f4c06b170 0x7f7f4c112b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35312/0 (socket says 172.21.15.37:35312) 2024-08-20T05:07:51.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.769+0000 7f7f49e00640 1 -- 172.21.15.37:0/2476867059 learned_addr learned my addr 172.21.15.37:0/2476867059 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:51.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.769+0000 7f7f4b200640 1 -- 172.21.15.37:0/2476867059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c10bef0 con 0x7f7f4c1055f0 2024-08-20T05:07:51.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.769+0000 7f7f4a800640 1 --2- 172.21.15.37:0/2476867059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f4c1081a0 0x7f7f4c111650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.769+0000 7f7f4b200640 1 -- 172.21.15.37:0/2476867059 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c10bd70 con 0x7f7f4c1081a0 2024-08-20T05:07:51.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.769+0000 7f7f4b200640 1 -- 172.21.15.37:0/2476867059 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c10c070 con 0x7f7f4c06b170 2024-08-20T05:07:51.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.770+0000 7f7f49e00640 1 -- 172.21.15.37:0/2476867059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f4c1081a0 msgr2=0x7f7f4c111650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.770+0000 7f7f49e00640 1 --2- 172.21.15.37:0/2476867059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f4c1081a0 0x7f7f4c111650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.770+0000 7f7f49e00640 1 -- 172.21.15.37:0/2476867059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f4c1055f0 msgr2=0x7f7f4c113140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.770+0000 7f7f49e00640 1 --2- 172.21.15.37:0/2476867059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f4c1055f0 0x7f7f4c113140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.770+0000 7f7f49e00640 1 -- 172.21.15.37:0/2476867059 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4c111c60 con 0x7f7f4c06b170 2024-08-20T05:07:51.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.770+0000 7f7f49e00640 1 --2- 172.21.15.37:0/2476867059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f4c06b170 0x7f7f4c112b30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00e9c0 tx=0x7f7f3c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.771+0000 7f7f42a00640 1 -- 172.21.15.37:0/2476867059 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c00cde0 con 0x7f7f4c06b170 2024-08-20T05:07:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.771+0000 7f7f42a00640 1 -- 172.21.15.37:0/2476867059 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f3c0035f0 con 0x7f7f4c06b170 2024-08-20T05:07:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.773+0000 7f7f42a00640 1 -- 172.21.15.37:0/2476867059 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c010690 con 0x7f7f4c06b170 2024-08-20T05:07:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.773+0000 7f7f4b200640 1 -- 172.21.15.37:0/2476867059 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4c111f50 con 0x7f7f4c06b170 2024-08-20T05:07:51.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.774+0000 7f7f4b200640 1 -- 172.21.15.37:0/2476867059 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f4c112470 con 0x7f7f4c06b170 2024-08-20T05:07:51.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.788+0000 7f7f53c80740 1 Processor -- start 2024-08-20T05:07:51.790 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.788+0000 7f7f42a00640 1 -- 172.21.15.37:0/2476867059 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7f3c003a80 con 0x7f7f4c06b170 2024-08-20T05:07:51.791 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.789+0000 7f7f53c80740 1 -- start start 2024-08-20T05:07:51.791 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.789+0000 7f7f53c80740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 0x55f353b52be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.789+0000 7f7f53c80740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b53120 0x55f353b55510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.789+0000 7f7f53c80740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b55b60 0x55f353b58020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.789+0000 7f7f53c80740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f353ac3210 con 0x55f353b53120 2024-08-20T05:07:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.789+0000 7f7f53c80740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f353ab2710 con 0x55f353b55b60 2024-08-20T05:07:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.789+0000 7f7f53c80740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f353ab6750 con 0x55f353b507f0 2024-08-20T05:07:51.792 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.790+0000 7f7f49400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b55b60 0x55f353b58020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.790+0000 7f7f49400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b55b60 0x55f353b58020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:54312/0 (socket says 172.21.15.37:54312) 2024-08-20T05:07:51.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.791+0000 7f7f49400640 1 -- 172.21.15.37:0/910278773 learned_addr learned my addr 172.21.15.37:0/910278773 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.792+0000 7f7f4a800640 1 --2- 172.21.15.37:0/910278773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 0x55f353b52be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.792+0000 7f7f49400640 1 -- 172.21.15.37:0/910278773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 msgr2=0x55f353b52be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:51.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.792+0000 7f7f49400640 1 --2- 172.21.15.37:0/910278773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 0x55f353b52be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.792+0000 7f7f49400640 1 -- 172.21.15.37:0/910278773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b53120 msgr2=0x55f353b55510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.792+0000 7f7f49e00640 1 --2- 172.21.15.37:0/910278773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b53120 0x55f353b55510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.792+0000 7f7f49400640 1 --2- 172.21.15.37:0/910278773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b53120 0x55f353b55510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.793+0000 7f7f49400640 1 -- 172.21.15.37:0/910278773 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f353a7ede0 con 0x55f353b55b60 2024-08-20T05:07:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.793+0000 7f7f4a800640 1 --2- 172.21.15.37:0/910278773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 0x55f353b52be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:07:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.793+0000 7f7f49e00640 1 --2- 172.21.15.37:0/910278773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b53120 0x55f353b55510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.793+0000 7f7f42a00640 1 --2- 172.21.15.37:0/2476867059 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f300b3b80 0x7f7f300b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.796+0000 7f7f42a00640 1 -- 172.21.15.37:0/2476867059 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7f3c0e4130 con 0x7f7f4c06b170 2024-08-20T05:07:51.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.797+0000 7f7f4a800640 1 --2- 172.21.15.37:0/2476867059 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f300b3b80 0x7f7f300b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.797+0000 7f7f49400640 1 --2- 172.21.15.37:0/910278773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b55b60 0x55f353b58020 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009c40 tx=0x7f7f3800e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7e502d938aa9722 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:51.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.798+0000 7f7f37400640 1 -- 172.21.15.37:0/910278773 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f38005020 con 0x55f353b55b60 2024-08-20T05:07:51.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.798+0000 7f7f37400640 1 -- 172.21.15.37:0/910278773 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f380047a0 con 0x55f353b55b60 2024-08-20T05:07:51.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.798+0000 7f7f37400640 1 -- 172.21.15.37:0/910278773 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f38010690 con 0x55f353b55b60 2024-08-20T05:07:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.801+0000 7f7f53c80740 1 -- 172.21.15.37:0/910278773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b55b60 msgr2=0x55f353b58020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:51.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.801+0000 7f7f53c80740 1 --2- 172.21.15.37:0/910278773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b55b60 0x55f353b58020 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009c40 tx=0x7f7f3800e720 comp rx=0 tx=0).stop 2024-08-20T05:07:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.801+0000 7f7f53c80740 1 -- 172.21.15.37:0/910278773 shutdown_connections 2024-08-20T05:07:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.801+0000 7f7f53c80740 1 --2- 172.21.15.37:0/910278773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b55b60 0x55f353b58020 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.801+0000 7f7f53c80740 1 --2- 172.21.15.37:0/910278773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b53120 0x55f353b55510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.801+0000 7f7f53c80740 1 --2- 172.21.15.37:0/910278773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 0x55f353b52be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.801+0000 7f7f53c80740 1 -- 172.21.15.37:0/910278773 >> 172.21.15.37:0/910278773 conn(0x55f353b4b940 msgr2=0x55f353b4c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.801+0000 7f7f53c80740 1 -- 172.21.15.37:0/910278773 shutdown_connections 2024-08-20T05:07:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.802+0000 7f7f53c80740 1 -- 172.21.15.37:0/910278773 wait complete. 2024-08-20T05:07:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.802+0000 7f7f53c80740 1 -- start start 2024-08-20T05:07:51.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.802+0000 7f7f53c80740 1 Processor -- start 2024-08-20T05:07:51.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.802+0000 7fa278a00640 1 -- 172.21.15.37:0/2939721407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2740751f0 msgr2=0x7fa2740755d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:51.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.802+0000 7fa278a00640 1 --2- 172.21.15.37:0/2939721407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2740751f0 0x7fa2740755d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009900 tx=0x7fa25c02a440 comp rx=0 tx=0).stop 2024-08-20T05:07:51.806 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.803+0000 7f7f53c80740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b507f0 0x55f353b59f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.803+0000 7f7f53c80740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b53120 0x55f353b5a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.803+0000 7f7f53c80740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b55b60 0x55f353b5b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.803+0000 7f7f4a800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b55b60 0x55f353b5b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.804+0000 7f7f4a800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b55b60 0x55f353b5b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:54320/0 (socket says 172.21.15.37:54320) 2024-08-20T05:07:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.804+0000 7f7f53c80740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f3539ebab0 con 0x55f353b507f0 2024-08-20T05:07:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.804+0000 7f7f53c80740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f353a59140 con 0x55f353b55b60 2024-08-20T05:07:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.804+0000 7f7f53c80740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f353b58b40 con 0x55f353b53120 2024-08-20T05:07:51.807 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.804+0000 7f7f49400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b53120 0x55f353b5a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.804+0000 7fa278a00640 1 -- 172.21.15.37:0/2939721407 shutdown_connections 2024-08-20T05:07:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.804+0000 7fa278a00640 1 --2- 172.21.15.37:0/2939721407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa27410f0c0 0x7fa2741114b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.804+0000 7fa278a00640 1 --2- 172.21.15.37:0/2939721407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa274075b10 0x7fa27410eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.804+0000 7fa278a00640 1 --2- 172.21.15.37:0/2939721407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2740751f0 0x7fa2740755d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.804+0000 7f7f49400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b53120 0x55f353b5a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35350/0 (socket says 172.21.15.37:35350) 2024-08-20T05:07:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.804+0000 7f7f49400640 1 -- 172.21.15.37:0/2663255550 learned_addr learned my addr 172.21.15.37:0/2663255550 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.804+0000 7f7f53c80740 10 client.0 _ll_register_callbacks cb 0x55f353a6c5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.804+0000 7f7f49400640 1 -- 172.21.15.37:0/2663255550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b55b60 msgr2=0x55f353b5b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:51.809 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.804+0000 7f7f49400640 1 --2- 172.21.15.37:0/2663255550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b55b60 0x55f353b5b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.804+0000 7f7f49400640 1 -- 172.21.15.37:0/2663255550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b507f0 msgr2=0x55f353b59f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.804+0000 7f7f49400640 1 --2- 172.21.15.37:0/2663255550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b507f0 0x55f353b59f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.804+0000 7f7f49400640 1 -- 172.21.15.37:0/2663255550 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f353a5a170 con 0x55f353b53120 2024-08-20T05:07:51.810 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.805+0000 7f7f4a800640 1 --2- 172.21.15.37:0/2476867059 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f300b3b80 0x7f7f300b6040 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7f44006010 tx=0x7f7f440308d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:51.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.804+0000 7fa278a00640 1 -- 172.21.15.37:0/2939721407 >> 172.21.15.37:0/2939721407 conn(0x7fa2740fe500 msgr2=0x7fa274100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:51.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.804+0000 7fa278a00640 1 -- 172.21.15.37:0/2939721407 shutdown_connections 2024-08-20T05:07:51.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.805+0000 7fa278a00640 1 -- 172.21.15.37:0/2939721407 wait complete. 2024-08-20T05:07:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.806+0000 7f7f49400640 1 --2- 172.21.15.37:0/2663255550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b53120 0x55f353b5a5a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009560 tx=0x7f7f38005db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=816f5c2f665f02e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.806+0000 7f7f2be00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:07:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.806+0000 7f7f2be00640 1 -- 172.21.15.37:0/2663255550 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f38026020 con 0x55f353b53120 2024-08-20T05:07:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.807+0000 7f7f53c80740 1 -- 172.21.15.37:0/2663255550 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f380047a0 con 0x55f353b53120 2024-08-20T05:07:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.807+0000 7f7f2be00640 1 -- 172.21.15.37:0/2663255550 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7f38005220 con 0x55f353b53120 2024-08-20T05:07:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.808+0000 7f7f2be00640 1 -- 172.21.15.37:0/2663255550 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f7f3801d040 con 0x55f353b53120 2024-08-20T05:07:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.808+0000 7f7f53c80740 10 client.26929 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.808+0000 7f7f53c80740 1 -- 172.21.15.37:0/2663255550 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f353815790 con 0x55f353b53120 2024-08-20T05:07:51.813 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.808+0000 7f7f2be00640 1 -- 172.21.15.37:0/2663255550 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f380047a0 con 0x55f353b53120 2024-08-20T05:07:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.809+0000 7f7f2be00640 1 -- 172.21.15.37:0/2663255550 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f7f38010430 con 0x55f353b53120 2024-08-20T05:07:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.809+0000 7f7f53c80740 10 client.26929 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.809+0000 7f7f53c80740 10 client.26929 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:07:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.809+0000 7f7f53c80740 20 client.26929 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.809+0000 7f7f53c80740 1 --2- 172.21.15.37:0/2663255550 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f353b657d0 0x55f353b67be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.809+0000 7f7f53c80740 4 client.26929 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:07:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.809+0000 7f7f53c80740 1 -- 172.21.15.37:0/2663255550 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f353ac5160 con 0x55f353b657d0 2024-08-20T05:07:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.810+0000 7f7f49e00640 1 --2- 172.21.15.37:0/2663255550 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f353b657d0 0x55f353b67be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.814 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.811+0000 7f7f49e00640 1 --2- 172.21.15.37:0/2663255550 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f353b657d0 0x55f353b67be0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b4f777daf1e7280 server_cookie=e8a7e3c2aa181e81 in_seq=0 out_seq=0 2024-08-20T05:07:51.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.809+0000 7fa278a00640 1 Processor -- start 2024-08-20T05:07:51.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.809+0000 7fa278a00640 1 -- start start 2024-08-20T05:07:51.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.810+0000 7fa278a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2740751f0 0x7fa27410e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.810+0000 7fa278a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa274075b10 0x7fa27410e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.815 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.811+0000 7f7f2be00640 10 client.26929 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:51.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.810+0000 7fa278a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa27410f0c0 0x7fa274105840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.811+0000 7fa278a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2741042e0 con 0x7fa2740751f0 2024-08-20T05:07:51.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.811+0000 7fa278a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa274104160 con 0x7fa274075b10 2024-08-20T05:07:51.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.811+0000 7fa278a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa274104460 con 0x7fa27410f0c0 2024-08-20T05:07:51.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.811+0000 7fa272800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa27410f0c0 0x7fa274105840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.811+0000 7fa271400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa274075b10 0x7fa27410e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.811+0000 7fa271e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2740751f0 0x7fa27410e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.812+0000 7fa271e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2740751f0 0x7fa27410e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56538/0 (socket says 172.21.15.37:56538) 2024-08-20T05:07:51.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.812+0000 7fa271e00640 1 -- 172.21.15.37:0/2837678230 learned_addr learned my addr 172.21.15.37:0/2837678230 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.812+0000 7f7f2be00640 1 -- 172.21.15.37:0/2663255550 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f353ac5160 con 0x55f353b657d0 2024-08-20T05:07:51.817 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.812+0000 7f7f2be00640 10 client.26929 handle_command_reply: tid=0 2024-08-20T05:07:51.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.813+0000 7fa272800640 1 -- 172.21.15.37:0/2837678230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa274075b10 msgr2=0x7fa27410e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:51.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.813+0000 7fa272800640 1 --2- 172.21.15.37:0/2837678230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa274075b10 0x7fa27410e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.813+0000 7fa272800640 1 -- 172.21.15.37:0/2837678230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2740751f0 msgr2=0x7fa27410e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:51.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.813+0000 7fa272800640 1 --2- 172.21.15.37:0/2837678230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2740751f0 0x7fa27410e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.813+0000 7f7f53c80740 1 client.26929 shutdown 2024-08-20T05:07:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.813+0000 7f7f53c80740 1 -- 172.21.15.37:0/2663255550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b53120 msgr2=0x55f353b5a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.813+0000 7f7f53c80740 1 --2- 172.21.15.37:0/2663255550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b53120 0x55f353b5a5a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009560 tx=0x7f7f38005db0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.813+0000 7fa272800640 1 -- 172.21.15.37:0/2837678230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa274105fe0 con 0x7fa27410f0c0 2024-08-20T05:07:51.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.813+0000 7fa272800640 1 --2- 172.21.15.37:0/2837678230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa27410f0c0 0x7fa274105840 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa27406bdb0 tx=0x7fa26c00edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.814+0000 7f7f53c80740 1 -- 172.21.15.37:0/2663255550 shutdown_connections 2024-08-20T05:07:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.814+0000 7f7f53c80740 1 --2- 172.21.15.37:0/2663255550 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f353b657d0 0x55f353b67be0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.814+0000 7f7f53c80740 1 --2- 172.21.15.37:0/2663255550 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b55b60 0x55f353b5b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.814+0000 7f7f53c80740 1 --2- 172.21.15.37:0/2663255550 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b53120 0x55f353b5a5a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.814+0000 7f7f53c80740 1 --2- 172.21.15.37:0/2663255550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b507f0 0x55f353b59f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.814+0000 7f7f53c80740 1 -- 172.21.15.37:0/2663255550 >> 172.21.15.37:0/2663255550 conn(0x55f353b4b940 msgr2=0x55f353b4a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:51.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.814+0000 7fa26aa00640 1 -- 172.21.15.37:0/2837678230 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c00ccc0 con 0x7fa27410f0c0 2024-08-20T05:07:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.816+0000 7f7f2be00640 0 client.26929 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:51.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.814+0000 7fa26aa00640 1 -- 172.21.15.37:0/2837678230 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa26c005020 con 0x7fa27410f0c0 2024-08-20T05:07:51.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.814+0000 7fa278a00640 1 -- 172.21.15.37:0/2837678230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2741062d0 con 0x7fa27410f0c0 2024-08-20T05:07:51.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.814+0000 7fa26aa00640 1 -- 172.21.15.37:0/2837678230 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa26c00ce60 con 0x7fa27410f0c0 2024-08-20T05:07:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.817+0000 7f7f53c80740 1 -- 172.21.15.37:0/2663255550 shutdown_connections 2024-08-20T05:07:51.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.817+0000 7fa278a00640 1 -- 172.21.15.37:0/2837678230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa27410b2f0 con 0x7fa27410f0c0 2024-08-20T05:07:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.818+0000 7f7f53c80740 1 -- 172.21.15.37:0/2663255550 wait complete. 2024-08-20T05:07:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.818+0000 7f7f53c80740 20 client.26929 trim_cache size 0 max 16384 2024-08-20T05:07:51.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.822+0000 7fa278a00640 1 -- 172.21.15.37:0/2837678230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2740755d0 con 0x7fa27410f0c0 2024-08-20T05:07:51.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.833+0000 7fa26aa00640 1 -- 172.21.15.37:0/2837678230 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa26c004ac0 con 0x7fa27410f0c0 2024-08-20T05:07:51.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.839+0000 7fa26aa00640 1 --2- 172.21.15.37:0/2837678230 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2580b3de0 0x7fa2580b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.839+0000 7fa26aa00640 1 -- 172.21.15.37:0/2837678230 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa26c0e4cd0 con 0x7fa27410f0c0 2024-08-20T05:07:51.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.840+0000 7fa26aa00640 1 -- 172.21.15.37:0/2837678230 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa26c01c020 con 0x7fa27410f0c0 2024-08-20T05:07:51.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.840+0000 7fa271e00640 1 --2- 172.21.15.37:0/2837678230 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2580b3de0 0x7fa2580b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:51.841+0000 7fa271e00640 1 --2- 172.21.15.37:0/2837678230 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2580b3de0 0x7fa2580b62a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa25c006010 tx=0x7fa25c009540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:51.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.860+0000 7f7f53c80740 1 Processor -- start 2024-08-20T05:07:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.860+0000 7f7f53c80740 1 -- start start 2024-08-20T05:07:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.861+0000 7f7f53c80740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 0x55f353b55f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.861+0000 7f7f53c80740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b53120 0x55f353b56480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.861+0000 7f7f53c80740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b55b60 0x55f353b59f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.861+0000 7f7f53c80740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c1b9fc0 con 0x55f353b55b60 2024-08-20T05:07:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.861+0000 7f7f53c80740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c1bbb00 con 0x55f353b53120 2024-08-20T05:07:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.861+0000 7f7f53c80740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c1ba690 con 0x55f353b507f0 2024-08-20T05:07:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.861+0000 7f7f49400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b53120 0x55f353b56480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.861+0000 7f7f49400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b53120 0x55f353b56480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:54336/0 (socket says 172.21.15.37:54336) 2024-08-20T05:07:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.861+0000 7f7f49400640 1 -- 172.21.15.37:0/1457377877 learned_addr learned my addr 172.21.15.37:0/1457377877 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.862+0000 7f7f49e00640 1 --2- 172.21.15.37:0/1457377877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 0x55f353b55f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.862+0000 7f7f4a800640 1 --2- 172.21.15.37:0/1457377877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b55b60 0x55f353b59f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.862+0000 7f7f49400640 1 -- 172.21.15.37:0/1457377877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 msgr2=0x55f353b55f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.862+0000 7f7f49400640 1 --2- 172.21.15.37:0/1457377877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 0x55f353b55f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.862+0000 7f7f49400640 1 -- 172.21.15.37:0/1457377877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b55b60 msgr2=0x55f353b59f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.862+0000 7f7f49400640 1 --2- 172.21.15.37:0/1457377877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b55b60 0x55f353b59f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.862+0000 7f7f49400640 1 -- 172.21.15.37:0/1457377877 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f35388e620 con 0x55f353b53120 2024-08-20T05:07:51.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:51 smithi135 ceph-mon[22342]: pgmap v569: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 MiB/s wr, 688 op/s 2024-08-20T05:07:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.862+0000 7f7f4a800640 1 --2- 172.21.15.37:0/1457377877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b55b60 0x55f353b59f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:07:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.863+0000 7f7f49e00640 1 --2- 172.21.15.37:0/1457377877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 0x55f353b55f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:07:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.863+0000 7f7f49400640 1 --2- 172.21.15.37:0/1457377877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b53120 0x55f353b56480 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7f3802d040 tx=0x7f7f3800efd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff09530bfe34fd35 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.863+0000 7f7f36a00640 1 -- 172.21.15.37:0/1457377877 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f38037020 con 0x55f353b53120 2024-08-20T05:07:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.863+0000 7f7f36a00640 1 -- 172.21.15.37:0/1457377877 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f380047a0 con 0x55f353b53120 2024-08-20T05:07:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.863+0000 7f7f36a00640 1 -- 172.21.15.37:0/1457377877 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f38026040 con 0x55f353b53120 2024-08-20T05:07:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.865+0000 7f7f53c80740 1 -- 172.21.15.37:0/1457377877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b53120 msgr2=0x55f353b56480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.865+0000 7f7f53c80740 1 --2- 172.21.15.37:0/1457377877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b53120 0x55f353b56480 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7f3802d040 tx=0x7f7f3800efd0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.865+0000 7f7f53c80740 1 -- 172.21.15.37:0/1457377877 shutdown_connections 2024-08-20T05:07:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.866+0000 7f7f53c80740 1 --2- 172.21.15.37:0/1457377877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b55b60 0x55f353b59f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.866+0000 7f7f53c80740 1 --2- 172.21.15.37:0/1457377877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b53120 0x55f353b56480 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.866+0000 7f7f53c80740 1 --2- 172.21.15.37:0/1457377877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 0x55f353b55f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.866+0000 7f7f53c80740 1 -- 172.21.15.37:0/1457377877 >> 172.21.15.37:0/1457377877 conn(0x55f353b4b940 msgr2=0x55f353b590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.866+0000 7f7f53c80740 1 -- 172.21.15.37:0/1457377877 shutdown_connections 2024-08-20T05:07:51.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.866+0000 7f7f53c80740 1 -- 172.21.15.37:0/1457377877 wait complete. 2024-08-20T05:07:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.867+0000 7f7f53c80740 1 -- start start 2024-08-20T05:07:51.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.867+0000 7f7f53c80740 1 Processor -- start 2024-08-20T05:07:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.868+0000 7f7f53c80740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 0x55f353b5ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.868+0000 7f7f53c80740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b53120 0x55f353b5f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.868+0000 7f7f53c80740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b55b60 0x55f353b5fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.868+0000 7f7f53c80740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c1bb430 con 0x55f353b55b60 2024-08-20T05:07:51.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.868+0000 7f7f53c80740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c1bad60 con 0x55f353b53120 2024-08-20T05:07:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.868+0000 7f7f53c80740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c1b7fa0 con 0x55f353b507f0 2024-08-20T05:07:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.868+0000 7f7f53c80740 10 client.0 _ll_register_callbacks cb 0x7f7f3c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.869+0000 7f7f49e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 0x55f353b5ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.869+0000 7f7f49400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b53120 0x55f353b5f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.869+0000 7f7f49e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 0x55f353b5ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35368/0 (socket says 172.21.15.37:35368) 2024-08-20T05:07:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.869+0000 7f7f49400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b53120 0x55f353b5f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:54350/0 (socket says 172.21.15.37:54350) 2024-08-20T05:07:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.869+0000 7f7f49e00640 1 -- 172.21.15.37:0/1191624050 learned_addr learned my addr 172.21.15.37:0/1191624050 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.870+0000 7f7f4a800640 1 --2- 172.21.15.37:0/1191624050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b55b60 0x55f353b5fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.870+0000 7f7f49400640 1 -- 172.21.15.37:0/1191624050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 msgr2=0x55f353b5ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.870+0000 7f7f49400640 1 --2- 172.21.15.37:0/1191624050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 0x55f353b5ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.870+0000 7f7f49400640 1 -- 172.21.15.37:0/1191624050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b55b60 msgr2=0x55f353b5fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.870+0000 7f7f49400640 1 --2- 172.21.15.37:0/1191624050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b55b60 0x55f353b5fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.870+0000 7f7f49400640 1 -- 172.21.15.37:0/1191624050 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f353b606f0 con 0x55f353b53120 2024-08-20T05:07:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.870+0000 7f7f4a800640 1 --2- 172.21.15.37:0/1191624050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b55b60 0x55f353b5fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:07:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.871+0000 7f7f49400640 1 --2- 172.21.15.37:0/1191624050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b53120 0x55f353b5f2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009580 tx=0x7f7f380098a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4467f324f77a07d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.871+0000 7f7f2be00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:07:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.871+0000 7f7f2be00640 1 -- 172.21.15.37:0/1191624050 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f38040060 con 0x55f353b53120 2024-08-20T05:07:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.871+0000 7f7f2be00640 1 -- 172.21.15.37:0/1191624050 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7f380053f0 con 0x55f353b53120 2024-08-20T05:07:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.872+0000 7f7f53c80740 1 -- 172.21.15.37:0/1191624050 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f380047a0 con 0x55f353b53120 2024-08-20T05:07:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.872+0000 7f7f2be00640 1 -- 172.21.15.37:0/1191624050 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f7f38047050 con 0x55f353b53120 2024-08-20T05:07:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.872+0000 7f7f53c80740 10 client.26915 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.872+0000 7f7f53c80740 1 -- 172.21.15.37:0/1191624050 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f353b61a60 con 0x55f353b53120 2024-08-20T05:07:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.872+0000 7f7f2be00640 1 -- 172.21.15.37:0/1191624050 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f380047a0 con 0x55f353b53120 2024-08-20T05:07:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.873+0000 7f7f2be00640 1 -- 172.21.15.37:0/1191624050 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f7f38018430 con 0x55f353b53120 2024-08-20T05:07:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.873+0000 7f7f53c80740 10 client.26915 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.873+0000 7f7f53c80740 10 client.26915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:07:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.873+0000 7f7f53c80740 20 client.26915 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.873+0000 7f7f53c80740 1 --2- 172.21.15.37:0/1191624050 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f353be14d0 0x55f353be38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.873+0000 7f7f53c80740 4 client.26915 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:07:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.873+0000 7f7f53c80740 1 -- 172.21.15.37:0/1191624050 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f353ac0c00 con 0x55f353be14d0 2024-08-20T05:07:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.874+0000 7f7f49e00640 1 --2- 172.21.15.37:0/1191624050 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f353be14d0 0x55f353be38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.875+0000 7f7f49e00640 1 --2- 172.21.15.37:0/1191624050 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f353be14d0 0x55f353be38c0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56cc87efc0b07b02 server_cookie=471e39908632e4d1 in_seq=0 out_seq=0 2024-08-20T05:07:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:51.875+0000 7f7f2be00640 10 client.26915 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:51.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:51 smithi130 ceph-mon[22007]: pgmap v569: 129 pgs: 129 active+clean; 1.1 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 MiB/s wr, 688 op/s 2024-08-20T05:07:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.009+0000 7f7f2be00640 1 -- 172.21.15.37:0/1191624050 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f353ac0c00 con 0x55f353be14d0 2024-08-20T05:07:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.009+0000 7f7f2be00640 10 client.26915 handle_command_reply: tid=0 2024-08-20T05:07:52.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.009+0000 7f7f53c80740 1 client.26915 shutdown 2024-08-20T05:07:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.010+0000 7f7f53c80740 1 -- 172.21.15.37:0/1191624050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b53120 msgr2=0x55f353b5f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.010+0000 7f7f53c80740 1 --2- 172.21.15.37:0/1191624050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b53120 0x55f353b5f2f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7f38009580 tx=0x7f7f380098a0 comp rx=0 tx=0).stop 2024-08-20T05:07:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.010+0000 7f7f53c80740 1 -- 172.21.15.37:0/1191624050 shutdown_connections 2024-08-20T05:07:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.010+0000 7f7f53c80740 1 --2- 172.21.15.37:0/1191624050 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f353be14d0 0x55f353be38c0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:52.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.010+0000 7f7f2be00640 0 client.26915 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.010+0000 7f7f53c80740 1 --2- 172.21.15.37:0/1191624050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f353b55b60 0x55f353b5fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.010+0000 7f7f53c80740 1 --2- 172.21.15.37:0/1191624050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f353b53120 0x55f353b5f2f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.010+0000 7f7f53c80740 1 --2- 172.21.15.37:0/1191624050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f353b507f0 0x55f353b5ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.010+0000 7f7f53c80740 1 -- 172.21.15.37:0/1191624050 >> 172.21.15.37:0/1191624050 conn(0x55f353b4b940 msgr2=0x55f353b4c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.011+0000 7f7f53c80740 1 -- 172.21.15.37:0/1191624050 shutdown_connections 2024-08-20T05:07:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.011+0000 7f7f53c80740 1 -- 172.21.15.37:0/1191624050 wait complete. 2024-08-20T05:07:52.013 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.011+0000 7f7f53c80740 20 client.26915 trim_cache size 0 max 16384 2024-08-20T05:07:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:07:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:07:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:07:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:07:52.014 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.012+0000 7f7f4b200640 1 -- 172.21.15.37:0/2476867059 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f300b3b80 msgr2=0x7f7f300b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.012+0000 7f7f4b200640 1 --2- 172.21.15.37:0/2476867059 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f300b3b80 0x7f7f300b6040 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7f44006010 tx=0x7f7f440308d0 comp rx=0 tx=0).stop 2024-08-20T05:07:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.012+0000 7f7f4b200640 1 -- 172.21.15.37:0/2476867059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f4c06b170 msgr2=0x7f7f4c112b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.012+0000 7f7f4b200640 1 --2- 172.21.15.37:0/2476867059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f4c06b170 0x7f7f4c112b30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c00e9c0 tx=0x7f7f3c00ee80 comp rx=0 tx=0).stop 2024-08-20T05:07:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.012+0000 7f7f4b200640 1 -- 172.21.15.37:0/2476867059 shutdown_connections 2024-08-20T05:07:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.012+0000 7f7f4b200640 1 --2- 172.21.15.37:0/2476867059 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f300b3b80 0x7f7f300b6040 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.012+0000 7f7f4b200640 1 --2- 172.21.15.37:0/2476867059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f4c1081a0 0x7f7f4c111650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.012+0000 7f7f4b200640 1 --2- 172.21.15.37:0/2476867059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f4c1055f0 0x7f7f4c113140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.012+0000 7f7f4b200640 1 --2- 172.21.15.37:0/2476867059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f4c06b170 0x7f7f4c112b30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.012+0000 7f7f4b200640 1 -- 172.21.15.37:0/2476867059 >> 172.21.15.37:0/2476867059 conn(0x7f7f4c0fcc50 msgr2=0x7f7f4c1038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.013+0000 7f7f4b200640 1 -- 172.21.15.37:0/2476867059 shutdown_connections 2024-08-20T05:07:52.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:07:52.013+0000 7f7f4b200640 1 -- 172.21.15.37:0/2476867059 wait complete. 2024-08-20T05:07:52.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:52.285+0000 7fa278a00640 1 -- 172.21.15.37:0/2837678230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa27410b650 con 0x7fa27410f0c0 2024-08-20T05:07:52.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:52.287+0000 7fa26aa00640 1 -- 172.21.15.37:0/2837678230 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11980 (secure 0 0 0) 0x7fa26c0abfa0 con 0x7fa27410f0c0 2024-08-20T05:07:52.290 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:07:52.291 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 36 2024-08-20T05:07:52.291 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"btime":"2024-08-20T05:06:06:678364+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:06:06.276613+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:07:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:52.291+0000 7fa278a00640 1 -- 172.21.15.37:0/2837678230 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2580b3de0 msgr2=0x7fa2580b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:52.291+0000 7fa278a00640 1 --2- 172.21.15.37:0/2837678230 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2580b3de0 0x7fa2580b62a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa25c006010 tx=0x7fa25c009540 comp rx=0 tx=0).stop 2024-08-20T05:07:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:52.291+0000 7fa278a00640 1 -- 172.21.15.37:0/2837678230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa27410f0c0 msgr2=0x7fa274105840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:52.291+0000 7fa278a00640 1 --2- 172.21.15.37:0/2837678230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa27410f0c0 0x7fa274105840 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa27406bdb0 tx=0x7fa26c00edd0 comp rx=0 tx=0).stop 2024-08-20T05:07:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:52.291+0000 7fa278a00640 1 -- 172.21.15.37:0/2837678230 shutdown_connections 2024-08-20T05:07:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:52.291+0000 7fa278a00640 1 --2- 172.21.15.37:0/2837678230 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2580b3de0 0x7fa2580b62a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:52.291+0000 7fa278a00640 1 --2- 172.21.15.37:0/2837678230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa27410f0c0 0x7fa274105840 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:52.291+0000 7fa278a00640 1 --2- 172.21.15.37:0/2837678230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa274075b10 0x7fa27410e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:52.291+0000 7fa278a00640 1 --2- 172.21.15.37:0/2837678230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2740751f0 0x7fa27410e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:52.291+0000 7fa278a00640 1 -- 172.21.15.37:0/2837678230 >> 172.21.15.37:0/2837678230 conn(0x7fa2740fe500 msgr2=0x7fa2740ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:52.292+0000 7fa278a00640 1 -- 172.21.15.37:0/2837678230 shutdown_connections 2024-08-20T05:07:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:52.292+0000 7fa278a00640 1 -- 172.21.15.37:0/2837678230 wait complete. 2024-08-20T05:07:52.566 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:52 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2837678230' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:07:52.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:52 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2837678230' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:07:52.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:52 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2837678230' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:07:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 295.0 s, 567.4 tps, lat 171.657 ms stddev 207.506 2024-08-20T05:07:53.368 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-08-20T05:07:53.369 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-08-20T05:07:53.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:53 smithi135 ceph-mon[22342]: pgmap v570: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.0 MiB/s wr, 638 op/s 2024-08-20T05:07:53.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:53 smithi130 ceph-mon[22007]: pgmap v570: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.0 MiB/s wr, 638 op/s 2024-08-20T05:07:54.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:53 smithi037 ceph-mon[17265]: pgmap v570: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.0 MiB/s wr, 638 op/s 2024-08-20T05:07:54.166 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:07:55.763 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:55 smithi037 ceph-mon[17265]: pgmap v571: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.9 MiB/s wr, 580 op/s 2024-08-20T05:07:55.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:55 smithi135 ceph-mon[22342]: pgmap v571: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.9 MiB/s wr, 580 op/s 2024-08-20T05:07:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:55 smithi130 ceph-mon[22007]: pgmap v571: 129 pgs: 129 active+clean; 1.1 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.9 MiB/s wr, 580 op/s 2024-08-20T05:07:55.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.994+0000 7f8b7ac00640 1 -- 172.21.15.37:0/3774591891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b74101400 msgr2=0x7f8b741017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.994+0000 7f8b7ac00640 1 --2- 172.21.15.37:0/3774591891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b74101400 0x7f8b741017e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009900 tx=0x7f8b6802a490 comp rx=0 tx=0).stop 2024-08-20T05:07:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.995+0000 7f8b7ac00640 1 -- 172.21.15.37:0/3774591891 shutdown_connections 2024-08-20T05:07:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.995+0000 7f8b7ac00640 1 --2- 172.21.15.37:0/3774591891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b7410efb0 0x7f8b741113a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.995+0000 7f8b7ac00640 1 --2- 172.21.15.37:0/3774591891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b74101d20 0x7f8b7410ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.995+0000 7f8b7ac00640 1 --2- 172.21.15.37:0/3774591891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b74101400 0x7f8b741017e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.995+0000 7f8b7ac00640 1 -- 172.21.15.37:0/3774591891 >> 172.21.15.37:0/3774591891 conn(0x7f8b740fd2d0 msgr2=0x7f8b740ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.996+0000 7f8b7ac00640 1 -- 172.21.15.37:0/3774591891 shutdown_connections 2024-08-20T05:07:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.996+0000 7f8b7ac00640 1 -- 172.21.15.37:0/3774591891 wait complete. 2024-08-20T05:07:56.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.997+0000 7f8b7ac00640 1 Processor -- start 2024-08-20T05:07:56.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.998+0000 7f8b7ac00640 1 -- start start 2024-08-20T05:07:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.999+0000 7f8b7ac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b74101400 0x7f8b74104860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.999+0000 7f8b7ac00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b74101d20 0x7f8b74104da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.999+0000 7f8b7ac00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b7410efb0 0x7f8b741069e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.999+0000 7f8b7ac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b74103ed0 con 0x7f8b74101400 2024-08-20T05:07:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.999+0000 7f8b7ac00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8b74103d50 con 0x7f8b74101d20 2024-08-20T05:07:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.999+0000 7f8b7ac00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8b74104050 con 0x7f8b7410efb0 2024-08-20T05:07:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.999+0000 7f8b78e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b74101d20 0x7f8b74104da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.999+0000 7f8b7a200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b7410efb0 0x7f8b741069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.999+0000 7f8b7a200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b7410efb0 0x7f8b741069e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:55842/0 (socket says 172.21.15.37:55842) 2024-08-20T05:07:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.999+0000 7f8b7a200640 1 -- 172.21.15.37:0/3622802286 learned_addr learned my addr 172.21.15.37:0/3622802286 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:55.999+0000 7f8b79800640 1 --2- 172.21.15.37:0/3622802286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b74101400 0x7f8b74104860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.000+0000 7f8b7a200640 1 -- 172.21.15.37:0/3622802286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b74101d20 msgr2=0x7f8b74104da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:56.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.000+0000 7f8b7a200640 1 --2- 172.21.15.37:0/3622802286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b74101d20 0x7f8b74104da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.000+0000 7f8b7a200640 1 -- 172.21.15.37:0/3622802286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b74101400 msgr2=0x7f8b74104860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.000+0000 7f8b7a200640 1 --2- 172.21.15.37:0/3622802286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b74101400 0x7f8b74104860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.000+0000 7f8b7a200640 1 -- 172.21.15.37:0/3622802286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b74106fa0 con 0x7f8b7410efb0 2024-08-20T05:07:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.001+0000 7f8b7a200640 1 --2- 172.21.15.37:0/3622802286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b7410efb0 0x7f8b741069e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c009c90 tx=0x7f8b6c00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.001+0000 7f8b72000640 1 -- 172.21.15.37:0/3622802286 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c010630 con 0x7f8b7410efb0 2024-08-20T05:07:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.001+0000 7f8b72000640 1 -- 172.21.15.37:0/3622802286 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b6c010c80 con 0x7f8b7410efb0 2024-08-20T05:07:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.001+0000 7f8b72000640 1 -- 172.21.15.37:0/3622802286 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6c017c10 con 0x7f8b7410efb0 2024-08-20T05:07:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.001+0000 7f8b7ac00640 1 -- 172.21.15.37:0/3622802286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b74107290 con 0x7f8b7410efb0 2024-08-20T05:07:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.001+0000 7f8b7ac00640 1 -- 172.21.15.37:0/3622802286 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b74107780 con 0x7f8b7410efb0 2024-08-20T05:07:56.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.006+0000 7f8b7edc5740 1 Processor -- start 2024-08-20T05:07:56.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.007+0000 7f8b72000640 1 -- 172.21.15.37:0/3622802286 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8b6c0107d0 con 0x7f8b7410efb0 2024-08-20T05:07:56.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.007+0000 7f8b7edc5740 1 -- start start 2024-08-20T05:07:56.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.008+0000 7f8b7edc5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.008+0000 7f8b7edc5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60d5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.009+0000 7f8b78e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:56.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.009+0000 7f8b7edc5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 0x5569c60d8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.009+0000 7f8b7edc5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5569c6069670 con 0x5569c60d5e80 2024-08-20T05:07:56.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.009+0000 7f8b7edc5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5569c603d7c0 con 0x5569c60c95d0 2024-08-20T05:07:56.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.009+0000 7f8b7edc5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5569c602ccc0 con 0x5569c60c9ef0 2024-08-20T05:07:56.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.009+0000 7f8b78e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42228/0 (socket says 172.21.15.37:42228) 2024-08-20T05:07:56.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.009+0000 7f8b78e00640 1 -- 172.21.15.37:0/288106082 learned_addr learned my addr 172.21.15.37:0/288106082 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:56.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.009+0000 7f8b79800640 1 --2- 172.21.15.37:0/288106082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60d5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:56.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.010+0000 7f8b72000640 1 --2- 172.21.15.37:0/3622802286 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8b5c0b3e40 0x7f8b5c0b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.010+0000 7f8b72000640 1 -- 172.21.15.37:0/3622802286 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8b6c0e4790 con 0x7f8b7410efb0 2024-08-20T05:07:56.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.010+0000 7f8b78e00640 1 --2- 172.21.15.37:0/288106082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 0x5569c60d8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:56.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.010+0000 7f8b79800640 1 -- 172.21.15.37:0/288106082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 msgr2=0x5569c60c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:56.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.010+0000 7f8b79800640 1 --2- 172.21.15.37:0/288106082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.010+0000 7f8b79800640 1 -- 172.21.15.37:0/288106082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 msgr2=0x5569c60d8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:56.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.010+0000 7f8b79800640 1 --2- 172.21.15.37:0/288106082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 0x5569c60d8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.010+0000 7f8b79800640 1 -- 172.21.15.37:0/288106082 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569c5fc0110 con 0x5569c60c9ef0 2024-08-20T05:07:56.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.010+0000 7f8b78e00640 1 --2- 172.21.15.37:0/288106082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:07:56.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.012+0000 7f8b79800640 1 --2- 172.21.15.37:0/288106082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60d5940 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8b6802aa80 tx=0x7f8b68004180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e27227e1df8cfc7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:56.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.012+0000 7f8b7a200640 1 --2- 172.21.15.37:0/3622802286 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8b5c0b3e40 0x7f8b5c0b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:56.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.012+0000 7f8b66a00640 1 -- 172.21.15.37:0/288106082 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68035040 con 0x5569c60c9ef0 2024-08-20T05:07:56.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.013+0000 7f8b66a00640 1 -- 172.21.15.37:0/288106082 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b680054f0 con 0x5569c60c9ef0 2024-08-20T05:07:56.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.013+0000 7f8b66a00640 1 -- 172.21.15.37:0/288106082 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68035040 con 0x5569c60c9ef0 2024-08-20T05:07:56.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.014+0000 7f8b7a200640 1 --2- 172.21.15.37:0/3622802286 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8b5c0b3e40 0x7f8b5c0b6300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00cba0 tx=0x7f8b6c0176b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:56.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.014+0000 7f8b7edc5740 1 -- 172.21.15.37:0/288106082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 msgr2=0x5569c60d5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:56.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.014+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/288106082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60d5940 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8b6802aa80 tx=0x7f8b68004180 comp rx=0 tx=0).stop 2024-08-20T05:07:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.014+0000 7f8b7edc5740 1 -- 172.21.15.37:0/288106082 shutdown_connections 2024-08-20T05:07:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.014+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/288106082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 0x5569c60d8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.014+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/288106082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60d5940 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.014+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/288106082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.015+0000 7f8b7edc5740 1 -- 172.21.15.37:0/288106082 >> 172.21.15.37:0/288106082 conn(0x5569c60c7400 msgr2=0x5569c60c85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.015+0000 7f8b7edc5740 1 -- 172.21.15.37:0/288106082 shutdown_connections 2024-08-20T05:07:56.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.016+0000 7f8b7edc5740 1 -- 172.21.15.37:0/288106082 wait complete. 2024-08-20T05:07:56.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.017+0000 7f8b7edc5740 1 -- start start 2024-08-20T05:07:56.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.017+0000 7f8b7edc5740 1 Processor -- start 2024-08-20T05:07:56.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.018+0000 7f8b7edc5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60d2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.018+0000 7f8b7edc5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60d3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.018+0000 7f8b7edc5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 0x5569c60d38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.018+0000 7f8b7edc5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5569c5fd2780 con 0x5569c60d5e80 2024-08-20T05:07:56.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.018+0000 7f8b7edc5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5569c6030d00 con 0x5569c60c95d0 2024-08-20T05:07:56.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.018+0000 7f8b7edc5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5569c5e8f7a0 con 0x5569c60c9ef0 2024-08-20T05:07:56.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.018+0000 7f8b7edc5740 10 client.0 _ll_register_callbacks cb 0x5569c5fda940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:56.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.019+0000 7f8b78e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60d2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.019+0000 7f8b78e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60d2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42240/0 (socket says 172.21.15.37:42240) 2024-08-20T05:07:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.019+0000 7f8b78e00640 1 -- 172.21.15.37:0/2841656493 learned_addr learned my addr 172.21.15.37:0/2841656493 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.019+0000 7f8b79800640 1 --2- 172.21.15.37:0/2841656493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60d3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.019+0000 7f8b78e00640 1 -- 172.21.15.37:0/2841656493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 msgr2=0x5569c60d3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.019+0000 7f8b78e00640 1 --2- 172.21.15.37:0/2841656493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60d3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.019+0000 7f8b78e00640 1 -- 172.21.15.37:0/2841656493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 msgr2=0x5569c60d38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.019+0000 7f8b78e00640 1 --2- 172.21.15.37:0/2841656493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 0x5569c60d38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.019+0000 7f8b78e00640 1 -- 172.21.15.37:0/2841656493 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569c5fdf9c0 con 0x5569c60c95d0 2024-08-20T05:07:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.020+0000 7f8b78e00640 1 --2- 172.21.15.37:0/2841656493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60d2e50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8b60012c60 tx=0x7f8b60011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67b9e079199a809e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.020+0000 7f8b5b400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:07:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.020+0000 7f8b5b400640 1 -- 172.21.15.37:0/2841656493 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b60019070 con 0x5569c60c95d0 2024-08-20T05:07:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.020+0000 7f8b5b400640 1 -- 172.21.15.37:0/2841656493 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8b6001e460 con 0x5569c60c95d0 2024-08-20T05:07:56.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.021+0000 7f8b7edc5740 1 -- 172.21.15.37:0/2841656493 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b680054f0 con 0x5569c60c95d0 2024-08-20T05:07:56.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.021+0000 7f8b5b400640 1 -- 172.21.15.37:0/2841656493 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8b6001e6a0 con 0x5569c60c95d0 2024-08-20T05:07:56.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.021+0000 7f8b7edc5740 10 client.26924 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:56.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.021+0000 7f8b7edc5740 1 -- 172.21.15.37:0/2841656493 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5569c5d9bb90 con 0x5569c60c95d0 2024-08-20T05:07:56.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.022+0000 7f8b5b400640 1 -- 172.21.15.37:0/2841656493 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b680054f0 con 0x5569c60c95d0 2024-08-20T05:07:56.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.022+0000 7f8b5b400640 1 -- 172.21.15.37:0/2841656493 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f8b60028620 con 0x5569c60c95d0 2024-08-20T05:07:56.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.022+0000 7f8b7edc5740 10 client.26924 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:56.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.022+0000 7f8b7edc5740 10 client.26924 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:07:56.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.023+0000 7f8b7edc5740 20 client.26924 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:56.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.023+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/2841656493 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5569c60e58d0 0x5569c60e7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.023+0000 7f8b7edc5740 4 client.26924 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:07:56.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.023+0000 7f8b7edc5740 1 -- 172.21.15.37:0/2841656493 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569c603f710 con 0x5569c60e58d0 2024-08-20T05:07:56.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.023+0000 7f8b79800640 1 --2- 172.21.15.37:0/2841656493 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5569c60e58d0 0x5569c60e7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.027+0000 7f8b79800640 1 --2- 172.21.15.37:0/2841656493 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5569c60e58d0 0x5569c60e7cc0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa62f243e2958f9f server_cookie=a4c3739724a864d8 in_seq=0 out_seq=0 2024-08-20T05:07:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.027+0000 7f8b5b400640 10 client.26924 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:56.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.028+0000 7f8b5b400640 1 -- 172.21.15.37:0/2841656493 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5569c603f710 con 0x5569c60e58d0 2024-08-20T05:07:56.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.028+0000 7f8b5b400640 10 client.26924 handle_command_reply: tid=0 2024-08-20T05:07:56.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.028+0000 7f8b7edc5740 1 client.26924 shutdown 2024-08-20T05:07:56.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.031+0000 7f8b7edc5740 1 -- 172.21.15.37:0/2841656493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 msgr2=0x5569c60d2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:56.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.031+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/2841656493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60d2e50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8b60012c60 tx=0x7f8b60011810 comp rx=0 tx=0).stop 2024-08-20T05:07:56.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.031+0000 7f8b7edc5740 1 -- 172.21.15.37:0/2841656493 shutdown_connections 2024-08-20T05:07:56.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.031+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/2841656493 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5569c60e58d0 0x5569c60e7cc0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.032+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/2841656493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 0x5569c60d38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.032+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/2841656493 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60d3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.032+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/2841656493 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60d2e50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.032+0000 7f8b7edc5740 1 -- 172.21.15.37:0/2841656493 >> 172.21.15.37:0/2841656493 conn(0x5569c60c7400 msgr2=0x5569c60ccfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:56.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.032+0000 7f8b5b400640 0 client.26924 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:56.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.032+0000 7f8b7edc5740 1 -- 172.21.15.37:0/2841656493 shutdown_connections 2024-08-20T05:07:56.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.032+0000 7f8b7edc5740 1 -- 172.21.15.37:0/2841656493 wait complete. 2024-08-20T05:07:56.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.032+0000 7f8b7edc5740 20 client.26924 trim_cache size 0 max 16384 2024-08-20T05:07:56.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.069+0000 7f8b7edc5740 1 Processor -- start 2024-08-20T05:07:56.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.069+0000 7f8b7edc5740 1 -- start start 2024-08-20T05:07:56.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.069+0000 7f8b7edc5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60cd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.069+0000 7f8b7edc5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60d3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.069+0000 7f8b7edc5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 0x5569c60ed570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.069+0000 7f8b7edc5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b741be360 con 0x5569c60d5e80 2024-08-20T05:07:56.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.069+0000 7f8b7edc5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8b741bfea0 con 0x5569c60c95d0 2024-08-20T05:07:56.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.069+0000 7f8b7edc5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8b741bea30 con 0x5569c60c9ef0 2024-08-20T05:07:56.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.070+0000 7f8b79800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60d3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:56.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.070+0000 7f8b79800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60d3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:55880/0 (socket says 172.21.15.37:55880) 2024-08-20T05:07:56.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.070+0000 7f8b79800640 1 -- 172.21.15.37:0/917493602 learned_addr learned my addr 172.21.15.37:0/917493602 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:56.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.070+0000 7f8b78e00640 1 --2- 172.21.15.37:0/917493602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:56.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.071+0000 7f8b79800640 1 -- 172.21.15.37:0/917493602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 msgr2=0x5569c60cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:56.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.071+0000 7f8b79800640 1 --2- 172.21.15.37:0/917493602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60cd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.071+0000 7f8b79800640 1 -- 172.21.15.37:0/917493602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 msgr2=0x5569c60ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:56.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.071+0000 7f8b79800640 1 --2- 172.21.15.37:0/917493602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 0x5569c60ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.071+0000 7f8b79800640 1 -- 172.21.15.37:0/917493602 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569c60c7230 con 0x5569c60c9ef0 2024-08-20T05:07:56.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.073+0000 7f8b79800640 1 --2- 172.21.15.37:0/917493602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60d3530 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009900 tx=0x7f8b68004cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=929d5d19682357ce server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:56.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.073+0000 7f8b66000640 1 -- 172.21.15.37:0/917493602 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b68035040 con 0x5569c60c9ef0 2024-08-20T05:07:56.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.074+0000 7f8b66000640 1 -- 172.21.15.37:0/917493602 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b68053070 con 0x5569c60c9ef0 2024-08-20T05:07:56.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.074+0000 7f8b66000640 1 -- 172.21.15.37:0/917493602 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b680035f0 con 0x5569c60c9ef0 2024-08-20T05:07:56.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.075+0000 7f8b7edc5740 1 -- 172.21.15.37:0/917493602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 msgr2=0x5569c60d3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:56.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.075+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/917493602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60d3530 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8b68009900 tx=0x7f8b68004cb0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.082+0000 7f8b7edc5740 1 -- 172.21.15.37:0/917493602 shutdown_connections 2024-08-20T05:07:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.082+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/917493602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 0x5569c60ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.082+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/917493602 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60d3530 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.082+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/917493602 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.082+0000 7f8b7edc5740 1 -- 172.21.15.37:0/917493602 >> 172.21.15.37:0/917493602 conn(0x5569c60c7400 msgr2=0x5569c60d2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:56.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.089+0000 7f8b7edc5740 1 -- 172.21.15.37:0/917493602 shutdown_connections 2024-08-20T05:07:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.089+0000 7f8b7edc5740 1 -- 172.21.15.37:0/917493602 wait complete. 2024-08-20T05:07:56.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.089+0000 7f8b7edc5740 1 -- start start 2024-08-20T05:07:56.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.090+0000 7f8b7edc5740 1 Processor -- start 2024-08-20T05:07:56.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.092+0000 7f8b7edc5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60d9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.092+0000 7f8b7edc5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60da100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.092+0000 7f8b7edc5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 0x5569c60da640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.092+0000 7f8b7edc5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b741bf7d0 con 0x5569c60d5e80 2024-08-20T05:07:56.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.092+0000 7f8b7edc5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8b741bf100 con 0x5569c60c95d0 2024-08-20T05:07:56.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.092+0000 7f8b7edc5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8b741bc300 con 0x5569c60c9ef0 2024-08-20T05:07:56.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.092+0000 7f8b7edc5740 10 client.0 _ll_register_callbacks cb 0x7f8b600128a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:07:56.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.093+0000 7f8b78e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 0x5569c60da640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:56.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.094+0000 7f8b79800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60da100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:56.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.094+0000 7f8b78e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 0x5569c60da640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54416/0 (socket says 172.21.15.37:54416) 2024-08-20T05:07:56.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.094+0000 7f8b78e00640 1 -- 172.21.15.37:0/466991049 learned_addr learned my addr 172.21.15.37:0/466991049 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:07:56.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.097+0000 7f8b78e00640 1 -- 172.21.15.37:0/466991049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 msgr2=0x5569c60da100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:56.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.097+0000 7f8b78e00640 1 --2- 172.21.15.37:0/466991049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60da100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.097+0000 7f8b78e00640 1 -- 172.21.15.37:0/466991049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 msgr2=0x5569c60d9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:07:56.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.097+0000 7f8b78e00640 1 --2- 172.21.15.37:0/466991049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60d9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.097+0000 7f8b78e00640 1 -- 172.21.15.37:0/466991049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569c60c8ae0 con 0x5569c60d5e80 2024-08-20T05:07:56.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.098+0000 7f8b79800640 1 --2- 172.21.15.37:0/466991049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60da100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:07:56.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.100+0000 7f8b78e00640 1 --2- 172.21.15.37:0/466991049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 0x5569c60da640 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8b60028fd0 tx=0x7f8b6000a4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8ce0d1ebc4d3b1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:07:56.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.100+0000 7f8b5b400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:07:56.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.102+0000 7f8b5b400640 1 -- 172.21.15.37:0/466991049 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b6001e6a0 con 0x5569c60d5e80 2024-08-20T05:07:56.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.102+0000 7f8b5b400640 1 -- 172.21.15.37:0/466991049 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8b6000a7f0 con 0x5569c60d5e80 2024-08-20T05:07:56.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.102+0000 7f8b7edc5740 1 -- 172.21.15.37:0/466991049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b68053070 con 0x5569c60d5e80 2024-08-20T05:07:56.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.103+0000 7f8b5b400640 1 -- 172.21.15.37:0/466991049 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8b6003e050 con 0x5569c60d5e80 2024-08-20T05:07:56.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.103+0000 7f8b7edc5740 10 client.16623 fetch_fsmap learned FSMap version 36 2024-08-20T05:07:56.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.103+0000 7f8b7edc5740 1 -- 172.21.15.37:0/466991049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5569c60c7e80 con 0x5569c60d5e80 2024-08-20T05:07:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.104+0000 7f8b5b400640 1 -- 172.21.15.37:0/466991049 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b68053070 con 0x5569c60d5e80 2024-08-20T05:07:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.106+0000 7f8b5b400640 1 -- 172.21.15.37:0/466991049 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f8b60005040 con 0x5569c60d5e80 2024-08-20T05:07:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.106+0000 7f8b7edc5740 10 client.16623 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:07:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.106+0000 7f8b7edc5740 10 client.16623 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:07:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.106+0000 7f8b7edc5740 20 client.16623 populate_metadata read hostname 'smithi037' 2024-08-20T05:07:56.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.106+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/466991049 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5569c6150c60 0x5569c6153080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:07:56.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.106+0000 7f8b7edc5740 4 client.16623 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-08-20T05:07:56.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.106+0000 7f8b7edc5740 1 -- 172.21.15.37:0/466991049 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x5569c603b1b0 con 0x5569c6150c60 2024-08-20T05:07:56.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.106+0000 7f8b79800640 1 --2- 172.21.15.37:0/466991049 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5569c6150c60 0x5569c6153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:07:56.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.107+0000 7f8b79800640 1 --2- 172.21.15.37:0/466991049 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5569c6150c60 0x5569c6153080 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=703b6ff6db7ed34 server_cookie=7ba52701c0b513a7 in_seq=0 out_seq=0 2024-08-20T05:07:56.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.107+0000 7f8b5b400640 10 client.16623 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:56.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.298+0000 7f8b5b400640 1 -- 172.21.15.37:0/466991049 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5569c603b1b0 con 0x5569c6150c60 2024-08-20T05:07:56.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.298+0000 7f8b5b400640 10 client.16623 handle_command_reply: tid=0 2024-08-20T05:07:56.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.298+0000 7f8b7edc5740 1 client.16623 shutdown 2024-08-20T05:07:56.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.298+0000 7f8b7edc5740 1 -- 172.21.15.37:0/466991049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 msgr2=0x5569c60da640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:56.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.298+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/466991049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 0x5569c60da640 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8b60028fd0 tx=0x7f8b6000a4b0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.298+0000 7f8b7edc5740 1 -- 172.21.15.37:0/466991049 shutdown_connections 2024-08-20T05:07:56.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.298+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/466991049 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5569c6150c60 0x5569c6153080 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.298+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/466991049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c60d5e80 0x5569c60da640 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.298+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/466991049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c60c9ef0 0x5569c60da100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.298+0000 7f8b7edc5740 1 --2- 172.21.15.37:0/466991049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c60c95d0 0x5569c60d9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.298+0000 7f8b7edc5740 1 -- 172.21.15.37:0/466991049 >> 172.21.15.37:0/466991049 conn(0x5569c60c7400 msgr2=0x5569c60d3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:56.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.299+0000 7f8b5b400640 0 client.16623 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:07:56.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.299+0000 7f8b7edc5740 1 -- 172.21.15.37:0/466991049 shutdown_connections 2024-08-20T05:07:56.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.299+0000 7f8b7edc5740 1 -- 172.21.15.37:0/466991049 wait complete. 2024-08-20T05:07:56.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.299+0000 7f8b7edc5740 20 client.16623 trim_cache size 0 max 16384 2024-08-20T05:07:56.303 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:07:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 36, 2024-08-20T05:07:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:07:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 26, 2024-08-20T05:07:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:07:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "dc8b695b": { 2024-08-20T05:07:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 26, 2024-08-20T05:07:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:07:56.303 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:07:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:07:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:07:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:07:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:07:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 150.0, 2024-08-20T05:07:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:07:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:07:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:07:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:07:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:07:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:07:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:07:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:07:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:07:56.304 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:07:56.305 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:07:56.305 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:07:56.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.301+0000 7f8b7ac00640 1 -- 172.21.15.37:0/3622802286 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8b5c0b3e40 msgr2=0x7f8b5c0b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:56.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.301+0000 7f8b7ac00640 1 --2- 172.21.15.37:0/3622802286 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8b5c0b3e40 0x7f8b5c0b6300 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c00cba0 tx=0x7f8b6c0176b0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.301+0000 7f8b7ac00640 1 -- 172.21.15.37:0/3622802286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b7410efb0 msgr2=0x7f8b741069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:07:56.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.301+0000 7f8b7ac00640 1 --2- 172.21.15.37:0/3622802286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b7410efb0 0x7f8b741069e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c009c90 tx=0x7f8b6c00c6a0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.302+0000 7f8b7ac00640 1 -- 172.21.15.37:0/3622802286 shutdown_connections 2024-08-20T05:07:56.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.302+0000 7f8b7ac00640 1 --2- 172.21.15.37:0/3622802286 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8b5c0b3e40 0x7f8b5c0b6300 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.302+0000 7f8b7ac00640 1 --2- 172.21.15.37:0/3622802286 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b7410efb0 0x7f8b741069e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.302+0000 7f8b7ac00640 1 --2- 172.21.15.37:0/3622802286 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b74101d20 0x7f8b74104da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.302+0000 7f8b7ac00640 1 --2- 172.21.15.37:0/3622802286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b74101400 0x7f8b74104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:07:56.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.302+0000 7f8b7ac00640 1 -- 172.21.15.37:0/3622802286 >> 172.21.15.37:0/3622802286 conn(0x7f8b740fd2d0 msgr2=0x7f8b7410fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:07:56.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.302+0000 7f8b7ac00640 1 -- 172.21.15.37:0/3622802286 shutdown_connections 2024-08-20T05:07:56.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:07:56.302+0000 7f8b7ac00640 1 -- 172.21.15.37:0/3622802286 wait complete. 2024-08-20T05:07:57.635 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'dc8b695b', quiesce took 9.4 seconds. Will release after: 20.6 2024-08-20T05:07:57.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:57 smithi135 ceph-mon[22342]: pgmap v572: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 663 op/s 2024-08-20T05:07:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:57 smithi130 ceph-mon[22007]: pgmap v572: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 663 op/s 2024-08-20T05:07:58.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:57 smithi037 ceph-mon[17265]: pgmap v572: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 663 op/s 2024-08-20T05:07:58.043 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 300.0 s, 481.2 tps, lat 133.534 ms stddev 157.209 2024-08-20T05:07:59.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:07:59 smithi135 ceph-mon[22342]: pgmap v573: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 569 op/s 2024-08-20T05:07:59.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:07:59 smithi130 ceph-mon[22007]: pgmap v573: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 569 op/s 2024-08-20T05:08:00.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:07:59 smithi037 ceph-mon[17265]: pgmap v573: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 11 MiB/s wr, 569 op/s 2024-08-20T05:08:01.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:01 smithi135 ceph-mon[22342]: pgmap v574: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 589 op/s 2024-08-20T05:08:01.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:01 smithi130 ceph-mon[22007]: pgmap v574: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 589 op/s 2024-08-20T05:08:02.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:01 smithi037 ceph-mon[17265]: pgmap v574: 129 pgs: 129 active+clean; 1.1 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 589 op/s 2024-08-20T05:08:02.216 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:08:02.612 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:08:03.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 305.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:08:03.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.227+0000 7fc82d200640 1 -- 172.21.15.37:0/328990021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc82810a520 msgr2=0x7fc82810a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:03.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.227+0000 7fc82d200640 1 --2- 172.21.15.37:0/328990021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc82810a520 0x7fc82810a960 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc814009900 tx=0x7fc81402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.227+0000 7fc82d200640 1 -- 172.21.15.37:0/328990021 shutdown_connections 2024-08-20T05:08:03.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.227+0000 7fc82d200640 1 --2- 172.21.15.37:0/328990021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc82810aea0 0x7fc8281116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.227+0000 7fc82d200640 1 --2- 172.21.15.37:0/328990021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc82810a520 0x7fc82810a960 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.227+0000 7fc82d200640 1 --2- 172.21.15.37:0/328990021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc828104b10 0x7fc828104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.227+0000 7fc82d200640 1 -- 172.21.15.37:0/328990021 >> 172.21.15.37:0/328990021 conn(0x7fc828100540 msgr2=0x7fc828102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:03.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.227+0000 7fc82d200640 1 -- 172.21.15.37:0/328990021 shutdown_connections 2024-08-20T05:08:03.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.227+0000 7fc82d200640 1 -- 172.21.15.37:0/328990021 wait complete. 2024-08-20T05:08:03.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.228+0000 7fc82d200640 1 Processor -- start 2024-08-20T05:08:03.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.228+0000 7fc82d200640 1 -- start start 2024-08-20T05:08:03.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.228+0000 7fc82d200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc828104b10 0x7fc82819afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.228+0000 7fc82d200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc82810a520 0x7fc82819b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.228+0000 7fc82d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc82810aea0 0x7fc8281a0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.228+0000 7fc82d200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc828114af0 con 0x7fc82810aea0 2024-08-20T05:08:03.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.228+0000 7fc82d200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc828114970 con 0x7fc82810a520 2024-08-20T05:08:03.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.228+0000 7fc82d200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc828114c70 con 0x7fc828104b10 2024-08-20T05:08:03.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.229+0000 7fc827e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc82810aea0 0x7fc8281a0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.229+0000 7fc827e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc82810aea0 0x7fc8281a0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54962/0 (socket says 172.21.15.37:54962) 2024-08-20T05:08:03.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.229+0000 7fc826a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc82810a520 0x7fc82819b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.229+0000 7fc827e00640 1 -- 172.21.15.37:0/2803422026 learned_addr learned my addr 172.21.15.37:0/2803422026 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:03.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.229+0000 7fc827400640 1 --2- 172.21.15.37:0/2803422026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc828104b10 0x7fc82819afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.229+0000 7fc827e00640 1 -- 172.21.15.37:0/2803422026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc828104b10 msgr2=0x7fc82819afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.229+0000 7fc827e00640 1 --2- 172.21.15.37:0/2803422026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc828104b10 0x7fc82819afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.229+0000 7fc827e00640 1 -- 172.21.15.37:0/2803422026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc82810a520 msgr2=0x7fc82819b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.229+0000 7fc827e00640 1 --2- 172.21.15.37:0/2803422026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc82810a520 0x7fc82819b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.229+0000 7fc827e00640 1 -- 172.21.15.37:0/2803422026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8281a1050 con 0x7fc82810aea0 2024-08-20T05:08:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.229+0000 7fc827e00640 1 --2- 172.21.15.37:0/2803422026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc82810aea0 0x7fc8281a0880 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc82000eb10 tx=0x7fc82000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.230+0000 7fc81fe00640 1 -- 172.21.15.37:0/2803422026 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820004b20 con 0x7fc82810aea0 2024-08-20T05:08:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.230+0000 7fc81fe00640 1 -- 172.21.15.37:0/2803422026 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc820004cc0 con 0x7fc82810aea0 2024-08-20T05:08:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.230+0000 7fc82d200640 1 -- 172.21.15.37:0/2803422026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8281a1340 con 0x7fc82810aea0 2024-08-20T05:08:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.230+0000 7fc81fe00640 1 -- 172.21.15.37:0/2803422026 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc820010670 con 0x7fc82810aea0 2024-08-20T05:08:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.230+0000 7fc82d200640 1 -- 172.21.15.37:0/2803422026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8281a7a00 con 0x7fc82810aea0 2024-08-20T05:08:03.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.233+0000 7fc831291740 1 Processor -- start 2024-08-20T05:08:03.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.233+0000 7fc81fe00640 1 -- 172.21.15.37:0/2803422026 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc820005020 con 0x7fc82810aea0 2024-08-20T05:08:03.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.234+0000 7fc831291740 1 -- start start 2024-08-20T05:08:03.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.234+0000 7fc831291740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee2fa80 0x56139ee2fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.234+0000 7fc831291740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee303a0 0x56139ee3bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.234+0000 7fc831291740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee3c330 0x56139ee3e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.234+0000 7fc831291740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56139eda5a60 con 0x56139ee3c330 2024-08-20T05:08:03.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.234+0000 7fc831291740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56139ed94f60 con 0x56139ee303a0 2024-08-20T05:08:03.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.234+0000 7fc831291740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56139ed98fa0 con 0x56139ee2fa80 2024-08-20T05:08:03.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.234+0000 7fc826a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee3c330 0x56139ee3e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.234+0000 7fc826a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee3c330 0x56139ee3e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54976/0 (socket says 172.21.15.37:54976) 2024-08-20T05:08:03.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.234+0000 7fc826a00640 1 -- 172.21.15.37:0/1723078500 learned_addr learned my addr 172.21.15.37:0/1723078500 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:03.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.234+0000 7fc827400640 1 --2- 172.21.15.37:0/1723078500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee303a0 0x56139ee3bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.234+0000 7fc826a00640 1 --2- 172.21.15.37:0/1723078500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee2fa80 0x56139ee2fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.235+0000 7fc826a00640 1 -- 172.21.15.37:0/1723078500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee2fa80 msgr2=0x56139ee2fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:03.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.235+0000 7fc826a00640 1 --2- 172.21.15.37:0/1723078500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee2fa80 0x56139ee2fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.235+0000 7fc826a00640 1 -- 172.21.15.37:0/1723078500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee303a0 msgr2=0x56139ee3bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:03.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.235+0000 7fc826a00640 1 --2- 172.21.15.37:0/1723078500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee303a0 0x56139ee3bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.235+0000 7fc826a00640 1 -- 172.21.15.37:0/1723078500 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56139ed3b3e0 con 0x56139ee3c330 2024-08-20T05:08:03.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.235+0000 7fc81fe00640 1 --2- 172.21.15.37:0/2803422026 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc80c0b3c70 0x7fc80c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.235+0000 7fc826a00640 1 --2- 172.21.15.37:0/1723078500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee3c330 0x56139ee3e720 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc81402a910 tx=0x7fc814005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c4186fe533d978 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:03.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.235+0000 7fc81fe00640 1 -- 172.21.15.37:0/2803422026 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc8200e4540 con 0x7fc82810aea0 2024-08-20T05:08:03.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.235+0000 7fc81cc00640 1 -- 172.21.15.37:0/1723078500 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814035070 con 0x56139ee3c330 2024-08-20T05:08:03.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.236+0000 7fc81cc00640 1 -- 172.21.15.37:0/1723078500 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc814004030 con 0x56139ee3c330 2024-08-20T05:08:03.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.236+0000 7fc81cc00640 1 -- 172.21.15.37:0/1723078500 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814003a90 con 0x56139ee3c330 2024-08-20T05:08:03.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.236+0000 7fc827400640 1 --2- 172.21.15.37:0/2803422026 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc80c0b3c70 0x7fc80c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.236+0000 7fc831291740 1 -- 172.21.15.37:0/1723078500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee3c330 msgr2=0x56139ee3e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:03.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.236+0000 7fc831291740 1 --2- 172.21.15.37:0/1723078500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee3c330 0x56139ee3e720 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc81402a910 tx=0x7fc814005b50 comp rx=0 tx=0).stop 2024-08-20T05:08:03.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.236+0000 7fc827400640 1 --2- 172.21.15.37:0/2803422026 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc80c0b3c70 0x7fc80c0b6130 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x56139ee2e790 tx=0x7fc81800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:03.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.236+0000 7fc831291740 1 -- 172.21.15.37:0/1723078500 shutdown_connections 2024-08-20T05:08:03.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.236+0000 7fc831291740 1 --2- 172.21.15.37:0/1723078500 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee3c330 0x56139ee3e720 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.236+0000 7fc831291740 1 --2- 172.21.15.37:0/1723078500 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee303a0 0x56139ee3bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.236+0000 7fc831291740 1 --2- 172.21.15.37:0/1723078500 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee2fa80 0x56139ee2fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.236+0000 7fc831291740 1 -- 172.21.15.37:0/1723078500 >> 172.21.15.37:0/1723078500 conn(0x56139ee2d8b0 msgr2=0x56139ee2ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:03.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.236+0000 7fc831291740 1 -- 172.21.15.37:0/1723078500 shutdown_connections 2024-08-20T05:08:03.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.237+0000 7fc831291740 1 -- 172.21.15.37:0/1723078500 wait complete. 2024-08-20T05:08:03.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.237+0000 7fc831291740 1 -- start start 2024-08-20T05:08:03.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.237+0000 7fc831291740 1 Processor -- start 2024-08-20T05:08:03.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.238+0000 7fc831291740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee2fa80 0x56139ee3bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.238+0000 7fc831291740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee303a0 0x56139ee39000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.238+0000 7fc831291740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee3c330 0x56139ee395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.238+0000 7fc831291740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56139ebf7700 con 0x56139ee2fa80 2024-08-20T05:08:03.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.238+0000 7fc831291740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56139ed30250 con 0x56139ee3c330 2024-08-20T05:08:03.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.238+0000 7fc831291740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56139ee3ef50 con 0x56139ee303a0 2024-08-20T05:08:03.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.238+0000 7fc831291740 10 client.0 _ll_register_callbacks cb 0x56139ed8f180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:03.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.238+0000 7fc827e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee3c330 0x56139ee395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.238+0000 7fc827400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee2fa80 0x56139ee3bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.238+0000 7fc827e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee3c330 0x56139ee395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50318/0 (socket says 172.21.15.37:50318) 2024-08-20T05:08:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.238+0000 7fc826a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee303a0 0x56139ee39000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.238+0000 7fc827e00640 1 -- 172.21.15.37:0/3492243551 learned_addr learned my addr 172.21.15.37:0/3492243551 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.238+0000 7fc827e00640 1 -- 172.21.15.37:0/3492243551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee303a0 msgr2=0x56139ee39000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.238+0000 7fc827e00640 1 --2- 172.21.15.37:0/3492243551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee303a0 0x56139ee39000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.238+0000 7fc827e00640 1 -- 172.21.15.37:0/3492243551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee2fa80 msgr2=0x56139ee3bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.238+0000 7fc827e00640 1 --2- 172.21.15.37:0/3492243551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee2fa80 0x56139ee3bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.238+0000 7fc827e00640 1 -- 172.21.15.37:0/3492243551 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56139eaf4650 con 0x56139ee3c330 2024-08-20T05:08:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.239+0000 7fc827e00640 1 --2- 172.21.15.37:0/3492243551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee3c330 0x56139ee395a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc8200a7110 tx=0x7fc8200aa800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab0e2209ad84b83 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.239+0000 7fc811600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:08:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.239+0000 7fc811600640 1 -- 172.21.15.37:0/3492243551 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8200e4070 con 0x56139ee3c330 2024-08-20T05:08:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.239+0000 7fc831291740 1 -- 172.21.15.37:0/3492243551 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc814004030 con 0x56139ee3c330 2024-08-20T05:08:03.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.239+0000 7fc811600640 1 -- 172.21.15.37:0/3492243551 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc8200a7680 con 0x56139ee3c330 2024-08-20T05:08:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.239+0000 7fc811600640 1 -- 172.21.15.37:0/3492243551 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc8200af450 con 0x56139ee3c330 2024-08-20T05:08:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.239+0000 7fc831291740 10 client.26939 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.239+0000 7fc831291740 1 -- 172.21.15.37:0/3492243551 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56139ee4a8d0 con 0x56139ee3c330 2024-08-20T05:08:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.239+0000 7fc811600640 1 -- 172.21.15.37:0/3492243551 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc814004030 con 0x56139ee3c330 2024-08-20T05:08:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.240+0000 7fc811600640 1 -- 172.21.15.37:0/3492243551 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fc8200ab2f0 con 0x56139ee3c330 2024-08-20T05:08:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.240+0000 7fc831291740 10 client.26939 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.240+0000 7fc831291740 10 client.26939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.240+0000 7fc831291740 20 client.26939 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.240+0000 7fc831291740 1 --2- 172.21.15.37:0/3492243551 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56139ee4bd30 0x56139ee4e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.240+0000 7fc831291740 4 client.26939 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:08:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.240+0000 7fc831291740 1 -- 172.21.15.37:0/3492243551 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56139eda79b0 con 0x56139ee4bd30 2024-08-20T05:08:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.240+0000 7fc827400640 1 --2- 172.21.15.37:0/3492243551 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56139ee4bd30 0x56139ee4e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.241+0000 7fc811600640 10 client.26939 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.241+0000 7fc827400640 1 --2- 172.21.15.37:0/3492243551 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56139ee4bd30 0x56139ee4e120 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75cc46db95508f06 server_cookie=36d9e3285a3a1ec5 in_seq=0 out_seq=0 2024-08-20T05:08:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.241+0000 7fc811600640 1 -- 172.21.15.37:0/3492243551 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56139eda79b0 con 0x56139ee4bd30 2024-08-20T05:08:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.241+0000 7fc811600640 10 client.26939 handle_command_reply: tid=0 2024-08-20T05:08:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.241+0000 7fc831291740 1 client.26939 shutdown 2024-08-20T05:08:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.242+0000 7fc831291740 1 -- 172.21.15.37:0/3492243551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee3c330 msgr2=0x56139ee395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.242+0000 7fc831291740 1 --2- 172.21.15.37:0/3492243551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee3c330 0x56139ee395a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc8200a7110 tx=0x7fc8200aa800 comp rx=0 tx=0).stop 2024-08-20T05:08:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.242+0000 7fc831291740 1 -- 172.21.15.37:0/3492243551 shutdown_connections 2024-08-20T05:08:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.242+0000 7fc831291740 1 --2- 172.21.15.37:0/3492243551 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56139ee4bd30 0x56139ee4e120 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.242+0000 7fc831291740 1 --2- 172.21.15.37:0/3492243551 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee3c330 0x56139ee395a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.242+0000 7fc831291740 1 --2- 172.21.15.37:0/3492243551 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee303a0 0x56139ee39000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.242+0000 7fc831291740 1 --2- 172.21.15.37:0/3492243551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee2fa80 0x56139ee3bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.242+0000 7fc831291740 1 -- 172.21.15.37:0/3492243551 >> 172.21.15.37:0/3492243551 conn(0x56139ee2d8b0 msgr2=0x56139ee33450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.242+0000 7fc811600640 0 client.26939 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.242+0000 7fc831291740 1 -- 172.21.15.37:0/3492243551 shutdown_connections 2024-08-20T05:08:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.242+0000 7fc831291740 1 -- 172.21.15.37:0/3492243551 wait complete. 2024-08-20T05:08:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.242+0000 7fc831291740 20 client.26939 trim_cache size 0 max 16384 2024-08-20T05:08:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.260+0000 7fc831291740 1 Processor -- start 2024-08-20T05:08:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.260+0000 7fc831291740 1 -- start start 2024-08-20T05:08:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.260+0000 7fc831291740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee2fa80 0x56139ee539f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.260+0000 7fc831291740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee303a0 0x56139ee53f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.260+0000 7fc831291740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee3c330 0x56139ee36230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.260+0000 7fc831291740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc8281b17e0 con 0x56139ee303a0 2024-08-20T05:08:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.260+0000 7fc831291740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc8281b3320 con 0x56139ee3c330 2024-08-20T05:08:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.260+0000 7fc831291740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc8281b1eb0 con 0x56139ee2fa80 2024-08-20T05:08:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.261+0000 7fc826a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee303a0 0x56139ee53f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.261+0000 7fc827e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee3c330 0x56139ee36230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.261+0000 7fc826a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee303a0 0x56139ee53f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54990/0 (socket says 172.21.15.37:54990) 2024-08-20T05:08:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.261+0000 7fc826a00640 1 -- 172.21.15.37:0/55128714 learned_addr learned my addr 172.21.15.37:0/55128714 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.261+0000 7fc827400640 1 --2- 172.21.15.37:0/55128714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee2fa80 0x56139ee539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.261+0000 7fc826a00640 1 -- 172.21.15.37:0/55128714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee2fa80 msgr2=0x56139ee539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.261+0000 7fc826a00640 1 --2- 172.21.15.37:0/55128714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee2fa80 0x56139ee539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.261+0000 7fc826a00640 1 -- 172.21.15.37:0/55128714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee3c330 msgr2=0x56139ee36230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.261+0000 7fc826a00640 1 --2- 172.21.15.37:0/55128714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee3c330 0x56139ee36230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.261+0000 7fc826a00640 1 -- 172.21.15.37:0/55128714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56139ee2e330 con 0x56139ee303a0 2024-08-20T05:08:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.261+0000 7fc827e00640 1 --2- 172.21.15.37:0/55128714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee3c330 0x56139ee36230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.261+0000 7fc827400640 1 --2- 172.21.15.37:0/55128714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee2fa80 0x56139ee539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.261+0000 7fc826a00640 1 --2- 172.21.15.37:0/55128714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee303a0 0x56139ee53f30 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc81402a910 tx=0x7fc814032e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e976086ae6496a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.262+0000 7fc813e00640 1 -- 172.21.15.37:0/55128714 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814035040 con 0x56139ee303a0 2024-08-20T05:08:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.262+0000 7fc813e00640 1 -- 172.21.15.37:0/55128714 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc81404f070 con 0x56139ee303a0 2024-08-20T05:08:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.262+0000 7fc813e00640 1 -- 172.21.15.37:0/55128714 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814004750 con 0x56139ee303a0 2024-08-20T05:08:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.262+0000 7fc831291740 1 -- 172.21.15.37:0/55128714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee303a0 msgr2=0x56139ee53f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.262+0000 7fc831291740 1 --2- 172.21.15.37:0/55128714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee303a0 0x56139ee53f30 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc81402a910 tx=0x7fc814032e50 comp rx=0 tx=0).stop 2024-08-20T05:08:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.262+0000 7fc831291740 1 -- 172.21.15.37:0/55128714 shutdown_connections 2024-08-20T05:08:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.262+0000 7fc831291740 1 --2- 172.21.15.37:0/55128714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee3c330 0x56139ee36230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.262+0000 7fc831291740 1 --2- 172.21.15.37:0/55128714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee303a0 0x56139ee53f30 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.262+0000 7fc831291740 1 --2- 172.21.15.37:0/55128714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee2fa80 0x56139ee539f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.262+0000 7fc831291740 1 -- 172.21.15.37:0/55128714 >> 172.21.15.37:0/55128714 conn(0x56139ee2d8b0 msgr2=0x56139ee2ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.263+0000 7fc831291740 1 -- 172.21.15.37:0/55128714 shutdown_connections 2024-08-20T05:08:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.263+0000 7fc831291740 1 -- 172.21.15.37:0/55128714 wait complete. 2024-08-20T05:08:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.263+0000 7fc831291740 1 -- start start 2024-08-20T05:08:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.263+0000 7fc831291740 1 Processor -- start 2024-08-20T05:08:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.264+0000 7fc831291740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee2fa80 0x56139ee449f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.264+0000 7fc831291740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee303a0 0x56139ee41f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.264+0000 7fc831291740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee3c330 0x56139ee42630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.264+0000 7fc831291740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc8281b2c50 con 0x56139ee2fa80 2024-08-20T05:08:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.264+0000 7fc831291740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc8281b2580 con 0x56139ee303a0 2024-08-20T05:08:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.264+0000 7fc831291740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc8281af7c0 con 0x56139ee3c330 2024-08-20T05:08:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.264+0000 7fc831291740 10 client.0 _ll_register_callbacks cb 0x7fc8200aae60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.264+0000 7fc827400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee2fa80 0x56139ee449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.264+0000 7fc827400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee2fa80 0x56139ee449f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54996/0 (socket says 172.21.15.37:54996) 2024-08-20T05:08:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.264+0000 7fc827400640 1 -- 172.21.15.37:0/4184506155 learned_addr learned my addr 172.21.15.37:0/4184506155 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.264+0000 7fc827e00640 1 --2- 172.21.15.37:0/4184506155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee3c330 0x56139ee42630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.264+0000 7fc826a00640 1 --2- 172.21.15.37:0/4184506155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee303a0 0x56139ee41f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.264+0000 7fc827400640 1 -- 172.21.15.37:0/4184506155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee3c330 msgr2=0x56139ee42630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.264+0000 7fc827400640 1 --2- 172.21.15.37:0/4184506155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee3c330 0x56139ee42630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.264+0000 7fc827400640 1 -- 172.21.15.37:0/4184506155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee303a0 msgr2=0x56139ee41f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.264+0000 7fc827400640 1 --2- 172.21.15.37:0/4184506155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee303a0 0x56139ee41f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.264+0000 7fc827400640 1 -- 172.21.15.37:0/4184506155 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56139ee2ef90 con 0x56139ee2fa80 2024-08-20T05:08:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.265+0000 7fc827400640 1 --2- 172.21.15.37:0/4184506155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee2fa80 0x56139ee449f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x56139ee4e990 tx=0x7fc8180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e385b0152dddca6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.265+0000 7fc811600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:08:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.265+0000 7fc811600640 1 -- 172.21.15.37:0/4184506155 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81801ebf0 con 0x56139ee2fa80 2024-08-20T05:08:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.265+0000 7fc811600640 1 -- 172.21.15.37:0/4184506155 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc81801ed90 con 0x56139ee2fa80 2024-08-20T05:08:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.265+0000 7fc831291740 1 -- 172.21.15.37:0/4184506155 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc81404f070 con 0x56139ee2fa80 2024-08-20T05:08:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.265+0000 7fc811600640 1 -- 172.21.15.37:0/4184506155 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc818005020 con 0x56139ee2fa80 2024-08-20T05:08:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.265+0000 7fc831291740 10 client.16641 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.265+0000 7fc831291740 1 -- 172.21.15.37:0/4184506155 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56139eeb6a40 con 0x56139ee2fa80 2024-08-20T05:08:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.265+0000 7fc811600640 1 -- 172.21.15.37:0/4184506155 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc81404f070 con 0x56139ee2fa80 2024-08-20T05:08:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.266+0000 7fc811600640 1 -- 172.21.15.37:0/4184506155 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fc81802a380 con 0x56139ee2fa80 2024-08-20T05:08:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.266+0000 7fc831291740 10 client.16641 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.266+0000 7fc831291740 10 client.16641 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.266+0000 7fc831291740 20 client.16641 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.266+0000 7fc831291740 1 --2- 172.21.15.37:0/4184506155 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56139eeb71a0 0x56139eeb95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.266+0000 7fc831291740 4 client.16641 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:08:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.266+0000 7fc831291740 1 -- 172.21.15.37:0/4184506155 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56139eda3450 con 0x56139eeb71a0 2024-08-20T05:08:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.266+0000 7fc826a00640 1 --2- 172.21.15.37:0/4184506155 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56139eeb71a0 0x56139eeb95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.267+0000 7fc826a00640 1 --2- 172.21.15.37:0/4184506155 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56139eeb71a0 0x56139eeb95c0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f94cc048d698c1f5 server_cookie=3f6e101fa811cd9d in_seq=0 out_seq=0 2024-08-20T05:08:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.267+0000 7fc811600640 10 client.16641 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.267+0000 7fc811600640 1 -- 172.21.15.37:0/4184506155 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56139eda3450 con 0x56139eeb71a0 2024-08-20T05:08:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.267+0000 7fc811600640 10 client.16641 handle_command_reply: tid=0 2024-08-20T05:08:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.267+0000 7fc831291740 1 client.16641 shutdown 2024-08-20T05:08:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.267+0000 7fc831291740 1 -- 172.21.15.37:0/4184506155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee2fa80 msgr2=0x56139ee449f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.267+0000 7fc831291740 1 --2- 172.21.15.37:0/4184506155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee2fa80 0x56139ee449f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x56139ee4e990 tx=0x7fc8180046c0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.267+0000 7fc831291740 1 -- 172.21.15.37:0/4184506155 shutdown_connections 2024-08-20T05:08:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.267+0000 7fc831291740 1 --2- 172.21.15.37:0/4184506155 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56139eeb71a0 0x56139eeb95c0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.291 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:08:03.291 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-20T05:08:03.291 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-08-20T05:08:03.291 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:08:03.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.267+0000 7fc831291740 1 --2- 172.21.15.37:0/4184506155 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56139ee3c330 0x56139ee42630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.267+0000 7fc831291740 1 --2- 172.21.15.37:0/4184506155 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56139ee303a0 0x56139ee41f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.267+0000 7fc811600640 0 client.16641 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.267+0000 7fc831291740 1 --2- 172.21.15.37:0/4184506155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56139ee2fa80 0x56139ee449f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.267+0000 7fc831291740 1 -- 172.21.15.37:0/4184506155 >> 172.21.15.37:0/4184506155 conn(0x56139ee2d8b0 msgr2=0x56139ee37750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.268+0000 7fc831291740 1 -- 172.21.15.37:0/4184506155 shutdown_connections 2024-08-20T05:08:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.268+0000 7fc831291740 1 -- 172.21.15.37:0/4184506155 wait complete. 2024-08-20T05:08:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.268+0000 7fc831291740 20 client.16641 trim_cache size 0 max 16384 2024-08-20T05:08:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.268+0000 7fc82d200640 1 -- 172.21.15.37:0/2803422026 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc80c0b3c70 msgr2=0x7fc80c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.268+0000 7fc82d200640 1 --2- 172.21.15.37:0/2803422026 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc80c0b3c70 0x7fc80c0b6130 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x56139ee2e790 tx=0x7fc81800b390 comp rx=0 tx=0).stop 2024-08-20T05:08:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.268+0000 7fc82d200640 1 -- 172.21.15.37:0/2803422026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc82810aea0 msgr2=0x7fc8281a0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.268+0000 7fc82d200640 1 --2- 172.21.15.37:0/2803422026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc82810aea0 0x7fc8281a0880 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc82000eb10 tx=0x7fc82000c2d0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.268+0000 7fc82d200640 1 -- 172.21.15.37:0/2803422026 shutdown_connections 2024-08-20T05:08:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.268+0000 7fc82d200640 1 --2- 172.21.15.37:0/2803422026 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc80c0b3c70 0x7fc80c0b6130 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.268+0000 7fc82d200640 1 --2- 172.21.15.37:0/2803422026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc82810aea0 0x7fc8281a0880 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.268+0000 7fc82d200640 1 --2- 172.21.15.37:0/2803422026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc82810a520 0x7fc82819b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.268+0000 7fc82d200640 1 --2- 172.21.15.37:0/2803422026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc828104b10 0x7fc82819afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.268+0000 7fc82d200640 1 -- 172.21.15.37:0/2803422026 >> 172.21.15.37:0/2803422026 conn(0x7fc828100540 msgr2=0x7fc828102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.269+0000 7fc82d200640 1 -- 172.21.15.37:0/2803422026 shutdown_connections 2024-08-20T05:08:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:03.269+0000 7fc82d200640 1 -- 172.21.15.37:0/2803422026 wait complete. 2024-08-20T05:08:03.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:03 smithi135 ceph-mon[22342]: pgmap v575: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 452 op/s 2024-08-20T05:08:03.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:03 smithi130 ceph-mon[22007]: pgmap v575: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 452 op/s 2024-08-20T05:08:04.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:03 smithi037 ceph-mon[17265]: pgmap v575: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 10 MiB/s wr, 452 op/s 2024-08-20T05:08:04.186 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T05:08:04.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:08:04.565 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:08:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.145+0000 7f3f84c00640 1 -- 172.21.15.37:0/429799582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f801048a0 msgr2=0x7f3f80104ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.145+0000 7f3f84c00640 1 --2- 172.21.15.37:0/429799582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f801048a0 0x7f3f80104ca0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3f70009930 tx=0x7f3f7002a420 comp rx=0 tx=0).stop 2024-08-20T05:08:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.145+0000 7f3f84c00640 1 -- 172.21.15.37:0/429799582 shutdown_connections 2024-08-20T05:08:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.145+0000 7f3f84c00640 1 --2- 172.21.15.37:0/429799582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f801063b0 0x7f3f8010cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.145+0000 7f3f84c00640 1 --2- 172.21.15.37:0/429799582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f801059f0 0x7f3f80105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.145+0000 7f3f84c00640 1 --2- 172.21.15.37:0/429799582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f801048a0 0x7f3f80104ca0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.145+0000 7f3f84c00640 1 -- 172.21.15.37:0/429799582 >> 172.21.15.37:0/429799582 conn(0x7f3f80100160 msgr2=0x7f3f80102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.145+0000 7f3f84c00640 1 -- 172.21.15.37:0/429799582 shutdown_connections 2024-08-20T05:08:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.145+0000 7f3f84c00640 1 -- 172.21.15.37:0/429799582 wait complete. 2024-08-20T05:08:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.146+0000 7f3f84c00640 1 Processor -- start 2024-08-20T05:08:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.146+0000 7f3f84c00640 1 -- start start 2024-08-20T05:08:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.147+0000 7f3f84c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f801048a0 0x7f3f8019acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.147+0000 7f3f84c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f801059f0 0x7f3f8019b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.147+0000 7f3f84c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f801063b0 0x7f3f8019bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.147+0000 7f3f84c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f80110540 con 0x7f3f801059f0 2024-08-20T05:08:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.147+0000 7f3f84c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3f801103c0 con 0x7f3f801063b0 2024-08-20T05:08:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.147+0000 7f3f84c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3f801106c0 con 0x7f3f801048a0 2024-08-20T05:08:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.147+0000 7f3f7d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f801059f0 0x7f3f8019b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.147+0000 7f3f7d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f801059f0 0x7f3f8019b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55020/0 (socket says 172.21.15.37:55020) 2024-08-20T05:08:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.147+0000 7f3f7d400640 1 -- 172.21.15.37:0/220694049 learned_addr learned my addr 172.21.15.37:0/220694049 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.147+0000 7f3f7de00640 1 --2- 172.21.15.37:0/220694049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f801048a0 0x7f3f8019acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.147+0000 7f3f7e800640 1 --2- 172.21.15.37:0/220694049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f801063b0 0x7f3f8019bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.147+0000 7f3f7d400640 1 -- 172.21.15.37:0/220694049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f801048a0 msgr2=0x7f3f8019acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.147+0000 7f3f7d400640 1 --2- 172.21.15.37:0/220694049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f801048a0 0x7f3f8019acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.147+0000 7f3f7d400640 1 -- 172.21.15.37:0/220694049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f801063b0 msgr2=0x7f3f8019bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.147+0000 7f3f7d400640 1 --2- 172.21.15.37:0/220694049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f801063b0 0x7f3f8019bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.147+0000 7f3f7d400640 1 -- 172.21.15.37:0/220694049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f8019c830 con 0x7f3f801059f0 2024-08-20T05:08:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.147+0000 7f3f7e800640 1 --2- 172.21.15.37:0/220694049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f801063b0 0x7f3f8019bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:08:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.148+0000 7f3f7d400640 1 --2- 172.21.15.37:0/220694049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f801059f0 0x7f3f8019b340 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00e9f0 tx=0x7f3f6c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.148+0000 7f3f76a00640 1 -- 172.21.15.37:0/220694049 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00cd80 con 0x7f3f801059f0 2024-08-20T05:08:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.148+0000 7f3f84c00640 1 -- 172.21.15.37:0/220694049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f8019cb20 con 0x7f3f801059f0 2024-08-20T05:08:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.148+0000 7f3f76a00640 1 -- 172.21.15.37:0/220694049 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f6c0108e0 con 0x7f3f801059f0 2024-08-20T05:08:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.148+0000 7f3f76a00640 1 -- 172.21.15.37:0/220694049 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c018980 con 0x7f3f801059f0 2024-08-20T05:08:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.148+0000 7f3f84c00640 1 -- 172.21.15.37:0/220694049 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f801a31f0 con 0x7f3f801059f0 2024-08-20T05:08:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.152+0000 7f3f87ab7740 1 Processor -- start 2024-08-20T05:08:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.152+0000 7f3f87ab7740 1 -- start start 2024-08-20T05:08:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.153+0000 7f3f87ab7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b83610 0x564f51b85a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.153+0000 7f3f87ab7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b85f40 0x564f51b88330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.153+0000 7f3f87ab7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b88980 0x564f51b8ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.153+0000 7f3f87ab7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564f51af6210 con 0x564f51b85f40 2024-08-20T05:08:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.153+0000 7f3f87ab7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564f51ae5710 con 0x564f51b83610 2024-08-20T05:08:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.153+0000 7f3f87ab7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564f51ae9750 con 0x564f51b88980 2024-08-20T05:08:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.153+0000 7f3f76a00640 1 -- 172.21.15.37:0/220694049 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3f6c010430 con 0x7f3f801059f0 2024-08-20T05:08:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.153+0000 7f3f7de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b85f40 0x564f51b88330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.153+0000 7f3f7e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b83610 0x564f51b85a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.153+0000 7f3f7de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b85f40 0x564f51b88330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55032/0 (socket says 172.21.15.37:55032) 2024-08-20T05:08:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.153+0000 7f3f7e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b83610 0x564f51b85a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50362/0 (socket says 172.21.15.37:50362) 2024-08-20T05:08:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.153+0000 7f3f7de00640 1 -- 172.21.15.37:0/3238343472 learned_addr learned my addr 172.21.15.37:0/3238343472 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.153+0000 7f3f7d400640 1 --2- 172.21.15.37:0/3238343472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b88980 0x564f51b8ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.154+0000 7f3f7e800640 1 -- 172.21.15.37:0/3238343472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b88980 msgr2=0x564f51b8ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.154+0000 7f3f7e800640 1 --2- 172.21.15.37:0/3238343472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b88980 0x564f51b8ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.154+0000 7f3f7e800640 1 -- 172.21.15.37:0/3238343472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b85f40 msgr2=0x564f51b88330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.154+0000 7f3f7e800640 1 --2- 172.21.15.37:0/3238343472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b85f40 0x564f51b88330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.154+0000 7f3f7e800640 1 -- 172.21.15.37:0/3238343472 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f51ab1de0 con 0x564f51b83610 2024-08-20T05:08:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.154+0000 7f3f7d400640 1 --2- 172.21.15.37:0/3238343472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b88980 0x564f51b8ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:08:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.154+0000 7f3f7e800640 1 --2- 172.21.15.37:0/3238343472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b83610 0x564f51b85a00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3f78005fd0 tx=0x7f3f780107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=943201dc6d6ac2cb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.154+0000 7f3f6b000640 1 -- 172.21.15.37:0/3238343472 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f7801c680 con 0x564f51b83610 2024-08-20T05:08:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.154+0000 7f3f6b000640 1 -- 172.21.15.37:0/3238343472 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f7801ccd0 con 0x564f51b83610 2024-08-20T05:08:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.154+0000 7f3f6b000640 1 -- 172.21.15.37:0/3238343472 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f78011d40 con 0x564f51b83610 2024-08-20T05:08:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.155+0000 7f3f76a00640 1 --2- 172.21.15.37:0/220694049 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3f640b3bd0 0x7f3f640b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.155+0000 7f3f87ab7740 1 -- 172.21.15.37:0/3238343472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b83610 msgr2=0x564f51b85a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.155+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/3238343472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b83610 0x564f51b85a00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3f78005fd0 tx=0x7f3f780107a0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.155+0000 7f3f76a00640 1 -- 172.21.15.37:0/220694049 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3f6c0e43b0 con 0x7f3f801059f0 2024-08-20T05:08:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.156+0000 7f3f87ab7740 1 -- 172.21.15.37:0/3238343472 shutdown_connections 2024-08-20T05:08:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.156+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/3238343472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b88980 0x564f51b8ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.156+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/3238343472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b85f40 0x564f51b88330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.156+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/3238343472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b83610 0x564f51b85a00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.156+0000 7f3f87ab7740 1 -- 172.21.15.37:0/3238343472 >> 172.21.15.37:0/3238343472 conn(0x564f51b7e760 msgr2=0x564f51b7f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.156+0000 7f3f7de00640 1 --2- 172.21.15.37:0/220694049 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3f640b3bd0 0x7f3f640b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.156+0000 7f3f87ab7740 1 -- 172.21.15.37:0/3238343472 shutdown_connections 2024-08-20T05:08:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.156+0000 7f3f87ab7740 1 -- 172.21.15.37:0/3238343472 wait complete. 2024-08-20T05:08:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.156+0000 7f3f87ab7740 1 -- start start 2024-08-20T05:08:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.156+0000 7f3f7de00640 1 --2- 172.21.15.37:0/220694049 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3f640b3bd0 0x7f3f640b6090 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3f70005ab0 tx=0x7f3f70005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.156+0000 7f3f87ab7740 1 Processor -- start 2024-08-20T05:08:05.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.157+0000 7f3f87ab7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b83610 0x564f51b8cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.157+0000 7f3f87ab7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b85f40 0x564f51b8d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.157+0000 7f3f87ab7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b88980 0x564f51b8df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.157+0000 7f3f87ab7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564f51a1eab0 con 0x564f51b88980 2024-08-20T05:08:05.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.157+0000 7f3f87ab7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564f51a8c140 con 0x564f51b85f40 2024-08-20T05:08:05.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.157+0000 7f3f87ab7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564f51b8b960 con 0x564f51b83610 2024-08-20T05:08:05.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.157+0000 7f3f87ab7740 10 client.0 _ll_register_callbacks cb 0x564f51a9f5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:05.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.157+0000 7f3f7e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b88980 0x564f51b8df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.157+0000 7f3f7de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b83610 0x564f51b8cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.157+0000 7f3f7de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b83610 0x564f51b8cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:56596/0 (socket says 172.21.15.37:56596) 2024-08-20T05:08:05.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.157+0000 7f3f7d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b85f40 0x564f51b8d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.157+0000 7f3f7de00640 1 -- 172.21.15.37:0/2676604526 learned_addr learned my addr 172.21.15.37:0/2676604526 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:05.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.158+0000 7f3f7d400640 1 -- 172.21.15.37:0/2676604526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b83610 msgr2=0x564f51b8cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:05.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.158+0000 7f3f7d400640 1 --2- 172.21.15.37:0/2676604526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b83610 0x564f51b8cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.158+0000 7f3f7d400640 1 -- 172.21.15.37:0/2676604526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b88980 msgr2=0x564f51b8df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:05.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.158+0000 7f3f7d400640 1 --2- 172.21.15.37:0/2676604526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b88980 0x564f51b8df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.158+0000 7f3f7d400640 1 -- 172.21.15.37:0/2676604526 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f51a8d170 con 0x564f51b85f40 2024-08-20T05:08:05.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.158+0000 7f3f7d400640 1 --2- 172.21.15.37:0/2676604526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b85f40 0x564f51b8d3c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0e1ab0 tx=0x7f3f6c0aa7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9f523a2b21c88a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:05.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.158+0000 7f3f5f400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:08:05.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.158+0000 7f3f5f400640 1 -- 172.21.15.37:0/2676604526 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0e4170 con 0x564f51b85f40 2024-08-20T05:08:05.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.158+0000 7f3f87ab7740 1 -- 172.21.15.37:0/2676604526 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f7801ccd0 con 0x564f51b85f40 2024-08-20T05:08:05.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.158+0000 7f3f5f400640 1 -- 172.21.15.37:0/2676604526 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3f6c0aa370 con 0x564f51b85f40 2024-08-20T05:08:05.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.159+0000 7f3f5f400640 1 -- 172.21.15.37:0/2676604526 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f3f6c0aaf00 con 0x564f51b85f40 2024-08-20T05:08:05.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.159+0000 7f3f87ab7740 10 client.26957 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:05.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.159+0000 7f3f87ab7740 1 -- 172.21.15.37:0/2676604526 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x564f51848790 con 0x564f51b85f40 2024-08-20T05:08:05.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.159+0000 7f3f5f400640 1 -- 172.21.15.37:0/2676604526 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f7801ccd0 con 0x564f51b85f40 2024-08-20T05:08:05.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.159+0000 7f3f5f400640 1 -- 172.21.15.37:0/2676604526 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f3f6c0a6a70 con 0x564f51b85f40 2024-08-20T05:08:05.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.159+0000 7f3f87ab7740 10 client.26957 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:05.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.159+0000 7f3f87ab7740 10 client.26957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:05.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.159+0000 7f3f87ab7740 20 client.26957 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:05.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.159+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/2676604526 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564f51b98910 0x564f51b9ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.159+0000 7f3f87ab7740 4 client.26957 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:08:05.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.159+0000 7f3f87ab7740 1 -- 172.21.15.37:0/2676604526 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f51af8160 con 0x564f51b98910 2024-08-20T05:08:05.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.160+0000 7f3f7de00640 1 --2- 172.21.15.37:0/2676604526 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564f51b98910 0x564f51b9ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.160+0000 7f3f7de00640 1 --2- 172.21.15.37:0/2676604526 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564f51b98910 0x564f51b9ad00 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3aea7874036aed43 server_cookie=5f87e362a6a4cc35 in_seq=0 out_seq=0 2024-08-20T05:08:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.160+0000 7f3f5f400640 10 client.26957 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.161+0000 7f3f5f400640 1 -- 172.21.15.37:0/2676604526 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564f51af8160 con 0x564f51b98910 2024-08-20T05:08:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.161+0000 7f3f5f400640 10 client.26957 handle_command_reply: tid=0 2024-08-20T05:08:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.161+0000 7f3f87ab7740 1 client.26957 shutdown 2024-08-20T05:08:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.161+0000 7f3f87ab7740 1 -- 172.21.15.37:0/2676604526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b85f40 msgr2=0x564f51b8d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.161+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/2676604526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b85f40 0x564f51b8d3c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0e1ab0 tx=0x7f3f6c0aa7a0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.162+0000 7f3f87ab7740 1 -- 172.21.15.37:0/2676604526 shutdown_connections 2024-08-20T05:08:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.162+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/2676604526 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564f51b98910 0x564f51b9ad00 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.162+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/2676604526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b88980 0x564f51b8df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.162+0000 7f3f5f400640 0 client.26957 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.162+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/2676604526 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b85f40 0x564f51b8d3c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.162+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/2676604526 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b83610 0x564f51b8cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.167 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.162+0000 7f3f87ab7740 1 -- 172.21.15.37:0/2676604526 >> 172.21.15.37:0/2676604526 conn(0x564f51b7e760 msgr2=0x564f51b7d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.162+0000 7f3f87ab7740 1 -- 172.21.15.37:0/2676604526 shutdown_connections 2024-08-20T05:08:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.162+0000 7f3f87ab7740 1 -- 172.21.15.37:0/2676604526 wait complete. 2024-08-20T05:08:05.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.162+0000 7f3f87ab7740 20 client.26957 trim_cache size 0 max 16384 2024-08-20T05:08:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.188+0000 7f3f87ab7740 1 Processor -- start 2024-08-20T05:08:05.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.188+0000 7f3f87ab7740 1 -- start start 2024-08-20T05:08:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.188+0000 7f3f87ab7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b83610 0x564f51b815a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.188+0000 7f3f87ab7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b85f40 0x564f51b81ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.188+0000 7f3f87ab7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b88980 0x564f51b9f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.188+0000 7f3f87ab7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f801ad600 con 0x564f51b85f40 2024-08-20T05:08:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.188+0000 7f3f87ab7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3f801af140 con 0x564f51b83610 2024-08-20T05:08:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.188+0000 7f3f87ab7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3f801adcd0 con 0x564f51b88980 2024-08-20T05:08:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.189+0000 7f3f7d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b85f40 0x564f51b81ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.189+0000 7f3f7d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b85f40 0x564f51b81ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55036/0 (socket says 172.21.15.37:55036) 2024-08-20T05:08:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.189+0000 7f3f7d400640 1 -- 172.21.15.37:0/3604421781 learned_addr learned my addr 172.21.15.37:0/3604421781 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.189+0000 7f3f7de00640 1 --2- 172.21.15.37:0/3604421781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b83610 0x564f51b815a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.189+0000 7f3f7e800640 1 --2- 172.21.15.37:0/3604421781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b88980 0x564f51b9f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.189+0000 7f3f7d400640 1 -- 172.21.15.37:0/3604421781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b88980 msgr2=0x564f51b9f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.189+0000 7f3f7d400640 1 --2- 172.21.15.37:0/3604421781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b88980 0x564f51b9f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.189+0000 7f3f7d400640 1 -- 172.21.15.37:0/3604421781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b83610 msgr2=0x564f51b815a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.189+0000 7f3f7d400640 1 --2- 172.21.15.37:0/3604421781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b83610 0x564f51b815a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.189+0000 7f3f7d400640 1 -- 172.21.15.37:0/3604421781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f518c1620 con 0x564f51b85f40 2024-08-20T05:08:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.189+0000 7f3f7d400640 1 --2- 172.21.15.37:0/3604421781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b85f40 0x564f51b81ae0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c023040 tx=0x7f3f6c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28f5b2a99175e10 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.190+0000 7f3f6a600640 1 -- 172.21.15.37:0/3604421781 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0ca070 con 0x564f51b85f40 2024-08-20T05:08:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.190+0000 7f3f6a600640 1 -- 172.21.15.37:0/3604421781 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f6c0e4170 con 0x564f51b85f40 2024-08-20T05:08:05.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.190+0000 7f3f6a600640 1 -- 172.21.15.37:0/3604421781 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0a6870 con 0x564f51b85f40 2024-08-20T05:08:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.191+0000 7f3f87ab7740 1 -- 172.21.15.37:0/3604421781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b85f40 msgr2=0x564f51b81ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.191+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/3604421781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b85f40 0x564f51b81ae0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c023040 tx=0x7f3f6c000bc0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.191+0000 7f3f87ab7740 1 -- 172.21.15.37:0/3604421781 shutdown_connections 2024-08-20T05:08:05.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.191+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/3604421781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b88980 0x564f51b9f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.191+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/3604421781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b85f40 0x564f51b81ae0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.191+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/3604421781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b83610 0x564f51b815a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.191+0000 7f3f87ab7740 1 -- 172.21.15.37:0/3604421781 >> 172.21.15.37:0/3604421781 conn(0x564f51b7e760 msgr2=0x564f51b7d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.191+0000 7f3f87ab7740 1 -- 172.21.15.37:0/3604421781 shutdown_connections 2024-08-20T05:08:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.191+0000 7f3f87ab7740 1 -- 172.21.15.37:0/3604421781 wait complete. 2024-08-20T05:08:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.191+0000 7f3f87ab7740 1 -- start start 2024-08-20T05:08:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.191+0000 7f3f87ab7740 1 Processor -- start 2024-08-20T05:08:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.192+0000 7f3f87ab7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b83610 0x564f51b947e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.192+0000 7f3f87ab7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b85f40 0x564f51b934e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.192+0000 7f3f87ab7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b88980 0x564f51b93bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.192+0000 7f3f87ab7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f801aea70 con 0x564f51b83610 2024-08-20T05:08:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.192+0000 7f3f87ab7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3f801ae3a0 con 0x564f51b88980 2024-08-20T05:08:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.192+0000 7f3f87ab7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3f801ab5e0 con 0x564f51b85f40 2024-08-20T05:08:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.192+0000 7f3f87ab7740 10 client.0 _ll_register_callbacks cb 0x7f3f6c009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.192+0000 7f3f7d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b85f40 0x564f51b934e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.192+0000 7f3f7d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b85f40 0x564f51b934e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:56612/0 (socket says 172.21.15.37:56612) 2024-08-20T05:08:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.192+0000 7f3f7d400640 1 -- 172.21.15.37:0/149497816 learned_addr learned my addr 172.21.15.37:0/149497816 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.192+0000 7f3f7de00640 1 --2- 172.21.15.37:0/149497816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b83610 0x564f51b947e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.192+0000 7f3f7e800640 1 --2- 172.21.15.37:0/149497816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b88980 0x564f51b93bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.193+0000 7f3f7d400640 1 -- 172.21.15.37:0/149497816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b88980 msgr2=0x564f51b93bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.193+0000 7f3f7d400640 1 --2- 172.21.15.37:0/149497816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b88980 0x564f51b93bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.193+0000 7f3f7d400640 1 -- 172.21.15.37:0/149497816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b83610 msgr2=0x564f51b947e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.193+0000 7f3f7d400640 1 --2- 172.21.15.37:0/149497816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b83610 0x564f51b947e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.193+0000 7f3f7d400640 1 -- 172.21.15.37:0/149497816 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f51b92000 con 0x564f51b85f40 2024-08-20T05:08:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.193+0000 7f3f7de00640 1 --2- 172.21.15.37:0/149497816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b83610 0x564f51b947e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:08:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.193+0000 7f3f7e800640 1 --2- 172.21.15.37:0/149497816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b88980 0x564f51b93bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:08:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.193+0000 7f3f7d400640 1 --2- 172.21.15.37:0/149497816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b85f40 0x564f51b934e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0aa9c0 tx=0x7f3f6c0aab70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb33569ac22bdb8d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.193+0000 7f3f5f400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:08:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.193+0000 7f3f5f400640 1 -- 172.21.15.37:0/149497816 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0ca070 con 0x564f51b85f40 2024-08-20T05:08:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.193+0000 7f3f87ab7740 1 -- 172.21.15.37:0/149497816 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f6c0e4170 con 0x564f51b85f40 2024-08-20T05:08:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.193+0000 7f3f5f400640 1 -- 172.21.15.37:0/149497816 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3f6c0a6a80 con 0x564f51b85f40 2024-08-20T05:08:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.194+0000 7f3f5f400640 1 -- 172.21.15.37:0/149497816 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f3f6c0be050 con 0x564f51b85f40 2024-08-20T05:08:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.194+0000 7f3f87ab7740 10 client.26989 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.194+0000 7f3f87ab7740 1 -- 172.21.15.37:0/149497816 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x564f51c037d0 con 0x564f51b85f40 2024-08-20T05:08:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.194+0000 7f3f5f400640 1 -- 172.21.15.37:0/149497816 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f6c0e4170 con 0x564f51b85f40 2024-08-20T05:08:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.194+0000 7f3f5f400640 1 -- 172.21.15.37:0/149497816 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f3f6c0b7060 con 0x564f51b85f40 2024-08-20T05:08:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.194+0000 7f3f87ab7740 10 client.26989 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.194+0000 7f3f87ab7740 10 client.26989 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.194+0000 7f3f87ab7740 20 client.26989 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.194+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/149497816 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564f51c04010 0x564f51c06430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.194+0000 7f3f87ab7740 4 client.26989 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:08:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.194+0000 7f3f87ab7740 1 -- 172.21.15.37:0/149497816 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564f51af3c00 con 0x564f51c04010 2024-08-20T05:08:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.195+0000 7f3f7de00640 1 --2- 172.21.15.37:0/149497816 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564f51c04010 0x564f51c06430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.195+0000 7f3f7de00640 1 --2- 172.21.15.37:0/149497816 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564f51c04010 0x564f51c06430 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d662f71c9d16cc3 server_cookie=fc599c694cf507fb in_seq=0 out_seq=0 2024-08-20T05:08:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.195+0000 7f3f5f400640 10 client.26989 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:05.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.205+0000 7f2cb0600640 1 -- 172.21.15.37:0/3929549490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca81019d0 msgr2=0x7f2ca8101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:05.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.205+0000 7f2cb0600640 1 --2- 172.21.15.37:0/3929549490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca81019d0 0x7f2ca8101db0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009900 tx=0x7f2c9c02a400 comp rx=0 tx=0).stop 2024-08-20T05:08:05.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.205+0000 7f2cb0600640 1 -- 172.21.15.37:0/3929549490 shutdown_connections 2024-08-20T05:08:05.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.205+0000 7f2cb0600640 1 --2- 172.21.15.37:0/3929549490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca8107d60 0x7f2ca810e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.205+0000 7f2cb0600640 1 --2- 172.21.15.37:0/3929549490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca81073e0 0x7f2ca8107820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.205+0000 7f2cb0600640 1 --2- 172.21.15.37:0/3929549490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca81019d0 0x7f2ca8101db0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.205+0000 7f2cb0600640 1 -- 172.21.15.37:0/3929549490 >> 172.21.15.37:0/3929549490 conn(0x7f2ca80fd440 msgr2=0x7f2ca80ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:05.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.205+0000 7f2cb0600640 1 -- 172.21.15.37:0/3929549490 shutdown_connections 2024-08-20T05:08:05.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.205+0000 7f2cb0600640 1 -- 172.21.15.37:0/3929549490 wait complete. 2024-08-20T05:08:05.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.206+0000 7f2cb0600640 1 Processor -- start 2024-08-20T05:08:05.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.206+0000 7f2cb0600640 1 -- start start 2024-08-20T05:08:05.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.207+0000 7f2cb0600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca81019d0 0x7f2ca819b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.207+0000 7f2cb0600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca81073e0 0x7f2ca819b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.207+0000 7f2cb0600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca8107d60 0x7f2ca81a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.207+0000 7f2cb0600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca8112b80 con 0x7f2ca81073e0 2024-08-20T05:08:05.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.207+0000 7f2cb0600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca8112a00 con 0x7f2ca81019d0 2024-08-20T05:08:05.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.207+0000 7f2cb0600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2ca8112d00 con 0x7f2ca8107d60 2024-08-20T05:08:05.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.207+0000 7f2cad200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca81073e0 0x7f2ca819b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.207+0000 7f2cadc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca81019d0 0x7f2ca819b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.207+0000 7f2cadc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca81019d0 0x7f2ca819b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50400/0 (socket says 172.21.15.37:50400) 2024-08-20T05:08:05.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.207+0000 7f2cadc00640 1 -- 172.21.15.37:0/870836052 learned_addr learned my addr 172.21.15.37:0/870836052 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:05.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.207+0000 7f2cad200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca81073e0 0x7f2ca819b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55074/0 (socket says 172.21.15.37:55074) 2024-08-20T05:08:05.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.207+0000 7f2cae600640 1 --2- 172.21.15.37:0/870836052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca8107d60 0x7f2ca81a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.208+0000 7f2cad200640 1 -- 172.21.15.37:0/870836052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca8107d60 msgr2=0x7f2ca81a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.208+0000 7f2cad200640 1 --2- 172.21.15.37:0/870836052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca8107d60 0x7f2ca81a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.208+0000 7f2cad200640 1 -- 172.21.15.37:0/870836052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca81019d0 msgr2=0x7f2ca819b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.208+0000 7f2cad200640 1 --2- 172.21.15.37:0/870836052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca81019d0 0x7f2ca819b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.208+0000 7f2cad200640 1 -- 172.21.15.37:0/870836052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ca81a1260 con 0x7f2ca81073e0 2024-08-20T05:08:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.208+0000 7f2cae600640 1 --2- 172.21.15.37:0/870836052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca8107d60 0x7f2ca81a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.208+0000 7f2cadc00640 1 --2- 172.21.15.37:0/870836052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca81019d0 0x7f2ca819b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:05.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.208+0000 7f2cad200640 1 --2- 172.21.15.37:0/870836052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca81073e0 0x7f2ca819b6f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400e9f0 tx=0x7f2c9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.208+0000 7f3f5f400640 1 -- 172.21.15.37:0/149497816 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564f51af3c00 con 0x564f51c04010 2024-08-20T05:08:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.208+0000 7f3f5f400640 10 client.26989 handle_command_reply: tid=0 2024-08-20T05:08:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.208+0000 7f3f87ab7740 1 client.26989 shutdown 2024-08-20T05:08:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.209+0000 7f3f87ab7740 1 -- 172.21.15.37:0/149497816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b85f40 msgr2=0x564f51b934e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:05.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.209+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/149497816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b85f40 0x564f51b934e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c0aa9c0 tx=0x7f3f6c0aab70 comp rx=0 tx=0).stop 2024-08-20T05:08:05.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.208+0000 7f2ca6000640 1 -- 172.21.15.37:0/870836052 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c9400ccc0 con 0x7f2ca81073e0 2024-08-20T05:08:05.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.208+0000 7f2ca6000640 1 -- 172.21.15.37:0/870836052 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c940108e0 con 0x7f2ca81073e0 2024-08-20T05:08:05.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.208+0000 7f2ca6000640 1 -- 172.21.15.37:0/870836052 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c94018880 con 0x7f2ca81073e0 2024-08-20T05:08:05.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.209+0000 7f2cb0600640 1 -- 172.21.15.37:0/870836052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ca81a1550 con 0x7f2ca81073e0 2024-08-20T05:08:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.209+0000 7f3f87ab7740 1 -- 172.21.15.37:0/149497816 shutdown_connections 2024-08-20T05:08:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.209+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/149497816 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564f51c04010 0x564f51c06430 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.209+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/149497816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564f51b88980 0x564f51b93bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.209+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/149497816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564f51b85f40 0x564f51b934e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.209+0000 7f3f87ab7740 1 --2- 172.21.15.37:0/149497816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564f51b83610 0x564f51b947e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.209+0000 7f3f87ab7740 1 -- 172.21.15.37:0/149497816 >> 172.21.15.37:0/149497816 conn(0x564f51b7e760 msgr2=0x564f51b9f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:05.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.209+0000 7f3f5f400640 0 client.26989 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:05.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.209+0000 7f2cb0600640 1 -- 172.21.15.37:0/870836052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ca81a7c10 con 0x7f2ca81073e0 2024-08-20T05:08:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.209+0000 7f3f87ab7740 1 -- 172.21.15.37:0/149497816 shutdown_connections 2024-08-20T05:08:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.209+0000 7f3f87ab7740 1 -- 172.21.15.37:0/149497816 wait complete. 2024-08-20T05:08:05.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.209+0000 7f3f87ab7740 20 client.26989 trim_cache size 0 max 16384 2024-08-20T05:08:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:08:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:08:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:08:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:08:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.210+0000 7f3f84c00640 1 -- 172.21.15.37:0/220694049 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3f640b3bd0 msgr2=0x7f3f640b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:05.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.210+0000 7f3f84c00640 1 --2- 172.21.15.37:0/220694049 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3f640b3bd0 0x7f3f640b6090 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3f70005ab0 tx=0x7f3f70005a20 comp rx=0 tx=0).stop 2024-08-20T05:08:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.210+0000 7f3f84c00640 1 -- 172.21.15.37:0/220694049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f801059f0 msgr2=0x7f3f8019b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.210+0000 7f3f84c00640 1 --2- 172.21.15.37:0/220694049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f801059f0 0x7f3f8019b340 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00e9f0 tx=0x7f3f6c00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.210+0000 7f2cb0600640 1 -- 172.21.15.37:0/870836052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ca8101db0 con 0x7f2ca81073e0 2024-08-20T05:08:05.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.210+0000 7f3f84c00640 1 -- 172.21.15.37:0/220694049 shutdown_connections 2024-08-20T05:08:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.210+0000 7f3f84c00640 1 --2- 172.21.15.37:0/220694049 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3f640b3bd0 0x7f3f640b6090 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.210+0000 7f3f84c00640 1 --2- 172.21.15.37:0/220694049 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f801063b0 0x7f3f8019bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.210+0000 7f3f84c00640 1 --2- 172.21.15.37:0/220694049 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f801059f0 0x7f3f8019b340 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.210+0000 7f3f84c00640 1 --2- 172.21.15.37:0/220694049 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f801048a0 0x7f3f8019acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.210+0000 7f3f84c00640 1 -- 172.21.15.37:0/220694049 >> 172.21.15.37:0/220694049 conn(0x7f3f80100160 msgr2=0x7f3f80106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.211+0000 7f3f84c00640 1 -- 172.21.15.37:0/220694049 shutdown_connections 2024-08-20T05:08:05.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:05.211+0000 7f3f84c00640 1 -- 172.21.15.37:0/220694049 wait complete. 2024-08-20T05:08:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.213+0000 7f2ca6000640 1 -- 172.21.15.37:0/870836052 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2c94010430 con 0x7f2ca81073e0 2024-08-20T05:08:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.215+0000 7f2ca6000640 1 --2- 172.21.15.37:0/870836052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2c900b3bd0 0x7f2c900b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.215+0000 7f2ca6000640 1 -- 172.21.15.37:0/870836052 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2c940e4770 con 0x7f2ca81073e0 2024-08-20T05:08:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.216+0000 7f2cadc00640 1 --2- 172.21.15.37:0/870836052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2c900b3bd0 0x7f2c900b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.216+0000 7f2cadc00640 1 --2- 172.21.15.37:0/870836052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2c900b3bd0 0x7f2c900b6090 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c0096c0 tx=0x7f2c9c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:05.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.216+0000 7f2ca6000640 1 -- 172.21.15.37:0/870836052 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f2c940ab370 con 0x7f2ca81073e0 2024-08-20T05:08:05.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.450+0000 7f2cb0600640 1 -- 172.21.15.37:0/870836052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ca81a7f50 con 0x7f2ca81073e0 2024-08-20T05:08:05.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.451+0000 7f2ca6000640 1 -- 172.21.15.37:0/870836052 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11980 (secure 0 0 0) 0x7f2c940af8c0 con 0x7f2ca81073e0 2024-08-20T05:08:05.453 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:08:05.453 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"btime":"2024-08-20T05:06:06:678364+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:06:06.276613+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:08:05.453 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 36 2024-08-20T05:08:05.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.453+0000 7f2cb0600640 1 -- 172.21.15.37:0/870836052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2c900b3bd0 msgr2=0x7f2c900b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:05.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.453+0000 7f2cb0600640 1 --2- 172.21.15.37:0/870836052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2c900b3bd0 0x7f2c900b6090 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c0096c0 tx=0x7f2c9c005a20 comp rx=0 tx=0).stop 2024-08-20T05:08:05.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.453+0000 7f2cb0600640 1 -- 172.21.15.37:0/870836052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca81073e0 msgr2=0x7f2ca819b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:05.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.453+0000 7f2cb0600640 1 --2- 172.21.15.37:0/870836052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca81073e0 0x7f2ca819b6f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2c9400e9f0 tx=0x7f2c9400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.453+0000 7f2cb0600640 1 -- 172.21.15.37:0/870836052 shutdown_connections 2024-08-20T05:08:05.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.453+0000 7f2cb0600640 1 --2- 172.21.15.37:0/870836052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2c900b3bd0 0x7f2c900b6090 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.453+0000 7f2cb0600640 1 --2- 172.21.15.37:0/870836052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2ca8107d60 0x7f2ca81a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.453+0000 7f2cb0600640 1 --2- 172.21.15.37:0/870836052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca81073e0 0x7f2ca819b6f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.453+0000 7f2cb0600640 1 --2- 172.21.15.37:0/870836052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2ca81019d0 0x7f2ca819b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:05.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.453+0000 7f2cb0600640 1 -- 172.21.15.37:0/870836052 >> 172.21.15.37:0/870836052 conn(0x7f2ca80fd440 msgr2=0x7f2ca80feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:05.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.454+0000 7f2cb0600640 1 -- 172.21.15.37:0/870836052 shutdown_connections 2024-08-20T05:08:05.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:05.454+0000 7f2cb0600640 1 -- 172.21.15.37:0/870836052 wait complete. 2024-08-20T05:08:05.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:05 smithi037 ceph-mon[17265]: pgmap v576: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 340 op/s 2024-08-20T05:08:05.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:05 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/870836052' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:08:05.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:05 smithi135 ceph-mon[22342]: pgmap v576: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 340 op/s 2024-08-20T05:08:05.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:05 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/870836052' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:08:05.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:05 smithi130 ceph-mon[22007]: pgmap v576: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 340 op/s 2024-08-20T05:08:05.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:05 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/870836052' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:08:06.328 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T05:08:06.727 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:08:07.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:07 smithi135 ceph-mon[22342]: pgmap v577: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 272 op/s 2024-08-20T05:08:07.898 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:07 smithi037 ceph-mon[17265]: pgmap v577: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 272 op/s 2024-08-20T05:08:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:07 smithi130 ceph-mon[22007]: pgmap v577: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 6.4 MiB/s wr, 272 op/s 2024-08-20T05:08:08.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 310.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:08:08.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.314+0000 7f413d200640 1 -- 172.21.15.37:0/3817403883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4138077d20 msgr2=0x7f4138113160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:08.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.314+0000 7f413d200640 1 --2- 172.21.15.37:0/3817403883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4138077d20 0x7f4138113160 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4124009860 tx=0x7f412402a340 comp rx=0 tx=0).stop 2024-08-20T05:08:08.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.314+0000 7f413d200640 1 -- 172.21.15.37:0/3817403883 shutdown_connections 2024-08-20T05:08:08.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.314+0000 7f413d200640 1 --2- 172.21.15.37:0/3817403883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41381136a0 0x7f4138115a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.314+0000 7f413d200640 1 --2- 172.21.15.37:0/3817403883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4138077d20 0x7f4138113160 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.314+0000 7f413d200640 1 --2- 172.21.15.37:0/3817403883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4138077400 0x7f41380777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.314+0000 7f413d200640 1 -- 172.21.15.37:0/3817403883 >> 172.21.15.37:0/3817403883 conn(0x7f4138100720 msgr2=0x7f4138102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:08.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.314+0000 7f413d200640 1 -- 172.21.15.37:0/3817403883 shutdown_connections 2024-08-20T05:08:08.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.314+0000 7f413d200640 1 -- 172.21.15.37:0/3817403883 wait complete. 2024-08-20T05:08:08.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.315+0000 7f413d200640 1 Processor -- start 2024-08-20T05:08:08.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.315+0000 7f413d200640 1 -- start start 2024-08-20T05:08:08.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.316+0000 7f413d200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4138077400 0x7f413819f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.316+0000 7f413d200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4138077d20 0x7f413819fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.316+0000 7f413d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41381136a0 0x7f41381a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.316+0000 7f413d200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f41381190a0 con 0x7f41381136a0 2024-08-20T05:08:08.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.316+0000 7f413d200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4138118f20 con 0x7f4138077400 2024-08-20T05:08:08.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.316+0000 7f413d200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4138119220 con 0x7f4138077d20 2024-08-20T05:08:08.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.316+0000 7f4136800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41381136a0 0x7f41381a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.316+0000 7f4135e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4138077400 0x7f413819f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.316+0000 7f4136800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41381136a0 0x7f41381a4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55088/0 (socket says 172.21.15.37:55088) 2024-08-20T05:08:08.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.316+0000 7f4136800640 1 -- 172.21.15.37:0/3642067758 learned_addr learned my addr 172.21.15.37:0/3642067758 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:08.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.316+0000 7f4135400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4138077d20 0x7f413819fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.316+0000 7f4136800640 1 -- 172.21.15.37:0/3642067758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4138077d20 msgr2=0x7f413819fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:08.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.316+0000 7f4136800640 1 --2- 172.21.15.37:0/3642067758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4138077d20 0x7f413819fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.316+0000 7f4136800640 1 -- 172.21.15.37:0/3642067758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4138077400 msgr2=0x7f413819f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:08.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.316+0000 7f4136800640 1 --2- 172.21.15.37:0/3642067758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4138077400 0x7f413819f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.317+0000 7f4136800640 1 -- 172.21.15.37:0/3642067758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41381a5640 con 0x7f41381136a0 2024-08-20T05:08:08.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.317+0000 7f4135e00640 1 --2- 172.21.15.37:0/3642067758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4138077400 0x7f413819f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:08.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.317+0000 7f4136800640 1 --2- 172.21.15.37:0/3642067758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41381136a0 0x7f41381a4e70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f413000c3f0 tx=0x7f413000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:08.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.317+0000 7f412ea00640 1 -- 172.21.15.37:0/3642067758 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130003970 con 0x7f41381136a0 2024-08-20T05:08:08.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.317+0000 7f412ea00640 1 -- 172.21.15.37:0/3642067758 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f413000b690 con 0x7f41381136a0 2024-08-20T05:08:08.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.317+0000 7f412ea00640 1 -- 172.21.15.37:0/3642067758 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130004380 con 0x7f41381136a0 2024-08-20T05:08:08.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.317+0000 7f413d200640 1 -- 172.21.15.37:0/3642067758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41381a5930 con 0x7f41381136a0 2024-08-20T05:08:08.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.317+0000 7f413d200640 1 -- 172.21.15.37:0/3642067758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41381abff0 con 0x7f41381136a0 2024-08-20T05:08:08.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.320+0000 7f413fc4f740 1 Processor -- start 2024-08-20T05:08:08.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.321+0000 7f412ea00640 1 -- 172.21.15.37:0/3642067758 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f413001d020 con 0x7f41381136a0 2024-08-20T05:08:08.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.321+0000 7f413fc4f740 1 -- start start 2024-08-20T05:08:08.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.321+0000 7f413fc4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb80c940 0x55b9eb80cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.322+0000 7f413fc4f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80d260 0x55b9eb818cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.322+0000 7f413fc4f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 0x55b9eb81b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.322+0000 7f413fc4f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b9eb782aa0 con 0x55b9eb8191f0 2024-08-20T05:08:08.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.322+0000 7f413fc4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b9eb771fa0 con 0x55b9eb80c940 2024-08-20T05:08:08.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.322+0000 7f413fc4f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b9eb775fe0 con 0x55b9eb80d260 2024-08-20T05:08:08.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.322+0000 7f4135400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 0x55b9eb81b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.322+0000 7f4135e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80d260 0x55b9eb818cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.322+0000 7f4135e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80d260 0x55b9eb818cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:56644/0 (socket says 172.21.15.37:56644) 2024-08-20T05:08:08.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.322+0000 7f4135e00640 1 -- 172.21.15.37:0/2356789884 learned_addr learned my addr 172.21.15.37:0/2356789884 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:08.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.322+0000 7f4135400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 0x55b9eb81b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55096/0 (socket says 172.21.15.37:55096) 2024-08-20T05:08:08.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.322+0000 7f4135400640 1 --2- 172.21.15.37:0/2356789884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb80c940 0x55b9eb80cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.322+0000 7f4135400640 1 -- 172.21.15.37:0/2356789884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80d260 msgr2=0x55b9eb818cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:08.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.323+0000 7f4135400640 1 --2- 172.21.15.37:0/2356789884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80d260 0x55b9eb818cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.323+0000 7f4135400640 1 -- 172.21.15.37:0/2356789884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb80c940 msgr2=0x55b9eb80cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:08.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.323+0000 7f4135400640 1 --2- 172.21.15.37:0/2356789884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb80c940 0x55b9eb80cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.323+0000 7f4135400640 1 -- 172.21.15.37:0/2356789884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9eb718420 con 0x55b9eb8191f0 2024-08-20T05:08:08.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.323+0000 7f4135e00640 1 --2- 172.21.15.37:0/2356789884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80d260 0x55b9eb818cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:08.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.323+0000 7f4135400640 1 --2- 172.21.15.37:0/2356789884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 0x55b9eb81b5e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4124035040 tx=0x7f4124000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10b865b731819af server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:08.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.323+0000 7f4123400640 1 -- 172.21.15.37:0/2356789884 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4124037040 con 0x55b9eb8191f0 2024-08-20T05:08:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.323+0000 7f4123400640 1 -- 172.21.15.37:0/2356789884 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4124030450 con 0x55b9eb8191f0 2024-08-20T05:08:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.323+0000 7f4123400640 1 -- 172.21.15.37:0/2356789884 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4124003850 con 0x55b9eb8191f0 2024-08-20T05:08:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.323+0000 7f412ea00640 1 --2- 172.21.15.37:0/3642067758 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f411c0b3c50 0x7f411c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.324+0000 7f412ea00640 1 -- 172.21.15.37:0/3642067758 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f41300e3d70 con 0x7f41381136a0 2024-08-20T05:08:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.324+0000 7f4135e00640 1 --2- 172.21.15.37:0/3642067758 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f411c0b3c50 0x7f411c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.324+0000 7f413fc4f740 1 -- 172.21.15.37:0/2356789884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 msgr2=0x55b9eb81b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.324+0000 7f413fc4f740 1 --2- 172.21.15.37:0/2356789884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 0x55b9eb81b5e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4124035040 tx=0x7f4124000bc0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.324+0000 7f413fc4f740 1 -- 172.21.15.37:0/2356789884 shutdown_connections 2024-08-20T05:08:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.324+0000 7f413fc4f740 1 --2- 172.21.15.37:0/2356789884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 0x55b9eb81b5e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.324+0000 7f413fc4f740 1 --2- 172.21.15.37:0/2356789884 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80d260 0x55b9eb818cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.324+0000 7f413fc4f740 1 --2- 172.21.15.37:0/2356789884 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb80c940 0x55b9eb80cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.324+0000 7f413fc4f740 1 -- 172.21.15.37:0/2356789884 >> 172.21.15.37:0/2356789884 conn(0x55b9eb80a770 msgr2=0x55b9eb80b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.324+0000 7f413fc4f740 1 -- 172.21.15.37:0/2356789884 shutdown_connections 2024-08-20T05:08:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.324+0000 7f413fc4f740 1 -- 172.21.15.37:0/2356789884 wait complete. 2024-08-20T05:08:08.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.325+0000 7f4135e00640 1 --2- 172.21.15.37:0/3642067758 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f411c0b3c50 0x7f411c0b6110 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55b9eb80b650 tx=0x7f4128005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:08.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.325+0000 7f413fc4f740 1 -- start start 2024-08-20T05:08:08.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.325+0000 7f413fc4f740 1 Processor -- start 2024-08-20T05:08:08.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.325+0000 7f413fc4f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 0x55b9eb818aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.325+0000 7f413fc4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb80d260 0x55b9eb815ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.326+0000 7f413fc4f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 0x55b9eb8164b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.326+0000 7f413fc4f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b9eb5d4700 con 0x55b9eb8191f0 2024-08-20T05:08:08.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.326+0000 7f413fc4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b9eb70d290 con 0x55b9eb80d260 2024-08-20T05:08:08.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.326+0000 7f413fc4f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b9eb81be10 con 0x55b9eb80c940 2024-08-20T05:08:08.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.326+0000 7f413fc4f740 10 client.0 _ll_register_callbacks cb 0x55b9eb76c1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:08.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.326+0000 7f4136800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 0x55b9eb8164b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.326+0000 7f4135400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb80d260 0x55b9eb815ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.326+0000 7f4136800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 0x55b9eb8164b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55108/0 (socket says 172.21.15.37:55108) 2024-08-20T05:08:08.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.326+0000 7f4136800640 1 -- 172.21.15.37:0/765744848 learned_addr learned my addr 172.21.15.37:0/765744848 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.326+0000 7f4135e00640 1 --2- 172.21.15.37:0/765744848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 0x55b9eb818aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.326+0000 7f4135400640 1 -- 172.21.15.37:0/765744848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 msgr2=0x55b9eb818aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.326+0000 7f4135400640 1 --2- 172.21.15.37:0/765744848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 0x55b9eb818aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.326+0000 7f4135400640 1 -- 172.21.15.37:0/765744848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 msgr2=0x55b9eb8164b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.326+0000 7f4135400640 1 --2- 172.21.15.37:0/765744848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 0x55b9eb8164b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.326+0000 7f4135400640 1 -- 172.21.15.37:0/765744848 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9eb4d1650 con 0x55b9eb80d260 2024-08-20T05:08:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.326+0000 7f4136800640 1 --2- 172.21.15.37:0/765744848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 0x55b9eb8164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.327+0000 7f4135400640 1 --2- 172.21.15.37:0/765744848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb80d260 0x55b9eb815ef0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4124009780 tx=0x7f4124005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eeb056813b51f9c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.327+0000 7f4117e00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:08:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.327+0000 7f4117e00640 1 -- 172.21.15.37:0/765744848 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4124050060 con 0x55b9eb80d260 2024-08-20T05:08:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.327+0000 7f413fc4f740 1 -- 172.21.15.37:0/765744848 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4124030450 con 0x55b9eb80d260 2024-08-20T05:08:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.327+0000 7f4117e00640 1 -- 172.21.15.37:0/765744848 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4124030800 con 0x55b9eb80d260 2024-08-20T05:08:08.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.327+0000 7f4117e00640 1 -- 172.21.15.37:0/765744848 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f4124057050 con 0x55b9eb80d260 2024-08-20T05:08:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.327+0000 7f413fc4f740 10 client.26981 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.327+0000 7f413fc4f740 1 -- 172.21.15.37:0/765744848 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b9eb827700 con 0x55b9eb80d260 2024-08-20T05:08:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.328+0000 7f4117e00640 1 -- 172.21.15.37:0/765744848 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4124030450 con 0x55b9eb80d260 2024-08-20T05:08:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.328+0000 7f4117e00640 1 -- 172.21.15.37:0/765744848 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f4124048070 con 0x55b9eb80d260 2024-08-20T05:08:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.328+0000 7f413fc4f740 10 client.26981 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.328+0000 7f413fc4f740 10 client.26981 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:08:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.328+0000 7f413fc4f740 20 client.26981 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.328+0000 7f413fc4f740 1 --2- 172.21.15.37:0/765744848 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55b9eb828a50 0x55b9eb82ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.328+0000 7f413fc4f740 4 client.26981 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:08:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.328+0000 7f413fc4f740 1 -- 172.21.15.37:0/765744848 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9eb7849f0 con 0x55b9eb828a50 2024-08-20T05:08:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.329+0000 7f4135e00640 1 --2- 172.21.15.37:0/765744848 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55b9eb828a50 0x55b9eb82ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.329+0000 7f4135e00640 1 --2- 172.21.15.37:0/765744848 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55b9eb828a50 0x55b9eb82ae40 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a9b61dd93fed66ff server_cookie=f867a79558bbc2a7 in_seq=0 out_seq=0 2024-08-20T05:08:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.329+0000 7f4117e00640 10 client.26981 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:08:08.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.330+0000 7f4117e00640 1 -- 172.21.15.37:0/765744848 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9eb7849f0 con 0x55b9eb828a50 2024-08-20T05:08:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.330+0000 7f4117e00640 10 client.26981 handle_command_reply: tid=0 2024-08-20T05:08:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.330+0000 7f413fc4f740 1 client.26981 shutdown 2024-08-20T05:08:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.331+0000 7f413fc4f740 1 -- 172.21.15.37:0/765744848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb80d260 msgr2=0x55b9eb815ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.331+0000 7f413fc4f740 1 --2- 172.21.15.37:0/765744848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb80d260 0x55b9eb815ef0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4124009780 tx=0x7f4124005f90 comp rx=0 tx=0).stop 2024-08-20T05:08:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.331+0000 7f413fc4f740 1 -- 172.21.15.37:0/765744848 shutdown_connections 2024-08-20T05:08:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.331+0000 7f413fc4f740 1 --2- 172.21.15.37:0/765744848 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55b9eb828a50 0x55b9eb82ae40 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.331+0000 7f413fc4f740 1 --2- 172.21.15.37:0/765744848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 0x55b9eb8164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.331+0000 7f413fc4f740 1 --2- 172.21.15.37:0/765744848 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb80d260 0x55b9eb815ef0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.331+0000 7f4117e00640 0 client.26981 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:08:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.331+0000 7f413fc4f740 1 --2- 172.21.15.37:0/765744848 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 0x55b9eb818aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.331+0000 7f413fc4f740 1 -- 172.21.15.37:0/765744848 >> 172.21.15.37:0/765744848 conn(0x55b9eb80a770 msgr2=0x55b9eb8102e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.331+0000 7f413fc4f740 1 -- 172.21.15.37:0/765744848 shutdown_connections 2024-08-20T05:08:08.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.331+0000 7f413fc4f740 1 -- 172.21.15.37:0/765744848 wait complete. 2024-08-20T05:08:08.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.331+0000 7f413fc4f740 20 client.26981 trim_cache size 0 max 16384 2024-08-20T05:08:08.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.351+0000 7f413fc4f740 1 Processor -- start 2024-08-20T05:08:08.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.351+0000 7f413fc4f740 1 -- start start 2024-08-20T05:08:08.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.352+0000 7f413fc4f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 0x55b9eb82de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.352+0000 7f413fc4f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb80d260 0x55b9eb82e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.352+0000 7f413fc4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb8191f0 0x55b9eb813100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.352+0000 7f413fc4f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f41381b5d50 con 0x55b9eb80d260 2024-08-20T05:08:08.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.352+0000 7f413fc4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f41381b7890 con 0x55b9eb8191f0 2024-08-20T05:08:08.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.352+0000 7f413fc4f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f41381b6420 con 0x55b9eb80c940 2024-08-20T05:08:08.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.352+0000 7f4135400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb80d260 0x55b9eb82e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.352+0000 7f4135400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb80d260 0x55b9eb82e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55122/0 (socket says 172.21.15.37:55122) 2024-08-20T05:08:08.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.352+0000 7f4135400640 1 -- 172.21.15.37:0/3895965132 learned_addr learned my addr 172.21.15.37:0/3895965132 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:08.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.352+0000 7f4135e00640 1 --2- 172.21.15.37:0/3895965132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 0x55b9eb82de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.352+0000 7f4136800640 1 --2- 172.21.15.37:0/3895965132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb8191f0 0x55b9eb813100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.352+0000 7f4135400640 1 -- 172.21.15.37:0/3895965132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 msgr2=0x55b9eb82de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.352+0000 7f4135400640 1 --2- 172.21.15.37:0/3895965132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 0x55b9eb82de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.352+0000 7f4135400640 1 -- 172.21.15.37:0/3895965132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb8191f0 msgr2=0x55b9eb813100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.352+0000 7f4135400640 1 --2- 172.21.15.37:0/3895965132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb8191f0 0x55b9eb813100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.353+0000 7f4135400640 1 -- 172.21.15.37:0/3895965132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9eb80a5a0 con 0x55b9eb80d260 2024-08-20T05:08:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.353+0000 7f4135e00640 1 --2- 172.21.15.37:0/3895965132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 0x55b9eb82de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.353+0000 7f4135400640 1 --2- 172.21.15.37:0/3895965132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb80d260 0x55b9eb82e3b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4124032640 tx=0x7f4124000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c5376c9e6091a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.353+0000 7f4122a00640 1 -- 172.21.15.37:0/3895965132 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4124050040 con 0x55b9eb80d260 2024-08-20T05:08:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.353+0000 7f4122a00640 1 -- 172.21.15.37:0/3895965132 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4124009450 con 0x55b9eb80d260 2024-08-20T05:08:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.353+0000 7f4122a00640 1 -- 172.21.15.37:0/3895965132 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4124037040 con 0x55b9eb80d260 2024-08-20T05:08:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.354+0000 7f413fc4f740 1 -- 172.21.15.37:0/3895965132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb80d260 msgr2=0x55b9eb82e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.354+0000 7f413fc4f740 1 --2- 172.21.15.37:0/3895965132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb80d260 0x55b9eb82e3b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f4124032640 tx=0x7f4124000bc0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.354+0000 7f413fc4f740 1 -- 172.21.15.37:0/3895965132 shutdown_connections 2024-08-20T05:08:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.354+0000 7f413fc4f740 1 --2- 172.21.15.37:0/3895965132 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb8191f0 0x55b9eb813100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.354+0000 7f413fc4f740 1 --2- 172.21.15.37:0/3895965132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb80d260 0x55b9eb82e3b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.354+0000 7f413fc4f740 1 --2- 172.21.15.37:0/3895965132 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 0x55b9eb82de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.354+0000 7f413fc4f740 1 -- 172.21.15.37:0/3895965132 >> 172.21.15.37:0/3895965132 conn(0x55b9eb80a770 msgr2=0x55b9eb809850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.354+0000 7f413fc4f740 1 -- 172.21.15.37:0/3895965132 shutdown_connections 2024-08-20T05:08:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.354+0000 7f413fc4f740 1 -- 172.21.15.37:0/3895965132 wait complete. 2024-08-20T05:08:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.354+0000 7f413fc4f740 1 -- start start 2024-08-20T05:08:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.355+0000 7f413fc4f740 1 Processor -- start 2024-08-20T05:08:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.355+0000 7f413fc4f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 0x55b9eb82d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.355+0000 7f413fc4f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb80d260 0x55b9eb82da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.355+0000 7f413fc4f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 0x55b9eb891390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.355+0000 7f413fc4f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f41381b71c0 con 0x55b9eb8191f0 2024-08-20T05:08:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.355+0000 7f413fc4f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f41381b6af0 con 0x55b9eb80d260 2024-08-20T05:08:08.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.355+0000 7f413fc4f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f41381b3d30 con 0x55b9eb80c940 2024-08-20T05:08:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.355+0000 7f413fc4f740 10 client.0 _ll_register_callbacks cb 0x7f4128005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.355+0000 7f4135e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 0x55b9eb82d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.355+0000 7f4136800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 0x55b9eb891390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.355+0000 7f4135e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 0x55b9eb82d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:56676/0 (socket says 172.21.15.37:56676) 2024-08-20T05:08:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.355+0000 7f4135e00640 1 -- 172.21.15.37:0/1628246362 learned_addr learned my addr 172.21.15.37:0/1628246362 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.355+0000 7f4135400640 1 --2- 172.21.15.37:0/1628246362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb80d260 0x55b9eb82da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.356+0000 7f4135e00640 1 -- 172.21.15.37:0/1628246362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb80d260 msgr2=0x55b9eb82da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.356+0000 7f4135e00640 1 --2- 172.21.15.37:0/1628246362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb80d260 0x55b9eb82da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.356+0000 7f4135e00640 1 -- 172.21.15.37:0/1628246362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 msgr2=0x55b9eb891390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.356+0000 7f4135e00640 1 --2- 172.21.15.37:0/1628246362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 0x55b9eb891390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.356+0000 7f4135e00640 1 -- 172.21.15.37:0/1628246362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9eb891a00 con 0x55b9eb80c940 2024-08-20T05:08:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.356+0000 7f4136800640 1 --2- 172.21.15.37:0/1628246362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 0x55b9eb891390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.356+0000 7f4135e00640 1 --2- 172.21.15.37:0/1628246362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 0x55b9eb82d4e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55b9eb81be70 tx=0x7f41280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4352e47ae11b363 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.356+0000 7f4117e00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:08:08.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.356+0000 7f4117e00640 1 -- 172.21.15.37:0/1628246362 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412800fda0 con 0x55b9eb80c940 2024-08-20T05:08:08.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.356+0000 7f413fc4f740 1 -- 172.21.15.37:0/1628246362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4124009450 con 0x55b9eb80c940 2024-08-20T05:08:08.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.357+0000 7f4117e00640 1 -- 172.21.15.37:0/1628246362 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4128003a40 con 0x55b9eb80c940 2024-08-20T05:08:08.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.357+0000 7f4117e00640 1 -- 172.21.15.37:0/1628246362 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f4128003c40 con 0x55b9eb80c940 2024-08-20T05:08:08.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.357+0000 7f413fc4f740 10 client.27013 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:08.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.357+0000 7f413fc4f740 1 -- 172.21.15.37:0/1628246362 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b9eb892d70 con 0x55b9eb80c940 2024-08-20T05:08:08.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.357+0000 7f4117e00640 1 -- 172.21.15.37:0/1628246362 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4124009450 con 0x55b9eb80c940 2024-08-20T05:08:08.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.357+0000 7f4117e00640 1 -- 172.21.15.37:0/1628246362 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f4128004a00 con 0x55b9eb80c940 2024-08-20T05:08:08.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.357+0000 7f413fc4f740 10 client.27013 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:08.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.357+0000 7f413fc4f740 10 client.27013 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:08:08.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.357+0000 7f413fc4f740 20 client.27013 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:08.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.357+0000 7f413fc4f740 1 --2- 172.21.15.37:0/1628246362 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55b9eb8934d0 0x55b9eb8958f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:08.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.357+0000 7f413fc4f740 4 client.27013 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:08:08.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.357+0000 7f413fc4f740 1 -- 172.21.15.37:0/1628246362 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b9eb780490 con 0x55b9eb8934d0 2024-08-20T05:08:08.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.358+0000 7f4135400640 1 --2- 172.21.15.37:0/1628246362 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55b9eb8934d0 0x55b9eb8958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:08.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.358+0000 7f4135400640 1 --2- 172.21.15.37:0/1628246362 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55b9eb8934d0 0x55b9eb8958f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2c8eeb9c03e1a019 server_cookie=1ff867b9dae28c36 in_seq=0 out_seq=0 2024-08-20T05:08:08.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.358+0000 7f4117e00640 10 client.27013 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:08:08.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.358+0000 7f4117e00640 1 -- 172.21.15.37:0/1628246362 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b9eb780490 con 0x55b9eb8934d0 2024-08-20T05:08:08.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.358+0000 7f4117e00640 10 client.27013 handle_command_reply: tid=0 2024-08-20T05:08:08.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.358+0000 7f413fc4f740 1 client.27013 shutdown 2024-08-20T05:08:08.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.359+0000 7f413fc4f740 1 -- 172.21.15.37:0/1628246362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 msgr2=0x55b9eb82d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:08.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.359+0000 7f413fc4f740 1 --2- 172.21.15.37:0/1628246362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 0x55b9eb82d4e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x55b9eb81be70 tx=0x7f41280046c0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.359+0000 7f413fc4f740 1 -- 172.21.15.37:0/1628246362 shutdown_connections 2024-08-20T05:08:08.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.359+0000 7f413fc4f740 1 --2- 172.21.15.37:0/1628246362 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55b9eb8934d0 0x55b9eb8958f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.359+0000 7f413fc4f740 1 --2- 172.21.15.37:0/1628246362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b9eb8191f0 0x55b9eb891390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.359+0000 7f413fc4f740 1 --2- 172.21.15.37:0/1628246362 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b9eb80d260 0x55b9eb82da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.359+0000 7f413fc4f740 1 --2- 172.21.15.37:0/1628246362 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b9eb80c940 0x55b9eb82d4e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.359+0000 7f4117e00640 0 client.27013 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:08:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.359+0000 7f413fc4f740 1 -- 172.21.15.37:0/1628246362 >> 172.21.15.37:0/1628246362 conn(0x55b9eb80a770 msgr2=0x55b9eb814640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.359+0000 7f413fc4f740 1 -- 172.21.15.37:0/1628246362 shutdown_connections 2024-08-20T05:08:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.359+0000 7f413fc4f740 1 -- 172.21.15.37:0/1628246362 wait complete. 2024-08-20T05:08:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.359+0000 7f413fc4f740 20 client.27013 trim_cache size 0 max 16384 2024-08-20T05:08:08.143 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:08:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.359+0000 7f413d200640 1 -- 172.21.15.37:0/3642067758 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f411c0b3c50 msgr2=0x7f411c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.359+0000 7f413d200640 1 --2- 172.21.15.37:0/3642067758 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f411c0b3c50 0x7f411c0b6110 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55b9eb80b650 tx=0x7f4128005f90 comp rx=0 tx=0).stop 2024-08-20T05:08:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.359+0000 7f413d200640 1 -- 172.21.15.37:0/3642067758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41381136a0 msgr2=0x7f41381a4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.359+0000 7f413d200640 1 --2- 172.21.15.37:0/3642067758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41381136a0 0x7f41381a4e70 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f413000c3f0 tx=0x7f413000c8b0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.360+0000 7f413d200640 1 -- 172.21.15.37:0/3642067758 shutdown_connections 2024-08-20T05:08:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.360+0000 7f413d200640 1 --2- 172.21.15.37:0/3642067758 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f411c0b3c50 0x7f411c0b6110 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.360+0000 7f413d200640 1 --2- 172.21.15.37:0/3642067758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41381136a0 0x7f41381a4e70 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.360+0000 7f413d200640 1 --2- 172.21.15.37:0/3642067758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4138077d20 0x7f413819fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.360+0000 7f413d200640 1 --2- 172.21.15.37:0/3642067758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4138077400 0x7f413819f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.360+0000 7f413d200640 1 -- 172.21.15.37:0/3642067758 >> 172.21.15.37:0/3642067758 conn(0x7f4138100720 msgr2=0x7f4138102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.360+0000 7f413d200640 1 -- 172.21.15.37:0/3642067758 shutdown_connections 2024-08-20T05:08:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:07.360+0000 7f413d200640 1 -- 172.21.15.37:0/3642067758 wait complete. 2024-08-20T05:08:09.477 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T05:08:09.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:09 smithi037 ceph-mon[17265]: pgmap v578: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.6 MiB/s wr, 128 op/s 2024-08-20T05:08:09.859 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:08:09.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:09 smithi135 ceph-mon[22342]: pgmap v578: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.6 MiB/s wr, 128 op/s 2024-08-20T05:08:09.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:09 smithi130 ceph-mon[22007]: pgmap v578: 129 pgs: 129 active+clean; 1.1 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.6 MiB/s wr, 128 op/s 2024-08-20T05:08:10.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.430+0000 7f5c41200640 1 -- 172.21.15.37:0/131059515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c113680 msgr2=0x7f5c3c115a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:10.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.430+0000 7f5c41200640 1 --2- 172.21.15.37:0/131059515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c113680 0x7f5c3c115a70 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009ca0 tx=0x7f5c3402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.430+0000 7f5c41200640 1 -- 172.21.15.37:0/131059515 shutdown_connections 2024-08-20T05:08:10.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.430+0000 7f5c41200640 1 --2- 172.21.15.37:0/131059515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c113680 0x7f5c3c115a70 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.430+0000 7f5c41200640 1 --2- 172.21.15.37:0/131059515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c3c077d20 0x7f5c3c113140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.430+0000 7f5c41200640 1 --2- 172.21.15.37:0/131059515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c3c077400 0x7f5c3c0777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.430+0000 7f5c41200640 1 -- 172.21.15.37:0/131059515 >> 172.21.15.37:0/131059515 conn(0x7f5c3c1006c0 msgr2=0x7f5c3c102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:10.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.430+0000 7f5c41200640 1 -- 172.21.15.37:0/131059515 shutdown_connections 2024-08-20T05:08:10.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.430+0000 7f5c41200640 1 -- 172.21.15.37:0/131059515 wait complete. 2024-08-20T05:08:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.431+0000 7f5c41200640 1 Processor -- start 2024-08-20T05:08:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.431+0000 7f5c41200640 1 -- start start 2024-08-20T05:08:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.431+0000 7f5c41200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c3c077400 0x7f5c3c19f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.431+0000 7f5c41200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c077d20 0x7f5c3c19fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.431+0000 7f5c41200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c3c113680 0x7f5c3c1a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.431+0000 7f5c41200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c119050 con 0x7f5c3c077d20 2024-08-20T05:08:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.431+0000 7f5c41200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c118ed0 con 0x7f5c3c113680 2024-08-20T05:08:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.431+0000 7f5c41200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c1191d0 con 0x7f5c3c077400 2024-08-20T05:08:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.431+0000 7f5c39e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c3c077400 0x7f5c3c19f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.432+0000 7f5c39e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c3c077400 0x7f5c3c19f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:56692/0 (socket says 172.21.15.37:56692) 2024-08-20T05:08:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.432+0000 7f5c31400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c077d20 0x7f5c3c19fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.432+0000 7f5c39e00640 1 -- 172.21.15.37:0/1455122646 learned_addr learned my addr 172.21.15.37:0/1455122646 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.432+0000 7f5c3a800640 1 --2- 172.21.15.37:0/1455122646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c3c113680 0x7f5c3c1a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.432+0000 7f5c39e00640 1 -- 172.21.15.37:0/1455122646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c3c113680 msgr2=0x7f5c3c1a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.432+0000 7f5c39e00640 1 --2- 172.21.15.37:0/1455122646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c3c113680 0x7f5c3c1a4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.432+0000 7f5c39e00640 1 -- 172.21.15.37:0/1455122646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c077d20 msgr2=0x7f5c3c19fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.432+0000 7f5c39e00640 1 --2- 172.21.15.37:0/1455122646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c077d20 0x7f5c3c19fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.432+0000 7f5c39e00640 1 -- 172.21.15.37:0/1455122646 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c1a5670 con 0x7f5c3c077400 2024-08-20T05:08:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.432+0000 7f5c31400640 1 --2- 172.21.15.37:0/1455122646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c077d20 0x7f5c3c19fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.432+0000 7f5c39e00640 1 --2- 172.21.15.37:0/1455122646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c3c077400 0x7f5c3c19f5c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00e9f0 tx=0x7f5c2c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.433+0000 7f5c33400640 1 -- 172.21.15.37:0/1455122646 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c00cd80 con 0x7f5c3c077400 2024-08-20T05:08:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.433+0000 7f5c33400640 1 -- 172.21.15.37:0/1455122646 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c2c0108e0 con 0x7f5c3c077400 2024-08-20T05:08:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.433+0000 7f5c33400640 1 -- 172.21.15.37:0/1455122646 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c018980 con 0x7f5c3c077400 2024-08-20T05:08:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.433+0000 7f5c41200640 1 -- 172.21.15.37:0/1455122646 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c3c1a5960 con 0x7f5c3c077400 2024-08-20T05:08:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.433+0000 7f5c41200640 1 -- 172.21.15.37:0/1455122646 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c3c1ac020 con 0x7f5c3c077400 2024-08-20T05:08:10.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.436+0000 7f5c43e90740 1 Processor -- start 2024-08-20T05:08:10.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.436+0000 7f5c43e90740 1 -- start start 2024-08-20T05:08:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.436+0000 7f5c43e90740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869948d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.436+0000 7f5c43e90740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562869949260 0x562869954cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.436+0000 7f5c43e90740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628699551f0 0x5628699575e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.436+0000 7f5c43e90740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5628698beaa0 con 0x562869948940 2024-08-20T05:08:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.436+0000 7f5c43e90740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5628698adfa0 con 0x562869949260 2024-08-20T05:08:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.436+0000 7f5c43e90740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5628698b1fe0 con 0x5628699551f0 2024-08-20T05:08:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.437+0000 7f5c3a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869948d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:10.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.437+0000 7f5c3a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869948d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55172/0 (socket says 172.21.15.37:55172) 2024-08-20T05:08:10.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.437+0000 7f5c3a800640 1 -- 172.21.15.37:0/1524824330 learned_addr learned my addr 172.21.15.37:0/1524824330 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:10.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.437+0000 7f5c31400640 1 --2- 172.21.15.37:0/1524824330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628699551f0 0x5628699575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:10.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.437+0000 7f5c33400640 1 -- 172.21.15.37:0/1455122646 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5c2c010430 con 0x7f5c3c077400 2024-08-20T05:08:10.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.437+0000 7f5c3a800640 1 -- 172.21.15.37:0/1524824330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628699551f0 msgr2=0x5628699575e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:10.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.437+0000 7f5c3a800640 1 --2- 172.21.15.37:0/1524824330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628699551f0 0x5628699575e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.437+0000 7f5c3a800640 1 -- 172.21.15.37:0/1524824330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562869949260 msgr2=0x562869954cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:08:10.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.437+0000 7f5c3a800640 1 --2- 172.21.15.37:0/1524824330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562869949260 0x562869954cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.437+0000 7f5c3a800640 1 -- 172.21.15.37:0/1524824330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562869854420 con 0x562869948940 2024-08-20T05:08:10.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.438+0000 7f5c3a800640 1 --2- 172.21.15.37:0/1524824330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869948d20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5c34035000 tx=0x7f5c34005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a439b16cffdd2d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:10.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.438+0000 7f5c2b400640 1 -- 172.21.15.37:0/1524824330 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c34031cf0 con 0x562869948940 2024-08-20T05:08:10.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.438+0000 7f5c2b400640 1 -- 172.21.15.37:0/1524824330 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c34036030 con 0x562869948940 2024-08-20T05:08:10.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.438+0000 7f5c2b400640 1 -- 172.21.15.37:0/1524824330 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c340042a0 con 0x562869948940 2024-08-20T05:08:10.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.439+0000 7f5c43e90740 1 -- 172.21.15.37:0/1524824330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 msgr2=0x562869948d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:10.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.439+0000 7f5c43e90740 1 --2- 172.21.15.37:0/1524824330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869948d20 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5c34035000 tx=0x7f5c34005fa0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.439+0000 7f5c43e90740 1 -- 172.21.15.37:0/1524824330 shutdown_connections 2024-08-20T05:08:10.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.439+0000 7f5c43e90740 1 --2- 172.21.15.37:0/1524824330 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628699551f0 0x5628699575e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.439+0000 7f5c43e90740 1 --2- 172.21.15.37:0/1524824330 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562869949260 0x562869954cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.439+0000 7f5c43e90740 1 --2- 172.21.15.37:0/1524824330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869948d20 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.439+0000 7f5c43e90740 1 -- 172.21.15.37:0/1524824330 >> 172.21.15.37:0/1524824330 conn(0x562869946770 msgr2=0x562869947910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.439+0000 7f5c33400640 1 --2- 172.21.15.37:0/1455122646 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5c200b3c50 0x7f5c200b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.439+0000 7f5c43e90740 1 -- 172.21.15.37:0/1524824330 shutdown_connections 2024-08-20T05:08:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.439+0000 7f5c33400640 1 -- 172.21.15.37:0/1455122646 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5c2c0e4290 con 0x7f5c3c077400 2024-08-20T05:08:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.439+0000 7f5c31400640 1 --2- 172.21.15.37:0/1455122646 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5c200b3c50 0x7f5c200b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.439+0000 7f5c43e90740 1 -- 172.21.15.37:0/1524824330 wait complete. 2024-08-20T05:08:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.440+0000 7f5c43e90740 1 -- start start 2024-08-20T05:08:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.440+0000 7f5c43e90740 1 Processor -- start 2024-08-20T05:08:10.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.440+0000 7f5c31400640 1 --2- 172.21.15.37:0/1455122646 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5c200b3c50 0x7f5c200b6110 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c115ae0 tx=0x7f5c2400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:10.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.440+0000 7f5c43e90740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869954a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.440+0000 7f5c43e90740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562869949260 0x562869951ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.440+0000 7f5c43e90740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628699551f0 0x562869952470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.440+0000 7f5c43e90740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562869710700 con 0x562869948940 2024-08-20T05:08:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.440+0000 7f5c43e90740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562869849290 con 0x5628699551f0 2024-08-20T05:08:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.440+0000 7f5c43e90740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562869957c90 con 0x562869949260 2024-08-20T05:08:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.441+0000 7f5c39e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869954a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.441+0000 7f5c43e90740 10 client.0 _ll_register_callbacks cb 0x5628698a81c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.441+0000 7f5c39e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869954a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55186/0 (socket says 172.21.15.37:55186) 2024-08-20T05:08:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.441+0000 7f5c39e00640 1 -- 172.21.15.37:0/1919119601 learned_addr learned my addr 172.21.15.37:0/1919119601 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.441+0000 7f5c31400640 1 --2- 172.21.15.37:0/1919119601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562869949260 0x562869951ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.441+0000 7f5c3a800640 1 --2- 172.21.15.37:0/1919119601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628699551f0 0x562869952470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.441+0000 7f5c39e00640 1 -- 172.21.15.37:0/1919119601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562869949260 msgr2=0x562869951ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.441+0000 7f5c39e00640 1 --2- 172.21.15.37:0/1919119601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562869949260 0x562869951ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.441+0000 7f5c39e00640 1 -- 172.21.15.37:0/1919119601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628699551f0 msgr2=0x562869952470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.441+0000 7f5c39e00640 1 --2- 172.21.15.37:0/1919119601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628699551f0 0x562869952470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.441+0000 7f5c39e00640 1 -- 172.21.15.37:0/1919119601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56286960d650 con 0x562869948940 2024-08-20T05:08:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.442+0000 7f5c39e00640 1 --2- 172.21.15.37:0/1919119601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869954a80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00e9c0 tx=0x7f5c2c010720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa5055a5773ad6e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.442+0000 7f5c1fe00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:08:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.442+0000 7f5c1fe00640 1 -- 172.21.15.37:0/1919119601 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c0af3e0 con 0x562869948940 2024-08-20T05:08:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.442+0000 7f5c1fe00640 1 -- 172.21.15.37:0/1919119601 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5c2c0aa0f0 con 0x562869948940 2024-08-20T05:08:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.442+0000 7f5c43e90740 1 -- 172.21.15.37:0/1919119601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c34036030 con 0x562869948940 2024-08-20T05:08:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.442+0000 7f5c1fe00640 1 -- 172.21.15.37:0/1919119601 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5c2c0b3e90 con 0x562869948940 2024-08-20T05:08:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.442+0000 7f5c43e90740 10 client.16695 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.442+0000 7f5c43e90740 1 -- 172.21.15.37:0/1919119601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5628699635c0 con 0x562869948940 2024-08-20T05:08:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.442+0000 7f5c1fe00640 1 -- 172.21.15.37:0/1919119601 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c34036030 con 0x562869948940 2024-08-20T05:08:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.443+0000 7f5c1fe00640 1 -- 172.21.15.37:0/1919119601 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f5c2c0a9b60 con 0x562869948940 2024-08-20T05:08:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.443+0000 7f5c43e90740 10 client.16695 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.443+0000 7f5c43e90740 10 client.16695 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:08:10.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.443+0000 7f5c43e90740 20 client.16695 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:10.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.443+0000 7f5c43e90740 1 --2- 172.21.15.37:0/1919119601 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x562869964a80 0x562869966e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.443+0000 7f5c43e90740 4 client.16695 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:08:10.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.443+0000 7f5c43e90740 1 -- 172.21.15.37:0/1919119601 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628698c09f0 con 0x562869964a80 2024-08-20T05:08:10.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.443+0000 7f5c31400640 1 --2- 172.21.15.37:0/1919119601 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x562869964a80 0x562869966e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.444+0000 7f5c31400640 1 --2- 172.21.15.37:0/1919119601 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x562869964a80 0x562869966e70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1a8f3fbcfb068087 server_cookie=80ba4a6009eaef56 in_seq=0 out_seq=0 2024-08-20T05:08:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.444+0000 7f5c1fe00640 10 client.16695 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:08:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.444+0000 7f5c1fe00640 1 -- 172.21.15.37:0/1919119601 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628698c09f0 con 0x562869964a80 2024-08-20T05:08:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.444+0000 7f5c1fe00640 10 client.16695 handle_command_reply: tid=0 2024-08-20T05:08:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.445+0000 7f5c43e90740 1 client.16695 shutdown 2024-08-20T05:08:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.445+0000 7f5c43e90740 1 -- 172.21.15.37:0/1919119601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 msgr2=0x562869954a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.445+0000 7f5c43e90740 1 --2- 172.21.15.37:0/1919119601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869954a80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00e9c0 tx=0x7f5c2c010720 comp rx=0 tx=0).stop 2024-08-20T05:08:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.445+0000 7f5c43e90740 1 -- 172.21.15.37:0/1919119601 shutdown_connections 2024-08-20T05:08:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.445+0000 7f5c43e90740 1 --2- 172.21.15.37:0/1919119601 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x562869964a80 0x562869966e70 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.445+0000 7f5c43e90740 1 --2- 172.21.15.37:0/1919119601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628699551f0 0x562869952470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.445+0000 7f5c43e90740 1 --2- 172.21.15.37:0/1919119601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562869949260 0x562869951ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.445+0000 7f5c43e90740 1 --2- 172.21.15.37:0/1919119601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869954a80 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.445+0000 7f5c43e90740 1 -- 172.21.15.37:0/1919119601 >> 172.21.15.37:0/1919119601 conn(0x562869946770 msgr2=0x56286994c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:10.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.445+0000 7f5c1fe00640 0 client.16695 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:08:10.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.445+0000 7f5c43e90740 1 -- 172.21.15.37:0/1919119601 shutdown_connections 2024-08-20T05:08:10.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.445+0000 7f5c43e90740 1 -- 172.21.15.37:0/1919119601 wait complete. 2024-08-20T05:08:10.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.445+0000 7f5c43e90740 20 client.16695 trim_cache size 0 max 16384 2024-08-20T05:08:10.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.459+0000 7f5c43e90740 1 Processor -- start 2024-08-20T05:08:10.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.459+0000 7f5c43e90740 1 -- start start 2024-08-20T05:08:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.460+0000 7f5c43e90740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869950e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.460+0000 7f5c43e90740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562869949260 0x5628699513a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.460+0000 7f5c43e90740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628699551f0 0x56286996c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.460+0000 7f5c43e90740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c1b5d10 con 0x562869948940 2024-08-20T05:08:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.460+0000 7f5c43e90740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c1b7850 con 0x562869949260 2024-08-20T05:08:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.460+0000 7f5c43e90740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c1b63e0 con 0x5628699551f0 2024-08-20T05:08:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.460+0000 7f5c39e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869950e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.460+0000 7f5c39e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869950e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55200/0 (socket says 172.21.15.37:55200) 2024-08-20T05:08:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.460+0000 7f5c39e00640 1 -- 172.21.15.37:0/4151511028 learned_addr learned my addr 172.21.15.37:0/4151511028 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.460+0000 7f5c31400640 1 --2- 172.21.15.37:0/4151511028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562869949260 0x5628699513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.460+0000 7f5c3a800640 1 --2- 172.21.15.37:0/4151511028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628699551f0 0x56286996c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.460+0000 7f5c39e00640 1 -- 172.21.15.37:0/4151511028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628699551f0 msgr2=0x56286996c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.460+0000 7f5c39e00640 1 --2- 172.21.15.37:0/4151511028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628699551f0 0x56286996c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.460+0000 7f5c39e00640 1 -- 172.21.15.37:0/4151511028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562869949260 msgr2=0x5628699513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.460+0000 7f5c39e00640 1 --2- 172.21.15.37:0/4151511028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562869949260 0x5628699513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.460+0000 7f5c39e00640 1 -- 172.21.15.37:0/4151511028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562869954df0 con 0x562869948940 2024-08-20T05:08:10.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.461+0000 7f5c39e00640 1 --2- 172.21.15.37:0/4151511028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869950e60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c0aae20 tx=0x7f5c2c0a6d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fac074aaf76e56a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:10.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.461+0000 7f5c2aa00640 1 -- 172.21.15.37:0/4151511028 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c0af3e0 con 0x562869948940 2024-08-20T05:08:10.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.461+0000 7f5c2aa00640 1 -- 172.21.15.37:0/4151511028 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c2c0e1e50 con 0x562869948940 2024-08-20T05:08:10.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.461+0000 7f5c2aa00640 1 -- 172.21.15.37:0/4151511028 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c018c30 con 0x562869948940 2024-08-20T05:08:10.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.461+0000 7f5c43e90740 1 -- 172.21.15.37:0/4151511028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 msgr2=0x562869950e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:10.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.461+0000 7f5c43e90740 1 --2- 172.21.15.37:0/4151511028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869950e60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c0aae20 tx=0x7f5c2c0a6d50 comp rx=0 tx=0).stop 2024-08-20T05:08:10.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.462+0000 7f5c43e90740 1 -- 172.21.15.37:0/4151511028 shutdown_connections 2024-08-20T05:08:10.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.462+0000 7f5c43e90740 1 --2- 172.21.15.37:0/4151511028 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628699551f0 0x56286996c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.462+0000 7f5c43e90740 1 --2- 172.21.15.37:0/4151511028 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562869949260 0x5628699513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.462+0000 7f5c43e90740 1 --2- 172.21.15.37:0/4151511028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562869948940 0x562869950e60 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.462+0000 7f5c43e90740 1 -- 172.21.15.37:0/4151511028 >> 172.21.15.37:0/4151511028 conn(0x562869946770 msgr2=0x562869950750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:10.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.462+0000 7f5c43e90740 1 -- 172.21.15.37:0/4151511028 shutdown_connections 2024-08-20T05:08:10.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.462+0000 7f5c43e90740 1 -- 172.21.15.37:0/4151511028 wait complete. 2024-08-20T05:08:10.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.462+0000 7f5c43e90740 1 -- start start 2024-08-20T05:08:10.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.462+0000 7f5c43e90740 1 Processor -- start 2024-08-20T05:08:10.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.463+0000 7f5c43e90740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562869948940 0x56286995d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.463+0000 7f5c43e90740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562869949260 0x56286995a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.463+0000 7f5c43e90740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628699551f0 0x56286995aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.463+0000 7f5c43e90740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c1b7180 con 0x5628699551f0 2024-08-20T05:08:10.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.463+0000 7f5c43e90740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c1b6ab0 con 0x562869948940 2024-08-20T05:08:10.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.463+0000 7f5c43e90740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c1b3cf0 con 0x562869949260 2024-08-20T05:08:10.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.463+0000 7f5c43e90740 10 client.0 _ll_register_callbacks cb 0x7f5c2c009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:10.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.463+0000 7f5c3a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628699551f0 0x56286995aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:10.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.463+0000 7f5c3a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628699551f0 0x56286995aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55216/0 (socket says 172.21.15.37:55216) 2024-08-20T05:08:10.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.463+0000 7f5c3a800640 1 -- 172.21.15.37:0/1853989287 learned_addr learned my addr 172.21.15.37:0/1853989287 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:10.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.463+0000 7f5c39e00640 1 --2- 172.21.15.37:0/1853989287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562869948940 0x56286995d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:10.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.463+0000 7f5c31400640 1 --2- 172.21.15.37:0/1853989287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562869949260 0x56286995a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:10.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.463+0000 7f5c3a800640 1 -- 172.21.15.37:0/1853989287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562869949260 msgr2=0x56286995a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:10.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.463+0000 7f5c3a800640 1 --2- 172.21.15.37:0/1853989287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562869949260 0x56286995a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.463+0000 7f5c3a800640 1 -- 172.21.15.37:0/1853989287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562869948940 msgr2=0x56286995d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:10.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.463+0000 7f5c3a800640 1 --2- 172.21.15.37:0/1853989287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562869948940 0x56286995d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.463+0000 7f5c3a800640 1 -- 172.21.15.37:0/1853989287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56286995b5e0 con 0x5628699551f0 2024-08-20T05:08:10.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.464+0000 7f5c3a800640 1 --2- 172.21.15.37:0/1853989287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628699551f0 0x56286995aed0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5c34003d40 tx=0x7f5c34003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d218e781f9add993 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:10.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.464+0000 7f5c1fe00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:08:10.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.464+0000 7f5c1fe00640 1 -- 172.21.15.37:0/1853989287 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3404a040 con 0x5628699551f0 2024-08-20T05:08:10.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.464+0000 7f5c1fe00640 1 -- 172.21.15.37:0/1853989287 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5c34031450 con 0x5628699551f0 2024-08-20T05:08:10.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.464+0000 7f5c43e90740 1 -- 172.21.15.37:0/1853989287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c2c0e1e50 con 0x5628699551f0 2024-08-20T05:08:10.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.464+0000 7f5c1fe00640 1 -- 172.21.15.37:0/1853989287 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5c34031650 con 0x5628699551f0 2024-08-20T05:08:10.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.464+0000 7f5c43e90740 10 client.16701 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:10.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.464+0000 7f5c43e90740 1 -- 172.21.15.37:0/1853989287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5628699cf690 con 0x5628699551f0 2024-08-20T05:08:10.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.465+0000 7f5c1fe00640 1 -- 172.21.15.37:0/1853989287 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c2c0e1e50 con 0x5628699551f0 2024-08-20T05:08:10.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.465+0000 7f5c1fe00640 1 -- 172.21.15.37:0/1853989287 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f5c3404d070 con 0x5628699551f0 2024-08-20T05:08:10.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.465+0000 7f5c43e90740 10 client.16701 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:10.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.465+0000 7f5c43e90740 10 client.16701 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:08:10.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.465+0000 7f5c43e90740 20 client.16701 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:10.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.465+0000 7f5c43e90740 1 --2- 172.21.15.37:0/1853989287 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5628699cfb80 0x5628699d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:10.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.465+0000 7f5c43e90740 4 client.16701 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:08:10.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.465+0000 7f5c43e90740 1 -- 172.21.15.37:0/1853989287 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5628698bc490 con 0x5628699cfb80 2024-08-20T05:08:10.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.465+0000 7f5c39e00640 1 --2- 172.21.15.37:0/1853989287 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5628699cfb80 0x5628699d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:10.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.466+0000 7f5c39e00640 1 --2- 172.21.15.37:0/1853989287 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5628699cfb80 0x5628699d1fa0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a95e075292f01044 server_cookie=a648d848d7be5636 in_seq=0 out_seq=0 2024-08-20T05:08:10.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.466+0000 7f5c1fe00640 10 client.16701 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:08:10.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.466+0000 7f5c1fe00640 1 -- 172.21.15.37:0/1853989287 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5628698bc490 con 0x5628699cfb80 2024-08-20T05:08:10.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.466+0000 7f5c1fe00640 10 client.16701 handle_command_reply: tid=0 2024-08-20T05:08:10.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.466+0000 7f5c43e90740 1 client.16701 shutdown 2024-08-20T05:08:10.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.466+0000 7f5c43e90740 1 -- 172.21.15.37:0/1853989287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628699551f0 msgr2=0x56286995aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:10.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.466+0000 7f5c43e90740 1 --2- 172.21.15.37:0/1853989287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628699551f0 0x56286995aed0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5c34003d40 tx=0x7f5c34003cd0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.466+0000 7f5c43e90740 1 -- 172.21.15.37:0/1853989287 shutdown_connections 2024-08-20T05:08:10.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.466+0000 7f5c43e90740 1 --2- 172.21.15.37:0/1853989287 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5628699cfb80 0x5628699d1fa0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.466+0000 7f5c43e90740 1 --2- 172.21.15.37:0/1853989287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628699551f0 0x56286995aed0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.466+0000 7f5c43e90740 1 --2- 172.21.15.37:0/1853989287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562869949260 0x56286995a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.466+0000 7f5c1fe00640 0 client.16701 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:08:10.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.466+0000 7f5c43e90740 1 --2- 172.21.15.37:0/1853989287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562869948940 0x56286995d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.466+0000 7f5c43e90740 1 -- 172.21.15.37:0/1853989287 >> 172.21.15.37:0/1853989287 conn(0x562869946770 msgr2=0x562869950f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:10.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.467+0000 7f5c43e90740 1 -- 172.21.15.37:0/1853989287 shutdown_connections 2024-08-20T05:08:10.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.467+0000 7f5c43e90740 1 -- 172.21.15.37:0/1853989287 wait complete. 2024-08-20T05:08:10.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.467+0000 7f5c43e90740 20 client.16701 trim_cache size 0 max 16384 2024-08-20T05:08:10.473 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:08:10.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.467+0000 7f5c41200640 1 -- 172.21.15.37:0/1455122646 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5c200b3c50 msgr2=0x7f5c200b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:10.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.467+0000 7f5c41200640 1 --2- 172.21.15.37:0/1455122646 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5c200b3c50 0x7f5c200b6110 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c115ae0 tx=0x7f5c2400b390 comp rx=0 tx=0).stop 2024-08-20T05:08:10.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.467+0000 7f5c41200640 1 -- 172.21.15.37:0/1455122646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c3c077400 msgr2=0x7f5c3c19f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:10.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.467+0000 7f5c41200640 1 --2- 172.21.15.37:0/1455122646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c3c077400 0x7f5c3c19f5c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c00e9f0 tx=0x7f5c2c00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.467+0000 7f5c41200640 1 -- 172.21.15.37:0/1455122646 shutdown_connections 2024-08-20T05:08:10.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.467+0000 7f5c41200640 1 --2- 172.21.15.37:0/1455122646 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5c200b3c50 0x7f5c200b6110 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.467+0000 7f5c41200640 1 --2- 172.21.15.37:0/1455122646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5c3c113680 0x7f5c3c1a4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.467+0000 7f5c41200640 1 --2- 172.21.15.37:0/1455122646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c3c077d20 0x7f5c3c19fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.467+0000 7f5c41200640 1 --2- 172.21.15.37:0/1455122646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5c3c077400 0x7f5c3c19f5c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:10.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.467+0000 7f5c41200640 1 -- 172.21.15.37:0/1455122646 >> 172.21.15.37:0/1455122646 conn(0x7f5c3c1006c0 msgr2=0x7f5c3c102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:10.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.468+0000 7f5c41200640 1 -- 172.21.15.37:0/1455122646 shutdown_connections 2024-08-20T05:08:10.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:10.468+0000 7f5c41200640 1 -- 172.21.15.37:0/1455122646 wait complete. 2024-08-20T05:08:11.430 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T05:08:11.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:11 smithi037 ceph-mon[17265]: pgmap v579: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.9 MiB/s wr, 377 op/s 2024-08-20T05:08:11.809 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:08:11.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:11 smithi135 ceph-mon[22342]: pgmap v579: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.9 MiB/s wr, 377 op/s 2024-08-20T05:08:11.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:11 smithi130 ceph-mon[22007]: pgmap v579: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.9 MiB/s wr, 377 op/s 2024-08-20T05:08:12.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.442+0000 7f5377200640 1 -- 172.21.15.37:0/329183510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537010b030 msgr2=0x7f5370111830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:12.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.442+0000 7f5377200640 1 --2- 172.21.15.37:0/329183510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537010b030 0x7f5370111830 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5368009ca0 tx=0x7f536802a8c0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.442+0000 7f5377200640 1 -- 172.21.15.37:0/329183510 shutdown_connections 2024-08-20T05:08:12.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.442+0000 7f5377200640 1 --2- 172.21.15.37:0/329183510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f537010b030 0x7f5370111830 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.442+0000 7f5377200640 1 --2- 172.21.15.37:0/329183510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f537010a6b0 0x7f537010aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.442+0000 7f5377200640 1 --2- 172.21.15.37:0/329183510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5370104ca0 0x7f5370105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.442+0000 7f5377200640 1 -- 172.21.15.37:0/329183510 >> 172.21.15.37:0/329183510 conn(0x7f5370100730 msgr2=0x7f5370102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.442+0000 7f5377200640 1 -- 172.21.15.37:0/329183510 shutdown_connections 2024-08-20T05:08:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.442+0000 7f5377200640 1 -- 172.21.15.37:0/329183510 wait complete. 2024-08-20T05:08:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.443+0000 7f5377200640 1 Processor -- start 2024-08-20T05:08:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.443+0000 7f5377200640 1 -- start start 2024-08-20T05:08:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.443+0000 7f5377200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5370104ca0 0x7f537019b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.443+0000 7f5377200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f537010a6b0 0x7f537019b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.443+0000 7f5377200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f537010b030 0x7f53701a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.443+0000 7f5377200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5370114d00 con 0x7f5370104ca0 2024-08-20T05:08:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.443+0000 7f5377200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5370114b80 con 0x7f537010a6b0 2024-08-20T05:08:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.443+0000 7f5377200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5370114e80 con 0x7f537010b030 2024-08-20T05:08:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.444+0000 7f536fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5370104ca0 0x7f537019b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.444+0000 7f536fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5370104ca0 0x7f537019b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55226/0 (socket says 172.21.15.37:55226) 2024-08-20T05:08:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.444+0000 7f536fe00640 1 -- 172.21.15.37:0/3915256540 learned_addr learned my addr 172.21.15.37:0/3915256540 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.444+0000 7f536f400640 1 --2- 172.21.15.37:0/3915256540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f537010a6b0 0x7f537019b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.444+0000 7f5375200640 1 --2- 172.21.15.37:0/3915256540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f537010b030 0x7f53701a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.444+0000 7f536fe00640 1 -- 172.21.15.37:0/3915256540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f537010b030 msgr2=0x7f53701a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.444+0000 7f536fe00640 1 --2- 172.21.15.37:0/3915256540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f537010b030 0x7f53701a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.444+0000 7f536fe00640 1 -- 172.21.15.37:0/3915256540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f537010a6b0 msgr2=0x7f537019b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.444+0000 7f536fe00640 1 --2- 172.21.15.37:0/3915256540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f537010a6b0 0x7f537019b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.444+0000 7f536fe00640 1 -- 172.21.15.37:0/3915256540 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53701a1220 con 0x7f5370104ca0 2024-08-20T05:08:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.445+0000 7f536fe00640 1 --2- 172.21.15.37:0/3915256540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5370104ca0 0x7f537019b170 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f536000e9f0 tx=0x7f536000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.445+0000 7f536cc00640 1 -- 172.21.15.37:0/3915256540 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536000cd80 con 0x7f5370104ca0 2024-08-20T05:08:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.445+0000 7f5377200640 1 -- 172.21.15.37:0/3915256540 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53701a1510 con 0x7f5370104ca0 2024-08-20T05:08:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.445+0000 7f536cc00640 1 -- 172.21.15.37:0/3915256540 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53600108e0 con 0x7f5370104ca0 2024-08-20T05:08:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.445+0000 7f536cc00640 1 -- 172.21.15.37:0/3915256540 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5360018980 con 0x7f5370104ca0 2024-08-20T05:08:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.445+0000 7f5377200640 1 -- 172.21.15.37:0/3915256540 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53701a7da0 con 0x7f5370104ca0 2024-08-20T05:08:12.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.448+0000 7f5379dfd740 1 Processor -- start 2024-08-20T05:08:12.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.448+0000 7f5379dfd740 1 -- start start 2024-08-20T05:08:12.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.448+0000 7f536cc00640 1 -- 172.21.15.37:0/3915256540 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5360010430 con 0x7f5370104ca0 2024-08-20T05:08:12.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.448+0000 7f5379dfd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f06260990 0x559f06260d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.448+0000 7f5379dfd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f062612b0 0x559f0626cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.448+0000 7f5379dfd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f0626d240 0x559f0626f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.449+0000 7f5379dfd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559f061d6aa0 con 0x559f0626d240 2024-08-20T05:08:12.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.449+0000 7f5379dfd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559f061c5fa0 con 0x559f06260990 2024-08-20T05:08:12.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.449+0000 7f5379dfd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559f061c9fe0 con 0x559f062612b0 2024-08-20T05:08:12.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.449+0000 7f5375200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f06260990 0x559f06260d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.449+0000 7f536fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f062612b0 0x559f0626cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.449+0000 7f536f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f0626d240 0x559f0626f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.449+0000 7f5375200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f06260990 0x559f06260d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50534/0 (socket says 172.21.15.37:50534) 2024-08-20T05:08:12.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.449+0000 7f5375200640 1 -- 172.21.15.37:0/948874731 learned_addr learned my addr 172.21.15.37:0/948874731 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:12.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.449+0000 7f5375200640 1 -- 172.21.15.37:0/948874731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f062612b0 msgr2=0x559f0626cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:12.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.449+0000 7f5375200640 1 --2- 172.21.15.37:0/948874731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f062612b0 0x559f0626cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.449+0000 7f5375200640 1 -- 172.21.15.37:0/948874731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f0626d240 msgr2=0x559f0626f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:12.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.449+0000 7f5375200640 1 --2- 172.21.15.37:0/948874731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f0626d240 0x559f0626f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.449+0000 7f5375200640 1 -- 172.21.15.37:0/948874731 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f0616c420 con 0x559f06260990 2024-08-20T05:08:12.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.450+0000 7f5375200640 1 --2- 172.21.15.37:0/948874731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f06260990 0x559f06260d70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5368009ca0 tx=0x7f53680093e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff1a978a593f8558 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:12.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.450+0000 7f5365600640 1 -- 172.21.15.37:0/948874731 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368031cf0 con 0x559f06260990 2024-08-20T05:08:12.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.450+0000 7f5365600640 1 -- 172.21.15.37:0/948874731 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5368036030 con 0x559f06260990 2024-08-20T05:08:12.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.450+0000 7f5365600640 1 -- 172.21.15.37:0/948874731 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368004240 con 0x559f06260990 2024-08-20T05:08:12.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.450+0000 7f536cc00640 1 --2- 172.21.15.37:0/3915256540 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53540b3bd0 0x7f53540b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.450+0000 7f536cc00640 1 -- 172.21.15.37:0/3915256540 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f53600e4300 con 0x7f5370104ca0 2024-08-20T05:08:12.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.450+0000 7f536fe00640 1 --2- 172.21.15.37:0/3915256540 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53540b3bd0 0x7f53540b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.451+0000 7f5379dfd740 1 -- 172.21.15.37:0/948874731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f06260990 msgr2=0x559f06260d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:12.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.451+0000 7f5379dfd740 1 --2- 172.21.15.37:0/948874731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f06260990 0x559f06260d70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5368009ca0 tx=0x7f53680093e0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.451+0000 7f5379dfd740 1 -- 172.21.15.37:0/948874731 shutdown_connections 2024-08-20T05:08:12.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.451+0000 7f5379dfd740 1 --2- 172.21.15.37:0/948874731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f0626d240 0x559f0626f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.451+0000 7f5379dfd740 1 --2- 172.21.15.37:0/948874731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f062612b0 0x559f0626cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.451+0000 7f5379dfd740 1 --2- 172.21.15.37:0/948874731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f06260990 0x559f06260d70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.451+0000 7f5379dfd740 1 -- 172.21.15.37:0/948874731 >> 172.21.15.37:0/948874731 conn(0x559f0625e7c0 msgr2=0x559f0625f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:12.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.451+0000 7f5379dfd740 1 -- 172.21.15.37:0/948874731 shutdown_connections 2024-08-20T05:08:12.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.451+0000 7f536fe00640 1 --2- 172.21.15.37:0/3915256540 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53540b3bd0 0x7f53540b6090 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f53600aac00 tx=0x7f53600e7d40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:12.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.451+0000 7f5379dfd740 1 -- 172.21.15.37:0/948874731 wait complete. 2024-08-20T05:08:12.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.451+0000 7f5379dfd740 1 -- start start 2024-08-20T05:08:12.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.452+0000 7f5379dfd740 1 Processor -- start 2024-08-20T05:08:12.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.452+0000 7f5379dfd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f06260990 0x559f0626ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.452+0000 7f5379dfd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f062612b0 0x559f06269e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.452+0000 7f5379dfd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f0626d240 0x559f0626a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.452+0000 7f5379dfd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559f06028700 con 0x559f062612b0 2024-08-20T05:08:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.452+0000 7f5379dfd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559f06161290 con 0x559f06260990 2024-08-20T05:08:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.452+0000 7f5379dfd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559f0626fce0 con 0x559f0626d240 2024-08-20T05:08:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.452+0000 7f5379dfd740 10 client.0 _ll_register_callbacks cb 0x559f061c01c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.452+0000 7f536f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f062612b0 0x559f06269e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.452+0000 7f536f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f062612b0 0x559f06269e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55240/0 (socket says 172.21.15.37:55240) 2024-08-20T05:08:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.452+0000 7f536f400640 1 -- 172.21.15.37:0/3378345080 learned_addr learned my addr 172.21.15.37:0/3378345080 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.453+0000 7f5375200640 1 --2- 172.21.15.37:0/3378345080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f06260990 0x559f0626ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.453+0000 7f5375200640 1 --2- 172.21.15.37:0/3378345080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f0626d240 0x559f0626a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.453+0000 7f536f400640 1 -- 172.21.15.37:0/3378345080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f0626d240 msgr2=0x559f0626a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.453+0000 7f536f400640 1 --2- 172.21.15.37:0/3378345080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f0626d240 0x559f0626a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.453+0000 7f536f400640 1 -- 172.21.15.37:0/3378345080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f06260990 msgr2=0x559f0626ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.453+0000 7f536f400640 1 --2- 172.21.15.37:0/3378345080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f06260990 0x559f0626ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.453+0000 7f536f400640 1 -- 172.21.15.37:0/3378345080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f05f25650 con 0x559f062612b0 2024-08-20T05:08:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.453+0000 7f536f400640 1 --2- 172.21.15.37:0/3378345080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f062612b0 0x559f06269e60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f535c012740 tx=0x7f535c012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce8934f3e9d5752 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.453+0000 7f535a000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:08:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.454+0000 7f535a000640 1 -- 172.21.15.37:0/3378345080 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c00f920 con 0x559f062612b0 2024-08-20T05:08:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.454+0000 7f535a000640 1 -- 172.21.15.37:0/3378345080 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f535c00fac0 con 0x559f062612b0 2024-08-20T05:08:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.454+0000 7f5379dfd740 1 -- 172.21.15.37:0/3378345080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5368036030 con 0x559f062612b0 2024-08-20T05:08:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.454+0000 7f535a000640 1 -- 172.21.15.37:0/3378345080 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f535c00fd00 con 0x559f062612b0 2024-08-20T05:08:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.454+0000 7f5379dfd740 10 client.16713 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.454+0000 7f5379dfd740 1 -- 172.21.15.37:0/3378345080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x559f0627b580 con 0x559f062612b0 2024-08-20T05:08:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.454+0000 7f535a000640 1 -- 172.21.15.37:0/3378345080 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5368036030 con 0x559f062612b0 2024-08-20T05:08:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.454+0000 7f535a000640 1 -- 172.21.15.37:0/3378345080 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f535c01c420 con 0x559f062612b0 2024-08-20T05:08:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.454+0000 7f5379dfd740 10 client.16713 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.454+0000 7f5379dfd740 10 client.16713 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:08:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.454+0000 7f5379dfd740 20 client.16713 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.454+0000 7f5379dfd740 1 --2- 172.21.15.37:0/3378345080 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x559f0627ca40 0x559f0627ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.454+0000 7f5379dfd740 4 client.16713 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:08:12.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.454+0000 7f5379dfd740 1 -- 172.21.15.37:0/3378345080 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f061d89f0 con 0x559f0627ca40 2024-08-20T05:08:12.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.455+0000 7f5375200640 1 --2- 172.21.15.37:0/3378345080 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x559f0627ca40 0x559f0627ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.455+0000 7f5375200640 1 --2- 172.21.15.37:0/3378345080 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x559f0627ca40 0x559f0627ee70 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0c3a32c751056fe server_cookie=4313922f677799fc in_seq=0 out_seq=0 2024-08-20T05:08:12.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.455+0000 7f535a000640 10 client.16713 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:08:12.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.456+0000 7f535a000640 1 -- 172.21.15.37:0/3378345080 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559f061d89f0 con 0x559f0627ca40 2024-08-20T05:08:12.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.456+0000 7f535a000640 10 client.16713 handle_command_reply: tid=0 2024-08-20T05:08:12.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.456+0000 7f5379dfd740 1 client.16713 shutdown 2024-08-20T05:08:12.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.456+0000 7f5379dfd740 1 -- 172.21.15.37:0/3378345080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f062612b0 msgr2=0x559f06269e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:12.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.456+0000 7f5379dfd740 1 --2- 172.21.15.37:0/3378345080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f062612b0 0x559f06269e60 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f535c012740 tx=0x7f535c012c00 comp rx=0 tx=0).stop 2024-08-20T05:08:12.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.456+0000 7f5379dfd740 1 -- 172.21.15.37:0/3378345080 shutdown_connections 2024-08-20T05:08:12.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.456+0000 7f5379dfd740 1 --2- 172.21.15.37:0/3378345080 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x559f0627ca40 0x559f0627ee70 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.457+0000 7f5379dfd740 1 --2- 172.21.15.37:0/3378345080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f0626d240 0x559f0626a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.457+0000 7f5379dfd740 1 --2- 172.21.15.37:0/3378345080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f062612b0 0x559f06269e60 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.457+0000 7f5379dfd740 1 --2- 172.21.15.37:0/3378345080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f06260990 0x559f0626ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.457+0000 7f535a000640 0 client.16713 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:08:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.457+0000 7f5379dfd740 1 -- 172.21.15.37:0/3378345080 >> 172.21.15.37:0/3378345080 conn(0x559f0625e7c0 msgr2=0x559f06264330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.457+0000 7f5379dfd740 1 -- 172.21.15.37:0/3378345080 shutdown_connections 2024-08-20T05:08:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.457+0000 7f5379dfd740 1 -- 172.21.15.37:0/3378345080 wait complete. 2024-08-20T05:08:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.457+0000 7f5379dfd740 20 client.16713 trim_cache size 0 max 16384 2024-08-20T05:08:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.470+0000 7f5379dfd740 1 Processor -- start 2024-08-20T05:08:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.471+0000 7f5379dfd740 1 -- start start 2024-08-20T05:08:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.471+0000 7f5379dfd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f06260990 0x559f06284780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.471+0000 7f5379dfd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f062612b0 0x559f06284cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.471+0000 7f5379dfd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f0626d240 0x559f06267070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.471+0000 7f5379dfd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f53701b19c0 con 0x559f0626d240 2024-08-20T05:08:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.471+0000 7f5379dfd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f53701b3500 con 0x559f062612b0 2024-08-20T05:08:12.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.471+0000 7f5379dfd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53701b2090 con 0x559f06260990 2024-08-20T05:08:12.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.471+0000 7f5375200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f0626d240 0x559f06267070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.471+0000 7f536f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f062612b0 0x559f06284cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.471+0000 7f5375200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f0626d240 0x559f06267070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55256/0 (socket says 172.21.15.37:55256) 2024-08-20T05:08:12.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.471+0000 7f5375200640 1 -- 172.21.15.37:0/2942413483 learned_addr learned my addr 172.21.15.37:0/2942413483 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:12.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.471+0000 7f5375200640 1 --2- 172.21.15.37:0/2942413483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f06260990 0x559f06284780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.472+0000 7f5375200640 1 -- 172.21.15.37:0/2942413483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f06260990 msgr2=0x559f06284780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:12.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.472+0000 7f5375200640 1 --2- 172.21.15.37:0/2942413483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f06260990 0x559f06284780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.472+0000 7f5375200640 1 -- 172.21.15.37:0/2942413483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f062612b0 msgr2=0x559f06284cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:12.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.472+0000 7f5375200640 1 --2- 172.21.15.37:0/2942413483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f062612b0 0x559f06284cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.472+0000 7f5375200640 1 -- 172.21.15.37:0/2942413483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f0625a150 con 0x559f0626d240 2024-08-20T05:08:12.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.472+0000 7f536f400640 1 --2- 172.21.15.37:0/2942413483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f062612b0 0x559f06284cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:12.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.472+0000 7f5375200640 1 --2- 172.21.15.37:0/2942413483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f0626d240 0x559f06267070 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f536802ae80 tx=0x7f5368005df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecdf085699c0719c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:12.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.472+0000 7f5364c00640 1 -- 172.21.15.37:0/2942413483 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368031af0 con 0x559f0626d240 2024-08-20T05:08:12.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.472+0000 7f5364c00640 1 -- 172.21.15.37:0/2942413483 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5368036040 con 0x559f0626d240 2024-08-20T05:08:12.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.472+0000 7f5364c00640 1 -- 172.21.15.37:0/2942413483 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368004500 con 0x559f0626d240 2024-08-20T05:08:12.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.473+0000 7f5379dfd740 1 -- 172.21.15.37:0/2942413483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f0626d240 msgr2=0x559f06267070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:12.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.473+0000 7f5379dfd740 1 --2- 172.21.15.37:0/2942413483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f0626d240 0x559f06267070 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f536802ae80 tx=0x7f5368005df0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.473+0000 7f5379dfd740 1 -- 172.21.15.37:0/2942413483 shutdown_connections 2024-08-20T05:08:12.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.473+0000 7f5379dfd740 1 --2- 172.21.15.37:0/2942413483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f0626d240 0x559f06267070 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.473+0000 7f5379dfd740 1 --2- 172.21.15.37:0/2942413483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f062612b0 0x559f06284cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.473+0000 7f5379dfd740 1 --2- 172.21.15.37:0/2942413483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f06260990 0x559f06284780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.473+0000 7f5379dfd740 1 -- 172.21.15.37:0/2942413483 >> 172.21.15.37:0/2942413483 conn(0x559f0625e7c0 msgr2=0x559f0626bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:12.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.473+0000 7f5379dfd740 1 -- 172.21.15.37:0/2942413483 shutdown_connections 2024-08-20T05:08:12.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.473+0000 7f5379dfd740 1 -- 172.21.15.37:0/2942413483 wait complete. 2024-08-20T05:08:12.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.473+0000 7f5379dfd740 1 -- start start 2024-08-20T05:08:12.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.474+0000 7f5379dfd740 1 Processor -- start 2024-08-20T05:08:12.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.474+0000 7f5379dfd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f06260990 0x559f06273150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.474+0000 7f5379dfd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f062612b0 0x559f06273690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.474+0000 7f5379dfd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f0626d240 0x559f062e6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.474+0000 7f5379dfd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f53701b2e30 con 0x559f06260990 2024-08-20T05:08:12.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.474+0000 7f5379dfd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f53701b2760 con 0x559f062612b0 2024-08-20T05:08:12.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.474+0000 7f5379dfd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53701af9a0 con 0x559f0626d240 2024-08-20T05:08:12.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.474+0000 7f5379dfd740 10 client.0 _ll_register_callbacks cb 0x7f535c009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:12.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.474+0000 7f5375200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f06260990 0x559f06273150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.474+0000 7f5375200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f06260990 0x559f06273150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55270/0 (socket says 172.21.15.37:55270) 2024-08-20T05:08:12.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.474+0000 7f5375200640 1 -- 172.21.15.37:0/999922767 learned_addr learned my addr 172.21.15.37:0/999922767 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:12.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.474+0000 7f536f400640 1 --2- 172.21.15.37:0/999922767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f062612b0 0x559f06273690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.474+0000 7f5375200640 1 --2- 172.21.15.37:0/999922767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f0626d240 0x559f062e6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.475+0000 7f536f400640 1 -- 172.21.15.37:0/999922767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f0626d240 msgr2=0x559f062e6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:12.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.475+0000 7f536f400640 1 --2- 172.21.15.37:0/999922767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f0626d240 0x559f062e6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.475+0000 7f536f400640 1 -- 172.21.15.37:0/999922767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f06260990 msgr2=0x559f06273150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:12.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.475+0000 7f536f400640 1 --2- 172.21.15.37:0/999922767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f06260990 0x559f06273150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.475+0000 7f536f400640 1 -- 172.21.15.37:0/999922767 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f062e6ca0 con 0x559f062612b0 2024-08-20T05:08:12.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.475+0000 7f5375200640 1 --2- 172.21.15.37:0/999922767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f06260990 0x559f06273150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:12.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.475+0000 7f536f400640 1 --2- 172.21.15.37:0/999922767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f062612b0 0x559f06273690 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f535c0059f0 tx=0x7f535c00fbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d40bce1455e1796c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:12.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.475+0000 7f535a000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:08:12.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.475+0000 7f535a000640 1 -- 172.21.15.37:0/999922767 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f535c02f060 con 0x559f062612b0 2024-08-20T05:08:12.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.476+0000 7f5379dfd740 1 -- 172.21.15.37:0/999922767 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5368036040 con 0x559f062612b0 2024-08-20T05:08:12.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.476+0000 7f535a000640 1 -- 172.21.15.37:0/999922767 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f535c0050d0 con 0x559f062612b0 2024-08-20T05:08:12.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.476+0000 7f535a000640 1 -- 172.21.15.37:0/999922767 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f535c005d30 con 0x559f062612b0 2024-08-20T05:08:12.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.476+0000 7f5379dfd740 10 client.27020 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:12.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.476+0000 7f5379dfd740 1 -- 172.21.15.37:0/999922767 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x559f062e7d90 con 0x559f062612b0 2024-08-20T05:08:12.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.476+0000 7f535a000640 1 -- 172.21.15.37:0/999922767 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5368036040 con 0x559f062612b0 2024-08-20T05:08:12.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.476+0000 7f535a000640 1 -- 172.21.15.37:0/999922767 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f535c003660 con 0x559f062612b0 2024-08-20T05:08:12.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.476+0000 7f5379dfd740 10 client.27020 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:12.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.476+0000 7f5379dfd740 10 client.27020 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:08:12.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.476+0000 7f5379dfd740 20 client.27020 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:12.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.476+0000 7f5379dfd740 1 --2- 172.21.15.37:0/999922767 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x559f062e8480 0x559f062ea8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:12.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.476+0000 7f5379dfd740 4 client.27020 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:08:12.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.476+0000 7f5379dfd740 1 -- 172.21.15.37:0/999922767 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559f061d4490 con 0x559f062e8480 2024-08-20T05:08:12.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.477+0000 7f5375200640 1 --2- 172.21.15.37:0/999922767 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x559f062e8480 0x559f062ea8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:12.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.477+0000 7f5375200640 1 --2- 172.21.15.37:0/999922767 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x559f062e8480 0x559f062ea8a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a923f48dca8bd416 server_cookie=9585c5b82cdaf5c0 in_seq=0 out_seq=0 2024-08-20T05:08:12.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.477+0000 7f535a000640 10 client.27020 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:08:12.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.477+0000 7f535a000640 1 -- 172.21.15.37:0/999922767 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559f061d4490 con 0x559f062e8480 2024-08-20T05:08:12.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.478+0000 7f535a000640 10 client.27020 handle_command_reply: tid=0 2024-08-20T05:08:12.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.478+0000 7f5379dfd740 1 client.27020 shutdown 2024-08-20T05:08:12.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.478+0000 7f5379dfd740 1 -- 172.21.15.37:0/999922767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f062612b0 msgr2=0x559f06273690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:12.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.478+0000 7f5379dfd740 1 --2- 172.21.15.37:0/999922767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f062612b0 0x559f06273690 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f535c0059f0 tx=0x7f535c00fbd0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.478+0000 7f5379dfd740 1 -- 172.21.15.37:0/999922767 shutdown_connections 2024-08-20T05:08:12.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.478+0000 7f5379dfd740 1 --2- 172.21.15.37:0/999922767 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x559f062e8480 0x559f062ea8a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.478+0000 7f5379dfd740 1 --2- 172.21.15.37:0/999922767 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559f0626d240 0x559f062e6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.478+0000 7f5379dfd740 1 --2- 172.21.15.37:0/999922767 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559f062612b0 0x559f06273690 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.478+0000 7f5379dfd740 1 --2- 172.21.15.37:0/999922767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559f06260990 0x559f06273150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.478+0000 7f535a000640 0 client.27020 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:08:12.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.478+0000 7f5379dfd740 1 -- 172.21.15.37:0/999922767 >> 172.21.15.37:0/999922767 conn(0x559f0625e7c0 msgr2=0x559f0625d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:12.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.478+0000 7f5379dfd740 1 -- 172.21.15.37:0/999922767 shutdown_connections 2024-08-20T05:08:12.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.478+0000 7f5379dfd740 1 -- 172.21.15.37:0/999922767 wait complete. 2024-08-20T05:08:12.514 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:08:12.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.478+0000 7f5379dfd740 20 client.27020 trim_cache size 0 max 16384 2024-08-20T05:08:12.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.479+0000 7f5377200640 1 -- 172.21.15.37:0/3915256540 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53540b3bd0 msgr2=0x7f53540b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:12.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.479+0000 7f5377200640 1 --2- 172.21.15.37:0/3915256540 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53540b3bd0 0x7f53540b6090 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f53600aac00 tx=0x7f53600e7d40 comp rx=0 tx=0).stop 2024-08-20T05:08:12.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.479+0000 7f5377200640 1 -- 172.21.15.37:0/3915256540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5370104ca0 msgr2=0x7f537019b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:12.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.479+0000 7f5377200640 1 --2- 172.21.15.37:0/3915256540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5370104ca0 0x7f537019b170 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f536000e9f0 tx=0x7f536000eeb0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.479+0000 7f5377200640 1 -- 172.21.15.37:0/3915256540 shutdown_connections 2024-08-20T05:08:12.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.479+0000 7f5377200640 1 --2- 172.21.15.37:0/3915256540 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53540b3bd0 0x7f53540b6090 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.479+0000 7f5377200640 1 --2- 172.21.15.37:0/3915256540 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f537010b030 0x7f53701a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.479+0000 7f5377200640 1 --2- 172.21.15.37:0/3915256540 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f537010a6b0 0x7f537019b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.479+0000 7f5377200640 1 --2- 172.21.15.37:0/3915256540 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5370104ca0 0x7f537019b170 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:12.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.479+0000 7f5377200640 1 -- 172.21.15.37:0/3915256540 >> 172.21.15.37:0/3915256540 conn(0x7f5370100730 msgr2=0x7f5370102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:12.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.479+0000 7f5377200640 1 -- 172.21.15.37:0/3915256540 shutdown_connections 2024-08-20T05:08:12.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:12.479+0000 7f5377200640 1 -- 172.21.15.37:0/3915256540 wait complete. 2024-08-20T05:08:13.044 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 315.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:08:13.305 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T05:08:13.683 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:08:13.860 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:13 smithi037 ceph-mon[17265]: pgmap v580: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.8 MiB/s wr, 535 op/s 2024-08-20T05:08:13.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:13 smithi135 ceph-mon[22342]: pgmap v580: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.8 MiB/s wr, 535 op/s 2024-08-20T05:08:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:13 smithi130 ceph-mon[22007]: pgmap v580: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.8 MiB/s wr, 535 op/s 2024-08-20T05:08:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.485+0000 7f70b3400640 1 -- 172.21.15.37:0/3487462845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac077d20 msgr2=0x7f70ac113140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.485+0000 7f70b3400640 1 --2- 172.21.15.37:0/3487462845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac077d20 0x7f70ac113140 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7094009900 tx=0x7f709402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.485+0000 7f70b3400640 1 -- 172.21.15.37:0/3487462845 shutdown_connections 2024-08-20T05:08:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.485+0000 7f70b3400640 1 --2- 172.21.15.37:0/3487462845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70ac113680 0x7f70ac115a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.485+0000 7f70b3400640 1 --2- 172.21.15.37:0/3487462845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac077d20 0x7f70ac113140 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.485+0000 7f70b3400640 1 --2- 172.21.15.37:0/3487462845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ac077400 0x7f70ac0777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.485+0000 7f70b3400640 1 -- 172.21.15.37:0/3487462845 >> 172.21.15.37:0/3487462845 conn(0x7f70ac1006c0 msgr2=0x7f70ac102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.485+0000 7f70b3400640 1 -- 172.21.15.37:0/3487462845 shutdown_connections 2024-08-20T05:08:14.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.486+0000 7f70b3400640 1 -- 172.21.15.37:0/3487462845 wait complete. 2024-08-20T05:08:14.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.487+0000 7f70b3400640 1 Processor -- start 2024-08-20T05:08:14.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.487+0000 7f70b3400640 1 -- start start 2024-08-20T05:08:14.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.487+0000 7f70b3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac077400 0x7f70ac19f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.487+0000 7f70b3400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70ac077d20 0x7f70ac19fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.487+0000 7f70b3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ac113680 0x7f70ac1a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.487+0000 7f70b3400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1190d0 con 0x7f70ac077400 2024-08-20T05:08:14.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.487+0000 7f70b3400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac118f50 con 0x7f70ac077d20 2024-08-20T05:08:14.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.487+0000 7f70b3400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac119250 con 0x7f70ac113680 2024-08-20T05:08:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.487+0000 7f70b0a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac077400 0x7f70ac19f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.488+0000 7f70b0a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac077400 0x7f70ac19f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33176/0 (socket says 172.21.15.37:33176) 2024-08-20T05:08:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.488+0000 7f70b0a00640 1 -- 172.21.15.37:0/2947670980 learned_addr learned my addr 172.21.15.37:0/2947670980 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.488+0000 7f70a3e00640 1 --2- 172.21.15.37:0/2947670980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70ac077d20 0x7f70ac19fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.488+0000 7f70b1400640 1 --2- 172.21.15.37:0/2947670980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ac113680 0x7f70ac1a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.488+0000 7f70b0a00640 1 -- 172.21.15.37:0/2947670980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ac113680 msgr2=0x7f70ac1a4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.488+0000 7f70b0a00640 1 --2- 172.21.15.37:0/2947670980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ac113680 0x7f70ac1a4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.488+0000 7f70b0a00640 1 -- 172.21.15.37:0/2947670980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70ac077d20 msgr2=0x7f70ac19fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.488+0000 7f70b0a00640 1 --2- 172.21.15.37:0/2947670980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70ac077d20 0x7f70ac19fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.488+0000 7f70b0a00640 1 -- 172.21.15.37:0/2947670980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ac1a5650 con 0x7f70ac077400 2024-08-20T05:08:14.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.488+0000 7f70b0a00640 1 --2- 172.21.15.37:0/2947670980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac077400 0x7f70ac19f5a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f709c00e9f0 tx=0x7f709c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.488+0000 7f70aa000640 1 -- 172.21.15.37:0/2947670980 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c00ccc0 con 0x7f70ac077400 2024-08-20T05:08:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.489+0000 7f70aa000640 1 -- 172.21.15.37:0/2947670980 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f709c00ce60 con 0x7f70ac077400 2024-08-20T05:08:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.489+0000 7f70b3400640 1 -- 172.21.15.37:0/2947670980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ac1a5940 con 0x7f70ac077400 2024-08-20T05:08:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.489+0000 7f70aa000640 1 -- 172.21.15.37:0/2947670980 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c010430 con 0x7f70ac077400 2024-08-20T05:08:14.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.489+0000 7f70b3400640 1 -- 172.21.15.37:0/2947670980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ac1ac000 con 0x7f70ac077400 2024-08-20T05:08:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.492+0000 7f70b5dd8740 1 Processor -- start 2024-08-20T05:08:14.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.493+0000 7f70aa000640 1 -- 172.21.15.37:0/2947670980 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f709c0046c0 con 0x7f70ac077400 2024-08-20T05:08:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.493+0000 7f70b5dd8740 1 -- start start 2024-08-20T05:08:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.493+0000 7f70b5dd8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e89d990 0x55a16e89dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.493+0000 7f70b5dd8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e89e2b0 0x55a16e8a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.493+0000 7f70b5dd8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e8aa240 0x55a16e8ac630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.493+0000 7f70b5dd8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a16e813aa0 con 0x55a16e8aa240 2024-08-20T05:08:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.493+0000 7f70b5dd8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a16e802fa0 con 0x55a16e89d990 2024-08-20T05:08:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.493+0000 7f70b5dd8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a16e806fe0 con 0x55a16e89e2b0 2024-08-20T05:08:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.493+0000 7f70a3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e8aa240 0x55a16e8ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.493+0000 7f70b0a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e89e2b0 0x55a16e8a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.493+0000 7f70a3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e8aa240 0x55a16e8ac630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33188/0 (socket says 172.21.15.37:33188) 2024-08-20T05:08:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.493+0000 7f70a3e00640 1 -- 172.21.15.37:0/1989296105 learned_addr learned my addr 172.21.15.37:0/1989296105 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:14.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.493+0000 7f70b1400640 1 --2- 172.21.15.37:0/1989296105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e89d990 0x55a16e89dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.494+0000 7f70a3e00640 1 -- 172.21.15.37:0/1989296105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e89e2b0 msgr2=0x55a16e8a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.494+0000 7f70a3e00640 1 --2- 172.21.15.37:0/1989296105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e89e2b0 0x55a16e8a9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.494+0000 7f70a3e00640 1 -- 172.21.15.37:0/1989296105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e89d990 msgr2=0x55a16e89dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.494+0000 7f70a3e00640 1 --2- 172.21.15.37:0/1989296105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e89d990 0x55a16e89dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.494+0000 7f70a3e00640 1 -- 172.21.15.37:0/1989296105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a16e7a9420 con 0x55a16e8aa240 2024-08-20T05:08:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.494+0000 7f70b0a00640 1 --2- 172.21.15.37:0/1989296105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e89e2b0 0x55a16e8a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.494+0000 7f70a3e00640 1 --2- 172.21.15.37:0/1989296105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e8aa240 0x55a16e8ac630 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7094000c00 tx=0x7f7094004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d56f492a249f0f8f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.495+0000 7f70aa000640 1 --2- 172.21.15.37:0/2947670980 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70900b3bd0 0x7f70900b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.495+0000 7f70a1c00640 1 -- 172.21.15.37:0/1989296105 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7094035040 con 0x55a16e8aa240 2024-08-20T05:08:14.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.495+0000 7f70a1c00640 1 -- 172.21.15.37:0/1989296105 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70940054f0 con 0x55a16e8aa240 2024-08-20T05:08:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.495+0000 7f70a1c00640 1 -- 172.21.15.37:0/1989296105 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70940035f0 con 0x55a16e8aa240 2024-08-20T05:08:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.495+0000 7f70aa000640 1 -- 172.21.15.37:0/2947670980 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f709c0e4370 con 0x7f70ac077400 2024-08-20T05:08:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.495+0000 7f70b1400640 1 --2- 172.21.15.37:0/2947670980 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70900b3bd0 0x7f70900b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.496+0000 7f70b5dd8740 1 -- 172.21.15.37:0/1989296105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e8aa240 msgr2=0x55a16e8ac630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.496+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/1989296105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e8aa240 0x55a16e8ac630 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7094000c00 tx=0x7f7094004040 comp rx=0 tx=0).stop 2024-08-20T05:08:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.496+0000 7f70b1400640 1 --2- 172.21.15.37:0/2947670980 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70900b3bd0 0x7f70900b6090 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f70ac06be80 tx=0x7f70a4009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.496+0000 7f70b5dd8740 1 -- 172.21.15.37:0/1989296105 shutdown_connections 2024-08-20T05:08:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.496+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/1989296105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e8aa240 0x55a16e8ac630 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.496+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/1989296105 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e89e2b0 0x55a16e8a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.496+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/1989296105 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e89d990 0x55a16e89dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.496+0000 7f70b5dd8740 1 -- 172.21.15.37:0/1989296105 >> 172.21.15.37:0/1989296105 conn(0x55a16e89b7c0 msgr2=0x55a16e89c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.496+0000 7f70b5dd8740 1 -- 172.21.15.37:0/1989296105 shutdown_connections 2024-08-20T05:08:14.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.496+0000 7f70b5dd8740 1 -- 172.21.15.37:0/1989296105 wait complete. 2024-08-20T05:08:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.496+0000 7f70b5dd8740 1 -- start start 2024-08-20T05:08:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.497+0000 7f70b5dd8740 1 Processor -- start 2024-08-20T05:08:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.497+0000 7f70b5dd8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89d990 0x55a16e8a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.497+0000 7f70b5dd8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e89e2b0 0x55a16e8a6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.497+0000 7f70b5dd8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e8aa240 0x55a16e8a73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.497+0000 7f70b5dd8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a16e665700 con 0x55a16e89d990 2024-08-20T05:08:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.497+0000 7f70b5dd8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a16e79e290 con 0x55a16e89e2b0 2024-08-20T05:08:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.497+0000 7f70b5dd8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a16e8ace60 con 0x55a16e8aa240 2024-08-20T05:08:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.497+0000 7f70b5dd8740 10 client.0 _ll_register_callbacks cb 0x55a16e7fd1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.497+0000 7f70b0a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89d990 0x55a16e8a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.498+0000 7f70a3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e89e2b0 0x55a16e8a6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.498+0000 7f70b0a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89d990 0x55a16e8a9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33198/0 (socket says 172.21.15.37:33198) 2024-08-20T05:08:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.498+0000 7f70b0a00640 1 -- 172.21.15.37:0/103489623 learned_addr learned my addr 172.21.15.37:0/103489623 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.498+0000 7f70b1400640 1 --2- 172.21.15.37:0/103489623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e8aa240 0x55a16e8a73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.498+0000 7f70a3e00640 1 -- 172.21.15.37:0/103489623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e8aa240 msgr2=0x55a16e8a73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.498+0000 7f70a3e00640 1 --2- 172.21.15.37:0/103489623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e8aa240 0x55a16e8a73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.498+0000 7f70a3e00640 1 -- 172.21.15.37:0/103489623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89d990 msgr2=0x55a16e8a9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.498+0000 7f70a3e00640 1 --2- 172.21.15.37:0/103489623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89d990 0x55a16e8a9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.498+0000 7f70a3e00640 1 -- 172.21.15.37:0/103489623 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a16e562650 con 0x55a16e89e2b0 2024-08-20T05:08:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.498+0000 7f70b0a00640 1 --2- 172.21.15.37:0/103489623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89d990 0x55a16e8a9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.498+0000 7f70a3e00640 1 --2- 172.21.15.37:0/103489623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e89e2b0 0x55a16e8a6e60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7094005ab0 tx=0x7f709402a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d18f8bc9082b843 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.498+0000 7f709a000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:08:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.499+0000 7f709a000640 1 -- 172.21.15.37:0/103489623 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7094035040 con 0x55a16e89e2b0 2024-08-20T05:08:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.499+0000 7f70b5dd8740 1 -- 172.21.15.37:0/103489623 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70940054f0 con 0x55a16e89e2b0 2024-08-20T05:08:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.499+0000 7f709a000640 1 -- 172.21.15.37:0/103489623 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7094004e70 con 0x55a16e89e2b0 2024-08-20T05:08:14.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.499+0000 7f709a000640 1 -- 172.21.15.37:0/103489623 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f709405a050 con 0x55a16e89e2b0 2024-08-20T05:08:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.499+0000 7f70b5dd8740 10 client.27032 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.499+0000 7f70b5dd8740 1 -- 172.21.15.37:0/103489623 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a16e8b86a0 con 0x55a16e89e2b0 2024-08-20T05:08:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.499+0000 7f709a000640 1 -- 172.21.15.37:0/103489623 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70940054f0 con 0x55a16e89e2b0 2024-08-20T05:08:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.499+0000 7f709a000640 1 -- 172.21.15.37:0/103489623 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f7094055030 con 0x55a16e89e2b0 2024-08-20T05:08:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.500+0000 7f70b5dd8740 10 client.27032 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.500+0000 7f70b5dd8740 10 client.27032 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:08:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.500+0000 7f70b5dd8740 20 client.27032 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.500+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/103489623 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55a16e8b99f0 0x55a16e8bbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.500+0000 7f70b5dd8740 4 client.27032 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:08:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.500+0000 7f70b5dd8740 1 -- 172.21.15.37:0/103489623 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a16e8159f0 con 0x55a16e8b99f0 2024-08-20T05:08:14.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.500+0000 7f70b0a00640 1 --2- 172.21.15.37:0/103489623 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55a16e8b99f0 0x55a16e8bbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.501+0000 7f70b0a00640 1 --2- 172.21.15.37:0/103489623 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55a16e8b99f0 0x55a16e8bbde0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=80dd3d0cf6335ad6 server_cookie=8b3db0765123be7a in_seq=0 out_seq=0 2024-08-20T05:08:14.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.501+0000 7f709a000640 10 client.27032 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:08:14.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.501+0000 7f709a000640 1 -- 172.21.15.37:0/103489623 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a16e8159f0 con 0x55a16e8b99f0 2024-08-20T05:08:14.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.501+0000 7f709a000640 10 client.27032 handle_command_reply: tid=0 2024-08-20T05:08:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.502+0000 7f70b5dd8740 1 client.27032 shutdown 2024-08-20T05:08:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.502+0000 7f70b5dd8740 1 -- 172.21.15.37:0/103489623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e89e2b0 msgr2=0x55a16e8a6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.502+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/103489623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e89e2b0 0x55a16e8a6e60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7094005ab0 tx=0x7f709402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.502+0000 7f70b5dd8740 1 -- 172.21.15.37:0/103489623 shutdown_connections 2024-08-20T05:08:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.502+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/103489623 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55a16e8b99f0 0x55a16e8bbde0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.502+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/103489623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e8aa240 0x55a16e8a73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.502+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/103489623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e89e2b0 0x55a16e8a6e60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.502+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/103489623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89d990 0x55a16e8a9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.502+0000 7f709a000640 0 client.27032 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:08:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.502+0000 7f70b5dd8740 1 -- 172.21.15.37:0/103489623 >> 172.21.15.37:0/103489623 conn(0x55a16e89b7c0 msgr2=0x55a16e8a1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:14.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.502+0000 7f70b5dd8740 1 -- 172.21.15.37:0/103489623 shutdown_connections 2024-08-20T05:08:14.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.502+0000 7f70b5dd8740 1 -- 172.21.15.37:0/103489623 wait complete. 2024-08-20T05:08:14.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.502+0000 7f70b5dd8740 20 client.27032 trim_cache size 0 max 16384 2024-08-20T05:08:14.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.516+0000 7f70b5dd8740 1 Processor -- start 2024-08-20T05:08:14.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.516+0000 7f70b5dd8740 1 -- start start 2024-08-20T05:08:14.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.516+0000 7f70b5dd8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e89d990 0x55a16e8bee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.516+0000 7f70b5dd8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89e2b0 0x55a16e8bf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.516+0000 7f70b5dd8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e8aa240 0x55a16e8a4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.516+0000 7f70b5dd8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1b5d60 con 0x55a16e89e2b0 2024-08-20T05:08:14.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.516+0000 7f70b5dd8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1b78a0 con 0x55a16e8aa240 2024-08-20T05:08:14.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.516+0000 7f70b5dd8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1b6430 con 0x55a16e89d990 2024-08-20T05:08:14.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.517+0000 7f70b0a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e89d990 0x55a16e8bee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.517+0000 7f70b0a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e89d990 0x55a16e8bee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:40670/0 (socket says 172.21.15.37:40670) 2024-08-20T05:08:14.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.517+0000 7f70b0a00640 1 -- 172.21.15.37:0/3480132126 learned_addr learned my addr 172.21.15.37:0/3480132126 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.517+0000 7f70a3e00640 1 --2- 172.21.15.37:0/3480132126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89e2b0 0x55a16e8bf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.517+0000 7f70b1400640 1 --2- 172.21.15.37:0/3480132126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e8aa240 0x55a16e8a4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.517+0000 7f70b0a00640 1 -- 172.21.15.37:0/3480132126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e8aa240 msgr2=0x55a16e8a4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.517+0000 7f70b0a00640 1 --2- 172.21.15.37:0/3480132126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e8aa240 0x55a16e8a4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.517+0000 7f70b0a00640 1 -- 172.21.15.37:0/3480132126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89e2b0 msgr2=0x55a16e8bf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.517+0000 7f70b0a00640 1 --2- 172.21.15.37:0/3480132126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89e2b0 0x55a16e8bf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.517+0000 7f70b0a00640 1 -- 172.21.15.37:0/3480132126 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a16e89b5f0 con 0x55a16e89d990 2024-08-20T05:08:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.517+0000 7f70a3e00640 1 --2- 172.21.15.37:0/3480132126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89e2b0 0x55a16e8bf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:08:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.517+0000 7f70b0a00640 1 --2- 172.21.15.37:0/3480132126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e89d990 0x55a16e8bee00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f709c0057a0 tx=0x7f709c0e7e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d6ea07b9e1a37b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:14.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.518+0000 7f70a1200640 1 -- 172.21.15.37:0/3480132126 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c0aa870 con 0x55a16e89d990 2024-08-20T05:08:14.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.518+0000 7f70a1200640 1 -- 172.21.15.37:0/3480132126 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f709c0aaa30 con 0x55a16e89d990 2024-08-20T05:08:14.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.518+0000 7f70a1200640 1 -- 172.21.15.37:0/3480132126 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c0aa690 con 0x55a16e89d990 2024-08-20T05:08:14.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.518+0000 7f70b5dd8740 1 -- 172.21.15.37:0/3480132126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e89d990 msgr2=0x55a16e8bee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:14.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.518+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/3480132126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e89d990 0x55a16e8bee00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f709c0057a0 tx=0x7f709c0e7e50 comp rx=0 tx=0).stop 2024-08-20T05:08:14.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.518+0000 7f70b5dd8740 1 -- 172.21.15.37:0/3480132126 shutdown_connections 2024-08-20T05:08:14.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.518+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/3480132126 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e8aa240 0x55a16e8a4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.518+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/3480132126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89e2b0 0x55a16e8bf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.518+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/3480132126 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e89d990 0x55a16e8bee00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.518+0000 7f70b5dd8740 1 -- 172.21.15.37:0/3480132126 >> 172.21.15.37:0/3480132126 conn(0x55a16e89b7c0 msgr2=0x55a16e89cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:14.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.518+0000 7f70b5dd8740 1 -- 172.21.15.37:0/3480132126 shutdown_connections 2024-08-20T05:08:14.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.518+0000 7f70b5dd8740 1 -- 172.21.15.37:0/3480132126 wait complete. 2024-08-20T05:08:14.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.519+0000 7f70b5dd8740 1 -- start start 2024-08-20T05:08:14.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.519+0000 7f70b5dd8740 1 Processor -- start 2024-08-20T05:08:14.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.519+0000 7f70b5dd8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e89d990 0x55a16e8bcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.519+0000 7f70b5dd8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89e2b0 0x55a16e8bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.519+0000 7f70b5dd8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e8aa240 0x55a16e8bd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.520+0000 7f70b5dd8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1b71d0 con 0x55a16e89e2b0 2024-08-20T05:08:14.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.520+0000 7f70b5dd8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1b6b00 con 0x55a16e89d990 2024-08-20T05:08:14.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.520+0000 7f70b5dd8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70ac1b3d40 con 0x55a16e8aa240 2024-08-20T05:08:14.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.520+0000 7f70b5dd8740 10 client.0 _ll_register_callbacks cb 0x7f70a4009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:14.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.520+0000 7f70a3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89e2b0 0x55a16e8bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.520+0000 7f70a3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89e2b0 0x55a16e8bd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33212/0 (socket says 172.21.15.37:33212) 2024-08-20T05:08:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.520+0000 7f70a3e00640 1 -- 172.21.15.37:0/1699653326 learned_addr learned my addr 172.21.15.37:0/1699653326 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.520+0000 7f70b0a00640 1 --2- 172.21.15.37:0/1699653326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e89d990 0x55a16e8bcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.520+0000 7f70b1400640 1 --2- 172.21.15.37:0/1699653326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e8aa240 0x55a16e8bd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.520+0000 7f70a3e00640 1 -- 172.21.15.37:0/1699653326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e8aa240 msgr2=0x55a16e8bd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.520+0000 7f70a3e00640 1 --2- 172.21.15.37:0/1699653326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e8aa240 0x55a16e8bd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.520+0000 7f70a3e00640 1 -- 172.21.15.37:0/1699653326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e89d990 msgr2=0x55a16e8bcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.520+0000 7f70a3e00640 1 --2- 172.21.15.37:0/1699653326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e89d990 0x55a16e8bcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.520+0000 7f70a3e00640 1 -- 172.21.15.37:0/1699653326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a16e9233b0 con 0x55a16e89e2b0 2024-08-20T05:08:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.520+0000 7f70b0a00640 1 --2- 172.21.15.37:0/1699653326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e89d990 0x55a16e8bcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.521+0000 7f70a3e00640 1 --2- 172.21.15.37:0/1699653326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89e2b0 0x55a16e8bd240 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f709402a910 tx=0x7f7094005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ecf51f65f287e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.521+0000 7f709a000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:08:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.521+0000 7f709a000640 1 -- 172.21.15.37:0/1699653326 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7094035070 con 0x55a16e89e2b0 2024-08-20T05:08:14.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.521+0000 7f70b5dd8740 1 -- 172.21.15.37:0/1699653326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f709c0aaa30 con 0x55a16e89e2b0 2024-08-20T05:08:14.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.521+0000 7f709a000640 1 -- 172.21.15.37:0/1699653326 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f70940315a0 con 0x55a16e89e2b0 2024-08-20T05:08:14.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.521+0000 7f709a000640 1 -- 172.21.15.37:0/1699653326 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f7094005850 con 0x55a16e89e2b0 2024-08-20T05:08:14.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.521+0000 7f70b5dd8740 10 client.16737 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:14.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.521+0000 7f70b5dd8740 1 -- 172.21.15.37:0/1699653326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55a16e9246b0 con 0x55a16e89e2b0 2024-08-20T05:08:14.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.521+0000 7f709a000640 1 -- 172.21.15.37:0/1699653326 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f709c0aaa30 con 0x55a16e89e2b0 2024-08-20T05:08:14.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.522+0000 7f709a000640 1 -- 172.21.15.37:0/1699653326 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f7094055040 con 0x55a16e89e2b0 2024-08-20T05:08:14.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.522+0000 7f70b5dd8740 10 client.16737 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:14.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.522+0000 7f70b5dd8740 10 client.16737 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:08:14.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.522+0000 7f70b5dd8740 20 client.16737 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:14.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.522+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/1699653326 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55a16e924c60 0x55a16e927080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:14.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.522+0000 7f70b5dd8740 4 client.16737 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:08:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.522+0000 7f70b5dd8740 1 -- 172.21.15.37:0/1699653326 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a16e811490 con 0x55a16e924c60 2024-08-20T05:08:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.522+0000 7f70b0a00640 1 --2- 172.21.15.37:0/1699653326 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55a16e924c60 0x55a16e927080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.523+0000 7f70b0a00640 1 --2- 172.21.15.37:0/1699653326 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55a16e924c60 0x55a16e927080 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1f8cc76028b86569 server_cookie=25ead3301ff34611 in_seq=0 out_seq=0 2024-08-20T05:08:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.523+0000 7f709a000640 10 client.16737 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:08:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.523+0000 7f709a000640 1 -- 172.21.15.37:0/1699653326 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a16e811490 con 0x55a16e924c60 2024-08-20T05:08:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.523+0000 7f709a000640 10 client.16737 handle_command_reply: tid=0 2024-08-20T05:08:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.523+0000 7f70b5dd8740 1 client.16737 shutdown 2024-08-20T05:08:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.523+0000 7f70b5dd8740 1 -- 172.21.15.37:0/1699653326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89e2b0 msgr2=0x55a16e8bd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.523+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/1699653326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89e2b0 0x55a16e8bd240 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f709402a910 tx=0x7f7094005d50 comp rx=0 tx=0).stop 2024-08-20T05:08:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.523+0000 7f70b5dd8740 1 -- 172.21.15.37:0/1699653326 shutdown_connections 2024-08-20T05:08:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.523+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/1699653326 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55a16e924c60 0x55a16e927080 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.523+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/1699653326 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a16e8aa240 0x55a16e8bd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.523+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/1699653326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a16e89e2b0 0x55a16e8bd240 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.523+0000 7f70b5dd8740 1 --2- 172.21.15.37:0/1699653326 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a16e89d990 0x55a16e8bcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.523+0000 7f709a000640 0 client.16737 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:08:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.523+0000 7f70b5dd8740 1 -- 172.21.15.37:0/1699653326 >> 172.21.15.37:0/1699653326 conn(0x55a16e89b7c0 msgr2=0x55a16e8a8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:14.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.523+0000 7f70b5dd8740 1 -- 172.21.15.37:0/1699653326 shutdown_connections 2024-08-20T05:08:14.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.523+0000 7f70b5dd8740 1 -- 172.21.15.37:0/1699653326 wait complete. 2024-08-20T05:08:14.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.523+0000 7f70b5dd8740 20 client.16737 trim_cache size 0 max 16384 2024-08-20T05:08:14.529 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:08:14.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.524+0000 7f70b3400640 1 -- 172.21.15.37:0/2947670980 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70900b3bd0 msgr2=0x7f70900b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:14.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.524+0000 7f70b3400640 1 --2- 172.21.15.37:0/2947670980 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70900b3bd0 0x7f70900b6090 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f70ac06be80 tx=0x7f70a4009500 comp rx=0 tx=0).stop 2024-08-20T05:08:14.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.524+0000 7f70b3400640 1 -- 172.21.15.37:0/2947670980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac077400 msgr2=0x7f70ac19f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:14.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.524+0000 7f70b3400640 1 --2- 172.21.15.37:0/2947670980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac077400 0x7f70ac19f5a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f709c00e9f0 tx=0x7f709c00edf0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.524+0000 7f70b3400640 1 -- 172.21.15.37:0/2947670980 shutdown_connections 2024-08-20T05:08:14.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.524+0000 7f70b3400640 1 --2- 172.21.15.37:0/2947670980 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70900b3bd0 0x7f70900b6090 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.524+0000 7f70b3400640 1 --2- 172.21.15.37:0/2947670980 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70ac113680 0x7f70ac1a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.524+0000 7f70b3400640 1 --2- 172.21.15.37:0/2947670980 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70ac077d20 0x7f70ac19fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.524+0000 7f70b3400640 1 --2- 172.21.15.37:0/2947670980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70ac077400 0x7f70ac19f5a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:14.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.524+0000 7f70b3400640 1 -- 172.21.15.37:0/2947670980 >> 172.21.15.37:0/2947670980 conn(0x7f70ac1006c0 msgr2=0x7f70ac102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:14.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.524+0000 7f70b3400640 1 -- 172.21.15.37:0/2947670980 shutdown_connections 2024-08-20T05:08:14.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:14.524+0000 7f70b3400640 1 -- 172.21.15.37:0/2947670980 wait complete. 2024-08-20T05:08:15.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T05:08:15.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:15 smithi037 ceph-mon[17265]: pgmap v581: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 MiB/s wr, 528 op/s 2024-08-20T05:08:15.845 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:08:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:15 smithi135 ceph-mon[22342]: pgmap v581: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 MiB/s wr, 528 op/s 2024-08-20T05:08:15.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:15 smithi130 ceph-mon[22007]: pgmap v581: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 MiB/s wr, 528 op/s 2024-08-20T05:08:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.376+0000 7f6bb4e00640 1 -- 172.21.15.37:0/2968342466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb010ef50 msgr2=0x7f6bb0111340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.376+0000 7f6bb4e00640 1 --2- 172.21.15.37:0/2968342466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb010ef50 0x7f6bb0111340 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009ca0 tx=0x7f6ba802a950 comp rx=0 tx=0).stop 2024-08-20T05:08:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.376+0000 7f6bb4e00640 1 -- 172.21.15.37:0/2968342466 shutdown_connections 2024-08-20T05:08:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.376+0000 7f6bb4e00640 1 --2- 172.21.15.37:0/2968342466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb010ef50 0x7f6bb0111340 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.376+0000 7f6bb4e00640 1 --2- 172.21.15.37:0/2968342466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bb0101cc0 0x7f6bb010ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.376+0000 7f6bb4e00640 1 --2- 172.21.15.37:0/2968342466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bb01013a0 0x7f6bb0101780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.376+0000 7f6bb4e00640 1 -- 172.21.15.37:0/2968342466 >> 172.21.15.37:0/2968342466 conn(0x7f6bb00fd2d0 msgr2=0x7f6bb00ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:16.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.377+0000 7f6bb4e00640 1 -- 172.21.15.37:0/2968342466 shutdown_connections 2024-08-20T05:08:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.377+0000 7f6bb4e00640 1 -- 172.21.15.37:0/2968342466 wait complete. 2024-08-20T05:08:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.377+0000 7f6bb4e00640 1 Processor -- start 2024-08-20T05:08:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.378+0000 7f6bb4e00640 1 -- start start 2024-08-20T05:08:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.378+0000 7f6bb4e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bb01013a0 0x7f6bb019ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.378+0000 7f6bb4e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bb0101cc0 0x7f6bb019b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.378+0000 7f6bb4e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb010ef50 0x7f6bb01a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.378+0000 7f6bb4e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb0114ad0 con 0x7f6bb010ef50 2024-08-20T05:08:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.378+0000 7f6bb4e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb0114950 con 0x7f6bb0101cc0 2024-08-20T05:08:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.378+0000 7f6bb4e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb0114c50 con 0x7f6bb01013a0 2024-08-20T05:08:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.378+0000 7f6bafe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb010ef50 0x7f6bb01a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.378+0000 7f6bafe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb010ef50 0x7f6bb01a0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33218/0 (socket says 172.21.15.37:33218) 2024-08-20T05:08:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.378+0000 7f6bafe00640 1 -- 172.21.15.37:0/2877339468 learned_addr learned my addr 172.21.15.37:0/2877339468 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.378+0000 7f6baf400640 1 --2- 172.21.15.37:0/2877339468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bb01013a0 0x7f6bb019ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.378+0000 7f6baea00640 1 --2- 172.21.15.37:0/2877339468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bb0101cc0 0x7f6bb019b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.379+0000 7f6bafe00640 1 -- 172.21.15.37:0/2877339468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bb01013a0 msgr2=0x7f6bb019ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.379+0000 7f6bafe00640 1 --2- 172.21.15.37:0/2877339468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bb01013a0 0x7f6bb019ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.379+0000 7f6bafe00640 1 -- 172.21.15.37:0/2877339468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bb0101cc0 msgr2=0x7f6bb019b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.379+0000 7f6bafe00640 1 --2- 172.21.15.37:0/2877339468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bb0101cc0 0x7f6bb019b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.379+0000 7f6bafe00640 1 -- 172.21.15.37:0/2877339468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb01a0f40 con 0x7f6bb010ef50 2024-08-20T05:08:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.379+0000 7f6bafe00640 1 --2- 172.21.15.37:0/2877339468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb010ef50 0x7f6bb01a0770 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8004af0 tx=0x7f6ba8031f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.379+0000 7f6ba7e00640 1 -- 172.21.15.37:0/2877339468 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8034040 con 0x7f6bb010ef50 2024-08-20T05:08:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.379+0000 7f6ba7e00640 1 -- 172.21.15.37:0/2877339468 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ba80308f0 con 0x7f6bb010ef50 2024-08-20T05:08:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.379+0000 7f6bb4e00640 1 -- 172.21.15.37:0/2877339468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb01a11d0 con 0x7f6bb010ef50 2024-08-20T05:08:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.379+0000 7f6ba7e00640 1 -- 172.21.15.37:0/2877339468 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8004600 con 0x7f6bb010ef50 2024-08-20T05:08:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.380+0000 7f6bb4e00640 1 -- 172.21.15.37:0/2877339468 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb01a78f0 con 0x7f6bb010ef50 2024-08-20T05:08:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.383+0000 7f6bb8e66740 1 Processor -- start 2024-08-20T05:08:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.383+0000 7f6ba7e00640 1 -- 172.21.15.37:0/2877339468 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6ba8037020 con 0x7f6bb010ef50 2024-08-20T05:08:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.383+0000 7f6bb8e66740 1 -- start start 2024-08-20T05:08:16.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.383+0000 7f6bb8e66740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c239ac0 0x55f46c239ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.383+0000 7f6bb8e66740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c23a3e0 0x55f46c245e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.383+0000 7f6bb8e66740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c246370 0x55f46c248760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.383+0000 7f6bb8e66740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f46c1afaa0 con 0x55f46c239ac0 2024-08-20T05:08:16.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.383+0000 7f6bb8e66740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f46c19efa0 con 0x55f46c23a3e0 2024-08-20T05:08:16.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.383+0000 7f6bb8e66740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f46c1a2fe0 con 0x55f46c246370 2024-08-20T05:08:16.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.384+0000 7f6baea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c239ac0 0x55f46c239ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.384+0000 7f6baf400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c23a3e0 0x55f46c245e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.384+0000 7f6baea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c239ac0 0x55f46c239ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33234/0 (socket says 172.21.15.37:33234) 2024-08-20T05:08:16.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.384+0000 7f6baea00640 1 -- 172.21.15.37:0/2945792998 learned_addr learned my addr 172.21.15.37:0/2945792998 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:16.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.384+0000 7f6baea00640 1 --2- 172.21.15.37:0/2945792998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c246370 0x55f46c248760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.384+0000 7f6baf400640 1 -- 172.21.15.37:0/2945792998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c246370 msgr2=0x55f46c248760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:16.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.384+0000 7f6baf400640 1 --2- 172.21.15.37:0/2945792998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c246370 0x55f46c248760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.384+0000 7f6baf400640 1 -- 172.21.15.37:0/2945792998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c239ac0 msgr2=0x55f46c239ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:16.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.384+0000 7f6baf400640 1 --2- 172.21.15.37:0/2945792998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c239ac0 0x55f46c239ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.384+0000 7f6baf400640 1 -- 172.21.15.37:0/2945792998 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f46c145420 con 0x55f46c23a3e0 2024-08-20T05:08:16.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.384+0000 7f6baea00640 1 --2- 172.21.15.37:0/2945792998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c239ac0 0x55f46c239ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.385+0000 7f6baf400640 1 --2- 172.21.15.37:0/2945792998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c23a3e0 0x55f46c245e30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009c20 tx=0x7f6ba0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c00194214f4509fa server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.385+0000 7f6ba7e00640 1 --2- 172.21.15.37:0/2877339468 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6b940b3cf0 0x7f6b940b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.385+0000 7f6ba4c00640 1 -- 172.21.15.37:0/2945792998 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0009dd0 con 0x55f46c23a3e0 2024-08-20T05:08:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.385+0000 7f6ba4c00640 1 -- 172.21.15.37:0/2945792998 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ba0005020 con 0x55f46c23a3e0 2024-08-20T05:08:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.385+0000 7f6ba7e00640 1 -- 172.21.15.37:0/2877339468 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6ba8104ad0 con 0x7f6bb010ef50 2024-08-20T05:08:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.385+0000 7f6ba4c00640 1 -- 172.21.15.37:0/2945792998 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0004b20 con 0x55f46c23a3e0 2024-08-20T05:08:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.385+0000 7f6baea00640 1 --2- 172.21.15.37:0/2877339468 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6b940b3cf0 0x7f6b940b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.386+0000 7f6bb8e66740 1 -- 172.21.15.37:0/2945792998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c23a3e0 msgr2=0x55f46c245e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.386+0000 7f6baea00640 1 --2- 172.21.15.37:0/2877339468 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6b940b3cf0 0x7f6b940b61b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009710 tx=0x7f6b9c009830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.386+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/2945792998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c23a3e0 0x55f46c245e30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009c20 tx=0x7f6ba0011810 comp rx=0 tx=0).stop 2024-08-20T05:08:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.386+0000 7f6bb8e66740 1 -- 172.21.15.37:0/2945792998 shutdown_connections 2024-08-20T05:08:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.386+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/2945792998 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c246370 0x55f46c248760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.386+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/2945792998 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c23a3e0 0x55f46c245e30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.386+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/2945792998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c239ac0 0x55f46c239ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.386+0000 7f6bb8e66740 1 -- 172.21.15.37:0/2945792998 >> 172.21.15.37:0/2945792998 conn(0x55f46c2378f0 msgr2=0x55f46c238a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.386+0000 7f6bb8e66740 1 -- 172.21.15.37:0/2945792998 shutdown_connections 2024-08-20T05:08:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.386+0000 7f6bb8e66740 1 -- 172.21.15.37:0/2945792998 wait complete. 2024-08-20T05:08:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.387+0000 7f6bb8e66740 1 -- start start 2024-08-20T05:08:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.387+0000 7f6bb8e66740 1 Processor -- start 2024-08-20T05:08:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.387+0000 7f6bb8e66740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c239ac0 0x55f46c245ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.387+0000 7f6bb8e66740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c23a3e0 0x55f46c242f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.387+0000 7f6bb8e66740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c246370 0x55f46c243470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.387+0000 7f6bb8e66740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f46c001700 con 0x55f46c239ac0 2024-08-20T05:08:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.387+0000 7f6bb8e66740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f46c13a290 con 0x55f46c23a3e0 2024-08-20T05:08:16.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.387+0000 7f6bb8e66740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f46c248ff0 con 0x55f46c246370 2024-08-20T05:08:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.387+0000 7f6bb8e66740 10 client.0 _ll_register_callbacks cb 0x55f46c1991c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.388+0000 7f6baf400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c239ac0 0x55f46c245ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.388+0000 7f6baea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c23a3e0 0x55f46c242f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.388+0000 7f6baf400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c239ac0 0x55f46c245ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33242/0 (socket says 172.21.15.37:33242) 2024-08-20T05:08:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.388+0000 7f6baf400640 1 -- 172.21.15.37:0/609837502 learned_addr learned my addr 172.21.15.37:0/609837502 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.388+0000 7f6bafe00640 1 --2- 172.21.15.37:0/609837502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c246370 0x55f46c243470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.388+0000 7f6baf400640 1 -- 172.21.15.37:0/609837502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c246370 msgr2=0x55f46c243470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.388+0000 7f6baf400640 1 --2- 172.21.15.37:0/609837502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c246370 0x55f46c243470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.388+0000 7f6baf400640 1 -- 172.21.15.37:0/609837502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c23a3e0 msgr2=0x55f46c242f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.388+0000 7f6baf400640 1 --2- 172.21.15.37:0/609837502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c23a3e0 0x55f46c242f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.388+0000 7f6baf400640 1 -- 172.21.15.37:0/609837502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f46befe650 con 0x55f46c239ac0 2024-08-20T05:08:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.388+0000 7f6bafe00640 1 --2- 172.21.15.37:0/609837502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c246370 0x55f46c243470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:08:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.388+0000 7f6baf400640 1 --2- 172.21.15.37:0/609837502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c239ac0 0x55f46c245ae0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6ba001b040 tx=0x7f6ba0005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc99a79dc5336e62 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.388+0000 7f6b99600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:08:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.389+0000 7f6b99600640 1 -- 172.21.15.37:0/609837502 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0029020 con 0x55f46c239ac0 2024-08-20T05:08:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.389+0000 7f6b99600640 1 -- 172.21.15.37:0/609837502 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6ba0004ab0 con 0x55f46c239ac0 2024-08-20T05:08:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.389+0000 7f6bb8e66740 1 -- 172.21.15.37:0/609837502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ba0005020 con 0x55f46c239ac0 2024-08-20T05:08:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.389+0000 7f6b99600640 1 -- 172.21.15.37:0/609837502 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6ba0034050 con 0x55f46c239ac0 2024-08-20T05:08:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.389+0000 7f6bb8e66740 10 client.16749 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.389+0000 7f6bb8e66740 1 -- 172.21.15.37:0/609837502 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f46c254830 con 0x55f46c239ac0 2024-08-20T05:08:16.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.389+0000 7f6b99600640 1 -- 172.21.15.37:0/609837502 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ba0005020 con 0x55f46c239ac0 2024-08-20T05:08:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.390+0000 7f6b99600640 1 -- 172.21.15.37:0/609837502 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f6ba0023420 con 0x55f46c239ac0 2024-08-20T05:08:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.390+0000 7f6bb8e66740 10 client.16749 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.390+0000 7f6bb8e66740 10 client.16749 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.390+0000 7f6bb8e66740 20 client.16749 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.390+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/609837502 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f46c255c90 0x55f46c258080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.390+0000 7f6bb8e66740 4 client.16749 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:08:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.390+0000 7f6bb8e66740 1 -- 172.21.15.37:0/609837502 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f46c1b19f0 con 0x55f46c255c90 2024-08-20T05:08:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.390+0000 7f6baea00640 1 --2- 172.21.15.37:0/609837502 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f46c255c90 0x55f46c258080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.391+0000 7f6baea00640 1 --2- 172.21.15.37:0/609837502 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f46c255c90 0x55f46c258080 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84187c8d36d27acc server_cookie=6805688d561212b3 in_seq=0 out_seq=0 2024-08-20T05:08:16.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.391+0000 7f6b99600640 10 client.16749 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:16.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.392+0000 7f6b99600640 1 -- 172.21.15.37:0/609837502 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f46c1b19f0 con 0x55f46c255c90 2024-08-20T05:08:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.392+0000 7f6b99600640 10 client.16749 handle_command_reply: tid=0 2024-08-20T05:08:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.392+0000 7f6bb8e66740 1 client.16749 shutdown 2024-08-20T05:08:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.392+0000 7f6bb8e66740 1 -- 172.21.15.37:0/609837502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c239ac0 msgr2=0x55f46c245ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.392+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/609837502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c239ac0 0x55f46c245ae0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6ba001b040 tx=0x7f6ba0005720 comp rx=0 tx=0).stop 2024-08-20T05:08:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.392+0000 7f6bb8e66740 1 -- 172.21.15.37:0/609837502 shutdown_connections 2024-08-20T05:08:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.392+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/609837502 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f46c255c90 0x55f46c258080 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.392+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/609837502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c246370 0x55f46c243470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.392+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/609837502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c23a3e0 0x55f46c242f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.392+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/609837502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c239ac0 0x55f46c245ae0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.392+0000 7f6bb8e66740 1 -- 172.21.15.37:0/609837502 >> 172.21.15.37:0/609837502 conn(0x55f46c2378f0 msgr2=0x55f46c23d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.392+0000 7f6b99600640 0 client.16749 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.392+0000 7f6bb8e66740 1 -- 172.21.15.37:0/609837502 shutdown_connections 2024-08-20T05:08:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.392+0000 7f6bb8e66740 1 -- 172.21.15.37:0/609837502 wait complete. 2024-08-20T05:08:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.392+0000 7f6bb8e66740 20 client.16749 trim_cache size 0 max 16384 2024-08-20T05:08:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.406+0000 7f6bb8e66740 1 Processor -- start 2024-08-20T05:08:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.406+0000 7f6bb8e66740 1 -- start start 2024-08-20T05:08:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.407+0000 7f6bb8e66740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c239ac0 0x55f46c25d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.407+0000 7f6bb8e66740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c23a3e0 0x55f46c25de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.407+0000 7f6bb8e66740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c246370 0x55f46c2362b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.407+0000 7f6bb8e66740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9000fbd0 con 0x55f46c23a3e0 2024-08-20T05:08:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.407+0000 7f6bb8e66740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90011710 con 0x55f46c239ac0 2024-08-20T05:08:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.407+0000 7f6bb8e66740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b900102a0 con 0x55f46c246370 2024-08-20T05:08:16.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.407+0000 7f6baea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c23a3e0 0x55f46c25de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.407+0000 7f6baea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c23a3e0 0x55f46c25de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33244/0 (socket says 172.21.15.37:33244) 2024-08-20T05:08:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.407+0000 7f6baea00640 1 -- 172.21.15.37:0/922814307 learned_addr learned my addr 172.21.15.37:0/922814307 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.407+0000 7f6baf400640 1 --2- 172.21.15.37:0/922814307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c239ac0 0x55f46c25d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.407+0000 7f6bafe00640 1 --2- 172.21.15.37:0/922814307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c246370 0x55f46c2362b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.407+0000 7f6baf400640 1 -- 172.21.15.37:0/922814307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c246370 msgr2=0x55f46c2362b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:16.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.407+0000 7f6baf400640 1 --2- 172.21.15.37:0/922814307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c246370 0x55f46c2362b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.407+0000 7f6baf400640 1 -- 172.21.15.37:0/922814307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c23a3e0 msgr2=0x55f46c25de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.407+0000 7f6baf400640 1 --2- 172.21.15.37:0/922814307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c23a3e0 0x55f46c25de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.408+0000 7f6baf400640 1 -- 172.21.15.37:0/922814307 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f46c244200 con 0x55f46c239ac0 2024-08-20T05:08:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.408+0000 7f6baf400640 1 --2- 172.21.15.37:0/922814307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c239ac0 0x55f46c25d900 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0023a00 tx=0x7f6ba0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d166e982b140ae81 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.408+0000 7f6b9be00640 1 -- 172.21.15.37:0/922814307 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0029030 con 0x55f46c239ac0 2024-08-20T05:08:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.408+0000 7f6b9be00640 1 -- 172.21.15.37:0/922814307 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ba0016070 con 0x55f46c239ac0 2024-08-20T05:08:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.408+0000 7f6b9be00640 1 -- 172.21.15.37:0/922814307 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba00042d0 con 0x55f46c239ac0 2024-08-20T05:08:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.409+0000 7f6bb8e66740 1 -- 172.21.15.37:0/922814307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c239ac0 msgr2=0x55f46c25d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.409+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/922814307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c239ac0 0x55f46c25d900 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0023a00 tx=0x7f6ba0011810 comp rx=0 tx=0).stop 2024-08-20T05:08:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.409+0000 7f6bb8e66740 1 -- 172.21.15.37:0/922814307 shutdown_connections 2024-08-20T05:08:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.409+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/922814307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c246370 0x55f46c2362b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.409+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/922814307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c23a3e0 0x55f46c25de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.409+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/922814307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c239ac0 0x55f46c25d900 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.409+0000 7f6bb8e66740 1 -- 172.21.15.37:0/922814307 >> 172.21.15.37:0/922814307 conn(0x55f46c2378f0 msgr2=0x55f46c23e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:16.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.409+0000 7f6bb8e66740 1 -- 172.21.15.37:0/922814307 shutdown_connections 2024-08-20T05:08:16.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.409+0000 7f6bb8e66740 1 -- 172.21.15.37:0/922814307 wait complete. 2024-08-20T05:08:16.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.409+0000 7f6bb8e66740 1 -- start start 2024-08-20T05:08:16.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.409+0000 7f6bb8e66740 1 Processor -- start 2024-08-20T05:08:16.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.410+0000 7f6bb8e66740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c239ac0 0x55f46c24eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.410+0000 7f6bb8e66740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c23a3e0 0x55f46c2492d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.410+0000 7f6bb8e66740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c246370 0x55f46c2499a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.410+0000 7f6bb8e66740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90011040 con 0x55f46c23a3e0 2024-08-20T05:08:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.410+0000 7f6bb8e66740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6b90010970 con 0x55f46c246370 2024-08-20T05:08:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.410+0000 7f6bb8e66740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9000dbb0 con 0x55f46c239ac0 2024-08-20T05:08:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.410+0000 7f6bb8e66740 10 client.0 _ll_register_callbacks cb 0x7f6b9c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.410+0000 7f6baf400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c239ac0 0x55f46c24eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.410+0000 7f6baea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c23a3e0 0x55f46c2492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.410+0000 7f6baf400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c239ac0 0x55f46c24eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:40758/0 (socket says 172.21.15.37:40758) 2024-08-20T05:08:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.410+0000 7f6baf400640 1 -- 172.21.15.37:0/24300893 learned_addr learned my addr 172.21.15.37:0/24300893 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.410+0000 7f6bafe00640 1 --2- 172.21.15.37:0/24300893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c246370 0x55f46c2499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.411+0000 7f6baf400640 1 -- 172.21.15.37:0/24300893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c246370 msgr2=0x55f46c2499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.411+0000 7f6baf400640 1 --2- 172.21.15.37:0/24300893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c246370 0x55f46c2499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.411+0000 7f6baf400640 1 -- 172.21.15.37:0/24300893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c23a3e0 msgr2=0x55f46c2492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.411+0000 7f6baf400640 1 --2- 172.21.15.37:0/24300893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c23a3e0 0x55f46c2492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.411+0000 7f6baf400640 1 -- 172.21.15.37:0/24300893 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f46c2be8c0 con 0x55f46c239ac0 2024-08-20T05:08:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.411+0000 7f6baf400640 1 --2- 172.21.15.37:0/24300893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c239ac0 0x55f46c24eb60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0023980 tx=0x7f6ba0004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1baecf4ef49db7e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.411+0000 7f6b99600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:08:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.411+0000 7f6b99600640 1 -- 172.21.15.37:0/24300893 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0040070 con 0x55f46c239ac0 2024-08-20T05:08:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.411+0000 7f6bb8e66740 1 -- 172.21.15.37:0/24300893 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ba0016070 con 0x55f46c239ac0 2024-08-20T05:08:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.412+0000 7f6b99600640 1 -- 172.21.15.37:0/24300893 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6ba0023c80 con 0x55f46c239ac0 2024-08-20T05:08:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.412+0000 7f6b99600640 1 -- 172.21.15.37:0/24300893 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6ba0029040 con 0x55f46c239ac0 2024-08-20T05:08:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.412+0000 7f6bb8e66740 10 client.27085 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.412+0000 7f6bb8e66740 1 -- 172.21.15.37:0/24300893 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55f46c2bfac0 con 0x55f46c239ac0 2024-08-20T05:08:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.412+0000 7f6b99600640 1 -- 172.21.15.37:0/24300893 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ba0016070 con 0x55f46c239ac0 2024-08-20T05:08:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.412+0000 7f6b99600640 1 -- 172.21.15.37:0/24300893 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f6ba00397e0 con 0x55f46c239ac0 2024-08-20T05:08:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.412+0000 7f6bb8e66740 10 client.27085 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.412+0000 7f6bb8e66740 10 client.27085 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:16.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.412+0000 7f6bb8e66740 20 client.27085 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:16.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.412+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/24300893 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f46c2c0150 0x55f46c2c2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:16.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.412+0000 7f6bb8e66740 4 client.27085 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:08:16.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.412+0000 7f6bb8e66740 1 -- 172.21.15.37:0/24300893 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f46c1ad490 con 0x55f46c2c0150 2024-08-20T05:08:16.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.413+0000 7f6baea00640 1 --2- 172.21.15.37:0/24300893 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f46c2c0150 0x55f46c2c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:16.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.413+0000 7f6baea00640 1 --2- 172.21.15.37:0/24300893 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f46c2c0150 0x55f46c2c2570 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48137328c98e53bc server_cookie=6c03de3fb3da73e5 in_seq=0 out_seq=0 2024-08-20T05:08:16.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.413+0000 7f6b99600640 10 client.27085 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:16.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.414+0000 7f6b99600640 1 -- 172.21.15.37:0/24300893 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f46c1ad490 con 0x55f46c2c0150 2024-08-20T05:08:16.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.414+0000 7f6b99600640 10 client.27085 handle_command_reply: tid=0 2024-08-20T05:08:16.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.414+0000 7f6bb8e66740 1 client.27085 shutdown 2024-08-20T05:08:16.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.414+0000 7f6bb8e66740 1 -- 172.21.15.37:0/24300893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c239ac0 msgr2=0x55f46c24eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:16.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.414+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/24300893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c239ac0 0x55f46c24eb60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0023980 tx=0x7f6ba0004830 comp rx=0 tx=0).stop 2024-08-20T05:08:16.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.414+0000 7f6bb8e66740 1 -- 172.21.15.37:0/24300893 shutdown_connections 2024-08-20T05:08:16.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.414+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/24300893 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f46c2c0150 0x55f46c2c2570 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.414+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/24300893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f46c246370 0x55f46c2499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.414+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/24300893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f46c23a3e0 0x55f46c2492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.414+0000 7f6bb8e66740 1 --2- 172.21.15.37:0/24300893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f46c239ac0 0x55f46c24eb60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.414+0000 7f6bb8e66740 1 -- 172.21.15.37:0/24300893 >> 172.21.15.37:0/24300893 conn(0x55f46c2378f0 msgr2=0x55f46c2362b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.414+0000 7f6b99600640 0 client.27085 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.414+0000 7f6bb8e66740 1 -- 172.21.15.37:0/24300893 shutdown_connections 2024-08-20T05:08:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.414+0000 7f6bb8e66740 1 -- 172.21.15.37:0/24300893 wait complete. 2024-08-20T05:08:16.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.414+0000 7f6bb8e66740 20 client.27085 trim_cache size 0 max 16384 2024-08-20T05:08:16.420 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:08:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.415+0000 7f6bb4e00640 1 -- 172.21.15.37:0/2877339468 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6b940b3cf0 msgr2=0x7f6b940b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.415+0000 7f6bb4e00640 1 --2- 172.21.15.37:0/2877339468 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6b940b3cf0 0x7f6b940b61b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009710 tx=0x7f6b9c009830 comp rx=0 tx=0).stop 2024-08-20T05:08:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.415+0000 7f6bb4e00640 1 -- 172.21.15.37:0/2877339468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb010ef50 msgr2=0x7f6bb01a0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.415+0000 7f6bb4e00640 1 --2- 172.21.15.37:0/2877339468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb010ef50 0x7f6bb01a0770 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8004af0 tx=0x7f6ba8031f50 comp rx=0 tx=0).stop 2024-08-20T05:08:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.415+0000 7f6bb4e00640 1 -- 172.21.15.37:0/2877339468 shutdown_connections 2024-08-20T05:08:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.415+0000 7f6bb4e00640 1 --2- 172.21.15.37:0/2877339468 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6b940b3cf0 0x7f6b940b61b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.415+0000 7f6bb4e00640 1 --2- 172.21.15.37:0/2877339468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bb010ef50 0x7f6bb01a0770 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.415+0000 7f6bb4e00640 1 --2- 172.21.15.37:0/2877339468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bb0101cc0 0x7f6bb019b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.415+0000 7f6bb4e00640 1 --2- 172.21.15.37:0/2877339468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bb01013a0 0x7f6bb019ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.415+0000 7f6bb4e00640 1 -- 172.21.15.37:0/2877339468 >> 172.21.15.37:0/2877339468 conn(0x7f6bb00fd2d0 msgr2=0x7f6bb01101d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.415+0000 7f6bb4e00640 1 -- 172.21.15.37:0/2877339468 shutdown_connections 2024-08-20T05:08:16.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:16.415+0000 7f6bb4e00640 1 -- 172.21.15.37:0/2877339468 wait complete. 2024-08-20T05:08:17.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:17 smithi135 ceph-mon[22342]: pgmap v582: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 528 op/s 2024-08-20T05:08:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:17 smithi130 ceph-mon[22007]: pgmap v582: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 528 op/s 2024-08-20T05:08:18.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:17 smithi037 ceph-mon[17265]: pgmap v582: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 MiB/s wr, 528 op/s 2024-08-20T05:08:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 320.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:08:18.236 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:08:18.346 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.344+0000 7f35fd200640 1 -- 172.21.15.37:0/1866236065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35f81063b0 msgr2=0x7f35f810cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.344+0000 7f35fd200640 1 --2- 172.21.15.37:0/1866236065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35f81063b0 0x7f35f810cd30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009cd0 tx=0x7f35f002a8e0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.344+0000 7f35fd200640 1 -- 172.21.15.37:0/1866236065 shutdown_connections 2024-08-20T05:08:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.344+0000 7f35fd200640 1 --2- 172.21.15.37:0/1866236065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35f81063b0 0x7f35f810cd30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.344+0000 7f35fd200640 1 --2- 172.21.15.37:0/1866236065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35f81059f0 0x7f35f8105e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.344+0000 7f35fd200640 1 --2- 172.21.15.37:0/1866236065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35f81048a0 0x7f35f8104ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.344+0000 7f35fd200640 1 -- 172.21.15.37:0/1866236065 >> 172.21.15.37:0/1866236065 conn(0x7f35f8100160 msgr2=0x7f35f8102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.344+0000 7f35fd200640 1 -- 172.21.15.37:0/1866236065 shutdown_connections 2024-08-20T05:08:18.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.344+0000 7f35fd200640 1 -- 172.21.15.37:0/1866236065 wait complete. 2024-08-20T05:08:18.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.345+0000 7f35fd200640 1 Processor -- start 2024-08-20T05:08:18.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.345+0000 7f35fd200640 1 -- start start 2024-08-20T05:08:18.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.346+0000 7f35fd200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35f81048a0 0x7f35f819abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.349 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.346+0000 7f35fd200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35f81059f0 0x7f35f819b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.346+0000 7f35fd200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35f81063b0 0x7f35f819be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.346+0000 7f35fd200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f35f8110540 con 0x7f35f81048a0 2024-08-20T05:08:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.346+0000 7f35fd200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81103c0 con 0x7f35f81059f0 2024-08-20T05:08:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.346+0000 7f35fd200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81106c0 con 0x7f35f81063b0 2024-08-20T05:08:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.346+0000 7f35f5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35f81048a0 0x7f35f819abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.346+0000 7f35f5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35f81048a0 0x7f35f819abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33278/0 (socket says 172.21.15.37:33278) 2024-08-20T05:08:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.346+0000 7f35f5e00640 1 -- 172.21.15.37:0/1401628303 learned_addr learned my addr 172.21.15.37:0/1401628303 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.346+0000 7f35f6800640 1 --2- 172.21.15.37:0/1401628303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35f81063b0 0x7f35f819be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.346+0000 7f35f5400640 1 --2- 172.21.15.37:0/1401628303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35f81059f0 0x7f35f819b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.346+0000 7f35f5e00640 1 -- 172.21.15.37:0/1401628303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35f81063b0 msgr2=0x7f35f819be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.346+0000 7f35f5e00640 1 --2- 172.21.15.37:0/1401628303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35f81063b0 0x7f35f819be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.346+0000 7f35f5e00640 1 -- 172.21.15.37:0/1401628303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35f81059f0 msgr2=0x7f35f819b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:18.350 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.346+0000 7f35f5e00640 1 --2- 172.21.15.37:0/1401628303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35f81059f0 0x7f35f819b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.346+0000 7f35f5e00640 1 -- 172.21.15.37:0/1401628303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f819c720 con 0x7f35f81048a0 2024-08-20T05:08:18.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.347+0000 7f35f6800640 1 --2- 172.21.15.37:0/1401628303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35f81063b0 0x7f35f819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:18.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.347+0000 7f35f5400640 1 --2- 172.21.15.37:0/1401628303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35f81059f0 0x7f35f819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:18.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.347+0000 7f35f5e00640 1 --2- 172.21.15.37:0/1401628303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35f81048a0 0x7f35f819abe0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f35e800e9f0 tx=0x7f35e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:18.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.347+0000 7f35eea00640 1 -- 172.21.15.37:0/1401628303 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e800cd80 con 0x7f35f81048a0 2024-08-20T05:08:18.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.347+0000 7f35eea00640 1 -- 172.21.15.37:0/1401628303 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35e80108e0 con 0x7f35f81048a0 2024-08-20T05:08:18.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.347+0000 7f35fd200640 1 -- 172.21.15.37:0/1401628303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f819ca10 con 0x7f35f81048a0 2024-08-20T05:08:18.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.347+0000 7f35eea00640 1 -- 172.21.15.37:0/1401628303 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e8018980 con 0x7f35f81048a0 2024-08-20T05:08:18.351 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.347+0000 7f35fd200640 1 -- 172.21.15.37:0/1401628303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f81a30e0 con 0x7f35f81048a0 2024-08-20T05:08:18.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.350+0000 7f360004c740 1 Processor -- start 2024-08-20T05:08:18.352 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.351+0000 7f360004c740 1 -- start start 2024-08-20T05:08:18.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.351+0000 7f360004c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 0x5638fc211a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.351+0000 7f360004c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc211f40 0x5638fc214330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.353 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.351+0000 7f360004c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc214980 0x5638fc216e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.351+0000 7f360004c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5638fc182210 con 0x5638fc20f610 2024-08-20T05:08:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.351+0000 7f360004c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5638fc171710 con 0x5638fc214980 2024-08-20T05:08:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.351+0000 7f360004c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5638fc175750 con 0x5638fc211f40 2024-08-20T05:08:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.351+0000 7f35f6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 0x5638fc211a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.351+0000 7f35f6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 0x5638fc211a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33292/0 (socket says 172.21.15.37:33292) 2024-08-20T05:08:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.351+0000 7f35f6800640 1 -- 172.21.15.37:0/2255851039 learned_addr learned my addr 172.21.15.37:0/2255851039 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.351+0000 7f35f5400640 1 --2- 172.21.15.37:0/2255851039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc214980 0x5638fc216e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.352+0000 7f35f6800640 1 -- 172.21.15.37:0/2255851039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc211f40 msgr2=0x5638fc214330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:08:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.352+0000 7f35f6800640 1 --2- 172.21.15.37:0/2255851039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc211f40 0x5638fc214330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.352+0000 7f35f6800640 1 -- 172.21.15.37:0/2255851039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc214980 msgr2=0x5638fc216e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.352+0000 7f35f6800640 1 --2- 172.21.15.37:0/2255851039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc214980 0x5638fc216e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.354 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.352+0000 7f35f6800640 1 -- 172.21.15.37:0/2255851039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638fc13dde0 con 0x5638fc20f610 2024-08-20T05:08:18.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.352+0000 7f35f6800640 1 --2- 172.21.15.37:0/2255851039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 0x5638fc211a00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f35f002aed0 tx=0x7f35f00093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0772a407d42231 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:18.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.352+0000 7f35e3400640 1 -- 172.21.15.37:0/2255851039 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f0048070 con 0x5638fc20f610 2024-08-20T05:08:18.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.352+0000 7f35e3400640 1 -- 172.21.15.37:0/2255851039 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f0036070 con 0x5638fc20f610 2024-08-20T05:08:18.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.352+0000 7f35e3400640 1 -- 172.21.15.37:0/2255851039 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f00047d0 con 0x5638fc20f610 2024-08-20T05:08:18.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.353+0000 7f35eea00640 1 -- 172.21.15.37:0/1401628303 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f35e8010430 con 0x7f35f81048a0 2024-08-20T05:08:18.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.353+0000 7f360004c740 1 -- 172.21.15.37:0/2255851039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 msgr2=0x5638fc211a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:18.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.353+0000 7f360004c740 1 --2- 172.21.15.37:0/2255851039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 0x5638fc211a00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f35f002aed0 tx=0x7f35f00093e0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.353+0000 7f360004c740 1 -- 172.21.15.37:0/2255851039 shutdown_connections 2024-08-20T05:08:18.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.353+0000 7f360004c740 1 --2- 172.21.15.37:0/2255851039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc214980 0x5638fc216e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.356 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.353+0000 7f360004c740 1 --2- 172.21.15.37:0/2255851039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc211f40 0x5638fc214330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.353+0000 7f360004c740 1 --2- 172.21.15.37:0/2255851039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 0x5638fc211a00 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.353+0000 7f360004c740 1 -- 172.21.15.37:0/2255851039 >> 172.21.15.37:0/2255851039 conn(0x5638fc20a760 msgr2=0x5638fc20b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:18.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.353+0000 7f360004c740 1 -- 172.21.15.37:0/2255851039 shutdown_connections 2024-08-20T05:08:18.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.353+0000 7f360004c740 1 -- 172.21.15.37:0/2255851039 wait complete. 2024-08-20T05:08:18.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.354+0000 7f360004c740 1 -- start start 2024-08-20T05:08:18.357 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.354+0000 7f360004c740 1 Processor -- start 2024-08-20T05:08:18.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.354+0000 7f360004c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 0x5638fc218cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.359 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.354+0000 7f360004c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc211f40 0x5638fc219390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.354+0000 7f360004c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc214980 0x5638fc219f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.354+0000 7f360004c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5638fc0aaab0 con 0x5638fc20f610 2024-08-20T05:08:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.354+0000 7f360004c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5638fc118140 con 0x5638fc211f40 2024-08-20T05:08:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.354+0000 7f360004c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5638fc217900 con 0x5638fc214980 2024-08-20T05:08:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.354+0000 7f360004c740 10 client.0 _ll_register_callbacks cb 0x5638fc12b5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.355+0000 7f35f6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 0x5638fc218cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.355+0000 7f35f6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 0x5638fc218cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33302/0 (socket says 172.21.15.37:33302) 2024-08-20T05:08:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.355+0000 7f35f6800640 1 -- 172.21.15.37:0/4038943234 learned_addr learned my addr 172.21.15.37:0/4038943234 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.355+0000 7f35f5400640 1 --2- 172.21.15.37:0/4038943234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc214980 0x5638fc219f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.355+0000 7f35eea00640 1 --2- 172.21.15.37:0/1401628303 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f35dc0b3ae0 0x7f35dc0b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.355+0000 7f35f5e00640 1 --2- 172.21.15.37:0/4038943234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc211f40 0x5638fc219390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:18.360 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.355+0000 7f35f6800640 1 --2- 172.21.15.37:0/1401628303 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f35dc0b3ae0 0x7f35dc0b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:18.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.355+0000 7f35f5400640 1 -- 172.21.15.37:0/4038943234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc211f40 msgr2=0x5638fc219390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:18.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.355+0000 7f35f5400640 1 --2- 172.21.15.37:0/4038943234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc211f40 0x5638fc219390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.355+0000 7f35f5400640 1 -- 172.21.15.37:0/4038943234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 msgr2=0x5638fc218cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:18.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.355+0000 7f35f5400640 1 --2- 172.21.15.37:0/4038943234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 0x5638fc218cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.355+0000 7f35f5400640 1 -- 172.21.15.37:0/4038943234 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638fc119170 con 0x5638fc214980 2024-08-20T05:08:18.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.355+0000 7f35eea00640 1 -- 172.21.15.37:0/1401628303 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f35e80e42a0 con 0x7f35f81048a0 2024-08-20T05:08:18.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.356+0000 7f35f5400640 1 --2- 172.21.15.37:0/4038943234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc214980 0x5638fc219f60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f35e4012d00 tx=0x7f35e400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db940a26ba0055ff server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:18.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.356+0000 7f35d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:08:18.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.356+0000 7f35d7e00640 1 -- 172.21.15.37:0/4038943234 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e4009d90 con 0x5638fc214980 2024-08-20T05:08:18.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.356+0000 7f35f6800640 1 --2- 172.21.15.37:0/1401628303 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f35dc0b3ae0 0x7f35dc0b5fa0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f35f0031e80 tx=0x7f35f002a8e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:18.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.356+0000 7f360004c740 1 -- 172.21.15.37:0/4038943234 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35f0036070 con 0x5638fc214980 2024-08-20T05:08:18.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.356+0000 7f35d7e00640 1 -- 172.21.15.37:0/4038943234 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f35e4012110 con 0x5638fc214980 2024-08-20T05:08:18.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.356+0000 7f35d7e00640 1 -- 172.21.15.37:0/4038943234 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f35e4025050 con 0x5638fc214980 2024-08-20T05:08:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.356+0000 7f360004c740 10 client.27094 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.356+0000 7f360004c740 1 -- 172.21.15.37:0/4038943234 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5638fbed4790 con 0x5638fc214980 2024-08-20T05:08:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.357+0000 7f35d7e00640 1 -- 172.21.15.37:0/4038943234 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f0036070 con 0x5638fc214980 2024-08-20T05:08:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.357+0000 7f35d7e00640 1 -- 172.21.15.37:0/4038943234 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f35e4003c60 con 0x5638fc214980 2024-08-20T05:08:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.357+0000 7f360004c740 10 client.27094 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.357+0000 7f360004c740 10 client.27094 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.357+0000 7f360004c740 20 client.27094 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.357+0000 7f360004c740 1 --2- 172.21.15.37:0/4038943234 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5638fc2249b0 0x5638fc226de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.357+0000 7f360004c740 4 client.27094 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:08:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.357+0000 7f360004c740 1 -- 172.21.15.37:0/4038943234 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638fc184160 con 0x5638fc2249b0 2024-08-20T05:08:18.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.358+0000 7f35f5e00640 1 --2- 172.21.15.37:0/4038943234 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5638fc2249b0 0x5638fc226de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.358+0000 7f35f5e00640 1 --2- 172.21.15.37:0/4038943234 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5638fc2249b0 0x5638fc226de0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=156bcd725b4b5239 server_cookie=1b67a40774e59e6e in_seq=0 out_seq=0 2024-08-20T05:08:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.358+0000 7f35d7e00640 10 client.27094 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.359+0000 7f35d7e00640 1 -- 172.21.15.37:0/4038943234 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638fc184160 con 0x5638fc2249b0 2024-08-20T05:08:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.359+0000 7f35d7e00640 10 client.27094 handle_command_reply: tid=0 2024-08-20T05:08:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.359+0000 7f360004c740 1 client.27094 shutdown 2024-08-20T05:08:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.359+0000 7f360004c740 1 -- 172.21.15.37:0/4038943234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc214980 msgr2=0x5638fc219f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.359+0000 7f360004c740 1 --2- 172.21.15.37:0/4038943234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc214980 0x5638fc219f60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f35e4012d00 tx=0x7f35e400f790 comp rx=0 tx=0).stop 2024-08-20T05:08:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.359+0000 7f360004c740 1 -- 172.21.15.37:0/4038943234 shutdown_connections 2024-08-20T05:08:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.359+0000 7f360004c740 1 --2- 172.21.15.37:0/4038943234 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5638fc2249b0 0x5638fc226de0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.359+0000 7f360004c740 1 --2- 172.21.15.37:0/4038943234 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc214980 0x5638fc219f60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.359+0000 7f360004c740 1 --2- 172.21.15.37:0/4038943234 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc211f40 0x5638fc219390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.359+0000 7f360004c740 1 --2- 172.21.15.37:0/4038943234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 0x5638fc218cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.359+0000 7f35d7e00640 0 client.27094 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:18.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.359+0000 7f360004c740 1 -- 172.21.15.37:0/4038943234 >> 172.21.15.37:0/4038943234 conn(0x5638fc20a760 msgr2=0x5638fc209760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:18.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.359+0000 7f360004c740 1 -- 172.21.15.37:0/4038943234 shutdown_connections 2024-08-20T05:08:18.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.360+0000 7f360004c740 1 -- 172.21.15.37:0/4038943234 wait complete. 2024-08-20T05:08:18.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.360+0000 7f360004c740 20 client.27094 trim_cache size 0 max 16384 2024-08-20T05:08:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.375+0000 7f360004c740 1 Processor -- start 2024-08-20T05:08:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.375+0000 7f360004c740 1 -- start start 2024-08-20T05:08:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.375+0000 7f360004c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc20f610 0x5638fc215470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.375+0000 7f360004c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc211f40 0x5638fc215a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.375+0000 7f360004c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc214980 0x5638fc215f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.375+0000 7f360004c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81ad410 con 0x5638fc211f40 2024-08-20T05:08:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.375+0000 7f360004c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81aef50 con 0x5638fc214980 2024-08-20T05:08:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.375+0000 7f360004c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81adae0 con 0x5638fc20f610 2024-08-20T05:08:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.376+0000 7f35f5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc211f40 0x5638fc215a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.376+0000 7f35f5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc211f40 0x5638fc215a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33314/0 (socket says 172.21.15.37:33314) 2024-08-20T05:08:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.376+0000 7f35f5400640 1 -- 172.21.15.37:0/687065172 learned_addr learned my addr 172.21.15.37:0/687065172 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.376+0000 7f35f6800640 1 --2- 172.21.15.37:0/687065172 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc214980 0x5638fc215f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.376+0000 7f35f5e00640 1 --2- 172.21.15.37:0/687065172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc20f610 0x5638fc215470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.376+0000 7f35f6800640 1 -- 172.21.15.37:0/687065172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc20f610 msgr2=0x5638fc215470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.376+0000 7f35f6800640 1 --2- 172.21.15.37:0/687065172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc20f610 0x5638fc215470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.376+0000 7f35f6800640 1 -- 172.21.15.37:0/687065172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc211f40 msgr2=0x5638fc215a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.376+0000 7f35f6800640 1 --2- 172.21.15.37:0/687065172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc211f40 0x5638fc215a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.376+0000 7f35f6800640 1 -- 172.21.15.37:0/687065172 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638fbf4d620 con 0x5638fc214980 2024-08-20T05:08:18.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.376+0000 7f35f5400640 1 --2- 172.21.15.37:0/687065172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc211f40 0x5638fc215a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:18.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.376+0000 7f35f5e00640 1 --2- 172.21.15.37:0/687065172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc20f610 0x5638fc215470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.377+0000 7f35f6800640 1 --2- 172.21.15.37:0/687065172 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc214980 0x5638fc215f80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f35f00316e0 tx=0x7f35f0050000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cbdb2f0a168d4dd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.377+0000 7f35e2a00640 1 -- 172.21.15.37:0/687065172 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f0054050 con 0x5638fc214980 2024-08-20T05:08:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.377+0000 7f35e2a00640 1 -- 172.21.15.37:0/687065172 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f0060070 con 0x5638fc214980 2024-08-20T05:08:18.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.377+0000 7f35e2a00640 1 -- 172.21.15.37:0/687065172 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f0048040 con 0x5638fc214980 2024-08-20T05:08:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.378+0000 7f360004c740 1 -- 172.21.15.37:0/687065172 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc214980 msgr2=0x5638fc215f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.378+0000 7f360004c740 1 --2- 172.21.15.37:0/687065172 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc214980 0x5638fc215f80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f35f00316e0 tx=0x7f35f0050000 comp rx=0 tx=0).stop 2024-08-20T05:08:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.378+0000 7f360004c740 1 -- 172.21.15.37:0/687065172 shutdown_connections 2024-08-20T05:08:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.378+0000 7f360004c740 1 --2- 172.21.15.37:0/687065172 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc214980 0x5638fc215f80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.378+0000 7f360004c740 1 --2- 172.21.15.37:0/687065172 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc211f40 0x5638fc215a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.378+0000 7f360004c740 1 --2- 172.21.15.37:0/687065172 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc20f610 0x5638fc215470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.378+0000 7f360004c740 1 -- 172.21.15.37:0/687065172 >> 172.21.15.37:0/687065172 conn(0x5638fc20a760 msgr2=0x5638fc214d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.378+0000 7f360004c740 1 -- 172.21.15.37:0/687065172 shutdown_connections 2024-08-20T05:08:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.378+0000 7f360004c740 1 -- 172.21.15.37:0/687065172 wait complete. 2024-08-20T05:08:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.378+0000 7f360004c740 1 -- start start 2024-08-20T05:08:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.378+0000 7f360004c740 1 Processor -- start 2024-08-20T05:08:18.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.379+0000 7f360004c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 0x5638fc220700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.379+0000 7f360004c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc211f40 0x5638fc220da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.379+0000 7f360004c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc214980 0x5638fc21f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.379+0000 7f360004c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81ae880 con 0x5638fc20f610 2024-08-20T05:08:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.379+0000 7f360004c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81ae1b0 con 0x5638fc214980 2024-08-20T05:08:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.379+0000 7f360004c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f35f81ab3f0 con 0x5638fc211f40 2024-08-20T05:08:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.379+0000 7f360004c740 10 client.0 _ll_register_callbacks cb 0x7f35e4009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.379+0000 7f35f5400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc211f40 0x5638fc220da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.379+0000 7f35f5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 0x5638fc220700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.379+0000 7f35f6800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc214980 0x5638fc21f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.379+0000 7f35f5400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc211f40 0x5638fc220da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:40792/0 (socket says 172.21.15.37:40792) 2024-08-20T05:08:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.379+0000 7f35f5400640 1 -- 172.21.15.37:0/3894787473 learned_addr learned my addr 172.21.15.37:0/3894787473 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.380+0000 7f35f5400640 1 -- 172.21.15.37:0/3894787473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc214980 msgr2=0x5638fc21f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:18.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.380+0000 7f35f5400640 1 --2- 172.21.15.37:0/3894787473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc214980 0x5638fc21f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.380+0000 7f35f5400640 1 -- 172.21.15.37:0/3894787473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 msgr2=0x5638fc220700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.380+0000 7f35f5400640 1 --2- 172.21.15.37:0/3894787473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 0x5638fc220700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.380+0000 7f35f5400640 1 -- 172.21.15.37:0/3894787473 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638fc21fd40 con 0x5638fc211f40 2024-08-20T05:08:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.380+0000 7f35f5400640 1 --2- 172.21.15.37:0/3894787473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc211f40 0x5638fc220da0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f35e400fd20 tx=0x7f35e400fd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a8960781813f99e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.380+0000 7f35d7e00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:08:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.380+0000 7f35d7e00640 1 -- 172.21.15.37:0/3894787473 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35e40105f0 con 0x5638fc211f40 2024-08-20T05:08:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.380+0000 7f360004c740 1 -- 172.21.15.37:0/3894787473 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35f0060070 con 0x5638fc211f40 2024-08-20T05:08:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.380+0000 7f35d7e00640 1 -- 172.21.15.37:0/3894787473 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f35e4010790 con 0x5638fc211f40 2024-08-20T05:08:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.380+0000 7f35d7e00640 1 -- 172.21.15.37:0/3894787473 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f35e403a050 con 0x5638fc211f40 2024-08-20T05:08:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.380+0000 7f360004c740 10 client.27100 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:18.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.381+0000 7f360004c740 1 -- 172.21.15.37:0/3894787473 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5638fc21ec60 con 0x5638fc211f40 2024-08-20T05:08:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.381+0000 7f35d7e00640 1 -- 172.21.15.37:0/3894787473 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35f0060070 con 0x5638fc211f40 2024-08-20T05:08:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.381+0000 7f35d7e00640 1 -- 172.21.15.37:0/3894787473 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f35e40055b0 con 0x5638fc211f40 2024-08-20T05:08:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.381+0000 7f360004c740 10 client.27100 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:18.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.381+0000 7f360004c740 10 client.27100 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:18.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.381+0000 7f360004c740 20 client.27100 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:18.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.381+0000 7f360004c740 1 --2- 172.21.15.37:0/3894787473 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5638fc28fdb0 0x5638fc2921d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:18.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.381+0000 7f360004c740 4 client.27100 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:08:18.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.381+0000 7f360004c740 1 -- 172.21.15.37:0/3894787473 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5638fc17fc00 con 0x5638fc28fdb0 2024-08-20T05:08:18.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.382+0000 7f35f5e00640 1 --2- 172.21.15.37:0/3894787473 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5638fc28fdb0 0x5638fc2921d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:18.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.382+0000 7f35f5e00640 1 --2- 172.21.15.37:0/3894787473 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5638fc28fdb0 0x5638fc2921d0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1aa502b224147c15 server_cookie=f37c78f513e421b6 in_seq=0 out_seq=0 2024-08-20T05:08:18.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.382+0000 7f35d7e00640 10 client.27100 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.393+0000 7f35d7e00640 1 -- 172.21.15.37:0/3894787473 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5638fc17fc00 con 0x5638fc28fdb0 2024-08-20T05:08:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.393+0000 7f35d7e00640 10 client.27100 handle_command_reply: tid=0 2024-08-20T05:08:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.393+0000 7f360004c740 1 client.27100 shutdown 2024-08-20T05:08:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.393+0000 7f360004c740 1 -- 172.21.15.37:0/3894787473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc211f40 msgr2=0x5638fc220da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.393+0000 7f360004c740 1 --2- 172.21.15.37:0/3894787473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc211f40 0x5638fc220da0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f35e400fd20 tx=0x7f35e400fd50 comp rx=0 tx=0).stop 2024-08-20T05:08:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.393+0000 7f360004c740 1 -- 172.21.15.37:0/3894787473 shutdown_connections 2024-08-20T05:08:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.393+0000 7f360004c740 1 --2- 172.21.15.37:0/3894787473 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5638fc28fdb0 0x5638fc2921d0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.393+0000 7f360004c740 1 --2- 172.21.15.37:0/3894787473 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5638fc214980 0x5638fc21f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.393+0000 7f360004c740 1 --2- 172.21.15.37:0/3894787473 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5638fc211f40 0x5638fc220da0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.393+0000 7f35d7e00640 0 client.27100 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.393+0000 7f360004c740 1 --2- 172.21.15.37:0/3894787473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638fc20f610 0x5638fc220700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.393+0000 7f360004c740 1 -- 172.21.15.37:0/3894787473 >> 172.21.15.37:0/3894787473 conn(0x5638fc20a760 msgr2=0x5638fc208f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.394+0000 7f360004c740 1 -- 172.21.15.37:0/3894787473 shutdown_connections 2024-08-20T05:08:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.394+0000 7f360004c740 1 -- 172.21.15.37:0/3894787473 wait complete. 2024-08-20T05:08:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.394+0000 7f360004c740 20 client.27100 trim_cache size 0 max 16384 2024-08-20T05:08:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:08:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:08:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:08:18.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:08:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.394+0000 7f35fd200640 1 -- 172.21.15.37:0/1401628303 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f35dc0b3ae0 msgr2=0x7f35dc0b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.394+0000 7f35fd200640 1 --2- 172.21.15.37:0/1401628303 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f35dc0b3ae0 0x7f35dc0b5fa0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f35f0031e80 tx=0x7f35f002a8e0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.394+0000 7f35fd200640 1 -- 172.21.15.37:0/1401628303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35f81048a0 msgr2=0x7f35f819abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.394+0000 7f35fd200640 1 --2- 172.21.15.37:0/1401628303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35f81048a0 0x7f35f819abe0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f35e800e9f0 tx=0x7f35e800eeb0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.395+0000 7f35fd200640 1 -- 172.21.15.37:0/1401628303 shutdown_connections 2024-08-20T05:08:18.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.395+0000 7f35fd200640 1 --2- 172.21.15.37:0/1401628303 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f35dc0b3ae0 0x7f35dc0b5fa0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.395+0000 7f35fd200640 1 --2- 172.21.15.37:0/1401628303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f35f81063b0 0x7f35f819be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.395+0000 7f35fd200640 1 --2- 172.21.15.37:0/1401628303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f35f81059f0 0x7f35f819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.395+0000 7f35fd200640 1 --2- 172.21.15.37:0/1401628303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35f81048a0 0x7f35f819abe0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.395+0000 7f35fd200640 1 -- 172.21.15.37:0/1401628303 >> 172.21.15.37:0/1401628303 conn(0x7f35f8100160 msgr2=0x7f35f8108d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.395+0000 7f35fd200640 1 -- 172.21.15.37:0/1401628303 shutdown_connections 2024-08-20T05:08:18.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:18.395+0000 7f35fd200640 1 -- 172.21.15.37:0/1401628303 wait complete. 2024-08-20T05:08:18.637 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:08:18.826 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T05:08:18.826 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T05:08:19.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.319+0000 7fd873200640 1 -- 172.21.15.37:0/1562526835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd87410ae90 msgr2=0x7fd874111690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:19.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.319+0000 7fd873200640 1 --2- 172.21.15.37:0/1562526835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd87410ae90 0x7fd874111690 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd86c009be0 tx=0x7fd86c02a6c0 comp rx=0 tx=0).stop 2024-08-20T05:08:19.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.319+0000 7fd873200640 1 -- 172.21.15.37:0/1562526835 shutdown_connections 2024-08-20T05:08:19.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.319+0000 7fd873200640 1 --2- 172.21.15.37:0/1562526835 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd87410ae90 0x7fd874111690 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:19.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.319+0000 7fd873200640 1 --2- 172.21.15.37:0/1562526835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87410a510 0x7fd87410a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.319+0000 7fd873200640 1 --2- 172.21.15.37:0/1562526835 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd874104b00 0x7fd874104ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.319+0000 7fd873200640 1 -- 172.21.15.37:0/1562526835 >> 172.21.15.37:0/1562526835 conn(0x7fd874100550 msgr2=0x7fd874102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.319+0000 7fd873200640 1 -- 172.21.15.37:0/1562526835 shutdown_connections 2024-08-20T05:08:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.319+0000 7fd873200640 1 -- 172.21.15.37:0/1562526835 wait complete. 2024-08-20T05:08:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.320+0000 7fd873200640 1 Processor -- start 2024-08-20T05:08:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.320+0000 7fd873200640 1 -- start start 2024-08-20T05:08:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.321+0000 7fd873200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd874104b00 0x7fd87419aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.321+0000 7fd873200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd87410a510 0x7fd87419b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.321+0000 7fd873200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87410ae90 0x7fd8741a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.321+0000 7fd873200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd874114b50 con 0x7fd87410ae90 2024-08-20T05:08:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.321+0000 7fd873200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd8741149d0 con 0x7fd87410a510 2024-08-20T05:08:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.321+0000 7fd873200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd874114cd0 con 0x7fd874104b00 2024-08-20T05:08:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.321+0000 7fd872800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87410ae90 0x7fd8741a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.321+0000 7fd872800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87410ae90 0x7fd8741a0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33344/0 (socket says 172.21.15.37:33344) 2024-08-20T05:08:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.321+0000 7fd872800640 1 -- 172.21.15.37:0/664266656 learned_addr learned my addr 172.21.15.37:0/664266656 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.321+0000 7fd871e00640 1 --2- 172.21.15.37:0/664266656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd874104b00 0x7fd87419aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.321+0000 7fd869400640 1 --2- 172.21.15.37:0/664266656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd87410a510 0x7fd87419b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.322+0000 7fd872800640 1 -- 172.21.15.37:0/664266656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd874104b00 msgr2=0x7fd87419aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.322+0000 7fd872800640 1 --2- 172.21.15.37:0/664266656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd874104b00 0x7fd87419aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.322+0000 7fd872800640 1 -- 172.21.15.37:0/664266656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd87410a510 msgr2=0x7fd87419b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.322+0000 7fd872800640 1 --2- 172.21.15.37:0/664266656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd87410a510 0x7fd87419b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.322+0000 7fd872800640 1 -- 172.21.15.37:0/664266656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8741a0f50 con 0x7fd87410ae90 2024-08-20T05:08:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.322+0000 7fd869400640 1 --2- 172.21.15.37:0/664266656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd87410a510 0x7fd87419b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.322+0000 7fd872800640 1 --2- 172.21.15.37:0/664266656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87410ae90 0x7fd8741a0780 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd86c004af0 tx=0x7fd86c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.322+0000 7fd86b400640 1 -- 172.21.15.37:0/664266656 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c041020 con 0x7fd87410ae90 2024-08-20T05:08:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.322+0000 7fd86b400640 1 -- 172.21.15.37:0/664266656 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd86c003e10 con 0x7fd87410ae90 2024-08-20T05:08:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.322+0000 7fd86b400640 1 -- 172.21.15.37:0/664266656 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd86c036040 con 0x7fd87410ae90 2024-08-20T05:08:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.322+0000 7fd873200640 1 -- 172.21.15.37:0/664266656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8741a11e0 con 0x7fd87410ae90 2024-08-20T05:08:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.323+0000 7fd873200640 1 -- 172.21.15.37:0/664266656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8741a7900 con 0x7fd87410ae90 2024-08-20T05:08:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.324+0000 7fd873200640 1 -- 172.21.15.37:0/664266656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd874104ee0 con 0x7fd87410ae90 2024-08-20T05:08:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.326+0000 7fd86b400640 1 -- 172.21.15.37:0/664266656 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd86c044020 con 0x7fd87410ae90 2024-08-20T05:08:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.328+0000 7fd86b400640 1 --2- 172.21.15.37:0/664266656 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd8580b3c70 0x7fd8580b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.329+0000 7fd871e00640 1 --2- 172.21.15.37:0/664266656 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd8580b3c70 0x7fd8580b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.329+0000 7fd86b400640 1 -- 172.21.15.37:0/664266656 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd86c104f20 con 0x7fd87410ae90 2024-08-20T05:08:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.329+0000 7fd871e00640 1 --2- 172.21.15.37:0/664266656 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd8580b3c70 0x7fd8580b6130 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd864009bd0 tx=0x7fd864005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.331+0000 7fd86b400640 1 -- 172.21.15.37:0/664266656 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd86c04b020 con 0x7fd87410ae90 2024-08-20T05:08:19.543 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:08:19.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.573+0000 7fd873200640 1 -- 172.21.15.37:0/664266656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8741a7b60 con 0x7fd87410ae90 2024-08-20T05:08:19.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.574+0000 7fd86b400640 1 -- 172.21.15.37:0/664266656 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11980 (secure 0 0 0) 0x7fd86c030970 con 0x7fd87410ae90 2024-08-20T05:08:19.576 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:08:19.576 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"btime":"2024-08-20T05:06:06:678364+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:06:06.276613+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:08:19.576 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 36 2024-08-20T05:08:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.576+0000 7fd873200640 1 -- 172.21.15.37:0/664266656 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd8580b3c70 msgr2=0x7fd8580b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.576+0000 7fd873200640 1 --2- 172.21.15.37:0/664266656 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd8580b3c70 0x7fd8580b6130 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd864009bd0 tx=0x7fd864005f90 comp rx=0 tx=0).stop 2024-08-20T05:08:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.576+0000 7fd873200640 1 -- 172.21.15.37:0/664266656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87410ae90 msgr2=0x7fd8741a0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.576+0000 7fd873200640 1 --2- 172.21.15.37:0/664266656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87410ae90 0x7fd8741a0780 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd86c004af0 tx=0x7fd86c003c20 comp rx=0 tx=0).stop 2024-08-20T05:08:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.577+0000 7fd873200640 1 -- 172.21.15.37:0/664266656 shutdown_connections 2024-08-20T05:08:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.577+0000 7fd873200640 1 --2- 172.21.15.37:0/664266656 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd8580b3c70 0x7fd8580b6130 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.577+0000 7fd873200640 1 --2- 172.21.15.37:0/664266656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd87410ae90 0x7fd8741a0780 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.577+0000 7fd873200640 1 --2- 172.21.15.37:0/664266656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd87410a510 0x7fd87419b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.577+0000 7fd873200640 1 --2- 172.21.15.37:0/664266656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd874104b00 0x7fd87419aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.577+0000 7fd873200640 1 -- 172.21.15.37:0/664266656 >> 172.21.15.37:0/664266656 conn(0x7fd874100550 msgr2=0x7fd8741039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.577+0000 7fd873200640 1 -- 172.21.15.37:0/664266656 shutdown_connections 2024-08-20T05:08:19.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:19.577+0000 7fd873200640 1 -- 172.21.15.37:0/664266656 wait complete. 2024-08-20T05:08:19.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:19 smithi130 ceph-mon[22007]: pgmap v583: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.4 MiB/s wr, 526 op/s 2024-08-20T05:08:19.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:19 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/664266656' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:08:19.959 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:19 smithi037 ceph-mon[17265]: pgmap v583: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.4 MiB/s wr, 526 op/s 2024-08-20T05:08:19.959 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:19 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/664266656' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:08:20.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:19 smithi135 ceph-mon[22342]: pgmap v583: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 8.4 MiB/s wr, 526 op/s 2024-08-20T05:08:20.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:19 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/664266656' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:08:20.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.423+0000 7f8233600640 1 -- 172.21.15.37:0/3462173108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f822c108e40 msgr2=0x7f822c10f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:20.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.423+0000 7f8233600640 1 --2- 172.21.15.37:0/3462173108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f822c108e40 0x7f822c10f640 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8224009ca0 tx=0x7f822402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.424+0000 7f8233600640 1 -- 172.21.15.37:0/3462173108 shutdown_connections 2024-08-20T05:08:20.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.424+0000 7f8233600640 1 --2- 172.21.15.37:0/3462173108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f822c108e40 0x7f822c10f640 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.424+0000 7f8233600640 1 --2- 172.21.15.37:0/3462173108 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f822c1084c0 0x7f822c108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.424+0000 7f8233600640 1 --2- 172.21.15.37:0/3462173108 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f822c102ab0 0x7f822c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.424+0000 7f8233600640 1 -- 172.21.15.37:0/3462173108 >> 172.21.15.37:0/3462173108 conn(0x7f822c0fe500 msgr2=0x7f822c100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:20.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.424+0000 7f8233600640 1 -- 172.21.15.37:0/3462173108 shutdown_connections 2024-08-20T05:08:20.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.424+0000 7f8233600640 1 -- 172.21.15.37:0/3462173108 wait complete. 2024-08-20T05:08:20.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.425+0000 7f8233600640 1 Processor -- start 2024-08-20T05:08:20.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.425+0000 7f8233600640 1 -- start start 2024-08-20T05:08:20.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.425+0000 7f8233600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f822c102ab0 0x7f822c198f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.425+0000 7f8233600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f822c1084c0 0x7f822c199470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.425+0000 7f8233600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f822c108e40 0x7f822c19e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.425+0000 7f8233600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f822c112b00 con 0x7f822c1084c0 2024-08-20T05:08:20.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.425+0000 7f8233600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f822c112980 con 0x7f822c108e40 2024-08-20T05:08:20.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.425+0000 7f8233600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f822c112c80 con 0x7f822c102ab0 2024-08-20T05:08:20.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.425+0000 7f8223e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f822c1084c0 0x7f822c199470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.426+0000 7f8223e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f822c1084c0 0x7f822c199470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33366/0 (socket says 172.21.15.37:33366) 2024-08-20T05:08:20.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.426+0000 7f8230c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f822c102ab0 0x7f822c198f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.426+0000 7f8223e00640 1 -- 172.21.15.37:0/2418773783 learned_addr learned my addr 172.21.15.37:0/2418773783 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:20.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.426+0000 7f8231600640 1 --2- 172.21.15.37:0/2418773783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f822c108e40 0x7f822c19e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.426+0000 7f8223e00640 1 -- 172.21.15.37:0/2418773783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f822c102ab0 msgr2=0x7f822c198f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:20.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.426+0000 7f8223e00640 1 --2- 172.21.15.37:0/2418773783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f822c102ab0 0x7f822c198f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.426+0000 7f8223e00640 1 -- 172.21.15.37:0/2418773783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f822c108e40 msgr2=0x7f822c19e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:20.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.426+0000 7f8223e00640 1 --2- 172.21.15.37:0/2418773783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f822c108e40 0x7f822c19e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.426+0000 7f8223e00640 1 -- 172.21.15.37:0/2418773783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822c19efe0 con 0x7f822c1084c0 2024-08-20T05:08:20.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.426+0000 7f8230c00640 1 --2- 172.21.15.37:0/2418773783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f822c102ab0 0x7f822c198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:20.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.426+0000 7f8223e00640 1 --2- 172.21.15.37:0/2418773783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f822c1084c0 0x7f822c199470 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f821400d950 tx=0x7f821400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:20.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.427+0000 7f822a000640 1 -- 172.21.15.37:0/2418773783 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214017070 con 0x7f822c1084c0 2024-08-20T05:08:20.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.427+0000 7f822a000640 1 -- 172.21.15.37:0/2418773783 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8214009c30 con 0x7f822c1084c0 2024-08-20T05:08:20.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.427+0000 7f822a000640 1 -- 172.21.15.37:0/2418773783 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821400f620 con 0x7f822c1084c0 2024-08-20T05:08:20.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.427+0000 7f8233600640 1 -- 172.21.15.37:0/2418773783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822c19f2d0 con 0x7f822c1084c0 2024-08-20T05:08:20.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.427+0000 7f8233600640 1 -- 172.21.15.37:0/2418773783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f822c1a5b60 con 0x7f822c1084c0 2024-08-20T05:08:20.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.430+0000 7f823626d740 1 Processor -- start 2024-08-20T05:08:20.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.430+0000 7f823626d740 1 -- start start 2024-08-20T05:08:20.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.430+0000 7f822a000640 1 -- 172.21.15.37:0/2418773783 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8214010460 con 0x7f822c1084c0 2024-08-20T05:08:20.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.430+0000 7f823626d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb01db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.430+0000 7f823626d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb022f0 0x55b86bb0dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.430+0000 7f823626d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb0e280 0x55b86bb10670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.430+0000 7f823626d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b86ba78870 con 0x55b86bb0e280 2024-08-20T05:08:20.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.430+0000 7f823626d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b86ba67d70 con 0x55b86bb019d0 2024-08-20T05:08:20.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.430+0000 7f823626d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b86ba6bdb0 con 0x55b86bb022f0 2024-08-20T05:08:20.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.431+0000 7f8231600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb01db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.431+0000 7f8223e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb0e280 0x55b86bb10670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.431+0000 7f8231600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb01db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:41592/0 (socket says 172.21.15.37:41592) 2024-08-20T05:08:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.431+0000 7f8231600640 1 -- 172.21.15.37:0/3879860401 learned_addr learned my addr 172.21.15.37:0/3879860401 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.431+0000 7f8230c00640 1 --2- 172.21.15.37:0/3879860401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb022f0 0x55b86bb0dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.431+0000 7f8231600640 1 -- 172.21.15.37:0/3879860401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb022f0 msgr2=0x55b86bb0dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:20.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.431+0000 7f8231600640 1 --2- 172.21.15.37:0/3879860401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb022f0 0x55b86bb0dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.431+0000 7f8231600640 1 -- 172.21.15.37:0/3879860401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb0e280 msgr2=0x55b86bb10670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:20.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.431+0000 7f8231600640 1 --2- 172.21.15.37:0/3879860401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb0e280 0x55b86bb10670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.431+0000 7f8231600640 1 -- 172.21.15.37:0/3879860401 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86b7c7930 con 0x55b86bb019d0 2024-08-20T05:08:20.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.432+0000 7f8231600640 1 --2- 172.21.15.37:0/3879860401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb01db0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8224005fa0 tx=0x7f8224009800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87b8eb7e5bf7e32e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:20.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.432+0000 7f8221c00640 1 -- 172.21.15.37:0/3879860401 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8224031cf0 con 0x55b86bb019d0 2024-08-20T05:08:20.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.432+0000 7f8221c00640 1 -- 172.21.15.37:0/3879860401 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8224036030 con 0x55b86bb019d0 2024-08-20T05:08:20.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.432+0000 7f8221c00640 1 -- 172.21.15.37:0/3879860401 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82240042a0 con 0x55b86bb019d0 2024-08-20T05:08:20.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.432+0000 7f822a000640 1 --2- 172.21.15.37:0/2418773783 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f82100b3c50 0x7f82100b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.432+0000 7f822a000640 1 -- 172.21.15.37:0/2418773783 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f82140e3b10 con 0x7f822c1084c0 2024-08-20T05:08:20.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.432+0000 7f8230c00640 1 --2- 172.21.15.37:0/2418773783 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f82100b3c50 0x7f82100b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.433+0000 7f823626d740 1 -- 172.21.15.37:0/3879860401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 msgr2=0x55b86bb01db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:20.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.433+0000 7f823626d740 1 --2- 172.21.15.37:0/3879860401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb01db0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8224005fa0 tx=0x7f8224009800 comp rx=0 tx=0).stop 2024-08-20T05:08:20.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.433+0000 7f823626d740 1 -- 172.21.15.37:0/3879860401 shutdown_connections 2024-08-20T05:08:20.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.433+0000 7f823626d740 1 --2- 172.21.15.37:0/3879860401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb0e280 0x55b86bb10670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.433+0000 7f823626d740 1 --2- 172.21.15.37:0/3879860401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb022f0 0x55b86bb0dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.433+0000 7f823626d740 1 --2- 172.21.15.37:0/3879860401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb01db0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.433+0000 7f823626d740 1 -- 172.21.15.37:0/3879860401 >> 172.21.15.37:0/3879860401 conn(0x55b86baff800 msgr2=0x55b86bb009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:20.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.433+0000 7f823626d740 1 -- 172.21.15.37:0/3879860401 shutdown_connections 2024-08-20T05:08:20.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.433+0000 7f8230c00640 1 --2- 172.21.15.37:0/2418773783 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f82100b3c50 0x7f82100b6110 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55b86bb04b50 tx=0x7f821c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:20.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.433+0000 7f823626d740 1 -- 172.21.15.37:0/3879860401 wait complete. 2024-08-20T05:08:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.434+0000 7f823626d740 1 -- start start 2024-08-20T05:08:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.434+0000 7f823626d740 1 Processor -- start 2024-08-20T05:08:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.434+0000 7f823626d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb12330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.434+0000 7f823626d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb022f0 0x55b86bb128d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.434+0000 7f823626d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb0e280 0x55b86bb179f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.434+0000 7f823626d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b86b8ca890 con 0x55b86bb022f0 2024-08-20T05:08:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.434+0000 7f823626d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b86b9eeb00 con 0x55b86bb019d0 2024-08-20T05:08:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.434+0000 7f823626d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b86bb10df0 con 0x55b86bb0e280 2024-08-20T05:08:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.434+0000 7f823626d740 10 client.0 _ll_register_callbacks cb 0x55b86ba62dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.435+0000 7f8230c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb12330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.435+0000 7f8230c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb12330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:41604/0 (socket says 172.21.15.37:41604) 2024-08-20T05:08:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.435+0000 7f8223e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb022f0 0x55b86bb128d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.435+0000 7f8230c00640 1 -- 172.21.15.37:0/123903963 learned_addr learned my addr 172.21.15.37:0/123903963 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.435+0000 7f8231600640 1 --2- 172.21.15.37:0/123903963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb0e280 0x55b86bb179f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.435+0000 7f8230c00640 1 -- 172.21.15.37:0/123903963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb0e280 msgr2=0x55b86bb179f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.435+0000 7f8230c00640 1 --2- 172.21.15.37:0/123903963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb0e280 0x55b86bb179f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.435+0000 7f8230c00640 1 -- 172.21.15.37:0/123903963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb022f0 msgr2=0x55b86bb128d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.435+0000 7f8230c00640 1 --2- 172.21.15.37:0/123903963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb022f0 0x55b86bb128d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.435+0000 7f8230c00640 1 -- 172.21.15.37:0/123903963 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b86ba2fa30 con 0x55b86bb019d0 2024-08-20T05:08:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.436+0000 7f8230c00640 1 --2- 172.21.15.37:0/123903963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb12330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f821c00fa90 tx=0x7f821c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ced04077d9336f51 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.436+0000 7f821a000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:08:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.436+0000 7f821a000640 1 -- 172.21.15.37:0/123903963 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c02e060 con 0x55b86bb019d0 2024-08-20T05:08:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.436+0000 7f823626d740 1 -- 172.21.15.37:0/123903963 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8224036030 con 0x55b86bb019d0 2024-08-20T05:08:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.436+0000 7f821a000640 1 -- 172.21.15.37:0/123903963 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f821c018030 con 0x55b86bb019d0 2024-08-20T05:08:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.436+0000 7f821a000640 1 -- 172.21.15.37:0/123903963 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f821c035050 con 0x55b86bb019d0 2024-08-20T05:08:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.436+0000 7f823626d740 10 client.27092 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.436+0000 7f823626d740 1 -- 172.21.15.37:0/123903963 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b86bb20b30 con 0x55b86bb019d0 2024-08-20T05:08:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.437+0000 7f821a000640 1 -- 172.21.15.37:0/123903963 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8224036030 con 0x55b86bb019d0 2024-08-20T05:08:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.437+0000 7f821a000640 1 -- 172.21.15.37:0/123903963 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f821c0297f0 con 0x55b86bb019d0 2024-08-20T05:08:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.437+0000 7f823626d740 10 client.27092 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.437+0000 7f823626d740 10 client.27092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.437+0000 7f823626d740 20 client.27092 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:20.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.437+0000 7f823626d740 1 --2- 172.21.15.37:0/123903963 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b86bb21f40 0x55b86bb24350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.437+0000 7f823626d740 4 client.27092 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:08:20.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.437+0000 7f823626d740 1 -- 172.21.15.37:0/123903963 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b86ba7a7c0 con 0x55b86bb21f40 2024-08-20T05:08:20.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.438+0000 7f8223e00640 1 --2- 172.21.15.37:0/123903963 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b86bb21f40 0x55b86bb24350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.438+0000 7f8223e00640 1 --2- 172.21.15.37:0/123903963 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b86bb21f40 0x55b86bb24350 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42b0c143b9feb304 server_cookie=68d719d160655ed8 in_seq=0 out_seq=0 2024-08-20T05:08:20.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.438+0000 7f821a000640 10 client.27092 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:20.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.439+0000 7f821a000640 1 -- 172.21.15.37:0/123903963 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b86ba7a7c0 con 0x55b86bb21f40 2024-08-20T05:08:20.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.439+0000 7f821a000640 10 client.27092 handle_command_reply: tid=0 2024-08-20T05:08:20.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.439+0000 7f823626d740 1 client.27092 shutdown 2024-08-20T05:08:20.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.439+0000 7f823626d740 1 -- 172.21.15.37:0/123903963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 msgr2=0x55b86bb12330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:20.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.439+0000 7f823626d740 1 --2- 172.21.15.37:0/123903963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb12330 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f821c00fa90 tx=0x7f821c004730 comp rx=0 tx=0).stop 2024-08-20T05:08:20.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.439+0000 7f823626d740 1 -- 172.21.15.37:0/123903963 shutdown_connections 2024-08-20T05:08:20.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.439+0000 7f823626d740 1 --2- 172.21.15.37:0/123903963 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b86bb21f40 0x55b86bb24350 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.439+0000 7f823626d740 1 --2- 172.21.15.37:0/123903963 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb0e280 0x55b86bb179f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.439+0000 7f823626d740 1 --2- 172.21.15.37:0/123903963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb022f0 0x55b86bb128d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.439+0000 7f823626d740 1 --2- 172.21.15.37:0/123903963 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb12330 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.439+0000 7f823626d740 1 -- 172.21.15.37:0/123903963 >> 172.21.15.37:0/123903963 conn(0x55b86baff800 msgr2=0x55b86bb053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:20.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.439+0000 7f821a000640 0 client.27092 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:20.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.439+0000 7f823626d740 1 -- 172.21.15.37:0/123903963 shutdown_connections 2024-08-20T05:08:20.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.439+0000 7f823626d740 1 -- 172.21.15.37:0/123903963 wait complete. 2024-08-20T05:08:20.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.440+0000 7f823626d740 20 client.27092 trim_cache size 0 max 16384 2024-08-20T05:08:20.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.458+0000 7f823626d740 1 Processor -- start 2024-08-20T05:08:20.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.458+0000 7f823626d740 1 -- start start 2024-08-20T05:08:20.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.458+0000 7f823626d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb019d0 0x55b86bafe7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.458+0000 7f823626d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb022f0 0x55b86bb0c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.458+0000 7f823626d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb0e280 0x55b86bb0ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.458+0000 7f823626d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f822c1ad580 con 0x55b86bb019d0 2024-08-20T05:08:20.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.458+0000 7f823626d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f822c1af0c0 con 0x55b86bb022f0 2024-08-20T05:08:20.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.458+0000 7f823626d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f822c1adc50 con 0x55b86bb0e280 2024-08-20T05:08:20.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.458+0000 7f8230c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb019d0 0x55b86bafe7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.458+0000 7f8230c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb019d0 0x55b86bafe7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33392/0 (socket says 172.21.15.37:33392) 2024-08-20T05:08:20.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.458+0000 7f8230c00640 1 -- 172.21.15.37:0/2460920806 learned_addr learned my addr 172.21.15.37:0/2460920806 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:20.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.458+0000 7f8231600640 1 --2- 172.21.15.37:0/2460920806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb0e280 0x55b86bb0ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.458+0000 7f8223e00640 1 --2- 172.21.15.37:0/2460920806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb022f0 0x55b86bb0c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.459+0000 7f8223e00640 1 -- 172.21.15.37:0/2460920806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb0e280 msgr2=0x55b86bb0ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:20.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.459+0000 7f8223e00640 1 --2- 172.21.15.37:0/2460920806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb0e280 0x55b86bb0ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.459+0000 7f8223e00640 1 -- 172.21.15.37:0/2460920806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb019d0 msgr2=0x55b86bafe7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:20.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.459+0000 7f8223e00640 1 --2- 172.21.15.37:0/2460920806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb019d0 0x55b86bafe7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.459+0000 7f8223e00640 1 -- 172.21.15.37:0/2460920806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b86bb00280 con 0x55b86bb022f0 2024-08-20T05:08:20.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.459+0000 7f8223e00640 1 --2- 172.21.15.37:0/2460920806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb022f0 0x55b86bb0c510 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55b86bb01980 tx=0x7f82140b3040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ee769d73a0ef4ae server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:20.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.459+0000 7f8221200640 1 -- 172.21.15.37:0/2460920806 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8214020040 con 0x55b86bb022f0 2024-08-20T05:08:20.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.459+0000 7f8221200640 1 -- 172.21.15.37:0/2460920806 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82140ec040 con 0x55b86bb022f0 2024-08-20T05:08:20.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.459+0000 7f8221200640 1 -- 172.21.15.37:0/2460920806 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82140b3710 con 0x55b86bb022f0 2024-08-20T05:08:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.460+0000 7f823626d740 1 -- 172.21.15.37:0/2460920806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb022f0 msgr2=0x55b86bb0c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.460+0000 7f823626d740 1 --2- 172.21.15.37:0/2460920806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb022f0 0x55b86bb0c510 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55b86bb01980 tx=0x7f82140b3040 comp rx=0 tx=0).stop 2024-08-20T05:08:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.460+0000 7f823626d740 1 -- 172.21.15.37:0/2460920806 shutdown_connections 2024-08-20T05:08:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.460+0000 7f823626d740 1 --2- 172.21.15.37:0/2460920806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb0e280 0x55b86bb0ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.460+0000 7f823626d740 1 --2- 172.21.15.37:0/2460920806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb022f0 0x55b86bb0c510 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.460+0000 7f823626d740 1 --2- 172.21.15.37:0/2460920806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb019d0 0x55b86bafe7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.460+0000 7f823626d740 1 -- 172.21.15.37:0/2460920806 >> 172.21.15.37:0/2460920806 conn(0x55b86baff800 msgr2=0x55b86bafe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.460+0000 7f823626d740 1 -- 172.21.15.37:0/2460920806 shutdown_connections 2024-08-20T05:08:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.460+0000 7f823626d740 1 -- 172.21.15.37:0/2460920806 wait complete. 2024-08-20T05:08:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.461+0000 7f823626d740 1 -- start start 2024-08-20T05:08:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.461+0000 7f823626d740 1 Processor -- start 2024-08-20T05:08:20.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.461+0000 7f823626d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb1e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.461+0000 7f823626d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb022f0 0x55b86bb1cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.461+0000 7f823626d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb0e280 0x55b86bb1d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.461+0000 7f823626d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f822c1ae9f0 con 0x55b86bb0e280 2024-08-20T05:08:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.461+0000 7f823626d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f822c1ae320 con 0x55b86bb019d0 2024-08-20T05:08:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.461+0000 7f823626d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f822c1ab560 con 0x55b86bb022f0 2024-08-20T05:08:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.461+0000 7f823626d740 10 client.0 _ll_register_callbacks cb 0x7f821c009e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.462+0000 7f8230c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb1e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.462+0000 7f8223e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb022f0 0x55b86bb1cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.462+0000 7f8230c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb1e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:41628/0 (socket says 172.21.15.37:41628) 2024-08-20T05:08:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.462+0000 7f8230c00640 1 -- 172.21.15.37:0/2009220813 learned_addr learned my addr 172.21.15.37:0/2009220813 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.462+0000 7f8231600640 1 --2- 172.21.15.37:0/2009220813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb0e280 0x55b86bb1d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.462+0000 7f8230c00640 1 -- 172.21.15.37:0/2009220813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb022f0 msgr2=0x55b86bb1cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:20.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.462+0000 7f8230c00640 1 --2- 172.21.15.37:0/2009220813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb022f0 0x55b86bb1cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.462+0000 7f8230c00640 1 -- 172.21.15.37:0/2009220813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb0e280 msgr2=0x55b86bb1d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:20.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.462+0000 7f8230c00640 1 --2- 172.21.15.37:0/2009220813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb0e280 0x55b86bb1d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.462+0000 7f8230c00640 1 -- 172.21.15.37:0/2009220813 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b86bb1d720 con 0x55b86bb019d0 2024-08-20T05:08:20.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.462+0000 7f8223e00640 1 --2- 172.21.15.37:0/2009220813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb022f0 0x55b86bb1cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:20.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.462+0000 7f8230c00640 1 --2- 172.21.15.37:0/2009220813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb1e640 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f821c029db0 tx=0x7f821c01e270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99afe5066f0cf091 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:20.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.462+0000 7f821a000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:08:20.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.463+0000 7f821a000640 1 -- 172.21.15.37:0/2009220813 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f821c03d020 con 0x55b86bb019d0 2024-08-20T05:08:20.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.463+0000 7f823626d740 1 -- 172.21.15.37:0/2009220813 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82140ec040 con 0x55b86bb019d0 2024-08-20T05:08:20.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.463+0000 7f821a000640 1 -- 172.21.15.37:0/2009220813 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f821c029630 con 0x55b86bb019d0 2024-08-20T05:08:20.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.463+0000 7f821a000640 1 -- 172.21.15.37:0/2009220813 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f821c00f880 con 0x55b86bb019d0 2024-08-20T05:08:20.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.463+0000 7f823626d740 10 client.27098 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:20.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.463+0000 7f823626d740 1 -- 172.21.15.37:0/2009220813 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b86bb8db60 con 0x55b86bb019d0 2024-08-20T05:08:20.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.463+0000 7f821a000640 1 -- 172.21.15.37:0/2009220813 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82140ec040 con 0x55b86bb019d0 2024-08-20T05:08:20.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.463+0000 7f821a000640 1 -- 172.21.15.37:0/2009220813 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f821c039410 con 0x55b86bb019d0 2024-08-20T05:08:20.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.463+0000 7f823626d740 10 client.27098 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:20.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.463+0000 7f823626d740 10 client.27098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:20.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.464+0000 7f823626d740 20 client.27098 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:20.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.464+0000 7f823626d740 1 --2- 172.21.15.37:0/2009220813 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b86bb8e270 0x55b86bb90690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:20.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.464+0000 7f823626d740 4 client.27098 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T05:08:20.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.464+0000 7f823626d740 1 -- 172.21.15.37:0/2009220813 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b86ba76260 con 0x55b86bb8e270 2024-08-20T05:08:20.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.464+0000 7f8223e00640 1 --2- 172.21.15.37:0/2009220813 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b86bb8e270 0x55b86bb90690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:20.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.464+0000 7f8223e00640 1 --2- 172.21.15.37:0/2009220813 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b86bb8e270 0x55b86bb90690 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d4a546240ac94bc server_cookie=69731929e127788d in_seq=0 out_seq=0 2024-08-20T05:08:20.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.464+0000 7f821a000640 10 client.27098 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:20.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.465+0000 7f821a000640 1 -- 172.21.15.37:0/2009220813 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b86ba76260 con 0x55b86bb8e270 2024-08-20T05:08:20.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.465+0000 7f821a000640 10 client.27098 handle_command_reply: tid=0 2024-08-20T05:08:20.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.466+0000 7f823626d740 1 client.27098 shutdown 2024-08-20T05:08:20.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.466+0000 7f823626d740 1 -- 172.21.15.37:0/2009220813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 msgr2=0x55b86bb1e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:20.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.466+0000 7f823626d740 1 --2- 172.21.15.37:0/2009220813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb1e640 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f821c029db0 tx=0x7f821c01e270 comp rx=0 tx=0).stop 2024-08-20T05:08:20.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.466+0000 7f823626d740 1 -- 172.21.15.37:0/2009220813 shutdown_connections 2024-08-20T05:08:20.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.466+0000 7f823626d740 1 --2- 172.21.15.37:0/2009220813 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b86bb8e270 0x55b86bb90690 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.466+0000 7f823626d740 1 --2- 172.21.15.37:0/2009220813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b86bb0e280 0x55b86bb1d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.466+0000 7f823626d740 1 --2- 172.21.15.37:0/2009220813 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b86bb022f0 0x55b86bb1cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.466+0000 7f823626d740 1 --2- 172.21.15.37:0/2009220813 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b86bb019d0 0x55b86bb1e640 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.466+0000 7f821a000640 0 client.27098 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:20.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.466+0000 7f823626d740 1 -- 172.21.15.37:0/2009220813 >> 172.21.15.37:0/2009220813 conn(0x55b86baff800 msgr2=0x55b86bb053a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:20.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.466+0000 7f823626d740 1 -- 172.21.15.37:0/2009220813 shutdown_connections 2024-08-20T05:08:20.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.466+0000 7f823626d740 1 -- 172.21.15.37:0/2009220813 wait complete. 2024-08-20T05:08:20.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.466+0000 7f823626d740 20 client.27098 trim_cache size 0 max 16384 2024-08-20T05:08:20.471 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:08:20.471 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-20T05:08:20.471 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "af62b868-59b4-4ab4-b8d0-d888b3555def", 2024-08-20T05:08:20.471 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-20T05:08:20.471 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:08:20.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.467+0000 7f8233600640 1 -- 172.21.15.37:0/2418773783 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f82100b3c50 msgr2=0x7f82100b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:20.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.467+0000 7f8233600640 1 --2- 172.21.15.37:0/2418773783 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f82100b3c50 0x7f82100b6110 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x55b86bb04b50 tx=0x7f821c005f90 comp rx=0 tx=0).stop 2024-08-20T05:08:20.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.467+0000 7f8233600640 1 -- 172.21.15.37:0/2418773783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f822c1084c0 msgr2=0x7f822c199470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:20.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.467+0000 7f8233600640 1 --2- 172.21.15.37:0/2418773783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f822c1084c0 0x7f822c199470 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f821400d950 tx=0x7f821400de10 comp rx=0 tx=0).stop 2024-08-20T05:08:20.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.467+0000 7f8233600640 1 -- 172.21.15.37:0/2418773783 shutdown_connections 2024-08-20T05:08:20.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.467+0000 7f8233600640 1 --2- 172.21.15.37:0/2418773783 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f82100b3c50 0x7f82100b6110 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.467+0000 7f8233600640 1 --2- 172.21.15.37:0/2418773783 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f822c108e40 0x7f822c19e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.467+0000 7f8233600640 1 --2- 172.21.15.37:0/2418773783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f822c1084c0 0x7f822c199470 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.467+0000 7f8233600640 1 --2- 172.21.15.37:0/2418773783 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f822c102ab0 0x7f822c198f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:20.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.467+0000 7f8233600640 1 -- 172.21.15.37:0/2418773783 >> 172.21.15.37:0/2418773783 conn(0x7f822c0fe500 msgr2=0x7f822c1008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:20.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.467+0000 7f8233600640 1 -- 172.21.15.37:0/2418773783 shutdown_connections 2024-08-20T05:08:20.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:20.467+0000 7f8233600640 1 -- 172.21.15.37:0/2418773783 wait complete. 2024-08-20T05:08:20.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:20 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:08:20.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:20 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:20.956 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 05:08:20 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b[51794]: 2024-08-20T05:08:20.478+0000 7fabbc466640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/pg_wal/ auth{1=1} v1473 ap=3 f(v12 m2024-08-20T05:07:55.574748+0000 40=39+1) n(v21 rc2024-08-20T05:07:56.113741+0000 b654311424 41=39+2) (inest sync->mix g=1) (ipolicy sync r=1) (iquiesce lock x=1 by request(mds.0:1725 nref=3)) caps={25373=pAsLsXsFs/pAsLsXsFsxcral@190} mcw={1=AsLsXsFs} | dirtyscattered=0 request=1 lock=2 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 discoverbase=0 scrubqueue=0 0x55dc3d210000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000007:[<0x10000000006/pg_wal v298>,<0x10000000005/data v74>,<0x100000001fb/postgres v10>,<0x100000001fa/091b5016-889b-437d-8bd4-e6363dc551f0 v29>,<0x10000000001/sv_1 v49>,<0x10000000000/qa v36>,<0x1/volumes v34>]//[]","memoryvalue":"(2)0x10000000007:[<0x10000000006/pg_wal v1473>,<0x10000000005/data v450>,<0x100000001fb/postgres v290>,<0x100000001fa/091b5016-889b-437d-8bd4-e6363dc551f0 v307>,<0x10000000001/sv_1 v315>,<0x10000000000/qa v313>,<0x1/volumes v297>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-20T05:07:39.349955+0000 37=36+1)","ondisk_value.rstat":"n(v0 rc2024-08-20T05:07:56.113741+0000 b654311424 41=39+2)","memory_value.dirstat":"f(v12 m2024-08-20T05:07:55.574748+0000 40=39+1)","memory_value.rstat":"n(v21 rc2024-08-20T05:07:56.113741+0000 b654311424 41=39+2)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-08-20T05:08:20.965 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:20 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:08:20.965 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:20 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:21.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:20 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:08:21.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:20 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:21.425 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id dc8b695b --release --await' 2024-08-20T05:08:21.425 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id dc8b695b --release --await 2024-08-20T05:08:21.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: pgmap v584: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 8.4 MiB/s wr, 528 op/s 2024-08-20T05:08:21.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: scrub queued for path: / 2024-08-20T05:08:21.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:21.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:08:21.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:08:21.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:21.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:08:21.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:21.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:08:21.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:21.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:08:21.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:08:21.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:08:21.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/pg_wal) see mds.b log and `damage ls` output for details 2024-08-20T05:08:21.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:21.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:21.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:21.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:21 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: pgmap v584: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 8.4 MiB/s wr, 528 op/s 2024-08-20T05:08:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: scrub queued for path: / 2024-08-20T05:08:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:08:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:08:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:08:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:08:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:08:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:08:21.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:08:21.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/pg_wal) see mds.b log and `damage ls` output for details 2024-08-20T05:08:21.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:21.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:21.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:21.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:21 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:22.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: pgmap v584: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 8.4 MiB/s wr, 528 op/s 2024-08-20T05:08:22.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: scrub queued for path: / 2024-08-20T05:08:22.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:22.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:08:22.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:08:22.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:22.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:08:22.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:22.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:08:22.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:22.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:08:22.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:08:22.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:08:22.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/pg_wal) see mds.b log and `damage ls` output for details 2024-08-20T05:08:22.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:22.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:22.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:22.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:21 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:08:22.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:08:22.258 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:08:22.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.900+0000 7fc4f0000640 1 -- 172.21.15.37:0/13219903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e810a6b0 msgr2=0x7fc4e810aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:22.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.900+0000 7fc4f0000640 1 --2- 172.21.15.37:0/13219903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e810a6b0 0x7fc4e810aaf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009900 tx=0x7fc4d402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.900+0000 7fc4f0000640 1 -- 172.21.15.37:0/13219903 shutdown_connections 2024-08-20T05:08:22.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.900+0000 7fc4f0000640 1 --2- 172.21.15.37:0/13219903 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4e810b030 0x7fc4e8111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.900+0000 7fc4f0000640 1 --2- 172.21.15.37:0/13219903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e810a6b0 0x7fc4e810aaf0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.900+0000 7fc4f0000640 1 --2- 172.21.15.37:0/13219903 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e8104ca0 0x7fc4e8105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.900+0000 7fc4f0000640 1 -- 172.21.15.37:0/13219903 >> 172.21.15.37:0/13219903 conn(0x7fc4e8100730 msgr2=0x7fc4e8102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:22.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.901+0000 7fc4f0000640 1 -- 172.21.15.37:0/13219903 shutdown_connections 2024-08-20T05:08:22.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.901+0000 7fc4f0000640 1 -- 172.21.15.37:0/13219903 wait complete. 2024-08-20T05:08:22.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.901+0000 7fc4f0000640 1 Processor -- start 2024-08-20T05:08:22.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.902+0000 7fc4f0000640 1 -- start start 2024-08-20T05:08:22.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.902+0000 7fc4f0000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e8104ca0 0x7fc4e819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.902+0000 7fc4f0000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4e810a6b0 0x7fc4e819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.902+0000 7fc4f0000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e810b030 0x7fc4e81a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.902+0000 7fc4f0000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e8114cf0 con 0x7fc4e8104ca0 2024-08-20T05:08:22.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.902+0000 7fc4f0000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e8114b70 con 0x7fc4e810a6b0 2024-08-20T05:08:22.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.902+0000 7fc4f0000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e8114e70 con 0x7fc4e810b030 2024-08-20T05:08:22.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.902+0000 7fc4ed600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e8104ca0 0x7fc4e819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.902+0000 7fc4ed600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e8104ca0 0x7fc4e819b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47752/0 (socket says 172.21.15.37:47752) 2024-08-20T05:08:22.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.902+0000 7fc4ed600640 1 -- 172.21.15.37:0/1190761314 learned_addr learned my addr 172.21.15.37:0/1190761314 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:22.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.902+0000 7fc4ee000640 1 --2- 172.21.15.37:0/1190761314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e810b030 0x7fc4e81a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.902+0000 7fc4ecc00640 1 --2- 172.21.15.37:0/1190761314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4e810a6b0 0x7fc4e819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.903+0000 7fc4ed600640 1 -- 172.21.15.37:0/1190761314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e810b030 msgr2=0x7fc4e81a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:22.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.903+0000 7fc4ed600640 1 --2- 172.21.15.37:0/1190761314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e810b030 0x7fc4e81a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.903+0000 7fc4ed600640 1 -- 172.21.15.37:0/1190761314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4e810a6b0 msgr2=0x7fc4e819b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:22.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.903+0000 7fc4ed600640 1 --2- 172.21.15.37:0/1190761314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4e810a6b0 0x7fc4e819b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.903+0000 7fc4ed600640 1 -- 172.21.15.37:0/1190761314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4e81a1220 con 0x7fc4e8104ca0 2024-08-20T05:08:22.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.903+0000 7fc4ee000640 1 --2- 172.21.15.37:0/1190761314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e810b030 0x7fc4e81a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:22.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.903+0000 7fc4ed600640 1 --2- 172.21.15.37:0/1190761314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e8104ca0 0x7fc4e819b170 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00e9f0 tx=0x7fc4dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:22.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.903+0000 7fc4e6000640 1 -- 172.21.15.37:0/1190761314 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc00cd80 con 0x7fc4e8104ca0 2024-08-20T05:08:22.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.904+0000 7fc4f0000640 1 -- 172.21.15.37:0/1190761314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4e81a1510 con 0x7fc4e8104ca0 2024-08-20T05:08:22.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.904+0000 7fc4e6000640 1 -- 172.21.15.37:0/1190761314 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4dc0108e0 con 0x7fc4e8104ca0 2024-08-20T05:08:22.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.904+0000 7fc4e6000640 1 -- 172.21.15.37:0/1190761314 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc018980 con 0x7fc4e8104ca0 2024-08-20T05:08:22.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.904+0000 7fc4f0000640 1 -- 172.21.15.37:0/1190761314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4e81a7da0 con 0x7fc4e8104ca0 2024-08-20T05:08:22.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.907+0000 7fc4f29e2740 1 Processor -- start 2024-08-20T05:08:22.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.907+0000 7fc4f29e2740 1 -- start start 2024-08-20T05:08:22.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.907+0000 7fc4e6000640 1 -- 172.21.15.37:0/1190761314 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc4dc010430 con 0x7fc4e8104ca0 2024-08-20T05:08:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.907+0000 7fc4f29e2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47c8cf0 0x5566c47c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.907+0000 7fc4f29e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47c9610 0x5566c47dd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.907+0000 7fc4f29e2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47dddb0 0x5566c47e01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.907+0000 7fc4f29e2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5566c476a670 con 0x5566c47c8cf0 2024-08-20T05:08:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.907+0000 7fc4f29e2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5566c473ed70 con 0x5566c47dddb0 2024-08-20T05:08:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.907+0000 7fc4f29e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5566c472e270 con 0x5566c47c9610 2024-08-20T05:08:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.908+0000 7fc4ee000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47c8cf0 0x5566c47c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.908+0000 7fc4ee000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47c8cf0 0x5566c47c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47756/0 (socket says 172.21.15.37:47756) 2024-08-20T05:08:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.908+0000 7fc4ee000640 1 -- 172.21.15.37:0/3849874285 learned_addr learned my addr 172.21.15.37:0/3849874285 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.908+0000 7fc4ed600640 1 --2- 172.21.15.37:0/3849874285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47c9610 0x5566c47dd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.908+0000 7fc4ecc00640 1 --2- 172.21.15.37:0/3849874285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47dddb0 0x5566c47e01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.908+0000 7fc4ee000640 1 -- 172.21.15.37:0/3849874285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47c9610 msgr2=0x5566c47dd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.908+0000 7fc4ee000640 1 --2- 172.21.15.37:0/3849874285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47c9610 0x5566c47dd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.908+0000 7fc4ee000640 1 -- 172.21.15.37:0/3849874285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47dddb0 msgr2=0x5566c47e01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.908+0000 7fc4ee000640 1 --2- 172.21.15.37:0/3849874285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47dddb0 0x5566c47e01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.908+0000 7fc4ee000640 1 -- 172.21.15.37:0/3849874285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c46ca870 con 0x5566c47c8cf0 2024-08-20T05:08:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.908+0000 7fc4ee000640 1 --2- 172.21.15.37:0/3849874285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47c8cf0 0x5566c47c90d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0011810 tx=0x7fc4e0011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390e3814c4cfb2e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.909+0000 7fc4da600640 1 -- 172.21.15.37:0/3849874285 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0011310 con 0x5566c47c8cf0 2024-08-20T05:08:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.909+0000 7fc4da600640 1 -- 172.21.15.37:0/3849874285 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4e0003e20 con 0x5566c47c8cf0 2024-08-20T05:08:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.909+0000 7fc4da600640 1 -- 172.21.15.37:0/3849874285 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e00044f0 con 0x5566c47c8cf0 2024-08-20T05:08:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.909+0000 7fc4e6000640 1 --2- 172.21.15.37:0/1190761314 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc4d00b3c50 0x7fc4d00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.909+0000 7fc4e6000640 1 -- 172.21.15.37:0/1190761314 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc4dc0e4290 con 0x7fc4e8104ca0 2024-08-20T05:08:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.910+0000 7fc4ed600640 1 --2- 172.21.15.37:0/1190761314 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc4d00b3c50 0x7fc4d00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.910+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3849874285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47c8cf0 msgr2=0x5566c47c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.910+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/3849874285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47c8cf0 0x5566c47c90d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0011810 tx=0x7fc4e0011cd0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.910+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3849874285 shutdown_connections 2024-08-20T05:08:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.910+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/3849874285 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47dddb0 0x5566c47e01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.910+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/3849874285 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47c9610 0x5566c47dd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.910+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/3849874285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47c8cf0 0x5566c47c90d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.910+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3849874285 >> 172.21.15.37:0/3849874285 conn(0x5566c47c6b20 msgr2=0x5566c47c7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.910+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3849874285 shutdown_connections 2024-08-20T05:08:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.910+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3849874285 wait complete. 2024-08-20T05:08:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.910+0000 7fc4ed600640 1 --2- 172.21.15.37:0/1190761314 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc4d00b3c50 0x7fc4d00b6110 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0aae20 tx=0x7fc4dc0e7cd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.911+0000 7fc4f29e2740 1 -- start start 2024-08-20T05:08:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.911+0000 7fc4f29e2740 1 Processor -- start 2024-08-20T05:08:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.911+0000 7fc4f29e2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 0x5566c47dd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.911+0000 7fc4f29e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47c9610 0x5566c47daa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.911+0000 7fc4f29e2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47dddb0 0x5566c47dafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.911+0000 7fc4f29e2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5566c46b4ff0 con 0x5566c47dddb0 2024-08-20T05:08:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.911+0000 7fc4f29e2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5566c47322b0 con 0x5566c47c8cf0 2024-08-20T05:08:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.911+0000 7fc4f29e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5566c4590bb0 con 0x5566c47c9610 2024-08-20T05:08:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.911+0000 7fc4f29e2740 10 client.0 _ll_register_callbacks cb 0x5566c4439d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.912+0000 7fc4ee000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47dddb0 0x5566c47dafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.912+0000 7fc4ee000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47dddb0 0x5566c47dafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47766/0 (socket says 172.21.15.37:47766) 2024-08-20T05:08:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.912+0000 7fc4ee000640 1 -- 172.21.15.37:0/3088324205 learned_addr learned my addr 172.21.15.37:0/3088324205 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.912+0000 7fc4ecc00640 1 --2- 172.21.15.37:0/3088324205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47c9610 0x5566c47daa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.912+0000 7fc4ee000640 1 --2- 172.21.15.37:0/3088324205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 0x5566c47dd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.912+0000 7fc4ecc00640 1 -- 172.21.15.37:0/3088324205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 msgr2=0x5566c47dd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.912+0000 7fc4ecc00640 1 --2- 172.21.15.37:0/3088324205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 0x5566c47dd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.912+0000 7fc4ecc00640 1 -- 172.21.15.37:0/3088324205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47dddb0 msgr2=0x5566c47dafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.912+0000 7fc4ecc00640 1 --2- 172.21.15.37:0/3088324205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47dddb0 0x5566c47dafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.912+0000 7fc4ecc00640 1 -- 172.21.15.37:0/3088324205 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566c448db00 con 0x5566c47c9610 2024-08-20T05:08:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.912+0000 7fc4ecc00640 1 --2- 172.21.15.37:0/3088324205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47c9610 0x5566c47daa70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009230 tx=0x7fc4d4032dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=640b27f420ad1765 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.912+0000 7fc4cea00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:08:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.913+0000 7fc4cea00640 1 -- 172.21.15.37:0/3088324205 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4035040 con 0x5566c47c9610 2024-08-20T05:08:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.913+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3088324205 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4e0003e20 con 0x5566c47c9610 2024-08-20T05:08:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.913+0000 7fc4cea00640 1 -- 172.21.15.37:0/3088324205 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc4d40316a0 con 0x5566c47c9610 2024-08-20T05:08:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.913+0000 7fc4cea00640 1 -- 172.21.15.37:0/3088324205 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc4d40318a0 con 0x5566c47c9610 2024-08-20T05:08:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.913+0000 7fc4f29e2740 10 client.27136 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.913+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3088324205 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5566c4504960 con 0x5566c47c9610 2024-08-20T05:08:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.913+0000 7fc4cea00640 1 -- 172.21.15.37:0/3088324205 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4e0003e20 con 0x5566c47c9610 2024-08-20T05:08:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.914+0000 7fc4cea00640 1 -- 172.21.15.37:0/3088324205 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fc4d4004750 con 0x5566c47c9610 2024-08-20T05:08:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.914+0000 7fc4f29e2740 10 client.27136 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.914+0000 7fc4f29e2740 10 client.27136 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:08:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.914+0000 7fc4f29e2740 20 client.27136 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.914+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/3088324205 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5566c47ed430 0x5566c47ef840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.914+0000 7fc4f29e2740 4 client.27136 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:08:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.914+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3088324205 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566c4740cc0 con 0x5566c47ed430 2024-08-20T05:08:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.914+0000 7fc4ee000640 1 --2- 172.21.15.37:0/3088324205 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5566c47ed430 0x5566c47ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.915+0000 7fc4ee000640 1 --2- 172.21.15.37:0/3088324205 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5566c47ed430 0x5566c47ef840 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cea4eb422012aee server_cookie=2f2432b52669faf9 in_seq=0 out_seq=0 2024-08-20T05:08:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.915+0000 7fc4cea00640 10 client.27136 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.915+0000 7fc4cea00640 1 -- 172.21.15.37:0/3088324205 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5566c4740cc0 con 0x5566c47ed430 2024-08-20T05:08:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.915+0000 7fc4cea00640 10 client.27136 handle_command_reply: tid=0 2024-08-20T05:08:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.915+0000 7fc4f29e2740 1 client.27136 shutdown 2024-08-20T05:08:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.916+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3088324205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47c9610 msgr2=0x5566c47daa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:22.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.916+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/3088324205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47c9610 0x5566c47daa70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009230 tx=0x7fc4d4032dc0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.916+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3088324205 shutdown_connections 2024-08-20T05:08:22.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.916+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/3088324205 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5566c47ed430 0x5566c47ef840 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.916+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/3088324205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47dddb0 0x5566c47dafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.916+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/3088324205 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47c9610 0x5566c47daa70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.916+0000 7fc4cea00640 0 client.27136 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:22.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.916+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/3088324205 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 0x5566c47dd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.916+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3088324205 >> 172.21.15.37:0/3088324205 conn(0x5566c47c6b20 msgr2=0x5566c47cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:22.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.916+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3088324205 shutdown_connections 2024-08-20T05:08:22.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.916+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3088324205 wait complete. 2024-08-20T05:08:22.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.916+0000 7fc4f29e2740 20 client.27136 trim_cache size 0 max 16384 2024-08-20T05:08:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.934+0000 7fc4f29e2740 1 Processor -- start 2024-08-20T05:08:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.934+0000 7fc4f29e2740 1 -- start start 2024-08-20T05:08:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.935+0000 7fc4f29e2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 0x5566c47e9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.935+0000 7fc4f29e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47c9610 0x5566c47c5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.935+0000 7fc4f29e2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47dddb0 0x5566c47c5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.935+0000 7fc4f29e2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e81ad6a0 con 0x5566c47dddb0 2024-08-20T05:08:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.935+0000 7fc4f29e2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e81af1e0 con 0x5566c47c8cf0 2024-08-20T05:08:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.935+0000 7fc4f29e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e81add70 con 0x5566c47c9610 2024-08-20T05:08:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.935+0000 7fc4ee000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47dddb0 0x5566c47c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.935+0000 7fc4ee000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 0x5566c47e9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.935+0000 7fc4ee000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 0x5566c47e9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:49792/0 (socket says 172.21.15.37:49792) 2024-08-20T05:08:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.935+0000 7fc4ecc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47c9610 0x5566c47c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.935+0000 7fc4ee000640 1 -- 172.21.15.37:0/3018699787 learned_addr learned my addr 172.21.15.37:0/3018699787 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.936+0000 7fc4ee000640 1 -- 172.21.15.37:0/3018699787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47c9610 msgr2=0x5566c47c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.936+0000 7fc4ee000640 1 --2- 172.21.15.37:0/3018699787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47c9610 0x5566c47c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.936+0000 7fc4ee000640 1 -- 172.21.15.37:0/3018699787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47dddb0 msgr2=0x5566c47c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.936+0000 7fc4ee000640 1 --2- 172.21.15.37:0/3018699787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47dddb0 0x5566c47c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.936+0000 7fc4ee000640 1 -- 172.21.15.37:0/3018699787 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566c47db2f0 con 0x5566c47c8cf0 2024-08-20T05:08:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.936+0000 7fc4ecc00640 1 --2- 172.21.15.37:0/3018699787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47c9610 0x5566c47c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.936+0000 7fc4ee000640 1 --2- 172.21.15.37:0/3018699787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 0x5566c47e9a00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00041a0 tx=0x7fc4e00040d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86e13330ba4cf36a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.936+0000 7fc4d9c00640 1 -- 172.21.15.37:0/3018699787 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0011230 con 0x5566c47c8cf0 2024-08-20T05:08:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.936+0000 7fc4d9c00640 1 -- 172.21.15.37:0/3018699787 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4e000fe50 con 0x5566c47c8cf0 2024-08-20T05:08:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.936+0000 7fc4d9c00640 1 -- 172.21.15.37:0/3018699787 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0005850 con 0x5566c47c8cf0 2024-08-20T05:08:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.937+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3018699787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 msgr2=0x5566c47e9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.937+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/3018699787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 0x5566c47e9a00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00041a0 tx=0x7fc4e00040d0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.937+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3018699787 shutdown_connections 2024-08-20T05:08:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.937+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/3018699787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47dddb0 0x5566c47c5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.937+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/3018699787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47c9610 0x5566c47c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.937+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/3018699787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 0x5566c47e9a00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.937+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3018699787 >> 172.21.15.37:0/3018699787 conn(0x5566c47c6b20 msgr2=0x5566c47cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.937+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3018699787 shutdown_connections 2024-08-20T05:08:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.937+0000 7fc4f29e2740 1 -- 172.21.15.37:0/3018699787 wait complete. 2024-08-20T05:08:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.938+0000 7fc4f29e2740 1 -- start start 2024-08-20T05:08:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.938+0000 7fc4f29e2740 1 Processor -- start 2024-08-20T05:08:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.938+0000 7fc4f29e2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 0x5566c47e5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.938+0000 7fc4f29e2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47c9610 0x5566c47f4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.938+0000 7fc4f29e2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47dddb0 0x5566c47f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.938+0000 7fc4f29e2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e81aeb10 con 0x5566c47c9610 2024-08-20T05:08:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.938+0000 7fc4f29e2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e81ae440 con 0x5566c47c8cf0 2024-08-20T05:08:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.938+0000 7fc4f29e2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc4e81ab680 con 0x5566c47dddb0 2024-08-20T05:08:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.938+0000 7fc4f29e2740 10 client.0 _ll_register_callbacks cb 0x7fc4dc005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.939+0000 7fc4ee000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 0x5566c47e5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.939+0000 7fc4ee000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 0x5566c47e5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:49794/0 (socket says 172.21.15.37:49794) 2024-08-20T05:08:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.939+0000 7fc4ee000640 1 -- 172.21.15.37:0/1835142106 learned_addr learned my addr 172.21.15.37:0/1835142106 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.939+0000 7fc4ecc00640 1 --2- 172.21.15.37:0/1835142106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47c9610 0x5566c47f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.939+0000 7fc4ee000640 1 --2- 172.21.15.37:0/1835142106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47dddb0 0x5566c47f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.939+0000 7fc4ee000640 1 -- 172.21.15.37:0/1835142106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47dddb0 msgr2=0x5566c47f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.939+0000 7fc4ee000640 1 --2- 172.21.15.37:0/1835142106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47dddb0 0x5566c47f4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.939+0000 7fc4ee000640 1 -- 172.21.15.37:0/1835142106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47c9610 msgr2=0x5566c47f4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.939+0000 7fc4ee000640 1 --2- 172.21.15.37:0/1835142106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47c9610 0x5566c47f4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.939+0000 7fc4ee000640 1 -- 172.21.15.37:0/1835142106 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566c47f53c0 con 0x5566c47c8cf0 2024-08-20T05:08:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.939+0000 7fc4ee000640 1 --2- 172.21.15.37:0/1835142106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 0x5566c47e5ff0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00095d0 tx=0x7fc4e0009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a64ac4e75461d789 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.939+0000 7fc4cea00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:08:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.940+0000 7fc4cea00640 1 -- 172.21.15.37:0/1835142106 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e0011430 con 0x5566c47c8cf0 2024-08-20T05:08:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.940+0000 7fc4cea00640 1 -- 172.21.15.37:0/1835142106 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc4e000f9a0 con 0x5566c47c8cf0 2024-08-20T05:08:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.940+0000 7fc4f29e2740 1 -- 172.21.15.37:0/1835142106 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4e000fe50 con 0x5566c47c8cf0 2024-08-20T05:08:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.940+0000 7fc4cea00640 1 -- 172.21.15.37:0/1835142106 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc4e000fba0 con 0x5566c47c8cf0 2024-08-20T05:08:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.940+0000 7fc4f29e2740 10 client.27116 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.940+0000 7fc4f29e2740 1 -- 172.21.15.37:0/1835142106 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5566c4857f20 con 0x5566c47c8cf0 2024-08-20T05:08:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.941+0000 7fc4cea00640 1 -- 172.21.15.37:0/1835142106 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4e000fe50 con 0x5566c47c8cf0 2024-08-20T05:08:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.941+0000 7fc4cea00640 1 -- 172.21.15.37:0/1835142106 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fc4e0028040 con 0x5566c47c8cf0 2024-08-20T05:08:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.941+0000 7fc4f29e2740 10 client.27116 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.941+0000 7fc4f29e2740 10 client.27116 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:08:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.941+0000 7fc4f29e2740 20 client.27116 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.941+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/1835142106 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5566c48584b0 0x5566c485a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.941+0000 7fc4f29e2740 4 client.27116 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "dc8b695b", "release": true, "await": true}] 2024-08-20T05:08:22.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.941+0000 7fc4f29e2740 1 -- 172.21.15.37:0/1835142106 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "set_id": "dc8b695b", "release": true, "await": true}) -- 0x5566c473c760 con 0x5566c48584b0 2024-08-20T05:08:22.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.941+0000 7fc4ecc00640 1 --2- 172.21.15.37:0/1835142106 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5566c48584b0 0x5566c485a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:22.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.942+0000 7fc4ecc00640 1 --2- 172.21.15.37:0/1835142106 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5566c48584b0 0x5566c485a8d0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a6704d53941b77c server_cookie=ab7a0fb287539e2e in_seq=0 out_seq=0 2024-08-20T05:08:22.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.942+0000 7fc4cea00640 10 client.27116 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.972+0000 7fc4cea00640 1 -- 172.21.15.37:0/1835142106 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5566c473c760 con 0x5566c48584b0 2024-08-20T05:08:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.972+0000 7fc4cea00640 10 client.27116 handle_command_reply: tid=0 2024-08-20T05:08:22.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.974+0000 7fc4f29e2740 1 client.27116 shutdown 2024-08-20T05:08:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.979+0000 7fc4f29e2740 1 -- 172.21.15.37:0/1835142106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 msgr2=0x5566c47e5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.979+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/1835142106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 0x5566c47e5ff0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00095d0 tx=0x7fc4e0009500 comp rx=0 tx=0).stop 2024-08-20T05:08:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.979+0000 7fc4f29e2740 1 -- 172.21.15.37:0/1835142106 shutdown_connections 2024-08-20T05:08:22.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.979+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/1835142106 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5566c48584b0 0x5566c485a8d0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.979+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/1835142106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5566c47dddb0 0x5566c47f4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.979+0000 7fc4cea00640 0 client.27116 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:22.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.979+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/1835142106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566c47c9610 0x5566c47f4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.979+0000 7fc4f29e2740 1 --2- 172.21.15.37:0/1835142106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5566c47c8cf0 0x5566c47e5ff0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.979+0000 7fc4f29e2740 1 -- 172.21.15.37:0/1835142106 >> 172.21.15.37:0/1835142106 conn(0x5566c47c6b20 msgr2=0x5566c47dc050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:22.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.980+0000 7fc4f29e2740 1 -- 172.21.15.37:0/1835142106 shutdown_connections 2024-08-20T05:08:22.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.980+0000 7fc4f29e2740 1 -- 172.21.15.37:0/1835142106 wait complete. 2024-08-20T05:08:22.983 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:08:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 36, 2024-08-20T05:08:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:08:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 28, 2024-08-20T05:08:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:08:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "dc8b695b": { 2024-08-20T05:08:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 28, 2024-08-20T05:08:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:08:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:08:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:08:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:08:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:08:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:08:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 150.0, 2024-08-20T05:08:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:08:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:08:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:08:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:08:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:08:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:08:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:08:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:08:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:08:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:08:22.985 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:08:22.986 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:08:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.981+0000 7fc4f29e2740 20 client.27116 trim_cache size 0 max 16384 2024-08-20T05:08:22.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.986+0000 7fc4f0000640 1 -- 172.21.15.37:0/1190761314 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc4d00b3c50 msgr2=0x7fc4d00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.986+0000 7fc4f0000640 1 --2- 172.21.15.37:0/1190761314 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc4d00b3c50 0x7fc4d00b6110 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc0aae20 tx=0x7fc4dc0e7cd0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.986+0000 7fc4f0000640 1 -- 172.21.15.37:0/1190761314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e8104ca0 msgr2=0x7fc4e819b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.986+0000 7fc4f0000640 1 --2- 172.21.15.37:0/1190761314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e8104ca0 0x7fc4e819b170 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00e9f0 tx=0x7fc4dc00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.986+0000 7fc4f0000640 1 -- 172.21.15.37:0/1190761314 shutdown_connections 2024-08-20T05:08:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.986+0000 7fc4f0000640 1 --2- 172.21.15.37:0/1190761314 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc4d00b3c50 0x7fc4d00b6110 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.986+0000 7fc4f0000640 1 --2- 172.21.15.37:0/1190761314 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc4e810b030 0x7fc4e81a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.986+0000 7fc4f0000640 1 --2- 172.21.15.37:0/1190761314 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc4e810a6b0 0x7fc4e819b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.986+0000 7fc4f0000640 1 --2- 172.21.15.37:0/1190761314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4e8104ca0 0x7fc4e819b170 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:22.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.986+0000 7fc4f0000640 1 -- 172.21.15.37:0/1190761314 >> 172.21.15.37:0/1190761314 conn(0x7fc4e8100730 msgr2=0x7fc4e8102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:22.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.988+0000 7fc4f0000640 1 -- 172.21.15.37:0/1190761314 shutdown_connections 2024-08-20T05:08:22.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:22.988+0000 7fc4f0000640 1 -- 172.21.15.37:0/1190761314 wait complete. 2024-08-20T05:08:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 325.0 s, 2.4 tps, lat 27085.985 ms stddev 206.550 2024-08-20T05:08:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:23 smithi037 ceph-mon[17265]: pgmap v585: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.7 MiB/s wr, 259 op/s 2024-08-20T05:08:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:23 smithi130 ceph-mon[22007]: pgmap v585: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.7 MiB/s wr, 259 op/s 2024-08-20T05:08:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:08:24.027 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'dc8b695b', total seconds elapsed: 35.8 2024-08-20T05:08:24.028 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-08-20T05:08:24.028 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:08:24.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:23 smithi135 ceph-mon[22342]: pgmap v585: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.7 MiB/s wr, 259 op/s 2024-08-20T05:08:24.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.798+0000 7f5262200640 1 -- 172.21.15.37:0/2863991380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f525c104cb0 msgr2=0x7f525c105090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:24.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.798+0000 7f5262200640 1 --2- 172.21.15.37:0/2863991380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f525c104cb0 0x7f525c105090 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5248009900 tx=0x7f524802a400 comp rx=0 tx=0).stop 2024-08-20T05:08:24.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.799+0000 7f5262200640 1 -- 172.21.15.37:0/2863991380 shutdown_connections 2024-08-20T05:08:24.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.799+0000 7f5262200640 1 --2- 172.21.15.37:0/2863991380 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c10b040 0x7f525c111840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.799+0000 7f5262200640 1 --2- 172.21.15.37:0/2863991380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f525c10a6c0 0x7f525c10ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.799+0000 7f5262200640 1 --2- 172.21.15.37:0/2863991380 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f525c104cb0 0x7f525c105090 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.799+0000 7f5262200640 1 -- 172.21.15.37:0/2863991380 >> 172.21.15.37:0/2863991380 conn(0x7f525c100720 msgr2=0x7f525c102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:24.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.800+0000 7f5262200640 1 -- 172.21.15.37:0/2863991380 shutdown_connections 2024-08-20T05:08:24.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.800+0000 7f5262200640 1 -- 172.21.15.37:0/2863991380 wait complete. 2024-08-20T05:08:24.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.801+0000 7f5262200640 1 Processor -- start 2024-08-20T05:08:24.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.802+0000 7f5262200640 1 -- start start 2024-08-20T05:08:24.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.802+0000 7f5262200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f525c104cb0 0x7f525c0773e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.802+0000 7f5262200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c10a6c0 0x7f525c077920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.802+0000 7f5262200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f525c10b040 0x7f525c077e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.803+0000 7f5262200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f525c114d50 con 0x7f525c104cb0 2024-08-20T05:08:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.803+0000 7f5262200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f525c114bd0 con 0x7f525c10b040 2024-08-20T05:08:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.803+0000 7f5262200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f525c114ed0 con 0x7f525c10a6c0 2024-08-20T05:08:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.803+0000 7f525b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f525c104cb0 0x7f525c0773e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.803+0000 7f525be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f525c10b040 0x7f525c077e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.803+0000 7f525be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f525c10b040 0x7f525c077e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:49814/0 (socket says 172.21.15.37:49814) 2024-08-20T05:08:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.803+0000 7f525be00640 1 -- 172.21.15.37:0/2518059113 learned_addr learned my addr 172.21.15.37:0/2518059113 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.803+0000 7f525aa00640 1 --2- 172.21.15.37:0/2518059113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c10a6c0 0x7f525c077920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.804+0000 7f525be00640 1 -- 172.21.15.37:0/2518059113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c10a6c0 msgr2=0x7f525c077920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.804+0000 7f525be00640 1 --2- 172.21.15.37:0/2518059113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c10a6c0 0x7f525c077920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.804+0000 7f525be00640 1 -- 172.21.15.37:0/2518059113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f525c104cb0 msgr2=0x7f525c0773e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.804+0000 7f525be00640 1 --2- 172.21.15.37:0/2518059113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f525c104cb0 0x7f525c0773e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.804+0000 7f525be00640 1 -- 172.21.15.37:0/2518059113 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c1ab830 con 0x7f525c10b040 2024-08-20T05:08:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.804+0000 7f525b400640 1 --2- 172.21.15.37:0/2518059113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f525c104cb0 0x7f525c0773e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:08:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.804+0000 7f525be00640 1 --2- 172.21.15.37:0/2518059113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f525c10b040 0x7f525c077e60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5254009fd0 tx=0x7f525400b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.804+0000 7f5253e00640 1 -- 172.21.15.37:0/2518059113 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254017070 con 0x7f525c10b040 2024-08-20T05:08:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.804+0000 7f5253e00640 1 -- 172.21.15.37:0/2518059113 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5254003e20 con 0x7f525c10b040 2024-08-20T05:08:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.805+0000 7f5253e00640 1 -- 172.21.15.37:0/2518059113 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254010460 con 0x7f525c10b040 2024-08-20T05:08:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.805+0000 7f5262200640 1 -- 172.21.15.37:0/2518059113 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525c1abb20 con 0x7f525c10b040 2024-08-20T05:08:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.805+0000 7f5262200640 1 -- 172.21.15.37:0/2518059113 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525c1ac010 con 0x7f525c10b040 2024-08-20T05:08:24.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.810+0000 7f5264c02740 1 Processor -- start 2024-08-20T05:08:24.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.811+0000 7f5253e00640 1 -- 172.21.15.37:0/2518059113 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5254003970 con 0x7f525c10b040 2024-08-20T05:08:24.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.811+0000 7f5264c02740 1 -- start start 2024-08-20T05:08:24.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.811+0000 7f5264c02740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f5950 0x5582ad6f5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.811+0000 7f5264c02740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad6f6270 0x5582ad701cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.811+0000 7f5264c02740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad702200 0x5582ad7045f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.812+0000 7f5264c02740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5582ad66ba60 con 0x5582ad6f5950 2024-08-20T05:08:24.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.812+0000 7f5264c02740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5582ad65af60 con 0x5582ad702200 2024-08-20T05:08:24.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.812+0000 7f5264c02740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5582ad65efa0 con 0x5582ad6f6270 2024-08-20T05:08:24.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.812+0000 7f525aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad702200 0x5582ad7045f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:24.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.812+0000 7f525aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad702200 0x5582ad7045f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:49822/0 (socket says 172.21.15.37:49822) 2024-08-20T05:08:24.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.812+0000 7f525aa00640 1 -- 172.21.15.37:0/1474233747 learned_addr learned my addr 172.21.15.37:0/1474233747 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:24.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.813+0000 7f525aa00640 1 -- 172.21.15.37:0/1474233747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad6f6270 msgr2=0x5582ad701cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:08:24.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.813+0000 7f525aa00640 1 --2- 172.21.15.37:0/1474233747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad6f6270 0x5582ad701cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.813+0000 7f525aa00640 1 -- 172.21.15.37:0/1474233747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f5950 msgr2=0x5582ad6f5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:24.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.813+0000 7f525aa00640 1 --2- 172.21.15.37:0/1474233747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f5950 0x5582ad6f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.813+0000 7f525aa00640 1 -- 172.21.15.37:0/1474233747 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582ad6013e0 con 0x5582ad702200 2024-08-20T05:08:24.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.813+0000 7f525aa00640 1 --2- 172.21.15.37:0/1474233747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad702200 0x5582ad7045f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f524c009d10 tx=0x7f524c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79c39173c5f82cad server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:24.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.813+0000 7f5247e00640 1 -- 172.21.15.37:0/1474233747 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c01f070 con 0x5582ad702200 2024-08-20T05:08:24.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.813+0000 7f5247e00640 1 -- 172.21.15.37:0/1474233747 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f524c009e00 con 0x5582ad702200 2024-08-20T05:08:24.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.813+0000 7f5247e00640 1 -- 172.21.15.37:0/1474233747 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524c00f750 con 0x5582ad702200 2024-08-20T05:08:24.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.814+0000 7f5253e00640 1 --2- 172.21.15.37:0/2518059113 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f52400b3d60 0x7f52400b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.814+0000 7f5264c02740 1 -- 172.21.15.37:0/1474233747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad702200 msgr2=0x5582ad7045f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:24.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.814+0000 7f5264c02740 1 --2- 172.21.15.37:0/1474233747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad702200 0x5582ad7045f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f524c009d10 tx=0x7f524c011810 comp rx=0 tx=0).stop 2024-08-20T05:08:24.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.815+0000 7f5253e00640 1 -- 172.21.15.37:0/2518059113 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f52540e3bd0 con 0x7f525c10b040 2024-08-20T05:08:24.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.815+0000 7f5264c02740 1 -- 172.21.15.37:0/1474233747 shutdown_connections 2024-08-20T05:08:24.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.815+0000 7f5264c02740 1 --2- 172.21.15.37:0/1474233747 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad702200 0x5582ad7045f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.815+0000 7f5264c02740 1 --2- 172.21.15.37:0/1474233747 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad6f6270 0x5582ad701cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.815+0000 7f5264c02740 1 --2- 172.21.15.37:0/1474233747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f5950 0x5582ad6f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.815+0000 7f5264c02740 1 -- 172.21.15.37:0/1474233747 >> 172.21.15.37:0/1474233747 conn(0x5582ad6f3780 msgr2=0x5582ad6f4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:24.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.815+0000 7f5264c02740 1 -- 172.21.15.37:0/1474233747 shutdown_connections 2024-08-20T05:08:24.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.815+0000 7f525b400640 1 --2- 172.21.15.37:0/2518059113 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f52400b3d60 0x7f52400b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:24.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.815+0000 7f5264c02740 1 -- 172.21.15.37:0/1474233747 wait complete. 2024-08-20T05:08:24.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.816+0000 7f5264c02740 1 -- start start 2024-08-20T05:08:24.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.817+0000 7f525b400640 1 --2- 172.21.15.37:0/2518059113 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f52400b3d60 0x7f52400b6220 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5248000c00 tx=0x7f5248031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:24.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.817+0000 7f5264c02740 1 Processor -- start 2024-08-20T05:08:24.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.817+0000 7f5264c02740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f5950 0x5582ad701a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.817+0000 7f5264c02740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad6f6270 0x5582ad6feed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.817+0000 7f5264c02740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad702200 0x5582ad6ff470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.817+0000 7f5264c02740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5582ad4bd700 con 0x5582ad6f5950 2024-08-20T05:08:24.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.817+0000 7f5264c02740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5582ad5f6250 con 0x5582ad6f6270 2024-08-20T05:08:24.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.817+0000 7f5264c02740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5582ad704e80 con 0x5582ad702200 2024-08-20T05:08:24.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.817+0000 7f5264c02740 10 client.0 _ll_register_callbacks cb 0x5582ad655180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:24.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.818+0000 7f525b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f5950 0x5582ad701a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:24.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.818+0000 7f525b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f5950 0x5582ad701a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47824/0 (socket says 172.21.15.37:47824) 2024-08-20T05:08:24.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.818+0000 7f525b400640 1 -- 172.21.15.37:0/3467540762 learned_addr learned my addr 172.21.15.37:0/3467540762 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:24.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.819+0000 7f525aa00640 1 --2- 172.21.15.37:0/3467540762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad6f6270 0x5582ad6feed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.819+0000 7f525be00640 1 --2- 172.21.15.37:0/3467540762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad702200 0x5582ad6ff470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.819+0000 7f525b400640 1 -- 172.21.15.37:0/3467540762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad702200 msgr2=0x5582ad6ff470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.819+0000 7f525b400640 1 --2- 172.21.15.37:0/3467540762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad702200 0x5582ad6ff470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.820+0000 7f525b400640 1 -- 172.21.15.37:0/3467540762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad6f6270 msgr2=0x5582ad6feed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.820+0000 7f525b400640 1 --2- 172.21.15.37:0/3467540762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad6f6270 0x5582ad6feed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.820+0000 7f525b400640 1 -- 172.21.15.37:0/3467540762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582ad3ba650 con 0x5582ad6f5950 2024-08-20T05:08:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.820+0000 7f525aa00640 1 --2- 172.21.15.37:0/3467540762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad6f6270 0x5582ad6feed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:08:24.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.820+0000 7f525be00640 1 --2- 172.21.15.37:0/3467540762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad702200 0x5582ad6ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:08:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.820+0000 7f525b400640 1 --2- 172.21.15.37:0/3467540762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f5950 0x5582ad701a80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5248009900 tx=0x7f5248009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f22736ac10e480 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.820+0000 7f5244c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:08:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.821+0000 7f5244c00640 1 -- 172.21.15.37:0/3467540762 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524804c020 con 0x5582ad6f5950 2024-08-20T05:08:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.821+0000 7f5244c00640 1 -- 172.21.15.37:0/3467540762 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5248004b90 con 0x5582ad6f5950 2024-08-20T05:08:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.821+0000 7f5264c02740 1 -- 172.21.15.37:0/3467540762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f524c009e00 con 0x5582ad6f5950 2024-08-20T05:08:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.821+0000 7f5244c00640 1 -- 172.21.15.37:0/3467540762 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5248057050 con 0x5582ad6f5950 2024-08-20T05:08:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.821+0000 7f5264c02740 10 client.16824 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.821+0000 7f5264c02740 1 -- 172.21.15.37:0/3467540762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5582ad710750 con 0x5582ad6f5950 2024-08-20T05:08:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.822+0000 7f5244c00640 1 -- 172.21.15.37:0/3467540762 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f524c009e00 con 0x5582ad6f5950 2024-08-20T05:08:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.822+0000 7f5244c00640 1 -- 172.21.15.37:0/3467540762 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f52480324b0 con 0x5582ad6f5950 2024-08-20T05:08:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.822+0000 7f5264c02740 10 client.16824 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.822+0000 7f5264c02740 10 client.16824 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.822+0000 7f5264c02740 20 client.16824 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.822+0000 7f5264c02740 1 --2- 172.21.15.37:0/3467540762 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5582ad711cb0 0x5582ad714130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.822+0000 7f5264c02740 4 client.16824 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:08:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.822+0000 7f5264c02740 1 -- 172.21.15.37:0/3467540762 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582ad66d9b0 con 0x5582ad711cb0 2024-08-20T05:08:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.823+0000 7f525aa00640 1 --2- 172.21.15.37:0/3467540762 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5582ad711cb0 0x5582ad714130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.824+0000 7f525aa00640 1 --2- 172.21.15.37:0/3467540762 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5582ad711cb0 0x5582ad714130 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2438d2920c2e3ca8 server_cookie=ac816312131b9757 in_seq=0 out_seq=0 2024-08-20T05:08:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.824+0000 7f5244c00640 10 client.16824 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.825+0000 7f5244c00640 1 -- 172.21.15.37:0/3467540762 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5582ad66d9b0 con 0x5582ad711cb0 2024-08-20T05:08:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.825+0000 7f5244c00640 10 client.16824 handle_command_reply: tid=0 2024-08-20T05:08:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.825+0000 7f5264c02740 1 client.16824 shutdown 2024-08-20T05:08:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.828+0000 7f5264c02740 1 -- 172.21.15.37:0/3467540762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f5950 msgr2=0x5582ad701a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.828+0000 7f5264c02740 1 --2- 172.21.15.37:0/3467540762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f5950 0x5582ad701a80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5248009900 tx=0x7f5248009260 comp rx=0 tx=0).stop 2024-08-20T05:08:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.828+0000 7f5264c02740 1 -- 172.21.15.37:0/3467540762 shutdown_connections 2024-08-20T05:08:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.828+0000 7f5264c02740 1 --2- 172.21.15.37:0/3467540762 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5582ad711cb0 0x5582ad714130 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.828+0000 7f5264c02740 1 --2- 172.21.15.37:0/3467540762 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad702200 0x5582ad6ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.828+0000 7f5264c02740 1 --2- 172.21.15.37:0/3467540762 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad6f6270 0x5582ad6feed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.828+0000 7f5264c02740 1 --2- 172.21.15.37:0/3467540762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f5950 0x5582ad701a80 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.828+0000 7f5264c02740 1 -- 172.21.15.37:0/3467540762 >> 172.21.15.37:0/3467540762 conn(0x5582ad6f3780 msgr2=0x5582ad6f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:24.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.828+0000 7f5244c00640 0 client.16824 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:24.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.829+0000 7f5264c02740 1 -- 172.21.15.37:0/3467540762 shutdown_connections 2024-08-20T05:08:24.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.829+0000 7f5264c02740 1 -- 172.21.15.37:0/3467540762 wait complete. 2024-08-20T05:08:24.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.829+0000 7f5264c02740 20 client.16824 trim_cache size 0 max 16384 2024-08-20T05:08:24.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.865+0000 7f5264c02740 1 Processor -- start 2024-08-20T05:08:24.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.865+0000 7f5264c02740 1 -- start start 2024-08-20T05:08:24.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.866+0000 7f5264c02740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f5950 0x5582ad6f2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.866+0000 7f5264c02740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad6f6270 0x5582ad700c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.866+0000 7f5264c02740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad702200 0x5582ad719a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.866+0000 7f5264c02740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f525c1b5f30 con 0x5582ad6f5950 2024-08-20T05:08:24.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.866+0000 7f5264c02740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f525c1b7a70 con 0x5582ad6f6270 2024-08-20T05:08:24.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.866+0000 7f5264c02740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f525c1b6600 con 0x5582ad702200 2024-08-20T05:08:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.867+0000 7f525aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad6f6270 0x5582ad700c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.867+0000 7f525aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad6f6270 0x5582ad700c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:49848/0 (socket says 172.21.15.37:49848) 2024-08-20T05:08:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.867+0000 7f525aa00640 1 -- 172.21.15.37:0/1300807886 learned_addr learned my addr 172.21.15.37:0/1300807886 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.867+0000 7f525be00640 1 --2- 172.21.15.37:0/1300807886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad702200 0x5582ad719a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.868+0000 7f525be00640 1 -- 172.21.15.37:0/1300807886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad6f6270 msgr2=0x5582ad700c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.868+0000 7f525be00640 1 --2- 172.21.15.37:0/1300807886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad6f6270 0x5582ad700c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.868+0000 7f525be00640 1 -- 172.21.15.37:0/1300807886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f5950 msgr2=0x5582ad6f2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.868+0000 7f525be00640 1 --2- 172.21.15.37:0/1300807886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f5950 0x5582ad6f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.868+0000 7f525be00640 1 -- 172.21.15.37:0/1300807886 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582ad701df0 con 0x5582ad702200 2024-08-20T05:08:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.868+0000 7f525be00640 1 --2- 172.21.15.37:0/1300807886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad702200 0x5582ad719a00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f52540e12d0 tx=0x7f5254004020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c99492bb4c316e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.868+0000 7f5247400640 1 -- 172.21.15.37:0/1300807886 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254020040 con 0x5582ad702200 2024-08-20T05:08:24.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.869+0000 7f5247400640 1 -- 172.21.15.37:0/1300807886 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52540aa230 con 0x5582ad702200 2024-08-20T05:08:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.869+0000 7f5247400640 1 -- 172.21.15.37:0/1300807886 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52540a69b0 con 0x5582ad702200 2024-08-20T05:08:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.870+0000 7f5264c02740 1 -- 172.21.15.37:0/1300807886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad702200 msgr2=0x5582ad719a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.870+0000 7f5264c02740 1 --2- 172.21.15.37:0/1300807886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad702200 0x5582ad719a00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f52540e12d0 tx=0x7f5254004020 comp rx=0 tx=0).stop 2024-08-20T05:08:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.870+0000 7f5264c02740 1 -- 172.21.15.37:0/1300807886 shutdown_connections 2024-08-20T05:08:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.870+0000 7f5264c02740 1 --2- 172.21.15.37:0/1300807886 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad702200 0x5582ad719a00 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.870+0000 7f5264c02740 1 --2- 172.21.15.37:0/1300807886 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad6f6270 0x5582ad700c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.870+0000 7f5264c02740 1 --2- 172.21.15.37:0/1300807886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f5950 0x5582ad6f2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.870+0000 7f5264c02740 1 -- 172.21.15.37:0/1300807886 >> 172.21.15.37:0/1300807886 conn(0x5582ad6f3780 msgr2=0x5582ad700500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:24.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.872+0000 7f5264c02740 1 -- 172.21.15.37:0/1300807886 shutdown_connections 2024-08-20T05:08:24.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.874+0000 7f5264c02740 1 -- 172.21.15.37:0/1300807886 wait complete. 2024-08-20T05:08:24.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.874+0000 7f5264c02740 1 -- start start 2024-08-20T05:08:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.875+0000 7f5264c02740 1 Processor -- start 2024-08-20T05:08:24.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.877+0000 7f5264c02740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad6f5950 0x5582ad7078d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.877+0000 7f5264c02740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f6270 0x5582ad707e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.877+0000 7f5264c02740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad702200 0x5582ad7749a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.878+0000 7f525be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad702200 0x5582ad7749a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:24.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.878+0000 7f525be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad702200 0x5582ad7749a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:49864/0 (socket says 172.21.15.37:49864) 2024-08-20T05:08:24.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.879+0000 7f525be00640 1 -- 172.21.15.37:0/3589643029 learned_addr learned my addr 172.21.15.37:0/3589643029 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:24.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.879+0000 7f5264c02740 1 -- 172.21.15.37:0/3589643029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f525c1b73a0 con 0x5582ad6f6270 2024-08-20T05:08:24.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.879+0000 7f5264c02740 1 -- 172.21.15.37:0/3589643029 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f525c1b6cd0 con 0x5582ad702200 2024-08-20T05:08:24.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.879+0000 7f5264c02740 1 -- 172.21.15.37:0/3589643029 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f525c1b3f10 con 0x5582ad6f5950 2024-08-20T05:08:24.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.879+0000 7f5264c02740 10 client.0 _ll_register_callbacks cb 0x7f524803f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:24.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.879+0000 7f525b400640 1 --2- 172.21.15.37:0/3589643029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad6f5950 0x5582ad7078d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:24.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.880+0000 7f525aa00640 1 --2- 172.21.15.37:0/3589643029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f6270 0x5582ad707e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:24.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.880+0000 7f525be00640 1 -- 172.21.15.37:0/3589643029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad6f5950 msgr2=0x5582ad7078d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:24.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.880+0000 7f525be00640 1 --2- 172.21.15.37:0/3589643029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad6f5950 0x5582ad7078d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.880+0000 7f525be00640 1 -- 172.21.15.37:0/3589643029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f6270 msgr2=0x5582ad707e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:24.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.880+0000 7f525be00640 1 --2- 172.21.15.37:0/3589643029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f6270 0x5582ad707e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.880+0000 7f525be00640 1 -- 172.21.15.37:0/3589643029 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582ad7750b0 con 0x5582ad702200 2024-08-20T05:08:24.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.881+0000 7f5244c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:08:24.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.881+0000 7f525be00640 1 --2- 172.21.15.37:0/3589643029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad702200 0x5582ad7749a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f52540e12a0 tx=0x7f52540042e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b7a8af6c688fea6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:24.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.882+0000 7f5244c00640 1 -- 172.21.15.37:0/3589643029 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254020070 con 0x5582ad702200 2024-08-20T05:08:24.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.883+0000 7f5244c00640 1 -- 172.21.15.37:0/3589643029 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f52540cd0c0 con 0x5582ad702200 2024-08-20T05:08:24.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.883+0000 7f5264c02740 1 -- 172.21.15.37:0/3589643029 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52540aa230 con 0x5582ad702200 2024-08-20T05:08:24.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.884+0000 7f5244c00640 1 -- 172.21.15.37:0/3589643029 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f52540aa720 con 0x5582ad702200 2024-08-20T05:08:24.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.884+0000 7f5264c02740 10 client.27134 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:24.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.884+0000 7f5264c02740 1 -- 172.21.15.37:0/3589643029 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5582ad77c460 con 0x5582ad702200 2024-08-20T05:08:24.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.884+0000 7f5244c00640 1 -- 172.21.15.37:0/3589643029 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52540aa230 con 0x5582ad702200 2024-08-20T05:08:24.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.885+0000 7f5244c00640 1 -- 172.21.15.37:0/3589643029 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f52540a6090 con 0x5582ad702200 2024-08-20T05:08:24.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.885+0000 7f5264c02740 10 client.27134 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:24.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.885+0000 7f5264c02740 10 client.27134 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:24.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.885+0000 7f5264c02740 20 client.27134 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:24.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.885+0000 7f5264c02740 1 --2- 172.21.15.37:0/3589643029 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5582ad77cab0 0x5582ad77eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:24.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.885+0000 7f5264c02740 4 client.27134 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:08:24.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.885+0000 7f5264c02740 1 -- 172.21.15.37:0/3589643029 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5582ad669450 con 0x5582ad77cab0 2024-08-20T05:08:24.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.887+0000 7f525b400640 1 --2- 172.21.15.37:0/3589643029 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5582ad77cab0 0x5582ad77eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:24.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.888+0000 7f525b400640 1 --2- 172.21.15.37:0/3589643029 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5582ad77cab0 0x5582ad77eed0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bb6883f8a7c90fe server_cookie=3f5259e3f1ce6c28 in_seq=0 out_seq=0 2024-08-20T05:08:24.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.888+0000 7f5244c00640 10 client.27134 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:24.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.888+0000 7f5244c00640 1 -- 172.21.15.37:0/3589643029 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5582ad669450 con 0x5582ad77cab0 2024-08-20T05:08:24.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.888+0000 7f5244c00640 10 client.27134 handle_command_reply: tid=0 2024-08-20T05:08:24.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.888+0000 7f5264c02740 1 client.27134 shutdown 2024-08-20T05:08:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.889+0000 7f5264c02740 1 -- 172.21.15.37:0/3589643029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad702200 msgr2=0x5582ad7749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.889+0000 7f5264c02740 1 --2- 172.21.15.37:0/3589643029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad702200 0x5582ad7749a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f52540e12a0 tx=0x7f52540042e0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.889+0000 7f5264c02740 1 -- 172.21.15.37:0/3589643029 shutdown_connections 2024-08-20T05:08:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.889+0000 7f5264c02740 1 --2- 172.21.15.37:0/3589643029 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5582ad77cab0 0x5582ad77eed0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.889+0000 7f5264c02740 1 --2- 172.21.15.37:0/3589643029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5582ad702200 0x5582ad7749a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.889+0000 7f5244c00640 0 client.27134 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.890+0000 7f5264c02740 1 --2- 172.21.15.37:0/3589643029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5582ad6f6270 0x5582ad707e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.890+0000 7f5264c02740 1 --2- 172.21.15.37:0/3589643029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5582ad6f5950 0x5582ad7078d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.890+0000 7f5264c02740 1 -- 172.21.15.37:0/3589643029 >> 172.21.15.37:0/3589643029 conn(0x5582ad6f3780 msgr2=0x5582ad6f27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.890+0000 7f5264c02740 1 -- 172.21.15.37:0/3589643029 shutdown_connections 2024-08-20T05:08:24.893 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:08:24.893 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T05:08:24.893 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-20T05:08:24.893 INFO:teuthology.orchestra.run.smithi037.stdout: "af62b868-59b4-4ab4-b8d0-d888b3555def": { 2024-08-20T05:08:24.893 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-20T05:08:24.893 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "af62b868-59b4-4ab4-b8d0-d888b3555def", 2024-08-20T05:08:24.894 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-20T05:08:24.894 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:08:24.894 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:08:24.894 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:08:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.890+0000 7f5264c02740 1 -- 172.21.15.37:0/3589643029 wait complete. 2024-08-20T05:08:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.891+0000 7f5264c02740 20 client.27134 trim_cache size 0 max 16384 2024-08-20T05:08:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.892+0000 7f5262200640 1 -- 172.21.15.37:0/2518059113 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f52400b3d60 msgr2=0x7f52400b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.892+0000 7f5262200640 1 --2- 172.21.15.37:0/2518059113 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f52400b3d60 0x7f52400b6220 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5248000c00 tx=0x7f5248031400 comp rx=0 tx=0).stop 2024-08-20T05:08:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.892+0000 7f5262200640 1 -- 172.21.15.37:0/2518059113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f525c10b040 msgr2=0x7f525c077e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.892+0000 7f5262200640 1 --2- 172.21.15.37:0/2518059113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f525c10b040 0x7f525c077e60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5254009fd0 tx=0x7f525400b260 comp rx=0 tx=0).stop 2024-08-20T05:08:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.893+0000 7f5262200640 1 -- 172.21.15.37:0/2518059113 shutdown_connections 2024-08-20T05:08:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.893+0000 7f5262200640 1 --2- 172.21.15.37:0/2518059113 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f52400b3d60 0x7f52400b6220 secure :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5248000c00 tx=0x7f5248031400 comp rx=0 tx=0).stop 2024-08-20T05:08:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.893+0000 7f5262200640 1 --2- 172.21.15.37:0/2518059113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f525c10b040 0x7f525c077e60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.893+0000 7f5262200640 1 --2- 172.21.15.37:0/2518059113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f525c10a6c0 0x7f525c077920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.893+0000 7f5262200640 1 --2- 172.21.15.37:0/2518059113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f525c104cb0 0x7f525c0773e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:24.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.893+0000 7f5262200640 1 -- 172.21.15.37:0/2518059113 >> 172.21.15.37:0/2518059113 conn(0x7f525c100720 msgr2=0x7f525c1020a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.897+0000 7f5262200640 1 -- 172.21.15.37:0/2518059113 shutdown_connections 2024-08-20T05:08:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:24.897+0000 7f5262200640 1 -- 172.21.15.37:0/2518059113 wait complete. 2024-08-20T05:08:25.907 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:25 smithi037 ceph-mon[17265]: pgmap v586: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 407 KiB/s wr, 86 op/s 2024-08-20T05:08:25.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:25 smithi130 ceph-mon[22007]: pgmap v586: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 407 KiB/s wr, 86 op/s 2024-08-20T05:08:25.970 INFO:tasks.cephfs.filesystem:scrub status for tag:af62b868-59b4-4ab4-b8d0-d888b3555def - {'path': '/', 'tag': 'af62b868-59b4-4ab4-b8d0-d888b3555def', 'options': 'recursive,force'} 2024-08-20T05:08:26.000 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:08:26.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:25 smithi135 ceph-mon[22342]: pgmap v586: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 407 KiB/s wr, 86 op/s 2024-08-20T05:08:26.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.723+0000 7fdd21400640 1 -- 172.21.15.37:0/2528428545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd1c113880 msgr2=0x7fdd1c115c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:26.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.723+0000 7fdd21400640 1 --2- 172.21.15.37:0/2528428545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd1c113880 0x7fdd1c115c90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdd1400acf0 tx=0x7fdd1402b9e0 comp rx=0 tx=0).stop 2024-08-20T05:08:26.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.724+0000 7fdd21400640 1 -- 172.21.15.37:0/2528428545 shutdown_connections 2024-08-20T05:08:26.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.724+0000 7fdd21400640 1 --2- 172.21.15.37:0/2528428545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd1c113880 0x7fdd1c115c90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:26.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.724+0000 7fdd21400640 1 --2- 172.21.15.37:0/2528428545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd1c10ac80 0x7fdd1c113340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:26.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.724+0000 7fdd21400640 1 --2- 172.21.15.37:0/2528428545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd1c10a2d0 0x7fdd1c10a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:26.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.724+0000 7fdd21400640 1 -- 172.21.15.37:0/2528428545 >> 172.21.15.37:0/2528428545 conn(0x7fdd1c06dcc0 msgr2=0x7fdd1c06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:26.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.725+0000 7fdd21400640 1 -- 172.21.15.37:0/2528428545 shutdown_connections 2024-08-20T05:08:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.725+0000 7fdd21400640 1 -- 172.21.15.37:0/2528428545 wait complete. 2024-08-20T05:08:26.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.726+0000 7fdd21400640 1 Processor -- start 2024-08-20T05:08:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.728+0000 7fdd21400640 1 -- start start 2024-08-20T05:08:26.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.728+0000 7fdd21400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd1c10a2d0 0x7fdd1c1a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.728+0000 7fdd21400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd1c10ac80 0x7fdd1c1a66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.728+0000 7fdd21400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd1c113880 0x7fdd1c19f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.728+0000 7fdd21400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c119100 con 0x7fdd1c10a2d0 2024-08-20T05:08:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.728+0000 7fdd21400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c118f80 con 0x7fdd1c113880 2024-08-20T05:08:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.728+0000 7fdd21400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdd1c119280 con 0x7fdd1c10ac80 2024-08-20T05:08:26.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.729+0000 7fdd19e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd1c10ac80 0x7fdd1c1a66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.729+0000 7fdd1a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd1c10a2d0 0x7fdd1c1a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.729+0000 7fdd19e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd1c10ac80 0x7fdd1c1a66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:48208/0 (socket says 172.21.15.37:48208) 2024-08-20T05:08:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.729+0000 7fdd1b200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd1c113880 0x7fdd1c19f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.729+0000 7fdd19e00640 1 -- 172.21.15.37:0/2415979458 learned_addr learned my addr 172.21.15.37:0/2415979458 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.730+0000 7fdd19e00640 1 -- 172.21.15.37:0/2415979458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd1c113880 msgr2=0x7fdd1c19f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.730+0000 7fdd19e00640 1 --2- 172.21.15.37:0/2415979458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd1c113880 0x7fdd1c19f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:26.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.730+0000 7fdd19e00640 1 -- 172.21.15.37:0/2415979458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd1c10a2d0 msgr2=0x7fdd1c1a6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:26.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.730+0000 7fdd19e00640 1 --2- 172.21.15.37:0/2415979458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd1c10a2d0 0x7fdd1c1a6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:26.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.730+0000 7fdd19e00640 1 -- 172.21.15.37:0/2415979458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd1c19fda0 con 0x7fdd1c10ac80 2024-08-20T05:08:26.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.736+0000 7fdd19e00640 1 --2- 172.21.15.37:0/2415979458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd1c10ac80 0x7fdd1c1a66d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800e9f0 tx=0x7fdd0800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:26.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.738+0000 7fdd13400640 1 -- 172.21.15.37:0/2415979458 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0800ccc0 con 0x7fdd1c10ac80 2024-08-20T05:08:26.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.738+0000 7fdd13400640 1 -- 172.21.15.37:0/2415979458 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd080054d0 con 0x7fdd1c10ac80 2024-08-20T05:08:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.738+0000 7fdd13400640 1 -- 172.21.15.37:0/2415979458 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd08010430 con 0x7fdd1c10ac80 2024-08-20T05:08:26.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.739+0000 7fdd21400640 1 -- 172.21.15.37:0/2415979458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd1c1a0090 con 0x7fdd1c10ac80 2024-08-20T05:08:26.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.740+0000 7fdd21400640 1 -- 172.21.15.37:0/2415979458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd1c1a5050 con 0x7fdd1c10ac80 2024-08-20T05:08:26.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.742+0000 7fdd21400640 1 -- 172.21.15.37:0/2415979458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd1c074640 con 0x7fdd1c10ac80 2024-08-20T05:08:26.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.752+0000 7fdd13400640 1 -- 172.21.15.37:0/2415979458 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdd080046c0 con 0x7fdd1c10ac80 2024-08-20T05:08:26.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.755+0000 7fdd13400640 1 --2- 172.21.15.37:0/2415979458 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd000b3d00 0x7fdd000b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:26.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.756+0000 7fdd1a800640 1 --2- 172.21.15.37:0/2415979458 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd000b3d00 0x7fdd000b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:26.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.758+0000 7fdd13400640 1 -- 172.21.15.37:0/2415979458 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fdd080a7810 con 0x7fdd1c10ac80 2024-08-20T05:08:26.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.758+0000 7fdd13400640 1 -- 172.21.15.37:0/2415979458 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fdd080ab920 con 0x7fdd1c10ac80 2024-08-20T05:08:26.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:26.760+0000 7fdd1a800640 1 --2- 172.21.15.37:0/2415979458 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd000b3d00 0x7fdd000b61c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009890 tx=0x7fdd0c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:26.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:26 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:08:26.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:26 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:08:26.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:26 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:08:27.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:26 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:08:27.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:26 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:08:27.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:26 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:08:27.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:26 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:08:27.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:26 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:08:27.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:26 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:08:27.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:27.178+0000 7fdd21400640 1 -- 172.21.15.37:0/2415979458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd1c10a6b0 con 0x7fdd1c10ac80 2024-08-20T05:08:27.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:27.179+0000 7fdd13400640 1 -- 172.21.15.37:0/2415979458 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11980 (secure 0 0 0) 0x7fdd1c10a6b0 con 0x7fdd1c10ac80 2024-08-20T05:08:27.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:08:27.185 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"btime":"2024-08-20T05:06:06:678364+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:06:06.276613+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:08:27.186 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 36 2024-08-20T05:08:27.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:27.184+0000 7fdd21400640 1 -- 172.21.15.37:0/2415979458 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd000b3d00 msgr2=0x7fdd000b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:27.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:27.184+0000 7fdd21400640 1 --2- 172.21.15.37:0/2415979458 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd000b3d00 0x7fdd000b61c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009890 tx=0x7fdd0c008040 comp rx=0 tx=0).stop 2024-08-20T05:08:27.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:27.184+0000 7fdd21400640 1 -- 172.21.15.37:0/2415979458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd1c10ac80 msgr2=0x7fdd1c1a66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:27.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:27.184+0000 7fdd21400640 1 --2- 172.21.15.37:0/2415979458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd1c10ac80 0x7fdd1c1a66d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdd0800e9f0 tx=0x7fdd0800eeb0 comp rx=0 tx=0).stop 2024-08-20T05:08:27.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:27.184+0000 7fdd21400640 1 -- 172.21.15.37:0/2415979458 shutdown_connections 2024-08-20T05:08:27.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:27.184+0000 7fdd21400640 1 --2- 172.21.15.37:0/2415979458 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd000b3d00 0x7fdd000b61c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:27.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:27.184+0000 7fdd21400640 1 --2- 172.21.15.37:0/2415979458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdd1c113880 0x7fdd1c19f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:27.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:27.184+0000 7fdd21400640 1 --2- 172.21.15.37:0/2415979458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdd1c10ac80 0x7fdd1c1a66d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:27.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:27.184+0000 7fdd21400640 1 --2- 172.21.15.37:0/2415979458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd1c10a2d0 0x7fdd1c1a6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:27.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:27.184+0000 7fdd21400640 1 -- 172.21.15.37:0/2415979458 >> 172.21.15.37:0/2415979458 conn(0x7fdd1c06dcc0 msgr2=0x7fdd1c072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:27.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:27.186+0000 7fdd21400640 1 -- 172.21.15.37:0/2415979458 shutdown_connections 2024-08-20T05:08:27.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:27.186+0000 7fdd21400640 1 -- 172.21.15.37:0/2415979458 wait complete. 2024-08-20T05:08:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:27 smithi130 ceph-mon[22007]: pgmap v587: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 1.1 MiB/s wr, 164 op/s 2024-08-20T05:08:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:27 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:08:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:27 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:08:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:27 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2415979458' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:08:28.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:27 smithi037 ceph-mon[17265]: pgmap v587: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 1.1 MiB/s wr, 164 op/s 2024-08-20T05:08:28.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:27 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:08:28.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:27 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:08:28.003 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:27 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2415979458' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:08:28.044 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 330.0 s, 652.6 tps, lat 875.609 ms stddev 4454.147 2024-08-20T05:08:28.081 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-08-20T05:08:28.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-08-20T05:08:28.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:27 smithi135 ceph-mon[22342]: pgmap v587: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 1.1 MiB/s wr, 164 op/s 2024-08-20T05:08:28.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:27 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:08:28.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:27 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:08:28.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:27 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2415979458' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:08:28.785 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:08:29.800 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:29 smithi037 ceph-mon[17265]: pgmap v588: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 1.9 MiB/s wr, 213 op/s 2024-08-20T05:08:29.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.713+0000 7ff04d600640 1 -- 172.21.15.37:0/3022067664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff048115740 msgr2=0x7ff048117b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:29.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.713+0000 7ff04d600640 1 --2- 172.21.15.37:0/3022067664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff048115740 0x7ff048117b30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff038009860 tx=0x7ff03802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.714+0000 7ff04d600640 1 -- 172.21.15.37:0/3022067664 shutdown_connections 2024-08-20T05:08:29.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.714+0000 7ff04d600640 1 --2- 172.21.15.37:0/3022067664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff048115740 0x7ff048117b30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.714+0000 7ff04d600640 1 --2- 172.21.15.37:0/3022067664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff04810a7a0 0x7ff048115200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.714+0000 7ff04d600640 1 --2- 172.21.15.37:0/3022067664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff048109e80 0x7ff04810a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.714+0000 7ff04d600640 1 -- 172.21.15.37:0/3022067664 >> 172.21.15.37:0/3022067664 conn(0x7ff04806dcc0 msgr2=0x7ff04806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:29.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.716+0000 7ff04d600640 1 -- 172.21.15.37:0/3022067664 shutdown_connections 2024-08-20T05:08:29.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.716+0000 7ff04d600640 1 -- 172.21.15.37:0/3022067664 wait complete. 2024-08-20T05:08:29.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.718+0000 7ff04d600640 1 Processor -- start 2024-08-20T05:08:29.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.718+0000 7ff04d600640 1 -- start start 2024-08-20T05:08:29.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.719+0000 7ff04d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff048109e80 0x7ff0481103c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.719+0000 7ff04d600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff04810a7a0 0x7ff048110900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.719+0000 7ff04d600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff048115740 0x7ff0481ab410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.719+0000 7ff04d600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff04811b2a0 con 0x7ff048109e80 2024-08-20T05:08:29.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.719+0000 7ff04d600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff04811b120 con 0x7ff048115740 2024-08-20T05:08:29.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.719+0000 7ff04d600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff04811b420 con 0x7ff04810a7a0 2024-08-20T05:08:29.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.719+0000 7ff046000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff04810a7a0 0x7ff048110900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:29.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.719+0000 7ff046a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff048109e80 0x7ff0481103c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:29.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.719+0000 7ff046000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff04810a7a0 0x7ff048110900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:48220/0 (socket says 172.21.15.37:48220) 2024-08-20T05:08:29.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.719+0000 7ff046000640 1 -- 172.21.15.37:0/1947915510 learned_addr learned my addr 172.21.15.37:0/1947915510 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:29.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.720+0000 7ff047400640 1 --2- 172.21.15.37:0/1947915510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff048115740 0x7ff0481ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:29.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.720+0000 7ff046000640 1 -- 172.21.15.37:0/1947915510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff048115740 msgr2=0x7ff0481ab410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:29.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.720+0000 7ff046000640 1 --2- 172.21.15.37:0/1947915510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff048115740 0x7ff0481ab410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.720+0000 7ff046000640 1 -- 172.21.15.37:0/1947915510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff048109e80 msgr2=0x7ff0481103c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:29.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.722+0000 7ff046000640 1 --2- 172.21.15.37:0/1947915510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff048109e80 0x7ff0481103c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.722+0000 7ff046000640 1 -- 172.21.15.37:0/1947915510 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0481abbe0 con 0x7ff04810a7a0 2024-08-20T05:08:29.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.722+0000 7ff046a00640 1 --2- 172.21.15.37:0/1947915510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff048109e80 0x7ff0481103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:08:29.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.723+0000 7ff046000640 1 --2- 172.21.15.37:0/1947915510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff04810a7a0 0x7ff048110900 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff03400d950 tx=0x7ff03400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:29.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.723+0000 7ff03f400640 1 -- 172.21.15.37:0/1947915510 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034017070 con 0x7ff04810a7a0 2024-08-20T05:08:29.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.723+0000 7ff03f400640 1 -- 172.21.15.37:0/1947915510 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff034009c30 con 0x7ff04810a7a0 2024-08-20T05:08:29.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.723+0000 7ff03f400640 1 -- 172.21.15.37:0/1947915510 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff03400f620 con 0x7ff04810a7a0 2024-08-20T05:08:29.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.724+0000 7ff04d600640 1 -- 172.21.15.37:0/1947915510 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0481abed0 con 0x7ff04810a7a0 2024-08-20T05:08:29.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.725+0000 7ff04d600640 1 -- 172.21.15.37:0/1947915510 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0481b4780 con 0x7ff04810a7a0 2024-08-20T05:08:29.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.731+0000 7ff050290740 1 Processor -- start 2024-08-20T05:08:29.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.732+0000 7ff050290740 1 -- start start 2024-08-20T05:08:29.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.732+0000 7ff050290740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d195fc3f0 0x557d195fc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.733+0000 7ff050290740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 0x557d19608760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.733+0000 7ff050290740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d19608ca0 0x557d1960b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.733+0000 7ff050290740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557d1959c670 con 0x557d195fcd10 2024-08-20T05:08:29.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.733+0000 7ff050290740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557d195707c0 con 0x557d19608ca0 2024-08-20T05:08:29.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.733+0000 7ff050290740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557d1955fcc0 con 0x557d195fc3f0 2024-08-20T05:08:29.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.733+0000 7ff047400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d195fc3f0 0x557d195fc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:29.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.734+0000 7ff047400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d195fc3f0 0x557d195fc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:48226/0 (socket says 172.21.15.37:48226) 2024-08-20T05:08:29.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.734+0000 7ff047400640 1 -- 172.21.15.37:0/1457284559 learned_addr learned my addr 172.21.15.37:0/1457284559 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:29.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.735+0000 7ff047400640 1 -- 172.21.15.37:0/1457284559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d19608ca0 msgr2=0x557d1960b090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:08:29.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.735+0000 7ff047400640 1 --2- 172.21.15.37:0/1457284559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d19608ca0 0x557d1960b090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.736+0000 7ff047400640 1 -- 172.21.15.37:0/1457284559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 msgr2=0x557d19608760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:29.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.736+0000 7ff047400640 1 --2- 172.21.15.37:0/1457284559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 0x557d19608760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.736+0000 7ff047400640 1 -- 172.21.15.37:0/1457284559 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d194f3110 con 0x557d195fc3f0 2024-08-20T05:08:29.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.736+0000 7ff03f400640 1 -- 172.21.15.37:0/1947915510 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff034010460 con 0x7ff04810a7a0 2024-08-20T05:08:29.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.739+0000 7ff047400640 1 --2- 172.21.15.37:0/1457284559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d195fc3f0 0x557d195fc7d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff038005e00 tx=0x7ff038030430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=882a58b807a62467 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:29.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.739+0000 7ff033400640 1 -- 172.21.15.37:0/1457284559 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038004050 con 0x557d195fc3f0 2024-08-20T05:08:29.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.739+0000 7ff033400640 1 -- 172.21.15.37:0/1457284559 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff038041030 con 0x557d195fc3f0 2024-08-20T05:08:29.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.739+0000 7ff033400640 1 -- 172.21.15.37:0/1457284559 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0380053e0 con 0x557d195fc3f0 2024-08-20T05:08:29.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.739+0000 7ff03f400640 1 --2- 172.21.15.37:0/1947915510 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff02c0b3c50 0x7ff02c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.739+0000 7ff03f400640 1 -- 172.21.15.37:0/1947915510 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff0340e3520 con 0x7ff04810a7a0 2024-08-20T05:08:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.740+0000 7ff046a00640 1 --2- 172.21.15.37:0/1947915510 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff02c0b3c50 0x7ff02c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.741+0000 7ff050290740 1 -- 172.21.15.37:0/1457284559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d195fc3f0 msgr2=0x557d195fc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.741+0000 7ff050290740 1 --2- 172.21.15.37:0/1457284559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d195fc3f0 0x557d195fc7d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff038005e00 tx=0x7ff038030430 comp rx=0 tx=0).stop 2024-08-20T05:08:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.743+0000 7ff050290740 1 -- 172.21.15.37:0/1457284559 shutdown_connections 2024-08-20T05:08:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.743+0000 7ff046a00640 1 --2- 172.21.15.37:0/1947915510 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff02c0b3c50 0x7ff02c0b6110 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x557d195fb100 tx=0x7ff040009b40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.743+0000 7ff050290740 1 --2- 172.21.15.37:0/1457284559 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d19608ca0 0x557d1960b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.743+0000 7ff050290740 1 --2- 172.21.15.37:0/1457284559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 0x557d19608760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.743+0000 7ff050290740 1 --2- 172.21.15.37:0/1457284559 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d195fc3f0 0x557d195fc7d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.743+0000 7ff050290740 1 -- 172.21.15.37:0/1457284559 >> 172.21.15.37:0/1457284559 conn(0x557d195fa220 msgr2=0x557d195fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.743+0000 7ff050290740 1 -- 172.21.15.37:0/1457284559 shutdown_connections 2024-08-20T05:08:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.745+0000 7ff050290740 1 -- 172.21.15.37:0/1457284559 wait complete. 2024-08-20T05:08:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.746+0000 7ff050290740 1 -- start start 2024-08-20T05:08:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.747+0000 7ff050290740 1 Processor -- start 2024-08-20T05:08:29.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.748+0000 7ff050290740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 0x557d19605ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.748+0000 7ff050290740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 0x557d196061e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.748+0000 7ff050290740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 0x557d19606720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.748+0000 7ff050290740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557d19505780 con 0x557d195fcd10 2024-08-20T05:08:29.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.748+0000 7ff050290740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557d19563d00 con 0x557d195fc3f0 2024-08-20T05:08:29.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.748+0000 7ff050290740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557d193c27a0 con 0x557d19608ca0 2024-08-20T05:08:29.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.749+0000 7ff046a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 0x557d19605ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:29.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.749+0000 7ff046a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 0x557d19605ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:49906/0 (socket says 172.21.15.37:49906) 2024-08-20T05:08:29.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.749+0000 7ff046a00640 1 -- 172.21.15.37:0/428229674 learned_addr learned my addr 172.21.15.37:0/428229674 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:29.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.749+0000 7ff046000640 1 --2- 172.21.15.37:0/428229674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 0x557d196061e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:29.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.749+0000 7ff050290740 10 client.0 _ll_register_callbacks cb 0x557d1950d940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:29.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.750+0000 7ff047400640 1 --2- 172.21.15.37:0/428229674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 0x557d19606720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.752+0000 7ff046a00640 1 -- 172.21.15.37:0/428229674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 msgr2=0x557d19606720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.752+0000 7ff046a00640 1 --2- 172.21.15.37:0/428229674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 0x557d19606720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.752+0000 7ff046a00640 1 -- 172.21.15.37:0/428229674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 msgr2=0x557d196061e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.752+0000 7ff046a00640 1 --2- 172.21.15.37:0/428229674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 0x557d196061e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.752+0000 7ff046a00640 1 -- 172.21.15.37:0/428229674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d195129c0 con 0x557d195fc3f0 2024-08-20T05:08:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.752+0000 7ff047400640 1 --2- 172.21.15.37:0/428229674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 0x557d19606720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:08:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.752+0000 7ff046a00640 1 --2- 172.21.15.37:0/428229674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 0x557d19605ca0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff040011c00 tx=0x7ff040009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba723265d4cf8fec server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.752+0000 7ff027e00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:08:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.753+0000 7ff027e00640 1 -- 172.21.15.37:0/428229674 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04001e420 con 0x557d195fc3f0 2024-08-20T05:08:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.753+0000 7ff027e00640 1 -- 172.21.15.37:0/428229674 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff04001e5c0 con 0x557d195fc3f0 2024-08-20T05:08:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.753+0000 7ff050290740 1 -- 172.21.15.37:0/428229674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff038041030 con 0x557d195fc3f0 2024-08-20T05:08:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.753+0000 7ff027e00640 1 -- 172.21.15.37:0/428229674 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ff04002f050 con 0x557d195fc3f0 2024-08-20T05:08:29.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.753+0000 7ff050290740 10 client.27149 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.753+0000 7ff050290740 1 -- 172.21.15.37:0/428229674 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x557d192ceb90 con 0x557d195fc3f0 2024-08-20T05:08:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.754+0000 7ff027e00640 1 -- 172.21.15.37:0/428229674 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff038041030 con 0x557d195fc3f0 2024-08-20T05:08:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.758+0000 7ff027e00640 1 -- 172.21.15.37:0/428229674 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7ff04001e7c0 con 0x557d195fc3f0 2024-08-20T05:08:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.758+0000 7ff050290740 10 client.27149 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.758+0000 7ff050290740 10 client.27149 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:08:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.758+0000 7ff050290740 20 client.27149 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.758+0000 7ff050290740 1 --2- 172.21.15.37:0/428229674 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557d196187e0 0x557d1961ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.758+0000 7ff050290740 4 client.27149 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:08:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.758+0000 7ff050290740 1 -- 172.21.15.37:0/428229674 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d19572710 con 0x557d196187e0 2024-08-20T05:08:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.758+0000 7ff046000640 1 --2- 172.21.15.37:0/428229674 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557d196187e0 0x557d1961ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.759+0000 7ff027e00640 10 client.27149 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:29.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.759+0000 7ff046000640 1 --2- 172.21.15.37:0/428229674 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557d196187e0 0x557d1961ac20 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acf88a7d2eb83a8 server_cookie=13bfafc6cc5bfa6f in_seq=0 out_seq=0 2024-08-20T05:08:29.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.760+0000 7ff027e00640 1 -- 172.21.15.37:0/428229674 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d19572710 con 0x557d196187e0 2024-08-20T05:08:29.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.760+0000 7ff027e00640 10 client.27149 handle_command_reply: tid=0 2024-08-20T05:08:29.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.760+0000 7ff050290740 1 client.27149 shutdown 2024-08-20T05:08:29.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.760+0000 7ff050290740 1 -- 172.21.15.37:0/428229674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 msgr2=0x557d19605ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:29.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.760+0000 7ff050290740 1 --2- 172.21.15.37:0/428229674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 0x557d19605ca0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff040011c00 tx=0x7ff040009500 comp rx=0 tx=0).stop 2024-08-20T05:08:29.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.761+0000 7ff050290740 1 -- 172.21.15.37:0/428229674 shutdown_connections 2024-08-20T05:08:29.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.761+0000 7ff050290740 1 --2- 172.21.15.37:0/428229674 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557d196187e0 0x557d1961ac20 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.761+0000 7ff050290740 1 --2- 172.21.15.37:0/428229674 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 0x557d19606720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.761+0000 7ff050290740 1 --2- 172.21.15.37:0/428229674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 0x557d196061e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.761+0000 7ff050290740 1 --2- 172.21.15.37:0/428229674 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 0x557d19605ca0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.761+0000 7ff050290740 1 -- 172.21.15.37:0/428229674 >> 172.21.15.37:0/428229674 conn(0x557d195fa220 msgr2=0x557d195ffd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:29.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.761+0000 7ff027e00640 0 client.27149 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:29.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.761+0000 7ff050290740 1 -- 172.21.15.37:0/428229674 shutdown_connections 2024-08-20T05:08:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.761+0000 7ff050290740 1 -- 172.21.15.37:0/428229674 wait complete. 2024-08-20T05:08:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.761+0000 7ff050290740 20 client.27149 trim_cache size 0 max 16384 2024-08-20T05:08:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.798+0000 7ff050290740 1 Processor -- start 2024-08-20T05:08:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.798+0000 7ff050290740 1 -- start start 2024-08-20T05:08:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.798+0000 7ff050290740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 0x557d196204f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.798+0000 7ff050290740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 0x557d19620a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.799+0000 7ff046a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 0x557d196204f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.799+0000 7ff046a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 0x557d196204f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:49920/0 (socket says 172.21.15.37:49920) 2024-08-20T05:08:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.799+0000 7ff050290740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 0x557d19602eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.799+0000 7ff050290740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481be630 con 0x557d195fcd10 2024-08-20T05:08:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.799+0000 7ff050290740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481c0170 con 0x557d195fc3f0 2024-08-20T05:08:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.799+0000 7ff050290740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481bed00 con 0x557d19608ca0 2024-08-20T05:08:29.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.799+0000 7ff046a00640 1 -- 172.21.15.37:0/2090306586 learned_addr learned my addr 172.21.15.37:0/2090306586 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:29.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.799+0000 7ff047400640 1 --2- 172.21.15.37:0/2090306586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 0x557d19602eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:29.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.800+0000 7ff047400640 1 -- 172.21.15.37:0/2090306586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 msgr2=0x557d196204f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:29.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.800+0000 7ff047400640 1 --2- 172.21.15.37:0/2090306586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 0x557d196204f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.800+0000 7ff047400640 1 -- 172.21.15.37:0/2090306586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 msgr2=0x557d19620a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:08:29.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.800+0000 7ff047400640 1 --2- 172.21.15.37:0/2090306586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 0x557d19620a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.800+0000 7ff047400640 1 -- 172.21.15.37:0/2090306586 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d1960b090 con 0x557d19608ca0 2024-08-20T05:08:29.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.801+0000 7ff046a00640 1 --2- 172.21.15.37:0/2090306586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 0x557d196204f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:29.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.802+0000 7ff047400640 1 --2- 172.21.15.37:0/2090306586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 0x557d19602eb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff03802a910 tx=0x7ff038030880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=104c3b8b3881a98c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:29.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.802+0000 7ff032a00640 1 -- 172.21.15.37:0/2090306586 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038004050 con 0x557d19608ca0 2024-08-20T05:08:29.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.803+0000 7ff032a00640 1 -- 172.21.15.37:0/2090306586 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff038041050 con 0x557d19608ca0 2024-08-20T05:08:29.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.803+0000 7ff032a00640 1 -- 172.21.15.37:0/2090306586 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038003850 con 0x557d19608ca0 2024-08-20T05:08:29.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.804+0000 7ff050290740 1 -- 172.21.15.37:0/2090306586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 msgr2=0x557d19602eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:29.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.804+0000 7ff050290740 1 --2- 172.21.15.37:0/2090306586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 0x557d19602eb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff03802a910 tx=0x7ff038030880 comp rx=0 tx=0).stop 2024-08-20T05:08:29.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.804+0000 7ff050290740 1 -- 172.21.15.37:0/2090306586 shutdown_connections 2024-08-20T05:08:29.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.804+0000 7ff050290740 1 --2- 172.21.15.37:0/2090306586 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 0x557d19602eb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.804+0000 7ff050290740 1 --2- 172.21.15.37:0/2090306586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 0x557d19620a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.804+0000 7ff050290740 1 --2- 172.21.15.37:0/2090306586 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 0x557d196204f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.804+0000 7ff050290740 1 -- 172.21.15.37:0/2090306586 >> 172.21.15.37:0/2090306586 conn(0x557d195fa220 msgr2=0x557d19607af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:29.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.804+0000 7ff050290740 1 -- 172.21.15.37:0/2090306586 shutdown_connections 2024-08-20T05:08:29.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.805+0000 7ff050290740 1 -- 172.21.15.37:0/2090306586 wait complete. 2024-08-20T05:08:29.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.805+0000 7ff050290740 1 -- start start 2024-08-20T05:08:29.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.805+0000 7ff050290740 1 Processor -- start 2024-08-20T05:08:29.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.807+0000 7ff050290740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 0x557d1960cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.807+0000 7ff050290740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 0x557d1960d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.807+0000 7ff050290740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 0x557d196824c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.808+0000 7ff046a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 0x557d1960cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:29.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.808+0000 7ff046000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 0x557d1960d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:29.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.808+0000 7ff047400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 0x557d196824c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:29.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.808+0000 7ff047400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 0x557d196824c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:48252/0 (socket says 172.21.15.37:48252) 2024-08-20T05:08:29.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.808+0000 7ff047400640 1 -- 172.21.15.37:0/288007560 learned_addr learned my addr 172.21.15.37:0/288007560 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:29.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.808+0000 7ff050290740 1 -- 172.21.15.37:0/288007560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481bfaa0 con 0x557d195fcd10 2024-08-20T05:08:29.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.808+0000 7ff050290740 1 -- 172.21.15.37:0/288007560 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481bf3d0 con 0x557d195fc3f0 2024-08-20T05:08:29.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.808+0000 7ff050290740 1 -- 172.21.15.37:0/288007560 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff0481bc610 con 0x557d19608ca0 2024-08-20T05:08:29.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.809+0000 7ff050290740 10 client.0 _ll_register_callbacks cb 0x7ff040009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:29.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.809+0000 7ff047400640 1 -- 172.21.15.37:0/288007560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 msgr2=0x557d1960cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:29.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.809+0000 7ff047400640 1 --2- 172.21.15.37:0/288007560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 0x557d1960cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.809+0000 7ff047400640 1 -- 172.21.15.37:0/288007560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 msgr2=0x557d1960d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:29.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.809+0000 7ff047400640 1 --2- 172.21.15.37:0/288007560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 0x557d1960d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:29.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.809+0000 7ff047400640 1 -- 172.21.15.37:0/288007560 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d1960da60 con 0x557d19608ca0 2024-08-20T05:08:29.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.809+0000 7ff046000640 1 --2- 172.21.15.37:0/288007560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 0x557d1960d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:08:29.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.810+0000 7ff047400640 1 --2- 172.21.15.37:0/288007560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 0x557d196824c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff038000c00 tx=0x7ff038030ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1119dc702d475b91 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:29.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.810+0000 7ff027e00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:08:29.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.810+0000 7ff027e00640 1 -- 172.21.15.37:0/288007560 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff038052670 con 0x557d19608ca0 2024-08-20T05:08:29.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.810+0000 7ff027e00640 1 -- 172.21.15.37:0/288007560 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff038052810 con 0x557d19608ca0 2024-08-20T05:08:29.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.810+0000 7ff050290740 1 -- 172.21.15.37:0/288007560 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff038041050 con 0x557d19608ca0 2024-08-20T05:08:29.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.811+0000 7ff027e00640 1 -- 172.21.15.37:0/288007560 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7ff038060050 con 0x557d19608ca0 2024-08-20T05:08:29.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.811+0000 7ff050290740 10 client.27178 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:29.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.811+0000 7ff050290740 1 -- 172.21.15.37:0/288007560 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x557d19683ac0 con 0x557d19608ca0 2024-08-20T05:08:29.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.811+0000 7ff027e00640 1 -- 172.21.15.37:0/288007560 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff038041050 con 0x557d19608ca0 2024-08-20T05:08:29.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.812+0000 7ff027e00640 1 -- 172.21.15.37:0/288007560 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7ff03805b8b0 con 0x557d19608ca0 2024-08-20T05:08:29.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.812+0000 7ff050290740 10 client.27178 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:29.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.812+0000 7ff050290740 10 client.27178 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:08:29.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.812+0000 7ff050290740 20 client.27178 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:29.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.812+0000 7ff050290740 1 --2- 172.21.15.37:0/288007560 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557d19683dd0 0x557d196861c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:29.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.812+0000 7ff050290740 4 client.27178 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-08-20T05:08:29.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.812+0000 7ff050290740 1 -- 172.21.15.37:0/288007560 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x557d1956e1b0 con 0x557d19683dd0 2024-08-20T05:08:29.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.814+0000 7ff046a00640 1 --2- 172.21.15.37:0/288007560 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557d19683dd0 0x557d196861c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:29.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.814+0000 7ff046a00640 1 --2- 172.21.15.37:0/288007560 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557d19683dd0 0x557d196861c0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a859801d7670dae7 server_cookie=ce1ea4a3431e6408 in_seq=0 out_seq=0 2024-08-20T05:08:29.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:29.814+0000 7ff027e00640 10 client.27178 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:29.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:29 smithi130 ceph-mon[22007]: pgmap v588: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 1.9 MiB/s wr, 213 op/s 2024-08-20T05:08:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.021+0000 7ff027e00640 1 -- 172.21.15.37:0/288007560 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557d1956e1b0 con 0x557d19683dd0 2024-08-20T05:08:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.021+0000 7ff027e00640 10 client.27178 handle_command_reply: tid=0 2024-08-20T05:08:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.021+0000 7ff050290740 1 client.27178 shutdown 2024-08-20T05:08:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.021+0000 7ff050290740 1 -- 172.21.15.37:0/288007560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 msgr2=0x557d196824c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.021+0000 7ff050290740 1 --2- 172.21.15.37:0/288007560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 0x557d196824c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ff038000c00 tx=0x7ff038030ed0 comp rx=0 tx=0).stop 2024-08-20T05:08:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.021+0000 7ff050290740 1 -- 172.21.15.37:0/288007560 shutdown_connections 2024-08-20T05:08:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.021+0000 7ff050290740 1 --2- 172.21.15.37:0/288007560 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557d19683dd0 0x557d196861c0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.021+0000 7ff050290740 1 --2- 172.21.15.37:0/288007560 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557d19608ca0 0x557d196824c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.021+0000 7ff050290740 1 --2- 172.21.15.37:0/288007560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557d195fcd10 0x557d1960d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.021+0000 7ff050290740 1 --2- 172.21.15.37:0/288007560 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557d195fc3f0 0x557d1960cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:30.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.021+0000 7ff050290740 1 -- 172.21.15.37:0/288007560 >> 172.21.15.37:0/288007560 conn(0x557d195fa220 msgr2=0x557d19607af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:30.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.021+0000 7ff027e00640 0 client.27178 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:30.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.021+0000 7ff050290740 1 -- 172.21.15.37:0/288007560 shutdown_connections 2024-08-20T05:08:30.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.021+0000 7ff050290740 1 -- 172.21.15.37:0/288007560 wait complete. 2024-08-20T05:08:30.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.022+0000 7ff050290740 20 client.27178 trim_cache size 0 max 16384 2024-08-20T05:08:30.025 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:08:30.025 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 36, 2024-08-20T05:08:30.025 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:08:30.025 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 30, 2024-08-20T05:08:30.025 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:08:30.026 INFO:teuthology.orchestra.run.smithi037.stdout: "1ba5c775": { 2024-08-20T05:08:30.026 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 30, 2024-08-20T05:08:30.026 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:08:30.026 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:08:30.026 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:08:30.026 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:08:30.026 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:08:30.026 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:08:30.026 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 150.0, 2024-08-20T05:08:30.026 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:08:30.026 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:08:30.026 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:08:30.027 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:08:30.027 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:08:30.027 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:08:30.027 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:08:30.027 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:08:30.027 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:08:30.027 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:08:30.027 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:08:30.027 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:08:30.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.022+0000 7ff04d600640 1 -- 172.21.15.37:0/1947915510 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff02c0b3c50 msgr2=0x7ff02c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:30.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.022+0000 7ff04d600640 1 --2- 172.21.15.37:0/1947915510 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff02c0b3c50 0x7ff02c0b6110 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x557d195fb100 tx=0x7ff040009b40 comp rx=0 tx=0).stop 2024-08-20T05:08:30.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.022+0000 7ff04d600640 1 -- 172.21.15.37:0/1947915510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff04810a7a0 msgr2=0x7ff048110900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:30.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.022+0000 7ff04d600640 1 --2- 172.21.15.37:0/1947915510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff04810a7a0 0x7ff048110900 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff03400d950 tx=0x7ff03400de10 comp rx=0 tx=0).stop 2024-08-20T05:08:30.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.023+0000 7ff04d600640 1 -- 172.21.15.37:0/1947915510 shutdown_connections 2024-08-20T05:08:30.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.023+0000 7ff04d600640 1 --2- 172.21.15.37:0/1947915510 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff02c0b3c50 0x7ff02c0b6110 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:30.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.023+0000 7ff04d600640 1 --2- 172.21.15.37:0/1947915510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff048115740 0x7ff0481ab410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:30.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.023+0000 7ff04d600640 1 --2- 172.21.15.37:0/1947915510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff04810a7a0 0x7ff048110900 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:30.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.023+0000 7ff04d600640 1 --2- 172.21.15.37:0/1947915510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff048109e80 0x7ff0481103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:30.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.023+0000 7ff04d600640 1 -- 172.21.15.37:0/1947915510 >> 172.21.15.37:0/1947915510 conn(0x7ff04806dcc0 msgr2=0x7ff048114780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:30.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.023+0000 7ff04d600640 1 -- 172.21.15.37:0/1947915510 shutdown_connections 2024-08-20T05:08:30.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:30.023+0000 7ff04d600640 1 -- 172.21.15.37:0/1947915510 wait complete. 2024-08-20T05:08:30.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:29 smithi135 ceph-mon[22342]: pgmap v588: 129 pgs: 129 active+clean; 1.1 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 1.9 MiB/s wr, 213 op/s 2024-08-20T05:08:30.909 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1ba5c775', quiesce took 6.9 seconds. Will release after: 23.1 2024-08-20T05:08:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.519+0000 7fa25e000640 1 -- 172.21.15.37:0/2825745593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa258100a80 msgr2=0x7fa258100e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.519+0000 7fa25e000640 1 --2- 172.21.15.37:0/2825745593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa258100a80 0x7fa258100e80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa248009900 tx=0x7fa24802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.519+0000 7fa25e000640 1 -- 172.21.15.37:0/2825745593 shutdown_connections 2024-08-20T05:08:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.519+0000 7fa25e000640 1 --2- 172.21.15.37:0/2825745593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa258108470 0x7fa25810a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.519+0000 7fa25e000640 1 --2- 172.21.15.37:0/2825745593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa258105b40 0x7fa258107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.519+0000 7fa25e000640 1 --2- 172.21.15.37:0/2825745593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa258100a80 0x7fa258100e80 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.519+0000 7fa25e000640 1 -- 172.21.15.37:0/2825745593 >> 172.21.15.37:0/2825745593 conn(0x7fa2580fc5e0 msgr2=0x7fa2580fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:31.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.520+0000 7fa25e000640 1 -- 172.21.15.37:0/2825745593 shutdown_connections 2024-08-20T05:08:31.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.520+0000 7fa25e000640 1 -- 172.21.15.37:0/2825745593 wait complete. 2024-08-20T05:08:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.520+0000 7fa25e000640 1 Processor -- start 2024-08-20T05:08:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.521+0000 7fa25e000640 1 -- start start 2024-08-20T05:08:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.521+0000 7fa25e000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa258100a80 0x7fa25819acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.521+0000 7fa25e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa258105b40 0x7fa25819b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.521+0000 7fa25e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa258108470 0x7fa25819bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.521+0000 7fa25e000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa25810e370 con 0x7fa258105b40 2024-08-20T05:08:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.521+0000 7fa25e000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa25810e1f0 con 0x7fa258100a80 2024-08-20T05:08:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.521+0000 7fa25e000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa25810e4f0 con 0x7fa258108470 2024-08-20T05:08:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.521+0000 7fa256a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa258105b40 0x7fa25819b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.521+0000 7fa256a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa258105b40 0x7fa25819b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47904/0 (socket says 172.21.15.37:47904) 2024-08-20T05:08:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.521+0000 7fa256a00640 1 -- 172.21.15.37:0/3363181847 learned_addr learned my addr 172.21.15.37:0/3363181847 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.521+0000 7fa257e00640 1 --2- 172.21.15.37:0/3363181847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa258108470 0x7fa25819bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.521+0000 7fa257400640 1 --2- 172.21.15.37:0/3363181847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa258100a80 0x7fa25819acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.522+0000 7fa256a00640 1 -- 172.21.15.37:0/3363181847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa258108470 msgr2=0x7fa25819bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.522+0000 7fa256a00640 1 --2- 172.21.15.37:0/3363181847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa258108470 0x7fa25819bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.522+0000 7fa256a00640 1 -- 172.21.15.37:0/3363181847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa258100a80 msgr2=0x7fa25819acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.522+0000 7fa256a00640 1 --2- 172.21.15.37:0/3363181847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa258100a80 0x7fa25819acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.522+0000 7fa256a00640 1 -- 172.21.15.37:0/3363181847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa25819c7f0 con 0x7fa258105b40 2024-08-20T05:08:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.522+0000 7fa256a00640 1 --2- 172.21.15.37:0/3363181847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa258105b40 0x7fa25819b300 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa24400ea60 tx=0x7fa24400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.522+0000 7fa24fe00640 1 -- 172.21.15.37:0/3363181847 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa24400cd20 con 0x7fa258105b40 2024-08-20T05:08:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.522+0000 7fa24fe00640 1 -- 172.21.15.37:0/3363181847 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2440035f0 con 0x7fa258105b40 2024-08-20T05:08:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.522+0000 7fa24fe00640 1 -- 172.21.15.37:0/3363181847 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa244010690 con 0x7fa258105b40 2024-08-20T05:08:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.522+0000 7fa25e000640 1 -- 172.21.15.37:0/3363181847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa25819cae0 con 0x7fa258105b40 2024-08-20T05:08:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.522+0000 7fa25e000640 1 -- 172.21.15.37:0/3363181847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2581a31b0 con 0x7fa258105b40 2024-08-20T05:08:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.525+0000 7fa261091740 1 Processor -- start 2024-08-20T05:08:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.525+0000 7fa261091740 1 -- start start 2024-08-20T05:08:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.526+0000 7fa261091740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab8897f2b0 0x55ab889816a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.526+0000 7fa261091740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88981be0 0x55ab88983fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.526+0000 7fa261091740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab88984620 0x55ab88986ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.526+0000 7fa261091740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ab888f2210 con 0x55ab8897f2b0 2024-08-20T05:08:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.526+0000 7fa261091740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ab888e1710 con 0x55ab88984620 2024-08-20T05:08:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.526+0000 7fa261091740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ab888e5750 con 0x55ab88981be0 2024-08-20T05:08:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.526+0000 7fa257e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab8897f2b0 0x55ab889816a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.526+0000 7fa257e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab8897f2b0 0x55ab889816a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47912/0 (socket says 172.21.15.37:47912) 2024-08-20T05:08:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.526+0000 7fa257e00640 1 -- 172.21.15.37:0/935307764 learned_addr learned my addr 172.21.15.37:0/935307764 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.526+0000 7fa24fe00640 1 -- 172.21.15.37:0/3363181847 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa2440037a0 con 0x7fa258105b40 2024-08-20T05:08:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.526+0000 7fa257400640 1 --2- 172.21.15.37:0/935307764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88981be0 0x55ab88983fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.526+0000 7fa256a00640 1 --2- 172.21.15.37:0/935307764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab88984620 0x55ab88986ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.527+0000 7fa257e00640 1 -- 172.21.15.37:0/935307764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88981be0 msgr2=0x55ab88983fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.527+0000 7fa257e00640 1 --2- 172.21.15.37:0/935307764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88981be0 0x55ab88983fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.527+0000 7fa257e00640 1 -- 172.21.15.37:0/935307764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab88984620 msgr2=0x55ab88986ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.527+0000 7fa257e00640 1 --2- 172.21.15.37:0/935307764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab88984620 0x55ab88986ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.527+0000 7fa257e00640 1 -- 172.21.15.37:0/935307764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab888adde0 con 0x55ab8897f2b0 2024-08-20T05:08:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.527+0000 7fa256a00640 1 --2- 172.21.15.37:0/935307764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab88984620 0x55ab88986ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:08:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.527+0000 7fa257e00640 1 --2- 172.21.15.37:0/935307764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab8897f2b0 0x55ab889816a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa250009f60 tx=0x7fa250009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13f398f76be8984 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.527+0000 7fa243e00640 1 -- 172.21.15.37:0/935307764 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25001e070 con 0x55ab8897f2b0 2024-08-20T05:08:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.527+0000 7fa243e00640 1 -- 172.21.15.37:0/935307764 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa250003c30 con 0x55ab8897f2b0 2024-08-20T05:08:31.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.527+0000 7fa243e00640 1 -- 172.21.15.37:0/935307764 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25000f900 con 0x55ab8897f2b0 2024-08-20T05:08:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.528+0000 7fa24fe00640 1 --2- 172.21.15.37:0/3363181847 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa23c0b3c50 0x7fa23c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.528+0000 7fa261091740 1 -- 172.21.15.37:0/935307764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab8897f2b0 msgr2=0x55ab889816a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.528+0000 7fa261091740 1 --2- 172.21.15.37:0/935307764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab8897f2b0 0x55ab889816a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa250009f60 tx=0x7fa250009f90 comp rx=0 tx=0).stop 2024-08-20T05:08:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.528+0000 7fa261091740 1 -- 172.21.15.37:0/935307764 shutdown_connections 2024-08-20T05:08:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.528+0000 7fa261091740 1 --2- 172.21.15.37:0/935307764 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab88984620 0x55ab88986ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.528+0000 7fa261091740 1 --2- 172.21.15.37:0/935307764 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88981be0 0x55ab88983fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.528+0000 7fa261091740 1 --2- 172.21.15.37:0/935307764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab8897f2b0 0x55ab889816a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.528+0000 7fa261091740 1 -- 172.21.15.37:0/935307764 >> 172.21.15.37:0/935307764 conn(0x55ab8897a3b0 msgr2=0x55ab8897b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.528+0000 7fa24fe00640 1 -- 172.21.15.37:0/3363181847 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa2440e42a0 con 0x7fa258105b40 2024-08-20T05:08:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.528+0000 7fa261091740 1 -- 172.21.15.37:0/935307764 shutdown_connections 2024-08-20T05:08:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.528+0000 7fa261091740 1 -- 172.21.15.37:0/935307764 wait complete. 2024-08-20T05:08:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.528+0000 7fa257400640 1 --2- 172.21.15.37:0/3363181847 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa23c0b3c50 0x7fa23c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.529+0000 7fa261091740 1 -- start start 2024-08-20T05:08:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.529+0000 7fa261091740 1 Processor -- start 2024-08-20T05:08:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.529+0000 7fa257400640 1 --2- 172.21.15.37:0/3363181847 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa23c0b3c50 0x7fa23c0b6110 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa248031500 tx=0x7fa248005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.529+0000 7fa261091740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab8897f2b0 0x55ab88988d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.529+0000 7fa261091740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88981be0 0x55ab889893d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.529+0000 7fa261091740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab88984620 0x55ab88989fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.529+0000 7fa261091740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ab8881aab0 con 0x55ab88984620 2024-08-20T05:08:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.529+0000 7fa261091740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ab88888140 con 0x55ab8897f2b0 2024-08-20T05:08:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.529+0000 7fa261091740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ab88987650 con 0x55ab88981be0 2024-08-20T05:08:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.530+0000 7fa261091740 10 client.0 _ll_register_callbacks cb 0x55ab8889b5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.530+0000 7fa257e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab88984620 0x55ab88989fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.530+0000 7fa257400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab8897f2b0 0x55ab88988d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.530+0000 7fa257e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab88984620 0x55ab88989fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47926/0 (socket says 172.21.15.37:47926) 2024-08-20T05:08:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.530+0000 7fa257e00640 1 -- 172.21.15.37:0/1841521894 learned_addr learned my addr 172.21.15.37:0/1841521894 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.530+0000 7fa256a00640 1 --2- 172.21.15.37:0/1841521894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88981be0 0x55ab889893d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.530+0000 7fa257e00640 1 -- 172.21.15.37:0/1841521894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88981be0 msgr2=0x55ab889893d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.530+0000 7fa257e00640 1 --2- 172.21.15.37:0/1841521894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88981be0 0x55ab889893d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.530+0000 7fa257e00640 1 -- 172.21.15.37:0/1841521894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab8897f2b0 msgr2=0x55ab88988d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.530+0000 7fa257e00640 1 --2- 172.21.15.37:0/1841521894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab8897f2b0 0x55ab88988d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.530+0000 7fa257e00640 1 -- 172.21.15.37:0/1841521894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab88889170 con 0x55ab88984620 2024-08-20T05:08:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.530+0000 7fa257e00640 1 --2- 172.21.15.37:0/1841521894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab88984620 0x55ab88989fa0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa25001c040 tx=0x7fa250004cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193a559224a70f61 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.531+0000 7fa240c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:08:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.531+0000 7fa240c00640 1 -- 172.21.15.37:0/1841521894 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25001e050 con 0x55ab88984620 2024-08-20T05:08:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.531+0000 7fa261091740 1 -- 172.21.15.37:0/1841521894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ab888b8a30 con 0x55ab88984620 2024-08-20T05:08:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.531+0000 7fa240c00640 1 -- 172.21.15.37:0/1841521894 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa250004460 con 0x55ab88984620 2024-08-20T05:08:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.531+0000 7fa240c00640 1 -- 172.21.15.37:0/1841521894 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa250033050 con 0x55ab88984620 2024-08-20T05:08:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.531+0000 7fa261091740 10 client.16851 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.531+0000 7fa261091740 1 -- 172.21.15.37:0/1841521894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ab88644790 con 0x55ab88984620 2024-08-20T05:08:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.531+0000 7fa240c00640 1 -- 172.21.15.37:0/1841521894 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ab888b8a30 con 0x55ab88984620 2024-08-20T05:08:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.532+0000 7fa240c00640 1 -- 172.21.15.37:0/1841521894 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fa250005040 con 0x55ab88984620 2024-08-20T05:08:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.532+0000 7fa261091740 10 client.16851 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.532+0000 7fa261091740 10 client.16851 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.532+0000 7fa261091740 20 client.16851 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.532+0000 7fa261091740 1 --2- 172.21.15.37:0/1841521894 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ab88994670 0x55ab88996a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.532+0000 7fa261091740 4 client.16851 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:08:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.532+0000 7fa261091740 1 -- 172.21.15.37:0/1841521894 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab888f4160 con 0x55ab88994670 2024-08-20T05:08:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.532+0000 7fa257400640 1 --2- 172.21.15.37:0/1841521894 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ab88994670 0x55ab88996a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.533+0000 7fa257400640 1 --2- 172.21.15.37:0/1841521894 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ab88994670 0x55ab88996a80 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5986a0d9c56eb93 server_cookie=a53c0c00fd82b1f8 in_seq=0 out_seq=0 2024-08-20T05:08:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.533+0000 7fa240c00640 10 client.16851 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.534+0000 7fa240c00640 1 -- 172.21.15.37:0/1841521894 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab888f4160 con 0x55ab88994670 2024-08-20T05:08:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.534+0000 7fa240c00640 10 client.16851 handle_command_reply: tid=0 2024-08-20T05:08:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.534+0000 7fa261091740 1 client.16851 shutdown 2024-08-20T05:08:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.534+0000 7fa261091740 1 -- 172.21.15.37:0/1841521894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab88984620 msgr2=0x55ab88989fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:31.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.534+0000 7fa261091740 1 --2- 172.21.15.37:0/1841521894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab88984620 0x55ab88989fa0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa25001c040 tx=0x7fa250004cb0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.534+0000 7fa261091740 1 -- 172.21.15.37:0/1841521894 shutdown_connections 2024-08-20T05:08:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.534+0000 7fa261091740 1 --2- 172.21.15.37:0/1841521894 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ab88994670 0x55ab88996a80 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.534+0000 7fa261091740 1 --2- 172.21.15.37:0/1841521894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab88984620 0x55ab88989fa0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.534+0000 7fa261091740 1 --2- 172.21.15.37:0/1841521894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88981be0 0x55ab889893d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.534+0000 7fa261091740 1 --2- 172.21.15.37:0/1841521894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab8897f2b0 0x55ab88988d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.534+0000 7fa240c00640 0 client.16851 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:31.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.534+0000 7fa261091740 1 -- 172.21.15.37:0/1841521894 >> 172.21.15.37:0/1841521894 conn(0x55ab8897a3b0 msgr2=0x55ab889794d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:31.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.534+0000 7fa261091740 1 -- 172.21.15.37:0/1841521894 shutdown_connections 2024-08-20T05:08:31.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.534+0000 7fa261091740 1 -- 172.21.15.37:0/1841521894 wait complete. 2024-08-20T05:08:31.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.534+0000 7fa261091740 20 client.16851 trim_cache size 0 max 16384 2024-08-20T05:08:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.550+0000 7fa261091740 1 Processor -- start 2024-08-20T05:08:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.550+0000 7fa261091740 1 -- start start 2024-08-20T05:08:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.550+0000 7fa261091740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab8897f2b0 0x55ab88996a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.550+0000 7fa261091740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88981be0 0x55ab8897b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.550+0000 7fa261091740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab88984620 0x55ab88984a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.550+0000 7fa261091740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581ad550 con 0x55ab88984620 2024-08-20T05:08:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.550+0000 7fa261091740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581af090 con 0x55ab8897f2b0 2024-08-20T05:08:31.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.550+0000 7fa261091740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581adc20 con 0x55ab88981be0 2024-08-20T05:08:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.550+0000 7fa257e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab88984620 0x55ab88984a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.550+0000 7fa257e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab88984620 0x55ab88984a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47938/0 (socket says 172.21.15.37:47938) 2024-08-20T05:08:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.550+0000 7fa257e00640 1 -- 172.21.15.37:0/74885005 learned_addr learned my addr 172.21.15.37:0/74885005 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.550+0000 7fa257400640 1 --2- 172.21.15.37:0/74885005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab8897f2b0 0x55ab88996a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.550+0000 7fa256a00640 1 --2- 172.21.15.37:0/74885005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88981be0 0x55ab8897b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.551+0000 7fa257e00640 1 -- 172.21.15.37:0/74885005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88981be0 msgr2=0x55ab8897b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.551+0000 7fa257e00640 1 --2- 172.21.15.37:0/74885005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88981be0 0x55ab8897b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.551+0000 7fa257e00640 1 -- 172.21.15.37:0/74885005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab8897f2b0 msgr2=0x55ab88996a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.551+0000 7fa257e00640 1 --2- 172.21.15.37:0/74885005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab8897f2b0 0x55ab88996a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.551+0000 7fa257e00640 1 -- 172.21.15.37:0/74885005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab886bd620 con 0x55ab88984620 2024-08-20T05:08:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.551+0000 7fa256a00640 1 --2- 172.21.15.37:0/74885005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88981be0 0x55ab8897b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:08:31.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.551+0000 7fa257e00640 1 --2- 172.21.15.37:0/74885005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab88984620 0x55ab88984a00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa250006010 tx=0x7fa250009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2bb6e5093a3d94b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.551+0000 7fa243400640 1 -- 172.21.15.37:0/74885005 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25003b070 con 0x55ab88984620 2024-08-20T05:08:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.551+0000 7fa243400640 1 -- 172.21.15.37:0/74885005 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa25002a070 con 0x55ab88984620 2024-08-20T05:08:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.551+0000 7fa243400640 1 -- 172.21.15.37:0/74885005 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa25001e070 con 0x55ab88984620 2024-08-20T05:08:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.552+0000 7fa261091740 1 -- 172.21.15.37:0/74885005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab88984620 msgr2=0x55ab88984a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.552+0000 7fa261091740 1 --2- 172.21.15.37:0/74885005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab88984620 0x55ab88984a00 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fa250006010 tx=0x7fa250009e30 comp rx=0 tx=0).stop 2024-08-20T05:08:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.552+0000 7fa261091740 1 -- 172.21.15.37:0/74885005 shutdown_connections 2024-08-20T05:08:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.552+0000 7fa261091740 1 --2- 172.21.15.37:0/74885005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab88984620 0x55ab88984a00 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.552+0000 7fa261091740 1 --2- 172.21.15.37:0/74885005 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88981be0 0x55ab8897b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.552+0000 7fa261091740 1 --2- 172.21.15.37:0/74885005 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab8897f2b0 0x55ab88996a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.552+0000 7fa261091740 1 -- 172.21.15.37:0/74885005 >> 172.21.15.37:0/74885005 conn(0x55ab8897a3b0 msgr2=0x55ab8897ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.552+0000 7fa261091740 1 -- 172.21.15.37:0/74885005 shutdown_connections 2024-08-20T05:08:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.552+0000 7fa261091740 1 -- 172.21.15.37:0/74885005 wait complete. 2024-08-20T05:08:31.556 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.552+0000 7fa261091740 1 -- start start 2024-08-20T05:08:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.552+0000 7fa261091740 1 Processor -- start 2024-08-20T05:08:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa261091740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab8897f2b0 0x55ab8898d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa261091740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab88981be0 0x55ab8898df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa261091740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88984620 0x55ab8898eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa261091740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581ae9c0 con 0x55ab8897f2b0 2024-08-20T05:08:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa261091740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581ae2f0 con 0x55ab88981be0 2024-08-20T05:08:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa261091740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2581ab530 con 0x55ab88984620 2024-08-20T05:08:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa261091740 10 client.0 _ll_register_callbacks cb 0x7fa25001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa257400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab8897f2b0 0x55ab8898d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa257400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab8897f2b0 0x55ab8898d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47940/0 (socket says 172.21.15.37:47940) 2024-08-20T05:08:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa257400640 1 -- 172.21.15.37:0/3907112488 learned_addr learned my addr 172.21.15.37:0/3907112488 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa257e00640 1 --2- 172.21.15.37:0/3907112488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88984620 0x55ab8898eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa256a00640 1 --2- 172.21.15.37:0/3907112488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab88981be0 0x55ab8898df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa257400640 1 -- 172.21.15.37:0/3907112488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88984620 msgr2=0x55ab8898eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa257400640 1 --2- 172.21.15.37:0/3907112488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88984620 0x55ab8898eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa257400640 1 -- 172.21.15.37:0/3907112488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab88981be0 msgr2=0x55ab8898df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:31.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa257400640 1 --2- 172.21.15.37:0/3907112488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab88981be0 0x55ab8898df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa257400640 1 -- 172.21.15.37:0/3907112488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab8898f320 con 0x55ab8897f2b0 2024-08-20T05:08:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.553+0000 7fa257e00640 1 --2- 172.21.15.37:0/3907112488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88984620 0x55ab8898eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:08:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.554+0000 7fa257400640 1 --2- 172.21.15.37:0/3907112488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab8897f2b0 0x55ab8898d880 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa248004650 tx=0x7fa248009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455831572cbf15e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.554+0000 7fa240c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:08:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.554+0000 7fa240c00640 1 -- 172.21.15.37:0/3907112488 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa248035040 con 0x55ab8897f2b0 2024-08-20T05:08:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.554+0000 7fa240c00640 1 -- 172.21.15.37:0/3907112488 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa248054480 con 0x55ab8897f2b0 2024-08-20T05:08:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.554+0000 7fa261091740 1 -- 172.21.15.37:0/3907112488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa25002a070 con 0x55ab8897f2b0 2024-08-20T05:08:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.554+0000 7fa240c00640 1 -- 172.21.15.37:0/3907112488 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa248065050 con 0x55ab8897f2b0 2024-08-20T05:08:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.554+0000 7fa261091740 10 client.16857 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.554+0000 7fa261091740 1 -- 172.21.15.37:0/3907112488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ab88990760 con 0x55ab8897f2b0 2024-08-20T05:08:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.554+0000 7fa240c00640 1 -- 172.21.15.37:0/3907112488 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa25002a070 con 0x55ab8897f2b0 2024-08-20T05:08:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.555+0000 7fa240c00640 1 -- 172.21.15.37:0/3907112488 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fa248044070 con 0x55ab8897f2b0 2024-08-20T05:08:31.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.555+0000 7fa261091740 10 client.16857 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.555+0000 7fa261091740 10 client.16857 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.555+0000 7fa261091740 20 client.16857 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.555+0000 7fa261091740 1 --2- 172.21.15.37:0/3907112488 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ab889ff360 0x55ab88a01750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.555+0000 7fa261091740 4 client.16857 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:08:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.555+0000 7fa261091740 1 -- 172.21.15.37:0/3907112488 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ab888efc00 con 0x55ab889ff360 2024-08-20T05:08:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.555+0000 7fa256a00640 1 --2- 172.21.15.37:0/3907112488 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ab889ff360 0x55ab88a01750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.555+0000 7fa256a00640 1 --2- 172.21.15.37:0/3907112488 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ab889ff360 0x55ab88a01750 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e0add7f5e7dfe7a server_cookie=9c66b036c1dd80df in_seq=0 out_seq=0 2024-08-20T05:08:31.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.555+0000 7fa240c00640 10 client.16857 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.567+0000 7fa240c00640 1 -- 172.21.15.37:0/3907112488 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ab888efc00 con 0x55ab889ff360 2024-08-20T05:08:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.567+0000 7fa240c00640 10 client.16857 handle_command_reply: tid=0 2024-08-20T05:08:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.567+0000 7fa261091740 1 client.16857 shutdown 2024-08-20T05:08:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.567+0000 7fa261091740 1 -- 172.21.15.37:0/3907112488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab8897f2b0 msgr2=0x55ab8898d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.567+0000 7fa261091740 1 --2- 172.21.15.37:0/3907112488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab8897f2b0 0x55ab8898d880 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa248004650 tx=0x7fa248009260 comp rx=0 tx=0).stop 2024-08-20T05:08:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.567+0000 7fa261091740 1 -- 172.21.15.37:0/3907112488 shutdown_connections 2024-08-20T05:08:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.567+0000 7fa261091740 1 --2- 172.21.15.37:0/3907112488 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ab889ff360 0x55ab88a01750 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.567+0000 7fa261091740 1 --2- 172.21.15.37:0/3907112488 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ab88984620 0x55ab8898eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.567+0000 7fa261091740 1 --2- 172.21.15.37:0/3907112488 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ab88981be0 0x55ab8898df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.567+0000 7fa261091740 1 --2- 172.21.15.37:0/3907112488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ab8897f2b0 0x55ab8898d880 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.567+0000 7fa240c00640 0 client.16857 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.567+0000 7fa261091740 1 -- 172.21.15.37:0/3907112488 >> 172.21.15.37:0/3907112488 conn(0x55ab8897a3b0 msgr2=0x55ab88978cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.567+0000 7fa261091740 1 -- 172.21.15.37:0/3907112488 shutdown_connections 2024-08-20T05:08:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.567+0000 7fa261091740 1 -- 172.21.15.37:0/3907112488 wait complete. 2024-08-20T05:08:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.568+0000 7fa261091740 20 client.16857 trim_cache size 0 max 16384 2024-08-20T05:08:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:08:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:08:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:08:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:08:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.568+0000 7fa25e000640 1 -- 172.21.15.37:0/3363181847 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa23c0b3c50 msgr2=0x7fa23c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.568+0000 7fa25e000640 1 --2- 172.21.15.37:0/3363181847 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa23c0b3c50 0x7fa23c0b6110 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa248031500 tx=0x7fa248005a20 comp rx=0 tx=0).stop 2024-08-20T05:08:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.568+0000 7fa25e000640 1 -- 172.21.15.37:0/3363181847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa258105b40 msgr2=0x7fa25819b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.568+0000 7fa25e000640 1 --2- 172.21.15.37:0/3363181847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa258105b40 0x7fa25819b300 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa24400ea60 tx=0x7fa24400ee60 comp rx=0 tx=0).stop 2024-08-20T05:08:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.568+0000 7fa25e000640 1 -- 172.21.15.37:0/3363181847 shutdown_connections 2024-08-20T05:08:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.568+0000 7fa25e000640 1 --2- 172.21.15.37:0/3363181847 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa23c0b3c50 0x7fa23c0b6110 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.568+0000 7fa25e000640 1 --2- 172.21.15.37:0/3363181847 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa258108470 0x7fa25819bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.568+0000 7fa25e000640 1 --2- 172.21.15.37:0/3363181847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa258105b40 0x7fa25819b300 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.568+0000 7fa25e000640 1 --2- 172.21.15.37:0/3363181847 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa258100a80 0x7fa25819acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.568+0000 7fa25e000640 1 -- 172.21.15.37:0/3363181847 >> 172.21.15.37:0/3363181847 conn(0x7fa2580fc5e0 msgr2=0x7fa258102140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.568+0000 7fa25e000640 1 -- 172.21.15.37:0/3363181847 shutdown_connections 2024-08-20T05:08:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:31.568+0000 7fa25e000640 1 -- 172.21.15.37:0/3363181847 wait complete. 2024-08-20T05:08:31.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:31 smithi130 ceph-mon[22007]: pgmap v589: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.4 MiB/s wr, 344 op/s 2024-08-20T05:08:32.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:31 smithi037 ceph-mon[17265]: pgmap v589: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.4 MiB/s wr, 344 op/s 2024-08-20T05:08:32.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:31 smithi135 ceph-mon[22342]: pgmap v589: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.4 MiB/s wr, 344 op/s 2024-08-20T05:08:32.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:32 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:08:33.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:32 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:08:33.044 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 335.0 s, 225.1 tps, lat 164.994 ms stddev 210.072 2024-08-20T05:08:33.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:32 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:08:33.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:33 smithi130 ceph-mon[22007]: pgmap v590: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 7.7 MiB/s wr, 415 op/s 2024-08-20T05:08:33.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T05:08:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T05:08:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T05:08:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T05:08:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:33 smithi130 ceph-mon[22007]: Adjusting osd_memory_target on smithi130 to 176.0M 2024-08-20T05:08:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:33 smithi130 ceph-mon[22007]: Unable to set osd_memory_target on smithi130 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-08-20T05:08:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-08-20T05:08:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]': finished 2024-08-20T05:08:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:08:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:08:33.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:08:34.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:33 smithi037 ceph-mon[17265]: pgmap v590: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 7.7 MiB/s wr, 415 op/s 2024-08-20T05:08:34.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T05:08:34.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T05:08:34.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T05:08:34.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T05:08:34.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:33 smithi037 ceph-mon[17265]: Adjusting osd_memory_target on smithi130 to 176.0M 2024-08-20T05:08:34.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:33 smithi037 ceph-mon[17265]: Unable to set osd_memory_target on smithi130 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-08-20T05:08:34.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-08-20T05:08:34.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]': finished 2024-08-20T05:08:34.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:08:34.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:08:34.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:08:34.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:33 smithi135 ceph-mon[22342]: pgmap v590: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 7.7 MiB/s wr, 415 op/s 2024-08-20T05:08:34.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T05:08:34.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T05:08:34.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T05:08:34.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T05:08:34.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:33 smithi135 ceph-mon[22342]: Adjusting osd_memory_target on smithi130 to 176.0M 2024-08-20T05:08:34.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:33 smithi135 ceph-mon[22342]: Unable to set osd_memory_target on smithi130 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-08-20T05:08:34.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-08-20T05:08:34.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd='[{"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"}]': finished 2024-08-20T05:08:34.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:08:34.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:08:34.117 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:08:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:35 smithi130 ceph-mon[22007]: pgmap v591: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 8.2 MiB/s wr, 410 op/s 2024-08-20T05:08:36.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:35 smithi037 ceph-mon[17265]: pgmap v591: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 8.2 MiB/s wr, 410 op/s 2024-08-20T05:08:36.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:35 smithi135 ceph-mon[22342]: pgmap v591: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 8.2 MiB/s wr, 410 op/s 2024-08-20T05:08:37.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:37 smithi130 ceph-mon[22007]: pgmap v592: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.8 MiB/s wr, 367 op/s 2024-08-20T05:08:38.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:37 smithi037 ceph-mon[17265]: pgmap v592: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.8 MiB/s wr, 367 op/s 2024-08-20T05:08:38.045 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 340.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:08:38.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:37 smithi135 ceph-mon[22342]: pgmap v592: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.8 MiB/s wr, 367 op/s 2024-08-20T05:08:39.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:39 smithi130 ceph-mon[22007]: pgmap v593: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.1 MiB/s wr, 287 op/s 2024-08-20T05:08:40.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:39 smithi037 ceph-mon[17265]: pgmap v593: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.1 MiB/s wr, 287 op/s 2024-08-20T05:08:40.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:39 smithi135 ceph-mon[22342]: pgmap v593: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.1 MiB/s wr, 287 op/s 2024-08-20T05:08:41.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:41 smithi130 ceph-mon[22007]: pgmap v594: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.6 MiB/s wr, 291 op/s 2024-08-20T05:08:42.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:41 smithi037 ceph-mon[17265]: pgmap v594: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.6 MiB/s wr, 291 op/s 2024-08-20T05:08:42.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:41 smithi135 ceph-mon[22342]: pgmap v594: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.6 MiB/s wr, 291 op/s 2024-08-20T05:08:43.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 345.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:08:43.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:43 smithi130 ceph-mon[22007]: pgmap v595: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.8 MiB/s wr, 202 op/s 2024-08-20T05:08:43.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:43 smithi037 ceph-mon[17265]: pgmap v595: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.8 MiB/s wr, 202 op/s 2024-08-20T05:08:43.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:43 smithi135 ceph-mon[22342]: pgmap v595: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.8 MiB/s wr, 202 op/s 2024-08-20T05:08:44.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.697+0000 7f8eaa400640 1 -- 172.21.15.37:0/3061460160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ea41059f0 msgr2=0x7f8ea4105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.697+0000 7f8eaa400640 1 --2- 172.21.15.37:0/3061460160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ea41059f0 0x7f8ea4105e70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009930 tx=0x7f8e8c02a440 comp rx=0 tx=0).stop 2024-08-20T05:08:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.697+0000 7f8eaa400640 1 -- 172.21.15.37:0/3061460160 shutdown_connections 2024-08-20T05:08:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.697+0000 7f8eaa400640 1 --2- 172.21.15.37:0/3061460160 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea41063b0 0x7f8ea410cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.697+0000 7f8eaa400640 1 --2- 172.21.15.37:0/3061460160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ea41059f0 0x7f8ea4105e70 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.697+0000 7f8eaa400640 1 --2- 172.21.15.37:0/3061460160 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ea41048a0 0x7f8ea4104ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.697+0000 7f8eaa400640 1 -- 172.21.15.37:0/3061460160 >> 172.21.15.37:0/3061460160 conn(0x7f8ea4100160 msgr2=0x7f8ea4102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.697+0000 7f8eaa400640 1 -- 172.21.15.37:0/3061460160 shutdown_connections 2024-08-20T05:08:44.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.697+0000 7f8eaa400640 1 -- 172.21.15.37:0/3061460160 wait complete. 2024-08-20T05:08:44.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.698+0000 7f8eaa400640 1 Processor -- start 2024-08-20T05:08:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.698+0000 7f8eaa400640 1 -- start start 2024-08-20T05:08:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.699+0000 7f8eaa400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea41048a0 0x7f8ea40776e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.699+0000 7f8eaa400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ea41059f0 0x7f8ea4077d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.699+0000 7f8eaa400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ea41063b0 0x7f8ea4078960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.699+0000 7f8eaa400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea4110540 con 0x7f8ea41063b0 2024-08-20T05:08:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.699+0000 7f8eaa400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea41103c0 con 0x7f8ea41059f0 2024-08-20T05:08:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.699+0000 7f8eaa400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea41106c0 con 0x7f8ea41048a0 2024-08-20T05:08:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.699+0000 7f8ea3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ea41063b0 0x7f8ea4078960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.699+0000 7f8ea3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea41048a0 0x7f8ea40776e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.699+0000 7f8ea3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea41048a0 0x7f8ea40776e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:37938/0 (socket says 172.21.15.37:37938) 2024-08-20T05:08:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.699+0000 7f8ea3400640 1 -- 172.21.15.37:0/2780606333 learned_addr learned my addr 172.21.15.37:0/2780606333 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:44.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.699+0000 7f8e9aa00640 1 --2- 172.21.15.37:0/2780606333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ea41059f0 0x7f8ea4077d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.699+0000 7f8ea3400640 1 -- 172.21.15.37:0/2780606333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ea41059f0 msgr2=0x7f8ea4077d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.699+0000 7f8ea3400640 1 --2- 172.21.15.37:0/2780606333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ea41059f0 0x7f8ea4077d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.699+0000 7f8ea3400640 1 -- 172.21.15.37:0/2780606333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ea41063b0 msgr2=0x7f8ea4078960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.699+0000 7f8ea3400640 1 --2- 172.21.15.37:0/2780606333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ea41063b0 0x7f8ea4078960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.699+0000 7f8ea3400640 1 -- 172.21.15.37:0/2780606333 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea4079220 con 0x7f8ea41048a0 2024-08-20T05:08:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.699+0000 7f8ea3e00640 1 --2- 172.21.15.37:0/2780606333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ea41063b0 0x7f8ea4078960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.700+0000 7f8ea3400640 1 --2- 172.21.15.37:0/2780606333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea41048a0 0x7f8ea40776e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400d950 tx=0x7f8e9400de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.700+0000 7f8ea0c00640 1 -- 172.21.15.37:0/2780606333 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e94017070 con 0x7f8ea41048a0 2024-08-20T05:08:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.700+0000 7f8eaa400640 1 -- 172.21.15.37:0/2780606333 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea4079510 con 0x7f8ea41048a0 2024-08-20T05:08:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.700+0000 7f8ea0c00640 1 -- 172.21.15.37:0/2780606333 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e94009c30 con 0x7f8ea41048a0 2024-08-20T05:08:44.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.700+0000 7f8ea0c00640 1 -- 172.21.15.37:0/2780606333 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e94020060 con 0x7f8ea41048a0 2024-08-20T05:08:44.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.700+0000 7f8eaa400640 1 -- 172.21.15.37:0/2780606333 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea4079bb0 con 0x7f8ea41048a0 2024-08-20T05:08:44.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.704+0000 7f8ead2d3740 1 Processor -- start 2024-08-20T05:08:44.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.704+0000 7f8ead2d3740 1 -- start start 2024-08-20T05:08:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.705+0000 7f8ead2d3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d837610 0x55e06d839a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.705+0000 7f8ead2d3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d839f40 0x55e06d83c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.705+0000 7f8ead2d3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 0x55e06d83ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.705+0000 7f8ead2d3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e06d7aa210 con 0x55e06d83c980 2024-08-20T05:08:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.705+0000 7f8ead2d3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e06d799710 con 0x55e06d837610 2024-08-20T05:08:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.705+0000 7f8ead2d3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e06d79d750 con 0x55e06d839f40 2024-08-20T05:08:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.705+0000 7f8e9aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 0x55e06d83ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.705+0000 7f8ea3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d837610 0x55e06d839a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.705+0000 7f8e9aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 0x55e06d83ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35220/0 (socket says 172.21.15.37:35220) 2024-08-20T05:08:44.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.705+0000 7f8e9aa00640 1 -- 172.21.15.37:0/1824344731 learned_addr learned my addr 172.21.15.37:0/1824344731 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:44.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.705+0000 7f8ea3e00640 1 -- 172.21.15.37:0/1824344731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d839f40 msgr2=0x55e06d83c330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:08:44.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.705+0000 7f8ea3e00640 1 --2- 172.21.15.37:0/1824344731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d839f40 0x55e06d83c330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.705+0000 7f8ea3e00640 1 -- 172.21.15.37:0/1824344731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 msgr2=0x55e06d83ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.705+0000 7f8ea3e00640 1 --2- 172.21.15.37:0/1824344731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 0x55e06d83ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.705+0000 7f8ea3e00640 1 -- 172.21.15.37:0/1824344731 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e06d765de0 con 0x55e06d837610 2024-08-20T05:08:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.705+0000 7f8e9aa00640 1 --2- 172.21.15.37:0/1824344731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 0x55e06d83ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.706+0000 7f8ea0c00640 1 -- 172.21.15.37:0/2780606333 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8e94010460 con 0x7f8ea41048a0 2024-08-20T05:08:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.706+0000 7f8ea3e00640 1 --2- 172.21.15.37:0/1824344731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d837610 0x55e06d839a00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c005fd0 tx=0x7f8e9c010ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4d82ed6e67855d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.706+0000 7f8e98c00640 1 -- 172.21.15.37:0/1824344731 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c004d20 con 0x55e06d837610 2024-08-20T05:08:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.706+0000 7f8e98c00640 1 -- 172.21.15.37:0/1824344731 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e9c00eae0 con 0x55e06d837610 2024-08-20T05:08:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.706+0000 7f8e98c00640 1 -- 172.21.15.37:0/1824344731 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c0055f0 con 0x55e06d837610 2024-08-20T05:08:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.707+0000 7f8ead2d3740 1 -- 172.21.15.37:0/1824344731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d837610 msgr2=0x55e06d839a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.707+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/1824344731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d837610 0x55e06d839a00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c005fd0 tx=0x7f8e9c010ae0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.707+0000 7f8ead2d3740 1 -- 172.21.15.37:0/1824344731 shutdown_connections 2024-08-20T05:08:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.707+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/1824344731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 0x55e06d83ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.707+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/1824344731 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d839f40 0x55e06d83c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.707+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/1824344731 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d837610 0x55e06d839a00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.707+0000 7f8ead2d3740 1 -- 172.21.15.37:0/1824344731 >> 172.21.15.37:0/1824344731 conn(0x55e06d832760 msgr2=0x55e06d8334f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.707+0000 7f8ead2d3740 1 -- 172.21.15.37:0/1824344731 shutdown_connections 2024-08-20T05:08:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.707+0000 7f8ead2d3740 1 -- 172.21.15.37:0/1824344731 wait complete. 2024-08-20T05:08:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.707+0000 7f8ea0c00640 1 --2- 172.21.15.37:0/2780606333 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8e880b3b60 0x7f8e880b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.707+0000 7f8ea0c00640 1 -- 172.21.15.37:0/2780606333 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8e940e3730 con 0x7f8ea41048a0 2024-08-20T05:08:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.707+0000 7f8ead2d3740 1 -- start start 2024-08-20T05:08:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.708+0000 7f8e9aa00640 1 --2- 172.21.15.37:0/2780606333 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8e880b3b60 0x7f8e880b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:44.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.708+0000 7f8ead2d3740 1 Processor -- start 2024-08-20T05:08:44.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.708+0000 7f8ead2d3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d837610 0x55e06d840d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.708+0000 7f8ead2d3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d839f40 0x55e06d8413e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.708+0000 7f8ead2d3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 0x55e06d841fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.708+0000 7f8e9aa00640 1 --2- 172.21.15.37:0/2780606333 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8e880b3b60 0x7f8e880b6020 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c02a960 tx=0x7f8e8c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.708+0000 7f8ead2d3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e06d6d2ab0 con 0x55e06d83c980 2024-08-20T05:08:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.708+0000 7f8ead2d3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e06d740140 con 0x55e06d839f40 2024-08-20T05:08:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.708+0000 7f8ead2d3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e06d83f960 con 0x55e06d837610 2024-08-20T05:08:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.708+0000 7f8ead2d3740 10 client.0 _ll_register_callbacks cb 0x55e06d7535d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.709+0000 7f8ea3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d837610 0x55e06d840d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.709+0000 7f8ea3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d837610 0x55e06d840d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:37952/0 (socket says 172.21.15.37:37952) 2024-08-20T05:08:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.709+0000 7f8ea3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 0x55e06d841fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.709+0000 7f8ea3400640 1 -- 172.21.15.37:0/3711784378 learned_addr learned my addr 172.21.15.37:0/3711784378 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.709+0000 7f8e9aa00640 1 --2- 172.21.15.37:0/3711784378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d839f40 0x55e06d8413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:44.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.709+0000 7f8ea3400640 1 -- 172.21.15.37:0/3711784378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d839f40 msgr2=0x55e06d8413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.709+0000 7f8ea3400640 1 --2- 172.21.15.37:0/3711784378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d839f40 0x55e06d8413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.709+0000 7f8ea3400640 1 -- 172.21.15.37:0/3711784378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 msgr2=0x55e06d841fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.709+0000 7f8ea3400640 1 --2- 172.21.15.37:0/3711784378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 0x55e06d841fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.709+0000 7f8ea3400640 1 -- 172.21.15.37:0/3711784378 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e06d741170 con 0x55e06d837610 2024-08-20T05:08:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.709+0000 7f8ea3e00640 1 --2- 172.21.15.37:0/3711784378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 0x55e06d841fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.709+0000 7f8ea3400640 1 --2- 172.21.15.37:0/3711784378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d837610 0x55e06d840d40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8e940a6410 tx=0x7f8e94009ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=228f28c83f40c88f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.709+0000 7f8e91600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:08:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.709+0000 7f8e91600640 1 -- 172.21.15.37:0/3711784378 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e940ae8e0 con 0x55e06d837610 2024-08-20T05:08:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.710+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3711784378 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e9c00eae0 con 0x55e06d837610 2024-08-20T05:08:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.710+0000 7f8e91600640 1 -- 172.21.15.37:0/3711784378 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8e940a95f0 con 0x55e06d837610 2024-08-20T05:08:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.710+0000 7f8e91600640 1 -- 172.21.15.37:0/3711784378 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8e940b3390 con 0x55e06d837610 2024-08-20T05:08:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.710+0000 7f8ead2d3740 10 client.27205 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.710+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3711784378 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e06d4fc790 con 0x55e06d837610 2024-08-20T05:08:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.710+0000 7f8e91600640 1 -- 172.21.15.37:0/3711784378 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e9c00eae0 con 0x55e06d837610 2024-08-20T05:08:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.710+0000 7f8e91600640 1 -- 172.21.15.37:0/3711784378 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f8e94023060 con 0x55e06d837610 2024-08-20T05:08:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.710+0000 7f8ead2d3740 10 client.27205 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.710+0000 7f8ead2d3740 10 client.27205 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.710+0000 7f8ead2d3740 20 client.27205 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.710+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/3711784378 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e06d84c950 0x55e06d84ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.710+0000 7f8ead2d3740 4 client.27205 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:08:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.710+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3711784378 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e06d7ac160 con 0x55e06d84c950 2024-08-20T05:08:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.711+0000 7f8e9aa00640 1 --2- 172.21.15.37:0/3711784378 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e06d84c950 0x55e06d84ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.711+0000 7f8e9aa00640 1 --2- 172.21.15.37:0/3711784378 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e06d84c950 0x55e06d84ed40 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ee974958624e722 server_cookie=7171a1c2f0a147fa in_seq=0 out_seq=0 2024-08-20T05:08:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.711+0000 7f8e91600640 10 client.27205 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.712+0000 7f8e91600640 1 -- 172.21.15.37:0/3711784378 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e06d7ac160 con 0x55e06d84c950 2024-08-20T05:08:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.712+0000 7f8e91600640 10 client.27205 handle_command_reply: tid=0 2024-08-20T05:08:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.712+0000 7f8ead2d3740 1 client.27205 shutdown 2024-08-20T05:08:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.713+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3711784378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d837610 msgr2=0x55e06d840d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.713+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/3711784378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d837610 0x55e06d840d40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8e940a6410 tx=0x7f8e94009ea0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.713+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3711784378 shutdown_connections 2024-08-20T05:08:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.713+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/3711784378 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e06d84c950 0x55e06d84ed40 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.713+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/3711784378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 0x55e06d841fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.713+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/3711784378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d839f40 0x55e06d8413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.713+0000 7f8e91600640 0 client.27205 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.713+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/3711784378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d837610 0x55e06d840d40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.713+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3711784378 >> 172.21.15.37:0/3711784378 conn(0x55e06d832760 msgr2=0x55e06d831760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.713+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3711784378 shutdown_connections 2024-08-20T05:08:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.713+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3711784378 wait complete. 2024-08-20T05:08:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.713+0000 7f8ead2d3740 20 client.27205 trim_cache size 0 max 16384 2024-08-20T05:08:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.728+0000 7f8ead2d3740 1 Processor -- start 2024-08-20T05:08:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.728+0000 7f8ead2d3740 1 -- start start 2024-08-20T05:08:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.728+0000 7f8ead2d3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d837610 0x55e06d830f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.729+0000 7f8ead2d3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d839f40 0x55e06d831480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.729+0000 7f8ead2d3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d83c980 0x55e06d8319c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.729+0000 7f8ead2d3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea41b19a0 con 0x55e06d839f40 2024-08-20T05:08:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.729+0000 7f8ead2d3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea41b34e0 con 0x55e06d837610 2024-08-20T05:08:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.729+0000 7f8ead2d3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea41b2070 con 0x55e06d83c980 2024-08-20T05:08:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.729+0000 7f8e9aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d839f40 0x55e06d831480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.729+0000 7f8e9aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d839f40 0x55e06d831480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35242/0 (socket says 172.21.15.37:35242) 2024-08-20T05:08:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.729+0000 7f8e9aa00640 1 -- 172.21.15.37:0/3367133558 learned_addr learned my addr 172.21.15.37:0/3367133558 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.729+0000 7f8ea3400640 1 --2- 172.21.15.37:0/3367133558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d837610 0x55e06d830f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.729+0000 7f8ea3e00640 1 --2- 172.21.15.37:0/3367133558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d83c980 0x55e06d8319c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.729+0000 7f8e9aa00640 1 -- 172.21.15.37:0/3367133558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d83c980 msgr2=0x55e06d8319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.729+0000 7f8e9aa00640 1 --2- 172.21.15.37:0/3367133558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d83c980 0x55e06d8319c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.729+0000 7f8e9aa00640 1 -- 172.21.15.37:0/3367133558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d837610 msgr2=0x55e06d830f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.729+0000 7f8e9aa00640 1 --2- 172.21.15.37:0/3367133558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d837610 0x55e06d830f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.729+0000 7f8e9aa00640 1 -- 172.21.15.37:0/3367133558 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e06d84f0b0 con 0x55e06d839f40 2024-08-20T05:08:44.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.729+0000 7f8ea3400640 1 --2- 172.21.15.37:0/3367133558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d837610 0x55e06d830f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:08:44.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.729+0000 7f8e9aa00640 1 --2- 172.21.15.37:0/3367133558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d839f40 0x55e06d831480 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c005ab0 tx=0x7f8e8c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f77d33209b75d09 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:44.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.730+0000 7f8e93e00640 1 -- 172.21.15.37:0/3367133558 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c035040 con 0x55e06d839f40 2024-08-20T05:08:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.730+0000 7f8e93e00640 1 -- 172.21.15.37:0/3367133558 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e8c058030 con 0x55e06d839f40 2024-08-20T05:08:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.730+0000 7f8e93e00640 1 -- 172.21.15.37:0/3367133558 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c03d9d0 con 0x55e06d839f40 2024-08-20T05:08:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.730+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3367133558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d839f40 msgr2=0x55e06d831480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.730+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/3367133558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d839f40 0x55e06d831480 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c005ab0 tx=0x7f8e8c040000 comp rx=0 tx=0).stop 2024-08-20T05:08:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.730+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3367133558 shutdown_connections 2024-08-20T05:08:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.730+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/3367133558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d83c980 0x55e06d8319c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.730+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/3367133558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d839f40 0x55e06d831480 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.730+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/3367133558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d837610 0x55e06d830f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.730+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3367133558 >> 172.21.15.37:0/3367133558 conn(0x55e06d832760 msgr2=0x55e06d83cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.730+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3367133558 shutdown_connections 2024-08-20T05:08:44.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.731+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3367133558 wait complete. 2024-08-20T05:08:44.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.731+0000 7f8ead2d3740 1 -- start start 2024-08-20T05:08:44.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.731+0000 7f8ead2d3740 1 Processor -- start 2024-08-20T05:08:44.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.731+0000 7f8ead2d3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d837610 0x55e06d8460d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.731+0000 7f8ead2d3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d839f40 0x55e06d846770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.731+0000 7f8ead2d3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 0x55e06d847340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.731+0000 7f8ead2d3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea41b2e10 con 0x55e06d83c980 2024-08-20T05:08:44.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.731+0000 7f8ead2d3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea41b2740 con 0x55e06d837610 2024-08-20T05:08:44.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.731+0000 7f8ead2d3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea41af980 con 0x55e06d839f40 2024-08-20T05:08:44.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.731+0000 7f8ead2d3740 10 client.0 _ll_register_callbacks cb 0x7f8e9400df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:44.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.732+0000 7f8ea3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 0x55e06d847340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:44.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.732+0000 7f8ea3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 0x55e06d847340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35250/0 (socket says 172.21.15.37:35250) 2024-08-20T05:08:44.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.732+0000 7f8ea3e00640 1 -- 172.21.15.37:0/3649611180 learned_addr learned my addr 172.21.15.37:0/3649611180 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:44.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.732+0000 7f8e9aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d839f40 0x55e06d846770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:44.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.732+0000 7f8ea3400640 1 --2- 172.21.15.37:0/3649611180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d837610 0x55e06d8460d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:44.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.732+0000 7f8ea3e00640 1 -- 172.21.15.37:0/3649611180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d839f40 msgr2=0x55e06d846770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:44.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.732+0000 7f8ea3e00640 1 --2- 172.21.15.37:0/3649611180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d839f40 0x55e06d846770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.732+0000 7f8ea3e00640 1 -- 172.21.15.37:0/3649611180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d837610 msgr2=0x55e06d8460d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:44.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.732+0000 7f8ea3e00640 1 --2- 172.21.15.37:0/3649611180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d837610 0x55e06d8460d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.732+0000 7f8ea3e00640 1 -- 172.21.15.37:0/3649611180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e06d575620 con 0x55e06d83c980 2024-08-20T05:08:44.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.732+0000 7f8ea3e00640 1 --2- 172.21.15.37:0/3649611180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 0x55e06d847340 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c010660 tx=0x7f8e9c00e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335a88b6ac21a03a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:44.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.732+0000 7f8e91600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:08:44.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.733+0000 7f8e91600640 1 -- 172.21.15.37:0/3649611180 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c005240 con 0x55e06d83c980 2024-08-20T05:08:44.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.733+0000 7f8e91600640 1 -- 172.21.15.37:0/3649611180 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8e9c0053e0 con 0x55e06d83c980 2024-08-20T05:08:44.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.733+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3649611180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e8c058030 con 0x55e06d83c980 2024-08-20T05:08:44.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.733+0000 7f8e91600640 1 -- 172.21.15.37:0/3649611180 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8e9c034050 con 0x55e06d83c980 2024-08-20T05:08:44.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.733+0000 7f8ead2d3740 10 client.16875 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:44.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.733+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3649611180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e06d848e00 con 0x55e06d83c980 2024-08-20T05:08:44.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.733+0000 7f8e91600640 1 -- 172.21.15.37:0/3649611180 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e8c058030 con 0x55e06d83c980 2024-08-20T05:08:44.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.733+0000 7f8e91600640 1 -- 172.21.15.37:0/3649611180 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f8e9c02f030 con 0x55e06d83c980 2024-08-20T05:08:44.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.733+0000 7f8ead2d3740 10 client.16875 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:44.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.733+0000 7f8ead2d3740 10 client.16875 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:44.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.733+0000 7f8ead2d3740 20 client.16875 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:44.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.733+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/3649611180 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e06d8b77b0 0x55e06d8b9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:44.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.733+0000 7f8ead2d3740 4 client.16875 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:08:44.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.733+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3649611180 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e06d7a7c00 con 0x55e06d8b77b0 2024-08-20T05:08:44.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.734+0000 7f8ea3400640 1 --2- 172.21.15.37:0/3649611180 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e06d8b77b0 0x55e06d8b9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:44.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.734+0000 7f8ea3400640 1 --2- 172.21.15.37:0/3649611180 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e06d8b77b0 0x55e06d8b9bd0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0da31b4a6857474 server_cookie=cbe9555dd82528d3 in_seq=0 out_seq=0 2024-08-20T05:08:44.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.734+0000 7f8e91600640 10 client.16875 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:44.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.744+0000 7f8e91600640 1 -- 172.21.15.37:0/3649611180 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e06d7a7c00 con 0x55e06d8b77b0 2024-08-20T05:08:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.744+0000 7f8e91600640 10 client.16875 handle_command_reply: tid=0 2024-08-20T05:08:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.744+0000 7f8ead2d3740 1 client.16875 shutdown 2024-08-20T05:08:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.744+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3649611180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 msgr2=0x55e06d847340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.744+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/3649611180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 0x55e06d847340 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c010660 tx=0x7f8e9c00e860 comp rx=0 tx=0).stop 2024-08-20T05:08:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.744+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3649611180 shutdown_connections 2024-08-20T05:08:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.744+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/3649611180 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e06d8b77b0 0x55e06d8b9bd0 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.744+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/3649611180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e06d83c980 0x55e06d847340 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.744+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/3649611180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e06d839f40 0x55e06d846770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.744+0000 7f8ead2d3740 1 --2- 172.21.15.37:0/3649611180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e06d837610 0x55e06d8460d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.744+0000 7f8e91600640 0 client.16875 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.744+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3649611180 >> 172.21.15.37:0/3649611180 conn(0x55e06d832760 msgr2=0x55e06d830f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:44.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.744+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3649611180 shutdown_connections 2024-08-20T05:08:44.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.744+0000 7f8ead2d3740 1 -- 172.21.15.37:0/3649611180 wait complete. 2024-08-20T05:08:44.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.745+0000 7f8ead2d3740 20 client.16875 trim_cache size 0 max 16384 2024-08-20T05:08:44.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:08:44.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:08:44.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:08:44.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:08:44.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.745+0000 7f8eaa400640 1 -- 172.21.15.37:0/2780606333 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8e880b3b60 msgr2=0x7f8e880b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:44.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.745+0000 7f8eaa400640 1 --2- 172.21.15.37:0/2780606333 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8e880b3b60 0x7f8e880b6020 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c02a960 tx=0x7f8e8c005a20 comp rx=0 tx=0).stop 2024-08-20T05:08:44.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.745+0000 7f8eaa400640 1 -- 172.21.15.37:0/2780606333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea41048a0 msgr2=0x7f8ea40776e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:44.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.745+0000 7f8eaa400640 1 --2- 172.21.15.37:0/2780606333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea41048a0 0x7f8ea40776e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400d950 tx=0x7f8e9400de10 comp rx=0 tx=0).stop 2024-08-20T05:08:44.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.745+0000 7f8eaa400640 1 -- 172.21.15.37:0/2780606333 shutdown_connections 2024-08-20T05:08:44.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.745+0000 7f8eaa400640 1 --2- 172.21.15.37:0/2780606333 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8e880b3b60 0x7f8e880b6020 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.745+0000 7f8eaa400640 1 --2- 172.21.15.37:0/2780606333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ea41063b0 0x7f8ea4078960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.745+0000 7f8eaa400640 1 --2- 172.21.15.37:0/2780606333 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8ea41059f0 0x7f8ea4077d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.745+0000 7f8eaa400640 1 --2- 172.21.15.37:0/2780606333 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8ea41048a0 0x7f8ea40776e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:44.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.745+0000 7f8eaa400640 1 -- 172.21.15.37:0/2780606333 >> 172.21.15.37:0/2780606333 conn(0x7f8ea4100160 msgr2=0x7f8ea4106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:44.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.745+0000 7f8eaa400640 1 -- 172.21.15.37:0/2780606333 shutdown_connections 2024-08-20T05:08:44.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:44.746+0000 7f8eaa400640 1 -- 172.21.15.37:0/2780606333 wait complete. 2024-08-20T05:08:45.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:45 smithi135 ceph-mon[22342]: pgmap v596: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.6 MiB/s wr, 174 op/s 2024-08-20T05:08:45.656 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:45 smithi037 ceph-mon[17265]: pgmap v596: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.6 MiB/s wr, 174 op/s 2024-08-20T05:08:45.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:45 smithi130 ceph-mon[22007]: pgmap v596: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.6 MiB/s wr, 174 op/s 2024-08-20T05:08:47.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:47 smithi135 ceph-mon[22342]: pgmap v597: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.1 MiB/s wr, 154 op/s 2024-08-20T05:08:47.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:47 smithi130 ceph-mon[22007]: pgmap v597: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.1 MiB/s wr, 154 op/s 2024-08-20T05:08:47.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:47 smithi037 ceph-mon[17265]: pgmap v597: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.1 MiB/s wr, 154 op/s 2024-08-20T05:08:48.043 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:08:49.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:49 smithi135 ceph-mon[22342]: pgmap v598: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.1 MiB/s wr, 149 op/s 2024-08-20T05:08:49.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:49 smithi130 ceph-mon[22007]: pgmap v598: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.1 MiB/s wr, 149 op/s 2024-08-20T05:08:49.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:49 smithi037 ceph-mon[17265]: pgmap v598: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.1 MiB/s wr, 149 op/s 2024-08-20T05:08:51.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:51 smithi135 ceph-mon[22342]: pgmap v599: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.1 MiB/s wr, 153 op/s 2024-08-20T05:08:51.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:51 smithi130 ceph-mon[22007]: pgmap v599: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.1 MiB/s wr, 153 op/s 2024-08-20T05:08:51.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:51 smithi037 ceph-mon[17265]: pgmap v599: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.1 MiB/s wr, 153 op/s 2024-08-20T05:08:53.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:08:53.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:53 smithi135 ceph-mon[22342]: pgmap v600: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.9 MiB/s wr, 99 op/s 2024-08-20T05:08:53.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:53 smithi130 ceph-mon[22007]: pgmap v600: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.9 MiB/s wr, 99 op/s 2024-08-20T05:08:53.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:53 smithi037 ceph-mon[17265]: pgmap v600: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.9 MiB/s wr, 99 op/s 2024-08-20T05:08:54.010 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:08:54.411 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:08:54.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.997+0000 7fe95ee00640 1 -- 172.21.15.37:0/1315143378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95810a510 msgr2=0x7fe95810a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:54.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.997+0000 7fe95ee00640 1 --2- 172.21.15.37:0/1315143378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95810a510 0x7fe95810a950 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe944009900 tx=0x7fe94402a410 comp rx=0 tx=0).stop 2024-08-20T05:08:54.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.997+0000 7fe95ee00640 1 -- 172.21.15.37:0/1315143378 shutdown_connections 2024-08-20T05:08:54.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.997+0000 7fe95ee00640 1 --2- 172.21.15.37:0/1315143378 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe95810ae90 0x7fe958111690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:54.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.997+0000 7fe95ee00640 1 --2- 172.21.15.37:0/1315143378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95810a510 0x7fe95810a950 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:54.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.997+0000 7fe95ee00640 1 --2- 172.21.15.37:0/1315143378 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe958104b00 0x7fe958104ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:54.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.997+0000 7fe95ee00640 1 -- 172.21.15.37:0/1315143378 >> 172.21.15.37:0/1315143378 conn(0x7fe958100550 msgr2=0x7fe958102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:54.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.997+0000 7fe95ee00640 1 -- 172.21.15.37:0/1315143378 shutdown_connections 2024-08-20T05:08:54.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.997+0000 7fe95ee00640 1 -- 172.21.15.37:0/1315143378 wait complete. 2024-08-20T05:08:54.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.998+0000 7fe95ee00640 1 Processor -- start 2024-08-20T05:08:54.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.998+0000 7fe95ee00640 1 -- start start 2024-08-20T05:08:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.998+0000 7fe95ee00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe958104b00 0x7fe95819af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.998+0000 7fe95ee00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe95810a510 0x7fe95819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.998+0000 7fe95ee00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95810ae90 0x7fe9581a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.998+0000 7fe95ee00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe958114b10 con 0x7fe95810ae90 2024-08-20T05:08:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.998+0000 7fe95ee00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe958114990 con 0x7fe95810a510 2024-08-20T05:08:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.998+0000 7fe95ee00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe958114c90 con 0x7fe958104b00 2024-08-20T05:08:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.998+0000 7fe95da00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe958104b00 0x7fe95819af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.999+0000 7fe95da00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe958104b00 0x7fe95819af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50094/0 (socket says 172.21.15.37:50094) 2024-08-20T05:08:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.999+0000 7fe95d000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe95810a510 0x7fe95819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:55.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.999+0000 7fe95da00640 1 -- 172.21.15.37:0/1802226018 learned_addr learned my addr 172.21.15.37:0/1802226018 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.999+0000 7fe95e400640 1 --2- 172.21.15.37:0/1802226018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95810ae90 0x7fe9581a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.999+0000 7fe95d000640 1 -- 172.21.15.37:0/1802226018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe958104b00 msgr2=0x7fe95819af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.999+0000 7fe95d000640 1 --2- 172.21.15.37:0/1802226018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe958104b00 0x7fe95819af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.999+0000 7fe95d000640 1 -- 172.21.15.37:0/1802226018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95810ae90 msgr2=0x7fe9581a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.999+0000 7fe95d000640 1 --2- 172.21.15.37:0/1802226018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95810ae90 0x7fe9581a0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.999+0000 7fe95d000640 1 -- 172.21.15.37:0/1802226018 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9581a0fd0 con 0x7fe95810a510 2024-08-20T05:08:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.999+0000 7fe95da00640 1 --2- 172.21.15.37:0/1802226018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe958104b00 0x7fe95819af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.999+0000 7fe95e400640 1 --2- 172.21.15.37:0/1802226018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95810ae90 0x7fe9581a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:54.999+0000 7fe95d000640 1 --2- 172.21.15.37:0/1802226018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe95810a510 0x7fe95819b460 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe94402a930 tx=0x7fe944031a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.000+0000 7fe956000640 1 -- 172.21.15.37:0/1802226018 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94403f030 con 0x7fe95810a510 2024-08-20T05:08:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.000+0000 7fe95ee00640 1 -- 172.21.15.37:0/1802226018 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9581a1260 con 0x7fe95810a510 2024-08-20T05:08:55.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.000+0000 7fe956000640 1 -- 172.21.15.37:0/1802226018 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe944004490 con 0x7fe95810a510 2024-08-20T05:08:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.000+0000 7fe956000640 1 -- 172.21.15.37:0/1802226018 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe944035070 con 0x7fe95810a510 2024-08-20T05:08:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.000+0000 7fe95ee00640 1 -- 172.21.15.37:0/1802226018 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9581a7980 con 0x7fe95810a510 2024-08-20T05:08:55.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.001+0000 7fe95ee00640 1 -- 172.21.15.37:0/1802226018 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe958104ee0 con 0x7fe95810a510 2024-08-20T05:08:55.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.003+0000 7fe956000640 1 -- 172.21.15.37:0/1802226018 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe944042030 con 0x7fe95810a510 2024-08-20T05:08:55.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.006+0000 7fe956000640 1 --2- 172.21.15.37:0/1802226018 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9400b3cf0 0x7fe9400b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:55.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.006+0000 7fe956000640 1 -- 172.21.15.37:0/1802226018 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe944104400 con 0x7fe95810a510 2024-08-20T05:08:55.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.006+0000 7fe95da00640 1 --2- 172.21.15.37:0/1802226018 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9400b3cf0 0x7fe9400b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:55.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.007+0000 7fe95da00640 1 --2- 172.21.15.37:0/1802226018 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9400b3cf0 0x7fe9400b61b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe94c011550 tx=0x7fe94c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:55.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.007+0000 7fe956000640 1 -- 172.21.15.37:0/1802226018 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fe9440cb000 con 0x7fe95810a510 2024-08-20T05:08:55.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.242+0000 7fe95ee00640 1 -- 172.21.15.37:0/1802226018 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe95819c050 con 0x7fe95810a510 2024-08-20T05:08:55.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.243+0000 7fe956000640 1 -- 172.21.15.37:0/1802226018 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11980 (secure 0 0 0) 0x7fe9440cf550 con 0x7fe95810a510 2024-08-20T05:08:55.247 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:08:55.247 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"btime":"2024-08-20T05:06:06:678364+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:06:06.276613+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:08:55.247 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 36 2024-08-20T05:08:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.246+0000 7fe95ee00640 1 -- 172.21.15.37:0/1802226018 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9400b3cf0 msgr2=0x7fe9400b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.246+0000 7fe95ee00640 1 --2- 172.21.15.37:0/1802226018 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9400b3cf0 0x7fe9400b61b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe94c011550 tx=0x7fe94c005f90 comp rx=0 tx=0).stop 2024-08-20T05:08:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.246+0000 7fe95ee00640 1 -- 172.21.15.37:0/1802226018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe95810a510 msgr2=0x7fe95819b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.246+0000 7fe95ee00640 1 --2- 172.21.15.37:0/1802226018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe95810a510 0x7fe95819b460 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe94402a930 tx=0x7fe944031a20 comp rx=0 tx=0).stop 2024-08-20T05:08:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.246+0000 7fe95ee00640 1 -- 172.21.15.37:0/1802226018 shutdown_connections 2024-08-20T05:08:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.246+0000 7fe95ee00640 1 --2- 172.21.15.37:0/1802226018 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9400b3cf0 0x7fe9400b61b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.246+0000 7fe95ee00640 1 --2- 172.21.15.37:0/1802226018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95810ae90 0x7fe9581a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.246+0000 7fe95ee00640 1 --2- 172.21.15.37:0/1802226018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe95810a510 0x7fe95819b460 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.246+0000 7fe95ee00640 1 --2- 172.21.15.37:0/1802226018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe958104b00 0x7fe95819af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.246+0000 7fe95ee00640 1 -- 172.21.15.37:0/1802226018 >> 172.21.15.37:0/1802226018 conn(0x7fe958100550 msgr2=0x7fe958102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.246+0000 7fe95ee00640 1 -- 172.21.15.37:0/1802226018 shutdown_connections 2024-08-20T05:08:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:55.246+0000 7fe95ee00640 1 -- 172.21.15.37:0/1802226018 wait complete. 2024-08-20T05:08:55.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:55 smithi037 ceph-mon[17265]: pgmap v601: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1017 KiB/s wr, 59 op/s 2024-08-20T05:08:55.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:55 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1802226018' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:08:55.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:55 smithi135 ceph-mon[22342]: pgmap v601: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1017 KiB/s wr, 59 op/s 2024-08-20T05:08:55.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:55 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1802226018' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:08:55.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:55 smithi130 ceph-mon[22007]: pgmap v601: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1017 KiB/s wr, 59 op/s 2024-08-20T05:08:55.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:55 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1802226018' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:08:55.971 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:08:56.318 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id 1ba5c775 --release --await' 2024-08-20T05:08:56.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id 1ba5c775 --release --await 2024-08-20T05:08:56.419 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:08:57.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.022+0000 7fc2c4400640 1 -- 172.21.15.37:0/4156988414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2bc075b90 msgr2=0x7fc2bc1132d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.022+0000 7fc2c4400640 1 --2- 172.21.15.37:0/4156988414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2bc075b90 0x7fc2bc1132d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009900 tx=0x7fc2a802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.022+0000 7fc2c4400640 1 -- 172.21.15.37:0/4156988414 shutdown_connections 2024-08-20T05:08:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.022+0000 7fc2c4400640 1 --2- 172.21.15.37:0/4156988414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2bc113810 0x7fc2bc115c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.022+0000 7fc2c4400640 1 --2- 172.21.15.37:0/4156988414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2bc075b90 0x7fc2bc1132d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.022+0000 7fc2c4400640 1 --2- 172.21.15.37:0/4156988414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2bc075270 0x7fc2bc075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.022+0000 7fc2c4400640 1 -- 172.21.15.37:0/4156988414 >> 172.21.15.37:0/4156988414 conn(0x7fc2bc0fe500 msgr2=0x7fc2bc100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.022+0000 7fc2c4400640 1 -- 172.21.15.37:0/4156988414 shutdown_connections 2024-08-20T05:08:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.022+0000 7fc2c4400640 1 -- 172.21.15.37:0/4156988414 wait complete. 2024-08-20T05:08:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.023+0000 7fc2c4400640 1 Processor -- start 2024-08-20T05:08:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.023+0000 7fc2c4400640 1 -- start start 2024-08-20T05:08:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.024+0000 7fc2c4400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2bc075270 0x7fc2bc19f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.024+0000 7fc2c4400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2bc075b90 0x7fc2bc19fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.024+0000 7fc2c4400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2bc113810 0x7fc2bc1a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.024+0000 7fc2c4400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc1190f0 con 0x7fc2bc075270 2024-08-20T05:08:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.024+0000 7fc2c4400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc118f70 con 0x7fc2bc113810 2024-08-20T05:08:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.024+0000 7fc2c4400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc119270 con 0x7fc2bc075b90 2024-08-20T05:08:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.024+0000 7fc2c1a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2bc075270 0x7fc2bc19f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.024+0000 7fc2c1a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2bc075270 0x7fc2bc19f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42496/0 (socket says 172.21.15.37:42496) 2024-08-20T05:08:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.024+0000 7fc2c1a00640 1 -- 172.21.15.37:0/3408937756 learned_addr learned my addr 172.21.15.37:0/3408937756 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.024+0000 7fc2c1000640 1 --2- 172.21.15.37:0/3408937756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2bc075b90 0x7fc2bc19fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.024+0000 7fc2c2400640 1 --2- 172.21.15.37:0/3408937756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2bc113810 0x7fc2bc1a4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.025+0000 7fc2c1a00640 1 -- 172.21.15.37:0/3408937756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2bc075b90 msgr2=0x7fc2bc19fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.025+0000 7fc2c1a00640 1 --2- 172.21.15.37:0/3408937756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2bc075b90 0x7fc2bc19fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.025+0000 7fc2c1a00640 1 -- 172.21.15.37:0/3408937756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2bc113810 msgr2=0x7fc2bc1a4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.025+0000 7fc2c1a00640 1 --2- 172.21.15.37:0/3408937756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2bc113810 0x7fc2bc1a4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.025+0000 7fc2c1a00640 1 -- 172.21.15.37:0/3408937756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2bc1a56b0 con 0x7fc2bc075270 2024-08-20T05:08:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.025+0000 7fc2c1000640 1 --2- 172.21.15.37:0/3408937756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2bc075b90 0x7fc2bc19fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.025+0000 7fc2c1a00640 1 --2- 172.21.15.37:0/3408937756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2bc075270 0x7fc2bc19f600 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000e9f0 tx=0x7fc2b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.025+0000 7fc2ba000640 1 -- 172.21.15.37:0/3408937756 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b000cd80 con 0x7fc2bc075270 2024-08-20T05:08:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.025+0000 7fc2c4400640 1 -- 172.21.15.37:0/3408937756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2bc1a59a0 con 0x7fc2bc075270 2024-08-20T05:08:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.025+0000 7fc2ba000640 1 -- 172.21.15.37:0/3408937756 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2b00054d0 con 0x7fc2bc075270 2024-08-20T05:08:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.025+0000 7fc2ba000640 1 -- 172.21.15.37:0/3408937756 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0010690 con 0x7fc2bc075270 2024-08-20T05:08:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.026+0000 7fc2c4400640 1 -- 172.21.15.37:0/3408937756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2bc1ac060 con 0x7fc2bc075270 2024-08-20T05:08:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.028+0000 7fc2c6fc4740 1 Processor -- start 2024-08-20T05:08:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.029+0000 7fc2c6fc4740 1 -- start start 2024-08-20T05:08:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.029+0000 7fc2c6fc4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee6900 0x558f5fee6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.029+0000 7fc2c6fc4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee7220 0x558f5fef2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.029+0000 7fc2c6fc4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 0x558f5fef55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.029+0000 7fc2ba000640 1 -- 172.21.15.37:0/3408937756 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc2b0004e70 con 0x7fc2bc075270 2024-08-20T05:08:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.029+0000 7fc2c6fc4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558f5fe5ca60 con 0x558f5fee7220 2024-08-20T05:08:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.029+0000 7fc2c6fc4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558f5fe4bf60 con 0x558f5fee6900 2024-08-20T05:08:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.029+0000 7fc2c6fc4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558f5fe4ffa0 con 0x558f5fef31b0 2024-08-20T05:08:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.029+0000 7fc2c1a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee7220 0x558f5fef2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.029+0000 7fc2c2400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee6900 0x558f5fee6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.029+0000 7fc2c2400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee6900 0x558f5fee6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:51098/0 (socket says 172.21.15.37:51098) 2024-08-20T05:08:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.029+0000 7fc2c2400640 1 -- 172.21.15.37:0/1261205018 learned_addr learned my addr 172.21.15.37:0/1261205018 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.029+0000 7fc2c1000640 1 --2- 172.21.15.37:0/1261205018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 0x558f5fef55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.030+0000 7fc2c2400640 1 -- 172.21.15.37:0/1261205018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 msgr2=0x558f5fef55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.030+0000 7fc2c2400640 1 --2- 172.21.15.37:0/1261205018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 0x558f5fef55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.030+0000 7fc2c2400640 1 -- 172.21.15.37:0/1261205018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee7220 msgr2=0x558f5fef2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:57.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.030+0000 7fc2c2400640 1 --2- 172.21.15.37:0/1261205018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee7220 0x558f5fef2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.030+0000 7fc2c2400640 1 -- 172.21.15.37:0/1261205018 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f5fdf23e0 con 0x558f5fee6900 2024-08-20T05:08:57.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.030+0000 7fc2c2400640 1 --2- 172.21.15.37:0/1261205018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee6900 0x558f5fee6ce0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009f90 tx=0x7fc2b40118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd6f21dc20766ebe server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:57.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.030+0000 7fc2aea00640 1 -- 172.21.15.37:0/1261205018 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4004d20 con 0x558f5fee6900 2024-08-20T05:08:57.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.030+0000 7fc2aea00640 1 -- 172.21.15.37:0/1261205018 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2b4004050 con 0x558f5fee6900 2024-08-20T05:08:57.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.031+0000 7fc2aea00640 1 -- 172.21.15.37:0/1261205018 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4005240 con 0x558f5fee6900 2024-08-20T05:08:57.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.031+0000 7fc2ba000640 1 --2- 172.21.15.37:0/3408937756 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc2a40b3c50 0x7fc2a40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.031+0000 7fc2ba000640 1 -- 172.21.15.37:0/3408937756 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc2b00e43b0 con 0x7fc2bc075270 2024-08-20T05:08:57.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.031+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/1261205018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee6900 msgr2=0x558f5fee6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.031+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/1261205018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee6900 0x558f5fee6ce0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009f90 tx=0x7fc2b40118d0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.031+0000 7fc2c1a00640 1 --2- 172.21.15.37:0/3408937756 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc2a40b3c50 0x7fc2a40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.031+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/1261205018 shutdown_connections 2024-08-20T05:08:57.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.031+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/1261205018 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 0x558f5fef55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.031+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/1261205018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee7220 0x558f5fef2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.031+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/1261205018 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee6900 0x558f5fee6ce0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.031+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/1261205018 >> 172.21.15.37:0/1261205018 conn(0x558f5fee4730 msgr2=0x558f5fee58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:57.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.031+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/1261205018 shutdown_connections 2024-08-20T05:08:57.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.031+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/1261205018 wait complete. 2024-08-20T05:08:57.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.032+0000 7fc2c1a00640 1 --2- 172.21.15.37:0/3408937756 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc2a40b3c50 0x7fc2a40b6110 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00aac00 tx=0x7fc2b00e7df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:57.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.032+0000 7fc2c6fc4740 1 -- start start 2024-08-20T05:08:57.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.032+0000 7fc2c6fc4740 1 Processor -- start 2024-08-20T05:08:57.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c6fc4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee6900 0x558f5fef2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c6fc4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee7220 0x558f5feefdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c6fc4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 0x558f5fef0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c6fc4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558f5fcae700 con 0x558f5fee6900 2024-08-20T05:08:57.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c6fc4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558f5fde7250 con 0x558f5fee7220 2024-08-20T05:08:57.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c6fc4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558f5fef5e30 con 0x558f5fef31b0 2024-08-20T05:08:57.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c6fc4740 10 client.0 _ll_register_callbacks cb 0x558f5fe46180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:57.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c2400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee6900 0x558f5fef2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c2400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee6900 0x558f5fef2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42524/0 (socket says 172.21.15.37:42524) 2024-08-20T05:08:57.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c2400640 1 -- 172.21.15.37:0/862017486 learned_addr learned my addr 172.21.15.37:0/862017486 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:57.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c2400640 1 --2- 172.21.15.37:0/862017486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 0x558f5fef0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c1000640 1 --2- 172.21.15.37:0/862017486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee7220 0x558f5feefdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c1000640 1 -- 172.21.15.37:0/862017486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 msgr2=0x558f5fef0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:57.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c1000640 1 --2- 172.21.15.37:0/862017486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 0x558f5fef0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c1000640 1 -- 172.21.15.37:0/862017486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee6900 msgr2=0x558f5fef2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:57.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c1000640 1 --2- 172.21.15.37:0/862017486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee6900 0x558f5fef2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c1000640 1 -- 172.21.15.37:0/862017486 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f5fbab650 con 0x558f5fee7220 2024-08-20T05:08:57.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.033+0000 7fc2c2400640 1 --2- 172.21.15.37:0/862017486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee6900 0x558f5fef2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:57.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.034+0000 7fc2c1000640 1 --2- 172.21.15.37:0/862017486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee7220 0x558f5feefdd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc2a802a9e0 tx=0x7fc2a8005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90736394cd877e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:57.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.034+0000 7fc2a3400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:08:57.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.034+0000 7fc2a3400640 1 -- 172.21.15.37:0/862017486 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a8035040 con 0x558f5fee7220 2024-08-20T05:08:57.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.034+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/862017486 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2b4004050 con 0x558f5fee7220 2024-08-20T05:08:57.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.034+0000 7fc2a3400640 1 -- 172.21.15.37:0/862017486 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc2a8004970 con 0x558f5fee7220 2024-08-20T05:08:57.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.034+0000 7fc2a3400640 1 -- 172.21.15.37:0/862017486 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc2a8004b70 con 0x558f5fee7220 2024-08-20T05:08:57.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.034+0000 7fc2c6fc4740 10 client.27206 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:57.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.034+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/862017486 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x558f5ff016a0 con 0x558f5fee7220 2024-08-20T05:08:57.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.035+0000 7fc2a3400640 1 -- 172.21.15.37:0/862017486 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2b4004050 con 0x558f5fee7220 2024-08-20T05:08:57.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.035+0000 7fc2a3400640 1 -- 172.21.15.37:0/862017486 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fc2a8044020 con 0x558f5fee7220 2024-08-20T05:08:57.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.035+0000 7fc2c6fc4740 10 client.27206 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:57.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.035+0000 7fc2c6fc4740 10 client.27206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:57.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.035+0000 7fc2c6fc4740 20 client.27206 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:57.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.035+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/862017486 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558f5ff02b60 0x558f5ff04f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.035+0000 7fc2c6fc4740 4 client.27206 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:08:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.035+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/862017486 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f5fe5e9b0 con 0x558f5ff02b60 2024-08-20T05:08:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.035+0000 7fc2c2400640 1 --2- 172.21.15.37:0/862017486 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558f5ff02b60 0x558f5ff04f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.036+0000 7fc2c2400640 1 --2- 172.21.15.37:0/862017486 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558f5ff02b60 0x558f5ff04f50 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a2096021a30bbce server_cookie=691d4a495f7cc9d0 in_seq=0 out_seq=0 2024-08-20T05:08:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.036+0000 7fc2a3400640 10 client.27206 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.036+0000 7fc2a3400640 1 -- 172.21.15.37:0/862017486 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558f5fe5e9b0 con 0x558f5ff02b60 2024-08-20T05:08:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.036+0000 7fc2a3400640 10 client.27206 handle_command_reply: tid=0 2024-08-20T05:08:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.037+0000 7fc2c6fc4740 1 client.27206 shutdown 2024-08-20T05:08:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.037+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/862017486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee7220 msgr2=0x558f5feefdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.037+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/862017486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee7220 0x558f5feefdd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc2a802a9e0 tx=0x7fc2a8005270 comp rx=0 tx=0).stop 2024-08-20T05:08:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.037+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/862017486 shutdown_connections 2024-08-20T05:08:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.037+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/862017486 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558f5ff02b60 0x558f5ff04f50 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.037+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/862017486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 0x558f5fef0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.037+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/862017486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee7220 0x558f5feefdd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.037+0000 7fc2a3400640 0 client.27206 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.037+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/862017486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee6900 0x558f5fef2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.037+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/862017486 >> 172.21.15.37:0/862017486 conn(0x558f5fee4730 msgr2=0x558f5feea2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.037+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/862017486 shutdown_connections 2024-08-20T05:08:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.037+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/862017486 wait complete. 2024-08-20T05:08:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.037+0000 7fc2c6fc4740 20 client.27206 trim_cache size 0 max 16384 2024-08-20T05:08:57.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.057+0000 7fc2c6fc4740 1 Processor -- start 2024-08-20T05:08:57.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.057+0000 7fc2c6fc4740 1 -- start start 2024-08-20T05:08:57.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.057+0000 7fc2c6fc4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee6900 0x558f5fef1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.057+0000 7fc2c6fc4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee7220 0x558f5ff0a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.057+0000 7fc2c6fc4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 0x558f5ff0ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.057+0000 7fc2c6fc4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc1b5dd0 con 0x558f5fee7220 2024-08-20T05:08:57.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.057+0000 7fc2c6fc4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc1b7910 con 0x558f5fee6900 2024-08-20T05:08:57.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.057+0000 7fc2c6fc4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc1b64a0 con 0x558f5fef31b0 2024-08-20T05:08:57.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.058+0000 7fc2c1000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee7220 0x558f5ff0a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.058+0000 7fc2c2400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee6900 0x558f5fef1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.058+0000 7fc2c1000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee7220 0x558f5ff0a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42538/0 (socket says 172.21.15.37:42538) 2024-08-20T05:08:57.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.058+0000 7fc2c1000640 1 -- 172.21.15.37:0/1006645704 learned_addr learned my addr 172.21.15.37:0/1006645704 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:57.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.058+0000 7fc2c2400640 1 --2- 172.21.15.37:0/1006645704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 0x558f5ff0ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.058+0000 7fc2c2400640 1 -- 172.21.15.37:0/1006645704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 msgr2=0x558f5ff0ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:57.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.058+0000 7fc2c2400640 1 --2- 172.21.15.37:0/1006645704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 0x558f5ff0ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.058+0000 7fc2c2400640 1 -- 172.21.15.37:0/1006645704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee7220 msgr2=0x558f5ff0a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:57.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.058+0000 7fc2c2400640 1 --2- 172.21.15.37:0/1006645704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee7220 0x558f5ff0a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.058+0000 7fc2c2400640 1 -- 172.21.15.37:0/1006645704 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f5fedfe90 con 0x558f5fee6900 2024-08-20T05:08:57.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.059+0000 7fc2c2400640 1 --2- 172.21.15.37:0/1006645704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee6900 0x558f5fef1b10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x558f5ff057c0 tx=0x7fc2b40048e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e2559ebb3d1ddec server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.059+0000 7fc2ae000640 1 -- 172.21.15.37:0/1006645704 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4003c70 con 0x558f5fee6900 2024-08-20T05:08:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.059+0000 7fc2ae000640 1 -- 172.21.15.37:0/1006645704 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2b4003e10 con 0x558f5fee6900 2024-08-20T05:08:57.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.059+0000 7fc2ae000640 1 -- 172.21.15.37:0/1006645704 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b400f970 con 0x558f5fee6900 2024-08-20T05:08:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.060+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/1006645704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee6900 msgr2=0x558f5fef1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.060+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/1006645704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee6900 0x558f5fef1b10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x558f5ff057c0 tx=0x7fc2b40048e0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.060+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/1006645704 shutdown_connections 2024-08-20T05:08:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.060+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/1006645704 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 0x558f5ff0ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.060+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/1006645704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee7220 0x558f5ff0a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.060+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/1006645704 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee6900 0x558f5fef1b10 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.060+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/1006645704 >> 172.21.15.37:0/1006645704 conn(0x558f5fee4730 msgr2=0x558f5fef1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.060+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/1006645704 shutdown_connections 2024-08-20T05:08:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.060+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/1006645704 wait complete. 2024-08-20T05:08:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.061+0000 7fc2c6fc4740 1 -- start start 2024-08-20T05:08:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.061+0000 7fc2c6fc4740 1 Processor -- start 2024-08-20T05:08:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.061+0000 7fc2c6fc4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee6900 0x558f5fef8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.061+0000 7fc2c6fc4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee7220 0x558f5fef9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.061+0000 7fc2c6fc4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 0x558f5ff64820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.061+0000 7fc2c6fc4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc1b7240 con 0x558f5fee6900 2024-08-20T05:08:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.061+0000 7fc2c6fc4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc1b6b70 con 0x558f5fee7220 2024-08-20T05:08:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.061+0000 7fc2c6fc4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc1b3db0 con 0x558f5fef31b0 2024-08-20T05:08:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.061+0000 7fc2c6fc4740 10 client.0 _ll_register_callbacks cb 0x7fc2a8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.062+0000 7fc2c2400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee6900 0x558f5fef8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.062+0000 7fc2c2400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee6900 0x558f5fef8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42542/0 (socket says 172.21.15.37:42542) 2024-08-20T05:08:57.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.062+0000 7fc2c2400640 1 -- 172.21.15.37:0/516147879 learned_addr learned my addr 172.21.15.37:0/516147879 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:57.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.062+0000 7fc2c1000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee7220 0x558f5fef9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.062+0000 7fc2c2400640 1 --2- 172.21.15.37:0/516147879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 0x558f5ff64820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.062+0000 7fc2c2400640 1 -- 172.21.15.37:0/516147879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 msgr2=0x558f5ff64820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:57.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.062+0000 7fc2c2400640 1 --2- 172.21.15.37:0/516147879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 0x558f5ff64820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.062+0000 7fc2c2400640 1 -- 172.21.15.37:0/516147879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee7220 msgr2=0x558f5fef9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:57.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.062+0000 7fc2c2400640 1 --2- 172.21.15.37:0/516147879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee7220 0x558f5fef9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.062+0000 7fc2c2400640 1 -- 172.21.15.37:0/516147879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f5ff64f60 con 0x558f5fee6900 2024-08-20T05:08:57.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.062+0000 7fc2c1000640 1 --2- 172.21.15.37:0/516147879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee7220 0x558f5fef9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:57.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.063+0000 7fc2c2400640 1 --2- 172.21.15.37:0/516147879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee6900 0x558f5fef8ac0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4004950 tx=0x7fc2b4013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36831479555ed2d6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:57.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.063+0000 7fc2a3400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:08:57.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.063+0000 7fc2a3400640 1 -- 172.21.15.37:0/516147879 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4004460 con 0x558f5fee6900 2024-08-20T05:08:57.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.063+0000 7fc2a3400640 1 -- 172.21.15.37:0/516147879 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc2b4004600 con 0x558f5fee6900 2024-08-20T05:08:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.063+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/516147879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2b4003e10 con 0x558f5fee6900 2024-08-20T05:08:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.063+0000 7fc2a3400640 1 -- 172.21.15.37:0/516147879 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc2b400f5f0 con 0x558f5fee6900 2024-08-20T05:08:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.063+0000 7fc2c6fc4740 10 client.16899 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.063+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/516147879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x558f5ff6d4c0 con 0x558f5fee6900 2024-08-20T05:08:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.064+0000 7fc2a3400640 1 -- 172.21.15.37:0/516147879 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2b4003e10 con 0x558f5fee6900 2024-08-20T05:08:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.064+0000 7fc2a3400640 1 -- 172.21.15.37:0/516147879 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7fc2b403d6b0 con 0x558f5fee6900 2024-08-20T05:08:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.064+0000 7fc2c6fc4740 10 client.16899 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.064+0000 7fc2c6fc4740 10 client.16899 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.064+0000 7fc2c6fc4740 20 client.16899 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.064+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/516147879 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558f5ff6d940 0x558f5ff6fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.064+0000 7fc2c6fc4740 4 client.16899 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:08:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.064+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/516147879 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558f5fe5a450 con 0x558f5ff6d940 2024-08-20T05:08:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.064+0000 7fc2c1000640 1 --2- 172.21.15.37:0/516147879 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558f5ff6d940 0x558f5ff6fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.065+0000 7fc2c1000640 1 --2- 172.21.15.37:0/516147879 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558f5ff6d940 0x558f5ff6fd60 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=691749094b1c6ba4 server_cookie=337fd7f5ce78073c in_seq=0 out_seq=0 2024-08-20T05:08:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.065+0000 7fc2a3400640 10 client.16899 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.065+0000 7fc2a3400640 1 -- 172.21.15.37:0/516147879 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558f5fe5a450 con 0x558f5ff6d940 2024-08-20T05:08:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.065+0000 7fc2a3400640 10 client.16899 handle_command_reply: tid=0 2024-08-20T05:08:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.065+0000 7fc2c6fc4740 1 client.16899 shutdown 2024-08-20T05:08:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.065+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/516147879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee6900 msgr2=0x558f5fef8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.065+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/516147879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee6900 0x558f5fef8ac0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4004950 tx=0x7fc2b4013040 comp rx=0 tx=0).stop 2024-08-20T05:08:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.065+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/516147879 shutdown_connections 2024-08-20T05:08:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.065+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/516147879 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558f5ff6d940 0x558f5ff6fd60 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.065+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/516147879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558f5fef31b0 0x558f5ff64820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.065+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/516147879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558f5fee7220 0x558f5fef9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.065+0000 7fc2c6fc4740 1 --2- 172.21.15.37:0/516147879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558f5fee6900 0x558f5fef8ac0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.065+0000 7fc2a3400640 0 client.16899 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.065+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/516147879 >> 172.21.15.37:0/516147879 conn(0x558f5fee4730 msgr2=0x558f5fef1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:57.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.066+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/516147879 shutdown_connections 2024-08-20T05:08:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.066+0000 7fc2c6fc4740 1 -- 172.21.15.37:0/516147879 wait complete. 2024-08-20T05:08:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.066+0000 7fc2c6fc4740 20 client.16899 trim_cache size 0 max 16384 2024-08-20T05:08:57.071 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:08:57.071 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-20T05:08:57.071 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-08-20T05:08:57.071 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:08:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.067+0000 7fc2c4400640 1 -- 172.21.15.37:0/3408937756 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc2a40b3c50 msgr2=0x7fc2a40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.067+0000 7fc2c4400640 1 --2- 172.21.15.37:0/3408937756 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc2a40b3c50 0x7fc2a40b6110 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fc2b00aac00 tx=0x7fc2b00e7df0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.067+0000 7fc2c4400640 1 -- 172.21.15.37:0/3408937756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2bc075270 msgr2=0x7fc2bc19f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.067+0000 7fc2c4400640 1 --2- 172.21.15.37:0/3408937756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2bc075270 0x7fc2bc19f600 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000e9f0 tx=0x7fc2b000edf0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.067+0000 7fc2c4400640 1 -- 172.21.15.37:0/3408937756 shutdown_connections 2024-08-20T05:08:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.067+0000 7fc2c4400640 1 --2- 172.21.15.37:0/3408937756 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc2a40b3c50 0x7fc2a40b6110 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.067+0000 7fc2c4400640 1 --2- 172.21.15.37:0/3408937756 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2bc113810 0x7fc2bc1a4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.067+0000 7fc2c4400640 1 --2- 172.21.15.37:0/3408937756 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc2bc075b90 0x7fc2bc19fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.067+0000 7fc2c4400640 1 --2- 172.21.15.37:0/3408937756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2bc075270 0x7fc2bc19f600 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.067+0000 7fc2c4400640 1 -- 172.21.15.37:0/3408937756 >> 172.21.15.37:0/3408937756 conn(0x7fc2bc0fe500 msgr2=0x7fc2bc0ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.067+0000 7fc2c4400640 1 -- 172.21.15.37:0/3408937756 shutdown_connections 2024-08-20T05:08:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:57.067+0000 7fc2c4400640 1 -- 172.21.15.37:0/3408937756 wait complete. 2024-08-20T05:08:57.598 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:57 smithi037 ceph-mon[17265]: pgmap v602: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-08-20T05:08:57.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:57 smithi135 ceph-mon[22342]: pgmap v602: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-08-20T05:08:57.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:57 smithi130 ceph-mon[22007]: pgmap v602: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-08-20T05:08:57.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.865+0000 7f5314800640 1 -- 172.21.15.37:0/2261571466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f530c1037d0 msgr2=0x7f530c103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.865+0000 7f5314800640 1 --2- 172.21.15.37:0/2261571466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f530c1037d0 0x7f530c103c50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009930 tx=0x7f52fc02a420 comp rx=0 tx=0).stop 2024-08-20T05:08:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.865+0000 7f5314800640 1 -- 172.21.15.37:0/2261571466 shutdown_connections 2024-08-20T05:08:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.865+0000 7f5314800640 1 --2- 172.21.15.37:0/2261571466 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f530c104190 0x7f530c10ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.865+0000 7f5314800640 1 --2- 172.21.15.37:0/2261571466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f530c1037d0 0x7f530c103c50 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.865+0000 7f5314800640 1 --2- 172.21.15.37:0/2261571466 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f530c102680 0x7f530c102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.865+0000 7f5314800640 1 -- 172.21.15.37:0/2261571466 >> 172.21.15.37:0/2261571466 conn(0x7f530c0fdf40 msgr2=0x7f530c100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.865+0000 7f5314800640 1 -- 172.21.15.37:0/2261571466 shutdown_connections 2024-08-20T05:08:57.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.865+0000 7f5314800640 1 -- 172.21.15.37:0/2261571466 wait complete. 2024-08-20T05:08:57.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.866+0000 7f5314800640 1 Processor -- start 2024-08-20T05:08:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.866+0000 7f5314800640 1 -- start start 2024-08-20T05:08:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.867+0000 7f5314800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f530c102680 0x7f530c19acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.867+0000 7f5314800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f530c1037d0 0x7f530c19b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.867+0000 7f5314800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f530c104190 0x7f530c19bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.867+0000 7f5314800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f530c10e320 con 0x7f530c1037d0 2024-08-20T05:08:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.867+0000 7f5314800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f530c10e1a0 con 0x7f530c102680 2024-08-20T05:08:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.867+0000 7f5314800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f530c10e4a0 con 0x7f530c104190 2024-08-20T05:08:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.867+0000 7f5311400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f530c1037d0 0x7f530c19b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.867+0000 7f5311e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f530c102680 0x7f530c19acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.867+0000 7f5311e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f530c102680 0x7f530c19acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:51162/0 (socket says 172.21.15.37:51162) 2024-08-20T05:08:57.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.867+0000 7f5311e00640 1 -- 172.21.15.37:0/3334414789 learned_addr learned my addr 172.21.15.37:0/3334414789 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.867+0000 7f5312800640 1 --2- 172.21.15.37:0/3334414789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f530c104190 0x7f530c19bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.868+0000 7f5311e00640 1 -- 172.21.15.37:0/3334414789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f530c104190 msgr2=0x7f530c19bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.868+0000 7f5311e00640 1 --2- 172.21.15.37:0/3334414789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f530c104190 0x7f530c19bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.868+0000 7f5311e00640 1 -- 172.21.15.37:0/3334414789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f530c1037d0 msgr2=0x7f530c19b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.868+0000 7f5311e00640 1 --2- 172.21.15.37:0/3334414789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f530c1037d0 0x7f530c19b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.868+0000 7f5311e00640 1 -- 172.21.15.37:0/3334414789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f530c19c800 con 0x7f530c102680 2024-08-20T05:08:57.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.868+0000 7f5311e00640 1 --2- 172.21.15.37:0/3334414789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f530c102680 0x7f530c19acc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f530000e9f0 tx=0x7f530000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.868+0000 7f5306a00640 1 -- 172.21.15.37:0/3334414789 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530000cd80 con 0x7f530c102680 2024-08-20T05:08:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.868+0000 7f5306a00640 1 -- 172.21.15.37:0/3334414789 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53000108e0 con 0x7f530c102680 2024-08-20T05:08:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.868+0000 7f5314800640 1 -- 172.21.15.37:0/3334414789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f530c19caf0 con 0x7f530c102680 2024-08-20T05:08:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.868+0000 7f5306a00640 1 -- 172.21.15.37:0/3334414789 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300018860 con 0x7f530c102680 2024-08-20T05:08:57.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.868+0000 7f5314800640 1 -- 172.21.15.37:0/3334414789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f530c1a31c0 con 0x7f530c102680 2024-08-20T05:08:57.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.871+0000 7f53177fc740 1 Processor -- start 2024-08-20T05:08:57.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.871+0000 7f53177fc740 1 -- start start 2024-08-20T05:08:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.872+0000 7f53177fc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 0x55d44aeaaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.872+0000 7f53177fc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aeaaf40 0x55d44aead330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.872+0000 7f53177fc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aead980 0x55d44aeafe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.872+0000 7f53177fc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d44ae1b210 con 0x55d44aeaaf40 2024-08-20T05:08:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.872+0000 7f53177fc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d44ae0a710 con 0x55d44aead980 2024-08-20T05:08:57.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.872+0000 7f53177fc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d44ae0e750 con 0x55d44aea8610 2024-08-20T05:08:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.872+0000 7f5312800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 0x55d44aeaaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.872+0000 7f5312800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 0x55d44aeaaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50168/0 (socket says 172.21.15.37:50168) 2024-08-20T05:08:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.872+0000 7f5312800640 1 -- 172.21.15.37:0/49285502 learned_addr learned my addr 172.21.15.37:0/49285502 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.872+0000 7f5311400640 1 --2- 172.21.15.37:0/49285502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aead980 0x55d44aeafe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.872+0000 7f5306a00640 1 -- 172.21.15.37:0/3334414789 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5300010430 con 0x7f530c102680 2024-08-20T05:08:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.872+0000 7f5312800640 1 -- 172.21.15.37:0/49285502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aead980 msgr2=0x55d44aeafe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.872+0000 7f5312800640 1 --2- 172.21.15.37:0/49285502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aead980 0x55d44aeafe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.872+0000 7f5312800640 1 -- 172.21.15.37:0/49285502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aeaaf40 msgr2=0x55d44aead330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:08:57.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.873+0000 7f5311e00640 1 --2- 172.21.15.37:0/49285502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aeaaf40 0x55d44aead330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.873+0000 7f5312800640 1 --2- 172.21.15.37:0/49285502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aeaaf40 0x55d44aead330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.873+0000 7f5312800640 1 -- 172.21.15.37:0/49285502 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d44add6de0 con 0x55d44aea8610 2024-08-20T05:08:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.873+0000 7f5311e00640 1 --2- 172.21.15.37:0/49285502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aeaaf40 0x55d44aead330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:08:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.873+0000 7f5312800640 1 --2- 172.21.15.37:0/49285502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 0x55d44aeaaa00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5308009f90 tx=0x7f53080118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6935f901085569 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.874+0000 7f52fb000640 1 -- 172.21.15.37:0/49285502 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308004d20 con 0x55d44aea8610 2024-08-20T05:08:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.874+0000 7f52fb000640 1 -- 172.21.15.37:0/49285502 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5308004050 con 0x55d44aea8610 2024-08-20T05:08:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.874+0000 7f52fb000640 1 -- 172.21.15.37:0/49285502 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308005280 con 0x55d44aea8610 2024-08-20T05:08:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.874+0000 7f5306a00640 1 --2- 172.21.15.37:0/3334414789 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f52f40b3bd0 0x7f52f40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.874+0000 7f53177fc740 1 -- 172.21.15.37:0/49285502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 msgr2=0x55d44aeaaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.874+0000 7f53177fc740 1 --2- 172.21.15.37:0/49285502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 0x55d44aeaaa00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5308009f90 tx=0x7f53080118d0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.875+0000 7f53177fc740 1 -- 172.21.15.37:0/49285502 shutdown_connections 2024-08-20T05:08:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.875+0000 7f53177fc740 1 --2- 172.21.15.37:0/49285502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aead980 0x55d44aeafe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.875+0000 7f53177fc740 1 --2- 172.21.15.37:0/49285502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aeaaf40 0x55d44aead330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.875+0000 7f53177fc740 1 --2- 172.21.15.37:0/49285502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 0x55d44aeaaa00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.875+0000 7f5306a00640 1 -- 172.21.15.37:0/3334414789 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f53000e4310 con 0x7f530c102680 2024-08-20T05:08:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.875+0000 7f53177fc740 1 -- 172.21.15.37:0/49285502 >> 172.21.15.37:0/49285502 conn(0x55d44aea3760 msgr2=0x55d44aea44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.875+0000 7f53177fc740 1 -- 172.21.15.37:0/49285502 shutdown_connections 2024-08-20T05:08:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.875+0000 7f5311e00640 1 --2- 172.21.15.37:0/3334414789 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f52f40b3bd0 0x7f52f40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.875+0000 7f53177fc740 1 -- 172.21.15.37:0/49285502 wait complete. 2024-08-20T05:08:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.875+0000 7f53177fc740 1 -- start start 2024-08-20T05:08:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.875+0000 7f5311e00640 1 --2- 172.21.15.37:0/3334414789 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f52f40b3bd0 0x7f52f40b6090 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f53000e1a10 tx=0x7f5300009590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.876+0000 7f53177fc740 1 Processor -- start 2024-08-20T05:08:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.876+0000 7f53177fc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 0x55d44aeb1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.876+0000 7f53177fc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aeaaf40 0x55d44aeb23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.876+0000 7f53177fc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aead980 0x55d44aeb2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.876+0000 7f53177fc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d44ad43ab0 con 0x55d44aeaaf40 2024-08-20T05:08:57.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.876+0000 7f53177fc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d44adb1140 con 0x55d44aead980 2024-08-20T05:08:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.876+0000 7f53177fc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d44aeb0960 con 0x55d44aea8610 2024-08-20T05:08:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.876+0000 7f53177fc740 10 client.0 _ll_register_callbacks cb 0x55d44adc45d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.876+0000 7f5311400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aeaaf40 0x55d44aeb23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.876+0000 7f5311400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aeaaf40 0x55d44aeb23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42564/0 (socket says 172.21.15.37:42564) 2024-08-20T05:08:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.876+0000 7f5311400640 1 -- 172.21.15.37:0/2329208064 learned_addr learned my addr 172.21.15.37:0/2329208064 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.876+0000 7f5312800640 1 --2- 172.21.15.37:0/2329208064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 0x55d44aeb1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.876+0000 7f5312800640 1 --2- 172.21.15.37:0/2329208064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aead980 0x55d44aeb2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.877+0000 7f5311400640 1 -- 172.21.15.37:0/2329208064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 msgr2=0x55d44aeb1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.877+0000 7f5311400640 1 --2- 172.21.15.37:0/2329208064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 0x55d44aeb1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.877+0000 7f5311400640 1 -- 172.21.15.37:0/2329208064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aead980 msgr2=0x55d44aeb2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:57.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.877+0000 7f5311400640 1 --2- 172.21.15.37:0/2329208064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aead980 0x55d44aeb2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.877+0000 7f5311400640 1 -- 172.21.15.37:0/2329208064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d44adb2170 con 0x55d44aeaaf40 2024-08-20T05:08:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.877+0000 7f5312800640 1 --2- 172.21.15.37:0/2329208064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 0x55d44aeb1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.877+0000 7f5311400640 1 --2- 172.21.15.37:0/2329208064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aeaaf40 0x55d44aeb23b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f52fc02aa10 tx=0x7f52fc0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2874de1d7faf43d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.877+0000 7f52ef400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:08:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.877+0000 7f52ef400640 1 -- 172.21.15.37:0/2329208064 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52fc035040 con 0x55d44aeaaf40 2024-08-20T05:08:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.877+0000 7f53177fc740 1 -- 172.21.15.37:0/2329208064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5308004050 con 0x55d44aeaaf40 2024-08-20T05:08:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.877+0000 7f52ef400640 1 -- 172.21.15.37:0/2329208064 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f52fc003a00 con 0x55d44aeaaf40 2024-08-20T05:08:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.878+0000 7f52ef400640 1 -- 172.21.15.37:0/2329208064 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f52fc04e050 con 0x55d44aeaaf40 2024-08-20T05:08:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.878+0000 7f53177fc740 10 client.16908 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.878+0000 7f53177fc740 1 -- 172.21.15.37:0/2329208064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55d44ab6d790 con 0x55d44aeaaf40 2024-08-20T05:08:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.878+0000 7f52ef400640 1 -- 172.21.15.37:0/2329208064 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5308004050 con 0x55d44aeaaf40 2024-08-20T05:08:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.878+0000 7f52ef400640 1 -- 172.21.15.37:0/2329208064 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f52fc03c440 con 0x55d44aeaaf40 2024-08-20T05:08:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.878+0000 7f53177fc740 10 client.16908 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:57.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.878+0000 7f53177fc740 10 client.16908 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:57.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.878+0000 7f53177fc740 20 client.16908 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:57.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.878+0000 7f53177fc740 1 --2- 172.21.15.37:0/2329208064 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d44aebd900 0x55d44aebfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.878+0000 7f53177fc740 4 client.16908 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:08:57.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.878+0000 7f53177fc740 1 -- 172.21.15.37:0/2329208064 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d44ae1d160 con 0x55d44aebd900 2024-08-20T05:08:57.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.879+0000 7f5312800640 1 --2- 172.21.15.37:0/2329208064 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d44aebd900 0x55d44aebfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.879+0000 7f5312800640 1 --2- 172.21.15.37:0/2329208064 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d44aebd900 0x55d44aebfcf0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb296b43abe04f5d server_cookie=f4f2cca30cea5d82 in_seq=0 out_seq=0 2024-08-20T05:08:57.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.879+0000 7f52ef400640 10 client.16908 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:57.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.880+0000 7f52ef400640 1 -- 172.21.15.37:0/2329208064 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d44ae1d160 con 0x55d44aebd900 2024-08-20T05:08:57.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.880+0000 7f52ef400640 10 client.16908 handle_command_reply: tid=0 2024-08-20T05:08:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.880+0000 7f53177fc740 1 client.16908 shutdown 2024-08-20T05:08:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.880+0000 7f53177fc740 1 -- 172.21.15.37:0/2329208064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aeaaf40 msgr2=0x55d44aeb23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.880+0000 7f53177fc740 1 --2- 172.21.15.37:0/2329208064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aeaaf40 0x55d44aeb23b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f52fc02aa10 tx=0x7f52fc0043b0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.880+0000 7f53177fc740 1 -- 172.21.15.37:0/2329208064 shutdown_connections 2024-08-20T05:08:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.880+0000 7f53177fc740 1 --2- 172.21.15.37:0/2329208064 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d44aebd900 0x55d44aebfcf0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.880+0000 7f53177fc740 1 --2- 172.21.15.37:0/2329208064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aead980 0x55d44aeb2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.880+0000 7f53177fc740 1 --2- 172.21.15.37:0/2329208064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aeaaf40 0x55d44aeb23b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.880+0000 7f53177fc740 1 --2- 172.21.15.37:0/2329208064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 0x55d44aeb1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.880+0000 7f53177fc740 1 -- 172.21.15.37:0/2329208064 >> 172.21.15.37:0/2329208064 conn(0x55d44aea3760 msgr2=0x55d44aea2760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.880+0000 7f52ef400640 0 client.16908 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.880+0000 7f53177fc740 1 -- 172.21.15.37:0/2329208064 shutdown_connections 2024-08-20T05:08:57.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.881+0000 7f53177fc740 1 -- 172.21.15.37:0/2329208064 wait complete. 2024-08-20T05:08:57.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.881+0000 7f53177fc740 20 client.16908 trim_cache size 0 max 16384 2024-08-20T05:08:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.896+0000 7f53177fc740 1 Processor -- start 2024-08-20T05:08:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.896+0000 7f53177fc740 1 -- start start 2024-08-20T05:08:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.896+0000 7f53177fc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aea8610 0x55d44aeae470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.896+0000 7f53177fc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aeaaf40 0x55d44aeb1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.896+0000 7f53177fc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aead980 0x55d44aeb2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.896+0000 7f53177fc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f530c1ad630 con 0x55d44aea8610 2024-08-20T05:08:57.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.896+0000 7f53177fc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f530c1af170 con 0x55d44aeaaf40 2024-08-20T05:08:57.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.896+0000 7f53177fc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f530c1add00 con 0x55d44aead980 2024-08-20T05:08:57.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.897+0000 7f5312800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aea8610 0x55d44aeae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.897+0000 7f5312800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aea8610 0x55d44aeae470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42574/0 (socket says 172.21.15.37:42574) 2024-08-20T05:08:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.897+0000 7f5312800640 1 -- 172.21.15.37:0/218906658 learned_addr learned my addr 172.21.15.37:0/218906658 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.897+0000 7f5311400640 1 --2- 172.21.15.37:0/218906658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aeaaf40 0x55d44aeb1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.897+0000 7f5312800640 1 --2- 172.21.15.37:0/218906658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aead980 0x55d44aeb2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.897+0000 7f5312800640 1 -- 172.21.15.37:0/218906658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aead980 msgr2=0x55d44aeb2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.897+0000 7f5312800640 1 --2- 172.21.15.37:0/218906658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aead980 0x55d44aeb2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.897+0000 7f5312800640 1 -- 172.21.15.37:0/218906658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aeaaf40 msgr2=0x55d44aeb1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.897+0000 7f5312800640 1 --2- 172.21.15.37:0/218906658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aeaaf40 0x55d44aeb1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.897+0000 7f5312800640 1 -- 172.21.15.37:0/218906658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d44abe6620 con 0x55d44aea8610 2024-08-20T05:08:57.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.897+0000 7f5311400640 1 --2- 172.21.15.37:0/218906658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aeaaf40 0x55d44aeb1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.898+0000 7f5312800640 1 --2- 172.21.15.37:0/218906658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aea8610 0x55d44aeae470 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5308005c40 tx=0x7f53080118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0eba25c3835cbda server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.898+0000 7f52fa600640 1 -- 172.21.15.37:0/218906658 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53080045a0 con 0x55d44aea8610 2024-08-20T05:08:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.898+0000 7f52fa600640 1 -- 172.21.15.37:0/218906658 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5308005070 con 0x55d44aea8610 2024-08-20T05:08:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.898+0000 7f52fa600640 1 -- 172.21.15.37:0/218906658 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530800f4e0 con 0x55d44aea8610 2024-08-20T05:08:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.898+0000 7f53177fc740 1 -- 172.21.15.37:0/218906658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aea8610 msgr2=0x55d44aeae470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.898+0000 7f53177fc740 1 --2- 172.21.15.37:0/218906658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aea8610 0x55d44aeae470 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5308005c40 tx=0x7f53080118d0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.899+0000 7f53177fc740 1 -- 172.21.15.37:0/218906658 shutdown_connections 2024-08-20T05:08:57.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.899+0000 7f53177fc740 1 --2- 172.21.15.37:0/218906658 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aead980 0x55d44aeb2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.899+0000 7f53177fc740 1 --2- 172.21.15.37:0/218906658 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aeaaf40 0x55d44aeb1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.899+0000 7f53177fc740 1 --2- 172.21.15.37:0/218906658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aea8610 0x55d44aeae470 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.899+0000 7f53177fc740 1 -- 172.21.15.37:0/218906658 >> 172.21.15.37:0/218906658 conn(0x55d44aea3760 msgr2=0x55d44aeadd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.899+0000 7f53177fc740 1 -- 172.21.15.37:0/218906658 shutdown_connections 2024-08-20T05:08:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.899+0000 7f53177fc740 1 -- 172.21.15.37:0/218906658 wait complete. 2024-08-20T05:08:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.899+0000 7f53177fc740 1 -- start start 2024-08-20T05:08:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.899+0000 7f53177fc740 1 Processor -- start 2024-08-20T05:08:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.900+0000 7f53177fc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 0x55d44aeb69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.900+0000 7f53177fc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aeaaf40 0x55d44aeb7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.900+0000 7f53177fc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aead980 0x55d44aeb7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.900+0000 7f53177fc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f530c1aeaa0 con 0x55d44aead980 2024-08-20T05:08:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.900+0000 7f53177fc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f530c1ae3d0 con 0x55d44aeaaf40 2024-08-20T05:08:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.900+0000 7f53177fc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f530c1ab610 con 0x55d44aea8610 2024-08-20T05:08:57.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.900+0000 7f53177fc740 10 client.0 _ll_register_callbacks cb 0x7f52fc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:57.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.900+0000 7f5312800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aead980 0x55d44aeb7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.900+0000 7f5312800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aead980 0x55d44aeb7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42586/0 (socket says 172.21.15.37:42586) 2024-08-20T05:08:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.900+0000 7f5312800640 1 -- 172.21.15.37:0/2375370671 learned_addr learned my addr 172.21.15.37:0/2375370671 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.900+0000 7f5311400640 1 --2- 172.21.15.37:0/2375370671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aeaaf40 0x55d44aeb7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.900+0000 7f5312800640 1 --2- 172.21.15.37:0/2375370671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 0x55d44aeb69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.901+0000 7f5311400640 1 -- 172.21.15.37:0/2375370671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 msgr2=0x55d44aeb69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.901+0000 7f5311400640 1 --2- 172.21.15.37:0/2375370671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 0x55d44aeb69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.901+0000 7f5311400640 1 -- 172.21.15.37:0/2375370671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aead980 msgr2=0x55d44aeb7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.901+0000 7f5311400640 1 --2- 172.21.15.37:0/2375370671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aead980 0x55d44aeb7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.901+0000 7f5311400640 1 -- 172.21.15.37:0/2375370671 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d44aeb8490 con 0x55d44aeaaf40 2024-08-20T05:08:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.901+0000 7f5311400640 1 --2- 172.21.15.37:0/2375370671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aeaaf40 0x55d44aeb7090 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f52fc03c860 tx=0x7f52fc000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=971ac78d61dd7df1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.901+0000 7f52ef400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:08:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.901+0000 7f52ef400640 1 -- 172.21.15.37:0/2375370671 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52fc035070 con 0x55d44aeaaf40 2024-08-20T05:08:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.901+0000 7f53177fc740 1 -- 172.21.15.37:0/2375370671 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5308005070 con 0x55d44aeaaf40 2024-08-20T05:08:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.901+0000 7f52ef400640 1 -- 172.21.15.37:0/2375370671 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f52fc003800 con 0x55d44aeaaf40 2024-08-20T05:08:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.902+0000 7f52ef400640 1 -- 172.21.15.37:0/2375370671 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f52fc003a00 con 0x55d44aeaaf40 2024-08-20T05:08:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.902+0000 7f53177fc740 10 client.27230 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.902+0000 7f53177fc740 1 -- 172.21.15.37:0/2375370671 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55d44aeb9870 con 0x55d44aeaaf40 2024-08-20T05:08:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.902+0000 7f52ef400640 1 -- 172.21.15.37:0/2375370671 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5308005070 con 0x55d44aeaaf40 2024-08-20T05:08:57.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.902+0000 7f52ef400640 1 -- 172.21.15.37:0/2375370671 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f52fc05a030 con 0x55d44aeaaf40 2024-08-20T05:08:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.902+0000 7f53177fc740 10 client.27230 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.902+0000 7f53177fc740 10 client.27230 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:08:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.902+0000 7f53177fc740 20 client.27230 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.902+0000 7f53177fc740 1 --2- 172.21.15.37:0/2375370671 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d44af285b0 0x55d44af2a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.902+0000 7f53177fc740 4 client.27230 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:08:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.902+0000 7f53177fc740 1 -- 172.21.15.37:0/2375370671 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d44ae18c00 con 0x55d44af285b0 2024-08-20T05:08:57.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.903+0000 7f5312800640 1 --2- 172.21.15.37:0/2375370671 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d44af285b0 0x55d44af2a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.903+0000 7f5312800640 1 --2- 172.21.15.37:0/2375370671 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d44af285b0 0x55d44af2a9a0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae9809bec4f20cd8 server_cookie=78d9c836e069c91b in_seq=0 out_seq=0 2024-08-20T05:08:57.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.903+0000 7f52ef400640 10 client.27230 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.915+0000 7f52ef400640 1 -- 172.21.15.37:0/2375370671 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d44ae18c00 con 0x55d44af285b0 2024-08-20T05:08:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.915+0000 7f52ef400640 10 client.27230 handle_command_reply: tid=0 2024-08-20T05:08:57.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.915+0000 7f53177fc740 1 client.27230 shutdown 2024-08-20T05:08:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.915+0000 7f53177fc740 1 -- 172.21.15.37:0/2375370671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aeaaf40 msgr2=0x55d44aeb7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.915+0000 7f53177fc740 1 --2- 172.21.15.37:0/2375370671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aeaaf40 0x55d44aeb7090 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f52fc03c860 tx=0x7f52fc000bc0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.915+0000 7f53177fc740 1 -- 172.21.15.37:0/2375370671 shutdown_connections 2024-08-20T05:08:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.915+0000 7f53177fc740 1 --2- 172.21.15.37:0/2375370671 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d44af285b0 0x55d44af2a9a0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.915+0000 7f53177fc740 1 --2- 172.21.15.37:0/2375370671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d44aead980 0x55d44aeb7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.915+0000 7f52ef400640 0 client.27230 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.915+0000 7f53177fc740 1 --2- 172.21.15.37:0/2375370671 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d44aeaaf40 0x55d44aeb7090 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.915+0000 7f53177fc740 1 --2- 172.21.15.37:0/2375370671 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d44aea8610 0x55d44aeb69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.915+0000 7f53177fc740 1 -- 172.21.15.37:0/2375370671 >> 172.21.15.37:0/2375370671 conn(0x55d44aea3760 msgr2=0x55d44aea1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.915+0000 7f53177fc740 1 -- 172.21.15.37:0/2375370671 shutdown_connections 2024-08-20T05:08:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.915+0000 7f53177fc740 1 -- 172.21.15.37:0/2375370671 wait complete. 2024-08-20T05:08:57.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.915+0000 7f53177fc740 20 client.27230 trim_cache size 0 max 16384 2024-08-20T05:08:57.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:08:57.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:08:57.921 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:08:57.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:08:57.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.916+0000 7f5314800640 1 -- 172.21.15.37:0/3334414789 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f52f40b3bd0 msgr2=0x7f52f40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.916+0000 7f5314800640 1 --2- 172.21.15.37:0/3334414789 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f52f40b3bd0 0x7f52f40b6090 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f53000e1a10 tx=0x7f5300009590 comp rx=0 tx=0).stop 2024-08-20T05:08:57.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.916+0000 7f5314800640 1 -- 172.21.15.37:0/3334414789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f530c102680 msgr2=0x7f530c19acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:57.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.916+0000 7f5314800640 1 --2- 172.21.15.37:0/3334414789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f530c102680 0x7f530c19acc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f530000e9f0 tx=0x7f530000eeb0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.916+0000 7f5314800640 1 -- 172.21.15.37:0/3334414789 shutdown_connections 2024-08-20T05:08:57.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.916+0000 7f5314800640 1 --2- 172.21.15.37:0/3334414789 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f52f40b3bd0 0x7f52f40b6090 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.916+0000 7f5314800640 1 --2- 172.21.15.37:0/3334414789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f530c104190 0x7f530c19bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.916+0000 7f5314800640 1 --2- 172.21.15.37:0/3334414789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f530c1037d0 0x7f530c19b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.916+0000 7f5314800640 1 --2- 172.21.15.37:0/3334414789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f530c102680 0x7f530c19acc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:57.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.916+0000 7f5314800640 1 -- 172.21.15.37:0/3334414789 >> 172.21.15.37:0/3334414789 conn(0x7f530c0fdf40 msgr2=0x7f530c108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:57.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.917+0000 7f5314800640 1 -- 172.21.15.37:0/3334414789 shutdown_connections 2024-08-20T05:08:57.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:08:57.917+0000 7f5314800640 1 -- 172.21.15.37:0/3334414789 wait complete. 2024-08-20T05:08:57.952 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T05:08:57.953 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:08:57.962 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:08:58.045 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:08:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.531+0000 7f2751800640 1 -- 172.21.15.37:0/2848891803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c104b10 msgr2=0x7f274c104ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.531+0000 7f2751800640 1 --2- 172.21.15.37:0/2848891803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c104b10 0x7f274c104ef0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f273c009860 tx=0x7f273c02a340 comp rx=0 tx=0).stop 2024-08-20T05:08:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.531+0000 7f2751800640 1 -- 172.21.15.37:0/2848891803 shutdown_connections 2024-08-20T05:08:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.531+0000 7f2751800640 1 --2- 172.21.15.37:0/2848891803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c10aea0 0x7f274c1116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.531+0000 7f2751800640 1 --2- 172.21.15.37:0/2848891803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f274c10a520 0x7f274c10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.531+0000 7f2751800640 1 --2- 172.21.15.37:0/2848891803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c104b10 0x7f274c104ef0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.531+0000 7f2751800640 1 -- 172.21.15.37:0/2848891803 >> 172.21.15.37:0/2848891803 conn(0x7f274c100540 msgr2=0x7f274c102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.531+0000 7f2751800640 1 -- 172.21.15.37:0/2848891803 shutdown_connections 2024-08-20T05:08:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.532+0000 7f2751800640 1 -- 172.21.15.37:0/2848891803 wait complete. 2024-08-20T05:08:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.533+0000 7f2751800640 1 Processor -- start 2024-08-20T05:08:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.533+0000 7f2751800640 1 -- start start 2024-08-20T05:08:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.533+0000 7f2751800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f274c104b10 0x7f274c19af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.533+0000 7f2751800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c10a520 0x7f274c19b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.534+0000 7f2751800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c10aea0 0x7f274c1a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.534+0000 7f2751800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f274c114b60 con 0x7f274c10a520 2024-08-20T05:08:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.534+0000 7f2751800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f274c1149e0 con 0x7f274c10aea0 2024-08-20T05:08:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.534+0000 7f2751800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f274c114ce0 con 0x7f274c104b10 2024-08-20T05:08:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.534+0000 7f274b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c10a520 0x7f274c19b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.534+0000 7f274be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f274c104b10 0x7f274c19af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.534+0000 7f274b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c10a520 0x7f274c19b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42598/0 (socket says 172.21.15.37:42598) 2024-08-20T05:08:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.534+0000 7f274b400640 1 -- 172.21.15.37:0/795694874 learned_addr learned my addr 172.21.15.37:0/795694874 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.534+0000 7f2750e00640 1 --2- 172.21.15.37:0/795694874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c10aea0 0x7f274c1a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.534+0000 7f274be00640 1 -- 172.21.15.37:0/795694874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c10aea0 msgr2=0x7f274c1a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.534+0000 7f274be00640 1 --2- 172.21.15.37:0/795694874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c10aea0 0x7f274c1a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.534+0000 7f274be00640 1 -- 172.21.15.37:0/795694874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c10a520 msgr2=0x7f274c19b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.534+0000 7f274be00640 1 --2- 172.21.15.37:0/795694874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c10a520 0x7f274c19b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.534+0000 7f274be00640 1 -- 172.21.15.37:0/795694874 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f274c1a0fe0 con 0x7f274c104b10 2024-08-20T05:08:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.535+0000 7f2750e00640 1 --2- 172.21.15.37:0/795694874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c10aea0 0x7f274c1a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:08:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.535+0000 7f274be00640 1 --2- 172.21.15.37:0/795694874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f274c104b10 0x7f274c19af30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f273c035040 tx=0x7f273c032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.535+0000 7f2748c00640 1 -- 172.21.15.37:0/795694874 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c040020 con 0x7f274c104b10 2024-08-20T05:08:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.535+0000 7f2751800640 1 -- 172.21.15.37:0/795694874 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f274c1a1270 con 0x7f274c104b10 2024-08-20T05:08:58.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.535+0000 7f2748c00640 1 -- 172.21.15.37:0/795694874 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f273c030e10 con 0x7f274c104b10 2024-08-20T05:08:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.535+0000 7f2748c00640 1 -- 172.21.15.37:0/795694874 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c037040 con 0x7f274c104b10 2024-08-20T05:08:58.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.536+0000 7f2751800640 1 -- 172.21.15.37:0/795694874 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f274c1a7990 con 0x7f274c104b10 2024-08-20T05:08:58.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.539+0000 7f2755804740 1 Processor -- start 2024-08-20T05:08:58.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.539+0000 7f2755804740 1 -- start start 2024-08-20T05:08:58.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.539+0000 7f2748c00640 1 -- 172.21.15.37:0/795694874 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f273c043020 con 0x7f274c104b10 2024-08-20T05:08:58.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.539+0000 7f2755804740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 0x559404c07260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.540+0000 7f2755804740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c077a0 0x559404c131f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.540+0000 7f2755804740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c13730 0x559404c15b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.540+0000 7f2755804740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559404ba8670 con 0x559404c06e80 2024-08-20T05:08:58.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.540+0000 7f2755804740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559404b7cd70 con 0x559404c077a0 2024-08-20T05:08:58.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.540+0000 7f2755804740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559404b6c270 con 0x559404c13730 2024-08-20T05:08:58.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.540+0000 7f274be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c077a0 0x559404c131f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.540+0000 7f274be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c077a0 0x559404c131f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:51220/0 (socket says 172.21.15.37:51220) 2024-08-20T05:08:58.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.540+0000 7f274be00640 1 -- 172.21.15.37:0/276799632 learned_addr learned my addr 172.21.15.37:0/276799632 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:58.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.540+0000 7f2750e00640 1 --2- 172.21.15.37:0/276799632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 0x559404c07260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.540+0000 7f274b400640 1 --2- 172.21.15.37:0/276799632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c13730 0x559404c15b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.541+0000 7f274b400640 1 -- 172.21.15.37:0/276799632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c077a0 msgr2=0x559404c131f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.541+0000 7f274b400640 1 --2- 172.21.15.37:0/276799632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c077a0 0x559404c131f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.541+0000 7f274b400640 1 -- 172.21.15.37:0/276799632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 msgr2=0x559404c07260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.541+0000 7f274b400640 1 --2- 172.21.15.37:0/276799632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 0x559404c07260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.541+0000 7f274b400640 1 -- 172.21.15.37:0/276799632 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559404b08870 con 0x559404c13730 2024-08-20T05:08:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.541+0000 7f274b400640 1 --2- 172.21.15.37:0/276799632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c13730 0x559404c15b20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2738009cf0 tx=0x7f2738011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63a5f65b3b0b75c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.541+0000 7f2741600640 1 -- 172.21.15.37:0/276799632 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738005020 con 0x559404c13730 2024-08-20T05:08:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.541+0000 7f2741600640 1 -- 172.21.15.37:0/276799632 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27380047a0 con 0x559404c13730 2024-08-20T05:08:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.541+0000 7f2741600640 1 -- 172.21.15.37:0/276799632 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738019670 con 0x559404c13730 2024-08-20T05:08:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.542+0000 7f2755804740 1 -- 172.21.15.37:0/276799632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c13730 msgr2=0x559404c15b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.542+0000 7f2755804740 1 --2- 172.21.15.37:0/276799632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c13730 0x559404c15b20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f2738009cf0 tx=0x7f2738011810 comp rx=0 tx=0).stop 2024-08-20T05:08:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.542+0000 7f2755804740 1 -- 172.21.15.37:0/276799632 shutdown_connections 2024-08-20T05:08:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.542+0000 7f2755804740 1 --2- 172.21.15.37:0/276799632 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c13730 0x559404c15b20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.542+0000 7f2755804740 1 --2- 172.21.15.37:0/276799632 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c077a0 0x559404c131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.542+0000 7f2755804740 1 --2- 172.21.15.37:0/276799632 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 0x559404c07260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.542+0000 7f2755804740 1 -- 172.21.15.37:0/276799632 >> 172.21.15.37:0/276799632 conn(0x559404c04cb0 msgr2=0x559404c05e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:58.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.542+0000 7f2755804740 1 -- 172.21.15.37:0/276799632 shutdown_connections 2024-08-20T05:08:58.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.542+0000 7f2755804740 1 -- 172.21.15.37:0/276799632 wait complete. 2024-08-20T05:08:58.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.543+0000 7f2748c00640 1 --2- 172.21.15.37:0/795694874 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27300b3c00 0x7f27300b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.543+0000 7f274b400640 1 --2- 172.21.15.37:0/795694874 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27300b3c00 0x7f27300b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.543+0000 7f2748c00640 1 -- 172.21.15.37:0/795694874 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f273c103bf0 con 0x7f274c104b10 2024-08-20T05:08:58.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.543+0000 7f2755804740 1 -- start start 2024-08-20T05:08:58.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.543+0000 7f2755804740 1 Processor -- start 2024-08-20T05:08:58.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.544+0000 7f2755804740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 0x559404c12ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.544+0000 7f2755804740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c077a0 0x559404c10340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.544+0000 7f274b400640 1 --2- 172.21.15.37:0/795694874 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27300b3c00 0x7f27300b60c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2738009ab0 tx=0x7f2738009ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:58.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.544+0000 7f2755804740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c13730 0x559404c10880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.544+0000 7f2755804740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559404af2ff0 con 0x559404c06e80 2024-08-20T05:08:58.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.544+0000 7f2755804740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559404b702b0 con 0x559404c13730 2024-08-20T05:08:58.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.544+0000 7f2755804740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5594049cebb0 con 0x559404c077a0 2024-08-20T05:08:58.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.544+0000 7f2755804740 10 client.0 _ll_register_callbacks cb 0x559404877d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:58.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.544+0000 7f274b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c077a0 0x559404c10340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.544+0000 7f274be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 0x559404c12ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.544+0000 7f274be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 0x559404c12ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42614/0 (socket says 172.21.15.37:42614) 2024-08-20T05:08:58.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.544+0000 7f274be00640 1 -- 172.21.15.37:0/2835491733 learned_addr learned my addr 172.21.15.37:0/2835491733 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:58.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.545+0000 7f2750e00640 1 --2- 172.21.15.37:0/2835491733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c13730 0x559404c10880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.545+0000 7f2750e00640 1 -- 172.21.15.37:0/2835491733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c077a0 msgr2=0x559404c10340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:58.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.545+0000 7f2750e00640 1 --2- 172.21.15.37:0/2835491733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c077a0 0x559404c10340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.545+0000 7f2750e00640 1 -- 172.21.15.37:0/2835491733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 msgr2=0x559404c12ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:58.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.545+0000 7f2750e00640 1 --2- 172.21.15.37:0/2835491733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 0x559404c12ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.545+0000 7f2750e00640 1 -- 172.21.15.37:0/2835491733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594048cbb00 con 0x559404c13730 2024-08-20T05:08:58.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.545+0000 7f274be00640 1 --2- 172.21.15.37:0/2835491733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 0x559404c12ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:58.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.545+0000 7f2750e00640 1 --2- 172.21.15.37:0/2835491733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c13730 0x559404c10880 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f274400fc00 tx=0x7f274400d7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32a4415130e80ba8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:58.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.545+0000 7f2736000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:08:58.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.546+0000 7f2736000640 1 -- 172.21.15.37:0/2835491733 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27440195f0 con 0x559404c13730 2024-08-20T05:08:58.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.546+0000 7f2755804740 1 -- 172.21.15.37:0/2835491733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27380047a0 con 0x559404c13730 2024-08-20T05:08:58.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.546+0000 7f2736000640 1 -- 172.21.15.37:0/2835491733 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2744019790 con 0x559404c13730 2024-08-20T05:08:58.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.546+0000 7f2736000640 1 -- 172.21.15.37:0/2835491733 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2744027050 con 0x559404c13730 2024-08-20T05:08:58.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.546+0000 7f2755804740 10 client.27242 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:58.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.546+0000 7f2755804740 1 -- 172.21.15.37:0/2835491733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x559404942960 con 0x559404c13730 2024-08-20T05:08:58.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.546+0000 7f2736000640 1 -- 172.21.15.37:0/2835491733 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27380047a0 con 0x559404c13730 2024-08-20T05:08:58.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.547+0000 7f2736000640 1 -- 172.21.15.37:0/2835491733 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f274400b040 con 0x559404c13730 2024-08-20T05:08:58.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.547+0000 7f2755804740 10 client.27242 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:58.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.547+0000 7f2755804740 10 client.27242 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:08:58.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.547+0000 7f2755804740 20 client.27242 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:58.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.547+0000 7f2755804740 1 --2- 172.21.15.37:0/2835491733 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559404c2b630 0x559404c2da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.547+0000 7f2755804740 4 client.27242 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:08:58.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.547+0000 7f2755804740 1 -- 172.21.15.37:0/2835491733 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559404b7ecc0 con 0x559404c2b630 2024-08-20T05:08:58.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.547+0000 7f274be00640 1 --2- 172.21.15.37:0/2835491733 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559404c2b630 0x559404c2da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.548+0000 7f274be00640 1 --2- 172.21.15.37:0/2835491733 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559404c2b630 0x559404c2da20 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81cbed5bdf6abfa1 server_cookie=8f8c9b727232e563 in_seq=0 out_seq=0 2024-08-20T05:08:58.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.548+0000 7f2736000640 10 client.27242 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:58.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.549+0000 7f2736000640 1 -- 172.21.15.37:0/2835491733 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559404b7ecc0 con 0x559404c2b630 2024-08-20T05:08:58.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.549+0000 7f2736000640 10 client.27242 handle_command_reply: tid=0 2024-08-20T05:08:58.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.549+0000 7f2755804740 1 client.27242 shutdown 2024-08-20T05:08:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.549+0000 7f2755804740 1 -- 172.21.15.37:0/2835491733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c13730 msgr2=0x559404c10880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.549+0000 7f2755804740 1 --2- 172.21.15.37:0/2835491733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c13730 0x559404c10880 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f274400fc00 tx=0x7f274400d7b0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.549+0000 7f2755804740 1 -- 172.21.15.37:0/2835491733 shutdown_connections 2024-08-20T05:08:58.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.549+0000 7f2755804740 1 --2- 172.21.15.37:0/2835491733 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559404c2b630 0x559404c2da20 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.549+0000 7f2755804740 1 --2- 172.21.15.37:0/2835491733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c13730 0x559404c10880 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.549+0000 7f2755804740 1 --2- 172.21.15.37:0/2835491733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c077a0 0x559404c10340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.549+0000 7f2755804740 1 --2- 172.21.15.37:0/2835491733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 0x559404c12ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.549+0000 7f2755804740 1 -- 172.21.15.37:0/2835491733 >> 172.21.15.37:0/2835491733 conn(0x559404c04cb0 msgr2=0x559404c0a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:58.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.549+0000 7f2736000640 0 client.27242 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:58.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.549+0000 7f2755804740 1 -- 172.21.15.37:0/2835491733 shutdown_connections 2024-08-20T05:08:58.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.550+0000 7f2755804740 1 -- 172.21.15.37:0/2835491733 wait complete. 2024-08-20T05:08:58.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.550+0000 7f2755804740 20 client.27242 trim_cache size 0 max 16384 2024-08-20T05:08:58.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.585+0000 7f2755804740 1 Processor -- start 2024-08-20T05:08:58.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.585+0000 7f2755804740 1 -- start start 2024-08-20T05:08:58.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.585+0000 7f2755804740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c06e80 0x559404c33330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.585+0000 7f2755804740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c077a0 0x559404c33870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.585+0000 7f2755804740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c13730 0x559404c23d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.585+0000 7f2755804740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f274c1ad390 con 0x559404c13730 2024-08-20T05:08:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.585+0000 7f2755804740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f274c1aeed0 con 0x559404c06e80 2024-08-20T05:08:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.585+0000 7f2755804740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f274c1ada60 con 0x559404c077a0 2024-08-20T05:08:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.586+0000 7f274be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c06e80 0x559404c33330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.586+0000 7f274be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c06e80 0x559404c33330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:51236/0 (socket says 172.21.15.37:51236) 2024-08-20T05:08:58.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.586+0000 7f274be00640 1 -- 172.21.15.37:0/489630918 learned_addr learned my addr 172.21.15.37:0/489630918 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:58.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.586+0000 7f2750e00640 1 --2- 172.21.15.37:0/489630918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c13730 0x559404c23d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.586+0000 7f274b400640 1 --2- 172.21.15.37:0/489630918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c077a0 0x559404c33870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.587+0000 7f274be00640 1 -- 172.21.15.37:0/489630918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c077a0 msgr2=0x559404c33870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:58.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.587+0000 7f274be00640 1 --2- 172.21.15.37:0/489630918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c077a0 0x559404c33870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.587+0000 7f274be00640 1 -- 172.21.15.37:0/489630918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c13730 msgr2=0x559404c23d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:58.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.587+0000 7f274be00640 1 --2- 172.21.15.37:0/489630918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c13730 0x559404c23d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.587+0000 7f274be00640 1 -- 172.21.15.37:0/489630918 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559404c13240 con 0x559404c06e80 2024-08-20T05:08:58.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.587+0000 7f2750e00640 1 --2- 172.21.15.37:0/489630918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c13730 0x559404c23d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:08:58.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.587+0000 7f274be00640 1 --2- 172.21.15.37:0/489630918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c06e80 0x559404c33330 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f273c005b60 tx=0x7f273c105040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a019e78908faba04 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.587+0000 7f2740c00640 1 -- 172.21.15.37:0/489630918 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c0c4e60 con 0x559404c06e80 2024-08-20T05:08:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.587+0000 7f2740c00640 1 -- 172.21.15.37:0/489630918 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f273c0d3130 con 0x559404c06e80 2024-08-20T05:08:58.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.587+0000 7f2740c00640 1 -- 172.21.15.37:0/489630918 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273c0ca740 con 0x559404c06e80 2024-08-20T05:08:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.588+0000 7f2755804740 1 -- 172.21.15.37:0/489630918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c06e80 msgr2=0x559404c33330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.588+0000 7f2755804740 1 --2- 172.21.15.37:0/489630918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c06e80 0x559404c33330 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f273c005b60 tx=0x7f273c105040 comp rx=0 tx=0).stop 2024-08-20T05:08:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.588+0000 7f2755804740 1 -- 172.21.15.37:0/489630918 shutdown_connections 2024-08-20T05:08:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.588+0000 7f2755804740 1 --2- 172.21.15.37:0/489630918 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c13730 0x559404c23d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.588+0000 7f2755804740 1 --2- 172.21.15.37:0/489630918 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c077a0 0x559404c33870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.588+0000 7f2755804740 1 --2- 172.21.15.37:0/489630918 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c06e80 0x559404c33330 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.588+0000 7f2755804740 1 -- 172.21.15.37:0/489630918 >> 172.21.15.37:0/489630918 conn(0x559404c04cb0 msgr2=0x559404c03c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.589+0000 7f2755804740 1 -- 172.21.15.37:0/489630918 shutdown_connections 2024-08-20T05:08:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.589+0000 7f2755804740 1 -- 172.21.15.37:0/489630918 wait complete. 2024-08-20T05:08:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.589+0000 7f2755804740 1 -- start start 2024-08-20T05:08:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.589+0000 7f2755804740 1 Processor -- start 2024-08-20T05:08:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.590+0000 7f2755804740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 0x559404c23d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.590+0000 7f2755804740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c077a0 0x559404c24270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.590+0000 7f2755804740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c13730 0x559404c8f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.590+0000 7f2755804740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f274c1ae800 con 0x559404c06e80 2024-08-20T05:08:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.590+0000 7f2755804740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f274c1ae130 con 0x559404c077a0 2024-08-20T05:08:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.590+0000 7f2755804740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f274c1ab3b0 con 0x559404c13730 2024-08-20T05:08:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.590+0000 7f2755804740 10 client.0 _ll_register_callbacks cb 0x7f27440099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:08:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.591+0000 7f274be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 0x559404c23d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.591+0000 7f274be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 0x559404c23d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42634/0 (socket says 172.21.15.37:42634) 2024-08-20T05:08:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.591+0000 7f274be00640 1 -- 172.21.15.37:0/3154459972 learned_addr learned my addr 172.21.15.37:0/3154459972 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.591+0000 7f274b400640 1 --2- 172.21.15.37:0/3154459972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c077a0 0x559404c24270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.591+0000 7f2750e00640 1 --2- 172.21.15.37:0/3154459972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c13730 0x559404c8f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.591+0000 7f274b400640 1 -- 172.21.15.37:0/3154459972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c13730 msgr2=0x559404c8f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.591+0000 7f274b400640 1 --2- 172.21.15.37:0/3154459972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c13730 0x559404c8f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.591+0000 7f274b400640 1 -- 172.21.15.37:0/3154459972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 msgr2=0x559404c23d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:08:58.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.591+0000 7f274b400640 1 --2- 172.21.15.37:0/3154459972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 0x559404c23d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.591+0000 7f274b400640 1 -- 172.21.15.37:0/3154459972 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559404c92000 con 0x559404c077a0 2024-08-20T05:08:58.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.592+0000 7f2750e00640 1 --2- 172.21.15.37:0/3154459972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c13730 0x559404c8f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:08:58.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.592+0000 7f274b400640 1 --2- 172.21.15.37:0/3154459972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c077a0 0x559404c24270 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f273801b040 tx=0x7f2738011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=141bf85c202d34df server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.592+0000 7f2736000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:08:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.592+0000 7f2736000640 1 -- 172.21.15.37:0/3154459972 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738036020 con 0x559404c077a0 2024-08-20T05:08:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.592+0000 7f2755804740 1 -- 172.21.15.37:0/3154459972 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559404b7a760 con 0x559404c077a0 2024-08-20T05:08:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.592+0000 7f2736000640 1 -- 172.21.15.37:0/3154459972 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2738022b70 con 0x559404c077a0 2024-08-20T05:08:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.593+0000 7f2736000640 1 -- 172.21.15.37:0/3154459972 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2738004780 con 0x559404c077a0 2024-08-20T05:08:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.593+0000 7f2755804740 10 client.27248 fetch_fsmap learned FSMap version 36 2024-08-20T05:08:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.593+0000 7f2755804740 1 -- 172.21.15.37:0/3154459972 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x559404ca7830 con 0x559404c077a0 2024-08-20T05:08:58.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.593+0000 7f2736000640 1 -- 172.21.15.37:0/3154459972 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559404b7a760 con 0x559404c077a0 2024-08-20T05:08:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.595+0000 7f2736000640 1 -- 172.21.15.37:0/3154459972 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f273802d050 con 0x559404c077a0 2024-08-20T05:08:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.595+0000 7f2755804740 10 client.27248 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:08:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.595+0000 7f2755804740 10 client.27248 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:08:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.595+0000 7f2755804740 20 client.27248 populate_metadata read hostname 'smithi037' 2024-08-20T05:08:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.595+0000 7f2755804740 1 --2- 172.21.15.37:0/3154459972 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559404ca7d70 0x559404caa190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.595+0000 7f2755804740 4 client.27248 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1ba5c775", "release": true, "await": true}] 2024-08-20T05:08:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.595+0000 7f2755804740 1 -- 172.21.15.37:0/3154459972 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1ba5c775", "release": true, "await": true}) -- 0x559404b77ea0 con 0x559404ca7d70 2024-08-20T05:08:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.596+0000 7f274be00640 1 --2- 172.21.15.37:0/3154459972 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559404ca7d70 0x559404caa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:58.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.596+0000 7f274be00640 1 --2- 172.21.15.37:0/3154459972 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559404ca7d70 0x559404caa190 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c4c2d696942de25 server_cookie=b4748078476d92a0 in_seq=0 out_seq=0 2024-08-20T05:08:58.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.596+0000 7f2736000640 10 client.27248 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:58.599 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:08:58.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.626+0000 7f2736000640 1 -- 172.21.15.37:0/3154459972 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x559404b77ea0 con 0x559404ca7d70 2024-08-20T05:08:58.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.626+0000 7f2736000640 10 client.27248 handle_command_reply: tid=0 2024-08-20T05:08:58.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.628+0000 7f2755804740 1 client.27248 shutdown 2024-08-20T05:08:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.630+0000 7f2755804740 1 -- 172.21.15.37:0/3154459972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c077a0 msgr2=0x559404c24270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.630+0000 7f2755804740 1 --2- 172.21.15.37:0/3154459972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c077a0 0x559404c24270 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f273801b040 tx=0x7f2738011810 comp rx=0 tx=0).stop 2024-08-20T05:08:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.630+0000 7f2755804740 1 -- 172.21.15.37:0/3154459972 shutdown_connections 2024-08-20T05:08:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.630+0000 7f2755804740 1 --2- 172.21.15.37:0/3154459972 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559404ca7d70 0x559404caa190 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.630+0000 7f2755804740 1 --2- 172.21.15.37:0/3154459972 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559404c13730 0x559404c8f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.630+0000 7f2755804740 1 --2- 172.21.15.37:0/3154459972 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559404c077a0 0x559404c24270 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.630+0000 7f2755804740 1 --2- 172.21.15.37:0/3154459972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559404c06e80 0x559404c23d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.630+0000 7f2755804740 1 -- 172.21.15.37:0/3154459972 >> 172.21.15.37:0/3154459972 conn(0x559404c04cb0 msgr2=0x559404c11970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.637+0000 7f2736000640 0 client.27248 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:08:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.637+0000 7f2755804740 1 -- 172.21.15.37:0/3154459972 shutdown_connections 2024-08-20T05:08:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.637+0000 7f2755804740 1 -- 172.21.15.37:0/3154459972 wait complete. 2024-08-20T05:08:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.639+0000 7f2755804740 20 client.27248 trim_cache size 0 max 16384 2024-08-20T05:08:58.645 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:08:58.645 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 36, 2024-08-20T05:08:58.645 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:08:58.645 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 32, 2024-08-20T05:08:58.645 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:08:58.645 INFO:teuthology.orchestra.run.smithi037.stdout: "1ba5c775": { 2024-08-20T05:08:58.646 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 32, 2024-08-20T05:08:58.646 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:08:58.646 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:08:58.646 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:08:58.646 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:08:58.646 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:08:58.646 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:08:58.646 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 150.0, 2024-08-20T05:08:58.646 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:08:58.646 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:08:58.646 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:08:58.646 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:08:58.646 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:08:58.647 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:08:58.647 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:08:58.647 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:08:58.647 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:08:58.647 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:08:58.647 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:08:58.647 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:08:58.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.644+0000 7f2751800640 1 -- 172.21.15.37:0/795694874 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27300b3c00 msgr2=0x7f27300b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:58.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.644+0000 7f2751800640 1 --2- 172.21.15.37:0/795694874 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27300b3c00 0x7f27300b60c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2738009ab0 tx=0x7f2738009ea0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.644+0000 7f2751800640 1 -- 172.21.15.37:0/795694874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f274c104b10 msgr2=0x7f274c19af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:58.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.644+0000 7f2751800640 1 --2- 172.21.15.37:0/795694874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f274c104b10 0x7f274c19af30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f273c035040 tx=0x7f273c032d50 comp rx=0 tx=0).stop 2024-08-20T05:08:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.651+0000 7f2751800640 1 -- 172.21.15.37:0/795694874 shutdown_connections 2024-08-20T05:08:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.651+0000 7f2751800640 1 --2- 172.21.15.37:0/795694874 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27300b3c00 0x7f27300b60c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.651+0000 7f2751800640 1 --2- 172.21.15.37:0/795694874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f274c10aea0 0x7f274c1a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.651+0000 7f2751800640 1 --2- 172.21.15.37:0/795694874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f274c10a520 0x7f274c19b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.651+0000 7f2751800640 1 --2- 172.21.15.37:0/795694874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f274c104b10 0x7f274c19af30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.651+0000 7f2751800640 1 -- 172.21.15.37:0/795694874 >> 172.21.15.37:0/795694874 conn(0x7f274c100540 msgr2=0x7f274c101c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.652+0000 7f2751800640 1 -- 172.21.15.37:0/795694874 shutdown_connections 2024-08-20T05:08:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:58.652+0000 7f2751800640 1 -- 172.21.15.37:0/795694874 wait complete. 2024-08-20T05:08:59.325 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:08:59 smithi037 ceph-mon[17265]: pgmap v603: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-08-20T05:08:59.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:08:59 smithi135 ceph-mon[22342]: pgmap v603: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-08-20T05:08:59.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:08:59 smithi130 ceph-mon[22007]: pgmap v603: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.1 KiB/s wr, 11 op/s 2024-08-20T05:08:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.813+0000 7f67ee800640 1 -- 172.21.15.37:0/2089636283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67e81039a0 msgr2=0x7f67e8103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.813+0000 7f67ee800640 1 --2- 172.21.15.37:0/2089636283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67e81039a0 0x7f67e8103d80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009900 tx=0x7f67d802a410 comp rx=0 tx=0).stop 2024-08-20T05:08:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.813+0000 7f67ee800640 1 -- 172.21.15.37:0/2089636283 shutdown_connections 2024-08-20T05:08:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.813+0000 7f67ee800640 1 --2- 172.21.15.37:0/2089636283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67e810ce00 0x7f67e810f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.813+0000 7f67ee800640 1 --2- 172.21.15.37:0/2089636283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67e81042c0 0x7f67e810c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.813+0000 7f67ee800640 1 --2- 172.21.15.37:0/2089636283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67e81039a0 0x7f67e8103d80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.813+0000 7f67ee800640 1 -- 172.21.15.37:0/2089636283 >> 172.21.15.37:0/2089636283 conn(0x7f67e80fd400 msgr2=0x7f67e80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:08:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.813+0000 7f67ee800640 1 -- 172.21.15.37:0/2089636283 shutdown_connections 2024-08-20T05:08:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.813+0000 7f67ee800640 1 -- 172.21.15.37:0/2089636283 wait complete. 2024-08-20T05:08:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.814+0000 7f67ee800640 1 Processor -- start 2024-08-20T05:08:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.815+0000 7f67ee800640 1 -- start start 2024-08-20T05:08:59.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.815+0000 7f67ee800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67e81039a0 0x7f67e810c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:59.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.816+0000 7f67ee800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67e81042c0 0x7f67e8109770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:59.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.816+0000 7f67ee800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67e810ce00 0x7f67e8109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:59.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.816+0000 7f67ee800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8114cc0 con 0x7f67e81042c0 2024-08-20T05:08:59.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.816+0000 7f67ee800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8114b40 con 0x7f67e81039a0 2024-08-20T05:08:59.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.816+0000 7f67ee800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8114e40 con 0x7f67e810ce00 2024-08-20T05:08:59.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.816+0000 7f67e7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67e81039a0 0x7f67e810c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:59.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.816+0000 7f67e7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67e810ce00 0x7f67e8109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:59.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.816+0000 7f67e7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67e810ce00 0x7f67e8109cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50268/0 (socket says 172.21.15.37:50268) 2024-08-20T05:08:59.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.816+0000 7f67e7e00640 1 -- 172.21.15.37:0/806242655 learned_addr learned my addr 172.21.15.37:0/806242655 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:08:59.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.816+0000 7f67e6a00640 1 --2- 172.21.15.37:0/806242655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67e81042c0 0x7f67e8109770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:59.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.816+0000 7f67e7e00640 1 -- 172.21.15.37:0/806242655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67e81039a0 msgr2=0x7f67e810c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:59.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.816+0000 7f67e7e00640 1 --2- 172.21.15.37:0/806242655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67e81039a0 0x7f67e810c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:59.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.816+0000 7f67e7e00640 1 -- 172.21.15.37:0/806242655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67e81042c0 msgr2=0x7f67e8109770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:08:59.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.816+0000 7f67e7e00640 1 --2- 172.21.15.37:0/806242655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67e81042c0 0x7f67e8109770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:08:59.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.816+0000 7f67e7e00640 1 -- 172.21.15.37:0/806242655 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e810a570 con 0x7f67e810ce00 2024-08-20T05:08:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.818+0000 7f67e7e00640 1 --2- 172.21.15.37:0/806242655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67e810ce00 0x7f67e8109cb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f67e000eb10 tx=0x7f67e000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.819+0000 7f67dfe00640 1 -- 172.21.15.37:0/806242655 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0004b20 con 0x7f67e810ce00 2024-08-20T05:08:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.820+0000 7f67dfe00640 1 -- 172.21.15.37:0/806242655 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67e0004cc0 con 0x7f67e810ce00 2024-08-20T05:08:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.820+0000 7f67dfe00640 1 -- 172.21.15.37:0/806242655 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e0010670 con 0x7f67e810ce00 2024-08-20T05:08:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.820+0000 7f67ee800640 1 -- 172.21.15.37:0/806242655 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e81a12c0 con 0x7f67e810ce00 2024-08-20T05:08:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.820+0000 7f67ee800640 1 -- 172.21.15.37:0/806242655 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e81a17b0 con 0x7f67e810ce00 2024-08-20T05:08:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.822+0000 7f67ee800640 1 -- 172.21.15.37:0/806242655 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c80052c0 con 0x7f67e810ce00 2024-08-20T05:08:59.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.825+0000 7f67dfe00640 1 -- 172.21.15.37:0/806242655 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f67e0005020 con 0x7f67e810ce00 2024-08-20T05:08:59.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.827+0000 7f67dfe00640 1 --2- 172.21.15.37:0/806242655 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f67cc0b3d10 0x7f67cc0b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:08:59.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.827+0000 7f67dfe00640 1 -- 172.21.15.37:0/806242655 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f67e00e4550 con 0x7f67e810ce00 2024-08-20T05:08:59.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.827+0000 7f67e7400640 1 --2- 172.21.15.37:0/806242655 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f67cc0b3d10 0x7f67cc0b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:08:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.829+0000 7f67e7400640 1 --2- 172.21.15.37:0/806242655 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f67cc0b3d10 0x7f67cc0b61d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f67d8000c00 tx=0x7f67d8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:08:59.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:08:59.832+0000 7f67dfe00640 1 -- 172.21.15.37:0/806242655 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f67e00ab7a0 con 0x7f67e810ce00 2024-08-20T05:09:00.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:00.264+0000 7f67ee800640 1 -- 172.21.15.37:0/806242655 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67c80055b0 con 0x7f67e810ce00 2024-08-20T05:09:00.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:00.266+0000 7f67dfe00640 1 -- 172.21.15.37:0/806242655 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11980 (secure 0 0 0) 0x7f67e00ab0a0 con 0x7f67e810ce00 2024-08-20T05:09:00.269 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:09:00.270 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"btime":"2024-08-20T05:06:06:678364+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":36,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:06:06.276613+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:09:00.270 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 36 2024-08-20T05:09:00.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:00.269+0000 7f67ee800640 1 -- 172.21.15.37:0/806242655 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f67cc0b3d10 msgr2=0x7f67cc0b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:00.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:00.269+0000 7f67ee800640 1 --2- 172.21.15.37:0/806242655 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f67cc0b3d10 0x7f67cc0b61d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f67d8000c00 tx=0x7f67d8031400 comp rx=0 tx=0).stop 2024-08-20T05:09:00.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:00.269+0000 7f67ee800640 1 -- 172.21.15.37:0/806242655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67e810ce00 msgr2=0x7f67e8109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:00.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:00.269+0000 7f67ee800640 1 --2- 172.21.15.37:0/806242655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67e810ce00 0x7f67e8109cb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f67e000eb10 tx=0x7f67e000c2d0 comp rx=0 tx=0).stop 2024-08-20T05:09:00.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:00.270+0000 7f67ee800640 1 -- 172.21.15.37:0/806242655 shutdown_connections 2024-08-20T05:09:00.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:00.270+0000 7f67ee800640 1 --2- 172.21.15.37:0/806242655 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f67cc0b3d10 0x7f67cc0b61d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:00.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:00.270+0000 7f67ee800640 1 --2- 172.21.15.37:0/806242655 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67e810ce00 0x7f67e8109cb0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:00.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:00.270+0000 7f67ee800640 1 --2- 172.21.15.37:0/806242655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67e81042c0 0x7f67e8109770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:00.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:00.270+0000 7f67ee800640 1 --2- 172.21.15.37:0/806242655 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f67e81039a0 0x7f67e810c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:00.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:00.270+0000 7f67ee800640 1 -- 172.21.15.37:0/806242655 >> 172.21.15.37:0/806242655 conn(0x7f67e80fd400 msgr2=0x7f67e810f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:00.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:00.271+0000 7f67ee800640 1 -- 172.21.15.37:0/806242655 shutdown_connections 2024-08-20T05:09:00.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:00.271+0000 7f67ee800640 1 -- 172.21.15.37:0/806242655 wait complete. 2024-08-20T05:09:00.464 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1ba5c775', total seconds elapsed: 36.4 2024-08-20T05:09:00.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:00 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/806242655' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:09:00.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:00 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/806242655' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:09:00.770 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:00 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/806242655' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:09:01.563 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T05:09:01.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:01 smithi135 ceph-mon[22342]: pgmap v604: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 197 KiB/s wr, 40 op/s 2024-08-20T05:09:01.645 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:01 smithi037 ceph-mon[17265]: pgmap v604: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 197 KiB/s wr, 40 op/s 2024-08-20T05:09:01.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:01 smithi130 ceph-mon[22007]: pgmap v604: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 197 KiB/s wr, 40 op/s 2024-08-20T05:09:02.227 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:09:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.965+0000 7eff9b600640 1 -- 172.21.15.37:0/2840524406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff941090e0 msgr2=0x7eff941094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.965+0000 7eff9b600640 1 --2- 172.21.15.37:0/2840524406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff941090e0 0x7eff941094c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7eff84009900 tx=0x7eff8402a410 comp rx=0 tx=0).stop 2024-08-20T05:09:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.966+0000 7eff9b600640 1 -- 172.21.15.37:0/2840524406 shutdown_connections 2024-08-20T05:09:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.966+0000 7eff9b600640 1 --2- 172.21.15.37:0/2840524406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9410f470 0x7eff94115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:02.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.966+0000 7eff9b600640 1 --2- 172.21.15.37:0/2840524406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9410eaf0 0x7eff9410ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:02.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.966+0000 7eff9b600640 1 --2- 172.21.15.37:0/2840524406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff941090e0 0x7eff941094c0 secure :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7eff84009900 tx=0x7eff8402a410 comp rx=0 tx=0).stop 2024-08-20T05:09:02.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.966+0000 7eff9b600640 1 -- 172.21.15.37:0/2840524406 >> 172.21.15.37:0/2840524406 conn(0x7eff94078760 msgr2=0x7eff9407ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:02.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.967+0000 7eff9b600640 1 -- 172.21.15.37:0/2840524406 shutdown_connections 2024-08-20T05:09:02.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.967+0000 7eff9b600640 1 -- 172.21.15.37:0/2840524406 wait complete. 2024-08-20T05:09:02.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.969+0000 7eff9b600640 1 Processor -- start 2024-08-20T05:09:02.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.970+0000 7eff9b600640 1 -- start start 2024-08-20T05:09:02.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.971+0000 7eff9b600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9410eaf0 0x7eff9419f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:02.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.971+0000 7eff9b600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9410f470 0x7eff9419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:02.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.971+0000 7eff9b600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff941a50a0 0x7eff941a5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:02.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.972+0000 7eff93e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9410f470 0x7eff9419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:02.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.972+0000 7eff93e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9410f470 0x7eff9419fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:52878/0 (socket says 172.21.15.37:52878) 2024-08-20T05:09:02.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.973+0000 7eff99600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff941a50a0 0x7eff941a5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:02.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.973+0000 7eff99600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff941a50a0 0x7eff941a5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52732/0 (socket says 172.21.15.37:52732) 2024-08-20T05:09:02.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.974+0000 7eff9b600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff94119080 con 0x7eff9410eaf0 2024-08-20T05:09:02.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.974+0000 7eff9b600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7eff94118f00 con 0x7eff9410f470 2024-08-20T05:09:02.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.974+0000 7eff9b600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7eff94119200 con 0x7eff941a50a0 2024-08-20T05:09:02.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.975+0000 7eff98c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9410eaf0 0x7eff9419f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:02.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.975+0000 7eff93e00640 1 -- 172.21.15.37:0/2122060119 learned_addr learned my addr 172.21.15.37:0/2122060119 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:02.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.976+0000 7eff99600640 1 -- 172.21.15.37:0/2122060119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9410f470 msgr2=0x7eff9419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:02.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.976+0000 7eff99600640 1 --2- 172.21.15.37:0/2122060119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9410f470 0x7eff9419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:02.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.976+0000 7eff99600640 1 -- 172.21.15.37:0/2122060119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9410eaf0 msgr2=0x7eff9419f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.976+0000 7eff99600640 1 --2- 172.21.15.37:0/2122060119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9410eaf0 0x7eff9419f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.976+0000 7eff99600640 1 -- 172.21.15.37:0/2122060119 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff941a5c30 con 0x7eff941a50a0 2024-08-20T05:09:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.977+0000 7eff93e00640 1 --2- 172.21.15.37:0/2122060119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9410f470 0x7eff9419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:09:02.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.978+0000 7eff99600640 1 --2- 172.21.15.37:0/2122060119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff941a50a0 0x7eff941a5550 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00ec50 tx=0x7eff8c00c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:02.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.981+0000 7eff91600640 1 -- 172.21.15.37:0/2122060119 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c003b70 con 0x7eff941a50a0 2024-08-20T05:09:02.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.981+0000 7eff91600640 1 -- 172.21.15.37:0/2122060119 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff8c003d10 con 0x7eff941a50a0 2024-08-20T05:09:02.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.981+0000 7eff91600640 1 -- 172.21.15.37:0/2122060119 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c010830 con 0x7eff941a50a0 2024-08-20T05:09:02.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.984+0000 7eff9b600640 1 -- 172.21.15.37:0/2122060119 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff941ac220 con 0x7eff941a50a0 2024-08-20T05:09:02.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.984+0000 7eff9b600640 1 -- 172.21.15.37:0/2122060119 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff941ac5c0 con 0x7eff941a50a0 2024-08-20T05:09:02.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.994+0000 7eff9e02d740 1 Processor -- start 2024-08-20T05:09:03.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.994+0000 7eff91600640 1 -- 172.21.15.37:0/2122060119 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7eff8c003ec0 con 0x7eff941a50a0 2024-08-20T05:09:03.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:02.999+0000 7eff9e02d740 1 -- start start 2024-08-20T05:09:03.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.000+0000 7eff91600640 1 --2- 172.21.15.37:0/2122060119 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff780b3c50 0x7eff780b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:03.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.000+0000 7eff91600640 1 -- 172.21.15.37:0/2122060119 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7eff8c0e4530 con 0x7eff941a50a0 2024-08-20T05:09:03.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.001+0000 7eff9e02d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6eb1940 0x55c2e6eb1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:03.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.001+0000 7eff9e02d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6eb2260 0x55c2e6ebdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:03.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.001+0000 7eff9e02d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ec05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:03.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.001+0000 7eff9e02d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c2e6e27aa0 con 0x55c2e6eb1940 2024-08-20T05:09:03.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.001+0000 7eff99600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ec05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:03.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.001+0000 7eff99600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ec05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52746/0 (socket says 172.21.15.37:52746) 2024-08-20T05:09:03.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.001+0000 7eff99600640 1 -- 172.21.15.37:0/2950217167 learned_addr learned my addr 172.21.15.37:0/2950217167 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:03.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.002+0000 7eff9e02d740 1 -- 172.21.15.37:0/2950217167 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c2e6e16fa0 con 0x55c2e6eb2260 2024-08-20T05:09:03.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.002+0000 7eff93e00640 1 --2- 172.21.15.37:0/2950217167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6eb2260 0x55c2e6ebdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:03.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.002+0000 7eff9e02d740 1 -- 172.21.15.37:0/2950217167 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c2e6e1afe0 con 0x55c2e6ebe1f0 2024-08-20T05:09:03.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.002+0000 7eff93e00640 1 --2- 172.21.15.37:0/2122060119 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff780b3c50 0x7eff780b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:03.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.002+0000 7eff93e00640 1 -- 172.21.15.37:0/2950217167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6ebe1f0 msgr2=0x55c2e6ec05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:03.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.002+0000 7eff93e00640 1 --2- 172.21.15.37:0/2950217167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ec05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.002+0000 7eff93e00640 1 -- 172.21.15.37:0/2950217167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6eb1940 msgr2=0x55c2e6eb1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:03.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.002+0000 7eff93e00640 1 --2- 172.21.15.37:0/2950217167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6eb1940 0x55c2e6eb1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.002+0000 7eff93e00640 1 -- 172.21.15.37:0/2950217167 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e6dbd420 con 0x55c2e6eb2260 2024-08-20T05:09:03.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.003+0000 7eff99600640 1 --2- 172.21.15.37:0/2950217167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ec05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:09:03.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.003+0000 7eff93e00640 1 --2- 172.21.15.37:0/2950217167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6eb2260 0x55c2e6ebdcb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7eff94078d30 tx=0x7eff8000bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=703bb992013b1592 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:03.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.003+0000 7eff89c00640 1 -- 172.21.15.37:0/2950217167 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff800108a0 con 0x55c2e6eb2260 2024-08-20T05:09:03.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.004+0000 7eff89c00640 1 -- 172.21.15.37:0/2950217167 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff8001b440 con 0x55c2e6eb2260 2024-08-20T05:09:03.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.004+0000 7eff89c00640 1 -- 172.21.15.37:0/2950217167 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8000e690 con 0x55c2e6eb2260 2024-08-20T05:09:03.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.005+0000 7eff9e02d740 1 -- 172.21.15.37:0/2950217167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6eb2260 msgr2=0x55c2e6ebdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:03.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.005+0000 7eff9e02d740 1 --2- 172.21.15.37:0/2950217167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6eb2260 0x55c2e6ebdcb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7eff94078d30 tx=0x7eff8000bf90 comp rx=0 tx=0).stop 2024-08-20T05:09:03.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.006+0000 7eff9e02d740 1 -- 172.21.15.37:0/2950217167 shutdown_connections 2024-08-20T05:09:03.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.006+0000 7eff9e02d740 1 --2- 172.21.15.37:0/2950217167 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ec05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.006+0000 7eff9e02d740 1 --2- 172.21.15.37:0/2950217167 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6eb2260 0x55c2e6ebdcb0 secure :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7eff94078d30 tx=0x7eff8000bf90 comp rx=0 tx=0).stop 2024-08-20T05:09:03.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.006+0000 7eff9e02d740 1 --2- 172.21.15.37:0/2950217167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6eb1940 0x55c2e6eb1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.006+0000 7eff9e02d740 1 -- 172.21.15.37:0/2950217167 >> 172.21.15.37:0/2950217167 conn(0x55c2e6eaf770 msgr2=0x55c2e6eb0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.006+0000 7eff93e00640 1 --2- 172.21.15.37:0/2122060119 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff780b3c50 0x7eff780b6110 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7eff8000b4f0 tx=0x7eff8000b440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.008+0000 7eff9e02d740 1 -- 172.21.15.37:0/2950217167 shutdown_connections 2024-08-20T05:09:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.008+0000 7eff9e02d740 1 -- 172.21.15.37:0/2950217167 wait complete. 2024-08-20T05:09:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.008+0000 7eff9e02d740 1 -- start start 2024-08-20T05:09:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.009+0000 7eff9e02d740 1 Processor -- start 2024-08-20T05:09:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.009+0000 7eff9e02d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6eb1940 0x55c2e6ebdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:03.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.009+0000 7eff9e02d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ebaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.009+0000 7eff9e02d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 0x55c2e6ebb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.010+0000 7eff93e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ebaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.010+0000 7eff93e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ebaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53970/0 (socket says 172.21.15.37:53970) 2024-08-20T05:09:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.012+0000 7eff9e02d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c2e6c79700 con 0x55c2e6ebe1f0 2024-08-20T05:09:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.012+0000 7eff9e02d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c2e6db2290 con 0x55c2e6ebb440 2024-08-20T05:09:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.012+0000 7eff9e02d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c2e6ec0ec0 con 0x55c2e6eb1940 2024-08-20T05:09:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.012+0000 7eff98c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6eb1940 0x55c2e6ebdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.012+0000 7eff9e02d740 10 client.0 _ll_register_callbacks cb 0x55c2e6e111c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.012+0000 7eff99600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 0x55c2e6ebb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.012+0000 7eff99600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 0x55c2e6ebb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:52896/0 (socket says 172.21.15.37:52896) 2024-08-20T05:09:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.012+0000 7eff99600640 1 -- 172.21.15.37:0/2086303079 learned_addr learned my addr 172.21.15.37:0/2086303079 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.013+0000 7eff99600640 1 -- 172.21.15.37:0/2086303079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6eb1940 msgr2=0x55c2e6ebdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.013+0000 7eff99600640 1 --2- 172.21.15.37:0/2086303079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6eb1940 0x55c2e6ebdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.013+0000 7eff99600640 1 -- 172.21.15.37:0/2086303079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6ebe1f0 msgr2=0x55c2e6ebaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.013+0000 7eff99600640 1 --2- 172.21.15.37:0/2086303079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ebaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.013+0000 7eff99600640 1 -- 172.21.15.37:0/2086303079 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2e6b76650 con 0x55c2e6ebb440 2024-08-20T05:09:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.013+0000 7eff98c00640 1 --2- 172.21.15.37:0/2086303079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6eb1940 0x55c2e6ebdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:09:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.014+0000 7eff7e000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:09:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.015+0000 7eff99600640 1 --2- 172.21.15.37:0/2086303079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 0x55c2e6ebb8c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00cba0 tx=0x7eff8c0aa980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc47f231ddbefa7c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.015+0000 7eff93e00640 1 --2- 172.21.15.37:0/2086303079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ebaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-08-20T05:09:03.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.015+0000 7eff7e000640 1 -- 172.21.15.37:0/2086303079 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8c0c4020 con 0x55c2e6ebb440 2024-08-20T05:09:03.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.015+0000 7eff7e000640 1 -- 172.21.15.37:0/2086303079 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7eff8c092030 con 0x55c2e6ebb440 2024-08-20T05:09:03.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.015+0000 7eff9e02d740 1 -- 172.21.15.37:0/2086303079 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff8001b440 con 0x55c2e6ebb440 2024-08-20T05:09:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.016+0000 7eff7e000640 1 -- 172.21.15.37:0/2086303079 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7eff8c0c4020 con 0x55c2e6ebb440 2024-08-20T05:09:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.016+0000 7eff9e02d740 10 client.27266 fetch_fsmap learned FSMap version 36 2024-08-20T05:09:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.016+0000 7eff9e02d740 1 -- 172.21.15.37:0/2086303079 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55c2e6eccc50 con 0x55c2e6ebb440 2024-08-20T05:09:03.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.016+0000 7eff7e000640 1 -- 172.21.15.37:0/2086303079 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff8001b440 con 0x55c2e6ebb440 2024-08-20T05:09:03.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.016+0000 7eff7e000640 1 -- 172.21.15.37:0/2086303079 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7eff8c0cc170 con 0x55c2e6ebb440 2024-08-20T05:09:03.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.016+0000 7eff9e02d740 10 client.27266 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:09:03.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.016+0000 7eff9e02d740 10 client.27266 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:09:03.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.017+0000 7eff9e02d740 20 client.27266 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.017+0000 7eff9e02d740 1 --2- 172.21.15.37:0/2086303079 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55c2e6ece0b0 0x55c2e6ed04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.017+0000 7eff9e02d740 4 client.27266 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:09:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.017+0000 7eff9e02d740 1 -- 172.21.15.37:0/2086303079 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2e6e299f0 con 0x55c2e6ece0b0 2024-08-20T05:09:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.017+0000 7eff98c00640 1 --2- 172.21.15.37:0/2086303079 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55c2e6ece0b0 0x55c2e6ed04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.018+0000 7eff98c00640 1 --2- 172.21.15.37:0/2086303079 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55c2e6ece0b0 0x55c2e6ed04e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6e3ca7c0e761fa1c server_cookie=2dbae9315d5c6f04 in_seq=0 out_seq=0 2024-08-20T05:09:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.019+0000 7eff7e000640 10 client.27266 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:09:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.019+0000 7eff7e000640 1 -- 172.21.15.37:0/2086303079 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2e6e299f0 con 0x55c2e6ece0b0 2024-08-20T05:09:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.019+0000 7eff7e000640 10 client.27266 handle_command_reply: tid=0 2024-08-20T05:09:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.019+0000 7eff9e02d740 1 client.27266 shutdown 2024-08-20T05:09:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.020+0000 7eff9e02d740 1 -- 172.21.15.37:0/2086303079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 msgr2=0x55c2e6ebb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.020+0000 7eff9e02d740 1 --2- 172.21.15.37:0/2086303079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 0x55c2e6ebb8c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00cba0 tx=0x7eff8c0aa980 comp rx=0 tx=0).stop 2024-08-20T05:09:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.020+0000 7eff9e02d740 1 -- 172.21.15.37:0/2086303079 shutdown_connections 2024-08-20T05:09:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.020+0000 7eff9e02d740 1 --2- 172.21.15.37:0/2086303079 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55c2e6ece0b0 0x55c2e6ed04e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.020+0000 7eff9e02d740 1 --2- 172.21.15.37:0/2086303079 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 0x55c2e6ebb8c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.020+0000 7eff9e02d740 1 --2- 172.21.15.37:0/2086303079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ebaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.020+0000 7eff9e02d740 1 --2- 172.21.15.37:0/2086303079 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6eb1940 0x55c2e6ebdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.020+0000 7eff9e02d740 1 -- 172.21.15.37:0/2086303079 >> 172.21.15.37:0/2086303079 conn(0x55c2e6eaf770 msgr2=0x55c2e6eb5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.020+0000 7eff7e000640 0 client.27266 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:09:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.021+0000 7eff9e02d740 1 -- 172.21.15.37:0/2086303079 shutdown_connections 2024-08-20T05:09:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.021+0000 7eff9e02d740 1 -- 172.21.15.37:0/2086303079 wait complete. 2024-08-20T05:09:03.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.021+0000 7eff9e02d740 20 client.27266 trim_cache size 0 max 16384 2024-08-20T05:09:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 365.0 s, 667.8 tps, lat 993.780 ms stddev 4995.023 2024-08-20T05:09:03.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.055+0000 7eff9e02d740 1 Processor -- start 2024-08-20T05:09:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.058+0000 7eff9e02d740 1 -- start start 2024-08-20T05:09:03.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.059+0000 7eff9e02d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6eb1940 0x55c2e6eae740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:03.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.059+0000 7eff9e02d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 0x55c2e6ed5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:03.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.060+0000 7eff98c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6eb1940 0x55c2e6eae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:03.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.060+0000 7eff98c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6eb1940 0x55c2e6eae740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52768/0 (socket says 172.21.15.37:52768) 2024-08-20T05:09:03.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.060+0000 7eff9e02d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ed62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:03.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.060+0000 7eff9e02d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff941b6510 con 0x55c2e6ebe1f0 2024-08-20T05:09:03.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.060+0000 7eff9e02d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7eff941b8050 con 0x55c2e6ebb440 2024-08-20T05:09:03.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.060+0000 7eff9e02d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7eff941b6be0 con 0x55c2e6eb1940 2024-08-20T05:09:03.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.060+0000 7eff98c00640 1 -- 172.21.15.37:0/1343917502 learned_addr learned my addr 172.21.15.37:0/1343917502 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:03.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.061+0000 7eff93e00640 1 --2- 172.21.15.37:0/1343917502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 0x55c2e6ed5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:03.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.062+0000 7eff98c00640 1 -- 172.21.15.37:0/1343917502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 msgr2=0x55c2e6ed5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:03.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.062+0000 7eff98c00640 1 --2- 172.21.15.37:0/1343917502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 0x55c2e6ed5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.062+0000 7eff98c00640 1 -- 172.21.15.37:0/1343917502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6ebe1f0 msgr2=0x55c2e6ed62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:03.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.062+0000 7eff98c00640 1 --2- 172.21.15.37:0/1343917502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ed62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.062+0000 7eff98c00640 1 -- 172.21.15.37:0/1343917502 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2e6eb0480 con 0x55c2e6eb1940 2024-08-20T05:09:03.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.063+0000 7eff98c00640 1 --2- 172.21.15.37:0/1343917502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6eb1940 0x55c2e6eae740 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7eff84000c00 tx=0x7eff84005de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aef7b7acd69b5fac server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:03.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.063+0000 7eff89200640 1 -- 172.21.15.37:0/1343917502 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84035070 con 0x55c2e6eb1940 2024-08-20T05:09:03.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.064+0000 7eff89200640 1 -- 172.21.15.37:0/1343917502 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55c2e6e299f0 con 0x55c2e6eb1940 2024-08-20T05:09:03.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.064+0000 7eff89200640 1 -- 172.21.15.37:0/1343917502 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff840046c0 con 0x55c2e6eb1940 2024-08-20T05:09:03.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.065+0000 7eff9e02d740 1 -- 172.21.15.37:0/1343917502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6eb1940 msgr2=0x55c2e6eae740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:03.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.065+0000 7eff9e02d740 1 --2- 172.21.15.37:0/1343917502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6eb1940 0x55c2e6eae740 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7eff84000c00 tx=0x7eff84005de0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.065+0000 7eff9e02d740 1 -- 172.21.15.37:0/1343917502 shutdown_connections 2024-08-20T05:09:03.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.065+0000 7eff9e02d740 1 --2- 172.21.15.37:0/1343917502 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ed62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.065+0000 7eff9e02d740 1 --2- 172.21.15.37:0/1343917502 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 0x55c2e6ed5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.065+0000 7eff9e02d740 1 --2- 172.21.15.37:0/1343917502 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6eb1940 0x55c2e6eae740 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.065+0000 7eff9e02d740 1 -- 172.21.15.37:0/1343917502 >> 172.21.15.37:0/1343917502 conn(0x55c2e6eaf770 msgr2=0x55c2e6eae030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:03.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.065+0000 7eff9e02d740 1 -- 172.21.15.37:0/1343917502 shutdown_connections 2024-08-20T05:09:03.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.066+0000 7eff9e02d740 1 -- 172.21.15.37:0/1343917502 wait complete. 2024-08-20T05:09:03.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.066+0000 7eff9e02d740 1 -- start start 2024-08-20T05:09:03.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.066+0000 7eff9e02d740 1 Processor -- start 2024-08-20T05:09:03.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.068+0000 7eff9e02d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 0x55c2e6ec3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:03.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.068+0000 7eff9e02d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ec40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:03.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.068+0000 7eff98c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 0x55c2e6ec3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:03.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.068+0000 7eff9e02d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6f30f00 0x55c2e6f31380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:03.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.068+0000 7eff98c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 0x55c2e6ec3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:52910/0 (socket says 172.21.15.37:52910) 2024-08-20T05:09:03.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.069+0000 7eff9e02d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff941b7980 con 0x55c2e6f30f00 2024-08-20T05:09:03.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.069+0000 7eff9e02d740 1 -- 172.21.15.37:0/1172957708 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7eff941b72b0 con 0x55c2e6ebb440 2024-08-20T05:09:03.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.069+0000 7eff9e02d740 1 -- 172.21.15.37:0/1172957708 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7eff941b4490 con 0x55c2e6ebe1f0 2024-08-20T05:09:03.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.069+0000 7eff98c00640 1 -- 172.21.15.37:0/1172957708 learned_addr learned my addr 172.21.15.37:0/1172957708 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:03.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.069+0000 7eff9e02d740 10 client.0 _ll_register_callbacks cb 0x7eff8c0aaac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:03.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.069+0000 7eff93e00640 1 --2- 172.21.15.37:0/1172957708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ec40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.069+0000 7eff98c00640 1 -- 172.21.15.37:0/1172957708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6ebe1f0 msgr2=0x55c2e6ec40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.069+0000 7eff98c00640 1 --2- 172.21.15.37:0/1172957708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ec40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.069+0000 7eff98c00640 1 -- 172.21.15.37:0/1172957708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6f30f00 msgr2=0x55c2e6f31380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.069+0000 7eff99600640 1 --2- 172.21.15.37:0/1172957708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6f30f00 0x55c2e6f31380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.069+0000 7eff98c00640 1 --2- 172.21.15.37:0/1172957708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6f30f00 0x55c2e6f31380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.069+0000 7eff98c00640 1 -- 172.21.15.37:0/1172957708 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2e6f31a20 con 0x55c2e6ebb440 2024-08-20T05:09:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.070+0000 7eff93e00640 1 --2- 172.21.15.37:0/1172957708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ec40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:09:03.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.072+0000 7eff98c00640 1 --2- 172.21.15.37:0/1172957708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 0x55c2e6ec3b20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7eff84005ab0 tx=0x7eff84031530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d59fede6970ddc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.072+0000 7eff7e000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:09:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.072+0000 7eff7e000640 1 -- 172.21.15.37:0/1172957708 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84051060 con 0x55c2e6ebb440 2024-08-20T05:09:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.072+0000 7eff7e000640 1 -- 172.21.15.37:0/1172957708 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7eff84031840 con 0x55c2e6ebb440 2024-08-20T05:09:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.073+0000 7eff9e02d740 1 -- 172.21.15.37:0/1172957708 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c2e6e299f0 con 0x55c2e6ebb440 2024-08-20T05:09:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.073+0000 7eff7e000640 1 -- 172.21.15.37:0/1172957708 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7eff84035070 con 0x55c2e6ebb440 2024-08-20T05:09:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.073+0000 7eff9e02d740 10 client.27272 fetch_fsmap learned FSMap version 36 2024-08-20T05:09:03.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.073+0000 7eff9e02d740 1 -- 172.21.15.37:0/1172957708 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55c2e6f38e90 con 0x55c2e6ebb440 2024-08-20T05:09:03.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.073+0000 7eff7e000640 1 -- 172.21.15.37:0/1172957708 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55c2e6e299f0 con 0x55c2e6ebb440 2024-08-20T05:09:03.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.074+0000 7eff7e000640 1 -- 172.21.15.37:0/1172957708 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7eff8403cb10 con 0x55c2e6ebb440 2024-08-20T05:09:03.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.074+0000 7eff9e02d740 10 client.27272 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:09:03.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.074+0000 7eff9e02d740 10 client.27272 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:09:03.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.074+0000 7eff9e02d740 20 client.27272 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:03.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.074+0000 7eff9e02d740 1 --2- 172.21.15.37:0/1172957708 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55c2e6f394c0 0x55c2e6f3b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:03.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.074+0000 7eff9e02d740 4 client.27272 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:09:03.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.074+0000 7eff9e02d740 1 -- 172.21.15.37:0/1172957708 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c2e6e25490 con 0x55c2e6f394c0 2024-08-20T05:09:03.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.074+0000 7eff93e00640 1 --2- 172.21.15.37:0/1172957708 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55c2e6f394c0 0x55c2e6f3b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:03.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.076+0000 7eff93e00640 1 --2- 172.21.15.37:0/1172957708 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55c2e6f394c0 0x55c2e6f3b8e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f1456cfac4d9bb2d server_cookie=1dc4e7addd79627c in_seq=0 out_seq=0 2024-08-20T05:09:03.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.076+0000 7eff7e000640 10 client.27272 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:09:03.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.076+0000 7eff7e000640 1 -- 172.21.15.37:0/1172957708 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c2e6e25490 con 0x55c2e6f394c0 2024-08-20T05:09:03.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.076+0000 7eff7e000640 10 client.27272 handle_command_reply: tid=0 2024-08-20T05:09:03.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.076+0000 7eff9e02d740 1 client.27272 shutdown 2024-08-20T05:09:03.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.076+0000 7eff9e02d740 1 -- 172.21.15.37:0/1172957708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 msgr2=0x55c2e6ec3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:03.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.076+0000 7eff9e02d740 1 --2- 172.21.15.37:0/1172957708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 0x55c2e6ec3b20 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7eff84005ab0 tx=0x7eff84031530 comp rx=0 tx=0).stop 2024-08-20T05:09:03.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.076+0000 7eff9e02d740 1 -- 172.21.15.37:0/1172957708 shutdown_connections 2024-08-20T05:09:03.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.076+0000 7eff9e02d740 1 --2- 172.21.15.37:0/1172957708 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55c2e6f394c0 0x55c2e6f3b8e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.076+0000 7eff9e02d740 1 --2- 172.21.15.37:0/1172957708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2e6f30f00 0x55c2e6f31380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.076+0000 7eff9e02d740 1 --2- 172.21.15.37:0/1172957708 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2e6ebe1f0 0x55c2e6ec40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.076+0000 7eff9e02d740 1 --2- 172.21.15.37:0/1172957708 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2e6ebb440 0x55c2e6ec3b20 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.077+0000 7eff9e02d740 1 -- 172.21.15.37:0/1172957708 >> 172.21.15.37:0/1172957708 conn(0x55c2e6eaf770 msgr2=0x55c2e6eae850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:03.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.077+0000 7eff7e000640 0 client.27272 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:09:03.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.077+0000 7eff9e02d740 1 -- 172.21.15.37:0/1172957708 shutdown_connections 2024-08-20T05:09:03.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.077+0000 7eff9e02d740 1 -- 172.21.15.37:0/1172957708 wait complete. 2024-08-20T05:09:03.081 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:09:03.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.077+0000 7eff9e02d740 20 client.27272 trim_cache size 0 max 16384 2024-08-20T05:09:03.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.079+0000 7eff9b600640 1 -- 172.21.15.37:0/2122060119 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff780b3c50 msgr2=0x7eff780b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.079+0000 7eff9b600640 1 --2- 172.21.15.37:0/2122060119 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff780b3c50 0x7eff780b6110 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7eff8000b4f0 tx=0x7eff8000b440 comp rx=0 tx=0).stop 2024-08-20T05:09:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.079+0000 7eff9b600640 1 -- 172.21.15.37:0/2122060119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff941a50a0 msgr2=0x7eff941a5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.079+0000 7eff9b600640 1 --2- 172.21.15.37:0/2122060119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff941a50a0 0x7eff941a5550 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00ec50 tx=0x7eff8c00c6a0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.079+0000 7eff9b600640 1 -- 172.21.15.37:0/2122060119 shutdown_connections 2024-08-20T05:09:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.079+0000 7eff9b600640 1 --2- 172.21.15.37:0/2122060119 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff780b3c50 0x7eff780b6110 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.079+0000 7eff9b600640 1 --2- 172.21.15.37:0/2122060119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff941a50a0 0x7eff941a5550 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.079+0000 7eff9b600640 1 --2- 172.21.15.37:0/2122060119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff9410f470 0x7eff9419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.079+0000 7eff9b600640 1 --2- 172.21.15.37:0/2122060119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff9410eaf0 0x7eff9419f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.079+0000 7eff9b600640 1 -- 172.21.15.37:0/2122060119 >> 172.21.15.37:0/2122060119 conn(0x7eff94078760 msgr2=0x7eff940791f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:03.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.080+0000 7eff9b600640 1 -- 172.21.15.37:0/2122060119 shutdown_connections 2024-08-20T05:09:03.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:03.080+0000 7eff9b600640 1 -- 172.21.15.37:0/2122060119 wait complete. 2024-08-20T05:09:03.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:03 smithi135 ceph-mon[22342]: pgmap v605: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 863 KiB/s wr, 85 op/s 2024-08-20T05:09:03.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:03 smithi130 ceph-mon[22007]: pgmap v605: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 863 KiB/s wr, 85 op/s 2024-08-20T05:09:03.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:03 smithi037 ceph-mon[17265]: pgmap v605: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 863 KiB/s wr, 85 op/s 2024-08-20T05:09:04.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T05:09:05.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:05 smithi135 ceph-mon[22342]: pgmap v606: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.9 MiB/s wr, 182 op/s 2024-08-20T05:09:05.686 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:09:05.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:05 smithi130 ceph-mon[22007]: pgmap v606: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.9 MiB/s wr, 182 op/s 2024-08-20T05:09:05.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:05 smithi037 ceph-mon[17265]: pgmap v606: 129 pgs: 129 active+clean; 1.2 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.9 MiB/s wr, 182 op/s 2024-08-20T05:09:06.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.458+0000 7f1f1aa00640 1 -- 172.21.15.37:0/1292319709 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f140313a0 con 0x7f1f1c107050 2024-08-20T05:09:06.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.459+0000 7f1f22e00640 1 -- 172.21.15.37:0/1292319709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f1c107050 msgr2=0x7f1f1c10d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:06.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.459+0000 7f1f22e00640 1 --2- 172.21.15.37:0/1292319709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f1c107050 0x7f1f1c10d850 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1f1400adb0 tx=0x7f1f1402b7a0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.459+0000 7f1f22e00640 1 -- 172.21.15.37:0/1292319709 shutdown_connections 2024-08-20T05:09:06.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.459+0000 7f1f22e00640 1 --2- 172.21.15.37:0/1292319709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f1c107050 0x7f1f1c10d850 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.459+0000 7f1f22e00640 1 --2- 172.21.15.37:0/1292319709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f1c1066d0 0x7f1f1c106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.459+0000 7f1f22e00640 1 --2- 172.21.15.37:0/1292319709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f1c100cc0 0x7f1f1c1010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.459+0000 7f1f22e00640 1 -- 172.21.15.37:0/1292319709 >> 172.21.15.37:0/1292319709 conn(0x7f1f1c0fc730 msgr2=0x7f1f1c0feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:06.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.459+0000 7f1f22e00640 1 -- 172.21.15.37:0/1292319709 shutdown_connections 2024-08-20T05:09:06.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.460+0000 7f1f22e00640 1 -- 172.21.15.37:0/1292319709 wait complete. 2024-08-20T05:09:06.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.461+0000 7f1f22e00640 1 Processor -- start 2024-08-20T05:09:06.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.462+0000 7f1f22e00640 1 -- start start 2024-08-20T05:09:06.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.462+0000 7f1f22e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f1c100cc0 0x7f1f1c10caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.462+0000 7f1f22e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f1c1066d0 0x7f1f1c10cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.462+0000 7f1f1be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f1c100cc0 0x7f1f1c10caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:06.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.462+0000 7f1f1be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f1c100cc0 0x7f1f1c10caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:52932/0 (socket says 172.21.15.37:52932) 2024-08-20T05:09:06.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.463+0000 7f1f1be00640 1 -- 172.21.15.37:0/1211835019 learned_addr learned my addr 172.21.15.37:0/1211835019 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:06.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.463+0000 7f1f22e00640 1 --2- 172.21.15.37:0/1211835019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f1c107050 0x7f1f1c1b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.463+0000 7f1f1b400640 1 --2- 172.21.15.37:0/1211835019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f1c1066d0 0x7f1f1c10cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:06.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.464+0000 7f1f22e00640 1 -- 172.21.15.37:0/1211835019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c10fb70 con 0x7f1f1c107050 2024-08-20T05:09:06.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.464+0000 7f1f22e00640 1 -- 172.21.15.37:0/1211835019 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c10f9f0 con 0x7f1f1c100cc0 2024-08-20T05:09:06.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.464+0000 7f1f22e00640 1 -- 172.21.15.37:0/1211835019 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c10fcf0 con 0x7f1f1c1066d0 2024-08-20T05:09:06.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.465+0000 7f1f1be00640 1 -- 172.21.15.37:0/1211835019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f1c1066d0 msgr2=0x7f1f1c10cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:06.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.465+0000 7f1f20e00640 1 --2- 172.21.15.37:0/1211835019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f1c107050 0x7f1f1c1b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:06.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.465+0000 7f1f1be00640 1 --2- 172.21.15.37:0/1211835019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f1c1066d0 0x7f1f1c10cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.465+0000 7f1f1be00640 1 -- 172.21.15.37:0/1211835019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f1c107050 msgr2=0x7f1f1c1b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:06.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.465+0000 7f1f1be00640 1 --2- 172.21.15.37:0/1211835019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f1c107050 0x7f1f1c1b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.465+0000 7f1f1be00640 1 -- 172.21.15.37:0/1211835019 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c1b3f40 con 0x7f1f1c100cc0 2024-08-20T05:09:06.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.465+0000 7f1f20e00640 1 --2- 172.21.15.37:0/1211835019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f1c107050 0x7f1f1c1b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:09:06.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.465+0000 7f1f1b400640 1 --2- 172.21.15.37:0/1211835019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f1c1066d0 0x7f1f1c10cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:09:06.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.466+0000 7f1f1be00640 1 --2- 172.21.15.37:0/1211835019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f1c100cc0 0x7f1f1c10caa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c00e9f0 tx=0x7f1f0c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:06.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.467+0000 7f1f18c00640 1 -- 172.21.15.37:0/1211835019 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c00cd80 con 0x7f1f1c100cc0 2024-08-20T05:09:06.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.467+0000 7f1f22e00640 1 -- 172.21.15.37:0/1211835019 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1c1b4230 con 0x7f1f1c100cc0 2024-08-20T05:09:06.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.467+0000 7f1f22e00640 1 -- 172.21.15.37:0/1211835019 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1c1b47c0 con 0x7f1f1c100cc0 2024-08-20T05:09:06.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.469+0000 7f1f18c00640 1 -- 172.21.15.37:0/1211835019 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f0c0108e0 con 0x7f1f1c100cc0 2024-08-20T05:09:06.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.469+0000 7f1f18c00640 1 -- 172.21.15.37:0/1211835019 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c018980 con 0x7f1f1c100cc0 2024-08-20T05:09:06.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.474+0000 7f1f25898740 1 Processor -- start 2024-08-20T05:09:06.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.475+0000 7f1f25898740 1 -- start start 2024-08-20T05:09:06.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.475+0000 7f1f25898740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 0x565140129d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.475+0000 7f1f18c00640 1 -- 172.21.15.37:0/1211835019 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1f0c010430 con 0x7f1f1c100cc0 2024-08-20T05:09:06.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.476+0000 7f1f25898740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56514012a260 0x565140135cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.476+0000 7f1f25898740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651401361f0 0x5651401385e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.477+0000 7f1f25898740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56514009faa0 con 0x56514012a260 2024-08-20T05:09:06.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.477+0000 7f1f25898740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56514008efa0 con 0x5651401361f0 2024-08-20T05:09:06.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.477+0000 7f1f25898740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x565140092fe0 con 0x565140129940 2024-08-20T05:09:06.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.478+0000 7f1f18c00640 1 --2- 172.21.15.37:0/1211835019 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1f000b3cd0 0x7f1f000b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.478+0000 7f1f20e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 0x565140129d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:06.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.478+0000 7f1f20e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 0x565140129d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52788/0 (socket says 172.21.15.37:52788) 2024-08-20T05:09:06.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.478+0000 7f1f20e00640 1 -- 172.21.15.37:0/2688637990 learned_addr learned my addr 172.21.15.37:0/2688637990 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:06.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.478+0000 7f1f1be00640 1 --2- 172.21.15.37:0/2688637990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56514012a260 0x565140135cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:06.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.478+0000 7f1f1b400640 1 --2- 172.21.15.37:0/2688637990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651401361f0 0x5651401385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:06.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.478+0000 7f1f20e00640 1 -- 172.21.15.37:0/2688637990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651401361f0 msgr2=0x5651401385e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:06.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.478+0000 7f1f20e00640 1 --2- 172.21.15.37:0/2688637990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651401361f0 0x5651401385e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.478+0000 7f1f20e00640 1 -- 172.21.15.37:0/2688637990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56514012a260 msgr2=0x565140135cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:06.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.479+0000 7f1f20e00640 1 --2- 172.21.15.37:0/2688637990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56514012a260 0x565140135cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.479+0000 7f1f20e00640 1 -- 172.21.15.37:0/2688637990 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565140035420 con 0x565140129940 2024-08-20T05:09:06.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.479+0000 7f1f1b400640 1 --2- 172.21.15.37:0/2688637990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651401361f0 0x5651401385e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:09:06.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.479+0000 7f1f18c00640 1 -- 172.21.15.37:0/1211835019 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1f0c0e43e0 con 0x7f1f1c100cc0 2024-08-20T05:09:06.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.479+0000 7f1f20e00640 1 --2- 172.21.15.37:0/1211835019 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1f000b3cd0 0x7f1f000b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:06.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.479+0000 7f1f1be00640 1 --2- 172.21.15.37:0/2688637990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56514012a260 0x565140135cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:09:06.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.480+0000 7f1f20e00640 1 --2- 172.21.15.37:0/2688637990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 0x565140129d20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1f14032ba0 tx=0x7f1f14032bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aa9f9a40fe36f2f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:06.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.481+0000 7f1f11600640 1 -- 172.21.15.37:0/2688637990 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1404f070 con 0x565140129940 2024-08-20T05:09:06.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.481+0000 7f1f11600640 1 -- 172.21.15.37:0/2688637990 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f140326c0 con 0x565140129940 2024-08-20T05:09:06.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.481+0000 7f1f11600640 1 -- 172.21.15.37:0/2688637990 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14030770 con 0x565140129940 2024-08-20T05:09:06.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.482+0000 7f1f25898740 1 -- 172.21.15.37:0/2688637990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 msgr2=0x565140129d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:06.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.482+0000 7f1f20e00640 1 --2- 172.21.15.37:0/1211835019 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1f000b3cd0 0x7f1f000b6190 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1f1404c000 tx=0x7f1f1404d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:06.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.482+0000 7f1f25898740 1 --2- 172.21.15.37:0/2688637990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 0x565140129d20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1f14032ba0 tx=0x7f1f14032bd0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.483+0000 7f1f25898740 1 -- 172.21.15.37:0/2688637990 shutdown_connections 2024-08-20T05:09:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.483+0000 7f1f25898740 1 --2- 172.21.15.37:0/2688637990 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651401361f0 0x5651401385e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.483+0000 7f1f25898740 1 --2- 172.21.15.37:0/2688637990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56514012a260 0x565140135cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.483+0000 7f1f25898740 1 --2- 172.21.15.37:0/2688637990 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 0x565140129d20 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.483+0000 7f1f25898740 1 -- 172.21.15.37:0/2688637990 >> 172.21.15.37:0/2688637990 conn(0x565140127770 msgr2=0x565140128910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.483+0000 7f1f25898740 1 -- 172.21.15.37:0/2688637990 shutdown_connections 2024-08-20T05:09:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.483+0000 7f1f25898740 1 -- 172.21.15.37:0/2688637990 wait complete. 2024-08-20T05:09:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.484+0000 7f1f25898740 1 -- start start 2024-08-20T05:09:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.484+0000 7f1f25898740 1 Processor -- start 2024-08-20T05:09:06.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.485+0000 7f1f25898740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 0x565140135940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.485+0000 7f1f25898740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56514012a260 0x565140132d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.486+0000 7f1f25898740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651401361f0 0x5651401332d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.486+0000 7f1f25898740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56513fef1700 con 0x56514012a260 2024-08-20T05:09:06.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.486+0000 7f1f25898740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56514002a290 con 0x5651401361f0 2024-08-20T05:09:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.486+0000 7f1f25898740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x565140138e70 con 0x565140129940 2024-08-20T05:09:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.486+0000 7f1f1b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56514012a260 0x565140132d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.487+0000 7f1f1b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56514012a260 0x565140132d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54028/0 (socket says 172.21.15.37:54028) 2024-08-20T05:09:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.487+0000 7f1f1b400640 1 -- 172.21.15.37:0/2932768364 learned_addr learned my addr 172.21.15.37:0/2932768364 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.487+0000 7f1f25898740 10 client.0 _ll_register_callbacks cb 0x5651400891c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.488+0000 7f1f1b400640 1 -- 172.21.15.37:0/2932768364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 msgr2=0x565140135940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:09:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.488+0000 7f1f1b400640 1 --2- 172.21.15.37:0/2932768364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 0x565140135940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.488+0000 7f1f1b400640 1 -- 172.21.15.37:0/2932768364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651401361f0 msgr2=0x5651401332d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:09:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.488+0000 7f1f1b400640 1 --2- 172.21.15.37:0/2932768364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651401361f0 0x5651401332d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.488+0000 7f1f1b400640 1 -- 172.21.15.37:0/2932768364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56513fdee650 con 0x56514012a260 2024-08-20T05:09:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.489+0000 7f1f1b400640 1 --2- 172.21.15.37:0/2932768364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56514012a260 0x565140132d90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1f08012780 tx=0x7f1f08012c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab3ca29186ecb43 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.489+0000 7f1f06000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:09:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.489+0000 7f1f06000640 1 -- 172.21.15.37:0/2932768364 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f08010dc0 con 0x56514012a260 2024-08-20T05:09:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.489+0000 7f1f25898740 1 -- 172.21.15.37:0/2932768364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f140326c0 con 0x56514012a260 2024-08-20T05:09:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.489+0000 7f1f06000640 1 -- 172.21.15.37:0/2932768364 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1f08004020 con 0x56514012a260 2024-08-20T05:09:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.490+0000 7f1f06000640 1 -- 172.21.15.37:0/2932768364 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f1f08025050 con 0x56514012a260 2024-08-20T05:09:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.490+0000 7f1f25898740 10 client.16944 fetch_fsmap learned FSMap version 36 2024-08-20T05:09:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.490+0000 7f1f25898740 1 -- 172.21.15.37:0/2932768364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x565140144630 con 0x56514012a260 2024-08-20T05:09:06.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.491+0000 7f1f06000640 1 -- 172.21.15.37:0/2932768364 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f140326c0 con 0x56514012a260 2024-08-20T05:09:06.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.492+0000 7f1f06000640 1 -- 172.21.15.37:0/2932768364 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f1f080035f0 con 0x56514012a260 2024-08-20T05:09:06.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.492+0000 7f1f25898740 10 client.16944 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:09:06.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.492+0000 7f1f25898740 10 client.16944 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:09:06.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.492+0000 7f1f25898740 20 client.16944 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:06.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.492+0000 7f1f25898740 1 --2- 172.21.15.37:0/2932768364 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x565140145b00 0x565140147f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.493+0000 7f1f25898740 4 client.16944 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:09:06.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.493+0000 7f1f25898740 1 -- 172.21.15.37:0/2932768364 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651400a19f0 con 0x565140145b00 2024-08-20T05:09:06.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.493+0000 7f1f1be00640 1 --2- 172.21.15.37:0/2932768364 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x565140145b00 0x565140147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:06.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.494+0000 7f1f1be00640 1 --2- 172.21.15.37:0/2932768364 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x565140145b00 0x565140147f30 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=51018cd1b58342bf server_cookie=14d84f89373ab148 in_seq=0 out_seq=0 2024-08-20T05:09:06.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.494+0000 7f1f06000640 10 client.16944 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:09:06.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.495+0000 7f1f06000640 1 -- 172.21.15.37:0/2932768364 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651400a19f0 con 0x565140145b00 2024-08-20T05:09:06.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.495+0000 7f1f06000640 10 client.16944 handle_command_reply: tid=0 2024-08-20T05:09:06.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.495+0000 7f1f25898740 1 client.16944 shutdown 2024-08-20T05:09:06.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.496+0000 7f1f25898740 1 -- 172.21.15.37:0/2932768364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56514012a260 msgr2=0x565140132d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:06.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.496+0000 7f1f25898740 1 --2- 172.21.15.37:0/2932768364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56514012a260 0x565140132d90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1f08012780 tx=0x7f1f08012c40 comp rx=0 tx=0).stop 2024-08-20T05:09:06.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.496+0000 7f1f25898740 1 -- 172.21.15.37:0/2932768364 shutdown_connections 2024-08-20T05:09:06.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.496+0000 7f1f25898740 1 --2- 172.21.15.37:0/2932768364 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x565140145b00 0x565140147f30 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.496+0000 7f1f25898740 1 --2- 172.21.15.37:0/2932768364 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651401361f0 0x5651401332d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.496+0000 7f1f25898740 1 --2- 172.21.15.37:0/2932768364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56514012a260 0x565140132d90 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.496+0000 7f1f25898740 1 --2- 172.21.15.37:0/2932768364 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 0x565140135940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.496+0000 7f1f06000640 0 client.16944 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:09:06.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.496+0000 7f1f25898740 1 -- 172.21.15.37:0/2932768364 >> 172.21.15.37:0/2932768364 conn(0x565140127770 msgr2=0x56514012d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:06.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.497+0000 7f1f25898740 1 -- 172.21.15.37:0/2932768364 shutdown_connections 2024-08-20T05:09:06.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.497+0000 7f1f25898740 1 -- 172.21.15.37:0/2932768364 wait complete. 2024-08-20T05:09:06.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.498+0000 7f1f25898740 20 client.16944 trim_cache size 0 max 16384 2024-08-20T05:09:06.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.529+0000 7f1f25898740 1 Processor -- start 2024-08-20T05:09:06.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.530+0000 7f1f25898740 1 -- start start 2024-08-20T05:09:06.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.530+0000 7f1f25898740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565140129940 0x565140134ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.530+0000 7f1f25898740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514012a260 0x56514014d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.530+0000 7f1f25898740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651401361f0 0x56514014dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.530+0000 7f1f25898740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1be650 con 0x565140129940 2024-08-20T05:09:06.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.530+0000 7f1f25898740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1c0190 con 0x5651401361f0 2024-08-20T05:09:06.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.530+0000 7f1f25898740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1bed20 con 0x56514012a260 2024-08-20T05:09:06.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.532+0000 7f1f20e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651401361f0 0x56514014dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:06.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.532+0000 7f1f20e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651401361f0 0x56514014dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:52946/0 (socket says 172.21.15.37:52946) 2024-08-20T05:09:06.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.532+0000 7f1f20e00640 1 -- 172.21.15.37:0/723282201 learned_addr learned my addr 172.21.15.37:0/723282201 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:06.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.532+0000 7f1f1b400640 1 --2- 172.21.15.37:0/723282201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514012a260 0x56514014d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:06.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.533+0000 7f1f20e00640 1 -- 172.21.15.37:0/723282201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514012a260 msgr2=0x56514014d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:06.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.534+0000 7f1f20e00640 1 --2- 172.21.15.37:0/723282201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514012a260 0x56514014d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.534+0000 7f1f20e00640 1 -- 172.21.15.37:0/723282201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565140129940 msgr2=0x565140134ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:06.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.534+0000 7f1f20e00640 1 --2- 172.21.15.37:0/723282201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565140129940 0x565140134ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.534+0000 7f1f20e00640 1 -- 172.21.15.37:0/723282201 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565140122ef0 con 0x5651401361f0 2024-08-20T05:09:06.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.534+0000 7f1f1b400640 1 --2- 172.21.15.37:0/723282201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514012a260 0x56514014d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:09:06.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.534+0000 7f1f20e00640 1 --2- 172.21.15.37:0/723282201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651401361f0 0x56514014dd40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1f14005e30 tx=0x7f1f1403c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84646a55a772d08f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:06.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.535+0000 7f1f10c00640 1 -- 172.21.15.37:0/723282201 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1404f070 con 0x5651401361f0 2024-08-20T05:09:06.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.535+0000 7f1f10c00640 1 -- 172.21.15.37:0/723282201 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f14057070 con 0x5651401361f0 2024-08-20T05:09:06.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.535+0000 7f1f10c00640 1 -- 172.21.15.37:0/723282201 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1404f070 con 0x5651401361f0 2024-08-20T05:09:06.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.537+0000 7f1f25898740 1 -- 172.21.15.37:0/723282201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651401361f0 msgr2=0x56514014dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:06.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.537+0000 7f1f25898740 1 --2- 172.21.15.37:0/723282201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651401361f0 0x56514014dd40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1f14005e30 tx=0x7f1f1403c000 comp rx=0 tx=0).stop 2024-08-20T05:09:06.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.537+0000 7f1f25898740 1 -- 172.21.15.37:0/723282201 shutdown_connections 2024-08-20T05:09:06.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.537+0000 7f1f25898740 1 --2- 172.21.15.37:0/723282201 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5651401361f0 0x56514014dd40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.537+0000 7f1f25898740 1 --2- 172.21.15.37:0/723282201 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56514012a260 0x56514014d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.537+0000 7f1f25898740 1 --2- 172.21.15.37:0/723282201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565140129940 0x565140134ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.537+0000 7f1f25898740 1 -- 172.21.15.37:0/723282201 >> 172.21.15.37:0/723282201 conn(0x565140127770 msgr2=0x5651401343c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:06.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.540+0000 7f1f25898740 1 -- 172.21.15.37:0/723282201 shutdown_connections 2024-08-20T05:09:06.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.540+0000 7f1f25898740 1 -- 172.21.15.37:0/723282201 wait complete. 2024-08-20T05:09:06.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.541+0000 7f1f25898740 1 -- start start 2024-08-20T05:09:06.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.541+0000 7f1f25898740 1 Processor -- start 2024-08-20T05:09:06.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.542+0000 7f1f25898740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 0x56514013e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.542+0000 7f1f25898740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514012a260 0x56514012f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.542+0000 7f1f1be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 0x56514013e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.542+0000 7f1f1be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 0x56514013e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52814/0 (socket says 172.21.15.37:52814) 2024-08-20T05:09:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.542+0000 7f1f1be00640 1 -- 172.21.15.37:0/65774910 learned_addr learned my addr 172.21.15.37:0/65774910 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.543+0000 7f1f25898740 1 --2- 172.21.15.37:0/65774910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5651401361f0 0x56514012fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.543+0000 7f1f25898740 1 -- 172.21.15.37:0/65774910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1bfac0 con 0x5651401361f0 2024-08-20T05:09:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.543+0000 7f1f25898740 1 -- 172.21.15.37:0/65774910 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1bf3f0 con 0x56514012a260 2024-08-20T05:09:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.543+0000 7f1f25898740 1 -- 172.21.15.37:0/65774910 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c1bc630 con 0x565140129940 2024-08-20T05:09:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.543+0000 7f1f25898740 10 client.0 _ll_register_callbacks cb 0x7f1f1c118880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.543+0000 7f1f1b400640 1 --2- 172.21.15.37:0/65774910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514012a260 0x56514012f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:06.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.543+0000 7f1f1be00640 1 -- 172.21.15.37:0/65774910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514012a260 msgr2=0x56514012f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:06.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.543+0000 7f1f1be00640 1 --2- 172.21.15.37:0/65774910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514012a260 0x56514012f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.543+0000 7f1f1be00640 1 -- 172.21.15.37:0/65774910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5651401361f0 msgr2=0x56514012fee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:09:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.543+0000 7f1f1be00640 1 --2- 172.21.15.37:0/65774910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5651401361f0 0x56514012fee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.543+0000 7f1f1be00640 1 -- 172.21.15.37:0/65774910 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565140130580 con 0x565140129940 2024-08-20T05:09:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.544+0000 7f1f1be00640 1 --2- 172.21.15.37:0/65774910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 0x56514013e630 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0a81a0 tx=0x7f1f0c0a6f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bd3cd916d6b3ec1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.544+0000 7f1f06000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:09:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.544+0000 7f1f06000640 1 -- 172.21.15.37:0/65774910 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c026040 con 0x565140129940 2024-08-20T05:09:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.544+0000 7f1f25898740 1 -- 172.21.15.37:0/65774910 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f14057070 con 0x565140129940 2024-08-20T05:09:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.544+0000 7f1f06000640 1 -- 172.21.15.37:0/65774910 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1f0c010a90 con 0x565140129940 2024-08-20T05:09:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.544+0000 7f1f06000640 1 -- 172.21.15.37:0/65774910 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f1f0c0aaf30 con 0x565140129940 2024-08-20T05:09:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.544+0000 7f1f25898740 10 client.27304 fetch_fsmap learned FSMap version 36 2024-08-20T05:09:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.545+0000 7f1f25898740 1 -- 172.21.15.37:0/65774910 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5651401b07d0 con 0x565140129940 2024-08-20T05:09:06.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.545+0000 7f1f06000640 1 -- 172.21.15.37:0/65774910 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f14057070 con 0x565140129940 2024-08-20T05:09:06.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.545+0000 7f1f06000640 1 -- 172.21.15.37:0/65774910 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f1f0c018b20 con 0x565140129940 2024-08-20T05:09:06.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.545+0000 7f1f25898740 10 client.27304 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:09:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.545+0000 7f1f25898740 10 client.27304 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:09:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.545+0000 7f1f25898740 20 client.27304 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.545+0000 7f1f25898740 1 --2- 172.21.15.37:0/65774910 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5651401b0e40 0x5651401b3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.545+0000 7f1f25898740 4 client.27304 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:09:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.545+0000 7f1f25898740 1 -- 172.21.15.37:0/65774910 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56514009d490 con 0x5651401b0e40 2024-08-20T05:09:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.547+0000 7f1f1b400640 1 --2- 172.21.15.37:0/65774910 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5651401b0e40 0x5651401b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.550+0000 7f1f1b400640 1 --2- 172.21.15.37:0/65774910 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5651401b0e40 0x5651401b3260 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3688440a7e35c5c5 server_cookie=2c32490801e8e4f2 in_seq=0 out_seq=0 2024-08-20T05:09:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.550+0000 7f1f06000640 10 client.27304 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:09:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.550+0000 7f1f06000640 1 -- 172.21.15.37:0/65774910 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56514009d490 con 0x5651401b0e40 2024-08-20T05:09:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.550+0000 7f1f06000640 10 client.27304 handle_command_reply: tid=0 2024-08-20T05:09:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.550+0000 7f1f25898740 1 client.27304 shutdown 2024-08-20T05:09:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.550+0000 7f1f25898740 1 -- 172.21.15.37:0/65774910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 msgr2=0x56514013e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.550+0000 7f1f25898740 1 --2- 172.21.15.37:0/65774910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 0x56514013e630 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0a81a0 tx=0x7f1f0c0a6f00 comp rx=0 tx=0).stop 2024-08-20T05:09:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.551+0000 7f1f25898740 1 -- 172.21.15.37:0/65774910 shutdown_connections 2024-08-20T05:09:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.551+0000 7f1f25898740 1 --2- 172.21.15.37:0/65774910 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5651401b0e40 0x5651401b3260 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.551+0000 7f1f25898740 1 --2- 172.21.15.37:0/65774910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5651401361f0 0x56514012fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.551+0000 7f1f25898740 1 --2- 172.21.15.37:0/65774910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56514012a260 0x56514012f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.551+0000 7f1f25898740 1 --2- 172.21.15.37:0/65774910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565140129940 0x56514013e630 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.551+0000 7f1f25898740 1 -- 172.21.15.37:0/65774910 >> 172.21.15.37:0/65774910 conn(0x565140127770 msgr2=0x565140134be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.551+0000 7f1f06000640 0 client.27304 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:09:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.551+0000 7f1f25898740 1 -- 172.21.15.37:0/65774910 shutdown_connections 2024-08-20T05:09:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.551+0000 7f1f25898740 1 -- 172.21.15.37:0/65774910 wait complete. 2024-08-20T05:09:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.552+0000 7f1f25898740 20 client.27304 trim_cache size 0 max 16384 2024-08-20T05:09:06.554 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:09:06.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.553+0000 7f1f22e00640 1 -- 172.21.15.37:0/1211835019 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1f000b3cd0 msgr2=0x7f1f000b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:06.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.553+0000 7f1f22e00640 1 --2- 172.21.15.37:0/1211835019 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1f000b3cd0 0x7f1f000b6190 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1f1404c000 tx=0x7f1f1404d000 comp rx=0 tx=0).stop 2024-08-20T05:09:06.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.553+0000 7f1f22e00640 1 -- 172.21.15.37:0/1211835019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f1c100cc0 msgr2=0x7f1f1c10caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:06.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.553+0000 7f1f22e00640 1 --2- 172.21.15.37:0/1211835019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f1c100cc0 0x7f1f1c10caa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c00e9f0 tx=0x7f1f0c00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.553+0000 7f1f22e00640 1 -- 172.21.15.37:0/1211835019 shutdown_connections 2024-08-20T05:09:06.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.553+0000 7f1f22e00640 1 --2- 172.21.15.37:0/1211835019 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1f000b3cd0 0x7f1f000b6190 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.553+0000 7f1f22e00640 1 --2- 172.21.15.37:0/1211835019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f1c107050 0x7f1f1c1b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.553+0000 7f1f22e00640 1 --2- 172.21.15.37:0/1211835019 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1f1c1066d0 0x7f1f1c10cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.553+0000 7f1f22e00640 1 --2- 172.21.15.37:0/1211835019 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1f1c100cc0 0x7f1f1c10caa0 secure :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c00e9f0 tx=0x7f1f0c00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:09:06.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.553+0000 7f1f22e00640 1 -- 172.21.15.37:0/1211835019 >> 172.21.15.37:0/1211835019 conn(0x7f1f1c0fc730 msgr2=0x7f1f1c104d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:06.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.556+0000 7f1f22e00640 1 -- 172.21.15.37:0/1211835019 shutdown_connections 2024-08-20T05:09:06.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:06.556+0000 7f1f22e00640 1 -- 172.21.15.37:0/1211835019 wait complete. 2024-08-20T05:09:07.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:07 smithi037 ceph-mon[17265]: pgmap v607: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.7 MiB/s wr, 276 op/s 2024-08-20T05:09:07.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:07 smithi135 ceph-mon[22342]: pgmap v607: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.7 MiB/s wr, 276 op/s 2024-08-20T05:09:07.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:07 smithi130 ceph-mon[22007]: pgmap v607: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.7 MiB/s wr, 276 op/s 2024-08-20T05:09:07.801 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T05:09:08.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 370.0 s, 905.0 tps, lat 111.566 ms stddev 152.257 2024-08-20T05:09:08.542 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:09:09.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.608+0000 7f6e2d800640 1 -- 172.21.15.37:0/224077941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e2810b040 msgr2=0x7f6e28111840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:09.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.608+0000 7f6e2d800640 1 --2- 172.21.15.37:0/224077941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e2810b040 0x7f6e28111840 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009be0 tx=0x7f6e2002a6c0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.609+0000 7f6e2d800640 1 -- 172.21.15.37:0/224077941 shutdown_connections 2024-08-20T05:09:09.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.609+0000 7f6e2d800640 1 --2- 172.21.15.37:0/224077941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e2810b040 0x7f6e28111840 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.609+0000 7f6e2d800640 1 --2- 172.21.15.37:0/224077941 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e2810a6c0 0x7f6e2810ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.609+0000 7f6e2d800640 1 --2- 172.21.15.37:0/224077941 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e28104cb0 0x7f6e28105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.609+0000 7f6e2d800640 1 -- 172.21.15.37:0/224077941 >> 172.21.15.37:0/224077941 conn(0x7f6e28100720 msgr2=0x7f6e28102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:09.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.609+0000 7f6e2d800640 1 -- 172.21.15.37:0/224077941 shutdown_connections 2024-08-20T05:09:09.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.609+0000 7f6e2d800640 1 -- 172.21.15.37:0/224077941 wait complete. 2024-08-20T05:09:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.610+0000 7f6e2d800640 1 Processor -- start 2024-08-20T05:09:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.610+0000 7f6e2d800640 1 -- start start 2024-08-20T05:09:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.611+0000 7f6e2d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e28104cb0 0x7f6e2819b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.611+0000 7f6e2d800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e2810a6c0 0x7f6e2819b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.611+0000 7f6e2d800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e2810b040 0x7f6e281a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.611+0000 7f6e2d800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28114cc0 con 0x7f6e28104cb0 2024-08-20T05:09:09.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.611+0000 7f6e2d800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28114b40 con 0x7f6e2810b040 2024-08-20T05:09:09.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.611+0000 7f6e2d800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6e28114e40 con 0x7f6e2810a6c0 2024-08-20T05:09:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.611+0000 7f6e26000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e2810a6c0 0x7f6e2819b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.611+0000 7f6e26000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e2810a6c0 0x7f6e2819b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52832/0 (socket says 172.21.15.37:52832) 2024-08-20T05:09:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.611+0000 7f6e26000640 1 -- 172.21.15.37:0/2207780770 learned_addr learned my addr 172.21.15.37:0/2207780770 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:09.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.612+0000 7f6e27400640 1 --2- 172.21.15.37:0/2207780770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e2810b040 0x7f6e281a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:09.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.612+0000 7f6e26a00640 1 --2- 172.21.15.37:0/2207780770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e28104cb0 0x7f6e2819b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:09.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.612+0000 7f6e27400640 1 -- 172.21.15.37:0/2207780770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e2810a6c0 msgr2=0x7f6e2819b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:09.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.612+0000 7f6e27400640 1 --2- 172.21.15.37:0/2207780770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e2810a6c0 0x7f6e2819b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.612+0000 7f6e27400640 1 -- 172.21.15.37:0/2207780770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e28104cb0 msgr2=0x7f6e2819b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:09.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.612+0000 7f6e27400640 1 --2- 172.21.15.37:0/2207780770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e28104cb0 0x7f6e2819b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.612+0000 7f6e27400640 1 -- 172.21.15.37:0/2207780770 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e281a1220 con 0x7f6e2810b040 2024-08-20T05:09:09.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.613+0000 7f6e27400640 1 --2- 172.21.15.37:0/2207780770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e2810b040 0x7f6e281a0a50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009b30 tx=0x7f6e20003b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:09.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.613+0000 7f6e1f400640 1 -- 172.21.15.37:0/2207780770 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e20041020 con 0x7f6e2810b040 2024-08-20T05:09:09.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.613+0000 7f6e1f400640 1 -- 172.21.15.37:0/2207780770 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e200318f0 con 0x7f6e2810b040 2024-08-20T05:09:09.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.613+0000 7f6e1f400640 1 -- 172.21.15.37:0/2207780770 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e20036040 con 0x7f6e2810b040 2024-08-20T05:09:09.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.614+0000 7f6e2d800640 1 -- 172.21.15.37:0/2207780770 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e281a14b0 con 0x7f6e2810b040 2024-08-20T05:09:09.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.614+0000 7f6e2d800640 1 -- 172.21.15.37:0/2207780770 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e281a7bd0 con 0x7f6e2810b040 2024-08-20T05:09:09.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.618+0000 7f6e301ed740 1 Processor -- start 2024-08-20T05:09:09.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.618+0000 7f6e1f400640 1 -- 172.21.15.37:0/2207780770 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6e20044020 con 0x7f6e2810b040 2024-08-20T05:09:09.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.619+0000 7f6e301ed740 1 -- start start 2024-08-20T05:09:09.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.619+0000 7f6e301ed740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 0x556be9a5b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.619+0000 7f6e301ed740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a5ba70 0x556be9a674c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.619+0000 7f6e301ed740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a67a00 0x556be9a69df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.619+0000 7f6e301ed740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556be99c8aa0 con 0x556be9a5ba70 2024-08-20T05:09:09.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.619+0000 7f6e301ed740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556be99b7fa0 con 0x556be9a67a00 2024-08-20T05:09:09.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.619+0000 7f6e301ed740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556be99bbfe0 con 0x556be9a5b150 2024-08-20T05:09:09.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.619+0000 7f6e26a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a5ba70 0x556be9a674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:09.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.620+0000 7f6e26a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a5ba70 0x556be9a674c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54062/0 (socket says 172.21.15.37:54062) 2024-08-20T05:09:09.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.620+0000 7f6e26a00640 1 -- 172.21.15.37:0/2855820137 learned_addr learned my addr 172.21.15.37:0/2855820137 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:09.623 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:09 smithi037 ceph-mon[17265]: pgmap v608: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.5 MiB/s wr, 328 op/s 2024-08-20T05:09:09.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.620+0000 7f6e26a00640 1 -- 172.21.15.37:0/2855820137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 msgr2=0x556be9a5b530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:09:09.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.620+0000 7f6e26a00640 1 --2- 172.21.15.37:0/2855820137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 0x556be9a5b530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.620+0000 7f6e26a00640 1 -- 172.21.15.37:0/2855820137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a67a00 msgr2=0x556be9a69df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:09:09.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.621+0000 7f6e26a00640 1 --2- 172.21.15.37:0/2855820137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a67a00 0x556be9a69df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.621+0000 7f6e26a00640 1 -- 172.21.15.37:0/2855820137 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556be995e420 con 0x556be9a5ba70 2024-08-20T05:09:09.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.621+0000 7f6e26a00640 1 --2- 172.21.15.37:0/2855820137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a5ba70 0x556be9a674c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009d50 tx=0x7f6e180117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe18bd181c204c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:09.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.622+0000 7f6e13e00640 1 -- 172.21.15.37:0/2855820137 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e18012650 con 0x556be9a5ba70 2024-08-20T05:09:09.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.622+0000 7f6e13e00640 1 -- 172.21.15.37:0/2855820137 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e18009e40 con 0x556be9a5ba70 2024-08-20T05:09:09.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.622+0000 7f6e13e00640 1 -- 172.21.15.37:0/2855820137 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1800fc60 con 0x556be9a5ba70 2024-08-20T05:09:09.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.622+0000 7f6e1f400640 1 --2- 172.21.15.37:0/2207780770 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6e0c0b3cd0 0x7f6e0c0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.623+0000 7f6e1f400640 1 -- 172.21.15.37:0/2207780770 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6e20104610 con 0x7f6e2810b040 2024-08-20T05:09:09.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.623+0000 7f6e301ed740 1 -- 172.21.15.37:0/2855820137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a5ba70 msgr2=0x556be9a674c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:09.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.623+0000 7f6e301ed740 1 --2- 172.21.15.37:0/2855820137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a5ba70 0x556be9a674c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6e18009d50 tx=0x7f6e180117b0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.623+0000 7f6e26000640 1 --2- 172.21.15.37:0/2207780770 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6e0c0b3cd0 0x7f6e0c0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:09.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.624+0000 7f6e301ed740 1 -- 172.21.15.37:0/2855820137 shutdown_connections 2024-08-20T05:09:09.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.624+0000 7f6e301ed740 1 --2- 172.21.15.37:0/2855820137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a67a00 0x556be9a69df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.624+0000 7f6e301ed740 1 --2- 172.21.15.37:0/2855820137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a5ba70 0x556be9a674c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.624+0000 7f6e301ed740 1 --2- 172.21.15.37:0/2855820137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 0x556be9a5b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.624+0000 7f6e301ed740 1 -- 172.21.15.37:0/2855820137 >> 172.21.15.37:0/2855820137 conn(0x556be9a58f80 msgr2=0x556be9a5a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:09.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.625+0000 7f6e301ed740 1 -- 172.21.15.37:0/2855820137 shutdown_connections 2024-08-20T05:09:09.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.625+0000 7f6e301ed740 1 -- 172.21.15.37:0/2855820137 wait complete. 2024-08-20T05:09:09.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.626+0000 7f6e301ed740 1 -- start start 2024-08-20T05:09:09.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.626+0000 7f6e301ed740 1 Processor -- start 2024-08-20T05:09:09.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.628+0000 7f6e26000640 1 --2- 172.21.15.37:0/2207780770 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6e0c0b3cd0 0x7f6e0c0b6190 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009640 tx=0x7f6e140095d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:09.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.629+0000 7f6e301ed740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 0x556be9a67320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.629+0000 7f6e301ed740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a5ba70 0x556be9a64770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.629+0000 7f6e301ed740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a67a00 0x556be9a64da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.630+0000 7f6e26a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 0x556be9a67320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:09.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.630+0000 7f6e27400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a67a00 0x556be9a64da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:09.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.630+0000 7f6e27400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a67a00 0x556be9a64da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:52992/0 (socket says 172.21.15.37:52992) 2024-08-20T05:09:09.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.630+0000 7f6e27400640 1 -- 172.21.15.37:0/366091045 learned_addr learned my addr 172.21.15.37:0/366091045 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:09.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.630+0000 7f6e301ed740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556be981a700 con 0x556be9a5ba70 2024-08-20T05:09:09.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.630+0000 7f6e301ed740 1 -- 172.21.15.37:0/366091045 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556be9953290 con 0x556be9a67a00 2024-08-20T05:09:09.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.630+0000 7f6e301ed740 1 -- 172.21.15.37:0/366091045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556be9a6a6b0 con 0x556be9a5b150 2024-08-20T05:09:09.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.630+0000 7f6e301ed740 10 client.0 _ll_register_callbacks cb 0x556be99b21c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:09.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.631+0000 7f6e26000640 1 --2- 172.21.15.37:0/366091045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a5ba70 0x556be9a64770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:09.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.631+0000 7f6e27400640 1 -- 172.21.15.37:0/366091045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 msgr2=0x556be9a67320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:09.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.631+0000 7f6e27400640 1 --2- 172.21.15.37:0/366091045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 0x556be9a67320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.631+0000 7f6e27400640 1 -- 172.21.15.37:0/366091045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a5ba70 msgr2=0x556be9a64770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:09.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.631+0000 7f6e27400640 1 --2- 172.21.15.37:0/366091045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a5ba70 0x556be9a64770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.631+0000 7f6e27400640 1 -- 172.21.15.37:0/366091045 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556be9717650 con 0x556be9a67a00 2024-08-20T05:09:09.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.631+0000 7f6e26000640 1 --2- 172.21.15.37:0/366091045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a5ba70 0x556be9a64770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:09:09.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.631+0000 7f6e27400640 1 --2- 172.21.15.37:0/366091045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a67a00 0x556be9a64da0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6e200cb0f0 tx=0x7f6e200ca8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a80131f92cff89f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:09.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.632+0000 7f6e10c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:09:09.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.632+0000 7f6e10c00640 1 -- 172.21.15.37:0/366091045 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e200cb160 con 0x556be9a67a00 2024-08-20T05:09:09.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.632+0000 7f6e10c00640 1 -- 172.21.15.37:0/366091045 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6e200c7750 con 0x556be9a67a00 2024-08-20T05:09:09.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.632+0000 7f6e301ed740 1 -- 172.21.15.37:0/366091045 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556be99ca9f0 con 0x556be9a67a00 2024-08-20T05:09:09.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.632+0000 7f6e10c00640 1 -- 172.21.15.37:0/366091045 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6e200cf760 con 0x556be9a67a00 2024-08-20T05:09:09.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.632+0000 7f6e301ed740 10 client.27293 fetch_fsmap learned FSMap version 36 2024-08-20T05:09:09.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.632+0000 7f6e301ed740 1 -- 172.21.15.37:0/366091045 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x556be9a76020 con 0x556be9a67a00 2024-08-20T05:09:09.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.633+0000 7f6e10c00640 1 -- 172.21.15.37:0/366091045 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x556be99ca9f0 con 0x556be9a67a00 2024-08-20T05:09:09.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.633+0000 7f6e10c00640 1 -- 172.21.15.37:0/366091045 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f6e200d3d80 con 0x556be9a67a00 2024-08-20T05:09:09.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.633+0000 7f6e301ed740 10 client.27293 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:09:09.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.633+0000 7f6e301ed740 10 client.27293 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:09:09.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.634+0000 7f6e301ed740 20 client.27293 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:09.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.634+0000 7f6e301ed740 1 --2- 172.21.15.37:0/366091045 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x556be9a775c0 0x556be9a79a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.634+0000 7f6e301ed740 4 client.27293 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:09:09.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.634+0000 7f6e301ed740 1 -- 172.21.15.37:0/366091045 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556be99c6490 con 0x556be9a775c0 2024-08-20T05:09:09.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.634+0000 7f6e26a00640 1 --2- 172.21.15.37:0/366091045 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x556be9a775c0 0x556be9a79a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:09.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.635+0000 7f6e26a00640 1 --2- 172.21.15.37:0/366091045 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x556be9a775c0 0x556be9a79a60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=62b34d03c83ebaff server_cookie=e99dcfccc8f77861 in_seq=0 out_seq=0 2024-08-20T05:09:09.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.635+0000 7f6e10c00640 10 client.27293 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:09:09.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.635+0000 7f6e10c00640 1 -- 172.21.15.37:0/366091045 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556be99c6490 con 0x556be9a775c0 2024-08-20T05:09:09.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.635+0000 7f6e10c00640 10 client.27293 handle_command_reply: tid=0 2024-08-20T05:09:09.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.636+0000 7f6e301ed740 1 client.27293 shutdown 2024-08-20T05:09:09.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.636+0000 7f6e301ed740 1 -- 172.21.15.37:0/366091045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a67a00 msgr2=0x556be9a64da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:09.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.636+0000 7f6e301ed740 1 --2- 172.21.15.37:0/366091045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a67a00 0x556be9a64da0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6e200cb0f0 tx=0x7f6e200ca8d0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.636+0000 7f6e301ed740 1 -- 172.21.15.37:0/366091045 shutdown_connections 2024-08-20T05:09:09.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.636+0000 7f6e301ed740 1 --2- 172.21.15.37:0/366091045 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x556be9a775c0 0x556be9a79a60 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.636+0000 7f6e301ed740 1 --2- 172.21.15.37:0/366091045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a67a00 0x556be9a64da0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.636+0000 7f6e301ed740 1 --2- 172.21.15.37:0/366091045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a5ba70 0x556be9a64770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.636+0000 7f6e301ed740 1 --2- 172.21.15.37:0/366091045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 0x556be9a67320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.636+0000 7f6e301ed740 1 -- 172.21.15.37:0/366091045 >> 172.21.15.37:0/366091045 conn(0x556be9a58f80 msgr2=0x556be9a5eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:09.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.636+0000 7f6e10c00640 0 client.27293 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:09:09.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.637+0000 7f6e301ed740 1 -- 172.21.15.37:0/366091045 shutdown_connections 2024-08-20T05:09:09.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.637+0000 7f6e301ed740 1 -- 172.21.15.37:0/366091045 wait complete. 2024-08-20T05:09:09.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.637+0000 7f6e301ed740 20 client.27293 trim_cache size 0 max 16384 2024-08-20T05:09:09.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.661+0000 7f6e301ed740 1 Processor -- start 2024-08-20T05:09:09.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.661+0000 7f6e301ed740 1 -- start start 2024-08-20T05:09:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.662+0000 7f6e301ed740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a58f80 0x556be9a7f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.662+0000 7f6e301ed740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 0x556be9a7f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.662+0000 7f6e301ed740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a5ba70 0x556be9a61980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.662+0000 7f6e301ed740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281ad4f0 con 0x556be9a58f80 2024-08-20T05:09:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.662+0000 7f6e301ed740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281af030 con 0x556be9a5ba70 2024-08-20T05:09:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.662+0000 7f6e301ed740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281adbc0 con 0x556be9a5b150 2024-08-20T05:09:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.662+0000 7f6e27400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a5ba70 0x556be9a61980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.662+0000 7f6e27400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a5ba70 0x556be9a61980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:52994/0 (socket says 172.21.15.37:52994) 2024-08-20T05:09:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.662+0000 7f6e27400640 1 -- 172.21.15.37:0/926568113 learned_addr learned my addr 172.21.15.37:0/926568113 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.662+0000 7f6e26000640 1 --2- 172.21.15.37:0/926568113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 0x556be9a7f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.663+0000 7f6e26000640 1 -- 172.21.15.37:0/926568113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a5ba70 msgr2=0x556be9a61980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:09.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.663+0000 7f6e26000640 1 --2- 172.21.15.37:0/926568113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a5ba70 0x556be9a61980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.663+0000 7f6e26000640 1 -- 172.21.15.37:0/926568113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a58f80 msgr2=0x556be9a7f330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:09:09.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.663+0000 7f6e26000640 1 --2- 172.21.15.37:0/926568113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a58f80 0x556be9a7f330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.663+0000 7f6e26000640 1 -- 172.21.15.37:0/926568113 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556be9a59a00 con 0x556be9a5b150 2024-08-20T05:09:09.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.663+0000 7f6e26000640 1 --2- 172.21.15.37:0/926568113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 0x556be9a7f870 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x556be9a59ca0 tx=0x7f6e14014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efa6a4578c480fc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.664+0000 7f6e13400640 1 -- 172.21.15.37:0/926568113 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e14028670 con 0x556be9a5b150 2024-08-20T05:09:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.664+0000 7f6e13400640 1 -- 172.21.15.37:0/926568113 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e14023070 con 0x556be9a5b150 2024-08-20T05:09:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.664+0000 7f6e13400640 1 -- 172.21.15.37:0/926568113 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e1401c670 con 0x556be9a5b150 2024-08-20T05:09:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.665+0000 7f6e301ed740 1 -- 172.21.15.37:0/926568113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 msgr2=0x556be9a7f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.665+0000 7f6e301ed740 1 --2- 172.21.15.37:0/926568113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 0x556be9a7f870 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x556be9a59ca0 tx=0x7f6e14014000 comp rx=0 tx=0).stop 2024-08-20T05:09:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.665+0000 7f6e301ed740 1 -- 172.21.15.37:0/926568113 shutdown_connections 2024-08-20T05:09:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.665+0000 7f6e301ed740 1 --2- 172.21.15.37:0/926568113 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a5ba70 0x556be9a61980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.665+0000 7f6e301ed740 1 --2- 172.21.15.37:0/926568113 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 0x556be9a7f870 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.665+0000 7f6e301ed740 1 --2- 172.21.15.37:0/926568113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a58f80 0x556be9a7f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.665+0000 7f6e301ed740 1 -- 172.21.15.37:0/926568113 >> 172.21.15.37:0/926568113 conn(0x556be9a669d0 msgr2=0x556be9a4f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:09.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.666+0000 7f6e301ed740 1 -- 172.21.15.37:0/926568113 shutdown_connections 2024-08-20T05:09:09.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.666+0000 7f6e301ed740 1 -- 172.21.15.37:0/926568113 wait complete. 2024-08-20T05:09:09.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.667+0000 7f6e301ed740 1 -- start start 2024-08-20T05:09:09.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.667+0000 7f6e301ed740 1 Processor -- start 2024-08-20T05:09:09.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.667+0000 7f6e301ed740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a58f80 0x556be9ada5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.667+0000 7f6e301ed740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 0x556be9adab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.667+0000 7f6e301ed740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a5ba70 0x556be9a6cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.667+0000 7f6e301ed740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281ae960 con 0x556be9a58f80 2024-08-20T05:09:09.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.667+0000 7f6e301ed740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281ae290 con 0x556be9a5ba70 2024-08-20T05:09:09.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.667+0000 7f6e301ed740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6e281ab4f0 con 0x556be9a5b150 2024-08-20T05:09:09.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.667+0000 7f6e301ed740 10 client.0 _ll_register_callbacks cb 0x7f6e20005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.668+0000 7f6e26000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 0x556be9adab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:09.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.668+0000 7f6e27400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a5ba70 0x556be9a6cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:09.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.668+0000 7f6e26a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a58f80 0x556be9ada5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:09.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.668+0000 7f6e27400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a5ba70 0x556be9a6cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53004/0 (socket says 172.21.15.37:53004) 2024-08-20T05:09:09.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.668+0000 7f6e27400640 1 -- 172.21.15.37:0/2726813964 learned_addr learned my addr 172.21.15.37:0/2726813964 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:09.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.668+0000 7f6e26000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 0x556be9adab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52868/0 (socket says 172.21.15.37:52868) 2024-08-20T05:09:09.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.668+0000 7f6e27400640 1 -- 172.21.15.37:0/2726813964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 msgr2=0x556be9adab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:09.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.668+0000 7f6e27400640 1 --2- 172.21.15.37:0/2726813964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 0x556be9adab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.668+0000 7f6e27400640 1 -- 172.21.15.37:0/2726813964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a58f80 msgr2=0x556be9ada5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:09.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.668+0000 7f6e27400640 1 --2- 172.21.15.37:0/2726813964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a58f80 0x556be9ada5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.668+0000 7f6e27400640 1 -- 172.21.15.37:0/2726813964 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556be9a6d750 con 0x556be9a5ba70 2024-08-20T05:09:09.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.668+0000 7f6e26a00640 1 --2- 172.21.15.37:0/2726813964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a58f80 0x556be9ada5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:09:09.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.669+0000 7f6e27400640 1 --2- 172.21.15.37:0/2726813964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a5ba70 0x556be9a6cf40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6e2002abe0 tx=0x7f6e200d4030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1727aad5fe101dc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:09.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.669+0000 7f6e10c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:09:09.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.669+0000 7f6e10c00640 1 -- 172.21.15.37:0/2726813964 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e200cac70 con 0x556be9a5ba70 2024-08-20T05:09:09.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.669+0000 7f6e10c00640 1 -- 172.21.15.37:0/2726813964 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6e20103030 con 0x556be9a5ba70 2024-08-20T05:09:09.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.669+0000 7f6e301ed740 1 -- 172.21.15.37:0/2726813964 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e14023070 con 0x556be9a5ba70 2024-08-20T05:09:09.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.669+0000 7f6e10c00640 1 -- 172.21.15.37:0/2726813964 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6e200ca620 con 0x556be9a5ba70 2024-08-20T05:09:09.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.669+0000 7f6e301ed740 10 client.27299 fetch_fsmap learned FSMap version 36 2024-08-20T05:09:09.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.669+0000 7f6e301ed740 1 -- 172.21.15.37:0/2726813964 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x556be9ae1e30 con 0x556be9a5ba70 2024-08-20T05:09:09.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.670+0000 7f6e10c00640 1 -- 172.21.15.37:0/2726813964 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e14023070 con 0x556be9a5ba70 2024-08-20T05:09:09.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.670+0000 7f6e10c00640 1 -- 172.21.15.37:0/2726813964 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f6e200c6ad0 con 0x556be9a5ba70 2024-08-20T05:09:09.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.670+0000 7f6e301ed740 10 client.27299 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:09:09.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.670+0000 7f6e301ed740 10 client.27299 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:09:09.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.670+0000 7f6e301ed740 20 client.27299 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:09.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.670+0000 7f6e301ed740 1 --2- 172.21.15.37:0/2726813964 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x556be9a67a00 0x556be9ae4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:09.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.670+0000 7f6e301ed740 4 client.27299 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:09:09.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.670+0000 7f6e301ed740 1 -- 172.21.15.37:0/2726813964 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556be99c3bd0 con 0x556be9a67a00 2024-08-20T05:09:09.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.670+0000 7f6e26a00640 1 --2- 172.21.15.37:0/2726813964 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x556be9a67a00 0x556be9ae4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.671+0000 7f6e26a00640 1 --2- 172.21.15.37:0/2726813964 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x556be9a67a00 0x556be9ae4490 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bb9a6d75c0a9d3bc server_cookie=ce09d7f1985c6424 in_seq=0 out_seq=0 2024-08-20T05:09:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.671+0000 7f6e10c00640 10 client.27299 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:09:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.671+0000 7f6e10c00640 1 -- 172.21.15.37:0/2726813964 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556be99c3bd0 con 0x556be9a67a00 2024-08-20T05:09:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.671+0000 7f6e10c00640 10 client.27299 handle_command_reply: tid=0 2024-08-20T05:09:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.671+0000 7f6e301ed740 1 client.27299 shutdown 2024-08-20T05:09:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.672+0000 7f6e301ed740 1 -- 172.21.15.37:0/2726813964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a5ba70 msgr2=0x556be9a6cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.672+0000 7f6e301ed740 1 --2- 172.21.15.37:0/2726813964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a5ba70 0x556be9a6cf40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f6e2002abe0 tx=0x7f6e200d4030 comp rx=0 tx=0).stop 2024-08-20T05:09:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.672+0000 7f6e301ed740 1 -- 172.21.15.37:0/2726813964 shutdown_connections 2024-08-20T05:09:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.672+0000 7f6e301ed740 1 --2- 172.21.15.37:0/2726813964 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x556be9a67a00 0x556be9ae4490 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.672+0000 7f6e301ed740 1 --2- 172.21.15.37:0/2726813964 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556be9a5ba70 0x556be9a6cf40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.672+0000 7f6e301ed740 1 --2- 172.21.15.37:0/2726813964 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556be9a5b150 0x556be9adab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.672+0000 7f6e301ed740 1 --2- 172.21.15.37:0/2726813964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556be9a58f80 0x556be9ada5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.672+0000 7f6e10c00640 0 client.27299 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:09:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.672+0000 7f6e301ed740 1 -- 172.21.15.37:0/2726813964 >> 172.21.15.37:0/2726813964 conn(0x556be9a669d0 msgr2=0x556be9a62ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:09.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.672+0000 7f6e301ed740 1 -- 172.21.15.37:0/2726813964 shutdown_connections 2024-08-20T05:09:09.676 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:09:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.672+0000 7f6e301ed740 1 -- 172.21.15.37:0/2726813964 wait complete. 2024-08-20T05:09:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.672+0000 7f6e301ed740 20 client.27299 trim_cache size 0 max 16384 2024-08-20T05:09:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.673+0000 7f6e2d800640 1 -- 172.21.15.37:0/2207780770 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6e0c0b3cd0 msgr2=0x7f6e0c0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.673+0000 7f6e2d800640 1 --2- 172.21.15.37:0/2207780770 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6e0c0b3cd0 0x7f6e0c0b6190 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f6e14009640 tx=0x7f6e140095d0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.673+0000 7f6e2d800640 1 -- 172.21.15.37:0/2207780770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e2810b040 msgr2=0x7f6e281a0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.673+0000 7f6e2d800640 1 --2- 172.21.15.37:0/2207780770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e2810b040 0x7f6e281a0a50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6e20009b30 tx=0x7f6e20003b80 comp rx=0 tx=0).stop 2024-08-20T05:09:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.674+0000 7f6e2d800640 1 -- 172.21.15.37:0/2207780770 shutdown_connections 2024-08-20T05:09:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.674+0000 7f6e2d800640 1 --2- 172.21.15.37:0/2207780770 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6e0c0b3cd0 0x7f6e0c0b6190 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.674+0000 7f6e2d800640 1 --2- 172.21.15.37:0/2207780770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6e2810b040 0x7f6e281a0a50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.674+0000 7f6e2d800640 1 --2- 172.21.15.37:0/2207780770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6e2810a6c0 0x7f6e2819b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.674+0000 7f6e2d800640 1 --2- 172.21.15.37:0/2207780770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e28104cb0 0x7f6e2819b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:09.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.674+0000 7f6e2d800640 1 -- 172.21.15.37:0/2207780770 >> 172.21.15.37:0/2207780770 conn(0x7f6e28100720 msgr2=0x7f6e28102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:09.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.674+0000 7f6e2d800640 1 -- 172.21.15.37:0/2207780770 shutdown_connections 2024-08-20T05:09:09.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:09.674+0000 7f6e2d800640 1 -- 172.21.15.37:0/2207780770 wait complete. 2024-08-20T05:09:09.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:09 smithi130 ceph-mon[22007]: pgmap v608: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.5 MiB/s wr, 328 op/s 2024-08-20T05:09:09.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:09 smithi135 ceph-mon[22342]: pgmap v608: 129 pgs: 129 active+clean; 1.2 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.5 MiB/s wr, 328 op/s 2024-08-20T05:09:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.120+0000 7f288da00640 1 -- 172.21.15.37:0/2660539754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28881035d0 msgr2=0x7f2888105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.120+0000 7f288da00640 1 --2- 172.21.15.37:0/2660539754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28881035d0 0x7f2888105a40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2874009900 tx=0x7f287402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.122 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.120+0000 7f288da00640 1 -- 172.21.15.37:0/2660539754 shutdown_connections 2024-08-20T05:09:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.120+0000 7f288da00640 1 --2- 172.21.15.37:0/2660539754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2888106180 0x7f2888106630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.120+0000 7f288da00640 1 --2- 172.21.15.37:0/2660539754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28881035d0 0x7f2888105a40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.120+0000 7f288da00640 1 --2- 172.21.15.37:0/2660539754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f288806bcb0 0x7f2888103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.120+0000 7f288da00640 1 -- 172.21.15.37:0/2660539754 >> 172.21.15.37:0/2660539754 conn(0x7f28880fce60 msgr2=0x7f28880ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.120+0000 7f288da00640 1 -- 172.21.15.37:0/2660539754 shutdown_connections 2024-08-20T05:09:11.123 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.120+0000 7f288da00640 1 -- 172.21.15.37:0/2660539754 wait complete. 2024-08-20T05:09:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.121+0000 7f288da00640 1 Processor -- start 2024-08-20T05:09:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.121+0000 7f288da00640 1 -- start start 2024-08-20T05:09:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.122+0000 7f288da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f288806bcb0 0x7f288819f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.122+0000 7f288da00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28881035d0 0x7f288819f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.122+0000 7f288da00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2888106180 0x7f28881a0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.122+0000 7f288da00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2888114910 con 0x7f288806bcb0 2024-08-20T05:09:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.122+0000 7f288da00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2888114790 con 0x7f28881035d0 2024-08-20T05:09:11.124 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.122+0000 7f288da00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2888114a90 con 0x7f2888106180 2024-08-20T05:09:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.122+0000 7f2886000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28881035d0 0x7f288819f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.122+0000 7f2886000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28881035d0 0x7f288819f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53020/0 (socket says 172.21.15.37:53020) 2024-08-20T05:09:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.122+0000 7f2886000640 1 -- 172.21.15.37:0/2937855637 learned_addr learned my addr 172.21.15.37:0/2937855637 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.122+0000 7f2887400640 1 --2- 172.21.15.37:0/2937855637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2888106180 0x7f28881a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.123+0000 7f2886a00640 1 --2- 172.21.15.37:0/2937855637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f288806bcb0 0x7f288819f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:11.125 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.123+0000 7f2886000640 1 -- 172.21.15.37:0/2937855637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2888106180 msgr2=0x7f28881a0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.123+0000 7f2886000640 1 --2- 172.21.15.37:0/2937855637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2888106180 0x7f28881a0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.123+0000 7f2886000640 1 -- 172.21.15.37:0/2937855637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f288806bcb0 msgr2=0x7f288819f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.123+0000 7f2886000640 1 --2- 172.21.15.37:0/2937855637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f288806bcb0 0x7f288819f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.123+0000 7f2886000640 1 -- 172.21.15.37:0/2937855637 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28881a0c00 con 0x7f28881035d0 2024-08-20T05:09:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.123+0000 7f2886000640 1 --2- 172.21.15.37:0/2937855637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28881035d0 0x7f288819f710 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2874005ab0 tx=0x7f2874003cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:11.126 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.124+0000 7f287f400640 1 -- 172.21.15.37:0/2937855637 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f287403f070 con 0x7f28881035d0 2024-08-20T05:09:11.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.124+0000 7f287f400640 1 -- 172.21.15.37:0/2937855637 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f287403b460 con 0x7f28881035d0 2024-08-20T05:09:11.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.124+0000 7f287f400640 1 -- 172.21.15.37:0/2937855637 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2874035030 con 0x7f28881035d0 2024-08-20T05:09:11.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.124+0000 7f288da00640 1 -- 172.21.15.37:0/2937855637 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28881a0e90 con 0x7f28881035d0 2024-08-20T05:09:11.127 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.124+0000 7f288da00640 1 -- 172.21.15.37:0/2937855637 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28881a73e0 con 0x7f28881035d0 2024-08-20T05:09:11.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.128+0000 7f2890a0f740 1 Processor -- start 2024-08-20T05:09:11.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.128+0000 7f2890a0f740 1 -- start start 2024-08-20T05:09:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.129+0000 7f2890a0f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 0x55cd2d6716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.129+0000 7f2890a0f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d671be0 0x55cd2d673fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.129+0000 7f2890a0f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d674620 0x55cd2d676ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.129+0000 7f2890a0f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d5e2210 con 0x55cd2d674620 2024-08-20T05:09:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.129+0000 7f2890a0f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d5d1710 con 0x55cd2d66f2b0 2024-08-20T05:09:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.129+0000 7f2890a0f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d5d5750 con 0x55cd2d671be0 2024-08-20T05:09:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.129+0000 7f287f400640 1 -- 172.21.15.37:0/2937855637 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2874042070 con 0x7f28881035d0 2024-08-20T05:09:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.129+0000 7f2887400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 0x55cd2d6716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:11.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.129+0000 7f2887400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 0x55cd2d6716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53036/0 (socket says 172.21.15.37:53036) 2024-08-20T05:09:11.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.129+0000 7f2887400640 1 -- 172.21.15.37:0/484856726 learned_addr learned my addr 172.21.15.37:0/484856726 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.130+0000 7f2886a00640 1 --2- 172.21.15.37:0/484856726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d671be0 0x55cd2d673fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.130+0000 7f2886000640 1 --2- 172.21.15.37:0/484856726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d674620 0x55cd2d676ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.130+0000 7f2887400640 1 -- 172.21.15.37:0/484856726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d671be0 msgr2=0x55cd2d673fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.130+0000 7f2887400640 1 --2- 172.21.15.37:0/484856726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d671be0 0x55cd2d673fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.130+0000 7f2887400640 1 -- 172.21.15.37:0/484856726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d674620 msgr2=0x55cd2d676ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.130+0000 7f2887400640 1 --2- 172.21.15.37:0/484856726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d674620 0x55cd2d676ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.130+0000 7f2887400640 1 -- 172.21.15.37:0/484856726 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd2d59dde0 con 0x55cd2d66f2b0 2024-08-20T05:09:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.130+0000 7f2886000640 1 --2- 172.21.15.37:0/484856726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d674620 0x55cd2d676ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:09:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.131+0000 7f2887400640 1 --2- 172.21.15.37:0/484856726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 0x55cd2d6716a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2880009fc0 tx=0x7f2880010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd82a557a263a99d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.131+0000 7f2873e00640 1 -- 172.21.15.37:0/484856726 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2880016070 con 0x55cd2d66f2b0 2024-08-20T05:09:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.131+0000 7f2873e00640 1 -- 172.21.15.37:0/484856726 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2880004d20 con 0x55cd2d66f2b0 2024-08-20T05:09:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.131+0000 7f2873e00640 1 -- 172.21.15.37:0/484856726 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28800053e0 con 0x55cd2d66f2b0 2024-08-20T05:09:11.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.131+0000 7f287f400640 1 --2- 172.21.15.37:0/2937855637 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f286c0b3c50 0x7f286c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.132+0000 7f287f400640 1 -- 172.21.15.37:0/2937855637 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2874104840 con 0x7f28881035d0 2024-08-20T05:09:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.132+0000 7f2886a00640 1 --2- 172.21.15.37:0/2937855637 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f286c0b3c50 0x7f286c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.132+0000 7f2890a0f740 1 -- 172.21.15.37:0/484856726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 msgr2=0x55cd2d6716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.132+0000 7f2890a0f740 1 --2- 172.21.15.37:0/484856726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 0x55cd2d6716a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2880009fc0 tx=0x7f2880010800 comp rx=0 tx=0).stop 2024-08-20T05:09:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.132+0000 7f2890a0f740 1 -- 172.21.15.37:0/484856726 shutdown_connections 2024-08-20T05:09:11.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.132+0000 7f2890a0f740 1 --2- 172.21.15.37:0/484856726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d674620 0x55cd2d676ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.132+0000 7f2890a0f740 1 --2- 172.21.15.37:0/484856726 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d671be0 0x55cd2d673fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.132+0000 7f2890a0f740 1 --2- 172.21.15.37:0/484856726 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 0x55cd2d6716a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.132+0000 7f2890a0f740 1 -- 172.21.15.37:0/484856726 >> 172.21.15.37:0/484856726 conn(0x55cd2d66a3b0 msgr2=0x55cd2d66b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.133+0000 7f2890a0f740 1 -- 172.21.15.37:0/484856726 shutdown_connections 2024-08-20T05:09:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.133+0000 7f2886a00640 1 --2- 172.21.15.37:0/2937855637 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f286c0b3c50 0x7f286c0b6110 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2878005fd0 tx=0x7f2878005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:11.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.134+0000 7f2890a0f740 1 -- 172.21.15.37:0/484856726 wait complete. 2024-08-20T05:09:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.135+0000 7f2890a0f740 1 -- start start 2024-08-20T05:09:11.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.135+0000 7f2890a0f740 1 Processor -- start 2024-08-20T05:09:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.136+0000 7f2890a0f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d66f2b0 0x55cd2d678d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.136+0000 7f2890a0f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d671be0 0x55cd2d679410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.136+0000 7f2890a0f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d674620 0x55cd2d679fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.136+0000 7f2886000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d671be0 0x55cd2d679410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:11.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.136+0000 7f2886a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d66f2b0 0x55cd2d678d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:11.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.136+0000 7f2890a0f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d50aab0 con 0x55cd2d674620 2024-08-20T05:09:11.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.136+0000 7f2886000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d671be0 0x55cd2d679410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53046/0 (socket says 172.21.15.37:53046) 2024-08-20T05:09:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.136+0000 7f2890a0f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d578140 con 0x55cd2d671be0 2024-08-20T05:09:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.136+0000 7f2890a0f740 1 -- 172.21.15.37:0/4106103893 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cd2d677600 con 0x55cd2d66f2b0 2024-08-20T05:09:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.136+0000 7f2886000640 1 -- 172.21.15.37:0/4106103893 learned_addr learned my addr 172.21.15.37:0/4106103893 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.136+0000 7f2890a0f740 10 client.0 _ll_register_callbacks cb 0x55cd2d58b5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.137+0000 7f2887400640 1 --2- 172.21.15.37:0/4106103893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d674620 0x55cd2d679fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.137+0000 7f2886000640 1 -- 172.21.15.37:0/4106103893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d66f2b0 msgr2=0x55cd2d678d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.137+0000 7f2886000640 1 --2- 172.21.15.37:0/4106103893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d66f2b0 0x55cd2d678d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.137+0000 7f2886000640 1 -- 172.21.15.37:0/4106103893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d674620 msgr2=0x55cd2d679fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.137+0000 7f2886000640 1 --2- 172.21.15.37:0/4106103893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d674620 0x55cd2d679fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.137+0000 7f2886000640 1 -- 172.21.15.37:0/4106103893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd2d579170 con 0x55cd2d671be0 2024-08-20T05:09:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.137+0000 7f2886000640 1 --2- 172.21.15.37:0/4106103893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d671be0 0x55cd2d679410 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2874101f40 tx=0x7f28740cab00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd10a8decd3e504c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:11.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.137+0000 7f2870c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:09:11.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.137+0000 7f2870c00640 1 -- 172.21.15.37:0/4106103893 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2874049070 con 0x55cd2d671be0 2024-08-20T05:09:11.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.137+0000 7f2870c00640 1 -- 172.21.15.37:0/4106103893 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f287403b910 con 0x55cd2d671be0 2024-08-20T05:09:11.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.137+0000 7f2890a0f740 1 -- 172.21.15.37:0/4106103893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cd2d5a8a30 con 0x55cd2d671be0 2024-08-20T05:09:11.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.138+0000 7f2870c00640 1 -- 172.21.15.37:0/4106103893 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f28740cb390 con 0x55cd2d671be0 2024-08-20T05:09:11.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.139+0000 7f2890a0f740 10 client.27311 fetch_fsmap learned FSMap version 36 2024-08-20T05:09:11.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.139+0000 7f2890a0f740 1 -- 172.21.15.37:0/4106103893 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55cd2d334790 con 0x55cd2d671be0 2024-08-20T05:09:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.139+0000 7f2870c00640 1 -- 172.21.15.37:0/4106103893 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55cd2d5a8a30 con 0x55cd2d671be0 2024-08-20T05:09:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.140+0000 7f2870c00640 1 -- 172.21.15.37:0/4106103893 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f28740c6d00 con 0x55cd2d671be0 2024-08-20T05:09:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.140+0000 7f2890a0f740 10 client.27311 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:09:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.140+0000 7f2890a0f740 10 client.27311 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:09:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.140+0000 7f2890a0f740 20 client.27311 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:11.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.140+0000 7f2890a0f740 1 --2- 172.21.15.37:0/4106103893 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55cd2d684970 0x55cd2d686dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.140+0000 7f2890a0f740 4 client.27311 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:09:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.140+0000 7f2890a0f740 1 -- 172.21.15.37:0/4106103893 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cd2d5e4160 con 0x55cd2d684970 2024-08-20T05:09:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.141+0000 7f2886a00640 1 --2- 172.21.15.37:0/4106103893 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55cd2d684970 0x55cd2d686dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.141+0000 7f2886a00640 1 --2- 172.21.15.37:0/4106103893 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55cd2d684970 0x55cd2d686dd0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12c8dd55b75351c8 server_cookie=4e6e6222a8215c85 in_seq=0 out_seq=0 2024-08-20T05:09:11.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.141+0000 7f2870c00640 10 client.27311 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.142+0000 7f2870c00640 1 -- 172.21.15.37:0/4106103893 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cd2d5e4160 con 0x55cd2d684970 2024-08-20T05:09:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.142+0000 7f2870c00640 10 client.27311 handle_command_reply: tid=0 2024-08-20T05:09:11.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.142+0000 7f2890a0f740 1 client.27311 shutdown 2024-08-20T05:09:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.143+0000 7f2890a0f740 1 -- 172.21.15.37:0/4106103893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d671be0 msgr2=0x55cd2d679410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.143+0000 7f2890a0f740 1 --2- 172.21.15.37:0/4106103893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d671be0 0x55cd2d679410 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2874101f40 tx=0x7f28740cab00 comp rx=0 tx=0).stop 2024-08-20T05:09:11.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.143+0000 7f2890a0f740 1 -- 172.21.15.37:0/4106103893 shutdown_connections 2024-08-20T05:09:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.143+0000 7f2890a0f740 1 --2- 172.21.15.37:0/4106103893 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55cd2d684970 0x55cd2d686dd0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.143+0000 7f2890a0f740 1 --2- 172.21.15.37:0/4106103893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d674620 0x55cd2d679fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.143+0000 7f2890a0f740 1 --2- 172.21.15.37:0/4106103893 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d671be0 0x55cd2d679410 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.143+0000 7f2890a0f740 1 --2- 172.21.15.37:0/4106103893 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d66f2b0 0x55cd2d678d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.143+0000 7f2890a0f740 1 -- 172.21.15.37:0/4106103893 >> 172.21.15.37:0/4106103893 conn(0x55cd2d66a3b0 msgr2=0x55cd2d6694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.143+0000 7f2870c00640 0 client.27311 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.143+0000 7f2890a0f740 1 -- 172.21.15.37:0/4106103893 shutdown_connections 2024-08-20T05:09:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.143+0000 7f2890a0f740 1 -- 172.21.15.37:0/4106103893 wait complete. 2024-08-20T05:09:11.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.143+0000 7f2890a0f740 20 client.27311 trim_cache size 0 max 16384 2024-08-20T05:09:11.148 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T05:09:11.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.173+0000 7f2890a0f740 1 Processor -- start 2024-08-20T05:09:11.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.173+0000 7f2890a0f740 1 -- start start 2024-08-20T05:09:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.174+0000 7f2890a0f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 0x55cd2d66b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.174+0000 7f2890a0f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d671be0 0x55cd2d674a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.174+0000 7f2890a0f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d674620 0x55cd2d674f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.174+0000 7f2890a0f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f28881b1a30 con 0x55cd2d671be0 2024-08-20T05:09:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.174+0000 7f2890a0f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f28881b3570 con 0x55cd2d66f2b0 2024-08-20T05:09:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.174+0000 7f2890a0f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f28881b2100 con 0x55cd2d674620 2024-08-20T05:09:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.176+0000 7f2886a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 0x55cd2d66b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.176+0000 7f2886a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 0x55cd2d66b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53048/0 (socket says 172.21.15.37:53048) 2024-08-20T05:09:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.176+0000 7f2886a00640 1 -- 172.21.15.37:0/2129665251 learned_addr learned my addr 172.21.15.37:0/2129665251 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.176+0000 7f2887400640 1 --2- 172.21.15.37:0/2129665251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d674620 0x55cd2d674f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.177+0000 7f2887400640 1 -- 172.21.15.37:0/2129665251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 msgr2=0x55cd2d66b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.177+0000 7f2887400640 1 --2- 172.21.15.37:0/2129665251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 0x55cd2d66b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.177+0000 7f2887400640 1 -- 172.21.15.37:0/2129665251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d671be0 msgr2=0x55cd2d674a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.177+0000 7f2887400640 1 --2- 172.21.15.37:0/2129665251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d671be0 0x55cd2d674a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.177+0000 7f2887400640 1 -- 172.21.15.37:0/2129665251 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd2d3ad620 con 0x55cd2d674620 2024-08-20T05:09:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.181+0000 7f2887400640 1 --2- 172.21.15.37:0/2129665251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d674620 0x55cd2d674f40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x55cd2d6771a0 tx=0x7f2880009ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=612d42e44051add4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.183+0000 7f2873400640 1 -- 172.21.15.37:0/2129665251 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2880016050 con 0x55cd2d674620 2024-08-20T05:09:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.183+0000 7f2873400640 1 -- 172.21.15.37:0/2129665251 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2880003bf0 con 0x55cd2d674620 2024-08-20T05:09:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.183+0000 7f2873400640 1 -- 172.21.15.37:0/2129665251 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2880005360 con 0x55cd2d674620 2024-08-20T05:09:11.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.185+0000 7f2890a0f740 1 -- 172.21.15.37:0/2129665251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d674620 msgr2=0x55cd2d674f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:11.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.185+0000 7f2890a0f740 1 --2- 172.21.15.37:0/2129665251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d674620 0x55cd2d674f40 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x55cd2d6771a0 tx=0x7f2880009ce0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.186+0000 7f2890a0f740 1 -- 172.21.15.37:0/2129665251 shutdown_connections 2024-08-20T05:09:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.186+0000 7f2890a0f740 1 --2- 172.21.15.37:0/2129665251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d674620 0x55cd2d674f40 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.186+0000 7f2890a0f740 1 --2- 172.21.15.37:0/2129665251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d671be0 0x55cd2d674a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.186+0000 7f2890a0f740 1 --2- 172.21.15.37:0/2129665251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 0x55cd2d66b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.186+0000 7f2890a0f740 1 -- 172.21.15.37:0/2129665251 >> 172.21.15.37:0/2129665251 conn(0x55cd2d66a3b0 msgr2=0x55cd2d66ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.187+0000 7f2890a0f740 1 -- 172.21.15.37:0/2129665251 shutdown_connections 2024-08-20T05:09:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.188+0000 7f2890a0f740 1 -- 172.21.15.37:0/2129665251 wait complete. 2024-08-20T05:09:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.188+0000 7f2890a0f740 1 -- start start 2024-08-20T05:09:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.188+0000 7f2890a0f740 1 Processor -- start 2024-08-20T05:09:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.189+0000 7f2890a0f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 0x55cd2d67d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.189+0000 7f2890a0f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d671be0 0x55cd2d67e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.189+0000 7f2890a0f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d674620 0x55cd2d67ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.189+0000 7f2890a0f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f28881b2ea0 con 0x55cd2d674620 2024-08-20T05:09:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.189+0000 7f2890a0f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f28881b27d0 con 0x55cd2d66f2b0 2024-08-20T05:09:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.189+0000 7f2890a0f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f28881afa10 con 0x55cd2d671be0 2024-08-20T05:09:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.189+0000 7f2890a0f740 10 client.0 _ll_register_callbacks cb 0x7f2874009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.189+0000 7f2886a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 0x55cd2d67d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.189+0000 7f2886a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 0x55cd2d67d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53050/0 (socket says 172.21.15.37:53050) 2024-08-20T05:09:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.189+0000 7f2886a00640 1 -- 172.21.15.37:0/3518030618 learned_addr learned my addr 172.21.15.37:0/3518030618 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.190+0000 7f2886000640 1 --2- 172.21.15.37:0/3518030618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d671be0 0x55cd2d67e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.190+0000 7f2886000640 1 -- 172.21.15.37:0/3518030618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 msgr2=0x55cd2d67d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.190+0000 7f2886000640 1 --2- 172.21.15.37:0/3518030618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 0x55cd2d67d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.190+0000 7f2886000640 1 -- 172.21.15.37:0/3518030618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d674620 msgr2=0x55cd2d67ec10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:09:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.190+0000 7f2886000640 1 --2- 172.21.15.37:0/3518030618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d674620 0x55cd2d67ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.190+0000 7f2886000640 1 -- 172.21.15.37:0/3518030618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd2d67f440 con 0x55cd2d671be0 2024-08-20T05:09:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.191+0000 7f2886000640 1 --2- 172.21.15.37:0/3518030618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d671be0 0x55cd2d67e090 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f28740c70f0 tx=0x7f28740d41c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b714ba55875a6633 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.191+0000 7f2870c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:09:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.191+0000 7f2870c00640 1 -- 172.21.15.37:0/3518030618 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2874049070 con 0x55cd2d671be0 2024-08-20T05:09:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.191+0000 7f2870c00640 1 -- 172.21.15.37:0/3518030618 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f28740c7980 con 0x55cd2d671be0 2024-08-20T05:09:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.193+0000 7f2890a0f740 1 -- 172.21.15.37:0/3518030618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2880003bf0 con 0x55cd2d671be0 2024-08-20T05:09:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.194+0000 7f2870c00640 1 -- 172.21.15.37:0/3518030618 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f28740cb160 con 0x55cd2d671be0 2024-08-20T05:09:11.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.195+0000 7f2890a0f740 10 client.27337 fetch_fsmap learned FSMap version 36 2024-08-20T05:09:11.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.195+0000 7f2890a0f740 1 -- 172.21.15.37:0/3518030618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55cd2d67f440 con 0x55cd2d671be0 2024-08-20T05:09:11.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.196+0000 7f2870c00640 1 -- 172.21.15.37:0/3518030618 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2880003bf0 con 0x55cd2d671be0 2024-08-20T05:09:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.196+0000 7f2870c00640 1 -- 172.21.15.37:0/3518030618 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7f28740ca060 con 0x55cd2d671be0 2024-08-20T05:09:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.197+0000 7f2890a0f740 10 client.27337 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:09:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.197+0000 7f2890a0f740 10 client.27337 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:09:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.197+0000 7f2890a0f740 20 client.27337 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.197+0000 7f2890a0f740 1 --2- 172.21.15.37:0/3518030618 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55cd2d680e00 0x55cd2d6f1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.197+0000 7f2890a0f740 4 client.27337 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:09:11.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.197+0000 7f2890a0f740 1 -- 172.21.15.37:0/3518030618 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cd2d5dfc00 con 0x55cd2d680e00 2024-08-20T05:09:11.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.198+0000 7f2886a00640 1 --2- 172.21.15.37:0/3518030618 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55cd2d680e00 0x55cd2d6f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:11.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.202+0000 7f2886a00640 1 --2- 172.21.15.37:0/3518030618 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55cd2d680e00 0x55cd2d6f1680 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4012f41b3865a920 server_cookie=60fb88dcbfc010f6 in_seq=0 out_seq=0 2024-08-20T05:09:11.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.204+0000 7f2870c00640 10 client.27337 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:11.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.366+0000 7f2870c00640 1 -- 172.21.15.37:0/3518030618 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cd2d5dfc00 con 0x55cd2d680e00 2024-08-20T05:09:11.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.366+0000 7f2870c00640 10 client.27337 handle_command_reply: tid=0 2024-08-20T05:09:11.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.366+0000 7f2890a0f740 1 client.27337 shutdown 2024-08-20T05:09:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.369+0000 7f2890a0f740 1 -- 172.21.15.37:0/3518030618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d671be0 msgr2=0x55cd2d67e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.369+0000 7f2890a0f740 1 --2- 172.21.15.37:0/3518030618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d671be0 0x55cd2d67e090 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f28740c70f0 tx=0x7f28740d41c0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.369+0000 7f2890a0f740 1 -- 172.21.15.37:0/3518030618 shutdown_connections 2024-08-20T05:09:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.369+0000 7f2890a0f740 1 --2- 172.21.15.37:0/3518030618 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55cd2d680e00 0x55cd2d6f1680 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.370+0000 7f2870c00640 0 client.27337 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.370+0000 7f2890a0f740 1 --2- 172.21.15.37:0/3518030618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd2d674620 0x55cd2d67ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.370+0000 7f2890a0f740 1 --2- 172.21.15.37:0/3518030618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cd2d671be0 0x55cd2d67e090 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.370+0000 7f2890a0f740 1 --2- 172.21.15.37:0/3518030618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cd2d66f2b0 0x55cd2d67d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.370+0000 7f2890a0f740 1 -- 172.21.15.37:0/3518030618 >> 172.21.15.37:0/3518030618 conn(0x55cd2d66a3b0 msgr2=0x55cd2d668cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.370+0000 7f2890a0f740 1 -- 172.21.15.37:0/3518030618 shutdown_connections 2024-08-20T05:09:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.370+0000 7f2890a0f740 1 -- 172.21.15.37:0/3518030618 wait complete. 2024-08-20T05:09:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.371+0000 7f2890a0f740 20 client.27337 trim_cache size 0 max 16384 2024-08-20T05:09:11.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:09:11.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:09:11.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:09:11.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:09:11.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.376+0000 7f288da00640 1 -- 172.21.15.37:0/2937855637 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f286c0b3c50 msgr2=0x7f286c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.376+0000 7f288da00640 1 --2- 172.21.15.37:0/2937855637 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f286c0b3c50 0x7f286c0b6110 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2878005fd0 tx=0x7f2878005850 comp rx=0 tx=0).stop 2024-08-20T05:09:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.376+0000 7f288da00640 1 -- 172.21.15.37:0/2937855637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28881035d0 msgr2=0x7f288819f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.376+0000 7f288da00640 1 --2- 172.21.15.37:0/2937855637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28881035d0 0x7f288819f710 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2874005ab0 tx=0x7f2874003cd0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.376+0000 7f288da00640 1 -- 172.21.15.37:0/2937855637 shutdown_connections 2024-08-20T05:09:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.376+0000 7f288da00640 1 --2- 172.21.15.37:0/2937855637 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f286c0b3c50 0x7f286c0b6110 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.376+0000 7f288da00640 1 --2- 172.21.15.37:0/2937855637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2888106180 0x7f28881a0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.376+0000 7f288da00640 1 --2- 172.21.15.37:0/2937855637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f28881035d0 0x7f288819f710 secure :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f2874005ab0 tx=0x7f2874003cd0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.376+0000 7f288da00640 1 --2- 172.21.15.37:0/2937855637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f288806bcb0 0x7f288819f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:11.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.376+0000 7f288da00640 1 -- 172.21.15.37:0/2937855637 >> 172.21.15.37:0/2937855637 conn(0x7f28880fce60 msgr2=0x7f28881018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:11.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.377+0000 7f288da00640 1 -- 172.21.15.37:0/2937855637 shutdown_connections 2024-08-20T05:09:11.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:11.377+0000 7f288da00640 1 -- 172.21.15.37:0/2937855637 wait complete. 2024-08-20T05:09:11.382 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:11 smithi037 ceph-mon[17265]: pgmap v609: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 460 op/s 2024-08-20T05:09:11.667 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:11 smithi135 ceph-mon[22342]: pgmap v609: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 460 op/s 2024-08-20T05:09:11.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:11 smithi130 ceph-mon[22007]: pgmap v609: 129 pgs: 129 active+clean; 1.2 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 460 op/s 2024-08-20T05:09:11.926 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:09:12.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.882+0000 7efe19400640 1 -- 172.21.15.37:0/3037142511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe14075210 msgr2=0x7efe140755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.882+0000 7efe19400640 1 --2- 172.21.15.37:0/3037142511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe14075210 0x7efe140755f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efe04009900 tx=0x7efe0402a410 comp rx=0 tx=0).stop 2024-08-20T05:09:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.883+0000 7efe19400640 1 -- 172.21.15.37:0/3037142511 shutdown_connections 2024-08-20T05:09:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.883+0000 7efe19400640 1 --2- 172.21.15.37:0/3037142511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1410ef10 0x7efe14111300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.883+0000 7efe19400640 1 --2- 172.21.15.37:0/3037142511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe14075b30 0x7efe1410e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.883+0000 7efe19400640 1 --2- 172.21.15.37:0/3037142511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe14075210 0x7efe140755f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.883+0000 7efe19400640 1 -- 172.21.15.37:0/3037142511 >> 172.21.15.37:0/3037142511 conn(0x7efe140fe350 msgr2=0x7efe14100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.883+0000 7efe19400640 1 -- 172.21.15.37:0/3037142511 shutdown_connections 2024-08-20T05:09:12.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.883+0000 7efe19400640 1 -- 172.21.15.37:0/3037142511 wait complete. 2024-08-20T05:09:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.884+0000 7efe19400640 1 Processor -- start 2024-08-20T05:09:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.885+0000 7efe19400640 1 -- start start 2024-08-20T05:09:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.885+0000 7efe19400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe14075210 0x7efe14102680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.885+0000 7efe19400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe14075b30 0x7efe14102bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.885+0000 7efe19400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe1410ef10 0x7efe14103100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.885+0000 7efe19400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe14114b40 con 0x7efe14075b30 2024-08-20T05:09:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.885+0000 7efe19400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efe141149c0 con 0x7efe14075210 2024-08-20T05:09:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.885+0000 7efe19400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efe14114cc0 con 0x7efe1410ef10 2024-08-20T05:09:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.885+0000 7efe13e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe14075210 0x7efe14102680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.885+0000 7efe13e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe14075210 0x7efe14102680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44280/0 (socket says 172.21.15.37:44280) 2024-08-20T05:09:12.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.885+0000 7efe13e00640 1 -- 172.21.15.37:0/1045184795 learned_addr learned my addr 172.21.15.37:0/1045184795 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.885+0000 7efe13400640 1 --2- 172.21.15.37:0/1045184795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe14075b30 0x7efe14102bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.886+0000 7efe13e00640 1 -- 172.21.15.37:0/1045184795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe1410ef10 msgr2=0x7efe14103100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T05:09:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.886+0000 7efe13e00640 1 --2- 172.21.15.37:0/1045184795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe1410ef10 0x7efe14103100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.886+0000 7efe13e00640 1 -- 172.21.15.37:0/1045184795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe14075b30 msgr2=0x7efe14102bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.886+0000 7efe13e00640 1 --2- 172.21.15.37:0/1045184795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe14075b30 0x7efe14102bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.886+0000 7efe13e00640 1 -- 172.21.15.37:0/1045184795 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe141ab520 con 0x7efe14075210 2024-08-20T05:09:12.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.886+0000 7efe13400640 1 --2- 172.21.15.37:0/1045184795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe14075b30 0x7efe14102bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:09:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.886+0000 7efe13e00640 1 --2- 172.21.15.37:0/1045184795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe14075210 0x7efe14102680 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7efe04005ab0 tx=0x7efe04003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.887+0000 7efe10c00640 1 -- 172.21.15.37:0/1045184795 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0403f070 con 0x7efe14075210 2024-08-20T05:09:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.887+0000 7efe19400640 1 -- 172.21.15.37:0/1045184795 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe141ab7b0 con 0x7efe14075210 2024-08-20T05:09:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.887+0000 7efe10c00640 1 -- 172.21.15.37:0/1045184795 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe04031d60 con 0x7efe14075210 2024-08-20T05:09:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.887+0000 7efe10c00640 1 -- 172.21.15.37:0/1045184795 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe04035030 con 0x7efe14075210 2024-08-20T05:09:12.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.887+0000 7efe19400640 1 -- 172.21.15.37:0/1045184795 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe141abce0 con 0x7efe14075210 2024-08-20T05:09:12.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.891+0000 7efe1d5be740 1 Processor -- start 2024-08-20T05:09:12.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.892+0000 7efe1d5be740 1 -- start start 2024-08-20T05:09:12.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.892+0000 7efe1d5be740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 0x5586c22cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.892+0000 7efe1d5be740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22ce3e0 0x5586c22d9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.892+0000 7efe1d5be740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22da370 0x5586c22dc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.892+0000 7efe1d5be740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5586c2243aa0 con 0x5586c22cdac0 2024-08-20T05:09:12.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.892+0000 7efe1d5be740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5586c2232fa0 con 0x5586c22da370 2024-08-20T05:09:12.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.892+0000 7efe1d5be740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5586c2236fe0 con 0x5586c22ce3e0 2024-08-20T05:09:12.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.893+0000 7efe18a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 0x5586c22cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:12.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.893+0000 7efe13400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22da370 0x5586c22dc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:12.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.893+0000 7efe18a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 0x5586c22cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57992/0 (socket says 172.21.15.37:57992) 2024-08-20T05:09:12.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.893+0000 7efe18a00640 1 -- 172.21.15.37:0/4215967870 learned_addr learned my addr 172.21.15.37:0/4215967870 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:12.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.893+0000 7efe10c00640 1 -- 172.21.15.37:0/1045184795 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7efe04042070 con 0x7efe14075210 2024-08-20T05:09:12.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.893+0000 7efe18a00640 1 -- 172.21.15.37:0/4215967870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22ce3e0 msgr2=0x5586c22d9e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:09:12.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.893+0000 7efe18a00640 1 --2- 172.21.15.37:0/4215967870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22ce3e0 0x5586c22d9e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.893+0000 7efe18a00640 1 -- 172.21.15.37:0/4215967870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22da370 msgr2=0x5586c22dc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:12.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.893+0000 7efe18a00640 1 --2- 172.21.15.37:0/4215967870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22da370 0x5586c22dc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.893+0000 7efe18a00640 1 -- 172.21.15.37:0/4215967870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586c21d9420 con 0x5586c22cdac0 2024-08-20T05:09:12.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.894+0000 7efe18a00640 1 --2- 172.21.15.37:0/4215967870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 0x5586c22cdea0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009e20 tx=0x7efe0c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3794628500af1c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:12.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.894+0000 7efe09200640 1 -- 172.21.15.37:0/4215967870 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c010630 con 0x5586c22cdac0 2024-08-20T05:09:12.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.894+0000 7efe09200640 1 -- 172.21.15.37:0/4215967870 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe0c00ee70 con 0x5586c22cdac0 2024-08-20T05:09:12.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.894+0000 7efe09200640 1 -- 172.21.15.37:0/4215967870 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c017c50 con 0x5586c22cdac0 2024-08-20T05:09:12.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.895+0000 7efe1d5be740 1 -- 172.21.15.37:0/4215967870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 msgr2=0x5586c22cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:12.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.895+0000 7efe1d5be740 1 --2- 172.21.15.37:0/4215967870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 0x5586c22cdea0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009e20 tx=0x7efe0c00e720 comp rx=0 tx=0).stop 2024-08-20T05:09:12.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.895+0000 7efe1d5be740 1 -- 172.21.15.37:0/4215967870 shutdown_connections 2024-08-20T05:09:12.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.895+0000 7efe1d5be740 1 --2- 172.21.15.37:0/4215967870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22da370 0x5586c22dc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.895+0000 7efe1d5be740 1 --2- 172.21.15.37:0/4215967870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22ce3e0 0x5586c22d9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.895+0000 7efe1d5be740 1 --2- 172.21.15.37:0/4215967870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 0x5586c22cdea0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.895+0000 7efe1d5be740 1 -- 172.21.15.37:0/4215967870 >> 172.21.15.37:0/4215967870 conn(0x5586c22cb8f0 msgr2=0x5586c22cca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:12.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.896+0000 7efe10c00640 1 --2- 172.21.15.37:0/1045184795 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdf80b3d70 0x7efdf80b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.896+0000 7efe1d5be740 1 -- 172.21.15.37:0/4215967870 shutdown_connections 2024-08-20T05:09:12.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.896+0000 7efe10c00640 1 -- 172.21.15.37:0/1045184795 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7efe04104830 con 0x7efe14075210 2024-08-20T05:09:12.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.896+0000 7efe1d5be740 1 -- 172.21.15.37:0/4215967870 wait complete. 2024-08-20T05:09:12.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.896+0000 7efe13400640 1 --2- 172.21.15.37:0/1045184795 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdf80b3d70 0x7efdf80b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:12.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.897+0000 7efe1d5be740 1 -- start start 2024-08-20T05:09:12.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.897+0000 7efe1d5be740 1 Processor -- start 2024-08-20T05:09:12.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.898+0000 7efe1d5be740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22cdac0 0x5586c22d9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.898+0000 7efe13400640 1 --2- 172.21.15.37:0/1045184795 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdf80b3d70 0x7efdf80b6230 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efe00005fd0 tx=0x7efe0000b5a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:12.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.898+0000 7efe1d5be740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22ce3e0 0x5586c22d7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.898+0000 7efe1d5be740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22da370 0x5586c22d75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.898+0000 7efe1d5be740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5586c2095700 con 0x5586c22ce3e0 2024-08-20T05:09:12.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.898+0000 7efe1d5be740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5586c21ce290 con 0x5586c22da370 2024-08-20T05:09:12.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.898+0000 7efe1d5be740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5586c22dcff0 con 0x5586c22cdac0 2024-08-20T05:09:12.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.898+0000 7efe1d5be740 10 client.0 _ll_register_callbacks cb 0x5586c222d1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:12.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.898+0000 7efe13e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22cdac0 0x5586c22d9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:12.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.898+0000 7efe13e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22cdac0 0x5586c22d9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:45334/0 (socket says 172.21.15.37:45334) 2024-08-20T05:09:12.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.898+0000 7efe13e00640 1 -- 172.21.15.37:0/1568555098 learned_addr learned my addr 172.21.15.37:0/1568555098 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:12.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.898+0000 7efe18a00640 1 --2- 172.21.15.37:0/1568555098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22da370 0x5586c22d75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:12.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.899+0000 7efe13400640 1 --2- 172.21.15.37:0/1568555098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22ce3e0 0x5586c22d7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:12.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.899+0000 7efe13e00640 1 -- 172.21.15.37:0/1568555098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22da370 msgr2=0x5586c22d75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.899+0000 7efe13e00640 1 --2- 172.21.15.37:0/1568555098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22da370 0x5586c22d75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.899+0000 7efe13e00640 1 -- 172.21.15.37:0/1568555098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22ce3e0 msgr2=0x5586c22d7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.899+0000 7efe13e00640 1 --2- 172.21.15.37:0/1568555098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22ce3e0 0x5586c22d7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.899+0000 7efe13e00640 1 -- 172.21.15.37:0/1568555098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586c1f92650 con 0x5586c22cdac0 2024-08-20T05:09:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.899+0000 7efe13400640 1 --2- 172.21.15.37:0/1568555098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22ce3e0 0x5586c22d7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:09:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.899+0000 7efe13e00640 1 --2- 172.21.15.37:0/1568555098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22cdac0 0x5586c22d9be0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efe040cb310 tx=0x7efe040cb150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dea006c2bdbb3237 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.899+0000 7efdfd600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:09:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.899+0000 7efdfd600640 1 -- 172.21.15.37:0/1568555098 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe04049070 con 0x5586c22cdac0 2024-08-20T05:09:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.900+0000 7efdfd600640 1 -- 172.21.15.37:0/1568555098 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7efe0403b460 con 0x5586c22cdac0 2024-08-20T05:09:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.900+0000 7efe1d5be740 1 -- 172.21.15.37:0/1568555098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe0c00ee70 con 0x5586c22cdac0 2024-08-20T05:09:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.900+0000 7efdfd600640 1 -- 172.21.15.37:0/1568555098 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7efe040cae90 con 0x5586c22cdac0 2024-08-20T05:09:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.900+0000 7efe1d5be740 10 client.27343 fetch_fsmap learned FSMap version 36 2024-08-20T05:09:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.900+0000 7efe1d5be740 1 -- 172.21.15.37:0/1568555098 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5586c22e88a0 con 0x5586c22cdac0 2024-08-20T05:09:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.900+0000 7efdfd600640 1 -- 172.21.15.37:0/1568555098 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe0c00ee70 con 0x5586c22cdac0 2024-08-20T05:09:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.901+0000 7efdfd600640 1 -- 172.21.15.37:0/1568555098 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7efe040cb5e0 con 0x5586c22cdac0 2024-08-20T05:09:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.901+0000 7efe1d5be740 10 client.27343 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:09:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.901+0000 7efe1d5be740 10 client.27343 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:09:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.901+0000 7efe1d5be740 20 client.27343 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.901+0000 7efe1d5be740 1 --2- 172.21.15.37:0/1568555098 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5586c22e9d50 0x5586c22ec160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.901+0000 7efe1d5be740 4 client.27343 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:09:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.901+0000 7efe1d5be740 1 -- 172.21.15.37:0/1568555098 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586c22459f0 con 0x5586c22e9d50 2024-08-20T05:09:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.901+0000 7efe13400640 1 --2- 172.21.15.37:0/1568555098 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5586c22e9d50 0x5586c22ec160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.902+0000 7efe13400640 1 --2- 172.21.15.37:0/1568555098 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5586c22e9d50 0x5586c22ec160 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d0c1e6fe914467b0 server_cookie=1e9f77daf46e175e in_seq=0 out_seq=0 2024-08-20T05:09:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.902+0000 7efdfd600640 10 client.27343 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:09:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.902+0000 7efdfd600640 1 -- 172.21.15.37:0/1568555098 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586c22459f0 con 0x5586c22e9d50 2024-08-20T05:09:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.902+0000 7efdfd600640 10 client.27343 handle_command_reply: tid=0 2024-08-20T05:09:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.903+0000 7efe1d5be740 1 client.27343 shutdown 2024-08-20T05:09:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.903+0000 7efe1d5be740 1 -- 172.21.15.37:0/1568555098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22cdac0 msgr2=0x5586c22d9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.903+0000 7efe1d5be740 1 --2- 172.21.15.37:0/1568555098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22cdac0 0x5586c22d9be0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efe040cb310 tx=0x7efe040cb150 comp rx=0 tx=0).stop 2024-08-20T05:09:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.903+0000 7efe1d5be740 1 -- 172.21.15.37:0/1568555098 shutdown_connections 2024-08-20T05:09:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.903+0000 7efe1d5be740 1 --2- 172.21.15.37:0/1568555098 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5586c22e9d50 0x5586c22ec160 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.903+0000 7efe1d5be740 1 --2- 172.21.15.37:0/1568555098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22da370 0x5586c22d75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.903+0000 7efe1d5be740 1 --2- 172.21.15.37:0/1568555098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22ce3e0 0x5586c22d7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.903+0000 7efe1d5be740 1 --2- 172.21.15.37:0/1568555098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22cdac0 0x5586c22d9be0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.903+0000 7efe1d5be740 1 -- 172.21.15.37:0/1568555098 >> 172.21.15.37:0/1568555098 conn(0x5586c22cb8f0 msgr2=0x5586c22d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:12.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.903+0000 7efdfd600640 0 client.27343 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:09:12.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.903+0000 7efe1d5be740 1 -- 172.21.15.37:0/1568555098 shutdown_connections 2024-08-20T05:09:12.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.903+0000 7efe1d5be740 1 -- 172.21.15.37:0/1568555098 wait complete. 2024-08-20T05:09:12.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.904+0000 7efe1d5be740 20 client.27343 trim_cache size 0 max 16384 2024-08-20T05:09:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.918+0000 7efe1d5be740 1 Processor -- start 2024-08-20T05:09:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.918+0000 7efe1d5be740 1 -- start start 2024-08-20T05:09:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.918+0000 7efe1d5be740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 0x5586c22e6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.918+0000 7efe1d5be740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22ce3e0 0x5586c22f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.918+0000 7efe1d5be740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22da370 0x5586c22f1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.918+0000 7efe1d5be740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe141b5ad0 con 0x5586c22cdac0 2024-08-20T05:09:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.918+0000 7efe1d5be740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efe141b7610 con 0x5586c22da370 2024-08-20T05:09:12.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.918+0000 7efe1d5be740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efe141b61a0 con 0x5586c22ce3e0 2024-08-20T05:09:12.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.918+0000 7efe13400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22ce3e0 0x5586c22f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.918+0000 7efe13400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22ce3e0 0x5586c22f1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:45342/0 (socket says 172.21.15.37:45342) 2024-08-20T05:09:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.919+0000 7efe13400640 1 -- 172.21.15.37:0/3540983001 learned_addr learned my addr 172.21.15.37:0/3540983001 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.919+0000 7efe13e00640 1 --2- 172.21.15.37:0/3540983001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 0x5586c22e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.919+0000 7efe13400640 1 -- 172.21.15.37:0/3540983001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22da370 msgr2=0x5586c22f1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.919+0000 7efe18a00640 1 --2- 172.21.15.37:0/3540983001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22da370 0x5586c22f1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.919+0000 7efe13400640 1 --2- 172.21.15.37:0/3540983001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22da370 0x5586c22f1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.919+0000 7efe13400640 1 -- 172.21.15.37:0/3540983001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 msgr2=0x5586c22e6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.919+0000 7efe13400640 1 --2- 172.21.15.37:0/3540983001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 0x5586c22e6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.919+0000 7efe13400640 1 -- 172.21.15.37:0/3540983001 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586c22d9f50 con 0x5586c22ce3e0 2024-08-20T05:09:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.919+0000 7efe18a00640 1 --2- 172.21.15.37:0/3540983001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22da370 0x5586c22f1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:09:12.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.919+0000 7efe13400640 1 --2- 172.21.15.37:0/3540983001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22ce3e0 0x5586c22f1a30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x5586c22bd1d0 tx=0x7efe00015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=525ba7613526601d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:12.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.920+0000 7efe13e00640 1 --2- 172.21.15.37:0/3540983001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 0x5586c22e6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:09:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.920+0000 7efdffe00640 1 -- 172.21.15.37:0/3540983001 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe000044b0 con 0x5586c22ce3e0 2024-08-20T05:09:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.920+0000 7efdffe00640 1 -- 172.21.15.37:0/3540983001 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe0002e070 con 0x5586c22ce3e0 2024-08-20T05:09:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.920+0000 7efdffe00640 1 -- 172.21.15.37:0/3540983001 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0001f900 con 0x5586c22ce3e0 2024-08-20T05:09:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.921+0000 7efe1d5be740 1 -- 172.21.15.37:0/3540983001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22ce3e0 msgr2=0x5586c22f1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.921+0000 7efe1d5be740 1 --2- 172.21.15.37:0/3540983001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22ce3e0 0x5586c22f1a30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x5586c22bd1d0 tx=0x7efe00015000 comp rx=0 tx=0).stop 2024-08-20T05:09:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.921+0000 7efe1d5be740 1 -- 172.21.15.37:0/3540983001 shutdown_connections 2024-08-20T05:09:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.921+0000 7efe1d5be740 1 --2- 172.21.15.37:0/3540983001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22da370 0x5586c22f1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.921+0000 7efe1d5be740 1 --2- 172.21.15.37:0/3540983001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22ce3e0 0x5586c22f1a30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.921+0000 7efe1d5be740 1 --2- 172.21.15.37:0/3540983001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 0x5586c22e6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.921+0000 7efe1d5be740 1 -- 172.21.15.37:0/3540983001 >> 172.21.15.37:0/3540983001 conn(0x5586c22cb8f0 msgr2=0x5586c22d58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.921+0000 7efe1d5be740 1 -- 172.21.15.37:0/3540983001 shutdown_connections 2024-08-20T05:09:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.921+0000 7efe1d5be740 1 -- 172.21.15.37:0/3540983001 wait complete. 2024-08-20T05:09:12.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.922+0000 7efe1d5be740 1 -- start start 2024-08-20T05:09:12.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.922+0000 7efe1d5be740 1 Processor -- start 2024-08-20T05:09:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.923+0000 7efe1d5be740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 0x5586c22dfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.923+0000 7efe1d5be740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22ce3e0 0x5586c22e0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.923+0000 7efe1d5be740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22da370 0x5586c234b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.923+0000 7efe1d5be740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe141b6f40 con 0x5586c22cdac0 2024-08-20T05:09:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.923+0000 7efe1d5be740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efe141b6870 con 0x5586c22ce3e0 2024-08-20T05:09:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.923+0000 7efe1d5be740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efe141b3ab0 con 0x5586c22da370 2024-08-20T05:09:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.923+0000 7efe1d5be740 10 client.0 _ll_register_callbacks cb 0x7efe040c7240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.923+0000 7efe13400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22ce3e0 0x5586c22e0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.923+0000 7efe13400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22ce3e0 0x5586c22e0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44314/0 (socket says 172.21.15.37:44314) 2024-08-20T05:09:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.923+0000 7efe13400640 1 -- 172.21.15.37:0/1673461335 learned_addr learned my addr 172.21.15.37:0/1673461335 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.923+0000 7efe18a00640 1 --2- 172.21.15.37:0/1673461335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22da370 0x5586c234b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:12.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.923+0000 7efe13e00640 1 --2- 172.21.15.37:0/1673461335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 0x5586c22dfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:12.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.924+0000 7efe13400640 1 -- 172.21.15.37:0/1673461335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22da370 msgr2=0x5586c234b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:12.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.924+0000 7efe13400640 1 --2- 172.21.15.37:0/1673461335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22da370 0x5586c234b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.924+0000 7efe13400640 1 -- 172.21.15.37:0/1673461335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 msgr2=0x5586c22dfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:12.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.924+0000 7efe13400640 1 --2- 172.21.15.37:0/1673461335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 0x5586c22dfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.924+0000 7efe13400640 1 -- 172.21.15.37:0/1673461335 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586c234c0d0 con 0x5586c22ce3e0 2024-08-20T05:09:12.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.924+0000 7efe13e00640 1 --2- 172.21.15.37:0/1673461335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 0x5586c22dfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:09:12.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.924+0000 7efe13400640 1 --2- 172.21.15.37:0/1673461335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22ce3e0 0x5586c22e0160 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efe0001f460 tx=0x7efe000045f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1864f9c93902ab6c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:12.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.924+0000 7efdfd600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:09:12.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.924+0000 7efdfd600640 1 -- 172.21.15.37:0/1673461335 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0001fad0 con 0x5586c22ce3e0 2024-08-20T05:09:12.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.924+0000 7efe1d5be740 1 -- 172.21.15.37:0/1673461335 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe0002e070 con 0x5586c22ce3e0 2024-08-20T05:09:12.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.924+0000 7efdfd600640 1 -- 172.21.15.37:0/1673461335 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7efe0001fc70 con 0x5586c22ce3e0 2024-08-20T05:09:12.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.925+0000 7efdfd600640 1 -- 172.21.15.37:0/1673461335 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7efe000283a0 con 0x5586c22ce3e0 2024-08-20T05:09:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.925+0000 7efe1d5be740 10 client.27332 fetch_fsmap learned FSMap version 36 2024-08-20T05:09:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.925+0000 7efe1d5be740 1 -- 172.21.15.37:0/1673461335 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5586c23545e0 con 0x5586c22ce3e0 2024-08-20T05:09:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.925+0000 7efdfd600640 1 -- 172.21.15.37:0/1673461335 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe0002e070 con 0x5586c22ce3e0 2024-08-20T05:09:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.925+0000 7efdfd600640 1 -- 172.21.15.37:0/1673461335 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 36) ==== 8370+0+0 (secure 0 0 0) 0x7efe0003a730 con 0x5586c22ce3e0 2024-08-20T05:09:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.925+0000 7efe1d5be740 10 client.27332 fetch_fsmap finished waiting for FSMap version 36 2024-08-20T05:09:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.925+0000 7efe1d5be740 10 client.27332 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:09:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.925+0000 7efe1d5be740 20 client.27332 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.925+0000 7efe1d5be740 1 --2- 172.21.15.37:0/1673461335 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5586c2354c50 0x5586c2357070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.926+0000 7efe1d5be740 4 client.27332 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:09:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.926+0000 7efe1d5be740 1 -- 172.21.15.37:0/1673461335 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5586c2241490 con 0x5586c2354c50 2024-08-20T05:09:12.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.926+0000 7efe13e00640 1 --2- 172.21.15.37:0/1673461335 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5586c2354c50 0x5586c2357070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.926+0000 7efe13e00640 1 --2- 172.21.15.37:0/1673461335 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5586c2354c50 0x5586c2357070 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bb639a03a29d5e90 server_cookie=aec01e4653099452 in_seq=0 out_seq=0 2024-08-20T05:09:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.926+0000 7efdfd600640 10 client.27332 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:09:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.926+0000 7efdfd600640 1 -- 172.21.15.37:0/1673461335 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5586c2241490 con 0x5586c2354c50 2024-08-20T05:09:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.927+0000 7efdfd600640 10 client.27332 handle_command_reply: tid=0 2024-08-20T05:09:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.927+0000 7efe1d5be740 1 client.27332 shutdown 2024-08-20T05:09:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.927+0000 7efe1d5be740 1 -- 172.21.15.37:0/1673461335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22ce3e0 msgr2=0x5586c22e0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.927+0000 7efe1d5be740 1 --2- 172.21.15.37:0/1673461335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22ce3e0 0x5586c22e0160 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7efe0001f460 tx=0x7efe000045f0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.927+0000 7efe1d5be740 1 -- 172.21.15.37:0/1673461335 shutdown_connections 2024-08-20T05:09:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.927+0000 7efe1d5be740 1 --2- 172.21.15.37:0/1673461335 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5586c2354c50 0x5586c2357070 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.927+0000 7efe1d5be740 1 --2- 172.21.15.37:0/1673461335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5586c22da370 0x5586c234b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.927+0000 7efe1d5be740 1 --2- 172.21.15.37:0/1673461335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5586c22ce3e0 0x5586c22e0160 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.927+0000 7efe1d5be740 1 --2- 172.21.15.37:0/1673461335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5586c22cdac0 0x5586c22dfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.927+0000 7efdfd600640 0 client.27332 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:09:12.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.927+0000 7efe1d5be740 1 -- 172.21.15.37:0/1673461335 >> 172.21.15.37:0/1673461335 conn(0x5586c22cb8f0 msgr2=0x5586c22d8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:12.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.927+0000 7efe1d5be740 1 -- 172.21.15.37:0/1673461335 shutdown_connections 2024-08-20T05:09:12.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.927+0000 7efe1d5be740 1 -- 172.21.15.37:0/1673461335 wait complete. 2024-08-20T05:09:12.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.927+0000 7efe1d5be740 20 client.27332 trim_cache size 0 max 16384 2024-08-20T05:09:12.932 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:09:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.928+0000 7efe19400640 1 -- 172.21.15.37:0/1045184795 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdf80b3d70 msgr2=0x7efdf80b6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.928+0000 7efe19400640 1 --2- 172.21.15.37:0/1045184795 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdf80b3d70 0x7efdf80b6230 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7efe00005fd0 tx=0x7efe0000b5a0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.928+0000 7efe19400640 1 -- 172.21.15.37:0/1045184795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe14075210 msgr2=0x7efe14102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.928+0000 7efe19400640 1 --2- 172.21.15.37:0/1045184795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe14075210 0x7efe14102680 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7efe04005ab0 tx=0x7efe04003c80 comp rx=0 tx=0).stop 2024-08-20T05:09:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.928+0000 7efe19400640 1 -- 172.21.15.37:0/1045184795 shutdown_connections 2024-08-20T05:09:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.928+0000 7efe19400640 1 --2- 172.21.15.37:0/1045184795 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdf80b3d70 0x7efdf80b6230 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.928+0000 7efe19400640 1 --2- 172.21.15.37:0/1045184795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe1410ef10 0x7efe14103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.928+0000 7efe19400640 1 --2- 172.21.15.37:0/1045184795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe14075b30 0x7efe14102bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.928+0000 7efe19400640 1 --2- 172.21.15.37:0/1045184795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe14075210 0x7efe14102680 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.928+0000 7efe19400640 1 -- 172.21.15.37:0/1045184795 >> 172.21.15.37:0/1045184795 conn(0x7efe140fe350 msgr2=0x7efe141110a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.928+0000 7efe19400640 1 -- 172.21.15.37:0/1045184795 shutdown_connections 2024-08-20T05:09:12.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:12.928+0000 7efe19400640 1 -- 172.21.15.37:0/1045184795 wait complete. 2024-08-20T05:09:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 375.0 s, 803.1 tps, lat 119.674 ms stddev 143.086 2024-08-20T05:09:13.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:13 smithi130 ceph-mon[22007]: pgmap v610: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 13 MiB/s wr, 538 op/s 2024-08-20T05:09:13.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:13 smithi037 ceph-mon[17265]: pgmap v610: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 13 MiB/s wr, 538 op/s 2024-08-20T05:09:13.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:13 smithi135 ceph-mon[22342]: pgmap v610: 129 pgs: 129 active+clean; 1.2 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 13 MiB/s wr, 538 op/s 2024-08-20T05:09:14.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T05:09:15.253 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:09:15.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T05:09:15.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T05:09:15.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T05:09:15.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:09:15.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:09:15.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:09:15.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:09:15.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T05:09:15.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T05:09:15.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T05:09:15.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:09:15.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:09:15.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:09:15.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:09:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-08-20T05:09:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-08-20T05:09:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-08-20T05:09:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:09:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:09:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:09:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:09:16.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.418+0000 7fca71400640 1 -- 172.21.15.37:0/3085704568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca6c102ab0 msgr2=0x7fca6c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:16.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.419+0000 7fca71400640 1 --2- 172.21.15.37:0/3085704568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca6c102ab0 0x7fca6c102e90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fca5c009900 tx=0x7fca5c02a420 comp rx=0 tx=0).stop 2024-08-20T05:09:16.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.419+0000 7fca71400640 1 -- 172.21.15.37:0/3085704568 shutdown_connections 2024-08-20T05:09:16.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.419+0000 7fca71400640 1 --2- 172.21.15.37:0/3085704568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca6c108e40 0x7fca6c10f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.419+0000 7fca71400640 1 --2- 172.21.15.37:0/3085704568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca6c1084c0 0x7fca6c108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.419+0000 7fca71400640 1 --2- 172.21.15.37:0/3085704568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca6c102ab0 0x7fca6c102e90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.419+0000 7fca71400640 1 -- 172.21.15.37:0/3085704568 >> 172.21.15.37:0/3085704568 conn(0x7fca6c0fe500 msgr2=0x7fca6c100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.419+0000 7fca71400640 1 -- 172.21.15.37:0/3085704568 shutdown_connections 2024-08-20T05:09:16.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.419+0000 7fca71400640 1 -- 172.21.15.37:0/3085704568 wait complete. 2024-08-20T05:09:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.420+0000 7fca71400640 1 Processor -- start 2024-08-20T05:09:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.421+0000 7fca71400640 1 -- start start 2024-08-20T05:09:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.421+0000 7fca71400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca6c102ab0 0x7fca6c19b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.421+0000 7fca71400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca6c1084c0 0x7fca6c19b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.421+0000 7fca71400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca6c108e40 0x7fca6c1a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.422+0000 7fca71400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c112b50 con 0x7fca6c108e40 2024-08-20T05:09:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.422+0000 7fca71400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c1129d0 con 0x7fca6c1084c0 2024-08-20T05:09:16.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.422+0000 7fca71400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c112cd0 con 0x7fca6c102ab0 2024-08-20T05:09:16.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.423+0000 7fca6a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca6c102ab0 0x7fca6c19b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.423+0000 7fca6a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca6c102ab0 0x7fca6c19b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:45398/0 (socket says 172.21.15.37:45398) 2024-08-20T05:09:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.423+0000 7fca6a800640 1 -- 172.21.15.37:0/1602608207 learned_addr learned my addr 172.21.15.37:0/1602608207 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.424+0000 7fca6a800640 1 -- 172.21.15.37:0/1602608207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca6c1084c0 msgr2=0x7fca6c19b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.424+0000 7fca6a800640 1 --2- 172.21.15.37:0/1602608207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca6c1084c0 0x7fca6c19b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.424+0000 7fca6a800640 1 -- 172.21.15.37:0/1602608207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca6c108e40 msgr2=0x7fca6c1a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.424+0000 7fca6a800640 1 --2- 172.21.15.37:0/1602608207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca6c108e40 0x7fca6c1a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.424+0000 7fca6a800640 1 -- 172.21.15.37:0/1602608207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca6c1a1300 con 0x7fca6c102ab0 2024-08-20T05:09:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.424+0000 7fca6a800640 1 --2- 172.21.15.37:0/1602608207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca6c102ab0 0x7fca6c19b250 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fca5c009a20 tx=0x7fca5c003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.425+0000 7fca63400640 1 -- 172.21.15.37:0/1602608207 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c03f070 con 0x7fca6c102ab0 2024-08-20T05:09:16.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.425+0000 7fca71400640 1 -- 172.21.15.37:0/1602608207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca6c1a1590 con 0x7fca6c102ab0 2024-08-20T05:09:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.425+0000 7fca71400640 1 -- 172.21.15.37:0/1602608207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca6c1a7cb0 con 0x7fca6c102ab0 2024-08-20T05:09:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.425+0000 7fca63400640 1 -- 172.21.15.37:0/1602608207 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca5c031b50 con 0x7fca6c102ab0 2024-08-20T05:09:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.425+0000 7fca63400640 1 -- 172.21.15.37:0/1602608207 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca5c035030 con 0x7fca6c102ab0 2024-08-20T05:09:16.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.430+0000 7fca73dc8740 1 Processor -- start 2024-08-20T05:09:16.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.431+0000 7fca73dc8740 1 -- start start 2024-08-20T05:09:16.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.431+0000 7fca73dc8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a11940 0x55d610a11d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.431+0000 7fca73dc8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a12260 0x55d610a1dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.431+0000 7fca73dc8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a1e1f0 0x55d610a205e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.431+0000 7fca73dc8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d610987aa0 con 0x55d610a1e1f0 2024-08-20T05:09:16.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.431+0000 7fca73dc8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d610976fa0 con 0x55d610a11940 2024-08-20T05:09:16.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.431+0000 7fca73dc8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d61097afe0 con 0x55d610a12260 2024-08-20T05:09:16.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.432+0000 7fca6b200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a11940 0x55d610a11d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:16.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.432+0000 7fca6b200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a11940 0x55d610a11d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44354/0 (socket says 172.21.15.37:44354) 2024-08-20T05:09:16.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.432+0000 7fca6b200640 1 -- 172.21.15.37:0/3108780538 learned_addr learned my addr 172.21.15.37:0/3108780538 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:16.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.432+0000 7fca63400640 1 -- 172.21.15.37:0/1602608207 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fca5c042070 con 0x7fca6c102ab0 2024-08-20T05:09:16.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.433+0000 7fca69e00640 1 --2- 172.21.15.37:0/3108780538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a1e1f0 0x55d610a205e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:16.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.433+0000 7fca6b200640 1 -- 172.21.15.37:0/3108780538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a12260 msgr2=0x55d610a1dcb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:09:16.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.433+0000 7fca6b200640 1 --2- 172.21.15.37:0/3108780538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a12260 0x55d610a1dcb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.433+0000 7fca6b200640 1 -- 172.21.15.37:0/3108780538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a1e1f0 msgr2=0x55d610a205e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:16.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.433+0000 7fca6b200640 1 --2- 172.21.15.37:0/3108780538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a1e1f0 0x55d610a205e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.433+0000 7fca6b200640 1 -- 172.21.15.37:0/3108780538 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d61091d420 con 0x55d610a11940 2024-08-20T05:09:16.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.433+0000 7fca6b200640 1 --2- 172.21.15.37:0/3108780538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a11940 0x55d610a11d20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fca64009d00 tx=0x7fca6400b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a8c1b03de53380a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:16.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.436+0000 7fca63400640 1 --2- 172.21.15.37:0/1602608207 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca500b3c50 0x7fca500b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.436+0000 7fca57400640 1 -- 172.21.15.37:0/3108780538 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6400bb30 con 0x55d610a11940 2024-08-20T05:09:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.436+0000 7fca57400640 1 -- 172.21.15.37:0/3108780538 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca64017070 con 0x55d610a11940 2024-08-20T05:09:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.437+0000 7fca63400640 1 -- 172.21.15.37:0/1602608207 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fca5c104730 con 0x7fca6c102ab0 2024-08-20T05:09:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.437+0000 7fca57400640 1 -- 172.21.15.37:0/3108780538 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca640115f0 con 0x55d610a11940 2024-08-20T05:09:16.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.438+0000 7fca73dc8740 1 -- 172.21.15.37:0/3108780538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a11940 msgr2=0x55d610a11d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:16.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.438+0000 7fca73dc8740 1 --2- 172.21.15.37:0/3108780538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a11940 0x55d610a11d20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fca64009d00 tx=0x7fca6400b420 comp rx=0 tx=0).stop 2024-08-20T05:09:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.438+0000 7fca6a800640 1 --2- 172.21.15.37:0/1602608207 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca500b3c50 0x7fca500b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.439+0000 7fca73dc8740 1 -- 172.21.15.37:0/3108780538 shutdown_connections 2024-08-20T05:09:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.439+0000 7fca73dc8740 1 --2- 172.21.15.37:0/3108780538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a1e1f0 0x55d610a205e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.439+0000 7fca73dc8740 1 --2- 172.21.15.37:0/3108780538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a12260 0x55d610a1dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.439+0000 7fca73dc8740 1 --2- 172.21.15.37:0/3108780538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a11940 0x55d610a11d20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.439+0000 7fca73dc8740 1 -- 172.21.15.37:0/3108780538 >> 172.21.15.37:0/3108780538 conn(0x55d610a0f770 msgr2=0x55d610a10910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:16.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.439+0000 7fca73dc8740 1 -- 172.21.15.37:0/3108780538 shutdown_connections 2024-08-20T05:09:16.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.439+0000 7fca73dc8740 1 -- 172.21.15.37:0/3108780538 wait complete. 2024-08-20T05:09:16.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.440+0000 7fca73dc8740 1 -- start start 2024-08-20T05:09:16.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.441+0000 7fca73dc8740 1 Processor -- start 2024-08-20T05:09:16.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.441+0000 7fca73dc8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a11940 0x55d610a1da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.443+0000 7fca73dc8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a12260 0x55d610a1af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.443+0000 7fca73dc8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a1e1f0 0x55d610a1b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.444+0000 7fca69e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a12260 0x55d610a1af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:16.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.444+0000 7fca69e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a12260 0x55d610a1af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44358/0 (socket says 172.21.15.37:44358) 2024-08-20T05:09:16.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.444+0000 7fca69e00640 1 -- 172.21.15.37:0/1010743732 learned_addr learned my addr 172.21.15.37:0/1010743732 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:16.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.444+0000 7fca73dc8740 1 -- 172.21.15.37:0/1010743732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d6107d9700 con 0x55d610a11940 2024-08-20T05:09:16.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.444+0000 7fca6b200640 1 --2- 172.21.15.37:0/1010743732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a1e1f0 0x55d610a1b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:16.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.444+0000 7fca73dc8740 1 -- 172.21.15.37:0/1010743732 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d610912290 con 0x55d610a12260 2024-08-20T05:09:16.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.444+0000 7fca73dc8740 1 -- 172.21.15.37:0/1010743732 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d610a20e70 con 0x55d610a1e1f0 2024-08-20T05:09:16.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.445+0000 7fca73dc8740 10 client.0 _ll_register_callbacks cb 0x55d6109711c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:16.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.445+0000 7fca69e00640 1 -- 172.21.15.37:0/1010743732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a1e1f0 msgr2=0x55d610a1b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:16.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.446+0000 7fca69e00640 1 --2- 172.21.15.37:0/1010743732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a1e1f0 0x55d610a1b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.446+0000 7fca69e00640 1 -- 172.21.15.37:0/1010743732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a11940 msgr2=0x55d610a1da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:16.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.446+0000 7fca69e00640 1 --2- 172.21.15.37:0/1010743732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a11940 0x55d610a1da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.446+0000 7fca69e00640 1 -- 172.21.15.37:0/1010743732 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6106d6650 con 0x55d610a12260 2024-08-20T05:09:16.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.446+0000 7fca6b200640 1 --2- 172.21.15.37:0/1010743732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a1e1f0 0x55d610a1b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:09:16.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.447+0000 7fca6a800640 1 --2- 172.21.15.37:0/1602608207 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca500b3c50 0x7fca500b6110 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0cb270 tx=0x7fca5c03b720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:16.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.447+0000 7fca69e00640 1 --2- 172.21.15.37:0/1010743732 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a12260 0x55d610a1af00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fca580103a0 tx=0x7fca58010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11916cb2fea9586a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:16.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.447+0000 7fca4be00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:09:16.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.448+0000 7fca4be00640 1 -- 172.21.15.37:0/1010743732 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58004230 con 0x55d610a12260 2024-08-20T05:09:16.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.448+0000 7fca4be00640 1 -- 172.21.15.37:0/1010743732 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fca580043d0 con 0x55d610a12260 2024-08-20T05:09:16.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.448+0000 7fca73dc8740 1 -- 172.21.15.37:0/1010743732 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca64017070 con 0x55d610a12260 2024-08-20T05:09:16.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.450+0000 7fca4be00640 1 -- 172.21.15.37:0/1010743732 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fca58012720 con 0x55d610a12260 2024-08-20T05:09:16.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.450+0000 7fca73dc8740 10 client.27341 fetch_fsmap learned FSMap version 37 2024-08-20T05:09:16.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.450+0000 7fca73dc8740 1 -- 172.21.15.37:0/1010743732 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d610a34fb0 con 0x55d610a12260 2024-08-20T05:09:16.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.450+0000 7fca4be00640 1 -- 172.21.15.37:0/1010743732 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca64017070 con 0x55d610a12260 2024-08-20T05:09:16.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.451+0000 7fca4be00640 1 -- 172.21.15.37:0/1010743732 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 37) ==== 8374+0+0 (secure 0 0 0) 0x7fca5800f040 con 0x55d610a12260 2024-08-20T05:09:16.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.451+0000 7fca73dc8740 10 client.27341 fetch_fsmap finished waiting for FSMap version 37 2024-08-20T05:09:16.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.451+0000 7fca73dc8740 10 client.27341 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:09:16.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.451+0000 7fca73dc8740 20 client.27341 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:16.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.451+0000 7fca73dc8740 1 --2- 172.21.15.37:0/1010743732 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d610a363c0 0x55d610a38860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.451+0000 7fca73dc8740 4 client.27341 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:09:16.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.451+0000 7fca73dc8740 1 -- 172.21.15.37:0/1010743732 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6109899f0 con 0x55d610a363c0 2024-08-20T05:09:16.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.451+0000 7fca6b200640 1 --2- 172.21.15.37:0/1010743732 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d610a363c0 0x55d610a38860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.452+0000 7fca6b200640 1 --2- 172.21.15.37:0/1010743732 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d610a363c0 0x55d610a38860 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b73099365275f65a server_cookie=f5ddaa3b80337608 in_seq=0 out_seq=0 2024-08-20T05:09:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.452+0000 7fca4be00640 10 client.27341 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.453+0000 7fca4be00640 1 -- 172.21.15.37:0/1010743732 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6109899f0 con 0x55d610a363c0 2024-08-20T05:09:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.453+0000 7fca4be00640 10 client.27341 handle_command_reply: tid=0 2024-08-20T05:09:16.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.453+0000 7fca73dc8740 1 client.27341 shutdown 2024-08-20T05:09:16.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.459+0000 7fca73dc8740 1 -- 172.21.15.37:0/1010743732 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a12260 msgr2=0x55d610a1af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:16.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.459+0000 7fca73dc8740 1 --2- 172.21.15.37:0/1010743732 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a12260 0x55d610a1af00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fca580103a0 tx=0x7fca58010860 comp rx=0 tx=0).stop 2024-08-20T05:09:16.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.461+0000 7fca73dc8740 1 -- 172.21.15.37:0/1010743732 shutdown_connections 2024-08-20T05:09:16.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.462+0000 7fca73dc8740 1 --2- 172.21.15.37:0/1010743732 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d610a363c0 0x55d610a38860 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.462+0000 7fca73dc8740 1 --2- 172.21.15.37:0/1010743732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a1e1f0 0x55d610a1b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.462+0000 7fca73dc8740 1 --2- 172.21.15.37:0/1010743732 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a12260 0x55d610a1af00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.462+0000 7fca73dc8740 1 --2- 172.21.15.37:0/1010743732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a11940 0x55d610a1da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.462+0000 7fca4be00640 0 client.27341 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:16.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.462+0000 7fca73dc8740 1 -- 172.21.15.37:0/1010743732 >> 172.21.15.37:0/1010743732 conn(0x55d610a0f770 msgr2=0x55d610a152e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:16.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.464+0000 7fca73dc8740 1 -- 172.21.15.37:0/1010743732 shutdown_connections 2024-08-20T05:09:16.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.464+0000 7fca73dc8740 1 -- 172.21.15.37:0/1010743732 wait complete. 2024-08-20T05:09:16.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.464+0000 7fca73dc8740 20 client.27341 trim_cache size 0 max 16384 2024-08-20T05:09:16.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.494+0000 7fca73dc8740 1 Processor -- start 2024-08-20T05:09:16.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.494+0000 7fca73dc8740 1 -- start start 2024-08-20T05:09:16.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.495+0000 7fca73dc8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a11940 0x55d610a1d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.495+0000 7fca73dc8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a12260 0x55d610a32820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.495+0000 7fca73dc8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a1e1f0 0x55d610a3e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.495+0000 7fca73dc8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c1ad770 con 0x55d610a12260 2024-08-20T05:09:16.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.495+0000 7fca73dc8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c1af2e0 con 0x55d610a11940 2024-08-20T05:09:16.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.495+0000 7fca73dc8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c1ade40 con 0x55d610a1e1f0 2024-08-20T05:09:16.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.495+0000 7fca6b200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a11940 0x55d610a1d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:16.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.495+0000 7fca6b200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a11940 0x55d610a1d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44372/0 (socket says 172.21.15.37:44372) 2024-08-20T05:09:16.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.495+0000 7fca6b200640 1 -- 172.21.15.37:0/2163921243 learned_addr learned my addr 172.21.15.37:0/2163921243 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:16.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.495+0000 7fca6b200640 1 --2- 172.21.15.37:0/2163921243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a1e1f0 0x55d610a3e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:16.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.496+0000 7fca6b200640 1 -- 172.21.15.37:0/2163921243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a1e1f0 msgr2=0x55d610a3e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:16.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.496+0000 7fca69e00640 1 --2- 172.21.15.37:0/2163921243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a12260 0x55d610a32820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:16.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.496+0000 7fca6b200640 1 --2- 172.21.15.37:0/2163921243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a1e1f0 0x55d610a3e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.496+0000 7fca6b200640 1 -- 172.21.15.37:0/2163921243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a12260 msgr2=0x55d610a32820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:16.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.496+0000 7fca6b200640 1 --2- 172.21.15.37:0/2163921243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a12260 0x55d610a32820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.496+0000 7fca6b200640 1 -- 172.21.15.37:0/2163921243 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d610a38ee0 con 0x55d610a11940 2024-08-20T05:09:16.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.496+0000 7fca6b200640 1 --2- 172.21.15.37:0/2163921243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a11940 0x55d610a1d000 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fca64009fd0 tx=0x7fca64007150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3d208a2f525b45a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:16.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.497+0000 7fca56a00640 1 -- 172.21.15.37:0/2163921243 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64003a30 con 0x55d610a11940 2024-08-20T05:09:16.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.497+0000 7fca56a00640 1 -- 172.21.15.37:0/2163921243 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca6402a070 con 0x55d610a11940 2024-08-20T05:09:16.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.497+0000 7fca56a00640 1 -- 172.21.15.37:0/2163921243 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca64004020 con 0x55d610a11940 2024-08-20T05:09:16.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.498+0000 7fca73dc8740 1 -- 172.21.15.37:0/2163921243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a11940 msgr2=0x55d610a1d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:16.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.498+0000 7fca73dc8740 1 --2- 172.21.15.37:0/2163921243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a11940 0x55d610a1d000 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fca64009fd0 tx=0x7fca64007150 comp rx=0 tx=0).stop 2024-08-20T05:09:16.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.499+0000 7fca73dc8740 1 -- 172.21.15.37:0/2163921243 shutdown_connections 2024-08-20T05:09:16.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.499+0000 7fca73dc8740 1 --2- 172.21.15.37:0/2163921243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a1e1f0 0x55d610a3e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.499+0000 7fca73dc8740 1 --2- 172.21.15.37:0/2163921243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a12260 0x55d610a32820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.499+0000 7fca73dc8740 1 --2- 172.21.15.37:0/2163921243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a11940 0x55d610a1d000 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.499+0000 7fca73dc8740 1 -- 172.21.15.37:0/2163921243 >> 172.21.15.37:0/2163921243 conn(0x55d610a0f770 msgr2=0x55d610a16480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:16.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.499+0000 7fca73dc8740 1 -- 172.21.15.37:0/2163921243 shutdown_connections 2024-08-20T05:09:16.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.500+0000 7fca73dc8740 1 -- 172.21.15.37:0/2163921243 wait complete. 2024-08-20T05:09:16.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.500+0000 7fca73dc8740 1 -- start start 2024-08-20T05:09:16.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.500+0000 7fca73dc8740 1 Processor -- start 2024-08-20T05:09:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.502+0000 7fca73dc8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a11940 0x55d610a2e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.502+0000 7fca73dc8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a12260 0x55d610a2eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.502+0000 7fca73dc8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a1e1f0 0x55d610a9b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.502+0000 7fca73dc8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c1aebe0 con 0x55d610a11940 2024-08-20T05:09:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.502+0000 7fca73dc8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c1ae510 con 0x55d610a1e1f0 2024-08-20T05:09:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.502+0000 7fca73dc8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c1ab790 con 0x55d610a12260 2024-08-20T05:09:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.502+0000 7fca73dc8740 10 client.0 _ll_register_callbacks cb 0x7fca58009410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.503+0000 7fca69e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a12260 0x55d610a2eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.503+0000 7fca69e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a12260 0x55d610a2eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:45422/0 (socket says 172.21.15.37:45422) 2024-08-20T05:09:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.503+0000 7fca69e00640 1 -- 172.21.15.37:0/3195584218 learned_addr learned my addr 172.21.15.37:0/3195584218 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.503+0000 7fca69e00640 1 -- 172.21.15.37:0/3195584218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a1e1f0 msgr2=0x55d610a9b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.503+0000 7fca6b200640 1 --2- 172.21.15.37:0/3195584218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a1e1f0 0x55d610a9b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.504+0000 7fca69e00640 1 --2- 172.21.15.37:0/3195584218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a1e1f0 0x55d610a9b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.504+0000 7fca69e00640 1 -- 172.21.15.37:0/3195584218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a11940 msgr2=0x55d610a2e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.504+0000 7fca69e00640 1 --2- 172.21.15.37:0/3195584218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a11940 0x55d610a2e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.504+0000 7fca69e00640 1 -- 172.21.15.37:0/3195584218 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d610a2f590 con 0x55d610a12260 2024-08-20T05:09:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.504+0000 7fca6b200640 1 --2- 172.21.15.37:0/3195584218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a1e1f0 0x55d610a9b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:09:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.504+0000 7fca69e00640 1 --2- 172.21.15.37:0/3195584218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a12260 0x55d610a2eed0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fca58005820 tx=0x7fca58010d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=823b87d71bba9a47 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.504+0000 7fca4be00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:09:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.505+0000 7fca4be00640 1 -- 172.21.15.37:0/3195584218 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58012ac0 con 0x55d610a12260 2024-08-20T05:09:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.505+0000 7fca73dc8740 1 -- 172.21.15.37:0/3195584218 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca6402a070 con 0x55d610a12260 2024-08-20T05:09:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.505+0000 7fca4be00640 1 -- 172.21.15.37:0/3195584218 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fca58012c60 con 0x55d610a12260 2024-08-20T05:09:16.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.505+0000 7fca4be00640 1 -- 172.21.15.37:0/3195584218 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fca58012e60 con 0x55d610a12260 2024-08-20T05:09:16.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.505+0000 7fca73dc8740 10 client.27361 fetch_fsmap learned FSMap version 37 2024-08-20T05:09:16.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.505+0000 7fca73dc8740 1 -- 172.21.15.37:0/3195584218 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55d610ab2760 con 0x55d610a12260 2024-08-20T05:09:16.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.506+0000 7fca4be00640 1 -- 172.21.15.37:0/3195584218 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca6402a070 con 0x55d610a12260 2024-08-20T05:09:16.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.506+0000 7fca4be00640 1 -- 172.21.15.37:0/3195584218 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 37) ==== 8374+0+0 (secure 0 0 0) 0x7fca5802e070 con 0x55d610a12260 2024-08-20T05:09:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.507+0000 7fca73dc8740 10 client.27361 fetch_fsmap finished waiting for FSMap version 37 2024-08-20T05:09:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.507+0000 7fca73dc8740 10 client.27361 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:09:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.507+0000 7fca73dc8740 20 client.27361 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.507+0000 7fca73dc8740 1 --2- 172.21.15.37:0/3195584218 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d610ab2f40 0x55d610ab5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.510+0000 7fca73dc8740 4 client.27361 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:09:16.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.510+0000 7fca73dc8740 1 -- 172.21.15.37:0/3195584218 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d610985490 con 0x55d610ab2f40 2024-08-20T05:09:16.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.510+0000 7fca6b200640 1 --2- 172.21.15.37:0/3195584218 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d610ab2f40 0x55d610ab5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:16.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.511+0000 7fca6b200640 1 --2- 172.21.15.37:0/3195584218 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d610ab2f40 0x55d610ab5330 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=238972db1b81ec0e server_cookie=e5870baff4082e73 in_seq=0 out_seq=0 2024-08-20T05:09:16.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.511+0000 7fca4be00640 10 client.27361 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.511+0000 7fca4be00640 1 -- 172.21.15.37:0/3195584218 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d610985490 con 0x55d610ab2f40 2024-08-20T05:09:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.511+0000 7fca4be00640 10 client.27361 handle_command_reply: tid=0 2024-08-20T05:09:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.511+0000 7fca73dc8740 1 client.27361 shutdown 2024-08-20T05:09:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.512+0000 7fca73dc8740 1 -- 172.21.15.37:0/3195584218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a12260 msgr2=0x55d610a2eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.512+0000 7fca73dc8740 1 --2- 172.21.15.37:0/3195584218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a12260 0x55d610a2eed0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fca58005820 tx=0x7fca58010d80 comp rx=0 tx=0).stop 2024-08-20T05:09:16.517 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:09:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.512+0000 7fca73dc8740 1 -- 172.21.15.37:0/3195584218 shutdown_connections 2024-08-20T05:09:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.512+0000 7fca73dc8740 1 --2- 172.21.15.37:0/3195584218 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d610ab2f40 0x55d610ab5330 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.512+0000 7fca73dc8740 1 --2- 172.21.15.37:0/3195584218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d610a1e1f0 0x55d610a9b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.512+0000 7fca73dc8740 1 --2- 172.21.15.37:0/3195584218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d610a12260 0x55d610a2eed0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.512+0000 7fca73dc8740 1 --2- 172.21.15.37:0/3195584218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d610a11940 0x55d610a2e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.512+0000 7fca73dc8740 1 -- 172.21.15.37:0/3195584218 >> 172.21.15.37:0/3195584218 conn(0x55d610a0f770 msgr2=0x55d610a31810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.512+0000 7fca4be00640 0 client.27361 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.512+0000 7fca73dc8740 1 -- 172.21.15.37:0/3195584218 shutdown_connections 2024-08-20T05:09:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.513+0000 7fca73dc8740 1 -- 172.21.15.37:0/3195584218 wait complete. 2024-08-20T05:09:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.513+0000 7fca73dc8740 20 client.27361 trim_cache size 0 max 16384 2024-08-20T05:09:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.514+0000 7fca71400640 1 -- 172.21.15.37:0/1602608207 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca500b3c50 msgr2=0x7fca500b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.514+0000 7fca71400640 1 --2- 172.21.15.37:0/1602608207 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca500b3c50 0x7fca500b6110 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fca5c0cb270 tx=0x7fca5c03b720 comp rx=0 tx=0).stop 2024-08-20T05:09:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.514+0000 7fca71400640 1 -- 172.21.15.37:0/1602608207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca6c102ab0 msgr2=0x7fca6c19b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.514+0000 7fca71400640 1 --2- 172.21.15.37:0/1602608207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca6c102ab0 0x7fca6c19b250 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fca5c009a20 tx=0x7fca5c003b90 comp rx=0 tx=0).stop 2024-08-20T05:09:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.514+0000 7fca71400640 1 -- 172.21.15.37:0/1602608207 shutdown_connections 2024-08-20T05:09:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.514+0000 7fca71400640 1 --2- 172.21.15.37:0/1602608207 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca500b3c50 0x7fca500b6110 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.514+0000 7fca71400640 1 --2- 172.21.15.37:0/1602608207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca6c108e40 0x7fca6c1a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.514+0000 7fca71400640 1 --2- 172.21.15.37:0/1602608207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca6c1084c0 0x7fca6c19b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.514+0000 7fca71400640 1 --2- 172.21.15.37:0/1602608207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca6c102ab0 0x7fca6c19b250 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.514+0000 7fca71400640 1 -- 172.21.15.37:0/1602608207 >> 172.21.15.37:0/1602608207 conn(0x7fca6c0fe500 msgr2=0x7fca6c075120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.514+0000 7fca71400640 1 -- 172.21.15.37:0/1602608207 shutdown_connections 2024-08-20T05:09:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:16.514+0000 7fca71400640 1 -- 172.21.15.37:0/1602608207 wait complete. 2024-08-20T05:09:17.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:17 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:09:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:17 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:09:17.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:17 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:09:18.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 380.0 s, 815.3 tps, lat 128.374 ms stddev 180.415 2024-08-20T05:09:19.151 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T05:09:19.151 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T05:09:19.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:19 smithi037 ceph-mon[17265]: pgmap v612: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 16 MiB/s wr, 593 op/s 2024-08-20T05:09:19.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:19 smithi037 ceph-mon[17265]: pgmap v613: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 14 MiB/s wr, 540 op/s 2024-08-20T05:09:19.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:19 smithi130 ceph-mon[22007]: pgmap v612: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 16 MiB/s wr, 593 op/s 2024-08-20T05:09:19.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:19 smithi130 ceph-mon[22007]: pgmap v613: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 14 MiB/s wr, 540 op/s 2024-08-20T05:09:19.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:19 smithi135 ceph-mon[22342]: pgmap v612: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 16 MiB/s wr, 593 op/s 2024-08-20T05:09:19.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:19 smithi135 ceph-mon[22342]: pgmap v613: 129 pgs: 129 active+clean; 1.2 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 14 MiB/s wr, 540 op/s 2024-08-20T05:09:19.868 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:09:20.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:20 smithi130 ceph-mon[22007]: pgmap v614: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 15 MiB/s wr, 625 op/s 2024-08-20T05:09:20.724 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:20 smithi037 ceph-mon[17265]: pgmap v614: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 15 MiB/s wr, 625 op/s 2024-08-20T05:09:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:20 smithi135 ceph-mon[22342]: pgmap v614: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 15 MiB/s wr, 625 op/s 2024-08-20T05:09:21.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.040+0000 7f4feac00640 1 -- 172.21.15.37:0/794078823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fe410f470 msgr2=0x7f4fe4115c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:21.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.040+0000 7f4feac00640 1 --2- 172.21.15.37:0/794078823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fe410f470 0x7f4fe4115c70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009900 tx=0x7f4fdc02a440 comp rx=0 tx=0).stop 2024-08-20T05:09:21.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.044+0000 7f4feac00640 1 -- 172.21.15.37:0/794078823 shutdown_connections 2024-08-20T05:09:21.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.044+0000 7f4feac00640 1 --2- 172.21.15.37:0/794078823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fe410f470 0x7f4fe4115c70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.044+0000 7f4feac00640 1 --2- 172.21.15.37:0/794078823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fe410eaf0 0x7f4fe410ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.044+0000 7f4feac00640 1 --2- 172.21.15.37:0/794078823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fe41090e0 0x7f4fe41094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.044+0000 7f4feac00640 1 -- 172.21.15.37:0/794078823 >> 172.21.15.37:0/794078823 conn(0x7f4fe4078760 msgr2=0x7f4fe407ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.047+0000 7f4feac00640 1 -- 172.21.15.37:0/794078823 shutdown_connections 2024-08-20T05:09:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.047+0000 7f4feac00640 1 -- 172.21.15.37:0/794078823 wait complete. 2024-08-20T05:09:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.048+0000 7f4feac00640 1 Processor -- start 2024-08-20T05:09:21.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.049+0000 7f4feac00640 1 -- start start 2024-08-20T05:09:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.050+0000 7f4feac00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fe41090e0 0x7f4fe4074460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.050+0000 7f4feac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fe410eaf0 0x7f4fe40749a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.051+0000 7f4feac00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fe410f470 0x7f4fe406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.051+0000 7f4feac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe4119110 con 0x7f4fe410eaf0 2024-08-20T05:09:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.051+0000 7f4feac00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe4118f90 con 0x7f4fe41090e0 2024-08-20T05:09:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.051+0000 7f4feac00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe4119290 con 0x7f4fe410f470 2024-08-20T05:09:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.051+0000 7f4fe3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fe41090e0 0x7f4fe4074460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.051+0000 7f4fe3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fe41090e0 0x7f4fe4074460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44400/0 (socket says 172.21.15.37:44400) 2024-08-20T05:09:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.051+0000 7f4fe3e00640 1 -- 172.21.15.37:0/2476866236 learned_addr learned my addr 172.21.15.37:0/2476866236 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.051+0000 7f4fe8c00640 1 --2- 172.21.15.37:0/2476866236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fe410f470 0x7f4fe406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.053+0000 7f4fe3400640 1 --2- 172.21.15.37:0/2476866236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fe410eaf0 0x7f4fe40749a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.053+0000 7f4fe8c00640 1 -- 172.21.15.37:0/2476866236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fe41090e0 msgr2=0x7f4fe4074460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.053+0000 7f4fe8c00640 1 --2- 172.21.15.37:0/2476866236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fe41090e0 0x7f4fe4074460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.053+0000 7f4fe8c00640 1 -- 172.21.15.37:0/2476866236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fe410eaf0 msgr2=0x7f4fe40749a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.053+0000 7f4fe8c00640 1 --2- 172.21.15.37:0/2476866236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fe410eaf0 0x7f4fe40749a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.053+0000 7f4fe8c00640 1 -- 172.21.15.37:0/2476866236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe406e070 con 0x7f4fe410f470 2024-08-20T05:09:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.055+0000 7f4fe3400640 1 --2- 172.21.15.37:0/2476866236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fe410eaf0 0x7f4fe40749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:09:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.055+0000 7f4fe8c00640 1 --2- 172.21.15.37:0/2476866236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fe410f470 0x7f4fe406d7b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009850 tx=0x7f4fdc003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.056+0000 7f4fe0c00640 1 -- 172.21.15.37:0/2476866236 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc03f070 con 0x7f4fe410f470 2024-08-20T05:09:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.057+0000 7f4fe0c00640 1 -- 172.21.15.37:0/2476866236 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fdc003e40 con 0x7f4fe410f470 2024-08-20T05:09:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.057+0000 7f4feac00640 1 -- 172.21.15.37:0/2476866236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe406e300 con 0x7f4fe410f470 2024-08-20T05:09:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.057+0000 7f4feac00640 1 -- 172.21.15.37:0/2476866236 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe40732a0 con 0x7f4fe410f470 2024-08-20T05:09:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.059+0000 7f4fe0c00640 1 -- 172.21.15.37:0/2476866236 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc035030 con 0x7f4fe410f470 2024-08-20T05:09:21.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.067+0000 7f4fed5cd740 1 Processor -- start 2024-08-20T05:09:21.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.068+0000 7f4fe0c00640 1 -- 172.21.15.37:0/2476866236 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4fdc042070 con 0x7f4fe410f470 2024-08-20T05:09:21.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.068+0000 7f4fed5cd740 1 -- start start 2024-08-20T05:09:21.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.069+0000 7f4fed5cd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 0x562be94d4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.069+0000 7f4fed5cd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 0x562be94e0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.070+0000 7f4fed5cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 0x562be94e3670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.070+0000 7f4fe3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 0x562be94d4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.070+0000 7f4fe3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 0x562be94d4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58058/0 (socket says 172.21.15.37:58058) 2024-08-20T05:09:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.070+0000 7f4fe3400640 1 -- 172.21.15.37:0/829949553 learned_addr learned my addr 172.21.15.37:0/829949553 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.070+0000 7f4fe3e00640 1 --2- 172.21.15.37:0/829949553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 0x562be94e0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.072+0000 7f4fed5cd740 1 -- 172.21.15.37:0/829949553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562be944b870 con 0x562be94d49d0 2024-08-20T05:09:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.072+0000 7f4fed5cd740 1 -- 172.21.15.37:0/829949553 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562be943ad70 con 0x562be94d52f0 2024-08-20T05:09:21.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.072+0000 7f4fed5cd740 1 -- 172.21.15.37:0/829949553 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562be943edb0 con 0x562be94e1280 2024-08-20T05:09:21.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.073+0000 7f4fe0c00640 1 --2- 172.21.15.37:0/2476866236 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4fc80b3de0 0x7f4fc80b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.073+0000 7f4fe3400640 1 --2- 172.21.15.37:0/829949553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 0x562be94e3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:21.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.074+0000 7f4fe8c00640 1 --2- 172.21.15.37:0/2476866236 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4fc80b3de0 0x7f4fc80b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:21.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.074+0000 7f4fe0c00640 1 -- 172.21.15.37:0/2476866236 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4fdc104850 con 0x7f4fe410f470 2024-08-20T05:09:21.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.075+0000 7f4fe3400640 1 -- 172.21.15.37:0/829949553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 msgr2=0x562be94e3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:21.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.075+0000 7f4fe3400640 1 --2- 172.21.15.37:0/829949553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 0x562be94e3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.075+0000 7f4fe3400640 1 -- 172.21.15.37:0/829949553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 msgr2=0x562be94e0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:21.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.075+0000 7f4fe3400640 1 --2- 172.21.15.37:0/829949553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 0x562be94e0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.075+0000 7f4fe3400640 1 -- 172.21.15.37:0/829949553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562be919a930 con 0x562be94d49d0 2024-08-20T05:09:21.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.076+0000 7f4fe3e00640 1 --2- 172.21.15.37:0/829949553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 0x562be94e0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:09:21.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.076+0000 7f4fe3400640 1 --2- 172.21.15.37:0/829949553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 0x562be94d4db0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4013900 tx=0x7f4fd4007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62967d8e81c1e410 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:21.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.076+0000 7f4fe8c00640 1 --2- 172.21.15.37:0/2476866236 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4fc80b3de0 0x7f4fc80b62a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc0cb330 tx=0x7f4fdc03bf70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:21.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.078+0000 7f4fd9200640 1 -- 172.21.15.37:0/829949553 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4003c10 con 0x562be94d49d0 2024-08-20T05:09:21.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.078+0000 7f4fd9200640 1 -- 172.21.15.37:0/829949553 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fd4003db0 con 0x562be94d49d0 2024-08-20T05:09:21.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.078+0000 7f4fd9200640 1 -- 172.21.15.37:0/829949553 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4004850 con 0x562be94d49d0 2024-08-20T05:09:21.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.079+0000 7f4fed5cd740 1 -- 172.21.15.37:0/829949553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 msgr2=0x562be94d4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:21.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.079+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/829949553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 0x562be94d4db0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4013900 tx=0x7f4fd4007c40 comp rx=0 tx=0).stop 2024-08-20T05:09:21.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.080+0000 7f4fed5cd740 1 -- 172.21.15.37:0/829949553 shutdown_connections 2024-08-20T05:09:21.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.080+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/829949553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 0x562be94e3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.080+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/829949553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 0x562be94e0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.080+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/829949553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 0x562be94d4db0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.080+0000 7f4fed5cd740 1 -- 172.21.15.37:0/829949553 >> 172.21.15.37:0/829949553 conn(0x562be94d2800 msgr2=0x562be94d39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:21.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.080+0000 7f4fed5cd740 1 -- 172.21.15.37:0/829949553 shutdown_connections 2024-08-20T05:09:21.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.081+0000 7f4fed5cd740 1 -- 172.21.15.37:0/829949553 wait complete. 2024-08-20T05:09:21.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.081+0000 7f4fed5cd740 1 -- start start 2024-08-20T05:09:21.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.082+0000 7f4fed5cd740 1 Processor -- start 2024-08-20T05:09:21.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.083+0000 7f4fed5cd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d49d0 0x562be94e0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.083+0000 7f4fed5cd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d52f0 0x562be94ddfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.084+0000 7f4fed5cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 0x562be94de610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.084+0000 7f4fed5cd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562be929d890 con 0x562be94d52f0 2024-08-20T05:09:21.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.084+0000 7f4fed5cd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562be93c1b00 con 0x562be94d49d0 2024-08-20T05:09:21.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.084+0000 7f4fed5cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562be94e3fd0 con 0x562be94e1280 2024-08-20T05:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.084+0000 7f4fed5cd740 10 client.0 _ll_register_callbacks cb 0x562be9435dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.085+0000 7f4fe3400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d49d0 0x562be94e0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.085+0000 7f4fe3400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d49d0 0x562be94e0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44426/0 (socket says 172.21.15.37:44426) 2024-08-20T05:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.085+0000 7f4fe3400640 1 -- 172.21.15.37:0/1287933795 learned_addr learned my addr 172.21.15.37:0/1287933795 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.085+0000 7f4fe3e00640 1 --2- 172.21.15.37:0/1287933795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d52f0 0x562be94ddfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.086+0000 7f4fe3400640 1 --2- 172.21.15.37:0/1287933795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 0x562be94de610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.086+0000 7f4fe3400640 1 -- 172.21.15.37:0/1287933795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 msgr2=0x562be94de610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:21.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.086+0000 7f4fe3400640 1 --2- 172.21.15.37:0/1287933795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 0x562be94de610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.086+0000 7f4fe3400640 1 -- 172.21.15.37:0/1287933795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d52f0 msgr2=0x562be94ddfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.086+0000 7f4fe3400640 1 --2- 172.21.15.37:0/1287933795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d52f0 0x562be94ddfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.086+0000 7f4fe3400640 1 -- 172.21.15.37:0/1287933795 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562be9402a30 con 0x562be94d49d0 2024-08-20T05:09:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.086+0000 7f4fe3e00640 1 --2- 172.21.15.37:0/1287933795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d52f0 0x562be94ddfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:09:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.087+0000 7f4fe3400640 1 --2- 172.21.15.37:0/1287933795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d49d0 0x562be94e0b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4007710 tx=0x7f4fd40044d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8ba2ce12acc2ef4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.087+0000 7f4fcd600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:09:21.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.087+0000 7f4fcd600640 1 -- 172.21.15.37:0/1287933795 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd4004230 con 0x562be94d49d0 2024-08-20T05:09:21.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.087+0000 7f4fcd600640 1 -- 172.21.15.37:0/1287933795 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4fd40045d0 con 0x562be94d49d0 2024-08-20T05:09:21.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.087+0000 7f4fed5cd740 1 -- 172.21.15.37:0/1287933795 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fd4003db0 con 0x562be94d49d0 2024-08-20T05:09:21.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.088+0000 7f4fcd600640 1 -- 172.21.15.37:0/1287933795 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f4fd4030050 con 0x562be94d49d0 2024-08-20T05:09:21.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.090+0000 7f4fed5cd740 10 client.27356 fetch_fsmap learned FSMap version 37 2024-08-20T05:09:21.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.090+0000 7f4fed5cd740 1 -- 172.21.15.37:0/1287933795 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562be94ef930 con 0x562be94d49d0 2024-08-20T05:09:21.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.090+0000 7f4fcd600640 1 -- 172.21.15.37:0/1287933795 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fd4003db0 con 0x562be94d49d0 2024-08-20T05:09:21.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.090+0000 7f4fcd600640 1 -- 172.21.15.37:0/1287933795 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 37) ==== 8374+0+0 (secure 0 0 0) 0x7f4fd401c6a0 con 0x562be94d49d0 2024-08-20T05:09:21.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.091+0000 7f4fed5cd740 10 client.27356 fetch_fsmap finished waiting for FSMap version 37 2024-08-20T05:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.091+0000 7f4fed5cd740 10 client.27356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.091+0000 7f4fed5cd740 20 client.27356 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.091+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/1287933795 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562be94f0ce0 0x562be94f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.091+0000 7f4fed5cd740 4 client.27356 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.091+0000 7f4fed5cd740 1 -- 172.21.15.37:0/1287933795 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562be944d7c0 con 0x562be94f0ce0 2024-08-20T05:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.091+0000 7f4fe3e00640 1 --2- 172.21.15.37:0/1287933795 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562be94f0ce0 0x562be94f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:21.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.092+0000 7f4fe3e00640 1 --2- 172.21.15.37:0/1287933795 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562be94f0ce0 0x562be94f30d0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5900ad0d12c10ea6 server_cookie=e78404a0fa8b7927 in_seq=0 out_seq=0 2024-08-20T05:09:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.092+0000 7f4fcd600640 10 client.27356 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.093+0000 7f4fcd600640 1 -- 172.21.15.37:0/1287933795 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562be944d7c0 con 0x562be94f0ce0 2024-08-20T05:09:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.093+0000 7f4fcd600640 10 client.27356 handle_command_reply: tid=0 2024-08-20T05:09:21.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.093+0000 7f4fed5cd740 1 client.27356 shutdown 2024-08-20T05:09:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.094+0000 7f4fed5cd740 1 -- 172.21.15.37:0/1287933795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d49d0 msgr2=0x562be94e0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.094+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/1287933795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d49d0 0x562be94e0b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4007710 tx=0x7f4fd40044d0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.094+0000 7f4fed5cd740 1 -- 172.21.15.37:0/1287933795 shutdown_connections 2024-08-20T05:09:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.094+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/1287933795 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562be94f0ce0 0x562be94f30d0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.094+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/1287933795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 0x562be94de610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.094+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/1287933795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d52f0 0x562be94ddfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.094+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/1287933795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d49d0 0x562be94e0b90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.094+0000 7f4fed5cd740 1 -- 172.21.15.37:0/1287933795 >> 172.21.15.37:0/1287933795 conn(0x562be94d2800 msgr2=0x562be94d83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.094+0000 7f4fcd600640 0 client.27356 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.094+0000 7f4fed5cd740 1 -- 172.21.15.37:0/1287933795 shutdown_connections 2024-08-20T05:09:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.094+0000 7f4fed5cd740 1 -- 172.21.15.37:0/1287933795 wait complete. 2024-08-20T05:09:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.094+0000 7f4fed5cd740 20 client.27356 trim_cache size 0 max 16384 2024-08-20T05:09:21.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.137+0000 7f4fed5cd740 1 Processor -- start 2024-08-20T05:09:21.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.137+0000 7f4fed5cd740 1 -- start start 2024-08-20T05:09:21.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.137+0000 7f4fed5cd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 0x562be94e00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.137+0000 7f4fed5cd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 0x562be94f8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.137+0000 7f4fed5cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 0x562be94f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.137+0000 7f4fed5cd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe41be620 con 0x562be94d49d0 2024-08-20T05:09:21.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.137+0000 7f4fed5cd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe41c0190 con 0x562be94d52f0 2024-08-20T05:09:21.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.137+0000 7f4fed5cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe41becf0 con 0x562be94e1280 2024-08-20T05:09:21.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.138+0000 7f4fe3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 0x562be94f8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:21.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.138+0000 7f4fe3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 0x562be94f8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44438/0 (socket says 172.21.15.37:44438) 2024-08-20T05:09:21.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.138+0000 7f4fe3e00640 1 -- 172.21.15.37:0/3967711458 learned_addr learned my addr 172.21.15.37:0/3967711458 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:21.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.138+0000 7f4fe3400640 1 --2- 172.21.15.37:0/3967711458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 0x562be94e00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:21.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.138+0000 7f4fe3e00640 1 -- 172.21.15.37:0/3967711458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 msgr2=0x562be94f8d50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:09:21.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.138+0000 7f4fe3e00640 1 --2- 172.21.15.37:0/3967711458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 0x562be94f8d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.138+0000 7f4fe3e00640 1 -- 172.21.15.37:0/3967711458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 msgr2=0x562be94e00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:21.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.142+0000 7f4fe3e00640 1 --2- 172.21.15.37:0/3967711458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 0x562be94e00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.142+0000 7f4fe3e00640 1 -- 172.21.15.37:0/3967711458 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562be94d2630 con 0x562be94d52f0 2024-08-20T05:09:21.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.142+0000 7f4fe3400640 1 --2- 172.21.15.37:0/3967711458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 0x562be94e00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:09:21.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.142+0000 7f4fe3e00640 1 --2- 172.21.15.37:0/3967711458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 0x562be94f8810 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0005e50 tx=0x7f4fd0010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9547b5cd58c51a92 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:21.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.143+0000 7f4fcfe00640 1 -- 172.21.15.37:0/3967711458 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0004220 con 0x562be94d52f0 2024-08-20T05:09:21.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.143+0000 7f4fcfe00640 1 -- 172.21.15.37:0/3967711458 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fd00043c0 con 0x562be94d52f0 2024-08-20T05:09:21.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.143+0000 7f4fcfe00640 1 -- 172.21.15.37:0/3967711458 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0004de0 con 0x562be94d52f0 2024-08-20T05:09:21.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.144+0000 7f4fed5cd740 1 -- 172.21.15.37:0/3967711458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 msgr2=0x562be94f8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:21.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.144+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/3967711458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 0x562be94f8810 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0005e50 tx=0x7f4fd0010800 comp rx=0 tx=0).stop 2024-08-20T05:09:21.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.144+0000 7f4fed5cd740 1 -- 172.21.15.37:0/3967711458 shutdown_connections 2024-08-20T05:09:21.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.145+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/3967711458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 0x562be94f8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.145+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/3967711458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 0x562be94f8810 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.145+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/3967711458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 0x562be94e00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.145+0000 7f4fed5cd740 1 -- 172.21.15.37:0/3967711458 >> 172.21.15.37:0/3967711458 conn(0x562be94d2800 msgr2=0x562be94dd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:21.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.145+0000 7f4fed5cd740 1 -- 172.21.15.37:0/3967711458 shutdown_connections 2024-08-20T05:09:21.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.145+0000 7f4fed5cd740 1 -- 172.21.15.37:0/3967711458 wait complete. 2024-08-20T05:09:21.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.146+0000 7f4fed5cd740 1 -- start start 2024-08-20T05:09:21.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.146+0000 7f4fed5cd740 1 Processor -- start 2024-08-20T05:09:21.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.148+0000 7f4fed5cd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 0x562be94e9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.148+0000 7f4fed5cd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 0x562be94e7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.148+0000 7f4fed5cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 0x562be94e77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.148+0000 7f4fed5cd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe41bfa90 con 0x562be94d49d0 2024-08-20T05:09:21.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.148+0000 7f4fed5cd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe41bf3c0 con 0x562be94d52f0 2024-08-20T05:09:21.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.148+0000 7f4fed5cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe41bc600 con 0x562be94e1280 2024-08-20T05:09:21.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.148+0000 7f4fed5cd740 10 client.0 _ll_register_callbacks cb 0x7f4fd000c390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:21.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.149+0000 7f4fe3400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 0x562be94e9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:21.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.149+0000 7f4fe3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 0x562be94e7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:21.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.149+0000 7f4fe3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 0x562be94e7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44452/0 (socket says 172.21.15.37:44452) 2024-08-20T05:09:21.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.149+0000 7f4fe3e00640 1 -- 172.21.15.37:0/568944044 learned_addr learned my addr 172.21.15.37:0/568944044 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:21.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.149+0000 7f4fe3400640 1 --2- 172.21.15.37:0/568944044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 0x562be94e77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:21.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.150+0000 7f4fe3e00640 1 -- 172.21.15.37:0/568944044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 msgr2=0x562be94e77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:21.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.150+0000 7f4fe3e00640 1 --2- 172.21.15.37:0/568944044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 0x562be94e77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.150+0000 7f4fe3e00640 1 -- 172.21.15.37:0/568944044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 msgr2=0x562be94e9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:21.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.150+0000 7f4fe3e00640 1 --2- 172.21.15.37:0/568944044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 0x562be94e9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.150+0000 7f4fe3e00640 1 -- 172.21.15.37:0/568944044 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562be94e3a60 con 0x562be94d52f0 2024-08-20T05:09:21.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.150+0000 7f4fe3400640 1 --2- 172.21.15.37:0/568944044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 0x562be94e77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:09:21.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.151+0000 7f4fe3e00640 1 --2- 172.21.15.37:0/568944044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 0x562be94e7010 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000c930 tx=0x7f4fd0004960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f06fb38aa92d8e4c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:21.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.151+0000 7f4fcd600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:09:21.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.152+0000 7f4fcd600640 1 -- 172.21.15.37:0/568944044 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0004ff0 con 0x562be94d52f0 2024-08-20T05:09:21.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.152+0000 7f4fcd600640 1 -- 172.21.15.37:0/568944044 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4fd0005190 con 0x562be94d52f0 2024-08-20T05:09:21.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.152+0000 7f4fed5cd740 1 -- 172.21.15.37:0/568944044 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fd00043c0 con 0x562be94d52f0 2024-08-20T05:09:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.152+0000 7f4fcd600640 1 -- 172.21.15.37:0/568944044 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f4fd0038050 con 0x562be94d52f0 2024-08-20T05:09:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.153+0000 7f4fed5cd740 10 client.27362 fetch_fsmap learned FSMap version 37 2024-08-20T05:09:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.153+0000 7f4fed5cd740 1 -- 172.21.15.37:0/568944044 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x562be94d9b90 con 0x562be94d52f0 2024-08-20T05:09:21.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.153+0000 7f4fcd600640 1 -- 172.21.15.37:0/568944044 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fd00043c0 con 0x562be94d52f0 2024-08-20T05:09:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.155+0000 7f4fcd600640 1 -- 172.21.15.37:0/568944044 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 37) ==== 8374+0+0 (secure 0 0 0) 0x7f4fd002d020 con 0x562be94d52f0 2024-08-20T05:09:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.155+0000 7f4fed5cd740 10 client.27362 fetch_fsmap finished waiting for FSMap version 37 2024-08-20T05:09:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.155+0000 7f4fed5cd740 10 client.27362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:09:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.155+0000 7f4fed5cd740 20 client.27362 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.155+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/568944044 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562be955bd00 0x562be955e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.155+0000 7f4fed5cd740 4 client.27362 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T05:09:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.155+0000 7f4fed5cd740 1 -- 172.21.15.37:0/568944044 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562be9449260 con 0x562be955bd00 2024-08-20T05:09:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.156+0000 7f4fe3400640 1 --2- 172.21.15.37:0/568944044 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562be955bd00 0x562be955e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:21.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.156+0000 7f4fe3400640 1 --2- 172.21.15.37:0/568944044 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562be955bd00 0x562be955e120 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e10ccf829be77c34 server_cookie=23fc8a00219e8c36 in_seq=0 out_seq=0 2024-08-20T05:09:21.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.156+0000 7f4fcd600640 10 client.27362 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:21.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.158+0000 7f4fcd600640 1 -- 172.21.15.37:0/568944044 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562be9449260 con 0x562be955bd00 2024-08-20T05:09:21.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.158+0000 7f4fcd600640 10 client.27362 handle_command_reply: tid=0 2024-08-20T05:09:21.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.158+0000 7f4fed5cd740 1 client.27362 shutdown 2024-08-20T05:09:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.159+0000 7f4fed5cd740 1 -- 172.21.15.37:0/568944044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 msgr2=0x562be94e7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:21.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.159+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/568944044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 0x562be94e7010 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000c930 tx=0x7f4fd0004960 comp rx=0 tx=0).stop 2024-08-20T05:09:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.160+0000 7f4fed5cd740 1 -- 172.21.15.37:0/568944044 shutdown_connections 2024-08-20T05:09:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.160+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/568944044 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562be955bd00 0x562be955e120 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.160+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/568944044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562be94e1280 0x562be94e77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.160+0000 7f4fcd600640 0 client.27362 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.160+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/568944044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562be94d52f0 0x562be94e7010 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.160+0000 7f4fed5cd740 1 --2- 172.21.15.37:0/568944044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562be94d49d0 0x562be94e9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.160+0000 7f4fed5cd740 1 -- 172.21.15.37:0/568944044 >> 172.21.15.37:0/568944044 conn(0x562be94d2800 msgr2=0x562be94d10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.160+0000 7f4fed5cd740 1 -- 172.21.15.37:0/568944044 shutdown_connections 2024-08-20T05:09:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.161+0000 7f4fed5cd740 1 -- 172.21.15.37:0/568944044 wait complete. 2024-08-20T05:09:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.161+0000 7f4fed5cd740 20 client.27362 trim_cache size 0 max 16384 2024-08-20T05:09:21.164 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:09:21.164 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-20T05:09:21.164 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "83a892db-a2bd-4447-a7fa-ddf74a27ae63", 2024-08-20T05:09:21.164 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-20T05:09:21.164 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:09:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.163+0000 7f4feac00640 1 -- 172.21.15.37:0/2476866236 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4fc80b3de0 msgr2=0x7f4fc80b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.163+0000 7f4feac00640 1 --2- 172.21.15.37:0/2476866236 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4fc80b3de0 0x7f4fc80b62a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc0cb330 tx=0x7f4fdc03bf70 comp rx=0 tx=0).stop 2024-08-20T05:09:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.163+0000 7f4feac00640 1 -- 172.21.15.37:0/2476866236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fe410f470 msgr2=0x7f4fe406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:21.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.163+0000 7f4feac00640 1 --2- 172.21.15.37:0/2476866236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fe410f470 0x7f4fe406d7b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009850 tx=0x7f4fdc003cd0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.163+0000 7f4feac00640 1 -- 172.21.15.37:0/2476866236 shutdown_connections 2024-08-20T05:09:21.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.163+0000 7f4feac00640 1 --2- 172.21.15.37:0/2476866236 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4fc80b3de0 0x7f4fc80b62a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.163+0000 7f4feac00640 1 --2- 172.21.15.37:0/2476866236 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4fe410f470 0x7f4fe406d7b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.163+0000 7f4feac00640 1 --2- 172.21.15.37:0/2476866236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fe410eaf0 0x7f4fe40749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.163+0000 7f4feac00640 1 --2- 172.21.15.37:0/2476866236 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4fe41090e0 0x7f4fe4074460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:21.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.163+0000 7f4feac00640 1 -- 172.21.15.37:0/2476866236 >> 172.21.15.37:0/2476866236 conn(0x7f4fe4078760 msgr2=0x7f4fe407ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:21.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.164+0000 7f4feac00640 1 -- 172.21.15.37:0/2476866236 shutdown_connections 2024-08-20T05:09:21.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:21.164+0000 7f4feac00640 1 -- 172.21.15.37:0/2476866236 wait complete. 2024-08-20T05:09:21.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:21 smithi037 ceph-mon[17265]: scrub queued for path: / 2024-08-20T05:09:21.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:21 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:21.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:21 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:09:21.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:21 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:09:21.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:21 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:21.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:21 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:09:21.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:21 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:09:21.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:21 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:21.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:21 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:21.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:21 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:09:21.727 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:21 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:09:21.728 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:21 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:21.728 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:21 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:21 smithi135 ceph-mon[22342]: scrub queued for path: / 2024-08-20T05:09:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:21 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:21 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:09:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:21 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:09:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:21 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:21 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:09:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:21 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:09:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:21 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:21 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:21 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:09:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:21 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:09:21.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:21 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:21.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:21 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:21 smithi130 ceph-mon[22007]: scrub queued for path: / 2024-08-20T05:09:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:21 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:21 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:09:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:21 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:09:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:21 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:21 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:09:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:21 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:09:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:21 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:21 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:21 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:09:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:21 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:09:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:21 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:21 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:22.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:09:22.465 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:22 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:09:22.465 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:22 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:09:22.465 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:22 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:22.465 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:22 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:22.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:22 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:22.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:22 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:09:22.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:22 smithi037 ceph-mon[17265]: pgmap v615: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 14 MiB/s wr, 598 op/s 2024-08-20T05:09:22.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:22 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:09:22.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:22 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:09:22.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:22 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:22.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:22 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:22.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:22 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:22.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:22 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:09:22.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:22 smithi135 ceph-mon[22342]: pgmap v615: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 14 MiB/s wr, 598 op/s 2024-08-20T05:09:22.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:22 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:09:22.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:22 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:09:22.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:22 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:22.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:22 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:22.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:22 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:09:22.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:22 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:09:22.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:22 smithi130 ceph-mon[22007]: pgmap v615: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 14 MiB/s wr, 598 op/s 2024-08-20T05:09:22.964 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:09:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 385.0 s, 672.9 tps, lat 147.077 ms stddev 201.429 2024-08-20T05:09:23.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.855+0000 7f19fb600640 1 -- 172.21.15.37:0/1623213417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19f41039a0 msgr2=0x7f19f4103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:23.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.855+0000 7f19fb600640 1 --2- 172.21.15.37:0/1623213417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19f41039a0 0x7f19f4103d80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009900 tx=0x7f19e802a400 comp rx=0 tx=0).stop 2024-08-20T05:09:23.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.855+0000 7f19fb600640 1 -- 172.21.15.37:0/1623213417 shutdown_connections 2024-08-20T05:09:23.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.855+0000 7f19fb600640 1 --2- 172.21.15.37:0/1623213417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19f410ce00 0x7f19f410f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.855+0000 7f19fb600640 1 --2- 172.21.15.37:0/1623213417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19f41042c0 0x7f19f410c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.855+0000 7f19fb600640 1 --2- 172.21.15.37:0/1623213417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19f41039a0 0x7f19f4103d80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.855+0000 7f19fb600640 1 -- 172.21.15.37:0/1623213417 >> 172.21.15.37:0/1623213417 conn(0x7f19f40fd400 msgr2=0x7f19f40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:23.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.856+0000 7f19fb600640 1 -- 172.21.15.37:0/1623213417 shutdown_connections 2024-08-20T05:09:23.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.857+0000 7f19fb600640 1 -- 172.21.15.37:0/1623213417 wait complete. 2024-08-20T05:09:23.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.858+0000 7f19fb600640 1 Processor -- start 2024-08-20T05:09:23.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.858+0000 7f19fb600640 1 -- start start 2024-08-20T05:09:23.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.858+0000 7f19fb600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19f41039a0 0x7f19f410bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.858+0000 7f19fb600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19f41042c0 0x7f19f410c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.858+0000 7f19fb600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19f410ce00 0x7f19f41a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.858+0000 7f19fb600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4112ac0 con 0x7f19f41042c0 2024-08-20T05:09:23.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.858+0000 7f19fb600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4112940 con 0x7f19f41039a0 2024-08-20T05:09:23.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.858+0000 7f19fb600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4112c40 con 0x7f19f410ce00 2024-08-20T05:09:23.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.859+0000 7f19f8c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19f41039a0 0x7f19f410bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:23.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.859+0000 7f19f8c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19f41039a0 0x7f19f410bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37642/0 (socket says 172.21.15.37:37642) 2024-08-20T05:09:23.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.859+0000 7f19f8c00640 1 -- 172.21.15.37:0/659611913 learned_addr learned my addr 172.21.15.37:0/659611913 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:23.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.859+0000 7f19f9600640 1 --2- 172.21.15.37:0/659611913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19f410ce00 0x7f19f41a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:23.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.859+0000 7f19f3e00640 1 --2- 172.21.15.37:0/659611913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19f41042c0 0x7f19f410c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:23.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.859+0000 7f19f8c00640 1 -- 172.21.15.37:0/659611913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19f410ce00 msgr2=0x7f19f41a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:23.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.859+0000 7f19f8c00640 1 --2- 172.21.15.37:0/659611913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19f410ce00 0x7f19f41a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.859+0000 7f19f8c00640 1 -- 172.21.15.37:0/659611913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19f41042c0 msgr2=0x7f19f410c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.859+0000 7f19f8c00640 1 --2- 172.21.15.37:0/659611913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19f41042c0 0x7f19f410c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.859+0000 7f19f8c00640 1 -- 172.21.15.37:0/659611913 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f41a2430 con 0x7f19f41039a0 2024-08-20T05:09:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.859+0000 7f19f3e00640 1 --2- 172.21.15.37:0/659611913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19f41042c0 0x7f19f410c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:09:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.859+0000 7f19f8c00640 1 --2- 172.21.15.37:0/659611913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19f41039a0 0x7f19f410bb70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f19e8005ab0 tx=0x7f19e8003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.860+0000 7f19f1600640 1 -- 172.21.15.37:0/659611913 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e803f070 con 0x7f19f41039a0 2024-08-20T05:09:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.860+0000 7f19f1600640 1 -- 172.21.15.37:0/659611913 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19e8031d60 con 0x7f19f41039a0 2024-08-20T05:09:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.860+0000 7f19fb600640 1 -- 172.21.15.37:0/659611913 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f41a26c0 con 0x7f19f41039a0 2024-08-20T05:09:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.860+0000 7f19f1600640 1 -- 172.21.15.37:0/659611913 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8035030 con 0x7f19f41039a0 2024-08-20T05:09:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.860+0000 7f19fb600640 1 -- 172.21.15.37:0/659611913 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f41ac070 con 0x7f19f41039a0 2024-08-20T05:09:23.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.866+0000 7f19fdfc8740 1 Processor -- start 2024-08-20T05:09:23.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.866+0000 7f19fdfc8740 1 -- start start 2024-08-20T05:09:23.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.866+0000 7f19fdfc8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746dae950 0x55a746daed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.866+0000 7f19fdfc8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746daf270 0x55a746dbacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.866+0000 7f19fdfc8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746dbb200 0x55a746dbd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.866+0000 7f19fdfc8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a746d24a60 con 0x55a746dbb200 2024-08-20T05:09:23.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.866+0000 7f19fdfc8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a746d13f60 con 0x55a746dae950 2024-08-20T05:09:23.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.866+0000 7f19fdfc8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a746d17fa0 con 0x55a746daf270 2024-08-20T05:09:23.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.866+0000 7f19f1600640 1 -- 172.21.15.37:0/659611913 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f19e8042070 con 0x7f19f41039a0 2024-08-20T05:09:23.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.867+0000 7f19f9600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746dae950 0x55a746daed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:23.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.867+0000 7f19f9600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746dae950 0x55a746daed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37656/0 (socket says 172.21.15.37:37656) 2024-08-20T05:09:23.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.867+0000 7f19f9600640 1 -- 172.21.15.37:0/3141644736 learned_addr learned my addr 172.21.15.37:0/3141644736 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:23.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.867+0000 7f19f3e00640 1 --2- 172.21.15.37:0/3141644736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746dbb200 0x55a746dbd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:23.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.867+0000 7f19f8c00640 1 --2- 172.21.15.37:0/3141644736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746daf270 0x55a746dbacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:23.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.867+0000 7f19f9600640 1 -- 172.21.15.37:0/3141644736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746daf270 msgr2=0x55a746dbacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:23.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.867+0000 7f19f9600640 1 --2- 172.21.15.37:0/3141644736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746daf270 0x55a746dbacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.867+0000 7f19f9600640 1 -- 172.21.15.37:0/3141644736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746dbb200 msgr2=0x55a746dbd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:23.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.867+0000 7f19f9600640 1 --2- 172.21.15.37:0/3141644736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746dbb200 0x55a746dbd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.867+0000 7f19f9600640 1 -- 172.21.15.37:0/3141644736 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a746cba3e0 con 0x55a746dae950 2024-08-20T05:09:23.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.867+0000 7f19f3e00640 1 --2- 172.21.15.37:0/3141644736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746dbb200 0x55a746dbd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:09:23.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.867+0000 7f19f8c00640 1 --2- 172.21.15.37:0/3141644736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746daf270 0x55a746dbacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:09:23.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.868+0000 7f19f9600640 1 --2- 172.21.15.37:0/3141644736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746dae950 0x55a746daed30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f19ec010370 tx=0x7f19ec010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f36999ae662e83c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:23.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.869+0000 7f19e5c00640 1 -- 172.21.15.37:0/3141644736 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec016070 con 0x55a746dae950 2024-08-20T05:09:23.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.869+0000 7f19e5c00640 1 -- 172.21.15.37:0/3141644736 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19ec004d20 con 0x55a746dae950 2024-08-20T05:09:23.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.869+0000 7f19e5c00640 1 -- 172.21.15.37:0/3141644736 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec005420 con 0x55a746dae950 2024-08-20T05:09:23.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.870+0000 7f19f1600640 1 --2- 172.21.15.37:0/659611913 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f19dc0b3c50 0x7f19dc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.870+0000 7f19f8c00640 1 --2- 172.21.15.37:0/659611913 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f19dc0b3c50 0x7f19dc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:23.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.870+0000 7f19f1600640 1 -- 172.21.15.37:0/659611913 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f19e8104830 con 0x7f19f41039a0 2024-08-20T05:09:23.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.870+0000 7f19fdfc8740 1 -- 172.21.15.37:0/3141644736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746dae950 msgr2=0x55a746daed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:23.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.870+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/3141644736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746dae950 0x55a746daed30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f19ec010370 tx=0x7f19ec010830 comp rx=0 tx=0).stop 2024-08-20T05:09:23.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.871+0000 7f19fdfc8740 1 -- 172.21.15.37:0/3141644736 shutdown_connections 2024-08-20T05:09:23.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.871+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/3141644736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746dbb200 0x55a746dbd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.871+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/3141644736 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746daf270 0x55a746dbacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.871+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/3141644736 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746dae950 0x55a746daed30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.871+0000 7f19fdfc8740 1 -- 172.21.15.37:0/3141644736 >> 172.21.15.37:0/3141644736 conn(0x55a746dac780 msgr2=0x55a746dad920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:23.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.871+0000 7f19f8c00640 1 --2- 172.21.15.37:0/659611913 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f19dc0b3c50 0x7f19dc0b6110 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f19e80c7400 tx=0x7f19e8031f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:23.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.871+0000 7f19fdfc8740 1 -- 172.21.15.37:0/3141644736 shutdown_connections 2024-08-20T05:09:23.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.871+0000 7f19fdfc8740 1 -- 172.21.15.37:0/3141644736 wait complete. 2024-08-20T05:09:23.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.871+0000 7f19fdfc8740 1 -- start start 2024-08-20T05:09:23.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.872+0000 7f19fdfc8740 1 Processor -- start 2024-08-20T05:09:23.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.872+0000 7f19fdfc8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746dae950 0x55a746dbaa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.872+0000 7f19fdfc8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746daf270 0x55a746db7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.873+0000 7f19fdfc8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746dbb200 0x55a746db8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.873+0000 7f19fdfc8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a746b76700 con 0x55a746dbb200 2024-08-20T05:09:23.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.873+0000 7f19fdfc8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a746caf250 con 0x55a746daf270 2024-08-20T05:09:23.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.873+0000 7f19fdfc8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a746dbde80 con 0x55a746dae950 2024-08-20T05:09:23.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.873+0000 7f19fdfc8740 10 client.0 _ll_register_callbacks cb 0x55a746d0e180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:23.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.873+0000 7f19f3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746daf270 0x55a746db7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:23.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.873+0000 7f19f3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746daf270 0x55a746db7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37666/0 (socket says 172.21.15.37:37666) 2024-08-20T05:09:23.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.873+0000 7f19f3e00640 1 -- 172.21.15.37:0/4032813129 learned_addr learned my addr 172.21.15.37:0/4032813129 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:23.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.874+0000 7f19f3e00640 1 -- 172.21.15.37:0/4032813129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746dae950 msgr2=0x55a746dbaa80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:09:23.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.874+0000 7f19f3e00640 1 --2- 172.21.15.37:0/4032813129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746dae950 0x55a746dbaa80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.874+0000 7f19f3e00640 1 -- 172.21.15.37:0/4032813129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746dbb200 msgr2=0x55a746db8470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:09:23.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.875+0000 7f19f3e00640 1 --2- 172.21.15.37:0/4032813129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746dbb200 0x55a746db8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.875+0000 7f19f3e00640 1 -- 172.21.15.37:0/4032813129 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a746a73650 con 0x55a746daf270 2024-08-20T05:09:23.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.875+0000 7f19f3e00640 1 --2- 172.21.15.37:0/4032813129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746daf270 0x55a746db7ed0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f19e00124f0 tx=0x7f19e00129b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc450dcb0208501c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:23.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.876+0000 7f19da000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:09:23.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.876+0000 7f19da000640 1 -- 172.21.15.37:0/4032813129 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e0005220 con 0x55a746daf270 2024-08-20T05:09:23.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.876+0000 7f19da000640 1 -- 172.21.15.37:0/4032813129 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f19e00053c0 con 0x55a746daf270 2024-08-20T05:09:23.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.876+0000 7f19fdfc8740 1 -- 172.21.15.37:0/4032813129 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19ec004d20 con 0x55a746daf270 2024-08-20T05:09:23.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.877+0000 7f19da000640 1 -- 172.21.15.37:0/4032813129 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f19e0005600 con 0x55a746daf270 2024-08-20T05:09:23.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.877+0000 7f19fdfc8740 10 client.27374 fetch_fsmap learned FSMap version 38 2024-08-20T05:09:23.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.877+0000 7f19fdfc8740 1 -- 172.21.15.37:0/4032813129 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a746dc97b0 con 0x55a746daf270 2024-08-20T05:09:23.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.877+0000 7f19da000640 1 -- 172.21.15.37:0/4032813129 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19ec004d20 con 0x55a746daf270 2024-08-20T05:09:23.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.877+0000 7f19da000640 1 -- 172.21.15.37:0/4032813129 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 38) ==== 8386+0+0 (secure 0 0 0) 0x7f19e000f040 con 0x55a746daf270 2024-08-20T05:09:23.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.878+0000 7f19fdfc8740 10 client.27374 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T05:09:23.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.878+0000 7f19fdfc8740 10 client.27374 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:09:23.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.878+0000 7f19fdfc8740 20 client.27374 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:23.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.878+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/4032813129 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a746dcac30 0x55a746dcd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.878+0000 7f19fdfc8740 4 client.27374 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:09:23.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.878+0000 7f19fdfc8740 1 -- 172.21.15.37:0/4032813129 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a746d269b0 con 0x55a746dcac30 2024-08-20T05:09:23.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.879+0000 7f19f9600640 1 --2- 172.21.15.37:0/4032813129 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a746dcac30 0x55a746dcd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:23.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.879+0000 7f19f9600640 1 --2- 172.21.15.37:0/4032813129 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a746dcac30 0x55a746dcd0b0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df60b6818f5cbd33 server_cookie=fb1b1fef7734276 in_seq=0 out_seq=0 2024-08-20T05:09:23.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.879+0000 7f19da000640 10 client.27374 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:23.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.880+0000 7f19da000640 1 -- 172.21.15.37:0/4032813129 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a746d269b0 con 0x55a746dcac30 2024-08-20T05:09:23.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.880+0000 7f19da000640 10 client.27374 handle_command_reply: tid=0 2024-08-20T05:09:23.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.881+0000 7f19fdfc8740 1 client.27374 shutdown 2024-08-20T05:09:23.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.881+0000 7f19fdfc8740 1 -- 172.21.15.37:0/4032813129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746daf270 msgr2=0x55a746db7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:23.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.881+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/4032813129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746daf270 0x55a746db7ed0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f19e00124f0 tx=0x7f19e00129b0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.881+0000 7f19fdfc8740 1 -- 172.21.15.37:0/4032813129 shutdown_connections 2024-08-20T05:09:23.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.881+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/4032813129 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a746dcac30 0x55a746dcd0b0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.881+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/4032813129 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746dbb200 0x55a746db8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.881+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/4032813129 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746daf270 0x55a746db7ed0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.881+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/4032813129 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746dae950 0x55a746dbaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.881+0000 7f19fdfc8740 1 -- 172.21.15.37:0/4032813129 >> 172.21.15.37:0/4032813129 conn(0x55a746dac780 msgr2=0x55a746db22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.881+0000 7f19da000640 0 client.27374 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.881+0000 7f19fdfc8740 1 -- 172.21.15.37:0/4032813129 shutdown_connections 2024-08-20T05:09:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.881+0000 7f19fdfc8740 1 -- 172.21.15.37:0/4032813129 wait complete. 2024-08-20T05:09:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.882+0000 7f19fdfc8740 20 client.27374 trim_cache size 0 max 16384 2024-08-20T05:09:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.907+0000 7f19fdfc8740 1 Processor -- start 2024-08-20T05:09:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.907+0000 7f19fdfc8740 1 -- start start 2024-08-20T05:09:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.908+0000 7f19fdfc8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746dae950 0x55a746dab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.908+0000 7f19f9600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746dae950 0x55a746dab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.908+0000 7f19f9600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746dae950 0x55a746dab7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37682/0 (socket says 172.21.15.37:37682) 2024-08-20T05:09:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.908+0000 7f19fdfc8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746daf270 0x55a746dabd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.908+0000 7f19f9600640 1 -- 172.21.15.37:0/1338185608 learned_addr learned my addr 172.21.15.37:0/1338185608 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.908+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/1338185608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746dbb200 0x55a746dd2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.908+0000 7f19fdfc8740 1 -- 172.21.15.37:0/1338185608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41b5f50 con 0x55a746dbb200 2024-08-20T05:09:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.908+0000 7f19fdfc8740 1 -- 172.21.15.37:0/1338185608 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41b7b50 con 0x55a746dae950 2024-08-20T05:09:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.908+0000 7f19fdfc8740 1 -- 172.21.15.37:0/1338185608 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41b6620 con 0x55a746daf270 2024-08-20T05:09:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.908+0000 7f19f3e00640 1 --2- 172.21.15.37:0/1338185608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746daf270 0x55a746dabd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.909+0000 7f19f3e00640 1 -- 172.21.15.37:0/1338185608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746dae950 msgr2=0x55a746dab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.909+0000 7f19f3e00640 1 --2- 172.21.15.37:0/1338185608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746dae950 0x55a746dab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.909+0000 7f19f3e00640 1 -- 172.21.15.37:0/1338185608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746dbb200 msgr2=0x55a746dd2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.909+0000 7f19f3e00640 1 --2- 172.21.15.37:0/1338185608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746dbb200 0x55a746dd2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.909+0000 7f19f3e00640 1 -- 172.21.15.37:0/1338185608 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a746dac5b0 con 0x55a746daf270 2024-08-20T05:09:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.909+0000 7f19f3e00640 1 --2- 172.21.15.37:0/1338185608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746daf270 0x55a746dabd30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f19e0010df0 tx=0x7f19e00058f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66d0d13d13706457 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.910+0000 7f19e5200640 1 -- 172.21.15.37:0/1338185608 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e0010780 con 0x55a746daf270 2024-08-20T05:09:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.910+0000 7f19e5200640 1 -- 172.21.15.37:0/1338185608 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19e0010920 con 0x55a746daf270 2024-08-20T05:09:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.910+0000 7f19e5200640 1 -- 172.21.15.37:0/1338185608 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e000f440 con 0x55a746daf270 2024-08-20T05:09:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.911+0000 7f19fdfc8740 1 -- 172.21.15.37:0/1338185608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746daf270 msgr2=0x55a746dabd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.911+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/1338185608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746daf270 0x55a746dabd30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f19e0010df0 tx=0x7f19e00058f0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.911+0000 7f19fdfc8740 1 -- 172.21.15.37:0/1338185608 shutdown_connections 2024-08-20T05:09:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.911+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/1338185608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746dbb200 0x55a746dd2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.911+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/1338185608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746daf270 0x55a746dabd30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.911+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/1338185608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746dae950 0x55a746dab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.911+0000 7f19fdfc8740 1 -- 172.21.15.37:0/1338185608 >> 172.21.15.37:0/1338185608 conn(0x55a746dac780 msgr2=0x55a746dab0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.911+0000 7f19fdfc8740 1 -- 172.21.15.37:0/1338185608 shutdown_connections 2024-08-20T05:09:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.911+0000 7f19fdfc8740 1 -- 172.21.15.37:0/1338185608 wait complete. 2024-08-20T05:09:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.912+0000 7f19fdfc8740 1 -- start start 2024-08-20T05:09:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.912+0000 7f19fdfc8740 1 Processor -- start 2024-08-20T05:09:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.913+0000 7f19fdfc8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746dae950 0x55a746dc35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.913+0000 7f19fdfc8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746daf270 0x55a746dc0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.913+0000 7f19fdfc8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746dbb200 0x55a746dc1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.913+0000 7f19fdfc8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41b73c0 con 0x55a746daf270 2024-08-20T05:09:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.913+0000 7f19fdfc8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41b6cf0 con 0x55a746dae950 2024-08-20T05:09:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.913+0000 7f19fdfc8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41b3f30 con 0x55a746dbb200 2024-08-20T05:09:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.913+0000 7f19fdfc8740 10 client.0 _ll_register_callbacks cb 0x7f19f406b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.914+0000 7f19f3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746daf270 0x55a746dc0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:23.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.916+0000 7f19f3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746daf270 0x55a746dc0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42726/0 (socket says 172.21.15.37:42726) 2024-08-20T05:09:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.916+0000 7f19f3e00640 1 -- 172.21.15.37:0/1528084568 learned_addr learned my addr 172.21.15.37:0/1528084568 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.916+0000 7f19f9600640 1 --2- 172.21.15.37:0/1528084568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746dbb200 0x55a746dc1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.917+0000 7f19f9600640 1 -- 172.21.15.37:0/1528084568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746dae950 msgr2=0x55a746dc35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.917+0000 7f19f9600640 1 --2- 172.21.15.37:0/1528084568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746dae950 0x55a746dc35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.917+0000 7f19f9600640 1 -- 172.21.15.37:0/1528084568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746daf270 msgr2=0x55a746dc0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.917+0000 7f19f9600640 1 --2- 172.21.15.37:0/1528084568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746daf270 0x55a746dc0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.917+0000 7f19f9600640 1 -- 172.21.15.37:0/1528084568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a746dad200 con 0x55a746dbb200 2024-08-20T05:09:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.917+0000 7f19f9600640 1 --2- 172.21.15.37:0/1528084568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746dbb200 0x55a746dc1030 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009640 tx=0x7f19ec003b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bb4ed0cb79a9b3e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.917+0000 7f19da000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:09:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.919+0000 7f19da000640 1 -- 172.21.15.37:0/1528084568 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec029020 con 0x55a746dbb200 2024-08-20T05:09:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.919+0000 7f19da000640 1 -- 172.21.15.37:0/1528084568 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f19ec012510 con 0x55a746dbb200 2024-08-20T05:09:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.920+0000 7f19fdfc8740 1 -- 172.21.15.37:0/1528084568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19e0010920 con 0x55a746dbb200 2024-08-20T05:09:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.920+0000 7f19da000640 1 -- 172.21.15.37:0/1528084568 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f19ec016040 con 0x55a746dbb200 2024-08-20T05:09:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.921+0000 7f19fdfc8740 10 client.27388 fetch_fsmap learned FSMap version 38 2024-08-20T05:09:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.921+0000 7f19fdfc8740 1 -- 172.21.15.37:0/1528084568 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x55a746e356a0 con 0x55a746dbb200 2024-08-20T05:09:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.922+0000 7f19da000640 1 -- 172.21.15.37:0/1528084568 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19e0010920 con 0x55a746dbb200 2024-08-20T05:09:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.922+0000 7f19da000640 1 -- 172.21.15.37:0/1528084568 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 38) ==== 8386+0+0 (secure 0 0 0) 0x7f19ec00f040 con 0x55a746dbb200 2024-08-20T05:09:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.923+0000 7f19fdfc8740 10 client.27388 fetch_fsmap finished waiting for FSMap version 38 2024-08-20T05:09:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.923+0000 7f19fdfc8740 10 client.27388 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:09:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.923+0000 7f19fdfc8740 20 client.27388 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.923+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/1528084568 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a746e35a80 0x55a746e37ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.923+0000 7f19fdfc8740 4 client.27388 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:09:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.923+0000 7f19fdfc8740 1 -- 172.21.15.37:0/1528084568 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a746d22450 con 0x55a746e35a80 2024-08-20T05:09:23.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.923+0000 7f19f3e00640 1 --2- 172.21.15.37:0/1528084568 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a746e35a80 0x55a746e37ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.927+0000 7f19f3e00640 1 --2- 172.21.15.37:0/1528084568 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a746e35a80 0x55a746e37ea0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9553bbe3835c1efa server_cookie=4ab7d64eabcf716e in_seq=0 out_seq=0 2024-08-20T05:09:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.927+0000 7f19da000640 10 client.27388 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.928+0000 7f19da000640 1 -- 172.21.15.37:0/1528084568 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a746d22450 con 0x55a746e35a80 2024-08-20T05:09:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.928+0000 7f19da000640 10 client.27388 handle_command_reply: tid=0 2024-08-20T05:09:23.934 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:09:23.934 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T05:09:23.934 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-20T05:09:23.934 INFO:teuthology.orchestra.run.smithi037.stdout: "83a892db-a2bd-4447-a7fa-ddf74a27ae63": { 2024-08-20T05:09:23.934 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-20T05:09:23.934 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "83a892db-a2bd-4447-a7fa-ddf74a27ae63", 2024-08-20T05:09:23.935 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-20T05:09:23.935 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:09:23.935 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:09:23.935 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:09:23.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.928+0000 7f19fdfc8740 1 client.27388 shutdown 2024-08-20T05:09:23.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.930+0000 7f19fdfc8740 1 -- 172.21.15.37:0/1528084568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746dbb200 msgr2=0x55a746dc1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:23.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.930+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/1528084568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746dbb200 0x55a746dc1030 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009640 tx=0x7f19ec003b60 comp rx=0 tx=0).stop 2024-08-20T05:09:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.930+0000 7f19fdfc8740 1 -- 172.21.15.37:0/1528084568 shutdown_connections 2024-08-20T05:09:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.930+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/1528084568 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a746e35a80 0x55a746e37ea0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.930+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/1528084568 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a746dbb200 0x55a746dc1030 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.930+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/1528084568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a746daf270 0x55a746dc0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.930+0000 7f19fdfc8740 1 --2- 172.21.15.37:0/1528084568 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a746dae950 0x55a746dc35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.930+0000 7f19fdfc8740 1 -- 172.21.15.37:0/1528084568 >> 172.21.15.37:0/1528084568 conn(0x55a746dac780 msgr2=0x55a746dab900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.930+0000 7f19da000640 0 client.27388 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.930+0000 7f19fdfc8740 1 -- 172.21.15.37:0/1528084568 shutdown_connections 2024-08-20T05:09:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.931+0000 7f19fdfc8740 1 -- 172.21.15.37:0/1528084568 wait complete. 2024-08-20T05:09:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.931+0000 7f19fdfc8740 20 client.27388 trim_cache size 0 max 16384 2024-08-20T05:09:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.933+0000 7f19fb600640 1 -- 172.21.15.37:0/659611913 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f19dc0b3c50 msgr2=0x7f19dc0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:23.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.933+0000 7f19fb600640 1 --2- 172.21.15.37:0/659611913 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f19dc0b3c50 0x7f19dc0b6110 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f19e80c7400 tx=0x7f19e8031f10 comp rx=0 tx=0).stop 2024-08-20T05:09:23.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.933+0000 7f19fb600640 1 -- 172.21.15.37:0/659611913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19f41039a0 msgr2=0x7f19f410bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:23.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.933+0000 7f19fb600640 1 --2- 172.21.15.37:0/659611913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19f41039a0 0x7f19f410bb70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f19e8005ab0 tx=0x7f19e8003c80 comp rx=0 tx=0).stop 2024-08-20T05:09:23.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.934+0000 7f19fb600640 1 -- 172.21.15.37:0/659611913 shutdown_connections 2024-08-20T05:09:23.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.934+0000 7f19fb600640 1 --2- 172.21.15.37:0/659611913 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f19dc0b3c50 0x7f19dc0b6110 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.934+0000 7f19fb600640 1 --2- 172.21.15.37:0/659611913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f19f410ce00 0x7f19f41a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.934+0000 7f19fb600640 1 --2- 172.21.15.37:0/659611913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19f41042c0 0x7f19f410c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.934+0000 7f19fb600640 1 --2- 172.21.15.37:0/659611913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f19f41039a0 0x7f19f410bb70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:23.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.934+0000 7f19fb600640 1 -- 172.21.15.37:0/659611913 >> 172.21.15.37:0/659611913 conn(0x7f19f40fd400 msgr2=0x7f19f410efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:23.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.935+0000 7f19fb600640 1 -- 172.21.15.37:0/659611913 shutdown_connections 2024-08-20T05:09:23.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:23.935+0000 7f19fb600640 1 -- 172.21.15.37:0/659611913 wait complete. 2024-08-20T05:09:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.595+0000 7fb8b5e00640 1 -- 172.21.15.37:0/460698042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8b0109dc0 msgr2=0x7fb8b010a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.595+0000 7fb8b5e00640 1 --2- 172.21.15.37:0/460698042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8b0109dc0 0x7fb8b010a240 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009890 tx=0x7fb89c02a380 comp rx=0 tx=0).stop 2024-08-20T05:09:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.596+0000 7fb8b5e00640 1 -- 172.21.15.37:0/460698042 shutdown_connections 2024-08-20T05:09:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.596+0000 7fb8b5e00640 1 --2- 172.21.15.37:0/460698042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8b010a780 0x7fb8b0111100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.596+0000 7fb8b5e00640 1 --2- 172.21.15.37:0/460698042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8b0109dc0 0x7fb8b010a240 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.596+0000 7fb8b5e00640 1 --2- 172.21.15.37:0/460698042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8b0108f90 0x7fb8b0109390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.596+0000 7fb8b5e00640 1 -- 172.21.15.37:0/460698042 >> 172.21.15.37:0/460698042 conn(0x7fb8b0078030 msgr2=0x7fb8b007a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.597+0000 7fb8b5e00640 1 -- 172.21.15.37:0/460698042 shutdown_connections 2024-08-20T05:09:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.597+0000 7fb8b5e00640 1 -- 172.21.15.37:0/460698042 wait complete. 2024-08-20T05:09:24.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.599+0000 7fb8b5e00640 1 Processor -- start 2024-08-20T05:09:24.602 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.599+0000 7fb8b5e00640 1 -- start start 2024-08-20T05:09:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.599+0000 7fb8b5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8b0108f90 0x7fb8b0080740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.600+0000 7fb8b5e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8b0109dc0 0x7fb8b0080d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.600+0000 7fb8aea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8b0108f90 0x7fb8b0080740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.600+0000 7fb8b5e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8b010a780 0x7fb8b00819c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.600+0000 7fb8b5e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b0114910 con 0x7fb8b0108f90 2024-08-20T05:09:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.600+0000 7fb8b5e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b0114790 con 0x7fb8b0109dc0 2024-08-20T05:09:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.600+0000 7fb8b5e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b0114a90 con 0x7fb8b010a780 2024-08-20T05:09:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.600+0000 7fb8aea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8b0108f90 0x7fb8b0080740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42738/0 (socket says 172.21.15.37:42738) 2024-08-20T05:09:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.600+0000 7fb8aea00640 1 -- 172.21.15.37:0/1464593171 learned_addr learned my addr 172.21.15.37:0/1464593171 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.600+0000 7fb8ae000640 1 --2- 172.21.15.37:0/1464593171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8b0109dc0 0x7fb8b0080d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:24.603 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.600+0000 7fb8af400640 1 --2- 172.21.15.37:0/1464593171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8b010a780 0x7fb8b00819c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.601+0000 7fb8aea00640 1 -- 172.21.15.37:0/1464593171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8b010a780 msgr2=0x7fb8b00819c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.601+0000 7fb8aea00640 1 --2- 172.21.15.37:0/1464593171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8b010a780 0x7fb8b00819c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.601+0000 7fb8aea00640 1 -- 172.21.15.37:0/1464593171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8b0109dc0 msgr2=0x7fb8b0080d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.601+0000 7fb8aea00640 1 --2- 172.21.15.37:0/1464593171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8b0109dc0 0x7fb8b0080d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.601+0000 7fb8aea00640 1 -- 172.21.15.37:0/1464593171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8b0082280 con 0x7fb8b0108f90 2024-08-20T05:09:24.604 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.602+0000 7fb8aea00640 1 --2- 172.21.15.37:0/1464593171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8b0108f90 0x7fb8b0080740 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000e9f0 tx=0x7fb8a000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:24.605 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.604+0000 7fb8b4a00640 1 -- 172.21.15.37:0/1464593171 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a000ccc0 con 0x7fb8b0108f90 2024-08-20T05:09:24.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.604+0000 7fb8b4a00640 1 -- 172.21.15.37:0/1464593171 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8a00054d0 con 0x7fb8b0108f90 2024-08-20T05:09:24.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.604+0000 7fb8b5e00640 1 -- 172.21.15.37:0/1464593171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8b0082570 con 0x7fb8b0108f90 2024-08-20T05:09:24.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.604+0000 7fb8b4a00640 1 -- 172.21.15.37:0/1464593171 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0010430 con 0x7fb8b0108f90 2024-08-20T05:09:24.606 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.604+0000 7fb8b5e00640 1 -- 172.21.15.37:0/1464593171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8b0082c10 con 0x7fb8b0108f90 2024-08-20T05:09:24.611 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.610+0000 7fb8b8dd7740 1 Processor -- start 2024-08-20T05:09:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.610+0000 7fb8b8dd7740 1 -- start start 2024-08-20T05:09:24.612 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.610+0000 7fb8b8dd7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554ad610 0x55c7554afa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.610+0000 7fb8b8dd7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554aff40 0x55c7554b2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.610+0000 7fb8b8dd7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b2980 0x55c7554b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.611+0000 7fb8b8dd7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c755420210 con 0x55c7554aff40 2024-08-20T05:09:24.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.611+0000 7fb8b8dd7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c75540f710 con 0x55c7554b2980 2024-08-20T05:09:24.613 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.611+0000 7fb8b8dd7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c755413750 con 0x55c7554ad610 2024-08-20T05:09:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.611+0000 7fb8af400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554ad610 0x55c7554afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.611+0000 7fb8ae000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b2980 0x55c7554b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.611+0000 7fb8ae000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b2980 0x55c7554b4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37712/0 (socket says 172.21.15.37:37712) 2024-08-20T05:09:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.614+0000 7fb8af400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554ad610 0x55c7554afa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:38880/0 (socket says 172.21.15.37:38880) 2024-08-20T05:09:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.614+0000 7fb8ae000640 1 -- 172.21.15.37:0/3866347827 learned_addr learned my addr 172.21.15.37:0/3866347827 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.614+0000 7fb8ae000640 1 -- 172.21.15.37:0/3866347827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554ad610 msgr2=0x55c7554afa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.614+0000 7fb8ae000640 1 --2- 172.21.15.37:0/3866347827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554ad610 0x55c7554afa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.615+0000 7fb8ae000640 1 -- 172.21.15.37:0/3866347827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554aff40 msgr2=0x55c7554b2330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:09:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.615+0000 7fb8ae000640 1 --2- 172.21.15.37:0/3866347827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554aff40 0x55c7554b2330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.615+0000 7fb8ae000640 1 -- 172.21.15.37:0/3866347827 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7553dbde0 con 0x55c7554b2980 2024-08-20T05:09:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.615+0000 7fb8ae000640 1 --2- 172.21.15.37:0/3866347827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b2980 0x55c7554b4e40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009890 tx=0x7fb89c009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d03bf6b2e0a6b86 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.616+0000 7fb89be00640 1 -- 172.21.15.37:0/3866347827 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c041020 con 0x55c7554b2980 2024-08-20T05:09:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.616+0000 7fb89be00640 1 -- 172.21.15.37:0/3866347827 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb89c004040 con 0x55c7554b2980 2024-08-20T05:09:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.616+0000 7fb89be00640 1 -- 172.21.15.37:0/3866347827 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c037040 con 0x55c7554b2980 2024-08-20T05:09:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.617+0000 7fb8b4a00640 1 -- 172.21.15.37:0/1464593171 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb8a00046c0 con 0x7fb8b0108f90 2024-08-20T05:09:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.617+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/3866347827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b2980 msgr2=0x55c7554b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.617+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/3866347827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b2980 0x55c7554b4e40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009890 tx=0x7fb89c009510 comp rx=0 tx=0).stop 2024-08-20T05:09:24.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.619+0000 7fb8b4a00640 1 --2- 172.21.15.37:0/1464593171 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb8940b3da0 0x7fb8940b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.620+0000 7fb8af400640 1 --2- 172.21.15.37:0/1464593171 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb8940b3da0 0x7fb8940b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.621+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/3866347827 shutdown_connections 2024-08-20T05:09:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.621+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/3866347827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b2980 0x55c7554b4e40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.621+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/3866347827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554aff40 0x55c7554b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.622 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.621+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/3866347827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554ad610 0x55c7554afa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.621+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/3866347827 >> 172.21.15.37:0/3866347827 conn(0x55c7554a8760 msgr2=0x55c7554a94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:24.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.621+0000 7fb8b4a00640 1 -- 172.21.15.37:0/1464593171 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb8a00e41c0 con 0x7fb8b0108f90 2024-08-20T05:09:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.622+0000 7fb8af400640 1 --2- 172.21.15.37:0/1464593171 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb8940b3da0 0x7fb8940b6260 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00814c0 tx=0x7fb8a8007470 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.622+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/3866347827 shutdown_connections 2024-08-20T05:09:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.622+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/3866347827 wait complete. 2024-08-20T05:09:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.623+0000 7fb8b8dd7740 1 -- start start 2024-08-20T05:09:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.623+0000 7fb8b8dd7740 1 Processor -- start 2024-08-20T05:09:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.626+0000 7fb8b8dd7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554ad610 0x55c7554b6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.626+0000 7fb8b8dd7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554aff40 0x55c7554b7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.626+0000 7fb8b8dd7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554b2980 0x55c7554b7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.626+0000 7fb8b8dd7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c755348ab0 con 0x55c7554b2980 2024-08-20T05:09:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.626+0000 7fb8b8dd7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c7553b6140 con 0x55c7554aff40 2024-08-20T05:09:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.626+0000 7fb8b8dd7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c7554b5900 con 0x55c7554ad610 2024-08-20T05:09:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.626+0000 7fb8b8dd7740 10 client.0 _ll_register_callbacks cb 0x55c7553c95d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:24.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.627+0000 7fb8aea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554ad610 0x55c7554b6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.627+0000 7fb8af400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554b2980 0x55c7554b7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.627+0000 7fb8aea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554ad610 0x55c7554b6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:38892/0 (socket says 172.21.15.37:38892) 2024-08-20T05:09:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.627+0000 7fb8aea00640 1 -- 172.21.15.37:0/963611211 learned_addr learned my addr 172.21.15.37:0/963611211 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:24.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.627+0000 7fb8ae000640 1 --2- 172.21.15.37:0/963611211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554aff40 0x55c7554b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.628+0000 7fb8aea00640 1 -- 172.21.15.37:0/963611211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554aff40 msgr2=0x55c7554b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.628+0000 7fb8aea00640 1 --2- 172.21.15.37:0/963611211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554aff40 0x55c7554b7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.628+0000 7fb8aea00640 1 -- 172.21.15.37:0/963611211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554b2980 msgr2=0x55c7554b7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.628+0000 7fb8aea00640 1 --2- 172.21.15.37:0/963611211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554b2980 0x55c7554b7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.628+0000 7fb8aea00640 1 -- 172.21.15.37:0/963611211 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7553b7170 con 0x55c7554ad610 2024-08-20T05:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.628+0000 7fb8ae000640 1 --2- 172.21.15.37:0/963611211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554aff40 0x55c7554b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.629+0000 7fb8aea00640 1 --2- 172.21.15.37:0/963611211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554ad610 0x55c7554b6ce0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00aaca0 tx=0x7fb8a0005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=627733ff765314 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.629+0000 7fb898c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.631+0000 7fb898c00640 1 -- 172.21.15.37:0/963611211 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a00aad10 con 0x55c7554ad610 2024-08-20T05:09:24.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.631+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/963611211 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb89c004040 con 0x55c7554ad610 2024-08-20T05:09:24.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.631+0000 7fb898c00640 1 -- 172.21.15.37:0/963611211 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb8a00b3930 con 0x55c7554ad610 2024-08-20T05:09:24.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.632+0000 7fb898c00640 1 -- 172.21.15.37:0/963611211 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fb8a00af310 con 0x55c7554ad610 2024-08-20T05:09:24.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.632+0000 7fb8b8dd7740 10 client.27400 fetch_fsmap learned FSMap version 39 2024-08-20T05:09:24.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.632+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/963611211 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55c755172790 con 0x55c7554ad610 2024-08-20T05:09:24.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.636+0000 7fb898c00640 1 -- 172.21.15.37:0/963611211 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb89c004040 con 0x55c7554ad610 2024-08-20T05:09:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.636+0000 7fb898c00640 1 -- 172.21.15.37:0/963611211 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7fb8a00a6680 con 0x55c7554ad610 2024-08-20T05:09:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.636+0000 7fb8b8dd7740 10 client.27400 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:09:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.636+0000 7fb8b8dd7740 10 client.27400 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:09:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.636+0000 7fb8b8dd7740 20 client.27400 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:24.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.636+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/963611211 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c7554c2a10 0x55c7554c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.637+0000 7fb8b8dd7740 4 client.27400 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:09:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.637+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/963611211 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c755422160 con 0x55c7554c2a10 2024-08-20T05:09:24.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.637+0000 7fb8ae000640 1 --2- 172.21.15.37:0/963611211 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c7554c2a10 0x55c7554c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.638+0000 7fb8ae000640 1 --2- 172.21.15.37:0/963611211 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c7554c2a10 0x55c7554c4e00 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dee73200bd90461 server_cookie=2ac58fb975a8274b in_seq=0 out_seq=0 2024-08-20T05:09:24.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.638+0000 7fb898c00640 10 client.27400 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.639+0000 7fb898c00640 1 -- 172.21.15.37:0/963611211 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c755422160 con 0x55c7554c2a10 2024-08-20T05:09:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.639+0000 7fb898c00640 10 client.27400 handle_command_reply: tid=0 2024-08-20T05:09:24.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.639+0000 7fb8b8dd7740 1 client.27400 shutdown 2024-08-20T05:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.641+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/963611211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554ad610 msgr2=0x55c7554b6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.641+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/963611211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554ad610 0x55c7554b6ce0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00aaca0 tx=0x7fb8a0005740 comp rx=0 tx=0).stop 2024-08-20T05:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.641+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/963611211 shutdown_connections 2024-08-20T05:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.641+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/963611211 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c7554c2a10 0x55c7554c4e00 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.641+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/963611211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554b2980 0x55c7554b7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.641+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/963611211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554aff40 0x55c7554b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.641+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/963611211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554ad610 0x55c7554b6ce0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.641+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/963611211 >> 172.21.15.37:0/963611211 conn(0x55c7554a8760 msgr2=0x55c7554a7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.641+0000 7fb898c00640 0 client.27400 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.641+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/963611211 shutdown_connections 2024-08-20T05:09:24.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.641+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/963611211 wait complete. 2024-08-20T05:09:24.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.643+0000 7fb8b8dd7740 20 client.27400 trim_cache size 0 max 16384 2024-08-20T05:09:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.675+0000 7fb8b8dd7740 1 Processor -- start 2024-08-20T05:09:24.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.675+0000 7fb8b8dd7740 1 -- start start 2024-08-20T05:09:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.676+0000 7fb8b8dd7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554aff40 0x55c7554b7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.676+0000 7fb8b8dd7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554b2980 0x55c7554bec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.676+0000 7fb8b8dd7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b3470 0x55c7554b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.677+0000 7fb8b8dd7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b01ba050 con 0x55c7554aff40 2024-08-20T05:09:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.677+0000 7fb8b8dd7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b01bbcb0 con 0x55c7554b3470 2024-08-20T05:09:24.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.677+0000 7fb8b8dd7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b01ba720 con 0x55c7554b2980 2024-08-20T05:09:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.677+0000 7fb8af400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b3470 0x55c7554b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.677+0000 7fb8af400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b3470 0x55c7554b6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37732/0 (socket says 172.21.15.37:37732) 2024-08-20T05:09:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.677+0000 7fb8af400640 1 -- 172.21.15.37:0/1627692204 learned_addr learned my addr 172.21.15.37:0/1627692204 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.677+0000 7fb8ae000640 1 --2- 172.21.15.37:0/1627692204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554b2980 0x55c7554bec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:24.682 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.678+0000 7fb8af400640 1 -- 172.21.15.37:0/1627692204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554b2980 msgr2=0x55c7554bec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.678+0000 7fb8af400640 1 --2- 172.21.15.37:0/1627692204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554b2980 0x55c7554bec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.678+0000 7fb8af400640 1 -- 172.21.15.37:0/1627692204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554aff40 msgr2=0x55c7554b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.678+0000 7fb8af400640 1 --2- 172.21.15.37:0/1627692204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554aff40 0x55c7554b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.678+0000 7fb8af400640 1 -- 172.21.15.37:0/1627692204 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7554afd70 con 0x55c7554b3470 2024-08-20T05:09:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.679+0000 7fb8ae000640 1 --2- 172.21.15.37:0/1627692204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554b2980 0x55c7554bec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:09:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.679+0000 7fb8af400640 1 --2- 172.21.15.37:0/1627692204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b3470 0x55c7554b6a50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8003c90 tx=0x7fb8a8014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db640e039e1b8ab0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:24.683 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.680+0000 7fb89b400640 1 -- 172.21.15.37:0/1627692204 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8028670 con 0x55c7554b3470 2024-08-20T05:09:24.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.680+0000 7fb89b400640 1 -- 172.21.15.37:0/1627692204 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8a8023070 con 0x55c7554b3470 2024-08-20T05:09:24.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.680+0000 7fb89b400640 1 -- 172.21.15.37:0/1627692204 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a801fbe0 con 0x55c7554b3470 2024-08-20T05:09:24.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.681+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/1627692204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b3470 msgr2=0x55c7554b6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:24.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.681+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/1627692204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b3470 0x55c7554b6a50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8003c90 tx=0x7fb8a8014000 comp rx=0 tx=0).stop 2024-08-20T05:09:24.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.682+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/1627692204 shutdown_connections 2024-08-20T05:09:24.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.682+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/1627692204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b3470 0x55c7554b6a50 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.684 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.682+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/1627692204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554b2980 0x55c7554bec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.682+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/1627692204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554aff40 0x55c7554b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.682+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/1627692204 >> 172.21.15.37:0/1627692204 conn(0x55c7554a8760 msgr2=0x55c7554b2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.683+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/1627692204 shutdown_connections 2024-08-20T05:09:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.683+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/1627692204 wait complete. 2024-08-20T05:09:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.683+0000 7fb8b8dd7740 1 -- start start 2024-08-20T05:09:24.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.684+0000 7fb8b8dd7740 1 Processor -- start 2024-08-20T05:09:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.688+0000 7fb8b8dd7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554aff40 0x55c7554bbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.688+0000 7fb8b8dd7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554b2980 0x55c7554bc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.688+0000 7fb8b8dd7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b3470 0x55c7554bd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.689+0000 7fb8aea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554aff40 0x55c7554bbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.689+0000 7fb8b8dd7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b01bb520 con 0x55c7554b2980 2024-08-20T05:09:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.689+0000 7fb8b8dd7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b01badf0 con 0x55c7554b3470 2024-08-20T05:09:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.689+0000 7fb8b8dd7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb8b01b8030 con 0x55c7554aff40 2024-08-20T05:09:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.689+0000 7fb8aea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554aff40 0x55c7554bbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:38912/0 (socket says 172.21.15.37:38912) 2024-08-20T05:09:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.689+0000 7fb8aea00640 1 -- 172.21.15.37:0/1560260922 learned_addr learned my addr 172.21.15.37:0/1560260922 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.689+0000 7fb8af400640 1 --2- 172.21.15.37:0/1560260922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b3470 0x55c7554bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.689+0000 7fb8ae000640 1 --2- 172.21.15.37:0/1560260922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554b2980 0x55c7554bc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:24.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.689+0000 7fb8b8dd7740 10 client.0 _ll_register_callbacks cb 0x7fb8a00aa730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.690+0000 7fb8af400640 1 -- 172.21.15.37:0/1560260922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554aff40 msgr2=0x55c7554bbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.690+0000 7fb8af400640 1 --2- 172.21.15.37:0/1560260922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554aff40 0x55c7554bbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.690+0000 7fb8af400640 1 -- 172.21.15.37:0/1560260922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554b2980 msgr2=0x55c7554bc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.690+0000 7fb8af400640 1 --2- 172.21.15.37:0/1560260922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554b2980 0x55c7554bc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.690+0000 7fb8af400640 1 -- 172.21.15.37:0/1560260922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7551eb620 con 0x55c7554b3470 2024-08-20T05:09:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.690+0000 7fb8af400640 1 --2- 172.21.15.37:0/1560260922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b3470 0x55c7554bd130 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80049b0 tx=0x7fb8a801f660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ac1097a03a8958c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.691+0000 7fb898c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:09:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.691+0000 7fb898c00640 1 -- 172.21.15.37:0/1560260922 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8035020 con 0x55c7554b3470 2024-08-20T05:09:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.691+0000 7fb898c00640 1 -- 172.21.15.37:0/1560260922 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb8a8031880 con 0x55c7554b3470 2024-08-20T05:09:24.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.692+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/1560260922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8a8023070 con 0x55c7554b3470 2024-08-20T05:09:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.692+0000 7fb898c00640 1 -- 172.21.15.37:0/1560260922 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fb8a8031a80 con 0x55c7554b3470 2024-08-20T05:09:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.692+0000 7fb8b8dd7740 10 client.27395 fetch_fsmap learned FSMap version 39 2024-08-20T05:09:24.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.692+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/1560260922 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55c7554beb50 con 0x55c7554b3470 2024-08-20T05:09:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.693+0000 7fb898c00640 1 -- 172.21.15.37:0/1560260922 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8a8023070 con 0x55c7554b3470 2024-08-20T05:09:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.693+0000 7fb898c00640 1 -- 172.21.15.37:0/1560260922 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7fb8a801e430 con 0x55c7554b3470 2024-08-20T05:09:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.693+0000 7fb8b8dd7740 10 client.27395 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:09:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.693+0000 7fb8b8dd7740 10 client.27395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:09:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.693+0000 7fb8b8dd7740 20 client.27395 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.693+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/1560260922 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c75552d880 0x55c75552fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.693+0000 7fb8b8dd7740 4 client.27395 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:09:24.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.693+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/1560260922 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c75541dc00 con 0x55c75552d880 2024-08-20T05:09:24.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.694+0000 7fb8aea00640 1 --2- 172.21.15.37:0/1560260922 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c75552d880 0x55c75552fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.695+0000 7fb8aea00640 1 --2- 172.21.15.37:0/1560260922 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c75552d880 0x55c75552fca0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fc06559c17c14e4 server_cookie=8cab2f13c294f1f8 in_seq=0 out_seq=0 2024-08-20T05:09:24.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.696+0000 7fb898c00640 10 client.27395 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:24.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.709+0000 7fb898c00640 1 -- 172.21.15.37:0/1560260922 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fb8a00ca040 con 0x55c75552d880 2024-08-20T05:09:24.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.709+0000 7fb898c00640 10 client.27395 handle_command_reply: tid=0 2024-08-20T05:09:24.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.709+0000 7fb8b8dd7740 1 client.27395 shutdown 2024-08-20T05:09:24.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.709+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/1560260922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b3470 msgr2=0x55c7554bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:24.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.709+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/1560260922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b3470 0x55c7554bd130 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80049b0 tx=0x7fb8a801f660 comp rx=0 tx=0).stop 2024-08-20T05:09:24.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.710+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/1560260922 shutdown_connections 2024-08-20T05:09:24.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.710+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/1560260922 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c75552d880 0x55c75552fca0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.710+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/1560260922 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c7554b3470 0x55c7554bd130 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.710+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/1560260922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c7554b2980 0x55c7554bc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.710+0000 7fb8b8dd7740 1 --2- 172.21.15.37:0/1560260922 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c7554aff40 0x55c7554bbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.710+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/1560260922 >> 172.21.15.37:0/1560260922 conn(0x55c7554a8760 msgr2=0x55c7554a8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.710+0000 7fb898c00640 0 client.27395 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.710+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/1560260922 shutdown_connections 2024-08-20T05:09:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.710+0000 7fb8b8dd7740 1 -- 172.21.15.37:0/1560260922 wait complete. 2024-08-20T05:09:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.711+0000 7fb8b8dd7740 20 client.27395 trim_cache size 0 max 16384 2024-08-20T05:09:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:09:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:09:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:09:24.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:09:24.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.712+0000 7fb8b5e00640 1 -- 172.21.15.37:0/1464593171 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb8940b3da0 msgr2=0x7fb8940b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:24.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.712+0000 7fb8b5e00640 1 --2- 172.21.15.37:0/1464593171 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb8940b3da0 0x7fb8940b6260 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb8b00814c0 tx=0x7fb8a8007470 comp rx=0 tx=0).stop 2024-08-20T05:09:24.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.712+0000 7fb8b5e00640 1 -- 172.21.15.37:0/1464593171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8b0108f90 msgr2=0x7fb8b0080740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:24.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.712+0000 7fb8b5e00640 1 --2- 172.21.15.37:0/1464593171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8b0108f90 0x7fb8b0080740 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb8a000e9f0 tx=0x7fb8a000eeb0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.712+0000 7fb8b5e00640 1 -- 172.21.15.37:0/1464593171 shutdown_connections 2024-08-20T05:09:24.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.712+0000 7fb8b5e00640 1 --2- 172.21.15.37:0/1464593171 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb8940b3da0 0x7fb8940b6260 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.712+0000 7fb8b5e00640 1 --2- 172.21.15.37:0/1464593171 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb8b010a780 0x7fb8b00819c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.712+0000 7fb8b5e00640 1 --2- 172.21.15.37:0/1464593171 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb8b0109dc0 0x7fb8b0080d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.712+0000 7fb8b5e00640 1 --2- 172.21.15.37:0/1464593171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8b0108f90 0x7fb8b0080740 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.712+0000 7fb8b5e00640 1 -- 172.21.15.37:0/1464593171 >> 172.21.15.37:0/1464593171 conn(0x7fb8b0078030 msgr2=0x7fb8b010d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.712+0000 7fb8b5e00640 1 -- 172.21.15.37:0/1464593171 shutdown_connections 2024-08-20T05:09:24.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:24.712+0000 7fb8b5e00640 1 -- 172.21.15.37:0/1464593171 wait complete. 2024-08-20T05:09:24.935 INFO:tasks.cephfs.filesystem:scrub status for tag:83a892db-a2bd-4447-a7fa-ddf74a27ae63 - {'path': '/', 'tag': '83a892db-a2bd-4447-a7fa-ddf74a27ae63', 'options': 'recursive,force'} 2024-08-20T05:09:25.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:25 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:09:25.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:25 smithi130 ceph-mon[22007]: pgmap v616: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 13 MiB/s wr, 584 op/s 2024-08-20T05:09:25.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:25 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:09:25.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:25 smithi037 ceph-mon[17265]: pgmap v616: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 13 MiB/s wr, 584 op/s 2024-08-20T05:09:25.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:25 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:09:25.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:25 smithi135 ceph-mon[22342]: pgmap v616: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 13 MiB/s wr, 584 op/s 2024-08-20T05:09:27.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:27 smithi135 ceph-mon[22342]: pgmap v617: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 14 MiB/s wr, 652 op/s 2024-08-20T05:09:27.659 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:27 smithi037 ceph-mon[17265]: pgmap v617: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 14 MiB/s wr, 652 op/s 2024-08-20T05:09:27.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:27 smithi130 ceph-mon[22007]: pgmap v617: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 14 MiB/s wr, 652 op/s 2024-08-20T05:09:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 390.0 s, 904.9 tps, lat 113.598 ms stddev 133.882 2024-08-20T05:09:29.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:29 smithi135 ceph-mon[22342]: pgmap v618: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 10 MiB/s wr, 578 op/s 2024-08-20T05:09:29.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:29 smithi130 ceph-mon[22007]: pgmap v618: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 10 MiB/s wr, 578 op/s 2024-08-20T05:09:29.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:29 smithi037 ceph-mon[17265]: pgmap v618: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 10 MiB/s wr, 578 op/s 2024-08-20T05:09:31.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:31 smithi135 ceph-mon[22342]: pgmap v619: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 14 MiB/s wr, 681 op/s 2024-08-20T05:09:31.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:31 smithi130 ceph-mon[22007]: pgmap v619: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 14 MiB/s wr, 681 op/s 2024-08-20T05:09:31.769 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:31 smithi037 ceph-mon[17265]: pgmap v619: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 14 MiB/s wr, 681 op/s 2024-08-20T05:09:32.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:32 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:09:32.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:32 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:09:32.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:32 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:09:32.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:32 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:09:32.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:32 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:09:32.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:32 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:09:32.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:32 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:09:32.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:32 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:09:32.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:32 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:09:32.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:32 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:09:32.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:32 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:09:32.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:32 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:09:32.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:32 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:09:32.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:32 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:09:32.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:32 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:09:33.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 395.0 s, 731.6 tps, lat 130.255 ms stddev 170.642 2024-08-20T05:09:33.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:33 smithi135 ceph-mon[22342]: pgmap v620: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 12 MiB/s wr, 639 op/s 2024-08-20T05:09:33.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:33 smithi130 ceph-mon[22007]: pgmap v620: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 12 MiB/s wr, 639 op/s 2024-08-20T05:09:33.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:33 smithi037 ceph-mon[17265]: pgmap v620: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 12 MiB/s wr, 639 op/s 2024-08-20T05:09:35.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:35 smithi130 ceph-mon[22007]: pgmap v621: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 11 MiB/s wr, 602 op/s 2024-08-20T05:09:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:35 smithi037 ceph-mon[17265]: pgmap v621: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 11 MiB/s wr, 602 op/s 2024-08-20T05:09:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:35 smithi135 ceph-mon[22342]: pgmap v621: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 11 MiB/s wr, 602 op/s 2024-08-20T05:09:37.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:37 smithi130 ceph-mon[22007]: pgmap v622: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 13 MiB/s wr, 645 op/s 2024-08-20T05:09:37.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:37 smithi037 ceph-mon[17265]: pgmap v622: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 13 MiB/s wr, 645 op/s 2024-08-20T05:09:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:37 smithi135 ceph-mon[22342]: pgmap v622: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 13 MiB/s wr, 645 op/s 2024-08-20T05:09:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.890+0000 7fc24a800640 1 -- 172.21.15.37:0/1977789523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2441059e0 msgr2=0x7fc244105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.890+0000 7fc24a800640 1 --2- 172.21.15.37:0/1977789523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2441059e0 0x7fc244105e60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009890 tx=0x7fc22c02a370 comp rx=0 tx=0).stop 2024-08-20T05:09:37.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.890+0000 7fc24a800640 1 -- 172.21.15.37:0/1977789523 shutdown_connections 2024-08-20T05:09:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.891+0000 7fc24a800640 1 --2- 172.21.15.37:0/1977789523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2441063a0 0x7fc24410cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.895+0000 7fc24a800640 1 --2- 172.21.15.37:0/1977789523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2441059e0 0x7fc244105e60 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.895+0000 7fc24a800640 1 --2- 172.21.15.37:0/1977789523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc244104890 0x7fc244104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.895+0000 7fc24a800640 1 -- 172.21.15.37:0/1977789523 >> 172.21.15.37:0/1977789523 conn(0x7fc244100130 msgr2=0x7fc244102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.895+0000 7fc24a800640 1 -- 172.21.15.37:0/1977789523 shutdown_connections 2024-08-20T05:09:37.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.896+0000 7fc24a800640 1 -- 172.21.15.37:0/1977789523 wait complete. 2024-08-20T05:09:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.900+0000 7fc24a800640 1 Processor -- start 2024-08-20T05:09:37.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.904+0000 7fc24a800640 1 -- start start 2024-08-20T05:09:37.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.912+0000 7fc24a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc244104890 0x7fc244111b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.912+0000 7fc24a800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2441059e0 0x7fc2441121e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:37.914 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.912+0000 7fc24a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2441063a0 0x7fc244112e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.912+0000 7fc243400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc244104890 0x7fc244111b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.912+0000 7fc243400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc244104890 0x7fc244111b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:47774/0 (socket says 172.21.15.37:47774) 2024-08-20T05:09:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.912+0000 7fc24a800640 1 -- 172.21.15.37:0/3159246578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc244077f70 con 0x7fc2441063a0 2024-08-20T05:09:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.912+0000 7fc243400640 1 -- 172.21.15.37:0/3159246578 learned_addr learned my addr 172.21.15.37:0/3159246578 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.913+0000 7fc24a800640 1 -- 172.21.15.37:0/3159246578 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc244077df0 con 0x7fc2441059e0 2024-08-20T05:09:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.913+0000 7fc24a800640 1 -- 172.21.15.37:0/3159246578 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2440780f0 con 0x7fc244104890 2024-08-20T05:09:37.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.913+0000 7fc242a00640 1 --2- 172.21.15.37:0/3159246578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2441059e0 0x7fc2441121e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.913+0000 7fc243400640 1 -- 172.21.15.37:0/3159246578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2441059e0 msgr2=0x7fc2441121e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.913+0000 7fc243400640 1 --2- 172.21.15.37:0/3159246578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2441059e0 0x7fc2441121e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.913+0000 7fc243400640 1 -- 172.21.15.37:0/3159246578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2441063a0 msgr2=0x7fc244112e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.913+0000 7fc243400640 1 --2- 172.21.15.37:0/3159246578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2441063a0 0x7fc244112e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.913+0000 7fc243400640 1 -- 172.21.15.37:0/3159246578 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc244113540 con 0x7fc244104890 2024-08-20T05:09:37.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.915+0000 7fc243400640 1 --2- 172.21.15.37:0/3159246578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc244104890 0x7fc244111b90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00efb0 tx=0x7fc23c00c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.916+0000 7fc23be00640 1 -- 172.21.15.37:0/3159246578 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c01b070 con 0x7fc244104890 2024-08-20T05:09:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.916+0000 7fc23be00640 1 -- 172.21.15.37:0/3159246578 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc23c00ba20 con 0x7fc244104890 2024-08-20T05:09:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.916+0000 7fc23be00640 1 -- 172.21.15.37:0/3159246578 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c016b30 con 0x7fc244104890 2024-08-20T05:09:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.918+0000 7fc24a800640 1 -- 172.21.15.37:0/3159246578 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc244113830 con 0x7fc244104890 2024-08-20T05:09:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.918+0000 7fc24a800640 1 -- 172.21.15.37:0/3159246578 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2441afdc0 con 0x7fc244104890 2024-08-20T05:09:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.924+0000 7fc24d6a5740 1 Processor -- start 2024-08-20T05:09:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.924+0000 7fc24d6a5740 1 -- start start 2024-08-20T05:09:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.924+0000 7fc24d6a5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b95332b0 0x55a9b95356a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.926+0000 7fc24d6a5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9535be0 0x55a9b9537fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:37.928 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.927+0000 7fc24d6a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b9538620 0x55a9b953aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.927+0000 7fc23be00640 1 -- 172.21.15.37:0/3159246578 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc23c00bbd0 con 0x7fc244104890 2024-08-20T05:09:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.927+0000 7fc24d6a5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a9b94a6210 con 0x55a9b95332b0 2024-08-20T05:09:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.927+0000 7fc24d6a5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a9b9495710 con 0x55a9b9535be0 2024-08-20T05:09:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.927+0000 7fc243e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b95332b0 0x55a9b95356a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.927+0000 7fc242a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b9538620 0x55a9b953aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.927+0000 7fc242a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b9538620 0x55a9b953aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:47776/0 (socket says 172.21.15.37:47776) 2024-08-20T05:09:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.927+0000 7fc242a00640 1 -- 172.21.15.37:0/2786365134 learned_addr learned my addr 172.21.15.37:0/2786365134 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:37.929 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.927+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2786365134 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a9b9499750 con 0x55a9b9538620 2024-08-20T05:09:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.927+0000 7fc243400640 1 --2- 172.21.15.37:0/2786365134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9535be0 0x55a9b9537fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.928+0000 7fc242a00640 1 -- 172.21.15.37:0/2786365134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9535be0 msgr2=0x55a9b9537fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.928+0000 7fc242a00640 1 --2- 172.21.15.37:0/2786365134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9535be0 0x55a9b9537fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.928+0000 7fc242a00640 1 -- 172.21.15.37:0/2786365134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b95332b0 msgr2=0x55a9b95356a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.928+0000 7fc242a00640 1 --2- 172.21.15.37:0/2786365134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b95332b0 0x55a9b95356a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.928+0000 7fc242a00640 1 -- 172.21.15.37:0/2786365134 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b9461de0 con 0x55a9b9538620 2024-08-20T05:09:37.930 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.928+0000 7fc243e00640 1 --2- 172.21.15.37:0/2786365134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b95332b0 0x55a9b95356a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:09:37.931 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.929+0000 7fc242a00640 1 --2- 172.21.15.37:0/2786365134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b9538620 0x55a9b953aae0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009890 tx=0x7fc22c030b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5098c5edf9735a11 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.930+0000 7fc23be00640 1 --2- 172.21.15.37:0/3159246578 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc2280b3d60 0x7fc2280b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.930+0000 7fc238c00640 1 -- 172.21.15.37:0/2786365134 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c041020 con 0x55a9b9538620 2024-08-20T05:09:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.930+0000 7fc238c00640 1 -- 172.21.15.37:0/2786365134 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc22c004040 con 0x55a9b9538620 2024-08-20T05:09:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.930+0000 7fc238c00640 1 -- 172.21.15.37:0/2786365134 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c037040 con 0x55a9b9538620 2024-08-20T05:09:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.930+0000 7fc23be00640 1 -- 172.21.15.37:0/3159246578 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc23c0e4680 con 0x7fc244104890 2024-08-20T05:09:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.931+0000 7fc243e00640 1 --2- 172.21.15.37:0/3159246578 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc2280b3d60 0x7fc2280b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.934+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2786365134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b9538620 msgr2=0x55a9b953aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.934+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/2786365134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b9538620 0x55a9b953aae0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc22c009890 tx=0x7fc22c030b30 comp rx=0 tx=0).stop 2024-08-20T05:09:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.935+0000 7fc243e00640 1 --2- 172.21.15.37:0/3159246578 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc2280b3d60 0x7fc2280b6220 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc234005d00 tx=0x7fc23400b310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.936+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2786365134 shutdown_connections 2024-08-20T05:09:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.936+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/2786365134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b9538620 0x55a9b953aae0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.936+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/2786365134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9535be0 0x55a9b9537fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.936+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/2786365134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b95332b0 0x55a9b95356a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:37.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.936+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2786365134 >> 172.21.15.37:0/2786365134 conn(0x55a9b952e3b0 msgr2=0x55a9b952f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.937+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2786365134 shutdown_connections 2024-08-20T05:09:37.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.937+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2786365134 wait complete. 2024-08-20T05:09:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.937+0000 7fc24d6a5740 1 -- start start 2024-08-20T05:09:37.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.938+0000 7fc24d6a5740 1 Processor -- start 2024-08-20T05:09:37.942 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.941+0000 7fc24d6a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b95332b0 0x55a9b953cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:37.943 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.941+0000 7fc24d6a5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b9535be0 0x55a9b953d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:37.944 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.941+0000 7fc243400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b95332b0 0x55a9b953cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.941+0000 7fc243400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b95332b0 0x55a9b953cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:47782/0 (socket says 172.21.15.37:47782) 2024-08-20T05:09:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.942+0000 7fc243400640 1 -- 172.21.15.37:0/2781946953 learned_addr learned my addr 172.21.15.37:0/2781946953 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.942+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/2781946953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9538620 0x55a9b953ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.942+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2781946953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a9b93ceab0 con 0x55a9b9535be0 2024-08-20T05:09:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.942+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2781946953 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a9b943c140 con 0x55a9b9538620 2024-08-20T05:09:37.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.942+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2781946953 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a9b953b5a0 con 0x55a9b95332b0 2024-08-20T05:09:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.942+0000 7fc24d6a5740 10 client.0 _ll_register_callbacks cb 0x55a9b944f5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.943+0000 7fc243e00640 1 --2- 172.21.15.37:0/2781946953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9538620 0x55a9b953ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.943+0000 7fc243400640 1 -- 172.21.15.37:0/2781946953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9538620 msgr2=0x55a9b953ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.943+0000 7fc243400640 1 --2- 172.21.15.37:0/2781946953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9538620 0x55a9b953ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.943+0000 7fc243400640 1 -- 172.21.15.37:0/2781946953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b9535be0 msgr2=0x55a9b953d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.943+0000 7fc243400640 1 --2- 172.21.15.37:0/2781946953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b9535be0 0x55a9b953d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.943+0000 7fc243400640 1 -- 172.21.15.37:0/2781946953 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9b943d170 con 0x55a9b95332b0 2024-08-20T05:09:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.944+0000 7fc243400640 1 --2- 172.21.15.37:0/2781946953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b95332b0 0x55a9b953cc60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0ab1c0 tx=0x7fc23c0ab850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d92ac5bd29909087 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:37.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.944+0000 7fc231600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:09:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.946+0000 7fc231600640 1 -- 172.21.15.37:0/2781946953 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c0aa9a0 con 0x55a9b95332b0 2024-08-20T05:09:37.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.946+0000 7fc231600640 1 -- 172.21.15.37:0/2781946953 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc23c00b780 con 0x55a9b95332b0 2024-08-20T05:09:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.946+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2781946953 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a9b946ca30 con 0x55a9b95332b0 2024-08-20T05:09:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.946+0000 7fc231600640 1 -- 172.21.15.37:0/2781946953 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc23c016410 con 0x55a9b95332b0 2024-08-20T05:09:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.947+0000 7fc24d6a5740 10 client.27418 fetch_fsmap learned FSMap version 39 2024-08-20T05:09:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.947+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2781946953 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55a9b91f8790 con 0x55a9b95332b0 2024-08-20T05:09:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.947+0000 7fc231600640 1 -- 172.21.15.37:0/2781946953 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a9b946ca30 con 0x55a9b95332b0 2024-08-20T05:09:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.947+0000 7fc231600640 1 -- 172.21.15.37:0/2781946953 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7fc23c00b040 con 0x55a9b95332b0 2024-08-20T05:09:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.947+0000 7fc24d6a5740 10 client.27418 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:09:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.947+0000 7fc24d6a5740 10 client.27418 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:09:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.947+0000 7fc24d6a5740 20 client.27418 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.948+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/2781946953 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a9b95489e0 0x55a9b954ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.948+0000 7fc24d6a5740 4 client.27418 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:09:37.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.948+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2781946953 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9b94a8160 con 0x55a9b95489e0 2024-08-20T05:09:37.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.950+0000 7fc242a00640 1 --2- 172.21.15.37:0/2781946953 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a9b95489e0 0x55a9b954ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.951+0000 7fc242a00640 1 --2- 172.21.15.37:0/2781946953 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a9b95489e0 0x55a9b954ae30 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0f38b0a468f533c server_cookie=74799c7f663e3b13 in_seq=0 out_seq=0 2024-08-20T05:09:37.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.951+0000 7fc231600640 10 client.27418 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:37.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.952+0000 7fc231600640 1 -- 172.21.15.37:0/2781946953 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9b94a8160 con 0x55a9b95489e0 2024-08-20T05:09:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.952+0000 7fc231600640 10 client.27418 handle_command_reply: tid=0 2024-08-20T05:09:37.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.953+0000 7fc24d6a5740 1 client.27418 shutdown 2024-08-20T05:09:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.956+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2781946953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b95332b0 msgr2=0x55a9b953cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.956+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/2781946953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b95332b0 0x55a9b953cc60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0ab1c0 tx=0x7fc23c0ab850 comp rx=0 tx=0).stop 2024-08-20T05:09:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.956+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2781946953 shutdown_connections 2024-08-20T05:09:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.956+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/2781946953 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a9b95489e0 0x55a9b954ae30 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.956+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/2781946953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9538620 0x55a9b953ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.956+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/2781946953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b9535be0 0x55a9b953d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.956+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/2781946953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b95332b0 0x55a9b953cc60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.956+0000 7fc231600640 0 client.27418 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:37.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.956+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2781946953 >> 172.21.15.37:0/2781946953 conn(0x55a9b952e3b0 msgr2=0x55a9b952d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:37.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.958+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2781946953 shutdown_connections 2024-08-20T05:09:37.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.958+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2781946953 wait complete. 2024-08-20T05:09:37.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.958+0000 7fc24d6a5740 20 client.27418 trim_cache size 0 max 16384 2024-08-20T05:09:37.999 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.997+0000 7fc24d6a5740 1 Processor -- start 2024-08-20T05:09:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.998+0000 7fc24d6a5740 1 -- start start 2024-08-20T05:09:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.998+0000 7fc24d6a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b95332b0 0x55a9b9538a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.998+0000 7fc24d6a5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9535be0 0x55a9b9538f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.998+0000 7fc24d6a5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b9538620 0x55a9b952ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.998+0000 7fc24d6a5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441ba1a0 con 0x55a9b9538620 2024-08-20T05:09:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.998+0000 7fc24d6a5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441bbe00 con 0x55a9b9535be0 2024-08-20T05:09:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.998+0000 7fc24d6a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441ba870 con 0x55a9b95332b0 2024-08-20T05:09:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.998+0000 7fc243400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b95332b0 0x55a9b9538a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.999+0000 7fc242a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9535be0 0x55a9b9538f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.999+0000 7fc243e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b9538620 0x55a9b952ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.999+0000 7fc242a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9535be0 0x55a9b9538f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:58242/0 (socket says 172.21.15.37:58242) 2024-08-20T05:09:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.999+0000 7fc242a00640 1 -- 172.21.15.37:0/515063899 learned_addr learned my addr 172.21.15.37:0/515063899 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.999+0000 7fc243400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b95332b0 0x55a9b9538a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:47786/0 (socket says 172.21.15.37:47786) 2024-08-20T05:09:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.999+0000 7fc243400640 1 -- 172.21.15.37:0/515063899 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9535be0 msgr2=0x55a9b9538f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.999+0000 7fc243400640 1 --2- 172.21.15.37:0/515063899 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9535be0 0x55a9b9538f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.999+0000 7fc243400640 1 -- 172.21.15.37:0/515063899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b9538620 msgr2=0x55a9b952ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.999+0000 7fc243400640 1 --2- 172.21.15.37:0/515063899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b9538620 0x55a9b952ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.999+0000 7fc243400640 1 -- 172.21.15.37:0/515063899 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9b9271620 con 0x55a9b95332b0 2024-08-20T05:09:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:37.999+0000 7fc242a00640 1 --2- 172.21.15.37:0/515063899 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9535be0 0x55a9b9538f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:09:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.000+0000 7fc243400640 1 --2- 172.21.15.37:0/515063899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b95332b0 0x55a9b9538a00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0a84a0 tx=0x7fc23c0a7220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cacde1cdfa131010 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.000+0000 7fc233e00640 1 -- 172.21.15.37:0/515063899 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c016410 con 0x55a9b95332b0 2024-08-20T05:09:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.000+0000 7fc233e00640 1 -- 172.21.15.37:0/515063899 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc23c0ab930 con 0x55a9b95332b0 2024-08-20T05:09:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.000+0000 7fc233e00640 1 -- 172.21.15.37:0/515063899 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c0af830 con 0x55a9b95332b0 2024-08-20T05:09:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.001+0000 7fc24d6a5740 1 -- 172.21.15.37:0/515063899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b95332b0 msgr2=0x55a9b9538a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.001+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/515063899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b95332b0 0x55a9b9538a00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc23c0a84a0 tx=0x7fc23c0a7220 comp rx=0 tx=0).stop 2024-08-20T05:09:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.001+0000 7fc24d6a5740 1 -- 172.21.15.37:0/515063899 shutdown_connections 2024-08-20T05:09:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.001+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/515063899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b9538620 0x55a9b952ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.001+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/515063899 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9535be0 0x55a9b9538f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.001+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/515063899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b95332b0 0x55a9b9538a00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.001+0000 7fc24d6a5740 1 -- 172.21.15.37:0/515063899 >> 172.21.15.37:0/515063899 conn(0x55a9b952e3b0 msgr2=0x55a9b953a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.002+0000 7fc24d6a5740 1 -- 172.21.15.37:0/515063899 shutdown_connections 2024-08-20T05:09:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.002+0000 7fc24d6a5740 1 -- 172.21.15.37:0/515063899 wait complete. 2024-08-20T05:09:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.002+0000 7fc24d6a5740 1 -- start start 2024-08-20T05:09:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.003+0000 7fc24d6a5740 1 Processor -- start 2024-08-20T05:09:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.003+0000 7fc24d6a5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b9535be0 0x55a9b9541d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.003+0000 7fc24d6a5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b9538620 0x55a9b95423f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.004+0000 7fc24d6a5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9542fa0 0x55a9b9543420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.004+0000 7fc24d6a5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441bb670 con 0x55a9b9538620 2024-08-20T05:09:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.004+0000 7fc242a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b9538620 0x55a9b95423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.004+0000 7fc24d6a5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441baf40 con 0x55a9b9542fa0 2024-08-20T05:09:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.004+0000 7fc24d6a5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc2441b8140 con 0x55a9b9535be0 2024-08-20T05:09:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.004+0000 7fc24d6a5740 10 client.0 _ll_register_callbacks cb 0x7fc23c0ea240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.004+0000 7fc243400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b9535be0 0x55a9b9541d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.004+0000 7fc243400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b9535be0 0x55a9b9541d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:47794/0 (socket says 172.21.15.37:47794) 2024-08-20T05:09:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.004+0000 7fc242a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b9538620 0x55a9b95423f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59428/0 (socket says 172.21.15.37:59428) 2024-08-20T05:09:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.004+0000 7fc243400640 1 -- 172.21.15.37:0/2648487673 learned_addr learned my addr 172.21.15.37:0/2648487673 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.004+0000 7fc243e00640 1 --2- 172.21.15.37:0/2648487673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9542fa0 0x55a9b9543420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.005+0000 7fc243400640 1 -- 172.21.15.37:0/2648487673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9542fa0 msgr2=0x55a9b9543420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.005+0000 7fc243400640 1 --2- 172.21.15.37:0/2648487673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9542fa0 0x55a9b9543420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.005+0000 7fc243400640 1 -- 172.21.15.37:0/2648487673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b9538620 msgr2=0x55a9b95423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.005+0000 7fc243400640 1 --2- 172.21.15.37:0/2648487673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b9538620 0x55a9b95423f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.005+0000 7fc243400640 1 -- 172.21.15.37:0/2648487673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9b9543c50 con 0x55a9b9535be0 2024-08-20T05:09:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.006+0000 7fc243400640 1 --2- 172.21.15.37:0/2648487673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b9535be0 0x55a9b9541d50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55a9b9530120 tx=0x7fc23c0ab850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e80008431460fde server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.006+0000 7fc231600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:09:38.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.007+0000 7fc231600640 1 -- 172.21.15.37:0/2648487673 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc23c0b8020 con 0x55a9b9535be0 2024-08-20T05:09:38.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.007+0000 7fc231600640 1 -- 172.21.15.37:0/2648487673 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc23c0cc320 con 0x55a9b9535be0 2024-08-20T05:09:38.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.007+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2648487673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc23c0ab930 con 0x55a9b9535be0 2024-08-20T05:09:38.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.008+0000 7fc231600640 1 -- 172.21.15.37:0/2648487673 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc23c016410 con 0x55a9b9535be0 2024-08-20T05:09:38.010 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.008+0000 7fc24d6a5740 10 client.27424 fetch_fsmap learned FSMap version 39 2024-08-20T05:09:38.010 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.008+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2648487673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55a9b9543c50 con 0x55a9b9535be0 2024-08-20T05:09:38.010 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.008+0000 7fc231600640 1 -- 172.21.15.37:0/2648487673 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc23c0ab930 con 0x55a9b9535be0 2024-08-20T05:09:38.010 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.008+0000 7fc231600640 1 -- 172.21.15.37:0/2648487673 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7fc23c0aa530 con 0x55a9b9535be0 2024-08-20T05:09:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.009+0000 7fc24d6a5740 10 client.27424 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:09:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.009+0000 7fc24d6a5740 10 client.27424 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:09:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.009+0000 7fc24d6a5740 20 client.27424 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.009+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/2648487673 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a9b95b38e0 0x55a9b95b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.009+0000 7fc24d6a5740 4 client.27424 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:09:38.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.009+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2648487673 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a9b94a3c00 con 0x55a9b95b38e0 2024-08-20T05:09:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.009+0000 7fc242a00640 1 --2- 172.21.15.37:0/2648487673 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a9b95b38e0 0x55a9b95b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.010+0000 7fc242a00640 1 --2- 172.21.15.37:0/2648487673 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a9b95b38e0 0x55a9b95b5d00 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c3c5f658e46efa4 server_cookie=8f9240aed7629e66 in_seq=0 out_seq=0 2024-08-20T05:09:38.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.010+0000 7fc231600640 10 client.27424 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.019+0000 7fc231600640 1 -- 172.21.15.37:0/2648487673 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a9b94a3c00 con 0x55a9b95b38e0 2024-08-20T05:09:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.019+0000 7fc231600640 10 client.27424 handle_command_reply: tid=0 2024-08-20T05:09:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.020+0000 7fc24d6a5740 1 client.27424 shutdown 2024-08-20T05:09:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.020+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2648487673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b9535be0 msgr2=0x55a9b9541d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.020+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/2648487673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b9535be0 0x55a9b9541d50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x55a9b9530120 tx=0x7fc23c0ab850 comp rx=0 tx=0).stop 2024-08-20T05:09:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.021+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2648487673 shutdown_connections 2024-08-20T05:09:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.021+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/2648487673 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a9b95b38e0 0x55a9b95b5d00 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.021+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/2648487673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9b9542fa0 0x55a9b9543420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.021+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/2648487673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9b9538620 0x55a9b95423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.021+0000 7fc24d6a5740 1 --2- 172.21.15.37:0/2648487673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9b9535be0 0x55a9b9541d50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.021+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2648487673 >> 172.21.15.37:0/2648487673 conn(0x55a9b952e3b0 msgr2=0x55a9b9538a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.021+0000 7fc231600640 0 client.27424 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.021+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2648487673 shutdown_connections 2024-08-20T05:09:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.021+0000 7fc24d6a5740 1 -- 172.21.15.37:0/2648487673 wait complete. 2024-08-20T05:09:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.021+0000 7fc24d6a5740 20 client.27424 trim_cache size 0 max 16384 2024-08-20T05:09:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:09:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:09:38.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:09:38.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:09:38.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.022+0000 7fc24a800640 1 -- 172.21.15.37:0/3159246578 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc2280b3d60 msgr2=0x7fc2280b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:38.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.022+0000 7fc24a800640 1 --2- 172.21.15.37:0/3159246578 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc2280b3d60 0x7fc2280b6220 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc234005d00 tx=0x7fc23400b310 comp rx=0 tx=0).stop 2024-08-20T05:09:38.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.022+0000 7fc24a800640 1 -- 172.21.15.37:0/3159246578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc244104890 msgr2=0x7fc244111b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:38.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.022+0000 7fc24a800640 1 --2- 172.21.15.37:0/3159246578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc244104890 0x7fc244111b90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00efb0 tx=0x7fc23c00c800 comp rx=0 tx=0).stop 2024-08-20T05:09:38.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.022+0000 7fc24a800640 1 -- 172.21.15.37:0/3159246578 shutdown_connections 2024-08-20T05:09:38.025 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.022+0000 7fc24a800640 1 --2- 172.21.15.37:0/3159246578 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc2280b3d60 0x7fc2280b6220 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.022+0000 7fc24a800640 1 --2- 172.21.15.37:0/3159246578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2441063a0 0x7fc244112e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.022+0000 7fc24a800640 1 --2- 172.21.15.37:0/3159246578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc2441059e0 0x7fc2441121e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.022+0000 7fc24a800640 1 --2- 172.21.15.37:0/3159246578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc244104890 0x7fc244111b90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.022+0000 7fc24a800640 1 -- 172.21.15.37:0/3159246578 >> 172.21.15.37:0/3159246578 conn(0x7fc244100130 msgr2=0x7fc24407aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.023+0000 7fc24a800640 1 -- 172.21.15.37:0/3159246578 shutdown_connections 2024-08-20T05:09:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:38.023+0000 7fc24a800640 1 -- 172.21.15.37:0/3159246578 wait complete. 2024-08-20T05:09:38.042 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 400.0 s, 821.6 tps, lat 120.815 ms stddev 166.742 2024-08-20T05:09:39.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:39 smithi130 ceph-mon[22007]: pgmap v623: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 541 op/s 2024-08-20T05:09:39.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:39 smithi037 ceph-mon[17265]: pgmap v623: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 541 op/s 2024-08-20T05:09:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:39 smithi135 ceph-mon[22342]: pgmap v623: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 541 op/s 2024-08-20T05:09:41.667 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:41 smithi135 ceph-mon[22342]: pgmap v624: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 637 op/s 2024-08-20T05:09:41.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:41 smithi130 ceph-mon[22007]: pgmap v624: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 637 op/s 2024-08-20T05:09:41.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:41 smithi037 ceph-mon[17265]: pgmap v624: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 637 op/s 2024-08-20T05:09:43.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 405.0 s, 657.1 tps, lat 159.058 ms stddev 179.394 2024-08-20T05:09:43.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:43 smithi037 ceph-mon[17265]: pgmap v625: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 609 op/s 2024-08-20T05:09:43.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:43 smithi135 ceph-mon[22342]: pgmap v625: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 609 op/s 2024-08-20T05:09:43.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:43 smithi130 ceph-mon[22007]: pgmap v625: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 MiB/s wr, 609 op/s 2024-08-20T05:09:45.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:45 smithi037 ceph-mon[17265]: pgmap v626: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 579 op/s 2024-08-20T05:09:45.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:45 smithi135 ceph-mon[22342]: pgmap v626: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 579 op/s 2024-08-20T05:09:45.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:45 smithi130 ceph-mon[22007]: pgmap v626: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 MiB/s wr, 579 op/s 2024-08-20T05:09:47.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:47 smithi135 ceph-mon[22342]: pgmap v627: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 637 op/s 2024-08-20T05:09:47.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:47 smithi130 ceph-mon[22007]: pgmap v627: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 637 op/s 2024-08-20T05:09:47.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:47 smithi037 ceph-mon[17265]: pgmap v627: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 637 op/s 2024-08-20T05:09:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 410.0 s, 916.2 tps, lat 107.899 ms stddev 119.630 2024-08-20T05:09:49.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:49 smithi135 ceph-mon[22342]: pgmap v628: 129 pgs: 129 active+clean; 1.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 559 op/s 2024-08-20T05:09:49.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:49 smithi130 ceph-mon[22007]: pgmap v628: 129 pgs: 129 active+clean; 1.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 559 op/s 2024-08-20T05:09:49.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:49 smithi037 ceph-mon[17265]: pgmap v628: 129 pgs: 129 active+clean; 1.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 559 op/s 2024-08-20T05:09:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.221+0000 7fa521800640 1 -- 172.21.15.37:0/3814038395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa51c0757f0 msgr2=0x7fa51c075c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.221+0000 7fa521800640 1 --2- 172.21.15.37:0/3814038395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa51c0757f0 0x7fa51c075c70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa508009900 tx=0x7fa50802a420 comp rx=0 tx=0).stop 2024-08-20T05:09:51.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.221+0000 7fa521800640 1 -- 172.21.15.37:0/3814038395 shutdown_connections 2024-08-20T05:09:51.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.221+0000 7fa521800640 1 --2- 172.21.15.37:0/3814038395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c10a600 0x7fa51c10ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.221+0000 7fa521800640 1 --2- 172.21.15.37:0/3814038395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa51c0757f0 0x7fa51c075c70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.221+0000 7fa521800640 1 --2- 172.21.15.37:0/3814038395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51c076c60 0x7fa51c0752b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.221+0000 7fa521800640 1 -- 172.21.15.37:0/3814038395 >> 172.21.15.37:0/3814038395 conn(0x7fa51c0fdf40 msgr2=0x7fa51c100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:51.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.221+0000 7fa521800640 1 -- 172.21.15.37:0/3814038395 shutdown_connections 2024-08-20T05:09:51.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.221+0000 7fa521800640 1 -- 172.21.15.37:0/3814038395 wait complete. 2024-08-20T05:09:51.225 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.223+0000 7fa521800640 1 Processor -- start 2024-08-20T05:09:51.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.223+0000 7fa521800640 1 -- start start 2024-08-20T05:09:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.223+0000 7fa521800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c0757f0 0x7fa51c1968c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.223+0000 7fa521800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa51c076c60 0x7fa51c196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.224+0000 7fa521800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51c10a600 0x7fa51c197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.224+0000 7fa51a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa51c076c60 0x7fa51c196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.224+0000 7fa51a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa51c076c60 0x7fa51c196f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47900/0 (socket says 172.21.15.37:47900) 2024-08-20T05:09:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.224+0000 7fa51a000640 1 -- 172.21.15.37:0/2638220718 learned_addr learned my addr 172.21.15.37:0/2638220718 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.224+0000 7fa521800640 1 -- 172.21.15.37:0/2638220718 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c110590 con 0x7fa51c10a600 2024-08-20T05:09:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.224+0000 7fa521800640 1 -- 172.21.15.37:0/2638220718 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c110410 con 0x7fa51c076c60 2024-08-20T05:09:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.224+0000 7fa521800640 1 -- 172.21.15.37:0/2638220718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c110710 con 0x7fa51c0757f0 2024-08-20T05:09:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.225+0000 7fa51aa00640 1 --2- 172.21.15.37:0/2638220718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c0757f0 0x7fa51c1968c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.225+0000 7fa51b400640 1 --2- 172.21.15.37:0/2638220718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51c10a600 0x7fa51c197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.225+0000 7fa51aa00640 1 -- 172.21.15.37:0/2638220718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa51c076c60 msgr2=0x7fa51c196f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.225+0000 7fa51aa00640 1 --2- 172.21.15.37:0/2638220718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa51c076c60 0x7fa51c196f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.225+0000 7fa51aa00640 1 -- 172.21.15.37:0/2638220718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51c10a600 msgr2=0x7fa51c197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.225+0000 7fa51aa00640 1 --2- 172.21.15.37:0/2638220718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51c10a600 0x7fa51c197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.225+0000 7fa51aa00640 1 -- 172.21.15.37:0/2638220718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51c198400 con 0x7fa51c0757f0 2024-08-20T05:09:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.225+0000 7fa51a000640 1 --2- 172.21.15.37:0/2638220718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa51c076c60 0x7fa51c196f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:09:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.225+0000 7fa51aa00640 1 --2- 172.21.15.37:0/2638220718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c0757f0 0x7fa51c1968c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00c970 tx=0x7fa50c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.226+0000 7fa513400640 1 -- 172.21.15.37:0/2638220718 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c007bb0 con 0x7fa51c0757f0 2024-08-20T05:09:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.226+0000 7fa513400640 1 -- 172.21.15.37:0/2638220718 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa50c007d50 con 0x7fa51c0757f0 2024-08-20T05:09:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.226+0000 7fa513400640 1 -- 172.21.15.37:0/2638220718 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c004e40 con 0x7fa51c0757f0 2024-08-20T05:09:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.226+0000 7fa521800640 1 -- 172.21.15.37:0/2638220718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51c1986f0 con 0x7fa51c0757f0 2024-08-20T05:09:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.226+0000 7fa521800640 1 -- 172.21.15.37:0/2638220718 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa51c19ce30 con 0x7fa51c0757f0 2024-08-20T05:09:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.231+0000 7fa524819740 1 Processor -- start 2024-08-20T05:09:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.232+0000 7fa524819740 1 -- start start 2024-08-20T05:09:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.232+0000 7fa524819740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc28610 0x559c5dc2aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.232+0000 7fa524819740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc2af40 0x559c5dc2d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.232+0000 7fa524819740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 0x559c5dc2fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.232+0000 7fa524819740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559c5db9b210 con 0x559c5dc28610 2024-08-20T05:09:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.232+0000 7fa524819740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559c5db8a710 con 0x559c5dc2af40 2024-08-20T05:09:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.232+0000 7fa524819740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559c5db8e750 con 0x559c5dc2d980 2024-08-20T05:09:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.232+0000 7fa513400640 1 -- 172.21.15.37:0/2638220718 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa50c00f450 con 0x7fa51c0757f0 2024-08-20T05:09:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.233+0000 7fa51a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 0x559c5dc2fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.233+0000 7fa51a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 0x559c5dc2fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:37774/0 (socket says 172.21.15.37:37774) 2024-08-20T05:09:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.233+0000 7fa51a000640 1 -- 172.21.15.37:0/2104138462 learned_addr learned my addr 172.21.15.37:0/2104138462 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.233+0000 7fa51a000640 1 -- 172.21.15.37:0/2104138462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc2af40 msgr2=0x559c5dc2d330 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:09:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.233+0000 7fa51a000640 1 --2- 172.21.15.37:0/2104138462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc2af40 0x559c5dc2d330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.233+0000 7fa51a000640 1 -- 172.21.15.37:0/2104138462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc28610 msgr2=0x559c5dc2aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.233+0000 7fa51a000640 1 --2- 172.21.15.37:0/2104138462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc28610 0x559c5dc2aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.233+0000 7fa51a000640 1 -- 172.21.15.37:0/2104138462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c5db56de0 con 0x559c5dc2d980 2024-08-20T05:09:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.234+0000 7fa51a000640 1 --2- 172.21.15.37:0/2104138462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 0x559c5dc2fe40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa508033040 tx=0x7fa508004cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b51ecde51e4b17e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.234+0000 7fa507e00640 1 -- 172.21.15.37:0/2104138462 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa508005190 con 0x559c5dc2d980 2024-08-20T05:09:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.235+0000 7fa507e00640 1 -- 172.21.15.37:0/2104138462 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa508031440 con 0x559c5dc2d980 2024-08-20T05:09:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.235+0000 7fa507e00640 1 -- 172.21.15.37:0/2104138462 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa508005190 con 0x559c5dc2d980 2024-08-20T05:09:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.235+0000 7fa513400640 1 --2- 172.21.15.37:0/2638220718 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa5000b3c50 0x7fa5000b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.235+0000 7fa513400640 1 -- 172.21.15.37:0/2638220718 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa50c0e3c20 con 0x7fa51c0757f0 2024-08-20T05:09:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.236+0000 7fa524819740 1 -- 172.21.15.37:0/2104138462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 msgr2=0x559c5dc2fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.236+0000 7fa524819740 1 --2- 172.21.15.37:0/2104138462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 0x559c5dc2fe40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fa508033040 tx=0x7fa508004cb0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.236+0000 7fa524819740 1 -- 172.21.15.37:0/2104138462 shutdown_connections 2024-08-20T05:09:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.236+0000 7fa524819740 1 --2- 172.21.15.37:0/2104138462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 0x559c5dc2fe40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.236+0000 7fa524819740 1 --2- 172.21.15.37:0/2104138462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc2af40 0x559c5dc2d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.236+0000 7fa524819740 1 --2- 172.21.15.37:0/2104138462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc28610 0x559c5dc2aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.236+0000 7fa524819740 1 -- 172.21.15.37:0/2104138462 >> 172.21.15.37:0/2104138462 conn(0x559c5dc23760 msgr2=0x559c5dc244f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.237+0000 7fa51b400640 1 --2- 172.21.15.37:0/2638220718 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa5000b3c50 0x7fa5000b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.238+0000 7fa51b400640 1 --2- 172.21.15.37:0/2638220718 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa5000b3c50 0x7fa5000b6110 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa51c197640 tx=0x7fa5140093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.247+0000 7fa524819740 1 -- 172.21.15.37:0/2104138462 shutdown_connections 2024-08-20T05:09:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.249+0000 7fa524819740 1 -- 172.21.15.37:0/2104138462 wait complete. 2024-08-20T05:09:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.250+0000 7fa524819740 1 -- start start 2024-08-20T05:09:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.250+0000 7fa524819740 1 Processor -- start 2024-08-20T05:09:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.251+0000 7fa524819740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc28610 0x559c5dc31e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.251+0000 7fa524819740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 0x559c5dc324a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.251+0000 7fa524819740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc33050 0x559c5dc334d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.252+0000 7fa51a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 0x559c5dc324a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.252+0000 7fa51a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 0x559c5dc324a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:37778/0 (socket says 172.21.15.37:37778) 2024-08-20T05:09:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.252+0000 7fa51a000640 1 -- 172.21.15.37:0/4271000834 learned_addr learned my addr 172.21.15.37:0/4271000834 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.252+0000 7fa524819740 1 -- 172.21.15.37:0/4271000834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559c5dac3ab0 con 0x559c5dc28610 2024-08-20T05:09:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.252+0000 7fa524819740 1 -- 172.21.15.37:0/4271000834 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559c5db31140 con 0x559c5dc33050 2024-08-20T05:09:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.252+0000 7fa524819740 1 -- 172.21.15.37:0/4271000834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559c5dc30900 con 0x559c5dc2d980 2024-08-20T05:09:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.252+0000 7fa524819740 10 client.0 _ll_register_callbacks cb 0x559c5db445d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.253+0000 7fa51b400640 1 --2- 172.21.15.37:0/4271000834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc33050 0x559c5dc334d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.253+0000 7fa51a000640 1 -- 172.21.15.37:0/4271000834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc33050 msgr2=0x559c5dc334d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.253+0000 7fa51a000640 1 --2- 172.21.15.37:0/4271000834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc33050 0x559c5dc334d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.253+0000 7fa51a000640 1 -- 172.21.15.37:0/4271000834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc28610 msgr2=0x559c5dc31e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.253+0000 7fa51a000640 1 --2- 172.21.15.37:0/4271000834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc28610 0x559c5dc31e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.253+0000 7fa51a000640 1 -- 172.21.15.37:0/4271000834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c5db32170 con 0x559c5dc2d980 2024-08-20T05:09:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.254+0000 7fa51a000640 1 --2- 172.21.15.37:0/4271000834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 0x559c5dc324a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa50802aa10 tx=0x7fa508031680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ca3ca1697c49bde server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.254+0000 7fa504c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:09:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.255+0000 7fa504c00640 1 -- 172.21.15.37:0/4271000834 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa508054020 con 0x559c5dc2d980 2024-08-20T05:09:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.255+0000 7fa504c00640 1 -- 172.21.15.37:0/4271000834 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa508031930 con 0x559c5dc2d980 2024-08-20T05:09:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.255+0000 7fa524819740 1 -- 172.21.15.37:0/4271000834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa508031440 con 0x559c5dc2d980 2024-08-20T05:09:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.256+0000 7fa504c00640 1 -- 172.21.15.37:0/4271000834 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa508004f90 con 0x559c5dc2d980 2024-08-20T05:09:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.256+0000 7fa524819740 10 client.27433 fetch_fsmap learned FSMap version 39 2024-08-20T05:09:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.256+0000 7fa524819740 1 -- 172.21.15.37:0/4271000834 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x559c5d8ed790 con 0x559c5dc2d980 2024-08-20T05:09:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.256+0000 7fa504c00640 1 -- 172.21.15.37:0/4271000834 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5080055e0 con 0x559c5dc2d980 2024-08-20T05:09:51.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.258+0000 7fa504c00640 1 -- 172.21.15.37:0/4271000834 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7fa508050b90 con 0x559c5dc2d980 2024-08-20T05:09:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.258+0000 7fa524819740 10 client.27433 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:09:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.258+0000 7fa524819740 10 client.27433 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:09:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.258+0000 7fa524819740 20 client.27433 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.258+0000 7fa524819740 1 --2- 172.21.15.37:0/4271000834 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559c5dc3da40 0x559c5dc3fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.258+0000 7fa524819740 4 client.27433 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:09:51.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.258+0000 7fa524819740 1 -- 172.21.15.37:0/4271000834 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fa508031440 con 0x559c5dc3da40 2024-08-20T05:09:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.258+0000 7fa51aa00640 1 --2- 172.21.15.37:0/4271000834 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559c5dc3da40 0x559c5dc3fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.259+0000 7fa51aa00640 1 --2- 172.21.15.37:0/4271000834 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559c5dc3da40 0x559c5dc3fe80 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a830750ee9eb3d0c server_cookie=9285fac8ea11baf1 in_seq=0 out_seq=0 2024-08-20T05:09:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.259+0000 7fa504c00640 10 client.27433 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:51.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.260+0000 7fa504c00640 1 -- 172.21.15.37:0/4271000834 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fa508031440 con 0x559c5dc3da40 2024-08-20T05:09:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.260+0000 7fa504c00640 10 client.27433 handle_command_reply: tid=0 2024-08-20T05:09:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.260+0000 7fa524819740 1 client.27433 shutdown 2024-08-20T05:09:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.260+0000 7fa524819740 1 -- 172.21.15.37:0/4271000834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 msgr2=0x559c5dc324a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.260+0000 7fa524819740 1 --2- 172.21.15.37:0/4271000834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 0x559c5dc324a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa50802aa10 tx=0x7fa508031680 comp rx=0 tx=0).stop 2024-08-20T05:09:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.262+0000 7fa524819740 1 -- 172.21.15.37:0/4271000834 shutdown_connections 2024-08-20T05:09:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.262+0000 7fa524819740 1 --2- 172.21.15.37:0/4271000834 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559c5dc3da40 0x559c5dc3fe80 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.262+0000 7fa524819740 1 --2- 172.21.15.37:0/4271000834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc33050 0x559c5dc334d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.262+0000 7fa524819740 1 --2- 172.21.15.37:0/4271000834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 0x559c5dc324a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.262+0000 7fa524819740 1 --2- 172.21.15.37:0/4271000834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc28610 0x559c5dc31e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.262+0000 7fa504c00640 0 client.27433 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.262+0000 7fa524819740 1 -- 172.21.15.37:0/4271000834 >> 172.21.15.37:0/4271000834 conn(0x559c5dc23760 msgr2=0x559c5dc22760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.262+0000 7fa524819740 1 -- 172.21.15.37:0/4271000834 shutdown_connections 2024-08-20T05:09:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.262+0000 7fa524819740 1 -- 172.21.15.37:0/4271000834 wait complete. 2024-08-20T05:09:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.263+0000 7fa524819740 20 client.27433 trim_cache size 0 max 16384 2024-08-20T05:09:51.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.306+0000 7fa524819740 1 Processor -- start 2024-08-20T05:09:51.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.307+0000 7fa524819740 1 -- start start 2024-08-20T05:09:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.307+0000 7fa524819740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc28610 0x559c5dc32510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.307+0000 7fa524819740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 0x559c5dc30cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.307+0000 7fa524819740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc33050 0x559c5dc31210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.307+0000 7fa524819740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1b9fe0 con 0x559c5dc28610 2024-08-20T05:09:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.307+0000 7fa524819740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1bbc40 con 0x559c5dc33050 2024-08-20T05:09:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.307+0000 7fa524819740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1ba6b0 con 0x559c5dc2d980 2024-08-20T05:09:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.308+0000 7fa51a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 0x559c5dc30cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:51.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.308+0000 7fa51a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 0x559c5dc30cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:37792/0 (socket says 172.21.15.37:37792) 2024-08-20T05:09:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.308+0000 7fa51a000640 1 -- 172.21.15.37:0/531296773 learned_addr learned my addr 172.21.15.37:0/531296773 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.308+0000 7fa51aa00640 1 --2- 172.21.15.37:0/531296773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc28610 0x559c5dc32510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.308+0000 7fa51b400640 1 --2- 172.21.15.37:0/531296773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc33050 0x559c5dc31210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.309+0000 7fa51aa00640 1 -- 172.21.15.37:0/531296773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 msgr2=0x559c5dc30cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:51.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.309+0000 7fa51aa00640 1 --2- 172.21.15.37:0/531296773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 0x559c5dc30cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.309+0000 7fa51aa00640 1 -- 172.21.15.37:0/531296773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc33050 msgr2=0x559c5dc31210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:51.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.310+0000 7fa51aa00640 1 --2- 172.21.15.37:0/531296773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc33050 0x559c5dc31210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.310+0000 7fa51aa00640 1 -- 172.21.15.37:0/531296773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c5dc2d6a0 con 0x559c5dc28610 2024-08-20T05:09:51.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.310+0000 7fa51b400640 1 --2- 172.21.15.37:0/531296773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc33050 0x559c5dc31210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:09:51.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.310+0000 7fa51aa00640 1 --2- 172.21.15.37:0/531296773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc28610 0x559c5dc32510 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x559c5dc24d70 tx=0x7fa50c0048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac81347ffb5c4b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:51.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.311+0000 7fa507400640 1 -- 172.21.15.37:0/531296773 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c01d040 con 0x559c5dc28610 2024-08-20T05:09:51.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.311+0000 7fa507400640 1 -- 172.21.15.37:0/531296773 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa50c0aaed0 con 0x559c5dc28610 2024-08-20T05:09:51.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.311+0000 7fa507400640 1 -- 172.21.15.37:0/531296773 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0a9a30 con 0x559c5dc28610 2024-08-20T05:09:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.312+0000 7fa524819740 1 -- 172.21.15.37:0/531296773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc28610 msgr2=0x559c5dc32510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.312+0000 7fa524819740 1 --2- 172.21.15.37:0/531296773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc28610 0x559c5dc32510 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x559c5dc24d70 tx=0x7fa50c0048a0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.312+0000 7fa524819740 1 -- 172.21.15.37:0/531296773 shutdown_connections 2024-08-20T05:09:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.312+0000 7fa524819740 1 --2- 172.21.15.37:0/531296773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc33050 0x559c5dc31210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.312+0000 7fa524819740 1 --2- 172.21.15.37:0/531296773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc2d980 0x559c5dc30cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.312+0000 7fa524819740 1 --2- 172.21.15.37:0/531296773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc28610 0x559c5dc32510 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.312+0000 7fa524819740 1 -- 172.21.15.37:0/531296773 >> 172.21.15.37:0/531296773 conn(0x559c5dc23760 msgr2=0x559c5dc31e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.312+0000 7fa524819740 1 -- 172.21.15.37:0/531296773 shutdown_connections 2024-08-20T05:09:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.312+0000 7fa524819740 1 -- 172.21.15.37:0/531296773 wait complete. 2024-08-20T05:09:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.313+0000 7fa524819740 1 -- start start 2024-08-20T05:09:51.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.313+0000 7fa524819740 1 Processor -- start 2024-08-20T05:09:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.314+0000 7fa524819740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc2d980 0x559c5dc38fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.314+0000 7fa524819740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc33050 0x559c5dc39660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.315+0000 7fa524819740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc37d60 0x559c5dc381e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.315+0000 7fa51a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc33050 0x559c5dc39660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.315+0000 7fa524819740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1bb4b0 con 0x559c5dc37d60 2024-08-20T05:09:51.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.315+0000 7fa524819740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1bad80 con 0x559c5dc2d980 2024-08-20T05:09:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.315+0000 7fa524819740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c1b8070 con 0x559c5dc33050 2024-08-20T05:09:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.315+0000 7fa524819740 10 client.0 _ll_register_callbacks cb 0x7fa5080095a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.315+0000 7fa51b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc37d60 0x559c5dc381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.315+0000 7fa51a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc33050 0x559c5dc39660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:37802/0 (socket says 172.21.15.37:37802) 2024-08-20T05:09:51.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.315+0000 7fa51aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc2d980 0x559c5dc38fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.315+0000 7fa51a000640 1 -- 172.21.15.37:0/3314423121 learned_addr learned my addr 172.21.15.37:0/3314423121 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.316+0000 7fa51aa00640 1 -- 172.21.15.37:0/3314423121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc33050 msgr2=0x559c5dc39660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.316+0000 7fa51aa00640 1 --2- 172.21.15.37:0/3314423121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc33050 0x559c5dc39660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.316+0000 7fa51aa00640 1 -- 172.21.15.37:0/3314423121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc37d60 msgr2=0x559c5dc381e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.316+0000 7fa51aa00640 1 --2- 172.21.15.37:0/3314423121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc37d60 0x559c5dc381e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.316+0000 7fa51aa00640 1 -- 172.21.15.37:0/3314423121 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c5d966620 con 0x559c5dc2d980 2024-08-20T05:09:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.316+0000 7fa51b400640 1 --2- 172.21.15.37:0/3314423121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc37d60 0x559c5dc381e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:09:51.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.317+0000 7fa504c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:09:51.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.317+0000 7fa51aa00640 1 --2- 172.21.15.37:0/3314423121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc2d980 0x559c5dc38fc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00c940 tx=0x7fa50c0a6c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20e590ca7b73dd6e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:51.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.319+0000 7fa504c00640 1 -- 172.21.15.37:0/3314423121 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0e1500 con 0x559c5dc2d980 2024-08-20T05:09:51.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.319+0000 7fa504c00640 1 -- 172.21.15.37:0/3314423121 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa50c0cd2d0 con 0x559c5dc2d980 2024-08-20T05:09:51.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.319+0000 7fa524819740 1 -- 172.21.15.37:0/3314423121 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa50c0aaed0 con 0x559c5dc2d980 2024-08-20T05:09:51.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.320+0000 7fa504c00640 1 -- 172.21.15.37:0/3314423121 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa50c0aa7d0 con 0x559c5dc2d980 2024-08-20T05:09:51.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.320+0000 7fa524819740 10 client.27428 fetch_fsmap learned FSMap version 39 2024-08-20T05:09:51.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.320+0000 7fa524819740 1 -- 172.21.15.37:0/3314423121 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x559c5dc37620 con 0x559c5dc2d980 2024-08-20T05:09:51.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.320+0000 7fa504c00640 1 -- 172.21.15.37:0/3314423121 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa50c0aaed0 con 0x559c5dc2d980 2024-08-20T05:09:51.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.321+0000 7fa504c00640 1 -- 172.21.15.37:0/3314423121 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7fa50c0a6240 con 0x559c5dc2d980 2024-08-20T05:09:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.321+0000 7fa524819740 10 client.27428 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:09:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.321+0000 7fa524819740 10 client.27428 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:09:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.321+0000 7fa524819740 20 client.27428 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.321+0000 7fa524819740 1 --2- 172.21.15.37:0/3314423121 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559c5dca8ed0 0x559c5dcab2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.321+0000 7fa524819740 4 client.27428 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:09:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.321+0000 7fa524819740 1 -- 172.21.15.37:0/3314423121 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559c5db9d160 con 0x559c5dca8ed0 2024-08-20T05:09:51.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.322+0000 7fa51a000640 1 --2- 172.21.15.37:0/3314423121 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559c5dca8ed0 0x559c5dcab2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.323+0000 7fa51a000640 1 --2- 172.21.15.37:0/3314423121 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559c5dca8ed0 0x559c5dcab2f0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3987e7002c7ec5f5 server_cookie=5ef93ad8fd2975be in_seq=0 out_seq=0 2024-08-20T05:09:51.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.323+0000 7fa504c00640 10 client.27428 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.447+0000 7fa504c00640 1 -- 172.21.15.37:0/3314423121 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559c5db9d160 con 0x559c5dca8ed0 2024-08-20T05:09:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.447+0000 7fa504c00640 10 client.27428 handle_command_reply: tid=0 2024-08-20T05:09:51.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.447+0000 7fa524819740 1 client.27428 shutdown 2024-08-20T05:09:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.447+0000 7fa524819740 1 -- 172.21.15.37:0/3314423121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc2d980 msgr2=0x559c5dc38fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.447+0000 7fa524819740 1 --2- 172.21.15.37:0/3314423121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc2d980 0x559c5dc38fc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00c940 tx=0x7fa50c0a6c70 comp rx=0 tx=0).stop 2024-08-20T05:09:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.447+0000 7fa524819740 1 -- 172.21.15.37:0/3314423121 shutdown_connections 2024-08-20T05:09:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.447+0000 7fa524819740 1 --2- 172.21.15.37:0/3314423121 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559c5dca8ed0 0x559c5dcab2f0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.447+0000 7fa524819740 1 --2- 172.21.15.37:0/3314423121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c5dc37d60 0x559c5dc381e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.447+0000 7fa524819740 1 --2- 172.21.15.37:0/3314423121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559c5dc33050 0x559c5dc39660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.447+0000 7fa524819740 1 --2- 172.21.15.37:0/3314423121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559c5dc2d980 0x559c5dc38fc0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.447+0000 7fa524819740 1 -- 172.21.15.37:0/3314423121 >> 172.21.15.37:0/3314423121 conn(0x559c5dc23760 msgr2=0x559c5dc21f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.448+0000 7fa504c00640 0 client.27428 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.448+0000 7fa524819740 1 -- 172.21.15.37:0/3314423121 shutdown_connections 2024-08-20T05:09:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.448+0000 7fa524819740 1 -- 172.21.15.37:0/3314423121 wait complete. 2024-08-20T05:09:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.448+0000 7fa524819740 20 client.27428 trim_cache size 0 max 16384 2024-08-20T05:09:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:09:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:09:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:09:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:09:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.451+0000 7fa521800640 1 -- 172.21.15.37:0/2638220718 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa5000b3c50 msgr2=0x7fa5000b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.451+0000 7fa521800640 1 --2- 172.21.15.37:0/2638220718 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa5000b3c50 0x7fa5000b6110 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa51c197640 tx=0x7fa5140093f0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.451+0000 7fa521800640 1 -- 172.21.15.37:0/2638220718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c0757f0 msgr2=0x7fa51c1968c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.451+0000 7fa521800640 1 --2- 172.21.15.37:0/2638220718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c0757f0 0x7fa51c1968c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00c970 tx=0x7fa50c00ce30 comp rx=0 tx=0).stop 2024-08-20T05:09:51.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.451+0000 7fa521800640 1 -- 172.21.15.37:0/2638220718 shutdown_connections 2024-08-20T05:09:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.451+0000 7fa521800640 1 --2- 172.21.15.37:0/2638220718 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa5000b3c50 0x7fa5000b6110 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.451+0000 7fa521800640 1 --2- 172.21.15.37:0/2638220718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa51c10a600 0x7fa51c197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.451+0000 7fa521800640 1 --2- 172.21.15.37:0/2638220718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa51c076c60 0x7fa51c196f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.451+0000 7fa521800640 1 --2- 172.21.15.37:0/2638220718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa51c0757f0 0x7fa51c1968c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.451+0000 7fa521800640 1 -- 172.21.15.37:0/2638220718 >> 172.21.15.37:0/2638220718 conn(0x7fa51c0fdf40 msgr2=0x7fa51c0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.452+0000 7fa521800640 1 -- 172.21.15.37:0/2638220718 shutdown_connections 2024-08-20T05:09:51.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:09:51.452+0000 7fa521800640 1 -- 172.21.15.37:0/2638220718 wait complete. 2024-08-20T05:09:51.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:51 smithi135 ceph-mon[22342]: pgmap v629: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 606 op/s 2024-08-20T05:09:51.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:51 smithi130 ceph-mon[22007]: pgmap v629: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 606 op/s 2024-08-20T05:09:51.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:51 smithi037 ceph-mon[17265]: pgmap v629: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 606 op/s 2024-08-20T05:09:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 415.0 s, 912.2 tps, lat 111.219 ms stddev 142.610 2024-08-20T05:09:53.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:53 smithi135 ceph-mon[22342]: pgmap v630: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 599 op/s 2024-08-20T05:09:53.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:53 smithi130 ceph-mon[22007]: pgmap v630: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 599 op/s 2024-08-20T05:09:53.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:53 smithi037 ceph-mon[17265]: pgmap v630: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 599 op/s 2024-08-20T05:09:54.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:09:55.358 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:55 smithi037 ceph-mon[17265]: pgmap v631: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 562 op/s 2024-08-20T05:09:55.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:55 smithi135 ceph-mon[22342]: pgmap v631: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 562 op/s 2024-08-20T05:09:55.681 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:09:55.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:55 smithi130 ceph-mon[22007]: pgmap v631: 129 pgs: 129 active+clean; 1.4 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 562 op/s 2024-08-20T05:09:56.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.459+0000 7f9489c00640 1 -- 172.21.15.37:0/966528090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9484107050 msgr2=0x7f948410d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:56.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.459+0000 7f9489c00640 1 --2- 172.21.15.37:0/966528090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9484107050 0x7f948410d850 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f947c009ca0 tx=0x7f947c02a8e0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.459+0000 7f9489c00640 1 -- 172.21.15.37:0/966528090 shutdown_connections 2024-08-20T05:09:56.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.459+0000 7f9489c00640 1 --2- 172.21.15.37:0/966528090 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9484107050 0x7f948410d850 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.459+0000 7f9489c00640 1 --2- 172.21.15.37:0/966528090 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94841066d0 0x7f9484106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.459+0000 7f9489c00640 1 --2- 172.21.15.37:0/966528090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9484100cc0 0x7f94841010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.459+0000 7f9489c00640 1 -- 172.21.15.37:0/966528090 >> 172.21.15.37:0/966528090 conn(0x7f94840fc730 msgr2=0x7f94840feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:56.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.459+0000 7f9489c00640 1 -- 172.21.15.37:0/966528090 shutdown_connections 2024-08-20T05:09:56.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.459+0000 7f9489c00640 1 -- 172.21.15.37:0/966528090 wait complete. 2024-08-20T05:09:56.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.461+0000 7f9489c00640 1 Processor -- start 2024-08-20T05:09:56.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.462+0000 7f9489c00640 1 -- start start 2024-08-20T05:09:56.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.462+0000 7f9489c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9484100cc0 0x7f94841120a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.462+0000 7f9489c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94841066d0 0x7f94841125e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.462+0000 7f9489c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9484107050 0x7f9484117980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.462+0000 7f9489c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9484110900 con 0x7f94841066d0 2024-08-20T05:09:56.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.462+0000 7f9489c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9484110780 con 0x7f9484107050 2024-08-20T05:09:56.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.462+0000 7f9489c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9484110a80 con 0x7f9484100cc0 2024-08-20T05:09:56.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.463+0000 7f9482a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9484100cc0 0x7f94841120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.463+0000 7f9482a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9484100cc0 0x7f94841120a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42828/0 (socket says 172.21.15.37:42828) 2024-08-20T05:09:56.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.463+0000 7f9482a00640 1 -- 172.21.15.37:0/856957440 learned_addr learned my addr 172.21.15.37:0/856957440 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:56.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.463+0000 7f9482000640 1 --2- 172.21.15.37:0/856957440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94841066d0 0x7f94841125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.463+0000 7f9483400640 1 --2- 172.21.15.37:0/856957440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9484107050 0x7f9484117980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.464+0000 7f9483400640 1 -- 172.21.15.37:0/856957440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9484100cc0 msgr2=0x7f94841120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:56.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.464+0000 7f9483400640 1 --2- 172.21.15.37:0/856957440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9484100cc0 0x7f94841120a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.464+0000 7f9483400640 1 -- 172.21.15.37:0/856957440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94841066d0 msgr2=0x7f94841125e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:56.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.464+0000 7f9483400640 1 --2- 172.21.15.37:0/856957440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94841066d0 0x7f94841125e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.464+0000 7f9483400640 1 -- 172.21.15.37:0/856957440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9484118100 con 0x7f9484107050 2024-08-20T05:09:56.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.468+0000 7f9483400640 1 --2- 172.21.15.37:0/856957440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9484107050 0x7f9484117980 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f947c02aed0 tx=0x7f947c003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:56.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.468+0000 7f947b400640 1 -- 172.21.15.37:0/856957440 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c004040 con 0x7f9484107050 2024-08-20T05:09:56.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.468+0000 7f947b400640 1 -- 172.21.15.37:0/856957440 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f947c004690 con 0x7f9484107050 2024-08-20T05:09:56.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.468+0000 7f947b400640 1 -- 172.21.15.37:0/856957440 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c03a400 con 0x7f9484107050 2024-08-20T05:09:56.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.468+0000 7f9489c00640 1 -- 172.21.15.37:0/856957440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9484118390 con 0x7f9484107050 2024-08-20T05:09:56.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.468+0000 7f9489c00640 1 -- 172.21.15.37:0/856957440 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948411cb10 con 0x7f9484107050 2024-08-20T05:09:56.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.480+0000 7f948c877740 1 Processor -- start 2024-08-20T05:09:56.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.481+0000 7f947b400640 1 -- 172.21.15.37:0/856957440 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f947c030670 con 0x7f9484107050 2024-08-20T05:09:56.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.481+0000 7f948c877740 1 -- start start 2024-08-20T05:09:56.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.482+0000 7f948c877740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5100900 0x559fb5100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.482+0000 7f948c877740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5101220 0x559fb510cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.482+0000 7f948c877740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb510d1b0 0x559fb510f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.482+0000 7f948c877740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559fb5076a60 con 0x559fb510d1b0 2024-08-20T05:09:56.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.482+0000 7f948c877740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559fb5065f60 con 0x559fb5100900 2024-08-20T05:09:56.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.482+0000 7f948c877740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559fb5069fa0 con 0x559fb5101220 2024-08-20T05:09:56.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.482+0000 7f9482000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5100900 0x559fb5100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.482+0000 7f9482a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5101220 0x559fb510cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.482+0000 7f9482000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5100900 0x559fb5100ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:46000/0 (socket says 172.21.15.37:46000) 2024-08-20T05:09:56.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.482+0000 7f9482a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5101220 0x559fb510cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42840/0 (socket says 172.21.15.37:42840) 2024-08-20T05:09:56.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.482+0000 7f9482000640 1 -- 172.21.15.37:0/4059569470 learned_addr learned my addr 172.21.15.37:0/4059569470 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:56.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.482+0000 7f9482000640 1 --2- 172.21.15.37:0/4059569470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb510d1b0 0x559fb510f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.483+0000 7f9482000640 1 -- 172.21.15.37:0/4059569470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5101220 msgr2=0x559fb510cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:56.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.483+0000 7f947b400640 1 --2- 172.21.15.37:0/856957440 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f94680b3c30 0x7f94680b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.484+0000 7f947b400640 1 -- 172.21.15.37:0/856957440 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f947c105460 con 0x7f9484107050 2024-08-20T05:09:56.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.485+0000 7f9483400640 1 --2- 172.21.15.37:0/856957440 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f94680b3c30 0x7f94680b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.487+0000 7f9482000640 1 --2- 172.21.15.37:0/4059569470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5101220 0x559fb510cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.487+0000 7f9482000640 1 -- 172.21.15.37:0/4059569470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5100900 msgr2=0x559fb5100ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:56.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.487+0000 7f9482000640 1 --2- 172.21.15.37:0/4059569470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5100900 0x559fb5100ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.487+0000 7f9482000640 1 -- 172.21.15.37:0/4059569470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fb500c3e0 con 0x559fb510d1b0 2024-08-20T05:09:56.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.487+0000 7f9482a00640 1 --2- 172.21.15.37:0/4059569470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5101220 0x559fb510cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:09:56.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.487+0000 7f9483400640 1 --2- 172.21.15.37:0/856957440 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f94680b3c30 0x7f94680b60f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f947c0309c0 tx=0x7f947c0305e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:56.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.491+0000 7f9482000640 1 --2- 172.21.15.37:0/4059569470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb510d1b0 0x559fb510f5a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9470017730 tx=0x7f94700090e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a9a2ce3d5e948 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:56.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.491+0000 7f946fe00640 1 -- 172.21.15.37:0/4059569470 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94700136e0 con 0x559fb510d1b0 2024-08-20T05:09:56.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.491+0000 7f946fe00640 1 -- 172.21.15.37:0/4059569470 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f947001d070 con 0x559fb510d1b0 2024-08-20T05:09:56.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.491+0000 7f946fe00640 1 -- 172.21.15.37:0/4059569470 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470018910 con 0x559fb510d1b0 2024-08-20T05:09:56.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.493+0000 7f948c877740 1 -- 172.21.15.37:0/4059569470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb510d1b0 msgr2=0x559fb510f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:56.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.493+0000 7f948c877740 1 --2- 172.21.15.37:0/4059569470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb510d1b0 0x559fb510f5a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9470017730 tx=0x7f94700090e0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.494+0000 7f948c877740 1 -- 172.21.15.37:0/4059569470 shutdown_connections 2024-08-20T05:09:56.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.494+0000 7f948c877740 1 --2- 172.21.15.37:0/4059569470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb510d1b0 0x559fb510f5a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.494+0000 7f948c877740 1 --2- 172.21.15.37:0/4059569470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5101220 0x559fb510cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.494+0000 7f948c877740 1 --2- 172.21.15.37:0/4059569470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5100900 0x559fb5100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.494+0000 7f948c877740 1 -- 172.21.15.37:0/4059569470 >> 172.21.15.37:0/4059569470 conn(0x559fb50fe730 msgr2=0x559fb50ff8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:56.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.495+0000 7f948c877740 1 -- 172.21.15.37:0/4059569470 shutdown_connections 2024-08-20T05:09:56.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.495+0000 7f948c877740 1 -- 172.21.15.37:0/4059569470 wait complete. 2024-08-20T05:09:56.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.496+0000 7f948c877740 1 -- start start 2024-08-20T05:09:56.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.496+0000 7f948c877740 1 Processor -- start 2024-08-20T05:09:56.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.497+0000 7f948c877740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5100900 0x559fb510c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.500+0000 7f948c877740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb5101220 0x559fb5109dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.500+0000 7f9482000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5100900 0x559fb510c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.500+0000 7f9482000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5100900 0x559fb510c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:46012/0 (socket says 172.21.15.37:46012) 2024-08-20T05:09:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.500+0000 7f948c877740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb510d1b0 0x559fb510a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.500+0000 7f948c877740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559fb4ec8700 con 0x559fb5101220 2024-08-20T05:09:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.500+0000 7f948c877740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559fb5001250 con 0x559fb5100900 2024-08-20T05:09:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.500+0000 7f948c877740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559fb510fdd0 con 0x559fb510d1b0 2024-08-20T05:09:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.500+0000 7f948c877740 10 client.0 _ll_register_callbacks cb 0x559fb5060180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.501+0000 7f9482000640 1 -- 172.21.15.37:0/475618515 learned_addr learned my addr 172.21.15.37:0/475618515 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.501+0000 7f9482000640 1 --2- 172.21.15.37:0/475618515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb510d1b0 0x559fb510a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.501+0000 7f9482a00640 1 --2- 172.21.15.37:0/475618515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb5101220 0x559fb5109dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.501+0000 7f9482000640 1 -- 172.21.15.37:0/475618515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb510d1b0 msgr2=0x559fb510a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.501+0000 7f9482000640 1 --2- 172.21.15.37:0/475618515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb510d1b0 0x559fb510a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.501+0000 7f9482000640 1 -- 172.21.15.37:0/475618515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb5101220 msgr2=0x559fb5109dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.501+0000 7f9482000640 1 --2- 172.21.15.37:0/475618515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb5101220 0x559fb5109dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.501+0000 7f9482000640 1 -- 172.21.15.37:0/475618515 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fb4dc5650 con 0x559fb5100900 2024-08-20T05:09:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.501+0000 7f9482a00640 1 --2- 172.21.15.37:0/475618515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb5101220 0x559fb5109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:09:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.502+0000 7f9482000640 1 --2- 172.21.15.37:0/475618515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5100900 0x559fb510c970 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9470009480 tx=0x7f94700094e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2779d50bc13d239d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.502+0000 7f946cc00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:09:56.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.502+0000 7f946cc00640 1 -- 172.21.15.37:0/475618515 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470013de0 con 0x559fb5100900 2024-08-20T05:09:56.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.503+0000 7f946cc00640 1 -- 172.21.15.37:0/475618515 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9470018690 con 0x559fb5100900 2024-08-20T05:09:56.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.503+0000 7f948c877740 1 -- 172.21.15.37:0/475618515 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f947001d070 con 0x559fb5100900 2024-08-20T05:09:56.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.503+0000 7f946cc00640 1 -- 172.21.15.37:0/475618515 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f9470005970 con 0x559fb5100900 2024-08-20T05:09:56.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.503+0000 7f948c877740 10 client.27440 fetch_fsmap learned FSMap version 39 2024-08-20T05:09:56.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.503+0000 7f948c877740 1 -- 172.21.15.37:0/475618515 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x559fb511b5e0 con 0x559fb5100900 2024-08-20T05:09:56.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.503+0000 7f946cc00640 1 -- 172.21.15.37:0/475618515 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f947001d070 con 0x559fb5100900 2024-08-20T05:09:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.505+0000 7f946cc00640 1 -- 172.21.15.37:0/475618515 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f9470006690 con 0x559fb5100900 2024-08-20T05:09:56.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.505+0000 7f948c877740 10 client.27440 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:09:56.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.505+0000 7f948c877740 10 client.27440 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:09:56.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.505+0000 7f948c877740 20 client.27440 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:56.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.505+0000 7f948c877740 1 --2- 172.21.15.37:0/475618515 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559fb511c9e0 0x559fb511edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.506+0000 7f948c877740 4 client.27440 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:09:56.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.506+0000 7f948c877740 1 -- 172.21.15.37:0/475618515 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fb50789b0 con 0x559fb511c9e0 2024-08-20T05:09:56.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.506+0000 7f9482a00640 1 --2- 172.21.15.37:0/475618515 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559fb511c9e0 0x559fb511edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.509+0000 7f9482a00640 1 --2- 172.21.15.37:0/475618515 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559fb511c9e0 0x559fb511edd0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8453f5753713210 server_cookie=6f1e3c56979f6eba in_seq=0 out_seq=0 2024-08-20T05:09:56.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.509+0000 7f946cc00640 10 client.27440 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:56.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.510+0000 7f946cc00640 1 -- 172.21.15.37:0/475618515 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559fb50789b0 con 0x559fb511c9e0 2024-08-20T05:09:56.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.510+0000 7f946cc00640 10 client.27440 handle_command_reply: tid=0 2024-08-20T05:09:56.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.510+0000 7f948c877740 1 client.27440 shutdown 2024-08-20T05:09:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.511+0000 7f948c877740 1 -- 172.21.15.37:0/475618515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5100900 msgr2=0x559fb510c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.511+0000 7f948c877740 1 --2- 172.21.15.37:0/475618515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5100900 0x559fb510c970 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9470009480 tx=0x7f94700094e0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.511+0000 7f948c877740 1 -- 172.21.15.37:0/475618515 shutdown_connections 2024-08-20T05:09:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.511+0000 7f948c877740 1 --2- 172.21.15.37:0/475618515 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559fb511c9e0 0x559fb511edd0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.511+0000 7f946cc00640 0 client.27440 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.511+0000 7f948c877740 1 --2- 172.21.15.37:0/475618515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb510d1b0 0x559fb510a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.511+0000 7f948c877740 1 --2- 172.21.15.37:0/475618515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb5101220 0x559fb5109dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.511+0000 7f948c877740 1 --2- 172.21.15.37:0/475618515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5100900 0x559fb510c970 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.511+0000 7f948c877740 1 -- 172.21.15.37:0/475618515 >> 172.21.15.37:0/475618515 conn(0x559fb50fe730 msgr2=0x559fb51042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.511+0000 7f948c877740 1 -- 172.21.15.37:0/475618515 shutdown_connections 2024-08-20T05:09:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.511+0000 7f948c877740 1 -- 172.21.15.37:0/475618515 wait complete. 2024-08-20T05:09:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.512+0000 7f948c877740 20 client.27440 trim_cache size 0 max 16384 2024-08-20T05:09:56.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.550+0000 7f948c877740 1 Processor -- start 2024-08-20T05:09:56.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.550+0000 7f948c877740 1 -- start start 2024-08-20T05:09:56.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.551+0000 7f948c877740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5100900 0x559fb5124480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.551+0000 7f948c877740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5101220 0x559fb51249c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.551+0000 7f948c877740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb510d1b0 0x559fb5107010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.551+0000 7f948c877740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f94841be650 con 0x559fb510d1b0 2024-08-20T05:09:56.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.551+0000 7f948c877740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f94841c02b0 con 0x559fb5101220 2024-08-20T05:09:56.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.551+0000 7f948c877740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f94841bed20 con 0x559fb5100900 2024-08-20T05:09:56.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.551+0000 7f9482a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5101220 0x559fb51249c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.551+0000 7f9482a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5101220 0x559fb51249c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:46014/0 (socket says 172.21.15.37:46014) 2024-08-20T05:09:56.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.551+0000 7f9482a00640 1 -- 172.21.15.37:0/1529964048 learned_addr learned my addr 172.21.15.37:0/1529964048 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:56.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.552+0000 7f9482000640 1 --2- 172.21.15.37:0/1529964048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5100900 0x559fb5124480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.552+0000 7f9482000640 1 --2- 172.21.15.37:0/1529964048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb510d1b0 0x559fb5107010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.552+0000 7f9482a00640 1 -- 172.21.15.37:0/1529964048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5100900 msgr2=0x559fb5124480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:56.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.552+0000 7f9482a00640 1 --2- 172.21.15.37:0/1529964048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5100900 0x559fb5124480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.552+0000 7f9482a00640 1 -- 172.21.15.37:0/1529964048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb510d1b0 msgr2=0x559fb5107010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:56.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.552+0000 7f9482a00640 1 --2- 172.21.15.37:0/1529964048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb510d1b0 0x559fb5107010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.552+0000 7f9482a00640 1 -- 172.21.15.37:0/1529964048 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fb50ff1b0 con 0x559fb5101220 2024-08-20T05:09:56.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.552+0000 7f9482000640 1 --2- 172.21.15.37:0/1529964048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5100900 0x559fb5124480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:09:56.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.553+0000 7f9482a00640 1 --2- 172.21.15.37:0/1529964048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5101220 0x559fb51249c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f94740058c0 tx=0x7f9474010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e60fb7430b56007d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:56.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.554+0000 7f946f400640 1 -- 172.21.15.37:0/1529964048 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947401d670 con 0x559fb5101220 2024-08-20T05:09:56.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.554+0000 7f946f400640 1 -- 172.21.15.37:0/1529964048 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f947401dcc0 con 0x559fb5101220 2024-08-20T05:09:56.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.554+0000 7f946f400640 1 -- 172.21.15.37:0/1529964048 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947400fdb0 con 0x559fb5101220 2024-08-20T05:09:56.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.555+0000 7f948c877740 1 -- 172.21.15.37:0/1529964048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5101220 msgr2=0x559fb51249c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:56.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.555+0000 7f948c877740 1 --2- 172.21.15.37:0/1529964048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5101220 0x559fb51249c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f94740058c0 tx=0x7f9474010800 comp rx=0 tx=0).stop 2024-08-20T05:09:56.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.555+0000 7f948c877740 1 -- 172.21.15.37:0/1529964048 shutdown_connections 2024-08-20T05:09:56.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.555+0000 7f948c877740 1 --2- 172.21.15.37:0/1529964048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb510d1b0 0x559fb5107010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.555+0000 7f948c877740 1 --2- 172.21.15.37:0/1529964048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb5101220 0x559fb51249c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.555+0000 7f948c877740 1 --2- 172.21.15.37:0/1529964048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5100900 0x559fb5124480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.555+0000 7f948c877740 1 -- 172.21.15.37:0/1529964048 >> 172.21.15.37:0/1529964048 conn(0x559fb50fe730 msgr2=0x559fb5108660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:56.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.556+0000 7f948c877740 1 -- 172.21.15.37:0/1529964048 shutdown_connections 2024-08-20T05:09:56.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.557+0000 7f948c877740 1 -- 172.21.15.37:0/1529964048 wait complete. 2024-08-20T05:09:56.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.557+0000 7f948c877740 1 -- start start 2024-08-20T05:09:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.559+0000 7f948c877740 1 Processor -- start 2024-08-20T05:09:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.560+0000 7f948c877740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb5100900 0x559fb5182440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.560+0000 7f948c877740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5101220 0x559fb5182980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.560+0000 7f948c877740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb510d1b0 0x559fb51132e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.560+0000 7f948c877740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f94841bfb20 con 0x559fb5100900 2024-08-20T05:09:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.560+0000 7f948c877740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f94841bf3f0 con 0x559fb510d1b0 2024-08-20T05:09:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.560+0000 7f948c877740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f94841bc630 con 0x559fb5101220 2024-08-20T05:09:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.560+0000 7f948c877740 10 client.0 _ll_register_callbacks cb 0x7f9470009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:09:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.560+0000 7f9482000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb510d1b0 0x559fb51132e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.560+0000 7f9482a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5101220 0x559fb5182980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.561+0000 7f9482a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5101220 0x559fb5182980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42878/0 (socket says 172.21.15.37:42878) 2024-08-20T05:09:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.561+0000 7f9482000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb510d1b0 0x559fb51132e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:46028/0 (socket says 172.21.15.37:46028) 2024-08-20T05:09:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.561+0000 7f9482000640 1 -- 172.21.15.37:0/1841215494 learned_addr learned my addr 172.21.15.37:0/1841215494 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.561+0000 7f9482000640 1 --2- 172.21.15.37:0/1841215494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb5100900 0x559fb5182440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.562+0000 7f9482000640 1 -- 172.21.15.37:0/1841215494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5101220 msgr2=0x559fb5182980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.562+0000 7f9482000640 1 --2- 172.21.15.37:0/1841215494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5101220 0x559fb5182980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.562+0000 7f9482000640 1 -- 172.21.15.37:0/1841215494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb5100900 msgr2=0x559fb5182440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:09:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.562+0000 7f9482000640 1 --2- 172.21.15.37:0/1841215494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb5100900 0x559fb5182440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.562+0000 7f9482000640 1 -- 172.21.15.37:0/1841215494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fb5113820 con 0x559fb510d1b0 2024-08-20T05:09:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.562+0000 7f9482000640 1 --2- 172.21.15.37:0/1841215494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb510d1b0 0x559fb51132e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f94700097b0 tx=0x7f94700046e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bae68c480089d69 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.563+0000 7f946cc00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:09:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.563+0000 7f946cc00640 1 -- 172.21.15.37:0/1841215494 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470021a70 con 0x559fb510d1b0 2024-08-20T05:09:56.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.563+0000 7f946cc00640 1 -- 172.21.15.37:0/1841215494 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9470021c10 con 0x559fb510d1b0 2024-08-20T05:09:56.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.563+0000 7f948c877740 1 -- 172.21.15.37:0/1841215494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559fb5074450 con 0x559fb510d1b0 2024-08-20T05:09:56.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.564+0000 7f946cc00640 1 -- 172.21.15.37:0/1841215494 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f9470021e10 con 0x559fb510d1b0 2024-08-20T05:09:56.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.564+0000 7f948c877740 10 client.27446 fetch_fsmap learned FSMap version 39 2024-08-20T05:09:56.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.564+0000 7f948c877740 1 -- 172.21.15.37:0/1841215494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x559fb5198c20 con 0x559fb510d1b0 2024-08-20T05:09:56.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.565+0000 7f946cc00640 1 -- 172.21.15.37:0/1841215494 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559fb5074450 con 0x559fb510d1b0 2024-08-20T05:09:56.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.565+0000 7f946cc00640 1 -- 172.21.15.37:0/1841215494 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f9470018450 con 0x559fb510d1b0 2024-08-20T05:09:56.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.565+0000 7f948c877740 10 client.27446 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:09:56.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.565+0000 7f948c877740 10 client.27446 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:09:56.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.565+0000 7f948c877740 20 client.27446 populate_metadata read hostname 'smithi037' 2024-08-20T05:09:56.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.565+0000 7f948c877740 1 --2- 172.21.15.37:0/1841215494 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559fb511c9e0 0x559fb519b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:56.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.565+0000 7f948c877740 4 client.27446 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:09:56.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.565+0000 7f948c877740 1 -- 172.21.15.37:0/1841215494 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559fb5071b90 con 0x559fb511c9e0 2024-08-20T05:09:56.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.566+0000 7f9482a00640 1 --2- 172.21.15.37:0/1841215494 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559fb511c9e0 0x559fb519b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:56.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.568+0000 7f9482a00640 1 --2- 172.21.15.37:0/1841215494 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559fb511c9e0 0x559fb519b450 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35207d0dfb6309d7 server_cookie=18c213faf853929a in_seq=0 out_seq=0 2024-08-20T05:09:56.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.568+0000 7f946cc00640 10 client.27446 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:56.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.569+0000 7f946cc00640 1 -- 172.21.15.37:0/1841215494 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559fb5071b90 con 0x559fb511c9e0 2024-08-20T05:09:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.569+0000 7f946cc00640 10 client.27446 handle_command_reply: tid=0 2024-08-20T05:09:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.569+0000 7f948c877740 1 client.27446 shutdown 2024-08-20T05:09:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.571+0000 7f948c877740 1 -- 172.21.15.37:0/1841215494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb510d1b0 msgr2=0x559fb51132e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.571+0000 7f948c877740 1 --2- 172.21.15.37:0/1841215494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb510d1b0 0x559fb51132e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f94700097b0 tx=0x7f94700046e0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.571+0000 7f948c877740 1 -- 172.21.15.37:0/1841215494 shutdown_connections 2024-08-20T05:09:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.571+0000 7f948c877740 1 --2- 172.21.15.37:0/1841215494 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559fb511c9e0 0x559fb519b450 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.571+0000 7f948c877740 1 --2- 172.21.15.37:0/1841215494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559fb510d1b0 0x559fb51132e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.571+0000 7f948c877740 1 --2- 172.21.15.37:0/1841215494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559fb5101220 0x559fb5182980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.571+0000 7f948c877740 1 --2- 172.21.15.37:0/1841215494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559fb5100900 0x559fb5182440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.571+0000 7f948c877740 1 -- 172.21.15.37:0/1841215494 >> 172.21.15.37:0/1841215494 conn(0x559fb50fe730 msgr2=0x559fb50fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.571+0000 7f946cc00640 0 client.27446 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:09:56.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.573+0000 7f948c877740 1 -- 172.21.15.37:0/1841215494 shutdown_connections 2024-08-20T05:09:56.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.573+0000 7f948c877740 1 -- 172.21.15.37:0/1841215494 wait complete. 2024-08-20T05:09:56.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.573+0000 7f948c877740 20 client.27446 trim_cache size 0 max 16384 2024-08-20T05:09:56.576 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:09:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-20T05:09:56.577 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-08-20T05:09:56.577 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:09:56.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.574+0000 7f9489c00640 1 -- 172.21.15.37:0/856957440 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f94680b3c30 msgr2=0x7f94680b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:56.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.574+0000 7f9489c00640 1 --2- 172.21.15.37:0/856957440 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f94680b3c30 0x7f94680b60f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f947c0309c0 tx=0x7f947c0305e0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.574+0000 7f9489c00640 1 -- 172.21.15.37:0/856957440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9484107050 msgr2=0x7f9484117980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.574+0000 7f9489c00640 1 --2- 172.21.15.37:0/856957440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9484107050 0x7f9484117980 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f947c02aed0 tx=0x7f947c003ba0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.575+0000 7f9489c00640 1 -- 172.21.15.37:0/856957440 shutdown_connections 2024-08-20T05:09:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.575+0000 7f9489c00640 1 --2- 172.21.15.37:0/856957440 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f94680b3c30 0x7f94680b60f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.575+0000 7f9489c00640 1 --2- 172.21.15.37:0/856957440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9484107050 0x7f9484117980 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.575+0000 7f9489c00640 1 --2- 172.21.15.37:0/856957440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94841066d0 0x7f94841125e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.575+0000 7f9489c00640 1 --2- 172.21.15.37:0/856957440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9484100cc0 0x7f94841120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.575+0000 7f9489c00640 1 -- 172.21.15.37:0/856957440 >> 172.21.15.37:0/856957440 conn(0x7f94840fc730 msgr2=0x7f94840feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.575+0000 7f9489c00640 1 -- 172.21.15.37:0/856957440 shutdown_connections 2024-08-20T05:09:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:56.575+0000 7f9489c00640 1 -- 172.21.15.37:0/856957440 wait complete. 2024-08-20T05:09:57.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:57 smithi135 ceph-mon[22342]: pgmap v632: 129 pgs: 129 active+clean; 1.4 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 609 op/s 2024-08-20T05:09:57.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:57 smithi130 ceph-mon[22007]: pgmap v632: 129 pgs: 129 active+clean; 1.4 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 609 op/s 2024-08-20T05:09:57.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:57 smithi037 ceph-mon[17265]: pgmap v632: 129 pgs: 129 active+clean; 1.4 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 609 op/s 2024-08-20T05:09:57.908 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T05:09:57.909 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:09:58.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 420.0 s, 705.6 tps, lat 133.027 ms stddev 170.919 2024-08-20T05:09:58.622 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:09:59.448 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:09:59 smithi037 ceph-mon[17265]: pgmap v633: 129 pgs: 129 active+clean; 1.4 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 10 MiB/s wr, 541 op/s 2024-08-20T05:09:59.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.632+0000 7fcfff800640 1 -- 172.21.15.37:0/2343510426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff8104ca0 msgr2=0x7fcff8105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:59.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.632+0000 7fcfff800640 1 --2- 172.21.15.37:0/2343510426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff8104ca0 0x7fcff8105080 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcfec009900 tx=0x7fcfec02a410 comp rx=0 tx=0).stop 2024-08-20T05:09:59.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.632+0000 7fcfff800640 1 -- 172.21.15.37:0/2343510426 shutdown_connections 2024-08-20T05:09:59.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.632+0000 7fcfff800640 1 --2- 172.21.15.37:0/2343510426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcff810b030 0x7fcff8111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:59.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.632+0000 7fcfff800640 1 --2- 172.21.15.37:0/2343510426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcff810a6b0 0x7fcff810aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:59.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.632+0000 7fcfff800640 1 --2- 172.21.15.37:0/2343510426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff8104ca0 0x7fcff8105080 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:59.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.632+0000 7fcfff800640 1 -- 172.21.15.37:0/2343510426 >> 172.21.15.37:0/2343510426 conn(0x7fcff8100730 msgr2=0x7fcff8102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:09:59.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.632+0000 7fcfff800640 1 -- 172.21.15.37:0/2343510426 shutdown_connections 2024-08-20T05:09:59.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.632+0000 7fcfff800640 1 -- 172.21.15.37:0/2343510426 wait complete. 2024-08-20T05:09:59.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.634+0000 7fcfff800640 1 Processor -- start 2024-08-20T05:09:59.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.634+0000 7fcfff800640 1 -- start start 2024-08-20T05:09:59.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.635+0000 7fcfff800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcff8104ca0 0x7fcff819b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:59.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.635+0000 7fcfff800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcff810a6b0 0x7fcff819b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:59.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.635+0000 7fcfff800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff810b030 0x7fcff81a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:59.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.635+0000 7fcfff800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fcff8114d40 con 0x7fcff810b030 2024-08-20T05:09:59.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.635+0000 7fcfff800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fcff8114bc0 con 0x7fcff8104ca0 2024-08-20T05:09:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.635+0000 7fcfff800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fcff8114ec0 con 0x7fcff810a6b0 2024-08-20T05:09:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.635+0000 7fcffce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcff8104ca0 0x7fcff819b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.635+0000 7fcffce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcff8104ca0 0x7fcff819b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:46050/0 (socket says 172.21.15.37:46050) 2024-08-20T05:09:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.635+0000 7fcffce00640 1 -- 172.21.15.37:0/4185652548 learned_addr learned my addr 172.21.15.37:0/4185652548 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:09:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.635+0000 7fcff7e00640 1 --2- 172.21.15.37:0/4185652548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcff810a6b0 0x7fcff819b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.636+0000 7fcffd800640 1 --2- 172.21.15.37:0/4185652548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff810b030 0x7fcff81a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.636+0000 7fcffce00640 1 -- 172.21.15.37:0/4185652548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcff810a6b0 msgr2=0x7fcff819b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.636+0000 7fcffce00640 1 --2- 172.21.15.37:0/4185652548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcff810a6b0 0x7fcff819b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.636+0000 7fcffce00640 1 -- 172.21.15.37:0/4185652548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff810b030 msgr2=0x7fcff81a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:09:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.636+0000 7fcffce00640 1 --2- 172.21.15.37:0/4185652548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff810b030 0x7fcff81a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:09:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.636+0000 7fcffce00640 1 -- 172.21.15.37:0/4185652548 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff81a12e0 con 0x7fcff8104ca0 2024-08-20T05:09:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.636+0000 7fcffd800640 1 --2- 172.21.15.37:0/4185652548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff810b030 0x7fcff81a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:09:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.636+0000 7fcffce00640 1 --2- 172.21.15.37:0/4185652548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcff8104ca0 0x7fcff819b230 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcfec031440 tx=0x7fcfec003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:59.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.637+0000 7fcff5600640 1 -- 172.21.15.37:0/4185652548 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec03f070 con 0x7fcff8104ca0 2024-08-20T05:09:59.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.637+0000 7fcff5600640 1 -- 172.21.15.37:0/4185652548 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcfec031b50 con 0x7fcff8104ca0 2024-08-20T05:09:59.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.637+0000 7fcff5600640 1 -- 172.21.15.37:0/4185652548 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec035030 con 0x7fcff8104ca0 2024-08-20T05:09:59.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.637+0000 7fcfff800640 1 -- 172.21.15.37:0/4185652548 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff81a1570 con 0x7fcff8104ca0 2024-08-20T05:09:59.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.637+0000 7fcfff800640 1 -- 172.21.15.37:0/4185652548 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff81a7c90 con 0x7fcff8104ca0 2024-08-20T05:09:59.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.639+0000 7fcfff800640 1 -- 172.21.15.37:0/4185652548 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff8105080 con 0x7fcff8104ca0 2024-08-20T05:09:59.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.642+0000 7fcff5600640 1 -- 172.21.15.37:0/4185652548 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fcfec042070 con 0x7fcff8104ca0 2024-08-20T05:09:59.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.644+0000 7fcff5600640 1 --2- 172.21.15.37:0/4185652548 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcfe00b3c90 0x7fcfe00b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:09:59.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.644+0000 7fcff5600640 1 -- 172.21.15.37:0/4185652548 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fcfec104780 con 0x7fcff8104ca0 2024-08-20T05:09:59.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.646+0000 7fcff7e00640 1 --2- 172.21.15.37:0/4185652548 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcfe00b3c90 0x7fcfe00b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:09:59.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.647+0000 7fcff5600640 1 -- 172.21.15.37:0/4185652548 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fcfec072070 con 0x7fcff8104ca0 2024-08-20T05:09:59.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:09:59.648+0000 7fcff7e00640 1 --2- 172.21.15.37:0/4185652548 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcfe00b3c90 0x7fcfe00b6150 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcff8101b30 tx=0x7fcfe4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:09:59.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:09:59 smithi130 ceph-mon[22007]: pgmap v633: 129 pgs: 129 active+clean; 1.4 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 10 MiB/s wr, 541 op/s 2024-08-20T05:09:59.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:09:59 smithi135 ceph-mon[22342]: pgmap v633: 129 pgs: 129 active+clean; 1.4 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 10 MiB/s wr, 541 op/s 2024-08-20T05:10:00.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:00.074+0000 7fcfff800640 1 -- 172.21.15.37:0/4185652548 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcff819c360 con 0x7fcff8104ca0 2024-08-20T05:10:00.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:00.075+0000 7fcff5600640 1 -- 172.21.15.37:0/4185652548 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11990 (secure 0 0 0) 0x7fcfec0cba30 con 0x7fcff8104ca0 2024-08-20T05:10:00.077 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:10:00.077 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":39,"btime":"2024-08-20T05:09:24:153999+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:09:24.103831+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:10:00.077 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 39 2024-08-20T05:10:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:00.079+0000 7fcfff800640 1 -- 172.21.15.37:0/4185652548 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcfe00b3c90 msgr2=0x7fcfe00b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:00.079+0000 7fcfff800640 1 --2- 172.21.15.37:0/4185652548 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcfe00b3c90 0x7fcfe00b6150 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcff8101b30 tx=0x7fcfe4005f90 comp rx=0 tx=0).stop 2024-08-20T05:10:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:00.079+0000 7fcfff800640 1 -- 172.21.15.37:0/4185652548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcff8104ca0 msgr2=0x7fcff819b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:00.079+0000 7fcfff800640 1 --2- 172.21.15.37:0/4185652548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcff8104ca0 0x7fcff819b230 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcfec031440 tx=0x7fcfec003b90 comp rx=0 tx=0).stop 2024-08-20T05:10:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:00.080+0000 7fcfff800640 1 -- 172.21.15.37:0/4185652548 shutdown_connections 2024-08-20T05:10:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:00.080+0000 7fcfff800640 1 --2- 172.21.15.37:0/4185652548 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fcfe00b3c90 0x7fcfe00b6150 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:00.080+0000 7fcfff800640 1 --2- 172.21.15.37:0/4185652548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcff810b030 0x7fcff81a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:00.080+0000 7fcfff800640 1 --2- 172.21.15.37:0/4185652548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fcff810a6b0 0x7fcff819b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:00.080+0000 7fcfff800640 1 --2- 172.21.15.37:0/4185652548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fcff8104ca0 0x7fcff819b230 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:00.080+0000 7fcfff800640 1 -- 172.21.15.37:0/4185652548 >> 172.21.15.37:0/4185652548 conn(0x7fcff8100730 msgr2=0x7fcff8102090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:00.081+0000 7fcfff800640 1 -- 172.21.15.37:0/4185652548 shutdown_connections 2024-08-20T05:10:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:00.081+0000 7fcfff800640 1 -- 172.21.15.37:0/4185652548 wait complete. 2024-08-20T05:10:00.674 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:00 smithi037 ceph-mon[17265]: overall HEALTH_OK 2024-08-20T05:10:00.675 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:00 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/4185652548' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:10:00.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:00 smithi130 ceph-mon[22007]: overall HEALTH_OK 2024-08-20T05:10:00.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:00 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/4185652548' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:10:00.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:00 smithi135 ceph-mon[22342]: overall HEALTH_OK 2024-08-20T05:10:00.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:00 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/4185652548' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:10:01.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T05:10:01.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:01 smithi130 ceph-mon[22007]: pgmap v634: 129 pgs: 129 active+clean; 1.4 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 581 op/s 2024-08-20T05:10:01.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:01 smithi037 ceph-mon[17265]: pgmap v634: 129 pgs: 129 active+clean; 1.4 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 581 op/s 2024-08-20T05:10:01.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:01 smithi135 ceph-mon[22342]: pgmap v634: 129 pgs: 129 active+clean; 1.4 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 581 op/s 2024-08-20T05:10:01.951 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:10:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.944+0000 7f4ccc600640 1 -- 172.21.15.37:0/3642406718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cc410a260 msgr2=0x7f4cc410a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.944+0000 7f4ccc600640 1 --2- 172.21.15.37:0/3642406718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cc410a260 0x7f4cc410a6a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009860 tx=0x7f4cb002a410 comp rx=0 tx=0).stop 2024-08-20T05:10:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.945+0000 7f4ccc600640 1 -- 172.21.15.37:0/3642406718 shutdown_connections 2024-08-20T05:10:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.945+0000 7f4ccc600640 1 --2- 172.21.15.37:0/3642406718 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cc411bdd0 0x7f4cc411e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.945+0000 7f4ccc600640 1 --2- 172.21.15.37:0/3642406718 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cc410a260 0x7f4cc410a6a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.945+0000 7f4ccc600640 1 --2- 172.21.15.37:0/3642406718 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cc4109e80 0x7f4cc4110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.945+0000 7f4ccc600640 1 -- 172.21.15.37:0/3642406718 >> 172.21.15.37:0/3642406718 conn(0x7f4cc406dcc0 msgr2=0x7f4cc406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.946+0000 7f4ccc600640 1 -- 172.21.15.37:0/3642406718 shutdown_connections 2024-08-20T05:10:02.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.946+0000 7f4ccc600640 1 -- 172.21.15.37:0/3642406718 wait complete. 2024-08-20T05:10:02.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.948+0000 7f4ccc600640 1 Processor -- start 2024-08-20T05:10:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.949+0000 7f4ccc600640 1 -- start start 2024-08-20T05:10:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.949+0000 7f4ccc600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cc4109e80 0x7f4cc41a7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.949+0000 7f4ccc600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cc410a260 0x7f4cc41a8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.949+0000 7f4ccc600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cc411bdd0 0x7f4cc41ad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.949+0000 7f4ccc600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc41218b0 con 0x7f4cc4109e80 2024-08-20T05:10:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.949+0000 7f4ccc600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc4121730 con 0x7f4cc410a260 2024-08-20T05:10:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.949+0000 7f4ccc600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc4121a30 con 0x7f4cc411bdd0 2024-08-20T05:10:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.950+0000 7f4cca600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cc411bdd0 0x7f4cc41ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.950+0000 7f4cca600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cc411bdd0 0x7f4cc41ad600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50552/0 (socket says 172.21.15.37:50552) 2024-08-20T05:10:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.950+0000 7f4cca600640 1 -- 172.21.15.37:0/3626836912 learned_addr learned my addr 172.21.15.37:0/3626836912 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.950+0000 7f4cc9200640 1 --2- 172.21.15.37:0/3626836912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cc410a260 0x7f4cc41a8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.951+0000 7f4cca600640 1 -- 172.21.15.37:0/3626836912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cc410a260 msgr2=0x7f4cc41a8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.951+0000 7f4cca600640 1 --2- 172.21.15.37:0/3626836912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cc410a260 0x7f4cc41a8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.951+0000 7f4cca600640 1 -- 172.21.15.37:0/3626836912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cc4109e80 msgr2=0x7f4cc41a7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:02.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.951+0000 7f4cca600640 1 --2- 172.21.15.37:0/3626836912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cc4109e80 0x7f4cc41a7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:02.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.951+0000 7f4cca600640 1 -- 172.21.15.37:0/3626836912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc41addd0 con 0x7f4cc411bdd0 2024-08-20T05:10:02.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.953+0000 7f4cca600640 1 --2- 172.21.15.37:0/3626836912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cc411bdd0 0x7f4cc41ad600 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00cce0 tx=0x7f4cbc00a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:02.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.953+0000 7f4cc2000640 1 -- 172.21.15.37:0/3626836912 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc00f450 con 0x7f4cc411bdd0 2024-08-20T05:10:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.953+0000 7f4cc2000640 1 -- 172.21.15.37:0/3626836912 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cbc00faa0 con 0x7f4cc411bdd0 2024-08-20T05:10:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.954+0000 7f4ccc600640 1 -- 172.21.15.37:0/3626836912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc41ae0c0 con 0x7f4cc411bdd0 2024-08-20T05:10:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.954+0000 7f4cc2000640 1 -- 172.21.15.37:0/3626836912 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc018b70 con 0x7f4cc411bdd0 2024-08-20T05:10:02.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.955+0000 7f4ccc600640 1 -- 172.21.15.37:0/3626836912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc41b4950 con 0x7f4cc411bdd0 2024-08-20T05:10:02.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.961+0000 7f4cc2000640 1 -- 172.21.15.37:0/3626836912 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4cbc00f5f0 con 0x7f4cc411bdd0 2024-08-20T05:10:02.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.962+0000 7f4ccf240740 1 Processor -- start 2024-08-20T05:10:02.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.962+0000 7f4ccf240740 1 -- start start 2024-08-20T05:10:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.963+0000 7f4ccf240740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913d940 0x561c8913dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.963+0000 7f4ccf240740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8913e260 0x561c89149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.963+0000 7f4ccf240740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8914a1f0 0x561c8914c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.963+0000 7f4ccf240740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561c890b3aa0 con 0x561c8913e260 2024-08-20T05:10:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.963+0000 7f4ccf240740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561c890a2fa0 con 0x561c8913d940 2024-08-20T05:10:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.963+0000 7f4ccf240740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561c890a6fe0 con 0x561c8914a1f0 2024-08-20T05:10:02.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.963+0000 7f4cc9c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8913e260 0x561c89149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:02.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.964+0000 7f4cc9c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8913e260 0x561c89149cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44332/0 (socket says 172.21.15.37:44332) 2024-08-20T05:10:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.964+0000 7f4cc9c00640 1 -- 172.21.15.37:0/4098716307 learned_addr learned my addr 172.21.15.37:0/4098716307 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.964+0000 7f4cc9200640 1 --2- 172.21.15.37:0/4098716307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913d940 0x561c8913dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.964+0000 7f4cc9c00640 1 -- 172.21.15.37:0/4098716307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8914a1f0 msgr2=0x561c8914c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.964+0000 7f4cc9c00640 1 --2- 172.21.15.37:0/4098716307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8914a1f0 0x561c8914c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.964+0000 7f4cc9c00640 1 -- 172.21.15.37:0/4098716307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913d940 msgr2=0x561c8913dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.964+0000 7f4cc9c00640 1 --2- 172.21.15.37:0/4098716307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913d940 0x561c8913dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.964+0000 7f4cc9c00640 1 -- 172.21.15.37:0/4098716307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c89049420 con 0x561c8913e260 2024-08-20T05:10:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.965+0000 7f4cc9c00640 1 --2- 172.21.15.37:0/4098716307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8913e260 0x561c89149cb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009b60 tx=0x7f4cb800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9db41356bd70d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.965+0000 7f4cc2000640 1 --2- 172.21.15.37:0/3626836912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4cac0b3c90 0x7f4cac0b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.966+0000 7f4cc2000640 1 -- 172.21.15.37:0/3626836912 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4cbc0e4360 con 0x7f4cc411bdd0 2024-08-20T05:10:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.966+0000 7f4cb6a00640 1 -- 172.21.15.37:0/4098716307 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8009e50 con 0x561c8913e260 2024-08-20T05:10:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.966+0000 7f4cb6a00640 1 -- 172.21.15.37:0/4098716307 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cb80108e0 con 0x561c8913e260 2024-08-20T05:10:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.966+0000 7f4cb6a00640 1 -- 172.21.15.37:0/4098716307 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8018990 con 0x561c8913e260 2024-08-20T05:10:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.966+0000 7f4cc9200640 1 --2- 172.21.15.37:0/3626836912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4cac0b3c90 0x7f4cac0b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.967+0000 7f4ccf240740 1 -- 172.21.15.37:0/4098716307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8913e260 msgr2=0x561c89149cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:02.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.967+0000 7f4ccf240740 1 --2- 172.21.15.37:0/4098716307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8913e260 0x561c89149cb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009b60 tx=0x7f4cb800e720 comp rx=0 tx=0).stop 2024-08-20T05:10:02.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.968+0000 7f4cc9200640 1 --2- 172.21.15.37:0/3626836912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4cac0b3c90 0x7f4cac0b6150 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4cc411e5b0 tx=0x7f4cb0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:02.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.968+0000 7f4ccf240740 1 -- 172.21.15.37:0/4098716307 shutdown_connections 2024-08-20T05:10:02.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.968+0000 7f4ccf240740 1 --2- 172.21.15.37:0/4098716307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8914a1f0 0x561c8914c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:02.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.968+0000 7f4ccf240740 1 --2- 172.21.15.37:0/4098716307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8913e260 0x561c89149cb0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:02.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.968+0000 7f4ccf240740 1 --2- 172.21.15.37:0/4098716307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913d940 0x561c8913dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:02.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.968+0000 7f4ccf240740 1 -- 172.21.15.37:0/4098716307 >> 172.21.15.37:0/4098716307 conn(0x561c8913b770 msgr2=0x561c8913c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:02.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.969+0000 7f4ccf240740 1 -- 172.21.15.37:0/4098716307 shutdown_connections 2024-08-20T05:10:02.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.969+0000 7f4ccf240740 1 -- 172.21.15.37:0/4098716307 wait complete. 2024-08-20T05:10:02.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.969+0000 7f4ccf240740 1 -- start start 2024-08-20T05:10:02.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.970+0000 7f4ccf240740 1 Processor -- start 2024-08-20T05:10:02.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.971+0000 7f4ccf240740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8913d940 0x561c891499f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:02.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.971+0000 7f4ccf240740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8913e260 0x561c89146e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:02.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.971+0000 7f4ccf240740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8914a1f0 0x561c89147380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:02.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.971+0000 7f4cc9200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8913e260 0x561c89146e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:02.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.971+0000 7f4cc9200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8913e260 0x561c89146e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50566/0 (socket says 172.21.15.37:50566) 2024-08-20T05:10:02.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.971+0000 7f4ccf240740 1 -- 172.21.15.37:0/912923609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561c88f05700 con 0x561c8913d940 2024-08-20T05:10:02.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.972+0000 7f4ccf240740 1 -- 172.21.15.37:0/912923609 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561c8903e290 con 0x561c8914a1f0 2024-08-20T05:10:02.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.972+0000 7f4cc9c00640 1 --2- 172.21.15.37:0/912923609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8913d940 0x561c891499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:02.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.972+0000 7f4ccf240740 1 -- 172.21.15.37:0/912923609 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561c8914ce70 con 0x561c8913e260 2024-08-20T05:10:02.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.972+0000 7f4ccf240740 10 client.0 _ll_register_callbacks cb 0x561c8909d1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:02.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.972+0000 7f4cca600640 1 --2- 172.21.15.37:0/912923609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8914a1f0 0x561c89147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:02.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.971+0000 7f4cc9200640 1 -- 172.21.15.37:0/912923609 learned_addr learned my addr 172.21.15.37:0/912923609 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:02.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.973+0000 7f4cca600640 1 -- 172.21.15.37:0/912923609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8913e260 msgr2=0x561c89146e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:02.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.973+0000 7f4cca600640 1 --2- 172.21.15.37:0/912923609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8913e260 0x561c89146e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:02.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.973+0000 7f4cca600640 1 -- 172.21.15.37:0/912923609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8913d940 msgr2=0x561c891499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:02.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.974+0000 7f4cca600640 1 --2- 172.21.15.37:0/912923609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8913d940 0x561c891499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:02.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.974+0000 7f4cca600640 1 -- 172.21.15.37:0/912923609 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c88e02650 con 0x561c8914a1f0 2024-08-20T05:10:02.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.974+0000 7f4cc9c00640 1 --2- 172.21.15.37:0/912923609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8913d940 0x561c891499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:10:02.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.975+0000 7f4cca600640 1 --2- 172.21.15.37:0/912923609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8914a1f0 0x561c89147380 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00ccb0 tx=0x7f4cbc00f9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87058811dc3c9f99 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:02.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.975+0000 7f4cab400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:10:02.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.975+0000 7f4cab400640 1 -- 172.21.15.37:0/912923609 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc0e41b0 con 0x561c8914a1f0 2024-08-20T05:10:02.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.976+0000 7f4ccf240740 1 -- 172.21.15.37:0/912923609 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cb80108e0 con 0x561c8914a1f0 2024-08-20T05:10:02.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.976+0000 7f4cab400640 1 -- 172.21.15.37:0/912923609 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4cbc0c5530 con 0x561c8914a1f0 2024-08-20T05:10:02.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.977+0000 7f4cab400640 1 -- 172.21.15.37:0/912923609 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4cbc0aaf10 con 0x561c8914a1f0 2024-08-20T05:10:02.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.977+0000 7f4ccf240740 10 client.27464 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:02.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.977+0000 7f4ccf240740 1 -- 172.21.15.37:0/912923609 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x561c89158700 con 0x561c8914a1f0 2024-08-20T05:10:02.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.977+0000 7f4cab400640 1 -- 172.21.15.37:0/912923609 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cb80108e0 con 0x561c8914a1f0 2024-08-20T05:10:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.977+0000 7f4cab400640 1 -- 172.21.15.37:0/912923609 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f4cbc020030 con 0x561c8914a1f0 2024-08-20T05:10:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.978+0000 7f4ccf240740 10 client.27464 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.978+0000 7f4ccf240740 10 client.27464 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:10:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.978+0000 7f4ccf240740 20 client.27464 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.978+0000 7f4ccf240740 1 --2- 172.21.15.37:0/912923609 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x561c89159b60 0x561c8915bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.978+0000 7f4ccf240740 4 client.27464 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:10:02.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.978+0000 7f4ccf240740 1 -- 172.21.15.37:0/912923609 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c890b59f0 con 0x561c89159b60 2024-08-20T05:10:02.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.978+0000 7f4cc9c00640 1 --2- 172.21.15.37:0/912923609 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x561c89159b60 0x561c8915bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:02.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.982+0000 7f4cc9c00640 1 --2- 172.21.15.37:0/912923609 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x561c89159b60 0x561c8915bfc0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e5ff9dfc49bf5ce6 server_cookie=21de0f3f6bfe4b3f in_seq=0 out_seq=0 2024-08-20T05:10:02.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.982+0000 7f4cab400640 10 client.27464 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:10:02.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.982+0000 7f4cab400640 1 -- 172.21.15.37:0/912923609 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561c890b59f0 con 0x561c89159b60 2024-08-20T05:10:02.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.983+0000 7f4cab400640 10 client.27464 handle_command_reply: tid=0 2024-08-20T05:10:02.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.983+0000 7f4ccf240740 1 client.27464 shutdown 2024-08-20T05:10:02.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.983+0000 7f4ccf240740 1 -- 172.21.15.37:0/912923609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8914a1f0 msgr2=0x561c89147380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:02.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.983+0000 7f4ccf240740 1 --2- 172.21.15.37:0/912923609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8914a1f0 0x561c89147380 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00ccb0 tx=0x7f4cbc00f9a0 comp rx=0 tx=0).stop 2024-08-20T05:10:02.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.984+0000 7f4ccf240740 1 -- 172.21.15.37:0/912923609 shutdown_connections 2024-08-20T05:10:02.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.984+0000 7f4ccf240740 1 --2- 172.21.15.37:0/912923609 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x561c89159b60 0x561c8915bfc0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:02.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.984+0000 7f4ccf240740 1 --2- 172.21.15.37:0/912923609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8914a1f0 0x561c89147380 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:02.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.984+0000 7f4ccf240740 1 --2- 172.21.15.37:0/912923609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8913e260 0x561c89146e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:02.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.984+0000 7f4ccf240740 1 --2- 172.21.15.37:0/912923609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8913d940 0x561c891499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:02.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.984+0000 7f4ccf240740 1 -- 172.21.15.37:0/912923609 >> 172.21.15.37:0/912923609 conn(0x561c8913b770 msgr2=0x561c89141310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:02.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.984+0000 7f4cab400640 0 client.27464 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:10:02.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.984+0000 7f4ccf240740 1 -- 172.21.15.37:0/912923609 shutdown_connections 2024-08-20T05:10:02.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.984+0000 7f4ccf240740 1 -- 172.21.15.37:0/912923609 wait complete. 2024-08-20T05:10:02.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:02.985+0000 7f4ccf240740 20 client.27464 trim_cache size 0 max 16384 2024-08-20T05:10:03.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.012+0000 7f4ccf240740 1 Processor -- start 2024-08-20T05:10:03.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.012+0000 7f4ccf240740 1 -- start start 2024-08-20T05:10:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.013+0000 7f4ccf240740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913d940 0x561c89155f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.013+0000 7f4ccf240740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8913e260 0x561c891618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.013+0000 7f4ccf240740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8914a1f0 0x561c89161e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.013+0000 7f4ccf240740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc41be630 con 0x561c8914a1f0 2024-08-20T05:10:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.013+0000 7f4ccf240740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc41c0290 con 0x561c8913d940 2024-08-20T05:10:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.013+0000 7f4ccf240740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc41bed00 con 0x561c8913e260 2024-08-20T05:10:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.013+0000 7f4cc9c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913d940 0x561c89155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.013+0000 7f4cc9c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913d940 0x561c89155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47674/0 (socket says 172.21.15.37:47674) 2024-08-20T05:10:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.013+0000 7f4cc9200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8913e260 0x561c891618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.013+0000 7f4cc9c00640 1 -- 172.21.15.37:0/347558026 learned_addr learned my addr 172.21.15.37:0/347558026 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.013+0000 7f4cca600640 1 --2- 172.21.15.37:0/347558026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8914a1f0 0x561c89161e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.014+0000 7f4cc9c00640 1 -- 172.21.15.37:0/347558026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8913e260 msgr2=0x561c891618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.014+0000 7f4cc9c00640 1 --2- 172.21.15.37:0/347558026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8913e260 0x561c891618d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.014+0000 7f4cc9c00640 1 -- 172.21.15.37:0/347558026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8914a1f0 msgr2=0x561c89161e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.014+0000 7f4cc9c00640 1 --2- 172.21.15.37:0/347558026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8914a1f0 0x561c89161e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.014+0000 7f4cc9c00640 1 -- 172.21.15.37:0/347558026 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c89149d60 con 0x561c8913d940 2024-08-20T05:10:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.014+0000 7f4cc9c00640 1 --2- 172.21.15.37:0/347558026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913d940 0x561c89155f90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009b60 tx=0x7f4cb8009570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24a79e6b5e8534d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:03.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.015+0000 7f4cb6000640 1 -- 172.21.15.37:0/347558026 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8030070 con 0x561c8913d940 2024-08-20T05:10:03.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.015+0000 7f4cb6000640 1 -- 172.21.15.37:0/347558026 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cb80054f0 con 0x561c8913d940 2024-08-20T05:10:03.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.015+0000 7f4cb6000640 1 -- 172.21.15.37:0/347558026 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8004c70 con 0x561c8913d940 2024-08-20T05:10:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.020+0000 7f4ccf240740 1 -- 172.21.15.37:0/347558026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913d940 msgr2=0x561c89155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.020+0000 7f4ccf240740 1 --2- 172.21.15.37:0/347558026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913d940 0x561c89155f90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8009b60 tx=0x7f4cb8009570 comp rx=0 tx=0).stop 2024-08-20T05:10:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.020+0000 7f4ccf240740 1 -- 172.21.15.37:0/347558026 shutdown_connections 2024-08-20T05:10:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.020+0000 7f4ccf240740 1 --2- 172.21.15.37:0/347558026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8914a1f0 0x561c89161e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.020+0000 7f4ccf240740 1 --2- 172.21.15.37:0/347558026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8913e260 0x561c891618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.020+0000 7f4ccf240740 1 --2- 172.21.15.37:0/347558026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913d940 0x561c89155f90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.020+0000 7f4ccf240740 1 -- 172.21.15.37:0/347558026 >> 172.21.15.37:0/347558026 conn(0x561c8913b770 msgr2=0x561c8913c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.021+0000 7f4ccf240740 1 -- 172.21.15.37:0/347558026 shutdown_connections 2024-08-20T05:10:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.021+0000 7f4ccf240740 1 -- 172.21.15.37:0/347558026 wait complete. 2024-08-20T05:10:03.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.021+0000 7f4ccf240740 1 -- start start 2024-08-20T05:10:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.022+0000 7f4ccf240740 1 Processor -- start 2024-08-20T05:10:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.022+0000 7f4ccf240740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8913d940 0x561c8914f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.022+0000 7f4ccf240740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913e260 0x561c8914fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.022+0000 7f4ccf240740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8914a1f0 0x561c891c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.022+0000 7f4ccf240740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc41bfb00 con 0x561c8914a1f0 2024-08-20T05:10:03.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.022+0000 7f4ccf240740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc41bf3d0 con 0x561c8913e260 2024-08-20T05:10:03.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.022+0000 7f4ccf240740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc41bc610 con 0x561c8913d940 2024-08-20T05:10:03.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.022+0000 7f4ccf240740 10 client.0 _ll_register_callbacks cb 0x7f4cbc018510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:03.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.023+0000 7f4cc9200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913e260 0x561c8914fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:03.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.023+0000 7f4cc9c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8913d940 0x561c8914f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:03.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.023+0000 7f4cc9200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913e260 0x561c8914fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47690/0 (socket says 172.21.15.37:47690) 2024-08-20T05:10:03.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.023+0000 7f4cc9200640 1 -- 172.21.15.37:0/3042451411 learned_addr learned my addr 172.21.15.37:0/3042451411 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:03.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.023+0000 7f4cca600640 1 --2- 172.21.15.37:0/3042451411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8914a1f0 0x561c891c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:03.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.023+0000 7f4cc9c00640 1 -- 172.21.15.37:0/3042451411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913e260 msgr2=0x561c8914fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:03.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.023+0000 7f4cc9c00640 1 --2- 172.21.15.37:0/3042451411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913e260 0x561c8914fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:03.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.023+0000 7f4cc9c00640 1 -- 172.21.15.37:0/3042451411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8914a1f0 msgr2=0x561c891c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:03.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.023+0000 7f4cc9c00640 1 --2- 172.21.15.37:0/3042451411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8914a1f0 0x561c891c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:03.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.023+0000 7f4cc9c00640 1 -- 172.21.15.37:0/3042451411 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c891c2eb0 con 0x561c8913d940 2024-08-20T05:10:03.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.023+0000 7f4cca600640 1 --2- 172.21.15.37:0/3042451411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8914a1f0 0x561c891c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:10:03.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.024+0000 7f4cc9c00640 1 --2- 172.21.15.37:0/3042451411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8913d940 0x561c8914f8c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4cb801a040 tx=0x7f4cb800ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e6a5d88589c95de server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:03.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.024+0000 7f4cab400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:10:03.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.024+0000 7f4cab400640 1 -- 172.21.15.37:0/3042451411 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8039070 con 0x561c8913d940 2024-08-20T05:10:03.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.024+0000 7f4cab400640 1 -- 172.21.15.37:0/3042451411 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4cb80035f0 con 0x561c8913d940 2024-08-20T05:10:03.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.024+0000 7f4ccf240740 1 -- 172.21.15.37:0/3042451411 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cb80054f0 con 0x561c8913d940 2024-08-20T05:10:03.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.024+0000 7f4cab400640 1 -- 172.21.15.37:0/3042451411 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4cb8045050 con 0x561c8913d940 2024-08-20T05:10:03.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.024+0000 7f4ccf240740 10 client.27475 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:03.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.024+0000 7f4ccf240740 1 -- 172.21.15.37:0/3042451411 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x561c891c41b0 con 0x561c8913d940 2024-08-20T05:10:03.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.025+0000 7f4cab400640 1 -- 172.21.15.37:0/3042451411 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cb80056a0 con 0x561c8913d940 2024-08-20T05:10:03.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.025+0000 7f4cab400640 1 -- 172.21.15.37:0/3042451411 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f4cb8004bb0 con 0x561c8913d940 2024-08-20T05:10:03.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.025+0000 7f4ccf240740 10 client.27475 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:03.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.025+0000 7f4ccf240740 10 client.27475 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:10:03.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.025+0000 7f4ccf240740 20 client.27475 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:03.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.025+0000 7f4ccf240740 1 --2- 172.21.15.37:0/3042451411 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x561c891c4680 0x561c891c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:03.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.025+0000 7f4ccf240740 4 client.27475 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:10:03.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.025+0000 7f4ccf240740 1 -- 172.21.15.37:0/3042451411 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f4cb80054f0 con 0x561c891c4680 2024-08-20T05:10:03.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.026+0000 7f4cc9200640 1 --2- 172.21.15.37:0/3042451411 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x561c891c4680 0x561c891c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:03.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.026+0000 7f4cc9200640 1 --2- 172.21.15.37:0/3042451411 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x561c891c4680 0x561c891c6a70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=27d15418208b4314 server_cookie=6cf59e26aeef22a3 in_seq=0 out_seq=0 2024-08-20T05:10:03.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.026+0000 7f4cab400640 10 client.27475 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:10:03.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.027+0000 7f4cab400640 1 -- 172.21.15.37:0/3042451411 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f4cb80054f0 con 0x561c891c4680 2024-08-20T05:10:03.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.027+0000 7f4cab400640 10 client.27475 handle_command_reply: tid=0 2024-08-20T05:10:03.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.027+0000 7f4ccf240740 1 client.27475 shutdown 2024-08-20T05:10:03.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.027+0000 7f4ccf240740 1 -- 172.21.15.37:0/3042451411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8913d940 msgr2=0x561c8914f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:03.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.027+0000 7f4ccf240740 1 --2- 172.21.15.37:0/3042451411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8913d940 0x561c8914f8c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4cb801a040 tx=0x7f4cb800ef50 comp rx=0 tx=0).stop 2024-08-20T05:10:03.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.028+0000 7f4ccf240740 1 -- 172.21.15.37:0/3042451411 shutdown_connections 2024-08-20T05:10:03.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.028+0000 7f4ccf240740 1 --2- 172.21.15.37:0/3042451411 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x561c891c4680 0x561c891c6a70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:03.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.028+0000 7f4ccf240740 1 --2- 172.21.15.37:0/3042451411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561c8914a1f0 0x561c891c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:03.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.028+0000 7f4ccf240740 1 --2- 172.21.15.37:0/3042451411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561c8913e260 0x561c8914fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:03.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.028+0000 7f4ccf240740 1 --2- 172.21.15.37:0/3042451411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561c8913d940 0x561c8914f8c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:03.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.028+0000 7f4ccf240740 1 -- 172.21.15.37:0/3042451411 >> 172.21.15.37:0/3042451411 conn(0x561c8913b770 msgr2=0x561c89148470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:03.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.028+0000 7f4cab400640 0 client.27475 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:10:03.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.028+0000 7f4ccf240740 1 -- 172.21.15.37:0/3042451411 shutdown_connections 2024-08-20T05:10:03.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.028+0000 7f4ccf240740 1 -- 172.21.15.37:0/3042451411 wait complete. 2024-08-20T05:10:03.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.028+0000 7f4ccf240740 20 client.27475 trim_cache size 0 max 16384 2024-08-20T05:10:03.031 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:10:03.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.030+0000 7f4ccc600640 1 -- 172.21.15.37:0/3626836912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4cac0b3c90 msgr2=0x7f4cac0b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:03.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.030+0000 7f4ccc600640 1 --2- 172.21.15.37:0/3626836912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4cac0b3c90 0x7f4cac0b6150 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4cc411e5b0 tx=0x7f4cb0005850 comp rx=0 tx=0).stop 2024-08-20T05:10:03.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.030+0000 7f4ccc600640 1 -- 172.21.15.37:0/3626836912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cc411bdd0 msgr2=0x7f4cc41ad600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:03.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.030+0000 7f4ccc600640 1 --2- 172.21.15.37:0/3626836912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cc411bdd0 0x7f4cc41ad600 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc00cce0 tx=0x7f4cbc00a620 comp rx=0 tx=0).stop 2024-08-20T05:10:03.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.030+0000 7f4ccc600640 1 -- 172.21.15.37:0/3626836912 shutdown_connections 2024-08-20T05:10:03.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.030+0000 7f4ccc600640 1 --2- 172.21.15.37:0/3626836912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4cac0b3c90 0x7f4cac0b6150 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:03.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.030+0000 7f4ccc600640 1 --2- 172.21.15.37:0/3626836912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4cc411bdd0 0x7f4cc41ad600 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:03.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.030+0000 7f4ccc600640 1 --2- 172.21.15.37:0/3626836912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4cc410a260 0x7f4cc41a8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:03.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.030+0000 7f4ccc600640 1 --2- 172.21.15.37:0/3626836912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4cc4109e80 0x7f4cc41a7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:03.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.030+0000 7f4ccc600640 1 -- 172.21.15.37:0/3626836912 >> 172.21.15.37:0/3626836912 conn(0x7f4cc406dcc0 msgr2=0x7f4cc411c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:03.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.030+0000 7f4ccc600640 1 -- 172.21.15.37:0/3626836912 shutdown_connections 2024-08-20T05:10:03.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:03.030+0000 7f4ccc600640 1 -- 172.21.15.37:0/3626836912 wait complete. 2024-08-20T05:10:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 425.0 s, 655.2 tps, lat 160.753 ms stddev 223.769 2024-08-20T05:10:03.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:03 smithi130 ceph-mon[22007]: pgmap v635: 129 pgs: 129 active+clean; 1.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.6 MiB/s wr, 611 op/s 2024-08-20T05:10:03.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:03 smithi037 ceph-mon[17265]: pgmap v635: 129 pgs: 129 active+clean; 1.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.6 MiB/s wr, 611 op/s 2024-08-20T05:10:03.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:03 smithi135 ceph-mon[22342]: pgmap v635: 129 pgs: 129 active+clean; 1.4 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.6 MiB/s wr, 611 op/s 2024-08-20T05:10:04.111 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T05:10:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.684+0000 7ff725000640 1 -- 172.21.15.37:0/723505482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff71809b250 msgr2=0x7ff71809d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:04.685 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.684+0000 7ff725000640 1 --2- 172.21.15.37:0/723505482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff71809b250 0x7ff71809d710 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff720065ff0 tx=0x7ff720097a10 comp rx=0 tx=0).stop 2024-08-20T05:10:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.684+0000 7ff725000640 1 -- 172.21.15.37:0/723505482 shutdown_connections 2024-08-20T05:10:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.684+0000 7ff725000640 1 --2- 172.21.15.37:0/723505482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff71809b250 0x7ff71809d710 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.684+0000 7ff725000640 1 --2- 172.21.15.37:0/723505482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7180986a0 0x7ff71809ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.684+0000 7ff725000640 1 --2- 172.21.15.37:0/723505482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7180058f0 0x7ff718098110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.684+0000 7ff725000640 1 -- 172.21.15.37:0/723505482 >> 172.21.15.37:0/723505482 conn(0x7ff71808fce0 msgr2=0x7ff718092120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.685+0000 7ff725000640 1 -- 172.21.15.37:0/723505482 shutdown_connections 2024-08-20T05:10:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.685+0000 7ff725000640 1 -- 172.21.15.37:0/723505482 wait complete. 2024-08-20T05:10:04.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.686+0000 7ff725000640 1 Processor -- start 2024-08-20T05:10:04.689 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.688+0000 7ff725000640 1 -- start start 2024-08-20T05:10:04.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.689+0000 7ff725000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7180058f0 0x7ff71812d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.690+0000 7ff725000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7180986a0 0x7ff71812dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.690+0000 7ff725000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff71809b250 0x7ff71812eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.690+0000 7ff71ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7180986a0 0x7ff71812dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.690+0000 7ff71ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7180986a0 0x7ff71812dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47702/0 (socket says 172.21.15.37:47702) 2024-08-20T05:10:04.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.690+0000 7ff71ea00640 1 -- 172.21.15.37:0/4093514793 learned_addr learned my addr 172.21.15.37:0/4093514793 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.690+0000 7ff71fe00640 1 --2- 172.21.15.37:0/4093514793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff71809b250 0x7ff71812eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.691+0000 7ff725000640 1 -- 172.21.15.37:0/4093514793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff7180a11a0 con 0x7ff7180058f0 2024-08-20T05:10:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.691+0000 7ff725000640 1 -- 172.21.15.37:0/4093514793 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff7180a1020 con 0x7ff7180986a0 2024-08-20T05:10:04.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.691+0000 7ff725000640 1 -- 172.21.15.37:0/4093514793 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7180a1320 con 0x7ff71809b250 2024-08-20T05:10:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.693+0000 7ff71ea00640 1 -- 172.21.15.37:0/4093514793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff71809b250 msgr2=0x7ff71812eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.693+0000 7ff71ea00640 1 --2- 172.21.15.37:0/4093514793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff71809b250 0x7ff71812eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.693+0000 7ff71ea00640 1 -- 172.21.15.37:0/4093514793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7180058f0 msgr2=0x7ff71812d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.693+0000 7ff71ea00640 1 --2- 172.21.15.37:0/4093514793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7180058f0 0x7ff71812d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.693+0000 7ff71ea00640 1 -- 172.21.15.37:0/4093514793 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff71812f3d0 con 0x7ff7180986a0 2024-08-20T05:10:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.693+0000 7ff71fe00640 1 --2- 172.21.15.37:0/4093514793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff71809b250 0x7ff71812eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:10:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.694+0000 7ff71ea00640 1 --2- 172.21.15.37:0/4093514793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7180986a0 0x7ff71812dee0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff71400c890 tx=0x7ff71400cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.694+0000 7ff713e00640 1 -- 172.21.15.37:0/4093514793 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714004220 con 0x7ff7180986a0 2024-08-20T05:10:04.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.694+0000 7ff713e00640 1 -- 172.21.15.37:0/4093514793 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7140043c0 con 0x7ff7180986a0 2024-08-20T05:10:04.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.694+0000 7ff713e00640 1 -- 172.21.15.37:0/4093514793 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714004a00 con 0x7ff7180986a0 2024-08-20T05:10:04.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.694+0000 7ff725000640 1 -- 172.21.15.37:0/4093514793 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff71812f6c0 con 0x7ff7180986a0 2024-08-20T05:10:04.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.695+0000 7ff725000640 1 -- 172.21.15.37:0/4093514793 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff718135d90 con 0x7ff7180986a0 2024-08-20T05:10:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.704+0000 7ff7294c5740 1 Processor -- start 2024-08-20T05:10:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.705+0000 7ff7294c5740 1 -- start start 2024-08-20T05:10:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.706+0000 7ff713e00640 1 -- 172.21.15.37:0/4093514793 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff7140079b0 con 0x7ff7180986a0 2024-08-20T05:10:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.708+0000 7ff7294c5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fd8000 0x556549fda3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.708+0000 7ff7294c5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fda930 0x556549fdcd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.708+0000 7ff7294c5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fdd370 0x556549fdf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.708+0000 7ff7294c5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556549f42210 con 0x556549fdd370 2024-08-20T05:10:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.708+0000 7ff7294c5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556549f31710 con 0x556549fd8000 2024-08-20T05:10:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.708+0000 7ff7294c5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556549f35750 con 0x556549fda930 2024-08-20T05:10:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.708+0000 7ff71f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fda930 0x556549fdcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.708+0000 7ff71f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fda930 0x556549fdcd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50628/0 (socket says 172.21.15.37:50628) 2024-08-20T05:10:04.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.708+0000 7ff71fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fd8000 0x556549fda3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.708+0000 7ff71f400640 1 -- 172.21.15.37:0/3967299428 learned_addr learned my addr 172.21.15.37:0/3967299428 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.709+0000 7ff71fe00640 1 -- 172.21.15.37:0/3967299428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fda930 msgr2=0x556549fdcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.709+0000 7ff71fe00640 1 --2- 172.21.15.37:0/3967299428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fda930 0x556549fdcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.709+0000 7ff71fe00640 1 -- 172.21.15.37:0/3967299428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fdd370 msgr2=0x556549fdf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.709+0000 7ff71fe00640 1 --2- 172.21.15.37:0/3967299428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fdd370 0x556549fdf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.709+0000 7ff71fe00640 1 -- 172.21.15.37:0/3967299428 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556549efdde0 con 0x556549fd8000 2024-08-20T05:10:04.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.710+0000 7ff71fe00640 1 --2- 172.21.15.37:0/3967299428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fd8000 0x556549fda3f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff720098000 tx=0x7ff7200660f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cb430b0a1021c44 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.711+0000 7ff710c00640 1 -- 172.21.15.37:0/3967299428 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7200ab070 con 0x556549fd8000 2024-08-20T05:10:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.711+0000 7ff710c00640 1 -- 172.21.15.37:0/3967299428 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff720069850 con 0x556549fd8000 2024-08-20T05:10:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.711+0000 7ff710c00640 1 -- 172.21.15.37:0/3967299428 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7200a0040 con 0x556549fd8000 2024-08-20T05:10:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.712+0000 7ff7294c5740 1 -- 172.21.15.37:0/3967299428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fd8000 msgr2=0x556549fda3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.712+0000 7ff7294c5740 1 --2- 172.21.15.37:0/3967299428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fd8000 0x556549fda3f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff720098000 tx=0x7ff7200660f0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.713+0000 7ff713e00640 1 --2- 172.21.15.37:0/4093514793 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7080b3c50 0x7ff7080b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.714+0000 7ff713e00640 1 -- 172.21.15.37:0/4093514793 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff7140e3c90 con 0x7ff7180986a0 2024-08-20T05:10:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.715+0000 7ff7294c5740 1 -- 172.21.15.37:0/3967299428 shutdown_connections 2024-08-20T05:10:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.715+0000 7ff7294c5740 1 --2- 172.21.15.37:0/3967299428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fdd370 0x556549fdf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.715+0000 7ff7294c5740 1 --2- 172.21.15.37:0/3967299428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fda930 0x556549fdcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.715+0000 7ff7294c5740 1 --2- 172.21.15.37:0/3967299428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fd8000 0x556549fda3f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.715+0000 7ff7294c5740 1 -- 172.21.15.37:0/3967299428 >> 172.21.15.37:0/3967299428 conn(0x556549fd3150 msgr2=0x556549fd3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.715+0000 7ff7294c5740 1 -- 172.21.15.37:0/3967299428 shutdown_connections 2024-08-20T05:10:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.715+0000 7ff7294c5740 1 -- 172.21.15.37:0/3967299428 wait complete. 2024-08-20T05:10:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.716+0000 7ff7294c5740 1 -- start start 2024-08-20T05:10:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.717+0000 7ff7294c5740 1 Processor -- start 2024-08-20T05:10:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.717+0000 7ff7294c5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fd8000 0x556549fe1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.717+0000 7ff7294c5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fda930 0x556549fe1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.718+0000 7ff7294c5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fdd370 0x556549fe2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.718+0000 7ff7294c5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556549e6aab0 con 0x556549fd8000 2024-08-20T05:10:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.718+0000 7ff7294c5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556549ed8140 con 0x556549fda930 2024-08-20T05:10:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.718+0000 7ff7294c5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556549fe02f0 con 0x556549fdd370 2024-08-20T05:10:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.718+0000 7ff7294c5740 10 client.0 _ll_register_callbacks cb 0x556549eeb5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.718+0000 7ff71ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fda930 0x556549fe1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.718+0000 7ff71ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fda930 0x556549fe1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47716/0 (socket says 172.21.15.37:47716) 2024-08-20T05:10:04.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.718+0000 7ff71ea00640 1 -- 172.21.15.37:0/962987239 learned_addr learned my addr 172.21.15.37:0/962987239 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:04.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.718+0000 7ff71ea00640 1 -- 172.21.15.37:0/962987239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fdd370 msgr2=0x556549fe2970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:10:04.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.718+0000 7ff71ea00640 1 --2- 172.21.15.37:0/962987239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fdd370 0x556549fe2970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.719+0000 7ff71ea00640 1 -- 172.21.15.37:0/962987239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fd8000 msgr2=0x556549fe1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:04.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.719+0000 7ff71ea00640 1 --2- 172.21.15.37:0/962987239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fd8000 0x556549fe1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.719+0000 7ff71ea00640 1 -- 172.21.15.37:0/962987239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556549ed9170 con 0x556549fda930 2024-08-20T05:10:04.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.719+0000 7ff71fe00640 1 --2- 172.21.15.37:0/4093514793 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7080b3c50 0x7ff7080b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:04.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.719+0000 7ff71ea00640 1 --2- 172.21.15.37:0/962987239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fda930 0x556549fe1da0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff7140aa540 tx=0x7ff7140aa0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=842cb4b11566ece server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:04.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.719+0000 7ff705600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:10:04.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.720+0000 7ff705600640 1 -- 172.21.15.37:0/962987239 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71401d040 con 0x556549fda930 2024-08-20T05:10:04.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.720+0000 7ff705600640 1 -- 172.21.15.37:0/962987239 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff7140a9cb0 con 0x556549fda930 2024-08-20T05:10:04.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.721+0000 7ff7294c5740 1 -- 172.21.15.37:0/962987239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff720069850 con 0x556549fda930 2024-08-20T05:10:04.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.721+0000 7ff71fe00640 1 --2- 172.21.15.37:0/4093514793 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7080b3c50 0x7ff7080b6110 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff7200687d0 tx=0x7ff720097a10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:04.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.722+0000 7ff705600640 1 -- 172.21.15.37:0/962987239 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7ff7140aaf40 con 0x556549fda930 2024-08-20T05:10:04.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.722+0000 7ff7294c5740 10 client.27482 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:04.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.722+0000 7ff7294c5740 1 -- 172.21.15.37:0/962987239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x556549c94790 con 0x556549fda930 2024-08-20T05:10:04.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.724+0000 7ff705600640 1 -- 172.21.15.37:0/962987239 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff720069850 con 0x556549fda930 2024-08-20T05:10:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.724+0000 7ff705600640 1 -- 172.21.15.37:0/962987239 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7ff7140a61b0 con 0x556549fda930 2024-08-20T05:10:04.726 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.725+0000 7ff7294c5740 10 client.27482 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.725+0000 7ff7294c5740 10 client.27482 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:10:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.725+0000 7ff7294c5740 20 client.27482 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.726+0000 7ff7294c5740 1 --2- 172.21.15.37:0/962987239 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556549fcdc40 0x556549fd0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.726+0000 7ff7294c5740 4 client.27482 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:10:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.726+0000 7ff7294c5740 1 -- 172.21.15.37:0/962987239 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556549f44160 con 0x556549fcdc40 2024-08-20T05:10:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.726+0000 7ff71f400640 1 --2- 172.21.15.37:0/962987239 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556549fcdc40 0x556549fd0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:04.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.727+0000 7ff705600640 10 client.27482 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:04.728 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.727+0000 7ff71f400640 1 --2- 172.21.15.37:0/962987239 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556549fcdc40 0x556549fd0080 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=206c985a715abc92 server_cookie=7d2b269b433c8416 in_seq=0 out_seq=0 2024-08-20T05:10:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.728+0000 7ff705600640 1 -- 172.21.15.37:0/962987239 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556549f44160 con 0x556549fcdc40 2024-08-20T05:10:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.728+0000 7ff705600640 10 client.27482 handle_command_reply: tid=0 2024-08-20T05:10:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.728+0000 7ff7294c5740 1 client.27482 shutdown 2024-08-20T05:10:04.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.729+0000 7ff7294c5740 1 -- 172.21.15.37:0/962987239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fda930 msgr2=0x556549fe1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.729+0000 7ff7294c5740 1 --2- 172.21.15.37:0/962987239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fda930 0x556549fe1da0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff7140aa540 tx=0x7ff7140aa0a0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.729+0000 7ff7294c5740 1 -- 172.21.15.37:0/962987239 shutdown_connections 2024-08-20T05:10:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.729+0000 7ff7294c5740 1 --2- 172.21.15.37:0/962987239 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556549fcdc40 0x556549fd0080 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.729+0000 7ff7294c5740 1 --2- 172.21.15.37:0/962987239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fdd370 0x556549fe2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.729+0000 7ff7294c5740 1 --2- 172.21.15.37:0/962987239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fda930 0x556549fe1da0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.729+0000 7ff7294c5740 1 --2- 172.21.15.37:0/962987239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fd8000 0x556549fe1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.729+0000 7ff7294c5740 1 -- 172.21.15.37:0/962987239 >> 172.21.15.37:0/962987239 conn(0x556549fd3150 msgr2=0x556549fc99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.729+0000 7ff705600640 0 client.27482 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.730+0000 7ff7294c5740 1 -- 172.21.15.37:0/962987239 shutdown_connections 2024-08-20T05:10:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.730+0000 7ff7294c5740 1 -- 172.21.15.37:0/962987239 wait complete. 2024-08-20T05:10:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.731+0000 7ff7294c5740 20 client.27482 trim_cache size 0 max 16384 2024-08-20T05:10:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.766+0000 7ff7294c5740 1 Processor -- start 2024-08-20T05:10:04.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.766+0000 7ff7294c5740 1 -- start start 2024-08-20T05:10:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.767+0000 7ff7294c5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fd8000 0x556549fe0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.767+0000 7ff7294c5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fda930 0x556549fc9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.767+0000 7ff7294c5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fdd370 0x556549fc96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.767+0000 7ff7294c5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff71813c000 con 0x556549fda930 2024-08-20T05:10:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.767+0000 7ff7294c5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff71813dc60 con 0x556549fdd370 2024-08-20T05:10:04.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.767+0000 7ff7294c5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff71813c6d0 con 0x556549fd8000 2024-08-20T05:10:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.767+0000 7ff71f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fd8000 0x556549fe0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.767+0000 7ff71fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fdd370 0x556549fc96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.767+0000 7ff71f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fd8000 0x556549fe0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50644/0 (socket says 172.21.15.37:50644) 2024-08-20T05:10:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.767+0000 7ff71f400640 1 -- 172.21.15.37:0/127191721 learned_addr learned my addr 172.21.15.37:0/127191721 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.768+0000 7ff71ea00640 1 --2- 172.21.15.37:0/127191721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fda930 0x556549fc9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:04.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.768+0000 7ff71f400640 1 -- 172.21.15.37:0/127191721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fdd370 msgr2=0x556549fc96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.768+0000 7ff71f400640 1 --2- 172.21.15.37:0/127191721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fdd370 0x556549fc96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.768+0000 7ff71f400640 1 -- 172.21.15.37:0/127191721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fda930 msgr2=0x556549fc9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.768+0000 7ff71f400640 1 --2- 172.21.15.37:0/127191721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fda930 0x556549fc9190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.768+0000 7ff71f400640 1 -- 172.21.15.37:0/127191721 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556549fda760 con 0x556549fd8000 2024-08-20T05:10:04.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.769+0000 7ff71f400640 1 --2- 172.21.15.37:0/127191721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fd8000 0x556549fe0e00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff70c006fd0 tx=0x7ff70c00bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8a5c13631cc8e71 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.770+0000 7ff707e00640 1 -- 172.21.15.37:0/127191721 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c024070 con 0x556549fd8000 2024-08-20T05:10:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.770+0000 7ff707e00640 1 -- 172.21.15.37:0/127191721 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff70c014cc0 con 0x556549fd8000 2024-08-20T05:10:04.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.770+0000 7ff707e00640 1 -- 172.21.15.37:0/127191721 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff70c01a040 con 0x556549fd8000 2024-08-20T05:10:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.771+0000 7ff7294c5740 1 -- 172.21.15.37:0/127191721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fd8000 msgr2=0x556549fe0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.771+0000 7ff7294c5740 1 --2- 172.21.15.37:0/127191721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fd8000 0x556549fe0e00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff70c006fd0 tx=0x7ff70c00bcf0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.772+0000 7ff7294c5740 1 -- 172.21.15.37:0/127191721 shutdown_connections 2024-08-20T05:10:04.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.772+0000 7ff7294c5740 1 --2- 172.21.15.37:0/127191721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fdd370 0x556549fc96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.772+0000 7ff7294c5740 1 --2- 172.21.15.37:0/127191721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fda930 0x556549fc9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.772+0000 7ff7294c5740 1 --2- 172.21.15.37:0/127191721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fd8000 0x556549fe0e00 secure :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff70c006fd0 tx=0x7ff70c00bcf0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.772+0000 7ff7294c5740 1 -- 172.21.15.37:0/127191721 >> 172.21.15.37:0/127191721 conn(0x556549fd3150 msgr2=0x556549fe06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:04.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.772+0000 7ff7294c5740 1 -- 172.21.15.37:0/127191721 shutdown_connections 2024-08-20T05:10:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.772+0000 7ff7294c5740 1 -- 172.21.15.37:0/127191721 wait complete. 2024-08-20T05:10:04.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.774+0000 7ff7294c5740 1 -- start start 2024-08-20T05:10:04.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.775+0000 7ff7294c5740 1 Processor -- start 2024-08-20T05:10:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.778+0000 7ff7294c5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fda930 0x556549fe6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.778+0000 7ff7294c5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fdd370 0x556549fe6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.778+0000 7ff7294c5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fe7690 0x556549fe7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.778+0000 7ff7294c5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff71813d4d0 con 0x556549fdd370 2024-08-20T05:10:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.778+0000 7ff7294c5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff71813cda0 con 0x556549fe7690 2024-08-20T05:10:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.778+0000 7ff7294c5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff71813a000 con 0x556549fda930 2024-08-20T05:10:04.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.778+0000 7ff7294c5740 10 client.0 _ll_register_callbacks cb 0x7ff7140aa220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.779+0000 7ff71ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fdd370 0x556549fe6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.779+0000 7ff71ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fdd370 0x556549fe6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44424/0 (socket says 172.21.15.37:44424) 2024-08-20T05:10:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.779+0000 7ff71ea00640 1 -- 172.21.15.37:0/1130216080 learned_addr learned my addr 172.21.15.37:0/1130216080 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.780+0000 7ff71ea00640 1 -- 172.21.15.37:0/1130216080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fda930 msgr2=0x556549fe6440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:10:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.780+0000 7ff71ea00640 1 --2- 172.21.15.37:0/1130216080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fda930 0x556549fe6440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.781 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.780+0000 7ff71ea00640 1 -- 172.21.15.37:0/1130216080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fe7690 msgr2=0x556549fe7b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:10:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.780+0000 7ff71ea00640 1 --2- 172.21.15.37:0/1130216080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fe7690 0x556549fe7b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.780+0000 7ff71ea00640 1 -- 172.21.15.37:0/1130216080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556549d0d620 con 0x556549fdd370 2024-08-20T05:10:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.780+0000 7ff71ea00640 1 --2- 172.21.15.37:0/1130216080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fdd370 0x556549fe6ae0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff714005fd0 tx=0x7ff7140a9ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce12bad92741d5b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:04.782 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.780+0000 7ff705600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:10:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.781+0000 7ff705600640 1 -- 172.21.15.37:0/1130216080 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71401d040 con 0x556549fdd370 2024-08-20T05:10:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.781+0000 7ff705600640 1 -- 172.21.15.37:0/1130216080 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff7140abd80 con 0x556549fdd370 2024-08-20T05:10:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.781+0000 7ff7294c5740 1 -- 172.21.15.37:0/1130216080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff70c014cc0 con 0x556549fdd370 2024-08-20T05:10:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.781+0000 7ff705600640 1 -- 172.21.15.37:0/1130216080 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7ff7140aee40 con 0x556549fdd370 2024-08-20T05:10:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.782+0000 7ff7294c5740 10 client.17049 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.782+0000 7ff7294c5740 1 -- 172.21.15.37:0/1130216080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x556549fe94c0 con 0x556549fdd370 2024-08-20T05:10:04.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.782+0000 7ff705600640 1 -- 172.21.15.37:0/1130216080 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff70c014cc0 con 0x556549fdd370 2024-08-20T05:10:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.783+0000 7ff705600640 1 -- 172.21.15.37:0/1130216080 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7ff7140affd0 con 0x556549fdd370 2024-08-20T05:10:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.783+0000 7ff7294c5740 10 client.17049 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.783+0000 7ff7294c5740 10 client.17049 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:10:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.783+0000 7ff7294c5740 20 client.17049 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:04.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.783+0000 7ff7294c5740 1 --2- 172.21.15.37:0/1130216080 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55654a060d60 0x55654a063180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.783+0000 7ff7294c5740 4 client.17049 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:10:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.783+0000 7ff7294c5740 1 -- 172.21.15.37:0/1130216080 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556549f3fc00 con 0x55654a060d60 2024-08-20T05:10:04.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.784+0000 7ff71f400640 1 --2- 172.21.15.37:0/1130216080 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55654a060d60 0x55654a063180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.785+0000 7ff71f400640 1 --2- 172.21.15.37:0/1130216080 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55654a060d60 0x55654a063180 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a3988f305bcb6 server_cookie=510bdd99ffd5363f in_seq=0 out_seq=0 2024-08-20T05:10:04.786 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.785+0000 7ff705600640 10 client.17049 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:04.852 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:10:04.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.946+0000 7ff705600640 1 -- 172.21.15.37:0/1130216080 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556549f3fc00 con 0x55654a060d60 2024-08-20T05:10:04.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.946+0000 7ff705600640 10 client.17049 handle_command_reply: tid=0 2024-08-20T05:10:04.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.946+0000 7ff7294c5740 1 client.17049 shutdown 2024-08-20T05:10:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.948+0000 7ff7294c5740 1 -- 172.21.15.37:0/1130216080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fdd370 msgr2=0x556549fe6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.948+0000 7ff7294c5740 1 --2- 172.21.15.37:0/1130216080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fdd370 0x556549fe6ae0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff714005fd0 tx=0x7ff7140a9ee0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.948+0000 7ff7294c5740 1 -- 172.21.15.37:0/1130216080 shutdown_connections 2024-08-20T05:10:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.948+0000 7ff7294c5740 1 --2- 172.21.15.37:0/1130216080 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55654a060d60 0x55654a063180 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.948+0000 7ff7294c5740 1 --2- 172.21.15.37:0/1130216080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556549fe7690 0x556549fe7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.948+0000 7ff7294c5740 1 --2- 172.21.15.37:0/1130216080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556549fdd370 0x556549fe6ae0 secure :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ff714005fd0 tx=0x7ff7140a9ee0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.948+0000 7ff7294c5740 1 --2- 172.21.15.37:0/1130216080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556549fda930 0x556549fe6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.948+0000 7ff7294c5740 1 -- 172.21.15.37:0/1130216080 >> 172.21.15.37:0/1130216080 conn(0x556549fd3150 msgr2=0x556549fc99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:04.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.948+0000 7ff705600640 0 client.17049 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:04.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.949+0000 7ff7294c5740 1 -- 172.21.15.37:0/1130216080 shutdown_connections 2024-08-20T05:10:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.949+0000 7ff7294c5740 1 -- 172.21.15.37:0/1130216080 wait complete. 2024-08-20T05:10:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.949+0000 7ff7294c5740 20 client.17049 trim_cache size 0 max 16384 2024-08-20T05:10:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:10:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:10:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:10:04.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:10:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.951+0000 7ff725000640 1 -- 172.21.15.37:0/4093514793 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7080b3c50 msgr2=0x7ff7080b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.951+0000 7ff725000640 1 --2- 172.21.15.37:0/4093514793 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7080b3c50 0x7ff7080b6110 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff7200687d0 tx=0x7ff720097a10 comp rx=0 tx=0).stop 2024-08-20T05:10:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.951+0000 7ff725000640 1 -- 172.21.15.37:0/4093514793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7180986a0 msgr2=0x7ff71812dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:04.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.951+0000 7ff725000640 1 --2- 172.21.15.37:0/4093514793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7180986a0 0x7ff71812dee0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ff71400c890 tx=0x7ff71400cd50 comp rx=0 tx=0).stop 2024-08-20T05:10:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.951+0000 7ff725000640 1 -- 172.21.15.37:0/4093514793 shutdown_connections 2024-08-20T05:10:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.951+0000 7ff725000640 1 --2- 172.21.15.37:0/4093514793 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7080b3c50 0x7ff7080b6110 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.951+0000 7ff725000640 1 --2- 172.21.15.37:0/4093514793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff71809b250 0x7ff71812eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.951+0000 7ff725000640 1 --2- 172.21.15.37:0/4093514793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7180986a0 0x7ff71812dee0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.951+0000 7ff725000640 1 --2- 172.21.15.37:0/4093514793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7180058f0 0x7ff71812d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.951+0000 7ff725000640 1 -- 172.21.15.37:0/4093514793 >> 172.21.15.37:0/4093514793 conn(0x7ff71808fce0 msgr2=0x7ff7180920d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.951+0000 7ff725000640 1 -- 172.21.15.37:0/4093514793 shutdown_connections 2024-08-20T05:10:04.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:04.951+0000 7ff725000640 1 -- 172.21.15.37:0/4093514793 wait complete. 2024-08-20T05:10:05.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:05 smithi130 ceph-mon[22007]: pgmap v636: 129 pgs: 129 active+clean; 1.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.9 MiB/s wr, 559 op/s 2024-08-20T05:10:05.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:05 smithi037 ceph-mon[17265]: pgmap v636: 129 pgs: 129 active+clean; 1.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.9 MiB/s wr, 559 op/s 2024-08-20T05:10:05.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.847+0000 7f8cf0c00640 1 -- 172.21.15.37:0/639312937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cec104ca0 msgr2=0x7f8cec105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:05.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.847+0000 7f8cf0c00640 1 --2- 172.21.15.37:0/639312937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cec104ca0 0x7f8cec105080 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009900 tx=0x7f8cd802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.847+0000 7f8cf0c00640 1 -- 172.21.15.37:0/639312937 shutdown_connections 2024-08-20T05:10:05.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.847+0000 7f8cf0c00640 1 --2- 172.21.15.37:0/639312937 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cec10b030 0x7f8cec111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.847+0000 7f8cf0c00640 1 --2- 172.21.15.37:0/639312937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cec10a6b0 0x7f8cec10aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.847+0000 7f8cf0c00640 1 --2- 172.21.15.37:0/639312937 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cec104ca0 0x7f8cec105080 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.847+0000 7f8cf0c00640 1 -- 172.21.15.37:0/639312937 >> 172.21.15.37:0/639312937 conn(0x7f8cec100730 msgr2=0x7f8cec102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:05.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.848+0000 7f8cf0c00640 1 -- 172.21.15.37:0/639312937 shutdown_connections 2024-08-20T05:10:05.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.848+0000 7f8cf0c00640 1 -- 172.21.15.37:0/639312937 wait complete. 2024-08-20T05:10:05.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.849+0000 7f8cf0c00640 1 Processor -- start 2024-08-20T05:10:05.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.849+0000 7f8cf0c00640 1 -- start start 2024-08-20T05:10:05.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.850+0000 7f8cf0c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cec104ca0 0x7f8cec111580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.850+0000 7f8cf0c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cec10a6b0 0x7f8cec10e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.850+0000 7f8cf0c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cec10b030 0x7f8cec10ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.850+0000 7f8cf0c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec114d00 con 0x7f8cec10a6b0 2024-08-20T05:10:05.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.850+0000 7f8cf0c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec114b80 con 0x7f8cec10b030 2024-08-20T05:10:05.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.850+0000 7f8cf0c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec114e80 con 0x7f8cec104ca0 2024-08-20T05:10:05.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.851+0000 7f8ce9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cec10a6b0 0x7f8cec10e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:05.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.851+0000 7f8ce9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cec10a6b0 0x7f8cec10e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44446/0 (socket says 172.21.15.37:44446) 2024-08-20T05:10:05.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.851+0000 7f8ce9400640 1 -- 172.21.15.37:0/1479720335 learned_addr learned my addr 172.21.15.37:0/1479720335 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:05.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.852+0000 7f8ce9400640 1 -- 172.21.15.37:0/1479720335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cec104ca0 msgr2=0x7f8cec111580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:05.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.852+0000 7f8ce9400640 1 --2- 172.21.15.37:0/1479720335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cec104ca0 0x7f8cec111580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.852+0000 7f8ce9400640 1 -- 172.21.15.37:0/1479720335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cec10b030 msgr2=0x7f8cec10ed10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T05:10:05.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.852+0000 7f8ce9400640 1 --2- 172.21.15.37:0/1479720335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cec10b030 0x7f8cec10ed10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.852+0000 7f8ce9400640 1 -- 172.21.15.37:0/1479720335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cec10f5a0 con 0x7f8cec10a6b0 2024-08-20T05:10:05.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.852+0000 7f8ce9400640 1 --2- 172.21.15.37:0/1479720335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cec10a6b0 0x7f8cec10e7d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc009d50 tx=0x7f8cdc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:05.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.853+0000 7f8ce2a00640 1 -- 172.21.15.37:0/1479720335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc003b70 con 0x7f8cec10a6b0 2024-08-20T05:10:05.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.853+0000 7f8cf0c00640 1 -- 172.21.15.37:0/1479720335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cec1abaa0 con 0x7f8cec10a6b0 2024-08-20T05:10:05.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.853+0000 7f8ce2a00640 1 -- 172.21.15.37:0/1479720335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cdc003d10 con 0x7f8cec10a6b0 2024-08-20T05:10:05.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.853+0000 7f8ce2a00640 1 -- 172.21.15.37:0/1479720335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0108d0 con 0x7f8cec10a6b0 2024-08-20T05:10:05.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.853+0000 7f8cf0c00640 1 -- 172.21.15.37:0/1479720335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cec1abfe0 con 0x7f8cec10a6b0 2024-08-20T05:10:05.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:05 smithi135 ceph-mon[22342]: pgmap v636: 129 pgs: 129 active+clean; 1.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.9 MiB/s wr, 559 op/s 2024-08-20T05:10:05.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.868+0000 7f8ce2a00640 1 -- 172.21.15.37:0/1479720335 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8cdc004560 con 0x7f8cec10a6b0 2024-08-20T05:10:05.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.874+0000 7f8ce2a00640 1 --2- 172.21.15.37:0/1479720335 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8cd00b3c50 0x7f8cd00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.874+0000 7f8ce2a00640 1 -- 172.21.15.37:0/1479720335 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8cdc0e48f0 con 0x7f8cec10a6b0 2024-08-20T05:10:05.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.875+0000 7f8ce9e00640 1 --2- 172.21.15.37:0/1479720335 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8cd00b3c50 0x7f8cd00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:05.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.875+0000 7f8cf36a9740 1 Processor -- start 2024-08-20T05:10:05.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.876+0000 7f8ce9e00640 1 --2- 172.21.15.37:0/1479720335 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8cd00b3c50 0x7f8cd00b6110 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8cd802a910 tx=0x7f8cd8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:05.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.879+0000 7f8cf36a9740 1 -- start start 2024-08-20T05:10:05.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.879+0000 7f8cf36a9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484f0940 0x5639484f0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.879+0000 7f8cf36a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484f1260 0x5639484fccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.879+0000 7f8cf36a9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484fd1f0 0x5639484ff5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.879+0000 7f8cf36a9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563948466aa0 con 0x5639484f0940 2024-08-20T05:10:05.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.879+0000 7f8cf36a9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563948455fa0 con 0x5639484f1260 2024-08-20T05:10:05.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.879+0000 7f8cf36a9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563948459fe0 con 0x5639484fd1f0 2024-08-20T05:10:05.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.880+0000 7f8cea800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484fd1f0 0x5639484ff5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:05.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.880+0000 7f8cea800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484fd1f0 0x5639484ff5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50684/0 (socket says 172.21.15.37:50684) 2024-08-20T05:10:05.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.880+0000 7f8cea800640 1 -- 172.21.15.37:0/2747992134 learned_addr learned my addr 172.21.15.37:0/2747992134 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:05.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.880+0000 7f8cea800640 1 -- 172.21.15.37:0/2747992134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484f1260 msgr2=0x5639484fccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:05.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.880+0000 7f8ce9e00640 1 --2- 172.21.15.37:0/2747992134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484f0940 0x5639484f0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:05.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.881+0000 7f8ce9400640 1 --2- 172.21.15.37:0/2747992134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484f1260 0x5639484fccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.881+0000 7f8cea800640 1 --2- 172.21.15.37:0/2747992134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484f1260 0x5639484fccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.881+0000 7f8cea800640 1 -- 172.21.15.37:0/2747992134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484f0940 msgr2=0x5639484f0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.881+0000 7f8cea800640 1 --2- 172.21.15.37:0/2747992134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484f0940 0x5639484f0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.881+0000 7f8cea800640 1 -- 172.21.15.37:0/2747992134 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639483fc420 con 0x5639484fd1f0 2024-08-20T05:10:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.881+0000 7f8ce9e00640 1 --2- 172.21.15.37:0/2747992134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484f0940 0x5639484f0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:10:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.881+0000 7f8ce9400640 1 --2- 172.21.15.37:0/2747992134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484f1260 0x5639484fccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:10:05.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.881+0000 7f8cea800640 1 --2- 172.21.15.37:0/2747992134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484fd1f0 0x5639484ff5e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009b00 tx=0x7f8ce400e350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e7c8423479d2028 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:05.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.885+0000 7f8cd7000640 1 -- 172.21.15.37:0/2747992134 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce400ed00 con 0x5639484fd1f0 2024-08-20T05:10:05.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.885+0000 7f8cd7000640 1 -- 172.21.15.37:0/2747992134 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ce4005020 con 0x5639484fd1f0 2024-08-20T05:10:05.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.886+0000 7f8cf36a9740 1 -- 172.21.15.37:0/2747992134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484fd1f0 msgr2=0x5639484ff5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:05.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.886+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/2747992134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484fd1f0 0x5639484ff5e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009b00 tx=0x7f8ce400e350 comp rx=0 tx=0).stop 2024-08-20T05:10:05.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.886+0000 7f8cf36a9740 1 -- 172.21.15.37:0/2747992134 shutdown_connections 2024-08-20T05:10:05.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.886+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/2747992134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484fd1f0 0x5639484ff5e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.886+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/2747992134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484f1260 0x5639484fccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.886+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/2747992134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484f0940 0x5639484f0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.886+0000 7f8cf36a9740 1 -- 172.21.15.37:0/2747992134 >> 172.21.15.37:0/2747992134 conn(0x5639484ee770 msgr2=0x5639484ef910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:05.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.889+0000 7f8cf36a9740 1 -- 172.21.15.37:0/2747992134 shutdown_connections 2024-08-20T05:10:05.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.889+0000 7f8cf36a9740 1 -- 172.21.15.37:0/2747992134 wait complete. 2024-08-20T05:10:05.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.890+0000 7f8cf36a9740 1 -- start start 2024-08-20T05:10:05.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.892+0000 7f8cf36a9740 1 Processor -- start 2024-08-20T05:10:05.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.896+0000 7f8cf36a9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484f0940 0x5639484fc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.896+0000 7f8cf36a9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f1260 0x5639484f9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.898+0000 7f8cf36a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484fd1f0 0x5639484fa200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.898+0000 7f8cf36a9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5639482b8700 con 0x5639484f0940 2024-08-20T05:10:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.898+0000 7f8cf36a9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5639483f1290 con 0x5639484fd1f0 2024-08-20T05:10:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.898+0000 7f8cf36a9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5639484fff10 con 0x5639484f1260 2024-08-20T05:10:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.898+0000 7f8ce9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f1260 0x5639484f9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.898+0000 7f8ce9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484f0940 0x5639484fc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.898+0000 7f8ce9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f1260 0x5639484f9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50698/0 (socket says 172.21.15.37:50698) 2024-08-20T05:10:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.898+0000 7f8ce9400640 1 -- 172.21.15.37:0/1001601606 learned_addr learned my addr 172.21.15.37:0/1001601606 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.899+0000 7f8cf36a9740 10 client.0 _ll_register_callbacks cb 0x5639484501c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:05.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.899+0000 7f8cea800640 1 --2- 172.21.15.37:0/1001601606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484fd1f0 0x5639484fa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.901+0000 7f8ce9400640 1 -- 172.21.15.37:0/1001601606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484fd1f0 msgr2=0x5639484fa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.901+0000 7f8ce9400640 1 --2- 172.21.15.37:0/1001601606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484fd1f0 0x5639484fa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.901+0000 7f8ce9400640 1 -- 172.21.15.37:0/1001601606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484f0940 msgr2=0x5639484fc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:05.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.901+0000 7f8ce9400640 1 --2- 172.21.15.37:0/1001601606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484f0940 0x5639484fc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.901+0000 7f8ce9400640 1 -- 172.21.15.37:0/1001601606 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639481b5650 con 0x5639484f1260 2024-08-20T05:10:05.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.901+0000 7f8ce9e00640 1 --2- 172.21.15.37:0/1001601606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484f0940 0x5639484fc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:10:05.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.901+0000 7f8cea800640 1 --2- 172.21.15.37:0/1001601606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484fd1f0 0x5639484fa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:10:05.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.901+0000 7f8ce9400640 1 --2- 172.21.15.37:0/1001601606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f1260 0x5639484f9cc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00cba0 tx=0x7f8cdc0ab080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25988e18eed08817 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:05.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.902+0000 7f8ccb400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:10:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.902+0000 7f8ccb400640 1 -- 172.21.15.37:0/1001601606 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0c5060 con 0x5639484f1260 2024-08-20T05:10:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.902+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1001601606 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ce4005020 con 0x5639484f1260 2024-08-20T05:10:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.902+0000 7f8ccb400640 1 -- 172.21.15.37:0/1001601606 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8cdc0a5d70 con 0x5639484f1260 2024-08-20T05:10:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.902+0000 7f8ccb400640 1 -- 172.21.15.37:0/1001601606 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8cdc0afa40 con 0x5639484f1260 2024-08-20T05:10:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.902+0000 7f8cf36a9740 10 client.27493 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.902+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1001601606 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56394850b610 con 0x5639484f1260 2024-08-20T05:10:05.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.903+0000 7f8ccb400640 1 -- 172.21.15.37:0/1001601606 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ce4005020 con 0x5639484f1260 2024-08-20T05:10:05.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.903+0000 7f8ccb400640 1 -- 172.21.15.37:0/1001601606 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f8cdc0a6e40 con 0x5639484f1260 2024-08-20T05:10:05.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.903+0000 7f8cf36a9740 10 client.27493 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:05.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.903+0000 7f8cf36a9740 10 client.27493 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:10:05.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.903+0000 7f8cf36a9740 20 client.27493 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:05.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.903+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/1001601606 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x56394850ca20 0x56394850ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.905+0000 7f8cf36a9740 4 client.27493 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:10:05.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.905+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1001601606 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639484689f0 con 0x56394850ca20 2024-08-20T05:10:05.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.905+0000 7f8ce9e00640 1 --2- 172.21.15.37:0/1001601606 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x56394850ca20 0x56394850ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:05.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.909+0000 7f8ccb400640 10 client.27493 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:10:05.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.909+0000 7f8ce9e00640 1 --2- 172.21.15.37:0/1001601606 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x56394850ca20 0x56394850ee50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=76e65c203fbd051a server_cookie=b68616f560850be1 in_seq=0 out_seq=0 2024-08-20T05:10:05.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.910+0000 7f8ccb400640 1 -- 172.21.15.37:0/1001601606 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5639484689f0 con 0x56394850ca20 2024-08-20T05:10:05.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.910+0000 7f8ccb400640 10 client.27493 handle_command_reply: tid=0 2024-08-20T05:10:05.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.911+0000 7f8cf36a9740 1 client.27493 shutdown 2024-08-20T05:10:05.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.911+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1001601606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f1260 msgr2=0x5639484f9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:05.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.911+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/1001601606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f1260 0x5639484f9cc0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00cba0 tx=0x7f8cdc0ab080 comp rx=0 tx=0).stop 2024-08-20T05:10:05.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.911+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1001601606 shutdown_connections 2024-08-20T05:10:05.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.911+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/1001601606 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x56394850ca20 0x56394850ee50 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.911+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/1001601606 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484fd1f0 0x5639484fa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.911+0000 7f8ccb400640 0 client.27493 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:10:05.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.911+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/1001601606 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f1260 0x5639484f9cc0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.911+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/1001601606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484f0940 0x5639484fc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.911+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1001601606 >> 172.21.15.37:0/1001601606 conn(0x5639484ee770 msgr2=0x5639484f42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:05.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.915+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1001601606 shutdown_connections 2024-08-20T05:10:05.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.915+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1001601606 wait complete. 2024-08-20T05:10:05.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.916+0000 7f8cf36a9740 20 client.27493 trim_cache size 0 max 16384 2024-08-20T05:10:05.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.945+0000 7f8cf36a9740 1 Processor -- start 2024-08-20T05:10:05.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.945+0000 7f8cf36a9740 1 -- start start 2024-08-20T05:10:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.946+0000 7f8cf36a9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f0940 0x563948514720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.946+0000 7f8cf36a9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484f1260 0x563948514c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.946+0000 7f8cf36a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484fd1f0 0x5639484f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.946+0000 7f8cf36a9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec1b5e90 con 0x5639484f1260 2024-08-20T05:10:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.946+0000 7f8cf36a9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec1b7af0 con 0x5639484fd1f0 2024-08-20T05:10:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.946+0000 7f8cf36a9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec1b6560 con 0x5639484f0940 2024-08-20T05:10:05.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.946+0000 7f8ce9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f0940 0x563948514720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:05.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.946+0000 7f8ce9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f0940 0x563948514720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50712/0 (socket says 172.21.15.37:50712) 2024-08-20T05:10:05.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.946+0000 7f8ce9e00640 1 -- 172.21.15.37:0/885289025 learned_addr learned my addr 172.21.15.37:0/885289025 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:05.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.947+0000 7f8cea800640 1 --2- 172.21.15.37:0/885289025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484fd1f0 0x5639484f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:05.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.947+0000 7f8ce9e00640 1 -- 172.21.15.37:0/885289025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484fd1f0 msgr2=0x5639484f6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:05.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.947+0000 7f8ce9e00640 1 --2- 172.21.15.37:0/885289025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484fd1f0 0x5639484f6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.947+0000 7f8ce9e00640 1 -- 172.21.15.37:0/885289025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484f1260 msgr2=0x563948514c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:05.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.947+0000 7f8ce9e00640 1 --2- 172.21.15.37:0/885289025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484f1260 0x563948514c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.947+0000 7f8ce9e00640 1 -- 172.21.15.37:0/885289025 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639484e9ed0 con 0x5639484f0940 2024-08-20T05:10:05.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.947+0000 7f8cea800640 1 --2- 172.21.15.37:0/885289025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484fd1f0 0x5639484f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:10:05.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.947+0000 7f8ce9e00640 1 --2- 172.21.15.37:0/885289025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f0940 0x563948514720 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8033000 tx=0x7f8cd803a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d748c74e790a3582 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:05.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.948+0000 7f8cd6600640 1 -- 172.21.15.37:0/885289025 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8035040 con 0x5639484f0940 2024-08-20T05:10:05.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.950+0000 7f8cd6600640 1 -- 172.21.15.37:0/885289025 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cd8054070 con 0x5639484f0940 2024-08-20T05:10:05.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.950+0000 7f8cd6600640 1 -- 172.21.15.37:0/885289025 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd804f310 con 0x5639484f0940 2024-08-20T05:10:05.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.951+0000 7f8cf36a9740 1 -- 172.21.15.37:0/885289025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f0940 msgr2=0x563948514720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:05.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.951+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/885289025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f0940 0x563948514720 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8033000 tx=0x7f8cd803a000 comp rx=0 tx=0).stop 2024-08-20T05:10:05.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.951+0000 7f8cf36a9740 1 -- 172.21.15.37:0/885289025 shutdown_connections 2024-08-20T05:10:05.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.951+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/885289025 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484fd1f0 0x5639484f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.951+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/885289025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484f1260 0x563948514c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.951+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/885289025 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f0940 0x563948514720 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.951+0000 7f8cf36a9740 1 -- 172.21.15.37:0/885289025 >> 172.21.15.37:0/885289025 conn(0x5639484ee770 msgr2=0x5639484fbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:05.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.951+0000 7f8cf36a9740 1 -- 172.21.15.37:0/885289025 shutdown_connections 2024-08-20T05:10:05.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.951+0000 7f8cf36a9740 1 -- 172.21.15.37:0/885289025 wait complete. 2024-08-20T05:10:05.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.954+0000 7f8cf36a9740 1 -- start start 2024-08-20T05:10:05.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.954+0000 7f8cf36a9740 1 Processor -- start 2024-08-20T05:10:05.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.955+0000 7f8cf36a9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484f0940 0x5639485059c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.955+0000 7f8cf36a9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f1260 0x5639484f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.955+0000 7f8cf36a9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484fd1f0 0x5639484f7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.955+0000 7f8ce9e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484f0940 0x5639485059c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:05.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.955+0000 7f8ce9e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484f0940 0x5639485059c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47790/0 (socket says 172.21.15.37:47790) 2024-08-20T05:10:05.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.955+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1207446519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec1b7360 con 0x5639484fd1f0 2024-08-20T05:10:05.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.955+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1207446519 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec1b6c30 con 0x5639484f0940 2024-08-20T05:10:05.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.955+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1207446519 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8cec1b3e70 con 0x5639484f1260 2024-08-20T05:10:05.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.955+0000 7f8ce9e00640 1 -- 172.21.15.37:0/1207446519 learned_addr learned my addr 172.21.15.37:0/1207446519 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:05.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.955+0000 7f8cf36a9740 10 client.0 _ll_register_callbacks cb 0x7f8cdc0a7300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:05.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.956+0000 7f8cea800640 1 --2- 172.21.15.37:0/1207446519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484fd1f0 0x5639484f7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:05.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.956+0000 7f8ce9400640 1 --2- 172.21.15.37:0/1207446519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f1260 0x5639484f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:05.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.956+0000 7f8ce9e00640 1 -- 172.21.15.37:0/1207446519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f1260 msgr2=0x5639484f6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:05.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.956+0000 7f8ce9e00640 1 --2- 172.21.15.37:0/1207446519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f1260 0x5639484f6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.956+0000 7f8ce9e00640 1 -- 172.21.15.37:0/1207446519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484fd1f0 msgr2=0x5639484f7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:05.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.957+0000 7f8ce9e00640 1 --2- 172.21.15.37:0/1207446519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484fd1f0 0x5639484f7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.957+0000 7f8ce9e00640 1 -- 172.21.15.37:0/1207446519 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639485766f0 con 0x5639484f0940 2024-08-20T05:10:05.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.958+0000 7f8cea800640 1 --2- 172.21.15.37:0/1207446519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484fd1f0 0x5639484f7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:10:05.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.958+0000 7f8ce9e00640 1 --2- 172.21.15.37:0/1207446519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484f0940 0x5639485059c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8cd802abb0 tx=0x7f8cd80040f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7b1473330b066f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:05.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.958+0000 7f8ccb400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:10:05.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.958+0000 7f8ccb400640 1 -- 172.21.15.37:0/1207446519 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd805d060 con 0x5639484f0940 2024-08-20T05:10:05.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.959+0000 7f8ccb400640 1 -- 172.21.15.37:0/1207446519 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8cd80314a0 con 0x5639484f0940 2024-08-20T05:10:05.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.959+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1207446519 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cd8054070 con 0x5639484f0940 2024-08-20T05:10:05.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.959+0000 7f8ccb400640 1 -- 172.21.15.37:0/1207446519 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8cd8035040 con 0x5639484f0940 2024-08-20T05:10:05.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.959+0000 7f8cf36a9740 10 client.27494 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:05.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.959+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1207446519 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x563948577850 con 0x5639484f0940 2024-08-20T05:10:05.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.960+0000 7f8ccb400640 1 -- 172.21.15.37:0/1207446519 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cd8054070 con 0x5639484f0940 2024-08-20T05:10:05.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.960+0000 7f8ccb400640 1 -- 172.21.15.37:0/1207446519 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f8cd804fa90 con 0x5639484f0940 2024-08-20T05:10:05.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.961+0000 7f8cf36a9740 10 client.27494 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:05.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.961+0000 7f8cf36a9740 10 client.27494 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:10:05.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.961+0000 7f8cf36a9740 20 client.27494 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:05.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.961+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/1207446519 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x56394850ca20 0x563948579f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:05.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.961+0000 7f8cf36a9740 4 client.27494 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:10:05.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.961+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1207446519 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563948464490 con 0x56394850ca20 2024-08-20T05:10:05.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.961+0000 7f8ce9400640 1 --2- 172.21.15.37:0/1207446519 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x56394850ca20 0x563948579f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:05.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.963+0000 7f8ce9400640 1 --2- 172.21.15.37:0/1207446519 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x56394850ca20 0x563948579f40 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8ec84979438085fa server_cookie=955e16e352eb6d05 in_seq=0 out_seq=0 2024-08-20T05:10:05.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.963+0000 7f8ccb400640 10 client.27494 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:10:05.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.963+0000 7f8ccb400640 1 -- 172.21.15.37:0/1207446519 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563948464490 con 0x56394850ca20 2024-08-20T05:10:05.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.963+0000 7f8ccb400640 10 client.27494 handle_command_reply: tid=0 2024-08-20T05:10:05.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.963+0000 7f8cf36a9740 1 client.27494 shutdown 2024-08-20T05:10:05.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.964+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1207446519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484f0940 msgr2=0x5639485059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:05.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.964+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/1207446519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484f0940 0x5639485059c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8cd802abb0 tx=0x7f8cd80040f0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.965+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1207446519 shutdown_connections 2024-08-20T05:10:05.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.965+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/1207446519 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x56394850ca20 0x563948579f40 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.965+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/1207446519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639484fd1f0 0x5639484f7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.965+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/1207446519 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639484f1260 0x5639484f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.965+0000 7f8cf36a9740 1 --2- 172.21.15.37:0/1207446519 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639484f0940 0x5639485059c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.965+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1207446519 >> 172.21.15.37:0/1207446519 conn(0x5639484ee770 msgr2=0x5639484ed030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:05.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.966+0000 7f8ccb400640 0 client.27494 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:10:05.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.966+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1207446519 shutdown_connections 2024-08-20T05:10:05.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.966+0000 7f8cf36a9740 1 -- 172.21.15.37:0/1207446519 wait complete. 2024-08-20T05:10:05.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.966+0000 7f8cf36a9740 20 client.27494 trim_cache size 0 max 16384 2024-08-20T05:10:05.968 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:10:05.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.968+0000 7f8cf0c00640 1 -- 172.21.15.37:0/1479720335 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8cd00b3c50 msgr2=0x7f8cd00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:05.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.968+0000 7f8cf0c00640 1 --2- 172.21.15.37:0/1479720335 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8cd00b3c50 0x7f8cd00b6110 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f8cd802a910 tx=0x7f8cd8031400 comp rx=0 tx=0).stop 2024-08-20T05:10:05.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.968+0000 7f8cf0c00640 1 -- 172.21.15.37:0/1479720335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cec10a6b0 msgr2=0x7f8cec10e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:05.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.968+0000 7f8cf0c00640 1 --2- 172.21.15.37:0/1479720335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cec10a6b0 0x7f8cec10e7d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc009d50 tx=0x7f8cdc00c6a0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.970+0000 7f8cf0c00640 1 -- 172.21.15.37:0/1479720335 shutdown_connections 2024-08-20T05:10:05.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.970+0000 7f8cf0c00640 1 --2- 172.21.15.37:0/1479720335 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8cd00b3c50 0x7f8cd00b6110 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.970+0000 7f8cf0c00640 1 --2- 172.21.15.37:0/1479720335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8cec10b030 0x7f8cec10ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.970+0000 7f8cf0c00640 1 --2- 172.21.15.37:0/1479720335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cec10a6b0 0x7f8cec10e7d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.970+0000 7f8cf0c00640 1 --2- 172.21.15.37:0/1479720335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8cec104ca0 0x7f8cec111580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:05.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.970+0000 7f8cf0c00640 1 -- 172.21.15.37:0/1479720335 >> 172.21.15.37:0/1479720335 conn(0x7f8cec100730 msgr2=0x7f8cec102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:05.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.970+0000 7f8cf0c00640 1 -- 172.21.15.37:0/1479720335 shutdown_connections 2024-08-20T05:10:05.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:05.970+0000 7f8cf0c00640 1 -- 172.21.15.37:0/1479720335 wait complete. 2024-08-20T05:10:07.061 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T05:10:07.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:07 smithi130 ceph-mon[22007]: pgmap v637: 129 pgs: 129 active+clean; 1.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.2 MiB/s wr, 591 op/s 2024-08-20T05:10:07.731 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:10:07.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:07 smithi037 ceph-mon[17265]: pgmap v637: 129 pgs: 129 active+clean; 1.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.2 MiB/s wr, 591 op/s 2024-08-20T05:10:07.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:07 smithi135 ceph-mon[22342]: pgmap v637: 129 pgs: 129 active+clean; 1.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.2 MiB/s wr, 591 op/s 2024-08-20T05:10:08.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 430.0 s, 611.2 tps, lat 161.323 ms stddev 192.785 2024-08-20T05:10:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.585+0000 7fec27400640 1 -- 172.21.15.37:0/2314902612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec2010ce00 msgr2=0x7fec2010f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:08.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.585+0000 7fec27400640 1 --2- 172.21.15.37:0/2314902612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec2010ce00 0x7fec2010f260 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fec10009860 tx=0x7fec1002a360 comp rx=0 tx=0).stop 2024-08-20T05:10:08.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.589+0000 7fec27400640 1 -- 172.21.15.37:0/2314902612 shutdown_connections 2024-08-20T05:10:08.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.589+0000 7fec27400640 1 --2- 172.21.15.37:0/2314902612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec2010ce00 0x7fec2010f260 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.589+0000 7fec27400640 1 --2- 172.21.15.37:0/2314902612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec201042c0 0x7fec2010c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.589+0000 7fec27400640 1 --2- 172.21.15.37:0/2314902612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec201039a0 0x7fec20103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.589+0000 7fec27400640 1 -- 172.21.15.37:0/2314902612 >> 172.21.15.37:0/2314902612 conn(0x7fec200fd400 msgr2=0x7fec200ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:08.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.590+0000 7fec27400640 1 -- 172.21.15.37:0/2314902612 shutdown_connections 2024-08-20T05:10:08.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.590+0000 7fec27400640 1 -- 172.21.15.37:0/2314902612 wait complete. 2024-08-20T05:10:08.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.592+0000 7fec27400640 1 Processor -- start 2024-08-20T05:10:08.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.593+0000 7fec27400640 1 -- start start 2024-08-20T05:10:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.594+0000 7fec27400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec201039a0 0x7fec20199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.594+0000 7fec27400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec201042c0 0x7fec20199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.594+0000 7fec27400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec2010ce00 0x7fec2019e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.594+0000 7fec27400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec20112a70 con 0x7fec2010ce00 2024-08-20T05:10:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.594+0000 7fec27400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fec201128f0 con 0x7fec201039a0 2024-08-20T05:10:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.594+0000 7fec27400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fec20112bf0 con 0x7fec201042c0 2024-08-20T05:10:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.594+0000 7fec1fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec201042c0 0x7fec20199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.594+0000 7fec1fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec201042c0 0x7fec20199580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50738/0 (socket says 172.21.15.37:50738) 2024-08-20T05:10:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.594+0000 7fec1fe00640 1 -- 172.21.15.37:0/1409402449 learned_addr learned my addr 172.21.15.37:0/1409402449 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.594+0000 7fec24a00640 1 --2- 172.21.15.37:0/1409402449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec201039a0 0x7fec20199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.595+0000 7fec25400640 1 --2- 172.21.15.37:0/1409402449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec2010ce00 0x7fec2019e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.595+0000 7fec24a00640 1 -- 172.21.15.37:0/1409402449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec201042c0 msgr2=0x7fec20199580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:08.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.595+0000 7fec24a00640 1 --2- 172.21.15.37:0/1409402449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec201042c0 0x7fec20199580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.595+0000 7fec24a00640 1 -- 172.21.15.37:0/1409402449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec2010ce00 msgr2=0x7fec2019e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:08.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.595+0000 7fec24a00640 1 --2- 172.21.15.37:0/1409402449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec2010ce00 0x7fec2019e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.595+0000 7fec24a00640 1 -- 172.21.15.37:0/1409402449 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2019f0f0 con 0x7fec201039a0 2024-08-20T05:10:08.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.596+0000 7fec24a00640 1 --2- 172.21.15.37:0/1409402449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec201039a0 0x7fec20199040 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fec1800ef60 tx=0x7fec1800ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:08.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.597+0000 7fec1d600640 1 -- 172.21.15.37:0/1409402449 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18020070 con 0x7fec201039a0 2024-08-20T05:10:08.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.597+0000 7fec1d600640 1 -- 172.21.15.37:0/1409402449 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec18013d10 con 0x7fec201039a0 2024-08-20T05:10:08.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.597+0000 7fec1d600640 1 -- 172.21.15.37:0/1409402449 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1801be60 con 0x7fec201039a0 2024-08-20T05:10:08.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.597+0000 7fec27400640 1 -- 172.21.15.37:0/1409402449 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec2019f3e0 con 0x7fec201039a0 2024-08-20T05:10:08.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.597+0000 7fec27400640 1 -- 172.21.15.37:0/1409402449 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec20101700 con 0x7fec201039a0 2024-08-20T05:10:08.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.613+0000 7fec2a016740 1 Processor -- start 2024-08-20T05:10:08.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.613+0000 7fec2a016740 1 -- start start 2024-08-20T05:10:08.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.614+0000 7fec2a016740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c2940 0x55dc2f1c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.614+0000 7fec2a016740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1c3260 0x55dc2f1d74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.614+0000 7fec2a016740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1d7a00 0x55dc2f1d9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.614+0000 7fec2a016740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dc2f138aa0 con 0x55dc2f1c3260 2024-08-20T05:10:08.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.615+0000 7fec2a016740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55dc2f127fa0 con 0x55dc2f1c2940 2024-08-20T05:10:08.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.615+0000 7fec2a016740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55dc2f12bfe0 con 0x55dc2f1d7a00 2024-08-20T05:10:08.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.615+0000 7fec1d600640 1 -- 172.21.15.37:0/1409402449 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fec18023070 con 0x7fec201039a0 2024-08-20T05:10:08.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.615+0000 7fec25400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c2940 0x55dc2f1c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:08.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.615+0000 7fec25400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c2940 0x55dc2f1c2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47810/0 (socket says 172.21.15.37:47810) 2024-08-20T05:10:08.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.615+0000 7fec25400640 1 -- 172.21.15.37:0/2209848009 learned_addr learned my addr 172.21.15.37:0/2209848009 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:08.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.615+0000 7fec25400640 1 -- 172.21.15.37:0/2209848009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1d7a00 msgr2=0x55dc2f1d9df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:10:08.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.615+0000 7fec25400640 1 --2- 172.21.15.37:0/2209848009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1d7a00 0x55dc2f1d9df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.615+0000 7fec25400640 1 -- 172.21.15.37:0/2209848009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1c3260 msgr2=0x55dc2f1d74c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:10:08.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.615+0000 7fec25400640 1 --2- 172.21.15.37:0/2209848009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1c3260 0x55dc2f1d74c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.615+0000 7fec25400640 1 -- 172.21.15.37:0/2209848009 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc2f0ce420 con 0x55dc2f1c2940 2024-08-20T05:10:08.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.616+0000 7fec25400640 1 --2- 172.21.15.37:0/2209848009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c2940 0x55dc2f1c2d20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fec10035040 tx=0x7fec100094c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10f0276449942394 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:08.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.617+0000 7fec15c00640 1 -- 172.21.15.37:0/2209848009 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec10037040 con 0x55dc2f1c2940 2024-08-20T05:10:08.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.617+0000 7fec15c00640 1 -- 172.21.15.37:0/2209848009 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec10030dd0 con 0x55dc2f1c2940 2024-08-20T05:10:08.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.617+0000 7fec15c00640 1 -- 172.21.15.37:0/2209848009 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec100053c0 con 0x55dc2f1c2940 2024-08-20T05:10:08.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.618+0000 7fec2a016740 1 -- 172.21.15.37:0/2209848009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c2940 msgr2=0x55dc2f1c2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:08.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.618+0000 7fec2a016740 1 --2- 172.21.15.37:0/2209848009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c2940 0x55dc2f1c2d20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fec10035040 tx=0x7fec100094c0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.618+0000 7fec2a016740 1 -- 172.21.15.37:0/2209848009 shutdown_connections 2024-08-20T05:10:08.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.618+0000 7fec2a016740 1 --2- 172.21.15.37:0/2209848009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1d7a00 0x55dc2f1d9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.618+0000 7fec2a016740 1 --2- 172.21.15.37:0/2209848009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1c3260 0x55dc2f1d74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.618+0000 7fec2a016740 1 --2- 172.21.15.37:0/2209848009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c2940 0x55dc2f1c2d20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.618+0000 7fec2a016740 1 -- 172.21.15.37:0/2209848009 >> 172.21.15.37:0/2209848009 conn(0x55dc2f1c0770 msgr2=0x55dc2f1c1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:08.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.618+0000 7fec2a016740 1 -- 172.21.15.37:0/2209848009 shutdown_connections 2024-08-20T05:10:08.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.619+0000 7fec2a016740 1 -- 172.21.15.37:0/2209848009 wait complete. 2024-08-20T05:10:08.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.619+0000 7fec1d600640 1 --2- 172.21.15.37:0/1409402449 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fec040b3c20 0x7fec040b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.619+0000 7fec1fe00640 1 --2- 172.21.15.37:0/1409402449 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fec040b3c20 0x7fec040b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:08.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.620+0000 7fec2a016740 1 -- start start 2024-08-20T05:10:08.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.620+0000 7fec1d600640 1 -- 172.21.15.37:0/1409402449 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fec180e85d0 con 0x7fec201039a0 2024-08-20T05:10:08.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.620+0000 7fec1fe00640 1 --2- 172.21.15.37:0/1409402449 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fec040b3c20 0x7fec040b60e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55dc2f1c28f0 tx=0x7fec0c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:08.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.621+0000 7fec2a016740 1 Processor -- start 2024-08-20T05:10:08.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.622+0000 7fec2a016740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1c2940 0x55dc2f1cc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.622+0000 7fec2a016740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1c3260 0x55dc2f1ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.622+0000 7fec24a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1c2940 0x55dc2f1cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:08.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.622+0000 7fec24a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1c2940 0x55dc2f1cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50740/0 (socket says 172.21.15.37:50740) 2024-08-20T05:10:08.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.623+0000 7fec24a00640 1 -- 172.21.15.37:0/2762618458 learned_addr learned my addr 172.21.15.37:0/2762618458 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:08.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.623+0000 7fec2a016740 1 --2- 172.21.15.37:0/2762618458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1d7a00 0x55dc2f1d6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.624+0000 7fec2a016740 1 -- 172.21.15.37:0/2762618458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dc2ef8a700 con 0x55dc2f1c3260 2024-08-20T05:10:08.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.624+0000 7fec2a016740 1 -- 172.21.15.37:0/2762618458 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55dc2f0c3290 con 0x55dc2f1d7a00 2024-08-20T05:10:08.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.624+0000 7fec2a016740 1 -- 172.21.15.37:0/2762618458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55dc2f1c8e50 con 0x55dc2f1c2940 2024-08-20T05:10:08.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.625+0000 7fec25400640 1 --2- 172.21.15.37:0/2762618458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1d7a00 0x55dc2f1d6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:08.626 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.625+0000 7fec2a016740 10 client.0 _ll_register_callbacks cb 0x55dc2f1221c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:08.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.625+0000 7fec1fe00640 1 --2- 172.21.15.37:0/2762618458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1c3260 0x55dc2f1ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:08.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.626+0000 7fec24a00640 1 -- 172.21.15.37:0/2762618458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1d7a00 msgr2=0x55dc2f1d6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:08.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.626+0000 7fec24a00640 1 --2- 172.21.15.37:0/2762618458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1d7a00 0x55dc2f1d6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.626+0000 7fec24a00640 1 -- 172.21.15.37:0/2762618458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1c3260 msgr2=0x55dc2f1ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:08.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.626+0000 7fec24a00640 1 --2- 172.21.15.37:0/2762618458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1c3260 0x55dc2f1ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.626+0000 7fec24a00640 1 -- 172.21.15.37:0/2762618458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc2ee87650 con 0x55dc2f1c2940 2024-08-20T05:10:08.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.627+0000 7fec24a00640 1 --2- 172.21.15.37:0/2762618458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1c2940 0x55dc2f1cc550 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fec180af160 tx=0x7fec180aece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1497936b8469fe2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:08.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.627+0000 7fec0a000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:10:08.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.629+0000 7fec0a000640 1 -- 172.21.15.37:0/2762618458 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec18013270 con 0x55dc2f1c2940 2024-08-20T05:10:08.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.629+0000 7fec0a000640 1 -- 172.21.15.37:0/2762618458 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fec1801b560 con 0x55dc2f1c2940 2024-08-20T05:10:08.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.629+0000 7fec2a016740 1 -- 172.21.15.37:0/2762618458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec10030dd0 con 0x55dc2f1c2940 2024-08-20T05:10:08.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.630+0000 7fec0a000640 1 -- 172.21.15.37:0/2762618458 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fec180c9050 con 0x55dc2f1c2940 2024-08-20T05:10:08.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.630+0000 7fec2a016740 10 client.27505 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:08.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.630+0000 7fec2a016740 1 -- 172.21.15.37:0/2762618458 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55dc2f1dd6c0 con 0x55dc2f1c2940 2024-08-20T05:10:08.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.631+0000 7fec0a000640 1 -- 172.21.15.37:0/2762618458 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec10030dd0 con 0x55dc2f1c2940 2024-08-20T05:10:08.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.631+0000 7fec0a000640 1 -- 172.21.15.37:0/2762618458 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7fec1800b040 con 0x55dc2f1c2940 2024-08-20T05:10:08.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.631+0000 7fec2a016740 10 client.27505 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:08.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.631+0000 7fec2a016740 10 client.27505 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:10:08.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.631+0000 7fec2a016740 20 client.27505 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:08.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.631+0000 7fec2a016740 1 --2- 172.21.15.37:0/2762618458 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55dc2f1dead0 0x55dc2f1e0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.631+0000 7fec2a016740 4 client.27505 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:10:08.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.631+0000 7fec2a016740 1 -- 172.21.15.37:0/2762618458 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc2f13a9f0 con 0x55dc2f1dead0 2024-08-20T05:10:08.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.632+0000 7fec1fe00640 1 --2- 172.21.15.37:0/2762618458 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55dc2f1dead0 0x55dc2f1e0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:08.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.633+0000 7fec1fe00640 1 --2- 172.21.15.37:0/2762618458 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55dc2f1dead0 0x55dc2f1e0f40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=de5cdb09caf166d server_cookie=e854a28977a718b2 in_seq=0 out_seq=0 2024-08-20T05:10:08.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.633+0000 7fec0a000640 10 client.27505 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:10:08.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.634+0000 7fec0a000640 1 -- 172.21.15.37:0/2762618458 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc2f13a9f0 con 0x55dc2f1dead0 2024-08-20T05:10:08.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.634+0000 7fec0a000640 10 client.27505 handle_command_reply: tid=0 2024-08-20T05:10:08.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.635+0000 7fec2a016740 1 client.27505 shutdown 2024-08-20T05:10:08.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.635+0000 7fec2a016740 1 -- 172.21.15.37:0/2762618458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1c2940 msgr2=0x55dc2f1cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:08.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.635+0000 7fec2a016740 1 --2- 172.21.15.37:0/2762618458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1c2940 0x55dc2f1cc550 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fec180af160 tx=0x7fec180aece0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.635+0000 7fec2a016740 1 -- 172.21.15.37:0/2762618458 shutdown_connections 2024-08-20T05:10:08.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.635+0000 7fec2a016740 1 --2- 172.21.15.37:0/2762618458 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55dc2f1dead0 0x55dc2f1e0f40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.636+0000 7fec2a016740 1 --2- 172.21.15.37:0/2762618458 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1d7a00 0x55dc2f1d6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.636+0000 7fec0a000640 0 client.27505 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:10:08.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.636+0000 7fec2a016740 1 --2- 172.21.15.37:0/2762618458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1c3260 0x55dc2f1ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.636+0000 7fec2a016740 1 --2- 172.21.15.37:0/2762618458 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1c2940 0x55dc2f1cc550 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.636+0000 7fec2a016740 1 -- 172.21.15.37:0/2762618458 >> 172.21.15.37:0/2762618458 conn(0x55dc2f1c0770 msgr2=0x55dc2f1c6310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:08.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.637+0000 7fec2a016740 1 -- 172.21.15.37:0/2762618458 shutdown_connections 2024-08-20T05:10:08.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.637+0000 7fec2a016740 1 -- 172.21.15.37:0/2762618458 wait complete. 2024-08-20T05:10:08.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.638+0000 7fec2a016740 20 client.27505 trim_cache size 0 max 16384 2024-08-20T05:10:08.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.673+0000 7fec2a016740 1 Processor -- start 2024-08-20T05:10:08.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.673+0000 7fec2a016740 1 -- start start 2024-08-20T05:10:08.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.674+0000 7fec2a016740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1c2940 0x55dc2f1bfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.675+0000 7fec2a016740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c3260 0x55dc2f1e6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.675+0000 7fec2a016740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1d7a00 0x55dc2f1e6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.675+0000 7fec2a016740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec201be630 con 0x55dc2f1d7a00 2024-08-20T05:10:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.675+0000 7fec2a016740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fec201c0290 con 0x55dc2f1c3260 2024-08-20T05:10:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.675+0000 7fec2a016740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fec201bed00 con 0x55dc2f1c2940 2024-08-20T05:10:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.675+0000 7fec1fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c3260 0x55dc2f1e6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.675+0000 7fec24a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1c2940 0x55dc2f1bfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.675+0000 7fec24a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1c2940 0x55dc2f1bfb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50748/0 (socket says 172.21.15.37:50748) 2024-08-20T05:10:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.675+0000 7fec24a00640 1 -- 172.21.15.37:0/3800613598 learned_addr learned my addr 172.21.15.37:0/3800613598 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.675+0000 7fec25400640 1 --2- 172.21.15.37:0/3800613598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1d7a00 0x55dc2f1e6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.675+0000 7fec24a00640 1 -- 172.21.15.37:0/3800613598 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c3260 msgr2=0x55dc2f1e6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.675+0000 7fec24a00640 1 --2- 172.21.15.37:0/3800613598 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c3260 0x55dc2f1e6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.675+0000 7fec24a00640 1 -- 172.21.15.37:0/3800613598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1d7a00 msgr2=0x55dc2f1e6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.675+0000 7fec24a00640 1 --2- 172.21.15.37:0/3800613598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1d7a00 0x55dc2f1e6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.675+0000 7fec24a00640 1 -- 172.21.15.37:0/3800613598 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc2f1bbed0 con 0x55dc2f1c2940 2024-08-20T05:10:08.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.676+0000 7fec1fe00640 1 --2- 172.21.15.37:0/3800613598 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c3260 0x55dc2f1e6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:10:08.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.676+0000 7fec24a00640 1 --2- 172.21.15.37:0/3800613598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1c2940 0x55dc2f1bfb00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fec180af390 tx=0x7fec180aefa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33523c566aa66c72 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:08.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.676+0000 7fec15200640 1 -- 172.21.15.37:0/3800613598 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec180ce080 con 0x55dc2f1c2940 2024-08-20T05:10:08.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.676+0000 7fec15200640 1 -- 172.21.15.37:0/3800613598 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec18013270 con 0x55dc2f1c2940 2024-08-20T05:10:08.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.676+0000 7fec15200640 1 -- 172.21.15.37:0/3800613598 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec180b7d40 con 0x55dc2f1c2940 2024-08-20T05:10:08.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.677+0000 7fec2a016740 1 -- 172.21.15.37:0/3800613598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1c2940 msgr2=0x55dc2f1bfb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:08.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.677+0000 7fec2a016740 1 --2- 172.21.15.37:0/3800613598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1c2940 0x55dc2f1bfb00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fec180af390 tx=0x7fec180aefa0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.678+0000 7fec2a016740 1 -- 172.21.15.37:0/3800613598 shutdown_connections 2024-08-20T05:10:08.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.678+0000 7fec2a016740 1 --2- 172.21.15.37:0/3800613598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1d7a00 0x55dc2f1e6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.678+0000 7fec2a016740 1 --2- 172.21.15.37:0/3800613598 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c3260 0x55dc2f1e6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.678+0000 7fec2a016740 1 --2- 172.21.15.37:0/3800613598 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1c2940 0x55dc2f1bfb00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.678+0000 7fec2a016740 1 -- 172.21.15.37:0/3800613598 >> 172.21.15.37:0/3800613598 conn(0x55dc2f1c0770 msgr2=0x55dc2f1c6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:08.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.678+0000 7fec2a016740 1 -- 172.21.15.37:0/3800613598 shutdown_connections 2024-08-20T05:10:08.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.678+0000 7fec2a016740 1 -- 172.21.15.37:0/3800613598 wait complete. 2024-08-20T05:10:08.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.679+0000 7fec2a016740 1 -- start start 2024-08-20T05:10:08.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.679+0000 7fec2a016740 1 Processor -- start 2024-08-20T05:10:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.680+0000 7fec2a016740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1c2940 0x55dc2f1f03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.680+0000 7fec2a016740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c3260 0x55dc2f1f0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.681+0000 7fec2a016740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1d7a00 0x55dc2f1f0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.681+0000 7fec2a016740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fec201bfb00 con 0x55dc2f1c2940 2024-08-20T05:10:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.681+0000 7fec2a016740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fec201bf3d0 con 0x55dc2f1c3260 2024-08-20T05:10:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.681+0000 7fec1fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c3260 0x55dc2f1f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.681+0000 7fec1fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c3260 0x55dc2f1f0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47838/0 (socket says 172.21.15.37:47838) 2024-08-20T05:10:08.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.681+0000 7fec1fe00640 1 -- 172.21.15.37:0/2503814185 learned_addr learned my addr 172.21.15.37:0/2503814185 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.681+0000 7fec25400640 1 --2- 172.21.15.37:0/2503814185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1d7a00 0x55dc2f1f0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.681+0000 7fec2a016740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fec201bc610 con 0x55dc2f1d7a00 2024-08-20T05:10:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.681+0000 7fec2a016740 10 client.0 _ll_register_callbacks cb 0x7fec2006b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.682+0000 7fec25400640 1 -- 172.21.15.37:0/2503814185 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c3260 msgr2=0x55dc2f1f0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.682+0000 7fec25400640 1 --2- 172.21.15.37:0/2503814185 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c3260 0x55dc2f1f0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.682+0000 7fec25400640 1 -- 172.21.15.37:0/2503814185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1c2940 msgr2=0x55dc2f1f03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.682+0000 7fec24a00640 1 --2- 172.21.15.37:0/2503814185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1c2940 0x55dc2f1f03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.682+0000 7fec25400640 1 --2- 172.21.15.37:0/2503814185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1c2940 0x55dc2f1f03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.682+0000 7fec25400640 1 -- 172.21.15.37:0/2503814185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc2f2486c0 con 0x55dc2f1d7a00 2024-08-20T05:10:08.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.683+0000 7fec25400640 1 --2- 172.21.15.37:0/2503814185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1d7a00 0x55dc2f1f0e40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fec100303f0 tx=0x7fec100095b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6428488190c0e8ea server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:08.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.683+0000 7fec0a000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:10:08.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.683+0000 7fec0a000640 1 -- 172.21.15.37:0/2503814185 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec10037040 con 0x55dc2f1d7a00 2024-08-20T05:10:08.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.684+0000 7fec0a000640 1 -- 172.21.15.37:0/2503814185 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fec10004450 con 0x55dc2f1d7a00 2024-08-20T05:10:08.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.684+0000 7fec2a016740 1 -- 172.21.15.37:0/2503814185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec18013270 con 0x55dc2f1d7a00 2024-08-20T05:10:08.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.684+0000 7fec0a000640 1 -- 172.21.15.37:0/2503814185 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fec100305f0 con 0x55dc2f1d7a00 2024-08-20T05:10:08.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.684+0000 7fec2a016740 10 client.27511 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:08.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.684+0000 7fec2a016740 1 -- 172.21.15.37:0/2503814185 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55dc2f2499c0 con 0x55dc2f1d7a00 2024-08-20T05:10:08.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.685+0000 7fec0a000640 1 -- 172.21.15.37:0/2503814185 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec18013270 con 0x55dc2f1d7a00 2024-08-20T05:10:08.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.685+0000 7fec0a000640 1 -- 172.21.15.37:0/2503814185 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7fec1003d7a0 con 0x55dc2f1d7a00 2024-08-20T05:10:08.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.686+0000 7fec2a016740 10 client.27511 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.686+0000 7fec2a016740 10 client.27511 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:10:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.686+0000 7fec2a016740 20 client.27511 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.686+0000 7fec2a016740 1 --2- 172.21.15.37:0/2503814185 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55dc2f249d00 0x55dc2f24c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.686+0000 7fec2a016740 4 client.27511 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:10:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.686+0000 7fec2a016740 1 -- 172.21.15.37:0/2503814185 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dc2f136490 con 0x55dc2f249d00 2024-08-20T05:10:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.686+0000 7fec24a00640 1 --2- 172.21.15.37:0/2503814185 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55dc2f249d00 0x55dc2f24c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.687+0000 7fec24a00640 1 --2- 172.21.15.37:0/2503814185 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55dc2f249d00 0x55dc2f24c120 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a93c2484b23ac8f server_cookie=50bbbbdce767be4b in_seq=0 out_seq=0 2024-08-20T05:10:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.687+0000 7fec0a000640 10 client.27511 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:10:08.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.688+0000 7fec0a000640 1 -- 172.21.15.37:0/2503814185 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dc2f136490 con 0x55dc2f249d00 2024-08-20T05:10:08.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.688+0000 7fec0a000640 10 client.27511 handle_command_reply: tid=0 2024-08-20T05:10:08.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.688+0000 7fec2a016740 1 client.27511 shutdown 2024-08-20T05:10:08.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.688+0000 7fec2a016740 1 -- 172.21.15.37:0/2503814185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1d7a00 msgr2=0x55dc2f1f0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.688+0000 7fec2a016740 1 --2- 172.21.15.37:0/2503814185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1d7a00 0x55dc2f1f0e40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fec100303f0 tx=0x7fec100095b0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.688+0000 7fec2a016740 1 -- 172.21.15.37:0/2503814185 shutdown_connections 2024-08-20T05:10:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.688+0000 7fec2a016740 1 --2- 172.21.15.37:0/2503814185 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55dc2f249d00 0x55dc2f24c120 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.688+0000 7fec2a016740 1 --2- 172.21.15.37:0/2503814185 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc2f1d7a00 0x55dc2f1f0e40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.688+0000 7fec2a016740 1 --2- 172.21.15.37:0/2503814185 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc2f1c3260 0x55dc2f1f0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.688+0000 7fec2a016740 1 --2- 172.21.15.37:0/2503814185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc2f1c2940 0x55dc2f1f03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.688+0000 7fec2a016740 1 -- 172.21.15.37:0/2503814185 >> 172.21.15.37:0/2503814185 conn(0x55dc2f1c0770 msgr2=0x55dc2f1cac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.689+0000 7fec0a000640 0 client.27511 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:10:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.689+0000 7fec2a016740 1 -- 172.21.15.37:0/2503814185 shutdown_connections 2024-08-20T05:10:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.689+0000 7fec2a016740 1 -- 172.21.15.37:0/2503814185 wait complete. 2024-08-20T05:10:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.689+0000 7fec2a016740 20 client.27511 trim_cache size 0 max 16384 2024-08-20T05:10:08.691 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:10:08.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.690+0000 7fec27400640 1 -- 172.21.15.37:0/1409402449 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fec040b3c20 msgr2=0x7fec040b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:08.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.690+0000 7fec27400640 1 --2- 172.21.15.37:0/1409402449 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fec040b3c20 0x7fec040b60e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x55dc2f1c28f0 tx=0x7fec0c005f90 comp rx=0 tx=0).stop 2024-08-20T05:10:08.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.690+0000 7fec27400640 1 -- 172.21.15.37:0/1409402449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec201039a0 msgr2=0x7fec20199040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:08.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.690+0000 7fec27400640 1 --2- 172.21.15.37:0/1409402449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec201039a0 0x7fec20199040 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fec1800ef60 tx=0x7fec1800ef90 comp rx=0 tx=0).stop 2024-08-20T05:10:08.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.690+0000 7fec27400640 1 -- 172.21.15.37:0/1409402449 shutdown_connections 2024-08-20T05:10:08.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.690+0000 7fec27400640 1 --2- 172.21.15.37:0/1409402449 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fec040b3c20 0x7fec040b60e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.690+0000 7fec27400640 1 --2- 172.21.15.37:0/1409402449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec2010ce00 0x7fec2019e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.690+0000 7fec27400640 1 --2- 172.21.15.37:0/1409402449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fec201042c0 0x7fec20199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.690+0000 7fec27400640 1 --2- 172.21.15.37:0/1409402449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fec201039a0 0x7fec20199040 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:08.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.690+0000 7fec27400640 1 -- 172.21.15.37:0/1409402449 >> 172.21.15.37:0/1409402449 conn(0x7fec200fd400 msgr2=0x7fec200fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:08.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.691+0000 7fec27400640 1 -- 172.21.15.37:0/1409402449 shutdown_connections 2024-08-20T05:10:08.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:08.691+0000 7fec27400640 1 -- 172.21.15.37:0/1409402449 wait complete. 2024-08-20T05:10:09.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:09 smithi037 ceph-mon[17265]: pgmap v638: 129 pgs: 129 active+clean; 1.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 520 op/s 2024-08-20T05:10:09.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:09 smithi130 ceph-mon[22007]: pgmap v638: 129 pgs: 129 active+clean; 1.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 520 op/s 2024-08-20T05:10:09.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:09 smithi135 ceph-mon[22342]: pgmap v638: 129 pgs: 129 active+clean; 1.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 520 op/s 2024-08-20T05:10:11.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T05:10:11.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:11 smithi037 ceph-mon[17265]: pgmap v639: 129 pgs: 129 active+clean; 1.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 557 op/s 2024-08-20T05:10:11.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:11 smithi135 ceph-mon[22342]: pgmap v639: 129 pgs: 129 active+clean; 1.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 557 op/s 2024-08-20T05:10:11.922 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:10:11.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:11 smithi130 ceph-mon[22007]: pgmap v639: 129 pgs: 129 active+clean; 1.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 557 op/s 2024-08-20T05:10:12.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:12 smithi037 ceph-mon[17265]: pgmap v640: 129 pgs: 129 active+clean; 1.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 MiB/s wr, 584 op/s 2024-08-20T05:10:12.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:12 smithi135 ceph-mon[22342]: pgmap v640: 129 pgs: 129 active+clean; 1.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 MiB/s wr, 584 op/s 2024-08-20T05:10:12.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:12 smithi130 ceph-mon[22007]: pgmap v640: 129 pgs: 129 active+clean; 1.4 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.9 MiB/s wr, 584 op/s 2024-08-20T05:10:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 435.0 s, 573.0 tps, lat 148.855 ms stddev 174.211 2024-08-20T05:10:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.828+0000 7f69bfe00640 1 -- 172.21.15.37:0/2462131212 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69b8075210 msgr2=0x7f69b80755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.828+0000 7f69bfe00640 1 --2- 172.21.15.37:0/2462131212 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69b8075210 0x7f69b80755f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f69a4009900 tx=0x7f69a402a400 comp rx=0 tx=0).stop 2024-08-20T05:10:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.829+0000 7f69bfe00640 1 -- 172.21.15.37:0/2462131212 shutdown_connections 2024-08-20T05:10:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.829+0000 7f69bfe00640 1 --2- 172.21.15.37:0/2462131212 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b810f0a0 0x7f69b8111490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.829+0000 7f69bfe00640 1 --2- 172.21.15.37:0/2462131212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b8075b30 0x7f69b810eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.829+0000 7f69bfe00640 1 --2- 172.21.15.37:0/2462131212 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69b8075210 0x7f69b80755f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.829+0000 7f69bfe00640 1 -- 172.21.15.37:0/2462131212 >> 172.21.15.37:0/2462131212 conn(0x7f69b80fe500 msgr2=0x7f69b8100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:13.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.829+0000 7f69bfe00640 1 -- 172.21.15.37:0/2462131212 shutdown_connections 2024-08-20T05:10:13.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.829+0000 7f69bfe00640 1 -- 172.21.15.37:0/2462131212 wait complete. 2024-08-20T05:10:13.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.831+0000 7f69bfe00640 1 Processor -- start 2024-08-20T05:10:13.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.834+0000 7f69bfe00640 1 -- start start 2024-08-20T05:10:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.834+0000 7f69bfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69b8075210 0x7f69b8102810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.834+0000 7f69bfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b8075b30 0x7f69b8102d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.834+0000 7f69bfe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b810f0a0 0x7f69b8103290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.834+0000 7f69bfe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69b8114cd0 con 0x7f69b8075b30 2024-08-20T05:10:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.835+0000 7f69bfe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f69b8114b50 con 0x7f69b8075210 2024-08-20T05:10:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.835+0000 7f69bfe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f69b8114e50 con 0x7f69b810f0a0 2024-08-20T05:10:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.835+0000 7f69bde00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b810f0a0 0x7f69b8103290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.835+0000 7f69bde00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b810f0a0 0x7f69b8103290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:54952/0 (socket says 172.21.15.37:54952) 2024-08-20T05:10:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.835+0000 7f69bde00640 1 -- 172.21.15.37:0/2997087943 learned_addr learned my addr 172.21.15.37:0/2997087943 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.836+0000 7f69bde00640 1 -- 172.21.15.37:0/2997087943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69b8075210 msgr2=0x7f69b8102810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T05:10:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.836+0000 7f69bde00640 1 --2- 172.21.15.37:0/2997087943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69b8075210 0x7f69b8102810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.836+0000 7f69bca00640 1 --2- 172.21.15.37:0/2997087943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b8075b30 0x7f69b8102d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.836+0000 7f69bde00640 1 -- 172.21.15.37:0/2997087943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b8075b30 msgr2=0x7f69b8102d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.836+0000 7f69bde00640 1 --2- 172.21.15.37:0/2997087943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b8075b30 0x7f69b8102d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.836+0000 7f69bde00640 1 -- 172.21.15.37:0/2997087943 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69b80736b0 con 0x7f69b810f0a0 2024-08-20T05:10:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.836+0000 7f69bde00640 1 --2- 172.21.15.37:0/2997087943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b810f0a0 0x7f69b8103290 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f69b000eb40 tx=0x7f69b000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.836+0000 7f69b6000640 1 -- 172.21.15.37:0/2997087943 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b0004b20 con 0x7f69b810f0a0 2024-08-20T05:10:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.836+0000 7f69b6000640 1 -- 172.21.15.37:0/2997087943 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69b0004cc0 con 0x7f69b810f0a0 2024-08-20T05:10:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.836+0000 7f69b6000640 1 -- 172.21.15.37:0/2997087943 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b0010720 con 0x7f69b810f0a0 2024-08-20T05:10:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.836+0000 7f69bfe00640 1 -- 172.21.15.37:0/2997087943 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69b80739a0 con 0x7f69b810f0a0 2024-08-20T05:10:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.837+0000 7f69bfe00640 1 -- 172.21.15.37:0/2997087943 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69b8073e90 con 0x7f69b810f0a0 2024-08-20T05:10:13.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.843+0000 7f69b6000640 1 -- 172.21.15.37:0/2997087943 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f69b0005560 con 0x7f69b810f0a0 2024-08-20T05:10:13.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.843+0000 7f69c2829740 1 Processor -- start 2024-08-20T05:10:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.844+0000 7f69c2829740 1 -- start start 2024-08-20T05:10:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.844+0000 7f69c2829740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb962940 0x55c4bb962d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.844+0000 7f69c2829740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb963260 0x55c4bb96ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.844+0000 7f69c2829740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb96f1f0 0x55c4bb9715e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.844+0000 7f69c2829740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c4bb8d8aa0 con 0x55c4bb963260 2024-08-20T05:10:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.844+0000 7f69c2829740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c4bb8c7fa0 con 0x55c4bb962940 2024-08-20T05:10:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.844+0000 7f69c2829740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c4bb8cbfe0 con 0x55c4bb96f1f0 2024-08-20T05:10:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.845+0000 7f69bca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb962940 0x55c4bb962d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.845+0000 7f69bca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb962940 0x55c4bb962d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33426/0 (socket says 172.21.15.37:33426) 2024-08-20T05:10:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.845+0000 7f69bca00640 1 -- 172.21.15.37:0/1597032701 learned_addr learned my addr 172.21.15.37:0/1597032701 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.845+0000 7f69bca00640 1 --2- 172.21.15.37:0/1597032701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb96f1f0 0x55c4bb9715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:13.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.846+0000 7f69b6000640 1 --2- 172.21.15.37:0/2997087943 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f69a00b3da0 0x7f69a00b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.846+0000 7f69bd400640 1 --2- 172.21.15.37:0/1597032701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb963260 0x55c4bb96ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:13.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.846+0000 7f69b6000640 1 -- 172.21.15.37:0/2997087943 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f69b00e47c0 con 0x7f69b810f0a0 2024-08-20T05:10:13.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.846+0000 7f69bca00640 1 -- 172.21.15.37:0/1597032701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb96f1f0 msgr2=0x55c4bb9715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:13.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.846+0000 7f69bca00640 1 --2- 172.21.15.37:0/1597032701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb96f1f0 0x55c4bb9715e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.846+0000 7f69bca00640 1 -- 172.21.15.37:0/1597032701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb963260 msgr2=0x55c4bb96ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.846+0000 7f69bca00640 1 --2- 172.21.15.37:0/1597032701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb963260 0x55c4bb96ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.846+0000 7f69bca00640 1 -- 172.21.15.37:0/1597032701 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4bb86e420 con 0x55c4bb962940 2024-08-20T05:10:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.847+0000 7f69bd400640 1 --2- 172.21.15.37:0/1597032701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb963260 0x55c4bb96ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:10:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.847+0000 7f69bde00640 1 --2- 172.21.15.37:0/2997087943 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f69a00b3da0 0x7f69a00b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.847+0000 7f69bca00640 1 --2- 172.21.15.37:0/1597032701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb962940 0x55c4bb962d20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f69ac015850 tx=0x7f69ac009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c5fe779072c9534 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.848+0000 7f69aa600640 1 -- 172.21.15.37:0/1597032701 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac0152f0 con 0x55c4bb962940 2024-08-20T05:10:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.849+0000 7f69aa600640 1 -- 172.21.15.37:0/1597032701 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69ac005020 con 0x55c4bb962940 2024-08-20T05:10:13.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.849+0000 7f69aa600640 1 -- 172.21.15.37:0/1597032701 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac004a00 con 0x55c4bb962940 2024-08-20T05:10:13.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.850+0000 7f69c2829740 1 -- 172.21.15.37:0/1597032701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb962940 msgr2=0x55c4bb962d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:13.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.850+0000 7f69c2829740 1 --2- 172.21.15.37:0/1597032701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb962940 0x55c4bb962d20 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f69ac015850 tx=0x7f69ac009f90 comp rx=0 tx=0).stop 2024-08-20T05:10:13.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.850+0000 7f69bde00640 1 --2- 172.21.15.37:0/2997087943 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f69a00b3da0 0x7f69a00b6260 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f69b001a040 tx=0x7f69b00e4a10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.851+0000 7f69c2829740 1 -- 172.21.15.37:0/1597032701 shutdown_connections 2024-08-20T05:10:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.851+0000 7f69c2829740 1 --2- 172.21.15.37:0/1597032701 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb96f1f0 0x55c4bb9715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.851+0000 7f69c2829740 1 --2- 172.21.15.37:0/1597032701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb963260 0x55c4bb96ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.851+0000 7f69c2829740 1 --2- 172.21.15.37:0/1597032701 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb962940 0x55c4bb962d20 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.851+0000 7f69c2829740 1 -- 172.21.15.37:0/1597032701 >> 172.21.15.37:0/1597032701 conn(0x55c4bb960770 msgr2=0x55c4bb961910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:13.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.853+0000 7f69c2829740 1 -- 172.21.15.37:0/1597032701 shutdown_connections 2024-08-20T05:10:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.853+0000 7f69c2829740 1 -- 172.21.15.37:0/1597032701 wait complete. 2024-08-20T05:10:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.854+0000 7f69c2829740 1 -- start start 2024-08-20T05:10:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.854+0000 7f69c2829740 1 Processor -- start 2024-08-20T05:10:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.855+0000 7f69c2829740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb962940 0x55c4bb96e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.855+0000 7f69c2829740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb963260 0x55c4bb96be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.855+0000 7f69c2829740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb96f1f0 0x55c4bb96c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.855+0000 7f69c2829740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c4bb72a700 con 0x55c4bb962940 2024-08-20T05:10:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.855+0000 7f69c2829740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c4bb863290 con 0x55c4bb96f1f0 2024-08-20T05:10:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.855+0000 7f69c2829740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c4bb971e10 con 0x55c4bb963260 2024-08-20T05:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.855+0000 7f69c2829740 10 client.0 _ll_register_callbacks cb 0x55c4bb8c21c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.855+0000 7f69bd400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb963260 0x55c4bb96be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.855+0000 7f69bd400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb963260 0x55c4bb96be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:54978/0 (socket says 172.21.15.37:54978) 2024-08-20T05:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.855+0000 7f69bd400640 1 -- 172.21.15.37:0/2708039876 learned_addr learned my addr 172.21.15.37:0/2708039876 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.856+0000 7f69bd400640 1 -- 172.21.15.37:0/2708039876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb96f1f0 msgr2=0x55c4bb96c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.856+0000 7f69bca00640 1 --2- 172.21.15.37:0/2708039876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb96f1f0 0x55c4bb96c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.856+0000 7f69bd400640 1 --2- 172.21.15.37:0/2708039876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb96f1f0 0x55c4bb96c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.856+0000 7f69bd400640 1 -- 172.21.15.37:0/2708039876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb962940 msgr2=0x55c4bb96e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.856+0000 7f69bd400640 1 --2- 172.21.15.37:0/2708039876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb962940 0x55c4bb96e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.856+0000 7f69bd400640 1 -- 172.21.15.37:0/2708039876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4bb627650 con 0x55c4bb963260 2024-08-20T05:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.857+0000 7f69bd400640 1 --2- 172.21.15.37:0/2708039876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb963260 0x55c4bb96be00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f69a4031440 tx=0x7f69a40042e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55f9ac7f9d75cfa server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.858+0000 7f699ea00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.858+0000 7f699ea00640 1 -- 172.21.15.37:0/2708039876 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a403f070 con 0x55c4bb963260 2024-08-20T05:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.858+0000 7f699ea00640 1 -- 172.21.15.37:0/2708039876 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f69a4005240 con 0x55c4bb963260 2024-08-20T05:10:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.858+0000 7f69c2829740 1 -- 172.21.15.37:0/2708039876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69ac005020 con 0x55c4bb963260 2024-08-20T05:10:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.859+0000 7f699ea00640 1 -- 172.21.15.37:0/2708039876 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f69a4049050 con 0x55c4bb963260 2024-08-20T05:10:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.859+0000 7f69c2829740 10 client.27523 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.859+0000 7f69c2829740 1 -- 172.21.15.37:0/2708039876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55c4bb97d5c0 con 0x55c4bb963260 2024-08-20T05:10:13.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.860+0000 7f699ea00640 1 -- 172.21.15.37:0/2708039876 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69ac005020 con 0x55c4bb963260 2024-08-20T05:10:13.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.860+0000 7f699ea00640 1 -- 172.21.15.37:0/2708039876 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f69a4003710 con 0x55c4bb963260 2024-08-20T05:10:13.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.860+0000 7f69c2829740 10 client.27523 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:13.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.860+0000 7f69c2829740 10 client.27523 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:10:13.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.860+0000 7f69c2829740 20 client.27523 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:13.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.860+0000 7f69c2829740 1 --2- 172.21.15.37:0/2708039876 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55c4bb97eac0 0x55c4bb980f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.860+0000 7f69c2829740 4 client.27523 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:10:13.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.860+0000 7f69c2829740 1 -- 172.21.15.37:0/2708039876 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4bb8da9f0 con 0x55c4bb97eac0 2024-08-20T05:10:13.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.863+0000 7f69bca00640 1 --2- 172.21.15.37:0/2708039876 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55c4bb97eac0 0x55c4bb980f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:13.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.864+0000 7f69bca00640 1 --2- 172.21.15.37:0/2708039876 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55c4bb97eac0 0x55c4bb980f30 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4db0282f997d4284 server_cookie=908014804f860e69 in_seq=0 out_seq=0 2024-08-20T05:10:13.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.864+0000 7f699ea00640 10 client.27523 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:10:13.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.865+0000 7f699ea00640 1 -- 172.21.15.37:0/2708039876 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c4bb8da9f0 con 0x55c4bb97eac0 2024-08-20T05:10:13.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.865+0000 7f699ea00640 10 client.27523 handle_command_reply: tid=0 2024-08-20T05:10:13.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.867+0000 7f69c2829740 1 client.27523 shutdown 2024-08-20T05:10:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.868+0000 7f69c2829740 1 -- 172.21.15.37:0/2708039876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb963260 msgr2=0x55c4bb96be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.868+0000 7f69c2829740 1 --2- 172.21.15.37:0/2708039876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb963260 0x55c4bb96be00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f69a4031440 tx=0x7f69a40042e0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.869+0000 7f69c2829740 1 -- 172.21.15.37:0/2708039876 shutdown_connections 2024-08-20T05:10:13.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.869+0000 7f69c2829740 1 --2- 172.21.15.37:0/2708039876 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55c4bb97eac0 0x55c4bb980f30 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.869+0000 7f69c2829740 1 --2- 172.21.15.37:0/2708039876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb96f1f0 0x55c4bb96c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.869+0000 7f69c2829740 1 --2- 172.21.15.37:0/2708039876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb963260 0x55c4bb96be00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.869+0000 7f69c2829740 1 --2- 172.21.15.37:0/2708039876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb962940 0x55c4bb96e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.869+0000 7f69c2829740 1 -- 172.21.15.37:0/2708039876 >> 172.21.15.37:0/2708039876 conn(0x55c4bb960770 msgr2=0x55c4bb966310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:13.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.869+0000 7f699ea00640 0 client.27523 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:10:13.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.869+0000 7f69c2829740 1 -- 172.21.15.37:0/2708039876 shutdown_connections 2024-08-20T05:10:13.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.870+0000 7f69c2829740 1 -- 172.21.15.37:0/2708039876 wait complete. 2024-08-20T05:10:13.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.870+0000 7f69c2829740 20 client.27523 trim_cache size 0 max 16384 2024-08-20T05:10:13.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.895+0000 7f69c2829740 1 Processor -- start 2024-08-20T05:10:13.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.895+0000 7f69c2829740 1 -- start start 2024-08-20T05:10:13.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.896+0000 7f69c2829740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb962940 0x55c4bb97af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.896+0000 7f69c2829740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb963260 0x55c4bb986840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.896+0000 7f69c2829740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb96f1f0 0x55c4bb986d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.896+0000 7f69c2829740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69b81c6d30 con 0x55c4bb96f1f0 2024-08-20T05:10:13.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.896+0000 7f69c2829740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f69b81c8990 con 0x55c4bb962940 2024-08-20T05:10:13.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.896+0000 7f69c2829740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f69b81c7400 con 0x55c4bb963260 2024-08-20T05:10:13.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.897+0000 7f69bd400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb963260 0x55c4bb986840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:13.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.897+0000 7f69bd400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb963260 0x55c4bb986840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:54984/0 (socket says 172.21.15.37:54984) 2024-08-20T05:10:13.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.897+0000 7f69bd400640 1 -- 172.21.15.37:0/3148049128 learned_addr learned my addr 172.21.15.37:0/3148049128 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:13.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.897+0000 7f69bd400640 1 -- 172.21.15.37:0/3148049128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb962940 msgr2=0x55c4bb97af60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:10:13.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.897+0000 7f69bd400640 1 --2- 172.21.15.37:0/3148049128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb962940 0x55c4bb97af60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.897+0000 7f69bd400640 1 -- 172.21.15.37:0/3148049128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb96f1f0 msgr2=0x55c4bb986d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:13.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.897+0000 7f69bd400640 1 --2- 172.21.15.37:0/3148049128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb96f1f0 0x55c4bb986d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.897+0000 7f69bd400640 1 -- 172.21.15.37:0/3148049128 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4bb95bef0 con 0x55c4bb963260 2024-08-20T05:10:13.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.898+0000 7f69bd400640 1 --2- 172.21.15.37:0/3148049128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb963260 0x55c4bb986840 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f69a4001eb0 tx=0x7f69a402a400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54cf8e36b9ca35a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:13.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.898+0000 7f69a9c00640 1 -- 172.21.15.37:0/3148049128 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a403f040 con 0x55c4bb963260 2024-08-20T05:10:13.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.898+0000 7f69a9c00640 1 -- 172.21.15.37:0/3148049128 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69a40037f0 con 0x55c4bb963260 2024-08-20T05:10:13.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.898+0000 7f69a9c00640 1 -- 172.21.15.37:0/3148049128 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a4035030 con 0x55c4bb963260 2024-08-20T05:10:13.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.900+0000 7f69c2829740 1 -- 172.21.15.37:0/3148049128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb963260 msgr2=0x55c4bb986840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:13.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.900+0000 7f69c2829740 1 --2- 172.21.15.37:0/3148049128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb963260 0x55c4bb986840 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f69a4001eb0 tx=0x7f69a402a400 comp rx=0 tx=0).stop 2024-08-20T05:10:13.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.900+0000 7f69c2829740 1 -- 172.21.15.37:0/3148049128 shutdown_connections 2024-08-20T05:10:13.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.900+0000 7f69c2829740 1 --2- 172.21.15.37:0/3148049128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb96f1f0 0x55c4bb986d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.900+0000 7f69c2829740 1 --2- 172.21.15.37:0/3148049128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb963260 0x55c4bb986840 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.900+0000 7f69c2829740 1 --2- 172.21.15.37:0/3148049128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb962940 0x55c4bb97af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.900+0000 7f69c2829740 1 -- 172.21.15.37:0/3148049128 >> 172.21.15.37:0/3148049128 conn(0x55c4bb960770 msgr2=0x55c4bb96dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:13.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.901+0000 7f69c2829740 1 -- 172.21.15.37:0/3148049128 shutdown_connections 2024-08-20T05:10:13.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.901+0000 7f69c2829740 1 -- 172.21.15.37:0/3148049128 wait complete. 2024-08-20T05:10:13.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.901+0000 7f69c2829740 1 -- start start 2024-08-20T05:10:13.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.902+0000 7f69c2829740 1 Processor -- start 2024-08-20T05:10:13.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.903+0000 7f69c2829740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb962940 0x55c4bb972880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.903+0000 7f69c2829740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb963260 0x55c4bb972dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.903+0000 7f69c2829740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb96f1f0 0x55c4bb9e7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.903+0000 7f69c2829740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69b81c8200 con 0x55c4bb963260 2024-08-20T05:10:13.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.903+0000 7f69c2829740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f69b81c7ad0 con 0x55c4bb96f1f0 2024-08-20T05:10:13.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.903+0000 7f69c2829740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f69b81b1ce0 con 0x55c4bb962940 2024-08-20T05:10:13.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.903+0000 7f69c2829740 10 client.0 _ll_register_callbacks cb 0x7f69ac005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:13.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.904+0000 7f69bca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb962940 0x55c4bb972880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:13.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.904+0000 7f69bd400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb963260 0x55c4bb972dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:13.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.904+0000 7f69bca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb962940 0x55c4bb972880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:55000/0 (socket says 172.21.15.37:55000) 2024-08-20T05:10:13.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.904+0000 7f69bca00640 1 -- 172.21.15.37:0/3596499925 learned_addr learned my addr 172.21.15.37:0/3596499925 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:13.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.904+0000 7f69bca00640 1 --2- 172.21.15.37:0/3596499925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb96f1f0 0x55c4bb9e7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:13.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.905+0000 7f69bca00640 1 -- 172.21.15.37:0/3596499925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb96f1f0 msgr2=0x55c4bb9e7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:13.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.905+0000 7f69bca00640 1 --2- 172.21.15.37:0/3596499925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb96f1f0 0x55c4bb9e7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.905+0000 7f69bca00640 1 -- 172.21.15.37:0/3596499925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb963260 msgr2=0x55c4bb972dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.905+0000 7f69bca00640 1 --2- 172.21.15.37:0/3596499925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb963260 0x55c4bb972dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.905+0000 7f69bca00640 1 -- 172.21.15.37:0/3596499925 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4bb9e7e70 con 0x55c4bb962940 2024-08-20T05:10:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.906+0000 7f69bd400640 1 --2- 172.21.15.37:0/3596499925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb963260 0x55c4bb972dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:10:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.906+0000 7f69bca00640 1 --2- 172.21.15.37:0/3596499925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb962940 0x55c4bb972880 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f69ac0157f0 tx=0x7f69ac0093f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=693e0f8eade81ee3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:13.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.906+0000 7f699ea00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:10:13.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.908+0000 7f699ea00640 1 -- 172.21.15.37:0/3596499925 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ac004220 con 0x55c4bb962940 2024-08-20T05:10:13.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.908+0000 7f699ea00640 1 -- 172.21.15.37:0/3596499925 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f69ac0043c0 con 0x55c4bb962940 2024-08-20T05:10:13.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.908+0000 7f69c2829740 1 -- 172.21.15.37:0/3596499925 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69a40037f0 con 0x55c4bb962940 2024-08-20T05:10:13.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.908+0000 7f699ea00640 1 -- 172.21.15.37:0/3596499925 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f69ac0152c0 con 0x55c4bb962940 2024-08-20T05:10:13.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.908+0000 7f69c2829740 10 client.27529 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:13.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.908+0000 7f69c2829740 1 -- 172.21.15.37:0/3596499925 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55c4bb9e9150 con 0x55c4bb962940 2024-08-20T05:10:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.911+0000 7f699ea00640 1 -- 172.21.15.37:0/3596499925 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69a40037f0 con 0x55c4bb962940 2024-08-20T05:10:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.911+0000 7f699ea00640 1 -- 172.21.15.37:0/3596499925 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f69ac01f040 con 0x55c4bb962940 2024-08-20T05:10:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.911+0000 7f69c2829740 10 client.27529 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.911+0000 7f69c2829740 10 client.27529 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:10:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.911+0000 7f69c2829740 20 client.27529 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.911+0000 7f69c2829740 1 --2- 172.21.15.37:0/3596499925 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55c4bb9e9600 0x55c4bb9eba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.912+0000 7f69c2829740 4 client.27529 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:10:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.912+0000 7f69c2829740 1 -- 172.21.15.37:0/3596499925 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c4bb8d6490 con 0x55c4bb9e9600 2024-08-20T05:10:13.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.912+0000 7f69bd400640 1 --2- 172.21.15.37:0/3596499925 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55c4bb9e9600 0x55c4bb9eba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:13.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.914+0000 7f69bd400640 1 --2- 172.21.15.37:0/3596499925 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55c4bb9e9600 0x55c4bb9eba20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b6ac298ae708ebbf server_cookie=21e57d853b91fd83 in_seq=0 out_seq=0 2024-08-20T05:10:13.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.914+0000 7f699ea00640 10 client.27529 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:10:13.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.914+0000 7f699ea00640 1 -- 172.21.15.37:0/3596499925 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c4bb8d6490 con 0x55c4bb9e9600 2024-08-20T05:10:13.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.914+0000 7f699ea00640 10 client.27529 handle_command_reply: tid=0 2024-08-20T05:10:13.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.914+0000 7f69c2829740 1 client.27529 shutdown 2024-08-20T05:10:13.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.914+0000 7f69c2829740 1 -- 172.21.15.37:0/3596499925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb962940 msgr2=0x55c4bb972880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:13.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.914+0000 7f69c2829740 1 --2- 172.21.15.37:0/3596499925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb962940 0x55c4bb972880 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f69ac0157f0 tx=0x7f69ac0093f0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.915+0000 7f69c2829740 1 -- 172.21.15.37:0/3596499925 shutdown_connections 2024-08-20T05:10:13.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.915+0000 7f69c2829740 1 --2- 172.21.15.37:0/3596499925 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55c4bb9e9600 0x55c4bb9eba20 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.915+0000 7f69c2829740 1 --2- 172.21.15.37:0/3596499925 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4bb96f1f0 0x55c4bb9e7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.915+0000 7f69c2829740 1 --2- 172.21.15.37:0/3596499925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4bb963260 0x55c4bb972dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.915+0000 7f69c2829740 1 --2- 172.21.15.37:0/3596499925 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4bb962940 0x55c4bb972880 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.915+0000 7f69c2829740 1 -- 172.21.15.37:0/3596499925 >> 172.21.15.37:0/3596499925 conn(0x55c4bb960770 msgr2=0x55c4bb95f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:13.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.915+0000 7f699ea00640 0 client.27529 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:10:13.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.916+0000 7f69c2829740 1 -- 172.21.15.37:0/3596499925 shutdown_connections 2024-08-20T05:10:13.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.916+0000 7f69c2829740 1 -- 172.21.15.37:0/3596499925 wait complete. 2024-08-20T05:10:13.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.916+0000 7f69c2829740 20 client.27529 trim_cache size 0 max 16384 2024-08-20T05:10:13.918 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:10:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.918+0000 7f69bfe00640 1 -- 172.21.15.37:0/2997087943 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f69a00b3da0 msgr2=0x7f69a00b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.918+0000 7f69bfe00640 1 --2- 172.21.15.37:0/2997087943 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f69a00b3da0 0x7f69a00b6260 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f69b001a040 tx=0x7f69b00e4a10 comp rx=0 tx=0).stop 2024-08-20T05:10:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.918+0000 7f69bfe00640 1 -- 172.21.15.37:0/2997087943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b810f0a0 msgr2=0x7f69b8103290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.918+0000 7f69bfe00640 1 --2- 172.21.15.37:0/2997087943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b810f0a0 0x7f69b8103290 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f69b000eb40 tx=0x7f69b000c2d0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.918+0000 7f69bfe00640 1 -- 172.21.15.37:0/2997087943 shutdown_connections 2024-08-20T05:10:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.918+0000 7f69bfe00640 1 --2- 172.21.15.37:0/2997087943 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f69a00b3da0 0x7f69a00b6260 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.918+0000 7f69bfe00640 1 --2- 172.21.15.37:0/2997087943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69b810f0a0 0x7f69b8103290 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.918+0000 7f69bfe00640 1 --2- 172.21.15.37:0/2997087943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69b8075b30 0x7f69b8102d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.918+0000 7f69bfe00640 1 --2- 172.21.15.37:0/2997087943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69b8075210 0x7f69b8102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:13.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.918+0000 7f69bfe00640 1 -- 172.21.15.37:0/2997087943 >> 172.21.15.37:0/2997087943 conn(0x7f69b80fe500 msgr2=0x7f69b8111260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:13.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.919+0000 7f69bfe00640 1 -- 172.21.15.37:0/2997087943 shutdown_connections 2024-08-20T05:10:13.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:13.919+0000 7f69bfe00640 1 -- 172.21.15.37:0/2997087943 wait complete. 2024-08-20T05:10:15.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:15 smithi135 ceph-mon[22342]: pgmap v641: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 810 op/s 2024-08-20T05:10:15.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:15 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:10:15.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:15 smithi130 ceph-mon[22007]: pgmap v641: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 810 op/s 2024-08-20T05:10:15.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:15 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:10:15.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:15 smithi037 ceph-mon[17265]: pgmap v641: 129 pgs: 129 active+clean; 1.4 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 12 MiB/s wr, 810 op/s 2024-08-20T05:10:15.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:15 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:10:17.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:17 smithi135 ceph-mon[22342]: pgmap v642: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 1.24k op/s 2024-08-20T05:10:17.689 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:17 smithi037 ceph-mon[17265]: pgmap v642: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 1.24k op/s 2024-08-20T05:10:17.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:17 smithi130 ceph-mon[22007]: pgmap v642: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 1.24k op/s 2024-08-20T05:10:17.892 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T05:10:18.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 440.0 s, 442.2 tps, lat 257.203 ms stddev 491.655 2024-08-20T05:10:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.157+0000 7f00d9800640 1 -- 172.21.15.37:0/3122924447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d4073fa0 msgr2=0x7f00d40743a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:18.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.157+0000 7f00d9800640 1 --2- 172.21.15.37:0/3122924447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d4073fa0 0x7f00d40743a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f00c4009900 tx=0x7f00c402a410 comp rx=0 tx=0).stop 2024-08-20T05:10:18.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.158+0000 7f00d9800640 1 -- 172.21.15.37:0/3122924447 shutdown_connections 2024-08-20T05:10:18.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.158+0000 7f00d9800640 1 --2- 172.21.15.37:0/3122924447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d410a840 0x7f00d41131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.158+0000 7f00d9800640 1 --2- 172.21.15.37:0/3122924447 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d4109e80 0x7f00d410a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.158+0000 7f00d9800640 1 --2- 172.21.15.37:0/3122924447 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d4073fa0 0x7f00d40743a0 secure :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f00c4009900 tx=0x7f00c402a410 comp rx=0 tx=0).stop 2024-08-20T05:10:18.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.158+0000 7f00d9800640 1 -- 172.21.15.37:0/3122924447 >> 172.21.15.37:0/3122924447 conn(0x7f00d406f550 msgr2=0x7f00d4071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:18.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.159+0000 7f00d9800640 1 -- 172.21.15.37:0/3122924447 shutdown_connections 2024-08-20T05:10:18.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.159+0000 7f00d9800640 1 -- 172.21.15.37:0/3122924447 wait complete. 2024-08-20T05:10:18.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.160+0000 7f00d9800640 1 Processor -- start 2024-08-20T05:10:18.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.160+0000 7f00d9800640 1 -- start start 2024-08-20T05:10:18.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.161+0000 7f00d9800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d4109e80 0x7f00d41a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.161+0000 7f00d9800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d410a840 0x7f00d41a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.161+0000 7f00d9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d41a2590 0x7f00d41a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.161+0000 7f00d3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d4109e80 0x7f00d41a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.161+0000 7f00d3400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d410a840 0x7f00d41a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.161+0000 7f00d3400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d410a840 0x7f00d41a1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33460/0 (socket says 172.21.15.37:33460) 2024-08-20T05:10:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.161+0000 7f00d9800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f00d4116980 con 0x7f00d41a2590 2024-08-20T05:10:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.161+0000 7f00d9800640 1 -- 172.21.15.37:0/3028226288 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f00d4116800 con 0x7f00d410a840 2024-08-20T05:10:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.161+0000 7f00d3400640 1 -- 172.21.15.37:0/3028226288 learned_addr learned my addr 172.21.15.37:0/3028226288 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.161+0000 7f00d9800640 1 -- 172.21.15.37:0/3028226288 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f00d4116b00 con 0x7f00d4109e80 2024-08-20T05:10:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.162+0000 7f00d3400640 1 -- 172.21.15.37:0/3028226288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d4109e80 msgr2=0x7f00d41a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.162+0000 7f00d8e00640 1 --2- 172.21.15.37:0/3028226288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d41a2590 0x7f00d41a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.162+0000 7f00d3400640 1 --2- 172.21.15.37:0/3028226288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d4109e80 0x7f00d41a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.162+0000 7f00d3400640 1 -- 172.21.15.37:0/3028226288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d41a2590 msgr2=0x7f00d41a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.162+0000 7f00d3400640 1 --2- 172.21.15.37:0/3028226288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d41a2590 0x7f00d41a2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.162+0000 7f00d3400640 1 -- 172.21.15.37:0/3028226288 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d41a3240 con 0x7f00d410a840 2024-08-20T05:10:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.163+0000 7f00d8e00640 1 --2- 172.21.15.37:0/3028226288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d41a2590 0x7f00d41a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:10:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.166+0000 7f00d3400640 1 --2- 172.21.15.37:0/3028226288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d410a840 0x7f00d41a1960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f00c000b450 tx=0x7f00c000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.166+0000 7f00d0c00640 1 -- 172.21.15.37:0/3028226288 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c0015020 con 0x7f00d410a840 2024-08-20T05:10:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.166+0000 7f00d0c00640 1 -- 172.21.15.37:0/3028226288 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00c0011d40 con 0x7f00d410a840 2024-08-20T05:10:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.166+0000 7f00d0c00640 1 -- 172.21.15.37:0/3028226288 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c000f340 con 0x7f00d410a840 2024-08-20T05:10:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.166+0000 7f00d9800640 1 -- 172.21.15.37:0/3028226288 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d41a9630 con 0x7f00d410a840 2024-08-20T05:10:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.167+0000 7f00d9800640 1 -- 172.21.15.37:0/3028226288 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d410b240 con 0x7f00d410a840 2024-08-20T05:10:18.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.174+0000 7f00dddf6740 1 Processor -- start 2024-08-20T05:10:18.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.178+0000 7f00dddf6740 1 -- start start 2024-08-20T05:10:18.180 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.178+0000 7f00d0c00640 1 -- 172.21.15.37:0/3028226288 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f00c0018020 con 0x7f00d410a840 2024-08-20T05:10:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.178+0000 7f00dddf6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be34b0 0x563840be58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.178+0000 7f00dddf6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840be5de0 0x563840be81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.178+0000 7f00dddf6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be8820 0x563840beace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.178+0000 7f00dddf6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563840b56210 con 0x563840be34b0 2024-08-20T05:10:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.178+0000 7f00dddf6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563840b45710 con 0x563840be8820 2024-08-20T05:10:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.178+0000 7f00dddf6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563840b49750 con 0x563840be5de0 2024-08-20T05:10:18.181 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.179+0000 7f00d8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be34b0 0x563840be58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:18.182 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.179+0000 7f00d8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be34b0 0x563840be58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44210/0 (socket says 172.21.15.37:44210) 2024-08-20T05:10:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.179+0000 7f00d8e00640 1 -- 172.21.15.37:0/1150985264 learned_addr learned my addr 172.21.15.37:0/1150985264 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.179+0000 7f00d8e00640 1 -- 172.21.15.37:0/1150985264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840be5de0 msgr2=0x563840be81d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:10:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.179+0000 7f00d8e00640 1 --2- 172.21.15.37:0/1150985264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840be5de0 0x563840be81d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.179+0000 7f00d8e00640 1 -- 172.21.15.37:0/1150985264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be8820 msgr2=0x563840beace0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:10:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.179+0000 7f00d8e00640 1 --2- 172.21.15.37:0/1150985264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be8820 0x563840beace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.179+0000 7f00d8e00640 1 -- 172.21.15.37:0/1150985264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563840b11de0 con 0x563840be34b0 2024-08-20T05:10:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.180+0000 7f00d8e00640 1 --2- 172.21.15.37:0/1150985264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be34b0 0x563840be58a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009f90 tx=0x7f00cc00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04170b94f9bf20c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.180+0000 7f00d0c00640 1 --2- 172.21.15.37:0/3028226288 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f00b80b3cd0 0x7f00b80b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.183 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.181+0000 7f00c9600640 1 -- 172.21.15.37:0/1150985264 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc003b70 con 0x563840be34b0 2024-08-20T05:10:18.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.181+0000 7f00d0c00640 1 -- 172.21.15.37:0/3028226288 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f00c00e3a70 con 0x7f00d410a840 2024-08-20T05:10:18.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.181+0000 7f00c9600640 1 -- 172.21.15.37:0/1150985264 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00cc003d10 con 0x563840be34b0 2024-08-20T05:10:18.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.181+0000 7f00c9600640 1 -- 172.21.15.37:0/1150985264 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0118f0 con 0x563840be34b0 2024-08-20T05:10:18.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.182+0000 7f00dddf6740 1 -- 172.21.15.37:0/1150985264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be34b0 msgr2=0x563840be58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:18.184 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.182+0000 7f00dddf6740 1 --2- 172.21.15.37:0/1150985264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be34b0 0x563840be58a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009f90 tx=0x7f00cc00f7f0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.182+0000 7f00dddf6740 1 -- 172.21.15.37:0/1150985264 shutdown_connections 2024-08-20T05:10:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.183+0000 7f00dddf6740 1 --2- 172.21.15.37:0/1150985264 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be8820 0x563840beace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.183+0000 7f00dddf6740 1 --2- 172.21.15.37:0/1150985264 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840be5de0 0x563840be81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.183+0000 7f00dddf6740 1 --2- 172.21.15.37:0/1150985264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be34b0 0x563840be58a0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.183+0000 7f00dddf6740 1 -- 172.21.15.37:0/1150985264 >> 172.21.15.37:0/1150985264 conn(0x563840bde600 msgr2=0x563840bdf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:18.185 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.183+0000 7f00d3e00640 1 --2- 172.21.15.37:0/3028226288 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f00b80b3cd0 0x7f00b80b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:18.187 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.186+0000 7f00d3e00640 1 --2- 172.21.15.37:0/3028226288 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f00b80b3cd0 0x7f00b80b6190 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f00c402aa00 tx=0x7f00c40314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:18.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.187+0000 7f00dddf6740 1 -- 172.21.15.37:0/1150985264 shutdown_connections 2024-08-20T05:10:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.187+0000 7f00dddf6740 1 -- 172.21.15.37:0/1150985264 wait complete. 2024-08-20T05:10:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.187+0000 7f00dddf6740 1 -- start start 2024-08-20T05:10:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.188+0000 7f00dddf6740 1 Processor -- start 2024-08-20T05:10:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.188+0000 7f00dddf6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840be34b0 0x563840bf56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.189+0000 7f00dddf6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be5de0 0x563840bf5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.189+0000 7f00dddf6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be8820 0x563840bf6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.189+0000 7f00dddf6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563840a7eab0 con 0x563840be8820 2024-08-20T05:10:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.189+0000 7f00dddf6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563840aec140 con 0x563840be5de0 2024-08-20T05:10:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.189+0000 7f00dddf6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563840beb800 con 0x563840be34b0 2024-08-20T05:10:18.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.189+0000 7f00dddf6740 10 client.0 _ll_register_callbacks cb 0x563840aff5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:18.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.189+0000 7f00d8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be8820 0x563840bf6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:18.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.189+0000 7f00d3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840be34b0 0x563840bf56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:18.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.189+0000 7f00d3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840be34b0 0x563840bf56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:55044/0 (socket says 172.21.15.37:55044) 2024-08-20T05:10:18.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.189+0000 7f00d3e00640 1 -- 172.21.15.37:0/1482627356 learned_addr learned my addr 172.21.15.37:0/1482627356 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:18.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.190+0000 7f00d3e00640 1 -- 172.21.15.37:0/1482627356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be5de0 msgr2=0x563840bf5d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:10:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.190+0000 7f00d3e00640 1 --2- 172.21.15.37:0/1482627356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be5de0 0x563840bf5d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.190+0000 7f00d3e00640 1 -- 172.21.15.37:0/1482627356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be8820 msgr2=0x563840bf6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.190+0000 7f00d3e00640 1 --2- 172.21.15.37:0/1482627356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be8820 0x563840bf6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.190+0000 7f00d3e00640 1 -- 172.21.15.37:0/1482627356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563840aed170 con 0x563840be34b0 2024-08-20T05:10:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.191+0000 7f00d3e00640 1 --2- 172.21.15.37:0/1482627356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840be34b0 0x563840bf56f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f00c4006010 tx=0x7f00c402a410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88d2ac23dafe44a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:18.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.191+0000 7f00be000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:10:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.191+0000 7f00be000640 1 -- 172.21.15.37:0/1482627356 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c404d070 con 0x563840be34b0 2024-08-20T05:10:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.192+0000 7f00be000640 1 -- 172.21.15.37:0/1482627356 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f00c4031ba0 con 0x563840be34b0 2024-08-20T05:10:18.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.192+0000 7f00dddf6740 1 -- 172.21.15.37:0/1482627356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563840b1ca30 con 0x563840be34b0 2024-08-20T05:10:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.193+0000 7f00be000640 1 -- 172.21.15.37:0/1482627356 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f00c4059050 con 0x563840be34b0 2024-08-20T05:10:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.193+0000 7f00dddf6740 10 client.27538 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:18.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.193+0000 7f00dddf6740 1 -- 172.21.15.37:0/1482627356 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5638408a8790 con 0x563840be34b0 2024-08-20T05:10:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.194+0000 7f00be000640 1 -- 172.21.15.37:0/1482627356 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563840b1ca30 con 0x563840be34b0 2024-08-20T05:10:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.194+0000 7f00be000640 1 -- 172.21.15.37:0/1482627356 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f00c4049550 con 0x563840be34b0 2024-08-20T05:10:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.194+0000 7f00dddf6740 10 client.27538 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.194+0000 7f00dddf6740 10 client.27538 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:10:18.196 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.194+0000 7f00dddf6740 20 client.27538 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.194+0000 7f00dddf6740 1 --2- 172.21.15.37:0/1482627356 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563840c01870 0x563840c03d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.194+0000 7f00dddf6740 4 client.27538 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:10:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.194+0000 7f00dddf6740 1 -- 172.21.15.37:0/1482627356 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563840b58160 con 0x563840c01870 2024-08-20T05:10:18.197 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.195+0000 7f00d3400640 1 --2- 172.21.15.37:0/1482627356 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563840c01870 0x563840c03d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.199+0000 7f00d3400640 1 --2- 172.21.15.37:0/1482627356 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563840c01870 0x563840c03d10 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b91a26ebe37ccf47 server_cookie=13b4dbd8bec7ed98 in_seq=0 out_seq=0 2024-08-20T05:10:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.199+0000 7f00be000640 10 client.27538 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:18.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.200+0000 7f00be000640 1 -- 172.21.15.37:0/1482627356 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563840b58160 con 0x563840c01870 2024-08-20T05:10:18.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.200+0000 7f00be000640 10 client.27538 handle_command_reply: tid=0 2024-08-20T05:10:18.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.200+0000 7f00dddf6740 1 client.27538 shutdown 2024-08-20T05:10:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.200+0000 7f00dddf6740 1 -- 172.21.15.37:0/1482627356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840be34b0 msgr2=0x563840bf56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.200+0000 7f00dddf6740 1 --2- 172.21.15.37:0/1482627356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840be34b0 0x563840bf56f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f00c4006010 tx=0x7f00c402a410 comp rx=0 tx=0).stop 2024-08-20T05:10:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.201+0000 7f00dddf6740 1 -- 172.21.15.37:0/1482627356 shutdown_connections 2024-08-20T05:10:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.201+0000 7f00dddf6740 1 --2- 172.21.15.37:0/1482627356 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563840c01870 0x563840c03d10 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.201+0000 7f00dddf6740 1 --2- 172.21.15.37:0/1482627356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be8820 0x563840bf6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.201+0000 7f00dddf6740 1 --2- 172.21.15.37:0/1482627356 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be5de0 0x563840bf5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.201+0000 7f00dddf6740 1 --2- 172.21.15.37:0/1482627356 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840be34b0 0x563840bf56f0 secure :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f00c4006010 tx=0x7f00c402a410 comp rx=0 tx=0).stop 2024-08-20T05:10:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.201+0000 7f00dddf6740 1 -- 172.21.15.37:0/1482627356 >> 172.21.15.37:0/1482627356 conn(0x563840bde600 msgr2=0x563840bdd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:18.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.201+0000 7f00be000640 0 client.27538 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:18.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.204+0000 7f00dddf6740 1 -- 172.21.15.37:0/1482627356 shutdown_connections 2024-08-20T05:10:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.205+0000 7f00dddf6740 1 -- 172.21.15.37:0/1482627356 wait complete. 2024-08-20T05:10:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.205+0000 7f00dddf6740 20 client.27538 trim_cache size 0 max 16384 2024-08-20T05:10:18.241 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.239+0000 7f00dddf6740 1 Processor -- start 2024-08-20T05:10:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.241+0000 7f00dddf6740 1 -- start start 2024-08-20T05:10:18.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.242+0000 7f00dddf6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be5de0 0x563840bdee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.242+0000 7f00dddf6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be8820 0x563840bdf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.242+0000 7f00d3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be5de0 0x563840bdee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.242+0000 7f00d3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be5de0 0x563840bdee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33488/0 (socket says 172.21.15.37:33488) 2024-08-20T05:10:18.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.242+0000 7f00d3e00640 1 -- 172.21.15.37:0/3632405032 learned_addr learned my addr 172.21.15.37:0/3632405032 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.243+0000 7f00dddf6740 1 --2- 172.21.15.37:0/3632405032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840beaab0 0x563840be8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.243+0000 7f00dddf6740 1 -- 172.21.15.37:0/3632405032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f00d41b1d30 con 0x563840be8820 2024-08-20T05:10:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.244+0000 7f00dddf6740 1 -- 172.21.15.37:0/3632405032 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f00d41b3990 con 0x563840be5de0 2024-08-20T05:10:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.244+0000 7f00dddf6740 1 -- 172.21.15.37:0/3632405032 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f00d41b2400 con 0x563840beaab0 2024-08-20T05:10:18.246 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.244+0000 7f00d3400640 1 --2- 172.21.15.37:0/3632405032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be8820 0x563840bdf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.245+0000 7f00d3e00640 1 -- 172.21.15.37:0/3632405032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840beaab0 msgr2=0x563840be8c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:10:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.245+0000 7f00d3e00640 1 --2- 172.21.15.37:0/3632405032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840beaab0 0x563840be8c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.245+0000 7f00d3e00640 1 -- 172.21.15.37:0/3632405032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be8820 msgr2=0x563840bdf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.245+0000 7f00d3e00640 1 --2- 172.21.15.37:0/3632405032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be8820 0x563840bdf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.247 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.245+0000 7f00d3e00640 1 -- 172.21.15.37:0/3632405032 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563840bf6cd0 con 0x563840be5de0 2024-08-20T05:10:18.249 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.247+0000 7f00d3400640 1 --2- 172.21.15.37:0/3632405032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be8820 0x563840bdf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:10:18.249 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.247+0000 7f00d3e00640 1 --2- 172.21.15.37:0/3632405032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be5de0 0x563840bdee60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f00c4049a90 tx=0x7f00c4049dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ed98cee3e0336ed server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:18.249 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.248+0000 7f00c8c00640 1 -- 172.21.15.37:0/3632405032 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4062070 con 0x563840be5de0 2024-08-20T05:10:18.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.248+0000 7f00c8c00640 1 -- 172.21.15.37:0/3632405032 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00c4031e50 con 0x563840be5de0 2024-08-20T05:10:18.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.248+0000 7f00c8c00640 1 -- 172.21.15.37:0/3632405032 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c4062070 con 0x563840be5de0 2024-08-20T05:10:18.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.249+0000 7f00dddf6740 1 -- 172.21.15.37:0/3632405032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be5de0 msgr2=0x563840bdee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:18.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.249+0000 7f00dddf6740 1 --2- 172.21.15.37:0/3632405032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be5de0 0x563840bdee60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f00c4049a90 tx=0x7f00c4049dd0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.249+0000 7f00dddf6740 1 -- 172.21.15.37:0/3632405032 shutdown_connections 2024-08-20T05:10:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.249+0000 7f00dddf6740 1 --2- 172.21.15.37:0/3632405032 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840beaab0 0x563840be8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.249+0000 7f00dddf6740 1 --2- 172.21.15.37:0/3632405032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be8820 0x563840bdf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.249+0000 7f00dddf6740 1 --2- 172.21.15.37:0/3632405032 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be5de0 0x563840bdee60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.249+0000 7f00dddf6740 1 -- 172.21.15.37:0/3632405032 >> 172.21.15.37:0/3632405032 conn(0x563840bde600 msgr2=0x563840bea3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:18.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.250+0000 7f00dddf6740 1 -- 172.21.15.37:0/3632405032 shutdown_connections 2024-08-20T05:10:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.250+0000 7f00dddf6740 1 -- 172.21.15.37:0/3632405032 wait complete. 2024-08-20T05:10:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.251+0000 7f00dddf6740 1 -- start start 2024-08-20T05:10:18.253 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.251+0000 7f00dddf6740 1 Processor -- start 2024-08-20T05:10:18.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.254+0000 7f00dddf6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be5de0 0x563840bfa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.255+0000 7f00dddf6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be8820 0x563840bfaae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.255+0000 7f00dddf6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840beaab0 0x563840bfb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.256+0000 7f00d3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be5de0 0x563840bfa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.256+0000 7f00dddf6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f00d41b3200 con 0x563840be8820 2024-08-20T05:10:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.256+0000 7f00dddf6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f00d41b2ad0 con 0x563840be5de0 2024-08-20T05:10:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.256+0000 7f00dddf6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f00d41afd10 con 0x563840beaab0 2024-08-20T05:10:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.256+0000 7f00d3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be5de0 0x563840bfa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33502/0 (socket says 172.21.15.37:33502) 2024-08-20T05:10:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.256+0000 7f00d3e00640 1 -- 172.21.15.37:0/2605198638 learned_addr learned my addr 172.21.15.37:0/2605198638 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.256+0000 7f00dddf6740 10 client.0 _ll_register_callbacks cb 0x7f00c4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:18.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.256+0000 7f00d8e00640 1 --2- 172.21.15.37:0/2605198638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840beaab0 0x563840bfb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:18.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.256+0000 7f00d3400640 1 --2- 172.21.15.37:0/2605198638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be8820 0x563840bfaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:18.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.257+0000 7f00d8e00640 1 -- 172.21.15.37:0/2605198638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be5de0 msgr2=0x563840bfa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.257+0000 7f00d8e00640 1 --2- 172.21.15.37:0/2605198638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be5de0 0x563840bfa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.257+0000 7f00d8e00640 1 -- 172.21.15.37:0/2605198638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be8820 msgr2=0x563840bfaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.257+0000 7f00d8e00640 1 --2- 172.21.15.37:0/2605198638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be8820 0x563840bfaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.257+0000 7f00d8e00640 1 -- 172.21.15.37:0/2605198638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563840be5c10 con 0x563840beaab0 2024-08-20T05:10:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.257+0000 7f00d8e00640 1 --2- 172.21.15.37:0/2605198638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840beaab0 0x563840bfb6b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f00cc000f80 tx=0x7f00cc004c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20a5eb4bd75e4b1c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.257+0000 7f00be000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:10:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.258+0000 7f00be000640 1 -- 172.21.15.37:0/2605198638 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00cc029060 con 0x563840beaab0 2024-08-20T05:10:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.258+0000 7f00be000640 1 -- 172.21.15.37:0/2605198638 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f00cc011700 con 0x563840beaab0 2024-08-20T05:10:18.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.258+0000 7f00dddf6740 1 -- 172.21.15.37:0/2605198638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00c4031e50 con 0x563840beaab0 2024-08-20T05:10:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.258+0000 7f00be000640 1 -- 172.21.15.37:0/2605198638 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f00cc030050 con 0x563840beaab0 2024-08-20T05:10:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.259+0000 7f00dddf6740 10 client.27541 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.259+0000 7f00dddf6740 1 -- 172.21.15.37:0/2605198638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x563840921620 con 0x563840beaab0 2024-08-20T05:10:18.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.259+0000 7f00be000640 1 -- 172.21.15.37:0/2605198638 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00cc011db0 con 0x563840beaab0 2024-08-20T05:10:18.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.261+0000 7f00be000640 1 -- 172.21.15.37:0/2605198638 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f00cc005690 con 0x563840beaab0 2024-08-20T05:10:18.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.261+0000 7f00dddf6740 10 client.27541 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:18.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.261+0000 7f00dddf6740 10 client.27541 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:10:18.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.261+0000 7f00dddf6740 20 client.27541 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:18.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.261+0000 7f00dddf6740 1 --2- 172.21.15.37:0/2605198638 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563840bfd530 0x563840c6e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:18.263 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.261+0000 7f00dddf6740 4 client.27541 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:10:18.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.261+0000 7f00dddf6740 1 -- 172.21.15.37:0/2605198638 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f00c4031e50 con 0x563840bfd530 2024-08-20T05:10:18.264 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.262+0000 7f00d3e00640 1 --2- 172.21.15.37:0/2605198638 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563840bfd530 0x563840c6e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:18.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.264+0000 7f00d3e00640 1 --2- 172.21.15.37:0/2605198638 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563840bfd530 0x563840c6e600 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=470499a3e1f5ab8 server_cookie=ff62e967f00b8829 in_seq=0 out_seq=0 2024-08-20T05:10:18.266 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.264+0000 7f00be000640 10 client.27541 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.420+0000 7f00be000640 1 -- 172.21.15.37:0/2605198638 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f00c4031e50 con 0x563840bfd530 2024-08-20T05:10:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.420+0000 7f00be000640 10 client.27541 handle_command_reply: tid=0 2024-08-20T05:10:18.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.421+0000 7f00dddf6740 1 client.27541 shutdown 2024-08-20T05:10:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.422+0000 7f00dddf6740 1 -- 172.21.15.37:0/2605198638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840beaab0 msgr2=0x563840bfb6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:18.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.422+0000 7f00dddf6740 1 --2- 172.21.15.37:0/2605198638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840beaab0 0x563840bfb6b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f00cc000f80 tx=0x7f00cc004c30 comp rx=0 tx=0).stop 2024-08-20T05:10:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.423+0000 7f00dddf6740 1 -- 172.21.15.37:0/2605198638 shutdown_connections 2024-08-20T05:10:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.423+0000 7f00dddf6740 1 --2- 172.21.15.37:0/2605198638 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563840bfd530 0x563840c6e600 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.423+0000 7f00dddf6740 1 --2- 172.21.15.37:0/2605198638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563840beaab0 0x563840bfb6b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.423+0000 7f00dddf6740 1 --2- 172.21.15.37:0/2605198638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563840be8820 0x563840bfaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.423+0000 7f00dddf6740 1 --2- 172.21.15.37:0/2605198638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563840be5de0 0x563840bfa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.423+0000 7f00dddf6740 1 -- 172.21.15.37:0/2605198638 >> 172.21.15.37:0/2605198638 conn(0x563840bde600 msgr2=0x563840c03880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:18.425 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.423+0000 7f00be000640 0 client.27541 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:18.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.424+0000 7f00dddf6740 1 -- 172.21.15.37:0/2605198638 shutdown_connections 2024-08-20T05:10:18.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.425+0000 7f00dddf6740 1 -- 172.21.15.37:0/2605198638 wait complete. 2024-08-20T05:10:18.427 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.425+0000 7f00dddf6740 20 client.27541 trim_cache size 0 max 16384 2024-08-20T05:10:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:10:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:10:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:10:18.428 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:10:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.428+0000 7f00d9800640 1 -- 172.21.15.37:0/3028226288 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f00b80b3cd0 msgr2=0x7f00b80b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.428+0000 7f00d9800640 1 --2- 172.21.15.37:0/3028226288 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f00b80b3cd0 0x7f00b80b6190 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f00c402aa00 tx=0x7f00c40314a0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.428+0000 7f00d9800640 1 -- 172.21.15.37:0/3028226288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d410a840 msgr2=0x7f00d41a1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:18.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.428+0000 7f00d9800640 1 --2- 172.21.15.37:0/3028226288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d410a840 0x7f00d41a1960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f00c000b450 tx=0x7f00c000b910 comp rx=0 tx=0).stop 2024-08-20T05:10:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.430+0000 7f00d9800640 1 -- 172.21.15.37:0/3028226288 shutdown_connections 2024-08-20T05:10:18.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.430+0000 7f00d9800640 1 --2- 172.21.15.37:0/3028226288 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f00b80b3cd0 0x7f00b80b6190 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.430+0000 7f00d9800640 1 --2- 172.21.15.37:0/3028226288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00d41a2590 0x7f00d41a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.430+0000 7f00d9800640 1 --2- 172.21.15.37:0/3028226288 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f00d410a840 0x7f00d41a1960 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.430+0000 7f00d9800640 1 --2- 172.21.15.37:0/3028226288 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f00d4109e80 0x7f00d41a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:18.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.430+0000 7f00d9800640 1 -- 172.21.15.37:0/3028226288 >> 172.21.15.37:0/3028226288 conn(0x7f00d406f550 msgr2=0x7f00d410f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.434+0000 7f00d9800640 1 -- 172.21.15.37:0/3028226288 shutdown_connections 2024-08-20T05:10:18.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:18.435+0000 7f00d9800640 1 -- 172.21.15.37:0/3028226288 wait complete. 2024-08-20T05:10:18.685 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:10:19.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.455+0000 7fd10b000640 1 -- 172.21.15.37:0/3703648127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd10410f440 msgr2=0x7fd104115c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:19.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.455+0000 7fd10b000640 1 --2- 172.21.15.37:0/3703648127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd10410f440 0x7fd104115c40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009900 tx=0x7fd0f402a400 comp rx=0 tx=0).stop 2024-08-20T05:10:19.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.455+0000 7fd10b000640 1 -- 172.21.15.37:0/3703648127 shutdown_connections 2024-08-20T05:10:19.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.456+0000 7fd10b000640 1 --2- 172.21.15.37:0/3703648127 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd10410f440 0x7fd104115c40 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.456+0000 7fd10b000640 1 --2- 172.21.15.37:0/3703648127 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd10410eac0 0x7fd10410ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.456+0000 7fd10b000640 1 --2- 172.21.15.37:0/3703648127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1041090b0 0x7fd104109490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.456+0000 7fd10b000640 1 -- 172.21.15.37:0/3703648127 >> 172.21.15.37:0/3703648127 conn(0x7fd1040787b0 msgr2=0x7fd10407abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.458+0000 7fd10b000640 1 -- 172.21.15.37:0/3703648127 shutdown_connections 2024-08-20T05:10:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.458+0000 7fd10b000640 1 -- 172.21.15.37:0/3703648127 wait complete. 2024-08-20T05:10:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.459+0000 7fd10b000640 1 Processor -- start 2024-08-20T05:10:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.460+0000 7fd10b000640 1 -- start start 2024-08-20T05:10:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.460+0000 7fd10b000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1041090b0 0x7fd10419f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.460+0000 7fd10b000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd10410eac0 0x7fd10419f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.460+0000 7fd10b000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10410f440 0x7fd1041a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.460+0000 7fd10b000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1041190c0 con 0x7fd10410f440 2024-08-20T05:10:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.460+0000 7fd10b000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd104118f40 con 0x7fd10410eac0 2024-08-20T05:10:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.460+0000 7fd10b000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd104119240 con 0x7fd1041090b0 2024-08-20T05:10:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.461+0000 7fd109000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10410f440 0x7fd1041a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.462+0000 7fd103400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd10410eac0 0x7fd10419f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.462+0000 7fd103400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd10410eac0 0x7fd10419f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33524/0 (socket says 172.21.15.37:33524) 2024-08-20T05:10:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.462+0000 7fd103400640 1 -- 172.21.15.37:0/232154256 learned_addr learned my addr 172.21.15.37:0/232154256 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.462+0000 7fd103400640 1 -- 172.21.15.37:0/232154256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1041090b0 msgr2=0x7fd10419f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.462+0000 7fd103400640 1 --2- 172.21.15.37:0/232154256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1041090b0 0x7fd10419f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.462+0000 7fd103400640 1 -- 172.21.15.37:0/232154256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10410f440 msgr2=0x7fd1041a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.462+0000 7fd103400640 1 --2- 172.21.15.37:0/232154256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10410f440 0x7fd1041a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.462+0000 7fd103400640 1 -- 172.21.15.37:0/232154256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1041a54a0 con 0x7fd10410eac0 2024-08-20T05:10:19.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.463+0000 7fd109000640 1 --2- 172.21.15.37:0/232154256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10410f440 0x7fd1041a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:10:19.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.463+0000 7fd103400640 1 --2- 172.21.15.37:0/232154256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd10410eac0 0x7fd10419f930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000c920 tx=0x7fd0f000cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.464+0000 7fd100c00640 1 -- 172.21.15.37:0/232154256 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0007c70 con 0x7fd10410eac0 2024-08-20T05:10:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.464+0000 7fd100c00640 1 -- 172.21.15.37:0/232154256 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0f0007e10 con 0x7fd10410eac0 2024-08-20T05:10:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.464+0000 7fd100c00640 1 -- 172.21.15.37:0/232154256 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0018820 con 0x7fd10410eac0 2024-08-20T05:10:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.465+0000 7fd10b000640 1 -- 172.21.15.37:0/232154256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1041a5790 con 0x7fd10410eac0 2024-08-20T05:10:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.465+0000 7fd10b000640 1 -- 172.21.15.37:0/232154256 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1041abe50 con 0x7fd10410eac0 2024-08-20T05:10:19.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.472+0000 7fd100c00640 1 -- 172.21.15.37:0/232154256 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd0f000f450 con 0x7fd10410eac0 2024-08-20T05:10:19.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.476+0000 7fd100c00640 1 --2- 172.21.15.37:0/232154256 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd0e80b3d00 0x7fd0e80b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.476+0000 7fd100c00640 1 -- 172.21.15.37:0/232154256 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd0f00e4180 con 0x7fd10410eac0 2024-08-20T05:10:19.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.477+0000 7fd10dacd740 1 Processor -- start 2024-08-20T05:10:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.477+0000 7fd10dacd740 1 -- start start 2024-08-20T05:10:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.478+0000 7fd103e00640 1 --2- 172.21.15.37:0/232154256 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd0e80b3d00 0x7fd0e80b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.478+0000 7fd10dacd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3bfff940 0x558a3bfffd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.478+0000 7fd10dacd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c000260 0x558a3c00bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.478+0000 7fd10dacd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c00c1f0 0x558a3c00e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.478+0000 7fd10dacd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558a3bf75aa0 con 0x558a3c00c1f0 2024-08-20T05:10:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.478+0000 7fd10dacd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558a3bf64fa0 con 0x558a3bfff940 2024-08-20T05:10:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.478+0000 7fd10dacd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558a3bf68fe0 con 0x558a3c000260 2024-08-20T05:10:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.479+0000 7fd103e00640 1 --2- 172.21.15.37:0/232154256 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd0e80b3d00 0x7fd0e80b61c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc005fd0 tx=0x7fd0fc009710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:19.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.479+0000 7fd103e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3bfff940 0x558a3bfffd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:19.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.479+0000 7fd103400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c000260 0x558a3c00bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:19.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.479+0000 7fd103400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c000260 0x558a3c00bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:55070/0 (socket says 172.21.15.37:55070) 2024-08-20T05:10:19.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.479+0000 7fd103400640 1 -- 172.21.15.37:0/19824050 learned_addr learned my addr 172.21.15.37:0/19824050 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.480+0000 7fd103400640 1 -- 172.21.15.37:0/19824050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3bfff940 msgr2=0x558a3bfffd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.480+0000 7fd103400640 1 --2- 172.21.15.37:0/19824050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3bfff940 0x558a3bfffd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.480+0000 7fd103400640 1 -- 172.21.15.37:0/19824050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c00c1f0 msgr2=0x558a3c00e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.480+0000 7fd103400640 1 --2- 172.21.15.37:0/19824050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c00c1f0 0x558a3c00e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.480+0000 7fd103400640 1 -- 172.21.15.37:0/19824050 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a3bf0b420 con 0x558a3c000260 2024-08-20T05:10:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.480+0000 7fd103400640 1 --2- 172.21.15.37:0/19824050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c000260 0x558a3c00bcb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00aac60 tx=0x7fd0f00aa8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3179acef90ab41c7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.481+0000 7fd0f9600640 1 -- 172.21.15.37:0/19824050 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00af0b0 con 0x558a3c000260 2024-08-20T05:10:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.481+0000 7fd0f9600640 1 -- 172.21.15.37:0/19824050 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0f00b3d80 con 0x558a3c000260 2024-08-20T05:10:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.481+0000 7fd0f9600640 1 -- 172.21.15.37:0/19824050 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f000f8c0 con 0x558a3c000260 2024-08-20T05:10:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.482+0000 7fd10dacd740 1 -- 172.21.15.37:0/19824050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c000260 msgr2=0x558a3c00bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.482+0000 7fd10dacd740 1 --2- 172.21.15.37:0/19824050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c000260 0x558a3c00bcb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fd0f00aac60 tx=0x7fd0f00aa8f0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.482+0000 7fd10dacd740 1 -- 172.21.15.37:0/19824050 shutdown_connections 2024-08-20T05:10:19.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.483+0000 7fd10dacd740 1 --2- 172.21.15.37:0/19824050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c00c1f0 0x558a3c00e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.483+0000 7fd10dacd740 1 --2- 172.21.15.37:0/19824050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c000260 0x558a3c00bcb0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.483+0000 7fd10dacd740 1 --2- 172.21.15.37:0/19824050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3bfff940 0x558a3bfffd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.483+0000 7fd10dacd740 1 -- 172.21.15.37:0/19824050 >> 172.21.15.37:0/19824050 conn(0x558a3bffd770 msgr2=0x558a3bffe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:19.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.483+0000 7fd10dacd740 1 -- 172.21.15.37:0/19824050 shutdown_connections 2024-08-20T05:10:19.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.483+0000 7fd10dacd740 1 -- 172.21.15.37:0/19824050 wait complete. 2024-08-20T05:10:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.484+0000 7fd10dacd740 1 -- start start 2024-08-20T05:10:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.484+0000 7fd10dacd740 1 Processor -- start 2024-08-20T05:10:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.487+0000 7fd10dacd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3bfff940 0x558a3c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.487+0000 7fd10dacd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c000260 0x558a3c008e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.488+0000 7fd10dacd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c00c1f0 0x558a3c009360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.489+0000 7fd109000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c00c1f0 0x558a3c009360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:19.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.489+0000 7fd109000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c00c1f0 0x558a3c009360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44256/0 (socket says 172.21.15.37:44256) 2024-08-20T05:10:19.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.489+0000 7fd103400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c000260 0x558a3c008e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:19.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.490+0000 7fd103e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3bfff940 0x558a3c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:19.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.490+0000 7fd109000640 1 -- 172.21.15.37:0/1856695603 learned_addr learned my addr 172.21.15.37:0/1856695603 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:19.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.490+0000 7fd10dacd740 1 -- 172.21.15.37:0/1856695603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558a3bdc7700 con 0x558a3c00c1f0 2024-08-20T05:10:19.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.490+0000 7fd10dacd740 1 -- 172.21.15.37:0/1856695603 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558a3bf00290 con 0x558a3bfff940 2024-08-20T05:10:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.490+0000 7fd10dacd740 1 -- 172.21.15.37:0/1856695603 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558a3c01fe80 con 0x558a3c000260 2024-08-20T05:10:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.491+0000 7fd10dacd740 10 client.0 _ll_register_callbacks cb 0x558a3bf5f1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.491+0000 7fd109000640 1 -- 172.21.15.37:0/1856695603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c000260 msgr2=0x558a3c008e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.491+0000 7fd109000640 1 --2- 172.21.15.37:0/1856695603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c000260 0x558a3c008e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.492+0000 7fd109000640 1 -- 172.21.15.37:0/1856695603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3bfff940 msgr2=0x558a3c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.492+0000 7fd109000640 1 --2- 172.21.15.37:0/1856695603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3bfff940 0x558a3c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.492+0000 7fd109000640 1 -- 172.21.15.37:0/1856695603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a3bcc4650 con 0x558a3c00c1f0 2024-08-20T05:10:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.492+0000 7fd103400640 1 --2- 172.21.15.37:0/1856695603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c000260 0x558a3c008e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:10:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.492+0000 7fd103e00640 1 --2- 172.21.15.37:0/1856695603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3bfff940 0x558a3c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:10:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.493+0000 7fd109000640 1 --2- 172.21.15.37:0/1856695603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c00c1f0 0x558a3c009360 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4031d30 tx=0x7fd0f4031d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693bc4c800fdc03 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.493+0000 7fd0ee000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:10:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.493+0000 7fd0ee000640 1 -- 172.21.15.37:0/1856695603 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4040070 con 0x558a3c00c1f0 2024-08-20T05:10:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.493+0000 7fd10dacd740 1 -- 172.21.15.37:0/1856695603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0f00b3d80 con 0x558a3c00c1f0 2024-08-20T05:10:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.493+0000 7fd0ee000640 1 -- 172.21.15.37:0/1856695603 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd0f4005220 con 0x558a3c00c1f0 2024-08-20T05:10:19.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.494+0000 7fd0ee000640 1 -- 172.21.15.37:0/1856695603 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fd0f4049050 con 0x558a3c00c1f0 2024-08-20T05:10:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.494+0000 7fd10dacd740 10 client.17100 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.494+0000 7fd10dacd740 1 -- 172.21.15.37:0/1856695603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x558a3c02b6c0 con 0x558a3c00c1f0 2024-08-20T05:10:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.495+0000 7fd0ee000640 1 -- 172.21.15.37:0/1856695603 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0f00b3d80 con 0x558a3c00c1f0 2024-08-20T05:10:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.495+0000 7fd0ee000640 1 -- 172.21.15.37:0/1856695603 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7fd0f404c020 con 0x558a3c00c1f0 2024-08-20T05:10:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.495+0000 7fd10dacd740 10 client.17100 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.495+0000 7fd10dacd740 10 client.17100 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:10:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.495+0000 7fd10dacd740 20 client.17100 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.495+0000 7fd10dacd740 1 --2- 172.21.15.37:0/1856695603 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558a3c02cc20 0x558a3c02f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.495+0000 7fd10dacd740 4 client.17100 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:10:19.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.495+0000 7fd10dacd740 1 -- 172.21.15.37:0/1856695603 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a3bf779f0 con 0x558a3c02cc20 2024-08-20T05:10:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.496+0000 7fd103e00640 1 --2- 172.21.15.37:0/1856695603 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558a3c02cc20 0x558a3c02f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.497+0000 7fd103e00640 1 --2- 172.21.15.37:0/1856695603 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558a3c02cc20 0x558a3c02f080 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd12666711bdae7 server_cookie=ddec9725b7bf971d in_seq=0 out_seq=0 2024-08-20T05:10:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.497+0000 7fd0ee000640 10 client.17100 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.498+0000 7fd0ee000640 1 -- 172.21.15.37:0/1856695603 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558a3bf779f0 con 0x558a3c02cc20 2024-08-20T05:10:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.498+0000 7fd0ee000640 10 client.17100 handle_command_reply: tid=0 2024-08-20T05:10:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.499+0000 7fd10dacd740 1 client.17100 shutdown 2024-08-20T05:10:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.501+0000 7fd10dacd740 1 -- 172.21.15.37:0/1856695603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c00c1f0 msgr2=0x558a3c009360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.501+0000 7fd10dacd740 1 --2- 172.21.15.37:0/1856695603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c00c1f0 0x558a3c009360 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4031d30 tx=0x7fd0f4031d60 comp rx=0 tx=0).stop 2024-08-20T05:10:19.503 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:19 smithi037 ceph-mon[17265]: pgmap v643: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 1.35k op/s 2024-08-20T05:10:19.504 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:10:19.504 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:10:19.504 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:10:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.502+0000 7fd10dacd740 1 -- 172.21.15.37:0/1856695603 shutdown_connections 2024-08-20T05:10:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.502+0000 7fd10dacd740 1 --2- 172.21.15.37:0/1856695603 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558a3c02cc20 0x558a3c02f080 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.502+0000 7fd10dacd740 1 --2- 172.21.15.37:0/1856695603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c00c1f0 0x558a3c009360 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.502+0000 7fd10dacd740 1 --2- 172.21.15.37:0/1856695603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c000260 0x558a3c008e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.502+0000 7fd10dacd740 1 --2- 172.21.15.37:0/1856695603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3bfff940 0x558a3c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.502+0000 7fd0ee000640 0 client.17100 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.502+0000 7fd10dacd740 1 -- 172.21.15.37:0/1856695603 >> 172.21.15.37:0/1856695603 conn(0x558a3bffd770 msgr2=0x558a3c0032e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.503+0000 7fd10dacd740 1 -- 172.21.15.37:0/1856695603 shutdown_connections 2024-08-20T05:10:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.503+0000 7fd10dacd740 1 -- 172.21.15.37:0/1856695603 wait complete. 2024-08-20T05:10:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.503+0000 7fd10dacd740 20 client.17100 trim_cache size 0 max 16384 2024-08-20T05:10:19.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.534+0000 7fd10dacd740 1 Processor -- start 2024-08-20T05:10:19.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.534+0000 7fd10dacd740 1 -- start start 2024-08-20T05:10:19.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.535+0000 7fd10dacd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3bfff940 0x558a3c028fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.535+0000 7fd10dacd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c000260 0x558a3c00ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.535+0000 7fd10dacd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3c00c1f0 0x558a3c034950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.535+0000 7fd10dacd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1041ad600 con 0x558a3c000260 2024-08-20T05:10:19.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.535+0000 7fd10dacd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd1041af260 con 0x558a3c00c1f0 2024-08-20T05:10:19.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.535+0000 7fd10dacd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd1041adcd0 con 0x558a3bfff940 2024-08-20T05:10:19.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.535+0000 7fd109000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3c00c1f0 0x558a3c034950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:19.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.535+0000 7fd109000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3c00c1f0 0x558a3c034950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33566/0 (socket says 172.21.15.37:33566) 2024-08-20T05:10:19.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.535+0000 7fd109000640 1 -- 172.21.15.37:0/2171659932 learned_addr learned my addr 172.21.15.37:0/2171659932 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:19.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.536+0000 7fd109000640 1 -- 172.21.15.37:0/2171659932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3bfff940 msgr2=0x558a3c028fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:19.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.536+0000 7fd109000640 1 --2- 172.21.15.37:0/2171659932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3bfff940 0x558a3c028fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.536+0000 7fd109000640 1 -- 172.21.15.37:0/2171659932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c000260 msgr2=0x558a3c00ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:19.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.536+0000 7fd109000640 1 --2- 172.21.15.37:0/2171659932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c000260 0x558a3c00ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.536+0000 7fd109000640 1 -- 172.21.15.37:0/2171659932 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a3c00bd40 con 0x558a3c00c1f0 2024-08-20T05:10:19.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.536+0000 7fd109000640 1 --2- 172.21.15.37:0/2171659932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3c00c1f0 0x558a3c034950 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009900 tx=0x7fd0f402a400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61e620dd8f588531 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:19.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.538+0000 7fd0f8c00640 1 -- 172.21.15.37:0/2171659932 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4040070 con 0x558a3c00c1f0 2024-08-20T05:10:19.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.538+0000 7fd0f8c00640 1 -- 172.21.15.37:0/2171659932 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0f4052070 con 0x558a3c00c1f0 2024-08-20T05:10:19.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.538+0000 7fd0f8c00640 1 -- 172.21.15.37:0/2171659932 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4035040 con 0x558a3c00c1f0 2024-08-20T05:10:19.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.539+0000 7fd10dacd740 1 -- 172.21.15.37:0/2171659932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3c00c1f0 msgr2=0x558a3c034950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:19.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.539+0000 7fd10dacd740 1 --2- 172.21.15.37:0/2171659932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3c00c1f0 0x558a3c034950 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009900 tx=0x7fd0f402a400 comp rx=0 tx=0).stop 2024-08-20T05:10:19.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.539+0000 7fd10dacd740 1 -- 172.21.15.37:0/2171659932 shutdown_connections 2024-08-20T05:10:19.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.539+0000 7fd10dacd740 1 --2- 172.21.15.37:0/2171659932 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3c00c1f0 0x558a3c034950 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.539+0000 7fd10dacd740 1 --2- 172.21.15.37:0/2171659932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c000260 0x558a3c00ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.539+0000 7fd10dacd740 1 --2- 172.21.15.37:0/2171659932 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3bfff940 0x558a3c028fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.539+0000 7fd10dacd740 1 -- 172.21.15.37:0/2171659932 >> 172.21.15.37:0/2171659932 conn(0x558a3bffd770 msgr2=0x558a3c00a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:19.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.540+0000 7fd10dacd740 1 -- 172.21.15.37:0/2171659932 shutdown_connections 2024-08-20T05:10:19.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.540+0000 7fd10dacd740 1 -- 172.21.15.37:0/2171659932 wait complete. 2024-08-20T05:10:19.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.541+0000 7fd10dacd740 1 -- start start 2024-08-20T05:10:19.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.542+0000 7fd10dacd740 1 Processor -- start 2024-08-20T05:10:19.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.544+0000 7fd10dacd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3bfff940 0x558a3c0255b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.545+0000 7fd10dacd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c000260 0x558a3c090190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.545+0000 7fd10dacd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c00c1f0 0x558a3c0906d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.545+0000 7fd10dacd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1041aead0 con 0x558a3c000260 2024-08-20T05:10:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.545+0000 7fd10dacd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd1041ae3a0 con 0x558a3bfff940 2024-08-20T05:10:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.545+0000 7fd10dacd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd1041a0520 con 0x558a3c00c1f0 2024-08-20T05:10:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.545+0000 7fd10dacd740 10 client.0 _ll_register_callbacks cb 0x7fd0f4009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:19.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.545+0000 7fd109000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c00c1f0 0x558a3c0906d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:19.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.545+0000 7fd109000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c00c1f0 0x558a3c0906d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:55100/0 (socket says 172.21.15.37:55100) 2024-08-20T05:10:19.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.545+0000 7fd109000640 1 -- 172.21.15.37:0/926001749 learned_addr learned my addr 172.21.15.37:0/926001749 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:19.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.546+0000 7fd103e00640 1 --2- 172.21.15.37:0/926001749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3bfff940 0x558a3c0255b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:19.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.546+0000 7fd109000640 1 -- 172.21.15.37:0/926001749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3bfff940 msgr2=0x558a3c0255b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:19.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.546+0000 7fd109000640 1 --2- 172.21.15.37:0/926001749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3bfff940 0x558a3c0255b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.546+0000 7fd109000640 1 -- 172.21.15.37:0/926001749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c000260 msgr2=0x558a3c090190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:19.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.546+0000 7fd109000640 1 --2- 172.21.15.37:0/926001749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c000260 0x558a3c090190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.546+0000 7fd109000640 1 -- 172.21.15.37:0/926001749 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a3c090ce0 con 0x558a3c00c1f0 2024-08-20T05:10:19.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.546+0000 7fd103e00640 1 --2- 172.21.15.37:0/926001749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3bfff940 0x558a3c0255b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:10:19.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.547+0000 7fd109000640 1 --2- 172.21.15.37:0/926001749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c00c1f0 0x558a3c0906d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4006010 tx=0x7fd0f404d6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e45249ab1b7f88c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:19.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.547+0000 7fd0ee000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:10:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.548+0000 7fd0ee000640 1 -- 172.21.15.37:0/926001749 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4035040 con 0x558a3c00c1f0 2024-08-20T05:10:19.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.548+0000 7fd0ee000640 1 -- 172.21.15.37:0/926001749 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd0f404dca0 con 0x558a3c00c1f0 2024-08-20T05:10:19.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.548+0000 7fd10dacd740 1 -- 172.21.15.37:0/926001749 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0f4052070 con 0x558a3c00c1f0 2024-08-20T05:10:19.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.550+0000 7fd0ee000640 1 -- 172.21.15.37:0/926001749 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fd0f4040040 con 0x558a3c00c1f0 2024-08-20T05:10:19.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.550+0000 7fd10dacd740 10 client.27553 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:19.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.550+0000 7fd10dacd740 1 -- 172.21.15.37:0/926001749 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x558a3c022f30 con 0x558a3c00c1f0 2024-08-20T05:10:19.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.550+0000 7fd0ee000640 1 -- 172.21.15.37:0/926001749 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0f4052070 con 0x558a3c00c1f0 2024-08-20T05:10:19.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.551+0000 7fd0ee000640 1 -- 172.21.15.37:0/926001749 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7fd0f404c040 con 0x558a3c00c1f0 2024-08-20T05:10:19.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.551+0000 7fd10dacd740 10 client.27553 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:19.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.551+0000 7fd10dacd740 10 client.27553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:10:19.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.551+0000 7fd10dacd740 20 client.27553 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:19.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.552+0000 7fd10dacd740 1 --2- 172.21.15.37:0/926001749 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558a3c0a8dd0 0x558a3c0ab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:19.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.552+0000 7fd10dacd740 4 client.27553 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:10:19.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.552+0000 7fd10dacd740 1 -- 172.21.15.37:0/926001749 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558a3bf73490 con 0x558a3c0a8dd0 2024-08-20T05:10:19.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.552+0000 7fd103e00640 1 --2- 172.21.15.37:0/926001749 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558a3c0a8dd0 0x558a3c0ab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:19.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.553+0000 7fd103e00640 1 --2- 172.21.15.37:0/926001749 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558a3c0a8dd0 0x558a3c0ab1f0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66a59312e620ee07 server_cookie=ea89ecbb6006236a in_seq=0 out_seq=0 2024-08-20T05:10:19.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.553+0000 7fd0ee000640 10 client.27553 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:19.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.557+0000 7fd0ee000640 1 -- 172.21.15.37:0/926001749 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558a3bf73490 con 0x558a3c0a8dd0 2024-08-20T05:10:19.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.557+0000 7fd0ee000640 10 client.27553 handle_command_reply: tid=0 2024-08-20T05:10:19.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.557+0000 7fd10dacd740 1 client.27553 shutdown 2024-08-20T05:10:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.558+0000 7fd10dacd740 1 -- 172.21.15.37:0/926001749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c00c1f0 msgr2=0x558a3c0906d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.558+0000 7fd10dacd740 1 --2- 172.21.15.37:0/926001749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c00c1f0 0x558a3c0906d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4006010 tx=0x7fd0f404d6a0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.558+0000 7fd10dacd740 1 -- 172.21.15.37:0/926001749 shutdown_connections 2024-08-20T05:10:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.558+0000 7fd10dacd740 1 --2- 172.21.15.37:0/926001749 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558a3c0a8dd0 0x558a3c0ab1f0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.558+0000 7fd10dacd740 1 --2- 172.21.15.37:0/926001749 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558a3c00c1f0 0x558a3c0906d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.558+0000 7fd10dacd740 1 --2- 172.21.15.37:0/926001749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558a3c000260 0x558a3c090190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.558+0000 7fd10dacd740 1 --2- 172.21.15.37:0/926001749 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558a3bfff940 0x558a3c0255b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.558+0000 7fd10dacd740 1 -- 172.21.15.37:0/926001749 >> 172.21.15.37:0/926001749 conn(0x558a3bffd770 msgr2=0x558a3c00ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:19.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.558+0000 7fd0ee000640 0 client.27553 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:19.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.560+0000 7fd10dacd740 1 -- 172.21.15.37:0/926001749 shutdown_connections 2024-08-20T05:10:19.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.560+0000 7fd10dacd740 1 -- 172.21.15.37:0/926001749 wait complete. 2024-08-20T05:10:19.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.560+0000 7fd10dacd740 20 client.27553 trim_cache size 0 max 16384 2024-08-20T05:10:19.563 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:10:19.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.563+0000 7fd10b000640 1 -- 172.21.15.37:0/232154256 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd0e80b3d00 msgr2=0x7fd0e80b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:19.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.563+0000 7fd10b000640 1 --2- 172.21.15.37:0/232154256 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd0e80b3d00 0x7fd0e80b61c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc005fd0 tx=0x7fd0fc009710 comp rx=0 tx=0).stop 2024-08-20T05:10:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.563+0000 7fd10b000640 1 -- 172.21.15.37:0/232154256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd10410eac0 msgr2=0x7fd10419f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.563+0000 7fd10b000640 1 --2- 172.21.15.37:0/232154256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd10410eac0 0x7fd10419f930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000c920 tx=0x7fd0f000cde0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.563+0000 7fd10b000640 1 -- 172.21.15.37:0/232154256 shutdown_connections 2024-08-20T05:10:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.563+0000 7fd10b000640 1 --2- 172.21.15.37:0/232154256 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd0e80b3d00 0x7fd0e80b61c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.563+0000 7fd10b000640 1 --2- 172.21.15.37:0/232154256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd10410f440 0x7fd1041a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.563+0000 7fd10b000640 1 --2- 172.21.15.37:0/232154256 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd10410eac0 0x7fd10419f930 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.563+0000 7fd10b000640 1 --2- 172.21.15.37:0/232154256 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd1041090b0 0x7fd10419f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.563+0000 7fd10b000640 1 -- 172.21.15.37:0/232154256 >> 172.21.15.37:0/232154256 conn(0x7fd1040787b0 msgr2=0x7fd104108660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.564+0000 7fd10b000640 1 -- 172.21.15.37:0/232154256 shutdown_connections 2024-08-20T05:10:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:19.564+0000 7fd10b000640 1 -- 172.21.15.37:0/232154256 wait complete. 2024-08-20T05:10:19.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:19 smithi135 ceph-mon[22342]: pgmap v643: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 1.35k op/s 2024-08-20T05:10:19.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:10:19.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:10:19.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:10:19.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:19 smithi130 ceph-mon[22007]: pgmap v643: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 18 MiB/s wr, 1.35k op/s 2024-08-20T05:10:19.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:10:19.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:10:19.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:10:21.596 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T05:10:21.596 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T05:10:21.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:21 smithi135 ceph-mon[22342]: pgmap v644: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 1.39k op/s 2024-08-20T05:10:21.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:21 smithi130 ceph-mon[22007]: pgmap v644: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 1.39k op/s 2024-08-20T05:10:21.706 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:21 smithi037 ceph-mon[17265]: pgmap v644: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 1.39k op/s 2024-08-20T05:10:22.319 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:10:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 445.0 s, 690.8 tps, lat 149.740 ms stddev 192.678 2024-08-20T05:10:23.521 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:23 smithi037 ceph-mon[17265]: pgmap v645: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 18 MiB/s wr, 1.41k op/s 2024-08-20T05:10:23.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:23 smithi130 ceph-mon[22007]: pgmap v645: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 18 MiB/s wr, 1.41k op/s 2024-08-20T05:10:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:23 smithi135 ceph-mon[22342]: pgmap v645: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 18 MiB/s wr, 1.41k op/s 2024-08-20T05:10:23.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.878+0000 7fbdaec00640 1 -- 172.21.15.37:0/1195226948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbda8109e80 msgr2=0x7fbda810a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:23.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.878+0000 7fbdaec00640 1 --2- 172.21.15.37:0/1195226948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbda8109e80 0x7fbda810a260 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009900 tx=0x7fbd9802a490 comp rx=0 tx=0).stop 2024-08-20T05:10:23.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.878+0000 7fbdaec00640 1 -- 172.21.15.37:0/1195226948 shutdown_connections 2024-08-20T05:10:23.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.878+0000 7fbdaec00640 1 --2- 172.21.15.37:0/1195226948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbda8115740 0x7fbda8117b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.878+0000 7fbdaec00640 1 --2- 172.21.15.37:0/1195226948 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbda810a7a0 0x7fbda8115200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.878+0000 7fbdaec00640 1 --2- 172.21.15.37:0/1195226948 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbda8109e80 0x7fbda810a260 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.878+0000 7fbdaec00640 1 -- 172.21.15.37:0/1195226948 >> 172.21.15.37:0/1195226948 conn(0x7fbda806dcc0 msgr2=0x7fbda806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:23.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.878+0000 7fbdaec00640 1 -- 172.21.15.37:0/1195226948 shutdown_connections 2024-08-20T05:10:23.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.879+0000 7fbdaec00640 1 -- 172.21.15.37:0/1195226948 wait complete. 2024-08-20T05:10:23.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.880+0000 7fbdaec00640 1 Processor -- start 2024-08-20T05:10:23.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.881+0000 7fbdaec00640 1 -- start start 2024-08-20T05:10:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.881+0000 7fbdaec00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbda8109e80 0x7fbda81142c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.881+0000 7fbdaec00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbda810a7a0 0x7fbda8114800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.881+0000 7fbdaec00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbda8115740 0x7fbda81a4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.881+0000 7fbdaec00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbda811b330 con 0x7fbda8109e80 2024-08-20T05:10:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.881+0000 7fbdaec00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbda811b1b0 con 0x7fbda8115740 2024-08-20T05:10:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.881+0000 7fbdaec00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbda811b4b0 con 0x7fbda810a7a0 2024-08-20T05:10:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.882+0000 7fbda7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbda810a7a0 0x7fbda8114800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:23.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.882+0000 7fbda7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbda810a7a0 0x7fbda8114800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:55326/0 (socket says 172.21.15.37:55326) 2024-08-20T05:10:23.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.882+0000 7fbda7400640 1 -- 172.21.15.37:0/728594656 learned_addr learned my addr 172.21.15.37:0/728594656 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:23.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.882+0000 7fbda7e00640 1 --2- 172.21.15.37:0/728594656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbda8109e80 0x7fbda81142c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:23.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.882+0000 7fbdacc00640 1 --2- 172.21.15.37:0/728594656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbda8115740 0x7fbda81a4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:23.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.883+0000 7fbda7400640 1 -- 172.21.15.37:0/728594656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbda8115740 msgr2=0x7fbda81a4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:23.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.883+0000 7fbda7400640 1 --2- 172.21.15.37:0/728594656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbda8115740 0x7fbda81a4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.883+0000 7fbda7400640 1 -- 172.21.15.37:0/728594656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbda8109e80 msgr2=0x7fbda81142c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:23.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.883+0000 7fbda7400640 1 --2- 172.21.15.37:0/728594656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbda8109e80 0x7fbda81142c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.883+0000 7fbda7400640 1 -- 172.21.15.37:0/728594656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda81a53e0 con 0x7fbda810a7a0 2024-08-20T05:10:23.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.883+0000 7fbda7400640 1 --2- 172.21.15.37:0/728594656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbda810a7a0 0x7fbda8114800 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400c920 tx=0x7fbd9400cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:23.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.884+0000 7fbda4c00640 1 -- 172.21.15.37:0/728594656 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94007c70 con 0x7fbda810a7a0 2024-08-20T05:10:23.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.884+0000 7fbda4c00640 1 -- 172.21.15.37:0/728594656 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd94007e10 con 0x7fbda810a7a0 2024-08-20T05:10:23.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.884+0000 7fbda4c00640 1 -- 172.21.15.37:0/728594656 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd94018820 con 0x7fbda810a7a0 2024-08-20T05:10:23.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.884+0000 7fbdaec00640 1 -- 172.21.15.37:0/728594656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda81a56d0 con 0x7fbda810a7a0 2024-08-20T05:10:23.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.884+0000 7fbdaec00640 1 -- 172.21.15.37:0/728594656 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda81a7de0 con 0x7fbda810a7a0 2024-08-20T05:10:23.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.890+0000 7fbdb17d0740 1 Processor -- start 2024-08-20T05:10:23.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.891+0000 7fbdb17d0740 1 -- start start 2024-08-20T05:10:23.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.891+0000 7fbdb17d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 0x55eb9439ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.891+0000 7fbdb17d0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb9439e2f0 0x55eb943a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.891+0000 7fbdb17d0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb943aa280 0x55eb943ac670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.891+0000 7fbdb17d0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55eb94314870 con 0x55eb9439e2f0 2024-08-20T05:10:23.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.891+0000 7fbdb17d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55eb94303d70 con 0x55eb9439d9d0 2024-08-20T05:10:23.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.891+0000 7fbdb17d0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55eb94307db0 con 0x55eb943aa280 2024-08-20T05:10:23.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.891+0000 7fbdacc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 0x55eb9439ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:23.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.892+0000 7fbdacc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 0x55eb9439ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56502/0 (socket says 172.21.15.37:56502) 2024-08-20T05:10:23.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.892+0000 7fbdacc00640 1 -- 172.21.15.37:0/3225629953 learned_addr learned my addr 172.21.15.37:0/3225629953 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:23.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.893+0000 7fbdacc00640 1 -- 172.21.15.37:0/3225629953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb943aa280 msgr2=0x55eb943ac670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:10:23.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.893+0000 7fbdacc00640 1 --2- 172.21.15.37:0/3225629953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb943aa280 0x55eb943ac670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.893+0000 7fbdacc00640 1 -- 172.21.15.37:0/3225629953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb9439e2f0 msgr2=0x55eb943a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:23.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.893+0000 7fbdacc00640 1 --2- 172.21.15.37:0/3225629953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb9439e2f0 0x55eb943a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.893+0000 7fbdacc00640 1 -- 172.21.15.37:0/3225629953 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb94063930 con 0x55eb9439d9d0 2024-08-20T05:10:23.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.893+0000 7fbda4c00640 1 -- 172.21.15.37:0/728594656 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbd9400f450 con 0x7fbda810a7a0 2024-08-20T05:10:23.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.894+0000 7fbdacc00640 1 --2- 172.21.15.37:0/3225629953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 0x55eb9439ddb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009ef0 tx=0x7fbda000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b99381601ff2ef9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:23.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.895+0000 7fbd9d200640 1 -- 172.21.15.37:0/3225629953 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda001a070 con 0x55eb9439d9d0 2024-08-20T05:10:23.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.895+0000 7fbd9d200640 1 -- 172.21.15.37:0/3225629953 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbda00158c0 con 0x55eb9439d9d0 2024-08-20T05:10:23.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.895+0000 7fbd9d200640 1 -- 172.21.15.37:0/3225629953 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda000a780 con 0x55eb9439d9d0 2024-08-20T05:10:23.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.896+0000 7fbda4c00640 1 --2- 172.21.15.37:0/728594656 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd8c0b3de0 0x7fbd8c0b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.897+0000 7fbda4c00640 1 -- 172.21.15.37:0/728594656 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbd940e40f0 con 0x7fbda810a7a0 2024-08-20T05:10:23.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.897+0000 7fbdb17d0740 1 -- 172.21.15.37:0/3225629953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 msgr2=0x55eb9439ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.897+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/3225629953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 0x55eb9439ddb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009ef0 tx=0x7fbda000c7f0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.897+0000 7fbdb17d0740 1 -- 172.21.15.37:0/3225629953 shutdown_connections 2024-08-20T05:10:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.897+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/3225629953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb943aa280 0x55eb943ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.897+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/3225629953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb9439e2f0 0x55eb943a9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.897+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/3225629953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 0x55eb9439ddb0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.897+0000 7fbdb17d0740 1 -- 172.21.15.37:0/3225629953 >> 172.21.15.37:0/3225629953 conn(0x55eb9439b800 msgr2=0x55eb9439c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.897+0000 7fbda7e00640 1 --2- 172.21.15.37:0/728594656 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd8c0b3de0 0x7fbd8c0b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.898+0000 7fbdb17d0740 1 -- 172.21.15.37:0/3225629953 shutdown_connections 2024-08-20T05:10:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.898+0000 7fbdb17d0740 1 -- 172.21.15.37:0/3225629953 wait complete. 2024-08-20T05:10:23.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.899+0000 7fbdb17d0740 1 -- start start 2024-08-20T05:10:23.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.899+0000 7fbdb17d0740 1 Processor -- start 2024-08-20T05:10:23.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.899+0000 7fbda7e00640 1 --2- 172.21.15.37:0/728594656 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd8c0b3de0 0x7fbd8c0b62a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbd98005ab0 tx=0x7fbd9800b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:23.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.900+0000 7fbdb17d0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb9439d9d0 0x55eb943a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.900+0000 7fbdb17d0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb9439e2f0 0x55eb943a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.900+0000 7fbdb17d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb943aa280 0x55eb943a7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.900+0000 7fbdb17d0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55eb94166890 con 0x55eb9439e2f0 2024-08-20T05:10:23.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.900+0000 7fbdb17d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55eb9428ab00 con 0x55eb943aa280 2024-08-20T05:10:23.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.900+0000 7fbdb17d0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55eb943acfd0 con 0x55eb9439d9d0 2024-08-20T05:10:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.900+0000 7fbdb17d0740 10 client.0 _ll_register_callbacks cb 0x55eb942fedc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.900+0000 7fbdacc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb943aa280 0x55eb943a7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.900+0000 7fbdacc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb943aa280 0x55eb943a7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56516/0 (socket says 172.21.15.37:56516) 2024-08-20T05:10:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.900+0000 7fbdacc00640 1 -- 172.21.15.37:0/4071830004 learned_addr learned my addr 172.21.15.37:0/4071830004 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.901+0000 7fbdacc00640 1 -- 172.21.15.37:0/4071830004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb9439d9d0 msgr2=0x55eb943a9b10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:10:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.901+0000 7fbdacc00640 1 --2- 172.21.15.37:0/4071830004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb9439d9d0 0x55eb943a9b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.901+0000 7fbdacc00640 1 -- 172.21.15.37:0/4071830004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb9439e2f0 msgr2=0x55eb943a6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.901+0000 7fbdacc00640 1 --2- 172.21.15.37:0/4071830004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb9439e2f0 0x55eb943a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.901+0000 7fbdacc00640 1 -- 172.21.15.37:0/4071830004 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb942cba30 con 0x55eb943aa280 2024-08-20T05:10:23.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.904+0000 7fbdacc00640 1 --2- 172.21.15.37:0/4071830004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb943aa280 0x55eb943a7500 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbda0015ca0 tx=0x7fbda0015cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79ba936fa962b37c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:23.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.904+0000 7fbd91600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:10:23.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.905+0000 7fbd91600640 1 -- 172.21.15.37:0/4071830004 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda001a040 con 0x55eb943aa280 2024-08-20T05:10:23.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.906+0000 7fbdb17d0740 1 -- 172.21.15.37:0/4071830004 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbda00158c0 con 0x55eb943aa280 2024-08-20T05:10:23.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.906+0000 7fbd91600640 1 -- 172.21.15.37:0/4071830004 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbda0009b30 con 0x55eb943aa280 2024-08-20T05:10:23.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.907+0000 7fbd91600640 1 -- 172.21.15.37:0/4071830004 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fbda002d050 con 0x55eb943aa280 2024-08-20T05:10:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.907+0000 7fbdb17d0740 10 client.27551 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.907+0000 7fbdb17d0740 1 -- 172.21.15.37:0/4071830004 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55eb943b88a0 con 0x55eb943aa280 2024-08-20T05:10:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.907+0000 7fbd91600640 1 -- 172.21.15.37:0/4071830004 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbda00158c0 con 0x55eb943aa280 2024-08-20T05:10:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.908+0000 7fbd91600640 1 -- 172.21.15.37:0/4071830004 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7fbda0028030 con 0x55eb943aa280 2024-08-20T05:10:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.908+0000 7fbdb17d0740 10 client.27551 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.908+0000 7fbdb17d0740 10 client.27551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:10:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.908+0000 7fbdb17d0740 20 client.27551 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.908+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/4071830004 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55eb943b9d60 0x55eb943bc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.908+0000 7fbdb17d0740 4 client.27551 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:10:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.908+0000 7fbdb17d0740 1 -- 172.21.15.37:0/4071830004 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb943167c0 con 0x55eb943b9d60 2024-08-20T05:10:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.909+0000 7fbda7e00640 1 --2- 172.21.15.37:0/4071830004 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55eb943b9d60 0x55eb943bc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.910+0000 7fbd91600640 10 client.27551 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.910+0000 7fbda7e00640 1 --2- 172.21.15.37:0/4071830004 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55eb943b9d60 0x55eb943bc150 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be621f663e71579b server_cookie=892a5b0e52d8d449 in_seq=0 out_seq=0 2024-08-20T05:10:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.911+0000 7fbd91600640 1 -- 172.21.15.37:0/4071830004 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb943167c0 con 0x55eb943b9d60 2024-08-20T05:10:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.911+0000 7fbd91600640 10 client.27551 handle_command_reply: tid=0 2024-08-20T05:10:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.912+0000 7fbdb17d0740 1 client.27551 shutdown 2024-08-20T05:10:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.912+0000 7fbdb17d0740 1 -- 172.21.15.37:0/4071830004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb943aa280 msgr2=0x55eb943a7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.912+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/4071830004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb943aa280 0x55eb943a7500 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbda0015ca0 tx=0x7fbda0015cd0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.912+0000 7fbdb17d0740 1 -- 172.21.15.37:0/4071830004 shutdown_connections 2024-08-20T05:10:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.912+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/4071830004 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55eb943b9d60 0x55eb943bc150 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.912+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/4071830004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb943aa280 0x55eb943a7500 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.912+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/4071830004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb9439e2f0 0x55eb943a6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.912+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/4071830004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb9439d9d0 0x55eb943a9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.912+0000 7fbdb17d0740 1 -- 172.21.15.37:0/4071830004 >> 172.21.15.37:0/4071830004 conn(0x55eb9439b800 msgr2=0x55eb9439a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.912+0000 7fbd91600640 0 client.27551 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.913+0000 7fbdb17d0740 1 -- 172.21.15.37:0/4071830004 shutdown_connections 2024-08-20T05:10:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.913+0000 7fbdb17d0740 1 -- 172.21.15.37:0/4071830004 wait complete. 2024-08-20T05:10:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.913+0000 7fbdb17d0740 20 client.27551 trim_cache size 0 max 16384 2024-08-20T05:10:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.954+0000 7fbdb17d0740 1 Processor -- start 2024-08-20T05:10:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.955+0000 7fbdb17d0740 1 -- start start 2024-08-20T05:10:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.956+0000 7fbdb17d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 0x55eb943b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.956+0000 7fbdb17d0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb9439e2f0 0x55eb943a2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.956+0000 7fbdb17d0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb943aa280 0x55eb943c1910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.956+0000 7fbdb17d0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81c6df0 con 0x55eb9439e2f0 2024-08-20T05:10:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.956+0000 7fbdb17d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81c8a50 con 0x55eb9439d9d0 2024-08-20T05:10:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.956+0000 7fbdb17d0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81c74c0 con 0x55eb943aa280 2024-08-20T05:10:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.956+0000 7fbda7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 0x55eb943b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.956+0000 7fbda7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 0x55eb943b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56518/0 (socket says 172.21.15.37:56518) 2024-08-20T05:10:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.956+0000 7fbda7e00640 1 -- 172.21.15.37:0/2208814862 learned_addr learned my addr 172.21.15.37:0/2208814862 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.957+0000 7fbdacc00640 1 --2- 172.21.15.37:0/2208814862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb943aa280 0x55eb943c1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.958+0000 7fbda7400640 1 --2- 172.21.15.37:0/2208814862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb9439e2f0 0x55eb943a2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.958+0000 7fbdacc00640 1 -- 172.21.15.37:0/2208814862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 msgr2=0x55eb943b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.958+0000 7fbdacc00640 1 --2- 172.21.15.37:0/2208814862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 0x55eb943b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.958+0000 7fbdacc00640 1 -- 172.21.15.37:0/2208814862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb9439e2f0 msgr2=0x55eb943a2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.958+0000 7fbdacc00640 1 --2- 172.21.15.37:0/2208814862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb9439e2f0 0x55eb943a2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.958+0000 7fbdacc00640 1 -- 172.21.15.37:0/2208814862 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb943bc6e0 con 0x55eb943aa280 2024-08-20T05:10:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.962+0000 7fbdacc00640 1 --2- 172.21.15.37:0/2208814862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb943aa280 0x55eb943c1910 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbda000ccf0 tx=0x7fbda0015ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50a907814fb4c945 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.963+0000 7fbd93e00640 1 -- 172.21.15.37:0/2208814862 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda001a040 con 0x55eb943aa280 2024-08-20T05:10:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.963+0000 7fbd93e00640 1 -- 172.21.15.37:0/2208814862 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbda001e430 con 0x55eb943aa280 2024-08-20T05:10:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.963+0000 7fbd93e00640 1 -- 172.21.15.37:0/2208814862 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda001ee10 con 0x55eb943aa280 2024-08-20T05:10:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.965+0000 7fbdb17d0740 1 -- 172.21.15.37:0/2208814862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb943aa280 msgr2=0x55eb943c1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.965+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/2208814862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb943aa280 0x55eb943c1910 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbda000ccf0 tx=0x7fbda0015ed0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.965+0000 7fbdb17d0740 1 -- 172.21.15.37:0/2208814862 shutdown_connections 2024-08-20T05:10:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.965+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/2208814862 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb943aa280 0x55eb943c1910 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.965+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/2208814862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb9439e2f0 0x55eb943a2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.965+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/2208814862 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 0x55eb943b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.965+0000 7fbdb17d0740 1 -- 172.21.15.37:0/2208814862 >> 172.21.15.37:0/2208814862 conn(0x55eb9439b800 msgr2=0x55eb943a1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.966+0000 7fbdb17d0740 1 -- 172.21.15.37:0/2208814862 shutdown_connections 2024-08-20T05:10:23.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.966+0000 7fbdb17d0740 1 -- 172.21.15.37:0/2208814862 wait complete. 2024-08-20T05:10:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.966+0000 7fbdb17d0740 1 -- start start 2024-08-20T05:10:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.967+0000 7fbdb17d0740 1 Processor -- start 2024-08-20T05:10:23.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.968+0000 7fbdb17d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 0x55eb943ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.968+0000 7fbdb17d0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb9439e2f0 0x55eb943ae720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.968+0000 7fbdb17d0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb943aa280 0x55eb943aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.969+0000 7fbda7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 0x55eb943ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.969+0000 7fbda7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 0x55eb943ae1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56534/0 (socket says 172.21.15.37:56534) 2024-08-20T05:10:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.969+0000 7fbdb17d0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81c82c0 con 0x55eb943aa280 2024-08-20T05:10:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.969+0000 7fbdb17d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81c7b90 con 0x55eb9439d9d0 2024-08-20T05:10:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.969+0000 7fbdb17d0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81c4dd0 con 0x55eb9439e2f0 2024-08-20T05:10:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.969+0000 7fbdb17d0740 10 client.0 _ll_register_callbacks cb 0x7fbda0018070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.969+0000 7fbda7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb9439e2f0 0x55eb943ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.969+0000 7fbda7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb9439e2f0 0x55eb943ae720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:55356/0 (socket says 172.21.15.37:55356) 2024-08-20T05:10:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.969+0000 7fbda7400640 1 -- 172.21.15.37:0/1964162919 learned_addr learned my addr 172.21.15.37:0/1964162919 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.970+0000 7fbda7400640 1 -- 172.21.15.37:0/1964162919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 msgr2=0x55eb943ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.970+0000 7fbda7400640 1 --2- 172.21.15.37:0/1964162919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 0x55eb943ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.970+0000 7fbda7400640 1 -- 172.21.15.37:0/1964162919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb943aa280 msgr2=0x55eb943aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.970+0000 7fbda7400640 1 --2- 172.21.15.37:0/1964162919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb943aa280 0x55eb943aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.971+0000 7fbda7400640 1 -- 172.21.15.37:0/1964162919 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb9439c280 con 0x55eb9439e2f0 2024-08-20T05:10:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.971+0000 7fbda7e00640 1 --2- 172.21.15.37:0/1964162919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 0x55eb943ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:10:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.971+0000 7fbda7400640 1 --2- 172.21.15.37:0/1964162919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb9439e2f0 0x55eb943ae720 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbd940aa940 tx=0x7fbd9400fcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cebc7d5db6a67a13 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.971+0000 7fbd91600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:10:23.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.972+0000 7fbd91600640 1 -- 172.21.15.37:0/1964162919 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd940aac40 con 0x55eb9439e2f0 2024-08-20T05:10:23.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.973+0000 7fbd91600640 1 -- 172.21.15.37:0/1964162919 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbd940aaea0 con 0x55eb9439e2f0 2024-08-20T05:10:23.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.973+0000 7fbdb17d0740 1 -- 172.21.15.37:0/1964162919 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbda001e430 con 0x55eb9439e2f0 2024-08-20T05:10:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.977+0000 7fbd91600640 1 -- 172.21.15.37:0/1964162919 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fbd940af240 con 0x55eb9439e2f0 2024-08-20T05:10:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.977+0000 7fbdb17d0740 10 client.27565 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:23.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.977+0000 7fbdb17d0740 1 -- 172.21.15.37:0/1964162919 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55eb94424bd0 con 0x55eb9439e2f0 2024-08-20T05:10:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.978+0000 7fbd91600640 1 -- 172.21.15.37:0/1964162919 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbda001e430 con 0x55eb9439e2f0 2024-08-20T05:10:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.978+0000 7fbd91600640 1 -- 172.21.15.37:0/1964162919 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7fbd940a65b0 con 0x55eb9439e2f0 2024-08-20T05:10:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.978+0000 7fbdb17d0740 10 client.27565 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.978+0000 7fbdb17d0740 10 client.27565 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:10:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.978+0000 7fbdb17d0740 20 client.27565 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:23.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.978+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/1964162919 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55eb944253a0 0x55eb944277c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:23.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.978+0000 7fbdb17d0740 4 client.27565 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T05:10:23.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.978+0000 7fbdb17d0740 1 -- 172.21.15.37:0/1964162919 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55eb94312260 con 0x55eb944253a0 2024-08-20T05:10:23.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.978+0000 7fbda7e00640 1 --2- 172.21.15.37:0/1964162919 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55eb944253a0 0x55eb944277c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:23.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.979+0000 7fbda7e00640 1 --2- 172.21.15.37:0/1964162919 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55eb944253a0 0x55eb944277c0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24c2dc2356fa341f server_cookie=b3e0bea8008be78 in_seq=0 out_seq=0 2024-08-20T05:10:23.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.979+0000 7fbd91600640 10 client.27565 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:23.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.980+0000 7fbd91600640 1 -- 172.21.15.37:0/1964162919 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55eb94312260 con 0x55eb944253a0 2024-08-20T05:10:23.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.980+0000 7fbd91600640 10 client.27565 handle_command_reply: tid=0 2024-08-20T05:10:23.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.980+0000 7fbdb17d0740 1 client.27565 shutdown 2024-08-20T05:10:23.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.981+0000 7fbdb17d0740 1 -- 172.21.15.37:0/1964162919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb9439e2f0 msgr2=0x55eb943ae720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:23.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.981+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/1964162919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb9439e2f0 0x55eb943ae720 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbd940aa940 tx=0x7fbd9400fcc0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.981+0000 7fbdb17d0740 1 -- 172.21.15.37:0/1964162919 shutdown_connections 2024-08-20T05:10:23.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.981+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/1964162919 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55eb944253a0 0x55eb944277c0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.981+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/1964162919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55eb943aa280 0x55eb943aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.981+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/1964162919 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55eb9439e2f0 0x55eb943ae720 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.981+0000 7fbdb17d0740 1 --2- 172.21.15.37:0/1964162919 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55eb9439d9d0 0x55eb943ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.981+0000 7fbd91600640 0 client.27565 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.981+0000 7fbdb17d0740 1 -- 172.21.15.37:0/1964162919 >> 172.21.15.37:0/1964162919 conn(0x55eb9439b800 msgr2=0x55eb943a6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.981+0000 7fbdb17d0740 1 -- 172.21.15.37:0/1964162919 shutdown_connections 2024-08-20T05:10:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.981+0000 7fbdb17d0740 1 -- 172.21.15.37:0/1964162919 wait complete. 2024-08-20T05:10:23.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.981+0000 7fbdb17d0740 20 client.27565 trim_cache size 0 max 16384 2024-08-20T05:10:23.984 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:10:23.984 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-20T05:10:23.985 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "019508da-0323-4a5c-a6e7-3ff764533f1c", 2024-08-20T05:10:23.985 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-20T05:10:23.985 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:10:23.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.984+0000 7fbdaec00640 1 -- 172.21.15.37:0/728594656 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd8c0b3de0 msgr2=0x7fbd8c0b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:23.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.984+0000 7fbdaec00640 1 --2- 172.21.15.37:0/728594656 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd8c0b3de0 0x7fbd8c0b62a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbd98005ab0 tx=0x7fbd9800b040 comp rx=0 tx=0).stop 2024-08-20T05:10:23.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.984+0000 7fbdaec00640 1 -- 172.21.15.37:0/728594656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbda810a7a0 msgr2=0x7fbda8114800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:23.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.984+0000 7fbdaec00640 1 --2- 172.21.15.37:0/728594656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbda810a7a0 0x7fbda8114800 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400c920 tx=0x7fbd9400cde0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.984+0000 7fbdaec00640 1 -- 172.21.15.37:0/728594656 shutdown_connections 2024-08-20T05:10:23.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.984+0000 7fbdaec00640 1 --2- 172.21.15.37:0/728594656 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd8c0b3de0 0x7fbd8c0b62a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.984+0000 7fbdaec00640 1 --2- 172.21.15.37:0/728594656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbda8115740 0x7fbda81a4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.984+0000 7fbdaec00640 1 --2- 172.21.15.37:0/728594656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbda810a7a0 0x7fbda8114800 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.984+0000 7fbdaec00640 1 --2- 172.21.15.37:0/728594656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbda8109e80 0x7fbda81142c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:23.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.984+0000 7fbdaec00640 1 -- 172.21.15.37:0/728594656 >> 172.21.15.37:0/728594656 conn(0x7fbda806dcc0 msgr2=0x7fbda80733e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:23.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.985+0000 7fbdaec00640 1 -- 172.21.15.37:0/728594656 shutdown_connections 2024-08-20T05:10:23.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:23.985+0000 7fbdaec00640 1 -- 172.21.15.37:0/728594656 wait complete. 2024-08-20T05:10:24.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:24 smithi130 ceph-mon[22007]: scrub queued for path: / 2024-08-20T05:10:24.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:24 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:24.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:24 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:10:24.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:24 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:10:24.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:24 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:24.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:24 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:10:24.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:24 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:10:24.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:24 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:24.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:24 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:24.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:24 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:24 smithi037 ceph-mon[17265]: scrub queued for path: / 2024-08-20T05:10:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:24 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:24 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:10:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:24 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:10:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:24 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:24 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:10:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:24 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:10:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:24 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:24 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:24.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:24 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:24 smithi135 ceph-mon[22342]: scrub queued for path: / 2024-08-20T05:10:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:24 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:24 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:10:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:24 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:10:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:24 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:24 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:10:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:24 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:10:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:24 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:24 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:24.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:24 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:24.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:10:25.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:25 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:10:25.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:25 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:10:25.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:25 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:25.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:25 smithi130 ceph-mon[22007]: pgmap v646: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 17 MiB/s wr, 1.36k op/s 2024-08-20T05:10:25.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:25 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:25.707 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:10:25.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:25 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:10:25.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:25 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:10:25.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:25 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:25.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:25 smithi037 ceph-mon[17265]: pgmap v646: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 17 MiB/s wr, 1.36k op/s 2024-08-20T05:10:25.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:25 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:25.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:25 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:10:25.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:25 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:10:25.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:25 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:25.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:25 smithi135 ceph-mon[22342]: pgmap v646: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 17 MiB/s wr, 1.36k op/s 2024-08-20T05:10:25.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:25 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:10:26.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.490+0000 7f4b72800640 1 -- 172.21.15.37:0/3320955572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b6c10b030 msgr2=0x7f4b6c111830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:26.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.490+0000 7f4b72800640 1 --2- 172.21.15.37:0/3320955572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b6c10b030 0x7f4b6c111830 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009ca0 tx=0x7f4b6402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.494+0000 7f4b72800640 1 -- 172.21.15.37:0/3320955572 shutdown_connections 2024-08-20T05:10:26.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.494+0000 7f4b72800640 1 --2- 172.21.15.37:0/3320955572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b6c10b030 0x7f4b6c111830 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.494+0000 7f4b72800640 1 --2- 172.21.15.37:0/3320955572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b6c10a6b0 0x7f4b6c10aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.494+0000 7f4b72800640 1 --2- 172.21.15.37:0/3320955572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b6c104ca0 0x7f4b6c105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.494+0000 7f4b72800640 1 -- 172.21.15.37:0/3320955572 >> 172.21.15.37:0/3320955572 conn(0x7f4b6c100730 msgr2=0x7f4b6c102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:26.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.494+0000 7f4b72800640 1 -- 172.21.15.37:0/3320955572 shutdown_connections 2024-08-20T05:10:26.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.494+0000 7f4b72800640 1 -- 172.21.15.37:0/3320955572 wait complete. 2024-08-20T05:10:26.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.496+0000 7f4b72800640 1 Processor -- start 2024-08-20T05:10:26.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.496+0000 7f4b72800640 1 -- start start 2024-08-20T05:10:26.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.496+0000 7f4b72800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b6c104ca0 0x7f4b6c19b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.497+0000 7f4b72800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b6c10a6b0 0x7f4b6c19b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.497+0000 7f4b72800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b6c10b030 0x7f4b6c1a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.497+0000 7f4b72800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c114d00 con 0x7f4b6c10b030 2024-08-20T05:10:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.497+0000 7f4b72800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c114b80 con 0x7f4b6c104ca0 2024-08-20T05:10:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.497+0000 7f4b72800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6c114e80 con 0x7f4b6c10a6b0 2024-08-20T05:10:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.497+0000 7f4b6aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b6c10a6b0 0x7f4b6c19b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.497+0000 7f4b6aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b6c10a6b0 0x7f4b6c19b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:55366/0 (socket says 172.21.15.37:55366) 2024-08-20T05:10:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.497+0000 7f4b6aa00640 1 -- 172.21.15.37:0/1952464222 learned_addr learned my addr 172.21.15.37:0/1952464222 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.497+0000 7f4b6be00640 1 --2- 172.21.15.37:0/1952464222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b6c10b030 0x7f4b6c1a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.497+0000 7f4b6b400640 1 --2- 172.21.15.37:0/1952464222 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b6c104ca0 0x7f4b6c19b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:26.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.500+0000 7f4b6b400640 1 -- 172.21.15.37:0/1952464222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b6c10a6b0 msgr2=0x7f4b6c19b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:26.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.500+0000 7f4b6b400640 1 --2- 172.21.15.37:0/1952464222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b6c10a6b0 0x7f4b6c19b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.500+0000 7f4b6b400640 1 -- 172.21.15.37:0/1952464222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b6c10b030 msgr2=0x7f4b6c1a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:26.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.501+0000 7f4b6b400640 1 --2- 172.21.15.37:0/1952464222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b6c10b030 0x7f4b6c1a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.501+0000 7f4b6b400640 1 -- 172.21.15.37:0/1952464222 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6c1a1260 con 0x7f4b6c104ca0 2024-08-20T05:10:26.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.502+0000 7f4b6b400640 1 --2- 172.21.15.37:0/1952464222 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b6c104ca0 0x7f4b6c19b1b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00d6d0 tx=0x7f4b5c00db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.502+0000 7f4b63e00640 1 -- 172.21.15.37:0/1952464222 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c017070 con 0x7f4b6c104ca0 2024-08-20T05:10:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.502+0000 7f4b72800640 1 -- 172.21.15.37:0/1952464222 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6c1a1550 con 0x7f4b6c104ca0 2024-08-20T05:10:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.502+0000 7f4b72800640 1 -- 172.21.15.37:0/1952464222 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b6c06ca70 con 0x7f4b6c104ca0 2024-08-20T05:10:26.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.503+0000 7f4b63e00640 1 -- 172.21.15.37:0/1952464222 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b5c009820 con 0x7f4b6c104ca0 2024-08-20T05:10:26.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.503+0000 7f4b63e00640 1 -- 172.21.15.37:0/1952464222 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c004bc0 con 0x7f4b6c104ca0 2024-08-20T05:10:26.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.507+0000 7f4b753e3740 1 Processor -- start 2024-08-20T05:10:26.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.510+0000 7f4b753e3740 1 -- start start 2024-08-20T05:10:26.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.510+0000 7f4b753e3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4718ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.510+0000 7f4b753e3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e4719220 0x5614e4724c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.510+0000 7f4b753e3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e47251b0 0x5614e47275a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.510+0000 7f4b753e3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5614e468ea60 con 0x5614e47251b0 2024-08-20T05:10:26.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.510+0000 7f4b753e3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5614e467df60 con 0x5614e4718900 2024-08-20T05:10:26.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.510+0000 7f4b753e3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5614e4681fa0 con 0x5614e4719220 2024-08-20T05:10:26.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.511+0000 7f4b6aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e47251b0 0x5614e47275a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:26.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.511+0000 7f4b6be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4718ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:26.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.511+0000 7f4b6be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4718ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56568/0 (socket says 172.21.15.37:56568) 2024-08-20T05:10:26.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.511+0000 7f4b6be00640 1 -- 172.21.15.37:0/1632543738 learned_addr learned my addr 172.21.15.37:0/1632543738 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:26.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.511+0000 7f4b6aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e47251b0 0x5614e47275a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39668/0 (socket says 172.21.15.37:39668) 2024-08-20T05:10:26.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.512+0000 7f4b63e00640 1 -- 172.21.15.37:0/1952464222 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4b5c005220 con 0x7f4b6c104ca0 2024-08-20T05:10:26.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.514+0000 7f4b6be00640 1 -- 172.21.15.37:0/1632543738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e4719220 msgr2=0x5614e4724c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:10:26.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.514+0000 7f4b6be00640 1 --2- 172.21.15.37:0/1632543738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e4719220 0x5614e4724c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.514+0000 7f4b6be00640 1 -- 172.21.15.37:0/1632543738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e47251b0 msgr2=0x5614e47275a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:26.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.514+0000 7f4b6be00640 1 --2- 172.21.15.37:0/1632543738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e47251b0 0x5614e47275a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.514+0000 7f4b6be00640 1 -- 172.21.15.37:0/1632543738 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614e46243e0 con 0x5614e4718900 2024-08-20T05:10:26.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.514+0000 7f4b6be00640 1 --2- 172.21.15.37:0/1632543738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4718ce0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009ca0 tx=0x7f4b6402f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33dfafd6f5a491a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:26.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.514+0000 7f4b60c00640 1 -- 172.21.15.37:0/1632543738 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64031db0 con 0x5614e4718900 2024-08-20T05:10:26.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.515+0000 7f4b60c00640 1 -- 172.21.15.37:0/1632543738 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b64036030 con 0x5614e4718900 2024-08-20T05:10:26.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.515+0000 7f4b60c00640 1 -- 172.21.15.37:0/1632543738 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b640042a0 con 0x5614e4718900 2024-08-20T05:10:26.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.515+0000 7f4b63e00640 1 --2- 172.21.15.37:0/1952464222 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4b500bc5e0 0x7f4b500beaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.516+0000 7f4b753e3740 1 -- 172.21.15.37:0/1632543738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 msgr2=0x5614e4718ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:26.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.516+0000 7f4b753e3740 1 --2- 172.21.15.37:0/1632543738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4718ce0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009ca0 tx=0x7f4b6402f3c0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.518+0000 7f4b63e00640 1 -- 172.21.15.37:0/1952464222 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4b5c004960 con 0x7f4b6c104ca0 2024-08-20T05:10:26.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.518+0000 7f4b6b400640 1 --2- 172.21.15.37:0/1952464222 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4b500bc5e0 0x7f4b500beaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:26.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.519+0000 7f4b753e3740 1 -- 172.21.15.37:0/1632543738 shutdown_connections 2024-08-20T05:10:26.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.519+0000 7f4b753e3740 1 --2- 172.21.15.37:0/1632543738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e47251b0 0x5614e47275a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.519+0000 7f4b753e3740 1 --2- 172.21.15.37:0/1632543738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e4719220 0x5614e4724c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.519+0000 7f4b753e3740 1 --2- 172.21.15.37:0/1632543738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4718ce0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.519+0000 7f4b753e3740 1 -- 172.21.15.37:0/1632543738 >> 172.21.15.37:0/1632543738 conn(0x5614e4716730 msgr2=0x5614e47178d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:26.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.519+0000 7f4b753e3740 1 -- 172.21.15.37:0/1632543738 shutdown_connections 2024-08-20T05:10:26.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.519+0000 7f4b753e3740 1 -- 172.21.15.37:0/1632543738 wait complete. 2024-08-20T05:10:26.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.522+0000 7f4b753e3740 1 -- start start 2024-08-20T05:10:26.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.524+0000 7f4b6b400640 1 --2- 172.21.15.37:0/1952464222 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4b500bc5e0 0x7f4b500beaa0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0a73b0 tx=0x7f4b5c0af7e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:26.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.524+0000 7f4b753e3740 1 Processor -- start 2024-08-20T05:10:26.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.527+0000 7f4b753e3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4724920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.528+0000 7f4b753e3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e4719220 0x5614e4721d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.528+0000 7f4b753e3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e47251b0 0x5614e47222b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.528+0000 7f4b753e3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5614e44e0700 con 0x5614e47251b0 2024-08-20T05:10:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.528+0000 7f4b753e3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5614e4619250 con 0x5614e4718900 2024-08-20T05:10:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.528+0000 7f4b753e3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5614e4727c50 con 0x5614e4719220 2024-08-20T05:10:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.528+0000 7f4b6be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4724920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.528+0000 7f4b6be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4724920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56572/0 (socket says 172.21.15.37:56572) 2024-08-20T05:10:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.528+0000 7f4b6be00640 1 -- 172.21.15.37:0/393551538 learned_addr learned my addr 172.21.15.37:0/393551538 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.528+0000 7f4b6be00640 1 --2- 172.21.15.37:0/393551538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e47251b0 0x5614e47222b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:26.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.529+0000 7f4b753e3740 10 client.0 _ll_register_callbacks cb 0x5614e4678180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:26.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.529+0000 7f4b6be00640 1 -- 172.21.15.37:0/393551538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e4719220 msgr2=0x5614e4721d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:26.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.529+0000 7f4b6aa00640 1 --2- 172.21.15.37:0/393551538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e4719220 0x5614e4721d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:26.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.529+0000 7f4b6be00640 1 --2- 172.21.15.37:0/393551538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e4719220 0x5614e4721d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.529+0000 7f4b6be00640 1 -- 172.21.15.37:0/393551538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e47251b0 msgr2=0x5614e47222b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:26.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.529+0000 7f4b6be00640 1 --2- 172.21.15.37:0/393551538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e47251b0 0x5614e47222b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.529+0000 7f4b6be00640 1 -- 172.21.15.37:0/393551538 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614e43dd650 con 0x5614e4718900 2024-08-20T05:10:26.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.529+0000 7f4b6aa00640 1 --2- 172.21.15.37:0/393551538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e4719220 0x5614e4721d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:10:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.531+0000 7f4b6be00640 1 --2- 172.21.15.37:0/393551538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4724920 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4b6402ade0 tx=0x7f4b64003db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ceb06590031bcd1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.531+0000 7f4b55600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:10:26.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.531+0000 7f4b55600640 1 -- 172.21.15.37:0/393551538 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64059060 con 0x5614e4718900 2024-08-20T05:10:26.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.532+0000 7f4b55600640 1 -- 172.21.15.37:0/393551538 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4b64004200 con 0x5614e4718900 2024-08-20T05:10:26.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.532+0000 7f4b753e3740 1 -- 172.21.15.37:0/393551538 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b64036030 con 0x5614e4718900 2024-08-20T05:10:26.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.533+0000 7f4b55600640 1 -- 172.21.15.37:0/393551538 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4b64004400 con 0x5614e4718900 2024-08-20T05:10:26.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.533+0000 7f4b753e3740 10 client.27569 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:26.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.533+0000 7f4b753e3740 1 -- 172.21.15.37:0/393551538 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5614e4733470 con 0x5614e4718900 2024-08-20T05:10:26.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.534+0000 7f4b55600640 1 -- 172.21.15.37:0/393551538 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b64036030 con 0x5614e4718900 2024-08-20T05:10:26.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.534+0000 7f4b55600640 1 -- 172.21.15.37:0/393551538 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f4b64050070 con 0x5614e4718900 2024-08-20T05:10:26.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.534+0000 7f4b753e3740 10 client.27569 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:26.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.534+0000 7f4b753e3740 10 client.27569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:10:26.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.534+0000 7f4b753e3740 20 client.27569 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:26.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.534+0000 7f4b753e3740 1 --2- 172.21.15.37:0/393551538 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5614e47347c0 0x5614e4736bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.534+0000 7f4b753e3740 4 client.27569 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:10:26.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.534+0000 7f4b753e3740 1 -- 172.21.15.37:0/393551538 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614e46909b0 con 0x5614e47347c0 2024-08-20T05:10:26.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.536+0000 7f4b6aa00640 1 --2- 172.21.15.37:0/393551538 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5614e47347c0 0x5614e4736bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.538+0000 7f4b6aa00640 1 --2- 172.21.15.37:0/393551538 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5614e47347c0 0x5614e4736bb0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3e9cccce565841e server_cookie=2515a905cdc1556d in_seq=0 out_seq=0 2024-08-20T05:10:26.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.538+0000 7f4b55600640 10 client.27569 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.539+0000 7f4b55600640 1 -- 172.21.15.37:0/393551538 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5614e46909b0 con 0x5614e47347c0 2024-08-20T05:10:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.539+0000 7f4b55600640 10 client.27569 handle_command_reply: tid=0 2024-08-20T05:10:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.539+0000 7f4b753e3740 1 client.27569 shutdown 2024-08-20T05:10:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.539+0000 7f4b753e3740 1 -- 172.21.15.37:0/393551538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 msgr2=0x5614e4724920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.539+0000 7f4b753e3740 1 --2- 172.21.15.37:0/393551538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4724920 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4b6402ade0 tx=0x7f4b64003db0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.541+0000 7f4b753e3740 1 -- 172.21.15.37:0/393551538 shutdown_connections 2024-08-20T05:10:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.541+0000 7f4b753e3740 1 --2- 172.21.15.37:0/393551538 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5614e47347c0 0x5614e4736bb0 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.541+0000 7f4b753e3740 1 --2- 172.21.15.37:0/393551538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e47251b0 0x5614e47222b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.541+0000 7f4b753e3740 1 --2- 172.21.15.37:0/393551538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e4719220 0x5614e4721d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.541+0000 7f4b753e3740 1 --2- 172.21.15.37:0/393551538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4724920 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.541+0000 7f4b55600640 0 client.27569 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:26.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.541+0000 7f4b753e3740 1 -- 172.21.15.37:0/393551538 >> 172.21.15.37:0/393551538 conn(0x5614e4716730 msgr2=0x5614e471c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:26.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.541+0000 7f4b753e3740 1 -- 172.21.15.37:0/393551538 shutdown_connections 2024-08-20T05:10:26.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.541+0000 7f4b753e3740 1 -- 172.21.15.37:0/393551538 wait complete. 2024-08-20T05:10:26.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.544+0000 7f4b753e3740 20 client.27569 trim_cache size 0 max 16384 2024-08-20T05:10:26.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.581+0000 7f4b753e3740 1 Processor -- start 2024-08-20T05:10:26.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.581+0000 7f4b753e3740 1 -- start start 2024-08-20T05:10:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.582+0000 7f4b753e3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4723e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.582+0000 7f4b753e3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e4719220 0x5614e473c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.582+0000 7f4b753e3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e47251b0 0x5614e473c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.582+0000 7f4b753e3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4c00fc20 con 0x5614e4719220 2024-08-20T05:10:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.582+0000 7f4b753e3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4c011880 con 0x5614e4718900 2024-08-20T05:10:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.582+0000 7f4b753e3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4c0102f0 con 0x5614e47251b0 2024-08-20T05:10:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.582+0000 7f4b6be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4723e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.582+0000 7f4b6be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4723e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56578/0 (socket says 172.21.15.37:56578) 2024-08-20T05:10:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.582+0000 7f4b6be00640 1 -- 172.21.15.37:0/755695122 learned_addr learned my addr 172.21.15.37:0/755695122 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.582+0000 7f4b6be00640 1 --2- 172.21.15.37:0/755695122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e47251b0 0x5614e473c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.584+0000 7f4b6be00640 1 -- 172.21.15.37:0/755695122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e47251b0 msgr2=0x5614e473c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.584+0000 7f4b6be00640 1 --2- 172.21.15.37:0/755695122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e47251b0 0x5614e473c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.584+0000 7f4b6be00640 1 -- 172.21.15.37:0/755695122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e4719220 msgr2=0x5614e473c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.584+0000 7f4b6be00640 1 --2- 172.21.15.37:0/755695122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e4719220 0x5614e473c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.584+0000 7f4b6be00640 1 -- 172.21.15.37:0/755695122 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614e4711e90 con 0x5614e4718900 2024-08-20T05:10:26.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.584+0000 7f4b6be00640 1 --2- 172.21.15.37:0/755695122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4723e70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4b64030040 tx=0x7f4b6402a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=add08bb9f5cb513f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.584+0000 7f4b57e00640 1 -- 172.21.15.37:0/755695122 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64059040 con 0x5614e4718900 2024-08-20T05:10:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.585+0000 7f4b57e00640 1 -- 172.21.15.37:0/755695122 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b64036030 con 0x5614e4718900 2024-08-20T05:10:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.585+0000 7f4b57e00640 1 -- 172.21.15.37:0/755695122 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b64063080 con 0x5614e4718900 2024-08-20T05:10:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.586+0000 7f4b753e3740 1 -- 172.21.15.37:0/755695122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 msgr2=0x5614e4723e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.586+0000 7f4b753e3740 1 --2- 172.21.15.37:0/755695122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4723e70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4b64030040 tx=0x7f4b6402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.586+0000 7f4b753e3740 1 -- 172.21.15.37:0/755695122 shutdown_connections 2024-08-20T05:10:26.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.586+0000 7f4b753e3740 1 --2- 172.21.15.37:0/755695122 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e47251b0 0x5614e473c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.586+0000 7f4b753e3740 1 --2- 172.21.15.37:0/755695122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e4719220 0x5614e473c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.587+0000 7f4b753e3740 1 --2- 172.21.15.37:0/755695122 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e4718900 0x5614e4723e70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.587+0000 7f4b753e3740 1 -- 172.21.15.37:0/755695122 >> 172.21.15.37:0/755695122 conn(0x5614e4716730 msgr2=0x5614e4717c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.588+0000 7f4b753e3740 1 -- 172.21.15.37:0/755695122 shutdown_connections 2024-08-20T05:10:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.588+0000 7f4b753e3740 1 -- 172.21.15.37:0/755695122 wait complete. 2024-08-20T05:10:26.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.590+0000 7f4b753e3740 1 -- start start 2024-08-20T05:10:26.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.590+0000 7f4b753e3740 1 Processor -- start 2024-08-20T05:10:26.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.591+0000 7f4b753e3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e4718900 0x5614e472d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.592+0000 7f4b753e3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e4719220 0x5614e471ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.592+0000 7f4b753e3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e47251b0 0x5614e471f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.592+0000 7f4b753e3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4c0110f0 con 0x5614e4718900 2024-08-20T05:10:26.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.592+0000 7f4b753e3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4c0109c0 con 0x5614e47251b0 2024-08-20T05:10:26.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.592+0000 7f4b753e3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4c00dc00 con 0x5614e4719220 2024-08-20T05:10:26.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.592+0000 7f4b753e3740 10 client.0 _ll_register_callbacks cb 0x7f4b6402f310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:26.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.592+0000 7f4b6aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e4719220 0x5614e471ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:26.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.592+0000 7f4b6aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e4719220 0x5614e471ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:55398/0 (socket says 172.21.15.37:55398) 2024-08-20T05:10:26.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.592+0000 7f4b6aa00640 1 -- 172.21.15.37:0/1350368437 learned_addr learned my addr 172.21.15.37:0/1350368437 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:26.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.593+0000 7f4b6be00640 1 --2- 172.21.15.37:0/1350368437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e4718900 0x5614e472d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:26.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.593+0000 7f4b6be00640 1 --2- 172.21.15.37:0/1350368437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e47251b0 0x5614e471f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:26.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.593+0000 7f4b6aa00640 1 -- 172.21.15.37:0/1350368437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e47251b0 msgr2=0x5614e471f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:26.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.593+0000 7f4b6aa00640 1 --2- 172.21.15.37:0/1350368437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e47251b0 0x5614e471f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.593+0000 7f4b6aa00640 1 -- 172.21.15.37:0/1350368437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e4718900 msgr2=0x5614e472d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:26.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.593+0000 7f4b6aa00640 1 --2- 172.21.15.37:0/1350368437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e4718900 0x5614e472d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.593+0000 7f4b6aa00640 1 -- 172.21.15.37:0/1350368437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614e479e340 con 0x5614e4719220 2024-08-20T05:10:26.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.593+0000 7f4b6be00640 1 --2- 172.21.15.37:0/1350368437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e47251b0 0x5614e471f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:10:26.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.594+0000 7f4b6aa00640 1 --2- 172.21.15.37:0/1350368437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e4719220 0x5614e471ec90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x5614e47372e0 tx=0x7f4b58009cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da6556027c5194bb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:26.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.594+0000 7f4b55600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:10:26.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.595+0000 7f4b55600640 1 -- 172.21.15.37:0/1350368437 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b58005020 con 0x5614e4719220 2024-08-20T05:10:26.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.595+0000 7f4b55600640 1 -- 172.21.15.37:0/1350368437 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4b580051c0 con 0x5614e4719220 2024-08-20T05:10:26.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.595+0000 7f4b753e3740 1 -- 172.21.15.37:0/1350368437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b64036030 con 0x5614e4719220 2024-08-20T05:10:26.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.595+0000 7f4b55600640 1 -- 172.21.15.37:0/1350368437 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4b5803c050 con 0x5614e4719220 2024-08-20T05:10:26.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.597+0000 7f4b753e3740 10 client.27577 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:26.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.597+0000 7f4b753e3740 1 -- 172.21.15.37:0/1350368437 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5614e479f5a0 con 0x5614e4719220 2024-08-20T05:10:26.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.598+0000 7f4b55600640 1 -- 172.21.15.37:0/1350368437 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b64036030 con 0x5614e4719220 2024-08-20T05:10:26.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.598+0000 7f4b55600640 1 -- 172.21.15.37:0/1350368437 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f4b58021440 con 0x5614e4719220 2024-08-20T05:10:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.598+0000 7f4b753e3740 10 client.27577 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.598+0000 7f4b753e3740 10 client.27577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:10:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.598+0000 7f4b753e3740 20 client.27577 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.598+0000 7f4b753e3740 1 --2- 172.21.15.37:0/1350368437 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5614e479fe10 0x5614e47a2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.598+0000 7f4b753e3740 4 client.27577 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:10:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.598+0000 7f4b753e3740 1 -- 172.21.15.37:0/1350368437 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5614e4727980 con 0x5614e479fe10 2024-08-20T05:10:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.598+0000 7f4b6be00640 1 --2- 172.21.15.37:0/1350368437 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5614e479fe10 0x5614e47a2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.599+0000 7f4b6be00640 1 --2- 172.21.15.37:0/1350368437 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5614e479fe10 0x5614e47a2230 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbd1efb5785c9cef server_cookie=1c979a5257cb3254 in_seq=0 out_seq=0 2024-08-20T05:10:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.599+0000 7f4b55600640 10 client.27577 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.600+0000 7f4b55600640 1 -- 172.21.15.37:0/1350368437 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5614e4727980 con 0x5614e479fe10 2024-08-20T05:10:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.600+0000 7f4b55600640 10 client.27577 handle_command_reply: tid=0 2024-08-20T05:10:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.600+0000 7f4b753e3740 1 client.27577 shutdown 2024-08-20T05:10:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.600+0000 7f4b753e3740 1 -- 172.21.15.37:0/1350368437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e4719220 msgr2=0x5614e471ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.600+0000 7f4b753e3740 1 --2- 172.21.15.37:0/1350368437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e4719220 0x5614e471ec90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x5614e47372e0 tx=0x7f4b58009cf0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.601+0000 7f4b753e3740 1 -- 172.21.15.37:0/1350368437 shutdown_connections 2024-08-20T05:10:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.601+0000 7f4b753e3740 1 --2- 172.21.15.37:0/1350368437 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5614e479fe10 0x5614e47a2230 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.601+0000 7f4b753e3740 1 --2- 172.21.15.37:0/1350368437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5614e47251b0 0x5614e471f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.601+0000 7f4b753e3740 1 --2- 172.21.15.37:0/1350368437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5614e4719220 0x5614e471ec90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.601+0000 7f4b753e3740 1 --2- 172.21.15.37:0/1350368437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5614e4718900 0x5614e472d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.601+0000 7f4b753e3740 1 -- 172.21.15.37:0/1350368437 >> 172.21.15.37:0/1350368437 conn(0x5614e4716730 msgr2=0x5614e4714ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.601+0000 7f4b55600640 0 client.27577 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.601+0000 7f4b753e3740 1 -- 172.21.15.37:0/1350368437 shutdown_connections 2024-08-20T05:10:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.602+0000 7f4b753e3740 1 -- 172.21.15.37:0/1350368437 wait complete. 2024-08-20T05:10:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.602+0000 7f4b753e3740 20 client.27577 trim_cache size 0 max 16384 2024-08-20T05:10:26.605 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:10:26.605 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T05:10:26.606 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-20T05:10:26.606 INFO:teuthology.orchestra.run.smithi037.stdout: "019508da-0323-4a5c-a6e7-3ff764533f1c": { 2024-08-20T05:10:26.606 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-20T05:10:26.606 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "019508da-0323-4a5c-a6e7-3ff764533f1c", 2024-08-20T05:10:26.606 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-20T05:10:26.606 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:10:26.606 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:10:26.606 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:10:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.603+0000 7f4b72800640 1 -- 172.21.15.37:0/1952464222 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4b500bc5e0 msgr2=0x7f4b500beaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.603+0000 7f4b72800640 1 --2- 172.21.15.37:0/1952464222 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4b500bc5e0 0x7f4b500beaa0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0a73b0 tx=0x7f4b5c0af7e0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.603+0000 7f4b72800640 1 -- 172.21.15.37:0/1952464222 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b6c104ca0 msgr2=0x7f4b6c19b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.603+0000 7f4b72800640 1 --2- 172.21.15.37:0/1952464222 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b6c104ca0 0x7f4b6c19b1b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00d6d0 tx=0x7f4b5c00db90 comp rx=0 tx=0).stop 2024-08-20T05:10:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.604+0000 7f4b72800640 1 -- 172.21.15.37:0/1952464222 shutdown_connections 2024-08-20T05:10:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.604+0000 7f4b72800640 1 --2- 172.21.15.37:0/1952464222 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4b500bc5e0 0x7f4b500beaa0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.604+0000 7f4b72800640 1 --2- 172.21.15.37:0/1952464222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b6c10b030 0x7f4b6c1a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.604+0000 7f4b72800640 1 --2- 172.21.15.37:0/1952464222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4b6c10a6b0 0x7f4b6c19b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.604+0000 7f4b72800640 1 --2- 172.21.15.37:0/1952464222 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4b6c104ca0 0x7f4b6c19b1b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.604+0000 7f4b72800640 1 -- 172.21.15.37:0/1952464222 >> 172.21.15.37:0/1952464222 conn(0x7f4b6c100730 msgr2=0x7f4b6c101030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.605+0000 7f4b72800640 1 -- 172.21.15.37:0/1952464222 shutdown_connections 2024-08-20T05:10:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:26.605+0000 7f4b72800640 1 -- 172.21.15.37:0/1952464222 wait complete. 2024-08-20T05:10:27.655 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:27 smithi037 ceph-mon[17265]: pgmap v647: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 13 MiB/s wr, 1.16k op/s 2024-08-20T05:10:27.659 INFO:tasks.cephfs.filesystem:scrub status for tag:019508da-0323-4a5c-a6e7-3ff764533f1c - {'path': '/', 'tag': '019508da-0323-4a5c-a6e7-3ff764533f1c', 'options': 'recursive,force'} 2024-08-20T05:10:27.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:27 smithi130 ceph-mon[22007]: pgmap v647: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 13 MiB/s wr, 1.16k op/s 2024-08-20T05:10:27.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:27 smithi135 ceph-mon[22342]: pgmap v647: 129 pgs: 129 active+clean; 1.4 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 13 MiB/s wr, 1.16k op/s 2024-08-20T05:10:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 450.0 s, 781.2 tps, lat 123.204 ms stddev 171.133 2024-08-20T05:10:29.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:29 smithi130 ceph-mon[22007]: pgmap v648: 129 pgs: 129 active+clean; 1.4 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 7.4 MiB/s wr, 708 op/s 2024-08-20T05:10:29.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:29 smithi037 ceph-mon[17265]: pgmap v648: 129 pgs: 129 active+clean; 1.4 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 7.4 MiB/s wr, 708 op/s 2024-08-20T05:10:29.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:29 smithi135 ceph-mon[22342]: pgmap v648: 129 pgs: 129 active+clean; 1.4 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 7.4 MiB/s wr, 708 op/s 2024-08-20T05:10:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.650+0000 7f4e0fa00640 1 -- 172.21.15.37:0/300685685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e081009a0 msgr2=0x7f4e08100da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.650+0000 7f4e0fa00640 1 --2- 172.21.15.37:0/300685685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e081009a0 0x7f4e08100da0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009900 tx=0x7f4dfc02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.650+0000 7f4e0fa00640 1 -- 172.21.15.37:0/300685685 shutdown_connections 2024-08-20T05:10:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.650+0000 7f4e0fa00640 1 --2- 172.21.15.37:0/300685685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e08101f30 0x7f4e081069a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.650+0000 7f4e0fa00640 1 --2- 172.21.15.37:0/300685685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e08101370 0x7f4e081017f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.650+0000 7f4e0fa00640 1 --2- 172.21.15.37:0/300685685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e081009a0 0x7f4e08100da0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.650+0000 7f4e0fa00640 1 -- 172.21.15.37:0/300685685 >> 172.21.15.37:0/300685685 conn(0x7f4e080fc5e0 msgr2=0x7f4e080fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.650+0000 7f4e0fa00640 1 -- 172.21.15.37:0/300685685 shutdown_connections 2024-08-20T05:10:31.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.651+0000 7f4e0fa00640 1 -- 172.21.15.37:0/300685685 wait complete. 2024-08-20T05:10:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.652+0000 7f4e0fa00640 1 Processor -- start 2024-08-20T05:10:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.652+0000 7f4e0fa00640 1 -- start start 2024-08-20T05:10:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.652+0000 7f4e0fa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e081009a0 0x7f4e0819f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.652+0000 7f4e0fa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e08101370 0x7f4e0819f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.652+0000 7f4e0fa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e08101f30 0x7f4e081a0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.652+0000 7f4e0fa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4e08114910 con 0x7f4e081009a0 2024-08-20T05:10:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.652+0000 7f4e0fa00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4e08114790 con 0x7f4e08101370 2024-08-20T05:10:31.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.652+0000 7f4e0fa00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4e08114a90 con 0x7f4e08101f30 2024-08-20T05:10:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.653+0000 7f4e07e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e08101370 0x7f4e0819f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.653+0000 7f4e0da00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e08101f30 0x7f4e081a0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.653+0000 7f4e0d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e081009a0 0x7f4e0819f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.653+0000 7f4e0da00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e08101f30 0x7f4e081a0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:55404/0 (socket says 172.21.15.37:55404) 2024-08-20T05:10:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.653+0000 7f4e0da00640 1 -- 172.21.15.37:0/2872916613 learned_addr learned my addr 172.21.15.37:0/2872916613 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.653+0000 7f4e0d000640 1 -- 172.21.15.37:0/2872916613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e08101f30 msgr2=0x7f4e081a0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.653+0000 7f4e0d000640 1 --2- 172.21.15.37:0/2872916613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e08101f30 0x7f4e081a0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.653+0000 7f4e0d000640 1 -- 172.21.15.37:0/2872916613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e08101370 msgr2=0x7f4e0819f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:31.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.653+0000 7f4e0d000640 1 --2- 172.21.15.37:0/2872916613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e08101370 0x7f4e0819f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.653+0000 7f4e0d000640 1 -- 172.21.15.37:0/2872916613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e081a0c00 con 0x7f4e081009a0 2024-08-20T05:10:31.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.654+0000 7f4e0d000640 1 --2- 172.21.15.37:0/2872916613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e081009a0 0x7f4e0819f0c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc02a9e0 tx=0x7f4dfc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:31.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.654+0000 7f4e05600640 1 -- 172.21.15.37:0/2872916613 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc03f070 con 0x7f4e081009a0 2024-08-20T05:10:31.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.654+0000 7f4e05600640 1 -- 172.21.15.37:0/2872916613 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4dfc031c60 con 0x7f4e081009a0 2024-08-20T05:10:31.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.654+0000 7f4e0fa00640 1 -- 172.21.15.37:0/2872916613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e081a0e90 con 0x7f4e081009a0 2024-08-20T05:10:31.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.654+0000 7f4e05600640 1 -- 172.21.15.37:0/2872916613 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc035030 con 0x7f4e081009a0 2024-08-20T05:10:31.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.654+0000 7f4e0fa00640 1 -- 172.21.15.37:0/2872916613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e081a75c0 con 0x7f4e081009a0 2024-08-20T05:10:31.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.657+0000 7f4e129fd740 1 Processor -- start 2024-08-20T05:10:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.658+0000 7f4e129fd740 1 -- start start 2024-08-20T05:10:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.658+0000 7f4e129fd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2d610 0x558539d2fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.658+0000 7f4e129fd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2ff40 0x558539d32330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.658+0000 7f4e129fd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d32980 0x558539d34e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.658+0000 7f4e129fd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558539ca0210 con 0x558539d2d610 2024-08-20T05:10:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.658+0000 7f4e129fd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558539c8f710 con 0x558539d32980 2024-08-20T05:10:31.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.658+0000 7f4e129fd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558539c93750 con 0x558539d2ff40 2024-08-20T05:10:31.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.658+0000 7f4e05600640 1 -- 172.21.15.37:0/2872916613 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4dfc042070 con 0x7f4e081009a0 2024-08-20T05:10:31.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.659+0000 7f4e0da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2d610 0x558539d2fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.659+0000 7f4e0da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2d610 0x558539d2fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39710/0 (socket says 172.21.15.37:39710) 2024-08-20T05:10:31.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.659+0000 7f4e0da00640 1 -- 172.21.15.37:0/4048389344 learned_addr learned my addr 172.21.15.37:0/4048389344 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:31.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.659+0000 7f4e0d000640 1 --2- 172.21.15.37:0/4048389344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2ff40 0x558539d32330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.659+0000 7f4e07e00640 1 --2- 172.21.15.37:0/4048389344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d32980 0x558539d34e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.660+0000 7f4e07e00640 1 -- 172.21.15.37:0/4048389344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2ff40 msgr2=0x558539d32330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:31.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.660+0000 7f4e07e00640 1 --2- 172.21.15.37:0/4048389344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2ff40 0x558539d32330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.660+0000 7f4e07e00640 1 -- 172.21.15.37:0/4048389344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2d610 msgr2=0x558539d2fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:31.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.660+0000 7f4e07e00640 1 --2- 172.21.15.37:0/4048389344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2d610 0x558539d2fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.660+0000 7f4e07e00640 1 -- 172.21.15.37:0/4048389344 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558539c5bde0 con 0x558539d32980 2024-08-20T05:10:31.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.660+0000 7f4e0da00640 1 --2- 172.21.15.37:0/4048389344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2d610 0x558539d2fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:10:31.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.662+0000 7f4e07e00640 1 --2- 172.21.15.37:0/4048389344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d32980 0x558539d34e40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009c20 tx=0x7f4df4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36301d86c90558e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:31.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.662+0000 7f4dfa000640 1 -- 172.21.15.37:0/4048389344 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df4009dd0 con 0x558539d32980 2024-08-20T05:10:31.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.662+0000 7f4dfa000640 1 -- 172.21.15.37:0/4048389344 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4df4005020 con 0x558539d32980 2024-08-20T05:10:31.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.662+0000 7f4dfa000640 1 -- 172.21.15.37:0/4048389344 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df4004b20 con 0x558539d32980 2024-08-20T05:10:31.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.664+0000 7f4e05600640 1 --2- 172.21.15.37:0/2872916613 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4df00b3cd0 0x7f4df00b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.664+0000 7f4e129fd740 1 -- 172.21.15.37:0/4048389344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d32980 msgr2=0x558539d34e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.664+0000 7f4e129fd740 1 --2- 172.21.15.37:0/4048389344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d32980 0x558539d34e40 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4df4009c20 tx=0x7f4df4011810 comp rx=0 tx=0).stop 2024-08-20T05:10:31.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.664+0000 7f4e05600640 1 -- 172.21.15.37:0/2872916613 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4dfc104600 con 0x7f4e081009a0 2024-08-20T05:10:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.665+0000 7f4e129fd740 1 -- 172.21.15.37:0/4048389344 shutdown_connections 2024-08-20T05:10:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.665+0000 7f4e129fd740 1 --2- 172.21.15.37:0/4048389344 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d32980 0x558539d34e40 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.665+0000 7f4e129fd740 1 --2- 172.21.15.37:0/4048389344 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2ff40 0x558539d32330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.665+0000 7f4e129fd740 1 --2- 172.21.15.37:0/4048389344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2d610 0x558539d2fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.665+0000 7f4e0da00640 1 --2- 172.21.15.37:0/2872916613 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4df00b3cd0 0x7f4df00b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.665+0000 7f4e129fd740 1 -- 172.21.15.37:0/4048389344 >> 172.21.15.37:0/4048389344 conn(0x558539d28760 msgr2=0x558539d294f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:31.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.665+0000 7f4e129fd740 1 -- 172.21.15.37:0/4048389344 shutdown_connections 2024-08-20T05:10:31.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.666+0000 7f4e129fd740 1 -- 172.21.15.37:0/4048389344 wait complete. 2024-08-20T05:10:31.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.666+0000 7f4e0da00640 1 --2- 172.21.15.37:0/2872916613 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4df00b3cd0 0x7f4df00b6190 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4e00012640 tx=0x7f4e00009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:31.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.666+0000 7f4e129fd740 1 -- start start 2024-08-20T05:10:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.667+0000 7f4e129fd740 1 Processor -- start 2024-08-20T05:10:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.667+0000 7f4e129fd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2d610 0x558539d47cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.667+0000 7f4e129fd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2ff40 0x558539d48360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.667+0000 7f4e129fd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d32980 0x558539d48f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.667+0000 7f4e129fd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558539bc8ab0 con 0x558539d2d610 2024-08-20T05:10:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.667+0000 7f4e129fd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558539c36140 con 0x558539d32980 2024-08-20T05:10:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.667+0000 7f4e129fd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558539d46970 con 0x558539d2ff40 2024-08-20T05:10:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.667+0000 7f4e129fd740 10 client.0 _ll_register_callbacks cb 0x558539c495d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.667+0000 7f4e0da00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d32980 0x558539d48f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.668+0000 7f4e0da00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d32980 0x558539d48f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56630/0 (socket says 172.21.15.37:56630) 2024-08-20T05:10:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.668+0000 7f4e0da00640 1 -- 172.21.15.37:0/2432773765 learned_addr learned my addr 172.21.15.37:0/2432773765 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.668+0000 7f4e0d000640 1 --2- 172.21.15.37:0/2432773765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2d610 0x558539d47cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.668+0000 7f4e07e00640 1 --2- 172.21.15.37:0/2432773765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2ff40 0x558539d48360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.668+0000 7f4e0da00640 1 -- 172.21.15.37:0/2432773765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2ff40 msgr2=0x558539d48360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.668+0000 7f4e0da00640 1 --2- 172.21.15.37:0/2432773765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2ff40 0x558539d48360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.668+0000 7f4e0da00640 1 -- 172.21.15.37:0/2432773765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2d610 msgr2=0x558539d47cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.668+0000 7f4e0da00640 1 --2- 172.21.15.37:0/2432773765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2d610 0x558539d47cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.668+0000 7f4e0da00640 1 -- 172.21.15.37:0/2432773765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558539c37170 con 0x558539d32980 2024-08-20T05:10:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.668+0000 7f4e07e00640 1 --2- 172.21.15.37:0/2432773765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2ff40 0x558539d48360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:10:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.668+0000 7f4e0d000640 1 --2- 172.21.15.37:0/2432773765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2d610 0x558539d47cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:10:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.668+0000 7f4e0da00640 1 --2- 172.21.15.37:0/2432773765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d32980 0x558539d48f30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4e00011890 tx=0x7f4e00004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b33d5061afdde5ba server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.668+0000 7f4deea00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:10:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.669+0000 7f4deea00640 1 -- 172.21.15.37:0/2432773765 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0002d060 con 0x558539d32980 2024-08-20T05:10:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.669+0000 7f4deea00640 1 -- 172.21.15.37:0/2432773765 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4e00018030 con 0x558539d32980 2024-08-20T05:10:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.669+0000 7f4e129fd740 1 -- 172.21.15.37:0/2432773765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4df4005020 con 0x558539d32980 2024-08-20T05:10:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.670+0000 7f4deea00640 1 -- 172.21.15.37:0/2432773765 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4e00034050 con 0x558539d32980 2024-08-20T05:10:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.670+0000 7f4e129fd740 10 client.27587 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.670+0000 7f4e129fd740 1 -- 172.21.15.37:0/2432773765 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5585399f2790 con 0x558539d32980 2024-08-20T05:10:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.670+0000 7f4deea00640 1 -- 172.21.15.37:0/2432773765 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4df4005020 con 0x558539d32980 2024-08-20T05:10:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.670+0000 7f4deea00640 1 -- 172.21.15.37:0/2432773765 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f4e0000f040 con 0x558539d32980 2024-08-20T05:10:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.670+0000 7f4e129fd740 10 client.27587 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.670+0000 7f4e129fd740 10 client.27587 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:10:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.670+0000 7f4e129fd740 20 client.27587 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.671+0000 7f4e129fd740 1 --2- 172.21.15.37:0/2432773765 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558539d539a0 0x558539d55e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.671+0000 7f4e129fd740 4 client.27587 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:10:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.671+0000 7f4e129fd740 1 -- 172.21.15.37:0/2432773765 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558539ca2160 con 0x558539d539a0 2024-08-20T05:10:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.671+0000 7f4e0d000640 1 --2- 172.21.15.37:0/2432773765 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558539d539a0 0x558539d55e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.672+0000 7f4e0d000640 1 --2- 172.21.15.37:0/2432773765 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558539d539a0 0x558539d55e20 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f9c05ffba2c808c server_cookie=96c5828aa6e8086 in_seq=0 out_seq=0 2024-08-20T05:10:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.672+0000 7f4deea00640 10 client.27587 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.672+0000 7f4deea00640 1 -- 172.21.15.37:0/2432773765 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558539ca2160 con 0x558539d539a0 2024-08-20T05:10:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.672+0000 7f4deea00640 10 client.27587 handle_command_reply: tid=0 2024-08-20T05:10:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.672+0000 7f4e129fd740 1 client.27587 shutdown 2024-08-20T05:10:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.673+0000 7f4e129fd740 1 -- 172.21.15.37:0/2432773765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d32980 msgr2=0x558539d48f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.673+0000 7f4e129fd740 1 --2- 172.21.15.37:0/2432773765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d32980 0x558539d48f30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4e00011890 tx=0x7f4e00004ab0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.673+0000 7f4e129fd740 1 -- 172.21.15.37:0/2432773765 shutdown_connections 2024-08-20T05:10:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.673+0000 7f4e129fd740 1 --2- 172.21.15.37:0/2432773765 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558539d539a0 0x558539d55e20 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.673+0000 7f4deea00640 0 client.27587 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.673+0000 7f4e129fd740 1 --2- 172.21.15.37:0/2432773765 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d32980 0x558539d48f30 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.673+0000 7f4e129fd740 1 --2- 172.21.15.37:0/2432773765 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2ff40 0x558539d48360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.673+0000 7f4e129fd740 1 --2- 172.21.15.37:0/2432773765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2d610 0x558539d47cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.673+0000 7f4e129fd740 1 -- 172.21.15.37:0/2432773765 >> 172.21.15.37:0/2432773765 conn(0x558539d28760 msgr2=0x558539d27760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.673+0000 7f4e129fd740 1 -- 172.21.15.37:0/2432773765 shutdown_connections 2024-08-20T05:10:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.673+0000 7f4e129fd740 1 -- 172.21.15.37:0/2432773765 wait complete. 2024-08-20T05:10:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.673+0000 7f4e129fd740 20 client.27587 trim_cache size 0 max 16384 2024-08-20T05:10:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.696+0000 7f4e129fd740 1 Processor -- start 2024-08-20T05:10:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.697+0000 7f4e129fd740 1 -- start start 2024-08-20T05:10:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.698+0000 7f4e129fd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2d610 0x558539d27650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.698+0000 7f4e129fd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d2ff40 0x558539d27b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.698+0000 7f4e129fd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d32980 0x558539d2b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.698+0000 7f4e129fd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4e081a9190 con 0x558539d32980 2024-08-20T05:10:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.698+0000 7f4e129fd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4e081aadf0 con 0x558539d2ff40 2024-08-20T05:10:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.698+0000 7f4e129fd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4e081a9860 con 0x558539d2d610 2024-08-20T05:10:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.699+0000 7f4e0d000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2d610 0x558539d27650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.699+0000 7f4e0d000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2d610 0x558539d27650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:55432/0 (socket says 172.21.15.37:55432) 2024-08-20T05:10:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.699+0000 7f4e0da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d32980 0x558539d2b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.699+0000 7f4e07e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d2ff40 0x558539d27b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.699+0000 7f4e0d000640 1 -- 172.21.15.37:0/3069935385 learned_addr learned my addr 172.21.15.37:0/3069935385 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.700+0000 7f4e0d000640 1 -- 172.21.15.37:0/3069935385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d2ff40 msgr2=0x558539d27b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.700+0000 7f4e0d000640 1 --2- 172.21.15.37:0/3069935385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d2ff40 0x558539d27b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.700+0000 7f4e0d000640 1 -- 172.21.15.37:0/3069935385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d32980 msgr2=0x558539d2b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.700+0000 7f4e0d000640 1 --2- 172.21.15.37:0/3069935385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d32980 0x558539d2b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.700+0000 7f4e0d000640 1 -- 172.21.15.37:0/3069935385 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558539d2fd70 con 0x558539d2d610 2024-08-20T05:10:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.701+0000 7f4e0d000640 1 --2- 172.21.15.37:0/3069935385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2d610 0x558539d27650 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc000c00 tx=0x7f4dfc02a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cf5141cc82513ed server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.701+0000 7f4df9600640 1 -- 172.21.15.37:0/3069935385 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc049040 con 0x558539d2d610 2024-08-20T05:10:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.701+0000 7f4df9600640 1 -- 172.21.15.37:0/3069935385 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4dfc031e10 con 0x558539d2d610 2024-08-20T05:10:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.701+0000 7f4df9600640 1 -- 172.21.15.37:0/3069935385 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc1042d0 con 0x558539d2d610 2024-08-20T05:10:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.703+0000 7f4e129fd740 1 -- 172.21.15.37:0/3069935385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2d610 msgr2=0x558539d27650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.703+0000 7f4e129fd740 1 --2- 172.21.15.37:0/3069935385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2d610 0x558539d27650 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc000c00 tx=0x7f4dfc02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:31 smithi130 ceph-mon[22007]: pgmap v649: 129 pgs: 129 active+clean; 1.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 5.8 MiB/s wr, 619 op/s 2024-08-20T05:10:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.703+0000 7f4e129fd740 1 -- 172.21.15.37:0/3069935385 shutdown_connections 2024-08-20T05:10:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.703+0000 7f4e129fd740 1 --2- 172.21.15.37:0/3069935385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d32980 0x558539d2b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.703+0000 7f4e129fd740 1 --2- 172.21.15.37:0/3069935385 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d2ff40 0x558539d27b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.703+0000 7f4e129fd740 1 --2- 172.21.15.37:0/3069935385 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d2d610 0x558539d27650 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.703+0000 7f4e129fd740 1 -- 172.21.15.37:0/3069935385 >> 172.21.15.37:0/3069935385 conn(0x558539d28760 msgr2=0x558539d26f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.703+0000 7f4e129fd740 1 -- 172.21.15.37:0/3069935385 shutdown_connections 2024-08-20T05:10:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.703+0000 7f4e129fd740 1 -- 172.21.15.37:0/3069935385 wait complete. 2024-08-20T05:10:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.704+0000 7f4e129fd740 1 -- start start 2024-08-20T05:10:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.704+0000 7f4e129fd740 1 Processor -- start 2024-08-20T05:10:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.704+0000 7f4e129fd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d2d610 0x558539d4f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.704+0000 7f4e129fd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2ff40 0x558539d4fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.704+0000 7f4e129fd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d32980 0x558539d4e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.704+0000 7f4e129fd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4e081aa660 con 0x558539d2ff40 2024-08-20T05:10:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.704+0000 7f4e129fd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4e081a9f30 con 0x558539d2d610 2024-08-20T05:10:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.704+0000 7f4e129fd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4e08110040 con 0x558539d32980 2024-08-20T05:10:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.705+0000 7f4e129fd740 10 client.0 _ll_register_callbacks cb 0x7f4e00009d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.705+0000 7f4e0d000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d2d610 0x558539d4f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.705+0000 7f4e0d000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d2d610 0x558539d4f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56640/0 (socket says 172.21.15.37:56640) 2024-08-20T05:10:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.705+0000 7f4e0d000640 1 -- 172.21.15.37:0/2458450358 learned_addr learned my addr 172.21.15.37:0/2458450358 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.705+0000 7f4e0da00640 1 --2- 172.21.15.37:0/2458450358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d32980 0x558539d4e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.705+0000 7f4e07e00640 1 --2- 172.21.15.37:0/2458450358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2ff40 0x558539d4fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.705+0000 7f4e0da00640 1 -- 172.21.15.37:0/2458450358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d2d610 msgr2=0x558539d4f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.705+0000 7f4e0da00640 1 --2- 172.21.15.37:0/2458450358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d2d610 0x558539d4f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.705+0000 7f4e0da00640 1 -- 172.21.15.37:0/2458450358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2ff40 msgr2=0x558539d4fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.705+0000 7f4e0da00640 1 --2- 172.21.15.37:0/2458450358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2ff40 0x558539d4fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.705+0000 7f4e0da00640 1 -- 172.21.15.37:0/2458450358 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558539a6b620 con 0x558539d32980 2024-08-20T05:10:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.705+0000 7f4e0d000640 1 --2- 172.21.15.37:0/2458450358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d2d610 0x558539d4f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:10:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.705+0000 7f4e07e00640 1 --2- 172.21.15.37:0/2458450358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2ff40 0x558539d4fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:10:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.706+0000 7f4e0da00640 1 --2- 172.21.15.37:0/2458450358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d32980 0x558539d4e460 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4e00012f70 tx=0x7f4e00004dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5ffb59755d97a1c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.706+0000 7f4deea00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:10:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.706+0000 7f4deea00640 1 -- 172.21.15.37:0/2458450358 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e00020c10 con 0x558539d32980 2024-08-20T05:10:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.706+0000 7f4deea00640 1 -- 172.21.15.37:0/2458450358 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4e00020db0 con 0x558539d32980 2024-08-20T05:10:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.706+0000 7f4e129fd740 1 -- 172.21.15.37:0/2458450358 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558539c9dc00 con 0x558539d32980 2024-08-20T05:10:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.706+0000 7f4deea00640 1 -- 172.21.15.37:0/2458450358 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4e00041050 con 0x558539d32980 2024-08-20T05:10:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.706+0000 7f4e129fd740 10 client.27595 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.706+0000 7f4e129fd740 1 -- 172.21.15.37:0/2458450358 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x558539d4d950 con 0x558539d32980 2024-08-20T05:10:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.707+0000 7f4deea00640 1 -- 172.21.15.37:0/2458450358 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558539c9dc00 con 0x558539d32980 2024-08-20T05:10:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.707+0000 7f4deea00640 1 -- 172.21.15.37:0/2458450358 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f4e00005420 con 0x558539d32980 2024-08-20T05:10:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.707+0000 7f4e129fd740 10 client.27595 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.707+0000 7f4e129fd740 10 client.27595 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:10:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.708+0000 7f4e129fd740 20 client.27595 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.708+0000 7f4e129fd740 1 --2- 172.21.15.37:0/2458450358 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558539d539a0 0x558539dc0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.708+0000 7f4e129fd740 4 client.27595 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:10:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.708+0000 7f4e129fd740 1 -- 172.21.15.37:0/2458450358 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558539c9b340 con 0x558539d539a0 2024-08-20T05:10:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.708+0000 7f4e0d000640 1 --2- 172.21.15.37:0/2458450358 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558539d539a0 0x558539dc0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.709+0000 7f4e0d000640 1 --2- 172.21.15.37:0/2458450358 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558539d539a0 0x558539dc0ca0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f7f20f8c8a0ad97 server_cookie=f4800e77b46f639f in_seq=0 out_seq=0 2024-08-20T05:10:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.709+0000 7f4deea00640 10 client.27595 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.717+0000 7f4deea00640 1 -- 172.21.15.37:0/2458450358 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558539c9b340 con 0x558539d539a0 2024-08-20T05:10:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.717+0000 7f4deea00640 10 client.27595 handle_command_reply: tid=0 2024-08-20T05:10:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.717+0000 7f4e129fd740 1 client.27595 shutdown 2024-08-20T05:10:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.717+0000 7f4e129fd740 1 -- 172.21.15.37:0/2458450358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d32980 msgr2=0x558539d4e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.717+0000 7f4e129fd740 1 --2- 172.21.15.37:0/2458450358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d32980 0x558539d4e460 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4e00012f70 tx=0x7f4e00004dc0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.717+0000 7f4e129fd740 1 -- 172.21.15.37:0/2458450358 shutdown_connections 2024-08-20T05:10:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.717+0000 7f4e129fd740 1 --2- 172.21.15.37:0/2458450358 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558539d539a0 0x558539dc0ca0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.717+0000 7f4e129fd740 1 --2- 172.21.15.37:0/2458450358 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558539d32980 0x558539d4e460 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.717+0000 7f4e129fd740 1 --2- 172.21.15.37:0/2458450358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558539d2ff40 0x558539d4fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.717+0000 7f4e129fd740 1 --2- 172.21.15.37:0/2458450358 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558539d2d610 0x558539d4f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.718+0000 7f4e129fd740 1 -- 172.21.15.37:0/2458450358 >> 172.21.15.37:0/2458450358 conn(0x558539d28760 msgr2=0x558539d27760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.718+0000 7f4deea00640 0 client.27595 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.718+0000 7f4e129fd740 1 -- 172.21.15.37:0/2458450358 shutdown_connections 2024-08-20T05:10:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.718+0000 7f4e129fd740 1 -- 172.21.15.37:0/2458450358 wait complete. 2024-08-20T05:10:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.719+0000 7f4e129fd740 20 client.27595 trim_cache size 0 max 16384 2024-08-20T05:10:31.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:10:31.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:10:31.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:10:31.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:10:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.721+0000 7f4e0fa00640 1 -- 172.21.15.37:0/2872916613 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4df00b3cd0 msgr2=0x7f4df00b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.721+0000 7f4e0fa00640 1 --2- 172.21.15.37:0/2872916613 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4df00b3cd0 0x7f4df00b6190 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4e00012640 tx=0x7f4e00009680 comp rx=0 tx=0).stop 2024-08-20T05:10:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.721+0000 7f4e0fa00640 1 -- 172.21.15.37:0/2872916613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e081009a0 msgr2=0x7f4e0819f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.721+0000 7f4e0fa00640 1 --2- 172.21.15.37:0/2872916613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e081009a0 0x7f4e0819f0c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc02a9e0 tx=0x7f4dfc003c10 comp rx=0 tx=0).stop 2024-08-20T05:10:31.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.721+0000 7f4e0fa00640 1 -- 172.21.15.37:0/2872916613 shutdown_connections 2024-08-20T05:10:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.721+0000 7f4e0fa00640 1 --2- 172.21.15.37:0/2872916613 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4df00b3cd0 0x7f4df00b6190 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.721+0000 7f4e0fa00640 1 --2- 172.21.15.37:0/2872916613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4e08101f30 0x7f4e081a0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.721+0000 7f4e0fa00640 1 --2- 172.21.15.37:0/2872916613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4e08101370 0x7f4e0819f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.721+0000 7f4e0fa00640 1 --2- 172.21.15.37:0/2872916613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e081009a0 0x7f4e0819f0c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.721+0000 7f4e0fa00640 1 -- 172.21.15.37:0/2872916613 >> 172.21.15.37:0/2872916613 conn(0x7f4e080fc5e0 msgr2=0x7f4e08102980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.722+0000 7f4e0fa00640 1 -- 172.21.15.37:0/2872916613 shutdown_connections 2024-08-20T05:10:31.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:31.723+0000 7f4e0fa00640 1 -- 172.21.15.37:0/2872916613 wait complete. 2024-08-20T05:10:31.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:31 smithi037 ceph-mon[17265]: pgmap v649: 129 pgs: 129 active+clean; 1.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 5.8 MiB/s wr, 619 op/s 2024-08-20T05:10:31.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:31 smithi135 ceph-mon[22342]: pgmap v649: 129 pgs: 129 active+clean; 1.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 5.8 MiB/s wr, 619 op/s 2024-08-20T05:10:33.040 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 455.0 s, 797.8 tps, lat 129.264 ms stddev 151.356 2024-08-20T05:10:33.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:33 smithi130 ceph-mon[22007]: pgmap v650: 129 pgs: 129 active+clean; 1.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 6.3 MiB/s wr, 657 op/s 2024-08-20T05:10:33.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:33 smithi037 ceph-mon[17265]: pgmap v650: 129 pgs: 129 active+clean; 1.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 6.3 MiB/s wr, 657 op/s 2024-08-20T05:10:33.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:33 smithi135 ceph-mon[22342]: pgmap v650: 129 pgs: 129 active+clean; 1.4 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 6.3 MiB/s wr, 657 op/s 2024-08-20T05:10:35.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:35 smithi130 ceph-mon[22007]: pgmap v651: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 6.3 MiB/s wr, 632 op/s 2024-08-20T05:10:35.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:35 smithi037 ceph-mon[17265]: pgmap v651: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 6.3 MiB/s wr, 632 op/s 2024-08-20T05:10:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:35 smithi135 ceph-mon[22342]: pgmap v651: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 6.3 MiB/s wr, 632 op/s 2024-08-20T05:10:36.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:36 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:10:36.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:36 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:10:36.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:36 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:10:36.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:36 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:10:36.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:36 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:10:36.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:36 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:10:37.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:37 smithi037 ceph-mon[17265]: pgmap v652: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.8 MiB/s wr, 675 op/s 2024-08-20T05:10:37.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:37 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:10:37.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:37 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:10:37.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:37 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:10:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:37 smithi135 ceph-mon[22342]: pgmap v652: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.8 MiB/s wr, 675 op/s 2024-08-20T05:10:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:37 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:10:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:37 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:10:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:37 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:10:37.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:37 smithi130 ceph-mon[22007]: pgmap v652: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.8 MiB/s wr, 675 op/s 2024-08-20T05:10:37.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:37 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:10:37.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:37 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:10:37.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:37 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:10:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 460.0 s, 786.2 tps, lat 127.869 ms stddev 169.984 2024-08-20T05:10:39.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:39 smithi037 ceph-mon[17265]: pgmap v653: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.1 MiB/s wr, 577 op/s 2024-08-20T05:10:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:39 smithi135 ceph-mon[22342]: pgmap v653: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.1 MiB/s wr, 577 op/s 2024-08-20T05:10:39.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:39 smithi130 ceph-mon[22007]: pgmap v653: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 6.1 MiB/s wr, 577 op/s 2024-08-20T05:10:40.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:40 smithi037 ceph-mon[17265]: pgmap v654: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.0 MiB/s wr, 597 op/s 2024-08-20T05:10:40.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:40 smithi135 ceph-mon[22342]: pgmap v654: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.0 MiB/s wr, 597 op/s 2024-08-20T05:10:40.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:40 smithi130 ceph-mon[22007]: pgmap v654: 129 pgs: 129 active+clean; 1.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.0 MiB/s wr, 597 op/s 2024-08-20T05:10:43.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 465.0 s, 666.8 tps, lat 141.547 ms stddev 180.306 2024-08-20T05:10:43.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:43 smithi135 ceph-mon[22342]: pgmap v655: 129 pgs: 129 active+clean; 1.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.8 MiB/s wr, 570 op/s 2024-08-20T05:10:43.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:43 smithi130 ceph-mon[22007]: pgmap v655: 129 pgs: 129 active+clean; 1.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.8 MiB/s wr, 570 op/s 2024-08-20T05:10:43.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:43 smithi037 ceph-mon[17265]: pgmap v655: 129 pgs: 129 active+clean; 1.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.8 MiB/s wr, 570 op/s 2024-08-20T05:10:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.942+0000 7f742f400640 1 -- 172.21.15.37:0/1184475820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f742806b820 msgr2=0x7f74281031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.942+0000 7f742f400640 1 --2- 172.21.15.37:0/1184475820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f742806b820 0x7f74281031a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7420009ca0 tx=0x7f742002a8c0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.943+0000 7f742f400640 1 -- 172.21.15.37:0/1184475820 shutdown_connections 2024-08-20T05:10:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.943+0000 7f742f400640 1 --2- 172.21.15.37:0/1184475820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7428106170 0x7f7428106620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.943+0000 7f742f400640 1 --2- 172.21.15.37:0/1184475820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74281036e0 0x7f7428105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.943+0000 7f742f400640 1 --2- 172.21.15.37:0/1184475820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f742806b820 0x7f74281031a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.943+0000 7f742f400640 1 -- 172.21.15.37:0/1184475820 >> 172.21.15.37:0/1184475820 conn(0x7f74280fce20 msgr2=0x7f74280ff240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.944+0000 7f742f400640 1 -- 172.21.15.37:0/1184475820 shutdown_connections 2024-08-20T05:10:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.944+0000 7f742f400640 1 -- 172.21.15.37:0/1184475820 wait complete. 2024-08-20T05:10:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.946+0000 7f742f400640 1 Processor -- start 2024-08-20T05:10:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.948+0000 7f742f400640 1 -- start start 2024-08-20T05:10:44.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.948+0000 7f742f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f742806b820 0x7f74281967f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.948+0000 7f742f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74281036e0 0x7f7428196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.948+0000 7f742f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7428106170 0x7f7428197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.948+0000 7f742f400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f742810a120 con 0x7f7428106170 2024-08-20T05:10:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.948+0000 7f742f400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7428109fa0 con 0x7f742806b820 2024-08-20T05:10:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.948+0000 7f742f400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f742810a2a0 con 0x7f74281036e0 2024-08-20T05:10:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.948+0000 7f742ca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f742806b820 0x7f74281967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.948+0000 7f7427e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74281036e0 0x7f7428196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.948+0000 7f742ca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f742806b820 0x7f74281967f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47104/0 (socket says 172.21.15.37:47104) 2024-08-20T05:10:44.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.948+0000 7f742ca00640 1 -- 172.21.15.37:0/53368570 learned_addr learned my addr 172.21.15.37:0/53368570 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.949+0000 7f742d400640 1 --2- 172.21.15.37:0/53368570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7428106170 0x7f7428197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.949+0000 7f7427e00640 1 -- 172.21.15.37:0/53368570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f742806b820 msgr2=0x7f74281967f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.949+0000 7f7427e00640 1 --2- 172.21.15.37:0/53368570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f742806b820 0x7f74281967f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.949+0000 7f7427e00640 1 -- 172.21.15.37:0/53368570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7428106170 msgr2=0x7f7428197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.949+0000 7f7427e00640 1 --2- 172.21.15.37:0/53368570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7428106170 0x7f7428197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.949+0000 7f7427e00640 1 -- 172.21.15.37:0/53368570 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7428198330 con 0x7f74281036e0 2024-08-20T05:10:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.949+0000 7f742d400640 1 --2- 172.21.15.37:0/53368570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7428106170 0x7f7428197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:10:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.949+0000 7f7427e00640 1 --2- 172.21.15.37:0/53368570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74281036e0 0x7f7428196e40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f741000d6d0 tx=0x7f741000db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.950+0000 7f7425600640 1 -- 172.21.15.37:0/53368570 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410017070 con 0x7f74281036e0 2024-08-20T05:10:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.950+0000 7f7425600640 1 -- 172.21.15.37:0/53368570 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7410009820 con 0x7f74281036e0 2024-08-20T05:10:44.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.950+0000 7f7425600640 1 -- 172.21.15.37:0/53368570 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410004c40 con 0x7f74281036e0 2024-08-20T05:10:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.950+0000 7f742f400640 1 -- 172.21.15.37:0/53368570 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7428198620 con 0x7f74281036e0 2024-08-20T05:10:44.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.951+0000 7f742f400640 1 -- 172.21.15.37:0/53368570 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f742819ecf0 con 0x7f74281036e0 2024-08-20T05:10:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.955+0000 7f7432408740 1 Processor -- start 2024-08-20T05:10:44.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.956+0000 7f7432408740 1 -- start start 2024-08-20T05:10:44.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.956+0000 7f7432408740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53ad610 0x55e3c53afa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.956+0000 7f7432408740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 0x55e3c53b2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.956+0000 7f7432408740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53b2980 0x55e3c53b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.956+0000 7f7432408740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e3c5320210 con 0x55e3c53b2980 2024-08-20T05:10:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.956+0000 7f7432408740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e3c530f710 con 0x55e3c53aff40 2024-08-20T05:10:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.956+0000 7f7432408740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e3c5313750 con 0x55e3c53ad610 2024-08-20T05:10:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.956+0000 7f742d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53ad610 0x55e3c53afa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.956+0000 7f742ca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 0x55e3c53b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.956+0000 7f742d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53ad610 0x55e3c53afa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34538/0 (socket says 172.21.15.37:34538) 2024-08-20T05:10:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.956+0000 7f742d400640 1 -- 172.21.15.37:0/2163548777 learned_addr learned my addr 172.21.15.37:0/2163548777 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.957+0000 7f742d400640 1 -- 172.21.15.37:0/2163548777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 msgr2=0x55e3c53b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.957+0000 7f742d400640 1 --2- 172.21.15.37:0/2163548777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 0x55e3c53b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.957+0000 7f742d400640 1 -- 172.21.15.37:0/2163548777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53b2980 msgr2=0x55e3c53b4e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:10:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.957+0000 7f742d400640 1 --2- 172.21.15.37:0/2163548777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53b2980 0x55e3c53b4e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.957+0000 7f742d400640 1 -- 172.21.15.37:0/2163548777 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3c52dbde0 con 0x55e3c53ad610 2024-08-20T05:10:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.957+0000 7f7425600640 1 -- 172.21.15.37:0/53368570 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7410005220 con 0x7f74281036e0 2024-08-20T05:10:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.958+0000 7f742d400640 1 --2- 172.21.15.37:0/2163548777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53ad610 0x55e3c53afa00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f741801ac70 tx=0x7f74180227c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c65f0204f582806a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.958+0000 7f741dc00640 1 -- 172.21.15.37:0/2163548777 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741802f070 con 0x55e3c53ad610 2024-08-20T05:10:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.958+0000 7f741dc00640 1 -- 172.21.15.37:0/2163548777 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f741802a8c0 con 0x55e3c53ad610 2024-08-20T05:10:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.958+0000 7f741dc00640 1 -- 172.21.15.37:0/2163548777 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418020800 con 0x55e3c53ad610 2024-08-20T05:10:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.960+0000 7f7432408740 1 -- 172.21.15.37:0/2163548777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53ad610 msgr2=0x55e3c53afa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.960+0000 7f7432408740 1 --2- 172.21.15.37:0/2163548777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53ad610 0x55e3c53afa00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f741801ac70 tx=0x7f74180227c0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.960+0000 7f7432408740 1 -- 172.21.15.37:0/2163548777 shutdown_connections 2024-08-20T05:10:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.960+0000 7f7432408740 1 --2- 172.21.15.37:0/2163548777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53b2980 0x55e3c53b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.960+0000 7f7432408740 1 --2- 172.21.15.37:0/2163548777 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 0x55e3c53b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.960+0000 7f7432408740 1 --2- 172.21.15.37:0/2163548777 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53ad610 0x55e3c53afa00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.960+0000 7f7432408740 1 -- 172.21.15.37:0/2163548777 >> 172.21.15.37:0/2163548777 conn(0x55e3c53a8760 msgr2=0x55e3c53a94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.960+0000 7f7425600640 1 --2- 172.21.15.37:0/53368570 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f740c0b3cd0 0x7f740c0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.961+0000 7f7425600640 1 -- 172.21.15.37:0/53368570 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f74100e3b50 con 0x7f74281036e0 2024-08-20T05:10:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.961+0000 7f742ca00640 1 --2- 172.21.15.37:0/53368570 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f740c0b3cd0 0x7f740c0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.962+0000 7f7432408740 1 -- 172.21.15.37:0/2163548777 shutdown_connections 2024-08-20T05:10:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.962+0000 7f7432408740 1 -- 172.21.15.37:0/2163548777 wait complete. 2024-08-20T05:10:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.963+0000 7f7432408740 1 -- start start 2024-08-20T05:10:44.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.963+0000 7f7432408740 1 Processor -- start 2024-08-20T05:10:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.964+0000 7f7432408740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53ad610 0x55e3c53b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.964+0000 7f7432408740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 0x55e3c53b7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.964+0000 7f7432408740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53b2980 0x55e3c53b8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:44.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.964+0000 7f7432408740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e3c5248ab0 con 0x55e3c53ad610 2024-08-20T05:10:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.964+0000 7f7432408740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e3c52b6140 con 0x55e3c53aff40 2024-08-20T05:10:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.964+0000 7f7432408740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e3c53b5960 con 0x55e3c53b2980 2024-08-20T05:10:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.964+0000 7f7432408740 10 client.0 _ll_register_callbacks cb 0x55e3c52c95d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.964+0000 7f7427e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 0x55e3c53b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.965+0000 7f7427e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 0x55e3c53b7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47132/0 (socket says 172.21.15.37:47132) 2024-08-20T05:10:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.965+0000 7f7427e00640 1 -- 172.21.15.37:0/3141637861 learned_addr learned my addr 172.21.15.37:0/3141637861 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:44.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.965+0000 7f742d400640 1 --2- 172.21.15.37:0/3141637861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53b2980 0x55e3c53b8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.965+0000 7f742ca00640 1 --2- 172.21.15.37:0/53368570 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f740c0b3cd0 0x7f740c0b6190 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7420009430 tx=0x7f7420009380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.965+0000 7f742d400640 1 -- 172.21.15.37:0/3141637861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 msgr2=0x55e3c53b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.965+0000 7f742d400640 1 --2- 172.21.15.37:0/3141637861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 0x55e3c53b7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.965+0000 7f742d400640 1 -- 172.21.15.37:0/3141637861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53ad610 msgr2=0x55e3c53b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.965+0000 7f742d400640 1 --2- 172.21.15.37:0/3141637861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53ad610 0x55e3c53b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.965+0000 7f742d400640 1 -- 172.21.15.37:0/3141637861 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3c52b7170 con 0x55e3c53b2980 2024-08-20T05:10:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.966+0000 7f742d400640 1 --2- 172.21.15.37:0/3141637861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53b2980 0x55e3c53b8060 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7418000c00 tx=0x7f741802a640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ef32abce12b8038 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:44.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.966+0000 7f7416000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:10:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.966+0000 7f7416000640 1 -- 172.21.15.37:0/3141637861 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7418038020 con 0x55e3c53b2980 2024-08-20T05:10:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.966+0000 7f7416000640 1 -- 172.21.15.37:0/3141637861 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7418019040 con 0x55e3c53b2980 2024-08-20T05:10:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.966+0000 7f7432408740 1 -- 172.21.15.37:0/3141637861 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f741802a8c0 con 0x55e3c53b2980 2024-08-20T05:10:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.967+0000 7f7416000640 1 -- 172.21.15.37:0/3141637861 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7418043050 con 0x55e3c53b2980 2024-08-20T05:10:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.967+0000 7f7432408740 10 client.27607 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.967+0000 7f7432408740 1 -- 172.21.15.37:0/3141637861 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55e3c5072790 con 0x55e3c53b2980 2024-08-20T05:10:44.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.967+0000 7f7416000640 1 -- 172.21.15.37:0/3141637861 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f741802a8c0 con 0x55e3c53b2980 2024-08-20T05:10:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.967+0000 7f7416000640 1 -- 172.21.15.37:0/3141637861 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f74180209f0 con 0x55e3c53b2980 2024-08-20T05:10:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.968+0000 7f7432408740 10 client.27607 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.968+0000 7f7432408740 10 client.27607 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:10:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.968+0000 7f7432408740 20 client.27607 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.968+0000 7f7432408740 1 --2- 172.21.15.37:0/3141637861 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e3c53c2810 0x55e3c53c4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.968+0000 7f7432408740 4 client.27607 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:10:44.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.968+0000 7f7432408740 1 -- 172.21.15.37:0/3141637861 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3c5322160 con 0x55e3c53c2810 2024-08-20T05:10:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.969+0000 7f742ca00640 1 --2- 172.21.15.37:0/3141637861 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e3c53c2810 0x55e3c53c4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.970+0000 7f742ca00640 1 --2- 172.21.15.37:0/3141637861 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e3c53c2810 0x55e3c53c4c30 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1f890c5a40da2 server_cookie=2ebdfe7f3c2740f4 in_seq=0 out_seq=0 2024-08-20T05:10:44.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.970+0000 7f7416000640 10 client.27607 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.970+0000 7f7416000640 1 -- 172.21.15.37:0/3141637861 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3c5322160 con 0x55e3c53c2810 2024-08-20T05:10:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.970+0000 7f7416000640 10 client.27607 handle_command_reply: tid=0 2024-08-20T05:10:44.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.970+0000 7f7432408740 1 client.27607 shutdown 2024-08-20T05:10:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.971+0000 7f7432408740 1 -- 172.21.15.37:0/3141637861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53b2980 msgr2=0x55e3c53b8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.971+0000 7f7432408740 1 --2- 172.21.15.37:0/3141637861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53b2980 0x55e3c53b8060 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7418000c00 tx=0x7f741802a640 comp rx=0 tx=0).stop 2024-08-20T05:10:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.971+0000 7f7432408740 1 -- 172.21.15.37:0/3141637861 shutdown_connections 2024-08-20T05:10:44.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.971+0000 7f7432408740 1 --2- 172.21.15.37:0/3141637861 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e3c53c2810 0x55e3c53c4c30 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.971+0000 7f7432408740 1 --2- 172.21.15.37:0/3141637861 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53b2980 0x55e3c53b8060 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.971+0000 7f7432408740 1 --2- 172.21.15.37:0/3141637861 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 0x55e3c53b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.971+0000 7f7432408740 1 --2- 172.21.15.37:0/3141637861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53ad610 0x55e3c53b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.971+0000 7f7432408740 1 -- 172.21.15.37:0/3141637861 >> 172.21.15.37:0/3141637861 conn(0x55e3c53a8760 msgr2=0x55e3c53a7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.971+0000 7f7416000640 0 client.27607 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.972+0000 7f7432408740 1 -- 172.21.15.37:0/3141637861 shutdown_connections 2024-08-20T05:10:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.972+0000 7f7432408740 1 -- 172.21.15.37:0/3141637861 wait complete. 2024-08-20T05:10:44.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.972+0000 7f7432408740 20 client.27607 trim_cache size 0 max 16384 2024-08-20T05:10:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.994+0000 7f7432408740 1 Processor -- start 2024-08-20T05:10:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.994+0000 7f7432408740 1 -- start start 2024-08-20T05:10:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.994+0000 7f7432408740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53ad610 0x55e3c53b8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.994+0000 7f7432408740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53aff40 0x55e3c53b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.994+0000 7f7432408740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53b2980 0x55e3c53b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.994+0000 7f7432408740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f74281a9220 con 0x55e3c53aff40 2024-08-20T05:10:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.994+0000 7f7432408740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f74281aae80 con 0x55e3c53b2980 2024-08-20T05:10:44.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.994+0000 7f7432408740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f74281a98f0 con 0x55e3c53ad610 2024-08-20T05:10:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.995+0000 7f742d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53b2980 0x55e3c53b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.995+0000 7f7427e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53aff40 0x55e3c53b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.995+0000 7f742d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53b2980 0x55e3c53b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47134/0 (socket says 172.21.15.37:47134) 2024-08-20T05:10:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.995+0000 7f742d400640 1 -- 172.21.15.37:0/1916218103 learned_addr learned my addr 172.21.15.37:0/1916218103 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.995+0000 7f742ca00640 1 --2- 172.21.15.37:0/1916218103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53ad610 0x55e3c53b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.995+0000 7f742ca00640 1 -- 172.21.15.37:0/1916218103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53b2980 msgr2=0x55e3c53b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.995+0000 7f742ca00640 1 --2- 172.21.15.37:0/1916218103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53b2980 0x55e3c53b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.995+0000 7f742ca00640 1 -- 172.21.15.37:0/1916218103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53aff40 msgr2=0x55e3c53b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.995+0000 7f742ca00640 1 --2- 172.21.15.37:0/1916218103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53aff40 0x55e3c53b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:44.998 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.995+0000 7f742ca00640 1 -- 172.21.15.37:0/1916218103 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3c50eb620 con 0x55e3c53ad610 2024-08-20T05:10:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.995+0000 7f742ca00640 1 --2- 172.21.15.37:0/1916218103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53ad610 0x55e3c53b8040 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x55e3c53c54a0 tx=0x7f7420041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c842a328fcc482c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.996+0000 7f741d200640 1 -- 172.21.15.37:0/1916218103 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420003af0 con 0x55e3c53ad610 2024-08-20T05:10:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.996+0000 7f741d200640 1 -- 172.21.15.37:0/1916218103 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7420058070 con 0x55e3c53ad610 2024-08-20T05:10:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.996+0000 7f741d200640 1 -- 172.21.15.37:0/1916218103 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742002f900 con 0x55e3c53ad610 2024-08-20T05:10:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.997+0000 7f7432408740 1 -- 172.21.15.37:0/1916218103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53ad610 msgr2=0x55e3c53b8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.997+0000 7f7432408740 1 --2- 172.21.15.37:0/1916218103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53ad610 0x55e3c53b8040 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x55e3c53c54a0 tx=0x7f7420041000 comp rx=0 tx=0).stop 2024-08-20T05:10:44.999 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.997+0000 7f7432408740 1 -- 172.21.15.37:0/1916218103 shutdown_connections 2024-08-20T05:10:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.997+0000 7f7432408740 1 --2- 172.21.15.37:0/1916218103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53b2980 0x55e3c53b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.997+0000 7f7432408740 1 --2- 172.21.15.37:0/1916218103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53aff40 0x55e3c53b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.997+0000 7f7432408740 1 --2- 172.21.15.37:0/1916218103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53ad610 0x55e3c53b8040 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.997+0000 7f7432408740 1 -- 172.21.15.37:0/1916218103 >> 172.21.15.37:0/1916218103 conn(0x55e3c53a8760 msgr2=0x55e3c53b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.998+0000 7f7432408740 1 -- 172.21.15.37:0/1916218103 shutdown_connections 2024-08-20T05:10:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.998+0000 7f7432408740 1 -- 172.21.15.37:0/1916218103 wait complete. 2024-08-20T05:10:45.000 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.998+0000 7f7432408740 1 -- start start 2024-08-20T05:10:45.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.999+0000 7f7432408740 1 Processor -- start 2024-08-20T05:10:45.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.999+0000 7f7432408740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53ad610 0x55e3c53bb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:45.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.999+0000 7f7432408740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 0x55e3c53bbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:45.001 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.999+0000 7f7432408740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53b2980 0x55e3c53bca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.999+0000 7f7432408740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f74281aa6f0 con 0x55e3c53ad610 2024-08-20T05:10:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.999+0000 7f7432408740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f74281a9fc0 con 0x55e3c53aff40 2024-08-20T05:10:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.999+0000 7f7432408740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f74281a7200 con 0x55e3c53b2980 2024-08-20T05:10:45.002 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:44.999+0000 7f7432408740 10 client.0 _ll_register_callbacks cb 0x7f741802d070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:45.003 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.000+0000 7f7427e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 0x55e3c53bbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:45.003 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.000+0000 7f7427e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 0x55e3c53bbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47148/0 (socket says 172.21.15.37:47148) 2024-08-20T05:10:45.003 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.000+0000 7f7427e00640 1 -- 172.21.15.37:0/1756414233 learned_addr learned my addr 172.21.15.37:0/1756414233 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:45.003 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.000+0000 7f742d400640 1 --2- 172.21.15.37:0/1756414233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53b2980 0x55e3c53bca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:45.003 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.000+0000 7f742ca00640 1 --2- 172.21.15.37:0/1756414233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53ad610 0x55e3c53bb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:45.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.000+0000 7f7427e00640 1 -- 172.21.15.37:0/1756414233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53b2980 msgr2=0x55e3c53bca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:45.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.000+0000 7f7427e00640 1 --2- 172.21.15.37:0/1756414233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53b2980 0x55e3c53bca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:45.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.000+0000 7f7427e00640 1 -- 172.21.15.37:0/1756414233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53ad610 msgr2=0x55e3c53bb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:45.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.000+0000 7f7427e00640 1 --2- 172.21.15.37:0/1756414233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53ad610 0x55e3c53bb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:45.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.000+0000 7f7427e00640 1 -- 172.21.15.37:0/1756414233 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3c53bd290 con 0x55e3c53aff40 2024-08-20T05:10:45.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.000+0000 7f742ca00640 1 --2- 172.21.15.37:0/1756414233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53ad610 0x55e3c53bb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:10:45.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.001+0000 7f7427e00640 1 --2- 172.21.15.37:0/1756414233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 0x55e3c53bbe90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f741000d6a0 tx=0x7f74100aa560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4276821ddb097e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:45.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.001+0000 7f7416000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:10:45.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.001+0000 7f7416000640 1 -- 172.21.15.37:0/1756414233 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74100c3020 con 0x55e3c53aff40 2024-08-20T05:10:45.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.001+0000 7f7416000640 1 -- 172.21.15.37:0/1756414233 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7410009cd0 con 0x55e3c53aff40 2024-08-20T05:10:45.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.001+0000 7f7432408740 1 -- 172.21.15.37:0/1756414233 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7420058070 con 0x55e3c53aff40 2024-08-20T05:10:45.004 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.002+0000 7f7416000640 1 -- 172.21.15.37:0/1756414233 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f74100aa6a0 con 0x55e3c53aff40 2024-08-20T05:10:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.002+0000 7f7432408740 10 client.27611 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.002+0000 7f7432408740 1 -- 172.21.15.37:0/1756414233 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55e3c53be670 con 0x55e3c53aff40 2024-08-20T05:10:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.002+0000 7f7416000640 1 -- 172.21.15.37:0/1756414233 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7420058070 con 0x55e3c53aff40 2024-08-20T05:10:45.005 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.002+0000 7f7416000640 1 -- 172.21.15.37:0/1756414233 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f74100cd0b0 con 0x55e3c53aff40 2024-08-20T05:10:45.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.002+0000 7f7432408740 10 client.27611 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:45.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.002+0000 7f7432408740 10 client.27611 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:10:45.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.002+0000 7f7432408740 20 client.27611 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:45.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.002+0000 7f7432408740 1 --2- 172.21.15.37:0/1756414233 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e3c542d4d0 0x55e3c542f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:45.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.002+0000 7f7432408740 4 client.27611 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:10:45.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.002+0000 7f7432408740 1 -- 172.21.15.37:0/1756414233 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e3c531dc00 con 0x55e3c542d4d0 2024-08-20T05:10:45.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.002+0000 7f742ca00640 1 --2- 172.21.15.37:0/1756414233 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e3c542d4d0 0x55e3c542f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:45.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.003+0000 7f742ca00640 1 --2- 172.21.15.37:0/1756414233 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e3c542d4d0 0x55e3c542f8c0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3529213b69e7932 server_cookie=56dc4c1dd6a2ba5e in_seq=0 out_seq=0 2024-08-20T05:10:45.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.003+0000 7f7416000640 10 client.27611 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.014+0000 7f7416000640 1 -- 172.21.15.37:0/1756414233 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e3c531dc00 con 0x55e3c542d4d0 2024-08-20T05:10:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.014+0000 7f7416000640 10 client.27611 handle_command_reply: tid=0 2024-08-20T05:10:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.014+0000 7f7432408740 1 client.27611 shutdown 2024-08-20T05:10:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.014+0000 7f7432408740 1 -- 172.21.15.37:0/1756414233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 msgr2=0x55e3c53bbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:45.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.014+0000 7f7432408740 1 --2- 172.21.15.37:0/1756414233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 0x55e3c53bbe90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f741000d6a0 tx=0x7f74100aa560 comp rx=0 tx=0).stop 2024-08-20T05:10:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.014+0000 7f7432408740 1 -- 172.21.15.37:0/1756414233 shutdown_connections 2024-08-20T05:10:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.015+0000 7f7432408740 1 --2- 172.21.15.37:0/1756414233 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e3c542d4d0 0x55e3c542f8c0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.015+0000 7f7432408740 1 --2- 172.21.15.37:0/1756414233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e3c53b2980 0x55e3c53bca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.015+0000 7f7432408740 1 --2- 172.21.15.37:0/1756414233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e3c53aff40 0x55e3c53bbe90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.015+0000 7f7432408740 1 --2- 172.21.15.37:0/1756414233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3c53ad610 0x55e3c53bb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.015+0000 7f7432408740 1 -- 172.21.15.37:0/1756414233 >> 172.21.15.37:0/1756414233 conn(0x55e3c53a8760 msgr2=0x55e3c53a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.015+0000 7f7416000640 0 client.27611 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:45.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.015+0000 7f7432408740 1 -- 172.21.15.37:0/1756414233 shutdown_connections 2024-08-20T05:10:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.015+0000 7f7432408740 1 -- 172.21.15.37:0/1756414233 wait complete. 2024-08-20T05:10:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.016+0000 7f7432408740 20 client.27611 trim_cache size 0 max 16384 2024-08-20T05:10:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:10:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:10:45.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:10:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:10:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.017+0000 7f742f400640 1 -- 172.21.15.37:0/53368570 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f740c0b3cd0 msgr2=0x7f740c0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.017+0000 7f742f400640 1 --2- 172.21.15.37:0/53368570 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f740c0b3cd0 0x7f740c0b6190 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7420009430 tx=0x7f7420009380 comp rx=0 tx=0).stop 2024-08-20T05:10:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.017+0000 7f742f400640 1 -- 172.21.15.37:0/53368570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74281036e0 msgr2=0x7f7428196e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.017+0000 7f742f400640 1 --2- 172.21.15.37:0/53368570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74281036e0 0x7f7428196e40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f741000d6d0 tx=0x7f741000db90 comp rx=0 tx=0).stop 2024-08-20T05:10:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.017+0000 7f742f400640 1 -- 172.21.15.37:0/53368570 shutdown_connections 2024-08-20T05:10:45.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.017+0000 7f742f400640 1 --2- 172.21.15.37:0/53368570 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f740c0b3cd0 0x7f740c0b6190 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.017+0000 7f742f400640 1 --2- 172.21.15.37:0/53368570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7428106170 0x7f7428197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.017+0000 7f742f400640 1 --2- 172.21.15.37:0/53368570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f74281036e0 0x7f7428196e40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.017+0000 7f742f400640 1 --2- 172.21.15.37:0/53368570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f742806b820 0x7f74281967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.017+0000 7f742f400640 1 -- 172.21.15.37:0/53368570 >> 172.21.15.37:0/53368570 conn(0x7f74280fce20 msgr2=0x7f74280fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.017+0000 7f742f400640 1 -- 172.21.15.37:0/53368570 shutdown_connections 2024-08-20T05:10:45.020 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:45.017+0000 7f742f400640 1 -- 172.21.15.37:0/53368570 wait complete. 2024-08-20T05:10:45.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:45 smithi135 ceph-mon[22342]: pgmap v656: 129 pgs: 129 active+clean; 1.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.8 MiB/s wr, 552 op/s 2024-08-20T05:10:45.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:45 smithi130 ceph-mon[22007]: pgmap v656: 129 pgs: 129 active+clean; 1.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.8 MiB/s wr, 552 op/s 2024-08-20T05:10:45.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:45 smithi037 ceph-mon[17265]: pgmap v656: 129 pgs: 129 active+clean; 1.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.8 MiB/s wr, 552 op/s 2024-08-20T05:10:47.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:47 smithi130 ceph-mon[22007]: pgmap v657: 129 pgs: 129 active+clean; 1.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 MiB/s wr, 600 op/s 2024-08-20T05:10:47.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:47 smithi037 ceph-mon[17265]: pgmap v657: 129 pgs: 129 active+clean; 1.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 MiB/s wr, 600 op/s 2024-08-20T05:10:47.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:47 smithi135 ceph-mon[22342]: pgmap v657: 129 pgs: 129 active+clean; 1.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 MiB/s wr, 600 op/s 2024-08-20T05:10:48.040 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 470.0 s, 675.4 tps, lat 153.360 ms stddev 226.982 2024-08-20T05:10:49.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:49 smithi130 ceph-mon[22007]: pgmap v658: 129 pgs: 129 active+clean; 1.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.1 MiB/s wr, 528 op/s 2024-08-20T05:10:49.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:49 smithi037 ceph-mon[17265]: pgmap v658: 129 pgs: 129 active+clean; 1.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.1 MiB/s wr, 528 op/s 2024-08-20T05:10:49.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:49 smithi135 ceph-mon[22342]: pgmap v658: 129 pgs: 129 active+clean; 1.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 5.1 MiB/s wr, 528 op/s 2024-08-20T05:10:51.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:51 smithi130 ceph-mon[22007]: pgmap v659: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 589 op/s 2024-08-20T05:10:51.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:51 smithi037 ceph-mon[17265]: pgmap v659: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 589 op/s 2024-08-20T05:10:51.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:51 smithi135 ceph-mon[22342]: pgmap v659: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 589 op/s 2024-08-20T05:10:51.894 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-20T05:10:51.894 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.85 2024-08-20T05:10:51.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:10:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:10:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 475.0 s, 545.0 tps, lat 184.352 ms stddev 238.854 2024-08-20T05:10:53.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.333+0000 7fbda1400640 1 -- 172.21.15.37:0/3345853989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd9c104130 msgr2=0x7fbd9c10c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:53.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.333+0000 7fbda1400640 1 --2- 172.21.15.37:0/3345853989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd9c104130 0x7fbd9c10c620 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009900 tx=0x7fbd8c02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:10:53.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.335+0000 7fbda1400640 1 -- 172.21.15.37:0/3345853989 shutdown_connections 2024-08-20T05:10:53.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.335+0000 7fbda1400640 1 --2- 172.21.15.37:0/3345853989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd9c10cc70 0x7fbd9c10f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:53.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.335+0000 7fbda1400640 1 --2- 172.21.15.37:0/3345853989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd9c104130 0x7fbd9c10c620 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:53.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.335+0000 7fbda1400640 1 --2- 172.21.15.37:0/3345853989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd9c103810 0x7fbd9c103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:53.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.335+0000 7fbda1400640 1 -- 172.21.15.37:0/3345853989 >> 172.21.15.37:0/3345853989 conn(0x7fbd9c0fd2d0 msgr2=0x7fbd9c0ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:53.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.335+0000 7fbda1400640 1 -- 172.21.15.37:0/3345853989 shutdown_connections 2024-08-20T05:10:53.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.335+0000 7fbda1400640 1 -- 172.21.15.37:0/3345853989 wait complete. 2024-08-20T05:10:53.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.337+0000 7fbda1400640 1 Processor -- start 2024-08-20T05:10:53.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.338+0000 7fbda1400640 1 -- start start 2024-08-20T05:10:53.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.338+0000 7fbda1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd9c103810 0x7fbd9c06cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:53.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.338+0000 7fbda1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd9c104130 0x7fbd9c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:53.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.338+0000 7fbda1400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd9c10cc70 0x7fbd9c072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:53.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.338+0000 7fbda1400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9c110760 con 0x7fbd9c10cc70 2024-08-20T05:10:53.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.338+0000 7fbda1400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9c1105e0 con 0x7fbd9c103810 2024-08-20T05:10:53.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.338+0000 7fbda1400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9c1108e0 con 0x7fbd9c104130 2024-08-20T05:10:53.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.340+0000 7fbd9b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd9c104130 0x7fbd9c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.340+0000 7fbd9b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd9c104130 0x7fbd9c06d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33502/0 (socket says 172.21.15.37:33502) 2024-08-20T05:10:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.340+0000 7fbd9b400640 1 -- 172.21.15.37:0/759051449 learned_addr learned my addr 172.21.15.37:0/759051449 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.340+0000 7fbd9b400640 1 -- 172.21.15.37:0/759051449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd9c103810 msgr2=0x7fbd9c06cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.340+0000 7fbd9b400640 1 --2- 172.21.15.37:0/759051449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd9c103810 0x7fbd9c06cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.340+0000 7fbd9b400640 1 -- 172.21.15.37:0/759051449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd9c10cc70 msgr2=0x7fbd9c072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.340+0000 7fbd9b400640 1 --2- 172.21.15.37:0/759051449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd9c10cc70 0x7fbd9c072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.340+0000 7fbd9b400640 1 -- 172.21.15.37:0/759051449 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd9c072c10 con 0x7fbd9c104130 2024-08-20T05:10:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.341+0000 7fbd9b400640 1 --2- 172.21.15.37:0/759051449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd9c104130 0x7fbd9c06d0f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c005ab0 tx=0x7fbd8c003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.342+0000 7fbd98c00640 1 -- 172.21.15.37:0/759051449 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c03f070 con 0x7fbd9c104130 2024-08-20T05:10:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.342+0000 7fbd98c00640 1 -- 172.21.15.37:0/759051449 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd8c031b50 con 0x7fbd9c104130 2024-08-20T05:10:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.342+0000 7fbd98c00640 1 -- 172.21.15.37:0/759051449 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c03f070 con 0x7fbd9c104130 2024-08-20T05:10:53.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.343+0000 7fbda1400640 1 -- 172.21.15.37:0/759051449 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd9c072ea0 con 0x7fbd9c104130 2024-08-20T05:10:53.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.343+0000 7fbda1400640 1 -- 172.21.15.37:0/759051449 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd9c073240 con 0x7fbd9c104130 2024-08-20T05:10:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.347+0000 7fbda1400640 1 -- 172.21.15.37:0/759051449 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd9c103bf0 con 0x7fbd9c104130 2024-08-20T05:10:53.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.350+0000 7fbd98c00640 1 -- 172.21.15.37:0/759051449 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbd8c042070 con 0x7fbd9c104130 2024-08-20T05:10:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.353+0000 7fbd98c00640 1 --2- 172.21.15.37:0/759051449 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd800b8300 0x7fbd800ba7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.353+0000 7fbd98c00640 1 -- 172.21.15.37:0/759051449 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbd8c0c71d0 con 0x7fbd9c104130 2024-08-20T05:10:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.353+0000 7fbd9be00640 1 --2- 172.21.15.37:0/759051449 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd800b8300 0x7fbd800ba7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:53.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.355+0000 7fbd9be00640 1 --2- 172.21.15.37:0/759051449 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd800b8300 0x7fbd800ba7c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fbd84005fd0 tx=0x7fbd84005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:53.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.360+0000 7fbd98c00640 1 -- 172.21.15.37:0/759051449 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fbd8c0cb2e0 con 0x7fbd9c104130 2024-08-20T05:10:53.397 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:53 smithi037 ceph-mon[17265]: pgmap v660: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 604 op/s 2024-08-20T05:10:53.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:53 smithi130 ceph-mon[22007]: pgmap v660: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 604 op/s 2024-08-20T05:10:53.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.809+0000 7fbda1400640 1 -- 172.21.15.37:0/759051449 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd9c073770 con 0x7fbd9c104130 2024-08-20T05:10:53.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.812+0000 7fbd98c00640 1 -- 172.21.15.37:0/759051449 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11990 (secure 0 0 0) 0x7fbd8c0cf1e0 con 0x7fbd9c104130 2024-08-20T05:10:53.818 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:10:53.818 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 39 2024-08-20T05:10:53.818 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":39,"btime":"2024-08-20T05:09:24:153999+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:09:24.103831+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:10:53.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.816+0000 7fbda1400640 1 -- 172.21.15.37:0/759051449 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd800b8300 msgr2=0x7fbd800ba7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:53.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.816+0000 7fbda1400640 1 --2- 172.21.15.37:0/759051449 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd800b8300 0x7fbd800ba7c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fbd84005fd0 tx=0x7fbd84005c70 comp rx=0 tx=0).stop 2024-08-20T05:10:53.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.816+0000 7fbda1400640 1 -- 172.21.15.37:0/759051449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd9c104130 msgr2=0x7fbd9c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:53.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.816+0000 7fbda1400640 1 --2- 172.21.15.37:0/759051449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd9c104130 0x7fbd9c06d0f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c005ab0 tx=0x7fbd8c003b90 comp rx=0 tx=0).stop 2024-08-20T05:10:53.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.816+0000 7fbda1400640 1 -- 172.21.15.37:0/759051449 shutdown_connections 2024-08-20T05:10:53.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.816+0000 7fbda1400640 1 --2- 172.21.15.37:0/759051449 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbd800b8300 0x7fbd800ba7c0 secure :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fbd84005fd0 tx=0x7fbd84005c70 comp rx=0 tx=0).stop 2024-08-20T05:10:53.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.816+0000 7fbda1400640 1 --2- 172.21.15.37:0/759051449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd9c10cc70 0x7fbd9c072490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:53.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.816+0000 7fbda1400640 1 --2- 172.21.15.37:0/759051449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbd9c104130 0x7fbd9c06d0f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:53.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.816+0000 7fbda1400640 1 --2- 172.21.15.37:0/759051449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbd9c103810 0x7fbd9c06cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:53.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.816+0000 7fbda1400640 1 -- 172.21.15.37:0/759051449 >> 172.21.15.37:0/759051449 conn(0x7fbd9c0fd2d0 msgr2=0x7fbd9c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:53.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.818+0000 7fbda1400640 1 -- 172.21.15.37:0/759051449 shutdown_connections 2024-08-20T05:10:53.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:53.819+0000 7fbda1400640 1 -- 172.21.15.37:0/759051449 wait complete. 2024-08-20T05:10:53.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:53 smithi135 ceph-mon[22342]: pgmap v660: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 604 op/s 2024-08-20T05:10:54.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:54 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/759051449' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:10:54.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:54 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/759051449' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:10:54.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:54 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/759051449' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:10:55.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:55 smithi130 ceph-mon[22007]: pgmap v661: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 577 op/s 2024-08-20T05:10:55.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:55 smithi037 ceph-mon[17265]: pgmap v661: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 577 op/s 2024-08-20T05:10:55.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:55 smithi135 ceph-mon[22342]: pgmap v661: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 577 op/s 2024-08-20T05:10:56.806 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 147.85 --await-for 45.0' 2024-08-20T05:10:56.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 147.85 --await-for 45.0 2024-08-20T05:10:57.531 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:10:57.660 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:10:57.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:57 smithi130 ceph-mon[22007]: pgmap v662: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 574 op/s 2024-08-20T05:10:57.713 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:57 smithi037 ceph-mon[17265]: pgmap v662: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 574 op/s 2024-08-20T05:10:57.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:57 smithi135 ceph-mon[22342]: pgmap v662: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.6 MiB/s wr, 574 op/s 2024-08-20T05:10:58.043 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 480.0 s, 750.2 tps, lat 131.337 ms stddev 137.403 2024-08-20T05:10:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.299+0000 7f3d43200640 1 -- 172.21.15.37:0/4030373714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d44076c60 msgr2=0x7f3d440752b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.299+0000 7f3d43200640 1 --2- 172.21.15.37:0/4030373714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d44076c60 0x7f3d440752b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c009ca0 tx=0x7f3d3c02a8e0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.302 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.300+0000 7f3d43200640 1 -- 172.21.15.37:0/4030373714 shutdown_connections 2024-08-20T05:10:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.300+0000 7f3d43200640 1 --2- 172.21.15.37:0/4030373714 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d4410a410 0x7f3d4410c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.300+0000 7f3d43200640 1 --2- 172.21.15.37:0/4030373714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d440757f0 0x7f3d44075c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.300+0000 7f3d43200640 1 --2- 172.21.15.37:0/4030373714 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d44076c60 0x7f3d440752b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.303 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.300+0000 7f3d43200640 1 -- 172.21.15.37:0/4030373714 >> 172.21.15.37:0/4030373714 conn(0x7f3d440fdd30 msgr2=0x7f3d44100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.301+0000 7f3d43200640 1 -- 172.21.15.37:0/4030373714 shutdown_connections 2024-08-20T05:10:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.301+0000 7f3d43200640 1 -- 172.21.15.37:0/4030373714 wait complete. 2024-08-20T05:10:58.304 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.303+0000 7f3d43200640 1 Processor -- start 2024-08-20T05:10:58.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.303+0000 7f3d43200640 1 -- start start 2024-08-20T05:10:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.304+0000 7f3d43200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d440757f0 0x7f3d4406f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.304+0000 7f3d43200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d4410a410 0x7f3d4406f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.304+0000 7f3d43200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d440705a0 0x7f3d44070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.304+0000 7f3d41400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d4410a410 0x7f3d4406f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.304+0000 7f3d41400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d4410a410 0x7f3d4406f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33512/0 (socket says 172.21.15.37:33512) 2024-08-20T05:10:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.304+0000 7f3d41400640 1 -- 172.21.15.37:0/3053086436 learned_addr learned my addr 172.21.15.37:0/3053086436 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.304+0000 7f3d42800640 1 --2- 172.21.15.37:0/3053086436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d440705a0 0x7f3d44070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.304+0000 7f3d41e00640 1 --2- 172.21.15.37:0/3053086436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d440757f0 0x7f3d4406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.305+0000 7f3d43200640 1 -- 172.21.15.37:0/3053086436 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d441031e0 con 0x7f3d440757f0 2024-08-20T05:10:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.305+0000 7f3d43200640 1 -- 172.21.15.37:0/3053086436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3d44103060 con 0x7f3d440705a0 2024-08-20T05:10:58.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.305+0000 7f3d43200640 1 -- 172.21.15.37:0/3053086436 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d44103360 con 0x7f3d4410a410 2024-08-20T05:10:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.305+0000 7f3d42800640 1 -- 172.21.15.37:0/3053086436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d4410a410 msgr2=0x7f3d4406f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.305+0000 7f3d42800640 1 --2- 172.21.15.37:0/3053086436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d4410a410 0x7f3d4406f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.305+0000 7f3d42800640 1 -- 172.21.15.37:0/3053086436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d440757f0 msgr2=0x7f3d4406f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.305+0000 7f3d42800640 1 --2- 172.21.15.37:0/3053086436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d440757f0 0x7f3d4406f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.305+0000 7f3d42800640 1 -- 172.21.15.37:0/3053086436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d44071250 con 0x7f3d440705a0 2024-08-20T05:10:58.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.305+0000 7f3d41400640 1 --2- 172.21.15.37:0/3053086436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d4410a410 0x7f3d4406f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:10:58.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.306+0000 7f3d42800640 1 --2- 172.21.15.37:0/3053086436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d440705a0 0x7f3d44070a50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000d680 tx=0x7f3d3000db40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:58.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.307+0000 7f3d3aa00640 1 -- 172.21.15.37:0/3053086436 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30017070 con 0x7f3d440705a0 2024-08-20T05:10:58.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.307+0000 7f3d3aa00640 1 -- 172.21.15.37:0/3053086436 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d30009820 con 0x7f3d440705a0 2024-08-20T05:10:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.307+0000 7f3d3aa00640 1 -- 172.21.15.37:0/3053086436 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d30004ce0 con 0x7f3d440705a0 2024-08-20T05:10:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.307+0000 7f3d43200640 1 -- 172.21.15.37:0/3053086436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d44073620 con 0x7f3d440705a0 2024-08-20T05:10:58.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.308+0000 7f3d43200640 1 -- 172.21.15.37:0/3053086436 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d44073b20 con 0x7f3d440705a0 2024-08-20T05:10:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.316+0000 7f3d4bc20740 1 Processor -- start 2024-08-20T05:10:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.316+0000 7f3d3aa00640 1 -- 172.21.15.37:0/3053086436 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3d300099d0 con 0x7f3d440705a0 2024-08-20T05:10:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.317+0000 7f3d4bc20740 1 -- start start 2024-08-20T05:10:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.317+0000 7f3d4bc20740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add0480 0x55760add2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.317+0000 7f3d4bc20740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add2db0 0x55760add51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.317+0000 7f3d4bc20740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add57f0 0x55760add7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.317+0000 7f3d4bc20740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55760ad43210 con 0x55760add0480 2024-08-20T05:10:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.317+0000 7f3d4bc20740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55760ad32710 con 0x55760add57f0 2024-08-20T05:10:58.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.317+0000 7f3d4bc20740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55760ad36750 con 0x55760add2db0 2024-08-20T05:10:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.318+0000 7f3d41e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add2db0 0x55760add51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.318+0000 7f3d41e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add2db0 0x55760add51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33518/0 (socket says 172.21.15.37:33518) 2024-08-20T05:10:58.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.318+0000 7f3d41e00640 1 -- 172.21.15.37:0/2005352836 learned_addr learned my addr 172.21.15.37:0/2005352836 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.318+0000 7f3d41400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add57f0 0x55760add7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.318+0000 7f3d41400640 1 --2- 172.21.15.37:0/2005352836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add0480 0x55760add2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.319+0000 7f3d41e00640 1 -- 172.21.15.37:0/2005352836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add57f0 msgr2=0x55760add7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.319+0000 7f3d41e00640 1 --2- 172.21.15.37:0/2005352836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add57f0 0x55760add7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.319+0000 7f3d41e00640 1 -- 172.21.15.37:0/2005352836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add0480 msgr2=0x55760add2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.319+0000 7f3d41e00640 1 --2- 172.21.15.37:0/2005352836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add0480 0x55760add2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.319+0000 7f3d41e00640 1 -- 172.21.15.37:0/2005352836 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55760acfede0 con 0x55760add2db0 2024-08-20T05:10:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.319+0000 7f3d3aa00640 1 --2- 172.21.15.37:0/3053086436 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d280b3c90 0x7f3d280b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.320+0000 7f3d3aa00640 1 -- 172.21.15.37:0/3053086436 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3d300e3800 con 0x7f3d440705a0 2024-08-20T05:10:58.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.323+0000 7f3d41e00640 1 --2- 172.21.15.37:0/2005352836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add2db0 0x55760add51a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c02ae50 tx=0x7f3d3c009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a793901cf36edcc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.323+0000 7f3d2f000640 1 -- 172.21.15.37:0/2005352836 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c031990 con 0x55760add2db0 2024-08-20T05:10:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.323+0000 7f3d41400640 1 --2- 172.21.15.37:0/3053086436 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d280b3c90 0x7f3d280b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.323+0000 7f3d2f000640 1 -- 172.21.15.37:0/2005352836 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d3c036040 con 0x55760add2db0 2024-08-20T05:10:58.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.324+0000 7f3d4bc20740 1 -- 172.21.15.37:0/2005352836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add2db0 msgr2=0x55760add51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.324+0000 7f3d2f000640 1 -- 172.21.15.37:0/2005352836 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c031990 con 0x55760add2db0 2024-08-20T05:10:58.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.324+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/2005352836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add2db0 0x55760add51a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c02ae50 tx=0x7f3d3c009a20 comp rx=0 tx=0).stop 2024-08-20T05:10:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.324+0000 7f3d4bc20740 1 -- 172.21.15.37:0/2005352836 shutdown_connections 2024-08-20T05:10:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.324+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/2005352836 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add57f0 0x55760add7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.324+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/2005352836 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add2db0 0x55760add51a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.324+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/2005352836 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add0480 0x55760add2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.324+0000 7f3d4bc20740 1 -- 172.21.15.37:0/2005352836 >> 172.21.15.37:0/2005352836 conn(0x55760adcb580 msgr2=0x55760adcc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.325+0000 7f3d4bc20740 1 -- 172.21.15.37:0/2005352836 shutdown_connections 2024-08-20T05:10:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.325+0000 7f3d4bc20740 1 -- 172.21.15.37:0/2005352836 wait complete. 2024-08-20T05:10:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.325+0000 7f3d4bc20740 1 -- start start 2024-08-20T05:10:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.326+0000 7f3d4bc20740 1 Processor -- start 2024-08-20T05:10:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.326+0000 7f3d41400640 1 --2- 172.21.15.37:0/3053086436 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d280b3c90 0x7f3d280b6150 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3d340097f0 tx=0x7f3d34005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.326+0000 7f3d4bc20740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add0480 0x55760add9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.327+0000 7f3d41e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add0480 0x55760add9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.327+0000 7f3d41e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add0480 0x55760add9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:51618/0 (socket says 172.21.15.37:51618) 2024-08-20T05:10:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.327+0000 7f3d4bc20740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add2db0 0x55760adda4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.327+0000 7f3d41e00640 1 -- 172.21.15.37:0/3159520485 learned_addr learned my addr 172.21.15.37:0/3159520485 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.327+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/3159520485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add57f0 0x55760addb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.327+0000 7f3d4bc20740 1 -- 172.21.15.37:0/3159520485 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55760ac6bab0 con 0x55760add2db0 2024-08-20T05:10:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.327+0000 7f3d4bc20740 1 -- 172.21.15.37:0/3159520485 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55760acd9140 con 0x55760add0480 2024-08-20T05:10:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.327+0000 7f3d4bc20740 1 -- 172.21.15.37:0/3159520485 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55760add87c0 con 0x55760add57f0 2024-08-20T05:10:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.327+0000 7f3d41e00640 1 -- 172.21.15.37:0/3159520485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add57f0 msgr2=0x55760addb090 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:10:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.327+0000 7f3d4bc20740 10 client.0 _ll_register_callbacks cb 0x55760acec5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.328+0000 7f3d42800640 1 --2- 172.21.15.37:0/3159520485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add57f0 0x55760addb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.328+0000 7f3d41e00640 1 --2- 172.21.15.37:0/3159520485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add57f0 0x55760addb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.328+0000 7f3d41e00640 1 -- 172.21.15.37:0/3159520485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add2db0 msgr2=0x55760adda4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:10:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.328+0000 7f3d41400640 1 --2- 172.21.15.37:0/3159520485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add2db0 0x55760adda4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.328+0000 7f3d41e00640 1 --2- 172.21.15.37:0/3159520485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add2db0 0x55760adda4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.328+0000 7f3d41e00640 1 -- 172.21.15.37:0/3159520485 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55760acda170 con 0x55760add0480 2024-08-20T05:10:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.329+0000 7f3d4bc20740 1 -- 172.21.15.37:0/3159520485 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55760ad09a30 con 0x55760add0480 2024-08-20T05:10:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.329+0000 7f3d41e00640 1 --2- 172.21.15.37:0/3159520485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add0480 0x55760add9e20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c009bf0 tx=0x7f3d3c031de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e9c75af4975310f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.329+0000 7f3d23400640 10 client.27626 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:10:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.330+0000 7f3d23400640 1 -- 172.21.15.37:0/3159520485 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c053020 con 0x55760add0480 2024-08-20T05:10:58.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.330+0000 7f3d23400640 1 -- 172.21.15.37:0/3159520485 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3d3c0306a0 con 0x55760add0480 2024-08-20T05:10:58.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.332+0000 7f3d23400640 1 -- 172.21.15.37:0/3159520485 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f3d3c0308e0 con 0x55760add0480 2024-08-20T05:10:58.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.332+0000 7f3d4bc20740 10 client.27626 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:58.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.332+0000 7f3d4bc20740 1 -- 172.21.15.37:0/3159520485 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({fsmap=39}) -- 0x55760aa95790 con 0x55760add0480 2024-08-20T05:10:58.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.334+0000 7f3d23400640 1 -- 172.21.15.37:0/3159520485 <== mon.2 v2:172.21.15.130:3300/0 4 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f3d3c045430 con 0x55760add0480 2024-08-20T05:10:58.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.334+0000 7f3d4bc20740 10 client.27626 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:58.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.334+0000 7f3d4bc20740 10 client.27626 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:10:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.336+0000 7f3d4bc20740 20 client.27626 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.336+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/3159520485 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55760ade5560 0x55760ade7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.336+0000 7f3d4bc20740 4 client.27626 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:10:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.336+0000 7f3d4bc20740 1 -- 172.21.15.37:0/3159520485 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55760ad45160 con 0x55760ade5560 2024-08-20T05:10:58.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.337+0000 7f3d41400640 1 --2- 172.21.15.37:0/3159520485 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55760ade5560 0x55760ade7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.341 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.339+0000 7f3d41400640 1 --2- 172.21.15.37:0/3159520485 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55760ade5560 0x55760ade7950 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f8cde70348e4d39 server_cookie=9063e473dac9c52f in_seq=0 out_seq=0 2024-08-20T05:10:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.339+0000 7f3d23400640 10 client.27626 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.340+0000 7f3d23400640 1 -- 172.21.15.37:0/3159520485 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55760ad45160 con 0x55760ade5560 2024-08-20T05:10:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.340+0000 7f3d23400640 10 client.27626 handle_command_reply: tid=0 2024-08-20T05:10:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.341+0000 7f3d4bc20740 1 client.27626 shutdown 2024-08-20T05:10:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.341+0000 7f3d4bc20740 1 -- 172.21.15.37:0/3159520485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add0480 msgr2=0x55760add9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.341+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/3159520485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add0480 0x55760add9e20 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c009bf0 tx=0x7f3d3c031de0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.342+0000 7f3d4bc20740 1 -- 172.21.15.37:0/3159520485 shutdown_connections 2024-08-20T05:10:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.342+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/3159520485 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55760ade5560 0x55760ade7950 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.342+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/3159520485 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add57f0 0x55760addb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.342+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/3159520485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add2db0 0x55760adda4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.342+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/3159520485 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add0480 0x55760add9e20 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.344 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.342+0000 7f3d23400640 0 client.27626 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:58.345 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.342+0000 7f3d4bc20740 1 -- 172.21.15.37:0/3159520485 >> 172.21.15.37:0/3159520485 conn(0x55760adcb580 msgr2=0x55760adca6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:58.345 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.343+0000 7f3d4bc20740 1 -- 172.21.15.37:0/3159520485 shutdown_connections 2024-08-20T05:10:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.343+0000 7f3d4bc20740 1 -- 172.21.15.37:0/3159520485 wait complete. 2024-08-20T05:10:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.346+0000 7f3d4bc20740 20 client.27626 trim_cache size 0 max 16384 2024-08-20T05:10:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.391+0000 7f3d4bc20740 1 Processor -- start 2024-08-20T05:10:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.391+0000 7f3d4bc20740 1 -- start start 2024-08-20T05:10:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.391+0000 7f3d4bc20740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add0480 0x55760add73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.391+0000 7f3d4bc20740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add2db0 0x55760add7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.391+0000 7f3d4bc20740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add57f0 0x55760add5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.391+0000 7f3d4bc20740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d441ba540 con 0x55760add57f0 2024-08-20T05:10:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.391+0000 7f3d4bc20740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3d441bc1a0 con 0x55760add2db0 2024-08-20T05:10:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.391+0000 7f3d4bc20740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d441bac10 con 0x55760add0480 2024-08-20T05:10:58.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.392+0000 7f3d41400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add2db0 0x55760add7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.392+0000 7f3d41400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add2db0 0x55760add7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:51630/0 (socket says 172.21.15.37:51630) 2024-08-20T05:10:58.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.392+0000 7f3d41400640 1 -- 172.21.15.37:0/1586075808 learned_addr learned my addr 172.21.15.37:0/1586075808 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:58.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.392+0000 7f3d41e00640 1 --2- 172.21.15.37:0/1586075808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add0480 0x55760add73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.392+0000 7f3d41400640 1 -- 172.21.15.37:0/1586075808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add0480 msgr2=0x55760add73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:58.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.392+0000 7f3d41400640 1 --2- 172.21.15.37:0/1586075808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add0480 0x55760add73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.393+0000 7f3d41400640 1 -- 172.21.15.37:0/1586075808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add57f0 msgr2=0x55760add5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:58.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.393+0000 7f3d41400640 1 --2- 172.21.15.37:0/1586075808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add57f0 0x55760add5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.393+0000 7f3d41400640 1 -- 172.21.15.37:0/1586075808 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55760ab0e620 con 0x55760add2db0 2024-08-20T05:10:58.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.393+0000 7f3d41400640 1 --2- 172.21.15.37:0/1586075808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add2db0 0x55760add7900 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x55760ade80f0 tx=0x7f3d34019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e523ee921f7b6961 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:58.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.394+0000 7f3d2e600640 1 -- 172.21.15.37:0/1586075808 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3401ebf0 con 0x55760add2db0 2024-08-20T05:10:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.396+0000 7f3d2e600640 1 -- 172.21.15.37:0/1586075808 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55760ad45160 con 0x55760add2db0 2024-08-20T05:10:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.396+0000 7f3d2e600640 1 -- 172.21.15.37:0/1586075808 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3401ebf0 con 0x55760add2db0 2024-08-20T05:10:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.398+0000 7f3d4bc20740 1 -- 172.21.15.37:0/1586075808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add2db0 msgr2=0x55760add7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.398+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/1586075808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add2db0 0x55760add7900 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x55760ade80f0 tx=0x7f3d34019000 comp rx=0 tx=0).stop 2024-08-20T05:10:58.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.399+0000 7f3d4bc20740 1 -- 172.21.15.37:0/1586075808 shutdown_connections 2024-08-20T05:10:58.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.399+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/1586075808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add57f0 0x55760add5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.399+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/1586075808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add2db0 0x55760add7900 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.399+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/1586075808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add0480 0x55760add73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.399+0000 7f3d4bc20740 1 -- 172.21.15.37:0/1586075808 >> 172.21.15.37:0/1586075808 conn(0x55760adcb580 msgr2=0x55760add9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:58.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.400+0000 7f3d4bc20740 1 -- 172.21.15.37:0/1586075808 shutdown_connections 2024-08-20T05:10:58.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.400+0000 7f3d4bc20740 1 -- 172.21.15.37:0/1586075808 wait complete. 2024-08-20T05:10:58.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.400+0000 7f3d4bc20740 1 -- start start 2024-08-20T05:10:58.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.401+0000 7f3d4bc20740 1 Processor -- start 2024-08-20T05:10:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.402+0000 7f3d4bc20740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add0480 0x55760addec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.403+0000 7f3d4bc20740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add2db0 0x55760addf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.403+0000 7f3d41e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add0480 0x55760addec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.404+0000 7f3d41e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add0480 0x55760addec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:51642/0 (socket says 172.21.15.37:51642) 2024-08-20T05:10:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.403+0000 7f3d4bc20740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add57f0 0x55760addfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.403+0000 7f3d41400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add2db0 0x55760addf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.404+0000 7f3d41400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add2db0 0x55760addf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33544/0 (socket says 172.21.15.37:33544) 2024-08-20T05:10:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.405+0000 7f3d41e00640 1 -- 172.21.15.37:0/373624226 learned_addr learned my addr 172.21.15.37:0/373624226 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.405+0000 7f3d4bc20740 1 -- 172.21.15.37:0/373624226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d441bba10 con 0x55760add57f0 2024-08-20T05:10:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.405+0000 7f3d4bc20740 1 -- 172.21.15.37:0/373624226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3d441bb2e0 con 0x55760add0480 2024-08-20T05:10:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.405+0000 7f3d4bc20740 1 -- 172.21.15.37:0/373624226 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d441b8520 con 0x55760add2db0 2024-08-20T05:10:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.405+0000 7f3d4bc20740 10 client.0 _ll_register_callbacks cb 0x7f3d3c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.405+0000 7f3d42800640 1 --2- 172.21.15.37:0/373624226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add57f0 0x55760addfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.405+0000 7f3d41e00640 1 -- 172.21.15.37:0/373624226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add2db0 msgr2=0x55760addf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:58.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.405+0000 7f3d41e00640 1 --2- 172.21.15.37:0/373624226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add2db0 0x55760addf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.405+0000 7f3d41e00640 1 -- 172.21.15.37:0/373624226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add57f0 msgr2=0x55760addfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:58.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.405+0000 7f3d41e00640 1 --2- 172.21.15.37:0/373624226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add57f0 0x55760addfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.406+0000 7f3d41e00640 1 -- 172.21.15.37:0/373624226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55760ade06e0 con 0x55760add0480 2024-08-20T05:10:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.406+0000 7f3d41e00640 1 --2- 172.21.15.37:0/373624226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add0480 0x55760addec90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0308b0 tx=0x7f3d3c02a8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9be23ea9557944f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.406+0000 7f3d23400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:10:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.407+0000 7f3d23400640 1 -- 172.21.15.37:0/373624226 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c053070 con 0x55760add0480 2024-08-20T05:10:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.407+0000 7f3d23400640 1 -- 172.21.15.37:0/373624226 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3d3c030a80 con 0x55760add0480 2024-08-20T05:10:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.407+0000 7f3d4bc20740 1 -- 172.21.15.37:0/373624226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55760ad45160 con 0x55760add0480 2024-08-20T05:10:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.407+0000 7f3d23400640 1 -- 172.21.15.37:0/373624226 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f3d3c06b050 con 0x55760add0480 2024-08-20T05:10:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.407+0000 7f3d4bc20740 10 client.27632 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:58.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.407+0000 7f3d4bc20740 1 -- 172.21.15.37:0/373624226 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55760ade1a30 con 0x55760add0480 2024-08-20T05:10:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.408+0000 7f3d23400640 1 -- 172.21.15.37:0/373624226 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55760ad45160 con 0x55760add0480 2024-08-20T05:10:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.408+0000 7f3d23400640 1 -- 172.21.15.37:0/373624226 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f3d3c062810 con 0x55760add0480 2024-08-20T05:10:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.408+0000 7f3d4bc20740 10 client.27632 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.408+0000 7f3d4bc20740 10 client.27632 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:10:58.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.408+0000 7f3d4bc20740 20 client.27632 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.409+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/373624226 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55760ae50150 0x55760ae52540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.409+0000 7f3d4bc20740 4 client.27632 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:10:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.409+0000 7f3d4bc20740 1 -- 172.21.15.37:0/373624226 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55760ad40c00 con 0x55760ae50150 2024-08-20T05:10:58.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.409+0000 7f3d41400640 1 --2- 172.21.15.37:0/373624226 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55760ae50150 0x55760ae52540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.411+0000 7f3d23400640 10 client.27632 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.412+0000 7f3d41400640 1 --2- 172.21.15.37:0/373624226 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55760ae50150 0x55760ae52540 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8f88adc26eacac2 server_cookie=50b3906f36d1e676 in_seq=0 out_seq=0 2024-08-20T05:10:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.486+0000 7f3d23400640 1 -- 172.21.15.37:0/373624226 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55760ad40c00 con 0x55760ae50150 2024-08-20T05:10:58.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.486+0000 7f3d23400640 10 client.27632 handle_command_reply: tid=0 2024-08-20T05:10:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.487+0000 7f3d4bc20740 1 client.27632 shutdown 2024-08-20T05:10:58.489 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.487+0000 7f3d4bc20740 1 -- 172.21.15.37:0/373624226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add0480 msgr2=0x55760addec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.487+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/373624226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add0480 0x55760addec90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0308b0 tx=0x7f3d3c02a8e0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.488+0000 7f3d4bc20740 1 -- 172.21.15.37:0/373624226 shutdown_connections 2024-08-20T05:10:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.488+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/373624226 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55760ae50150 0x55760ae52540 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.488+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/373624226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55760add57f0 0x55760addfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.488+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/373624226 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55760add2db0 0x55760addf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.488+0000 7f3d4bc20740 1 --2- 172.21.15.37:0/373624226 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55760add0480 0x55760addec90 secure :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c0308b0 tx=0x7f3d3c02a8e0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.488+0000 7f3d4bc20740 1 -- 172.21.15.37:0/373624226 >> 172.21.15.37:0/373624226 conn(0x55760adcb580 msgr2=0x55760add73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:58.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.488+0000 7f3d23400640 0 client.27632 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:58.491 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.489+0000 7f3d4bc20740 1 -- 172.21.15.37:0/373624226 shutdown_connections 2024-08-20T05:10:58.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:10:58.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:10:58.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:10:58.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:10:58.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.489+0000 7f3d4bc20740 1 -- 172.21.15.37:0/373624226 wait complete. 2024-08-20T05:10:58.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.489+0000 7f3d4bc20740 20 client.27632 trim_cache size 0 max 16384 2024-08-20T05:10:58.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.491+0000 7f3d43200640 1 -- 172.21.15.37:0/3053086436 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d280b3c90 msgr2=0x7f3d280b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.491+0000 7f3d43200640 1 --2- 172.21.15.37:0/3053086436 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d280b3c90 0x7f3d280b6150 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3d340097f0 tx=0x7f3d34005f90 comp rx=0 tx=0).stop 2024-08-20T05:10:58.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.491+0000 7f3d43200640 1 -- 172.21.15.37:0/3053086436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d440705a0 msgr2=0x7f3d44070a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.491+0000 7f3d43200640 1 --2- 172.21.15.37:0/3053086436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d440705a0 0x7f3d44070a50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000d680 tx=0x7f3d3000db40 comp rx=0 tx=0).stop 2024-08-20T05:10:58.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.491+0000 7f8ebfe00640 1 -- 172.21.15.37:0/2334538524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8eb8109e80 msgr2=0x7f8eb810a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.491+0000 7f8ebfe00640 1 --2- 172.21.15.37:0/2334538524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8eb8109e80 0x7f8eb810a260 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00fb10 tx=0x7f8eac02e600 comp rx=0 tx=0).stop 2024-08-20T05:10:58.495 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.492+0000 7f3d43200640 1 -- 172.21.15.37:0/3053086436 shutdown_connections 2024-08-20T05:10:58.495 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.492+0000 7f3d43200640 1 --2- 172.21.15.37:0/3053086436 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d280b3c90 0x7f3d280b6150 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.495 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.492+0000 7f3d43200640 1 --2- 172.21.15.37:0/3053086436 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d440705a0 0x7f3d44070a50 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.495 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.492+0000 7f3d43200640 1 --2- 172.21.15.37:0/3053086436 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d4410a410 0x7f3d4406f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.495 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.492+0000 7f3d43200640 1 --2- 172.21.15.37:0/3053086436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d440757f0 0x7f3d4406f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.495 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.492+0000 7f3d43200640 1 -- 172.21.15.37:0/3053086436 >> 172.21.15.37:0/3053086436 conn(0x7f3d440fdd30 msgr2=0x7f3d44100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:58.495 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.492+0000 7f3d43200640 1 -- 172.21.15.37:0/3053086436 shutdown_connections 2024-08-20T05:10:58.495 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:10:58.493+0000 7f3d43200640 1 -- 172.21.15.37:0/3053086436 wait complete. 2024-08-20T05:10:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.492+0000 7f8ebfe00640 1 -- 172.21.15.37:0/2334538524 shutdown_connections 2024-08-20T05:10:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.492+0000 7f8ebfe00640 1 --2- 172.21.15.37:0/2334538524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb8115740 0x7f8eb8117b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.492+0000 7f8ebfe00640 1 --2- 172.21.15.37:0/2334538524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb810a7a0 0x7f8eb8115200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.492+0000 7f8ebfe00640 1 --2- 172.21.15.37:0/2334538524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8eb8109e80 0x7f8eb810a260 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.492+0000 7f8ebfe00640 1 -- 172.21.15.37:0/2334538524 >> 172.21.15.37:0/2334538524 conn(0x7f8eb806dcc0 msgr2=0x7f8eb806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.493+0000 7f8ebfe00640 1 -- 172.21.15.37:0/2334538524 shutdown_connections 2024-08-20T05:10:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.493+0000 7f8ebfe00640 1 -- 172.21.15.37:0/2334538524 wait complete. 2024-08-20T05:10:58.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.495+0000 7f8ebfe00640 1 Processor -- start 2024-08-20T05:10:58.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.496+0000 7f8ebfe00640 1 -- start start 2024-08-20T05:10:58.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.496+0000 7f8ebfe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb8109e80 0x7f8eb81a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.496+0000 7f8ebfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8eb810a7a0 0x7f8eb81a8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.496+0000 7f8ebfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb8115740 0x7f8eb81ad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.496+0000 7f8ebfe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb81190c0 con 0x7f8eb8115740 2024-08-20T05:10:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.496+0000 7f8ebfe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb8118f40 con 0x7f8eb810a7a0 2024-08-20T05:10:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.496+0000 7f8ebfe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb8119240 con 0x7f8eb8109e80 2024-08-20T05:10:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.497+0000 7f8ebca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8eb810a7a0 0x7f8eb81a8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.497+0000 7f8ebca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8eb810a7a0 0x7f8eb81a8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:51666/0 (socket says 172.21.15.37:51666) 2024-08-20T05:10:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.497+0000 7f8ebca00640 1 -- 172.21.15.37:0/1580742832 learned_addr learned my addr 172.21.15.37:0/1580742832 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.497+0000 7f8ebd400640 1 --2- 172.21.15.37:0/1580742832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb8109e80 0x7f8eb81a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.498+0000 7f8ebca00640 1 -- 172.21.15.37:0/1580742832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb8109e80 msgr2=0x7f8eb81a7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.498+0000 7f8ebca00640 1 --2- 172.21.15.37:0/1580742832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb8109e80 0x7f8eb81a7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.498+0000 7f8ebca00640 1 -- 172.21.15.37:0/1580742832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb8115740 msgr2=0x7f8eb81ad6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.498+0000 7f8ebde00640 1 --2- 172.21.15.37:0/1580742832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb8115740 0x7f8eb81ad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.498+0000 7f8ebca00640 1 --2- 172.21.15.37:0/1580742832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb8115740 0x7f8eb81ad6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.498+0000 7f8ebca00640 1 -- 172.21.15.37:0/1580742832 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb81ade90 con 0x7f8eb810a7a0 2024-08-20T05:10:58.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.498+0000 7f8ebde00640 1 --2- 172.21.15.37:0/1580742832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb8115740 0x7f8eb81ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:10:58.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.499+0000 7f8ebca00640 1 --2- 172.21.15.37:0/1580742832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8eb810a7a0 0x7f8eb81a8320 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400d950 tx=0x7f8ea400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:58.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.499+0000 7f8eb6000640 1 -- 172.21.15.37:0/1580742832 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4017030 con 0x7f8eb810a7a0 2024-08-20T05:10:58.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.499+0000 7f8eb6000640 1 -- 172.21.15.37:0/1580742832 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ea4004020 con 0x7f8eb810a7a0 2024-08-20T05:10:58.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.499+0000 7f8eb6000640 1 -- 172.21.15.37:0/1580742832 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40047a0 con 0x7f8eb810a7a0 2024-08-20T05:10:58.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.503+0000 7f8ebfe00640 1 -- 172.21.15.37:0/1580742832 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb81ae180 con 0x7f8eb810a7a0 2024-08-20T05:10:58.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.503+0000 7f8ebfe00640 1 -- 172.21.15.37:0/1580742832 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb819f2e0 con 0x7f8eb810a7a0 2024-08-20T05:10:58.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.515+0000 7f8ec289d740 1 Processor -- start 2024-08-20T05:10:58.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.515+0000 7f8eb6000640 1 -- 172.21.15.37:0/1580742832 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8ea4009a30 con 0x7f8eb810a7a0 2024-08-20T05:10:58.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.516+0000 7f8ec289d740 1 -- start start 2024-08-20T05:10:58.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.516+0000 7f8ec289d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07de40 0x56322d07e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.517+0000 7f8ebde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07de40 0x56322d07e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.517+0000 7f8ec289d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d07e760 0x56322d08a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.517+0000 7f8ec289d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d08a6f0 0x56322d08cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.517+0000 7f8ec289d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56322cff3600 con 0x56322d07e760 2024-08-20T05:10:58.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.517+0000 7f8ec289d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56322cfe2b00 con 0x56322d07de40 2024-08-20T05:10:58.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.517+0000 7f8ec289d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56322cfe6b40 con 0x56322d08a6f0 2024-08-20T05:10:58.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.517+0000 7f8ebde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07de40 0x56322d07e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:51674/0 (socket says 172.21.15.37:51674) 2024-08-20T05:10:58.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.518+0000 7f8ebde00640 1 -- 172.21.15.37:0/1095727945 learned_addr learned my addr 172.21.15.37:0/1095727945 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:58.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.518+0000 7f8ebd400640 1 --2- 172.21.15.37:0/1095727945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d07e760 0x56322d08a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.519+0000 7f8ebca00640 1 --2- 172.21.15.37:0/1095727945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d08a6f0 0x56322d08cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.519+0000 7f8ebde00640 1 -- 172.21.15.37:0/1095727945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d08a6f0 msgr2=0x56322d08cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:58.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.520+0000 7f8ebde00640 1 --2- 172.21.15.37:0/1095727945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d08a6f0 0x56322d08cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.520+0000 7f8ebde00640 1 -- 172.21.15.37:0/1095727945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d07e760 msgr2=0x56322d08a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:58.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.520+0000 7f8ebde00640 1 --2- 172.21.15.37:0/1095727945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d07e760 0x56322d08a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.520+0000 7f8ebde00640 1 -- 172.21.15.37:0/1095727945 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56322cf88ee0 con 0x56322d07de40 2024-08-20T05:10:58.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.520+0000 7f8ebd400640 1 --2- 172.21.15.37:0/1095727945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d07e760 0x56322d08a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:10:58.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.520+0000 7f8ebca00640 1 --2- 172.21.15.37:0/1095727945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d08a6f0 0x56322d08cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:10:58.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.520+0000 7f8eb6000640 1 --2- 172.21.15.37:0/1580742832 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8ea00b3c90 0x7f8ea00b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.520+0000 7f8eb6000640 1 -- 172.21.15.37:0/1580742832 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8ea40e30d0 con 0x7f8eb810a7a0 2024-08-20T05:10:58.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.521+0000 7f8ebd400640 1 --2- 172.21.15.37:0/1580742832 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8ea00b3c90 0x7f8ea00b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.522+0000 7f8ebde00640 1 --2- 172.21.15.37:0/1095727945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07de40 0x56322d07e220 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0009f70 tx=0x7f8eb0031800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b4348856f8ff6c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:58.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.522+0000 7f8eaa600640 1 -- 172.21.15.37:0/1095727945 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0033650 con 0x56322d07de40 2024-08-20T05:10:58.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.522+0000 7f8eaa600640 1 -- 172.21.15.37:0/1095727945 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8eb0033ca0 con 0x56322d07de40 2024-08-20T05:10:58.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.522+0000 7f8eaa600640 1 -- 172.21.15.37:0/1095727945 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0032dc0 con 0x56322d07de40 2024-08-20T05:10:58.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.523+0000 7f8ec289d740 1 -- 172.21.15.37:0/1095727945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07de40 msgr2=0x56322d07e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.523+0000 7f8ec289d740 1 --2- 172.21.15.37:0/1095727945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07de40 0x56322d07e220 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0009f70 tx=0x7f8eb0031800 comp rx=0 tx=0).stop 2024-08-20T05:10:58.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.523+0000 7f8ebd400640 1 --2- 172.21.15.37:0/1580742832 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8ea00b3c90 0x7f8ea00b6150 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8eac006010 tx=0x7f8eac02eb00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:58.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.523+0000 7f8ec289d740 1 -- 172.21.15.37:0/1095727945 shutdown_connections 2024-08-20T05:10:58.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.523+0000 7f8ec289d740 1 --2- 172.21.15.37:0/1095727945 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d08a6f0 0x56322d08cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.523+0000 7f8ec289d740 1 --2- 172.21.15.37:0/1095727945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d07e760 0x56322d08a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.523+0000 7f8ec289d740 1 --2- 172.21.15.37:0/1095727945 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07de40 0x56322d07e220 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.523+0000 7f8ec289d740 1 -- 172.21.15.37:0/1095727945 >> 172.21.15.37:0/1095727945 conn(0x56322d07bc70 msgr2=0x56322d07ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:58.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.524+0000 7f8ec289d740 1 -- 172.21.15.37:0/1095727945 shutdown_connections 2024-08-20T05:10:58.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.525+0000 7f8ec289d740 1 -- 172.21.15.37:0/1095727945 wait complete. 2024-08-20T05:10:58.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.525+0000 7f8ec289d740 1 -- start start 2024-08-20T05:10:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.526+0000 7f8ec289d740 1 Processor -- start 2024-08-20T05:10:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.526+0000 7f8ec289d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 0x56322d087730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.526+0000 7f8ec289d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07e760 0x56322d087c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.526+0000 7f8ec289d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d08a6f0 0x56322d0881b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.526+0000 7f8ec289d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56322ce457b0 con 0x56322d08a6f0 2024-08-20T05:10:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.526+0000 7f8ec289d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56322cf7ddd0 con 0x56322d07e760 2024-08-20T05:10:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.526+0000 7f8ec289d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56322d08d370 con 0x56322d07de40 2024-08-20T05:10:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.527+0000 7f8ec289d740 10 client.0 _ll_register_callbacks cb 0x56322ccef0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.527+0000 7f8ebd400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 0x56322d087730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.527+0000 7f8ebd400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 0x56322d087730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33592/0 (socket says 172.21.15.37:33592) 2024-08-20T05:10:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.527+0000 7f8ebd400640 1 -- 172.21.15.37:0/3549813417 learned_addr learned my addr 172.21.15.37:0/3549813417 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.527+0000 7f8ebca00640 1 --2- 172.21.15.37:0/3549813417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07e760 0x56322d087c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.527+0000 7f8ebde00640 1 --2- 172.21.15.37:0/3549813417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d08a6f0 0x56322d0881b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.528+0000 7f8ebd400640 1 -- 172.21.15.37:0/3549813417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07e760 msgr2=0x56322d087c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.528+0000 7f8ebd400640 1 --2- 172.21.15.37:0/3549813417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07e760 0x56322d087c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.528+0000 7f8ebd400640 1 -- 172.21.15.37:0/3549813417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d08a6f0 msgr2=0x56322d0881b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.528+0000 7f8ebd400640 1 --2- 172.21.15.37:0/3549813417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d08a6f0 0x56322d0881b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.528+0000 7f8ebd400640 1 -- 172.21.15.37:0/3549813417 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56322cd51ba0 con 0x56322d07de40 2024-08-20T05:10:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.528+0000 7f8ebd400640 1 --2- 172.21.15.37:0/3549813417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 0x56322d087730 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8eac036000 tx=0x7f8eac02e600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b893e50d88f8e8ec server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.528+0000 7f8e9ea00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:10:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.529+0000 7f8e9ea00640 1 -- 172.21.15.37:0/3549813417 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac051070 con 0x56322d07de40 2024-08-20T05:10:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.529+0000 7f8e9ea00640 1 -- 172.21.15.37:0/3549813417 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8eac003af0 con 0x56322d07de40 2024-08-20T05:10:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.529+0000 7f8ec289d740 1 -- 172.21.15.37:0/3549813417 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8eb0033ca0 con 0x56322d07de40 2024-08-20T05:10:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.529+0000 7f8e9ea00640 1 -- 172.21.15.37:0/3549813417 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8eac05b050 con 0x56322d07de40 2024-08-20T05:10:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.529+0000 7f8ec289d740 10 client.27640 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.529+0000 7f8ec289d740 1 -- 172.21.15.37:0/3549813417 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56322d098f70 con 0x56322d07de40 2024-08-20T05:10:58.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.529+0000 7f8e9ea00640 1 -- 172.21.15.37:0/3549813417 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8eb0033ca0 con 0x56322d07de40 2024-08-20T05:10:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.530+0000 7f8e9ea00640 1 -- 172.21.15.37:0/3549813417 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f8eac04db30 con 0x56322d07de40 2024-08-20T05:10:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.530+0000 7f8ec289d740 10 client.27640 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.530+0000 7f8ec289d740 10 client.27640 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:10:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.530+0000 7f8ec289d740 20 client.27640 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.530+0000 7f8ec289d740 1 --2- 172.21.15.37:0/3549813417 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56322d09a430 0x56322d09c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.530+0000 7f8ec289d740 4 client.27640 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:10:58.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.530+0000 7f8ec289d740 1 -- 172.21.15.37:0/3549813417 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56322cff5550 con 0x56322d09a430 2024-08-20T05:10:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.530+0000 7f8ebca00640 1 --2- 172.21.15.37:0/3549813417 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56322d09a430 0x56322d09c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.531+0000 7f8ebca00640 1 --2- 172.21.15.37:0/3549813417 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56322d09a430 0x56322d09c860 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2607f1990ef0df6 server_cookie=2b02d5cf623babe6 in_seq=0 out_seq=0 2024-08-20T05:10:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.531+0000 7f8e9ea00640 10 client.27640 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.532+0000 7f8e9ea00640 1 -- 172.21.15.37:0/3549813417 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56322cff5550 con 0x56322d09a430 2024-08-20T05:10:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.532+0000 7f8e9ea00640 10 client.27640 handle_command_reply: tid=0 2024-08-20T05:10:58.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.532+0000 7f8ec289d740 1 client.27640 shutdown 2024-08-20T05:10:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.533+0000 7f8ec289d740 1 -- 172.21.15.37:0/3549813417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 msgr2=0x56322d087730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.533+0000 7f8ec289d740 1 --2- 172.21.15.37:0/3549813417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 0x56322d087730 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8eac036000 tx=0x7f8eac02e600 comp rx=0 tx=0).stop 2024-08-20T05:10:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.534+0000 7f8ec289d740 1 -- 172.21.15.37:0/3549813417 shutdown_connections 2024-08-20T05:10:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.534+0000 7f8ec289d740 1 --2- 172.21.15.37:0/3549813417 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56322d09a430 0x56322d09c860 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.534+0000 7f8ec289d740 1 --2- 172.21.15.37:0/3549813417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d08a6f0 0x56322d0881b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.534+0000 7f8ec289d740 1 --2- 172.21.15.37:0/3549813417 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07e760 0x56322d087c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.534+0000 7f8ec289d740 1 --2- 172.21.15.37:0/3549813417 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 0x56322d087730 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.534+0000 7f8ec289d740 1 -- 172.21.15.37:0/3549813417 >> 172.21.15.37:0/3549813417 conn(0x56322d07bc70 msgr2=0x56322d081810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.534+0000 7f8e9ea00640 0 client.27640 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.534+0000 7f8ec289d740 1 -- 172.21.15.37:0/3549813417 shutdown_connections 2024-08-20T05:10:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.534+0000 7f8ec289d740 1 -- 172.21.15.37:0/3549813417 wait complete. 2024-08-20T05:10:58.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.534+0000 7f8ec289d740 20 client.27640 trim_cache size 0 max 16384 2024-08-20T05:10:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:10:58.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.566+0000 7f8ec289d740 1 Processor -- start 2024-08-20T05:10:58.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.566+0000 7f8ec289d740 1 -- start start 2024-08-20T05:10:58.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.567+0000 7f8ec289d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 0x56322d081eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.567+0000 7f8ec289d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07e760 0x56322d089470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.567+0000 7f8ec289d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d08a6f0 0x56322d0a2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.567+0000 7f8ec289d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb81b82e0 con 0x56322d08a6f0 2024-08-20T05:10:58.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.567+0000 7f8ec289d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb81b5fb0 con 0x56322d07e760 2024-08-20T05:10:58.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.567+0000 7f8ec289d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb81b7c10 con 0x56322d07de40 2024-08-20T05:10:58.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.567+0000 7f8ebca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07e760 0x56322d089470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.567+0000 7f8ebd400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 0x56322d081eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.567+0000 7f8ebd400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 0x56322d081eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33602/0 (socket says 172.21.15.37:33602) 2024-08-20T05:10:58.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.567+0000 7f8ebd400640 1 -- 172.21.15.37:0/1325583623 learned_addr learned my addr 172.21.15.37:0/1325583623 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:58.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.568+0000 7f8ebde00640 1 --2- 172.21.15.37:0/1325583623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d08a6f0 0x56322d0a2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.568+0000 7f8ebd400640 1 -- 172.21.15.37:0/1325583623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07e760 msgr2=0x56322d089470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:58.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.568+0000 7f8ebd400640 1 --2- 172.21.15.37:0/1325583623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07e760 0x56322d089470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.568+0000 7f8ebd400640 1 -- 172.21.15.37:0/1325583623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d08a6f0 msgr2=0x56322d0a2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:58.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.568+0000 7f8ebd400640 1 --2- 172.21.15.37:0/1325583623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d08a6f0 0x56322d0a2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.568+0000 7f8ebd400640 1 -- 172.21.15.37:0/1325583623 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56322d083070 con 0x56322d07de40 2024-08-20T05:10:58.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.568+0000 7f8ebd400640 1 --2- 172.21.15.37:0/1325583623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 0x56322d081eb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8eac037040 tx=0x7f8eac004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=556f19308c0277c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:58.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.569+0000 7f8ea9c00640 1 -- 172.21.15.37:0/1325583623 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac05b050 con 0x56322d07de40 2024-08-20T05:10:58.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.569+0000 7f8ea9c00640 1 -- 172.21.15.37:0/1325583623 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8eac003f20 con 0x56322d07de40 2024-08-20T05:10:58.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.569+0000 7f8ea9c00640 1 -- 172.21.15.37:0/1325583623 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac04d6b0 con 0x56322d07de40 2024-08-20T05:10:58.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.571+0000 7f8ec289d740 1 -- 172.21.15.37:0/1325583623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 msgr2=0x56322d081eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.571+0000 7f8ec289d740 1 --2- 172.21.15.37:0/1325583623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 0x56322d081eb0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8eac037040 tx=0x7f8eac004600 comp rx=0 tx=0).stop 2024-08-20T05:10:58.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.571+0000 7f8ec289d740 1 -- 172.21.15.37:0/1325583623 shutdown_connections 2024-08-20T05:10:58.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.571+0000 7f8ec289d740 1 --2- 172.21.15.37:0/1325583623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d08a6f0 0x56322d0a2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.571+0000 7f8ec289d740 1 --2- 172.21.15.37:0/1325583623 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07e760 0x56322d089470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.571+0000 7f8ec289d740 1 --2- 172.21.15.37:0/1325583623 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 0x56322d081eb0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.571+0000 7f8ec289d740 1 -- 172.21.15.37:0/1325583623 >> 172.21.15.37:0/1325583623 conn(0x56322d07bc70 msgr2=0x56322d088d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:58.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.571+0000 7f8ec289d740 1 -- 172.21.15.37:0/1325583623 shutdown_connections 2024-08-20T05:10:58.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.572+0000 7f8ec289d740 1 -- 172.21.15.37:0/1325583623 wait complete. 2024-08-20T05:10:58.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.572+0000 7f8ec289d740 1 -- start start 2024-08-20T05:10:58.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.573+0000 7f8ec289d740 1 Processor -- start 2024-08-20T05:10:58.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.574+0000 7f8ec289d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 0x56322d092e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.574+0000 7f8ec289d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07e760 0x56322d08e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.574+0000 7f8ec289d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d08a6f0 0x56322d08e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.574+0000 7f8ec289d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb81b6d50 con 0x56322d08a6f0 2024-08-20T05:10:58.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.574+0000 7f8ec289d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb81b6680 con 0x56322d07e760 2024-08-20T05:10:58.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.574+0000 7f8ec289d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb81b7480 con 0x56322d07de40 2024-08-20T05:10:58.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.574+0000 7f8ec289d740 10 client.0 _ll_register_callbacks cb 0x7f8eac044070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:10:58.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.574+0000 7f8ebde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d08a6f0 0x56322d08e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.574+0000 7f8ebde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d08a6f0 0x56322d08e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45064/0 (socket says 172.21.15.37:45064) 2024-08-20T05:10:58.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.574+0000 7f8ebde00640 1 -- 172.21.15.37:0/3812530472 learned_addr learned my addr 172.21.15.37:0/3812530472 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:10:58.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.574+0000 7f8ebd400640 1 --2- 172.21.15.37:0/3812530472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 0x56322d092e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.574+0000 7f8ebca00640 1 --2- 172.21.15.37:0/3812530472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07e760 0x56322d08e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.575+0000 7f8ebd400640 1 -- 172.21.15.37:0/3812530472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07e760 msgr2=0x56322d08e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:58.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.575+0000 7f8ebd400640 1 --2- 172.21.15.37:0/3812530472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07e760 0x56322d08e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.575+0000 7f8ebd400640 1 -- 172.21.15.37:0/3812530472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d08a6f0 msgr2=0x56322d08e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:10:58.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.575+0000 7f8ebd400640 1 --2- 172.21.15.37:0/3812530472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d08a6f0 0x56322d08e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.575+0000 7f8ebd400640 1 -- 172.21.15.37:0/3812530472 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56322d104140 con 0x56322d07de40 2024-08-20T05:10:58.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.575+0000 7f8ebca00640 1 --2- 172.21.15.37:0/3812530472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07e760 0x56322d08e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:10:58.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.575+0000 7f8ebd400640 1 --2- 172.21.15.37:0/3812530472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 0x56322d092e10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00fb10 tx=0x7f8eac02ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e749caf09e317a66 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:10:58.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.575+0000 7f8e9ea00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:10:58.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.576+0000 7f8e9ea00640 1 -- 172.21.15.37:0/3812530472 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac05b070 con 0x56322d07de40 2024-08-20T05:10:58.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.576+0000 7f8e9ea00640 1 -- 172.21.15.37:0/3812530472 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8eac003bc0 con 0x56322d07de40 2024-08-20T05:10:58.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.576+0000 7f8ec289d740 1 -- 172.21.15.37:0/3812530472 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8eac003f20 con 0x56322d07de40 2024-08-20T05:10:58.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.576+0000 7f8e9ea00640 1 -- 172.21.15.37:0/3812530472 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8eac07b050 con 0x56322d07de40 2024-08-20T05:10:58.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.576+0000 7f8ec289d740 10 client.27646 fetch_fsmap learned FSMap version 39 2024-08-20T05:10:58.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.576+0000 7f8ec289d740 1 -- 172.21.15.37:0/3812530472 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56322d1052f0 con 0x56322d07de40 2024-08-20T05:10:58.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.576+0000 7f8e9ea00640 1 -- 172.21.15.37:0/3812530472 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8eac003f20 con 0x56322d07de40 2024-08-20T05:10:58.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.577+0000 7f8e9ea00640 1 -- 172.21.15.37:0/3812530472 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f8eac067070 con 0x56322d07de40 2024-08-20T05:10:58.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.577+0000 7f8ec289d740 10 client.27646 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:10:58.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.577+0000 7f8ec289d740 10 client.27646 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:10:58.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.577+0000 7f8ec289d740 20 client.27646 populate_metadata read hostname 'smithi037' 2024-08-20T05:10:58.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.577+0000 7f8ec289d740 1 --2- 172.21.15.37:0/3812530472 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56322d105ab0 0x56322d107ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:10:58.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.577+0000 7f8ec289d740 4 client.27646 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.85, "await_for": 45.0}] 2024-08-20T05:10:58.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.577+0000 7f8ec289d740 1 -- 172.21.15.37:0/3812530472 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.85, "await_for": 45.0}) -- 0x56322cff0ff0 con 0x56322d105ab0 2024-08-20T05:10:58.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.577+0000 7f8ebca00640 1 --2- 172.21.15.37:0/3812530472 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56322d105ab0 0x56322d107ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:10:58.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.578+0000 7f8ebca00640 1 --2- 172.21.15.37:0/3812530472 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56322d105ab0 0x56322d107ed0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c820f9e7b96d1130 server_cookie=c59aac3544d84180 in_seq=0 out_seq=0 2024-08-20T05:10:58.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.578+0000 7f8e9ea00640 10 client.27646 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:58.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.876+0000 7f8e9ea00640 1 -- 172.21.15.37:0/3812530472 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x56322cff0ff0 con 0x56322d105ab0 2024-08-20T05:10:58.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.876+0000 7f8e9ea00640 10 client.27646 handle_command_reply: tid=0 2024-08-20T05:10:58.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.876+0000 7f8ec289d740 1 client.27646 shutdown 2024-08-20T05:10:58.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.876+0000 7f8ec289d740 1 -- 172.21.15.37:0/3812530472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 msgr2=0x56322d092e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.876+0000 7f8ec289d740 1 --2- 172.21.15.37:0/3812530472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 0x56322d092e10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00fb10 tx=0x7f8eac02ec80 comp rx=0 tx=0).stop 2024-08-20T05:10:58.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.876+0000 7f8ec289d740 1 -- 172.21.15.37:0/3812530472 shutdown_connections 2024-08-20T05:10:58.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.876+0000 7f8ec289d740 1 --2- 172.21.15.37:0/3812530472 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56322d105ab0 0x56322d107ed0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.876+0000 7f8ec289d740 1 --2- 172.21.15.37:0/3812530472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56322d08a6f0 0x56322d08e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.876+0000 7f8ec289d740 1 --2- 172.21.15.37:0/3812530472 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56322d07e760 0x56322d08e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.876+0000 7f8ec289d740 1 --2- 172.21.15.37:0/3812530472 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56322d07de40 0x56322d092e10 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.876+0000 7f8e9ea00640 0 client.27646 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:10:58.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.876+0000 7f8ec289d740 1 -- 172.21.15.37:0/3812530472 >> 172.21.15.37:0/3812530472 conn(0x56322d07bc70 msgr2=0x56322d089580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:58.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.877+0000 7f8ec289d740 1 -- 172.21.15.37:0/3812530472 shutdown_connections 2024-08-20T05:10:58.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.877+0000 7f8ec289d740 1 -- 172.21.15.37:0/3812530472 wait complete. 2024-08-20T05:10:58.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.877+0000 7f8ec289d740 20 client.27646 trim_cache size 0 max 16384 2024-08-20T05:10:58.881 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:10:58.881 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 39, 2024-08-20T05:10:58.881 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:10:58.881 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 34, 2024-08-20T05:10:58.881 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:10:58.881 INFO:teuthology.orchestra.run.smithi037.stdout: "e49b23c": { 2024-08-20T05:10:58.881 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 34, 2024-08-20T05:10:58.881 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:10:58.881 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:10:58.882 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:10:58.882 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:10:58.882 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:10:58.882 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:10:58.882 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 147.8, 2024-08-20T05:10:58.882 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:10:58.882 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:10:58.882 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:10:58.882 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:10:58.882 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:10:58.882 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:10:58.882 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:10:58.882 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:10:58.882 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:10:58.883 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:10:58.883 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:10:58.883 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:10:58.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.878+0000 7f8ebfe00640 1 -- 172.21.15.37:0/1580742832 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8ea00b3c90 msgr2=0x7f8ea00b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.878+0000 7f8ebfe00640 1 --2- 172.21.15.37:0/1580742832 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8ea00b3c90 0x7f8ea00b6150 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8eac006010 tx=0x7f8eac02eb00 comp rx=0 tx=0).stop 2024-08-20T05:10:58.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.878+0000 7f8ebfe00640 1 -- 172.21.15.37:0/1580742832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8eb810a7a0 msgr2=0x7f8eb81a8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:10:58.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.878+0000 7f8ebfe00640 1 --2- 172.21.15.37:0/1580742832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8eb810a7a0 0x7f8eb81a8320 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8ea400d950 tx=0x7f8ea400de10 comp rx=0 tx=0).stop 2024-08-20T05:10:58.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.878+0000 7f8ebfe00640 1 -- 172.21.15.37:0/1580742832 shutdown_connections 2024-08-20T05:10:58.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.878+0000 7f8ebfe00640 1 --2- 172.21.15.37:0/1580742832 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8ea00b3c90 0x7f8ea00b6150 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.878+0000 7f8ebfe00640 1 --2- 172.21.15.37:0/1580742832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8eb8115740 0x7f8eb81ad6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.878+0000 7f8ebfe00640 1 --2- 172.21.15.37:0/1580742832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8eb810a7a0 0x7f8eb81a8320 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.878+0000 7f8ebfe00640 1 --2- 172.21.15.37:0/1580742832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8eb8109e80 0x7f8eb81a7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:10:58.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.878+0000 7f8ebfe00640 1 -- 172.21.15.37:0/1580742832 >> 172.21.15.37:0/1580742832 conn(0x7f8eb806dcc0 msgr2=0x7f8eb80714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:10:58.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.878+0000 7f8ebfe00640 1 -- 172.21.15.37:0/1580742832 shutdown_connections 2024-08-20T05:10:58.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:10:58.878+0000 7f8ebfe00640 1 -- 172.21.15.37:0/1580742832 wait complete. 2024-08-20T05:10:59.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:10:59 smithi130 ceph-mon[22007]: pgmap v663: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.4 MiB/s wr, 506 op/s 2024-08-20T05:10:59.726 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:10:59 smithi037 ceph-mon[17265]: pgmap v663: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.4 MiB/s wr, 506 op/s 2024-08-20T05:10:59.762 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e49b23c', quiesce took 7.9 seconds. Will release after: 19.950000000000003 2024-08-20T05:10:59.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:10:59 smithi135 ceph-mon[22342]: pgmap v663: 129 pgs: 129 active+clean; 1.4 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.4 MiB/s wr, 506 op/s 2024-08-20T05:11:00.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.008+0000 7fbabb000640 1 -- 172.21.15.37:0/3177506538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbab410a6a0 msgr2=0x7fbab410aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:00.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.008+0000 7fbabb000640 1 --2- 172.21.15.37:0/3177506538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbab410a6a0 0x7fbab410aae0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fba9c009900 tx=0x7fba9c02a410 comp rx=0 tx=0).stop 2024-08-20T05:11:00.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.009+0000 7fbabb000640 1 -- 172.21.15.37:0/3177506538 shutdown_connections 2024-08-20T05:11:00.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.009+0000 7fbabb000640 1 --2- 172.21.15.37:0/3177506538 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab410b020 0x7fbab4111820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.009+0000 7fbabb000640 1 --2- 172.21.15.37:0/3177506538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbab410a6a0 0x7fbab410aae0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.009+0000 7fbabb000640 1 --2- 172.21.15.37:0/3177506538 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab4104c90 0x7fbab4105070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.009+0000 7fbabb000640 1 -- 172.21.15.37:0/3177506538 >> 172.21.15.37:0/3177506538 conn(0x7fbab41006c0 msgr2=0x7fbab4102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:00.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.009+0000 7fbabb000640 1 -- 172.21.15.37:0/3177506538 shutdown_connections 2024-08-20T05:11:00.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.009+0000 7fbabb000640 1 -- 172.21.15.37:0/3177506538 wait complete. 2024-08-20T05:11:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.010+0000 7fbabb000640 1 Processor -- start 2024-08-20T05:11:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.010+0000 7fbabb000640 1 -- start start 2024-08-20T05:11:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.010+0000 7fbabb000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab4104c90 0x7fbab419b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.010+0000 7fbabb000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbab410a6a0 0x7fbab419b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.010+0000 7fbabb000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab410b020 0x7fbab41a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.010+0000 7fbabb000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbab4114cf0 con 0x7fbab410a6a0 2024-08-20T05:11:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.010+0000 7fbabb000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbab4114b70 con 0x7fbab4104c90 2024-08-20T05:11:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.010+0000 7fbabb000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbab4114e70 con 0x7fbab410b020 2024-08-20T05:11:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.010+0000 7fbaab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbab410a6a0 0x7fbab419b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.011+0000 7fbab3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab4104c90 0x7fbab419b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.011+0000 7fbaab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbab410a6a0 0x7fbab419b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45072/0 (socket says 172.21.15.37:45072) 2024-08-20T05:11:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.011+0000 7fbaab400640 1 -- 172.21.15.37:0/2400580355 learned_addr learned my addr 172.21.15.37:0/2400580355 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.011+0000 7fbab3e00640 1 --2- 172.21.15.37:0/2400580355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab4104c90 0x7fbab419b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:51722/0 (socket says 172.21.15.37:51722) 2024-08-20T05:11:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.011+0000 7fbab9000640 1 --2- 172.21.15.37:0/2400580355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab410b020 0x7fbab41a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.011+0000 7fbab3e00640 1 -- 172.21.15.37:0/2400580355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab410b020 msgr2=0x7fbab41a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.011+0000 7fbab3e00640 1 --2- 172.21.15.37:0/2400580355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab410b020 0x7fbab41a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.011+0000 7fbab3e00640 1 -- 172.21.15.37:0/2400580355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbab410a6a0 msgr2=0x7fbab419b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.011+0000 7fbab3e00640 1 --2- 172.21.15.37:0/2400580355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbab410a6a0 0x7fbab419b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.011+0000 7fbab3e00640 1 -- 172.21.15.37:0/2400580355 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbab41a1220 con 0x7fbab4104c90 2024-08-20T05:11:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.011+0000 7fbab3e00640 1 --2- 172.21.15.37:0/2400580355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab4104c90 0x7fbab419b170 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbaa400e9f0 tx=0x7fbaa400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.012+0000 7fbab1600640 1 -- 172.21.15.37:0/2400580355 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa400cd80 con 0x7fbab4104c90 2024-08-20T05:11:00.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.012+0000 7fbab1600640 1 -- 172.21.15.37:0/2400580355 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaa40035f0 con 0x7fbab4104c90 2024-08-20T05:11:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.012+0000 7fbabb000640 1 -- 172.21.15.37:0/2400580355 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbab41a1510 con 0x7fbab4104c90 2024-08-20T05:11:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.012+0000 7fbab1600640 1 -- 172.21.15.37:0/2400580355 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4010670 con 0x7fbab4104c90 2024-08-20T05:11:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.012+0000 7fbabb000640 1 -- 172.21.15.37:0/2400580355 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbab41a7da0 con 0x7fbab4104c90 2024-08-20T05:11:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.015+0000 7fbabda87740 1 Processor -- start 2024-08-20T05:11:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.015+0000 7fbabda87740 1 -- start start 2024-08-20T05:11:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.016+0000 7fbabda87740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229adce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.016+0000 7fbabda87740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ae220 0x5647229b9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.016+0000 7fbabda87740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ba1b0 0x5647229bc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.016+0000 7fbabda87740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564722923a60 con 0x5647229ba1b0 2024-08-20T05:11:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.016+0000 7fbabda87740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564722912f60 con 0x5647229ae220 2024-08-20T05:11:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.016+0000 7fbabda87740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564722916fa0 con 0x5647229ad900 2024-08-20T05:11:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.016+0000 7fbab1600640 1 -- 172.21.15.37:0/2400580355 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbaa40037a0 con 0x7fbab4104c90 2024-08-20T05:11:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.016+0000 7fbaab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ba1b0 0x5647229bc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.016+0000 7fbab9000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.016+0000 7fbab9000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229adce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33632/0 (socket says 172.21.15.37:33632) 2024-08-20T05:11:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.016+0000 7fbaab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ba1b0 0x5647229bc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45074/0 (socket says 172.21.15.37:45074) 2024-08-20T05:11:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.016+0000 7fbab9000640 1 -- 172.21.15.37:0/2018600727 learned_addr learned my addr 172.21.15.37:0/2018600727 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.016+0000 7fbab3e00640 1 --2- 172.21.15.37:0/2018600727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ae220 0x5647229b9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.016+0000 7fbaab400640 1 -- 172.21.15.37:0/2018600727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 msgr2=0x5647229adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.016+0000 7fbaab400640 1 --2- 172.21.15.37:0/2018600727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229adce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.017+0000 7fbaab400640 1 -- 172.21.15.37:0/2018600727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ae220 msgr2=0x5647229b9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.017+0000 7fbaab400640 1 --2- 172.21.15.37:0/2018600727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ae220 0x5647229b9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.017+0000 7fbaab400640 1 -- 172.21.15.37:0/2018600727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647228b93e0 con 0x5647229ba1b0 2024-08-20T05:11:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.017+0000 7fbab3e00640 1 --2- 172.21.15.37:0/2018600727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ae220 0x5647229b9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:11:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.017+0000 7fbaab400640 1 --2- 172.21.15.37:0/2018600727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ba1b0 0x5647229bc5a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fba9c000c00 tx=0x7fba9c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498d0b696f9d9b0a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.017+0000 7fbaa9600640 1 -- 172.21.15.37:0/2018600727 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c040070 con 0x5647229ba1b0 2024-08-20T05:11:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.017+0000 7fbaa9600640 1 -- 172.21.15.37:0/2018600727 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba9c0054d0 con 0x5647229ba1b0 2024-08-20T05:11:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.017+0000 7fbaa9600640 1 -- 172.21.15.37:0/2018600727 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c035040 con 0x5647229ba1b0 2024-08-20T05:11:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.018+0000 7fbab1600640 1 --2- 172.21.15.37:0/2400580355 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fba980b3c50 0x7fba980b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.018+0000 7fbab1600640 1 -- 172.21.15.37:0/2400580355 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbaa40e41d0 con 0x7fbab4104c90 2024-08-20T05:11:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.018+0000 7fbab9000640 1 --2- 172.21.15.37:0/2400580355 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fba980b3c50 0x7fba980b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.018+0000 7fbabda87740 1 -- 172.21.15.37:0/2018600727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ba1b0 msgr2=0x5647229bc5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.018+0000 7fbabda87740 1 --2- 172.21.15.37:0/2018600727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ba1b0 0x5647229bc5a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fba9c000c00 tx=0x7fba9c005c00 comp rx=0 tx=0).stop 2024-08-20T05:11:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.018+0000 7fbabda87740 1 -- 172.21.15.37:0/2018600727 shutdown_connections 2024-08-20T05:11:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.018+0000 7fbabda87740 1 --2- 172.21.15.37:0/2018600727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ba1b0 0x5647229bc5a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.018+0000 7fbabda87740 1 --2- 172.21.15.37:0/2018600727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ae220 0x5647229b9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.018+0000 7fbabda87740 1 --2- 172.21.15.37:0/2018600727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.018+0000 7fbabda87740 1 -- 172.21.15.37:0/2018600727 >> 172.21.15.37:0/2018600727 conn(0x5647229ab730 msgr2=0x5647229ac8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.018+0000 7fbabda87740 1 -- 172.21.15.37:0/2018600727 shutdown_connections 2024-08-20T05:11:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.018+0000 7fbabda87740 1 -- 172.21.15.37:0/2018600727 wait complete. 2024-08-20T05:11:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.019+0000 7fbab9000640 1 --2- 172.21.15.37:0/2400580355 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fba980b3c50 0x7fba980b6110 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0116b0 tx=0x7fbaac009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.019+0000 7fbabda87740 1 -- start start 2024-08-20T05:11:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.019+0000 7fbabda87740 1 Processor -- start 2024-08-20T05:11:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbabda87740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229b9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbabda87740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ae220 0x5647229b6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbabda87740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ba1b0 0x5647229b7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbabda87740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564722775700 con 0x5647229ba1b0 2024-08-20T05:11:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbabda87740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5647228ae250 con 0x5647229ae220 2024-08-20T05:11:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbabda87740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5647229bcdd0 con 0x5647229ad900 2024-08-20T05:11:00.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbabda87740 10 client.0 _ll_register_callbacks cb 0x56472290d180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbab9000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ba1b0 0x5647229b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbaab400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ae220 0x5647229b6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbab3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229b9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbaab400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ae220 0x5647229b6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:51738/0 (socket says 172.21.15.37:51738) 2024-08-20T05:11:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbab9000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ba1b0 0x5647229b7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45080/0 (socket says 172.21.15.37:45080) 2024-08-20T05:11:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbaab400640 1 -- 172.21.15.37:0/4144507505 learned_addr learned my addr 172.21.15.37:0/4144507505 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbaab400640 1 -- 172.21.15.37:0/4144507505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 msgr2=0x5647229b9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbaab400640 1 --2- 172.21.15.37:0/4144507505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229b9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbaab400640 1 -- 172.21.15.37:0/4144507505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ba1b0 msgr2=0x5647229b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbaab400640 1 --2- 172.21.15.37:0/4144507505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ba1b0 0x5647229b7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbaab400640 1 -- 172.21.15.37:0/4144507505 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564722672650 con 0x5647229ae220 2024-08-20T05:11:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.020+0000 7fbab9000640 1 --2- 172.21.15.37:0/4144507505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ba1b0 0x5647229b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:00.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.021+0000 7fbaab400640 1 --2- 172.21.15.37:0/4144507505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ae220 0x5647229b6dc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fba9c005940 tx=0x7fba9c004f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21b77d22241337b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.021+0000 7fbaa2000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:11:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.021+0000 7fbaa2000640 1 -- 172.21.15.37:0/4144507505 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c040070 con 0x5647229ae220 2024-08-20T05:11:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.021+0000 7fbaa2000640 1 -- 172.21.15.37:0/4144507505 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fba9c0049a0 con 0x5647229ae220 2024-08-20T05:11:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.021+0000 7fbabda87740 1 -- 172.21.15.37:0/4144507505 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba9c0054d0 con 0x5647229ae220 2024-08-20T05:11:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.021+0000 7fbaa2000640 1 -- 172.21.15.37:0/4144507505 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fba9c035040 con 0x5647229ae220 2024-08-20T05:11:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.021+0000 7fbabda87740 10 client.27662 fetch_fsmap learned FSMap version 39 2024-08-20T05:11:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.021+0000 7fbabda87740 1 -- 172.21.15.37:0/4144507505 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5647229c85e0 con 0x5647229ae220 2024-08-20T05:11:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.022+0000 7fbaa2000640 1 -- 172.21.15.37:0/4144507505 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba9c0054d0 con 0x5647229ae220 2024-08-20T05:11:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.022+0000 7fbaa2000640 1 -- 172.21.15.37:0/4144507505 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7fba9c0314a0 con 0x5647229ae220 2024-08-20T05:11:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.022+0000 7fbabda87740 10 client.27662 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:11:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.022+0000 7fbabda87740 10 client.27662 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:00.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.022+0000 7fbabda87740 20 client.27662 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.022+0000 7fbabda87740 1 --2- 172.21.15.37:0/4144507505 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5647229c9930 0x5647229cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.022+0000 7fbabda87740 4 client.27662 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.022+0000 7fbabda87740 1 -- 172.21.15.37:0/4144507505 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647229259b0 con 0x5647229c9930 2024-08-20T05:11:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.023+0000 7fbab3e00640 1 --2- 172.21.15.37:0/4144507505 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5647229c9930 0x5647229cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.023+0000 7fbab3e00640 1 --2- 172.21.15.37:0/4144507505 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5647229c9930 0x5647229cbd20 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6de2d6d6d783d81c server_cookie=1e98844ee3cb0cdf in_seq=0 out_seq=0 2024-08-20T05:11:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.023+0000 7fbaa2000640 10 client.27662 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.024+0000 7fbaa2000640 1 -- 172.21.15.37:0/4144507505 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5647229259b0 con 0x5647229c9930 2024-08-20T05:11:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.024+0000 7fbaa2000640 10 client.27662 handle_command_reply: tid=0 2024-08-20T05:11:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.024+0000 7fbabda87740 1 client.27662 shutdown 2024-08-20T05:11:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.024+0000 7fbabda87740 1 -- 172.21.15.37:0/4144507505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ae220 msgr2=0x5647229b6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.024+0000 7fbabda87740 1 --2- 172.21.15.37:0/4144507505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ae220 0x5647229b6dc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fba9c005940 tx=0x7fba9c004f90 comp rx=0 tx=0).stop 2024-08-20T05:11:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.024+0000 7fbabda87740 1 -- 172.21.15.37:0/4144507505 shutdown_connections 2024-08-20T05:11:00.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.024+0000 7fbabda87740 1 --2- 172.21.15.37:0/4144507505 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5647229c9930 0x5647229cbd20 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.024+0000 7fbabda87740 1 --2- 172.21.15.37:0/4144507505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ba1b0 0x5647229b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.024+0000 7fbabda87740 1 --2- 172.21.15.37:0/4144507505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ae220 0x5647229b6dc0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.024+0000 7fbabda87740 1 --2- 172.21.15.37:0/4144507505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229b9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.024+0000 7fbabda87740 1 -- 172.21.15.37:0/4144507505 >> 172.21.15.37:0/4144507505 conn(0x5647229ab730 msgr2=0x5647229b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.024+0000 7fbaa2000640 0 client.27662 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.024+0000 7fbabda87740 1 -- 172.21.15.37:0/4144507505 shutdown_connections 2024-08-20T05:11:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.024+0000 7fbabda87740 1 -- 172.21.15.37:0/4144507505 wait complete. 2024-08-20T05:11:00.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.024+0000 7fbabda87740 20 client.27662 trim_cache size 0 max 16384 2024-08-20T05:11:00.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.042+0000 7fbabda87740 1 Processor -- start 2024-08-20T05:11:00.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.043+0000 7fbabda87740 1 -- start start 2024-08-20T05:11:00.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.043+0000 7fbabda87740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.043+0000 7fbabda87740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ae220 0x5647229d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.043+0000 7fbabda87740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ba1b0 0x5647229d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.043+0000 7fbabda87740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41b1980 con 0x5647229ae220 2024-08-20T05:11:00.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.043+0000 7fbabda87740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41b35e0 con 0x5647229ba1b0 2024-08-20T05:11:00.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.043+0000 7fbabda87740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41b2050 con 0x5647229ad900 2024-08-20T05:11:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.043+0000 7fbab3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.043+0000 7fbaab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ae220 0x5647229d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.043+0000 7fbab3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229b8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33640/0 (socket says 172.21.15.37:33640) 2024-08-20T05:11:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.043+0000 7fbab3e00640 1 -- 172.21.15.37:0/3458341409 learned_addr learned my addr 172.21.15.37:0/3458341409 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.043+0000 7fbab9000640 1 --2- 172.21.15.37:0/3458341409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ba1b0 0x5647229d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.044+0000 7fbab3e00640 1 -- 172.21.15.37:0/3458341409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ba1b0 msgr2=0x5647229d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:00.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.044+0000 7fbab3e00640 1 --2- 172.21.15.37:0/3458341409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ba1b0 0x5647229d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.044+0000 7fbab3e00640 1 -- 172.21.15.37:0/3458341409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ae220 msgr2=0x5647229d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.044+0000 7fbab3e00640 1 --2- 172.21.15.37:0/3458341409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ae220 0x5647229d12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.044+0000 7fbab3e00640 1 -- 172.21.15.37:0/3458341409 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647229b2970 con 0x5647229ad900 2024-08-20T05:11:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.044+0000 7fbab3e00640 1 --2- 172.21.15.37:0/3458341409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229b8ec0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40aaa20 tx=0x7fbaa40e17a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f55925c78a35eaf server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.044+0000 7fbaa8c00640 1 -- 172.21.15.37:0/3458341409 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40aad20 con 0x5647229ad900 2024-08-20T05:11:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.044+0000 7fbaa8c00640 1 -- 172.21.15.37:0/3458341409 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaa40af320 con 0x5647229ad900 2024-08-20T05:11:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.044+0000 7fbaa8c00640 1 -- 172.21.15.37:0/3458341409 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40a6fb0 con 0x5647229ad900 2024-08-20T05:11:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.045+0000 7fbabda87740 1 -- 172.21.15.37:0/3458341409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 msgr2=0x5647229b8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.045+0000 7fbabda87740 1 --2- 172.21.15.37:0/3458341409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229b8ec0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40aaa20 tx=0x7fbaa40e17a0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.045+0000 7fbabda87740 1 -- 172.21.15.37:0/3458341409 shutdown_connections 2024-08-20T05:11:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.045+0000 7fbabda87740 1 --2- 172.21.15.37:0/3458341409 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ba1b0 0x5647229d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.045+0000 7fbabda87740 1 --2- 172.21.15.37:0/3458341409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ae220 0x5647229d12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.045+0000 7fbabda87740 1 --2- 172.21.15.37:0/3458341409 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229b8ec0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.045+0000 7fbabda87740 1 -- 172.21.15.37:0/3458341409 >> 172.21.15.37:0/3458341409 conn(0x5647229ab730 msgr2=0x5647229aa810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:00.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.045+0000 7fbabda87740 1 -- 172.21.15.37:0/3458341409 shutdown_connections 2024-08-20T05:11:00.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.045+0000 7fbabda87740 1 -- 172.21.15.37:0/3458341409 wait complete. 2024-08-20T05:11:00.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.045+0000 7fbabda87740 1 -- start start 2024-08-20T05:11:00.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.046+0000 7fbabda87740 1 Processor -- start 2024-08-20T05:11:00.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.046+0000 7fbabda87740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229c2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.046+0000 7fbabda87740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ae220 0x5647229bfb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.046+0000 7fbabda87740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ba1b0 0x5647229c0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.046+0000 7fbabda87740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41b2e50 con 0x5647229ae220 2024-08-20T05:11:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.046+0000 7fbabda87740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41b2720 con 0x5647229ba1b0 2024-08-20T05:11:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.046+0000 7fbabda87740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbab41af960 con 0x5647229ad900 2024-08-20T05:11:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.046+0000 7fbabda87740 10 client.0 _ll_register_callbacks cb 0x7fbaac009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.046+0000 7fbab3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229c2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.046+0000 7fbaab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ae220 0x5647229bfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.047+0000 7fbab9000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ba1b0 0x5647229c0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.047+0000 7fbaab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ae220 0x5647229bfb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45100/0 (socket says 172.21.15.37:45100) 2024-08-20T05:11:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.047+0000 7fbaab400640 1 -- 172.21.15.37:0/3241691548 learned_addr learned my addr 172.21.15.37:0/3241691548 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.046+0000 7fbab3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229c2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33648/0 (socket says 172.21.15.37:33648) 2024-08-20T05:11:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.047+0000 7fbab3e00640 1 -- 172.21.15.37:0/3241691548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ba1b0 msgr2=0x5647229c0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:00.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.047+0000 7fbab3e00640 1 --2- 172.21.15.37:0/3241691548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ba1b0 0x5647229c0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.047+0000 7fbab3e00640 1 -- 172.21.15.37:0/3241691548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ae220 msgr2=0x5647229bfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.047+0000 7fbab3e00640 1 --2- 172.21.15.37:0/3241691548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ae220 0x5647229bfb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.047+0000 7fbab3e00640 1 -- 172.21.15.37:0/3241691548 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647229c0820 con 0x5647229ad900 2024-08-20T05:11:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.047+0000 7fbab3e00640 1 --2- 172.21.15.37:0/3241691548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229c2660 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40aaa20 tx=0x7fbaa4005bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c419ee84f4905b16 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.047+0000 7fbaa2000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:11:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.047+0000 7fbaa2000640 1 -- 172.21.15.37:0/3241691548 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40b3dd0 con 0x5647229ad900 2024-08-20T05:11:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.048+0000 7fbabda87740 1 -- 172.21.15.37:0/3241691548 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbaa40af320 con 0x5647229ad900 2024-08-20T05:11:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.048+0000 7fbaa2000640 1 -- 172.21.15.37:0/3241691548 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbaa4009310 con 0x5647229ad900 2024-08-20T05:11:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.048+0000 7fbaa2000640 1 -- 172.21.15.37:0/3241691548 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fbaa40aad20 con 0x5647229ad900 2024-08-20T05:11:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.048+0000 7fbabda87740 10 client.27664 fetch_fsmap learned FSMap version 39 2024-08-20T05:11:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.048+0000 7fbabda87740 1 -- 172.21.15.37:0/3241691548 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x564722a3cac0 con 0x5647229ad900 2024-08-20T05:11:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.048+0000 7fbaa2000640 1 -- 172.21.15.37:0/3241691548 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaa40af320 con 0x5647229ad900 2024-08-20T05:11:00.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.048+0000 7fbaa2000640 1 -- 172.21.15.37:0/3241691548 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7fbaa40a6690 con 0x5647229ad900 2024-08-20T05:11:00.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.048+0000 7fbabda87740 10 client.27664 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:11:00.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.048+0000 7fbabda87740 10 client.27664 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:00.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.048+0000 7fbabda87740 20 client.27664 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:00.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.048+0000 7fbabda87740 1 --2- 172.21.15.37:0/3241691548 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564722a3d230 0x564722a3f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:00.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.048+0000 7fbabda87740 4 client.27664 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:11:00.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.048+0000 7fbabda87740 1 -- 172.21.15.37:0/3241691548 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564722921450 con 0x564722a3d230 2024-08-20T05:11:00.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.049+0000 7fbaab400640 1 --2- 172.21.15.37:0/3241691548 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564722a3d230 0x564722a3f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:00.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.049+0000 7fbaab400640 1 --2- 172.21.15.37:0/3241691548 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564722a3d230 0x564722a3f650 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e41f840011abe422 server_cookie=e4205bf6006d333f in_seq=0 out_seq=0 2024-08-20T05:11:00.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.049+0000 7fbaa2000640 10 client.27664 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:00.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.049+0000 7fbaa2000640 1 -- 172.21.15.37:0/3241691548 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564722921450 con 0x564722a3d230 2024-08-20T05:11:00.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.049+0000 7fbaa2000640 10 client.27664 handle_command_reply: tid=0 2024-08-20T05:11:00.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.049+0000 7fbabda87740 1 client.27664 shutdown 2024-08-20T05:11:00.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.050+0000 7fbabda87740 1 -- 172.21.15.37:0/3241691548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 msgr2=0x5647229c2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:00.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.050+0000 7fbabda87740 1 --2- 172.21.15.37:0/3241691548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229c2660 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40aaa20 tx=0x7fbaa4005bb0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.050+0000 7fbabda87740 1 -- 172.21.15.37:0/3241691548 shutdown_connections 2024-08-20T05:11:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.050+0000 7fbabda87740 1 --2- 172.21.15.37:0/3241691548 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564722a3d230 0x564722a3f650 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.050+0000 7fbabda87740 1 --2- 172.21.15.37:0/3241691548 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647229ba1b0 0x5647229c0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.050+0000 7fbabda87740 1 --2- 172.21.15.37:0/3241691548 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647229ae220 0x5647229bfb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.050+0000 7fbabda87740 1 --2- 172.21.15.37:0/3241691548 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647229ad900 0x5647229c2660 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.050+0000 7fbabda87740 1 -- 172.21.15.37:0/3241691548 >> 172.21.15.37:0/3241691548 conn(0x5647229ab730 msgr2=0x5647229b5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.050+0000 7fbaa2000640 0 client.27664 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.050+0000 7fbabda87740 1 -- 172.21.15.37:0/3241691548 shutdown_connections 2024-08-20T05:11:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.050+0000 7fbabda87740 1 -- 172.21.15.37:0/3241691548 wait complete. 2024-08-20T05:11:00.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.050+0000 7fbabda87740 20 client.27664 trim_cache size 0 max 16384 2024-08-20T05:11:00.057 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:11:00.058 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-20T05:11:00.058 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-08-20T05:11:00.058 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:11:00.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.051+0000 7fbabb000640 1 -- 172.21.15.37:0/2400580355 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fba980b3c50 msgr2=0x7fba980b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:00.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.051+0000 7fbabb000640 1 --2- 172.21.15.37:0/2400580355 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fba980b3c50 0x7fba980b6110 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0116b0 tx=0x7fbaac009500 comp rx=0 tx=0).stop 2024-08-20T05:11:00.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.051+0000 7fbabb000640 1 -- 172.21.15.37:0/2400580355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab4104c90 msgr2=0x7fbab419b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:00.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.051+0000 7fbabb000640 1 --2- 172.21.15.37:0/2400580355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab4104c90 0x7fbab419b170 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbaa400e9f0 tx=0x7fbaa400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.051+0000 7fbabb000640 1 -- 172.21.15.37:0/2400580355 shutdown_connections 2024-08-20T05:11:00.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.051+0000 7fbabb000640 1 --2- 172.21.15.37:0/2400580355 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fba980b3c50 0x7fba980b6110 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.051+0000 7fbabb000640 1 --2- 172.21.15.37:0/2400580355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbab410b020 0x7fbab41a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.051+0000 7fbabb000640 1 --2- 172.21.15.37:0/2400580355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbab410a6a0 0x7fbab419b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.051+0000 7fbabb000640 1 --2- 172.21.15.37:0/2400580355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbab4104c90 0x7fbab419b170 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:00.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.051+0000 7fbabb000640 1 -- 172.21.15.37:0/2400580355 >> 172.21.15.37:0/2400580355 conn(0x7fbab41006c0 msgr2=0x7fbab4102ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:00.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.051+0000 7fbabb000640 1 -- 172.21.15.37:0/2400580355 shutdown_connections 2024-08-20T05:11:00.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:00.051+0000 7fbabb000640 1 -- 172.21.15.37:0/2400580355 wait complete. 2024-08-20T05:11:00.811 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T05:11:00.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:11:01.193 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:01.583 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:01 smithi037 ceph-mon[17265]: pgmap v664: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.6 MiB/s wr, 541 op/s 2024-08-20T05:11:01.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:01 smithi130 ceph-mon[22007]: pgmap v664: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.6 MiB/s wr, 541 op/s 2024-08-20T05:11:01.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.796+0000 7ff4e3200640 1 -- 172.21.15.37:0/4029374063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e4104b00 msgr2=0x7ff4e4104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.796+0000 7ff4e3200640 1 --2- 172.21.15.37:0/4029374063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e4104b00 0x7ff4e4104ee0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4009900 tx=0x7ff4d402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:11:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.796+0000 7ff4e3200640 1 -- 172.21.15.37:0/4029374063 shutdown_connections 2024-08-20T05:11:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.796+0000 7ff4e3200640 1 --2- 172.21.15.37:0/4029374063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4e410ae90 0x7ff4e4111690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.796+0000 7ff4e3200640 1 --2- 172.21.15.37:0/4029374063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e410a510 0x7ff4e410a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.796+0000 7ff4e3200640 1 --2- 172.21.15.37:0/4029374063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e4104b00 0x7ff4e4104ee0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.796+0000 7ff4e3200640 1 -- 172.21.15.37:0/4029374063 >> 172.21.15.37:0/4029374063 conn(0x7ff4e4100550 msgr2=0x7ff4e4102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.796+0000 7ff4e3200640 1 -- 172.21.15.37:0/4029374063 shutdown_connections 2024-08-20T05:11:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.797+0000 7ff4e3200640 1 -- 172.21.15.37:0/4029374063 wait complete. 2024-08-20T05:11:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.797+0000 7ff4e3200640 1 Processor -- start 2024-08-20T05:11:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.798+0000 7ff4e3200640 1 -- start start 2024-08-20T05:11:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.798+0000 7ff4e3200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e4104b00 0x7ff4e419af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:01.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.798+0000 7ff4e3200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e410a510 0x7ff4e419b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.798+0000 7ff4e3200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4e410ae90 0x7ff4e41a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.798+0000 7ff4e3200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e4114ba0 con 0x7ff4e410a510 2024-08-20T05:11:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.798+0000 7ff4e3200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e4114a20 con 0x7ff4e410ae90 2024-08-20T05:11:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.798+0000 7ff4e3200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e4114d20 con 0x7ff4e4104b00 2024-08-20T05:11:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.798+0000 7ff4dbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e410a510 0x7ff4e419b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.798+0000 7ff4dbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e410a510 0x7ff4e419b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45118/0 (socket says 172.21.15.37:45118) 2024-08-20T05:11:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.798+0000 7ff4dbe00640 1 -- 172.21.15.37:0/3974152895 learned_addr learned my addr 172.21.15.37:0/3974152895 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.798+0000 7ff4e1e00640 1 --2- 172.21.15.37:0/3974152895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e4104b00 0x7ff4e419af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.798+0000 7ff4e2800640 1 --2- 172.21.15.37:0/3974152895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4e410ae90 0x7ff4e41a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.799+0000 7ff4dbe00640 1 -- 172.21.15.37:0/3974152895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e4104b00 msgr2=0x7ff4e419af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:01.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.799+0000 7ff4dbe00640 1 --2- 172.21.15.37:0/3974152895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e4104b00 0x7ff4e419af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:01.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.799+0000 7ff4dbe00640 1 -- 172.21.15.37:0/3974152895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4e410ae90 msgr2=0x7ff4e41a0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:01.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.799+0000 7ff4dbe00640 1 --2- 172.21.15.37:0/3974152895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4e410ae90 0x7ff4e41a0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:01.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.799+0000 7ff4dbe00640 1 -- 172.21.15.37:0/3974152895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e41a0ff0 con 0x7ff4e410a510 2024-08-20T05:11:01.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.799+0000 7ff4dbe00640 1 --2- 172.21.15.37:0/3974152895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e410a510 0x7ff4e419b480 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00e9f0 tx=0x7ff4cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:01.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.799+0000 7ff4daa00640 1 -- 172.21.15.37:0/3974152895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc00cd80 con 0x7ff4e410a510 2024-08-20T05:11:01.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.799+0000 7ff4daa00640 1 -- 172.21.15.37:0/3974152895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4cc0054d0 con 0x7ff4e410a510 2024-08-20T05:11:01.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.799+0000 7ff4e3200640 1 -- 172.21.15.37:0/3974152895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e41a12e0 con 0x7ff4e410a510 2024-08-20T05:11:01.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.799+0000 7ff4daa00640 1 -- 172.21.15.37:0/3974152895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc010690 con 0x7ff4e410a510 2024-08-20T05:11:01.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.800+0000 7ff4e3200640 1 -- 172.21.15.37:0/3974152895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e41a79a0 con 0x7ff4e410a510 2024-08-20T05:11:01.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.801+0000 7ff4e3200640 1 -- 172.21.15.37:0/3974152895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4e4104ee0 con 0x7ff4e410a510 2024-08-20T05:11:01.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.803+0000 7ff4daa00640 1 -- 172.21.15.37:0/3974152895 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff4cc004e90 con 0x7ff4e410a510 2024-08-20T05:11:01.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.805+0000 7ff4daa00640 1 --2- 172.21.15.37:0/3974152895 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4c80b3cf0 0x7ff4c80b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:01.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.805+0000 7ff4daa00640 1 -- 172.21.15.37:0/3974152895 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff4cc0e4380 con 0x7ff4e410a510 2024-08-20T05:11:01.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.805+0000 7ff4e1e00640 1 --2- 172.21.15.37:0/3974152895 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4c80b3cf0 0x7ff4c80b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:01.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.806+0000 7ff4e1e00640 1 --2- 172.21.15.37:0/3974152895 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4c80b3cf0 0x7ff4c80b61b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4005ab0 tx=0x7ff4d4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:01.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:01.808+0000 7ff4daa00640 1 -- 172.21.15.37:0/3974152895 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff4cc0ab5d0 con 0x7ff4e410a510 2024-08-20T05:11:01.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:01 smithi135 ceph-mon[22342]: pgmap v664: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.6 MiB/s wr, 541 op/s 2024-08-20T05:11:02.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:02.043+0000 7ff4e3200640 1 -- 172.21.15.37:0/3974152895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4e41a7d30 con 0x7ff4e410a510 2024-08-20T05:11:02.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:02.043+0000 7ff4daa00640 1 -- 172.21.15.37:0/3974152895 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11990 (secure 0 0 0) 0x7ff4cc0aaed0 con 0x7ff4e410a510 2024-08-20T05:11:02.046 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:11:02.046 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":39,"btime":"2024-08-20T05:09:24:153999+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:09:24.103831+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:11:02.046 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 39 2024-08-20T05:11:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:02.046+0000 7ff4e3200640 1 -- 172.21.15.37:0/3974152895 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4c80b3cf0 msgr2=0x7ff4c80b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:02.046+0000 7ff4e3200640 1 --2- 172.21.15.37:0/3974152895 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4c80b3cf0 0x7ff4c80b61b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4005ab0 tx=0x7ff4d4005a20 comp rx=0 tx=0).stop 2024-08-20T05:11:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:02.046+0000 7ff4e3200640 1 -- 172.21.15.37:0/3974152895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e410a510 msgr2=0x7ff4e419b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:02.046+0000 7ff4e3200640 1 --2- 172.21.15.37:0/3974152895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e410a510 0x7ff4e419b480 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc00e9f0 tx=0x7ff4cc00edf0 comp rx=0 tx=0).stop 2024-08-20T05:11:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:02.046+0000 7ff4e3200640 1 -- 172.21.15.37:0/3974152895 shutdown_connections 2024-08-20T05:11:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:02.046+0000 7ff4e3200640 1 --2- 172.21.15.37:0/3974152895 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4c80b3cf0 0x7ff4c80b61b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:02.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:02.046+0000 7ff4e3200640 1 --2- 172.21.15.37:0/3974152895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4e410ae90 0x7ff4e41a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:02.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:02.046+0000 7ff4e3200640 1 --2- 172.21.15.37:0/3974152895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e410a510 0x7ff4e419b480 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:02.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:02.046+0000 7ff4e3200640 1 --2- 172.21.15.37:0/3974152895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e4104b00 0x7ff4e419af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:02.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:02.046+0000 7ff4e3200640 1 -- 172.21.15.37:0/3974152895 >> 172.21.15.37:0/3974152895 conn(0x7ff4e4100550 msgr2=0x7ff4e4109c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:02.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:02.046+0000 7ff4e3200640 1 -- 172.21.15.37:0/3974152895 shutdown_connections 2024-08-20T05:11:02.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:02.046+0000 7ff4e3200640 1 -- 172.21.15.37:0/3974152895 wait complete. 2024-08-20T05:11:02.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:02 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3974152895' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:11:02.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:02 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3974152895' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:11:02.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:02 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3974152895' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:11:03.045 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 485.0 s, 57.2 tps, lat 215.554 ms stddev 183.820 2024-08-20T05:11:03.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:03 smithi130 ceph-mon[22007]: pgmap v665: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.9 MiB/s wr, 498 op/s 2024-08-20T05:11:03.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:03 smithi037 ceph-mon[17265]: pgmap v665: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.9 MiB/s wr, 498 op/s 2024-08-20T05:11:03.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:03 smithi135 ceph-mon[22342]: pgmap v665: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.9 MiB/s wr, 498 op/s 2024-08-20T05:11:04.530 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T05:11:04.915 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:05.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.508+0000 7f8e13e00640 1 -- 172.21.15.37:0/3327431406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e1410aea0 msgr2=0x7f8e141116a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:05.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.508+0000 7f8e13e00640 1 --2- 172.21.15.37:0/3327431406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e1410aea0 0x7f8e141116a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c009ca0 tx=0x7f8e0c02a8c0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.508+0000 7f8e13e00640 1 -- 172.21.15.37:0/3327431406 shutdown_connections 2024-08-20T05:11:05.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.508+0000 7f8e13e00640 1 --2- 172.21.15.37:0/3327431406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e1410aea0 0x7f8e141116a0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.508+0000 7f8e13e00640 1 --2- 172.21.15.37:0/3327431406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e1410a520 0x7f8e1410a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.508+0000 7f8e13e00640 1 --2- 172.21.15.37:0/3327431406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e14104b10 0x7f8e14104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.508+0000 7f8e13e00640 1 -- 172.21.15.37:0/3327431406 >> 172.21.15.37:0/3327431406 conn(0x7f8e14100540 msgr2=0x7f8e14102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:05.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.508+0000 7f8e13e00640 1 -- 172.21.15.37:0/3327431406 shutdown_connections 2024-08-20T05:11:05.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.508+0000 7f8e13e00640 1 -- 172.21.15.37:0/3327431406 wait complete. 2024-08-20T05:11:05.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.510+0000 7f8e13e00640 1 Processor -- start 2024-08-20T05:11:05.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.510+0000 7f8e13e00640 1 -- start start 2024-08-20T05:11:05.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.510+0000 7f8e13e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e14104b10 0x7f8e1419aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.510+0000 7f8e13e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e1410a520 0x7f8e1419b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.510+0000 7f8e13e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e1410aea0 0x7f8e141a07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.510+0000 7f8e13e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e14114bb0 con 0x7f8e1410aea0 2024-08-20T05:11:05.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.510+0000 7f8e13e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8e14114a30 con 0x7f8e1410a520 2024-08-20T05:11:05.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.510+0000 7f8e13e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8e14114d30 con 0x7f8e14104b10 2024-08-20T05:11:05.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.511+0000 7f8e12a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e14104b10 0x7f8e1419aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.511+0000 7f8e12a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e14104b10 0x7f8e1419aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57646/0 (socket says 172.21.15.37:57646) 2024-08-20T05:11:05.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.511+0000 7f8e12a00640 1 -- 172.21.15.37:0/2889839649 learned_addr learned my addr 172.21.15.37:0/2889839649 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:05.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.511+0000 7f8e13400640 1 --2- 172.21.15.37:0/2889839649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e1410aea0 0x7f8e141a07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.511+0000 7f8e12000640 1 --2- 172.21.15.37:0/2889839649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e1410a520 0x7f8e1419b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.511+0000 7f8e13400640 1 -- 172.21.15.37:0/2889839649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e14104b10 msgr2=0x7f8e1419aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:05.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.511+0000 7f8e13400640 1 --2- 172.21.15.37:0/2889839649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e14104b10 0x7f8e1419aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.511+0000 7f8e13400640 1 -- 172.21.15.37:0/2889839649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e1410a520 msgr2=0x7f8e1419b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:05.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.511+0000 7f8e13400640 1 --2- 172.21.15.37:0/2889839649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e1410a520 0x7f8e1419b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.511+0000 7f8e13400640 1 -- 172.21.15.37:0/2889839649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e141a0f90 con 0x7f8e1410aea0 2024-08-20T05:11:05.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.511+0000 7f8e12a00640 1 --2- 172.21.15.37:0/2889839649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e14104b10 0x7f8e1419aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:05.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.511+0000 7f8e13400640 1 --2- 172.21.15.37:0/2889839649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e1410aea0 0x7f8e141a07c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c005e30 tx=0x7f8e0c0317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:05.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.512+0000 7f8e0b400640 1 -- 172.21.15.37:0/2889839649 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c003b70 con 0x7f8e1410aea0 2024-08-20T05:11:05.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.512+0000 7f8e0b400640 1 -- 172.21.15.37:0/2889839649 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e0c003d10 con 0x7f8e1410aea0 2024-08-20T05:11:05.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.512+0000 7f8e13e00640 1 -- 172.21.15.37:0/2889839649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e141a1220 con 0x7f8e1410aea0 2024-08-20T05:11:05.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.512+0000 7f8e0b400640 1 -- 172.21.15.37:0/2889839649 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c02f970 con 0x7f8e1410aea0 2024-08-20T05:11:05.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.512+0000 7f8e13e00640 1 -- 172.21.15.37:0/2889839649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e141a7940 con 0x7f8e1410aea0 2024-08-20T05:11:05.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.515+0000 7f8e1c29a740 1 Processor -- start 2024-08-20T05:11:05.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.515+0000 7f8e0b400640 1 -- 172.21.15.37:0/2889839649 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8e0c02fb10 con 0x7f8e1410aea0 2024-08-20T05:11:05.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.515+0000 7f8e1c29a740 1 -- start start 2024-08-20T05:11:05.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.516+0000 7f8e1c29a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 0x558d6eba7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.516+0000 7f8e1c29a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6eba8440 0x558d6ebb3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.516+0000 7f8e1c29a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6ebb43d0 0x558d6ebb67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.516+0000 7f8e1c29a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558d6eb1daa0 con 0x558d6eba8440 2024-08-20T05:11:05.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.516+0000 7f8e1c29a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558d6eb0cfa0 con 0x558d6eba7b20 2024-08-20T05:11:05.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.516+0000 7f8e1c29a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558d6eb10fe0 con 0x558d6ebb43d0 2024-08-20T05:11:05.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.516+0000 7f8e12a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6eba8440 0x558d6ebb3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.516+0000 7f8e12a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6eba8440 0x558d6ebb3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49550/0 (socket says 172.21.15.37:49550) 2024-08-20T05:11:05.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.516+0000 7f8e12a00640 1 -- 172.21.15.37:0/3206215796 learned_addr learned my addr 172.21.15.37:0/3206215796 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:05.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.516+0000 7f8e12000640 1 --2- 172.21.15.37:0/3206215796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 0x558d6eba7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.516+0000 7f8e12000640 1 --2- 172.21.15.37:0/3206215796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6ebb43d0 0x558d6ebb67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.516+0000 7f8e12a00640 1 -- 172.21.15.37:0/3206215796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6ebb43d0 msgr2=0x558d6ebb67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:05.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.517+0000 7f8e12a00640 1 --2- 172.21.15.37:0/3206215796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6ebb43d0 0x558d6ebb67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.517+0000 7f8e12a00640 1 -- 172.21.15.37:0/3206215796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 msgr2=0x558d6eba7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:05.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.517+0000 7f8e12a00640 1 --2- 172.21.15.37:0/3206215796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 0x558d6eba7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.517+0000 7f8e12a00640 1 -- 172.21.15.37:0/3206215796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d6eab3420 con 0x558d6eba8440 2024-08-20T05:11:05.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.517+0000 7f8e12000640 1 --2- 172.21.15.37:0/3206215796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 0x558d6eba7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:11:05.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.517+0000 7f8e12a00640 1 --2- 172.21.15.37:0/3206215796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6eba8440 0x558d6ebb3e90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8e04011630 tx=0x7f8e04011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198f0a5095a088a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:05.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.517+0000 7f8e0b400640 1 --2- 172.21.15.37:0/2889839649 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8df80b3cf0 0x7f8df80b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.517+0000 7f8dffe00640 1 -- 172.21.15.37:0/3206215796 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0401e070 con 0x558d6eba8440 2024-08-20T05:11:05.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.517+0000 7f8dffe00640 1 -- 172.21.15.37:0/3206215796 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e0400fba0 con 0x558d6eba8440 2024-08-20T05:11:05.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.517+0000 7f8dffe00640 1 -- 172.21.15.37:0/3206215796 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e04019ca0 con 0x558d6eba8440 2024-08-20T05:11:05.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.517+0000 7f8e0b400640 1 -- 172.21.15.37:0/2889839649 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8e0c1051a0 con 0x7f8e1410aea0 2024-08-20T05:11:05.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.517+0000 7f8e12000640 1 --2- 172.21.15.37:0/2889839649 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8df80b3cf0 0x7f8df80b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.518+0000 7f8e1c29a740 1 -- 172.21.15.37:0/3206215796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6eba8440 msgr2=0x558d6ebb3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:05.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.518+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/3206215796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6eba8440 0x558d6ebb3e90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8e04011630 tx=0x7f8e04011af0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.518+0000 7f8e1c29a740 1 -- 172.21.15.37:0/3206215796 shutdown_connections 2024-08-20T05:11:05.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.518+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/3206215796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6ebb43d0 0x558d6ebb67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.518+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/3206215796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6eba8440 0x558d6ebb3e90 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.518+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/3206215796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 0x558d6eba7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.518+0000 7f8e1c29a740 1 -- 172.21.15.37:0/3206215796 >> 172.21.15.37:0/3206215796 conn(0x558d6eba5950 msgr2=0x558d6eba6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:05.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.518+0000 7f8e1c29a740 1 -- 172.21.15.37:0/3206215796 shutdown_connections 2024-08-20T05:11:05.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.518+0000 7f8e12000640 1 --2- 172.21.15.37:0/2889839649 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8df80b3cf0 0x7f8df80b61b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8e14102d80 tx=0x7f8e00004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:05.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.518+0000 7f8e1c29a740 1 -- 172.21.15.37:0/3206215796 wait complete. 2024-08-20T05:11:05.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.519+0000 7f8e1c29a740 1 -- start start 2024-08-20T05:11:05.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.519+0000 7f8e1c29a740 1 Processor -- start 2024-08-20T05:11:05.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.519+0000 7f8e1c29a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 0x558d6ebb3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.519+0000 7f8e1c29a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6eba8440 0x558d6ebb0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.519+0000 7f8e1c29a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6ebb43d0 0x558d6ebb1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.519+0000 7f8e1c29a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558d6e96f700 con 0x558d6ebb43d0 2024-08-20T05:11:05.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.519+0000 7f8e1c29a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558d6eaa8290 con 0x558d6eba7b20 2024-08-20T05:11:05.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.519+0000 7f8e1c29a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558d6ebb7050 con 0x558d6eba8440 2024-08-20T05:11:05.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.520+0000 7f8e1c29a740 10 client.0 _ll_register_callbacks cb 0x558d6eb071c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:05.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.520+0000 7f8e12a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 0x558d6ebb3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.520+0000 7f8e13400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6ebb43d0 0x558d6ebb1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.520+0000 7f8e12a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 0x558d6ebb3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50684/0 (socket says 172.21.15.37:50684) 2024-08-20T05:11:05.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.520+0000 7f8e12a00640 1 -- 172.21.15.37:0/2639912591 learned_addr learned my addr 172.21.15.37:0/2639912591 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:05.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.520+0000 7f8e12000640 1 --2- 172.21.15.37:0/2639912591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6eba8440 0x558d6ebb0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.520+0000 7f8e12a00640 1 -- 172.21.15.37:0/2639912591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6eba8440 msgr2=0x558d6ebb0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:05.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.520+0000 7f8e12a00640 1 --2- 172.21.15.37:0/2639912591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6eba8440 0x558d6ebb0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.520+0000 7f8e12a00640 1 -- 172.21.15.37:0/2639912591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6ebb43d0 msgr2=0x558d6ebb1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:05.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.520+0000 7f8e12a00640 1 --2- 172.21.15.37:0/2639912591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6ebb43d0 0x558d6ebb1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.520+0000 7f8e12a00640 1 -- 172.21.15.37:0/2639912591 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d6e86c650 con 0x558d6eba7b20 2024-08-20T05:11:05.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.520+0000 7f8e12000640 1 --2- 172.21.15.37:0/2639912591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6eba8440 0x558d6ebb0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:11:05.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.520+0000 7f8e13400640 1 --2- 172.21.15.37:0/2639912591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6ebb43d0 0x558d6ebb1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:05.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.520+0000 7f8e12a00640 1 --2- 172.21.15.37:0/2639912591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 0x558d6ebb3b70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009f40 tx=0x7f8e0400fb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2607b1ec6e461e2c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:05.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.520+0000 7f8dfcc00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:11:05.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.521+0000 7f8dfcc00640 1 -- 172.21.15.37:0/2639912591 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e04026020 con 0x558d6eba7b20 2024-08-20T05:11:05.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.521+0000 7f8e1c29a740 1 -- 172.21.15.37:0/2639912591 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e0400fba0 con 0x558d6eba7b20 2024-08-20T05:11:05.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.521+0000 7f8dfcc00640 1 -- 172.21.15.37:0/2639912591 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8e0400fd50 con 0x558d6eba7b20 2024-08-20T05:11:05.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.521+0000 7f8dfcc00640 1 -- 172.21.15.37:0/2639912591 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8e04031050 con 0x558d6eba7b20 2024-08-20T05:11:05.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.521+0000 7f8e1c29a740 10 client.27686 fetch_fsmap learned FSMap version 39 2024-08-20T05:11:05.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.521+0000 7f8e1c29a740 1 -- 172.21.15.37:0/2639912591 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x558d6ebc2890 con 0x558d6eba7b20 2024-08-20T05:11:05.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.522+0000 7f8dfcc00640 1 -- 172.21.15.37:0/2639912591 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e0400fba0 con 0x558d6eba7b20 2024-08-20T05:11:05.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.522+0000 7f8dfcc00640 1 -- 172.21.15.37:0/2639912591 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f8e04021070 con 0x558d6eba7b20 2024-08-20T05:11:05.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.522+0000 7f8e1c29a740 10 client.27686 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:11:05.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.522+0000 7f8e1c29a740 10 client.27686 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:11:05.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.522+0000 7f8e1c29a740 20 client.27686 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:05.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.522+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/2639912591 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x558d6ebc3c40 0x558d6ebc6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.522+0000 7f8e1c29a740 4 client.27686 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:05.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.522+0000 7f8e1c29a740 1 -- 172.21.15.37:0/2639912591 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d6eb1f9f0 con 0x558d6ebc3c40 2024-08-20T05:11:05.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.522+0000 7f8e12000640 1 --2- 172.21.15.37:0/2639912591 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x558d6ebc3c40 0x558d6ebc6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.523+0000 7f8e12000640 1 --2- 172.21.15.37:0/2639912591 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x558d6ebc3c40 0x558d6ebc6030 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cdc16e957583db42 server_cookie=641a2da854efd97c in_seq=0 out_seq=0 2024-08-20T05:11:05.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.523+0000 7f8dfcc00640 10 client.27686 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:11:05.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.524+0000 7f8dfcc00640 1 -- 172.21.15.37:0/2639912591 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d6eb1f9f0 con 0x558d6ebc3c40 2024-08-20T05:11:05.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.524+0000 7f8dfcc00640 10 client.27686 handle_command_reply: tid=0 2024-08-20T05:11:05.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.524+0000 7f8e1c29a740 1 client.27686 shutdown 2024-08-20T05:11:05.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.524+0000 7f8e1c29a740 1 -- 172.21.15.37:0/2639912591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 msgr2=0x558d6ebb3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:05.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.524+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/2639912591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 0x558d6ebb3b70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8e04009f40 tx=0x7f8e0400fb20 comp rx=0 tx=0).stop 2024-08-20T05:11:05.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.524+0000 7f8e1c29a740 1 -- 172.21.15.37:0/2639912591 shutdown_connections 2024-08-20T05:11:05.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.524+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/2639912591 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x558d6ebc3c40 0x558d6ebc6030 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.524+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/2639912591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6ebb43d0 0x558d6ebb1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.524+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/2639912591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6eba8440 0x558d6ebb0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.524+0000 7f8dfcc00640 0 client.27686 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:11:05.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.524+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/2639912591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 0x558d6ebb3b70 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.524+0000 7f8e1c29a740 1 -- 172.21.15.37:0/2639912591 >> 172.21.15.37:0/2639912591 conn(0x558d6eba5950 msgr2=0x558d6eba4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:05.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.524+0000 7f8e1c29a740 1 -- 172.21.15.37:0/2639912591 shutdown_connections 2024-08-20T05:11:05.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.524+0000 7f8e1c29a740 1 -- 172.21.15.37:0/2639912591 wait complete. 2024-08-20T05:11:05.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.524+0000 7f8e1c29a740 20 client.27686 trim_cache size 0 max 16384 2024-08-20T05:11:05.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.538+0000 7f8e1c29a740 1 Processor -- start 2024-08-20T05:11:05.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.538+0000 7f8e1c29a740 1 -- start start 2024-08-20T05:11:05.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.539+0000 7f8e1c29a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 0x558d6ebc01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.539+0000 7f8e1c29a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6eba8440 0x558d6ebb04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.539+0000 7f8e1c29a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6ebb43d0 0x558d6eba4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.539+0000 7f8e1c29a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e141b1780 con 0x558d6ebb43d0 2024-08-20T05:11:05.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.539+0000 7f8e1c29a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8e141b33e0 con 0x558d6eba7b20 2024-08-20T05:11:05.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.539+0000 7f8e1c29a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8e141b1e50 con 0x558d6eba8440 2024-08-20T05:11:05.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.539+0000 7f8e13400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6ebb43d0 0x558d6eba4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.539+0000 7f8e13400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6ebb43d0 0x558d6eba4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49558/0 (socket says 172.21.15.37:49558) 2024-08-20T05:11:05.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.539+0000 7f8e13400640 1 -- 172.21.15.37:0/2979206483 learned_addr learned my addr 172.21.15.37:0/2979206483 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:05.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.539+0000 7f8e12a00640 1 --2- 172.21.15.37:0/2979206483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 0x558d6ebc01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.539+0000 7f8e12000640 1 --2- 172.21.15.37:0/2979206483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6eba8440 0x558d6ebb04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.540+0000 7f8e13400640 1 -- 172.21.15.37:0/2979206483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6eba8440 msgr2=0x558d6ebb04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:05.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.540+0000 7f8e13400640 1 --2- 172.21.15.37:0/2979206483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6eba8440 0x558d6ebb04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.540+0000 7f8e13400640 1 -- 172.21.15.37:0/2979206483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 msgr2=0x558d6ebc01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:05.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.540+0000 7f8e13400640 1 --2- 172.21.15.37:0/2979206483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 0x558d6ebc01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.540+0000 7f8e13400640 1 -- 172.21.15.37:0/2979206483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d6eba6d10 con 0x558d6ebb43d0 2024-08-20T05:11:05.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.540+0000 7f8e12a00640 1 --2- 172.21.15.37:0/2979206483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 0x558d6ebc01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:05.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.540+0000 7f8e13400640 1 --2- 172.21.15.37:0/2979206483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6ebb43d0 0x558d6eba4a80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0c7d70 tx=0x7f8e0c004890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1685553ebd2a39f7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:05.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.540+0000 7f8dff400640 1 -- 172.21.15.37:0/2979206483 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0cc3f0 con 0x558d6ebb43d0 2024-08-20T05:11:05.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.540+0000 7f8dff400640 1 -- 172.21.15.37:0/2979206483 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e0c036040 con 0x558d6ebb43d0 2024-08-20T05:11:05.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.540+0000 7f8dff400640 1 -- 172.21.15.37:0/2979206483 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c0cbf50 con 0x558d6ebb43d0 2024-08-20T05:11:05.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.541+0000 7f8e1c29a740 1 -- 172.21.15.37:0/2979206483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6ebb43d0 msgr2=0x558d6eba4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:05.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.541+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/2979206483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6ebb43d0 0x558d6eba4a80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0c7d70 tx=0x7f8e0c004890 comp rx=0 tx=0).stop 2024-08-20T05:11:05.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.541+0000 7f8e1c29a740 1 -- 172.21.15.37:0/2979206483 shutdown_connections 2024-08-20T05:11:05.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.541+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/2979206483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6ebb43d0 0x558d6eba4a80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.541+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/2979206483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6eba8440 0x558d6ebb04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.541+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/2979206483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba7b20 0x558d6ebc01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.541+0000 7f8e1c29a740 1 -- 172.21.15.37:0/2979206483 >> 172.21.15.37:0/2979206483 conn(0x558d6eba5950 msgr2=0x558d6eba4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:05.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.541+0000 7f8e1c29a740 1 -- 172.21.15.37:0/2979206483 shutdown_connections 2024-08-20T05:11:05.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.541+0000 7f8e1c29a740 1 -- 172.21.15.37:0/2979206483 wait complete. 2024-08-20T05:11:05.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.541+0000 7f8e1c29a740 1 -- start start 2024-08-20T05:11:05.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.542+0000 7f8e1c29a740 1 Processor -- start 2024-08-20T05:11:05.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.542+0000 7f8e1c29a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6eba7b20 0x558d6ebbc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.542+0000 7f8e1c29a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba8440 0x558d6ebbca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.542+0000 7f8e1c29a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6ebb43d0 0x558d6ebad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.542+0000 7f8e1c29a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8e141b2c50 con 0x558d6eba7b20 2024-08-20T05:11:05.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.542+0000 7f8e1c29a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8e141b2520 con 0x558d6eba8440 2024-08-20T05:11:05.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.542+0000 7f8e1c29a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8e141af760 con 0x558d6ebb43d0 2024-08-20T05:11:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.542+0000 7f8e1c29a740 10 client.0 _ll_register_callbacks cb 0x7f8e0401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.542+0000 7f8e12a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6eba7b20 0x558d6ebbc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.543+0000 7f8e12a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6eba7b20 0x558d6ebbc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49560/0 (socket says 172.21.15.37:49560) 2024-08-20T05:11:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.543+0000 7f8e12a00640 1 -- 172.21.15.37:0/1920435091 learned_addr learned my addr 172.21.15.37:0/1920435091 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.543+0000 7f8e12000640 1 --2- 172.21.15.37:0/1920435091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba8440 0x558d6ebbca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.543+0000 7f8e13400640 1 --2- 172.21.15.37:0/1920435091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6ebb43d0 0x558d6ebad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.543+0000 7f8e12a00640 1 -- 172.21.15.37:0/1920435091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6ebb43d0 msgr2=0x558d6ebad7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.543+0000 7f8e12a00640 1 --2- 172.21.15.37:0/1920435091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6ebb43d0 0x558d6ebad7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.543+0000 7f8e12a00640 1 -- 172.21.15.37:0/1920435091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba8440 msgr2=0x558d6ebbca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.543+0000 7f8e12a00640 1 --2- 172.21.15.37:0/1920435091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba8440 0x558d6ebbca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.543+0000 7f8e12a00640 1 -- 172.21.15.37:0/1920435091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d6ebadfd0 con 0x558d6eba7b20 2024-08-20T05:11:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.543+0000 7f8e12a00640 1 --2- 172.21.15.37:0/1920435091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6eba7b20 0x558d6ebbc520 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8e04011550 tx=0x7f8e0400fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f417d796c3da97 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:05.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.543+0000 7f8dfcc00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:11:05.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.543+0000 7f8dfcc00640 1 -- 172.21.15.37:0/1920435091 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e04026050 con 0x558d6eba7b20 2024-08-20T05:11:05.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.544+0000 7f8e1c29a740 1 -- 172.21.15.37:0/1920435091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e0c036040 con 0x558d6eba7b20 2024-08-20T05:11:05.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.544+0000 7f8dfcc00640 1 -- 172.21.15.37:0/1920435091 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8e0400fba0 con 0x558d6eba7b20 2024-08-20T05:11:05.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.544+0000 7f8dfcc00640 1 -- 172.21.15.37:0/1920435091 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8e0401e040 con 0x558d6eba7b20 2024-08-20T05:11:05.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.544+0000 7f8e1c29a740 10 client.17217 fetch_fsmap learned FSMap version 39 2024-08-20T05:11:05.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.544+0000 7f8e1c29a740 1 -- 172.21.15.37:0/1920435091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x558d6ec2e2f0 con 0x558d6eba7b20 2024-08-20T05:11:05.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.544+0000 7f8dfcc00640 1 -- 172.21.15.37:0/1920435091 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e0c036040 con 0x558d6eba7b20 2024-08-20T05:11:05.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.544+0000 7f8dfcc00640 1 -- 172.21.15.37:0/1920435091 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 39) ==== 8394+0+0 (secure 0 0 0) 0x7f8e04021040 con 0x558d6eba7b20 2024-08-20T05:11:05.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.544+0000 7f8e1c29a740 10 client.17217 fetch_fsmap finished waiting for FSMap version 39 2024-08-20T05:11:05.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.544+0000 7f8e1c29a740 10 client.17217 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:11:05.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.544+0000 7f8e1c29a740 20 client.17217 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:05.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.544+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/1920435091 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x558d6ec2ea00 0x558d6ec30e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:05.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.544+0000 7f8e1c29a740 4 client.17217 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:11:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.544+0000 7f8e1c29a740 1 -- 172.21.15.37:0/1920435091 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558d6eb1b490 con 0x558d6ec2ea00 2024-08-20T05:11:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.545+0000 7f8e12000640 1 --2- 172.21.15.37:0/1920435091 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x558d6ec2ea00 0x558d6ec30e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.545+0000 7f8e12000640 1 --2- 172.21.15.37:0/1920435091 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x558d6ec2ea00 0x558d6ec30e20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=609d142fcebdcf93 server_cookie=11640a60b83ab4e2 in_seq=0 out_seq=0 2024-08-20T05:11:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.545+0000 7f8dfcc00640 10 client.17217 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:11:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.546+0000 7f8dfcc00640 1 -- 172.21.15.37:0/1920435091 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558d6eb1b490 con 0x558d6ec2ea00 2024-08-20T05:11:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.546+0000 7f8dfcc00640 10 client.17217 handle_command_reply: tid=0 2024-08-20T05:11:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.546+0000 7f8e1c29a740 1 client.17217 shutdown 2024-08-20T05:11:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.546+0000 7f8e1c29a740 1 -- 172.21.15.37:0/1920435091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6eba7b20 msgr2=0x558d6ebbc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.546+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/1920435091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6eba7b20 0x558d6ebbc520 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8e04011550 tx=0x7f8e0400fa00 comp rx=0 tx=0).stop 2024-08-20T05:11:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.546+0000 7f8e1c29a740 1 -- 172.21.15.37:0/1920435091 shutdown_connections 2024-08-20T05:11:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.546+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/1920435091 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x558d6ec2ea00 0x558d6ec30e20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.546+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/1920435091 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d6ebb43d0 0x558d6ebad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.546+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/1920435091 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d6eba8440 0x558d6ebbca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.546+0000 7f8e1c29a740 1 --2- 172.21.15.37:0/1920435091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d6eba7b20 0x558d6ebbc520 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.546+0000 7f8e1c29a740 1 -- 172.21.15.37:0/1920435091 >> 172.21.15.37:0/1920435091 conn(0x558d6eba5950 msgr2=0x558d6eba4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:05.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.546+0000 7f8dfcc00640 0 client.17217 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:11:05.575 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:11:05.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.546+0000 7f8e1c29a740 1 -- 172.21.15.37:0/1920435091 shutdown_connections 2024-08-20T05:11:05.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.546+0000 7f8e1c29a740 1 -- 172.21.15.37:0/1920435091 wait complete. 2024-08-20T05:11:05.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.546+0000 7f8e1c29a740 20 client.17217 trim_cache size 0 max 16384 2024-08-20T05:11:05.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.547+0000 7f8e13e00640 1 -- 172.21.15.37:0/2889839649 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8df80b3cf0 msgr2=0x7f8df80b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:05.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.547+0000 7f8e13e00640 1 --2- 172.21.15.37:0/2889839649 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8df80b3cf0 0x7f8df80b61b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8e14102d80 tx=0x7f8e00004730 comp rx=0 tx=0).stop 2024-08-20T05:11:05.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.547+0000 7f8e13e00640 1 -- 172.21.15.37:0/2889839649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e1410aea0 msgr2=0x7f8e141a07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:05.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.547+0000 7f8e13e00640 1 --2- 172.21.15.37:0/2889839649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e1410aea0 0x7f8e141a07c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c005e30 tx=0x7f8e0c0317c0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.547+0000 7f8e13e00640 1 -- 172.21.15.37:0/2889839649 shutdown_connections 2024-08-20T05:11:05.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.547+0000 7f8e13e00640 1 --2- 172.21.15.37:0/2889839649 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8df80b3cf0 0x7f8df80b61b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.547+0000 7f8e13e00640 1 --2- 172.21.15.37:0/2889839649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e1410aea0 0x7f8e141a07c0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.547+0000 7f8e13e00640 1 --2- 172.21.15.37:0/2889839649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8e1410a520 0x7f8e1419b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.547+0000 7f8e13e00640 1 --2- 172.21.15.37:0/2889839649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8e14104b10 0x7f8e1419aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:05.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.547+0000 7f8e13e00640 1 -- 172.21.15.37:0/2889839649 >> 172.21.15.37:0/2889839649 conn(0x7f8e14100540 msgr2=0x7f8e141039e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:05.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.547+0000 7f8e13e00640 1 -- 172.21.15.37:0/2889839649 shutdown_connections 2024-08-20T05:11:05.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:05.547+0000 7f8e13e00640 1 -- 172.21.15.37:0/2889839649 wait complete. 2024-08-20T05:11:05.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:05 smithi130 ceph-mon[22007]: pgmap v666: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.1 MiB/s wr, 401 op/s 2024-08-20T05:11:05.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:05 smithi037 ceph-mon[17265]: pgmap v666: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.1 MiB/s wr, 401 op/s 2024-08-20T05:11:05.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:05 smithi135 ceph-mon[22342]: pgmap v666: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.1 MiB/s wr, 401 op/s 2024-08-20T05:11:06.484 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T05:11:06.869 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:07.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.510+0000 7f6bbbe00640 1 -- 172.21.15.37:0/1583317942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc10ef10 msgr2=0x7f6bbc111300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:07.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.510+0000 7f6bbbe00640 1 --2- 172.21.15.37:0/1583317942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc10ef10 0x7f6bbc111300 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009ca0 tx=0x7f6bb402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.510+0000 7f6bbbe00640 1 -- 172.21.15.37:0/1583317942 shutdown_connections 2024-08-20T05:11:07.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.510+0000 7f6bbbe00640 1 --2- 172.21.15.37:0/1583317942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc10ef10 0x7f6bbc111300 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.510+0000 7f6bbbe00640 1 --2- 172.21.15.37:0/1583317942 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bbc075b30 0x7f6bbc10e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.510+0000 7f6bbbe00640 1 --2- 172.21.15.37:0/1583317942 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bbc075210 0x7f6bbc0755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.510+0000 7f6bbbe00640 1 -- 172.21.15.37:0/1583317942 >> 172.21.15.37:0/1583317942 conn(0x7f6bbc0fe350 msgr2=0x7f6bbc100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:07.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.510+0000 7f6bbbe00640 1 -- 172.21.15.37:0/1583317942 shutdown_connections 2024-08-20T05:11:07.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.510+0000 7f6bbbe00640 1 -- 172.21.15.37:0/1583317942 wait complete. 2024-08-20T05:11:07.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.511+0000 7f6bbbe00640 1 Processor -- start 2024-08-20T05:11:07.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.511+0000 7f6bbbe00640 1 -- start start 2024-08-20T05:11:07.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.512+0000 7f6bbbe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bbc075210 0x7f6bbc19af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.512+0000 7f6bbbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bbc075b30 0x7f6bbc19b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.512+0000 7f6bbbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc10ef10 0x7f6bbc1a07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.512+0000 7f6bbbe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc114b40 con 0x7f6bbc10ef10 2024-08-20T05:11:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.512+0000 7f6bbbe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc1149c0 con 0x7f6bbc075210 2024-08-20T05:11:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.512+0000 7f6bbbe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc114cc0 con 0x7f6bbc075b30 2024-08-20T05:11:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.512+0000 7f6bbb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc10ef10 0x7f6bbc1a07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.512+0000 7f6bbaa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bbc075210 0x7f6bbc19af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.512+0000 7f6bbaa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bbc075210 0x7f6bbc19af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50736/0 (socket says 172.21.15.37:50736) 2024-08-20T05:11:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.512+0000 7f6bbb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc10ef10 0x7f6bbc1a07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49582/0 (socket says 172.21.15.37:49582) 2024-08-20T05:11:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.512+0000 7f6bbaa00640 1 -- 172.21.15.37:0/94535596 learned_addr learned my addr 172.21.15.37:0/94535596 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.512+0000 7f6bba000640 1 --2- 172.21.15.37:0/94535596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bbc075b30 0x7f6bbc19b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.512+0000 7f6bbaa00640 1 -- 172.21.15.37:0/94535596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bbc075b30 msgr2=0x7f6bbc19b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.512+0000 7f6bbaa00640 1 --2- 172.21.15.37:0/94535596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bbc075b30 0x7f6bbc19b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.513+0000 7f6bbaa00640 1 -- 172.21.15.37:0/94535596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc10ef10 msgr2=0x7f6bbc1a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.513+0000 7f6bbaa00640 1 --2- 172.21.15.37:0/94535596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc10ef10 0x7f6bbc1a07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.513+0000 7f6bbaa00640 1 -- 172.21.15.37:0/94535596 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bbc1a0fc0 con 0x7f6bbc075210 2024-08-20T05:11:07.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.513+0000 7f6bba000640 1 --2- 172.21.15.37:0/94535596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bbc075b30 0x7f6bbc19b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:11:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.513+0000 7f6bbb400640 1 --2- 172.21.15.37:0/94535596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc10ef10 0x7f6bbc1a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.513+0000 7f6bbaa00640 1 --2- 172.21.15.37:0/94535596 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bbc075210 0x7f6bbc19af10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00e9f0 tx=0x7f6bac00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.513+0000 7f6bb3400640 1 -- 172.21.15.37:0/94535596 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac00cd80 con 0x7f6bbc075210 2024-08-20T05:11:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.513+0000 7f6bb3400640 1 -- 172.21.15.37:0/94535596 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bac0108e0 con 0x7f6bbc075210 2024-08-20T05:11:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.513+0000 7f6bb3400640 1 -- 172.21.15.37:0/94535596 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac018980 con 0x7f6bbc075210 2024-08-20T05:11:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.513+0000 7f6bbbe00640 1 -- 172.21.15.37:0/94535596 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bbc1a12b0 con 0x7f6bbc075210 2024-08-20T05:11:07.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.513+0000 7f6bbbe00640 1 -- 172.21.15.37:0/94535596 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bbc1a7b40 con 0x7f6bbc075210 2024-08-20T05:11:07.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.516+0000 7f6bc43e6740 1 Processor -- start 2024-08-20T05:11:07.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.517+0000 7f6bc43e6740 1 -- start start 2024-08-20T05:11:07.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.517+0000 7f6bc43e6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a53ac0 0x559a19a53ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.517+0000 7f6bc43e6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 0x559a19a5fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.517+0000 7f6bb3400640 1 -- 172.21.15.37:0/94535596 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6bac010430 con 0x7f6bbc075210 2024-08-20T05:11:07.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.517+0000 7f6bc43e6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a60370 0x559a19a62760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.517+0000 7f6bc43e6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559a199c9aa0 con 0x559a19a543e0 2024-08-20T05:11:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.517+0000 7f6bc43e6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559a199b8fa0 con 0x559a19a60370 2024-08-20T05:11:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.517+0000 7f6bc43e6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559a199bcfe0 con 0x559a19a53ac0 2024-08-20T05:11:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.517+0000 7f6bba000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a60370 0x559a19a62760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.517+0000 7f6bbaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 0x559a19a5fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.517+0000 7f6bba000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a60370 0x559a19a62760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50752/0 (socket says 172.21.15.37:50752) 2024-08-20T05:11:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.517+0000 7f6bba000640 1 -- 172.21.15.37:0/3078197830 learned_addr learned my addr 172.21.15.37:0/3078197830 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:07.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.517+0000 7f6bbb400640 1 --2- 172.21.15.37:0/3078197830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a53ac0 0x559a19a53ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.518+0000 7f6bba000640 1 -- 172.21.15.37:0/3078197830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a53ac0 msgr2=0x559a19a53ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:07.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.518+0000 7f6bba000640 1 --2- 172.21.15.37:0/3078197830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a53ac0 0x559a19a53ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.518+0000 7f6bba000640 1 -- 172.21.15.37:0/3078197830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 msgr2=0x559a19a5fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:07.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.518+0000 7f6bba000640 1 --2- 172.21.15.37:0/3078197830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 0x559a19a5fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.518+0000 7f6bba000640 1 -- 172.21.15.37:0/3078197830 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a1995f420 con 0x559a19a60370 2024-08-20T05:11:07.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.518+0000 7f6bba000640 1 --2- 172.21.15.37:0/3078197830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a60370 0x559a19a62760 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009ce0 tx=0x7f6ba80117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebf3e8e584b28701 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:07.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.518+0000 7f6ba7e00640 1 -- 172.21.15.37:0/3078197830 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8012450 con 0x559a19a60370 2024-08-20T05:11:07.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.518+0000 7f6ba7e00640 1 -- 172.21.15.37:0/3078197830 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ba8012aa0 con 0x559a19a60370 2024-08-20T05:11:07.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.519+0000 7f6ba7e00640 1 -- 172.21.15.37:0/3078197830 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba800fc30 con 0x559a19a60370 2024-08-20T05:11:07.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.519+0000 7f6bb3400640 1 --2- 172.21.15.37:0/94535596 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6ba00b3cf0 0x7f6ba00b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.519+0000 7f6bb3400640 1 -- 172.21.15.37:0/94535596 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6bac0e4340 con 0x7f6bbc075210 2024-08-20T05:11:07.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.519+0000 7f6bbb400640 1 --2- 172.21.15.37:0/94535596 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6ba00b3cf0 0x7f6ba00b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.519+0000 7f6bc43e6740 1 -- 172.21.15.37:0/3078197830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a60370 msgr2=0x559a19a62760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:07.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.519+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/3078197830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a60370 0x559a19a62760 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009ce0 tx=0x7f6ba80117b0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.519+0000 7f6bc43e6740 1 -- 172.21.15.37:0/3078197830 shutdown_connections 2024-08-20T05:11:07.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.519+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/3078197830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a60370 0x559a19a62760 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.519+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/3078197830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 0x559a19a5fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.519+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/3078197830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a53ac0 0x559a19a53ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.519+0000 7f6bc43e6740 1 -- 172.21.15.37:0/3078197830 >> 172.21.15.37:0/3078197830 conn(0x559a19a518f0 msgr2=0x559a19a52a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:07.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.519+0000 7f6bc43e6740 1 -- 172.21.15.37:0/3078197830 shutdown_connections 2024-08-20T05:11:07.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.520+0000 7f6bc43e6740 1 -- 172.21.15.37:0/3078197830 wait complete. 2024-08-20T05:11:07.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.520+0000 7f6bbb400640 1 --2- 172.21.15.37:0/94535596 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6ba00b3cf0 0x7f6ba00b61b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4004af0 tx=0x7f6bb4005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:07.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.520+0000 7f6bc43e6740 1 -- start start 2024-08-20T05:11:07.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.520+0000 7f6bc43e6740 1 Processor -- start 2024-08-20T05:11:07.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.521+0000 7f6bc43e6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a53ac0 0x559a19a5fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.521+0000 7f6bc43e6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 0x559a19a5cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.521+0000 7f6bc43e6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a60370 0x559a19a5d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.521+0000 7f6bc43e6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559a1981b700 con 0x559a19a543e0 2024-08-20T05:11:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.521+0000 7f6bc43e6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559a19954290 con 0x559a19a53ac0 2024-08-20T05:11:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.521+0000 7f6bc43e6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559a19a63040 con 0x559a19a60370 2024-08-20T05:11:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.521+0000 7f6bc43e6740 10 client.0 _ll_register_callbacks cb 0x559a199b31c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.521+0000 7f6bba000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 0x559a19a5cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.521+0000 7f6bba000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 0x559a19a5cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49600/0 (socket says 172.21.15.37:49600) 2024-08-20T05:11:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.521+0000 7f6bba000640 1 -- 172.21.15.37:0/1681742312 learned_addr learned my addr 172.21.15.37:0/1681742312 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.521+0000 7f6bbaa00640 1 --2- 172.21.15.37:0/1681742312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a53ac0 0x559a19a5fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.521+0000 7f6bbb400640 1 --2- 172.21.15.37:0/1681742312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a60370 0x559a19a5d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.522+0000 7f6bbaa00640 1 -- 172.21.15.37:0/1681742312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a60370 msgr2=0x559a19a5d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:07.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.522+0000 7f6bbaa00640 1 --2- 172.21.15.37:0/1681742312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a60370 0x559a19a5d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.522+0000 7f6bbaa00640 1 -- 172.21.15.37:0/1681742312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 msgr2=0x559a19a5cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:07.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.522+0000 7f6bbaa00640 1 --2- 172.21.15.37:0/1681742312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 0x559a19a5cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.522+0000 7f6bbaa00640 1 -- 172.21.15.37:0/1681742312 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a19718650 con 0x559a19a53ac0 2024-08-20T05:11:07.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.522+0000 7f6bba000640 1 --2- 172.21.15.37:0/1681742312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 0x559a19a5cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:07.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.522+0000 7f6bbaa00640 1 --2- 172.21.15.37:0/1681742312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a53ac0 0x559a19a5fb20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0e7fd0 tx=0x7f6bac009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c8c4777291f3e64 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:07.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.522+0000 7f6ba4c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:11:07.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.522+0000 7f6ba4c00640 1 -- 172.21.15.37:0/1681742312 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac010720 con 0x559a19a53ac0 2024-08-20T05:11:07.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.522+0000 7f6bc43e6740 1 -- 172.21.15.37:0/1681742312 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ba8012aa0 con 0x559a19a53ac0 2024-08-20T05:11:07.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.522+0000 7f6ba4c00640 1 -- 172.21.15.37:0/1681742312 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6bac0aa0f0 con 0x559a19a53ac0 2024-08-20T05:11:07.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.523+0000 7f6ba4c00640 1 -- 172.21.15.37:0/1681742312 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f6bac0aa9a0 con 0x559a19a53ac0 2024-08-20T05:11:07.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.523+0000 7f6bc43e6740 10 client.27704 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:07.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.523+0000 7f6bc43e6740 1 -- 172.21.15.37:0/1681742312 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x559a19a6e860 con 0x559a19a53ac0 2024-08-20T05:11:07.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.523+0000 7f6ba4c00640 1 -- 172.21.15.37:0/1681742312 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ba8012aa0 con 0x559a19a53ac0 2024-08-20T05:11:07.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.523+0000 7f6ba4c00640 1 -- 172.21.15.37:0/1681742312 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f6bac0a6800 con 0x559a19a53ac0 2024-08-20T05:11:07.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.523+0000 7f6bc43e6740 10 client.27704 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:07.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.523+0000 7f6bc43e6740 10 client.27704 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:11:07.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.523+0000 7f6bc43e6740 20 client.27704 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:07.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.523+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/1681742312 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x559a19a6fd20 0x559a19a721c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.523+0000 7f6bc43e6740 4 client.27704 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:07.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.523+0000 7f6bc43e6740 1 -- 172.21.15.37:0/1681742312 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a199cb9f0 con 0x559a19a6fd20 2024-08-20T05:11:07.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.524+0000 7f6bba000640 1 --2- 172.21.15.37:0/1681742312 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x559a19a6fd20 0x559a19a721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.524+0000 7f6bba000640 1 --2- 172.21.15.37:0/1681742312 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x559a19a6fd20 0x559a19a721c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e812133fd516cf09 server_cookie=442285335c24e63a in_seq=0 out_seq=0 2024-08-20T05:11:07.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.524+0000 7f6ba4c00640 10 client.27704 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:11:07.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.525+0000 7f6ba4c00640 1 -- 172.21.15.37:0/1681742312 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559a199cb9f0 con 0x559a19a6fd20 2024-08-20T05:11:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.525+0000 7f6ba4c00640 10 client.27704 handle_command_reply: tid=0 2024-08-20T05:11:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.525+0000 7f6bc43e6740 1 client.27704 shutdown 2024-08-20T05:11:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.525+0000 7f6bc43e6740 1 -- 172.21.15.37:0/1681742312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a53ac0 msgr2=0x559a19a5fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.525+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/1681742312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a53ac0 0x559a19a5fb20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0e7fd0 tx=0x7f6bac009310 comp rx=0 tx=0).stop 2024-08-20T05:11:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.525+0000 7f6bc43e6740 1 -- 172.21.15.37:0/1681742312 shutdown_connections 2024-08-20T05:11:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.525+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/1681742312 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x559a19a6fd20 0x559a19a721c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.525+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/1681742312 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a60370 0x559a19a5d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.525+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/1681742312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 0x559a19a5cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.525+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/1681742312 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a53ac0 0x559a19a5fb20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.525+0000 7f6ba4c00640 0 client.27704 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:11:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.525+0000 7f6bc43e6740 1 -- 172.21.15.37:0/1681742312 >> 172.21.15.37:0/1681742312 conn(0x559a19a518f0 msgr2=0x559a19a57490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:07.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.526+0000 7f6bc43e6740 1 -- 172.21.15.37:0/1681742312 shutdown_connections 2024-08-20T05:11:07.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.526+0000 7f6bc43e6740 1 -- 172.21.15.37:0/1681742312 wait complete. 2024-08-20T05:11:07.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.526+0000 7f6bc43e6740 20 client.27704 trim_cache size 0 max 16384 2024-08-20T05:11:07.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.539+0000 7f6bc43e6740 1 Processor -- start 2024-08-20T05:11:07.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.540+0000 7f6bc43e6740 1 -- start start 2024-08-20T05:11:07.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.540+0000 7f6bc43e6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a53ac0 0x559a19a6c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.540+0000 7f6bc43e6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a543e0 0x559a19a584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.540+0000 7f6bc43e6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a60370 0x559a19a77a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.540+0000 7f6bc43e6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc1b1820 con 0x559a19a53ac0 2024-08-20T05:11:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.540+0000 7f6bc43e6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc1b3420 con 0x559a19a60370 2024-08-20T05:11:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.540+0000 7f6bc43e6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc1b1ef0 con 0x559a19a543e0 2024-08-20T05:11:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.540+0000 7f6bbaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a53ac0 0x559a19a6c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.540+0000 7f6bbb400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a60370 0x559a19a77a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.540+0000 7f6bbaa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a53ac0 0x559a19a6c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49606/0 (socket says 172.21.15.37:49606) 2024-08-20T05:11:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.540+0000 7f6bbaa00640 1 -- 172.21.15.37:0/4143152199 learned_addr learned my addr 172.21.15.37:0/4143152199 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.540+0000 7f6bba000640 1 --2- 172.21.15.37:0/4143152199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a543e0 0x559a19a584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.541+0000 7f6bbb400640 1 -- 172.21.15.37:0/4143152199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a543e0 msgr2=0x559a19a584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.541+0000 7f6bbb400640 1 --2- 172.21.15.37:0/4143152199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a543e0 0x559a19a584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.541+0000 7f6bbb400640 1 -- 172.21.15.37:0/4143152199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a53ac0 msgr2=0x559a19a6c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.541+0000 7f6bbb400640 1 --2- 172.21.15.37:0/4143152199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a53ac0 0x559a19a6c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.541+0000 7f6bbb400640 1 -- 172.21.15.37:0/4143152199 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a19a5fe90 con 0x559a19a60370 2024-08-20T05:11:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.541+0000 7f6bbaa00640 1 --2- 172.21.15.37:0/4143152199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a53ac0 0x559a19a6c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.541+0000 7f6bbb400640 1 --2- 172.21.15.37:0/4143152199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a60370 0x559a19a77a90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6bb402ade0 tx=0x7f6bb4042000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f30a06a3e24fa2d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.541+0000 7f6ba7400640 1 -- 172.21.15.37:0/4143152199 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4003970 con 0x559a19a60370 2024-08-20T05:11:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.541+0000 7f6ba7400640 1 -- 172.21.15.37:0/4143152199 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bb4036040 con 0x559a19a60370 2024-08-20T05:11:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.541+0000 7f6ba7400640 1 -- 172.21.15.37:0/4143152199 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb402f610 con 0x559a19a60370 2024-08-20T05:11:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.542+0000 7f6bc43e6740 1 -- 172.21.15.37:0/4143152199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a60370 msgr2=0x559a19a77a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.542+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/4143152199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a60370 0x559a19a77a90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6bb402ade0 tx=0x7f6bb4042000 comp rx=0 tx=0).stop 2024-08-20T05:11:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.542+0000 7f6bc43e6740 1 -- 172.21.15.37:0/4143152199 shutdown_connections 2024-08-20T05:11:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.542+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/4143152199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a60370 0x559a19a77a90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.542+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/4143152199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a543e0 0x559a19a584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.542+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/4143152199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a53ac0 0x559a19a6c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.542+0000 7f6bc43e6740 1 -- 172.21.15.37:0/4143152199 >> 172.21.15.37:0/4143152199 conn(0x559a19a518f0 msgr2=0x559a19a57de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.542+0000 7f6bc43e6740 1 -- 172.21.15.37:0/4143152199 shutdown_connections 2024-08-20T05:11:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.542+0000 7f6bc43e6740 1 -- 172.21.15.37:0/4143152199 wait complete. 2024-08-20T05:11:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.543+0000 7f6bc43e6740 1 -- start start 2024-08-20T05:11:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.543+0000 7f6bc43e6740 1 Processor -- start 2024-08-20T05:11:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.543+0000 7f6bc43e6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a53ac0 0x559a19a688a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.543+0000 7f6bc43e6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 0x559a19a63d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.543+0000 7f6bc43e6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a60370 0x559a19a642b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.543+0000 7f6bc43e6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc1b2cf0 con 0x559a19a543e0 2024-08-20T05:11:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.543+0000 7f6bc43e6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc1b25c0 con 0x559a19a53ac0 2024-08-20T05:11:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.543+0000 7f6bc43e6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc1af800 con 0x559a19a60370 2024-08-20T05:11:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.543+0000 7f6bc43e6740 10 client.0 _ll_register_callbacks cb 0x7f6bac0e7a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.544+0000 7f6bba000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 0x559a19a63d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.544+0000 7f6bbaa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a53ac0 0x559a19a688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.544+0000 7f6bbb400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a60370 0x559a19a642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.544+0000 7f6bba000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 0x559a19a63d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49614/0 (socket says 172.21.15.37:49614) 2024-08-20T05:11:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.544+0000 7f6bba000640 1 -- 172.21.15.37:0/2541789243 learned_addr learned my addr 172.21.15.37:0/2541789243 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.544+0000 7f6bbaa00640 1 -- 172.21.15.37:0/2541789243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a60370 msgr2=0x559a19a642b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.544+0000 7f6bbaa00640 1 --2- 172.21.15.37:0/2541789243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a60370 0x559a19a642b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.544+0000 7f6bbaa00640 1 -- 172.21.15.37:0/2541789243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 msgr2=0x559a19a63d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.544+0000 7f6bbaa00640 1 --2- 172.21.15.37:0/2541789243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 0x559a19a63d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.544+0000 7f6bbaa00640 1 -- 172.21.15.37:0/2541789243 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a19a649f0 con 0x559a19a53ac0 2024-08-20T05:11:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.544+0000 7f6bba000640 1 --2- 172.21.15.37:0/2541789243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 0x559a19a63d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.544+0000 7f6bbaa00640 1 --2- 172.21.15.37:0/2541789243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a53ac0 0x559a19a688a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0aae20 tx=0x7f6bac0af310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b1f3fd074b1d9e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.544+0000 7f6ba4c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:11:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.545+0000 7f6ba4c00640 1 -- 172.21.15.37:0/2541789243 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac010720 con 0x559a19a53ac0 2024-08-20T05:11:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.545+0000 7f6ba4c00640 1 -- 172.21.15.37:0/2541789243 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6bac0a7480 con 0x559a19a53ac0 2024-08-20T05:11:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.545+0000 7f6bc43e6740 1 -- 172.21.15.37:0/2541789243 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bb4036040 con 0x559a19a53ac0 2024-08-20T05:11:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.545+0000 7f6ba4c00640 1 -- 172.21.15.37:0/2541789243 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f6bac0ab590 con 0x559a19a53ac0 2024-08-20T05:11:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.545+0000 7f6bc43e6740 10 client.27710 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.545+0000 7f6bc43e6740 1 -- 172.21.15.37:0/2541789243 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x559a19ada9d0 con 0x559a19a53ac0 2024-08-20T05:11:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.545+0000 7f6ba4c00640 1 -- 172.21.15.37:0/2541789243 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bb4036040 con 0x559a19a53ac0 2024-08-20T05:11:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.545+0000 7f6ba4c00640 1 -- 172.21.15.37:0/2541789243 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f6bac0b0620 con 0x559a19a53ac0 2024-08-20T05:11:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.545+0000 7f6bc43e6740 10 client.27710 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.545+0000 7f6bc43e6740 10 client.27710 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:11:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.545+0000 7f6bc43e6740 20 client.27710 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.545+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/2541789243 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x559a19adb0d0 0x559a19add4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:07.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.545+0000 7f6bc43e6740 4 client.27710 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:11:07.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.545+0000 7f6bc43e6740 1 -- 172.21.15.37:0/2541789243 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559a199c7490 con 0x559a19adb0d0 2024-08-20T05:11:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.546+0000 7f6bba000640 1 --2- 172.21.15.37:0/2541789243 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x559a19adb0d0 0x559a19add4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.546+0000 7f6bba000640 1 --2- 172.21.15.37:0/2541789243 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x559a19adb0d0 0x559a19add4f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e468c2fc22130d45 server_cookie=ff212f29babdf7fa in_seq=0 out_seq=0 2024-08-20T05:11:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.546+0000 7f6ba4c00640 10 client.27710 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:11:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.547+0000 7f6ba4c00640 1 -- 172.21.15.37:0/2541789243 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559a199c7490 con 0x559a19adb0d0 2024-08-20T05:11:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.547+0000 7f6ba4c00640 10 client.27710 handle_command_reply: tid=0 2024-08-20T05:11:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.547+0000 7f6bc43e6740 1 client.27710 shutdown 2024-08-20T05:11:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.547+0000 7f6bc43e6740 1 -- 172.21.15.37:0/2541789243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a53ac0 msgr2=0x559a19a688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.547+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/2541789243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a53ac0 0x559a19a688a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0aae20 tx=0x7f6bac0af310 comp rx=0 tx=0).stop 2024-08-20T05:11:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.547+0000 7f6bc43e6740 1 -- 172.21.15.37:0/2541789243 shutdown_connections 2024-08-20T05:11:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.547+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/2541789243 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x559a19adb0d0 0x559a19add4f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.547+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/2541789243 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a19a60370 0x559a19a642b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.547+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/2541789243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a19a543e0 0x559a19a63d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.547+0000 7f6bc43e6740 1 --2- 172.21.15.37:0/2541789243 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a19a53ac0 0x559a19a688a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.547+0000 7f6ba4c00640 0 client.27710 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:11:07.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.547+0000 7f6bc43e6740 1 -- 172.21.15.37:0/2541789243 >> 172.21.15.37:0/2541789243 conn(0x559a19a518f0 msgr2=0x559a19a50ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:07.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.547+0000 7f6bc43e6740 1 -- 172.21.15.37:0/2541789243 shutdown_connections 2024-08-20T05:11:07.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.547+0000 7f6bc43e6740 1 -- 172.21.15.37:0/2541789243 wait complete. 2024-08-20T05:11:07.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.547+0000 7f6bc43e6740 20 client.27710 trim_cache size 0 max 16384 2024-08-20T05:11:07.552 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:11:07.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.548+0000 7f6bbbe00640 1 -- 172.21.15.37:0/94535596 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6ba00b3cf0 msgr2=0x7f6ba00b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:07.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.548+0000 7f6bbbe00640 1 --2- 172.21.15.37:0/94535596 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6ba00b3cf0 0x7f6ba00b61b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4004af0 tx=0x7f6bb4005d80 comp rx=0 tx=0).stop 2024-08-20T05:11:07.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.548+0000 7f6bbbe00640 1 -- 172.21.15.37:0/94535596 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bbc075210 msgr2=0x7f6bbc19af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:07.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.548+0000 7f6bbbe00640 1 --2- 172.21.15.37:0/94535596 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bbc075210 0x7f6bbc19af10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00e9f0 tx=0x7f6bac00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.548+0000 7f6bbbe00640 1 -- 172.21.15.37:0/94535596 shutdown_connections 2024-08-20T05:11:07.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.548+0000 7f6bbbe00640 1 --2- 172.21.15.37:0/94535596 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6ba00b3cf0 0x7f6ba00b61b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.548+0000 7f6bbbe00640 1 --2- 172.21.15.37:0/94535596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bbc10ef10 0x7f6bbc1a07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.548+0000 7f6bbbe00640 1 --2- 172.21.15.37:0/94535596 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6bbc075b30 0x7f6bbc19b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.548+0000 7f6bbbe00640 1 --2- 172.21.15.37:0/94535596 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6bbc075210 0x7f6bbc19af10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:07.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.548+0000 7f6bbbe00640 1 -- 172.21.15.37:0/94535596 >> 172.21.15.37:0/94535596 conn(0x7f6bbc0fe350 msgr2=0x7f6bbc106970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:07.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.548+0000 7f6bbbe00640 1 -- 172.21.15.37:0/94535596 shutdown_connections 2024-08-20T05:11:07.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:07.548+0000 7f6bbbe00640 1 -- 172.21.15.37:0/94535596 wait complete. 2024-08-20T05:11:07.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:07 smithi037 ceph-mon[17265]: pgmap v667: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.3 MiB/s wr, 328 op/s 2024-08-20T05:11:07.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:07 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:11:07.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:07 smithi135 ceph-mon[22342]: pgmap v667: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.3 MiB/s wr, 328 op/s 2024-08-20T05:11:07.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:07 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:11:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:07 smithi130 ceph-mon[22007]: pgmap v667: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.3 MiB/s wr, 328 op/s 2024-08-20T05:11:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:07 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:11:08.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:11:08.347 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T05:11:08.727 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:09.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.292+0000 7ff5e4a00640 1 -- 172.21.15.37:0/1543096223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e0077d20 msgr2=0x7ff5e0112fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:09.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.292+0000 7ff5e4a00640 1 --2- 172.21.15.37:0/1543096223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e0077d20 0x7ff5e0112fb0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009900 tx=0x7ff5cc02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.292+0000 7ff5e4a00640 1 -- 172.21.15.37:0/1543096223 shutdown_connections 2024-08-20T05:11:09.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.292+0000 7ff5e4a00640 1 --2- 172.21.15.37:0/1543096223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5e01134f0 0x7ff5e01158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.292+0000 7ff5e4a00640 1 --2- 172.21.15.37:0/1543096223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e0077d20 0x7ff5e0112fb0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.292+0000 7ff5e4a00640 1 --2- 172.21.15.37:0/1543096223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5e0077400 0x7ff5e00777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.292+0000 7ff5e4a00640 1 -- 172.21.15.37:0/1543096223 >> 172.21.15.37:0/1543096223 conn(0x7ff5e0100550 msgr2=0x7ff5e0102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.293+0000 7ff5e4a00640 1 -- 172.21.15.37:0/1543096223 shutdown_connections 2024-08-20T05:11:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.293+0000 7ff5e4a00640 1 -- 172.21.15.37:0/1543096223 wait complete. 2024-08-20T05:11:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.293+0000 7ff5e4a00640 1 Processor -- start 2024-08-20T05:11:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.294+0000 7ff5e4a00640 1 -- start start 2024-08-20T05:11:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.294+0000 7ff5e4a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5e0077400 0x7ff5e019f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.294+0000 7ff5e4a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5e0077d20 0x7ff5e019f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.294+0000 7ff5e4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e01134f0 0x7ff5e01a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.294+0000 7ff5e4a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e0118f50 con 0x7ff5e01134f0 2024-08-20T05:11:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.294+0000 7ff5e4a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e0118dd0 con 0x7ff5e0077d20 2024-08-20T05:11:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.294+0000 7ff5e4a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e01190d0 con 0x7ff5e0077400 2024-08-20T05:11:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.294+0000 7ff5dfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e01134f0 0x7ff5e01a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.294+0000 7ff5dfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e01134f0 0x7ff5e01a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49620/0 (socket says 172.21.15.37:49620) 2024-08-20T05:11:09.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.294+0000 7ff5dfe00640 1 -- 172.21.15.37:0/1006346471 learned_addr learned my addr 172.21.15.37:0/1006346471 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:09.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.294+0000 7ff5df400640 1 --2- 172.21.15.37:0/1006346471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5e0077400 0x7ff5e019f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.294+0000 7ff5dea00640 1 --2- 172.21.15.37:0/1006346471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5e0077d20 0x7ff5e019f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.295+0000 7ff5dfe00640 1 -- 172.21.15.37:0/1006346471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5e0077400 msgr2=0x7ff5e019f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:09.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.295+0000 7ff5dfe00640 1 --2- 172.21.15.37:0/1006346471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5e0077400 0x7ff5e019f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.295+0000 7ff5dfe00640 1 -- 172.21.15.37:0/1006346471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5e0077d20 msgr2=0x7ff5e019f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:09.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.295+0000 7ff5dfe00640 1 --2- 172.21.15.37:0/1006346471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5e0077d20 0x7ff5e019f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.295+0000 7ff5dfe00640 1 -- 172.21.15.37:0/1006346471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e01a53e0 con 0x7ff5e01134f0 2024-08-20T05:11:09.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.295+0000 7ff5dfe00640 1 --2- 172.21.15.37:0/1006346471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e01134f0 0x7ff5e01a4c10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800dac0 tx=0x7ff5d800df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:09.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.295+0000 7ff5d7e00640 1 -- 172.21.15.37:0/1006346471 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8017070 con 0x7ff5e01134f0 2024-08-20T05:11:09.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.295+0000 7ff5d7e00640 1 -- 172.21.15.37:0/1006346471 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5d800be30 con 0x7ff5e01134f0 2024-08-20T05:11:09.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.295+0000 7ff5e4a00640 1 -- 172.21.15.37:0/1006346471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e01a56d0 con 0x7ff5e01134f0 2024-08-20T05:11:09.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.295+0000 7ff5d7e00640 1 -- 172.21.15.37:0/1006346471 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8010460 con 0x7ff5e01134f0 2024-08-20T05:11:09.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.295+0000 7ff5e4a00640 1 -- 172.21.15.37:0/1006346471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e01abd90 con 0x7ff5e01134f0 2024-08-20T05:11:09.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.298+0000 7ff5e8bf7740 1 Processor -- start 2024-08-20T05:11:09.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.299+0000 7ff5d7e00640 1 -- 172.21.15.37:0/1006346471 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff5d80040b0 con 0x7ff5e01134f0 2024-08-20T05:11:09.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.299+0000 7ff5e8bf7740 1 -- start start 2024-08-20T05:11:09.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.299+0000 7ff5e8bf7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c8200ac0 0x5642c8200ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.299+0000 7ff5e8bf7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c82013e0 0x5642c820ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.299+0000 7ff5e8bf7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c820d370 0x5642c820f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.299+0000 7ff5e8bf7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5642c8176aa0 con 0x5642c8200ac0 2024-08-20T05:11:09.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.299+0000 7ff5e8bf7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5642c8165fa0 con 0x5642c820d370 2024-08-20T05:11:09.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.299+0000 7ff5e8bf7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5642c8169fe0 con 0x5642c82013e0 2024-08-20T05:11:09.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.300+0000 7ff5dea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c8200ac0 0x5642c8200ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.300+0000 7ff5dea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c8200ac0 0x5642c8200ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49630/0 (socket says 172.21.15.37:49630) 2024-08-20T05:11:09.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.300+0000 7ff5dea00640 1 -- 172.21.15.37:0/2752303223 learned_addr learned my addr 172.21.15.37:0/2752303223 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:09.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.300+0000 7ff5df400640 1 --2- 172.21.15.37:0/2752303223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c82013e0 0x5642c820ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.300+0000 7ff5dea00640 1 --2- 172.21.15.37:0/2752303223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c820d370 0x5642c820f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.300+0000 7ff5dea00640 1 -- 172.21.15.37:0/2752303223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c82013e0 msgr2=0x5642c820ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:09.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.300+0000 7ff5dea00640 1 --2- 172.21.15.37:0/2752303223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c82013e0 0x5642c820ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.300+0000 7ff5dea00640 1 -- 172.21.15.37:0/2752303223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c820d370 msgr2=0x5642c820f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:09.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.300+0000 7ff5dea00640 1 --2- 172.21.15.37:0/2752303223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c820d370 0x5642c820f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.300+0000 7ff5dea00640 1 -- 172.21.15.37:0/2752303223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642c810c420 con 0x5642c8200ac0 2024-08-20T05:11:09.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.300+0000 7ff5df400640 1 --2- 172.21.15.37:0/2752303223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c82013e0 0x5642c820ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:09.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.300+0000 7ff5dea00640 1 --2- 172.21.15.37:0/2752303223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c8200ac0 0x5642c8200ea0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc000c00 tx=0x7ff5cc009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51c17ba1a45c051 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:09.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.301+0000 7ff5d7e00640 1 --2- 172.21.15.37:0/1006346471 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5c40b3cf0 0x7ff5c40b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.301+0000 7ff5d7e00640 1 -- 172.21.15.37:0/1006346471 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff5d80e3860 con 0x7ff5e01134f0 2024-08-20T05:11:09.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.301+0000 7ff5df400640 1 --2- 172.21.15.37:0/1006346471 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5c40b3cf0 0x7ff5c40b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.301+0000 7ff5cbe00640 1 -- 172.21.15.37:0/2752303223 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc044020 con 0x5642c8200ac0 2024-08-20T05:11:09.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.301+0000 7ff5cbe00640 1 -- 172.21.15.37:0/2752303223 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5cc004770 con 0x5642c8200ac0 2024-08-20T05:11:09.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.301+0000 7ff5cbe00640 1 -- 172.21.15.37:0/2752303223 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc035040 con 0x5642c8200ac0 2024-08-20T05:11:09.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.302+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/2752303223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c8200ac0 msgr2=0x5642c8200ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:09.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.302+0000 7ff5df400640 1 --2- 172.21.15.37:0/1006346471 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5c40b3cf0 0x7ff5c40b61b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x5642c81ff7d0 tx=0x7ff5d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:09.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.302+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/2752303223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c8200ac0 0x5642c8200ea0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc000c00 tx=0x7ff5cc009560 comp rx=0 tx=0).stop 2024-08-20T05:11:09.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.302+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/2752303223 shutdown_connections 2024-08-20T05:11:09.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.302+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/2752303223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c820d370 0x5642c820f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.302+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/2752303223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c82013e0 0x5642c820ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.302+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/2752303223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c8200ac0 0x5642c8200ea0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.302+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/2752303223 >> 172.21.15.37:0/2752303223 conn(0x5642c81fe8f0 msgr2=0x5642c81ffa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:09.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.302+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/2752303223 shutdown_connections 2024-08-20T05:11:09.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.302+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/2752303223 wait complete. 2024-08-20T05:11:09.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.302+0000 7ff5e8bf7740 1 -- start start 2024-08-20T05:11:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.303+0000 7ff5e8bf7740 1 Processor -- start 2024-08-20T05:11:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.303+0000 7ff5e8bf7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c8200ac0 0x5642c820cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.303+0000 7ff5e8bf7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c82013e0 0x5642c820a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.303+0000 7ff5e8bf7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c820d370 0x5642c820a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.303+0000 7ff5e8bf7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5642c7fc8700 con 0x5642c820d370 2024-08-20T05:11:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.303+0000 7ff5e8bf7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5642c8101290 con 0x5642c8200ac0 2024-08-20T05:11:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.303+0000 7ff5e8bf7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5642c820ff90 con 0x5642c82013e0 2024-08-20T05:11:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.303+0000 7ff5e8bf7740 10 client.0 _ll_register_callbacks cb 0x5642c81601c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.303+0000 7ff5dfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c820d370 0x5642c820a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.303+0000 7ff5df400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c8200ac0 0x5642c820cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.303+0000 7ff5dea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c82013e0 0x5642c820a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.303+0000 7ff5df400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c8200ac0 0x5642c820cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50818/0 (socket says 172.21.15.37:50818) 2024-08-20T05:11:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.304+0000 7ff5df400640 1 -- 172.21.15.37:0/2752397242 learned_addr learned my addr 172.21.15.37:0/2752397242 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.304+0000 7ff5dfe00640 1 -- 172.21.15.37:0/2752397242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c82013e0 msgr2=0x5642c820a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.304+0000 7ff5dfe00640 1 --2- 172.21.15.37:0/2752397242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c82013e0 0x5642c820a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.304+0000 7ff5dfe00640 1 -- 172.21.15.37:0/2752397242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c8200ac0 msgr2=0x5642c820cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.304+0000 7ff5dfe00640 1 --2- 172.21.15.37:0/2752397242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c8200ac0 0x5642c820cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.304+0000 7ff5dfe00640 1 -- 172.21.15.37:0/2752397242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642c7ec5650 con 0x5642c820d370 2024-08-20T05:11:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.304+0000 7ff5dea00640 1 --2- 172.21.15.37:0/2752397242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c82013e0 0x5642c820a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.304+0000 7ff5dfe00640 1 --2- 172.21.15.37:0/2752397242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c820d370 0x5642c820a5b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800da90 tx=0x7ff5d80a9ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fe3c32c24e427c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.304+0000 7ff5c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:11:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.304+0000 7ff5c8c00640 1 -- 172.21.15.37:0/2752397242 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8020040 con 0x5642c820d370 2024-08-20T05:11:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.304+0000 7ff5c8c00640 1 -- 172.21.15.37:0/2752397242 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff5d80a4d90 con 0x5642c820d370 2024-08-20T05:11:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.304+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/2752397242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5cc004770 con 0x5642c820d370 2024-08-20T05:11:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.305+0000 7ff5c8c00640 1 -- 172.21.15.37:0/2752397242 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7ff5d80a96c0 con 0x5642c820d370 2024-08-20T05:11:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.305+0000 7ff5e8bf7740 10 client.17247 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.305+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/2752397242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5642c821b8c0 con 0x5642c820d370 2024-08-20T05:11:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.305+0000 7ff5c8c00640 1 -- 172.21.15.37:0/2752397242 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5cc004770 con 0x5642c820d370 2024-08-20T05:11:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.305+0000 7ff5c8c00640 1 -- 172.21.15.37:0/2752397242 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7ff5d8023060 con 0x5642c820d370 2024-08-20T05:11:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.305+0000 7ff5e8bf7740 10 client.17247 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.305+0000 7ff5e8bf7740 10 client.17247 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:11:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.305+0000 7ff5e8bf7740 20 client.17247 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.305+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/2752397242 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5642c821cdd0 0x5642c821f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.305+0000 7ff5e8bf7740 4 client.17247 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.305+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/2752397242 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642c81789f0 con 0x5642c821cdd0 2024-08-20T05:11:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.306+0000 7ff5df400640 1 --2- 172.21.15.37:0/2752397242 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5642c821cdd0 0x5642c821f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.306+0000 7ff5df400640 1 --2- 172.21.15.37:0/2752397242 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5642c821cdd0 0x5642c821f210 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f60b6eaff8f5dd64 server_cookie=7ac5ba56ab842854 in_seq=0 out_seq=0 2024-08-20T05:11:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.306+0000 7ff5c8c00640 10 client.17247 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:11:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.307+0000 7ff5c8c00640 1 -- 172.21.15.37:0/2752397242 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5642c81789f0 con 0x5642c821cdd0 2024-08-20T05:11:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.307+0000 7ff5c8c00640 10 client.17247 handle_command_reply: tid=0 2024-08-20T05:11:09.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.307+0000 7ff5e8bf7740 1 client.17247 shutdown 2024-08-20T05:11:09.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.307+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/2752397242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c820d370 msgr2=0x5642c820a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:09.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.307+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/2752397242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c820d370 0x5642c820a5b0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800da90 tx=0x7ff5d80a9ce0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.307+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/2752397242 shutdown_connections 2024-08-20T05:11:09.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.307+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/2752397242 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5642c821cdd0 0x5642c821f210 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.307+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/2752397242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c820d370 0x5642c820a5b0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.307+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/2752397242 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c82013e0 0x5642c820a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.307+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/2752397242 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c8200ac0 0x5642c820cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.307+0000 7ff5c8c00640 0 client.17247 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:11:09.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.307+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/2752397242 >> 172.21.15.37:0/2752397242 conn(0x5642c81fe8f0 msgr2=0x5642c8204460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:09.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.308+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/2752397242 shutdown_connections 2024-08-20T05:11:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.308+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/2752397242 wait complete. 2024-08-20T05:11:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.308+0000 7ff5e8bf7740 20 client.17247 trim_cache size 0 max 16384 2024-08-20T05:11:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.322+0000 7ff5e8bf7740 1 Processor -- start 2024-08-20T05:11:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.322+0000 7ff5e8bf7740 1 -- start start 2024-08-20T05:11:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.322+0000 7ff5e8bf7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c8200ac0 0x5642c82190e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.322+0000 7ff5e8bf7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c82013e0 0x5642c820b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.322+0000 7ff5e8bf7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c820d370 0x5642c8224ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.322+0000 7ff5e8bf7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e01b5a10 con 0x5642c820d370 2024-08-20T05:11:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.322+0000 7ff5e8bf7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e01b7610 con 0x5642c82013e0 2024-08-20T05:11:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.322+0000 7ff5e8bf7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e01b60e0 con 0x5642c8200ac0 2024-08-20T05:11:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.322+0000 7ff5dfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c820d370 0x5642c8224ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.322+0000 7ff5dfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c820d370 0x5642c8224ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49636/0 (socket says 172.21.15.37:49636) 2024-08-20T05:11:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.322+0000 7ff5df400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c8200ac0 0x5642c82190e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.322+0000 7ff5dfe00640 1 -- 172.21.15.37:0/1777492742 learned_addr learned my addr 172.21.15.37:0/1777492742 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.323+0000 7ff5dea00640 1 --2- 172.21.15.37:0/1777492742 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c82013e0 0x5642c820b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.323+0000 7ff5dfe00640 1 -- 172.21.15.37:0/1777492742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c8200ac0 msgr2=0x5642c82190e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.323+0000 7ff5dfe00640 1 --2- 172.21.15.37:0/1777492742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c8200ac0 0x5642c82190e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.323+0000 7ff5dfe00640 1 -- 172.21.15.37:0/1777492742 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c82013e0 msgr2=0x5642c820b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.323+0000 7ff5dfe00640 1 --2- 172.21.15.37:0/1777492742 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c82013e0 0x5642c820b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.323+0000 7ff5dfe00640 1 -- 172.21.15.37:0/1777492742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642c81fe720 con 0x5642c820d370 2024-08-20T05:11:09.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.323+0000 7ff5df400640 1 --2- 172.21.15.37:0/1777492742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c8200ac0 0x5642c82190e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:09.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.323+0000 7ff5dfe00640 1 --2- 172.21.15.37:0/1777492742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c820d370 0x5642c8224ae0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80a64e0 tx=0x7ff5d80afb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f0f88fcedbf313 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:09.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.323+0000 7ff5cb400640 1 -- 172.21.15.37:0/1777492742 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8020070 con 0x5642c820d370 2024-08-20T05:11:09.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.323+0000 7ff5cb400640 1 -- 172.21.15.37:0/1777492742 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5d80afc90 con 0x5642c820d370 2024-08-20T05:11:09.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.323+0000 7ff5cb400640 1 -- 172.21.15.37:0/1777492742 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d80bfa50 con 0x5642c820d370 2024-08-20T05:11:09.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.324+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/1777492742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c820d370 msgr2=0x5642c8224ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:09.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.324+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/1777492742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c820d370 0x5642c8224ae0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff5d80a64e0 tx=0x7ff5d80afb40 comp rx=0 tx=0).stop 2024-08-20T05:11:09.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.324+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/1777492742 shutdown_connections 2024-08-20T05:11:09.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.324+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/1777492742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c820d370 0x5642c8224ae0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.324+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/1777492742 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c82013e0 0x5642c820b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.324+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/1777492742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c8200ac0 0x5642c82190e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.324+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/1777492742 >> 172.21.15.37:0/1777492742 conn(0x5642c81fe8f0 msgr2=0x5642c8205590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:09.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.324+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/1777492742 shutdown_connections 2024-08-20T05:11:09.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.324+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/1777492742 wait complete. 2024-08-20T05:11:09.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.324+0000 7ff5e8bf7740 1 -- start start 2024-08-20T05:11:09.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.325+0000 7ff5e8bf7740 1 Processor -- start 2024-08-20T05:11:09.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.325+0000 7ff5e8bf7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c8200ac0 0x5642c8215590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.325+0000 7ff5e8bf7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c82013e0 0x5642c8215b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.325+0000 7ff5e8bf7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c820d370 0x5642c8210cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.325+0000 7ff5e8bf7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e01b6ee0 con 0x5642c8200ac0 2024-08-20T05:11:09.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.325+0000 7ff5e8bf7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e01b67b0 con 0x5642c82013e0 2024-08-20T05:11:09.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.325+0000 7ff5e8bf7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e01b39f0 con 0x5642c820d370 2024-08-20T05:11:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.325+0000 7ff5e8bf7740 10 client.0 _ll_register_callbacks cb 0x7ff5d80aa230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.325+0000 7ff5df400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c8200ac0 0x5642c8215590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.326+0000 7ff5df400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c8200ac0 0x5642c8215590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49640/0 (socket says 172.21.15.37:49640) 2024-08-20T05:11:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.326+0000 7ff5df400640 1 -- 172.21.15.37:0/1829266292 learned_addr learned my addr 172.21.15.37:0/1829266292 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.326+0000 7ff5dfe00640 1 --2- 172.21.15.37:0/1829266292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c820d370 0x5642c8210cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.326+0000 7ff5dea00640 1 --2- 172.21.15.37:0/1829266292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c82013e0 0x5642c8215b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.326+0000 7ff5df400640 1 -- 172.21.15.37:0/1829266292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c820d370 msgr2=0x5642c8210cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.326+0000 7ff5df400640 1 --2- 172.21.15.37:0/1829266292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c820d370 0x5642c8210cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.326+0000 7ff5df400640 1 -- 172.21.15.37:0/1829266292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c82013e0 msgr2=0x5642c8215b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.326+0000 7ff5df400640 1 --2- 172.21.15.37:0/1829266292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c82013e0 0x5642c8215b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.326+0000 7ff5df400640 1 -- 172.21.15.37:0/1829266292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642c81ff370 con 0x5642c8200ac0 2024-08-20T05:11:09.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.326+0000 7ff5dfe00640 1 --2- 172.21.15.37:0/1829266292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c820d370 0x5642c8210cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:09.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.326+0000 7ff5df400640 1 --2- 172.21.15.37:0/1829266292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c8200ac0 0x5642c8215590 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x5642c821fa50 tx=0x7ff5d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3cb55c565ad4f25 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:09.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.326+0000 7ff5c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:11:09.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.327+0000 7ff5c8c00640 1 -- 172.21.15.37:0/1829266292 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d0005020 con 0x5642c8200ac0 2024-08-20T05:11:09.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.327+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/1829266292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5d80afc90 con 0x5642c8200ac0 2024-08-20T05:11:09.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.327+0000 7ff5c8c00640 1 -- 172.21.15.37:0/1829266292 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff5d00051c0 con 0x5642c8200ac0 2024-08-20T05:11:09.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.327+0000 7ff5c8c00640 1 -- 172.21.15.37:0/1829266292 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7ff5d00053c0 con 0x5642c8200ac0 2024-08-20T05:11:09.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.327+0000 7ff5e8bf7740 10 client.17253 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:09.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.327+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/1829266292 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5642c8287650 con 0x5642c8200ac0 2024-08-20T05:11:09.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.327+0000 7ff5c8c00640 1 -- 172.21.15.37:0/1829266292 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5d80afc90 con 0x5642c8200ac0 2024-08-20T05:11:09.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.327+0000 7ff5c8c00640 1 -- 172.21.15.37:0/1829266292 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7ff5d002b690 con 0x5642c8200ac0 2024-08-20T05:11:09.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.328+0000 7ff5e8bf7740 10 client.17253 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:09.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.328+0000 7ff5e8bf7740 10 client.17253 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:11:09.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.328+0000 7ff5e8bf7740 20 client.17253 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.328+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/1829266292 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5642c8287d70 0x5642c828a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.328+0000 7ff5e8bf7740 4 client.17253 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:11:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.328+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/1829266292 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5642c8174490 con 0x5642c8287d70 2024-08-20T05:11:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.328+0000 7ff5dea00640 1 --2- 172.21.15.37:0/1829266292 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5642c8287d70 0x5642c828a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.329+0000 7ff5dea00640 1 --2- 172.21.15.37:0/1829266292 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5642c8287d70 0x5642c828a190 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b9af2758cdc6b662 server_cookie=4d8e10191d4ec860 in_seq=0 out_seq=0 2024-08-20T05:11:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.329+0000 7ff5c8c00640 10 client.17253 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:11:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.329+0000 7ff5c8c00640 1 -- 172.21.15.37:0/1829266292 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5642c8174490 con 0x5642c8287d70 2024-08-20T05:11:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.329+0000 7ff5c8c00640 10 client.17253 handle_command_reply: tid=0 2024-08-20T05:11:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.329+0000 7ff5e8bf7740 1 client.17253 shutdown 2024-08-20T05:11:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.329+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/1829266292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c8200ac0 msgr2=0x5642c8215590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.329+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/1829266292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c8200ac0 0x5642c8215590 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x5642c821fa50 tx=0x7ff5d0017000 comp rx=0 tx=0).stop 2024-08-20T05:11:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.329+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/1829266292 shutdown_connections 2024-08-20T05:11:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.329+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/1829266292 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5642c8287d70 0x5642c828a190 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.329+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/1829266292 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5642c820d370 0x5642c8210cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.329+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/1829266292 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5642c82013e0 0x5642c8215b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.329+0000 7ff5e8bf7740 1 --2- 172.21.15.37:0/1829266292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5642c8200ac0 0x5642c8215590 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.329+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/1829266292 >> 172.21.15.37:0/1829266292 conn(0x5642c81fe8f0 msgr2=0x5642c82088b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:09.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.329+0000 7ff5c8c00640 0 client.17253 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:11:09.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.329+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/1829266292 shutdown_connections 2024-08-20T05:11:09.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.329+0000 7ff5e8bf7740 1 -- 172.21.15.37:0/1829266292 wait complete. 2024-08-20T05:11:09.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.330+0000 7ff5e8bf7740 20 client.17253 trim_cache size 0 max 16384 2024-08-20T05:11:09.349 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:11:09.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.330+0000 7ff5e4a00640 1 -- 172.21.15.37:0/1006346471 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5c40b3cf0 msgr2=0x7ff5c40b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:09.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.330+0000 7ff5e4a00640 1 --2- 172.21.15.37:0/1006346471 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5c40b3cf0 0x7ff5c40b61b0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x5642c81ff7d0 tx=0x7ff5d0005f90 comp rx=0 tx=0).stop 2024-08-20T05:11:09.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.330+0000 7ff5e4a00640 1 -- 172.21.15.37:0/1006346471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e01134f0 msgr2=0x7ff5e01a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:09.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.330+0000 7ff5e4a00640 1 --2- 172.21.15.37:0/1006346471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e01134f0 0x7ff5e01a4c10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800dac0 tx=0x7ff5d800df80 comp rx=0 tx=0).stop 2024-08-20T05:11:09.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.330+0000 7ff5e4a00640 1 -- 172.21.15.37:0/1006346471 shutdown_connections 2024-08-20T05:11:09.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.330+0000 7ff5e4a00640 1 --2- 172.21.15.37:0/1006346471 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff5c40b3cf0 0x7ff5c40b61b0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.330+0000 7ff5e4a00640 1 --2- 172.21.15.37:0/1006346471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e01134f0 0x7ff5e01a4c10 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.330+0000 7ff5e4a00640 1 --2- 172.21.15.37:0/1006346471 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff5e0077d20 0x7ff5e019f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.330+0000 7ff5e4a00640 1 --2- 172.21.15.37:0/1006346471 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff5e0077400 0x7ff5e019f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:09.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.330+0000 7ff5e4a00640 1 -- 172.21.15.37:0/1006346471 >> 172.21.15.37:0/1006346471 conn(0x7ff5e0100550 msgr2=0x7ff5e0102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:09.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.331+0000 7ff5e4a00640 1 -- 172.21.15.37:0/1006346471 shutdown_connections 2024-08-20T05:11:09.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:09.331+0000 7ff5e4a00640 1 -- 172.21.15.37:0/1006346471 wait complete. 2024-08-20T05:11:09.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:09 smithi037 ceph-mon[17265]: pgmap v668: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.4 MiB/s wr, 235 op/s 2024-08-20T05:11:09.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:09 smithi135 ceph-mon[22342]: pgmap v668: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.4 MiB/s wr, 235 op/s 2024-08-20T05:11:09.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:09 smithi130 ceph-mon[22007]: pgmap v668: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.4 MiB/s wr, 235 op/s 2024-08-20T05:11:10.409 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T05:11:10.789 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.369+0000 7fc3bee00640 1 -- 172.21.15.37:0/3330484889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3b810eaf0 msgr2=0x7fc3b810ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.369+0000 7fc3bee00640 1 --2- 172.21.15.37:0/3330484889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3b810eaf0 0x7fc3b810ef30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009900 tx=0x7fc3a402a410 comp rx=0 tx=0).stop 2024-08-20T05:11:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.369+0000 7fc3bee00640 1 -- 172.21.15.37:0/3330484889 shutdown_connections 2024-08-20T05:11:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.369+0000 7fc3bee00640 1 --2- 172.21.15.37:0/3330484889 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3b810f470 0x7fc3b8115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.369+0000 7fc3bee00640 1 --2- 172.21.15.37:0/3330484889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3b810eaf0 0x7fc3b810ef30 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.369+0000 7fc3bee00640 1 --2- 172.21.15.37:0/3330484889 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3b81090e0 0x7fc3b81094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.369+0000 7fc3bee00640 1 -- 172.21.15.37:0/3330484889 >> 172.21.15.37:0/3330484889 conn(0x7fc3b8078760 msgr2=0x7fc3b807ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.369+0000 7fc3bee00640 1 -- 172.21.15.37:0/3330484889 shutdown_connections 2024-08-20T05:11:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.370+0000 7fc3bee00640 1 -- 172.21.15.37:0/3330484889 wait complete. 2024-08-20T05:11:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.370+0000 7fc3bee00640 1 Processor -- start 2024-08-20T05:11:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.371+0000 7fc3bee00640 1 -- start start 2024-08-20T05:11:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.371+0000 7fc3bee00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3b81090e0 0x7fc3b819f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.371+0000 7fc3bee00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3b810eaf0 0x7fc3b819fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.371+0000 7fc3bee00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3b810f470 0x7fc3b81a4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.371+0000 7fc3bee00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b81190f0 con 0x7fc3b810f470 2024-08-20T05:11:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.371+0000 7fc3bee00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8118f70 con 0x7fc3b81090e0 2024-08-20T05:11:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.371+0000 7fc3bee00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b8119270 con 0x7fc3b810eaf0 2024-08-20T05:11:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.371+0000 7fc3bce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3b810f470 0x7fc3b81a4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.371+0000 7fc3bce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3b810f470 0x7fc3b81a4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49656/0 (socket says 172.21.15.37:49656) 2024-08-20T05:11:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.371+0000 7fc3bce00640 1 -- 172.21.15.37:0/2902793397 learned_addr learned my addr 172.21.15.37:0/2902793397 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.371+0000 7fc3b7400640 1 --2- 172.21.15.37:0/2902793397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3b810eaf0 0x7fc3b819fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.371+0000 7fc3b7e00640 1 --2- 172.21.15.37:0/2902793397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3b81090e0 0x7fc3b819f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.372+0000 7fc3bce00640 1 -- 172.21.15.37:0/2902793397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3b810eaf0 msgr2=0x7fc3b819fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.372+0000 7fc3bce00640 1 --2- 172.21.15.37:0/2902793397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3b810eaf0 0x7fc3b819fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.372+0000 7fc3bce00640 1 -- 172.21.15.37:0/2902793397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3b81090e0 msgr2=0x7fc3b819f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.372+0000 7fc3bce00640 1 --2- 172.21.15.37:0/2902793397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3b81090e0 0x7fc3b819f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.372+0000 7fc3bce00640 1 -- 172.21.15.37:0/2902793397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b81a56f0 con 0x7fc3b810f470 2024-08-20T05:11:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.372+0000 7fc3bce00640 1 --2- 172.21.15.37:0/2902793397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3b810f470 0x7fc3b81a4f20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000eb10 tx=0x7fc3b000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.372+0000 7fc3b4c00640 1 -- 172.21.15.37:0/2902793397 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0004b20 con 0x7fc3b810f470 2024-08-20T05:11:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.372+0000 7fc3b4c00640 1 -- 172.21.15.37:0/2902793397 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3b0004cc0 con 0x7fc3b810f470 2024-08-20T05:11:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.372+0000 7fc3b4c00640 1 -- 172.21.15.37:0/2902793397 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b0010670 con 0x7fc3b810f470 2024-08-20T05:11:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.372+0000 7fc3bee00640 1 -- 172.21.15.37:0/2902793397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b81a59e0 con 0x7fc3b810f470 2024-08-20T05:11:11.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.372+0000 7fc3bee00640 1 -- 172.21.15.37:0/2902793397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b81ac0a0 con 0x7fc3b810f470 2024-08-20T05:11:11.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.377+0000 7fc3c1a58740 1 Processor -- start 2024-08-20T05:11:11.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.377+0000 7fc3b4c00640 1 -- 172.21.15.37:0/2902793397 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc3b0005020 con 0x7fc3b810f470 2024-08-20T05:11:11.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.377+0000 7fc3c1a58740 1 -- start start 2024-08-20T05:11:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.378+0000 7fc3c1a58740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 0x55e7872bed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.378+0000 7fc3c1a58740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872bf260 0x55e7872cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.378+0000 7fc3c1a58740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.378+0000 7fc3c1a58740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e787234aa0 con 0x55e7872cb1f0 2024-08-20T05:11:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.378+0000 7fc3c1a58740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e787223fa0 con 0x55e7872bf260 2024-08-20T05:11:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.378+0000 7fc3c1a58740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e787227fe0 con 0x55e7872be940 2024-08-20T05:11:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.378+0000 7fc3b7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872bf260 0x55e7872cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.378+0000 7fc3b7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872bf260 0x55e7872cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50872/0 (socket says 172.21.15.37:50872) 2024-08-20T05:11:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.378+0000 7fc3b7e00640 1 -- 172.21.15.37:0/2801156408 learned_addr learned my addr 172.21.15.37:0/2801156408 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.378+0000 7fc3b7400640 1 --2- 172.21.15.37:0/2801156408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.378+0000 7fc3b7400640 1 --2- 172.21.15.37:0/2801156408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 0x55e7872bed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.379+0000 7fc3b7e00640 1 -- 172.21.15.37:0/2801156408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 msgr2=0x55e7872bed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.379+0000 7fc3b7e00640 1 --2- 172.21.15.37:0/2801156408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 0x55e7872bed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.379+0000 7fc3b7e00640 1 -- 172.21.15.37:0/2801156408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 msgr2=0x55e7872cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.379+0000 7fc3b7e00640 1 --2- 172.21.15.37:0/2801156408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.379+0000 7fc3b7e00640 1 -- 172.21.15.37:0/2801156408 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7871ca420 con 0x55e7872bf260 2024-08-20T05:11:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.379+0000 7fc3b7e00640 1 --2- 172.21.15.37:0/2801156408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872bf260 0x55e7872cacb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8009cf0 tx=0x7fc3a8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1df9913edf77999c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.379+0000 7fc3b4c00640 1 --2- 172.21.15.37:0/2902793397 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc39c0b3bd0 0x7fc39c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.379+0000 7fc3ad600640 1 -- 172.21.15.37:0/2801156408 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8004230 con 0x55e7872bf260 2024-08-20T05:11:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.379+0000 7fc3ad600640 1 -- 172.21.15.37:0/2801156408 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3a80043d0 con 0x55e7872bf260 2024-08-20T05:11:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.379+0000 7fc3ad600640 1 -- 172.21.15.37:0/2801156408 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a80197c0 con 0x55e7872bf260 2024-08-20T05:11:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.380+0000 7fc3b4c00640 1 -- 172.21.15.37:0/2902793397 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc3b00e44b0 con 0x7fc3b810f470 2024-08-20T05:11:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.380+0000 7fc3b7400640 1 --2- 172.21.15.37:0/2902793397 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc39c0b3bd0 0x7fc39c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.380+0000 7fc3c1a58740 1 -- 172.21.15.37:0/2801156408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872bf260 msgr2=0x55e7872cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.380+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/2801156408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872bf260 0x55e7872cacb0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8009cf0 tx=0x7fc3a8011810 comp rx=0 tx=0).stop 2024-08-20T05:11:11.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.380+0000 7fc3b7400640 1 --2- 172.21.15.37:0/2902793397 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc39c0b3bd0 0x7fc39c0b6090 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4005ab0 tx=0x7fc3a4041040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:11.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.380+0000 7fc3c1a58740 1 -- 172.21.15.37:0/2801156408 shutdown_connections 2024-08-20T05:11:11.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.380+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/2801156408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.380+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/2801156408 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872bf260 0x55e7872cacb0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.380+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/2801156408 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 0x55e7872bed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.380+0000 7fc3c1a58740 1 -- 172.21.15.37:0/2801156408 >> 172.21.15.37:0/2801156408 conn(0x55e7872bc770 msgr2=0x55e7872bd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:11.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.381+0000 7fc3c1a58740 1 -- 172.21.15.37:0/2801156408 shutdown_connections 2024-08-20T05:11:11.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.381+0000 7fc3c1a58740 1 -- 172.21.15.37:0/2801156408 wait complete. 2024-08-20T05:11:11.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.381+0000 7fc3c1a58740 1 -- start start 2024-08-20T05:11:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.381+0000 7fc3c1a58740 1 Processor -- start 2024-08-20T05:11:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.382+0000 7fc3c1a58740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 0x55e7872ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.382+0000 7fc3c1a58740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872bf260 0x55e7872c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.382+0000 7fc3c1a58740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872c8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.382+0000 7fc3c1a58740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e787086700 con 0x55e7872cb1f0 2024-08-20T05:11:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.382+0000 7fc3c1a58740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e7871bf290 con 0x55e7872bf260 2024-08-20T05:11:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.382+0000 7fc3c1a58740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e7872cde70 con 0x55e7872be940 2024-08-20T05:11:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.382+0000 7fc3c1a58740 10 client.0 _ll_register_callbacks cb 0x55e78721e1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.382+0000 7fc3b7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 0x55e7872ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.382+0000 7fc3b7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 0x55e7872ca8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57858/0 (socket says 172.21.15.37:57858) 2024-08-20T05:11:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.382+0000 7fc3bce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.382+0000 7fc3b7e00640 1 -- 172.21.15.37:0/4024091033 learned_addr learned my addr 172.21.15.37:0/4024091033 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.382+0000 7fc3b7400640 1 --2- 172.21.15.37:0/4024091033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872bf260 0x55e7872c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.383+0000 7fc3b7e00640 1 -- 172.21.15.37:0/4024091033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872bf260 msgr2=0x55e7872c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.383+0000 7fc3b7e00640 1 --2- 172.21.15.37:0/4024091033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872bf260 0x55e7872c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.383+0000 7fc3b7e00640 1 -- 172.21.15.37:0/4024091033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 msgr2=0x55e7872c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.383+0000 7fc3b7e00640 1 --2- 172.21.15.37:0/4024091033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.383+0000 7fc3b7e00640 1 -- 172.21.15.37:0/4024091033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e786f83650 con 0x55e7872be940 2024-08-20T05:11:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.383+0000 7fc3bce00640 1 --2- 172.21.15.37:0/4024091033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.383+0000 7fc3b7e00640 1 --2- 172.21.15.37:0/4024091033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 0x55e7872ca8c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc3a801b040 tx=0x7fc3a8003880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90b6bf4bd8b98ff4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.383+0000 7fc3a2000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:11:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.383+0000 7fc3a2000640 1 -- 172.21.15.37:0/4024091033 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a8027070 con 0x55e7872be940 2024-08-20T05:11:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.383+0000 7fc3c1a58740 1 -- 172.21.15.37:0/4024091033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3a80043d0 con 0x55e7872be940 2024-08-20T05:11:11.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.383+0000 7fc3a2000640 1 -- 172.21.15.37:0/4024091033 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc3a8005240 con 0x55e7872be940 2024-08-20T05:11:11.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.384+0000 7fc3a2000640 1 -- 172.21.15.37:0/4024091033 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fc3a8033050 con 0x55e7872be940 2024-08-20T05:11:11.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.384+0000 7fc3c1a58740 10 client.27736 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:11.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.384+0000 7fc3c1a58740 1 -- 172.21.15.37:0/4024091033 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55e7872d95b0 con 0x55e7872be940 2024-08-20T05:11:11.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.384+0000 7fc3a2000640 1 -- 172.21.15.37:0/4024091033 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3a80043d0 con 0x55e7872be940 2024-08-20T05:11:11.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.384+0000 7fc3a2000640 1 -- 172.21.15.37:0/4024091033 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7fc3a8004b70 con 0x55e7872be940 2024-08-20T05:11:11.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.384+0000 7fc3c1a58740 10 client.27736 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:11.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.384+0000 7fc3c1a58740 10 client.27736 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:11:11.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.385+0000 7fc3c1a58740 20 client.27736 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:11.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.385+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/4024091033 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55e7872dabb0 0x55e7872dd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.385+0000 7fc3c1a58740 4 client.27736 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:11.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.385+0000 7fc3c1a58740 1 -- 172.21.15.37:0/4024091033 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7872369f0 con 0x55e7872dabb0 2024-08-20T05:11:11.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.385+0000 7fc3b7400640 1 --2- 172.21.15.37:0/4024091033 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55e7872dabb0 0x55e7872dd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.386+0000 7fc3b7400640 1 --2- 172.21.15.37:0/4024091033 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55e7872dabb0 0x55e7872dd000 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3c55f9fd6fc7bcf7 server_cookie=3e7877bb34185214 in_seq=0 out_seq=0 2024-08-20T05:11:11.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.386+0000 7fc3a2000640 10 client.27736 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:11:11.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.386+0000 7fc3a2000640 1 -- 172.21.15.37:0/4024091033 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7872369f0 con 0x55e7872dabb0 2024-08-20T05:11:11.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.386+0000 7fc3a2000640 10 client.27736 handle_command_reply: tid=0 2024-08-20T05:11:11.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.386+0000 7fc3c1a58740 1 client.27736 shutdown 2024-08-20T05:11:11.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.387+0000 7fc3c1a58740 1 -- 172.21.15.37:0/4024091033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 msgr2=0x55e7872ca8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.387+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/4024091033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 0x55e7872ca8c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc3a801b040 tx=0x7fc3a8003880 comp rx=0 tx=0).stop 2024-08-20T05:11:11.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.387+0000 7fc3c1a58740 1 -- 172.21.15.37:0/4024091033 shutdown_connections 2024-08-20T05:11:11.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.387+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/4024091033 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55e7872dabb0 0x55e7872dd000 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.387+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/4024091033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.387+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/4024091033 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872bf260 0x55e7872c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.387+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/4024091033 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 0x55e7872ca8c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.387+0000 7fc3a2000640 0 client.27736 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:11:11.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.387+0000 7fc3c1a58740 1 -- 172.21.15.37:0/4024091033 >> 172.21.15.37:0/4024091033 conn(0x55e7872bc770 msgr2=0x55e7872c22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:11.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.387+0000 7fc3c1a58740 1 -- 172.21.15.37:0/4024091033 shutdown_connections 2024-08-20T05:11:11.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.387+0000 7fc3c1a58740 1 -- 172.21.15.37:0/4024091033 wait complete. 2024-08-20T05:11:11.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.387+0000 7fc3c1a58740 20 client.27736 trim_cache size 0 max 16384 2024-08-20T05:11:11.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.401+0000 7fc3c1a58740 1 Processor -- start 2024-08-20T05:11:11.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.401+0000 7fc3c1a58740 1 -- start start 2024-08-20T05:11:11.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.401+0000 7fc3c1a58740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 0x55e7872bb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.401+0000 7fc3c1a58740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872bf260 0x55e7872bbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.401+0000 7fc3c1a58740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872e2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.401+0000 7fc3c1a58740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b81b5e40 con 0x55e7872cb1f0 2024-08-20T05:11:11.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.401+0000 7fc3c1a58740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b81b7a40 con 0x55e7872bf260 2024-08-20T05:11:11.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.401+0000 7fc3c1a58740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b81b6510 con 0x55e7872be940 2024-08-20T05:11:11.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.402+0000 7fc3b7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 0x55e7872bb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.402+0000 7fc3bce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872e2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.402+0000 7fc3b7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872bf260 0x55e7872bbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.402+0000 7fc3b7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 0x55e7872bb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57870/0 (socket says 172.21.15.37:57870) 2024-08-20T05:11:11.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.402+0000 7fc3b7e00640 1 -- 172.21.15.37:0/998247523 learned_addr learned my addr 172.21.15.37:0/998247523 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:11.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.402+0000 7fc3bce00640 1 -- 172.21.15.37:0/998247523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 msgr2=0x55e7872bb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:11.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.402+0000 7fc3bce00640 1 --2- 172.21.15.37:0/998247523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 0x55e7872bb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.402+0000 7fc3bce00640 1 -- 172.21.15.37:0/998247523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872bf260 msgr2=0x55e7872bbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:11.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.402+0000 7fc3bce00640 1 --2- 172.21.15.37:0/998247523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872bf260 0x55e7872bbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.402+0000 7fc3bce00640 1 -- 172.21.15.37:0/998247523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7872c7ac0 con 0x55e7872cb1f0 2024-08-20T05:11:11.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.402+0000 7fc3bce00640 1 --2- 172.21.15.37:0/998247523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872e2910 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00e1bb0 tx=0x7fc3b00aa950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32eeb74ce0f309 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:11.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.402+0000 7fc3acc00640 1 -- 172.21.15.37:0/998247523 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b00c4070 con 0x55e7872cb1f0 2024-08-20T05:11:11.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.403+0000 7fc3acc00640 1 -- 172.21.15.37:0/998247523 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3b00ab700 con 0x55e7872cb1f0 2024-08-20T05:11:11.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.403+0000 7fc3acc00640 1 -- 172.21.15.37:0/998247523 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3b00ab4c0 con 0x55e7872cb1f0 2024-08-20T05:11:11.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.403+0000 7fc3c1a58740 1 -- 172.21.15.37:0/998247523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 msgr2=0x55e7872e2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.403+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/998247523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872e2910 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00e1bb0 tx=0x7fc3b00aa950 comp rx=0 tx=0).stop 2024-08-20T05:11:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.403+0000 7fc3c1a58740 1 -- 172.21.15.37:0/998247523 shutdown_connections 2024-08-20T05:11:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.403+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/998247523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872e2910 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.403+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/998247523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872bf260 0x55e7872bbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.403+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/998247523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872be940 0x55e7872bb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.403+0000 7fc3c1a58740 1 -- 172.21.15.37:0/998247523 >> 172.21.15.37:0/998247523 conn(0x55e7872bc770 msgr2=0x55e7872bb030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.403+0000 7fc3c1a58740 1 -- 172.21.15.37:0/998247523 shutdown_connections 2024-08-20T05:11:11.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.403+0000 7fc3c1a58740 1 -- 172.21.15.37:0/998247523 wait complete. 2024-08-20T05:11:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.404+0000 7fc3c1a58740 1 -- start start 2024-08-20T05:11:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.404+0000 7fc3c1a58740 1 Processor -- start 2024-08-20T05:11:11.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.404+0000 7fc3c1a58740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872be940 0x55e7872d3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.404+0000 7fc3c1a58740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872bf260 0x55e7872d3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.404+0000 7fc3c1a58740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872c46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.404+0000 7fc3c1a58740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b81b7310 con 0x55e7872cb1f0 2024-08-20T05:11:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.404+0000 7fc3c1a58740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b81b6be0 con 0x55e7872be940 2024-08-20T05:11:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.404+0000 7fc3c1a58740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b81b3e20 con 0x55e7872bf260 2024-08-20T05:11:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.405+0000 7fc3c1a58740 10 client.0 _ll_register_callbacks cb 0x7fc3b00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.405+0000 7fc3b7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872be940 0x55e7872d3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.405+0000 7fc3b7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872bf260 0x55e7872d3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.405+0000 7fc3bce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872c46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.405+0000 7fc3b7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872be940 0x55e7872d3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50890/0 (socket says 172.21.15.37:50890) 2024-08-20T05:11:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.405+0000 7fc3b7e00640 1 -- 172.21.15.37:0/1435237052 learned_addr learned my addr 172.21.15.37:0/1435237052 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.405+0000 7fc3b7e00640 1 -- 172.21.15.37:0/1435237052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872bf260 msgr2=0x55e7872d3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:11.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.405+0000 7fc3b7e00640 1 --2- 172.21.15.37:0/1435237052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872bf260 0x55e7872d3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.405+0000 7fc3b7e00640 1 -- 172.21.15.37:0/1435237052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 msgr2=0x55e7872c46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.405+0000 7fc3b7e00640 1 --2- 172.21.15.37:0/1435237052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872c46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.405+0000 7fc3b7e00640 1 -- 172.21.15.37:0/1435237052 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7872c4ed0 con 0x55e7872be940 2024-08-20T05:11:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.405+0000 7fc3b7e00640 1 --2- 172.21.15.37:0/1435237052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872be940 0x55e7872d3310 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8000c00 tx=0x7fc3a8019810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cded4c57f4ac7d28 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.405+0000 7fc3a2000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:11:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.406+0000 7fc3a2000640 1 -- 172.21.15.37:0/1435237052 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3a803c060 con 0x55e7872be940 2024-08-20T05:11:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.406+0000 7fc3a2000640 1 -- 172.21.15.37:0/1435237052 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc3a8004fa0 con 0x55e7872be940 2024-08-20T05:11:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.406+0000 7fc3c1a58740 1 -- 172.21.15.37:0/1435237052 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3b00ab700 con 0x55e7872be940 2024-08-20T05:11:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.406+0000 7fc3a2000640 1 -- 172.21.15.37:0/1435237052 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fc3a8043050 con 0x55e7872be940 2024-08-20T05:11:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.406+0000 7fc3c1a58740 10 client.27746 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.406+0000 7fc3c1a58740 1 -- 172.21.15.37:0/1435237052 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55e787345480 con 0x55e7872be940 2024-08-20T05:11:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.406+0000 7fc3a2000640 1 -- 172.21.15.37:0/1435237052 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc3b00ab700 con 0x55e7872be940 2024-08-20T05:11:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.406+0000 7fc3a2000640 1 -- 172.21.15.37:0/1435237052 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7fc3a8023460 con 0x55e7872be940 2024-08-20T05:11:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.406+0000 7fc3c1a58740 10 client.27746 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:11.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.406+0000 7fc3c1a58740 10 client.27746 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:11:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.406+0000 7fc3c1a58740 20 client.27746 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.407+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/1435237052 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55e787345ae0 0x55e787347f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.407+0000 7fc3c1a58740 4 client.27746 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:11:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.407+0000 7fc3c1a58740 1 -- 172.21.15.37:0/1435237052 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e787232490 con 0x55e787345ae0 2024-08-20T05:11:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.407+0000 7fc3b7400640 1 --2- 172.21.15.37:0/1435237052 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55e787345ae0 0x55e787347f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.407+0000 7fc3b7400640 1 --2- 172.21.15.37:0/1435237052 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55e787345ae0 0x55e787347f00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c7f60c8c358ea211 server_cookie=1b83a32c508d4e3d in_seq=0 out_seq=0 2024-08-20T05:11:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.407+0000 7fc3a2000640 10 client.27746 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:11:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.408+0000 7fc3a2000640 1 -- 172.21.15.37:0/1435237052 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e787232490 con 0x55e787345ae0 2024-08-20T05:11:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.408+0000 7fc3a2000640 10 client.27746 handle_command_reply: tid=0 2024-08-20T05:11:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.408+0000 7fc3c1a58740 1 client.27746 shutdown 2024-08-20T05:11:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.408+0000 7fc3c1a58740 1 -- 172.21.15.37:0/1435237052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872be940 msgr2=0x55e7872d3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.408+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/1435237052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872be940 0x55e7872d3310 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8000c00 tx=0x7fc3a8019810 comp rx=0 tx=0).stop 2024-08-20T05:11:11.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.408+0000 7fc3c1a58740 1 -- 172.21.15.37:0/1435237052 shutdown_connections 2024-08-20T05:11:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.408+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/1435237052 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55e787345ae0 0x55e787347f00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.408+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/1435237052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7872cb1f0 0x55e7872c46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.408+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/1435237052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7872bf260 0x55e7872d3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.408+0000 7fc3c1a58740 1 --2- 172.21.15.37:0/1435237052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7872be940 0x55e7872d3310 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.408+0000 7fc3a2000640 0 client.27746 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:11:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.408+0000 7fc3c1a58740 1 -- 172.21.15.37:0/1435237052 >> 172.21.15.37:0/1435237052 conn(0x55e7872bc770 msgr2=0x55e7872bb850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.408+0000 7fc3c1a58740 1 -- 172.21.15.37:0/1435237052 shutdown_connections 2024-08-20T05:11:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.408+0000 7fc3c1a58740 1 -- 172.21.15.37:0/1435237052 wait complete. 2024-08-20T05:11:11.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.408+0000 7fc3c1a58740 20 client.27746 trim_cache size 0 max 16384 2024-08-20T05:11:11.414 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:11:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.409+0000 7fc3bee00640 1 -- 172.21.15.37:0/2902793397 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc39c0b3bd0 msgr2=0x7fc39c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.409+0000 7fc3bee00640 1 --2- 172.21.15.37:0/2902793397 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc39c0b3bd0 0x7fc39c0b6090 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4005ab0 tx=0x7fc3a4041040 comp rx=0 tx=0).stop 2024-08-20T05:11:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.409+0000 7fc3bee00640 1 -- 172.21.15.37:0/2902793397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3b810f470 msgr2=0x7fc3b81a4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.409+0000 7fc3bee00640 1 --2- 172.21.15.37:0/2902793397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3b810f470 0x7fc3b81a4f20 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc3b000eb10 tx=0x7fc3b000c2d0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.409+0000 7fc3bee00640 1 -- 172.21.15.37:0/2902793397 shutdown_connections 2024-08-20T05:11:11.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.409+0000 7fc3bee00640 1 --2- 172.21.15.37:0/2902793397 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc39c0b3bd0 0x7fc39c0b6090 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.409+0000 7fc3bee00640 1 --2- 172.21.15.37:0/2902793397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3b810f470 0x7fc3b81a4f20 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.409+0000 7fc3bee00640 1 --2- 172.21.15.37:0/2902793397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc3b810eaf0 0x7fc3b819fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.409+0000 7fc3bee00640 1 --2- 172.21.15.37:0/2902793397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc3b81090e0 0x7fc3b819f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.409+0000 7fc3bee00640 1 -- 172.21.15.37:0/2902793397 >> 172.21.15.37:0/2902793397 conn(0x7fc3b8078760 msgr2=0x7fc3b807ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.409+0000 7fc3bee00640 1 -- 172.21.15.37:0/2902793397 shutdown_connections 2024-08-20T05:11:11.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:11.409+0000 7fc3bee00640 1 -- 172.21.15.37:0/2902793397 wait complete. 2024-08-20T05:11:11.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:11 smithi037 ceph-mon[17265]: pgmap v669: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.3 MiB/s wr, 172 op/s 2024-08-20T05:11:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.628+0000 7fb7f1a00640 1 -- 172.21.15.37:0/1267063824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ec077750 msgr2=0x7fb7ec077b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.628+0000 7fb7f1a00640 1 --2- 172.21.15.37:0/1267063824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ec077750 0x7fb7ec077b50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009900 tx=0x7fb7dc02a410 comp rx=0 tx=0).stop 2024-08-20T05:11:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.628+0000 7fb7f1a00640 1 -- 172.21.15.37:0/1267063824 shutdown_connections 2024-08-20T05:11:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.628+0000 7fb7f1a00640 1 --2- 172.21.15.37:0/1267063824 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7ec079260 0x7fb7ec079bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.628+0000 7fb7f1a00640 1 --2- 172.21.15.37:0/1267063824 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7ec0788a0 0x7fb7ec078d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.628+0000 7fb7f1a00640 1 --2- 172.21.15.37:0/1267063824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ec077750 0x7fb7ec077b50 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.628+0000 7fb7f1a00640 1 -- 172.21.15.37:0/1267063824 >> 172.21.15.37:0/1267063824 conn(0x7fb7ec100130 msgr2=0x7fb7ec102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.628+0000 7fb7f1a00640 1 -- 172.21.15.37:0/1267063824 shutdown_connections 2024-08-20T05:11:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.628+0000 7fb7f1a00640 1 -- 172.21.15.37:0/1267063824 wait complete. 2024-08-20T05:11:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.629+0000 7fb7f1a00640 1 Processor -- start 2024-08-20T05:11:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.629+0000 7fb7f1a00640 1 -- start start 2024-08-20T05:11:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.630+0000 7fb7f1a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7ec077750 0x7fb7ec19f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.630+0000 7fb7f1a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7ec0788a0 0x7fb7ec19f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.630+0000 7fb7f1a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ec079260 0x7fb7ec1a0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.630+0000 7fb7f1a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec114940 con 0x7fb7ec079260 2024-08-20T05:11:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.630+0000 7fb7f1a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec1147c0 con 0x7fb7ec0788a0 2024-08-20T05:11:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.630+0000 7fb7f1a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec114ac0 con 0x7fb7ec077750 2024-08-20T05:11:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.630+0000 7fb7eb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ec079260 0x7fb7ec1a0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.630+0000 7fb7eaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7ec077750 0x7fb7ec19f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.630+0000 7fb7eb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ec079260 0x7fb7ec1a0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49702/0 (socket says 172.21.15.37:49702) 2024-08-20T05:11:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.630+0000 7fb7eb400640 1 -- 172.21.15.37:0/996389959 learned_addr learned my addr 172.21.15.37:0/996389959 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.630+0000 7fb7e2000640 1 --2- 172.21.15.37:0/996389959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7ec0788a0 0x7fb7ec19f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.630+0000 7fb7eb400640 1 -- 172.21.15.37:0/996389959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7ec077750 msgr2=0x7fb7ec19f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.630+0000 7fb7eb400640 1 --2- 172.21.15.37:0/996389959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7ec077750 0x7fb7ec19f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.631+0000 7fb7eb400640 1 -- 172.21.15.37:0/996389959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7ec0788a0 msgr2=0x7fb7ec19f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.631+0000 7fb7eb400640 1 --2- 172.21.15.37:0/996389959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7ec0788a0 0x7fb7ec19f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.631+0000 7fb7eb400640 1 -- 172.21.15.37:0/996389959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ec1a0c10 con 0x7fb7ec079260 2024-08-20T05:11:11.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.631+0000 7fb7eb400640 1 --2- 172.21.15.37:0/996389959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ec079260 0x7fb7ec1a0350 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400efd0 tx=0x7fb7e400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:11.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.631+0000 7fb7e3e00640 1 -- 172.21.15.37:0/996389959 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4003b70 con 0x7fb7ec079260 2024-08-20T05:11:11.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.631+0000 7fb7e3e00640 1 -- 172.21.15.37:0/996389959 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7e4003d10 con 0x7fb7ec079260 2024-08-20T05:11:11.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.631+0000 7fb7e3e00640 1 -- 172.21.15.37:0/996389959 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e40108a0 con 0x7fb7ec079260 2024-08-20T05:11:11.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.631+0000 7fb7f1a00640 1 -- 172.21.15.37:0/996389959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7ec1a0f00 con 0x7fb7ec079260 2024-08-20T05:11:11.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.631+0000 7fb7f1a00640 1 -- 172.21.15.37:0/996389959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7ec1a75d0 con 0x7fb7ec079260 2024-08-20T05:11:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.635+0000 7fb7f4a6d740 1 Processor -- start 2024-08-20T05:11:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.635+0000 7fb7e3e00640 1 -- 172.21.15.37:0/996389959 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb7e4004020 con 0x7fb7ec079260 2024-08-20T05:11:11.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.635+0000 7fb7f4a6d740 1 -- start start 2024-08-20T05:11:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.635+0000 7fb7f4a6d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d262b0 0x5569c9d286a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.635+0000 7fb7f4a6d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d28be0 0x5569c9d2afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.635+0000 7fb7f4a6d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d2b620 0x5569c9d2dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.635+0000 7fb7f4a6d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5569c9c99210 con 0x5569c9d2b620 2024-08-20T05:11:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.635+0000 7fb7f4a6d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5569c9c88710 con 0x5569c9d262b0 2024-08-20T05:11:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.635+0000 7fb7f4a6d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5569c9c8c750 con 0x5569c9d28be0 2024-08-20T05:11:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.636+0000 7fb7e2000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d262b0 0x5569c9d286a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.636+0000 7fb7e2000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d262b0 0x5569c9d286a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50924/0 (socket says 172.21.15.37:50924) 2024-08-20T05:11:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.636+0000 7fb7eaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d28be0 0x5569c9d2afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.636+0000 7fb7e2000640 1 -- 172.21.15.37:0/2448068270 learned_addr learned my addr 172.21.15.37:0/2448068270 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:11.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.636+0000 7fb7e2000640 1 --2- 172.21.15.37:0/2448068270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d2b620 0x5569c9d2dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.636+0000 7fb7eaa00640 1 -- 172.21.15.37:0/2448068270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d262b0 msgr2=0x5569c9d286a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:11.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.636+0000 7fb7eaa00640 1 --2- 172.21.15.37:0/2448068270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d262b0 0x5569c9d286a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.636+0000 7fb7eaa00640 1 -- 172.21.15.37:0/2448068270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d2b620 msgr2=0x5569c9d2dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:11.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.636+0000 7fb7eaa00640 1 --2- 172.21.15.37:0/2448068270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d2b620 0x5569c9d2dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.636+0000 7fb7eaa00640 1 -- 172.21.15.37:0/2448068270 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569c9c54de0 con 0x5569c9d28be0 2024-08-20T05:11:11.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.637+0000 7fb7eaa00640 1 --2- 172.21.15.37:0/2448068270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d28be0 0x5569c9d2afd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc02aa00 tx=0x7fb7dc005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26f0000b91669110 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:11.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.637+0000 7fb7e3e00640 1 --2- 172.21.15.37:0/996389959 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb7d00b3c50 0x7fb7d00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.637+0000 7fb7e3e00640 1 -- 172.21.15.37:0/996389959 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb7e40e43a0 con 0x7fb7ec079260 2024-08-20T05:11:11.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.637+0000 7fb7dbe00640 1 -- 172.21.15.37:0/2448068270 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc035030 con 0x5569c9d28be0 2024-08-20T05:11:11.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.637+0000 7fb7e2000640 1 --2- 172.21.15.37:0/996389959 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb7d00b3c50 0x7fb7d00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.637+0000 7fb7dbe00640 1 -- 172.21.15.37:0/2448068270 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7dc040070 con 0x5569c9d28be0 2024-08-20T05:11:11.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.637+0000 7fb7dbe00640 1 -- 172.21.15.37:0/2448068270 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc0318d0 con 0x5569c9d28be0 2024-08-20T05:11:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.638+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/2448068270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d28be0 msgr2=0x5569c9d2afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.638+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/2448068270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d28be0 0x5569c9d2afd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc02aa00 tx=0x7fb7dc005c00 comp rx=0 tx=0).stop 2024-08-20T05:11:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.638+0000 7fb7e2000640 1 --2- 172.21.15.37:0/996389959 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb7d00b3c50 0x7fb7d00b6110 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4011930 tx=0x7fb7d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.638+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/2448068270 shutdown_connections 2024-08-20T05:11:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.638+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/2448068270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d2b620 0x5569c9d2dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.638+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/2448068270 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d28be0 0x5569c9d2afd0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.638+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/2448068270 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d262b0 0x5569c9d286a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.638+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/2448068270 >> 172.21.15.37:0/2448068270 conn(0x5569c9d213b0 msgr2=0x5569c9d22190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.638+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/2448068270 shutdown_connections 2024-08-20T05:11:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.638+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/2448068270 wait complete. 2024-08-20T05:11:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.638+0000 7fb7f4a6d740 1 -- start start 2024-08-20T05:11:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.638+0000 7fb7f4a6d740 1 Processor -- start 2024-08-20T05:11:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.639+0000 7fb7f4a6d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d262b0 0x5569c9d2fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.639+0000 7fb7f4a6d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d28be0 0x5569c9d30330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.639+0000 7fb7f4a6d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d2b620 0x5569c9d30f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.639+0000 7fb7f4a6d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5569c9bc1ab0 con 0x5569c9d2b620 2024-08-20T05:11:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.639+0000 7fb7f4a6d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5569c9c2f140 con 0x5569c9d262b0 2024-08-20T05:11:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.639+0000 7fb7f4a6d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5569c9d2e5a0 con 0x5569c9d28be0 2024-08-20T05:11:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.639+0000 7fb7f4a6d740 10 client.0 _ll_register_callbacks cb 0x5569c9c425d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:11.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.639+0000 7fb7eb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d2b620 0x5569c9d30f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.639+0000 7fb7eb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d2b620 0x5569c9d30f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49726/0 (socket says 172.21.15.37:49726) 2024-08-20T05:11:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.639+0000 7fb7eb400640 1 -- 172.21.15.37:0/1282324883 learned_addr learned my addr 172.21.15.37:0/1282324883 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.639+0000 7fb7e2000640 1 --2- 172.21.15.37:0/1282324883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d28be0 0x5569c9d30330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.639+0000 7fb7eaa00640 1 --2- 172.21.15.37:0/1282324883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d262b0 0x5569c9d2fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.640+0000 7fb7eb400640 1 -- 172.21.15.37:0/1282324883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d28be0 msgr2=0x5569c9d30330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.640+0000 7fb7eb400640 1 --2- 172.21.15.37:0/1282324883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d28be0 0x5569c9d30330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.640+0000 7fb7eb400640 1 -- 172.21.15.37:0/1282324883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d262b0 msgr2=0x5569c9d2fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.640+0000 7fb7eb400640 1 --2- 172.21.15.37:0/1282324883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d262b0 0x5569c9d2fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.640+0000 7fb7eb400640 1 -- 172.21.15.37:0/1282324883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569c9c30170 con 0x5569c9d2b620 2024-08-20T05:11:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.640+0000 7fb7eb400640 1 --2- 172.21.15.37:0/1282324883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d2b620 0x5569c9d30f00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40a8160 tx=0x7fb7e40098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f00e384cabc389 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.640+0000 7fb7d8c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:11:11.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.640+0000 7fb7d8c00640 1 -- 172.21.15.37:0/1282324883 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e40c5060 con 0x5569c9d2b620 2024-08-20T05:11:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.640+0000 7fb7d8c00640 1 -- 172.21.15.37:0/1282324883 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb7e4004560 con 0x5569c9d2b620 2024-08-20T05:11:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.640+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/1282324883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5569c9c5fa30 con 0x5569c9d2b620 2024-08-20T05:11:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.640+0000 7fb7d8c00640 1 -- 172.21.15.37:0/1282324883 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fb7e40cc050 con 0x5569c9d2b620 2024-08-20T05:11:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.640+0000 7fb7f4a6d740 10 client.17283 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.640+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/1282324883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5569c99eb790 con 0x5569c9d2b620 2024-08-20T05:11:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.641+0000 7fb7d8c00640 1 -- 172.21.15.37:0/1282324883 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7e4086070 con 0x5569c9d2b620 2024-08-20T05:11:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.641+0000 7fb7d8c00640 1 -- 172.21.15.37:0/1282324883 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7fb7e401f020 con 0x5569c9d2b620 2024-08-20T05:11:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.641+0000 7fb7f4a6d740 10 client.17283 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.641+0000 7fb7f4a6d740 10 client.17283 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.641+0000 7fb7f4a6d740 20 client.17283 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.641+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/1282324883 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5569c9d3b850 0x5569c9d3dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.641+0000 7fb7f4a6d740 4 client.17283 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:11.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.641+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/1282324883 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569c9c9b160 con 0x5569c9d3b850 2024-08-20T05:11:11.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.641+0000 7fb7eaa00640 1 --2- 172.21.15.37:0/1282324883 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5569c9d3b850 0x5569c9d3dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.642+0000 7fb7eaa00640 1 --2- 172.21.15.37:0/1282324883 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5569c9d3b850 0x5569c9d3dd10 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2abde958894e6c39 server_cookie=5a63117c529726cd in_seq=0 out_seq=0 2024-08-20T05:11:11.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.642+0000 7fb7d8c00640 10 client.17283 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.643+0000 7fb7d8c00640 1 -- 172.21.15.37:0/1282324883 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5569c9c9b160 con 0x5569c9d3b850 2024-08-20T05:11:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.643+0000 7fb7d8c00640 10 client.17283 handle_command_reply: tid=0 2024-08-20T05:11:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.643+0000 7fb7f4a6d740 1 client.17283 shutdown 2024-08-20T05:11:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.643+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/1282324883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d2b620 msgr2=0x5569c9d30f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.643+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/1282324883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d2b620 0x5569c9d30f00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40a8160 tx=0x7fb7e40098e0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.643+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/1282324883 shutdown_connections 2024-08-20T05:11:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.643+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/1282324883 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5569c9d3b850 0x5569c9d3dd10 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.643+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/1282324883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d2b620 0x5569c9d30f00 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.643+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/1282324883 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d28be0 0x5569c9d30330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.643+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/1282324883 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d262b0 0x5569c9d2fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.643+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/1282324883 >> 172.21.15.37:0/1282324883 conn(0x5569c9d213b0 msgr2=0x5569c9d204d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.643+0000 7fb7d8c00640 0 client.17283 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.643+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/1282324883 shutdown_connections 2024-08-20T05:11:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.643+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/1282324883 wait complete. 2024-08-20T05:11:11.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.643+0000 7fb7f4a6d740 20 client.17283 trim_cache size 0 max 16384 2024-08-20T05:11:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.660+0000 7fb7f4a6d740 1 Processor -- start 2024-08-20T05:11:11.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.660+0000 7fb7f4a6d740 1 -- start start 2024-08-20T05:11:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.660+0000 7fb7f4a6d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d262b0 0x5569c9d2d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.660+0000 7fb7f4a6d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d28be0 0x5569c9d2d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.660+0000 7fb7f4a6d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d2b620 0x5569c9d21c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.660+0000 7fb7f4a6d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec1b18f0 con 0x5569c9d28be0 2024-08-20T05:11:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.660+0000 7fb7f4a6d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec1b34f0 con 0x5569c9d262b0 2024-08-20T05:11:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.660+0000 7fb7f4a6d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec1b1fc0 con 0x5569c9d2b620 2024-08-20T05:11:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.660+0000 7fb7e2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d28be0 0x5569c9d2d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.660+0000 7fb7e2000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d28be0 0x5569c9d2d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49738/0 (socket says 172.21.15.37:49738) 2024-08-20T05:11:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.660+0000 7fb7e2000640 1 -- 172.21.15.37:0/142302451 learned_addr learned my addr 172.21.15.37:0/142302451 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.660+0000 7fb7eb400640 1 --2- 172.21.15.37:0/142302451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d2b620 0x5569c9d21c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.661+0000 7fb7eaa00640 1 --2- 172.21.15.37:0/142302451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d262b0 0x5569c9d2d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.661+0000 7fb7e2000640 1 -- 172.21.15.37:0/142302451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d2b620 msgr2=0x5569c9d21c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:11.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.661+0000 7fb7e2000640 1 --2- 172.21.15.37:0/142302451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d2b620 0x5569c9d21c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.661+0000 7fb7e2000640 1 -- 172.21.15.37:0/142302451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d262b0 msgr2=0x5569c9d2d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.661+0000 7fb7e2000640 1 --2- 172.21.15.37:0/142302451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d262b0 0x5569c9d2d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.661+0000 7fb7e2000640 1 -- 172.21.15.37:0/142302451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569c9d306a0 con 0x5569c9d28be0 2024-08-20T05:11:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.661+0000 7fb7e2000640 1 --2- 172.21.15.37:0/142302451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d28be0 0x5569c9d2d720 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4012000 tx=0x7fb7d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c2872f6d6c2c5a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.661+0000 7fb7db400640 1 -- 172.21.15.37:0/142302451 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400fe20 con 0x5569c9d28be0 2024-08-20T05:11:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.661+0000 7fb7db400640 1 -- 172.21.15.37:0/142302451 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7d402c910 con 0x5569c9d28be0 2024-08-20T05:11:11.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.662+0000 7fb7db400640 1 -- 172.21.15.37:0/142302451 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40208b0 con 0x5569c9d28be0 2024-08-20T05:11:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.662+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/142302451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d28be0 msgr2=0x5569c9d2d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.662+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/142302451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d28be0 0x5569c9d2d720 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4012000 tx=0x7fb7d40046c0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.662+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/142302451 shutdown_connections 2024-08-20T05:11:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.662+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/142302451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d2b620 0x5569c9d21c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.662+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/142302451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d28be0 0x5569c9d2d720 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.662+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/142302451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d262b0 0x5569c9d2d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.662+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/142302451 >> 172.21.15.37:0/142302451 conn(0x5569c9d213b0 msgr2=0x5569c9d3d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.662+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/142302451 shutdown_connections 2024-08-20T05:11:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.662+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/142302451 wait complete. 2024-08-20T05:11:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.663+0000 7fb7f4a6d740 1 -- start start 2024-08-20T05:11:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.663+0000 7fb7f4a6d740 1 Processor -- start 2024-08-20T05:11:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.663+0000 7fb7f4a6d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d262b0 0x5569c9d34940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.663+0000 7fb7f4a6d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d28be0 0x5569c9d34fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.663+0000 7fb7f4a6d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d2b620 0x5569c9d35bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.663+0000 7fb7f4a6d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec1b2dc0 con 0x5569c9d28be0 2024-08-20T05:11:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.663+0000 7fb7f4a6d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec1b2690 con 0x5569c9d2b620 2024-08-20T05:11:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.663+0000 7fb7f4a6d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ec1af8d0 con 0x5569c9d262b0 2024-08-20T05:11:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.663+0000 7fb7f4a6d740 10 client.0 _ll_register_callbacks cb 0x7fb7e4004830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.664+0000 7fb7eaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d262b0 0x5569c9d34940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.664+0000 7fb7eaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d262b0 0x5569c9d34940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57916/0 (socket says 172.21.15.37:57916) 2024-08-20T05:11:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.664+0000 7fb7eaa00640 1 -- 172.21.15.37:0/1248531124 learned_addr learned my addr 172.21.15.37:0/1248531124 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.664+0000 7fb7e2000640 1 --2- 172.21.15.37:0/1248531124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d28be0 0x5569c9d34fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.664+0000 7fb7eb400640 1 --2- 172.21.15.37:0/1248531124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d2b620 0x5569c9d35bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.664+0000 7fb7eaa00640 1 -- 172.21.15.37:0/1248531124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d2b620 msgr2=0x5569c9d35bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.664+0000 7fb7eaa00640 1 --2- 172.21.15.37:0/1248531124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d2b620 0x5569c9d35bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.664+0000 7fb7eaa00640 1 -- 172.21.15.37:0/1248531124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d28be0 msgr2=0x5569c9d34fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.664+0000 7fb7eaa00640 1 --2- 172.21.15.37:0/1248531124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d28be0 0x5569c9d34fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.664+0000 7fb7eaa00640 1 -- 172.21.15.37:0/1248531124 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569c9a64620 con 0x5569c9d262b0 2024-08-20T05:11:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.664+0000 7fb7eaa00640 1 --2- 172.21.15.37:0/1248531124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d262b0 0x5569c9d34940 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009900 tx=0x7fb7dc004160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62e4f00dbd05fa16 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.664+0000 7fb7d8c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:11:11.670 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.664+0000 7fb7d8c00640 1 -- 172.21.15.37:0/1248531124 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7dc035040 con 0x5569c9d262b0 2024-08-20T05:11:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.664+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/1248531124 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7d402c910 con 0x5569c9d262b0 2024-08-20T05:11:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.664+0000 7fb7d8c00640 1 -- 172.21.15.37:0/1248531124 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb7dc003a00 con 0x5569c9d262b0 2024-08-20T05:11:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.665+0000 7fb7d8c00640 1 -- 172.21.15.37:0/1248531124 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fb7dc0044c0 con 0x5569c9d262b0 2024-08-20T05:11:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.665+0000 7fb7f4a6d740 10 client.27760 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.665+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/1248531124 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5569c9d376a0 con 0x5569c9d262b0 2024-08-20T05:11:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.665+0000 7fb7d8c00640 1 -- 172.21.15.37:0/1248531124 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7d402c910 con 0x5569c9d262b0 2024-08-20T05:11:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.665+0000 7fb7d8c00640 1 -- 172.21.15.37:0/1248531124 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7fb7dc04d040 con 0x5569c9d262b0 2024-08-20T05:11:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.665+0000 7fb7f4a6d740 10 client.27760 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.665+0000 7fb7f4a6d740 10 client.27760 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.665+0000 7fb7f4a6d740 20 client.27760 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.665+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/1248531124 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5569c9d37c60 0x5569c9da8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.665+0000 7fb7f4a6d740 4 client.27760 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:11:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.665+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/1248531124 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5569c9c96c00 con 0x5569c9d37c60 2024-08-20T05:11:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.666+0000 7fb7e2000640 1 --2- 172.21.15.37:0/1248531124 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5569c9d37c60 0x5569c9da8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:11.671 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.666+0000 7fb7e2000640 1 --2- 172.21.15.37:0/1248531124 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5569c9d37c60 0x5569c9da8600 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=334a4351d3eb239d server_cookie=a3745306461ec696 in_seq=0 out_seq=0 2024-08-20T05:11:11.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.666+0000 7fb7d8c00640 10 client.27760 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:11.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.674+0000 7fb7d8c00640 1 -- 172.21.15.37:0/1248531124 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5569c9c96c00 con 0x5569c9d37c60 2024-08-20T05:11:11.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.674+0000 7fb7d8c00640 10 client.27760 handle_command_reply: tid=0 2024-08-20T05:11:11.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.675+0000 7fb7f4a6d740 1 client.27760 shutdown 2024-08-20T05:11:11.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.675+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/1248531124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d262b0 msgr2=0x5569c9d34940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.675+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/1248531124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d262b0 0x5569c9d34940 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc009900 tx=0x7fb7dc004160 comp rx=0 tx=0).stop 2024-08-20T05:11:11.677 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.675+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/1248531124 shutdown_connections 2024-08-20T05:11:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.675+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/1248531124 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5569c9d37c60 0x5569c9da8600 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.675+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/1248531124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5569c9d2b620 0x5569c9d35bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.675+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/1248531124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5569c9d28be0 0x5569c9d34fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.675+0000 7fb7f4a6d740 1 --2- 172.21.15.37:0/1248531124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5569c9d262b0 0x5569c9d34940 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.675+0000 7fb7d8c00640 0 client.27760 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.675+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/1248531124 >> 172.21.15.37:0/1248531124 conn(0x5569c9d213b0 msgr2=0x5569c9d2d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.675+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/1248531124 shutdown_connections 2024-08-20T05:11:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.675+0000 7fb7f4a6d740 1 -- 172.21.15.37:0/1248531124 wait complete. 2024-08-20T05:11:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.675+0000 7fb7f4a6d740 20 client.27760 trim_cache size 0 max 16384 2024-08-20T05:11:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:11:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:11:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:11:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:11:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.676+0000 7fb7f1a00640 1 -- 172.21.15.37:0/996389959 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb7d00b3c50 msgr2=0x7fb7d00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.676+0000 7fb7f1a00640 1 --2- 172.21.15.37:0/996389959 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb7d00b3c50 0x7fb7d00b6110 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4011930 tx=0x7fb7d4005f90 comp rx=0 tx=0).stop 2024-08-20T05:11:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.676+0000 7fb7f1a00640 1 -- 172.21.15.37:0/996389959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ec079260 msgr2=0x7fb7ec1a0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.676+0000 7fb7f1a00640 1 --2- 172.21.15.37:0/996389959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ec079260 0x7fb7ec1a0350 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400efd0 tx=0x7fb7e400c6a0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.676+0000 7fb7f1a00640 1 -- 172.21.15.37:0/996389959 shutdown_connections 2024-08-20T05:11:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.676+0000 7fb7f1a00640 1 --2- 172.21.15.37:0/996389959 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb7d00b3c50 0x7fb7d00b6110 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.676+0000 7fb7f1a00640 1 --2- 172.21.15.37:0/996389959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7ec079260 0x7fb7ec1a0350 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.676+0000 7fb7f1a00640 1 --2- 172.21.15.37:0/996389959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb7ec0788a0 0x7fb7ec19f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.676+0000 7fb7f1a00640 1 --2- 172.21.15.37:0/996389959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb7ec077750 0x7fb7ec19f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.676+0000 7fb7f1a00640 1 -- 172.21.15.37:0/996389959 >> 172.21.15.37:0/996389959 conn(0x7fb7ec100130 msgr2=0x7fb7ec101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.676+0000 7fb7f1a00640 1 -- 172.21.15.37:0/996389959 shutdown_connections 2024-08-20T05:11:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:11.676+0000 7fb7f1a00640 1 -- 172.21.15.37:0/996389959 wait complete. 2024-08-20T05:11:11.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:11 smithi135 ceph-mon[22342]: pgmap v669: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.3 MiB/s wr, 172 op/s 2024-08-20T05:11:11.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:11 smithi130 ceph-mon[22007]: pgmap v669: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 1.3 MiB/s wr, 172 op/s 2024-08-20T05:11:12.417 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T05:11:12.798 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:13.045 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 495.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:11:13.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.422+0000 7f27bfe00640 1 -- 172.21.15.37:0/2171437355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b8104c90 msgr2=0x7f27b8105070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:13.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.422+0000 7f27bfe00640 1 --2- 172.21.15.37:0/2171437355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b8104c90 0x7f27b8105070 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f27ac009900 tx=0x7f27ac02a410 comp rx=0 tx=0).stop 2024-08-20T05:11:13.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.422+0000 7f27bfe00640 1 -- 172.21.15.37:0/2171437355 shutdown_connections 2024-08-20T05:11:13.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.422+0000 7f27bfe00640 1 --2- 172.21.15.37:0/2171437355 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27b810b020 0x7f27b8111820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.422+0000 7f27bfe00640 1 --2- 172.21.15.37:0/2171437355 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27b810a6a0 0x7f27b810aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.422+0000 7f27bfe00640 1 --2- 172.21.15.37:0/2171437355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b8104c90 0x7f27b8105070 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.422+0000 7f27bfe00640 1 -- 172.21.15.37:0/2171437355 >> 172.21.15.37:0/2171437355 conn(0x7f27b81006c0 msgr2=0x7f27b8102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.422+0000 7f27bfe00640 1 -- 172.21.15.37:0/2171437355 shutdown_connections 2024-08-20T05:11:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.422+0000 7f27bfe00640 1 -- 172.21.15.37:0/2171437355 wait complete. 2024-08-20T05:11:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.423+0000 7f27bfe00640 1 Processor -- start 2024-08-20T05:11:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.423+0000 7f27bfe00640 1 -- start start 2024-08-20T05:11:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.424+0000 7f27bfe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27b8104c90 0x7f27b819b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.424+0000 7f27bfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b810a6a0 0x7f27b819b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.424+0000 7f27bfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27b810b020 0x7f27b81a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.424+0000 7f27bfe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f27b8114d30 con 0x7f27b810a6a0 2024-08-20T05:11:13.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.424+0000 7f27bfe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f27b8114bb0 con 0x7f27b810b020 2024-08-20T05:11:13.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.424+0000 7f27bfe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f27b8114eb0 con 0x7f27b8104c90 2024-08-20T05:11:13.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.424+0000 7f27bca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b810a6a0 0x7f27b819b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.424+0000 7f27bca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b810a6a0 0x7f27b819b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34068/0 (socket says 172.21.15.37:34068) 2024-08-20T05:11:13.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.424+0000 7f27bca00640 1 -- 172.21.15.37:0/2065596854 learned_addr learned my addr 172.21.15.37:0/2065596854 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:13.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.424+0000 7f27bd400640 1 --2- 172.21.15.37:0/2065596854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27b8104c90 0x7f27b819b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.424+0000 7f27bde00640 1 --2- 172.21.15.37:0/2065596854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27b810b020 0x7f27b81a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.424+0000 7f27bca00640 1 -- 172.21.15.37:0/2065596854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27b8104c90 msgr2=0x7f27b819b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:13.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.424+0000 7f27bca00640 1 --2- 172.21.15.37:0/2065596854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27b8104c90 0x7f27b819b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.424+0000 7f27bca00640 1 -- 172.21.15.37:0/2065596854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27b810b020 msgr2=0x7f27b81a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:13.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.424+0000 7f27bca00640 1 --2- 172.21.15.37:0/2065596854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27b810b020 0x7f27b81a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.424+0000 7f27bca00640 1 -- 172.21.15.37:0/2065596854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b81a1260 con 0x7f27b810a6a0 2024-08-20T05:11:13.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.425+0000 7f27bca00640 1 --2- 172.21.15.37:0/2065596854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b810a6a0 0x7f27b819b6f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f27a400d950 tx=0x7f27a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:13.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.425+0000 7f27b6000640 1 -- 172.21.15.37:0/2065596854 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4017030 con 0x7f27b810a6a0 2024-08-20T05:11:13.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.425+0000 7f27b6000640 1 -- 172.21.15.37:0/2065596854 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27a4004020 con 0x7f27b810a6a0 2024-08-20T05:11:13.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.425+0000 7f27bfe00640 1 -- 172.21.15.37:0/2065596854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b81a1550 con 0x7f27b810a6a0 2024-08-20T05:11:13.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.425+0000 7f27b6000640 1 -- 172.21.15.37:0/2065596854 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a40047a0 con 0x7f27b810a6a0 2024-08-20T05:11:13.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.425+0000 7f27bfe00640 1 -- 172.21.15.37:0/2065596854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b81a7c10 con 0x7f27b810a6a0 2024-08-20T05:11:13.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.428+0000 7f27c2a3c740 1 Processor -- start 2024-08-20T05:11:13.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.429+0000 7f27c2a3c740 1 -- start start 2024-08-20T05:11:13.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.429+0000 7f27b6000640 1 -- 172.21.15.37:0/2065596854 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f27a4009a30 con 0x7f27b810a6a0 2024-08-20T05:11:13.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.429+0000 7f27c2a3c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c3554940 0x5654c3554d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.429+0000 7f27c2a3c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3555260 0x5654c3560cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.429+0000 7f27c2a3c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c35611f0 0x5654c35635e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.429+0000 7f27c2a3c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5654c34caaa0 con 0x5654c3554940 2024-08-20T05:11:13.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.429+0000 7f27c2a3c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5654c34b9fa0 con 0x5654c3555260 2024-08-20T05:11:13.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.429+0000 7f27c2a3c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5654c34bdfe0 con 0x5654c35611f0 2024-08-20T05:11:13.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.429+0000 7f27bde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c3554940 0x5654c3554d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.429+0000 7f27bca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c35611f0 0x5654c35635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.429+0000 7f27bd400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3555260 0x5654c3560cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.429+0000 7f27bca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c35611f0 0x5654c35635e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51948/0 (socket says 172.21.15.37:51948) 2024-08-20T05:11:13.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.429+0000 7f27bd400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3555260 0x5654c3560cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43842/0 (socket says 172.21.15.37:43842) 2024-08-20T05:11:13.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.429+0000 7f27bca00640 1 -- 172.21.15.37:0/259734109 learned_addr learned my addr 172.21.15.37:0/259734109 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:13.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.430+0000 7f27bca00640 1 -- 172.21.15.37:0/259734109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3555260 msgr2=0x5654c3560cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:13.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.430+0000 7f27bca00640 1 --2- 172.21.15.37:0/259734109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3555260 0x5654c3560cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.430+0000 7f27bca00640 1 -- 172.21.15.37:0/259734109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c3554940 msgr2=0x5654c3554d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:13.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.430+0000 7f27bca00640 1 --2- 172.21.15.37:0/259734109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c3554940 0x5654c3554d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.430+0000 7f27bca00640 1 -- 172.21.15.37:0/259734109 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c3460420 con 0x5654c35611f0 2024-08-20T05:11:13.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.430+0000 7f27bd400640 1 --2- 172.21.15.37:0/259734109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3555260 0x5654c3560cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:13.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.430+0000 7f27bca00640 1 --2- 172.21.15.37:0/259734109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c35611f0 0x5654c35635e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f27a40e9a30 tx=0x7f27a40e9ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68dacae5451388fe server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:13.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.431+0000 7f27b6000640 1 --2- 172.21.15.37:0/2065596854 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27a00b3bd0 0x7f27a00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.431+0000 7f27aa600640 1 -- 172.21.15.37:0/259734109 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a40f3020 con 0x5654c35611f0 2024-08-20T05:11:13.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.431+0000 7f27aa600640 1 -- 172.21.15.37:0/259734109 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27a40aa090 con 0x5654c35611f0 2024-08-20T05:11:13.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.431+0000 7f27aa600640 1 -- 172.21.15.37:0/259734109 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4086700 con 0x5654c35611f0 2024-08-20T05:11:13.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.431+0000 7f27b6000640 1 -- 172.21.15.37:0/2065596854 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f27a40e3a30 con 0x7f27b810a6a0 2024-08-20T05:11:13.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.431+0000 7f27bde00640 1 --2- 172.21.15.37:0/2065596854 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27a00b3bd0 0x7f27a00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.432+0000 7f27c2a3c740 1 -- 172.21.15.37:0/259734109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c35611f0 msgr2=0x5654c35635e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:13.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.432+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/259734109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c35611f0 0x5654c35635e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f27a40e9a30 tx=0x7f27a40e9ef0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.432+0000 7f27bde00640 1 --2- 172.21.15.37:0/2065596854 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27a00b3bd0 0x7f27a00b6090 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f27b0005fd0 tx=0x7f27b0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:13.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.432+0000 7f27c2a3c740 1 -- 172.21.15.37:0/259734109 shutdown_connections 2024-08-20T05:11:13.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.432+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/259734109 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c35611f0 0x5654c35635e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.432+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/259734109 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3555260 0x5654c3560cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.432+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/259734109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c3554940 0x5654c3554d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.432+0000 7f27c2a3c740 1 -- 172.21.15.37:0/259734109 >> 172.21.15.37:0/259734109 conn(0x5654c3552770 msgr2=0x5654c3553910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:13.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.432+0000 7f27c2a3c740 1 -- 172.21.15.37:0/259734109 shutdown_connections 2024-08-20T05:11:13.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.432+0000 7f27c2a3c740 1 -- 172.21.15.37:0/259734109 wait complete. 2024-08-20T05:11:13.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.432+0000 7f27c2a3c740 1 -- start start 2024-08-20T05:11:13.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.432+0000 7f27c2a3c740 1 Processor -- start 2024-08-20T05:11:13.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.433+0000 7f27c2a3c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c3554940 0x5654c3560920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.433+0000 7f27c2a3c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3555260 0x5654c355dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.433+0000 7f27c2a3c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c35611f0 0x5654c355e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.433+0000 7f27c2a3c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5654c331c700 con 0x5654c3554940 2024-08-20T05:11:13.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.433+0000 7f27c2a3c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5654c3455290 con 0x5654c3555260 2024-08-20T05:11:13.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.433+0000 7f27c2a3c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5654c3563e70 con 0x5654c35611f0 2024-08-20T05:11:13.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.433+0000 7f27c2a3c740 10 client.0 _ll_register_callbacks cb 0x5654c34b41c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:13.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.433+0000 7f27bde00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c35611f0 0x5654c355e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.433+0000 7f27bd400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c3554940 0x5654c3560920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.433+0000 7f27bde00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c35611f0 0x5654c355e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51954/0 (socket says 172.21.15.37:51954) 2024-08-20T05:11:13.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.433+0000 7f27bd400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c3554940 0x5654c3560920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34088/0 (socket says 172.21.15.37:34088) 2024-08-20T05:11:13.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.433+0000 7f27bca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3555260 0x5654c355dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.433+0000 7f27bde00640 1 -- 172.21.15.37:0/677610515 learned_addr learned my addr 172.21.15.37:0/677610515 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:13.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.434+0000 7f27bca00640 1 -- 172.21.15.37:0/677610515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c35611f0 msgr2=0x5654c355e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:13.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.434+0000 7f27bca00640 1 --2- 172.21.15.37:0/677610515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c35611f0 0x5654c355e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.434+0000 7f27bca00640 1 -- 172.21.15.37:0/677610515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c3554940 msgr2=0x5654c3560920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:13.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.434+0000 7f27bca00640 1 --2- 172.21.15.37:0/677610515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c3554940 0x5654c3560920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.434+0000 7f27bca00640 1 -- 172.21.15.37:0/677610515 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c3219650 con 0x5654c3555260 2024-08-20T05:11:13.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.434+0000 7f27bca00640 1 --2- 172.21.15.37:0/677610515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3555260 0x5654c355dd70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f27a40aa510 tx=0x7f27a40e3cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e61a21b1e2cf4ff8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:13.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.434+0000 7f279ea00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:11:13.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.434+0000 7f279ea00640 1 -- 172.21.15.37:0/677610515 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4089e90 con 0x5654c3555260 2024-08-20T05:11:13.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.434+0000 7f27c2a3c740 1 -- 172.21.15.37:0/677610515 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27a40aa090 con 0x5654c3555260 2024-08-20T05:11:13.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.434+0000 7f279ea00640 1 -- 172.21.15.37:0/677610515 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f27a40cd0d0 con 0x5654c3555260 2024-08-20T05:11:13.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.434+0000 7f279ea00640 1 -- 172.21.15.37:0/677610515 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f27a40f3070 con 0x5654c3555260 2024-08-20T05:11:13.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.434+0000 7f27c2a3c740 10 client.27776 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:13.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.434+0000 7f27c2a3c740 1 -- 172.21.15.37:0/677610515 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5654c356f620 con 0x5654c3555260 2024-08-20T05:11:13.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.435+0000 7f279ea00640 1 -- 172.21.15.37:0/677610515 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27a40aa090 con 0x5654c3555260 2024-08-20T05:11:13.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.435+0000 7f279ea00640 1 -- 172.21.15.37:0/677610515 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f27a40a6810 con 0x5654c3555260 2024-08-20T05:11:13.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.435+0000 7f27c2a3c740 10 client.27776 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:13.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.435+0000 7f27c2a3c740 10 client.27776 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:13.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.435+0000 7f27c2a3c740 20 client.27776 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:13.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.435+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/677610515 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5654c3570970 0x5654c3572d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.435+0000 7f27c2a3c740 4 client.27776 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:13.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.435+0000 7f27c2a3c740 1 -- 172.21.15.37:0/677610515 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5654c34cc9f0 con 0x5654c3570970 2024-08-20T05:11:13.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.435+0000 7f27bd400640 1 --2- 172.21.15.37:0/677610515 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5654c3570970 0x5654c3572d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.436+0000 7f27bd400640 1 --2- 172.21.15.37:0/677610515 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5654c3570970 0x5654c3572d60 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8966681f1f185d2 server_cookie=8d0ce6c5dfd46376 in_seq=0 out_seq=0 2024-08-20T05:11:13.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.436+0000 7f279ea00640 10 client.27776 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:13.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.436+0000 7f279ea00640 1 -- 172.21.15.37:0/677610515 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5654c34cc9f0 con 0x5654c3570970 2024-08-20T05:11:13.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.436+0000 7f279ea00640 10 client.27776 handle_command_reply: tid=0 2024-08-20T05:11:13.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.437+0000 7f27c2a3c740 1 client.27776 shutdown 2024-08-20T05:11:13.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.437+0000 7f27c2a3c740 1 -- 172.21.15.37:0/677610515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3555260 msgr2=0x5654c355dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:13.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.437+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/677610515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3555260 0x5654c355dd70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f27a40aa510 tx=0x7f27a40e3cb0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.437+0000 7f27c2a3c740 1 -- 172.21.15.37:0/677610515 shutdown_connections 2024-08-20T05:11:13.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.437+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/677610515 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5654c3570970 0x5654c3572d60 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.437+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/677610515 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c35611f0 0x5654c355e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.437+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/677610515 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3555260 0x5654c355dd70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.437+0000 7f279ea00640 0 client.27776 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:13.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.437+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/677610515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c3554940 0x5654c3560920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.437+0000 7f27c2a3c740 1 -- 172.21.15.37:0/677610515 >> 172.21.15.37:0/677610515 conn(0x5654c3552770 msgr2=0x5654c35582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:13.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.437+0000 7f27c2a3c740 1 -- 172.21.15.37:0/677610515 shutdown_connections 2024-08-20T05:11:13.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.437+0000 7f27c2a3c740 1 -- 172.21.15.37:0/677610515 wait complete. 2024-08-20T05:11:13.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.437+0000 7f27c2a3c740 20 client.27776 trim_cache size 0 max 16384 2024-08-20T05:11:13.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.451+0000 7f27c2a3c740 1 Processor -- start 2024-08-20T05:11:13.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.452+0000 7f27c2a3c740 1 -- start start 2024-08-20T05:11:13.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.452+0000 7f27c2a3c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c3554940 0x5654c3559370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.452+0000 7f27c2a3c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c3555260 0x5654c3575d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.452+0000 7f27c2a3c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c35611f0 0x5654c35762c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.452+0000 7f27c2a3c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f27b81b1a90 con 0x5654c3554940 2024-08-20T05:11:13.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.452+0000 7f27c2a3c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f27b81b3690 con 0x5654c35611f0 2024-08-20T05:11:13.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.452+0000 7f27c2a3c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f27b81b2160 con 0x5654c3555260 2024-08-20T05:11:13.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.452+0000 7f27bca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c3555260 0x5654c3575d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.452+0000 7f27bd400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c3554940 0x5654c3559370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.452+0000 7f27bd400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c3554940 0x5654c3559370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34104/0 (socket says 172.21.15.37:34104) 2024-08-20T05:11:13.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.452+0000 7f27bd400640 1 -- 172.21.15.37:0/2571952812 learned_addr learned my addr 172.21.15.37:0/2571952812 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:13.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.452+0000 7f27bca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c3555260 0x5654c3575d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51960/0 (socket says 172.21.15.37:51960) 2024-08-20T05:11:13.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.452+0000 7f27bde00640 1 --2- 172.21.15.37:0/2571952812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c35611f0 0x5654c35762c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.453+0000 7f27bca00640 1 -- 172.21.15.37:0/2571952812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c35611f0 msgr2=0x5654c35762c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:13.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.453+0000 7f27bca00640 1 --2- 172.21.15.37:0/2571952812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c35611f0 0x5654c35762c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.453+0000 7f27bca00640 1 -- 172.21.15.37:0/2571952812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c3554940 msgr2=0x5654c3559370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:13.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.453+0000 7f27bca00640 1 --2- 172.21.15.37:0/2571952812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c3554940 0x5654c3559370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.453+0000 7f27bca00640 1 -- 172.21.15.37:0/2571952812 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654c354ded0 con 0x5654c3555260 2024-08-20T05:11:13.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.453+0000 7f27bca00640 1 --2- 172.21.15.37:0/2571952812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c3555260 0x5654c3575d80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f27a40aa280 tx=0x7f27a40e11b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45cc36dbad1b7c24 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:13.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.453+0000 7f27a9c00640 1 -- 172.21.15.37:0/2571952812 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a408a070 con 0x5654c3555260 2024-08-20T05:11:13.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.453+0000 7f27a9c00640 1 -- 172.21.15.37:0/2571952812 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27a40eb6d0 con 0x5654c3555260 2024-08-20T05:11:13.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.453+0000 7f27a9c00640 1 -- 172.21.15.37:0/2571952812 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a408a240 con 0x5654c3555260 2024-08-20T05:11:13.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.454+0000 7f27c2a3c740 1 -- 172.21.15.37:0/2571952812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c3555260 msgr2=0x5654c3575d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:13.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.454+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/2571952812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c3555260 0x5654c3575d80 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f27a40aa280 tx=0x7f27a40e11b0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.454+0000 7f27c2a3c740 1 -- 172.21.15.37:0/2571952812 shutdown_connections 2024-08-20T05:11:13.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.454+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/2571952812 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c35611f0 0x5654c35762c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.454+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/2571952812 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c3555260 0x5654c3575d80 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.454+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/2571952812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c3554940 0x5654c3559370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.454+0000 7f27c2a3c740 1 -- 172.21.15.37:0/2571952812 >> 172.21.15.37:0/2571952812 conn(0x5654c3552770 msgr2=0x5654c3558c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:13.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.454+0000 7f27c2a3c740 1 -- 172.21.15.37:0/2571952812 shutdown_connections 2024-08-20T05:11:13.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.454+0000 7f27c2a3c740 1 -- 172.21.15.37:0/2571952812 wait complete. 2024-08-20T05:11:13.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.454+0000 7f27c2a3c740 1 -- start start 2024-08-20T05:11:13.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.455+0000 7f27c2a3c740 1 Processor -- start 2024-08-20T05:11:13.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.455+0000 7f27c2a3c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3554940 0x5654c3576460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.455+0000 7f27c2a3c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c3555260 0x5654c3573950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.455+0000 7f27c2a3c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c35611f0 0x5654c3573ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.455+0000 7f27c2a3c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f27b81b2f60 con 0x5654c35611f0 2024-08-20T05:11:13.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.455+0000 7f27c2a3c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f27b81b2830 con 0x5654c3554940 2024-08-20T05:11:13.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.455+0000 7f27c2a3c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f27b81afa70 con 0x5654c3555260 2024-08-20T05:11:13.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.455+0000 7f27c2a3c740 10 client.0 _ll_register_callbacks cb 0x7f27b0009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:13.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.455+0000 7f27bd400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3554940 0x5654c3576460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.455+0000 7f27bca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c3555260 0x5654c3573950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.456+0000 7f27bde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c35611f0 0x5654c3573ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.456+0000 7f27bd400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3554940 0x5654c3576460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43854/0 (socket says 172.21.15.37:43854) 2024-08-20T05:11:13.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.456+0000 7f27bd400640 1 -- 172.21.15.37:0/3442861282 learned_addr learned my addr 172.21.15.37:0/3442861282 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:13.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.456+0000 7f27bca00640 1 -- 172.21.15.37:0/3442861282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3554940 msgr2=0x5654c3576460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:13.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.456+0000 7f27bca00640 1 --2- 172.21.15.37:0/3442861282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3554940 0x5654c3576460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.456+0000 7f27bca00640 1 -- 172.21.15.37:0/3442861282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c35611f0 msgr2=0x5654c3573ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:13.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.456+0000 7f27bca00640 1 --2- 172.21.15.37:0/3442861282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c35611f0 0x5654c3573ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.456+0000 7f27bca00640 1 -- 172.21.15.37:0/3442861282 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5654c3574700 con 0x5654c3555260 2024-08-20T05:11:13.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.456+0000 7f27bd400640 1 --2- 172.21.15.37:0/3442861282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3554940 0x5654c3576460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:13.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.456+0000 7f27bca00640 1 --2- 172.21.15.37:0/3442861282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c3555260 0x5654c3573950 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f27a40a6600 tx=0x7f27a40e9880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db11d2e8721761e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:13.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.456+0000 7f279ea00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:11:13.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.456+0000 7f279ea00640 1 -- 172.21.15.37:0/3442861282 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a408a430 con 0x5654c3555260 2024-08-20T05:11:13.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.457+0000 7f27c2a3c740 1 -- 172.21.15.37:0/3442861282 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27a40eb6d0 con 0x5654c3555260 2024-08-20T05:11:13.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.457+0000 7f279ea00640 1 -- 172.21.15.37:0/3442861282 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f27a40a6b70 con 0x5654c3555260 2024-08-20T05:11:13.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.457+0000 7f279ea00640 1 -- 172.21.15.37:0/3442861282 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f27a4087cb0 con 0x5654c3555260 2024-08-20T05:11:13.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.457+0000 7f27c2a3c740 10 client.27778 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:13.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.457+0000 7f27c2a3c740 1 -- 172.21.15.37:0/3442861282 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5654c3574700 con 0x5654c3555260 2024-08-20T05:11:13.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.457+0000 7f279ea00640 1 -- 172.21.15.37:0/3442861282 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27a40eb6d0 con 0x5654c3555260 2024-08-20T05:11:13.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.457+0000 7f279ea00640 1 -- 172.21.15.37:0/3442861282 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f27a40aa7e0 con 0x5654c3555260 2024-08-20T05:11:13.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.457+0000 7f27c2a3c740 10 client.27778 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:13.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.457+0000 7f27c2a3c740 10 client.27778 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:13.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.457+0000 7f27c2a3c740 20 client.27778 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:13.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.457+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/3442861282 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5654c35db6e0 0x5654c35ddb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:13.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.457+0000 7f27c2a3c740 4 client.27778 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:11:13.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.457+0000 7f27c2a3c740 1 -- 172.21.15.37:0/3442861282 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5654c34c8490 con 0x5654c35db6e0 2024-08-20T05:11:13.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.458+0000 7f27bd400640 1 --2- 172.21.15.37:0/3442861282 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5654c35db6e0 0x5654c35ddb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:13.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.458+0000 7f27bd400640 1 --2- 172.21.15.37:0/3442861282 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5654c35db6e0 0x5654c35ddb00 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d096c2c8f1448f8d server_cookie=2f9d96ce67b9f755 in_seq=0 out_seq=0 2024-08-20T05:11:13.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.458+0000 7f279ea00640 10 client.27778 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:13.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.458+0000 7f279ea00640 1 -- 172.21.15.37:0/3442861282 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5654c34c8490 con 0x5654c35db6e0 2024-08-20T05:11:13.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.458+0000 7f279ea00640 10 client.27778 handle_command_reply: tid=0 2024-08-20T05:11:13.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.458+0000 7f27c2a3c740 1 client.27778 shutdown 2024-08-20T05:11:13.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.459+0000 7f27c2a3c740 1 -- 172.21.15.37:0/3442861282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c3555260 msgr2=0x5654c3573950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:13.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.459+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/3442861282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c3555260 0x5654c3573950 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f27a40a6600 tx=0x7f27a40e9880 comp rx=0 tx=0).stop 2024-08-20T05:11:13.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.459+0000 7f27c2a3c740 1 -- 172.21.15.37:0/3442861282 shutdown_connections 2024-08-20T05:11:13.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.459+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/3442861282 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5654c35db6e0 0x5654c35ddb00 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.459+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/3442861282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5654c35611f0 0x5654c3573ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.459+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/3442861282 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5654c3555260 0x5654c3573950 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.459+0000 7f279ea00640 0 client.27778 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:13.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.459+0000 7f27c2a3c740 1 --2- 172.21.15.37:0/3442861282 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5654c3554940 0x5654c3576460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.459+0000 7f27c2a3c740 1 -- 172.21.15.37:0/3442861282 >> 172.21.15.37:0/3442861282 conn(0x5654c3552770 msgr2=0x5654c3551030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:13.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.459+0000 7f27c2a3c740 1 -- 172.21.15.37:0/3442861282 shutdown_connections 2024-08-20T05:11:13.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.459+0000 7f27c2a3c740 1 -- 172.21.15.37:0/3442861282 wait complete. 2024-08-20T05:11:13.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.459+0000 7f27c2a3c740 20 client.27778 trim_cache size 0 max 16384 2024-08-20T05:11:13.473 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:11:13.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.460+0000 7f27bfe00640 1 -- 172.21.15.37:0/2065596854 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27a00b3bd0 msgr2=0x7f27a00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:13.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.460+0000 7f27bfe00640 1 --2- 172.21.15.37:0/2065596854 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27a00b3bd0 0x7f27a00b6090 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f27b0005fd0 tx=0x7f27b0009500 comp rx=0 tx=0).stop 2024-08-20T05:11:13.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.460+0000 7f27bfe00640 1 -- 172.21.15.37:0/2065596854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b810a6a0 msgr2=0x7f27b819b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:13.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.460+0000 7f27bfe00640 1 --2- 172.21.15.37:0/2065596854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b810a6a0 0x7f27b819b6f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f27a400d950 tx=0x7f27a400de10 comp rx=0 tx=0).stop 2024-08-20T05:11:13.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.460+0000 7f27bfe00640 1 -- 172.21.15.37:0/2065596854 shutdown_connections 2024-08-20T05:11:13.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.460+0000 7f27bfe00640 1 --2- 172.21.15.37:0/2065596854 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27a00b3bd0 0x7f27a00b6090 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.460+0000 7f27bfe00640 1 --2- 172.21.15.37:0/2065596854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27b810b020 0x7f27b81a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.460+0000 7f27bfe00640 1 --2- 172.21.15.37:0/2065596854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27b810a6a0 0x7f27b819b6f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.460+0000 7f27bfe00640 1 --2- 172.21.15.37:0/2065596854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27b8104c90 0x7f27b819b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:13.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.460+0000 7f27bfe00640 1 -- 172.21.15.37:0/2065596854 >> 172.21.15.37:0/2065596854 conn(0x7f27b81006c0 msgr2=0x7f27b81088e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:13.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.460+0000 7f27bfe00640 1 -- 172.21.15.37:0/2065596854 shutdown_connections 2024-08-20T05:11:13.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:13.460+0000 7f27bfe00640 1 -- 172.21.15.37:0/2065596854 wait complete. 2024-08-20T05:11:13.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:13 smithi037 ceph-mon[17265]: pgmap v670: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 688 KiB/s wr, 88 op/s 2024-08-20T05:11:13.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:13 smithi135 ceph-mon[22342]: pgmap v670: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 688 KiB/s wr, 88 op/s 2024-08-20T05:11:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:13 smithi130 ceph-mon[22007]: pgmap v670: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 688 KiB/s wr, 88 op/s 2024-08-20T05:11:15.497 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T05:11:15.498 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T05:11:15.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:15 smithi037 ceph-mon[17265]: pgmap v671: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 188 KiB/s wr, 32 op/s 2024-08-20T05:11:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:15 smithi135 ceph-mon[22342]: pgmap v671: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 188 KiB/s wr, 32 op/s 2024-08-20T05:11:15.900 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:15.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:15 smithi130 ceph-mon[22007]: pgmap v671: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 188 KiB/s wr, 32 op/s 2024-08-20T05:11:16.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.467+0000 7efe17e00640 1 -- 172.21.15.37:0/317949013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe10104ca0 msgr2=0x7efe10105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:16.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.467+0000 7efe17e00640 1 --2- 172.21.15.37:0/317949013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe10104ca0 0x7efe10105080 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7efe04009ca0 tx=0x7efe0402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.467+0000 7efe17e00640 1 -- 172.21.15.37:0/317949013 shutdown_connections 2024-08-20T05:11:16.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.467+0000 7efe17e00640 1 --2- 172.21.15.37:0/317949013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe1010b030 0x7efe10111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.467+0000 7efe17e00640 1 --2- 172.21.15.37:0/317949013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe1010a6b0 0x7efe1010aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.467+0000 7efe17e00640 1 --2- 172.21.15.37:0/317949013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe10104ca0 0x7efe10105080 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.467+0000 7efe17e00640 1 -- 172.21.15.37:0/317949013 >> 172.21.15.37:0/317949013 conn(0x7efe10100730 msgr2=0x7efe10102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:16.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.467+0000 7efe17e00640 1 -- 172.21.15.37:0/317949013 shutdown_connections 2024-08-20T05:11:16.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.467+0000 7efe17e00640 1 -- 172.21.15.37:0/317949013 wait complete. 2024-08-20T05:11:16.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.468+0000 7efe17e00640 1 Processor -- start 2024-08-20T05:11:16.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.468+0000 7efe17e00640 1 -- start start 2024-08-20T05:11:16.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.469+0000 7efe17e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe10104ca0 0x7efe1019b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.469+0000 7efe17e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1010a6b0 0x7efe1019b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.469+0000 7efe17e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe1010b030 0x7efe101a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.469+0000 7efe17e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe10114d40 con 0x7efe1010a6b0 2024-08-20T05:11:16.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.469+0000 7efe17e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efe10114bc0 con 0x7efe10104ca0 2024-08-20T05:11:16.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.469+0000 7efe17e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efe10114ec0 con 0x7efe1010b030 2024-08-20T05:11:16.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.469+0000 7efe15400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe10104ca0 0x7efe1019b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:16.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.469+0000 7efe14a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1010a6b0 0x7efe1019b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:16.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.469+0000 7efe15400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe10104ca0 0x7efe1019b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43876/0 (socket says 172.21.15.37:43876) 2024-08-20T05:11:16.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.469+0000 7efe15400640 1 -- 172.21.15.37:0/1404137531 learned_addr learned my addr 172.21.15.37:0/1404137531 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:16.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.469+0000 7efe15e00640 1 --2- 172.21.15.37:0/1404137531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe1010b030 0x7efe101a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:16.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.469+0000 7efe15400640 1 -- 172.21.15.37:0/1404137531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe1010b030 msgr2=0x7efe101a0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:16.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.469+0000 7efe15400640 1 --2- 172.21.15.37:0/1404137531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe1010b030 0x7efe101a0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.470+0000 7efe15400640 1 -- 172.21.15.37:0/1404137531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1010a6b0 msgr2=0x7efe1019b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:16.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.470+0000 7efe15400640 1 --2- 172.21.15.37:0/1404137531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1010a6b0 0x7efe1019b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.470+0000 7efe15400640 1 -- 172.21.15.37:0/1404137531 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe101a1240 con 0x7efe10104ca0 2024-08-20T05:11:16.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.470+0000 7efe14a00640 1 --2- 172.21.15.37:0/1404137531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1010a6b0 0x7efe1019b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:16.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.470+0000 7efe15400640 1 --2- 172.21.15.37:0/1404137531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe10104ca0 0x7efe1019b190 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efe04005e30 tx=0x7efe04031840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:16.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.470+0000 7efe0e000640 1 -- 172.21.15.37:0/1404137531 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe04003b70 con 0x7efe10104ca0 2024-08-20T05:11:16.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.470+0000 7efe17e00640 1 -- 172.21.15.37:0/1404137531 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe101a14d0 con 0x7efe10104ca0 2024-08-20T05:11:16.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.470+0000 7efe0e000640 1 -- 172.21.15.37:0/1404137531 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe04003d10 con 0x7efe10104ca0 2024-08-20T05:11:16.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.470+0000 7efe0e000640 1 -- 172.21.15.37:0/1404137531 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0402fa30 con 0x7efe10104ca0 2024-08-20T05:11:16.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.470+0000 7efe17e00640 1 -- 172.21.15.37:0/1404137531 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe101a7bf0 con 0x7efe10104ca0 2024-08-20T05:11:16.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.474+0000 7efe1aa74740 1 Processor -- start 2024-08-20T05:11:16.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.474+0000 7efe1aa74740 1 -- start start 2024-08-20T05:11:16.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.474+0000 7efe1aa74740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fc3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.474+0000 7efe1aa74740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fcfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.474+0000 7efe1aa74740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fd0280 0x55c4e1fd2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.474+0000 7efe1aa74740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c4e1f3a870 con 0x55c4e1fc42f0 2024-08-20T05:11:16.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.474+0000 7efe1aa74740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c4e1f29d70 con 0x55c4e1fc39d0 2024-08-20T05:11:16.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.474+0000 7efe1aa74740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c4e1f2ddb0 con 0x55c4e1fd0280 2024-08-20T05:11:16.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.475+0000 7efe15e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fc3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:16.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.475+0000 7efe14a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fd0280 0x55c4e1fd2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:16.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.475+0000 7efe15e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fc3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43888/0 (socket says 172.21.15.37:43888) 2024-08-20T05:11:16.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.475+0000 7efe15e00640 1 -- 172.21.15.37:0/3244958534 learned_addr learned my addr 172.21.15.37:0/3244958534 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:16.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.475+0000 7efe15e00640 1 -- 172.21.15.37:0/3244958534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fd0280 msgr2=0x55c4e1fd2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:16.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.475+0000 7efe15e00640 1 --2- 172.21.15.37:0/3244958534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fd0280 0x55c4e1fd2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.475+0000 7efe15e00640 1 -- 172.21.15.37:0/3244958534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fc42f0 msgr2=0x55c4e1fcfd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:11:16.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.475+0000 7efe15e00640 1 --2- 172.21.15.37:0/3244958534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fcfd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.475+0000 7efe15e00640 1 -- 172.21.15.37:0/3244958534 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4e1c89930 con 0x55c4e1fc39d0 2024-08-20T05:11:16.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.475+0000 7efe14a00640 1 --2- 172.21.15.37:0/3244958534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fd0280 0x55c4e1fd2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:16.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.475+0000 7efe15e00640 1 --2- 172.21.15.37:0/3244958534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fc3db0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7efe08009ca0 tx=0x7efe08011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa70089218c7ec38 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:16.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.476+0000 7efe0e000640 1 -- 172.21.15.37:0/1404137531 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7efe0402fbd0 con 0x7efe10104ca0 2024-08-20T05:11:16.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.477+0000 7efe02600640 1 -- 172.21.15.37:0/3244958534 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0801e070 con 0x55c4e1fc39d0 2024-08-20T05:11:16.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.477+0000 7efe02600640 1 -- 172.21.15.37:0/3244958534 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe08009e50 con 0x55c4e1fc39d0 2024-08-20T05:11:16.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.477+0000 7efe02600640 1 -- 172.21.15.37:0/3244958534 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0800ea10 con 0x55c4e1fc39d0 2024-08-20T05:11:16.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.477+0000 7efe0e000640 1 --2- 172.21.15.37:0/1404137531 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdf80b3bd0 0x7efdf80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.477+0000 7efe0e000640 1 -- 172.21.15.37:0/1404137531 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7efe04105480 con 0x7efe10104ca0 2024-08-20T05:11:16.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.478+0000 7efe15400640 1 --2- 172.21.15.37:0/1404137531 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdf80b3bd0 0x7efdf80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:16.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.478+0000 7efe1aa74740 1 -- 172.21.15.37:0/3244958534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fc39d0 msgr2=0x55c4e1fc3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:16.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.478+0000 7efe1aa74740 1 --2- 172.21.15.37:0/3244958534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fc3db0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7efe08009ca0 tx=0x7efe08011810 comp rx=0 tx=0).stop 2024-08-20T05:11:16.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.478+0000 7efe1aa74740 1 -- 172.21.15.37:0/3244958534 shutdown_connections 2024-08-20T05:11:16.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.478+0000 7efe1aa74740 1 --2- 172.21.15.37:0/3244958534 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fd0280 0x55c4e1fd2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.478+0000 7efe1aa74740 1 --2- 172.21.15.37:0/3244958534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fcfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.478+0000 7efe1aa74740 1 --2- 172.21.15.37:0/3244958534 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fc3db0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.478+0000 7efe1aa74740 1 -- 172.21.15.37:0/3244958534 >> 172.21.15.37:0/3244958534 conn(0x55c4e1fc1800 msgr2=0x55c4e1fc29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:16.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.478+0000 7efe15400640 1 --2- 172.21.15.37:0/1404137531 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdf80b3bd0 0x7efdf80b6090 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efe040cbd30 tx=0x7efe0402a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:16.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.478+0000 7efe1aa74740 1 -- 172.21.15.37:0/3244958534 shutdown_connections 2024-08-20T05:11:16.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.479+0000 7efe1aa74740 1 -- 172.21.15.37:0/3244958534 wait complete. 2024-08-20T05:11:16.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.479+0000 7efe1aa74740 1 -- start start 2024-08-20T05:11:16.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.479+0000 7efe1aa74740 1 Processor -- start 2024-08-20T05:11:16.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.480+0000 7efe1aa74740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fcfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.480+0000 7efe1aa74740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.480+0000 7efe1aa74740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fd0280 0x55c4e1fcd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.480+0000 7efe1aa74740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c4e1d8c890 con 0x55c4e1fd0280 2024-08-20T05:11:16.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.480+0000 7efe1aa74740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c4e1eb0b00 con 0x55c4e1fc42f0 2024-08-20T05:11:16.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.480+0000 7efe1aa74740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c4e1fd2fd0 con 0x55c4e1fc39d0 2024-08-20T05:11:16.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.480+0000 7efe1aa74740 10 client.0 _ll_register_callbacks cb 0x55c4e1f24dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:16.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.480+0000 7efe15e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fcfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:16.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.480+0000 7efe15e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fd0280 0x55c4e1fcd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:16.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.481+0000 7efe15e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fcfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52000/0 (socket says 172.21.15.37:52000) 2024-08-20T05:11:16.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.481+0000 7efe15e00640 1 -- 172.21.15.37:0/651450825 learned_addr learned my addr 172.21.15.37:0/651450825 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:16.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.481+0000 7efe14a00640 1 --2- 172.21.15.37:0/651450825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:16.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.481+0000 7efe14a00640 1 -- 172.21.15.37:0/651450825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 msgr2=0x55c4e1fcfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:16.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.481+0000 7efe14a00640 1 --2- 172.21.15.37:0/651450825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fcfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.481+0000 7efe14a00640 1 -- 172.21.15.37:0/651450825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fd0280 msgr2=0x55c4e1fcd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:16.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.481+0000 7efe14a00640 1 --2- 172.21.15.37:0/651450825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fd0280 0x55c4e1fcd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.481+0000 7efe14a00640 1 -- 172.21.15.37:0/651450825 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4e1ef1a30 con 0x55c4e1fc42f0 2024-08-20T05:11:16.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.481+0000 7efe14a00640 1 --2- 172.21.15.37:0/651450825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fccf90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7efe1010a2f0 tx=0x7efdfc00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55a92abd53c6b1be server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:16.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.481+0000 7efdf6a00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:11:16.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.482+0000 7efdf6a00640 1 -- 172.21.15.37:0/651450825 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdfc0120d0 con 0x55c4e1fc42f0 2024-08-20T05:11:16.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.482+0000 7efdf6a00640 1 -- 172.21.15.37:0/651450825 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7efdfc004030 con 0x55c4e1fc42f0 2024-08-20T05:11:16.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.482+0000 7efe1aa74740 1 -- 172.21.15.37:0/651450825 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe08009e50 con 0x55c4e1fc42f0 2024-08-20T05:11:16.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.482+0000 7efdf6a00640 1 -- 172.21.15.37:0/651450825 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7efdfc012270 con 0x55c4e1fc42f0 2024-08-20T05:11:16.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.482+0000 7efe1aa74740 10 client.27794 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:16.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.482+0000 7efe1aa74740 1 -- 172.21.15.37:0/651450825 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55c4e1fde930 con 0x55c4e1fc42f0 2024-08-20T05:11:16.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.483+0000 7efdf6a00640 1 -- 172.21.15.37:0/651450825 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe08009e50 con 0x55c4e1fc42f0 2024-08-20T05:11:16.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.483+0000 7efdf6a00640 1 -- 172.21.15.37:0/651450825 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7efdfc01c460 con 0x55c4e1fc42f0 2024-08-20T05:11:16.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.483+0000 7efe1aa74740 10 client.27794 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:16.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.483+0000 7efe1aa74740 10 client.27794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:16.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.483+0000 7efe1aa74740 20 client.27794 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:16.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.483+0000 7efe1aa74740 1 --2- 172.21.15.37:0/651450825 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c4e1fdfe90 0x55c4e1fe22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.483+0000 7efe1aa74740 4 client.27794 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:16.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.483+0000 7efe1aa74740 1 -- 172.21.15.37:0/651450825 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4e1f3c7c0 con 0x55c4e1fdfe90 2024-08-20T05:11:16.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.483+0000 7efe15e00640 1 --2- 172.21.15.37:0/651450825 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c4e1fdfe90 0x55c4e1fe22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:16.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.484+0000 7efe15e00640 1 --2- 172.21.15.37:0/651450825 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c4e1fdfe90 0x55c4e1fe22b0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abdf22c55d4ddb14 server_cookie=403744975814611d in_seq=0 out_seq=0 2024-08-20T05:11:16.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.484+0000 7efdf6a00640 10 client.27794 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.485+0000 7efdf6a00640 1 -- 172.21.15.37:0/651450825 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c4e1f3c7c0 con 0x55c4e1fdfe90 2024-08-20T05:11:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.485+0000 7efdf6a00640 10 client.27794 handle_command_reply: tid=0 2024-08-20T05:11:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.485+0000 7efe1aa74740 1 client.27794 shutdown 2024-08-20T05:11:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.485+0000 7efe1aa74740 1 -- 172.21.15.37:0/651450825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fc42f0 msgr2=0x55c4e1fccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.485+0000 7efe1aa74740 1 --2- 172.21.15.37:0/651450825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fccf90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7efe1010a2f0 tx=0x7efdfc00f790 comp rx=0 tx=0).stop 2024-08-20T05:11:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.485+0000 7efe1aa74740 1 -- 172.21.15.37:0/651450825 shutdown_connections 2024-08-20T05:11:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.485+0000 7efe1aa74740 1 --2- 172.21.15.37:0/651450825 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c4e1fdfe90 0x55c4e1fe22b0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.485+0000 7efe1aa74740 1 --2- 172.21.15.37:0/651450825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fd0280 0x55c4e1fcd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.485+0000 7efe1aa74740 1 --2- 172.21.15.37:0/651450825 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fccf90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.485+0000 7efe1aa74740 1 --2- 172.21.15.37:0/651450825 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fcfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.485+0000 7efdf6a00640 0 client.27794 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.485+0000 7efe1aa74740 1 -- 172.21.15.37:0/651450825 >> 172.21.15.37:0/651450825 conn(0x55c4e1fc1800 msgr2=0x55c4e1fc73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.485+0000 7efe1aa74740 1 -- 172.21.15.37:0/651450825 shutdown_connections 2024-08-20T05:11:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.486+0000 7efe1aa74740 1 -- 172.21.15.37:0/651450825 wait complete. 2024-08-20T05:11:16.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.486+0000 7efe1aa74740 20 client.27794 trim_cache size 0 max 16384 2024-08-20T05:11:16.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.504+0000 7efe1aa74740 1 Processor -- start 2024-08-20T05:11:16.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.504+0000 7efe1aa74740 1 -- start start 2024-08-20T05:11:16.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.504+0000 7efe1aa74740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fc87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.504+0000 7efe1aa74740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fdc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.504+0000 7efe1aa74740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fd0280 0x55c4e1fe7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.504+0000 7efe1aa74740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe101b19c0 con 0x55c4e1fc42f0 2024-08-20T05:11:16.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.504+0000 7efe1aa74740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efe101b35c0 con 0x55c4e1fd0280 2024-08-20T05:11:16.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.504+0000 7efe1aa74740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efe101b2090 con 0x55c4e1fc39d0 2024-08-20T05:11:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.505+0000 7efe14a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fdc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.505+0000 7efe15e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fc87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.505+0000 7efe14a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fdc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34154/0 (socket says 172.21.15.37:34154) 2024-08-20T05:11:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.505+0000 7efe14a00640 1 -- 172.21.15.37:0/1589822080 learned_addr learned my addr 172.21.15.37:0/1589822080 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.505+0000 7efe15e00640 1 --2- 172.21.15.37:0/1589822080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fd0280 0x55c4e1fe7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.505+0000 7efe15e00640 1 -- 172.21.15.37:0/1589822080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fd0280 msgr2=0x55c4e1fe7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.505+0000 7efe15e00640 1 --2- 172.21.15.37:0/1589822080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fd0280 0x55c4e1fe7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.505+0000 7efe15e00640 1 -- 172.21.15.37:0/1589822080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fc42f0 msgr2=0x55c4e1fdc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.505+0000 7efe15e00640 1 --2- 172.21.15.37:0/1589822080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fdc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.505+0000 7efe15e00640 1 -- 172.21.15.37:0/1589822080 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4e1fc2ee0 con 0x55c4e1fc39d0 2024-08-20T05:11:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.505+0000 7efe15e00640 1 --2- 172.21.15.37:0/1589822080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fc87c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x55c4e1fe2b20 tx=0x7efe08005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dce0da98e905e8e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.506+0000 7efe01c00640 1 -- 172.21.15.37:0/1589822080 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0801e070 con 0x55c4e1fc39d0 2024-08-20T05:11:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.506+0000 7efe01c00640 1 -- 172.21.15.37:0/1589822080 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe0801f040 con 0x55c4e1fc39d0 2024-08-20T05:11:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.506+0000 7efe01c00640 1 -- 172.21.15.37:0/1589822080 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe080035f0 con 0x55c4e1fc39d0 2024-08-20T05:11:16.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.506+0000 7efe1aa74740 1 -- 172.21.15.37:0/1589822080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 msgr2=0x55c4e1fc87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:16.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.506+0000 7efe1aa74740 1 --2- 172.21.15.37:0/1589822080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fc87c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x55c4e1fe2b20 tx=0x7efe08005f90 comp rx=0 tx=0).stop 2024-08-20T05:11:16.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.506+0000 7efe1aa74740 1 -- 172.21.15.37:0/1589822080 shutdown_connections 2024-08-20T05:11:16.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.507+0000 7efe1aa74740 1 --2- 172.21.15.37:0/1589822080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fd0280 0x55c4e1fe7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.507+0000 7efe1aa74740 1 --2- 172.21.15.37:0/1589822080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fdc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.507+0000 7efe1aa74740 1 --2- 172.21.15.37:0/1589822080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fc87c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.507+0000 7efe1aa74740 1 -- 172.21.15.37:0/1589822080 >> 172.21.15.37:0/1589822080 conn(0x55c4e1fc1800 msgr2=0x55c4e1fcede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.507+0000 7efe1aa74740 1 -- 172.21.15.37:0/1589822080 shutdown_connections 2024-08-20T05:11:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.507+0000 7efe1aa74740 1 -- 172.21.15.37:0/1589822080 wait complete. 2024-08-20T05:11:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.507+0000 7efe1aa74740 1 -- start start 2024-08-20T05:11:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.507+0000 7efe1aa74740 1 Processor -- start 2024-08-20T05:11:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.508+0000 7efe1aa74740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fd86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.508+0000 7efe1aa74740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fc9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.508+0000 7efe1aa74740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fd0280 0x55c4e1fca020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.508+0000 7efe1aa74740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe101b2e90 con 0x55c4e1fc42f0 2024-08-20T05:11:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.508+0000 7efe1aa74740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efe101b2760 con 0x55c4e1fd0280 2024-08-20T05:11:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.508+0000 7efe1aa74740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efe101af9a0 con 0x55c4e1fc39d0 2024-08-20T05:11:16.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.508+0000 7efe1aa74740 10 client.0 _ll_register_callbacks cb 0x7efdfc009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:16.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.508+0000 7efe15e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fd86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:16.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.508+0000 7efe14a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fc9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:16.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.508+0000 7efe15e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fd86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52014/0 (socket says 172.21.15.37:52014) 2024-08-20T05:11:16.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.508+0000 7efe15e00640 1 -- 172.21.15.37:0/1030721816 learned_addr learned my addr 172.21.15.37:0/1030721816 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:16.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.508+0000 7efe15e00640 1 --2- 172.21.15.37:0/1030721816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fd0280 0x55c4e1fca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:16.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.509+0000 7efe14a00640 1 -- 172.21.15.37:0/1030721816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 msgr2=0x55c4e1fd86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:16.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.509+0000 7efe14a00640 1 --2- 172.21.15.37:0/1030721816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fd86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.509+0000 7efe14a00640 1 -- 172.21.15.37:0/1030721816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fd0280 msgr2=0x55c4e1fca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.509+0000 7efe14a00640 1 --2- 172.21.15.37:0/1030721816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fd0280 0x55c4e1fca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.509+0000 7efe14a00640 1 -- 172.21.15.37:0/1030721816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4e1fca610 con 0x55c4e1fc42f0 2024-08-20T05:11:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.509+0000 7efe15e00640 1 --2- 172.21.15.37:0/1030721816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fd0280 0x55c4e1fca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:11:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.509+0000 7efe14a00640 1 --2- 172.21.15.37:0/1030721816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fc9ae0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7efdfc000c00 tx=0x7efdfc0120d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94139e54d7da5ff server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.509+0000 7efdf6a00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:11:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.509+0000 7efdf6a00640 1 -- 172.21.15.37:0/1030721816 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdfc01cd00 con 0x55c4e1fc42f0 2024-08-20T05:11:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.509+0000 7efdf6a00640 1 -- 172.21.15.37:0/1030721816 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7efdfc005040 con 0x55c4e1fc42f0 2024-08-20T05:11:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.509+0000 7efe1aa74740 1 -- 172.21.15.37:0/1030721816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe0801f040 con 0x55c4e1fc42f0 2024-08-20T05:11:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.510+0000 7efdf6a00640 1 -- 172.21.15.37:0/1030721816 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7efdfc005280 con 0x55c4e1fc42f0 2024-08-20T05:11:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.510+0000 7efe1aa74740 10 client.17322 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:16.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.510+0000 7efe1aa74740 1 -- 172.21.15.37:0/1030721816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55c4e204a9f0 con 0x55c4e1fc42f0 2024-08-20T05:11:16.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.510+0000 7efdf6a00640 1 -- 172.21.15.37:0/1030721816 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe0801f040 con 0x55c4e1fc42f0 2024-08-20T05:11:16.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.510+0000 7efdf6a00640 1 -- 172.21.15.37:0/1030721816 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7efdfc031030 con 0x55c4e1fc42f0 2024-08-20T05:11:16.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.510+0000 7efe1aa74740 10 client.17322 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:16.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.510+0000 7efe1aa74740 10 client.17322 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:16.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.510+0000 7efe1aa74740 20 client.17322 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:16.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.510+0000 7efe1aa74740 1 --2- 172.21.15.37:0/1030721816 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c4e204b250 0x55c4e204d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:16.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.510+0000 7efe1aa74740 4 client.17322 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T05:11:16.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.510+0000 7efe1aa74740 1 -- 172.21.15.37:0/1030721816 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c4e1f38260 con 0x55c4e204b250 2024-08-20T05:11:16.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.511+0000 7efe15e00640 1 --2- 172.21.15.37:0/1030721816 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c4e204b250 0x55c4e204d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:16.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.511+0000 7efe15e00640 1 --2- 172.21.15.37:0/1030721816 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c4e204b250 0x55c4e204d670 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4140fbca1da26fec server_cookie=ead48ad824806d73 in_seq=0 out_seq=0 2024-08-20T05:11:16.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.511+0000 7efdf6a00640 10 client.17322 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:16.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.512+0000 7efdf6a00640 1 -- 172.21.15.37:0/1030721816 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c4e1f38260 con 0x55c4e204b250 2024-08-20T05:11:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.512+0000 7efdf6a00640 10 client.17322 handle_command_reply: tid=0 2024-08-20T05:11:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.513+0000 7efe1aa74740 1 client.17322 shutdown 2024-08-20T05:11:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.513+0000 7efe1aa74740 1 -- 172.21.15.37:0/1030721816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fc42f0 msgr2=0x55c4e1fc9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.513+0000 7efe1aa74740 1 --2- 172.21.15.37:0/1030721816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fc9ae0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7efdfc000c00 tx=0x7efdfc0120d0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.513+0000 7efe1aa74740 1 -- 172.21.15.37:0/1030721816 shutdown_connections 2024-08-20T05:11:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.513+0000 7efe1aa74740 1 --2- 172.21.15.37:0/1030721816 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c4e204b250 0x55c4e204d670 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.513+0000 7efe1aa74740 1 --2- 172.21.15.37:0/1030721816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c4e1fd0280 0x55c4e1fca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.513+0000 7efe1aa74740 1 --2- 172.21.15.37:0/1030721816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c4e1fc42f0 0x55c4e1fc9ae0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.513+0000 7efe1aa74740 1 --2- 172.21.15.37:0/1030721816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c4e1fc39d0 0x55c4e1fd86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.513+0000 7efdf6a00640 0 client.17322 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.513+0000 7efe1aa74740 1 -- 172.21.15.37:0/1030721816 >> 172.21.15.37:0/1030721816 conn(0x55c4e1fc1800 msgr2=0x55c4e1fce5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.513+0000 7efe1aa74740 1 -- 172.21.15.37:0/1030721816 shutdown_connections 2024-08-20T05:11:16.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.513+0000 7efe1aa74740 1 -- 172.21.15.37:0/1030721816 wait complete. 2024-08-20T05:11:16.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.514+0000 7efe1aa74740 20 client.17322 trim_cache size 0 max 16384 2024-08-20T05:11:16.518 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:11:16.518 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-20T05:11:16.518 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "778cb2be-7329-4178-a9cc-54f396b2c461", 2024-08-20T05:11:16.518 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-20T05:11:16.518 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:11:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.514+0000 7efe17e00640 1 -- 172.21.15.37:0/1404137531 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdf80b3bd0 msgr2=0x7efdf80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.514+0000 7efe17e00640 1 --2- 172.21.15.37:0/1404137531 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdf80b3bd0 0x7efdf80b6090 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7efe040cbd30 tx=0x7efe0402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.514+0000 7efe17e00640 1 -- 172.21.15.37:0/1404137531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe10104ca0 msgr2=0x7efe1019b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.514+0000 7efe17e00640 1 --2- 172.21.15.37:0/1404137531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe10104ca0 0x7efe1019b190 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7efe04005e30 tx=0x7efe04031840 comp rx=0 tx=0).stop 2024-08-20T05:11:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.514+0000 7efe17e00640 1 -- 172.21.15.37:0/1404137531 shutdown_connections 2024-08-20T05:11:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.514+0000 7efe17e00640 1 --2- 172.21.15.37:0/1404137531 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdf80b3bd0 0x7efdf80b6090 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.514+0000 7efe17e00640 1 --2- 172.21.15.37:0/1404137531 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe1010b030 0x7efe101a0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.514+0000 7efe17e00640 1 --2- 172.21.15.37:0/1404137531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1010a6b0 0x7efe1019b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.514+0000 7efe17e00640 1 --2- 172.21.15.37:0/1404137531 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe10104ca0 0x7efe1019b190 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.514+0000 7efe17e00640 1 -- 172.21.15.37:0/1404137531 >> 172.21.15.37:0/1404137531 conn(0x7efe10100730 msgr2=0x7efe10102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.515+0000 7efe17e00640 1 -- 172.21.15.37:0/1404137531 shutdown_connections 2024-08-20T05:11:16.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:16.515+0000 7efe17e00640 1 -- 172.21.15.37:0/1404137531 wait complete. 2024-08-20T05:11:16.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:16 smithi037 ceph-mon[17265]: pgmap v672: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 365 KiB/s wr, 54 op/s 2024-08-20T05:11:16.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:16 smithi135 ceph-mon[22342]: pgmap v672: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 365 KiB/s wr, 54 op/s 2024-08-20T05:11:16.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:16 smithi130 ceph-mon[22007]: pgmap v672: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 365 KiB/s wr, 54 op/s 2024-08-20T05:11:17.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:11:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:17 smithi037 ceph-mon[17265]: scrub queued for path: / 2024-08-20T05:11:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:17 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:17 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:11:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:17 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:11:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:17 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:11:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:17 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:17 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:17 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:11:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:17 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:11:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:17 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:11:17.769 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:17 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.769 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:17 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.769 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:17 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.770 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:17 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.858 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:17.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:17 smithi135 ceph-mon[22342]: scrub queued for path: / 2024-08-20T05:11:17.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:17 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:17 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:11:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:17 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:11:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:17 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:11:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:17 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:17 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:17 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:11:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:17 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:11:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:17 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:11:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:17 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:17 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:17 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:17 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:17 smithi130 ceph-mon[22007]: scrub queued for path: / 2024-08-20T05:11:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:17 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:17 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:11:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:17 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:11:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:17 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:11:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:17 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:17 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:17 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:11:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:17 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:11:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:17 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:11:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:17 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:17 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:17 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:17.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:17 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:11:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 500.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:11:18.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.484+0000 7f6efd000640 1 -- 172.21.15.37:0/1313857570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef8108320 msgr2=0x7f6ef8108760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:18.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.484+0000 7f6efd000640 1 --2- 172.21.15.37:0/1313857570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef8108320 0x7f6ef8108760 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009900 tx=0x7f6ee402a410 comp rx=0 tx=0).stop 2024-08-20T05:11:18.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.484+0000 7f6efd000640 1 -- 172.21.15.37:0/1313857570 shutdown_connections 2024-08-20T05:11:18.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.484+0000 7f6efd000640 1 --2- 172.21.15.37:0/1313857570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef8108ca0 0x7f6ef810f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.484+0000 7f6efd000640 1 --2- 172.21.15.37:0/1313857570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef8108320 0x7f6ef8108760 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.484+0000 7f6efd000640 1 --2- 172.21.15.37:0/1313857570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ef8102910 0x7f6ef8102cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.484+0000 7f6efd000640 1 -- 172.21.15.37:0/1313857570 >> 172.21.15.37:0/1313857570 conn(0x7f6ef80fe3c0 msgr2=0x7f6ef81007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.484+0000 7f6efd000640 1 -- 172.21.15.37:0/1313857570 shutdown_connections 2024-08-20T05:11:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.484+0000 7f6efd000640 1 -- 172.21.15.37:0/1313857570 wait complete. 2024-08-20T05:11:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.485+0000 7f6efd000640 1 Processor -- start 2024-08-20T05:11:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.485+0000 7f6efd000640 1 -- start start 2024-08-20T05:11:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.485+0000 7f6efd000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef8102910 0x7f6ef819af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.485+0000 7f6efd000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef8108320 0x7f6ef819b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.486+0000 7f6efd000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ef8108ca0 0x7f6ef81a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.486+0000 7f6efd000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef8112940 con 0x7f6ef8102910 2024-08-20T05:11:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.486+0000 7f6efd000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef81127c0 con 0x7f6ef8108ca0 2024-08-20T05:11:18.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.486+0000 7f6efd000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef8112ac0 con 0x7f6ef8108320 2024-08-20T05:11:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.486+0000 7f6ef7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef8102910 0x7f6ef819af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.486+0000 7f6ef7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef8102910 0x7f6ef819af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34184/0 (socket says 172.21.15.37:34184) 2024-08-20T05:11:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.486+0000 7f6ef7400640 1 -- 172.21.15.37:0/3142250510 learned_addr learned my addr 172.21.15.37:0/3142250510 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.486+0000 7f6ef6a00640 1 --2- 172.21.15.37:0/3142250510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef8108320 0x7f6ef819b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.486+0000 7f6ef7e00640 1 --2- 172.21.15.37:0/3142250510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ef8108ca0 0x7f6ef81a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.486+0000 7f6ef7400640 1 -- 172.21.15.37:0/3142250510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef8108320 msgr2=0x7f6ef819b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.486+0000 7f6ef7400640 1 --2- 172.21.15.37:0/3142250510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef8108320 0x7f6ef819b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.486+0000 7f6ef7400640 1 -- 172.21.15.37:0/3142250510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ef8108ca0 msgr2=0x7f6ef81a0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.486+0000 7f6ef7400640 1 --2- 172.21.15.37:0/3142250510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ef8108ca0 0x7f6ef81a0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.486+0000 7f6ef7400640 1 -- 172.21.15.37:0/3142250510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef81a0ff0 con 0x7f6ef8102910 2024-08-20T05:11:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.486+0000 7f6ef6a00640 1 --2- 172.21.15.37:0/3142250510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef8108320 0x7f6ef819b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:18.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.487+0000 7f6ef7400640 1 --2- 172.21.15.37:0/3142250510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef8102910 0x7f6ef819af40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009d50 tx=0x7f6ee800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.487+0000 7f6eefe00640 1 -- 172.21.15.37:0/3142250510 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8003b70 con 0x7f6ef8102910 2024-08-20T05:11:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.487+0000 7f6eefe00640 1 -- 172.21.15.37:0/3142250510 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ee8003d10 con 0x7f6ef8102910 2024-08-20T05:11:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.487+0000 7f6efd000640 1 -- 172.21.15.37:0/3142250510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef81a12e0 con 0x7f6ef8102910 2024-08-20T05:11:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.487+0000 7f6eefe00640 1 -- 172.21.15.37:0/3142250510 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80108a0 con 0x7f6ef8102910 2024-08-20T05:11:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.487+0000 7f6efd000640 1 -- 172.21.15.37:0/3142250510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef81a79a0 con 0x7f6ef8102910 2024-08-20T05:11:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.490+0000 7f6f01094740 1 Processor -- start 2024-08-20T05:11:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.490+0000 7f6f01094740 1 -- start start 2024-08-20T05:11:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.491+0000 7f6f01094740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2aa80 0x5565c3d2ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.491+0000 7f6f01094740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d2b3a0 0x5565c3d36df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.491+0000 7f6f01094740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d37330 0x5565c3d39720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.491+0000 7f6f01094740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5565c3ca0a60 con 0x5565c3d2b3a0 2024-08-20T05:11:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.491+0000 7f6f01094740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5565c3c8ff60 con 0x5565c3d37330 2024-08-20T05:11:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.491+0000 7f6f01094740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5565c3c93fa0 con 0x5565c3d2aa80 2024-08-20T05:11:18.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.491+0000 7f6eefe00640 1 -- 172.21.15.37:0/3142250510 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6ee8004000 con 0x7f6ef8102910 2024-08-20T05:11:18.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.491+0000 7f6ef7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2aa80 0x5565c3d2ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.491+0000 7f6ef7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2aa80 0x5565c3d2ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52054/0 (socket says 172.21.15.37:52054) 2024-08-20T05:11:18.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.491+0000 7f6ef7e00640 1 -- 172.21.15.37:0/253387601 learned_addr learned my addr 172.21.15.37:0/253387601 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:18.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.491+0000 7f6ef7400640 1 --2- 172.21.15.37:0/253387601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d2b3a0 0x5565c3d36df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.491+0000 7f6ef6a00640 1 --2- 172.21.15.37:0/253387601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d37330 0x5565c3d39720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6ef6a00640 1 -- 172.21.15.37:0/253387601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2aa80 msgr2=0x5565c3d2ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:18.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6ef6a00640 1 --2- 172.21.15.37:0/253387601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2aa80 0x5565c3d2ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6ef6a00640 1 -- 172.21.15.37:0/253387601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d2b3a0 msgr2=0x5565c3d36df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:18.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6ef6a00640 1 --2- 172.21.15.37:0/253387601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d2b3a0 0x5565c3d36df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6ef6a00640 1 -- 172.21.15.37:0/253387601 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565c3c363e0 con 0x5565c3d37330 2024-08-20T05:11:18.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6ef7e00640 1 --2- 172.21.15.37:0/253387601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2aa80 0x5565c3d2ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:18.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6ef6a00640 1 --2- 172.21.15.37:0/253387601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d37330 0x5565c3d39720 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6ee402aa00 tx=0x7f6ee40043f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1833e9168f483e7b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:18.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6eecc00640 1 -- 172.21.15.37:0/253387601 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4035040 con 0x5565c3d37330 2024-08-20T05:11:18.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6eecc00640 1 -- 172.21.15.37:0/253387601 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ee4004770 con 0x5565c3d37330 2024-08-20T05:11:18.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6eecc00640 1 -- 172.21.15.37:0/253387601 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4003850 con 0x5565c3d37330 2024-08-20T05:11:18.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6eefe00640 1 --2- 172.21.15.37:0/3142250510 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6edc0b3c70 0x7f6edc0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6f01094740 1 -- 172.21.15.37:0/253387601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d37330 msgr2=0x5565c3d39720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:18.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6f01094740 1 --2- 172.21.15.37:0/253387601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d37330 0x5565c3d39720 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6ee402aa00 tx=0x7f6ee40043f0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6eefe00640 1 -- 172.21.15.37:0/3142250510 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6ee80e4670 con 0x7f6ef8102910 2024-08-20T05:11:18.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6ef7e00640 1 --2- 172.21.15.37:0/3142250510 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6edc0b3c70 0x7f6edc0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6f01094740 1 -- 172.21.15.37:0/253387601 shutdown_connections 2024-08-20T05:11:18.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6f01094740 1 --2- 172.21.15.37:0/253387601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d37330 0x5565c3d39720 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6f01094740 1 --2- 172.21.15.37:0/253387601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d2b3a0 0x5565c3d36df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6f01094740 1 --2- 172.21.15.37:0/253387601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2aa80 0x5565c3d2ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6f01094740 1 -- 172.21.15.37:0/253387601 >> 172.21.15.37:0/253387601 conn(0x5565c3d288b0 msgr2=0x5565c3d29a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:18.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6f01094740 1 -- 172.21.15.37:0/253387601 shutdown_connections 2024-08-20T05:11:18.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.492+0000 7f6f01094740 1 -- 172.21.15.37:0/253387601 wait complete. 2024-08-20T05:11:18.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.494+0000 7f6f01094740 1 -- start start 2024-08-20T05:11:18.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.494+0000 7f6ef7e00640 1 --2- 172.21.15.37:0/3142250510 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6edc0b3c70 0x7f6edc0b6130 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009ea0 tx=0x7f6ef0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:18.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.494+0000 7f6f01094740 1 Processor -- start 2024-08-20T05:11:18.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.494+0000 7f6f01094740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 0x5565c3d36ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.494+0000 7f6f01094740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2b3a0 0x5565c3d33f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.495+0000 7f6f01094740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d37330 0x5565c3d34460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.495+0000 7f6f01094740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5565c3af2700 con 0x5565c3d37330 2024-08-20T05:11:18.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.495+0000 7f6f01094740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5565c3c2b250 con 0x5565c3d2aa80 2024-08-20T05:11:18.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.495+0000 7f6f01094740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5565c3d39f50 con 0x5565c3d2b3a0 2024-08-20T05:11:18.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.495+0000 7f6f01094740 10 client.0 _ll_register_callbacks cb 0x5565c3c8a180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:18.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.495+0000 7f6ef7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d37330 0x5565c3d34460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.495+0000 7f6ef7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 0x5565c3d36ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.495+0000 7f6ef7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 0x5565c3d36ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43960/0 (socket says 172.21.15.37:43960) 2024-08-20T05:11:18.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.495+0000 7f6ef7400640 1 -- 172.21.15.37:0/3445839957 learned_addr learned my addr 172.21.15.37:0/3445839957 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:18.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.495+0000 7f6ef6a00640 1 --2- 172.21.15.37:0/3445839957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2b3a0 0x5565c3d33f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.495+0000 7f6ef7e00640 1 -- 172.21.15.37:0/3445839957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2b3a0 msgr2=0x5565c3d33f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:18.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.495+0000 7f6ef7e00640 1 --2- 172.21.15.37:0/3445839957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2b3a0 0x5565c3d33f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.495+0000 7f6ef7e00640 1 -- 172.21.15.37:0/3445839957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 msgr2=0x5565c3d36ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:18.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.495+0000 7f6ef7e00640 1 --2- 172.21.15.37:0/3445839957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 0x5565c3d36ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.495+0000 7f6ef7e00640 1 -- 172.21.15.37:0/3445839957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565c39ef650 con 0x5565c3d37330 2024-08-20T05:11:18.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.495+0000 7f6ef7400640 1 --2- 172.21.15.37:0/3445839957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 0x5565c3d36ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:18.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.496+0000 7f6ef7e00640 1 --2- 172.21.15.37:0/3445839957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d37330 0x5565c3d34460 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6ef001e9d0 tx=0x7f6ef0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d418c8c1ff752d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:18.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.496+0000 7f6ee1600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:11:18.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.496+0000 7f6ee1600640 1 -- 172.21.15.37:0/3445839957 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef002e060 con 0x5565c3d37330 2024-08-20T05:11:18.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.496+0000 7f6f01094740 1 -- 172.21.15.37:0/3445839957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ee4004770 con 0x5565c3d37330 2024-08-20T05:11:18.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.496+0000 7f6ee1600640 1 -- 172.21.15.37:0/3445839957 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6ef0018030 con 0x5565c3d37330 2024-08-20T05:11:18.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.496+0000 7f6ee1600640 1 -- 172.21.15.37:0/3445839957 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f6ef0035050 con 0x5565c3d37330 2024-08-20T05:11:18.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.496+0000 7f6f01094740 10 client.17334 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:18.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.496+0000 7f6f01094740 1 -- 172.21.15.37:0/3445839957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5565c3d45790 con 0x5565c3d37330 2024-08-20T05:11:18.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.496+0000 7f6ee1600640 1 -- 172.21.15.37:0/3445839957 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ee4004770 con 0x5565c3d37330 2024-08-20T05:11:18.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.497+0000 7f6ee1600640 1 -- 172.21.15.37:0/3445839957 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f6ef001c430 con 0x5565c3d37330 2024-08-20T05:11:18.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.497+0000 7f6f01094740 10 client.17334 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:18.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.497+0000 7f6f01094740 10 client.17334 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:18.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.497+0000 7f6f01094740 20 client.17334 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:18.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.497+0000 7f6f01094740 1 --2- 172.21.15.37:0/3445839957 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5565c3d46ca0 0x5565c3d490b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.497+0000 7f6f01094740 4 client.17334 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:18.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.497+0000 7f6f01094740 1 -- 172.21.15.37:0/3445839957 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565c3ca29b0 con 0x5565c3d46ca0 2024-08-20T05:11:18.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.497+0000 7f6ef7400640 1 --2- 172.21.15.37:0/3445839957 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5565c3d46ca0 0x5565c3d490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.498+0000 7f6ef7400640 1 --2- 172.21.15.37:0/3445839957 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5565c3d46ca0 0x5565c3d490b0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70453af5613066df server_cookie=213d68e2086c9cb9 in_seq=0 out_seq=0 2024-08-20T05:11:18.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.498+0000 7f6ee1600640 10 client.17334 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:18.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.498+0000 7f6ee1600640 1 -- 172.21.15.37:0/3445839957 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5565c3ca29b0 con 0x5565c3d46ca0 2024-08-20T05:11:18.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.498+0000 7f6ee1600640 10 client.17334 handle_command_reply: tid=0 2024-08-20T05:11:18.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.499+0000 7f6f01094740 1 client.17334 shutdown 2024-08-20T05:11:18.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.499+0000 7f6f01094740 1 -- 172.21.15.37:0/3445839957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d37330 msgr2=0x5565c3d34460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:18.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.499+0000 7f6f01094740 1 --2- 172.21.15.37:0/3445839957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d37330 0x5565c3d34460 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6ef001e9d0 tx=0x7f6ef0004730 comp rx=0 tx=0).stop 2024-08-20T05:11:18.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.499+0000 7f6f01094740 1 -- 172.21.15.37:0/3445839957 shutdown_connections 2024-08-20T05:11:18.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.499+0000 7f6f01094740 1 --2- 172.21.15.37:0/3445839957 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5565c3d46ca0 0x5565c3d490b0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.499+0000 7f6f01094740 1 --2- 172.21.15.37:0/3445839957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d37330 0x5565c3d34460 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.499+0000 7f6f01094740 1 --2- 172.21.15.37:0/3445839957 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2b3a0 0x5565c3d33f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.499+0000 7f6f01094740 1 --2- 172.21.15.37:0/3445839957 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 0x5565c3d36ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.499+0000 7f6ee1600640 0 client.17334 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:18.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.499+0000 7f6f01094740 1 -- 172.21.15.37:0/3445839957 >> 172.21.15.37:0/3445839957 conn(0x5565c3d288b0 msgr2=0x5565c3d2e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:18.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.499+0000 7f6f01094740 1 -- 172.21.15.37:0/3445839957 shutdown_connections 2024-08-20T05:11:18.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.499+0000 7f6f01094740 1 -- 172.21.15.37:0/3445839957 wait complete. 2024-08-20T05:11:18.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.499+0000 7f6f01094740 20 client.17334 trim_cache size 0 max 16384 2024-08-20T05:11:18.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.518+0000 7f6f01094740 1 Processor -- start 2024-08-20T05:11:18.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.518+0000 7f6f01094740 1 -- start start 2024-08-20T05:11:18.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.518+0000 7f6f01094740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 0x5565c3d4e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.518+0000 7f6f01094740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d2b3a0 0x5565c3d4ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.518+0000 7f6f01094740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d37330 0x5565c3d31150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.518+0000 7f6f01094740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef81b17a0 con 0x5565c3d2b3a0 2024-08-20T05:11:18.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.518+0000 7f6f01094740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef81b33a0 con 0x5565c3d2aa80 2024-08-20T05:11:18.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.518+0000 7f6f01094740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef81b1e70 con 0x5565c3d37330 2024-08-20T05:11:18.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.518+0000 7f6ef7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d37330 0x5565c3d31150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.518+0000 7f6ef7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 0x5565c3d4e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.518+0000 7f6ef6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d2b3a0 0x5565c3d4ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.518+0000 7f6ef7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d37330 0x5565c3d31150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52062/0 (socket says 172.21.15.37:52062) 2024-08-20T05:11:18.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.518+0000 7f6ef7e00640 1 -- 172.21.15.37:0/875899546 learned_addr learned my addr 172.21.15.37:0/875899546 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:18.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.519+0000 7f6ef7400640 1 -- 172.21.15.37:0/875899546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d37330 msgr2=0x5565c3d31150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:18.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.519+0000 7f6ef7400640 1 --2- 172.21.15.37:0/875899546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d37330 0x5565c3d31150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.519+0000 7f6ef7400640 1 -- 172.21.15.37:0/875899546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d2b3a0 msgr2=0x5565c3d4ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:18.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.519+0000 7f6ef7400640 1 --2- 172.21.15.37:0/875899546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d2b3a0 0x5565c3d4ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.519+0000 7f6ef7400640 1 -- 172.21.15.37:0/875899546 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565c3d36e40 con 0x5565c3d2aa80 2024-08-20T05:11:18.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.519+0000 7f6ef7400640 1 --2- 172.21.15.37:0/875899546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 0x5565c3d4e9c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80ab1b0 tx=0x7f6ee80ea550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d18ed5de2abdd39d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:18.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.519+0000 7f6ee3e00640 1 -- 172.21.15.37:0/875899546 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80aad30 con 0x5565c3d2aa80 2024-08-20T05:11:18.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.519+0000 7f6ee3e00640 1 -- 172.21.15.37:0/875899546 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ee80ea030 con 0x5565c3d2aa80 2024-08-20T05:11:18.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.519+0000 7f6ee3e00640 1 -- 172.21.15.37:0/875899546 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80e1ee0 con 0x5565c3d2aa80 2024-08-20T05:11:18.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.520+0000 7f6f01094740 1 -- 172.21.15.37:0/875899546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 msgr2=0x5565c3d4e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:18.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.520+0000 7f6f01094740 1 --2- 172.21.15.37:0/875899546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 0x5565c3d4e9c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6ee80ab1b0 tx=0x7f6ee80ea550 comp rx=0 tx=0).stop 2024-08-20T05:11:18.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.520+0000 7f6f01094740 1 -- 172.21.15.37:0/875899546 shutdown_connections 2024-08-20T05:11:18.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.520+0000 7f6f01094740 1 --2- 172.21.15.37:0/875899546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d37330 0x5565c3d31150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.520+0000 7f6f01094740 1 --2- 172.21.15.37:0/875899546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d2b3a0 0x5565c3d4ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.520+0000 7f6f01094740 1 --2- 172.21.15.37:0/875899546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 0x5565c3d4e9c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.520+0000 7f6f01094740 1 -- 172.21.15.37:0/875899546 >> 172.21.15.37:0/875899546 conn(0x5565c3d288b0 msgr2=0x5565c3d327a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:18.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.520+0000 7f6f01094740 1 -- 172.21.15.37:0/875899546 shutdown_connections 2024-08-20T05:11:18.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.520+0000 7f6f01094740 1 -- 172.21.15.37:0/875899546 wait complete. 2024-08-20T05:11:18.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.521+0000 7f6f01094740 1 -- start start 2024-08-20T05:11:18.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.521+0000 7f6f01094740 1 Processor -- start 2024-08-20T05:11:18.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.521+0000 7f6f01094740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 0x5565c3d3d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.521+0000 7f6f01094740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2b3a0 0x5565c3d3d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.521+0000 7f6f01094740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d37330 0x5565c3d3dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.521+0000 7f6f01094740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef81b2c70 con 0x5565c3d37330 2024-08-20T05:11:18.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.521+0000 7f6f01094740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef81b2540 con 0x5565c3d2aa80 2024-08-20T05:11:18.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.521+0000 7f6f01094740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef81af780 con 0x5565c3d2b3a0 2024-08-20T05:11:18.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.521+0000 7f6f01094740 10 client.0 _ll_register_callbacks cb 0x7f6ef0009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:18.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.522+0000 7f6ef7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 0x5565c3d3d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.522+0000 7f6ef6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2b3a0 0x5565c3d3d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.522+0000 7f6ef7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d37330 0x5565c3d3dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.522+0000 7f6ef6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2b3a0 0x5565c3d3d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52076/0 (socket says 172.21.15.37:52076) 2024-08-20T05:11:18.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.522+0000 7f6ef7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 0x5565c3d3d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43976/0 (socket says 172.21.15.37:43976) 2024-08-20T05:11:18.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.522+0000 7f6ef6a00640 1 -- 172.21.15.37:0/1906507462 learned_addr learned my addr 172.21.15.37:0/1906507462 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:18.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.522+0000 7f6ef6a00640 1 -- 172.21.15.37:0/1906507462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 msgr2=0x5565c3d3d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:18.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.522+0000 7f6ef6a00640 1 --2- 172.21.15.37:0/1906507462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 0x5565c3d3d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.522+0000 7f6ef6a00640 1 -- 172.21.15.37:0/1906507462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d37330 msgr2=0x5565c3d3dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:18.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.522+0000 7f6ef6a00640 1 --2- 172.21.15.37:0/1906507462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d37330 0x5565c3d3dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.522+0000 7f6ef6a00640 1 -- 172.21.15.37:0/1906507462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565c3db0c90 con 0x5565c3d2b3a0 2024-08-20T05:11:18.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.522+0000 7f6ef6a00640 1 --2- 172.21.15.37:0/1906507462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2b3a0 0x5565c3d3d820 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4031440 tx=0x7f6ee4005330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5940a7e7e2d2fa2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:18.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.522+0000 7f6ee1600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:11:18.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.523+0000 7f6ee1600640 1 -- 172.21.15.37:0/1906507462 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4035040 con 0x5565c3d2b3a0 2024-08-20T05:11:18.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.523+0000 7f6f01094740 1 -- 172.21.15.37:0/1906507462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ee80ea030 con 0x5565c3d2b3a0 2024-08-20T05:11:18.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.523+0000 7f6ee1600640 1 -- 172.21.15.37:0/1906507462 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6ee4004970 con 0x5565c3d2b3a0 2024-08-20T05:11:18.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.523+0000 7f6ee1600640 1 -- 172.21.15.37:0/1906507462 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f6ee4004b90 con 0x5565c3d2b3a0 2024-08-20T05:11:18.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.523+0000 7f6f01094740 10 client.27814 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:18.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.523+0000 7f6f01094740 1 -- 172.21.15.37:0/1906507462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5565c3db1fa0 con 0x5565c3d2b3a0 2024-08-20T05:11:18.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.523+0000 7f6ee1600640 1 -- 172.21.15.37:0/1906507462 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ee80ea030 con 0x5565c3d2b3a0 2024-08-20T05:11:18.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.524+0000 7f6ee1600640 1 -- 172.21.15.37:0/1906507462 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f6ee4050460 con 0x5565c3d2b3a0 2024-08-20T05:11:18.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.524+0000 7f6f01094740 10 client.27814 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:18.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.524+0000 7f6f01094740 10 client.27814 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:18.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.524+0000 7f6f01094740 20 client.27814 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:18.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.524+0000 7f6f01094740 1 --2- 172.21.15.37:0/1906507462 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5565c3db2340 0x5565c3db4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:18.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.524+0000 7f6f01094740 4 client.27814 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:11:18.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.524+0000 7f6f01094740 1 -- 172.21.15.37:0/1906507462 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5565c3c9e450 con 0x5565c3db2340 2024-08-20T05:11:18.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.524+0000 7f6ef7400640 1 --2- 172.21.15.37:0/1906507462 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5565c3db2340 0x5565c3db4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:18.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.525+0000 7f6ef7400640 1 --2- 172.21.15.37:0/1906507462 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5565c3db2340 0x5565c3db4730 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=558f23d37ab6f3ff server_cookie=62e92dc169d2aa7d in_seq=0 out_seq=0 2024-08-20T05:11:18.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.525+0000 7f6ee1600640 10 client.27814 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:18.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.525+0000 7f6ee1600640 1 -- 172.21.15.37:0/1906507462 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5565c3c9e450 con 0x5565c3db2340 2024-08-20T05:11:18.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.525+0000 7f6ee1600640 10 client.27814 handle_command_reply: tid=0 2024-08-20T05:11:18.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.525+0000 7f6f01094740 1 client.27814 shutdown 2024-08-20T05:11:18.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.525+0000 7f6f01094740 1 -- 172.21.15.37:0/1906507462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2b3a0 msgr2=0x5565c3d3d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.525+0000 7f6f01094740 1 --2- 172.21.15.37:0/1906507462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2b3a0 0x5565c3d3d820 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4031440 tx=0x7f6ee4005330 comp rx=0 tx=0).stop 2024-08-20T05:11:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.525+0000 7f6f01094740 1 -- 172.21.15.37:0/1906507462 shutdown_connections 2024-08-20T05:11:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.525+0000 7f6f01094740 1 --2- 172.21.15.37:0/1906507462 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5565c3db2340 0x5565c3db4730 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.525+0000 7f6f01094740 1 --2- 172.21.15.37:0/1906507462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565c3d37330 0x5565c3d3dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.525+0000 7f6f01094740 1 --2- 172.21.15.37:0/1906507462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5565c3d2b3a0 0x5565c3d3d820 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.525+0000 7f6f01094740 1 --2- 172.21.15.37:0/1906507462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5565c3d2aa80 0x5565c3d3d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.525+0000 7f6f01094740 1 -- 172.21.15.37:0/1906507462 >> 172.21.15.37:0/1906507462 conn(0x5565c3d288b0 msgr2=0x5565c3d27270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.525+0000 7f6ee1600640 0 client.27814 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.525+0000 7f6f01094740 1 -- 172.21.15.37:0/1906507462 shutdown_connections 2024-08-20T05:11:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.525+0000 7f6f01094740 1 -- 172.21.15.37:0/1906507462 wait complete. 2024-08-20T05:11:18.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.525+0000 7f6f01094740 20 client.27814 trim_cache size 0 max 16384 2024-08-20T05:11:18.532 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:11:18.532 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T05:11:18.532 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-20T05:11:18.532 INFO:teuthology.orchestra.run.smithi037.stdout: "778cb2be-7329-4178-a9cc-54f396b2c461": { 2024-08-20T05:11:18.532 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-20T05:11:18.532 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "778cb2be-7329-4178-a9cc-54f396b2c461", 2024-08-20T05:11:18.532 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-20T05:11:18.532 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:11:18.532 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:11:18.532 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:11:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.526+0000 7f6efd000640 1 -- 172.21.15.37:0/3142250510 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6edc0b3c70 msgr2=0x7f6edc0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.526+0000 7f6efd000640 1 --2- 172.21.15.37:0/3142250510 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6edc0b3c70 0x7f6edc0b6130 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0009ea0 tx=0x7f6ef0005f90 comp rx=0 tx=0).stop 2024-08-20T05:11:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.526+0000 7f6efd000640 1 -- 172.21.15.37:0/3142250510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef8102910 msgr2=0x7f6ef819af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.526+0000 7f6efd000640 1 --2- 172.21.15.37:0/3142250510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef8102910 0x7f6ef819af40 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8009d50 tx=0x7f6ee800c6a0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.526+0000 7f6efd000640 1 -- 172.21.15.37:0/3142250510 shutdown_connections 2024-08-20T05:11:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.526+0000 7f6efd000640 1 --2- 172.21.15.37:0/3142250510 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6edc0b3c70 0x7f6edc0b6130 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.526+0000 7f6efd000640 1 --2- 172.21.15.37:0/3142250510 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6ef8108ca0 0x7f6ef81a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.526+0000 7f6efd000640 1 --2- 172.21.15.37:0/3142250510 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6ef8108320 0x7f6ef819b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.526+0000 7f6efd000640 1 --2- 172.21.15.37:0/3142250510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef8102910 0x7f6ef819af40 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.526+0000 7f6efd000640 1 -- 172.21.15.37:0/3142250510 >> 172.21.15.37:0/3142250510 conn(0x7f6ef80fe3c0 msgr2=0x7f6ef8105900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.526+0000 7f6efd000640 1 -- 172.21.15.37:0/3142250510 shutdown_connections 2024-08-20T05:11:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:18.526+0000 7f6efd000640 1 -- 172.21.15.37:0/3142250510 wait complete. 2024-08-20T05:11:18.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:18 smithi037 ceph-mon[17265]: pgmap v673: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 361 KiB/s wr, 66 op/s 2024-08-20T05:11:18.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:18 smithi135 ceph-mon[22342]: pgmap v673: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 361 KiB/s wr, 66 op/s 2024-08-20T05:11:18.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:18 smithi130 ceph-mon[22007]: pgmap v673: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 361 KiB/s wr, 66 op/s 2024-08-20T05:11:19.469 INFO:tasks.cephfs.filesystem:scrub status for tag:778cb2be-7329-4178-a9cc-54f396b2c461 - {'path': '/', 'tag': '778cb2be-7329-4178-a9cc-54f396b2c461', 'options': 'recursive,force'} 2024-08-20T05:11:19.713 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:11:19.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:19 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:11:19.848 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:19 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:11:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:19 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:11:20.633 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:20.795 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:20 smithi037 ceph-mon[17265]: pgmap v674: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 348 KiB/s wr, 110 op/s 2024-08-20T05:11:20.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:20 smithi135 ceph-mon[22342]: pgmap v674: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 348 KiB/s wr, 110 op/s 2024-08-20T05:11:20.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:20 smithi130 ceph-mon[22007]: pgmap v674: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 348 KiB/s wr, 110 op/s 2024-08-20T05:11:21.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.220+0000 7f20ea000640 1 -- 172.21.15.37:0/3223964375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20e4101400 msgr2=0x7f20e41017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.220+0000 7f20ea000640 1 --2- 172.21.15.37:0/3223964375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20e4101400 0x7f20e41017e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f20d8009900 tx=0x7f20d802a480 comp rx=0 tx=0).stop 2024-08-20T05:11:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.220+0000 7f20ea000640 1 -- 172.21.15.37:0/3223964375 shutdown_connections 2024-08-20T05:11:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.220+0000 7f20ea000640 1 --2- 172.21.15.37:0/3223964375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20e410efb0 0x7f20e41113a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.220+0000 7f20ea000640 1 --2- 172.21.15.37:0/3223964375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e4101d20 0x7f20e410ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.220+0000 7f20ea000640 1 --2- 172.21.15.37:0/3223964375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20e4101400 0x7f20e41017e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.220+0000 7f20ea000640 1 -- 172.21.15.37:0/3223964375 >> 172.21.15.37:0/3223964375 conn(0x7f20e40fd2d0 msgr2=0x7f20e40ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.220+0000 7f20ea000640 1 -- 172.21.15.37:0/3223964375 shutdown_connections 2024-08-20T05:11:21.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.220+0000 7f20ea000640 1 -- 172.21.15.37:0/3223964375 wait complete. 2024-08-20T05:11:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.221+0000 7f20ea000640 1 Processor -- start 2024-08-20T05:11:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.221+0000 7f20ea000640 1 -- start start 2024-08-20T05:11:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.222+0000 7f20ea000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20e4101400 0x7f20e419af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.222+0000 7f20ea000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20e4101d20 0x7f20e419b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.222+0000 7f20ea000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e410efb0 0x7f20e41a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:21.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.222+0000 7f20ea000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f20e4114b00 con 0x7f20e410efb0 2024-08-20T05:11:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.222+0000 7f20ea000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f20e4114980 con 0x7f20e4101400 2024-08-20T05:11:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.222+0000 7f20ea000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f20e4114c80 con 0x7f20e4101d20 2024-08-20T05:11:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.222+0000 7f20e8c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20e4101400 0x7f20e419af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.222+0000 7f20e8c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20e4101400 0x7f20e419af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43990/0 (socket says 172.21.15.37:43990) 2024-08-20T05:11:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.222+0000 7f20e8c00640 1 -- 172.21.15.37:0/2111199974 learned_addr learned my addr 172.21.15.37:0/2111199974 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.222+0000 7f20e9600640 1 --2- 172.21.15.37:0/2111199974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e410efb0 0x7f20e41a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:21.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.222+0000 7f20e3e00640 1 --2- 172.21.15.37:0/2111199974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20e4101d20 0x7f20e419b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.223+0000 7f20e8c00640 1 -- 172.21.15.37:0/2111199974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20e4101d20 msgr2=0x7f20e419b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.223+0000 7f20e8c00640 1 --2- 172.21.15.37:0/2111199974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20e4101d20 0x7f20e419b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.223+0000 7f20e8c00640 1 -- 172.21.15.37:0/2111199974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e410efb0 msgr2=0x7f20e41a0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.223+0000 7f20e8c00640 1 --2- 172.21.15.37:0/2111199974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e410efb0 0x7f20e41a0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.223+0000 7f20e8c00640 1 -- 172.21.15.37:0/2111199974 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e41a1040 con 0x7f20e4101400 2024-08-20T05:11:21.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.223+0000 7f20e8c00640 1 --2- 172.21.15.37:0/2111199974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20e4101400 0x7f20e419af90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f20d8005ab0 tx=0x7f20d8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.224+0000 7f20e1600640 1 -- 172.21.15.37:0/2111199974 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d803f070 con 0x7f20e4101400 2024-08-20T05:11:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.224+0000 7f20e1600640 1 -- 172.21.15.37:0/2111199974 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20d8031b60 con 0x7f20e4101400 2024-08-20T05:11:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.224+0000 7f20e1600640 1 -- 172.21.15.37:0/2111199974 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d8035030 con 0x7f20e4101400 2024-08-20T05:11:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.224+0000 7f20ea000640 1 -- 172.21.15.37:0/2111199974 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e41a12d0 con 0x7f20e4101400 2024-08-20T05:11:21.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.224+0000 7f20ea000640 1 -- 172.21.15.37:0/2111199974 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e4103610 con 0x7f20e4101400 2024-08-20T05:11:21.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.226+0000 7f20ea000640 1 -- 172.21.15.37:0/2111199974 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20e406ae50 con 0x7f20e4101400 2024-08-20T05:11:21.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.229+0000 7f20e1600640 1 -- 172.21.15.37:0/2111199974 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f20d8042070 con 0x7f20e4101400 2024-08-20T05:11:21.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.231+0000 7f20e1600640 1 --2- 172.21.15.37:0/2111199974 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20cc0b3dc0 0x7f20cc0b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.231+0000 7f20e1600640 1 -- 172.21.15.37:0/2111199974 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f20d8104560 con 0x7f20e4101400 2024-08-20T05:11:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.231+0000 7f20e3e00640 1 --2- 172.21.15.37:0/2111199974 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20cc0b3dc0 0x7f20cc0b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:21.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.232+0000 7f20e3e00640 1 --2- 172.21.15.37:0/2111199974 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20cc0b3dc0 0x7f20cc0b6280 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f20e40ff950 tx=0x7f20d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:21.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.234+0000 7f20e1600640 1 -- 172.21.15.37:0/2111199974 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f20d80cb160 con 0x7f20e4101400 2024-08-20T05:11:21.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.489+0000 7f20ea000640 1 -- 172.21.15.37:0/2111199974 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20e4103930 con 0x7f20e4101400 2024-08-20T05:11:21.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.490+0000 7f20e1600640 1 -- 172.21.15.37:0/2111199974 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11986 (secure 0 0 0) 0x7f20d80cf6b0 con 0x7f20e4101400 2024-08-20T05:11:21.491 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:11:21.492 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":40,"btime":"2024-08-20T05:11:06:453851+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:11:06.285910+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:11:21.492 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 40 2024-08-20T05:11:21.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.493+0000 7f20ea000640 1 -- 172.21.15.37:0/2111199974 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20cc0b3dc0 msgr2=0x7f20cc0b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.493+0000 7f20ea000640 1 --2- 172.21.15.37:0/2111199974 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20cc0b3dc0 0x7f20cc0b6280 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f20e40ff950 tx=0x7f20d0005f90 comp rx=0 tx=0).stop 2024-08-20T05:11:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.493+0000 7f20ea000640 1 -- 172.21.15.37:0/2111199974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20e4101400 msgr2=0x7f20e419af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.493+0000 7f20ea000640 1 --2- 172.21.15.37:0/2111199974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20e4101400 0x7f20e419af90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f20d8005ab0 tx=0x7f20d8003c10 comp rx=0 tx=0).stop 2024-08-20T05:11:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.493+0000 7f20ea000640 1 -- 172.21.15.37:0/2111199974 shutdown_connections 2024-08-20T05:11:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.493+0000 7f20ea000640 1 --2- 172.21.15.37:0/2111199974 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f20cc0b3dc0 0x7f20cc0b6280 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.493+0000 7f20ea000640 1 --2- 172.21.15.37:0/2111199974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f20e410efb0 0x7f20e41a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.493+0000 7f20ea000640 1 --2- 172.21.15.37:0/2111199974 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f20e4101d20 0x7f20e419b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.493+0000 7f20ea000640 1 --2- 172.21.15.37:0/2111199974 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f20e4101400 0x7f20e419af90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.493+0000 7f20ea000640 1 -- 172.21.15.37:0/2111199974 >> 172.21.15.37:0/2111199974 conn(0x7f20e40fd2d0 msgr2=0x7f20e41111e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.494+0000 7f20ea000640 1 -- 172.21.15.37:0/2111199974 shutdown_connections 2024-08-20T05:11:21.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:21.494+0000 7f20ea000640 1 -- 172.21.15.37:0/2111199974 wait complete. 2024-08-20T05:11:21.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:21 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:21.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:21 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:21.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:21 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:21.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:21 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:21.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:21 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2111199974' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:11:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:21 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:21 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:21.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:21 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:21.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:21 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:21.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:21 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2111199974' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:11:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:21 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:21 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:21 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:21 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:21 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2111199974' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:11:22.501 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id e49b23c --release --await' 2024-08-20T05:11:22.501 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id e49b23c --release --await 2024-08-20T05:11:22.891 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:23.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:11:23.228 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:23.228 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:23.228 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:22 smithi037 ceph-mon[17265]: pgmap v675: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 348 KiB/s wr, 130 op/s 2024-08-20T05:11:23.228 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:11:23.228 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:11:23.228 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:22 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:23.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:23.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:23.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:22 smithi135 ceph-mon[22342]: pgmap v675: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 348 KiB/s wr, 130 op/s 2024-08-20T05:11:23.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:11:23.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:11:23.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:22 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:23.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:23.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:23.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:22 smithi130 ceph-mon[22007]: pgmap v675: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 348 KiB/s wr, 130 op/s 2024-08-20T05:11:23.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:11:23.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:11:23.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:22 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:11:23.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.465+0000 7f4293e00640 1 -- 172.21.15.37:0/3849781789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f429410a510 msgr2=0x7f429410a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:23.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.465+0000 7f4293e00640 1 --2- 172.21.15.37:0/3849781789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f429410a510 0x7f429410a950 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f427c009900 tx=0x7f427c02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.465+0000 7f4293e00640 1 -- 172.21.15.37:0/3849781789 shutdown_connections 2024-08-20T05:11:23.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.465+0000 7f4293e00640 1 --2- 172.21.15.37:0/3849781789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f429410ae90 0x7f4294111690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.465+0000 7f4293e00640 1 --2- 172.21.15.37:0/3849781789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f429410a510 0x7f429410a950 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.465+0000 7f4293e00640 1 --2- 172.21.15.37:0/3849781789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4294104b00 0x7f4294104ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.465+0000 7f4293e00640 1 -- 172.21.15.37:0/3849781789 >> 172.21.15.37:0/3849781789 conn(0x7f4294100550 msgr2=0x7f4294102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:23.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.465+0000 7f4293e00640 1 -- 172.21.15.37:0/3849781789 shutdown_connections 2024-08-20T05:11:23.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.465+0000 7f4293e00640 1 -- 172.21.15.37:0/3849781789 wait complete. 2024-08-20T05:11:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.466+0000 7f4293e00640 1 Processor -- start 2024-08-20T05:11:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.467+0000 7f4293e00640 1 -- start start 2024-08-20T05:11:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.467+0000 7f4293e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4294104b00 0x7f429419aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.467+0000 7f4293e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f429410a510 0x7f429419b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.467+0000 7f4293e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f429410ae90 0x7f42941a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.467+0000 7f4293e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4294114b60 con 0x7f429410ae90 2024-08-20T05:11:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.467+0000 7f4293e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f42941149e0 con 0x7f429410a510 2024-08-20T05:11:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.467+0000 7f4293e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4294114ce0 con 0x7f4294104b00 2024-08-20T05:11:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.467+0000 7f4292a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4294104b00 0x7f429419aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.467+0000 7f4292a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4294104b00 0x7f429419aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52582/0 (socket says 172.21.15.37:52582) 2024-08-20T05:11:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.467+0000 7f4292a00640 1 -- 172.21.15.37:0/3846358950 learned_addr learned my addr 172.21.15.37:0/3846358950 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.467+0000 7f4293400640 1 --2- 172.21.15.37:0/3846358950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f429410ae90 0x7f42941a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.467+0000 7f428be00640 1 --2- 172.21.15.37:0/3846358950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f429410a510 0x7f429419b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.468+0000 7f4292a00640 1 -- 172.21.15.37:0/3846358950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f429410a510 msgr2=0x7f429419b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:23.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.468+0000 7f4292a00640 1 --2- 172.21.15.37:0/3846358950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f429410a510 0x7f429419b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.468+0000 7f4292a00640 1 -- 172.21.15.37:0/3846358950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f429410ae90 msgr2=0x7f42941a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:23.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.468+0000 7f4292a00640 1 --2- 172.21.15.37:0/3846358950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f429410ae90 0x7f42941a07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.468+0000 7f4292a00640 1 -- 172.21.15.37:0/3846358950 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42941a0fa0 con 0x7f4294104b00 2024-08-20T05:11:23.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.468+0000 7f4292a00640 1 --2- 172.21.15.37:0/3846358950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4294104b00 0x7f429419aef0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f428400e9f0 tx=0x7f428400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:23.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.468+0000 7f428b400640 1 -- 172.21.15.37:0/3846358950 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428400cd80 con 0x7f4294104b00 2024-08-20T05:11:23.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.468+0000 7f428b400640 1 -- 172.21.15.37:0/3846358950 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42840054d0 con 0x7f4294104b00 2024-08-20T05:11:23.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.468+0000 7f4293e00640 1 -- 172.21.15.37:0/3846358950 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42941a1290 con 0x7f4294104b00 2024-08-20T05:11:23.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.468+0000 7f428b400640 1 -- 172.21.15.37:0/3846358950 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4284010690 con 0x7f4294104b00 2024-08-20T05:11:23.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.469+0000 7f4293e00640 1 -- 172.21.15.37:0/3846358950 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42941a7950 con 0x7f4294104b00 2024-08-20T05:11:23.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.471+0000 7f429c1c1740 1 Processor -- start 2024-08-20T05:11:23.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.472+0000 7f429c1c1740 1 -- start start 2024-08-20T05:11:23.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.472+0000 7f429c1c1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c02e80 0x560ae9c03260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.472+0000 7f429c1c1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 0x560ae9c0f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.472+0000 7f429c1c1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c0f730 0x560ae9c11b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.472+0000 7f429c1c1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560ae9ba4670 con 0x560ae9c02e80 2024-08-20T05:11:23.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.472+0000 7f429c1c1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560ae9b78d70 con 0x560ae9c037a0 2024-08-20T05:11:23.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.472+0000 7f429c1c1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560ae9b68270 con 0x560ae9c0f730 2024-08-20T05:11:23.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.472+0000 7f4293400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c02e80 0x560ae9c03260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.472+0000 7f428b400640 1 -- 172.21.15.37:0/3846358950 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4284004e90 con 0x7f4294104b00 2024-08-20T05:11:23.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.472+0000 7f4293400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c02e80 0x560ae9c03260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57908/0 (socket says 172.21.15.37:57908) 2024-08-20T05:11:23.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.472+0000 7f4293400640 1 -- 172.21.15.37:0/2935496993 learned_addr learned my addr 172.21.15.37:0/2935496993 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:23.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.472+0000 7f428be00640 1 --2- 172.21.15.37:0/2935496993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c0f730 0x560ae9c11b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.473+0000 7f4292a00640 1 --2- 172.21.15.37:0/2935496993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 0x560ae9c0f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.473+0000 7f4293400640 1 -- 172.21.15.37:0/2935496993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c0f730 msgr2=0x560ae9c11b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:23.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.473+0000 7f4293400640 1 --2- 172.21.15.37:0/2935496993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c0f730 0x560ae9c11b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.473+0000 7f4293400640 1 -- 172.21.15.37:0/2935496993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 msgr2=0x560ae9c0f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:23.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.473+0000 7f4293400640 1 --2- 172.21.15.37:0/2935496993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 0x560ae9c0f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.473+0000 7f4293400640 1 -- 172.21.15.37:0/2935496993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ae9b04870 con 0x560ae9c02e80 2024-08-20T05:11:23.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.473+0000 7f4292a00640 1 --2- 172.21.15.37:0/2935496993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 0x560ae9c0f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:11:23.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.473+0000 7f4293400640 1 --2- 172.21.15.37:0/2935496993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c02e80 0x560ae9c03260 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f428c009fd0 tx=0x7f428c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc52068aa91277aa server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:23.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.473+0000 7f4283400640 1 -- 172.21.15.37:0/2935496993 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c004d20 con 0x560ae9c02e80 2024-08-20T05:11:23.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.474+0000 7f4283400640 1 -- 172.21.15.37:0/2935496993 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f428c004050 con 0x560ae9c02e80 2024-08-20T05:11:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.474+0000 7f4283400640 1 -- 172.21.15.37:0/2935496993 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c005280 con 0x560ae9c02e80 2024-08-20T05:11:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.474+0000 7f428b400640 1 --2- 172.21.15.37:0/3846358950 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42780b3cf0 0x7f42780b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.474+0000 7f429c1c1740 1 -- 172.21.15.37:0/2935496993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c02e80 msgr2=0x560ae9c03260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.474+0000 7f429c1c1740 1 --2- 172.21.15.37:0/2935496993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c02e80 0x560ae9c03260 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f428c009fd0 tx=0x7f428c0118d0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.474+0000 7f429c1c1740 1 -- 172.21.15.37:0/2935496993 shutdown_connections 2024-08-20T05:11:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.474+0000 7f429c1c1740 1 --2- 172.21.15.37:0/2935496993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c0f730 0x560ae9c11b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.474+0000 7f429c1c1740 1 --2- 172.21.15.37:0/2935496993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 0x560ae9c0f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.474+0000 7f429c1c1740 1 --2- 172.21.15.37:0/2935496993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c02e80 0x560ae9c03260 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.474+0000 7f429c1c1740 1 -- 172.21.15.37:0/2935496993 >> 172.21.15.37:0/2935496993 conn(0x560ae9c00cb0 msgr2=0x560ae9c01e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.474+0000 7f428b400640 1 -- 172.21.15.37:0/3846358950 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f42840e4380 con 0x7f4294104b00 2024-08-20T05:11:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.474+0000 7f429c1c1740 1 -- 172.21.15.37:0/2935496993 shutdown_connections 2024-08-20T05:11:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.475+0000 7f4292a00640 1 --2- 172.21.15.37:0/3846358950 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42780b3cf0 0x7f42780b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.475+0000 7f429c1c1740 1 -- 172.21.15.37:0/2935496993 wait complete. 2024-08-20T05:11:23.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.475+0000 7f429c1c1740 1 -- start start 2024-08-20T05:11:23.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.475+0000 7f4292a00640 1 --2- 172.21.15.37:0/3846358950 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42780b3cf0 0x7f42780b61b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f428400c6a0 tx=0x7f4284004a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:23.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.476+0000 7f429c1c1740 1 Processor -- start 2024-08-20T05:11:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.476+0000 7f429c1c1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c02e80 0x560ae9c0efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.476+0000 7f429c1c1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 0x560ae9c0c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.476+0000 7f429c1c1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c0f730 0x560ae9c0c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.476+0000 7f429c1c1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560ae9aeeff0 con 0x560ae9c02e80 2024-08-20T05:11:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.476+0000 7f429c1c1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560ae9b6c2b0 con 0x560ae9c037a0 2024-08-20T05:11:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.476+0000 7f429c1c1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560ae99cabb0 con 0x560ae9c0f730 2024-08-20T05:11:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.476+0000 7f429c1c1740 10 client.0 _ll_register_callbacks cb 0x560ae9873d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.476+0000 7f4293400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c02e80 0x560ae9c0efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.476+0000 7f4293400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c02e80 0x560ae9c0efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57912/0 (socket says 172.21.15.37:57912) 2024-08-20T05:11:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.476+0000 7f4293400640 1 -- 172.21.15.37:0/1379249245 learned_addr learned my addr 172.21.15.37:0/1379249245 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:23.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.477+0000 7f428be00640 1 --2- 172.21.15.37:0/1379249245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 0x560ae9c0c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.477+0000 7f4293400640 1 --2- 172.21.15.37:0/1379249245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c0f730 0x560ae9c0c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.477+0000 7f428be00640 1 -- 172.21.15.37:0/1379249245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c0f730 msgr2=0x560ae9c0c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.477+0000 7f428be00640 1 --2- 172.21.15.37:0/1379249245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c0f730 0x560ae9c0c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.477+0000 7f428be00640 1 -- 172.21.15.37:0/1379249245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c02e80 msgr2=0x560ae9c0efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.477+0000 7f428be00640 1 --2- 172.21.15.37:0/1379249245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c02e80 0x560ae9c0efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.477+0000 7f428be00640 1 -- 172.21.15.37:0/1379249245 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ae98c7b00 con 0x560ae9c037a0 2024-08-20T05:11:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.477+0000 7f428be00640 1 --2- 172.21.15.37:0/1379249245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 0x560ae9c0c410 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f427c02a9e0 tx=0x7f427c0042e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e4128f056cab0c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.477+0000 7f4277e00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:11:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.478+0000 7f4277e00640 1 -- 172.21.15.37:0/1379249245 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c035040 con 0x560ae9c037a0 2024-08-20T05:11:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.478+0000 7f429c1c1740 1 -- 172.21.15.37:0/1379249245 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f428c004050 con 0x560ae9c037a0 2024-08-20T05:11:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.478+0000 7f4277e00640 1 -- 172.21.15.37:0/1379249245 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f427c005450 con 0x560ae9c037a0 2024-08-20T05:11:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.478+0000 7f4277e00640 1 -- 172.21.15.37:0/1379249245 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f427c005650 con 0x560ae9c037a0 2024-08-20T05:11:23.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.478+0000 7f429c1c1740 10 client.27833 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:23.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.478+0000 7f429c1c1740 1 -- 172.21.15.37:0/1379249245 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x560ae993e960 con 0x560ae9c037a0 2024-08-20T05:11:23.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.478+0000 7f4277e00640 1 -- 172.21.15.37:0/1379249245 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f428c004050 con 0x560ae9c037a0 2024-08-20T05:11:23.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.478+0000 7f4277e00640 1 -- 172.21.15.37:0/1379249245 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f427c003850 con 0x560ae9c037a0 2024-08-20T05:11:23.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.479+0000 7f429c1c1740 10 client.27833 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:23.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.479+0000 7f429c1c1740 10 client.27833 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:11:23.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.479+0000 7f429c1c1740 20 client.27833 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:23.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.479+0000 7f429c1c1740 1 --2- 172.21.15.37:0/1379249245 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560ae9c1ed50 0x560ae9c211b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.479+0000 7f429c1c1740 4 client.27833 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:23.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.479+0000 7f429c1c1740 1 -- 172.21.15.37:0/1379249245 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ae9b7acc0 con 0x560ae9c1ed50 2024-08-20T05:11:23.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.479+0000 7f4293400640 1 --2- 172.21.15.37:0/1379249245 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560ae9c1ed50 0x560ae9c211b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.480+0000 7f4277e00640 10 client.27833 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:23.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.480+0000 7f4293400640 1 --2- 172.21.15.37:0/1379249245 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560ae9c1ed50 0x560ae9c211b0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bab5d7b085f2773a server_cookie=8a99c7924195bfea in_seq=0 out_seq=0 2024-08-20T05:11:23.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.480+0000 7f4277e00640 1 -- 172.21.15.37:0/1379249245 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560ae9b7acc0 con 0x560ae9c1ed50 2024-08-20T05:11:23.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.480+0000 7f4277e00640 10 client.27833 handle_command_reply: tid=0 2024-08-20T05:11:23.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.480+0000 7f429c1c1740 1 client.27833 shutdown 2024-08-20T05:11:23.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.481+0000 7f429c1c1740 1 -- 172.21.15.37:0/1379249245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 msgr2=0x560ae9c0c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:23.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.481+0000 7f429c1c1740 1 --2- 172.21.15.37:0/1379249245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 0x560ae9c0c410 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f427c02a9e0 tx=0x7f427c0042e0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.481+0000 7f429c1c1740 1 -- 172.21.15.37:0/1379249245 shutdown_connections 2024-08-20T05:11:23.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.481+0000 7f429c1c1740 1 --2- 172.21.15.37:0/1379249245 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560ae9c1ed50 0x560ae9c211b0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.481+0000 7f429c1c1740 1 --2- 172.21.15.37:0/1379249245 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c0f730 0x560ae9c0c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.481+0000 7f429c1c1740 1 --2- 172.21.15.37:0/1379249245 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 0x560ae9c0c410 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.481+0000 7f429c1c1740 1 --2- 172.21.15.37:0/1379249245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c02e80 0x560ae9c0efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.481+0000 7f4277e00640 0 client.27833 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:23.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.481+0000 7f429c1c1740 1 -- 172.21.15.37:0/1379249245 >> 172.21.15.37:0/1379249245 conn(0x560ae9c00cb0 msgr2=0x560ae9c06850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:23.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.481+0000 7f429c1c1740 1 -- 172.21.15.37:0/1379249245 shutdown_connections 2024-08-20T05:11:23.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.481+0000 7f429c1c1740 1 -- 172.21.15.37:0/1379249245 wait complete. 2024-08-20T05:11:23.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.481+0000 7f429c1c1740 20 client.27833 trim_cache size 0 max 16384 2024-08-20T05:11:23.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.501+0000 7f429c1c1740 1 Processor -- start 2024-08-20T05:11:23.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.501+0000 7f429c1c1740 1 -- start start 2024-08-20T05:11:23.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.501+0000 7f429c1c1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c02e80 0x560ae9bffef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.501+0000 7f429c1c1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c037a0 0x560ae9c1b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.501+0000 7f429c1c1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c0f730 0x560ae9c26a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.501+0000 7f429c1c1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f42941b17b0 con 0x560ae9c0f730 2024-08-20T05:11:23.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.501+0000 7f429c1c1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f42941b33b0 con 0x560ae9c02e80 2024-08-20T05:11:23.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.501+0000 7f429c1c1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f42941b1e80 con 0x560ae9c037a0 2024-08-20T05:11:23.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.502+0000 7f4293400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c0f730 0x560ae9c26a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.502+0000 7f428be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c037a0 0x560ae9c1b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.502+0000 7f4293400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c0f730 0x560ae9c26a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57928/0 (socket says 172.21.15.37:57928) 2024-08-20T05:11:23.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.502+0000 7f4293400640 1 -- 172.21.15.37:0/4007728625 learned_addr learned my addr 172.21.15.37:0/4007728625 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:23.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.502+0000 7f4293400640 1 --2- 172.21.15.37:0/4007728625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c02e80 0x560ae9bffef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.502+0000 7f428be00640 1 -- 172.21.15.37:0/4007728625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c02e80 msgr2=0x560ae9bffef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:23.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.502+0000 7f428be00640 1 --2- 172.21.15.37:0/4007728625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c02e80 0x560ae9bffef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.502+0000 7f428be00640 1 -- 172.21.15.37:0/4007728625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c0f730 msgr2=0x560ae9c26a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:23.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.502+0000 7f428be00640 1 --2- 172.21.15.37:0/4007728625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c0f730 0x560ae9c26a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.502+0000 7f428be00640 1 -- 172.21.15.37:0/4007728625 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ae9c01730 con 0x560ae9c037a0 2024-08-20T05:11:23.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.502+0000 7f428be00640 1 --2- 172.21.15.37:0/4007728625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c037a0 0x560ae9c1b350 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f427c003c20 tx=0x7f427c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=451defa54c4a0230 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:23.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.503+0000 7f4282a00640 1 -- 172.21.15.37:0/4007728625 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c035070 con 0x560ae9c037a0 2024-08-20T05:11:23.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.503+0000 7f4282a00640 1 -- 172.21.15.37:0/4007728625 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f427c040070 con 0x560ae9c037a0 2024-08-20T05:11:23.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.503+0000 7f4282a00640 1 -- 172.21.15.37:0/4007728625 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c0054b0 con 0x560ae9c037a0 2024-08-20T05:11:23.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.503+0000 7f429c1c1740 1 -- 172.21.15.37:0/4007728625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c037a0 msgr2=0x560ae9c1b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:23.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.503+0000 7f429c1c1740 1 --2- 172.21.15.37:0/4007728625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c037a0 0x560ae9c1b350 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f427c003c20 tx=0x7f427c000bc0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.503+0000 7f429c1c1740 1 -- 172.21.15.37:0/4007728625 shutdown_connections 2024-08-20T05:11:23.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.503+0000 7f429c1c1740 1 --2- 172.21.15.37:0/4007728625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c0f730 0x560ae9c26a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.503+0000 7f429c1c1740 1 --2- 172.21.15.37:0/4007728625 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c037a0 0x560ae9c1b350 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.503+0000 7f429c1c1740 1 --2- 172.21.15.37:0/4007728625 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c02e80 0x560ae9bffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.503+0000 7f429c1c1740 1 -- 172.21.15.37:0/4007728625 >> 172.21.15.37:0/4007728625 conn(0x560ae9c00cb0 msgr2=0x560ae9c07950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:23.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.503+0000 7f429c1c1740 1 -- 172.21.15.37:0/4007728625 shutdown_connections 2024-08-20T05:11:23.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.503+0000 7f429c1c1740 1 -- 172.21.15.37:0/4007728625 wait complete. 2024-08-20T05:11:23.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.504+0000 7f429c1c1740 1 -- start start 2024-08-20T05:11:23.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.504+0000 7f429c1c1740 1 Processor -- start 2024-08-20T05:11:23.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.504+0000 7f429c1c1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c02e80 0x560ae9c151d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.504+0000 7f429c1c1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 0x560ae9c15750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.505+0000 7f429c1c1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c0f730 0x560ae9c82a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.505+0000 7f429c1c1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f42941b2c80 con 0x560ae9c0f730 2024-08-20T05:11:23.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.505+0000 7f429c1c1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f42941b2550 con 0x560ae9c037a0 2024-08-20T05:11:23.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.505+0000 7f429c1c1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f42941af790 con 0x560ae9c02e80 2024-08-20T05:11:23.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.505+0000 7f429c1c1740 10 client.0 _ll_register_callbacks cb 0x7f4284005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:23.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.505+0000 7f4293400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c02e80 0x560ae9c151d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.505+0000 7f428be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 0x560ae9c15750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.505+0000 7f428be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 0x560ae9c15750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44658/0 (socket says 172.21.15.37:44658) 2024-08-20T05:11:23.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.505+0000 7f428be00640 1 -- 172.21.15.37:0/4071883761 learned_addr learned my addr 172.21.15.37:0/4071883761 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:23.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.505+0000 7f4293400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c02e80 0x560ae9c151d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52626/0 (socket says 172.21.15.37:52626) 2024-08-20T05:11:23.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.505+0000 7f4293400640 1 --2- 172.21.15.37:0/4071883761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c0f730 0x560ae9c82a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.505+0000 7f428be00640 1 -- 172.21.15.37:0/4071883761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c02e80 msgr2=0x560ae9c151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:23.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.505+0000 7f428be00640 1 --2- 172.21.15.37:0/4071883761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c02e80 0x560ae9c151d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.505+0000 7f428be00640 1 -- 172.21.15.37:0/4071883761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c0f730 msgr2=0x560ae9c82a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:23.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.505+0000 7f428be00640 1 --2- 172.21.15.37:0/4071883761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c0f730 0x560ae9c82a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.505+0000 7f428be00640 1 -- 172.21.15.37:0/4071883761 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ae9c83130 con 0x560ae9c037a0 2024-08-20T05:11:23.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.505+0000 7f4293400640 1 --2- 172.21.15.37:0/4071883761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c0f730 0x560ae9c82a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:11:23.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.506+0000 7f428be00640 1 --2- 172.21.15.37:0/4071883761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 0x560ae9c15750 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f427c02a9b0 tx=0x7f427c031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae83b0695559bb32 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:23.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.506+0000 7f4277e00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:11:23.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.506+0000 7f4277e00640 1 -- 172.21.15.37:0/4071883761 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427c05f060 con 0x560ae9c037a0 2024-08-20T05:11:23.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.506+0000 7f4277e00640 1 -- 172.21.15.37:0/4071883761 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f427c003800 con 0x560ae9c037a0 2024-08-20T05:11:23.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.506+0000 7f429c1c1740 1 -- 172.21.15.37:0/4071883761 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f427c040070 con 0x560ae9c037a0 2024-08-20T05:11:23.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.506+0000 7f4277e00640 1 -- 172.21.15.37:0/4071883761 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f427c035040 con 0x560ae9c037a0 2024-08-20T05:11:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.506+0000 7f429c1c1740 10 client.27839 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.506+0000 7f429c1c1740 1 -- 172.21.15.37:0/4071883761 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x560ae9c8a530 con 0x560ae9c037a0 2024-08-20T05:11:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.507+0000 7f4277e00640 1 -- 172.21.15.37:0/4071883761 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f427c040070 con 0x560ae9c037a0 2024-08-20T05:11:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.507+0000 7f4277e00640 1 -- 172.21.15.37:0/4071883761 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f427c045500 con 0x560ae9c037a0 2024-08-20T05:11:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.507+0000 7f429c1c1740 10 client.27839 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.507+0000 7f429c1c1740 10 client.27839 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:11:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.507+0000 7f429c1c1740 20 client.27839 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.507+0000 7f429c1c1740 1 --2- 172.21.15.37:0/4071883761 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560ae9c8aa40 0x560ae9c8ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.507+0000 7f429c1c1740 4 client.27839 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e49b23c", "release": true, "await": true}] 2024-08-20T05:11:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.507+0000 7f429c1c1740 1 -- 172.21.15.37:0/4071883761 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e49b23c", "release": true, "await": true}) -- 0x560ae9b76760 con 0x560ae9c8aa40 2024-08-20T05:11:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.508+0000 7f4293400640 1 --2- 172.21.15.37:0/4071883761 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560ae9c8aa40 0x560ae9c8ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.508+0000 7f4293400640 1 --2- 172.21.15.37:0/4071883761 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560ae9c8aa40 0x560ae9c8ce60 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7caa4fbdb00b0f0b server_cookie=730b586c0f889178 in_seq=0 out_seq=0 2024-08-20T05:11:23.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.508+0000 7f4277e00640 10 client.27839 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:23.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.550+0000 7f4277e00640 1 -- 172.21.15.37:0/4071883761 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x560ae9b76760 con 0x560ae9c8aa40 2024-08-20T05:11:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.550+0000 7f4277e00640 10 client.27839 handle_command_reply: tid=0 2024-08-20T05:11:23.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.550+0000 7f429c1c1740 1 client.27839 shutdown 2024-08-20T05:11:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.553+0000 7f429c1c1740 1 -- 172.21.15.37:0/4071883761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 msgr2=0x560ae9c15750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:23.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.553+0000 7f429c1c1740 1 --2- 172.21.15.37:0/4071883761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 0x560ae9c15750 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f427c02a9b0 tx=0x7f427c031400 comp rx=0 tx=0).stop 2024-08-20T05:11:23.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.554+0000 7f429c1c1740 1 -- 172.21.15.37:0/4071883761 shutdown_connections 2024-08-20T05:11:23.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.554+0000 7f429c1c1740 1 --2- 172.21.15.37:0/4071883761 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560ae9c8aa40 0x560ae9c8ce60 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.554+0000 7f429c1c1740 1 --2- 172.21.15.37:0/4071883761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ae9c0f730 0x560ae9c82a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.554+0000 7f429c1c1740 1 --2- 172.21.15.37:0/4071883761 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560ae9c037a0 0x560ae9c15750 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.554+0000 7f429c1c1740 1 --2- 172.21.15.37:0/4071883761 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560ae9c02e80 0x560ae9c151d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.554+0000 7f4277e00640 0 client.27839 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:23.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.554+0000 7f429c1c1740 1 -- 172.21.15.37:0/4071883761 >> 172.21.15.37:0/4071883761 conn(0x560ae9c00cb0 msgr2=0x560ae9c1a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:23.561 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:11:23.561 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 40, 2024-08-20T05:11:23.561 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:11:23.561 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 36, 2024-08-20T05:11:23.561 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:11:23.561 INFO:teuthology.orchestra.run.smithi037.stdout: "e49b23c": { 2024-08-20T05:11:23.561 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 36, 2024-08-20T05:11:23.562 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:11:23.562 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:11:23.562 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:11:23.562 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:11:23.562 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:11:23.562 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:11:23.563 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 147.8, 2024-08-20T05:11:23.563 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:11:23.563 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:11:23.563 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:11:23.563 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:11:23.563 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:11:23.563 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:11:23.563 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:11:23.563 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:11:23.563 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:11:23.563 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:11:23.563 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:11:23.563 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:11:23.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.557+0000 7f429c1c1740 1 -- 172.21.15.37:0/4071883761 shutdown_connections 2024-08-20T05:11:23.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.557+0000 7f429c1c1740 1 -- 172.21.15.37:0/4071883761 wait complete. 2024-08-20T05:11:23.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.559+0000 7f429c1c1740 20 client.27839 trim_cache size 0 max 16384 2024-08-20T05:11:23.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.560+0000 7f4293e00640 1 -- 172.21.15.37:0/3846358950 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42780b3cf0 msgr2=0x7f42780b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:23.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.560+0000 7f4293e00640 1 --2- 172.21.15.37:0/3846358950 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42780b3cf0 0x7f42780b61b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f428400c6a0 tx=0x7f4284004a90 comp rx=0 tx=0).stop 2024-08-20T05:11:23.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.560+0000 7f4293e00640 1 -- 172.21.15.37:0/3846358950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4294104b00 msgr2=0x7f429419aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.560+0000 7f4293e00640 1 --2- 172.21.15.37:0/3846358950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4294104b00 0x7f429419aef0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f428400e9f0 tx=0x7f428400edf0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.561+0000 7f4293e00640 1 -- 172.21.15.37:0/3846358950 shutdown_connections 2024-08-20T05:11:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.561+0000 7f4293e00640 1 --2- 172.21.15.37:0/3846358950 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f42780b3cf0 0x7f42780b61b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.561+0000 7f4293e00640 1 --2- 172.21.15.37:0/3846358950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f429410ae90 0x7f42941a07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.561+0000 7f4293e00640 1 --2- 172.21.15.37:0/3846358950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f429410a510 0x7f429419b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.561+0000 7f4293e00640 1 --2- 172.21.15.37:0/3846358950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4294104b00 0x7f429419aef0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.561+0000 7f4293e00640 1 -- 172.21.15.37:0/3846358950 >> 172.21.15.37:0/3846358950 conn(0x7f4294100550 msgr2=0x7f4294102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.561+0000 7f4293e00640 1 -- 172.21.15.37:0/3846358950 shutdown_connections 2024-08-20T05:11:23.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:23.561+0000 7f4293e00640 1 -- 172.21.15.37:0/3846358950 wait complete. 2024-08-20T05:11:24.574 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e49b23c', total seconds elapsed: 32.7 2024-08-20T05:11:24.574 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.85 2024-08-20T05:11:24.575 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:11:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.877+0000 7f752fe00640 1 -- 172.21.15.37:0/1413659906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7528098880 msgr2=0x7f7528098d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.877+0000 7f752fe00640 1 --2- 172.21.15.37:0/1413659906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7528098880 0x7f7528098d00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7520009930 tx=0x7f752002a420 comp rx=0 tx=0).stop 2024-08-20T05:11:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.877+0000 7f752fe00640 1 -- 172.21.15.37:0/1413659906 shutdown_connections 2024-08-20T05:11:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.877+0000 7f752fe00640 1 --2- 172.21.15.37:0/1413659906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7528099240 0x7f752809fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.877+0000 7f752fe00640 1 --2- 172.21.15.37:0/1413659906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7528098880 0x7f7528098d00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.877+0000 7f752fe00640 1 --2- 172.21.15.37:0/1413659906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7528097730 0x7f7528097b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.877+0000 7f752fe00640 1 -- 172.21.15.37:0/1413659906 >> 172.21.15.37:0/1413659906 conn(0x7f7528092fd0 msgr2=0x7f7528095410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.878+0000 7f752fe00640 1 -- 172.21.15.37:0/1413659906 shutdown_connections 2024-08-20T05:11:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.878+0000 7f752fe00640 1 -- 172.21.15.37:0/1413659906 wait complete. 2024-08-20T05:11:24.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.882+0000 7f752fe00640 1 Processor -- start 2024-08-20T05:11:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.882+0000 7f752fe00640 1 -- start start 2024-08-20T05:11:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.883+0000 7f752fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7528097730 0x7f7528008f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.883+0000 7f752fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7528098880 0x7f75280095c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.883+0000 7f752fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7528099240 0x7f752800a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.883+0000 7f752fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f75280a33d0 con 0x7f7528098880 2024-08-20T05:11:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.883+0000 7f752fe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f75280a3250 con 0x7f7528097730 2024-08-20T05:11:24.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.883+0000 7f752fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f75280a3550 con 0x7f7528099240 2024-08-20T05:11:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.883+0000 7f752ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7528097730 0x7f7528008f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.883+0000 7f752ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7528097730 0x7f7528008f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44666/0 (socket says 172.21.15.37:44666) 2024-08-20T05:11:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.883+0000 7f752ea00640 1 -- 172.21.15.37:0/2081564011 learned_addr learned my addr 172.21.15.37:0/2081564011 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.883+0000 7f752f400640 1 --2- 172.21.15.37:0/2081564011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7528099240 0x7f752800a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.884+0000 7f752ea00640 1 -- 172.21.15.37:0/2081564011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7528099240 msgr2=0x7f752800a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.884+0000 7f752ea00640 1 --2- 172.21.15.37:0/2081564011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7528099240 0x7f752800a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.884+0000 7f752ea00640 1 -- 172.21.15.37:0/2081564011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7528098880 msgr2=0x7f75280095c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.884+0000 7f752ea00640 1 --2- 172.21.15.37:0/2081564011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7528098880 0x7f75280095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.884+0000 7f752ea00640 1 -- 172.21.15.37:0/2081564011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f752800aab0 con 0x7f7528097730 2024-08-20T05:11:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.884+0000 7f752ea00640 1 --2- 172.21.15.37:0/2081564011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7528097730 0x7f7528008f70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7530052510 tx=0x7f753006c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.886+0000 7f7527400640 1 -- 172.21.15.37:0/2081564011 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753007dde0 con 0x7f7528097730 2024-08-20T05:11:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.886+0000 7f7527400640 1 -- 172.21.15.37:0/2081564011 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f753006c6e0 con 0x7f7528097730 2024-08-20T05:11:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.886+0000 7f7527400640 1 -- 172.21.15.37:0/2081564011 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753007a700 con 0x7f7528097730 2024-08-20T05:11:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.886+0000 7f752fe00640 1 -- 172.21.15.37:0/2081564011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f752800ada0 con 0x7f7528097730 2024-08-20T05:11:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.886+0000 7f752fe00640 1 -- 172.21.15.37:0/2081564011 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f752800b440 con 0x7f7528097730 2024-08-20T05:11:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.894+0000 7f7527400640 1 -- 172.21.15.37:0/2081564011 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7530085aa0 con 0x7f7528097730 2024-08-20T05:11:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.895+0000 7f7538487740 1 Processor -- start 2024-08-20T05:11:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.896+0000 7f7538487740 1 -- start start 2024-08-20T05:11:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.896+0000 7f7538487740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4ce7f0 0x563f2d4d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.896+0000 7f7538487740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d1120 0x563f2d4d3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.896+0000 7f7538487740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d3b60 0x563f2d4d6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.896+0000 7f7538487740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563f2d441210 con 0x563f2d4d1120 2024-08-20T05:11:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.896+0000 7f7538487740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563f2d430710 con 0x563f2d4ce7f0 2024-08-20T05:11:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.896+0000 7f7538487740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563f2d434750 con 0x563f2d4d3b60 2024-08-20T05:11:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.897+0000 7f752e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d3b60 0x563f2d4d6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.897+0000 7f752e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d3b60 0x563f2d4d6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52662/0 (socket says 172.21.15.37:52662) 2024-08-20T05:11:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.897+0000 7f752e000640 1 -- 172.21.15.37:0/505457154 learned_addr learned my addr 172.21.15.37:0/505457154 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.897+0000 7f752f400640 1 --2- 172.21.15.37:0/505457154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4ce7f0 0x563f2d4d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.897+0000 7f752e000640 1 -- 172.21.15.37:0/505457154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4ce7f0 msgr2=0x563f2d4d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.897+0000 7f752e000640 1 --2- 172.21.15.37:0/505457154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4ce7f0 0x563f2d4d0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.897+0000 7f752e000640 1 -- 172.21.15.37:0/505457154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d1120 msgr2=0x563f2d4d3510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:11:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.897+0000 7f752e000640 1 --2- 172.21.15.37:0/505457154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d1120 0x563f2d4d3510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.897+0000 7f752e000640 1 -- 172.21.15.37:0/505457154 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f2d3fcde0 con 0x563f2d4d3b60 2024-08-20T05:11:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.898+0000 7f752f400640 1 --2- 172.21.15.37:0/505457154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4ce7f0 0x563f2d4d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:11:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.898+0000 7f752e000640 1 --2- 172.21.15.37:0/505457154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d3b60 0x563f2d4d6020 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f752002aa10 tx=0x7f7520005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f229d60d68a492f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.898+0000 7f7527400640 1 --2- 172.21.15.37:0/2081564011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75140b3de0 0x7f75140b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.899+0000 7f7527400640 1 -- 172.21.15.37:0/2081564011 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7530151140 con 0x7f7528097730 2024-08-20T05:11:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.899+0000 7f751b400640 1 -- 172.21.15.37:0/505457154 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752003e070 con 0x563f2d4d3b60 2024-08-20T05:11:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.899+0000 7f751b400640 1 -- 172.21.15.37:0/505457154 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75200053b0 con 0x563f2d4d3b60 2024-08-20T05:11:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.899+0000 7f751b400640 1 -- 172.21.15.37:0/505457154 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7520035040 con 0x563f2d4d3b60 2024-08-20T05:11:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.901+0000 7f7538487740 1 -- 172.21.15.37:0/505457154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d3b60 msgr2=0x563f2d4d6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.901+0000 7f7538487740 1 --2- 172.21.15.37:0/505457154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d3b60 0x563f2d4d6020 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f752002aa10 tx=0x7f7520005040 comp rx=0 tx=0).stop 2024-08-20T05:11:24.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.901+0000 7f7538487740 1 -- 172.21.15.37:0/505457154 shutdown_connections 2024-08-20T05:11:24.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.901+0000 7f7538487740 1 --2- 172.21.15.37:0/505457154 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d3b60 0x563f2d4d6020 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.901+0000 7f7538487740 1 --2- 172.21.15.37:0/505457154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d1120 0x563f2d4d3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.901+0000 7f7538487740 1 --2- 172.21.15.37:0/505457154 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4ce7f0 0x563f2d4d0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.901+0000 7f7538487740 1 -- 172.21.15.37:0/505457154 >> 172.21.15.37:0/505457154 conn(0x563f2d4c9940 msgr2=0x563f2d4ca6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:24.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.903+0000 7f752f400640 1 --2- 172.21.15.37:0/2081564011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75140b3de0 0x7f75140b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.904+0000 7f7538487740 1 -- 172.21.15.37:0/505457154 shutdown_connections 2024-08-20T05:11:24.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.904+0000 7f7538487740 1 -- 172.21.15.37:0/505457154 wait complete. 2024-08-20T05:11:24.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.905+0000 7f7538487740 1 -- start start 2024-08-20T05:11:24.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.905+0000 7f752f400640 1 --2- 172.21.15.37:0/2081564011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75140b3de0 0x7f75140b62a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f751c005fd0 tx=0x7f751c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:24.906 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.905+0000 7f7538487740 1 Processor -- start 2024-08-20T05:11:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.906+0000 7f7538487740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4ce7f0 0x563f2d4d7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.906+0000 7f7538487740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d1120 0x563f2d4d85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.906+0000 7f7538487740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d3b60 0x563f2d4d91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.907 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.906+0000 7f7538487740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563f2d369ab0 con 0x563f2d4d3b60 2024-08-20T05:11:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.906+0000 7f7538487740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563f2d3d7140 con 0x563f2d4ce7f0 2024-08-20T05:11:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.906+0000 7f7538487740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563f2d4d6ae0 con 0x563f2d4d1120 2024-08-20T05:11:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.906+0000 7f752e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d1120 0x563f2d4d85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.906+0000 7f752ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4ce7f0 0x563f2d4d7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.906+0000 7f752ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4ce7f0 0x563f2d4d7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44690/0 (socket says 172.21.15.37:44690) 2024-08-20T05:11:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.906+0000 7f752ea00640 1 -- 172.21.15.37:0/4087749368 learned_addr learned my addr 172.21.15.37:0/4087749368 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.906+0000 7f752e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d1120 0x563f2d4d85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52668/0 (socket says 172.21.15.37:52668) 2024-08-20T05:11:24.908 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.906+0000 7f7538487740 10 client.0 _ll_register_callbacks cb 0x563f2d3ea5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:24.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.907+0000 7f752ea00640 1 -- 172.21.15.37:0/4087749368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d1120 msgr2=0x563f2d4d85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:24.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.907+0000 7f752ea00640 1 --2- 172.21.15.37:0/4087749368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d1120 0x563f2d4d85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.907+0000 7f752ea00640 1 -- 172.21.15.37:0/4087749368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d3b60 msgr2=0x563f2d4d91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:24.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.907+0000 7f752ea00640 1 --2- 172.21.15.37:0/4087749368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d3b60 0x563f2d4d91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.907+0000 7f752ea00640 1 -- 172.21.15.37:0/4087749368 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f2d3d8170 con 0x563f2d4ce7f0 2024-08-20T05:11:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.908+0000 7f752ea00640 1 --2- 172.21.15.37:0/4087749368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4ce7f0 0x563f2d4d7f30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f75300517a0 tx=0x7f75301174c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9461cc3eeff67e4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.908+0000 7f750fe00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:11:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.909+0000 7f750fe00640 1 -- 172.21.15.37:0/4087749368 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753008b040 con 0x563f2d4ce7f0 2024-08-20T05:11:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.909+0000 7f750fe00640 1 -- 172.21.15.37:0/4087749368 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7530120ac0 con 0x563f2d4ce7f0 2024-08-20T05:11:24.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.909+0000 7f7538487740 1 -- 172.21.15.37:0/4087749368 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75200053b0 con 0x563f2d4ce7f0 2024-08-20T05:11:24.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.910+0000 7f750fe00640 1 -- 172.21.15.37:0/4087749368 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f7530118390 con 0x563f2d4ce7f0 2024-08-20T05:11:24.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.910+0000 7f7538487740 10 client.27851 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:24.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.910+0000 7f7538487740 1 -- 172.21.15.37:0/4087749368 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x563f2d193790 con 0x563f2d4ce7f0 2024-08-20T05:11:24.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.911+0000 7f750fe00640 1 -- 172.21.15.37:0/4087749368 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7530117c90 con 0x563f2d4ce7f0 2024-08-20T05:11:24.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.911+0000 7f750fe00640 1 -- 172.21.15.37:0/4087749368 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f7530116960 con 0x563f2d4ce7f0 2024-08-20T05:11:24.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.911+0000 7f7538487740 10 client.27851 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:24.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.911+0000 7f7538487740 10 client.27851 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:24.912 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.911+0000 7f7538487740 20 client.27851 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:24.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.911+0000 7f7538487740 1 --2- 172.21.15.37:0/4087749368 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563f2d4e3c10 0x563f2d4e6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.911+0000 7f7538487740 4 client.27851 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:24.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.912+0000 7f7538487740 1 -- 172.21.15.37:0/4087749368 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f75200053b0 con 0x563f2d4e3c10 2024-08-20T05:11:24.913 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.912+0000 7f752e000640 1 --2- 172.21.15.37:0/4087749368 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563f2d4e3c10 0x563f2d4e6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:24.915 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.914+0000 7f752e000640 1 --2- 172.21.15.37:0/4087749368 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563f2d4e3c10 0x563f2d4e6070 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1972e27aa51ac450 server_cookie=21f34b8fcffeec1a in_seq=0 out_seq=0 2024-08-20T05:11:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.915+0000 7f750fe00640 10 client.27851 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.915+0000 7f750fe00640 1 -- 172.21.15.37:0/4087749368 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f75200053b0 con 0x563f2d4e3c10 2024-08-20T05:11:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.916+0000 7f750fe00640 10 client.27851 handle_command_reply: tid=0 2024-08-20T05:11:24.916 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.916+0000 7f7538487740 1 client.27851 shutdown 2024-08-20T05:11:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.917+0000 7f7538487740 1 -- 172.21.15.37:0/4087749368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4ce7f0 msgr2=0x563f2d4d7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:24.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.917+0000 7f7538487740 1 --2- 172.21.15.37:0/4087749368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4ce7f0 0x563f2d4d7f30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f75300517a0 tx=0x7f75301174c0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.918+0000 7f7538487740 1 -- 172.21.15.37:0/4087749368 shutdown_connections 2024-08-20T05:11:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.918+0000 7f7538487740 1 --2- 172.21.15.37:0/4087749368 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563f2d4e3c10 0x563f2d4e6070 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.918+0000 7f7538487740 1 --2- 172.21.15.37:0/4087749368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d3b60 0x563f2d4d91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.918+0000 7f7538487740 1 --2- 172.21.15.37:0/4087749368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d1120 0x563f2d4d85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.918+0000 7f7538487740 1 --2- 172.21.15.37:0/4087749368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4ce7f0 0x563f2d4d7f30 secure :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f75300517a0 tx=0x7f75301174c0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.918+0000 7f750fe00640 0 client.27851 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:24.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.918+0000 7f7538487740 1 -- 172.21.15.37:0/4087749368 >> 172.21.15.37:0/4087749368 conn(0x563f2d4c9940 msgr2=0x563f2d4c89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:24.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.919+0000 7f7538487740 1 -- 172.21.15.37:0/4087749368 shutdown_connections 2024-08-20T05:11:24.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.919+0000 7f7538487740 1 -- 172.21.15.37:0/4087749368 wait complete. 2024-08-20T05:11:24.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.919+0000 7f7538487740 20 client.27851 trim_cache size 0 max 16384 2024-08-20T05:11:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.950+0000 7f7538487740 1 Processor -- start 2024-08-20T05:11:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.950+0000 7f7538487740 1 -- start start 2024-08-20T05:11:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.951+0000 7f7538487740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4d1120 0x563f2d4d7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.951+0000 7f7538487740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d3b60 0x563f2d4ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.951+0000 7f7538487740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d4650 0x563f2d4ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.951+0000 7f7538487740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f752814d020 con 0x563f2d4d3b60 2024-08-20T05:11:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.951+0000 7f7538487740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f752814ec20 con 0x563f2d4d1120 2024-08-20T05:11:24.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.951+0000 7f7538487740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f752814d6f0 con 0x563f2d4d4650 2024-08-20T05:11:24.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.951+0000 7f752ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4d1120 0x563f2d4d7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:24.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.952+0000 7f752ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4d1120 0x563f2d4d7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44704/0 (socket says 172.21.15.37:44704) 2024-08-20T05:11:24.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.952+0000 7f752ea00640 1 -- 172.21.15.37:0/2561775303 learned_addr learned my addr 172.21.15.37:0/2561775303 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:24.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.952+0000 7f752f400640 1 --2- 172.21.15.37:0/2561775303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d4650 0x563f2d4ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:24.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.952+0000 7f752e000640 1 --2- 172.21.15.37:0/2561775303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d3b60 0x563f2d4ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:24.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.953+0000 7f752ea00640 1 -- 172.21.15.37:0/2561775303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d4650 msgr2=0x563f2d4ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:24.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.953+0000 7f752ea00640 1 --2- 172.21.15.37:0/2561775303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d4650 0x563f2d4ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.953+0000 7f752ea00640 1 -- 172.21.15.37:0/2561775303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d3b60 msgr2=0x563f2d4ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:24.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.953+0000 7f752ea00640 1 --2- 172.21.15.37:0/2561775303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d3b60 0x563f2d4ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.953+0000 7f752ea00640 1 -- 172.21.15.37:0/2561775303 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f2d20c620 con 0x563f2d4d1120 2024-08-20T05:11:24.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.953+0000 7f752e000640 1 --2- 172.21.15.37:0/2561775303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d3b60 0x563f2d4ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:11:24.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.954+0000 7f752ea00640 1 --2- 172.21.15.37:0/2561775303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4d1120 0x563f2d4d7ca0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7530114f00 tx=0x7f7530117530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7d65ef4b6914986 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:24.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.954+0000 7f751aa00640 1 -- 172.21.15.37:0/2561775303 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753008b070 con 0x563f2d4d1120 2024-08-20T05:11:24.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.954+0000 7f751aa00640 1 -- 172.21.15.37:0/2561775303 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7530117c90 con 0x563f2d4d1120 2024-08-20T05:11:24.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.954+0000 7f751aa00640 1 -- 172.21.15.37:0/2561775303 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f753011d610 con 0x563f2d4d1120 2024-08-20T05:11:24.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.955+0000 7f7538487740 1 -- 172.21.15.37:0/2561775303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4d1120 msgr2=0x563f2d4d7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:24.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.955+0000 7f7538487740 1 --2- 172.21.15.37:0/2561775303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4d1120 0x563f2d4d7ca0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7530114f00 tx=0x7f7530117530 comp rx=0 tx=0).stop 2024-08-20T05:11:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.955+0000 7f7538487740 1 -- 172.21.15.37:0/2561775303 shutdown_connections 2024-08-20T05:11:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.956+0000 7f7538487740 1 --2- 172.21.15.37:0/2561775303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d4650 0x563f2d4ca6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.956+0000 7f7538487740 1 --2- 172.21.15.37:0/2561775303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d3b60 0x563f2d4ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.956+0000 7f7538487740 1 --2- 172.21.15.37:0/2561775303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4d1120 0x563f2d4d7ca0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.957+0000 7f7538487740 1 -- 172.21.15.37:0/2561775303 >> 172.21.15.37:0/2561775303 conn(0x563f2d4c9940 msgr2=0x563f2d4d3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:24.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.958+0000 7f7538487740 1 -- 172.21.15.37:0/2561775303 shutdown_connections 2024-08-20T05:11:24.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.958+0000 7f7538487740 1 -- 172.21.15.37:0/2561775303 wait complete. 2024-08-20T05:11:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.960+0000 7f7538487740 1 -- start start 2024-08-20T05:11:24.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.960+0000 7f7538487740 1 Processor -- start 2024-08-20T05:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.961+0000 7f7538487740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4d1120 0x563f2d4df7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.961+0000 7f7538487740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d3b60 0x563f2d4de4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.961+0000 7f7538487740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d4650 0x563f2d4dea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.961+0000 7f7538487740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f752814e4f0 con 0x563f2d4d3b60 2024-08-20T05:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.961+0000 7f7538487740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f752814ddc0 con 0x563f2d4d1120 2024-08-20T05:11:24.962 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.961+0000 7f7538487740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7528133fb0 con 0x563f2d4d4650 2024-08-20T05:11:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.961+0000 7f7538487740 10 client.0 _ll_register_callbacks cb 0x7f7530068660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:24.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.961+0000 7f752f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d4650 0x563f2d4dea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.962+0000 7f752f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d4650 0x563f2d4dea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52684/0 (socket says 172.21.15.37:52684) 2024-08-20T05:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.962+0000 7f752f400640 1 -- 172.21.15.37:0/4086522497 learned_addr learned my addr 172.21.15.37:0/4086522497 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.962+0000 7f752ea00640 1 --2- 172.21.15.37:0/4086522497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4d1120 0x563f2d4df7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.962+0000 7f752e000640 1 --2- 172.21.15.37:0/4086522497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d3b60 0x563f2d4de4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.962+0000 7f752f400640 1 -- 172.21.15.37:0/4086522497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4d1120 msgr2=0x563f2d4df7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.962+0000 7f752f400640 1 --2- 172.21.15.37:0/4086522497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4d1120 0x563f2d4df7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.962+0000 7f752f400640 1 -- 172.21.15.37:0/4086522497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d3b60 msgr2=0x563f2d4de4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.962+0000 7f752f400640 1 --2- 172.21.15.37:0/4086522497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d3b60 0x563f2d4de4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.962+0000 7f752f400640 1 -- 172.21.15.37:0/4086522497 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f2d4df260 con 0x563f2d4d4650 2024-08-20T05:11:24.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.963+0000 7f752e000640 1 --2- 172.21.15.37:0/4086522497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d3b60 0x563f2d4de4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:11:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.963+0000 7f752f400640 1 --2- 172.21.15.37:0/4086522497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d4650 0x563f2d4dea30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f751c0058c0 tx=0x7f751c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f42633681f80028 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.963+0000 7f750fe00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:11:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.963+0000 7f750fe00640 1 -- 172.21.15.37:0/4086522497 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f751c020a40 con 0x563f2d4d4650 2024-08-20T05:11:24.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.964+0000 7f7538487740 1 -- 172.21.15.37:0/4086522497 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7530117c90 con 0x563f2d4d4650 2024-08-20T05:11:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.964+0000 7f750fe00640 1 -- 172.21.15.37:0/4086522497 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f751c020840 con 0x563f2d4d4650 2024-08-20T05:11:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.964+0000 7f750fe00640 1 -- 172.21.15.37:0/4086522497 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f751c020a40 con 0x563f2d4d4650 2024-08-20T05:11:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.964+0000 7f7538487740 10 client.27856 fetch_fsmap learned FSMap version 40 2024-08-20T05:11:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.965+0000 7f7538487740 1 -- 172.21.15.37:0/4086522497 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x563f2d54e9f0 con 0x563f2d4d4650 2024-08-20T05:11:24.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.965+0000 7f750fe00640 1 -- 172.21.15.37:0/4086522497 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7530117c90 con 0x563f2d4d4650 2024-08-20T05:11:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.966+0000 7f750fe00640 1 -- 172.21.15.37:0/4086522497 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f751c027070 con 0x563f2d4d4650 2024-08-20T05:11:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.966+0000 7f7538487740 10 client.27856 fetch_fsmap finished waiting for FSMap version 40 2024-08-20T05:11:24.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.966+0000 7f7538487740 10 client.27856 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.966+0000 7f7538487740 20 client.27856 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.966+0000 7f7538487740 1 --2- 172.21.15.37:0/4086522497 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563f2d54f460 0x563f2d551880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.966+0000 7f7538487740 4 client.27856 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:11:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.966+0000 7f7538487740 1 -- 172.21.15.37:0/4086522497 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563f2d443160 con 0x563f2d54f460 2024-08-20T05:11:24.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.967+0000 7f752ea00640 1 --2- 172.21.15.37:0/4086522497 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563f2d54f460 0x563f2d551880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.969+0000 7f750fe00640 10 client.27856 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:24.969+0000 7f752ea00640 1 --2- 172.21.15.37:0/4086522497 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563f2d54f460 0x563f2d551880 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5efa94fd2eae31cd server_cookie=bf2d3d736988f0e in_seq=0 out_seq=0 2024-08-20T05:11:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.133+0000 7f750fe00640 1 -- 172.21.15.37:0/4086522497 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563f2d443160 con 0x563f2d54f460 2024-08-20T05:11:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.133+0000 7f750fe00640 10 client.27856 handle_command_reply: tid=0 2024-08-20T05:11:25.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.133+0000 7f7538487740 1 client.27856 shutdown 2024-08-20T05:11:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.134+0000 7f7538487740 1 -- 172.21.15.37:0/4086522497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d4650 msgr2=0x563f2d4dea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.134+0000 7f7538487740 1 --2- 172.21.15.37:0/4086522497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d4650 0x563f2d4dea30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f751c0058c0 tx=0x7f751c004730 comp rx=0 tx=0).stop 2024-08-20T05:11:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.134+0000 7f7538487740 1 -- 172.21.15.37:0/4086522497 shutdown_connections 2024-08-20T05:11:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.134+0000 7f7538487740 1 --2- 172.21.15.37:0/4086522497 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563f2d54f460 0x563f2d551880 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.134+0000 7f7538487740 1 --2- 172.21.15.37:0/4086522497 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563f2d4d4650 0x563f2d4dea30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.134+0000 7f7538487740 1 --2- 172.21.15.37:0/4086522497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563f2d4d3b60 0x563f2d4de4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.134+0000 7f7538487740 1 --2- 172.21.15.37:0/4086522497 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563f2d4d1120 0x563f2d4df7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.134+0000 7f7538487740 1 -- 172.21.15.37:0/4086522497 >> 172.21.15.37:0/4086522497 conn(0x563f2d4c9940 msgr2=0x563f2d4ca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.134+0000 7f750fe00640 0 client.27856 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.134+0000 7f7538487740 1 -- 172.21.15.37:0/4086522497 shutdown_connections 2024-08-20T05:11:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.134+0000 7f7538487740 1 -- 172.21.15.37:0/4086522497 wait complete. 2024-08-20T05:11:25.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.134+0000 7f7538487740 20 client.27856 trim_cache size 0 max 16384 2024-08-20T05:11:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:11:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:11:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:11:25.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:11:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.135+0000 7f752fe00640 1 -- 172.21.15.37:0/2081564011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75140b3de0 msgr2=0x7f75140b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.135+0000 7f752fe00640 1 --2- 172.21.15.37:0/2081564011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75140b3de0 0x7f75140b62a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f751c005fd0 tx=0x7f751c005850 comp rx=0 tx=0).stop 2024-08-20T05:11:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.135+0000 7f752fe00640 1 -- 172.21.15.37:0/2081564011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7528097730 msgr2=0x7f7528008f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.135+0000 7f752fe00640 1 --2- 172.21.15.37:0/2081564011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7528097730 0x7f7528008f70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7530052510 tx=0x7f753006c3d0 comp rx=0 tx=0).stop 2024-08-20T05:11:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.135+0000 7f752fe00640 1 -- 172.21.15.37:0/2081564011 shutdown_connections 2024-08-20T05:11:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.135+0000 7f752fe00640 1 --2- 172.21.15.37:0/2081564011 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75140b3de0 0x7f75140b62a0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.135+0000 7f752fe00640 1 --2- 172.21.15.37:0/2081564011 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7528099240 0x7f752800a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.135+0000 7f752fe00640 1 --2- 172.21.15.37:0/2081564011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7528098880 0x7f75280095c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:25.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.135+0000 7f752fe00640 1 --2- 172.21.15.37:0/2081564011 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7528097730 0x7f7528008f70 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.135+0000 7f752fe00640 1 -- 172.21.15.37:0/2081564011 >> 172.21.15.37:0/2081564011 conn(0x7f7528092fd0 msgr2=0x7f752809bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.136+0000 7f752fe00640 1 -- 172.21.15.37:0/2081564011 shutdown_connections 2024-08-20T05:11:25.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:25.136+0000 7f752fe00640 1 -- 172.21.15.37:0/2081564011 wait complete. 2024-08-20T05:11:25.322 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:25.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:25 smithi130 ceph-mon[22007]: pgmap v676: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 379 KiB/s wr, 135 op/s 2024-08-20T05:11:25.707 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:25 smithi037 ceph-mon[17265]: pgmap v676: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 379 KiB/s wr, 135 op/s 2024-08-20T05:11:25.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:25 smithi135 ceph-mon[22342]: pgmap v676: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 379 KiB/s wr, 135 op/s 2024-08-20T05:11:26.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.094+0000 7effe2600640 1 -- 172.21.15.37:0/424010272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effd40a1e30 msgr2=0x7effd40a4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:26.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.094+0000 7effe2600640 1 --2- 172.21.15.37:0/424010272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effd40a1e30 0x7effd40a4220 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7effdc068900 tx=0x7effdc097b80 comp rx=0 tx=0).stop 2024-08-20T05:11:26.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.097+0000 7effe2600640 1 -- 172.21.15.37:0/424010272 shutdown_connections 2024-08-20T05:11:26.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.097+0000 7effe2600640 1 --2- 172.21.15.37:0/424010272 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effd40a1e30 0x7effd40a4220 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:26.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.097+0000 7effe2600640 1 --2- 172.21.15.37:0/424010272 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effd4006e20 0x7effd4007260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:26.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.097+0000 7effe2600640 1 --2- 172.21.15.37:0/424010272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effd40084b0 0x7effd40068e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:26.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.097+0000 7effe2600640 1 -- 172.21.15.37:0/424010272 >> 172.21.15.37:0/424010272 conn(0x7effd400d600 msgr2=0x7effd400da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:26.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.097+0000 7effe2600640 1 -- 172.21.15.37:0/424010272 shutdown_connections 2024-08-20T05:11:26.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.098+0000 7effe2600640 1 -- 172.21.15.37:0/424010272 wait complete. 2024-08-20T05:11:26.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.099+0000 7effe2600640 1 Processor -- start 2024-08-20T05:11:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.099+0000 7effe2600640 1 -- start start 2024-08-20T05:11:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.101+0000 7effe2600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effd4006e20 0x7effd412dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.101+0000 7effe2600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effd40084b0 0x7effd412e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.102+0000 7effe2600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effd40a1e30 0x7effd41335c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.102+0000 7effe2600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7effd40a79f0 con 0x7effd4006e20 2024-08-20T05:11:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.102+0000 7effe2600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7effd40a7870 con 0x7effd40084b0 2024-08-20T05:11:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.102+0000 7effe2600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7effd40a7b70 con 0x7effd40a1e30 2024-08-20T05:11:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.102+0000 7effe1200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effd4006e20 0x7effd412dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.103+0000 7effe1200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effd4006e20 0x7effd412dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57994/0 (socket says 172.21.15.37:57994) 2024-08-20T05:11:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.103+0000 7effe1200640 1 -- 172.21.15.37:0/929770993 learned_addr learned my addr 172.21.15.37:0/929770993 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.103+0000 7effe1200640 1 -- 172.21.15.37:0/929770993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effd40a1e30 msgr2=0x7effd41335c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.103+0000 7effe1200640 1 --2- 172.21.15.37:0/929770993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effd40a1e30 0x7effd41335c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.103+0000 7effe1200640 1 -- 172.21.15.37:0/929770993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effd40084b0 msgr2=0x7effd412e220 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T05:11:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.103+0000 7effe1200640 1 --2- 172.21.15.37:0/929770993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effd40084b0 0x7effd412e220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.103+0000 7effe1200640 1 -- 172.21.15.37:0/929770993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd4133d90 con 0x7effd4006e20 2024-08-20T05:11:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.105+0000 7effe1200640 1 --2- 172.21.15.37:0/929770993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effd4006e20 0x7effd412dce0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7effd000d950 tx=0x7effd000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.105+0000 7effd9600640 1 -- 172.21.15.37:0/929770993 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd0017070 con 0x7effd4006e20 2024-08-20T05:11:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.106+0000 7effd9600640 1 -- 172.21.15.37:0/929770993 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effd0009c30 con 0x7effd4006e20 2024-08-20T05:11:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.106+0000 7effd9600640 1 -- 172.21.15.37:0/929770993 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd000f620 con 0x7effd4006e20 2024-08-20T05:11:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.106+0000 7effe2600640 1 -- 172.21.15.37:0/929770993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd4134080 con 0x7effd4006e20 2024-08-20T05:11:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.106+0000 7effe2600640 1 -- 172.21.15.37:0/929770993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd413a910 con 0x7effd4006e20 2024-08-20T05:11:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.107+0000 7effe2600640 1 -- 172.21.15.37:0/929770993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effbc0052c0 con 0x7effd4006e20 2024-08-20T05:11:26.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.125+0000 7effd9600640 1 -- 172.21.15.37:0/929770993 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7effd000f7c0 con 0x7effd4006e20 2024-08-20T05:11:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.132+0000 7effd9600640 1 --2- 172.21.15.37:0/929770993 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7effc40b3cd0 0x7effc40b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:26.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.133+0000 7effd9600640 1 -- 172.21.15.37:0/929770993 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7effd00e3fc0 con 0x7effd4006e20 2024-08-20T05:11:26.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.133+0000 7effd9600640 1 -- 172.21.15.37:0/929770993 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7effd0020070 con 0x7effd4006e20 2024-08-20T05:11:26.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.135+0000 7effdbe00640 1 --2- 172.21.15.37:0/929770993 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7effc40b3cd0 0x7effc40b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:26.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.140+0000 7effdbe00640 1 --2- 172.21.15.37:0/929770993 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7effc40b3cd0 0x7effc40b6190 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7effd400df30 tx=0x7effc8006bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.583+0000 7effe2600640 1 -- 172.21.15.37:0/929770993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effbc0055b0 con 0x7effd4006e20 2024-08-20T05:11:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.584+0000 7effd9600640 1 -- 172.21.15.37:0/929770993 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11986 (secure 0 0 0) 0x7effd00ab290 con 0x7effd4006e20 2024-08-20T05:11:26.587 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:11:26.587 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":40,"btime":"2024-08-20T05:11:06:453851+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:11:06.285910+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:11:26.587 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 40 2024-08-20T05:11:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.588+0000 7effe2600640 1 -- 172.21.15.37:0/929770993 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7effc40b3cd0 msgr2=0x7effc40b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.588+0000 7effe2600640 1 --2- 172.21.15.37:0/929770993 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7effc40b3cd0 0x7effc40b6190 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7effd400df30 tx=0x7effc8006bd0 comp rx=0 tx=0).stop 2024-08-20T05:11:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.588+0000 7effe2600640 1 -- 172.21.15.37:0/929770993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effd4006e20 msgr2=0x7effd412dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.588+0000 7effe2600640 1 --2- 172.21.15.37:0/929770993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effd4006e20 0x7effd412dce0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7effd000d950 tx=0x7effd000de10 comp rx=0 tx=0).stop 2024-08-20T05:11:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.588+0000 7effe2600640 1 -- 172.21.15.37:0/929770993 shutdown_connections 2024-08-20T05:11:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.588+0000 7effe2600640 1 --2- 172.21.15.37:0/929770993 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7effc40b3cd0 0x7effc40b6190 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.588+0000 7effe2600640 1 --2- 172.21.15.37:0/929770993 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7effd40a1e30 0x7effd41335c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:26.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.588+0000 7effe2600640 1 --2- 172.21.15.37:0/929770993 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7effd40084b0 0x7effd412e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:26.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.588+0000 7effe2600640 1 --2- 172.21.15.37:0/929770993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effd4006e20 0x7effd412dce0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:26.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.588+0000 7effe2600640 1 -- 172.21.15.37:0/929770993 >> 172.21.15.37:0/929770993 conn(0x7effd400d600 msgr2=0x7effd4099dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.592+0000 7effe2600640 1 -- 172.21.15.37:0/929770993 shutdown_connections 2024-08-20T05:11:26.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:26.592+0000 7effe2600640 1 -- 172.21.15.37:0/929770993 wait complete. 2024-08-20T05:11:27.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:27 smithi130 ceph-mon[22007]: pgmap v677: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 603 KiB/s wr, 164 op/s 2024-08-20T05:11:27.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:27 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/929770993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:11:27.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:27 smithi037 ceph-mon[17265]: pgmap v677: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 603 KiB/s wr, 164 op/s 2024-08-20T05:11:27.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:27 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/929770993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:11:27.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:27 smithi135 ceph-mon[22342]: pgmap v677: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 603 KiB/s wr, 164 op/s 2024-08-20T05:11:27.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:27 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/929770993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:11:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 510.0 s, 595.4 tps, lat 988.527 ms stddev 4540.976 2024-08-20T05:11:28.252 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 147.85 --await-for 45.0' 2024-08-20T05:11:28.252 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 147.85 --await-for 45.0 2024-08-20T05:11:28.952 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:29.662 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:29 smithi037 ceph-mon[17265]: pgmap v678: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 1.0 MiB/s wr, 183 op/s 2024-08-20T05:11:29.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:29 smithi130 ceph-mon[22007]: pgmap v678: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 1.0 MiB/s wr, 183 op/s 2024-08-20T05:11:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.764+0000 7f7ce4800640 1 -- 172.21.15.37:0/907853069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc104ca0 msgr2=0x7f7cdc105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:29.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.764+0000 7f7ce4800640 1 --2- 172.21.15.37:0/907853069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc104ca0 0x7f7cdc105080 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009900 tx=0x7f7cd003b420 comp rx=0 tx=0).stop 2024-08-20T05:11:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.764+0000 7f7ce4800640 1 -- 172.21.15.37:0/907853069 shutdown_connections 2024-08-20T05:11:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.764+0000 7f7ce4800640 1 --2- 172.21.15.37:0/907853069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cdc10b030 0x7f7cdc111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.764+0000 7f7ce4800640 1 --2- 172.21.15.37:0/907853069 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cdc10a6b0 0x7f7cdc10aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.764+0000 7f7ce4800640 1 --2- 172.21.15.37:0/907853069 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc104ca0 0x7f7cdc105080 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.764+0000 7f7ce4800640 1 -- 172.21.15.37:0/907853069 >> 172.21.15.37:0/907853069 conn(0x7f7cdc100730 msgr2=0x7f7cdc102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.766+0000 7f7ce4800640 1 -- 172.21.15.37:0/907853069 shutdown_connections 2024-08-20T05:11:29.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.766+0000 7f7ce4800640 1 -- 172.21.15.37:0/907853069 wait complete. 2024-08-20T05:11:29.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.768+0000 7f7ce4800640 1 Processor -- start 2024-08-20T05:11:29.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.768+0000 7f7ce4800640 1 -- start start 2024-08-20T05:11:29.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.769+0000 7f7ce4800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cdc104ca0 0x7f7cdc110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.769+0000 7f7ce4800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc10a6b0 0x7f7cdc110790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.770 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.769+0000 7f7ce4800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cdc10b030 0x7f7cdc073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.769+0000 7f7ce4800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc078460 con 0x7f7cdc104ca0 2024-08-20T05:11:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.769+0000 7f7ce4800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc0782e0 con 0x7f7cdc10a6b0 2024-08-20T05:11:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.769+0000 7f7ce4800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc0785e0 con 0x7f7cdc10b030 2024-08-20T05:11:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.770+0000 7f7ce1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc10a6b0 0x7f7cdc110790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.770+0000 7f7ce1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc10a6b0 0x7f7cdc110790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44746/0 (socket says 172.21.15.37:44746) 2024-08-20T05:11:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.770+0000 7f7ce1400640 1 -- 172.21.15.37:0/3045684741 learned_addr learned my addr 172.21.15.37:0/3045684741 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.770+0000 7f7ce2800640 1 --2- 172.21.15.37:0/3045684741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cdc10b030 0x7f7cdc073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.770+0000 7f7ce1e00640 1 --2- 172.21.15.37:0/3045684741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cdc104ca0 0x7f7cdc110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.771+0000 7f7ce1400640 1 -- 172.21.15.37:0/3045684741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cdc10b030 msgr2=0x7f7cdc073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.771+0000 7f7ce1400640 1 --2- 172.21.15.37:0/3045684741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cdc10b030 0x7f7cdc073f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.771+0000 7f7ce1400640 1 -- 172.21.15.37:0/3045684741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cdc104ca0 msgr2=0x7f7cdc110250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.771+0000 7f7ce1400640 1 --2- 172.21.15.37:0/3045684741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cdc104ca0 0x7f7cdc110250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.771+0000 7f7ce1400640 1 -- 172.21.15.37:0/3045684741 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc074600 con 0x7f7cdc10a6b0 2024-08-20T05:11:29.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.772+0000 7f7ce1400640 1 --2- 172.21.15.37:0/3045684741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc10a6b0 0x7f7cdc110790 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00e9f0 tx=0x7f7ccc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:29.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.772+0000 7f7cd6a00640 1 -- 172.21.15.37:0/3045684741 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc00cd80 con 0x7f7cdc10a6b0 2024-08-20T05:11:29.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.773+0000 7f7cd6a00640 1 -- 172.21.15.37:0/3045684741 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ccc0108e0 con 0x7f7cdc10a6b0 2024-08-20T05:11:29.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.773+0000 7f7cd6a00640 1 -- 172.21.15.37:0/3045684741 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc018980 con 0x7f7cdc10a6b0 2024-08-20T05:11:29.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.774+0000 7f7ce4800640 1 -- 172.21.15.37:0/3045684741 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cdc0748f0 con 0x7f7cdc10a6b0 2024-08-20T05:11:29.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.774+0000 7f7ce4800640 1 -- 172.21.15.37:0/3045684741 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cdc074de0 con 0x7f7cdc10a6b0 2024-08-20T05:11:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.778+0000 7f7ce72cd740 1 Processor -- start 2024-08-20T05:11:29.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.779+0000 7f7ce72cd740 1 -- start start 2024-08-20T05:11:29.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.780+0000 7f7ce72cd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1be40 0x558d28a1c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.780+0000 7f7ce72cd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a1c760 0x558d28a281b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.780+0000 7f7ce72cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a286f0 0x558d28a2aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.780+0000 7f7ce72cd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558d28991600 con 0x558d28a1c760 2024-08-20T05:11:29.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.780+0000 7f7ce72cd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558d28980b00 con 0x558d28a1be40 2024-08-20T05:11:29.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.780+0000 7f7ce72cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558d28984b40 con 0x558d28a286f0 2024-08-20T05:11:29.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.780+0000 7f7ce2800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1be40 0x558d28a1c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:29.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.780+0000 7f7ce2800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1be40 0x558d28a1c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44754/0 (socket says 172.21.15.37:44754) 2024-08-20T05:11:29.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.780+0000 7f7ce2800640 1 -- 172.21.15.37:0/538557449 learned_addr learned my addr 172.21.15.37:0/538557449 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:29.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.781+0000 7f7ce1e00640 1 --2- 172.21.15.37:0/538557449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a1c760 0x558d28a281b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:29.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.781+0000 7f7ce2800640 1 -- 172.21.15.37:0/538557449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a286f0 msgr2=0x558d28a2aae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:11:29.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.781+0000 7f7ce2800640 1 --2- 172.21.15.37:0/538557449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a286f0 0x558d28a2aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.781+0000 7f7ce2800640 1 -- 172.21.15.37:0/538557449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a1c760 msgr2=0x558d28a281b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:29.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.781+0000 7f7ce2800640 1 --2- 172.21.15.37:0/538557449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a1c760 0x558d28a281b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.781+0000 7f7ce2800640 1 -- 172.21.15.37:0/538557449 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d28926ee0 con 0x558d28a1be40 2024-08-20T05:11:29.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.781+0000 7f7cd6a00640 1 -- 172.21.15.37:0/3045684741 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7ccc018b20 con 0x7f7cdc10a6b0 2024-08-20T05:11:29.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.781+0000 7f7ce2800640 1 --2- 172.21.15.37:0/538557449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1be40 0x558d28a1c220 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7cd80039f0 tx=0x7f7cd8003eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68dad202c8b9b005 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:29.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.782+0000 7f7ccb000640 1 -- 172.21.15.37:0/538557449 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd801a470 con 0x558d28a1be40 2024-08-20T05:11:29.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.782+0000 7f7ccb000640 1 -- 172.21.15.37:0/538557449 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cd8015070 con 0x558d28a1be40 2024-08-20T05:11:29.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.782+0000 7f7ccb000640 1 -- 172.21.15.37:0/538557449 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd801a470 con 0x558d28a1be40 2024-08-20T05:11:29.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.783+0000 7f7ce72cd740 1 -- 172.21.15.37:0/538557449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1be40 msgr2=0x558d28a1c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.783+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/538557449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1be40 0x558d28a1c220 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7cd80039f0 tx=0x7f7cd8003eb0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.783+0000 7f7ce72cd740 1 -- 172.21.15.37:0/538557449 shutdown_connections 2024-08-20T05:11:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.783+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/538557449 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a286f0 0x558d28a2aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.783+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/538557449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a1c760 0x558d28a281b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.783+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/538557449 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1be40 0x558d28a1c220 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.783+0000 7f7cd6a00640 1 --2- 172.21.15.37:0/3045684741 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7cc40b3c50 0x7f7cc40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.783+0000 7f7ce72cd740 1 -- 172.21.15.37:0/538557449 >> 172.21.15.37:0/538557449 conn(0x558d28a19c70 msgr2=0x558d28a1ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.784+0000 7f7cd6a00640 1 -- 172.21.15.37:0/3045684741 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7ccc0e4280 con 0x7f7cdc10a6b0 2024-08-20T05:11:29.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.784+0000 7f7ce2800640 1 --2- 172.21.15.37:0/3045684741 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7cc40b3c50 0x7f7cc40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:29.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.785+0000 7f7ce72cd740 1 -- 172.21.15.37:0/538557449 shutdown_connections 2024-08-20T05:11:29.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.785+0000 7f7ce72cd740 1 -- 172.21.15.37:0/538557449 wait complete. 2024-08-20T05:11:29.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.785+0000 7f7ce72cd740 1 -- start start 2024-08-20T05:11:29.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.786+0000 7f7ce72cd740 1 Processor -- start 2024-08-20T05:11:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.787+0000 7f7ce2800640 1 --2- 172.21.15.37:0/3045684741 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7cc40b3c50 0x7f7cc40b6110 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8011e30 tx=0x7f7cd8011f30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.788+0000 7f7ce72cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 0x558d28a25700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.788+0000 7f7ce72cd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a1c760 0x558d28a25c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.788+0000 7f7ce72cd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a286f0 0x558d28a26180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.788+0000 7f7ce72cd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558d287e37b0 con 0x558d28a1c760 2024-08-20T05:11:29.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.788+0000 7f7ce72cd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558d2891bdd0 con 0x558d28a286f0 2024-08-20T05:11:29.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.788+0000 7f7ce72cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558d28a3c380 con 0x558d28a1be40 2024-08-20T05:11:29.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.788+0000 7f7ce72cd740 10 client.0 _ll_register_callbacks cb 0x558d2868d0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.789+0000 7f7ce1e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 0x558d28a25700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.789+0000 7f7ce2800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a286f0 0x558d28a26180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.789+0000 7f7ce2800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a286f0 0x558d28a26180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:44766/0 (socket says 172.21.15.37:44766) 2024-08-20T05:11:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.789+0000 7f7ce2800640 1 -- 172.21.15.37:0/464129112 learned_addr learned my addr 172.21.15.37:0/464129112 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.789+0000 7f7ce1400640 1 --2- 172.21.15.37:0/464129112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a1c760 0x558d28a25c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.790+0000 7f7ce2800640 1 -- 172.21.15.37:0/464129112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 msgr2=0x558d28a25700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.790+0000 7f7ce2800640 1 --2- 172.21.15.37:0/464129112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 0x558d28a25700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.790+0000 7f7ce2800640 1 -- 172.21.15.37:0/464129112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a1c760 msgr2=0x558d28a25c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.790+0000 7f7ce2800640 1 --2- 172.21.15.37:0/464129112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a1c760 0x558d28a25c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.790+0000 7f7ce2800640 1 -- 172.21.15.37:0/464129112 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d286efba0 con 0x558d28a286f0 2024-08-20T05:11:29.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.791+0000 7f7ce2800640 1 --2- 172.21.15.37:0/464129112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a286f0 0x558d28a26180 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8004fd0 tx=0x7f7cd8003eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e2632baa301702b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:29.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.791+0000 7f7cbf400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:11:29.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.792+0000 7f7cbf400640 1 -- 172.21.15.37:0/464129112 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8034060 con 0x558d28a286f0 2024-08-20T05:11:29.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.792+0000 7f7cbf400640 1 -- 172.21.15.37:0/464129112 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7cd80056d0 con 0x558d28a286f0 2024-08-20T05:11:29.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.792+0000 7f7ce72cd740 1 -- 172.21.15.37:0/464129112 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cd8015070 con 0x558d28a286f0 2024-08-20T05:11:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.795+0000 7f7cbf400640 1 -- 172.21.15.37:0/464129112 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f7cd80058d0 con 0x558d28a286f0 2024-08-20T05:11:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.795+0000 7f7ce72cd740 10 client.27869 fetch_fsmap learned FSMap version 41 2024-08-20T05:11:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.795+0000 7f7ce72cd740 1 -- 172.21.15.37:0/464129112 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x558d28a47f90 con 0x558d28a286f0 2024-08-20T05:11:29.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.796+0000 7f7cbf400640 1 -- 172.21.15.37:0/464129112 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cd8015070 con 0x558d28a286f0 2024-08-20T05:11:29.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.798+0000 7f7cbf400640 1 -- 172.21.15.37:0/464129112 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 41) ==== 8390+0+0 (secure 0 0 0) 0x7f7cd80245c0 con 0x558d28a286f0 2024-08-20T05:11:29.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.798+0000 7f7ce72cd740 10 client.27869 fetch_fsmap finished waiting for FSMap version 41 2024-08-20T05:11:29.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.798+0000 7f7ce72cd740 10 client.27869 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:11:29.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.798+0000 7f7ce72cd740 20 client.27869 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:29.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.798+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/464129112 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558d28a492e0 0x558d28a4b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.798+0000 7f7ce72cd740 4 client.27869 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:29.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.798+0000 7f7ce72cd740 1 -- 172.21.15.37:0/464129112 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d28993550 con 0x558d28a492e0 2024-08-20T05:11:29.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.800+0000 7f7ce1e00640 1 --2- 172.21.15.37:0/464129112 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558d28a492e0 0x558d28a4b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:29.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.803+0000 7f7cbf400640 10 client.27869 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:29.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.803+0000 7f7ce1e00640 1 --2- 172.21.15.37:0/464129112 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558d28a492e0 0x558d28a4b6d0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=292ac20ac7a8240f server_cookie=4f3e1fd832421451 in_seq=0 out_seq=0 2024-08-20T05:11:29.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.805+0000 7f7cbf400640 1 -- 172.21.15.37:0/464129112 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d28993550 con 0x558d28a492e0 2024-08-20T05:11:29.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.805+0000 7f7cbf400640 10 client.27869 handle_command_reply: tid=0 2024-08-20T05:11:29.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.805+0000 7f7ce72cd740 1 client.27869 shutdown 2024-08-20T05:11:29.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.806+0000 7f7ce72cd740 1 -- 172.21.15.37:0/464129112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a286f0 msgr2=0x558d28a26180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:29.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.806+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/464129112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a286f0 0x558d28a26180 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8004fd0 tx=0x7f7cd8003eb0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.807+0000 7f7ce72cd740 1 -- 172.21.15.37:0/464129112 shutdown_connections 2024-08-20T05:11:29.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.807+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/464129112 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558d28a492e0 0x558d28a4b6d0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.807+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/464129112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a286f0 0x558d28a26180 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.807+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/464129112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a1c760 0x558d28a25c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.807+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/464129112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 0x558d28a25700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.807+0000 7f7cbf400640 0 client.27869 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:29.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.807+0000 7f7ce72cd740 1 -- 172.21.15.37:0/464129112 >> 172.21.15.37:0/464129112 conn(0x558d28a19c70 msgr2=0x558d28a1f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.810+0000 7f7ce72cd740 1 -- 172.21.15.37:0/464129112 shutdown_connections 2024-08-20T05:11:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.811+0000 7f7ce72cd740 1 -- 172.21.15.37:0/464129112 wait complete. 2024-08-20T05:11:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.812+0000 7f7ce72cd740 20 client.27869 trim_cache size 0 max 16384 2024-08-20T05:11:29.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.859+0000 7f7ce72cd740 1 Processor -- start 2024-08-20T05:11:29.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.859+0000 7f7ce72cd740 1 -- start start 2024-08-20T05:11:29.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.860+0000 7f7ce72cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 0x558d28a27440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.860+0000 7f7ce72cd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1c760 0x558d28a25c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.860+0000 7f7ce72cd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a286f0 0x558d28a26180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.860+0000 7f7ce72cd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1a4e60 con 0x558d28a286f0 2024-08-20T05:11:29.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.860+0000 7f7ce72cd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1a6a60 con 0x558d28a1c760 2024-08-20T05:11:29.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.860+0000 7f7ce72cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1a5530 con 0x558d28a1be40 2024-08-20T05:11:29.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.861+0000 7f7ce2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a286f0 0x558d28a26180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:29.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.862+0000 7f7ce2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a286f0 0x558d28a26180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58040/0 (socket says 172.21.15.37:58040) 2024-08-20T05:11:29.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.862+0000 7f7ce2800640 1 -- 172.21.15.37:0/738867430 learned_addr learned my addr 172.21.15.37:0/738867430 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:29.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.862+0000 7f7ce1400640 1 --2- 172.21.15.37:0/738867430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1c760 0x558d28a25c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:29.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.862+0000 7f7ce1e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 0x558d28a27440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:29.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.863+0000 7f7ce2800640 1 -- 172.21.15.37:0/738867430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 msgr2=0x558d28a27440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:29.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.864+0000 7f7ce2800640 1 --2- 172.21.15.37:0/738867430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 0x558d28a27440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.864+0000 7f7ce2800640 1 -- 172.21.15.37:0/738867430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1c760 msgr2=0x558d28a25c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:29.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.864+0000 7f7ce2800640 1 --2- 172.21.15.37:0/738867430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1c760 0x558d28a25c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.864+0000 7f7ce2800640 1 -- 172.21.15.37:0/738867430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d28a19aa0 con 0x558d28a286f0 2024-08-20T05:11:29.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:29 smithi135 ceph-mon[22342]: pgmap v678: 129 pgs: 129 active+clean; 1.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 1.0 MiB/s wr, 183 op/s 2024-08-20T05:11:29.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.865+0000 7f7ce1e00640 1 --2- 172.21.15.37:0/738867430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 0x558d28a27440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:11:29.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.865+0000 7f7ce1400640 1 --2- 172.21.15.37:0/738867430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1c760 0x558d28a25c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:11:29.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.866+0000 7f7ce2800640 1 --2- 172.21.15.37:0/738867430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a286f0 0x558d28a26180 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009b60 tx=0x7f7cd8011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5af80e1f3b2c5f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:29.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.866+0000 7f7cca600640 1 -- 172.21.15.37:0/738867430 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8034070 con 0x558d28a286f0 2024-08-20T05:11:29.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.867+0000 7f7cca600640 1 -- 172.21.15.37:0/738867430 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cd8015040 con 0x558d28a286f0 2024-08-20T05:11:29.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.867+0000 7f7cca600640 1 -- 172.21.15.37:0/738867430 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd803e080 con 0x558d28a286f0 2024-08-20T05:11:29.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.867+0000 7f7ce72cd740 1 -- 172.21.15.37:0/738867430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a286f0 msgr2=0x558d28a26180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:29.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.868+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/738867430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a286f0 0x558d28a26180 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009b60 tx=0x7f7cd8011ca0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.868+0000 7f7ce72cd740 1 -- 172.21.15.37:0/738867430 shutdown_connections 2024-08-20T05:11:29.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.868+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/738867430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a286f0 0x558d28a26180 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.868+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/738867430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1c760 0x558d28a25c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.868+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/738867430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 0x558d28a27440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.868+0000 7f7ce72cd740 1 -- 172.21.15.37:0/738867430 >> 172.21.15.37:0/738867430 conn(0x558d28a19c70 msgr2=0x558d28a26d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:29.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.868+0000 7f7ce72cd740 1 -- 172.21.15.37:0/738867430 shutdown_connections 2024-08-20T05:11:29.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.869+0000 7f7ce72cd740 1 -- 172.21.15.37:0/738867430 wait complete. 2024-08-20T05:11:29.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.869+0000 7f7ce72cd740 1 -- start start 2024-08-20T05:11:29.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.870+0000 7f7ce72cd740 1 Processor -- start 2024-08-20T05:11:29.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.870+0000 7f7ce72cd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 0x558d28a3d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.870+0000 7f7ce72cd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1c760 0x558d28a3de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.870+0000 7f7ce72cd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a286f0 0x558d28ab2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.870+0000 7f7ce72cd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1a6330 con 0x558d28a286f0 2024-08-20T05:11:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.870+0000 7f7ce72cd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc1a5c00 con 0x558d28a1c760 2024-08-20T05:11:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.870+0000 7f7ce72cd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc11a110 con 0x558d28a1be40 2024-08-20T05:11:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.870+0000 7f7ce72cd740 10 client.0 _ll_register_callbacks cb 0x7f7cd8009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.871+0000 7f7ce1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1c760 0x558d28a3de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.871+0000 7f7ce1e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 0x558d28a3d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.871+0000 7f7ce1e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 0x558d28a3d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52744/0 (socket says 172.21.15.37:52744) 2024-08-20T05:11:29.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.871+0000 7f7ce1e00640 1 -- 172.21.15.37:0/1512082462 learned_addr learned my addr 172.21.15.37:0/1512082462 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.872+0000 7f7ce1e00640 1 -- 172.21.15.37:0/1512082462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1c760 msgr2=0x558d28a3de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.872+0000 7f7ce1e00640 1 --2- 172.21.15.37:0/1512082462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1c760 0x558d28a3de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.872+0000 7f7ce1e00640 1 -- 172.21.15.37:0/1512082462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a286f0 msgr2=0x558d28ab2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.872+0000 7f7ce1e00640 1 --2- 172.21.15.37:0/1512082462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a286f0 0x558d28ab2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:29.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.872+0000 7f7ce1e00640 1 -- 172.21.15.37:0/1512082462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d28a193a0 con 0x558d28a1be40 2024-08-20T05:11:29.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.872+0000 7f7cbf400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:11:29.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.873+0000 7f7ce1e00640 1 --2- 172.21.15.37:0/1512082462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 0x558d28a3d950 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0005e00 tx=0x7f7cd0005900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29edf2cb6206ffa2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:29.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.873+0000 7f7cbf400640 1 -- 172.21.15.37:0/1512082462 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0046040 con 0x558d28a1be40 2024-08-20T05:11:29.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.873+0000 7f7cbf400640 1 -- 172.21.15.37:0/1512082462 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7cd0005250 con 0x558d28a1be40 2024-08-20T05:11:29.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.874+0000 7f7ce72cd740 1 -- 172.21.15.37:0/1512082462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cd8015040 con 0x558d28a1be40 2024-08-20T05:11:29.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.874+0000 7f7cbf400640 1 -- 172.21.15.37:0/1512082462 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7f7cd0005450 con 0x558d28a1be40 2024-08-20T05:11:29.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.875+0000 7f7ce72cd740 10 client.27871 fetch_fsmap learned FSMap version 41 2024-08-20T05:11:29.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.875+0000 7f7ce72cd740 1 -- 172.21.15.37:0/1512082462 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) -- 0x558d28ab4400 con 0x558d28a1be40 2024-08-20T05:11:29.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.876+0000 7f7cbf400640 1 -- 172.21.15.37:0/1512082462 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cd8015040 con 0x558d28a1be40 2024-08-20T05:11:29.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.879+0000 7f7cbf400640 1 -- 172.21.15.37:0/1512082462 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 41) ==== 8390+0+0 (secure 0 0 0) 0x7f7cd0004770 con 0x558d28a1be40 2024-08-20T05:11:29.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.879+0000 7f7ce72cd740 10 client.27871 fetch_fsmap finished waiting for FSMap version 41 2024-08-20T05:11:29.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.879+0000 7f7ce72cd740 10 client.27871 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:11:29.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.879+0000 7f7ce72cd740 20 client.27871 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:29.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.879+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/1512082462 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558d28ab4c20 0x558d28ab7040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:29.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.879+0000 7f7ce72cd740 4 client.27871 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.85, "await_for": 45.0}] 2024-08-20T05:11:29.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.879+0000 7f7ce72cd740 1 -- 172.21.15.37:0/1512082462 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.85, "await_for": 45.0}) -- 0x558d2898eff0 con 0x558d28ab4c20 2024-08-20T05:11:29.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.880+0000 7f7ce1400640 1 --2- 172.21.15.37:0/1512082462 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558d28ab4c20 0x558d28ab7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:29.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.881+0000 7f7cbf400640 10 client.27871 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:29.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:29.881+0000 7f7ce1400640 1 --2- 172.21.15.37:0/1512082462 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558d28ab4c20 0x558d28ab7040 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed4fc32569ee5ee6 server_cookie=44ec1ec4c000bf98 in_seq=0 out_seq=0 2024-08-20T05:11:30.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.040+0000 7f7cbf400640 1 -- 172.21.15.37:0/1512082462 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558d2898eff0 con 0x558d28ab4c20 2024-08-20T05:11:30.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.040+0000 7f7cbf400640 10 client.27871 handle_command_reply: tid=0 2024-08-20T05:11:30.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.040+0000 7f7ce72cd740 1 client.27871 shutdown 2024-08-20T05:11:30.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.040+0000 7f7ce72cd740 1 -- 172.21.15.37:0/1512082462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 msgr2=0x558d28a3d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:30.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.040+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/1512082462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 0x558d28a3d950 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0005e00 tx=0x7f7cd0005900 comp rx=0 tx=0).stop 2024-08-20T05:11:30.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.040+0000 7f7ce72cd740 1 -- 172.21.15.37:0/1512082462 shutdown_connections 2024-08-20T05:11:30.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.040+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/1512082462 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558d28ab4c20 0x558d28ab7040 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:30.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.040+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/1512082462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d28a286f0 0x558d28ab2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:30.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.040+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/1512082462 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d28a1c760 0x558d28a3de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:30.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.040+0000 7f7cbf400640 0 client.27871 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:30.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.040+0000 7f7ce72cd740 1 --2- 172.21.15.37:0/1512082462 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d28a1be40 0x558d28a3d950 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:30.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.040+0000 7f7ce72cd740 1 -- 172.21.15.37:0/1512082462 >> 172.21.15.37:0/1512082462 conn(0x558d28a19c70 msgr2=0x558d28a26d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:30.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.040+0000 7f7ce72cd740 1 -- 172.21.15.37:0/1512082462 shutdown_connections 2024-08-20T05:11:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.040+0000 7f7ce72cd740 1 -- 172.21.15.37:0/1512082462 wait complete. 2024-08-20T05:11:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.040+0000 7f7ce72cd740 20 client.27871 trim_cache size 0 max 16384 2024-08-20T05:11:30.043 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:11:30.043 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 41, 2024-08-20T05:11:30.043 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:11:30.043 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 38, 2024-08-20T05:11:30.043 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:11:30.043 INFO:teuthology.orchestra.run.smithi037.stdout: "d7ad4f9c": { 2024-08-20T05:11:30.044 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 38, 2024-08-20T05:11:30.044 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:11:30.044 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:11:30.044 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:11:30.044 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:11:30.044 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:11:30.044 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:11:30.044 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 147.8, 2024-08-20T05:11:30.044 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:11:30.044 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:11:30.044 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:11:30.044 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:11:30.044 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:11:30.044 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:11:30.044 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:11:30.044 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:11:30.045 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:11:30.045 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:11:30.045 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:11:30.045 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:11:30.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.041+0000 7f7ce4800640 1 -- 172.21.15.37:0/3045684741 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7cc40b3c50 msgr2=0x7f7cc40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:30.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.041+0000 7f7ce4800640 1 --2- 172.21.15.37:0/3045684741 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7cc40b3c50 0x7f7cc40b6110 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8011e30 tx=0x7f7cd8011f30 comp rx=0 tx=0).stop 2024-08-20T05:11:30.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.041+0000 7f7ce4800640 1 -- 172.21.15.37:0/3045684741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc10a6b0 msgr2=0x7f7cdc110790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:30.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.041+0000 7f7ce4800640 1 --2- 172.21.15.37:0/3045684741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc10a6b0 0x7f7cdc110790 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00e9f0 tx=0x7f7ccc00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:11:30.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.041+0000 7f7ce4800640 1 -- 172.21.15.37:0/3045684741 shutdown_connections 2024-08-20T05:11:30.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.041+0000 7f7ce4800640 1 --2- 172.21.15.37:0/3045684741 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7cc40b3c50 0x7f7cc40b6110 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:30.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.041+0000 7f7ce4800640 1 --2- 172.21.15.37:0/3045684741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cdc10b030 0x7f7cdc073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:30.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.041+0000 7f7ce4800640 1 --2- 172.21.15.37:0/3045684741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cdc10a6b0 0x7f7cdc110790 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:30.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.041+0000 7f7ce4800640 1 --2- 172.21.15.37:0/3045684741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cdc104ca0 0x7f7cdc110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:30.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.041+0000 7f7ce4800640 1 -- 172.21.15.37:0/3045684741 >> 172.21.15.37:0/3045684741 conn(0x7f7cdc100730 msgr2=0x7f7cdc102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:30.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.041+0000 7f7ce4800640 1 -- 172.21.15.37:0/3045684741 shutdown_connections 2024-08-20T05:11:30.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:30.042+0000 7f7ce4800640 1 -- 172.21.15.37:0/3045684741 wait complete. 2024-08-20T05:11:30.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:30 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:11:30.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:30 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:11:30.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:30 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:11:31.098 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd7ad4f9c', quiesce took 6.5 seconds. Will release after: 21.35 2024-08-20T05:11:31.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:31 smithi130 ceph-mon[22007]: pgmap v679: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 2.2 MiB/s wr, 286 op/s 2024-08-20T05:11:31.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:31 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:11:31.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:31 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:11:31.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:31 smithi037 ceph-mon[17265]: pgmap v679: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 2.2 MiB/s wr, 286 op/s 2024-08-20T05:11:31.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:31 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:11:31.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:31 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:11:31.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:31 smithi135 ceph-mon[22342]: pgmap v679: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 2.2 MiB/s wr, 286 op/s 2024-08-20T05:11:31.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:31 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:11:31.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:31 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:11:32.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:32 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:11:32.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:32 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:11:32.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:32 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:11:32.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:32 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:11:32.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:32 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:11:32.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:32 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:11:32.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:32 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:11:32.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:32 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:11:32.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:32 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:11:33.044 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 515.0 s, 229.9 tps, lat 156.039 ms stddev 212.813 2024-08-20T05:11:33.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:33 smithi130 ceph-mon[22007]: pgmap v680: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.8 MiB/s wr, 300 op/s 2024-08-20T05:11:33.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:33 smithi037 ceph-mon[17265]: pgmap v680: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.8 MiB/s wr, 300 op/s 2024-08-20T05:11:33.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:33 smithi135 ceph-mon[22342]: pgmap v680: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.8 MiB/s wr, 300 op/s 2024-08-20T05:11:35.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:35 smithi130 ceph-mon[22007]: pgmap v681: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.1 MiB/s wr, 303 op/s 2024-08-20T05:11:35.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:35 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:11:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:35 smithi037 ceph-mon[17265]: pgmap v681: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.1 MiB/s wr, 303 op/s 2024-08-20T05:11:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:35 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:11:35.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:35 smithi135 ceph-mon[22342]: pgmap v681: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.1 MiB/s wr, 303 op/s 2024-08-20T05:11:35.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:35 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:11:37.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:37 smithi130 ceph-mon[22007]: pgmap v682: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.1 MiB/s wr, 301 op/s 2024-08-20T05:11:37.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:37 smithi037 ceph-mon[17265]: pgmap v682: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.1 MiB/s wr, 301 op/s 2024-08-20T05:11:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:37 smithi135 ceph-mon[22342]: pgmap v682: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.1 MiB/s wr, 301 op/s 2024-08-20T05:11:38.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:11:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.277+0000 7feae7200640 1 -- 172.21.15.37:0/3841696059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feae8102490 msgr2=0x7feae8102890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.277+0000 7feae7200640 1 --2- 172.21.15.37:0/3841696059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feae8102490 0x7feae8102890 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fead8009930 tx=0x7fead802a440 comp rx=0 tx=0).stop 2024-08-20T05:11:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.278+0000 7feae7200640 1 -- 172.21.15.37:0/3841696059 shutdown_connections 2024-08-20T05:11:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.278+0000 7feae7200640 1 --2- 172.21.15.37:0/3841696059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feae8103fa0 0x7feae810a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.278+0000 7feae7200640 1 --2- 172.21.15.37:0/3841696059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae81035e0 0x7feae8103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.278+0000 7feae7200640 1 --2- 172.21.15.37:0/3841696059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feae8102490 0x7feae8102890 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.278+0000 7feae7200640 1 -- 172.21.15.37:0/3841696059 >> 172.21.15.37:0/3841696059 conn(0x7feae80fdd30 msgr2=0x7feae8100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.278+0000 7feae7200640 1 -- 172.21.15.37:0/3841696059 shutdown_connections 2024-08-20T05:11:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.278+0000 7feae7200640 1 -- 172.21.15.37:0/3841696059 wait complete. 2024-08-20T05:11:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.279+0000 7feae7200640 1 Processor -- start 2024-08-20T05:11:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.279+0000 7feae7200640 1 -- start start 2024-08-20T05:11:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.279+0000 7feae7200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feae8102490 0x7feae819aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.279+0000 7feae7200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feae81035e0 0x7feae819b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.279+0000 7feae7200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae8103fa0 0x7feae819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.279+0000 7feae7200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feae810e150 con 0x7feae8102490 2024-08-20T05:11:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.279+0000 7feae7200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feae810dfd0 con 0x7feae8103fa0 2024-08-20T05:11:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.279+0000 7feae7200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feae810e2d0 con 0x7feae81035e0 2024-08-20T05:11:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.279+0000 7feae5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feae8102490 0x7feae819aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.279+0000 7feae5e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feae8102490 0x7feae819aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50730/0 (socket says 172.21.15.37:50730) 2024-08-20T05:11:38.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.279+0000 7feae5e00640 1 -- 172.21.15.37:0/2414686098 learned_addr learned my addr 172.21.15.37:0/2414686098 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.279+0000 7feae5400640 1 --2- 172.21.15.37:0/2414686098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feae81035e0 0x7feae819b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.280+0000 7feae6800640 1 --2- 172.21.15.37:0/2414686098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae8103fa0 0x7feae819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.280+0000 7feae5e00640 1 -- 172.21.15.37:0/2414686098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feae81035e0 msgr2=0x7feae819b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.280+0000 7feae5e00640 1 --2- 172.21.15.37:0/2414686098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feae81035e0 0x7feae819b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.280+0000 7feae5e00640 1 -- 172.21.15.37:0/2414686098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae8103fa0 msgr2=0x7feae819bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.280+0000 7feae5e00640 1 --2- 172.21.15.37:0/2414686098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae8103fa0 0x7feae819bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.280+0000 7feae5e00640 1 -- 172.21.15.37:0/2414686098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae819c620 con 0x7feae8102490 2024-08-20T05:11:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.280+0000 7feae5e00640 1 --2- 172.21.15.37:0/2414686098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feae8102490 0x7feae819aae0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fead8031500 tx=0x7fead8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.280+0000 7feadea00640 1 -- 172.21.15.37:0/2414686098 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead803f070 con 0x7feae8102490 2024-08-20T05:11:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.280+0000 7feadea00640 1 -- 172.21.15.37:0/2414686098 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fead8031c50 con 0x7feae8102490 2024-08-20T05:11:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.280+0000 7feadea00640 1 -- 172.21.15.37:0/2414686098 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead8035030 con 0x7feae8102490 2024-08-20T05:11:38.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.281+0000 7feae7200640 1 -- 172.21.15.37:0/2414686098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae819c8b0 con 0x7feae8102490 2024-08-20T05:11:38.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.281+0000 7feae7200640 1 -- 172.21.15.37:0/2414686098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae81a2fe0 con 0x7feae8102490 2024-08-20T05:11:38.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.284+0000 7feaefa4c740 1 Processor -- start 2024-08-20T05:11:38.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.285+0000 7feaefa4c740 1 -- start start 2024-08-20T05:11:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.285+0000 7feaefa4c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c6135d4b0 0x563c6135f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.285+0000 7feaefa4c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c6135fde0 0x563c613621d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.285+0000 7feaefa4c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c61362820 0x563c61364ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.285+0000 7feaefa4c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563c612d0210 con 0x563c61362820 2024-08-20T05:11:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.285+0000 7feaefa4c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563c612bf710 con 0x563c6135d4b0 2024-08-20T05:11:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.285+0000 7feaefa4c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563c612c3750 con 0x563c6135fde0 2024-08-20T05:11:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.285+0000 7feae5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c61362820 0x563c61364ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:38.288 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.286+0000 7feadea00640 1 -- 172.21.15.37:0/2414686098 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fead8042070 con 0x7feae8102490 2024-08-20T05:11:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.286+0000 7feae6800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c6135d4b0 0x563c6135f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.286+0000 7feae5400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c61362820 0x563c61364ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50738/0 (socket says 172.21.15.37:50738) 2024-08-20T05:11:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.286+0000 7feae5400640 1 -- 172.21.15.37:0/2327512255 learned_addr learned my addr 172.21.15.37:0/2327512255 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.286+0000 7feae6800640 1 -- 172.21.15.37:0/2327512255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c6135fde0 msgr2=0x563c613621d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:38.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.286+0000 7feae6800640 1 --2- 172.21.15.37:0/2327512255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c6135fde0 0x563c613621d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.286+0000 7feae6800640 1 -- 172.21.15.37:0/2327512255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c61362820 msgr2=0x563c61364ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.286+0000 7feae6800640 1 --2- 172.21.15.37:0/2327512255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c61362820 0x563c61364ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.286+0000 7feae6800640 1 -- 172.21.15.37:0/2327512255 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c6128bde0 con 0x563c6135d4b0 2024-08-20T05:11:38.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.286+0000 7feae6800640 1 --2- 172.21.15.37:0/2327512255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c6135d4b0 0x563c6135f8a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7feae0005fd0 tx=0x7feae0011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=257935575b5599e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.287+0000 7fead3000640 1 -- 172.21.15.37:0/2327512255 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0004d20 con 0x563c6135d4b0 2024-08-20T05:11:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.287+0000 7fead3000640 1 -- 172.21.15.37:0/2327512255 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feae0004030 con 0x563c6135d4b0 2024-08-20T05:11:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.287+0000 7fead3000640 1 -- 172.21.15.37:0/2327512255 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0005280 con 0x563c6135d4b0 2024-08-20T05:11:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.287+0000 7feadea00640 1 --2- 172.21.15.37:0/2414686098 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feacc0b3c50 0x7feacc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.288+0000 7feaefa4c740 1 -- 172.21.15.37:0/2327512255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c6135d4b0 msgr2=0x563c6135f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.288+0000 7feaefa4c740 1 --2- 172.21.15.37:0/2327512255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c6135d4b0 0x563c6135f8a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7feae0005fd0 tx=0x7feae0011810 comp rx=0 tx=0).stop 2024-08-20T05:11:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.288+0000 7feadea00640 1 -- 172.21.15.37:0/2414686098 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fead8104680 con 0x7feae8102490 2024-08-20T05:11:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.288+0000 7feaefa4c740 1 -- 172.21.15.37:0/2327512255 shutdown_connections 2024-08-20T05:11:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.288+0000 7feaefa4c740 1 --2- 172.21.15.37:0/2327512255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c61362820 0x563c61364ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.288+0000 7feaefa4c740 1 --2- 172.21.15.37:0/2327512255 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c6135fde0 0x563c613621d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.288+0000 7feaefa4c740 1 --2- 172.21.15.37:0/2327512255 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c6135d4b0 0x563c6135f8a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.288+0000 7feaefa4c740 1 -- 172.21.15.37:0/2327512255 >> 172.21.15.37:0/2327512255 conn(0x563c61358600 msgr2=0x563c61359390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.288+0000 7feae5e00640 1 --2- 172.21.15.37:0/2414686098 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feacc0b3c50 0x7feacc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.288+0000 7feaefa4c740 1 -- 172.21.15.37:0/2327512255 shutdown_connections 2024-08-20T05:11:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.288+0000 7feaefa4c740 1 -- 172.21.15.37:0/2327512255 wait complete. 2024-08-20T05:11:38.296 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.288+0000 7feaefa4c740 1 -- start start 2024-08-20T05:11:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.288+0000 7feae5e00640 1 --2- 172.21.15.37:0/2414686098 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feacc0b3c50 0x7feacc0b6110 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fead80cb210 tx=0x7fead804a450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.289+0000 7feaefa4c740 1 Processor -- start 2024-08-20T05:11:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.289+0000 7feaefa4c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c6135d4b0 0x563c61366ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.289+0000 7feaefa4c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c6135fde0 0x563c61367540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.289+0000 7feaefa4c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c61362820 0x563c61368110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.289+0000 7feaefa4c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563c611f8ab0 con 0x563c6135d4b0 2024-08-20T05:11:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.289+0000 7feaefa4c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x563c61266140 con 0x563c6135fde0 2024-08-20T05:11:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.289+0000 7feaefa4c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x563c61365800 con 0x563c61362820 2024-08-20T05:11:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.289+0000 7feaefa4c740 10 client.0 _ll_register_callbacks cb 0x563c612795d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.289+0000 7feae6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c6135d4b0 0x563c61366ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.289+0000 7feae6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c6135d4b0 0x563c61366ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50746/0 (socket says 172.21.15.37:50746) 2024-08-20T05:11:38.297 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.289+0000 7feae6800640 1 -- 172.21.15.37:0/2746371177 learned_addr learned my addr 172.21.15.37:0/2746371177 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.289+0000 7feae5400640 1 --2- 172.21.15.37:0/2746371177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c6135fde0 0x563c61367540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.290+0000 7feae6800640 1 -- 172.21.15.37:0/2746371177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c61362820 msgr2=0x563c61368110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.290+0000 7feae6800640 1 --2- 172.21.15.37:0/2746371177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c61362820 0x563c61368110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.290+0000 7feae6800640 1 -- 172.21.15.37:0/2746371177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c6135fde0 msgr2=0x563c61367540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.290+0000 7feae6800640 1 --2- 172.21.15.37:0/2746371177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c6135fde0 0x563c61367540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.290+0000 7feae6800640 1 -- 172.21.15.37:0/2746371177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c61267170 con 0x563c6135d4b0 2024-08-20T05:11:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.290+0000 7feae6800640 1 --2- 172.21.15.37:0/2746371177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c6135d4b0 0x563c61366ea0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7feae0009270 tx=0x7feae0005280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66632223d321ba07 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.290+0000 7feac7400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:11:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.290+0000 7feac7400640 1 -- 172.21.15.37:0/2746371177 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0027020 con 0x563c6135d4b0 2024-08-20T05:11:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.290+0000 7feaefa4c740 1 -- 172.21.15.37:0/2746371177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563c61296a30 con 0x563c6135d4b0 2024-08-20T05:11:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.290+0000 7feac7400640 1 -- 172.21.15.37:0/2746371177 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7feae0005680 con 0x563c6135d4b0 2024-08-20T05:11:38.298 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.291+0000 7feac7400640 1 -- 172.21.15.37:0/2746371177 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7feae0032050 con 0x563c6135d4b0 2024-08-20T05:11:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.291+0000 7feaefa4c740 10 client.17397 fetch_fsmap learned FSMap version 42 2024-08-20T05:11:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.291+0000 7feaefa4c740 1 -- 172.21.15.37:0/2746371177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563c61022790 con 0x563c6135d4b0 2024-08-20T05:11:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.291+0000 7feac7400640 1 -- 172.21.15.37:0/2746371177 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x563c61296a30 con 0x563c6135d4b0 2024-08-20T05:11:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.291+0000 7feac7400640 1 -- 172.21.15.37:0/2746371177 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7feae0018070 con 0x563c6135d4b0 2024-08-20T05:11:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.291+0000 7feaefa4c740 10 client.17397 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T05:11:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.291+0000 7feaefa4c740 10 client.17397 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.291+0000 7feaefa4c740 20 client.17397 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.291+0000 7feaefa4c740 1 --2- 172.21.15.37:0/2746371177 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563c61372900 0x563c61374d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.291+0000 7feaefa4c740 4 client.17397 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:38.299 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.291+0000 7feaefa4c740 1 -- 172.21.15.37:0/2746371177 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c612d2160 con 0x563c61372900 2024-08-20T05:11:38.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.292+0000 7feae5400640 1 --2- 172.21.15.37:0/2746371177 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563c61372900 0x563c61374d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:38.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.292+0000 7feae5400640 1 --2- 172.21.15.37:0/2746371177 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563c61372900 0x563c61374d60 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fa8d83a0d75d922 server_cookie=34ccf1fca312e1f2 in_seq=0 out_seq=0 2024-08-20T05:11:38.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.292+0000 7feac7400640 10 client.17397 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:38.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.293+0000 7feac7400640 1 -- 172.21.15.37:0/2746371177 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c612d2160 con 0x563c61372900 2024-08-20T05:11:38.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.293+0000 7feac7400640 10 client.17397 handle_command_reply: tid=0 2024-08-20T05:11:38.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.293+0000 7feaefa4c740 1 client.17397 shutdown 2024-08-20T05:11:38.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.293+0000 7feaefa4c740 1 -- 172.21.15.37:0/2746371177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c6135d4b0 msgr2=0x563c61366ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:38.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.293+0000 7feaefa4c740 1 --2- 172.21.15.37:0/2746371177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c6135d4b0 0x563c61366ea0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7feae0009270 tx=0x7feae0005280 comp rx=0 tx=0).stop 2024-08-20T05:11:38.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.293+0000 7feaefa4c740 1 -- 172.21.15.37:0/2746371177 shutdown_connections 2024-08-20T05:11:38.300 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.293+0000 7feaefa4c740 1 --2- 172.21.15.37:0/2746371177 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563c61372900 0x563c61374d60 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.293+0000 7feaefa4c740 1 --2- 172.21.15.37:0/2746371177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c61362820 0x563c61368110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.293+0000 7feaefa4c740 1 --2- 172.21.15.37:0/2746371177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c6135fde0 0x563c61367540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.293+0000 7feaefa4c740 1 --2- 172.21.15.37:0/2746371177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c6135d4b0 0x563c61366ea0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.293+0000 7feac7400640 0 client.17397 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.293+0000 7feaefa4c740 1 -- 172.21.15.37:0/2746371177 >> 172.21.15.37:0/2746371177 conn(0x563c61358600 msgr2=0x563c61357590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.293+0000 7feaefa4c740 1 -- 172.21.15.37:0/2746371177 shutdown_connections 2024-08-20T05:11:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.293+0000 7feaefa4c740 1 -- 172.21.15.37:0/2746371177 wait complete. 2024-08-20T05:11:38.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.293+0000 7feaefa4c740 20 client.17397 trim_cache size 0 max 16384 2024-08-20T05:11:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.309+0000 7feaefa4c740 1 Processor -- start 2024-08-20T05:11:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.310+0000 7feaefa4c740 1 -- start start 2024-08-20T05:11:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.310+0000 7feaefa4c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c6135d4b0 0x563c613590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.310+0000 7feaefa4c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c6135fde0 0x563c613595e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.310+0000 7feaefa4c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c61362820 0x563c61362c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.310+0000 7feaefa4c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feae81ad320 con 0x563c6135d4b0 2024-08-20T05:11:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.310+0000 7feaefa4c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feae81aef20 con 0x563c61362820 2024-08-20T05:11:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.310+0000 7feaefa4c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feae81ad9f0 con 0x563c6135fde0 2024-08-20T05:11:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.310+0000 7feae6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c6135d4b0 0x563c613590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.310+0000 7feae6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c6135d4b0 0x563c613590a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50756/0 (socket says 172.21.15.37:50756) 2024-08-20T05:11:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.310+0000 7feae6800640 1 -- 172.21.15.37:0/3612269782 learned_addr learned my addr 172.21.15.37:0/3612269782 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.310+0000 7feae5400640 1 --2- 172.21.15.37:0/3612269782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c6135fde0 0x563c613595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.310+0000 7feae6800640 1 --2- 172.21.15.37:0/3612269782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c61362820 0x563c61362c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.310+0000 7feae6800640 1 -- 172.21.15.37:0/3612269782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c6135fde0 msgr2=0x563c613595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.310+0000 7feae6800640 1 --2- 172.21.15.37:0/3612269782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c6135fde0 0x563c613595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.310+0000 7feae6800640 1 -- 172.21.15.37:0/3612269782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c61362820 msgr2=0x563c61362c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.310+0000 7feae6800640 1 --2- 172.21.15.37:0/3612269782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c61362820 0x563c61362c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.310+0000 7feae6800640 1 -- 172.21.15.37:0/3612269782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c6109b620 con 0x563c6135d4b0 2024-08-20T05:11:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.311+0000 7feae6800640 1 --2- 172.21.15.37:0/3612269782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c6135d4b0 0x563c613590a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7feae0009560 tx=0x7feae0005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c265399bfdc0d2fc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.311+0000 7fead2600640 1 -- 172.21.15.37:0/3612269782 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae0027040 con 0x563c6135d4b0 2024-08-20T05:11:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.311+0000 7fead2600640 1 -- 172.21.15.37:0/3612269782 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feae00048e0 con 0x563c6135d4b0 2024-08-20T05:11:38.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.311+0000 7fead2600640 1 -- 172.21.15.37:0/3612269782 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feae000fd30 con 0x563c6135d4b0 2024-08-20T05:11:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.311+0000 7feaefa4c740 1 -- 172.21.15.37:0/3612269782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c6135d4b0 msgr2=0x563c613590a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.311+0000 7feaefa4c740 1 --2- 172.21.15.37:0/3612269782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c6135d4b0 0x563c613590a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7feae0009560 tx=0x7feae0005bd0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.312+0000 7feaefa4c740 1 -- 172.21.15.37:0/3612269782 shutdown_connections 2024-08-20T05:11:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.312+0000 7feaefa4c740 1 --2- 172.21.15.37:0/3612269782 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c61362820 0x563c61362c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.312+0000 7feaefa4c740 1 --2- 172.21.15.37:0/3612269782 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c6135fde0 0x563c613595e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.312+0000 7feaefa4c740 1 --2- 172.21.15.37:0/3612269782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c6135d4b0 0x563c613590a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.312+0000 7feaefa4c740 1 -- 172.21.15.37:0/3612269782 >> 172.21.15.37:0/3612269782 conn(0x563c61358600 msgr2=0x563c613644b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.312+0000 7feaefa4c740 1 -- 172.21.15.37:0/3612269782 shutdown_connections 2024-08-20T05:11:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.312+0000 7feaefa4c740 1 -- 172.21.15.37:0/3612269782 wait complete. 2024-08-20T05:11:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.312+0000 7feaefa4c740 1 -- start start 2024-08-20T05:11:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.312+0000 7feaefa4c740 1 Processor -- start 2024-08-20T05:11:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feaefa4c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c6135d4b0 0x563c6136be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feaefa4c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c6135fde0 0x563c6136c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feaefa4c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c61362820 0x563c6136d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feaefa4c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feae81ae7f0 con 0x563c61362820 2024-08-20T05:11:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feaefa4c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feae81ae0c0 con 0x563c6135fde0 2024-08-20T05:11:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feaefa4c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feae81ab300 con 0x563c6135d4b0 2024-08-20T05:11:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feaefa4c740 10 client.0 _ll_register_callbacks cb 0x7fead4009570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feae6800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c6135d4b0 0x563c6136be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feae6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c61362820 0x563c6136d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feae5400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c6135fde0 0x563c6136c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feae6800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c61362820 0x563c6136d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50768/0 (socket says 172.21.15.37:50768) 2024-08-20T05:11:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feae6800640 1 -- 172.21.15.37:0/3041327698 learned_addr learned my addr 172.21.15.37:0/3041327698 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feae5400640 1 -- 172.21.15.37:0/3041327698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c6135d4b0 msgr2=0x563c6136be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feae5400640 1 --2- 172.21.15.37:0/3041327698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c6135d4b0 0x563c6136be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feae5400640 1 -- 172.21.15.37:0/3041327698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c61362820 msgr2=0x563c6136d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feae5400640 1 --2- 172.21.15.37:0/3041327698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c61362820 0x563c6136d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feae5400640 1 -- 172.21.15.37:0/3041327698 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c6136d8b0 con 0x563c6135fde0 2024-08-20T05:11:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.313+0000 7feae6800640 1 --2- 172.21.15.37:0/3041327698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c61362820 0x563c6136d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.314+0000 7feae5400640 1 --2- 172.21.15.37:0/3041327698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c6135fde0 0x563c6136c4b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x563c61372ce0 tx=0x7fead4004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e4c6276587987ac server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.314+0000 7feac7400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:11:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.314+0000 7feac7400640 1 -- 172.21.15.37:0/3041327698 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fead4005020 con 0x563c6135fde0 2024-08-20T05:11:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.314+0000 7feaefa4c740 1 -- 172.21.15.37:0/3041327698 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feae00048e0 con 0x563c6135fde0 2024-08-20T05:11:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.314+0000 7feac7400640 1 -- 172.21.15.37:0/3041327698 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fead40051c0 con 0x563c6135fde0 2024-08-20T05:11:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.315+0000 7feac7400640 1 -- 172.21.15.37:0/3041327698 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fead402e050 con 0x563c6135fde0 2024-08-20T05:11:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.315+0000 7feaefa4c740 10 client.27893 fetch_fsmap learned FSMap version 42 2024-08-20T05:11:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.315+0000 7feaefa4c740 1 -- 172.21.15.37:0/3041327698 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x563c6136ed40 con 0x563c6135fde0 2024-08-20T05:11:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.315+0000 7feac7400640 1 -- 172.21.15.37:0/3041327698 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feae00048e0 con 0x563c6135fde0 2024-08-20T05:11:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.315+0000 7feac7400640 1 -- 172.21.15.37:0/3041327698 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 42) ==== 8394+0+0 (secure 0 0 0) 0x7fead4020410 con 0x563c6135fde0 2024-08-20T05:11:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.315+0000 7feaefa4c740 10 client.27893 fetch_fsmap finished waiting for FSMap version 42 2024-08-20T05:11:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.315+0000 7feaefa4c740 10 client.27893 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.315+0000 7feaefa4c740 20 client.27893 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.315+0000 7feaefa4c740 1 --2- 172.21.15.37:0/3041327698 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563c613dd7a0 0x563c613dfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.315+0000 7feaefa4c740 4 client.27893 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:11:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.315+0000 7feaefa4c740 1 -- 172.21.15.37:0/3041327698 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563c612cdc00 con 0x563c613dd7a0 2024-08-20T05:11:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.315+0000 7feae6800640 1 --2- 172.21.15.37:0/3041327698 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563c613dd7a0 0x563c613dfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.316+0000 7feae6800640 1 --2- 172.21.15.37:0/3041327698 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563c613dd7a0 0x563c613dfb90 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43f2facbfa942f44 server_cookie=286b6bada7279569 in_seq=0 out_seq=0 2024-08-20T05:11:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.316+0000 7feac7400640 10 client.27893 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.324+0000 7feac7400640 1 -- 172.21.15.37:0/3041327698 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563c612cdc00 con 0x563c613dd7a0 2024-08-20T05:11:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.324+0000 7feac7400640 10 client.27893 handle_command_reply: tid=0 2024-08-20T05:11:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.324+0000 7feaefa4c740 1 client.27893 shutdown 2024-08-20T05:11:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.325+0000 7feaefa4c740 1 -- 172.21.15.37:0/3041327698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c6135fde0 msgr2=0x563c6136c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.325+0000 7feaefa4c740 1 --2- 172.21.15.37:0/3041327698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c6135fde0 0x563c6136c4b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x563c61372ce0 tx=0x7fead4004260 comp rx=0 tx=0).stop 2024-08-20T05:11:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.325+0000 7feaefa4c740 1 -- 172.21.15.37:0/3041327698 shutdown_connections 2024-08-20T05:11:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.325+0000 7feaefa4c740 1 --2- 172.21.15.37:0/3041327698 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x563c613dd7a0 0x563c613dfb90 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.325+0000 7feaefa4c740 1 --2- 172.21.15.37:0/3041327698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563c61362820 0x563c6136d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.325+0000 7feaefa4c740 1 --2- 172.21.15.37:0/3041327698 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x563c6135fde0 0x563c6136c4b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.325+0000 7feaefa4c740 1 --2- 172.21.15.37:0/3041327698 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x563c6135d4b0 0x563c6136be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.325+0000 7feaefa4c740 1 -- 172.21.15.37:0/3041327698 >> 172.21.15.37:0/3041327698 conn(0x563c61358600 msgr2=0x563c613644b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.325+0000 7feac7400640 0 client.27893 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.325+0000 7feaefa4c740 1 -- 172.21.15.37:0/3041327698 shutdown_connections 2024-08-20T05:11:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.325+0000 7feaefa4c740 1 -- 172.21.15.37:0/3041327698 wait complete. 2024-08-20T05:11:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.325+0000 7feaefa4c740 20 client.27893 trim_cache size 0 max 16384 2024-08-20T05:11:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:11:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:11:38.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:11:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:11:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.326+0000 7feae7200640 1 -- 172.21.15.37:0/2414686098 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feacc0b3c50 msgr2=0x7feacc0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.326+0000 7feae7200640 1 --2- 172.21.15.37:0/2414686098 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feacc0b3c50 0x7feacc0b6110 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fead80cb210 tx=0x7fead804a450 comp rx=0 tx=0).stop 2024-08-20T05:11:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.326+0000 7feae7200640 1 -- 172.21.15.37:0/2414686098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feae8102490 msgr2=0x7feae819aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.326+0000 7feae7200640 1 --2- 172.21.15.37:0/2414686098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feae8102490 0x7feae819aae0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fead8031500 tx=0x7fead8003c10 comp rx=0 tx=0).stop 2024-08-20T05:11:38.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.326+0000 7feae7200640 1 -- 172.21.15.37:0/2414686098 shutdown_connections 2024-08-20T05:11:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.326+0000 7feae7200640 1 --2- 172.21.15.37:0/2414686098 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feacc0b3c50 0x7feacc0b6110 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.326+0000 7feae7200640 1 --2- 172.21.15.37:0/2414686098 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feae8103fa0 0x7feae819bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.326+0000 7feae7200640 1 --2- 172.21.15.37:0/2414686098 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feae81035e0 0x7feae819b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.326+0000 7feae7200640 1 --2- 172.21.15.37:0/2414686098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feae8102490 0x7feae819aae0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.326+0000 7feae7200640 1 -- 172.21.15.37:0/2414686098 >> 172.21.15.37:0/2414686098 conn(0x7feae80fdd30 msgr2=0x7feae80750b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.326+0000 7feae7200640 1 -- 172.21.15.37:0/2414686098 shutdown_connections 2024-08-20T05:11:38.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:38.326+0000 7feae7200640 1 -- 172.21.15.37:0/2414686098 wait complete. 2024-08-20T05:11:39.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:39 smithi130 ceph-mon[22007]: pgmap v683: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.8 MiB/s wr, 265 op/s 2024-08-20T05:11:39.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:39 smithi037 ceph-mon[17265]: pgmap v683: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.8 MiB/s wr, 265 op/s 2024-08-20T05:11:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:39 smithi135 ceph-mon[22342]: pgmap v683: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.8 MiB/s wr, 265 op/s 2024-08-20T05:11:41.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:41 smithi130 ceph-mon[22007]: pgmap v684: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.1 MiB/s wr, 218 op/s 2024-08-20T05:11:41.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:41 smithi037 ceph-mon[17265]: pgmap v684: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.1 MiB/s wr, 218 op/s 2024-08-20T05:11:41.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:41 smithi135 ceph-mon[22342]: pgmap v684: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.1 MiB/s wr, 218 op/s 2024-08-20T05:11:42.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:42 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:11:42.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:42 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:11:42.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:42 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:11:43.043 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 525.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:11:43.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:43 smithi037 ceph-mon[17265]: pgmap v685: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 916 KiB/s wr, 99 op/s 2024-08-20T05:11:43.767 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:43 smithi135 ceph-mon[22342]: pgmap v685: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 916 KiB/s wr, 99 op/s 2024-08-20T05:11:43.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:43 smithi130 ceph-mon[22007]: pgmap v685: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 916 KiB/s wr, 99 op/s 2024-08-20T05:11:45.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:45 smithi037 ceph-mon[17265]: pgmap v686: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 300 KiB/s wr, 40 op/s 2024-08-20T05:11:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:45 smithi135 ceph-mon[22342]: pgmap v686: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 300 KiB/s wr, 40 op/s 2024-08-20T05:11:45.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:45 smithi130 ceph-mon[22007]: pgmap v686: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 300 KiB/s wr, 40 op/s 2024-08-20T05:11:47.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:47 smithi037 ceph-mon[17265]: pgmap v687: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 138 KiB/s wr, 29 op/s 2024-08-20T05:11:47.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:47 smithi135 ceph-mon[22342]: pgmap v687: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 138 KiB/s wr, 29 op/s 2024-08-20T05:11:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:47 smithi130 ceph-mon[22007]: pgmap v687: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 138 KiB/s wr, 29 op/s 2024-08-20T05:11:48.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 530.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:11:49.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:11:49.758 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:49 smithi130 ceph-mon[22007]: pgmap v688: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 235 KiB/s wr, 37 op/s 2024-08-20T05:11:49.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:49 smithi037 ceph-mon[17265]: pgmap v688: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 235 KiB/s wr, 37 op/s 2024-08-20T05:11:49.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:49 smithi135 ceph-mon[22342]: pgmap v688: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 235 KiB/s wr, 37 op/s 2024-08-20T05:11:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:50.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.484+0000 7f1795400640 1 -- 172.21.15.37:0/2939645609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f179010a520 msgr2=0x7f179010a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:50.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.484+0000 7f1795400640 1 --2- 172.21.15.37:0/2939645609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f179010a520 0x7f179010a960 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f177c009900 tx=0x7f177c02a410 comp rx=0 tx=0).stop 2024-08-20T05:11:50.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.484+0000 7f1795400640 1 -- 172.21.15.37:0/2939645609 shutdown_connections 2024-08-20T05:11:50.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.484+0000 7f1795400640 1 --2- 172.21.15.37:0/2939645609 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f179010aea0 0x7f17901116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.484+0000 7f1795400640 1 --2- 172.21.15.37:0/2939645609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f179010a520 0x7f179010a960 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.484+0000 7f1795400640 1 --2- 172.21.15.37:0/2939645609 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1790104b10 0x7f1790104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.484+0000 7f1795400640 1 -- 172.21.15.37:0/2939645609 >> 172.21.15.37:0/2939645609 conn(0x7f1790100540 msgr2=0x7f1790102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:50.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.484+0000 7f1795400640 1 -- 172.21.15.37:0/2939645609 shutdown_connections 2024-08-20T05:11:50.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.484+0000 7f1795400640 1 -- 172.21.15.37:0/2939645609 wait complete. 2024-08-20T05:11:50.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.485+0000 7f1795400640 1 Processor -- start 2024-08-20T05:11:50.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.485+0000 7f1795400640 1 -- start start 2024-08-20T05:11:50.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.486+0000 7f1795400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1790104b10 0x7f179019af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.486+0000 7f1795400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f179010a520 0x7f179019b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.486+0000 7f1795400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f179010aea0 0x7f17901a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.486+0000 7f1795400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1790114bb0 con 0x7f179010a520 2024-08-20T05:11:50.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.486+0000 7f1795400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1790114a30 con 0x7f1790104b10 2024-08-20T05:11:50.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.486+0000 7f1795400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1790114d30 con 0x7f179010aea0 2024-08-20T05:11:50.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.486+0000 7f178f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f179010a520 0x7f179019b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:50.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.486+0000 7f178fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1790104b10 0x7f179019af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:50.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.486+0000 7f178f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f179010a520 0x7f179019b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48528/0 (socket says 172.21.15.37:48528) 2024-08-20T05:11:50.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.486+0000 7f178f400640 1 -- 172.21.15.37:0/940543110 learned_addr learned my addr 172.21.15.37:0/940543110 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:50.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.486+0000 7f178fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1790104b10 0x7f179019af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:39562/0 (socket says 172.21.15.37:39562) 2024-08-20T05:11:50.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.486+0000 7f1794a00640 1 --2- 172.21.15.37:0/940543110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f179010aea0 0x7f17901a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:50.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.487+0000 7f178f400640 1 -- 172.21.15.37:0/940543110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f179010aea0 msgr2=0x7f17901a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:50.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.487+0000 7f178f400640 1 --2- 172.21.15.37:0/940543110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f179010aea0 0x7f17901a07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.487+0000 7f178f400640 1 -- 172.21.15.37:0/940543110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1790104b10 msgr2=0x7f179019af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:50.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.487+0000 7f178f400640 1 --2- 172.21.15.37:0/940543110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1790104b10 0x7f179019af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.487+0000 7f178f400640 1 -- 172.21.15.37:0/940543110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17901a0fb0 con 0x7f179010a520 2024-08-20T05:11:50.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.487+0000 7f178f400640 1 --2- 172.21.15.37:0/940543110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f179010a520 0x7f179019b440 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f177c005ab0 tx=0x7f177c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:50.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.487+0000 7f178cc00640 1 -- 172.21.15.37:0/940543110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c03f070 con 0x7f179010a520 2024-08-20T05:11:50.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.487+0000 7f1795400640 1 -- 172.21.15.37:0/940543110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17901a1240 con 0x7f179010a520 2024-08-20T05:11:50.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.487+0000 7f178cc00640 1 -- 172.21.15.37:0/940543110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f177c031d60 con 0x7f179010a520 2024-08-20T05:11:50.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.487+0000 7f178cc00640 1 -- 172.21.15.37:0/940543110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c035030 con 0x7f179010a520 2024-08-20T05:11:50.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.488+0000 7f1795400640 1 -- 172.21.15.37:0/940543110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17901a7960 con 0x7f179010a520 2024-08-20T05:11:50.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.492+0000 7f1799473740 1 Processor -- start 2024-08-20T05:11:50.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.492+0000 7f1799473740 1 -- start start 2024-08-20T05:11:50.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.492+0000 7f1799473740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fab1a80 0x55df6fab1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.492+0000 7f1799473740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab23a0 0x55df6fabddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.492+0000 7f1799473740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fabe330 0x55df6fac0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.492+0000 7f1799473740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55df6fa27a60 con 0x55df6fab1a80 2024-08-20T05:11:50.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.492+0000 7f1799473740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55df6fa16f60 con 0x55df6fab23a0 2024-08-20T05:11:50.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.492+0000 7f1799473740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55df6fa1afa0 con 0x55df6fabe330 2024-08-20T05:11:50.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.493+0000 7f1794a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fab1a80 0x55df6fab1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:50.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.493+0000 7f178fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab23a0 0x55df6fabddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:50.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.493+0000 7f1794a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fab1a80 0x55df6fab1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48534/0 (socket says 172.21.15.37:48534) 2024-08-20T05:11:50.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.493+0000 7f1794a00640 1 -- 172.21.15.37:0/1098141441 learned_addr learned my addr 172.21.15.37:0/1098141441 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:50.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.493+0000 7f178fe00640 1 -- 172.21.15.37:0/1098141441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fabe330 msgr2=0x55df6fac0720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:11:50.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.493+0000 7f178fe00640 1 --2- 172.21.15.37:0/1098141441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fabe330 0x55df6fac0720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.493+0000 7f178fe00640 1 -- 172.21.15.37:0/1098141441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fab1a80 msgr2=0x55df6fab1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:50.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.493+0000 7f178fe00640 1 --2- 172.21.15.37:0/1098141441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fab1a80 0x55df6fab1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.493+0000 7f178fe00640 1 -- 172.21.15.37:0/1098141441 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df6f9bd3e0 con 0x55df6fab23a0 2024-08-20T05:11:50.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.493+0000 7f178cc00640 1 -- 172.21.15.37:0/940543110 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f177c042070 con 0x7f179010a520 2024-08-20T05:11:50.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.493+0000 7f178fe00640 1 --2- 172.21.15.37:0/1098141441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab23a0 0x55df6fabddf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1780005fd0 tx=0x7f17800107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c80ade34e2dcb801 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:50.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.494+0000 7f1785200640 1 -- 172.21.15.37:0/1098141441 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178001c680 con 0x55df6fab23a0 2024-08-20T05:11:50.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.494+0000 7f1785200640 1 -- 172.21.15.37:0/1098141441 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f178000be20 con 0x55df6fab23a0 2024-08-20T05:11:50.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.494+0000 7f1785200640 1 -- 172.21.15.37:0/1098141441 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780011c00 con 0x55df6fab23a0 2024-08-20T05:11:50.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.494+0000 7f1799473740 1 -- 172.21.15.37:0/1098141441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab23a0 msgr2=0x55df6fabddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:50.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.494+0000 7f1799473740 1 --2- 172.21.15.37:0/1098141441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab23a0 0x55df6fabddf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1780005fd0 tx=0x7f17800107a0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.495+0000 7f1799473740 1 -- 172.21.15.37:0/1098141441 shutdown_connections 2024-08-20T05:11:50.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.495+0000 7f1799473740 1 --2- 172.21.15.37:0/1098141441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fabe330 0x55df6fac0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.495+0000 7f1799473740 1 --2- 172.21.15.37:0/1098141441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab23a0 0x55df6fabddf0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.495+0000 7f1799473740 1 --2- 172.21.15.37:0/1098141441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fab1a80 0x55df6fab1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.495+0000 7f1799473740 1 -- 172.21.15.37:0/1098141441 >> 172.21.15.37:0/1098141441 conn(0x55df6faaf8b0 msgr2=0x55df6fab0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:50.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.495+0000 7f1799473740 1 -- 172.21.15.37:0/1098141441 shutdown_connections 2024-08-20T05:11:50.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.495+0000 7f1799473740 1 -- 172.21.15.37:0/1098141441 wait complete. 2024-08-20T05:11:50.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.495+0000 7f1799473740 1 -- start start 2024-08-20T05:11:50.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.495+0000 7f178cc00640 1 --2- 172.21.15.37:0/940543110 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f17740b3c00 0x7f17740b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.495+0000 7f1799473740 1 Processor -- start 2024-08-20T05:11:50.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.496+0000 7f178cc00640 1 -- 172.21.15.37:0/940543110 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f177c1043e0 con 0x7f179010a520 2024-08-20T05:11:50.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.496+0000 7f1794a00640 1 --2- 172.21.15.37:0/940543110 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f17740b3c00 0x7f17740b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:50.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.496+0000 7f1799473740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab1a80 0x55df6fabdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.496+0000 7f1799473740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab23a0 0x55df6fabaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.496+0000 7f1799473740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fabe330 0x55df6fabb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.496+0000 7f1799473740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55df6f879700 con 0x55df6fabe330 2024-08-20T05:11:50.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.496+0000 7f1799473740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55df6f9b2250 con 0x55df6fab1a80 2024-08-20T05:11:50.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.496+0000 7f1799473740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55df6fac0fb0 con 0x55df6fab23a0 2024-08-20T05:11:50.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.496+0000 7f1799473740 10 client.0 _ll_register_callbacks cb 0x55df6fa11180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:50.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.497+0000 7f178fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab1a80 0x55df6fabdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:50.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.497+0000 7f1794a00640 1 --2- 172.21.15.37:0/940543110 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f17740b3c00 0x7f17740b60c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1788005f10 tx=0x7f1788009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:50.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.497+0000 7f1794a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fabe330 0x55df6fabb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:50.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.497+0000 7f178fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab1a80 0x55df6fabdaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:39574/0 (socket says 172.21.15.37:39574) 2024-08-20T05:11:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.497+0000 7f178f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab23a0 0x55df6fabaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.497+0000 7f178fe00640 1 -- 172.21.15.37:0/3836414789 learned_addr learned my addr 172.21.15.37:0/3836414789 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.497+0000 7f178fe00640 1 -- 172.21.15.37:0/3836414789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab23a0 msgr2=0x55df6fabaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.497+0000 7f178fe00640 1 --2- 172.21.15.37:0/3836414789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab23a0 0x55df6fabaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.497+0000 7f178fe00640 1 -- 172.21.15.37:0/3836414789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fabe330 msgr2=0x55df6fabb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.497+0000 7f178fe00640 1 --2- 172.21.15.37:0/3836414789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fabe330 0x55df6fabb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.497+0000 7f178fe00640 1 -- 172.21.15.37:0/3836414789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df6f776650 con 0x55df6fab1a80 2024-08-20T05:11:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.497+0000 7f178fe00640 1 --2- 172.21.15.37:0/3836414789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab1a80 0x55df6fabdaf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f17800117e0 tx=0x7f17800116e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a47c7e7f40d3653 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.497+0000 7f1779600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:11:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.498+0000 7f1779600640 1 -- 172.21.15.37:0/3836414789 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178002b060 con 0x55df6fab1a80 2024-08-20T05:11:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.498+0000 7f1799473740 1 -- 172.21.15.37:0/3836414789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f178000be20 con 0x55df6fab1a80 2024-08-20T05:11:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.498+0000 7f1779600640 1 -- 172.21.15.37:0/3836414789 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1780005040 con 0x55df6fab1a80 2024-08-20T05:11:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.498+0000 7f1779600640 1 -- 172.21.15.37:0/3836414789 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f1780032050 con 0x55df6fab1a80 2024-08-20T05:11:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.498+0000 7f1799473740 10 client.27905 fetch_fsmap learned FSMap version 43 2024-08-20T05:11:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.498+0000 7f1799473740 1 -- 172.21.15.37:0/3836414789 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55df6facc820 con 0x55df6fab1a80 2024-08-20T05:11:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.498+0000 7f1779600640 1 -- 172.21.15.37:0/3836414789 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f178000be20 con 0x55df6fab1a80 2024-08-20T05:11:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.499+0000 7f1779600640 1 -- 172.21.15.37:0/3836414789 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f1780025070 con 0x55df6fab1a80 2024-08-20T05:11:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.499+0000 7f1799473740 10 client.27905 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:11:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.499+0000 7f1799473740 10 client.27905 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.499+0000 7f1799473740 20 client.27905 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.499+0000 7f1799473740 1 --2- 172.21.15.37:0/3836414789 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55df6facdbd0 0x55df6facffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.499+0000 7f1799473740 4 client.27905 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.499+0000 7f1799473740 1 -- 172.21.15.37:0/3836414789 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df6fa299b0 con 0x55df6facdbd0 2024-08-20T05:11:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.499+0000 7f178f400640 1 --2- 172.21.15.37:0/3836414789 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55df6facdbd0 0x55df6facffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.500+0000 7f178f400640 1 --2- 172.21.15.37:0/3836414789 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55df6facdbd0 0x55df6facffc0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac14a2b24d3adb27 server_cookie=77af95d2f26e0b01 in_seq=0 out_seq=0 2024-08-20T05:11:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.500+0000 7f1779600640 10 client.27905 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:50.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.500+0000 7f1779600640 1 -- 172.21.15.37:0/3836414789 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55df6fa299b0 con 0x55df6facdbd0 2024-08-20T05:11:50.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.500+0000 7f1779600640 10 client.27905 handle_command_reply: tid=0 2024-08-20T05:11:50.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.501+0000 7f1799473740 1 client.27905 shutdown 2024-08-20T05:11:50.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.501+0000 7f1799473740 1 -- 172.21.15.37:0/3836414789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab1a80 msgr2=0x55df6fabdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:50.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.501+0000 7f1799473740 1 --2- 172.21.15.37:0/3836414789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab1a80 0x55df6fabdaf0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f17800117e0 tx=0x7f17800116e0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.501+0000 7f1799473740 1 -- 172.21.15.37:0/3836414789 shutdown_connections 2024-08-20T05:11:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.501+0000 7f1799473740 1 --2- 172.21.15.37:0/3836414789 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55df6facdbd0 0x55df6facffc0 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.501+0000 7f1799473740 1 --2- 172.21.15.37:0/3836414789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fabe330 0x55df6fabb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.501+0000 7f1779600640 0 client.27905 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.501+0000 7f1799473740 1 --2- 172.21.15.37:0/3836414789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab23a0 0x55df6fabaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.501+0000 7f1799473740 1 --2- 172.21.15.37:0/3836414789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab1a80 0x55df6fabdaf0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.501+0000 7f1799473740 1 -- 172.21.15.37:0/3836414789 >> 172.21.15.37:0/3836414789 conn(0x55df6faaf8b0 msgr2=0x55df6fab5420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.501+0000 7f1799473740 1 -- 172.21.15.37:0/3836414789 shutdown_connections 2024-08-20T05:11:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.501+0000 7f1799473740 1 -- 172.21.15.37:0/3836414789 wait complete. 2024-08-20T05:11:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.501+0000 7f1799473740 20 client.27905 trim_cache size 0 max 16384 2024-08-20T05:11:50.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.519+0000 7f1799473740 1 Processor -- start 2024-08-20T05:11:50.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.519+0000 7f1799473740 1 -- start start 2024-08-20T05:11:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.520+0000 7f1799473740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab1a80 0x55df6faca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.520+0000 7f1799473740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab23a0 0x55df6fad55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.520+0000 7f1799473740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fabe330 0x55df6fad5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.520+0000 7f1799473740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f17901b17e0 con 0x55df6fabe330 2024-08-20T05:11:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.520+0000 7f1799473740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f17901b33b0 con 0x55df6fab23a0 2024-08-20T05:11:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.520+0000 7f1799473740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f17901b1eb0 con 0x55df6fab1a80 2024-08-20T05:11:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.520+0000 7f1794a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fabe330 0x55df6fad5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.520+0000 7f178fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab1a80 0x55df6faca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.520+0000 7f1794a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fabe330 0x55df6fad5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48544/0 (socket says 172.21.15.37:48544) 2024-08-20T05:11:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.520+0000 7f1794a00640 1 -- 172.21.15.37:0/3515829336 learned_addr learned my addr 172.21.15.37:0/3515829336 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.520+0000 7f178f400640 1 --2- 172.21.15.37:0/3515829336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab23a0 0x55df6fad55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.520+0000 7f178f400640 1 -- 172.21.15.37:0/3515829336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab1a80 msgr2=0x55df6faca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.521+0000 7f178f400640 1 --2- 172.21.15.37:0/3515829336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab1a80 0x55df6faca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.521+0000 7f178f400640 1 -- 172.21.15.37:0/3515829336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fabe330 msgr2=0x55df6fad5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.521+0000 7f178f400640 1 --2- 172.21.15.37:0/3515829336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fabe330 0x55df6fad5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.521+0000 7f178f400640 1 -- 172.21.15.37:0/3515829336 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df6faa1060 con 0x55df6fab23a0 2024-08-20T05:11:50.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.521+0000 7f178fe00640 1 --2- 172.21.15.37:0/3515829336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab1a80 0x55df6faca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:50.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.521+0000 7f178f400640 1 --2- 172.21.15.37:0/3515829336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab23a0 0x55df6fad55e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f177c101eb0 tx=0x7f177c031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bd19e3c4e931e5d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.521+0000 7f177be00640 1 -- 172.21.15.37:0/3515829336 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c049040 con 0x55df6fab23a0 2024-08-20T05:11:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.521+0000 7f177be00640 1 -- 172.21.15.37:0/3515829336 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f177c0ad070 con 0x55df6fab23a0 2024-08-20T05:11:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.521+0000 7f177be00640 1 -- 172.21.15.37:0/3515829336 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c104080 con 0x55df6fab23a0 2024-08-20T05:11:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.522+0000 7f1799473740 1 -- 172.21.15.37:0/3515829336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab23a0 msgr2=0x55df6fad55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.522+0000 7f1799473740 1 --2- 172.21.15.37:0/3515829336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab23a0 0x55df6fad55e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f177c101eb0 tx=0x7f177c031400 comp rx=0 tx=0).stop 2024-08-20T05:11:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.522+0000 7f1799473740 1 -- 172.21.15.37:0/3515829336 shutdown_connections 2024-08-20T05:11:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.522+0000 7f1799473740 1 --2- 172.21.15.37:0/3515829336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fabe330 0x55df6fad5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.522+0000 7f1799473740 1 --2- 172.21.15.37:0/3515829336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fab23a0 0x55df6fad55e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.522+0000 7f1799473740 1 --2- 172.21.15.37:0/3515829336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab1a80 0x55df6faca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.522+0000 7f1799473740 1 -- 172.21.15.37:0/3515829336 >> 172.21.15.37:0/3515829336 conn(0x55df6faaf8b0 msgr2=0x55df6faaea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.522+0000 7f1799473740 1 -- 172.21.15.37:0/3515829336 shutdown_connections 2024-08-20T05:11:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.522+0000 7f1799473740 1 -- 172.21.15.37:0/3515829336 wait complete. 2024-08-20T05:11:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.522+0000 7f1799473740 1 -- start start 2024-08-20T05:11:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.523+0000 7f1799473740 1 Processor -- start 2024-08-20T05:11:50.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.523+0000 7f1799473740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fab1a80 0x55df6fac6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.523+0000 7f1799473740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab23a0 0x55df6fac1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.523+0000 7f1799473740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fabe330 0x55df6fac2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.523+0000 7f1799473740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f17901b2cb0 con 0x55df6fab1a80 2024-08-20T05:11:50.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.523+0000 7f1799473740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f17901b2580 con 0x55df6fabe330 2024-08-20T05:11:50.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.523+0000 7f1799473740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f17901af7c0 con 0x55df6fab23a0 2024-08-20T05:11:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.523+0000 7f1799473740 10 client.0 _ll_register_callbacks cb 0x7f1788009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.523+0000 7f178f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab23a0 0x55df6fac1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.524+0000 7f178f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab23a0 0x55df6fac1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57460/0 (socket says 172.21.15.37:57460) 2024-08-20T05:11:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.524+0000 7f178f400640 1 -- 172.21.15.37:0/356884207 learned_addr learned my addr 172.21.15.37:0/356884207 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.524+0000 7f178fe00640 1 --2- 172.21.15.37:0/356884207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fab1a80 0x55df6fac6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.524+0000 7f1794a00640 1 --2- 172.21.15.37:0/356884207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fabe330 0x55df6fac2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.524+0000 7f178f400640 1 -- 172.21.15.37:0/356884207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fabe330 msgr2=0x55df6fac2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.524+0000 7f178f400640 1 --2- 172.21.15.37:0/356884207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fabe330 0x55df6fac2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.524+0000 7f178f400640 1 -- 172.21.15.37:0/356884207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fab1a80 msgr2=0x55df6fac6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.524+0000 7f178f400640 1 --2- 172.21.15.37:0/356884207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fab1a80 0x55df6fac6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.524+0000 7f178f400640 1 -- 172.21.15.37:0/356884207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df6fac2790 con 0x55df6fab23a0 2024-08-20T05:11:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.524+0000 7f178f400640 1 --2- 172.21.15.37:0/356884207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab23a0 0x55df6fac1c10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f177c005ec0 tx=0x7f177c031f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=542454c369e1e7eb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.524+0000 7f1779600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:11:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.524+0000 7f1779600640 1 -- 172.21.15.37:0/356884207 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c0e9030 con 0x55df6fab23a0 2024-08-20T05:11:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.525+0000 7f1799473740 1 -- 172.21.15.37:0/356884207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f177c0ad070 con 0x55df6fab23a0 2024-08-20T05:11:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.525+0000 7f1779600640 1 -- 172.21.15.37:0/356884207 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f177c0c7630 con 0x55df6fab23a0 2024-08-20T05:11:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.525+0000 7f1779600640 1 -- 172.21.15.37:0/356884207 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f177c049070 con 0x55df6fab23a0 2024-08-20T05:11:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.525+0000 7f1799473740 10 client.27898 fetch_fsmap learned FSMap version 43 2024-08-20T05:11:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.525+0000 7f1799473740 1 -- 172.21.15.37:0/356884207 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55df6fb38430 con 0x55df6fab23a0 2024-08-20T05:11:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.525+0000 7f1779600640 1 -- 172.21.15.37:0/356884207 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f177c0ad070 con 0x55df6fab23a0 2024-08-20T05:11:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.525+0000 7f1779600640 1 -- 172.21.15.37:0/356884207 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f177c0d6070 con 0x55df6fab23a0 2024-08-20T05:11:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.525+0000 7f1799473740 10 client.27898 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:11:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.525+0000 7f1799473740 10 client.27898 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.525+0000 7f1799473740 20 client.27898 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.525+0000 7f1799473740 1 --2- 172.21.15.37:0/356884207 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55df6fb38b20 0x55df6fb3af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.525+0000 7f1799473740 4 client.27898 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:11:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.525+0000 7f1799473740 1 -- 172.21.15.37:0/356884207 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55df6fa25450 con 0x55df6fb38b20 2024-08-20T05:11:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.526+0000 7f178fe00640 1 --2- 172.21.15.37:0/356884207 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55df6fb38b20 0x55df6fb3af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.526+0000 7f178fe00640 1 --2- 172.21.15.37:0/356884207 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55df6fb38b20 0x55df6fb3af40 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=914705b056735715 server_cookie=b28f62fbfd1c5531 in_seq=0 out_seq=0 2024-08-20T05:11:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.526+0000 7f1779600640 10 client.27898 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.526+0000 7f1779600640 1 -- 172.21.15.37:0/356884207 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55df6fa25450 con 0x55df6fb38b20 2024-08-20T05:11:50.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.526+0000 7f1779600640 10 client.27898 handle_command_reply: tid=0 2024-08-20T05:11:50.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.526+0000 7f1799473740 1 client.27898 shutdown 2024-08-20T05:11:50.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.527+0000 7f1799473740 1 -- 172.21.15.37:0/356884207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab23a0 msgr2=0x55df6fac1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:50.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.527+0000 7f1799473740 1 --2- 172.21.15.37:0/356884207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab23a0 0x55df6fac1c10 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f177c005ec0 tx=0x7f177c031f10 comp rx=0 tx=0).stop 2024-08-20T05:11:50.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.527+0000 7f1799473740 1 -- 172.21.15.37:0/356884207 shutdown_connections 2024-08-20T05:11:50.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.527+0000 7f1799473740 1 --2- 172.21.15.37:0/356884207 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55df6fb38b20 0x55df6fb3af40 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.527+0000 7f1799473740 1 --2- 172.21.15.37:0/356884207 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df6fabe330 0x55df6fac2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.527+0000 7f1799473740 1 --2- 172.21.15.37:0/356884207 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df6fab23a0 0x55df6fac1c10 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.527+0000 7f1779600640 0 client.27898 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:50.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.527+0000 7f1799473740 1 --2- 172.21.15.37:0/356884207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df6fab1a80 0x55df6fac6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.527+0000 7f1799473740 1 -- 172.21.15.37:0/356884207 >> 172.21.15.37:0/356884207 conn(0x55df6faaf8b0 msgr2=0x55df6fab97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:50.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.527+0000 7f1799473740 1 -- 172.21.15.37:0/356884207 shutdown_connections 2024-08-20T05:11:50.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.527+0000 7f1799473740 1 -- 172.21.15.37:0/356884207 wait complete. 2024-08-20T05:11:50.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.527+0000 7f1799473740 20 client.27898 trim_cache size 0 max 16384 2024-08-20T05:11:50.534 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:11:50.534 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-20T05:11:50.534 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-08-20T05:11:50.535 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:11:50.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.528+0000 7f1795400640 1 -- 172.21.15.37:0/940543110 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f17740b3c00 msgr2=0x7f17740b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:50.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.528+0000 7f1795400640 1 --2- 172.21.15.37:0/940543110 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f17740b3c00 0x7f17740b60c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1788005f10 tx=0x7f1788009600 comp rx=0 tx=0).stop 2024-08-20T05:11:50.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.528+0000 7f1795400640 1 -- 172.21.15.37:0/940543110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f179010a520 msgr2=0x7f179019b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:50.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.528+0000 7f1795400640 1 --2- 172.21.15.37:0/940543110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f179010a520 0x7f179019b440 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f177c005ab0 tx=0x7f177c003cd0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.528+0000 7f1795400640 1 -- 172.21.15.37:0/940543110 shutdown_connections 2024-08-20T05:11:50.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.528+0000 7f1795400640 1 --2- 172.21.15.37:0/940543110 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f17740b3c00 0x7f17740b60c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.528+0000 7f1795400640 1 --2- 172.21.15.37:0/940543110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f179010aea0 0x7f17901a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.528+0000 7f1795400640 1 --2- 172.21.15.37:0/940543110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f179010a520 0x7f179019b440 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.528+0000 7f1795400640 1 --2- 172.21.15.37:0/940543110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1790104b10 0x7f179019af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:50.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.528+0000 7f1795400640 1 -- 172.21.15.37:0/940543110 >> 172.21.15.37:0/940543110 conn(0x7f1790100540 msgr2=0x7f1790103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:50.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.528+0000 7f1795400640 1 -- 172.21.15.37:0/940543110 shutdown_connections 2024-08-20T05:11:50.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:50.528+0000 7f1795400640 1 -- 172.21.15.37:0/940543110 wait complete. 2024-08-20T05:11:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.444+0000 7f7574600640 1 -- 172.21.15.37:0/1389622000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f756c102680 msgr2=0x7f756c102a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.445+0000 7f7574600640 1 --2- 172.21.15.37:0/1389622000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f756c102680 0x7f756c102a80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7560009930 tx=0x7f756002a440 comp rx=0 tx=0).stop 2024-08-20T05:11:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.445+0000 7f7574600640 1 -- 172.21.15.37:0/1389622000 shutdown_connections 2024-08-20T05:11:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.445+0000 7f7574600640 1 --2- 172.21.15.37:0/1389622000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f756c104190 0x7f756c10ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.445+0000 7f7574600640 1 --2- 172.21.15.37:0/1389622000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f756c1037d0 0x7f756c103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.447 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.445+0000 7f7574600640 1 --2- 172.21.15.37:0/1389622000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f756c102680 0x7f756c102a80 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.445+0000 7f7574600640 1 -- 172.21.15.37:0/1389622000 >> 172.21.15.37:0/1389622000 conn(0x7f756c0fdf40 msgr2=0x7f756c100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.445+0000 7f7574600640 1 -- 172.21.15.37:0/1389622000 shutdown_connections 2024-08-20T05:11:51.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.445+0000 7f7574600640 1 -- 172.21.15.37:0/1389622000 wait complete. 2024-08-20T05:11:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.446+0000 7f7574600640 1 Processor -- start 2024-08-20T05:11:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.446+0000 7f7574600640 1 -- start start 2024-08-20T05:11:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.446+0000 7f7574600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f756c102680 0x7f756c076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.446+0000 7f7574600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f756c1037d0 0x7f756c075270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.446+0000 7f7574600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f756c104190 0x7f756c0757b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.446+0000 7f7574600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f756c10e320 con 0x7f756c102680 2024-08-20T05:11:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.446+0000 7f7574600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f756c10e1a0 con 0x7f756c1037d0 2024-08-20T05:11:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.446+0000 7f7574600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f756c10e4a0 con 0x7f756c104190 2024-08-20T05:11:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.446+0000 7f7571c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f756c102680 0x7f756c076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:51.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.446+0000 7f7571c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f756c102680 0x7f756c076a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48576/0 (socket says 172.21.15.37:48576) 2024-08-20T05:11:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.446+0000 7f7571c00640 1 -- 172.21.15.37:0/3185262087 learned_addr learned my addr 172.21.15.37:0/3185262087 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.446+0000 7f7572600640 1 --2- 172.21.15.37:0/3185262087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f756c104190 0x7f756c0757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.447+0000 7f7571200640 1 --2- 172.21.15.37:0/3185262087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f756c1037d0 0x7f756c075270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.447+0000 7f7571c00640 1 -- 172.21.15.37:0/3185262087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f756c104190 msgr2=0x7f756c0757b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.447+0000 7f7571c00640 1 --2- 172.21.15.37:0/3185262087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f756c104190 0x7f756c0757b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.447+0000 7f7571c00640 1 -- 172.21.15.37:0/3185262087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f756c1037d0 msgr2=0x7f756c075270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.447+0000 7f7571c00640 1 --2- 172.21.15.37:0/3185262087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f756c1037d0 0x7f756c075270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.447+0000 7f7571c00640 1 -- 172.21.15.37:0/3185262087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f756c076020 con 0x7f756c102680 2024-08-20T05:11:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.447+0000 7f7571c00640 1 --2- 172.21.15.37:0/3185262087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f756c102680 0x7f756c076a10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7560031500 tx=0x7f7560003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.447+0000 7f756a000640 1 -- 172.21.15.37:0/3185262087 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756003f070 con 0x7f756c102680 2024-08-20T05:11:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.448+0000 7f756a000640 1 -- 172.21.15.37:0/3185262087 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7560003e70 con 0x7f756c102680 2024-08-20T05:11:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.448+0000 7f7574600640 1 -- 172.21.15.37:0/3185262087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f756c1a2b00 con 0x7f756c102680 2024-08-20T05:11:51.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.448+0000 7f756a000640 1 -- 172.21.15.37:0/3185262087 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560035030 con 0x7f756c102680 2024-08-20T05:11:51.452 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.448+0000 7f7574600640 1 -- 172.21.15.37:0/3185262087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f756c1a3010 con 0x7f756c102680 2024-08-20T05:11:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.452+0000 7f757766a740 1 Processor -- start 2024-08-20T05:11:51.454 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.452+0000 7f757766a740 1 -- start start 2024-08-20T05:11:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.452+0000 7f757766a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7af2b0 0x55f21a7b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.452+0000 7f757766a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7b1be0 0x55f21a7b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.452+0000 7f757766a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7b4620 0x55f21a7b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.452+0000 7f757766a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f21a722210 con 0x55f21a7af2b0 2024-08-20T05:11:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.452+0000 7f757766a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f21a711710 con 0x55f21a7b1be0 2024-08-20T05:11:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.452+0000 7f757766a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f21a715750 con 0x55f21a7b4620 2024-08-20T05:11:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.453+0000 7f7572600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7af2b0 0x55f21a7b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:51.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.453+0000 7f756a000640 1 -- 172.21.15.37:0/3185262087 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7560042070 con 0x7f756c102680 2024-08-20T05:11:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.453+0000 7f7572600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7af2b0 0x55f21a7b16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48582/0 (socket says 172.21.15.37:48582) 2024-08-20T05:11:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.453+0000 7f7572600640 1 -- 172.21.15.37:0/1095640189 learned_addr learned my addr 172.21.15.37:0/1095640189 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.453+0000 7f7571200640 1 --2- 172.21.15.37:0/1095640189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7b4620 0x55f21a7b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.453+0000 7f7572600640 1 -- 172.21.15.37:0/1095640189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7b4620 msgr2=0x55f21a7b6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.453+0000 7f7572600640 1 --2- 172.21.15.37:0/1095640189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7b4620 0x55f21a7b6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.453+0000 7f7572600640 1 -- 172.21.15.37:0/1095640189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7b1be0 msgr2=0x55f21a7b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.453+0000 7f7572600640 1 --2- 172.21.15.37:0/1095640189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7b1be0 0x55f21a7b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.453+0000 7f7572600640 1 -- 172.21.15.37:0/1095640189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f21a6ddde0 con 0x55f21a7af2b0 2024-08-20T05:11:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.453+0000 7f7572600640 1 --2- 172.21.15.37:0/1095640189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7af2b0 0x55f21a7b16a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7564010370 tx=0x7f7564010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6e709525897bf8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.454+0000 7f755ea00640 1 -- 172.21.15.37:0/1095640189 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7564016070 con 0x55f21a7af2b0 2024-08-20T05:11:51.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.454+0000 7f755ea00640 1 -- 172.21.15.37:0/1095640189 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7564004d20 con 0x55f21a7af2b0 2024-08-20T05:11:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.454+0000 7f755ea00640 1 -- 172.21.15.37:0/1095640189 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75640053c0 con 0x55f21a7af2b0 2024-08-20T05:11:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.454+0000 7f757766a740 1 -- 172.21.15.37:0/1095640189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7af2b0 msgr2=0x55f21a7b16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.454+0000 7f757766a740 1 --2- 172.21.15.37:0/1095640189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7af2b0 0x55f21a7b16a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7564010370 tx=0x7f7564010830 comp rx=0 tx=0).stop 2024-08-20T05:11:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.454+0000 7f757766a740 1 -- 172.21.15.37:0/1095640189 shutdown_connections 2024-08-20T05:11:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.454+0000 7f757766a740 1 --2- 172.21.15.37:0/1095640189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7b4620 0x55f21a7b6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.454+0000 7f757766a740 1 --2- 172.21.15.37:0/1095640189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7b1be0 0x55f21a7b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.454+0000 7f757766a740 1 --2- 172.21.15.37:0/1095640189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7af2b0 0x55f21a7b16a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.454+0000 7f757766a740 1 -- 172.21.15.37:0/1095640189 >> 172.21.15.37:0/1095640189 conn(0x55f21a7aa3b0 msgr2=0x55f21a7ab190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.454+0000 7f756a000640 1 --2- 172.21.15.37:0/3185262087 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75540b3c50 0x7f75540b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.454+0000 7f757766a740 1 -- 172.21.15.37:0/1095640189 shutdown_connections 2024-08-20T05:11:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.455+0000 7f757766a740 1 -- 172.21.15.37:0/1095640189 wait complete. 2024-08-20T05:11:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.455+0000 7f756a000640 1 -- 172.21.15.37:0/3185262087 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7560104b00 con 0x7f756c102680 2024-08-20T05:11:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.455+0000 7f7571200640 1 --2- 172.21.15.37:0/3185262087 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75540b3c50 0x7f75540b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.455+0000 7f757766a740 1 -- start start 2024-08-20T05:11:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.455+0000 7f757766a740 1 Processor -- start 2024-08-20T05:11:51.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.455+0000 7f7571200640 1 --2- 172.21.15.37:0/3185262087 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75540b3c50 0x7f75540b6110 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7558004530 tx=0x7f755800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f757766a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7af2b0 0x55f21a7b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f757766a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 0x55f21a7b9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f757766a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7b4620 0x55f21a7ba010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f757766a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f21a64aab0 con 0x55f21a7b1be0 2024-08-20T05:11:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f757766a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f21a6b8140 con 0x55f21a7af2b0 2024-08-20T05:11:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f757766a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f21a7b7600 con 0x55f21a7b4620 2024-08-20T05:11:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f757766a740 10 client.0 _ll_register_callbacks cb 0x55f21a6cb5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f7571200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 0x55f21a7b9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f7571c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7af2b0 0x55f21a7b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f7571c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7af2b0 0x55f21a7b8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:39632/0 (socket says 172.21.15.37:39632) 2024-08-20T05:11:51.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f7571c00640 1 -- 172.21.15.37:0/199662828 learned_addr learned my addr 172.21.15.37:0/199662828 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f7572600640 1 --2- 172.21.15.37:0/199662828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7b4620 0x55f21a7ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f7571c00640 1 -- 172.21.15.37:0/199662828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7b4620 msgr2=0x55f21a7ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f7571c00640 1 --2- 172.21.15.37:0/199662828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7b4620 0x55f21a7ba010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f7571c00640 1 -- 172.21.15.37:0/199662828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 msgr2=0x55f21a7b9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f7571c00640 1 --2- 172.21.15.37:0/199662828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 0x55f21a7b9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f7571c00640 1 -- 172.21.15.37:0/199662828 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f21a6b9170 con 0x55f21a7af2b0 2024-08-20T05:11:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.456+0000 7f7571200640 1 --2- 172.21.15.37:0/199662828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 0x55f21a7b9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.457+0000 7f7571c00640 1 --2- 172.21.15.37:0/199662828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7af2b0 0x55f21a7b8da0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f75600cb400 tx=0x7f75600cb050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8629bf8025123029 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.457+0000 7f7553400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:11:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.457+0000 7f7553400640 1 -- 172.21.15.37:0/199662828 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560049070 con 0x55f21a7af2b0 2024-08-20T05:11:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.457+0000 7f757766a740 1 -- 172.21.15.37:0/199662828 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f21a6e8a30 con 0x55f21a7af2b0 2024-08-20T05:11:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.457+0000 7f7553400640 1 -- 172.21.15.37:0/199662828 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f75600cb960 con 0x55f21a7af2b0 2024-08-20T05:11:51.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.457+0000 7f7553400640 1 -- 172.21.15.37:0/199662828 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f756003be60 con 0x55f21a7af2b0 2024-08-20T05:11:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.457+0000 7f757766a740 10 client.27920 fetch_fsmap learned FSMap version 43 2024-08-20T05:11:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.457+0000 7f757766a740 1 -- 172.21.15.37:0/199662828 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55f21a474790 con 0x55f21a7af2b0 2024-08-20T05:11:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.458+0000 7f7553400640 1 -- 172.21.15.37:0/199662828 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f21a6e8a30 con 0x55f21a7af2b0 2024-08-20T05:11:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.458+0000 7f7553400640 1 -- 172.21.15.37:0/199662828 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f75600d4270 con 0x55f21a7af2b0 2024-08-20T05:11:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.458+0000 7f757766a740 10 client.27920 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:11:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.458+0000 7f757766a740 10 client.27920 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.458+0000 7f757766a740 20 client.27920 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.458+0000 7f757766a740 1 --2- 172.21.15.37:0/199662828 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f21a7c4a80 0x55f21a7c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.458+0000 7f757766a740 4 client.27920 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.458+0000 7f757766a740 1 -- 172.21.15.37:0/199662828 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f21a724160 con 0x55f21a7c4a80 2024-08-20T05:11:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.458+0000 7f7571200640 1 --2- 172.21.15.37:0/199662828 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f21a7c4a80 0x55f21a7c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:51.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.459+0000 7f7571200640 1 --2- 172.21.15.37:0/199662828 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f21a7c4a80 0x55f21a7c6ea0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59822eec7da5f846 server_cookie=fdfaaf583234cfbd in_seq=0 out_seq=0 2024-08-20T05:11:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.459+0000 7f7553400640 10 client.27920 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.460+0000 7f7553400640 1 -- 172.21.15.37:0/199662828 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f21a724160 con 0x55f21a7c4a80 2024-08-20T05:11:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.460+0000 7f7553400640 10 client.27920 handle_command_reply: tid=0 2024-08-20T05:11:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.460+0000 7f757766a740 1 client.27920 shutdown 2024-08-20T05:11:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.460+0000 7f757766a740 1 -- 172.21.15.37:0/199662828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7af2b0 msgr2=0x55f21a7b8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.460+0000 7f757766a740 1 --2- 172.21.15.37:0/199662828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7af2b0 0x55f21a7b8da0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f75600cb400 tx=0x7f75600cb050 comp rx=0 tx=0).stop 2024-08-20T05:11:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.460+0000 7f757766a740 1 -- 172.21.15.37:0/199662828 shutdown_connections 2024-08-20T05:11:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.460+0000 7f757766a740 1 --2- 172.21.15.37:0/199662828 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f21a7c4a80 0x55f21a7c6ea0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.460+0000 7f757766a740 1 --2- 172.21.15.37:0/199662828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7b4620 0x55f21a7ba010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.460+0000 7f757766a740 1 --2- 172.21.15.37:0/199662828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 0x55f21a7b9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.460+0000 7f757766a740 1 --2- 172.21.15.37:0/199662828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7af2b0 0x55f21a7b8da0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.460+0000 7f7553400640 0 client.27920 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.460+0000 7f757766a740 1 -- 172.21.15.37:0/199662828 >> 172.21.15.37:0/199662828 conn(0x55f21a7aa3b0 msgr2=0x55f21a7a94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:51.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.460+0000 7f757766a740 1 -- 172.21.15.37:0/199662828 shutdown_connections 2024-08-20T05:11:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.460+0000 7f757766a740 1 -- 172.21.15.37:0/199662828 wait complete. 2024-08-20T05:11:51.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.461+0000 7f757766a740 20 client.27920 trim_cache size 0 max 16384 2024-08-20T05:11:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.487+0000 7f757766a740 1 Processor -- start 2024-08-20T05:11:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.488+0000 7f757766a740 1 -- start start 2024-08-20T05:11:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.488+0000 7f757766a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7af2b0 0x55f21a7b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.491 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.488+0000 7f757766a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 0x55f21a7b6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.488+0000 7f757766a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7b4620 0x55f21a7b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.488+0000 7f757766a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f756c1ad4a0 con 0x55f21a7b1be0 2024-08-20T05:11:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.488+0000 7f757766a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f756c1af070 con 0x55f21a7b4620 2024-08-20T05:11:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.488+0000 7f757766a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f756c1adb70 con 0x55f21a7af2b0 2024-08-20T05:11:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.488+0000 7f7571200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 0x55f21a7b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.488+0000 7f7571200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 0x55f21a7b6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48588/0 (socket says 172.21.15.37:48588) 2024-08-20T05:11:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.488+0000 7f7571200640 1 -- 172.21.15.37:0/1413994106 learned_addr learned my addr 172.21.15.37:0/1413994106 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.488+0000 7f7571c00640 1 --2- 172.21.15.37:0/1413994106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7af2b0 0x55f21a7b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:51.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.489+0000 7f7572600640 1 --2- 172.21.15.37:0/1413994106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7b4620 0x55f21a7b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.489+0000 7f7571200640 1 -- 172.21.15.37:0/1413994106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7af2b0 msgr2=0x55f21a7b6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.489+0000 7f7571200640 1 --2- 172.21.15.37:0/1413994106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7af2b0 0x55f21a7b6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.489+0000 7f7571200640 1 -- 172.21.15.37:0/1413994106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7b4620 msgr2=0x55f21a7b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.489+0000 7f7571200640 1 --2- 172.21.15.37:0/1413994106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7b4620 0x55f21a7b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.489+0000 7f7571200640 1 -- 172.21.15.37:0/1413994106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f21a4ed620 con 0x55f21a7b1be0 2024-08-20T05:11:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.489+0000 7f7571c00640 1 --2- 172.21.15.37:0/1413994106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7af2b0 0x55f21a7b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.489+0000 7f7571200640 1 --2- 172.21.15.37:0/1413994106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 0x55f21a7b6890 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7558003d00 tx=0x7f7558019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc08af500ca013 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.489+0000 7f755e000640 1 -- 172.21.15.37:0/1413994106 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755801e9f0 con 0x55f21a7b1be0 2024-08-20T05:11:51.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.489+0000 7f755e000640 1 -- 172.21.15.37:0/1413994106 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f755801eb90 con 0x55f21a7b1be0 2024-08-20T05:11:51.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.489+0000 7f755e000640 1 -- 172.21.15.37:0/1413994106 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755801d650 con 0x55f21a7b1be0 2024-08-20T05:11:51.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.490+0000 7f757766a740 1 -- 172.21.15.37:0/1413994106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 msgr2=0x55f21a7b6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:51.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.490+0000 7f757766a740 1 --2- 172.21.15.37:0/1413994106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 0x55f21a7b6890 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f7558003d00 tx=0x7f7558019000 comp rx=0 tx=0).stop 2024-08-20T05:11:51.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.490+0000 7f757766a740 1 -- 172.21.15.37:0/1413994106 shutdown_connections 2024-08-20T05:11:51.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.490+0000 7f757766a740 1 --2- 172.21.15.37:0/1413994106 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7b4620 0x55f21a7b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.490+0000 7f757766a740 1 --2- 172.21.15.37:0/1413994106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 0x55f21a7b6890 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.490+0000 7f757766a740 1 --2- 172.21.15.37:0/1413994106 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7af2b0 0x55f21a7b6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.490+0000 7f757766a740 1 -- 172.21.15.37:0/1413994106 >> 172.21.15.37:0/1413994106 conn(0x55f21a7aa3b0 msgr2=0x55f21a7a5230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:51.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.490+0000 7f757766a740 1 -- 172.21.15.37:0/1413994106 shutdown_connections 2024-08-20T05:11:51.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.491+0000 7f757766a740 1 -- 172.21.15.37:0/1413994106 wait complete. 2024-08-20T05:11:51.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.491+0000 7f757766a740 1 -- start start 2024-08-20T05:11:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.491+0000 7f757766a740 1 Processor -- start 2024-08-20T05:11:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f757766a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7af2b0 0x55f21a7bd720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f757766a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 0x55f21a7bddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f757766a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7b4620 0x55f21a7be990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f757766a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f756c1ae970 con 0x55f21a7b1be0 2024-08-20T05:11:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f757766a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f756c1ae240 con 0x55f21a7af2b0 2024-08-20T05:11:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f757766a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f756c1ab480 con 0x55f21a7b4620 2024-08-20T05:11:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f757766a740 10 client.0 _ll_register_callbacks cb 0x7f75600c7780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f7571200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 0x55f21a7bddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f7571c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7af2b0 0x55f21a7bd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f7571200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 0x55f21a7bddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48598/0 (socket says 172.21.15.37:48598) 2024-08-20T05:11:51.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f7572600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7b4620 0x55f21a7be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f7571200640 1 -- 172.21.15.37:0/3247802806 learned_addr learned my addr 172.21.15.37:0/3247802806 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f7571c00640 1 -- 172.21.15.37:0/3247802806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7b4620 msgr2=0x55f21a7be990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f7571c00640 1 --2- 172.21.15.37:0/3247802806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7b4620 0x55f21a7be990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f7571c00640 1 -- 172.21.15.37:0/3247802806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 msgr2=0x55f21a7bddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f7571c00640 1 --2- 172.21.15.37:0/3247802806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 0x55f21a7bddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f7571c00640 1 -- 172.21.15.37:0/3247802806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f21a7bf1c0 con 0x55f21a7af2b0 2024-08-20T05:11:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.492+0000 7f7572600640 1 --2- 172.21.15.37:0/3247802806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7b4620 0x55f21a7be990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.493+0000 7f7571c00640 1 --2- 172.21.15.37:0/3247802806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7af2b0 0x55f21a7bd720 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f756002aa00 tx=0x7f7560047000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d90bb55bbb33efb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.493+0000 7f7553400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:11:51.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.493+0000 7f7553400640 1 -- 172.21.15.37:0/3247802806 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560049070 con 0x55f21a7af2b0 2024-08-20T05:11:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.493+0000 7f757766a740 1 -- 172.21.15.37:0/3247802806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f755801eb90 con 0x55f21a7af2b0 2024-08-20T05:11:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.493+0000 7f7553400640 1 -- 172.21.15.37:0/3247802806 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f75600cb960 con 0x55f21a7af2b0 2024-08-20T05:11:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.493+0000 7f7553400640 1 -- 172.21.15.37:0/3247802806 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f75600c75c0 con 0x55f21a7af2b0 2024-08-20T05:11:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.493+0000 7f757766a740 10 client.27926 fetch_fsmap learned FSMap version 43 2024-08-20T05:11:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.493+0000 7f757766a740 1 -- 172.21.15.37:0/3247802806 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55f21a7c0530 con 0x55f21a7af2b0 2024-08-20T05:11:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.493+0000 7f7553400640 1 -- 172.21.15.37:0/3247802806 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f755801eb90 con 0x55f21a7af2b0 2024-08-20T05:11:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.493+0000 7f7553400640 1 -- 172.21.15.37:0/3247802806 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f75600c7070 con 0x55f21a7af2b0 2024-08-20T05:11:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.494+0000 7f757766a740 10 client.27926 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:11:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.494+0000 7f757766a740 10 client.27926 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:11:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.494+0000 7f757766a740 20 client.27926 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.494+0000 7f757766a740 1 --2- 172.21.15.37:0/3247802806 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f21a7c0d50 0x55f21a831750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:51.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.494+0000 7f757766a740 4 client.27926 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:11:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.494+0000 7f757766a740 1 -- 172.21.15.37:0/3247802806 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f21a71fc00 con 0x55f21a7c0d50 2024-08-20T05:11:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.494+0000 7f7571200640 1 --2- 172.21.15.37:0/3247802806 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f21a7c0d50 0x55f21a831750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.494+0000 7f7571200640 1 --2- 172.21.15.37:0/3247802806 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f21a7c0d50 0x55f21a831750 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb1667560b5eb48c server_cookie=fcf712f48e22af70 in_seq=0 out_seq=0 2024-08-20T05:11:51.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.494+0000 7f7553400640 10 client.27926 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:51.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.503+0000 7f7553400640 1 -- 172.21.15.37:0/3247802806 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f21a71fc00 con 0x55f21a7c0d50 2024-08-20T05:11:51.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.504+0000 7f7553400640 10 client.27926 handle_command_reply: tid=0 2024-08-20T05:11:51.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.504+0000 7f757766a740 1 client.27926 shutdown 2024-08-20T05:11:51.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.504+0000 7f757766a740 1 -- 172.21.15.37:0/3247802806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7af2b0 msgr2=0x55f21a7bd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:51.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.504+0000 7f757766a740 1 --2- 172.21.15.37:0/3247802806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7af2b0 0x55f21a7bd720 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f756002aa00 tx=0x7f7560047000 comp rx=0 tx=0).stop 2024-08-20T05:11:51.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.504+0000 7f757766a740 1 -- 172.21.15.37:0/3247802806 shutdown_connections 2024-08-20T05:11:51.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.504+0000 7f757766a740 1 --2- 172.21.15.37:0/3247802806 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f21a7c0d50 0x55f21a831750 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.504+0000 7f757766a740 1 --2- 172.21.15.37:0/3247802806 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f21a7b4620 0x55f21a7be990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.504+0000 7f757766a740 1 --2- 172.21.15.37:0/3247802806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f21a7b1be0 0x55f21a7bddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.504+0000 7f757766a740 1 --2- 172.21.15.37:0/3247802806 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f21a7af2b0 0x55f21a7bd720 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.504+0000 7f7553400640 0 client.27926 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:51.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.504+0000 7f757766a740 1 -- 172.21.15.37:0/3247802806 >> 172.21.15.37:0/3247802806 conn(0x55f21a7aa3b0 msgr2=0x55f21a7b6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:51.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.504+0000 7f757766a740 1 -- 172.21.15.37:0/3247802806 shutdown_connections 2024-08-20T05:11:51.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.504+0000 7f757766a740 1 -- 172.21.15.37:0/3247802806 wait complete. 2024-08-20T05:11:51.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.504+0000 7f757766a740 20 client.27926 trim_cache size 0 max 16384 2024-08-20T05:11:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:11:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:11:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:11:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:11:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.505+0000 7f7574600640 1 -- 172.21.15.37:0/3185262087 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75540b3c50 msgr2=0x7f75540b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:51.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.505+0000 7f7574600640 1 --2- 172.21.15.37:0/3185262087 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75540b3c50 0x7f75540b6110 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7558004530 tx=0x7f755800b390 comp rx=0 tx=0).stop 2024-08-20T05:11:51.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.505+0000 7f7574600640 1 -- 172.21.15.37:0/3185262087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f756c102680 msgr2=0x7f756c076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:51.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.505+0000 7f7574600640 1 --2- 172.21.15.37:0/3185262087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f756c102680 0x7f756c076a10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7560031500 tx=0x7f7560003c80 comp rx=0 tx=0).stop 2024-08-20T05:11:51.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.505+0000 7f7574600640 1 -- 172.21.15.37:0/3185262087 shutdown_connections 2024-08-20T05:11:51.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.505+0000 7f7574600640 1 --2- 172.21.15.37:0/3185262087 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75540b3c50 0x7f75540b6110 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.505+0000 7f7574600640 1 --2- 172.21.15.37:0/3185262087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f756c104190 0x7f756c0757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.505+0000 7f7574600640 1 --2- 172.21.15.37:0/3185262087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f756c1037d0 0x7f756c075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.505+0000 7f7574600640 1 --2- 172.21.15.37:0/3185262087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f756c102680 0x7f756c076a10 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:51.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.505+0000 7f7574600640 1 -- 172.21.15.37:0/3185262087 >> 172.21.15.37:0/3185262087 conn(0x7f756c0fdf40 msgr2=0x7f756c106b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:51.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.505+0000 7f7574600640 1 -- 172.21.15.37:0/3185262087 shutdown_connections 2024-08-20T05:11:51.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:11:51.505+0000 7f7574600640 1 -- 172.21.15.37:0/3185262087 wait complete. 2024-08-20T05:11:51.510 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T05:11:51.511 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:11:51.601 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:51 smithi037 ceph-mon[17265]: pgmap v689: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 351 KiB/s wr, 52 op/s 2024-08-20T05:11:51.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:51 smithi135 ceph-mon[22342]: pgmap v689: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 351 KiB/s wr, 52 op/s 2024-08-20T05:11:51.934 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:51.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:51 smithi130 ceph-mon[22007]: pgmap v689: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 351 KiB/s wr, 52 op/s 2024-08-20T05:11:52.449 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:11:52.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.823+0000 7f55f2200640 1 -- 172.21.15.37:0/1263997372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55ec10f0d0 msgr2=0x7f55ec1114c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:52.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.823+0000 7f55f2200640 1 --2- 172.21.15.37:0/1263997372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55ec10f0d0 0x7f55ec1114c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f55e4009ca0 tx=0x7f55e402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:11:52.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.823+0000 7f55f2200640 1 -- 172.21.15.37:0/1263997372 shutdown_connections 2024-08-20T05:11:52.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.823+0000 7f55f2200640 1 --2- 172.21.15.37:0/1263997372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55ec10f0d0 0x7f55ec1114c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:52.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.823+0000 7f55f2200640 1 --2- 172.21.15.37:0/1263997372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55ec075c70 0x7f55ec10eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:52.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.823+0000 7f55f2200640 1 --2- 172.21.15.37:0/1263997372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ec075270 0x7f55ec075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.823+0000 7f55f2200640 1 -- 172.21.15.37:0/1263997372 >> 172.21.15.37:0/1263997372 conn(0x7f55ec0fe500 msgr2=0x7f55ec100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.823+0000 7f55f2200640 1 -- 172.21.15.37:0/1263997372 shutdown_connections 2024-08-20T05:11:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.823+0000 7f55f2200640 1 -- 172.21.15.37:0/1263997372 wait complete. 2024-08-20T05:11:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.824+0000 7f55f2200640 1 Processor -- start 2024-08-20T05:11:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.824+0000 7f55f2200640 1 -- start start 2024-08-20T05:11:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.825+0000 7f55f2200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55ec075270 0x7f55ec19b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.825+0000 7f55f2200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ec075c70 0x7f55ec19b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.825+0000 7f55f2200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55ec10f0d0 0x7f55ec1a0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.825+0000 7f55f2200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f55ec114cd0 con 0x7f55ec075270 2024-08-20T05:11:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.825+0000 7f55f2200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f55ec114b50 con 0x7f55ec10f0d0 2024-08-20T05:11:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.825+0000 7f55f2200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f55ec114e50 con 0x7f55ec075c70 2024-08-20T05:11:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.825+0000 7f55eaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ec075c70 0x7f55ec19b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.825+0000 7f55eb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55ec075270 0x7f55ec19b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.825+0000 7f55ebe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55ec10f0d0 0x7f55ec1a0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.825+0000 7f55eb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55ec075270 0x7f55ec19b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43240/0 (socket says 172.21.15.37:43240) 2024-08-20T05:11:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.825+0000 7f55eb400640 1 -- 172.21.15.37:0/2078081382 learned_addr learned my addr 172.21.15.37:0/2078081382 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.826+0000 7f55eb400640 1 -- 172.21.15.37:0/2078081382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ec075c70 msgr2=0x7f55ec19b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.826+0000 7f55eb400640 1 --2- 172.21.15.37:0/2078081382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ec075c70 0x7f55ec19b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.826+0000 7f55eb400640 1 -- 172.21.15.37:0/2078081382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55ec10f0d0 msgr2=0x7f55ec1a0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.826+0000 7f55eb400640 1 --2- 172.21.15.37:0/2078081382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55ec10f0d0 0x7f55ec1a0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.826+0000 7f55eb400640 1 -- 172.21.15.37:0/2078081382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ec1a11d0 con 0x7f55ec075270 2024-08-20T05:11:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.826+0000 7f55eaa00640 1 --2- 172.21.15.37:0/2078081382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ec075c70 0x7f55ec19b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.826+0000 7f55eb400640 1 --2- 172.21.15.37:0/2078081382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55ec075270 0x7f55ec19b120 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00e9f0 tx=0x7f55dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.826+0000 7f55e3e00640 1 -- 172.21.15.37:0/2078081382 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc00cd80 con 0x7f55ec075270 2024-08-20T05:11:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.826+0000 7f55f2200640 1 -- 172.21.15.37:0/2078081382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55ec1a14c0 con 0x7f55ec075270 2024-08-20T05:11:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.826+0000 7f55e3e00640 1 -- 172.21.15.37:0/2078081382 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f55dc0108e0 con 0x7f55ec075270 2024-08-20T05:11:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.826+0000 7f55e3e00640 1 -- 172.21.15.37:0/2078081382 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc018980 con 0x7f55ec075270 2024-08-20T05:11:52.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.826+0000 7f55f2200640 1 -- 172.21.15.37:0/2078081382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55ec1a7d50 con 0x7f55ec075270 2024-08-20T05:11:52.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.828+0000 7f55f2200640 1 -- 172.21.15.37:0/2078081382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55ec075650 con 0x7f55ec075270 2024-08-20T05:11:52.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.831+0000 7f55e3e00640 1 -- 172.21.15.37:0/2078081382 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f55dc010430 con 0x7f55ec075270 2024-08-20T05:11:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.833+0000 7f55e3e00640 1 --2- 172.21.15.37:0/2078081382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55d00b3c50 0x7f55d00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.833+0000 7f55e3e00640 1 -- 172.21.15.37:0/2078081382 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f55dc0e4290 con 0x7f55ec075270 2024-08-20T05:11:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.833+0000 7f55eaa00640 1 --2- 172.21.15.37:0/2078081382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55d00b3c50 0x7f55d00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:52.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.834+0000 7f55eaa00640 1 --2- 172.21.15.37:0/2078081382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55d00b3c50 0x7f55d00b6110 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f55ec100d30 tx=0x7f55d8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:52.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:52.837+0000 7f55e3e00640 1 -- 172.21.15.37:0/2078081382 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f55dc0aae90 con 0x7f55ec075270 2024-08-20T05:11:52.989 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 535.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:11:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:53.088+0000 7f55f2200640 1 -- 172.21.15.37:0/2078081382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55ec19c250 con 0x7f55ec075270 2024-08-20T05:11:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:53.089+0000 7f55e3e00640 1 -- 172.21.15.37:0/2078081382 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+11987 (secure 0 0 0) 0x7f55dc0af3e0 con 0x7f55ec075270 2024-08-20T05:11:53.091 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:11:53.091 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":43,"btime":"2024-08-20T05:11:41:443525+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":43,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:11:41.286831+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:11:53.091 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 43 2024-08-20T05:11:53.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:53.091+0000 7f55f2200640 1 -- 172.21.15.37:0/2078081382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55d00b3c50 msgr2=0x7f55d00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:53.091+0000 7f55f2200640 1 --2- 172.21.15.37:0/2078081382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55d00b3c50 0x7f55d00b6110 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f55ec100d30 tx=0x7f55d8005f90 comp rx=0 tx=0).stop 2024-08-20T05:11:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:53.091+0000 7f55f2200640 1 -- 172.21.15.37:0/2078081382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55ec075270 msgr2=0x7f55ec19b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:53.091+0000 7f55f2200640 1 --2- 172.21.15.37:0/2078081382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55ec075270 0x7f55ec19b120 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00e9f0 tx=0x7f55dc00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:11:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:53.091+0000 7f55f2200640 1 -- 172.21.15.37:0/2078081382 shutdown_connections 2024-08-20T05:11:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:53.091+0000 7f55f2200640 1 --2- 172.21.15.37:0/2078081382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f55d00b3c50 0x7f55d00b6110 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:53.091+0000 7f55f2200640 1 --2- 172.21.15.37:0/2078081382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f55ec10f0d0 0x7f55ec1a0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:53.091+0000 7f55f2200640 1 --2- 172.21.15.37:0/2078081382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f55ec075c70 0x7f55ec19b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:53.091+0000 7f55f2200640 1 --2- 172.21.15.37:0/2078081382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55ec075270 0x7f55ec19b120 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:53.091+0000 7f55f2200640 1 -- 172.21.15.37:0/2078081382 >> 172.21.15.37:0/2078081382 conn(0x7f55ec0fe500 msgr2=0x7f55ec111270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:53.092+0000 7f55f2200640 1 -- 172.21.15.37:0/2078081382 shutdown_connections 2024-08-20T05:11:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:53.092+0000 7f55f2200640 1 -- 172.21.15.37:0/2078081382 wait complete. 2024-08-20T05:11:53.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:53 smithi037 ceph-mon[17265]: pgmap v690: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 351 KiB/s wr, 50 op/s 2024-08-20T05:11:53.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:53 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2078081382' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:11:53.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:53 smithi135 ceph-mon[22342]: pgmap v690: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 351 KiB/s wr, 50 op/s 2024-08-20T05:11:53.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:53 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2078081382' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:11:53.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:53 smithi130 ceph-mon[22007]: pgmap v690: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 351 KiB/s wr, 50 op/s 2024-08-20T05:11:53.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:53 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2078081382' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:11:54.455 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T05:11:54.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.745+0000 7f4c86c00640 1 -- 172.21.15.37:0/3541555372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c8010b030 msgr2=0x7f4c80111830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:54.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.745+0000 7f4c86c00640 1 --2- 172.21.15.37:0/3541555372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c8010b030 0x7f4c80111830 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009be0 tx=0x7f4c7802a6c0 comp rx=0 tx=0).stop 2024-08-20T05:11:54.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.746+0000 7f4c86c00640 1 -- 172.21.15.37:0/3541555372 shutdown_connections 2024-08-20T05:11:54.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.746+0000 7f4c86c00640 1 --2- 172.21.15.37:0/3541555372 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c8010b030 0x7f4c80111830 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:54.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.746+0000 7f4c86c00640 1 --2- 172.21.15.37:0/3541555372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8010a6b0 0x7f4c8010aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:54.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.746+0000 7f4c86c00640 1 --2- 172.21.15.37:0/3541555372 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c80104ca0 0x7f4c80105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:54.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.746+0000 7f4c86c00640 1 -- 172.21.15.37:0/3541555372 >> 172.21.15.37:0/3541555372 conn(0x7f4c80100730 msgr2=0x7f4c80102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:54.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.746+0000 7f4c86c00640 1 -- 172.21.15.37:0/3541555372 shutdown_connections 2024-08-20T05:11:54.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.746+0000 7f4c86c00640 1 -- 172.21.15.37:0/3541555372 wait complete. 2024-08-20T05:11:54.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.747+0000 7f4c86c00640 1 Processor -- start 2024-08-20T05:11:54.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.747+0000 7f4c86c00640 1 -- start start 2024-08-20T05:11:54.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.747+0000 7f4c86c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c80104ca0 0x7f4c8019b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:54.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.747+0000 7f4c86c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8010a6b0 0x7f4c8019b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:54.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.747+0000 7f4c86c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c8010b030 0x7f4c801a0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:54.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.747+0000 7f4c86c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f4c80114cf0 con 0x7f4c8010a6b0 2024-08-20T05:11:54.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.747+0000 7f4c86c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4c80114b70 con 0x7f4c80104ca0 2024-08-20T05:11:54.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.747+0000 7f4c86c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4c80114e70 con 0x7f4c8010b030 2024-08-20T05:11:54.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.748+0000 7f4c77400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8010a6b0 0x7f4c8019b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:54.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.748+0000 7f4c7fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c80104ca0 0x7f4c8019b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:54.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.748+0000 7f4c7fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c80104ca0 0x7f4c8019b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:55770/0 (socket says 172.21.15.37:55770) 2024-08-20T05:11:54.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.748+0000 7f4c7fe00640 1 -- 172.21.15.37:0/3050563629 learned_addr learned my addr 172.21.15.37:0/3050563629 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:54.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.748+0000 7f4c84c00640 1 --2- 172.21.15.37:0/3050563629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c8010b030 0x7f4c801a0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:54.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.748+0000 7f4c7fe00640 1 -- 172.21.15.37:0/3050563629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c8010b030 msgr2=0x7f4c801a0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:54.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.748+0000 7f4c7fe00640 1 --2- 172.21.15.37:0/3050563629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c8010b030 0x7f4c801a0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:54.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.748+0000 7f4c7fe00640 1 -- 172.21.15.37:0/3050563629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8010a6b0 msgr2=0x7f4c8019b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:54.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.748+0000 7f4c7fe00640 1 --2- 172.21.15.37:0/3050563629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8010a6b0 0x7f4c8019b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:54.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.748+0000 7f4c7fe00640 1 -- 172.21.15.37:0/3050563629 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c801a11f0 con 0x7f4c80104ca0 2024-08-20T05:11:54.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.748+0000 7f4c7fe00640 1 --2- 172.21.15.37:0/3050563629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c80104ca0 0x7f4c8019b140 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000e9f0 tx=0x7f4c7000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:54.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.749+0000 7f4c7d600640 1 -- 172.21.15.37:0/3050563629 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7000ccc0 con 0x7f4c80104ca0 2024-08-20T05:11:54.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.749+0000 7f4c7d600640 1 -- 172.21.15.37:0/3050563629 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c700054d0 con 0x7f4c80104ca0 2024-08-20T05:11:54.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.749+0000 7f4c86c00640 1 -- 172.21.15.37:0/3050563629 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c801a14e0 con 0x7f4c80104ca0 2024-08-20T05:11:54.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.749+0000 7f4c7d600640 1 -- 172.21.15.37:0/3050563629 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70010430 con 0x7f4c80104ca0 2024-08-20T05:11:54.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.749+0000 7f4c86c00640 1 -- 172.21.15.37:0/3050563629 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c801a7ba0 con 0x7f4c80104ca0 2024-08-20T05:11:54.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.750+0000 7f4c86c00640 1 -- 172.21.15.37:0/3050563629 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c80105080 con 0x7f4c80104ca0 2024-08-20T05:11:54.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.752+0000 7f4c7d600640 1 -- 172.21.15.37:0/3050563629 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4c700046c0 con 0x7f4c80104ca0 2024-08-20T05:11:54.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.753+0000 7f4c7d600640 1 --2- 172.21.15.37:0/3050563629 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4c640b3c50 0x7f4c640b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:54.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.753+0000 7f4c7d600640 1 -- 172.21.15.37:0/3050563629 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4c700e42e0 con 0x7f4c80104ca0 2024-08-20T05:11:54.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.754+0000 7f4c77400640 1 --2- 172.21.15.37:0/3050563629 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4c640b3c50 0x7f4c640b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:54.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.754+0000 7f4c77400640 1 --2- 172.21.15.37:0/3050563629 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4c640b3c50 0x7f4c640b6110 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4c80104120 tx=0x7f4c68005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:54.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:54.757+0000 7f4c7d600640 1 -- 172.21.15.37:0/3050563629 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f4c700ab530 con 0x7f4c80104ca0 2024-08-20T05:11:54.885 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:55.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.011+0000 7f4c86c00640 1 -- 172.21.15.37:0/3050563629 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c8002e340 con 0x7f4c80104ca0 2024-08-20T05:11:55.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.012+0000 7f4c7d600640 1 -- 172.21.15.37:0/3050563629 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+11987 (secure 0 0 0) 0x7f4c700aae30 con 0x7f4c80104ca0 2024-08-20T05:11:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:11:55.015 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":43,"btime":"2024-08-20T05:11:41:443525+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":43,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:11:41.286831+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:11:55.015 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 43 2024-08-20T05:11:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.015+0000 7f4c86c00640 1 -- 172.21.15.37:0/3050563629 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4c640b3c50 msgr2=0x7f4c640b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.015+0000 7f4c86c00640 1 --2- 172.21.15.37:0/3050563629 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4c640b3c50 0x7f4c640b6110 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4c80104120 tx=0x7f4c68005f90 comp rx=0 tx=0).stop 2024-08-20T05:11:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.015+0000 7f4c86c00640 1 -- 172.21.15.37:0/3050563629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c80104ca0 msgr2=0x7f4c8019b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.015+0000 7f4c86c00640 1 --2- 172.21.15.37:0/3050563629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c80104ca0 0x7f4c8019b140 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000e9f0 tx=0x7f4c7000eeb0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.015+0000 7f4c86c00640 1 -- 172.21.15.37:0/3050563629 shutdown_connections 2024-08-20T05:11:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.015+0000 7f4c86c00640 1 --2- 172.21.15.37:0/3050563629 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f4c640b3c50 0x7f4c640b6110 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.015+0000 7f4c86c00640 1 --2- 172.21.15.37:0/3050563629 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f4c8010b030 0x7f4c801a0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.015+0000 7f4c86c00640 1 --2- 172.21.15.37:0/3050563629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c8010a6b0 0x7f4c8019b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.015+0000 7f4c86c00640 1 --2- 172.21.15.37:0/3050563629 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f4c80104ca0 0x7f4c8019b140 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.015+0000 7f4c86c00640 1 -- 172.21.15.37:0/3050563629 >> 172.21.15.37:0/3050563629 conn(0x7f4c80100730 msgr2=0x7f4c80102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.015+0000 7f4c86c00640 1 -- 172.21.15.37:0/3050563629 shutdown_connections 2024-08-20T05:11:55.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.015+0000 7f4c86c00640 1 -- 172.21.15.37:0/3050563629 wait complete. 2024-08-20T05:11:55.695 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:55 smithi037 ceph-mon[17265]: pgmap v691: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 349 KiB/s wr, 50 op/s 2024-08-20T05:11:55.695 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:55 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3050563629' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:11:55.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.809+0000 7f3e62400640 1 -- 172.21.15.37:0/698868799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c10aea0 msgr2=0x7f3e5c1116a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:55.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.809+0000 7f3e62400640 1 --2- 172.21.15.37:0/698868799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c10aea0 0x7f3e5c1116a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009ca0 tx=0x7f3e5402a8c0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.809+0000 7f3e62400640 1 -- 172.21.15.37:0/698868799 shutdown_connections 2024-08-20T05:11:55.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.809+0000 7f3e62400640 1 --2- 172.21.15.37:0/698868799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c10aea0 0x7f3e5c1116a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.809+0000 7f3e62400640 1 --2- 172.21.15.37:0/698868799 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e5c10a520 0x7f3e5c10a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.809+0000 7f3e62400640 1 --2- 172.21.15.37:0/698868799 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e5c104b10 0x7f3e5c104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.809+0000 7f3e62400640 1 -- 172.21.15.37:0/698868799 >> 172.21.15.37:0/698868799 conn(0x7f3e5c100540 msgr2=0x7f3e5c102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:55.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.809+0000 7f3e62400640 1 -- 172.21.15.37:0/698868799 shutdown_connections 2024-08-20T05:11:55.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.809+0000 7f3e62400640 1 -- 172.21.15.37:0/698868799 wait complete. 2024-08-20T05:11:55.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.811+0000 7f3e62400640 1 Processor -- start 2024-08-20T05:11:55.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.811+0000 7f3e62400640 1 -- start start 2024-08-20T05:11:55.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.811+0000 7f3e62400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c104b10 0x7f3e5c19af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.811+0000 7f3e62400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e5c10a520 0x7f3e5c19b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.811+0000 7f3e62400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e5c10aea0 0x7f3e5c1a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.811+0000 7f3e62400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c114b20 con 0x7f3e5c104b10 2024-08-20T05:11:55.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.811+0000 7f3e62400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c1149a0 con 0x7f3e5c10aea0 2024-08-20T05:11:55.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.811+0000 7f3e62400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c114ca0 con 0x7f3e5c10a520 2024-08-20T05:11:55.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.812+0000 7f3e61000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c104b10 0x7f3e5c19af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:55.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.812+0000 7f3e5be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e5c10a520 0x7f3e5c19b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:55.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.812+0000 7f3e61000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c104b10 0x7f3e5c19af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43292/0 (socket says 172.21.15.37:43292) 2024-08-20T05:11:55.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.812+0000 7f3e61000640 1 -- 172.21.15.37:0/3235869131 learned_addr learned my addr 172.21.15.37:0/3235869131 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:55.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.812+0000 7f3e61a00640 1 --2- 172.21.15.37:0/3235869131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e5c10aea0 0x7f3e5c1a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:55.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.812+0000 7f3e5be00640 1 -- 172.21.15.37:0/3235869131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e5c10aea0 msgr2=0x7f3e5c1a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:55.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.812+0000 7f3e5be00640 1 --2- 172.21.15.37:0/3235869131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e5c10aea0 0x7f3e5c1a07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.812+0000 7f3e5be00640 1 -- 172.21.15.37:0/3235869131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c104b10 msgr2=0x7f3e5c19af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:55.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.812+0000 7f3e5be00640 1 --2- 172.21.15.37:0/3235869131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c104b10 0x7f3e5c19af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.812+0000 7f3e5be00640 1 -- 172.21.15.37:0/3235869131 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c1a0fb0 con 0x7f3e5c10a520 2024-08-20T05:11:55.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.812+0000 7f3e61000640 1 --2- 172.21.15.37:0/3235869131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c104b10 0x7f3e5c19af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:55.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.813+0000 7f3e5be00640 1 --2- 172.21.15.37:0/3235869131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e5c10a520 0x7f3e5c19b440 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800e9f0 tx=0x7f3e4800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:55.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.813+0000 7f3e59600640 1 -- 172.21.15.37:0/3235869131 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e4800ccc0 con 0x7f3e5c10a520 2024-08-20T05:11:55.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.813+0000 7f3e62400640 1 -- 172.21.15.37:0/3235869131 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e5c1a12a0 con 0x7f3e5c10a520 2024-08-20T05:11:55.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.813+0000 7f3e59600640 1 -- 172.21.15.37:0/3235869131 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e48005020 con 0x7f3e5c10a520 2024-08-20T05:11:55.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.813+0000 7f3e59600640 1 -- 172.21.15.37:0/3235869131 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e48004a00 con 0x7f3e5c10a520 2024-08-20T05:11:55.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.813+0000 7f3e62400640 1 -- 172.21.15.37:0/3235869131 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e5c1a7960 con 0x7f3e5c10a520 2024-08-20T05:11:55.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.816+0000 7f3e66664740 1 Processor -- start 2024-08-20T05:11:55.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.816+0000 7f3e66664740 1 -- start start 2024-08-20T05:11:55.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.816+0000 7f3e66664740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e20bac0 0x56012e20bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.816+0000 7f3e66664740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20c3e0 0x56012e217e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.816+0000 7f3e66664740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e218370 0x56012e21a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.817+0000 7f3e66664740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56012e181aa0 con 0x56012e20bac0 2024-08-20T05:11:55.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.817+0000 7f3e66664740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56012e170fa0 con 0x56012e218370 2024-08-20T05:11:55.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.817+0000 7f3e66664740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56012e174fe0 con 0x56012e20c3e0 2024-08-20T05:11:55.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.817+0000 7f3e61a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e20bac0 0x56012e20bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:55.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.817+0000 7f3e61000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20c3e0 0x56012e217e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:55.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.817+0000 7f3e61000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20c3e0 0x56012e217e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36698/0 (socket says 172.21.15.37:36698) 2024-08-20T05:11:55.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.817+0000 7f3e61000640 1 -- 172.21.15.37:0/2897843297 learned_addr learned my addr 172.21.15.37:0/2897843297 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:55.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.817+0000 7f3e61a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e20bac0 0x56012e20bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43302/0 (socket says 172.21.15.37:43302) 2024-08-20T05:11:55.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.817+0000 7f3e59600640 1 -- 172.21.15.37:0/3235869131 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3e48004ba0 con 0x7f3e5c10a520 2024-08-20T05:11:55.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.817+0000 7f3e61000640 1 -- 172.21.15.37:0/2897843297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e218370 msgr2=0x56012e21a760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:11:55.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.817+0000 7f3e61000640 1 --2- 172.21.15.37:0/2897843297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e218370 0x56012e21a760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.817+0000 7f3e61000640 1 -- 172.21.15.37:0/2897843297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e20bac0 msgr2=0x56012e20bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:55.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.817+0000 7f3e61000640 1 --2- 172.21.15.37:0/2897843297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e20bac0 0x56012e20bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.817+0000 7f3e61000640 1 -- 172.21.15.37:0/2897843297 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56012e117420 con 0x56012e20c3e0 2024-08-20T05:11:55.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.817+0000 7f3e61a00640 1 --2- 172.21.15.37:0/2897843297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e20bac0 0x56012e20bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:55.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.818+0000 7f3e61000640 1 --2- 172.21.15.37:0/2897843297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20c3e0 0x56012e217e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3e50011650 tx=0x7f3e50009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=883cbef077469a4f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:55.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.818+0000 7f3e4e000640 1 -- 172.21.15.37:0/2897843297 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5001e070 con 0x56012e20c3e0 2024-08-20T05:11:55.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.818+0000 7f3e4e000640 1 -- 172.21.15.37:0/2897843297 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e5000fb70 con 0x56012e20c3e0 2024-08-20T05:11:55.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.818+0000 7f3e4e000640 1 -- 172.21.15.37:0/2897843297 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e50019c70 con 0x56012e20c3e0 2024-08-20T05:11:55.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.819+0000 7f3e66664740 1 -- 172.21.15.37:0/2897843297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20c3e0 msgr2=0x56012e217e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:55.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.819+0000 7f3e66664740 1 --2- 172.21.15.37:0/2897843297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20c3e0 0x56012e217e30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3e50011650 tx=0x7f3e50009f90 comp rx=0 tx=0).stop 2024-08-20T05:11:55.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.819+0000 7f3e66664740 1 -- 172.21.15.37:0/2897843297 shutdown_connections 2024-08-20T05:11:55.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.819+0000 7f3e66664740 1 --2- 172.21.15.37:0/2897843297 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e218370 0x56012e21a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.819+0000 7f3e66664740 1 --2- 172.21.15.37:0/2897843297 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20c3e0 0x56012e217e30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.819+0000 7f3e66664740 1 --2- 172.21.15.37:0/2897843297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e20bac0 0x56012e20bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.819+0000 7f3e66664740 1 -- 172.21.15.37:0/2897843297 >> 172.21.15.37:0/2897843297 conn(0x56012e2098f0 msgr2=0x56012e20aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:55.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.819+0000 7f3e59600640 1 --2- 172.21.15.37:0/3235869131 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3e440b3c70 0x7f3e440b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.819+0000 7f3e66664740 1 -- 172.21.15.37:0/2897843297 shutdown_connections 2024-08-20T05:11:55.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.819+0000 7f3e66664740 1 -- 172.21.15.37:0/2897843297 wait complete. 2024-08-20T05:11:55.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.819+0000 7f3e59600640 1 -- 172.21.15.37:0/3235869131 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3e480e3fe0 con 0x7f3e5c10a520 2024-08-20T05:11:55.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.819+0000 7f3e61000640 1 --2- 172.21.15.37:0/3235869131 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3e440b3c70 0x7f3e440b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:55.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.820+0000 7f3e66664740 1 -- start start 2024-08-20T05:11:55.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.820+0000 7f3e66664740 1 Processor -- start 2024-08-20T05:11:55.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.820+0000 7f3e61000640 1 --2- 172.21.15.37:0/3235869131 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3e440b3c70 0x7f3e440b6130 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3e500196d0 tx=0x7f3e50019730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:55.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.820+0000 7f3e66664740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e20bac0 0x56012e217bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.820+0000 7f3e66664740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20c3e0 0x56012e215040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.820+0000 7f3e66664740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e218370 0x56012e2155e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.820+0000 7f3e66664740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56012dfd3700 con 0x56012e218370 2024-08-20T05:11:55.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.820+0000 7f3e66664740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56012e10c290 con 0x56012e20bac0 2024-08-20T05:11:55.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.820+0000 7f3e66664740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56012e21aff0 con 0x56012e20c3e0 2024-08-20T05:11:55.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.821+0000 7f3e66664740 10 client.0 _ll_register_callbacks cb 0x56012e16b1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:55.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.821+0000 7f3e61a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e218370 0x56012e2155e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:55.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.821+0000 7f3e61000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e20bac0 0x56012e217bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:55.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.821+0000 7f3e5be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20c3e0 0x56012e215040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:55.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.821+0000 7f3e61000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e20bac0 0x56012e217bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:55822/0 (socket says 172.21.15.37:55822) 2024-08-20T05:11:55.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.821+0000 7f3e61a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e218370 0x56012e2155e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43304/0 (socket says 172.21.15.37:43304) 2024-08-20T05:11:55.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.821+0000 7f3e61000640 1 -- 172.21.15.37:0/4156717876 learned_addr learned my addr 172.21.15.37:0/4156717876 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:55.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.821+0000 7f3e5be00640 1 -- 172.21.15.37:0/4156717876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e20bac0 msgr2=0x56012e217bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:55.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.821+0000 7f3e5be00640 1 --2- 172.21.15.37:0/4156717876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e20bac0 0x56012e217bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.821+0000 7f3e5be00640 1 -- 172.21.15.37:0/4156717876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e218370 msgr2=0x56012e2155e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:55.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.821+0000 7f3e5be00640 1 --2- 172.21.15.37:0/4156717876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e218370 0x56012e2155e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.821+0000 7f3e5be00640 1 -- 172.21.15.37:0/4156717876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56012ded0650 con 0x56012e20c3e0 2024-08-20T05:11:55.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.821+0000 7f3e5be00640 1 --2- 172.21.15.37:0/4156717876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20c3e0 0x56012e215040 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800e9c0 tx=0x7f3e480aa700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c68fecad8bba8ed1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:55.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.821+0000 7f3e42a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:11:55.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.822+0000 7f3e42a00640 1 -- 172.21.15.37:0/4156717876 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e480abe60 con 0x56012e20c3e0 2024-08-20T05:11:55.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.822+0000 7f3e42a00640 1 -- 172.21.15.37:0/4156717876 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3e480a7120 con 0x56012e20c3e0 2024-08-20T05:11:55.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.822+0000 7f3e66664740 1 -- 172.21.15.37:0/4156717876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e5000fb70 con 0x56012e20c3e0 2024-08-20T05:11:55.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.822+0000 7f3e42a00640 1 -- 172.21.15.37:0/4156717876 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f3e4801c040 con 0x56012e20c3e0 2024-08-20T05:11:55.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.822+0000 7f3e66664740 10 client.27940 fetch_fsmap learned FSMap version 43 2024-08-20T05:11:55.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.822+0000 7f3e66664740 1 -- 172.21.15.37:0/4156717876 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56012e22f0d0 con 0x56012e20c3e0 2024-08-20T05:11:55.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.822+0000 7f3e42a00640 1 -- 172.21.15.37:0/4156717876 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e5000fb70 con 0x56012e20c3e0 2024-08-20T05:11:55.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.822+0000 7f3e42a00640 1 -- 172.21.15.37:0/4156717876 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f3e480b3750 con 0x56012e20c3e0 2024-08-20T05:11:55.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.822+0000 7f3e66664740 10 client.27940 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:11:55.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.822+0000 7f3e66664740 10 client.27940 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:11:55.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.822+0000 7f3e66664740 20 client.27940 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:55.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.823+0000 7f3e66664740 1 --2- 172.21.15.37:0/4156717876 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x56012e230580 0x56012e232970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.823+0000 7f3e66664740 4 client.27940 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:55.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.823+0000 7f3e66664740 1 -- 172.21.15.37:0/4156717876 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56012e1839f0 con 0x56012e230580 2024-08-20T05:11:55.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.823+0000 7f3e61000640 1 --2- 172.21.15.37:0/4156717876 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x56012e230580 0x56012e232970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.823+0000 7f3e61000640 1 --2- 172.21.15.37:0/4156717876 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x56012e230580 0x56012e232970 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ace84b4ed9b1f063 server_cookie=d40f48411e68967 in_seq=0 out_seq=0 2024-08-20T05:11:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.823+0000 7f3e42a00640 10 client.27940 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:11:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.824+0000 7f3e42a00640 1 -- 172.21.15.37:0/4156717876 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56012e1839f0 con 0x56012e230580 2024-08-20T05:11:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.824+0000 7f3e42a00640 10 client.27940 handle_command_reply: tid=0 2024-08-20T05:11:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.824+0000 7f3e66664740 1 client.27940 shutdown 2024-08-20T05:11:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.824+0000 7f3e66664740 1 -- 172.21.15.37:0/4156717876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20c3e0 msgr2=0x56012e215040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.824+0000 7f3e66664740 1 --2- 172.21.15.37:0/4156717876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20c3e0 0x56012e215040 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800e9c0 tx=0x7f3e480aa700 comp rx=0 tx=0).stop 2024-08-20T05:11:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.825+0000 7f3e66664740 1 -- 172.21.15.37:0/4156717876 shutdown_connections 2024-08-20T05:11:55.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.825+0000 7f3e66664740 1 --2- 172.21.15.37:0/4156717876 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x56012e230580 0x56012e232970 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.825+0000 7f3e66664740 1 --2- 172.21.15.37:0/4156717876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e218370 0x56012e2155e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.825+0000 7f3e66664740 1 --2- 172.21.15.37:0/4156717876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20c3e0 0x56012e215040 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.825+0000 7f3e42a00640 0 client.27940 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:11:55.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.825+0000 7f3e66664740 1 --2- 172.21.15.37:0/4156717876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e20bac0 0x56012e217bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.825+0000 7f3e66664740 1 -- 172.21.15.37:0/4156717876 >> 172.21.15.37:0/4156717876 conn(0x56012e2098f0 msgr2=0x56012e20f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:55.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.825+0000 7f3e66664740 1 -- 172.21.15.37:0/4156717876 shutdown_connections 2024-08-20T05:11:55.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.825+0000 7f3e66664740 1 -- 172.21.15.37:0/4156717876 wait complete. 2024-08-20T05:11:55.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.825+0000 7f3e66664740 20 client.27940 trim_cache size 0 max 16384 2024-08-20T05:11:55.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.839+0000 7f3e66664740 1 Processor -- start 2024-08-20T05:11:55.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.839+0000 7f3e66664740 1 -- start start 2024-08-20T05:11:55.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.840+0000 7f3e66664740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e20bac0 0x56012e22c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.840+0000 7f3e66664740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e20c3e0 0x56012e238200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.840+0000 7f3e66664740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e218370 0x56012e238740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.840+0000 7f3e66664740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c1ad350 con 0x56012e20bac0 2024-08-20T05:11:55.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.840+0000 7f3e66664740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c1aef20 con 0x56012e20c3e0 2024-08-20T05:11:55.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.840+0000 7f3e66664740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c1ada20 con 0x56012e218370 2024-08-20T05:11:55.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.840+0000 7f3e61000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e20bac0 0x56012e22c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:55.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.840+0000 7f3e61000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e20bac0 0x56012e22c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43320/0 (socket says 172.21.15.37:43320) 2024-08-20T05:11:55.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.840+0000 7f3e61000640 1 -- 172.21.15.37:0/1887958151 learned_addr learned my addr 172.21.15.37:0/1887958151 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:55.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.840+0000 7f3e61a00640 1 --2- 172.21.15.37:0/1887958151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e218370 0x56012e238740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:55.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.840+0000 7f3e5be00640 1 --2- 172.21.15.37:0/1887958151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e20c3e0 0x56012e238200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:55.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.840+0000 7f3e61000640 1 -- 172.21.15.37:0/1887958151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e218370 msgr2=0x56012e238740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:55.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.840+0000 7f3e61000640 1 --2- 172.21.15.37:0/1887958151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e218370 0x56012e238740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.840+0000 7f3e61000640 1 -- 172.21.15.37:0/1887958151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e20c3e0 msgr2=0x56012e238200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:55.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.840+0000 7f3e61000640 1 --2- 172.21.15.37:0/1887958151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e20c3e0 0x56012e238200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.840+0000 7f3e61000640 1 -- 172.21.15.37:0/1887958151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56012e21ab00 con 0x56012e20bac0 2024-08-20T05:11:55.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.841+0000 7f3e61000640 1 --2- 172.21.15.37:0/1887958151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e20bac0 0x56012e22c9a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3e50019560 tx=0x7f3e50020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36d99b8d35b9440 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:55.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.841+0000 7f3e4d600640 1 -- 172.21.15.37:0/1887958151 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e5001e040 con 0x56012e20bac0 2024-08-20T05:11:55.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.841+0000 7f3e4d600640 1 -- 172.21.15.37:0/1887958151 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e5001ae30 con 0x56012e20bac0 2024-08-20T05:11:55.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.841+0000 7f3e4d600640 1 -- 172.21.15.37:0/1887958151 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e50004680 con 0x56012e20bac0 2024-08-20T05:11:55.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.842+0000 7f3e66664740 1 -- 172.21.15.37:0/1887958151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e20bac0 msgr2=0x56012e22c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:55.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.842+0000 7f3e66664740 1 --2- 172.21.15.37:0/1887958151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e20bac0 0x56012e22c9a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3e50019560 tx=0x7f3e50020000 comp rx=0 tx=0).stop 2024-08-20T05:11:55.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.842+0000 7f3e66664740 1 -- 172.21.15.37:0/1887958151 shutdown_connections 2024-08-20T05:11:55.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.842+0000 7f3e66664740 1 --2- 172.21.15.37:0/1887958151 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e218370 0x56012e238740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.842+0000 7f3e66664740 1 --2- 172.21.15.37:0/1887958151 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e20c3e0 0x56012e238200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.842+0000 7f3e66664740 1 --2- 172.21.15.37:0/1887958151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e20bac0 0x56012e22c9a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.842+0000 7f3e66664740 1 -- 172.21.15.37:0/1887958151 >> 172.21.15.37:0/1887958151 conn(0x56012e2098f0 msgr2=0x56012e216e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:55.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.842+0000 7f3e66664740 1 -- 172.21.15.37:0/1887958151 shutdown_connections 2024-08-20T05:11:55.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.842+0000 7f3e66664740 1 -- 172.21.15.37:0/1887958151 wait complete. 2024-08-20T05:11:55.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.842+0000 7f3e66664740 1 -- start start 2024-08-20T05:11:55.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.842+0000 7f3e66664740 1 Processor -- start 2024-08-20T05:11:55.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.843+0000 7f3e66664740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20bac0 0x56012e2293b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.843+0000 7f3e66664740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e20c3e0 0x56012e212000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.843+0000 7f3e66664740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e218370 0x56012e212740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.843+0000 7f3e66664740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c1ae820 con 0x56012e218370 2024-08-20T05:11:55.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.843+0000 7f3e66664740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c1ae0f0 con 0x56012e20c3e0 2024-08-20T05:11:55.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.843+0000 7f3e66664740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c1ab330 con 0x56012e20bac0 2024-08-20T05:11:55.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.843+0000 7f3e66664740 10 client.0 _ll_register_callbacks cb 0x7f3e480046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:55.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.843+0000 7f3e61a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e218370 0x56012e212740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:55.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.843+0000 7f3e61000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20bac0 0x56012e2293b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:55.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.843+0000 7f3e5be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e20c3e0 0x56012e212000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:55.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.843+0000 7f3e61000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20bac0 0x56012e2293b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36728/0 (socket says 172.21.15.37:36728) 2024-08-20T05:11:55.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.843+0000 7f3e61000640 1 -- 172.21.15.37:0/904178601 learned_addr learned my addr 172.21.15.37:0/904178601 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:55.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.844+0000 7f3e61000640 1 -- 172.21.15.37:0/904178601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e20c3e0 msgr2=0x56012e212000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:55.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.844+0000 7f3e61000640 1 --2- 172.21.15.37:0/904178601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e20c3e0 0x56012e212000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.844+0000 7f3e61000640 1 -- 172.21.15.37:0/904178601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e218370 msgr2=0x56012e212740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:55.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.844+0000 7f3e61000640 1 --2- 172.21.15.37:0/904178601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e218370 0x56012e212740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.844+0000 7f3e61000640 1 -- 172.21.15.37:0/904178601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56012e29a1d0 con 0x56012e20bac0 2024-08-20T05:11:55.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.844+0000 7f3e61000640 1 --2- 172.21.15.37:0/904178601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20bac0 0x56012e2293b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000f6e0 tx=0x7f3e50019820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f680cf9f2b7e7198 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:55.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.844+0000 7f3e42a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:11:55.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.844+0000 7f3e42a00640 1 -- 172.21.15.37:0/904178601 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e50040070 con 0x56012e20bac0 2024-08-20T05:11:55.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.844+0000 7f3e66664740 1 -- 172.21.15.37:0/904178601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e5001ae30 con 0x56012e20bac0 2024-08-20T05:11:55.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.844+0000 7f3e42a00640 1 -- 172.21.15.37:0/904178601 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3e50005040 con 0x56012e20bac0 2024-08-20T05:11:55.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.845+0000 7f3e42a00640 1 -- 172.21.15.37:0/904178601 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f3e5004f050 con 0x56012e20bac0 2024-08-20T05:11:55.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.845+0000 7f3e66664740 10 client.27946 fetch_fsmap learned FSMap version 43 2024-08-20T05:11:55.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.845+0000 7f3e66664740 1 -- 172.21.15.37:0/904178601 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56012e29b430 con 0x56012e20bac0 2024-08-20T05:11:55.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.845+0000 7f3e42a00640 1 -- 172.21.15.37:0/904178601 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e5001ae30 con 0x56012e20bac0 2024-08-20T05:11:55.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.845+0000 7f3e42a00640 1 -- 172.21.15.37:0/904178601 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f3e50021030 con 0x56012e20bac0 2024-08-20T05:11:55.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.845+0000 7f3e66664740 10 client.27946 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:11:55.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.845+0000 7f3e66664740 10 client.27946 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:11:55.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.845+0000 7f3e66664740 20 client.27946 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:55.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.845+0000 7f3e66664740 1 --2- 172.21.15.37:0/904178601 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x56012e29b960 0x56012e29dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:55.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.845+0000 7f3e66664740 4 client.27946 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:11:55.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.845+0000 7f3e66664740 1 -- 172.21.15.37:0/904178601 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56012e17f490 con 0x56012e29b960 2024-08-20T05:11:55.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.846+0000 7f3e5be00640 1 --2- 172.21.15.37:0/904178601 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x56012e29b960 0x56012e29dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:55.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.846+0000 7f3e5be00640 1 --2- 172.21.15.37:0/904178601 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x56012e29b960 0x56012e29dd80 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f7129cbdf19ca76 server_cookie=a51386723573e978 in_seq=0 out_seq=0 2024-08-20T05:11:55.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.846+0000 7f3e42a00640 10 client.27946 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:11:55.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.846+0000 7f3e42a00640 1 -- 172.21.15.37:0/904178601 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56012e17f490 con 0x56012e29b960 2024-08-20T05:11:55.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.846+0000 7f3e42a00640 10 client.27946 handle_command_reply: tid=0 2024-08-20T05:11:55.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.846+0000 7f3e66664740 1 client.27946 shutdown 2024-08-20T05:11:55.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.847+0000 7f3e66664740 1 -- 172.21.15.37:0/904178601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20bac0 msgr2=0x56012e2293b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:55.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.847+0000 7f3e66664740 1 --2- 172.21.15.37:0/904178601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20bac0 0x56012e2293b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3e5000f6e0 tx=0x7f3e50019820 comp rx=0 tx=0).stop 2024-08-20T05:11:55.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.847+0000 7f3e66664740 1 -- 172.21.15.37:0/904178601 shutdown_connections 2024-08-20T05:11:55.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.847+0000 7f3e66664740 1 --2- 172.21.15.37:0/904178601 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x56012e29b960 0x56012e29dd80 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.847+0000 7f3e66664740 1 --2- 172.21.15.37:0/904178601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56012e218370 0x56012e212740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.847+0000 7f3e66664740 1 --2- 172.21.15.37:0/904178601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56012e20c3e0 0x56012e212000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.847+0000 7f3e66664740 1 --2- 172.21.15.37:0/904178601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56012e20bac0 0x56012e2293b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.847+0000 7f3e42a00640 0 client.27946 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:11:55.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.847+0000 7f3e66664740 1 -- 172.21.15.37:0/904178601 >> 172.21.15.37:0/904178601 conn(0x56012e2098f0 msgr2=0x56012e20eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:55.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.847+0000 7f3e66664740 1 -- 172.21.15.37:0/904178601 shutdown_connections 2024-08-20T05:11:55.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.847+0000 7f3e66664740 1 -- 172.21.15.37:0/904178601 wait complete. 2024-08-20T05:11:55.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.847+0000 7f3e66664740 20 client.27946 trim_cache size 0 max 16384 2024-08-20T05:11:55.853 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:11:55.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.848+0000 7f3e62400640 1 -- 172.21.15.37:0/3235869131 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3e440b3c70 msgr2=0x7f3e440b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:55.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.848+0000 7f3e62400640 1 --2- 172.21.15.37:0/3235869131 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3e440b3c70 0x7f3e440b6130 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3e500196d0 tx=0x7f3e50019730 comp rx=0 tx=0).stop 2024-08-20T05:11:55.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.848+0000 7f3e62400640 1 -- 172.21.15.37:0/3235869131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e5c10a520 msgr2=0x7f3e5c19b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:55.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.848+0000 7f3e62400640 1 --2- 172.21.15.37:0/3235869131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e5c10a520 0x7f3e5c19b440 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3e4800e9f0 tx=0x7f3e4800eeb0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.848+0000 7f3e62400640 1 -- 172.21.15.37:0/3235869131 shutdown_connections 2024-08-20T05:11:55.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.848+0000 7f3e62400640 1 --2- 172.21.15.37:0/3235869131 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3e440b3c70 0x7f3e440b6130 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.848+0000 7f3e62400640 1 --2- 172.21.15.37:0/3235869131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3e5c10aea0 0x7f3e5c1a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.848+0000 7f3e62400640 1 --2- 172.21.15.37:0/3235869131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3e5c10a520 0x7f3e5c19b440 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.848+0000 7f3e62400640 1 --2- 172.21.15.37:0/3235869131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e5c104b10 0x7f3e5c19af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:55.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.848+0000 7f3e62400640 1 -- 172.21.15.37:0/3235869131 >> 172.21.15.37:0/3235869131 conn(0x7f3e5c100540 msgr2=0x7f3e5c108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:55.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.848+0000 7f3e62400640 1 -- 172.21.15.37:0/3235869131 shutdown_connections 2024-08-20T05:11:55.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:55.848+0000 7f3e62400640 1 -- 172.21.15.37:0/3235869131 wait complete. 2024-08-20T05:11:55.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:55 smithi135 ceph-mon[22342]: pgmap v691: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 349 KiB/s wr, 50 op/s 2024-08-20T05:11:55.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:55 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3050563629' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:11:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:55 smithi130 ceph-mon[22007]: pgmap v691: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 349 KiB/s wr, 50 op/s 2024-08-20T05:11:55.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:55 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3050563629' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:11:56.813 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id d7ad4f9c --release --await' 2024-08-20T05:11:56.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id d7ad4f9c --release --await 2024-08-20T05:11:57.562 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T05:11:57.746 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:57.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:57 smithi037 ceph-mon[17265]: pgmap v692: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 829 KiB/s wr, 105 op/s 2024-08-20T05:11:57.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:57 smithi135 ceph-mon[22342]: pgmap v692: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 829 KiB/s wr, 105 op/s 2024-08-20T05:11:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:57 smithi130 ceph-mon[22007]: pgmap v692: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 829 KiB/s wr, 105 op/s 2024-08-20T05:11:58.045 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 540.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:11:58.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.364+0000 7f060fe00640 1 -- 172.21.15.37:0/19632440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f060810f0d0 msgr2=0x7f06081114c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:58.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.364+0000 7f060fe00640 1 --2- 172.21.15.37:0/19632440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f060810f0d0 0x7f06081114c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0600009ca0 tx=0x7f060002a8c0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.365+0000 7f060fe00640 1 -- 172.21.15.37:0/19632440 shutdown_connections 2024-08-20T05:11:58.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.365+0000 7f060fe00640 1 --2- 172.21.15.37:0/19632440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f060810f0d0 0x7f06081114c0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.365+0000 7f060fe00640 1 --2- 172.21.15.37:0/19632440 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0608075c70 0x7f060810eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.365+0000 7f060fe00640 1 --2- 172.21.15.37:0/19632440 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0608075270 0x7f0608075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.365+0000 7f060fe00640 1 -- 172.21.15.37:0/19632440 >> 172.21.15.37:0/19632440 conn(0x7f06080fe500 msgr2=0x7f0608100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:58.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.365+0000 7f060fe00640 1 -- 172.21.15.37:0/19632440 shutdown_connections 2024-08-20T05:11:58.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.365+0000 7f060fe00640 1 -- 172.21.15.37:0/19632440 wait complete. 2024-08-20T05:11:58.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.366+0000 7f060fe00640 1 Processor -- start 2024-08-20T05:11:58.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.366+0000 7f060fe00640 1 -- start start 2024-08-20T05:11:58.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.366+0000 7f060fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0608075270 0x7f060819b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.366+0000 7f060fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0608075c70 0x7f060819b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.366+0000 7f060fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f060810f0d0 0x7f06081a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.366+0000 7f060fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0608114cd0 con 0x7f0608075c70 2024-08-20T05:11:58.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.366+0000 7f060fe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0608114b50 con 0x7f0608075270 2024-08-20T05:11:58.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.366+0000 7f060fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0608114e50 con 0x7f060810f0d0 2024-08-20T05:11:58.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.367+0000 7f060d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0608075270 0x7f060819b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:58.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.367+0000 7f060ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0608075c70 0x7f060819b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:58.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.367+0000 7f060d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0608075270 0x7f060819b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:55866/0 (socket says 172.21.15.37:55866) 2024-08-20T05:11:58.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.367+0000 7f060d400640 1 -- 172.21.15.37:0/2949886733 learned_addr learned my addr 172.21.15.37:0/2949886733 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:58.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.367+0000 7f060de00640 1 --2- 172.21.15.37:0/2949886733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f060810f0d0 0x7f06081a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:58.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.367+0000 7f060d400640 1 -- 172.21.15.37:0/2949886733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f060810f0d0 msgr2=0x7f06081a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:58.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.367+0000 7f060d400640 1 --2- 172.21.15.37:0/2949886733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f060810f0d0 0x7f06081a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.367+0000 7f060d400640 1 -- 172.21.15.37:0/2949886733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0608075c70 msgr2=0x7f060819b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.367+0000 7f060d400640 1 --2- 172.21.15.37:0/2949886733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0608075c70 0x7f060819b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.367+0000 7f060d400640 1 -- 172.21.15.37:0/2949886733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06081a12b0 con 0x7f0608075270 2024-08-20T05:11:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.368+0000 7f060d400640 1 --2- 172.21.15.37:0/2949886733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0608075270 0x7f060819b200 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00e9f0 tx=0x7f05fc00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.368+0000 7f0606000640 1 -- 172.21.15.37:0/2949886733 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc00cd80 con 0x7f0608075270 2024-08-20T05:11:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.368+0000 7f060fe00640 1 -- 172.21.15.37:0/2949886733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06081a15a0 con 0x7f0608075270 2024-08-20T05:11:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.368+0000 7f0606000640 1 -- 172.21.15.37:0/2949886733 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05fc0108e0 con 0x7f0608075270 2024-08-20T05:11:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.368+0000 7f0606000640 1 -- 172.21.15.37:0/2949886733 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc018980 con 0x7f0608075270 2024-08-20T05:11:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.368+0000 7f060fe00640 1 -- 172.21.15.37:0/2949886733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06081a7e30 con 0x7f0608075270 2024-08-20T05:11:58.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.371+0000 7f06128b8740 1 Processor -- start 2024-08-20T05:11:58.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.371+0000 7f06128b8740 1 -- start start 2024-08-20T05:11:58.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.371+0000 7f06128b8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d547cf0 0x55730d5480d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.371+0000 7f06128b8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d548610 0x55730d554060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.371+0000 7f06128b8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d5545a0 0x55730d556990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.372+0000 7f06128b8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55730d4e9670 con 0x55730d5545a0 2024-08-20T05:11:58.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.372+0000 7f06128b8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55730d4bdd70 con 0x55730d548610 2024-08-20T05:11:58.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.372+0000 7f06128b8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55730d4ad270 con 0x55730d547cf0 2024-08-20T05:11:58.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.372+0000 7f060ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d5545a0 0x55730d556990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.372+0000 7f060de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d547cf0 0x55730d5480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.372+0000 7f060ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d5545a0 0x55730d556990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43366/0 (socket says 172.21.15.37:43366) 2024-08-20T05:11:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.372+0000 7f060ca00640 1 -- 172.21.15.37:0/1921089547 learned_addr learned my addr 172.21.15.37:0/1921089547 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.372+0000 7f060de00640 1 -- 172.21.15.37:0/1921089547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d548610 msgr2=0x55730d554060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:11:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.372+0000 7f060de00640 1 --2- 172.21.15.37:0/1921089547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d548610 0x55730d554060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.372+0000 7f060de00640 1 -- 172.21.15.37:0/1921089547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d5545a0 msgr2=0x55730d556990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.372+0000 7f060de00640 1 --2- 172.21.15.37:0/1921089547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d5545a0 0x55730d556990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.372+0000 7f060de00640 1 -- 172.21.15.37:0/1921089547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55730d449870 con 0x55730d547cf0 2024-08-20T05:11:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.373+0000 7f060de00640 1 --2- 172.21.15.37:0/1921089547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d547cf0 0x55730d5480d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f060002ade0 tx=0x7f0600009870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a80fbc5d21f2c376 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:58.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.373+0000 7f05fa600640 1 -- 172.21.15.37:0/1921089547 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0600031cf0 con 0x55730d547cf0 2024-08-20T05:11:58.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.373+0000 7f05fa600640 1 -- 172.21.15.37:0/1921089547 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0600036040 con 0x55730d547cf0 2024-08-20T05:11:58.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.373+0000 7f05fa600640 1 -- 172.21.15.37:0/1921089547 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06000042a0 con 0x55730d547cf0 2024-08-20T05:11:58.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.374+0000 7f0606000640 1 -- 172.21.15.37:0/2949886733 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f05fc010430 con 0x7f0608075270 2024-08-20T05:11:58.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.374+0000 7f06128b8740 1 -- 172.21.15.37:0/1921089547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d547cf0 msgr2=0x55730d5480d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:58.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.374+0000 7f06128b8740 1 --2- 172.21.15.37:0/1921089547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d547cf0 0x55730d5480d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f060002ade0 tx=0x7f0600009870 comp rx=0 tx=0).stop 2024-08-20T05:11:58.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.374+0000 7f06128b8740 1 -- 172.21.15.37:0/1921089547 shutdown_connections 2024-08-20T05:11:58.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.374+0000 7f06128b8740 1 --2- 172.21.15.37:0/1921089547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d5545a0 0x55730d556990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.374+0000 7f06128b8740 1 --2- 172.21.15.37:0/1921089547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d548610 0x55730d554060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.374+0000 7f06128b8740 1 --2- 172.21.15.37:0/1921089547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d547cf0 0x55730d5480d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.374+0000 7f06128b8740 1 -- 172.21.15.37:0/1921089547 >> 172.21.15.37:0/1921089547 conn(0x55730d545b20 msgr2=0x55730d546cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:58.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.374+0000 7f06128b8740 1 -- 172.21.15.37:0/1921089547 shutdown_connections 2024-08-20T05:11:58.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.374+0000 7f06128b8740 1 -- 172.21.15.37:0/1921089547 wait complete. 2024-08-20T05:11:58.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.375+0000 7f06128b8740 1 -- start start 2024-08-20T05:11:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.375+0000 7f06128b8740 1 Processor -- start 2024-08-20T05:11:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.376+0000 7f0606000640 1 --2- 172.21.15.37:0/2949886733 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f05f00b3ae0 0x7f05f00b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.376+0000 7f06128b8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d547cf0 0x55730d553da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.376+0000 7f06128b8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d548610 0x55730d5511f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.376+0000 7f06128b8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d5545a0 0x55730d551730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.376+0000 7f06128b8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55730d433ff0 con 0x55730d547cf0 2024-08-20T05:11:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.376+0000 7f06128b8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55730d4b12b0 con 0x55730d5545a0 2024-08-20T05:11:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.376+0000 7f06128b8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55730d30fbb0 con 0x55730d548610 2024-08-20T05:11:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.376+0000 7f0606000640 1 -- 172.21.15.37:0/2949886733 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f05fc0e43b0 con 0x7f0608075270 2024-08-20T05:11:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.376+0000 7f06128b8740 10 client.0 _ll_register_callbacks cb 0x55730d1b8d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.376+0000 7f060de00640 1 --2- 172.21.15.37:0/2949886733 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f05f00b3ae0 0x7f05f00b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.376+0000 7f060d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d547cf0 0x55730d553da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.376+0000 7f060d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d547cf0 0x55730d553da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43368/0 (socket says 172.21.15.37:43368) 2024-08-20T05:11:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.376+0000 7f060d400640 1 -- 172.21.15.37:0/3849075820 learned_addr learned my addr 172.21.15.37:0/3849075820 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.376+0000 7f060de00640 1 --2- 172.21.15.37:0/3849075820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d5545a0 0x55730d551730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.376+0000 7f060ca00640 1 --2- 172.21.15.37:0/3849075820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d548610 0x55730d5511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.377+0000 7f060ca00640 1 -- 172.21.15.37:0/3849075820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d5545a0 msgr2=0x55730d551730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.377+0000 7f060ca00640 1 --2- 172.21.15.37:0/3849075820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d5545a0 0x55730d551730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.377+0000 7f060ca00640 1 -- 172.21.15.37:0/3849075820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d547cf0 msgr2=0x55730d553da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.377+0000 7f060ca00640 1 --2- 172.21.15.37:0/3849075820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d547cf0 0x55730d553da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.377+0000 7f060ca00640 1 -- 172.21.15.37:0/3849075820 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55730d20cb00 con 0x55730d548610 2024-08-20T05:11:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.377+0000 7f060de00640 1 --2- 172.21.15.37:0/2949886733 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f05f00b3ae0 0x7f05f00b5fa0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0600009600 tx=0x7f0600003d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.377+0000 7f060ca00640 1 --2- 172.21.15.37:0/3849075820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d548610 0x55730d5511f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f05f40126d0 tx=0x7f05f4012b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=922baa0518a215ec server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:58.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.377+0000 7f05eea00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:11:58.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.377+0000 7f05eea00640 1 -- 172.21.15.37:0/3849075820 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f400f920 con 0x55730d548610 2024-08-20T05:11:58.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.377+0000 7f05eea00640 1 -- 172.21.15.37:0/3849075820 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f05f400fac0 con 0x55730d548610 2024-08-20T05:11:58.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.377+0000 7f06128b8740 1 -- 172.21.15.37:0/3849075820 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0600036040 con 0x55730d548610 2024-08-20T05:11:58.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.378+0000 7f05eea00640 1 -- 172.21.15.37:0/3849075820 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f05f4025050 con 0x55730d548610 2024-08-20T05:11:58.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.378+0000 7f06128b8740 10 client.27958 fetch_fsmap learned FSMap version 43 2024-08-20T05:11:58.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.378+0000 7f06128b8740 1 -- 172.21.15.37:0/3849075820 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55730d283960 con 0x55730d548610 2024-08-20T05:11:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.378+0000 7f05eea00640 1 -- 172.21.15.37:0/3849075820 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0600036040 con 0x55730d548610 2024-08-20T05:11:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.378+0000 7f05eea00640 1 -- 172.21.15.37:0/3849075820 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f05f4010430 con 0x55730d548610 2024-08-20T05:11:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.378+0000 7f06128b8740 10 client.27958 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:11:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.378+0000 7f06128b8740 10 client.27958 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:11:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.379+0000 7f06128b8740 20 client.27958 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.379+0000 7f06128b8740 1 --2- 172.21.15.37:0/3849075820 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55730d56c410 0x55730d56e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.379+0000 7f06128b8740 4 client.27958 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.379+0000 7f06128b8740 1 -- 172.21.15.37:0/3849075820 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55730d4bfcc0 con 0x55730d56c410 2024-08-20T05:11:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.379+0000 7f060d400640 1 --2- 172.21.15.37:0/3849075820 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55730d56c410 0x55730d56e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.379+0000 7f060d400640 1 --2- 172.21.15.37:0/3849075820 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55730d56c410 0x55730d56e800 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1b2f0f1cf07ed5c server_cookie=2e653168b1897498 in_seq=0 out_seq=0 2024-08-20T05:11:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.379+0000 7f05eea00640 10 client.27958 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.380+0000 7f05eea00640 1 -- 172.21.15.37:0/3849075820 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55730d4bfcc0 con 0x55730d56c410 2024-08-20T05:11:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.380+0000 7f05eea00640 10 client.27958 handle_command_reply: tid=0 2024-08-20T05:11:58.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.380+0000 7f06128b8740 1 client.27958 shutdown 2024-08-20T05:11:58.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.381+0000 7f06128b8740 1 -- 172.21.15.37:0/3849075820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d548610 msgr2=0x55730d5511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:58.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.381+0000 7f06128b8740 1 --2- 172.21.15.37:0/3849075820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d548610 0x55730d5511f0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f05f40126d0 tx=0x7f05f4012b90 comp rx=0 tx=0).stop 2024-08-20T05:11:58.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.381+0000 7f06128b8740 1 -- 172.21.15.37:0/3849075820 shutdown_connections 2024-08-20T05:11:58.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.381+0000 7f06128b8740 1 --2- 172.21.15.37:0/3849075820 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55730d56c410 0x55730d56e800 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.381+0000 7f06128b8740 1 --2- 172.21.15.37:0/3849075820 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d5545a0 0x55730d551730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.381+0000 7f06128b8740 1 --2- 172.21.15.37:0/3849075820 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d548610 0x55730d5511f0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.381+0000 7f06128b8740 1 --2- 172.21.15.37:0/3849075820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d547cf0 0x55730d553da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.381+0000 7f05eea00640 0 client.27958 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:58.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.381+0000 7f06128b8740 1 -- 172.21.15.37:0/3849075820 >> 172.21.15.37:0/3849075820 conn(0x55730d545b20 msgr2=0x55730d54b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:58.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.381+0000 7f06128b8740 1 -- 172.21.15.37:0/3849075820 shutdown_connections 2024-08-20T05:11:58.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.381+0000 7f06128b8740 1 -- 172.21.15.37:0/3849075820 wait complete. 2024-08-20T05:11:58.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.381+0000 7f06128b8740 20 client.27958 trim_cache size 0 max 16384 2024-08-20T05:11:58.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.400+0000 7f06128b8740 1 Processor -- start 2024-08-20T05:11:58.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.400+0000 7f06128b8740 1 -- start start 2024-08-20T05:11:58.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.400+0000 7f06128b8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d547cf0 0x55730d544b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.400+0000 7f06128b8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d548610 0x55730d5740a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.400+0000 7f06128b8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d5545a0 0x55730d5745e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.400+0000 7f06128b8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f06081ad720 con 0x55730d548610 2024-08-20T05:11:58.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.400+0000 7f06128b8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f06081af2f0 con 0x55730d5545a0 2024-08-20T05:11:58.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.400+0000 7f06128b8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06081addf0 con 0x55730d547cf0 2024-08-20T05:11:58.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.400+0000 7f060d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d547cf0 0x55730d544b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.400+0000 7f060ca00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d548610 0x55730d5740a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.400+0000 7f060d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d547cf0 0x55730d544b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36772/0 (socket says 172.21.15.37:36772) 2024-08-20T05:11:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.400+0000 7f060d400640 1 -- 172.21.15.37:0/3844278955 learned_addr learned my addr 172.21.15.37:0/3844278955 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.401+0000 7f060de00640 1 --2- 172.21.15.37:0/3844278955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d5545a0 0x55730d5745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.401+0000 7f060ca00640 1 -- 172.21.15.37:0/3844278955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d547cf0 msgr2=0x55730d544b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.401+0000 7f060ca00640 1 --2- 172.21.15.37:0/3844278955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d547cf0 0x55730d544b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.401+0000 7f060ca00640 1 -- 172.21.15.37:0/3844278955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d5545a0 msgr2=0x55730d5745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.401+0000 7f060ca00640 1 --2- 172.21.15.37:0/3844278955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d5545a0 0x55730d5745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.401+0000 7f060ca00640 1 -- 172.21.15.37:0/3844278955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55730d550150 con 0x55730d548610 2024-08-20T05:11:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.401+0000 7f060d400640 1 --2- 172.21.15.37:0/3844278955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d547cf0 0x55730d544b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.401+0000 7f060ca00640 1 --2- 172.21.15.37:0/3844278955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d548610 0x55730d5740a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f05f4000c00 tx=0x7f05f400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682264b1b379a2de server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:58.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.402+0000 7f05f9c00640 1 -- 172.21.15.37:0/3844278955 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f4005d30 con 0x55730d548610 2024-08-20T05:11:58.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.402+0000 7f05f9c00640 1 -- 172.21.15.37:0/3844278955 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05f400fdd0 con 0x55730d548610 2024-08-20T05:11:58.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.402+0000 7f05f9c00640 1 -- 172.21.15.37:0/3844278955 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f40051e0 con 0x55730d548610 2024-08-20T05:11:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.402+0000 7f06128b8740 1 -- 172.21.15.37:0/3844278955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d548610 msgr2=0x55730d5740a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.402+0000 7f06128b8740 1 --2- 172.21.15.37:0/3844278955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d548610 0x55730d5740a0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f05f4000c00 tx=0x7f05f400f790 comp rx=0 tx=0).stop 2024-08-20T05:11:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.402+0000 7f06128b8740 1 -- 172.21.15.37:0/3844278955 shutdown_connections 2024-08-20T05:11:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.402+0000 7f06128b8740 1 --2- 172.21.15.37:0/3844278955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d5545a0 0x55730d5745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.402+0000 7f06128b8740 1 --2- 172.21.15.37:0/3844278955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d548610 0x55730d5740a0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.402+0000 7f06128b8740 1 --2- 172.21.15.37:0/3844278955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d547cf0 0x55730d544b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.402+0000 7f06128b8740 1 -- 172.21.15.37:0/3844278955 >> 172.21.15.37:0/3844278955 conn(0x55730d545b20 msgr2=0x55730d544420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.403+0000 7f06128b8740 1 -- 172.21.15.37:0/3844278955 shutdown_connections 2024-08-20T05:11:58.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.403+0000 7f06128b8740 1 -- 172.21.15.37:0/3844278955 wait complete. 2024-08-20T05:11:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.403+0000 7f06128b8740 1 -- start start 2024-08-20T05:11:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.403+0000 7f06128b8740 1 Processor -- start 2024-08-20T05:11:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.404+0000 7f06128b8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d547cf0 0x55730d564d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.404+0000 7f06128b8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d548610 0x55730d5652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.404+0000 7f06128b8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d5545a0 0x55730d561ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.404+0000 7f06128b8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f06081aebf0 con 0x55730d548610 2024-08-20T05:11:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.404+0000 7f06128b8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f06081ae4c0 con 0x55730d547cf0 2024-08-20T05:11:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.404+0000 7f06128b8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f06081ab740 con 0x55730d5545a0 2024-08-20T05:11:58.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.404+0000 7f06128b8740 10 client.0 _ll_register_callbacks cb 0x7f05f4009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:58.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.404+0000 7f060d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d547cf0 0x55730d564d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:58.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.404+0000 7f060d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d547cf0 0x55730d564d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:55886/0 (socket says 172.21.15.37:55886) 2024-08-20T05:11:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.404+0000 7f060d400640 1 -- 172.21.15.37:0/3363006317 learned_addr learned my addr 172.21.15.37:0/3363006317 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.404+0000 7f060ca00640 1 --2- 172.21.15.37:0/3363006317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d548610 0x55730d5652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.404+0000 7f060de00640 1 --2- 172.21.15.37:0/3363006317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d5545a0 0x55730d561ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.405+0000 7f060d400640 1 -- 172.21.15.37:0/3363006317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d5545a0 msgr2=0x55730d561ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.405+0000 7f060d400640 1 --2- 172.21.15.37:0/3363006317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d5545a0 0x55730d561ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.405+0000 7f060d400640 1 -- 172.21.15.37:0/3363006317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d548610 msgr2=0x55730d5652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.405+0000 7f060d400640 1 --2- 172.21.15.37:0/3363006317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d548610 0x55730d5652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.405+0000 7f060d400640 1 -- 172.21.15.37:0/3363006317 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55730d5623d0 con 0x55730d547cf0 2024-08-20T05:11:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.405+0000 7f060de00640 1 --2- 172.21.15.37:0/3363006317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d5545a0 0x55730d561ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:11:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.405+0000 7f060ca00640 1 --2- 172.21.15.37:0/3363006317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d548610 0x55730d5652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:11:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.405+0000 7f060d400640 1 --2- 172.21.15.37:0/3363006317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d547cf0 0x55730d564d70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0a8170 tx=0x7f05fc0aab50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbf21209533774ef server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.405+0000 7f05eea00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:11:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.405+0000 7f05eea00640 1 -- 172.21.15.37:0/3363006317 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc0af500 con 0x55730d547cf0 2024-08-20T05:11:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.405+0000 7f05eea00640 1 -- 172.21.15.37:0/3363006317 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f05fc0e4150 con 0x55730d547cf0 2024-08-20T05:11:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.405+0000 7f06128b8740 1 -- 172.21.15.37:0/3363006317 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05f400fdd0 con 0x55730d547cf0 2024-08-20T05:11:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.405+0000 7f05eea00640 1 -- 172.21.15.37:0/3363006317 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f05fc0c0330 con 0x55730d547cf0 2024-08-20T05:11:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.405+0000 7f06128b8740 10 client.27968 fetch_fsmap learned FSMap version 43 2024-08-20T05:11:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.405+0000 7f06128b8740 1 -- 172.21.15.37:0/3363006317 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55730d5d7c20 con 0x55730d547cf0 2024-08-20T05:11:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.406+0000 7f05eea00640 1 -- 172.21.15.37:0/3363006317 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05f400fdd0 con 0x55730d547cf0 2024-08-20T05:11:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.406+0000 7f05eea00640 1 -- 172.21.15.37:0/3363006317 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f05fc018b20 con 0x55730d547cf0 2024-08-20T05:11:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.406+0000 7f06128b8740 10 client.27968 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:11:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.406+0000 7f06128b8740 10 client.27968 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:11:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.406+0000 7f06128b8740 20 client.27968 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.406+0000 7f06128b8740 1 --2- 172.21.15.37:0/3363006317 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55730d5d8320 0x55730d5da740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.406+0000 7f06128b8740 4 client.27968 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d7ad4f9c", "release": true, "await": true}] 2024-08-20T05:11:58.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.406+0000 7f06128b8740 1 -- 172.21.15.37:0/3363006317 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d7ad4f9c", "release": true, "await": true}) -- 0x55730d4bb760 con 0x55730d5d8320 2024-08-20T05:11:58.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.406+0000 7f060ca00640 1 --2- 172.21.15.37:0/3363006317 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55730d5d8320 0x55730d5da740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:58.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.407+0000 7f060ca00640 1 --2- 172.21.15.37:0/3363006317 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55730d5d8320 0x55730d5da740 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c2b85e30a1993d1 server_cookie=1672bccf33c91b29 in_seq=0 out_seq=0 2024-08-20T05:11:58.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.407+0000 7f05eea00640 10 client.27968 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:58.447 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:11:58.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.450+0000 7f05eea00640 1 -- 172.21.15.37:0/3363006317 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55730d4bb760 con 0x55730d5d8320 2024-08-20T05:11:58.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.450+0000 7f05eea00640 10 client.27968 handle_command_reply: tid=0 2024-08-20T05:11:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.451+0000 7f06128b8740 1 client.27968 shutdown 2024-08-20T05:11:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.453+0000 7f06128b8740 1 -- 172.21.15.37:0/3363006317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d547cf0 msgr2=0x55730d564d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.453+0000 7f06128b8740 1 --2- 172.21.15.37:0/3363006317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d547cf0 0x55730d564d70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0a8170 tx=0x7f05fc0aab50 comp rx=0 tx=0).stop 2024-08-20T05:11:58.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.453+0000 7f06128b8740 1 -- 172.21.15.37:0/3363006317 shutdown_connections 2024-08-20T05:11:58.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.453+0000 7f06128b8740 1 --2- 172.21.15.37:0/3363006317 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55730d5d8320 0x55730d5da740 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.453+0000 7f06128b8740 1 --2- 172.21.15.37:0/3363006317 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55730d5545a0 0x55730d561ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.453+0000 7f06128b8740 1 --2- 172.21.15.37:0/3363006317 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55730d548610 0x55730d5652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.453+0000 7f06128b8740 1 --2- 172.21.15.37:0/3363006317 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55730d547cf0 0x55730d564d70 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.453+0000 7f06128b8740 1 -- 172.21.15.37:0/3363006317 >> 172.21.15.37:0/3363006317 conn(0x55730d545b20 msgr2=0x55730d544420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:58.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.453+0000 7f05eea00640 0 client.27968 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:11:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.458+0000 7f06128b8740 1 -- 172.21.15.37:0/3363006317 shutdown_connections 2024-08-20T05:11:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.458+0000 7f06128b8740 1 -- 172.21.15.37:0/3363006317 wait complete. 2024-08-20T05:11:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.458+0000 7f06128b8740 20 client.27968 trim_cache size 0 max 16384 2024-08-20T05:11:58.461 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:11:58.461 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 43, 2024-08-20T05:11:58.461 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:11:58.461 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 40, 2024-08-20T05:11:58.461 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:11:58.461 INFO:teuthology.orchestra.run.smithi037.stdout: "d7ad4f9c": { 2024-08-20T05:11:58.461 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 40, 2024-08-20T05:11:58.462 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:11:58.462 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:11:58.462 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:11:58.462 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:11:58.462 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:11:58.462 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:11:58.462 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 147.8, 2024-08-20T05:11:58.462 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:11:58.462 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:11:58.462 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:11:58.462 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:11:58.462 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:11:58.463 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:11:58.463 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:11:58.463 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:11:58.463 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:11:58.463 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:11:58.463 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:11:58.463 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:11:58.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.460+0000 7f060fe00640 1 -- 172.21.15.37:0/2949886733 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f05f00b3ae0 msgr2=0x7f05f00b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:58.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.460+0000 7f060fe00640 1 --2- 172.21.15.37:0/2949886733 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f05f00b3ae0 0x7f05f00b5fa0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0600009600 tx=0x7f0600003d50 comp rx=0 tx=0).stop 2024-08-20T05:11:58.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.460+0000 7f060fe00640 1 -- 172.21.15.37:0/2949886733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0608075270 msgr2=0x7f060819b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:58.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.460+0000 7f060fe00640 1 --2- 172.21.15.37:0/2949886733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0608075270 0x7f060819b200 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00e9f0 tx=0x7f05fc00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.461+0000 7f060fe00640 1 -- 172.21.15.37:0/2949886733 shutdown_connections 2024-08-20T05:11:58.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.461+0000 7f060fe00640 1 --2- 172.21.15.37:0/2949886733 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f05f00b3ae0 0x7f05f00b5fa0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.461+0000 7f060fe00640 1 --2- 172.21.15.37:0/2949886733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f060810f0d0 0x7f06081a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.461+0000 7f060fe00640 1 --2- 172.21.15.37:0/2949886733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0608075c70 0x7f060819b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.461+0000 7f060fe00640 1 --2- 172.21.15.37:0/2949886733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0608075270 0x7f060819b200 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:58.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.461+0000 7f060fe00640 1 -- 172.21.15.37:0/2949886733 >> 172.21.15.37:0/2949886733 conn(0x7f06080fe500 msgr2=0x7f0608111290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:58.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.461+0000 7f060fe00640 1 -- 172.21.15.37:0/2949886733 shutdown_connections 2024-08-20T05:11:58.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:58.461+0000 7f060fe00640 1 -- 172.21.15.37:0/2949886733 wait complete. 2024-08-20T05:11:59.591 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:11:59.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.357+0000 7f9360600640 1 -- 172.21.15.37:0/2836887741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f935810f0e0 msgr2=0x7f93581114d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:59.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.357+0000 7f9360600640 1 --2- 172.21.15.37:0/2836887741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f935810f0e0 0x7f93581114d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9350009be0 tx=0x7f935002a750 comp rx=0 tx=0).stop 2024-08-20T05:11:59.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.357+0000 7f9360600640 1 -- 172.21.15.37:0/2836887741 shutdown_connections 2024-08-20T05:11:59.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.357+0000 7f9360600640 1 --2- 172.21.15.37:0/2836887741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f935810f0e0 0x7f93581114d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.357+0000 7f9360600640 1 --2- 172.21.15.37:0/2836887741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9358101e50 0x7f935810eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.357+0000 7f9360600640 1 --2- 172.21.15.37:0/2836887741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9358101530 0x7f9358101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.357+0000 7f9360600640 1 -- 172.21.15.37:0/2836887741 >> 172.21.15.37:0/2836887741 conn(0x7f93580fd400 msgr2=0x7f93580ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.357+0000 7f9360600640 1 -- 172.21.15.37:0/2836887741 shutdown_connections 2024-08-20T05:11:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.357+0000 7f9360600640 1 -- 172.21.15.37:0/2836887741 wait complete. 2024-08-20T05:11:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.359+0000 7f9360600640 1 Processor -- start 2024-08-20T05:11:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.359+0000 7f9360600640 1 -- start start 2024-08-20T05:11:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.359+0000 7f9360600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9358101530 0x7f935810e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.359+0000 7f9360600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9358101e50 0x7f935810bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.359+0000 7f9360600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f935810f0e0 0x7f935810c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.360+0000 7f9360600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9358114c60 con 0x7f9358101e50 2024-08-20T05:11:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.360+0000 7f9360600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9358114ae0 con 0x7f9358101530 2024-08-20T05:11:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.360+0000 7f9360600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9358114de0 con 0x7f935810f0e0 2024-08-20T05:11:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.360+0000 7f935dc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9358101530 0x7f935810e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.360+0000 7f935dc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9358101530 0x7f935810e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:55906/0 (socket says 172.21.15.37:55906) 2024-08-20T05:11:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.360+0000 7f935dc00640 1 -- 172.21.15.37:0/1914801150 learned_addr learned my addr 172.21.15.37:0/1914801150 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:59.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.360+0000 7f935e600640 1 --2- 172.21.15.37:0/1914801150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f935810f0e0 0x7f935810c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:59.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.360+0000 7f935d200640 1 --2- 172.21.15.37:0/1914801150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9358101e50 0x7f935810bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:59.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.360+0000 7f935dc00640 1 -- 172.21.15.37:0/1914801150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f935810f0e0 msgr2=0x7f935810c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:59.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.360+0000 7f935dc00640 1 --2- 172.21.15.37:0/1914801150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f935810f0e0 0x7f935810c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.360+0000 7f935dc00640 1 -- 172.21.15.37:0/1914801150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9358101e50 msgr2=0x7f935810bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:59.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.360+0000 7f935dc00640 1 --2- 172.21.15.37:0/1914801150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9358101e50 0x7f935810bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.360+0000 7f935dc00640 1 -- 172.21.15.37:0/1914801150 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935810c980 con 0x7f9358101530 2024-08-20T05:11:59.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.361+0000 7f935dc00640 1 --2- 172.21.15.37:0/1914801150 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9358101530 0x7f935810e8e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f934c00e9c0 tx=0x7f934c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:59.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.361+0000 7f9356000640 1 -- 172.21.15.37:0/1914801150 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c00ccc0 con 0x7f9358101530 2024-08-20T05:11:59.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.361+0000 7f9356000640 1 -- 172.21.15.37:0/1914801150 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f934c0054d0 con 0x7f9358101530 2024-08-20T05:11:59.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.361+0000 7f9356000640 1 -- 172.21.15.37:0/1914801150 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c010430 con 0x7f9358101530 2024-08-20T05:11:59.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.361+0000 7f9360600640 1 -- 172.21.15.37:0/1914801150 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93581aba80 con 0x7f9358101530 2024-08-20T05:11:59.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.361+0000 7f9360600640 1 -- 172.21.15.37:0/1914801150 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93581abf40 con 0x7f9358101530 2024-08-20T05:11:59.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.367+0000 7f9362ff6740 1 Processor -- start 2024-08-20T05:11:59.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.368+0000 7f9362ff6740 1 -- start start 2024-08-20T05:11:59.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.368+0000 7f9362ff6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 0x55ff2d0f8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.368+0000 7f9362ff6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d0f9260 0x55ff2d104cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.368+0000 7f9362ff6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d1051f0 0x55ff2d1075e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.368+0000 7f9362ff6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ff2d06eaa0 con 0x55ff2d0f8940 2024-08-20T05:11:59.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.368+0000 7f9362ff6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ff2d05dfa0 con 0x55ff2d1051f0 2024-08-20T05:11:59.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.368+0000 7f9362ff6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ff2d061fe0 con 0x55ff2d0f9260 2024-08-20T05:11:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.368+0000 7f935e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 0x55ff2d0f8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.368+0000 7f935e600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 0x55ff2d0f8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43390/0 (socket says 172.21.15.37:43390) 2024-08-20T05:11:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.368+0000 7f935e600640 1 -- 172.21.15.37:0/1335751021 learned_addr learned my addr 172.21.15.37:0/1335751021 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.368+0000 7f935d200640 1 --2- 172.21.15.37:0/1335751021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d1051f0 0x55ff2d1075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.369+0000 7f935e600640 1 -- 172.21.15.37:0/1335751021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d0f9260 msgr2=0x55ff2d104cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:11:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.369+0000 7f935e600640 1 --2- 172.21.15.37:0/1335751021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d0f9260 0x55ff2d104cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.369+0000 7f935e600640 1 -- 172.21.15.37:0/1335751021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d1051f0 msgr2=0x55ff2d1075e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.369+0000 7f935e600640 1 --2- 172.21.15.37:0/1335751021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d1051f0 0x55ff2d1075e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.369+0000 7f935e600640 1 -- 172.21.15.37:0/1335751021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff2d004420 con 0x55ff2d0f8940 2024-08-20T05:11:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.369+0000 7f935e600640 1 --2- 172.21.15.37:0/1335751021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 0x55ff2d0f8d20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9350009be0 tx=0x7f9350030410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f5ee5ff016f05 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.370+0000 7f934aa00640 1 -- 172.21.15.37:0/1335751021 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350041030 con 0x55ff2d0f8940 2024-08-20T05:11:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.370+0000 7f9356000640 1 -- 172.21.15.37:0/1914801150 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f934c004f80 con 0x7f9358101530 2024-08-20T05:11:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.370+0000 7f934aa00640 1 -- 172.21.15.37:0/1335751021 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9350003e20 con 0x55ff2d0f8940 2024-08-20T05:11:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.370+0000 7f934aa00640 1 -- 172.21.15.37:0/1335751021 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350036040 con 0x55ff2d0f8940 2024-08-20T05:11:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.370+0000 7f9362ff6740 1 -- 172.21.15.37:0/1335751021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 msgr2=0x55ff2d0f8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.370+0000 7f9362ff6740 1 --2- 172.21.15.37:0/1335751021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 0x55ff2d0f8d20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f9350009be0 tx=0x7f9350030410 comp rx=0 tx=0).stop 2024-08-20T05:11:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.371+0000 7f9362ff6740 1 -- 172.21.15.37:0/1335751021 shutdown_connections 2024-08-20T05:11:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.371+0000 7f9362ff6740 1 --2- 172.21.15.37:0/1335751021 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d1051f0 0x55ff2d1075e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.371+0000 7f9362ff6740 1 --2- 172.21.15.37:0/1335751021 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d0f9260 0x55ff2d104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.371+0000 7f9362ff6740 1 --2- 172.21.15.37:0/1335751021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 0x55ff2d0f8d20 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.371+0000 7f9362ff6740 1 -- 172.21.15.37:0/1335751021 >> 172.21.15.37:0/1335751021 conn(0x55ff2d0f6770 msgr2=0x55ff2d0f7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.371+0000 7f9362ff6740 1 -- 172.21.15.37:0/1335751021 shutdown_connections 2024-08-20T05:11:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.371+0000 7f9362ff6740 1 -- 172.21.15.37:0/1335751021 wait complete. 2024-08-20T05:11:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.371+0000 7f9356000640 1 --2- 172.21.15.37:0/1914801150 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f93400b3b60 0x7f93400b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.371+0000 7f9362ff6740 1 -- start start 2024-08-20T05:11:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.371+0000 7f9356000640 1 -- 172.21.15.37:0/1914801150 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f934c0e4320 con 0x7f9358101530 2024-08-20T05:11:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.372+0000 7f9362ff6740 1 Processor -- start 2024-08-20T05:11:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.372+0000 7f935e600640 1 --2- 172.21.15.37:0/1914801150 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f93400b3b60 0x7f93400b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.372+0000 7f9362ff6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 0x55ff2d1049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.372+0000 7f9362ff6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d0f9260 0x55ff2d101e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.373+0000 7f9362ff6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d1051f0 0x55ff2d102360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.373+0000 7f9362ff6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ff2cec0700 con 0x55ff2d0f8940 2024-08-20T05:11:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.373+0000 7f9362ff6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ff2cff9290 con 0x55ff2d0f9260 2024-08-20T05:11:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.373+0000 7f9362ff6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ff2d107e10 con 0x55ff2d1051f0 2024-08-20T05:11:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.373+0000 7f9362ff6740 10 client.0 _ll_register_callbacks cb 0x55ff2d0581c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.373+0000 7f935dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 0x55ff2d1049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.373+0000 7f935dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 0x55ff2d1049d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43406/0 (socket says 172.21.15.37:43406) 2024-08-20T05:11:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.373+0000 7f935dc00640 1 -- 172.21.15.37:0/35594730 learned_addr learned my addr 172.21.15.37:0/35594730 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.373+0000 7f935e600640 1 --2- 172.21.15.37:0/1914801150 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f93400b3b60 0x7f93400b6020 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9350009b30 tx=0x7f935002a750 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.373+0000 7f935e600640 1 --2- 172.21.15.37:0/35594730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d1051f0 0x55ff2d102360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.374+0000 7f935dc00640 1 -- 172.21.15.37:0/35594730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d1051f0 msgr2=0x55ff2d102360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.374+0000 7f935dc00640 1 --2- 172.21.15.37:0/35594730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d1051f0 0x55ff2d102360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.374+0000 7f935dc00640 1 -- 172.21.15.37:0/35594730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d0f9260 msgr2=0x55ff2d101e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:11:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.374+0000 7f935dc00640 1 --2- 172.21.15.37:0/35594730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d0f9260 0x55ff2d101e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.374+0000 7f935dc00640 1 -- 172.21.15.37:0/35594730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff2cdbd650 con 0x55ff2d0f8940 2024-08-20T05:11:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.375+0000 7f933f400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:11:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.375+0000 7f935dc00640 1 --2- 172.21.15.37:0/35594730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 0x55ff2d1049d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f934c0a6ef0 tx=0x7f934c0aa980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc704c878fa2d7dc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.376+0000 7f933f400640 1 -- 172.21.15.37:0/35594730 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c0aae70 con 0x55ff2d0f8940 2024-08-20T05:11:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.376+0000 7f933f400640 1 -- 172.21.15.37:0/35594730 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f934c005270 con 0x55ff2d0f8940 2024-08-20T05:11:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.376+0000 7f9362ff6740 1 -- 172.21.15.37:0/35594730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9350003e20 con 0x55ff2d0f8940 2024-08-20T05:11:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.377+0000 7f933f400640 1 -- 172.21.15.37:0/35594730 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f934c0af470 con 0x55ff2d0f8940 2024-08-20T05:11:59.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.377+0000 7f9362ff6740 10 client.17499 fetch_fsmap learned FSMap version 43 2024-08-20T05:11:59.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.377+0000 7f9362ff6740 1 -- 172.21.15.37:0/35594730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55ff2d1136a0 con 0x55ff2d0f8940 2024-08-20T05:11:59.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.377+0000 7f933f400640 1 -- 172.21.15.37:0/35594730 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9350003e20 con 0x55ff2d0f8940 2024-08-20T05:11:59.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.377+0000 7f933f400640 1 -- 172.21.15.37:0/35594730 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f934c0a9b40 con 0x55ff2d0f8940 2024-08-20T05:11:59.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.378+0000 7f9362ff6740 10 client.17499 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:11:59.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.378+0000 7f9362ff6740 10 client.17499 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:11:59.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.378+0000 7f9362ff6740 20 client.17499 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:59.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.378+0000 7f9362ff6740 1 --2- 172.21.15.37:0/35594730 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55ff2d114b00 0x55ff2d116f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.378+0000 7f9362ff6740 4 client.17499 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:11:59.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.378+0000 7f9362ff6740 1 -- 172.21.15.37:0/35594730 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff2d0709f0 con 0x55ff2d114b00 2024-08-20T05:11:59.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.378+0000 7f935d200640 1 --2- 172.21.15.37:0/35594730 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55ff2d114b00 0x55ff2d116f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:59.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.379+0000 7f935d200640 1 --2- 172.21.15.37:0/35594730 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55ff2d114b00 0x55ff2d116f40 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d1cae467778c2fb server_cookie=411a4b4b46226e0e in_seq=0 out_seq=0 2024-08-20T05:11:59.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.379+0000 7f933f400640 10 client.17499 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:11:59.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.379+0000 7f933f400640 1 -- 172.21.15.37:0/35594730 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff2d0709f0 con 0x55ff2d114b00 2024-08-20T05:11:59.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.379+0000 7f933f400640 10 client.17499 handle_command_reply: tid=0 2024-08-20T05:11:59.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.379+0000 7f9362ff6740 1 client.17499 shutdown 2024-08-20T05:11:59.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.380+0000 7f9362ff6740 1 -- 172.21.15.37:0/35594730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 msgr2=0x55ff2d1049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:59.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.380+0000 7f9362ff6740 1 --2- 172.21.15.37:0/35594730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 0x55ff2d1049d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f934c0a6ef0 tx=0x7f934c0aa980 comp rx=0 tx=0).stop 2024-08-20T05:11:59.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.380+0000 7f9362ff6740 1 -- 172.21.15.37:0/35594730 shutdown_connections 2024-08-20T05:11:59.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.380+0000 7f9362ff6740 1 --2- 172.21.15.37:0/35594730 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55ff2d114b00 0x55ff2d116f40 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.380+0000 7f9362ff6740 1 --2- 172.21.15.37:0/35594730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d1051f0 0x55ff2d102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.380+0000 7f9362ff6740 1 --2- 172.21.15.37:0/35594730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d0f9260 0x55ff2d101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.380+0000 7f9362ff6740 1 --2- 172.21.15.37:0/35594730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 0x55ff2d1049d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.380+0000 7f9362ff6740 1 -- 172.21.15.37:0/35594730 >> 172.21.15.37:0/35594730 conn(0x55ff2d0f6770 msgr2=0x55ff2d0fc2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:59.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.380+0000 7f933f400640 0 client.17499 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:11:59.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.380+0000 7f9362ff6740 1 -- 172.21.15.37:0/35594730 shutdown_connections 2024-08-20T05:11:59.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.380+0000 7f9362ff6740 1 -- 172.21.15.37:0/35594730 wait complete. 2024-08-20T05:11:59.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.380+0000 7f9362ff6740 20 client.17499 trim_cache size 0 max 16384 2024-08-20T05:11:59.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.399+0000 7f9362ff6740 1 Processor -- start 2024-08-20T05:11:59.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.399+0000 7f9362ff6740 1 -- start start 2024-08-20T05:11:59.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.399+0000 7f9362ff6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d0f8940 0x55ff2d110f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.399+0000 7f9362ff6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d0f9260 0x55ff2d11c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.399+0000 7f9362ff6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d1051f0 0x55ff2d11cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.399+0000 7f9362ff6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93581b5d80 con 0x55ff2d1051f0 2024-08-20T05:11:59.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.399+0000 7f9362ff6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f93581b7950 con 0x55ff2d0f8940 2024-08-20T05:11:59.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.399+0000 7f9362ff6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93581b6450 con 0x55ff2d0f9260 2024-08-20T05:11:59.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.400+0000 7f935d200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d0f9260 0x55ff2d11c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:59.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.400+0000 7f935dc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d0f8940 0x55ff2d110f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:59.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.400+0000 7f935d200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d0f9260 0x55ff2d11c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36814/0 (socket says 172.21.15.37:36814) 2024-08-20T05:11:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.400+0000 7f935d200640 1 -- 172.21.15.37:0/3499640975 learned_addr learned my addr 172.21.15.37:0/3499640975 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.400+0000 7f935e600640 1 --2- 172.21.15.37:0/3499640975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d1051f0 0x55ff2d11cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.400+0000 7f935dc00640 1 -- 172.21.15.37:0/3499640975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d0f9260 msgr2=0x55ff2d11c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.400+0000 7f935dc00640 1 --2- 172.21.15.37:0/3499640975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d0f9260 0x55ff2d11c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.400+0000 7f935dc00640 1 -- 172.21.15.37:0/3499640975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d1051f0 msgr2=0x55ff2d11cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.400+0000 7f935dc00640 1 --2- 172.21.15.37:0/3499640975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d1051f0 0x55ff2d11cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.400+0000 7f935dc00640 1 -- 172.21.15.37:0/3499640975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff2d1026a0 con 0x55ff2d0f8940 2024-08-20T05:11:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.400+0000 7f935e600640 1 --2- 172.21.15.37:0/3499640975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d1051f0 0x55ff2d11cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:11:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.400+0000 7f935dc00640 1 --2- 172.21.15.37:0/3499640975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d0f8940 0x55ff2d110f60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f934c000c00 tx=0x7f934c009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8194a830870bbffb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.401+0000 7f934a000640 1 -- 172.21.15.37:0/3499640975 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c0aae70 con 0x55ff2d0f8940 2024-08-20T05:11:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.401+0000 7f934a000640 1 -- 172.21.15.37:0/3499640975 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f934c0b3f20 con 0x55ff2d0f8940 2024-08-20T05:11:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.401+0000 7f934a000640 1 -- 172.21.15.37:0/3499640975 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934c0b0830 con 0x55ff2d0f8940 2024-08-20T05:11:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.402+0000 7f9362ff6740 1 -- 172.21.15.37:0/3499640975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d0f8940 msgr2=0x55ff2d110f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:59.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.402+0000 7f9362ff6740 1 --2- 172.21.15.37:0/3499640975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d0f8940 0x55ff2d110f60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f934c000c00 tx=0x7f934c009f90 comp rx=0 tx=0).stop 2024-08-20T05:11:59.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.405+0000 7f9362ff6740 1 -- 172.21.15.37:0/3499640975 shutdown_connections 2024-08-20T05:11:59.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.405+0000 7f9362ff6740 1 --2- 172.21.15.37:0/3499640975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d1051f0 0x55ff2d11cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.405+0000 7f9362ff6740 1 --2- 172.21.15.37:0/3499640975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d0f9260 0x55ff2d11c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.405+0000 7f9362ff6740 1 --2- 172.21.15.37:0/3499640975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d0f8940 0x55ff2d110f60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.405+0000 7f9362ff6740 1 -- 172.21.15.37:0/3499640975 >> 172.21.15.37:0/3499640975 conn(0x55ff2d0f6770 msgr2=0x55ff2d103c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:59.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.405+0000 7f9362ff6740 1 -- 172.21.15.37:0/3499640975 shutdown_connections 2024-08-20T05:11:59.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.405+0000 7f9362ff6740 1 -- 172.21.15.37:0/3499640975 wait complete. 2024-08-20T05:11:59.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.406+0000 7f9362ff6740 1 -- start start 2024-08-20T05:11:59.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.406+0000 7f9362ff6740 1 Processor -- start 2024-08-20T05:11:59.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.406+0000 7f9362ff6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 0x55ff2d10a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.406+0000 7f9362ff6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d0f9260 0x55ff2d10aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.406+0000 7f9362ff6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d1051f0 0x55ff2d1777b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.406+0000 7f9362ff6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f93581b7250 con 0x55ff2d0f8940 2024-08-20T05:11:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.406+0000 7f9362ff6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f93581b6b20 con 0x55ff2d1051f0 2024-08-20T05:11:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.406+0000 7f9362ff6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f93581b3d60 con 0x55ff2d0f9260 2024-08-20T05:11:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.407+0000 7f9362ff6740 10 client.0 _ll_register_callbacks cb 0x7f934c0aacf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:11:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.407+0000 7f935d200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d0f9260 0x55ff2d10aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.407+0000 7f935dc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 0x55ff2d10a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.407+0000 7f935d200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d0f9260 0x55ff2d10aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36828/0 (socket says 172.21.15.37:36828) 2024-08-20T05:11:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.407+0000 7f935d200640 1 -- 172.21.15.37:0/317259336 learned_addr learned my addr 172.21.15.37:0/317259336 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:11:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.407+0000 7f935e600640 1 --2- 172.21.15.37:0/317259336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d1051f0 0x55ff2d1777b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.407+0000 7f935d200640 1 -- 172.21.15.37:0/317259336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d1051f0 msgr2=0x55ff2d1777b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.407+0000 7f935d200640 1 --2- 172.21.15.37:0/317259336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d1051f0 0x55ff2d1777b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.407+0000 7f935d200640 1 -- 172.21.15.37:0/317259336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 msgr2=0x55ff2d10a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:11:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.407+0000 7f935d200640 1 --2- 172.21.15.37:0/317259336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 0x55ff2d10a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.407+0000 7f935d200640 1 -- 172.21.15.37:0/317259336 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff2d177ef0 con 0x55ff2d0f9260 2024-08-20T05:11:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.407+0000 7f935dc00640 1 --2- 172.21.15.37:0/317259336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 0x55ff2d10a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:11:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.408+0000 7f935d200640 1 --2- 172.21.15.37:0/317259336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d0f9260 0x55ff2d10aec0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f935810e630 tx=0x7f9344010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66a2ed6b8a985519 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:11:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.408+0000 7f933f400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:11:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.408+0000 7f933f400640 1 -- 172.21.15.37:0/317259336 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9344004230 con 0x55ff2d0f9260 2024-08-20T05:11:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.408+0000 7f933f400640 1 -- 172.21.15.37:0/317259336 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f93440043d0 con 0x55ff2d0f9260 2024-08-20T05:11:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.408+0000 7f9362ff6740 1 -- 172.21.15.37:0/317259336 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f934c0b3f20 con 0x55ff2d0f9260 2024-08-20T05:11:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.408+0000 7f933f400640 1 -- 172.21.15.37:0/317259336 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f934401d620 con 0x55ff2d0f9260 2024-08-20T05:11:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.408+0000 7f9362ff6740 10 client.27979 fetch_fsmap learned FSMap version 43 2024-08-20T05:11:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.408+0000 7f9362ff6740 1 -- 172.21.15.37:0/317259336 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55ff2d17f3b0 con 0x55ff2d0f9260 2024-08-20T05:11:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.409+0000 7f933f400640 1 -- 172.21.15.37:0/317259336 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f934c0b3f20 con 0x55ff2d0f9260 2024-08-20T05:11:59.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.409+0000 7f933f400640 1 -- 172.21.15.37:0/317259336 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f9344024030 con 0x55ff2d0f9260 2024-08-20T05:11:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.409+0000 7f9362ff6740 10 client.27979 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:11:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.409+0000 7f9362ff6740 10 client.27979 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:11:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.409+0000 7f9362ff6740 20 client.27979 populate_metadata read hostname 'smithi037' 2024-08-20T05:11:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.409+0000 7f9362ff6740 1 --2- 172.21.15.37:0/317259336 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55ff2d17fb40 0x55ff2d181f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:11:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.409+0000 7f9362ff6740 4 client.27979 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:11:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.409+0000 7f9362ff6740 1 -- 172.21.15.37:0/317259336 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ff2d06c490 con 0x55ff2d17fb40 2024-08-20T05:11:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.409+0000 7f935dc00640 1 --2- 172.21.15.37:0/317259336 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55ff2d17fb40 0x55ff2d181f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:11:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.410+0000 7f935dc00640 1 --2- 172.21.15.37:0/317259336 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55ff2d17fb40 0x55ff2d181f60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=50f725dc5fd220e3 server_cookie=3f1db43ef1d31b40 in_seq=0 out_seq=0 2024-08-20T05:11:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.410+0000 7f933f400640 10 client.27979 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:11:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.410+0000 7f933f400640 1 -- 172.21.15.37:0/317259336 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ff2d06c490 con 0x55ff2d17fb40 2024-08-20T05:11:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.410+0000 7f933f400640 10 client.27979 handle_command_reply: tid=0 2024-08-20T05:11:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.410+0000 7f9362ff6740 1 client.27979 shutdown 2024-08-20T05:11:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.410+0000 7f9362ff6740 1 -- 172.21.15.37:0/317259336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d0f9260 msgr2=0x55ff2d10aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:59.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.410+0000 7f9362ff6740 1 --2- 172.21.15.37:0/317259336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d0f9260 0x55ff2d10aec0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f935810e630 tx=0x7f9344010800 comp rx=0 tx=0).stop 2024-08-20T05:11:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.411+0000 7f9362ff6740 1 -- 172.21.15.37:0/317259336 shutdown_connections 2024-08-20T05:11:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.411+0000 7f9362ff6740 1 --2- 172.21.15.37:0/317259336 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55ff2d17fb40 0x55ff2d181f60 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.411+0000 7f9362ff6740 1 --2- 172.21.15.37:0/317259336 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff2d1051f0 0x55ff2d1777b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.411+0000 7f9362ff6740 1 --2- 172.21.15.37:0/317259336 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff2d0f9260 0x55ff2d10aec0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.411+0000 7f9362ff6740 1 --2- 172.21.15.37:0/317259336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff2d0f8940 0x55ff2d10a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.411+0000 7f9362ff6740 1 -- 172.21.15.37:0/317259336 >> 172.21.15.37:0/317259336 conn(0x55ff2d0f6770 msgr2=0x55ff2d0f5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.411+0000 7f933f400640 0 client.27979 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:11:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.411+0000 7f9362ff6740 1 -- 172.21.15.37:0/317259336 shutdown_connections 2024-08-20T05:11:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.411+0000 7f9362ff6740 1 -- 172.21.15.37:0/317259336 wait complete. 2024-08-20T05:11:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.412+0000 7f9362ff6740 20 client.27979 trim_cache size 0 max 16384 2024-08-20T05:11:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.413+0000 7f9360600640 1 -- 172.21.15.37:0/1914801150 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f93400b3b60 msgr2=0x7f93400b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.413+0000 7f9360600640 1 --2- 172.21.15.37:0/1914801150 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f93400b3b60 0x7f93400b6020 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9350009b30 tx=0x7f935002a750 comp rx=0 tx=0).stop 2024-08-20T05:11:59.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.413+0000 7f9360600640 1 -- 172.21.15.37:0/1914801150 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9358101530 msgr2=0x7f935810e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:11:59.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.413+0000 7f9360600640 1 --2- 172.21.15.37:0/1914801150 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9358101530 0x7f935810e8e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f934c00e9c0 tx=0x7f934c00ee80 comp rx=0 tx=0).stop 2024-08-20T05:11:59.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.413+0000 7f9360600640 1 -- 172.21.15.37:0/1914801150 shutdown_connections 2024-08-20T05:11:59.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.413+0000 7f9360600640 1 --2- 172.21.15.37:0/1914801150 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f93400b3b60 0x7f93400b6020 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.413+0000 7f9360600640 1 --2- 172.21.15.37:0/1914801150 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f935810f0e0 0x7f935810c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.413+0000 7f9360600640 1 --2- 172.21.15.37:0/1914801150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9358101e50 0x7f935810bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.413+0000 7f9360600640 1 --2- 172.21.15.37:0/1914801150 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9358101530 0x7f935810e8e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:11:59.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.413+0000 7f9360600640 1 -- 172.21.15.37:0/1914801150 >> 172.21.15.37:0/1914801150 conn(0x7f93580fd400 msgr2=0x7f93581103b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:11:59.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.413+0000 7f9360600640 1 -- 172.21.15.37:0/1914801150 shutdown_connections 2024-08-20T05:11:59.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:11:59.413+0000 7f9360600640 1 -- 172.21.15.37:0/1914801150 wait complete. 2024-08-20T05:11:59.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:11:59 smithi037 ceph-mon[17265]: pgmap v693: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 907 KiB/s wr, 114 op/s 2024-08-20T05:11:59.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:11:59 smithi135 ceph-mon[22342]: pgmap v693: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 907 KiB/s wr, 114 op/s 2024-08-20T05:11:59.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:11:59 smithi130 ceph-mon[22007]: pgmap v693: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 907 KiB/s wr, 114 op/s 2024-08-20T05:12:00.817 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:00 smithi037 ceph-mon[17265]: pgmap v694: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 MiB/s wr, 166 op/s 2024-08-20T05:12:00.821 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T05:12:00.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:00 smithi135 ceph-mon[22342]: pgmap v694: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 MiB/s wr, 166 op/s 2024-08-20T05:12:00.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:00 smithi130 ceph-mon[22007]: pgmap v694: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.3 MiB/s wr, 166 op/s 2024-08-20T05:12:01.465 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd7ad4f9c', total seconds elapsed: 36.9 2024-08-20T05:12:01.647 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:12:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.405+0000 7ff395e00640 1 -- 172.21.15.37:0/645241026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff390102ab0 msgr2=0x7ff390102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.405+0000 7ff395e00640 1 --2- 172.21.15.37:0/645241026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff390102ab0 0x7ff390102e90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ff380009900 tx=0x7ff38002a410 comp rx=0 tx=0).stop 2024-08-20T05:12:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.406+0000 7ff395e00640 1 -- 172.21.15.37:0/645241026 shutdown_connections 2024-08-20T05:12:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.406+0000 7ff395e00640 1 --2- 172.21.15.37:0/645241026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff390108e40 0x7ff39010f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.406+0000 7ff395e00640 1 --2- 172.21.15.37:0/645241026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3901084c0 0x7ff390108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.406+0000 7ff395e00640 1 --2- 172.21.15.37:0/645241026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff390102ab0 0x7ff390102e90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.406+0000 7ff395e00640 1 -- 172.21.15.37:0/645241026 >> 172.21.15.37:0/645241026 conn(0x7ff3900fe520 msgr2=0x7ff390100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.406+0000 7ff395e00640 1 -- 172.21.15.37:0/645241026 shutdown_connections 2024-08-20T05:12:02.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.406+0000 7ff395e00640 1 -- 172.21.15.37:0/645241026 wait complete. 2024-08-20T05:12:02.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.410+0000 7ff395e00640 1 Processor -- start 2024-08-20T05:12:02.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.410+0000 7ff395e00640 1 -- start start 2024-08-20T05:12:02.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.410+0000 7ff395e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff390102ab0 0x7ff390109630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.410+0000 7ff395e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3901084c0 0x7ff390109b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.410+0000 7ff395e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff390108e40 0x7ff39010a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.410+0000 7ff395e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff390112b90 con 0x7ff390102ab0 2024-08-20T05:12:02.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.411+0000 7ff395e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff390112a10 con 0x7ff3901084c0 2024-08-20T05:12:02.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.411+0000 7ff395e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff390112d10 con 0x7ff390108e40 2024-08-20T05:12:02.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.412+0000 7ff38f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff390108e40 0x7ff39010a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:02.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.413+0000 7ff38f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff390108e40 0x7ff39010a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36846/0 (socket says 172.21.15.37:36846) 2024-08-20T05:12:02.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.413+0000 7ff38f400640 1 -- 172.21.15.37:0/1740646915 learned_addr learned my addr 172.21.15.37:0/1740646915 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:02.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.414+0000 7ff387e00640 1 --2- 172.21.15.37:0/1740646915 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3901084c0 0x7ff390109b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:02.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.414+0000 7ff38ea00640 1 --2- 172.21.15.37:0/1740646915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff390102ab0 0x7ff390109630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:02.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.415+0000 7ff38ea00640 1 -- 172.21.15.37:0/1740646915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff390108e40 msgr2=0x7ff39010a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:02.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.415+0000 7ff38ea00640 1 --2- 172.21.15.37:0/1740646915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff390108e40 0x7ff39010a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.415+0000 7ff38ea00640 1 -- 172.21.15.37:0/1740646915 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3901084c0 msgr2=0x7ff390109b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:02.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.415+0000 7ff38ea00640 1 --2- 172.21.15.37:0/1740646915 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3901084c0 0x7ff390109b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.415+0000 7ff38ea00640 1 -- 172.21.15.37:0/1740646915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39019b040 con 0x7ff390102ab0 2024-08-20T05:12:02.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.418+0000 7ff38ea00640 1 --2- 172.21.15.37:0/1740646915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff390102ab0 0x7ff390109630 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff38002a930 tx=0x7ff380003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:02.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.420+0000 7ff394a00640 1 -- 172.21.15.37:0/1740646915 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38003f070 con 0x7ff390102ab0 2024-08-20T05:12:02.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.421+0000 7ff394a00640 1 -- 172.21.15.37:0/1740646915 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff38003bd20 con 0x7ff390102ab0 2024-08-20T05:12:02.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.421+0000 7ff394a00640 1 -- 172.21.15.37:0/1740646915 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff380035030 con 0x7ff390102ab0 2024-08-20T05:12:02.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.422+0000 7ff395e00640 1 -- 172.21.15.37:0/1740646915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39019b2d0 con 0x7ff390102ab0 2024-08-20T05:12:02.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.422+0000 7ff395e00640 1 -- 172.21.15.37:0/1740646915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff39019b7e0 con 0x7ff390102ab0 2024-08-20T05:12:02.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.428+0000 7ff398a2a740 1 Processor -- start 2024-08-20T05:12:02.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.432+0000 7ff398a2a740 1 -- start start 2024-08-20T05:12:02.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.432+0000 7ff398a2a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f0c940 0x559092f0cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.432+0000 7ff398a2a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0d260 0x559092f18cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.432+0000 7ff398a2a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559092f191f0 0x559092f1b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.432+0000 7ff398a2a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559092e82aa0 con 0x559092f191f0 2024-08-20T05:12:02.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.432+0000 7ff398a2a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559092e71fa0 con 0x559092f0d260 2024-08-20T05:12:02.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.432+0000 7ff398a2a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559092e75fe0 con 0x559092f0c940 2024-08-20T05:12:02.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.434+0000 7ff394a00640 1 -- 172.21.15.37:0/1740646915 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff380042070 con 0x7ff390102ab0 2024-08-20T05:12:02.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.436+0000 7ff38f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f0c940 0x559092f0cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:02.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.436+0000 7ff38f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f0c940 0x559092f0cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36858/0 (socket says 172.21.15.37:36858) 2024-08-20T05:12:02.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.436+0000 7ff38f400640 1 -- 172.21.15.37:0/924291789 learned_addr learned my addr 172.21.15.37:0/924291789 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:02.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.436+0000 7ff38f400640 1 -- 172.21.15.37:0/924291789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0d260 msgr2=0x559092f18cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:12:02.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.436+0000 7ff38f400640 1 --2- 172.21.15.37:0/924291789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0d260 0x559092f18cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.436+0000 7ff38f400640 1 -- 172.21.15.37:0/924291789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559092f191f0 msgr2=0x559092f1b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:02.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.436+0000 7ff38f400640 1 --2- 172.21.15.37:0/924291789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559092f191f0 0x559092f1b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.436+0000 7ff38f400640 1 -- 172.21.15.37:0/924291789 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559092e18420 con 0x559092f0c940 2024-08-20T05:12:02.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.436+0000 7ff394a00640 1 --2- 172.21.15.37:0/1740646915 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff3740b3c50 0x7ff3740b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.437+0000 7ff38f400640 1 --2- 172.21.15.37:0/924291789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f0c940 0x559092f0cd20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff388009fd0 tx=0x7ff388007800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95f6a2790e714758 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:02.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.437+0000 7ff37fe00640 1 -- 172.21.15.37:0/924291789 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388019070 con 0x559092f0c940 2024-08-20T05:12:02.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.438+0000 7ff37fe00640 1 -- 172.21.15.37:0/924291789 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff388012bc0 con 0x559092f0c940 2024-08-20T05:12:02.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.438+0000 7ff37fe00640 1 -- 172.21.15.37:0/924291789 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388019070 con 0x559092f0c940 2024-08-20T05:12:02.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.439+0000 7ff398a2a740 1 -- 172.21.15.37:0/924291789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f0c940 msgr2=0x559092f0cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:02.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.439+0000 7ff398a2a740 1 --2- 172.21.15.37:0/924291789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f0c940 0x559092f0cd20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff388009fd0 tx=0x7ff388007800 comp rx=0 tx=0).stop 2024-08-20T05:12:02.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.441+0000 7ff398a2a740 1 -- 172.21.15.37:0/924291789 shutdown_connections 2024-08-20T05:12:02.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.441+0000 7ff398a2a740 1 --2- 172.21.15.37:0/924291789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559092f191f0 0x559092f1b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.441+0000 7ff398a2a740 1 --2- 172.21.15.37:0/924291789 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0d260 0x559092f18cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.441+0000 7ff398a2a740 1 --2- 172.21.15.37:0/924291789 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f0c940 0x559092f0cd20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.441+0000 7ff398a2a740 1 -- 172.21.15.37:0/924291789 >> 172.21.15.37:0/924291789 conn(0x559092f0a770 msgr2=0x559092f0b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:02.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.441+0000 7ff38ea00640 1 --2- 172.21.15.37:0/1740646915 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff3740b3c50 0x7ff3740b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:02.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.441+0000 7ff394a00640 1 -- 172.21.15.37:0/1740646915 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff3800c7e00 con 0x7ff390102ab0 2024-08-20T05:12:02.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.443+0000 7ff38ea00640 1 --2- 172.21.15.37:0/1740646915 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff3740b3c50 0x7ff3740b6110 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff3800c8a50 tx=0x7ff3800d0f30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:02.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.444+0000 7ff398a2a740 1 -- 172.21.15.37:0/924291789 shutdown_connections 2024-08-20T05:12:02.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.445+0000 7ff398a2a740 1 -- 172.21.15.37:0/924291789 wait complete. 2024-08-20T05:12:02.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.447+0000 7ff398a2a740 1 -- start start 2024-08-20T05:12:02.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.447+0000 7ff398a2a740 1 Processor -- start 2024-08-20T05:12:02.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.448+0000 7ff398a2a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f0c940 0x559092f18ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.448+0000 7ff398a2a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0d260 0x559092f15f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.448+0000 7ff398a2a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559092f164b0 0x559092f16930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.448+0000 7ff398a2a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559092cd4700 con 0x559092f164b0 2024-08-20T05:12:02.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.448+0000 7ff398a2a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559092e0d290 con 0x559092f0d260 2024-08-20T05:12:02.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.448+0000 7ff398a2a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559092f2ce80 con 0x559092f0c940 2024-08-20T05:12:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.448+0000 7ff38f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f0c940 0x559092f18ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.449+0000 7ff387e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0d260 0x559092f15f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.449+0000 7ff38f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f0c940 0x559092f18ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36866/0 (socket says 172.21.15.37:36866) 2024-08-20T05:12:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.449+0000 7ff38f400640 1 -- 172.21.15.37:0/1016866685 learned_addr learned my addr 172.21.15.37:0/1016866685 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:02.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.449+0000 7ff398a2a740 10 client.0 _ll_register_callbacks cb 0x559092e6c1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:02.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.449+0000 7ff387e00640 1 -- 172.21.15.37:0/1016866685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f0c940 msgr2=0x559092f18ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:02.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.449+0000 7ff387e00640 1 --2- 172.21.15.37:0/1016866685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f0c940 0x559092f18ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.449+0000 7ff387e00640 1 -- 172.21.15.37:0/1016866685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559092f164b0 msgr2=0x559092f16930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:02.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.449+0000 7ff387e00640 1 --2- 172.21.15.37:0/1016866685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559092f164b0 0x559092f16930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.450+0000 7ff387e00640 1 -- 172.21.15.37:0/1016866685 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559092bd1650 con 0x559092f0d260 2024-08-20T05:12:02.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.451+0000 7ff38f400640 1 --2- 172.21.15.37:0/1016866685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f0c940 0x559092f18ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:12:02.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.451+0000 7ff37cc00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:12:02.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.451+0000 7ff387e00640 1 --2- 172.21.15.37:0/1016866685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0d260 0x559092f15f20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x559092f0c8b0 tx=0x7ff37800d530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2417215244f10d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:02.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.452+0000 7ff37cc00640 1 -- 172.21.15.37:0/1016866685 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff378014430 con 0x559092f0d260 2024-08-20T05:12:02.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.452+0000 7ff398a2a740 1 -- 172.21.15.37:0/1016866685 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff388012bc0 con 0x559092f0d260 2024-08-20T05:12:02.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.452+0000 7ff37cc00640 1 -- 172.21.15.37:0/1016866685 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff37800f040 con 0x559092f0d260 2024-08-20T05:12:02.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.453+0000 7ff37cc00640 1 -- 172.21.15.37:0/1016866685 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7ff378014430 con 0x559092f0d260 2024-08-20T05:12:02.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.453+0000 7ff398a2a740 10 client.27989 fetch_fsmap learned FSMap version 43 2024-08-20T05:12:02.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.453+0000 7ff398a2a740 1 -- 172.21.15.37:0/1016866685 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x559092f38ce0 con 0x559092f0d260 2024-08-20T05:12:02.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.454+0000 7ff37cc00640 1 -- 172.21.15.37:0/1016866685 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff388012bc0 con 0x559092f0d260 2024-08-20T05:12:02.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.454+0000 7ff37cc00640 1 -- 172.21.15.37:0/1016866685 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7ff378013070 con 0x559092f0d260 2024-08-20T05:12:02.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.454+0000 7ff398a2a740 10 client.27989 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:12:02.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.454+0000 7ff398a2a740 10 client.27989 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:12:02.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.454+0000 7ff398a2a740 20 client.27989 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:02.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.454+0000 7ff398a2a740 1 --2- 172.21.15.37:0/1016866685 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x559092f3a140 0x559092f3c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.454+0000 7ff398a2a740 4 client.27989 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:12:02.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.454+0000 7ff398a2a740 1 -- 172.21.15.37:0/1016866685 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559092e849f0 con 0x559092f3a140 2024-08-20T05:12:02.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.456+0000 7ff38f400640 1 --2- 172.21.15.37:0/1016866685 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x559092f3a140 0x559092f3c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:02.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.459+0000 7ff38f400640 1 --2- 172.21.15.37:0/1016866685 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x559092f3a140 0x559092f3c560 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=311f4873b51ec192 server_cookie=8e24a0c854df70ce in_seq=0 out_seq=0 2024-08-20T05:12:02.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.460+0000 7ff37cc00640 10 client.27989 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:12:02.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.463+0000 7ff37cc00640 1 -- 172.21.15.37:0/1016866685 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559092e849f0 con 0x559092f3a140 2024-08-20T05:12:02.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.463+0000 7ff37cc00640 10 client.27989 handle_command_reply: tid=0 2024-08-20T05:12:02.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.463+0000 7ff398a2a740 1 client.27989 shutdown 2024-08-20T05:12:02.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.464+0000 7ff398a2a740 1 -- 172.21.15.37:0/1016866685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0d260 msgr2=0x559092f15f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:02.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.464+0000 7ff398a2a740 1 --2- 172.21.15.37:0/1016866685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0d260 0x559092f15f20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x559092f0c8b0 tx=0x7ff37800d530 comp rx=0 tx=0).stop 2024-08-20T05:12:02.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.464+0000 7ff398a2a740 1 -- 172.21.15.37:0/1016866685 shutdown_connections 2024-08-20T05:12:02.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.464+0000 7ff398a2a740 1 --2- 172.21.15.37:0/1016866685 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x559092f3a140 0x559092f3c560 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.464+0000 7ff398a2a740 1 --2- 172.21.15.37:0/1016866685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559092f164b0 0x559092f16930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.464+0000 7ff398a2a740 1 --2- 172.21.15.37:0/1016866685 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0d260 0x559092f15f20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.464+0000 7ff398a2a740 1 --2- 172.21.15.37:0/1016866685 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f0c940 0x559092f18ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.464+0000 7ff37cc00640 0 client.27989 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:12:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.464+0000 7ff398a2a740 1 -- 172.21.15.37:0/1016866685 >> 172.21.15.37:0/1016866685 conn(0x559092f0a770 msgr2=0x559092f102e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.467+0000 7ff398a2a740 1 -- 172.21.15.37:0/1016866685 shutdown_connections 2024-08-20T05:12:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.467+0000 7ff398a2a740 1 -- 172.21.15.37:0/1016866685 wait complete. 2024-08-20T05:12:02.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.467+0000 7ff398a2a740 20 client.27989 trim_cache size 0 max 16384 2024-08-20T05:12:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.497+0000 7ff398a2a740 1 Processor -- start 2024-08-20T05:12:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.501+0000 7ff398a2a740 1 -- start start 2024-08-20T05:12:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.501+0000 7ff398a2a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0c940 0x559092f10c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.501+0000 7ff398a2a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559092f0d260 0x559092f41e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.501+0000 7ff398a2a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f164b0 0x559092f42370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.501+0000 7ff398a2a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff39006e920 con 0x559092f0d260 2024-08-20T05:12:02.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.501+0000 7ff398a2a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff3900704f0 con 0x559092f0c940 2024-08-20T05:12:02.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.501+0000 7ff398a2a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff39006eff0 con 0x559092f164b0 2024-08-20T05:12:02.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.502+0000 7ff38f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f164b0 0x559092f42370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:02.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.502+0000 7ff38f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f164b0 0x559092f42370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36868/0 (socket says 172.21.15.37:36868) 2024-08-20T05:12:02.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.502+0000 7ff38f400640 1 -- 172.21.15.37:0/1845940666 learned_addr learned my addr 172.21.15.37:0/1845940666 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:02.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.502+0000 7ff38f400640 1 --2- 172.21.15.37:0/1845940666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0c940 0x559092f10c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:02.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.503+0000 7ff38f400640 1 -- 172.21.15.37:0/1845940666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0c940 msgr2=0x559092f10c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:02.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.503+0000 7ff38f400640 1 --2- 172.21.15.37:0/1845940666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0c940 0x559092f10c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.503+0000 7ff38f400640 1 -- 172.21.15.37:0/1845940666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559092f0d260 msgr2=0x559092f41e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:02.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.503+0000 7ff38f400640 1 --2- 172.21.15.37:0/1845940666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559092f0d260 0x559092f41e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.503+0000 7ff38f400640 1 -- 172.21.15.37:0/1845940666 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559092f0b1f0 con 0x559092f164b0 2024-08-20T05:12:02.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.503+0000 7ff38f400640 1 --2- 172.21.15.37:0/1845940666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f164b0 0x559092f42370 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff388009500 tx=0x7ff388004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1857ef0688bbc600 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:02.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.503+0000 7ff37f400640 1 -- 172.21.15.37:0/1845940666 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388019040 con 0x559092f164b0 2024-08-20T05:12:02.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.503+0000 7ff37f400640 1 -- 172.21.15.37:0/1845940666 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3880129c0 con 0x559092f164b0 2024-08-20T05:12:02.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.503+0000 7ff37f400640 1 -- 172.21.15.37:0/1845940666 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38802c6d0 con 0x559092f164b0 2024-08-20T05:12:02.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.505+0000 7ff398a2a740 1 -- 172.21.15.37:0/1845940666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f164b0 msgr2=0x559092f42370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:02.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.505+0000 7ff398a2a740 1 --2- 172.21.15.37:0/1845940666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f164b0 0x559092f42370 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff388009500 tx=0x7ff388004a40 comp rx=0 tx=0).stop 2024-08-20T05:12:02.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.505+0000 7ff398a2a740 1 -- 172.21.15.37:0/1845940666 shutdown_connections 2024-08-20T05:12:02.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.505+0000 7ff398a2a740 1 --2- 172.21.15.37:0/1845940666 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f164b0 0x559092f42370 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.505+0000 7ff398a2a740 1 --2- 172.21.15.37:0/1845940666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559092f0d260 0x559092f41e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.505+0000 7ff398a2a740 1 --2- 172.21.15.37:0/1845940666 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0c940 0x559092f10c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.505+0000 7ff398a2a740 1 -- 172.21.15.37:0/1845940666 >> 172.21.15.37:0/1845940666 conn(0x559092f0a770 msgr2=0x559092f17d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.505+0000 7ff398a2a740 1 -- 172.21.15.37:0/1845940666 shutdown_connections 2024-08-20T05:12:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.505+0000 7ff398a2a740 1 -- 172.21.15.37:0/1845940666 wait complete. 2024-08-20T05:12:02.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.506+0000 7ff398a2a740 1 -- start start 2024-08-20T05:12:02.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.507+0000 7ff398a2a740 1 Processor -- start 2024-08-20T05:12:02.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.507+0000 7ff398a2a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559092f0c940 0x559092f2db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.507+0000 7ff398a2a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0d260 0x559092f2e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.507+0000 7ff398a2a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f164b0 0x559092f9cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.507+0000 7ff398a2a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff39006fdf0 con 0x559092f0c940 2024-08-20T05:12:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.507+0000 7ff398a2a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff39006f6c0 con 0x559092f0d260 2024-08-20T05:12:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.507+0000 7ff398a2a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff39006c8a0 con 0x559092f164b0 2024-08-20T05:12:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.507+0000 7ff398a2a740 10 client.0 _ll_register_callbacks cb 0x7ff37800b0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.508+0000 7ff38f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f164b0 0x559092f9cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.508+0000 7ff38f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f164b0 0x559092f9cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36880/0 (socket says 172.21.15.37:36880) 2024-08-20T05:12:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.508+0000 7ff38f400640 1 -- 172.21.15.37:0/3047339970 learned_addr learned my addr 172.21.15.37:0/3047339970 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:02.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.508+0000 7ff387e00640 1 --2- 172.21.15.37:0/3047339970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0d260 0x559092f2e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.509+0000 7ff38f400640 1 -- 172.21.15.37:0/3047339970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0d260 msgr2=0x559092f2e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.509+0000 7ff38f400640 1 --2- 172.21.15.37:0/3047339970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0d260 0x559092f2e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.509+0000 7ff38f400640 1 -- 172.21.15.37:0/3047339970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559092f0c940 msgr2=0x559092f2db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.509+0000 7ff38f400640 1 --2- 172.21.15.37:0/3047339970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559092f0c940 0x559092f2db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.509+0000 7ff38f400640 1 -- 172.21.15.37:0/3047339970 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559092f0b6b0 con 0x559092f164b0 2024-08-20T05:12:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.510+0000 7ff37cc00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:12:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.510+0000 7ff38f400640 1 --2- 172.21.15.37:0/3047339970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f164b0 0x559092f9cec0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff3880145f0 tx=0x7ff388014620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89bd3d78272a8584 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:02.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.510+0000 7ff37cc00640 1 -- 172.21.15.37:0/3047339970 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388019040 con 0x559092f164b0 2024-08-20T05:12:02.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.510+0000 7ff37cc00640 1 -- 172.21.15.37:0/3047339970 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff388014970 con 0x559092f164b0 2024-08-20T05:12:02.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.510+0000 7ff398a2a740 1 -- 172.21.15.37:0/3047339970 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3880129c0 con 0x559092f164b0 2024-08-20T05:12:02.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.511+0000 7ff37cc00640 1 -- 172.21.15.37:0/3047339970 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7ff3880127e0 con 0x559092f164b0 2024-08-20T05:12:02.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.511+0000 7ff398a2a740 10 client.27994 fetch_fsmap learned FSMap version 43 2024-08-20T05:12:02.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.511+0000 7ff398a2a740 1 -- 172.21.15.37:0/3047339970 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x559092fa48a0 con 0x559092f164b0 2024-08-20T05:12:02.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.513+0000 7ff37cc00640 1 -- 172.21.15.37:0/3047339970 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3880129c0 con 0x559092f164b0 2024-08-20T05:12:02.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.513+0000 7ff37cc00640 1 -- 172.21.15.37:0/3047339970 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7ff38802d450 con 0x559092f164b0 2024-08-20T05:12:02.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.513+0000 7ff398a2a740 10 client.27994 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:12:02.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.513+0000 7ff398a2a740 10 client.27994 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:12:02.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.513+0000 7ff398a2a740 20 client.27994 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:02.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.513+0000 7ff398a2a740 1 --2- 172.21.15.37:0/3047339970 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x559092fa4d80 0x559092fa71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:02.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.513+0000 7ff398a2a740 4 client.27994 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:12:02.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.513+0000 7ff398a2a740 1 -- 172.21.15.37:0/3047339970 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559092e80490 con 0x559092fa4d80 2024-08-20T05:12:02.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.514+0000 7ff387e00640 1 --2- 172.21.15.37:0/3047339970 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x559092fa4d80 0x559092fa71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.515+0000 7ff37cc00640 10 client.27994 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:12:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.515+0000 7ff387e00640 1 --2- 172.21.15.37:0/3047339970 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x559092fa4d80 0x559092fa71a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6d70005af29063ce server_cookie=b650cdd08caff7f8 in_seq=0 out_seq=0 2024-08-20T05:12:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.515+0000 7ff37cc00640 1 -- 172.21.15.37:0/3047339970 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559092e80490 con 0x559092fa4d80 2024-08-20T05:12:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.515+0000 7ff37cc00640 10 client.27994 handle_command_reply: tid=0 2024-08-20T05:12:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.515+0000 7ff398a2a740 1 client.27994 shutdown 2024-08-20T05:12:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.516+0000 7ff398a2a740 1 -- 172.21.15.37:0/3047339970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f164b0 msgr2=0x559092f9cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.516+0000 7ff398a2a740 1 --2- 172.21.15.37:0/3047339970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f164b0 0x559092f9cec0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff3880145f0 tx=0x7ff388014620 comp rx=0 tx=0).stop 2024-08-20T05:12:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.516+0000 7ff398a2a740 1 -- 172.21.15.37:0/3047339970 shutdown_connections 2024-08-20T05:12:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.516+0000 7ff398a2a740 1 --2- 172.21.15.37:0/3047339970 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x559092fa4d80 0x559092fa71a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.516+0000 7ff398a2a740 1 --2- 172.21.15.37:0/3047339970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559092f164b0 0x559092f9cec0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.516+0000 7ff37cc00640 0 client.27994 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:12:02.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.516+0000 7ff398a2a740 1 --2- 172.21.15.37:0/3047339970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559092f0d260 0x559092f2e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.516+0000 7ff398a2a740 1 --2- 172.21.15.37:0/3047339970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559092f0c940 0x559092f2db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.516+0000 7ff398a2a740 1 -- 172.21.15.37:0/3047339970 >> 172.21.15.37:0/3047339970 conn(0x559092f0a770 msgr2=0x559092f09030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.516+0000 7ff398a2a740 1 -- 172.21.15.37:0/3047339970 shutdown_connections 2024-08-20T05:12:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.516+0000 7ff398a2a740 1 -- 172.21.15.37:0/3047339970 wait complete. 2024-08-20T05:12:02.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.517+0000 7ff398a2a740 20 client.27994 trim_cache size 0 max 16384 2024-08-20T05:12:02.520 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:12:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.518+0000 7ff395e00640 1 -- 172.21.15.37:0/1740646915 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff3740b3c50 msgr2=0x7ff3740b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.518+0000 7ff395e00640 1 --2- 172.21.15.37:0/1740646915 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff3740b3c50 0x7ff3740b6110 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff3800c8a50 tx=0x7ff3800d0f30 comp rx=0 tx=0).stop 2024-08-20T05:12:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.518+0000 7ff395e00640 1 -- 172.21.15.37:0/1740646915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff390102ab0 msgr2=0x7ff390109630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.518+0000 7ff395e00640 1 --2- 172.21.15.37:0/1740646915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff390102ab0 0x7ff390109630 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff38002a930 tx=0x7ff380003d40 comp rx=0 tx=0).stop 2024-08-20T05:12:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.518+0000 7ff395e00640 1 -- 172.21.15.37:0/1740646915 shutdown_connections 2024-08-20T05:12:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.518+0000 7ff395e00640 1 --2- 172.21.15.37:0/1740646915 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff3740b3c50 0x7ff3740b6110 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.518+0000 7ff395e00640 1 --2- 172.21.15.37:0/1740646915 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff390108e40 0x7ff39010a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.518+0000 7ff395e00640 1 --2- 172.21.15.37:0/1740646915 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff3901084c0 0x7ff390109b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.518+0000 7ff395e00640 1 --2- 172.21.15.37:0/1740646915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff390102ab0 0x7ff390109630 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:02.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.518+0000 7ff395e00640 1 -- 172.21.15.37:0/1740646915 >> 172.21.15.37:0/1740646915 conn(0x7ff3900fe520 msgr2=0x7ff3900758d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:02.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.521+0000 7ff395e00640 1 -- 172.21.15.37:0/1740646915 shutdown_connections 2024-08-20T05:12:02.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:02.521+0000 7ff395e00640 1 -- 172.21.15.37:0/1740646915 wait complete. 2024-08-20T05:12:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 545.0 s, 484.9 tps, lat 1365.510 ms stddev 5751.053 2024-08-20T05:12:03.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T05:12:03.638 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:03 smithi037 ceph-mon[17265]: pgmap v695: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 1.8 MiB/s wr, 213 op/s 2024-08-20T05:12:03.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:03 smithi130 ceph-mon[22007]: pgmap v695: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 1.8 MiB/s wr, 213 op/s 2024-08-20T05:12:03.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:03 smithi135 ceph-mon[22342]: pgmap v695: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 1.8 MiB/s wr, 213 op/s 2024-08-20T05:12:04.271 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:12:04.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.694+0000 7f8331a00640 1 -- 172.21.15.37:0/880876661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f832c06b170 msgr2=0x7f832c102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:04.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.694+0000 7f8331a00640 1 --2- 172.21.15.37:0/880876661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f832c06b170 0x7f832c102e50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f831c009900 tx=0x7f831c02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.695+0000 7f8331a00640 1 -- 172.21.15.37:0/880876661 shutdown_connections 2024-08-20T05:12:04.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.695+0000 7f8331a00640 1 --2- 172.21.15.37:0/880876661 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f832c105f90 0x7f832c106440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.695+0000 7f8331a00640 1 --2- 172.21.15.37:0/880876661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832c1033e0 0x7f832c105850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.695+0000 7f8331a00640 1 --2- 172.21.15.37:0/880876661 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f832c06b170 0x7f832c102e50 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.695+0000 7f8331a00640 1 -- 172.21.15.37:0/880876661 >> 172.21.15.37:0/880876661 conn(0x7f832c0fcc50 msgr2=0x7f832c0ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:04.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.695+0000 7f8331a00640 1 -- 172.21.15.37:0/880876661 shutdown_connections 2024-08-20T05:12:04.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.695+0000 7f8331a00640 1 -- 172.21.15.37:0/880876661 wait complete. 2024-08-20T05:12:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.696+0000 7f8331a00640 1 Processor -- start 2024-08-20T05:12:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.697+0000 7f8331a00640 1 -- start start 2024-08-20T05:12:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.697+0000 7f8331a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832c06b170 0x7f832c19ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.697+0000 7f8331a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f832c1033e0 0x7f832c19f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.697+0000 7f8331a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f832c105f90 0x7f832c1a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.697+0000 7f8331a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f832c114720 con 0x7f832c06b170 2024-08-20T05:12:04.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.697+0000 7f8331a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f832c1145a0 con 0x7f832c1033e0 2024-08-20T05:12:04.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.697+0000 7f8331a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f832c1148a0 con 0x7f832c105f90 2024-08-20T05:12:04.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.697+0000 7f8331000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f832c105f90 0x7f832c1a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:04.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.697+0000 7f832be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832c06b170 0x7f832c19ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:04.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.697+0000 7f8323e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f832c1033e0 0x7f832c19f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:04.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.697+0000 7f8331000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f832c105f90 0x7f832c1a00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51064/0 (socket says 172.21.15.37:51064) 2024-08-20T05:12:04.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.697+0000 7f8331000640 1 -- 172.21.15.37:0/3110720612 learned_addr learned my addr 172.21.15.37:0/3110720612 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:04.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.698+0000 7f8331000640 1 -- 172.21.15.37:0/3110720612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f832c1033e0 msgr2=0x7f832c19f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:04.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.698+0000 7f8331000640 1 --2- 172.21.15.37:0/3110720612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f832c1033e0 0x7f832c19f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.698+0000 7f8331000640 1 -- 172.21.15.37:0/3110720612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832c06b170 msgr2=0x7f832c19ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:04.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.698+0000 7f8331000640 1 --2- 172.21.15.37:0/3110720612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832c06b170 0x7f832c19ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.698+0000 7f8331000640 1 -- 172.21.15.37:0/3110720612 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832c1a09b0 con 0x7f832c105f90 2024-08-20T05:12:04.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.698+0000 7f8331000640 1 --2- 172.21.15.37:0/3110720612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f832c105f90 0x7f832c1a00f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f832400eb10 tx=0x7f832400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:04.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.699+0000 7f8329600640 1 -- 172.21.15.37:0/3110720612 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324004b20 con 0x7f832c105f90 2024-08-20T05:12:04.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.699+0000 7f8329600640 1 -- 172.21.15.37:0/3110720612 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8324004cc0 con 0x7f832c105f90 2024-08-20T05:12:04.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.699+0000 7f8329600640 1 -- 172.21.15.37:0/3110720612 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8324010670 con 0x7f832c105f90 2024-08-20T05:12:04.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.699+0000 7f8331a00640 1 -- 172.21.15.37:0/3110720612 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f832c1a0ca0 con 0x7f832c105f90 2024-08-20T05:12:04.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.699+0000 7f8331a00640 1 -- 172.21.15.37:0/3110720612 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f832c1a7370 con 0x7f832c105f90 2024-08-20T05:12:04.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.702+0000 7f8335fe4740 1 Processor -- start 2024-08-20T05:12:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.704+0000 7f8329600640 1 -- 172.21.15.37:0/3110720612 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8324005020 con 0x7f832c105f90 2024-08-20T05:12:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.704+0000 7f8335fe4740 1 -- start start 2024-08-20T05:12:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.704+0000 7f8335fe4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0c7f0 0x55f188a0ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.704+0000 7f8335fe4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0f120 0x55f188a11510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.704+0000 7f8335fe4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a14020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.704+0000 7f8335fe4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f18897f210 con 0x55f188a11b60 2024-08-20T05:12:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.704+0000 7f8335fe4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f18896e710 con 0x55f188a0f120 2024-08-20T05:12:04.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.704+0000 7f8335fe4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f188972750 con 0x55f188a0c7f0 2024-08-20T05:12:04.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.704+0000 7f8323e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a14020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.704+0000 7f8323e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a14020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54888/0 (socket says 172.21.15.37:54888) 2024-08-20T05:12:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.704+0000 7f8323e00640 1 -- 172.21.15.37:0/3367951166 learned_addr learned my addr 172.21.15.37:0/3367951166 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.704+0000 7f832be00640 1 --2- 172.21.15.37:0/3367951166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0f120 0x55f188a11510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.705+0000 7f8323e00640 1 -- 172.21.15.37:0/3367951166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0c7f0 msgr2=0x55f188a0ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.705+0000 7f8323e00640 1 --2- 172.21.15.37:0/3367951166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0c7f0 0x55f188a0ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.705+0000 7f8323e00640 1 -- 172.21.15.37:0/3367951166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0f120 msgr2=0x55f188a11510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.705+0000 7f8323e00640 1 --2- 172.21.15.37:0/3367951166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0f120 0x55f188a11510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.705+0000 7f8323e00640 1 -- 172.21.15.37:0/3367951166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f18893ade0 con 0x55f188a11b60 2024-08-20T05:12:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.705+0000 7f8323e00640 1 --2- 172.21.15.37:0/3367951166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a14020 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8314009d80 tx=0x7f8314011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37bbe32341b9765 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.705+0000 7f8321600640 1 -- 172.21.15.37:0/3367951166 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8314005220 con 0x55f188a11b60 2024-08-20T05:12:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.705+0000 7f8321600640 1 -- 172.21.15.37:0/3367951166 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8314004c50 con 0x55f188a11b60 2024-08-20T05:12:04.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.705+0000 7f8329600640 1 --2- 172.21.15.37:0/3110720612 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83100b3c50 0x7f83100b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.705+0000 7f8321600640 1 -- 172.21.15.37:0/3367951166 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f831401a840 con 0x55f188a11b60 2024-08-20T05:12:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.706+0000 7f8329600640 1 -- 172.21.15.37:0/3110720612 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f83240e4510 con 0x7f832c105f90 2024-08-20T05:12:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.706+0000 7f832be00640 1 --2- 172.21.15.37:0/3110720612 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83100b3c50 0x7f83100b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.706+0000 7f8335fe4740 1 -- 172.21.15.37:0/3367951166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 msgr2=0x55f188a14020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:04.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.706+0000 7f8335fe4740 1 --2- 172.21.15.37:0/3367951166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a14020 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8314009d80 tx=0x7f8314011810 comp rx=0 tx=0).stop 2024-08-20T05:12:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.706+0000 7f8335fe4740 1 -- 172.21.15.37:0/3367951166 shutdown_connections 2024-08-20T05:12:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.706+0000 7f8335fe4740 1 --2- 172.21.15.37:0/3367951166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a14020 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.706+0000 7f8335fe4740 1 --2- 172.21.15.37:0/3367951166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0f120 0x55f188a11510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.706+0000 7f8335fe4740 1 --2- 172.21.15.37:0/3367951166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0c7f0 0x55f188a0ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.706+0000 7f8335fe4740 1 -- 172.21.15.37:0/3367951166 >> 172.21.15.37:0/3367951166 conn(0x55f188a07940 msgr2=0x55f188a086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:04.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.706+0000 7f8335fe4740 1 -- 172.21.15.37:0/3367951166 shutdown_connections 2024-08-20T05:12:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.706+0000 7f8335fe4740 1 -- 172.21.15.37:0/3367951166 wait complete. 2024-08-20T05:12:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.707+0000 7f832be00640 1 --2- 172.21.15.37:0/3110720612 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83100b3c50 0x7f83100b6110 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f831c031500 tx=0x7f831c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.707+0000 7f8335fe4740 1 -- start start 2024-08-20T05:12:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.707+0000 7f8335fe4740 1 Processor -- start 2024-08-20T05:12:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.708+0000 7f8335fe4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0c7f0 0x55f188a15ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.708+0000 7f8335fe4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0f120 0x55f188a16590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.708+0000 7f8335fe4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a17160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.708+0000 7f8335fe4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f1888a7ab0 con 0x55f188a11b60 2024-08-20T05:12:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.708+0000 7f8335fe4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f188915140 con 0x55f188a0f120 2024-08-20T05:12:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.708+0000 7f8335fe4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f188a14b40 con 0x55f188a0c7f0 2024-08-20T05:12:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.708+0000 7f8335fe4740 10 client.0 _ll_register_callbacks cb 0x55f1889285d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:04.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.708+0000 7f832be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0c7f0 0x55f188a15ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.708+0000 7f832be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0c7f0 0x55f188a15ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51090/0 (socket says 172.21.15.37:51090) 2024-08-20T05:12:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.708+0000 7f832be00640 1 -- 172.21.15.37:0/3129754682 learned_addr learned my addr 172.21.15.37:0/3129754682 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.708+0000 7f8331000640 1 --2- 172.21.15.37:0/3129754682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a17160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.708+0000 7f8331000640 1 -- 172.21.15.37:0/3129754682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0c7f0 msgr2=0x55f188a15ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.708+0000 7f8331000640 1 --2- 172.21.15.37:0/3129754682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0c7f0 0x55f188a15ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.708+0000 7f8331000640 1 -- 172.21.15.37:0/3129754682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0f120 msgr2=0x55f188a16590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.708+0000 7f8331000640 1 --2- 172.21.15.37:0/3129754682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0f120 0x55f188a16590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.708+0000 7f8331000640 1 -- 172.21.15.37:0/3129754682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f188916170 con 0x55f188a11b60 2024-08-20T05:12:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.709+0000 7f8331000640 1 --2- 172.21.15.37:0/3129754682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a17160 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f83240a82d0 tx=0x7f83240aa7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466463b4b80b7e7a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.709+0000 7f831a000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:12:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.709+0000 7f831a000640 1 -- 172.21.15.37:0/3129754682 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240af420 con 0x55f188a11b60 2024-08-20T05:12:04.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.709+0000 7f831a000640 1 -- 172.21.15.37:0/3129754682 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f83240a7650 con 0x55f188a11b60 2024-08-20T05:12:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.709+0000 7f8335fe4740 1 -- 172.21.15.37:0/3129754682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8314004c50 con 0x55f188a11b60 2024-08-20T05:12:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.709+0000 7f831a000640 1 -- 172.21.15.37:0/3129754682 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f83240cc050 con 0x55f188a11b60 2024-08-20T05:12:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.709+0000 7f8335fe4740 10 client.17520 fetch_fsmap learned FSMap version 43 2024-08-20T05:12:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.709+0000 7f8335fe4740 1 -- 172.21.15.37:0/3129754682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55f1886d1790 con 0x55f188a11b60 2024-08-20T05:12:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.710+0000 7f831a000640 1 -- 172.21.15.37:0/3129754682 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8314004c50 con 0x55f188a11b60 2024-08-20T05:12:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.710+0000 7f831a000640 1 -- 172.21.15.37:0/3129754682 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f8324086070 con 0x55f188a11b60 2024-08-20T05:12:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.710+0000 7f8335fe4740 10 client.17520 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:12:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.710+0000 7f8335fe4740 10 client.17520 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:12:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.710+0000 7f8335fe4740 20 client.17520 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.710+0000 7f8335fe4740 1 --2- 172.21.15.37:0/3129754682 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f188a21be0 0x55f188a24040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.710+0000 7f8335fe4740 4 client.17520 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:12:04.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.710+0000 7f8335fe4740 1 -- 172.21.15.37:0/3129754682 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f188981160 con 0x55f188a21be0 2024-08-20T05:12:04.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.710+0000 7f832be00640 1 --2- 172.21.15.37:0/3129754682 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f188a21be0 0x55f188a24040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.711+0000 7f832be00640 1 --2- 172.21.15.37:0/3129754682 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f188a21be0 0x55f188a24040 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=216a6ce91e7f5bed server_cookie=e6a909db2ceba90a in_seq=0 out_seq=0 2024-08-20T05:12:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.711+0000 7f831a000640 10 client.17520 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.712+0000 7f831a000640 1 -- 172.21.15.37:0/3129754682 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f188981160 con 0x55f188a21be0 2024-08-20T05:12:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.712+0000 7f831a000640 10 client.17520 handle_command_reply: tid=0 2024-08-20T05:12:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.712+0000 7f8335fe4740 1 client.17520 shutdown 2024-08-20T05:12:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.712+0000 7f8335fe4740 1 -- 172.21.15.37:0/3129754682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 msgr2=0x55f188a17160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:04.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.712+0000 7f8335fe4740 1 --2- 172.21.15.37:0/3129754682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a17160 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f83240a82d0 tx=0x7f83240aa7d0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.712+0000 7f8335fe4740 1 -- 172.21.15.37:0/3129754682 shutdown_connections 2024-08-20T05:12:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.712+0000 7f8335fe4740 1 --2- 172.21.15.37:0/3129754682 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f188a21be0 0x55f188a24040 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.712+0000 7f8335fe4740 1 --2- 172.21.15.37:0/3129754682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a17160 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.712+0000 7f8335fe4740 1 --2- 172.21.15.37:0/3129754682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0f120 0x55f188a16590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.712+0000 7f8335fe4740 1 --2- 172.21.15.37:0/3129754682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0c7f0 0x55f188a15ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.712+0000 7f8335fe4740 1 -- 172.21.15.37:0/3129754682 >> 172.21.15.37:0/3129754682 conn(0x55f188a07940 msgr2=0x55f188a069b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.712+0000 7f831a000640 0 client.17520 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.713+0000 7f8335fe4740 1 -- 172.21.15.37:0/3129754682 shutdown_connections 2024-08-20T05:12:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.713+0000 7f8335fe4740 1 -- 172.21.15.37:0/3129754682 wait complete. 2024-08-20T05:12:04.718 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.713+0000 7f8335fe4740 20 client.17520 trim_cache size 0 max 16384 2024-08-20T05:12:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.728+0000 7f8335fe4740 1 Processor -- start 2024-08-20T05:12:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.728+0000 7f8335fe4740 1 -- start start 2024-08-20T05:12:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.728+0000 7f8335fe4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0c7f0 0x55f188a028b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.728+0000 7f8335fe4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0f120 0x55f188a09770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.728+0000 7f8335fe4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a09cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.728+0000 7f8335fe4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f832c1b1790 con 0x55f188a11b60 2024-08-20T05:12:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.728+0000 7f8335fe4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f832c1b3360 con 0x55f188a0c7f0 2024-08-20T05:12:04.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.728+0000 7f8335fe4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f832c1b1e60 con 0x55f188a0f120 2024-08-20T05:12:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.729+0000 7f8331000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a09cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.729+0000 7f8323e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0f120 0x55f188a09770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.729+0000 7f8323e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0f120 0x55f188a09770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51092/0 (socket says 172.21.15.37:51092) 2024-08-20T05:12:04.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.729+0000 7f832be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0c7f0 0x55f188a028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.729+0000 7f8323e00640 1 -- 172.21.15.37:0/3328479253 learned_addr learned my addr 172.21.15.37:0/3328479253 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.729+0000 7f8331000640 1 -- 172.21.15.37:0/3328479253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0f120 msgr2=0x55f188a09770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.729+0000 7f8331000640 1 --2- 172.21.15.37:0/3328479253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0f120 0x55f188a09770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.729+0000 7f8331000640 1 -- 172.21.15.37:0/3328479253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0c7f0 msgr2=0x55f188a028b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.729+0000 7f8331000640 1 --2- 172.21.15.37:0/3328479253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0c7f0 0x55f188a028b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.729+0000 7f8331000640 1 -- 172.21.15.37:0/3328479253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f188a0ef50 con 0x55f188a11b60 2024-08-20T05:12:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.729+0000 7f8331000640 1 --2- 172.21.15.37:0/3328479253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a09cb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f83240049d0 tx=0x7f8324004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502641a8bea98d04 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.730+0000 7f8320c00640 1 -- 172.21.15.37:0/3328479253 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240af420 con 0x55f188a11b60 2024-08-20T05:12:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.730+0000 7f8320c00640 1 -- 172.21.15.37:0/3328479253 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83240ab060 con 0x55f188a11b60 2024-08-20T05:12:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.730+0000 7f8320c00640 1 -- 172.21.15.37:0/3328479253 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240ab520 con 0x55f188a11b60 2024-08-20T05:12:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.730+0000 7f8335fe4740 1 -- 172.21.15.37:0/3328479253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 msgr2=0x55f188a09cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.730+0000 7f8335fe4740 1 --2- 172.21.15.37:0/3328479253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a09cb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f83240049d0 tx=0x7f8324004ab0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.730+0000 7f8335fe4740 1 -- 172.21.15.37:0/3328479253 shutdown_connections 2024-08-20T05:12:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.730+0000 7f8335fe4740 1 --2- 172.21.15.37:0/3328479253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a09cb0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.730+0000 7f8335fe4740 1 --2- 172.21.15.37:0/3328479253 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0f120 0x55f188a09770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.730+0000 7f8335fe4740 1 --2- 172.21.15.37:0/3328479253 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0c7f0 0x55f188a028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.730+0000 7f8335fe4740 1 -- 172.21.15.37:0/3328479253 >> 172.21.15.37:0/3328479253 conn(0x55f188a07940 msgr2=0x55f188a0bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.730+0000 7f8335fe4740 1 -- 172.21.15.37:0/3328479253 shutdown_connections 2024-08-20T05:12:04.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.731+0000 7f8335fe4740 1 -- 172.21.15.37:0/3328479253 wait complete. 2024-08-20T05:12:04.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.731+0000 7f8335fe4740 1 -- start start 2024-08-20T05:12:04.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.731+0000 7f8335fe4740 1 Processor -- start 2024-08-20T05:12:04.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.731+0000 7f8335fe4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0c7f0 0x55f188a1aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.732+0000 7f8335fe4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0f120 0x55f188a1b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.732+0000 7f8335fe4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a1bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.732+0000 7f8335fe4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f832c1b2c60 con 0x55f188a11b60 2024-08-20T05:12:04.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.732+0000 7f8335fe4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f832c1b2530 con 0x55f188a0c7f0 2024-08-20T05:12:04.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.732+0000 7f8335fe4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f832c1af770 con 0x55f188a0f120 2024-08-20T05:12:04.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.732+0000 7f8335fe4740 10 client.0 _ll_register_callbacks cb 0x7f83240aae30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:04.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.732+0000 7f8331000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a1bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:04.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.732+0000 7f8331000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a1bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54904/0 (socket says 172.21.15.37:54904) 2024-08-20T05:12:04.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.732+0000 7f8331000640 1 -- 172.21.15.37:0/1890332935 learned_addr learned my addr 172.21.15.37:0/1890332935 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:04.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.732+0000 7f832be00640 1 --2- 172.21.15.37:0/1890332935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0c7f0 0x55f188a1aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:04.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.732+0000 7f8323e00640 1 --2- 172.21.15.37:0/1890332935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0f120 0x55f188a1b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:04.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.732+0000 7f8331000640 1 -- 172.21.15.37:0/1890332935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0f120 msgr2=0x55f188a1b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:04.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.732+0000 7f8331000640 1 --2- 172.21.15.37:0/1890332935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0f120 0x55f188a1b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.732+0000 7f8331000640 1 -- 172.21.15.37:0/1890332935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0c7f0 msgr2=0x55f188a1aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:04.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.732+0000 7f8331000640 1 --2- 172.21.15.37:0/1890332935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0c7f0 0x55f188a1aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:04.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.732+0000 7f8331000640 1 -- 172.21.15.37:0/1890332935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f18874a620 con 0x55f188a11b60 2024-08-20T05:12:04.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.733+0000 7f8331000640 1 --2- 172.21.15.37:0/1890332935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a1bd10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f83240ab330 tx=0x7f832400efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9931c4783feedd04 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:04.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.733+0000 7f831a000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:12:04.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.733+0000 7f831a000640 1 -- 172.21.15.37:0/1890332935 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83240af660 con 0x55f188a11b60 2024-08-20T05:12:04.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.733+0000 7f831a000640 1 -- 172.21.15.37:0/1890332935 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f83240cc1f0 con 0x55f188a11b60 2024-08-20T05:12:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.733+0000 7f8335fe4740 1 -- 172.21.15.37:0/1890332935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83240ab060 con 0x55f188a11b60 2024-08-20T05:12:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.733+0000 7f831a000640 1 -- 172.21.15.37:0/1890332935 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f83240aa2c0 con 0x55f188a11b60 2024-08-20T05:12:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.733+0000 7f8335fe4740 10 client.17526 fetch_fsmap learned FSMap version 43 2024-08-20T05:12:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.733+0000 7f8335fe4740 1 -- 172.21.15.37:0/1890332935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55f188a1d730 con 0x55f188a11b60 2024-08-20T05:12:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.733+0000 7f831a000640 1 -- 172.21.15.37:0/1890332935 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83240ab060 con 0x55f188a11b60 2024-08-20T05:12:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.733+0000 7f831a000640 1 -- 172.21.15.37:0/1890332935 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f8324086070 con 0x55f188a11b60 2024-08-20T05:12:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.733+0000 7f8335fe4740 10 client.17526 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:12:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.733+0000 7f8335fe4740 10 client.17526 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:12:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.733+0000 7f8335fe4740 20 client.17526 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.733+0000 7f8335fe4740 1 --2- 172.21.15.37:0/1890332935 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f188a1df80 0x55f188a8e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.734+0000 7f8335fe4740 4 client.17526 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:12:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.734+0000 7f8335fe4740 1 -- 172.21.15.37:0/1890332935 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f18897cc00 con 0x55f188a1df80 2024-08-20T05:12:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.734+0000 7f832be00640 1 --2- 172.21.15.37:0/1890332935 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f188a1df80 0x55f188a8e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:04.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.734+0000 7f832be00640 1 --2- 172.21.15.37:0/1890332935 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f188a1df80 0x55f188a8e8f0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1daa74cbcd0a870d server_cookie=45b179d9f6a9151a in_seq=0 out_seq=0 2024-08-20T05:12:04.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:04.734+0000 7f831a000640 10 client.17526 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:05.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.090+0000 7f831a000640 1 -- 172.21.15.37:0/1890332935 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f18897cc00 con 0x55f188a1df80 2024-08-20T05:12:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.090+0000 7f831a000640 10 client.17526 handle_command_reply: tid=0 2024-08-20T05:12:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.090+0000 7f8335fe4740 1 client.17526 shutdown 2024-08-20T05:12:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.090+0000 7f8335fe4740 1 -- 172.21.15.37:0/1890332935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 msgr2=0x55f188a1bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:05.115 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.090+0000 7f8335fe4740 1 --2- 172.21.15.37:0/1890332935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a1bd10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f83240ab330 tx=0x7f832400efd0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.091+0000 7f8335fe4740 1 -- 172.21.15.37:0/1890332935 shutdown_connections 2024-08-20T05:12:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.091+0000 7f8335fe4740 1 --2- 172.21.15.37:0/1890332935 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f188a1df80 0x55f188a8e8f0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.091+0000 7f8335fe4740 1 --2- 172.21.15.37:0/1890332935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f188a11b60 0x55f188a1bd10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.091+0000 7f8335fe4740 1 --2- 172.21.15.37:0/1890332935 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f188a0f120 0x55f188a1b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.091+0000 7f8335fe4740 1 --2- 172.21.15.37:0/1890332935 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f188a0c7f0 0x55f188a1aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.091+0000 7f831a000640 0 client.17526 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.091+0000 7f8335fe4740 1 -- 172.21.15.37:0/1890332935 >> 172.21.15.37:0/1890332935 conn(0x55f188a07940 msgr2=0x55f188a06190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.091+0000 7f8335fe4740 1 -- 172.21.15.37:0/1890332935 shutdown_connections 2024-08-20T05:12:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.091+0000 7f8335fe4740 1 -- 172.21.15.37:0/1890332935 wait complete. 2024-08-20T05:12:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.092+0000 7f8335fe4740 20 client.17526 trim_cache size 0 max 16384 2024-08-20T05:12:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:12:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:12:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:12:05.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:12:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.092+0000 7f8331a00640 1 -- 172.21.15.37:0/3110720612 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83100b3c50 msgr2=0x7f83100b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.092+0000 7f8331a00640 1 --2- 172.21.15.37:0/3110720612 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83100b3c50 0x7f83100b6110 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f831c031500 tx=0x7f831c005a20 comp rx=0 tx=0).stop 2024-08-20T05:12:05.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.093+0000 7f8331a00640 1 -- 172.21.15.37:0/3110720612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f832c105f90 msgr2=0x7f832c1a00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.093+0000 7f8331a00640 1 --2- 172.21.15.37:0/3110720612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f832c105f90 0x7f832c1a00f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f832400eb10 tx=0x7f832400c2d0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.093+0000 7f8331a00640 1 -- 172.21.15.37:0/3110720612 shutdown_connections 2024-08-20T05:12:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.093+0000 7f8331a00640 1 --2- 172.21.15.37:0/3110720612 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83100b3c50 0x7f83100b6110 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.093+0000 7f8331a00640 1 --2- 172.21.15.37:0/3110720612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f832c105f90 0x7f832c1a00f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.093+0000 7f8331a00640 1 --2- 172.21.15.37:0/3110720612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f832c1033e0 0x7f832c19f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.093+0000 7f8331a00640 1 --2- 172.21.15.37:0/3110720612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832c06b170 0x7f832c19ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.093+0000 7f8331a00640 1 -- 172.21.15.37:0/3110720612 >> 172.21.15.37:0/3110720612 conn(0x7f832c0fcc50 msgr2=0x7f832c104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.093+0000 7f8331a00640 1 -- 172.21.15.37:0/3110720612 shutdown_connections 2024-08-20T05:12:05.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:05.093+0000 7f8331a00640 1 -- 172.21.15.37:0/3110720612 wait complete. 2024-08-20T05:12:05.625 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:05 smithi037 ceph-mon[17265]: pgmap v696: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.4 MiB/s wr, 286 op/s 2024-08-20T05:12:05.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.591+0000 7f7c2a600640 1 -- 172.21.15.37:0/242823468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c24102ab0 msgr2=0x7f7c24102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:05.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.591+0000 7f7c2a600640 1 --2- 172.21.15.37:0/242823468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c24102ab0 0x7f7c24102e90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009860 tx=0x7f7c1402a340 comp rx=0 tx=0).stop 2024-08-20T05:12:05.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.591+0000 7f7c2a600640 1 -- 172.21.15.37:0/242823468 shutdown_connections 2024-08-20T05:12:05.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.591+0000 7f7c2a600640 1 --2- 172.21.15.37:0/242823468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24108e40 0x7f7c2410f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.591+0000 7f7c2a600640 1 --2- 172.21.15.37:0/242823468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c241084c0 0x7f7c24108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.591+0000 7f7c2a600640 1 --2- 172.21.15.37:0/242823468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c24102ab0 0x7f7c24102e90 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.591+0000 7f7c2a600640 1 -- 172.21.15.37:0/242823468 >> 172.21.15.37:0/242823468 conn(0x7f7c240fe520 msgr2=0x7f7c24100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.594+0000 7f7c2a600640 1 -- 172.21.15.37:0/242823468 shutdown_connections 2024-08-20T05:12:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.594+0000 7f7c2a600640 1 -- 172.21.15.37:0/242823468 wait complete. 2024-08-20T05:12:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.595+0000 7f7c2a600640 1 Processor -- start 2024-08-20T05:12:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.595+0000 7f7c2a600640 1 -- start start 2024-08-20T05:12:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.596+0000 7f7c2a600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c24102ab0 0x7f7c241120f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.596+0000 7f7c2a600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c241084c0 0x7f7c24112630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.596+0000 7f7c2a600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24108e40 0x7f7c241179d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.596+0000 7f7c2a600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c24076c40 con 0x7f7c241084c0 2024-08-20T05:12:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.596+0000 7f7c2a600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7c24076ac0 con 0x7f7c24102ab0 2024-08-20T05:12:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.596+0000 7f7c2a600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7c24076dc0 con 0x7f7c24108e40 2024-08-20T05:12:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.596+0000 7f7c23400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c24102ab0 0x7f7c241120f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.596+0000 7f7c23e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24108e40 0x7f7c241179d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.596+0000 7f7c23400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c24102ab0 0x7f7c241120f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:59292/0 (socket says 172.21.15.37:59292) 2024-08-20T05:12:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.596+0000 7f7c23400640 1 -- 172.21.15.37:0/2713226840 learned_addr learned my addr 172.21.15.37:0/2713226840 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.597+0000 7f7c22a00640 1 --2- 172.21.15.37:0/2713226840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c241084c0 0x7f7c24112630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.597+0000 7f7c23400640 1 -- 172.21.15.37:0/2713226840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24108e40 msgr2=0x7f7c241179d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.597+0000 7f7c23400640 1 --2- 172.21.15.37:0/2713226840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24108e40 0x7f7c241179d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.597+0000 7f7c23400640 1 -- 172.21.15.37:0/2713226840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c241084c0 msgr2=0x7f7c24112630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.597+0000 7f7c23400640 1 --2- 172.21.15.37:0/2713226840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c241084c0 0x7f7c24112630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.597+0000 7f7c23400640 1 -- 172.21.15.37:0/2713226840 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c24118150 con 0x7f7c24102ab0 2024-08-20T05:12:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.597+0000 7f7c22a00640 1 --2- 172.21.15.37:0/2713226840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c241084c0 0x7f7c24112630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:12:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.597+0000 7f7c23400640 1 --2- 172.21.15.37:0/2713226840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c24102ab0 0x7f7c241120f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7c1402a8b0 tx=0x7f7c14032d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.598+0000 7f7c1be00640 1 -- 172.21.15.37:0/2713226840 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14042070 con 0x7f7c24102ab0 2024-08-20T05:12:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.598+0000 7f7c1be00640 1 -- 172.21.15.37:0/2713226840 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c14030e10 con 0x7f7c24102ab0 2024-08-20T05:12:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.598+0000 7f7c1be00640 1 -- 172.21.15.37:0/2713226840 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14037040 con 0x7f7c24102ab0 2024-08-20T05:12:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.598+0000 7f7c2a600640 1 -- 172.21.15.37:0/2713226840 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c241183e0 con 0x7f7c24102ab0 2024-08-20T05:12:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.598+0000 7f7c2a600640 1 -- 172.21.15.37:0/2713226840 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c2411cb60 con 0x7f7c24102ab0 2024-08-20T05:12:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.603+0000 7f7c2d0d8740 1 Processor -- start 2024-08-20T05:12:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.603+0000 7f7c2d0d8740 1 -- start start 2024-08-20T05:12:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.604+0000 7f7c2d0d8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397b940 0x55a05397bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.604+0000 7f7c2d0d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a05397c260 0x55a053987cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.604+0000 7f7c2d0d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0539881f0 0x55a05398a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.604+0000 7f7c2d0d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a0538f1aa0 con 0x55a0539881f0 2024-08-20T05:12:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.604+0000 7f7c2d0d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a0538e0fa0 con 0x55a05397c260 2024-08-20T05:12:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.604+0000 7f7c2d0d8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a0538e4fe0 con 0x55a05397b940 2024-08-20T05:12:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.605+0000 7f7c23e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397b940 0x55a05397bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.605+0000 7f7c23e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397b940 0x55a05397bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51140/0 (socket says 172.21.15.37:51140) 2024-08-20T05:12:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.605+0000 7f7c23e00640 1 -- 172.21.15.37:0/2862368218 learned_addr learned my addr 172.21.15.37:0/2862368218 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.606+0000 7f7c23e00640 1 -- 172.21.15.37:0/2862368218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a05397c260 msgr2=0x55a053987cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:12:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.606+0000 7f7c23e00640 1 --2- 172.21.15.37:0/2862368218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a05397c260 0x55a053987cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.606+0000 7f7c23e00640 1 -- 172.21.15.37:0/2862368218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0539881f0 msgr2=0x55a05398a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.606+0000 7f7c23e00640 1 --2- 172.21.15.37:0/2862368218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0539881f0 0x55a05398a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.606+0000 7f7c23e00640 1 -- 172.21.15.37:0/2862368218 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a053887420 con 0x55a05397b940 2024-08-20T05:12:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.610+0000 7f7c1be00640 1 -- 172.21.15.37:0/2713226840 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7c14030450 con 0x7f7c24102ab0 2024-08-20T05:12:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.611+0000 7f7c23e00640 1 --2- 172.21.15.37:0/2862368218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397b940 0x55a05397bd20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009fd0 tx=0x7f7c1c010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91b500a0bda6f28b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.611+0000 7f7c18c00640 1 -- 172.21.15.37:0/2862368218 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c011700 con 0x55a05397b940 2024-08-20T05:12:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.611+0000 7f7c18c00640 1 -- 172.21.15.37:0/2862368218 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c1c011d50 con 0x55a05397b940 2024-08-20T05:12:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.612+0000 7f7c18c00640 1 -- 172.21.15.37:0/2862368218 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c01a380 con 0x55a05397b940 2024-08-20T05:12:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.615+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/2862368218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397b940 msgr2=0x55a05397bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.615+0000 7f7c1be00640 1 --2- 172.21.15.37:0/2713226840 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7c080b3d60 0x7f7c080b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.615+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/2862368218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397b940 0x55a05397bd20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009fd0 tx=0x7f7c1c010860 comp rx=0 tx=0).stop 2024-08-20T05:12:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.616+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/2862368218 shutdown_connections 2024-08-20T05:12:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.616+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/2862368218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0539881f0 0x55a05398a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.616+0000 7f7c1be00640 1 -- 172.21.15.37:0/2713226840 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7c14103620 con 0x7f7c24102ab0 2024-08-20T05:12:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.616+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/2862368218 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a05397c260 0x55a053987cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.616+0000 7f7c23400640 1 --2- 172.21.15.37:0/2713226840 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7c080b3d60 0x7f7c080b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.617+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/2862368218 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397b940 0x55a05397bd20 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.617+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/2862368218 >> 172.21.15.37:0/2862368218 conn(0x55a053979770 msgr2=0x55a05397a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.618+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/2862368218 shutdown_connections 2024-08-20T05:12:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.619+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/2862368218 wait complete. 2024-08-20T05:12:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.620+0000 7f7c2d0d8740 1 -- start start 2024-08-20T05:12:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.620+0000 7f7c23400640 1 --2- 172.21.15.37:0/2713226840 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7c080b3d60 0x7f7c080b6220 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7c140c62d0 tx=0x7f7c14030fc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.620+0000 7f7c2d0d8740 1 Processor -- start 2024-08-20T05:12:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.621+0000 7f7c2d0d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a05397b940 0x55a053987a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.621+0000 7f7c2d0d8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397c260 0x55a053984e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.622+0000 7f7c2d0d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0539881f0 0x55a0539853b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.622+0000 7f7c2d0d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a053743700 con 0x55a05397b940 2024-08-20T05:12:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.622+0000 7f7c2d0d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a05387c290 con 0x55a0539881f0 2024-08-20T05:12:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.622+0000 7f7c2d0d8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a05398ae70 con 0x55a05397c260 2024-08-20T05:12:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.622+0000 7f7c2d0d8740 10 client.0 _ll_register_callbacks cb 0x55a0538db1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.622+0000 7f7c23e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a05397b940 0x55a053987a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.622+0000 7f7c23e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a05397b940 0x55a053987a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54924/0 (socket says 172.21.15.37:54924) 2024-08-20T05:12:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.622+0000 7f7c23e00640 1 -- 172.21.15.37:0/2247685001 learned_addr learned my addr 172.21.15.37:0/2247685001 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.622+0000 7f7c23e00640 1 --2- 172.21.15.37:0/2247685001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0539881f0 0x55a0539853b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.622+0000 7f7c23e00640 1 -- 172.21.15.37:0/2247685001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397c260 msgr2=0x55a053984e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.622+0000 7f7c23e00640 1 --2- 172.21.15.37:0/2247685001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397c260 0x55a053984e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.622+0000 7f7c23e00640 1 -- 172.21.15.37:0/2247685001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0539881f0 msgr2=0x55a0539853b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.622+0000 7f7c23e00640 1 --2- 172.21.15.37:0/2247685001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0539881f0 0x55a0539853b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.622+0000 7f7c23e00640 1 -- 172.21.15.37:0/2247685001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a053640650 con 0x55a05397b940 2024-08-20T05:12:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.623+0000 7f7c23e00640 1 --2- 172.21.15.37:0/2247685001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a05397b940 0x55a053987a20 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009de0 tx=0x7f7c1c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b6fb2f916e4642 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.623+0000 7f7c0d600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:12:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.627+0000 7f7c0d600640 1 -- 172.21.15.37:0/2247685001 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c024040 con 0x55a05397b940 2024-08-20T05:12:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.627+0000 7f7c0d600640 1 -- 172.21.15.37:0/2247685001 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7c1c004d40 con 0x55a05397b940 2024-08-20T05:12:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.627+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/2247685001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c1c011d50 con 0x55a05397b940 2024-08-20T05:12:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.627+0000 7f7c0d600640 1 -- 172.21.15.37:0/2247685001 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f7c1c034050 con 0x55a05397b940 2024-08-20T05:12:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.627+0000 7f7c2d0d8740 10 client.17532 fetch_fsmap learned FSMap version 43 2024-08-20T05:12:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.627+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/2247685001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55a053996710 con 0x55a05397b940 2024-08-20T05:12:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.628+0000 7f7c0d600640 1 -- 172.21.15.37:0/2247685001 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c1c011d50 con 0x55a05397b940 2024-08-20T05:12:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.628+0000 7f7c0d600640 1 -- 172.21.15.37:0/2247685001 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f7c1c004020 con 0x55a05397b940 2024-08-20T05:12:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.628+0000 7f7c2d0d8740 10 client.17532 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:12:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.628+0000 7f7c2d0d8740 10 client.17532 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:12:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.628+0000 7f7c2d0d8740 20 client.17532 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.628+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/2247685001 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55a053997a60 0x55a053999e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.628+0000 7f7c2d0d8740 4 client.17532 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:12:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.628+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/2247685001 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0538f39f0 con 0x55a053997a60 2024-08-20T05:12:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.629+0000 7f7c22a00640 1 --2- 172.21.15.37:0/2247685001 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55a053997a60 0x55a053999e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.629+0000 7f7c22a00640 1 --2- 172.21.15.37:0/2247685001 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55a053997a60 0x55a053999e50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b84ddb261da89539 server_cookie=10c3a65ff6b18a99 in_seq=0 out_seq=0 2024-08-20T05:12:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.629+0000 7f7c0d600640 10 client.17532 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:12:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.630+0000 7f7c0d600640 1 -- 172.21.15.37:0/2247685001 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0538f39f0 con 0x55a053997a60 2024-08-20T05:12:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.630+0000 7f7c0d600640 10 client.17532 handle_command_reply: tid=0 2024-08-20T05:12:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.630+0000 7f7c2d0d8740 1 client.17532 shutdown 2024-08-20T05:12:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.631+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/2247685001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a05397b940 msgr2=0x55a053987a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.631+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/2247685001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a05397b940 0x55a053987a20 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009de0 tx=0x7f7c1c01ca90 comp rx=0 tx=0).stop 2024-08-20T05:12:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.631+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/2247685001 shutdown_connections 2024-08-20T05:12:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.631+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/2247685001 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55a053997a60 0x55a053999e50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.631+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/2247685001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0539881f0 0x55a0539853b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.631+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/2247685001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397c260 0x55a053984e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.631+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/2247685001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a05397b940 0x55a053987a20 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.631+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/2247685001 >> 172.21.15.37:0/2247685001 conn(0x55a053979770 msgr2=0x55a05397f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.632+0000 7f7c0d600640 0 client.17532 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:12:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.632+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/2247685001 shutdown_connections 2024-08-20T05:12:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.632+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/2247685001 wait complete. 2024-08-20T05:12:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.632+0000 7f7c2d0d8740 20 client.17532 trim_cache size 0 max 16384 2024-08-20T05:12:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.653+0000 7f7c2d0d8740 1 Processor -- start 2024-08-20T05:12:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.653+0000 7f7c2d0d8740 1 -- start start 2024-08-20T05:12:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.654+0000 7f7c2d0d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a05397b940 0x55a053993fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.654+0000 7f7c2d0d8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397c260 0x55a05399f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.654+0000 7f7c2d0d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0539881f0 0x55a05399f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.654+0000 7f7c2d0d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241be680 con 0x55a0539881f0 2024-08-20T05:12:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.654+0000 7f7c2d0d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241c0250 con 0x55a05397b940 2024-08-20T05:12:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.654+0000 7f7c2d0d8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241bed50 con 0x55a05397c260 2024-08-20T05:12:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.654+0000 7f7c23e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a05397b940 0x55a053993fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.654+0000 7f7c23e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a05397b940 0x55a053993fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:59316/0 (socket says 172.21.15.37:59316) 2024-08-20T05:12:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.654+0000 7f7c23e00640 1 -- 172.21.15.37:0/1707408579 learned_addr learned my addr 172.21.15.37:0/1707408579 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.654+0000 7f7c23e00640 1 --2- 172.21.15.37:0/1707408579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0539881f0 0x55a05399f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.654+0000 7f7c22a00640 1 --2- 172.21.15.37:0/1707408579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397c260 0x55a05399f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.655+0000 7f7c23e00640 1 -- 172.21.15.37:0/1707408579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397c260 msgr2=0x55a05399f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.655+0000 7f7c23e00640 1 --2- 172.21.15.37:0/1707408579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397c260 0x55a05399f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.655+0000 7f7c23e00640 1 -- 172.21.15.37:0/1707408579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0539881f0 msgr2=0x55a05399f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.655+0000 7f7c23e00640 1 --2- 172.21.15.37:0/1707408579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0539881f0 0x55a05399f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.655+0000 7f7c23e00640 1 -- 172.21.15.37:0/1707408579 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a053984c20 con 0x55a05397b940 2024-08-20T05:12:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.655+0000 7f7c23e00640 1 --2- 172.21.15.37:0/1707408579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a05397b940 0x55a053993fc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009d60 tx=0x7f7c1c010860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eabf5e3ec88efc7e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.655+0000 7f7c0fe00640 1 -- 172.21.15.37:0/1707408579 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0047b0 con 0x55a05397b940 2024-08-20T05:12:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.655+0000 7f7c0fe00640 1 -- 172.21.15.37:0/1707408579 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c1c010d60 con 0x55a05397b940 2024-08-20T05:12:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.655+0000 7f7c0fe00640 1 -- 172.21.15.37:0/1707408579 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c004000 con 0x55a05397b940 2024-08-20T05:12:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.656+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/1707408579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a05397b940 msgr2=0x55a053993fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.656+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/1707408579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a05397b940 0x55a053993fc0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009d60 tx=0x7f7c1c010860 comp rx=0 tx=0).stop 2024-08-20T05:12:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.656+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/1707408579 shutdown_connections 2024-08-20T05:12:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.656+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/1707408579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0539881f0 0x55a05399f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.656+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/1707408579 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397c260 0x55a05399f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.656+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/1707408579 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a05397b940 0x55a053993fc0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.656+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/1707408579 >> 172.21.15.37:0/1707408579 conn(0x55a053979770 msgr2=0x55a053986cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.657+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/1707408579 shutdown_connections 2024-08-20T05:12:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.657+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/1707408579 wait complete. 2024-08-20T05:12:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.657+0000 7f7c2d0d8740 1 -- start start 2024-08-20T05:12:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.657+0000 7f7c2d0d8740 1 Processor -- start 2024-08-20T05:12:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.658+0000 7f7c2d0d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a05397b940 0x55a053990540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.658+0000 7f7c2d0d8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397c260 0x55a05398ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.658+0000 7f7c2d0d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0539881f0 0x55a05398bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.658+0000 7f7c2d0d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241bfb50 con 0x55a05397b940 2024-08-20T05:12:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.658+0000 7f7c2d0d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241bf420 con 0x55a0539881f0 2024-08-20T05:12:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.658+0000 7f7c2d0d8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241bc660 con 0x55a05397c260 2024-08-20T05:12:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.658+0000 7f7c2d0d8740 10 client.0 _ll_register_callbacks cb 0x7f7c1c009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.659+0000 7f7c23e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a05397b940 0x55a053990540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.659+0000 7f7c23e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a05397b940 0x55a053990540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54946/0 (socket says 172.21.15.37:54946) 2024-08-20T05:12:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.659+0000 7f7c23e00640 1 -- 172.21.15.37:0/1879873546 learned_addr learned my addr 172.21.15.37:0/1879873546 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.659+0000 7f7c23e00640 1 --2- 172.21.15.37:0/1879873546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0539881f0 0x55a05398bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.659+0000 7f7c22a00640 1 --2- 172.21.15.37:0/1879873546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397c260 0x55a05398ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.659+0000 7f7c22a00640 1 -- 172.21.15.37:0/1879873546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0539881f0 msgr2=0x55a05398bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.659+0000 7f7c22a00640 1 --2- 172.21.15.37:0/1879873546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0539881f0 0x55a05398bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.659+0000 7f7c22a00640 1 -- 172.21.15.37:0/1879873546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a05397b940 msgr2=0x55a053990540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.659+0000 7f7c22a00640 1 --2- 172.21.15.37:0/1879873546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a05397b940 0x55a053990540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.659+0000 7f7c22a00640 1 -- 172.21.15.37:0/1879873546 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a05398c510 con 0x55a05397c260 2024-08-20T05:12:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.659+0000 7f7c23e00640 1 --2- 172.21.15.37:0/1879873546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a05397b940 0x55a053990540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:12:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.660+0000 7f7c22a00640 1 --2- 172.21.15.37:0/1879873546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397c260 0x55a05398ba10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x55a05399a3f0 tx=0x7f7c10011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0041f501d3a5293 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.660+0000 7f7c0d600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:12:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.660+0000 7f7c0d600640 1 -- 172.21.15.37:0/1879873546 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10005460 con 0x55a05397c260 2024-08-20T05:12:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.660+0000 7f7c0d600640 1 -- 172.21.15.37:0/1879873546 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7c10004730 con 0x55a05397c260 2024-08-20T05:12:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.660+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/1879873546 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c1c010d60 con 0x55a05397c260 2024-08-20T05:12:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.660+0000 7f7c0d600640 1 -- 172.21.15.37:0/1879873546 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f7c10005600 con 0x55a05397c260 2024-08-20T05:12:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.660+0000 7f7c2d0d8740 10 client.28024 fetch_fsmap learned FSMap version 43 2024-08-20T05:12:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.660+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/1879873546 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55a053a022b0 con 0x55a05397c260 2024-08-20T05:12:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.660+0000 7f7c0d600640 1 -- 172.21.15.37:0/1879873546 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c1c010d60 con 0x55a05397c260 2024-08-20T05:12:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.661+0000 7f7c0d600640 1 -- 172.21.15.37:0/1879873546 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f7c1000f950 con 0x55a05397c260 2024-08-20T05:12:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.661+0000 7f7c2d0d8740 10 client.28024 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:12:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.661+0000 7f7c2d0d8740 10 client.28024 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:12:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.661+0000 7f7c2d0d8740 20 client.28024 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.661+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/1879873546 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55a053a02a60 0x55a053a04e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.661+0000 7f7c2d0d8740 4 client.28024 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:12:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.661+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/1879873546 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a0538ef490 con 0x55a053a02a60 2024-08-20T05:12:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.662+0000 7f7c23e00640 1 --2- 172.21.15.37:0/1879873546 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55a053a02a60 0x55a053a04e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.663+0000 7f7c23e00640 1 --2- 172.21.15.37:0/1879873546 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55a053a02a60 0x55a053a04e80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c466b916d66b5df3 server_cookie=e2b06bcbce2c05fc in_seq=0 out_seq=0 2024-08-20T05:12:05.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.663+0000 7f7c0d600640 10 client.28024 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:12:05.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.663+0000 7f7c0d600640 1 -- 172.21.15.37:0/1879873546 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a0538ef490 con 0x55a053a02a60 2024-08-20T05:12:05.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.663+0000 7f7c0d600640 10 client.28024 handle_command_reply: tid=0 2024-08-20T05:12:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.663+0000 7f7c2d0d8740 1 client.28024 shutdown 2024-08-20T05:12:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.664+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/1879873546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397c260 msgr2=0x55a05398ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.664+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/1879873546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397c260 0x55a05398ba10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x55a05399a3f0 tx=0x7f7c10011810 comp rx=0 tx=0).stop 2024-08-20T05:12:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.664+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/1879873546 shutdown_connections 2024-08-20T05:12:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.664+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/1879873546 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55a053a02a60 0x55a053a04e80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.664+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/1879873546 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a0539881f0 0x55a05398bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.664+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/1879873546 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a05397c260 0x55a05398ba10 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.664+0000 7f7c2d0d8740 1 --2- 172.21.15.37:0/1879873546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a05397b940 0x55a053990540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.664+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/1879873546 >> 172.21.15.37:0/1879873546 conn(0x55a053979770 msgr2=0x55a0539864a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.665+0000 7f7c0d600640 0 client.28024 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:12:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.665+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/1879873546 shutdown_connections 2024-08-20T05:12:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.665+0000 7f7c2d0d8740 1 -- 172.21.15.37:0/1879873546 wait complete. 2024-08-20T05:12:05.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.665+0000 7f7c2d0d8740 20 client.28024 trim_cache size 0 max 16384 2024-08-20T05:12:05.683 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:12:05.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.666+0000 7f7c2a600640 1 -- 172.21.15.37:0/2713226840 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7c080b3d60 msgr2=0x7f7c080b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:05.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.666+0000 7f7c2a600640 1 --2- 172.21.15.37:0/2713226840 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7c080b3d60 0x7f7c080b6220 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7c140c62d0 tx=0x7f7c14030fc0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.667+0000 7f7c2a600640 1 -- 172.21.15.37:0/2713226840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c24102ab0 msgr2=0x7f7c241120f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:05.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.667+0000 7f7c2a600640 1 --2- 172.21.15.37:0/2713226840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c24102ab0 0x7f7c241120f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f7c1402a8b0 tx=0x7f7c14032d20 comp rx=0 tx=0).stop 2024-08-20T05:12:05.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.667+0000 7f7c2a600640 1 -- 172.21.15.37:0/2713226840 shutdown_connections 2024-08-20T05:12:05.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.667+0000 7f7c2a600640 1 --2- 172.21.15.37:0/2713226840 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7c080b3d60 0x7f7c080b6220 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.667+0000 7f7c2a600640 1 --2- 172.21.15.37:0/2713226840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c24108e40 0x7f7c241179d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.667+0000 7f7c2a600640 1 --2- 172.21.15.37:0/2713226840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c241084c0 0x7f7c24112630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.667+0000 7f7c2a600640 1 --2- 172.21.15.37:0/2713226840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c24102ab0 0x7f7c241120f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:05.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.667+0000 7f7c2a600640 1 -- 172.21.15.37:0/2713226840 >> 172.21.15.37:0/2713226840 conn(0x7f7c240fe520 msgr2=0x7f7c24100910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:05.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.667+0000 7f7c2a600640 1 -- 172.21.15.37:0/2713226840 shutdown_connections 2024-08-20T05:12:05.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:05.667+0000 7f7c2a600640 1 -- 172.21.15.37:0/2713226840 wait complete. 2024-08-20T05:12:05.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:05 smithi130 ceph-mon[22007]: pgmap v696: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.4 MiB/s wr, 286 op/s 2024-08-20T05:12:05.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:05 smithi135 ceph-mon[22342]: pgmap v696: 129 pgs: 129 active+clean; 1.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.4 MiB/s wr, 286 op/s 2024-08-20T05:12:06.681 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T05:12:07.358 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:12:07.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:07 smithi130 ceph-mon[22007]: pgmap v697: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 3.3 MiB/s wr, 380 op/s 2024-08-20T05:12:07.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:07 smithi037 ceph-mon[17265]: pgmap v697: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 3.3 MiB/s wr, 380 op/s 2024-08-20T05:12:07.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:07 smithi135 ceph-mon[22342]: pgmap v697: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 3.3 MiB/s wr, 380 op/s 2024-08-20T05:12:08.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 550.0 s, 502.8 tps, lat 204.495 ms stddev 239.499 2024-08-20T05:12:09.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.370+0000 7f1bdd800640 1 -- 172.21.15.37:0/1035569735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd810b030 msgr2=0x7f1bd8111830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:09.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.370+0000 7f1bdd800640 1 --2- 172.21.15.37:0/1035569735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd810b030 0x7f1bd8111830 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009ca0 tx=0x7f1bd002a8f0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.370+0000 7f1bdd800640 1 -- 172.21.15.37:0/1035569735 shutdown_connections 2024-08-20T05:12:09.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.370+0000 7f1bdd800640 1 --2- 172.21.15.37:0/1035569735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd810b030 0x7f1bd8111830 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.370+0000 7f1bdd800640 1 --2- 172.21.15.37:0/1035569735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bd810a6b0 0x7f1bd810aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.370+0000 7f1bdd800640 1 --2- 172.21.15.37:0/1035569735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd8104ca0 0x7f1bd8105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.370+0000 7f1bdd800640 1 -- 172.21.15.37:0/1035569735 >> 172.21.15.37:0/1035569735 conn(0x7f1bd8100730 msgr2=0x7f1bd8102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:09.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.371+0000 7f1bdd800640 1 -- 172.21.15.37:0/1035569735 shutdown_connections 2024-08-20T05:12:09.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.371+0000 7f1bdd800640 1 -- 172.21.15.37:0/1035569735 wait complete. 2024-08-20T05:12:09.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.372+0000 7f1bdd800640 1 Processor -- start 2024-08-20T05:12:09.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.373+0000 7f1bdd800640 1 -- start start 2024-08-20T05:12:09.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.374+0000 7f1bdd800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bd8104ca0 0x7f1bd8111640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.374+0000 7f1bdd800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd810a6b0 0x7f1bd810e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.374+0000 7f1bdd800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd810b030 0x7f1bd810ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.374+0000 7f1bdd800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd8114d70 con 0x7f1bd810b030 2024-08-20T05:12:09.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.374+0000 7f1bdd800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd8114bf0 con 0x7f1bd8104ca0 2024-08-20T05:12:09.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.374+0000 7f1bdd800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd8114ef0 con 0x7f1bd810a6b0 2024-08-20T05:12:09.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.374+0000 7f1bd6a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bd8104ca0 0x7f1bd8111640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:09.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.375+0000 7f1bd6a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bd8104ca0 0x7f1bd8111640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:59358/0 (socket says 172.21.15.37:59358) 2024-08-20T05:12:09.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.375+0000 7f1bd6a00640 1 -- 172.21.15.37:0/7052795 learned_addr learned my addr 172.21.15.37:0/7052795 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:09.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.375+0000 7f1bd7400640 1 --2- 172.21.15.37:0/7052795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd810b030 0x7f1bd810ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:09.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.375+0000 7f1bd6a00640 1 -- 172.21.15.37:0/7052795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd810a6b0 msgr2=0x7f1bd810e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:09.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.375+0000 7f1bd6000640 1 --2- 172.21.15.37:0/7052795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd810a6b0 0x7f1bd810e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:09.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.376+0000 7f1bd6a00640 1 --2- 172.21.15.37:0/7052795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd810a6b0 0x7f1bd810e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.376+0000 7f1bd6a00640 1 -- 172.21.15.37:0/7052795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd810b030 msgr2=0x7f1bd810ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:09.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.376+0000 7f1bd6a00640 1 --2- 172.21.15.37:0/7052795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd810b030 0x7f1bd810ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.376+0000 7f1bd6a00640 1 -- 172.21.15.37:0/7052795 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd81a1290 con 0x7f1bd8104ca0 2024-08-20T05:12:09.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.376+0000 7f1bd7400640 1 --2- 172.21.15.37:0/7052795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd810b030 0x7f1bd810ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:12:09.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.376+0000 7f1bd6000640 1 --2- 172.21.15.37:0/7052795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd810a6b0 0x7f1bd810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:12:09.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.377+0000 7f1bd6a00640 1 --2- 172.21.15.37:0/7052795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bd8104ca0 0x7f1bd8111640 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800b450 tx=0x7f1bc800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:09.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.377+0000 7f1bcf400640 1 -- 172.21.15.37:0/7052795 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8015020 con 0x7f1bd8104ca0 2024-08-20T05:12:09.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.377+0000 7f1bdd800640 1 -- 172.21.15.37:0/7052795 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd81a1580 con 0x7f1bd8104ca0 2024-08-20T05:12:09.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.377+0000 7f1bdd800640 1 -- 172.21.15.37:0/7052795 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd81a1b40 con 0x7f1bd8104ca0 2024-08-20T05:12:09.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.379+0000 7f1bcf400640 1 -- 172.21.15.37:0/7052795 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bc8011d40 con 0x7f1bd8104ca0 2024-08-20T05:12:09.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.379+0000 7f1bcf400640 1 -- 172.21.15.37:0/7052795 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8015020 con 0x7f1bd8104ca0 2024-08-20T05:12:09.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.388+0000 7f1be0242740 1 Processor -- start 2024-08-20T05:12:09.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.388+0000 7f1be0242740 1 -- start start 2024-08-20T05:12:09.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.389+0000 7f1be0242740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1605940 0x557dc1605d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.389+0000 7f1be0242740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc1606260 0x557dc1611cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.389+0000 7f1be0242740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc16121f0 0x557dc16145e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.389+0000 7f1bd7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1605940 0x557dc1605d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:09.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.389+0000 7f1bd7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1605940 0x557dc1605d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51198/0 (socket says 172.21.15.37:51198) 2024-08-20T05:12:09.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.389+0000 7f1bd7400640 1 -- 172.21.15.37:0/1925444934 learned_addr learned my addr 172.21.15.37:0/1925444934 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:09.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.390+0000 7f1be0242740 1 -- 172.21.15.37:0/1925444934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557dc157baa0 con 0x557dc1606260 2024-08-20T05:12:09.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.390+0000 7f1be0242740 1 -- 172.21.15.37:0/1925444934 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557dc156afa0 con 0x557dc16121f0 2024-08-20T05:12:09.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.390+0000 7f1bd6000640 1 --2- 172.21.15.37:0/1925444934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc16121f0 0x557dc16145e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:09.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.390+0000 7f1be0242740 1 -- 172.21.15.37:0/1925444934 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557dc156efe0 con 0x557dc1605940 2024-08-20T05:12:09.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.390+0000 7f1bd7400640 1 -- 172.21.15.37:0/1925444934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc16121f0 msgr2=0x557dc16145e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:09.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.390+0000 7f1bd7400640 1 --2- 172.21.15.37:0/1925444934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc16121f0 0x557dc16145e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.390+0000 7f1bd7400640 1 -- 172.21.15.37:0/1925444934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc1606260 msgr2=0x557dc1611cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:12:09.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.390+0000 7f1bd7400640 1 --2- 172.21.15.37:0/1925444934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc1606260 0x557dc1611cb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.391+0000 7f1bd7400640 1 -- 172.21.15.37:0/1925444934 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dc1511420 con 0x557dc1605940 2024-08-20T05:12:09.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.391+0000 7f1bd7400640 1 --2- 172.21.15.37:0/1925444934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1605940 0x557dc1605d20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0035000 tx=0x7f1bd002f490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf028f9406394f8c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:09.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.391+0000 7f1bc3e00640 1 -- 172.21.15.37:0/1925444934 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0031700 con 0x557dc1605940 2024-08-20T05:12:09.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.391+0000 7f1bc3e00640 1 -- 172.21.15.37:0/1925444934 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bd0036040 con 0x557dc1605940 2024-08-20T05:12:09.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.391+0000 7f1bcf400640 1 -- 172.21.15.37:0/7052795 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1bc8018020 con 0x7f1bd8104ca0 2024-08-20T05:12:09.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.394+0000 7f1bcf400640 1 --2- 172.21.15.37:0/7052795 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1bbc0b3f20 0x7f1bbc0b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.394+0000 7f1bcf400640 1 -- 172.21.15.37:0/7052795 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1bc80e3720 con 0x7f1bd8104ca0 2024-08-20T05:12:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.395+0000 7f1bc3e00640 1 -- 172.21.15.37:0/1925444934 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00047d0 con 0x557dc1605940 2024-08-20T05:12:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.395+0000 7f1bd6a00640 1 --2- 172.21.15.37:0/7052795 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1bbc0b3f20 0x7f1bbc0b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.396+0000 7f1be0242740 1 -- 172.21.15.37:0/1925444934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1605940 msgr2=0x557dc1605d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.396+0000 7f1be0242740 1 --2- 172.21.15.37:0/1925444934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1605940 0x557dc1605d20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0035000 tx=0x7f1bd002f490 comp rx=0 tx=0).stop 2024-08-20T05:12:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.396+0000 7f1be0242740 1 -- 172.21.15.37:0/1925444934 shutdown_connections 2024-08-20T05:12:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.396+0000 7f1be0242740 1 --2- 172.21.15.37:0/1925444934 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc16121f0 0x557dc16145e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.397+0000 7f1be0242740 1 --2- 172.21.15.37:0/1925444934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc1606260 0x557dc1611cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.397+0000 7f1be0242740 1 --2- 172.21.15.37:0/1925444934 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1605940 0x557dc1605d20 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.397+0000 7f1be0242740 1 -- 172.21.15.37:0/1925444934 >> 172.21.15.37:0/1925444934 conn(0x557dc1603770 msgr2=0x557dc1604910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.397+0000 7f1bd6a00640 1 --2- 172.21.15.37:0/7052795 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1bbc0b3f20 0x7f1bbc0b63e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80a71a0 tx=0x7f1bc8004770 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.401+0000 7f1be0242740 1 -- 172.21.15.37:0/1925444934 shutdown_connections 2024-08-20T05:12:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.401+0000 7f1be0242740 1 -- 172.21.15.37:0/1925444934 wait complete. 2024-08-20T05:12:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.402+0000 7f1be0242740 1 -- start start 2024-08-20T05:12:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.402+0000 7f1be0242740 1 Processor -- start 2024-08-20T05:12:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.403+0000 7f1be0242740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1605940 0x557dc1611990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.403+0000 7f1be0242740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1606260 0x557dc160ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.403+0000 7f1be0242740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc16121f0 0x557dc160f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.403+0000 7f1be0242740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557dc13cd700 con 0x557dc16121f0 2024-08-20T05:12:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.403+0000 7f1be0242740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557dc1506290 con 0x557dc1606260 2024-08-20T05:12:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.403+0000 7f1be0242740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557dc1614e10 con 0x557dc1605940 2024-08-20T05:12:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.403+0000 7f1be0242740 10 client.0 _ll_register_callbacks cb 0x557dc15651c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.404+0000 7f1bd7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1605940 0x557dc1611990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.404+0000 7f1bd7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1605940 0x557dc1611990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51200/0 (socket says 172.21.15.37:51200) 2024-08-20T05:12:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.404+0000 7f1bd7400640 1 -- 172.21.15.37:0/3322298581 learned_addr learned my addr 172.21.15.37:0/3322298581 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.404+0000 7f1bd7400640 1 --2- 172.21.15.37:0/3322298581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc16121f0 0x557dc160f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:09.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.405+0000 7f1bd7400640 1 -- 172.21.15.37:0/3322298581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1606260 msgr2=0x557dc160ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.405+0000 7f1bd7400640 1 --2- 172.21.15.37:0/3322298581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1606260 0x557dc160ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.405+0000 7f1bd7400640 1 -- 172.21.15.37:0/3322298581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc16121f0 msgr2=0x557dc160f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.405+0000 7f1bd7400640 1 --2- 172.21.15.37:0/3322298581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc16121f0 0x557dc160f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.405+0000 7f1bd7400640 1 -- 172.21.15.37:0/3322298581 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dc12ca650 con 0x557dc1605940 2024-08-20T05:12:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.405+0000 7f1bd7400640 1 --2- 172.21.15.37:0/3322298581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1605940 0x557dc1611990 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0004470 tx=0x7f1bd0004370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=119ec2da559a7663 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.405+0000 7f1bc0c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:12:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.406+0000 7f1bc0c00640 1 -- 172.21.15.37:0/3322298581 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0059060 con 0x557dc1605940 2024-08-20T05:12:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.406+0000 7f1bc0c00640 1 -- 172.21.15.37:0/3322298581 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1bd0003970 con 0x557dc1605940 2024-08-20T05:12:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.406+0000 7f1be0242740 1 -- 172.21.15.37:0/3322298581 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bd0036040 con 0x557dc1605940 2024-08-20T05:12:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.406+0000 7f1bc0c00640 1 -- 172.21.15.37:0/3322298581 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f1bd0003b70 con 0x557dc1605940 2024-08-20T05:12:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.406+0000 7f1be0242740 10 client.28033 fetch_fsmap learned FSMap version 43 2024-08-20T05:12:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.406+0000 7f1be0242740 1 -- 172.21.15.37:0/3322298581 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x557dc1620680 con 0x557dc1605940 2024-08-20T05:12:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.407+0000 7f1bc0c00640 1 -- 172.21.15.37:0/3322298581 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bd0036040 con 0x557dc1605940 2024-08-20T05:12:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.407+0000 7f1bc0c00640 1 -- 172.21.15.37:0/3322298581 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f1bd004e030 con 0x557dc1605940 2024-08-20T05:12:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.407+0000 7f1be0242740 10 client.28033 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:12:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.407+0000 7f1be0242740 10 client.28033 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:12:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.407+0000 7f1be0242740 20 client.28033 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.407+0000 7f1be0242740 1 --2- 172.21.15.37:0/3322298581 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557dc16219d0 0x557dc1623dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.407+0000 7f1be0242740 4 client.28033 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:12:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.407+0000 7f1be0242740 1 -- 172.21.15.37:0/3322298581 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557dc157d9f0 con 0x557dc16219d0 2024-08-20T05:12:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.408+0000 7f1bd6000640 1 --2- 172.21.15.37:0/3322298581 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557dc16219d0 0x557dc1623dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:09.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.412+0000 7f1bd6000640 1 --2- 172.21.15.37:0/3322298581 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557dc16219d0 0x557dc1623dc0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38971001a8dc63ed server_cookie=aa79804af3c832bc in_seq=0 out_seq=0 2024-08-20T05:12:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.413+0000 7f1bc0c00640 10 client.28033 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:09.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.413+0000 7f1bc0c00640 1 -- 172.21.15.37:0/3322298581 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557dc157d9f0 con 0x557dc16219d0 2024-08-20T05:12:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.413+0000 7f1bc0c00640 10 client.28033 handle_command_reply: tid=0 2024-08-20T05:12:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.413+0000 7f1be0242740 1 client.28033 shutdown 2024-08-20T05:12:09.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.414+0000 7f1be0242740 1 -- 172.21.15.37:0/3322298581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1605940 msgr2=0x557dc1611990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.414+0000 7f1be0242740 1 --2- 172.21.15.37:0/3322298581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1605940 0x557dc1611990 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0004470 tx=0x7f1bd0004370 comp rx=0 tx=0).stop 2024-08-20T05:12:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.415+0000 7f1be0242740 1 -- 172.21.15.37:0/3322298581 shutdown_connections 2024-08-20T05:12:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.415+0000 7f1be0242740 1 --2- 172.21.15.37:0/3322298581 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557dc16219d0 0x557dc1623dc0 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.415+0000 7f1be0242740 1 --2- 172.21.15.37:0/3322298581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc16121f0 0x557dc160f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.415+0000 7f1be0242740 1 --2- 172.21.15.37:0/3322298581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1606260 0x557dc160ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.415+0000 7f1be0242740 1 --2- 172.21.15.37:0/3322298581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1605940 0x557dc1611990 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.415+0000 7f1be0242740 1 -- 172.21.15.37:0/3322298581 >> 172.21.15.37:0/3322298581 conn(0x557dc1603770 msgr2=0x557dc16092e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:09.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.415+0000 7f1bc0c00640 0 client.28033 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:09.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.416+0000 7f1be0242740 1 -- 172.21.15.37:0/3322298581 shutdown_connections 2024-08-20T05:12:09.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.416+0000 7f1be0242740 1 -- 172.21.15.37:0/3322298581 wait complete. 2024-08-20T05:12:09.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.416+0000 7f1be0242740 20 client.28033 trim_cache size 0 max 16384 2024-08-20T05:12:09.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.448+0000 7f1be0242740 1 Processor -- start 2024-08-20T05:12:09.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.448+0000 7f1be0242740 1 -- start start 2024-08-20T05:12:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.449+0000 7f1be0242740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1605940 0x557dc1602740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.449+0000 7f1be0242740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1606260 0x557dc1602c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.449+0000 7f1be0242740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc16121f0 0x557dc16293c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.449+0000 7f1be0242740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb800fc70 con 0x557dc16121f0 2024-08-20T05:12:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.449+0000 7f1be0242740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb8011840 con 0x557dc1605940 2024-08-20T05:12:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.449+0000 7f1be0242740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb8010340 con 0x557dc1606260 2024-08-20T05:12:09.453 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:09 smithi037 ceph-mon[17265]: pgmap v698: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 3.6 MiB/s wr, 377 op/s 2024-08-20T05:12:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.450+0000 7f1bd7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1605940 0x557dc1602740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.450+0000 7f1bd7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1605940 0x557dc1602740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:59390/0 (socket says 172.21.15.37:59390) 2024-08-20T05:12:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.450+0000 7f1bd7400640 1 -- 172.21.15.37:0/2605748181 learned_addr learned my addr 172.21.15.37:0/2605748181 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:09.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.450+0000 7f1bd7400640 1 --2- 172.21.15.37:0/2605748181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc16121f0 0x557dc16293c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.450+0000 7f1bd6000640 1 --2- 172.21.15.37:0/2605748181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1606260 0x557dc1602c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.451+0000 7f1bd7400640 1 -- 172.21.15.37:0/2605748181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1606260 msgr2=0x557dc1602c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.451+0000 7f1bd7400640 1 --2- 172.21.15.37:0/2605748181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1606260 0x557dc1602c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.451+0000 7f1bd7400640 1 -- 172.21.15.37:0/2605748181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc16121f0 msgr2=0x557dc16293c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.451+0000 7f1bd7400640 1 --2- 172.21.15.37:0/2605748181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc16121f0 0x557dc16293c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.451+0000 7f1bd7400640 1 -- 172.21.15.37:0/2605748181 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557dc16041f0 con 0x557dc1605940 2024-08-20T05:12:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.452+0000 7f1bd7400640 1 --2- 172.21.15.37:0/2605748181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1605940 0x557dc1602740 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1bd002b070 tx=0x7f1bd002a8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fef4653f42789a83 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.452+0000 7f1bc3400640 1 -- 172.21.15.37:0/2605748181 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0059070 con 0x557dc1605940 2024-08-20T05:12:09.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.452+0000 7f1bc3400640 1 -- 172.21.15.37:0/2605748181 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bd0036040 con 0x557dc1605940 2024-08-20T05:12:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.452+0000 7f1bc3400640 1 -- 172.21.15.37:0/2605748181 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0003d10 con 0x557dc1605940 2024-08-20T05:12:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.453+0000 7f1be0242740 1 -- 172.21.15.37:0/2605748181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1605940 msgr2=0x557dc1602740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:09.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.453+0000 7f1be0242740 1 --2- 172.21.15.37:0/2605748181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1605940 0x557dc1602740 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1bd002b070 tx=0x7f1bd002a8f0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.456+0000 7f1be0242740 1 -- 172.21.15.37:0/2605748181 shutdown_connections 2024-08-20T05:12:09.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.456+0000 7f1be0242740 1 --2- 172.21.15.37:0/2605748181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc16121f0 0x557dc16293c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.456+0000 7f1be0242740 1 --2- 172.21.15.37:0/2605748181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1606260 0x557dc1602c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.456+0000 7f1be0242740 1 --2- 172.21.15.37:0/2605748181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1605940 0x557dc1602740 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.456+0000 7f1be0242740 1 -- 172.21.15.37:0/2605748181 >> 172.21.15.37:0/2605748181 conn(0x557dc1603770 msgr2=0x557dc1602030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:09.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.458+0000 7f1be0242740 1 -- 172.21.15.37:0/2605748181 shutdown_connections 2024-08-20T05:12:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.458+0000 7f1be0242740 1 -- 172.21.15.37:0/2605748181 wait complete. 2024-08-20T05:12:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.459+0000 7f1be0242740 1 -- start start 2024-08-20T05:12:09.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.459+0000 7f1be0242740 1 Processor -- start 2024-08-20T05:12:09.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.460+0000 7f1be0242740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1605940 0x557dc16179e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.461+0000 7f1be0242740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1606260 0x557dc1617f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.461+0000 7f1bd7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1605940 0x557dc16179e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:09.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.461+0000 7f1bd7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1605940 0x557dc16179e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:59402/0 (socket says 172.21.15.37:59402) 2024-08-20T05:12:09.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.461+0000 7f1bd7400640 1 -- 172.21.15.37:0/1281641423 learned_addr learned my addr 172.21.15.37:0/1281641423 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:09.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.462+0000 7f1be0242740 1 --2- 172.21.15.37:0/1281641423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc16121f0 0x557dc16843d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.462+0000 7f1be0242740 1 -- 172.21.15.37:0/1281641423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb8011140 con 0x557dc16121f0 2024-08-20T05:12:09.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.462+0000 7f1be0242740 1 -- 172.21.15.37:0/1281641423 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb8010a10 con 0x557dc1605940 2024-08-20T05:12:09.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.462+0000 7f1be0242740 1 -- 172.21.15.37:0/1281641423 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb800dc50 con 0x557dc1606260 2024-08-20T05:12:09.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.462+0000 7f1be0242740 10 client.0 _ll_register_callbacks cb 0x7f1bc400a0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:09.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.461+0000 7f1bd6000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1606260 0x557dc1617f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:09.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.462+0000 7f1bd7400640 1 -- 172.21.15.37:0/1281641423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1606260 msgr2=0x557dc1617f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:09.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.462+0000 7f1bd7400640 1 --2- 172.21.15.37:0/1281641423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1606260 0x557dc1617f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.462+0000 7f1bd7400640 1 -- 172.21.15.37:0/1281641423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc16121f0 msgr2=0x557dc16843d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:09.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.462+0000 7f1bd7400640 1 --2- 172.21.15.37:0/1281641423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc16121f0 0x557dc16843d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.462+0000 7f1bd7400640 1 -- 172.21.15.37:0/1281641423 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dc1684ae0 con 0x557dc1605940 2024-08-20T05:12:09.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.463+0000 7f1bd7400640 1 --2- 172.21.15.37:0/1281641423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1605940 0x557dc16179e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1bd002f540 tx=0x7f1bd00307e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62997198857d8cf7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:09.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.463+0000 7f1bc0c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:12:09.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.463+0000 7f1bc0c00640 1 -- 172.21.15.37:0/1281641423 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0059040 con 0x557dc1605940 2024-08-20T05:12:09.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.463+0000 7f1bc0c00640 1 -- 172.21.15.37:0/1281641423 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1bd0003970 con 0x557dc1605940 2024-08-20T05:12:09.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.463+0000 7f1be0242740 1 -- 172.21.15.37:0/1281641423 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bd0036040 con 0x557dc1605940 2024-08-20T05:12:09.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.464+0000 7f1bc0c00640 1 -- 172.21.15.37:0/1281641423 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f1bd006c050 con 0x557dc1605940 2024-08-20T05:12:09.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.464+0000 7f1be0242740 10 client.28037 fetch_fsmap learned FSMap version 43 2024-08-20T05:12:09.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.464+0000 7f1be0242740 1 -- 172.21.15.37:0/1281641423 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x557dc168bf30 con 0x557dc1605940 2024-08-20T05:12:09.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.464+0000 7f1bc0c00640 1 -- 172.21.15.37:0/1281641423 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1bd0036040 con 0x557dc1605940 2024-08-20T05:12:09.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.465+0000 7f1bc0c00640 1 -- 172.21.15.37:0/1281641423 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f1bd004e040 con 0x557dc1605940 2024-08-20T05:12:09.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.465+0000 7f1be0242740 10 client.28037 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:12:09.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.465+0000 7f1be0242740 10 client.28037 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:12:09.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.465+0000 7f1be0242740 20 client.28037 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:09.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.465+0000 7f1be0242740 1 --2- 172.21.15.37:0/1281641423 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557dc168c540 0x557dc168e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:09.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.465+0000 7f1be0242740 4 client.28037 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:12:09.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.465+0000 7f1be0242740 1 -- 172.21.15.37:0/1281641423 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557dc1579490 con 0x557dc168c540 2024-08-20T05:12:09.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.467+0000 7f1bd6000640 1 --2- 172.21.15.37:0/1281641423 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557dc168c540 0x557dc168e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:09.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.469+0000 7f1bd6000640 1 --2- 172.21.15.37:0/1281641423 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557dc168c540 0x557dc168e960 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f08bbf628b5882d9 server_cookie=3c7b971b3a0d81ca in_seq=0 out_seq=0 2024-08-20T05:12:09.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.469+0000 7f1bc0c00640 10 client.28037 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:09.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.469+0000 7f1bc0c00640 1 -- 172.21.15.37:0/1281641423 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557dc1579490 con 0x557dc168c540 2024-08-20T05:12:09.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.469+0000 7f1bc0c00640 10 client.28037 handle_command_reply: tid=0 2024-08-20T05:12:09.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.473+0000 7f1be0242740 1 client.28037 shutdown 2024-08-20T05:12:09.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.473+0000 7f1be0242740 1 -- 172.21.15.37:0/1281641423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1605940 msgr2=0x557dc16179e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:09.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.473+0000 7f1be0242740 1 --2- 172.21.15.37:0/1281641423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1605940 0x557dc16179e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1bd002f540 tx=0x7f1bd00307e0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.473+0000 7f1be0242740 1 -- 172.21.15.37:0/1281641423 shutdown_connections 2024-08-20T05:12:09.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.473+0000 7f1be0242740 1 --2- 172.21.15.37:0/1281641423 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557dc168c540 0x557dc168e960 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.473+0000 7f1be0242740 1 --2- 172.21.15.37:0/1281641423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dc16121f0 0x557dc16843d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.473+0000 7f1be0242740 1 --2- 172.21.15.37:0/1281641423 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dc1606260 0x557dc1617f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.473+0000 7f1be0242740 1 --2- 172.21.15.37:0/1281641423 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dc1605940 0x557dc16179e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.473+0000 7f1be0242740 1 -- 172.21.15.37:0/1281641423 >> 172.21.15.37:0/1281641423 conn(0x557dc1603770 msgr2=0x557dc1602850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:09.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.473+0000 7f1bc0c00640 0 client.28037 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:09.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.474+0000 7f1be0242740 1 -- 172.21.15.37:0/1281641423 shutdown_connections 2024-08-20T05:12:09.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.475+0000 7f1be0242740 1 -- 172.21.15.37:0/1281641423 wait complete. 2024-08-20T05:12:09.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.475+0000 7f1be0242740 20 client.28037 trim_cache size 0 max 16384 2024-08-20T05:12:09.480 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:12:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.480+0000 7f1bdd800640 1 -- 172.21.15.37:0/7052795 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1bbc0b3f20 msgr2=0x7f1bbc0b63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.480+0000 7f1bdd800640 1 --2- 172.21.15.37:0/7052795 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1bbc0b3f20 0x7f1bbc0b63e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80a71a0 tx=0x7f1bc8004770 comp rx=0 tx=0).stop 2024-08-20T05:12:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.480+0000 7f1bdd800640 1 -- 172.21.15.37:0/7052795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bd8104ca0 msgr2=0x7f1bd8111640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.480+0000 7f1bdd800640 1 --2- 172.21.15.37:0/7052795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bd8104ca0 0x7f1bd8111640 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800b450 tx=0x7f1bc800b910 comp rx=0 tx=0).stop 2024-08-20T05:12:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.480+0000 7f1bdd800640 1 -- 172.21.15.37:0/7052795 shutdown_connections 2024-08-20T05:12:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.480+0000 7f1bdd800640 1 --2- 172.21.15.37:0/7052795 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1bbc0b3f20 0x7f1bbc0b63e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.480+0000 7f1bdd800640 1 --2- 172.21.15.37:0/7052795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd810b030 0x7f1bd810ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.480+0000 7f1bdd800640 1 --2- 172.21.15.37:0/7052795 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1bd810a6b0 0x7f1bd810e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.480+0000 7f1bdd800640 1 --2- 172.21.15.37:0/7052795 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1bd8104ca0 0x7f1bd8111640 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.480+0000 7f1bdd800640 1 -- 172.21.15.37:0/7052795 >> 172.21.15.37:0/7052795 conn(0x7f1bd8100730 msgr2=0x7f1bd8102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.480+0000 7f1bdd800640 1 -- 172.21.15.37:0/7052795 shutdown_connections 2024-08-20T05:12:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:09.480+0000 7f1bdd800640 1 -- 172.21.15.37:0/7052795 wait complete. 2024-08-20T05:12:09.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:09 smithi130 ceph-mon[22007]: pgmap v698: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 3.6 MiB/s wr, 377 op/s 2024-08-20T05:12:09.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:09 smithi135 ceph-mon[22342]: pgmap v698: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 3.6 MiB/s wr, 377 op/s 2024-08-20T05:12:11.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:11 smithi130 ceph-mon[22007]: pgmap v699: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.3 MiB/s wr, 465 op/s 2024-08-20T05:12:11.769 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:11 smithi037 ceph-mon[17265]: pgmap v699: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.3 MiB/s wr, 465 op/s 2024-08-20T05:12:11.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:11 smithi135 ceph-mon[22342]: pgmap v699: 129 pgs: 129 active+clean; 1.4 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.3 MiB/s wr, 465 op/s 2024-08-20T05:12:11.968 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T05:12:11.968 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T05:12:12.684 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:12:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 555.0 s, 592.2 tps, lat 171.655 ms stddev 187.017 2024-08-20T05:12:13.667 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:13 smithi135 ceph-mon[22342]: pgmap v700: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.3 MiB/s wr, 479 op/s 2024-08-20T05:12:13.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:13 smithi130 ceph-mon[22007]: pgmap v700: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.3 MiB/s wr, 479 op/s 2024-08-20T05:12:13.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:13 smithi037 ceph-mon[17265]: pgmap v700: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.3 MiB/s wr, 479 op/s 2024-08-20T05:12:13.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.993+0000 7f80e4e00640 1 -- 172.21.15.37:0/856606594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e010eaf0 msgr2=0x7f80e010ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:13.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.993+0000 7f80e4e00640 1 --2- 172.21.15.37:0/856606594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e010eaf0 0x7f80e010ef30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f80cc009900 tx=0x7f80cc02a440 comp rx=0 tx=0).stop 2024-08-20T05:12:13.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.994+0000 7f80e4e00640 1 -- 172.21.15.37:0/856606594 shutdown_connections 2024-08-20T05:12:13.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.994+0000 7f80e4e00640 1 --2- 172.21.15.37:0/856606594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80e010f470 0x7f80e0115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:13.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.994+0000 7f80e4e00640 1 --2- 172.21.15.37:0/856606594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e010eaf0 0x7f80e010ef30 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:13.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.994+0000 7f80e4e00640 1 --2- 172.21.15.37:0/856606594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80e01090e0 0x7f80e01094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.994+0000 7f80e4e00640 1 -- 172.21.15.37:0/856606594 >> 172.21.15.37:0/856606594 conn(0x7f80e0078760 msgr2=0x7f80e007ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.994+0000 7f80e4e00640 1 -- 172.21.15.37:0/856606594 shutdown_connections 2024-08-20T05:12:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.994+0000 7f80e4e00640 1 -- 172.21.15.37:0/856606594 wait complete. 2024-08-20T05:12:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.996+0000 7f80e4e00640 1 Processor -- start 2024-08-20T05:12:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.996+0000 7f80e4e00640 1 -- start start 2024-08-20T05:12:13.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.996+0000 7f80e4e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80e01090e0 0x7f80e019f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.996+0000 7f80e4e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e010eaf0 0x7f80e019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.996+0000 7f80e4e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80e010f470 0x7f80e01a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.997+0000 7f80dd400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e010eaf0 0x7f80e019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.997+0000 7f80dde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80e01090e0 0x7f80e019f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.997+0000 7f80e4e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0119200 con 0x7f80e01090e0 2024-08-20T05:12:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.997+0000 7f80e4e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0119080 con 0x7f80e010f470 2024-08-20T05:12:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.997+0000 7f80e4e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0119380 con 0x7f80e010eaf0 2024-08-20T05:12:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.997+0000 7f80dde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80e01090e0 0x7f80e019f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59158/0 (socket says 172.21.15.37:59158) 2024-08-20T05:12:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.997+0000 7f80dde00640 1 -- 172.21.15.37:0/658751950 learned_addr learned my addr 172.21.15.37:0/658751950 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.998+0000 7f80dde00640 1 -- 172.21.15.37:0/658751950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e010eaf0 msgr2=0x7f80e019fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.998+0000 7f80dde00640 1 --2- 172.21.15.37:0/658751950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e010eaf0 0x7f80e019fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.998+0000 7f80dde00640 1 -- 172.21.15.37:0/658751950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80e010f470 msgr2=0x7f80e01a5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.998+0000 7f80dde00640 1 --2- 172.21.15.37:0/658751950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80e010f470 0x7f80e01a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.998+0000 7f80dde00640 1 -- 172.21.15.37:0/658751950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e01a5800 con 0x7f80e01090e0 2024-08-20T05:12:14.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.998+0000 7f80dd400640 1 --2- 172.21.15.37:0/658751950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e010eaf0 0x7f80e019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:12:14.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:13.999+0000 7f80dde00640 1 --2- 172.21.15.37:0/658751950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80e01090e0 0x7f80e019f750 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f80d800ba50 tx=0x7f80d800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:14.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.001+0000 7f80d6a00640 1 -- 172.21.15.37:0/658751950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8019070 con 0x7f80e01090e0 2024-08-20T05:12:14.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.002+0000 7f80e4e00640 1 -- 172.21.15.37:0/658751950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e01a5af0 con 0x7f80e01090e0 2024-08-20T05:12:14.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.002+0000 7f80e4e00640 1 -- 172.21.15.37:0/658751950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e01ac230 con 0x7f80e01090e0 2024-08-20T05:12:14.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.002+0000 7f80d6a00640 1 -- 172.21.15.37:0/658751950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80d800cbe0 con 0x7f80e01090e0 2024-08-20T05:12:14.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.002+0000 7f80d6a00640 1 -- 172.21.15.37:0/658751950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80075f0 con 0x7f80e01090e0 2024-08-20T05:12:14.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.010+0000 7f80e7a2e740 1 Processor -- start 2024-08-20T05:12:14.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.012+0000 7f80e7a2e740 1 -- start start 2024-08-20T05:12:14.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.012+0000 7f80e7a2e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c3d9d0 0x55be36c3ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.013+0000 7f80e7a2e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3e2f0 0x55be36c49d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.013+0000 7f80de800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c3d9d0 0x55be36c3ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:14.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.013+0000 7f80d6a00640 1 -- 172.21.15.37:0/658751950 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f80d801c070 con 0x7f80e01090e0 2024-08-20T05:12:14.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.013+0000 7f80e7a2e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c4a280 0x55be36c4c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.013+0000 7f80de800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c3d9d0 0x55be36c3ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59168/0 (socket says 172.21.15.37:59168) 2024-08-20T05:12:14.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.013+0000 7f80e7a2e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55be36bb4870 con 0x55be36c3d9d0 2024-08-20T05:12:14.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.013+0000 7f80e7a2e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55be36ba3d70 con 0x55be36c3e2f0 2024-08-20T05:12:14.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.013+0000 7f80e7a2e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55be36ba7db0 con 0x55be36c4a280 2024-08-20T05:12:14.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.013+0000 7f80dde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3e2f0 0x55be36c49d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:14.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.013+0000 7f80dde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3e2f0 0x55be36c49d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:59178/0 (socket says 172.21.15.37:59178) 2024-08-20T05:12:14.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.013+0000 7f80dde00640 1 -- 172.21.15.37:0/4051531917 learned_addr learned my addr 172.21.15.37:0/4051531917 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:14.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.015+0000 7f80dde00640 1 -- 172.21.15.37:0/4051531917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c4a280 msgr2=0x55be36c4c670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:12:14.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.015+0000 7f80dde00640 1 --2- 172.21.15.37:0/4051531917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c4a280 0x55be36c4c670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.015+0000 7f80dde00640 1 -- 172.21.15.37:0/4051531917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c3d9d0 msgr2=0x55be36c3ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:14.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.016+0000 7f80d6a00640 1 --2- 172.21.15.37:0/658751950 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80c40b3c90 0x7f80c40b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.016+0000 7f80d6a00640 1 -- 172.21.15.37:0/658751950 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f80d80e3390 con 0x7f80e01090e0 2024-08-20T05:12:14.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.016+0000 7f80dde00640 1 --2- 172.21.15.37:0/4051531917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c3d9d0 0x55be36c3ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.016+0000 7f80dde00640 1 -- 172.21.15.37:0/4051531917 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be36903930 con 0x55be36c3e2f0 2024-08-20T05:12:14.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.016+0000 7f80de800640 1 --2- 172.21.15.37:0/4051531917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c3d9d0 0x55be36c3ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:12:14.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.017+0000 7f80dde00640 1 --2- 172.21.15.37:0/4051531917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3e2f0 0x55be36c49d40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f80d80e0af0 tx=0x7f80d8009470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de4e5aaedb11381b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:14.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.017+0000 7f80cb400640 1 -- 172.21.15.37:0/4051531917 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80a5eb0 con 0x55be36c3e2f0 2024-08-20T05:12:14.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.017+0000 7f80cb400640 1 -- 172.21.15.37:0/4051531917 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80d80a9b00 con 0x55be36c3e2f0 2024-08-20T05:12:14.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.017+0000 7f80cb400640 1 -- 172.21.15.37:0/4051531917 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80e69c0 con 0x55be36c3e2f0 2024-08-20T05:12:14.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.018+0000 7f80dd400640 1 --2- 172.21.15.37:0/658751950 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80c40b3c90 0x7f80c40b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:14.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.019+0000 7f80e7a2e740 1 -- 172.21.15.37:0/4051531917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3e2f0 msgr2=0x55be36c49d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:14.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.020+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/4051531917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3e2f0 0x55be36c49d40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f80d80e0af0 tx=0x7f80d8009470 comp rx=0 tx=0).stop 2024-08-20T05:12:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.020+0000 7f80e7a2e740 1 -- 172.21.15.37:0/4051531917 shutdown_connections 2024-08-20T05:12:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.020+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/4051531917 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c4a280 0x55be36c4c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.020+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/4051531917 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3e2f0 0x55be36c49d40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.020+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/4051531917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c3d9d0 0x55be36c3ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.020+0000 7f80e7a2e740 1 -- 172.21.15.37:0/4051531917 >> 172.21.15.37:0/4051531917 conn(0x55be36c3b800 msgr2=0x55be36c3c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.020+0000 7f80e7a2e740 1 -- 172.21.15.37:0/4051531917 shutdown_connections 2024-08-20T05:12:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.020+0000 7f80e7a2e740 1 -- 172.21.15.37:0/4051531917 wait complete. 2024-08-20T05:12:14.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.021+0000 7f80e7a2e740 1 -- start start 2024-08-20T05:12:14.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.021+0000 7f80dd400640 1 --2- 172.21.15.37:0/658751950 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80c40b3c90 0x7f80c40b6150 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f80cc02aa30 tx=0x7f80cc000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.021+0000 7f80e7a2e740 1 Processor -- start 2024-08-20T05:12:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.022+0000 7f80e7a2e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3d9d0 0x55be36c499d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.022+0000 7f80e7a2e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c3e2f0 0x55be36c46e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.022+0000 7f80e7a2e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c4a280 0x55be36c47360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.023+0000 7f80e7a2e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55be36a06890 con 0x55be36c4a280 2024-08-20T05:12:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.023+0000 7f80e7a2e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55be36b2ab00 con 0x55be36c3d9d0 2024-08-20T05:12:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.023+0000 7f80e7a2e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55be36c4cf10 con 0x55be36c3e2f0 2024-08-20T05:12:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.023+0000 7f80dd400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c3e2f0 0x55be36c46e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.023+0000 7f80dd400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c3e2f0 0x55be36c46e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42132/0 (socket says 172.21.15.37:42132) 2024-08-20T05:12:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.023+0000 7f80dd400640 1 -- 172.21.15.37:0/1038100137 learned_addr learned my addr 172.21.15.37:0/1038100137 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.023+0000 7f80e7a2e740 10 client.0 _ll_register_callbacks cb 0x55be36b9edc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.023+0000 7f80dd400640 1 -- 172.21.15.37:0/1038100137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3d9d0 msgr2=0x55be36c499d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:12:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.023+0000 7f80dd400640 1 --2- 172.21.15.37:0/1038100137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3d9d0 0x55be36c499d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.023+0000 7f80dd400640 1 -- 172.21.15.37:0/1038100137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c4a280 msgr2=0x55be36c47360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.023+0000 7f80dd400640 1 --2- 172.21.15.37:0/1038100137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c4a280 0x55be36c47360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.023+0000 7f80dd400640 1 -- 172.21.15.37:0/1038100137 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be36b6ba30 con 0x55be36c3e2f0 2024-08-20T05:12:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.024+0000 7f80dd400640 1 --2- 172.21.15.37:0/1038100137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c3e2f0 0x55be36c46e20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f80cc009900 tx=0x7f80cc009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51bcfefa571d3e5a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:14.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.024+0000 7f80bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:12:14.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.024+0000 7f80bfe00640 1 -- 172.21.15.37:0/1038100137 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc04d020 con 0x55be36c3e2f0 2024-08-20T05:12:14.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.026+0000 7f80bfe00640 1 -- 172.21.15.37:0/1038100137 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f80cc0318b0 con 0x55be36c3e2f0 2024-08-20T05:12:14.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.026+0000 7f80e7a2e740 1 -- 172.21.15.37:0/1038100137 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80d80a9b00 con 0x55be36c3e2f0 2024-08-20T05:12:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.027+0000 7f80bfe00640 1 -- 172.21.15.37:0/1038100137 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f80cc035040 con 0x55be36c3e2f0 2024-08-20T05:12:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.027+0000 7f80e7a2e740 10 client.28048 fetch_fsmap learned FSMap version 43 2024-08-20T05:12:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.027+0000 7f80e7a2e740 1 -- 172.21.15.37:0/1038100137 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55be36c586a0 con 0x55be36c3e2f0 2024-08-20T05:12:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.027+0000 7f80bfe00640 1 -- 172.21.15.37:0/1038100137 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80d80a9b00 con 0x55be36c3e2f0 2024-08-20T05:12:14.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.027+0000 7f80bfe00640 1 -- 172.21.15.37:0/1038100137 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f80cc05a020 con 0x55be36c3e2f0 2024-08-20T05:12:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.027+0000 7f80e7a2e740 10 client.28048 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:12:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.027+0000 7f80e7a2e740 10 client.28048 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:12:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.027+0000 7f80e7a2e740 20 client.28048 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.028+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/1038100137 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55be36c59d00 0x55be36c5c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.028+0000 7f80e7a2e740 4 client.28048 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:12:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.028+0000 7f80e7a2e740 1 -- 172.21.15.37:0/1038100137 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be36bb67c0 con 0x55be36c59d00 2024-08-20T05:12:14.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.028+0000 7f80dde00640 1 --2- 172.21.15.37:0/1038100137 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55be36c59d00 0x55be36c5c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.029+0000 7f80bfe00640 10 client.28048 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:14.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.029+0000 7f80dde00640 1 --2- 172.21.15.37:0/1038100137 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55be36c59d00 0x55be36c5c1c0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d065b33f4822b51c server_cookie=715d38d9790b77e6 in_seq=0 out_seq=0 2024-08-20T05:12:14.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.030+0000 7f80bfe00640 1 -- 172.21.15.37:0/1038100137 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55be36bb67c0 con 0x55be36c59d00 2024-08-20T05:12:14.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.030+0000 7f80bfe00640 10 client.28048 handle_command_reply: tid=0 2024-08-20T05:12:14.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.030+0000 7f80e7a2e740 1 client.28048 shutdown 2024-08-20T05:12:14.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.031+0000 7f80e7a2e740 1 -- 172.21.15.37:0/1038100137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c3e2f0 msgr2=0x55be36c46e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:14.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.031+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/1038100137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c3e2f0 0x55be36c46e20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f80cc009900 tx=0x7f80cc009260 comp rx=0 tx=0).stop 2024-08-20T05:12:14.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.031+0000 7f80e7a2e740 1 -- 172.21.15.37:0/1038100137 shutdown_connections 2024-08-20T05:12:14.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.031+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/1038100137 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55be36c59d00 0x55be36c5c1c0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.031+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/1038100137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c4a280 0x55be36c47360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.031+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/1038100137 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c3e2f0 0x55be36c46e20 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.031+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/1038100137 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3d9d0 0x55be36c499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.031+0000 7f80e7a2e740 1 -- 172.21.15.37:0/1038100137 >> 172.21.15.37:0/1038100137 conn(0x55be36c3b800 msgr2=0x55be36c413a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:14.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.031+0000 7f80bfe00640 0 client.28048 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:14.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.032+0000 7f80e7a2e740 1 -- 172.21.15.37:0/1038100137 shutdown_connections 2024-08-20T05:12:14.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.032+0000 7f80e7a2e740 1 -- 172.21.15.37:0/1038100137 wait complete. 2024-08-20T05:12:14.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.032+0000 7f80e7a2e740 20 client.28048 trim_cache size 0 max 16384 2024-08-20T05:12:14.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.069+0000 7f80e7a2e740 1 Processor -- start 2024-08-20T05:12:14.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.069+0000 7f80e7a2e740 1 -- start start 2024-08-20T05:12:14.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.070+0000 7f80e7a2e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3d9d0 0x55be36c56090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.070+0000 7f80e7a2e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c3e2f0 0x55be36c61a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.070+0000 7f80e7a2e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c4a280 0x55be36c61fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.070+0000 7f80e7a2e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f80c000fbd0 con 0x55be36c3e2f0 2024-08-20T05:12:14.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.070+0000 7f80e7a2e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f80c00117a0 con 0x55be36c3d9d0 2024-08-20T05:12:14.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.070+0000 7f80e7a2e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f80c00102a0 con 0x55be36c4a280 2024-08-20T05:12:14.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.070+0000 7f80dde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3d9d0 0x55be36c56090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:14.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.070+0000 7f80dde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3d9d0 0x55be36c56090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:59186/0 (socket says 172.21.15.37:59186) 2024-08-20T05:12:14.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.070+0000 7f80dde00640 1 -- 172.21.15.37:0/614706001 learned_addr learned my addr 172.21.15.37:0/614706001 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:14.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.071+0000 7f80dde00640 1 -- 172.21.15.37:0/614706001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c4a280 msgr2=0x55be36c61fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:14.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.071+0000 7f80dde00640 1 --2- 172.21.15.37:0/614706001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c4a280 0x55be36c61fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.071+0000 7f80dde00640 1 -- 172.21.15.37:0/614706001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c3e2f0 msgr2=0x55be36c61a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:14.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.071+0000 7f80dde00640 1 --2- 172.21.15.37:0/614706001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c3e2f0 0x55be36c61a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.071+0000 7f80dde00640 1 -- 172.21.15.37:0/614706001 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be36c3c280 con 0x55be36c3d9d0 2024-08-20T05:12:14.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.073+0000 7f80dde00640 1 --2- 172.21.15.37:0/614706001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3d9d0 0x55be36c56090 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f80d80a9cf0 tx=0x7f80d80a5eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84f5011d4e667d4e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:14.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.074+0000 7f80caa00640 1 -- 172.21.15.37:0/614706001 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80a9760 con 0x55be36c3d9d0 2024-08-20T05:12:14.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.075+0000 7f80caa00640 1 -- 172.21.15.37:0/614706001 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80d808d030 con 0x55be36c3d9d0 2024-08-20T05:12:14.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.075+0000 7f80caa00640 1 -- 172.21.15.37:0/614706001 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80a9940 con 0x55be36c3d9d0 2024-08-20T05:12:14.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.076+0000 7f80e7a2e740 1 -- 172.21.15.37:0/614706001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3d9d0 msgr2=0x55be36c56090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:14.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.076+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/614706001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3d9d0 0x55be36c56090 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f80d80a9cf0 tx=0x7f80d80a5eb0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.076+0000 7f80e7a2e740 1 -- 172.21.15.37:0/614706001 shutdown_connections 2024-08-20T05:12:14.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.076+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/614706001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c4a280 0x55be36c61fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.076+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/614706001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c3e2f0 0x55be36c61a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.076+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/614706001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3d9d0 0x55be36c56090 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.076+0000 7f80e7a2e740 1 -- 172.21.15.37:0/614706001 >> 172.21.15.37:0/614706001 conn(0x55be36c3b800 msgr2=0x55be36c424a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:14.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.078+0000 7f80e7a2e740 1 -- 172.21.15.37:0/614706001 shutdown_connections 2024-08-20T05:12:14.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.081+0000 7f80e7a2e740 1 -- 172.21.15.37:0/614706001 wait complete. 2024-08-20T05:12:14.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.082+0000 7f80e7a2e740 1 -- start start 2024-08-20T05:12:14.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.082+0000 7f80e7a2e740 1 Processor -- start 2024-08-20T05:12:14.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.083+0000 7f80e7a2e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c3d9d0 0x55be36c52850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.084+0000 7f80e7a2e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3e2f0 0x55be36c43b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.084+0000 7f80e7a2e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c4a280 0x55be36c44050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.084+0000 7f80dde00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c3d9d0 0x55be36c52850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:14.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.084+0000 7f80dde00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c3d9d0 0x55be36c52850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42160/0 (socket says 172.21.15.37:42160) 2024-08-20T05:12:14.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.084+0000 7f80e7a2e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f80c00110a0 con 0x55be36c4a280 2024-08-20T05:12:14.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.085+0000 7f80e7a2e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f80c0010970 con 0x55be36c3e2f0 2024-08-20T05:12:14.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.085+0000 7f80e7a2e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f80c000dbb0 con 0x55be36c3d9d0 2024-08-20T05:12:14.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.085+0000 7f80de800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c4a280 0x55be36c44050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:14.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.085+0000 7f80dde00640 1 -- 172.21.15.37:0/101958325 learned_addr learned my addr 172.21.15.37:0/101958325 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:14.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.085+0000 7f80e7a2e740 10 client.0 _ll_register_callbacks cb 0x7f80cc040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:14.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.086+0000 7f80dde00640 1 -- 172.21.15.37:0/101958325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3e2f0 msgr2=0x55be36c43b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:14.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.086+0000 7f80dde00640 1 --2- 172.21.15.37:0/101958325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3e2f0 0x55be36c43b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.086+0000 7f80dde00640 1 -- 172.21.15.37:0/101958325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c4a280 msgr2=0x55be36c44050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:14.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.086+0000 7f80dde00640 1 --2- 172.21.15.37:0/101958325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c4a280 0x55be36c44050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.086+0000 7f80dde00640 1 -- 172.21.15.37:0/101958325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be36c44830 con 0x55be36c3d9d0 2024-08-20T05:12:14.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.086+0000 7f80bfe00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:12:14.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.086+0000 7f80dde00640 1 --2- 172.21.15.37:0/101958325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c3d9d0 0x55be36c52850 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f80d80e0b40 tx=0x7f80d80a9760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f764831ff24d327 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:14.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.087+0000 7f80bfe00640 1 -- 172.21.15.37:0/101958325 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80a9dc0 con 0x55be36c3d9d0 2024-08-20T05:12:14.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.087+0000 7f80bfe00640 1 -- 172.21.15.37:0/101958325 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f80d80a65e0 con 0x55be36c3d9d0 2024-08-20T05:12:14.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.087+0000 7f80e7a2e740 1 -- 172.21.15.37:0/101958325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80d808d030 con 0x55be36c3d9d0 2024-08-20T05:12:14.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.088+0000 7f80bfe00640 1 -- 172.21.15.37:0/101958325 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f80d80c9050 con 0x55be36c3d9d0 2024-08-20T05:12:14.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.088+0000 7f80e7a2e740 10 client.28051 fetch_fsmap learned FSMap version 43 2024-08-20T05:12:14.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.088+0000 7f80e7a2e740 1 -- 172.21.15.37:0/101958325 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55be36cc4a90 con 0x55be36c3d9d0 2024-08-20T05:12:14.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.089+0000 7f80bfe00640 1 -- 172.21.15.37:0/101958325 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80d808d030 con 0x55be36c3d9d0 2024-08-20T05:12:14.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.089+0000 7f80bfe00640 1 -- 172.21.15.37:0/101958325 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f80d80a6280 con 0x55be36c3d9d0 2024-08-20T05:12:14.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.089+0000 7f80e7a2e740 10 client.28051 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:12:14.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.089+0000 7f80e7a2e740 10 client.28051 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:12:14.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.089+0000 7f80e7a2e740 20 client.28051 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:14.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.089+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/101958325 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55be36cc4c60 0x55be36cc7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:14.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.089+0000 7f80e7a2e740 4 client.28051 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T05:12:14.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.089+0000 7f80e7a2e740 1 -- 172.21.15.37:0/101958325 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55be36bb2260 con 0x55be36cc4c60 2024-08-20T05:12:14.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.091+0000 7f80dd400640 1 --2- 172.21.15.37:0/101958325 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55be36cc4c60 0x55be36cc7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:14.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.092+0000 7f80dd400640 1 --2- 172.21.15.37:0/101958325 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55be36cc4c60 0x55be36cc7050 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e820a2b14cb35a67 server_cookie=f52599771a6a0efe in_seq=0 out_seq=0 2024-08-20T05:12:14.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.092+0000 7f80bfe00640 10 client.28051 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:14.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.096+0000 7f80bfe00640 1 -- 172.21.15.37:0/101958325 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55be36bb2260 con 0x55be36cc4c60 2024-08-20T05:12:14.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.096+0000 7f80bfe00640 10 client.28051 handle_command_reply: tid=0 2024-08-20T05:12:14.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.096+0000 7f80e7a2e740 1 client.28051 shutdown 2024-08-20T05:12:14.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.096+0000 7f80e7a2e740 1 -- 172.21.15.37:0/101958325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c3d9d0 msgr2=0x55be36c52850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:14.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.096+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/101958325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c3d9d0 0x55be36c52850 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f80d80e0b40 tx=0x7f80d80a9760 comp rx=0 tx=0).stop 2024-08-20T05:12:14.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.097+0000 7f80e7a2e740 1 -- 172.21.15.37:0/101958325 shutdown_connections 2024-08-20T05:12:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.097+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/101958325 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55be36cc4c60 0x55be36cc7050 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.097+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/101958325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55be36c4a280 0x55be36c44050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.097+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/101958325 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55be36c3e2f0 0x55be36c43b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.097+0000 7f80e7a2e740 1 --2- 172.21.15.37:0/101958325 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55be36c3d9d0 0x55be36c52850 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.097+0000 7f80e7a2e740 1 -- 172.21.15.37:0/101958325 >> 172.21.15.37:0/101958325 conn(0x55be36c3b800 msgr2=0x55be36c48450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:14.102 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:12:14.102 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-20T05:12:14.102 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "0bf3f73d-6cf4-4a4e-bb58-7bf467ef8004", 2024-08-20T05:12:14.102 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-20T05:12:14.102 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:12:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.097+0000 7f80bfe00640 0 client.28051 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.098+0000 7f80e7a2e740 1 -- 172.21.15.37:0/101958325 shutdown_connections 2024-08-20T05:12:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.099+0000 7f80e7a2e740 1 -- 172.21.15.37:0/101958325 wait complete. 2024-08-20T05:12:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.099+0000 7f80e7a2e740 20 client.28051 trim_cache size 0 max 16384 2024-08-20T05:12:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.100+0000 7f80e4e00640 1 -- 172.21.15.37:0/658751950 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80c40b3c90 msgr2=0x7f80c40b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:14.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.100+0000 7f80e4e00640 1 --2- 172.21.15.37:0/658751950 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80c40b3c90 0x7f80c40b6150 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f80cc02aa30 tx=0x7f80cc000bc0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.100+0000 7f80e4e00640 1 -- 172.21.15.37:0/658751950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80e01090e0 msgr2=0x7f80e019f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:14.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.100+0000 7f80e4e00640 1 --2- 172.21.15.37:0/658751950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80e01090e0 0x7f80e019f750 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f80d800ba50 tx=0x7f80d800bf10 comp rx=0 tx=0).stop 2024-08-20T05:12:14.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.100+0000 7f80e4e00640 1 -- 172.21.15.37:0/658751950 shutdown_connections 2024-08-20T05:12:14.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.100+0000 7f80e4e00640 1 --2- 172.21.15.37:0/658751950 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f80c40b3c90 0x7f80c40b6150 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.100+0000 7f80e4e00640 1 --2- 172.21.15.37:0/658751950 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f80e010f470 0x7f80e01a5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.100+0000 7f80e4e00640 1 --2- 172.21.15.37:0/658751950 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f80e010eaf0 0x7f80e019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.100+0000 7f80e4e00640 1 --2- 172.21.15.37:0/658751950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80e01090e0 0x7f80e019f750 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.100+0000 7f80e4e00640 1 -- 172.21.15.37:0/658751950 >> 172.21.15.37:0/658751950 conn(0x7f80e0078760 msgr2=0x7f80e007ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.100+0000 7f80e4e00640 1 -- 172.21.15.37:0/658751950 shutdown_connections 2024-08-20T05:12:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:14.100+0000 7f80e4e00640 1 -- 172.21.15.37:0/658751950 wait complete. 2024-08-20T05:12:14.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:14 smithi130 ceph-mon[22007]: scrub queued for path: / 2024-08-20T05:12:14.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:14 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:14.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:14 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:12:14.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:14 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:12:14.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:14 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:14.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:14 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:12:14.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:14 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:12:14.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:14 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:14.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:14 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:14.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:14 smithi037 ceph-mon[17265]: scrub queued for path: / 2024-08-20T05:12:14.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:14 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:14.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:14 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:12:14.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:14 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:12:14.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:14 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:14.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:14 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:12:14.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:14 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:12:14.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:14 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:14.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:14 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:14.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:14 smithi135 ceph-mon[22342]: scrub queued for path: / 2024-08-20T05:12:14.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:14 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:14.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:14 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:12:14.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:14 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:12:14.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:14 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:14.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:14 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:12:14.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:14 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:12:14.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:14 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:14.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:14 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:15.225 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:12:15.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:15 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:12:15.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:15 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:12:15.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:15 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:15.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:15 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:15.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:15 smithi130 ceph-mon[22007]: pgmap v701: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.7 MiB/s wr, 513 op/s 2024-08-20T05:12:15.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:15 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:15.758 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:15 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:12:15.758 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:15 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:12:15.758 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:15 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:15.758 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:15 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:15.758 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:15 smithi037 ceph-mon[17265]: pgmap v701: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.7 MiB/s wr, 513 op/s 2024-08-20T05:12:15.758 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:15 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:15 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:12:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:15 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:12:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:15 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:15 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:15 smithi135 ceph-mon[22342]: pgmap v701: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.7 MiB/s wr, 513 op/s 2024-08-20T05:12:15.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:15 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:12:17.299 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:12:17.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:17 smithi130 ceph-mon[22007]: pgmap v702: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 5.2 MiB/s wr, 589 op/s 2024-08-20T05:12:17.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:17 smithi037 ceph-mon[17265]: pgmap v702: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 5.2 MiB/s wr, 589 op/s 2024-08-20T05:12:17.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:17 smithi135 ceph-mon[22342]: pgmap v702: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 5.2 MiB/s wr, 589 op/s 2024-08-20T05:12:18.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 560.0 s, 432.6 tps, lat 229.806 ms stddev 290.522 2024-08-20T05:12:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.463+0000 7f53f1400640 1 -- 172.21.15.37:0/448903724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53ec107b90 msgr2=0x7f53ec10e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.463+0000 7f53f1400640 1 --2- 172.21.15.37:0/448903724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53ec107b90 0x7f53ec10e390 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f53d800d910 tx=0x7f53d802a170 comp rx=0 tx=0).stop 2024-08-20T05:12:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.464+0000 7f53f1400640 1 -- 172.21.15.37:0/448903724 shutdown_connections 2024-08-20T05:12:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.464+0000 7f53f1400640 1 --2- 172.21.15.37:0/448903724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53ec107b90 0x7f53ec10e390 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.464+0000 7f53f1400640 1 --2- 172.21.15.37:0/448903724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53ec107210 0x7f53ec107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.464+0000 7f53f1400640 1 --2- 172.21.15.37:0/448903724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53ec101800 0x7f53ec101be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.464+0000 7f53f1400640 1 -- 172.21.15.37:0/448903724 >> 172.21.15.37:0/448903724 conn(0x7f53ec0fd2d0 msgr2=0x7f53ec0ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.464+0000 7f53f1400640 1 -- 172.21.15.37:0/448903724 shutdown_connections 2024-08-20T05:12:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.464+0000 7f53f1400640 1 -- 172.21.15.37:0/448903724 wait complete. 2024-08-20T05:12:18.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.465+0000 7f53f1400640 1 Processor -- start 2024-08-20T05:12:18.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.465+0000 7f53f1400640 1 -- start start 2024-08-20T05:12:18.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.466+0000 7f53f1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53ec101800 0x7f53ec196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.466+0000 7f53f1400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53ec107210 0x7f53ec197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.466+0000 7f53f1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53ec107b90 0x7f53ec19c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.466+0000 7f53f1400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec110790 con 0x7f53ec107210 2024-08-20T05:12:18.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.466+0000 7f53f1400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec110610 con 0x7f53ec101800 2024-08-20T05:12:18.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.466+0000 7f53f1400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec110910 con 0x7f53ec107b90 2024-08-20T05:12:18.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.466+0000 7f53ebe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53ec101800 0x7f53ec196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:18.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.466+0000 7f53f0a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53ec107b90 0x7f53ec19c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:18.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.466+0000 7f53f0a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53ec107b90 0x7f53ec19c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42186/0 (socket says 172.21.15.37:42186) 2024-08-20T05:12:18.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.467+0000 7f53f0a00640 1 -- 172.21.15.37:0/3641942709 learned_addr learned my addr 172.21.15.37:0/3641942709 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:18.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.467+0000 7f53f0a00640 1 -- 172.21.15.37:0/3641942709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53ec101800 msgr2=0x7f53ec196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:18.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.467+0000 7f53f0a00640 1 --2- 172.21.15.37:0/3641942709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53ec101800 0x7f53ec196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.467+0000 7f53f0a00640 1 -- 172.21.15.37:0/3641942709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53ec107210 msgr2=0x7f53ec197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:18.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.467+0000 7f53eb400640 1 --2- 172.21.15.37:0/3641942709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53ec107210 0x7f53ec197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:18.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.467+0000 7f53f0a00640 1 --2- 172.21.15.37:0/3641942709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53ec107210 0x7f53ec197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.467+0000 7f53f0a00640 1 -- 172.21.15.37:0/3641942709 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ec19ccc0 con 0x7f53ec107b90 2024-08-20T05:12:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.467+0000 7f53eb400640 1 --2- 172.21.15.37:0/3641942709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53ec107210 0x7f53ec197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:12:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.468+0000 7f53f0a00640 1 --2- 172.21.15.37:0/3641942709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53ec107b90 0x7f53ec19c400 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f53d802a6e0 tx=0x7f53d8004fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.468+0000 7f53e8c00640 1 -- 172.21.15.37:0/3641942709 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d803e020 con 0x7f53ec107b90 2024-08-20T05:12:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.468+0000 7f53f1400640 1 -- 172.21.15.37:0/3641942709 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ec19cf50 con 0x7f53ec107b90 2024-08-20T05:12:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.468+0000 7f53f1400640 1 -- 172.21.15.37:0/3641942709 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ec1a3750 con 0x7f53ec107b90 2024-08-20T05:12:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.469+0000 7f53e8c00640 1 -- 172.21.15.37:0/3641942709 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53d802e050 con 0x7f53ec107b90 2024-08-20T05:12:18.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.469+0000 7f53e8c00640 1 -- 172.21.15.37:0/3641942709 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d8032420 con 0x7f53ec107b90 2024-08-20T05:12:18.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.473+0000 7f53f53e1740 1 Processor -- start 2024-08-20T05:12:18.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.476+0000 7f53e8c00640 1 -- 172.21.15.37:0/3641942709 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f53d8041020 con 0x7f53ec107b90 2024-08-20T05:12:18.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.478+0000 7f53f53e1740 1 -- start start 2024-08-20T05:12:18.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.478+0000 7f53f53e1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c0a80 0x5598171c0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.478+0000 7f53f53e1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c13a0 0x5598171d5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.478+0000 7f53f53e1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171d5b40 0x5598171d7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.478+0000 7f53f53e1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559817136a60 con 0x5598171c0a80 2024-08-20T05:12:18.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.478+0000 7f53f53e1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559817125f60 con 0x5598171c13a0 2024-08-20T05:12:18.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.478+0000 7f53f53e1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559817129fa0 con 0x5598171d5b40 2024-08-20T05:12:18.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.479+0000 7f53eb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c0a80 0x5598171c0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:18.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.479+0000 7f53ebe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c13a0 0x5598171d5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:18.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.479+0000 7f53eb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c0a80 0x5598171c0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59226/0 (socket says 172.21.15.37:59226) 2024-08-20T05:12:18.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.479+0000 7f53ebe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c13a0 0x5598171d5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:59220/0 (socket says 172.21.15.37:59220) 2024-08-20T05:12:18.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.479+0000 7f53eb400640 1 -- 172.21.15.37:0/1989159879 learned_addr learned my addr 172.21.15.37:0/1989159879 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.479+0000 7f53e8c00640 1 --2- 172.21.15.37:0/3641942709 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53d00b3dc0 0x7f53d00b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.479+0000 7f53eb400640 1 --2- 172.21.15.37:0/1989159879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171d5b40 0x5598171d7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.479+0000 7f53e8c00640 1 -- 172.21.15.37:0/3641942709 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f53d8103b20 con 0x7f53ec107b90 2024-08-20T05:12:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.479+0000 7f53eb400640 1 -- 172.21.15.37:0/1989159879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171d5b40 msgr2=0x5598171d7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.479+0000 7f53eb400640 1 --2- 172.21.15.37:0/1989159879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171d5b40 0x5598171d7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.479+0000 7f53eb400640 1 -- 172.21.15.37:0/1989159879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c13a0 msgr2=0x5598171d5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:18.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.479+0000 7f53eb400640 1 --2- 172.21.15.37:0/1989159879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c13a0 0x5598171d5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.479+0000 7f53f0a00640 1 --2- 172.21.15.37:0/3641942709 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53d00b3dc0 0x7f53d00b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.479+0000 7f53eb400640 1 -- 172.21.15.37:0/1989159879 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598170cc3e0 con 0x5598171c0a80 2024-08-20T05:12:18.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.481+0000 7f53eb400640 1 --2- 172.21.15.37:0/1989159879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c0a80 0x5598171c0e60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f53dc013840 tx=0x7f53dc00e3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b9158b67884e70 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:18.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.483+0000 7f53e1200640 1 -- 172.21.15.37:0/1989159879 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc00b6c0 con 0x5598171c0a80 2024-08-20T05:12:18.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.483+0000 7f53e1200640 1 -- 172.21.15.37:0/1989159879 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53dc00bd10 con 0x5598171c0a80 2024-08-20T05:12:18.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.484+0000 7f53e1200640 1 -- 172.21.15.37:0/1989159879 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc00b6c0 con 0x5598171c0a80 2024-08-20T05:12:18.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.485+0000 7f53f53e1740 1 -- 172.21.15.37:0/1989159879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c0a80 msgr2=0x5598171c0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:18.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.485+0000 7f53f53e1740 1 --2- 172.21.15.37:0/1989159879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c0a80 0x5598171c0e60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f53dc013840 tx=0x7f53dc00e3d0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.485+0000 7f53f0a00640 1 --2- 172.21.15.37:0/3641942709 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53d00b3dc0 0x7f53d00b6280 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f53d80e4420 tx=0x7f53d800cf40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:18.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.486+0000 7f53f53e1740 1 -- 172.21.15.37:0/1989159879 shutdown_connections 2024-08-20T05:12:18.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.486+0000 7f53f53e1740 1 --2- 172.21.15.37:0/1989159879 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171d5b40 0x5598171d7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.486+0000 7f53f53e1740 1 --2- 172.21.15.37:0/1989159879 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c13a0 0x5598171d5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.486+0000 7f53f53e1740 1 --2- 172.21.15.37:0/1989159879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c0a80 0x5598171c0e60 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.486+0000 7f53f53e1740 1 -- 172.21.15.37:0/1989159879 >> 172.21.15.37:0/1989159879 conn(0x5598171be8b0 msgr2=0x5598171bfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:18.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.486+0000 7f53f53e1740 1 -- 172.21.15.37:0/1989159879 shutdown_connections 2024-08-20T05:12:18.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.487+0000 7f53f53e1740 1 -- 172.21.15.37:0/1989159879 wait complete. 2024-08-20T05:12:18.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.487+0000 7f53f53e1740 1 -- start start 2024-08-20T05:12:18.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.488+0000 7f53f53e1740 1 Processor -- start 2024-08-20T05:12:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.490+0000 7f53f53e1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c0a80 0x5598171d5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.491+0000 7f53f53e1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c13a0 0x5598171d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.491+0000 7f53f53e1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171d5b40 0x5598171d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.491+0000 7f53f53e1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559816f88700 con 0x5598171c13a0 2024-08-20T05:12:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.491+0000 7f53f53e1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5598170c1250 con 0x5598171c0a80 2024-08-20T05:12:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.491+0000 7f53f53e1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5598171d8840 con 0x5598171d5b40 2024-08-20T05:12:18.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.491+0000 7f53f53e1740 10 client.0 _ll_register_callbacks cb 0x559817120180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.491+0000 7f53eb400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c0a80 0x5598171d5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.491+0000 7f53eb400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c0a80 0x5598171d5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:59226/0 (socket says 172.21.15.37:59226) 2024-08-20T05:12:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.491+0000 7f53eb400640 1 -- 172.21.15.37:0/1531531841 learned_addr learned my addr 172.21.15.37:0/1531531841 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.491+0000 7f53eb400640 1 --2- 172.21.15.37:0/1531531841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171d5b40 0x5598171d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.492+0000 7f53ebe00640 1 --2- 172.21.15.37:0/1531531841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c13a0 0x5598171d26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.492+0000 7f53eb400640 1 -- 172.21.15.37:0/1531531841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171d5b40 msgr2=0x5598171d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:18.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.492+0000 7f53eb400640 1 --2- 172.21.15.37:0/1531531841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171d5b40 0x5598171d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.493+0000 7f53eb400640 1 -- 172.21.15.37:0/1531531841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c13a0 msgr2=0x5598171d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:18.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.493+0000 7f53eb400640 1 --2- 172.21.15.37:0/1531531841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c13a0 0x5598171d26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.493+0000 7f53eb400640 1 -- 172.21.15.37:0/1531531841 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559816e85650 con 0x5598171c0a80 2024-08-20T05:12:18.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.493+0000 7f53ebe00640 1 --2- 172.21.15.37:0/1531531841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c13a0 0x5598171d26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:12:18.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.494+0000 7f53eb400640 1 --2- 172.21.15.37:0/1531531841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c0a80 0x5598171d5270 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f53dc005940 tx=0x7f53dc005c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccf739ec421de4f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:18.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.494+0000 7f53d5600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:12:18.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.495+0000 7f53d5600640 1 -- 172.21.15.37:0/1531531841 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc013dc0 con 0x5598171c0a80 2024-08-20T05:12:18.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.496+0000 7f53d5600640 1 -- 172.21.15.37:0/1531531841 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f53dc00b8d0 con 0x5598171c0a80 2024-08-20T05:12:18.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.496+0000 7f53f53e1740 1 -- 172.21.15.37:0/1531531841 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53dc00bd10 con 0x5598171c0a80 2024-08-20T05:12:18.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.496+0000 7f53d5600640 1 -- 172.21.15.37:0/1531531841 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f53dc00bad0 con 0x5598171c0a80 2024-08-20T05:12:18.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.497+0000 7f53f53e1740 10 client.28055 fetch_fsmap learned FSMap version 43 2024-08-20T05:12:18.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.497+0000 7f53f53e1740 1 -- 172.21.15.37:0/1531531841 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5598171e40a0 con 0x5598171c0a80 2024-08-20T05:12:18.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.499+0000 7f53d5600640 1 -- 172.21.15.37:0/1531531841 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53dc00bd10 con 0x5598171c0a80 2024-08-20T05:12:18.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.499+0000 7f53d5600640 1 -- 172.21.15.37:0/1531531841 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f53dc02d020 con 0x5598171c0a80 2024-08-20T05:12:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.499+0000 7f53f53e1740 10 client.28055 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:12:18.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.499+0000 7f53f53e1740 10 client.28055 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:12:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.499+0000 7f53f53e1740 20 client.28055 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.499+0000 7f53f53e1740 1 --2- 172.21.15.37:0/1531531841 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5598171e53f0 0x5598171e77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.499+0000 7f53f53e1740 4 client.28055 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:12:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.499+0000 7f53f53e1740 1 -- 172.21.15.37:0/1531531841 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598171389b0 con 0x5598171e53f0 2024-08-20T05:12:18.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.502+0000 7f53ebe00640 1 --2- 172.21.15.37:0/1531531841 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5598171e53f0 0x5598171e77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.503+0000 7f53ebe00640 1 --2- 172.21.15.37:0/1531531841 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5598171e53f0 0x5598171e77e0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=506d8a3f4d6d237 server_cookie=313a3a7186bdaf1a in_seq=0 out_seq=0 2024-08-20T05:12:18.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.503+0000 7f53d5600640 10 client.28055 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.504+0000 7f53d5600640 1 -- 172.21.15.37:0/1531531841 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5598171389b0 con 0x5598171e53f0 2024-08-20T05:12:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.504+0000 7f53d5600640 10 client.28055 handle_command_reply: tid=0 2024-08-20T05:12:18.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.504+0000 7f53f53e1740 1 client.28055 shutdown 2024-08-20T05:12:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.505+0000 7f53f53e1740 1 -- 172.21.15.37:0/1531531841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c0a80 msgr2=0x5598171d5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:18.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.505+0000 7f53f53e1740 1 --2- 172.21.15.37:0/1531531841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c0a80 0x5598171d5270 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f53dc005940 tx=0x7f53dc005c50 comp rx=0 tx=0).stop 2024-08-20T05:12:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.505+0000 7f53f53e1740 1 -- 172.21.15.37:0/1531531841 shutdown_connections 2024-08-20T05:12:18.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.505+0000 7f53f53e1740 1 --2- 172.21.15.37:0/1531531841 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5598171e53f0 0x5598171e77e0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.505+0000 7f53f53e1740 1 --2- 172.21.15.37:0/1531531841 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171d5b40 0x5598171d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.505+0000 7f53f53e1740 1 --2- 172.21.15.37:0/1531531841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c13a0 0x5598171d26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.505+0000 7f53f53e1740 1 --2- 172.21.15.37:0/1531531841 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c0a80 0x5598171d5270 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.505+0000 7f53f53e1740 1 -- 172.21.15.37:0/1531531841 >> 172.21.15.37:0/1531531841 conn(0x5598171be8b0 msgr2=0x5598171c4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.506+0000 7f53d5600640 0 client.28055 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.506+0000 7f53f53e1740 1 -- 172.21.15.37:0/1531531841 shutdown_connections 2024-08-20T05:12:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.506+0000 7f53f53e1740 1 -- 172.21.15.37:0/1531531841 wait complete. 2024-08-20T05:12:18.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.506+0000 7f53f53e1740 20 client.28055 trim_cache size 0 max 16384 2024-08-20T05:12:18.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.542+0000 7f53f53e1740 1 Processor -- start 2024-08-20T05:12:18.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.542+0000 7f53f53e1740 1 -- start start 2024-08-20T05:12:18.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.543+0000 7f53f53e1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c0a80 0x5598171d2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.543+0000 7f53f53e1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c13a0 0x5598171c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.543+0000 7f53f53e1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171d5b40 0x5598171bd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.543+0000 7f53f53e1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc00fd20 con 0x5598171c13a0 2024-08-20T05:12:18.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.543+0000 7f53f53e1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc0118f0 con 0x5598171c0a80 2024-08-20T05:12:18.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.543+0000 7f53f53e1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc0103f0 con 0x5598171d5b40 2024-08-20T05:12:18.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.544+0000 7f53eb400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c0a80 0x5598171d2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:18.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.544+0000 7f53eb400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c0a80 0x5598171d2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:59242/0 (socket says 172.21.15.37:59242) 2024-08-20T05:12:18.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.544+0000 7f53eb400640 1 -- 172.21.15.37:0/589500190 learned_addr learned my addr 172.21.15.37:0/589500190 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:18.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.544+0000 7f53ebe00640 1 --2- 172.21.15.37:0/589500190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c13a0 0x5598171c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:18.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.544+0000 7f53eb400640 1 --2- 172.21.15.37:0/589500190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171d5b40 0x5598171bd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:18.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.545+0000 7f53eb400640 1 -- 172.21.15.37:0/589500190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171d5b40 msgr2=0x5598171bd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:18.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.545+0000 7f53eb400640 1 --2- 172.21.15.37:0/589500190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171d5b40 0x5598171bd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.545+0000 7f53eb400640 1 -- 172.21.15.37:0/589500190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c13a0 msgr2=0x5598171c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:18.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.545+0000 7f53eb400640 1 --2- 172.21.15.37:0/589500190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c13a0 0x5598171c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.545+0000 7f53eb400640 1 -- 172.21.15.37:0/589500190 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598171d2470 con 0x5598171c0a80 2024-08-20T05:12:18.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.545+0000 7f53ebe00640 1 --2- 172.21.15.37:0/589500190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c13a0 0x5598171c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:12:18.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.547+0000 7f53eb400640 1 --2- 172.21.15.37:0/589500190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c0a80 0x5598171d2d00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f53dc005d40 tx=0x7f53dc00eaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d038cde941de969 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:18.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.547+0000 7f53d7e00640 1 -- 172.21.15.37:0/589500190 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc00bad0 con 0x5598171c0a80 2024-08-20T05:12:18.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.548+0000 7f53d7e00640 1 -- 172.21.15.37:0/589500190 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53dc00e870 con 0x5598171c0a80 2024-08-20T05:12:18.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.548+0000 7f53d7e00640 1 -- 172.21.15.37:0/589500190 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc011040 con 0x5598171c0a80 2024-08-20T05:12:18.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.549+0000 7f53f53e1740 1 -- 172.21.15.37:0/589500190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c0a80 msgr2=0x5598171d2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:18.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.549+0000 7f53f53e1740 1 --2- 172.21.15.37:0/589500190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c0a80 0x5598171d2d00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f53dc005d40 tx=0x7f53dc00eaf0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.549+0000 7f53f53e1740 1 -- 172.21.15.37:0/589500190 shutdown_connections 2024-08-20T05:12:18.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.550+0000 7f53f53e1740 1 --2- 172.21.15.37:0/589500190 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171d5b40 0x5598171bd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.550+0000 7f53f53e1740 1 --2- 172.21.15.37:0/589500190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171c13a0 0x5598171c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.550+0000 7f53f53e1740 1 --2- 172.21.15.37:0/589500190 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c0a80 0x5598171d2d00 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.550+0000 7f53f53e1740 1 -- 172.21.15.37:0/589500190 >> 172.21.15.37:0/589500190 conn(0x5598171be8b0 msgr2=0x5598171c3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:18.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.550+0000 7f53f53e1740 1 -- 172.21.15.37:0/589500190 shutdown_connections 2024-08-20T05:12:18.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.550+0000 7f53f53e1740 1 -- 172.21.15.37:0/589500190 wait complete. 2024-08-20T05:12:18.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.553+0000 7f53f53e1740 1 -- start start 2024-08-20T05:12:18.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.554+0000 7f53f53e1740 1 Processor -- start 2024-08-20T05:12:18.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.555+0000 7f53f53e1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171c0a80 0x5598171ed740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.555+0000 7f53f53e1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c13a0 0x5598171ddbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.555+0000 7f53f53e1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171d5b40 0x5598171de170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.556+0000 7f53f53e1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc0111f0 con 0x5598171d5b40 2024-08-20T05:12:18.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.556+0000 7f53f53e1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc010ac0 con 0x5598171c13a0 2024-08-20T05:12:18.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.556+0000 7f53f53e1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc00dcc0 con 0x5598171c0a80 2024-08-20T05:12:18.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.556+0000 7f53f53e1740 10 client.0 _ll_register_callbacks cb 0x7f53e400d1f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:18.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.557+0000 7f53ebe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c13a0 0x5598171ddbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:18.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.557+0000 7f53ebe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c13a0 0x5598171ddbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:59250/0 (socket says 172.21.15.37:59250) 2024-08-20T05:12:18.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.557+0000 7f53ebe00640 1 -- 172.21.15.37:0/474500896 learned_addr learned my addr 172.21.15.37:0/474500896 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:18.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.557+0000 7f53eb400640 1 --2- 172.21.15.37:0/474500896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171c0a80 0x5598171ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:18.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.558+0000 7f53eb400640 1 -- 172.21.15.37:0/474500896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c13a0 msgr2=0x5598171ddbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:18.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.558+0000 7f53eb400640 1 --2- 172.21.15.37:0/474500896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c13a0 0x5598171ddbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.558+0000 7f53eb400640 1 -- 172.21.15.37:0/474500896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171d5b40 msgr2=0x5598171de170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:18.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.558+0000 7f53eb400640 1 --2- 172.21.15.37:0/474500896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171d5b40 0x5598171de170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.558+0000 7f53eb400640 1 -- 172.21.15.37:0/474500896 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55981724afc0 con 0x5598171c0a80 2024-08-20T05:12:18.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.560+0000 7f53eb400640 1 --2- 172.21.15.37:0/474500896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171c0a80 0x5598171ed740 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00b690 tx=0x7f53dc0058c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcdd22fb80d6423d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:18.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.560+0000 7f53d5600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:12:18.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.561+0000 7f53d5600640 1 -- 172.21.15.37:0/474500896 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53dc00bce0 con 0x5598171c0a80 2024-08-20T05:12:18.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.562+0000 7f53f53e1740 1 -- 172.21.15.37:0/474500896 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53dc00e870 con 0x5598171c0a80 2024-08-20T05:12:18.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.562+0000 7f53d5600640 1 -- 172.21.15.37:0/474500896 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f53dc003c00 con 0x5598171c0a80 2024-08-20T05:12:18.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.562+0000 7f53d5600640 1 -- 172.21.15.37:0/474500896 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f53dc04a050 con 0x5598171c0a80 2024-08-20T05:12:18.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.563+0000 7f53f53e1740 10 client.28069 fetch_fsmap learned FSMap version 43 2024-08-20T05:12:18.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.563+0000 7f53f53e1740 1 -- 172.21.15.37:0/474500896 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5598171ec390 con 0x5598171c0a80 2024-08-20T05:12:18.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.564+0000 7f53d5600640 1 -- 172.21.15.37:0/474500896 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53dc00e870 con 0x5598171c0a80 2024-08-20T05:12:18.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.564+0000 7f53d5600640 1 -- 172.21.15.37:0/474500896 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7f53dc02d040 con 0x5598171c0a80 2024-08-20T05:12:18.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.565+0000 7f53f53e1740 10 client.28069 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:12:18.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.565+0000 7f53f53e1740 10 client.28069 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:12:18.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.565+0000 7f53f53e1740 20 client.28069 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:18.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.565+0000 7f53f53e1740 1 --2- 172.21.15.37:0/474500896 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5598171ec800 0x559817263000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:18.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.565+0000 7f53f53e1740 4 client.28069 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:12:18.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.565+0000 7f53f53e1740 1 -- 172.21.15.37:0/474500896 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559817134450 con 0x5598171ec800 2024-08-20T05:12:18.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.566+0000 7f53ebe00640 1 --2- 172.21.15.37:0/474500896 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5598171ec800 0x559817263000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:18.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.569+0000 7f53d5600640 10 client.28069 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:18.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.569+0000 7f53ebe00640 1 --2- 172.21.15.37:0/474500896 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5598171ec800 0x559817263000 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94ca19cceda1c06c server_cookie=76ac489a76f5ce22 in_seq=0 out_seq=0 2024-08-20T05:12:18.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.572+0000 7f53d5600640 1 -- 172.21.15.37:0/474500896 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559817134450 con 0x5598171ec800 2024-08-20T05:12:18.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.572+0000 7f53d5600640 10 client.28069 handle_command_reply: tid=0 2024-08-20T05:12:18.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.572+0000 7f53f53e1740 1 client.28069 shutdown 2024-08-20T05:12:18.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.573+0000 7f53f53e1740 1 -- 172.21.15.37:0/474500896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171c0a80 msgr2=0x5598171ed740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:18.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.573+0000 7f53f53e1740 1 --2- 172.21.15.37:0/474500896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171c0a80 0x5598171ed740 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00b690 tx=0x7f53dc0058c0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.573+0000 7f53f53e1740 1 -- 172.21.15.37:0/474500896 shutdown_connections 2024-08-20T05:12:18.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.573+0000 7f53f53e1740 1 --2- 172.21.15.37:0/474500896 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5598171ec800 0x559817263000 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.573+0000 7f53f53e1740 1 --2- 172.21.15.37:0/474500896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598171d5b40 0x5598171de170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.573+0000 7f53f53e1740 1 --2- 172.21.15.37:0/474500896 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5598171c13a0 0x5598171ddbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.573+0000 7f53f53e1740 1 --2- 172.21.15.37:0/474500896 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5598171c0a80 0x5598171ed740 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.573+0000 7f53f53e1740 1 -- 172.21.15.37:0/474500896 >> 172.21.15.37:0/474500896 conn(0x5598171be8b0 msgr2=0x5598171d4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:18.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.574+0000 7f53d5600640 0 client.28069 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:18.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.574+0000 7f53f53e1740 1 -- 172.21.15.37:0/474500896 shutdown_connections 2024-08-20T05:12:18.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.576+0000 7f53f53e1740 1 -- 172.21.15.37:0/474500896 wait complete. 2024-08-20T05:12:18.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.577+0000 7f53f53e1740 20 client.28069 trim_cache size 0 max 16384 2024-08-20T05:12:18.579 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:12:18.580 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T05:12:18.580 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-20T05:12:18.580 INFO:teuthology.orchestra.run.smithi037.stdout: "0bf3f73d-6cf4-4a4e-bb58-7bf467ef8004": { 2024-08-20T05:12:18.580 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-20T05:12:18.580 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "0bf3f73d-6cf4-4a4e-bb58-7bf467ef8004", 2024-08-20T05:12:18.580 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-20T05:12:18.580 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:12:18.580 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:12:18.580 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:12:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.579+0000 7f53f1400640 1 -- 172.21.15.37:0/3641942709 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53d00b3dc0 msgr2=0x7f53d00b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.579+0000 7f53f1400640 1 --2- 172.21.15.37:0/3641942709 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53d00b3dc0 0x7f53d00b6280 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f53d80e4420 tx=0x7f53d800cf40 comp rx=0 tx=0).stop 2024-08-20T05:12:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.579+0000 7f53f1400640 1 -- 172.21.15.37:0/3641942709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53ec107b90 msgr2=0x7f53ec19c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.579+0000 7f53f1400640 1 --2- 172.21.15.37:0/3641942709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53ec107b90 0x7f53ec19c400 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f53d802a6e0 tx=0x7f53d8004fa0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.579+0000 7f53f1400640 1 -- 172.21.15.37:0/3641942709 shutdown_connections 2024-08-20T05:12:18.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.579+0000 7f53f1400640 1 --2- 172.21.15.37:0/3641942709 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53d00b3dc0 0x7f53d00b6280 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.579+0000 7f53f1400640 1 --2- 172.21.15.37:0/3641942709 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f53ec107b90 0x7f53ec19c400 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.580+0000 7f53f1400640 1 --2- 172.21.15.37:0/3641942709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53ec107210 0x7f53ec197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.580+0000 7f53f1400640 1 --2- 172.21.15.37:0/3641942709 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f53ec101800 0x7f53ec196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:18.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.580+0000 7f53f1400640 1 -- 172.21.15.37:0/3641942709 >> 172.21.15.37:0/3641942709 conn(0x7f53ec0fd2d0 msgr2=0x7f53ec0fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:18.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.580+0000 7f53f1400640 1 -- 172.21.15.37:0/3641942709 shutdown_connections 2024-08-20T05:12:18.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:12:18.580+0000 7f53f1400640 1 -- 172.21.15.37:0/3641942709 wait complete. 2024-08-20T05:12:19.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:19 smithi130 ceph-mon[22007]: pgmap v703: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.0 MiB/s wr, 586 op/s 2024-08-20T05:12:19.801 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:19 smithi037 ceph-mon[17265]: pgmap v703: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.0 MiB/s wr, 586 op/s 2024-08-20T05:12:19.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:19 smithi135 ceph-mon[22342]: pgmap v703: 129 pgs: 129 active+clean; 1.4 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.0 MiB/s wr, 586 op/s 2024-08-20T05:12:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.320+0000 7fb23e800640 1 -- 172.21.15.37:0/3614251827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2381063c0 msgr2=0x7fb23810cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.320+0000 7fb23e800640 1 --2- 172.21.15.37:0/3614251827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2381063c0 0x7fb23810cd40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb230009930 tx=0x7fb23002a440 comp rx=0 tx=0).stop 2024-08-20T05:12:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.321+0000 7fb23e800640 1 -- 172.21.15.37:0/3614251827 shutdown_connections 2024-08-20T05:12:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.321+0000 7fb23e800640 1 --2- 172.21.15.37:0/3614251827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2381063c0 0x7fb23810cd40 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.321+0000 7fb23e800640 1 --2- 172.21.15.37:0/3614251827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb238105a00 0x7fb238105e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.321+0000 7fb23e800640 1 --2- 172.21.15.37:0/3614251827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb2381048b0 0x7fb238104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.321+0000 7fb23e800640 1 -- 172.21.15.37:0/3614251827 >> 172.21.15.37:0/3614251827 conn(0x7fb238100170 msgr2=0x7fb238102590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.321+0000 7fb23e800640 1 -- 172.21.15.37:0/3614251827 shutdown_connections 2024-08-20T05:12:20.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.321+0000 7fb23e800640 1 -- 172.21.15.37:0/3614251827 wait complete. 2024-08-20T05:12:20.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.322+0000 7fb23e800640 1 Processor -- start 2024-08-20T05:12:20.324 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.323+0000 7fb23e800640 1 -- start start 2024-08-20T05:12:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.323+0000 7fb23e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2381048b0 0x7fb23819f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.323+0000 7fb23e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb238105a00 0x7fb23819f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.323+0000 7fb23e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2381063c0 0x7fb2381a02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.323+0000 7fb23e800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb238077f70 con 0x7fb2381063c0 2024-08-20T05:12:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.323+0000 7fb23e800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb238077df0 con 0x7fb238105a00 2024-08-20T05:12:20.325 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.323+0000 7fb23e800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb2380780f0 con 0x7fb2381048b0 2024-08-20T05:12:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.323+0000 7fb237400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2381048b0 0x7fb23819f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.323+0000 7fb237400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2381048b0 0x7fb23819f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42224/0 (socket says 172.21.15.37:42224) 2024-08-20T05:12:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.323+0000 7fb237400640 1 -- 172.21.15.37:0/4128889398 learned_addr learned my addr 172.21.15.37:0/4128889398 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.323+0000 7fb22ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb238105a00 0x7fb23819f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.324+0000 7fb237e00640 1 --2- 172.21.15.37:0/4128889398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2381063c0 0x7fb2381a02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.324+0000 7fb237400640 1 -- 172.21.15.37:0/4128889398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb238105a00 msgr2=0x7fb23819f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.324+0000 7fb237400640 1 --2- 172.21.15.37:0/4128889398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb238105a00 0x7fb23819f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.326 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.324+0000 7fb237400640 1 -- 172.21.15.37:0/4128889398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2381063c0 msgr2=0x7fb2381a02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.324+0000 7fb237400640 1 --2- 172.21.15.37:0/4128889398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2381063c0 0x7fb2381a02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.324+0000 7fb237400640 1 -- 172.21.15.37:0/4128889398 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2381a0b90 con 0x7fb2381048b0 2024-08-20T05:12:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.324+0000 7fb237e00640 1 --2- 172.21.15.37:0/4128889398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2381063c0 0x7fb2381a02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:12:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.324+0000 7fb237400640 1 --2- 172.21.15.37:0/4128889398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2381048b0 0x7fb23819f050 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb220009d50 tx=0x7fb22000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.324+0000 7fb234c00640 1 -- 172.21.15.37:0/4128889398 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220003b70 con 0x7fb2381048b0 2024-08-20T05:12:20.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.325+0000 7fb234c00640 1 -- 172.21.15.37:0/4128889398 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb220003d10 con 0x7fb2381048b0 2024-08-20T05:12:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.325+0000 7fb234c00640 1 -- 172.21.15.37:0/4128889398 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2200108a0 con 0x7fb2381048b0 2024-08-20T05:12:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.325+0000 7fb23e800640 1 -- 172.21.15.37:0/4128889398 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2381a0e80 con 0x7fb2381048b0 2024-08-20T05:12:20.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.325+0000 7fb23e800640 1 -- 172.21.15.37:0/4128889398 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2381a7550 con 0x7fb2381048b0 2024-08-20T05:12:20.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.331+0000 7fb234c00640 1 -- 172.21.15.37:0/4128889398 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb220004000 con 0x7fb2381048b0 2024-08-20T05:12:20.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.333+0000 7fb234c00640 1 --2- 172.21.15.37:0/4128889398 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb21c0b3c50 0x7fb21c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.335 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.333+0000 7fb234c00640 1 -- 172.21.15.37:0/4128889398 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb2200e4700 con 0x7fb2381048b0 2024-08-20T05:12:20.336 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.334+0000 7fb22ea00640 1 --2- 172.21.15.37:0/4128889398 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb21c0b3c50 0x7fb21c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:20.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.338+0000 7fb22ea00640 1 --2- 172.21.15.37:0/4128889398 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb21c0b3c50 0x7fb21c0b6110 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb22800bbe0 tx=0x7fb22800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:20.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.453+0000 7fb2416b1740 1 Processor -- start 2024-08-20T05:12:20.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.454+0000 7fb2416b1740 1 -- start start 2024-08-20T05:12:20.456 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.455+0000 7fb2416b1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab962610 0x55bdab964a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.455+0000 7fb2416b1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab964f40 0x55bdab967330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.455+0000 7fb2416b1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 0x55bdab969e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.455+0000 7fb2416b1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bdab8d5210 con 0x55bdab964f40 2024-08-20T05:12:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.455+0000 7fb2416b1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bdab8c4710 con 0x55bdab962610 2024-08-20T05:12:20.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.455+0000 7fb2416b1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bdab8c8750 con 0x55bdab967980 2024-08-20T05:12:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.455+0000 7fb237e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 0x55bdab969e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.456+0000 7fb237e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 0x55bdab969e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42236/0 (socket says 172.21.15.37:42236) 2024-08-20T05:12:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.456+0000 7fb237e00640 1 -- 172.21.15.37:0/1510704561 learned_addr learned my addr 172.21.15.37:0/1510704561 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:20.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.456+0000 7fb22ea00640 1 --2- 172.21.15.37:0/1510704561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab964f40 0x55bdab967330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.457+0000 7fb237e00640 1 -- 172.21.15.37:0/1510704561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab962610 msgr2=0x55bdab964a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.457+0000 7fb237e00640 1 --2- 172.21.15.37:0/1510704561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab962610 0x55bdab964a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.457+0000 7fb237e00640 1 -- 172.21.15.37:0/1510704561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab964f40 msgr2=0x55bdab967330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.457+0000 7fb237e00640 1 --2- 172.21.15.37:0/1510704561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab964f40 0x55bdab967330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.459 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.457+0000 7fb237e00640 1 -- 172.21.15.37:0/1510704561 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdab890de0 con 0x55bdab967980 2024-08-20T05:12:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.459+0000 7fb237e00640 1 --2- 172.21.15.37:0/1510704561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 0x55bdab969e40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb230009900 tx=0x7fb230009680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87ab1dc947b6cdce server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:20.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.460+0000 7fb22cc00640 1 -- 172.21.15.37:0/1510704561 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230035030 con 0x55bdab967980 2024-08-20T05:12:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.460+0000 7fb22cc00640 1 -- 172.21.15.37:0/1510704561 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2300044d0 con 0x55bdab967980 2024-08-20T05:12:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.460+0000 7fb22cc00640 1 -- 172.21.15.37:0/1510704561 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2300035f0 con 0x55bdab967980 2024-08-20T05:12:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.461+0000 7fb2416b1740 1 -- 172.21.15.37:0/1510704561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 msgr2=0x55bdab969e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:20.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.461+0000 7fb2416b1740 1 --2- 172.21.15.37:0/1510704561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 0x55bdab969e40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb230009900 tx=0x7fb230009680 comp rx=0 tx=0).stop 2024-08-20T05:12:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.462+0000 7fb2416b1740 1 -- 172.21.15.37:0/1510704561 shutdown_connections 2024-08-20T05:12:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.462+0000 7fb2416b1740 1 --2- 172.21.15.37:0/1510704561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 0x55bdab969e40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.462+0000 7fb2416b1740 1 --2- 172.21.15.37:0/1510704561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab964f40 0x55bdab967330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.462+0000 7fb2416b1740 1 --2- 172.21.15.37:0/1510704561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab962610 0x55bdab964a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.462+0000 7fb2416b1740 1 -- 172.21.15.37:0/1510704561 >> 172.21.15.37:0/1510704561 conn(0x55bdab95d760 msgr2=0x55bdab95e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.462+0000 7fb2416b1740 1 -- 172.21.15.37:0/1510704561 shutdown_connections 2024-08-20T05:12:20.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.462+0000 7fb2416b1740 1 -- 172.21.15.37:0/1510704561 wait complete. 2024-08-20T05:12:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.462+0000 7fb2416b1740 1 -- start start 2024-08-20T05:12:20.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.464+0000 7fb2416b1740 1 Processor -- start 2024-08-20T05:12:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.464+0000 7fb2416b1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab962610 0x55bdab96bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.464+0000 7fb2416b1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab964f40 0x55bdab96c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.464+0000 7fb2416b1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab967980 0x55bdab96cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.464+0000 7fb2416b1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55bdab7fdab0 con 0x55bdab962610 2024-08-20T05:12:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.464+0000 7fb2416b1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55bdab86b140 con 0x55bdab967980 2024-08-20T05:12:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.464+0000 7fb2416b1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55bdab96a900 con 0x55bdab964f40 2024-08-20T05:12:20.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.464+0000 7fb2416b1740 10 client.0 _ll_register_callbacks cb 0x55bdab87e5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.466+0000 7fb22ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab964f40 0x55bdab96c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.466+0000 7fb22ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab964f40 0x55bdab96c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42240/0 (socket says 172.21.15.37:42240) 2024-08-20T05:12:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.466+0000 7fb22ea00640 1 -- 172.21.15.37:0/2243477429 learned_addr learned my addr 172.21.15.37:0/2243477429 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.466+0000 7fb237400640 1 --2- 172.21.15.37:0/2243477429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab962610 0x55bdab96bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.466+0000 7fb22ea00640 1 -- 172.21.15.37:0/2243477429 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab967980 msgr2=0x55bdab96cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.466+0000 7fb22ea00640 1 --2- 172.21.15.37:0/2243477429 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab967980 0x55bdab96cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.466+0000 7fb22ea00640 1 -- 172.21.15.37:0/2243477429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab962610 msgr2=0x55bdab96bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.466+0000 7fb22ea00640 1 --2- 172.21.15.37:0/2243477429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab962610 0x55bdab96bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.466+0000 7fb22ea00640 1 -- 172.21.15.37:0/2243477429 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdab86c170 con 0x55bdab964f40 2024-08-20T05:12:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.467+0000 7fb22ea00640 1 --2- 172.21.15.37:0/2243477429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab964f40 0x55bdab96c3f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb2280117e0 tx=0x7fb228004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cc4d30ca8e61eed server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.467+0000 7fb225600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:12:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.467+0000 7fb225600640 1 -- 172.21.15.37:0/2243477429 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22801fbb0 con 0x55bdab964f40 2024-08-20T05:12:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.467+0000 7fb225600640 1 -- 172.21.15.37:0/2243477429 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb22801fd50 con 0x55bdab964f40 2024-08-20T05:12:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.468+0000 7fb2416b1740 1 -- 172.21.15.37:0/2243477429 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2300044d0 con 0x55bdab964f40 2024-08-20T05:12:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.468+0000 7fb225600640 1 -- 172.21.15.37:0/2243477429 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fb228028440 con 0x55bdab964f40 2024-08-20T05:12:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.469+0000 7fb2416b1740 10 client.28081 fetch_fsmap learned FSMap version 43 2024-08-20T05:12:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.469+0000 7fb2416b1740 1 -- 172.21.15.37:0/2243477429 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55bdab627790 con 0x55bdab964f40 2024-08-20T05:12:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.469+0000 7fb225600640 1 -- 172.21.15.37:0/2243477429 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2300044d0 con 0x55bdab964f40 2024-08-20T05:12:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.469+0000 7fb225600640 1 -- 172.21.15.37:0/2243477429 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7fb228026070 con 0x55bdab964f40 2024-08-20T05:12:20.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.470+0000 7fb2416b1740 10 client.28081 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:12:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.470+0000 7fb2416b1740 10 client.28081 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:12:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.470+0000 7fb2416b1740 20 client.28081 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.470+0000 7fb2416b1740 1 --2- 172.21.15.37:0/2243477429 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55bdab988ab0 0x55bdab98af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.470+0000 7fb2416b1740 4 client.28081 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:12:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.470+0000 7fb2416b1740 1 -- 172.21.15.37:0/2243477429 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bdab8d7160 con 0x55bdab988ab0 2024-08-20T05:12:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.471+0000 7fb237400640 1 --2- 172.21.15.37:0/2243477429 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55bdab988ab0 0x55bdab98af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.473+0000 7fb237400640 1 --2- 172.21.15.37:0/2243477429 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55bdab988ab0 0x55bdab98af10 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f98c9c8a96c3f1a5 server_cookie=7ab98a186b4e3ab6 in_seq=0 out_seq=0 2024-08-20T05:12:20.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.473+0000 7fb225600640 10 client.28081 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:20.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.474+0000 7fb225600640 1 -- 172.21.15.37:0/2243477429 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bdab8d7160 con 0x55bdab988ab0 2024-08-20T05:12:20.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.474+0000 7fb225600640 10 client.28081 handle_command_reply: tid=0 2024-08-20T05:12:20.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.475+0000 7fb2416b1740 1 client.28081 shutdown 2024-08-20T05:12:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.476+0000 7fb2416b1740 1 -- 172.21.15.37:0/2243477429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab964f40 msgr2=0x55bdab96c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.476+0000 7fb2416b1740 1 --2- 172.21.15.37:0/2243477429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab964f40 0x55bdab96c3f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb2280117e0 tx=0x7fb228004730 comp rx=0 tx=0).stop 2024-08-20T05:12:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.476+0000 7fb2416b1740 1 -- 172.21.15.37:0/2243477429 shutdown_connections 2024-08-20T05:12:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.476+0000 7fb2416b1740 1 --2- 172.21.15.37:0/2243477429 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55bdab988ab0 0x55bdab98af10 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.476+0000 7fb2416b1740 1 --2- 172.21.15.37:0/2243477429 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab967980 0x55bdab96cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.476+0000 7fb2416b1740 1 --2- 172.21.15.37:0/2243477429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab964f40 0x55bdab96c3f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.476+0000 7fb2416b1740 1 --2- 172.21.15.37:0/2243477429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab962610 0x55bdab96bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.476+0000 7fb225600640 0 client.28081 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:20.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.476+0000 7fb2416b1740 1 -- 172.21.15.37:0/2243477429 >> 172.21.15.37:0/2243477429 conn(0x55bdab95d760 msgr2=0x55bdab95c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:20.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.476+0000 7fb2416b1740 1 -- 172.21.15.37:0/2243477429 shutdown_connections 2024-08-20T05:12:20.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.477+0000 7fb2416b1740 1 -- 172.21.15.37:0/2243477429 wait complete. 2024-08-20T05:12:20.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.477+0000 7fb2416b1740 20 client.28081 trim_cache size 0 max 16384 2024-08-20T05:12:20.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.518+0000 7fb2416b1740 1 Processor -- start 2024-08-20T05:12:20.520 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.519+0000 7fb2416b1740 1 -- start start 2024-08-20T05:12:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.519+0000 7fb2416b1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab962610 0x55bdab95dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.519+0000 7fb2416b1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab964f40 0x55bdab95e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.519+0000 7fb2416b1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 0x55bdab9689b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.519+0000 7fb2416b1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2381a91f0 con 0x55bdab964f40 2024-08-20T05:12:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.519+0000 7fb2416b1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb2381aadc0 con 0x55bdab962610 2024-08-20T05:12:20.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.519+0000 7fb2416b1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb2381a98c0 con 0x55bdab967980 2024-08-20T05:12:20.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.520+0000 7fb237e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 0x55bdab9689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:20.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.520+0000 7fb22ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab964f40 0x55bdab95e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:20.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.520+0000 7fb22ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab964f40 0x55bdab95e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59312/0 (socket says 172.21.15.37:59312) 2024-08-20T05:12:20.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.520+0000 7fb22ea00640 1 -- 172.21.15.37:0/44617323 learned_addr learned my addr 172.21.15.37:0/44617323 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:20.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.520+0000 7fb237400640 1 --2- 172.21.15.37:0/44617323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab962610 0x55bdab95dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:20.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.521+0000 7fb237e00640 1 -- 172.21.15.37:0/44617323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab962610 msgr2=0x55bdab95dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:20.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.523+0000 7fb237e00640 1 --2- 172.21.15.37:0/44617323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab962610 0x55bdab95dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.523+0000 7fb237e00640 1 -- 172.21.15.37:0/44617323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab964f40 msgr2=0x55bdab95e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:20.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.523+0000 7fb237e00640 1 --2- 172.21.15.37:0/44617323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab964f40 0x55bdab95e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.523+0000 7fb237e00640 1 -- 172.21.15.37:0/44617323 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdab6a0620 con 0x55bdab967980 2024-08-20T05:12:20.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.523+0000 7fb237400640 1 --2- 172.21.15.37:0/44617323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab962610 0x55bdab95dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:12:20.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.523+0000 7fb22ea00640 1 --2- 172.21.15.37:0/44617323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab964f40 0x55bdab95e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:12:20.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.523+0000 7fb237e00640 1 --2- 172.21.15.37:0/44617323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 0x55bdab9689b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb230031500 tx=0x7fb230004550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16dbfc26ad9f3160 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:20.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.525+0000 7fb227e00640 1 -- 172.21.15.37:0/44617323 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230051070 con 0x55bdab967980 2024-08-20T05:12:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.525+0000 7fb227e00640 1 -- 172.21.15.37:0/44617323 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2300048c0 con 0x55bdab967980 2024-08-20T05:12:20.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.525+0000 7fb227e00640 1 -- 172.21.15.37:0/44617323 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb230035050 con 0x55bdab967980 2024-08-20T05:12:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.526+0000 7fb2416b1740 1 -- 172.21.15.37:0/44617323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 msgr2=0x55bdab9689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.526+0000 7fb2416b1740 1 --2- 172.21.15.37:0/44617323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 0x55bdab9689b0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb230031500 tx=0x7fb230004550 comp rx=0 tx=0).stop 2024-08-20T05:12:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.526+0000 7fb2416b1740 1 -- 172.21.15.37:0/44617323 shutdown_connections 2024-08-20T05:12:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.526+0000 7fb2416b1740 1 --2- 172.21.15.37:0/44617323 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 0x55bdab9689b0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.526+0000 7fb2416b1740 1 --2- 172.21.15.37:0/44617323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab964f40 0x55bdab95e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.526+0000 7fb2416b1740 1 --2- 172.21.15.37:0/44617323 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab962610 0x55bdab95dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.526+0000 7fb2416b1740 1 -- 172.21.15.37:0/44617323 >> 172.21.15.37:0/44617323 conn(0x55bdab95d760 msgr2=0x55bdab967d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:20.528 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.526+0000 7fb2416b1740 1 -- 172.21.15.37:0/44617323 shutdown_connections 2024-08-20T05:12:20.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.526+0000 7fb2416b1740 1 -- 172.21.15.37:0/44617323 wait complete. 2024-08-20T05:12:20.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.527+0000 7fb2416b1740 1 -- start start 2024-08-20T05:12:20.529 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.527+0000 7fb2416b1740 1 Processor -- start 2024-08-20T05:12:20.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.528+0000 7fb2416b1740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab962610 0x55bdab9708e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.530 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.529+0000 7fb2416b1740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab964f40 0x55bdab970f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.529+0000 7fb2416b1740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 0x55bdab971a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.529+0000 7fb2416b1740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2381aa6c0 con 0x55bdab962610 2024-08-20T05:12:20.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.529+0000 7fb2416b1740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb2381a9f90 con 0x55bdab964f40 2024-08-20T05:12:20.531 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.529+0000 7fb2416b1740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb238074b60 con 0x55bdab967980 2024-08-20T05:12:20.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.529+0000 7fb2416b1740 10 client.0 _ll_register_callbacks cb 0x7fb228010cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:20.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.529+0000 7fb237e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 0x55bdab971a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:20.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.529+0000 7fb237e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 0x55bdab971a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42262/0 (socket says 172.21.15.37:42262) 2024-08-20T05:12:20.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.529+0000 7fb237400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab962610 0x55bdab9708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:20.532 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.530+0000 7fb237400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab962610 0x55bdab9708e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59326/0 (socket says 172.21.15.37:59326) 2024-08-20T05:12:20.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.530+0000 7fb22ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab964f40 0x55bdab970f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:20.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.530+0000 7fb22ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab964f40 0x55bdab970f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:59310/0 (socket says 172.21.15.37:59310) 2024-08-20T05:12:20.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.530+0000 7fb237e00640 1 -- 172.21.15.37:0/2597777096 learned_addr learned my addr 172.21.15.37:0/2597777096 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:20.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.531+0000 7fb237e00640 1 -- 172.21.15.37:0/2597777096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab964f40 msgr2=0x55bdab970f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:20.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.531+0000 7fb237e00640 1 --2- 172.21.15.37:0/2597777096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab964f40 0x55bdab970f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.531+0000 7fb237e00640 1 -- 172.21.15.37:0/2597777096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab962610 msgr2=0x55bdab9708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:20.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.531+0000 7fb237e00640 1 --2- 172.21.15.37:0/2597777096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab962610 0x55bdab9708e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.531+0000 7fb237e00640 1 -- 172.21.15.37:0/2597777096 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdab9722a0 con 0x55bdab967980 2024-08-20T05:12:20.533 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.531+0000 7fb22ea00640 1 --2- 172.21.15.37:0/2597777096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab964f40 0x55bdab970f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:12:20.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.531+0000 7fb237e00640 1 --2- 172.21.15.37:0/2597777096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 0x55bdab971a70 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb23002aa30 tx=0x7fb2300095b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f084fa5f929306f4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:20.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.531+0000 7fb225600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:12:20.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.532+0000 7fb225600640 1 -- 172.21.15.37:0/2597777096 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23005a060 con 0x55bdab967980 2024-08-20T05:12:20.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.532+0000 7fb225600640 1 -- 172.21.15.37:0/2597777096 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb2300037f0 con 0x55bdab967980 2024-08-20T05:12:20.534 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.532+0000 7fb2416b1740 1 -- 172.21.15.37:0/2597777096 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2300048c0 con 0x55bdab967980 2024-08-20T05:12:20.535 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.533+0000 7fb225600640 1 -- 172.21.15.37:0/2597777096 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fb230035070 con 0x55bdab967980 2024-08-20T05:12:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.535+0000 7fb2416b1740 10 client.28087 fetch_fsmap learned FSMap version 43 2024-08-20T05:12:20.536 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.535+0000 7fb2416b1740 1 -- 172.21.15.37:0/2597777096 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55bdab973610 con 0x55bdab967980 2024-08-20T05:12:20.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.537+0000 7fb225600640 1 -- 172.21.15.37:0/2597777096 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb2300048c0 con 0x55bdab967980 2024-08-20T05:12:20.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.537+0000 7fb225600640 1 -- 172.21.15.37:0/2597777096 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 43) ==== 8390+0+0 (secure 0 0 0) 0x7fb23003b430 con 0x55bdab967980 2024-08-20T05:12:20.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.537+0000 7fb2416b1740 10 client.28087 fetch_fsmap finished waiting for FSMap version 43 2024-08-20T05:12:20.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.537+0000 7fb2416b1740 10 client.28087 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:12:20.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.537+0000 7fb2416b1740 20 client.28087 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:20.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.537+0000 7fb2416b1740 1 --2- 172.21.15.37:0/2597777096 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55bdab9739e0 0x55bdab9f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:20.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.537+0000 7fb2416b1740 4 client.28087 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:12:20.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.537+0000 7fb2416b1740 1 -- 172.21.15.37:0/2597777096 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bdab8d2c00 con 0x55bdab9739e0 2024-08-20T05:12:20.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.538+0000 7fb237400640 1 --2- 172.21.15.37:0/2597777096 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55bdab9739e0 0x55bdab9f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.539+0000 7fb237400640 1 --2- 172.21.15.37:0/2597777096 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55bdab9739e0 0x55bdab9f57c0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28e1037ff5d6303b server_cookie=2618777388334c43 in_seq=0 out_seq=0 2024-08-20T05:12:20.541 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.539+0000 7fb225600640 10 client.28087 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:20.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.562+0000 7fb225600640 1 -- 172.21.15.37:0/2597777096 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bdab8d2c00 con 0x55bdab9739e0 2024-08-20T05:12:20.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.562+0000 7fb225600640 10 client.28087 handle_command_reply: tid=0 2024-08-20T05:12:20.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.562+0000 7fb2416b1740 1 client.28087 shutdown 2024-08-20T05:12:20.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.562+0000 7fb2416b1740 1 -- 172.21.15.37:0/2597777096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 msgr2=0x55bdab971a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:20.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.562+0000 7fb2416b1740 1 --2- 172.21.15.37:0/2597777096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 0x55bdab971a70 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb23002aa30 tx=0x7fb2300095b0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.563+0000 7fb2416b1740 1 -- 172.21.15.37:0/2597777096 shutdown_connections 2024-08-20T05:12:20.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.563+0000 7fb2416b1740 1 --2- 172.21.15.37:0/2597777096 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55bdab9739e0 0x55bdab9f57c0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.563+0000 7fb2416b1740 1 --2- 172.21.15.37:0/2597777096 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55bdab967980 0x55bdab971a70 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.563+0000 7fb2416b1740 1 --2- 172.21.15.37:0/2597777096 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55bdab964f40 0x55bdab970f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.563+0000 7fb2416b1740 1 --2- 172.21.15.37:0/2597777096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bdab962610 0x55bdab9708e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.563+0000 7fb2416b1740 1 -- 172.21.15.37:0/2597777096 >> 172.21.15.37:0/2597777096 conn(0x55bdab95d760 msgr2=0x55bdab95bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:20.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.563+0000 7fb225600640 0 client.28087 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:20.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.565+0000 7fb2416b1740 1 -- 172.21.15.37:0/2597777096 shutdown_connections 2024-08-20T05:12:20.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.565+0000 7fb2416b1740 1 -- 172.21.15.37:0/2597777096 wait complete. 2024-08-20T05:12:20.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.565+0000 7fb2416b1740 20 client.28087 trim_cache size 0 max 16384 2024-08-20T05:12:20.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:12:20.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:12:20.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:12:20.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:12:20.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.567+0000 7fb23e800640 1 -- 172.21.15.37:0/4128889398 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb21c0b3c50 msgr2=0x7fb21c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:20.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.567+0000 7fb23e800640 1 --2- 172.21.15.37:0/4128889398 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb21c0b3c50 0x7fb21c0b6110 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb22800bbe0 tx=0x7fb22800b390 comp rx=0 tx=0).stop 2024-08-20T05:12:20.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.567+0000 7fb23e800640 1 -- 172.21.15.37:0/4128889398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2381048b0 msgr2=0x7fb23819f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:20.569 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.567+0000 7fb23e800640 1 --2- 172.21.15.37:0/4128889398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2381048b0 0x7fb23819f050 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb220009d50 tx=0x7fb22000c6a0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.567+0000 7fb23e800640 1 -- 172.21.15.37:0/4128889398 shutdown_connections 2024-08-20T05:12:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.567+0000 7fb23e800640 1 --2- 172.21.15.37:0/4128889398 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb21c0b3c50 0x7fb21c0b6110 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.567+0000 7fb23e800640 1 --2- 172.21.15.37:0/4128889398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2381063c0 0x7fb2381a02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.567+0000 7fb23e800640 1 --2- 172.21.15.37:0/4128889398 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb238105a00 0x7fb23819f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.567+0000 7fb23e800640 1 --2- 172.21.15.37:0/4128889398 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb2381048b0 0x7fb23819f050 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.567+0000 7fb23e800640 1 -- 172.21.15.37:0/4128889398 >> 172.21.15.37:0/4128889398 conn(0x7fb238100170 msgr2=0x7fb23807a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.568+0000 7fb23e800640 1 -- 172.21.15.37:0/4128889398 shutdown_connections 2024-08-20T05:12:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:20.568+0000 7fb23e800640 1 -- 172.21.15.37:0/4128889398 wait complete. 2024-08-20T05:12:21.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:21 smithi130 ceph-mon[22007]: pgmap v704: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 6.0 MiB/s wr, 766 op/s 2024-08-20T05:12:21.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:21 smithi037 ceph-mon[17265]: pgmap v704: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 6.0 MiB/s wr, 766 op/s 2024-08-20T05:12:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:21 smithi135 ceph-mon[22342]: pgmap v704: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 6.0 MiB/s wr, 766 op/s 2024-08-20T05:12:22.328 INFO:tasks.cephfs.filesystem:scrub status for tag:0bf3f73d-6cf4-4a4e-bb58-7bf467ef8004 - {'path': '/', 'tag': '0bf3f73d-6cf4-4a4e-bb58-7bf467ef8004', 'options': 'recursive,force'} 2024-08-20T05:12:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 565.0 s, 603.0 tps, lat 163.679 ms stddev 219.550 2024-08-20T05:12:23.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:23 smithi037 ceph-mon[17265]: pgmap v705: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 6.3 MiB/s wr, 775 op/s 2024-08-20T05:12:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:12:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:23 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:23.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:23 smithi135 ceph-mon[22342]: pgmap v705: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 6.3 MiB/s wr, 775 op/s 2024-08-20T05:12:23.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:12:23.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:23.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:23.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:23.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:23 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:23 smithi130 ceph-mon[22007]: pgmap v705: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 6.3 MiB/s wr, 775 op/s 2024-08-20T05:12:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:12:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:23.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:23 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:25.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:24 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:25.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:24 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:25.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:25 smithi037 ceph-mon[17265]: pgmap v706: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 6.4 MiB/s wr, 789 op/s 2024-08-20T05:12:25.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:24 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:25.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:24 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:25.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:24 smithi135 ceph-mon[22342]: pgmap v706: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 6.4 MiB/s wr, 789 op/s 2024-08-20T05:12:25.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:24 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:25.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:24 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:25.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:24 smithi130 ceph-mon[22007]: pgmap v706: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 6.4 MiB/s wr, 789 op/s 2024-08-20T05:12:26.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:26 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:12:26.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:26 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:12:26.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:26 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:26.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:26 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:12:26.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:26 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:12:26.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:26 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:26.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:26 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:12:26.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:26 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:12:26.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:26 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:12:27.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:27 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:12:27.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:27 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:12:27.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:27 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:12:27.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:27 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:12:27.366 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:27 smithi135 ceph-mon[22342]: pgmap v707: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.4 MiB/s wr, 774 op/s 2024-08-20T05:12:27.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:27 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:12:27.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:27 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:12:27.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:27 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:12:27.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:27 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:12:27.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:27 smithi130 ceph-mon[22007]: pgmap v707: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.4 MiB/s wr, 774 op/s 2024-08-20T05:12:27.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:27 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:12:27.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:27 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:12:27.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:27 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:12:27.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:27 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:12:27.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:27 smithi037 ceph-mon[17265]: pgmap v707: 129 pgs: 129 active+clean; 1.4 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.4 MiB/s wr, 774 op/s 2024-08-20T05:12:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 570.0 s, 621.8 tps, lat 158.022 ms stddev 178.560 2024-08-20T05:12:28.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:28 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:12:28.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:28 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:12:28.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:28 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:12:29.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:29 smithi135 ceph-mon[22342]: pgmap v708: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.9 MiB/s wr, 699 op/s 2024-08-20T05:12:29.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:29 smithi130 ceph-mon[22007]: pgmap v708: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.9 MiB/s wr, 699 op/s 2024-08-20T05:12:29.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:29 smithi037 ceph-mon[17265]: pgmap v708: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.9 MiB/s wr, 699 op/s 2024-08-20T05:12:31.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:31 smithi130 ceph-mon[22007]: pgmap v709: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.1 MiB/s wr, 716 op/s 2024-08-20T05:12:31.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:31 smithi037 ceph-mon[17265]: pgmap v709: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.1 MiB/s wr, 716 op/s 2024-08-20T05:12:31.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:31 smithi135 ceph-mon[22342]: pgmap v709: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 6.1 MiB/s wr, 716 op/s 2024-08-20T05:12:33.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 575.0 s, 494.8 tps, lat 204.604 ms stddev 248.642 2024-08-20T05:12:33.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:33 smithi130 ceph-mon[22007]: pgmap v710: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 509 op/s 2024-08-20T05:12:33.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:33 smithi037 ceph-mon[17265]: pgmap v710: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 509 op/s 2024-08-20T05:12:33.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:33 smithi135 ceph-mon[22342]: pgmap v710: 129 pgs: 129 active+clean; 1.4 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 509 op/s 2024-08-20T05:12:34.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.365+0000 7f8737000640 1 -- 172.21.15.37:0/1063755741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f873006b170 msgr2=0x7f8730105060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.365+0000 7f8737000640 1 --2- 172.21.15.37:0/1063755741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f873006b170 0x7f8730105060 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8724009900 tx=0x7f872402a410 comp rx=0 tx=0).stop 2024-08-20T05:12:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.367+0000 7f8737000640 1 -- 172.21.15.37:0/1063755741 shutdown_connections 2024-08-20T05:12:34.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.367+0000 7f8737000640 1 --2- 172.21.15.37:0/1063755741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87301081a0 0x7f873010a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.367+0000 7f8737000640 1 --2- 172.21.15.37:0/1063755741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87301055f0 0x7f8730107a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.367+0000 7f8737000640 1 --2- 172.21.15.37:0/1063755741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f873006b170 0x7f8730105060 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.367+0000 7f8737000640 1 -- 172.21.15.37:0/1063755741 >> 172.21.15.37:0/1063755741 conn(0x7f87300fcc50 msgr2=0x7f87300ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:34.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.369+0000 7f8737000640 1 -- 172.21.15.37:0/1063755741 shutdown_connections 2024-08-20T05:12:34.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.369+0000 7f8737000640 1 -- 172.21.15.37:0/1063755741 wait complete. 2024-08-20T05:12:34.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.370+0000 7f8737000640 1 Processor -- start 2024-08-20T05:12:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.371+0000 7f8737000640 1 -- start start 2024-08-20T05:12:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.371+0000 7f8737000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f873006b170 0x7f87301027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.371+0000 7f8737000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87301055f0 0x7f8730101000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.371+0000 7f8737000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87301081a0 0x7f8730101540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.371+0000 7f8737000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f873010e1c0 con 0x7f873006b170 2024-08-20T05:12:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.371+0000 7f8737000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f873010e040 con 0x7f87301055f0 2024-08-20T05:12:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.371+0000 7f8737000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f873010e340 con 0x7f87301081a0 2024-08-20T05:12:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.371+0000 7f8736600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87301081a0 0x7f8730101540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.372+0000 7f8736600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87301081a0 0x7f8730101540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49778/0 (socket says 172.21.15.37:49778) 2024-08-20T05:12:34.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.372+0000 7f8736600640 1 -- 172.21.15.37:0/4198682008 learned_addr learned my addr 172.21.15.37:0/4198682008 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.372+0000 7f8735c00640 1 --2- 172.21.15.37:0/4198682008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f873006b170 0x7f87301027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.372+0000 7f8735200640 1 --2- 172.21.15.37:0/4198682008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87301055f0 0x7f8730101000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.372+0000 7f8736600640 1 -- 172.21.15.37:0/4198682008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87301055f0 msgr2=0x7f8730101000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.372+0000 7f8736600640 1 --2- 172.21.15.37:0/4198682008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87301055f0 0x7f8730101000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.372+0000 7f8736600640 1 -- 172.21.15.37:0/4198682008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f873006b170 msgr2=0x7f87301027a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.372+0000 7f8736600640 1 --2- 172.21.15.37:0/4198682008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f873006b170 0x7f87301027a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.372+0000 7f8736600640 1 -- 172.21.15.37:0/4198682008 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f873019c840 con 0x7f87301081a0 2024-08-20T05:12:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.373+0000 7f8736600640 1 --2- 172.21.15.37:0/4198682008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87301081a0 0x7f8730101540 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f872800b970 tx=0x7f872800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.373+0000 7f872e000640 1 -- 172.21.15.37:0/4198682008 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8728019070 con 0x7f87301081a0 2024-08-20T05:12:34.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.373+0000 7f872e000640 1 -- 172.21.15.37:0/4198682008 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8728014440 con 0x7f87301081a0 2024-08-20T05:12:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.373+0000 7f872e000640 1 -- 172.21.15.37:0/4198682008 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87280075d0 con 0x7f87301081a0 2024-08-20T05:12:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.373+0000 7f8737000640 1 -- 172.21.15.37:0/4198682008 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f873019cb30 con 0x7f87301081a0 2024-08-20T05:12:34.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.374+0000 7f8737000640 1 -- 172.21.15.37:0/4198682008 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f873019d0b0 con 0x7f87301081a0 2024-08-20T05:12:34.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.381+0000 7f872e000640 1 -- 172.21.15.37:0/4198682008 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f872801c070 con 0x7f87301081a0 2024-08-20T05:12:34.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.383+0000 7f872e000640 1 --2- 172.21.15.37:0/4198682008 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87180b3cd0 0x7f87180b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.383+0000 7f872e000640 1 -- 172.21.15.37:0/4198682008 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f87280e35f0 con 0x7f87301081a0 2024-08-20T05:12:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.384+0000 7f8735c00640 1 --2- 172.21.15.37:0/4198682008 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87180b3cd0 0x7f87180b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.385+0000 7f8735c00640 1 --2- 172.21.15.37:0/4198682008 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87180b3cd0 0x7f87180b6190 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8724031500 tx=0x7f8724005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:34.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.386+0000 7f873b646740 1 Processor -- start 2024-08-20T05:12:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.386+0000 7f873b646740 1 -- start start 2024-08-20T05:12:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.386+0000 7f873b646740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511f77f0 0x561e511f9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.386+0000 7f873b646740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fa120 0x561e511fc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.386+0000 7f873b646740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fcb60 0x561e511ff020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.386+0000 7f873b646740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561e5116a210 con 0x561e511fcb60 2024-08-20T05:12:34.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.386+0000 7f873b646740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561e51159710 con 0x561e511fa120 2024-08-20T05:12:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.386+0000 7f873b646740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561e5115d750 con 0x561e511f77f0 2024-08-20T05:12:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.387+0000 7f8735c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511f77f0 0x561e511f9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.387+0000 7f8735c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511f77f0 0x561e511f9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49780/0 (socket says 172.21.15.37:49780) 2024-08-20T05:12:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.387+0000 7f8735200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fa120 0x561e511fc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.387+0000 7f8735c00640 1 -- 172.21.15.37:0/1068796895 learned_addr learned my addr 172.21.15.37:0/1068796895 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.387+0000 7f8735c00640 1 -- 172.21.15.37:0/1068796895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fa120 msgr2=0x561e511fc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.387+0000 7f8735c00640 1 --2- 172.21.15.37:0/1068796895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fa120 0x561e511fc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.387+0000 7f8735c00640 1 -- 172.21.15.37:0/1068796895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fcb60 msgr2=0x561e511ff020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.387+0000 7f8735c00640 1 --2- 172.21.15.37:0/1068796895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fcb60 0x561e511ff020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.387+0000 7f8735c00640 1 -- 172.21.15.37:0/1068796895 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e51125de0 con 0x561e511f77f0 2024-08-20T05:12:34.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.387+0000 7f8735200640 1 --2- 172.21.15.37:0/1068796895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fa120 0x561e511fc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:12:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.388+0000 7f8735c00640 1 --2- 172.21.15.37:0/1068796895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511f77f0 0x561e511f9be0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8724004550 tx=0x7f872403b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e57fc8153a56529d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.388+0000 7f8722a00640 1 -- 172.21.15.37:0/1068796895 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724041070 con 0x561e511f77f0 2024-08-20T05:12:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.388+0000 7f8722a00640 1 -- 172.21.15.37:0/1068796895 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f872404d070 con 0x561e511f77f0 2024-08-20T05:12:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.388+0000 7f8722a00640 1 -- 172.21.15.37:0/1068796895 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724035050 con 0x561e511f77f0 2024-08-20T05:12:34.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.390+0000 7f873b646740 1 -- 172.21.15.37:0/1068796895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511f77f0 msgr2=0x561e511f9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.390+0000 7f873b646740 1 --2- 172.21.15.37:0/1068796895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511f77f0 0x561e511f9be0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8724004550 tx=0x7f872403b000 comp rx=0 tx=0).stop 2024-08-20T05:12:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.390+0000 7f873b646740 1 -- 172.21.15.37:0/1068796895 shutdown_connections 2024-08-20T05:12:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.390+0000 7f873b646740 1 --2- 172.21.15.37:0/1068796895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fcb60 0x561e511ff020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.390+0000 7f873b646740 1 --2- 172.21.15.37:0/1068796895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fa120 0x561e511fc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.390+0000 7f873b646740 1 --2- 172.21.15.37:0/1068796895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511f77f0 0x561e511f9be0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.390+0000 7f873b646740 1 -- 172.21.15.37:0/1068796895 >> 172.21.15.37:0/1068796895 conn(0x561e511f2940 msgr2=0x561e511f36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.391+0000 7f873b646740 1 -- 172.21.15.37:0/1068796895 shutdown_connections 2024-08-20T05:12:34.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.391+0000 7f873b646740 1 -- 172.21.15.37:0/1068796895 wait complete. 2024-08-20T05:12:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.391+0000 7f873b646740 1 -- start start 2024-08-20T05:12:34.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.392+0000 7f873b646740 1 Processor -- start 2024-08-20T05:12:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.394+0000 7f873b646740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511f77f0 0x561e51200fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.394+0000 7f873b646740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 0x561e51201650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.394+0000 7f873b646740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fcb60 0x561e51202220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.395+0000 7f8735c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511f77f0 0x561e51200fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.395+0000 7f8735c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511f77f0 0x561e51200fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49792/0 (socket says 172.21.15.37:49792) 2024-08-20T05:12:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.395+0000 7f8735200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 0x561e51201650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:34.397 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.395+0000 7f8735200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 0x561e51201650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42288/0 (socket says 172.21.15.37:42288) 2024-08-20T05:12:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.395+0000 7f8736600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fcb60 0x561e51202220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.395+0000 7f8736600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fcb60 0x561e51202220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53632/0 (socket says 172.21.15.37:53632) 2024-08-20T05:12:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.395+0000 7f873b646740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561e51092ab0 con 0x561e511fa120 2024-08-20T05:12:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.396+0000 7f8735c00640 1 -- 172.21.15.37:0/1666838004 learned_addr learned my addr 172.21.15.37:0/1666838004 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:34.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.396+0000 7f873b646740 1 -- 172.21.15.37:0/1666838004 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561e51100140 con 0x561e511fcb60 2024-08-20T05:12:34.399 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.397+0000 7f873b646740 1 -- 172.21.15.37:0/1666838004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x561e511ffae0 con 0x561e511f77f0 2024-08-20T05:12:34.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.399+0000 7f873b646740 10 client.0 _ll_register_callbacks cb 0x561e511135d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.399+0000 7f8735c00640 1 -- 172.21.15.37:0/1666838004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fcb60 msgr2=0x561e51202220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:34.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.399+0000 7f8735c00640 1 --2- 172.21.15.37:0/1666838004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fcb60 0x561e51202220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.399+0000 7f8735c00640 1 -- 172.21.15.37:0/1666838004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 msgr2=0x561e51201650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.399+0000 7f8735c00640 1 --2- 172.21.15.37:0/1666838004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 0x561e51201650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.399+0000 7f8735c00640 1 -- 172.21.15.37:0/1666838004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e51101170 con 0x561e511f77f0 2024-08-20T05:12:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.401+0000 7f8717400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:12:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.401+0000 7f8735c00640 1 --2- 172.21.15.37:0/1666838004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511f77f0 0x561e51200fb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8724009900 tx=0x7f87240054e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75527bc11f2d4960 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:34.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.402+0000 7f8717400640 1 -- 172.21.15.37:0/1666838004 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8724055070 con 0x561e511f77f0 2024-08-20T05:12:34.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.402+0000 7f8717400640 1 -- 172.21.15.37:0/1666838004 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8724004b90 con 0x561e511f77f0 2024-08-20T05:12:34.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.403+0000 7f873b646740 1 -- 172.21.15.37:0/1666838004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f872404d070 con 0x561e511f77f0 2024-08-20T05:12:34.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.411+0000 7f8717400640 1 -- 172.21.15.37:0/1666838004 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f872405f050 con 0x561e511f77f0 2024-08-20T05:12:34.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.412+0000 7f873b646740 10 client.28099 fetch_fsmap learned FSMap version 44 2024-08-20T05:12:34.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.412+0000 7f873b646740 1 -- 172.21.15.37:0/1666838004 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x561e50ebc790 con 0x561e511f77f0 2024-08-20T05:12:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.413+0000 7f8717400640 1 -- 172.21.15.37:0/1666838004 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f872404d070 con 0x561e511f77f0 2024-08-20T05:12:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.413+0000 7f8717400640 1 -- 172.21.15.37:0/1666838004 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 44) ==== 8386+0+0 (secure 0 0 0) 0x7f87240329d0 con 0x561e511f77f0 2024-08-20T05:12:34.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.413+0000 7f873b646740 10 client.28099 fetch_fsmap finished waiting for FSMap version 44 2024-08-20T05:12:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.414+0000 7f873b646740 10 client.28099 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:12:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.414+0000 7f873b646740 20 client.28099 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.414+0000 7f873b646740 1 --2- 172.21.15.37:0/1666838004 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561e5120c7b0 0x561e5120eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.414+0000 7f873b646740 4 client.28099 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:12:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.414+0000 7f873b646740 1 -- 172.21.15.37:0/1666838004 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561e5116c160 con 0x561e5120c7b0 2024-08-20T05:12:34.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.414+0000 7f8735200640 1 --2- 172.21.15.37:0/1666838004 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561e5120c7b0 0x561e5120eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.416+0000 7f8735200640 1 --2- 172.21.15.37:0/1666838004 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561e5120c7b0 0x561e5120eba0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54c940017deea280 server_cookie=6c100bc0f2a8dfe1 in_seq=0 out_seq=0 2024-08-20T05:12:34.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.416+0000 7f8717400640 10 client.28099 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.417+0000 7f8717400640 1 -- 172.21.15.37:0/1666838004 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561e5116c160 con 0x561e5120c7b0 2024-08-20T05:12:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.417+0000 7f8717400640 10 client.28099 handle_command_reply: tid=0 2024-08-20T05:12:34.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.417+0000 7f873b646740 1 client.28099 shutdown 2024-08-20T05:12:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.418+0000 7f873b646740 1 -- 172.21.15.37:0/1666838004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511f77f0 msgr2=0x561e51200fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.418+0000 7f873b646740 1 --2- 172.21.15.37:0/1666838004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511f77f0 0x561e51200fb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8724009900 tx=0x7f87240054e0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.418+0000 7f873b646740 1 -- 172.21.15.37:0/1666838004 shutdown_connections 2024-08-20T05:12:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.418+0000 7f873b646740 1 --2- 172.21.15.37:0/1666838004 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561e5120c7b0 0x561e5120eba0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.418+0000 7f873b646740 1 --2- 172.21.15.37:0/1666838004 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fcb60 0x561e51202220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.418+0000 7f873b646740 1 --2- 172.21.15.37:0/1666838004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 0x561e51201650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.418+0000 7f8717400640 0 client.28099 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.418+0000 7f873b646740 1 --2- 172.21.15.37:0/1666838004 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511f77f0 0x561e51200fb0 secure :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8724009900 tx=0x7f87240054e0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.418+0000 7f873b646740 1 -- 172.21.15.37:0/1666838004 >> 172.21.15.37:0/1666838004 conn(0x561e511f2940 msgr2=0x561e511f19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:34.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.419+0000 7f873b646740 1 -- 172.21.15.37:0/1666838004 shutdown_connections 2024-08-20T05:12:34.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.419+0000 7f873b646740 1 -- 172.21.15.37:0/1666838004 wait complete. 2024-08-20T05:12:34.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.419+0000 7f873b646740 20 client.28099 trim_cache size 0 max 16384 2024-08-20T05:12:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.446+0000 7f873b646740 1 Processor -- start 2024-08-20T05:12:34.448 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.447+0000 7f873b646740 1 -- start start 2024-08-20T05:12:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.447+0000 7f873b646740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 0x561e511fdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.447+0000 7f873b646740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511fcb60 0x561e51208ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.447+0000 7f873b646740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fd6c0 0x561e511fe180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.447+0000 7f873b646740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f87301ba0d0 con 0x561e511fa120 2024-08-20T05:12:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.447+0000 7f873b646740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f87301bbc70 con 0x561e511fd6c0 2024-08-20T05:12:34.449 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.447+0000 7f873b646740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f87301ba7a0 con 0x561e511fcb60 2024-08-20T05:12:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.447+0000 7f8735200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511fcb60 0x561e51208ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.447+0000 7f8735200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511fcb60 0x561e51208ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49794/0 (socket says 172.21.15.37:49794) 2024-08-20T05:12:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.447+0000 7f8735200640 1 -- 172.21.15.37:0/1557497422 learned_addr learned my addr 172.21.15.37:0/1557497422 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.448+0000 7f8736600640 1 --2- 172.21.15.37:0/1557497422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fd6c0 0x561e511fe180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.448+0000 7f8735c00640 1 --2- 172.21.15.37:0/1557497422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 0x561e511fdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.448+0000 7f8735200640 1 -- 172.21.15.37:0/1557497422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fd6c0 msgr2=0x561e511fe180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.448+0000 7f8735200640 1 --2- 172.21.15.37:0/1557497422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fd6c0 0x561e511fe180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.448+0000 7f8735200640 1 -- 172.21.15.37:0/1557497422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 msgr2=0x561e511fdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.448+0000 7f8735200640 1 --2- 172.21.15.37:0/1557497422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 0x561e511fdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.448+0000 7f8735200640 1 -- 172.21.15.37:0/1557497422 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561e50f35620 con 0x561e511fcb60 2024-08-20T05:12:34.450 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.448+0000 7f8736600640 1 --2- 172.21.15.37:0/1557497422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fd6c0 0x561e511fe180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:12:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.448+0000 7f8735c00640 1 --2- 172.21.15.37:0/1557497422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 0x561e511fdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:12:34.451 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.448+0000 7f8735200640 1 --2- 172.21.15.37:0/1557497422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511fcb60 0x561e51208ee0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x561e5120f250 tx=0x7f871c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12628e163f32ea84 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:34.453 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.451+0000 7f8722000640 1 -- 172.21.15.37:0/1557497422 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c004230 con 0x561e511fcb60 2024-08-20T05:12:34.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.452+0000 7f8722000640 1 -- 172.21.15.37:0/1557497422 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f871c0043d0 con 0x561e511fcb60 2024-08-20T05:12:34.455 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.452+0000 7f8722000640 1 -- 172.21.15.37:0/1557497422 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871c011940 con 0x561e511fcb60 2024-08-20T05:12:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.455+0000 7f873b646740 1 -- 172.21.15.37:0/1557497422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511fcb60 msgr2=0x561e51208ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.455+0000 7f873b646740 1 --2- 172.21.15.37:0/1557497422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511fcb60 0x561e51208ee0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x561e5120f250 tx=0x7f871c005f90 comp rx=0 tx=0).stop 2024-08-20T05:12:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.455+0000 7f873b646740 1 -- 172.21.15.37:0/1557497422 shutdown_connections 2024-08-20T05:12:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.455+0000 7f873b646740 1 --2- 172.21.15.37:0/1557497422 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fd6c0 0x561e511fe180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.457 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.455+0000 7f873b646740 1 --2- 172.21.15.37:0/1557497422 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511fcb60 0x561e51208ee0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.456+0000 7f873b646740 1 --2- 172.21.15.37:0/1557497422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 0x561e511fdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.458 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.456+0000 7f873b646740 1 -- 172.21.15.37:0/1557497422 >> 172.21.15.37:0/1557497422 conn(0x561e511f2940 msgr2=0x561e511fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:34.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.458+0000 7f873b646740 1 -- 172.21.15.37:0/1557497422 shutdown_connections 2024-08-20T05:12:34.460 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.458+0000 7f873b646740 1 -- 172.21.15.37:0/1557497422 wait complete. 2024-08-20T05:12:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.459+0000 7f873b646740 1 -- start start 2024-08-20T05:12:34.461 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.459+0000 7f873b646740 1 Processor -- start 2024-08-20T05:12:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.461+0000 7f873b646740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 0x561e51209040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.461+0000 7f873b646740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fcb60 0x561e51207de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.461+0000 7f873b646740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511fd6c0 0x561e512084d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.461+0000 7f873b646740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f87301bb570 con 0x561e511fa120 2024-08-20T05:12:34.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.461+0000 7f873b646740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f87301bae70 con 0x561e511fcb60 2024-08-20T05:12:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.461+0000 7f873b646740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f87301b8130 con 0x561e511fd6c0 2024-08-20T05:12:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.462+0000 7f873b646740 10 client.0 _ll_register_callbacks cb 0x7f871c009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.462+0000 7f8736600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511fd6c0 0x561e512084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.462+0000 7f8736600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511fd6c0 0x561e512084d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49802/0 (socket says 172.21.15.37:49802) 2024-08-20T05:12:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.462+0000 7f8736600640 1 -- 172.21.15.37:0/3891649283 learned_addr learned my addr 172.21.15.37:0/3891649283 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.462+0000 7f8735c00640 1 --2- 172.21.15.37:0/3891649283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 0x561e51209040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.462+0000 7f8736600640 1 -- 172.21.15.37:0/3891649283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fcb60 msgr2=0x561e51207de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.461+0000 7f8735200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fcb60 0x561e51207de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.462+0000 7f8736600640 1 --2- 172.21.15.37:0/3891649283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fcb60 0x561e51207de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.462+0000 7f8736600640 1 -- 172.21.15.37:0/3891649283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 msgr2=0x561e51209040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.462+0000 7f8736600640 1 --2- 172.21.15.37:0/3891649283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 0x561e51209040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.462+0000 7f8736600640 1 -- 172.21.15.37:0/3891649283 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561e51206920 con 0x561e511fd6c0 2024-08-20T05:12:34.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.463+0000 7f8735c00640 1 --2- 172.21.15.37:0/3891649283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 0x561e51209040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:12:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.464+0000 7f8735200640 1 --2- 172.21.15.37:0/3891649283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fcb60 0x561e51207de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:12:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.464+0000 7f8736600640 1 --2- 172.21.15.37:0/3891649283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511fd6c0 0x561e512084d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f87280e0cf0 tx=0x7f8728014730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9132eb8b074297a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.464+0000 7f8717400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:12:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.464+0000 7f8717400640 1 -- 172.21.15.37:0/3891649283 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87280aa140 con 0x561e511fd6c0 2024-08-20T05:12:34.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.464+0000 7f8717400640 1 -- 172.21.15.37:0/3891649283 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f87280a6730 con 0x561e511fd6c0 2024-08-20T05:12:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.464+0000 7f873b646740 1 -- 172.21.15.37:0/3891649283 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f871c0043d0 con 0x561e511fd6c0 2024-08-20T05:12:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.465+0000 7f8717400640 1 -- 172.21.15.37:0/3891649283 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f87280c9050 con 0x561e511fd6c0 2024-08-20T05:12:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.465+0000 7f873b646740 10 client.28105 fetch_fsmap learned FSMap version 44 2024-08-20T05:12:34.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.465+0000 7f873b646740 1 -- 172.21.15.37:0/3891649283 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x561e51277670 con 0x561e511fd6c0 2024-08-20T05:12:34.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.467+0000 7f8717400640 1 -- 172.21.15.37:0/3891649283 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f871c0043d0 con 0x561e511fd6c0 2024-08-20T05:12:34.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.467+0000 7f8717400640 1 -- 172.21.15.37:0/3891649283 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 44) ==== 8386+0+0 (secure 0 0 0) 0x7f87280b2e30 con 0x561e511fd6c0 2024-08-20T05:12:34.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.467+0000 7f873b646740 10 client.28105 fetch_fsmap finished waiting for FSMap version 44 2024-08-20T05:12:34.469 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.467+0000 7f873b646740 10 client.28105 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:12:34.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.467+0000 7f873b646740 20 client.28105 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.467+0000 7f873b646740 1 --2- 172.21.15.37:0/3891649283 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561e51278000 0x561e5127a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.467+0000 7f873b646740 4 client.28105 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:12:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.467+0000 7f873b646740 1 -- 172.21.15.37:0/3891649283 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561e51167c00 con 0x561e51278000 2024-08-20T05:12:34.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.468+0000 7f8735c00640 1 --2- 172.21.15.37:0/3891649283 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561e51278000 0x561e5127a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:34.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.471+0000 7f8717400640 10 client.28105 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:34.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.471+0000 7f8735c00640 1 --2- 172.21.15.37:0/3891649283 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561e51278000 0x561e5127a420 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf78f9dfc0d8ac58 server_cookie=8cb9182b650b27 in_seq=0 out_seq=0 2024-08-20T05:12:34.521 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.519+0000 7f8717400640 1 -- 172.21.15.37:0/3891649283 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561e51167c00 con 0x561e51278000 2024-08-20T05:12:34.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.519+0000 7f8717400640 10 client.28105 handle_command_reply: tid=0 2024-08-20T05:12:34.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.520+0000 7f873b646740 1 client.28105 shutdown 2024-08-20T05:12:34.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.520+0000 7f873b646740 1 -- 172.21.15.37:0/3891649283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511fd6c0 msgr2=0x561e512084d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:34.522 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.520+0000 7f873b646740 1 --2- 172.21.15.37:0/3891649283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511fd6c0 0x561e512084d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f87280e0cf0 tx=0x7f8728014730 comp rx=0 tx=0).stop 2024-08-20T05:12:34.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.520+0000 7f873b646740 1 -- 172.21.15.37:0/3891649283 shutdown_connections 2024-08-20T05:12:34.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.520+0000 7f873b646740 1 --2- 172.21.15.37:0/3891649283 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561e51278000 0x561e5127a420 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.520+0000 7f8717400640 0 client.28105 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:34.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.520+0000 7f873b646740 1 --2- 172.21.15.37:0/3891649283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561e511fd6c0 0x561e512084d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.520+0000 7f873b646740 1 --2- 172.21.15.37:0/3891649283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561e511fcb60 0x561e51207de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.520+0000 7f873b646740 1 --2- 172.21.15.37:0/3891649283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561e511fa120 0x561e51209040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.520+0000 7f873b646740 1 -- 172.21.15.37:0/3891649283 >> 172.21.15.37:0/3891649283 conn(0x561e511f2940 msgr2=0x561e511f1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:34.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.521+0000 7f873b646740 1 -- 172.21.15.37:0/3891649283 shutdown_connections 2024-08-20T05:12:34.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.521+0000 7f873b646740 1 -- 172.21.15.37:0/3891649283 wait complete. 2024-08-20T05:12:34.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.521+0000 7f873b646740 20 client.28105 trim_cache size 0 max 16384 2024-08-20T05:12:34.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:12:34.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:12:34.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:12:34.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:12:34.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.522+0000 7f8737000640 1 -- 172.21.15.37:0/4198682008 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87180b3cd0 msgr2=0x7f87180b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.522+0000 7f8737000640 1 --2- 172.21.15.37:0/4198682008 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87180b3cd0 0x7f87180b6190 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8724031500 tx=0x7f8724005fd0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.522+0000 7f8737000640 1 -- 172.21.15.37:0/4198682008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87301081a0 msgr2=0x7f8730101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.522+0000 7f8737000640 1 --2- 172.21.15.37:0/4198682008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87301081a0 0x7f8730101540 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f872800b970 tx=0x7f872800be30 comp rx=0 tx=0).stop 2024-08-20T05:12:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.522+0000 7f8737000640 1 -- 172.21.15.37:0/4198682008 shutdown_connections 2024-08-20T05:12:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.522+0000 7f8737000640 1 --2- 172.21.15.37:0/4198682008 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f87180b3cd0 0x7f87180b6190 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.522+0000 7f8737000640 1 --2- 172.21.15.37:0/4198682008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f87301081a0 0x7f8730101540 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.522+0000 7f8737000640 1 --2- 172.21.15.37:0/4198682008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f87301055f0 0x7f8730101000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.522+0000 7f8737000640 1 --2- 172.21.15.37:0/4198682008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f873006b170 0x7f87301027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.522+0000 7f8737000640 1 -- 172.21.15.37:0/4198682008 >> 172.21.15.37:0/4198682008 conn(0x7f87300fcc50 msgr2=0x7f8730103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.523+0000 7f8737000640 1 -- 172.21.15.37:0/4198682008 shutdown_connections 2024-08-20T05:12:34.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:34.523+0000 7f8737000640 1 -- 172.21.15.37:0/4198682008 wait complete. 2024-08-20T05:12:35.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:35 smithi130 ceph-mon[22007]: pgmap v711: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 MiB/s wr, 543 op/s 2024-08-20T05:12:35.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:35 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:12:35.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:35 smithi037 ceph-mon[17265]: pgmap v711: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 MiB/s wr, 543 op/s 2024-08-20T05:12:35.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:35 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:12:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:35 smithi135 ceph-mon[22342]: pgmap v711: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.0 MiB/s wr, 543 op/s 2024-08-20T05:12:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:35 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:12:37.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:37 smithi130 ceph-mon[22007]: pgmap v712: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 511 op/s 2024-08-20T05:12:37.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:37 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:12:37.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:37 smithi037 ceph-mon[17265]: pgmap v712: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 511 op/s 2024-08-20T05:12:37.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:37 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:12:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:37 smithi135 ceph-mon[22342]: pgmap v712: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 511 op/s 2024-08-20T05:12:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:37 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:12:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 580.0 s, 636.2 tps, lat 159.220 ms stddev 179.222 2024-08-20T05:12:39.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:39 smithi130 ceph-mon[22007]: pgmap v713: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.6 MiB/s wr, 510 op/s 2024-08-20T05:12:39.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:39 smithi037 ceph-mon[17265]: pgmap v713: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.6 MiB/s wr, 510 op/s 2024-08-20T05:12:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:39 smithi135 ceph-mon[22342]: pgmap v713: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.6 MiB/s wr, 510 op/s 2024-08-20T05:12:40.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:40 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:12:40.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:40 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:12:40.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:40 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:12:41.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:41 smithi037 ceph-mon[17265]: pgmap v714: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.9 MiB/s wr, 544 op/s 2024-08-20T05:12:41.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:41 smithi135 ceph-mon[22342]: pgmap v714: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.9 MiB/s wr, 544 op/s 2024-08-20T05:12:41.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:41 smithi130 ceph-mon[22007]: pgmap v714: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.9 MiB/s wr, 544 op/s 2024-08-20T05:12:43.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 585.0 s, 719.4 tps, lat 137.558 ms stddev 146.116 2024-08-20T05:12:43.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:43 smithi037 ceph-mon[17265]: pgmap v715: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 464 op/s 2024-08-20T05:12:43.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:43 smithi135 ceph-mon[22342]: pgmap v715: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 464 op/s 2024-08-20T05:12:43.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:43 smithi130 ceph-mon[22007]: pgmap v715: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.4 MiB/s wr, 464 op/s 2024-08-20T05:12:45.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:45 smithi037 ceph-mon[17265]: pgmap v716: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.6 MiB/s wr, 601 op/s 2024-08-20T05:12:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:45 smithi135 ceph-mon[22342]: pgmap v716: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.6 MiB/s wr, 601 op/s 2024-08-20T05:12:45.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:45 smithi130 ceph-mon[22007]: pgmap v716: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.6 MiB/s wr, 601 op/s 2024-08-20T05:12:47.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:47 smithi037 ceph-mon[17265]: pgmap v717: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 503 op/s 2024-08-20T05:12:47.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.835+0000 7f670a400640 1 -- 172.21.15.37:0/3696620445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67041026b0 msgr2=0x7f6704102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:47.837 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.835+0000 7f670a400640 1 --2- 172.21.15.37:0/3696620445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67041026b0 0x7f6704102b30 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009890 tx=0x7f66f002a380 comp rx=0 tx=0).stop 2024-08-20T05:12:47.837 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.837+0000 7f670a400640 1 -- 172.21.15.37:0/3696620445 shutdown_connections 2024-08-20T05:12:47.837 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.837+0000 7f670a400640 1 --2- 172.21.15.37:0/3696620445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6704103070 0x7f67041099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.837+0000 7f670a400640 1 --2- 172.21.15.37:0/3696620445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67041026b0 0x7f6704102b30 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.837+0000 7f670a400640 1 --2- 172.21.15.37:0/3696620445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6704101560 0x7f6704101960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.837+0000 7f670a400640 1 -- 172.21.15.37:0/3696620445 >> 172.21.15.37:0/3696620445 conn(0x7f67040fce40 msgr2=0x7f67040ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:47.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.837+0000 7f670a400640 1 -- 172.21.15.37:0/3696620445 shutdown_connections 2024-08-20T05:12:47.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.837+0000 7f670a400640 1 -- 172.21.15.37:0/3696620445 wait complete. 2024-08-20T05:12:47.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.838+0000 7f670a400640 1 Processor -- start 2024-08-20T05:12:47.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.840+0000 7f670a400640 1 -- start start 2024-08-20T05:12:47.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.840+0000 7f670a400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6704101560 0x7f6704105320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.840+0000 7f670a400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67041026b0 0x7f6704103b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.840+0000 7f670a400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6704103070 0x7f67041040c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.841+0000 7f670a400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f670410d250 con 0x7f6704103070 2024-08-20T05:12:47.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.841+0000 7f670a400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f670410d0d0 con 0x7f6704101560 2024-08-20T05:12:47.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.841+0000 7f670a400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f670410d3d0 con 0x7f67041026b0 2024-08-20T05:12:47.842 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.841+0000 7f6702a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67041026b0 0x7f6704103b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.841+0000 7f6702a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67041026b0 0x7f6704103b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46598/0 (socket says 172.21.15.37:46598) 2024-08-20T05:12:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.841+0000 7f6702a00640 1 -- 172.21.15.37:0/761392087 learned_addr learned my addr 172.21.15.37:0/761392087 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.841+0000 7f6703e00640 1 --2- 172.21.15.37:0/761392087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6704103070 0x7f67041040c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.842+0000 7f6703400640 1 --2- 172.21.15.37:0/761392087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6704101560 0x7f6704105320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.842+0000 7f6702a00640 1 -- 172.21.15.37:0/761392087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6704101560 msgr2=0x7f6704105320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.842+0000 7f6702a00640 1 --2- 172.21.15.37:0/761392087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6704101560 0x7f6704105320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.842+0000 7f6702a00640 1 -- 172.21.15.37:0/761392087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6704103070 msgr2=0x7f67041040c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.842+0000 7f6702a00640 1 --2- 172.21.15.37:0/761392087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6704103070 0x7f67041040c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.842+0000 7f6702a00640 1 -- 172.21.15.37:0/761392087 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6704104930 con 0x7f67041026b0 2024-08-20T05:12:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.842+0000 7f6703400640 1 --2- 172.21.15.37:0/761392087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6704101560 0x7f6704105320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:12:47.843 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.842+0000 7f6703e00640 1 --2- 172.21.15.37:0/761392087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6704103070 0x7f67041040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:12:47.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.842+0000 7f6702a00640 1 --2- 172.21.15.37:0/761392087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67041026b0 0x7f6704103b80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f66f0005940 tx=0x7f66f0032e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:47.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.843+0000 7f66fbe00640 1 -- 172.21.15.37:0/761392087 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0040020 con 0x7f67041026b0 2024-08-20T05:12:47.844 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.843+0000 7f66fbe00640 1 -- 172.21.15.37:0/761392087 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66f0004040 con 0x7f67041026b0 2024-08-20T05:12:47.845 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.845+0000 7f66fbe00640 1 -- 172.21.15.37:0/761392087 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0037040 con 0x7f67041026b0 2024-08-20T05:12:47.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.845+0000 7f670a400640 1 -- 172.21.15.37:0/761392087 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67041a2ba0 con 0x7f67041026b0 2024-08-20T05:12:47.846 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.845+0000 7f670a400640 1 -- 172.21.15.37:0/761392087 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67041a3010 con 0x7f67041026b0 2024-08-20T05:12:47.859 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.859+0000 7f66fbe00640 1 -- 172.21.15.37:0/761392087 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f66f0043020 con 0x7f67041026b0 2024-08-20T05:12:47.862 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.861+0000 7f66fbe00640 1 --2- 172.21.15.37:0/761392087 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f66e80b3bd0 0x7f66e80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:47 smithi135 ceph-mon[22342]: pgmap v717: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 503 op/s 2024-08-20T05:12:47.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.862+0000 7f6703400640 1 --2- 172.21.15.37:0/761392087 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f66e80b3bd0 0x7f66e80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:47.865 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.863+0000 7f6703400640 1 --2- 172.21.15.37:0/761392087 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f66e80b3bd0 0x7f66e80b6090 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f66f4005fd0 tx=0x7f66f4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:47.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.866+0000 7f66fbe00640 1 -- 172.21.15.37:0/761392087 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f66f0103d80 con 0x7f67041026b0 2024-08-20T05:12:47.866 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.866+0000 7f670d2c8740 1 Processor -- start 2024-08-20T05:12:47.867 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.866+0000 7f670d2c8740 1 -- start start 2024-08-20T05:12:47.868 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.867+0000 7f670d2c8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa0446a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.868+0000 7f670d2c8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa044be0 0x557dfa046fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.868+0000 7f6703400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa0446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:47.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.868+0000 7f6703400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa0446a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37994/0 (socket says 172.21.15.37:37994) 2024-08-20T05:12:47.869 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.868+0000 7f6702a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa044be0 0x557dfa046fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.868+0000 7f6702a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa044be0 0x557dfa046fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46608/0 (socket says 172.21.15.37:46608) 2024-08-20T05:12:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.868+0000 7f670d2c8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa047620 0x557dfa049ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.869+0000 7f6703400640 1 -- 172.21.15.37:0/3245700618 learned_addr learned my addr 172.21.15.37:0/3245700618 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.869+0000 7f670d2c8740 1 -- 172.21.15.37:0/3245700618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557df9fb5210 con 0x557dfa047620 2024-08-20T05:12:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.869+0000 7f670d2c8740 1 -- 172.21.15.37:0/3245700618 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557df9fa4710 con 0x557dfa0422b0 2024-08-20T05:12:47.871 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.869+0000 7f670d2c8740 1 -- 172.21.15.37:0/3245700618 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557df9fa8750 con 0x557dfa044be0 2024-08-20T05:12:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.869+0000 7f6703e00640 1 --2- 172.21.15.37:0/3245700618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa047620 0x557dfa049ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.870+0000 7f6703400640 1 -- 172.21.15.37:0/3245700618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa044be0 msgr2=0x557dfa046fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.870+0000 7f6703400640 1 --2- 172.21.15.37:0/3245700618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa044be0 0x557dfa046fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.870+0000 7f6703400640 1 -- 172.21.15.37:0/3245700618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa047620 msgr2=0x557dfa049ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.870+0000 7f6703400640 1 --2- 172.21.15.37:0/3245700618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa047620 0x557dfa049ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.870+0000 7f6703400640 1 -- 172.21.15.37:0/3245700618 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557df9f70de0 con 0x557dfa0422b0 2024-08-20T05:12:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.870+0000 7f6703e00640 1 --2- 172.21.15.37:0/3245700618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa047620 0x557dfa049ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:12:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.870+0000 7f6702a00640 1 --2- 172.21.15.37:0/3245700618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa044be0 0x557dfa046fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:12:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.871+0000 7f6703400640 1 --2- 172.21.15.37:0/3245700618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa0446a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f66f4010e90 tx=0x7f66f4013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3d5d866c990bcf7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.871+0000 7f66f8c00640 1 -- 172.21.15.37:0/3245700618 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f4023070 con 0x557dfa0422b0 2024-08-20T05:12:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.871+0000 7f66f8c00640 1 -- 172.21.15.37:0/3245700618 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66f40054d0 con 0x557dfa0422b0 2024-08-20T05:12:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.871+0000 7f66f8c00640 1 -- 172.21.15.37:0/3245700618 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f401f6b0 con 0x557dfa0422b0 2024-08-20T05:12:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.872+0000 7f670d2c8740 1 -- 172.21.15.37:0/3245700618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 msgr2=0x557dfa0446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.872+0000 7f670d2c8740 1 --2- 172.21.15.37:0/3245700618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa0446a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f66f4010e90 tx=0x7f66f4013000 comp rx=0 tx=0).stop 2024-08-20T05:12:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.876+0000 7f670d2c8740 1 -- 172.21.15.37:0/3245700618 shutdown_connections 2024-08-20T05:12:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.876+0000 7f670d2c8740 1 --2- 172.21.15.37:0/3245700618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa047620 0x557dfa049ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.876+0000 7f670d2c8740 1 --2- 172.21.15.37:0/3245700618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa044be0 0x557dfa046fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.876+0000 7f670d2c8740 1 --2- 172.21.15.37:0/3245700618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa0446a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.876+0000 7f670d2c8740 1 -- 172.21.15.37:0/3245700618 >> 172.21.15.37:0/3245700618 conn(0x557dfa03d3b0 msgr2=0x557dfa03e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:47.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.877+0000 7f670d2c8740 1 -- 172.21.15.37:0/3245700618 shutdown_connections 2024-08-20T05:12:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.877+0000 7f670d2c8740 1 -- 172.21.15.37:0/3245700618 wait complete. 2024-08-20T05:12:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.877+0000 7f670d2c8740 1 -- start start 2024-08-20T05:12:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.878+0000 7f670d2c8740 1 Processor -- start 2024-08-20T05:12:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.882+0000 7f670d2c8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa04bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.882+0000 7f670d2c8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa044be0 0x557dfa04c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.882+0000 7f670d2c8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa047620 0x557dfa04cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.883+0000 7f6703400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa04bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:47.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.883+0000 7f6703e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa047620 0x557dfa04cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:47.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.883+0000 7f6703e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa047620 0x557dfa04cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40122/0 (socket says 172.21.15.37:40122) 2024-08-20T05:12:47.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.883+0000 7f6703400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa04bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:38004/0 (socket says 172.21.15.37:38004) 2024-08-20T05:12:47.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.885+0000 7f670d2c8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557df9eddab0 con 0x557dfa047620 2024-08-20T05:12:47.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.885+0000 7f670d2c8740 1 -- 172.21.15.37:0/2459394056 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557df9f4b140 con 0x557dfa0422b0 2024-08-20T05:12:47.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.885+0000 7f6703e00640 1 -- 172.21.15.37:0/2459394056 learned_addr learned my addr 172.21.15.37:0/2459394056 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:47.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.885+0000 7f670d2c8740 1 -- 172.21.15.37:0/2459394056 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557dfa04a600 con 0x557dfa044be0 2024-08-20T05:12:47.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.885+0000 7f670d2c8740 10 client.0 _ll_register_callbacks cb 0x557df9f5e5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:47.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.885+0000 7f6702a00640 1 --2- 172.21.15.37:0/2459394056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa044be0 0x557dfa04c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.886+0000 7f6703400640 1 -- 172.21.15.37:0/2459394056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa044be0 msgr2=0x557dfa04c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.886+0000 7f6703400640 1 --2- 172.21.15.37:0/2459394056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa044be0 0x557dfa04c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.886+0000 7f6703400640 1 -- 172.21.15.37:0/2459394056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa047620 msgr2=0x557dfa04cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.886+0000 7f6703400640 1 --2- 172.21.15.37:0/2459394056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa047620 0x557dfa04cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.886+0000 7f6703400640 1 -- 172.21.15.37:0/2459394056 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557df9f4c170 con 0x557dfa0422b0 2024-08-20T05:12:47.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.887+0000 7f6702a00640 1 --2- 172.21.15.37:0/2459394056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa044be0 0x557dfa04c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:12:47.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.888+0000 7f6703400640 1 --2- 172.21.15.37:0/2459394056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa04bd80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f66f4010850 tx=0x7f66f40048f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce0fe2e9b1b877da server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:47.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.888+0000 7f66ed600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:12:47.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.889+0000 7f66ed600640 1 -- 172.21.15.37:0/2459394056 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f4023040 con 0x557dfa0422b0 2024-08-20T05:12:47.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.890+0000 7f66ed600640 1 -- 172.21.15.37:0/2459394056 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f66f4005170 con 0x557dfa0422b0 2024-08-20T05:12:47.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.890+0000 7f670d2c8740 1 -- 172.21.15.37:0/2459394056 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557df9f7ba30 con 0x557dfa0422b0 2024-08-20T05:12:47.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.890+0000 7f66ed600640 1 -- 172.21.15.37:0/2459394056 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f66f4005370 con 0x557dfa0422b0 2024-08-20T05:12:47.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.890+0000 7f670d2c8740 10 client.28094 fetch_fsmap learned FSMap version 46 2024-08-20T05:12:47.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.890+0000 7f670d2c8740 1 -- 172.21.15.37:0/2459394056 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x557df9d07790 con 0x557dfa0422b0 2024-08-20T05:12:47.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.891+0000 7f66ed600640 1 -- 172.21.15.37:0/2459394056 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557df9f7ba30 con 0x557dfa0422b0 2024-08-20T05:12:47.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.892+0000 7f66ed600640 1 -- 172.21.15.37:0/2459394056 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 46) ==== 8378+0+0 (secure 0 0 0) 0x7f66f400f040 con 0x557dfa0422b0 2024-08-20T05:12:47.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.893+0000 7f670d2c8740 10 client.28094 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T05:12:47.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.893+0000 7f670d2c8740 10 client.28094 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:12:47.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.893+0000 7f670d2c8740 20 client.28094 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:47.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.893+0000 7f670d2c8740 1 --2- 172.21.15.37:0/2459394056 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557dfa0575b0 0x557dfa0599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.893+0000 7f670d2c8740 4 client.28094 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:12:47.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.893+0000 7f670d2c8740 1 -- 172.21.15.37:0/2459394056 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557df9fb7160 con 0x557dfa0575b0 2024-08-20T05:12:47.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.894+0000 7f6702a00640 1 --2- 172.21.15.37:0/2459394056 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557dfa0575b0 0x557dfa0599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:47.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.895+0000 7f66ed600640 10 client.28094 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:47.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.895+0000 7f6702a00640 1 --2- 172.21.15.37:0/2459394056 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557dfa0575b0 0x557dfa0599a0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf0687b88f59b79d server_cookie=c493307f24605bd6 in_seq=0 out_seq=0 2024-08-20T05:12:47.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.895+0000 7f66ed600640 1 -- 172.21.15.37:0/2459394056 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557df9fb7160 con 0x557dfa0575b0 2024-08-20T05:12:47.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.895+0000 7f66ed600640 10 client.28094 handle_command_reply: tid=0 2024-08-20T05:12:47.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.896+0000 7f670d2c8740 1 client.28094 shutdown 2024-08-20T05:12:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.897+0000 7f670d2c8740 1 -- 172.21.15.37:0/2459394056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 msgr2=0x557dfa04bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.897+0000 7f670d2c8740 1 --2- 172.21.15.37:0/2459394056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa04bd80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f66f4010850 tx=0x7f66f40048f0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.897+0000 7f670d2c8740 1 -- 172.21.15.37:0/2459394056 shutdown_connections 2024-08-20T05:12:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.897+0000 7f670d2c8740 1 --2- 172.21.15.37:0/2459394056 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557dfa0575b0 0x557dfa0599a0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.897+0000 7f670d2c8740 1 --2- 172.21.15.37:0/2459394056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa047620 0x557dfa04cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.897+0000 7f670d2c8740 1 --2- 172.21.15.37:0/2459394056 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa044be0 0x557dfa04c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.897+0000 7f670d2c8740 1 --2- 172.21.15.37:0/2459394056 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa04bd80 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.897+0000 7f670d2c8740 1 -- 172.21.15.37:0/2459394056 >> 172.21.15.37:0/2459394056 conn(0x557dfa03d3b0 msgr2=0x557dfa03c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:47.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.897+0000 7f66ed600640 0 client.28094 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:47.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.897+0000 7f670d2c8740 1 -- 172.21.15.37:0/2459394056 shutdown_connections 2024-08-20T05:12:47.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.897+0000 7f670d2c8740 1 -- 172.21.15.37:0/2459394056 wait complete. 2024-08-20T05:12:47.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.898+0000 7f670d2c8740 20 client.28094 trim_cache size 0 max 16384 2024-08-20T05:12:47.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.945+0000 7f670d2c8740 1 Processor -- start 2024-08-20T05:12:47.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.946+0000 7f670d2c8740 1 -- start start 2024-08-20T05:12:47.947 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.946+0000 7f670d2c8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa03d3b0 0x557dfa049280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.946+0000 7f670d2c8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa053cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.946+0000 7f670d2c8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa044be0 0x557dfa0497c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.946+0000 7f670d2c8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f67041b1b20 con 0x557dfa044be0 2024-08-20T05:12:47.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.946+0000 7f670d2c8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f67041b3660 con 0x557dfa0422b0 2024-08-20T05:12:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.946+0000 7f670d2c8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f67041b21f0 con 0x557dfa03d3b0 2024-08-20T05:12:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.946+0000 7f6702a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa053cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.946+0000 7f6702a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa053cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:38020/0 (socket says 172.21.15.37:38020) 2024-08-20T05:12:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.946+0000 7f6702a00640 1 -- 172.21.15.37:0/2000426641 learned_addr learned my addr 172.21.15.37:0/2000426641 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.947+0000 7f6702a00640 1 -- 172.21.15.37:0/2000426641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa03d3b0 msgr2=0x557dfa049280 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:12:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.947+0000 7f6702a00640 1 --2- 172.21.15.37:0/2000426641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa03d3b0 0x557dfa049280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.947+0000 7f6702a00640 1 -- 172.21.15.37:0/2000426641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa044be0 msgr2=0x557dfa0497c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:12:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.947+0000 7f6702a00640 1 --2- 172.21.15.37:0/2000426641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa044be0 0x557dfa0497c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.947+0000 7f6702a00640 1 -- 172.21.15.37:0/2000426641 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557df9d80620 con 0x557dfa0422b0 2024-08-20T05:12:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.947+0000 7f6702a00640 1 --2- 172.21.15.37:0/2000426641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa053cb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f66f00c7b40 tx=0x7f66f0101350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10f2a629112b55e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:47.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.947+0000 7f66efe00640 1 -- 172.21.15.37:0/2000426641 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f00cafd0 con 0x557dfa0422b0 2024-08-20T05:12:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.947+0000 7f66efe00640 1 -- 172.21.15.37:0/2000426641 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66f00ca8d0 con 0x557dfa0422b0 2024-08-20T05:12:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.947+0000 7f66efe00640 1 -- 172.21.15.37:0/2000426641 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f00cab30 con 0x557dfa0422b0 2024-08-20T05:12:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.948+0000 7f670d2c8740 1 -- 172.21.15.37:0/2000426641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 msgr2=0x557dfa053cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.948+0000 7f670d2c8740 1 --2- 172.21.15.37:0/2000426641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa053cb0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f66f00c7b40 tx=0x7f66f0101350 comp rx=0 tx=0).stop 2024-08-20T05:12:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.949+0000 7f670d2c8740 1 -- 172.21.15.37:0/2000426641 shutdown_connections 2024-08-20T05:12:47.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.949+0000 7f670d2c8740 1 --2- 172.21.15.37:0/2000426641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa044be0 0x557dfa0497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.949+0000 7f670d2c8740 1 --2- 172.21.15.37:0/2000426641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa0422b0 0x557dfa053cb0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.949+0000 7f670d2c8740 1 --2- 172.21.15.37:0/2000426641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa03d3b0 0x557dfa049280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.949+0000 7f670d2c8740 1 -- 172.21.15.37:0/2000426641 >> 172.21.15.37:0/2000426641 conn(0x557dfa041e90 msgr2=0x557dfa0595c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.949+0000 7f670d2c8740 1 -- 172.21.15.37:0/2000426641 shutdown_connections 2024-08-20T05:12:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.950+0000 7f670d2c8740 1 -- 172.21.15.37:0/2000426641 wait complete. 2024-08-20T05:12:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.950+0000 7f670d2c8740 1 -- start start 2024-08-20T05:12:47.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.950+0000 7f670d2c8740 1 Processor -- start 2024-08-20T05:12:47.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.954+0000 7f670d2c8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa03d3b0 0x557dfa0506a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.954+0000 7f670d2c8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa0422b0 0x557dfa050d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.954+0000 7f670d2c8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa044be0 0x557dfa051910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:47 smithi130 ceph-mon[22007]: pgmap v717: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.6 MiB/s wr, 503 op/s 2024-08-20T05:12:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.954+0000 7f6703400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa03d3b0 0x557dfa0506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.955+0000 7f6702a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa0422b0 0x557dfa050d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.955+0000 7f6702a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa0422b0 0x557dfa050d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40132/0 (socket says 172.21.15.37:40132) 2024-08-20T05:12:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.955+0000 7f6702a00640 1 -- 172.21.15.37:0/2815556826 learned_addr learned my addr 172.21.15.37:0/2815556826 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:12:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.955+0000 7f670d2c8740 1 -- 172.21.15.37:0/2815556826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f67041b2f90 con 0x557dfa0422b0 2024-08-20T05:12:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.955+0000 7f670d2c8740 1 -- 172.21.15.37:0/2815556826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f67041b28c0 con 0x557dfa044be0 2024-08-20T05:12:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.955+0000 7f670d2c8740 1 -- 172.21.15.37:0/2815556826 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f67041afb20 con 0x557dfa03d3b0 2024-08-20T05:12:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.955+0000 7f6703e00640 1 --2- 172.21.15.37:0/2815556826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa044be0 0x557dfa051910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:47.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.955+0000 7f670d2c8740 10 client.0 _ll_register_callbacks cb 0x7f66fc0075e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:12:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.956+0000 7f6703e00640 1 -- 172.21.15.37:0/2815556826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa03d3b0 msgr2=0x557dfa0506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.956+0000 7f6703e00640 1 --2- 172.21.15.37:0/2815556826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa03d3b0 0x557dfa0506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.956+0000 7f6703e00640 1 -- 172.21.15.37:0/2815556826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa0422b0 msgr2=0x557dfa050d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:12:47.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.956+0000 7f6703e00640 1 --2- 172.21.15.37:0/2815556826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa0422b0 0x557dfa050d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:47.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.956+0000 7f6703e00640 1 -- 172.21.15.37:0/2815556826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557dfa052140 con 0x557dfa044be0 2024-08-20T05:12:47.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.956+0000 7f6703400640 1 --2- 172.21.15.37:0/2815556826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa03d3b0 0x557dfa0506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:12:47.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.956+0000 7f6703e00640 1 --2- 172.21.15.37:0/2815556826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa044be0 0x557dfa051910 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f66fc010ba0 tx=0x7f66fc010c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80d4879b7ed61524 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:12:47.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.956+0000 7f66ed600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:12:47.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.957+0000 7f66ed600640 1 -- 172.21.15.37:0/2815556826 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc00fbc0 con 0x557dfa044be0 2024-08-20T05:12:47.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.957+0000 7f66ed600640 1 -- 172.21.15.37:0/2815556826 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f66fc00fd60 con 0x557dfa044be0 2024-08-20T05:12:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.957+0000 7f670d2c8740 1 -- 172.21.15.37:0/2815556826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66f00ca8d0 con 0x557dfa044be0 2024-08-20T05:12:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.957+0000 7f66ed600640 1 -- 172.21.15.37:0/2815556826 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f66fc01a420 con 0x557dfa044be0 2024-08-20T05:12:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.958+0000 7f670d2c8740 10 client.28100 fetch_fsmap learned FSMap version 46 2024-08-20T05:12:47.959 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.959+0000 7f670d2c8740 1 -- 172.21.15.37:0/2815556826 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x557dfa053530 con 0x557dfa044be0 2024-08-20T05:12:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.959+0000 7f66ed600640 1 -- 172.21.15.37:0/2815556826 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66f00ca8d0 con 0x557dfa044be0 2024-08-20T05:12:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.959+0000 7f66ed600640 1 -- 172.21.15.37:0/2815556826 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 46) ==== 8378+0+0 (secure 0 0 0) 0x7f66fc0195f0 con 0x557dfa044be0 2024-08-20T05:12:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.959+0000 7f670d2c8740 10 client.28100 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T05:12:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.959+0000 7f670d2c8740 10 client.28100 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:12:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.959+0000 7f670d2c8740 20 client.28100 populate_metadata read hostname 'smithi037' 2024-08-20T05:12:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.959+0000 7f670d2c8740 1 --2- 172.21.15.37:0/2815556826 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557dfa047620 0x557dfa0c4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:12:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.959+0000 7f670d2c8740 4 client.28100 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:12:47.960 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.959+0000 7f670d2c8740 1 -- 172.21.15.37:0/2815556826 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557df9fb2c00 con 0x557dfa047620 2024-08-20T05:12:47.961 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.960+0000 7f6703400640 1 --2- 172.21.15.37:0/2815556826 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557dfa047620 0x557dfa0c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:12:47.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.960+0000 7f66ed600640 10 client.28100 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:47.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:47.960+0000 7f6703400640 1 --2- 172.21.15.37:0/2815556826 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557dfa047620 0x557dfa0c4040 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c20b554de404eab server_cookie=484148284acca446 in_seq=0 out_seq=0 2024-08-20T05:12:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.005+0000 7f66ed600640 1 -- 172.21.15.37:0/2815556826 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557df9fb2c00 con 0x557dfa047620 2024-08-20T05:12:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.005+0000 7f66ed600640 10 client.28100 handle_command_reply: tid=0 2024-08-20T05:12:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.006+0000 7f670d2c8740 1 client.28100 shutdown 2024-08-20T05:12:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.006+0000 7f670d2c8740 1 -- 172.21.15.37:0/2815556826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa044be0 msgr2=0x557dfa051910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.006+0000 7f670d2c8740 1 --2- 172.21.15.37:0/2815556826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa044be0 0x557dfa051910 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f66fc010ba0 tx=0x7f66fc010c90 comp rx=0 tx=0).stop 2024-08-20T05:12:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.007+0000 7f670d2c8740 1 -- 172.21.15.37:0/2815556826 shutdown_connections 2024-08-20T05:12:48.008 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.007+0000 7f670d2c8740 1 --2- 172.21.15.37:0/2815556826 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557dfa047620 0x557dfa0c4040 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.007+0000 7f670d2c8740 1 --2- 172.21.15.37:0/2815556826 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557dfa044be0 0x557dfa051910 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.007+0000 7f66ed600640 0 client.28100 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:12:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.007+0000 7f670d2c8740 1 --2- 172.21.15.37:0/2815556826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557dfa0422b0 0x557dfa050d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.007+0000 7f670d2c8740 1 --2- 172.21.15.37:0/2815556826 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557dfa03d3b0 0x557dfa0506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.008+0000 7f670d2c8740 1 -- 172.21.15.37:0/2815556826 >> 172.21.15.37:0/2815556826 conn(0x557dfa041e90 msgr2=0x557dfa049280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.008+0000 7f670d2c8740 1 -- 172.21.15.37:0/2815556826 shutdown_connections 2024-08-20T05:12:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.008+0000 7f670d2c8740 1 -- 172.21.15.37:0/2815556826 wait complete. 2024-08-20T05:12:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.008+0000 7f670d2c8740 20 client.28100 trim_cache size 0 max 16384 2024-08-20T05:12:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:12:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:12:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:12:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:12:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.010+0000 7f670a400640 1 -- 172.21.15.37:0/761392087 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f66e80b3bd0 msgr2=0x7f66e80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.010+0000 7f670a400640 1 --2- 172.21.15.37:0/761392087 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f66e80b3bd0 0x7f66e80b6090 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f66f4005fd0 tx=0x7f66f4009260 comp rx=0 tx=0).stop 2024-08-20T05:12:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.010+0000 7f670a400640 1 -- 172.21.15.37:0/761392087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67041026b0 msgr2=0x7f6704103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:12:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.010+0000 7f670a400640 1 --2- 172.21.15.37:0/761392087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67041026b0 0x7f6704103b80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f66f0005940 tx=0x7f66f0032e90 comp rx=0 tx=0).stop 2024-08-20T05:12:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.010+0000 7f670a400640 1 -- 172.21.15.37:0/761392087 shutdown_connections 2024-08-20T05:12:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.010+0000 7f670a400640 1 --2- 172.21.15.37:0/761392087 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f66e80b3bd0 0x7f66e80b6090 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.010+0000 7f670a400640 1 --2- 172.21.15.37:0/761392087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6704103070 0x7f67041040c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.010+0000 7f670a400640 1 --2- 172.21.15.37:0/761392087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f67041026b0 0x7f6704103b80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.010+0000 7f670a400640 1 --2- 172.21.15.37:0/761392087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6704101560 0x7f6704105320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:12:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.010+0000 7f670a400640 1 -- 172.21.15.37:0/761392087 >> 172.21.15.37:0/761392087 conn(0x7f67040fce40 msgr2=0x7f67040fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:12:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.011+0000 7f670a400640 1 -- 172.21.15.37:0/761392087 shutdown_connections 2024-08-20T05:12:48.012 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:12:48.011+0000 7f670a400640 1 -- 172.21.15.37:0/761392087 wait complete. 2024-08-20T05:12:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 590.0 s, 468.2 tps, lat 208.568 ms stddev 220.522 2024-08-20T05:12:49.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:49 smithi135 ceph-mon[22342]: pgmap v718: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.0 MiB/s wr, 534 op/s 2024-08-20T05:12:49.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:49 smithi130 ceph-mon[22007]: pgmap v718: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.0 MiB/s wr, 534 op/s 2024-08-20T05:12:50.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:49 smithi037 ceph-mon[17265]: pgmap v718: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.0 MiB/s wr, 534 op/s 2024-08-20T05:12:51.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:51 smithi135 ceph-mon[22342]: pgmap v719: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 573 op/s 2024-08-20T05:12:51.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:51 smithi130 ceph-mon[22007]: pgmap v719: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 573 op/s 2024-08-20T05:12:52.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:51 smithi037 ceph-mon[17265]: pgmap v719: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 573 op/s 2024-08-20T05:12:52.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:12:52.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:52 smithi037 ceph-mon[17265]: pgmap v720: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.2 MiB/s wr, 485 op/s 2024-08-20T05:12:52.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:52 smithi135 ceph-mon[22342]: pgmap v720: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.2 MiB/s wr, 485 op/s 2024-08-20T05:12:52.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:52 smithi130 ceph-mon[22007]: pgmap v720: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.2 MiB/s wr, 485 op/s 2024-08-20T05:12:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 595.0 s, 530.2 tps, lat 189.140 ms stddev 226.264 2024-08-20T05:12:53.525 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:12:55.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:55 smithi130 ceph-mon[22007]: pgmap v721: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.3 MiB/s wr, 682 op/s 2024-08-20T05:12:55.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:55 smithi037 ceph-mon[17265]: pgmap v721: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.3 MiB/s wr, 682 op/s 2024-08-20T05:12:55.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:55 smithi135 ceph-mon[22342]: pgmap v721: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 7.3 MiB/s wr, 682 op/s 2024-08-20T05:12:57.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:57 smithi135 ceph-mon[22342]: pgmap v722: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.2 MiB/s wr, 624 op/s 2024-08-20T05:12:57.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:57 smithi130 ceph-mon[22007]: pgmap v722: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.2 MiB/s wr, 624 op/s 2024-08-20T05:12:57.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:57 smithi037 ceph-mon[17265]: pgmap v722: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.2 MiB/s wr, 624 op/s 2024-08-20T05:12:58.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 600.0 s, 515.2 tps, lat 194.059 ms stddev 233.926 2024-08-20T05:12:59.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:12:59 smithi130 ceph-mon[22007]: pgmap v723: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.5 MiB/s wr, 620 op/s 2024-08-20T05:12:59.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:12:59 smithi037 ceph-mon[17265]: pgmap v723: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.5 MiB/s wr, 620 op/s 2024-08-20T05:12:59.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:12:59 smithi135 ceph-mon[22342]: pgmap v723: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.5 MiB/s wr, 620 op/s 2024-08-20T05:13:01.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:01 smithi130 ceph-mon[22007]: pgmap v724: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.3 MiB/s wr, 702 op/s 2024-08-20T05:13:01.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:01 smithi037 ceph-mon[17265]: pgmap v724: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.3 MiB/s wr, 702 op/s 2024-08-20T05:13:01.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:01 smithi135 ceph-mon[22342]: pgmap v724: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.3 MiB/s wr, 702 op/s 2024-08-20T05:13:02.364 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.362+0000 7fb451600640 1 -- 172.21.15.37:0/3013292744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb44c077750 msgr2=0x7fb44c077b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:02.365 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.362+0000 7fb451600640 1 --2- 172.21.15.37:0/3013292744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb44c077750 0x7fb44c077b50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb43c009900 tx=0x7fb43c02a420 comp rx=0 tx=0).stop 2024-08-20T05:13:02.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.364+0000 7fb451600640 1 -- 172.21.15.37:0/3013292744 shutdown_connections 2024-08-20T05:13:02.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.364+0000 7fb451600640 1 --2- 172.21.15.37:0/3013292744 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb44c079260 0x7fb44c079bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.364+0000 7fb451600640 1 --2- 172.21.15.37:0/3013292744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c0788a0 0x7fb44c078d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.364+0000 7fb451600640 1 --2- 172.21.15.37:0/3013292744 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb44c077750 0x7fb44c077b50 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.364+0000 7fb451600640 1 -- 172.21.15.37:0/3013292744 >> 172.21.15.37:0/3013292744 conn(0x7fb44c100130 msgr2=0x7fb44c102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.365+0000 7fb451600640 1 -- 172.21.15.37:0/3013292744 shutdown_connections 2024-08-20T05:13:02.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.365+0000 7fb451600640 1 -- 172.21.15.37:0/3013292744 wait complete. 2024-08-20T05:13:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.367+0000 7fb451600640 1 Processor -- start 2024-08-20T05:13:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.367+0000 7fb451600640 1 -- start start 2024-08-20T05:13:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.368+0000 7fb451600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c077750 0x7fb44c19f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.368+0000 7fb451600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb44c0788a0 0x7fb44c19f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.368+0000 7fb451600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb44c079260 0x7fb44c1a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.368+0000 7fb451600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c1149a0 con 0x7fb44c077750 2024-08-20T05:13:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.368+0000 7fb451600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c114820 con 0x7fb44c0788a0 2024-08-20T05:13:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.368+0000 7fb451600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c114b20 con 0x7fb44c079260 2024-08-20T05:13:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.368+0000 7fb44b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb44c079260 0x7fb44c1a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.368+0000 7fb44b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb44c079260 0x7fb44c1a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:60472/0 (socket says 172.21.15.37:60472) 2024-08-20T05:13:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.368+0000 7fb44b400640 1 -- 172.21.15.37:0/877974043 learned_addr learned my addr 172.21.15.37:0/877974043 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.368+0000 7fb443e00640 1 --2- 172.21.15.37:0/877974043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb44c0788a0 0x7fb44c19f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.369+0000 7fb44aa00640 1 --2- 172.21.15.37:0/877974043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c077750 0x7fb44c19f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.369+0000 7fb443e00640 1 -- 172.21.15.37:0/877974043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb44c079260 msgr2=0x7fb44c1a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.370+0000 7fb443e00640 1 --2- 172.21.15.37:0/877974043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb44c079260 0x7fb44c1a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.370+0000 7fb443e00640 1 -- 172.21.15.37:0/877974043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c077750 msgr2=0x7fb44c19f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.370+0000 7fb443e00640 1 --2- 172.21.15.37:0/877974043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c077750 0x7fb44c19f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.370+0000 7fb443e00640 1 -- 172.21.15.37:0/877974043 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44c1a0c30 con 0x7fb44c0788a0 2024-08-20T05:13:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.370+0000 7fb44b400640 1 --2- 172.21.15.37:0/877974043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb44c079260 0x7fb44c1a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:13:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.370+0000 7fb44aa00640 1 --2- 172.21.15.37:0/877974043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c077750 0x7fb44c19f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:02.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.370+0000 7fb443e00640 1 --2- 172.21.15.37:0/877974043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb44c0788a0 0x7fb44c19f740 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb43400b3f0 tx=0x7fb43400b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:02.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.371+0000 7fb443400640 1 -- 172.21.15.37:0/877974043 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434015020 con 0x7fb44c0788a0 2024-08-20T05:13:02.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.371+0000 7fb443400640 1 -- 172.21.15.37:0/877974043 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb434011ce0 con 0x7fb44c0788a0 2024-08-20T05:13:02.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.371+0000 7fb443400640 1 -- 172.21.15.37:0/877974043 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434010d80 con 0x7fb44c0788a0 2024-08-20T05:13:02.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.371+0000 7fb451600640 1 -- 172.21.15.37:0/877974043 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb44c1a0f20 con 0x7fb44c0788a0 2024-08-20T05:13:02.374 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.372+0000 7fb451600640 1 -- 172.21.15.37:0/877974043 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb44c1a75f0 con 0x7fb44c0788a0 2024-08-20T05:13:02.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.379+0000 7fb443400640 1 -- 172.21.15.37:0/877974043 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb434018020 con 0x7fb44c0788a0 2024-08-20T05:13:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.381+0000 7fb4544bd740 1 Processor -- start 2024-08-20T05:13:02.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.381+0000 7fb4544bd740 1 -- start start 2024-08-20T05:13:02.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.381+0000 7fb4544bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680bd610 0x55a9680bfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.381+0000 7fb4544bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bff40 0x55a9680c2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.381+0000 7fb4544bd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 0x55a9680c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.381+0000 7fb4544bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a968030210 con 0x55a9680bd610 2024-08-20T05:13:02.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.381+0000 7fb4544bd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a96801f710 con 0x55a9680c2980 2024-08-20T05:13:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.382+0000 7fb4544bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a968023750 con 0x55a9680bff40 2024-08-20T05:13:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.382+0000 7fb44aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bff40 0x55a9680c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.382+0000 7fb44aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bff40 0x55a9680c2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:60476/0 (socket says 172.21.15.37:60476) 2024-08-20T05:13:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.382+0000 7fb44aa00640 1 -- 172.21.15.37:0/2115331580 learned_addr learned my addr 172.21.15.37:0/2115331580 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.382+0000 7fb443e00640 1 --2- 172.21.15.37:0/2115331580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 0x55a9680c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.382+0000 7fb443400640 1 --2- 172.21.15.37:0/877974043 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4300b3c50 0x7fb4300b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.383+0000 7fb44aa00640 1 -- 172.21.15.37:0/2115331580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 msgr2=0x55a9680c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.383+0000 7fb44aa00640 1 --2- 172.21.15.37:0/2115331580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 0x55a9680c4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.383+0000 7fb44aa00640 1 -- 172.21.15.37:0/2115331580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680bd610 msgr2=0x55a9680bfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.383+0000 7fb44aa00640 1 --2- 172.21.15.37:0/2115331580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680bd610 0x55a9680bfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.383+0000 7fb44aa00640 1 -- 172.21.15.37:0/2115331580 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a967febde0 con 0x55a9680bff40 2024-08-20T05:13:02.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.383+0000 7fb443e00640 1 --2- 172.21.15.37:0/2115331580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 0x55a9680c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.384+0000 7fb443400640 1 -- 172.21.15.37:0/877974043 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb4340e37a0 con 0x7fb44c0788a0 2024-08-20T05:13:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.385+0000 7fb44aa00640 1 --2- 172.21.15.37:0/2115331580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bff40 0x55a9680c2330 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb43c02a940 tx=0x7fb43c004530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=930bff9ca5475b1d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.385+0000 7fb44b400640 1 --2- 172.21.15.37:0/877974043 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4300b3c50 0x7fb4300b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.386+0000 7fb44b400640 1 --2- 172.21.15.37:0/877974043 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4300b3c50 0x7fb4300b6110 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb44c19fe70 tx=0x7fb4440098e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.386+0000 7fb43b400640 1 -- 172.21.15.37:0/2115331580 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c035030 con 0x55a9680bff40 2024-08-20T05:13:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.387+0000 7fb43b400640 1 -- 172.21.15.37:0/2115331580 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb43c040070 con 0x55a9680bff40 2024-08-20T05:13:02.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.387+0000 7fb43b400640 1 -- 172.21.15.37:0/2115331580 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c045470 con 0x55a9680bff40 2024-08-20T05:13:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.389+0000 7fb4544bd740 1 -- 172.21.15.37:0/2115331580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bff40 msgr2=0x55a9680c2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:02.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.389+0000 7fb4544bd740 1 --2- 172.21.15.37:0/2115331580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bff40 0x55a9680c2330 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fb43c02a940 tx=0x7fb43c004530 comp rx=0 tx=0).stop 2024-08-20T05:13:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.391+0000 7fb4544bd740 1 -- 172.21.15.37:0/2115331580 shutdown_connections 2024-08-20T05:13:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.391+0000 7fb4544bd740 1 --2- 172.21.15.37:0/2115331580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 0x55a9680c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.391+0000 7fb4544bd740 1 --2- 172.21.15.37:0/2115331580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bff40 0x55a9680c2330 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.391+0000 7fb4544bd740 1 --2- 172.21.15.37:0/2115331580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680bd610 0x55a9680bfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.393 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.391+0000 7fb4544bd740 1 -- 172.21.15.37:0/2115331580 >> 172.21.15.37:0/2115331580 conn(0x55a9680b8760 msgr2=0x55a9680b94f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:02.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.392+0000 7fb4544bd740 1 -- 172.21.15.37:0/2115331580 shutdown_connections 2024-08-20T05:13:02.396 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.393+0000 7fb4544bd740 1 -- 172.21.15.37:0/2115331580 wait complete. 2024-08-20T05:13:02.398 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.396+0000 7fb4544bd740 1 -- start start 2024-08-20T05:13:02.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.398+0000 7fb4544bd740 1 Processor -- start 2024-08-20T05:13:02.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.399+0000 7fb4544bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 0x55a9680d7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.399+0000 7fb4544bd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680bff40 0x55a9680d8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.399+0000 7fb4544bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680c2980 0x55a9680d8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.399+0000 7fb4544bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a967f58ab0 con 0x55a9680c2980 2024-08-20T05:13:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.399+0000 7fb4544bd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a967fc6140 con 0x55a9680bff40 2024-08-20T05:13:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.399+0000 7fb4544bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a9680d6910 con 0x55a9680bd610 2024-08-20T05:13:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.399+0000 7fb4544bd740 10 client.0 _ll_register_callbacks cb 0x55a967fd95d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.400+0000 7fb44aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 0x55a9680d7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.400+0000 7fb44aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 0x55a9680d7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:60482/0 (socket says 172.21.15.37:60482) 2024-08-20T05:13:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.400+0000 7fb44aa00640 1 -- 172.21.15.37:0/1644954118 learned_addr learned my addr 172.21.15.37:0/1644954118 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.400+0000 7fb44b400640 1 --2- 172.21.15.37:0/1644954118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680c2980 0x55a9680d8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.400+0000 7fb44aa00640 1 -- 172.21.15.37:0/1644954118 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680bff40 msgr2=0x55a9680d8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.400+0000 7fb44aa00640 1 --2- 172.21.15.37:0/1644954118 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680bff40 0x55a9680d8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.400+0000 7fb44aa00640 1 -- 172.21.15.37:0/1644954118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680c2980 msgr2=0x55a9680d8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.400+0000 7fb44aa00640 1 --2- 172.21.15.37:0/1644954118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680c2980 0x55a9680d8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.401+0000 7fb44aa00640 1 -- 172.21.15.37:0/1644954118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a967fc7170 con 0x55a9680bd610 2024-08-20T05:13:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.401+0000 7fb44b400640 1 --2- 172.21.15.37:0/1644954118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680c2980 0x55a9680d8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:13:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.401+0000 7fb44aa00640 1 --2- 172.21.15.37:0/1644954118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 0x55a9680d7ca0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb43c02a460 tx=0x7fb43c0317d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0daf9f1ad3596e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.401+0000 7fb42fe00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:13:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.402+0000 7fb42fe00640 1 -- 172.21.15.37:0/1644954118 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c035070 con 0x55a9680bd610 2024-08-20T05:13:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.402+0000 7fb42fe00640 1 -- 172.21.15.37:0/1644954118 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb43c005040 con 0x55a9680bd610 2024-08-20T05:13:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.403+0000 7fb4544bd740 1 -- 172.21.15.37:0/1644954118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb43c040070 con 0x55a9680bd610 2024-08-20T05:13:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.408+0000 7fb42fe00640 1 -- 172.21.15.37:0/1644954118 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fb43c005240 con 0x55a9680bd610 2024-08-20T05:13:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.408+0000 7fb4544bd740 10 client.28123 fetch_fsmap learned FSMap version 46 2024-08-20T05:13:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.408+0000 7fb4544bd740 1 -- 172.21.15.37:0/1644954118 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55a967d82790 con 0x55a9680bd610 2024-08-20T05:13:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.409+0000 7fb42fe00640 1 -- 172.21.15.37:0/1644954118 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb43c040070 con 0x55a9680bd610 2024-08-20T05:13:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.410+0000 7fb42fe00640 1 -- 172.21.15.37:0/1644954118 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 46) ==== 8378+0+0 (secure 0 0 0) 0x7fb43c05a020 con 0x55a9680bd610 2024-08-20T05:13:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.410+0000 7fb4544bd740 10 client.28123 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T05:13:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.410+0000 7fb4544bd740 10 client.28123 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.410+0000 7fb4544bd740 20 client.28123 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.410+0000 7fb4544bd740 1 --2- 172.21.15.37:0/1644954118 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a9680f44d0 0x55a9680f68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.410+0000 7fb4544bd740 4 client.28123 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:13:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.410+0000 7fb4544bd740 1 -- 172.21.15.37:0/1644954118 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a968032160 con 0x55a9680f44d0 2024-08-20T05:13:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.415+0000 7fb443e00640 1 --2- 172.21.15.37:0/1644954118 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a9680f44d0 0x55a9680f68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.416+0000 7fb443e00640 1 --2- 172.21.15.37:0/1644954118 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a9680f44d0 0x55a9680f68c0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14b02d79223266d9 server_cookie=287108a008170b08 in_seq=0 out_seq=0 2024-08-20T05:13:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.416+0000 7fb42fe00640 10 client.28123 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:02.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.417+0000 7fb42fe00640 1 -- 172.21.15.37:0/1644954118 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a968032160 con 0x55a9680f44d0 2024-08-20T05:13:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.417+0000 7fb42fe00640 10 client.28123 handle_command_reply: tid=0 2024-08-20T05:13:02.419 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.417+0000 7fb4544bd740 1 client.28123 shutdown 2024-08-20T05:13:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.418+0000 7fb4544bd740 1 -- 172.21.15.37:0/1644954118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 msgr2=0x55a9680d7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.418+0000 7fb4544bd740 1 --2- 172.21.15.37:0/1644954118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 0x55a9680d7ca0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fb43c02a460 tx=0x7fb43c0317d0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.421+0000 7fb4544bd740 1 -- 172.21.15.37:0/1644954118 shutdown_connections 2024-08-20T05:13:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.421+0000 7fb4544bd740 1 --2- 172.21.15.37:0/1644954118 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a9680f44d0 0x55a9680f68c0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.421+0000 7fb4544bd740 1 --2- 172.21.15.37:0/1644954118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680c2980 0x55a9680d8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.421+0000 7fb4544bd740 1 --2- 172.21.15.37:0/1644954118 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680bff40 0x55a9680d8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.421+0000 7fb4544bd740 1 --2- 172.21.15.37:0/1644954118 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 0x55a9680d7ca0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.421+0000 7fb42fe00640 0 client.28123 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.421+0000 7fb4544bd740 1 -- 172.21.15.37:0/1644954118 >> 172.21.15.37:0/1644954118 conn(0x55a9680b8760 msgr2=0x55a9680b7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.421+0000 7fb4544bd740 1 -- 172.21.15.37:0/1644954118 shutdown_connections 2024-08-20T05:13:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.422+0000 7fb4544bd740 1 -- 172.21.15.37:0/1644954118 wait complete. 2024-08-20T05:13:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.422+0000 7fb4544bd740 20 client.28123 trim_cache size 0 max 16384 2024-08-20T05:13:02.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.473+0000 7fb4544bd740 1 Processor -- start 2024-08-20T05:13:02.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.473+0000 7fb4544bd740 1 -- start start 2024-08-20T05:13:02.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.475+0000 7fb4544bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 0x55a9680b8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.476 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.475+0000 7fb4544bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680bff40 0x55a9680b9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.475+0000 7fb4544bd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 0x55a9680c3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.475+0000 7fb4544bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c105e60 con 0x55a9680bff40 2024-08-20T05:13:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.475+0000 7fb4544bd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c1079a0 con 0x55a9680c2980 2024-08-20T05:13:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.475+0000 7fb4544bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c106530 con 0x55a9680bd610 2024-08-20T05:13:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.475+0000 7fb44b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 0x55a9680c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.476+0000 7fb44aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 0x55a9680b8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.477 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.476+0000 7fb44aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 0x55a9680b8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:60492/0 (socket says 172.21.15.37:60492) 2024-08-20T05:13:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.476+0000 7fb44aa00640 1 -- 172.21.15.37:0/82032705 learned_addr learned my addr 172.21.15.37:0/82032705 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.476+0000 7fb44aa00640 1 -- 172.21.15.37:0/82032705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 msgr2=0x55a9680c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.477+0000 7fb443e00640 1 --2- 172.21.15.37:0/82032705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680bff40 0x55a9680b9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.477+0000 7fb44aa00640 1 --2- 172.21.15.37:0/82032705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 0x55a9680c3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.477+0000 7fb44aa00640 1 -- 172.21.15.37:0/82032705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680bff40 msgr2=0x55a9680b9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.477+0000 7fb44aa00640 1 --2- 172.21.15.37:0/82032705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680bff40 0x55a9680b9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.477+0000 7fb44aa00640 1 -- 172.21.15.37:0/82032705 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a967dfb620 con 0x55a9680bd610 2024-08-20T05:13:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.477+0000 7fb443e00640 1 --2- 172.21.15.37:0/82032705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680bff40 0x55a9680b9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.477+0000 7fb44b400640 1 --2- 172.21.15.37:0/82032705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 0x55a9680c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:02.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.477+0000 7fb44aa00640 1 --2- 172.21.15.37:0/82032705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 0x55a9680b8fc0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0055c0 tx=0x7fb43c005550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5b8b8930ddb5b15 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.478+0000 7fb43aa00640 1 -- 172.21.15.37:0/82032705 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c005240 con 0x55a9680bd610 2024-08-20T05:13:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.478+0000 7fb43aa00640 1 -- 172.21.15.37:0/82032705 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb43c040070 con 0x55a9680bd610 2024-08-20T05:13:02.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.478+0000 7fb43aa00640 1 -- 172.21.15.37:0/82032705 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c004e40 con 0x55a9680bd610 2024-08-20T05:13:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.479+0000 7fb4544bd740 1 -- 172.21.15.37:0/82032705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 msgr2=0x55a9680b8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:02.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.479+0000 7fb4544bd740 1 --2- 172.21.15.37:0/82032705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 0x55a9680b8fc0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fb43c0055c0 tx=0x7fb43c005550 comp rx=0 tx=0).stop 2024-08-20T05:13:02.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.480+0000 7fb4544bd740 1 -- 172.21.15.37:0/82032705 shutdown_connections 2024-08-20T05:13:02.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.480+0000 7fb4544bd740 1 --2- 172.21.15.37:0/82032705 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 0x55a9680c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.480+0000 7fb4544bd740 1 --2- 172.21.15.37:0/82032705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680bff40 0x55a9680b9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.480+0000 7fb4544bd740 1 --2- 172.21.15.37:0/82032705 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 0x55a9680b8fc0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.480+0000 7fb4544bd740 1 -- 172.21.15.37:0/82032705 >> 172.21.15.37:0/82032705 conn(0x55a9680b8760 msgr2=0x55a9680bcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:02.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.480+0000 7fb4544bd740 1 -- 172.21.15.37:0/82032705 shutdown_connections 2024-08-20T05:13:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.481+0000 7fb4544bd740 1 -- 172.21.15.37:0/82032705 wait complete. 2024-08-20T05:13:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.481+0000 7fb4544bd740 1 -- start start 2024-08-20T05:13:02.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.481+0000 7fb4544bd740 1 Processor -- start 2024-08-20T05:13:02.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.483+0000 7fb4544bd740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 0x55a9680dcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.484+0000 7fb4544bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680bff40 0x55a9680dd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.484+0000 7fb4544bd740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 0x55a9680dddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.484+0000 7fb4544bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c1072d0 con 0x55a9680bff40 2024-08-20T05:13:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.484+0000 7fb4544bd740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c106c00 con 0x55a9680c2980 2024-08-20T05:13:02.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.484+0000 7fb4544bd740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb44c074ab0 con 0x55a9680bd610 2024-08-20T05:13:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.484+0000 7fb4544bd740 10 client.0 _ll_register_callbacks cb 0x7fb4340e9420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.484+0000 7fb44b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 0x55a9680dddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.484+0000 7fb44b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 0x55a9680dddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:49792/0 (socket says 172.21.15.37:49792) 2024-08-20T05:13:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.484+0000 7fb44b400640 1 -- 172.21.15.37:0/1772516490 learned_addr learned my addr 172.21.15.37:0/1772516490 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.484+0000 7fb44aa00640 1 --2- 172.21.15.37:0/1772516490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 0x55a9680dcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.485+0000 7fb44aa00640 1 -- 172.21.15.37:0/1772516490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 msgr2=0x55a9680dddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.485+0000 7fb44aa00640 1 --2- 172.21.15.37:0/1772516490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 0x55a9680dddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.485+0000 7fb44aa00640 1 -- 172.21.15.37:0/1772516490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680bff40 msgr2=0x55a9680dd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.485+0000 7fb44aa00640 1 --2- 172.21.15.37:0/1772516490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680bff40 0x55a9680dd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.485+0000 7fb44aa00640 1 -- 172.21.15.37:0/1772516490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9680de600 con 0x55a9680bd610 2024-08-20T05:13:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.486+0000 7fb44aa00640 1 --2- 172.21.15.37:0/1772516490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 0x55a9680dcbd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb43c02aa10 tx=0x7fb43c003f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84d4ef985c2a5dbb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.486+0000 7fb42fe00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:13:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.486+0000 7fb42fe00640 1 -- 172.21.15.37:0/1772516490 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c0039c0 con 0x55a9680bd610 2024-08-20T05:13:02.489 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.487+0000 7fb42fe00640 1 -- 172.21.15.37:0/1772516490 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb43c045470 con 0x55a9680bd610 2024-08-20T05:13:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.487+0000 7fb4544bd740 1 -- 172.21.15.37:0/1772516490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb43c040070 con 0x55a9680bd610 2024-08-20T05:13:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.487+0000 7fb42fe00640 1 -- 172.21.15.37:0/1772516490 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fb43c045670 con 0x55a9680bd610 2024-08-20T05:13:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.488+0000 7fb4544bd740 10 client.28129 fetch_fsmap learned FSMap version 46 2024-08-20T05:13:02.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.488+0000 7fb4544bd740 1 -- 172.21.15.37:0/1772516490 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55a9680df8e0 con 0x55a9680bd610 2024-08-20T05:13:02.491 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.489+0000 7fb42fe00640 1 -- 172.21.15.37:0/1772516490 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb43c040070 con 0x55a9680bd610 2024-08-20T05:13:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.489+0000 7fb42fe00640 1 -- 172.21.15.37:0/1772516490 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 46) ==== 8378+0+0 (secure 0 0 0) 0x7fb43c06b030 con 0x55a9680bd610 2024-08-20T05:13:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.489+0000 7fb4544bd740 10 client.28129 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T05:13:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.489+0000 7fb4544bd740 10 client.28129 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.489+0000 7fb4544bd740 20 client.28129 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.490+0000 7fb4544bd740 1 --2- 172.21.15.37:0/1772516490 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a96815f2b0 0x55a9681616d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.490+0000 7fb4544bd740 4 client.28129 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:13:02.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.490+0000 7fb4544bd740 1 -- 172.21.15.37:0/1772516490 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a96802dc00 con 0x55a96815f2b0 2024-08-20T05:13:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.490+0000 7fb443e00640 1 --2- 172.21.15.37:0/1772516490 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a96815f2b0 0x55a9681616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.491+0000 7fb42fe00640 10 client.28129 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:02.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.491+0000 7fb443e00640 1 --2- 172.21.15.37:0/1772516490 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a96815f2b0 0x55a9681616d0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9607fe917597f9f server_cookie=56ee3a9508d88dd6 in_seq=0 out_seq=0 2024-08-20T05:13:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.521+0000 7fb42fe00640 1 -- 172.21.15.37:0/1772516490 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a96802dc00 con 0x55a96815f2b0 2024-08-20T05:13:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.521+0000 7fb42fe00640 10 client.28129 handle_command_reply: tid=0 2024-08-20T05:13:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.521+0000 7fb4544bd740 1 client.28129 shutdown 2024-08-20T05:13:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.522+0000 7fb4544bd740 1 -- 172.21.15.37:0/1772516490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 msgr2=0x55a9680dcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.522+0000 7fb4544bd740 1 --2- 172.21.15.37:0/1772516490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 0x55a9680dcbd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb43c02aa10 tx=0x7fb43c003f70 comp rx=0 tx=0).stop 2024-08-20T05:13:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.522+0000 7fb4544bd740 1 -- 172.21.15.37:0/1772516490 shutdown_connections 2024-08-20T05:13:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.522+0000 7fb4544bd740 1 --2- 172.21.15.37:0/1772516490 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a96815f2b0 0x55a9681616d0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.522+0000 7fb4544bd740 1 --2- 172.21.15.37:0/1772516490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a9680c2980 0x55a9680dddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.522+0000 7fb42fe00640 0 client.28129 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.522+0000 7fb4544bd740 1 --2- 172.21.15.37:0/1772516490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a9680bff40 0x55a9680dd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.522+0000 7fb4544bd740 1 --2- 172.21.15.37:0/1772516490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a9680bd610 0x55a9680dcbd0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.522+0000 7fb4544bd740 1 -- 172.21.15.37:0/1772516490 >> 172.21.15.37:0/1772516490 conn(0x55a9680b8760 msgr2=0x55a9680bcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.522+0000 7fb4544bd740 1 -- 172.21.15.37:0/1772516490 shutdown_connections 2024-08-20T05:13:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.522+0000 7fb4544bd740 1 -- 172.21.15.37:0/1772516490 wait complete. 2024-08-20T05:13:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:13:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:13:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:13:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:13:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.523+0000 7fb4544bd740 20 client.28129 trim_cache size 0 max 16384 2024-08-20T05:13:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.524+0000 7fb451600640 1 -- 172.21.15.37:0/877974043 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4300b3c50 msgr2=0x7fb4300b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.524+0000 7fb451600640 1 --2- 172.21.15.37:0/877974043 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4300b3c50 0x7fb4300b6110 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb44c19fe70 tx=0x7fb4440098e0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.524+0000 7fb451600640 1 -- 172.21.15.37:0/877974043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb44c0788a0 msgr2=0x7fb44c19f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.524+0000 7fb451600640 1 --2- 172.21.15.37:0/877974043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb44c0788a0 0x7fb44c19f740 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb43400b3f0 tx=0x7fb43400b8b0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.524+0000 7fb451600640 1 -- 172.21.15.37:0/877974043 shutdown_connections 2024-08-20T05:13:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.524+0000 7fb451600640 1 --2- 172.21.15.37:0/877974043 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4300b3c50 0x7fb4300b6110 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.524+0000 7fb451600640 1 --2- 172.21.15.37:0/877974043 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb44c079260 0x7fb44c1a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.524+0000 7fb451600640 1 --2- 172.21.15.37:0/877974043 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb44c0788a0 0x7fb44c19f740 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.524+0000 7fb451600640 1 --2- 172.21.15.37:0/877974043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c077750 0x7fb44c19f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.524+0000 7fb451600640 1 -- 172.21.15.37:0/877974043 >> 172.21.15.37:0/877974043 conn(0x7fb44c100130 msgr2=0x7fb44c101bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.524+0000 7fb451600640 1 -- 172.21.15.37:0/877974043 shutdown_connections 2024-08-20T05:13:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:02.524+0000 7fb451600640 1 -- 172.21.15.37:0/877974043 wait complete. 2024-08-20T05:13:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.942+0000 7f60a0e00640 1 -- 172.21.15.37:0/2381913383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f609c101600 msgr2=0x7f609c1019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.942+0000 7f60a0e00640 1 --2- 172.21.15.37:0/2381913383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f609c101600 0x7f609c1019e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6094009be0 tx=0x7f609402a6f0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.943+0000 7f60a0e00640 1 -- 172.21.15.37:0/2381913383 shutdown_connections 2024-08-20T05:13:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.944+0000 7f60a0e00640 1 --2- 172.21.15.37:0/2381913383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c106a40 0x7f609c106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.944+0000 7f60a0e00640 1 --2- 172.21.15.37:0/2381913383 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f609c101f20 0x7f609c1063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.944+0000 7f60a0e00640 1 --2- 172.21.15.37:0/2381913383 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f609c101600 0x7f609c1019e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.944+0000 7f60a0e00640 1 -- 172.21.15.37:0/2381913383 >> 172.21.15.37:0/2381913383 conn(0x7f609c0fd2d0 msgr2=0x7f609c0ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.944+0000 7f60a0e00640 1 -- 172.21.15.37:0/2381913383 shutdown_connections 2024-08-20T05:13:02.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.945+0000 7f60a0e00640 1 -- 172.21.15.37:0/2381913383 wait complete. 2024-08-20T05:13:02.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.947+0000 7f60a0e00640 1 Processor -- start 2024-08-20T05:13:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.947+0000 7f60a0e00640 1 -- start start 2024-08-20T05:13:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.948+0000 7f60a0e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f609c101600 0x7f609c19f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.948+0000 7f60a0e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c101f20 0x7f609c19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.948+0000 7f60a0e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f609c106a40 0x7f609c1a4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.948+0000 7f60a0e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f609c118f00 con 0x7f609c101f20 2024-08-20T05:13:02.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.948+0000 7f60a0e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f609c118d80 con 0x7f609c106a40 2024-08-20T05:13:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.948+0000 7f60a0e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f609c119080 con 0x7f609c101600 2024-08-20T05:13:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.949+0000 7f609b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f609c101600 0x7f609c19f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.949+0000 7f609b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f609c101600 0x7f609c19f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42784/0 (socket says 172.21.15.37:42784) 2024-08-20T05:13:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.949+0000 7f609b400640 1 -- 172.21.15.37:0/3918031506 learned_addr learned my addr 172.21.15.37:0/3918031506 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:02.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.950+0000 7f609aa00640 1 --2- 172.21.15.37:0/3918031506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c101f20 0x7f609c19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.950+0000 7f609be00640 1 --2- 172.21.15.37:0/3918031506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f609c106a40 0x7f609c1a4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.950+0000 7f609b400640 1 -- 172.21.15.37:0/3918031506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f609c106a40 msgr2=0x7f609c1a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:02.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.950+0000 7f609b400640 1 --2- 172.21.15.37:0/3918031506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f609c106a40 0x7f609c1a4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.950+0000 7f609b400640 1 -- 172.21.15.37:0/3918031506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c101f20 msgr2=0x7f609c19f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:02.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.951+0000 7f609b400640 1 --2- 172.21.15.37:0/3918031506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c101f20 0x7f609c19f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.951+0000 7f609b400640 1 -- 172.21.15.37:0/3918031506 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609c1a53c0 con 0x7f609c101600 2024-08-20T05:13:02.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.951+0000 7f609aa00640 1 --2- 172.21.15.37:0/3918031506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c101f20 0x7f609c19f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:02.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.951+0000 7f609b400640 1 --2- 172.21.15.37:0/3918031506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f609c101600 0x7f609c19f310 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6094000f80 tx=0x7f6094031670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:02.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.952+0000 7f6093e00640 1 -- 172.21.15.37:0/3918031506 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094041020 con 0x7f609c101600 2024-08-20T05:13:02.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.952+0000 7f6093e00640 1 -- 172.21.15.37:0/3918031506 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f609403c920 con 0x7f609c101600 2024-08-20T05:13:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.952+0000 7f6093e00640 1 -- 172.21.15.37:0/3918031506 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6094036040 con 0x7f609c101600 2024-08-20T05:13:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.953+0000 7f60a0e00640 1 -- 172.21.15.37:0/3918031506 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609c1a5650 con 0x7f609c101600 2024-08-20T05:13:02.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.953+0000 7f60a0e00640 1 -- 172.21.15.37:0/3918031506 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f609c06c8a0 con 0x7f609c101600 2024-08-20T05:13:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.959+0000 7f60a4ec8740 1 Processor -- start 2024-08-20T05:13:02.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.959+0000 7f6093e00640 1 -- 172.21.15.37:0/3918031506 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6094044020 con 0x7f609c101600 2024-08-20T05:13:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.962+0000 7f6093e00640 1 --2- 172.21.15.37:0/3918031506 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f60800b3dc0 0x7f60800b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.962+0000 7f6093e00640 1 -- 172.21.15.37:0/3918031506 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6094105180 con 0x7f609c101600 2024-08-20T05:13:02.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.959+0000 7f60a4ec8740 1 -- start start 2024-08-20T05:13:02.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.963+0000 7f60a4ec8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c52aa80 0x55969c52ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.963+0000 7f60a4ec8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52b3a0 0x55969c536df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.963+0000 7f60a4ec8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c537330 0x55969c539720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.963+0000 7f60a4ec8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55969c4a0a60 con 0x55969c52b3a0 2024-08-20T05:13:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.963+0000 7f60a4ec8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55969c48ff60 con 0x55969c537330 2024-08-20T05:13:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.963+0000 7f60a4ec8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55969c493fa0 con 0x55969c52aa80 2024-08-20T05:13:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.964+0000 7f609b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c52aa80 0x55969c52ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.964+0000 7f609b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c52aa80 0x55969c52ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42798/0 (socket says 172.21.15.37:42798) 2024-08-20T05:13:02.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.964+0000 7f609b400640 1 -- 172.21.15.37:0/4148269894 learned_addr learned my addr 172.21.15.37:0/4148269894 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:02.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.965+0000 7f609aa00640 1 --2- 172.21.15.37:0/4148269894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52b3a0 0x55969c536df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.966+0000 7f609be00640 1 --2- 172.21.15.37:0/4148269894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c537330 0x55969c539720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.966+0000 7f609aa00640 1 -- 172.21.15.37:0/4148269894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c52aa80 msgr2=0x55969c52ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:02.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.966+0000 7f609aa00640 1 --2- 172.21.15.37:0/4148269894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c52aa80 0x55969c52ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.966+0000 7f609aa00640 1 -- 172.21.15.37:0/4148269894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c537330 msgr2=0x55969c539720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:02.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.966+0000 7f609aa00640 1 --2- 172.21.15.37:0/4148269894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c537330 0x55969c539720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.967+0000 7f609aa00640 1 -- 172.21.15.37:0/4148269894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55969c4363e0 con 0x55969c52b3a0 2024-08-20T05:13:02.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.967+0000 7f609b400640 1 --2- 172.21.15.37:0/4148269894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c52aa80 0x55969c52ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:02.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.967+0000 7f609be00640 1 --2- 172.21.15.37:0/4148269894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c537330 0x55969c539720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:02.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.967+0000 7f609be00640 1 --2- 172.21.15.37:0/3918031506 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f60800b3dc0 0x7f60800b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.968+0000 7f609aa00640 1 --2- 172.21.15.37:0/4148269894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52b3a0 0x55969c536df0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6088005fd0 tx=0x7f608800e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9628f178db691d8c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:02.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.968+0000 7f6090c00640 1 -- 172.21.15.37:0/4148269894 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088016070 con 0x55969c52b3a0 2024-08-20T05:13:02.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.969+0000 7f6090c00640 1 -- 172.21.15.37:0/4148269894 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6088011920 con 0x55969c52b3a0 2024-08-20T05:13:02.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.971+0000 7f6090c00640 1 -- 172.21.15.37:0/4148269894 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088010830 con 0x55969c52b3a0 2024-08-20T05:13:02.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.973+0000 7f609be00640 1 --2- 172.21.15.37:0/3918031506 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f60800b3dc0 0x7f60800b6280 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f608c0058c0 tx=0x7f608c004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:02.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.973+0000 7f60a4ec8740 1 -- 172.21.15.37:0/4148269894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52b3a0 msgr2=0x55969c536df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:02.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.973+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/4148269894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52b3a0 0x55969c536df0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6088005fd0 tx=0x7f608800e6c0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.973+0000 7f60a4ec8740 1 -- 172.21.15.37:0/4148269894 shutdown_connections 2024-08-20T05:13:02.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.974+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/4148269894 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c537330 0x55969c539720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.974+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/4148269894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52b3a0 0x55969c536df0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.974+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/4148269894 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c52aa80 0x55969c52ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.974+0000 7f60a4ec8740 1 -- 172.21.15.37:0/4148269894 >> 172.21.15.37:0/4148269894 conn(0x55969c5288b0 msgr2=0x55969c529a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:02.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.974+0000 7f60a4ec8740 1 -- 172.21.15.37:0/4148269894 shutdown_connections 2024-08-20T05:13:02.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.974+0000 7f60a4ec8740 1 -- 172.21.15.37:0/4148269894 wait complete. 2024-08-20T05:13:02.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.975+0000 7f60a4ec8740 1 -- start start 2024-08-20T05:13:02.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.975+0000 7f60a4ec8740 1 Processor -- start 2024-08-20T05:13:02.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.976+0000 7f60a4ec8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52aa80 0x55969c536a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.976+0000 7f60a4ec8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c52b3a0 0x55969c533eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.976+0000 7f60a4ec8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c537330 0x55969c5343f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.977+0000 7f60a4ec8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55969c2f2700 con 0x55969c52aa80 2024-08-20T05:13:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.977+0000 7f60a4ec8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55969c42b250 con 0x55969c52b3a0 2024-08-20T05:13:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.977+0000 7f60a4ec8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55969c53a050 con 0x55969c537330 2024-08-20T05:13:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.977+0000 7f609aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c52b3a0 0x55969c533eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.977+0000 7f609aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c52b3a0 0x55969c533eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53244/0 (socket says 172.21.15.37:53244) 2024-08-20T05:13:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.977+0000 7f609aa00640 1 -- 172.21.15.37:0/3132561065 learned_addr learned my addr 172.21.15.37:0/3132561065 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.977+0000 7f609be00640 1 --2- 172.21.15.37:0/3132561065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c537330 0x55969c5343f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.977+0000 7f60a4ec8740 10 client.0 _ll_register_callbacks cb 0x55969c48a180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:02.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.977+0000 7f609b400640 1 --2- 172.21.15.37:0/3132561065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52aa80 0x55969c536a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.978+0000 7f609aa00640 1 -- 172.21.15.37:0/3132561065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c537330 msgr2=0x55969c5343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:02.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.978+0000 7f609aa00640 1 --2- 172.21.15.37:0/3132561065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c537330 0x55969c5343f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.978+0000 7f609aa00640 1 -- 172.21.15.37:0/3132561065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52aa80 msgr2=0x55969c536a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:02.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.978+0000 7f609aa00640 1 --2- 172.21.15.37:0/3132561065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52aa80 0x55969c536a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.978+0000 7f609aa00640 1 -- 172.21.15.37:0/3132561065 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55969c1ef650 con 0x55969c52b3a0 2024-08-20T05:13:02.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.978+0000 7f609aa00640 1 --2- 172.21.15.37:0/3132561065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c52b3a0 0x55969c533eb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f60880093c0 tx=0x7f608800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=956cada64e48ca72 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:02.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.978+0000 7f6085600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:13:02.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.978+0000 7f6085600640 1 -- 172.21.15.37:0/3132561065 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088016070 con 0x55969c52b3a0 2024-08-20T05:13:02.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.978+0000 7f6085600640 1 -- 172.21.15.37:0/3132561065 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6088005040 con 0x55969c52b3a0 2024-08-20T05:13:02.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.978+0000 7f60a4ec8740 1 -- 172.21.15.37:0/3132561065 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6088011920 con 0x55969c52b3a0 2024-08-20T05:13:02.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.979+0000 7f6085600640 1 -- 172.21.15.37:0/3132561065 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f6088005240 con 0x55969c52b3a0 2024-08-20T05:13:02.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.979+0000 7f60a4ec8740 10 client.28121 fetch_fsmap learned FSMap version 46 2024-08-20T05:13:02.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.979+0000 7f60a4ec8740 1 -- 172.21.15.37:0/3132561065 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55969c545770 con 0x55969c52b3a0 2024-08-20T05:13:02.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.979+0000 7f6085600640 1 -- 172.21.15.37:0/3132561065 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6088011920 con 0x55969c52b3a0 2024-08-20T05:13:02.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.979+0000 7f6085600640 1 -- 172.21.15.37:0/3132561065 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 46) ==== 8378+0+0 (secure 0 0 0) 0x7f6088022020 con 0x55969c52b3a0 2024-08-20T05:13:02.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.980+0000 7f60a4ec8740 10 client.28121 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T05:13:02.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.980+0000 7f60a4ec8740 10 client.28121 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:02.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.980+0000 7f60a4ec8740 20 client.28121 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:02.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.980+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/3132561065 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55969c546b70 0x55969c548f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:02.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.980+0000 7f60a4ec8740 4 client.28121 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:13:02.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.980+0000 7f60a4ec8740 1 -- 172.21.15.37:0/3132561065 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55969c4a29b0 con 0x55969c546b70 2024-08-20T05:13:02.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.980+0000 7f609b400640 1 --2- 172.21.15.37:0/3132561065 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55969c546b70 0x55969c548f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:02.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.981+0000 7f609b400640 1 --2- 172.21.15.37:0/3132561065 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55969c546b70 0x55969c548f60 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3199e4d616d3666 server_cookie=2ed87ebe537113a in_seq=0 out_seq=0 2024-08-20T05:13:02.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.981+0000 7f6085600640 10 client.28121 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:02.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.981+0000 7f6085600640 1 -- 172.21.15.37:0/3132561065 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55969c4a29b0 con 0x55969c546b70 2024-08-20T05:13:02.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.981+0000 7f6085600640 10 client.28121 handle_command_reply: tid=0 2024-08-20T05:13:02.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.982+0000 7f60a4ec8740 1 client.28121 shutdown 2024-08-20T05:13:02.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.983+0000 7f60a4ec8740 1 -- 172.21.15.37:0/3132561065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c52b3a0 msgr2=0x55969c533eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:02.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.983+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/3132561065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c52b3a0 0x55969c533eb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f60880093c0 tx=0x7f608800ef20 comp rx=0 tx=0).stop 2024-08-20T05:13:02.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.983+0000 7f60a4ec8740 1 -- 172.21.15.37:0/3132561065 shutdown_connections 2024-08-20T05:13:02.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.983+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/3132561065 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55969c546b70 0x55969c548f60 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.983+0000 7f6085600640 0 client.28121 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:02.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.983+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/3132561065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c537330 0x55969c5343f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.983+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/3132561065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c52b3a0 0x55969c533eb0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.983+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/3132561065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52aa80 0x55969c536a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:02.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.983+0000 7f60a4ec8740 1 -- 172.21.15.37:0/3132561065 >> 172.21.15.37:0/3132561065 conn(0x55969c5288b0 msgr2=0x55969c52e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:02.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.983+0000 7f60a4ec8740 1 -- 172.21.15.37:0/3132561065 shutdown_connections 2024-08-20T05:13:02.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.983+0000 7f60a4ec8740 1 -- 172.21.15.37:0/3132561065 wait complete. 2024-08-20T05:13:02.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:02.984+0000 7f60a4ec8740 20 client.28121 trim_cache size 0 max 16384 2024-08-20T05:13:03.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.011+0000 7f60a4ec8740 1 Processor -- start 2024-08-20T05:13:03.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.011+0000 7f60a4ec8740 1 -- start start 2024-08-20T05:13:03.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.011+0000 7f60a4ec8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52aa80 0x55969c54e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:03.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.011+0000 7f60a4ec8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c52b3a0 0x55969c54ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.011+0000 7f60a4ec8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c537330 0x55969c5310c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.011+0000 7f60a4ec8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f609c1be330 con 0x55969c52aa80 2024-08-20T05:13:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.011+0000 7f60a4ec8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f609c1bfe70 con 0x55969c537330 2024-08-20T05:13:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.011+0000 7f60a4ec8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f609c1bea00 con 0x55969c52b3a0 2024-08-20T05:13:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.011+0000 7f609aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c52b3a0 0x55969c54ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.011+0000 7f609aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c52b3a0 0x55969c54ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42826/0 (socket says 172.21.15.37:42826) 2024-08-20T05:13:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.011+0000 7f609aa00640 1 -- 172.21.15.37:0/2751591180 learned_addr learned my addr 172.21.15.37:0/2751591180 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:03.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.012+0000 7f609aa00640 1 -- 172.21.15.37:0/2751591180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c537330 msgr2=0x55969c5310c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.012+0000 7f609be00640 1 --2- 172.21.15.37:0/2751591180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c537330 0x55969c5310c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.012+0000 7f609aa00640 1 --2- 172.21.15.37:0/2751591180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c537330 0x55969c5310c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.012+0000 7f609aa00640 1 -- 172.21.15.37:0/2751591180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52aa80 msgr2=0x55969c54e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.012+0000 7f609aa00640 1 --2- 172.21.15.37:0/2751591180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52aa80 0x55969c54e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.012+0000 7f609aa00640 1 -- 172.21.15.37:0/2751591180 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55969c52b1d0 con 0x55969c52b3a0 2024-08-20T05:13:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.012+0000 7f609be00640 1 --2- 172.21.15.37:0/2751591180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c537330 0x55969c5310c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.013+0000 7f609aa00640 1 --2- 172.21.15.37:0/2751591180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c52b3a0 0x55969c54ebc0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6088010780 tx=0x7f6088005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=137e374b38c7f3f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:03.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.013+0000 7f6087e00640 1 -- 172.21.15.37:0/2751591180 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088016070 con 0x55969c52b3a0 2024-08-20T05:13:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.013+0000 7f6087e00640 1 -- 172.21.15.37:0/2751591180 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6088009850 con 0x55969c52b3a0 2024-08-20T05:13:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.013+0000 7f6087e00640 1 -- 172.21.15.37:0/2751591180 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6088005640 con 0x55969c52b3a0 2024-08-20T05:13:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.014+0000 7f60a4ec8740 1 -- 172.21.15.37:0/2751591180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c52b3a0 msgr2=0x55969c54ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.014+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/2751591180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c52b3a0 0x55969c54ebc0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6088010780 tx=0x7f6088005f90 comp rx=0 tx=0).stop 2024-08-20T05:13:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.014+0000 7f60a4ec8740 1 -- 172.21.15.37:0/2751591180 shutdown_connections 2024-08-20T05:13:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.014+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/2751591180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c537330 0x55969c5310c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:03.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.014+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/2751591180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c52b3a0 0x55969c54ebc0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:03.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.014+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/2751591180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52aa80 0x55969c54e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:03.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.014+0000 7f60a4ec8740 1 -- 172.21.15.37:0/2751591180 >> 172.21.15.37:0/2751591180 conn(0x55969c5288b0 msgr2=0x55969c535d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:03.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.014+0000 7f60a4ec8740 1 -- 172.21.15.37:0/2751591180 shutdown_connections 2024-08-20T05:13:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.014+0000 7f60a4ec8740 1 -- 172.21.15.37:0/2751591180 wait complete. 2024-08-20T05:13:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.015+0000 7f60a4ec8740 1 -- start start 2024-08-20T05:13:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.015+0000 7f60a4ec8740 1 Processor -- start 2024-08-20T05:13:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.016+0000 7f60a4ec8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c52aa80 0x55969c53fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.016+0000 7f60a4ec8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52b3a0 0x55969c53d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:03.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.017+0000 7f60a4ec8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c537330 0x55969c53d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:03.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.017+0000 7f60a4ec8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f609c1bf7a0 con 0x55969c52b3a0 2024-08-20T05:13:03.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.017+0000 7f60a4ec8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f609c1bf0d0 con 0x55969c52aa80 2024-08-20T05:13:03.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.017+0000 7f60a4ec8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f609c1a0440 con 0x55969c537330 2024-08-20T05:13:03.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.017+0000 7f60a4ec8740 10 client.0 _ll_register_callbacks cb 0x7f609403cb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.017+0000 7f609b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c52aa80 0x55969c53fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.018+0000 7f609be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c537330 0x55969c53d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.018+0000 7f609b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c52aa80 0x55969c53fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53254/0 (socket says 172.21.15.37:53254) 2024-08-20T05:13:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.018+0000 7f609b400640 1 -- 172.21.15.37:0/3439626771 learned_addr learned my addr 172.21.15.37:0/3439626771 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.018+0000 7f609aa00640 1 --2- 172.21.15.37:0/3439626771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52b3a0 0x55969c53d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:03.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.019+0000 7f609b400640 1 -- 172.21.15.37:0/3439626771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c537330 msgr2=0x55969c53d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.019+0000 7f609b400640 1 --2- 172.21.15.37:0/3439626771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c537330 0x55969c53d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.019+0000 7f609b400640 1 -- 172.21.15.37:0/3439626771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52b3a0 msgr2=0x55969c53d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.019+0000 7f609b400640 1 --2- 172.21.15.37:0/3439626771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52b3a0 0x55969c53d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:03.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.019+0000 7f609b400640 1 -- 172.21.15.37:0/3439626771 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55969c5b0660 con 0x55969c52aa80 2024-08-20T05:13:03.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.019+0000 7f609aa00640 1 --2- 172.21.15.37:0/3439626771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52b3a0 0x55969c53d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:03.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.022+0000 7f609be00640 1 --2- 172.21.15.37:0/3439626771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c537330 0x55969c53d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:13:03.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.023+0000 7f609b400640 1 --2- 172.21.15.37:0/3439626771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c52aa80 0x55969c53fbb0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6094102930 tx=0x7f6094030e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc02fe2be0f0cac3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:03.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.023+0000 7f6085600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:13:03.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.024+0000 7f6085600640 1 -- 172.21.15.37:0/3439626771 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60940cbd30 con 0x55969c52aa80 2024-08-20T05:13:03.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.024+0000 7f60a4ec8740 1 -- 172.21.15.37:0/3439626771 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6088009850 con 0x55969c52aa80 2024-08-20T05:13:03.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.024+0000 7f6085600640 1 -- 172.21.15.37:0/3439626771 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f609403cd20 con 0x55969c52aa80 2024-08-20T05:13:03.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.024+0000 7f6085600640 1 -- 172.21.15.37:0/3439626771 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f60940eb050 con 0x55969c52aa80 2024-08-20T05:13:03.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.025+0000 7f60a4ec8740 10 client.28124 fetch_fsmap learned FSMap version 46 2024-08-20T05:13:03.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.025+0000 7f60a4ec8740 1 -- 172.21.15.37:0/3439626771 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55969c5b1870 con 0x55969c52aa80 2024-08-20T05:13:03.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.026+0000 7f6085600640 1 -- 172.21.15.37:0/3439626771 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6088009850 con 0x55969c52aa80 2024-08-20T05:13:03.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.028+0000 7f6085600640 1 -- 172.21.15.37:0/3439626771 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 46) ==== 8378+0+0 (secure 0 0 0) 0x7f609403c470 con 0x55969c52aa80 2024-08-20T05:13:03.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.028+0000 7f60a4ec8740 10 client.28124 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T05:13:03.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.028+0000 7f60a4ec8740 10 client.28124 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:03.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.028+0000 7f60a4ec8740 20 client.28124 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:03.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.028+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/3439626771 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55969c5b1f20 0x55969c5b4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:03.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.028+0000 7f60a4ec8740 4 client.28124 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:13:03.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.028+0000 7f60a4ec8740 1 -- 172.21.15.37:0/3439626771 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55969c49e450 con 0x55969c5b1f20 2024-08-20T05:13:03.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.029+0000 7f609aa00640 1 --2- 172.21.15.37:0/3439626771 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55969c5b1f20 0x55969c5b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:03.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.031+0000 7f609aa00640 1 --2- 172.21.15.37:0/3439626771 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55969c5b1f20 0x55969c5b4340 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5be92adce28dc09 server_cookie=fe952081e6c1c2da in_seq=0 out_seq=0 2024-08-20T05:13:03.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.031+0000 7f6085600640 10 client.28124 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:03.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.032+0000 7f6085600640 1 -- 172.21.15.37:0/3439626771 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55969c49e450 con 0x55969c5b1f20 2024-08-20T05:13:03.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.032+0000 7f6085600640 10 client.28124 handle_command_reply: tid=0 2024-08-20T05:13:03.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.032+0000 7f60a4ec8740 1 client.28124 shutdown 2024-08-20T05:13:03.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.033+0000 7f60a4ec8740 1 -- 172.21.15.37:0/3439626771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c52aa80 msgr2=0x55969c53fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:03.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.033+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/3439626771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c52aa80 0x55969c53fbb0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6094102930 tx=0x7f6094030e30 comp rx=0 tx=0).stop 2024-08-20T05:13:03.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.033+0000 7f60a4ec8740 1 -- 172.21.15.37:0/3439626771 shutdown_connections 2024-08-20T05:13:03.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.033+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/3439626771 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55969c5b1f20 0x55969c5b4340 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:03.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.033+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/3439626771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55969c537330 0x55969c53d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:03.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.033+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/3439626771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55969c52b3a0 0x55969c53d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:03.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.033+0000 7f60a4ec8740 1 --2- 172.21.15.37:0/3439626771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55969c52aa80 0x55969c53fbb0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:03.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.033+0000 7f60a4ec8740 1 -- 172.21.15.37:0/3439626771 >> 172.21.15.37:0/3439626771 conn(0x55969c5288b0 msgr2=0x55969c527270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:03.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.033+0000 7f6085600640 0 client.28124 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:03.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.034+0000 7f60a4ec8740 1 -- 172.21.15.37:0/3439626771 shutdown_connections 2024-08-20T05:13:03.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.034+0000 7f60a4ec8740 1 -- 172.21.15.37:0/3439626771 wait complete. 2024-08-20T05:13:03.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.034+0000 7f60a4ec8740 20 client.28124 trim_cache size 0 max 16384 2024-08-20T05:13:03.037 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:13:03.037 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-20T05:13:03.037 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-08-20T05:13:03.037 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:13:03.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.037+0000 7f60a0e00640 1 -- 172.21.15.37:0/3918031506 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f60800b3dc0 msgr2=0x7f60800b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:03.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.037+0000 7f60a0e00640 1 --2- 172.21.15.37:0/3918031506 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f60800b3dc0 0x7f60800b6280 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f608c0058c0 tx=0x7f608c004730 comp rx=0 tx=0).stop 2024-08-20T05:13:03.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.037+0000 7f60a0e00640 1 -- 172.21.15.37:0/3918031506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f609c101600 msgr2=0x7f609c19f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:03.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.037+0000 7f60a0e00640 1 --2- 172.21.15.37:0/3918031506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f609c101600 0x7f609c19f310 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6094000f80 tx=0x7f6094031670 comp rx=0 tx=0).stop 2024-08-20T05:13:03.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.037+0000 7f60a0e00640 1 -- 172.21.15.37:0/3918031506 shutdown_connections 2024-08-20T05:13:03.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.037+0000 7f60a0e00640 1 --2- 172.21.15.37:0/3918031506 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f60800b3dc0 0x7f60800b6280 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:03.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.037+0000 7f60a0e00640 1 --2- 172.21.15.37:0/3918031506 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f609c106a40 0x7f609c1a4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:03.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.037+0000 7f60a0e00640 1 --2- 172.21.15.37:0/3918031506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f609c101f20 0x7f609c19f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:03.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.037+0000 7f60a0e00640 1 --2- 172.21.15.37:0/3918031506 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f609c101600 0x7f609c19f310 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:03.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.037+0000 7f60a0e00640 1 -- 172.21.15.37:0/3918031506 >> 172.21.15.37:0/3918031506 conn(0x7f609c0fd2d0 msgr2=0x7f609c1043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.038+0000 7f60a0e00640 1 -- 172.21.15.37:0/3918031506 shutdown_connections 2024-08-20T05:13:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:03.038+0000 7f60a0e00640 1 -- 172.21.15.37:0/3918031506 wait complete. 2024-08-20T05:13:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 605.0 s, 498.4 tps, lat 201.978 ms stddev 317.629 2024-08-20T05:13:03.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:03 smithi037 ceph-mon[17265]: pgmap v725: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.9 MiB/s wr, 601 op/s 2024-08-20T05:13:03.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:03 smithi135 ceph-mon[22342]: pgmap v725: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.9 MiB/s wr, 601 op/s 2024-08-20T05:13:03.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:03 smithi130 ceph-mon[22007]: pgmap v725: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.9 MiB/s wr, 601 op/s 2024-08-20T05:13:04.243 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T05:13:04.244 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:13:05.029 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:13:05.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:05 smithi037 ceph-mon[17265]: pgmap v726: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 742 op/s 2024-08-20T05:13:05.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:05 smithi135 ceph-mon[22342]: pgmap v726: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 742 op/s 2024-08-20T05:13:05.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:05 smithi130 ceph-mon[22007]: pgmap v726: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 742 op/s 2024-08-20T05:13:07.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.275+0000 7f1a85800640 1 -- 172.21.15.37:0/4099994581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a80109e80 msgr2=0x7f1a80110ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:07.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.275+0000 7f1a85800640 1 --2- 172.21.15.37:0/4099994581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a80109e80 0x7f1a80110ee0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009900 tx=0x7f1a7002a4d0 comp rx=0 tx=0).stop 2024-08-20T05:13:07.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.276+0000 7f1a85800640 1 -- 172.21.15.37:0/4099994581 shutdown_connections 2024-08-20T05:13:07.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.276+0000 7f1a85800640 1 --2- 172.21.15.37:0/4099994581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a8011bdd0 0x7f1a8011e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:07.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.276+0000 7f1a85800640 1 --2- 172.21.15.37:0/4099994581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a8010a260 0x7f1a8010a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:07.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.276+0000 7f1a85800640 1 --2- 172.21.15.37:0/4099994581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a80109e80 0x7f1a80110ee0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:07.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.276+0000 7f1a85800640 1 -- 172.21.15.37:0/4099994581 >> 172.21.15.37:0/4099994581 conn(0x7f1a8006dcc0 msgr2=0x7f1a8006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:07.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.276+0000 7f1a85800640 1 -- 172.21.15.37:0/4099994581 shutdown_connections 2024-08-20T05:13:07.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.276+0000 7f1a85800640 1 -- 172.21.15.37:0/4099994581 wait complete. 2024-08-20T05:13:07.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.278+0000 7f1a85800640 1 Processor -- start 2024-08-20T05:13:07.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.278+0000 7f1a85800640 1 -- start start 2024-08-20T05:13:07.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.279+0000 7f1a85800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a80109e80 0x7f1a801a7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:07.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.279+0000 7f1a85800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a8010a260 0x7f1a801a8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:07.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.280+0000 7f1a7ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a80109e80 0x7f1a801a7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:07.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.280+0000 7f1a7ea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a80109e80 0x7f1a801a7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53264/0 (socket says 172.21.15.37:53264) 2024-08-20T05:13:07.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.280+0000 7f1a7ea00640 1 -- 172.21.15.37:0/2330359068 learned_addr learned my addr 172.21.15.37:0/2330359068 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:07.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.280+0000 7f1a77e00640 1 --2- 172.21.15.37:0/2330359068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a8010a260 0x7f1a801a8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:07.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.280+0000 7f1a85800640 1 --2- 172.21.15.37:0/2330359068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a8011bdd0 0x7f1a801ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:07.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.280+0000 7f1a85800640 1 -- 172.21.15.37:0/2330359068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1a801218b0 con 0x7f1a8010a260 2024-08-20T05:13:07.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.280+0000 7f1a85800640 1 -- 172.21.15.37:0/2330359068 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1a80121730 con 0x7f1a80109e80 2024-08-20T05:13:07.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.281+0000 7f1a85800640 1 -- 172.21.15.37:0/2330359068 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1a80121a30 con 0x7f1a8011bdd0 2024-08-20T05:13:07.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.281+0000 7f1a7f400640 1 --2- 172.21.15.37:0/2330359068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a8011bdd0 0x7f1a801ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.282+0000 7f1a7ea00640 1 -- 172.21.15.37:0/2330359068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a8011bdd0 msgr2=0x7f1a801ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.282+0000 7f1a7ea00640 1 --2- 172.21.15.37:0/2330359068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a8011bdd0 0x7f1a801ad4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.282+0000 7f1a7ea00640 1 -- 172.21.15.37:0/2330359068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a8010a260 msgr2=0x7f1a801a8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.282+0000 7f1a7ea00640 1 --2- 172.21.15.37:0/2330359068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a8010a260 0x7f1a801a8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.282+0000 7f1a7ea00640 1 -- 172.21.15.37:0/2330359068 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a801adc90 con 0x7f1a80109e80 2024-08-20T05:13:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.282+0000 7f1a7f400640 1 --2- 172.21.15.37:0/2330359068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a8011bdd0 0x7f1a801ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:07.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.282+0000 7f1a7ea00640 1 --2- 172.21.15.37:0/2330359068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a80109e80 0x7f1a801a7be0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1a70030650 tx=0x7f1a70030680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:07.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.283+0000 7f1a77400640 1 -- 172.21.15.37:0/2330359068 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7003f070 con 0x7f1a80109e80 2024-08-20T05:13:07.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.283+0000 7f1a77400640 1 -- 172.21.15.37:0/2330359068 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a70004460 con 0x7f1a80109e80 2024-08-20T05:13:07.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.283+0000 7f1a77400640 1 -- 172.21.15.37:0/2330359068 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70035030 con 0x7f1a80109e80 2024-08-20T05:13:07.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.284+0000 7f1a85800640 1 -- 172.21.15.37:0/2330359068 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a801adf20 con 0x7f1a80109e80 2024-08-20T05:13:07.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.284+0000 7f1a85800640 1 -- 172.21.15.37:0/2330359068 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a801b4640 con 0x7f1a80109e80 2024-08-20T05:13:07.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.286+0000 7f1a85800640 1 -- 172.21.15.37:0/2330359068 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a80074640 con 0x7f1a80109e80 2024-08-20T05:13:07.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.292+0000 7f1a77400640 1 -- 172.21.15.37:0/2330359068 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1a70042070 con 0x7f1a80109e80 2024-08-20T05:13:07.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.296+0000 7f1a77400640 1 --2- 172.21.15.37:0/2330359068 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1a640b3cd0 0x7f1a640b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:07.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.296+0000 7f1a77400640 1 -- 172.21.15.37:0/2330359068 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1a70105010 con 0x7f1a80109e80 2024-08-20T05:13:07.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.296+0000 7f1a77e00640 1 --2- 172.21.15.37:0/2330359068 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1a640b3cd0 0x7f1a640b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:07.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.298+0000 7f1a77e00640 1 --2- 172.21.15.37:0/2330359068 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1a640b3cd0 0x7f1a640b6190 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1a8011e280 tx=0x7f1a6800a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:07.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.298+0000 7f1a77400640 1 -- 172.21.15.37:0/2330359068 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f1a70072070 con 0x7f1a80109e80 2024-08-20T05:13:07.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.734+0000 7f1a85800640 1 -- 172.21.15.37:0/2330359068 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a801a8d10 con 0x7f1a80109e80 2024-08-20T05:13:07.737 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:07 smithi037 ceph-mon[17265]: pgmap v727: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.5 MiB/s wr, 576 op/s 2024-08-20T05:13:07.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.737+0000 7f1a77400640 1 -- 172.21.15.37:0/2330359068 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+11983 (secure 0 0 0) 0x7f1a700cc260 con 0x7f1a80109e80 2024-08-20T05:13:07.741 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:13:07.743 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":46,"btime":"2024-08-20T05:12:39:424100+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":46,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:12:39.106814+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:13:07.744 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 46 2024-08-20T05:13:07.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.744+0000 7f1a85800640 1 -- 172.21.15.37:0/2330359068 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1a640b3cd0 msgr2=0x7f1a640b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:07.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.744+0000 7f1a85800640 1 --2- 172.21.15.37:0/2330359068 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1a640b3cd0 0x7f1a640b6190 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1a8011e280 tx=0x7f1a6800a250 comp rx=0 tx=0).stop 2024-08-20T05:13:07.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.744+0000 7f1a85800640 1 -- 172.21.15.37:0/2330359068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a80109e80 msgr2=0x7f1a801a7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:07.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.744+0000 7f1a85800640 1 --2- 172.21.15.37:0/2330359068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a80109e80 0x7f1a801a7be0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1a70030650 tx=0x7f1a70030680 comp rx=0 tx=0).stop 2024-08-20T05:13:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.746+0000 7f1a85800640 1 -- 172.21.15.37:0/2330359068 shutdown_connections 2024-08-20T05:13:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.746+0000 7f1a85800640 1 --2- 172.21.15.37:0/2330359068 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1a640b3cd0 0x7f1a640b6190 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.746+0000 7f1a85800640 1 --2- 172.21.15.37:0/2330359068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1a8011bdd0 0x7f1a801ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.746+0000 7f1a85800640 1 --2- 172.21.15.37:0/2330359068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a8010a260 0x7f1a801a8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.746+0000 7f1a85800640 1 --2- 172.21.15.37:0/2330359068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1a80109e80 0x7f1a801a7be0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.746+0000 7f1a85800640 1 -- 172.21.15.37:0/2330359068 >> 172.21.15.37:0/2330359068 conn(0x7f1a8006dcc0 msgr2=0x7f1a8011c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.747+0000 7f1a85800640 1 -- 172.21.15.37:0/2330359068 shutdown_connections 2024-08-20T05:13:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:07.747+0000 7f1a85800640 1 -- 172.21.15.37:0/2330359068 wait complete. 2024-08-20T05:13:07.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:07 smithi135 ceph-mon[22342]: pgmap v727: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.5 MiB/s wr, 576 op/s 2024-08-20T05:13:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:07 smithi130 ceph-mon[22007]: pgmap v727: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.5 MiB/s wr, 576 op/s 2024-08-20T05:13:08.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 610.0 s, 595.6 tps, lat 168.271 ms stddev 223.375 2024-08-20T05:13:08.485 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:08 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2330359068' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:13:08.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T05:13:08.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:08 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2330359068' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:13:08.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:08 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2330359068' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:13:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:13:09.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:09 smithi037 ceph-mon[17265]: pgmap v728: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.7 MiB/s wr, 504 op/s 2024-08-20T05:13:09.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:09 smithi135 ceph-mon[22342]: pgmap v728: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.7 MiB/s wr, 504 op/s 2024-08-20T05:13:09.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:09 smithi130 ceph-mon[22007]: pgmap v728: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.7 MiB/s wr, 504 op/s 2024-08-20T05:13:10.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.309+0000 7f70f6200640 1 -- 172.21.15.37:0/2183524174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f0102a90 msgr2=0x7f70f0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:10.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.309+0000 7f70f6200640 1 --2- 172.21.15.37:0/2183524174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f0102a90 0x7f70f0102e70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009860 tx=0x7f70e002a340 comp rx=0 tx=0).stop 2024-08-20T05:13:10.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.311+0000 7f70f6200640 1 -- 172.21.15.37:0/2183524174 shutdown_connections 2024-08-20T05:13:10.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.311+0000 7f70f6200640 1 --2- 172.21.15.37:0/2183524174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70f0108e20 0x7f70f010f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.311+0000 7f70f6200640 1 --2- 172.21.15.37:0/2183524174 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f01084a0 0x7f70f01088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.311+0000 7f70f6200640 1 --2- 172.21.15.37:0/2183524174 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f0102a90 0x7f70f0102e70 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.311+0000 7f70f6200640 1 -- 172.21.15.37:0/2183524174 >> 172.21.15.37:0/2183524174 conn(0x7f70f00fe540 msgr2=0x7f70f0100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:10.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.311+0000 7f70f6200640 1 -- 172.21.15.37:0/2183524174 shutdown_connections 2024-08-20T05:13:10.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.311+0000 7f70f6200640 1 -- 172.21.15.37:0/2183524174 wait complete. 2024-08-20T05:13:10.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.312+0000 7f70f6200640 1 Processor -- start 2024-08-20T05:13:10.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.313+0000 7f70f6200640 1 -- start start 2024-08-20T05:13:10.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.313+0000 7f70f6200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f0102a90 0x7f70f010e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.313+0000 7f70f6200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70f01084a0 0x7f70f010ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.314+0000 7f70ef400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f0102a90 0x7f70f010e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:10.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.314+0000 7f70f6200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f0108e20 0x7f70f01a1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.314+0000 7f70f6200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70f0112b30 con 0x7f70f01084a0 2024-08-20T05:13:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.314+0000 7f70f6200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70f01129b0 con 0x7f70f0108e20 2024-08-20T05:13:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.314+0000 7f70f6200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70f0112cb0 con 0x7f70f0102a90 2024-08-20T05:13:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.314+0000 7f70e7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70f01084a0 0x7f70f010ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.314+0000 7f70e7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70f01084a0 0x7f70f010ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53090/0 (socket says 172.21.15.37:53090) 2024-08-20T05:13:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.314+0000 7f70e7e00640 1 -- 172.21.15.37:0/2457213252 learned_addr learned my addr 172.21.15.37:0/2457213252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.314+0000 7f70efe00640 1 --2- 172.21.15.37:0/2457213252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f0108e20 0x7f70f01a1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:10.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.315+0000 7f70e7e00640 1 -- 172.21.15.37:0/2457213252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f0102a90 msgr2=0x7f70f010e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.315+0000 7f70e7e00640 1 --2- 172.21.15.37:0/2457213252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f0102a90 0x7f70f010e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.315+0000 7f70e7e00640 1 -- 172.21.15.37:0/2457213252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f0108e20 msgr2=0x7f70f01a1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.315+0000 7f70e7e00640 1 --2- 172.21.15.37:0/2457213252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f0108e20 0x7f70f01a1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.315+0000 7f70e7e00640 1 -- 172.21.15.37:0/2457213252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f01a2490 con 0x7f70f01084a0 2024-08-20T05:13:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.316+0000 7f70e7e00640 1 --2- 172.21.15.37:0/2457213252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70f01084a0 0x7f70f010ed20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f70d800e9c0 tx=0x7f70d800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:10.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.316+0000 7f70ecc00640 1 -- 172.21.15.37:0/2457213252 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d800ccc0 con 0x7f70f01084a0 2024-08-20T05:13:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.317+0000 7f70ecc00640 1 -- 172.21.15.37:0/2457213252 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70d80054d0 con 0x7f70f01084a0 2024-08-20T05:13:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.317+0000 7f70f6200640 1 -- 172.21.15.37:0/2457213252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f01a2780 con 0x7f70f01084a0 2024-08-20T05:13:10.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.317+0000 7f70ecc00640 1 -- 172.21.15.37:0/2457213252 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d8010430 con 0x7f70f01084a0 2024-08-20T05:13:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.318+0000 7f70f6200640 1 -- 172.21.15.37:0/2457213252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f01ac250 con 0x7f70f01084a0 2024-08-20T05:13:10.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.323+0000 7f70f8dd2740 1 Processor -- start 2024-08-20T05:13:10.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.324+0000 7f70f8dd2740 1 -- start start 2024-08-20T05:13:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.324+0000 7f70f8dd2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f415940 0x55b72f415d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.324+0000 7f70f8dd2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f416260 0x55b72f421cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.324+0000 7f70f8dd2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f4221f0 0x55b72f4245e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.324+0000 7f70f8dd2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b72f38baa0 con 0x55b72f416260 2024-08-20T05:13:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.324+0000 7f70f8dd2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b72f37afa0 con 0x55b72f4221f0 2024-08-20T05:13:10.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.324+0000 7f70f8dd2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b72f37efe0 con 0x55b72f415940 2024-08-20T05:13:10.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.325+0000 7f70ecc00640 1 -- 172.21.15.37:0/2457213252 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f70d8004f80 con 0x7f70f01084a0 2024-08-20T05:13:10.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.325+0000 7f70e7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f4221f0 0x55b72f4245e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:10.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.325+0000 7f70e7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f4221f0 0x55b72f4245e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53290/0 (socket says 172.21.15.37:53290) 2024-08-20T05:13:10.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.326+0000 7f70e7e00640 1 -- 172.21.15.37:0/2917496384 learned_addr learned my addr 172.21.15.37:0/2917496384 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:10.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.326+0000 7f70efe00640 1 --2- 172.21.15.37:0/2917496384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f415940 0x55b72f415d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.326+0000 7f70e7e00640 1 -- 172.21.15.37:0/2917496384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f415940 msgr2=0x55b72f415d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.326+0000 7f70e7e00640 1 --2- 172.21.15.37:0/2917496384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f415940 0x55b72f415d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.326+0000 7f70ef400640 1 --2- 172.21.15.37:0/2917496384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f416260 0x55b72f421cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.326+0000 7f70e7e00640 1 -- 172.21.15.37:0/2917496384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f416260 msgr2=0x55b72f421cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.326+0000 7f70e7e00640 1 --2- 172.21.15.37:0/2917496384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f416260 0x55b72f421cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.326+0000 7f70e7e00640 1 -- 172.21.15.37:0/2917496384 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b72f321420 con 0x55b72f4221f0 2024-08-20T05:13:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.327+0000 7f70efe00640 1 --2- 172.21.15.37:0/2917496384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f415940 0x55b72f415d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.327+0000 7f70ef400640 1 --2- 172.21.15.37:0/2917496384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f416260 0x55b72f421cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.327+0000 7f70ecc00640 1 --2- 172.21.15.37:0/2457213252 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70d40b3d10 0x7f70d40b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.328+0000 7f70ecc00640 1 -- 172.21.15.37:0/2457213252 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f70d80e41c0 con 0x7f70f01084a0 2024-08-20T05:13:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.328+0000 7f70e7e00640 1 --2- 172.21.15.37:0/2917496384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f4221f0 0x55b72f4245e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f70d80ec190 tx=0x7f70d80ec280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70d6b3667bdf0b1e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.328+0000 7f70efe00640 1 --2- 172.21.15.37:0/2457213252 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70d40b3d10 0x7f70d40b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.328+0000 7f70dfe00640 1 -- 172.21.15.37:0/2917496384 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d80a6bd0 con 0x55b72f4221f0 2024-08-20T05:13:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.328+0000 7f70dfe00640 1 -- 172.21.15.37:0/2917496384 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70d80aa820 con 0x55b72f4221f0 2024-08-20T05:13:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.328+0000 7f70dfe00640 1 -- 172.21.15.37:0/2917496384 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d800ce60 con 0x55b72f4221f0 2024-08-20T05:13:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.330+0000 7f70f8dd2740 1 -- 172.21.15.37:0/2917496384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f4221f0 msgr2=0x55b72f4245e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.330+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/2917496384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f4221f0 0x55b72f4245e0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f70d80ec190 tx=0x7f70d80ec280 comp rx=0 tx=0).stop 2024-08-20T05:13:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.330+0000 7f70efe00640 1 --2- 172.21.15.37:0/2457213252 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70d40b3d10 0x7f70d40b61d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f70e800a510 tx=0x7f70e8009650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.330+0000 7f70f8dd2740 1 -- 172.21.15.37:0/2917496384 shutdown_connections 2024-08-20T05:13:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.330+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/2917496384 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f4221f0 0x55b72f4245e0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.330+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/2917496384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f416260 0x55b72f421cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.330+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/2917496384 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f415940 0x55b72f415d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.330+0000 7f70f8dd2740 1 -- 172.21.15.37:0/2917496384 >> 172.21.15.37:0/2917496384 conn(0x55b72f413770 msgr2=0x55b72f414910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.330+0000 7f70f8dd2740 1 -- 172.21.15.37:0/2917496384 shutdown_connections 2024-08-20T05:13:10.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.330+0000 7f70f8dd2740 1 -- 172.21.15.37:0/2917496384 wait complete. 2024-08-20T05:13:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.331+0000 7f70f8dd2740 1 -- start start 2024-08-20T05:13:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.331+0000 7f70f8dd2740 1 Processor -- start 2024-08-20T05:13:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.332+0000 7f70f8dd2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f415940 0x55b72f4219c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.332+0000 7f70f8dd2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f416260 0x55b72f41ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.332+0000 7f70f8dd2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f4221f0 0x55b72f41f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.332+0000 7f70f8dd2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b72f1dd700 con 0x55b72f4221f0 2024-08-20T05:13:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.332+0000 7f70f8dd2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b72f316290 con 0x55b72f415940 2024-08-20T05:13:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.332+0000 7f70f8dd2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b72f435e80 con 0x55b72f416260 2024-08-20T05:13:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.332+0000 7f70f8dd2740 10 client.0 _ll_register_callbacks cb 0x55b72f3751c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:10.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.333+0000 7f70ef400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f415940 0x55b72f4219c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.333+0000 7f70ef400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f415940 0x55b72f4219c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53306/0 (socket says 172.21.15.37:53306) 2024-08-20T05:13:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.333+0000 7f70ef400640 1 -- 172.21.15.37:0/1935064351 learned_addr learned my addr 172.21.15.37:0/1935064351 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.333+0000 7f70e7e00640 1 --2- 172.21.15.37:0/1935064351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f416260 0x55b72f41ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.334+0000 7f70efe00640 1 --2- 172.21.15.37:0/1935064351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f4221f0 0x55b72f41f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.334+0000 7f70ef400640 1 -- 172.21.15.37:0/1935064351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f416260 msgr2=0x55b72f41ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.334+0000 7f70ef400640 1 --2- 172.21.15.37:0/1935064351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f416260 0x55b72f41ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.334+0000 7f70ef400640 1 -- 172.21.15.37:0/1935064351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f4221f0 msgr2=0x55b72f41f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:10.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.334+0000 7f70ef400640 1 --2- 172.21.15.37:0/1935064351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f4221f0 0x55b72f41f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.334+0000 7f70ef400640 1 -- 172.21.15.37:0/1935064351 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b72f0da650 con 0x55b72f415940 2024-08-20T05:13:10.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.336+0000 7f70ef400640 1 --2- 172.21.15.37:0/1935064351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f415940 0x55b72f4219c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f70e002a930 tx=0x7f70e002cf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8615e59af6d504e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:10.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.336+0000 7f70dcc00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:13:10.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.336+0000 7f70dcc00640 1 -- 172.21.15.37:0/1935064351 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0037040 con 0x55b72f415940 2024-08-20T05:13:10.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.336+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1935064351 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70d80aa820 con 0x55b72f415940 2024-08-20T05:13:10.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.337+0000 7f70dcc00640 1 -- 172.21.15.37:0/1935064351 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f70e0004040 con 0x55b72f415940 2024-08-20T05:13:10.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.337+0000 7f70dcc00640 1 -- 172.21.15.37:0/1935064351 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f70e004d050 con 0x55b72f415940 2024-08-20T05:13:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.338+0000 7f70f8dd2740 10 client.28139 fetch_fsmap learned FSMap version 46 2024-08-20T05:13:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.338+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1935064351 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55b72f441650 con 0x55b72f415940 2024-08-20T05:13:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.338+0000 7f70dcc00640 1 -- 172.21.15.37:0/1935064351 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70d80aa820 con 0x55b72f415940 2024-08-20T05:13:10.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.339+0000 7f70dcc00640 1 -- 172.21.15.37:0/1935064351 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 46) ==== 8378+0+0 (secure 0 0 0) 0x7f70e0005260 con 0x55b72f415940 2024-08-20T05:13:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.339+0000 7f70f8dd2740 10 client.28139 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T05:13:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.339+0000 7f70f8dd2740 10 client.28139 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:13:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.339+0000 7f70f8dd2740 20 client.28139 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:10.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.339+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/1935064351 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55b72f442ad0 0x55b72f444ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.340+0000 7f70f8dd2740 4 client.28139 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:13:10.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.340+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1935064351 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b72f38d9f0 con 0x55b72f442ad0 2024-08-20T05:13:10.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.347+0000 7f70e7e00640 1 --2- 172.21.15.37:0/1935064351 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55b72f442ad0 0x55b72f444ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.348+0000 7f70e7e00640 1 --2- 172.21.15.37:0/1935064351 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55b72f442ad0 0x55b72f444ec0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fe7e0d909164f619 server_cookie=e6f9c7ac9564bc6c in_seq=0 out_seq=0 2024-08-20T05:13:10.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.348+0000 7f70dcc00640 10 client.28139 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:13:10.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.352+0000 7f70dcc00640 1 -- 172.21.15.37:0/1935064351 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b72f38d9f0 con 0x55b72f442ad0 2024-08-20T05:13:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.352+0000 7f70dcc00640 10 client.28139 handle_command_reply: tid=0 2024-08-20T05:13:10.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.352+0000 7f70f8dd2740 1 client.28139 shutdown 2024-08-20T05:13:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.354+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1935064351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f415940 msgr2=0x55b72f4219c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.354+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/1935064351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f415940 0x55b72f4219c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f70e002a930 tx=0x7f70e002cf40 comp rx=0 tx=0).stop 2024-08-20T05:13:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.354+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1935064351 shutdown_connections 2024-08-20T05:13:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.354+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/1935064351 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55b72f442ad0 0x55b72f444ec0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.354+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/1935064351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f4221f0 0x55b72f41f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.354+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/1935064351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f416260 0x55b72f41ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.354+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/1935064351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f415940 0x55b72f4219c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.354+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1935064351 >> 172.21.15.37:0/1935064351 conn(0x55b72f413770 msgr2=0x55b72f419310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.355+0000 7f70dcc00640 0 client.28139 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:13:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.355+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1935064351 shutdown_connections 2024-08-20T05:13:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.355+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1935064351 wait complete. 2024-08-20T05:13:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.356+0000 7f70f8dd2740 20 client.28139 trim_cache size 0 max 16384 2024-08-20T05:13:10.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.386+0000 7f70f8dd2740 1 Processor -- start 2024-08-20T05:13:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.390+0000 7f70f8dd2740 1 -- start start 2024-08-20T05:13:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.390+0000 7f70f8dd2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f413770 0x55b72f43efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.391+0000 7f70f8dd2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f415940 0x55b72f44a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.391+0000 7f70f8dd2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f416260 0x55b72f44ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.391+0000 7f70f8dd2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70f01ad720 con 0x55b72f416260 2024-08-20T05:13:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.391+0000 7f70f8dd2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70f01af260 con 0x55b72f415940 2024-08-20T05:13:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.391+0000 7f70f8dd2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70f01addf0 con 0x55b72f413770 2024-08-20T05:13:10.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.392+0000 7f70e7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f415940 0x55b72f44a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.392+0000 7f70e7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f415940 0x55b72f44a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53320/0 (socket says 172.21.15.37:53320) 2024-08-20T05:13:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.392+0000 7f70e7e00640 1 -- 172.21.15.37:0/1085625134 learned_addr learned my addr 172.21.15.37:0/1085625134 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:10.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.392+0000 7f70ef400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f413770 0x55b72f43efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.392+0000 7f70e7e00640 1 -- 172.21.15.37:0/1085625134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f413770 msgr2=0x55b72f43efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.392+0000 7f70e7e00640 1 --2- 172.21.15.37:0/1085625134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f413770 0x55b72f43efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.392+0000 7f70e7e00640 1 -- 172.21.15.37:0/1085625134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f416260 msgr2=0x55b72f44ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.392+0000 7f70e7e00640 1 --2- 172.21.15.37:0/1085625134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f416260 0x55b72f44ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.393+0000 7f70e7e00640 1 -- 172.21.15.37:0/1085625134 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b72f421d30 con 0x55b72f415940 2024-08-20T05:13:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.393+0000 7f70e7e00640 1 --2- 172.21.15.37:0/1085625134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f415940 0x55b72f44a7e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f70d80a6d90 tx=0x7f70d80094c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e94cfa6b5468e55f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:10.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.393+0000 7f70df400640 1 -- 172.21.15.37:0/1085625134 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d80aa480 con 0x55b72f415940 2024-08-20T05:13:10.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.394+0000 7f70df400640 1 -- 172.21.15.37:0/1085625134 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70d80aa820 con 0x55b72f415940 2024-08-20T05:13:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.394+0000 7f70df400640 1 -- 172.21.15.37:0/1085625134 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70d80aa660 con 0x55b72f415940 2024-08-20T05:13:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.395+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1085625134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f415940 msgr2=0x55b72f44a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.395+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/1085625134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f415940 0x55b72f44a7e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f70d80a6d90 tx=0x7f70d80094c0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.395+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1085625134 shutdown_connections 2024-08-20T05:13:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.395+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/1085625134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f416260 0x55b72f44ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.395+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/1085625134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f415940 0x55b72f44a7e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.395+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/1085625134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f413770 0x55b72f43efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.395+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1085625134 >> 172.21.15.37:0/1085625134 conn(0x55b72f415050 msgr2=0x55b72f41a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.396+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1085625134 shutdown_connections 2024-08-20T05:13:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.396+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1085625134 wait complete. 2024-08-20T05:13:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.396+0000 7f70f8dd2740 1 -- start start 2024-08-20T05:13:10.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.397+0000 7f70f8dd2740 1 Processor -- start 2024-08-20T05:13:10.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.398+0000 7f70f8dd2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f413770 0x55b72f43b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.399+0000 7f70f8dd2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f415940 0x55b72f436d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.399+0000 7f70ef400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f413770 0x55b72f43b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.399+0000 7f70ef400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f413770 0x55b72f43b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53110/0 (socket says 172.21.15.37:53110) 2024-08-20T05:13:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.399+0000 7f70f8dd2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f416260 0x55b72f437300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.399+0000 7f70ef400640 1 -- 172.21.15.37:0/1246875428 learned_addr learned my addr 172.21.15.37:0/1246875428 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.399+0000 7f70f8dd2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f70f01aeb90 con 0x55b72f413770 2024-08-20T05:13:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.399+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1246875428 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f70f01ae4c0 con 0x55b72f416260 2024-08-20T05:13:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.399+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1246875428 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f70f0074390 con 0x55b72f415940 2024-08-20T05:13:10.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.399+0000 7f70e7e00640 1 --2- 172.21.15.37:0/1246875428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f415940 0x55b72f436d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:10.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.400+0000 7f70f8dd2740 10 client.0 _ll_register_callbacks cb 0x7f70d8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:10.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.400+0000 7f70efe00640 1 --2- 172.21.15.37:0/1246875428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f416260 0x55b72f437300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:10.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.400+0000 7f70ef400640 1 -- 172.21.15.37:0/1246875428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f415940 msgr2=0x55b72f436d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:10.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.400+0000 7f70ef400640 1 --2- 172.21.15.37:0/1246875428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f415940 0x55b72f436d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.400+0000 7f70ef400640 1 -- 172.21.15.37:0/1246875428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f416260 msgr2=0x55b72f437300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:10.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.400+0000 7f70ef400640 1 --2- 172.21.15.37:0/1246875428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f416260 0x55b72f437300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.400+0000 7f70ef400640 1 -- 172.21.15.37:0/1246875428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b72f437b30 con 0x55b72f413770 2024-08-20T05:13:10.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.400+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1246875428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70d80aa820 con 0x55b72f413770 2024-08-20T05:13:10.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.401+0000 7f70ef400640 1 --2- 172.21.15.37:0/1246875428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f413770 0x55b72f43b850 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f70e00309f0 tx=0x7f70e002cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6c2753af64d018 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:10.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.401+0000 7f70dcc00640 10 client.17619 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:13:10.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.402+0000 7f70dcc00640 1 -- 172.21.15.37:0/1246875428 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e005f050 con 0x55b72f413770 2024-08-20T05:13:10.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.402+0000 7f70dcc00640 1 -- 172.21.15.37:0/1246875428 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f70e0004fa0 con 0x55b72f413770 2024-08-20T05:13:10.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.402+0000 7f70dcc00640 1 -- 172.21.15.37:0/1246875428 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f70e0037040 con 0x55b72f413770 2024-08-20T05:13:10.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.402+0000 7f70f8dd2740 10 client.17619 fetch_fsmap learned FSMap version 46 2024-08-20T05:13:10.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.402+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1246875428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=46}) -- 0x55b72f4ad800 con 0x55b72f413770 2024-08-20T05:13:10.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.404+0000 7f70dcc00640 1 -- 172.21.15.37:0/1246875428 <== mon.0 v2:172.21.15.37:3300/0 4 ==== fsmap(e 46) ==== 8378+0+0 (secure 0 0 0) 0x7f70e0005200 con 0x55b72f413770 2024-08-20T05:13:10.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.404+0000 7f70f8dd2740 10 client.17619 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T05:13:10.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.404+0000 7f70f8dd2740 10 client.17619 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:13:10.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.404+0000 7f70f8dd2740 20 client.17619 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:10.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.404+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/1246875428 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55b72f4221f0 0x55b72f4afe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:10.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.404+0000 7f70f8dd2740 4 client.17619 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:13:10.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.404+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1246875428 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b72f389490 con 0x55b72f4221f0 2024-08-20T05:13:10.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.405+0000 7f70e7e00640 1 --2- 172.21.15.37:0/1246875428 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55b72f4221f0 0x55b72f4afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:10.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.406+0000 7f70e7e00640 1 --2- 172.21.15.37:0/1246875428 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55b72f4221f0 0x55b72f4afe00 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6137e24832f3ecc7 server_cookie=14b80f3d2d00f589 in_seq=0 out_seq=0 2024-08-20T05:13:10.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.406+0000 7f70dcc00640 10 client.17619 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:13:10.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.407+0000 7f70dcc00640 1 -- 172.21.15.37:0/1246875428 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b72f389490 con 0x55b72f4221f0 2024-08-20T05:13:10.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.407+0000 7f70dcc00640 10 client.17619 handle_command_reply: tid=0 2024-08-20T05:13:10.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.407+0000 7f70f8dd2740 1 client.17619 shutdown 2024-08-20T05:13:10.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.407+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1246875428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f413770 msgr2=0x55b72f43b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:10.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.407+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/1246875428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f413770 0x55b72f43b850 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f70e00309f0 tx=0x7f70e002cfd0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.407+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1246875428 shutdown_connections 2024-08-20T05:13:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.407+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/1246875428 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55b72f4221f0 0x55b72f4afe00 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.407+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/1246875428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b72f416260 0x55b72f437300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.407+0000 7f70dcc00640 0 client.17619 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:13:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.407+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/1246875428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b72f415940 0x55b72f436d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.407+0000 7f70f8dd2740 1 --2- 172.21.15.37:0/1246875428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b72f413770 0x55b72f43b850 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.407+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1246875428 >> 172.21.15.37:0/1246875428 conn(0x55b72f415050 msgr2=0x55b72f412030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.408+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1246875428 shutdown_connections 2024-08-20T05:13:10.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.408+0000 7f70f8dd2740 1 -- 172.21.15.37:0/1246875428 wait complete. 2024-08-20T05:13:10.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.408+0000 7f70f8dd2740 20 client.17619 trim_cache size 0 max 16384 2024-08-20T05:13:10.411 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:13:10.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.409+0000 7f70f6200640 1 -- 172.21.15.37:0/2457213252 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70d40b3d10 msgr2=0x7f70d40b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:10.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.409+0000 7f70f6200640 1 --2- 172.21.15.37:0/2457213252 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70d40b3d10 0x7f70d40b61d0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f70e800a510 tx=0x7f70e8009650 comp rx=0 tx=0).stop 2024-08-20T05:13:10.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.409+0000 7f70f6200640 1 -- 172.21.15.37:0/2457213252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70f01084a0 msgr2=0x7f70f010ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:10.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.409+0000 7f70f6200640 1 --2- 172.21.15.37:0/2457213252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70f01084a0 0x7f70f010ed20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f70d800e9c0 tx=0x7f70d800ee80 comp rx=0 tx=0).stop 2024-08-20T05:13:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.411+0000 7f70f6200640 1 -- 172.21.15.37:0/2457213252 shutdown_connections 2024-08-20T05:13:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.411+0000 7f70f6200640 1 --2- 172.21.15.37:0/2457213252 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f70d40b3d10 0x7f70d40b61d0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.411+0000 7f70f6200640 1 --2- 172.21.15.37:0/2457213252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f70f0108e20 0x7f70f01a1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.411+0000 7f70f6200640 1 --2- 172.21.15.37:0/2457213252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70f01084a0 0x7f70f010ed20 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.411+0000 7f70f6200640 1 --2- 172.21.15.37:0/2457213252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f70f0102a90 0x7f70f010e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.411+0000 7f70f6200640 1 -- 172.21.15.37:0/2457213252 >> 172.21.15.37:0/2457213252 conn(0x7f70f00fe540 msgr2=0x7f70f0104a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.411+0000 7f70f6200640 1 -- 172.21.15.37:0/2457213252 shutdown_connections 2024-08-20T05:13:10.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:10.411+0000 7f70f6200640 1 -- 172.21.15.37:0/2457213252 wait complete. 2024-08-20T05:13:11.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:11 smithi037 ceph-mon[17265]: pgmap v729: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.7 MiB/s wr, 588 op/s 2024-08-20T05:13:11.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:11 smithi135 ceph-mon[22342]: pgmap v729: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.7 MiB/s wr, 588 op/s 2024-08-20T05:13:11.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:11 smithi130 ceph-mon[22007]: pgmap v729: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.7 MiB/s wr, 588 op/s 2024-08-20T05:13:13.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 615.0 s, 502.0 tps, lat 201.263 ms stddev 231.851 2024-08-20T05:13:13.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:13 smithi037 ceph-mon[17265]: pgmap v730: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.4 MiB/s wr, 445 op/s 2024-08-20T05:13:13.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T05:13:13.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:13 smithi135 ceph-mon[22342]: pgmap v730: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.4 MiB/s wr, 445 op/s 2024-08-20T05:13:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:13 smithi130 ceph-mon[22007]: pgmap v730: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 6.4 MiB/s wr, 445 op/s 2024-08-20T05:13:14.474 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:13:15.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:15 smithi037 ceph-mon[17265]: pgmap v731: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.0 MiB/s wr, 577 op/s 2024-08-20T05:13:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:15 smithi135 ceph-mon[22342]: pgmap v731: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.0 MiB/s wr, 577 op/s 2024-08-20T05:13:15.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:15 smithi130 ceph-mon[22007]: pgmap v731: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.0 MiB/s wr, 577 op/s 2024-08-20T05:13:16.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.186+0000 7f1e80200640 1 -- 172.21.15.37:0/3060031680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e7810a900 msgr2=0x7f1e7810b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.186+0000 7f1e80200640 1 --2- 172.21.15.37:0/3060031680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e7810a900 0x7f1e7810b0c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1e70009ca0 tx=0x7f1e7002a8f0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.186+0000 7f1e80200640 1 -- 172.21.15.37:0/3060031680 shutdown_connections 2024-08-20T05:13:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.186+0000 7f1e80200640 1 --2- 172.21.15.37:0/3060031680 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e7810a900 0x7f1e7810b0c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.186+0000 7f1e80200640 1 --2- 172.21.15.37:0/3060031680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e780746f0 0x7f1e7810a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.186+0000 7f1e80200640 1 --2- 172.21.15.37:0/3060031680 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e780742f0 0x7f1e78109e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.186+0000 7f1e80200640 1 -- 172.21.15.37:0/3060031680 >> 172.21.15.37:0/3060031680 conn(0x7f1e7806f740 msgr2=0x7f1e78071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.186+0000 7f1e80200640 1 -- 172.21.15.37:0/3060031680 shutdown_connections 2024-08-20T05:13:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.186+0000 7f1e80200640 1 -- 172.21.15.37:0/3060031680 wait complete. 2024-08-20T05:13:16.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.188+0000 7f1e80200640 1 Processor -- start 2024-08-20T05:13:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.188+0000 7f1e80200640 1 -- start start 2024-08-20T05:13:16.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.188+0000 7f1e80200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e780742f0 0x7f1e781a3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.188+0000 7f1e80200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e780746f0 0x7f1e781a3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.189+0000 7f1e80200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e7810a900 0x7f1e781a4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.189+0000 7f1e80200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e78118e10 con 0x7f1e780746f0 2024-08-20T05:13:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.189+0000 7f1e80200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1e78118c90 con 0x7f1e7810a900 2024-08-20T05:13:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.189+0000 7f1e80200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1e78118f90 con 0x7f1e780742f0 2024-08-20T05:13:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.189+0000 7f1e7e200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e7810a900 0x7f1e781a4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.189+0000 7f1e7d800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e780742f0 0x7f1e781a3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.189+0000 7f1e7e200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e7810a900 0x7f1e781a4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43850/0 (socket says 172.21.15.37:43850) 2024-08-20T05:13:16.191 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.189+0000 7f1e7e200640 1 -- 172.21.15.37:0/915139320 learned_addr learned my addr 172.21.15.37:0/915139320 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.189+0000 7f1e7ce00640 1 --2- 172.21.15.37:0/915139320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e780746f0 0x7f1e781a3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.190+0000 7f1e7e200640 1 -- 172.21.15.37:0/915139320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e780742f0 msgr2=0x7f1e781a3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.190+0000 7f1e7e200640 1 --2- 172.21.15.37:0/915139320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e780742f0 0x7f1e781a3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.190+0000 7f1e7e200640 1 -- 172.21.15.37:0/915139320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e780746f0 msgr2=0x7f1e781a3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.190+0000 7f1e7e200640 1 --2- 172.21.15.37:0/915139320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e780746f0 0x7f1e781a3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.190+0000 7f1e7e200640 1 -- 172.21.15.37:0/915139320 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e781a50d0 con 0x7f1e7810a900 2024-08-20T05:13:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.191+0000 7f1e7e200640 1 --2- 172.21.15.37:0/915139320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e7810a900 0x7f1e781a4810 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1e70006010 tx=0x7f1e7002f870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.193+0000 7f1e76000640 1 -- 172.21.15.37:0/915139320 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7002fdf0 con 0x7f1e7810a900 2024-08-20T05:13:16.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.193+0000 7f1e76000640 1 -- 172.21.15.37:0/915139320 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e7002d070 con 0x7f1e7810a900 2024-08-20T05:13:16.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.193+0000 7f1e76000640 1 -- 172.21.15.37:0/915139320 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e7003b820 con 0x7f1e7810a900 2024-08-20T05:13:16.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.194+0000 7f1e80200640 1 -- 172.21.15.37:0/915139320 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e781a5360 con 0x7f1e7810a900 2024-08-20T05:13:16.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.194+0000 7f1e80200640 1 -- 172.21.15.37:0/915139320 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e781aba90 con 0x7f1e7810a900 2024-08-20T05:13:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.202+0000 7f1e83045740 1 Processor -- start 2024-08-20T05:13:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.203+0000 7f1e76000640 1 -- 172.21.15.37:0/915139320 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1e70030b30 con 0x7f1e7810a900 2024-08-20T05:13:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.206+0000 7f1e76000640 1 --2- 172.21.15.37:0/915139320 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e600b3d20 0x7f1e600b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.206+0000 7f1e76000640 1 -- 172.21.15.37:0/915139320 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1e70104f70 con 0x7f1e7810a900 2024-08-20T05:13:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.207+0000 7f1e7ce00640 1 --2- 172.21.15.37:0/915139320 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e600b3d20 0x7f1e600b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.207+0000 7f1e83045740 1 -- start start 2024-08-20T05:13:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.208+0000 7f1e83045740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc25610 0x55ec5fc27a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.208+0000 7f1e83045740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc27f40 0x55ec5fc2a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.208+0000 7f1e83045740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc2ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.208+0000 7f1e83045740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ec5fb98210 con 0x55ec5fc25610 2024-08-20T05:13:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.208+0000 7f1e83045740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ec5fb87710 con 0x55ec5fc2a980 2024-08-20T05:13:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.208+0000 7f1e83045740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ec5fb8b750 con 0x55ec5fc27f40 2024-08-20T05:13:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.208+0000 7f1e7ce00640 1 --2- 172.21.15.37:0/915139320 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e600b3d20 0x7f1e600b61e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009990 tx=0x7f1e64009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.209+0000 7f1e7e200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc2ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.209+0000 7f1e7d800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc25610 0x55ec5fc27a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.209+0000 7f1e7e200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc2ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43856/0 (socket says 172.21.15.37:43856) 2024-08-20T05:13:16.212 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.209+0000 7f1e7e200640 1 -- 172.21.15.37:0/3679091186 learned_addr learned my addr 172.21.15.37:0/3679091186 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.209+0000 7f1e7e200640 1 -- 172.21.15.37:0/3679091186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc27f40 msgr2=0x55ec5fc2a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.209+0000 7f1e7e200640 1 --2- 172.21.15.37:0/3679091186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc27f40 0x55ec5fc2a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.209+0000 7f1e7e200640 1 -- 172.21.15.37:0/3679091186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc25610 msgr2=0x55ec5fc27a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.209+0000 7f1e7e200640 1 --2- 172.21.15.37:0/3679091186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc25610 0x55ec5fc27a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.209+0000 7f1e7e200640 1 -- 172.21.15.37:0/3679091186 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec5fb53de0 con 0x55ec5fc2a980 2024-08-20T05:13:16.213 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.210+0000 7f1e7e200640 1 --2- 172.21.15.37:0/3679091186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc2ce40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1e700c8d90 tx=0x7f1e7002a8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=284ed2fe7cc1e5b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.210+0000 7f1e6aa00640 1 -- 172.21.15.37:0/3679091186 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e700cee60 con 0x55ec5fc2a980 2024-08-20T05:13:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.210+0000 7f1e6aa00640 1 -- 172.21.15.37:0/3679091186 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e700cce50 con 0x55ec5fc2a980 2024-08-20T05:13:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.210+0000 7f1e6aa00640 1 -- 172.21.15.37:0/3679091186 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e700c7db0 con 0x55ec5fc2a980 2024-08-20T05:13:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.211+0000 7f1e83045740 1 -- 172.21.15.37:0/3679091186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 msgr2=0x55ec5fc2ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.211+0000 7f1e83045740 1 --2- 172.21.15.37:0/3679091186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc2ce40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1e700c8d90 tx=0x7f1e7002a8f0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.211+0000 7f1e83045740 1 -- 172.21.15.37:0/3679091186 shutdown_connections 2024-08-20T05:13:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.211+0000 7f1e83045740 1 --2- 172.21.15.37:0/3679091186 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc2ce40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.211+0000 7f1e83045740 1 --2- 172.21.15.37:0/3679091186 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc27f40 0x55ec5fc2a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.211+0000 7f1e83045740 1 --2- 172.21.15.37:0/3679091186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc25610 0x55ec5fc27a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.211+0000 7f1e83045740 1 -- 172.21.15.37:0/3679091186 >> 172.21.15.37:0/3679091186 conn(0x55ec5fc20760 msgr2=0x55ec5fc214f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:16.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.213+0000 7f1e83045740 1 -- 172.21.15.37:0/3679091186 shutdown_connections 2024-08-20T05:13:16.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.213+0000 7f1e83045740 1 -- 172.21.15.37:0/3679091186 wait complete. 2024-08-20T05:13:16.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.213+0000 7f1e83045740 1 -- start start 2024-08-20T05:13:16.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.216+0000 7f1e83045740 1 Processor -- start 2024-08-20T05:13:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.216+0000 7f1e83045740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc25610 0x55ec5fc2e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.216+0000 7f1e83045740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc27f40 0x55ec5fc2f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.216+0000 7f1e83045740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc2fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.216+0000 7f1e83045740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ec5fac0ab0 con 0x55ec5fc27f40 2024-08-20T05:13:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.216+0000 7f1e83045740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ec5fb2e140 con 0x55ec5fc2a980 2024-08-20T05:13:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.216+0000 7f1e83045740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ec5fb87710 con 0x55ec5fc25610 2024-08-20T05:13:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.217+0000 7f1e83045740 10 client.0 _ll_register_callbacks cb 0x55ec5fb415d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.217+0000 7f1e7e200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc2fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.217+0000 7f1e7e200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc2fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43872/0 (socket says 172.21.15.37:43872) 2024-08-20T05:13:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.217+0000 7f1e7e200640 1 -- 172.21.15.37:0/3539819899 learned_addr learned my addr 172.21.15.37:0/3539819899 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:16.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.218+0000 7f1e7d800640 1 --2- 172.21.15.37:0/3539819899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc25610 0x55ec5fc2e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.218+0000 7f1e7ce00640 1 --2- 172.21.15.37:0/3539819899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc27f40 0x55ec5fc2f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.218+0000 7f1e7e200640 1 -- 172.21.15.37:0/3539819899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc25610 msgr2=0x55ec5fc2e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:16.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.218+0000 7f1e7e200640 1 --2- 172.21.15.37:0/3539819899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc25610 0x55ec5fc2e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.218+0000 7f1e7e200640 1 -- 172.21.15.37:0/3539819899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc27f40 msgr2=0x55ec5fc2f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:16.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.219+0000 7f1e7e200640 1 --2- 172.21.15.37:0/3539819899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc27f40 0x55ec5fc2f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.220+0000 7f1e7e200640 1 -- 172.21.15.37:0/3539819899 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec5fb2f170 con 0x55ec5fc2a980 2024-08-20T05:13:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.220+0000 7f1e7ce00640 1 --2- 172.21.15.37:0/3539819899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc27f40 0x55ec5fc2f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:16.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.220+0000 7f1e7e200640 1 --2- 172.21.15.37:0/3539819899 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc2fba0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1e70102720 tx=0x7f1e70102ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca12d1548a921fb1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:16.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.220+0000 7f1e5f400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:13:16.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.221+0000 7f1e5f400640 1 -- 172.21.15.37:0/3539819899 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e700d9060 con 0x55ec5fc2a980 2024-08-20T05:13:16.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.221+0000 7f1e5f400640 1 -- 172.21.15.37:0/3539819899 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1e700c8110 con 0x55ec5fc2a980 2024-08-20T05:13:16.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.221+0000 7f1e83045740 1 -- 172.21.15.37:0/3539819899 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e700cce50 con 0x55ec5fc2a980 2024-08-20T05:13:16.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.222+0000 7f1e5f400640 1 -- 172.21.15.37:0/3539819899 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f1e700ec070 con 0x55ec5fc2a980 2024-08-20T05:13:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.222+0000 7f1e83045740 10 client.28151 fetch_fsmap learned FSMap version 46 2024-08-20T05:13:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.222+0000 7f1e83045740 1 -- 172.21.15.37:0/3539819899 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55ec5f8ea790 con 0x55ec5fc2a980 2024-08-20T05:13:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.222+0000 7f1e5f400640 1 -- 172.21.15.37:0/3539819899 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e700cce50 con 0x55ec5fc2a980 2024-08-20T05:13:16.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.224+0000 7f1e5f400640 1 -- 172.21.15.37:0/3539819899 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 46) ==== 8378+0+0 (secure 0 0 0) 0x7f1e700305f0 con 0x55ec5fc2a980 2024-08-20T05:13:16.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.224+0000 7f1e83045740 10 client.28151 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T05:13:16.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.224+0000 7f1e83045740 10 client.28151 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:16.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.224+0000 7f1e83045740 20 client.28151 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.224+0000 7f1e83045740 1 --2- 172.21.15.37:0/3539819899 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ec5fc3a2f0 0x55ec5fc3c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.225+0000 7f1e83045740 4 client.28151 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:13:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.225+0000 7f1e83045740 1 -- 172.21.15.37:0/3539819899 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec5fb9a160 con 0x55ec5fc3a2f0 2024-08-20T05:13:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.225+0000 7f1e7d800640 1 --2- 172.21.15.37:0/3539819899 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ec5fc3a2f0 0x55ec5fc3c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.226+0000 7f1e7d800640 1 --2- 172.21.15.37:0/3539819899 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ec5fc3a2f0 0x55ec5fc3c710 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b42991b1d994f972 server_cookie=e18cfca3580c299c in_seq=0 out_seq=0 2024-08-20T05:13:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.226+0000 7f1e5f400640 10 client.28151 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.227+0000 7f1e5f400640 1 -- 172.21.15.37:0/3539819899 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec5fb9a160 con 0x55ec5fc3a2f0 2024-08-20T05:13:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.227+0000 7f1e5f400640 10 client.28151 handle_command_reply: tid=0 2024-08-20T05:13:16.229 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.227+0000 7f1e83045740 1 client.28151 shutdown 2024-08-20T05:13:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.228+0000 7f1e83045740 1 -- 172.21.15.37:0/3539819899 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 msgr2=0x55ec5fc2fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.231+0000 7f1e83045740 1 --2- 172.21.15.37:0/3539819899 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc2fba0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1e70102720 tx=0x7f1e70102ea0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.233+0000 7f1e83045740 1 -- 172.21.15.37:0/3539819899 shutdown_connections 2024-08-20T05:13:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.233+0000 7f1e83045740 1 --2- 172.21.15.37:0/3539819899 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ec5fc3a2f0 0x55ec5fc3c710 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.233+0000 7f1e83045740 1 --2- 172.21.15.37:0/3539819899 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc2fba0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.233+0000 7f1e83045740 1 --2- 172.21.15.37:0/3539819899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc27f40 0x55ec5fc2f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.233+0000 7f1e83045740 1 --2- 172.21.15.37:0/3539819899 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc25610 0x55ec5fc2e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.233+0000 7f1e5f400640 0 client.28151 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.233+0000 7f1e83045740 1 -- 172.21.15.37:0/3539819899 >> 172.21.15.37:0/3539819899 conn(0x55ec5fc20760 msgr2=0x55ec5fc1f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.234+0000 7f1e83045740 1 -- 172.21.15.37:0/3539819899 shutdown_connections 2024-08-20T05:13:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.234+0000 7f1e83045740 1 -- 172.21.15.37:0/3539819899 wait complete. 2024-08-20T05:13:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.235+0000 7f1e83045740 20 client.28151 trim_cache size 0 max 16384 2024-08-20T05:13:16.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.268+0000 7f1e83045740 1 Processor -- start 2024-08-20T05:13:16.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.268+0000 7f1e83045740 1 -- start start 2024-08-20T05:13:16.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.268+0000 7f1e83045740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc25610 0x55ec5fc2df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.268+0000 7f1e83045740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc27f40 0x55ec5fc36860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.270 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.268+0000 7f1e83045740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc1ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.269+0000 7f1e83045740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e781b5b70 con 0x55ec5fc25610 2024-08-20T05:13:16.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.269+0000 7f1e83045740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1e781b76b0 con 0x55ec5fc2a980 2024-08-20T05:13:16.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.269+0000 7f1e83045740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1e781b6240 con 0x55ec5fc27f40 2024-08-20T05:13:16.271 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.269+0000 7f1e7e200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc1ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.269+0000 7f1e7e200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc1ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43884/0 (socket says 172.21.15.37:43884) 2024-08-20T05:13:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.269+0000 7f1e7e200640 1 -- 172.21.15.37:0/491819103 learned_addr learned my addr 172.21.15.37:0/491819103 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.269+0000 7f1e7ce00640 1 --2- 172.21.15.37:0/491819103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc27f40 0x55ec5fc36860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.269+0000 7f1e7d800640 1 --2- 172.21.15.37:0/491819103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc25610 0x55ec5fc2df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.270+0000 7f1e7e200640 1 -- 172.21.15.37:0/491819103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc27f40 msgr2=0x55ec5fc36860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.270+0000 7f1e7e200640 1 --2- 172.21.15.37:0/491819103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc27f40 0x55ec5fc36860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.270+0000 7f1e7e200640 1 -- 172.21.15.37:0/491819103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc25610 msgr2=0x55ec5fc2df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.270+0000 7f1e7e200640 1 --2- 172.21.15.37:0/491819103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc25610 0x55ec5fc2df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.270+0000 7f1e7e200640 1 -- 172.21.15.37:0/491819103 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec5f963620 con 0x55ec5fc2a980 2024-08-20T05:13:16.272 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.270+0000 7f1e7ce00640 1 --2- 172.21.15.37:0/491819103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc27f40 0x55ec5fc36860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:13:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.270+0000 7f1e7e200640 1 --2- 172.21.15.37:0/491819103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc1ff50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1e700cc3d0 tx=0x7f1e70105270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4351b4fb453c0d34 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:16.273 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.271+0000 7f1e6a000640 1 -- 172.21.15.37:0/491819103 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e700ec070 con 0x55ec5fc2a980 2024-08-20T05:13:16.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.273+0000 7f1e6a000640 1 -- 172.21.15.37:0/491819103 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e700cce50 con 0x55ec5fc2a980 2024-08-20T05:13:16.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.273+0000 7f1e6a000640 1 -- 172.21.15.37:0/491819103 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e700ec070 con 0x55ec5fc2a980 2024-08-20T05:13:16.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.274+0000 7f1e83045740 1 -- 172.21.15.37:0/491819103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 msgr2=0x55ec5fc1ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.276 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.274+0000 7f1e83045740 1 --2- 172.21.15.37:0/491819103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc1ff50 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1e700cc3d0 tx=0x7f1e70105270 comp rx=0 tx=0).stop 2024-08-20T05:13:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.275+0000 7f1e83045740 1 -- 172.21.15.37:0/491819103 shutdown_connections 2024-08-20T05:13:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.275+0000 7f1e83045740 1 --2- 172.21.15.37:0/491819103 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc2a980 0x55ec5fc1ff50 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.275+0000 7f1e83045740 1 --2- 172.21.15.37:0/491819103 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc27f40 0x55ec5fc36860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.275+0000 7f1e83045740 1 --2- 172.21.15.37:0/491819103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc25610 0x55ec5fc2df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.277 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.275+0000 7f1e83045740 1 -- 172.21.15.37:0/491819103 >> 172.21.15.37:0/491819103 conn(0x55ec5fc20760 msgr2=0x55ec5fc2c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:16.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.277+0000 7f1e83045740 1 -- 172.21.15.37:0/491819103 shutdown_connections 2024-08-20T05:13:16.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.277+0000 7f1e83045740 1 -- 172.21.15.37:0/491819103 wait complete. 2024-08-20T05:13:16.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.278+0000 7f1e83045740 1 -- start start 2024-08-20T05:13:16.280 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.278+0000 7f1e83045740 1 Processor -- start 2024-08-20T05:13:16.281 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.279+0000 7f1e83045740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc25610 0x55ec5fc36170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.281 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.279+0000 7f1e83045740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc27f40 0x55ec5fc36810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.281 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.279+0000 7f1e83045740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc2a980 0x55ec5fc35000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.281 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.279+0000 7f1e83045740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e781b6fe0 con 0x55ec5fc2a980 2024-08-20T05:13:16.281 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.279+0000 7f1e83045740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1e781b6910 con 0x55ec5fc27f40 2024-08-20T05:13:16.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.279+0000 7f1e83045740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1e781b3c00 con 0x55ec5fc25610 2024-08-20T05:13:16.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.279+0000 7f1e83045740 10 client.0 _ll_register_callbacks cb 0x7f1e6c0093d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:16.282 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.280+0000 7f1e7ce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc27f40 0x55ec5fc36810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.280+0000 7f1e7ce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc27f40 0x55ec5fc36810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43896/0 (socket says 172.21.15.37:43896) 2024-08-20T05:13:16.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.280+0000 7f1e7ce00640 1 -- 172.21.15.37:0/2588818859 learned_addr learned my addr 172.21.15.37:0/2588818859 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:16.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.280+0000 7f1e7d800640 1 --2- 172.21.15.37:0/2588818859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc25610 0x55ec5fc36170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.280+0000 7f1e7d800640 1 -- 172.21.15.37:0/2588818859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc27f40 msgr2=0x55ec5fc36810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:16.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.280+0000 7f1e7d800640 1 --2- 172.21.15.37:0/2588818859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc27f40 0x55ec5fc36810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.280+0000 7f1e7d800640 1 -- 172.21.15.37:0/2588818859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc2a980 msgr2=0x55ec5fc35000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:16.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.280+0000 7f1e7d800640 1 --2- 172.21.15.37:0/2588818859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc2a980 0x55ec5fc35000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.280+0000 7f1e7d800640 1 -- 172.21.15.37:0/2588818859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec5fc35800 con 0x55ec5fc25610 2024-08-20T05:13:16.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.281+0000 7f1e7d800640 1 --2- 172.21.15.37:0/2588818859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc25610 0x55ec5fc36170 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x55ec5fc3ccf0 tx=0x7f1e6c006dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60458ff06cc5165e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:16.283 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.281+0000 7f1e5f400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:13:16.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.281+0000 7f1e5f400640 1 -- 172.21.15.37:0/2588818859 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c023020 con 0x55ec5fc25610 2024-08-20T05:13:16.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.281+0000 7f1e5f400640 1 -- 172.21.15.37:0/2588818859 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1e6c015d20 con 0x55ec5fc25610 2024-08-20T05:13:16.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.282+0000 7f1e83045740 1 -- 172.21.15.37:0/2588818859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e700cce50 con 0x55ec5fc25610 2024-08-20T05:13:16.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.282+0000 7f1e5f400640 1 -- 172.21.15.37:0/2588818859 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f1e6c01f420 con 0x55ec5fc25610 2024-08-20T05:13:16.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.282+0000 7f1e83045740 10 client.28183 fetch_fsmap learned FSMap version 46 2024-08-20T05:13:16.284 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.282+0000 7f1e83045740 1 -- 172.21.15.37:0/2588818859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55ec5fc346f0 con 0x55ec5fc25610 2024-08-20T05:13:16.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.282+0000 7f1e5f400640 1 -- 172.21.15.37:0/2588818859 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e700cce50 con 0x55ec5fc25610 2024-08-20T05:13:16.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.284+0000 7f1e5f400640 1 -- 172.21.15.37:0/2588818859 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 46) ==== 8378+0+0 (secure 0 0 0) 0x7f1e6c01f5c0 con 0x55ec5fc25610 2024-08-20T05:13:16.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.284+0000 7f1e83045740 10 client.28183 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T05:13:16.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.284+0000 7f1e83045740 10 client.28183 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:16.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.284+0000 7f1e83045740 20 client.28183 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:16.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.284+0000 7f1e83045740 1 --2- 172.21.15.37:0/2588818859 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ec5fcade50 0x55ec5fcb0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.284+0000 7f1e83045740 4 client.28183 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:13:16.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.284+0000 7f1e83045740 1 -- 172.21.15.37:0/2588818859 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ec5fb95c00 con 0x55ec5fcade50 2024-08-20T05:13:16.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.285+0000 7f1e7ce00640 1 --2- 172.21.15.37:0/2588818859 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ec5fcade50 0x55ec5fcb0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.290+0000 7f1e5f400640 10 client.28183 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:16.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.290+0000 7f1e7ce00640 1 --2- 172.21.15.37:0/2588818859 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ec5fcade50 0x55ec5fcb0270 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39042ed89f2f5383 server_cookie=a1244674248c6c03 in_seq=0 out_seq=0 2024-08-20T05:13:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.306+0000 7f1e5f400640 1 -- 172.21.15.37:0/2588818859 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ec5fb95c00 con 0x55ec5fcade50 2024-08-20T05:13:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.307+0000 7f1e5f400640 10 client.28183 handle_command_reply: tid=0 2024-08-20T05:13:16.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.307+0000 7f1e83045740 1 client.28183 shutdown 2024-08-20T05:13:16.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.308+0000 7f1e83045740 1 -- 172.21.15.37:0/2588818859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc25610 msgr2=0x55ec5fc36170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.308+0000 7f1e83045740 1 --2- 172.21.15.37:0/2588818859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc25610 0x55ec5fc36170 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x55ec5fc3ccf0 tx=0x7f1e6c006dd0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.309+0000 7f1e83045740 1 -- 172.21.15.37:0/2588818859 shutdown_connections 2024-08-20T05:13:16.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.309+0000 7f1e83045740 1 --2- 172.21.15.37:0/2588818859 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ec5fcade50 0x55ec5fcb0270 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.309+0000 7f1e83045740 1 --2- 172.21.15.37:0/2588818859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec5fc2a980 0x55ec5fc35000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.310+0000 7f1e83045740 1 --2- 172.21.15.37:0/2588818859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec5fc27f40 0x55ec5fc36810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.310+0000 7f1e5f400640 0 client.28183 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:16.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.310+0000 7f1e83045740 1 --2- 172.21.15.37:0/2588818859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec5fc25610 0x55ec5fc36170 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.310+0000 7f1e83045740 1 -- 172.21.15.37:0/2588818859 >> 172.21.15.37:0/2588818859 conn(0x55ec5fc20760 msgr2=0x55ec5fc1ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.311+0000 7f1e83045740 1 -- 172.21.15.37:0/2588818859 shutdown_connections 2024-08-20T05:13:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.311+0000 7f1e83045740 1 -- 172.21.15.37:0/2588818859 wait complete. 2024-08-20T05:13:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.311+0000 7f1e83045740 20 client.28183 trim_cache size 0 max 16384 2024-08-20T05:13:16.313 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:13:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:13:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:13:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:13:16.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.312+0000 7f1e80200640 1 -- 172.21.15.37:0/915139320 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e600b3d20 msgr2=0x7f1e600b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.313+0000 7f1e80200640 1 --2- 172.21.15.37:0/915139320 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e600b3d20 0x7f1e600b61e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009990 tx=0x7f1e64009110 comp rx=0 tx=0).stop 2024-08-20T05:13:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.313+0000 7f1e80200640 1 -- 172.21.15.37:0/915139320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e7810a900 msgr2=0x7f1e781a4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.313+0000 7f1e80200640 1 --2- 172.21.15.37:0/915139320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e7810a900 0x7f1e781a4810 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1e70006010 tx=0x7f1e7002f870 comp rx=0 tx=0).stop 2024-08-20T05:13:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.313+0000 7f1e80200640 1 -- 172.21.15.37:0/915139320 shutdown_connections 2024-08-20T05:13:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.313+0000 7f1e80200640 1 --2- 172.21.15.37:0/915139320 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e600b3d20 0x7f1e600b61e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.313+0000 7f1e80200640 1 --2- 172.21.15.37:0/915139320 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e7810a900 0x7f1e781a4810 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.313+0000 7f1e80200640 1 --2- 172.21.15.37:0/915139320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e780746f0 0x7f1e781a3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.313+0000 7f1e80200640 1 --2- 172.21.15.37:0/915139320 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e780742f0 0x7f1e781a3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.313+0000 7f1e80200640 1 -- 172.21.15.37:0/915139320 >> 172.21.15.37:0/915139320 conn(0x7f1e7806f740 msgr2=0x7f1e7806fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.314+0000 7f1e80200640 1 -- 172.21.15.37:0/915139320 shutdown_connections 2024-08-20T05:13:16.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:16.314+0000 7f1e80200640 1 -- 172.21.15.37:0/915139320 wait complete. 2024-08-20T05:13:16.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.314+0000 7f5399200640 1 -- 172.21.15.37:0/3608429368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5394104130 msgr2=0x7f539410c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.315+0000 7f5399200640 1 --2- 172.21.15.37:0/3608429368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5394104130 0x7f539410c620 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f5380009860 tx=0x7f538002a340 comp rx=0 tx=0).stop 2024-08-20T05:13:16.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.315+0000 7f5399200640 1 -- 172.21.15.37:0/3608429368 shutdown_connections 2024-08-20T05:13:16.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.315+0000 7f5399200640 1 --2- 172.21.15.37:0/3608429368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f539410cc70 0x7f539410f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.316+0000 7f5399200640 1 --2- 172.21.15.37:0/3608429368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5394104130 0x7f539410c620 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.316+0000 7f5399200640 1 --2- 172.21.15.37:0/3608429368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394103810 0x7f5394103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.316+0000 7f5399200640 1 -- 172.21.15.37:0/3608429368 >> 172.21.15.37:0/3608429368 conn(0x7f53940fd2d0 msgr2=0x7f53940ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:16.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.317+0000 7f5399200640 1 -- 172.21.15.37:0/3608429368 shutdown_connections 2024-08-20T05:13:16.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.317+0000 7f5399200640 1 -- 172.21.15.37:0/3608429368 wait complete. 2024-08-20T05:13:16.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.318+0000 7f5399200640 1 Processor -- start 2024-08-20T05:13:16.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.319+0000 7f5399200640 1 -- start start 2024-08-20T05:13:16.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.319+0000 7f5399200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5394103810 0x7f539410c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.319+0000 7f5399200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394104130 0x7f5394109570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.319+0000 7f5399200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f539410cc70 0x7f5394109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.320+0000 7f5393400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5394103810 0x7f539410c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.320+0000 7f5393e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f539410cc70 0x7f5394109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.320+0000 7f5393400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5394103810 0x7f539410c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:58928/0 (socket says 172.21.15.37:58928) 2024-08-20T05:13:16.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.320+0000 7f5393400640 1 -- 172.21.15.37:0/3585453527 learned_addr learned my addr 172.21.15.37:0/3585453527 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:16.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.320+0000 7f5399200640 1 -- 172.21.15.37:0/3585453527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5394114b00 con 0x7f539410cc70 2024-08-20T05:13:16.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.320+0000 7f5399200640 1 -- 172.21.15.37:0/3585453527 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5394114980 con 0x7f5394104130 2024-08-20T05:13:16.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.320+0000 7f5399200640 1 -- 172.21.15.37:0/3585453527 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5394114c80 con 0x7f5394103810 2024-08-20T05:13:16.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.320+0000 7f5392a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394104130 0x7f5394109570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.321+0000 7f5392a00640 1 -- 172.21.15.37:0/3585453527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5394103810 msgr2=0x7f539410c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.321+0000 7f5392a00640 1 --2- 172.21.15.37:0/3585453527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5394103810 0x7f539410c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.321+0000 7f5392a00640 1 -- 172.21.15.37:0/3585453527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f539410cc70 msgr2=0x7f5394109ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.321+0000 7f5392a00640 1 --2- 172.21.15.37:0/3585453527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f539410cc70 0x7f5394109ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.321+0000 7f5392a00640 1 -- 172.21.15.37:0/3585453527 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539410a370 con 0x7f5394104130 2024-08-20T05:13:16.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.321+0000 7f5393e00640 1 --2- 172.21.15.37:0/3585453527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f539410cc70 0x7f5394109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:16.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.322+0000 7f5392a00640 1 --2- 172.21.15.37:0/3585453527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394104130 0x7f5394109570 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f538002a860 tx=0x7f5380032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:16.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.322+0000 7f538be00640 1 -- 172.21.15.37:0/3585453527 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5380037040 con 0x7f5394104130 2024-08-20T05:13:16.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.323+0000 7f538be00640 1 -- 172.21.15.37:0/3585453527 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5380030c10 con 0x7f5394104130 2024-08-20T05:13:16.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.323+0000 7f538be00640 1 -- 172.21.15.37:0/3585453527 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53800035f0 con 0x7f5394104130 2024-08-20T05:13:16.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.324+0000 7f5399200640 1 -- 172.21.15.37:0/3585453527 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53941ab840 con 0x7f5394104130 2024-08-20T05:13:16.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.325+0000 7f5399200640 1 -- 172.21.15.37:0/3585453527 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53941abc40 con 0x7f5394104130 2024-08-20T05:13:16.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.332+0000 7f539d1e7740 1 Processor -- start 2024-08-20T05:13:16.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.332+0000 7f538be00640 1 -- 172.21.15.37:0/3585453527 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5380043070 con 0x7f5394104130 2024-08-20T05:13:16.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.332+0000 7f539d1e7740 1 -- start start 2024-08-20T05:13:16.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.333+0000 7f539d1e7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7beac0 0x564e3e7beea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.334+0000 7f539d1e7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7bf3e0 0x564e3e7cae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.334+0000 7f539d1e7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7cb370 0x564e3e7cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.334+0000 7f539d1e7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e3e734aa0 con 0x564e3e7beac0 2024-08-20T05:13:16.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.335+0000 7f5393400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7bf3e0 0x564e3e7cae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.335+0000 7f5393400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7bf3e0 0x564e3e7cae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43924/0 (socket says 172.21.15.37:43924) 2024-08-20T05:13:16.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.335+0000 7f5393400640 1 -- 172.21.15.37:0/2357079446 learned_addr learned my addr 172.21.15.37:0/2357079446 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:16.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.335+0000 7f5392a00640 1 --2- 172.21.15.37:0/2357079446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7cb370 0x564e3e7cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.336+0000 7f5393e00640 1 --2- 172.21.15.37:0/2357079446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7beac0 0x564e3e7beea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.334+0000 7f539d1e7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564e3e723fa0 con 0x564e3e7bf3e0 2024-08-20T05:13:16.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.336+0000 7f539d1e7740 1 -- 172.21.15.37:0/2357079446 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564e3e727fe0 con 0x564e3e7cb370 2024-08-20T05:13:16.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.337+0000 7f5393400640 1 -- 172.21.15.37:0/2357079446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7cb370 msgr2=0x564e3e7cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:16.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.337+0000 7f5393400640 1 --2- 172.21.15.37:0/2357079446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7cb370 0x564e3e7cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.337+0000 7f5393400640 1 -- 172.21.15.37:0/2357079446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7beac0 msgr2=0x564e3e7beea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:16.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.337+0000 7f5393400640 1 --2- 172.21.15.37:0/2357079446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7beac0 0x564e3e7beea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.337+0000 7f538be00640 1 --2- 172.21.15.37:0/3585453527 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53780b3e40 0x7f53780b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.337+0000 7f5393400640 1 -- 172.21.15.37:0/2357079446 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e3e6ca420 con 0x564e3e7bf3e0 2024-08-20T05:13:16.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.337+0000 7f5393e00640 1 --2- 172.21.15.37:0/2357079446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7beac0 0x564e3e7beea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:16.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.338+0000 7f538be00640 1 -- 172.21.15.37:0/3585453527 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5380103020 con 0x7f5394104130 2024-08-20T05:13:16.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.338+0000 7f5393400640 1 --2- 172.21.15.37:0/2357079446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7bf3e0 0x564e3e7cae30 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f538400bd90 tx=0x7f538400f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54ef4f1902a805f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:16.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.339+0000 7f5393e00640 1 --2- 172.21.15.37:0/3585453527 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53780b3e40 0x7f53780b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.339+0000 7f5388c00640 1 -- 172.21.15.37:0/2357079446 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5384015070 con 0x564e3e7bf3e0 2024-08-20T05:13:16.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.339+0000 7f5388c00640 1 -- 172.21.15.37:0/2357079446 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53840035f0 con 0x564e3e7bf3e0 2024-08-20T05:13:16.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.339+0000 7f5388c00640 1 -- 172.21.15.37:0/2357079446 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5384011680 con 0x564e3e7bf3e0 2024-08-20T05:13:16.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.340+0000 7f539d1e7740 1 -- 172.21.15.37:0/2357079446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7bf3e0 msgr2=0x564e3e7cae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.340+0000 7f539d1e7740 1 --2- 172.21.15.37:0/2357079446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7bf3e0 0x564e3e7cae30 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f538400bd90 tx=0x7f538400f730 comp rx=0 tx=0).stop 2024-08-20T05:13:16.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.340+0000 7f5393e00640 1 --2- 172.21.15.37:0/3585453527 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53780b3e40 0x7f53780b6300 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f538c009fd0 tx=0x7f538c010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:16.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.340+0000 7f539d1e7740 1 -- 172.21.15.37:0/2357079446 shutdown_connections 2024-08-20T05:13:16.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.340+0000 7f539d1e7740 1 --2- 172.21.15.37:0/2357079446 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7cb370 0x564e3e7cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.340+0000 7f539d1e7740 1 --2- 172.21.15.37:0/2357079446 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7bf3e0 0x564e3e7cae30 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.340+0000 7f539d1e7740 1 --2- 172.21.15.37:0/2357079446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7beac0 0x564e3e7beea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.340+0000 7f539d1e7740 1 -- 172.21.15.37:0/2357079446 >> 172.21.15.37:0/2357079446 conn(0x564e3e7bc8f0 msgr2=0x564e3e7bda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:16.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.340+0000 7f539d1e7740 1 -- 172.21.15.37:0/2357079446 shutdown_connections 2024-08-20T05:13:16.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.341+0000 7f539d1e7740 1 -- 172.21.15.37:0/2357079446 wait complete. 2024-08-20T05:13:16.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.342+0000 7f539d1e7740 1 -- start start 2024-08-20T05:13:16.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.342+0000 7f539d1e7740 1 Processor -- start 2024-08-20T05:13:16.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.342+0000 7f539d1e7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7beac0 0x564e3e7cab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.342+0000 7f539d1e7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7bf3e0 0x564e3e7c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.343+0000 7f539d1e7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7cb370 0x564e3e7c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.343+0000 7f539d1e7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e3e586700 con 0x564e3e7bf3e0 2024-08-20T05:13:16.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.343+0000 7f539d1e7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564e3e6bf290 con 0x564e3e7beac0 2024-08-20T05:13:16.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.343+0000 7f539d1e7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564e3e7cdff0 con 0x564e3e7cb370 2024-08-20T05:13:16.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.343+0000 7f539d1e7740 10 client.0 _ll_register_callbacks cb 0x564e3e71e1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:16.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.343+0000 7f5393400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7beac0 0x564e3e7cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.343+0000 7f5393400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7beac0 0x564e3e7cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43940/0 (socket says 172.21.15.37:43940) 2024-08-20T05:13:16.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.343+0000 7f5393400640 1 -- 172.21.15.37:0/4224754152 learned_addr learned my addr 172.21.15.37:0/4224754152 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:16.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.343+0000 7f5393e00640 1 --2- 172.21.15.37:0/4224754152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7cb370 0x564e3e7c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.344+0000 7f5393400640 1 -- 172.21.15.37:0/4224754152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7cb370 msgr2=0x564e3e7c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:16.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.344+0000 7f5393400640 1 --2- 172.21.15.37:0/4224754152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7cb370 0x564e3e7c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.344+0000 7f5393400640 1 -- 172.21.15.37:0/4224754152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7bf3e0 msgr2=0x564e3e7c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:16.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.344+0000 7f5392a00640 1 --2- 172.21.15.37:0/4224754152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7bf3e0 0x564e3e7c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.344+0000 7f5393400640 1 --2- 172.21.15.37:0/4224754152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7bf3e0 0x564e3e7c7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.344+0000 7f5393400640 1 -- 172.21.15.37:0/4224754152 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e3e483650 con 0x564e3e7beac0 2024-08-20T05:13:16.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.344+0000 7f5393e00640 1 --2- 172.21.15.37:0/4224754152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7cb370 0x564e3e7c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:16.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.344+0000 7f5392a00640 1 --2- 172.21.15.37:0/4224754152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7bf3e0 0x564e3e7c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:16.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.345+0000 7f5393400640 1 --2- 172.21.15.37:0/4224754152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7beac0 0x564e3e7cab00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5384003f70 tx=0x7f53840039d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c58db0c39c6c7e24 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:16.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.345+0000 7f537d600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:13:16.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.345+0000 7f537d600640 1 -- 172.21.15.37:0/4224754152 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5384028060 con 0x564e3e7beac0 2024-08-20T05:13:16.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.345+0000 7f537d600640 1 -- 172.21.15.37:0/4224754152 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5384004210 con 0x564e3e7beac0 2024-08-20T05:13:16.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.345+0000 7f539d1e7740 1 -- 172.21.15.37:0/4224754152 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53840035f0 con 0x564e3e7beac0 2024-08-20T05:13:16.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.346+0000 7f537d600640 1 -- 172.21.15.37:0/4224754152 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f538402f050 con 0x564e3e7beac0 2024-08-20T05:13:16.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.346+0000 7f539d1e7740 10 client.28169 fetch_fsmap learned FSMap version 46 2024-08-20T05:13:16.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.346+0000 7f539d1e7740 1 -- 172.21.15.37:0/4224754152 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x564e3e7d9790 con 0x564e3e7beac0 2024-08-20T05:13:16.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.346+0000 7f537d600640 1 -- 172.21.15.37:0/4224754152 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f53840035f0 con 0x564e3e7beac0 2024-08-20T05:13:16.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.347+0000 7f537d600640 1 -- 172.21.15.37:0/4224754152 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 46) ==== 8378+0+0 (secure 0 0 0) 0x7f5384011ce0 con 0x564e3e7beac0 2024-08-20T05:13:16.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.347+0000 7f539d1e7740 10 client.28169 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T05:13:16.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.347+0000 7f539d1e7740 10 client.28169 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:13:16.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.347+0000 7f539d1e7740 20 client.28169 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:16.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.347+0000 7f539d1e7740 1 --2- 172.21.15.37:0/4224754152 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x564e3e7dab90 0x564e3e7dcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.348+0000 7f539d1e7740 4 client.28169 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:13:16.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.348+0000 7f539d1e7740 1 -- 172.21.15.37:0/4224754152 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e3e7369f0 con 0x564e3e7dab90 2024-08-20T05:13:16.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.348+0000 7f5392a00640 1 --2- 172.21.15.37:0/4224754152 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x564e3e7dab90 0x564e3e7dcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.349+0000 7f5392a00640 1 --2- 172.21.15.37:0/4224754152 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x564e3e7dab90 0x564e3e7dcf80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1ce03654949d92d8 server_cookie=beb9a31d20240fdb in_seq=0 out_seq=0 2024-08-20T05:13:16.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.349+0000 7f537d600640 10 client.28169 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:13:16.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.350+0000 7f537d600640 1 -- 172.21.15.37:0/4224754152 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e3e7369f0 con 0x564e3e7dab90 2024-08-20T05:13:16.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.350+0000 7f537d600640 10 client.28169 handle_command_reply: tid=0 2024-08-20T05:13:16.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.350+0000 7f539d1e7740 1 client.28169 shutdown 2024-08-20T05:13:16.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.350+0000 7f539d1e7740 1 -- 172.21.15.37:0/4224754152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7beac0 msgr2=0x564e3e7cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.350+0000 7f539d1e7740 1 --2- 172.21.15.37:0/4224754152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7beac0 0x564e3e7cab00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5384003f70 tx=0x7f53840039d0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.350+0000 7f539d1e7740 1 -- 172.21.15.37:0/4224754152 shutdown_connections 2024-08-20T05:13:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.350+0000 7f539d1e7740 1 --2- 172.21.15.37:0/4224754152 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x564e3e7dab90 0x564e3e7dcf80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.350+0000 7f539d1e7740 1 --2- 172.21.15.37:0/4224754152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7cb370 0x564e3e7c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.350+0000 7f539d1e7740 1 --2- 172.21.15.37:0/4224754152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7bf3e0 0x564e3e7c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.350+0000 7f539d1e7740 1 --2- 172.21.15.37:0/4224754152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7beac0 0x564e3e7cab00 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.350+0000 7f539d1e7740 1 -- 172.21.15.37:0/4224754152 >> 172.21.15.37:0/4224754152 conn(0x564e3e7bc8f0 msgr2=0x564e3e7c2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.350+0000 7f537d600640 0 client.28169 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:13:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.351+0000 7f539d1e7740 1 -- 172.21.15.37:0/4224754152 shutdown_connections 2024-08-20T05:13:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.351+0000 7f539d1e7740 1 -- 172.21.15.37:0/4224754152 wait complete. 2024-08-20T05:13:16.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.351+0000 7f539d1e7740 20 client.28169 trim_cache size 0 max 16384 2024-08-20T05:13:16.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.375+0000 7f539d1e7740 1 Processor -- start 2024-08-20T05:13:16.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.375+0000 7f539d1e7740 1 -- start start 2024-08-20T05:13:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.379+0000 7f539d1e7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7beac0 0x564e3e7d7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.379+0000 7f539d1e7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7bf3e0 0x564e3e7c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.379+0000 7f539d1e7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7cb370 0x564e3e7e2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.379+0000 7f539d1e7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f53941b5b20 con 0x564e3e7bf3e0 2024-08-20T05:13:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.379+0000 7f539d1e7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f53941b7660 con 0x564e3e7cb370 2024-08-20T05:13:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.379+0000 7f539d1e7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53941b61f0 con 0x564e3e7beac0 2024-08-20T05:13:16.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.379+0000 7f5393e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7cb370 0x564e3e7e2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.380+0000 7f5393e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7cb370 0x564e3e7e2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43946/0 (socket says 172.21.15.37:43946) 2024-08-20T05:13:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.380+0000 7f5393e00640 1 -- 172.21.15.37:0/4187482334 learned_addr learned my addr 172.21.15.37:0/4187482334 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.380+0000 7f5393400640 1 --2- 172.21.15.37:0/4187482334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7beac0 0x564e3e7d7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.380+0000 7f5393e00640 1 -- 172.21.15.37:0/4187482334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7beac0 msgr2=0x564e3e7d7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.380+0000 7f5392a00640 1 --2- 172.21.15.37:0/4187482334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7bf3e0 0x564e3e7c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.381+0000 7f5393e00640 1 --2- 172.21.15.37:0/4187482334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7beac0 0x564e3e7d7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.381+0000 7f5393e00640 1 -- 172.21.15.37:0/4187482334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7bf3e0 msgr2=0x564e3e7c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.381+0000 7f5393e00640 1 --2- 172.21.15.37:0/4187482334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7bf3e0 0x564e3e7c34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.381+0000 7f5393e00640 1 -- 172.21.15.37:0/4187482334 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e3e7ae0a0 con 0x564e3e7cb370 2024-08-20T05:13:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.381+0000 7f5392a00640 1 --2- 172.21.15.37:0/4187482334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7bf3e0 0x564e3e7c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.382+0000 7f5393400640 1 --2- 172.21.15.37:0/4187482334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7beac0 0x564e3e7d7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.383+0000 7f5393e00640 1 --2- 172.21.15.37:0/4187482334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7cb370 0x564e3e7e2580 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f538c009850 tx=0x7f538c019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76a5489f5ff25e8d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.383+0000 7f537fe00640 1 -- 172.21.15.37:0/4187482334 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c025610 con 0x564e3e7cb370 2024-08-20T05:13:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.384+0000 7f537fe00640 1 -- 172.21.15.37:0/4187482334 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f538c02a070 con 0x564e3e7cb370 2024-08-20T05:13:16.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.384+0000 7f537fe00640 1 -- 172.21.15.37:0/4187482334 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f538c018950 con 0x564e3e7cb370 2024-08-20T05:13:16.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.385+0000 7f539d1e7740 1 -- 172.21.15.37:0/4187482334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7cb370 msgr2=0x564e3e7e2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.385+0000 7f539d1e7740 1 --2- 172.21.15.37:0/4187482334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7cb370 0x564e3e7e2580 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f538c009850 tx=0x7f538c019000 comp rx=0 tx=0).stop 2024-08-20T05:13:16.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.388+0000 7f539d1e7740 1 -- 172.21.15.37:0/4187482334 shutdown_connections 2024-08-20T05:13:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.388+0000 7f539d1e7740 1 --2- 172.21.15.37:0/4187482334 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7cb370 0x564e3e7e2580 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.388+0000 7f539d1e7740 1 --2- 172.21.15.37:0/4187482334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7bf3e0 0x564e3e7c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.388+0000 7f539d1e7740 1 --2- 172.21.15.37:0/4187482334 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7beac0 0x564e3e7d7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.388+0000 7f539d1e7740 1 -- 172.21.15.37:0/4187482334 >> 172.21.15.37:0/4187482334 conn(0x564e3e7bc8f0 msgr2=0x564e3e7c2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.388+0000 7f539d1e7740 1 -- 172.21.15.37:0/4187482334 shutdown_connections 2024-08-20T05:13:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.390+0000 7f539d1e7740 1 -- 172.21.15.37:0/4187482334 wait complete. 2024-08-20T05:13:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.391+0000 7f539d1e7740 1 -- start start 2024-08-20T05:13:16.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.391+0000 7f539d1e7740 1 Processor -- start 2024-08-20T05:13:16.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.395+0000 7f539d1e7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7beac0 0x564e3e7d3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.395+0000 7f539d1e7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7bf3e0 0x564e3e7c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.395+0000 7f539d1e7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7cb370 0x564e3e7c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.395+0000 7f5392a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7bf3e0 0x564e3e7c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.395+0000 7f5392a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7bf3e0 0x564e3e7c4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:58974/0 (socket says 172.21.15.37:58974) 2024-08-20T05:13:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.396+0000 7f539d1e7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f53941b6f90 con 0x564e3e7beac0 2024-08-20T05:13:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.396+0000 7f5392a00640 1 -- 172.21.15.37:0/4082932869 learned_addr learned my addr 172.21.15.37:0/4082932869 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.396+0000 7f5393e00640 1 --2- 172.21.15.37:0/4082932869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7cb370 0x564e3e7c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.396+0000 7f539d1e7740 1 -- 172.21.15.37:0/4082932869 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f53941b68c0 con 0x564e3e7cb370 2024-08-20T05:13:16.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.396+0000 7f539d1e7740 1 -- 172.21.15.37:0/4082932869 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f53941b3b00 con 0x564e3e7bf3e0 2024-08-20T05:13:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.397+0000 7f539d1e7740 10 client.0 _ll_register_callbacks cb 0x7f538400bbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.397+0000 7f5392a00640 1 -- 172.21.15.37:0/4082932869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7cb370 msgr2=0x564e3e7c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:16.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.398+0000 7f5392a00640 1 --2- 172.21.15.37:0/4082932869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7cb370 0x564e3e7c4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.398+0000 7f5392a00640 1 -- 172.21.15.37:0/4082932869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7beac0 msgr2=0x564e3e7d3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:16.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.398+0000 7f5392a00640 1 --2- 172.21.15.37:0/4082932869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7beac0 0x564e3e7d3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.398+0000 7f5392a00640 1 -- 172.21.15.37:0/4082932869 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e3e7c55e0 con 0x564e3e7bf3e0 2024-08-20T05:13:16.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.399+0000 7f5392a00640 1 --2- 172.21.15.37:0/4082932869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7bf3e0 0x564e3e7c4ab0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5380030a80 tx=0x7f538002a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3c2d9870ba5ab31 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:16.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.399+0000 7f537d600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:13:16.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.401+0000 7f537d600640 1 -- 172.21.15.37:0/4082932869 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53800c9780 con 0x564e3e7bf3e0 2024-08-20T05:13:16.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.401+0000 7f537d600640 1 -- 172.21.15.37:0/4082932869 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5380106110 con 0x564e3e7bf3e0 2024-08-20T05:13:16.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.402+0000 7f539d1e7740 1 -- 172.21.15.37:0/4082932869 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f538c02a070 con 0x564e3e7bf3e0 2024-08-20T05:13:16.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.403+0000 7f537d600640 1 -- 172.21.15.37:0/4082932869 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f5380106310 con 0x564e3e7bf3e0 2024-08-20T05:13:16.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.403+0000 7f539d1e7740 10 client.28195 fetch_fsmap learned FSMap version 46 2024-08-20T05:13:16.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.403+0000 7f539d1e7740 1 -- 172.21.15.37:0/4082932869 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x564e3e7d20a0 con 0x564e3e7bf3e0 2024-08-20T05:13:16.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.403+0000 7f537d600640 1 -- 172.21.15.37:0/4082932869 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f538c02a070 con 0x564e3e7bf3e0 2024-08-20T05:13:16.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.405+0000 7f537d600640 1 -- 172.21.15.37:0/4082932869 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 46) ==== 8378+0+0 (secure 0 0 0) 0x7f53800c9ed0 con 0x564e3e7bf3e0 2024-08-20T05:13:16.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.405+0000 7f539d1e7740 10 client.28195 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T05:13:16.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.405+0000 7f539d1e7740 10 client.28195 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:13:16.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.405+0000 7f539d1e7740 20 client.28195 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:16.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.406+0000 7f539d1e7740 1 --2- 172.21.15.37:0/4082932869 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x564e3e845a90 0x564e3e847eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:16.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.406+0000 7f539d1e7740 4 client.28195 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:13:16.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.406+0000 7f539d1e7740 1 -- 172.21.15.37:0/4082932869 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564e3e732490 con 0x564e3e845a90 2024-08-20T05:13:16.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.407+0000 7f5393400640 1 --2- 172.21.15.37:0/4082932869 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x564e3e845a90 0x564e3e847eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.408+0000 7f5393400640 1 --2- 172.21.15.37:0/4082932869 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x564e3e845a90 0x564e3e847eb0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5cf39ab086946e76 server_cookie=e20532ac7e72a557 in_seq=0 out_seq=0 2024-08-20T05:13:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.408+0000 7f537d600640 10 client.28195 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:13:16.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.408+0000 7f537d600640 1 -- 172.21.15.37:0/4082932869 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564e3e732490 con 0x564e3e845a90 2024-08-20T05:13:16.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.408+0000 7f537d600640 10 client.28195 handle_command_reply: tid=0 2024-08-20T05:13:16.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.408+0000 7f539d1e7740 1 client.28195 shutdown 2024-08-20T05:13:16.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.409+0000 7f539d1e7740 1 -- 172.21.15.37:0/4082932869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7bf3e0 msgr2=0x564e3e7c4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.409+0000 7f539d1e7740 1 --2- 172.21.15.37:0/4082932869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7bf3e0 0x564e3e7c4ab0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5380030a80 tx=0x7f538002a340 comp rx=0 tx=0).stop 2024-08-20T05:13:16.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.410+0000 7f539d1e7740 1 -- 172.21.15.37:0/4082932869 shutdown_connections 2024-08-20T05:13:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.410+0000 7f539d1e7740 1 --2- 172.21.15.37:0/4082932869 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x564e3e845a90 0x564e3e847eb0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.410+0000 7f539d1e7740 1 --2- 172.21.15.37:0/4082932869 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564e3e7cb370 0x564e3e7c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.410+0000 7f539d1e7740 1 --2- 172.21.15.37:0/4082932869 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564e3e7bf3e0 0x564e3e7c4ab0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.410+0000 7f539d1e7740 1 --2- 172.21.15.37:0/4082932869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e3e7beac0 0x564e3e7d3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.410+0000 7f537d600640 0 client.28195 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:13:16.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.410+0000 7f539d1e7740 1 -- 172.21.15.37:0/4082932869 >> 172.21.15.37:0/4082932869 conn(0x564e3e7bc8f0 msgr2=0x564e3e7c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:16.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.410+0000 7f539d1e7740 1 -- 172.21.15.37:0/4082932869 shutdown_connections 2024-08-20T05:13:16.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.410+0000 7f539d1e7740 1 -- 172.21.15.37:0/4082932869 wait complete. 2024-08-20T05:13:16.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.411+0000 7f539d1e7740 20 client.28195 trim_cache size 0 max 16384 2024-08-20T05:13:16.413 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:13:16.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.412+0000 7f5399200640 1 -- 172.21.15.37:0/3585453527 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53780b3e40 msgr2=0x7f53780b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.412+0000 7f5399200640 1 --2- 172.21.15.37:0/3585453527 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53780b3e40 0x7f53780b6300 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f538c009fd0 tx=0x7f538c010040 comp rx=0 tx=0).stop 2024-08-20T05:13:16.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.412+0000 7f5399200640 1 -- 172.21.15.37:0/3585453527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394104130 msgr2=0x7f5394109570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:16.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.412+0000 7f5399200640 1 --2- 172.21.15.37:0/3585453527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394104130 0x7f5394109570 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f538002a860 tx=0x7f5380032d50 comp rx=0 tx=0).stop 2024-08-20T05:13:16.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.412+0000 7f5399200640 1 -- 172.21.15.37:0/3585453527 shutdown_connections 2024-08-20T05:13:16.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.412+0000 7f5399200640 1 --2- 172.21.15.37:0/3585453527 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f53780b3e40 0x7f53780b6300 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.412+0000 7f5399200640 1 --2- 172.21.15.37:0/3585453527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f539410cc70 0x7f5394109ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.412+0000 7f5399200640 1 --2- 172.21.15.37:0/3585453527 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5394104130 0x7f5394109570 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.412+0000 7f5399200640 1 --2- 172.21.15.37:0/3585453527 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5394103810 0x7f539410c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:16.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.412+0000 7f5399200640 1 -- 172.21.15.37:0/3585453527 >> 172.21.15.37:0/3585453527 conn(0x7f53940fd2d0 msgr2=0x7f539410eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:16.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.412+0000 7f5399200640 1 -- 172.21.15.37:0/3585453527 shutdown_connections 2024-08-20T05:13:16.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:16.412+0000 7f5399200640 1 -- 172.21.15.37:0/3585453527 wait complete. 2024-08-20T05:13:17.508 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T05:13:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:17 smithi037 ceph-mon[17265]: pgmap v732: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.5 MiB/s wr, 470 op/s 2024-08-20T05:13:17.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:17 smithi135 ceph-mon[22342]: pgmap v732: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.5 MiB/s wr, 470 op/s 2024-08-20T05:13:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:17 smithi130 ceph-mon[22007]: pgmap v732: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.5 MiB/s wr, 470 op/s 2024-08-20T05:13:18.040 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 620.0 s, 493.2 tps, lat 199.618 ms stddev 227.711 2024-08-20T05:13:18.247 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:13:19.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.081+0000 7f2cf3600640 1 -- 172.21.15.37:0/2097319184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cec115740 msgr2=0x7f2cec117b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.081+0000 7f2cf3600640 1 --2- 172.21.15.37:0/2097319184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cec115740 0x7f2cec117b30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4009be0 tx=0x7f2ce402a790 comp rx=0 tx=0).stop 2024-08-20T05:13:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.082+0000 7f2cf3600640 1 -- 172.21.15.37:0/2097319184 shutdown_connections 2024-08-20T05:13:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.082+0000 7f2cf3600640 1 --2- 172.21.15.37:0/2097319184 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cec115740 0x7f2cec117b30 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.082+0000 7f2cf3600640 1 --2- 172.21.15.37:0/2097319184 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cec10a7a0 0x7f2cec115200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.082+0000 7f2cf3600640 1 --2- 172.21.15.37:0/2097319184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cec109e80 0x7f2cec10a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.082+0000 7f2cf3600640 1 -- 172.21.15.37:0/2097319184 >> 172.21.15.37:0/2097319184 conn(0x7f2cec06dcc0 msgr2=0x7f2cec06e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.082+0000 7f2cf3600640 1 -- 172.21.15.37:0/2097319184 shutdown_connections 2024-08-20T05:13:19.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.083+0000 7f2cf3600640 1 -- 172.21.15.37:0/2097319184 wait complete. 2024-08-20T05:13:19.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.084+0000 7f2cf3600640 1 Processor -- start 2024-08-20T05:13:19.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.086+0000 7f2cf3600640 1 -- start start 2024-08-20T05:13:19.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.086+0000 7f2cf3600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cec109e80 0x7f2cec11a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.086+0000 7f2cf3600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cec10a7a0 0x7f2cec11ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.086+0000 7f2cf3600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cec115740 0x7f2cec1200f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.086+0000 7f2cf3600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec119030 con 0x7f2cec115740 2024-08-20T05:13:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.086+0000 7f2cf3600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec118eb0 con 0x7f2cec109e80 2024-08-20T05:13:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.086+0000 7f2cf3600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec1191b0 con 0x7f2cec10a7a0 2024-08-20T05:13:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.087+0000 7f2cebe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cec10a7a0 0x7f2cec11ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.087+0000 7f2cebe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cec10a7a0 0x7f2cec11ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:58996/0 (socket says 172.21.15.37:58996) 2024-08-20T05:13:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.087+0000 7f2cebe00640 1 -- 172.21.15.37:0/3088219678 learned_addr learned my addr 172.21.15.37:0/3088219678 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:19.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.087+0000 7f2cebe00640 1 -- 172.21.15.37:0/3088219678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cec109e80 msgr2=0x7f2cec11a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:19.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.087+0000 7f2cebe00640 1 --2- 172.21.15.37:0/3088219678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cec109e80 0x7f2cec11a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.087+0000 7f2cebe00640 1 -- 172.21.15.37:0/3088219678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cec115740 msgr2=0x7f2cec1200f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:19.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.087+0000 7f2cebe00640 1 --2- 172.21.15.37:0/3088219678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cec115740 0x7f2cec1200f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.087+0000 7f2cebe00640 1 -- 172.21.15.37:0/3088219678 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec120630 con 0x7f2cec10a7a0 2024-08-20T05:13:19.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.088+0000 7f2cebe00640 1 --2- 172.21.15.37:0/3088219678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cec10a7a0 0x7f2cec11ad50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000e9c0 tx=0x7f2ce000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:19.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.088+0000 7f2ce9600640 1 -- 172.21.15.37:0/3088219678 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce000ccc0 con 0x7f2cec10a7a0 2024-08-20T05:13:19.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.088+0000 7f2ce9600640 1 -- 172.21.15.37:0/3088219678 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ce00054d0 con 0x7f2cec10a7a0 2024-08-20T05:13:19.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.088+0000 7f2ce9600640 1 -- 172.21.15.37:0/3088219678 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0010430 con 0x7f2cec10a7a0 2024-08-20T05:13:19.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.088+0000 7f2cf3600640 1 -- 172.21.15.37:0/3088219678 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cec120920 con 0x7f2cec10a7a0 2024-08-20T05:13:19.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.090+0000 7f2cf3600640 1 -- 172.21.15.37:0/3088219678 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cec120e10 con 0x7f2cec10a7a0 2024-08-20T05:13:19.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.097+0000 7f2ce9600640 1 -- 172.21.15.37:0/3088219678 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2ce0004f80 con 0x7f2cec10a7a0 2024-08-20T05:13:19.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.098+0000 7f2cf603d740 1 Processor -- start 2024-08-20T05:13:19.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.098+0000 7f2cf603d740 1 -- start start 2024-08-20T05:13:19.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.100+0000 7f2cf603d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd2987940 0x55cfd2987d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.100+0000 7f2cf603d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 0x55cfd2993cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.100+0000 7f2cf603d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd29941f0 0x55cfd29965e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.100+0000 7f2cf603d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cfd28fdaa0 con 0x55cfd2988260 2024-08-20T05:13:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.100+0000 7f2cf603d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cfd28ecfa0 con 0x55cfd29941f0 2024-08-20T05:13:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.100+0000 7f2cf603d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cfd28f0fe0 con 0x55cfd2987940 2024-08-20T05:13:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.100+0000 7f2cf0c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 0x55cfd2993cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:19.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.100+0000 7f2cf1600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd2987940 0x55cfd2987d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.100+0000 7f2cf1600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd2987940 0x55cfd2987d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:58998/0 (socket says 172.21.15.37:58998) 2024-08-20T05:13:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.100+0000 7f2cf0c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 0x55cfd2993cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36860/0 (socket says 172.21.15.37:36860) 2024-08-20T05:13:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.100+0000 7f2cf1600640 1 -- 172.21.15.37:0/1620389197 learned_addr learned my addr 172.21.15.37:0/1620389197 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.100+0000 7f2cebe00640 1 --2- 172.21.15.37:0/1620389197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd29941f0 0x55cfd29965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.101+0000 7f2cf0c00640 1 -- 172.21.15.37:0/1620389197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd2987940 msgr2=0x55cfd2987d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.101+0000 7f2cf0c00640 1 --2- 172.21.15.37:0/1620389197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd2987940 0x55cfd2987d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.101+0000 7f2cf0c00640 1 -- 172.21.15.37:0/1620389197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd29941f0 msgr2=0x55cfd29965e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.101+0000 7f2cf0c00640 1 --2- 172.21.15.37:0/1620389197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd29941f0 0x55cfd29965e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.101+0000 7f2cf0c00640 1 -- 172.21.15.37:0/1620389197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfd2893420 con 0x55cfd2988260 2024-08-20T05:13:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.101+0000 7f2cf0c00640 1 --2- 172.21.15.37:0/1620389197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 0x55cfd2993cb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009b40 tx=0x7f2cd800e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687619f7216e99cb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.102+0000 7f2cddc00640 1 -- 172.21.15.37:0/1620389197 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd800ed80 con 0x55cfd2988260 2024-08-20T05:13:19.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.102+0000 7f2cddc00640 1 -- 172.21.15.37:0/1620389197 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cd8005020 con 0x55cfd2988260 2024-08-20T05:13:19.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.102+0000 7f2cddc00640 1 -- 172.21.15.37:0/1620389197 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8004a00 con 0x55cfd2988260 2024-08-20T05:13:19.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.102+0000 7f2ce9600640 1 --2- 172.21.15.37:0/3088219678 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2cd40b3c50 0x7f2cd40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.103+0000 7f2cf603d740 1 -- 172.21.15.37:0/1620389197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 msgr2=0x55cfd2993cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:19.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.103+0000 7f2cf603d740 1 --2- 172.21.15.37:0/1620389197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 0x55cfd2993cb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009b40 tx=0x7f2cd800e350 comp rx=0 tx=0).stop 2024-08-20T05:13:19.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.105+0000 7f2cf1600640 1 --2- 172.21.15.37:0/3088219678 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2cd40b3c50 0x7f2cd40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.105+0000 7f2ce9600640 1 -- 172.21.15.37:0/3088219678 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2ce00e42d0 con 0x7f2cec10a7a0 2024-08-20T05:13:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.105+0000 7f2cf603d740 1 -- 172.21.15.37:0/1620389197 shutdown_connections 2024-08-20T05:13:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.105+0000 7f2cf603d740 1 --2- 172.21.15.37:0/1620389197 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd29941f0 0x55cfd29965e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.105+0000 7f2cf603d740 1 --2- 172.21.15.37:0/1620389197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 0x55cfd2993cb0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.105+0000 7f2cf603d740 1 --2- 172.21.15.37:0/1620389197 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd2987940 0x55cfd2987d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.105+0000 7f2cf603d740 1 -- 172.21.15.37:0/1620389197 >> 172.21.15.37:0/1620389197 conn(0x55cfd2985770 msgr2=0x55cfd2986910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.105+0000 7f2cf603d740 1 -- 172.21.15.37:0/1620389197 shutdown_connections 2024-08-20T05:13:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.105+0000 7f2cf603d740 1 -- 172.21.15.37:0/1620389197 wait complete. 2024-08-20T05:13:19.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.106+0000 7f2cf603d740 1 -- start start 2024-08-20T05:13:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.108+0000 7f2cf603d740 1 Processor -- start 2024-08-20T05:13:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.109+0000 7f2cf603d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2987940 0x55cfd29939e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.109+0000 7f2cf603d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 0x55cfd2990e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.109+0000 7f2cf603d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 0x55cfd2991370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.109+0000 7f2cf603d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cfd274f700 con 0x55cfd2988260 2024-08-20T05:13:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.109+0000 7f2cf603d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55cfd2888290 con 0x55cfd2987940 2024-08-20T05:13:19.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.109+0000 7f2cf603d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55cfd2996e70 con 0x55cfd29941f0 2024-08-20T05:13:19.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.109+0000 7f2cf603d740 10 client.0 _ll_register_callbacks cb 0x55cfd28e71c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:19.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.110+0000 7f2cf1600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 0x55cfd2991370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:19.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.110+0000 7f2cebe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 0x55cfd2990e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:19.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.110+0000 7f2cf1600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 0x55cfd2991370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:59014/0 (socket says 172.21.15.37:59014) 2024-08-20T05:13:19.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.110+0000 7f2cf1600640 1 -- 172.21.15.37:0/3274764062 learned_addr learned my addr 172.21.15.37:0/3274764062 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:19.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.110+0000 7f2cf0c00640 1 --2- 172.21.15.37:0/3274764062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2987940 0x55cfd29939e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:19.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.111+0000 7f2cf1600640 1 -- 172.21.15.37:0/3274764062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2987940 msgr2=0x55cfd29939e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:19.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.111+0000 7f2cf1600640 1 --2- 172.21.15.37:0/3274764062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2987940 0x55cfd29939e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.111+0000 7f2cf1600640 1 -- 172.21.15.37:0/3274764062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 msgr2=0x55cfd2990e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:19.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.112+0000 7f2cf1600640 1 --2- 172.21.15.37:0/3274764062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 0x55cfd2990e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.112+0000 7f2cf1600640 1 -- 172.21.15.37:0/3274764062 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfd264c650 con 0x55cfd29941f0 2024-08-20T05:13:19.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.112+0000 7f2cebe00640 1 --2- 172.21.15.37:0/3274764062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 0x55cfd2990e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:19.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.112+0000 7f2cf1600640 1 --2- 172.21.15.37:0/3274764062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 0x55cfd2991370 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4034040 tx=0x7f2ce4030c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8c84f1f4a667647 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:19.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.112+0000 7f2cd2000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:13:19.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.114+0000 7f2cd2000640 1 -- 172.21.15.37:0/3274764062 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4036040 con 0x55cfd29941f0 2024-08-20T05:13:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.114+0000 7f2cd2000640 1 -- 172.21.15.37:0/3274764062 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2ce4004250 con 0x55cfd29941f0 2024-08-20T05:13:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.115+0000 7f2cf603d740 1 -- 172.21.15.37:0/3274764062 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cd8005020 con 0x55cfd29941f0 2024-08-20T05:13:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.115+0000 7f2cd2000640 1 -- 172.21.15.37:0/3274764062 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f2ce4031440 con 0x55cfd29941f0 2024-08-20T05:13:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.115+0000 7f2cf603d740 10 client.28207 fetch_fsmap learned FSMap version 46 2024-08-20T05:13:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.115+0000 7f2cf603d740 1 -- 172.21.15.37:0/3274764062 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55cfd29a2760 con 0x55cfd29941f0 2024-08-20T05:13:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.115+0000 7f2cd2000640 1 -- 172.21.15.37:0/3274764062 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cd8005020 con 0x55cfd29941f0 2024-08-20T05:13:19.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.116+0000 7f2cd2000640 1 -- 172.21.15.37:0/3274764062 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 46) ==== 8378+0+0 (secure 0 0 0) 0x7f2ce4031cc0 con 0x55cfd29941f0 2024-08-20T05:13:19.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.116+0000 7f2cf603d740 10 client.28207 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T05:13:19.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.116+0000 7f2cf603d740 10 client.28207 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:13:19.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.116+0000 7f2cf603d740 20 client.28207 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:19.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.116+0000 7f2cf603d740 1 --2- 172.21.15.37:0/3274764062 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55cfd29a3c20 0x55cfd29a6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.116+0000 7f2cf603d740 4 client.28207 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:13:19.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.116+0000 7f2cf603d740 1 -- 172.21.15.37:0/3274764062 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfd28ff9f0 con 0x55cfd29a3c20 2024-08-20T05:13:19.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.118+0000 7f2cf0c00640 1 --2- 172.21.15.37:0/3274764062 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55cfd29a3c20 0x55cfd29a6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:19.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.118+0000 7f2cf1600640 1 --2- 172.21.15.37:0/3088219678 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2cd40b3c50 0x7f2cd40b6110 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2ce404b000 tx=0x7f2ce4048000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:19.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.119+0000 7f2cd2000640 10 client.28207 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:13:19.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.119+0000 7f2cf0c00640 1 --2- 172.21.15.37:0/3274764062 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55cfd29a3c20 0x55cfd29a6030 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=20314ff20a2a9646 server_cookie=b172f7339fbd9298 in_seq=0 out_seq=0 2024-08-20T05:13:19.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.119+0000 7f2cd2000640 1 -- 172.21.15.37:0/3274764062 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cfd28ff9f0 con 0x55cfd29a3c20 2024-08-20T05:13:19.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.119+0000 7f2cd2000640 10 client.28207 handle_command_reply: tid=0 2024-08-20T05:13:19.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.120+0000 7f2cf603d740 1 client.28207 shutdown 2024-08-20T05:13:19.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.120+0000 7f2cf603d740 1 -- 172.21.15.37:0/3274764062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 msgr2=0x55cfd2991370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:19.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.120+0000 7f2cf603d740 1 --2- 172.21.15.37:0/3274764062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 0x55cfd2991370 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4034040 tx=0x7f2ce4030c60 comp rx=0 tx=0).stop 2024-08-20T05:13:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.120+0000 7f2cf603d740 1 -- 172.21.15.37:0/3274764062 shutdown_connections 2024-08-20T05:13:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.120+0000 7f2cf603d740 1 --2- 172.21.15.37:0/3274764062 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55cfd29a3c20 0x55cfd29a6030 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.120+0000 7f2cf603d740 1 --2- 172.21.15.37:0/3274764062 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 0x55cfd2991370 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.120+0000 7f2cd2000640 0 client.28207 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:13:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.120+0000 7f2cf603d740 1 --2- 172.21.15.37:0/3274764062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 0x55cfd2990e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.120+0000 7f2cf603d740 1 --2- 172.21.15.37:0/3274764062 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2987940 0x55cfd29939e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.120+0000 7f2cf603d740 1 -- 172.21.15.37:0/3274764062 >> 172.21.15.37:0/3274764062 conn(0x55cfd2985770 msgr2=0x55cfd298b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:19.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.121+0000 7f2cf603d740 1 -- 172.21.15.37:0/3274764062 shutdown_connections 2024-08-20T05:13:19.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.121+0000 7f2cf603d740 1 -- 172.21.15.37:0/3274764062 wait complete. 2024-08-20T05:13:19.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.121+0000 7f2cf603d740 20 client.28207 trim_cache size 0 max 16384 2024-08-20T05:13:19.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.141+0000 7f2cf603d740 1 Processor -- start 2024-08-20T05:13:19.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.141+0000 7f2cf603d740 1 -- start start 2024-08-20T05:13:19.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.142+0000 7f2cf603d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2987940 0x55cfd2984030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.142+0000 7f2cf603d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2988260 0x55cfd29ab900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.142+0000 7f2cf603d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 0x55cfd29abe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.142+0000 7f2cf603d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec07ec10 con 0x55cfd2987940 2024-08-20T05:13:19.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.142+0000 7f2cf603d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec080750 con 0x55cfd2988260 2024-08-20T05:13:19.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.142+0000 7f2cf603d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec07f2e0 con 0x55cfd29941f0 2024-08-20T05:13:19.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.142+0000 7f2cf0c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2987940 0x55cfd2984030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:19.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.142+0000 7f2cebe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2988260 0x55cfd29ab900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:19.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.142+0000 7f2cf0c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2987940 0x55cfd2984030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36888/0 (socket says 172.21.15.37:36888) 2024-08-20T05:13:19.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.142+0000 7f2cebe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2988260 0x55cfd29ab900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43994/0 (socket says 172.21.15.37:43994) 2024-08-20T05:13:19.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.142+0000 7f2cf0c00640 1 -- 172.21.15.37:0/1913383265 learned_addr learned my addr 172.21.15.37:0/1913383265 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:19.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.142+0000 7f2cf1600640 1 --2- 172.21.15.37:0/1913383265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 0x55cfd29abe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:19.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.142+0000 7f2cf1600640 1 -- 172.21.15.37:0/1913383265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2988260 msgr2=0x55cfd29ab900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:19.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.142+0000 7f2cf1600640 1 --2- 172.21.15.37:0/1913383265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2988260 0x55cfd29ab900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.142+0000 7f2cf1600640 1 -- 172.21.15.37:0/1913383265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2987940 msgr2=0x55cfd2984030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:19.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.142+0000 7f2cf1600640 1 --2- 172.21.15.37:0/1913383265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2987940 0x55cfd2984030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.142+0000 7f2cf1600640 1 -- 172.21.15.37:0/1913383265 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfd298c9e0 con 0x55cfd29941f0 2024-08-20T05:13:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.143+0000 7f2cf1600640 1 --2- 172.21.15.37:0/1913383265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 0x55cfd29abe40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4031010 tx=0x7f2ce4030fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c06a586a89ff6425 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.143+0000 7f2cdd200640 1 -- 172.21.15.37:0/1913383265 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4036040 con 0x55cfd29941f0 2024-08-20T05:13:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.143+0000 7f2cdd200640 1 -- 172.21.15.37:0/1913383265 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ce4009a60 con 0x55cfd29941f0 2024-08-20T05:13:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.143+0000 7f2cdd200640 1 -- 172.21.15.37:0/1913383265 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce40097e0 con 0x55cfd29941f0 2024-08-20T05:13:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.144+0000 7f2cf603d740 1 -- 172.21.15.37:0/1913383265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 msgr2=0x55cfd29abe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.144+0000 7f2cf603d740 1 --2- 172.21.15.37:0/1913383265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 0x55cfd29abe40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4031010 tx=0x7f2ce4030fa0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.144+0000 7f2cf603d740 1 -- 172.21.15.37:0/1913383265 shutdown_connections 2024-08-20T05:13:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.144+0000 7f2cf603d740 1 --2- 172.21.15.37:0/1913383265 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 0x55cfd29abe40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.144+0000 7f2cf603d740 1 --2- 172.21.15.37:0/1913383265 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2988260 0x55cfd29ab900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.144+0000 7f2cf603d740 1 --2- 172.21.15.37:0/1913383265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2987940 0x55cfd2984030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.144+0000 7f2cf603d740 1 -- 172.21.15.37:0/1913383265 >> 172.21.15.37:0/1913383265 conn(0x55cfd2985770 msgr2=0x55cfd2992c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:19.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.144+0000 7f2cf603d740 1 -- 172.21.15.37:0/1913383265 shutdown_connections 2024-08-20T05:13:19.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.144+0000 7f2cf603d740 1 -- 172.21.15.37:0/1913383265 wait complete. 2024-08-20T05:13:19.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.145+0000 7f2cf603d740 1 -- start start 2024-08-20T05:13:19.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.145+0000 7f2cf603d740 1 Processor -- start 2024-08-20T05:13:19.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.146+0000 7f2cf603d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2987940 0x55cfd299c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.146+0000 7f2cf603d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 0x55cfd2999c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.146+0000 7f2cf603d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 0x55cfd299a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.146+0000 7f2cf603d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec080080 con 0x55cfd2988260 2024-08-20T05:13:19.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.146+0000 7f2cf603d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec07f9b0 con 0x55cfd2987940 2024-08-20T05:13:19.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.146+0000 7f2cf603d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec10a260 con 0x55cfd29941f0 2024-08-20T05:13:19.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.146+0000 7f2cf603d740 10 client.0 _ll_register_callbacks cb 0x7f2cd8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:19.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.146+0000 7f2cf0c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2987940 0x55cfd299c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:19.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.146+0000 7f2cf0c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2987940 0x55cfd299c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43996/0 (socket says 172.21.15.37:43996) 2024-08-20T05:13:19.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.146+0000 7f2cf0c00640 1 -- 172.21.15.37:0/1931184187 learned_addr learned my addr 172.21.15.37:0/1931184187 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:19.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.146+0000 7f2cebe00640 1 --2- 172.21.15.37:0/1931184187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 0x55cfd2999c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:19.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.146+0000 7f2cf0c00640 1 -- 172.21.15.37:0/1931184187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 msgr2=0x55cfd299a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:19.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.146+0000 7f2cf1600640 1 --2- 172.21.15.37:0/1931184187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 0x55cfd299a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:19.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.146+0000 7f2cf0c00640 1 --2- 172.21.15.37:0/1931184187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 0x55cfd299a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.146+0000 7f2cf0c00640 1 -- 172.21.15.37:0/1931184187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 msgr2=0x55cfd2999c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:19.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.146+0000 7f2cf0c00640 1 --2- 172.21.15.37:0/1931184187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 0x55cfd2999c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.146+0000 7f2cf0c00640 1 -- 172.21.15.37:0/1931184187 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfd299a9e0 con 0x55cfd2987940 2024-08-20T05:13:19.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.147+0000 7f2cf0c00640 1 --2- 172.21.15.37:0/1931184187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2987940 0x55cfd299c780 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8000c00 tx=0x7f2cd8005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d61cd4caa53c8e26 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:19.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.147+0000 7f2cd2000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:13:19.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.147+0000 7f2cd2000640 1 -- 172.21.15.37:0/1931184187 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8033060 con 0x55cfd2987940 2024-08-20T05:13:19.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.148+0000 7f2cd2000640 1 -- 172.21.15.37:0/1931184187 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2cd800ecc0 con 0x55cfd2987940 2024-08-20T05:13:19.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.148+0000 7f2cf603d740 1 -- 172.21.15.37:0/1931184187 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ce4009a60 con 0x55cfd2987940 2024-08-20T05:13:19.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.148+0000 7f2cd2000640 1 -- 172.21.15.37:0/1931184187 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f2cd80097d0 con 0x55cfd2987940 2024-08-20T05:13:19.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.149+0000 7f2cf603d740 10 client.28190 fetch_fsmap learned FSMap version 46 2024-08-20T05:13:19.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.149+0000 7f2cf603d740 1 -- 172.21.15.37:0/1931184187 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55cfd2a0e8c0 con 0x55cfd2987940 2024-08-20T05:13:19.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.149+0000 7f2cd2000640 1 -- 172.21.15.37:0/1931184187 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ce4009a60 con 0x55cfd2987940 2024-08-20T05:13:19.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.150+0000 7f2cd2000640 1 -- 172.21.15.37:0/1931184187 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 46) ==== 8378+0+0 (secure 0 0 0) 0x7f2cd8004be0 con 0x55cfd2987940 2024-08-20T05:13:19.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.150+0000 7f2cf603d740 10 client.28190 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T05:13:19.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.150+0000 7f2cf603d740 10 client.28190 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:13:19.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.150+0000 7f2cf603d740 20 client.28190 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:19.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.150+0000 7f2cf603d740 1 --2- 172.21.15.37:0/1931184187 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55cfd2a0ee00 0x55cfd2a11220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:19.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.150+0000 7f2cf603d740 4 client.28190 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:13:19.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.150+0000 7f2cf603d740 1 -- 172.21.15.37:0/1931184187 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cfd2984ee0 con 0x55cfd2a0ee00 2024-08-20T05:13:19.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.151+0000 7f2cebe00640 1 --2- 172.21.15.37:0/1931184187 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55cfd2a0ee00 0x55cfd2a11220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:19.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.154+0000 7f2cebe00640 1 --2- 172.21.15.37:0/1931184187 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55cfd2a0ee00 0x55cfd2a11220 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=de3fd753e9a7aebe server_cookie=774e336f80eeaf5a in_seq=0 out_seq=0 2024-08-20T05:13:19.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.154+0000 7f2cd2000640 10 client.28190 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:13:19.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.155+0000 7f2cd2000640 1 -- 172.21.15.37:0/1931184187 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cfd2984ee0 con 0x55cfd2a0ee00 2024-08-20T05:13:19.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.155+0000 7f2cd2000640 10 client.28190 handle_command_reply: tid=0 2024-08-20T05:13:19.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.155+0000 7f2cf603d740 1 client.28190 shutdown 2024-08-20T05:13:19.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.155+0000 7f2cf603d740 1 -- 172.21.15.37:0/1931184187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2987940 msgr2=0x55cfd299c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:19.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.155+0000 7f2cf603d740 1 --2- 172.21.15.37:0/1931184187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2987940 0x55cfd299c780 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8000c00 tx=0x7f2cd8005f10 comp rx=0 tx=0).stop 2024-08-20T05:13:19.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.155+0000 7f2cf603d740 1 -- 172.21.15.37:0/1931184187 shutdown_connections 2024-08-20T05:13:19.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.155+0000 7f2cf603d740 1 --2- 172.21.15.37:0/1931184187 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55cfd2a0ee00 0x55cfd2a11220 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.155+0000 7f2cf603d740 1 --2- 172.21.15.37:0/1931184187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55cfd29941f0 0x55cfd299a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.155+0000 7f2cf603d740 1 --2- 172.21.15.37:0/1931184187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cfd2988260 0x55cfd2999c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.155+0000 7f2cf603d740 1 --2- 172.21.15.37:0/1931184187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55cfd2987940 0x55cfd299c780 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.155+0000 7f2cf603d740 1 -- 172.21.15.37:0/1931184187 >> 172.21.15.37:0/1931184187 conn(0x55cfd2985770 msgr2=0x55cfd298f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:19.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.155+0000 7f2cd2000640 0 client.28190 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:13:19.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.155+0000 7f2cf603d740 1 -- 172.21.15.37:0/1931184187 shutdown_connections 2024-08-20T05:13:19.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.156+0000 7f2cf603d740 1 -- 172.21.15.37:0/1931184187 wait complete. 2024-08-20T05:13:19.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.156+0000 7f2cf603d740 20 client.28190 trim_cache size 0 max 16384 2024-08-20T05:13:19.159 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:13:19.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.157+0000 7f2cf3600640 1 -- 172.21.15.37:0/3088219678 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2cd40b3c50 msgr2=0x7f2cd40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:19.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.157+0000 7f2cf3600640 1 --2- 172.21.15.37:0/3088219678 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2cd40b3c50 0x7f2cd40b6110 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2ce404b000 tx=0x7f2ce4048000 comp rx=0 tx=0).stop 2024-08-20T05:13:19.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.157+0000 7f2cf3600640 1 -- 172.21.15.37:0/3088219678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cec10a7a0 msgr2=0x7f2cec11ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:19.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.157+0000 7f2cf3600640 1 --2- 172.21.15.37:0/3088219678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cec10a7a0 0x7f2cec11ad50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000e9c0 tx=0x7f2ce000ee80 comp rx=0 tx=0).stop 2024-08-20T05:13:19.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.157+0000 7f2cf3600640 1 -- 172.21.15.37:0/3088219678 shutdown_connections 2024-08-20T05:13:19.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.157+0000 7f2cf3600640 1 --2- 172.21.15.37:0/3088219678 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2cd40b3c50 0x7f2cd40b6110 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.157+0000 7f2cf3600640 1 --2- 172.21.15.37:0/3088219678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2cec115740 0x7f2cec1200f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.157+0000 7f2cf3600640 1 --2- 172.21.15.37:0/3088219678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2cec10a7a0 0x7f2cec11ad50 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.157+0000 7f2cf3600640 1 --2- 172.21.15.37:0/3088219678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2cec109e80 0x7f2cec11a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:19.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.157+0000 7f2cf3600640 1 -- 172.21.15.37:0/3088219678 >> 172.21.15.37:0/3088219678 conn(0x7f2cec06dcc0 msgr2=0x7f2cec072600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:19.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.157+0000 7f2cf3600640 1 -- 172.21.15.37:0/3088219678 shutdown_connections 2024-08-20T05:13:19.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:19.157+0000 7f2cf3600640 1 -- 172.21.15.37:0/3088219678 wait complete. 2024-08-20T05:13:19.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:19 smithi135 ceph-mon[22342]: pgmap v733: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.4 MiB/s wr, 457 op/s 2024-08-20T05:13:19.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:19 smithi130 ceph-mon[22007]: pgmap v733: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.4 MiB/s wr, 457 op/s 2024-08-20T05:13:20.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:19 smithi037 ceph-mon[17265]: pgmap v733: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.4 MiB/s wr, 457 op/s 2024-08-20T05:13:21.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:21 smithi135 ceph-mon[22342]: pgmap v734: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.2 MiB/s wr, 544 op/s 2024-08-20T05:13:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:21 smithi130 ceph-mon[22007]: pgmap v734: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.2 MiB/s wr, 544 op/s 2024-08-20T05:13:22.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:21 smithi037 ceph-mon[17265]: pgmap v734: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.2 MiB/s wr, 544 op/s 2024-08-20T05:13:22.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T05:13:23.013 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:13:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 625.0 s, 493.6 tps, lat 208.578 ms stddev 249.261 2024-08-20T05:13:23.739 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:23 smithi037 ceph-mon[17265]: pgmap v735: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 437 op/s 2024-08-20T05:13:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:23 smithi135 ceph-mon[22342]: pgmap v735: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 437 op/s 2024-08-20T05:13:23.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.895+0000 7fa8baa00640 1 -- 172.21.15.37:0/2045478612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8b411bdd0 msgr2=0x7fa8b411e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:23.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.897+0000 7fa8baa00640 1 --2- 172.21.15.37:0/2045478612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8b411bdd0 0x7fa8b411e1c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009900 tx=0x7fa8a002a4a0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.898+0000 7fa8baa00640 1 -- 172.21.15.37:0/2045478612 shutdown_connections 2024-08-20T05:13:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.898+0000 7fa8baa00640 1 --2- 172.21.15.37:0/2045478612 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8b411bdd0 0x7fa8b411e1c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.898+0000 7fa8baa00640 1 --2- 172.21.15.37:0/2045478612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b410a260 0x7fa8b410a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.898+0000 7fa8baa00640 1 --2- 172.21.15.37:0/2045478612 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8b4109e80 0x7fa8b4110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.898+0000 7fa8baa00640 1 -- 172.21.15.37:0/2045478612 >> 172.21.15.37:0/2045478612 conn(0x7fa8b406dcc0 msgr2=0x7fa8b406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:23.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.899+0000 7fa8baa00640 1 -- 172.21.15.37:0/2045478612 shutdown_connections 2024-08-20T05:13:23.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.899+0000 7fa8baa00640 1 -- 172.21.15.37:0/2045478612 wait complete. 2024-08-20T05:13:23.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.902+0000 7fa8baa00640 1 Processor -- start 2024-08-20T05:13:23.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.902+0000 7fa8baa00640 1 -- start start 2024-08-20T05:13:23.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.903+0000 7fa8baa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8b4109e80 0x7fa8b41a7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:23.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.903+0000 7fa8baa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8b410a260 0x7fa8b41a8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:23.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.904+0000 7fa8baa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b411bdd0 0x7fa8b41ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:23.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.905+0000 7fa8b3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8b4109e80 0x7fa8b41a7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:23.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.905+0000 7fa8b3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8b4109e80 0x7fa8b41a7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51716/0 (socket says 172.21.15.37:51716) 2024-08-20T05:13:23.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.905+0000 7fa8b3400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8b410a260 0x7fa8b41a8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:23.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.905+0000 7fa8b3400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8b410a260 0x7fa8b41a8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53790/0 (socket says 172.21.15.37:53790) 2024-08-20T05:13:23.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.906+0000 7fa8b3e00640 1 -- 172.21.15.37:0/4237513513 learned_addr learned my addr 172.21.15.37:0/4237513513 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:23.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.907+0000 7fa8baa00640 1 -- 172.21.15.37:0/4237513513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b4121990 con 0x7fa8b411bdd0 2024-08-20T05:13:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.907+0000 7fa8baa00640 1 -- 172.21.15.37:0/4237513513 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b4121810 con 0x7fa8b410a260 2024-08-20T05:13:23.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.907+0000 7fa8baa00640 1 -- 172.21.15.37:0/4237513513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b4121b10 con 0x7fa8b4109e80 2024-08-20T05:13:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.908+0000 7fa8b8a00640 1 --2- 172.21.15.37:0/4237513513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b411bdd0 0x7fa8b41ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.908+0000 7fa8b3e00640 1 -- 172.21.15.37:0/4237513513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8b410a260 msgr2=0x7fa8b41a8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.908+0000 7fa8b3e00640 1 --2- 172.21.15.37:0/4237513513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8b410a260 0x7fa8b41a8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.908+0000 7fa8b3e00640 1 -- 172.21.15.37:0/4237513513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b411bdd0 msgr2=0x7fa8b41ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.908+0000 7fa8b3e00640 1 --2- 172.21.15.37:0/4237513513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b411bdd0 0x7fa8b41ad7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.908+0000 7fa8b3e00640 1 -- 172.21.15.37:0/4237513513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b41adf90 con 0x7fa8b4109e80 2024-08-20T05:13:23.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.909+0000 7fa8b3e00640 1 --2- 172.21.15.37:0/4237513513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8b4109e80 0x7fa8b41a7ee0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00ba50 tx=0x7fa8ac00be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.910+0000 7fa8b0c00640 1 -- 172.21.15.37:0/4237513513 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac019070 con 0x7fa8b4109e80 2024-08-20T05:13:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.910+0000 7fa8b0c00640 1 -- 172.21.15.37:0/4237513513 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8ac014440 con 0x7fa8b4109e80 2024-08-20T05:13:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.910+0000 7fa8b0c00640 1 -- 172.21.15.37:0/4237513513 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0075b0 con 0x7fa8b4109e80 2024-08-20T05:13:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.911+0000 7fa8baa00640 1 -- 172.21.15.37:0/4237513513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b41ae280 con 0x7fa8b4109e80 2024-08-20T05:13:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.911+0000 7fa8baa00640 1 -- 172.21.15.37:0/4237513513 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b41b49c0 con 0x7fa8b4109e80 2024-08-20T05:13:23.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.924+0000 7fa8bd408740 1 Processor -- start 2024-08-20T05:13:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.925+0000 7fa8b0c00640 1 -- 172.21.15.37:0/4237513513 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa8ac0145f0 con 0x7fa8b4109e80 2024-08-20T05:13:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.928+0000 7fa8bd408740 1 -- start start 2024-08-20T05:13:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.929+0000 7fa8b0c00640 1 --2- 172.21.15.37:0/4237513513 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa8980b3d20 0x7fa8980b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:23.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.929+0000 7fa8bd408740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5869990 0x5631e5869d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:23.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.929+0000 7fa8bd408740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e586a2b0 0x5631e5875d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:23.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.929+0000 7fa8bd408740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5876240 0x5631e5878630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:23.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.929+0000 7fa8bd408740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5631e57dfaa0 con 0x5631e5876240 2024-08-20T05:13:23.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.929+0000 7fa8b0c00640 1 -- 172.21.15.37:0/4237513513 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa8ac0e3460 con 0x7fa8b4109e80 2024-08-20T05:13:23.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.929+0000 7fa8bd408740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5631e57cefa0 con 0x5631e5869990 2024-08-20T05:13:23.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.929+0000 7fa8bd408740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5631e57d2fe0 con 0x5631e586a2b0 2024-08-20T05:13:23.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.930+0000 7fa8b8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5876240 0x5631e5878630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:23.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.930+0000 7fa8b8a00640 1 --2- 172.21.15.37:0/4237513513 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa8980b3d20 0x7fa8980b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:23.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.930+0000 7fa8b8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5876240 0x5631e5878630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46514/0 (socket says 172.21.15.37:46514) 2024-08-20T05:13:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.931+0000 7fa8b8a00640 1 -- 172.21.15.37:0/3081927601 learned_addr learned my addr 172.21.15.37:0/3081927601 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.933+0000 7fa8b3e00640 1 --2- 172.21.15.37:0/3081927601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5869990 0x5631e5869d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.933+0000 7fa8b8a00640 1 --2- 172.21.15.37:0/4237513513 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa8980b3d20 0x7fa8980b61e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009900 tx=0x7fa8a0005bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.933+0000 7fa8b3e00640 1 -- 172.21.15.37:0/3081927601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e586a2b0 msgr2=0x5631e5875d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.933+0000 7fa8b3e00640 1 --2- 172.21.15.37:0/3081927601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e586a2b0 0x5631e5875d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.933+0000 7fa8b3e00640 1 -- 172.21.15.37:0/3081927601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5876240 msgr2=0x5631e5878630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:23.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.935+0000 7fa8b3e00640 1 --2- 172.21.15.37:0/3081927601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5876240 0x5631e5878630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.935+0000 7fa8b3e00640 1 -- 172.21.15.37:0/3081927601 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631e5775420 con 0x5631e5869990 2024-08-20T05:13:23.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.935+0000 7fa8b8a00640 1 --2- 172.21.15.37:0/3081927601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5876240 0x5631e5878630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:23.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.936+0000 7fa8b3e00640 1 --2- 172.21.15.37:0/3081927601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5869990 0x5631e5869d70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00ba20 tx=0x7fa8ac0a9be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f98e4a23f314e7a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:23.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.938+0000 7fa8a9200640 1 -- 172.21.15.37:0/3081927601 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0ae610 con 0x5631e5869990 2024-08-20T05:13:23.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.938+0000 7fa8a9200640 1 -- 172.21.15.37:0/3081927601 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8ac0b30c0 con 0x5631e5869990 2024-08-20T05:13:23.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.938+0000 7fa8a9200640 1 -- 172.21.15.37:0/3081927601 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0b2e90 con 0x5631e5869990 2024-08-20T05:13:23.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.939+0000 7fa8bd408740 1 -- 172.21.15.37:0/3081927601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5869990 msgr2=0x5631e5869d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:23.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.939+0000 7fa8bd408740 1 --2- 172.21.15.37:0/3081927601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5869990 0x5631e5869d70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00ba20 tx=0x7fa8ac0a9be0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.940+0000 7fa8bd408740 1 -- 172.21.15.37:0/3081927601 shutdown_connections 2024-08-20T05:13:23.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.940+0000 7fa8bd408740 1 --2- 172.21.15.37:0/3081927601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5876240 0x5631e5878630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.940+0000 7fa8bd408740 1 --2- 172.21.15.37:0/3081927601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e586a2b0 0x5631e5875d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.940+0000 7fa8bd408740 1 --2- 172.21.15.37:0/3081927601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5869990 0x5631e5869d70 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.940+0000 7fa8bd408740 1 -- 172.21.15.37:0/3081927601 >> 172.21.15.37:0/3081927601 conn(0x5631e58677c0 msgr2=0x5631e5868960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:23.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.940+0000 7fa8bd408740 1 -- 172.21.15.37:0/3081927601 shutdown_connections 2024-08-20T05:13:23.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.940+0000 7fa8bd408740 1 -- 172.21.15.37:0/3081927601 wait complete. 2024-08-20T05:13:23.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.941+0000 7fa8bd408740 1 -- start start 2024-08-20T05:13:23.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.941+0000 7fa8bd408740 1 Processor -- start 2024-08-20T05:13:23.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.945+0000 7fa8bd408740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e5869990 0x5631e5875ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:23.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.945+0000 7fa8bd408740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e586a2b0 0x5631e5872f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:23.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.945+0000 7fa8bd408740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 0x5631e58734c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:23.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.946+0000 7fa8bd408740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5631e5631700 con 0x5631e586a2b0 2024-08-20T05:13:23.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.946+0000 7fa8bd408740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5631e576a290 con 0x5631e5876240 2024-08-20T05:13:23.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.946+0000 7fa8bd408740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5631e5878ec0 con 0x5631e5869990 2024-08-20T05:13:23.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.946+0000 7fa8b8a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 0x5631e58734c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:23.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.946+0000 7fa8b8a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 0x5631e58734c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53812/0 (socket says 172.21.15.37:53812) 2024-08-20T05:13:23.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.946+0000 7fa8b8a00640 1 -- 172.21.15.37:0/4108027821 learned_addr learned my addr 172.21.15.37:0/4108027821 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:23.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.947+0000 7fa8b3400640 1 --2- 172.21.15.37:0/4108027821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e586a2b0 0x5631e5872f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:23.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.947+0000 7fa8bd408740 10 client.0 _ll_register_callbacks cb 0x5631e57c91c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.947+0000 7fa8b8a00640 1 -- 172.21.15.37:0/4108027821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e5869990 msgr2=0x5631e5875ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.947+0000 7fa8b8a00640 1 --2- 172.21.15.37:0/4108027821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e5869990 0x5631e5875ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.947+0000 7fa8b8a00640 1 -- 172.21.15.37:0/4108027821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e586a2b0 msgr2=0x5631e5872f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.947+0000 7fa8b8a00640 1 --2- 172.21.15.37:0/4108027821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e586a2b0 0x5631e5872f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.947+0000 7fa8b8a00640 1 -- 172.21.15.37:0/4108027821 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631e552e650 con 0x5631e5876240 2024-08-20T05:13:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.951+0000 7fa8b8a00640 1 --2- 172.21.15.37:0/4108027821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 0x5631e58734c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009230 tx=0x7fa8a0031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7be329e70e1d1918 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.951+0000 7fa89d600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:13:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.951+0000 7fa89d600640 1 -- 172.21.15.37:0/4108027821 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a004c070 con 0x5631e5876240 2024-08-20T05:13:23.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.951+0000 7fa8bd408740 1 -- 172.21.15.37:0/4108027821 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8ac0b30c0 con 0x5631e5876240 2024-08-20T05:13:23.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.951+0000 7fa89d600640 1 -- 172.21.15.37:0/4108027821 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa8a0031d30 con 0x5631e5876240 2024-08-20T05:13:23.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.952+0000 7fa89d600640 1 -- 172.21.15.37:0/4108027821 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fa8a0035040 con 0x5631e5876240 2024-08-20T05:13:23.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.952+0000 7fa8bd408740 10 client.28199 fetch_fsmap learned FSMap version 46 2024-08-20T05:13:23.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.952+0000 7fa8bd408740 1 -- 172.21.15.37:0/4108027821 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5631e58847c0 con 0x5631e5876240 2024-08-20T05:13:23.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.952+0000 7fa89d600640 1 -- 172.21.15.37:0/4108027821 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8ac0b30c0 con 0x5631e5876240 2024-08-20T05:13:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:23 smithi130 ceph-mon[22007]: pgmap v735: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.7 MiB/s wr, 437 op/s 2024-08-20T05:13:23.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.954+0000 7fa89d600640 1 -- 172.21.15.37:0/4108027821 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 46) ==== 8378+0+0 (secure 0 0 0) 0x7fa8a0046040 con 0x5631e5876240 2024-08-20T05:13:23.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.954+0000 7fa8bd408740 10 client.28199 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T05:13:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.954+0000 7fa8bd408740 10 client.28199 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:13:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.954+0000 7fa8bd408740 20 client.28199 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.954+0000 7fa8bd408740 1 --2- 172.21.15.37:0/4108027821 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5631e5885c20 0x5631e5888070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.954+0000 7fa8bd408740 4 client.28199 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:13:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.954+0000 7fa8bd408740 1 -- 172.21.15.37:0/4108027821 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631e57e19f0 con 0x5631e5885c20 2024-08-20T05:13:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.954+0000 7fa8b3e00640 1 --2- 172.21.15.37:0/4108027821 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5631e5885c20 0x5631e5888070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.955+0000 7fa8b3e00640 1 --2- 172.21.15.37:0/4108027821 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5631e5885c20 0x5631e5888070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9e2988da790bcc70 server_cookie=cdac6b582ec872e5 in_seq=0 out_seq=0 2024-08-20T05:13:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.955+0000 7fa89d600640 10 client.28199 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:13:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.956+0000 7fa89d600640 1 -- 172.21.15.37:0/4108027821 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631e57e19f0 con 0x5631e5885c20 2024-08-20T05:13:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.956+0000 7fa89d600640 10 client.28199 handle_command_reply: tid=0 2024-08-20T05:13:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.957+0000 7fa8bd408740 1 client.28199 shutdown 2024-08-20T05:13:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.957+0000 7fa8bd408740 1 -- 172.21.15.37:0/4108027821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 msgr2=0x5631e58734c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.957+0000 7fa8bd408740 1 --2- 172.21.15.37:0/4108027821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 0x5631e58734c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009230 tx=0x7fa8a0031400 comp rx=0 tx=0).stop 2024-08-20T05:13:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.958+0000 7fa8bd408740 1 -- 172.21.15.37:0/4108027821 shutdown_connections 2024-08-20T05:13:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.958+0000 7fa8bd408740 1 --2- 172.21.15.37:0/4108027821 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5631e5885c20 0x5631e5888070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.958+0000 7fa8bd408740 1 --2- 172.21.15.37:0/4108027821 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 0x5631e58734c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.958+0000 7fa8bd408740 1 --2- 172.21.15.37:0/4108027821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e586a2b0 0x5631e5872f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.958+0000 7fa8bd408740 1 --2- 172.21.15.37:0/4108027821 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e5869990 0x5631e5875ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.958+0000 7fa8bd408740 1 -- 172.21.15.37:0/4108027821 >> 172.21.15.37:0/4108027821 conn(0x5631e58677c0 msgr2=0x5631e586d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.958+0000 7fa89d600640 0 client.28199 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:13:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.958+0000 7fa8bd408740 1 -- 172.21.15.37:0/4108027821 shutdown_connections 2024-08-20T05:13:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.959+0000 7fa8bd408740 1 -- 172.21.15.37:0/4108027821 wait complete. 2024-08-20T05:13:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.959+0000 7fa8bd408740 20 client.28199 trim_cache size 0 max 16384 2024-08-20T05:13:23.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.992+0000 7fa8bd408740 1 Processor -- start 2024-08-20T05:13:23.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.993+0000 7fa8bd408740 1 -- start start 2024-08-20T05:13:23.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.993+0000 7fa8bd408740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5869990 0x5631e5871fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:23.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.994+0000 7fa8bd408740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e586a2b0 0x5631e5872500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:23.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.994+0000 7fa8b3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5869990 0x5631e5871fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:23.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.994+0000 7fa8b3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5869990 0x5631e5871fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46520/0 (socket says 172.21.15.37:46520) 2024-08-20T05:13:23.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.994+0000 7fa8bd408740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 0x5631e588d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:23.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.995+0000 7fa8b3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e586a2b0 0x5631e5872500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:23.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.995+0000 7fa8b3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e586a2b0 0x5631e5872500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51748/0 (socket says 172.21.15.37:51748) 2024-08-20T05:13:23.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.995+0000 7fa8bd408740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b41be6c0 con 0x5631e5869990 2024-08-20T05:13:23.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.995+0000 7fa8bd408740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b41c0200 con 0x5631e5876240 2024-08-20T05:13:23.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.995+0000 7fa8bd408740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b41bed90 con 0x5631e586a2b0 2024-08-20T05:13:23.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.995+0000 7fa8b3e00640 1 -- 172.21.15.37:0/3693426914 learned_addr learned my addr 172.21.15.37:0/3693426914 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:23.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.995+0000 7fa8b8a00640 1 --2- 172.21.15.37:0/3693426914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 0x5631e588d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:23.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.995+0000 7fa8b8a00640 1 -- 172.21.15.37:0/3693426914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e586a2b0 msgr2=0x5631e5872500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:23.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.995+0000 7fa8b8a00640 1 --2- 172.21.15.37:0/3693426914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e586a2b0 0x5631e5872500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.995+0000 7fa8b8a00640 1 -- 172.21.15.37:0/3693426914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5869990 msgr2=0x5631e5871fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:23.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.995+0000 7fa8b8a00640 1 --2- 172.21.15.37:0/3693426914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5869990 0x5631e5871fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:23.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.995+0000 7fa8b8a00640 1 -- 172.21.15.37:0/3693426914 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631e5868240 con 0x5631e5876240 2024-08-20T05:13:23.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.996+0000 7fa8b8a00640 1 --2- 172.21.15.37:0/3693426914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 0x5631e588d940 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0033000 tx=0x7fa8a0000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bc2e8f8c3912e4b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:23.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.996+0000 7fa89fe00640 1 -- 172.21.15.37:0/3693426914 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a004c040 con 0x5631e5876240 2024-08-20T05:13:23.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.997+0000 7fa89fe00640 1 -- 172.21.15.37:0/3693426914 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8a0031d30 con 0x5631e5876240 2024-08-20T05:13:23.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.997+0000 7fa89fe00640 1 -- 172.21.15.37:0/3693426914 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0051880 con 0x5631e5876240 2024-08-20T05:13:24.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.998+0000 7fa8bd408740 1 -- 172.21.15.37:0/3693426914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 msgr2=0x5631e588d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:24.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:23.998+0000 7fa8bd408740 1 --2- 172.21.15.37:0/3693426914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 0x5631e588d940 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0033000 tx=0x7fa8a0000bc0 comp rx=0 tx=0).stop 2024-08-20T05:13:24.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.000+0000 7fa8bd408740 1 -- 172.21.15.37:0/3693426914 shutdown_connections 2024-08-20T05:13:24.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.000+0000 7fa8bd408740 1 --2- 172.21.15.37:0/3693426914 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 0x5631e588d940 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:24.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.000+0000 7fa8bd408740 1 --2- 172.21.15.37:0/3693426914 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e586a2b0 0x5631e5872500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:24.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.000+0000 7fa8bd408740 1 --2- 172.21.15.37:0/3693426914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5869990 0x5631e5871fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:24.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.000+0000 7fa8bd408740 1 -- 172.21.15.37:0/3693426914 >> 172.21.15.37:0/3693426914 conn(0x5631e58677c0 msgr2=0x5631e5874df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:24.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.000+0000 7fa8bd408740 1 -- 172.21.15.37:0/3693426914 shutdown_connections 2024-08-20T05:13:24.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.000+0000 7fa8bd408740 1 -- 172.21.15.37:0/3693426914 wait complete. 2024-08-20T05:13:24.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.001+0000 7fa8bd408740 1 -- start start 2024-08-20T05:13:24.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.001+0000 7fa8bd408740 1 Processor -- start 2024-08-20T05:13:24.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.003+0000 7fa8bd408740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5869990 0x5631e587b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:24.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.003+0000 7fa8bd408740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e586a2b0 0x5631e587bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:24.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.003+0000 7fa8bd408740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 0x5631e58ee910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:24.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.003+0000 7fa8b3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e586a2b0 0x5631e587bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:24.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.003+0000 7fa8b3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5869990 0x5631e587b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:24.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.004+0000 7fa8b3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5869990 0x5631e587b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46522/0 (socket says 172.21.15.37:46522) 2024-08-20T05:13:24.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.004+0000 7fa8b3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e586a2b0 0x5631e587bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51752/0 (socket says 172.21.15.37:51752) 2024-08-20T05:13:24.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.004+0000 7fa8bd408740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b41bfb30 con 0x5631e5869990 2024-08-20T05:13:24.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.004+0000 7fa8bd408740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b41bf460 con 0x5631e5876240 2024-08-20T05:13:24.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.004+0000 7fa8bd408740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b41bc6a0 con 0x5631e586a2b0 2024-08-20T05:13:24.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.004+0000 7fa8b8a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 0x5631e58ee910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:24.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.004+0000 7fa8b8a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 0x5631e58ee910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53834/0 (socket says 172.21.15.37:53834) 2024-08-20T05:13:24.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.004+0000 7fa8b8a00640 1 -- 172.21.15.37:0/2865507678 learned_addr learned my addr 172.21.15.37:0/2865507678 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:24.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.005+0000 7fa8bd408740 10 client.0 _ll_register_callbacks cb 0x7fa8a0003b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:24.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.006+0000 7fa8b3400640 1 -- 172.21.15.37:0/2865507678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 msgr2=0x5631e58ee910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:24.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.006+0000 7fa8b3400640 1 --2- 172.21.15.37:0/2865507678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 0x5631e58ee910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:24.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.006+0000 7fa8b3400640 1 -- 172.21.15.37:0/2865507678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5869990 msgr2=0x5631e587b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:24.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.006+0000 7fa8b3400640 1 --2- 172.21.15.37:0/2865507678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5869990 0x5631e587b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:24.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.006+0000 7fa8b3400640 1 -- 172.21.15.37:0/2865507678 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631e58eef00 con 0x5631e586a2b0 2024-08-20T05:13:24.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.007+0000 7fa8b3e00640 1 --2- 172.21.15.37:0/2865507678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5869990 0x5631e587b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:24.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.008+0000 7fa8b3400640 1 --2- 172.21.15.37:0/2865507678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e586a2b0 0x5631e587bc80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x5631e5868550 tx=0x7fa8a40136b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11a0505fa1786dd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:24.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.008+0000 7fa89d600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:13:24.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.008+0000 7fa89d600640 1 -- 172.21.15.37:0/2865507678 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a401a030 con 0x5631e586a2b0 2024-08-20T05:13:24.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.009+0000 7fa89d600640 1 -- 172.21.15.37:0/2865507678 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa8a4016460 con 0x5631e586a2b0 2024-08-20T05:13:24.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.009+0000 7fa8bd408740 1 -- 172.21.15.37:0/2865507678 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8a0031d30 con 0x5631e586a2b0 2024-08-20T05:13:24.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.010+0000 7fa89d600640 1 -- 172.21.15.37:0/2865507678 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fa8a4009e40 con 0x5631e586a2b0 2024-08-20T05:13:24.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.011+0000 7fa8bd408740 10 client.28222 fetch_fsmap learned FSMap version 46 2024-08-20T05:13:24.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.011+0000 7fa8bd408740 1 -- 172.21.15.37:0/2865507678 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5631e58f0290 con 0x5631e586a2b0 2024-08-20T05:13:24.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.011+0000 7fa89d600640 1 -- 172.21.15.37:0/2865507678 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8a0031d30 con 0x5631e586a2b0 2024-08-20T05:13:24.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.012+0000 7fa89d600640 1 -- 172.21.15.37:0/2865507678 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 46) ==== 8378+0+0 (secure 0 0 0) 0x7fa8a4016ca0 con 0x5631e586a2b0 2024-08-20T05:13:24.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.012+0000 7fa8bd408740 10 client.28222 fetch_fsmap finished waiting for FSMap version 46 2024-08-20T05:13:24.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.012+0000 7fa8bd408740 10 client.28222 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:13:24.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.012+0000 7fa8bd408740 20 client.28222 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:24.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.012+0000 7fa8bd408740 1 --2- 172.21.15.37:0/2865507678 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5631e58f0a40 0x5631e58f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:24.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.012+0000 7fa8bd408740 4 client.28222 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:13:24.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.012+0000 7fa8bd408740 1 -- 172.21.15.37:0/2865507678 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5631e57dd490 con 0x5631e58f0a40 2024-08-20T05:13:24.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.013+0000 7fa8b3e00640 1 --2- 172.21.15.37:0/2865507678 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5631e58f0a40 0x5631e58f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:24.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.013+0000 7fa89d600640 10 client.28222 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:13:24.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.014+0000 7fa8b3e00640 1 --2- 172.21.15.37:0/2865507678 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5631e58f0a40 0x5631e58f2e60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ed587a88e24c113 server_cookie=aa2cf094b01c442c in_seq=0 out_seq=0 2024-08-20T05:13:24.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.016+0000 7fa89d600640 1 -- 172.21.15.37:0/2865507678 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5631e57dd490 con 0x5631e58f0a40 2024-08-20T05:13:24.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.016+0000 7fa89d600640 10 client.28222 handle_command_reply: tid=0 2024-08-20T05:13:24.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.016+0000 7fa8bd408740 1 client.28222 shutdown 2024-08-20T05:13:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.016+0000 7fa8bd408740 1 -- 172.21.15.37:0/2865507678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e586a2b0 msgr2=0x5631e587bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.016+0000 7fa8bd408740 1 --2- 172.21.15.37:0/2865507678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e586a2b0 0x5631e587bc80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x5631e5868550 tx=0x7fa8a40136b0 comp rx=0 tx=0).stop 2024-08-20T05:13:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.016+0000 7fa8bd408740 1 -- 172.21.15.37:0/2865507678 shutdown_connections 2024-08-20T05:13:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.016+0000 7fa8bd408740 1 --2- 172.21.15.37:0/2865507678 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5631e58f0a40 0x5631e58f2e60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.016+0000 7fa8bd408740 1 --2- 172.21.15.37:0/2865507678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5631e5876240 0x5631e58ee910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.016+0000 7fa8bd408740 1 --2- 172.21.15.37:0/2865507678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5631e586a2b0 0x5631e587bc80 secure :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0x5631e5868550 tx=0x7fa8a40136b0 comp rx=0 tx=0).stop 2024-08-20T05:13:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.016+0000 7fa8bd408740 1 --2- 172.21.15.37:0/2865507678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5631e5869990 0x5631e587b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:24.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.016+0000 7fa8bd408740 1 -- 172.21.15.37:0/2865507678 >> 172.21.15.37:0/2865507678 conn(0x5631e58677c0 msgr2=0x5631e5871fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.017+0000 7fa89d600640 0 client.28222 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:13:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.017+0000 7fa8bd408740 1 -- 172.21.15.37:0/2865507678 shutdown_connections 2024-08-20T05:13:24.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.017+0000 7fa8bd408740 1 -- 172.21.15.37:0/2865507678 wait complete. 2024-08-20T05:13:24.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.021+0000 7fa8bd408740 20 client.28222 trim_cache size 0 max 16384 2024-08-20T05:13:24.023 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:13:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.022+0000 7fa8baa00640 1 -- 172.21.15.37:0/4237513513 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa8980b3d20 msgr2=0x7fa8980b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:24.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.022+0000 7fa8baa00640 1 --2- 172.21.15.37:0/4237513513 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa8980b3d20 0x7fa8980b61e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009900 tx=0x7fa8a0005bb0 comp rx=0 tx=0).stop 2024-08-20T05:13:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.022+0000 7fa8baa00640 1 -- 172.21.15.37:0/4237513513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8b4109e80 msgr2=0x7fa8b41a7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:24.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.022+0000 7fa8baa00640 1 --2- 172.21.15.37:0/4237513513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8b4109e80 0x7fa8b41a7ee0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00ba50 tx=0x7fa8ac00be50 comp rx=0 tx=0).stop 2024-08-20T05:13:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.023+0000 7fa8baa00640 1 -- 172.21.15.37:0/4237513513 shutdown_connections 2024-08-20T05:13:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.023+0000 7fa8baa00640 1 --2- 172.21.15.37:0/4237513513 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa8980b3d20 0x7fa8980b61e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.023+0000 7fa8baa00640 1 --2- 172.21.15.37:0/4237513513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8b411bdd0 0x7fa8b41ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.023+0000 7fa8baa00640 1 --2- 172.21.15.37:0/4237513513 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa8b410a260 0x7fa8b41a8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.023+0000 7fa8baa00640 1 --2- 172.21.15.37:0/4237513513 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa8b4109e80 0x7fa8b41a7ee0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.023+0000 7fa8baa00640 1 -- 172.21.15.37:0/4237513513 >> 172.21.15.37:0/4237513513 conn(0x7fa8b406dcc0 msgr2=0x7fa8b411c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.024+0000 7fa8baa00640 1 -- 172.21.15.37:0/4237513513 shutdown_connections 2024-08-20T05:13:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:24.024+0000 7fa8baa00640 1 -- 172.21.15.37:0/4237513513 wait complete. 2024-08-20T05:13:25.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:25 smithi135 ceph-mon[22342]: pgmap v736: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.2 MiB/s wr, 556 op/s 2024-08-20T05:13:25.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:25 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:13:25.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:25 smithi130 ceph-mon[22007]: pgmap v736: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.2 MiB/s wr, 556 op/s 2024-08-20T05:13:25.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:25 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:13:26.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:25 smithi037 ceph-mon[17265]: pgmap v736: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 8.2 MiB/s wr, 556 op/s 2024-08-20T05:13:26.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:25 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:13:26.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T05:13:26.585 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:26 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:13:26.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:26 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:13:26.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:26 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:13:27.294 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:13:27.769 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:27 smithi037 ceph-mon[17265]: pgmap v737: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 469 op/s 2024-08-20T05:13:27.769 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:13:27.769 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:13:27.769 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:27 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:13:27.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:27 smithi135 ceph-mon[22342]: pgmap v737: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 469 op/s 2024-08-20T05:13:27.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:13:27.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:13:27.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:27 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:13:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:27 smithi130 ceph-mon[22007]: pgmap v737: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.6 MiB/s wr, 469 op/s 2024-08-20T05:13:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:13:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:13:27.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:27 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:13:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 630.0 s, 565.8 tps, lat 171.125 ms stddev 220.411 2024-08-20T05:13:28.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.373+0000 7fbaec200640 1 -- 172.21.15.37:0/3894306177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbae41017b0 msgr2=0x7fbae4101b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:28.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.373+0000 7fbaec200640 1 --2- 172.21.15.37:0/3894306177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbae41017b0 0x7fbae4101b90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009900 tx=0x7fbad802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.374+0000 7fbaec200640 1 -- 172.21.15.37:0/3894306177 shutdown_connections 2024-08-20T05:13:28.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.374+0000 7fbaec200640 1 --2- 172.21.15.37:0/3894306177 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbae4106bf0 0x7fbae4107040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.374+0000 7fbaec200640 1 --2- 172.21.15.37:0/3894306177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbae41020d0 0x7fbae41065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.374+0000 7fbaec200640 1 --2- 172.21.15.37:0/3894306177 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbae41017b0 0x7fbae4101b90 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.374+0000 7fbaec200640 1 -- 172.21.15.37:0/3894306177 >> 172.21.15.37:0/3894306177 conn(0x7fbae40fd400 msgr2=0x7fbae40ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:28.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.374+0000 7fbaec200640 1 -- 172.21.15.37:0/3894306177 shutdown_connections 2024-08-20T05:13:28.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.375+0000 7fbaec200640 1 -- 172.21.15.37:0/3894306177 wait complete. 2024-08-20T05:13:28.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.376+0000 7fbaec200640 1 Processor -- start 2024-08-20T05:13:28.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.376+0000 7fbaec200640 1 -- start start 2024-08-20T05:13:28.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.376+0000 7fbaec200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbae41017b0 0x7fbae419f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.376+0000 7fbaec200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbae41020d0 0x7fbae419fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.376+0000 7fbaec200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbae4106bf0 0x7fbae41a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.376+0000 7fbaec200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbae41190d0 con 0x7fbae41020d0 2024-08-20T05:13:28.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.376+0000 7fbaec200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbae4118f50 con 0x7fbae4106bf0 2024-08-20T05:13:28.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.376+0000 7fbaec200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbae4119250 con 0x7fbae41017b0 2024-08-20T05:13:28.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.377+0000 7fbae9800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbae41017b0 0x7fbae419f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:28.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.377+0000 7fbae9800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbae41017b0 0x7fbae419f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51766/0 (socket says 172.21.15.37:51766) 2024-08-20T05:13:28.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.377+0000 7fbae9800640 1 -- 172.21.15.37:0/3287645495 learned_addr learned my addr 172.21.15.37:0/3287645495 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:28.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.377+0000 7fbae9800640 1 -- 172.21.15.37:0/3287645495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbae4106bf0 msgr2=0x7fbae41a4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:28.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.377+0000 7fbaea200640 1 --2- 172.21.15.37:0/3287645495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbae4106bf0 0x7fbae41a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:28.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.377+0000 7fbae9800640 1 --2- 172.21.15.37:0/3287645495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbae4106bf0 0x7fbae41a4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.378+0000 7fbae9800640 1 -- 172.21.15.37:0/3287645495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbae41020d0 msgr2=0x7fbae419fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:28.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.378+0000 7fbae8e00640 1 --2- 172.21.15.37:0/3287645495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbae41020d0 0x7fbae419fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:28.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.378+0000 7fbae9800640 1 --2- 172.21.15.37:0/3287645495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbae41020d0 0x7fbae419fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.378+0000 7fbae9800640 1 -- 172.21.15.37:0/3287645495 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae41a5650 con 0x7fbae41017b0 2024-08-20T05:13:28.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.378+0000 7fbaea200640 1 --2- 172.21.15.37:0/3287645495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbae4106bf0 0x7fbae41a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:28.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.378+0000 7fbae8e00640 1 --2- 172.21.15.37:0/3287645495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbae41020d0 0x7fbae419fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:28.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.378+0000 7fbae9800640 1 --2- 172.21.15.37:0/3287645495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbae41017b0 0x7fbae419f5a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbad8005ab0 tx=0x7fbad8003c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:28.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.379+0000 7fbae2000640 1 -- 172.21.15.37:0/3287645495 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad803f070 con 0x7fbae41017b0 2024-08-20T05:13:28.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.379+0000 7fbaec200640 1 -- 172.21.15.37:0/3287645495 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbae41a58e0 con 0x7fbae41017b0 2024-08-20T05:13:28.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.379+0000 7fbae2000640 1 -- 172.21.15.37:0/3287645495 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbad8031d60 con 0x7fbae41017b0 2024-08-20T05:13:28.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.379+0000 7fbae2000640 1 -- 172.21.15.37:0/3287645495 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8035030 con 0x7fbae41017b0 2024-08-20T05:13:28.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.379+0000 7fbaec200640 1 -- 172.21.15.37:0/3287645495 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbae41ac000 con 0x7fbae41017b0 2024-08-20T05:13:28.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.384+0000 7fbae2000640 1 -- 172.21.15.37:0/3287645495 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbad8042070 con 0x7fbae41017b0 2024-08-20T05:13:28.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.386+0000 7fbaeec9d740 1 Processor -- start 2024-08-20T05:13:28.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.387+0000 7fbae2000640 1 --2- 172.21.15.37:0/3287645495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbacc0b3c50 0x7fbacc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.387+0000 7fbae2000640 1 -- 172.21.15.37:0/3287645495 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbad81048d0 con 0x7fbae41017b0 2024-08-20T05:13:28.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.388+0000 7fbaeec9d740 1 -- start start 2024-08-20T05:13:28.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.388+0000 7fbaeec9d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a8940 0x55df321a8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.388+0000 7fbaeec9d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a9260 0x55df321b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.388+0000 7fbaeec9d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321b51f0 0x55df321b75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.388+0000 7fbaeec9d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55df3211eaa0 con 0x55df321a9260 2024-08-20T05:13:28.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.388+0000 7fbaeec9d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55df3210dfa0 con 0x55df321b51f0 2024-08-20T05:13:28.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.388+0000 7fbaeec9d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55df32111fe0 con 0x55df321a8940 2024-08-20T05:13:28.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.389+0000 7fbae9800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a8940 0x55df321a8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.389+0000 7fbae9800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a8940 0x55df321a8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51778/0 (socket says 172.21.15.37:51778) 2024-08-20T05:13:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.389+0000 7fbae9800640 1 -- 172.21.15.37:0/3640264120 learned_addr learned my addr 172.21.15.37:0/3640264120 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.389+0000 7fbae9800640 1 -- 172.21.15.37:0/3640264120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321b51f0 msgr2=0x55df321b75e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:13:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.389+0000 7fbae9800640 1 --2- 172.21.15.37:0/3640264120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321b51f0 0x55df321b75e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.389+0000 7fbae9800640 1 -- 172.21.15.37:0/3640264120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a9260 msgr2=0x55df321b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.389+0000 7fbae9800640 1 --2- 172.21.15.37:0/3640264120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a9260 0x55df321b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.389+0000 7fbae9800640 1 -- 172.21.15.37:0/3640264120 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df320b4420 con 0x55df321a8940 2024-08-20T05:13:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.389+0000 7fbaea200640 1 --2- 172.21.15.37:0/3287645495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbacc0b3c50 0x7fbacc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.389+0000 7fbae9800640 1 --2- 172.21.15.37:0/3640264120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a8940 0x55df321a8d20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbad80cb3b0 tx=0x7fbad8031f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9858ce427b3a0e89 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:28.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.390+0000 7fbad6a00640 1 -- 172.21.15.37:0/3640264120 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8049030 con 0x55df321a8940 2024-08-20T05:13:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.390+0000 7fbad6a00640 1 -- 172.21.15.37:0/3640264120 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbad80cbb20 con 0x55df321a8940 2024-08-20T05:13:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.390+0000 7fbad6a00640 1 -- 172.21.15.37:0/3640264120 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad80d4040 con 0x55df321a8940 2024-08-20T05:13:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.391+0000 7fbaeec9d740 1 -- 172.21.15.37:0/3640264120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a8940 msgr2=0x55df321a8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.391+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/3640264120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a8940 0x55df321a8d20 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbad80cb3b0 tx=0x7fbad8031f10 comp rx=0 tx=0).stop 2024-08-20T05:13:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.391+0000 7fbaea200640 1 --2- 172.21.15.37:0/3287645495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbacc0b3c50 0x7fbacc0b6110 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009270 tx=0x7fbadc009440 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.391+0000 7fbaeec9d740 1 -- 172.21.15.37:0/3640264120 shutdown_connections 2024-08-20T05:13:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.391+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/3640264120 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321b51f0 0x55df321b75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.391+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/3640264120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a9260 0x55df321b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.391+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/3640264120 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a8940 0x55df321a8d20 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.391+0000 7fbaeec9d740 1 -- 172.21.15.37:0/3640264120 >> 172.21.15.37:0/3640264120 conn(0x55df321a6770 msgr2=0x55df321a7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.391+0000 7fbaeec9d740 1 -- 172.21.15.37:0/3640264120 shutdown_connections 2024-08-20T05:13:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.391+0000 7fbaeec9d740 1 -- 172.21.15.37:0/3640264120 wait complete. 2024-08-20T05:13:28.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.392+0000 7fbaeec9d740 1 -- start start 2024-08-20T05:13:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.392+0000 7fbaeec9d740 1 Processor -- start 2024-08-20T05:13:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.392+0000 7fbaeec9d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a8940 0x55df321b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.392+0000 7fbaeec9d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a9260 0x55df321b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.392+0000 7fbaeec9d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321b51f0 0x55df321b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.392+0000 7fbaeec9d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55df31f70700 con 0x55df321a9260 2024-08-20T05:13:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.392+0000 7fbaeec9d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55df320a9290 con 0x55df321b51f0 2024-08-20T05:13:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.392+0000 7fbaeec9d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55df321b7c30 con 0x55df321a8940 2024-08-20T05:13:28.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.392+0000 7fbaeec9d740 10 client.0 _ll_register_callbacks cb 0x55df321081c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.393+0000 7fbae9800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a8940 0x55df321b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.393+0000 7fbae8e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a9260 0x55df321b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.393+0000 7fbae9800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a8940 0x55df321b4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51788/0 (socket says 172.21.15.37:51788) 2024-08-20T05:13:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.393+0000 7fbae9800640 1 -- 172.21.15.37:0/4200393321 learned_addr learned my addr 172.21.15.37:0/4200393321 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.393+0000 7fbae9800640 1 -- 172.21.15.37:0/4200393321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321b51f0 msgr2=0x55df321b23e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:13:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.393+0000 7fbae9800640 1 --2- 172.21.15.37:0/4200393321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321b51f0 0x55df321b23e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.393+0000 7fbae9800640 1 -- 172.21.15.37:0/4200393321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a9260 msgr2=0x55df321b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:28.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.393+0000 7fbae9800640 1 --2- 172.21.15.37:0/4200393321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a9260 0x55df321b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.393+0000 7fbae9800640 1 -- 172.21.15.37:0/4200393321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df31e6d650 con 0x55df321a8940 2024-08-20T05:13:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.394+0000 7fbae9800640 1 --2- 172.21.15.37:0/4200393321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a8940 0x55df321b4a30 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbad8031440 tx=0x7fbad802a3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b32ce9b5469633f2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.394+0000 7fbacb400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:13:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.394+0000 7fbacb400640 1 -- 172.21.15.37:0/4200393321 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8049040 con 0x55df321a8940 2024-08-20T05:13:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.394+0000 7fbaeec9d740 1 -- 172.21.15.37:0/4200393321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbad80cbb20 con 0x55df321a8940 2024-08-20T05:13:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.394+0000 7fbacb400640 1 -- 172.21.15.37:0/4200393321 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbad80d4250 con 0x55df321a8940 2024-08-20T05:13:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.394+0000 7fbacb400640 1 -- 172.21.15.37:0/4200393321 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fbad80cb420 con 0x55df321a8940 2024-08-20T05:13:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.394+0000 7fbaeec9d740 10 client.28234 fetch_fsmap learned FSMap version 47 2024-08-20T05:13:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.394+0000 7fbaeec9d740 1 -- 172.21.15.37:0/4200393321 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55df321c3400 con 0x55df321a8940 2024-08-20T05:13:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.394+0000 7fbacb400640 1 -- 172.21.15.37:0/4200393321 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbad80cbb20 con 0x55df321a8940 2024-08-20T05:13:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.395+0000 7fbacb400640 1 -- 172.21.15.37:0/4200393321 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 47) ==== 8374+0+0 (secure 0 0 0) 0x7fbad80c6f00 con 0x55df321a8940 2024-08-20T05:13:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.395+0000 7fbaeec9d740 10 client.28234 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T05:13:28.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.395+0000 7fbaeec9d740 10 client.28234 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:28.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.395+0000 7fbaeec9d740 20 client.28234 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:28.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.395+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/4200393321 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55df321c4750 0x55df321c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.395+0000 7fbaeec9d740 4 client.28234 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:13:28.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.395+0000 7fbaeec9d740 1 -- 172.21.15.37:0/4200393321 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df321209f0 con 0x55df321c4750 2024-08-20T05:13:28.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.396+0000 7fbae8e00640 1 --2- 172.21.15.37:0/4200393321 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55df321c4750 0x55df321c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:28.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.397+0000 7fbae8e00640 1 --2- 172.21.15.37:0/4200393321 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55df321c4750 0x55df321c6b40 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3210ec1ea1b892f8 server_cookie=d0a2cc031d77e85d in_seq=0 out_seq=0 2024-08-20T05:13:28.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.397+0000 7fbacb400640 10 client.28234 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:28.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.397+0000 7fbacb400640 1 -- 172.21.15.37:0/4200393321 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55df321209f0 con 0x55df321c4750 2024-08-20T05:13:28.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.397+0000 7fbacb400640 10 client.28234 handle_command_reply: tid=0 2024-08-20T05:13:28.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.398+0000 7fbaeec9d740 1 client.28234 shutdown 2024-08-20T05:13:28.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.398+0000 7fbaeec9d740 1 -- 172.21.15.37:0/4200393321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a8940 msgr2=0x55df321b4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:28.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.398+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/4200393321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a8940 0x55df321b4a30 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbad8031440 tx=0x7fbad802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.398+0000 7fbaeec9d740 1 -- 172.21.15.37:0/4200393321 shutdown_connections 2024-08-20T05:13:28.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.398+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/4200393321 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55df321c4750 0x55df321c6b40 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.398+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/4200393321 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321b51f0 0x55df321b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.398+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/4200393321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a9260 0x55df321b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.398+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/4200393321 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a8940 0x55df321b4a30 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.398+0000 7fbaeec9d740 1 -- 172.21.15.37:0/4200393321 >> 172.21.15.37:0/4200393321 conn(0x55df321a6770 msgr2=0x55df321ac310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:28.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.398+0000 7fbacb400640 0 client.28234 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:28.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.401+0000 7fbaeec9d740 1 -- 172.21.15.37:0/4200393321 shutdown_connections 2024-08-20T05:13:28.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.401+0000 7fbaeec9d740 1 -- 172.21.15.37:0/4200393321 wait complete. 2024-08-20T05:13:28.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.401+0000 7fbaeec9d740 20 client.28234 trim_cache size 0 max 16384 2024-08-20T05:13:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.425+0000 7fbaeec9d740 1 Processor -- start 2024-08-20T05:13:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.425+0000 7fbaeec9d740 1 -- start start 2024-08-20T05:13:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.425+0000 7fbaeec9d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a8940 0x55df321c0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.426+0000 7fbaeec9d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a9260 0x55df321acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.426+0000 7fbaeec9d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321b51f0 0x55df321cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.426+0000 7fbae8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a9260 0x55df321acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:28.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.426+0000 7fbae8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a9260 0x55df321acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51796/0 (socket says 172.21.15.37:51796) 2024-08-20T05:13:28.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.426+0000 7fbae9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a8940 0x55df321c0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:28.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.427+0000 7fbae9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a8940 0x55df321c0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46574/0 (socket says 172.21.15.37:46574) 2024-08-20T05:13:28.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.427+0000 7fbae8e00640 1 -- 172.21.15.37:0/700059913 learned_addr learned my addr 172.21.15.37:0/700059913 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:28.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.427+0000 7fbaeec9d740 1 -- 172.21.15.37:0/700059913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbae41b5e60 con 0x55df321a8940 2024-08-20T05:13:28.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.427+0000 7fbaeec9d740 1 -- 172.21.15.37:0/700059913 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbae41b79a0 con 0x55df321b51f0 2024-08-20T05:13:28.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.427+0000 7fbaeec9d740 1 -- 172.21.15.37:0/700059913 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbae41b6530 con 0x55df321a9260 2024-08-20T05:13:28.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.427+0000 7fbaea200640 1 --2- 172.21.15.37:0/700059913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321b51f0 0x55df321cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:28.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.428+0000 7fbae9800640 1 -- 172.21.15.37:0/700059913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a9260 msgr2=0x55df321acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:28.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.428+0000 7fbae9800640 1 --2- 172.21.15.37:0/700059913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a9260 0x55df321acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.428+0000 7fbae9800640 1 -- 172.21.15.37:0/700059913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321b51f0 msgr2=0x55df321cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:28.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.428+0000 7fbae9800640 1 --2- 172.21.15.37:0/700059913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321b51f0 0x55df321cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.428+0000 7fbae9800640 1 -- 172.21.15.37:0/700059913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df321a71f0 con 0x55df321a8940 2024-08-20T05:13:28.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.428+0000 7fbae8e00640 1 --2- 172.21.15.37:0/700059913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a9260 0x55df321acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:28.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.428+0000 7fbae9800640 1 --2- 172.21.15.37:0/700059913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a8940 0x55df321c0d10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbad80cb5e0 tx=0x7fbad8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3859b4ebb183cd52 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:28.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.429+0000 7fbad6000640 1 -- 172.21.15.37:0/700059913 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8049020 con 0x55df321a8940 2024-08-20T05:13:28.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.429+0000 7fbad6000640 1 -- 172.21.15.37:0/700059913 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbad80cbb20 con 0x55df321a8940 2024-08-20T05:13:28.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.429+0000 7fbad6000640 1 -- 172.21.15.37:0/700059913 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad80c6d90 con 0x55df321a8940 2024-08-20T05:13:28.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.431+0000 7fbaeec9d740 1 -- 172.21.15.37:0/700059913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a8940 msgr2=0x55df321c0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:28.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.431+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/700059913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a8940 0x55df321c0d10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbad80cb5e0 tx=0x7fbad8009260 comp rx=0 tx=0).stop 2024-08-20T05:13:28.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.431+0000 7fbaeec9d740 1 -- 172.21.15.37:0/700059913 shutdown_connections 2024-08-20T05:13:28.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.431+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/700059913 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321b51f0 0x55df321cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.431+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/700059913 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321a9260 0x55df321acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.431+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/700059913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a8940 0x55df321c0d10 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.431+0000 7fbaeec9d740 1 -- 172.21.15.37:0/700059913 >> 172.21.15.37:0/700059913 conn(0x55df321a6770 msgr2=0x55df321b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:28.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.431+0000 7fbaeec9d740 1 -- 172.21.15.37:0/700059913 shutdown_connections 2024-08-20T05:13:28.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.431+0000 7fbaeec9d740 1 -- 172.21.15.37:0/700059913 wait complete. 2024-08-20T05:13:28.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.432+0000 7fbaeec9d740 1 -- start start 2024-08-20T05:13:28.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.432+0000 7fbaeec9d740 1 Processor -- start 2024-08-20T05:13:28.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.433+0000 7fbaeec9d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321a8940 0x55df321b8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.433+0000 7fbaeec9d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a9260 0x55df321b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.433+0000 7fbaeec9d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321b51f0 0x55df3223e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.433+0000 7fbaeec9d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbae41b72d0 con 0x55df321a9260 2024-08-20T05:13:28.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.433+0000 7fbaeec9d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbae41b6c00 con 0x55df321a8940 2024-08-20T05:13:28.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.433+0000 7fbaeec9d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbae41b3e40 con 0x55df321b51f0 2024-08-20T05:13:28.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.433+0000 7fbaeec9d740 10 client.0 _ll_register_callbacks cb 0x7fbad80cad70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:28.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.433+0000 7fbaea200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321b51f0 0x55df3223e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.433+0000 7fbaea200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321b51f0 0x55df3223e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51800/0 (socket says 172.21.15.37:51800) 2024-08-20T05:13:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.433+0000 7fbaea200640 1 -- 172.21.15.37:0/591861366 learned_addr learned my addr 172.21.15.37:0/591861366 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.433+0000 7fbae9800640 1 --2- 172.21.15.37:0/591861366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321a8940 0x55df321b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.433+0000 7fbae8e00640 1 --2- 172.21.15.37:0/591861366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a9260 0x55df321b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.434+0000 7fbae9800640 1 -- 172.21.15.37:0/591861366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321b51f0 msgr2=0x55df3223e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.434+0000 7fbae9800640 1 --2- 172.21.15.37:0/591861366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321b51f0 0x55df3223e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.434+0000 7fbae9800640 1 -- 172.21.15.37:0/591861366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a9260 msgr2=0x55df321b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.434+0000 7fbae9800640 1 --2- 172.21.15.37:0/591861366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a9260 0x55df321b87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.434+0000 7fbae9800640 1 -- 172.21.15.37:0/591861366 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df3223e880 con 0x55df321a8940 2024-08-20T05:13:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.434+0000 7fbae8e00640 1 --2- 172.21.15.37:0/591861366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a9260 0x55df321b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.434+0000 7fbae9800640 1 --2- 172.21.15.37:0/591861366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321a8940 0x55df321b8270 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbad80e0b10 tx=0x7fbad8031f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec9ff2923f60990e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:28.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.434+0000 7fbacb400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:13:28.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.434+0000 7fbacb400640 1 -- 172.21.15.37:0/591861366 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad8049050 con 0x55df321a8940 2024-08-20T05:13:28.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.434+0000 7fbacb400640 1 -- 172.21.15.37:0/591861366 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbad80ca890 con 0x55df321a8940 2024-08-20T05:13:28.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.435+0000 7fbaeec9d740 1 -- 172.21.15.37:0/591861366 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbad80cbb20 con 0x55df321a8940 2024-08-20T05:13:28.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.435+0000 7fbacb400640 1 -- 172.21.15.37:0/591861366 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fbad80cfa20 con 0x55df321a8940 2024-08-20T05:13:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.435+0000 7fbaeec9d740 10 client.28214 fetch_fsmap learned FSMap version 47 2024-08-20T05:13:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.435+0000 7fbaeec9d740 1 -- 172.21.15.37:0/591861366 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55df3223e880 con 0x55df321a8940 2024-08-20T05:13:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.436+0000 7fbacb400640 1 -- 172.21.15.37:0/591861366 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbad80cbb20 con 0x55df321a8940 2024-08-20T05:13:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.436+0000 7fbacb400640 1 -- 172.21.15.37:0/591861366 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 47) ==== 8374+0+0 (secure 0 0 0) 0x7fbad80ca0f0 con 0x55df321a8940 2024-08-20T05:13:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.436+0000 7fbaeec9d740 10 client.28214 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T05:13:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.436+0000 7fbaeec9d740 10 client.28214 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.436+0000 7fbaeec9d740 20 client.28214 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.436+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/591861366 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55df3223fd50 0x55df32242140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.436+0000 7fbaeec9d740 4 client.28214 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:13:28.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.436+0000 7fbaeec9d740 1 -- 172.21.15.37:0/591861366 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55df3211c490 con 0x55df3223fd50 2024-08-20T05:13:28.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.438+0000 7fbae8e00640 1 --2- 172.21.15.37:0/591861366 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55df3223fd50 0x55df32242140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:28.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.439+0000 7fbae8e00640 1 --2- 172.21.15.37:0/591861366 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55df3223fd50 0x55df32242140 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbfead9aca779fe5 server_cookie=6f34d9e0b0c696b5 in_seq=0 out_seq=0 2024-08-20T05:13:28.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.439+0000 7fbacb400640 10 client.28214 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:28.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.439+0000 7fbacb400640 1 -- 172.21.15.37:0/591861366 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55df3211c490 con 0x55df3223fd50 2024-08-20T05:13:28.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.439+0000 7fbacb400640 10 client.28214 handle_command_reply: tid=0 2024-08-20T05:13:28.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.439+0000 7fbaeec9d740 1 client.28214 shutdown 2024-08-20T05:13:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.440+0000 7fbaeec9d740 1 -- 172.21.15.37:0/591861366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321a8940 msgr2=0x55df321b8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.440+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/591861366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321a8940 0x55df321b8270 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbad80e0b10 tx=0x7fbad8031f10 comp rx=0 tx=0).stop 2024-08-20T05:13:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.440+0000 7fbaeec9d740 1 -- 172.21.15.37:0/591861366 shutdown_connections 2024-08-20T05:13:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.440+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/591861366 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55df3223fd50 0x55df32242140 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.440+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/591861366 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55df321b51f0 0x55df3223e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.440+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/591861366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55df321a9260 0x55df321b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.440+0000 7fbaeec9d740 1 --2- 172.21.15.37:0/591861366 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55df321a8940 0x55df321b8270 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.440+0000 7fbaeec9d740 1 -- 172.21.15.37:0/591861366 >> 172.21.15.37:0/591861366 conn(0x55df321a6770 msgr2=0x55df321a5030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:28.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.440+0000 7fbacb400640 0 client.28214 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.440+0000 7fbaeec9d740 1 -- 172.21.15.37:0/591861366 shutdown_connections 2024-08-20T05:13:28.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.440+0000 7fbaeec9d740 1 -- 172.21.15.37:0/591861366 wait complete. 2024-08-20T05:13:28.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.441+0000 7fbaeec9d740 20 client.28214 trim_cache size 0 max 16384 2024-08-20T05:13:28.447 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:13:28.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.445+0000 7fbaec200640 1 -- 172.21.15.37:0/3287645495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbacc0b3c50 msgr2=0x7fbacc0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:28.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.446+0000 7fbaec200640 1 --2- 172.21.15.37:0/3287645495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbacc0b3c50 0x7fbacc0b6110 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbadc009270 tx=0x7fbadc009440 comp rx=0 tx=0).stop 2024-08-20T05:13:28.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.446+0000 7fbaec200640 1 -- 172.21.15.37:0/3287645495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbae41017b0 msgr2=0x7fbae419f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:28.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.446+0000 7fbaec200640 1 --2- 172.21.15.37:0/3287645495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbae41017b0 0x7fbae419f5a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fbad8005ab0 tx=0x7fbad8003c80 comp rx=0 tx=0).stop 2024-08-20T05:13:28.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.446+0000 7fbaec200640 1 -- 172.21.15.37:0/3287645495 shutdown_connections 2024-08-20T05:13:28.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.446+0000 7fbaec200640 1 --2- 172.21.15.37:0/3287645495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbacc0b3c50 0x7fbacc0b6110 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.446+0000 7fbaec200640 1 --2- 172.21.15.37:0/3287645495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbae4106bf0 0x7fbae41a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.446+0000 7fbaec200640 1 --2- 172.21.15.37:0/3287645495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbae41020d0 0x7fbae419fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.446+0000 7fbaec200640 1 --2- 172.21.15.37:0/3287645495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbae41017b0 0x7fbae419f5a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:28.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.446+0000 7fbaec200640 1 -- 172.21.15.37:0/3287645495 >> 172.21.15.37:0/3287645495 conn(0x7fbae40fd400 msgr2=0x7fbae4104520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:28.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.446+0000 7fbaec200640 1 -- 172.21.15.37:0/3287645495 shutdown_connections 2024-08-20T05:13:28.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:28.447+0000 7fbaec200640 1 -- 172.21.15.37:0/3287645495 wait complete. 2024-08-20T05:13:28.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:28 smithi135 ceph-mon[22342]: pgmap v738: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 467 op/s 2024-08-20T05:13:28.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:28 smithi130 ceph-mon[22007]: pgmap v738: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 467 op/s 2024-08-20T05:13:29.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:28 smithi037 ceph-mon[17265]: pgmap v738: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 467 op/s 2024-08-20T05:13:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.535+0000 7fdd09a00640 1 -- 172.21.15.37:0/2256680897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcfc096670 msgr2=0x7fdcfc096af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.535+0000 7fdd09a00640 1 --2- 172.21.15.37:0/2256680897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcfc096670 0x7fdcfc096af0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009930 tx=0x7fdcf403b430 comp rx=0 tx=0).stop 2024-08-20T05:13:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.535+0000 7fdd09a00640 1 -- 172.21.15.37:0/2256680897 shutdown_connections 2024-08-20T05:13:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.535+0000 7fdd09a00640 1 --2- 172.21.15.37:0/2256680897 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcfc097030 0x7fdcfc09d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.535+0000 7fdd09a00640 1 --2- 172.21.15.37:0/2256680897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcfc096670 0x7fdcfc096af0 secure :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009930 tx=0x7fdcf403b430 comp rx=0 tx=0).stop 2024-08-20T05:13:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.535+0000 7fdd09a00640 1 --2- 172.21.15.37:0/2256680897 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcfc095520 0x7fdcfc095920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.535+0000 7fdd09a00640 1 -- 172.21.15.37:0/2256680897 >> 172.21.15.37:0/2256680897 conn(0x7fdcfc090dc0 msgr2=0x7fdcfc093200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:29.538 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.537+0000 7fdd09a00640 1 -- 172.21.15.37:0/2256680897 shutdown_connections 2024-08-20T05:13:29.539 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.537+0000 7fdd09a00640 1 -- 172.21.15.37:0/2256680897 wait complete. 2024-08-20T05:13:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.538+0000 7fdd09a00640 1 Processor -- start 2024-08-20T05:13:29.540 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.539+0000 7fdd09a00640 1 -- start start 2024-08-20T05:13:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.540+0000 7fdd09a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcfc095520 0x7fdcfc129940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.540+0000 7fdd09a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcfc097030 0x7fdcfc129f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.540+0000 7fdd09a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcfc12abc0 0x7fdcfc12b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.540+0000 7fdd09a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc09f030 con 0x7fdcfc097030 2024-08-20T05:13:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.540+0000 7fdd09a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc09eeb0 con 0x7fdcfc095520 2024-08-20T05:13:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.540+0000 7fdd09a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc09f1b0 con 0x7fdcfc12abc0 2024-08-20T05:13:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.540+0000 7fdd03400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcfc12abc0 0x7fdcfc12b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:29.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.540+0000 7fdd03400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcfc12abc0 0x7fdcfc12b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51820/0 (socket says 172.21.15.37:51820) 2024-08-20T05:13:29.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.540+0000 7fdd03400640 1 -- 172.21.15.37:0/2056007391 learned_addr learned my addr 172.21.15.37:0/2056007391 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:29.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.541+0000 7fdd03400640 1 -- 172.21.15.37:0/2056007391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcfc095520 msgr2=0x7fdcfc129940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:29.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.541+0000 7fdd03400640 1 --2- 172.21.15.37:0/2056007391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcfc095520 0x7fdcfc129940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.541+0000 7fdd03400640 1 -- 172.21.15.37:0/2056007391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcfc097030 msgr2=0x7fdcfc129f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:29.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.541+0000 7fdd03400640 1 --2- 172.21.15.37:0/2056007391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcfc097030 0x7fdcfc129f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.541+0000 7fdd03400640 1 -- 172.21.15.37:0/2056007391 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcfc12b870 con 0x7fdcfc12abc0 2024-08-20T05:13:29.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.541+0000 7fdd03400640 1 --2- 172.21.15.37:0/2056007391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcfc12abc0 0x7fdcfc12b070 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fdd040519c0 tx=0x7fdd0407a700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.545+0000 7fdcfb400640 1 -- 172.21.15.37:0/2056007391 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0407c610 con 0x7fdcfc12abc0 2024-08-20T05:13:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.545+0000 7fdcfb400640 1 -- 172.21.15.37:0/2056007391 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd0406c6b0 con 0x7fdcfc12abc0 2024-08-20T05:13:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.545+0000 7fdcfb400640 1 -- 172.21.15.37:0/2056007391 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0407ba50 con 0x7fdcfc12abc0 2024-08-20T05:13:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.545+0000 7fdd09a00640 1 -- 172.21.15.37:0/2056007391 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcfc131c60 con 0x7fdcfc12abc0 2024-08-20T05:13:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.546+0000 7fdd09a00640 1 -- 172.21.15.37:0/2056007391 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcfc1320d0 con 0x7fdcfc12abc0 2024-08-20T05:13:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.553+0000 7fdd0c83b740 1 Processor -- start 2024-08-20T05:13:29.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.554+0000 7fdcfb400640 1 -- 172.21.15.37:0/2056007391 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdd04064050 con 0x7fdcfc12abc0 2024-08-20T05:13:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.557+0000 7fdd0c83b740 1 -- start start 2024-08-20T05:13:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.557+0000 7fdd0c83b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 0x5572f0191be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.557+0000 7fdd0c83b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0192120 0x5572f0194510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.557+0000 7fdd0c83b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f0194b60 0x5572f0197020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.557+0000 7fdd0c83b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5572f0102210 con 0x5572f0192120 2024-08-20T05:13:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.557+0000 7fdd0c83b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5572f00f1710 con 0x5572f0194b60 2024-08-20T05:13:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.557+0000 7fdd0c83b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5572f00f5750 con 0x5572f018f7f0 2024-08-20T05:13:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.558+0000 7fdd02000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 0x5572f0191be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.558+0000 7fdcfb400640 1 --2- 172.21.15.37:0/2056007391 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdce80b3de0 0x7fdce80b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.558+0000 7fdd02000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 0x5572f0191be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51834/0 (socket says 172.21.15.37:51834) 2024-08-20T05:13:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.558+0000 7fdcfb400640 1 -- 172.21.15.37:0/2056007391 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fdd04150f10 con 0x7fdcfc12abc0 2024-08-20T05:13:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.559+0000 7fdd02a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0192120 0x5572f0194510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.559+0000 7fdd02a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0192120 0x5572f0194510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46600/0 (socket says 172.21.15.37:46600) 2024-08-20T05:13:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.559+0000 7fdd02a00640 1 -- 172.21.15.37:0/3662205720 learned_addr learned my addr 172.21.15.37:0/3662205720 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.559+0000 7fdd03400640 1 --2- 172.21.15.37:0/2056007391 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdce80b3de0 0x7fdce80b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.560+0000 7fdd02a00640 1 -- 172.21.15.37:0/3662205720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 msgr2=0x5572f0191be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.561+0000 7fdd02a00640 1 --2- 172.21.15.37:0/3662205720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 0x5572f0191be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.561+0000 7fdd02a00640 1 -- 172.21.15.37:0/3662205720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f0194b60 msgr2=0x5572f0197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.561+0000 7fdd02a00640 1 --2- 172.21.15.37:0/3662205720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f0194b60 0x5572f0197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.561+0000 7fdd02a00640 1 -- 172.21.15.37:0/3662205720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f00bdde0 con 0x5572f0192120 2024-08-20T05:13:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.561+0000 7fdd03400640 1 --2- 172.21.15.37:0/2056007391 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdce80b3de0 0x7fdce80b62a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdd04113ae0 tx=0x7fdd04068df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:29.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.561+0000 7fdd02000640 1 --2- 172.21.15.37:0/3662205720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 0x5572f0191be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-08-20T05:13:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.562+0000 7fdd02a00640 1 --2- 172.21.15.37:0/3662205720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0192120 0x5572f0194510 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000bb10 tx=0x7fdcf000d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a27f4ae01c42df7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.563+0000 7fdcefe00640 1 -- 172.21.15.37:0/3662205720 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0016070 con 0x5572f0192120 2024-08-20T05:13:29.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.563+0000 7fdcefe00640 1 -- 172.21.15.37:0/3662205720 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcf000dce0 con 0x5572f0192120 2024-08-20T05:13:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.564+0000 7fdd0c83b740 1 -- 172.21.15.37:0/3662205720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0192120 msgr2=0x5572f0194510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.564+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/3662205720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0192120 0x5572f0194510 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000bb10 tx=0x7fdcf000d2e0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.564+0000 7fdd0c83b740 1 -- 172.21.15.37:0/3662205720 shutdown_connections 2024-08-20T05:13:29.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.564+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/3662205720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f0194b60 0x5572f0197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.564+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/3662205720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0192120 0x5572f0194510 secure :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000bb10 tx=0x7fdcf000d2e0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.564+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/3662205720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 0x5572f0191be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.564+0000 7fdd0c83b740 1 -- 172.21.15.37:0/3662205720 >> 172.21.15.37:0/3662205720 conn(0x5572f018a940 msgr2=0x5572f018b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.565+0000 7fdd0c83b740 1 -- 172.21.15.37:0/3662205720 shutdown_connections 2024-08-20T05:13:29.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.565+0000 7fdd0c83b740 1 -- 172.21.15.37:0/3662205720 wait complete. 2024-08-20T05:13:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.565+0000 7fdd0c83b740 1 -- start start 2024-08-20T05:13:29.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.566+0000 7fdd0c83b740 1 Processor -- start 2024-08-20T05:13:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.570+0000 7fdd0c83b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 0x5572f0199170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.572 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.570+0000 7fdd0c83b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0194b60 0x5572f0199810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.570+0000 7fdd0c83b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f019a3c0 0x5572f019a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.570+0000 7fdd0c83b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5572f002aab0 con 0x5572f0194b60 2024-08-20T05:13:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.570+0000 7fdd0c83b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5572f0098140 con 0x5572f019a3c0 2024-08-20T05:13:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.570+0000 7fdd0c83b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5572f0197be0 con 0x5572f018f7f0 2024-08-20T05:13:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.571+0000 7fdd0c83b740 10 client.0 _ll_register_callbacks cb 0x5572f00ab5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.571+0000 7fdd02000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 0x5572f0199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.571+0000 7fdd02000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 0x5572f0199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51840/0 (socket says 172.21.15.37:51840) 2024-08-20T05:13:29.573 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.571+0000 7fdd02000640 1 -- 172.21.15.37:0/2466116904 learned_addr learned my addr 172.21.15.37:0/2466116904 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.571+0000 7fdd02000640 1 --2- 172.21.15.37:0/2466116904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f019a3c0 0x5572f019a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.572+0000 7fdd02000640 1 -- 172.21.15.37:0/2466116904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f019a3c0 msgr2=0x5572f019a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.572+0000 7fdd02000640 1 --2- 172.21.15.37:0/2466116904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f019a3c0 0x5572f019a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.572+0000 7fdd02000640 1 -- 172.21.15.37:0/2466116904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0194b60 msgr2=0x5572f0199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:29.574 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.572+0000 7fdd02a00640 1 --2- 172.21.15.37:0/2466116904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0194b60 0x5572f0199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.572+0000 7fdd02000640 1 --2- 172.21.15.37:0/2466116904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0194b60 0x5572f0199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.572+0000 7fdd02000640 1 -- 172.21.15.37:0/2466116904 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572f0099170 con 0x5572f018f7f0 2024-08-20T05:13:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.572+0000 7fdd02000640 1 --2- 172.21.15.37:0/2466116904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 0x5572f0199170 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009230 tx=0x7fdcf4005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cf5b5d71b143627 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.572+0000 7fdcecc00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:13:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.573+0000 7fdcecc00640 1 -- 172.21.15.37:0/2466116904 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4046040 con 0x5572f018f7f0 2024-08-20T05:13:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.573+0000 7fdcecc00640 1 -- 172.21.15.37:0/2466116904 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fdcf4005220 con 0x5572f018f7f0 2024-08-20T05:13:29.575 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.573+0000 7fdd0c83b740 1 -- 172.21.15.37:0/2466116904 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcf000dce0 con 0x5572f018f7f0 2024-08-20T05:13:29.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.574+0000 7fdcecc00640 1 -- 172.21.15.37:0/2466116904 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fdcf4005420 con 0x5572f018f7f0 2024-08-20T05:13:29.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.574+0000 7fdd0c83b740 10 client.28249 fetch_fsmap learned FSMap version 47 2024-08-20T05:13:29.576 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.574+0000 7fdd0c83b740 1 -- 172.21.15.37:0/2466116904 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5572efe54790 con 0x5572f018f7f0 2024-08-20T05:13:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.578+0000 7fdcecc00640 1 -- 172.21.15.37:0/2466116904 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcf000dce0 con 0x5572f018f7f0 2024-08-20T05:13:29.579 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.578+0000 7fdcecc00640 1 -- 172.21.15.37:0/2466116904 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 47) ==== 8374+0+0 (secure 0 0 0) 0x7fdcf404b040 con 0x5572f018f7f0 2024-08-20T05:13:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.578+0000 7fdd0c83b740 10 client.28249 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T05:13:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.578+0000 7fdd0c83b740 10 client.28249 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.578+0000 7fdd0c83b740 20 client.28249 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.578+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/2466116904 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5572f01a5130 0x5572f01a7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.580 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.578+0000 7fdd0c83b740 4 client.28249 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:13:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.578+0000 7fdd0c83b740 1 -- 172.21.15.37:0/2466116904 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572f0104160 con 0x5572f01a5130 2024-08-20T05:13:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.579+0000 7fdd02a00640 1 --2- 172.21.15.37:0/2466116904 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5572f01a5130 0x5572f01a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.579+0000 7fdcecc00640 10 client.28249 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:29.581 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.579+0000 7fdd02a00640 1 --2- 172.21.15.37:0/2466116904 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5572f01a5130 0x5572f01a7520 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3a3594103e6d53e server_cookie=3b7d6c8f60cf904d in_seq=0 out_seq=0 2024-08-20T05:13:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.580+0000 7fdcecc00640 1 -- 172.21.15.37:0/2466116904 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5572f0104160 con 0x5572f01a5130 2024-08-20T05:13:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.580+0000 7fdcecc00640 10 client.28249 handle_command_reply: tid=0 2024-08-20T05:13:29.582 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.580+0000 7fdd0c83b740 1 client.28249 shutdown 2024-08-20T05:13:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.581+0000 7fdd0c83b740 1 -- 172.21.15.37:0/2466116904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 msgr2=0x5572f0199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.581+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/2466116904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 0x5572f0199170 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009230 tx=0x7fdcf4005d50 comp rx=0 tx=0).stop 2024-08-20T05:13:29.583 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.581+0000 7fdd0c83b740 1 -- 172.21.15.37:0/2466116904 shutdown_connections 2024-08-20T05:13:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.581+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/2466116904 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5572f01a5130 0x5572f01a7520 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.581+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/2466116904 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f019a3c0 0x5572f019a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.581+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/2466116904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0194b60 0x5572f0199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.581+0000 7fdcecc00640 0 client.28249 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.581+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/2466116904 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 0x5572f0199170 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.581+0000 7fdd0c83b740 1 -- 172.21.15.37:0/2466116904 >> 172.21.15.37:0/2466116904 conn(0x5572f018a940 msgr2=0x5572f01899b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.582+0000 7fdd0c83b740 1 -- 172.21.15.37:0/2466116904 shutdown_connections 2024-08-20T05:13:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.582+0000 7fdd0c83b740 1 -- 172.21.15.37:0/2466116904 wait complete. 2024-08-20T05:13:29.584 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.582+0000 7fdd0c83b740 20 client.28249 trim_cache size 0 max 16384 2024-08-20T05:13:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.621+0000 7fdd0c83b740 1 Processor -- start 2024-08-20T05:13:29.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.621+0000 7fdd0c83b740 1 -- start start 2024-08-20T05:13:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.622+0000 7fdd0c83b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 0x5572f0199810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.622+0000 7fdd0c83b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0194b60 0x5572f0194f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.622+0000 7fdd0c83b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f019a3c0 0x5572f0195480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.622+0000 7fdd0c83b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc13c590 con 0x5572f0194b60 2024-08-20T05:13:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.622+0000 7fdd0c83b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc13e0d0 con 0x5572f019a3c0 2024-08-20T05:13:29.624 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.622+0000 7fdd0c83b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc13cc60 con 0x5572f018f7f0 2024-08-20T05:13:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.622+0000 7fdd02000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 0x5572f0199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.622+0000 7fdd02a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0194b60 0x5572f0194f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.622+0000 7fdd02000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 0x5572f0199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51846/0 (socket says 172.21.15.37:51846) 2024-08-20T05:13:29.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.622+0000 7fdd02000640 1 -- 172.21.15.37:0/1086367491 learned_addr learned my addr 172.21.15.37:0/1086367491 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.622+0000 7fdd02000640 1 --2- 172.21.15.37:0/1086367491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f019a3c0 0x5572f0195480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.623+0000 7fdd02a00640 1 -- 172.21.15.37:0/1086367491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 msgr2=0x5572f0199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.623+0000 7fdd02a00640 1 --2- 172.21.15.37:0/1086367491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 0x5572f0199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.623+0000 7fdd02a00640 1 -- 172.21.15.37:0/1086367491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f019a3c0 msgr2=0x5572f0195480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.623+0000 7fdd02a00640 1 --2- 172.21.15.37:0/1086367491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f019a3c0 0x5572f0195480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.623+0000 7fdd02a00640 1 -- 172.21.15.37:0/1086367491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572f019abb0 con 0x5572f0194b60 2024-08-20T05:13:29.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.623+0000 7fdd02a00640 1 --2- 172.21.15.37:0/1086367491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0194b60 0x5572f0194f40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0011000 tx=0x7fdcf0005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c95da20b1f0b1fc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.624+0000 7fdcef400640 1 -- 172.21.15.37:0/1086367491 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf002a070 con 0x5572f0194b60 2024-08-20T05:13:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.624+0000 7fdcef400640 1 -- 172.21.15.37:0/1086367491 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcf000dce0 con 0x5572f0194b60 2024-08-20T05:13:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.624+0000 7fdcef400640 1 -- 172.21.15.37:0/1086367491 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0016040 con 0x5572f0194b60 2024-08-20T05:13:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.625+0000 7fdd0c83b740 1 -- 172.21.15.37:0/1086367491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0194b60 msgr2=0x5572f0194f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.625+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/1086367491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0194b60 0x5572f0194f40 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fdcf0011000 tx=0x7fdcf0005c90 comp rx=0 tx=0).stop 2024-08-20T05:13:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.625+0000 7fdd0c83b740 1 -- 172.21.15.37:0/1086367491 shutdown_connections 2024-08-20T05:13:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.625+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/1086367491 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f019a3c0 0x5572f0195480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.625+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/1086367491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f0194b60 0x5572f0194f40 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.625+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/1086367491 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f018f7f0 0x5572f0199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.625+0000 7fdd0c83b740 1 -- 172.21.15.37:0/1086367491 >> 172.21.15.37:0/1086367491 conn(0x5572f018a940 msgr2=0x5572f018b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.627+0000 7fdd0c83b740 1 -- 172.21.15.37:0/1086367491 shutdown_connections 2024-08-20T05:13:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.627+0000 7fdd0c83b740 1 -- 172.21.15.37:0/1086367491 wait complete. 2024-08-20T05:13:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.627+0000 7fdd0c83b740 1 -- start start 2024-08-20T05:13:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.627+0000 7fdd0c83b740 1 Processor -- start 2024-08-20T05:13:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.629+0000 7fdd0c83b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f0194b60 0x5572f019df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.629+0000 7fdd0c83b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f019e510 0x5572f019f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.629+0000 7fdd02000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f0194b60 0x5572f019df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:29.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.629+0000 7fdd0c83b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f019f650 0x5572f019fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.629+0000 7fdd0c83b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc13da00 con 0x5572f019f650 2024-08-20T05:13:29.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.629+0000 7fdd0c83b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc13d330 con 0x5572f019e510 2024-08-20T05:13:29.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.629+0000 7fdd0c83b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc13a570 con 0x5572f0194b60 2024-08-20T05:13:29.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.629+0000 7fdd02000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f0194b60 0x5572f019df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:51850/0 (socket says 172.21.15.37:51850) 2024-08-20T05:13:29.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.629+0000 7fdd02000640 1 -- 172.21.15.37:0/3559574621 learned_addr learned my addr 172.21.15.37:0/3559574621 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:29.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.629+0000 7fdd0c83b740 10 client.0 _ll_register_callbacks cb 0x7fdd04051180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:29.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.629+0000 7fdd02a00640 1 --2- 172.21.15.37:0/3559574621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f019e510 0x5572f019f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:29.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.630+0000 7fdd02a00640 1 -- 172.21.15.37:0/3559574621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f0194b60 msgr2=0x5572f019df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:29.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.630+0000 7fdd02a00640 1 --2- 172.21.15.37:0/3559574621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f0194b60 0x5572f019df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.630+0000 7fdd02a00640 1 -- 172.21.15.37:0/3559574621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f019f650 msgr2=0x5572f019fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:29.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.630+0000 7fdd02a00640 1 --2- 172.21.15.37:0/3559574621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f019f650 0x5572f019fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.630+0000 7fdd02a00640 1 -- 172.21.15.37:0/3559574621 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572efecd620 con 0x5572f019e510 2024-08-20T05:13:29.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.631+0000 7fdcecc00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:13:29.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.631+0000 7fdd02a00640 1 --2- 172.21.15.37:0/3559574621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f019e510 0x5572f019f110 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000c010 tx=0x7fdcf000baa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56e4b71b27d1602e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:29.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.632+0000 7fdcecc00640 1 -- 172.21.15.37:0/3559574621 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0016070 con 0x5572f019e510 2024-08-20T05:13:29.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.632+0000 7fdcecc00640 1 -- 172.21.15.37:0/3559574621 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fdcf0004030 con 0x5572f019e510 2024-08-20T05:13:29.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.632+0000 7fdd0c83b740 1 -- 172.21.15.37:0/3559574621 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcf000dce0 con 0x5572f019e510 2024-08-20T05:13:29.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.633+0000 7fdcecc00640 1 -- 172.21.15.37:0/3559574621 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fdcf002a040 con 0x5572f019e510 2024-08-20T05:13:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.633+0000 7fdd0c83b740 10 client.28226 fetch_fsmap learned FSMap version 47 2024-08-20T05:13:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.633+0000 7fdd0c83b740 1 -- 172.21.15.37:0/3559574621 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5572f020fde0 con 0x5572f019e510 2024-08-20T05:13:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.634+0000 7fdcecc00640 1 -- 172.21.15.37:0/3559574621 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdcf000dce0 con 0x5572f019e510 2024-08-20T05:13:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.634+0000 7fdcecc00640 1 -- 172.21.15.37:0/3559574621 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 47) ==== 8374+0+0 (secure 0 0 0) 0x7fdcf0010660 con 0x5572f019e510 2024-08-20T05:13:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.634+0000 7fdd0c83b740 10 client.28226 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T05:13:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.634+0000 7fdd0c83b740 10 client.28226 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.635+0000 7fdd0c83b740 20 client.28226 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.635+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/3559574621 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5572f02102f0 0x5572f02126e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.635+0000 7fdd0c83b740 4 client.28226 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:13:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.635+0000 7fdd0c83b740 1 -- 172.21.15.37:0/3559574621 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5572f00ffc00 con 0x5572f02102f0 2024-08-20T05:13:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.635+0000 7fdd02000640 1 --2- 172.21.15.37:0/3559574621 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5572f02102f0 0x5572f02126e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.639+0000 7fdd02000640 1 --2- 172.21.15.37:0/3559574621 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5572f02102f0 0x5572f02126e0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d0fec542c8b0465 server_cookie=c8aab7465d252a8e in_seq=0 out_seq=0 2024-08-20T05:13:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.639+0000 7fdcecc00640 10 client.28226 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.788+0000 7fdcecc00640 1 -- 172.21.15.37:0/3559574621 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5572f00ffc00 con 0x5572f02102f0 2024-08-20T05:13:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.788+0000 7fdcecc00640 10 client.28226 handle_command_reply: tid=0 2024-08-20T05:13:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.788+0000 7fdd0c83b740 1 client.28226 shutdown 2024-08-20T05:13:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.791+0000 7fdd0c83b740 1 -- 172.21.15.37:0/3559574621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f019e510 msgr2=0x5572f019f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.791+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/3559574621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f019e510 0x5572f019f110 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000c010 tx=0x7fdcf000baa0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.791+0000 7fdd0c83b740 1 -- 172.21.15.37:0/3559574621 shutdown_connections 2024-08-20T05:13:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.791+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/3559574621 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5572f02102f0 0x5572f02126e0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.791+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/3559574621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5572f019f650 0x5572f019fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.791+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/3559574621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5572f019e510 0x5572f019f110 secure :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000c010 tx=0x7fdcf000baa0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.791+0000 7fdd0c83b740 1 --2- 172.21.15.37:0/3559574621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5572f0194b60 0x5572f019df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.791+0000 7fdd0c83b740 1 -- 172.21.15.37:0/3559574621 >> 172.21.15.37:0/3559574621 conn(0x5572f018a940 msgr2=0x5572f0189190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.791+0000 7fdcecc00640 0 client.28226 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.791+0000 7fdd0c83b740 1 -- 172.21.15.37:0/3559574621 shutdown_connections 2024-08-20T05:13:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.792+0000 7fdd0c83b740 1 -- 172.21.15.37:0/3559574621 wait complete. 2024-08-20T05:13:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.792+0000 7fdd0c83b740 20 client.28226 trim_cache size 0 max 16384 2024-08-20T05:13:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:13:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:13:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:13:29.794 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:13:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.795+0000 7fdd09a00640 1 -- 172.21.15.37:0/2056007391 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdce80b3de0 msgr2=0x7fdce80b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.795+0000 7fdd09a00640 1 --2- 172.21.15.37:0/2056007391 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdce80b3de0 0x7fdce80b62a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdd04113ae0 tx=0x7fdd04068df0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.797+0000 7fdd09a00640 1 -- 172.21.15.37:0/2056007391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcfc12abc0 msgr2=0x7fdcfc12b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.797+0000 7fdd09a00640 1 --2- 172.21.15.37:0/2056007391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcfc12abc0 0x7fdcfc12b070 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fdd040519c0 tx=0x7fdd0407a700 comp rx=0 tx=0).stop 2024-08-20T05:13:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.797+0000 7fdd09a00640 1 -- 172.21.15.37:0/2056007391 shutdown_connections 2024-08-20T05:13:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.797+0000 7fdd09a00640 1 --2- 172.21.15.37:0/2056007391 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdce80b3de0 0x7fdce80b62a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.797+0000 7fdd09a00640 1 --2- 172.21.15.37:0/2056007391 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdcfc12abc0 0x7fdcfc12b070 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.797+0000 7fdd09a00640 1 --2- 172.21.15.37:0/2056007391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcfc097030 0x7fdcfc129f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.797+0000 7fdd09a00640 1 --2- 172.21.15.37:0/2056007391 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdcfc095520 0x7fdcfc129940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.797+0000 7fdd09a00640 1 -- 172.21.15.37:0/2056007391 >> 172.21.15.37:0/2056007391 conn(0x7fdcfc090dc0 msgr2=0x7fdcfc099b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.798+0000 7fdd09a00640 1 -- 172.21.15.37:0/2056007391 shutdown_connections 2024-08-20T05:13:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:29.798+0000 7fdd09a00640 1 -- 172.21.15.37:0/2056007391 wait complete. 2024-08-20T05:13:31.655 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T05:13:31.655 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T05:13:31.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:31 smithi130 ceph-mon[22007]: pgmap v739: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.8 MiB/s wr, 551 op/s 2024-08-20T05:13:31.733 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:31 smithi037 ceph-mon[17265]: pgmap v739: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.8 MiB/s wr, 551 op/s 2024-08-20T05:13:31.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:31 smithi135 ceph-mon[22342]: pgmap v739: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.8 MiB/s wr, 551 op/s 2024-08-20T05:13:32.365 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:13:33.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 635.0 s, 541.8 tps, lat 188.052 ms stddev 241.967 2024-08-20T05:13:33.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:33 smithi037 ceph-mon[17265]: pgmap v740: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 472 op/s 2024-08-20T05:13:33.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:33 smithi135 ceph-mon[22342]: pgmap v740: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 472 op/s 2024-08-20T05:13:33.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:33 smithi130 ceph-mon[22007]: pgmap v740: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.5 MiB/s wr, 472 op/s 2024-08-20T05:13:34.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.824+0000 7f86a3800640 1 -- 172.21.15.37:0/2094134262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f869c108350 msgr2=0x7f869c108790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:34.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.826+0000 7f86a3800640 1 --2- 172.21.15.37:0/2094134262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f869c108350 0x7f869c108790 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f868c009900 tx=0x7f868c02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.826+0000 7f86a3800640 1 -- 172.21.15.37:0/2094134262 shutdown_connections 2024-08-20T05:13:34.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.826+0000 7f86a3800640 1 --2- 172.21.15.37:0/2094134262 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f869c108cd0 0x7f869c10f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.826+0000 7f86a3800640 1 --2- 172.21.15.37:0/2094134262 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f869c108350 0x7f869c108790 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.826+0000 7f86a3800640 1 --2- 172.21.15.37:0/2094134262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f869c102940 0x7f869c102d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.826+0000 7f86a3800640 1 -- 172.21.15.37:0/2094134262 >> 172.21.15.37:0/2094134262 conn(0x7f869c0fe3f0 msgr2=0x7f869c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:34.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.826+0000 7f86a3800640 1 -- 172.21.15.37:0/2094134262 shutdown_connections 2024-08-20T05:13:34.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.826+0000 7f86a3800640 1 -- 172.21.15.37:0/2094134262 wait complete. 2024-08-20T05:13:34.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.828+0000 7f86a3800640 1 Processor -- start 2024-08-20T05:13:34.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.828+0000 7f86a3800640 1 -- start start 2024-08-20T05:13:34.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.828+0000 7f86a3800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f869c102940 0x7f869c1094c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.828+0000 7f86a3800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f869c108350 0x7f869c109a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.828+0000 7f86a3800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f869c108cd0 0x7f869c109f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.828+0000 7f86a3800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f869c1129e0 con 0x7f869c108cd0 2024-08-20T05:13:34.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.828+0000 7f86a3800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f869c112860 con 0x7f869c108350 2024-08-20T05:13:34.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.828+0000 7f86a3800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f869c112b60 con 0x7f869c102940 2024-08-20T05:13:34.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.831+0000 7f86a1800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f869c108cd0 0x7f869c109f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:34.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.831+0000 7f86a1800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f869c108cd0 0x7f869c109f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36466/0 (socket says 172.21.15.37:36466) 2024-08-20T05:13:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.831+0000 7f86a1800640 1 -- 172.21.15.37:0/482187814 learned_addr learned my addr 172.21.15.37:0/482187814 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.832+0000 7f86a0e00640 1 --2- 172.21.15.37:0/482187814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f869c102940 0x7f869c1094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.832+0000 7f869be00640 1 --2- 172.21.15.37:0/482187814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f869c108350 0x7f869c109a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.832+0000 7f869be00640 1 -- 172.21.15.37:0/482187814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f869c102940 msgr2=0x7f869c1094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.832+0000 7f869be00640 1 --2- 172.21.15.37:0/482187814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f869c102940 0x7f869c1094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.833+0000 7f869be00640 1 -- 172.21.15.37:0/482187814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f869c108cd0 msgr2=0x7f869c109f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.833+0000 7f869be00640 1 --2- 172.21.15.37:0/482187814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f869c108cd0 0x7f869c109f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.833+0000 7f869be00640 1 -- 172.21.15.37:0/482187814 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f869c19ac40 con 0x7f869c108350 2024-08-20T05:13:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.833+0000 7f869be00640 1 --2- 172.21.15.37:0/482187814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f869c108350 0x7f869c109a00 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f868c02a9e0 tx=0x7f868c003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.834+0000 7f8699600640 1 -- 172.21.15.37:0/482187814 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c03f070 con 0x7f869c108350 2024-08-20T05:13:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.836+0000 7f86a3800640 1 -- 172.21.15.37:0/482187814 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f869c19aed0 con 0x7f869c108350 2024-08-20T05:13:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.836+0000 7f86a3800640 1 -- 172.21.15.37:0/482187814 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f869c19b3d0 con 0x7f869c108350 2024-08-20T05:13:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.840+0000 7f8699600640 1 -- 172.21.15.37:0/482187814 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f868c031b50 con 0x7f869c108350 2024-08-20T05:13:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.840+0000 7f8699600640 1 -- 172.21.15.37:0/482187814 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c035030 con 0x7f869c108350 2024-08-20T05:13:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.846+0000 7f86a6437740 1 Processor -- start 2024-08-20T05:13:34.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.852+0000 7f86a6437740 1 -- start start 2024-08-20T05:13:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.852+0000 7f86a6437740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf14ba0 0x55a46bf14f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.853+0000 7f86a6437740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 0x55a46bf20f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.853+0000 7f86a6437740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf21450 0x55a46bf23840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.853+0000 7f86a6437740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a46be8b870 con 0x55a46bf154c0 2024-08-20T05:13:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.853+0000 7f86a6437740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a46be7ad70 con 0x55a46bf21450 2024-08-20T05:13:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.853+0000 7f86a6437740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a46be7edb0 con 0x55a46bf14ba0 2024-08-20T05:13:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.853+0000 7f86a1800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf14ba0 0x55a46bf14f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:34.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.853+0000 7f86a1800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf14ba0 0x55a46bf14f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52650/0 (socket says 172.21.15.37:52650) 2024-08-20T05:13:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.853+0000 7f86a1800640 1 -- 172.21.15.37:0/1767227775 learned_addr learned my addr 172.21.15.37:0/1767227775 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.853+0000 7f86a0e00640 1 --2- 172.21.15.37:0/1767227775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 0x55a46bf20f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.854+0000 7f86a1800640 1 -- 172.21.15.37:0/1767227775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf21450 msgr2=0x55a46bf23840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:13:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.854+0000 7f86a1800640 1 --2- 172.21.15.37:0/1767227775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf21450 0x55a46bf23840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.854+0000 7f86a1800640 1 -- 172.21.15.37:0/1767227775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 msgr2=0x55a46bf20f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.854+0000 7f86a1800640 1 --2- 172.21.15.37:0/1767227775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 0x55a46bf20f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.854+0000 7f86a1800640 1 -- 172.21.15.37:0/1767227775 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a46bbda930 con 0x55a46bf14ba0 2024-08-20T05:13:34.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.854+0000 7f86a1800640 1 --2- 172.21.15.37:0/1767227775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf14ba0 0x55a46bf14f80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f869400f3f0 tx=0x7f869400f8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62c1f13f4a84a6c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.855+0000 7f8692000640 1 -- 172.21.15.37:0/1767227775 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8694004d20 con 0x55a46bf14ba0 2024-08-20T05:13:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.855+0000 7f8692000640 1 -- 172.21.15.37:0/1767227775 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8694014070 con 0x55a46bf14ba0 2024-08-20T05:13:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.855+0000 7f8692000640 1 -- 172.21.15.37:0/1767227775 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86940055f0 con 0x55a46bf14ba0 2024-08-20T05:13:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.857+0000 7f86a6437740 1 -- 172.21.15.37:0/1767227775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf14ba0 msgr2=0x55a46bf14f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.857+0000 7f86a6437740 1 --2- 172.21.15.37:0/1767227775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf14ba0 0x55a46bf14f80 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f869400f3f0 tx=0x7f869400f8b0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.861+0000 7f86a6437740 1 -- 172.21.15.37:0/1767227775 shutdown_connections 2024-08-20T05:13:34.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.861+0000 7f86a6437740 1 --2- 172.21.15.37:0/1767227775 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf21450 0x55a46bf23840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.861+0000 7f86a6437740 1 --2- 172.21.15.37:0/1767227775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 0x55a46bf20f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.861+0000 7f86a6437740 1 --2- 172.21.15.37:0/1767227775 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf14ba0 0x55a46bf14f80 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.861+0000 7f86a6437740 1 -- 172.21.15.37:0/1767227775 >> 172.21.15.37:0/1767227775 conn(0x55a46bf129d0 msgr2=0x55a46bf13b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.861+0000 7f8699600640 1 -- 172.21.15.37:0/482187814 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f868c042070 con 0x7f869c108350 2024-08-20T05:13:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.861+0000 7f86a6437740 1 -- 172.21.15.37:0/1767227775 shutdown_connections 2024-08-20T05:13:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.861+0000 7f86a6437740 1 -- 172.21.15.37:0/1767227775 wait complete. 2024-08-20T05:13:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.862+0000 7f86a6437740 1 -- start start 2024-08-20T05:13:34.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.862+0000 7f86a6437740 1 Processor -- start 2024-08-20T05:13:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.864+0000 7f8699600640 1 --2- 172.21.15.37:0/482187814 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f86800b3c80 0x7f86800b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.864+0000 7f8699600640 1 -- 172.21.15.37:0/482187814 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f868c1044a0 con 0x7f869c108350 2024-08-20T05:13:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.865+0000 7f86a6437740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf14ba0 0x55a46bf20c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.865+0000 7f86a6437740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 0x55a46bf1e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.865+0000 7f86a6437740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf21450 0x55a46bf1e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.865+0000 7f86a6437740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a46bcdd890 con 0x55a46bf154c0 2024-08-20T05:13:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.865+0000 7f86a6437740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a46be01b00 con 0x55a46bf14ba0 2024-08-20T05:13:34.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.865+0000 7f86a6437740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a46bf241a0 con 0x55a46bf21450 2024-08-20T05:13:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.865+0000 7f86a6437740 10 client.0 _ll_register_callbacks cb 0x55a46be75dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.866+0000 7f86a0e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf14ba0 0x55a46bf20c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.866+0000 7f869be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 0x55a46bf1e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.866+0000 7f86a1800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf21450 0x55a46bf1e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.866+0000 7f86a1800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf21450 0x55a46bf1e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52662/0 (socket says 172.21.15.37:52662) 2024-08-20T05:13:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.866+0000 7f86a1800640 1 -- 172.21.15.37:0/2263599648 learned_addr learned my addr 172.21.15.37:0/2263599648 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.866+0000 7f86a1800640 1 --2- 172.21.15.37:0/482187814 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f86800b3c80 0x7f86800b6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:34.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.866+0000 7f86a0e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf14ba0 0x55a46bf20c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53430/0 (socket says 172.21.15.37:53430) 2024-08-20T05:13:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.867+0000 7f869be00640 1 -- 172.21.15.37:0/2263599648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf21450 msgr2=0x55a46bf1e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:34.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.868+0000 7f869be00640 1 --2- 172.21.15.37:0/2263599648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf21450 0x55a46bf1e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.868+0000 7f869be00640 1 -- 172.21.15.37:0/2263599648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf14ba0 msgr2=0x55a46bf20c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.868+0000 7f869be00640 1 --2- 172.21.15.37:0/2263599648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf14ba0 0x55a46bf20c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.868+0000 7f869be00640 1 -- 172.21.15.37:0/2263599648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a46be42a30 con 0x55a46bf154c0 2024-08-20T05:13:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.868+0000 7f86a1800640 1 --2- 172.21.15.37:0/2263599648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf21450 0x55a46bf1e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:13:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.868+0000 7f86a0e00640 1 --2- 172.21.15.37:0/2263599648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf14ba0 0x55a46bf20c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.870+0000 7f869be00640 1 --2- 172.21.15.37:0/2263599648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 0x55a46bf1e0c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x55a46bf14b50 tx=0x7f868c0cae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48ecf3f8d55800bb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.870+0000 7f8686a00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:13:34.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.870+0000 7f8686a00640 1 -- 172.21.15.37:0/2263599648 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f868c0e5060 con 0x55a46bf154c0 2024-08-20T05:13:34.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.871+0000 7f86a6437740 1 -- 172.21.15.37:0/2263599648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8694014070 con 0x55a46bf154c0 2024-08-20T05:13:34.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.871+0000 7f86a1800640 1 --2- 172.21.15.37:0/482187814 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f86800b3c80 0x7f86800b6140 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8694010fd0 tx=0x7f8694007ad0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:34.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.871+0000 7f8686a00640 1 -- 172.21.15.37:0/2263599648 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f868c0c7280 con 0x55a46bf154c0 2024-08-20T05:13:34.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.872+0000 7f8686a00640 1 -- 172.21.15.37:0/2263599648 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f868c0cb6f0 con 0x55a46bf154c0 2024-08-20T05:13:34.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.872+0000 7f86a6437740 10 client.17688 fetch_fsmap learned FSMap version 47 2024-08-20T05:13:34.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.872+0000 7f86a6437740 1 -- 172.21.15.37:0/2263599648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55a46bf2faa0 con 0x55a46bf154c0 2024-08-20T05:13:34.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.873+0000 7f8686a00640 1 -- 172.21.15.37:0/2263599648 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8694014070 con 0x55a46bf154c0 2024-08-20T05:13:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.875+0000 7f8686a00640 1 -- 172.21.15.37:0/2263599648 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 47) ==== 8374+0+0 (secure 0 0 0) 0x7f868c0d3c10 con 0x55a46bf154c0 2024-08-20T05:13:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.875+0000 7f86a6437740 10 client.17688 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T05:13:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.875+0000 7f86a6437740 10 client.17688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.875+0000 7f86a6437740 20 client.17688 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.875+0000 7f86a6437740 1 --2- 172.21.15.37:0/2263599648 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a46bf31170 0x55a46bf33590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.875+0000 7f86a6437740 4 client.17688 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:13:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.875+0000 7f86a6437740 1 -- 172.21.15.37:0/2263599648 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a46be8d7c0 con 0x55a46bf31170 2024-08-20T05:13:34.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.882+0000 7f86a0e00640 1 --2- 172.21.15.37:0/2263599648 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a46bf31170 0x55a46bf33590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.884+0000 7f86a0e00640 1 --2- 172.21.15.37:0/2263599648 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a46bf31170 0x55a46bf33590 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40d56f4b75a6d5c7 server_cookie=4a18bf1594f08f51 in_seq=0 out_seq=0 2024-08-20T05:13:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.884+0000 7f8686a00640 10 client.17688 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.888+0000 7f8686a00640 1 -- 172.21.15.37:0/2263599648 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a46be8d7c0 con 0x55a46bf31170 2024-08-20T05:13:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.888+0000 7f8686a00640 10 client.17688 handle_command_reply: tid=0 2024-08-20T05:13:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.889+0000 7f86a6437740 1 client.17688 shutdown 2024-08-20T05:13:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.889+0000 7f86a6437740 1 -- 172.21.15.37:0/2263599648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 msgr2=0x55a46bf1e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.889+0000 7f86a6437740 1 --2- 172.21.15.37:0/2263599648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 0x55a46bf1e0c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x55a46bf14b50 tx=0x7f868c0cae80 comp rx=0 tx=0).stop 2024-08-20T05:13:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.889+0000 7f86a6437740 1 -- 172.21.15.37:0/2263599648 shutdown_connections 2024-08-20T05:13:34.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.889+0000 7f86a6437740 1 --2- 172.21.15.37:0/2263599648 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a46bf31170 0x55a46bf33590 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.889+0000 7f86a6437740 1 --2- 172.21.15.37:0/2263599648 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf21450 0x55a46bf1e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.889+0000 7f86a6437740 1 --2- 172.21.15.37:0/2263599648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 0x55a46bf1e0c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.889+0000 7f86a6437740 1 --2- 172.21.15.37:0/2263599648 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf14ba0 0x55a46bf20c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.889+0000 7f8686a00640 0 client.17688 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.889+0000 7f86a6437740 1 -- 172.21.15.37:0/2263599648 >> 172.21.15.37:0/2263599648 conn(0x55a46bf129d0 msgr2=0x55a46bf18570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.889+0000 7f86a6437740 1 -- 172.21.15.37:0/2263599648 shutdown_connections 2024-08-20T05:13:34.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.890+0000 7f86a6437740 1 -- 172.21.15.37:0/2263599648 wait complete. 2024-08-20T05:13:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.891+0000 7f86a6437740 20 client.17688 trim_cache size 0 max 16384 2024-08-20T05:13:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.928+0000 7f86a6437740 1 Processor -- start 2024-08-20T05:13:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.928+0000 7f86a6437740 1 -- start start 2024-08-20T05:13:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.929+0000 7f86a6437740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf14ba0 0x55a46bf2d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.929+0000 7f86a6437740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 0x55a46bf195d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.929+0000 7f86a6437740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf21450 0x55a46bf38e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.929+0000 7f86a6437740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f867c00fbc0 con 0x55a46bf154c0 2024-08-20T05:13:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.929+0000 7f86a6437740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f867c011700 con 0x55a46bf21450 2024-08-20T05:13:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.929+0000 7f86a6437740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f867c010290 con 0x55a46bf14ba0 2024-08-20T05:13:34.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.930+0000 7f86a0e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf14ba0 0x55a46bf2d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.930+0000 7f86a0e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf14ba0 0x55a46bf2d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52664/0 (socket says 172.21.15.37:52664) 2024-08-20T05:13:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.930+0000 7f86a0e00640 1 -- 172.21.15.37:0/2176526152 learned_addr learned my addr 172.21.15.37:0/2176526152 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.930+0000 7f86a1800640 1 --2- 172.21.15.37:0/2176526152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf21450 0x55a46bf38e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.930+0000 7f86a0e00640 1 -- 172.21.15.37:0/2176526152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf21450 msgr2=0x55a46bf38e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.930+0000 7f86a0e00640 1 --2- 172.21.15.37:0/2176526152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf21450 0x55a46bf38e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.930+0000 7f86a0e00640 1 -- 172.21.15.37:0/2176526152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 msgr2=0x55a46bf195d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.930+0000 7f869be00640 1 --2- 172.21.15.37:0/2176526152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 0x55a46bf195d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.930+0000 7f86a0e00640 1 --2- 172.21.15.37:0/2176526152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 0x55a46bf195d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.930+0000 7f86a0e00640 1 -- 172.21.15.37:0/2176526152 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a46bf13450 con 0x55a46bf14ba0 2024-08-20T05:13:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.931+0000 7f86a0e00640 1 --2- 172.21.15.37:0/2176526152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf14ba0 0x55a46bf2d350 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8688004280 tx=0x7f86880039c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd86af4d34a62480 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.931+0000 7f8691600640 1 -- 172.21.15.37:0/2176526152 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8688024020 con 0x55a46bf14ba0 2024-08-20T05:13:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.931+0000 7f8691600640 1 -- 172.21.15.37:0/2176526152 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86880208f0 con 0x55a46bf14ba0 2024-08-20T05:13:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.931+0000 7f8691600640 1 -- 172.21.15.37:0/2176526152 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8688013bf0 con 0x55a46bf14ba0 2024-08-20T05:13:34.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.932+0000 7f86a6437740 1 -- 172.21.15.37:0/2176526152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf14ba0 msgr2=0x55a46bf2d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.932+0000 7f86a6437740 1 --2- 172.21.15.37:0/2176526152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf14ba0 0x55a46bf2d350 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8688004280 tx=0x7f86880039c0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.935+0000 7f86a6437740 1 -- 172.21.15.37:0/2176526152 shutdown_connections 2024-08-20T05:13:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.935+0000 7f86a6437740 1 --2- 172.21.15.37:0/2176526152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf21450 0x55a46bf38e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.935+0000 7f86a6437740 1 --2- 172.21.15.37:0/2176526152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 0x55a46bf195d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.935+0000 7f86a6437740 1 --2- 172.21.15.37:0/2176526152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf14ba0 0x55a46bf2d350 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.935+0000 7f86a6437740 1 -- 172.21.15.37:0/2176526152 >> 172.21.15.37:0/2176526152 conn(0x55a46bf129d0 msgr2=0x55a46bf18ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.936+0000 7f86a6437740 1 -- 172.21.15.37:0/2176526152 shutdown_connections 2024-08-20T05:13:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.936+0000 7f86a6437740 1 -- 172.21.15.37:0/2176526152 wait complete. 2024-08-20T05:13:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.937+0000 7f86a6437740 1 -- start start 2024-08-20T05:13:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.937+0000 7f86a6437740 1 Processor -- start 2024-08-20T05:13:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.939+0000 7f86a6437740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf14ba0 0x55a46bf24c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.939+0000 7f86a6437740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 0x55a46bf251b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.939+0000 7f86a6437740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf21450 0x55a46bf99e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.940+0000 7f86a6437740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f867c011030 con 0x55a46bf154c0 2024-08-20T05:13:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.940+0000 7f869be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 0x55a46bf251b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.940+0000 7f86a1800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf21450 0x55a46bf99e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.940+0000 7f86a1800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf21450 0x55a46bf99e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52676/0 (socket says 172.21.15.37:52676) 2024-08-20T05:13:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.940+0000 7f86a1800640 1 -- 172.21.15.37:0/4208586248 learned_addr learned my addr 172.21.15.37:0/4208586248 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.940+0000 7f86a0e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf14ba0 0x55a46bf24c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.941+0000 7f86a6437740 1 -- 172.21.15.37:0/4208586248 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f867c010960 con 0x55a46bf14ba0 2024-08-20T05:13:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.941+0000 7f86a6437740 1 -- 172.21.15.37:0/4208586248 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f867c00db60 con 0x55a46bf21450 2024-08-20T05:13:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.941+0000 7f86a6437740 10 client.0 _ll_register_callbacks cb 0x7f868c005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.941+0000 7f86a1800640 1 -- 172.21.15.37:0/4208586248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf14ba0 msgr2=0x55a46bf24c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.942+0000 7f86a1800640 1 --2- 172.21.15.37:0/4208586248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf14ba0 0x55a46bf24c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.942+0000 7f86a1800640 1 -- 172.21.15.37:0/4208586248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 msgr2=0x55a46bf251b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:34.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.942+0000 7f86a1800640 1 --2- 172.21.15.37:0/4208586248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 0x55a46bf251b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.942+0000 7f86a1800640 1 -- 172.21.15.37:0/4208586248 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a46bf9a4f0 con 0x55a46bf21450 2024-08-20T05:13:34.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.942+0000 7f86a0e00640 1 --2- 172.21.15.37:0/4208586248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf14ba0 0x55a46bf24c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:34.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.942+0000 7f8686a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:13:34.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.942+0000 7f86a1800640 1 --2- 172.21.15.37:0/4208586248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf21450 0x55a46bf99e00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f869400f3f0 tx=0x7f86940051d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e18b313dec726dc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:34.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.943+0000 7f8686a00640 1 -- 172.21.15.37:0/4208586248 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869402a040 con 0x55a46bf21450 2024-08-20T05:13:34.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.943+0000 7f8686a00640 1 -- 172.21.15.37:0/4208586248 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f86940057d0 con 0x55a46bf21450 2024-08-20T05:13:34.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.944+0000 7f86a6437740 1 -- 172.21.15.37:0/4208586248 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86880208f0 con 0x55a46bf21450 2024-08-20T05:13:34.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.944+0000 7f8686a00640 1 -- 172.21.15.37:0/4208586248 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f869402a040 con 0x55a46bf21450 2024-08-20T05:13:34.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.946+0000 7f86a6437740 10 client.28273 fetch_fsmap learned FSMap version 47 2024-08-20T05:13:34.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.946+0000 7f86a6437740 1 -- 172.21.15.37:0/4208586248 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55a46bf9b810 con 0x55a46bf21450 2024-08-20T05:13:34.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.946+0000 7f8686a00640 1 -- 172.21.15.37:0/4208586248 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86880208f0 con 0x55a46bf21450 2024-08-20T05:13:34.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.946+0000 7f8686a00640 1 -- 172.21.15.37:0/4208586248 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 47) ==== 8374+0+0 (secure 0 0 0) 0x7f86940044f0 con 0x55a46bf21450 2024-08-20T05:13:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.947+0000 7f86a6437740 10 client.28273 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T05:13:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.947+0000 7f86a6437740 10 client.28273 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.947+0000 7f86a6437740 20 client.28273 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.947+0000 7f86a6437740 1 --2- 172.21.15.37:0/4208586248 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a46bf9bd10 0x55a46bf9e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.947+0000 7f86a6437740 4 client.28273 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T05:13:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.947+0000 7f86a6437740 1 -- 172.21.15.37:0/4208586248 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a46be89260 con 0x55a46bf9bd10 2024-08-20T05:13:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.947+0000 7f86a0e00640 1 --2- 172.21.15.37:0/4208586248 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a46bf9bd10 0x55a46bf9e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.948+0000 7f8686a00640 10 client.28273 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.949+0000 7f86a0e00640 1 --2- 172.21.15.37:0/4208586248 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a46bf9bd10 0x55a46bf9e130 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1ecfb42b3166c6b server_cookie=912727a8fe9f5249 in_seq=0 out_seq=0 2024-08-20T05:13:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.950+0000 7f8686a00640 1 -- 172.21.15.37:0/4208586248 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a46be89260 con 0x55a46bf9bd10 2024-08-20T05:13:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.950+0000 7f8686a00640 10 client.28273 handle_command_reply: tid=0 2024-08-20T05:13:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.950+0000 7f86a6437740 1 client.28273 shutdown 2024-08-20T05:13:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.950+0000 7f86a6437740 1 -- 172.21.15.37:0/4208586248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf21450 msgr2=0x55a46bf99e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:34.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.950+0000 7f86a6437740 1 --2- 172.21.15.37:0/4208586248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf21450 0x55a46bf99e00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f869400f3f0 tx=0x7f86940051d0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.951+0000 7f86a6437740 1 -- 172.21.15.37:0/4208586248 shutdown_connections 2024-08-20T05:13:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.951+0000 7f86a6437740 1 --2- 172.21.15.37:0/4208586248 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a46bf9bd10 0x55a46bf9e130 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.951+0000 7f86a6437740 1 --2- 172.21.15.37:0/4208586248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a46bf21450 0x55a46bf99e00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.951+0000 7f86a6437740 1 --2- 172.21.15.37:0/4208586248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a46bf154c0 0x55a46bf251b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.951+0000 7f8686a00640 0 client.28273 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.951+0000 7f86a6437740 1 --2- 172.21.15.37:0/4208586248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a46bf14ba0 0x55a46bf24c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.951+0000 7f86a6437740 1 -- 172.21.15.37:0/4208586248 >> 172.21.15.37:0/4208586248 conn(0x55a46bf129d0 msgr2=0x55a46bf196c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.952+0000 7f86a6437740 1 -- 172.21.15.37:0/4208586248 shutdown_connections 2024-08-20T05:13:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.952+0000 7f86a6437740 1 -- 172.21.15.37:0/4208586248 wait complete. 2024-08-20T05:13:34.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.952+0000 7f86a6437740 20 client.28273 trim_cache size 0 max 16384 2024-08-20T05:13:34.121 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:13:34.121 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-20T05:13:34.121 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "c434d135-523e-4c28-84c1-e8a9ae961b18", 2024-08-20T05:13:34.121 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-20T05:13:34.121 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:13:34.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.953+0000 7f86a3800640 1 -- 172.21.15.37:0/482187814 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f86800b3c80 msgr2=0x7f86800b6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:34.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.953+0000 7f86a3800640 1 --2- 172.21.15.37:0/482187814 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f86800b3c80 0x7f86800b6140 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f8694010fd0 tx=0x7f8694007ad0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.953+0000 7f86a3800640 1 -- 172.21.15.37:0/482187814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f869c108350 msgr2=0x7f869c109a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:34.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.953+0000 7f86a3800640 1 --2- 172.21.15.37:0/482187814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f869c108350 0x7f869c109a00 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f868c02a9e0 tx=0x7f868c003b90 comp rx=0 tx=0).stop 2024-08-20T05:13:34.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.953+0000 7f86a3800640 1 -- 172.21.15.37:0/482187814 shutdown_connections 2024-08-20T05:13:34.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.953+0000 7f86a3800640 1 --2- 172.21.15.37:0/482187814 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f86800b3c80 0x7f86800b6140 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.953+0000 7f86a3800640 1 --2- 172.21.15.37:0/482187814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f869c108cd0 0x7f869c109f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.953+0000 7f86a3800640 1 --2- 172.21.15.37:0/482187814 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f869c108350 0x7f869c109a00 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.953+0000 7f86a3800640 1 --2- 172.21.15.37:0/482187814 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f869c102940 0x7f869c1094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:34.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.954+0000 7f86a3800640 1 -- 172.21.15.37:0/482187814 >> 172.21.15.37:0/482187814 conn(0x7f869c0fe3f0 msgr2=0x7f869c104900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:34.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.954+0000 7f86a3800640 1 -- 172.21.15.37:0/482187814 shutdown_connections 2024-08-20T05:13:34.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:33.954+0000 7f86a3800640 1 -- 172.21.15.37:0/482187814 wait complete. 2024-08-20T05:13:34.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:34 smithi037 ceph-mon[17265]: scrub queued for path: / 2024-08-20T05:13:34.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:34 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:34.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:34 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:13:34.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:34 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:13:34.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:34 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:13:34.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:34 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:13:34.769 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:34 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:34.769 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:34 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:34.769 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:34 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:34.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:34 smithi135 ceph-mon[22342]: scrub queued for path: / 2024-08-20T05:13:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:34 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:34 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:13:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:34 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:13:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:34 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:13:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:34 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:13:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:34 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:34 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:34.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:34 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:34.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:34 smithi130 ceph-mon[22007]: scrub queued for path: / 2024-08-20T05:13:34.957 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:34 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:34.958 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:34 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:13:34.958 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:34 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:13:34.958 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:34 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:13:34.958 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:34 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:13:34.958 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:34 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:34.958 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:34 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:34.958 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:34 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:35 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:13:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:35 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:35 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:35 smithi037 ceph-mon[17265]: pgmap v741: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.2 MiB/s wr, 612 op/s 2024-08-20T05:13:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:35 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:13:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:35 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:35 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:35.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:35 smithi135 ceph-mon[22342]: pgmap v741: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.2 MiB/s wr, 612 op/s 2024-08-20T05:13:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:35 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:13:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:35 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:35 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:13:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:35 smithi130 ceph-mon[22007]: pgmap v741: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 8.2 MiB/s wr, 612 op/s 2024-08-20T05:13:36.407 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:13:37.203 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:13:37.733 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:37 smithi037 ceph-mon[17265]: pgmap v742: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 7.0 MiB/s wr, 552 op/s 2024-08-20T05:13:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:37 smithi135 ceph-mon[22342]: pgmap v742: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 7.0 MiB/s wr, 552 op/s 2024-08-20T05:13:37.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:37 smithi130 ceph-mon[22007]: pgmap v742: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 7.0 MiB/s wr, 552 op/s 2024-08-20T05:13:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 640.0 s, 523.0 tps, lat 179.859 ms stddev 232.214 2024-08-20T05:13:38.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.215+0000 7f44a2e00640 1 -- 172.21.15.37:0/3839270823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f449c104cc0 msgr2=0x7f449c1050a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:38.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.215+0000 7f44a2e00640 1 --2- 172.21.15.37:0/3839270823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f449c104cc0 0x7f449c1050a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f448c009860 tx=0x7f448c02a340 comp rx=0 tx=0).stop 2024-08-20T05:13:38.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.216+0000 7f44a2e00640 1 -- 172.21.15.37:0/3839270823 shutdown_connections 2024-08-20T05:13:38.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.216+0000 7f44a2e00640 1 --2- 172.21.15.37:0/3839270823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f449c10b050 0x7f449c111850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.216+0000 7f44a2e00640 1 --2- 172.21.15.37:0/3839270823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f449c10a6d0 0x7f449c10ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.216+0000 7f44a2e00640 1 --2- 172.21.15.37:0/3839270823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f449c104cc0 0x7f449c1050a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.216+0000 7f44a2e00640 1 -- 172.21.15.37:0/3839270823 >> 172.21.15.37:0/3839270823 conn(0x7f449c1006f0 msgr2=0x7f449c102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:38.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.216+0000 7f44a2e00640 1 -- 172.21.15.37:0/3839270823 shutdown_connections 2024-08-20T05:13:38.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.217+0000 7f44a2e00640 1 -- 172.21.15.37:0/3839270823 wait complete. 2024-08-20T05:13:38.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.218+0000 7f44a2e00640 1 Processor -- start 2024-08-20T05:13:38.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.219+0000 7f44a2e00640 1 -- start start 2024-08-20T05:13:38.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.220+0000 7f44a2e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f449c10a6d0 0x7f449c1117a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.220+0000 7f44a2e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f449c10b050 0x7f449c10e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.220+0000 7f44a2e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f449c10f050 0x7f449c1ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.220+0000 7f449b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f449c10b050 0x7f449c10e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:38.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.220+0000 7f44a0e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f449c10f050 0x7f449c1ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:38.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.220+0000 7f449b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f449c10b050 0x7f449c10e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53470/0 (socket says 172.21.15.37:53470) 2024-08-20T05:13:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.220+0000 7f449b400640 1 -- 172.21.15.37:0/400324678 learned_addr learned my addr 172.21.15.37:0/400324678 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.220+0000 7f44a2e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f449c114cd0 con 0x7f449c10a6d0 2024-08-20T05:13:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.220+0000 7f44a2e00640 1 -- 172.21.15.37:0/400324678 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f449c114b50 con 0x7f449c10b050 2024-08-20T05:13:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.220+0000 7f44a2e00640 1 -- 172.21.15.37:0/400324678 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f449c114e50 con 0x7f449c10f050 2024-08-20T05:13:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.221+0000 7f449be00640 1 --2- 172.21.15.37:0/400324678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f449c10a6d0 0x7f449c1117a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.221+0000 7f449b400640 1 -- 172.21.15.37:0/400324678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f449c10f050 msgr2=0x7f449c1ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.221+0000 7f449b400640 1 --2- 172.21.15.37:0/400324678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f449c10f050 0x7f449c1ab9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.221+0000 7f449b400640 1 -- 172.21.15.37:0/400324678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f449c10a6d0 msgr2=0x7f449c1117a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.221+0000 7f449b400640 1 --2- 172.21.15.37:0/400324678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f449c10a6d0 0x7f449c1117a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.221+0000 7f449b400640 1 -- 172.21.15.37:0/400324678 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f449c1abef0 con 0x7f449c10b050 2024-08-20T05:13:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.221+0000 7f44a0e00640 1 --2- 172.21.15.37:0/400324678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f449c10f050 0x7f449c1ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:38.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.221+0000 7f449be00640 1 --2- 172.21.15.37:0/400324678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f449c10a6d0 0x7f449c1117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:38.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.221+0000 7f449b400640 1 --2- 172.21.15.37:0/400324678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f449c10b050 0x7f449c10e9f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f448800e9c0 tx=0x7f448800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:38.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.222+0000 7f4498c00640 1 -- 172.21.15.37:0/400324678 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448800ccc0 con 0x7f449c10b050 2024-08-20T05:13:38.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.222+0000 7f4498c00640 1 -- 172.21.15.37:0/400324678 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44880054d0 con 0x7f449c10b050 2024-08-20T05:13:38.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.222+0000 7f4498c00640 1 -- 172.21.15.37:0/400324678 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4488010430 con 0x7f449c10b050 2024-08-20T05:13:38.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.222+0000 7f44a2e00640 1 -- 172.21.15.37:0/400324678 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f449c1ac0c0 con 0x7f449c10b050 2024-08-20T05:13:38.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.222+0000 7f44a2e00640 1 -- 172.21.15.37:0/400324678 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f449c1ac550 con 0x7f449c10b050 2024-08-20T05:13:38.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.226+0000 7f44a5a77740 1 Processor -- start 2024-08-20T05:13:38.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.226+0000 7f44a5a77740 1 -- start start 2024-08-20T05:13:38.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.226+0000 7f44a5a77740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb41900 0x55970cb41ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.226+0000 7f44a5a77740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb42220 0x55970cb4dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.226+0000 7f44a5a77740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb4e1b0 0x55970cb505a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.226+0000 7f44a5a77740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55970cab7a60 con 0x55970cb41900 2024-08-20T05:13:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.226+0000 7f44a5a77740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55970caa6f60 con 0x55970cb4e1b0 2024-08-20T05:13:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.226+0000 7f44a5a77740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55970caaafa0 con 0x55970cb42220 2024-08-20T05:13:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.226+0000 7f449be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb42220 0x55970cb4dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.226+0000 7f449be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb42220 0x55970cb4dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52696/0 (socket says 172.21.15.37:52696) 2024-08-20T05:13:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.226+0000 7f449be00640 1 -- 172.21.15.37:0/4196626065 learned_addr learned my addr 172.21.15.37:0/4196626065 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.226+0000 7f44a0e00640 1 --2- 172.21.15.37:0/4196626065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb41900 0x55970cb41ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.227+0000 7f4498c00640 1 -- 172.21.15.37:0/400324678 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4488004f80 con 0x7f449c10b050 2024-08-20T05:13:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.227+0000 7f449be00640 1 -- 172.21.15.37:0/4196626065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb4e1b0 msgr2=0x55970cb505a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:13:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.227+0000 7f449be00640 1 --2- 172.21.15.37:0/4196626065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb4e1b0 0x55970cb505a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.227+0000 7f449be00640 1 -- 172.21.15.37:0/4196626065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb41900 msgr2=0x55970cb41ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.227+0000 7f449be00640 1 --2- 172.21.15.37:0/4196626065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb41900 0x55970cb41ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.227+0000 7f449be00640 1 -- 172.21.15.37:0/4196626065 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55970ca4d3e0 con 0x55970cb42220 2024-08-20T05:13:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.228+0000 7f449be00640 1 --2- 172.21.15.37:0/4196626065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb42220 0x55970cb4dc70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f448c000c00 tx=0x7f448c004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9688e1698f267f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.228+0000 7f4491600640 1 -- 172.21.15.37:0/4196626065 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c037070 con 0x55970cb42220 2024-08-20T05:13:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.228+0000 7f4491600640 1 -- 172.21.15.37:0/4196626065 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f448c041070 con 0x55970cb42220 2024-08-20T05:13:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.228+0000 7f4491600640 1 -- 172.21.15.37:0/4196626065 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c004c90 con 0x55970cb42220 2024-08-20T05:13:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.229+0000 7f4498c00640 1 --2- 172.21.15.37:0/400324678 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f44800b3bd0 0x7f44800b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.229+0000 7f4498c00640 1 -- 172.21.15.37:0/400324678 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f44880e4370 con 0x7f449c10b050 2024-08-20T05:13:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.230+0000 7f44a5a77740 1 -- 172.21.15.37:0/4196626065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb42220 msgr2=0x55970cb4dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.230+0000 7f44a5a77740 1 --2- 172.21.15.37:0/4196626065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb42220 0x55970cb4dc70 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f448c000c00 tx=0x7f448c004040 comp rx=0 tx=0).stop 2024-08-20T05:13:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.230+0000 7f44a0e00640 1 --2- 172.21.15.37:0/400324678 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f44800b3bd0 0x7f44800b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.230+0000 7f44a5a77740 1 -- 172.21.15.37:0/4196626065 shutdown_connections 2024-08-20T05:13:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.230+0000 7f44a5a77740 1 --2- 172.21.15.37:0/4196626065 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb4e1b0 0x55970cb505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.230+0000 7f44a5a77740 1 --2- 172.21.15.37:0/4196626065 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb42220 0x55970cb4dc70 secure :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f448c000c00 tx=0x7f448c004040 comp rx=0 tx=0).stop 2024-08-20T05:13:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.230+0000 7f44a5a77740 1 --2- 172.21.15.37:0/4196626065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb41900 0x55970cb41ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.230+0000 7f44a5a77740 1 -- 172.21.15.37:0/4196626065 >> 172.21.15.37:0/4196626065 conn(0x55970cb3f730 msgr2=0x55970cb408d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.231+0000 7f44a5a77740 1 -- 172.21.15.37:0/4196626065 shutdown_connections 2024-08-20T05:13:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.231+0000 7f44a5a77740 1 -- 172.21.15.37:0/4196626065 wait complete. 2024-08-20T05:13:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.232+0000 7f44a5a77740 1 -- start start 2024-08-20T05:13:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.232+0000 7f44a0e00640 1 --2- 172.21.15.37:0/400324678 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f44800b3bd0 0x7f44800b6090 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4494009fd0 tx=0x7f4494009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.232+0000 7f44a5a77740 1 Processor -- start 2024-08-20T05:13:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.232+0000 7f44a5a77740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb41900 0x55970cb4b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.232+0000 7f44a5a77740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb4e1b0 0x55970cb4b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.232+0000 7f44a5a77740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb4bbe0 0x55970cb5a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.233+0000 7f44a5a77740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55970c909700 con 0x55970cb41900 2024-08-20T05:13:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.233+0000 7f44a5a77740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55970ca42250 con 0x55970cb4e1b0 2024-08-20T05:13:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.233+0000 7f44a5a77740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55970cb50dd0 con 0x55970cb4bbe0 2024-08-20T05:13:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.233+0000 7f44a5a77740 10 client.0 _ll_register_callbacks cb 0x55970caa1180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.233+0000 7f449be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb41900 0x55970cb4b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:38.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.233+0000 7f44a0e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb4bbe0 0x55970cb5a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:38.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.233+0000 7f449be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb41900 0x55970cb4b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36530/0 (socket says 172.21.15.37:36530) 2024-08-20T05:13:38.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.233+0000 7f449be00640 1 -- 172.21.15.37:0/1523818943 learned_addr learned my addr 172.21.15.37:0/1523818943 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:38.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.233+0000 7f449b400640 1 --2- 172.21.15.37:0/1523818943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb4e1b0 0x55970cb4b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:38.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.233+0000 7f449b400640 1 -- 172.21.15.37:0/1523818943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb4bbe0 msgr2=0x55970cb5a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:38.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.234+0000 7f449b400640 1 --2- 172.21.15.37:0/1523818943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb4bbe0 0x55970cb5a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.234+0000 7f449b400640 1 -- 172.21.15.37:0/1523818943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb41900 msgr2=0x55970cb4b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:38.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.234+0000 7f449b400640 1 --2- 172.21.15.37:0/1523818943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb41900 0x55970cb4b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.234+0000 7f449b400640 1 -- 172.21.15.37:0/1523818943 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55970c806650 con 0x55970cb4e1b0 2024-08-20T05:13:38.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.234+0000 7f449be00640 1 --2- 172.21.15.37:0/1523818943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb41900 0x55970cb4b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:38.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.234+0000 7f44a0e00640 1 --2- 172.21.15.37:0/1523818943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb4bbe0 0x55970cb5a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:38.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.234+0000 7f449b400640 1 --2- 172.21.15.37:0/1523818943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb4e1b0 0x55970cb4b6a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f44880e1bc0 tx=0x7f448800cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40b836d57950218d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:38.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.234+0000 7f4486000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:13:38.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.234+0000 7f4486000640 1 -- 172.21.15.37:0/1523818943 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44880af5c0 con 0x55970cb4e1b0 2024-08-20T05:13:38.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.235+0000 7f4486000640 1 -- 172.21.15.37:0/1523818943 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f44880e4170 con 0x55970cb4e1b0 2024-08-20T05:13:38.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.235+0000 7f44a5a77740 1 -- 172.21.15.37:0/1523818943 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f448c041070 con 0x55970cb4e1b0 2024-08-20T05:13:38.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.235+0000 7f4486000640 1 -- 172.21.15.37:0/1523818943 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f44880b4070 con 0x55970cb4e1b0 2024-08-20T05:13:38.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.235+0000 7f44a5a77740 10 client.28247 fetch_fsmap learned FSMap version 47 2024-08-20T05:13:38.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.235+0000 7f44a5a77740 1 -- 172.21.15.37:0/1523818943 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55970cb5cd60 con 0x55970cb4e1b0 2024-08-20T05:13:38.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.235+0000 7f4486000640 1 -- 172.21.15.37:0/1523818943 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f448c041070 con 0x55970cb4e1b0 2024-08-20T05:13:38.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.235+0000 7f4486000640 1 -- 172.21.15.37:0/1523818943 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 47) ==== 8374+0+0 (secure 0 0 0) 0x7f44880ad070 con 0x55970cb4e1b0 2024-08-20T05:13:38.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.236+0000 7f44a5a77740 10 client.28247 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T05:13:38.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.236+0000 7f44a5a77740 10 client.28247 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:38.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.236+0000 7f44a5a77740 20 client.28247 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:38.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.236+0000 7f44a5a77740 1 --2- 172.21.15.37:0/1523818943 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55970cb5e210 0x55970cb60630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.236+0000 7f44a5a77740 4 client.28247 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:13:38.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.236+0000 7f44a5a77740 1 -- 172.21.15.37:0/1523818943 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55970cab99b0 con 0x55970cb5e210 2024-08-20T05:13:38.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.236+0000 7f449be00640 1 --2- 172.21.15.37:0/1523818943 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55970cb5e210 0x55970cb60630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:38.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.237+0000 7f449be00640 1 --2- 172.21.15.37:0/1523818943 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55970cb5e210 0x55970cb60630 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7df718255ac9f4cb server_cookie=12d5aef74a4d8f04 in_seq=0 out_seq=0 2024-08-20T05:13:38.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.237+0000 7f4486000640 10 client.28247 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:38.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.237+0000 7f4486000640 1 -- 172.21.15.37:0/1523818943 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55970cab99b0 con 0x55970cb5e210 2024-08-20T05:13:38.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.237+0000 7f4486000640 10 client.28247 handle_command_reply: tid=0 2024-08-20T05:13:38.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.238+0000 7f44a5a77740 1 client.28247 shutdown 2024-08-20T05:13:38.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.238+0000 7f44a5a77740 1 -- 172.21.15.37:0/1523818943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb4e1b0 msgr2=0x55970cb4b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:38.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.238+0000 7f44a5a77740 1 --2- 172.21.15.37:0/1523818943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb4e1b0 0x55970cb4b6a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f44880e1bc0 tx=0x7f448800cf20 comp rx=0 tx=0).stop 2024-08-20T05:13:38.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.238+0000 7f44a5a77740 1 -- 172.21.15.37:0/1523818943 shutdown_connections 2024-08-20T05:13:38.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.238+0000 7f44a5a77740 1 --2- 172.21.15.37:0/1523818943 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55970cb5e210 0x55970cb60630 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.238+0000 7f4486000640 0 client.28247 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:38.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.238+0000 7f44a5a77740 1 --2- 172.21.15.37:0/1523818943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb4bbe0 0x55970cb5a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.238+0000 7f44a5a77740 1 --2- 172.21.15.37:0/1523818943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb4e1b0 0x55970cb4b6a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.238+0000 7f44a5a77740 1 --2- 172.21.15.37:0/1523818943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb41900 0x55970cb4b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.238+0000 7f44a5a77740 1 -- 172.21.15.37:0/1523818943 >> 172.21.15.37:0/1523818943 conn(0x55970cb3f730 msgr2=0x55970cb452d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:38.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.238+0000 7f44a5a77740 1 -- 172.21.15.37:0/1523818943 shutdown_connections 2024-08-20T05:13:38.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.238+0000 7f44a5a77740 1 -- 172.21.15.37:0/1523818943 wait complete. 2024-08-20T05:13:38.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.238+0000 7f44a5a77740 20 client.28247 trim_cache size 0 max 16384 2024-08-20T05:13:38.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.266+0000 7f44a5a77740 1 Processor -- start 2024-08-20T05:13:38.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.266+0000 7f44a5a77740 1 -- start start 2024-08-20T05:13:38.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.266+0000 7f44a5a77740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb41900 0x55970cb3dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.267+0000 7f44a5a77740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb4bbe0 0x55970cb59ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.267+0000 7f44a5a77740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb4e1b0 0x55970cb5a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.267+0000 7f44a5a77740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1b63c0 con 0x55970cb4e1b0 2024-08-20T05:13:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.267+0000 7f44a5a77740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1b7f00 con 0x55970cb41900 2024-08-20T05:13:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.267+0000 7f44a5a77740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1b6a90 con 0x55970cb4bbe0 2024-08-20T05:13:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.267+0000 7f449be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb41900 0x55970cb3dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.267+0000 7f449b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb4bbe0 0x55970cb59ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.267+0000 7f449be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb41900 0x55970cb3dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53496/0 (socket says 172.21.15.37:53496) 2024-08-20T05:13:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.267+0000 7f449be00640 1 -- 172.21.15.37:0/2967475230 learned_addr learned my addr 172.21.15.37:0/2967475230 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.267+0000 7f449b400640 1 -- 172.21.15.37:0/2967475230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb41900 msgr2=0x55970cb3dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.267+0000 7f449b400640 1 --2- 172.21.15.37:0/2967475230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb41900 0x55970cb3dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.267+0000 7f449b400640 1 -- 172.21.15.37:0/2967475230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb4e1b0 msgr2=0x55970cb5a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.267+0000 7f44a0e00640 1 --2- 172.21.15.37:0/2967475230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb4e1b0 0x55970cb5a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.268+0000 7f449b400640 1 --2- 172.21.15.37:0/2967475230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb4e1b0 0x55970cb5a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.268+0000 7f449b400640 1 -- 172.21.15.37:0/2967475230 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55970cb401b0 con 0x55970cb4bbe0 2024-08-20T05:13:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.268+0000 7f44a0e00640 1 --2- 172.21.15.37:0/2967475230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb4e1b0 0x55970cb5a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.268+0000 7f449b400640 1 --2- 172.21.15.37:0/2967475230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb4bbe0 0x55970cb59ef0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f44880aaf50 tx=0x7f4488004a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4f68bc358ccec5c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.268+0000 7f4490c00640 1 -- 172.21.15.37:0/2967475230 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44880af5c0 con 0x55970cb4bbe0 2024-08-20T05:13:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.268+0000 7f4490c00640 1 -- 172.21.15.37:0/2967475230 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4488070190 con 0x55970cb4bbe0 2024-08-20T05:13:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.268+0000 7f4490c00640 1 -- 172.21.15.37:0/2967475230 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44880af140 con 0x55970cb4bbe0 2024-08-20T05:13:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.269+0000 7f44a5a77740 1 -- 172.21.15.37:0/2967475230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb4bbe0 msgr2=0x55970cb59ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.269+0000 7f44a5a77740 1 --2- 172.21.15.37:0/2967475230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb4bbe0 0x55970cb59ef0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f44880aaf50 tx=0x7f4488004a20 comp rx=0 tx=0).stop 2024-08-20T05:13:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.269+0000 7f44a5a77740 1 -- 172.21.15.37:0/2967475230 shutdown_connections 2024-08-20T05:13:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.269+0000 7f44a5a77740 1 --2- 172.21.15.37:0/2967475230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb4e1b0 0x55970cb5a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.269+0000 7f44a5a77740 1 --2- 172.21.15.37:0/2967475230 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb4bbe0 0x55970cb59ef0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.269+0000 7f44a5a77740 1 --2- 172.21.15.37:0/2967475230 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb41900 0x55970cb3dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.269+0000 7f44a5a77740 1 -- 172.21.15.37:0/2967475230 >> 172.21.15.37:0/2967475230 conn(0x55970cb3f730 msgr2=0x55970cb46440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.270+0000 7f44a5a77740 1 -- 172.21.15.37:0/2967475230 shutdown_connections 2024-08-20T05:13:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.270+0000 7f44a5a77740 1 -- 172.21.15.37:0/2967475230 wait complete. 2024-08-20T05:13:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.270+0000 7f44a5a77740 1 -- start start 2024-08-20T05:13:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.270+0000 7f44a5a77740 1 Processor -- start 2024-08-20T05:13:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f44a5a77740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb41900 0x55970cbc2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f44a5a77740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb4bbe0 0x55970cbc29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f44a5a77740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb4e1b0 0x55970cbc2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f44a5a77740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1b7830 con 0x55970cb4e1b0 2024-08-20T05:13:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f44a5a77740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1b7160 con 0x55970cb4bbe0 2024-08-20T05:13:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f44a5a77740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f449c1b43a0 con 0x55970cb41900 2024-08-20T05:13:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f44a5a77740 10 client.0 _ll_register_callbacks cb 0x55970cb4e100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f449b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb4bbe0 0x55970cbc29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f449be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb41900 0x55970cbc2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f449b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb4bbe0 0x55970cbc29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53512/0 (socket says 172.21.15.37:53512) 2024-08-20T05:13:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f449b400640 1 -- 172.21.15.37:0/2392304437 learned_addr learned my addr 172.21.15.37:0/2392304437 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f44a0e00640 1 --2- 172.21.15.37:0/2392304437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb4e1b0 0x55970cbc2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f449b400640 1 -- 172.21.15.37:0/2392304437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb41900 msgr2=0x55970cbc2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f449b400640 1 --2- 172.21.15.37:0/2392304437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb41900 0x55970cbc2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f449b400640 1 -- 172.21.15.37:0/2392304437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb4e1b0 msgr2=0x55970cbc2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f449b400640 1 --2- 172.21.15.37:0/2392304437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb4e1b0 0x55970cbc2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f449b400640 1 -- 172.21.15.37:0/2392304437 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55970cb55100 con 0x55970cb4bbe0 2024-08-20T05:13:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.271+0000 7f449be00640 1 --2- 172.21.15.37:0/2392304437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb41900 0x55970cbc2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.272+0000 7f449b400640 1 --2- 172.21.15.37:0/2392304437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb4bbe0 0x55970cbc29a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4488009230 tx=0x7f4488009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a7b231eea91c33f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.272+0000 7f4486000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:13:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.272+0000 7f4486000640 1 -- 172.21.15.37:0/2392304437 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44880c9070 con 0x55970cb4bbe0 2024-08-20T05:13:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.272+0000 7f4486000640 1 -- 172.21.15.37:0/2392304437 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f44880e4170 con 0x55970cb4bbe0 2024-08-20T05:13:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.272+0000 7f44a5a77740 1 -- 172.21.15.37:0/2392304437 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4488070190 con 0x55970cb4bbe0 2024-08-20T05:13:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.272+0000 7f4486000640 1 -- 172.21.15.37:0/2392304437 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7f44880a6e80 con 0x55970cb4bbe0 2024-08-20T05:13:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.272+0000 7f44a5a77740 10 client.28253 fetch_fsmap learned FSMap version 47 2024-08-20T05:13:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.273+0000 7f44a5a77740 1 -- 172.21.15.37:0/2392304437 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55970cb56360 con 0x55970cb4bbe0 2024-08-20T05:13:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.273+0000 7f4486000640 1 -- 172.21.15.37:0/2392304437 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4488070190 con 0x55970cb4bbe0 2024-08-20T05:13:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.273+0000 7f4486000640 1 -- 172.21.15.37:0/2392304437 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 47) ==== 8374+0+0 (secure 0 0 0) 0x7f4488087020 con 0x55970cb4bbe0 2024-08-20T05:13:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.273+0000 7f44a5a77740 10 client.28253 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T05:13:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.273+0000 7f44a5a77740 10 client.28253 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.273+0000 7f44a5a77740 20 client.28253 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.273+0000 7f44a5a77740 1 --2- 172.21.15.37:0/2392304437 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55970cb5e210 0x55970cb568d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.273+0000 7f44a5a77740 4 client.28253 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:13:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.273+0000 7f44a5a77740 1 -- 172.21.15.37:0/2392304437 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55970cab5450 con 0x55970cb5e210 2024-08-20T05:13:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.274+0000 7f449be00640 1 --2- 172.21.15.37:0/2392304437 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55970cb5e210 0x55970cb568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.274+0000 7f449be00640 1 --2- 172.21.15.37:0/2392304437 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55970cb5e210 0x55970cb568d0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a4004d6b90096b server_cookie=ea333a59e9aeae62 in_seq=0 out_seq=0 2024-08-20T05:13:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.274+0000 7f4486000640 10 client.28253 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.275+0000 7f4486000640 1 -- 172.21.15.37:0/2392304437 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55970cab5450 con 0x55970cb5e210 2024-08-20T05:13:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.275+0000 7f4486000640 10 client.28253 handle_command_reply: tid=0 2024-08-20T05:13:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.275+0000 7f44a5a77740 1 client.28253 shutdown 2024-08-20T05:13:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.275+0000 7f44a5a77740 1 -- 172.21.15.37:0/2392304437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb4bbe0 msgr2=0x55970cbc29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.275+0000 7f44a5a77740 1 --2- 172.21.15.37:0/2392304437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb4bbe0 0x55970cbc29a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4488009230 tx=0x7f4488009f90 comp rx=0 tx=0).stop 2024-08-20T05:13:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.275+0000 7f44a5a77740 1 -- 172.21.15.37:0/2392304437 shutdown_connections 2024-08-20T05:13:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.276+0000 7f44a5a77740 1 --2- 172.21.15.37:0/2392304437 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55970cb5e210 0x55970cb568d0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.276+0000 7f44a5a77740 1 --2- 172.21.15.37:0/2392304437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55970cb4e1b0 0x55970cbc2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.276+0000 7f44a5a77740 1 --2- 172.21.15.37:0/2392304437 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55970cb4bbe0 0x55970cbc29a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.276+0000 7f44a5a77740 1 --2- 172.21.15.37:0/2392304437 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55970cb41900 0x55970cbc2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.276+0000 7f44a5a77740 1 -- 172.21.15.37:0/2392304437 >> 172.21.15.37:0/2392304437 conn(0x55970cb3f730 msgr2=0x55970cb498b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.276+0000 7f4486000640 0 client.28253 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.277+0000 7f44a5a77740 1 -- 172.21.15.37:0/2392304437 shutdown_connections 2024-08-20T05:13:38.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.277+0000 7f44a5a77740 1 -- 172.21.15.37:0/2392304437 wait complete. 2024-08-20T05:13:38.722 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:13:38.722 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T05:13:38.722 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-20T05:13:38.722 INFO:teuthology.orchestra.run.smithi037.stdout: "c434d135-523e-4c28-84c1-e8a9ae961b18": { 2024-08-20T05:13:38.722 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-20T05:13:38.722 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "c434d135-523e-4c28-84c1-e8a9ae961b18", 2024-08-20T05:13:38.722 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-20T05:13:38.723 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:13:38.723 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:13:38.723 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:13:38.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.277+0000 7f44a5a77740 20 client.28253 trim_cache size 0 max 16384 2024-08-20T05:13:38.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.279+0000 7f44a2e00640 1 -- 172.21.15.37:0/400324678 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f44800b3bd0 msgr2=0x7f44800b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:38.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.279+0000 7f44a2e00640 1 --2- 172.21.15.37:0/400324678 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f44800b3bd0 0x7f44800b6090 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f4494009fd0 tx=0x7f4494009500 comp rx=0 tx=0).stop 2024-08-20T05:13:38.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.279+0000 7f44a2e00640 1 -- 172.21.15.37:0/400324678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f449c10b050 msgr2=0x7f449c10e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:38.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.279+0000 7f44a2e00640 1 --2- 172.21.15.37:0/400324678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f449c10b050 0x7f449c10e9f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f448800e9c0 tx=0x7f448800ee80 comp rx=0 tx=0).stop 2024-08-20T05:13:38.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.279+0000 7f44a2e00640 1 -- 172.21.15.37:0/400324678 shutdown_connections 2024-08-20T05:13:38.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.279+0000 7f44a2e00640 1 --2- 172.21.15.37:0/400324678 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f44800b3bd0 0x7f44800b6090 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.279+0000 7f44a2e00640 1 --2- 172.21.15.37:0/400324678 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f449c10f050 0x7f449c1ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.279+0000 7f44a2e00640 1 --2- 172.21.15.37:0/400324678 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f449c10b050 0x7f449c10e9f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.279+0000 7f44a2e00640 1 --2- 172.21.15.37:0/400324678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f449c10a6d0 0x7f449c1117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:38.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.279+0000 7f44a2e00640 1 -- 172.21.15.37:0/400324678 >> 172.21.15.37:0/400324678 conn(0x7f449c1006f0 msgr2=0x7f449c102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:38.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.280+0000 7f44a2e00640 1 -- 172.21.15.37:0/400324678 shutdown_connections 2024-08-20T05:13:38.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:38.280+0000 7f44a2e00640 1 -- 172.21.15.37:0/400324678 wait complete. 2024-08-20T05:13:39.496 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:39 smithi037 ceph-mon[17265]: pgmap v743: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 6.7 MiB/s wr, 559 op/s 2024-08-20T05:13:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:39 smithi135 ceph-mon[22342]: pgmap v743: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 6.7 MiB/s wr, 559 op/s 2024-08-20T05:13:39.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:39 smithi130 ceph-mon[22007]: pgmap v743: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 6.7 MiB/s wr, 559 op/s 2024-08-20T05:13:40.239 INFO:tasks.cephfs.filesystem:scrub status for tag:c434d135-523e-4c28-84c1-e8a9ae961b18 - {'path': '/', 'tag': 'c434d135-523e-4c28-84c1-e8a9ae961b18', 'options': 'recursive,force'} 2024-08-20T05:13:41.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:41 smithi037 ceph-mon[17265]: pgmap v744: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 8.1 MiB/s wr, 649 op/s 2024-08-20T05:13:41.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:41 smithi135 ceph-mon[22342]: pgmap v744: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 8.1 MiB/s wr, 649 op/s 2024-08-20T05:13:41.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:41 smithi130 ceph-mon[22007]: pgmap v744: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 8.1 MiB/s wr, 649 op/s 2024-08-20T05:13:43.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 645.0 s, 518.6 tps, lat 201.864 ms stddev 293.042 2024-08-20T05:13:43.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.070+0000 7fda7c200640 1 -- 172.21.15.37:0/1867343066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda741037b0 msgr2=0x7fda74103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:43.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.070+0000 7fda7c200640 1 --2- 172.21.15.37:0/1867343066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda741037b0 0x7fda74103c30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fda60009930 tx=0x7fda6002a420 comp rx=0 tx=0).stop 2024-08-20T05:13:43.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.070+0000 7fda7c200640 1 -- 172.21.15.37:0/1867343066 shutdown_connections 2024-08-20T05:13:43.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.070+0000 7fda7c200640 1 --2- 172.21.15.37:0/1867343066 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda74104170 0x7fda7410aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.070+0000 7fda7c200640 1 --2- 172.21.15.37:0/1867343066 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda741037b0 0x7fda74103c30 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.072 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.070+0000 7fda7c200640 1 --2- 172.21.15.37:0/1867343066 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda74102660 0x7fda74102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.070+0000 7fda7c200640 1 -- 172.21.15.37:0/1867343066 >> 172.21.15.37:0/1867343066 conn(0x7fda740fdf20 msgr2=0x7fda74100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:43.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.070+0000 7fda7c200640 1 -- 172.21.15.37:0/1867343066 shutdown_connections 2024-08-20T05:13:43.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.070+0000 7fda7c200640 1 -- 172.21.15.37:0/1867343066 wait complete. 2024-08-20T05:13:43.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.071+0000 7fda7c200640 1 Processor -- start 2024-08-20T05:13:43.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.071+0000 7fda7c200640 1 -- start start 2024-08-20T05:13:43.073 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.072+0000 7fda7c200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda74102660 0x7fda7419f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.072+0000 7fda7c200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda741037b0 0x7fda7419f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.074 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.072+0000 7fda7c200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda74104170 0x7fda741a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.072+0000 7fda7c200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fda7410c150 con 0x7fda741037b0 2024-08-20T05:13:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.072+0000 7fda7c200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fda7410bfd0 con 0x7fda74104170 2024-08-20T05:13:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.072+0000 7fda7c200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda7410c2d0 con 0x7fda74102660 2024-08-20T05:13:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.072+0000 7fda79800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda74102660 0x7fda7419f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.072+0000 7fda79800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda74102660 0x7fda7419f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50744/0 (socket says 172.21.15.37:50744) 2024-08-20T05:13:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.072+0000 7fda79800640 1 -- 172.21.15.37:0/3269287351 learned_addr learned my addr 172.21.15.37:0/3269287351 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.073+0000 7fda7a200640 1 --2- 172.21.15.37:0/3269287351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda74104170 0x7fda741a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.073+0000 7fda78e00640 1 --2- 172.21.15.37:0/3269287351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda741037b0 0x7fda7419f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.073+0000 7fda7a200640 1 -- 172.21.15.37:0/3269287351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda74102660 msgr2=0x7fda7419f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.073+0000 7fda7a200640 1 --2- 172.21.15.37:0/3269287351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda74102660 0x7fda7419f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.073+0000 7fda7a200640 1 -- 172.21.15.37:0/3269287351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda741037b0 msgr2=0x7fda7419f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.073+0000 7fda7a200640 1 --2- 172.21.15.37:0/3269287351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda741037b0 0x7fda7419f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.073+0000 7fda7a200640 1 -- 172.21.15.37:0/3269287351 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda741a0b40 con 0x7fda74104170 2024-08-20T05:13:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.073+0000 7fda7a200640 1 --2- 172.21.15.37:0/3269287351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda74104170 0x7fda741a0280 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fda6c009fd0 tx=0x7fda6c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.074+0000 7fda72000640 1 -- 172.21.15.37:0/3269287351 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c00ce20 con 0x7fda74104170 2024-08-20T05:13:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.074+0000 7fda72000640 1 -- 172.21.15.37:0/3269287351 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda6c005020 con 0x7fda74104170 2024-08-20T05:13:43.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.074+0000 7fda7c200640 1 -- 172.21.15.37:0/3269287351 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda741a0e30 con 0x7fda74104170 2024-08-20T05:13:43.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.074+0000 7fda72000640 1 -- 172.21.15.37:0/3269287351 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c010690 con 0x7fda74104170 2024-08-20T05:13:43.077 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.074+0000 7fda7c200640 1 -- 172.21.15.37:0/3269287351 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda741a7500 con 0x7fda74104170 2024-08-20T05:13:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.078+0000 7fda7f07c740 1 Processor -- start 2024-08-20T05:13:43.081 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.079+0000 7fda72000640 1 -- 172.21.15.37:0/3269287351 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fda6c0054d0 con 0x7fda74104170 2024-08-20T05:13:43.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.080+0000 7fda7f07c740 1 -- start start 2024-08-20T05:13:43.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.080+0000 7fda7f07c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561300943610 0x561300945a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.080+0000 7fda7f07c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300945f40 0x561300948330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.080+0000 7fda7f07c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561300948980 0x56130094ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.080+0000 7fda7f07c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5613008b6210 con 0x561300948980 2024-08-20T05:13:43.082 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.080+0000 7fda7f07c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5613008a5710 con 0x561300945f40 2024-08-20T05:13:43.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.080+0000 7fda7f07c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5613008a9750 con 0x561300943610 2024-08-20T05:13:43.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.081+0000 7fda79800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300945f40 0x561300948330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:43.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.081+0000 7fda79800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300945f40 0x561300948330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45452/0 (socket says 172.21.15.37:45452) 2024-08-20T05:13:43.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.081+0000 7fda79800640 1 -- 172.21.15.37:0/1094945115 learned_addr learned my addr 172.21.15.37:0/1094945115 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:43.083 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.081+0000 7fda78e00640 1 --2- 172.21.15.37:0/1094945115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561300943610 0x561300945a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:43.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.082+0000 7fda72000640 1 --2- 172.21.15.37:0/3269287351 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fda5c0b3c90 0x7fda5c0b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.084 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.082+0000 7fda72000640 1 -- 172.21.15.37:0/3269287351 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fda6c0e4680 con 0x7fda74104170 2024-08-20T05:13:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.082+0000 7fda79800640 1 -- 172.21.15.37:0/1094945115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561300943610 msgr2=0x561300945a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.082+0000 7fda79800640 1 --2- 172.21.15.37:0/1094945115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561300943610 0x561300945a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.083+0000 7fda79800640 1 -- 172.21.15.37:0/1094945115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561300948980 msgr2=0x56130094ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.083+0000 7fda78e00640 1 --2- 172.21.15.37:0/1094945115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561300948980 0x56130094ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.083+0000 7fda79800640 1 --2- 172.21.15.37:0/1094945115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561300948980 0x56130094ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.083+0000 7fda79800640 1 -- 172.21.15.37:0/1094945115 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561300871de0 con 0x561300945f40 2024-08-20T05:13:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.083+0000 7fda78e00640 1 --2- 172.21.15.37:0/1094945115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561300948980 0x56130094ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.083+0000 7fda7a200640 1 --2- 172.21.15.37:0/3269287351 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fda5c0b3c90 0x7fda5c0b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.084+0000 7fda79800640 1 --2- 172.21.15.37:0/1094945115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300945f40 0x561300948330 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fda6800adb0 tx=0x7fda6800f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61d02520c92c0978 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.084+0000 7fda7a200640 1 --2- 172.21.15.37:0/3269287351 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fda5c0b3c90 0x7fda5c0b6150 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0e1de0 tx=0x7fda6c0057c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.084+0000 7fda66a00640 1 -- 172.21.15.37:0/1094945115 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6801d070 con 0x561300945f40 2024-08-20T05:13:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.084+0000 7fda66a00640 1 -- 172.21.15.37:0/1094945115 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda68010cf0 con 0x561300945f40 2024-08-20T05:13:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.084+0000 7fda66a00640 1 -- 172.21.15.37:0/1094945115 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda68018c40 con 0x561300945f40 2024-08-20T05:13:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.085+0000 7fda7f07c740 1 -- 172.21.15.37:0/1094945115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300945f40 msgr2=0x561300948330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.085+0000 7fda7f07c740 1 --2- 172.21.15.37:0/1094945115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300945f40 0x561300948330 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fda6800adb0 tx=0x7fda6800f790 comp rx=0 tx=0).stop 2024-08-20T05:13:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.086+0000 7fda7f07c740 1 -- 172.21.15.37:0/1094945115 shutdown_connections 2024-08-20T05:13:43.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.086+0000 7fda7f07c740 1 --2- 172.21.15.37:0/1094945115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561300948980 0x56130094ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.086+0000 7fda7f07c740 1 --2- 172.21.15.37:0/1094945115 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300945f40 0x561300948330 secure :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fda6800adb0 tx=0x7fda6800f790 comp rx=0 tx=0).stop 2024-08-20T05:13:43.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.086+0000 7fda7f07c740 1 --2- 172.21.15.37:0/1094945115 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561300943610 0x561300945a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.088 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.086+0000 7fda7f07c740 1 -- 172.21.15.37:0/1094945115 >> 172.21.15.37:0/1094945115 conn(0x56130093e760 msgr2=0x56130093f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:43.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.087+0000 7fda7f07c740 1 -- 172.21.15.37:0/1094945115 shutdown_connections 2024-08-20T05:13:43.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.087+0000 7fda7f07c740 1 -- 172.21.15.37:0/1094945115 wait complete. 2024-08-20T05:13:43.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.087+0000 7fda7f07c740 1 -- start start 2024-08-20T05:13:43.090 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.088+0000 7fda7f07c740 1 Processor -- start 2024-08-20T05:13:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.088+0000 7fda7f07c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300943610 0x56130095dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.088+0000 7fda7f07c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561300948980 0x56130095e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.088+0000 7fda7f07c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56130095f130 0x56130095f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.088+0000 7fda7f07c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5613007deab0 con 0x561300948980 2024-08-20T05:13:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.088+0000 7fda7f07c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56130084c140 con 0x561300943610 2024-08-20T05:13:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.088+0000 7fda7f07c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56130094b960 con 0x56130095f130 2024-08-20T05:13:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.088+0000 7fda7f07c740 10 client.0 _ll_register_callbacks cb 0x56130085f5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.089+0000 7fda78e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300943610 0x56130095dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.089+0000 7fda78e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300943610 0x56130095dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45456/0 (socket says 172.21.15.37:45456) 2024-08-20T05:13:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.089+0000 7fda78e00640 1 -- 172.21.15.37:0/1824071524 learned_addr learned my addr 172.21.15.37:0/1824071524 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.089+0000 7fda78e00640 1 --2- 172.21.15.37:0/1824071524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56130095f130 0x56130095f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.089+0000 7fda78e00640 1 -- 172.21.15.37:0/1824071524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56130095f130 msgr2=0x56130095f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.089+0000 7fda78e00640 1 --2- 172.21.15.37:0/1824071524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56130095f130 0x56130095f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.089+0000 7fda78e00640 1 -- 172.21.15.37:0/1824071524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561300948980 msgr2=0x56130095e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.089+0000 7fda78e00640 1 --2- 172.21.15.37:0/1824071524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561300948980 0x56130095e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.089+0000 7fda78e00640 1 -- 172.21.15.37:0/1824071524 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56130084d170 con 0x561300943610 2024-08-20T05:13:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.090+0000 7fda78e00640 1 --2- 172.21.15.37:0/1824071524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300943610 0x56130095dee0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fda6002aa10 tx=0x7fda6002a420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da23f03df2569c2b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.090+0000 7fda5b400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:13:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.090+0000 7fda5b400640 1 -- 172.21.15.37:0/1824071524 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda60035040 con 0x561300943610 2024-08-20T05:13:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.090+0000 7fda7f07c740 1 -- 172.21.15.37:0/1824071524 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda68010cf0 con 0x561300943610 2024-08-20T05:13:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.090+0000 7fda5b400640 1 -- 172.21.15.37:0/1824071524 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fda600315a0 con 0x561300943610 2024-08-20T05:13:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.090+0000 7fda5b400640 1 -- 172.21.15.37:0/1824071524 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fda60005020 con 0x561300943610 2024-08-20T05:13:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.090+0000 7fda7f07c740 10 client.28265 fetch_fsmap learned FSMap version 47 2024-08-20T05:13:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.090+0000 7fda7f07c740 1 -- 172.21.15.37:0/1824071524 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x561300608790 con 0x561300943610 2024-08-20T05:13:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.091+0000 7fda5b400640 1 -- 172.21.15.37:0/1824071524 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda68010cf0 con 0x561300943610 2024-08-20T05:13:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.091+0000 7fda5b400640 1 -- 172.21.15.37:0/1824071524 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 47) ==== 8374+0+0 (secure 0 0 0) 0x7fda6003a070 con 0x561300943610 2024-08-20T05:13:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.091+0000 7fda7f07c740 10 client.28265 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T05:13:43.094 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.091+0000 7fda7f07c740 10 client.28265 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.091+0000 7fda7f07c740 20 client.28265 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.091+0000 7fda7f07c740 1 --2- 172.21.15.37:0/1824071524 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561300969ef0 0x56130096c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.091+0000 7fda7f07c740 4 client.28265 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:13:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.091+0000 7fda7f07c740 1 -- 172.21.15.37:0/1824071524 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613008b8160 con 0x561300969ef0 2024-08-20T05:13:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.092+0000 7fda79800640 1 --2- 172.21.15.37:0/1824071524 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561300969ef0 0x56130096c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.094+0000 7fda79800640 1 --2- 172.21.15.37:0/1824071524 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561300969ef0 0x56130096c360 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3850762ef3bcf3a6 server_cookie=d3cb975b6750fcb0 in_seq=0 out_seq=0 2024-08-20T05:13:43.095 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.094+0000 7fda5b400640 10 client.28265 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.095+0000 7fda5b400640 1 -- 172.21.15.37:0/1824071524 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5613008b8160 con 0x561300969ef0 2024-08-20T05:13:43.097 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.095+0000 7fda5b400640 10 client.28265 handle_command_reply: tid=0 2024-08-20T05:13:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.095+0000 7fda7f07c740 1 client.28265 shutdown 2024-08-20T05:13:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.095+0000 7fda7f07c740 1 -- 172.21.15.37:0/1824071524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300943610 msgr2=0x56130095dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.095+0000 7fda7f07c740 1 --2- 172.21.15.37:0/1824071524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300943610 0x56130095dee0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fda6002aa10 tx=0x7fda6002a420 comp rx=0 tx=0).stop 2024-08-20T05:13:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.096+0000 7fda7f07c740 1 -- 172.21.15.37:0/1824071524 shutdown_connections 2024-08-20T05:13:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.096+0000 7fda7f07c740 1 --2- 172.21.15.37:0/1824071524 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x561300969ef0 0x56130096c360 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.096+0000 7fda7f07c740 1 --2- 172.21.15.37:0/1824071524 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56130095f130 0x56130095f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.096+0000 7fda7f07c740 1 --2- 172.21.15.37:0/1824071524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561300948980 0x56130095e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.096+0000 7fda7f07c740 1 --2- 172.21.15.37:0/1824071524 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300943610 0x56130095dee0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.096+0000 7fda7f07c740 1 -- 172.21.15.37:0/1824071524 >> 172.21.15.37:0/1824071524 conn(0x56130093e760 msgr2=0x56130093d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:43.098 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.096+0000 7fda5b400640 0 client.28265 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:43.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.096+0000 7fda7f07c740 1 -- 172.21.15.37:0/1824071524 shutdown_connections 2024-08-20T05:13:43.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.097+0000 7fda7f07c740 1 -- 172.21.15.37:0/1824071524 wait complete. 2024-08-20T05:13:43.099 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.097+0000 7fda7f07c740 20 client.28265 trim_cache size 0 max 16384 2024-08-20T05:13:43.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.127+0000 7fda7f07c740 1 Processor -- start 2024-08-20T05:13:43.129 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.127+0000 7fda7f07c740 1 -- start start 2024-08-20T05:13:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.128+0000 7fda7f07c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561300943610 0x561300949470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.128+0000 7fda7f07c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300948980 0x56130093cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.128+0000 7fda7f07c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56130095f130 0x56130093d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.128+0000 7fda7f07c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fda741a92b0 con 0x56130095f130 2024-08-20T05:13:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.128+0000 7fda7f07c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fda741aadf0 con 0x561300948980 2024-08-20T05:13:43.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.128+0000 7fda7f07c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda741a9980 con 0x561300943610 2024-08-20T05:13:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.128+0000 7fda78e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561300943610 0x561300949470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.128+0000 7fda79800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300948980 0x56130093cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.128+0000 7fda79800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300948980 0x56130093cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45472/0 (socket says 172.21.15.37:45472) 2024-08-20T05:13:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.128+0000 7fda79800640 1 -- 172.21.15.37:0/2715977238 learned_addr learned my addr 172.21.15.37:0/2715977238 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.129+0000 7fda79800640 1 -- 172.21.15.37:0/2715977238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561300943610 msgr2=0x561300949470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.129+0000 7fda79800640 1 --2- 172.21.15.37:0/2715977238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561300943610 0x561300949470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.129+0000 7fda79800640 1 -- 172.21.15.37:0/2715977238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56130095f130 msgr2=0x56130093d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.129+0000 7fda79800640 1 --2- 172.21.15.37:0/2715977238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56130095f130 0x56130093d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.129+0000 7fda79800640 1 -- 172.21.15.37:0/2715977238 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561300681620 con 0x561300948980 2024-08-20T05:13:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.129+0000 7fda79800640 1 --2- 172.21.15.37:0/2715977238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300948980 0x56130093cf40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x56130093fd70 tx=0x7fda6800a380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94f5d35c5a39d294 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.130+0000 7fda66000640 1 -- 172.21.15.37:0/2715977238 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6801d040 con 0x561300948980 2024-08-20T05:13:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.130+0000 7fda66000640 1 -- 172.21.15.37:0/2715977238 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda6800a7e0 con 0x561300948980 2024-08-20T05:13:43.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.130+0000 7fda66000640 1 -- 172.21.15.37:0/2715977238 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda68005430 con 0x561300948980 2024-08-20T05:13:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.131+0000 7fda7f07c740 1 -- 172.21.15.37:0/2715977238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300948980 msgr2=0x56130093cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.131+0000 7fda7f07c740 1 --2- 172.21.15.37:0/2715977238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300948980 0x56130093cf40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x56130093fd70 tx=0x7fda6800a380 comp rx=0 tx=0).stop 2024-08-20T05:13:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.135+0000 7fda7f07c740 1 -- 172.21.15.37:0/2715977238 shutdown_connections 2024-08-20T05:13:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.135+0000 7fda7f07c740 1 --2- 172.21.15.37:0/2715977238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56130095f130 0x56130093d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.135+0000 7fda7f07c740 1 --2- 172.21.15.37:0/2715977238 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300948980 0x56130093cf40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.135+0000 7fda7f07c740 1 --2- 172.21.15.37:0/2715977238 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561300943610 0x561300949470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.135+0000 7fda7f07c740 1 -- 172.21.15.37:0/2715977238 >> 172.21.15.37:0/2715977238 conn(0x56130093e760 msgr2=0x561300948d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.137+0000 7fda7f07c740 1 -- 172.21.15.37:0/2715977238 shutdown_connections 2024-08-20T05:13:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.137+0000 7fda7f07c740 1 -- 172.21.15.37:0/2715977238 wait complete. 2024-08-20T05:13:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.138+0000 7fda7f07c740 1 -- start start 2024-08-20T05:13:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.139+0000 7fda7f07c740 1 Processor -- start 2024-08-20T05:13:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.140+0000 7fda7f07c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300943610 0x561300965980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.140+0000 7fda7f07c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561300948980 0x561300964680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.140+0000 7fda7f07c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56130095f130 0x561300964bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.140+0000 7fda7f07c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fda741aa720 con 0x56130095f130 2024-08-20T05:13:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.140+0000 7fda7f07c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fda741aa050 con 0x561300943610 2024-08-20T05:13:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.140+0000 7fda7f07c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fda74074b40 con 0x561300948980 2024-08-20T05:13:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.140+0000 7fda7f07c740 10 client.0 _ll_register_callbacks cb 0x7fda6c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.142+0000 7fda79800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561300948980 0x561300964680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.142+0000 7fda79800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561300948980 0x561300964680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50782/0 (socket says 172.21.15.37:50782) 2024-08-20T05:13:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.142+0000 7fda79800640 1 -- 172.21.15.37:0/3038457298 learned_addr learned my addr 172.21.15.37:0/3038457298 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:43.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.142+0000 7fda78e00640 1 --2- 172.21.15.37:0/3038457298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300943610 0x561300965980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.143+0000 7fda78e00640 1 --2- 172.21.15.37:0/3038457298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56130095f130 0x561300964bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.143+0000 7fda78e00640 1 -- 172.21.15.37:0/3038457298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561300948980 msgr2=0x561300964680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.143+0000 7fda78e00640 1 --2- 172.21.15.37:0/3038457298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561300948980 0x561300964680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.143+0000 7fda78e00640 1 -- 172.21.15.37:0/3038457298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56130095f130 msgr2=0x561300964bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.143+0000 7fda78e00640 1 --2- 172.21.15.37:0/3038457298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56130095f130 0x561300964bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.143+0000 7fda78e00640 1 -- 172.21.15.37:0/3038457298 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613009653f0 con 0x561300943610 2024-08-20T05:13:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.144+0000 7fda78e00640 1 --2- 172.21.15.37:0/3038457298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300943610 0x561300965980 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fda600059d0 tx=0x7fda6002a920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2868b3fc425ea797 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.144+0000 7fda5b400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:13:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.145+0000 7fda5b400640 1 -- 172.21.15.37:0/3038457298 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6005c060 con 0x561300943610 2024-08-20T05:13:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.145+0000 7fda5b400640 1 -- 172.21.15.37:0/3038457298 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fda600051c0 con 0x561300943610 2024-08-20T05:13:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.145+0000 7fda7f07c740 1 -- 172.21.15.37:0/3038457298 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda6800a7e0 con 0x561300943610 2024-08-20T05:13:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.146+0000 7fda5b400640 1 -- 172.21.15.37:0/3038457298 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fda60035040 con 0x561300943610 2024-08-20T05:13:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.146+0000 7fda7f07c740 10 client.28271 fetch_fsmap learned FSMap version 47 2024-08-20T05:13:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.146+0000 7fda7f07c740 1 -- 172.21.15.37:0/3038457298 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5613009d4cd0 con 0x561300943610 2024-08-20T05:13:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.147+0000 7fda5b400640 1 -- 172.21.15.37:0/3038457298 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fda6800a7e0 con 0x561300943610 2024-08-20T05:13:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.150+0000 7fda5b400640 1 -- 172.21.15.37:0/3038457298 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 47) ==== 8374+0+0 (secure 0 0 0) 0x7fda6003a040 con 0x561300943610 2024-08-20T05:13:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.150+0000 7fda7f07c740 10 client.28271 fetch_fsmap finished waiting for FSMap version 47 2024-08-20T05:13:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.150+0000 7fda7f07c740 10 client.28271 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.150+0000 7fda7f07c740 20 client.28271 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.150+0000 7fda7f07c740 1 --2- 172.21.15.37:0/3038457298 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5613009d5630 0x5613009d7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.150+0000 7fda7f07c740 4 client.28271 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:13:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.150+0000 7fda7f07c740 1 -- 172.21.15.37:0/3038457298 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5613008b3c00 con 0x5613009d5630 2024-08-20T05:13:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.150+0000 7fda79800640 1 --2- 172.21.15.37:0/3038457298 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5613009d5630 0x5613009d7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:43.154 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.153+0000 7fda79800640 1 --2- 172.21.15.37:0/3038457298 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5613009d5630 0x5613009d7a50 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aeaa35a396ca00d server_cookie=d74c4362428a4f4e in_seq=0 out_seq=0 2024-08-20T05:13:43.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.153+0000 7fda5b400640 10 client.28271 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:43.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.314+0000 7fda5b400640 1 -- 172.21.15.37:0/3038457298 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5613008b3c00 con 0x5613009d5630 2024-08-20T05:13:43.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.314+0000 7fda5b400640 10 client.28271 handle_command_reply: tid=0 2024-08-20T05:13:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.314+0000 7fda7f07c740 1 client.28271 shutdown 2024-08-20T05:13:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.315+0000 7fda7f07c740 1 -- 172.21.15.37:0/3038457298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300943610 msgr2=0x561300965980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.315+0000 7fda7f07c740 1 --2- 172.21.15.37:0/3038457298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300943610 0x561300965980 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fda600059d0 tx=0x7fda6002a920 comp rx=0 tx=0).stop 2024-08-20T05:13:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.315+0000 7fda7f07c740 1 -- 172.21.15.37:0/3038457298 shutdown_connections 2024-08-20T05:13:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.315+0000 7fda7f07c740 1 --2- 172.21.15.37:0/3038457298 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5613009d5630 0x5613009d7a50 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.315+0000 7fda7f07c740 1 --2- 172.21.15.37:0/3038457298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56130095f130 0x561300964bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.315+0000 7fda7f07c740 1 --2- 172.21.15.37:0/3038457298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561300948980 0x561300964680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.315+0000 7fda5b400640 0 client.28271 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.315+0000 7fda7f07c740 1 --2- 172.21.15.37:0/3038457298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561300943610 0x561300965980 secure :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fda600059d0 tx=0x7fda6002a920 comp rx=0 tx=0).stop 2024-08-20T05:13:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.315+0000 7fda7f07c740 1 -- 172.21.15.37:0/3038457298 >> 172.21.15.37:0/3038457298 conn(0x56130093e760 msgr2=0x56130093cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.317+0000 7fda7f07c740 1 -- 172.21.15.37:0/3038457298 shutdown_connections 2024-08-20T05:13:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.317+0000 7fda7f07c740 1 -- 172.21.15.37:0/3038457298 wait complete. 2024-08-20T05:13:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.317+0000 7fda7f07c740 20 client.28271 trim_cache size 0 max 16384 2024-08-20T05:13:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:13:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:13:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:13:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:13:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.319+0000 7fda7c200640 1 -- 172.21.15.37:0/3269287351 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fda5c0b3c90 msgr2=0x7fda5c0b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.319+0000 7fda7c200640 1 --2- 172.21.15.37:0/3269287351 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fda5c0b3c90 0x7fda5c0b6150 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fda6c0e1de0 tx=0x7fda6c0057c0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.319+0000 7fda7c200640 1 -- 172.21.15.37:0/3269287351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda74104170 msgr2=0x7fda741a0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.319+0000 7fda7c200640 1 --2- 172.21.15.37:0/3269287351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda74104170 0x7fda741a0280 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fda6c009fd0 tx=0x7fda6c00ef10 comp rx=0 tx=0).stop 2024-08-20T05:13:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.319+0000 7fda7c200640 1 -- 172.21.15.37:0/3269287351 shutdown_connections 2024-08-20T05:13:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.319+0000 7fda7c200640 1 --2- 172.21.15.37:0/3269287351 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fda5c0b3c90 0x7fda5c0b6150 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.319+0000 7fda7c200640 1 --2- 172.21.15.37:0/3269287351 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fda74104170 0x7fda741a0280 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.319+0000 7fda7c200640 1 --2- 172.21.15.37:0/3269287351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda741037b0 0x7fda7419f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.319+0000 7fda7c200640 1 --2- 172.21.15.37:0/3269287351 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fda74102660 0x7fda7419f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.319+0000 7fda7c200640 1 -- 172.21.15.37:0/3269287351 >> 172.21.15.37:0/3269287351 conn(0x7fda740fdf20 msgr2=0x7fda74106ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.320+0000 7fda7c200640 1 -- 172.21.15.37:0/3269287351 shutdown_connections 2024-08-20T05:13:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:43.320+0000 7fda7c200640 1 -- 172.21.15.37:0/3269287351 wait complete. 2024-08-20T05:13:43.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:43 smithi037 ceph-mon[17265]: pgmap v745: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.8 MiB/s wr, 549 op/s 2024-08-20T05:13:43.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:43 smithi135 ceph-mon[22342]: pgmap v745: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.8 MiB/s wr, 549 op/s 2024-08-20T05:13:43.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:43 smithi130 ceph-mon[22007]: pgmap v745: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.8 MiB/s wr, 549 op/s 2024-08-20T05:13:44.909 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.3 2024-08-20T05:13:44.909 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:13:45.626 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:13:45.810 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:45 smithi037 ceph-mon[17265]: pgmap v746: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 6.6 MiB/s wr, 613 op/s 2024-08-20T05:13:45.810 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:45 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:13:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:45 smithi135 ceph-mon[22342]: pgmap v746: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 6.6 MiB/s wr, 613 op/s 2024-08-20T05:13:45.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:45 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:13:45.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:45 smithi130 ceph-mon[22007]: pgmap v746: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 6.6 MiB/s wr, 613 op/s 2024-08-20T05:13:45.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:45 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:13:46.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:46 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:13:46.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:46 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:13:46.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:46 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:13:46.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:46 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:13:47.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:46 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:13:47.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:46 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:13:47.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:47 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:13:47.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:47 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:13:47.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:47 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:13:47.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:47 smithi037 ceph-mon[17265]: pgmap v747: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 6.2 MiB/s wr, 539 op/s 2024-08-20T05:13:47.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:47 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/470848345' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:13:47.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:47 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:13:47.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:47 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:13:47.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:47 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:13:47.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:47 smithi135 ceph-mon[22342]: pgmap v747: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 6.2 MiB/s wr, 539 op/s 2024-08-20T05:13:47.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:47 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/470848345' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:13:47.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.033+0000 7f2e9f000640 1 -- 172.21.15.37:0/3022846431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e900a0070 msgr2=0x7f2e900a8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:47.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.033+0000 7f2e9f000640 1 --2- 172.21.15.37:0/3022846431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e900a0070 0x7f2e900a8a00 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2e9802e8d0 tx=0x7f2e98097ab0 comp rx=0 tx=0).stop 2024-08-20T05:13:47.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.033+0000 7f2e9f000640 1 -- 172.21.15.37:0/3022846431 shutdown_connections 2024-08-20T05:13:47.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.033+0000 7f2e9f000640 1 --2- 172.21.15.37:0/3022846431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e900a0070 0x7f2e900a8a00 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.033+0000 7f2e9f000640 1 --2- 172.21.15.37:0/3022846431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e9009f6b0 0x7f2e9009fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.033+0000 7f2e9f000640 1 --2- 172.21.15.37:0/3022846431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e9009c760 0x7f2e9009cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.033+0000 7f2e9f000640 1 -- 172.21.15.37:0/3022846431 >> 172.21.15.37:0/3022846431 conn(0x7f2e9000b7a0 msgr2=0x7f2e9000dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.034+0000 7f2e9f000640 1 -- 172.21.15.37:0/3022846431 shutdown_connections 2024-08-20T05:13:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.035+0000 7f2e9f000640 1 -- 172.21.15.37:0/3022846431 wait complete. 2024-08-20T05:13:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.036+0000 7f2e9f000640 1 Processor -- start 2024-08-20T05:13:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.036+0000 7f2e9f000640 1 -- start start 2024-08-20T05:13:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.037+0000 7f2e9f000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e9009c760 0x7f2e901322c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.038+0000 7f2e9f000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e9009f6b0 0x7f2e90132800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.038+0000 7f2e9dc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e9009c760 0x7f2e901322c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.038+0000 7f2e9dc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e9009c760 0x7f2e901322c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50806/0 (socket says 172.21.15.37:50806) 2024-08-20T05:13:47.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.038+0000 7f2e9dc00640 1 -- 172.21.15.37:0/470848345 learned_addr learned my addr 172.21.15.37:0/470848345 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:47.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.038+0000 7f2e9f000640 1 --2- 172.21.15.37:0/470848345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e900a0070 0x7f2e90137ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:47.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.039+0000 7f2e9f000640 1 -- 172.21.15.37:0/470848345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2e900abd50 con 0x7f2e9009f6b0 2024-08-20T05:13:47.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.039+0000 7f2e9f000640 1 -- 172.21.15.37:0/470848345 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2e900abbd0 con 0x7f2e900a0070 2024-08-20T05:13:47.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.039+0000 7f2e9f000640 1 -- 172.21.15.37:0/470848345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2e900abed0 con 0x7f2e9009c760 2024-08-20T05:13:47.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.039+0000 7f2e9e600640 1 --2- 172.21.15.37:0/470848345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e900a0070 0x7f2e90137ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:47.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.040+0000 7f2e9d200640 1 --2- 172.21.15.37:0/470848345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e9009f6b0 0x7f2e90132800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:47.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.040+0000 7f2e9dc00640 1 -- 172.21.15.37:0/470848345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e900a0070 msgr2=0x7f2e90137ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:47.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.040+0000 7f2e9dc00640 1 --2- 172.21.15.37:0/470848345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e900a0070 0x7f2e90137ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:47.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.040+0000 7f2e9dc00640 1 -- 172.21.15.37:0/470848345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e9009f6b0 msgr2=0x7f2e90132800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:47.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.040+0000 7f2e9dc00640 1 --2- 172.21.15.37:0/470848345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e9009f6b0 0x7f2e90132800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:47.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.040+0000 7f2e9dc00640 1 -- 172.21.15.37:0/470848345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e90138370 con 0x7f2e9009c760 2024-08-20T05:13:47.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.043+0000 7f2e9dc00640 1 --2- 172.21.15.37:0/470848345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e9009c760 0x7f2e901322c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00d950 tx=0x7f2e8c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:47.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.043+0000 7f2e96000640 1 -- 172.21.15.37:0/470848345 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c017030 con 0x7f2e9009c760 2024-08-20T05:13:47.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.043+0000 7f2e96000640 1 -- 172.21.15.37:0/470848345 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e8c004020 con 0x7f2e9009c760 2024-08-20T05:13:47.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.043+0000 7f2e96000640 1 -- 172.21.15.37:0/470848345 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0047a0 con 0x7f2e9009c760 2024-08-20T05:13:47.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.043+0000 7f2e9f000640 1 -- 172.21.15.37:0/470848345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e90138660 con 0x7f2e9009c760 2024-08-20T05:13:47.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.044+0000 7f2e9f000640 1 -- 172.21.15.37:0/470848345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e9013ed20 con 0x7f2e9009c760 2024-08-20T05:13:47.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.048+0000 7f2e9f000640 1 -- 172.21.15.37:0/470848345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e9009cb40 con 0x7f2e9009c760 2024-08-20T05:13:47.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.051+0000 7f2e96000640 1 -- 172.21.15.37:0/470848345 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2e8c009a30 con 0x7f2e9009c760 2024-08-20T05:13:47.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.053+0000 7f2e96000640 1 --2- 172.21.15.37:0/470848345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2e800b3cd0 0x7f2e800b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:47.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.053+0000 7f2e96000640 1 -- 172.21.15.37:0/470848345 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2e8c0e30f0 con 0x7f2e9009c760 2024-08-20T05:13:47.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.055+0000 7f2e9d200640 1 --2- 172.21.15.37:0/470848345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2e800b3cd0 0x7f2e800b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:47.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.056+0000 7f2e96000640 1 -- 172.21.15.37:0/470848345 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f2e8c04fe20 con 0x7f2e9009c760 2024-08-20T05:13:47.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.058+0000 7f2e9d200640 1 --2- 172.21.15.37:0/470848345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2e800b3cd0 0x7f2e800b6190 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2e84005fd0 tx=0x7f2e84005a00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:47.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.512+0000 7f2e9f000640 1 -- 172.21.15.37:0/470848345 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e901333f0 con 0x7f2e9009c760 2024-08-20T05:13:47.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.513+0000 7f2e96000640 1 -- 172.21.15.37:0/470848345 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+11980 (secure 0 0 0) 0x7f2e8c0aa340 con 0x7f2e9009c760 2024-08-20T05:13:47.887 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:13:47.887 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":48,"btime":"2024-08-20T05:13:44:512025+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":48,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:13:43.851787+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:13:47.887 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 48 2024-08-20T05:13:47.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.521+0000 7f2e9f000640 1 -- 172.21.15.37:0/470848345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2e800b3cd0 msgr2=0x7f2e800b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:47.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.521+0000 7f2e9f000640 1 --2- 172.21.15.37:0/470848345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2e800b3cd0 0x7f2e800b6190 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2e84005fd0 tx=0x7f2e84005a00 comp rx=0 tx=0).stop 2024-08-20T05:13:47.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.521+0000 7f2e9f000640 1 -- 172.21.15.37:0/470848345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e9009c760 msgr2=0x7f2e901322c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:47.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.521+0000 7f2e9f000640 1 --2- 172.21.15.37:0/470848345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e9009c760 0x7f2e901322c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00d950 tx=0x7f2e8c00de10 comp rx=0 tx=0).stop 2024-08-20T05:13:47.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.522+0000 7f2e9f000640 1 -- 172.21.15.37:0/470848345 shutdown_connections 2024-08-20T05:13:47.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.522+0000 7f2e9f000640 1 --2- 172.21.15.37:0/470848345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2e800b3cd0 0x7f2e800b6190 secure :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2e84005fd0 tx=0x7f2e84005a00 comp rx=0 tx=0).stop 2024-08-20T05:13:47.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.522+0000 7f2e9f000640 1 --2- 172.21.15.37:0/470848345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2e900a0070 0x7f2e90137ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:47.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.522+0000 7f2e9f000640 1 --2- 172.21.15.37:0/470848345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e9009f6b0 0x7f2e90132800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:47.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.522+0000 7f2e9f000640 1 --2- 172.21.15.37:0/470848345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2e9009c760 0x7f2e901322c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:47.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.522+0000 7f2e9f000640 1 -- 172.21.15.37:0/470848345 >> 172.21.15.37:0/470848345 conn(0x7f2e9000b7a0 msgr2=0x7f2e900a1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:47.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.524+0000 7f2e9f000640 1 -- 172.21.15.37:0/470848345 shutdown_connections 2024-08-20T05:13:47.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:47.524+0000 7f2e9f000640 1 -- 172.21.15.37:0/470848345 wait complete. 2024-08-20T05:13:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:47 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:13:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:47 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:13:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:47 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:13:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:47 smithi130 ceph-mon[22007]: pgmap v747: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 6.2 MiB/s wr, 539 op/s 2024-08-20T05:13:47.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:47 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/470848345' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:13:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 650.0 s, 408.2 tps, lat 245.572 ms stddev 339.705 2024-08-20T05:13:48.781 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 143.3 --await-for 45.0' 2024-08-20T05:13:48.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 143.3 --await-for 45.0 2024-08-20T05:13:49.518 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:13:49.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:49 smithi135 ceph-mon[22342]: pgmap v748: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.8 MiB/s wr, 496 op/s 2024-08-20T05:13:49.930 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:49 smithi037 ceph-mon[17265]: pgmap v748: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.8 MiB/s wr, 496 op/s 2024-08-20T05:13:49.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:49 smithi130 ceph-mon[22007]: pgmap v748: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.8 MiB/s wr, 496 op/s 2024-08-20T05:13:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.381+0000 7f6dd1a00640 1 -- 172.21.15.37:0/916585954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6dcc102920 msgr2=0x7f6dcc102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.381+0000 7f6dd1a00640 1 --2- 172.21.15.37:0/916585954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6dcc102920 0x7f6dcc102d00 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009900 tx=0x7f6dbc02a410 comp rx=0 tx=0).stop 2024-08-20T05:13:50.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.390+0000 7f6dd1a00640 1 -- 172.21.15.37:0/916585954 shutdown_connections 2024-08-20T05:13:50.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.390+0000 7f6dd1a00640 1 --2- 172.21.15.37:0/916585954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6dcc108cb0 0x7f6dcc10f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.390+0000 7f6dd1a00640 1 --2- 172.21.15.37:0/916585954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dcc108330 0x7f6dcc108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.390+0000 7f6dd1a00640 1 --2- 172.21.15.37:0/916585954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6dcc102920 0x7f6dcc102d00 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.390+0000 7f6dd1a00640 1 -- 172.21.15.37:0/916585954 >> 172.21.15.37:0/916585954 conn(0x7f6dcc0fe350 msgr2=0x7f6dcc100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:50.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.390+0000 7f6dd1a00640 1 -- 172.21.15.37:0/916585954 shutdown_connections 2024-08-20T05:13:50.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.391+0000 7f6dd1a00640 1 -- 172.21.15.37:0/916585954 wait complete. 2024-08-20T05:13:50.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.392+0000 7f6dd1a00640 1 Processor -- start 2024-08-20T05:13:50.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.393+0000 7f6dd1a00640 1 -- start start 2024-08-20T05:13:50.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.394+0000 7f6dd1a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dcc102920 0x7f6dcc19afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.394+0000 7f6dd1a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6dcc108330 0x7f6dcc19b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.395+0000 7f6dcbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dcc102920 0x7f6dcc19afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:50.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.395+0000 7f6dcbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dcc102920 0x7f6dcc19afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40090/0 (socket says 172.21.15.37:40090) 2024-08-20T05:13:50.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.397+0000 7f6dcbe00640 1 -- 172.21.15.37:0/2820902944 learned_addr learned my addr 172.21.15.37:0/2820902944 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:50.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.397+0000 7f6dcb400640 1 --2- 172.21.15.37:0/2820902944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6dcc108330 0x7f6dcc19b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:50.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.397+0000 7f6dd1a00640 1 --2- 172.21.15.37:0/2820902944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6dcc108cb0 0x7f6dcc1a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.397+0000 7f6dd1a00640 1 -- 172.21.15.37:0/2820902944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc1129c0 con 0x7f6dcc102920 2024-08-20T05:13:50.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.397+0000 7f6dd1a00640 1 -- 172.21.15.37:0/2820902944 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc112840 con 0x7f6dcc108330 2024-08-20T05:13:50.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.397+0000 7f6dd1a00640 1 -- 172.21.15.37:0/2820902944 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc112b40 con 0x7f6dcc108cb0 2024-08-20T05:13:50.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.398+0000 7f6dd1000640 1 --2- 172.21.15.37:0/2820902944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6dcc108cb0 0x7f6dcc1a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:50.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.400+0000 7f6dcbe00640 1 -- 172.21.15.37:0/2820902944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6dcc108cb0 msgr2=0x7f6dcc1a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:50.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.400+0000 7f6dcbe00640 1 --2- 172.21.15.37:0/2820902944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6dcc108cb0 0x7f6dcc1a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.400+0000 7f6dcbe00640 1 -- 172.21.15.37:0/2820902944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6dcc108330 msgr2=0x7f6dcc19b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:50.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.400+0000 7f6dcbe00640 1 --2- 172.21.15.37:0/2820902944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6dcc108330 0x7f6dcc19b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.400+0000 7f6dcbe00640 1 -- 172.21.15.37:0/2820902944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dcc1a1080 con 0x7f6dcc102920 2024-08-20T05:13:50.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.402+0000 7f6dcbe00640 1 --2- 172.21.15.37:0/2820902944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dcc102920 0x7f6dcc19afd0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc031440 tx=0x7f6dbc003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:50.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.405+0000 7f6dc8c00640 1 -- 172.21.15.37:0/2820902944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc03f070 con 0x7f6dcc102920 2024-08-20T05:13:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.405+0000 7f6dc8c00640 1 -- 172.21.15.37:0/2820902944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dbc003e40 con 0x7f6dcc102920 2024-08-20T05:13:50.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.405+0000 7f6dd1a00640 1 -- 172.21.15.37:0/2820902944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dcc1a1310 con 0x7f6dcc102920 2024-08-20T05:13:50.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.409+0000 7f6dc8c00640 1 -- 172.21.15.37:0/2820902944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc035030 con 0x7f6dcc102920 2024-08-20T05:13:50.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.409+0000 7f6dd1a00640 1 -- 172.21.15.37:0/2820902944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dcc1a7a30 con 0x7f6dcc102920 2024-08-20T05:13:50.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.416+0000 7f6dd5c18740 1 Processor -- start 2024-08-20T05:13:50.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.416+0000 7f6dd5c18740 1 -- start start 2024-08-20T05:13:50.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.417+0000 7f6dd5c18740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804a7380 0x55ff804a78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.417+0000 7f6dd5c18740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7e00 0x55ff804a8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.417+0000 7f6dd5c18740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804bc440 0x55ff804be830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.417+0000 7f6dd5c18740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ff80447670 con 0x55ff804a7e00 2024-08-20T05:13:50.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.417+0000 7f6dd5c18740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ff8041b7c0 con 0x55ff804bc440 2024-08-20T05:13:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.417+0000 7f6dd5c18740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ff8040acc0 con 0x55ff804a7380 2024-08-20T05:13:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.419+0000 7f6dcb400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804bc440 0x55ff804be830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.419+0000 7f6dcb400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804bc440 0x55ff804be830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45514/0 (socket says 172.21.15.37:45514) 2024-08-20T05:13:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.419+0000 7f6dcb400640 1 -- 172.21.15.37:0/2970388594 learned_addr learned my addr 172.21.15.37:0/2970388594 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.419+0000 7f6dc8c00640 1 -- 172.21.15.37:0/2820902944 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6dbc042070 con 0x7f6dcc102920 2024-08-20T05:13:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.420+0000 7f6dd1000640 1 --2- 172.21.15.37:0/2970388594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804a7380 0x55ff804a78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.420+0000 7f6dd1000640 1 -- 172.21.15.37:0/2970388594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804bc440 msgr2=0x55ff804be830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.420+0000 7f6dd1000640 1 --2- 172.21.15.37:0/2970388594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804bc440 0x55ff804be830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.420+0000 7f6dd1000640 1 -- 172.21.15.37:0/2970388594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7e00 msgr2=0x55ff804a8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.420+0000 7f6dd1000640 1 --2- 172.21.15.37:0/2970388594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7e00 0x55ff804a8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.420+0000 7f6dd1000640 1 -- 172.21.15.37:0/2970388594 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff8039e110 con 0x55ff804a7380 2024-08-20T05:13:50.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.421+0000 7f6dd1000640 1 --2- 172.21.15.37:0/2970388594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804a7380 0x55ff804a78c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4009fb0 tx=0x7f6dc4009650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ac929f3aea066d9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:50.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.421+0000 7f6dd1a00640 1 -- 172.21.15.37:0/2970388594 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4013790 con 0x55ff804a7380 2024-08-20T05:13:50.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.421+0000 7f6dc8c00640 1 --2- 172.21.15.37:0/2820902944 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6db00b3d40 0x7f6db00b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.423+0000 7f6dd1a00640 1 -- 172.21.15.37:0/2970388594 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dc4019070 con 0x55ff804a7380 2024-08-20T05:13:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.423+0000 7f6dcbe00640 1 --2- 172.21.15.37:0/2820902944 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6db00b3d40 0x7f6db00b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.424+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2970388594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804a7380 msgr2=0x55ff804a78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.424+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/2970388594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804a7380 0x55ff804a78c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4009fb0 tx=0x7f6dc4009650 comp rx=0 tx=0).stop 2024-08-20T05:13:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.424+0000 7f6dc8c00640 1 -- 172.21.15.37:0/2820902944 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6dbc0c71b0 con 0x7f6dcc102920 2024-08-20T05:13:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.424+0000 7f6dcbe00640 1 --2- 172.21.15.37:0/2820902944 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6db00b3d40 0x7f6db00b6200 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x55ff804a6160 tx=0x7f6dbc031f60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:50.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.425+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2970388594 shutdown_connections 2024-08-20T05:13:50.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.425+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/2970388594 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804bc440 0x55ff804be830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.425+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/2970388594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7e00 0x55ff804a8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.425+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/2970388594 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804a7380 0x55ff804a78c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.425+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2970388594 >> 172.21.15.37:0/2970388594 conn(0x55ff804a56f0 msgr2=0x55ff804a6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:50.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.425+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2970388594 shutdown_connections 2024-08-20T05:13:50.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.425+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2970388594 wait complete. 2024-08-20T05:13:50.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.426+0000 7f6dd5c18740 1 -- start start 2024-08-20T05:13:50.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.426+0000 7f6dd5c18740 1 Processor -- start 2024-08-20T05:13:50.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.427+0000 7f6dd5c18740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7380 0x55ff804b1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.429+0000 7f6dd5c18740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804a7e00 0x55ff804bbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.429+0000 7f6dd5c18740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804bc440 0x55ff804b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.429+0000 7f6dd5c18740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ff803b0780 con 0x55ff804a7380 2024-08-20T05:13:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.429+0000 7f6dd5c18740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ff8040ed00 con 0x55ff804a7e00 2024-08-20T05:13:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.429+0000 7f6dd5c18740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ff8026d7a0 con 0x55ff804bc440 2024-08-20T05:13:50.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.429+0000 7f6dd5c18740 10 client.0 _ll_register_callbacks cb 0x55ff803b8940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:50.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.430+0000 7f6dd1000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804bc440 0x55ff804b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:50.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.430+0000 7f6dd1000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804bc440 0x55ff804b19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50840/0 (socket says 172.21.15.37:50840) 2024-08-20T05:13:50.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.430+0000 7f6dd1000640 1 -- 172.21.15.37:0/2844523529 learned_addr learned my addr 172.21.15.37:0/2844523529 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:50.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.430+0000 7f6dd1000640 1 --2- 172.21.15.37:0/2844523529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7380 0x55ff804b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:50.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.432+0000 7f6dcb400640 1 --2- 172.21.15.37:0/2844523529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804a7e00 0x55ff804bbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:50.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.433+0000 7f6dd1000640 1 -- 172.21.15.37:0/2844523529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804bc440 msgr2=0x55ff804b19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:50.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.434+0000 7f6dd1000640 1 --2- 172.21.15.37:0/2844523529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804bc440 0x55ff804b19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.434+0000 7f6dd1000640 1 -- 172.21.15.37:0/2844523529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804a7e00 msgr2=0x55ff804bbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:50.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.434+0000 7f6dd1000640 1 --2- 172.21.15.37:0/2844523529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804a7e00 0x55ff804bbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.434+0000 7f6dd1000640 1 -- 172.21.15.37:0/2844523529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff803bd9c0 con 0x55ff804a7380 2024-08-20T05:13:50.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.435+0000 7f6dcb400640 1 --2- 172.21.15.37:0/2844523529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804a7e00 0x55ff804bbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:13:50.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.437+0000 7f6dd1000640 1 --2- 172.21.15.37:0/2844523529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7380 0x55ff804b1420 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4009f80 tx=0x7f6dc400af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7d3418c1dcfce0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:50.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.437+0000 7f6db6000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:13:50.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.438+0000 7f6db6000640 1 -- 172.21.15.37:0/2844523529 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4013ca0 con 0x55ff804a7380 2024-08-20T05:13:50.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.438+0000 7f6db6000640 1 -- 172.21.15.37:0/2844523529 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6dc4013e40 con 0x55ff804a7380 2024-08-20T05:13:50.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.438+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2844523529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dc4019070 con 0x55ff804a7380 2024-08-20T05:13:50.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.438+0000 7f6db6000640 1 -- 172.21.15.37:0/2844523529 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f6dc4003a10 con 0x55ff804a7380 2024-08-20T05:13:50.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.439+0000 7f6dd5c18740 10 client.17718 fetch_fsmap learned FSMap version 48 2024-08-20T05:13:50.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.439+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2844523529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55ff80179b90 con 0x55ff804a7380 2024-08-20T05:13:50.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.439+0000 7f6db6000640 1 -- 172.21.15.37:0/2844523529 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6dc4019070 con 0x55ff804a7380 2024-08-20T05:13:50.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.440+0000 7f6db6000640 1 -- 172.21.15.37:0/2844523529 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f6dc401d450 con 0x55ff804a7380 2024-08-20T05:13:50.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.443+0000 7f6dd5c18740 10 client.17718 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:13:50.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.443+0000 7f6dd5c18740 10 client.17718 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:13:50.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.443+0000 7f6dd5c18740 20 client.17718 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:50.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.443+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/2844523529 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ff804d49a0 0x55ff804d6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.443+0000 7f6dd5c18740 4 client.17718 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:13:50.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.443+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2844523529 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff8041d710 con 0x55ff804d49a0 2024-08-20T05:13:50.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.444+0000 7f6dcb400640 1 --2- 172.21.15.37:0/2844523529 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ff804d49a0 0x55ff804d6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:50.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.448+0000 7f6db6000640 10 client.17718 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:50.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.448+0000 7f6dcb400640 1 --2- 172.21.15.37:0/2844523529 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ff804d49a0 0x55ff804d6d90 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcba254b4ee7391a server_cookie=9e9951094ccbb779 in_seq=0 out_seq=0 2024-08-20T05:13:50.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.451+0000 7f6db6000640 1 -- 172.21.15.37:0/2844523529 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff8041d710 con 0x55ff804d49a0 2024-08-20T05:13:50.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.451+0000 7f6db6000640 10 client.17718 handle_command_reply: tid=0 2024-08-20T05:13:50.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.451+0000 7f6dd5c18740 1 client.17718 shutdown 2024-08-20T05:13:50.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.452+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2844523529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7380 msgr2=0x55ff804b1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:50.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.452+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/2844523529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7380 0x55ff804b1420 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4009f80 tx=0x7f6dc400af90 comp rx=0 tx=0).stop 2024-08-20T05:13:50.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.452+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2844523529 shutdown_connections 2024-08-20T05:13:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.452+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/2844523529 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ff804d49a0 0x55ff804d6d90 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.452+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/2844523529 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804bc440 0x55ff804b19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.452+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/2844523529 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804a7e00 0x55ff804bbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.452+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/2844523529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7380 0x55ff804b1420 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.452+0000 7f6db6000640 0 client.17718 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:50.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.452+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2844523529 >> 172.21.15.37:0/2844523529 conn(0x55ff804a56f0 msgr2=0x55ff804aa9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:50.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.455+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2844523529 shutdown_connections 2024-08-20T05:13:50.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.455+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2844523529 wait complete. 2024-08-20T05:13:50.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.455+0000 7f6dd5c18740 20 client.17718 trim_cache size 0 max 16384 2024-08-20T05:13:50.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.491+0000 7f6dd5c18740 1 Processor -- start 2024-08-20T05:13:50.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.491+0000 7f6dd5c18740 1 -- start start 2024-08-20T05:13:50.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.492+0000 7f6dd5c18740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7380 0x55ff804bdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.492+0000 7f6dd5c18740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804a7e00 0x55ff804be490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.492+0000 7f6dd5c18740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804bc440 0x55ff804be9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.493+0000 7f6dd5c18740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc1ad3b0 con 0x55ff804a7380 2024-08-20T05:13:50.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.493+0000 7f6dd5c18740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc1aeef0 con 0x55ff804bc440 2024-08-20T05:13:50.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.493+0000 7f6dd5c18740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc1ada80 con 0x55ff804a7e00 2024-08-20T05:13:50.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.493+0000 7f6dcb400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804a7e00 0x55ff804be490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:50.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.493+0000 7f6dd1000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7380 0x55ff804bdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:50.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.493+0000 7f6dcb400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804a7e00 0x55ff804be490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50852/0 (socket says 172.21.15.37:50852) 2024-08-20T05:13:50.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.493+0000 7f6dcb400640 1 -- 172.21.15.37:0/188476082 learned_addr learned my addr 172.21.15.37:0/188476082 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:50.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.494+0000 7f6dd1000640 1 --2- 172.21.15.37:0/188476082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804bc440 0x55ff804be9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:50.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.495+0000 7f6dcb400640 1 -- 172.21.15.37:0/188476082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804bc440 msgr2=0x55ff804be9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:50.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.495+0000 7f6dcb400640 1 --2- 172.21.15.37:0/188476082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804bc440 0x55ff804be9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.495+0000 7f6dcb400640 1 -- 172.21.15.37:0/188476082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7380 msgr2=0x55ff804bdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:50.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.495+0000 7f6dcb400640 1 --2- 172.21.15.37:0/188476082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7380 0x55ff804bdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.495+0000 7f6dcb400640 1 -- 172.21.15.37:0/188476082 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff804aa680 con 0x55ff804a7e00 2024-08-20T05:13:50.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.495+0000 7f6dcb400640 1 --2- 172.21.15.37:0/188476082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804a7e00 0x55ff804be490 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x55ff803b07e0 tx=0x7f6db800b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7062ac8ffad54d26 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:50.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.496+0000 7f6dd1000640 1 --2- 172.21.15.37:0/188476082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804bc440 0x55ff804be9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:13:50.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.496+0000 7f6dc0c00640 1 -- 172.21.15.37:0/188476082 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8005020 con 0x55ff804a7e00 2024-08-20T05:13:50.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.496+0000 7f6dc0c00640 1 -- 172.21.15.37:0/188476082 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6db80047a0 con 0x55ff804a7e00 2024-08-20T05:13:50.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.496+0000 7f6dc0c00640 1 -- 172.21.15.37:0/188476082 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db80116a0 con 0x55ff804a7e00 2024-08-20T05:13:50.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.497+0000 7f6dd5c18740 1 -- 172.21.15.37:0/188476082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804a7e00 msgr2=0x55ff804be490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:50.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.497+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/188476082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804a7e00 0x55ff804be490 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x55ff803b07e0 tx=0x7f6db800b390 comp rx=0 tx=0).stop 2024-08-20T05:13:50.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.498+0000 7f6dd5c18740 1 -- 172.21.15.37:0/188476082 shutdown_connections 2024-08-20T05:13:50.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.498+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/188476082 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804bc440 0x55ff804be9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.498+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/188476082 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804a7e00 0x55ff804be490 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.498+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/188476082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7380 0x55ff804bdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.498+0000 7f6dd5c18740 1 -- 172.21.15.37:0/188476082 >> 172.21.15.37:0/188476082 conn(0x55ff804a56f0 msgr2=0x55ff804afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.502+0000 7f6dd5c18740 1 -- 172.21.15.37:0/188476082 shutdown_connections 2024-08-20T05:13:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.502+0000 7f6dd5c18740 1 -- 172.21.15.37:0/188476082 wait complete. 2024-08-20T05:13:50.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.503+0000 7f6dd5c18740 1 -- start start 2024-08-20T05:13:50.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.503+0000 7f6dd5c18740 1 Processor -- start 2024-08-20T05:13:50.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.504+0000 7f6dd5c18740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7380 0x55ff804d8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.504+0000 7f6dd5c18740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804a7e00 0x55ff804d8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.504+0000 7f6dd5c18740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804bc440 0x55ff805372a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.504+0000 7f6dd5c18740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc1ae820 con 0x55ff804a7380 2024-08-20T05:13:50.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.504+0000 7f6dd5c18740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc1ae150 con 0x55ff804a7e00 2024-08-20T05:13:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.504+0000 7f6dd5c18740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6dcc1ab440 con 0x55ff804bc440 2024-08-20T05:13:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.504+0000 7f6dd5c18740 10 client.0 _ll_register_callbacks cb 0x7f6dc4009e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.505+0000 7f6dcb400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804a7e00 0x55ff804d8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:50.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.506+0000 7f6dcb400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804a7e00 0x55ff804d8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45536/0 (socket says 172.21.15.37:45536) 2024-08-20T05:13:50.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.506+0000 7f6dcb400640 1 -- 172.21.15.37:0/2334729178 learned_addr learned my addr 172.21.15.37:0/2334729178 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:50.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.506+0000 7f6dcb400640 1 -- 172.21.15.37:0/2334729178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804bc440 msgr2=0x55ff805372a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:50.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.506+0000 7f6dcb400640 1 --2- 172.21.15.37:0/2334729178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804bc440 0x55ff805372a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.506+0000 7f6dcb400640 1 -- 172.21.15.37:0/2334729178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7380 msgr2=0x55ff804d8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:50.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.506+0000 7f6dcb400640 1 --2- 172.21.15.37:0/2334729178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7380 0x55ff804d8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.506+0000 7f6dcb400640 1 -- 172.21.15.37:0/2334729178 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff805379e0 con 0x55ff804a7e00 2024-08-20T05:13:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.508+0000 7f6dcb400640 1 --2- 172.21.15.37:0/2334729178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804a7e00 0x55ff804d8d10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6db8004770 tx=0x7f6db800b9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e162dea4be90845 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.508+0000 7f6db6000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:13:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.508+0000 7f6db6000640 1 -- 172.21.15.37:0/2334729178 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db8004b60 con 0x55ff804a7e00 2024-08-20T05:13:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.508+0000 7f6db6000640 1 -- 172.21.15.37:0/2334729178 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6db8004d00 con 0x55ff804a7e00 2024-08-20T05:13:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.508+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2334729178 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6db80047a0 con 0x55ff804a7e00 2024-08-20T05:13:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.509+0000 7f6db6000640 1 -- 172.21.15.37:0/2334729178 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f6db8036050 con 0x55ff804a7e00 2024-08-20T05:13:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.509+0000 7f6dd5c18740 10 client.28292 fetch_fsmap learned FSMap version 48 2024-08-20T05:13:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.509+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2334729178 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55ff8053fea0 con 0x55ff804a7e00 2024-08-20T05:13:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.509+0000 7f6db6000640 1 -- 172.21.15.37:0/2334729178 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6db80047a0 con 0x55ff804a7e00 2024-08-20T05:13:50.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.513+0000 7f6db6000640 1 -- 172.21.15.37:0/2334729178 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f6db8024030 con 0x55ff804a7e00 2024-08-20T05:13:50.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.513+0000 7f6dd5c18740 10 client.28292 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:13:50.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.513+0000 7f6dd5c18740 10 client.28292 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:13:50.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.513+0000 7f6dd5c18740 20 client.28292 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:50.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.513+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/2334729178 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ff80540560 0x55ff80542980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:50.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.513+0000 7f6dd5c18740 4 client.28292 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.3, "await_for": 45.0}] 2024-08-20T05:13:50.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.513+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2334729178 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.3, "await_for": 45.0}) -- 0x55ff804191b0 con 0x55ff80540560 2024-08-20T05:13:50.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.513+0000 7f6dd1000640 1 --2- 172.21.15.37:0/2334729178 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ff80540560 0x55ff80542980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:50.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.516+0000 7f6db6000640 10 client.28292 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:50.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.516+0000 7f6dd1000640 1 --2- 172.21.15.37:0/2334729178 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ff80540560 0x55ff80542980 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5019483e97483653 server_cookie=fa8c0225119560d4 in_seq=0 out_seq=0 2024-08-20T05:13:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.736+0000 7f6db6000640 1 -- 172.21.15.37:0/2334729178 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ff804191b0 con 0x55ff80540560 2024-08-20T05:13:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.736+0000 7f6db6000640 10 client.28292 handle_command_reply: tid=0 2024-08-20T05:13:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.736+0000 7f6dd5c18740 1 client.28292 shutdown 2024-08-20T05:13:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.736+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2334729178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804a7e00 msgr2=0x55ff804d8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.736+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/2334729178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804a7e00 0x55ff804d8d10 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6db8004770 tx=0x7f6db800b9e0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.737+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2334729178 shutdown_connections 2024-08-20T05:13:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.737+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/2334729178 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ff80540560 0x55ff80542980 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.737+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/2334729178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ff804bc440 0x55ff805372a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.737+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/2334729178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ff804a7e00 0x55ff804d8d10 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.737+0000 7f6dd5c18740 1 --2- 172.21.15.37:0/2334729178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ff804a7380 0x55ff804d8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.737+0000 7f6db6000640 0 client.28292 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.737+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2334729178 >> 172.21.15.37:0/2334729178 conn(0x55ff804a56f0 msgr2=0x55ff804be770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.737+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2334729178 shutdown_connections 2024-08-20T05:13:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.737+0000 7f6dd5c18740 1 -- 172.21.15.37:0/2334729178 wait complete. 2024-08-20T05:13:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.737+0000 7f6dd5c18740 20 client.28292 trim_cache size 0 max 16384 2024-08-20T05:13:50.741 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:13:50.741 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 48, 2024-08-20T05:13:50.741 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:13:50.741 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 42, 2024-08-20T05:13:50.741 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:13:50.741 INFO:teuthology.orchestra.run.smithi037.stdout: "1119eaf7": { 2024-08-20T05:13:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 42, 2024-08-20T05:13:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:13:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:13:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:13:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:13:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:13:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:13:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 143.3, 2024-08-20T05:13:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:13:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:13:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:13:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:13:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:13:50.743 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:13:50.743 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:13:50.743 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:13:50.743 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:13:50.743 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:13:50.743 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:13:50.743 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:13:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.738+0000 7f6dc2000640 1 -- 172.21.15.37:0/2820902944 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6db00b3d40 msgr2=0x7f6db00b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.738+0000 7f6dc2000640 1 --2- 172.21.15.37:0/2820902944 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6db00b3d40 0x7f6db00b6200 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x55ff804a6160 tx=0x7f6dbc031f60 comp rx=0 tx=0).stop 2024-08-20T05:13:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.738+0000 7f6dc2000640 1 -- 172.21.15.37:0/2820902944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dcc102920 msgr2=0x7f6dcc19afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.738+0000 7f6dc2000640 1 --2- 172.21.15.37:0/2820902944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dcc102920 0x7f6dcc19afd0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc031440 tx=0x7f6dbc003cd0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.739+0000 7f6dc2000640 1 -- 172.21.15.37:0/2820902944 shutdown_connections 2024-08-20T05:13:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.739+0000 7f6dc2000640 1 --2- 172.21.15.37:0/2820902944 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f6db00b3d40 0x7f6db00b6200 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.739+0000 7f6dc2000640 1 --2- 172.21.15.37:0/2820902944 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6dcc108cb0 0x7f6dcc1a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.739+0000 7f6dc2000640 1 --2- 172.21.15.37:0/2820902944 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6dcc108330 0x7f6dcc19b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.739+0000 7f6dc2000640 1 --2- 172.21.15.37:0/2820902944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dcc102920 0x7f6dcc19afd0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.739+0000 7f6dc2000640 1 -- 172.21.15.37:0/2820902944 >> 172.21.15.37:0/2820902944 conn(0x7f6dcc0fe350 msgr2=0x7f6dcc106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.739+0000 7f6dc2000640 1 -- 172.21.15.37:0/2820902944 shutdown_connections 2024-08-20T05:13:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:13:50.739+0000 7f6dc2000640 1 -- 172.21.15.37:0/2820902944 wait complete. 2024-08-20T05:13:50.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:50 smithi130 ceph-mon[22007]: pgmap v749: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.8 MiB/s wr, 537 op/s 2024-08-20T05:13:51.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:50 smithi037 ceph-mon[17265]: pgmap v749: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.8 MiB/s wr, 537 op/s 2024-08-20T05:13:51.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:50 smithi135 ceph-mon[22342]: pgmap v749: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.8 MiB/s wr, 537 op/s 2024-08-20T05:13:51.976 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1119eaf7', quiesce took 7.1 seconds. Will release after: 16.200000000000003 2024-08-20T05:13:53.043 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 655.0 s, 366.4 tps, lat 130.385 ms stddev 167.523 2024-08-20T05:13:53.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:53 smithi037 ceph-mon[17265]: pgmap v750: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.2 MiB/s wr, 427 op/s 2024-08-20T05:13:53.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:53 smithi135 ceph-mon[22342]: pgmap v750: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.2 MiB/s wr, 427 op/s 2024-08-20T05:13:53.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:53 smithi130 ceph-mon[22007]: pgmap v750: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.2 MiB/s wr, 427 op/s 2024-08-20T05:13:55.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:55 smithi037 ceph-mon[17265]: pgmap v751: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 467 op/s 2024-08-20T05:13:55.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:55 smithi135 ceph-mon[22342]: pgmap v751: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 467 op/s 2024-08-20T05:13:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:55 smithi130 ceph-mon[22007]: pgmap v751: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.9 MiB/s wr, 467 op/s 2024-08-20T05:13:56.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.461+0000 7efe7c000640 1 -- 172.21.15.37:0/1430717771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe74076cc0 msgr2=0x7efe74075310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:56.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.461+0000 7efe7c000640 1 --2- 172.21.15.37:0/1430717771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe74076cc0 0x7efe74075310 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7efe68009900 tx=0x7efe6802a410 comp rx=0 tx=0).stop 2024-08-20T05:13:56.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.461+0000 7efe7c000640 1 -- 172.21.15.37:0/1430717771 shutdown_connections 2024-08-20T05:13:56.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.461+0000 7efe7c000640 1 --2- 172.21.15.37:0/1430717771 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe7410a5a0 0x7efe7410ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.461+0000 7efe7c000640 1 --2- 172.21.15.37:0/1430717771 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe74075850 0x7efe74075cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.461+0000 7efe7c000640 1 --2- 172.21.15.37:0/1430717771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe74076cc0 0x7efe74075310 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.461+0000 7efe7c000640 1 -- 172.21.15.37:0/1430717771 >> 172.21.15.37:0/1430717771 conn(0x7efe740fdf40 msgr2=0x7efe74100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:56.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.461+0000 7efe7c000640 1 -- 172.21.15.37:0/1430717771 shutdown_connections 2024-08-20T05:13:56.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.461+0000 7efe7c000640 1 -- 172.21.15.37:0/1430717771 wait complete. 2024-08-20T05:13:56.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.462+0000 7efe7c000640 1 Processor -- start 2024-08-20T05:13:56.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.462+0000 7efe7c000640 1 -- start start 2024-08-20T05:13:56.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.463+0000 7efe7c000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe74075850 0x7efe7419ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.463+0000 7efe7c000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe74076cc0 0x7efe7419b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.465 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.463+0000 7efe7c000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe7410a5a0 0x7efe7419bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.463+0000 7efe7c000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe74110520 con 0x7efe74076cc0 2024-08-20T05:13:56.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.463+0000 7efe7c000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efe741103a0 con 0x7efe7410a5a0 2024-08-20T05:13:56.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.463+0000 7efe7c000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efe741106a0 con 0x7efe74075850 2024-08-20T05:13:56.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.463+0000 7efe79600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe74075850 0x7efe7419ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.463+0000 7efe78c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe74076cc0 0x7efe7419b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.463+0000 7efe79600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe74075850 0x7efe7419ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:48576/0 (socket says 172.21.15.37:48576) 2024-08-20T05:13:56.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.463+0000 7efe79600640 1 -- 172.21.15.37:0/1654768316 learned_addr learned my addr 172.21.15.37:0/1654768316 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:56.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.463+0000 7efe7a000640 1 --2- 172.21.15.37:0/1654768316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe7410a5a0 0x7efe7419bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.463+0000 7efe79600640 1 -- 172.21.15.37:0/1654768316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe7410a5a0 msgr2=0x7efe7419bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:56.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.463+0000 7efe79600640 1 --2- 172.21.15.37:0/1654768316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe7410a5a0 0x7efe7419bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.463+0000 7efe79600640 1 -- 172.21.15.37:0/1654768316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe74076cc0 msgr2=0x7efe7419b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:56.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.463+0000 7efe79600640 1 --2- 172.21.15.37:0/1654768316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe74076cc0 0x7efe7419b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.463+0000 7efe79600640 1 -- 172.21.15.37:0/1654768316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe7419c7b0 con 0x7efe74075850 2024-08-20T05:13:56.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.464+0000 7efe79600640 1 --2- 172.21.15.37:0/1654768316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe74075850 0x7efe7419ac70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efe68005ab0 tx=0x7efe68003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:56.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.464+0000 7efe72000640 1 -- 172.21.15.37:0/1654768316 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6803f070 con 0x7efe74075850 2024-08-20T05:13:56.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.464+0000 7efe72000640 1 -- 172.21.15.37:0/1654768316 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe68031c50 con 0x7efe74075850 2024-08-20T05:13:56.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.464+0000 7efe7c000640 1 -- 172.21.15.37:0/1654768316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe7419ca40 con 0x7efe74075850 2024-08-20T05:13:56.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.464+0000 7efe72000640 1 -- 172.21.15.37:0/1654768316 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe68035030 con 0x7efe74075850 2024-08-20T05:13:56.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.464+0000 7efe7c000640 1 -- 172.21.15.37:0/1654768316 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe741a3170 con 0x7efe74075850 2024-08-20T05:13:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.468+0000 7efe7f030740 1 Processor -- start 2024-08-20T05:13:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.468+0000 7efe7f030740 1 -- start start 2024-08-20T05:13:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.468+0000 7efe72000640 1 -- 172.21.15.37:0/1654768316 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7efe68042070 con 0x7efe74075850 2024-08-20T05:13:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.468+0000 7efe7f030740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 0x5575407536a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.468+0000 7efe7f030740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557540753be0 0x557540755fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.468+0000 7efe7f030740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x557540758ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.468+0000 7efe7f030740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5575406c4210 con 0x557540756620 2024-08-20T05:13:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.468+0000 7efe7f030740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5575406b3710 con 0x5575407512b0 2024-08-20T05:13:56.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.468+0000 7efe7f030740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5575406b7750 con 0x557540753be0 2024-08-20T05:13:56.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.468+0000 7efe7a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 0x5575407536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.468+0000 7efe78c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x557540758ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.468+0000 7efe7a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 0x5575407536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42290/0 (socket says 172.21.15.37:42290) 2024-08-20T05:13:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.468+0000 7efe7a000640 1 -- 172.21.15.37:0/1524191050 learned_addr learned my addr 172.21.15.37:0/1524191050 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.468+0000 7efe78c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x557540758ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50790/0 (socket says 172.21.15.37:50790) 2024-08-20T05:13:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.468+0000 7efe79600640 1 --2- 172.21.15.37:0/1524191050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557540753be0 0x557540755fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.469+0000 7efe78c00640 1 -- 172.21.15.37:0/1524191050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557540753be0 msgr2=0x557540755fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.469+0000 7efe78c00640 1 --2- 172.21.15.37:0/1524191050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557540753be0 0x557540755fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.469+0000 7efe78c00640 1 -- 172.21.15.37:0/1524191050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 msgr2=0x5575407536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.469+0000 7efe78c00640 1 --2- 172.21.15.37:0/1524191050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 0x5575407536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.469+0000 7efe78c00640 1 -- 172.21.15.37:0/1524191050 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55754067fde0 con 0x557540756620 2024-08-20T05:13:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.469+0000 7efe7a000640 1 --2- 172.21.15.37:0/1524191050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 0x5575407536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.469+0000 7efe78c00640 1 --2- 172.21.15.37:0/1524191050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x557540758ae0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efe60009c20 tx=0x7efe60011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8c4ec418ddbf99 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.469+0000 7efe66600640 1 -- 172.21.15.37:0/1524191050 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60004050 con 0x557540756620 2024-08-20T05:13:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.469+0000 7efe66600640 1 -- 172.21.15.37:0/1524191050 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe600054d0 con 0x557540756620 2024-08-20T05:13:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.469+0000 7efe66600640 1 -- 172.21.15.37:0/1524191050 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe60004ca0 con 0x557540756620 2024-08-20T05:13:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.470+0000 7efe72000640 1 --2- 172.21.15.37:0/1654768316 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efe5c0b3c50 0x7efe5c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.470+0000 7efe7f030740 1 -- 172.21.15.37:0/1524191050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 msgr2=0x557540758ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.470+0000 7efe7f030740 1 --2- 172.21.15.37:0/1524191050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x557540758ae0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7efe60009c20 tx=0x7efe60011810 comp rx=0 tx=0).stop 2024-08-20T05:13:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.470+0000 7efe72000640 1 -- 172.21.15.37:0/1654768316 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7efe68104620 con 0x7efe74075850 2024-08-20T05:13:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.470+0000 7efe7a000640 1 --2- 172.21.15.37:0/1654768316 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efe5c0b3c50 0x7efe5c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.470+0000 7efe7f030740 1 -- 172.21.15.37:0/1524191050 shutdown_connections 2024-08-20T05:13:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.470+0000 7efe7f030740 1 --2- 172.21.15.37:0/1524191050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x557540758ae0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.470+0000 7efe7f030740 1 --2- 172.21.15.37:0/1524191050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557540753be0 0x557540755fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.470+0000 7efe7f030740 1 --2- 172.21.15.37:0/1524191050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 0x5575407536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.470+0000 7efe7f030740 1 -- 172.21.15.37:0/1524191050 >> 172.21.15.37:0/1524191050 conn(0x55754074c3b0 msgr2=0x55754074d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:56.474 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.470+0000 7efe7f030740 1 -- 172.21.15.37:0/1524191050 shutdown_connections 2024-08-20T05:13:56.475 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.471+0000 7efe7f030740 1 -- 172.21.15.37:0/1524191050 wait complete. 2024-08-20T05:13:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.471+0000 7efe7a000640 1 --2- 172.21.15.37:0/1654768316 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efe5c0b3c50 0x7efe5c0b6110 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009fd0 tx=0x7efe6c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.471+0000 7efe7f030740 1 -- start start 2024-08-20T05:13:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.471+0000 7efe7f030740 1 Processor -- start 2024-08-20T05:13:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe7f030740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575407512b0 0x55754075acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe7f030740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557540753be0 0x55754075b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe7f030740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x55754075bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe7f030740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5575405ecab0 con 0x557540756620 2024-08-20T05:13:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe7f030740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55754065a140 con 0x557540753be0 2024-08-20T05:13:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe7f030740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557540759600 con 0x5575407512b0 2024-08-20T05:13:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe7f030740 10 client.0 _ll_register_callbacks cb 0x55754066d5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe7a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x55754075bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe7a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x55754075bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50796/0 (socket says 172.21.15.37:50796) 2024-08-20T05:13:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe7a000640 1 -- 172.21.15.37:0/188884431 learned_addr learned my addr 172.21.15.37:0/188884431 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe79600640 1 --2- 172.21.15.37:0/188884431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575407512b0 0x55754075acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe78c00640 1 --2- 172.21.15.37:0/188884431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557540753be0 0x55754075b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe7a000640 1 -- 172.21.15.37:0/188884431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575407512b0 msgr2=0x55754075acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe7a000640 1 --2- 172.21.15.37:0/188884431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575407512b0 0x55754075acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe7a000640 1 -- 172.21.15.37:0/188884431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557540753be0 msgr2=0x55754075b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe7a000640 1 --2- 172.21.15.37:0/188884431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557540753be0 0x55754075b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe7a000640 1 -- 172.21.15.37:0/188884431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55754065b170 con 0x557540756620 2024-08-20T05:13:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.472+0000 7efe79600640 1 --2- 172.21.15.37:0/188884431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575407512b0 0x55754075acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.473+0000 7efe7a000640 1 --2- 172.21.15.37:0/188884431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x55754075bef0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00fb40 tx=0x7efe6c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2eff6fbc4def07 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.473+0000 7efe5aa00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:13:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.473+0000 7efe5aa00640 1 -- 172.21.15.37:0/188884431 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6c004b20 con 0x557540756620 2024-08-20T05:13:56.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.473+0000 7efe5aa00640 1 -- 172.21.15.37:0/188884431 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7efe6c017030 con 0x557540756620 2024-08-20T05:13:56.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.473+0000 7efe7f030740 1 -- 172.21.15.37:0/188884431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55754068aa30 con 0x557540756620 2024-08-20T05:13:56.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.473+0000 7efe5aa00640 1 -- 172.21.15.37:0/188884431 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7efe6c004cc0 con 0x557540756620 2024-08-20T05:13:56.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.473+0000 7efe7f030740 10 client.17733 fetch_fsmap learned FSMap version 48 2024-08-20T05:13:56.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.473+0000 7efe7f030740 1 -- 172.21.15.37:0/188884431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x557540416790 con 0x557540756620 2024-08-20T05:13:56.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.473+0000 7efe5aa00640 1 -- 172.21.15.37:0/188884431 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55754068aa30 con 0x557540756620 2024-08-20T05:13:56.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.474+0000 7efe5aa00640 1 -- 172.21.15.37:0/188884431 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7efe6c005290 con 0x557540756620 2024-08-20T05:13:56.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.474+0000 7efe7f030740 10 client.17733 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:13:56.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.474+0000 7efe7f030740 10 client.17733 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:56.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.474+0000 7efe7f030740 20 client.17733 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:56.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.474+0000 7efe7f030740 1 --2- 172.21.15.37:0/188884431 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5575407669d0 0x557540768de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.474+0000 7efe7f030740 4 client.17733 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:13:56.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.474+0000 7efe7f030740 1 -- 172.21.15.37:0/188884431 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575406c6160 con 0x5575407669d0 2024-08-20T05:13:56.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.474+0000 7efe79600640 1 --2- 172.21.15.37:0/188884431 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5575407669d0 0x557540768de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.475+0000 7efe79600640 1 --2- 172.21.15.37:0/188884431 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5575407669d0 0x557540768de0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a44521f65c5f68cc server_cookie=ebd46c205ebfa6ef in_seq=0 out_seq=0 2024-08-20T05:13:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.475+0000 7efe5aa00640 10 client.17733 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.476+0000 7efe5aa00640 1 -- 172.21.15.37:0/188884431 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5575406c6160 con 0x5575407669d0 2024-08-20T05:13:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.476+0000 7efe5aa00640 10 client.17733 handle_command_reply: tid=0 2024-08-20T05:13:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.476+0000 7efe7f030740 1 client.17733 shutdown 2024-08-20T05:13:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.476+0000 7efe7f030740 1 -- 172.21.15.37:0/188884431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 msgr2=0x55754075bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.476+0000 7efe7f030740 1 --2- 172.21.15.37:0/188884431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x55754075bef0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7efe6c00fb40 tx=0x7efe6c004ab0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.476+0000 7efe7f030740 1 -- 172.21.15.37:0/188884431 shutdown_connections 2024-08-20T05:13:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.476+0000 7efe7f030740 1 --2- 172.21.15.37:0/188884431 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5575407669d0 0x557540768de0 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.476+0000 7efe7f030740 1 --2- 172.21.15.37:0/188884431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x55754075bef0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.476+0000 7efe5aa00640 0 client.17733 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.476+0000 7efe7f030740 1 --2- 172.21.15.37:0/188884431 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557540753be0 0x55754075b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.476+0000 7efe7f030740 1 --2- 172.21.15.37:0/188884431 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5575407512b0 0x55754075acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.476+0000 7efe7f030740 1 -- 172.21.15.37:0/188884431 >> 172.21.15.37:0/188884431 conn(0x55754074c3b0 msgr2=0x55754074b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:56.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.476+0000 7efe7f030740 1 -- 172.21.15.37:0/188884431 shutdown_connections 2024-08-20T05:13:56.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.476+0000 7efe7f030740 1 -- 172.21.15.37:0/188884431 wait complete. 2024-08-20T05:13:56.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.476+0000 7efe7f030740 20 client.17733 trim_cache size 0 max 16384 2024-08-20T05:13:56.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.492+0000 7efe7f030740 1 Processor -- start 2024-08-20T05:13:56.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.492+0000 7efe7f030740 1 -- start start 2024-08-20T05:13:56.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.492+0000 7efe7f030740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 0x55754075b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.492+0000 7efe7f030740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557540753be0 0x557540759eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.492+0000 7efe7f030740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x55754075a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.492+0000 7efe7f030740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe741ad4e0 con 0x557540756620 2024-08-20T05:13:56.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.492+0000 7efe7f030740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efe741af020 con 0x5575407512b0 2024-08-20T05:13:56.494 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.492+0000 7efe7f030740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efe741adbb0 con 0x557540753be0 2024-08-20T05:13:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.492+0000 7efe7a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x55754075a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.492+0000 7efe7a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x55754075a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50812/0 (socket says 172.21.15.37:50812) 2024-08-20T05:13:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.492+0000 7efe7a000640 1 -- 172.21.15.37:0/3067691180 learned_addr learned my addr 172.21.15.37:0/3067691180 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.492+0000 7efe78c00640 1 --2- 172.21.15.37:0/3067691180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557540753be0 0x557540759eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.492+0000 7efe79600640 1 --2- 172.21.15.37:0/3067691180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 0x55754075b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.493+0000 7efe7a000640 1 -- 172.21.15.37:0/3067691180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557540753be0 msgr2=0x557540759eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.493+0000 7efe7a000640 1 --2- 172.21.15.37:0/3067691180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557540753be0 0x557540759eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.493+0000 7efe7a000640 1 -- 172.21.15.37:0/3067691180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 msgr2=0x55754075b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.493+0000 7efe7a000640 1 --2- 172.21.15.37:0/3067691180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 0x55754075b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.493+0000 7efe7a000640 1 -- 172.21.15.37:0/3067691180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55754048f620 con 0x557540756620 2024-08-20T05:13:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.493+0000 7efe7a000640 1 --2- 172.21.15.37:0/3067691180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x55754075a3f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0058a0 tx=0x7efe6c011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9048d922fc55cc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.493+0000 7efe65c00640 1 -- 172.21.15.37:0/3067691180 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6c03b070 con 0x557540756620 2024-08-20T05:13:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.493+0000 7efe65c00640 1 -- 172.21.15.37:0/3067691180 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe6c00f900 con 0x557540756620 2024-08-20T05:13:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.493+0000 7efe65c00640 1 -- 172.21.15.37:0/3067691180 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe6c01d6d0 con 0x557540756620 2024-08-20T05:13:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.494+0000 7efe7f030740 1 -- 172.21.15.37:0/3067691180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 msgr2=0x55754075a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.494+0000 7efe7f030740 1 --2- 172.21.15.37:0/3067691180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x55754075a3f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0058a0 tx=0x7efe6c011f00 comp rx=0 tx=0).stop 2024-08-20T05:13:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.494+0000 7efe7f030740 1 -- 172.21.15.37:0/3067691180 shutdown_connections 2024-08-20T05:13:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.494+0000 7efe7f030740 1 --2- 172.21.15.37:0/3067691180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x55754075a3f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.494+0000 7efe7f030740 1 --2- 172.21.15.37:0/3067691180 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557540753be0 0x557540759eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.494+0000 7efe7f030740 1 --2- 172.21.15.37:0/3067691180 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 0x55754075b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.494+0000 7efe7f030740 1 -- 172.21.15.37:0/3067691180 >> 172.21.15.37:0/3067691180 conn(0x55754074c3b0 msgr2=0x557540747230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.494+0000 7efe7f030740 1 -- 172.21.15.37:0/3067691180 shutdown_connections 2024-08-20T05:13:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.494+0000 7efe7f030740 1 -- 172.21.15.37:0/3067691180 wait complete. 2024-08-20T05:13:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.494+0000 7efe7f030740 1 -- start start 2024-08-20T05:13:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.495+0000 7efe7f030740 1 Processor -- start 2024-08-20T05:13:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.495+0000 7efe7f030740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 0x557540761fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.495+0000 7efe7f030740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557540753be0 0x557540762510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.495+0000 7efe7f030740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x557540762c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.495+0000 7efe7f030740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efe741ae950 con 0x557540756620 2024-08-20T05:13:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.495+0000 7efe7f030740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efe741ae280 con 0x5575407512b0 2024-08-20T05:13:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.495+0000 7efe7f030740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efe741ab4c0 con 0x557540753be0 2024-08-20T05:13:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.495+0000 7efe7f030740 10 client.0 _ll_register_callbacks cb 0x7efe6c009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:13:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.495+0000 7efe7a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x557540762c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.495+0000 7efe78c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557540753be0 0x557540762510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.495+0000 7efe79600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 0x557540761fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.495+0000 7efe7a000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x557540762c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50828/0 (socket says 172.21.15.37:50828) 2024-08-20T05:13:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.495+0000 7efe78c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557540753be0 0x557540762510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:48626/0 (socket says 172.21.15.37:48626) 2024-08-20T05:13:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.495+0000 7efe7a000640 1 -- 172.21.15.37:0/888884494 learned_addr learned my addr 172.21.15.37:0/888884494 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:13:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.496+0000 7efe79600640 1 -- 172.21.15.37:0/888884494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557540753be0 msgr2=0x557540762510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.496+0000 7efe79600640 1 --2- 172.21.15.37:0/888884494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557540753be0 0x557540762510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.496+0000 7efe79600640 1 -- 172.21.15.37:0/888884494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 msgr2=0x557540762c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:13:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.496+0000 7efe79600640 1 --2- 172.21.15.37:0/888884494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x557540762c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.496+0000 7efe79600640 1 -- 172.21.15.37:0/888884494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575407cf830 con 0x5575407512b0 2024-08-20T05:13:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.496+0000 7efe78c00640 1 --2- 172.21.15.37:0/888884494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557540753be0 0x557540762510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.496+0000 7efe7a000640 1 --2- 172.21.15.37:0/888884494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x557540762c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:13:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.496+0000 7efe79600640 1 --2- 172.21.15.37:0/888884494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 0x557540761fb0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efe680caf20 tx=0x7efe68107be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59b4132693db9f3d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:13:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.496+0000 7efe5aa00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:13:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.496+0000 7efe5aa00640 1 -- 172.21.15.37:0/888884494 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe68049040 con 0x5575407512b0 2024-08-20T05:13:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.496+0000 7efe7f030740 1 -- 172.21.15.37:0/888884494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5575406c1c00 con 0x5575407512b0 2024-08-20T05:13:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.496+0000 7efe5aa00640 1 -- 172.21.15.37:0/888884494 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7efe68031e00 con 0x5575407512b0 2024-08-20T05:13:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.496+0000 7efe5aa00640 1 -- 172.21.15.37:0/888884494 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7efe680ca990 con 0x5575407512b0 2024-08-20T05:13:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.496+0000 7efe7f030740 10 client.28310 fetch_fsmap learned FSMap version 48 2024-08-20T05:13:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.496+0000 7efe7f030740 1 -- 172.21.15.37:0/888884494 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5575407d0c10 con 0x5575407512b0 2024-08-20T05:13:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.497+0000 7efe5aa00640 1 -- 172.21.15.37:0/888884494 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5575406c1c00 con 0x5575407512b0 2024-08-20T05:13:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.497+0000 7efe5aa00640 1 -- 172.21.15.37:0/888884494 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7efe680c74b0 con 0x5575407512b0 2024-08-20T05:13:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.497+0000 7efe7f030740 10 client.28310 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:13:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.497+0000 7efe7f030740 10 client.28310 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:13:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.497+0000 7efe7f030740 20 client.28310 populate_metadata read hostname 'smithi037' 2024-08-20T05:13:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.497+0000 7efe7f030740 1 --2- 172.21.15.37:0/888884494 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5575407d1510 0x5575407d3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:13:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.497+0000 7efe7f030740 4 client.28310 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:13:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.497+0000 7efe7f030740 1 -- 172.21.15.37:0/888884494 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5575406bf340 con 0x5575407d1510 2024-08-20T05:13:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.497+0000 7efe78c00640 1 --2- 172.21.15.37:0/888884494 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5575407d1510 0x5575407d3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:13:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.498+0000 7efe78c00640 1 --2- 172.21.15.37:0/888884494 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5575407d1510 0x5575407d3900 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a91f7fcc01a3e2b server_cookie=2114ed7ac592fa24 in_seq=0 out_seq=0 2024-08-20T05:13:56.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.498+0000 7efe5aa00640 10 client.28310 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:56.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.507+0000 7efe5aa00640 1 -- 172.21.15.37:0/888884494 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5575406bf340 con 0x5575407d1510 2024-08-20T05:13:56.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.507+0000 7efe5aa00640 10 client.28310 handle_command_reply: tid=0 2024-08-20T05:13:56.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.507+0000 7efe7f030740 1 client.28310 shutdown 2024-08-20T05:13:56.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.507+0000 7efe7f030740 1 -- 172.21.15.37:0/888884494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 msgr2=0x557540761fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:56.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.507+0000 7efe7f030740 1 --2- 172.21.15.37:0/888884494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 0x557540761fb0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efe680caf20 tx=0x7efe68107be0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.507+0000 7efe7f030740 1 -- 172.21.15.37:0/888884494 shutdown_connections 2024-08-20T05:13:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.507+0000 7efe7f030740 1 --2- 172.21.15.37:0/888884494 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5575407d1510 0x5575407d3900 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.507+0000 7efe7f030740 1 --2- 172.21.15.37:0/888884494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557540756620 0x557540762c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.507+0000 7efe7f030740 1 --2- 172.21.15.37:0/888884494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557540753be0 0x557540762510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.507+0000 7efe7f030740 1 --2- 172.21.15.37:0/888884494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5575407512b0 0x557540761fb0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.507+0000 7efe5aa00640 0 client.28310 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:13:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.507+0000 7efe7f030740 1 -- 172.21.15.37:0/888884494 >> 172.21.15.37:0/888884494 conn(0x55754074c3b0 msgr2=0x557540759eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.507+0000 7efe7f030740 1 -- 172.21.15.37:0/888884494 shutdown_connections 2024-08-20T05:13:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.507+0000 7efe7f030740 1 -- 172.21.15.37:0/888884494 wait complete. 2024-08-20T05:13:56.510 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.507+0000 7efe7f030740 20 client.28310 trim_cache size 0 max 16384 2024-08-20T05:13:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:13:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:13:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:13:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:13:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.508+0000 7efe7c000640 1 -- 172.21.15.37:0/1654768316 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efe5c0b3c50 msgr2=0x7efe5c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.508+0000 7efe7c000640 1 --2- 172.21.15.37:0/1654768316 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efe5c0b3c50 0x7efe5c0b6110 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7efe6c009fd0 tx=0x7efe6c009500 comp rx=0 tx=0).stop 2024-08-20T05:13:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.508+0000 7efe7c000640 1 -- 172.21.15.37:0/1654768316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe74075850 msgr2=0x7efe7419ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:13:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.508+0000 7efe7c000640 1 --2- 172.21.15.37:0/1654768316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe74075850 0x7efe7419ac70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efe68005ab0 tx=0x7efe68003b90 comp rx=0 tx=0).stop 2024-08-20T05:13:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.508+0000 7efe7c000640 1 -- 172.21.15.37:0/1654768316 shutdown_connections 2024-08-20T05:13:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.508+0000 7efe7c000640 1 --2- 172.21.15.37:0/1654768316 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efe5c0b3c50 0x7efe5c0b6110 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.508+0000 7efe7c000640 1 --2- 172.21.15.37:0/1654768316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efe7410a5a0 0x7efe7419bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.508+0000 7efe7c000640 1 --2- 172.21.15.37:0/1654768316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe74076cc0 0x7efe7419b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.508+0000 7efe7c000640 1 --2- 172.21.15.37:0/1654768316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efe74075850 0x7efe7419ac70 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:13:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.508+0000 7efe7c000640 1 -- 172.21.15.37:0/1654768316 >> 172.21.15.37:0/1654768316 conn(0x7efe740fdf40 msgr2=0x7efe740fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:13:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.508+0000 7efe7c000640 1 -- 172.21.15.37:0/1654768316 shutdown_connections 2024-08-20T05:13:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:13:56.508+0000 7efe7c000640 1 -- 172.21.15.37:0/1654768316 wait complete. 2024-08-20T05:13:57.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:57 smithi037 ceph-mon[17265]: pgmap v752: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.1 MiB/s wr, 380 op/s 2024-08-20T05:13:57.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:57 smithi135 ceph-mon[22342]: pgmap v752: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.1 MiB/s wr, 380 op/s 2024-08-20T05:13:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:57 smithi130 ceph-mon[22007]: pgmap v752: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.1 MiB/s wr, 380 op/s 2024-08-20T05:13:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 660.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:13:59.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:13:59 smithi037 ceph-mon[17265]: pgmap v753: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.6 MiB/s wr, 284 op/s 2024-08-20T05:13:59.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:13:59 smithi135 ceph-mon[22342]: pgmap v753: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.6 MiB/s wr, 284 op/s 2024-08-20T05:13:59.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:13:59 smithi130 ceph-mon[22007]: pgmap v753: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.6 MiB/s wr, 284 op/s 2024-08-20T05:14:01.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:01 smithi037 ceph-mon[17265]: pgmap v754: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.0 MiB/s wr, 243 op/s 2024-08-20T05:14:01.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:01 smithi135 ceph-mon[22342]: pgmap v754: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.0 MiB/s wr, 243 op/s 2024-08-20T05:14:01.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:01 smithi130 ceph-mon[22007]: pgmap v754: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.0 MiB/s wr, 243 op/s 2024-08-20T05:14:03.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 665.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:14:03.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:03 smithi037 ceph-mon[17265]: pgmap v755: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 MiB/s wr, 132 op/s 2024-08-20T05:14:03.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:03 smithi135 ceph-mon[22342]: pgmap v755: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 MiB/s wr, 132 op/s 2024-08-20T05:14:03.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:03 smithi130 ceph-mon[22007]: pgmap v755: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.3 MiB/s wr, 132 op/s 2024-08-20T05:14:05.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:05 smithi037 ceph-mon[17265]: pgmap v756: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.1 MiB/s wr, 101 op/s 2024-08-20T05:14:05.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:05 smithi135 ceph-mon[22342]: pgmap v756: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.1 MiB/s wr, 101 op/s 2024-08-20T05:14:05.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:05 smithi130 ceph-mon[22007]: pgmap v756: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.1 MiB/s wr, 101 op/s 2024-08-20T05:14:07.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:07 smithi037 ceph-mon[17265]: pgmap v757: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 147 KiB/s wr, 32 op/s 2024-08-20T05:14:07.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:07 smithi135 ceph-mon[22342]: pgmap v757: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 147 KiB/s wr, 32 op/s 2024-08-20T05:14:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:07 smithi130 ceph-mon[22007]: pgmap v757: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 147 KiB/s wr, 32 op/s 2024-08-20T05:14:08.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 670.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:14:08.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:14:08.570 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:14:09.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.203+0000 7feeafe00640 1 -- 172.21.15.37:0/187588448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb0077d20 msgr2=0x7feeb0112fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:09.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.203+0000 7feeafe00640 1 --2- 172.21.15.37:0/187588448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb0077d20 0x7feeb0112fb0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fee98009900 tx=0x7fee9802a410 comp rx=0 tx=0).stop 2024-08-20T05:14:09.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.203+0000 7feeafe00640 1 -- 172.21.15.37:0/187588448 shutdown_connections 2024-08-20T05:14:09.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.203+0000 7feeafe00640 1 --2- 172.21.15.37:0/187588448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feeb01134f0 0x7feeb01158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.203+0000 7feeafe00640 1 --2- 172.21.15.37:0/187588448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb0077d20 0x7feeb0112fb0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.203+0000 7feeafe00640 1 --2- 172.21.15.37:0/187588448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feeb0077400 0x7feeb00777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.203+0000 7feeafe00640 1 -- 172.21.15.37:0/187588448 >> 172.21.15.37:0/187588448 conn(0x7feeb0100550 msgr2=0x7feeb0102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:09.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.204+0000 7feeafe00640 1 -- 172.21.15.37:0/187588448 shutdown_connections 2024-08-20T05:14:09.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.204+0000 7feeafe00640 1 -- 172.21.15.37:0/187588448 wait complete. 2024-08-20T05:14:09.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.204+0000 7feeafe00640 1 Processor -- start 2024-08-20T05:14:09.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.205+0000 7feeafe00640 1 -- start start 2024-08-20T05:14:09.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.205+0000 7feeafe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feeb0077400 0x7feeb019f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.205+0000 7feeafe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb0077d20 0x7feeb019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.205+0000 7feeafe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feeb01134f0 0x7feeb01a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.205+0000 7feeafe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7feeb0118f50 con 0x7feeb0077d20 2024-08-20T05:14:09.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.205+0000 7feeafe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7feeb0118dd0 con 0x7feeb0077400 2024-08-20T05:14:09.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.205+0000 7feeafe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7feeb01190d0 con 0x7feeb01134f0 2024-08-20T05:14:09.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.205+0000 7feea6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb0077d20 0x7feeb019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.205+0000 7feea6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb0077d20 0x7feeb019f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47418/0 (socket says 172.21.15.37:47418) 2024-08-20T05:14:09.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.205+0000 7feea6000640 1 -- 172.21.15.37:0/2485657149 learned_addr learned my addr 172.21.15.37:0/2485657149 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:09.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.205+0000 7feeaea00640 1 --2- 172.21.15.37:0/2485657149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feeb0077400 0x7feeb019f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.205+0000 7feeaf400640 1 --2- 172.21.15.37:0/2485657149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feeb01134f0 0x7feeb01a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.206+0000 7feeaea00640 1 -- 172.21.15.37:0/2485657149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feeb01134f0 msgr2=0x7feeb01a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:09.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.206+0000 7feeaea00640 1 --2- 172.21.15.37:0/2485657149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feeb01134f0 0x7feeb01a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.206+0000 7feeaea00640 1 -- 172.21.15.37:0/2485657149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb0077d20 msgr2=0x7feeb019f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:09.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.206+0000 7feeaea00640 1 --2- 172.21.15.37:0/2485657149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb0077d20 0x7feeb019f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.206+0000 7feeaea00640 1 -- 172.21.15.37:0/2485657149 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb01a53d0 con 0x7feeb0077400 2024-08-20T05:14:09.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.206+0000 7feea6000640 1 --2- 172.21.15.37:0/2485657149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb0077d20 0x7feeb019f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:14:09.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.206+0000 7feeaf400640 1 --2- 172.21.15.37:0/2485657149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feeb01134f0 0x7feeb01a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:14:09.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.206+0000 7feeaea00640 1 --2- 172.21.15.37:0/2485657149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feeb0077400 0x7feeb019f320 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7feea0005fd0 tx=0x7feea000dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:09.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.207+0000 7feeb4a00640 1 -- 172.21.15.37:0/2485657149 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0009c30 con 0x7feeb0077400 2024-08-20T05:14:09.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.207+0000 7feeafe00640 1 -- 172.21.15.37:0/2485657149 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb01a56c0 con 0x7feeb0077400 2024-08-20T05:14:09.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.207+0000 7feeb4a00640 1 -- 172.21.15.37:0/2485657149 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feea0009dd0 con 0x7feeb0077400 2024-08-20T05:14:09.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.207+0000 7feeb4a00640 1 -- 172.21.15.37:0/2485657149 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea0003e20 con 0x7feeb0077400 2024-08-20T05:14:09.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.207+0000 7feeafe00640 1 -- 172.21.15.37:0/2485657149 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb01abf50 con 0x7feeb0077400 2024-08-20T05:14:09.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.208+0000 7feeafe00640 1 -- 172.21.15.37:0/2485657149 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb0078910 con 0x7feeb0077400 2024-08-20T05:14:09.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.210+0000 7feeb4a00640 1 -- 172.21.15.37:0/2485657149 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7feea0003fe0 con 0x7feeb0077400 2024-08-20T05:14:09.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.212+0000 7feeb4a00640 1 --2- 172.21.15.37:0/2485657149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fee940b3c70 0x7fee940b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.212+0000 7feeb4a00640 1 -- 172.21.15.37:0/2485657149 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7feea00e3b30 con 0x7feeb0077400 2024-08-20T05:14:09.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.212+0000 7feea6000640 1 --2- 172.21.15.37:0/2485657149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fee940b3c70 0x7fee940b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.213+0000 7feea6000640 1 --2- 172.21.15.37:0/2485657149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fee940b3c70 0x7fee940b6130 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7feeb0079c30 tx=0x7fee98005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:09.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.213+0000 7feeb4a00640 1 -- 172.21.15.37:0/2485657149 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7feea0017020 con 0x7feeb0077400 2024-08-20T05:14:09.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.447+0000 7feeafe00640 1 -- 172.21.15.37:0/2485657149 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feeb00777e0 con 0x7feeb0077400 2024-08-20T05:14:09.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.448+0000 7feeb4a00640 1 -- 172.21.15.37:0/2485657149 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+11980 (secure 0 0 0) 0x7feeb00777e0 con 0x7feeb0077400 2024-08-20T05:14:09.449 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:14:09.449 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":48,"btime":"2024-08-20T05:13:44:512025+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":48,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:13:43.851787+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:14:09.449 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 48 2024-08-20T05:14:09.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.450+0000 7feeafe00640 1 -- 172.21.15.37:0/2485657149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fee940b3c70 msgr2=0x7fee940b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:09.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.450+0000 7feeafe00640 1 --2- 172.21.15.37:0/2485657149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fee940b3c70 0x7fee940b6130 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7feeb0079c30 tx=0x7fee98005a20 comp rx=0 tx=0).stop 2024-08-20T05:14:09.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.450+0000 7feeafe00640 1 -- 172.21.15.37:0/2485657149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feeb0077400 msgr2=0x7feeb019f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:09.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.450+0000 7feeafe00640 1 --2- 172.21.15.37:0/2485657149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feeb0077400 0x7feeb019f320 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7feea0005fd0 tx=0x7feea000dde0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.450+0000 7feeafe00640 1 -- 172.21.15.37:0/2485657149 shutdown_connections 2024-08-20T05:14:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.450+0000 7feeafe00640 1 --2- 172.21.15.37:0/2485657149 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fee940b3c70 0x7fee940b6130 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.450+0000 7feeafe00640 1 --2- 172.21.15.37:0/2485657149 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7feeb01134f0 0x7feeb01a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.450+0000 7feeafe00640 1 --2- 172.21.15.37:0/2485657149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb0077d20 0x7feeb019f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.450+0000 7feeafe00640 1 --2- 172.21.15.37:0/2485657149 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7feeb0077400 0x7feeb019f320 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.450+0000 7feeafe00640 1 -- 172.21.15.37:0/2485657149 >> 172.21.15.37:0/2485657149 conn(0x7feeb0100550 msgr2=0x7feeb0102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.451+0000 7feeafe00640 1 -- 172.21.15.37:0/2485657149 shutdown_connections 2024-08-20T05:14:09.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:09.451+0000 7feeafe00640 1 -- 172.21.15.37:0/2485657149 wait complete. 2024-08-20T05:14:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.627+0000 7efdf3600640 1 -- 172.21.15.37:0/4237763451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdec104190 msgr2=0x7efdec10ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.627+0000 7efdf3600640 1 --2- 172.21.15.37:0/4237763451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdec104190 0x7efdec10ab10 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7efde4009cd0 tx=0x7efde402a8f0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.628+0000 7efdf3600640 1 -- 172.21.15.37:0/4237763451 shutdown_connections 2024-08-20T05:14:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.628+0000 7efdf3600640 1 --2- 172.21.15.37:0/4237763451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdec104190 0x7efdec10ab10 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.628+0000 7efdf3600640 1 --2- 172.21.15.37:0/4237763451 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdec1037d0 0x7efdec103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.628+0000 7efdf3600640 1 --2- 172.21.15.37:0/4237763451 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec102680 0x7efdec102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.628+0000 7efdf3600640 1 -- 172.21.15.37:0/4237763451 >> 172.21.15.37:0/4237763451 conn(0x7efdec0fdf40 msgr2=0x7efdec100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.628+0000 7efdf3600640 1 -- 172.21.15.37:0/4237763451 shutdown_connections 2024-08-20T05:14:09.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.628+0000 7efdf3600640 1 -- 172.21.15.37:0/4237763451 wait complete. 2024-08-20T05:14:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.629+0000 7efdf3600640 1 Processor -- start 2024-08-20T05:14:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.629+0000 7efdf3600640 1 -- start start 2024-08-20T05:14:09.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.629+0000 7efdf3600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdec102680 0x7efdec076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.629+0000 7efdf3600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec1037d0 0x7efdec075270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.629+0000 7efdf3600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdec104190 0x7efdec0757b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.629+0000 7efdf3600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efdec10e340 con 0x7efdec104190 2024-08-20T05:14:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.629+0000 7efdf3600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efdec10e1c0 con 0x7efdec102680 2024-08-20T05:14:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.629+0000 7efdf3600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efdec10e4c0 con 0x7efdec1037d0 2024-08-20T05:14:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.629+0000 7efdf0c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdec102680 0x7efdec076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.629+0000 7efdf0c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdec102680 0x7efdec076a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47050/0 (socket says 172.21.15.37:47050) 2024-08-20T05:14:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.629+0000 7efdf0c00640 1 -- 172.21.15.37:0/3724484676 learned_addr learned my addr 172.21.15.37:0/3724484676 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.630+0000 7efde3e00640 1 --2- 172.21.15.37:0/3724484676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec1037d0 0x7efdec075270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.630+0000 7efdf1600640 1 --2- 172.21.15.37:0/3724484676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdec104190 0x7efdec0757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.630+0000 7efdf0c00640 1 -- 172.21.15.37:0/3724484676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec1037d0 msgr2=0x7efdec075270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.630+0000 7efdf0c00640 1 --2- 172.21.15.37:0/3724484676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec1037d0 0x7efdec075270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.630+0000 7efdf0c00640 1 -- 172.21.15.37:0/3724484676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdec104190 msgr2=0x7efdec0757b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:09.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.630+0000 7efdf0c00640 1 --2- 172.21.15.37:0/3724484676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdec104190 0x7efdec0757b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.630+0000 7efdf0c00640 1 -- 172.21.15.37:0/3724484676 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdec076020 con 0x7efdec102680 2024-08-20T05:14:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.630+0000 7efdf0c00640 1 --2- 172.21.15.37:0/3724484676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdec102680 0x7efdec076a10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7efddc00e9f0 tx=0x7efddc00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.630+0000 7efdea000640 1 -- 172.21.15.37:0/3724484676 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc00cd80 con 0x7efdec102680 2024-08-20T05:14:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.631+0000 7efdf3600640 1 -- 172.21.15.37:0/3724484676 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdec1a2b50 con 0x7efdec102680 2024-08-20T05:14:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.631+0000 7efdea000640 1 -- 172.21.15.37:0/3724484676 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efddc0054d0 con 0x7efdec102680 2024-08-20T05:14:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.631+0000 7efdea000640 1 -- 172.21.15.37:0/3724484676 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc010690 con 0x7efdec102680 2024-08-20T05:14:09.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.631+0000 7efdf3600640 1 -- 172.21.15.37:0/3724484676 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdec1a3070 con 0x7efdec102680 2024-08-20T05:14:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.633+0000 7efdf6467740 1 Processor -- start 2024-08-20T05:14:09.634 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.634+0000 7efdf6467740 1 -- start start 2024-08-20T05:14:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.634+0000 7efdf6467740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30252b0 0x55c2a30276a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.634+0000 7efdf6467740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a3027be0 0x55c2a3029fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.634+0000 7efdf6467740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a302a620 0x55c2a302cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.634+0000 7efdf6467740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c2a2f98210 con 0x55c2a30252b0 2024-08-20T05:14:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.634+0000 7efdf6467740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c2a2f87710 con 0x55c2a302a620 2024-08-20T05:14:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.634+0000 7efdf6467740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c2a2f8b750 con 0x55c2a3027be0 2024-08-20T05:14:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.634+0000 7efdf1600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30252b0 0x55c2a30276a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.634+0000 7efdf1600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30252b0 0x55c2a30276a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47452/0 (socket says 172.21.15.37:47452) 2024-08-20T05:14:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.634+0000 7efdf1600640 1 -- 172.21.15.37:0/89287117 learned_addr learned my addr 172.21.15.37:0/89287117 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.634+0000 7efdea000640 1 -- 172.21.15.37:0/3724484676 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7efddc004e90 con 0x7efdec102680 2024-08-20T05:14:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.634+0000 7efde3e00640 1 --2- 172.21.15.37:0/89287117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a302a620 0x55c2a302cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.635+0000 7efdf1600640 1 -- 172.21.15.37:0/89287117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a3027be0 msgr2=0x55c2a3029fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.635+0000 7efdf1600640 1 --2- 172.21.15.37:0/89287117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a3027be0 0x55c2a3029fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.635+0000 7efdf1600640 1 -- 172.21.15.37:0/89287117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a302a620 msgr2=0x55c2a302cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.635+0000 7efdf1600640 1 --2- 172.21.15.37:0/89287117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a302a620 0x55c2a302cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.635+0000 7efdf1600640 1 -- 172.21.15.37:0/89287117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2a2f53de0 con 0x55c2a30252b0 2024-08-20T05:14:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.635+0000 7efdf1600640 1 --2- 172.21.15.37:0/89287117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30252b0 0x55c2a30276a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7efde4009cd0 tx=0x7efde4009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874fa6d3df66c9f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.635+0000 7efde1c00640 1 -- 172.21.15.37:0/89287117 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde4030900 con 0x55c2a30252b0 2024-08-20T05:14:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.635+0000 7efde1c00640 1 -- 172.21.15.37:0/89287117 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efde4036030 con 0x55c2a30252b0 2024-08-20T05:14:09.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.635+0000 7efde1c00640 1 -- 172.21.15.37:0/89287117 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde4004520 con 0x55c2a30252b0 2024-08-20T05:14:09.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.636+0000 7efdf6467740 1 -- 172.21.15.37:0/89287117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30252b0 msgr2=0x55c2a30276a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:09.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.636+0000 7efdf6467740 1 --2- 172.21.15.37:0/89287117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30252b0 0x55c2a30276a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7efde4009cd0 tx=0x7efde4009a20 comp rx=0 tx=0).stop 2024-08-20T05:14:09.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.636+0000 7efdf6467740 1 -- 172.21.15.37:0/89287117 shutdown_connections 2024-08-20T05:14:09.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.636+0000 7efdf6467740 1 --2- 172.21.15.37:0/89287117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a302a620 0x55c2a302cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.636+0000 7efdf6467740 1 --2- 172.21.15.37:0/89287117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a3027be0 0x55c2a3029fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.636+0000 7efdf6467740 1 --2- 172.21.15.37:0/89287117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30252b0 0x55c2a30276a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.636+0000 7efdf6467740 1 -- 172.21.15.37:0/89287117 >> 172.21.15.37:0/89287117 conn(0x55c2a30203b0 msgr2=0x55c2a3021190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:09.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.636+0000 7efdf6467740 1 -- 172.21.15.37:0/89287117 shutdown_connections 2024-08-20T05:14:09.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.636+0000 7efdf6467740 1 -- 172.21.15.37:0/89287117 wait complete. 2024-08-20T05:14:09.641 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.636+0000 7efdea000640 1 --2- 172.21.15.37:0/3724484676 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdd00b3ae0 0x7efdd00b5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.636+0000 7efdea000640 1 -- 172.21.15.37:0/3724484676 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7efddc0e43d0 con 0x7efdec102680 2024-08-20T05:14:09.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.636+0000 7efde3e00640 1 --2- 172.21.15.37:0/3724484676 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdd00b3ae0 0x7efdd00b5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.636+0000 7efdf6467740 1 -- start start 2024-08-20T05:14:09.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.637+0000 7efdf6467740 1 Processor -- start 2024-08-20T05:14:09.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.637+0000 7efde3e00640 1 --2- 172.21.15.37:0/3724484676 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdd00b3ae0 0x7efdd00b5fa0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7efdd40045b0 tx=0x7efdd400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:09.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.637+0000 7efdf6467740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a30252b0 0x55c2a302ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.637+0000 7efdf6467740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a3027be0 0x55c2a302f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.637+0000 7efdf6467740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a302a620 0x55c2a302ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.637+0000 7efdf6467740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c2a2ec0ab0 con 0x55c2a302a620 2024-08-20T05:14:09.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.637+0000 7efdf6467740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c2a2f2e140 con 0x55c2a30252b0 2024-08-20T05:14:09.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.637+0000 7efdf6467740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c2a302d5a0 con 0x55c2a3027be0 2024-08-20T05:14:09.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.637+0000 7efdf6467740 10 client.0 _ll_register_callbacks cb 0x55c2a2f415d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:09.642 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.637+0000 7efdf0c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a30252b0 0x55c2a302ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.637+0000 7efdf1600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a302a620 0x55c2a302ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.637+0000 7efdf0c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a30252b0 0x55c2a302ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47066/0 (socket says 172.21.15.37:47066) 2024-08-20T05:14:09.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.637+0000 7efdf0c00640 1 -- 172.21.15.37:0/590598153 learned_addr learned my addr 172.21.15.37:0/590598153 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:09.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.637+0000 7efde3e00640 1 --2- 172.21.15.37:0/590598153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a3027be0 0x55c2a302f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.638+0000 7efdf0c00640 1 -- 172.21.15.37:0/590598153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a3027be0 msgr2=0x55c2a302f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:09.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.638+0000 7efdf0c00640 1 --2- 172.21.15.37:0/590598153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a3027be0 0x55c2a302f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.638+0000 7efdf0c00640 1 -- 172.21.15.37:0/590598153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a302a620 msgr2=0x55c2a302ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:09.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.638+0000 7efdf0c00640 1 --2- 172.21.15.37:0/590598153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a302a620 0x55c2a302ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.638+0000 7efdf0c00640 1 -- 172.21.15.37:0/590598153 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2a2f2f170 con 0x55c2a30252b0 2024-08-20T05:14:09.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.638+0000 7efdf0c00640 1 --2- 172.21.15.37:0/590598153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a30252b0 0x55c2a302ed40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7efddc0097d0 tx=0x7efddc0aa750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66fff412bfe540b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:09.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.638+0000 7efdda000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:14:09.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.638+0000 7efdda000640 1 -- 172.21.15.37:0/590598153 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc0ab620 con 0x55c2a30252b0 2024-08-20T05:14:09.643 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.638+0000 7efdda000640 1 -- 172.21.15.37:0/590598153 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7efddc0e4170 con 0x55c2a30252b0 2024-08-20T05:14:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.638+0000 7efdf6467740 1 -- 172.21.15.37:0/590598153 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c2a2f5ea30 con 0x55c2a30252b0 2024-08-20T05:14:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.638+0000 7efdda000640 1 -- 172.21.15.37:0/590598153 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7efddc0aaf20 con 0x55c2a30252b0 2024-08-20T05:14:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.638+0000 7efdf6467740 10 client.28328 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.638+0000 7efdf6467740 1 -- 172.21.15.37:0/590598153 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55c2a2cea790 con 0x55c2a30252b0 2024-08-20T05:14:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.639+0000 7efdda000640 1 -- 172.21.15.37:0/590598153 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55c2a2f5ea30 con 0x55c2a30252b0 2024-08-20T05:14:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.639+0000 7efdda000640 1 -- 172.21.15.37:0/590598153 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7efddc0a6890 con 0x55c2a30252b0 2024-08-20T05:14:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.639+0000 7efdf6467740 10 client.28328 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.639+0000 7efdf6467740 10 client.28328 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:14:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.639+0000 7efdf6467740 20 client.28328 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.639+0000 7efdf6467740 1 --2- 172.21.15.37:0/590598153 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c2a303a950 0x55c2a303cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.639+0000 7efdf6467740 4 client.28328 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:14:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.639+0000 7efdf6467740 1 -- 172.21.15.37:0/590598153 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2a2f9a160 con 0x55c2a303a950 2024-08-20T05:14:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.639+0000 7efde3e00640 1 --2- 172.21.15.37:0/590598153 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c2a303a950 0x55c2a303cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.640+0000 7efde3e00640 1 --2- 172.21.15.37:0/590598153 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c2a303a950 0x55c2a303cd40 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=295553981c719fa2 server_cookie=8693f25f9bcd43b1 in_seq=0 out_seq=0 2024-08-20T05:14:09.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.640+0000 7efdda000640 10 client.28328 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.641+0000 7efdda000640 1 -- 172.21.15.37:0/590598153 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2a2f9a160 con 0x55c2a303a950 2024-08-20T05:14:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.641+0000 7efdda000640 10 client.28328 handle_command_reply: tid=0 2024-08-20T05:14:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.641+0000 7efdf6467740 1 client.28328 shutdown 2024-08-20T05:14:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.641+0000 7efdf6467740 1 -- 172.21.15.37:0/590598153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a30252b0 msgr2=0x55c2a302ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.641+0000 7efdf6467740 1 --2- 172.21.15.37:0/590598153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a30252b0 0x55c2a302ed40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7efddc0097d0 tx=0x7efddc0aa750 comp rx=0 tx=0).stop 2024-08-20T05:14:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.641+0000 7efdf6467740 1 -- 172.21.15.37:0/590598153 shutdown_connections 2024-08-20T05:14:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.641+0000 7efdf6467740 1 --2- 172.21.15.37:0/590598153 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c2a303a950 0x55c2a303cd40 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.641+0000 7efdf6467740 1 --2- 172.21.15.37:0/590598153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a302a620 0x55c2a302ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.641+0000 7efdf6467740 1 --2- 172.21.15.37:0/590598153 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a3027be0 0x55c2a302f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.641+0000 7efdf6467740 1 --2- 172.21.15.37:0/590598153 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a30252b0 0x55c2a302ed40 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.641+0000 7efdf6467740 1 -- 172.21.15.37:0/590598153 >> 172.21.15.37:0/590598153 conn(0x55c2a30203b0 msgr2=0x55c2a301f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.641+0000 7efdda000640 0 client.28328 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.641+0000 7efdf6467740 1 -- 172.21.15.37:0/590598153 shutdown_connections 2024-08-20T05:14:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.641+0000 7efdf6467740 1 -- 172.21.15.37:0/590598153 wait complete. 2024-08-20T05:14:09.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.641+0000 7efdf6467740 20 client.28328 trim_cache size 0 max 16384 2024-08-20T05:14:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.657+0000 7efdf6467740 1 Processor -- start 2024-08-20T05:14:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.657+0000 7efdf6467740 1 -- start start 2024-08-20T05:14:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.657+0000 7efdf6467740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a30203b0 0x55c2a302aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.657+0000 7efdf6467740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30252b0 0x55c2a302af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.657+0000 7efdf6467740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a3027be0 0x55c2a302d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.657+0000 7efdf6467740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efdec1ad430 con 0x55c2a30252b0 2024-08-20T05:14:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.657+0000 7efdf6467740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efdec1aef70 con 0x55c2a3027be0 2024-08-20T05:14:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.657+0000 7efdf6467740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efdec1adb00 con 0x55c2a30203b0 2024-08-20T05:14:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.657+0000 7efde3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30252b0 0x55c2a302af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.657+0000 7efde3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30252b0 0x55c2a302af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47472/0 (socket says 172.21.15.37:47472) 2024-08-20T05:14:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.657+0000 7efde3e00640 1 -- 172.21.15.37:0/373975455 learned_addr learned my addr 172.21.15.37:0/373975455 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.657+0000 7efdf1600640 1 --2- 172.21.15.37:0/373975455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a3027be0 0x55c2a302d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.658+0000 7efdf0c00640 1 --2- 172.21.15.37:0/373975455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a30203b0 0x55c2a302aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.658+0000 7efde3e00640 1 -- 172.21.15.37:0/373975455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a30203b0 msgr2=0x55c2a302aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:09.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.658+0000 7efde3e00640 1 --2- 172.21.15.37:0/373975455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a30203b0 0x55c2a302aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.658+0000 7efde3e00640 1 -- 172.21.15.37:0/373975455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a3027be0 msgr2=0x55c2a302d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.658+0000 7efde3e00640 1 --2- 172.21.15.37:0/373975455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a3027be0 0x55c2a302d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.658+0000 7efde3e00640 1 -- 172.21.15.37:0/373975455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2a2d63620 con 0x55c2a30252b0 2024-08-20T05:14:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.658+0000 7efde3e00640 1 --2- 172.21.15.37:0/373975455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30252b0 0x55c2a302af40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7efdd4003d00 tx=0x7efdd4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc859cd3fde3338f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.658+0000 7efde1200640 1 -- 172.21.15.37:0/373975455 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd401ed00 con 0x55c2a30252b0 2024-08-20T05:14:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.658+0000 7efde1200640 1 -- 172.21.15.37:0/373975455 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdd402a8d0 con 0x55c2a30252b0 2024-08-20T05:14:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.658+0000 7efde1200640 1 -- 172.21.15.37:0/373975455 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd401c820 con 0x55c2a30252b0 2024-08-20T05:14:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.659+0000 7efdf6467740 1 -- 172.21.15.37:0/373975455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30252b0 msgr2=0x55c2a302af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.659+0000 7efdf6467740 1 --2- 172.21.15.37:0/373975455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30252b0 0x55c2a302af40 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7efdd4003d00 tx=0x7efdd4016000 comp rx=0 tx=0).stop 2024-08-20T05:14:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.659+0000 7efdf6467740 1 -- 172.21.15.37:0/373975455 shutdown_connections 2024-08-20T05:14:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.659+0000 7efdf6467740 1 --2- 172.21.15.37:0/373975455 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a3027be0 0x55c2a302d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.659+0000 7efdf6467740 1 --2- 172.21.15.37:0/373975455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30252b0 0x55c2a302af40 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.659+0000 7efdf6467740 1 --2- 172.21.15.37:0/373975455 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a30203b0 0x55c2a302aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.659+0000 7efdf6467740 1 -- 172.21.15.37:0/373975455 >> 172.21.15.37:0/373975455 conn(0x55c2a3024e90 msgr2=0x55c2a302c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.659+0000 7efdf6467740 1 -- 172.21.15.37:0/373975455 shutdown_connections 2024-08-20T05:14:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.659+0000 7efdf6467740 1 -- 172.21.15.37:0/373975455 wait complete. 2024-08-20T05:14:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.659+0000 7efdf6467740 1 -- start start 2024-08-20T05:14:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.660+0000 7efdf6467740 1 Processor -- start 2024-08-20T05:14:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.660+0000 7efdf6467740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30203b0 0x55c2a3033c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.660+0000 7efdf6467740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a30252b0 0x55c2a3034310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.660+0000 7efdf6467740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a3027be0 0x55c2a3034e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.660+0000 7efdf6467740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efdec1ae8a0 con 0x55c2a30203b0 2024-08-20T05:14:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.660+0000 7efdf6467740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efdec1ae1d0 con 0x55c2a30252b0 2024-08-20T05:14:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.660+0000 7efdf6467740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efdec1ab410 con 0x55c2a3027be0 2024-08-20T05:14:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.660+0000 7efdf6467740 10 client.0 _ll_register_callbacks cb 0x7efddc009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.660+0000 7efdf0c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30203b0 0x55c2a3033c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.660+0000 7efde3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a30252b0 0x55c2a3034310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.660+0000 7efdf0c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30203b0 0x55c2a3033c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47476/0 (socket says 172.21.15.37:47476) 2024-08-20T05:14:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.660+0000 7efdf0c00640 1 -- 172.21.15.37:0/1266660252 learned_addr learned my addr 172.21.15.37:0/1266660252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.660+0000 7efde3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a30252b0 0x55c2a3034310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47084/0 (socket says 172.21.15.37:47084) 2024-08-20T05:14:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.660+0000 7efdf1600640 1 --2- 172.21.15.37:0/1266660252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a3027be0 0x55c2a3034e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.661+0000 7efdf0c00640 1 -- 172.21.15.37:0/1266660252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a3027be0 msgr2=0x55c2a3034e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.661+0000 7efdf0c00640 1 --2- 172.21.15.37:0/1266660252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a3027be0 0x55c2a3034e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.661+0000 7efdf0c00640 1 -- 172.21.15.37:0/1266660252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a30252b0 msgr2=0x55c2a3034310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.661+0000 7efdf0c00640 1 --2- 172.21.15.37:0/1266660252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a30252b0 0x55c2a3034310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.661+0000 7efdf0c00640 1 -- 172.21.15.37:0/1266660252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2a30356c0 con 0x55c2a30203b0 2024-08-20T05:14:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.661+0000 7efde3e00640 1 --2- 172.21.15.37:0/1266660252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a30252b0 0x55c2a3034310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:14:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.661+0000 7efdf0c00640 1 --2- 172.21.15.37:0/1266660252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30203b0 0x55c2a3033c70 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7efddc0a74c0 tx=0x7efddc005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb8cf1d1d6b1af1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.661+0000 7efdda000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:14:09.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.661+0000 7efdda000640 1 -- 172.21.15.37:0/1266660252 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efddc0aacf0 con 0x55c2a30203b0 2024-08-20T05:14:09.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.661+0000 7efdda000640 1 -- 172.21.15.37:0/1266660252 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7efddc0a9f40 con 0x55c2a30203b0 2024-08-20T05:14:09.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.661+0000 7efdf6467740 1 -- 172.21.15.37:0/1266660252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdd402a8d0 con 0x55c2a30203b0 2024-08-20T05:14:09.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.661+0000 7efdda000640 1 -- 172.21.15.37:0/1266660252 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7efddc005680 con 0x55c2a30203b0 2024-08-20T05:14:09.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.661+0000 7efdf6467740 10 client.17763 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:09.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.661+0000 7efdf6467740 1 -- 172.21.15.37:0/1266660252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55c2a3036a30 con 0x55c2a30203b0 2024-08-20T05:14:09.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.662+0000 7efdda000640 1 -- 172.21.15.37:0/1266660252 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdd402a8d0 con 0x55c2a30203b0 2024-08-20T05:14:09.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.662+0000 7efdda000640 1 -- 172.21.15.37:0/1266660252 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7efddc0b06b0 con 0x55c2a30203b0 2024-08-20T05:14:09.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.662+0000 7efdf6467740 10 client.17763 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:09.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.662+0000 7efdf6467740 10 client.17763 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:14:09.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.662+0000 7efdf6467740 20 client.17763 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:09.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.662+0000 7efdf6467740 1 --2- 172.21.15.37:0/1266660252 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c2a302a620 0x55c2a30a75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:09.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.662+0000 7efdf6467740 4 client.17763 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:14:09.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.662+0000 7efdf6467740 1 -- 172.21.15.37:0/1266660252 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c2a2f95c00 con 0x55c2a302a620 2024-08-20T05:14:09.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.662+0000 7efde3e00640 1 --2- 172.21.15.37:0/1266660252 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c2a302a620 0x55c2a30a75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:09.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.663+0000 7efde3e00640 1 --2- 172.21.15.37:0/1266660252 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c2a302a620 0x55c2a30a75c0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e09fcadcb3281f3 server_cookie=44b80cf30bd56454 in_seq=0 out_seq=0 2024-08-20T05:14:09.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.663+0000 7efdda000640 10 client.17763 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.671+0000 7efdda000640 1 -- 172.21.15.37:0/1266660252 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c2a2f95c00 con 0x55c2a302a620 2024-08-20T05:14:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.671+0000 7efdda000640 10 client.17763 handle_command_reply: tid=0 2024-08-20T05:14:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.671+0000 7efdf6467740 1 client.17763 shutdown 2024-08-20T05:14:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.671+0000 7efdf6467740 1 -- 172.21.15.37:0/1266660252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30203b0 msgr2=0x55c2a3033c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.671+0000 7efdf6467740 1 --2- 172.21.15.37:0/1266660252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30203b0 0x55c2a3033c70 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7efddc0a74c0 tx=0x7efddc005f10 comp rx=0 tx=0).stop 2024-08-20T05:14:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.671+0000 7efdf6467740 1 -- 172.21.15.37:0/1266660252 shutdown_connections 2024-08-20T05:14:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.671+0000 7efdf6467740 1 --2- 172.21.15.37:0/1266660252 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c2a302a620 0x55c2a30a75c0 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.671+0000 7efdf6467740 1 --2- 172.21.15.37:0/1266660252 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c2a3027be0 0x55c2a3034e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.671+0000 7efdf6467740 1 --2- 172.21.15.37:0/1266660252 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c2a30252b0 0x55c2a3034310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.671+0000 7efdda000640 0 client.17763 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.671+0000 7efdf6467740 1 --2- 172.21.15.37:0/1266660252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c2a30203b0 0x55c2a3033c70 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.671+0000 7efdf6467740 1 -- 172.21.15.37:0/1266660252 >> 172.21.15.37:0/1266660252 conn(0x55c2a3024e90 msgr2=0x55c2a302aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.672+0000 7efdf6467740 1 -- 172.21.15.37:0/1266660252 shutdown_connections 2024-08-20T05:14:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.672+0000 7efdf6467740 1 -- 172.21.15.37:0/1266660252 wait complete. 2024-08-20T05:14:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.672+0000 7efdf6467740 20 client.17763 trim_cache size 0 max 16384 2024-08-20T05:14:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:14:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:14:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:14:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:14:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.672+0000 7efdf3600640 1 -- 172.21.15.37:0/3724484676 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdd00b3ae0 msgr2=0x7efdd00b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.672+0000 7efdf3600640 1 --2- 172.21.15.37:0/3724484676 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdd00b3ae0 0x7efdd00b5fa0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7efdd40045b0 tx=0x7efdd400b390 comp rx=0 tx=0).stop 2024-08-20T05:14:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.672+0000 7efdf3600640 1 -- 172.21.15.37:0/3724484676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdec102680 msgr2=0x7efdec076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.672+0000 7efdf3600640 1 --2- 172.21.15.37:0/3724484676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdec102680 0x7efdec076a10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7efddc00e9f0 tx=0x7efddc00edf0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.672+0000 7efdf3600640 1 -- 172.21.15.37:0/3724484676 shutdown_connections 2024-08-20T05:14:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.672+0000 7efdf3600640 1 --2- 172.21.15.37:0/3724484676 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efdd00b3ae0 0x7efdd00b5fa0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.672+0000 7efdf3600640 1 --2- 172.21.15.37:0/3724484676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdec104190 0x7efdec0757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.672+0000 7efdf3600640 1 --2- 172.21.15.37:0/3724484676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdec1037d0 0x7efdec075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.672+0000 7efdf3600640 1 --2- 172.21.15.37:0/3724484676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdec102680 0x7efdec076a10 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.672+0000 7efdf3600640 1 -- 172.21.15.37:0/3724484676 >> 172.21.15.37:0/3724484676 conn(0x7efdec0fdf40 msgr2=0x7efdec106ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.673+0000 7efdf3600640 1 -- 172.21.15.37:0/3724484676 shutdown_connections 2024-08-20T05:14:09.676 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:09.673+0000 7efdf3600640 1 -- 172.21.15.37:0/3724484676 wait complete. 2024-08-20T05:14:09.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:09 smithi037 ceph-mon[17265]: pgmap v758: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-08-20T05:14:09.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:09 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2485657149' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:14:09.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:09 smithi135 ceph-mon[22342]: pgmap v758: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-08-20T05:14:09.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:09 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2485657149' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:14:09.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:09 smithi130 ceph-mon[22007]: pgmap v758: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-08-20T05:14:09.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:09 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2485657149' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:14:10.240 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:14:10.411 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id 1119eaf7 --release --await' 2024-08-20T05:14:10.412 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id 1119eaf7 --release --await 2024-08-20T05:14:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:14:11.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:11 smithi037 ceph-mon[17265]: pgmap v759: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-08-20T05:14:11.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.770+0000 7fb9a1800640 1 -- 172.21.15.37:0/2554573235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c10a510 msgr2=0x7fb99c10a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:11.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.770+0000 7fb9a1800640 1 --2- 172.21.15.37:0/2554573235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c10a510 0x7fb99c10a950 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb984009900 tx=0x7fb98402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.771+0000 7fb9a1800640 1 -- 172.21.15.37:0/2554573235 shutdown_connections 2024-08-20T05:14:11.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.771+0000 7fb9a1800640 1 --2- 172.21.15.37:0/2554573235 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb99c10ae90 0x7fb99c111690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.771+0000 7fb9a1800640 1 --2- 172.21.15.37:0/2554573235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c10a510 0x7fb99c10a950 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.771+0000 7fb9a1800640 1 --2- 172.21.15.37:0/2554573235 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb99c104b00 0x7fb99c104ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.771+0000 7fb9a1800640 1 -- 172.21.15.37:0/2554573235 >> 172.21.15.37:0/2554573235 conn(0x7fb99c100550 msgr2=0x7fb99c102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:11.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.771+0000 7fb9a1800640 1 -- 172.21.15.37:0/2554573235 shutdown_connections 2024-08-20T05:14:11.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.771+0000 7fb9a1800640 1 -- 172.21.15.37:0/2554573235 wait complete. 2024-08-20T05:14:11.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.772+0000 7fb9a1800640 1 Processor -- start 2024-08-20T05:14:11.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.772+0000 7fb9a1800640 1 -- start start 2024-08-20T05:14:11.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.773+0000 7fb9a1800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb99c104b00 0x7fb99c19af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.773+0000 7fb9a1800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c10a510 0x7fb99c19b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.773+0000 7fb9a1800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb99c10ae90 0x7fb99c1a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.773+0000 7fb9a1800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c114ba0 con 0x7fb99c10a510 2024-08-20T05:14:11.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.773+0000 7fb9a1800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c114a20 con 0x7fb99c10ae90 2024-08-20T05:14:11.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.773+0000 7fb9a1800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c114d20 con 0x7fb99c104b00 2024-08-20T05:14:11.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.773+0000 7fb993400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c10a510 0x7fb99c19b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.773+0000 7fb993400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c10a510 0x7fb99c19b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47502/0 (socket says 172.21.15.37:47502) 2024-08-20T05:14:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.773+0000 7fb993400640 1 -- 172.21.15.37:0/2749986050 learned_addr learned my addr 172.21.15.37:0/2749986050 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.773+0000 7fb99be00640 1 --2- 172.21.15.37:0/2749986050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb99c104b00 0x7fb99c19af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.773+0000 7fb9a0e00640 1 --2- 172.21.15.37:0/2749986050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb99c10ae90 0x7fb99c1a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.773+0000 7fb99be00640 1 -- 172.21.15.37:0/2749986050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb99c10ae90 msgr2=0x7fb99c1a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.773+0000 7fb99be00640 1 --2- 172.21.15.37:0/2749986050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb99c10ae90 0x7fb99c1a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.774+0000 7fb99be00640 1 -- 172.21.15.37:0/2749986050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c10a510 msgr2=0x7fb99c19b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.774+0000 7fb99be00640 1 --2- 172.21.15.37:0/2749986050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c10a510 0x7fb99c19b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.774+0000 7fb99be00640 1 -- 172.21.15.37:0/2749986050 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c1a1020 con 0x7fb99c104b00 2024-08-20T05:14:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.774+0000 7fb993400640 1 --2- 172.21.15.37:0/2749986050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c10a510 0x7fb99c19b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:14:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.774+0000 7fb99be00640 1 --2- 172.21.15.37:0/2749986050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb99c104b00 0x7fb99c19af70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00e9f0 tx=0x7fb98c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.774+0000 7fb999600640 1 -- 172.21.15.37:0/2749986050 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c00ccc0 con 0x7fb99c104b00 2024-08-20T05:14:11.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.774+0000 7fb999600640 1 -- 172.21.15.37:0/2749986050 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb98c0108e0 con 0x7fb99c104b00 2024-08-20T05:14:11.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.774+0000 7fb9a1800640 1 -- 172.21.15.37:0/2749986050 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99c1a1310 con 0x7fb99c104b00 2024-08-20T05:14:11.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.774+0000 7fb999600640 1 -- 172.21.15.37:0/2749986050 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98c018880 con 0x7fb99c104b00 2024-08-20T05:14:11.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.774+0000 7fb9a1800640 1 -- 172.21.15.37:0/2749986050 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb99c1a79d0 con 0x7fb99c104b00 2024-08-20T05:14:11.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.777+0000 7fb9a5896740 1 Processor -- start 2024-08-20T05:14:11.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.777+0000 7fb9a5896740 1 -- start start 2024-08-20T05:14:11.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.778+0000 7fb999600640 1 -- 172.21.15.37:0/2749986050 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb98c010430 con 0x7fb99c104b00 2024-08-20T05:14:11.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.778+0000 7fb9a5896740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962ceba80 0x556962cebe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.778+0000 7fb9a5896740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cec3a0 0x556962cf7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.778+0000 7fb9a5896740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962cf8330 0x556962cfa720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.778+0000 7fb9a5896740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556962c61a60 con 0x556962cf8330 2024-08-20T05:14:11.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.778+0000 7fb9a5896740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556962c50f60 con 0x556962cec3a0 2024-08-20T05:14:11.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.778+0000 7fb9a5896740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556962c54fa0 con 0x556962ceba80 2024-08-20T05:14:11.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.778+0000 7fb9a0e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962ceba80 0x556962cebe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.778+0000 7fb993400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962cf8330 0x556962cfa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.778+0000 7fb9a0e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962ceba80 0x556962cebe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:48656/0 (socket says 172.21.15.37:48656) 2024-08-20T05:14:11.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.778+0000 7fb9a0e00640 1 -- 172.21.15.37:0/376081938 learned_addr learned my addr 172.21.15.37:0/376081938 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:11.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.778+0000 7fb99be00640 1 --2- 172.21.15.37:0/376081938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cec3a0 0x556962cf7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.778+0000 7fb9a0e00640 1 -- 172.21.15.37:0/376081938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cec3a0 msgr2=0x556962cf7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:11.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.778+0000 7fb9a0e00640 1 --2- 172.21.15.37:0/376081938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cec3a0 0x556962cf7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.778+0000 7fb9a0e00640 1 -- 172.21.15.37:0/376081938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962cf8330 msgr2=0x556962cfa720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:11.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.779+0000 7fb9a0e00640 1 --2- 172.21.15.37:0/376081938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962cf8330 0x556962cfa720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.779+0000 7fb9a0e00640 1 -- 172.21.15.37:0/376081938 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556962bf73e0 con 0x556962ceba80 2024-08-20T05:14:11.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.779+0000 7fb9a0e00640 1 --2- 172.21.15.37:0/376081938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962ceba80 0x556962cebe60 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb994009f50 tx=0x7fb9940118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff036e4cf87320f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:11.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.779+0000 7fb991600640 1 -- 172.21.15.37:0/376081938 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99401e070 con 0x556962ceba80 2024-08-20T05:14:11.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.779+0000 7fb991600640 1 -- 172.21.15.37:0/376081938 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb994003c30 con 0x556962ceba80 2024-08-20T05:14:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.779+0000 7fb991600640 1 -- 172.21.15.37:0/376081938 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99400f8d0 con 0x556962ceba80 2024-08-20T05:14:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.779+0000 7fb999600640 1 --2- 172.21.15.37:0/2749986050 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb9800b3c70 0x7fb9800b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.780+0000 7fb999600640 1 -- 172.21.15.37:0/2749986050 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb98c0e4370 con 0x7fb99c104b00 2024-08-20T05:14:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.780+0000 7fb99be00640 1 --2- 172.21.15.37:0/2749986050 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb9800b3c70 0x7fb9800b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.780+0000 7fb9a5896740 1 -- 172.21.15.37:0/376081938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962ceba80 msgr2=0x556962cebe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.780+0000 7fb9a5896740 1 --2- 172.21.15.37:0/376081938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962ceba80 0x556962cebe60 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb994009f50 tx=0x7fb9940118d0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.780+0000 7fb9a5896740 1 -- 172.21.15.37:0/376081938 shutdown_connections 2024-08-20T05:14:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.780+0000 7fb9a5896740 1 --2- 172.21.15.37:0/376081938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962cf8330 0x556962cfa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.780+0000 7fb9a5896740 1 --2- 172.21.15.37:0/376081938 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cec3a0 0x556962cf7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.780+0000 7fb9a5896740 1 --2- 172.21.15.37:0/376081938 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962ceba80 0x556962cebe60 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.780+0000 7fb9a5896740 1 -- 172.21.15.37:0/376081938 >> 172.21.15.37:0/376081938 conn(0x556962ce98b0 msgr2=0x556962ceaa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.780+0000 7fb9a5896740 1 -- 172.21.15.37:0/376081938 shutdown_connections 2024-08-20T05:14:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.780+0000 7fb9a5896740 1 -- 172.21.15.37:0/376081938 wait complete. 2024-08-20T05:14:11.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.780+0000 7fb99be00640 1 --2- 172.21.15.37:0/2749986050 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb9800b3c70 0x7fb9800b6130 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0a6ff0 tx=0x7fb98c009700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.781+0000 7fb9a5896740 1 -- start start 2024-08-20T05:14:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.781+0000 7fb9a5896740 1 Processor -- start 2024-08-20T05:14:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.781+0000 7fb9a5896740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962ceba80 0x556962cf7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.781+0000 7fb9a5896740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962cec3a0 0x556962cf4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.781+0000 7fb9a5896740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cf8330 0x556962cf54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.781+0000 7fb9a5896740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556962ab3700 con 0x556962cec3a0 2024-08-20T05:14:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.782+0000 7fb9a5896740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556962bec250 con 0x556962cf8330 2024-08-20T05:14:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.782+0000 7fb9a5896740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556962cfafb0 con 0x556962ceba80 2024-08-20T05:14:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.782+0000 7fb9a5896740 10 client.0 _ll_register_callbacks cb 0x556962c4b180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.782+0000 7fb993400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962cec3a0 0x556962cf4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.782+0000 7fb993400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962cec3a0 0x556962cf4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47516/0 (socket says 172.21.15.37:47516) 2024-08-20T05:14:11.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.782+0000 7fb993400640 1 -- 172.21.15.37:0/383577504 learned_addr learned my addr 172.21.15.37:0/383577504 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.782+0000 7fb9a0e00640 1 --2- 172.21.15.37:0/383577504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962ceba80 0x556962cf7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.782+0000 7fb9a0e00640 1 --2- 172.21.15.37:0/383577504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cf8330 0x556962cf54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.782+0000 7fb993400640 1 -- 172.21.15.37:0/383577504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962ceba80 msgr2=0x556962cf7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.782+0000 7fb993400640 1 --2- 172.21.15.37:0/383577504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962ceba80 0x556962cf7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.782+0000 7fb993400640 1 -- 172.21.15.37:0/383577504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cf8330 msgr2=0x556962cf54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.782+0000 7fb993400640 1 --2- 172.21.15.37:0/383577504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cf8330 0x556962cf54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.782+0000 7fb993400640 1 -- 172.21.15.37:0/383577504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569629b0650 con 0x556962cec3a0 2024-08-20T05:14:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.782+0000 7fb9a0e00640 1 --2- 172.21.15.37:0/383577504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cf8330 0x556962cf54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:14:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.783+0000 7fb993400640 1 --2- 172.21.15.37:0/383577504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962cec3a0 0x556962cf4f80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb98402a9e0 tx=0x7fb984003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce68a8a73891997c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.783+0000 7fb98a000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:14:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.783+0000 7fb98a000640 1 -- 172.21.15.37:0/383577504 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984035040 con 0x556962cec3a0 2024-08-20T05:14:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.783+0000 7fb9a5896740 1 -- 172.21.15.37:0/383577504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb994003c30 con 0x556962cec3a0 2024-08-20T05:14:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.783+0000 7fb98a000640 1 -- 172.21.15.37:0/383577504 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb984005020 con 0x556962cec3a0 2024-08-20T05:14:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.783+0000 7fb98a000640 1 -- 172.21.15.37:0/383577504 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb98404e050 con 0x556962cec3a0 2024-08-20T05:14:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.783+0000 7fb9a5896740 10 client.17775 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:11.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.783+0000 7fb9a5896740 1 -- 172.21.15.37:0/383577504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x556962d06870 con 0x556962cec3a0 2024-08-20T05:14:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.784+0000 7fb98a000640 1 -- 172.21.15.37:0/383577504 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb994003c30 con 0x556962cec3a0 2024-08-20T05:14:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.784+0000 7fb98a000640 1 -- 172.21.15.37:0/383577504 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7fb9840314a0 con 0x556962cec3a0 2024-08-20T05:14:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.784+0000 7fb9a5896740 10 client.17775 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.784+0000 7fb9a5896740 10 client.17775 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:14:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.784+0000 7fb9a5896740 20 client.17775 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.784+0000 7fb9a5896740 1 --2- 172.21.15.37:0/383577504 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556962d07d20 0x556962d0a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.784+0000 7fb9a5896740 4 client.17775 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:14:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.784+0000 7fb9a5896740 1 -- 172.21.15.37:0/383577504 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556962c639b0 con 0x556962d07d20 2024-08-20T05:14:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.784+0000 7fb9a0e00640 1 --2- 172.21.15.37:0/383577504 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556962d07d20 0x556962d0a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.785+0000 7fb9a0e00640 1 --2- 172.21.15.37:0/383577504 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556962d07d20 0x556962d0a160 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a65d99e7fcdc284 server_cookie=7fc73d4fe3f97470 in_seq=0 out_seq=0 2024-08-20T05:14:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.785+0000 7fb98a000640 10 client.17775 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.786+0000 7fb98a000640 1 -- 172.21.15.37:0/383577504 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556962c639b0 con 0x556962d07d20 2024-08-20T05:14:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.786+0000 7fb98a000640 10 client.17775 handle_command_reply: tid=0 2024-08-20T05:14:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.786+0000 7fb9a5896740 1 client.17775 shutdown 2024-08-20T05:14:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.786+0000 7fb9a5896740 1 -- 172.21.15.37:0/383577504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962cec3a0 msgr2=0x556962cf4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.786+0000 7fb9a5896740 1 --2- 172.21.15.37:0/383577504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962cec3a0 0x556962cf4f80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb98402a9e0 tx=0x7fb984003820 comp rx=0 tx=0).stop 2024-08-20T05:14:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.786+0000 7fb9a5896740 1 -- 172.21.15.37:0/383577504 shutdown_connections 2024-08-20T05:14:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.786+0000 7fb9a5896740 1 --2- 172.21.15.37:0/383577504 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556962d07d20 0x556962d0a160 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.786+0000 7fb9a5896740 1 --2- 172.21.15.37:0/383577504 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cf8330 0x556962cf54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.786+0000 7fb9a5896740 1 --2- 172.21.15.37:0/383577504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962cec3a0 0x556962cf4f80 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.786+0000 7fb9a5896740 1 --2- 172.21.15.37:0/383577504 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962ceba80 0x556962cf7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.786+0000 7fb9a5896740 1 -- 172.21.15.37:0/383577504 >> 172.21.15.37:0/383577504 conn(0x556962ce98b0 msgr2=0x556962cef420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.786+0000 7fb98a000640 0 client.17775 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.786+0000 7fb9a5896740 1 -- 172.21.15.37:0/383577504 shutdown_connections 2024-08-20T05:14:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.786+0000 7fb9a5896740 1 -- 172.21.15.37:0/383577504 wait complete. 2024-08-20T05:14:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.786+0000 7fb9a5896740 20 client.17775 trim_cache size 0 max 16384 2024-08-20T05:14:11.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.804+0000 7fb9a5896740 1 Processor -- start 2024-08-20T05:14:11.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.804+0000 7fb9a5896740 1 -- start start 2024-08-20T05:14:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.805+0000 7fb9a5896740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962ceba80 0x556962d04100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.805+0000 7fb9a5896740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cec3a0 0x556962d0fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.805+0000 7fb9a5896740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962cf8330 0x556962d0ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.805+0000 7fb9a5896740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c1b1880 con 0x556962ceba80 2024-08-20T05:14:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.805+0000 7fb9a5896740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c1b33c0 con 0x556962cec3a0 2024-08-20T05:14:11.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.805+0000 7fb9a5896740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c1b1f50 con 0x556962cf8330 2024-08-20T05:14:11.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.805+0000 7fb9a0e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962ceba80 0x556962d04100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.805+0000 7fb9a0e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962ceba80 0x556962d04100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47518/0 (socket says 172.21.15.37:47518) 2024-08-20T05:14:11.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.805+0000 7fb9a0e00640 1 -- 172.21.15.37:0/1729939582 learned_addr learned my addr 172.21.15.37:0/1729939582 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:11.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.805+0000 7fb993400640 1 --2- 172.21.15.37:0/1729939582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cec3a0 0x556962d0fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.805+0000 7fb9a0e00640 1 --2- 172.21.15.37:0/1729939582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962cf8330 0x556962d0ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.805+0000 7fb993400640 1 -- 172.21.15.37:0/1729939582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962cf8330 msgr2=0x556962d0ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:11.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.805+0000 7fb993400640 1 --2- 172.21.15.37:0/1729939582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962cf8330 0x556962d0ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.806+0000 7fb993400640 1 -- 172.21.15.37:0/1729939582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962ceba80 msgr2=0x556962d04100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:11.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.806+0000 7fb993400640 1 --2- 172.21.15.37:0/1729939582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962ceba80 0x556962d04100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.806+0000 7fb993400640 1 -- 172.21.15.37:0/1729939582 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556962ce96e0 con 0x556962cec3a0 2024-08-20T05:14:11.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.806+0000 7fb9a0e00640 1 --2- 172.21.15.37:0/1729939582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962ceba80 0x556962d04100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:14:11.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.806+0000 7fb993400640 1 --2- 172.21.15.37:0/1729939582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cec3a0 0x556962d0fa30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb9840319c0 tx=0x7fb98402a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12a030f9db5e6b06 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:11.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.806+0000 7fb990c00640 1 -- 172.21.15.37:0/1729939582 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984035070 con 0x556962cec3a0 2024-08-20T05:14:11.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.806+0000 7fb990c00640 1 -- 172.21.15.37:0/1729939582 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb984003c60 con 0x556962cec3a0 2024-08-20T05:14:11.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.806+0000 7fb990c00640 1 -- 172.21.15.37:0/1729939582 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98403cb50 con 0x556962cec3a0 2024-08-20T05:14:11.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.807+0000 7fb9a5896740 1 -- 172.21.15.37:0/1729939582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cec3a0 msgr2=0x556962d0fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:11.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.807+0000 7fb9a5896740 1 --2- 172.21.15.37:0/1729939582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cec3a0 0x556962d0fa30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fb9840319c0 tx=0x7fb98402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.807+0000 7fb9a5896740 1 -- 172.21.15.37:0/1729939582 shutdown_connections 2024-08-20T05:14:11.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.807+0000 7fb9a5896740 1 --2- 172.21.15.37:0/1729939582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962cf8330 0x556962d0ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.807+0000 7fb9a5896740 1 --2- 172.21.15.37:0/1729939582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cec3a0 0x556962d0fa30 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.807+0000 7fb9a5896740 1 --2- 172.21.15.37:0/1729939582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962ceba80 0x556962d04100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.807+0000 7fb9a5896740 1 -- 172.21.15.37:0/1729939582 >> 172.21.15.37:0/1729939582 conn(0x556962ce98b0 msgr2=0x556962cf05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:11.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.807+0000 7fb9a5896740 1 -- 172.21.15.37:0/1729939582 shutdown_connections 2024-08-20T05:14:11.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.807+0000 7fb9a5896740 1 -- 172.21.15.37:0/1729939582 wait complete. 2024-08-20T05:14:11.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.807+0000 7fb9a5896740 1 -- start start 2024-08-20T05:14:11.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.808+0000 7fb9a5896740 1 Processor -- start 2024-08-20T05:14:11.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.808+0000 7fb9a5896740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962ceba80 0x556962cfba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.808+0000 7fb9a5896740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962cec3a0 0x556962cfbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.808+0000 7fb9a5896740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cf8330 0x556962d709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.808+0000 7fb9a5896740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c1b2cf0 con 0x556962ceba80 2024-08-20T05:14:11.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.808+0000 7fb9a5896740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c1b2620 con 0x556962cf8330 2024-08-20T05:14:11.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.808+0000 7fb9a5896740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c1af860 con 0x556962cec3a0 2024-08-20T05:14:11.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.808+0000 7fb9a5896740 10 client.0 _ll_register_callbacks cb 0x7fb984009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:11.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.808+0000 7fb9a0e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962ceba80 0x556962cfba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.808+0000 7fb993400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962cec3a0 0x556962cfbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.808+0000 7fb9a0e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962ceba80 0x556962cfba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47522/0 (socket says 172.21.15.37:47522) 2024-08-20T05:14:11.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.808+0000 7fb9a0e00640 1 -- 172.21.15.37:0/4178603430 learned_addr learned my addr 172.21.15.37:0/4178603430 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:11.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.809+0000 7fb9a0e00640 1 --2- 172.21.15.37:0/4178603430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cf8330 0x556962d709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.809+0000 7fb993400640 1 -- 172.21.15.37:0/4178603430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cf8330 msgr2=0x556962d709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:11.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.809+0000 7fb993400640 1 --2- 172.21.15.37:0/4178603430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cf8330 0x556962d709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.809+0000 7fb993400640 1 -- 172.21.15.37:0/4178603430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962ceba80 msgr2=0x556962cfba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:11.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.809+0000 7fb993400640 1 --2- 172.21.15.37:0/4178603430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962ceba80 0x556962cfba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.809+0000 7fb993400640 1 -- 172.21.15.37:0/4178603430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556962cea330 con 0x556962cec3a0 2024-08-20T05:14:11.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.809+0000 7fb9a0e00640 1 --2- 172.21.15.37:0/4178603430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962ceba80 0x556962cfba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:14:11.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.809+0000 7fb993400640 1 --2- 172.21.15.37:0/4178603430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962cec3a0 0x556962cfbf60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb984005ec0 tx=0x7fb984005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6ce9ebcb2f7b467 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:11.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.809+0000 7fb98a000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:14:11.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.809+0000 7fb98a000640 1 -- 172.21.15.37:0/4178603430 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984061060 con 0x556962cec3a0 2024-08-20T05:14:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.809+0000 7fb9a5896740 1 -- 172.21.15.37:0/4178603430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb984003c60 con 0x556962cec3a0 2024-08-20T05:14:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.809+0000 7fb98a000640 1 -- 172.21.15.37:0/4178603430 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb984053850 con 0x556962cec3a0 2024-08-20T05:14:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.810+0000 7fb98a000640 1 -- 172.21.15.37:0/4178603430 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb984068050 con 0x556962cec3a0 2024-08-20T05:14:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.810+0000 7fb9a5896740 10 client.28384 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.810+0000 7fb9a5896740 1 -- 172.21.15.37:0/4178603430 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x556962d721b0 con 0x556962cec3a0 2024-08-20T05:14:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.810+0000 7fb98a000640 1 -- 172.21.15.37:0/4178603430 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb984003c60 con 0x556962cec3a0 2024-08-20T05:14:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.810+0000 7fb98a000640 1 -- 172.21.15.37:0/4178603430 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7fb98403c590 con 0x556962cec3a0 2024-08-20T05:14:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.810+0000 7fb9a5896740 10 client.28384 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.810+0000 7fb9a5896740 10 client.28384 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:14:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.810+0000 7fb9a5896740 20 client.28384 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.810+0000 7fb9a5896740 1 --2- 172.21.15.37:0/4178603430 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556962d727f0 0x556962d74c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:11.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.810+0000 7fb9a5896740 4 client.28384 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:14:11.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.810+0000 7fb9a5896740 1 -- 172.21.15.37:0/4178603430 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556962c5f450 con 0x556962d727f0 2024-08-20T05:14:11.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.811+0000 7fb9a0e00640 1 --2- 172.21.15.37:0/4178603430 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556962d727f0 0x556962d74c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.811+0000 7fb9a0e00640 1 --2- 172.21.15.37:0/4178603430 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556962d727f0 0x556962d74c10 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d976f78e3d14ea3f server_cookie=d39cb24c5a8c192a in_seq=0 out_seq=0 2024-08-20T05:14:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.811+0000 7fb98a000640 10 client.28384 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.811+0000 7fb98a000640 1 -- 172.21.15.37:0/4178603430 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556962c5f450 con 0x556962d727f0 2024-08-20T05:14:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.811+0000 7fb98a000640 10 client.28384 handle_command_reply: tid=0 2024-08-20T05:14:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.811+0000 7fb9a5896740 1 client.28384 shutdown 2024-08-20T05:14:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.811+0000 7fb9a5896740 1 -- 172.21.15.37:0/4178603430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962cec3a0 msgr2=0x556962cfbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.811+0000 7fb9a5896740 1 --2- 172.21.15.37:0/4178603430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962cec3a0 0x556962cfbf60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb984005ec0 tx=0x7fb984005fd0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.812+0000 7fb9a5896740 1 -- 172.21.15.37:0/4178603430 shutdown_connections 2024-08-20T05:14:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.812+0000 7fb9a5896740 1 --2- 172.21.15.37:0/4178603430 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556962d727f0 0x556962d74c10 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.812+0000 7fb9a5896740 1 --2- 172.21.15.37:0/4178603430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556962cf8330 0x556962d709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.812+0000 7fb9a5896740 1 --2- 172.21.15.37:0/4178603430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556962cec3a0 0x556962cfbf60 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.812+0000 7fb98a000640 0 client.28384 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:11.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.812+0000 7fb9a5896740 1 --2- 172.21.15.37:0/4178603430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556962ceba80 0x556962cfba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.812+0000 7fb9a5896740 1 -- 172.21.15.37:0/4178603430 >> 172.21.15.37:0/4178603430 conn(0x556962ce98b0 msgr2=0x556962ce8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:11.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.812+0000 7fb9a5896740 1 -- 172.21.15.37:0/4178603430 shutdown_connections 2024-08-20T05:14:11.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.812+0000 7fb9a5896740 1 -- 172.21.15.37:0/4178603430 wait complete. 2024-08-20T05:14:11.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.812+0000 7fb9a5896740 20 client.28384 trim_cache size 0 max 16384 2024-08-20T05:14:11.817 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:14:11.817 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-20T05:14:11.817 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-08-20T05:14:11.817 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:14:11.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.813+0000 7fb9a1800640 1 -- 172.21.15.37:0/2749986050 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb9800b3c70 msgr2=0x7fb9800b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:11.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.813+0000 7fb9a1800640 1 --2- 172.21.15.37:0/2749986050 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb9800b3c70 0x7fb9800b6130 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0a6ff0 tx=0x7fb98c009700 comp rx=0 tx=0).stop 2024-08-20T05:14:11.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.813+0000 7fb9a1800640 1 -- 172.21.15.37:0/2749986050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb99c104b00 msgr2=0x7fb99c19af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:11.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.813+0000 7fb9a1800640 1 --2- 172.21.15.37:0/2749986050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb99c104b00 0x7fb99c19af70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb98c00e9f0 tx=0x7fb98c00eeb0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.813+0000 7fb9a1800640 1 -- 172.21.15.37:0/2749986050 shutdown_connections 2024-08-20T05:14:11.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.813+0000 7fb9a1800640 1 --2- 172.21.15.37:0/2749986050 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb9800b3c70 0x7fb9800b6130 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.813+0000 7fb9a1800640 1 --2- 172.21.15.37:0/2749986050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb99c10ae90 0x7fb99c1a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.813+0000 7fb9a1800640 1 --2- 172.21.15.37:0/2749986050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb99c10a510 0x7fb99c19b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.813+0000 7fb9a1800640 1 --2- 172.21.15.37:0/2749986050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb99c104b00 0x7fb99c19af70 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:11.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.813+0000 7fb9a1800640 1 -- 172.21.15.37:0/2749986050 >> 172.21.15.37:0/2749986050 conn(0x7fb99c100550 msgr2=0x7fb99c1039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:11.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.813+0000 7fb9a1800640 1 -- 172.21.15.37:0/2749986050 shutdown_connections 2024-08-20T05:14:11.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:11.813+0000 7fb9a1800640 1 -- 172.21.15.37:0/2749986050 wait complete. 2024-08-20T05:14:11.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:11 smithi135 ceph-mon[22342]: pgmap v759: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-08-20T05:14:11.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:11 smithi130 ceph-mon[22007]: pgmap v759: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2024-08-20T05:14:12.834 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T05:14:12.834 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:14:12.942 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:14:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 675.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:14:13.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.523+0000 7f625f800640 1 -- 172.21.15.37:0/2878963536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6258075b30 msgr2=0x7f625810eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:13.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.523+0000 7f625f800640 1 --2- 172.21.15.37:0/2878963536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6258075b30 0x7f625810eb60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6240009860 tx=0x7f624002a340 comp rx=0 tx=0).stop 2024-08-20T05:14:13.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.523+0000 7f625f800640 1 -- 172.21.15.37:0/2878963536 shutdown_connections 2024-08-20T05:14:13.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.523+0000 7f625f800640 1 --2- 172.21.15.37:0/2878963536 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f625810f0a0 0x7f6258111490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.523+0000 7f625f800640 1 --2- 172.21.15.37:0/2878963536 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6258075b30 0x7f625810eb60 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.523+0000 7f625f800640 1 --2- 172.21.15.37:0/2878963536 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6258075210 0x7f62580755f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.523+0000 7f625f800640 1 -- 172.21.15.37:0/2878963536 >> 172.21.15.37:0/2878963536 conn(0x7f62580fe500 msgr2=0x7f6258100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:13.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.523+0000 7f625f800640 1 -- 172.21.15.37:0/2878963536 shutdown_connections 2024-08-20T05:14:13.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.523+0000 7f625f800640 1 -- 172.21.15.37:0/2878963536 wait complete. 2024-08-20T05:14:13.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.524+0000 7f625f800640 1 Processor -- start 2024-08-20T05:14:13.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.525+0000 7f625f800640 1 -- start start 2024-08-20T05:14:13.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.525+0000 7f625f800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6258075210 0x7f625819b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.525+0000 7f625f800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6258075b30 0x7f625819b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.525+0000 7f625f800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f625810f0a0 0x7f62581a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.525+0000 7f625f800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6258114c80 con 0x7f6258075210 2024-08-20T05:14:13.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.525+0000 7f625f800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6258114b00 con 0x7f6258075b30 2024-08-20T05:14:13.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.525+0000 7f625f800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6258114e00 con 0x7f625810f0a0 2024-08-20T05:14:13.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.525+0000 7f625ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6258075210 0x7f625819b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.526+0000 7f624fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6258075b30 0x7f625819b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.526+0000 7f625ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6258075210 0x7f625819b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42030/0 (socket says 172.21.15.37:42030) 2024-08-20T05:14:13.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.526+0000 7f625ce00640 1 -- 172.21.15.37:0/2323758816 learned_addr learned my addr 172.21.15.37:0/2323758816 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:13.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.526+0000 7f625d800640 1 --2- 172.21.15.37:0/2323758816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f625810f0a0 0x7f62581a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.526+0000 7f624fe00640 1 -- 172.21.15.37:0/2323758816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f625810f0a0 msgr2=0x7f62581a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.526+0000 7f624fe00640 1 --2- 172.21.15.37:0/2323758816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f625810f0a0 0x7f62581a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.526+0000 7f624fe00640 1 -- 172.21.15.37:0/2323758816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6258075210 msgr2=0x7f625819b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.526+0000 7f624fe00640 1 --2- 172.21.15.37:0/2323758816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6258075210 0x7f625819b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.526+0000 7f624fe00640 1 -- 172.21.15.37:0/2323758816 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62581a1280 con 0x7f6258075b30 2024-08-20T05:14:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.526+0000 7f625ce00640 1 --2- 172.21.15.37:0/2323758816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6258075210 0x7f625819b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:14:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.526+0000 7f624fe00640 1 --2- 172.21.15.37:0/2323758816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6258075b30 0x7f625819b710 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6240035040 tx=0x7f6240032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.527+0000 7f6256000640 1 -- 172.21.15.37:0/2323758816 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240040020 con 0x7f6258075b30 2024-08-20T05:14:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.527+0000 7f6256000640 1 -- 172.21.15.37:0/2323758816 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6240030e10 con 0x7f6258075b30 2024-08-20T05:14:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.527+0000 7f6256000640 1 -- 172.21.15.37:0/2323758816 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6240037040 con 0x7f6258075b30 2024-08-20T05:14:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.527+0000 7f625f800640 1 -- 172.21.15.37:0/2323758816 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62581a1510 con 0x7f6258075b30 2024-08-20T05:14:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.527+0000 7f625f800640 1 -- 172.21.15.37:0/2323758816 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62581a7c30 con 0x7f6258075b30 2024-08-20T05:14:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.530+0000 7f626240e740 1 Processor -- start 2024-08-20T05:14:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.530+0000 7f626240e740 1 -- start start 2024-08-20T05:14:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.531+0000 7f626240e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513dfcf0 0x55ac513e00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.531+0000 7f626240e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513e0610 0x55ac513f4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.531+0000 7f626240e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513f4db0 0x55ac513f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.531+0000 7f626240e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ac51381670 con 0x55ac513f4db0 2024-08-20T05:14:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.531+0000 7f626240e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ac51355d70 con 0x55ac513e0610 2024-08-20T05:14:13.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.531+0000 7f626240e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ac51345270 con 0x55ac513dfcf0 2024-08-20T05:14:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.531+0000 7f625d800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513dfcf0 0x55ac513e00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.531+0000 7f625d800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513dfcf0 0x55ac513e00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42564/0 (socket says 172.21.15.37:42564) 2024-08-20T05:14:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.531+0000 7f625d800640 1 -- 172.21.15.37:0/1308691936 learned_addr learned my addr 172.21.15.37:0/1308691936 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.531+0000 7f6256000640 1 -- 172.21.15.37:0/2323758816 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6240043020 con 0x7f6258075b30 2024-08-20T05:14:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.531+0000 7f625ce00640 1 --2- 172.21.15.37:0/1308691936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513e0610 0x55ac513f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.531+0000 7f624fe00640 1 --2- 172.21.15.37:0/1308691936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513f4db0 0x55ac513f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.531+0000 7f625d800640 1 -- 172.21.15.37:0/1308691936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513e0610 msgr2=0x55ac513f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.531+0000 7f625d800640 1 --2- 172.21.15.37:0/1308691936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513e0610 0x55ac513f4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.531+0000 7f625d800640 1 -- 172.21.15.37:0/1308691936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513f4db0 msgr2=0x55ac513f71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.531+0000 7f625d800640 1 --2- 172.21.15.37:0/1308691936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513f4db0 0x55ac513f71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.532+0000 7f625d800640 1 -- 172.21.15.37:0/1308691936 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac512e1870 con 0x55ac513dfcf0 2024-08-20T05:14:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.532+0000 7f624fe00640 1 --2- 172.21.15.37:0/1308691936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513f4db0 0x55ac513f71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:14:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.532+0000 7f625d800640 1 --2- 172.21.15.37:0/1308691936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513dfcf0 0x55ac513e00d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f625000e450 tx=0x7f62500095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=858a2ad1cddbe994 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.532+0000 7f624e000640 1 -- 172.21.15.37:0/1308691936 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6250003970 con 0x55ac513dfcf0 2024-08-20T05:14:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.532+0000 7f624e000640 1 -- 172.21.15.37:0/1308691936 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f625000d710 con 0x55ac513dfcf0 2024-08-20T05:14:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.532+0000 7f624e000640 1 -- 172.21.15.37:0/1308691936 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62500043e0 con 0x55ac513dfcf0 2024-08-20T05:14:13.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.533+0000 7f626240e740 1 -- 172.21.15.37:0/1308691936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513dfcf0 msgr2=0x55ac513e00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:13.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.533+0000 7f626240e740 1 --2- 172.21.15.37:0/1308691936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513dfcf0 0x55ac513e00d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f625000e450 tx=0x7f62500095c0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.533+0000 7f626240e740 1 -- 172.21.15.37:0/1308691936 shutdown_connections 2024-08-20T05:14:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.533+0000 7f626240e740 1 --2- 172.21.15.37:0/1308691936 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513f4db0 0x55ac513f71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.533+0000 7f626240e740 1 --2- 172.21.15.37:0/1308691936 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513e0610 0x55ac513f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.533+0000 7f626240e740 1 --2- 172.21.15.37:0/1308691936 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513dfcf0 0x55ac513e00d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.533+0000 7f626240e740 1 -- 172.21.15.37:0/1308691936 >> 172.21.15.37:0/1308691936 conn(0x55ac513ddb20 msgr2=0x55ac513decc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.533+0000 7f626240e740 1 -- 172.21.15.37:0/1308691936 shutdown_connections 2024-08-20T05:14:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.533+0000 7f626240e740 1 -- 172.21.15.37:0/1308691936 wait complete. 2024-08-20T05:14:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.534+0000 7f626240e740 1 -- start start 2024-08-20T05:14:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.534+0000 7f6256000640 1 --2- 172.21.15.37:0/2323758816 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f623c0b3bf0 0x7f623c0b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.534+0000 7f626240e740 1 Processor -- start 2024-08-20T05:14:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.534+0000 7f6256000640 1 -- 172.21.15.37:0/2323758816 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6240103b40 con 0x7f6258075b30 2024-08-20T05:14:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.535+0000 7f625d800640 1 --2- 172.21.15.37:0/2323758816 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f623c0b3bf0 0x7f623c0b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.535+0000 7f626240e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513dfcf0 0x55ac513e97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.535+0000 7f626240e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513e0610 0x55ac513e9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.535+0000 7f626240e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513f4db0 0x55ac513f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.535+0000 7f626240e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ac512cbff0 con 0x55ac513f4db0 2024-08-20T05:14:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.535+0000 7f626240e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ac513492b0 con 0x55ac513e0610 2024-08-20T05:14:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.535+0000 7f626240e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ac511a7bb0 con 0x55ac513dfcf0 2024-08-20T05:14:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.536+0000 7f626240e740 10 client.0 _ll_register_callbacks cb 0x55ac51050d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.536+0000 7f624fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513e0610 0x55ac513e9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.536+0000 7f625ce00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513dfcf0 0x55ac513e97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.536+0000 7f625ce00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513dfcf0 0x55ac513e97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42574/0 (socket says 172.21.15.37:42574) 2024-08-20T05:14:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.536+0000 7f625ce00640 1 -- 172.21.15.37:0/428887891 learned_addr learned my addr 172.21.15.37:0/428887891 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.536+0000 7f625d800640 1 --2- 172.21.15.37:0/428887891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513f4db0 0x55ac513f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.536+0000 7f625ce00640 1 -- 172.21.15.37:0/428887891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513e0610 msgr2=0x55ac513e9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.536+0000 7f625ce00640 1 --2- 172.21.15.37:0/428887891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513e0610 0x55ac513e9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.536+0000 7f625ce00640 1 -- 172.21.15.37:0/428887891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513f4db0 msgr2=0x55ac513f3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.536+0000 7f625ce00640 1 --2- 172.21.15.37:0/428887891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513f4db0 0x55ac513f3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.536+0000 7f625ce00640 1 -- 172.21.15.37:0/428887891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac510a4b00 con 0x55ac513dfcf0 2024-08-20T05:14:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.536+0000 7f625d800640 1 --2- 172.21.15.37:0/428887891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513f4db0 0x55ac513f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:14:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.537+0000 7f625ce00640 1 --2- 172.21.15.37:0/428887891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513dfcf0 0x55ac513e97b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6248012d20 tx=0x7f624800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0f74fdc155e627d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.537+0000 7f6246a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:14:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.537+0000 7f625d800640 1 --2- 172.21.15.37:0/2323758816 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f623c0b3bf0 0x7f623c0b60b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6250009e20 tx=0x7f6250005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.537+0000 7f6246a00640 1 -- 172.21.15.37:0/428887891 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62480120d0 con 0x55ac513dfcf0 2024-08-20T05:14:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.537+0000 7f626240e740 1 -- 172.21.15.37:0/428887891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f625000d710 con 0x55ac513dfcf0 2024-08-20T05:14:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.537+0000 7f6246a00640 1 -- 172.21.15.37:0/428887891 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6248010430 con 0x55ac513dfcf0 2024-08-20T05:14:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.537+0000 7f6246a00640 1 -- 172.21.15.37:0/428887891 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f6248012270 con 0x55ac513dfcf0 2024-08-20T05:14:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.537+0000 7f626240e740 10 client.28396 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.537+0000 7f626240e740 1 -- 172.21.15.37:0/428887891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55ac5111b960 con 0x55ac513dfcf0 2024-08-20T05:14:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.538+0000 7f6246a00640 1 -- 172.21.15.37:0/428887891 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f625000d710 con 0x55ac513dfcf0 2024-08-20T05:14:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.538+0000 7f6246a00640 1 -- 172.21.15.37:0/428887891 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f624801c7c0 con 0x55ac513dfcf0 2024-08-20T05:14:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.538+0000 7f626240e740 10 client.28396 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.538+0000 7f626240e740 10 client.28396 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:14:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.538+0000 7f626240e740 20 client.28396 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.538+0000 7f626240e740 1 --2- 172.21.15.37:0/428887891 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ac513fbb90 0x55ac513fdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.538+0000 7f626240e740 4 client.28396 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:14:13.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.538+0000 7f626240e740 1 -- 172.21.15.37:0/428887891 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac51357cc0 con 0x55ac513fbb90 2024-08-20T05:14:13.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.539+0000 7f624fe00640 1 --2- 172.21.15.37:0/428887891 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ac513fbb90 0x55ac513fdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.539+0000 7f6246a00640 10 client.28396 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:13.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.539+0000 7f624fe00640 1 --2- 172.21.15.37:0/428887891 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ac513fbb90 0x55ac513fdfa0 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc638aba24c6fbf7 server_cookie=25abb264bfeba87d in_seq=0 out_seq=0 2024-08-20T05:14:13.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.540+0000 7f6246a00640 1 -- 172.21.15.37:0/428887891 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ac51357cc0 con 0x55ac513fbb90 2024-08-20T05:14:13.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.540+0000 7f6246a00640 10 client.28396 handle_command_reply: tid=0 2024-08-20T05:14:13.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.540+0000 7f626240e740 1 client.28396 shutdown 2024-08-20T05:14:13.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.540+0000 7f626240e740 1 -- 172.21.15.37:0/428887891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513dfcf0 msgr2=0x55ac513e97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:13.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.540+0000 7f626240e740 1 --2- 172.21.15.37:0/428887891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513dfcf0 0x55ac513e97b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f6248012d20 tx=0x7f624800f790 comp rx=0 tx=0).stop 2024-08-20T05:14:13.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.540+0000 7f626240e740 1 -- 172.21.15.37:0/428887891 shutdown_connections 2024-08-20T05:14:13.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.540+0000 7f626240e740 1 --2- 172.21.15.37:0/428887891 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ac513fbb90 0x55ac513fdfa0 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.540+0000 7f626240e740 1 --2- 172.21.15.37:0/428887891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513f4db0 0x55ac513f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.540+0000 7f626240e740 1 --2- 172.21.15.37:0/428887891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513e0610 0x55ac513e9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.540+0000 7f626240e740 1 --2- 172.21.15.37:0/428887891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513dfcf0 0x55ac513e97b0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.540+0000 7f626240e740 1 -- 172.21.15.37:0/428887891 >> 172.21.15.37:0/428887891 conn(0x55ac513ddb20 msgr2=0x55ac513e36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:13.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.540+0000 7f6246a00640 0 client.28396 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:13.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.541+0000 7f626240e740 1 -- 172.21.15.37:0/428887891 shutdown_connections 2024-08-20T05:14:13.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.541+0000 7f626240e740 1 -- 172.21.15.37:0/428887891 wait complete. 2024-08-20T05:14:13.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.541+0000 7f626240e740 20 client.28396 trim_cache size 0 max 16384 2024-08-20T05:14:13.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.561+0000 7f626240e740 1 Processor -- start 2024-08-20T05:14:13.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.561+0000 7f626240e740 1 -- start start 2024-08-20T05:14:13.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.561+0000 7f626240e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513dfcf0 0x55ac513e1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.561+0000 7f626240e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513e0610 0x55ac513e2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.561+0000 7f626240e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513f4db0 0x55ac514038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.561+0000 7f626240e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f62581be610 con 0x55ac513dfcf0 2024-08-20T05:14:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.561+0000 7f626240e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f62581c0150 con 0x55ac513e0610 2024-08-20T05:14:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.561+0000 7f626240e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f62581bece0 con 0x55ac513f4db0 2024-08-20T05:14:13.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.561+0000 7f625ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513dfcf0 0x55ac513e1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.562+0000 7f625ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513dfcf0 0x55ac513e1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42062/0 (socket says 172.21.15.37:42062) 2024-08-20T05:14:13.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.562+0000 7f625ce00640 1 -- 172.21.15.37:0/2666603687 learned_addr learned my addr 172.21.15.37:0/2666603687 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:13.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.562+0000 7f624fe00640 1 --2- 172.21.15.37:0/2666603687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513e0610 0x55ac513e2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.562+0000 7f625d800640 1 --2- 172.21.15.37:0/2666603687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513f4db0 0x55ac514038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.562+0000 7f624fe00640 1 -- 172.21.15.37:0/2666603687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513f4db0 msgr2=0x55ac514038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.562+0000 7f624fe00640 1 --2- 172.21.15.37:0/2666603687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513f4db0 0x55ac514038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.562+0000 7f624fe00640 1 -- 172.21.15.37:0/2666603687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513dfcf0 msgr2=0x55ac513e1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.562+0000 7f624fe00640 1 --2- 172.21.15.37:0/2666603687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513dfcf0 0x55ac513e1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.562+0000 7f624fe00640 1 -- 172.21.15.37:0/2666603687 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac513ea0a0 con 0x55ac513e0610 2024-08-20T05:14:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.562+0000 7f625ce00640 1 --2- 172.21.15.37:0/2666603687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513dfcf0 0x55ac513e1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:14:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.562+0000 7f624fe00640 1 --2- 172.21.15.37:0/2666603687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513e0610 0x55ac513e2290 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55ac513dfca0 tx=0x7f6240004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f28f21fddbc8985d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.563+0000 7f624d600640 1 -- 172.21.15.37:0/2666603687 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62400ca690 con 0x55ac513e0610 2024-08-20T05:14:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.563+0000 7f624d600640 1 -- 172.21.15.37:0/2666603687 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62400cec90 con 0x55ac513e0610 2024-08-20T05:14:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.563+0000 7f624d600640 1 -- 172.21.15.37:0/2666603687 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62400c6920 con 0x55ac513e0610 2024-08-20T05:14:13.566 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:14:13.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.563+0000 7f626240e740 1 -- 172.21.15.37:0/2666603687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513e0610 msgr2=0x55ac513e2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:13.568 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.563+0000 7f626240e740 1 --2- 172.21.15.37:0/2666603687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513e0610 0x55ac513e2290 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x55ac513dfca0 tx=0x7f6240004610 comp rx=0 tx=0).stop 2024-08-20T05:14:13.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.563+0000 7f626240e740 1 -- 172.21.15.37:0/2666603687 shutdown_connections 2024-08-20T05:14:13.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.563+0000 7f626240e740 1 --2- 172.21.15.37:0/2666603687 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513f4db0 0x55ac514038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.563+0000 7f626240e740 1 --2- 172.21.15.37:0/2666603687 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513e0610 0x55ac513e2290 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.563+0000 7f626240e740 1 --2- 172.21.15.37:0/2666603687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513dfcf0 0x55ac513e1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.563+0000 7f626240e740 1 -- 172.21.15.37:0/2666603687 >> 172.21.15.37:0/2666603687 conn(0x55ac513ddb20 msgr2=0x55ac513f6b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:13.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.564+0000 7f626240e740 1 -- 172.21.15.37:0/2666603687 shutdown_connections 2024-08-20T05:14:13.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.564+0000 7f626240e740 1 -- 172.21.15.37:0/2666603687 wait complete. 2024-08-20T05:14:13.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.564+0000 7f626240e740 1 -- start start 2024-08-20T05:14:13.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.564+0000 7f626240e740 1 Processor -- start 2024-08-20T05:14:13.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.565+0000 7f626240e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513dfcf0 0x55ac5140f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.565+0000 7f626240e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513e0610 0x55ac5140fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.565+0000 7f626240e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513f4db0 0x55ac5140c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.565+0000 7f626240e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f62581bfa80 con 0x55ac513dfcf0 2024-08-20T05:14:13.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.565+0000 7f626240e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f62581bf3b0 con 0x55ac513f4db0 2024-08-20T05:14:13.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.565+0000 7f626240e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f62581bc630 con 0x55ac513e0610 2024-08-20T05:14:13.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.565+0000 7f626240e740 10 client.0 _ll_register_callbacks cb 0x7f6248009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:13.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.565+0000 7f625ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513dfcf0 0x55ac5140f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.565+0000 7f625ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513dfcf0 0x55ac5140f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42064/0 (socket says 172.21.15.37:42064) 2024-08-20T05:14:13.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.565+0000 7f625ce00640 1 -- 172.21.15.37:0/3850140298 learned_addr learned my addr 172.21.15.37:0/3850140298 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:13.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.565+0000 7f625d800640 1 --2- 172.21.15.37:0/3850140298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513f4db0 0x55ac5140c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.565+0000 7f624fe00640 1 --2- 172.21.15.37:0/3850140298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513e0610 0x55ac5140fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.566+0000 7f625ce00640 1 -- 172.21.15.37:0/3850140298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513e0610 msgr2=0x55ac5140fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:13.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.566+0000 7f625ce00640 1 --2- 172.21.15.37:0/3850140298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513e0610 0x55ac5140fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.566+0000 7f625ce00640 1 -- 172.21.15.37:0/3850140298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513f4db0 msgr2=0x55ac5140c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:13.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.566+0000 7f625ce00640 1 --2- 172.21.15.37:0/3850140298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513f4db0 0x55ac5140c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.566+0000 7f625ce00640 1 -- 172.21.15.37:0/3850140298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac5140caf0 con 0x55ac513dfcf0 2024-08-20T05:14:13.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.566+0000 7f625ce00640 1 --2- 172.21.15.37:0/3850140298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513dfcf0 0x55ac5140f5e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6248009560 tx=0x7f6248009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476cb5294621a8b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:13.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.566+0000 7f6246a00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:14:13.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.566+0000 7f6246a00640 1 -- 172.21.15.37:0/3850140298 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624801c420 con 0x55ac513dfcf0 2024-08-20T05:14:13.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.566+0000 7f6246a00640 1 -- 172.21.15.37:0/3850140298 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f624801c5c0 con 0x55ac513dfcf0 2024-08-20T05:14:13.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.566+0000 7f626240e740 1 -- 172.21.15.37:0/3850140298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62400cec90 con 0x55ac513dfcf0 2024-08-20T05:14:13.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.566+0000 7f6246a00640 1 -- 172.21.15.37:0/3850140298 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f6248038050 con 0x55ac513dfcf0 2024-08-20T05:14:13.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.567+0000 7f626240e740 10 client.17796 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:13.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.567+0000 7f626240e740 1 -- 172.21.15.37:0/3850140298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55ac51466f90 con 0x55ac513dfcf0 2024-08-20T05:14:13.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.567+0000 7f6246a00640 1 -- 172.21.15.37:0/3850140298 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62400cec90 con 0x55ac513dfcf0 2024-08-20T05:14:13.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.567+0000 7f6246a00640 1 -- 172.21.15.37:0/3850140298 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f624801b530 con 0x55ac513dfcf0 2024-08-20T05:14:13.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.567+0000 7f626240e740 10 client.17796 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:13.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.567+0000 7f626240e740 10 client.17796 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:14:13.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.567+0000 7f626240e740 20 client.17796 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:13.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.567+0000 7f626240e740 1 --2- 172.21.15.37:0/3850140298 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ac514677c0 0x55ac51469be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:13.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.567+0000 7f626240e740 4 client.17796 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1119eaf7", "release": true, "await": true}] 2024-08-20T05:14:13.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.567+0000 7f626240e740 1 -- 172.21.15.37:0/3850140298 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1119eaf7", "release": true, "await": true}) -- 0x55ac51353760 con 0x55ac514677c0 2024-08-20T05:14:13.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.568+0000 7f624fe00640 1 --2- 172.21.15.37:0/3850140298 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ac514677c0 0x55ac51469be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:13.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.568+0000 7f624fe00640 1 --2- 172.21.15.37:0/3850140298 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ac514677c0 0x55ac51469be0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5fada73184f59cf server_cookie=bd6bbe27e3763f0d in_seq=0 out_seq=0 2024-08-20T05:14:13.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.568+0000 7f6246a00640 10 client.17796 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:13.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.607+0000 7f6246a00640 1 -- 172.21.15.37:0/3850140298 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ac51353760 con 0x55ac514677c0 2024-08-20T05:14:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.607+0000 7f6246a00640 10 client.17796 handle_command_reply: tid=0 2024-08-20T05:14:13.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.607+0000 7f626240e740 1 client.17796 shutdown 2024-08-20T05:14:13.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.611+0000 7f626240e740 1 -- 172.21.15.37:0/3850140298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513dfcf0 msgr2=0x55ac5140f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.611+0000 7f626240e740 1 --2- 172.21.15.37:0/3850140298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513dfcf0 0x55ac5140f5e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6248009560 tx=0x7f6248009590 comp rx=0 tx=0).stop 2024-08-20T05:14:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.611+0000 7f626240e740 1 -- 172.21.15.37:0/3850140298 shutdown_connections 2024-08-20T05:14:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.611+0000 7f626240e740 1 --2- 172.21.15.37:0/3850140298 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55ac514677c0 0x55ac51469be0 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.611+0000 7f626240e740 1 --2- 172.21.15.37:0/3850140298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ac513f4db0 0x55ac5140c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.611+0000 7f626240e740 1 --2- 172.21.15.37:0/3850140298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ac513e0610 0x55ac5140fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.611+0000 7f626240e740 1 --2- 172.21.15.37:0/3850140298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ac513dfcf0 0x55ac5140f5e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.611+0000 7f626240e740 1 -- 172.21.15.37:0/3850140298 >> 172.21.15.37:0/3850140298 conn(0x55ac513ddb20 msgr2=0x55ac513dc420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.611+0000 7f6246a00640 0 client.17796 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.612+0000 7f626240e740 1 -- 172.21.15.37:0/3850140298 shutdown_connections 2024-08-20T05:14:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.612+0000 7f626240e740 1 -- 172.21.15.37:0/3850140298 wait complete. 2024-08-20T05:14:13.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.613+0000 7f626240e740 20 client.17796 trim_cache size 0 max 16384 2024-08-20T05:14:13.615 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:14:13.615 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 48, 2024-08-20T05:14:13.615 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:14:13.615 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 44, 2024-08-20T05:14:13.616 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:14:13.616 INFO:teuthology.orchestra.run.smithi037.stdout: "1119eaf7": { 2024-08-20T05:14:13.616 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 44, 2024-08-20T05:14:13.616 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:14:13.616 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:14:13.616 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:14:13.616 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:14:13.616 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:14:13.616 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:14:13.616 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 143.3, 2024-08-20T05:14:13.616 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:14:13.616 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:14:13.616 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:14:13.617 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:14:13.617 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:14:13.617 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:14:13.617 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:14:13.617 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:14:13.617 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:14:13.617 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:14:13.617 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:14:13.617 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:14:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.616+0000 7f625f800640 1 -- 172.21.15.37:0/2323758816 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f623c0b3bf0 msgr2=0x7f623c0b60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.616+0000 7f625f800640 1 --2- 172.21.15.37:0/2323758816 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f623c0b3bf0 0x7f623c0b60b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f6250009e20 tx=0x7f6250005fd0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.616+0000 7f625f800640 1 -- 172.21.15.37:0/2323758816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6258075b30 msgr2=0x7f625819b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.616+0000 7f625f800640 1 --2- 172.21.15.37:0/2323758816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6258075b30 0x7f625819b710 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6240035040 tx=0x7f6240032d50 comp rx=0 tx=0).stop 2024-08-20T05:14:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.616+0000 7f625f800640 1 -- 172.21.15.37:0/2323758816 shutdown_connections 2024-08-20T05:14:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.616+0000 7f625f800640 1 --2- 172.21.15.37:0/2323758816 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f623c0b3bf0 0x7f623c0b60b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.616+0000 7f625f800640 1 --2- 172.21.15.37:0/2323758816 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f625810f0a0 0x7f62581a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.616+0000 7f625f800640 1 --2- 172.21.15.37:0/2323758816 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6258075b30 0x7f625819b710 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.616+0000 7f625f800640 1 --2- 172.21.15.37:0/2323758816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6258075210 0x7f625819b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:13.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.616+0000 7f625f800640 1 -- 172.21.15.37:0/2323758816 >> 172.21.15.37:0/2323758816 conn(0x7f62580fe500 msgr2=0x7f62580ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:13.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.617+0000 7f625f800640 1 -- 172.21.15.37:0/2323758816 shutdown_connections 2024-08-20T05:14:13.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:13.617+0000 7f625f800640 1 -- 172.21.15.37:0/2323758816 wait complete. 2024-08-20T05:14:13.651 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:13 smithi037 ceph-mon[17265]: pgmap v760: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-08-20T05:14:13.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:13 smithi135 ceph-mon[22342]: pgmap v760: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-08-20T05:14:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:13 smithi130 ceph-mon[22007]: pgmap v760: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.6 KiB/s wr, 11 op/s 2024-08-20T05:14:14.625 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1119eaf7', total seconds elapsed: 29.7 2024-08-20T05:14:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.186+0000 7efdff600640 1 -- 172.21.15.37:0/1841720250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdf00a4790 msgr2=0x7efdf00a4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.186+0000 7efdff600640 1 --2- 172.21.15.37:0/1841720250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdf00a4790 0x7efdf00a4b70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7efdec01a940 tx=0x7efdec03b520 comp rx=0 tx=0).stop 2024-08-20T05:14:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.186+0000 7efdff600640 1 -- 172.21.15.37:0/1841720250 shutdown_connections 2024-08-20T05:14:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.186+0000 7efdff600640 1 --2- 172.21.15.37:0/1841720250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdf00b74b0 0x7efdf00b98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.186+0000 7efdff600640 1 --2- 172.21.15.37:0/1841720250 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdf00a50b0 0x7efdf00b6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.186+0000 7efdff600640 1 --2- 172.21.15.37:0/1841720250 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdf00a4790 0x7efdf00a4b70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.186+0000 7efdff600640 1 -- 172.21.15.37:0/1841720250 >> 172.21.15.37:0/1841720250 conn(0x7efdf001a040 msgr2=0x7efdf001c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.186+0000 7efdff600640 1 -- 172.21.15.37:0/1841720250 shutdown_connections 2024-08-20T05:14:15.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.186+0000 7efdff600640 1 -- 172.21.15.37:0/1841720250 wait complete. 2024-08-20T05:14:15.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.187+0000 7efdff600640 1 Processor -- start 2024-08-20T05:14:15.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.188+0000 7efdff600640 1 -- start start 2024-08-20T05:14:15.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.188+0000 7efdff600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdf00a4790 0x7efdf00b69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:15.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.188+0000 7efdff600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdf00a50b0 0x7efdf00b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:15.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.188+0000 7efdff600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdf00b74b0 0x7efdf00b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:15.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.189+0000 7efdfd600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdf00b74b0 0x7efdf00b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:15.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.189+0000 7efdfd600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdf00b74b0 0x7efdf00b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42618/0 (socket says 172.21.15.37:42618) 2024-08-20T05:14:15.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.189+0000 7efdfcc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdf00a4790 0x7efdf00b69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:15.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.189+0000 7efdfcc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdf00a4790 0x7efdf00b69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:38390/0 (socket says 172.21.15.37:38390) 2024-08-20T05:14:15.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.189+0000 7efdfd600640 1 -- 172.21.15.37:0/3350691495 learned_addr learned my addr 172.21.15.37:0/3350691495 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:15.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.189+0000 7efdff600640 1 -- 172.21.15.37:0/3350691495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efdf00af030 con 0x7efdf00a50b0 2024-08-20T05:14:15.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.189+0000 7efdff600640 1 -- 172.21.15.37:0/3350691495 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7efdf00aeeb0 con 0x7efdf00a4790 2024-08-20T05:14:15.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.189+0000 7efdff600640 1 -- 172.21.15.37:0/3350691495 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7efdf00af1b0 con 0x7efdf00b74b0 2024-08-20T05:14:15.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.189+0000 7efdf7e00640 1 --2- 172.21.15.37:0/3350691495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdf00a50b0 0x7efdf00b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:15.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.190+0000 7efdfd600640 1 -- 172.21.15.37:0/3350691495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdf00a4790 msgr2=0x7efdf00b69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:15.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.190+0000 7efdfd600640 1 --2- 172.21.15.37:0/3350691495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdf00a4790 0x7efdf00b69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:15.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.190+0000 7efdfd600640 1 -- 172.21.15.37:0/3350691495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdf00a50b0 msgr2=0x7efdf00b6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:15.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.190+0000 7efdfd600640 1 --2- 172.21.15.37:0/3350691495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdf00a50b0 0x7efdf00b6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:15.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.190+0000 7efdfd600640 1 -- 172.21.15.37:0/3350691495 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdf00b3740 con 0x7efdf00b74b0 2024-08-20T05:14:15.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.190+0000 7efdfd600640 1 --2- 172.21.15.37:0/3350691495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdf00b74b0 0x7efdf00b2e80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7efdf80519c0 tx=0x7efdf80749c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:15.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.191+0000 7efdf5600640 1 -- 172.21.15.37:0/3350691495 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf807a070 con 0x7efdf00b74b0 2024-08-20T05:14:15.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.191+0000 7efdf5600640 1 -- 172.21.15.37:0/3350691495 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efdf8075420 con 0x7efdf00b74b0 2024-08-20T05:14:15.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.191+0000 7efdf5600640 1 -- 172.21.15.37:0/3350691495 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf8072610 con 0x7efdf00b74b0 2024-08-20T05:14:15.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.191+0000 7efdff600640 1 -- 172.21.15.37:0/3350691495 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdf00b3a30 con 0x7efdf00b74b0 2024-08-20T05:14:15.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.192+0000 7efdff600640 1 -- 172.21.15.37:0/3350691495 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdf0147660 con 0x7efdf00b74b0 2024-08-20T05:14:15.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.195+0000 7efdff600640 1 -- 172.21.15.37:0/3350691495 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdf00a4b70 con 0x7efdf00b74b0 2024-08-20T05:14:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.199+0000 7efdf5600640 1 -- 172.21.15.37:0/3350691495 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7efdf807d070 con 0x7efdf00b74b0 2024-08-20T05:14:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.201+0000 7efdf5600640 1 --2- 172.21.15.37:0/3350691495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efde00b3c90 0x7efde00b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:15.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.202+0000 7efdf5600640 1 -- 172.21.15.37:0/3350691495 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7efdf81487f0 con 0x7efdf00b74b0 2024-08-20T05:14:15.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.205+0000 7efdfcc00640 1 --2- 172.21.15.37:0/3350691495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efde00b3c90 0x7efde00b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:15.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.205+0000 7efdf5600640 1 -- 172.21.15.37:0/3350691495 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7efdf00b3a30 con 0x7efdf00b74b0 2024-08-20T05:14:15.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.206+0000 7efdfcc00640 1 --2- 172.21.15.37:0/3350691495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efde00b3c90 0x7efde00b6150 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efdec006010 tx=0x7efdec000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:15.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.660+0000 7efdff600640 1 -- 172.21.15.37:0/3350691495 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efdf0147a80 con 0x7efdf00b74b0 2024-08-20T05:14:15.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.661+0000 7efdf5600640 1 -- 172.21.15.37:0/3350691495 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+11980 (secure 0 0 0) 0x7efdf810faa0 con 0x7efdf00b74b0 2024-08-20T05:14:15.662 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:14:15.662 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":48,"btime":"2024-08-20T05:13:44:512025+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":48,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:13:43.851787+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:14:15.662 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 48 2024-08-20T05:14:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.664+0000 7efdff600640 1 -- 172.21.15.37:0/3350691495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efde00b3c90 msgr2=0x7efde00b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.664+0000 7efdff600640 1 --2- 172.21.15.37:0/3350691495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efde00b3c90 0x7efde00b6150 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efdec006010 tx=0x7efdec000bc0 comp rx=0 tx=0).stop 2024-08-20T05:14:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.664+0000 7efdff600640 1 -- 172.21.15.37:0/3350691495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdf00b74b0 msgr2=0x7efdf00b2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.664+0000 7efdff600640 1 --2- 172.21.15.37:0/3350691495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdf00b74b0 0x7efdf00b2e80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7efdf80519c0 tx=0x7efdf80749c0 comp rx=0 tx=0).stop 2024-08-20T05:14:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.664+0000 7efdff600640 1 -- 172.21.15.37:0/3350691495 shutdown_connections 2024-08-20T05:14:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.664+0000 7efdff600640 1 --2- 172.21.15.37:0/3350691495 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7efde00b3c90 0x7efde00b6150 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.664+0000 7efdff600640 1 --2- 172.21.15.37:0/3350691495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7efdf00b74b0 0x7efdf00b2e80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.664+0000 7efdff600640 1 --2- 172.21.15.37:0/3350691495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdf00a50b0 0x7efdf00b6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.664+0000 7efdff600640 1 --2- 172.21.15.37:0/3350691495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7efdf00a4790 0x7efdf00b69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.664+0000 7efdff600640 1 -- 172.21.15.37:0/3350691495 >> 172.21.15.37:0/3350691495 conn(0x7efdf001a040 msgr2=0x7efdf00b79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.664+0000 7efdff600640 1 -- 172.21.15.37:0/3350691495 shutdown_connections 2024-08-20T05:14:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:15.664+0000 7efdff600640 1 -- 172.21.15.37:0/3350691495 wait complete. 2024-08-20T05:14:15.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:15 smithi037 ceph-mon[17265]: pgmap v761: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-08-20T05:14:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:15 smithi135 ceph-mon[22342]: pgmap v761: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-08-20T05:14:15.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:15 smithi130 ceph-mon[22007]: pgmap v761: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 45 KiB/s wr, 19 op/s 2024-08-20T05:14:16.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:16 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3350691495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:14:16.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:16 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3350691495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:14:16.918 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T05:14:16.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:16 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3350691495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:14:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:14:17.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:17 smithi037 ceph-mon[17265]: pgmap v762: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 652 KiB/s wr, 53 op/s 2024-08-20T05:14:17.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:17 smithi135 ceph-mon[22342]: pgmap v762: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 652 KiB/s wr, 53 op/s 2024-08-20T05:14:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:17 smithi130 ceph-mon[22007]: pgmap v762: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 652 KiB/s wr, 53 op/s 2024-08-20T05:14:18.040 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 680.0 s, 470.1 tps, lat 1182.938 ms stddev 4750.143 2024-08-20T05:14:19.191 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:14:19.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.399+0000 7f1b8de00640 1 -- 172.21.15.37:0/1052180787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b8810a510 msgr2=0x7f1b8810a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:19.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.399+0000 7f1b8de00640 1 --2- 172.21.15.37:0/1052180787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b8810a510 0x7f1b8810a950 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f1b74009900 tx=0x7f1b7402a410 comp rx=0 tx=0).stop 2024-08-20T05:14:19.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.399+0000 7f1b8de00640 1 -- 172.21.15.37:0/1052180787 shutdown_connections 2024-08-20T05:14:19.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.399+0000 7f1b8de00640 1 --2- 172.21.15.37:0/1052180787 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8810ae90 0x7f1b88111690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.399+0000 7f1b8de00640 1 --2- 172.21.15.37:0/1052180787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b8810a510 0x7f1b8810a950 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.399+0000 7f1b8de00640 1 --2- 172.21.15.37:0/1052180787 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b88104b00 0x7f1b88104ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.399+0000 7f1b8de00640 1 -- 172.21.15.37:0/1052180787 >> 172.21.15.37:0/1052180787 conn(0x7f1b88100550 msgr2=0x7f1b88102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:19.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.400+0000 7f1b8de00640 1 -- 172.21.15.37:0/1052180787 shutdown_connections 2024-08-20T05:14:19.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.400+0000 7f1b8de00640 1 -- 172.21.15.37:0/1052180787 wait complete. 2024-08-20T05:14:19.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.401+0000 7f1b8de00640 1 Processor -- start 2024-08-20T05:14:19.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.401+0000 7f1b8de00640 1 -- start start 2024-08-20T05:14:19.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.401+0000 7f1b8de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b88104b00 0x7f1b8819af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.401+0000 7f1b8de00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b8810a510 0x7f1b8819b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.401+0000 7f1b8de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8810ae90 0x7f1b881a0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.401+0000 7f1b8de00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1b88114ba0 con 0x7f1b8810a510 2024-08-20T05:14:19.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.401+0000 7f1b8de00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1b88114a20 con 0x7f1b88104b00 2024-08-20T05:14:19.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.401+0000 7f1b8de00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1b88114d20 con 0x7f1b8810ae90 2024-08-20T05:14:19.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.401+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b8810a510 0x7f1b8819b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:19.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.402+0000 7f1b87e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b8810a510 0x7f1b8819b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42090/0 (socket says 172.21.15.37:42090) 2024-08-20T05:14:19.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.402+0000 7f1b87e00640 1 -- 172.21.15.37:0/123153864 learned_addr learned my addr 172.21.15.37:0/123153864 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:19.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.402+0000 7f1b8ca00640 1 --2- 172.21.15.37:0/123153864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b88104b00 0x7f1b8819af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:19.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.402+0000 7f1b8d400640 1 --2- 172.21.15.37:0/123153864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8810ae90 0x7f1b881a0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:19.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.402+0000 7f1b87e00640 1 -- 172.21.15.37:0/123153864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8810ae90 msgr2=0x7f1b881a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:19.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.402+0000 7f1b87e00640 1 --2- 172.21.15.37:0/123153864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8810ae90 0x7f1b881a0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.402+0000 7f1b87e00640 1 -- 172.21.15.37:0/123153864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b88104b00 msgr2=0x7f1b8819af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:19.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.402+0000 7f1b87e00640 1 --2- 172.21.15.37:0/123153864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b88104b00 0x7f1b8819af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.402+0000 7f1b87e00640 1 -- 172.21.15.37:0/123153864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b881a1000 con 0x7f1b8810a510 2024-08-20T05:14:19.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.402+0000 7f1b87e00640 1 --2- 172.21.15.37:0/123153864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b8810a510 0x7f1b8819b490 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1b74005ab0 tx=0x7f1b74003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:19.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.403+0000 7f1b85600640 1 -- 172.21.15.37:0/123153864 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7403f070 con 0x7f1b8810a510 2024-08-20T05:14:19.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.403+0000 7f1b85600640 1 -- 172.21.15.37:0/123153864 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b74031d60 con 0x7f1b8810a510 2024-08-20T05:14:19.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.403+0000 7f1b8de00640 1 -- 172.21.15.37:0/123153864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b881a1290 con 0x7f1b8810a510 2024-08-20T05:14:19.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.403+0000 7f1b85600640 1 -- 172.21.15.37:0/123153864 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b74035030 con 0x7f1b8810a510 2024-08-20T05:14:19.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.403+0000 7f1b8de00640 1 -- 172.21.15.37:0/123153864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b881a79b0 con 0x7f1b8810a510 2024-08-20T05:14:19.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.406+0000 7f1b9205f740 1 Processor -- start 2024-08-20T05:14:19.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.406+0000 7f1b9205f740 1 -- start start 2024-08-20T05:14:19.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.406+0000 7f1b85600640 1 -- 172.21.15.37:0/123153864 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1b74042070 con 0x7f1b8810a510 2024-08-20T05:14:19.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.406+0000 7f1b9205f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead6ac0 0x5602aead6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.406+0000 7f1b9205f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead73e0 0x5602aeae2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.406+0000 7f1b9205f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeae5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.406+0000 7f1b9205f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5602aea4caa0 con 0x5602aeae3370 2024-08-20T05:14:19.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.406+0000 7f1b9205f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5602aea3bfa0 con 0x5602aead6ac0 2024-08-20T05:14:19.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.406+0000 7f1b9205f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5602aea3ffe0 con 0x5602aead73e0 2024-08-20T05:14:19.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.407+0000 7f1b8d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead6ac0 0x5602aead6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:19.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.407+0000 7f1b8d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead6ac0 0x5602aead6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:38422/0 (socket says 172.21.15.37:38422) 2024-08-20T05:14:19.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.407+0000 7f1b8d400640 1 -- 172.21.15.37:0/935028781 learned_addr learned my addr 172.21.15.37:0/935028781 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:19.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.407+0000 7f1b87e00640 1 --2- 172.21.15.37:0/935028781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeae5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:19.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.407+0000 7f1b87e00640 1 -- 172.21.15.37:0/935028781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead73e0 msgr2=0x5602aeae2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:19.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.407+0000 7f1b87e00640 1 --2- 172.21.15.37:0/935028781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead73e0 0x5602aeae2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.407+0000 7f1b87e00640 1 -- 172.21.15.37:0/935028781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead6ac0 msgr2=0x5602aead6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:19.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.407+0000 7f1b87e00640 1 --2- 172.21.15.37:0/935028781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead6ac0 0x5602aead6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.407+0000 7f1b87e00640 1 -- 172.21.15.37:0/935028781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602ae9e2420 con 0x5602aeae3370 2024-08-20T05:14:19.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.408+0000 7f1b87e00640 1 --2- 172.21.15.37:0/935028781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeae5760 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1b74101ed0 tx=0x7f1b7410acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0b104d0e8bc4f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:19.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.408+0000 7f1b79c00640 1 -- 172.21.15.37:0/935028781 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b741062e0 con 0x5602aeae3370 2024-08-20T05:14:19.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.408+0000 7f1b79c00640 1 -- 172.21.15.37:0/935028781 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b74114020 con 0x5602aeae3370 2024-08-20T05:14:19.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.408+0000 7f1b79c00640 1 -- 172.21.15.37:0/935028781 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7410ec80 con 0x5602aeae3370 2024-08-20T05:14:19.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.409+0000 7f1b9205f740 1 -- 172.21.15.37:0/935028781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 msgr2=0x5602aeae5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.409+0000 7f1b9205f740 1 --2- 172.21.15.37:0/935028781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeae5760 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f1b74101ed0 tx=0x7f1b7410acb0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.409+0000 7f1b9205f740 1 -- 172.21.15.37:0/935028781 shutdown_connections 2024-08-20T05:14:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.409+0000 7f1b9205f740 1 --2- 172.21.15.37:0/935028781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeae5760 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.409+0000 7f1b9205f740 1 --2- 172.21.15.37:0/935028781 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead73e0 0x5602aeae2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.409+0000 7f1b9205f740 1 --2- 172.21.15.37:0/935028781 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead6ac0 0x5602aead6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.409+0000 7f1b9205f740 1 -- 172.21.15.37:0/935028781 >> 172.21.15.37:0/935028781 conn(0x5602aead48f0 msgr2=0x5602aead5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.409+0000 7f1b85600640 1 --2- 172.21.15.37:0/123153864 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1b700b3cf0 0x7f1b700b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.409+0000 7f1b9205f740 1 -- 172.21.15.37:0/935028781 shutdown_connections 2024-08-20T05:14:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.409+0000 7f1b9205f740 1 -- 172.21.15.37:0/935028781 wait complete. 2024-08-20T05:14:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.409+0000 7f1b85600640 1 -- 172.21.15.37:0/123153864 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1b74104830 con 0x7f1b8810a510 2024-08-20T05:14:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.409+0000 7f1b8ca00640 1 --2- 172.21.15.37:0/123153864 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1b700b3cf0 0x7f1b700b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.410+0000 7f1b9205f740 1 -- start start 2024-08-20T05:14:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.410+0000 7f1b8ca00640 1 --2- 172.21.15.37:0/123153864 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1b700b3cf0 0x7f1b700b61b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x5602aead57d0 tx=0x7f1b7c0094c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.410+0000 7f1b9205f740 1 Processor -- start 2024-08-20T05:14:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.411+0000 7f1b9205f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead6ac0 0x5602aeae2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.411+0000 7f1b9205f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead73e0 0x5602aeadfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.411+0000 7f1b9205f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeae0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.411+0000 7f1b9205f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5602ae89e700 con 0x5602aeae3370 2024-08-20T05:14:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.411+0000 7f1b9205f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5602ae9d7290 con 0x5602aead6ac0 2024-08-20T05:14:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.411+0000 7f1b9205f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5602aeae5db0 con 0x5602aead73e0 2024-08-20T05:14:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.411+0000 7f1b9205f740 10 client.0 _ll_register_callbacks cb 0x5602aea361c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.411+0000 7f1b8ca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead6ac0 0x5602aeae2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.411+0000 7f1b8ca00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead6ac0 0x5602aeae2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:38430/0 (socket says 172.21.15.37:38430) 2024-08-20T05:14:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.411+0000 7f1b8ca00640 1 -- 172.21.15.37:0/3330978112 learned_addr learned my addr 172.21.15.37:0/3330978112 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.411+0000 7f1b87e00640 1 --2- 172.21.15.37:0/3330978112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead73e0 0x5602aeadfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.411+0000 7f1b8d400640 1 --2- 172.21.15.37:0/3330978112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeae0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.412+0000 7f1b8ca00640 1 -- 172.21.15.37:0/3330978112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead73e0 msgr2=0x5602aeadfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:19.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.412+0000 7f1b8ca00640 1 --2- 172.21.15.37:0/3330978112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead73e0 0x5602aeadfff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.412+0000 7f1b8ca00640 1 -- 172.21.15.37:0/3330978112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 msgr2=0x5602aeae0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.412+0000 7f1b8ca00640 1 --2- 172.21.15.37:0/3330978112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeae0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.412+0000 7f1b8ca00640 1 -- 172.21.15.37:0/3330978112 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602ae79b650 con 0x5602aead6ac0 2024-08-20T05:14:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.412+0000 7f1b8ca00640 1 --2- 172.21.15.37:0/3330978112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead6ac0 0x5602aeae2ba0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c015700 tx=0x7f1b7c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5f9e9c7fce2ba42 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.412+0000 7f1b6e000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:14:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.412+0000 7f1b6e000640 1 -- 172.21.15.37:0/3330978112 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c023020 con 0x5602aead6ac0 2024-08-20T05:14:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.412+0000 7f1b6e000640 1 -- 172.21.15.37:0/3330978112 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1b7c013510 con 0x5602aead6ac0 2024-08-20T05:14:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.412+0000 7f1b9205f740 1 -- 172.21.15.37:0/3330978112 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b74114020 con 0x5602aead6ac0 2024-08-20T05:14:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.413+0000 7f1b6e000640 1 -- 172.21.15.37:0/3330978112 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f1b7c02e050 con 0x5602aead6ac0 2024-08-20T05:14:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.413+0000 7f1b9205f740 10 client.28379 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.413+0000 7f1b9205f740 1 -- 172.21.15.37:0/3330978112 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5602aeaf1600 con 0x5602aead6ac0 2024-08-20T05:14:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.413+0000 7f1b6e000640 1 -- 172.21.15.37:0/3330978112 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b74114020 con 0x5602aead6ac0 2024-08-20T05:14:19.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.413+0000 7f1b6e000640 1 -- 172.21.15.37:0/3330978112 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f1b7c01e030 con 0x5602aead6ac0 2024-08-20T05:14:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.413+0000 7f1b9205f740 10 client.28379 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.413+0000 7f1b9205f740 10 client.28379 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:14:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.413+0000 7f1b9205f740 20 client.28379 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.413+0000 7f1b9205f740 1 --2- 172.21.15.37:0/3330978112 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5602aeaf2ac0 0x5602aeaf4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.414+0000 7f1b9205f740 4 client.28379 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:14:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.414+0000 7f1b9205f740 1 -- 172.21.15.37:0/3330978112 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602aea4e9f0 con 0x5602aeaf2ac0 2024-08-20T05:14:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.414+0000 7f1b87e00640 1 --2- 172.21.15.37:0/3330978112 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5602aeaf2ac0 0x5602aeaf4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.414+0000 7f1b87e00640 1 --2- 172.21.15.37:0/3330978112 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5602aeaf2ac0 0x5602aeaf4f10 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=66faa85e089e770c server_cookie=7ee083ac10491fc1 in_seq=0 out_seq=0 2024-08-20T05:14:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.414+0000 7f1b6e000640 10 client.28379 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:14:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.415+0000 7f1b6e000640 1 -- 172.21.15.37:0/3330978112 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5602aea4e9f0 con 0x5602aeaf2ac0 2024-08-20T05:14:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.415+0000 7f1b6e000640 10 client.28379 handle_command_reply: tid=0 2024-08-20T05:14:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.415+0000 7f1b9205f740 1 client.28379 shutdown 2024-08-20T05:14:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.416+0000 7f1b9205f740 1 -- 172.21.15.37:0/3330978112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead6ac0 msgr2=0x5602aeae2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:19.201 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.416+0000 7f1b9205f740 1 --2- 172.21.15.37:0/3330978112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead6ac0 0x5602aeae2ba0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c015700 tx=0x7f1b7c0046c0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.416+0000 7f1b9205f740 1 -- 172.21.15.37:0/3330978112 shutdown_connections 2024-08-20T05:14:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.416+0000 7f1b9205f740 1 --2- 172.21.15.37:0/3330978112 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5602aeaf2ac0 0x5602aeaf4f10 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.416+0000 7f1b9205f740 1 --2- 172.21.15.37:0/3330978112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeae0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.416+0000 7f1b9205f740 1 --2- 172.21.15.37:0/3330978112 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead73e0 0x5602aeadfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.416+0000 7f1b6e000640 0 client.28379 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:14:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.416+0000 7f1b9205f740 1 --2- 172.21.15.37:0/3330978112 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead6ac0 0x5602aeae2ba0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.416+0000 7f1b9205f740 1 -- 172.21.15.37:0/3330978112 >> 172.21.15.37:0/3330978112 conn(0x5602aead48f0 msgr2=0x5602aeada460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.416+0000 7f1b9205f740 1 -- 172.21.15.37:0/3330978112 shutdown_connections 2024-08-20T05:14:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.416+0000 7f1b9205f740 1 -- 172.21.15.37:0/3330978112 wait complete. 2024-08-20T05:14:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.416+0000 7f1b9205f740 20 client.28379 trim_cache size 0 max 16384 2024-08-20T05:14:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.431+0000 7f1b9205f740 1 Processor -- start 2024-08-20T05:14:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.431+0000 7f1b9205f740 1 -- start start 2024-08-20T05:14:19.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.431+0000 7f1b9205f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead6ac0 0x5602aeafa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.431+0000 7f1b9205f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead73e0 0x5602aeafad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.431+0000 7f1b9205f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeadd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.431+0000 7f1b9205f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881b1860 con 0x5602aeae3370 2024-08-20T05:14:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.431+0000 7f1b9205f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881b33a0 con 0x5602aead73e0 2024-08-20T05:14:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.431+0000 7f1b9205f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881b1f30 con 0x5602aead6ac0 2024-08-20T05:14:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.431+0000 7f1b8ca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead6ac0 0x5602aeafa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.431+0000 7f1b8d400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeadd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.431+0000 7f1b8ca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead6ac0 0x5602aeafa7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42668/0 (socket says 172.21.15.37:42668) 2024-08-20T05:14:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.432+0000 7f1b8ca00640 1 -- 172.21.15.37:0/4265568801 learned_addr learned my addr 172.21.15.37:0/4265568801 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.432+0000 7f1b8d400640 1 -- 172.21.15.37:0/4265568801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead6ac0 msgr2=0x5602aeafa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.432+0000 7f1b8d400640 1 --2- 172.21.15.37:0/4265568801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead6ac0 0x5602aeafa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.432+0000 7f1b8d400640 1 -- 172.21.15.37:0/4265568801 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead73e0 msgr2=0x5602aeafad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:19.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.432+0000 7f1b8d400640 1 --2- 172.21.15.37:0/4265568801 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead73e0 0x5602aeafad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.432+0000 7f1b8d400640 1 -- 172.21.15.37:0/4265568801 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602aead4720 con 0x5602aeae3370 2024-08-20T05:14:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.432+0000 7f1b8d400640 1 --2- 172.21.15.37:0/4265568801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeadd220 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1b80005fd0 tx=0x7f1b80012930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119ac2c2c8666914 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.432+0000 7f1b79200640 1 -- 172.21.15.37:0/4265568801 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b80004b20 con 0x5602aeae3370 2024-08-20T05:14:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.432+0000 7f1b79200640 1 -- 172.21.15.37:0/4265568801 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b80004cc0 con 0x5602aeae3370 2024-08-20T05:14:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.432+0000 7f1b79200640 1 -- 172.21.15.37:0/4265568801 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b800053a0 con 0x5602aeae3370 2024-08-20T05:14:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.433+0000 7f1b9205f740 1 -- 172.21.15.37:0/4265568801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 msgr2=0x5602aeadd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.433+0000 7f1b9205f740 1 --2- 172.21.15.37:0/4265568801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeadd220 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1b80005fd0 tx=0x7f1b80012930 comp rx=0 tx=0).stop 2024-08-20T05:14:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.433+0000 7f1b9205f740 1 -- 172.21.15.37:0/4265568801 shutdown_connections 2024-08-20T05:14:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.433+0000 7f1b9205f740 1 --2- 172.21.15.37:0/4265568801 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeadd220 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.433+0000 7f1b9205f740 1 --2- 172.21.15.37:0/4265568801 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead73e0 0x5602aeafad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.433+0000 7f1b9205f740 1 --2- 172.21.15.37:0/4265568801 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead6ac0 0x5602aeafa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.433+0000 7f1b9205f740 1 -- 172.21.15.37:0/4265568801 >> 172.21.15.37:0/4265568801 conn(0x5602aead48f0 msgr2=0x5602aeae1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.433+0000 7f1b9205f740 1 -- 172.21.15.37:0/4265568801 shutdown_connections 2024-08-20T05:14:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.433+0000 7f1b9205f740 1 -- 172.21.15.37:0/4265568801 wait complete. 2024-08-20T05:14:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.434+0000 7f1b9205f740 1 -- start start 2024-08-20T05:14:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.434+0000 7f1b9205f740 1 Processor -- start 2024-08-20T05:14:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.434+0000 7f1b9205f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead6ac0 0x5602aeae8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.434+0000 7f1b9205f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead73e0 0x5602aeae94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.434+0000 7f1b9205f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeae9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.434+0000 7f1b9205f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881b2cd0 con 0x5602aeae3370 2024-08-20T05:14:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.434+0000 7f1b9205f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881b2600 con 0x5602aead73e0 2024-08-20T05:14:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.434+0000 7f1b9205f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1b881af840 con 0x5602aead6ac0 2024-08-20T05:14:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.434+0000 7f1b9205f740 10 client.0 _ll_register_callbacks cb 0x7f1b7c009670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.435+0000 7f1b8ca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead6ac0 0x5602aeae8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:19.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.435+0000 7f1b8ca00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead6ac0 0x5602aeae8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42680/0 (socket says 172.21.15.37:42680) 2024-08-20T05:14:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.435+0000 7f1b8ca00640 1 -- 172.21.15.37:0/1912563416 learned_addr learned my addr 172.21.15.37:0/1912563416 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.435+0000 7f1b87e00640 1 --2- 172.21.15.37:0/1912563416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead73e0 0x5602aeae94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.435+0000 7f1b8d400640 1 --2- 172.21.15.37:0/1912563416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeae9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.435+0000 7f1b8ca00640 1 -- 172.21.15.37:0/1912563416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead73e0 msgr2=0x5602aeae94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.435+0000 7f1b8ca00640 1 --2- 172.21.15.37:0/1912563416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead73e0 0x5602aeae94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.435+0000 7f1b8ca00640 1 -- 172.21.15.37:0/1912563416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 msgr2=0x5602aeae9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.435+0000 7f1b8ca00640 1 --2- 172.21.15.37:0/1912563416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeae9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.435+0000 7f1b8ca00640 1 -- 172.21.15.37:0/1912563416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602aeb5c920 con 0x5602aead6ac0 2024-08-20T05:14:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.435+0000 7f1b8d400640 1 --2- 172.21.15.37:0/1912563416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeae9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:14:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.435+0000 7f1b8ca00640 1 --2- 172.21.15.37:0/1912563416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead6ac0 0x5602aeae8f90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c01fab0 tx=0x7f1b7c01f3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e07ca79d2dd182c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.435+0000 7f1b6e000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:14:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.436+0000 7f1b6e000640 1 -- 172.21.15.37:0/1912563416 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c036020 con 0x5602aead6ac0 2024-08-20T05:14:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.436+0000 7f1b9205f740 1 -- 172.21.15.37:0/1912563416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1b80004cc0 con 0x5602aead6ac0 2024-08-20T05:14:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.436+0000 7f1b6e000640 1 -- 172.21.15.37:0/1912563416 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1b7c013710 con 0x5602aead6ac0 2024-08-20T05:14:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.436+0000 7f1b6e000640 1 -- 172.21.15.37:0/1912563416 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f1b7c041050 con 0x5602aead6ac0 2024-08-20T05:14:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.436+0000 7f1b9205f740 10 client.28423 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.436+0000 7f1b9205f740 1 -- 172.21.15.37:0/1912563416 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5602aeb5dc20 con 0x5602aead6ac0 2024-08-20T05:14:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.436+0000 7f1b6e000640 1 -- 172.21.15.37:0/1912563416 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1b80004cc0 con 0x5602aead6ac0 2024-08-20T05:14:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.437+0000 7f1b6e000640 1 -- 172.21.15.37:0/1912563416 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f1b7c01e040 con 0x5602aead6ac0 2024-08-20T05:14:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.437+0000 7f1b9205f740 10 client.28423 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.437+0000 7f1b9205f740 10 client.28423 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:14:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.437+0000 7f1b9205f740 20 client.28423 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.437+0000 7f1b9205f740 1 --2- 172.21.15.37:0/1912563416 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5602aeb5e3d0 0x5602aeb607f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.437+0000 7f1b9205f740 4 client.28423 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:14:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.437+0000 7f1b9205f740 1 -- 172.21.15.37:0/1912563416 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5602aea4a490 con 0x5602aeb5e3d0 2024-08-20T05:14:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.437+0000 7f1b87e00640 1 --2- 172.21.15.37:0/1912563416 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5602aeb5e3d0 0x5602aeb607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.437+0000 7f1b87e00640 1 --2- 172.21.15.37:0/1912563416 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5602aeb5e3d0 0x5602aeb607f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7e0510f985285e21 server_cookie=86c0a66788d9662f in_seq=0 out_seq=0 2024-08-20T05:14:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.437+0000 7f1b6e000640 10 client.28423 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:14:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.438+0000 7f1b6e000640 1 -- 172.21.15.37:0/1912563416 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5602aea4a490 con 0x5602aeb5e3d0 2024-08-20T05:14:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.438+0000 7f1b6e000640 10 client.28423 handle_command_reply: tid=0 2024-08-20T05:14:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.438+0000 7f1b9205f740 1 client.28423 shutdown 2024-08-20T05:14:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.438+0000 7f1b9205f740 1 -- 172.21.15.37:0/1912563416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead6ac0 msgr2=0x5602aeae8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.438+0000 7f1b9205f740 1 --2- 172.21.15.37:0/1912563416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead6ac0 0x5602aeae8f90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c01fab0 tx=0x7f1b7c01f3f0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.438+0000 7f1b9205f740 1 -- 172.21.15.37:0/1912563416 shutdown_connections 2024-08-20T05:14:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.438+0000 7f1b9205f740 1 --2- 172.21.15.37:0/1912563416 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5602aeb5e3d0 0x5602aeb607f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.438+0000 7f1b9205f740 1 --2- 172.21.15.37:0/1912563416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5602aeae3370 0x5602aeae9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.438+0000 7f1b9205f740 1 --2- 172.21.15.37:0/1912563416 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5602aead73e0 0x5602aeae94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.438+0000 7f1b6e000640 0 client.28423 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:14:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.438+0000 7f1b9205f740 1 --2- 172.21.15.37:0/1912563416 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5602aead6ac0 0x5602aeae8f90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.438+0000 7f1b9205f740 1 -- 172.21.15.37:0/1912563416 >> 172.21.15.37:0/1912563416 conn(0x5602aead48f0 msgr2=0x5602aead32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.438+0000 7f1b9205f740 1 -- 172.21.15.37:0/1912563416 shutdown_connections 2024-08-20T05:14:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.438+0000 7f1b9205f740 1 -- 172.21.15.37:0/1912563416 wait complete. 2024-08-20T05:14:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.438+0000 7f1b9205f740 20 client.28423 trim_cache size 0 max 16384 2024-08-20T05:14:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.439+0000 7f1b8de00640 1 -- 172.21.15.37:0/123153864 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1b700b3cf0 msgr2=0x7f1b700b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.439+0000 7f1b8de00640 1 --2- 172.21.15.37:0/123153864 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1b700b3cf0 0x7f1b700b61b0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x5602aead57d0 tx=0x7f1b7c0094c0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.439+0000 7f1b8de00640 1 -- 172.21.15.37:0/123153864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b8810a510 msgr2=0x7f1b8819b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.439+0000 7f1b8de00640 1 --2- 172.21.15.37:0/123153864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b8810a510 0x7f1b8819b490 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1b74005ab0 tx=0x7f1b74003cd0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.439+0000 7f1b8de00640 1 -- 172.21.15.37:0/123153864 shutdown_connections 2024-08-20T05:14:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.439+0000 7f1b8de00640 1 --2- 172.21.15.37:0/123153864 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1b700b3cf0 0x7f1b700b61b0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.439+0000 7f1b8de00640 1 --2- 172.21.15.37:0/123153864 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1b8810ae90 0x7f1b881a0830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.439+0000 7f1b8de00640 1 --2- 172.21.15.37:0/123153864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b8810a510 0x7f1b8819b490 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.439+0000 7f1b8de00640 1 --2- 172.21.15.37:0/123153864 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1b88104b00 0x7f1b8819af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:19.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.439+0000 7f1b8de00640 1 -- 172.21.15.37:0/123153864 >> 172.21.15.37:0/123153864 conn(0x7f1b88100550 msgr2=0x7f1b88102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:19.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.439+0000 7f1b8de00640 1 -- 172.21.15.37:0/123153864 shutdown_connections 2024-08-20T05:14:19.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:18.439+0000 7f1b8de00640 1 -- 172.21.15.37:0/123153864 wait complete. 2024-08-20T05:14:19.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:19 smithi135 ceph-mon[22342]: pgmap v763: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 1.3 MiB/s wr, 101 op/s 2024-08-20T05:14:19.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:19 smithi130 ceph-mon[22007]: pgmap v763: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 1.3 MiB/s wr, 101 op/s 2024-08-20T05:14:20.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:19 smithi037 ceph-mon[17265]: pgmap v763: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 1.3 MiB/s wr, 101 op/s 2024-08-20T05:14:20.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T05:14:21.573 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:14:21.802 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:21 smithi037 ceph-mon[17265]: pgmap v764: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.5 MiB/s wr, 210 op/s 2024-08-20T05:14:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:21 smithi135 ceph-mon[22342]: pgmap v764: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.5 MiB/s wr, 210 op/s 2024-08-20T05:14:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:21 smithi130 ceph-mon[22007]: pgmap v764: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.5 MiB/s wr, 210 op/s 2024-08-20T05:14:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.387+0000 7fb27b200640 1 -- 172.21.15.37:0/3215190367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb27c10a520 msgr2=0x7fb27c10a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.387+0000 7fb27b200640 1 --2- 172.21.15.37:0/3215190367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb27c10a520 0x7fb27c10a960 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb268009900 tx=0x7fb26802a440 comp rx=0 tx=0).stop 2024-08-20T05:14:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.388+0000 7fb27b200640 1 -- 172.21.15.37:0/3215190367 shutdown_connections 2024-08-20T05:14:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.388+0000 7fb27b200640 1 --2- 172.21.15.37:0/3215190367 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb27c10aea0 0x7fb27c1116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.388+0000 7fb27b200640 1 --2- 172.21.15.37:0/3215190367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb27c10a520 0x7fb27c10a960 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.388+0000 7fb27b200640 1 --2- 172.21.15.37:0/3215190367 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb27c104b10 0x7fb27c104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.388+0000 7fb27b200640 1 -- 172.21.15.37:0/3215190367 >> 172.21.15.37:0/3215190367 conn(0x7fb27c100540 msgr2=0x7fb27c102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.389+0000 7fb27b200640 1 -- 172.21.15.37:0/3215190367 shutdown_connections 2024-08-20T05:14:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.390+0000 7fb27b200640 1 -- 172.21.15.37:0/3215190367 wait complete. 2024-08-20T05:14:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.391+0000 7fb27b200640 1 Processor -- start 2024-08-20T05:14:22.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.391+0000 7fb27b200640 1 -- start start 2024-08-20T05:14:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.393+0000 7fb27b200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb27c104b10 0x7fb27c1113c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.393+0000 7fb27b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb27c10a520 0x7fb27c10e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.393+0000 7fb27b200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb27c10aea0 0x7fb27c10eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.394+0000 7fb27b200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c114c30 con 0x7fb27c10aea0 2024-08-20T05:14:22.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.394+0000 7fb279400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb27c10a520 0x7fb27c10e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.394+0000 7fb279400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb27c10a520 0x7fb27c10e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42698/0 (socket says 172.21.15.37:42698) 2024-08-20T05:14:22.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.394+0000 7fb279400640 1 -- 172.21.15.37:0/2476007498 learned_addr learned my addr 172.21.15.37:0/2476007498 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:22.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.395+0000 7fb27b200640 1 -- 172.21.15.37:0/2476007498 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c114ab0 con 0x7fb27c104b10 2024-08-20T05:14:22.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.395+0000 7fb27b200640 1 -- 172.21.15.37:0/2476007498 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb27c114db0 con 0x7fb27c10a520 2024-08-20T05:14:22.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.398+0000 7fb279e00640 1 --2- 172.21.15.37:0/2476007498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb27c104b10 0x7fb27c1113c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.398+0000 7fb279e00640 1 -- 172.21.15.37:0/2476007498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb27c10a520 msgr2=0x7fb27c10e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.398+0000 7fb279e00640 1 --2- 172.21.15.37:0/2476007498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb27c10a520 0x7fb27c10e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.398+0000 7fb279e00640 1 -- 172.21.15.37:0/2476007498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb27c10aea0 msgr2=0x7fb27c10eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.398+0000 7fb279e00640 1 --2- 172.21.15.37:0/2476007498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb27c10aea0 0x7fb27c10eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.398+0000 7fb279e00640 1 -- 172.21.15.37:0/2476007498 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27c10f410 con 0x7fb27c104b10 2024-08-20T05:14:22.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.399+0000 7fb279e00640 1 --2- 172.21.15.37:0/2476007498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb27c104b10 0x7fb27c1113c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009fd0 tx=0x7fb26c00b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:22.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.399+0000 7fb272a00640 1 -- 172.21.15.37:0/2476007498 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c015020 con 0x7fb27c104b10 2024-08-20T05:14:22.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.399+0000 7fb27b200640 1 -- 172.21.15.37:0/2476007498 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb27c1a1210 con 0x7fb27c104b10 2024-08-20T05:14:22.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.399+0000 7fb272a00640 1 -- 172.21.15.37:0/2476007498 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb26c011ce0 con 0x7fb27c104b10 2024-08-20T05:14:22.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.399+0000 7fb272a00640 1 -- 172.21.15.37:0/2476007498 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c01ad90 con 0x7fb27c104b10 2024-08-20T05:14:22.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.400+0000 7fb27b200640 1 -- 172.21.15.37:0/2476007498 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb27c1a1820 con 0x7fb27c104b10 2024-08-20T05:14:22.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.406+0000 7fb272a00640 1 -- 172.21.15.37:0/2476007498 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb26c018020 con 0x7fb27c104b10 2024-08-20T05:14:22.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.409+0000 7fb28384c740 1 Processor -- start 2024-08-20T05:14:22.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.409+0000 7fb28384c740 1 -- start start 2024-08-20T05:14:22.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.409+0000 7fb28384c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff077ac0 0x5649ff077ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.410+0000 7fb27a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff077ac0 0x5649ff077ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.412+0000 7fb272a00640 1 --2- 172.21.15.37:0/2476007498 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2600b3d40 0x7fb2600b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.412+0000 7fb272a00640 1 -- 172.21.15.37:0/2476007498 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb26c0e36d0 con 0x7fb27c104b10 2024-08-20T05:14:22.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.412+0000 7fb279e00640 1 --2- 172.21.15.37:0/2476007498 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2600b3d40 0x7fb2600b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.413+0000 7fb28384c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff0783e0 0x5649ff083e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.413+0000 7fb27a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff077ac0 0x5649ff077ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42156/0 (socket says 172.21.15.37:42156) 2024-08-20T05:14:22.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.413+0000 7fb279e00640 1 --2- 172.21.15.37:0/2476007498 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2600b3d40 0x7fb2600b6200 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0aa1b0 tx=0x7fb26c01a8f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:22.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.414+0000 7fb27a800640 1 -- 172.21.15.37:0/731934357 learned_addr learned my addr 172.21.15.37:0/731934357 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:22.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.414+0000 7fb28384c740 1 --2- 172.21.15.37:0/731934357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff084370 0x5649ff086760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.414+0000 7fb28384c740 1 -- 172.21.15.37:0/731934357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5649fefedaa0 con 0x5649ff077ac0 2024-08-20T05:14:22.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.414+0000 7fb28384c740 1 -- 172.21.15.37:0/731934357 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5649fefdcfa0 con 0x5649ff0783e0 2024-08-20T05:14:22.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.414+0000 7fb28384c740 1 -- 172.21.15.37:0/731934357 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5649fefe0fe0 con 0x5649ff084370 2024-08-20T05:14:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.414+0000 7fb279400640 1 --2- 172.21.15.37:0/731934357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff0783e0 0x5649ff083e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.415+0000 7fb27a800640 1 --2- 172.21.15.37:0/731934357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff084370 0x5649ff086760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.415+0000 7fb279400640 1 -- 172.21.15.37:0/731934357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff084370 msgr2=0x5649ff086760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.415+0000 7fb279400640 1 --2- 172.21.15.37:0/731934357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff084370 0x5649ff086760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.415+0000 7fb279400640 1 -- 172.21.15.37:0/731934357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff077ac0 msgr2=0x5649ff077ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.415+0000 7fb279400640 1 --2- 172.21.15.37:0/731934357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff077ac0 0x5649ff077ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.415+0000 7fb279400640 1 -- 172.21.15.37:0/731934357 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649fef83420 con 0x5649ff0783e0 2024-08-20T05:14:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.417+0000 7fb27a800640 1 --2- 172.21.15.37:0/731934357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff084370 0x5649ff086760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:14:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.417+0000 7fb279400640 1 --2- 172.21.15.37:0/731934357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff0783e0 0x5649ff083e30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb268000c00 tx=0x7fb268004380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d524b2dbe425b2b7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:22.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.418+0000 7fb267000640 1 -- 172.21.15.37:0/731934357 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26803f070 con 0x5649ff0783e0 2024-08-20T05:14:22.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.418+0000 7fb267000640 1 -- 172.21.15.37:0/731934357 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb268003ca0 con 0x5649ff0783e0 2024-08-20T05:14:22.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.418+0000 7fb267000640 1 -- 172.21.15.37:0/731934357 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26803f070 con 0x5649ff0783e0 2024-08-20T05:14:22.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.420+0000 7fb28384c740 1 -- 172.21.15.37:0/731934357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff0783e0 msgr2=0x5649ff083e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.420+0000 7fb28384c740 1 --2- 172.21.15.37:0/731934357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff0783e0 0x5649ff083e30 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb268000c00 tx=0x7fb268004380 comp rx=0 tx=0).stop 2024-08-20T05:14:22.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.420+0000 7fb28384c740 1 -- 172.21.15.37:0/731934357 shutdown_connections 2024-08-20T05:14:22.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.420+0000 7fb28384c740 1 --2- 172.21.15.37:0/731934357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff084370 0x5649ff086760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.420+0000 7fb28384c740 1 --2- 172.21.15.37:0/731934357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff0783e0 0x5649ff083e30 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.420+0000 7fb28384c740 1 --2- 172.21.15.37:0/731934357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff077ac0 0x5649ff077ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.420+0000 7fb28384c740 1 -- 172.21.15.37:0/731934357 >> 172.21.15.37:0/731934357 conn(0x5649ff0758f0 msgr2=0x5649ff076a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:22.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.420+0000 7fb28384c740 1 -- 172.21.15.37:0/731934357 shutdown_connections 2024-08-20T05:14:22.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.421+0000 7fb28384c740 1 -- 172.21.15.37:0/731934357 wait complete. 2024-08-20T05:14:22.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.421+0000 7fb28384c740 1 -- start start 2024-08-20T05:14:22.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.422+0000 7fb28384c740 1 Processor -- start 2024-08-20T05:14:22.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.426+0000 7fb28384c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff077ac0 0x5649ff083b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.427+0000 7fb27a800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff077ac0 0x5649ff083b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.427+0000 7fb28384c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff0783e0 0x5649ff080f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.427+0000 7fb28384c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff084370 0x5649ff0814a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.428+0000 7fb28384c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5649fee3f700 con 0x5649ff084370 2024-08-20T05:14:22.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.428+0000 7fb27a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff084370 0x5649ff0814a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.428+0000 7fb27a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff084370 0x5649ff0814a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42168/0 (socket says 172.21.15.37:42168) 2024-08-20T05:14:22.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.428+0000 7fb27a800640 1 -- 172.21.15.37:0/767429530 learned_addr learned my addr 172.21.15.37:0/767429530 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:22.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.429+0000 7fb279400640 1 --2- 172.21.15.37:0/767429530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff0783e0 0x5649ff080f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.429+0000 7fb28384c740 1 -- 172.21.15.37:0/767429530 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5649fef78290 con 0x5649ff077ac0 2024-08-20T05:14:22.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.429+0000 7fb28384c740 1 -- 172.21.15.37:0/767429530 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5649ff086f90 con 0x5649ff0783e0 2024-08-20T05:14:22.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.429+0000 7fb28384c740 10 client.0 _ll_register_callbacks cb 0x5649fefd71c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.431+0000 7fb279400640 1 -- 172.21.15.37:0/767429530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff077ac0 msgr2=0x5649ff083b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.431+0000 7fb279400640 1 --2- 172.21.15.37:0/767429530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff077ac0 0x5649ff083b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.431+0000 7fb279400640 1 -- 172.21.15.37:0/767429530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff084370 msgr2=0x5649ff0814a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.431+0000 7fb279400640 1 --2- 172.21.15.37:0/767429530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff084370 0x5649ff0814a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.431+0000 7fb279400640 1 -- 172.21.15.37:0/767429530 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649fed3c650 con 0x5649ff0783e0 2024-08-20T05:14:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.431+0000 7fb279400640 1 --2- 172.21.15.37:0/767429530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff0783e0 0x5649ff080f60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb26802a480 tx=0x7fb268003820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f0caeafd743f54 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.431+0000 7fb25b400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:14:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.432+0000 7fb25b400640 1 -- 172.21.15.37:0/767429530 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26803f040 con 0x5649ff0783e0 2024-08-20T05:14:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.432+0000 7fb25b400640 1 -- 172.21.15.37:0/767429530 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb2680318e0 con 0x5649ff0783e0 2024-08-20T05:14:22.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.432+0000 7fb28384c740 1 -- 172.21.15.37:0/767429530 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb268003ca0 con 0x5649ff0783e0 2024-08-20T05:14:22.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.434+0000 7fb25b400640 1 -- 172.21.15.37:0/767429530 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb268035070 con 0x5649ff0783e0 2024-08-20T05:14:22.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.434+0000 7fb28384c740 10 client.28432 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:22.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.434+0000 7fb28384c740 1 -- 172.21.15.37:0/767429530 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5649ff0927b0 con 0x5649ff0783e0 2024-08-20T05:14:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.435+0000 7fb25b400640 1 -- 172.21.15.37:0/767429530 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb268003ca0 con 0x5649ff0783e0 2024-08-20T05:14:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.435+0000 7fb25b400640 1 -- 172.21.15.37:0/767429530 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7fb268044a10 con 0x5649ff0783e0 2024-08-20T05:14:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.435+0000 7fb28384c740 10 client.28432 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.435+0000 7fb28384c740 10 client.28432 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:14:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.435+0000 7fb28384c740 20 client.28432 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.435+0000 7fb28384c740 1 --2- 172.21.15.37:0/767429530 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5649ff093b00 0x5649ff095ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.435+0000 7fb28384c740 4 client.28432 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:14:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.435+0000 7fb28384c740 1 -- 172.21.15.37:0/767429530 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649fefef9f0 con 0x5649ff093b00 2024-08-20T05:14:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.436+0000 7fb27a800640 1 --2- 172.21.15.37:0/767429530 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5649ff093b00 0x5649ff095ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.442+0000 7fb27a800640 1 --2- 172.21.15.37:0/767429530 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5649ff093b00 0x5649ff095ef0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c340a1040316efed server_cookie=7c7dcb89db863bd5 in_seq=0 out_seq=0 2024-08-20T05:14:22.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.442+0000 7fb25b400640 10 client.28432 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:14:22.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.445+0000 7fb25b400640 1 -- 172.21.15.37:0/767429530 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5649fefef9f0 con 0x5649ff093b00 2024-08-20T05:14:22.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.445+0000 7fb25b400640 10 client.28432 handle_command_reply: tid=0 2024-08-20T05:14:22.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.445+0000 7fb28384c740 1 client.28432 shutdown 2024-08-20T05:14:22.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.448+0000 7fb28384c740 1 -- 172.21.15.37:0/767429530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff0783e0 msgr2=0x5649ff080f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.448+0000 7fb28384c740 1 --2- 172.21.15.37:0/767429530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff0783e0 0x5649ff080f60 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb26802a480 tx=0x7fb268003820 comp rx=0 tx=0).stop 2024-08-20T05:14:22.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.448+0000 7fb28384c740 1 -- 172.21.15.37:0/767429530 shutdown_connections 2024-08-20T05:14:22.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.448+0000 7fb28384c740 1 --2- 172.21.15.37:0/767429530 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5649ff093b00 0x5649ff095ef0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.448+0000 7fb28384c740 1 --2- 172.21.15.37:0/767429530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff084370 0x5649ff0814a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.448+0000 7fb28384c740 1 --2- 172.21.15.37:0/767429530 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff0783e0 0x5649ff080f60 secure :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fb26802a480 tx=0x7fb268003820 comp rx=0 tx=0).stop 2024-08-20T05:14:22.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.448+0000 7fb28384c740 1 --2- 172.21.15.37:0/767429530 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff077ac0 0x5649ff083b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.448+0000 7fb28384c740 1 -- 172.21.15.37:0/767429530 >> 172.21.15.37:0/767429530 conn(0x5649ff0758f0 msgr2=0x5649ff07b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:22.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.448+0000 7fb25b400640 0 client.28432 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:14:22.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.449+0000 7fb28384c740 1 -- 172.21.15.37:0/767429530 shutdown_connections 2024-08-20T05:14:22.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.449+0000 7fb28384c740 1 -- 172.21.15.37:0/767429530 wait complete. 2024-08-20T05:14:22.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.449+0000 7fb28384c740 20 client.28432 trim_cache size 0 max 16384 2024-08-20T05:14:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.492+0000 7fb28384c740 1 Processor -- start 2024-08-20T05:14:22.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.492+0000 7fb28384c740 1 -- start start 2024-08-20T05:14:22.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.493+0000 7fb28384c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff077ac0 0x5649ff07c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.493+0000 7fb28384c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff084370 0x5649ff07fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.493+0000 7fb28384c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff098f10 0x5649ff099390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.493+0000 7fb28384c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c00fbf0 con 0x5649ff084370 2024-08-20T05:14:22.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.493+0000 7fb28384c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c011730 con 0x5649ff098f10 2024-08-20T05:14:22.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.493+0000 7fb28384c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c0102c0 con 0x5649ff077ac0 2024-08-20T05:14:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.493+0000 7fb27a800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff098f10 0x5649ff099390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.493+0000 7fb27a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff077ac0 0x5649ff07c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.493+0000 7fb27a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff077ac0 0x5649ff07c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42730/0 (socket says 172.21.15.37:42730) 2024-08-20T05:14:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.493+0000 7fb27a800640 1 -- 172.21.15.37:0/1549580603 learned_addr learned my addr 172.21.15.37:0/1549580603 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.494+0000 7fb27a800640 1 -- 172.21.15.37:0/1549580603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff098f10 msgr2=0x5649ff099390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.494+0000 7fb27a800640 1 --2- 172.21.15.37:0/1549580603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff098f10 0x5649ff099390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.494+0000 7fb27a800640 1 -- 172.21.15.37:0/1549580603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff084370 msgr2=0x5649ff07fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.494+0000 7fb27a800640 1 --2- 172.21.15.37:0/1549580603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff084370 0x5649ff07fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.494+0000 7fb27a800640 1 -- 172.21.15.37:0/1549580603 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649ff081810 con 0x5649ff077ac0 2024-08-20T05:14:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.495+0000 7fb27a800640 1 --2- 172.21.15.37:0/1549580603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff077ac0 0x5649ff07c600 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb274009640 tx=0x7fb27400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef2f3180c9fd19c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.495+0000 7fb266600640 1 -- 172.21.15.37:0/1549580603 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274012040 con 0x5649ff077ac0 2024-08-20T05:14:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.495+0000 7fb266600640 1 -- 172.21.15.37:0/1549580603 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb274013040 con 0x5649ff077ac0 2024-08-20T05:14:22.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.495+0000 7fb266600640 1 -- 172.21.15.37:0/1549580603 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2740046c0 con 0x5649ff077ac0 2024-08-20T05:14:22.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.498+0000 7fb28384c740 1 -- 172.21.15.37:0/1549580603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff077ac0 msgr2=0x5649ff07c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.498+0000 7fb28384c740 1 --2- 172.21.15.37:0/1549580603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff077ac0 0x5649ff07c600 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb274009640 tx=0x7fb27400b040 comp rx=0 tx=0).stop 2024-08-20T05:14:22.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.499+0000 7fb28384c740 1 -- 172.21.15.37:0/1549580603 shutdown_connections 2024-08-20T05:14:22.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.499+0000 7fb28384c740 1 --2- 172.21.15.37:0/1549580603 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff098f10 0x5649ff099390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.499+0000 7fb28384c740 1 --2- 172.21.15.37:0/1549580603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff084370 0x5649ff07fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.499+0000 7fb28384c740 1 --2- 172.21.15.37:0/1549580603 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff077ac0 0x5649ff07c600 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.499+0000 7fb28384c740 1 -- 172.21.15.37:0/1549580603 >> 172.21.15.37:0/1549580603 conn(0x5649ff0758f0 msgr2=0x5649ff07f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:22.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.500+0000 7fb28384c740 1 -- 172.21.15.37:0/1549580603 shutdown_connections 2024-08-20T05:14:22.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.500+0000 7fb28384c740 1 -- 172.21.15.37:0/1549580603 wait complete. 2024-08-20T05:14:22.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.500+0000 7fb28384c740 1 -- start start 2024-08-20T05:14:22.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.501+0000 7fb28384c740 1 Processor -- start 2024-08-20T05:14:22.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.505+0000 7fb28384c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff077ac0 0x5649ff098920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.505+0000 7fb28384c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff084370 0x5649ff095e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.505+0000 7fb27a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff077ac0 0x5649ff098920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.505+0000 7fb27a800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff077ac0 0x5649ff098920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:42736/0 (socket says 172.21.15.37:42736) 2024-08-20T05:14:22.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.506+0000 7fb27a800640 1 -- 172.21.15.37:0/565554733 learned_addr learned my addr 172.21.15.37:0/565554733 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:22.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.506+0000 7fb28384c740 1 --2- 172.21.15.37:0/565554733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff098f10 0x5649ff0965a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.506+0000 7fb28384c740 1 -- 172.21.15.37:0/565554733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c011060 con 0x5649ff084370 2024-08-20T05:14:22.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.506+0000 7fb28384c740 1 -- 172.21.15.37:0/565554733 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c010990 con 0x5649ff098f10 2024-08-20T05:14:22.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.506+0000 7fb28384c740 1 -- 172.21.15.37:0/565554733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c00dbd0 con 0x5649ff077ac0 2024-08-20T05:14:22.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.506+0000 7fb28384c740 10 client.0 _ll_register_callbacks cb 0x7fb274009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:22.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.506+0000 7fb279400640 1 --2- 172.21.15.37:0/565554733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff084370 0x5649ff095e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.507+0000 7fb27a800640 1 --2- 172.21.15.37:0/565554733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff098f10 0x5649ff0965a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.507+0000 7fb27a800640 1 -- 172.21.15.37:0/565554733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff098f10 msgr2=0x5649ff0965a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.507+0000 7fb27a800640 1 --2- 172.21.15.37:0/565554733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff098f10 0x5649ff0965a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.507+0000 7fb27a800640 1 -- 172.21.15.37:0/565554733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff084370 msgr2=0x5649ff095e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.507+0000 7fb27a800640 1 --2- 172.21.15.37:0/565554733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff084370 0x5649ff095e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.507+0000 7fb27a800640 1 -- 172.21.15.37:0/565554733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649ff0fd440 con 0x5649ff077ac0 2024-08-20T05:14:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.508+0000 7fb27a800640 1 --2- 172.21.15.37:0/565554733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff077ac0 0x5649ff098920 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb2740042e0 tx=0x7fb274009ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0915beb4c118b6a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.508+0000 7fb25b400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:14:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.508+0000 7fb25b400640 1 -- 172.21.15.37:0/565554733 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274012070 con 0x5649ff077ac0 2024-08-20T05:14:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.508+0000 7fb28384c740 1 -- 172.21.15.37:0/565554733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb274013040 con 0x5649ff077ac0 2024-08-20T05:14:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.508+0000 7fb25b400640 1 -- 172.21.15.37:0/565554733 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb274003ad0 con 0x5649ff077ac0 2024-08-20T05:14:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.509+0000 7fb25b400640 1 -- 172.21.15.37:0/565554733 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb27403a050 con 0x5649ff077ac0 2024-08-20T05:14:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.509+0000 7fb28384c740 10 client.28438 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:22.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.509+0000 7fb28384c740 1 -- 172.21.15.37:0/565554733 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5649ff0fe660 con 0x5649ff077ac0 2024-08-20T05:14:22.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.510+0000 7fb25b400640 1 -- 172.21.15.37:0/565554733 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb274013040 con 0x5649ff077ac0 2024-08-20T05:14:22.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.511+0000 7fb25b400640 1 -- 172.21.15.37:0/565554733 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7fb274022030 con 0x5649ff077ac0 2024-08-20T05:14:22.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.512+0000 7fb28384c740 10 client.28438 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:22.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.512+0000 7fb28384c740 10 client.28438 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:14:22.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.512+0000 7fb28384c740 20 client.28438 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:22.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.512+0000 7fb28384c740 1 --2- 172.21.15.37:0/565554733 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5649ff0febd0 0x5649ff100ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.512+0000 7fb28384c740 4 client.28438 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:14:22.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.512+0000 7fb28384c740 1 -- 172.21.15.37:0/565554733 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5649fefeb490 con 0x5649ff0febd0 2024-08-20T05:14:22.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.514+0000 7fb279400640 1 --2- 172.21.15.37:0/565554733 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5649ff0febd0 0x5649ff100ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.518+0000 7fb279400640 1 --2- 172.21.15.37:0/565554733 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5649ff0febd0 0x5649ff100ff0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f7ceba6a6b2a329c server_cookie=dae46cb0a9a96f2f in_seq=0 out_seq=0 2024-08-20T05:14:22.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.518+0000 7fb25b400640 10 client.28438 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:14:22.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.519+0000 7fb25b400640 1 -- 172.21.15.37:0/565554733 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5649fefeb490 con 0x5649ff0febd0 2024-08-20T05:14:22.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.519+0000 7fb25b400640 10 client.28438 handle_command_reply: tid=0 2024-08-20T05:14:22.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.519+0000 7fb28384c740 1 client.28438 shutdown 2024-08-20T05:14:22.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.520+0000 7fb28384c740 1 -- 172.21.15.37:0/565554733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff077ac0 msgr2=0x5649ff098920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.520+0000 7fb28384c740 1 --2- 172.21.15.37:0/565554733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff077ac0 0x5649ff098920 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb2740042e0 tx=0x7fb274009ac0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.520+0000 7fb28384c740 1 -- 172.21.15.37:0/565554733 shutdown_connections 2024-08-20T05:14:22.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.520+0000 7fb28384c740 1 --2- 172.21.15.37:0/565554733 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5649ff0febd0 0x5649ff100ff0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.520+0000 7fb25b400640 0 client.28438 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:14:22.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.520+0000 7fb28384c740 1 --2- 172.21.15.37:0/565554733 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5649ff098f10 0x5649ff0965a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.520+0000 7fb28384c740 1 --2- 172.21.15.37:0/565554733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5649ff084370 0x5649ff095e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.520+0000 7fb28384c740 1 --2- 172.21.15.37:0/565554733 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5649ff077ac0 0x5649ff098920 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.520+0000 7fb28384c740 1 -- 172.21.15.37:0/565554733 >> 172.21.15.37:0/565554733 conn(0x5649ff0758f0 msgr2=0x5649ff07f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.520+0000 7fb28384c740 1 -- 172.21.15.37:0/565554733 shutdown_connections 2024-08-20T05:14:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.520+0000 7fb28384c740 1 -- 172.21.15.37:0/565554733 wait complete. 2024-08-20T05:14:22.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.521+0000 7fb28384c740 20 client.28438 trim_cache size 0 max 16384 2024-08-20T05:14:22.523 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:14:22.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.524+0000 7fb27b200640 1 -- 172.21.15.37:0/2476007498 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2600b3d40 msgr2=0x7fb2600b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.524+0000 7fb27b200640 1 --2- 172.21.15.37:0/2476007498 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2600b3d40 0x7fb2600b6200 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb26c0aa1b0 tx=0x7fb26c01a8f0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.524+0000 7fb27b200640 1 -- 172.21.15.37:0/2476007498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb27c104b10 msgr2=0x7fb27c1113c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.524+0000 7fb27b200640 1 --2- 172.21.15.37:0/2476007498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb27c104b10 0x7fb27c1113c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009fd0 tx=0x7fb26c00b870 comp rx=0 tx=0).stop 2024-08-20T05:14:22.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.524+0000 7fb27b200640 1 -- 172.21.15.37:0/2476007498 shutdown_connections 2024-08-20T05:14:22.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.524+0000 7fb27b200640 1 --2- 172.21.15.37:0/2476007498 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2600b3d40 0x7fb2600b6200 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.524+0000 7fb27b200640 1 --2- 172.21.15.37:0/2476007498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb27c10aea0 0x7fb27c10eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.524+0000 7fb27b200640 1 --2- 172.21.15.37:0/2476007498 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb27c10a520 0x7fb27c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.524+0000 7fb27b200640 1 --2- 172.21.15.37:0/2476007498 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb27c104b10 0x7fb27c1113c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.524+0000 7fb27b200640 1 -- 172.21.15.37:0/2476007498 >> 172.21.15.37:0/2476007498 conn(0x7fb27c100540 msgr2=0x7fb27c102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:22.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.525+0000 7fb27b200640 1 -- 172.21.15.37:0/2476007498 shutdown_connections 2024-08-20T05:14:22.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:22.525+0000 7fb27b200640 1 -- 172.21.15.37:0/2476007498 wait complete. 2024-08-20T05:14:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.870+0000 7f1e48000640 1 -- 172.21.15.37:0/439449827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4006cd50 msgr2=0x7f1e4006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.870+0000 7f1e48000640 1 --2- 172.21.15.37:0/439449827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4006cd50 0x7f1e4006d150 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400b9f0 tx=0x7f1e3402c0a0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.871+0000 7f1e48000640 1 -- 172.21.15.37:0/439449827 shutdown_connections 2024-08-20T05:14:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.871+0000 7f1e48000640 1 --2- 172.21.15.37:0/439449827 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e4006e860 0x7f1e400731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.871+0000 7f1e48000640 1 --2- 172.21.15.37:0/439449827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e4006dea0 0x7f1e4006e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.871+0000 7f1e48000640 1 --2- 172.21.15.37:0/439449827 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4006cd50 0x7f1e4006d150 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.871+0000 7f1e48000640 1 -- 172.21.15.37:0/439449827 >> 172.21.15.37:0/439449827 conn(0x7f1e400fc580 msgr2=0x7f1e400fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:22.873 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.871+0000 7f1e48000640 1 -- 172.21.15.37:0/439449827 shutdown_connections 2024-08-20T05:14:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.871+0000 7f1e48000640 1 -- 172.21.15.37:0/439449827 wait complete. 2024-08-20T05:14:22.874 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.872+0000 7f1e48000640 1 Processor -- start 2024-08-20T05:14:22.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.875+0000 7f1e48000640 1 -- start start 2024-08-20T05:14:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.875+0000 7f1e48000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e4006cd50 0x7f1e401a34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.875+0000 7f1e48000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4006dea0 0x7f1e401a3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.875+0000 7f1e48000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e4006e860 0x7f1e401a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.876+0000 7f1e48000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e40118d30 con 0x7f1e4006e860 2024-08-20T05:14:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.876+0000 7f1e48000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1e40118bb0 con 0x7f1e4006dea0 2024-08-20T05:14:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.876+0000 7f1e48000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1e40118eb0 con 0x7f1e4006cd50 2024-08-20T05:14:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.876+0000 7f1e44c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4006dea0 0x7f1e401a3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.876+0000 7f1e44c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4006dea0 0x7f1e401a3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45544/0 (socket says 172.21.15.37:45544) 2024-08-20T05:14:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.876+0000 7f1e44c00640 1 -- 172.21.15.37:0/1208675503 learned_addr learned my addr 172.21.15.37:0/1208675503 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.876+0000 7f1e45600640 1 --2- 172.21.15.37:0/1208675503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e4006cd50 0x7f1e401a34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.876+0000 7f1e46000640 1 --2- 172.21.15.37:0/1208675503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e4006e860 0x7f1e401a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.876+0000 7f1e44c00640 1 -- 172.21.15.37:0/1208675503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e4006cd50 msgr2=0x7f1e401a34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.876+0000 7f1e44c00640 1 --2- 172.21.15.37:0/1208675503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e4006cd50 0x7f1e401a34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.876+0000 7f1e44c00640 1 -- 172.21.15.37:0/1208675503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e4006e860 msgr2=0x7f1e401a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.876+0000 7f1e44c00640 1 --2- 172.21.15.37:0/1208675503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e4006e860 0x7f1e401a4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.876+0000 7f1e44c00640 1 -- 172.21.15.37:0/1208675503 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e401a5020 con 0x7f1e4006dea0 2024-08-20T05:14:22.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.877+0000 7f1e44c00640 1 --2- 172.21.15.37:0/1208675503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4006dea0 0x7f1e401a3b30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00b4a0 tx=0x7f1e2c00b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.877+0000 7f1e3e000640 1 -- 172.21.15.37:0/1208675503 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c014070 con 0x7f1e4006dea0 2024-08-20T05:14:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.877+0000 7f1e3e000640 1 -- 172.21.15.37:0/1208675503 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e2c010ac0 con 0x7f1e4006dea0 2024-08-20T05:14:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.877+0000 7f1e3e000640 1 -- 172.21.15.37:0/1208675503 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c017c30 con 0x7f1e4006dea0 2024-08-20T05:14:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.877+0000 7f1e48000640 1 -- 172.21.15.37:0/1208675503 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e401a52b0 con 0x7f1e4006dea0 2024-08-20T05:14:22.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.877+0000 7f1e48000640 1 -- 172.21.15.37:0/1208675503 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e40114010 con 0x7f1e4006dea0 2024-08-20T05:14:22.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.883+0000 7f1e4b06e740 1 Processor -- start 2024-08-20T05:14:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.886+0000 7f1e3e000640 1 -- 172.21.15.37:0/1208675503 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1e2c017070 con 0x7f1e4006dea0 2024-08-20T05:14:22.888 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.886+0000 7f1e4b06e740 1 -- start start 2024-08-20T05:14:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.886+0000 7f1e4b06e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b792b0 0x564675b7b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.886+0000 7f1e4b06e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b7bbe0 0x564675b7dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.886+0000 7f1e4b06e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b7e620 0x564675b80ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.886+0000 7f1e4b06e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564675aec210 con 0x564675b7e620 2024-08-20T05:14:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.887+0000 7f1e4b06e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564675adb710 con 0x564675b7bbe0 2024-08-20T05:14:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.887+0000 7f1e4b06e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564675adf750 con 0x564675b792b0 2024-08-20T05:14:22.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.887+0000 7f1e45600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b7bbe0 0x564675b7dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.887+0000 7f1e45600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b7bbe0 0x564675b7dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45556/0 (socket says 172.21.15.37:45556) 2024-08-20T05:14:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.887+0000 7f1e45600640 1 -- 172.21.15.37:0/3291864746 learned_addr learned my addr 172.21.15.37:0/3291864746 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.888+0000 7f1e45600640 1 -- 172.21.15.37:0/3291864746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b792b0 msgr2=0x564675b7b6a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:14:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.888+0000 7f1e46000640 1 --2- 172.21.15.37:0/3291864746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b792b0 0x564675b7b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.888+0000 7f1e45600640 1 --2- 172.21.15.37:0/3291864746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b792b0 0x564675b7b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.888+0000 7f1e45600640 1 -- 172.21.15.37:0/3291864746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b7e620 msgr2=0x564675b80ae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:14:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.888+0000 7f1e45600640 1 --2- 172.21.15.37:0/3291864746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b7e620 0x564675b80ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.888+0000 7f1e45600640 1 -- 172.21.15.37:0/3291864746 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564675aa7de0 con 0x564675b7bbe0 2024-08-20T05:14:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.888+0000 7f1e46000640 1 --2- 172.21.15.37:0/3291864746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b792b0 0x564675b7b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:14:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.888+0000 7f1e3e000640 1 --2- 172.21.15.37:0/1208675503 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e280b3c50 0x7f1e280b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.889+0000 7f1e3e000640 1 -- 172.21.15.37:0/1208675503 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1e2c0e3700 con 0x7f1e4006dea0 2024-08-20T05:14:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.889+0000 7f1e45600640 1 --2- 172.21.15.37:0/3291864746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b7bbe0 0x564675b7dfd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400b9f0 tx=0x7f1e34005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71c9da36af04b437 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.889+0000 7f1e46000640 1 --2- 172.21.15.37:0/1208675503 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e280b3c50 0x7f1e280b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.889+0000 7f1e32600640 1 -- 172.21.15.37:0/3291864746 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e34041030 con 0x564675b7bbe0 2024-08-20T05:14:22.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.889+0000 7f1e32600640 1 -- 172.21.15.37:0/3291864746 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e3402cc70 con 0x564675b7bbe0 2024-08-20T05:14:22.892 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.889+0000 7f1e32600640 1 -- 172.21.15.37:0/3291864746 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e34039040 con 0x564675b7bbe0 2024-08-20T05:14:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.894+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3291864746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b7bbe0 msgr2=0x564675b7dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.894+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/3291864746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b7bbe0 0x564675b7dfd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1e3400b9f0 tx=0x7f1e34005c90 comp rx=0 tx=0).stop 2024-08-20T05:14:22.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.894+0000 7f1e46000640 1 --2- 172.21.15.37:0/1208675503 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e280b3c50 0x7f1e280b6110 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1e401a4260 tx=0x7f1e3800a5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.895+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3291864746 shutdown_connections 2024-08-20T05:14:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.895+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/3291864746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b7e620 0x564675b80ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.895+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/3291864746 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b7bbe0 0x564675b7dfd0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.895+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/3291864746 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b792b0 0x564675b7b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.895+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3291864746 >> 172.21.15.37:0/3291864746 conn(0x564675b743b0 msgr2=0x564675b75190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.895+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3291864746 shutdown_connections 2024-08-20T05:14:22.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.895+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3291864746 wait complete. 2024-08-20T05:14:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.896+0000 7f1e4b06e740 1 -- start start 2024-08-20T05:14:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.896+0000 7f1e4b06e740 1 Processor -- start 2024-08-20T05:14:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.897+0000 7f1e4b06e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b792b0 0x564675b93d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.898 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.897+0000 7f1e4b06e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b7bbe0 0x564675b94420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.897+0000 7f1e4b06e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b7e620 0x564675b94f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.897+0000 7f1e45600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b792b0 0x564675b93d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.897+0000 7f1e44c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b7bbe0 0x564675b94420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.899 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.897+0000 7f1e44c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b7bbe0 0x564675b94420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:40954/0 (socket says 172.21.15.37:40954) 2024-08-20T05:14:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.897+0000 7f1e45600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b792b0 0x564675b93d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45568/0 (socket says 172.21.15.37:45568) 2024-08-20T05:14:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.897+0000 7f1e44c00640 1 -- 172.21.15.37:0/3724947754 learned_addr learned my addr 172.21.15.37:0/3724947754 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.897+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3724947754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564675a14ab0 con 0x564675b7e620 2024-08-20T05:14:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.897+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3724947754 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564675a82140 con 0x564675b792b0 2024-08-20T05:14:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.897+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3724947754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564675b925b0 con 0x564675b7bbe0 2024-08-20T05:14:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.897+0000 7f1e46000640 1 --2- 172.21.15.37:0/3724947754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b7e620 0x564675b94f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.900 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.897+0000 7f1e4b06e740 10 client.0 _ll_register_callbacks cb 0x564675a955d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.898+0000 7f1e44c00640 1 -- 172.21.15.37:0/3724947754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b792b0 msgr2=0x564675b93d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.898+0000 7f1e44c00640 1 --2- 172.21.15.37:0/3724947754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b792b0 0x564675b93d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.898+0000 7f1e44c00640 1 -- 172.21.15.37:0/3724947754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b7e620 msgr2=0x564675b94f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.898+0000 7f1e44c00640 1 --2- 172.21.15.37:0/3724947754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b7e620 0x564675b94f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.898+0000 7f1e44c00640 1 -- 172.21.15.37:0/3724947754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564675a83170 con 0x564675b7bbe0 2024-08-20T05:14:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.898+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3724947754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564675ab2a30 con 0x564675b7bbe0 2024-08-20T05:14:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.898+0000 7f1e44c00640 1 --2- 172.21.15.37:0/3724947754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b7bbe0 0x564675b94420 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0a6330 tx=0x7f1e2c017360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea075a15693f5d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.898+0000 7f1e26a00640 10 client.28447 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:14:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.899+0000 7f1e26a00640 1 -- 172.21.15.37:0/3724947754 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c01e070 con 0x564675b7bbe0 2024-08-20T05:14:22.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.899+0000 7f1e26a00640 1 -- 172.21.15.37:0/3724947754 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1e2c0e3440 con 0x564675b7bbe0 2024-08-20T05:14:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.899+0000 7f1e26a00640 1 -- 172.21.15.37:0/3724947754 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f1e2c0aa2b0 con 0x564675b7bbe0 2024-08-20T05:14:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.899+0000 7f1e4b06e740 10 client.28447 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.899+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3724947754 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({fsmap=48}) -- 0x56467583e790 con 0x564675b7bbe0 2024-08-20T05:14:22.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.899+0000 7f1e26a00640 1 -- 172.21.15.37:0/3724947754 <== mon.1 v2:172.21.15.135:3300/0 4 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f1e2c0a6540 con 0x564675b7bbe0 2024-08-20T05:14:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.899+0000 7f1e4b06e740 10 client.28447 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.899+0000 7f1e4b06e740 10 client.28447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:14:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.899+0000 7f1e4b06e740 20 client.28447 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.899+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/3724947754 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564675b9f760 0x564675ba1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.899+0000 7f1e4b06e740 4 client.28447 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:14:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.899+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3724947754 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564675aee160 con 0x564675b9f760 2024-08-20T05:14:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.901+0000 7f1e45600640 1 --2- 172.21.15.37:0/3724947754 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564675b9f760 0x564675ba1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.901+0000 7f1e45600640 1 --2- 172.21.15.37:0/3724947754 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564675b9f760 0x564675ba1b50 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=672ec02c3fdbc2cd server_cookie=74ae61be766e7c7f in_seq=0 out_seq=0 2024-08-20T05:14:22.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.901+0000 7f1e26a00640 10 client.28447 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.902+0000 7f1e26a00640 1 -- 172.21.15.37:0/3724947754 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564675aee160 con 0x564675b9f760 2024-08-20T05:14:22.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.902+0000 7f1e26a00640 10 client.28447 handle_command_reply: tid=0 2024-08-20T05:14:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.907+0000 7f1e4b06e740 1 client.28447 shutdown 2024-08-20T05:14:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.907+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3724947754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b7bbe0 msgr2=0x564675b94420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.909 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.907+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/3724947754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b7bbe0 0x564675b94420 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0a6330 tx=0x7f1e2c017360 comp rx=0 tx=0).stop 2024-08-20T05:14:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.908+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3724947754 shutdown_connections 2024-08-20T05:14:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.908+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/3724947754 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564675b9f760 0x564675ba1b50 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.908+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/3724947754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b7e620 0x564675b94f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.908+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/3724947754 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b7bbe0 0x564675b94420 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.908+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/3724947754 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b792b0 0x564675b93d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.908+0000 7f1e26a00640 0 client.28447 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:22.910 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.908+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3724947754 >> 172.21.15.37:0/3724947754 conn(0x564675b743b0 msgr2=0x564675b734d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.908+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3724947754 shutdown_connections 2024-08-20T05:14:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.909+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3724947754 wait complete. 2024-08-20T05:14:22.911 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.909+0000 7f1e4b06e740 20 client.28447 trim_cache size 0 max 16384 2024-08-20T05:14:22.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.947+0000 7f1e4b06e740 1 Processor -- start 2024-08-20T05:14:22.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.947+0000 7f1e4b06e740 1 -- start start 2024-08-20T05:14:22.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.947+0000 7f1e4b06e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b792b0 0x564675b93270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.947+0000 7f1e4b06e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b7e620 0x564675b802b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.947+0000 7f1e4b06e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b807f0 0x564675b7eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.947+0000 7f1e4b06e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e401b1a40 con 0x564675b792b0 2024-08-20T05:14:22.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.947+0000 7f1e4b06e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1e401b3580 con 0x564675b7e620 2024-08-20T05:14:22.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.947+0000 7f1e4b06e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1e401b2110 con 0x564675b807f0 2024-08-20T05:14:22.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.948+0000 7f1e46000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b807f0 0x564675b7eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.948+0000 7f1e46000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b807f0 0x564675b7eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:40956/0 (socket says 172.21.15.37:40956) 2024-08-20T05:14:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.948+0000 7f1e46000640 1 -- 172.21.15.37:0/3765766130 learned_addr learned my addr 172.21.15.37:0/3765766130 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.948+0000 7f1e46000640 1 -- 172.21.15.37:0/3765766130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b7e620 msgr2=0x564675b802b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:14:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.948+0000 7f1e46000640 1 --2- 172.21.15.37:0/3765766130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b7e620 0x564675b802b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.948+0000 7f1e46000640 1 -- 172.21.15.37:0/3765766130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b792b0 msgr2=0x564675b93270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.948+0000 7f1e46000640 1 --2- 172.21.15.37:0/3765766130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b792b0 0x564675b93270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.948+0000 7f1e46000640 1 -- 172.21.15.37:0/3765766130 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646758b7620 con 0x564675b807f0 2024-08-20T05:14:22.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.948+0000 7f1e46000640 1 --2- 172.21.15.37:0/3765766130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b807f0 0x564675b7eab0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1e38018780 tx=0x7f1e38013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57881f69f56db306 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.949+0000 7f1e31c00640 1 -- 172.21.15.37:0/3765766130 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e38004d20 con 0x564675b807f0 2024-08-20T05:14:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.949+0000 7f1e31c00640 1 -- 172.21.15.37:0/3765766130 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e38017d60 con 0x564675b807f0 2024-08-20T05:14:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.949+0000 7f1e31c00640 1 -- 172.21.15.37:0/3765766130 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e380057e0 con 0x564675b807f0 2024-08-20T05:14:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.950+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3765766130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b807f0 msgr2=0x564675b7eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.950+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/3765766130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b807f0 0x564675b7eab0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1e38018780 tx=0x7f1e38013000 comp rx=0 tx=0).stop 2024-08-20T05:14:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.950+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3765766130 shutdown_connections 2024-08-20T05:14:22.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.950+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/3765766130 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b807f0 0x564675b7eab0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.950+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/3765766130 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b7e620 0x564675b802b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.950+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/3765766130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b792b0 0x564675b93270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.950+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3765766130 >> 172.21.15.37:0/3765766130 conn(0x564675b743b0 msgr2=0x564675b6f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.951+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3765766130 shutdown_connections 2024-08-20T05:14:22.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.951+0000 7f1e4b06e740 1 -- 172.21.15.37:0/3765766130 wait complete. 2024-08-20T05:14:22.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.951+0000 7f1e4b06e740 1 -- start start 2024-08-20T05:14:22.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.952+0000 7f1e4b06e740 1 Processor -- start 2024-08-20T05:14:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.953+0000 7f1e4b06e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b792b0 0x564675b9baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.953+0000 7f1e4b06e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b7e620 0x564675b9a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.953+0000 7f1e4b06e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b807f0 0x564675b9ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.954+0000 7f1e4b06e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1e401b2eb0 con 0x564675b792b0 2024-08-20T05:14:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.954+0000 7f1e46000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b807f0 0x564675b9ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.954+0000 7f1e46000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b807f0 0x564675b9ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45586/0 (socket says 172.21.15.37:45586) 2024-08-20T05:14:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.954+0000 7f1e46000640 1 -- 172.21.15.37:0/1509632511 learned_addr learned my addr 172.21.15.37:0/1509632511 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.954+0000 7f1e4b06e740 1 -- 172.21.15.37:0/1509632511 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1e401b27e0 con 0x564675b807f0 2024-08-20T05:14:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.954+0000 7f1e4b06e740 1 -- 172.21.15.37:0/1509632511 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1e401afa20 con 0x564675b7e620 2024-08-20T05:14:22.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.954+0000 7f1e4b06e740 10 client.0 _ll_register_callbacks cb 0x7f1e2c011fa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.955+0000 7f1e46000640 1 -- 172.21.15.37:0/1509632511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b7e620 msgr2=0x564675b9a7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:14:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.955+0000 7f1e46000640 1 --2- 172.21.15.37:0/1509632511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b7e620 0x564675b9a7f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.955+0000 7f1e46000640 1 -- 172.21.15.37:0/1509632511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b792b0 msgr2=0x564675b9baf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:14:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.956+0000 7f1e45600640 1 --2- 172.21.15.37:0/1509632511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b792b0 0x564675b9baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.957+0000 7f1e46000640 1 --2- 172.21.15.37:0/1509632511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b792b0 0x564675b9baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.957+0000 7f1e46000640 1 -- 172.21.15.37:0/1509632511 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564675b9b560 con 0x564675b807f0 2024-08-20T05:14:22.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.957+0000 7f1e4b06e740 1 -- 172.21.15.37:0/1509632511 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e38017d60 con 0x564675b807f0 2024-08-20T05:14:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.959+0000 7f1e46000640 1 --2- 172.21.15.37:0/1509632511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b807f0 0x564675b9ad30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1e38006010 tx=0x7f1e38005710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acccfb3857d14646 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.959+0000 7f1e26a00640 10 client.28409 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:14:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.961+0000 7f1e26a00640 1 -- 172.21.15.37:0/1509632511 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e38003970 con 0x564675b807f0 2024-08-20T05:14:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.961+0000 7f1e26a00640 1 -- 172.21.15.37:0/1509632511 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1e38003b10 con 0x564675b807f0 2024-08-20T05:14:22.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.961+0000 7f1e26a00640 1 -- 172.21.15.37:0/1509632511 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f1e38003d70 con 0x564675b807f0 2024-08-20T05:14:22.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.963+0000 7f1e4b06e740 10 client.28409 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:22.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.963+0000 7f1e4b06e740 1 -- 172.21.15.37:0/1509632511 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({fsmap=48}) -- 0x564675c0a3e0 con 0x564675b807f0 2024-08-20T05:14:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.965+0000 7f1e26a00640 1 -- 172.21.15.37:0/1509632511 <== mon.2 v2:172.21.15.130:3300/0 4 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f1e38023070 con 0x564675b807f0 2024-08-20T05:14:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.965+0000 7f1e4b06e740 10 client.28409 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.965+0000 7f1e4b06e740 10 client.28409 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:14:22.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.965+0000 7f1e4b06e740 20 client.28409 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.965+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/1509632511 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564675c0ab00 0x564675c0cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.965+0000 7f1e4b06e740 4 client.28409 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:14:22.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.965+0000 7f1e4b06e740 1 -- 172.21.15.37:0/1509632511 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564675ae9c00 con 0x564675c0ab00 2024-08-20T05:14:22.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.968+0000 7f1e45600640 1 --2- 172.21.15.37:0/1509632511 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564675c0ab00 0x564675c0cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:22.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.969+0000 7f1e26a00640 10 client.28409 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:22.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.969+0000 7f1e45600640 1 --2- 172.21.15.37:0/1509632511 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564675c0ab00 0x564675c0cf20 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ef4c5b6f3ef965e server_cookie=ea9fc0c311d5442b in_seq=0 out_seq=0 2024-08-20T05:14:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.990+0000 7f1e26a00640 1 -- 172.21.15.37:0/1509632511 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564675ae9c00 con 0x564675c0ab00 2024-08-20T05:14:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.990+0000 7f1e26a00640 10 client.28409 handle_command_reply: tid=0 2024-08-20T05:14:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.990+0000 7f1e4b06e740 1 client.28409 shutdown 2024-08-20T05:14:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.992+0000 7f1e4b06e740 1 -- 172.21.15.37:0/1509632511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b807f0 msgr2=0x564675b9ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.992+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/1509632511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b807f0 0x564675b9ad30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1e38006010 tx=0x7f1e38005710 comp rx=0 tx=0).stop 2024-08-20T05:14:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.992+0000 7f1e4b06e740 1 -- 172.21.15.37:0/1509632511 shutdown_connections 2024-08-20T05:14:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.992+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/1509632511 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564675c0ab00 0x564675c0cf20 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.992+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/1509632511 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564675b807f0 0x564675b9ad30 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.992+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/1509632511 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564675b7e620 0x564675b9a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.992+0000 7f1e4b06e740 1 --2- 172.21.15.37:0/1509632511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564675b792b0 0x564675b9baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.992+0000 7f1e26a00640 0 client.28409 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.992+0000 7f1e4b06e740 1 -- 172.21.15.37:0/1509632511 >> 172.21.15.37:0/1509632511 conn(0x564675b743b0 msgr2=0x564675b6f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.992+0000 7f1e4b06e740 1 -- 172.21.15.37:0/1509632511 shutdown_connections 2024-08-20T05:14:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.992+0000 7f1e4b06e740 1 -- 172.21.15.37:0/1509632511 wait complete. 2024-08-20T05:14:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:14:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:14:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:14:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:14:22.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.993+0000 7f1e4b06e740 20 client.28409 trim_cache size 0 max 16384 2024-08-20T05:14:22.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.994+0000 7f1e48000640 1 -- 172.21.15.37:0/1208675503 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e280b3c50 msgr2=0x7f1e280b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.994+0000 7f1e48000640 1 --2- 172.21.15.37:0/1208675503 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e280b3c50 0x7f1e280b6110 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1e401a4260 tx=0x7f1e3800a5f0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.994+0000 7f1e48000640 1 -- 172.21.15.37:0/1208675503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4006dea0 msgr2=0x7f1e401a3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:22.996 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.994+0000 7f1e48000640 1 --2- 172.21.15.37:0/1208675503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4006dea0 0x7f1e401a3b30 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c00b4a0 tx=0x7f1e2c00b960 comp rx=0 tx=0).stop 2024-08-20T05:14:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.994+0000 7f1e48000640 1 -- 172.21.15.37:0/1208675503 shutdown_connections 2024-08-20T05:14:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.994+0000 7f1e48000640 1 --2- 172.21.15.37:0/1208675503 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e280b3c50 0x7f1e280b6110 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.994+0000 7f1e48000640 1 --2- 172.21.15.37:0/1208675503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e4006e860 0x7f1e401a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.994+0000 7f1e48000640 1 --2- 172.21.15.37:0/1208675503 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1e4006dea0 0x7f1e401a3b30 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.994+0000 7f1e48000640 1 --2- 172.21.15.37:0/1208675503 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1e4006cd50 0x7f1e401a34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.994+0000 7f1e48000640 1 -- 172.21.15.37:0/1208675503 >> 172.21.15.37:0/1208675503 conn(0x7f1e400fc580 msgr2=0x7f1e400fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.994+0000 7f1e48000640 1 -- 172.21.15.37:0/1208675503 shutdown_connections 2024-08-20T05:14:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:22.994+0000 7f1e48000640 1 -- 172.21.15.37:0/1208675503 wait complete. 2024-08-20T05:14:23.040 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 685.0 s, 514.2 tps, lat 185.268 ms stddev 205.478 2024-08-20T05:14:23.502 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T05:14:23.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:23 smithi037 ceph-mon[17265]: pgmap v765: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 3.6 MiB/s wr, 270 op/s 2024-08-20T05:14:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:23 smithi135 ceph-mon[22342]: pgmap v765: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 3.6 MiB/s wr, 270 op/s 2024-08-20T05:14:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:23 smithi130 ceph-mon[22007]: pgmap v765: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 3.6 MiB/s wr, 270 op/s 2024-08-20T05:14:24.234 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:14:25.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.661+0000 7f0a39000640 1 -- 172.21.15.37:0/1918070928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a34109e80 msgr2=0x7f0a3410a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:25.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.661+0000 7f0a39000640 1 --2- 172.21.15.37:0/1918070928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a34109e80 0x7f0a3410a260 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0a24009890 tx=0x7f0a2402a3b0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.661+0000 7f0a39000640 1 -- 172.21.15.37:0/1918070928 shutdown_connections 2024-08-20T05:14:25.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.661+0000 7f0a39000640 1 --2- 172.21.15.37:0/1918070928 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a34115740 0x7f0a34117b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.661+0000 7f0a39000640 1 --2- 172.21.15.37:0/1918070928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a3410a7a0 0x7f0a34115200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.661+0000 7f0a39000640 1 --2- 172.21.15.37:0/1918070928 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a34109e80 0x7f0a3410a260 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.661+0000 7f0a39000640 1 -- 172.21.15.37:0/1918070928 >> 172.21.15.37:0/1918070928 conn(0x7f0a3406cc20 msgr2=0x7f0a3406d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:25.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.661+0000 7f0a39000640 1 -- 172.21.15.37:0/1918070928 shutdown_connections 2024-08-20T05:14:25.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.661+0000 7f0a39000640 1 -- 172.21.15.37:0/1918070928 wait complete. 2024-08-20T05:14:25.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.664+0000 7f0a39000640 1 Processor -- start 2024-08-20T05:14:25.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.664+0000 7f0a39000640 1 -- start start 2024-08-20T05:14:25.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.665+0000 7f0a39000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a34109e80 0x7f0a3410b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.665+0000 7f0a39000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a3410a7a0 0x7f0a3410b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.665+0000 7f0a39000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a34115740 0x7f0a3410bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.666+0000 7f0a39000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3411b180 con 0x7f0a3410a7a0 2024-08-20T05:14:25.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.666+0000 7f0a39000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3411b000 con 0x7f0a34115740 2024-08-20T05:14:25.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.666+0000 7f0a39000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3411b300 con 0x7f0a34109e80 2024-08-20T05:14:25.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.666+0000 7f0a33e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a34115740 0x7f0a3410bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:25.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.666+0000 7f0a32a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a3410a7a0 0x7f0a3410b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:25.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.666+0000 7f0a33e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a34115740 0x7f0a3410bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45612/0 (socket says 172.21.15.37:45612) 2024-08-20T05:14:25.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.666+0000 7f0a33e00640 1 -- 172.21.15.37:0/975638119 learned_addr learned my addr 172.21.15.37:0/975638119 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.668+0000 7f0a32a00640 1 -- 172.21.15.37:0/975638119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a34109e80 msgr2=0x7f0a3410b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.668+0000 7f0a32a00640 1 --2- 172.21.15.37:0/975638119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a34109e80 0x7f0a3410b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.668+0000 7f0a32a00640 1 -- 172.21.15.37:0/975638119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a34115740 msgr2=0x7f0a3410bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.668+0000 7f0a32a00640 1 --2- 172.21.15.37:0/975638119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a34115740 0x7f0a3410bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.668+0000 7f0a32a00640 1 -- 172.21.15.37:0/975638119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a341afab0 con 0x7f0a3410a7a0 2024-08-20T05:14:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.669+0000 7f0a32a00640 1 --2- 172.21.15.37:0/975638119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a3410a7a0 0x7f0a3410b5f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000b3f0 tx=0x7f0a2000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.669+0000 7f0a2be00640 1 -- 172.21.15.37:0/975638119 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a20015020 con 0x7f0a3410a7a0 2024-08-20T05:14:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.669+0000 7f0a39000640 1 -- 172.21.15.37:0/975638119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a341afda0 con 0x7f0a3410a7a0 2024-08-20T05:14:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.669+0000 7f0a39000640 1 -- 172.21.15.37:0/975638119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a341b02b0 con 0x7f0a3410a7a0 2024-08-20T05:14:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.670+0000 7f0a2be00640 1 -- 172.21.15.37:0/975638119 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a20011ce0 con 0x7f0a3410a7a0 2024-08-20T05:14:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.670+0000 7f0a2be00640 1 -- 172.21.15.37:0/975638119 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a20010d80 con 0x7f0a3410a7a0 2024-08-20T05:14:25.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.677+0000 7f0a3cff5740 1 Processor -- start 2024-08-20T05:14:25.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.677+0000 7f0a3cff5740 1 -- start start 2024-08-20T05:14:25.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.679+0000 7f0a3cff5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bafb00 0x556c62bafee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.682 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:25 smithi037 ceph-mon[17265]: pgmap v766: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.6 MiB/s wr, 391 op/s 2024-08-20T05:14:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.679+0000 7f0a3cff5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bb0420 0x556c62bc4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.680+0000 7f0a33e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bafb00 0x556c62bafee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.680+0000 7f0a33e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bafb00 0x556c62bafee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45616/0 (socket says 172.21.15.37:45616) 2024-08-20T05:14:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.680+0000 7f0a33e00640 1 -- 172.21.15.37:0/1225187337 learned_addr learned my addr 172.21.15.37:0/1225187337 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.680+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1225187337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bc4bc0 0x556c62bc6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.680+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1225187337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556c62b25aa0 con 0x556c62bb0420 2024-08-20T05:14:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.680+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1225187337 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556c62b14fa0 con 0x556c62bafb00 2024-08-20T05:14:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.680+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1225187337 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556c62b18fe0 con 0x556c62bc4bc0 2024-08-20T05:14:25.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.681+0000 7f0a2be00640 1 -- 172.21.15.37:0/975638119 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0a20018020 con 0x7f0a3410a7a0 2024-08-20T05:14:25.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.681+0000 7f0a32a00640 1 --2- 172.21.15.37:0/1225187337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bc4bc0 0x556c62bc6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:25.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.683+0000 7f0a33400640 1 --2- 172.21.15.37:0/1225187337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bb0420 0x556c62bc4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:25.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.683+0000 7f0a2be00640 1 --2- 172.21.15.37:0/975638119 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0a180b3dc0 0x7f0a180b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.683+0000 7f0a2be00640 1 -- 172.21.15.37:0/975638119 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0a200e3800 con 0x7f0a3410a7a0 2024-08-20T05:14:25.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.688+0000 7f0a33e00640 1 -- 172.21.15.37:0/1225187337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bc4bc0 msgr2=0x556c62bc6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:25.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.688+0000 7f0a33e00640 1 --2- 172.21.15.37:0/1225187337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bc4bc0 0x556c62bc6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.688+0000 7f0a33e00640 1 -- 172.21.15.37:0/1225187337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bb0420 msgr2=0x556c62bc4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:25.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.688+0000 7f0a33e00640 1 --2- 172.21.15.37:0/1225187337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bb0420 0x556c62bc4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.688+0000 7f0a33e00640 1 -- 172.21.15.37:0/1225187337 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c62abb420 con 0x556c62bafb00 2024-08-20T05:14:25.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.689+0000 7f0a33e00640 1 --2- 172.21.15.37:0/1225187337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bafb00 0x556c62bafee0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00f500 tx=0x7f0a2c00f900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f577036cdb503e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:25.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.690+0000 7f0a33e00640 1 --2- 172.21.15.37:0/975638119 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0a180b3dc0 0x7f0a180b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:25.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.690+0000 7f0a28c00640 1 -- 172.21.15.37:0/1225187337 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c003b70 con 0x556c62bafb00 2024-08-20T05:14:25.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.690+0000 7f0a28c00640 1 -- 172.21.15.37:0/1225187337 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a2c003d10 con 0x556c62bafb00 2024-08-20T05:14:25.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.690+0000 7f0a28c00640 1 -- 172.21.15.37:0/1225187337 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c004680 con 0x556c62bafb00 2024-08-20T05:14:25.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.691+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1225187337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bafb00 msgr2=0x556c62bafee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:25.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.691+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1225187337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bafb00 0x556c62bafee0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00f500 tx=0x7f0a2c00f900 comp rx=0 tx=0).stop 2024-08-20T05:14:25.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.692+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1225187337 shutdown_connections 2024-08-20T05:14:25.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.692+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1225187337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bc4bc0 0x556c62bc6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.692+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1225187337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bb0420 0x556c62bc4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.692+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1225187337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bafb00 0x556c62bafee0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.692+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1225187337 >> 172.21.15.37:0/1225187337 conn(0x556c62bad930 msgr2=0x556c62baead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:25.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.692+0000 7f0a33e00640 1 --2- 172.21.15.37:0/975638119 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0a180b3dc0 0x7f0a180b6280 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c01c040 tx=0x7f0a2c01a450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:25.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.692+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1225187337 shutdown_connections 2024-08-20T05:14:25.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.693+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1225187337 wait complete. 2024-08-20T05:14:25.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.697+0000 7f0a3cff5740 1 -- start start 2024-08-20T05:14:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.698+0000 7f0a3cff5740 1 Processor -- start 2024-08-20T05:14:25.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.706+0000 7f0a3cff5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bafb00 0x556c62bc4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.706+0000 7f0a3cff5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bb0420 0x556c62bc17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.707+0000 7f0a3cff5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bc4bc0 0x556c62bc1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.707+0000 7f0a33400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bafb00 0x556c62bc4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:25.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.707+0000 7f0a32a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bb0420 0x556c62bc17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:25.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.709+0000 7f0a3cff5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556c62977700 con 0x556c62bc4bc0 2024-08-20T05:14:25.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.709+0000 7f0a3cff5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556c62ab0290 con 0x556c62bb0420 2024-08-20T05:14:25.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.709+0000 7f0a3cff5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556c62bc7870 con 0x556c62bafb00 2024-08-20T05:14:25.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.709+0000 7f0a3cff5740 10 client.0 _ll_register_callbacks cb 0x556c62b0f1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:25.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.713+0000 7f0a32a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bb0420 0x556c62bc17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45624/0 (socket says 172.21.15.37:45624) 2024-08-20T05:14:25.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.708+0000 7f0a33400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bafb00 0x556c62bc4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41004/0 (socket says 172.21.15.37:41004) 2024-08-20T05:14:25.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.713+0000 7f0a33400640 1 -- 172.21.15.37:0/1394273001 learned_addr learned my addr 172.21.15.37:0/1394273001 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:25.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.715+0000 7f0a33400640 1 -- 172.21.15.37:0/1394273001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bb0420 msgr2=0x556c62bc17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:25.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.717+0000 7f0a33400640 1 --2- 172.21.15.37:0/1394273001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bb0420 0x556c62bc17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.724+0000 7f0a33400640 1 -- 172.21.15.37:0/1394273001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bc4bc0 msgr2=0x556c62bc1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:25.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.724+0000 7f0a33400640 1 --2- 172.21.15.37:0/1394273001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bc4bc0 0x556c62bc1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.725+0000 7f0a33400640 1 -- 172.21.15.37:0/1394273001 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c62874650 con 0x556c62bafb00 2024-08-20T05:14:25.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.725+0000 7f0a32a00640 1 --2- 172.21.15.37:0/1394273001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bb0420 0x556c62bc17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:14:25.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.726+0000 7f0a1d600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:14:25.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.726+0000 7f0a33400640 1 --2- 172.21.15.37:0/1394273001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bafb00 0x556c62bc4390 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0a24034000 tx=0x7f0a24004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9d6d9acc98190e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:25.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.727+0000 7f0a1d600640 1 -- 172.21.15.37:0/1394273001 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24040020 con 0x556c62bafb00 2024-08-20T05:14:25.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.727+0000 7f0a1d600640 1 -- 172.21.15.37:0/1394273001 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0a24030680 con 0x556c62bafb00 2024-08-20T05:14:25.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.727+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1394273001 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a2c003d10 con 0x556c62bafb00 2024-08-20T05:14:25.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.728+0000 7f0a1d600640 1 -- 172.21.15.37:0/1394273001 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f0a24037070 con 0x556c62bafb00 2024-08-20T05:14:25.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.728+0000 7f0a3cff5740 10 client.28459 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:25.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.728+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1394273001 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x556c62bd3080 con 0x556c62bafb00 2024-08-20T05:14:25.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.729+0000 7f0a1d600640 1 -- 172.21.15.37:0/1394273001 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a2c003d10 con 0x556c62bafb00 2024-08-20T05:14:25.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.733+0000 7f0a1d600640 1 -- 172.21.15.37:0/1394273001 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f0a24005040 con 0x556c62bafb00 2024-08-20T05:14:25.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.733+0000 7f0a3cff5740 10 client.28459 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:25.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.733+0000 7f0a3cff5740 10 client.28459 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:14:25.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.733+0000 7f0a3cff5740 20 client.28459 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.733+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1394273001 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x556c62bd4530 0x556c62bd6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.734+0000 7f0a3cff5740 4 client.28459 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:14:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.734+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1394273001 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c62b279f0 con 0x556c62bd4530 2024-08-20T05:14:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.734+0000 7f0a32a00640 1 --2- 172.21.15.37:0/1394273001 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x556c62bd4530 0x556c62bd6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:25.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.735+0000 7f0a32a00640 1 --2- 172.21.15.37:0/1394273001 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x556c62bd4530 0x556c62bd6980 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=254dde26a1309431 server_cookie=dcde802cb3eb870e in_seq=0 out_seq=0 2024-08-20T05:14:25.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.735+0000 7f0a1d600640 10 client.28459 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:14:25.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.736+0000 7f0a1d600640 1 -- 172.21.15.37:0/1394273001 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556c62b279f0 con 0x556c62bd4530 2024-08-20T05:14:25.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.736+0000 7f0a1d600640 10 client.28459 handle_command_reply: tid=0 2024-08-20T05:14:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.737+0000 7f0a3cff5740 1 client.28459 shutdown 2024-08-20T05:14:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.737+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1394273001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bafb00 msgr2=0x556c62bc4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.737+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1394273001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bafb00 0x556c62bc4390 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0a24034000 tx=0x7f0a24004270 comp rx=0 tx=0).stop 2024-08-20T05:14:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.738+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1394273001 shutdown_connections 2024-08-20T05:14:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.738+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1394273001 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x556c62bd4530 0x556c62bd6980 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.738+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1394273001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bc4bc0 0x556c62bc1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.738+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1394273001 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bb0420 0x556c62bc17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.738+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1394273001 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bafb00 0x556c62bc4390 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.738+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1394273001 >> 172.21.15.37:0/1394273001 conn(0x556c62bad930 msgr2=0x556c62bb34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.738+0000 7f0a1d600640 0 client.28459 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:14:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.738+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1394273001 shutdown_connections 2024-08-20T05:14:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.738+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1394273001 wait complete. 2024-08-20T05:14:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.739+0000 7f0a3cff5740 20 client.28459 trim_cache size 0 max 16384 2024-08-20T05:14:25.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.772+0000 7f0a3cff5740 1 Processor -- start 2024-08-20T05:14:25.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.773+0000 7f0a3cff5740 1 -- start start 2024-08-20T05:14:25.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.774+0000 7f0a3cff5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bafb00 0x556c62bd0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.774+0000 7f0a3cff5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bb0420 0x556c62bb4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.774+0000 7f0a3cff5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bc4bc0 0x556c62bdc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.774+0000 7f0a3cff5740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a341b5cb0 con 0x556c62bb0420 2024-08-20T05:14:25.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.774+0000 7f0a3cff5740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0a341b77f0 con 0x556c62bafb00 2024-08-20T05:14:25.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.774+0000 7f0a3cff5740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0a341b6380 con 0x556c62bc4bc0 2024-08-20T05:14:25.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.774+0000 7f0a33400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bafb00 0x556c62bd0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:25.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.774+0000 7f0a33400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bafb00 0x556c62bd0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45628/0 (socket says 172.21.15.37:45628) 2024-08-20T05:14:25.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.774+0000 7f0a33400640 1 -- 172.21.15.37:0/1223993474 learned_addr learned my addr 172.21.15.37:0/1223993474 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:25.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.774+0000 7f0a33e00640 1 --2- 172.21.15.37:0/1223993474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bc4bc0 0x556c62bdc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:25.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.775+0000 7f0a32a00640 1 --2- 172.21.15.37:0/1223993474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bb0420 0x556c62bb4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:25.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.775+0000 7f0a33400640 1 -- 172.21.15.37:0/1223993474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bc4bc0 msgr2=0x556c62bdc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:25.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.775+0000 7f0a33400640 1 --2- 172.21.15.37:0/1223993474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bc4bc0 0x556c62bdc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.775+0000 7f0a33400640 1 -- 172.21.15.37:0/1223993474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bb0420 msgr2=0x556c62bb4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:25.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.775+0000 7f0a33400640 1 --2- 172.21.15.37:0/1223993474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bb0420 0x556c62bb4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.775+0000 7f0a33400640 1 -- 172.21.15.37:0/1223993474 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c62bd7000 con 0x556c62bafb00 2024-08-20T05:14:25.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.776+0000 7f0a33400640 1 --2- 172.21.15.37:0/1223993474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bafb00 0x556c62bd0990 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0a24009890 tx=0x7f0a2402aaf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5596085803a4cfd3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:25.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.777+0000 7f0a1fe00640 1 -- 172.21.15.37:0/1223993474 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24074070 con 0x556c62bafb00 2024-08-20T05:14:25.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.777+0000 7f0a1fe00640 1 -- 172.21.15.37:0/1223993474 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a24038040 con 0x556c62bafb00 2024-08-20T05:14:25.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.777+0000 7f0a1fe00640 1 -- 172.21.15.37:0/1223993474 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24040070 con 0x556c62bafb00 2024-08-20T05:14:25.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.778+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1223993474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bafb00 msgr2=0x556c62bd0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:25.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.778+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1223993474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bafb00 0x556c62bd0990 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0a24009890 tx=0x7f0a2402aaf0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.779+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1223993474 shutdown_connections 2024-08-20T05:14:25.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.779+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1223993474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bc4bc0 0x556c62bdc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.779+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1223993474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bb0420 0x556c62bb4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.779+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1223993474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bafb00 0x556c62bd0990 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.779+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1223993474 >> 172.21.15.37:0/1223993474 conn(0x556c62bad930 msgr2=0x556c62bb3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:25.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.779+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1223993474 shutdown_connections 2024-08-20T05:14:25.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.780+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1223993474 wait complete. 2024-08-20T05:14:25.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.781+0000 7f0a3cff5740 1 -- start start 2024-08-20T05:14:25.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.781+0000 7f0a3cff5740 1 Processor -- start 2024-08-20T05:14:25.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.782+0000 7f0a3cff5740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bafb00 0x556c62bccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.782+0000 7f0a3cff5740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bb0420 0x556c62bc9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.784+0000 7f0a32a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bb0420 0x556c62bc9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:25.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.784+0000 7f0a33400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bafb00 0x556c62bccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:25.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.784+0000 7f0a3cff5740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bc4bc0 0x556c62bc9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.784+0000 7f0a33400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bafb00 0x556c62bccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41024/0 (socket says 172.21.15.37:41024) 2024-08-20T05:14:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.785+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1195934401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0a341b7120 con 0x556c62bc4bc0 2024-08-20T05:14:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.785+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1195934401 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0a341b6a50 con 0x556c62bb0420 2024-08-20T05:14:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.785+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1195934401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0a341b3d10 con 0x556c62bafb00 2024-08-20T05:14:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.785+0000 7f0a3cff5740 10 client.0 _ll_register_callbacks cb 0x7f0a24035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.785+0000 7f0a33400640 1 -- 172.21.15.37:0/1195934401 learned_addr learned my addr 172.21.15.37:0/1195934401 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.785+0000 7f0a33400640 1 -- 172.21.15.37:0/1195934401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bb0420 msgr2=0x556c62bc9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.785+0000 7f0a33400640 1 --2- 172.21.15.37:0/1195934401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bb0420 0x556c62bc9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.785+0000 7f0a33400640 1 -- 172.21.15.37:0/1195934401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bc4bc0 msgr2=0x556c62bc9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.785+0000 7f0a33400640 1 --2- 172.21.15.37:0/1195934401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bc4bc0 0x556c62bc9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.786+0000 7f0a33400640 1 -- 172.21.15.37:0/1195934401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c62bc9f70 con 0x556c62bafb00 2024-08-20T05:14:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.786+0000 7f0a33400640 1 --2- 172.21.15.37:0/1195934401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bafb00 0x556c62bccf60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0a24030420 tx=0x7f0a24003800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55e911ee998d9929 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.786+0000 7f0a1d600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:14:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.787+0000 7f0a1d600640 1 -- 172.21.15.37:0/1195934401 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24040070 con 0x556c62bafb00 2024-08-20T05:14:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.787+0000 7f0a1d600640 1 -- 172.21.15.37:0/1195934401 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0a24030690 con 0x556c62bafb00 2024-08-20T05:14:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.788+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1195934401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a24038040 con 0x556c62bafb00 2024-08-20T05:14:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.788+0000 7f0a1d600640 1 -- 172.21.15.37:0/1195934401 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f0a24074070 con 0x556c62bafb00 2024-08-20T05:14:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.788+0000 7f0a3cff5740 10 client.28465 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:25.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.788+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1195934401 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x556c62bc0ae0 con 0x556c62bafb00 2024-08-20T05:14:25.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.789+0000 7f0a1d600640 1 -- 172.21.15.37:0/1195934401 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a24038040 con 0x556c62bafb00 2024-08-20T05:14:25.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.789+0000 7f0a1d600640 1 -- 172.21.15.37:0/1195934401 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f0a24070440 con 0x556c62bafb00 2024-08-20T05:14:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.789+0000 7f0a3cff5740 10 client.28465 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.789+0000 7f0a3cff5740 10 client.28465 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:14:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.789+0000 7f0a3cff5740 20 client.28465 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.789+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1195934401 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x556c62c371e0 0x556c62c395d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.789+0000 7f0a3cff5740 4 client.28465 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:14:25.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.789+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1195934401 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556c62b23490 con 0x556c62c371e0 2024-08-20T05:14:25.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.791+0000 7f0a32a00640 1 --2- 172.21.15.37:0/1195934401 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x556c62c371e0 0x556c62c395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:25.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.791+0000 7f0a32a00640 1 --2- 172.21.15.37:0/1195934401 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x556c62c371e0 0x556c62c395d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d7ba6025bb16aac2 server_cookie=3dded551699320d2 in_seq=0 out_seq=0 2024-08-20T05:14:25.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.791+0000 7f0a1d600640 10 client.28465 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:14:25.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.792+0000 7f0a1d600640 1 -- 172.21.15.37:0/1195934401 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556c62b23490 con 0x556c62c371e0 2024-08-20T05:14:25.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.792+0000 7f0a1d600640 10 client.28465 handle_command_reply: tid=0 2024-08-20T05:14:25.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.792+0000 7f0a3cff5740 1 client.28465 shutdown 2024-08-20T05:14:25.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.794+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1195934401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bafb00 msgr2=0x556c62bccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:25.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.794+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1195934401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bafb00 0x556c62bccf60 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0a24030420 tx=0x7f0a24003800 comp rx=0 tx=0).stop 2024-08-20T05:14:25.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.794+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1195934401 shutdown_connections 2024-08-20T05:14:25.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.794+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1195934401 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x556c62c371e0 0x556c62c395d0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.794+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1195934401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c62bc4bc0 0x556c62bc9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.794+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1195934401 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c62bb0420 0x556c62bc9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.794+0000 7f0a3cff5740 1 --2- 172.21.15.37:0/1195934401 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c62bafb00 0x556c62bccf60 secure :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0a24030420 tx=0x7f0a24003800 comp rx=0 tx=0).stop 2024-08-20T05:14:25.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.794+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1195934401 >> 172.21.15.37:0/1195934401 conn(0x556c62bad930 msgr2=0x556c62bac2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:25.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.794+0000 7f0a1d600640 0 client.28465 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:14:25.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.794+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1195934401 shutdown_connections 2024-08-20T05:14:25.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.794+0000 7f0a3cff5740 1 -- 172.21.15.37:0/1195934401 wait complete. 2024-08-20T05:14:25.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.795+0000 7f0a3cff5740 20 client.28465 trim_cache size 0 max 16384 2024-08-20T05:14:25.798 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:14:25.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.797+0000 7f0a39000640 1 -- 172.21.15.37:0/975638119 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0a180b3dc0 msgr2=0x7f0a180b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:25.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.797+0000 7f0a39000640 1 --2- 172.21.15.37:0/975638119 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0a180b3dc0 0x7f0a180b6280 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c01c040 tx=0x7f0a2c01a450 comp rx=0 tx=0).stop 2024-08-20T05:14:25.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.797+0000 7f0a39000640 1 -- 172.21.15.37:0/975638119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a3410a7a0 msgr2=0x7f0a3410b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:25.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.797+0000 7f0a39000640 1 --2- 172.21.15.37:0/975638119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a3410a7a0 0x7f0a3410b5f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000b3f0 tx=0x7f0a2000b8b0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.798+0000 7f0a39000640 1 -- 172.21.15.37:0/975638119 shutdown_connections 2024-08-20T05:14:25.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.798+0000 7f0a39000640 1 --2- 172.21.15.37:0/975638119 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0a180b3dc0 0x7f0a180b6280 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.798+0000 7f0a39000640 1 --2- 172.21.15.37:0/975638119 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0a34115740 0x7f0a3410bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.798+0000 7f0a39000640 1 --2- 172.21.15.37:0/975638119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a3410a7a0 0x7f0a3410b5f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.798+0000 7f0a39000640 1 --2- 172.21.15.37:0/975638119 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0a34109e80 0x7f0a3410b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:25.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.798+0000 7f0a39000640 1 -- 172.21.15.37:0/975638119 >> 172.21.15.37:0/975638119 conn(0x7f0a3406cc20 msgr2=0x7f0a34072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:25.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.798+0000 7f0a39000640 1 -- 172.21.15.37:0/975638119 shutdown_connections 2024-08-20T05:14:25.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:25.798+0000 7f0a39000640 1 -- 172.21.15.37:0/975638119 wait complete. 2024-08-20T05:14:25.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:25 smithi135 ceph-mon[22342]: pgmap v766: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.6 MiB/s wr, 391 op/s 2024-08-20T05:14:25.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:25 smithi130 ceph-mon[22007]: pgmap v766: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 4.6 MiB/s wr, 391 op/s 2024-08-20T05:14:27.075 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T05:14:27.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:27 smithi135 ceph-mon[22342]: pgmap v767: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.0 MiB/s wr, 481 op/s 2024-08-20T05:14:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:27 smithi130 ceph-mon[22007]: pgmap v767: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.0 MiB/s wr, 481 op/s 2024-08-20T05:14:28.019 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:27 smithi037 ceph-mon[17265]: pgmap v767: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.0 MiB/s wr, 481 op/s 2024-08-20T05:14:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 690.0 s, 663.0 tps, lat 144.257 ms stddev 189.281 2024-08-20T05:14:28.158 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:14:28.589 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:28 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:14:28.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:28 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:14:28.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:28 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:14:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.680+0000 7f22a4a00640 1 -- 172.21.15.37:0/3947171855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a010aea0 msgr2=0x7f22a01116a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.680+0000 7f22a4a00640 1 --2- 172.21.15.37:0/3947171855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a010aea0 0x7f22a01116a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2298009ca0 tx=0x7f229802a8c0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.681+0000 7f22a4a00640 1 -- 172.21.15.37:0/3947171855 shutdown_connections 2024-08-20T05:14:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.681+0000 7f22a4a00640 1 --2- 172.21.15.37:0/3947171855 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a010aea0 0x7f22a01116a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.681+0000 7f22a4a00640 1 --2- 172.21.15.37:0/3947171855 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22a010a520 0x7f22a010a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.681+0000 7f22a4a00640 1 --2- 172.21.15.37:0/3947171855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22a0104b10 0x7f22a0104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.681+0000 7f22a4a00640 1 -- 172.21.15.37:0/3947171855 >> 172.21.15.37:0/3947171855 conn(0x7f22a0100540 msgr2=0x7f22a0102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.682+0000 7f22a4a00640 1 -- 172.21.15.37:0/3947171855 shutdown_connections 2024-08-20T05:14:29.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.682+0000 7f22a4a00640 1 -- 172.21.15.37:0/3947171855 wait complete. 2024-08-20T05:14:29.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.683+0000 7f22a4a00640 1 Processor -- start 2024-08-20T05:14:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.683+0000 7f22a4a00640 1 -- start start 2024-08-20T05:14:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.684+0000 7f22a4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22a0104b10 0x7f22a00773e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.684+0000 7f22a4a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22a010a520 0x7f22a0077920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.684+0000 7f22a4a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a010aea0 0x7f22a0077e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.684+0000 7f22a4a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f22a0114b20 con 0x7f22a0104b10 2024-08-20T05:14:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.684+0000 7f22a4a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01149a0 con 0x7f22a010a520 2024-08-20T05:14:29.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.684+0000 7f22a4a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22a0114ca0 con 0x7f22a010aea0 2024-08-20T05:14:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.684+0000 7f2297e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22a010a520 0x7f22a0077920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.685+0000 7f229e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22a0104b10 0x7f22a00773e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.685+0000 7f229e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22a0104b10 0x7f22a00773e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52444/0 (socket says 172.21.15.37:52444) 2024-08-20T05:14:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.685+0000 7f229e800640 1 -- 172.21.15.37:0/2788255023 learned_addr learned my addr 172.21.15.37:0/2788255023 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.685+0000 7f229f200640 1 --2- 172.21.15.37:0/2788255023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a010aea0 0x7f22a0077e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.685+0000 7f229f200640 1 -- 172.21.15.37:0/2788255023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22a010a520 msgr2=0x7f22a0077920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.685+0000 7f229f200640 1 --2- 172.21.15.37:0/2788255023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22a010a520 0x7f22a0077920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.685+0000 7f229f200640 1 -- 172.21.15.37:0/2788255023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22a0104b10 msgr2=0x7f22a00773e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.685+0000 7f229f200640 1 --2- 172.21.15.37:0/2788255023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22a0104b10 0x7f22a00773e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.685+0000 7f229f200640 1 -- 172.21.15.37:0/2788255023 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a0073610 con 0x7f22a010aea0 2024-08-20T05:14:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.686+0000 7f229f200640 1 --2- 172.21.15.37:0/2788255023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a010aea0 0x7f22a0077e60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f229802aeb0 tx=0x7f2298003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.686+0000 7f2297400640 1 -- 172.21.15.37:0/2788255023 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298031900 con 0x7f22a010aea0 2024-08-20T05:14:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.686+0000 7f2297400640 1 -- 172.21.15.37:0/2788255023 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f22980044f0 con 0x7f22a010aea0 2024-08-20T05:14:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.686+0000 7f2297400640 1 -- 172.21.15.37:0/2788255023 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298030cb0 con 0x7f22a010aea0 2024-08-20T05:14:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.686+0000 7f22a4a00640 1 -- 172.21.15.37:0/2788255023 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a00738a0 con 0x7f22a010aea0 2024-08-20T05:14:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.686+0000 7f22a4a00640 1 -- 172.21.15.37:0/2788255023 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a0073cd0 con 0x7f22a010aea0 2024-08-20T05:14:29.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.691+0000 7f22a7ec7740 1 Processor -- start 2024-08-20T05:14:29.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.691+0000 7f2297400640 1 -- 172.21.15.37:0/2788255023 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f22980046a0 con 0x7f22a010aea0 2024-08-20T05:14:29.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.692+0000 7f22a7ec7740 1 -- start start 2024-08-20T05:14:29.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.692+0000 7f22a7ec7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d4ac0 0x55ec784d4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.692+0000 7f22a7ec7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784d53e0 0x55ec784e0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.692+0000 7f22a7ec7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 0x55ec784e3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.692+0000 7f22a7ec7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ec7844aaa0 con 0x55ec784d53e0 2024-08-20T05:14:29.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.692+0000 7f22a7ec7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ec78439fa0 con 0x55ec784d4ac0 2024-08-20T05:14:29.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.692+0000 7f22a7ec7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ec7843dfe0 con 0x55ec784e1370 2024-08-20T05:14:29.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.693+0000 7f2297e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d4ac0 0x55ec784d4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:29.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.693+0000 7f2297e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 0x55ec784e3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:29.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.693+0000 7f2297e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 0x55ec784e3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41056/0 (socket says 172.21.15.37:41056) 2024-08-20T05:14:29.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.693+0000 7f2297e00640 1 -- 172.21.15.37:0/2799975087 learned_addr learned my addr 172.21.15.37:0/2799975087 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:29.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.693+0000 7f2297e00640 1 -- 172.21.15.37:0/2799975087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d4ac0 msgr2=0x55ec784d4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:29.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.693+0000 7f2297e00640 1 --2- 172.21.15.37:0/2799975087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d4ac0 0x55ec784d4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.693+0000 7f2297e00640 1 -- 172.21.15.37:0/2799975087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784d53e0 msgr2=0x55ec784e0e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:14:29.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.693+0000 7f2297e00640 1 --2- 172.21.15.37:0/2799975087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784d53e0 0x55ec784e0e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.693+0000 7f2297e00640 1 -- 172.21.15.37:0/2799975087 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec783e0420 con 0x55ec784e1370 2024-08-20T05:14:29.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.694+0000 7f2297e00640 1 --2- 172.21.15.37:0/2799975087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 0x55ec784e3760 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f22880108e0 tx=0x7f2288005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=379999e52c27a92c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:29.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.694+0000 7f2297400640 1 --2- 172.21.15.37:0/2788255023 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22800b3d40 0x7f22800b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.694+0000 7f228f400640 1 -- 172.21.15.37:0/2799975087 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288010e60 con 0x55ec784e1370 2024-08-20T05:14:29.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.694+0000 7f228f400640 1 -- 172.21.15.37:0/2799975087 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f228801e3b0 con 0x55ec784e1370 2024-08-20T05:14:29.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.694+0000 7f228f400640 1 -- 172.21.15.37:0/2799975087 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288016030 con 0x55ec784e1370 2024-08-20T05:14:29.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.694+0000 7f2297400640 1 -- 172.21.15.37:0/2788255023 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2298105250 con 0x7f22a010aea0 2024-08-20T05:14:29.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.695+0000 7f229e800640 1 --2- 172.21.15.37:0/2788255023 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22800b3d40 0x7f22800b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:29.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.695+0000 7f22a7ec7740 1 -- 172.21.15.37:0/2799975087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 msgr2=0x55ec784e3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:29.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.695+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/2799975087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 0x55ec784e3760 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f22880108e0 tx=0x7f2288005f90 comp rx=0 tx=0).stop 2024-08-20T05:14:29.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.696+0000 7f229e800640 1 --2- 172.21.15.37:0/2788255023 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22800b3d40 0x7f22800b6200 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x55ec784d37d0 tx=0x7f229000b2c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:29.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.696+0000 7f22a7ec7740 1 -- 172.21.15.37:0/2799975087 shutdown_connections 2024-08-20T05:14:29.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.696+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/2799975087 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 0x55ec784e3760 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.696+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/2799975087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784d53e0 0x55ec784e0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.696+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/2799975087 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d4ac0 0x55ec784d4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.696+0000 7f22a7ec7740 1 -- 172.21.15.37:0/2799975087 >> 172.21.15.37:0/2799975087 conn(0x55ec784d28f0 msgr2=0x55ec784d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:29.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.696+0000 7f22a7ec7740 1 -- 172.21.15.37:0/2799975087 shutdown_connections 2024-08-20T05:14:29.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.696+0000 7f22a7ec7740 1 -- 172.21.15.37:0/2799975087 wait complete. 2024-08-20T05:14:29.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.697+0000 7f22a7ec7740 1 -- start start 2024-08-20T05:14:29.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.697+0000 7f22a7ec7740 1 Processor -- start 2024-08-20T05:14:29.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.702+0000 7f22a7ec7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784d4ac0 0x55ec784e0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.702+0000 7f22a7ec7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d53e0 0x55ec784ddfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.702+0000 7f22a7ec7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784e1370 0x55ec784de4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.702+0000 7f22a7ec7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ec7829c700 con 0x55ec784e1370 2024-08-20T05:14:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.702+0000 7f22a7ec7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ec783d5290 con 0x55ec784d53e0 2024-08-20T05:14:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.702+0000 7f22a7ec7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ec784e3ff0 con 0x55ec784d4ac0 2024-08-20T05:14:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.703+0000 7f229e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784d4ac0 0x55ec784e0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:29.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.703+0000 7f229e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784d4ac0 0x55ec784e0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41068/0 (socket says 172.21.15.37:41068) 2024-08-20T05:14:29.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.703+0000 7f229e800640 1 -- 172.21.15.37:0/3186619257 learned_addr learned my addr 172.21.15.37:0/3186619257 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:29.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.703+0000 7f2297e00640 1 --2- 172.21.15.37:0/3186619257 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d53e0 0x55ec784ddfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:29.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.702+0000 7f22a7ec7740 10 client.0 _ll_register_callbacks cb 0x55ec784341c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:29.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.703+0000 7f229f200640 1 --2- 172.21.15.37:0/3186619257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784e1370 0x55ec784de4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:29.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.704+0000 7f229e800640 1 -- 172.21.15.37:0/3186619257 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d53e0 msgr2=0x55ec784ddfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:29.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.704+0000 7f229e800640 1 --2- 172.21.15.37:0/3186619257 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d53e0 0x55ec784ddfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.704+0000 7f229e800640 1 -- 172.21.15.37:0/3186619257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784e1370 msgr2=0x55ec784de4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:29.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.704+0000 7f229e800640 1 --2- 172.21.15.37:0/3186619257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784e1370 0x55ec784de4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.704+0000 7f229e800640 1 -- 172.21.15.37:0/3186619257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec78199650 con 0x55ec784d4ac0 2024-08-20T05:14:29.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.704+0000 7f229f200640 1 --2- 172.21.15.37:0/3186619257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784e1370 0x55ec784de4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:14:29.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.705+0000 7f229e800640 1 --2- 172.21.15.37:0/3186619257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784d4ac0 0x55ec784e0b60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2290011440 tx=0x7f22900046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=625d4e2f2dfc53ba server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:29.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.705+0000 7f2287e00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:14:29.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.705+0000 7f2287e00640 1 -- 172.21.15.37:0/3186619257 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2290022070 con 0x55ec784d4ac0 2024-08-20T05:14:29.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.705+0000 7f2287e00640 1 -- 172.21.15.37:0/3186619257 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2290005220 con 0x55ec784d4ac0 2024-08-20T05:14:29.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.709+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3186619257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f228801e3b0 con 0x55ec784d4ac0 2024-08-20T05:14:29.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.711+0000 7f2287e00640 1 -- 172.21.15.37:0/3186619257 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f229002b050 con 0x55ec784d4ac0 2024-08-20T05:14:29.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.711+0000 7f22a7ec7740 10 client.28477 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:29.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.711+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3186619257 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55ec784ef860 con 0x55ec784d4ac0 2024-08-20T05:14:29.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.714+0000 7f2287e00640 1 -- 172.21.15.37:0/3186619257 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f228801e3b0 con 0x55ec784d4ac0 2024-08-20T05:14:29.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.719+0000 7f2287e00640 1 -- 172.21.15.37:0/3186619257 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f22900047a0 con 0x55ec784d4ac0 2024-08-20T05:14:29.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.719+0000 7f22a7ec7740 10 client.28477 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:29.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.719+0000 7f22a7ec7740 10 client.28477 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:14:29.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.719+0000 7f22a7ec7740 20 client.28477 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:29.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.719+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/3186619257 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55ec784f0dc0 0x55ec784f3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.719+0000 7f22a7ec7740 4 client.28477 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:14:29.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.719+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3186619257 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec7844c9f0 con 0x55ec784f0dc0 2024-08-20T05:14:29.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.720+0000 7f2297e00640 1 --2- 172.21.15.37:0/3186619257 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55ec784f0dc0 0x55ec784f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:29.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.723+0000 7f2297e00640 1 --2- 172.21.15.37:0/3186619257 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55ec784f0dc0 0x55ec784f3210 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d0bcf00e0577f4a6 server_cookie=9f57cdbffdad287d in_seq=0 out_seq=0 2024-08-20T05:14:29.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.723+0000 7f2287e00640 10 client.28477 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:14:29.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:29 smithi037 ceph-mon[17265]: pgmap v768: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.9 MiB/s wr, 509 op/s 2024-08-20T05:14:29.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:14:29.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:14:29.725 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:14:29.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.728+0000 7f2287e00640 1 -- 172.21.15.37:0/3186619257 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec7844c9f0 con 0x55ec784f0dc0 2024-08-20T05:14:29.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.728+0000 7f2287e00640 10 client.28477 handle_command_reply: tid=0 2024-08-20T05:14:29.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.728+0000 7f22a7ec7740 1 client.28477 shutdown 2024-08-20T05:14:29.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.728+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3186619257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784d4ac0 msgr2=0x55ec784e0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:29.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.728+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/3186619257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784d4ac0 0x55ec784e0b60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2290011440 tx=0x7f22900046c0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.729+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3186619257 shutdown_connections 2024-08-20T05:14:29.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.729+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/3186619257 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55ec784f0dc0 0x55ec784f3210 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.729+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/3186619257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784e1370 0x55ec784de4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.729+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/3186619257 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d53e0 0x55ec784ddfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.729+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/3186619257 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784d4ac0 0x55ec784e0b60 secure :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2290011440 tx=0x7f22900046c0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.729+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3186619257 >> 172.21.15.37:0/3186619257 conn(0x55ec784d28f0 msgr2=0x55ec784d8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.729+0000 7f2287e00640 0 client.28477 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:14:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.729+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3186619257 shutdown_connections 2024-08-20T05:14:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.729+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3186619257 wait complete. 2024-08-20T05:14:29.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.731+0000 7f22a7ec7740 20 client.28477 trim_cache size 0 max 16384 2024-08-20T05:14:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.769+0000 7f22a7ec7740 1 Processor -- start 2024-08-20T05:14:29.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.769+0000 7f22a7ec7740 1 -- start start 2024-08-20T05:14:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.769+0000 7f22a7ec7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d53e0 0x55ec784ed110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.769+0000 7f22a7ec7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 0x55ec784f8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.769+0000 7f22a7ec7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784f9020 0x55ec784dc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.769+0000 7f22a7ec7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01c6b60 con 0x55ec784f9020 2024-08-20T05:14:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.769+0000 7f22a7ec7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01c86a0 con 0x55ec784d53e0 2024-08-20T05:14:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.770+0000 7f22a7ec7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01c7230 con 0x55ec784e1370 2024-08-20T05:14:29.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.770+0000 7f2297e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 0x55ec784f8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:29.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.771+0000 7f2297e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 0x55ec784f8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41076/0 (socket says 172.21.15.37:41076) 2024-08-20T05:14:29.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.771+0000 7f2297e00640 1 -- 172.21.15.37:0/282536752 learned_addr learned my addr 172.21.15.37:0/282536752 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:29.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.771+0000 7f229e800640 1 --2- 172.21.15.37:0/282536752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d53e0 0x55ec784ed110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:29.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.772+0000 7f229f200640 1 --2- 172.21.15.37:0/282536752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784f9020 0x55ec784dc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:29.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.772+0000 7f2297e00640 1 -- 172.21.15.37:0/282536752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d53e0 msgr2=0x55ec784ed110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:29.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.772+0000 7f2297e00640 1 --2- 172.21.15.37:0/282536752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d53e0 0x55ec784ed110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.772+0000 7f2297e00640 1 -- 172.21.15.37:0/282536752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784f9020 msgr2=0x55ec784dc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:29.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.772+0000 7f2297e00640 1 --2- 172.21.15.37:0/282536752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784f9020 0x55ec784dc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.772+0000 7f2297e00640 1 -- 172.21.15.37:0/282536752 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec784ddd60 con 0x55ec784e1370 2024-08-20T05:14:29.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.772+0000 7f229e800640 1 --2- 172.21.15.37:0/282536752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d53e0 0x55ec784ed110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:14:29.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.773+0000 7f2297e00640 1 --2- 172.21.15.37:0/282536752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 0x55ec784f8ae0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f228801eda0 tx=0x7f2288009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=709a5175844c6836 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:29.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.773+0000 7f228ea00640 1 -- 172.21.15.37:0/282536752 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288016050 con 0x55ec784e1370 2024-08-20T05:14:29.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.773+0000 7f228ea00640 1 -- 172.21.15.37:0/282536752 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2288031070 con 0x55ec784e1370 2024-08-20T05:14:29.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.773+0000 7f228ea00640 1 -- 172.21.15.37:0/282536752 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288010e60 con 0x55ec784e1370 2024-08-20T05:14:29.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.774+0000 7f22a7ec7740 1 -- 172.21.15.37:0/282536752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 msgr2=0x55ec784f8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:29.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.774+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/282536752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 0x55ec784f8ae0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f228801eda0 tx=0x7f2288009260 comp rx=0 tx=0).stop 2024-08-20T05:14:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.776+0000 7f22a7ec7740 1 -- 172.21.15.37:0/282536752 shutdown_connections 2024-08-20T05:14:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.776+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/282536752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784f9020 0x55ec784dc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.776+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/282536752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 0x55ec784f8ae0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.776+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/282536752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d53e0 0x55ec784ed110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.776+0000 7f22a7ec7740 1 -- 172.21.15.37:0/282536752 >> 172.21.15.37:0/282536752 conn(0x55ec784d28f0 msgr2=0x55ec784d9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:29.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.776+0000 7f22a7ec7740 1 -- 172.21.15.37:0/282536752 shutdown_connections 2024-08-20T05:14:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.776+0000 7f22a7ec7740 1 -- 172.21.15.37:0/282536752 wait complete. 2024-08-20T05:14:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.777+0000 7f22a7ec7740 1 -- start start 2024-08-20T05:14:29.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.777+0000 7f22a7ec7740 1 Processor -- start 2024-08-20T05:14:29.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.780+0000 7f22a7ec7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d53e0 0x55ec784e97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.780+0000 7f22a7ec7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 0x55ec784e4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.781+0000 7f22a7ec7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784f9020 0x55ec784e51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.781+0000 7f229e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d53e0 0x55ec784e97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.781+0000 7f229e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d53e0 0x55ec784e97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45684/0 (socket says 172.21.15.37:45684) 2024-08-20T05:14:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.781+0000 7f2297e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 0x55ec784e4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.781+0000 7f2297e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 0x55ec784e4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:41092/0 (socket says 172.21.15.37:41092) 2024-08-20T05:14:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.782+0000 7f229e800640 1 -- 172.21.15.37:0/3826944178 learned_addr learned my addr 172.21.15.37:0/3826944178 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.782+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3826944178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01c7fd0 con 0x55ec784f9020 2024-08-20T05:14:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.782+0000 7f229f200640 1 --2- 172.21.15.37:0/3826944178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784f9020 0x55ec784e51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.782+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3826944178 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01c7900 con 0x55ec784d53e0 2024-08-20T05:14:29.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.782+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3826944178 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f22a01b1b10 con 0x55ec784e1370 2024-08-20T05:14:29.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.783+0000 7f22a7ec7740 10 client.0 _ll_register_callbacks cb 0x7f2290015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:29.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.784+0000 7f229f200640 1 -- 172.21.15.37:0/3826944178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 msgr2=0x55ec784e4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:29.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.784+0000 7f229f200640 1 --2- 172.21.15.37:0/3826944178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 0x55ec784e4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.784+0000 7f229f200640 1 -- 172.21.15.37:0/3826944178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d53e0 msgr2=0x55ec784e97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:29.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.784+0000 7f229f200640 1 --2- 172.21.15.37:0/3826944178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d53e0 0x55ec784e97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.784+0000 7f229f200640 1 -- 172.21.15.37:0/3826944178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec784e58c0 con 0x55ec784f9020 2024-08-20T05:14:29.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.785+0000 7f229f200640 1 --2- 172.21.15.37:0/3826944178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784f9020 0x55ec784e51d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f2298102d20 tx=0x7f22980cb9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7060394db95c588 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:29.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.785+0000 7f2287e00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:14:29.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.786+0000 7f2287e00640 1 -- 172.21.15.37:0/3826944178 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22980e6060 con 0x55ec784f9020 2024-08-20T05:14:29.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.786+0000 7f2287e00640 1 -- 172.21.15.37:0/3826944178 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f22980c8090 con 0x55ec784f9020 2024-08-20T05:14:29.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.788+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3826944178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2288031070 con 0x55ec784f9020 2024-08-20T05:14:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.790+0000 7f2287e00640 1 -- 172.21.15.37:0/3826944178 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f22980eb050 con 0x55ec784f9020 2024-08-20T05:14:29.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.790+0000 7f22a7ec7740 10 client.17859 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:29.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.790+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3826944178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55ec7855b9f0 con 0x55ec784f9020 2024-08-20T05:14:29.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.790+0000 7f2287e00640 1 -- 172.21.15.37:0/3826944178 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2288031070 con 0x55ec784f9020 2024-08-20T05:14:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.792+0000 7f2287e00640 1 -- 172.21.15.37:0/3826944178 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f22980cc130 con 0x55ec784f9020 2024-08-20T05:14:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.792+0000 7f22a7ec7740 10 client.17859 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.792+0000 7f22a7ec7740 10 client.17859 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:14:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.792+0000 7f22a7ec7740 20 client.17859 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.792+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/3826944178 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55ec7855c0f0 0x55ec7855e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.792+0000 7f22a7ec7740 4 client.17859 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:14:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.792+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3826944178 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ec78448490 con 0x55ec7855c0f0 2024-08-20T05:14:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.794+0000 7f229e800640 1 --2- 172.21.15.37:0/3826944178 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55ec7855c0f0 0x55ec7855e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:29.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.796+0000 7f229e800640 1 --2- 172.21.15.37:0/3826944178 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55ec7855c0f0 0x55ec7855e510 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9d60257d30fc7bc0 server_cookie=53fd4722e29ed5de in_seq=0 out_seq=0 2024-08-20T05:14:29.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.797+0000 7f2287e00640 10 client.17859 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:14:29.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.797+0000 7f2287e00640 1 -- 172.21.15.37:0/3826944178 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ec78448490 con 0x55ec7855c0f0 2024-08-20T05:14:29.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.797+0000 7f2287e00640 10 client.17859 handle_command_reply: tid=0 2024-08-20T05:14:29.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.797+0000 7f22a7ec7740 1 client.17859 shutdown 2024-08-20T05:14:29.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.797+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3826944178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784f9020 msgr2=0x55ec784e51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:29.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.797+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/3826944178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784f9020 0x55ec784e51d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f2298102d20 tx=0x7f22980cb9d0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.798+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3826944178 shutdown_connections 2024-08-20T05:14:29.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.798+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/3826944178 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55ec7855c0f0 0x55ec7855e510 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.798+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/3826944178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ec784f9020 0x55ec784e51d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.798+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/3826944178 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ec784e1370 0x55ec784e4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.798+0000 7f22a7ec7740 1 --2- 172.21.15.37:0/3826944178 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ec784d53e0 0x55ec784e97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.798+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3826944178 >> 172.21.15.37:0/3826944178 conn(0x55ec784d28f0 msgr2=0x55ec784df5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:29.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.798+0000 7f2287e00640 0 client.17859 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:14:29.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.798+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3826944178 shutdown_connections 2024-08-20T05:14:29.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.798+0000 7f22a7ec7740 1 -- 172.21.15.37:0/3826944178 wait complete. 2024-08-20T05:14:29.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.798+0000 7f22a7ec7740 20 client.17859 trim_cache size 0 max 16384 2024-08-20T05:14:29.802 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:14:29.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.800+0000 7f22a4a00640 1 -- 172.21.15.37:0/2788255023 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22800b3d40 msgr2=0x7f22800b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:29.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.800+0000 7f22a4a00640 1 --2- 172.21.15.37:0/2788255023 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22800b3d40 0x7f22800b6200 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x55ec784d37d0 tx=0x7f229000b2c0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.800+0000 7f22a4a00640 1 -- 172.21.15.37:0/2788255023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a010aea0 msgr2=0x7f22a0077e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:29.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.800+0000 7f22a4a00640 1 --2- 172.21.15.37:0/2788255023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a010aea0 0x7f22a0077e60 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f229802aeb0 tx=0x7f2298003ba0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.800+0000 7f22a4a00640 1 -- 172.21.15.37:0/2788255023 shutdown_connections 2024-08-20T05:14:29.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.800+0000 7f22a4a00640 1 --2- 172.21.15.37:0/2788255023 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f22800b3d40 0x7f22800b6200 secure :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0x55ec784d37d0 tx=0x7f229000b2c0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.800+0000 7f22a4a00640 1 --2- 172.21.15.37:0/2788255023 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f22a010aea0 0x7f22a0077e60 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.800+0000 7f22a4a00640 1 --2- 172.21.15.37:0/2788255023 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f22a010a520 0x7f22a0077920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.800+0000 7f22a4a00640 1 --2- 172.21.15.37:0/2788255023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22a0104b10 0x7f22a00773e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:29.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.800+0000 7f22a4a00640 1 -- 172.21.15.37:0/2788255023 >> 172.21.15.37:0/2788255023 conn(0x7f22a0100540 msgr2=0x7f22a0100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:29.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.800+0000 7f22a4a00640 1 -- 172.21.15.37:0/2788255023 shutdown_connections 2024-08-20T05:14:29.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:29.802+0000 7f22a4a00640 1 -- 172.21.15.37:0/2788255023 wait complete. 2024-08-20T05:14:29.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:29 smithi135 ceph-mon[22342]: pgmap v768: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.9 MiB/s wr, 509 op/s 2024-08-20T05:14:29.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:14:29.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:14:29.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:14:29.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:29 smithi130 ceph-mon[22007]: pgmap v768: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.9 MiB/s wr, 509 op/s 2024-08-20T05:14:29.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:14:29.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:14:29.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:14:30.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:30 smithi135 ceph-mon[22342]: pgmap v769: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 6.7 MiB/s wr, 591 op/s 2024-08-20T05:14:30.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:30 smithi130 ceph-mon[22007]: pgmap v769: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 6.7 MiB/s wr, 591 op/s 2024-08-20T05:14:31.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:30 smithi037 ceph-mon[17265]: pgmap v769: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 6.7 MiB/s wr, 591 op/s 2024-08-20T05:14:31.887 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T05:14:32.671 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:14:33.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 695.0 s, 628.6 tps, lat 164.395 ms stddev 263.952 2024-08-20T05:14:33.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.508+0000 7f573ec00640 1 -- 172.21.15.37:0/1990978669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f573810a4f0 msgr2=0x7f573810a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:33.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.508+0000 7f573ec00640 1 --2- 172.21.15.37:0/1990978669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f573810a4f0 0x7f573810a930 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f572c009900 tx=0x7f572c02a400 comp rx=0 tx=0).stop 2024-08-20T05:14:33.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.508+0000 7f573ec00640 1 -- 172.21.15.37:0/1990978669 shutdown_connections 2024-08-20T05:14:33.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.508+0000 7f573ec00640 1 --2- 172.21.15.37:0/1990978669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f573810ae70 0x7f5738111670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.508+0000 7f573ec00640 1 --2- 172.21.15.37:0/1990978669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f573810a4f0 0x7f573810a930 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.508+0000 7f573ec00640 1 --2- 172.21.15.37:0/1990978669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5738104ae0 0x7f5738104ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.508+0000 7f573ec00640 1 -- 172.21.15.37:0/1990978669 >> 172.21.15.37:0/1990978669 conn(0x7f57381004f0 msgr2=0x7f5738102910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:33.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.509+0000 7f573ec00640 1 -- 172.21.15.37:0/1990978669 shutdown_connections 2024-08-20T05:14:33.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.510+0000 7f573ec00640 1 -- 172.21.15.37:0/1990978669 wait complete. 2024-08-20T05:14:33.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.511+0000 7f573ec00640 1 Processor -- start 2024-08-20T05:14:33.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.512+0000 7f573ec00640 1 -- start start 2024-08-20T05:14:33.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.515+0000 7f573ec00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5738104ae0 0x7f5738111300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.516+0000 7f573ec00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f573810a4f0 0x7f573810e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.516+0000 7f5737e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5738104ae0 0x7f5738111300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:33.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.516+0000 7f5737e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5738104ae0 0x7f5738111300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35118/0 (socket says 172.21.15.37:35118) 2024-08-20T05:14:33.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.516+0000 7f5737e00640 1 -- 172.21.15.37:0/776368745 learned_addr learned my addr 172.21.15.37:0/776368745 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:33.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.517+0000 7f5737400640 1 --2- 172.21.15.37:0/776368745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f573810a4f0 0x7f573810e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:33.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.517+0000 7f573ec00640 1 --2- 172.21.15.37:0/776368745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f573810ae70 0x7f573810ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.518+0000 7f573ec00640 1 -- 172.21.15.37:0/776368745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5738114b80 con 0x7f573810ae70 2024-08-20T05:14:33.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.518+0000 7f573ec00640 1 -- 172.21.15.37:0/776368745 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5738114a00 con 0x7f573810a4f0 2024-08-20T05:14:33.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.518+0000 7f573ec00640 1 -- 172.21.15.37:0/776368745 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5738114d00 con 0x7f5738104ae0 2024-08-20T05:14:33.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.518+0000 7f573cc00640 1 --2- 172.21.15.37:0/776368745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f573810ae70 0x7f573810ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.519+0000 7f5737400640 1 -- 172.21.15.37:0/776368745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5738104ae0 msgr2=0x7f5738111300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.519+0000 7f5737400640 1 --2- 172.21.15.37:0/776368745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5738104ae0 0x7f5738111300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.519+0000 7f5737400640 1 -- 172.21.15.37:0/776368745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f573810ae70 msgr2=0x7f573810ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.519+0000 7f5737400640 1 --2- 172.21.15.37:0/776368745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f573810ae70 0x7f573810ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.519+0000 7f5737400640 1 -- 172.21.15.37:0/776368745 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573810f260 con 0x7f573810a4f0 2024-08-20T05:14:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.520+0000 7f5737400640 1 --2- 172.21.15.37:0/776368745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f573810a4f0 0x7f573810e550 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f572c02a9f0 tx=0x7f572c003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.521+0000 7f5734c00640 1 -- 172.21.15.37:0/776368745 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c03f070 con 0x7f573810a4f0 2024-08-20T05:14:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.521+0000 7f5734c00640 1 -- 172.21.15.37:0/776368745 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f572c031b50 con 0x7f573810a4f0 2024-08-20T05:14:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.522+0000 7f573ec00640 1 -- 172.21.15.37:0/776368745 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57381a1060 con 0x7f573810a4f0 2024-08-20T05:14:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.522+0000 7f5734c00640 1 -- 172.21.15.37:0/776368745 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c035030 con 0x7f573810a4f0 2024-08-20T05:14:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.523+0000 7f573ec00640 1 -- 172.21.15.37:0/776368745 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57381a1590 con 0x7f573810a4f0 2024-08-20T05:14:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.527+0000 7f5741842740 1 Processor -- start 2024-08-20T05:14:33.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.530+0000 7f5741842740 1 -- start start 2024-08-20T05:14:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.530+0000 7f5741842740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f59b40 0x556154f59f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.531+0000 7f5741842740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f5a460 0x556154f65eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.531+0000 7f5741842740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f663f0 0x556154f687e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.531+0000 7f5741842740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556154ecfaa0 con 0x556154f663f0 2024-08-20T05:14:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.531+0000 7f5741842740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556154ebefa0 con 0x556154f59b40 2024-08-20T05:14:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.531+0000 7f5741842740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556154ec2fe0 con 0x556154f5a460 2024-08-20T05:14:33.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.531+0000 7f573cc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f59b40 0x556154f59f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.531+0000 7f5737e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f5a460 0x556154f65eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.531+0000 7f5737e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f5a460 0x556154f65eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35130/0 (socket says 172.21.15.37:35130) 2024-08-20T05:14:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.531+0000 7f5737e00640 1 -- 172.21.15.37:0/2620391556 learned_addr learned my addr 172.21.15.37:0/2620391556 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:33.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.532+0000 7f5737e00640 1 -- 172.21.15.37:0/2620391556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f59b40 msgr2=0x556154f59f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:33.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.532+0000 7f5737e00640 1 --2- 172.21.15.37:0/2620391556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f59b40 0x556154f59f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.532+0000 7f5737e00640 1 -- 172.21.15.37:0/2620391556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f663f0 msgr2=0x556154f687e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:14:33.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.532+0000 7f5737e00640 1 --2- 172.21.15.37:0/2620391556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f663f0 0x556154f687e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.532+0000 7f5737e00640 1 -- 172.21.15.37:0/2620391556 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556154e65420 con 0x556154f5a460 2024-08-20T05:14:33.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.532+0000 7f5737e00640 1 --2- 172.21.15.37:0/2620391556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f5a460 0x556154f65eb0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f573000a890 tx=0x7f573000f8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f96fa7383ce3400 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:33.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.533+0000 7f5729200640 1 -- 172.21.15.37:0/2620391556 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573000d860 con 0x556154f5a460 2024-08-20T05:14:33.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.533+0000 7f5729200640 1 -- 172.21.15.37:0/2620391556 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57300173e0 con 0x556154f5a460 2024-08-20T05:14:33.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.533+0000 7f5729200640 1 -- 172.21.15.37:0/2620391556 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57300165f0 con 0x556154f5a460 2024-08-20T05:14:33.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.533+0000 7f5734c00640 1 -- 172.21.15.37:0/776368745 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f572c042070 con 0x7f573810a4f0 2024-08-20T05:14:33.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.534+0000 7f5741842740 1 -- 172.21.15.37:0/2620391556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f5a460 msgr2=0x556154f65eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:33.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.534+0000 7f5741842740 1 --2- 172.21.15.37:0/2620391556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f5a460 0x556154f65eb0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f573000a890 tx=0x7f573000f8a0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.537+0000 7f5741842740 1 -- 172.21.15.37:0/2620391556 shutdown_connections 2024-08-20T05:14:33.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.537+0000 7f5741842740 1 --2- 172.21.15.37:0/2620391556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f663f0 0x556154f687e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.537+0000 7f5741842740 1 --2- 172.21.15.37:0/2620391556 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f5a460 0x556154f65eb0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.537+0000 7f5741842740 1 --2- 172.21.15.37:0/2620391556 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f59b40 0x556154f59f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.537+0000 7f5741842740 1 -- 172.21.15.37:0/2620391556 >> 172.21.15.37:0/2620391556 conn(0x556154f57970 msgr2=0x556154f58b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.537+0000 7f5741842740 1 -- 172.21.15.37:0/2620391556 shutdown_connections 2024-08-20T05:14:33.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.537+0000 7f5741842740 1 -- 172.21.15.37:0/2620391556 wait complete. 2024-08-20T05:14:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.538+0000 7f5734c00640 1 --2- 172.21.15.37:0/776368745 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57200b3cd0 0x7f57200b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.538+0000 7f5741842740 1 -- start start 2024-08-20T05:14:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.538+0000 7f5734c00640 1 -- 172.21.15.37:0/776368745 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f572c104510 con 0x7f573810a4f0 2024-08-20T05:14:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.538+0000 7f5741842740 1 Processor -- start 2024-08-20T05:14:33.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.540+0000 7f573cc00640 1 --2- 172.21.15.37:0/776368745 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57200b3cd0 0x7f57200b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.540+0000 7f5741842740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 0x556154f65cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.540+0000 7f5741842740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f5a460 0x556154f63110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.540+0000 7f5741842740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f663f0 0x556154f636d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.540+0000 7f5741842740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556154d21700 con 0x556154f59b40 2024-08-20T05:14:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.540+0000 7f5741842740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556154e5a290 con 0x556154f663f0 2024-08-20T05:14:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.540+0000 7f5741842740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556154f7a080 con 0x556154f5a460 2024-08-20T05:14:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.540+0000 7f5741842740 10 client.0 _ll_register_callbacks cb 0x556154eb91c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:33.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.541+0000 7f5737400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f5a460 0x556154f63110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:33.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.541+0000 7f573cc00640 1 --2- 172.21.15.37:0/776368745 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57200b3cd0 0x7f57200b6190 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5724009be0 tx=0x7f5724005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:33.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.541+0000 7f573cc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f663f0 0x556154f636d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:33.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.541+0000 7f573cc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f663f0 0x556154f636d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:54008/0 (socket says 172.21.15.37:54008) 2024-08-20T05:14:33.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.541+0000 7f573cc00640 1 -- 172.21.15.37:0/1367659140 learned_addr learned my addr 172.21.15.37:0/1367659140 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:33.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.542+0000 7f5737e00640 1 --2- 172.21.15.37:0/1367659140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 0x556154f65cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:33.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.542+0000 7f573cc00640 1 -- 172.21.15.37:0/1367659140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f5a460 msgr2=0x556154f63110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:33.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.542+0000 7f573cc00640 1 --2- 172.21.15.37:0/1367659140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f5a460 0x556154f63110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.542+0000 7f573cc00640 1 -- 172.21.15.37:0/1367659140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 msgr2=0x556154f65cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:33.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.542+0000 7f573cc00640 1 --2- 172.21.15.37:0/1367659140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 0x556154f65cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.542+0000 7f573cc00640 1 -- 172.21.15.37:0/1367659140 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556154c1e650 con 0x556154f663f0 2024-08-20T05:14:33.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.545+0000 7f573cc00640 1 --2- 172.21.15.37:0/1367659140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f663f0 0x556154f636d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5724011d00 tx=0x7f57240046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3f666863bb38e3b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:33.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.545+0000 7f571d600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:14:33.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.545+0000 7f571d600640 1 -- 172.21.15.37:0/1367659140 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5724005220 con 0x556154f663f0 2024-08-20T05:14:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.545+0000 7f571d600640 1 -- 172.21.15.37:0/1367659140 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f57240053c0 con 0x556154f663f0 2024-08-20T05:14:33.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.547+0000 7f5741842740 1 -- 172.21.15.37:0/1367659140 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57300173e0 con 0x556154f663f0 2024-08-20T05:14:33.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.547+0000 7f571d600640 1 -- 172.21.15.37:0/1367659140 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f57240055c0 con 0x556154f663f0 2024-08-20T05:14:33.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.547+0000 7f5741842740 10 client.28451 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:33.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.547+0000 7f5741842740 1 -- 172.21.15.37:0/1367659140 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x556154f85a30 con 0x556154f663f0 2024-08-20T05:14:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.548+0000 7f571d600640 1 -- 172.21.15.37:0/1367659140 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5724004c50 con 0x556154f663f0 2024-08-20T05:14:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.548+0000 7f571d600640 1 -- 172.21.15.37:0/1367659140 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f5724025070 con 0x556154f663f0 2024-08-20T05:14:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.548+0000 7f5741842740 10 client.28451 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.548+0000 7f5741842740 10 client.28451 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:14:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.548+0000 7f5741842740 20 client.28451 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.548+0000 7f5741842740 1 --2- 172.21.15.37:0/1367659140 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556154f86f30 0x556154f89350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.548+0000 7f5741842740 4 client.28451 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:14:33.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.549+0000 7f5741842740 1 -- 172.21.15.37:0/1367659140 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f57300173e0 con 0x556154f86f30 2024-08-20T05:14:33.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.549+0000 7f5737e00640 1 --2- 172.21.15.37:0/1367659140 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556154f86f30 0x556154f89350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:33.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.552+0000 7f5737e00640 1 --2- 172.21.15.37:0/1367659140 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556154f86f30 0x556154f89350 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e47d98aed1732a73 server_cookie=a78d1dc1250715d8 in_seq=0 out_seq=0 2024-08-20T05:14:33.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.552+0000 7f571d600640 10 client.28451 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:33.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.553+0000 7f571d600640 1 -- 172.21.15.37:0/1367659140 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f57300173e0 con 0x556154f86f30 2024-08-20T05:14:33.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.553+0000 7f571d600640 10 client.28451 handle_command_reply: tid=0 2024-08-20T05:14:33.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.553+0000 7f5741842740 1 client.28451 shutdown 2024-08-20T05:14:33.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.553+0000 7f5741842740 1 -- 172.21.15.37:0/1367659140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f663f0 msgr2=0x556154f636d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:33.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.553+0000 7f5741842740 1 --2- 172.21.15.37:0/1367659140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f663f0 0x556154f636d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5724011d00 tx=0x7f57240046c0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.554+0000 7f5741842740 1 -- 172.21.15.37:0/1367659140 shutdown_connections 2024-08-20T05:14:33.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.554+0000 7f5741842740 1 --2- 172.21.15.37:0/1367659140 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556154f86f30 0x556154f89350 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.554+0000 7f5741842740 1 --2- 172.21.15.37:0/1367659140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f663f0 0x556154f636d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.554+0000 7f5741842740 1 --2- 172.21.15.37:0/1367659140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f5a460 0x556154f63110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.554+0000 7f5741842740 1 --2- 172.21.15.37:0/1367659140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 0x556154f65cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.554+0000 7f5741842740 1 -- 172.21.15.37:0/1367659140 >> 172.21.15.37:0/1367659140 conn(0x556154f57970 msgr2=0x556154f56b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:33.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.554+0000 7f571d600640 0 client.28451 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:33.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.554+0000 7f5741842740 1 -- 172.21.15.37:0/1367659140 shutdown_connections 2024-08-20T05:14:33.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.555+0000 7f5741842740 1 -- 172.21.15.37:0/1367659140 wait complete. 2024-08-20T05:14:33.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.555+0000 7f5741842740 20 client.28451 trim_cache size 0 max 16384 2024-08-20T05:14:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.587+0000 7f5741842740 1 Processor -- start 2024-08-20T05:14:33.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.587+0000 7f5741842740 1 -- start start 2024-08-20T05:14:33.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.588+0000 7f5741842740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 0x556154f8ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.588+0000 7f5741842740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f5a460 0x556154f8f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.588+0000 7f5741842740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f663f0 0x556154f60320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.589+0000 7f5737e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 0x556154f8ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:33.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.589+0000 7f5737e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 0x556154f8ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49250/0 (socket says 172.21.15.37:49250) 2024-08-20T05:14:33.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.590+0000 7f5737e00640 1 -- 172.21.15.37:0/1190151645 learned_addr learned my addr 172.21.15.37:0/1190151645 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:33.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.590+0000 7f5737400640 1 --2- 172.21.15.37:0/1190151645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f5a460 0x556154f8f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:33.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.590+0000 7f5741842740 1 -- 172.21.15.37:0/1190151645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f57381b5b60 con 0x556154f59b40 2024-08-20T05:14:33.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.590+0000 7f5741842740 1 -- 172.21.15.37:0/1190151645 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f57381b76a0 con 0x556154f5a460 2024-08-20T05:14:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.590+0000 7f573cc00640 1 --2- 172.21.15.37:0/1190151645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f663f0 0x556154f60320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.590+0000 7f5741842740 1 -- 172.21.15.37:0/1190151645 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f57381b6230 con 0x556154f663f0 2024-08-20T05:14:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.591+0000 7f573cc00640 1 -- 172.21.15.37:0/1190151645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f5a460 msgr2=0x556154f8f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.591+0000 7f573cc00640 1 --2- 172.21.15.37:0/1190151645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f5a460 0x556154f8f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.591+0000 7f573cc00640 1 -- 172.21.15.37:0/1190151645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 msgr2=0x556154f8ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.591+0000 7f573cc00640 1 --2- 172.21.15.37:0/1190151645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 0x556154f8ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.591+0000 7f573cc00640 1 -- 172.21.15.37:0/1190151645 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556154f899d0 con 0x556154f663f0 2024-08-20T05:14:33.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.591+0000 7f5737e00640 1 --2- 172.21.15.37:0/1190151645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 0x556154f8ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:14:33.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.591+0000 7f5737400640 1 --2- 172.21.15.37:0/1190151645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f5a460 0x556154f8f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:14:33.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.592+0000 7f573cc00640 1 --2- 172.21.15.37:0/1190151645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f663f0 0x556154f60320 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5724011cd0 tx=0x7f5724009a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1fcdf7fd979dec3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:33.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.592+0000 7f571fe00640 1 -- 172.21.15.37:0/1190151645 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5724005020 con 0x556154f663f0 2024-08-20T05:14:33.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.592+0000 7f571fe00640 1 -- 172.21.15.37:0/1190151645 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5724030920 con 0x556154f663f0 2024-08-20T05:14:33.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.592+0000 7f571fe00640 1 -- 172.21.15.37:0/1190151645 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5724004d60 con 0x556154f663f0 2024-08-20T05:14:33.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.594+0000 7f5741842740 1 -- 172.21.15.37:0/1190151645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f663f0 msgr2=0x556154f60320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:33.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.594+0000 7f5741842740 1 --2- 172.21.15.37:0/1190151645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f663f0 0x556154f60320 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5724011cd0 tx=0x7f5724009a50 comp rx=0 tx=0).stop 2024-08-20T05:14:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.595+0000 7f5741842740 1 -- 172.21.15.37:0/1190151645 shutdown_connections 2024-08-20T05:14:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.595+0000 7f5741842740 1 --2- 172.21.15.37:0/1190151645 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f663f0 0x556154f60320 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.595+0000 7f5741842740 1 --2- 172.21.15.37:0/1190151645 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f5a460 0x556154f8f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.595+0000 7f5741842740 1 --2- 172.21.15.37:0/1190151645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 0x556154f8ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.597+0000 7f5741842740 1 -- 172.21.15.37:0/1190151645 >> 172.21.15.37:0/1190151645 conn(0x556154f57970 msgr2=0x556154f64f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:33.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.598+0000 7f5741842740 1 -- 172.21.15.37:0/1190151645 shutdown_connections 2024-08-20T05:14:33.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.598+0000 7f5741842740 1 -- 172.21.15.37:0/1190151645 wait complete. 2024-08-20T05:14:33.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.599+0000 7f5741842740 1 -- start start 2024-08-20T05:14:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.600+0000 7f5741842740 1 Processor -- start 2024-08-20T05:14:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.601+0000 7f5741842740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 0x556154f7fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.601+0000 7f5741842740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f5a460 0x556154f7d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.601+0000 7f5741842740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f663f0 0x556154f7d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.601+0000 7f5741842740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f57381b6fd0 con 0x556154f59b40 2024-08-20T05:14:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.601+0000 7f5741842740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f57381b6900 con 0x556154f5a460 2024-08-20T05:14:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.601+0000 7f5741842740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f57380733b0 con 0x556154f663f0 2024-08-20T05:14:33.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.601+0000 7f5741842740 10 client.0 _ll_register_callbacks cb 0x7f5724009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:33.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.601+0000 7f5737e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 0x556154f7fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:33.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.602+0000 7f5737e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 0x556154f7fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49254/0 (socket says 172.21.15.37:49254) 2024-08-20T05:14:33.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.602+0000 7f5737e00640 1 -- 172.21.15.37:0/3013235664 learned_addr learned my addr 172.21.15.37:0/3013235664 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:33.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.602+0000 7f573cc00640 1 --2- 172.21.15.37:0/3013235664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f663f0 0x556154f7d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:33.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.602+0000 7f5737e00640 1 -- 172.21.15.37:0/3013235664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f663f0 msgr2=0x556154f7d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:33.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.602+0000 7f5737e00640 1 --2- 172.21.15.37:0/3013235664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f663f0 0x556154f7d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.602+0000 7f5737e00640 1 -- 172.21.15.37:0/3013235664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f5a460 msgr2=0x556154f7d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:33.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.602+0000 7f5737e00640 1 --2- 172.21.15.37:0/3013235664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f5a460 0x556154f7d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.602+0000 7f5737e00640 1 -- 172.21.15.37:0/3013235664 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556154ff0c00 con 0x556154f59b40 2024-08-20T05:14:33.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.603+0000 7f5737e00640 1 --2- 172.21.15.37:0/3013235664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 0x556154f7fc50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f573000a890 tx=0x7f5730017d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fa8082822c9360 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:33.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.603+0000 7f571d600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:14:33.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.603+0000 7f571d600640 1 -- 172.21.15.37:0/3013235664 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5730017e10 con 0x556154f59b40 2024-08-20T05:14:33.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.604+0000 7f571d600640 1 -- 172.21.15.37:0/3013235664 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5730017610 con 0x556154f59b40 2024-08-20T05:14:33.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.604+0000 7f5741842740 1 -- 172.21.15.37:0/3013235664 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5724030920 con 0x556154f59b40 2024-08-20T05:14:33.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.604+0000 7f571d600640 1 -- 172.21.15.37:0/3013235664 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f5730034050 con 0x556154f59b40 2024-08-20T05:14:33.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.604+0000 7f5741842740 10 client.17871 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:33.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.604+0000 7f5741842740 1 -- 172.21.15.37:0/3013235664 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x556154ff1eb0 con 0x556154f59b40 2024-08-20T05:14:33.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.605+0000 7f573cc00640 1 --2- 172.21.15.37:0/3013235664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f663f0 0x556154f7d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:14:33.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.605+0000 7f571d600640 1 -- 172.21.15.37:0/3013235664 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5724030920 con 0x556154f59b40 2024-08-20T05:14:33.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.605+0000 7f571d600640 1 -- 172.21.15.37:0/3013235664 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f5730016070 con 0x556154f59b40 2024-08-20T05:14:33.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.605+0000 7f5741842740 10 client.17871 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:33.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.605+0000 7f5741842740 10 client.17871 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:14:33.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.605+0000 7f5741842740 20 client.17871 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:33.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.605+0000 7f5741842740 1 --2- 172.21.15.37:0/3013235664 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556154ff23c0 0x556154ff47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:33.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.605+0000 7f5741842740 4 client.17871 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:14:33.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.605+0000 7f5741842740 1 -- 172.21.15.37:0/3013235664 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556154ed19f0 con 0x556154ff23c0 2024-08-20T05:14:33.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.608+0000 7f5737400640 1 --2- 172.21.15.37:0/3013235664 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556154ff23c0 0x556154ff47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:33.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.610+0000 7f5737400640 1 --2- 172.21.15.37:0/3013235664 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556154ff23c0 0x556154ff47e0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1538ffba4d8a7fe server_cookie=55e9fd141225c281 in_seq=0 out_seq=0 2024-08-20T05:14:33.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.610+0000 7f571d600640 10 client.17871 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:33.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.610+0000 7f571d600640 1 -- 172.21.15.37:0/3013235664 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556154ed19f0 con 0x556154ff23c0 2024-08-20T05:14:33.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.610+0000 7f571d600640 10 client.17871 handle_command_reply: tid=0 2024-08-20T05:14:33.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.610+0000 7f5741842740 1 client.17871 shutdown 2024-08-20T05:14:33.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.611+0000 7f5741842740 1 -- 172.21.15.37:0/3013235664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 msgr2=0x556154f7fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:33.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.611+0000 7f5741842740 1 --2- 172.21.15.37:0/3013235664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 0x556154f7fc50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f573000a890 tx=0x7f5730017d00 comp rx=0 tx=0).stop 2024-08-20T05:14:33.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.611+0000 7f5741842740 1 -- 172.21.15.37:0/3013235664 shutdown_connections 2024-08-20T05:14:33.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.611+0000 7f5741842740 1 --2- 172.21.15.37:0/3013235664 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556154ff23c0 0x556154ff47e0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.611+0000 7f5741842740 1 --2- 172.21.15.37:0/3013235664 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556154f663f0 0x556154f7d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.611+0000 7f5741842740 1 --2- 172.21.15.37:0/3013235664 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556154f5a460 0x556154f7d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.611+0000 7f5741842740 1 --2- 172.21.15.37:0/3013235664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556154f59b40 0x556154f7fc50 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.611+0000 7f5741842740 1 -- 172.21.15.37:0/3013235664 >> 172.21.15.37:0/3013235664 conn(0x556154f57970 msgr2=0x556154f56370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:33.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.611+0000 7f571d600640 0 client.17871 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:33.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.611+0000 7f5741842740 1 -- 172.21.15.37:0/3013235664 shutdown_connections 2024-08-20T05:14:33.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.612+0000 7f5741842740 1 -- 172.21.15.37:0/3013235664 wait complete. 2024-08-20T05:14:33.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.612+0000 7f5741842740 20 client.17871 trim_cache size 0 max 16384 2024-08-20T05:14:33.617 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:14:33.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.616+0000 7f573ec00640 1 -- 172.21.15.37:0/776368745 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57200b3cd0 msgr2=0x7f57200b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:33.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.616+0000 7f573ec00640 1 --2- 172.21.15.37:0/776368745 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57200b3cd0 0x7f57200b6190 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5724009be0 tx=0x7f5724005f90 comp rx=0 tx=0).stop 2024-08-20T05:14:33.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.616+0000 7f573ec00640 1 -- 172.21.15.37:0/776368745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f573810a4f0 msgr2=0x7f573810e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:33.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.616+0000 7f573ec00640 1 --2- 172.21.15.37:0/776368745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f573810a4f0 0x7f573810e550 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f572c02a9f0 tx=0x7f572c003b90 comp rx=0 tx=0).stop 2024-08-20T05:14:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.618+0000 7f573ec00640 1 -- 172.21.15.37:0/776368745 shutdown_connections 2024-08-20T05:14:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.618+0000 7f573ec00640 1 --2- 172.21.15.37:0/776368745 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f57200b3cd0 0x7f57200b6190 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.618+0000 7f573ec00640 1 --2- 172.21.15.37:0/776368745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f573810ae70 0x7f573810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.618+0000 7f573ec00640 1 --2- 172.21.15.37:0/776368745 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f573810a4f0 0x7f573810e550 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.618+0000 7f573ec00640 1 --2- 172.21.15.37:0/776368745 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5738104ae0 0x7f5738111300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.618+0000 7f573ec00640 1 -- 172.21.15.37:0/776368745 >> 172.21.15.37:0/776368745 conn(0x7f57381004f0 msgr2=0x7f57381028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:33.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.618+0000 7f573ec00640 1 -- 172.21.15.37:0/776368745 shutdown_connections 2024-08-20T05:14:33.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:33.618+0000 7f573ec00640 1 -- 172.21.15.37:0/776368745 wait complete. 2024-08-20T05:14:33.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:33 smithi037 ceph-mon[17265]: pgmap v770: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.7 MiB/s wr, 555 op/s 2024-08-20T05:14:33.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:33 smithi135 ceph-mon[22342]: pgmap v770: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.7 MiB/s wr, 555 op/s 2024-08-20T05:14:33.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:33 smithi130 ceph-mon[22007]: pgmap v770: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 6.7 MiB/s wr, 555 op/s 2024-08-20T05:14:35.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:35 smithi037 ceph-mon[17265]: pgmap v771: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.0 MiB/s wr, 612 op/s 2024-08-20T05:14:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:35 smithi135 ceph-mon[22342]: pgmap v771: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.0 MiB/s wr, 612 op/s 2024-08-20T05:14:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:35 smithi130 ceph-mon[22007]: pgmap v771: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.0 MiB/s wr, 612 op/s 2024-08-20T05:14:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.216+0000 7f7db1600640 1 -- 172.21.15.37:0/257645482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dac076c60 msgr2=0x7f7dac0752b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.216+0000 7f7db1600640 1 --2- 172.21.15.37:0/257645482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dac076c60 0x7f7dac0752b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009900 tx=0x7f7d9402a440 comp rx=0 tx=0).stop 2024-08-20T05:14:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.216+0000 7f7db1600640 1 -- 172.21.15.37:0/257645482 shutdown_connections 2024-08-20T05:14:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.216+0000 7f7db1600640 1 --2- 172.21.15.37:0/257645482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dac10a600 0x7f7dac10ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.216+0000 7f7db1600640 1 --2- 172.21.15.37:0/257645482 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7dac0757f0 0x7f7dac075c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.216+0000 7f7db1600640 1 --2- 172.21.15.37:0/257645482 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dac076c60 0x7f7dac0752b0 secure :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009900 tx=0x7f7d9402a440 comp rx=0 tx=0).stop 2024-08-20T05:14:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.216+0000 7f7db1600640 1 -- 172.21.15.37:0/257645482 >> 172.21.15.37:0/257645482 conn(0x7f7dac0fdf40 msgr2=0x7f7dac100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.217+0000 7f7db1600640 1 -- 172.21.15.37:0/257645482 shutdown_connections 2024-08-20T05:14:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.217+0000 7f7db1600640 1 -- 172.21.15.37:0/257645482 wait complete. 2024-08-20T05:14:36.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.218+0000 7f7db1600640 1 Processor -- start 2024-08-20T05:14:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.219+0000 7f7db1600640 1 -- start start 2024-08-20T05:14:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.219+0000 7f7db1600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dac0757f0 0x7f7dac19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.219+0000 7f7db1600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dac10a600 0x7f7dac19fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.219+0000 7f7db1600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7dac1a0710 0x7f7dac1a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.219+0000 7f7db1600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac110650 con 0x7f7dac0757f0 2024-08-20T05:14:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.219+0000 7f7db1600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac1104d0 con 0x7f7dac1a0710 2024-08-20T05:14:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.219+0000 7f7db1600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac1107d0 con 0x7f7dac10a600 2024-08-20T05:14:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.220+0000 7f7daa000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dac10a600 0x7f7dac19fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.220+0000 7f7daa000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dac10a600 0x7f7dac19fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35180/0 (socket says 172.21.15.37:35180) 2024-08-20T05:14:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.220+0000 7f7daa000640 1 -- 172.21.15.37:0/4091112486 learned_addr learned my addr 172.21.15.37:0/4091112486 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.220+0000 7f7dab400640 1 --2- 172.21.15.37:0/4091112486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7dac1a0710 0x7f7dac1a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.220+0000 7f7daaa00640 1 --2- 172.21.15.37:0/4091112486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dac0757f0 0x7f7dac19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.221+0000 7f7daa000640 1 -- 172.21.15.37:0/4091112486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7dac1a0710 msgr2=0x7f7dac1a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.221+0000 7f7daa000640 1 --2- 172.21.15.37:0/4091112486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7dac1a0710 0x7f7dac1a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.221+0000 7f7daa000640 1 -- 172.21.15.37:0/4091112486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dac0757f0 msgr2=0x7f7dac19f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.221+0000 7f7daa000640 1 --2- 172.21.15.37:0/4091112486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dac0757f0 0x7f7dac19f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.221+0000 7f7daa000640 1 -- 172.21.15.37:0/4091112486 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dac1a13c0 con 0x7f7dac10a600 2024-08-20T05:14:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.221+0000 7f7daa000640 1 --2- 172.21.15.37:0/4091112486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dac10a600 0x7f7dac19fae0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c00b450 tx=0x7f7d9c00b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.222+0000 7f7da3400640 1 -- 172.21.15.37:0/4091112486 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c015020 con 0x7f7dac10a600 2024-08-20T05:14:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.222+0000 7f7db1600640 1 -- 172.21.15.37:0/4091112486 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dac1a77b0 con 0x7f7dac10a600 2024-08-20T05:14:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.222+0000 7f7da3400640 1 -- 172.21.15.37:0/4091112486 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d9c011d40 con 0x7f7dac10a600 2024-08-20T05:14:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.222+0000 7f7da3400640 1 -- 172.21.15.37:0/4091112486 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c00f340 con 0x7f7dac10a600 2024-08-20T05:14:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.222+0000 7f7db1600640 1 -- 172.21.15.37:0/4091112486 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dac1a7d70 con 0x7f7dac10a600 2024-08-20T05:14:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.227+0000 7f7db4669740 1 Processor -- start 2024-08-20T05:14:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.230+0000 7f7da3400640 1 -- 172.21.15.37:0/4091112486 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7d9c018020 con 0x7f7dac10a600 2024-08-20T05:14:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.231+0000 7f7db4669740 1 -- start start 2024-08-20T05:14:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.231+0000 7f7db4669740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291d2b0 0x56096291f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.232+0000 7f7db4669740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56096291fbe0 0x560962921fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.232+0000 7f7db4669740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560962922620 0x560962924ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.232+0000 7f7db4669740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560962890210 con 0x56096291d2b0 2024-08-20T05:14:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.232+0000 7f7db4669740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56096287f710 con 0x560962922620 2024-08-20T05:14:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.232+0000 7f7db4669740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560962883750 con 0x56096291fbe0 2024-08-20T05:14:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.232+0000 7f7daaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56096291fbe0 0x560962921fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.233+0000 7f7dab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291d2b0 0x56096291f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.233+0000 7f7dab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291d2b0 0x56096291f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49272/0 (socket says 172.21.15.37:49272) 2024-08-20T05:14:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.233+0000 7f7dab400640 1 -- 172.21.15.37:0/2826851807 learned_addr learned my addr 172.21.15.37:0/2826851807 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.234+0000 7f7dab400640 1 -- 172.21.15.37:0/2826851807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56096291fbe0 msgr2=0x560962921fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.236+0000 7f7dab400640 1 --2- 172.21.15.37:0/2826851807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56096291fbe0 0x560962921fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.236+0000 7f7daa000640 1 --2- 172.21.15.37:0/2826851807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560962922620 0x560962924ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.236+0000 7f7dab400640 1 -- 172.21.15.37:0/2826851807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560962922620 msgr2=0x560962924ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.236+0000 7f7dab400640 1 --2- 172.21.15.37:0/2826851807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560962922620 0x560962924ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.236+0000 7f7dab400640 1 -- 172.21.15.37:0/2826851807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56096284bde0 con 0x56096291d2b0 2024-08-20T05:14:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.236+0000 7f7daaa00640 1 --2- 172.21.15.37:0/2826851807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56096291fbe0 0x560962921fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:14:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.236+0000 7f7daa000640 1 --2- 172.21.15.37:0/2826851807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560962922620 0x560962924ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:14:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.237+0000 7f7dab400640 1 --2- 172.21.15.37:0/2826851807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291d2b0 0x56096291f6a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7da400b500 tx=0x7f7da4009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c074fdf97fcb6c86 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.237+0000 7f7d9b400640 1 -- 172.21.15.37:0/2826851807 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da400a970 con 0x56096291d2b0 2024-08-20T05:14:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.238+0000 7f7da3400640 1 --2- 172.21.15.37:0/4091112486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7d900b3bd0 0x7f7d900b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.239+0000 7f7d9b400640 1 -- 172.21.15.37:0/2826851807 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7da4019070 con 0x56096291d2b0 2024-08-20T05:14:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.239+0000 7f7d9b400640 1 -- 172.21.15.37:0/2826851807 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da4013380 con 0x56096291d2b0 2024-08-20T05:14:36.243 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.239+0000 7f7da3400640 1 -- 172.21.15.37:0/4091112486 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7d9c0e3a50 con 0x7f7dac10a600 2024-08-20T05:14:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.242+0000 7f7db4669740 1 -- 172.21.15.37:0/2826851807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291d2b0 msgr2=0x56096291f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.242+0000 7f7db4669740 1 --2- 172.21.15.37:0/2826851807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291d2b0 0x56096291f6a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f7da400b500 tx=0x7f7da4009630 comp rx=0 tx=0).stop 2024-08-20T05:14:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.242+0000 7f7db4669740 1 -- 172.21.15.37:0/2826851807 shutdown_connections 2024-08-20T05:14:36.244 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.242+0000 7f7db4669740 1 --2- 172.21.15.37:0/2826851807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560962922620 0x560962924ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.242+0000 7f7db4669740 1 --2- 172.21.15.37:0/2826851807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56096291fbe0 0x560962921fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.242+0000 7f7db4669740 1 --2- 172.21.15.37:0/2826851807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291d2b0 0x56096291f6a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.242+0000 7f7db4669740 1 -- 172.21.15.37:0/2826851807 >> 172.21.15.37:0/2826851807 conn(0x5609629183b0 msgr2=0x560962919190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:36.245 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.243+0000 7f7db4669740 1 -- 172.21.15.37:0/2826851807 shutdown_connections 2024-08-20T05:14:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.246+0000 7f7daaa00640 1 --2- 172.21.15.37:0/4091112486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7d900b3bd0 0x7f7d900b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.246+0000 7f7db4669740 1 -- 172.21.15.37:0/2826851807 wait complete. 2024-08-20T05:14:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.246+0000 7f7db4669740 1 -- start start 2024-08-20T05:14:36.248 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.247+0000 7f7db4669740 1 Processor -- start 2024-08-20T05:14:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.247+0000 7f7daaa00640 1 --2- 172.21.15.37:0/4091112486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7d900b3bd0 0x7f7d900b6090 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009230 tx=0x7f7d94000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.247+0000 7f7db4669740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56096291d2b0 0x560962926c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.247+0000 7f7db4669740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291fbe0 0x5609629272d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.247+0000 7f7db4669740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560962922620 0x560962927ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.247+0000 7f7db4669740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5609627b8ab0 con 0x56096291fbe0 2024-08-20T05:14:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.247+0000 7f7db4669740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560962826140 con 0x56096291d2b0 2024-08-20T05:14:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.247+0000 7f7db4669740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560962925600 con 0x560962922620 2024-08-20T05:14:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.248+0000 7f7daaa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56096291d2b0 0x560962926c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:36.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.248+0000 7f7daa000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291fbe0 0x5609629272d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:36.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.248+0000 7f7daa000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291fbe0 0x5609629272d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49288/0 (socket says 172.21.15.37:49288) 2024-08-20T05:14:36.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.248+0000 7f7daa000640 1 -- 172.21.15.37:0/990668982 learned_addr learned my addr 172.21.15.37:0/990668982 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:36.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.249+0000 7f7dab400640 1 --2- 172.21.15.37:0/990668982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560962922620 0x560962927ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:36.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.249+0000 7f7daa000640 1 -- 172.21.15.37:0/990668982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560962922620 msgr2=0x560962927ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:36.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.249+0000 7f7daa000640 1 --2- 172.21.15.37:0/990668982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560962922620 0x560962927ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.251 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.249+0000 7f7daa000640 1 -- 172.21.15.37:0/990668982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56096291d2b0 msgr2=0x560962926c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:36.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.249+0000 7f7daa000640 1 --2- 172.21.15.37:0/990668982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56096291d2b0 0x560962926c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.249+0000 7f7daa000640 1 -- 172.21.15.37:0/990668982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560962827170 con 0x56096291fbe0 2024-08-20T05:14:36.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.249+0000 7f7dab400640 1 --2- 172.21.15.37:0/990668982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560962922620 0x560962927ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:14:36.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.249+0000 7f7daa000640 1 --2- 172.21.15.37:0/990668982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291fbe0 0x5609629272d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0a6680 tx=0x7f7d9c010ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a064fd5a0afad56 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:36.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.249+0000 7f7db4669740 10 client.0 _ll_register_callbacks cb 0x5609628395d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:36.252 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.249+0000 7f7d8fe00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:14:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.250+0000 7f7d8fe00640 1 -- 172.21.15.37:0/990668982 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9c0aa110 con 0x56096291fbe0 2024-08-20T05:14:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.251+0000 7f7db4669740 1 -- 172.21.15.37:0/990668982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560962856a30 con 0x56096291fbe0 2024-08-20T05:14:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.252+0000 7f7d8fe00640 1 -- 172.21.15.37:0/990668982 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7d9c011890 con 0x56096291fbe0 2024-08-20T05:14:36.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.252+0000 7f7d8fe00640 1 -- 172.21.15.37:0/990668982 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f7d9c0aad00 con 0x56096291fbe0 2024-08-20T05:14:36.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.252+0000 7f7db4669740 10 client.17880 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:36.254 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.252+0000 7f7db4669740 1 -- 172.21.15.37:0/990668982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({fsmap=48}) -- 0x5609625e2790 con 0x56096291fbe0 2024-08-20T05:14:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.253+0000 7f7d8fe00640 1 -- 172.21.15.37:0/990668982 <== mon.0 v2:172.21.15.37:3300/0 4 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f7d9c0a9860 con 0x56096291fbe0 2024-08-20T05:14:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.253+0000 7f7db4669740 10 client.17880 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.253+0000 7f7db4669740 10 client.17880 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:14:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.253+0000 7f7db4669740 20 client.17880 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.253+0000 7f7db4669740 1 --2- 172.21.15.37:0/990668982 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560962943550 0x5609629459c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.254+0000 7f7db4669740 4 client.17880 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:14:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.254+0000 7f7db4669740 1 -- 172.21.15.37:0/990668982 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560962892160 con 0x560962943550 2024-08-20T05:14:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.255+0000 7f7daaa00640 1 --2- 172.21.15.37:0/990668982 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560962943550 0x5609629459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.256+0000 7f7daaa00640 1 --2- 172.21.15.37:0/990668982 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560962943550 0x5609629459c0 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2709a0aa36001a7b server_cookie=b50715fd744fdaa8 in_seq=0 out_seq=0 2024-08-20T05:14:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.256+0000 7f7d8fe00640 10 client.17880 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.256+0000 7f7d8fe00640 1 -- 172.21.15.37:0/990668982 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560962892160 con 0x560962943550 2024-08-20T05:14:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.257+0000 7f7d8fe00640 10 client.17880 handle_command_reply: tid=0 2024-08-20T05:14:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.257+0000 7f7db4669740 1 client.17880 shutdown 2024-08-20T05:14:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.257+0000 7f7db4669740 1 -- 172.21.15.37:0/990668982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291fbe0 msgr2=0x5609629272d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.257+0000 7f7db4669740 1 --2- 172.21.15.37:0/990668982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291fbe0 0x5609629272d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c0a6680 tx=0x7f7d9c010ff0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.259+0000 7f7db4669740 1 -- 172.21.15.37:0/990668982 shutdown_connections 2024-08-20T05:14:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.259+0000 7f7db4669740 1 --2- 172.21.15.37:0/990668982 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560962943550 0x5609629459c0 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.259+0000 7f7db4669740 1 --2- 172.21.15.37:0/990668982 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560962922620 0x560962927ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.259+0000 7f7d8fe00640 0 client.17880 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.259+0000 7f7db4669740 1 --2- 172.21.15.37:0/990668982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291fbe0 0x5609629272d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.259+0000 7f7db4669740 1 --2- 172.21.15.37:0/990668982 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56096291d2b0 0x560962926c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.259+0000 7f7db4669740 1 -- 172.21.15.37:0/990668982 >> 172.21.15.37:0/990668982 conn(0x5609629183b0 msgr2=0x5609629174d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.260+0000 7f7db4669740 1 -- 172.21.15.37:0/990668982 shutdown_connections 2024-08-20T05:14:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.260+0000 7f7db4669740 1 -- 172.21.15.37:0/990668982 wait complete. 2024-08-20T05:14:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.260+0000 7f7db4669740 20 client.17880 trim_cache size 0 max 16384 2024-08-20T05:14:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.305+0000 7f7db4669740 1 Processor -- start 2024-08-20T05:14:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.305+0000 7f7db4669740 1 -- start start 2024-08-20T05:14:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.306+0000 7f7db4669740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291d2b0 0x560962918e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.306+0000 7f7db4669740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56096291fbe0 0x560962919390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.306+0000 7f7db4669740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560962922620 0x560962916cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.306+0000 7f7db4669740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac1a9830 con 0x56096291d2b0 2024-08-20T05:14:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.306+0000 7f7db4669740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac1ab370 con 0x560962922620 2024-08-20T05:14:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.306+0000 7f7db4669740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac1a9f00 con 0x56096291fbe0 2024-08-20T05:14:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.306+0000 7f7dab400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560962922620 0x560962916cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:36.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.306+0000 7f7dab400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560962922620 0x560962916cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:54078/0 (socket says 172.21.15.37:54078) 2024-08-20T05:14:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.307+0000 7f7dab400640 1 -- 172.21.15.37:0/3863545653 learned_addr learned my addr 172.21.15.37:0/3863545653 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.307+0000 7f7dab400640 1 -- 172.21.15.37:0/3863545653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56096291fbe0 msgr2=0x560962919390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:14:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.307+0000 7f7dab400640 1 --2- 172.21.15.37:0/3863545653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56096291fbe0 0x560962919390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.307+0000 7f7dab400640 1 -- 172.21.15.37:0/3863545653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291d2b0 msgr2=0x560962918e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.307+0000 7f7dab400640 1 --2- 172.21.15.37:0/3863545653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291d2b0 0x560962918e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.307+0000 7f7dab400640 1 -- 172.21.15.37:0/3863545653 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56096265b620 con 0x560962922620 2024-08-20T05:14:36.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.308+0000 7f7dab400640 1 --2- 172.21.15.37:0/3863545653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560962922620 0x560962916cb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7da400d010 tx=0x7f7da4015d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a9d1a8215fbd4c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:36.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.311+0000 7f7d9aa00640 1 -- 172.21.15.37:0/3863545653 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da4014d40 con 0x560962922620 2024-08-20T05:14:36.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.311+0000 7f7d9aa00640 1 -- 172.21.15.37:0/3863545653 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7da4022070 con 0x560962922620 2024-08-20T05:14:36.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.311+0000 7f7d9aa00640 1 -- 172.21.15.37:0/3863545653 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da400a770 con 0x560962922620 2024-08-20T05:14:36.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.312+0000 7f7db4669740 1 -- 172.21.15.37:0/3863545653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560962922620 msgr2=0x560962916cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:36.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.312+0000 7f7db4669740 1 --2- 172.21.15.37:0/3863545653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560962922620 0x560962916cb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7da400d010 tx=0x7f7da4015d20 comp rx=0 tx=0).stop 2024-08-20T05:14:36.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.312+0000 7f7db4669740 1 -- 172.21.15.37:0/3863545653 shutdown_connections 2024-08-20T05:14:36.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.312+0000 7f7db4669740 1 --2- 172.21.15.37:0/3863545653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560962922620 0x560962916cb0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.312+0000 7f7db4669740 1 --2- 172.21.15.37:0/3863545653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56096291fbe0 0x560962919390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.312+0000 7f7db4669740 1 --2- 172.21.15.37:0/3863545653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291d2b0 0x560962918e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.315 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.312+0000 7f7db4669740 1 -- 172.21.15.37:0/3863545653 >> 172.21.15.37:0/3863545653 conn(0x5609629183b0 msgr2=0x560962924170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:36.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.313+0000 7f7db4669740 1 -- 172.21.15.37:0/3863545653 shutdown_connections 2024-08-20T05:14:36.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.313+0000 7f7db4669740 1 -- 172.21.15.37:0/3863545653 wait complete. 2024-08-20T05:14:36.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.313+0000 7f7db4669740 1 -- start start 2024-08-20T05:14:36.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.313+0000 7f7db4669740 1 Processor -- start 2024-08-20T05:14:36.316 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.314+0000 7f7db4669740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56096291d2b0 0x56096292b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.314+0000 7f7db4669740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291fbe0 0x56096292c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.314+0000 7f7db4669740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560962922620 0x56096292cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.315+0000 7f7daaa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56096291d2b0 0x56096292b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:36.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.315+0000 7f7daaa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56096291d2b0 0x56096292b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:54086/0 (socket says 172.21.15.37:54086) 2024-08-20T05:14:36.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.315+0000 7f7daaa00640 1 -- 172.21.15.37:0/4091906547 learned_addr learned my addr 172.21.15.37:0/4091906547 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.315+0000 7f7dab400640 1 --2- 172.21.15.37:0/4091906547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560962922620 0x56096292cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.315+0000 7f7db4669740 1 -- 172.21.15.37:0/4091906547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac1aaca0 con 0x56096291fbe0 2024-08-20T05:14:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.315+0000 7f7db4669740 1 -- 172.21.15.37:0/4091906547 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac1aa5d0 con 0x56096291d2b0 2024-08-20T05:14:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.316+0000 7f7db4669740 1 -- 172.21.15.37:0/4091906547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac074880 con 0x560962922620 2024-08-20T05:14:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.316+0000 7f7daa000640 1 --2- 172.21.15.37:0/4091906547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291fbe0 0x56096292c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.316+0000 7f7dab400640 1 -- 172.21.15.37:0/4091906547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56096291d2b0 msgr2=0x56096292b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:36.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.316+0000 7f7dab400640 1 --2- 172.21.15.37:0/4091906547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56096291d2b0 0x56096292b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.316+0000 7f7dab400640 1 -- 172.21.15.37:0/4091906547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291fbe0 msgr2=0x56096292c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.316+0000 7f7dab400640 1 --2- 172.21.15.37:0/4091906547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291fbe0 0x56096292c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.317+0000 7f7dab400640 1 -- 172.21.15.37:0/4091906547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56096292d450 con 0x560962922620 2024-08-20T05:14:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.317+0000 7f7db4669740 10 client.0 _ll_register_callbacks cb 0x7f7d9c0046e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.317+0000 7f7db4669740 1 -- 172.21.15.37:0/4091906547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7da4022070 con 0x560962922620 2024-08-20T05:14:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.317+0000 7f7daa000640 1 --2- 172.21.15.37:0/4091906547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291fbe0 0x56096292c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:14:36.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.317+0000 7f7dab400640 1 --2- 172.21.15.37:0/4091906547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560962922620 0x56096292cc20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7da400b500 tx=0x7f7da4003c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=443c48f692c445c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:36.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.317+0000 7f7d8fe00640 10 client.28504 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:14:36.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.318+0000 7f7d8fe00640 1 -- 172.21.15.37:0/4091906547 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da4014bf0 con 0x560962922620 2024-08-20T05:14:36.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.318+0000 7f7d8fe00640 1 -- 172.21.15.37:0/4091906547 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7da40149f0 con 0x560962922620 2024-08-20T05:14:36.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.319+0000 7f7d8fe00640 1 -- 172.21.15.37:0/4091906547 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f7da4014bf0 con 0x560962922620 2024-08-20T05:14:36.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.319+0000 7f7db4669740 10 client.28504 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:36.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.319+0000 7f7db4669740 1 -- 172.21.15.37:0/4091906547 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({fsmap=48}) -- 0x56096292e600 con 0x560962922620 2024-08-20T05:14:36.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.319+0000 7f7d8fe00640 1 -- 172.21.15.37:0/4091906547 <== mon.1 v2:172.21.15.135:3300/0 4 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f7da400a770 con 0x560962922620 2024-08-20T05:14:36.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.319+0000 7f7db4669740 10 client.28504 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:36.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.320+0000 7f7db4669740 10 client.28504 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:14:36.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.320+0000 7f7db4669740 20 client.28504 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:36.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.320+0000 7f7db4669740 1 --2- 172.21.15.37:0/4091906547 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5609629ae2a0 0x5609629b0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:36.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.320+0000 7f7db4669740 4 client.28504 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:14:36.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.320+0000 7f7db4669740 1 -- 172.21.15.37:0/4091906547 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56096288dc00 con 0x5609629ae2a0 2024-08-20T05:14:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.320+0000 7f7daaa00640 1 --2- 172.21.15.37:0/4091906547 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5609629ae2a0 0x5609629b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.321+0000 7f7daaa00640 1 --2- 172.21.15.37:0/4091906547 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5609629ae2a0 0x5609629b0690 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6d851e6ec74a0b3 server_cookie=89a63e58dbf7e977 in_seq=0 out_seq=0 2024-08-20T05:14:36.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.322+0000 7f7d8fe00640 10 client.28504 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.436+0000 7f7d8fe00640 1 -- 172.21.15.37:0/4091906547 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56096288dc00 con 0x5609629ae2a0 2024-08-20T05:14:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.436+0000 7f7d8fe00640 10 client.28504 handle_command_reply: tid=0 2024-08-20T05:14:36.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.436+0000 7f7db4669740 1 client.28504 shutdown 2024-08-20T05:14:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.437+0000 7f7db4669740 1 -- 172.21.15.37:0/4091906547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560962922620 msgr2=0x56096292cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.437+0000 7f7db4669740 1 --2- 172.21.15.37:0/4091906547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560962922620 0x56096292cc20 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f7da400b500 tx=0x7f7da4003c60 comp rx=0 tx=0).stop 2024-08-20T05:14:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.437+0000 7f7db4669740 1 -- 172.21.15.37:0/4091906547 shutdown_connections 2024-08-20T05:14:36.439 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.437+0000 7f7db4669740 1 --2- 172.21.15.37:0/4091906547 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5609629ae2a0 0x5609629b0690 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.437+0000 7f7db4669740 1 --2- 172.21.15.37:0/4091906547 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560962922620 0x56096292cc20 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.437+0000 7f7db4669740 1 --2- 172.21.15.37:0/4091906547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56096291fbe0 0x56096292c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.437+0000 7f7db4669740 1 --2- 172.21.15.37:0/4091906547 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56096291d2b0 0x56096292b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.437+0000 7f7db4669740 1 -- 172.21.15.37:0/4091906547 >> 172.21.15.37:0/4091906547 conn(0x5609629183b0 msgr2=0x560962924170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.437+0000 7f7d8fe00640 0 client.28504 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.437+0000 7f7db4669740 1 -- 172.21.15.37:0/4091906547 shutdown_connections 2024-08-20T05:14:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.437+0000 7f7db4669740 1 -- 172.21.15.37:0/4091906547 wait complete. 2024-08-20T05:14:36.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.438+0000 7f7db4669740 20 client.28504 trim_cache size 0 max 16384 2024-08-20T05:14:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:14:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:14:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:14:36.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:14:36.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.441+0000 7f7db1600640 1 -- 172.21.15.37:0/4091112486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7d900b3bd0 msgr2=0x7f7d900b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:36.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.441+0000 7f7db1600640 1 --2- 172.21.15.37:0/4091112486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7d900b3bd0 0x7f7d900b6090 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009230 tx=0x7f7d94000bc0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.441+0000 7f7db1600640 1 -- 172.21.15.37:0/4091112486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dac10a600 msgr2=0x7f7dac19fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:36.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.441+0000 7f7db1600640 1 --2- 172.21.15.37:0/4091112486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dac10a600 0x7f7dac19fae0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f7d9c00b450 tx=0x7f7d9c00b910 comp rx=0 tx=0).stop 2024-08-20T05:14:36.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.441+0000 7f7db1600640 1 -- 172.21.15.37:0/4091112486 shutdown_connections 2024-08-20T05:14:36.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.441+0000 7f7db1600640 1 --2- 172.21.15.37:0/4091112486 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7d900b3bd0 0x7f7d900b6090 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.441+0000 7f7db1600640 1 --2- 172.21.15.37:0/4091112486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7dac1a0710 0x7f7dac1a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.441+0000 7f7db1600640 1 --2- 172.21.15.37:0/4091112486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7dac10a600 0x7f7dac19fae0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.441+0000 7f7db1600640 1 --2- 172.21.15.37:0/4091112486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7dac0757f0 0x7f7dac19f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:36.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.441+0000 7f7db1600640 1 -- 172.21.15.37:0/4091112486 >> 172.21.15.37:0/4091112486 conn(0x7f7dac0fdf40 msgr2=0x7f7dac1021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:36.445 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.444+0000 7f7db1600640 1 -- 172.21.15.37:0/4091112486 shutdown_connections 2024-08-20T05:14:36.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:36.444+0000 7f7db1600640 1 -- 172.21.15.37:0/4091112486 wait complete. 2024-08-20T05:14:36.871 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T05:14:36.872 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T05:14:37.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:37 smithi037 ceph-mon[17265]: pgmap v772: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.0 MiB/s wr, 600 op/s 2024-08-20T05:14:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:37 smithi135 ceph-mon[22342]: pgmap v772: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.0 MiB/s wr, 600 op/s 2024-08-20T05:14:37.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:37 smithi130 ceph-mon[22007]: pgmap v772: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.0 MiB/s wr, 600 op/s 2024-08-20T05:14:38.038 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:14:38.043 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 700.0 s, 417.4 tps, lat 237.317 ms stddev 330.701 2024-08-20T05:14:38.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.979+0000 7fb258400640 1 -- 172.21.15.37:0/1259997061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb25010f470 msgr2=0x7fb250115c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:38.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.979+0000 7fb258400640 1 --2- 172.21.15.37:0/1259997061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb25010f470 0x7fb250115c70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb248009860 tx=0x7fb24802a340 comp rx=0 tx=0).stop 2024-08-20T05:14:38.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.979+0000 7fb258400640 1 -- 172.21.15.37:0/1259997061 shutdown_connections 2024-08-20T05:14:38.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.979+0000 7fb258400640 1 --2- 172.21.15.37:0/1259997061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb25010f470 0x7fb250115c70 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:38.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.979+0000 7fb258400640 1 --2- 172.21.15.37:0/1259997061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb25010eaf0 0x7fb25010ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:38.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.979+0000 7fb258400640 1 --2- 172.21.15.37:0/1259997061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2501090e0 0x7fb2501094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:38.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.979+0000 7fb258400640 1 -- 172.21.15.37:0/1259997061 >> 172.21.15.37:0/1259997061 conn(0x7fb250078760 msgr2=0x7fb25007ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:38.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.979+0000 7fb258400640 1 -- 172.21.15.37:0/1259997061 shutdown_connections 2024-08-20T05:14:38.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.979+0000 7fb258400640 1 -- 172.21.15.37:0/1259997061 wait complete. 2024-08-20T05:14:38.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.981+0000 7fb258400640 1 Processor -- start 2024-08-20T05:14:38.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.982+0000 7fb258400640 1 -- start start 2024-08-20T05:14:38.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.983+0000 7fb258400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2501090e0 0x7fb250083300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:38.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.983+0000 7fb258400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb25010eaf0 0x7fb250083840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:38.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.983+0000 7fb255a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2501090e0 0x7fb250083300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:38.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.983+0000 7fb258400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb25010f470 0x7fb25007c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.983+0000 7fb255000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb25010eaf0 0x7fb250083840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.984+0000 7fb255000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb25010eaf0 0x7fb250083840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:54108/0 (socket says 172.21.15.37:54108) 2024-08-20T05:14:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.984+0000 7fb255000640 1 -- 172.21.15.37:0/995730891 learned_addr learned my addr 172.21.15.37:0/995730891 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.984+0000 7fb258400640 1 -- 172.21.15.37:0/995730891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2501190a0 con 0x7fb2501090e0 2024-08-20T05:14:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.984+0000 7fb256400640 1 --2- 172.21.15.37:0/995730891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb25010f470 0x7fb25007c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.984+0000 7fb258400640 1 -- 172.21.15.37:0/995730891 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb250118f20 con 0x7fb25010eaf0 2024-08-20T05:14:38.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.984+0000 7fb258400640 1 -- 172.21.15.37:0/995730891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb250119220 con 0x7fb25010f470 2024-08-20T05:14:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.984+0000 7fb256400640 1 -- 172.21.15.37:0/995730891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb25010eaf0 msgr2=0x7fb250083840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.984+0000 7fb256400640 1 --2- 172.21.15.37:0/995730891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb25010eaf0 0x7fb250083840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.984+0000 7fb256400640 1 -- 172.21.15.37:0/995730891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2501090e0 msgr2=0x7fb250083300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.984+0000 7fb256400640 1 --2- 172.21.15.37:0/995730891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2501090e0 0x7fb250083300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.984+0000 7fb256400640 1 -- 172.21.15.37:0/995730891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25007cf40 con 0x7fb25010f470 2024-08-20T05:14:38.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.985+0000 7fb256400640 1 --2- 172.21.15.37:0/995730891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb25010f470 0x7fb25007c680 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb24802a930 tx=0x7fb248032d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.986+0000 7fb24e000640 1 -- 172.21.15.37:0/995730891 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb248042070 con 0x7fb25010f470 2024-08-20T05:14:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.986+0000 7fb24e000640 1 -- 172.21.15.37:0/995730891 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb248030d50 con 0x7fb25010f470 2024-08-20T05:14:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.986+0000 7fb24e000640 1 -- 172.21.15.37:0/995730891 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb248037040 con 0x7fb25010f470 2024-08-20T05:14:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.986+0000 7fb258400640 1 -- 172.21.15.37:0/995730891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25007d1d0 con 0x7fb25010f470 2024-08-20T05:14:38.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.986+0000 7fb258400640 1 -- 172.21.15.37:0/995730891 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb250082140 con 0x7fb25010f470 2024-08-20T05:14:38.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.991+0000 7fb24e000640 1 -- 172.21.15.37:0/995730891 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb248045070 con 0x7fb25010f470 2024-08-20T05:14:38.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.992+0000 7fb25afc3740 1 Processor -- start 2024-08-20T05:14:38.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.995+0000 7fb25afc3740 1 -- start start 2024-08-20T05:14:38.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.995+0000 7fb25afc3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540bf9d0 0x557e540bfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:38.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.995+0000 7fb25afc3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 0x557e540cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:38.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.995+0000 7fb25afc3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540cc280 0x557e540ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:38.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.995+0000 7fb25afc3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e54036870 con 0x557e540bf9d0 2024-08-20T05:14:38.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.995+0000 7fb25afc3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557e54025d70 con 0x557e540cc280 2024-08-20T05:14:38.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.995+0000 7fb25afc3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557e54029db0 con 0x557e540c02f0 2024-08-20T05:14:38.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.996+0000 7fb255a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 0x557e540cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:38.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.996+0000 7fb255a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 0x557e540cbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35222/0 (socket says 172.21.15.37:35222) 2024-08-20T05:14:38.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.996+0000 7fb255a00640 1 -- 172.21.15.37:0/65153650 learned_addr learned my addr 172.21.15.37:0/65153650 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:38.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.996+0000 7fb255a00640 1 -- 172.21.15.37:0/65153650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540cc280 msgr2=0x557e540ce670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:14:38.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.996+0000 7fb255a00640 1 --2- 172.21.15.37:0/65153650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540cc280 0x557e540ce670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:38.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.996+0000 7fb255a00640 1 -- 172.21.15.37:0/65153650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540bf9d0 msgr2=0x557e540bfdb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:14:38.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.996+0000 7fb255a00640 1 --2- 172.21.15.37:0/65153650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540bf9d0 0x557e540bfdb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.996+0000 7fb255a00640 1 -- 172.21.15.37:0/65153650 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e53d85930 con 0x557e540c02f0 2024-08-20T05:14:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.997+0000 7fb24e000640 1 --2- 172.21.15.37:0/995730891 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2380b3de0 0x7fb2380b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.997+0000 7fb255a00640 1 --2- 172.21.15.37:0/65153650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 0x557e540cbd40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb2440114c0 tx=0x7fb244011980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dddff23e3bb575a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.997+0000 7fb255000640 1 --2- 172.21.15.37:0/995730891 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2380b3de0 0x7fb2380b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.997+0000 7fb24e000640 1 -- 172.21.15.37:0/995730891 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb2481030d0 con 0x7fb25010f470 2024-08-20T05:14:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.997+0000 7fb242a00640 1 -- 172.21.15.37:0/65153650 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb24400f680 con 0x557e540c02f0 2024-08-20T05:14:39.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.998+0000 7fb242a00640 1 -- 172.21.15.37:0/65153650 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb24400fcd0 con 0x557e540c02f0 2024-08-20T05:14:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:38.998+0000 7fb242a00640 1 -- 172.21.15.37:0/65153650 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb244019d10 con 0x557e540c02f0 2024-08-20T05:14:39.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.000+0000 7fb255000640 1 --2- 172.21.15.37:0/995730891 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2380b3de0 0x7fb2380b62a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x557e540bf980 tx=0x7fb23c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:39.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.000+0000 7fb25afc3740 1 -- 172.21.15.37:0/65153650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 msgr2=0x557e540cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:39.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.000+0000 7fb25afc3740 1 --2- 172.21.15.37:0/65153650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 0x557e540cbd40 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb2440114c0 tx=0x7fb244011980 comp rx=0 tx=0).stop 2024-08-20T05:14:39.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.001+0000 7fb25afc3740 1 -- 172.21.15.37:0/65153650 shutdown_connections 2024-08-20T05:14:39.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.001+0000 7fb25afc3740 1 --2- 172.21.15.37:0/65153650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540cc280 0x557e540ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.001+0000 7fb25afc3740 1 --2- 172.21.15.37:0/65153650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 0x557e540cbd40 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.001+0000 7fb25afc3740 1 --2- 172.21.15.37:0/65153650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540bf9d0 0x557e540bfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.001+0000 7fb25afc3740 1 -- 172.21.15.37:0/65153650 >> 172.21.15.37:0/65153650 conn(0x557e540bd800 msgr2=0x557e540be9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:39.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.001+0000 7fb25afc3740 1 -- 172.21.15.37:0/65153650 shutdown_connections 2024-08-20T05:14:39.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.001+0000 7fb25afc3740 1 -- 172.21.15.37:0/65153650 wait complete. 2024-08-20T05:14:39.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.002+0000 7fb25afc3740 1 -- start start 2024-08-20T05:14:39.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.003+0000 7fb25afc3740 1 Processor -- start 2024-08-20T05:14:39.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.004+0000 7fb25afc3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540bf9d0 0x557e540cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:39.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.004+0000 7fb25afc3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 0x557e540c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:39.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.004+0000 7fb25afc3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540cc280 0x557e540c9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:39.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.004+0000 7fb25afc3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e53e88890 con 0x557e540cc280 2024-08-20T05:14:39.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.004+0000 7fb25afc3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557e53facb00 con 0x557e540bf9d0 2024-08-20T05:14:39.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.004+0000 7fb25afc3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557e540cefd0 con 0x557e540c02f0 2024-08-20T05:14:39.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.004+0000 7fb25afc3740 10 client.0 _ll_register_callbacks cb 0x557e54020dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.004+0000 7fb255a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540bf9d0 0x557e540cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.004+0000 7fb256400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540cc280 0x557e540c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.004+0000 7fb255a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540bf9d0 0x557e540cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:54114/0 (socket says 172.21.15.37:54114) 2024-08-20T05:14:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.004+0000 7fb255a00640 1 -- 172.21.15.37:0/2505684994 learned_addr learned my addr 172.21.15.37:0/2505684994 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.005+0000 7fb255000640 1 --2- 172.21.15.37:0/2505684994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 0x557e540c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.005+0000 7fb256400640 1 -- 172.21.15.37:0/2505684994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 msgr2=0x557e540c8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.005+0000 7fb256400640 1 --2- 172.21.15.37:0/2505684994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 0x557e540c8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.005+0000 7fb256400640 1 -- 172.21.15.37:0/2505684994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540bf9d0 msgr2=0x557e540cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.005+0000 7fb256400640 1 --2- 172.21.15.37:0/2505684994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540bf9d0 0x557e540cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.005+0000 7fb256400640 1 -- 172.21.15.37:0/2505684994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e53feda30 con 0x557e540cc280 2024-08-20T05:14:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.006+0000 7fb256400640 1 --2- 172.21.15.37:0/2505684994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540cc280 0x557e540c9530 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb2480c9a50 tx=0x7fb2480c9be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb053509d9a8d3a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.006+0000 7fb237400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:14:39.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.006+0000 7fb237400640 1 -- 172.21.15.37:0/2505684994 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2480328c0 con 0x557e540cc280 2024-08-20T05:14:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.006+0000 7fb237400640 1 -- 172.21.15.37:0/2505684994 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb2480c9fb0 con 0x557e540cc280 2024-08-20T05:14:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.006+0000 7fb25afc3740 1 -- 172.21.15.37:0/2505684994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb24400fcd0 con 0x557e540cc280 2024-08-20T05:14:39.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.007+0000 7fb237400640 1 -- 172.21.15.37:0/2505684994 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb2480c9d50 con 0x557e540cc280 2024-08-20T05:14:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.007+0000 7fb25afc3740 10 client.17889 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.007+0000 7fb25afc3740 1 -- 172.21.15.37:0/2505684994 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x557e540da8c0 con 0x557e540cc280 2024-08-20T05:14:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.007+0000 7fb237400640 1 -- 172.21.15.37:0/2505684994 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb24400fcd0 con 0x557e540cc280 2024-08-20T05:14:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.007+0000 7fb237400640 1 -- 172.21.15.37:0/2505684994 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7fb2480d28c0 con 0x557e540cc280 2024-08-20T05:14:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.007+0000 7fb25afc3740 10 client.17889 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.007+0000 7fb25afc3740 10 client.17889 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:14:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.007+0000 7fb25afc3740 20 client.17889 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.007+0000 7fb25afc3740 1 --2- 172.21.15.37:0/2505684994 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557e540dbe00 0x557e540de2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.007+0000 7fb25afc3740 4 client.17889 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:14:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.007+0000 7fb25afc3740 1 -- 172.21.15.37:0/2505684994 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e540387c0 con 0x557e540dbe00 2024-08-20T05:14:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.008+0000 7fb255a00640 1 --2- 172.21.15.37:0/2505684994 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557e540dbe00 0x557e540de2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:39.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.009+0000 7fb255a00640 1 --2- 172.21.15.37:0/2505684994 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557e540dbe00 0x557e540de2a0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3db7b9375ae3b326 server_cookie=c80a128f7a6c29a9 in_seq=0 out_seq=0 2024-08-20T05:14:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.009+0000 7fb237400640 10 client.17889 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.009+0000 7fb237400640 1 -- 172.21.15.37:0/2505684994 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557e540387c0 con 0x557e540dbe00 2024-08-20T05:14:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.009+0000 7fb237400640 10 client.17889 handle_command_reply: tid=0 2024-08-20T05:14:39.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.010+0000 7fb25afc3740 1 client.17889 shutdown 2024-08-20T05:14:39.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.012+0000 7fb25afc3740 1 -- 172.21.15.37:0/2505684994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540cc280 msgr2=0x557e540c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:39.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.012+0000 7fb25afc3740 1 --2- 172.21.15.37:0/2505684994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540cc280 0x557e540c9530 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb2480c9a50 tx=0x7fb2480c9be0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.013+0000 7fb25afc3740 1 -- 172.21.15.37:0/2505684994 shutdown_connections 2024-08-20T05:14:39.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.014+0000 7fb25afc3740 1 --2- 172.21.15.37:0/2505684994 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557e540dbe00 0x557e540de2a0 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.014+0000 7fb237400640 0 client.17889 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:39.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.014+0000 7fb25afc3740 1 --2- 172.21.15.37:0/2505684994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540cc280 0x557e540c9530 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.014+0000 7fb25afc3740 1 --2- 172.21.15.37:0/2505684994 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 0x557e540c8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.014+0000 7fb25afc3740 1 --2- 172.21.15.37:0/2505684994 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540bf9d0 0x557e540cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.014+0000 7fb25afc3740 1 -- 172.21.15.37:0/2505684994 >> 172.21.15.37:0/2505684994 conn(0x557e540bd800 msgr2=0x557e540c33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:39.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.014+0000 7fb25afc3740 1 -- 172.21.15.37:0/2505684994 shutdown_connections 2024-08-20T05:14:39.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.014+0000 7fb25afc3740 1 -- 172.21.15.37:0/2505684994 wait complete. 2024-08-20T05:14:39.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.014+0000 7fb25afc3740 20 client.17889 trim_cache size 0 max 16384 2024-08-20T05:14:39.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.059+0000 7fb25afc3740 1 Processor -- start 2024-08-20T05:14:39.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.059+0000 7fb25afc3740 1 -- start start 2024-08-20T05:14:39.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.060+0000 7fb25afc3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540bd800 0x557e540d80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:39.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.060+0000 7fb25afc3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540bf9d0 0x557e540e3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:39.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.060+0000 7fb25afc3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540c02f0 0x557e540e40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:39.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.060+0000 7fb25afc3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2501be5f0 con 0x557e540bd800 2024-08-20T05:14:39.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.060+0000 7fb25afc3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb2501c0130 con 0x557e540c02f0 2024-08-20T05:14:39.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.060+0000 7fb25afc3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb2501becc0 con 0x557e540bf9d0 2024-08-20T05:14:39.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.060+0000 7fb255000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540bf9d0 0x557e540e3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:39.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.060+0000 7fb255000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540bf9d0 0x557e540e3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:35252/0 (socket says 172.21.15.37:35252) 2024-08-20T05:14:39.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.060+0000 7fb255000640 1 -- 172.21.15.37:0/1882376933 learned_addr learned my addr 172.21.15.37:0/1882376933 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:39.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.060+0000 7fb256400640 1 --2- 172.21.15.37:0/1882376933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540c02f0 0x557e540e40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:39.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.061+0000 7fb255a00640 1 --2- 172.21.15.37:0/1882376933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540bd800 0x557e540d80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:39.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.061+0000 7fb255000640 1 -- 172.21.15.37:0/1882376933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540c02f0 msgr2=0x557e540e40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:39.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.061+0000 7fb255000640 1 --2- 172.21.15.37:0/1882376933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540c02f0 0x557e540e40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.061+0000 7fb255000640 1 -- 172.21.15.37:0/1882376933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540bd800 msgr2=0x557e540d80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:39.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.061+0000 7fb255000640 1 --2- 172.21.15.37:0/1882376933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540bd800 0x557e540d80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.061+0000 7fb255000640 1 -- 172.21.15.37:0/1882376933 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e540bd630 con 0x557e540bf9d0 2024-08-20T05:14:39.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.061+0000 7fb256400640 1 --2- 172.21.15.37:0/1882376933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540c02f0 0x557e540e40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:14:39.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.062+0000 7fb255000640 1 --2- 172.21.15.37:0/1882376933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540bf9d0 0x557e540e3bb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009ec0 tx=0x7fb23c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cce5547e948a8aba server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:39.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.063+0000 7fb242000640 1 -- 172.21.15.37:0/1882376933 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c02b070 con 0x557e540bf9d0 2024-08-20T05:14:39.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.063+0000 7fb242000640 1 -- 172.21.15.37:0/1882376933 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb23c01ec60 con 0x557e540bf9d0 2024-08-20T05:14:39.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.063+0000 7fb242000640 1 -- 172.21.15.37:0/1882376933 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23c01c690 con 0x557e540bf9d0 2024-08-20T05:14:39.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.064+0000 7fb25afc3740 1 -- 172.21.15.37:0/1882376933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540bf9d0 msgr2=0x557e540e3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:39.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.064+0000 7fb25afc3740 1 --2- 172.21.15.37:0/1882376933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540bf9d0 0x557e540e3bb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009ec0 tx=0x7fb23c014000 comp rx=0 tx=0).stop 2024-08-20T05:14:39.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.065+0000 7fb25afc3740 1 -- 172.21.15.37:0/1882376933 shutdown_connections 2024-08-20T05:14:39.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.065+0000 7fb25afc3740 1 --2- 172.21.15.37:0/1882376933 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540c02f0 0x557e540e40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.065+0000 7fb25afc3740 1 --2- 172.21.15.37:0/1882376933 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540bf9d0 0x557e540e3bb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.065+0000 7fb25afc3740 1 --2- 172.21.15.37:0/1882376933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540bd800 0x557e540d80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.065+0000 7fb25afc3740 1 -- 172.21.15.37:0/1882376933 >> 172.21.15.37:0/1882376933 conn(0x557e540c4910 msgr2=0x557e540be910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:39.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.065+0000 7fb25afc3740 1 -- 172.21.15.37:0/1882376933 shutdown_connections 2024-08-20T05:14:39.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.065+0000 7fb25afc3740 1 -- 172.21.15.37:0/1882376933 wait complete. 2024-08-20T05:14:39.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.065+0000 7fb25afc3740 1 -- start start 2024-08-20T05:14:39.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.066+0000 7fb25afc3740 1 Processor -- start 2024-08-20T05:14:39.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.066+0000 7fb25afc3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540bd800 0x557e540d0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:39.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.066+0000 7fb25afc3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540bf9d0 0x557e540d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.066+0000 7fb25afc3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 0x557e540d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.066+0000 7fb25afc3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb2501bfa60 con 0x557e540bf9d0 2024-08-20T05:14:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.066+0000 7fb25afc3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb2501bf390 con 0x557e540bd800 2024-08-20T05:14:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.066+0000 7fb25afc3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb2501bc5d0 con 0x557e540c02f0 2024-08-20T05:14:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.066+0000 7fb25afc3740 10 client.0 _ll_register_callbacks cb 0x7fb248005a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.066+0000 7fb255a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540bd800 0x557e540d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.066+0000 7fb255a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540bd800 0x557e540d0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:54138/0 (socket says 172.21.15.37:54138) 2024-08-20T05:14:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.066+0000 7fb255a00640 1 -- 172.21.15.37:0/2569159569 learned_addr learned my addr 172.21.15.37:0/2569159569 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.067+0000 7fb256400640 1 --2- 172.21.15.37:0/2569159569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 0x557e540d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.067+0000 7fb255000640 1 --2- 172.21.15.37:0/2569159569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540bf9d0 0x557e540d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.067+0000 7fb256400640 1 -- 172.21.15.37:0/2569159569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540bd800 msgr2=0x557e540d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.067+0000 7fb256400640 1 --2- 172.21.15.37:0/2569159569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540bd800 0x557e540d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.068+0000 7fb256400640 1 -- 172.21.15.37:0/2569159569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540bf9d0 msgr2=0x557e540d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:39.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.068+0000 7fb256400640 1 --2- 172.21.15.37:0/2569159569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540bf9d0 0x557e540d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.068+0000 7fb256400640 1 -- 172.21.15.37:0/2569159569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e540cea60 con 0x557e540c02f0 2024-08-20T05:14:39.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.068+0000 7fb255000640 1 --2- 172.21.15.37:0/2569159569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540bf9d0 0x557e540d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:14:39.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.068+0000 7fb237400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:14:39.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.068+0000 7fb256400640 1 --2- 172.21.15.37:0/2569159569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 0x557e540d0dc0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb2480c56c0 tx=0x7fb248005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c840da669284f307 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:39.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.069+0000 7fb237400640 1 -- 172.21.15.37:0/2569159569 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2480c5c10 con 0x557e540c02f0 2024-08-20T05:14:39.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.069+0000 7fb237400640 1 -- 172.21.15.37:0/2569159569 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb2480c6340 con 0x557e540c02f0 2024-08-20T05:14:39.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.069+0000 7fb25afc3740 1 -- 172.21.15.37:0/2569159569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb23c01ec60 con 0x557e540c02f0 2024-08-20T05:14:39.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.073+0000 7fb237400640 1 -- 172.21.15.37:0/2569159569 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb2480d8050 con 0x557e540c02f0 2024-08-20T05:14:39.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.073+0000 7fb25afc3740 10 client.28522 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:39.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.073+0000 7fb25afc3740 1 -- 172.21.15.37:0/2569159569 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x557e540be280 con 0x557e540c02f0 2024-08-20T05:14:39.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.073+0000 7fb237400640 1 -- 172.21.15.37:0/2569159569 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb23c01ec60 con 0x557e540c02f0 2024-08-20T05:14:39.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.075+0000 7fb237400640 1 -- 172.21.15.37:0/2569159569 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7fb2480cf430 con 0x557e540c02f0 2024-08-20T05:14:39.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.075+0000 7fb25afc3740 10 client.28522 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:39.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.075+0000 7fb25afc3740 10 client.28522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:14:39.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.075+0000 7fb25afc3740 20 client.28522 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:39.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.075+0000 7fb25afc3740 1 --2- 172.21.15.37:0/2569159569 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557e540cc280 0x557e541493f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:39.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.075+0000 7fb25afc3740 4 client.28522 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T05:14:39.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.075+0000 7fb25afc3740 1 -- 172.21.15.37:0/2569159569 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557e54034260 con 0x557e540cc280 2024-08-20T05:14:39.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.079+0000 7fb255a00640 1 --2- 172.21.15.37:0/2569159569 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557e540cc280 0x557e541493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:39.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.079+0000 7fb255a00640 1 --2- 172.21.15.37:0/2569159569 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557e540cc280 0x557e541493f0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8733d1cd1958e27c server_cookie=2453a0574b3986b5 in_seq=0 out_seq=0 2024-08-20T05:14:39.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.079+0000 7fb237400640 10 client.28522 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:39.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.082+0000 7fb237400640 1 -- 172.21.15.37:0/2569159569 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557e54034260 con 0x557e540cc280 2024-08-20T05:14:39.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.082+0000 7fb237400640 10 client.28522 handle_command_reply: tid=0 2024-08-20T05:14:39.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.083+0000 7fb25afc3740 1 client.28522 shutdown 2024-08-20T05:14:39.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.083+0000 7fb25afc3740 1 -- 172.21.15.37:0/2569159569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 msgr2=0x557e540d0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:39.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.083+0000 7fb25afc3740 1 --2- 172.21.15.37:0/2569159569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 0x557e540d0dc0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb2480c56c0 tx=0x7fb248005f90 comp rx=0 tx=0).stop 2024-08-20T05:14:39.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.083+0000 7fb25afc3740 1 -- 172.21.15.37:0/2569159569 shutdown_connections 2024-08-20T05:14:39.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.084+0000 7fb25afc3740 1 --2- 172.21.15.37:0/2569159569 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x557e540cc280 0x557e541493f0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.084+0000 7fb25afc3740 1 --2- 172.21.15.37:0/2569159569 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e540c02f0 0x557e540d0dc0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.084+0000 7fb25afc3740 1 --2- 172.21.15.37:0/2569159569 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e540bf9d0 0x557e540d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.084+0000 7fb25afc3740 1 --2- 172.21.15.37:0/2569159569 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e540bd800 0x557e540d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.084+0000 7fb25afc3740 1 -- 172.21.15.37:0/2569159569 >> 172.21.15.37:0/2569159569 conn(0x557e540c4910 msgr2=0x557e540ca5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:39.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.084+0000 7fb237400640 0 client.28522 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:39.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.085+0000 7fb25afc3740 1 -- 172.21.15.37:0/2569159569 shutdown_connections 2024-08-20T05:14:39.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.085+0000 7fb25afc3740 1 -- 172.21.15.37:0/2569159569 wait complete. 2024-08-20T05:14:39.094 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:14:39.094 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-20T05:14:39.094 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "578e11b7-c998-45b0-9619-15b968980fa2", 2024-08-20T05:14:39.095 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-20T05:14:39.095 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:14:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.088+0000 7fb25afc3740 20 client.28522 trim_cache size 0 max 16384 2024-08-20T05:14:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.089+0000 7fb258400640 1 -- 172.21.15.37:0/995730891 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2380b3de0 msgr2=0x7fb2380b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.089+0000 7fb258400640 1 --2- 172.21.15.37:0/995730891 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2380b3de0 0x7fb2380b62a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x557e540bf980 tx=0x7fb23c009260 comp rx=0 tx=0).stop 2024-08-20T05:14:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.089+0000 7fb258400640 1 -- 172.21.15.37:0/995730891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb25010f470 msgr2=0x7fb25007c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.089+0000 7fb258400640 1 --2- 172.21.15.37:0/995730891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb25010f470 0x7fb25007c680 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb24802a930 tx=0x7fb248032d20 comp rx=0 tx=0).stop 2024-08-20T05:14:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.089+0000 7fb258400640 1 -- 172.21.15.37:0/995730891 shutdown_connections 2024-08-20T05:14:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.089+0000 7fb258400640 1 --2- 172.21.15.37:0/995730891 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb2380b3de0 0x7fb2380b62a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.089+0000 7fb258400640 1 --2- 172.21.15.37:0/995730891 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb25010f470 0x7fb25007c680 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.089+0000 7fb258400640 1 --2- 172.21.15.37:0/995730891 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb25010eaf0 0x7fb250083840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.089+0000 7fb258400640 1 --2- 172.21.15.37:0/995730891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2501090e0 0x7fb250083300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:39.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.089+0000 7fb258400640 1 -- 172.21.15.37:0/995730891 >> 172.21.15.37:0/995730891 conn(0x7fb250078760 msgr2=0x7fb25007ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:39.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.089+0000 7fb258400640 1 -- 172.21.15.37:0/995730891 shutdown_connections 2024-08-20T05:14:39.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:39.090+0000 7fb258400640 1 -- 172.21.15.37:0/995730891 wait complete. 2024-08-20T05:14:39.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:39 smithi037 ceph-mon[17265]: pgmap v773: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.0 MiB/s wr, 553 op/s 2024-08-20T05:14:39.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:39 smithi037 ceph-mon[17265]: scrub queued for path: / 2024-08-20T05:14:39.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:39 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:39.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:39 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:14:39.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:39 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:14:39.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:39 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:14:39.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:39 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:39.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:39 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:39 smithi135 ceph-mon[22342]: pgmap v773: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.0 MiB/s wr, 553 op/s 2024-08-20T05:14:39.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:39 smithi135 ceph-mon[22342]: scrub queued for path: / 2024-08-20T05:14:39.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:39 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:39.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:39 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:14:39.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:39 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:14:39.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:39 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:14:39.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:39 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:39.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:39 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:39.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:39 smithi130 ceph-mon[22007]: pgmap v773: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.0 MiB/s wr, 553 op/s 2024-08-20T05:14:39.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:39 smithi130 ceph-mon[22007]: scrub queued for path: / 2024-08-20T05:14:39.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:39 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:39.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:39 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:14:39.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:39 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:14:39.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:39 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:14:39.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:39 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:39.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:39 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:40.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:40 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:14:40.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:40 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:14:40.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:40 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:40.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:40 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:40.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:40 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:40.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:40 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:14:40.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:40 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:14:40.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:40 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:40.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:40 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:40.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:40 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:41.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:40 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:14:41.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:40 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:14:41.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:40 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:41.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:40 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:41.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:40 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:14:41.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:14:41.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:41 smithi037 ceph-mon[17265]: pgmap v774: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 6.8 MiB/s wr, 609 op/s 2024-08-20T05:14:41.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:41 smithi135 ceph-mon[22342]: pgmap v774: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 6.8 MiB/s wr, 609 op/s 2024-08-20T05:14:41.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:41 smithi130 ceph-mon[22007]: pgmap v774: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 6.8 MiB/s wr, 609 op/s 2024-08-20T05:14:42.267 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:14:43.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 705.0 s, 532.5 tps, lat 194.007 ms stddev 268.293 2024-08-20T05:14:43.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.057+0000 7f672b200640 1 -- 172.21.15.37:0/3252313834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6724075210 msgr2=0x7f67240755f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:43.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.057+0000 7f672b200640 1 --2- 172.21.15.37:0/3252313834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6724075210 0x7f67240755f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6714009860 tx=0x7f671402a340 comp rx=0 tx=0).stop 2024-08-20T05:14:43.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.058+0000 7f672b200640 1 -- 172.21.15.37:0/3252313834 shutdown_connections 2024-08-20T05:14:43.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.058+0000 7f672b200640 1 --2- 172.21.15.37:0/3252313834 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f672410f0a0 0x7f6724111490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.058+0000 7f672b200640 1 --2- 172.21.15.37:0/3252313834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6724075b30 0x7f672410eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.058+0000 7f672b200640 1 --2- 172.21.15.37:0/3252313834 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f6724075210 0x7f67240755f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.058+0000 7f672b200640 1 -- 172.21.15.37:0/3252313834 >> 172.21.15.37:0/3252313834 conn(0x7f67240fe500 msgr2=0x7f6724100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:43.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.058+0000 7f672b200640 1 -- 172.21.15.37:0/3252313834 shutdown_connections 2024-08-20T05:14:43.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.059+0000 7f672b200640 1 -- 172.21.15.37:0/3252313834 wait complete. 2024-08-20T05:14:43.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.060+0000 7f672b200640 1 Processor -- start 2024-08-20T05:14:43.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.061+0000 7f672b200640 1 -- start start 2024-08-20T05:14:43.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.062+0000 7f672b200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6724075210 0x7f67240742f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.063+0000 7f672b200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6724075b30 0x7f6724074830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.063+0000 7f672b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f672410f0a0 0x7f672406d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.063+0000 7f672b200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6724114c50 con 0x7f6724075b30 2024-08-20T05:14:43.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.063+0000 7f672b200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6724114ad0 con 0x7f6724075210 2024-08-20T05:14:43.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.063+0000 7f672b200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6724114dd0 con 0x7f672410f0a0 2024-08-20T05:14:43.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.063+0000 7f6723e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6724075210 0x7f67240742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:43.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.063+0000 7f6723e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6724075210 0x7f67240742f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:49168/0 (socket says 172.21.15.37:49168) 2024-08-20T05:14:43.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.063+0000 7f6723e00640 1 -- 172.21.15.37:0/4000505608 learned_addr learned my addr 172.21.15.37:0/4000505608 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:43.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.063+0000 7f6729200640 1 --2- 172.21.15.37:0/4000505608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f672410f0a0 0x7f672406d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:43.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.063+0000 7f6723400640 1 --2- 172.21.15.37:0/4000505608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6724075b30 0x7f6724074830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:43.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.064+0000 7f6729200640 1 -- 172.21.15.37:0/4000505608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6724075210 msgr2=0x7f67240742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.064+0000 7f6729200640 1 --2- 172.21.15.37:0/4000505608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6724075210 0x7f67240742f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.064+0000 7f6729200640 1 -- 172.21.15.37:0/4000505608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6724075b30 msgr2=0x7f6724074830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.064+0000 7f6729200640 1 --2- 172.21.15.37:0/4000505608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6724075b30 0x7f6724074830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.064+0000 7f6729200640 1 -- 172.21.15.37:0/4000505608 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672406dd50 con 0x7f672410f0a0 2024-08-20T05:14:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.067+0000 7f6729200640 1 --2- 172.21.15.37:0/4000505608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f672410f0a0 0x7f672406d520 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f671c005fd0 tx=0x7f671c00c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:43.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.068+0000 7f6720c00640 1 -- 172.21.15.37:0/4000505608 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c003970 con 0x7f672410f0a0 2024-08-20T05:14:43.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.068+0000 7f6720c00640 1 -- 172.21.15.37:0/4000505608 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f671c004020 con 0x7f672410f0a0 2024-08-20T05:14:43.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.068+0000 7f672b200640 1 -- 172.21.15.37:0/4000505608 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f672406e040 con 0x7f672410f0a0 2024-08-20T05:14:43.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.069+0000 7f672b200640 1 -- 172.21.15.37:0/4000505608 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6724073130 con 0x7f672410f0a0 2024-08-20T05:14:43.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.069+0000 7f6720c00640 1 -- 172.21.15.37:0/4000505608 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c00b840 con 0x7f672410f0a0 2024-08-20T05:14:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.073+0000 7f672dc15740 1 Processor -- start 2024-08-20T05:14:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.078+0000 7f672dc15740 1 -- start start 2024-08-20T05:14:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.078+0000 7f6720c00640 1 -- 172.21.15.37:0/4000505608 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f671c01d020 con 0x7f672410f0a0 2024-08-20T05:14:43.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.079+0000 7f672dc15740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6790900 0x55b3a6790ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.079+0000 7f672dc15740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a6791220 0x55b3a679cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.079+0000 7f672dc15740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a679d1b0 0x55b3a679f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.079+0000 7f6723e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a6791220 0x55b3a679cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:43.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.079+0000 7f6723e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a6791220 0x55b3a679cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52502/0 (socket says 172.21.15.37:52502) 2024-08-20T05:14:43.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.079+0000 7f6723e00640 1 -- 172.21.15.37:0/4023297755 learned_addr learned my addr 172.21.15.37:0/4023297755 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:43.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.079+0000 7f672dc15740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b3a6706a60 con 0x55b3a679d1b0 2024-08-20T05:14:43.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.079+0000 7f672dc15740 1 -- 172.21.15.37:0/4023297755 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b3a66f5f60 con 0x55b3a6790900 2024-08-20T05:14:43.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.079+0000 7f672dc15740 1 -- 172.21.15.37:0/4023297755 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b3a66f9fa0 con 0x55b3a6791220 2024-08-20T05:14:43.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.079+0000 7f6723400640 1 --2- 172.21.15.37:0/4023297755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6790900 0x55b3a6790ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:43.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.081+0000 7f6723400640 1 --2- 172.21.15.37:0/4023297755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a679d1b0 0x55b3a679f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:43.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.082+0000 7f6723400640 1 -- 172.21.15.37:0/4023297755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a6791220 msgr2=0x55b3a679cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:43.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.082+0000 7f6723400640 1 --2- 172.21.15.37:0/4023297755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a6791220 0x55b3a679cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.082+0000 7f6723400640 1 -- 172.21.15.37:0/4023297755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6790900 msgr2=0x55b3a6790ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:43.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.082+0000 7f6723400640 1 --2- 172.21.15.37:0/4023297755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6790900 0x55b3a6790ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.082+0000 7f6723400640 1 -- 172.21.15.37:0/4023297755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a669c3e0 con 0x55b3a679d1b0 2024-08-20T05:14:43.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.083+0000 7f6723400640 1 --2- 172.21.15.37:0/4023297755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a679d1b0 0x55b3a679f5a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6710011720 tx=0x7f671000a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f51d331ecdeb00 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:43.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.085+0000 7f6719600640 1 -- 172.21.15.37:0/4023297755 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671000d950 con 0x55b3a679d1b0 2024-08-20T05:14:43.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.085+0000 7f6719600640 1 -- 172.21.15.37:0/4023297755 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6710005020 con 0x55b3a679d1b0 2024-08-20T05:14:43.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.085+0000 7f6719600640 1 -- 172.21.15.37:0/4023297755 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710004ba0 con 0x55b3a679d1b0 2024-08-20T05:14:43.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.087+0000 7f672dc15740 1 -- 172.21.15.37:0/4023297755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a679d1b0 msgr2=0x55b3a679f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:43.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.087+0000 7f672dc15740 1 --2- 172.21.15.37:0/4023297755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a679d1b0 0x55b3a679f5a0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6710011720 tx=0x7f671000a2d0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.088+0000 7f6720c00640 1 --2- 172.21.15.37:0/4000505608 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f67080b3da0 0x7f67080b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.088+0000 7f6720c00640 1 -- 172.21.15.37:0/4000505608 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f671c0e3c20 con 0x7f672410f0a0 2024-08-20T05:14:43.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.090+0000 7f6723e00640 1 --2- 172.21.15.37:0/4000505608 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f67080b3da0 0x7f67080b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:43.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.090+0000 7f672dc15740 1 -- 172.21.15.37:0/4023297755 shutdown_connections 2024-08-20T05:14:43.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.090+0000 7f672dc15740 1 --2- 172.21.15.37:0/4023297755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a679d1b0 0x55b3a679f5a0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.090+0000 7f672dc15740 1 --2- 172.21.15.37:0/4023297755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a6791220 0x55b3a679cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.090+0000 7f672dc15740 1 --2- 172.21.15.37:0/4023297755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6790900 0x55b3a6790ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.090+0000 7f672dc15740 1 -- 172.21.15.37:0/4023297755 >> 172.21.15.37:0/4023297755 conn(0x55b3a678e730 msgr2=0x55b3a678f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.093+0000 7f672dc15740 1 -- 172.21.15.37:0/4023297755 shutdown_connections 2024-08-20T05:14:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.094+0000 7f672dc15740 1 -- 172.21.15.37:0/4023297755 wait complete. 2024-08-20T05:14:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.094+0000 7f6723e00640 1 --2- 172.21.15.37:0/4000505608 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f67080b3da0 0x7f67080b6260 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f671400b230 tx=0x7f671400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.094+0000 7f672dc15740 1 -- start start 2024-08-20T05:14:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.095+0000 7f672dc15740 1 Processor -- start 2024-08-20T05:14:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.096+0000 7f672dc15740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6790900 0x55b3a679c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.096+0000 7f672dc15740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a6791220 0x55b3a6799dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.096+0000 7f672dc15740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a679d1b0 0x55b3a679a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.096+0000 7f6723400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a6791220 0x55b3a6799dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.096+0000 7f6723e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6790900 0x55b3a679c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.096+0000 7f6723400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a6791220 0x55b3a6799dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49500/0 (socket says 172.21.15.37:49500) 2024-08-20T05:14:43.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.096+0000 7f6729200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a679d1b0 0x55b3a679a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.096+0000 7f6729200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a679d1b0 0x55b3a679a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52508/0 (socket says 172.21.15.37:52508) 2024-08-20T05:14:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.096+0000 7f6723e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6790900 0x55b3a679c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:49180/0 (socket says 172.21.15.37:49180) 2024-08-20T05:14:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.097+0000 7f672dc15740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b3a6558700 con 0x55b3a6791220 2024-08-20T05:14:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.097+0000 7f672dc15740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b3a6691250 con 0x55b3a6790900 2024-08-20T05:14:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.097+0000 7f672dc15740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b3a679fe30 con 0x55b3a679d1b0 2024-08-20T05:14:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.097+0000 7f672dc15740 10 client.0 _ll_register_callbacks cb 0x55b3a66f0180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.099+0000 7f6723400640 1 -- 172.21.15.37:0/3072850614 learned_addr learned my addr 172.21.15.37:0/3072850614 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.099+0000 7f6723e00640 1 -- 172.21.15.37:0/3072850614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a679d1b0 msgr2=0x55b3a679a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.099+0000 7f6723e00640 1 --2- 172.21.15.37:0/3072850614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a679d1b0 0x55b3a679a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.099+0000 7f6723e00640 1 -- 172.21.15.37:0/3072850614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a6791220 msgr2=0x55b3a6799dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.099+0000 7f6723e00640 1 --2- 172.21.15.37:0/3072850614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a6791220 0x55b3a6799dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.099+0000 7f6723e00640 1 -- 172.21.15.37:0/3072850614 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3a6455650 con 0x55b3a6790900 2024-08-20T05:14:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.100+0000 7f6723e00640 1 --2- 172.21.15.37:0/3072850614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6790900 0x55b3a679c980 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x55b3a678f610 tx=0x7f671402a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24732cb1f92aaa24 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.100+0000 7f670e000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:14:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.102+0000 7f670e000640 1 -- 172.21.15.37:0/3072850614 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671404f020 con 0x55b3a6790900 2024-08-20T05:14:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.102+0000 7f670e000640 1 -- 172.21.15.37:0/3072850614 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6714030d90 con 0x55b3a6790900 2024-08-20T05:14:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.102+0000 7f672dc15740 1 -- 172.21.15.37:0/3072850614 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6710005020 con 0x55b3a6790900 2024-08-20T05:14:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.102+0000 7f670e000640 1 -- 172.21.15.37:0/3072850614 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f671405a050 con 0x55b3a6790900 2024-08-20T05:14:43.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.102+0000 7f672dc15740 10 client.28493 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.102+0000 7f672dc15740 1 -- 172.21.15.37:0/3072850614 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55b3a67a96e0 con 0x55b3a6790900 2024-08-20T05:14:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.102+0000 7f670e000640 1 -- 172.21.15.37:0/3072850614 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6710005020 con 0x55b3a6790900 2024-08-20T05:14:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.104+0000 7f670e000640 1 -- 172.21.15.37:0/3072850614 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f671404b7f0 con 0x55b3a6790900 2024-08-20T05:14:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.104+0000 7f672dc15740 10 client.28493 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.104+0000 7f672dc15740 10 client.28493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:14:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.104+0000 7f672dc15740 20 client.28493 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.104+0000 7f672dc15740 1 --2- 172.21.15.37:0/3072850614 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b3a67aad40 0x55b3a67ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.105+0000 7f672dc15740 4 client.28493 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:14:43.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.105+0000 7f672dc15740 1 -- 172.21.15.37:0/3072850614 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3a67089b0 con 0x55b3a67aad40 2024-08-20T05:14:43.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.106+0000 7f6723400640 1 --2- 172.21.15.37:0/3072850614 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b3a67aad40 0x55b3a67ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:43.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.107+0000 7f6723400640 1 --2- 172.21.15.37:0/3072850614 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b3a67aad40 0x55b3a67ad1e0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68a528a1c38a16c4 server_cookie=1e48ddf58aa56bd4 in_seq=0 out_seq=0 2024-08-20T05:14:43.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.107+0000 7f670e000640 10 client.28493 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:43.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.108+0000 7f670e000640 1 -- 172.21.15.37:0/3072850614 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b3a67089b0 con 0x55b3a67aad40 2024-08-20T05:14:43.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.108+0000 7f670e000640 10 client.28493 handle_command_reply: tid=0 2024-08-20T05:14:43.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.108+0000 7f672dc15740 1 client.28493 shutdown 2024-08-20T05:14:43.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.109+0000 7f672dc15740 1 -- 172.21.15.37:0/3072850614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6790900 msgr2=0x55b3a679c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.109+0000 7f672dc15740 1 --2- 172.21.15.37:0/3072850614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6790900 0x55b3a679c980 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x55b3a678f610 tx=0x7f671402a340 comp rx=0 tx=0).stop 2024-08-20T05:14:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.109+0000 7f672dc15740 1 -- 172.21.15.37:0/3072850614 shutdown_connections 2024-08-20T05:14:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.109+0000 7f672dc15740 1 --2- 172.21.15.37:0/3072850614 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b3a67aad40 0x55b3a67ad1e0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.109+0000 7f672dc15740 1 --2- 172.21.15.37:0/3072850614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a679d1b0 0x55b3a679a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.109+0000 7f672dc15740 1 --2- 172.21.15.37:0/3072850614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a6791220 0x55b3a6799dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.109+0000 7f672dc15740 1 --2- 172.21.15.37:0/3072850614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6790900 0x55b3a679c980 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.109+0000 7f672dc15740 1 -- 172.21.15.37:0/3072850614 >> 172.21.15.37:0/3072850614 conn(0x55b3a678e730 msgr2=0x55b3a67942a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.109+0000 7f670e000640 0 client.28493 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.109+0000 7f672dc15740 1 -- 172.21.15.37:0/3072850614 shutdown_connections 2024-08-20T05:14:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.109+0000 7f672dc15740 1 -- 172.21.15.37:0/3072850614 wait complete. 2024-08-20T05:14:43.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.110+0000 7f672dc15740 20 client.28493 trim_cache size 0 max 16384 2024-08-20T05:14:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.152+0000 7f672dc15740 1 Processor -- start 2024-08-20T05:14:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.156+0000 7f672dc15740 1 -- start start 2024-08-20T05:14:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.156+0000 7f672dc15740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a6790900 0x55b3a678d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.156+0000 7f672dc15740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a6791220 0x55b3a67a7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.156+0000 7f672dc15740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a679d1b0 0x55b3a67a76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.156+0000 7f672dc15740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f670400fbd0 con 0x55b3a6790900 2024-08-20T05:14:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.156+0000 7f672dc15740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6704011710 con 0x55b3a679d1b0 2024-08-20T05:14:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.156+0000 7f672dc15740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f67040102a0 con 0x55b3a6791220 2024-08-20T05:14:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.157+0000 7f6723400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a6791220 0x55b3a67a7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.157+0000 7f6723400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a6791220 0x55b3a67a7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52514/0 (socket says 172.21.15.37:52514) 2024-08-20T05:14:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.157+0000 7f6723400640 1 -- 172.21.15.37:0/1964079627 learned_addr learned my addr 172.21.15.37:0/1964079627 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.157+0000 7f6723e00640 1 --2- 172.21.15.37:0/1964079627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a6790900 0x55b3a678d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.157+0000 7f6729200640 1 --2- 172.21.15.37:0/1964079627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a679d1b0 0x55b3a67a76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.160+0000 7f6729200640 1 -- 172.21.15.37:0/1964079627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a6791220 msgr2=0x55b3a67a7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.160+0000 7f6729200640 1 --2- 172.21.15.37:0/1964079627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a6791220 0x55b3a67a7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.160+0000 7f6729200640 1 -- 172.21.15.37:0/1964079627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a6790900 msgr2=0x55b3a678d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.160+0000 7f6729200640 1 --2- 172.21.15.37:0/1964079627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a6790900 0x55b3a678d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.160+0000 7f6729200640 1 -- 172.21.15.37:0/1964079627 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3a678f1b0 con 0x55b3a679d1b0 2024-08-20T05:14:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.160+0000 7f6729200640 1 --2- 172.21.15.37:0/1964079627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a679d1b0 0x55b3a67a76a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f671c0a79e0 tx=0x7f671c0a66e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7af6f955ecfcdb3c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.161+0000 7f6718c00640 1 -- 172.21.15.37:0/1964079627 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c0c4070 con 0x55b3a679d1b0 2024-08-20T05:14:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.161+0000 7f6718c00640 1 -- 172.21.15.37:0/1964079627 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f671c0aed70 con 0x55b3a679d1b0 2024-08-20T05:14:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.161+0000 7f6718c00640 1 -- 172.21.15.37:0/1964079627 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c0b35f0 con 0x55b3a679d1b0 2024-08-20T05:14:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.162+0000 7f672dc15740 1 -- 172.21.15.37:0/1964079627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a679d1b0 msgr2=0x55b3a67a76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.162+0000 7f672dc15740 1 --2- 172.21.15.37:0/1964079627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a679d1b0 0x55b3a67a76a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f671c0a79e0 tx=0x7f671c0a66e0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.162+0000 7f672dc15740 1 -- 172.21.15.37:0/1964079627 shutdown_connections 2024-08-20T05:14:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.162+0000 7f672dc15740 1 --2- 172.21.15.37:0/1964079627 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a679d1b0 0x55b3a67a76a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.162+0000 7f672dc15740 1 --2- 172.21.15.37:0/1964079627 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a6791220 0x55b3a67a7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.162+0000 7f672dc15740 1 --2- 172.21.15.37:0/1964079627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a6790900 0x55b3a678d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.162+0000 7f672dc15740 1 -- 172.21.15.37:0/1964079627 >> 172.21.15.37:0/1964079627 conn(0x55b3a678e730 msgr2=0x55b3a678cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.162+0000 7f672dc15740 1 -- 172.21.15.37:0/1964079627 shutdown_connections 2024-08-20T05:14:43.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.162+0000 7f672dc15740 1 -- 172.21.15.37:0/1964079627 wait complete. 2024-08-20T05:14:43.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.163+0000 7f672dc15740 1 -- start start 2024-08-20T05:14:43.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.163+0000 7f672dc15740 1 Processor -- start 2024-08-20T05:14:43.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.164+0000 7f672dc15740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a6790900 0x55b3a67a4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.164+0000 7f672dc15740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6791220 0x55b3a67a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.165+0000 7f672dc15740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a679d1b0 0x55b3a6830c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.165+0000 7f672dc15740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6704011040 con 0x55b3a6790900 2024-08-20T05:14:43.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.165+0000 7f672dc15740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6704010970 con 0x55b3a6791220 2024-08-20T05:14:43.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.165+0000 7f6729200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a679d1b0 0x55b3a6830c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:43.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.165+0000 7f672dc15740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f670400dbb0 con 0x55b3a679d1b0 2024-08-20T05:14:43.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.165+0000 7f6729200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a679d1b0 0x55b3a6830c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52524/0 (socket says 172.21.15.37:52524) 2024-08-20T05:14:43.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.165+0000 7f6729200640 1 -- 172.21.15.37:0/4004681277 learned_addr learned my addr 172.21.15.37:0/4004681277 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:43.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.165+0000 7f672dc15740 10 client.0 _ll_register_callbacks cb 0x7f6714042070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:43.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.166+0000 7f6729200640 1 -- 172.21.15.37:0/4004681277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6791220 msgr2=0x55b3a67a4c10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:14:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.166+0000 7f6729200640 1 --2- 172.21.15.37:0/4004681277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6791220 0x55b3a67a4c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.166+0000 7f6729200640 1 -- 172.21.15.37:0/4004681277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a6790900 msgr2=0x55b3a67a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.166+0000 7f6729200640 1 --2- 172.21.15.37:0/4004681277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a6790900 0x55b3a67a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.166+0000 7f6729200640 1 -- 172.21.15.37:0/4004681277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3a6831380 con 0x55b3a679d1b0 2024-08-20T05:14:43.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.167+0000 7f6729200640 1 --2- 172.21.15.37:0/4004681277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a679d1b0 0x55b3a6830c70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f671c0a6070 tx=0x7f671c0aac80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b4f8dffbaa97a14 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:43.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.167+0000 7f670e000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:14:43.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.167+0000 7f670e000640 1 -- 172.21.15.37:0/4004681277 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c0c4070 con 0x55b3a679d1b0 2024-08-20T05:14:43.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.168+0000 7f670e000640 1 -- 172.21.15.37:0/4004681277 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f671c0b35a0 con 0x55b3a679d1b0 2024-08-20T05:14:43.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.168+0000 7f672dc15740 1 -- 172.21.15.37:0/4004681277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f671c0aed70 con 0x55b3a679d1b0 2024-08-20T05:14:43.170 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.168+0000 7f670e000640 1 -- 172.21.15.37:0/4004681277 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f671c003b10 con 0x55b3a679d1b0 2024-08-20T05:14:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.168+0000 7f672dc15740 10 client.28540 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.169+0000 7f672dc15740 1 -- 172.21.15.37:0/4004681277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55b3a68398f0 con 0x55b3a679d1b0 2024-08-20T05:14:43.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.169+0000 7f670e000640 1 -- 172.21.15.37:0/4004681277 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f671c0aed70 con 0x55b3a679d1b0 2024-08-20T05:14:43.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.170+0000 7f670e000640 1 -- 172.21.15.37:0/4004681277 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f671c00b040 con 0x55b3a679d1b0 2024-08-20T05:14:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.171+0000 7f672dc15740 10 client.28540 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.171+0000 7f672dc15740 10 client.28540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:14:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.171+0000 7f672dc15740 20 client.28540 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.171+0000 7f672dc15740 1 --2- 172.21.15.37:0/4004681277 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b3a6839f90 0x55b3a683c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.171+0000 7f672dc15740 4 client.28540 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:14:43.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.171+0000 7f672dc15740 1 -- 172.21.15.37:0/4004681277 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b3a6704450 con 0x55b3a6839f90 2024-08-20T05:14:43.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.172+0000 7f6723e00640 1 --2- 172.21.15.37:0/4004681277 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b3a6839f90 0x55b3a683c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:43.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.172+0000 7f670e000640 10 client.28540 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:43.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.172+0000 7f6723e00640 1 --2- 172.21.15.37:0/4004681277 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b3a6839f90 0x55b3a683c3d0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d15062cea3e988e server_cookie=96d73e033ef61dc8 in_seq=0 out_seq=0 2024-08-20T05:14:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.173+0000 7f670e000640 1 -- 172.21.15.37:0/4004681277 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b3a6704450 con 0x55b3a6839f90 2024-08-20T05:14:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.173+0000 7f670e000640 10 client.28540 handle_command_reply: tid=0 2024-08-20T05:14:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.173+0000 7f672dc15740 1 client.28540 shutdown 2024-08-20T05:14:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.173+0000 7f672dc15740 1 -- 172.21.15.37:0/4004681277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a679d1b0 msgr2=0x55b3a6830c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.173+0000 7f672dc15740 1 --2- 172.21.15.37:0/4004681277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a679d1b0 0x55b3a6830c70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f671c0a6070 tx=0x7f671c0aac80 comp rx=0 tx=0).stop 2024-08-20T05:14:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.173+0000 7f672dc15740 1 -- 172.21.15.37:0/4004681277 shutdown_connections 2024-08-20T05:14:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.173+0000 7f672dc15740 1 --2- 172.21.15.37:0/4004681277 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b3a6839f90 0x55b3a683c3d0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.173+0000 7f670e000640 0 client.28540 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:43.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.173+0000 7f672dc15740 1 --2- 172.21.15.37:0/4004681277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b3a679d1b0 0x55b3a6830c70 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.173+0000 7f672dc15740 1 --2- 172.21.15.37:0/4004681277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b3a6791220 0x55b3a67a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.173+0000 7f672dc15740 1 --2- 172.21.15.37:0/4004681277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b3a6790900 0x55b3a67a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.173+0000 7f672dc15740 1 -- 172.21.15.37:0/4004681277 >> 172.21.15.37:0/4004681277 conn(0x55b3a678e730 msgr2=0x55b3a678d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:43.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.174+0000 7f672dc15740 1 -- 172.21.15.37:0/4004681277 shutdown_connections 2024-08-20T05:14:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.175+0000 7f672dc15740 1 -- 172.21.15.37:0/4004681277 wait complete. 2024-08-20T05:14:43.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.175+0000 7f672dc15740 20 client.28540 trim_cache size 0 max 16384 2024-08-20T05:14:43.177 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:14:43.177 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T05:14:43.177 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-20T05:14:43.177 INFO:teuthology.orchestra.run.smithi037.stdout: "578e11b7-c998-45b0-9619-15b968980fa2": { 2024-08-20T05:14:43.177 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-20T05:14:43.177 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "578e11b7-c998-45b0-9619-15b968980fa2", 2024-08-20T05:14:43.178 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-20T05:14:43.178 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:14:43.178 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:14:43.178 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:14:43.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.176+0000 7f672b200640 1 -- 172.21.15.37:0/4000505608 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f67080b3da0 msgr2=0x7f67080b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:43.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.176+0000 7f672b200640 1 --2- 172.21.15.37:0/4000505608 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f67080b3da0 0x7f67080b6260 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f671400b230 tx=0x7f671400b040 comp rx=0 tx=0).stop 2024-08-20T05:14:43.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.176+0000 7f672b200640 1 -- 172.21.15.37:0/4000505608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f672410f0a0 msgr2=0x7f672406d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:43.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.176+0000 7f672b200640 1 --2- 172.21.15.37:0/4000505608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f672410f0a0 0x7f672406d520 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f671c005fd0 tx=0x7f671c00c740 comp rx=0 tx=0).stop 2024-08-20T05:14:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.177+0000 7f672b200640 1 -- 172.21.15.37:0/4000505608 shutdown_connections 2024-08-20T05:14:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.177+0000 7f672b200640 1 --2- 172.21.15.37:0/4000505608 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f67080b3da0 0x7f67080b6260 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.177+0000 7f672b200640 1 --2- 172.21.15.37:0/4000505608 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f672410f0a0 0x7f672406d520 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.177+0000 7f672b200640 1 --2- 172.21.15.37:0/4000505608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6724075b30 0x7f6724074830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.177+0000 7f672b200640 1 --2- 172.21.15.37:0/4000505608 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f6724075210 0x7f67240742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.177+0000 7f672b200640 1 -- 172.21.15.37:0/4000505608 >> 172.21.15.37:0/4000505608 conn(0x7f67240fe500 msgr2=0x7f6724108bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.177+0000 7f672b200640 1 -- 172.21.15.37:0/4000505608 shutdown_connections 2024-08-20T05:14:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:43.177+0000 7f672b200640 1 -- 172.21.15.37:0/4000505608 wait complete. 2024-08-20T05:14:43.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:43 smithi135 ceph-mon[22342]: pgmap v775: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 6.0 MiB/s wr, 554 op/s 2024-08-20T05:14:43.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:43 smithi130 ceph-mon[22007]: pgmap v775: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 6.0 MiB/s wr, 554 op/s 2024-08-20T05:14:44.018 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:43 smithi037 ceph-mon[17265]: pgmap v775: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 6.0 MiB/s wr, 554 op/s 2024-08-20T05:14:44.240 INFO:tasks.cephfs.filesystem:scrub status for tag:578e11b7-c998-45b0-9619-15b968980fa2 - {'path': '/', 'tag': '578e11b7-c998-45b0-9619-15b968980fa2', 'options': 'recursive,force'} 2024-08-20T05:14:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:45 smithi135 ceph-mon[22342]: pgmap v776: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 6.4 MiB/s wr, 643 op/s 2024-08-20T05:14:45.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:45 smithi130 ceph-mon[22007]: pgmap v776: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 6.4 MiB/s wr, 643 op/s 2024-08-20T05:14:46.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:45 smithi037 ceph-mon[17265]: pgmap v776: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 6.4 MiB/s wr, 643 op/s 2024-08-20T05:14:47.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:47 smithi135 ceph-mon[22342]: pgmap v777: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 6.1 MiB/s wr, 619 op/s 2024-08-20T05:14:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:47 smithi130 ceph-mon[22007]: pgmap v777: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 6.1 MiB/s wr, 619 op/s 2024-08-20T05:14:48.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:47 smithi037 ceph-mon[17265]: pgmap v777: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 6.1 MiB/s wr, 619 op/s 2024-08-20T05:14:48.040 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 710.0 s, 531.2 tps, lat 189.340 ms stddev 218.593 2024-08-20T05:14:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.744+0000 7f2b29a00640 1 -- 172.21.15.37:0/1191445093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b241033e0 msgr2=0x7f2b24105850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.744+0000 7f2b29a00640 1 --2- 172.21.15.37:0/1191445093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b241033e0 0x7f2b24105850 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009860 tx=0x7f2b1002a380 comp rx=0 tx=0).stop 2024-08-20T05:14:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.744+0000 7f2b29a00640 1 -- 172.21.15.37:0/1191445093 shutdown_connections 2024-08-20T05:14:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.744+0000 7f2b29a00640 1 --2- 172.21.15.37:0/1191445093 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b24105f90 0x7f2b24106440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.744+0000 7f2b29a00640 1 --2- 172.21.15.37:0/1191445093 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b241033e0 0x7f2b24105850 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.744+0000 7f2b29a00640 1 --2- 172.21.15.37:0/1191445093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b2406b170 0x7f2b24102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.746 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.744+0000 7f2b29a00640 1 -- 172.21.15.37:0/1191445093 >> 172.21.15.37:0/1191445093 conn(0x7f2b240fcc50 msgr2=0x7f2b240ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.744+0000 7f2b29a00640 1 -- 172.21.15.37:0/1191445093 shutdown_connections 2024-08-20T05:14:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.745+0000 7f2b29a00640 1 -- 172.21.15.37:0/1191445093 wait complete. 2024-08-20T05:14:49.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.746+0000 7f2b29a00640 1 Processor -- start 2024-08-20T05:14:49.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.748+0000 7f2b29a00640 1 -- start start 2024-08-20T05:14:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.748+0000 7f2b29a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b2406b170 0x7f2b24196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.748+0000 7f2b29a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b241033e0 0x7f2b24196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.748+0000 7f2b29a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b24105f90 0x7f2b24197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.748+0000 7f2b29a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2b24109f50 con 0x7f2b2406b170 2024-08-20T05:14:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.748+0000 7f2b29a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2b24109dd0 con 0x7f2b24105f90 2024-08-20T05:14:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.748+0000 7f2b29a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2410a0d0 con 0x7f2b241033e0 2024-08-20T05:14:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.749+0000 7f2b23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b241033e0 0x7f2b24196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.749+0000 7f2b23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b241033e0 0x7f2b24196d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52536/0 (socket says 172.21.15.37:52536) 2024-08-20T05:14:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.749+0000 7f2b23400640 1 -- 172.21.15.37:0/181932823 learned_addr learned my addr 172.21.15.37:0/181932823 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:49.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.749+0000 7f2b23e00640 1 --2- 172.21.15.37:0/181932823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b2406b170 0x7f2b24196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:49.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.751+0000 7f2b23400640 1 -- 172.21.15.37:0/181932823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b24105f90 msgr2=0x7f2b24197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:49.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.751+0000 7f2b23400640 1 --2- 172.21.15.37:0/181932823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b24105f90 0x7f2b24197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.751+0000 7f2b23400640 1 -- 172.21.15.37:0/181932823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b2406b170 msgr2=0x7f2b24196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.751+0000 7f2b23400640 1 --2- 172.21.15.37:0/181932823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b2406b170 0x7f2b24196700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.751+0000 7f2b23400640 1 -- 172.21.15.37:0/181932823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b24198240 con 0x7f2b241033e0 2024-08-20T05:14:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.751+0000 7f2b23400640 1 --2- 172.21.15.37:0/181932823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b241033e0 0x7f2b24196d50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009780 tx=0x7f2b10032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:49.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.752+0000 7f2b20c00640 1 -- 172.21.15.37:0/181932823 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b10037050 con 0x7f2b241033e0 2024-08-20T05:14:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.752+0000 7f2b29a00640 1 -- 172.21.15.37:0/181932823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b241984d0 con 0x7f2b241033e0 2024-08-20T05:14:49.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.752+0000 7f2b29a00640 1 -- 172.21.15.37:0/181932823 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b2419ec00 con 0x7f2b241033e0 2024-08-20T05:14:49.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.755+0000 7f2b20c00640 1 -- 172.21.15.37:0/181932823 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b10038040 con 0x7f2b241033e0 2024-08-20T05:14:49.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.755+0000 7f2b20c00640 1 -- 172.21.15.37:0/181932823 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b10003b40 con 0x7f2b241033e0 2024-08-20T05:14:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.758+0000 7f2b20c00640 1 -- 172.21.15.37:0/181932823 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2b10045030 con 0x7f2b241033e0 2024-08-20T05:14:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.761+0000 7f2b20c00640 1 --2- 172.21.15.37:0/181932823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2b080b3c50 0x7f2b080b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.761+0000 7f2b20c00640 1 -- 172.21.15.37:0/181932823 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2b10104db0 con 0x7f2b241033e0 2024-08-20T05:14:49.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.761+0000 7f2b2e059740 1 Processor -- start 2024-08-20T05:14:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.762+0000 7f2b23e00640 1 --2- 172.21.15.37:0/181932823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2b080b3c50 0x7f2b080b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.762+0000 7f2b2e059740 1 -- start start 2024-08-20T05:14:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.762+0000 7f2b2e059740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec37f0 0x55a11eec5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.762+0000 7f2b2e059740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec6120 0x55a11eec8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.762+0000 7f2b2e059740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 0x55a11eecb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.762+0000 7f2b2e059740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a11ee36210 con 0x55a11eec37f0 2024-08-20T05:14:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.762+0000 7f2b2e059740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a11ee25710 con 0x55a11eec8b60 2024-08-20T05:14:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.762+0000 7f2b2e059740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a11ee29750 con 0x55a11eec6120 2024-08-20T05:14:49.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.763+0000 7f2b23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec6120 0x55a11eec8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:49.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.763+0000 7f2b23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec6120 0x55a11eec8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52552/0 (socket says 172.21.15.37:52552) 2024-08-20T05:14:49.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.763+0000 7f2b23400640 1 -- 172.21.15.37:0/993499100 learned_addr learned my addr 172.21.15.37:0/993499100 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.763+0000 7f2b29000640 1 --2- 172.21.15.37:0/993499100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 0x55a11eecb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.763+0000 7f2b23e00640 1 --2- 172.21.15.37:0/993499100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec37f0 0x55a11eec5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.764+0000 7f2b29000640 1 -- 172.21.15.37:0/993499100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec6120 msgr2=0x55a11eec8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.764+0000 7f2b29000640 1 --2- 172.21.15.37:0/993499100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec6120 0x55a11eec8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.764+0000 7f2b29000640 1 -- 172.21.15.37:0/993499100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec37f0 msgr2=0x55a11eec5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.764+0000 7f2b29000640 1 --2- 172.21.15.37:0/993499100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec37f0 0x55a11eec5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.764+0000 7f2b29000640 1 -- 172.21.15.37:0/993499100 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a11edf1de0 con 0x55a11eec8b60 2024-08-20T05:14:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.764+0000 7f2b29000640 1 --2- 172.21.15.37:0/993499100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 0x55a11eecb020 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009cb0 tx=0x7f2b1c00b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fbeaf59a0dbdb5c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.764+0000 7f2b19600640 1 -- 172.21.15.37:0/993499100 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c018070 con 0x55a11eec8b60 2024-08-20T05:14:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.765+0000 7f2b23e00640 1 --2- 172.21.15.37:0/181932823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2b080b3c50 0x7f2b080b6110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2b1401a6d0 tx=0x7f2b1401aef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.768+0000 7f2b19600640 1 -- 172.21.15.37:0/993499100 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b1c0119d0 con 0x55a11eec8b60 2024-08-20T05:14:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.768+0000 7f2b19600640 1 -- 172.21.15.37:0/993499100 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c013990 con 0x55a11eec8b60 2024-08-20T05:14:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.769+0000 7f2b2e059740 1 -- 172.21.15.37:0/993499100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 msgr2=0x55a11eecb020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.769+0000 7f2b2e059740 1 --2- 172.21.15.37:0/993499100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 0x55a11eecb020 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009cb0 tx=0x7f2b1c00b7e0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.769+0000 7f2b2e059740 1 -- 172.21.15.37:0/993499100 shutdown_connections 2024-08-20T05:14:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.769+0000 7f2b2e059740 1 --2- 172.21.15.37:0/993499100 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 0x55a11eecb020 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.769+0000 7f2b2e059740 1 --2- 172.21.15.37:0/993499100 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec6120 0x55a11eec8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.769+0000 7f2b2e059740 1 --2- 172.21.15.37:0/993499100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec37f0 0x55a11eec5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.769+0000 7f2b2e059740 1 -- 172.21.15.37:0/993499100 >> 172.21.15.37:0/993499100 conn(0x55a11eebe940 msgr2=0x55a11eebf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:49.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.769+0000 7f2b2e059740 1 -- 172.21.15.37:0/993499100 shutdown_connections 2024-08-20T05:14:49.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.769+0000 7f2b2e059740 1 -- 172.21.15.37:0/993499100 wait complete. 2024-08-20T05:14:49.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.770+0000 7f2b2e059740 1 -- start start 2024-08-20T05:14:49.772 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.770+0000 7f2b2e059740 1 Processor -- start 2024-08-20T05:14:49.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.771+0000 7f2b2e059740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec37f0 0x55a11eeccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.771+0000 7f2b2e059740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec6120 0x55a11eecd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.771+0000 7f2b2e059740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec8b60 0x55a11eece130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.773 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.771+0000 7f2b23e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec37f0 0x55a11eeccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:49.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.772+0000 7f2b23400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec6120 0x55a11eecd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:49.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.772+0000 7f2b23400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec6120 0x55a11eecd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:49232/0 (socket says 172.21.15.37:49232) 2024-08-20T05:14:49.774 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.772+0000 7f2b23e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec37f0 0x55a11eeccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49566/0 (socket says 172.21.15.37:49566) 2024-08-20T05:14:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.773+0000 7f2b23400640 1 -- 172.21.15.37:0/47982535 learned_addr learned my addr 172.21.15.37:0/47982535 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.773+0000 7f2b2e059740 1 -- 172.21.15.37:0/47982535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a11ed5eab0 con 0x55a11eec37f0 2024-08-20T05:14:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.773+0000 7f2b2e059740 1 -- 172.21.15.37:0/47982535 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a11edcc140 con 0x55a11eec6120 2024-08-20T05:14:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.773+0000 7f2b2e059740 1 -- 172.21.15.37:0/47982535 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a11eecbb40 con 0x55a11eec8b60 2024-08-20T05:14:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.773+0000 7f2b2e059740 10 client.0 _ll_register_callbacks cb 0x55a11eddf5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:49.775 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.773+0000 7f2b29000640 1 --2- 172.21.15.37:0/47982535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec8b60 0x55a11eece130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.773+0000 7f2b23400640 1 -- 172.21.15.37:0/47982535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec8b60 msgr2=0x55a11eece130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.773+0000 7f2b23400640 1 --2- 172.21.15.37:0/47982535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec8b60 0x55a11eece130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.773+0000 7f2b23400640 1 -- 172.21.15.37:0/47982535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec37f0 msgr2=0x55a11eeccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.773+0000 7f2b23400640 1 --2- 172.21.15.37:0/47982535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec37f0 0x55a11eeccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.773+0000 7f2b23400640 1 -- 172.21.15.37:0/47982535 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a11edcd170 con 0x55a11eec6120 2024-08-20T05:14:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.774+0000 7f2b23400640 1 --2- 172.21.15.37:0/47982535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec6120 0x55a11eecd5d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2b10102880 tx=0x7f2b10005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aa6b1ec413d39eb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.774+0000 7f2b0e000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:14:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.776+0000 7f2b0e000640 1 -- 172.21.15.37:0/47982535 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b100cc180 con 0x55a11eec6120 2024-08-20T05:14:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.776+0000 7f2b2e059740 1 -- 172.21.15.37:0/47982535 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b1c0119d0 con 0x55a11eec6120 2024-08-20T05:14:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.777+0000 7f2b0e000640 1 -- 172.21.15.37:0/47982535 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2b100c7d10 con 0x55a11eec6120 2024-08-20T05:14:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.777+0000 7f2b0e000640 1 -- 172.21.15.37:0/47982535 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f2b100cba80 con 0x55a11eec6120 2024-08-20T05:14:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.781+0000 7f2b2e059740 10 client.28505 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.781+0000 7f2b2e059740 1 -- 172.21.15.37:0/47982535 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55a11eb88790 con 0x55a11eec6120 2024-08-20T05:14:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.781+0000 7f2b0e000640 1 -- 172.21.15.37:0/47982535 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b1c0119d0 con 0x55a11eec6120 2024-08-20T05:14:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.781+0000 7f2b0e000640 1 -- 172.21.15.37:0/47982535 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f2b100b1b70 con 0x55a11eec6120 2024-08-20T05:14:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.781+0000 7f2b2e059740 10 client.28505 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.781+0000 7f2b2e059740 10 client.28505 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:14:49.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.781+0000 7f2b2e059740 20 client.28505 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:49.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.782+0000 7f2b2e059740 1 --2- 172.21.15.37:0/47982535 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a11eed8b80 0x55a11eedb020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.782+0000 7f2b2e059740 4 client.28505 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:14:49.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.782+0000 7f2b2e059740 1 -- 172.21.15.37:0/47982535 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a11ee38160 con 0x55a11eed8b80 2024-08-20T05:14:49.784 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.782+0000 7f2b23e00640 1 --2- 172.21.15.37:0/47982535 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a11eed8b80 0x55a11eedb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.783+0000 7f2b23e00640 1 --2- 172.21.15.37:0/47982535 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a11eed8b80 0x55a11eedb020 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee89c7dc751d620e server_cookie=a31b29db8c482072 in_seq=0 out_seq=0 2024-08-20T05:14:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.783+0000 7f2b0e000640 10 client.28505 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:49.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.785+0000 7f2b0e000640 1 -- 172.21.15.37:0/47982535 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a11ee38160 con 0x55a11eed8b80 2024-08-20T05:14:49.787 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.785+0000 7f2b0e000640 10 client.28505 handle_command_reply: tid=0 2024-08-20T05:14:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.786+0000 7f2b2e059740 1 client.28505 shutdown 2024-08-20T05:14:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.786+0000 7f2b2e059740 1 -- 172.21.15.37:0/47982535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec6120 msgr2=0x55a11eecd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.786+0000 7f2b2e059740 1 --2- 172.21.15.37:0/47982535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec6120 0x55a11eecd5d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2b10102880 tx=0x7f2b10005f90 comp rx=0 tx=0).stop 2024-08-20T05:14:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.786+0000 7f2b2e059740 1 -- 172.21.15.37:0/47982535 shutdown_connections 2024-08-20T05:14:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.786+0000 7f2b2e059740 1 --2- 172.21.15.37:0/47982535 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a11eed8b80 0x55a11eedb020 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.786+0000 7f2b2e059740 1 --2- 172.21.15.37:0/47982535 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec8b60 0x55a11eece130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.786+0000 7f2b2e059740 1 --2- 172.21.15.37:0/47982535 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec6120 0x55a11eecd5d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.786+0000 7f2b2e059740 1 --2- 172.21.15.37:0/47982535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec37f0 0x55a11eeccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.786+0000 7f2b2e059740 1 -- 172.21.15.37:0/47982535 >> 172.21.15.37:0/47982535 conn(0x55a11eebe940 msgr2=0x55a11eebd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.786+0000 7f2b0e000640 0 client.28505 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.786+0000 7f2b2e059740 1 -- 172.21.15.37:0/47982535 shutdown_connections 2024-08-20T05:14:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.786+0000 7f2b2e059740 1 -- 172.21.15.37:0/47982535 wait complete. 2024-08-20T05:14:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.787+0000 7f2b2e059740 20 client.28505 trim_cache size 0 max 16384 2024-08-20T05:14:49.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.823+0000 7f2b2e059740 1 Processor -- start 2024-08-20T05:14:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.823+0000 7f2b2e059740 1 -- start start 2024-08-20T05:14:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.823+0000 7f2b2e059740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec37f0 0x55a11eebf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.823+0000 7f2b2e059740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec6120 0x55a11eec9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.823+0000 7f2b2e059740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 0x55a11eeca030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.825 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.823+0000 7f2b2e059740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0400fbc0 con 0x55a11eec6120 2024-08-20T05:14:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.823+0000 7f2b2e059740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2b04011700 con 0x55a11eec8b60 2024-08-20T05:14:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.823+0000 7f2b2e059740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2b04010290 con 0x55a11eec37f0 2024-08-20T05:14:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.824+0000 7f2b29000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 0x55a11eeca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.824+0000 7f2b29000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 0x55a11eeca030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:49244/0 (socket says 172.21.15.37:49244) 2024-08-20T05:14:49.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.824+0000 7f2b29000640 1 -- 172.21.15.37:0/337673335 learned_addr learned my addr 172.21.15.37:0/337673335 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.824+0000 7f2b23400640 1 --2- 172.21.15.37:0/337673335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec6120 0x55a11eec9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.825+0000 7f2b29000640 1 -- 172.21.15.37:0/337673335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec37f0 msgr2=0x55a11eebf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:49.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.825+0000 7f2b29000640 1 --2- 172.21.15.37:0/337673335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec37f0 0x55a11eebf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.825+0000 7f2b29000640 1 -- 172.21.15.37:0/337673335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec6120 msgr2=0x55a11eec9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.825+0000 7f2b29000640 1 --2- 172.21.15.37:0/337673335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec6120 0x55a11eec9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.825+0000 7f2b29000640 1 -- 172.21.15.37:0/337673335 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a11ec01620 con 0x55a11eec8b60 2024-08-20T05:14:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.825+0000 7f2b23400640 1 --2- 172.21.15.37:0/337673335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec6120 0x55a11eec9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:14:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.825+0000 7f2b29000640 1 --2- 172.21.15.37:0/337673335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 0x55a11eeca030 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c015000 tx=0x7f2b1c0093b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76062f3ac7f6995d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.826+0000 7f2b18c00640 1 -- 172.21.15.37:0/337673335 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c023030 con 0x55a11eec8b60 2024-08-20T05:14:49.828 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.826+0000 7f2b18c00640 1 -- 172.21.15.37:0/337673335 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b1c004020 con 0x55a11eec8b60 2024-08-20T05:14:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.826+0000 7f2b18c00640 1 -- 172.21.15.37:0/337673335 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c018040 con 0x55a11eec8b60 2024-08-20T05:14:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.827+0000 7f2b2e059740 1 -- 172.21.15.37:0/337673335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 msgr2=0x55a11eeca030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:49.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.827+0000 7f2b2e059740 1 --2- 172.21.15.37:0/337673335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 0x55a11eeca030 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c015000 tx=0x7f2b1c0093b0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.827+0000 7f2b2e059740 1 -- 172.21.15.37:0/337673335 shutdown_connections 2024-08-20T05:14:49.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.827+0000 7f2b2e059740 1 --2- 172.21.15.37:0/337673335 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 0x55a11eeca030 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.827+0000 7f2b2e059740 1 --2- 172.21.15.37:0/337673335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec6120 0x55a11eec9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.827+0000 7f2b2e059740 1 --2- 172.21.15.37:0/337673335 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec37f0 0x55a11eebf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.827+0000 7f2b2e059740 1 -- 172.21.15.37:0/337673335 >> 172.21.15.37:0/337673335 conn(0x55a11eebe940 msgr2=0x55a11eebf260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:49.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.828+0000 7f2b2e059740 1 -- 172.21.15.37:0/337673335 shutdown_connections 2024-08-20T05:14:49.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.828+0000 7f2b2e059740 1 -- 172.21.15.37:0/337673335 wait complete. 2024-08-20T05:14:49.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.828+0000 7f2b2e059740 1 -- start start 2024-08-20T05:14:49.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.829+0000 7f2b2e059740 1 Processor -- start 2024-08-20T05:14:49.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.830+0000 7f2b2e059740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec37f0 0x55a11eed00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.831+0000 7f2b2e059740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec6120 0x55a11eed0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.831+0000 7f2b2e059740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 0x55a11eed1360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.831+0000 7f2b2e059740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2b04011030 con 0x55a11eec37f0 2024-08-20T05:14:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.831+0000 7f2b23e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec37f0 0x55a11eed00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.831+0000 7f2b23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec6120 0x55a11eed0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.831+0000 7f2b23400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec6120 0x55a11eed0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:52590/0 (socket says 172.21.15.37:52590) 2024-08-20T05:14:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.831+0000 7f2b23400640 1 -- 172.21.15.37:0/3238473156 learned_addr learned my addr 172.21.15.37:0/3238473156 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.831+0000 7f2b29000640 1 --2- 172.21.15.37:0/3238473156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 0x55a11eed1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.831+0000 7f2b2e059740 1 -- 172.21.15.37:0/3238473156 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2b04010960 con 0x55a11eec8b60 2024-08-20T05:14:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.832+0000 7f2b2e059740 1 -- 172.21.15.37:0/3238473156 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0400db60 con 0x55a11eec6120 2024-08-20T05:14:49.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.832+0000 7f2b2e059740 10 client.0 _ll_register_callbacks cb 0x7f2b101024e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:14:49.835 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.832+0000 7f2b29000640 1 -- 172.21.15.37:0/3238473156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec6120 msgr2=0x55a11eed0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:49.835 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.832+0000 7f2b29000640 1 --2- 172.21.15.37:0/3238473156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec6120 0x55a11eed0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.835 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.832+0000 7f2b29000640 1 -- 172.21.15.37:0/3238473156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec37f0 msgr2=0x55a11eed00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:14:49.835 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.832+0000 7f2b29000640 1 --2- 172.21.15.37:0/3238473156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec37f0 0x55a11eed00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.835 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.832+0000 7f2b29000640 1 -- 172.21.15.37:0/3238473156 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a11eed1b90 con 0x55a11eec8b60 2024-08-20T05:14:49.835 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.833+0000 7f2b29000640 1 --2- 172.21.15.37:0/3238473156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 0x55a11eed1360 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00d010 tx=0x7f2b1c0098b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ceee08579f39332 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.833+0000 7f2b0e000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:14:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.833+0000 7f2b0e000640 1 -- 172.21.15.37:0/3238473156 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c02d020 con 0x55a11eec8b60 2024-08-20T05:14:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.833+0000 7f2b0e000640 1 -- 172.21.15.37:0/3238473156 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2b1c0041d0 con 0x55a11eec8b60 2024-08-20T05:14:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.833+0000 7f2b2e059740 1 -- 172.21.15.37:0/3238473156 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b1c004020 con 0x55a11eec8b60 2024-08-20T05:14:49.838 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.834+0000 7f2b0e000640 1 -- 172.21.15.37:0/3238473156 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f2b1c038050 con 0x55a11eec8b60 2024-08-20T05:14:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.834+0000 7f2b2e059740 10 client.28511 fetch_fsmap learned FSMap version 48 2024-08-20T05:14:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.834+0000 7f2b2e059740 1 -- 172.21.15.37:0/3238473156 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55a11eed4f10 con 0x55a11eec8b60 2024-08-20T05:14:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.834+0000 7f2b0e000640 1 -- 172.21.15.37:0/3238473156 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b1c004020 con 0x55a11eec8b60 2024-08-20T05:14:49.839 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.836+0000 7f2b0e000640 1 -- 172.21.15.37:0/3238473156 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f2b1c011c80 con 0x55a11eec8b60 2024-08-20T05:14:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.838+0000 7f2b2e059740 10 client.28511 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:14:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.838+0000 7f2b2e059740 10 client.28511 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:14:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.838+0000 7f2b2e059740 20 client.28511 populate_metadata read hostname 'smithi037' 2024-08-20T05:14:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.838+0000 7f2b2e059740 1 --2- 172.21.15.37:0/3238473156 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a11ef54990 0x55a11ef56d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.838+0000 7f2b2e059740 4 client.28511 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:14:49.840 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.838+0000 7f2b2e059740 1 -- 172.21.15.37:0/3238473156 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a11ee33c00 con 0x55a11ef54990 2024-08-20T05:14:49.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.839+0000 7f2b23e00640 1 --2- 172.21.15.37:0/3238473156 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a11ef54990 0x55a11ef56d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:49.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.839+0000 7f2b23e00640 1 --2- 172.21.15.37:0/3238473156 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a11ef54990 0x55a11ef56d80 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9be1e79128ced000 server_cookie=3c2b94f131d16354 in_seq=0 out_seq=0 2024-08-20T05:14:49.841 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.839+0000 7f2b0e000640 10 client.28511 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:49.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:49 smithi135 ceph-mon[22342]: pgmap v778: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 5.4 MiB/s wr, 554 op/s 2024-08-20T05:14:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.878+0000 7f2b0e000640 1 -- 172.21.15.37:0/3238473156 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a11ee33c00 con 0x55a11ef54990 2024-08-20T05:14:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.878+0000 7f2b0e000640 10 client.28511 handle_command_reply: tid=0 2024-08-20T05:14:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.878+0000 7f2b2e059740 1 client.28511 shutdown 2024-08-20T05:14:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.879+0000 7f2b2e059740 1 -- 172.21.15.37:0/3238473156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 msgr2=0x55a11eed1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.879+0000 7f2b2e059740 1 --2- 172.21.15.37:0/3238473156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 0x55a11eed1360 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c00d010 tx=0x7f2b1c0098b0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.879+0000 7f2b2e059740 1 -- 172.21.15.37:0/3238473156 shutdown_connections 2024-08-20T05:14:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.879+0000 7f2b2e059740 1 --2- 172.21.15.37:0/3238473156 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a11ef54990 0x55a11ef56d80 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.879+0000 7f2b2e059740 1 --2- 172.21.15.37:0/3238473156 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a11eec8b60 0x55a11eed1360 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.879+0000 7f2b2e059740 1 --2- 172.21.15.37:0/3238473156 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a11eec6120 0x55a11eed0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.879+0000 7f2b2e059740 1 --2- 172.21.15.37:0/3238473156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a11eec37f0 0x55a11eed00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.879+0000 7f2b0e000640 0 client.28511 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:14:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.879+0000 7f2b2e059740 1 -- 172.21.15.37:0/3238473156 >> 172.21.15.37:0/3238473156 conn(0x55a11eebe940 msgr2=0x55a11eebd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.880+0000 7f2b2e059740 1 -- 172.21.15.37:0/3238473156 shutdown_connections 2024-08-20T05:14:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.880+0000 7f2b2e059740 1 -- 172.21.15.37:0/3238473156 wait complete. 2024-08-20T05:14:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.880+0000 7f2b2e059740 20 client.28511 trim_cache size 0 max 16384 2024-08-20T05:14:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:14:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:14:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:14:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:14:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.881+0000 7f2b29a00640 1 -- 172.21.15.37:0/181932823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2b080b3c50 msgr2=0x7f2b080b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.881+0000 7f2b29a00640 1 --2- 172.21.15.37:0/181932823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2b080b3c50 0x7f2b080b6110 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2b1401a6d0 tx=0x7f2b1401aef0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.881+0000 7f2b29a00640 1 -- 172.21.15.37:0/181932823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b241033e0 msgr2=0x7f2b24196d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.881+0000 7f2b29a00640 1 --2- 172.21.15.37:0/181932823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b241033e0 0x7f2b24196d50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009780 tx=0x7f2b10032d50 comp rx=0 tx=0).stop 2024-08-20T05:14:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.881+0000 7f2b29a00640 1 -- 172.21.15.37:0/181932823 shutdown_connections 2024-08-20T05:14:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.881+0000 7f2b29a00640 1 --2- 172.21.15.37:0/181932823 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2b080b3c50 0x7f2b080b6110 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.881+0000 7f2b29a00640 1 --2- 172.21.15.37:0/181932823 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2b24105f90 0x7f2b24197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.881+0000 7f2b29a00640 1 --2- 172.21.15.37:0/181932823 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2b241033e0 0x7f2b24196d50 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.881+0000 7f2b29a00640 1 --2- 172.21.15.37:0/181932823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b2406b170 0x7f2b24196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.881+0000 7f2b29a00640 1 -- 172.21.15.37:0/181932823 >> 172.21.15.37:0/181932823 conn(0x7f2b240fcc50 msgr2=0x7f2b240ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.882+0000 7f2b29a00640 1 -- 172.21.15.37:0/181932823 shutdown_connections 2024-08-20T05:14:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:14:49.882+0000 7f2b29a00640 1 -- 172.21.15.37:0/181932823 wait complete. 2024-08-20T05:14:49.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:49 smithi130 ceph-mon[22007]: pgmap v778: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 5.4 MiB/s wr, 554 op/s 2024-08-20T05:14:50.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:49 smithi037 ceph-mon[17265]: pgmap v778: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 5.4 MiB/s wr, 554 op/s 2024-08-20T05:14:51.769 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:51 smithi037 ceph-mon[17265]: pgmap v779: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 5.9 MiB/s wr, 575 op/s 2024-08-20T05:14:51.769 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:51 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:14:51.769 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:51 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:14:51.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:51 smithi135 ceph-mon[22342]: pgmap v779: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 5.9 MiB/s wr, 575 op/s 2024-08-20T05:14:51.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:51 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:14:51.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:51 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:14:51.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:51 smithi130 ceph-mon[22007]: pgmap v779: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 5.9 MiB/s wr, 575 op/s 2024-08-20T05:14:51.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:51 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:14:51.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:51 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:14:52.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:52 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:14:52.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:52 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:14:52.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:52 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:14:52.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:52 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:14:52.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:52 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:14:52.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:52 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:14:53.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:52 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:14:53.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:52 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:14:53.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:52 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:14:53.042 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 715.0 s, 497.3 tps, lat 203.889 ms stddev 236.665 2024-08-20T05:14:53.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:53 smithi135 ceph-mon[22342]: pgmap v780: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 5.3 MiB/s wr, 538 op/s 2024-08-20T05:14:53.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:53 smithi130 ceph-mon[22007]: pgmap v780: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 5.3 MiB/s wr, 538 op/s 2024-08-20T05:14:54.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:53 smithi037 ceph-mon[17265]: pgmap v780: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 5.3 MiB/s wr, 538 op/s 2024-08-20T05:14:55.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:55 smithi135 ceph-mon[22342]: pgmap v781: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 6.2 MiB/s wr, 589 op/s 2024-08-20T05:14:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:55 smithi130 ceph-mon[22007]: pgmap v781: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 6.2 MiB/s wr, 589 op/s 2024-08-20T05:14:56.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:55 smithi037 ceph-mon[17265]: pgmap v781: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 6.2 MiB/s wr, 589 op/s 2024-08-20T05:14:57.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:57 smithi135 ceph-mon[22342]: pgmap v782: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 5.8 MiB/s wr, 530 op/s 2024-08-20T05:14:57.897 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.3 2024-08-20T05:14:57.897 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:14:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:57 smithi130 ceph-mon[22007]: pgmap v782: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 5.8 MiB/s wr, 530 op/s 2024-08-20T05:14:58.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:57 smithi037 ceph-mon[17265]: pgmap v782: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 5.8 MiB/s wr, 530 op/s 2024-08-20T05:14:58.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 720.0 s, 498.5 tps, lat 194.438 ms stddev 237.007 2024-08-20T05:14:58.678 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:14:58.922 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:14:58 smithi037 ceph-mon[17265]: pgmap v783: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 5.1 MiB/s wr, 487 op/s 2024-08-20T05:14:58.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:14:58 smithi130 ceph-mon[22007]: pgmap v783: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 5.1 MiB/s wr, 487 op/s 2024-08-20T05:14:59.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:14:58 smithi135 ceph-mon[22342]: pgmap v783: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 5.1 MiB/s wr, 487 op/s 2024-08-20T05:14:59.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.554+0000 7f92aec00640 1 -- 172.21.15.37:0/1624210146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92a8075b90 msgr2=0x7f92a81132d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:59.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.554+0000 7f92aec00640 1 --2- 172.21.15.37:0/1624210146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92a8075b90 0x7f92a81132d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9294009900 tx=0x7f929402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:14:59.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.556+0000 7f92aec00640 1 -- 172.21.15.37:0/1624210146 shutdown_connections 2024-08-20T05:14:59.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.556+0000 7f92aec00640 1 --2- 172.21.15.37:0/1624210146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a8113810 0x7f92a8115c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:59.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.556+0000 7f92aec00640 1 --2- 172.21.15.37:0/1624210146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92a8075b90 0x7f92a81132d0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:59.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.556+0000 7f92aec00640 1 --2- 172.21.15.37:0/1624210146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92a8075270 0x7f92a8075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:59.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.556+0000 7f92aec00640 1 -- 172.21.15.37:0/1624210146 >> 172.21.15.37:0/1624210146 conn(0x7f92a80fe500 msgr2=0x7f92a8100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:14:59.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.556+0000 7f92aec00640 1 -- 172.21.15.37:0/1624210146 shutdown_connections 2024-08-20T05:14:59.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.558+0000 7f92aec00640 1 -- 172.21.15.37:0/1624210146 wait complete. 2024-08-20T05:14:59.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.559+0000 7f92aec00640 1 Processor -- start 2024-08-20T05:14:59.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.560+0000 7f92aec00640 1 -- start start 2024-08-20T05:14:59.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.562+0000 7f92aec00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92a8075270 0x7f92a81118c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:59.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.563+0000 7f92aec00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92a8075b90 0x7f92a8111e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:59.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.564+0000 7f92aec00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a8113810 0x7f92a810bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:59.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.564+0000 7f92a7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92a8075270 0x7f92a81118c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:59.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.564+0000 7f92a7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92a8075b90 0x7f92a8111e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:59.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.565+0000 7f92a7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92a8075b90 0x7f92a8111e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:35800/0 (socket says 172.21.15.37:35800) 2024-08-20T05:14:59.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.566+0000 7f92a7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92a8075270 0x7f92a81118c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36834/0 (socket says 172.21.15.37:36834) 2024-08-20T05:14:59.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.566+0000 7f92acc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a8113810 0x7f92a810bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:59.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.568+0000 7f92acc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a8113810 0x7f92a810bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35294/0 (socket says 172.21.15.37:35294) 2024-08-20T05:14:59.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.569+0000 7f92aec00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f92a81190e0 con 0x7f92a8113810 2024-08-20T05:14:59.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.569+0000 7f92aec00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f92a8118f60 con 0x7f92a8075b90 2024-08-20T05:14:59.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.569+0000 7f92aec00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f92a8119260 con 0x7f92a8075270 2024-08-20T05:14:59.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.569+0000 7f92a7400640 1 -- 172.21.15.37:0/3989815832 learned_addr learned my addr 172.21.15.37:0/3989815832 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:14:59.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.571+0000 7f92acc00640 1 -- 172.21.15.37:0/3989815832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92a8075270 msgr2=0x7f92a81118c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:59.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.571+0000 7f92acc00640 1 --2- 172.21.15.37:0/3989815832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92a8075270 0x7f92a81118c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:59.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.571+0000 7f92acc00640 1 -- 172.21.15.37:0/3989815832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92a8075b90 msgr2=0x7f92a8111e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:14:59.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.571+0000 7f92acc00640 1 --2- 172.21.15.37:0/3989815832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92a8075b90 0x7f92a8111e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:14:59.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.571+0000 7f92acc00640 1 -- 172.21.15.37:0/3989815832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a810c3a0 con 0x7f92a8113810 2024-08-20T05:14:59.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.574+0000 7f92acc00640 1 --2- 172.21.15.37:0/3989815832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a8113810 0x7f92a810bc00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f92a000ca80 tx=0x7f92a000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:59.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.575+0000 7f92a4c00640 1 -- 172.21.15.37:0/3989815832 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a000ae20 con 0x7f92a8113810 2024-08-20T05:14:59.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.575+0000 7f92a4c00640 1 -- 172.21.15.37:0/3989815832 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92a000f900 con 0x7f92a8113810 2024-08-20T05:14:59.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.575+0000 7f92aec00640 1 -- 172.21.15.37:0/3989815832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a810c690 con 0x7f92a8113810 2024-08-20T05:14:59.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.576+0000 7f92aec00640 1 -- 172.21.15.37:0/3989815832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a8110580 con 0x7f92a8113810 2024-08-20T05:14:59.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.578+0000 7f92a4c00640 1 -- 172.21.15.37:0/3989815832 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a0018a20 con 0x7f92a8113810 2024-08-20T05:14:59.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.579+0000 7f92aec00640 1 -- 172.21.15.37:0/3989815832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92880052c0 con 0x7f92a8113810 2024-08-20T05:14:59.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.584+0000 7f92a4c00640 1 -- 172.21.15.37:0/3989815832 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f92a000f450 con 0x7f92a8113810 2024-08-20T05:14:59.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.587+0000 7f92a4c00640 1 --2- 172.21.15.37:0/3989815832 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f928c0b3cd0 0x7f928c0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:14:59.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.587+0000 7f92a4c00640 1 -- 172.21.15.37:0/3989815832 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f92a00e4560 con 0x7f92a8113810 2024-08-20T05:14:59.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.587+0000 7f92a7e00640 1 --2- 172.21.15.37:0/3989815832 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f928c0b3cd0 0x7f928c0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:14:59.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.589+0000 7f92a7e00640 1 --2- 172.21.15.37:0/3989815832 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f928c0b3cd0 0x7f928c0b6190 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9298009b60 tx=0x7f9298005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:14:59.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:14:59.610+0000 7f92a4c00640 1 -- 172.21.15.37:0/3989815832 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f92a0014030 con 0x7f92a8113810 2024-08-20T05:15:00.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:00.056+0000 7f92aec00640 1 -- 172.21.15.37:0/3989815832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92880055b0 con 0x7f92a8113810 2024-08-20T05:15:00.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:00.058+0000 7f92a4c00640 1 -- 172.21.15.37:0/3989815832 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+11980 (secure 0 0 0) 0x7f92a00ab8c0 con 0x7f92a8113810 2024-08-20T05:15:00.064 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:15:00.064 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":48,"btime":"2024-08-20T05:13:44:512025+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":48,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:13:43.851787+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:15:00.064 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 48 2024-08-20T05:15:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:00.065+0000 7f92aec00640 1 -- 172.21.15.37:0/3989815832 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f928c0b3cd0 msgr2=0x7f928c0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:00.065+0000 7f92aec00640 1 --2- 172.21.15.37:0/3989815832 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f928c0b3cd0 0x7f928c0b6190 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9298009b60 tx=0x7f9298005f90 comp rx=0 tx=0).stop 2024-08-20T05:15:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:00.065+0000 7f92aec00640 1 -- 172.21.15.37:0/3989815832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a8113810 msgr2=0x7f92a810bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:00.065+0000 7f92aec00640 1 --2- 172.21.15.37:0/3989815832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a8113810 0x7f92a810bc00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f92a000ca80 tx=0x7f92a000cf40 comp rx=0 tx=0).stop 2024-08-20T05:15:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:00.065+0000 7f92aec00640 1 -- 172.21.15.37:0/3989815832 shutdown_connections 2024-08-20T05:15:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:00.065+0000 7f92aec00640 1 --2- 172.21.15.37:0/3989815832 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f928c0b3cd0 0x7f928c0b6190 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:00.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:00.065+0000 7f92aec00640 1 --2- 172.21.15.37:0/3989815832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a8113810 0x7f92a810bc00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:00.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:00.065+0000 7f92aec00640 1 --2- 172.21.15.37:0/3989815832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f92a8075b90 0x7f92a8111e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:00.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:00.065+0000 7f92aec00640 1 --2- 172.21.15.37:0/3989815832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f92a8075270 0x7f92a81118c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:00.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:00.065+0000 7f92aec00640 1 -- 172.21.15.37:0/3989815832 >> 172.21.15.37:0/3989815832 conn(0x7f92a80fe500 msgr2=0x7f92a81159c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:00.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:00.068+0000 7f92aec00640 1 -- 172.21.15.37:0/3989815832 shutdown_connections 2024-08-20T05:15:00.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:00.068+0000 7f92aec00640 1 -- 172.21.15.37:0/3989815832 wait complete. 2024-08-20T05:15:00.365 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:00 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3989815832' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:15:00.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:00 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3989815832' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:15:00.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:00 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3989815832' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:15:01.390 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:01 smithi037 ceph-mon[17265]: pgmap v784: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 5.3 MiB/s wr, 512 op/s 2024-08-20T05:15:01.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:01 smithi130 ceph-mon[22007]: pgmap v784: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 5.3 MiB/s wr, 512 op/s 2024-08-20T05:15:01.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:01 smithi135 ceph-mon[22342]: pgmap v784: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 5.3 MiB/s wr, 512 op/s 2024-08-20T05:15:02.892 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 137.3 --await-for 45.0' 2024-08-20T05:15:02.892 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 137.3 --await-for 45.0 2024-08-20T05:15:03.044 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 725.0 s, 487.0 tps, lat 205.076 ms stddev 261.363 2024-08-20T05:15:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.106+0000 7f601be00640 1 -- 172.21.15.37:0/219305571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f601c1046b0 msgr2=0x7f601c104ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:03.108 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.106+0000 7f601be00640 1 --2- 172.21.15.37:0/219305571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f601c1046b0 0x7f601c104ab0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f6008009900 tx=0x7f600802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.108+0000 7f601be00640 1 -- 172.21.15.37:0/219305571 shutdown_connections 2024-08-20T05:15:03.110 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.108+0000 7f601be00640 1 --2- 172.21.15.37:0/219305571 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f601c1061c0 0x7f601c10cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.108+0000 7f601be00640 1 --2- 172.21.15.37:0/219305571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f601c105800 0x7f601c105c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.108+0000 7f601be00640 1 --2- 172.21.15.37:0/219305571 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f601c1046b0 0x7f601c104ab0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.108+0000 7f601be00640 1 -- 172.21.15.37:0/219305571 >> 172.21.15.37:0/219305571 conn(0x7f601c0fff50 msgr2=0x7f601c102390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.110+0000 7f601be00640 1 -- 172.21.15.37:0/219305571 shutdown_connections 2024-08-20T05:15:03.111 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.110+0000 7f601be00640 1 -- 172.21.15.37:0/219305571 wait complete. 2024-08-20T05:15:03.112 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.111+0000 7f601be00640 1 Processor -- start 2024-08-20T05:15:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.114+0000 7f601be00640 1 -- start start 2024-08-20T05:15:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.114+0000 7f601be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f601c1046b0 0x7f601c19eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.114+0000 7f601be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f601c105800 0x7f601c19f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.116 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.114+0000 7f601be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f601c1061c0 0x7f601c1a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.114+0000 7f601be00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f601c1103d0 con 0x7f601c1061c0 2024-08-20T05:15:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.114+0000 7f601be00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f601c110250 con 0x7f601c105800 2024-08-20T05:15:03.117 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.114+0000 7f601be00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f601c110550 con 0x7f601c1046b0 2024-08-20T05:15:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.115+0000 7f601a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f601c105800 0x7f601c19f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.115+0000 7f601a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f601c105800 0x7f601c19f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:57532/0 (socket says 172.21.15.37:57532) 2024-08-20T05:15:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.115+0000 7f601a000640 1 -- 172.21.15.37:0/216871807 learned_addr learned my addr 172.21.15.37:0/216871807 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.115+0000 7f601aa00640 1 --2- 172.21.15.37:0/216871807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f601c1046b0 0x7f601c19eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.115+0000 7f601b400640 1 --2- 172.21.15.37:0/216871807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f601c1061c0 0x7f601c1a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.116+0000 7f601a000640 1 -- 172.21.15.37:0/216871807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f601c1046b0 msgr2=0x7f601c19eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.116+0000 7f601a000640 1 --2- 172.21.15.37:0/216871807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f601c1046b0 0x7f601c19eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.116+0000 7f601a000640 1 -- 172.21.15.37:0/216871807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f601c1061c0 msgr2=0x7f601c1a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.116+0000 7f601a000640 1 --2- 172.21.15.37:0/216871807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f601c1061c0 0x7f601c1a0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.116+0000 7f601a000640 1 -- 172.21.15.37:0/216871807 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601c1a09f0 con 0x7f601c105800 2024-08-20T05:15:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.116+0000 7f601aa00640 1 --2- 172.21.15.37:0/216871807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f601c1046b0 0x7f601c19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:15:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.116+0000 7f601a000640 1 --2- 172.21.15.37:0/216871807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f601c105800 0x7f601c19f500 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f600c00c890 tx=0x7f600c00cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.118+0000 7f6013400640 1 -- 172.21.15.37:0/216871807 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c004220 con 0x7f601c105800 2024-08-20T05:15:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.118+0000 7f6013400640 1 -- 172.21.15.37:0/216871807 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f600c0043c0 con 0x7f601c105800 2024-08-20T05:15:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.118+0000 7f6013400640 1 -- 172.21.15.37:0/216871807 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c004a00 con 0x7f601c105800 2024-08-20T05:15:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.118+0000 7f601be00640 1 -- 172.21.15.37:0/216871807 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f601c1a0ce0 con 0x7f601c105800 2024-08-20T05:15:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.118+0000 7f601be00640 1 -- 172.21.15.37:0/216871807 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f601c06ca80 con 0x7f601c105800 2024-08-20T05:15:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.127+0000 7f60247d8740 1 Processor -- start 2024-08-20T05:15:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.128+0000 7f6013400640 1 -- 172.21.15.37:0/216871807 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f600c0079b0 con 0x7f601c105800 2024-08-20T05:15:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.130+0000 7f60247d8740 1 -- start start 2024-08-20T05:15:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.130+0000 7f60247d8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655edf4b0 0x564655ee18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.130+0000 7f60247d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655ee1de0 0x564655ee41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.130+0000 7f60247d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655ee4820 0x564655ee6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.130+0000 7f60247d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564655e52210 con 0x564655ee4820 2024-08-20T05:15:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.130+0000 7f60247d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564655e41710 con 0x564655ee1de0 2024-08-20T05:15:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.130+0000 7f60247d8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564655e45750 con 0x564655edf4b0 2024-08-20T05:15:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.130+0000 7f601b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655edf4b0 0x564655ee18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.130+0000 7f601b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655edf4b0 0x564655ee18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57086/0 (socket says 172.21.15.37:57086) 2024-08-20T05:15:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.130+0000 7f601b400640 1 -- 172.21.15.37:0/2674419810 learned_addr learned my addr 172.21.15.37:0/2674419810 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.131+0000 7f6013400640 1 --2- 172.21.15.37:0/216871807 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f60000b3d20 0x7f60000b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.131+0000 7f601b400640 1 -- 172.21.15.37:0/2674419810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655ee1de0 msgr2=0x564655ee41d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:15:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.131+0000 7f601b400640 1 --2- 172.21.15.37:0/2674419810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655ee1de0 0x564655ee41d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.131+0000 7f601b400640 1 -- 172.21.15.37:0/2674419810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655ee4820 msgr2=0x564655ee6ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:15:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.131+0000 7f601b400640 1 --2- 172.21.15.37:0/2674419810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655ee4820 0x564655ee6ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.131+0000 7f601b400640 1 -- 172.21.15.37:0/2674419810 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564655e0dde0 con 0x564655edf4b0 2024-08-20T05:15:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.131+0000 7f6013400640 1 -- 172.21.15.37:0/216871807 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f600c0e3cc0 con 0x7f601c105800 2024-08-20T05:15:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.131+0000 7f601b400640 1 --2- 172.21.15.37:0/2674419810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655edf4b0 0x564655ee18a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6014007d60 tx=0x7f601400c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff98a97f00e0d406 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.133+0000 7f6007e00640 1 -- 172.21.15.37:0/2674419810 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014015020 con 0x564655edf4b0 2024-08-20T05:15:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.133+0000 7f601b400640 1 --2- 172.21.15.37:0/216871807 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f60000b3d20 0x7f60000b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.133+0000 7f6007e00640 1 -- 172.21.15.37:0/2674419810 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6014011ae0 con 0x564655edf4b0 2024-08-20T05:15:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.133+0000 7f6007e00640 1 -- 172.21.15.37:0/2674419810 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014010ac0 con 0x564655edf4b0 2024-08-20T05:15:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.135+0000 7f60247d8740 1 -- 172.21.15.37:0/2674419810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655edf4b0 msgr2=0x564655ee18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.135+0000 7f60247d8740 1 --2- 172.21.15.37:0/2674419810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655edf4b0 0x564655ee18a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f6014007d60 tx=0x7f601400c560 comp rx=0 tx=0).stop 2024-08-20T05:15:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.137+0000 7f60247d8740 1 -- 172.21.15.37:0/2674419810 shutdown_connections 2024-08-20T05:15:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.137+0000 7f60247d8740 1 --2- 172.21.15.37:0/2674419810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655ee4820 0x564655ee6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.137+0000 7f60247d8740 1 --2- 172.21.15.37:0/2674419810 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655ee1de0 0x564655ee41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.137+0000 7f60247d8740 1 --2- 172.21.15.37:0/2674419810 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655edf4b0 0x564655ee18a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.137+0000 7f60247d8740 1 -- 172.21.15.37:0/2674419810 >> 172.21.15.37:0/2674419810 conn(0x564655eda600 msgr2=0x564655edb390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.137+0000 7f60247d8740 1 -- 172.21.15.37:0/2674419810 shutdown_connections 2024-08-20T05:15:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.138+0000 7f601b400640 1 --2- 172.21.15.37:0/216871807 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f60000b3d20 0x7f60000b61e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6014016000 tx=0x7f6014010df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.138+0000 7f60247d8740 1 -- 172.21.15.37:0/2674419810 wait complete. 2024-08-20T05:15:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.139+0000 7f60247d8740 1 -- start start 2024-08-20T05:15:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.139+0000 7f60247d8740 1 Processor -- start 2024-08-20T05:15:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.141+0000 7f60247d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655edf4b0 0x564655ee8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.141+0000 7f60247d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655ee1de0 0x564655ee95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.141+0000 7f60247d8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655ee4820 0x564655eea1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.141+0000 7f60247d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564655d7aab0 con 0x564655edf4b0 2024-08-20T05:15:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.141+0000 7f60247d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564655de8140 con 0x564655ee1de0 2024-08-20T05:15:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.141+0000 7f60247d8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564655ee7800 con 0x564655ee4820 2024-08-20T05:15:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.141+0000 7f60247d8740 10 client.0 _ll_register_callbacks cb 0x564655dfb5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.142+0000 7f601b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655ee4820 0x564655eea1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.142+0000 7f601b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655ee4820 0x564655eea1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57090/0 (socket says 172.21.15.37:57090) 2024-08-20T05:15:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.142+0000 7f601b400640 1 -- 172.21.15.37:0/4194064732 learned_addr learned my addr 172.21.15.37:0/4194064732 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.142+0000 7f601aa00640 1 --2- 172.21.15.37:0/4194064732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655edf4b0 0x564655ee8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.142+0000 7f601b400640 1 -- 172.21.15.37:0/4194064732 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655ee1de0 msgr2=0x564655ee95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.142+0000 7f601b400640 1 --2- 172.21.15.37:0/4194064732 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655ee1de0 0x564655ee95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.142+0000 7f601b400640 1 -- 172.21.15.37:0/4194064732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655edf4b0 msgr2=0x564655ee8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.142+0000 7f601b400640 1 --2- 172.21.15.37:0/4194064732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655edf4b0 0x564655ee8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.142+0000 7f601b400640 1 -- 172.21.15.37:0/4194064732 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564655de9170 con 0x564655ee4820 2024-08-20T05:15:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.145+0000 7f601b400640 1 --2- 172.21.15.37:0/4194064732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655ee4820 0x564655eea1c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6014007d30 tx=0x7f6014010d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5eb1599da0212967 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.146+0000 7f6004c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:15:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.146+0000 7f6004c00640 1 -- 172.21.15.37:0/4194064732 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014015040 con 0x564655ee4820 2024-08-20T05:15:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.147+0000 7f6004c00640 1 -- 172.21.15.37:0/4194064732 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f601401b050 con 0x564655ee4820 2024-08-20T05:15:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.147+0000 7f60247d8740 1 -- 172.21.15.37:0/4194064732 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564655e18a30 con 0x564655ee4820 2024-08-20T05:15:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.147+0000 7f6004c00640 1 -- 172.21.15.37:0/4194064732 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f6014010390 con 0x564655ee4820 2024-08-20T05:15:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.148+0000 7f60247d8740 10 client.28567 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.148+0000 7f60247d8740 1 -- 172.21.15.37:0/4194064732 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x564655ba4790 con 0x564655ee4820 2024-08-20T05:15:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.149+0000 7f6004c00640 1 -- 172.21.15.37:0/4194064732 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564655e18a30 con 0x564655ee4820 2024-08-20T05:15:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.149+0000 7f6004c00640 1 -- 172.21.15.37:0/4194064732 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f6014011430 con 0x564655ee4820 2024-08-20T05:15:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.149+0000 7f60247d8740 10 client.28567 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.149+0000 7f60247d8740 10 client.28567 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.149+0000 7f60247d8740 20 client.28567 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:03.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.149+0000 7f60247d8740 1 --2- 172.21.15.37:0/4194064732 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564655ef4a00 0x564655ef6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.149+0000 7f60247d8740 4 client.28567 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:15:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.149+0000 7f60247d8740 1 -- 172.21.15.37:0/4194064732 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564655e54160 con 0x564655ef4a00 2024-08-20T05:15:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.150+0000 7f601aa00640 1 --2- 172.21.15.37:0/4194064732 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564655ef4a00 0x564655ef6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:03.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.151+0000 7f6004c00640 10 client.28567 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.151+0000 7f601aa00640 1 --2- 172.21.15.37:0/4194064732 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564655ef4a00 0x564655ef6df0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=435b8a9e5066375c server_cookie=21402b8572d34f8 in_seq=0 out_seq=0 2024-08-20T05:15:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.155+0000 7f6004c00640 1 -- 172.21.15.37:0/4194064732 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564655e54160 con 0x564655ef4a00 2024-08-20T05:15:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.156+0000 7f6004c00640 10 client.28567 handle_command_reply: tid=0 2024-08-20T05:15:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.156+0000 7f60247d8740 1 client.28567 shutdown 2024-08-20T05:15:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.157+0000 7f60247d8740 1 -- 172.21.15.37:0/4194064732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655ee4820 msgr2=0x564655eea1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.157+0000 7f60247d8740 1 --2- 172.21.15.37:0/4194064732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655ee4820 0x564655eea1c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f6014007d30 tx=0x7f6014010d20 comp rx=0 tx=0).stop 2024-08-20T05:15:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.157+0000 7f60247d8740 1 -- 172.21.15.37:0/4194064732 shutdown_connections 2024-08-20T05:15:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.157+0000 7f60247d8740 1 --2- 172.21.15.37:0/4194064732 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564655ef4a00 0x564655ef6df0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.157+0000 7f60247d8740 1 --2- 172.21.15.37:0/4194064732 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655ee4820 0x564655eea1c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.157+0000 7f60247d8740 1 --2- 172.21.15.37:0/4194064732 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655ee1de0 0x564655ee95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.157+0000 7f60247d8740 1 --2- 172.21.15.37:0/4194064732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655edf4b0 0x564655ee8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.158+0000 7f60247d8740 1 -- 172.21.15.37:0/4194064732 >> 172.21.15.37:0/4194064732 conn(0x564655eda600 msgr2=0x564655ed9590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.158+0000 7f6004c00640 0 client.28567 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.158+0000 7f60247d8740 1 -- 172.21.15.37:0/4194064732 shutdown_connections 2024-08-20T05:15:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.158+0000 7f60247d8740 1 -- 172.21.15.37:0/4194064732 wait complete. 2024-08-20T05:15:03.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.159+0000 7f60247d8740 20 client.28567 trim_cache size 0 max 16384 2024-08-20T05:15:03.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.196+0000 7f60247d8740 1 Processor -- start 2024-08-20T05:15:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.196+0000 7f60247d8740 1 -- start start 2024-08-20T05:15:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.196+0000 7f60247d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655eda600 0x564655eea1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.196+0000 7f60247d8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655edf4b0 0x564655ef0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.196+0000 7f60247d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655ee1de0 0x564655ee6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.196+0000 7f60247d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f601c1ba000 con 0x564655eda600 2024-08-20T05:15:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.196+0000 7f60247d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f601c1bbb40 con 0x564655ee1de0 2024-08-20T05:15:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.196+0000 7f60247d8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f601c1ba6d0 con 0x564655edf4b0 2024-08-20T05:15:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.197+0000 7f601a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655edf4b0 0x564655ef0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.197+0000 7f601a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655edf4b0 0x564655ef0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57102/0 (socket says 172.21.15.37:57102) 2024-08-20T05:15:03.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.197+0000 7f601a000640 1 -- 172.21.15.37:0/141904045 learned_addr learned my addr 172.21.15.37:0/141904045 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.197+0000 7f601b400640 1 --2- 172.21.15.37:0/141904045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655ee1de0 0x564655ee6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:03.200 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.197+0000 7f601aa00640 1 --2- 172.21.15.37:0/141904045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655eda600 0x564655eea1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.197+0000 7f601a000640 1 -- 172.21.15.37:0/141904045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655ee1de0 msgr2=0x564655ee6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.197+0000 7f601a000640 1 --2- 172.21.15.37:0/141904045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655ee1de0 0x564655ee6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.197+0000 7f601a000640 1 -- 172.21.15.37:0/141904045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655eda600 msgr2=0x564655eea1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.197+0000 7f601a000640 1 --2- 172.21.15.37:0/141904045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655eda600 0x564655eea1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.197+0000 7f601a000640 1 -- 172.21.15.37:0/141904045 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564655c1d620 con 0x564655edf4b0 2024-08-20T05:15:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.197+0000 7f601b400640 1 --2- 172.21.15.37:0/141904045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655ee1de0 0x564655ee6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:15:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.198+0000 7f601aa00640 1 --2- 172.21.15.37:0/141904045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655eda600 0x564655eea1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.198+0000 7f601a000640 1 --2- 172.21.15.37:0/141904045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655edf4b0 0x564655ef0e80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f600c0a7ae0 tx=0x7f600c005290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed65eddfc833e6c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.198+0000 7f6007400640 1 -- 172.21.15.37:0/141904045 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c01d030 con 0x564655edf4b0 2024-08-20T05:15:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.198+0000 7f6007400640 1 -- 172.21.15.37:0/141904045 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f600c0aa380 con 0x564655edf4b0 2024-08-20T05:15:03.201 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.198+0000 7f6007400640 1 -- 172.21.15.37:0/141904045 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c0a6b00 con 0x564655edf4b0 2024-08-20T05:15:03.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.199+0000 7f60247d8740 1 -- 172.21.15.37:0/141904045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655edf4b0 msgr2=0x564655ef0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:03.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.199+0000 7f60247d8740 1 --2- 172.21.15.37:0/141904045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655edf4b0 0x564655ef0e80 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f600c0a7ae0 tx=0x7f600c005290 comp rx=0 tx=0).stop 2024-08-20T05:15:03.202 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.199+0000 7f60247d8740 1 -- 172.21.15.37:0/141904045 shutdown_connections 2024-08-20T05:15:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.199+0000 7f60247d8740 1 --2- 172.21.15.37:0/141904045 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655ee1de0 0x564655ee6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.199+0000 7f60247d8740 1 --2- 172.21.15.37:0/141904045 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655edf4b0 0x564655ef0e80 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.199+0000 7f60247d8740 1 --2- 172.21.15.37:0/141904045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655eda600 0x564655eea1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.199+0000 7f60247d8740 1 -- 172.21.15.37:0/141904045 >> 172.21.15.37:0/141904045 conn(0x564655edf060 msgr2=0x564655ee8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.200+0000 7f60247d8740 1 -- 172.21.15.37:0/141904045 shutdown_connections 2024-08-20T05:15:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.200+0000 7f60247d8740 1 -- 172.21.15.37:0/141904045 wait complete. 2024-08-20T05:15:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.200+0000 7f60247d8740 1 -- start start 2024-08-20T05:15:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.200+0000 7f60247d8740 1 Processor -- start 2024-08-20T05:15:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.201+0000 7f60247d8740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655eda600 0x564655eeda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.201+0000 7f60247d8740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655edf4b0 0x564655eee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.201+0000 7f60247d8740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655ee1de0 0x564655eeecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.201+0000 7f60247d8740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f601c1bb470 con 0x564655edf4b0 2024-08-20T05:15:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.201+0000 7f60247d8740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f601c1bada0 con 0x564655eda600 2024-08-20T05:15:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.201+0000 7f60247d8740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f601c1a0f90 con 0x564655ee1de0 2024-08-20T05:15:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.201+0000 7f60247d8740 10 client.0 _ll_register_callbacks cb 0x7f6014007bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.201+0000 7f601aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655eda600 0x564655eeda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.201+0000 7f601b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655ee1de0 0x564655eeecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.201+0000 7f601aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655eda600 0x564655eeda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:57562/0 (socket says 172.21.15.37:57562) 2024-08-20T05:15:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.201+0000 7f601b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655ee1de0 0x564655eeecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57116/0 (socket says 172.21.15.37:57116) 2024-08-20T05:15:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.201+0000 7f601aa00640 1 -- 172.21.15.37:0/2286058593 learned_addr learned my addr 172.21.15.37:0/2286058593 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.202+0000 7f601b400640 1 -- 172.21.15.37:0/2286058593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655eda600 msgr2=0x564655eeda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.202+0000 7f601b400640 1 --2- 172.21.15.37:0/2286058593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655eda600 0x564655eeda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.202+0000 7f601b400640 1 -- 172.21.15.37:0/2286058593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655edf4b0 msgr2=0x564655eee0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.202+0000 7f601b400640 1 --2- 172.21.15.37:0/2286058593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655edf4b0 0x564655eee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.202+0000 7f601b400640 1 -- 172.21.15.37:0/2286058593 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564655eef4f0 con 0x564655ee1de0 2024-08-20T05:15:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.202+0000 7f601b400640 1 --2- 172.21.15.37:0/2286058593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655ee1de0 0x564655eeecc0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f601400c5a0 tx=0x7f60140071f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be94d2a83ed3eee3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.202+0000 7f6004c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:15:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.202+0000 7f6004c00640 1 -- 172.21.15.37:0/2286058593 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014015040 con 0x564655ee1de0 2024-08-20T05:15:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.202+0000 7f6004c00640 1 -- 172.21.15.37:0/2286058593 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f6014011430 con 0x564655ee1de0 2024-08-20T05:15:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.202+0000 7f60247d8740 1 -- 172.21.15.37:0/2286058593 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f600c0aa380 con 0x564655ee1de0 2024-08-20T05:15:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.203+0000 7f6004c00640 1 -- 172.21.15.37:0/2286058593 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f6014011630 con 0x564655ee1de0 2024-08-20T05:15:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.203+0000 7f60247d8740 10 client.28573 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.203+0000 7f60247d8740 1 -- 172.21.15.37:0/2286058593 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x564655ef08a0 con 0x564655ee1de0 2024-08-20T05:15:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.203+0000 7f6004c00640 1 -- 172.21.15.37:0/2286058593 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f600c0aa380 con 0x564655ee1de0 2024-08-20T05:15:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.203+0000 7f6004c00640 1 -- 172.21.15.37:0/2286058593 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f601401b020 con 0x564655ee1de0 2024-08-20T05:15:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.203+0000 7f60247d8740 10 client.28573 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.203+0000 7f60247d8740 10 client.28573 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.203+0000 7f60247d8740 20 client.28573 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.203+0000 7f60247d8740 1 --2- 172.21.15.37:0/2286058593 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564655ee4820 0x564655f616a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.203+0000 7f60247d8740 4 client.28573 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:15:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.203+0000 7f60247d8740 1 -- 172.21.15.37:0/2286058593 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564655e4fc00 con 0x564655ee4820 2024-08-20T05:15:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.204+0000 7f601aa00640 1 --2- 172.21.15.37:0/2286058593 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564655ee4820 0x564655f616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.204+0000 7f601aa00640 1 --2- 172.21.15.37:0/2286058593 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564655ee4820 0x564655f616a0 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62102ebba0992188 server_cookie=183fc1d822a02c9c in_seq=0 out_seq=0 2024-08-20T05:15:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.205+0000 7f6004c00640 10 client.28573 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:03.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.215+0000 7f6004c00640 1 -- 172.21.15.37:0/2286058593 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564655e4fc00 con 0x564655ee4820 2024-08-20T05:15:03.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.215+0000 7f6004c00640 10 client.28573 handle_command_reply: tid=0 2024-08-20T05:15:03.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.215+0000 7f60247d8740 1 client.28573 shutdown 2024-08-20T05:15:03.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.216+0000 7f60247d8740 1 -- 172.21.15.37:0/2286058593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655ee1de0 msgr2=0x564655eeecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:03.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.216+0000 7f60247d8740 1 --2- 172.21.15.37:0/2286058593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655ee1de0 0x564655eeecc0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f601400c5a0 tx=0x7f60140071f0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.216+0000 7f60247d8740 1 -- 172.21.15.37:0/2286058593 shutdown_connections 2024-08-20T05:15:03.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.216+0000 7f60247d8740 1 --2- 172.21.15.37:0/2286058593 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564655ee4820 0x564655f616a0 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.216+0000 7f60247d8740 1 --2- 172.21.15.37:0/2286058593 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564655ee1de0 0x564655eeecc0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.216+0000 7f60247d8740 1 --2- 172.21.15.37:0/2286058593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564655edf4b0 0x564655eee0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.216+0000 7f60247d8740 1 --2- 172.21.15.37:0/2286058593 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564655eda600 0x564655eeda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.216+0000 7f60247d8740 1 -- 172.21.15.37:0/2286058593 >> 172.21.15.37:0/2286058593 conn(0x564655edf060 msgr2=0x564655ee6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:03.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.216+0000 7f6004c00640 0 client.28573 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:03.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.217+0000 7f60247d8740 1 -- 172.21.15.37:0/2286058593 shutdown_connections 2024-08-20T05:15:03.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.217+0000 7f60247d8740 1 -- 172.21.15.37:0/2286058593 wait complete. 2024-08-20T05:15:03.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.217+0000 7f60247d8740 20 client.28573 trim_cache size 0 max 16384 2024-08-20T05:15:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:15:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:15:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:15:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:15:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.221+0000 7f601be00640 1 -- 172.21.15.37:0/216871807 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f60000b3d20 msgr2=0x7f60000b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.221+0000 7f601be00640 1 --2- 172.21.15.37:0/216871807 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f60000b3d20 0x7f60000b61e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6014016000 tx=0x7f6014010df0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.221+0000 7f601be00640 1 -- 172.21.15.37:0/216871807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f601c105800 msgr2=0x7f601c19f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.221+0000 7f601be00640 1 --2- 172.21.15.37:0/216871807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f601c105800 0x7f601c19f500 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f600c00c890 tx=0x7f600c00cd50 comp rx=0 tx=0).stop 2024-08-20T05:15:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.221+0000 7f601be00640 1 -- 172.21.15.37:0/216871807 shutdown_connections 2024-08-20T05:15:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.222+0000 7f601be00640 1 --2- 172.21.15.37:0/216871807 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f60000b3d20 0x7f60000b61e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.222+0000 7f601be00640 1 --2- 172.21.15.37:0/216871807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f601c1061c0 0x7f601c1a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.222+0000 7f601be00640 1 --2- 172.21.15.37:0/216871807 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f601c105800 0x7f601c19f500 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.222+0000 7f601be00640 1 --2- 172.21.15.37:0/216871807 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f601c1046b0 0x7f601c19eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.222+0000 7f601be00640 1 -- 172.21.15.37:0/216871807 >> 172.21.15.37:0/216871807 conn(0x7f601c0fff50 msgr2=0x7f601c079340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.224+0000 7f601be00640 1 -- 172.21.15.37:0/216871807 shutdown_connections 2024-08-20T05:15:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:03.224+0000 7f601be00640 1 -- 172.21.15.37:0/216871807 wait complete. 2024-08-20T05:15:03.619 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:15:03.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:03 smithi037 ceph-mon[17265]: pgmap v785: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 5.9 MiB/s wr, 545 op/s 2024-08-20T05:15:03.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:03 smithi135 ceph-mon[22342]: pgmap v785: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 5.9 MiB/s wr, 545 op/s 2024-08-20T05:15:03.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:03 smithi130 ceph-mon[22007]: pgmap v785: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 5.9 MiB/s wr, 545 op/s 2024-08-20T05:15:05.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:05 smithi037 ceph-mon[17265]: pgmap v786: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 6.1 MiB/s wr, 560 op/s 2024-08-20T05:15:05.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:05 smithi135 ceph-mon[22342]: pgmap v786: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 6.1 MiB/s wr, 560 op/s 2024-08-20T05:15:05.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:05 smithi130 ceph-mon[22007]: pgmap v786: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 6.1 MiB/s wr, 560 op/s 2024-08-20T05:15:06.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.533+0000 7f52bf600640 1 -- 172.21.15.37:0/3044852192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52b810b030 msgr2=0x7f52b8111830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:06.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.533+0000 7f52bf600640 1 --2- 172.21.15.37:0/3044852192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52b810b030 0x7f52b8111830 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f52b0009ca0 tx=0x7f52b002a8c0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.533+0000 7f52bf600640 1 -- 172.21.15.37:0/3044852192 shutdown_connections 2024-08-20T05:15:06.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.533+0000 7f52bf600640 1 --2- 172.21.15.37:0/3044852192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52b810b030 0x7f52b8111830 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.533+0000 7f52bf600640 1 --2- 172.21.15.37:0/3044852192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52b810a6b0 0x7f52b810aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.533+0000 7f52bf600640 1 --2- 172.21.15.37:0/3044852192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b8104ca0 0x7f52b8105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.534+0000 7f52bf600640 1 -- 172.21.15.37:0/3044852192 >> 172.21.15.37:0/3044852192 conn(0x7f52b8100750 msgr2=0x7f52b8102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:06.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.534+0000 7f52bf600640 1 -- 172.21.15.37:0/3044852192 shutdown_connections 2024-08-20T05:15:06.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.534+0000 7f52bf600640 1 -- 172.21.15.37:0/3044852192 wait complete. 2024-08-20T05:15:06.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.536+0000 7f52bf600640 1 Processor -- start 2024-08-20T05:15:06.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.536+0000 7f52bf600640 1 -- start start 2024-08-20T05:15:06.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.536+0000 7f52bf600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b8104ca0 0x7f52b81114a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.537+0000 7f52bf600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52b810a6b0 0x7f52b810e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.537+0000 7f52bf600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52b810b030 0x7f52b810ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.537+0000 7f52bf600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f52b8114d40 con 0x7f52b8104ca0 2024-08-20T05:15:06.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.537+0000 7f52bf600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f52b8114bc0 con 0x7f52b810a6b0 2024-08-20T05:15:06.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.537+0000 7f52bf600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f52b8114ec0 con 0x7f52b810b030 2024-08-20T05:15:06.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.537+0000 7f52bcc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b8104ca0 0x7f52b81114a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.537+0000 7f52bd600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52b810b030 0x7f52b810ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.537+0000 7f52bd600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52b810b030 0x7f52b810ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57130/0 (socket says 172.21.15.37:57130) 2024-08-20T05:15:06.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.537+0000 7f52bd600640 1 -- 172.21.15.37:0/131431432 learned_addr learned my addr 172.21.15.37:0/131431432 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:06.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.538+0000 7f52bd600640 1 -- 172.21.15.37:0/131431432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52b810a6b0 msgr2=0x7f52b810e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:06.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.538+0000 7f52b7e00640 1 --2- 172.21.15.37:0/131431432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52b810a6b0 0x7f52b810e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.538+0000 7f52bd600640 1 --2- 172.21.15.37:0/131431432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52b810a6b0 0x7f52b810e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.538+0000 7f52bd600640 1 -- 172.21.15.37:0/131431432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b8104ca0 msgr2=0x7f52b81114a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:06.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.538+0000 7f52bd600640 1 --2- 172.21.15.37:0/131431432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b8104ca0 0x7f52b81114a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.538+0000 7f52bd600640 1 -- 172.21.15.37:0/131431432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b810f400 con 0x7f52b810b030 2024-08-20T05:15:06.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.538+0000 7f52bcc00640 1 --2- 172.21.15.37:0/131431432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b8104ca0 0x7f52b81114a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:15:06.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.538+0000 7f52b7e00640 1 --2- 172.21.15.37:0/131431432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52b810a6b0 0x7f52b810e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:06.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.538+0000 7f52bd600640 1 --2- 172.21.15.37:0/131431432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52b810b030 0x7f52b810ec30 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f52b0009430 tx=0x7f52b00317c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:06.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.539+0000 7f52b5600640 1 -- 172.21.15.37:0/131431432 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b0003b70 con 0x7f52b810b030 2024-08-20T05:15:06.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.539+0000 7f52b5600640 1 -- 172.21.15.37:0/131431432 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52b0003d10 con 0x7f52b810b030 2024-08-20T05:15:06.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.539+0000 7f52b5600640 1 -- 172.21.15.37:0/131431432 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b002fa30 con 0x7f52b810b030 2024-08-20T05:15:06.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.539+0000 7f52bf600640 1 -- 172.21.15.37:0/131431432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b81aba20 con 0x7f52b810b030 2024-08-20T05:15:06.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.539+0000 7f52bf600640 1 -- 172.21.15.37:0/131431432 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b81abeb0 con 0x7f52b810b030 2024-08-20T05:15:06.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.543+0000 7f52c2225740 1 Processor -- start 2024-08-20T05:15:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.543+0000 7f52b5600640 1 -- 172.21.15.37:0/131431432 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f52b002fbd0 con 0x7f52b810b030 2024-08-20T05:15:06.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.544+0000 7f52c2225740 1 -- start start 2024-08-20T05:15:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.544+0000 7f52c2225740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 0x55b51170b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.544+0000 7f52c2225740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b51170bd10 0x55b511717760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.544+0000 7f52c2225740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b511717ca0 0x55b51171a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.544+0000 7f52c2225740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b5116ab670 con 0x55b51170bd10 2024-08-20T05:15:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.544+0000 7f52c2225740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b51167f7c0 con 0x55b511717ca0 2024-08-20T05:15:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.544+0000 7f52c2225740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b51166ecc0 con 0x55b51170b3f0 2024-08-20T05:15:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.545+0000 7f52b7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 0x55b51170b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.545+0000 7f52b7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 0x55b51170b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57134/0 (socket says 172.21.15.37:57134) 2024-08-20T05:15:06.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.545+0000 7f52b7e00640 1 -- 172.21.15.37:0/238583187 learned_addr learned my addr 172.21.15.37:0/238583187 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:06.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.545+0000 7f52b7e00640 1 --2- 172.21.15.37:0/238583187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b511717ca0 0x55b51171a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.545+0000 7f52bcc00640 1 --2- 172.21.15.37:0/238583187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b51170bd10 0x55b511717760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.546+0000 7f52b5600640 1 --2- 172.21.15.37:0/131431432 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f529c0b3d20 0x7f529c0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.546+0000 7f52bcc00640 1 -- 172.21.15.37:0/238583187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 msgr2=0x55b51170b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.546+0000 7f52bcc00640 1 --2- 172.21.15.37:0/238583187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 0x55b51170b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.546+0000 7f52bcc00640 1 -- 172.21.15.37:0/238583187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b511717ca0 msgr2=0x55b51171a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.546+0000 7f52bcc00640 1 --2- 172.21.15.37:0/238583187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b511717ca0 0x55b51171a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.546+0000 7f52bcc00640 1 -- 172.21.15.37:0/238583187 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b511602110 con 0x55b51170bd10 2024-08-20T05:15:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.546+0000 7f52b5600640 1 -- 172.21.15.37:0/131431432 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f52b0105310 con 0x7f52b810b030 2024-08-20T05:15:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.546+0000 7f52bcc00640 1 --2- 172.21.15.37:0/238583187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b51170bd10 0x55b511717760 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009fd0 tx=0x7f52a80118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1ff55ce5cd3c10 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.547+0000 7f52bd600640 1 --2- 172.21.15.37:0/131431432 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f529c0b3d20 0x7f529c0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.547+0000 7f52adc00640 1 -- 172.21.15.37:0/238583187 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a801e070 con 0x55b51170bd10 2024-08-20T05:15:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.547+0000 7f52adc00640 1 -- 172.21.15.37:0/238583187 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52a80035f0 con 0x55b51170bd10 2024-08-20T05:15:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.547+0000 7f52adc00640 1 -- 172.21.15.37:0/238583187 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a80044e0 con 0x55b51170bd10 2024-08-20T05:15:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.548+0000 7f52c2225740 1 -- 172.21.15.37:0/238583187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b51170bd10 msgr2=0x55b511717760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.548+0000 7f52bd600640 1 --2- 172.21.15.37:0/131431432 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f529c0b3d20 0x7f529c0b61e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f52b002ae80 tx=0x7f52b002a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.548+0000 7f52c2225740 1 --2- 172.21.15.37:0/238583187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b51170bd10 0x55b511717760 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009fd0 tx=0x7f52a80118d0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.548+0000 7f52c2225740 1 -- 172.21.15.37:0/238583187 shutdown_connections 2024-08-20T05:15:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.548+0000 7f52c2225740 1 --2- 172.21.15.37:0/238583187 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b511717ca0 0x55b51171a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.548+0000 7f52c2225740 1 --2- 172.21.15.37:0/238583187 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b51170bd10 0x55b511717760 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.548+0000 7f52c2225740 1 --2- 172.21.15.37:0/238583187 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 0x55b51170b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.548+0000 7f52c2225740 1 -- 172.21.15.37:0/238583187 >> 172.21.15.37:0/238583187 conn(0x55b511709220 msgr2=0x55b51170a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:06.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.548+0000 7f52c2225740 1 -- 172.21.15.37:0/238583187 shutdown_connections 2024-08-20T05:15:06.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.548+0000 7f52c2225740 1 -- 172.21.15.37:0/238583187 wait complete. 2024-08-20T05:15:06.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.549+0000 7f52c2225740 1 -- start start 2024-08-20T05:15:06.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.549+0000 7f52c2225740 1 Processor -- start 2024-08-20T05:15:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.550+0000 7f52c2225740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b51170b3f0 0x55b511714c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.550+0000 7f52c2225740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170bd10 0x55b5117151d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.550+0000 7f52c2225740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b511717ca0 0x55b511715710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.550+0000 7f52c2225740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b511614780 con 0x55b51170b3f0 2024-08-20T05:15:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.550+0000 7f52c2225740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b511672d00 con 0x55b511717ca0 2024-08-20T05:15:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.550+0000 7f52c2225740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b5114d17a0 con 0x55b51170bd10 2024-08-20T05:15:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.550+0000 7f52c2225740 10 client.0 _ll_register_callbacks cb 0x55b51161c940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.550+0000 7f52bcc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170bd10 0x55b5117151d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.550+0000 7f52bcc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170bd10 0x55b5117151d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57138/0 (socket says 172.21.15.37:57138) 2024-08-20T05:15:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.550+0000 7f52bcc00640 1 -- 172.21.15.37:0/3231977669 learned_addr learned my addr 172.21.15.37:0/3231977669 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.551+0000 7f52b7e00640 1 --2- 172.21.15.37:0/3231977669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b511717ca0 0x55b511715710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.551+0000 7f52b7e00640 1 --2- 172.21.15.37:0/3231977669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b51170b3f0 0x55b511714c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.551+0000 7f52b7e00640 1 -- 172.21.15.37:0/3231977669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170bd10 msgr2=0x55b5117151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.551+0000 7f52b7e00640 1 --2- 172.21.15.37:0/3231977669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170bd10 0x55b5117151d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.551+0000 7f52b7e00640 1 -- 172.21.15.37:0/3231977669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b51170b3f0 msgr2=0x55b511714c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:06.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.551+0000 7f52b7e00640 1 --2- 172.21.15.37:0/3231977669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b51170b3f0 0x55b511714c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.551+0000 7f52b7e00640 1 -- 172.21.15.37:0/3231977669 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5116219c0 con 0x55b511717ca0 2024-08-20T05:15:06.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.552+0000 7f52b7e00640 1 --2- 172.21.15.37:0/3231977669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b511717ca0 0x55b511715710 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f52a400be00 tx=0x7f52a40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4569a90da20e1433 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:06.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.552+0000 7f52a2000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:15:06.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.553+0000 7f52a2000640 1 -- 172.21.15.37:0/3231977669 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a400ec60 con 0x55b511717ca0 2024-08-20T05:15:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.553+0000 7f52a2000640 1 -- 172.21.15.37:0/3231977669 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f52a400ee00 con 0x55b511717ca0 2024-08-20T05:15:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.553+0000 7f52c2225740 1 -- 172.21.15.37:0/3231977669 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52a80035f0 con 0x55b511717ca0 2024-08-20T05:15:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.553+0000 7f52a2000640 1 -- 172.21.15.37:0/3231977669 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f52a4004020 con 0x55b511717ca0 2024-08-20T05:15:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.553+0000 7f52c2225740 10 client.28538 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.553+0000 7f52c2225740 1 -- 172.21.15.37:0/3231977669 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55b5113ddb90 con 0x55b511717ca0 2024-08-20T05:15:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.554+0000 7f52a2000640 1 -- 172.21.15.37:0/3231977669 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52a80035f0 con 0x55b511717ca0 2024-08-20T05:15:06.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.554+0000 7f52a2000640 1 -- 172.21.15.37:0/3231977669 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f52a401c030 con 0x55b511717ca0 2024-08-20T05:15:06.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.554+0000 7f52c2225740 10 client.28538 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:06.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.554+0000 7f52c2225740 10 client.28538 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:15:06.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.554+0000 7f52c2225740 20 client.28538 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:06.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.554+0000 7f52c2225740 1 --2- 172.21.15.37:0/3231977669 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b511738b60 0x55b51173afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.554+0000 7f52c2225740 4 client.28538 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:15:06.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.554+0000 7f52c2225740 1 -- 172.21.15.37:0/3231977669 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b511681710 con 0x55b511738b60 2024-08-20T05:15:06.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.555+0000 7f52bcc00640 1 --2- 172.21.15.37:0/3231977669 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b511738b60 0x55b51173afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.555+0000 7f52bcc00640 1 --2- 172.21.15.37:0/3231977669 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b511738b60 0x55b51173afe0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82ac370465f144bc server_cookie=a8baba34d3456af0 in_seq=0 out_seq=0 2024-08-20T05:15:06.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.555+0000 7f52a2000640 10 client.28538 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.556+0000 7f52a2000640 1 -- 172.21.15.37:0/3231977669 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b511681710 con 0x55b511738b60 2024-08-20T05:15:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.556+0000 7f52a2000640 10 client.28538 handle_command_reply: tid=0 2024-08-20T05:15:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.556+0000 7f52c2225740 1 client.28538 shutdown 2024-08-20T05:15:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.556+0000 7f52c2225740 1 -- 172.21.15.37:0/3231977669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b511717ca0 msgr2=0x55b511715710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.556+0000 7f52c2225740 1 --2- 172.21.15.37:0/3231977669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b511717ca0 0x55b511715710 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f52a400be00 tx=0x7f52a40046c0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.556+0000 7f52c2225740 1 -- 172.21.15.37:0/3231977669 shutdown_connections 2024-08-20T05:15:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.556+0000 7f52c2225740 1 --2- 172.21.15.37:0/3231977669 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b511738b60 0x55b51173afe0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.556+0000 7f52a2000640 0 client.28538 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:06.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.556+0000 7f52c2225740 1 --2- 172.21.15.37:0/3231977669 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b511717ca0 0x55b511715710 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.556+0000 7f52c2225740 1 --2- 172.21.15.37:0/3231977669 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170bd10 0x55b5117151d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.556+0000 7f52c2225740 1 --2- 172.21.15.37:0/3231977669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b51170b3f0 0x55b511714c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.556+0000 7f52c2225740 1 -- 172.21.15.37:0/3231977669 >> 172.21.15.37:0/3231977669 conn(0x55b511709220 msgr2=0x55b51170edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:06.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.557+0000 7f52c2225740 1 -- 172.21.15.37:0/3231977669 shutdown_connections 2024-08-20T05:15:06.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.557+0000 7f52c2225740 1 -- 172.21.15.37:0/3231977669 wait complete. 2024-08-20T05:15:06.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.557+0000 7f52c2225740 20 client.28538 trim_cache size 0 max 16384 2024-08-20T05:15:06.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.587+0000 7f52c2225740 1 Processor -- start 2024-08-20T05:15:06.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.587+0000 7f52c2225740 1 -- start start 2024-08-20T05:15:06.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.587+0000 7f52c2225740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 0x55b51170f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.587+0000 7f52c2225740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b51170bd10 0x55b5117408b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.587+0000 7f52c2225740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b511717ca0 0x55b511740df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.587+0000 7f52c2225740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f52b81af760 con 0x55b511717ca0 2024-08-20T05:15:06.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.587+0000 7f52c2225740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f52b81ad550 con 0x55b51170bd10 2024-08-20T05:15:06.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.587+0000 7f52c2225740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f52b81af090 con 0x55b51170b3f0 2024-08-20T05:15:06.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.588+0000 7f52b7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 0x55b51170f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.588+0000 7f52b7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 0x55b51170f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57152/0 (socket says 172.21.15.37:57152) 2024-08-20T05:15:06.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.588+0000 7f52b7e00640 1 -- 172.21.15.37:0/4009469828 learned_addr learned my addr 172.21.15.37:0/4009469828 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:06.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.588+0000 7f52bcc00640 1 --2- 172.21.15.37:0/4009469828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b51170bd10 0x55b5117408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.588+0000 7f52bcc00640 1 -- 172.21.15.37:0/4009469828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 msgr2=0x55b51170f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:06.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.588+0000 7f52b7e00640 1 --2- 172.21.15.37:0/4009469828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b511717ca0 0x55b511740df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.588+0000 7f52bcc00640 1 --2- 172.21.15.37:0/4009469828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 0x55b51170f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.588+0000 7f52bcc00640 1 -- 172.21.15.37:0/4009469828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b511717ca0 msgr2=0x55b511740df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:06.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.588+0000 7f52bcc00640 1 --2- 172.21.15.37:0/4009469828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b511717ca0 0x55b511740df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.588+0000 7f52bcc00640 1 -- 172.21.15.37:0/4009469828 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b511709ca0 con 0x55b51170bd10 2024-08-20T05:15:06.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.588+0000 7f52b7e00640 1 --2- 172.21.15.37:0/4009469828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b511717ca0 0x55b511740df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:06.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.589+0000 7f52bcc00640 1 --2- 172.21.15.37:0/4009469828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b51170bd10 0x55b5117408b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f52a8003f30 tx=0x7f52a80042c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36310c50437b7ba8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:06.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.589+0000 7f52ad200640 1 -- 172.21.15.37:0/4009469828 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a801e040 con 0x55b51170bd10 2024-08-20T05:15:06.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.589+0000 7f52ad200640 1 -- 172.21.15.37:0/4009469828 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52a80054f0 con 0x55b51170bd10 2024-08-20T05:15:06.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.589+0000 7f52ad200640 1 -- 172.21.15.37:0/4009469828 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a800f5a0 con 0x55b51170bd10 2024-08-20T05:15:06.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.590+0000 7f52c2225740 1 -- 172.21.15.37:0/4009469828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b51170bd10 msgr2=0x55b5117408b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:06.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.590+0000 7f52c2225740 1 --2- 172.21.15.37:0/4009469828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b51170bd10 0x55b5117408b0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f52a8003f30 tx=0x7f52a80042c0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.590+0000 7f52c2225740 1 -- 172.21.15.37:0/4009469828 shutdown_connections 2024-08-20T05:15:06.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.590+0000 7f52c2225740 1 --2- 172.21.15.37:0/4009469828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b511717ca0 0x55b511740df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.590+0000 7f52c2225740 1 --2- 172.21.15.37:0/4009469828 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b51170bd10 0x55b5117408b0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.590+0000 7f52c2225740 1 --2- 172.21.15.37:0/4009469828 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 0x55b51170f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.590+0000 7f52c2225740 1 -- 172.21.15.37:0/4009469828 >> 172.21.15.37:0/4009469828 conn(0x55b511709220 msgr2=0x55b511716ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:06.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.592+0000 7f52c2225740 1 -- 172.21.15.37:0/4009469828 shutdown_connections 2024-08-20T05:15:06.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.593+0000 7f52c2225740 1 -- 172.21.15.37:0/4009469828 wait complete. 2024-08-20T05:15:06.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.593+0000 7f52c2225740 1 -- start start 2024-08-20T05:15:06.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.593+0000 7f52c2225740 1 Processor -- start 2024-08-20T05:15:06.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.594+0000 7f52c2225740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 0x55b511731240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.594+0000 7f52c2225740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b51170bd10 0x55b51172c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.594+0000 7f52c2225740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b511717ca0 0x55b51172cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.594+0000 7f52c2225740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f52b81ae2f0 con 0x55b51170bd10 2024-08-20T05:15:06.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.594+0000 7f52c2225740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f52b81adc20 con 0x55b511717ca0 2024-08-20T05:15:06.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.594+0000 7f52c2225740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f52b81ae9c0 con 0x55b51170b3f0 2024-08-20T05:15:06.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.594+0000 7f52c2225740 10 client.0 _ll_register_callbacks cb 0x7f52a4013550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:06.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.594+0000 7f52b7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 0x55b511731240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.594+0000 7f52b7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 0x55b511731240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57168/0 (socket says 172.21.15.37:57168) 2024-08-20T05:15:06.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.594+0000 7f52b7e00640 1 -- 172.21.15.37:0/3778490459 learned_addr learned my addr 172.21.15.37:0/3778490459 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:06.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.594+0000 7f52bcc00640 1 --2- 172.21.15.37:0/3778490459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b51170bd10 0x55b51172c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.594+0000 7f52b7e00640 1 --2- 172.21.15.37:0/3778490459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b511717ca0 0x55b51172cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.595+0000 7f52b7e00640 1 -- 172.21.15.37:0/3778490459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 msgr2=0x55b511731240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:06.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.595+0000 7f52b7e00640 1 --2- 172.21.15.37:0/3778490459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 0x55b511731240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.595+0000 7f52b7e00640 1 -- 172.21.15.37:0/3778490459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b51170bd10 msgr2=0x55b51172c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:06.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.595+0000 7f52b7e00640 1 --2- 172.21.15.37:0/3778490459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b51170bd10 0x55b51172c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.595+0000 7f52b7e00640 1 -- 172.21.15.37:0/3778490459 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b51172d540 con 0x55b511717ca0 2024-08-20T05:15:06.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.595+0000 7f52bcc00640 1 --2- 172.21.15.37:0/3778490459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b51170bd10 0x55b51172c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:06.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.595+0000 7f52b7e00640 1 --2- 172.21.15.37:0/3778490459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b511717ca0 0x55b51172cd40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f52a400b460 tx=0x7f52a40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdd7d7d3d3d9b5cc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:06.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.595+0000 7f52a2000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:15:06.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.596+0000 7f52a2000640 1 -- 172.21.15.37:0/3778490459 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a400ea60 con 0x55b511717ca0 2024-08-20T05:15:06.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.596+0000 7f52a2000640 1 -- 172.21.15.37:0/3778490459 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f52a4028020 con 0x55b511717ca0 2024-08-20T05:15:06.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.596+0000 7f52c2225740 1 -- 172.21.15.37:0/3778490459 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52a80054f0 con 0x55b511717ca0 2024-08-20T05:15:06.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.596+0000 7f52a2000640 1 -- 172.21.15.37:0/3778490459 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f52a4040050 con 0x55b511717ca0 2024-08-20T05:15:06.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.596+0000 7f52c2225740 10 client.28544 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:06.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.596+0000 7f52c2225740 1 -- 172.21.15.37:0/3778490459 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55b5117a3900 con 0x55b511717ca0 2024-08-20T05:15:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.596+0000 7f52a2000640 1 -- 172.21.15.37:0/3778490459 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52a80054f0 con 0x55b511717ca0 2024-08-20T05:15:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.597+0000 7f52a2000640 1 -- 172.21.15.37:0/3778490459 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f52a402c040 con 0x55b511717ca0 2024-08-20T05:15:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.597+0000 7f52c2225740 10 client.28544 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.597+0000 7f52c2225740 10 client.28544 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:15:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.597+0000 7f52c2225740 20 client.28544 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.597+0000 7f52c2225740 1 --2- 172.21.15.37:0/3778490459 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b5117a40c0 0x55b5117a64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.597+0000 7f52c2225740 4 client.28544 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.3, "await_for": 45.0}] 2024-08-20T05:15:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.597+0000 7f52c2225740 1 -- 172.21.15.37:0/3778490459 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.3, "await_for": 45.0}) -- 0x55b51167d1b0 con 0x55b5117a40c0 2024-08-20T05:15:06.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.597+0000 7f52bcc00640 1 --2- 172.21.15.37:0/3778490459 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b5117a40c0 0x55b5117a64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:06.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.598+0000 7f52bcc00640 1 --2- 172.21.15.37:0/3778490459 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b5117a40c0 0x55b5117a64e0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b0f3f9f3ff7706d server_cookie=c9477a58c2480608 in_seq=0 out_seq=0 2024-08-20T05:15:06.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.598+0000 7f52a2000640 10 client.28544 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:06.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.788+0000 7f52a2000640 1 -- 172.21.15.37:0/3778490459 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b51167d1b0 con 0x55b5117a40c0 2024-08-20T05:15:06.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.788+0000 7f52a2000640 10 client.28544 handle_command_reply: tid=0 2024-08-20T05:15:06.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.788+0000 7f52c2225740 1 client.28544 shutdown 2024-08-20T05:15:06.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.788+0000 7f52c2225740 1 -- 172.21.15.37:0/3778490459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b511717ca0 msgr2=0x55b51172cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:06.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.788+0000 7f52c2225740 1 --2- 172.21.15.37:0/3778490459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b511717ca0 0x55b51172cd40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f52a400b460 tx=0x7f52a40046c0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.788+0000 7f52c2225740 1 -- 172.21.15.37:0/3778490459 shutdown_connections 2024-08-20T05:15:06.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.788+0000 7f52c2225740 1 --2- 172.21.15.37:0/3778490459 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b5117a40c0 0x55b5117a64e0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.788+0000 7f52c2225740 1 --2- 172.21.15.37:0/3778490459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b511717ca0 0x55b51172cd40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.788+0000 7f52c2225740 1 --2- 172.21.15.37:0/3778490459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b51170bd10 0x55b51172c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.788+0000 7f52a2000640 0 client.28544 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:06.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.788+0000 7f52c2225740 1 --2- 172.21.15.37:0/3778490459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b51170b3f0 0x55b511731240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.788+0000 7f52c2225740 1 -- 172.21.15.37:0/3778490459 >> 172.21.15.37:0/3778490459 conn(0x55b511709220 msgr2=0x55b511714c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:06.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.788+0000 7f52c2225740 1 -- 172.21.15.37:0/3778490459 shutdown_connections 2024-08-20T05:15:06.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.788+0000 7f52c2225740 1 -- 172.21.15.37:0/3778490459 wait complete. 2024-08-20T05:15:06.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.789+0000 7f52c2225740 20 client.28544 trim_cache size 0 max 16384 2024-08-20T05:15:06.792 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:15:06.792 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 48, 2024-08-20T05:15:06.792 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:15:06.792 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 46, 2024-08-20T05:15:06.792 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:15:06.792 INFO:teuthology.orchestra.run.smithi037.stdout: "9ca7b0fe": { 2024-08-20T05:15:06.793 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 46, 2024-08-20T05:15:06.793 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:15:06.793 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:15:06.793 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:15:06.793 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:15:06.793 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:15:06.793 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:15:06.793 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 137.3, 2024-08-20T05:15:06.793 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:15:06.793 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:15:06.793 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:15:06.793 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:15:06.793 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:15:06.794 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:15:06.794 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:15:06.794 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:15:06.794 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:15:06.794 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:15:06.794 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:15:06.794 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:15:06.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.789+0000 7f52bf600640 1 -- 172.21.15.37:0/131431432 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f529c0b3d20 msgr2=0x7f529c0b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:06.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.789+0000 7f52bf600640 1 --2- 172.21.15.37:0/131431432 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f529c0b3d20 0x7f529c0b61e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f52b002ae80 tx=0x7f52b002a8c0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.789+0000 7f52bf600640 1 -- 172.21.15.37:0/131431432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52b810b030 msgr2=0x7f52b810ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:06.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.789+0000 7f52bf600640 1 --2- 172.21.15.37:0/131431432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52b810b030 0x7f52b810ec30 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f52b0009430 tx=0x7f52b00317c0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.789+0000 7f52bf600640 1 -- 172.21.15.37:0/131431432 shutdown_connections 2024-08-20T05:15:06.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.789+0000 7f52bf600640 1 --2- 172.21.15.37:0/131431432 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f529c0b3d20 0x7f529c0b61e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.789+0000 7f52bf600640 1 --2- 172.21.15.37:0/131431432 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f52b810b030 0x7f52b810ec30 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.789+0000 7f52bf600640 1 --2- 172.21.15.37:0/131431432 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f52b810a6b0 0x7f52b810e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.789+0000 7f52bf600640 1 --2- 172.21.15.37:0/131431432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52b8104ca0 0x7f52b81114a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:06.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.789+0000 7f52bf600640 1 -- 172.21.15.37:0/131431432 >> 172.21.15.37:0/131431432 conn(0x7f52b8100750 msgr2=0x7f52b8103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:06.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.790+0000 7f52bf600640 1 -- 172.21.15.37:0/131431432 shutdown_connections 2024-08-20T05:15:06.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:06.790+0000 7f52bf600640 1 -- 172.21.15.37:0/131431432 wait complete. 2024-08-20T05:15:07.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:07 smithi037 ceph-mon[17265]: pgmap v787: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 5.7 MiB/s wr, 538 op/s 2024-08-20T05:15:07.811 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9ca7b0fe', quiesce took 9.9 seconds. Will release after: 7.4 2024-08-20T05:15:07.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:07 smithi135 ceph-mon[22342]: pgmap v787: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 5.7 MiB/s wr, 538 op/s 2024-08-20T05:15:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:07 smithi130 ceph-mon[22007]: pgmap v787: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 5.7 MiB/s wr, 538 op/s 2024-08-20T05:15:08.042 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 730.0 s, 330.6 tps, lat 224.419 ms stddev 284.622 2024-08-20T05:15:09.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:09 smithi135 ceph-mon[22342]: pgmap v788: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 5.1 MiB/s wr, 472 op/s 2024-08-20T05:15:09.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:09 smithi130 ceph-mon[22007]: pgmap v788: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 5.1 MiB/s wr, 472 op/s 2024-08-20T05:15:10.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:09 smithi037 ceph-mon[17265]: pgmap v788: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 470 KiB/s rd, 5.1 MiB/s wr, 472 op/s 2024-08-20T05:15:11.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:11 smithi135 ceph-mon[22342]: pgmap v789: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 4.9 MiB/s wr, 448 op/s 2024-08-20T05:15:11.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:11 smithi130 ceph-mon[22007]: pgmap v789: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 4.9 MiB/s wr, 448 op/s 2024-08-20T05:15:12.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:11 smithi037 ceph-mon[17265]: pgmap v789: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 451 KiB/s rd, 4.9 MiB/s wr, 448 op/s 2024-08-20T05:15:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:15:13.831 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:13 smithi037 ceph-mon[17265]: pgmap v790: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 4.4 MiB/s wr, 386 op/s 2024-08-20T05:15:13.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:13 smithi135 ceph-mon[22342]: pgmap v790: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 4.4 MiB/s wr, 386 op/s 2024-08-20T05:15:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:13 smithi130 ceph-mon[22007]: pgmap v790: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 4.4 MiB/s wr, 386 op/s 2024-08-20T05:15:14.242 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:15:14.645 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:15:15.213 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:15:15.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.417+0000 7f0b04c00640 1 -- 172.21.15.37:0/2137747468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b00102920 msgr2=0x7f0b00102d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:15.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.417+0000 7f0b04c00640 1 --2- 172.21.15.37:0/2137747468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b00102920 0x7f0b00102d00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0af0009900 tx=0x7f0af002a3f0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.417+0000 7f0b04c00640 1 -- 172.21.15.37:0/2137747468 shutdown_connections 2024-08-20T05:15:15.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.417+0000 7f0b04c00640 1 --2- 172.21.15.37:0/2137747468 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b00108cb0 0x7f0b0010f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.417+0000 7f0b04c00640 1 --2- 172.21.15.37:0/2137747468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b00108330 0x7f0b00108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.417+0000 7f0b04c00640 1 --2- 172.21.15.37:0/2137747468 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b00102920 0x7f0b00102d00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.417+0000 7f0b04c00640 1 -- 172.21.15.37:0/2137747468 >> 172.21.15.37:0/2137747468 conn(0x7f0b000fe350 msgr2=0x7f0b00100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:15.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.417+0000 7f0b04c00640 1 -- 172.21.15.37:0/2137747468 shutdown_connections 2024-08-20T05:15:15.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.417+0000 7f0b04c00640 1 -- 172.21.15.37:0/2137747468 wait complete. 2024-08-20T05:15:15.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.418+0000 7f0b04c00640 1 Processor -- start 2024-08-20T05:15:15.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.418+0000 7f0b04c00640 1 -- start start 2024-08-20T05:15:15.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.419+0000 7f0b04c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b00102920 0x7f0b0019af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.419+0000 7f0b04c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b00108330 0x7f0b0019b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.419+0000 7f0b04c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b00108cb0 0x7f0b001a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.419+0000 7f0b04c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b001129c0 con 0x7f0b00102920 2024-08-20T05:15:15.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.419+0000 7f0b04c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b00112840 con 0x7f0b00108330 2024-08-20T05:15:15.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.419+0000 7f0b04c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b00112b40 con 0x7f0b00108cb0 2024-08-20T05:15:15.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.419+0000 7f0aff400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b00102920 0x7f0b0019af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.419+0000 7f0aff400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b00102920 0x7f0b0019af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56194/0 (socket says 172.21.15.37:56194) 2024-08-20T05:15:15.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.419+0000 7f0aff400640 1 -- 172.21.15.37:0/1661515117 learned_addr learned my addr 172.21.15.37:0/1661515117 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:15.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.419+0000 7f0afea00640 1 --2- 172.21.15.37:0/1661515117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b00108330 0x7f0b0019b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.419+0000 7f0affe00640 1 --2- 172.21.15.37:0/1661515117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b00108cb0 0x7f0b001a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.420+0000 7f0aff400640 1 -- 172.21.15.37:0/1661515117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b00108cb0 msgr2=0x7f0b001a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:15.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.420+0000 7f0aff400640 1 --2- 172.21.15.37:0/1661515117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b00108cb0 0x7f0b001a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.420+0000 7f0aff400640 1 -- 172.21.15.37:0/1661515117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b00108330 msgr2=0x7f0b0019b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:15.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.420+0000 7f0aff400640 1 --2- 172.21.15.37:0/1661515117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b00108330 0x7f0b0019b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.420+0000 7f0aff400640 1 -- 172.21.15.37:0/1661515117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b001a0fe0 con 0x7f0b00102920 2024-08-20T05:15:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.420+0000 7f0aff400640 1 --2- 172.21.15.37:0/1661515117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b00102920 0x7f0b0019af30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0af0005ab0 tx=0x7f0af0003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.420+0000 7f0af7e00640 1 -- 172.21.15.37:0/1661515117 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af003f070 con 0x7f0b00102920 2024-08-20T05:15:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.420+0000 7f0af7e00640 1 -- 172.21.15.37:0/1661515117 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0af0031b60 con 0x7f0b00102920 2024-08-20T05:15:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.420+0000 7f0af7e00640 1 -- 172.21.15.37:0/1661515117 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0035030 con 0x7f0b00102920 2024-08-20T05:15:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.420+0000 7f0b04c00640 1 -- 172.21.15.37:0/1661515117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b001a1270 con 0x7f0b00102920 2024-08-20T05:15:15.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.421+0000 7f0b04c00640 1 -- 172.21.15.37:0/1661515117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b001a7990 con 0x7f0b00102920 2024-08-20T05:15:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.425+0000 7f0b08e82740 1 Processor -- start 2024-08-20T05:15:15.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.426+0000 7f0b08e82740 1 -- start start 2024-08-20T05:15:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.426+0000 7f0af7e00640 1 -- 172.21.15.37:0/1661515117 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0af0042070 con 0x7f0b00102920 2024-08-20T05:15:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.426+0000 7f0b08e82740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f5a80 0x562e513f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.426+0000 7f0b08e82740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e513f63a0 0x562e51401df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.426+0000 7f0b08e82740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e51402330 0x562e51404720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.426+0000 7f0b08e82740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562e5136ba60 con 0x562e51402330 2024-08-20T05:15:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.426+0000 7f0b08e82740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562e5135af60 con 0x562e513f63a0 2024-08-20T05:15:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.426+0000 7f0b08e82740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562e5135efa0 con 0x562e513f5a80 2024-08-20T05:15:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.426+0000 7f0affe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f5a80 0x562e513f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.427+0000 7f0affe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f5a80 0x562e513f5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:59828/0 (socket says 172.21.15.37:59828) 2024-08-20T05:15:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.427+0000 7f0affe00640 1 -- 172.21.15.37:0/4075826188 learned_addr learned my addr 172.21.15.37:0/4075826188 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:15.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.427+0000 7f0aff400640 1 --2- 172.21.15.37:0/4075826188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e513f63a0 0x562e51401df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.427+0000 7f0afea00640 1 --2- 172.21.15.37:0/4075826188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e51402330 0x562e51404720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.427+0000 7f0affe00640 1 -- 172.21.15.37:0/4075826188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e513f63a0 msgr2=0x562e51401df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.427+0000 7f0affe00640 1 --2- 172.21.15.37:0/4075826188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e513f63a0 0x562e51401df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.427+0000 7f0affe00640 1 -- 172.21.15.37:0/4075826188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e51402330 msgr2=0x562e51404720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.427+0000 7f0affe00640 1 --2- 172.21.15.37:0/4075826188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e51402330 0x562e51404720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.427+0000 7f0affe00640 1 -- 172.21.15.37:0/4075826188 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e513013e0 con 0x562e513f5a80 2024-08-20T05:15:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.427+0000 7f0affe00640 1 --2- 172.21.15.37:0/4075826188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f5a80 0x562e513f5e60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009fd0 tx=0x7f0af80118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed8da400a5e16f73 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.428+0000 7f0aebe00640 1 -- 172.21.15.37:0/4075826188 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8004d20 con 0x562e513f5a80 2024-08-20T05:15:15.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.428+0000 7f0aebe00640 1 -- 172.21.15.37:0/4075826188 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0af8004050 con 0x562e513f5a80 2024-08-20T05:15:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.428+0000 7f0aebe00640 1 -- 172.21.15.37:0/4075826188 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8005220 con 0x562e513f5a80 2024-08-20T05:15:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.428+0000 7f0af7e00640 1 --2- 172.21.15.37:0/1661515117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0ae40b3cf0 0x7f0ae40b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.428+0000 7f0af7e00640 1 -- 172.21.15.37:0/1661515117 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0af0104600 con 0x7f0b00102920 2024-08-20T05:15:15.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.428+0000 7f0aff400640 1 --2- 172.21.15.37:0/1661515117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0ae40b3cf0 0x7f0ae40b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.429+0000 7f0b08e82740 1 -- 172.21.15.37:0/4075826188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f5a80 msgr2=0x562e513f5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.429+0000 7f0b08e82740 1 --2- 172.21.15.37:0/4075826188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f5a80 0x562e513f5e60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0af8009fd0 tx=0x7f0af80118d0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.429+0000 7f0aff400640 1 --2- 172.21.15.37:0/1661515117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0ae40b3cf0 0x7f0ae40b61b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0af0000c00 tx=0x7f0af010a0e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.429+0000 7f0b08e82740 1 -- 172.21.15.37:0/4075826188 shutdown_connections 2024-08-20T05:15:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.429+0000 7f0b08e82740 1 --2- 172.21.15.37:0/4075826188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e51402330 0x562e51404720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.429+0000 7f0b08e82740 1 --2- 172.21.15.37:0/4075826188 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e513f63a0 0x562e51401df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.429+0000 7f0b08e82740 1 --2- 172.21.15.37:0/4075826188 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f5a80 0x562e513f5e60 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.429+0000 7f0b08e82740 1 -- 172.21.15.37:0/4075826188 >> 172.21.15.37:0/4075826188 conn(0x562e513f38b0 msgr2=0x562e513f4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.429+0000 7f0b08e82740 1 -- 172.21.15.37:0/4075826188 shutdown_connections 2024-08-20T05:15:15.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.429+0000 7f0b08e82740 1 -- 172.21.15.37:0/4075826188 wait complete. 2024-08-20T05:15:15.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.430+0000 7f0b08e82740 1 -- start start 2024-08-20T05:15:15.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.430+0000 7f0b08e82740 1 Processor -- start 2024-08-20T05:15:15.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.431+0000 7f0b08e82740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e513f5a80 0x562e51401b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.431+0000 7f0b08e82740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f63a0 0x562e513fef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.431+0000 7f0b08e82740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e51402330 0x562e513ff4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.431+0000 7f0b08e82740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562e511bd700 con 0x562e51402330 2024-08-20T05:15:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.431+0000 7f0b08e82740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x562e512f6250 con 0x562e513f5a80 2024-08-20T05:15:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.431+0000 7f0b08e82740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x562e51404fb0 con 0x562e513f63a0 2024-08-20T05:15:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.431+0000 7f0b08e82740 10 client.0 _ll_register_callbacks cb 0x562e51355180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.431+0000 7f0affe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e51402330 0x562e513ff4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.431+0000 7f0affe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e51402330 0x562e513ff4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56222/0 (socket says 172.21.15.37:56222) 2024-08-20T05:15:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.431+0000 7f0affe00640 1 -- 172.21.15.37:0/3710589984 learned_addr learned my addr 172.21.15.37:0/3710589984 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:15.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.431+0000 7f0afea00640 1 --2- 172.21.15.37:0/3710589984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f63a0 0x562e513fef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.431+0000 7f0affe00640 1 --2- 172.21.15.37:0/3710589984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e513f5a80 0x562e51401b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.432+0000 7f0afea00640 1 -- 172.21.15.37:0/3710589984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e513f5a80 msgr2=0x562e51401b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.432+0000 7f0afea00640 1 --2- 172.21.15.37:0/3710589984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e513f5a80 0x562e51401b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.432+0000 7f0afea00640 1 -- 172.21.15.37:0/3710589984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e51402330 msgr2=0x562e513ff4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.432+0000 7f0afea00640 1 --2- 172.21.15.37:0/3710589984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e51402330 0x562e513ff4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.432+0000 7f0afea00640 1 -- 172.21.15.37:0/3710589984 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e510ba650 con 0x562e513f63a0 2024-08-20T05:15:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.432+0000 7f0afea00640 1 --2- 172.21.15.37:0/3710589984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f63a0 0x562e513fef60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0136e0 tx=0x7f0aec013ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74a40dddaa861a6a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:15.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.432+0000 7f0ae8c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:15:15.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.432+0000 7f0ae8c00640 1 -- 172.21.15.37:0/3710589984 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec011dd0 con 0x562e513f63a0 2024-08-20T05:15:15.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.432+0000 7f0b08e82740 1 -- 172.21.15.37:0/3710589984 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0af8004050 con 0x562e513f63a0 2024-08-20T05:15:15.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.432+0000 7f0ae8c00640 1 -- 172.21.15.37:0/3710589984 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0aec01b430 con 0x562e513f63a0 2024-08-20T05:15:15.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.433+0000 7f0ae8c00640 1 -- 172.21.15.37:0/3710589984 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f0aec026050 con 0x562e513f63a0 2024-08-20T05:15:15.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.433+0000 7f0b08e82740 10 client.28603 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:15.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.433+0000 7f0b08e82740 1 -- 172.21.15.37:0/3710589984 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x562e51410870 con 0x562e513f63a0 2024-08-20T05:15:15.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.433+0000 7f0ae8c00640 1 -- 172.21.15.37:0/3710589984 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0af8004050 con 0x562e513f63a0 2024-08-20T05:15:15.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.433+0000 7f0ae8c00640 1 -- 172.21.15.37:0/3710589984 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f0aec00f690 con 0x562e513f63a0 2024-08-20T05:15:15.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.433+0000 7f0b08e82740 10 client.28603 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:15.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.433+0000 7f0b08e82740 10 client.28603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:15.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.433+0000 7f0b08e82740 20 client.28603 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:15.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.433+0000 7f0b08e82740 1 --2- 172.21.15.37:0/3710589984 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562e51411dd0 0x562e514141f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.433+0000 7f0b08e82740 4 client.28603 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:15:15.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.434+0000 7f0b08e82740 1 -- 172.21.15.37:0/3710589984 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e5136d9b0 con 0x562e51411dd0 2024-08-20T05:15:15.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.434+0000 7f0affe00640 1 --2- 172.21.15.37:0/3710589984 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562e51411dd0 0x562e514141f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.434+0000 7f0affe00640 1 --2- 172.21.15.37:0/3710589984 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562e51411dd0 0x562e514141f0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43f8462bb1af1fb server_cookie=c4ba7b00cadc29ed in_seq=0 out_seq=0 2024-08-20T05:15:15.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.434+0000 7f0ae8c00640 10 client.28603 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.435+0000 7f0ae8c00640 1 -- 172.21.15.37:0/3710589984 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562e5136d9b0 con 0x562e51411dd0 2024-08-20T05:15:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.435+0000 7f0ae8c00640 10 client.28603 handle_command_reply: tid=0 2024-08-20T05:15:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.435+0000 7f0b08e82740 1 client.28603 shutdown 2024-08-20T05:15:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.436+0000 7f0b08e82740 1 -- 172.21.15.37:0/3710589984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f63a0 msgr2=0x562e513fef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.436+0000 7f0b08e82740 1 --2- 172.21.15.37:0/3710589984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f63a0 0x562e513fef60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0136e0 tx=0x7f0aec013ba0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.436+0000 7f0b08e82740 1 -- 172.21.15.37:0/3710589984 shutdown_connections 2024-08-20T05:15:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.436+0000 7f0b08e82740 1 --2- 172.21.15.37:0/3710589984 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562e51411dd0 0x562e514141f0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.436+0000 7f0b08e82740 1 --2- 172.21.15.37:0/3710589984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e51402330 0x562e513ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.436+0000 7f0b08e82740 1 --2- 172.21.15.37:0/3710589984 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f63a0 0x562e513fef60 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.436+0000 7f0b08e82740 1 --2- 172.21.15.37:0/3710589984 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e513f5a80 0x562e51401b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.436+0000 7f0b08e82740 1 -- 172.21.15.37:0/3710589984 >> 172.21.15.37:0/3710589984 conn(0x562e513f38b0 msgr2=0x562e513f9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.436+0000 7f0ae8c00640 0 client.28603 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.436+0000 7f0b08e82740 1 -- 172.21.15.37:0/3710589984 shutdown_connections 2024-08-20T05:15:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.436+0000 7f0b08e82740 1 -- 172.21.15.37:0/3710589984 wait complete. 2024-08-20T05:15:15.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.436+0000 7f0b08e82740 20 client.28603 trim_cache size 0 max 16384 2024-08-20T05:15:15.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.454+0000 7f0b08e82740 1 Processor -- start 2024-08-20T05:15:15.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.454+0000 7f0b08e82740 1 -- start start 2024-08-20T05:15:15.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.455+0000 7f0b08e82740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e513f5a80 0x562e5140e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.455+0000 7f0b08e82740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f63a0 0x562e51419aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.455+0000 7f0b08e82740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e51402330 0x562e51419fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.455+0000 7f0b08e82740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b001b1770 con 0x562e51402330 2024-08-20T05:15:15.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.455+0000 7f0b08e82740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b001b32b0 con 0x562e513f5a80 2024-08-20T05:15:15.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.455+0000 7f0b08e82740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b001b1e40 con 0x562e513f63a0 2024-08-20T05:15:15.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.455+0000 7f0afea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f63a0 0x562e51419aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.455+0000 7f0afea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f63a0 0x562e51419aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:59850/0 (socket says 172.21.15.37:59850) 2024-08-20T05:15:15.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.455+0000 7f0afea00640 1 -- 172.21.15.37:0/2324274486 learned_addr learned my addr 172.21.15.37:0/2324274486 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:15.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.456+0000 7f0affe00640 1 --2- 172.21.15.37:0/2324274486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e513f5a80 0x562e5140e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.456+0000 7f0affe00640 1 --2- 172.21.15.37:0/2324274486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e51402330 0x562e51419fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.456+0000 7f0afea00640 1 -- 172.21.15.37:0/2324274486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e513f5a80 msgr2=0x562e5140e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:15.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.456+0000 7f0afea00640 1 --2- 172.21.15.37:0/2324274486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e513f5a80 0x562e5140e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.456+0000 7f0afea00640 1 -- 172.21.15.37:0/2324274486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e51402330 msgr2=0x562e51419fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:15.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.456+0000 7f0afea00640 1 --2- 172.21.15.37:0/2324274486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e51402330 0x562e51419fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.456+0000 7f0afea00640 1 -- 172.21.15.37:0/2324274486 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e513ff800 con 0x562e513f63a0 2024-08-20T05:15:15.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.456+0000 7f0affe00640 1 --2- 172.21.15.37:0/2324274486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e51402330 0x562e51419fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:15.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.456+0000 7f0afea00640 1 --2- 172.21.15.37:0/2324274486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f63a0 0x562e51419aa0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00fab0 tx=0x7f0aec005670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0c5b91166de8823 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.456+0000 7f0aeb400640 1 -- 172.21.15.37:0/2324274486 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec011bd0 con 0x562e513f63a0 2024-08-20T05:15:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.457+0000 7f0aeb400640 1 -- 172.21.15.37:0/2324274486 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aec00f870 con 0x562e513f63a0 2024-08-20T05:15:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.457+0000 7f0aeb400640 1 -- 172.21.15.37:0/2324274486 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec01bc00 con 0x562e513f63a0 2024-08-20T05:15:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.457+0000 7f0b08e82740 1 -- 172.21.15.37:0/2324274486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f63a0 msgr2=0x562e51419aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.457+0000 7f0b08e82740 1 --2- 172.21.15.37:0/2324274486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f63a0 0x562e51419aa0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00fab0 tx=0x7f0aec005670 comp rx=0 tx=0).stop 2024-08-20T05:15:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.457+0000 7f0b08e82740 1 -- 172.21.15.37:0/2324274486 shutdown_connections 2024-08-20T05:15:15.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.457+0000 7f0b08e82740 1 --2- 172.21.15.37:0/2324274486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e51402330 0x562e51419fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.457+0000 7f0b08e82740 1 --2- 172.21.15.37:0/2324274486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f63a0 0x562e51419aa0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.457+0000 7f0b08e82740 1 --2- 172.21.15.37:0/2324274486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e513f5a80 0x562e5140e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.457+0000 7f0b08e82740 1 -- 172.21.15.37:0/2324274486 >> 172.21.15.37:0/2324274486 conn(0x562e513f38b0 msgr2=0x562e51400db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.458+0000 7f0b08e82740 1 -- 172.21.15.37:0/2324274486 shutdown_connections 2024-08-20T05:15:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.458+0000 7f0b08e82740 1 -- 172.21.15.37:0/2324274486 wait complete. 2024-08-20T05:15:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.458+0000 7f0b08e82740 1 -- start start 2024-08-20T05:15:15.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.458+0000 7f0b08e82740 1 Processor -- start 2024-08-20T05:15:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.459+0000 7f0b08e82740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f5a80 0x562e5140a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.459+0000 7f0b08e82740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e513f63a0 0x562e51405b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.459+0000 7f0b08e82740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e51402330 0x562e514060d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.459+0000 7f0b08e82740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b001b2be0 con 0x562e513f63a0 2024-08-20T05:15:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.459+0000 7f0b08e82740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b001b2510 con 0x562e51402330 2024-08-20T05:15:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.459+0000 7f0b08e82740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b001af750 con 0x562e513f5a80 2024-08-20T05:15:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.459+0000 7f0b08e82740 10 client.0 _ll_register_callbacks cb 0x7f0aec009490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.459+0000 7f0afea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e513f63a0 0x562e51405b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.459+0000 7f0afea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e513f63a0 0x562e51405b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56232/0 (socket says 172.21.15.37:56232) 2024-08-20T05:15:15.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.459+0000 7f0afea00640 1 -- 172.21.15.37:0/2760054943 learned_addr learned my addr 172.21.15.37:0/2760054943 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.459+0000 7f0affe00640 1 --2- 172.21.15.37:0/2760054943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f5a80 0x562e5140a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.459+0000 7f0affe00640 1 --2- 172.21.15.37:0/2760054943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e51402330 0x562e514060d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.460+0000 7f0afea00640 1 -- 172.21.15.37:0/2760054943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f5a80 msgr2=0x562e5140a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.460+0000 7f0afea00640 1 --2- 172.21.15.37:0/2760054943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f5a80 0x562e5140a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.460+0000 7f0afea00640 1 -- 172.21.15.37:0/2760054943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e51402330 msgr2=0x562e514060d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.460+0000 7f0afea00640 1 --2- 172.21.15.37:0/2760054943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e51402330 0x562e514060d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.460+0000 7f0afea00640 1 -- 172.21.15.37:0/2760054943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e514066c0 con 0x562e513f63a0 2024-08-20T05:15:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.460+0000 7f0affe00640 1 --2- 172.21.15.37:0/2760054943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e51402330 0x562e514060d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:15:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.460+0000 7f0afea00640 1 --2- 172.21.15.37:0/2760054943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e513f63a0 0x562e51405b90 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00feb0 tx=0x7f0aec00fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a3d97e3ba9f56f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.460+0000 7f0ae8c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:15:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.460+0000 7f0ae8c00640 1 -- 172.21.15.37:0/2760054943 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec0117b0 con 0x562e513f63a0 2024-08-20T05:15:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.460+0000 7f0ae8c00640 1 -- 172.21.15.37:0/2760054943 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0aec011bd0 con 0x562e513f63a0 2024-08-20T05:15:15.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.460+0000 7f0b08e82740 1 -- 172.21.15.37:0/2760054943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0aec00f870 con 0x562e513f63a0 2024-08-20T05:15:15.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.461+0000 7f0ae8c00640 1 -- 172.21.15.37:0/2760054943 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f0aec045050 con 0x562e513f63a0 2024-08-20T05:15:15.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.461+0000 7f0b08e82740 10 client.17949 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:15.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.461+0000 7f0b08e82740 1 -- 172.21.15.37:0/2760054943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x562e5147c810 con 0x562e513f63a0 2024-08-20T05:15:15.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.461+0000 7f0ae8c00640 1 -- 172.21.15.37:0/2760054943 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0aec00f870 con 0x562e513f63a0 2024-08-20T05:15:15.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.461+0000 7f0ae8c00640 1 -- 172.21.15.37:0/2760054943 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f0aec01b900 con 0x562e513f63a0 2024-08-20T05:15:15.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.461+0000 7f0b08e82740 10 client.17949 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:15.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.461+0000 7f0b08e82740 10 client.17949 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:15.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.461+0000 7f0b08e82740 20 client.17949 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:15.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.461+0000 7f0b08e82740 1 --2- 172.21.15.37:0/2760054943 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562e5147ce90 0x562e5147f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.462+0000 7f0b08e82740 4 client.17949 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:15:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.462+0000 7f0b08e82740 1 -- 172.21.15.37:0/2760054943 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562e51401520 con 0x562e5147ce90 2024-08-20T05:15:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.462+0000 7f0affe00640 1 --2- 172.21.15.37:0/2760054943 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562e5147ce90 0x562e5147f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.462+0000 7f0affe00640 1 --2- 172.21.15.37:0/2760054943 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562e5147ce90 0x562e5147f2b0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=744708a775f7f66f server_cookie=5f8062114d4cb61e in_seq=0 out_seq=0 2024-08-20T05:15:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.462+0000 7f0ae8c00640 10 client.17949 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.463+0000 7f0ae8c00640 1 -- 172.21.15.37:0/2760054943 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562e51401520 con 0x562e5147ce90 2024-08-20T05:15:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.463+0000 7f0ae8c00640 10 client.17949 handle_command_reply: tid=0 2024-08-20T05:15:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.463+0000 7f0b08e82740 1 client.17949 shutdown 2024-08-20T05:15:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.463+0000 7f0b08e82740 1 -- 172.21.15.37:0/2760054943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e513f63a0 msgr2=0x562e51405b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.463+0000 7f0b08e82740 1 --2- 172.21.15.37:0/2760054943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e513f63a0 0x562e51405b90 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00feb0 tx=0x7f0aec00fee0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.463+0000 7f0b08e82740 1 -- 172.21.15.37:0/2760054943 shutdown_connections 2024-08-20T05:15:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.463+0000 7f0b08e82740 1 --2- 172.21.15.37:0/2760054943 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x562e5147ce90 0x562e5147f2b0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.463+0000 7f0b08e82740 1 --2- 172.21.15.37:0/2760054943 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x562e51402330 0x562e514060d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.463+0000 7f0b08e82740 1 --2- 172.21.15.37:0/2760054943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562e513f63a0 0x562e51405b90 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.463+0000 7f0ae8c00640 0 client.17949 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:15.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.463+0000 7f0b08e82740 1 --2- 172.21.15.37:0/2760054943 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x562e513f5a80 0x562e5140a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.463+0000 7f0b08e82740 1 -- 172.21.15.37:0/2760054943 >> 172.21.15.37:0/2760054943 conn(0x562e513f38b0 msgr2=0x562e513f2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:15.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.463+0000 7f0b08e82740 1 -- 172.21.15.37:0/2760054943 shutdown_connections 2024-08-20T05:15:15.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.463+0000 7f0b08e82740 1 -- 172.21.15.37:0/2760054943 wait complete. 2024-08-20T05:15:15.468 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:15:15.468 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-20T05:15:15.468 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-08-20T05:15:15.469 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:15:15.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.464+0000 7f0b08e82740 20 client.17949 trim_cache size 0 max 16384 2024-08-20T05:15:15.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.464+0000 7f0b04c00640 1 -- 172.21.15.37:0/1661515117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0ae40b3cf0 msgr2=0x7f0ae40b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:15.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.464+0000 7f0b04c00640 1 --2- 172.21.15.37:0/1661515117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0ae40b3cf0 0x7f0ae40b61b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0af0000c00 tx=0x7f0af010a0e0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.464+0000 7f0b04c00640 1 -- 172.21.15.37:0/1661515117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b00102920 msgr2=0x7f0b0019af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:15.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.464+0000 7f0b04c00640 1 --2- 172.21.15.37:0/1661515117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b00102920 0x7f0b0019af30 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0af0005ab0 tx=0x7f0af0003c10 comp rx=0 tx=0).stop 2024-08-20T05:15:15.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.465+0000 7f0b04c00640 1 -- 172.21.15.37:0/1661515117 shutdown_connections 2024-08-20T05:15:15.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.465+0000 7f0b04c00640 1 --2- 172.21.15.37:0/1661515117 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0ae40b3cf0 0x7f0ae40b61b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.465+0000 7f0b04c00640 1 --2- 172.21.15.37:0/1661515117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b00108cb0 0x7f0b001a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.465+0000 7f0b04c00640 1 --2- 172.21.15.37:0/1661515117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b00108330 0x7f0b0019b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.465+0000 7f0b04c00640 1 --2- 172.21.15.37:0/1661515117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b00102920 0x7f0b0019af30 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:15.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.465+0000 7f0b04c00640 1 -- 172.21.15.37:0/1661515117 >> 172.21.15.37:0/1661515117 conn(0x7f0b000fe350 msgr2=0x7f0b001048e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:15.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.465+0000 7f0b04c00640 1 -- 172.21.15.37:0/1661515117 shutdown_connections 2024-08-20T05:15:15.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:15.465+0000 7f0b04c00640 1 -- 172.21.15.37:0/1661515117 wait complete. 2024-08-20T05:15:15.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:15 smithi037 ceph-mon[17265]: pgmap v791: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 2.9 MiB/s wr, 282 op/s 2024-08-20T05:15:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:15 smithi135 ceph-mon[22342]: pgmap v791: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 2.9 MiB/s wr, 282 op/s 2024-08-20T05:15:15.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:15 smithi130 ceph-mon[22007]: pgmap v791: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 2.9 MiB/s wr, 282 op/s 2024-08-20T05:15:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.395+0000 7fb50e800640 1 -- 172.21.15.37:0/3669772537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5081059e0 msgr2=0x7fb508105e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.395+0000 7fb50e800640 1 --2- 172.21.15.37:0/3669772537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5081059e0 0x7fb508105e60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4009930 tx=0x7fb4f402a440 comp rx=0 tx=0).stop 2024-08-20T05:15:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.396+0000 7fb50e800640 1 -- 172.21.15.37:0/3669772537 shutdown_connections 2024-08-20T05:15:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.396+0000 7fb50e800640 1 --2- 172.21.15.37:0/3669772537 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5081063a0 0x7fb50810cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.396+0000 7fb50e800640 1 --2- 172.21.15.37:0/3669772537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5081059e0 0x7fb508105e60 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.396+0000 7fb50e800640 1 --2- 172.21.15.37:0/3669772537 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb508104890 0x7fb508104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.396+0000 7fb50e800640 1 -- 172.21.15.37:0/3669772537 >> 172.21.15.37:0/3669772537 conn(0x7fb508100130 msgr2=0x7fb508102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.396+0000 7fb50e800640 1 -- 172.21.15.37:0/3669772537 shutdown_connections 2024-08-20T05:15:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.396+0000 7fb50e800640 1 -- 172.21.15.37:0/3669772537 wait complete. 2024-08-20T05:15:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.396+0000 7fb50e800640 1 Processor -- start 2024-08-20T05:15:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.397+0000 7fb50e800640 1 -- start start 2024-08-20T05:15:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.397+0000 7fb50e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb508104890 0x7fb50819acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.397+0000 7fb50e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5081059e0 0x7fb50819b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.397+0000 7fb50e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5081063a0 0x7fb50819bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.397+0000 7fb50e800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb508110550 con 0x7fb508104890 2024-08-20T05:15:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.397+0000 7fb50e800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5081103d0 con 0x7fb5081063a0 2024-08-20T05:15:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.397+0000 7fb50e800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5081106d0 con 0x7fb5081059e0 2024-08-20T05:15:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.397+0000 7fb507400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb508104890 0x7fb50819acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.397+0000 7fb507400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb508104890 0x7fb50819acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56246/0 (socket says 172.21.15.37:56246) 2024-08-20T05:15:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.397+0000 7fb507400640 1 -- 172.21.15.37:0/4016300892 learned_addr learned my addr 172.21.15.37:0/4016300892 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.397+0000 7fb507e00640 1 --2- 172.21.15.37:0/4016300892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5081063a0 0x7fb50819bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.397+0000 7fb506a00640 1 --2- 172.21.15.37:0/4016300892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5081059e0 0x7fb50819b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.398+0000 7fb507400640 1 -- 172.21.15.37:0/4016300892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5081059e0 msgr2=0x7fb50819b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.398+0000 7fb507400640 1 --2- 172.21.15.37:0/4016300892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5081059e0 0x7fb50819b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.398+0000 7fb507400640 1 -- 172.21.15.37:0/4016300892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5081063a0 msgr2=0x7fb50819bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.398+0000 7fb507400640 1 --2- 172.21.15.37:0/4016300892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5081063a0 0x7fb50819bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.398+0000 7fb507400640 1 -- 172.21.15.37:0/4016300892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb50819c7f0 con 0x7fb508104890 2024-08-20T05:15:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.398+0000 7fb507400640 1 --2- 172.21.15.37:0/4016300892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb508104890 0x7fb50819acb0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800e9f0 tx=0x7fb4f800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.398+0000 7fb4ffe00640 1 -- 172.21.15.37:0/4016300892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f800ccc0 con 0x7fb508104890 2024-08-20T05:15:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.398+0000 7fb4ffe00640 1 -- 172.21.15.37:0/4016300892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4f800ce60 con 0x7fb508104890 2024-08-20T05:15:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.398+0000 7fb50e800640 1 -- 172.21.15.37:0/4016300892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb50819cae0 con 0x7fb508104890 2024-08-20T05:15:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.398+0000 7fb4ffe00640 1 -- 172.21.15.37:0/4016300892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8010430 con 0x7fb508104890 2024-08-20T05:15:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.398+0000 7fb50e800640 1 -- 172.21.15.37:0/4016300892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5081a31b0 con 0x7fb508104890 2024-08-20T05:15:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.401+0000 7fb511862740 1 Processor -- start 2024-08-20T05:15:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.401+0000 7fb511862740 1 -- start start 2024-08-20T05:15:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.402+0000 7fb511862740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4ec610 0x55984a4eea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.402+0000 7fb511862740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4eef40 0x55984a4f1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.402+0000 7fb4ffe00640 1 -- 172.21.15.37:0/4016300892 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb4f80046c0 con 0x7fb508104890 2024-08-20T05:15:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.402+0000 7fb511862740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4f1980 0x55984a4f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.402+0000 7fb511862740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55984a45f210 con 0x55984a4ec610 2024-08-20T05:15:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.402+0000 7fb511862740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55984a44e710 con 0x55984a4f1980 2024-08-20T05:15:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.402+0000 7fb511862740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55984a452750 con 0x55984a4eef40 2024-08-20T05:15:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.402+0000 7fb507e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4ec610 0x55984a4eea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.402+0000 7fb507e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4ec610 0x55984a4eea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56262/0 (socket says 172.21.15.37:56262) 2024-08-20T05:15:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.402+0000 7fb507e00640 1 -- 172.21.15.37:0/2793925584 learned_addr learned my addr 172.21.15.37:0/2793925584 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.402+0000 7fb507400640 1 --2- 172.21.15.37:0/2793925584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4eef40 0x55984a4f1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.402+0000 7fb506a00640 1 --2- 172.21.15.37:0/2793925584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4f1980 0x55984a4f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.402+0000 7fb507e00640 1 -- 172.21.15.37:0/2793925584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4eef40 msgr2=0x55984a4f1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.402+0000 7fb507e00640 1 --2- 172.21.15.37:0/2793925584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4eef40 0x55984a4f1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.402+0000 7fb507e00640 1 -- 172.21.15.37:0/2793925584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4f1980 msgr2=0x55984a4f3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.402+0000 7fb507e00640 1 --2- 172.21.15.37:0/2793925584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4f1980 0x55984a4f3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.403+0000 7fb507e00640 1 -- 172.21.15.37:0/2793925584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55984a41ade0 con 0x55984a4ec610 2024-08-20T05:15:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.403+0000 7fb507e00640 1 --2- 172.21.15.37:0/2793925584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4ec610 0x55984a4eea00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb500009fa0 tx=0x7fb5000118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2322bd066ec55d12 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.403+0000 7fb4fcc00640 1 -- 172.21.15.37:0/2793925584 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500004d20 con 0x55984a4ec610 2024-08-20T05:15:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.403+0000 7fb4fcc00640 1 -- 172.21.15.37:0/2793925584 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb500004050 con 0x55984a4ec610 2024-08-20T05:15:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.403+0000 7fb4fcc00640 1 -- 172.21.15.37:0/2793925584 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500005280 con 0x55984a4ec610 2024-08-20T05:15:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.404+0000 7fb4ffe00640 1 --2- 172.21.15.37:0/4016300892 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4ec0b3c50 0x7fb4ec0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.404+0000 7fb511862740 1 -- 172.21.15.37:0/2793925584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4ec610 msgr2=0x55984a4eea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.404+0000 7fb511862740 1 --2- 172.21.15.37:0/2793925584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4ec610 0x55984a4eea00 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb500009fa0 tx=0x7fb5000118d0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.404+0000 7fb4ffe00640 1 -- 172.21.15.37:0/4016300892 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb4f80e43c0 con 0x7fb508104890 2024-08-20T05:15:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.404+0000 7fb511862740 1 -- 172.21.15.37:0/2793925584 shutdown_connections 2024-08-20T05:15:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.404+0000 7fb511862740 1 --2- 172.21.15.37:0/2793925584 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4f1980 0x55984a4f3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.404+0000 7fb511862740 1 --2- 172.21.15.37:0/2793925584 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4eef40 0x55984a4f1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.404+0000 7fb511862740 1 --2- 172.21.15.37:0/2793925584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4ec610 0x55984a4eea00 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.404+0000 7fb511862740 1 -- 172.21.15.37:0/2793925584 >> 172.21.15.37:0/2793925584 conn(0x55984a4e7760 msgr2=0x55984a4e84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.404+0000 7fb507400640 1 --2- 172.21.15.37:0/4016300892 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4ec0b3c50 0x7fb4ec0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.404+0000 7fb511862740 1 -- 172.21.15.37:0/2793925584 shutdown_connections 2024-08-20T05:15:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.404+0000 7fb511862740 1 -- 172.21.15.37:0/2793925584 wait complete. 2024-08-20T05:15:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.405+0000 7fb507400640 1 --2- 172.21.15.37:0/4016300892 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4ec0b3c50 0x7fb4ec0b6110 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80aaea0 tx=0x7fb4f80e7e00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.405+0000 7fb511862740 1 -- start start 2024-08-20T05:15:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.405+0000 7fb511862740 1 Processor -- start 2024-08-20T05:15:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.405+0000 7fb511862740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4ec610 0x55984a4f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.405+0000 7fb511862740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4eef40 0x55984a4f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.405+0000 7fb511862740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4f1980 0x55984a4f6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.405+0000 7fb511862740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55984a387ab0 con 0x55984a4ec610 2024-08-20T05:15:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.405+0000 7fb511862740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55984a3f5140 con 0x55984a4f1980 2024-08-20T05:15:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.405+0000 7fb511862740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55984a4f4960 con 0x55984a4eef40 2024-08-20T05:15:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.405+0000 7fb511862740 10 client.0 _ll_register_callbacks cb 0x55984a4085d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.406+0000 7fb507e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4ec610 0x55984a4f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.406+0000 7fb507e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4ec610 0x55984a4f5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56276/0 (socket says 172.21.15.37:56276) 2024-08-20T05:15:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.406+0000 7fb507e00640 1 -- 172.21.15.37:0/1092622206 learned_addr learned my addr 172.21.15.37:0/1092622206 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.406+0000 7fb506a00640 1 --2- 172.21.15.37:0/1092622206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4eef40 0x55984a4f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.406+0000 7fb507e00640 1 --2- 172.21.15.37:0/1092622206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4f1980 0x55984a4f6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.406+0000 7fb507e00640 1 -- 172.21.15.37:0/1092622206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4eef40 msgr2=0x55984a4f63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.406+0000 7fb507e00640 1 --2- 172.21.15.37:0/1092622206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4eef40 0x55984a4f63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.406+0000 7fb507e00640 1 -- 172.21.15.37:0/1092622206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4f1980 msgr2=0x55984a4f6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.406+0000 7fb507e00640 1 --2- 172.21.15.37:0/1092622206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4f1980 0x55984a4f6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.406+0000 7fb507e00640 1 -- 172.21.15.37:0/1092622206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55984a3f6170 con 0x55984a4ec610 2024-08-20T05:15:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.406+0000 7fb507e00640 1 --2- 172.21.15.37:0/1092622206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4ec610 0x55984a4f5d50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb500009ac0 tx=0x7fb5000047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f71e80060a94ab server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.406+0000 7fb4f1600640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:15:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.407+0000 7fb4f1600640 1 -- 172.21.15.37:0/1092622206 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50002d060 con 0x55984a4ec610 2024-08-20T05:15:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.407+0000 7fb511862740 1 -- 172.21.15.37:0/1092622206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb500004050 con 0x55984a4ec610 2024-08-20T05:15:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.407+0000 7fb4f1600640 1 -- 172.21.15.37:0/1092622206 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb500003c40 con 0x55984a4ec610 2024-08-20T05:15:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.407+0000 7fb4f1600640 1 -- 172.21.15.37:0/1092622206 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb500034050 con 0x55984a4ec610 2024-08-20T05:15:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.407+0000 7fb511862740 10 client.17961 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.407+0000 7fb511862740 1 -- 172.21.15.37:0/1092622206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55984a1b1790 con 0x55984a4ec610 2024-08-20T05:15:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.407+0000 7fb4f1600640 1 -- 172.21.15.37:0/1092622206 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb500004050 con 0x55984a4ec610 2024-08-20T05:15:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.407+0000 7fb4f1600640 1 -- 172.21.15.37:0/1092622206 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7fb50000f4e0 con 0x55984a4ec610 2024-08-20T05:15:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.407+0000 7fb511862740 10 client.17961 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.407+0000 7fb511862740 10 client.17961 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.407+0000 7fb511862740 20 client.17961 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.407+0000 7fb511862740 1 --2- 172.21.15.37:0/1092622206 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55984a501690 0x55984a503af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.407+0000 7fb511862740 4 client.17961 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:15:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.407+0000 7fb511862740 1 -- 172.21.15.37:0/1092622206 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55984a461160 con 0x55984a501690 2024-08-20T05:15:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.408+0000 7fb506a00640 1 --2- 172.21.15.37:0/1092622206 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55984a501690 0x55984a503af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.408+0000 7fb506a00640 1 --2- 172.21.15.37:0/1092622206 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55984a501690 0x55984a503af0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53832c44c3937735 server_cookie=abea8a8cb6b4afa5 in_seq=0 out_seq=0 2024-08-20T05:15:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.408+0000 7fb4f1600640 10 client.17961 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.409+0000 7fb4f1600640 1 -- 172.21.15.37:0/1092622206 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55984a461160 con 0x55984a501690 2024-08-20T05:15:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.409+0000 7fb4f1600640 10 client.17961 handle_command_reply: tid=0 2024-08-20T05:15:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.409+0000 7fb511862740 1 client.17961 shutdown 2024-08-20T05:15:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.409+0000 7fb511862740 1 -- 172.21.15.37:0/1092622206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4ec610 msgr2=0x55984a4f5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.409+0000 7fb511862740 1 --2- 172.21.15.37:0/1092622206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4ec610 0x55984a4f5d50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb500009ac0 tx=0x7fb5000047d0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.409+0000 7fb511862740 1 -- 172.21.15.37:0/1092622206 shutdown_connections 2024-08-20T05:15:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.409+0000 7fb511862740 1 --2- 172.21.15.37:0/1092622206 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55984a501690 0x55984a503af0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.409+0000 7fb511862740 1 --2- 172.21.15.37:0/1092622206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4f1980 0x55984a4f6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.409+0000 7fb511862740 1 --2- 172.21.15.37:0/1092622206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4eef40 0x55984a4f63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.409+0000 7fb4f1600640 0 client.17961 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.409+0000 7fb511862740 1 --2- 172.21.15.37:0/1092622206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4ec610 0x55984a4f5d50 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.409+0000 7fb511862740 1 -- 172.21.15.37:0/1092622206 >> 172.21.15.37:0/1092622206 conn(0x55984a4e7760 msgr2=0x55984a4e6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.410+0000 7fb511862740 1 -- 172.21.15.37:0/1092622206 shutdown_connections 2024-08-20T05:15:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.410+0000 7fb511862740 1 -- 172.21.15.37:0/1092622206 wait complete. 2024-08-20T05:15:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.410+0000 7fb511862740 20 client.17961 trim_cache size 0 max 16384 2024-08-20T05:15:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.425+0000 7fb511862740 1 Processor -- start 2024-08-20T05:15:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.425+0000 7fb511862740 1 -- start start 2024-08-20T05:15:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.426+0000 7fb511862740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4ec610 0x55984a4f2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.426+0000 7fb511862740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4eef40 0x55984a4e5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.426+0000 7fb511862740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4f1980 0x55984a4e6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.426+0000 7fb511862740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5081ad560 con 0x55984a4f1980 2024-08-20T05:15:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.426+0000 7fb511862740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5081af0a0 con 0x55984a4eef40 2024-08-20T05:15:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.426+0000 7fb511862740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5081adc30 con 0x55984a4ec610 2024-08-20T05:15:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.426+0000 7fb507e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4ec610 0x55984a4f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.426+0000 7fb507e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4f1980 0x55984a4e6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.426+0000 7fb507e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4ec610 0x55984a4f2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:59902/0 (socket says 172.21.15.37:59902) 2024-08-20T05:15:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.426+0000 7fb507e00640 1 -- 172.21.15.37:0/3153463850 learned_addr learned my addr 172.21.15.37:0/3153463850 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.426+0000 7fb506a00640 1 --2- 172.21.15.37:0/3153463850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4eef40 0x55984a4e5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.426+0000 7fb507e00640 1 -- 172.21.15.37:0/3153463850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4eef40 msgr2=0x55984a4e5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.426+0000 7fb507e00640 1 --2- 172.21.15.37:0/3153463850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4eef40 0x55984a4e5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.426+0000 7fb507e00640 1 -- 172.21.15.37:0/3153463850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4f1980 msgr2=0x55984a4e6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.427+0000 7fb507e00640 1 --2- 172.21.15.37:0/3153463850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4f1980 0x55984a4e6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.427+0000 7fb507e00640 1 -- 172.21.15.37:0/3153463850 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55984a22a620 con 0x55984a4ec610 2024-08-20T05:15:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.427+0000 7fb507e00640 1 --2- 172.21.15.37:0/3153463850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4ec610 0x55984a4f2470 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb500010010 tx=0x7fb5000021f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4295d77b6c958573 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.427+0000 7fb4f3e00640 1 -- 172.21.15.37:0/3153463850 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50002d070 con 0x55984a4ec610 2024-08-20T05:15:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.427+0000 7fb4f3e00640 1 -- 172.21.15.37:0/3153463850 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5000040f0 con 0x55984a4ec610 2024-08-20T05:15:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.427+0000 7fb4f3e00640 1 -- 172.21.15.37:0/3153463850 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50001d030 con 0x55984a4ec610 2024-08-20T05:15:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.428+0000 7fb511862740 1 -- 172.21.15.37:0/3153463850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4ec610 msgr2=0x55984a4f2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.428+0000 7fb511862740 1 --2- 172.21.15.37:0/3153463850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4ec610 0x55984a4f2470 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb500010010 tx=0x7fb5000021f0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.428+0000 7fb511862740 1 -- 172.21.15.37:0/3153463850 shutdown_connections 2024-08-20T05:15:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.428+0000 7fb511862740 1 --2- 172.21.15.37:0/3153463850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4f1980 0x55984a4e6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.428+0000 7fb511862740 1 --2- 172.21.15.37:0/3153463850 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4eef40 0x55984a4e5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.428+0000 7fb511862740 1 --2- 172.21.15.37:0/3153463850 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4ec610 0x55984a4f2470 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.428+0000 7fb511862740 1 -- 172.21.15.37:0/3153463850 >> 172.21.15.37:0/3153463850 conn(0x55984a4e7760 msgr2=0x55984a4f1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.428+0000 7fb511862740 1 -- 172.21.15.37:0/3153463850 shutdown_connections 2024-08-20T05:15:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.428+0000 7fb511862740 1 -- 172.21.15.37:0/3153463850 wait complete. 2024-08-20T05:15:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.428+0000 7fb511862740 1 -- start start 2024-08-20T05:15:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.428+0000 7fb511862740 1 Processor -- start 2024-08-20T05:15:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.429+0000 7fb511862740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4ec610 0x55984a4fa930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.429+0000 7fb511862740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4eef40 0x55984a4fafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.429+0000 7fb511862740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4f1980 0x55984a4fb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.429+0000 7fb511862740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb5081ae9d0 con 0x55984a4f1980 2024-08-20T05:15:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.429+0000 7fb511862740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb5081ae300 con 0x55984a4eef40 2024-08-20T05:15:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.429+0000 7fb511862740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb5081ab540 con 0x55984a4ec610 2024-08-20T05:15:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.429+0000 7fb511862740 10 client.0 _ll_register_callbacks cb 0x7fb5000093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.429+0000 7fb507e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4f1980 0x55984a4fb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.429+0000 7fb507e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4ec610 0x55984a4fa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.429+0000 7fb507e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4ec610 0x55984a4fa930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:59908/0 (socket says 172.21.15.37:59908) 2024-08-20T05:15:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.429+0000 7fb507e00640 1 -- 172.21.15.37:0/4028696505 learned_addr learned my addr 172.21.15.37:0/4028696505 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.429+0000 7fb506a00640 1 --2- 172.21.15.37:0/4028696505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4eef40 0x55984a4fafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.430+0000 7fb507e00640 1 -- 172.21.15.37:0/4028696505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4eef40 msgr2=0x55984a4fafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.430+0000 7fb507e00640 1 --2- 172.21.15.37:0/4028696505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4eef40 0x55984a4fafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.430+0000 7fb507e00640 1 -- 172.21.15.37:0/4028696505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4f1980 msgr2=0x55984a4fb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.430+0000 7fb507e00640 1 --2- 172.21.15.37:0/4028696505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4f1980 0x55984a4fb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.430+0000 7fb507e00640 1 -- 172.21.15.37:0/4028696505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55984a4fc130 con 0x55984a4ec610 2024-08-20T05:15:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.430+0000 7fb507e00640 1 --2- 172.21.15.37:0/4028696505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4ec610 0x55984a4fa930 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb500004770 tx=0x7fb5000048d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26a9868aecdab023 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.430+0000 7fb4f1600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:15:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.430+0000 7fb4f1600640 1 -- 172.21.15.37:0/4028696505 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50001d040 con 0x55984a4ec610 2024-08-20T05:15:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.430+0000 7fb511862740 1 -- 172.21.15.37:0/4028696505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5000040f0 con 0x55984a4ec610 2024-08-20T05:15:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.430+0000 7fb4f1600640 1 -- 172.21.15.37:0/4028696505 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb500003e50 con 0x55984a4ec610 2024-08-20T05:15:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.430+0000 7fb4f1600640 1 -- 172.21.15.37:0/4028696505 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb50002d040 con 0x55984a4ec610 2024-08-20T05:15:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.430+0000 7fb511862740 10 client.28627 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.430+0000 7fb511862740 1 -- 172.21.15.37:0/4028696505 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55984a4fd4a0 con 0x55984a4ec610 2024-08-20T05:15:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.430+0000 7fb4f1600640 1 -- 172.21.15.37:0/4028696505 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5000040f0 con 0x55984a4ec610 2024-08-20T05:15:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.431+0000 7fb4f1600640 1 -- 172.21.15.37:0/4028696505 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7fb500044040 con 0x55984a4ec610 2024-08-20T05:15:16.436 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.431+0000 7fb511862740 10 client.28627 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.431+0000 7fb511862740 10 client.28627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.431+0000 7fb511862740 20 client.28627 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.431+0000 7fb511862740 1 --2- 172.21.15.37:0/4028696505 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55984a4fddc0 0x55984a56e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.431+0000 7fb511862740 4 client.28627 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:15:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.431+0000 7fb511862740 1 -- 172.21.15.37:0/4028696505 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55984a45cc00 con 0x55984a4fddc0 2024-08-20T05:15:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.431+0000 7fb506a00640 1 --2- 172.21.15.37:0/4028696505 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55984a4fddc0 0x55984a56e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.432+0000 7fb506a00640 1 --2- 172.21.15.37:0/4028696505 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55984a4fddc0 0x55984a56e3f0 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca956b2a850b1a13 server_cookie=ce1aa3dc3590557e in_seq=0 out_seq=0 2024-08-20T05:15:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.432+0000 7fb4f1600640 10 client.28627 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.439+0000 7fb4f1600640 1 -- 172.21.15.37:0/4028696505 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55984a45cc00 con 0x55984a4fddc0 2024-08-20T05:15:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.439+0000 7fb4f1600640 10 client.28627 handle_command_reply: tid=0 2024-08-20T05:15:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.439+0000 7fb511862740 1 client.28627 shutdown 2024-08-20T05:15:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.439+0000 7fb511862740 1 -- 172.21.15.37:0/4028696505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4ec610 msgr2=0x55984a4fa930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:16.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.439+0000 7fb511862740 1 --2- 172.21.15.37:0/4028696505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4ec610 0x55984a4fa930 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb500004770 tx=0x7fb5000048d0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.439+0000 7fb511862740 1 -- 172.21.15.37:0/4028696505 shutdown_connections 2024-08-20T05:15:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.439+0000 7fb511862740 1 --2- 172.21.15.37:0/4028696505 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55984a4fddc0 0x55984a56e3f0 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.439+0000 7fb511862740 1 --2- 172.21.15.37:0/4028696505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55984a4f1980 0x55984a4fb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.439+0000 7fb511862740 1 --2- 172.21.15.37:0/4028696505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55984a4eef40 0x55984a4fafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.439+0000 7fb511862740 1 --2- 172.21.15.37:0/4028696505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55984a4ec610 0x55984a4fa930 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.439+0000 7fb511862740 1 -- 172.21.15.37:0/4028696505 >> 172.21.15.37:0/4028696505 conn(0x55984a4e7760 msgr2=0x55984a4f29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.439+0000 7fb4f1600640 0 client.28627 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.439+0000 7fb511862740 1 -- 172.21.15.37:0/4028696505 shutdown_connections 2024-08-20T05:15:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.439+0000 7fb511862740 1 -- 172.21.15.37:0/4028696505 wait complete. 2024-08-20T05:15:16.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.439+0000 7fb511862740 20 client.28627 trim_cache size 0 max 16384 2024-08-20T05:15:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:15:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:15:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:15:16.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:15:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.440+0000 7fb50e800640 1 -- 172.21.15.37:0/4016300892 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4ec0b3c50 msgr2=0x7fb4ec0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.440+0000 7fb50e800640 1 --2- 172.21.15.37:0/4016300892 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4ec0b3c50 0x7fb4ec0b6110 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80aaea0 tx=0x7fb4f80e7e00 comp rx=0 tx=0).stop 2024-08-20T05:15:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.440+0000 7fb50e800640 1 -- 172.21.15.37:0/4016300892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb508104890 msgr2=0x7fb50819acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.440+0000 7fb50e800640 1 --2- 172.21.15.37:0/4016300892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb508104890 0x7fb50819acb0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800e9f0 tx=0x7fb4f800edf0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.440+0000 7fb50e800640 1 -- 172.21.15.37:0/4016300892 shutdown_connections 2024-08-20T05:15:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.440+0000 7fb50e800640 1 --2- 172.21.15.37:0/4016300892 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb4ec0b3c50 0x7fb4ec0b6110 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.440+0000 7fb50e800640 1 --2- 172.21.15.37:0/4016300892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb5081063a0 0x7fb50819bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.440+0000 7fb50e800640 1 --2- 172.21.15.37:0/4016300892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb5081059e0 0x7fb50819b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.440+0000 7fb50e800640 1 --2- 172.21.15.37:0/4016300892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb508104890 0x7fb50819acb0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:16.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.440+0000 7fb50e800640 1 -- 172.21.15.37:0/4016300892 >> 172.21.15.37:0/4016300892 conn(0x7fb508100130 msgr2=0x7fb508108db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.440+0000 7fb50e800640 1 -- 172.21.15.37:0/4016300892 shutdown_connections 2024-08-20T05:15:16.445 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:16.440+0000 7fb50e800640 1 -- 172.21.15.37:0/4016300892 wait complete. 2024-08-20T05:15:16.816 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T05:15:16.816 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:15:16.864 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:15:17.796 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:17 smithi037 ceph-mon[17265]: pgmap v792: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 2.0 MiB/s wr, 185 op/s 2024-08-20T05:15:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.846+0000 7f94e4c00640 1 -- 172.21.15.37:0/1555710962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0077400 msgr2=0x7f94e00777e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.846+0000 7f94e4c00640 1 --2- 172.21.15.37:0/1555710962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0077400 0x7f94e00777e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009900 tx=0x7f94d002a410 comp rx=0 tx=0).stop 2024-08-20T05:15:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.846+0000 7f94e4c00640 1 -- 172.21.15.37:0/1555710962 shutdown_connections 2024-08-20T05:15:17.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.846+0000 7f94e4c00640 1 --2- 172.21.15.37:0/1555710962 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94e01136a0 0x7f94e0115a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.846+0000 7f94e4c00640 1 --2- 172.21.15.37:0/1555710962 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94e0077d20 0x7f94e0113160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.846+0000 7f94e4c00640 1 --2- 172.21.15.37:0/1555710962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e0077400 0x7f94e00777e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.846+0000 7f94e4c00640 1 -- 172.21.15.37:0/1555710962 >> 172.21.15.37:0/1555710962 conn(0x7f94e0100720 msgr2=0x7f94e0102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.846+0000 7f94e4c00640 1 -- 172.21.15.37:0/1555710962 shutdown_connections 2024-08-20T05:15:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.846+0000 7f94e4c00640 1 -- 172.21.15.37:0/1555710962 wait complete. 2024-08-20T05:15:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.847+0000 7f94e4c00640 1 Processor -- start 2024-08-20T05:15:17.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.847+0000 7f94e4c00640 1 -- start start 2024-08-20T05:15:17.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.848+0000 7f94e4c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94e0077400 0x7f94e019f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:17.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.848+0000 7f94e4c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94e0077d20 0x7f94e019faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:17.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.848+0000 7f94e4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e01136a0 0x7f94e01a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:17.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.848+0000 7f94e4c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f94e0119100 con 0x7f94e01136a0 2024-08-20T05:15:17.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.848+0000 7f94e4c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f94e0118f80 con 0x7f94e0077400 2024-08-20T05:15:17.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.848+0000 7f94e4c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f94e0119280 con 0x7f94e0077d20 2024-08-20T05:15:17.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.848+0000 7f94de800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e01136a0 0x7f94e01a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:17.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.848+0000 7f94dde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94e0077400 0x7f94e019f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:17.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.848+0000 7f94de800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e01136a0 0x7f94e01a4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56312/0 (socket says 172.21.15.37:56312) 2024-08-20T05:15:17.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.848+0000 7f94de800640 1 -- 172.21.15.37:0/275526181 learned_addr learned my addr 172.21.15.37:0/275526181 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:17.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.848+0000 7f94dd400640 1 --2- 172.21.15.37:0/275526181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94e0077d20 0x7f94e019faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:17.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.849+0000 7f94dde00640 1 -- 172.21.15.37:0/275526181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94e0077d20 msgr2=0x7f94e019faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:17.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.849+0000 7f94dde00640 1 --2- 172.21.15.37:0/275526181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94e0077d20 0x7f94e019faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:17.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.849+0000 7f94dde00640 1 -- 172.21.15.37:0/275526181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e01136a0 msgr2=0x7f94e01a4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:17.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.849+0000 7f94dde00640 1 --2- 172.21.15.37:0/275526181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e01136a0 0x7f94e01a4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:17.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.849+0000 7f94dde00640 1 -- 172.21.15.37:0/275526181 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e01a5660 con 0x7f94e0077400 2024-08-20T05:15:17.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.849+0000 7f94de800640 1 --2- 172.21.15.37:0/275526181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e01136a0 0x7f94e01a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:15:17.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.849+0000 7f94dde00640 1 --2- 172.21.15.37:0/275526181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94e0077400 0x7f94e019f5b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f94d002aa00 tx=0x7f94d0003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.850+0000 7f94d6a00640 1 -- 172.21.15.37:0/275526181 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d003f070 con 0x7f94e0077400 2024-08-20T05:15:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.850+0000 7f94d6a00640 1 -- 172.21.15.37:0/275526181 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94d0031b50 con 0x7f94e0077400 2024-08-20T05:15:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.850+0000 7f94d6a00640 1 -- 172.21.15.37:0/275526181 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d0035030 con 0x7f94e0077400 2024-08-20T05:15:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.850+0000 7f94e4c00640 1 -- 172.21.15.37:0/275526181 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e01a58f0 con 0x7f94e0077400 2024-08-20T05:15:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.850+0000 7f94e4c00640 1 -- 172.21.15.37:0/275526181 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e01ac010 con 0x7f94e0077400 2024-08-20T05:15:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.851+0000 7f94e4c00640 1 -- 172.21.15.37:0/275526181 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e00777e0 con 0x7f94e0077400 2024-08-20T05:15:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.855+0000 7f94d6a00640 1 -- 172.21.15.37:0/275526181 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f94d0042070 con 0x7f94e0077400 2024-08-20T05:15:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.858+0000 7f94d6a00640 1 --2- 172.21.15.37:0/275526181 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f94c40b3c50 0x7f94c40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.858+0000 7f94d6a00640 1 -- 172.21.15.37:0/275526181 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f94d01046e0 con 0x7f94e0077400 2024-08-20T05:15:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.858+0000 7f94dd400640 1 --2- 172.21.15.37:0/275526181 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f94c40b3c50 0x7f94c40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.858+0000 7f94d6a00640 1 -- 172.21.15.37:0/275526181 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f94d0104b40 con 0x7f94e0077400 2024-08-20T05:15:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:17.859+0000 7f94dd400640 1 --2- 172.21.15.37:0/275526181 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f94c40b3c50 0x7f94c40b6110 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f94e007a020 tx=0x7f94cc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:17.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:17 smithi135 ceph-mon[22342]: pgmap v792: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 2.0 MiB/s wr, 185 op/s 2024-08-20T05:15:17.901 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:15:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:17 smithi130 ceph-mon[22007]: pgmap v792: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 2.0 MiB/s wr, 185 op/s 2024-08-20T05:15:18.045 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:15:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.110+0000 7f94e4c00640 1 -- 172.21.15.37:0/275526181 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94e01ac2f0 con 0x7f94e0077400 2024-08-20T05:15:18.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.111+0000 7f94d6a00640 1 -- 172.21.15.37:0/275526181 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+11980 (secure 0 0 0) 0x7f94d00cb2e0 con 0x7f94e0077400 2024-08-20T05:15:18.113 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:15:18.113 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":48,"btime":"2024-08-20T05:13:44:512025+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":48,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:13:43.851787+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:15:18.114 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 48 2024-08-20T05:15:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.113+0000 7f94e4c00640 1 -- 172.21.15.37:0/275526181 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f94c40b3c50 msgr2=0x7f94c40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:18.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.113+0000 7f94e4c00640 1 --2- 172.21.15.37:0/275526181 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f94c40b3c50 0x7f94c40b6110 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f94e007a020 tx=0x7f94cc005f90 comp rx=0 tx=0).stop 2024-08-20T05:15:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.113+0000 7f94e4c00640 1 -- 172.21.15.37:0/275526181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94e0077400 msgr2=0x7f94e019f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.113+0000 7f94e4c00640 1 --2- 172.21.15.37:0/275526181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94e0077400 0x7f94e019f5b0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f94d002aa00 tx=0x7f94d0003b90 comp rx=0 tx=0).stop 2024-08-20T05:15:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.113+0000 7f94e4c00640 1 -- 172.21.15.37:0/275526181 shutdown_connections 2024-08-20T05:15:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.113+0000 7f94e4c00640 1 --2- 172.21.15.37:0/275526181 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f94c40b3c50 0x7f94c40b6110 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.113+0000 7f94e4c00640 1 --2- 172.21.15.37:0/275526181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94e01136a0 0x7f94e01a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.113+0000 7f94e4c00640 1 --2- 172.21.15.37:0/275526181 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f94e0077d20 0x7f94e019faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.113+0000 7f94e4c00640 1 --2- 172.21.15.37:0/275526181 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f94e0077400 0x7f94e019f5b0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.113+0000 7f94e4c00640 1 -- 172.21.15.37:0/275526181 >> 172.21.15.37:0/275526181 conn(0x7f94e0100720 msgr2=0x7f94e0102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.114+0000 7f94e4c00640 1 -- 172.21.15.37:0/275526181 shutdown_connections 2024-08-20T05:15:18.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.114+0000 7f94e4c00640 1 -- 172.21.15.37:0/275526181 wait complete. 2024-08-20T05:15:18.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:18 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/275526181' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:15:18.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:18 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/275526181' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:15:18.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:18 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/275526181' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:15:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.922+0000 7f1dc1c00640 1 -- 172.21.15.37:0/1089950273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dbc102ab0 msgr2=0x7f1dbc102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.922+0000 7f1dc1c00640 1 --2- 172.21.15.37:0/1089950273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dbc102ab0 0x7f1dbc102e90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009900 tx=0x7f1dac02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:15:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.922+0000 7f1dc1c00640 1 -- 172.21.15.37:0/1089950273 shutdown_connections 2024-08-20T05:15:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.922+0000 7f1dc1c00640 1 --2- 172.21.15.37:0/1089950273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dbc108e40 0x7f1dbc10f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.922+0000 7f1dc1c00640 1 --2- 172.21.15.37:0/1089950273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1dbc1084c0 0x7f1dbc108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.922+0000 7f1dc1c00640 1 --2- 172.21.15.37:0/1089950273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dbc102ab0 0x7f1dbc102e90 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.922+0000 7f1dc1c00640 1 -- 172.21.15.37:0/1089950273 >> 172.21.15.37:0/1089950273 conn(0x7f1dbc0fe500 msgr2=0x7f1dbc100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:18.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.922+0000 7f1dc1c00640 1 -- 172.21.15.37:0/1089950273 shutdown_connections 2024-08-20T05:15:18.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.922+0000 7f1dc1c00640 1 -- 172.21.15.37:0/1089950273 wait complete. 2024-08-20T05:15:18.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.923+0000 7f1dc1c00640 1 Processor -- start 2024-08-20T05:15:18.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.923+0000 7f1dc1c00640 1 -- start start 2024-08-20T05:15:18.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.923+0000 7f1dc1c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1dbc102ab0 0x7f1dbc19b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:18.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.923+0000 7f1dc1c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dbc1084c0 0x7f1dbc19b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:18.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.924+0000 7f1dc1c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dbc108e40 0x7f1dbc1a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:18.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.924+0000 7f1dc1c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc112b10 con 0x7f1dbc1084c0 2024-08-20T05:15:18.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.924+0000 7f1dc1c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc112990 con 0x7f1dbc102ab0 2024-08-20T05:15:18.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.924+0000 7f1dc1c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc112c90 con 0x7f1dbc108e40 2024-08-20T05:15:18.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.924+0000 7f1dba000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dbc1084c0 0x7f1dbc19b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:18.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.924+0000 7f1dba000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dbc1084c0 0x7f1dbc19b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56342/0 (socket says 172.21.15.37:56342) 2024-08-20T05:15:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.924+0000 7f1dba000640 1 -- 172.21.15.37:0/1493615219 learned_addr learned my addr 172.21.15.37:0/1493615219 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.924+0000 7f1dbaa00640 1 --2- 172.21.15.37:0/1493615219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1dbc102ab0 0x7f1dbc19b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.924+0000 7f1dbb400640 1 --2- 172.21.15.37:0/1493615219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dbc108e40 0x7f1dbc1a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.924+0000 7f1dba000640 1 -- 172.21.15.37:0/1493615219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dbc108e40 msgr2=0x7f1dbc1a0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.924+0000 7f1dba000640 1 --2- 172.21.15.37:0/1493615219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dbc108e40 0x7f1dbc1a0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.924+0000 7f1dba000640 1 -- 172.21.15.37:0/1493615219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1dbc102ab0 msgr2=0x7f1dbc19b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.924+0000 7f1dba000640 1 --2- 172.21.15.37:0/1493615219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1dbc102ab0 0x7f1dbc19b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.924+0000 7f1dba000640 1 -- 172.21.15.37:0/1493615219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dbc1a1250 con 0x7f1dbc1084c0 2024-08-20T05:15:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.924+0000 7f1dbb400640 1 --2- 172.21.15.37:0/1493615219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dbc108e40 0x7f1dbc1a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:15:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.925+0000 7f1dba000640 1 --2- 172.21.15.37:0/1493615219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dbc1084c0 0x7f1dbc19b6e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1da800ea60 tx=0x7f1da800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.925+0000 7f1db3400640 1 -- 172.21.15.37:0/1493615219 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da800cde0 con 0x7f1dbc1084c0 2024-08-20T05:15:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.925+0000 7f1db3400640 1 -- 172.21.15.37:0/1493615219 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1da80035f0 con 0x7f1dbc1084c0 2024-08-20T05:15:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.925+0000 7f1dc1c00640 1 -- 172.21.15.37:0/1493615219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dbc1a1540 con 0x7f1dbc1084c0 2024-08-20T05:15:18.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.925+0000 7f1db3400640 1 -- 172.21.15.37:0/1493615219 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da8010690 con 0x7f1dbc1084c0 2024-08-20T05:15:18.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.925+0000 7f1dc1c00640 1 -- 172.21.15.37:0/1493615219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dbc1a7c00 con 0x7f1dbc1084c0 2024-08-20T05:15:18.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.926+0000 7f1dc1c00640 1 -- 172.21.15.37:0/1493615219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dbc102e90 con 0x7f1dbc1084c0 2024-08-20T05:15:18.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.930+0000 7f1db3400640 1 -- 172.21.15.37:0/1493615219 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1da80037a0 con 0x7f1dbc1084c0 2024-08-20T05:15:18.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.931+0000 7f1db3400640 1 --2- 172.21.15.37:0/1493615219 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1da00b3bd0 0x7f1da00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:18.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.931+0000 7f1db3400640 1 -- 172.21.15.37:0/1493615219 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1da80e4360 con 0x7f1dbc1084c0 2024-08-20T05:15:18.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.932+0000 7f1dbaa00640 1 --2- 172.21.15.37:0/1493615219 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1da00b3bd0 0x7f1da00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:18.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.932+0000 7f1dbaa00640 1 --2- 172.21.15.37:0/1493615219 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1da00b3bd0 0x7f1da00b6090 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1dac005ab0 tx=0x7f1dac005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:18.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:18.933+0000 7f1db3400640 1 -- 172.21.15.37:0/1493615219 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f1da80ab5b0 con 0x7f1dbc1084c0 2024-08-20T05:15:19.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:19.171+0000 7f1dc1c00640 1 -- 172.21.15.37:0/1493615219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1dbc19c2d0 con 0x7f1dbc1084c0 2024-08-20T05:15:19.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:19.172+0000 7f1db3400640 1 -- 172.21.15.37:0/1493615219 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+11980 (secure 0 0 0) 0x7f1da80aaeb0 con 0x7f1dbc1084c0 2024-08-20T05:15:19.174 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:15:19.174 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":48,"btime":"2024-08-20T05:13:44:512025+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":48,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:13:43.851787+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:15:19.174 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 48 2024-08-20T05:15:19.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:19.174+0000 7f1dc1c00640 1 -- 172.21.15.37:0/1493615219 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1da00b3bd0 msgr2=0x7f1da00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:19.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:19.174+0000 7f1dc1c00640 1 --2- 172.21.15.37:0/1493615219 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1da00b3bd0 0x7f1da00b6090 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1dac005ab0 tx=0x7f1dac005a20 comp rx=0 tx=0).stop 2024-08-20T05:15:19.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:19.174+0000 7f1dc1c00640 1 -- 172.21.15.37:0/1493615219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dbc1084c0 msgr2=0x7f1dbc19b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:19.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:19.174+0000 7f1dc1c00640 1 --2- 172.21.15.37:0/1493615219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dbc1084c0 0x7f1dbc19b6e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1da800ea60 tx=0x7f1da800ef20 comp rx=0 tx=0).stop 2024-08-20T05:15:19.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:19.174+0000 7f1dc1c00640 1 -- 172.21.15.37:0/1493615219 shutdown_connections 2024-08-20T05:15:19.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:19.174+0000 7f1dc1c00640 1 --2- 172.21.15.37:0/1493615219 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1da00b3bd0 0x7f1da00b6090 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:19.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:19.174+0000 7f1dc1c00640 1 --2- 172.21.15.37:0/1493615219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1dbc108e40 0x7f1dbc1a0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:19.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:19.174+0000 7f1dc1c00640 1 --2- 172.21.15.37:0/1493615219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1dbc1084c0 0x7f1dbc19b6e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:19.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:19.174+0000 7f1dc1c00640 1 --2- 172.21.15.37:0/1493615219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1dbc102ab0 0x7f1dbc19b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:19.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:19.174+0000 7f1dc1c00640 1 -- 172.21.15.37:0/1493615219 >> 172.21.15.37:0/1493615219 conn(0x7f1dbc0fe500 msgr2=0x7f1dbc0758d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:19.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:19.174+0000 7f1dc1c00640 1 -- 172.21.15.37:0/1493615219 shutdown_connections 2024-08-20T05:15:19.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:19.174+0000 7f1dc1c00640 1 -- 172.21.15.37:0/1493615219 wait complete. 2024-08-20T05:15:19.761 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id 9ca7b0fe --release --await' 2024-08-20T05:15:19.762 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id 9ca7b0fe --release --await 2024-08-20T05:15:19.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:19 smithi037 ceph-mon[17265]: pgmap v793: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 895 KiB/s wr, 82 op/s 2024-08-20T05:15:19.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:19 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1493615219' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:15:19.857 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:19 smithi130 ceph-mon[22007]: pgmap v793: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 895 KiB/s wr, 82 op/s 2024-08-20T05:15:19.857 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:19 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1493615219' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:15:19.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:19 smithi135 ceph-mon[22342]: pgmap v793: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 895 KiB/s wr, 82 op/s 2024-08-20T05:15:19.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:19 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1493615219' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:15:20.506 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T05:15:20.610 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:15:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.259+0000 7f2596800640 1 -- 172.21.15.37:0/189838386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f259010a510 msgr2=0x7f259010a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.259+0000 7f2596800640 1 --2- 172.21.15.37:0/189838386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f259010a510 0x7f259010a950 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f257c009900 tx=0x7f257c02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.259+0000 7f2596800640 1 -- 172.21.15.37:0/189838386 shutdown_connections 2024-08-20T05:15:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.259+0000 7f2596800640 1 --2- 172.21.15.37:0/189838386 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f259010ae90 0x7f2590111690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.259+0000 7f2596800640 1 --2- 172.21.15.37:0/189838386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f259010a510 0x7f259010a950 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.259+0000 7f2596800640 1 --2- 172.21.15.37:0/189838386 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2590104b00 0x7f2590104ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.259+0000 7f2596800640 1 -- 172.21.15.37:0/189838386 >> 172.21.15.37:0/189838386 conn(0x7f2590100550 msgr2=0x7f2590102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.259+0000 7f2596800640 1 -- 172.21.15.37:0/189838386 shutdown_connections 2024-08-20T05:15:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.259+0000 7f2596800640 1 -- 172.21.15.37:0/189838386 wait complete. 2024-08-20T05:15:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.260+0000 7f2596800640 1 Processor -- start 2024-08-20T05:15:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.260+0000 7f2596800640 1 -- start start 2024-08-20T05:15:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.260+0000 7f2596800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2590104b00 0x7f259019af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.260+0000 7f2596800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f259010a510 0x7f259019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.260+0000 7f2596800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f259010ae90 0x7f25901a0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.260+0000 7f2596800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2590114ba0 con 0x7f259010ae90 2024-08-20T05:15:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.260+0000 7f2596800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2590114a20 con 0x7f259010a510 2024-08-20T05:15:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.260+0000 7f2596800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2590114d20 con 0x7f2590104b00 2024-08-20T05:15:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.261+0000 7f2595e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f259010ae90 0x7f25901a0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.261+0000 7f2594a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f259010a510 0x7f259019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.261+0000 7f2595400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2590104b00 0x7f259019af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.261+0000 7f2594a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f259010a510 0x7f259019b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:38104/0 (socket says 172.21.15.37:38104) 2024-08-20T05:15:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.261+0000 7f2594a00640 1 -- 172.21.15.37:0/611781912 learned_addr learned my addr 172.21.15.37:0/611781912 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.261+0000 7f2595400640 1 -- 172.21.15.37:0/611781912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f259010a510 msgr2=0x7f259019b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.261+0000 7f2595400640 1 --2- 172.21.15.37:0/611781912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f259010a510 0x7f259019b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.261+0000 7f2595400640 1 -- 172.21.15.37:0/611781912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f259010ae90 msgr2=0x7f25901a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.261+0000 7f2595400640 1 --2- 172.21.15.37:0/611781912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f259010ae90 0x7f25901a0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.261+0000 7f2595400640 1 -- 172.21.15.37:0/611781912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25901a1020 con 0x7f2590104b00 2024-08-20T05:15:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.261+0000 7f2594a00640 1 --2- 172.21.15.37:0/611781912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f259010a510 0x7f259019b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:15:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.261+0000 7f2595e00640 1 --2- 172.21.15.37:0/611781912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f259010ae90 0x7f25901a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:15:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.261+0000 7f2595400640 1 --2- 172.21.15.37:0/611781912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2590104b00 0x7f259019af70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f258400e9f0 tx=0x7f258400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.262+0000 7f258e000640 1 -- 172.21.15.37:0/611781912 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258400ccc0 con 0x7f2590104b00 2024-08-20T05:15:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.262+0000 7f2596800640 1 -- 172.21.15.37:0/611781912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25901a1310 con 0x7f2590104b00 2024-08-20T05:15:21.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.262+0000 7f258e000640 1 -- 172.21.15.37:0/611781912 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25840108e0 con 0x7f2590104b00 2024-08-20T05:15:21.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.262+0000 7f258e000640 1 -- 172.21.15.37:0/611781912 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2584018880 con 0x7f2590104b00 2024-08-20T05:15:21.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.262+0000 7f2596800640 1 -- 172.21.15.37:0/611781912 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25901a7ba0 con 0x7f2590104b00 2024-08-20T05:15:21.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.265+0000 7f259a833740 1 Processor -- start 2024-08-20T05:15:21.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.265+0000 7f259a833740 1 -- start start 2024-08-20T05:15:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.265+0000 7f259a833740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d1274fa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.265+0000 7f259a833740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d1275061f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.265+0000 7f259a833740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d127508b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.265+0000 7f259a833740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d12749b670 con 0x55d1274fa7a0 2024-08-20T05:15:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.265+0000 7f259a833740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d12746fd70 con 0x55d1274f9e80 2024-08-20T05:15:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.265+0000 7f259a833740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d12745f270 con 0x55d127506730 2024-08-20T05:15:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.266+0000 7f2594a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d127508b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.266+0000 7f2595e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d1274fa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.266+0000 7f2594a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d127508b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:59992/0 (socket says 172.21.15.37:59992) 2024-08-20T05:15:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.266+0000 7f2594a00640 1 -- 172.21.15.37:0/2776565107 learned_addr learned my addr 172.21.15.37:0/2776565107 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.266+0000 7f2594a00640 1 -- 172.21.15.37:0/2776565107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 msgr2=0x55d1274fa260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:21.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.266+0000 7f258e000640 1 -- 172.21.15.37:0/611781912 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2584010430 con 0x7f2590104b00 2024-08-20T05:15:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.266+0000 7f2594a00640 1 --2- 172.21.15.37:0/2776565107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d1274fa260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.266+0000 7f2594a00640 1 -- 172.21.15.37:0/2776565107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 msgr2=0x55d1275061f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:15:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.267+0000 7f2595400640 1 --2- 172.21.15.37:0/2776565107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d1275061f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.267+0000 7f2594a00640 1 --2- 172.21.15.37:0/2776565107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d1275061f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.267+0000 7f2594a00640 1 -- 172.21.15.37:0/2776565107 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1273fb870 con 0x55d127506730 2024-08-20T05:15:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.267+0000 7f2595e00640 1 --2- 172.21.15.37:0/2776565107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d1274fa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:15:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.267+0000 7f2595400640 1 --2- 172.21.15.37:0/2776565107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d1275061f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.267+0000 7f2594a00640 1 --2- 172.21.15.37:0/2776565107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d127508b20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f257c02a9e0 tx=0x7f257c0044b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe83be76fc8fca9a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.267+0000 7f2582600640 1 -- 172.21.15.37:0/2776565107 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c040070 con 0x55d127506730 2024-08-20T05:15:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.267+0000 7f2582600640 1 -- 172.21.15.37:0/2776565107 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f257c0047a0 con 0x55d127506730 2024-08-20T05:15:21.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.267+0000 7f2582600640 1 -- 172.21.15.37:0/2776565107 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f257c035040 con 0x55d127506730 2024-08-20T05:15:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.268+0000 7f259a833740 1 -- 172.21.15.37:0/2776565107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 msgr2=0x55d127508b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.268+0000 7f259a833740 1 --2- 172.21.15.37:0/2776565107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d127508b20 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f257c02a9e0 tx=0x7f257c0044b0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.268+0000 7f259a833740 1 -- 172.21.15.37:0/2776565107 shutdown_connections 2024-08-20T05:15:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.268+0000 7f259a833740 1 --2- 172.21.15.37:0/2776565107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d127508b20 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.268+0000 7f259a833740 1 --2- 172.21.15.37:0/2776565107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d1275061f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.268+0000 7f259a833740 1 --2- 172.21.15.37:0/2776565107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d1274fa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.268+0000 7f259a833740 1 -- 172.21.15.37:0/2776565107 >> 172.21.15.37:0/2776565107 conn(0x55d1274f7cb0 msgr2=0x55d1274f8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.268+0000 7f259a833740 1 -- 172.21.15.37:0/2776565107 shutdown_connections 2024-08-20T05:15:21.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.269+0000 7f259a833740 1 -- 172.21.15.37:0/2776565107 wait complete. 2024-08-20T05:15:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.269+0000 7f258e000640 1 --2- 172.21.15.37:0/611781912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f25780b3c00 0x7f25780b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.269+0000 7f259a833740 1 -- start start 2024-08-20T05:15:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.269+0000 7f258e000640 1 -- 172.21.15.37:0/611781912 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f25840e42d0 con 0x7f2590104b00 2024-08-20T05:15:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.269+0000 7f2595e00640 1 --2- 172.21.15.37:0/611781912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f25780b3c00 0x7f25780b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.269+0000 7f259a833740 1 Processor -- start 2024-08-20T05:15:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.270+0000 7f259a833740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d127505ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.270+0000 7f259a833740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d127503340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.270+0000 7f259a833740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d127503880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.270+0000 7f259a833740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d1273e5ff0 con 0x55d1274fa7a0 2024-08-20T05:15:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.270+0000 7f259a833740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d1274632b0 con 0x55d1274f9e80 2024-08-20T05:15:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.270+0000 7f259a833740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d1272c1bb0 con 0x55d127506730 2024-08-20T05:15:21.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.270+0000 7f259a833740 10 client.0 _ll_register_callbacks cb 0x55d12716ad70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.271+0000 7f2595e00640 1 --2- 172.21.15.37:0/611781912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f25780b3c00 0x7f25780b60c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2588009fd0 tx=0x7f2588009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.271+0000 7f2595400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d127505ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.271+0000 7f2595400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d127505ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:38130/0 (socket says 172.21.15.37:38130) 2024-08-20T05:15:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.271+0000 7f2595400640 1 -- 172.21.15.37:0/2154797863 learned_addr learned my addr 172.21.15.37:0/2154797863 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.271+0000 7f2594a00640 1 --2- 172.21.15.37:0/2154797863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d127503340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.271+0000 7f2595e00640 1 --2- 172.21.15.37:0/2154797863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d127503880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.271+0000 7f2595400640 1 -- 172.21.15.37:0/2154797863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 msgr2=0x55d127503880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.271+0000 7f2595400640 1 --2- 172.21.15.37:0/2154797863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d127503880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.271+0000 7f2595400640 1 -- 172.21.15.37:0/2154797863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 msgr2=0x55d127503340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.271+0000 7f2595400640 1 --2- 172.21.15.37:0/2154797863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d127503340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.271+0000 7f2595400640 1 -- 172.21.15.37:0/2154797863 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1271beb00 con 0x55d1274f9e80 2024-08-20T05:15:21.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.271+0000 7f2595e00640 1 --2- 172.21.15.37:0/2154797863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d127503880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:15:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.271+0000 7f2595400640 1 --2- 172.21.15.37:0/2154797863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d127505ef0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f25840a8140 tx=0x7f25840107e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f89e2ce2ceb4f3c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.271+0000 7f2576a00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:15:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.272+0000 7f2576a00640 1 -- 172.21.15.37:0/2154797863 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25840af420 con 0x55d1274f9e80 2024-08-20T05:15:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.272+0000 7f2576a00640 1 -- 172.21.15.37:0/2154797863 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f25840aa130 con 0x55d1274f9e80 2024-08-20T05:15:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.272+0000 7f259a833740 1 -- 172.21.15.37:0/2154797863 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f257c0047a0 con 0x55d1274f9e80 2024-08-20T05:15:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.272+0000 7f2576a00640 1 -- 172.21.15.37:0/2154797863 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f25840b3ed0 con 0x55d1274f9e80 2024-08-20T05:15:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.272+0000 7f259a833740 10 client.28604 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.272+0000 7f259a833740 1 -- 172.21.15.37:0/2154797863 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55d127235960 con 0x55d1274f9e80 2024-08-20T05:15:21.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.272+0000 7f2576a00640 1 -- 172.21.15.37:0/2154797863 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f257c0047a0 con 0x55d1274f9e80 2024-08-20T05:15:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.273+0000 7f2576a00640 1 -- 172.21.15.37:0/2154797863 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f25840b05b0 con 0x55d1274f9e80 2024-08-20T05:15:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.273+0000 7f259a833740 10 client.28604 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.273+0000 7f259a833740 10 client.28604 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:15:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.273+0000 7f259a833740 20 client.28604 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.273+0000 7f259a833740 1 --2- 172.21.15.37:0/2154797863 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d127515d10 0x55d127518150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.273+0000 7f259a833740 4 client.28604 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:15:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.273+0000 7f259a833740 1 -- 172.21.15.37:0/2154797863 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d127471cc0 con 0x55d127515d10 2024-08-20T05:15:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.273+0000 7f2594a00640 1 --2- 172.21.15.37:0/2154797863 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d127515d10 0x55d127518150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.274+0000 7f2594a00640 1 --2- 172.21.15.37:0/2154797863 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d127515d10 0x55d127518150 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8fcf9482cb4dfd server_cookie=48c44001757ee51 in_seq=0 out_seq=0 2024-08-20T05:15:21.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.274+0000 7f2576a00640 10 client.28604 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.274+0000 7f2576a00640 1 -- 172.21.15.37:0/2154797863 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d127471cc0 con 0x55d127515d10 2024-08-20T05:15:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.274+0000 7f2576a00640 10 client.28604 handle_command_reply: tid=0 2024-08-20T05:15:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.274+0000 7f259a833740 1 client.28604 shutdown 2024-08-20T05:15:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.275+0000 7f259a833740 1 -- 172.21.15.37:0/2154797863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 msgr2=0x55d127505ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.275+0000 7f259a833740 1 --2- 172.21.15.37:0/2154797863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d127505ef0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f25840a8140 tx=0x7f25840107e0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.275+0000 7f259a833740 1 -- 172.21.15.37:0/2154797863 shutdown_connections 2024-08-20T05:15:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.275+0000 7f259a833740 1 --2- 172.21.15.37:0/2154797863 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d127515d10 0x55d127518150 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.275+0000 7f259a833740 1 --2- 172.21.15.37:0/2154797863 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d127503880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.275+0000 7f259a833740 1 --2- 172.21.15.37:0/2154797863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d127503340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.275+0000 7f2576a00640 0 client.28604 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.275+0000 7f259a833740 1 --2- 172.21.15.37:0/2154797863 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d127505ef0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.275+0000 7f259a833740 1 -- 172.21.15.37:0/2154797863 >> 172.21.15.37:0/2154797863 conn(0x55d1274f7cb0 msgr2=0x55d1274fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.275+0000 7f259a833740 1 -- 172.21.15.37:0/2154797863 shutdown_connections 2024-08-20T05:15:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.275+0000 7f259a833740 1 -- 172.21.15.37:0/2154797863 wait complete. 2024-08-20T05:15:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.275+0000 7f259a833740 20 client.28604 trim_cache size 0 max 16384 2024-08-20T05:15:21.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.295+0000 7f259a833740 1 Processor -- start 2024-08-20T05:15:21.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.295+0000 7f259a833740 1 -- start start 2024-08-20T05:15:21.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.295+0000 7f259a833740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d127512320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.296+0000 7f259a833740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d127505080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.296+0000 7f259a833740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d12750e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.296+0000 7f259a833740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f25901b1870 con 0x55d1274fa7a0 2024-08-20T05:15:21.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.296+0000 7f259a833740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f25901b33b0 con 0x55d1274f9e80 2024-08-20T05:15:21.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.296+0000 7f259a833740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f25901b1f40 con 0x55d127506730 2024-08-20T05:15:21.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.296+0000 7f2595400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d127512320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.296+0000 7f2595400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d127512320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:38146/0 (socket says 172.21.15.37:38146) 2024-08-20T05:15:21.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.296+0000 7f2595400640 1 -- 172.21.15.37:0/2059027849 learned_addr learned my addr 172.21.15.37:0/2059027849 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:21.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.296+0000 7f2594a00640 1 --2- 172.21.15.37:0/2059027849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d127505080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.296+0000 7f2595400640 1 -- 172.21.15.37:0/2059027849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 msgr2=0x55d12750e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:21.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.296+0000 7f2595e00640 1 --2- 172.21.15.37:0/2059027849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d12750e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.296+0000 7f2595400640 1 --2- 172.21.15.37:0/2059027849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d12750e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.296+0000 7f2595400640 1 -- 172.21.15.37:0/2059027849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 msgr2=0x55d127505080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:21.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.296+0000 7f2595400640 1 --2- 172.21.15.37:0/2059027849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d127505080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.296+0000 7f2595400640 1 -- 172.21.15.37:0/2059027849 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1274f8730 con 0x55d1274f9e80 2024-08-20T05:15:21.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.297+0000 7f2595e00640 1 --2- 172.21.15.37:0/2059027849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d12750e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:21.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.297+0000 7f2595400640 1 --2- 172.21.15.37:0/2059027849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d127512320 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f25840a7470 tx=0x7f2584010ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfb3fccc44672e91 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:21.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.297+0000 7f2581c00640 1 -- 172.21.15.37:0/2059027849 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25840aa640 con 0x55d1274f9e80 2024-08-20T05:15:21.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.297+0000 7f2581c00640 1 -- 172.21.15.37:0/2059027849 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25840b05b0 con 0x55d1274f9e80 2024-08-20T05:15:21.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.297+0000 7f2581c00640 1 -- 172.21.15.37:0/2059027849 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25840a9ed0 con 0x55d1274f9e80 2024-08-20T05:15:21.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.298+0000 7f259a833740 1 -- 172.21.15.37:0/2059027849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 msgr2=0x55d127512320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.298+0000 7f259a833740 1 --2- 172.21.15.37:0/2059027849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d127512320 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f25840a7470 tx=0x7f2584010ca0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.298+0000 7f259a833740 1 -- 172.21.15.37:0/2059027849 shutdown_connections 2024-08-20T05:15:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.298+0000 7f259a833740 1 --2- 172.21.15.37:0/2059027849 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d12750e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.298+0000 7f259a833740 1 --2- 172.21.15.37:0/2059027849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d127505080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.298+0000 7f259a833740 1 --2- 172.21.15.37:0/2059027849 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d127512320 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.298+0000 7f259a833740 1 -- 172.21.15.37:0/2059027849 >> 172.21.15.37:0/2059027849 conn(0x55d1274f7cb0 msgr2=0x55d127504970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.298+0000 7f259a833740 1 -- 172.21.15.37:0/2059027849 shutdown_connections 2024-08-20T05:15:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.298+0000 7f259a833740 1 -- 172.21.15.37:0/2059027849 wait complete. 2024-08-20T05:15:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.299+0000 7f259a833740 1 -- start start 2024-08-20T05:15:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.299+0000 7f259a833740 1 Processor -- start 2024-08-20T05:15:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.299+0000 7f259a833740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d12750e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.299+0000 7f259a833740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d12750cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.299+0000 7f259a833740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d12750d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.299+0000 7f259a833740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f25901b2ce0 con 0x55d1274fa7a0 2024-08-20T05:15:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.299+0000 7f259a833740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f25901b2610 con 0x55d1274f9e80 2024-08-20T05:15:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.299+0000 7f259a833740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f25901af850 con 0x55d127506730 2024-08-20T05:15:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.299+0000 7f259a833740 10 client.0 _ll_register_callbacks cb 0x7f25840a6d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.300+0000 7f2595400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d12750e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.300+0000 7f2595400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d12750e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:38160/0 (socket says 172.21.15.37:38160) 2024-08-20T05:15:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.300+0000 7f2595400640 1 -- 172.21.15.37:0/1543094337 learned_addr learned my addr 172.21.15.37:0/1543094337 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.300+0000 7f2594a00640 1 --2- 172.21.15.37:0/1543094337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d12750cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.300+0000 7f2595e00640 1 --2- 172.21.15.37:0/1543094337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d12750d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.300+0000 7f2595400640 1 -- 172.21.15.37:0/1543094337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 msgr2=0x55d12750d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.300+0000 7f2595400640 1 --2- 172.21.15.37:0/1543094337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d12750d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.300+0000 7f2595400640 1 -- 172.21.15.37:0/1543094337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 msgr2=0x55d12750cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.300+0000 7f2595400640 1 --2- 172.21.15.37:0/1543094337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d12750cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.300+0000 7f2595400640 1 -- 172.21.15.37:0/1543094337 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d127502b80 con 0x55d1274f9e80 2024-08-20T05:15:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.300+0000 7f2594a00640 1 --2- 172.21.15.37:0/1543094337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d12750cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:15:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.301+0000 7f2595400640 1 --2- 172.21.15.37:0/1543094337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d12750e880 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f25840af390 tx=0x7f25840a6b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11cc44c5ac3d457f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.301+0000 7f2576a00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:15:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.301+0000 7f2576a00640 1 -- 172.21.15.37:0/1543094337 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25840aa640 con 0x55d1274f9e80 2024-08-20T05:15:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.301+0000 7f259a833740 1 -- 172.21.15.37:0/1543094337 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25840b05b0 con 0x55d1274f9e80 2024-08-20T05:15:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.301+0000 7f2576a00640 1 -- 172.21.15.37:0/1543094337 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f25840a9e20 con 0x55d1274f9e80 2024-08-20T05:15:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.301+0000 7f2576a00640 1 -- 172.21.15.37:0/1543094337 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f258408f050 con 0x55d1274f9e80 2024-08-20T05:15:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.301+0000 7f259a833740 10 client.28610 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.301+0000 7f259a833740 1 -- 172.21.15.37:0/1543094337 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55d127502b80 con 0x55d1274f9e80 2024-08-20T05:15:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.301+0000 7f2576a00640 1 -- 172.21.15.37:0/1543094337 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25840b05b0 con 0x55d1274f9e80 2024-08-20T05:15:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.302+0000 7f2576a00640 1 -- 172.21.15.37:0/1543094337 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f25840c5c00 con 0x55d1274f9e80 2024-08-20T05:15:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.302+0000 7f259a833740 10 client.28610 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.302+0000 7f259a833740 10 client.28610 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:15:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.302+0000 7f259a833740 20 client.28610 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.302+0000 7f259a833740 1 --2- 172.21.15.37:0/1543094337 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d127581940 0x55d127583d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.302+0000 7f259a833740 4 client.28610 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9ca7b0fe", "release": true, "await": true}] 2024-08-20T05:15:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.302+0000 7f259a833740 1 -- 172.21.15.37:0/1543094337 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9ca7b0fe", "release": true, "await": true}) -- 0x55d12746d760 con 0x55d127581940 2024-08-20T05:15:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.302+0000 7f2594a00640 1 --2- 172.21.15.37:0/1543094337 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d127581940 0x55d127583d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.303+0000 7f2594a00640 1 --2- 172.21.15.37:0/1543094337 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d127581940 0x55d127583d60 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b953dba97bb4979 server_cookie=e8613412e9c286fe in_seq=0 out_seq=0 2024-08-20T05:15:21.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.303+0000 7f2576a00640 10 client.28610 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:15:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.347+0000 7f2576a00640 1 -- 172.21.15.37:0/1543094337 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d12746d760 con 0x55d127581940 2024-08-20T05:15:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.347+0000 7f2576a00640 10 client.28610 handle_command_reply: tid=0 2024-08-20T05:15:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.348+0000 7f259a833740 1 client.28610 shutdown 2024-08-20T05:15:21.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.354+0000 7f259a833740 1 -- 172.21.15.37:0/1543094337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 msgr2=0x55d12750e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:21.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.354+0000 7f259a833740 1 --2- 172.21.15.37:0/1543094337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d12750e880 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f25840af390 tx=0x7f25840a6b50 comp rx=0 tx=0).stop 2024-08-20T05:15:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.354+0000 7f259a833740 1 -- 172.21.15.37:0/1543094337 shutdown_connections 2024-08-20T05:15:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.354+0000 7f259a833740 1 --2- 172.21.15.37:0/1543094337 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55d127581940 0x55d127583d60 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.354+0000 7f259a833740 1 --2- 172.21.15.37:0/1543094337 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d127506730 0x55d12750d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.354+0000 7f259a833740 1 --2- 172.21.15.37:0/1543094337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d1274fa7a0 0x55d12750cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.354+0000 7f259a833740 1 --2- 172.21.15.37:0/1543094337 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d1274f9e80 0x55d12750e880 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.354+0000 7f259a833740 1 -- 172.21.15.37:0/1543094337 >> 172.21.15.37:0/1543094337 conn(0x55d1274f7cb0 msgr2=0x55d127505190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.354+0000 7f2576a00640 0 client.28610 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:21.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.354+0000 7f259a833740 1 -- 172.21.15.37:0/1543094337 shutdown_connections 2024-08-20T05:15:21.360 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:15:21.360 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 48, 2024-08-20T05:15:21.360 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:15:21.360 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 48, 2024-08-20T05:15:21.360 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:15:21.361 INFO:teuthology.orchestra.run.smithi037.stdout: "9ca7b0fe": { 2024-08-20T05:15:21.361 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 48, 2024-08-20T05:15:21.361 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:15:21.361 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:15:21.361 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:15:21.361 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:15:21.361 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:15:21.361 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:15:21.361 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 137.3, 2024-08-20T05:15:21.361 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:15:21.361 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:15:21.361 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:15:21.361 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:15:21.362 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:15:21.362 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:15:21.362 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:15:21.362 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:15:21.362 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:15:21.362 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:15:21.362 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:15:21.362 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:15:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.358+0000 7f259a833740 1 -- 172.21.15.37:0/1543094337 wait complete. 2024-08-20T05:15:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.358+0000 7f259a833740 20 client.28610 trim_cache size 0 max 16384 2024-08-20T05:15:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.359+0000 7f2596800640 1 -- 172.21.15.37:0/611781912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f25780b3c00 msgr2=0x7f25780b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.359+0000 7f2596800640 1 --2- 172.21.15.37:0/611781912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f25780b3c00 0x7f25780b60c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2588009fd0 tx=0x7f2588009500 comp rx=0 tx=0).stop 2024-08-20T05:15:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.359+0000 7f2596800640 1 -- 172.21.15.37:0/611781912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2590104b00 msgr2=0x7f259019af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.359+0000 7f2596800640 1 --2- 172.21.15.37:0/611781912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2590104b00 0x7f259019af70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f258400e9f0 tx=0x7f258400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.359+0000 7f2596800640 1 -- 172.21.15.37:0/611781912 shutdown_connections 2024-08-20T05:15:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.359+0000 7f2596800640 1 --2- 172.21.15.37:0/611781912 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f25780b3c00 0x7f25780b60c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.359+0000 7f2596800640 1 --2- 172.21.15.37:0/611781912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f259010ae90 0x7f25901a0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.359+0000 7f2596800640 1 --2- 172.21.15.37:0/611781912 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f259010a510 0x7f259019b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.359+0000 7f2596800640 1 --2- 172.21.15.37:0/611781912 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2590104b00 0x7f259019af70 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:21.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.359+0000 7f2596800640 1 -- 172.21.15.37:0/611781912 >> 172.21.15.37:0/611781912 conn(0x7f2590100550 msgr2=0x7f25901039c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:21.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.360+0000 7f2596800640 1 -- 172.21.15.37:0/611781912 shutdown_connections 2024-08-20T05:15:21.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:21.360+0000 7f2596800640 1 -- 172.21.15.37:0/611781912 wait complete. 2024-08-20T05:15:21.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:21 smithi037 ceph-mon[17265]: pgmap v794: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 316 KiB/s wr, 48 op/s 2024-08-20T05:15:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:21 smithi135 ceph-mon[22342]: pgmap v794: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 316 KiB/s wr, 48 op/s 2024-08-20T05:15:21.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:21 smithi130 ceph-mon[22007]: pgmap v794: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 316 KiB/s wr, 48 op/s 2024-08-20T05:15:22.625 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9ca7b0fe', total seconds elapsed: 24.7 2024-08-20T05:15:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.867+0000 7ff7e0e00640 1 -- 172.21.15.37:0/1373822063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7dc06c8a0 msgr2=0x7ff7dc06cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.867+0000 7ff7e0e00640 1 --2- 172.21.15.37:0/1373822063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7dc06c8a0 0x7ff7dc06cce0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8009900 tx=0x7ff7c802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.868+0000 7ff7e0e00640 1 -- 172.21.15.37:0/1373822063 shutdown_connections 2024-08-20T05:15:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.868+0000 7ff7e0e00640 1 --2- 172.21.15.37:0/1373822063 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7dc06d220 0x7ff7dc116360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.868+0000 7ff7e0e00640 1 --2- 172.21.15.37:0/1373822063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7dc06c8a0 0x7ff7dc06cce0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.868+0000 7ff7e0e00640 1 --2- 172.21.15.37:0/1373822063 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7dc0744b0 0x7ff7dc074890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.868+0000 7ff7e0e00640 1 -- 172.21.15.37:0/1373822063 >> 172.21.15.37:0/1373822063 conn(0x7ff7dc076bd0 msgr2=0x7ff7dc076fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.868+0000 7ff7e0e00640 1 -- 172.21.15.37:0/1373822063 shutdown_connections 2024-08-20T05:15:22.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.868+0000 7ff7e0e00640 1 -- 172.21.15.37:0/1373822063 wait complete. 2024-08-20T05:15:22.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.869+0000 7ff7e0e00640 1 Processor -- start 2024-08-20T05:15:22.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.870+0000 7ff7e0e00640 1 -- start start 2024-08-20T05:15:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.870+0000 7ff7e0e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7dc06c8a0 0x7ff7dc1a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.870+0000 7ff7e0e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7dc06d220 0x7ff7dc1a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.870+0000 7ff7e0e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7dc0744b0 0x7ff7dc1a9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.870+0000 7ff7e0e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff7dc1190c0 con 0x7ff7dc06d220 2024-08-20T05:15:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.870+0000 7ff7e0e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff7dc118f40 con 0x7ff7dc06c8a0 2024-08-20T05:15:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.870+0000 7ff7e0e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7dc119240 con 0x7ff7dc0744b0 2024-08-20T05:15:22.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.871+0000 7ff7d9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7dc06d220 0x7ff7dc1a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:22.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.871+0000 7ff7d9e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7dc06c8a0 0x7ff7dc1a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:22.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.871+0000 7ff7d9400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7dc06d220 0x7ff7dc1a3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39994/0 (socket says 172.21.15.37:39994) 2024-08-20T05:15:22.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.871+0000 7ff7d9400640 1 -- 172.21.15.37:0/2663098107 learned_addr learned my addr 172.21.15.37:0/2663098107 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:22.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.871+0000 7ff7da800640 1 --2- 172.21.15.37:0/2663098107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7dc0744b0 0x7ff7dc1a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:22.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.873+0000 7ff7d9400640 1 -- 172.21.15.37:0/2663098107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7dc0744b0 msgr2=0x7ff7dc1a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:22.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.873+0000 7ff7d9400640 1 --2- 172.21.15.37:0/2663098107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7dc0744b0 0x7ff7dc1a9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.873+0000 7ff7d9400640 1 -- 172.21.15.37:0/2663098107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7dc06c8a0 msgr2=0x7ff7dc1a39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:22.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.873+0000 7ff7d9400640 1 --2- 172.21.15.37:0/2663098107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7dc06c8a0 0x7ff7dc1a39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.873+0000 7ff7d9400640 1 -- 172.21.15.37:0/2663098107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7dc1a9a60 con 0x7ff7dc06d220 2024-08-20T05:15:22.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.874+0000 7ff7d9400640 1 --2- 172.21.15.37:0/2663098107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7dc06d220 0x7ff7dc1a3ef0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8005ab0 tx=0x7ff7c8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:22.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.874+0000 7ff7d2a00640 1 -- 172.21.15.37:0/2663098107 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c803f070 con 0x7ff7dc06d220 2024-08-20T05:15:22.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.874+0000 7ff7e0e00640 1 -- 172.21.15.37:0/2663098107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7dc1a9cf0 con 0x7ff7dc06d220 2024-08-20T05:15:22.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.875+0000 7ff7e0e00640 1 -- 172.21.15.37:0/2663098107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7dc1b0410 con 0x7ff7dc06d220 2024-08-20T05:15:22.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.875+0000 7ff7d2a00640 1 -- 172.21.15.37:0/2663098107 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7c8031b50 con 0x7ff7dc06d220 2024-08-20T05:15:22.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.875+0000 7ff7d2a00640 1 -- 172.21.15.37:0/2663098107 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8035030 con 0x7ff7dc06d220 2024-08-20T05:15:22.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.881+0000 7ff7e3a06740 1 Processor -- start 2024-08-20T05:15:22.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.881+0000 7ff7e3a06740 1 -- start start 2024-08-20T05:15:22.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.882+0000 7ff7e3a06740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d634f940 0x5647d634fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.882+0000 7ff7e3a06740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d6350260 0x5647d635bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.882+0000 7ff7e3a06740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d635c1f0 0x5647d635e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.882+0000 7ff7e3a06740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5647d62c5aa0 con 0x5647d635c1f0 2024-08-20T05:15:22.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.882+0000 7ff7e3a06740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5647d62b4fa0 con 0x5647d6350260 2024-08-20T05:15:22.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.882+0000 7ff7e3a06740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5647d62b8fe0 con 0x5647d634f940 2024-08-20T05:15:22.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.882+0000 7ff7d9e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d6350260 0x5647d635bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:22.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.882+0000 7ff7da800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d634f940 0x5647d634fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:22.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.882+0000 7ff7da800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d634f940 0x5647d634fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33774/0 (socket says 172.21.15.37:33774) 2024-08-20T05:15:22.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.882+0000 7ff7d9e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d6350260 0x5647d635bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37410/0 (socket says 172.21.15.37:37410) 2024-08-20T05:15:22.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.882+0000 7ff7da800640 1 -- 172.21.15.37:0/1028481755 learned_addr learned my addr 172.21.15.37:0/1028481755 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:22.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.884+0000 7ff7d9e00640 1 -- 172.21.15.37:0/1028481755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d634f940 msgr2=0x5647d634fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:22.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.884+0000 7ff7d9e00640 1 --2- 172.21.15.37:0/1028481755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d634f940 0x5647d634fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.884+0000 7ff7d9e00640 1 -- 172.21.15.37:0/1028481755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d635c1f0 msgr2=0x5647d635e5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:15:22.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.884+0000 7ff7d9e00640 1 --2- 172.21.15.37:0/1028481755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d635c1f0 0x5647d635e5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.884+0000 7ff7d9e00640 1 -- 172.21.15.37:0/1028481755 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647d625b420 con 0x5647d6350260 2024-08-20T05:15:22.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.885+0000 7ff7d9e00640 1 --2- 172.21.15.37:0/1028481755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d6350260 0x5647d635bcb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009b70 tx=0x7ff7cc0117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d088f3a05c4d6ab server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:22.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.888+0000 7ff7d2a00640 1 -- 172.21.15.37:0/2663098107 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff7c8042070 con 0x7ff7dc06d220 2024-08-20T05:15:22.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.889+0000 7ff7c7400640 1 -- 172.21.15.37:0/1028481755 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc009e60 con 0x5647d6350260 2024-08-20T05:15:22.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.890+0000 7ff7c7400640 1 -- 172.21.15.37:0/1028481755 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7cc012900 con 0x5647d6350260 2024-08-20T05:15:22.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.890+0000 7ff7c7400640 1 -- 172.21.15.37:0/1028481755 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc009e60 con 0x5647d6350260 2024-08-20T05:15:22.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.891+0000 7ff7d2a00640 1 --2- 172.21.15.37:0/2663098107 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7c00b3d10 0x7ff7c00b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.891+0000 7ff7e3a06740 1 -- 172.21.15.37:0/1028481755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d6350260 msgr2=0x5647d635bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:22.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.891+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/1028481755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d6350260 0x5647d635bcb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009b70 tx=0x7ff7cc0117b0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.891+0000 7ff7d2a00640 1 -- 172.21.15.37:0/2663098107 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff7c8104540 con 0x7ff7dc06d220 2024-08-20T05:15:22.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.892+0000 7ff7da800640 1 --2- 172.21.15.37:0/2663098107 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7c00b3d10 0x7ff7c00b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.892+0000 7ff7e3a06740 1 -- 172.21.15.37:0/1028481755 shutdown_connections 2024-08-20T05:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.892+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/1028481755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d635c1f0 0x5647d635e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.892+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/1028481755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d6350260 0x5647d635bcb0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.892+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/1028481755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d634f940 0x5647d634fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.892+0000 7ff7e3a06740 1 -- 172.21.15.37:0/1028481755 >> 172.21.15.37:0/1028481755 conn(0x5647d634d770 msgr2=0x5647d634e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.893+0000 7ff7e3a06740 1 -- 172.21.15.37:0/1028481755 shutdown_connections 2024-08-20T05:15:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.893+0000 7ff7e3a06740 1 -- 172.21.15.37:0/1028481755 wait complete. 2024-08-20T05:15:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.894+0000 7ff7da800640 1 --2- 172.21.15.37:0/2663098107 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7c00b3d10 0x7ff7c00b61d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40039c0 tx=0x7ff7d4010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.894+0000 7ff7e3a06740 1 -- start start 2024-08-20T05:15:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.895+0000 7ff7e3a06740 1 Processor -- start 2024-08-20T05:15:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.896+0000 7ff7e3a06740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d634f940 0x5647d635ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.896+0000 7ff7e3a06740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d6350260 0x5647d6358ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.896+0000 7ff7e3a06740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d635c1f0 0x5647d63594a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.897+0000 7ff7d9e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d634f940 0x5647d635ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.897+0000 7ff7e3a06740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5647d6117700 con 0x5647d6350260 2024-08-20T05:15:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.897+0000 7ff7e3a06740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5647d6250290 con 0x5647d634f940 2024-08-20T05:15:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.897+0000 7ff7e3a06740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5647d635ee70 con 0x5647d635c1f0 2024-08-20T05:15:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.897+0000 7ff7d9e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d634f940 0x5647d635ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37414/0 (socket says 172.21.15.37:37414) 2024-08-20T05:15:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.897+0000 7ff7d9e00640 1 -- 172.21.15.37:0/2845107239 learned_addr learned my addr 172.21.15.37:0/2845107239 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.897+0000 7ff7da800640 1 --2- 172.21.15.37:0/2845107239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d635c1f0 0x5647d63594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.897+0000 7ff7e3a06740 10 client.0 _ll_register_callbacks cb 0x5647d62af1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.898+0000 7ff7d9400640 1 --2- 172.21.15.37:0/2845107239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d6350260 0x5647d6358ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.898+0000 7ff7d9e00640 1 -- 172.21.15.37:0/2845107239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d635c1f0 msgr2=0x5647d63594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.898+0000 7ff7d9e00640 1 --2- 172.21.15.37:0/2845107239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d635c1f0 0x5647d63594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.898+0000 7ff7d9e00640 1 -- 172.21.15.37:0/2845107239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d6350260 msgr2=0x5647d6358ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.898+0000 7ff7d9e00640 1 --2- 172.21.15.37:0/2845107239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d6350260 0x5647d6358ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.898+0000 7ff7d9e00640 1 -- 172.21.15.37:0/2845107239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647d6014650 con 0x5647d634f940 2024-08-20T05:15:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.898+0000 7ff7d9e00640 1 --2- 172.21.15.37:0/2845107239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d634f940 0x5647d635ba90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc012ce0 tx=0x7ff7cc009700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5567482309c62151 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.898+0000 7ff7bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:15:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.899+0000 7ff7bbe00640 1 -- 172.21.15.37:0/2845107239 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc028070 con 0x5647d634f940 2024-08-20T05:15:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.899+0000 7ff7bbe00640 1 -- 172.21.15.37:0/2845107239 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff7cc005450 con 0x5647d634f940 2024-08-20T05:15:22.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.899+0000 7ff7e3a06740 1 -- 172.21.15.37:0/2845107239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7cc012900 con 0x5647d634f940 2024-08-20T05:15:22.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.899+0000 7ff7d9400640 1 --2- 172.21.15.37:0/2845107239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d6350260 0x5647d6358ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:22.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.900+0000 7ff7bbe00640 1 -- 172.21.15.37:0/2845107239 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7ff7cc033050 con 0x5647d634f940 2024-08-20T05:15:22.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.900+0000 7ff7e3a06740 10 client.28622 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:22.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.903+0000 7ff7e3a06740 1 -- 172.21.15.37:0/2845107239 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5647d6372fe0 con 0x5647d634f940 2024-08-20T05:15:22.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.904+0000 7ff7bbe00640 1 -- 172.21.15.37:0/2845107239 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7cc012900 con 0x5647d634f940 2024-08-20T05:15:22.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.905+0000 7ff7bbe00640 1 -- 172.21.15.37:0/2845107239 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7ff7cc0046c0 con 0x5647d634f940 2024-08-20T05:15:22.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.906+0000 7ff7e3a06740 10 client.28622 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:22.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.906+0000 7ff7e3a06740 10 client.28622 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:15:22.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.906+0000 7ff7e3a06740 20 client.28622 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:22.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.906+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/2845107239 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5647d6374390 0x5647d6376780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.906+0000 7ff7e3a06740 4 client.28622 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:15:22.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.906+0000 7ff7e3a06740 1 -- 172.21.15.37:0/2845107239 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647d62c79f0 con 0x5647d6374390 2024-08-20T05:15:22.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.908+0000 7ff7d9400640 1 --2- 172.21.15.37:0/2845107239 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5647d6374390 0x5647d6376780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:22.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.909+0000 7ff7bbe00640 10 client.28622 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:15:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.909+0000 7ff7d9400640 1 --2- 172.21.15.37:0/2845107239 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5647d6374390 0x5647d6376780 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=46c187467c2b7d0e server_cookie=a56bcee3fc0b30c7 in_seq=0 out_seq=0 2024-08-20T05:15:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.909+0000 7ff7bbe00640 1 -- 172.21.15.37:0/2845107239 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5647d62c79f0 con 0x5647d6374390 2024-08-20T05:15:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.909+0000 7ff7bbe00640 10 client.28622 handle_command_reply: tid=0 2024-08-20T05:15:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.910+0000 7ff7e3a06740 1 client.28622 shutdown 2024-08-20T05:15:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.911+0000 7ff7e3a06740 1 -- 172.21.15.37:0/2845107239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d634f940 msgr2=0x5647d635ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.911+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/2845107239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d634f940 0x5647d635ba90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc012ce0 tx=0x7ff7cc009700 comp rx=0 tx=0).stop 2024-08-20T05:15:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.912+0000 7ff7e3a06740 1 -- 172.21.15.37:0/2845107239 shutdown_connections 2024-08-20T05:15:22.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.912+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/2845107239 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5647d6374390 0x5647d6376780 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.912+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/2845107239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d635c1f0 0x5647d63594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.912+0000 7ff7bbe00640 0 client.28622 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:15:22.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.912+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/2845107239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d6350260 0x5647d6358ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.912+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/2845107239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d634f940 0x5647d635ba90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.913+0000 7ff7e3a06740 1 -- 172.21.15.37:0/2845107239 >> 172.21.15.37:0/2845107239 conn(0x5647d634d770 msgr2=0x5647d63532e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.913+0000 7ff7e3a06740 1 -- 172.21.15.37:0/2845107239 shutdown_connections 2024-08-20T05:15:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.913+0000 7ff7e3a06740 1 -- 172.21.15.37:0/2845107239 wait complete. 2024-08-20T05:15:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.913+0000 7ff7e3a06740 20 client.28622 trim_cache size 0 max 16384 2024-08-20T05:15:22.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.943+0000 7ff7e3a06740 1 Processor -- start 2024-08-20T05:15:22.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.943+0000 7ff7e3a06740 1 -- start start 2024-08-20T05:15:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.944+0000 7ff7e3a06740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d634f940 0x5647d63583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.944+0000 7ff7e3a06740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d6350260 0x5647d634c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.944+0000 7ff7e3a06740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d635c1f0 0x5647d634cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.944+0000 7ff7e3a06740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff7bc00fc90 con 0x5647d6350260 2024-08-20T05:15:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.944+0000 7ff7e3a06740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff7bc0117d0 con 0x5647d635c1f0 2024-08-20T05:15:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.944+0000 7ff7e3a06740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7bc010360 con 0x5647d634f940 2024-08-20T05:15:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.944+0000 7ff7d9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d634f940 0x5647d63583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.945+0000 7ff7d9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d634f940 0x5647d63583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33804/0 (socket says 172.21.15.37:33804) 2024-08-20T05:15:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.945+0000 7ff7d9e00640 1 -- 172.21.15.37:0/2995948851 learned_addr learned my addr 172.21.15.37:0/2995948851 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.945+0000 7ff7da800640 1 --2- 172.21.15.37:0/2995948851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d635c1f0 0x5647d634cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.945+0000 7ff7d9400640 1 --2- 172.21.15.37:0/2995948851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d6350260 0x5647d634c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.946+0000 7ff7d9e00640 1 -- 172.21.15.37:0/2995948851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d635c1f0 msgr2=0x5647d634cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.946+0000 7ff7d9e00640 1 --2- 172.21.15.37:0/2995948851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d635c1f0 0x5647d634cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.946+0000 7ff7d9e00640 1 -- 172.21.15.37:0/2995948851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d6350260 msgr2=0x5647d634c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.946+0000 7ff7d9e00640 1 --2- 172.21.15.37:0/2995948851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d6350260 0x5647d634c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.946+0000 7ff7d9e00640 1 -- 172.21.15.37:0/2995948851 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647d6349110 con 0x5647d634f940 2024-08-20T05:15:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.946+0000 7ff7da800640 1 --2- 172.21.15.37:0/2995948851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d635c1f0 0x5647d634cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.947+0000 7ff7d9e00640 1 --2- 172.21.15.37:0/2995948851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d634f940 0x5647d63583d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0117f0 tx=0x7ff7cc0099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f16179caa7a470d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.947+0000 7ff7d9400640 1 --2- 172.21.15.37:0/2995948851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d6350260 0x5647d634c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.947+0000 7ff7c6a00640 1 -- 172.21.15.37:0/2995948851 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc028040 con 0x5647d634f940 2024-08-20T05:15:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.947+0000 7ff7c6a00640 1 -- 172.21.15.37:0/2995948851 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7cc012dc0 con 0x5647d634f940 2024-08-20T05:15:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.947+0000 7ff7c6a00640 1 -- 172.21.15.37:0/2995948851 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc004e10 con 0x5647d634f940 2024-08-20T05:15:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.948+0000 7ff7e3a06740 1 -- 172.21.15.37:0/2995948851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d634f940 msgr2=0x5647d63583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.948+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/2995948851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d634f940 0x5647d63583d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc0117f0 tx=0x7ff7cc0099c0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.949+0000 7ff7e3a06740 1 -- 172.21.15.37:0/2995948851 shutdown_connections 2024-08-20T05:15:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.949+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/2995948851 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d635c1f0 0x5647d634cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.949+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/2995948851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d6350260 0x5647d634c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.949+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/2995948851 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d634f940 0x5647d63583d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.949+0000 7ff7e3a06740 1 -- 172.21.15.37:0/2995948851 >> 172.21.15.37:0/2995948851 conn(0x5647d634d770 msgr2=0x5647d634c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:22.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.950+0000 7ff7e3a06740 1 -- 172.21.15.37:0/2995948851 shutdown_connections 2024-08-20T05:15:22.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.951+0000 7ff7e3a06740 1 -- 172.21.15.37:0/2995948851 wait complete. 2024-08-20T05:15:22.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.952+0000 7ff7e3a06740 1 -- start start 2024-08-20T05:15:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.952+0000 7ff7e3a06740 1 Processor -- start 2024-08-20T05:15:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.953+0000 7ff7e3a06740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d634f940 0x5647d636a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.953+0000 7ff7e3a06740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d6350260 0x5647d636a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.953+0000 7ff7e3a06740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d635c1f0 0x5647d63d6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.953+0000 7ff7e3a06740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff7bc011100 con 0x5647d6350260 2024-08-20T05:15:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.953+0000 7ff7e3a06740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff7bc010a30 con 0x5647d634f940 2024-08-20T05:15:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.953+0000 7ff7e3a06740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7bc00dc70 con 0x5647d635c1f0 2024-08-20T05:15:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.953+0000 7ff7e3a06740 10 client.0 _ll_register_callbacks cb 0x7ff7d400a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.954+0000 7ff7d9e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d634f940 0x5647d636a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.954+0000 7ff7d9e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d634f940 0x5647d636a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37428/0 (socket says 172.21.15.37:37428) 2024-08-20T05:15:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.954+0000 7ff7d9e00640 1 -- 172.21.15.37:0/1133948790 learned_addr learned my addr 172.21.15.37:0/1133948790 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.954+0000 7ff7da800640 1 --2- 172.21.15.37:0/1133948790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d635c1f0 0x5647d63d6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.954+0000 7ff7d9400640 1 --2- 172.21.15.37:0/1133948790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d6350260 0x5647d636a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.954+0000 7ff7d9e00640 1 -- 172.21.15.37:0/1133948790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d635c1f0 msgr2=0x5647d63d6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.954+0000 7ff7d9e00640 1 --2- 172.21.15.37:0/1133948790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d635c1f0 0x5647d63d6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.954+0000 7ff7d9e00640 1 -- 172.21.15.37:0/1133948790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d6350260 msgr2=0x5647d636a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:22.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.954+0000 7ff7d9e00640 1 --2- 172.21.15.37:0/1133948790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d6350260 0x5647d636a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.954+0000 7ff7d9e00640 1 -- 172.21.15.37:0/1133948790 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647d63d7530 con 0x5647d634f940 2024-08-20T05:15:22.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.956+0000 7ff7d9e00640 1 --2- 172.21.15.37:0/1133948790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d634f940 0x5647d636a300 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc039040 tx=0x7ff7cc011d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67533c5575f0e38 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:22.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.956+0000 7ff7bbe00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:15:22.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.957+0000 7ff7bbe00640 1 -- 172.21.15.37:0/1133948790 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc044060 con 0x5647d634f940 2024-08-20T05:15:22.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.957+0000 7ff7bbe00640 1 -- 172.21.15.37:0/1133948790 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff7cc004bb0 con 0x5647d634f940 2024-08-20T05:15:22.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.957+0000 7ff7e3a06740 1 -- 172.21.15.37:0/1133948790 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7cc012dc0 con 0x5647d634f940 2024-08-20T05:15:22.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.957+0000 7ff7bbe00640 1 -- 172.21.15.37:0/1133948790 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7ff7cc028070 con 0x5647d634f940 2024-08-20T05:15:22.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.957+0000 7ff7e3a06740 10 client.28625 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:22.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.957+0000 7ff7e3a06740 1 -- 172.21.15.37:0/1133948790 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5647d635fb80 con 0x5647d634f940 2024-08-20T05:15:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.958+0000 7ff7bbe00640 1 -- 172.21.15.37:0/1133948790 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7cc012dc0 con 0x5647d634f940 2024-08-20T05:15:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.958+0000 7ff7bbe00640 1 -- 172.21.15.37:0/1133948790 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7ff7cc003680 con 0x5647d634f940 2024-08-20T05:15:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.958+0000 7ff7e3a06740 10 client.28625 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.958+0000 7ff7e3a06740 10 client.28625 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:15:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.958+0000 7ff7e3a06740 20 client.28625 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.958+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/1133948790 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5647d6374390 0x5647d63622c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.958+0000 7ff7e3a06740 4 client.28625 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:15:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.958+0000 7ff7e3a06740 1 -- 172.21.15.37:0/1133948790 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5647d62c3490 con 0x5647d6374390 2024-08-20T05:15:22.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.959+0000 7ff7d9400640 1 --2- 172.21.15.37:0/1133948790 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5647d6374390 0x5647d63622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:22.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.960+0000 7ff7d9400640 1 --2- 172.21.15.37:0/1133948790 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5647d6374390 0x5647d63622c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9b3a9021d6b17a99 server_cookie=cc3c7d537da1569f in_seq=0 out_seq=0 2024-08-20T05:15:22.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.960+0000 7ff7bbe00640 10 client.28625 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:15:22.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.961+0000 7ff7bbe00640 1 -- 172.21.15.37:0/1133948790 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5647d62c3490 con 0x5647d6374390 2024-08-20T05:15:22.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.961+0000 7ff7bbe00640 10 client.28625 handle_command_reply: tid=0 2024-08-20T05:15:22.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.961+0000 7ff7e3a06740 1 client.28625 shutdown 2024-08-20T05:15:22.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.961+0000 7ff7e3a06740 1 -- 172.21.15.37:0/1133948790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d634f940 msgr2=0x5647d636a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:22.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.961+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/1133948790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d634f940 0x5647d636a300 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc039040 tx=0x7ff7cc011d60 comp rx=0 tx=0).stop 2024-08-20T05:15:22.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.961+0000 7ff7e3a06740 1 -- 172.21.15.37:0/1133948790 shutdown_connections 2024-08-20T05:15:22.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.961+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/1133948790 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x5647d6374390 0x5647d63622c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.961+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/1133948790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d635c1f0 0x5647d63d6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.961+0000 7ff7bbe00640 0 client.28625 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:15:22.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.962+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/1133948790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d6350260 0x5647d636a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.962+0000 7ff7e3a06740 1 --2- 172.21.15.37:0/1133948790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d634f940 0x5647d636a300 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.962+0000 7ff7e3a06740 1 -- 172.21.15.37:0/1133948790 >> 172.21.15.37:0/1133948790 conn(0x5647d634d770 msgr2=0x5647d634c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:22.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.963+0000 7ff7e3a06740 1 -- 172.21.15.37:0/1133948790 shutdown_connections 2024-08-20T05:15:22.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.963+0000 7ff7e3a06740 1 -- 172.21.15.37:0/1133948790 wait complete. 2024-08-20T05:15:22.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.963+0000 7ff7e3a06740 20 client.28625 trim_cache size 0 max 16384 2024-08-20T05:15:22.964 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:15:22.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.964+0000 7ff7e0e00640 1 -- 172.21.15.37:0/2663098107 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7c00b3d10 msgr2=0x7ff7c00b61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:22.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.964+0000 7ff7e0e00640 1 --2- 172.21.15.37:0/2663098107 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7c00b3d10 0x7ff7c00b61d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40039c0 tx=0x7ff7d4010040 comp rx=0 tx=0).stop 2024-08-20T05:15:22.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.964+0000 7ff7e0e00640 1 -- 172.21.15.37:0/2663098107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7dc06d220 msgr2=0x7ff7dc1a3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:22.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.964+0000 7ff7e0e00640 1 --2- 172.21.15.37:0/2663098107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7dc06d220 0x7ff7dc1a3ef0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8005ab0 tx=0x7ff7c8003c20 comp rx=0 tx=0).stop 2024-08-20T05:15:22.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.964+0000 7ff7e0e00640 1 -- 172.21.15.37:0/2663098107 shutdown_connections 2024-08-20T05:15:22.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.964+0000 7ff7e0e00640 1 --2- 172.21.15.37:0/2663098107 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7c00b3d10 0x7ff7c00b61d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.964+0000 7ff7e0e00640 1 --2- 172.21.15.37:0/2663098107 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7dc0744b0 0x7ff7dc1a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.964+0000 7ff7e0e00640 1 --2- 172.21.15.37:0/2663098107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7dc06d220 0x7ff7dc1a3ef0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.964+0000 7ff7e0e00640 1 --2- 172.21.15.37:0/2663098107 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7dc06c8a0 0x7ff7dc1a39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:22.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.964+0000 7ff7e0e00640 1 -- 172.21.15.37:0/2663098107 >> 172.21.15.37:0/2663098107 conn(0x7ff7dc076bd0 msgr2=0x7ff7dc0723c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:22.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.965+0000 7ff7e0e00640 1 -- 172.21.15.37:0/2663098107 shutdown_connections 2024-08-20T05:15:22.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:22.965+0000 7ff7e0e00640 1 -- 172.21.15.37:0/2663098107 wait complete. 2024-08-20T05:15:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 745.0 s, 155.5 tps, lat 2083.362 ms stddev 4998.194 2024-08-20T05:15:23.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:23 smithi037 ceph-mon[17265]: pgmap v795: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 128 KiB/s wr, 23 op/s 2024-08-20T05:15:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:23 smithi135 ceph-mon[22342]: pgmap v795: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 128 KiB/s wr, 23 op/s 2024-08-20T05:15:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:23 smithi130 ceph-mon[22007]: pgmap v795: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 128 KiB/s wr, 23 op/s 2024-08-20T05:15:24.718 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T05:15:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:15:25.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:25 smithi135 ceph-mon[22342]: pgmap v796: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 398 KiB/s wr, 66 op/s 2024-08-20T05:15:25.873 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:25 smithi037 ceph-mon[17265]: pgmap v796: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 398 KiB/s wr, 66 op/s 2024-08-20T05:15:25.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:25 smithi130 ceph-mon[22007]: pgmap v796: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 398 KiB/s wr, 66 op/s 2024-08-20T05:15:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.049+0000 7f409ce00640 1 -- 172.21.15.37:0/862536332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40981090e0 msgr2=0x7f40981094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.049+0000 7f409ce00640 1 --2- 172.21.15.37:0/862536332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40981090e0 0x7f40981094c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4088009900 tx=0x7f408802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.049+0000 7f409ce00640 1 -- 172.21.15.37:0/862536332 shutdown_connections 2024-08-20T05:15:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.049+0000 7f409ce00640 1 --2- 172.21.15.37:0/862536332 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f409810f470 0x7f4098115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.049+0000 7f409ce00640 1 --2- 172.21.15.37:0/862536332 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f409810eaf0 0x7f409810ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.049+0000 7f409ce00640 1 --2- 172.21.15.37:0/862536332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40981090e0 0x7f40981094c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.049+0000 7f409ce00640 1 -- 172.21.15.37:0/862536332 >> 172.21.15.37:0/862536332 conn(0x7f4098078760 msgr2=0x7f409807ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.049+0000 7f409ce00640 1 -- 172.21.15.37:0/862536332 shutdown_connections 2024-08-20T05:15:27.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.049+0000 7f409ce00640 1 -- 172.21.15.37:0/862536332 wait complete. 2024-08-20T05:15:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.051+0000 7f409ce00640 1 Processor -- start 2024-08-20T05:15:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.051+0000 7f409ce00640 1 -- start start 2024-08-20T05:15:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.051+0000 7f409ce00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40981090e0 0x7f409819f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.051+0000 7f409ce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f409810eaf0 0x7f409819fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.051+0000 7f409ce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f409810f470 0x7f40981a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.051+0000 7f409ce00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40981190d0 con 0x7f409810eaf0 2024-08-20T05:15:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.051+0000 7f409ce00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f4098118f50 con 0x7f409810f470 2024-08-20T05:15:27.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.051+0000 7f409ce00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f4098119250 con 0x7f40981090e0 2024-08-20T05:15:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.052+0000 7f4095e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40981090e0 0x7f409819f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.052+0000 7f4096800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f409810f470 0x7f40981a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.053+0000 7f4096800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f409810f470 0x7f40981a4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37454/0 (socket says 172.21.15.37:37454) 2024-08-20T05:15:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.053+0000 7f4096800640 1 -- 172.21.15.37:0/3247317870 learned_addr learned my addr 172.21.15.37:0/3247317870 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:27.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.053+0000 7f4095400640 1 --2- 172.21.15.37:0/3247317870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f409810eaf0 0x7f409819fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.053+0000 7f4095e00640 1 -- 172.21.15.37:0/3247317870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f409810f470 msgr2=0x7f40981a4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.053+0000 7f4095e00640 1 --2- 172.21.15.37:0/3247317870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f409810f470 0x7f40981a4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.053+0000 7f4095e00640 1 -- 172.21.15.37:0/3247317870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f409810eaf0 msgr2=0x7f409819fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.053+0000 7f4095e00640 1 --2- 172.21.15.37:0/3247317870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f409810eaf0 0x7f409819fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.053+0000 7f4095e00640 1 -- 172.21.15.37:0/3247317870 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40981a5650 con 0x7f40981090e0 2024-08-20T05:15:27.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.054+0000 7f4095e00640 1 --2- 172.21.15.37:0/3247317870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40981090e0 0x7f409819f5a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f408802a9e0 tx=0x7f4088003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:27.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.054+0000 7f408ea00640 1 -- 172.21.15.37:0/3247317870 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408803f070 con 0x7f40981090e0 2024-08-20T05:15:27.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.054+0000 7f408ea00640 1 -- 172.21.15.37:0/3247317870 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4088031b50 con 0x7f40981090e0 2024-08-20T05:15:27.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.054+0000 7f408ea00640 1 -- 172.21.15.37:0/3247317870 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4088035030 con 0x7f40981090e0 2024-08-20T05:15:27.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.055+0000 7f409ce00640 1 -- 172.21.15.37:0/3247317870 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40981a58e0 con 0x7f40981090e0 2024-08-20T05:15:27.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.055+0000 7f409ce00640 1 -- 172.21.15.37:0/3247317870 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40981ac000 con 0x7f40981090e0 2024-08-20T05:15:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.058+0000 7f409f7cb740 1 Processor -- start 2024-08-20T05:15:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.058+0000 7f408ea00640 1 -- 172.21.15.37:0/3247317870 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f4088042070 con 0x7f40981090e0 2024-08-20T05:15:27.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.058+0000 7f409f7cb740 1 -- start start 2024-08-20T05:15:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.059+0000 7f409f7cb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e4990 0x564fd58e4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.059+0000 7f409f7cb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58e52b0 0x564fd58f0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.059+0000 7f409f7cb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58f1240 0x564fd58f3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.059+0000 7f409f7cb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564fd585aaa0 con 0x564fd58e52b0 2024-08-20T05:15:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.059+0000 7f409f7cb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564fd5849fa0 con 0x564fd58f1240 2024-08-20T05:15:27.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.059+0000 7f409f7cb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564fd584dfe0 con 0x564fd58e4990 2024-08-20T05:15:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.059+0000 7f4096800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e4990 0x564fd58e4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.059+0000 7f4096800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e4990 0x564fd58e4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33836/0 (socket says 172.21.15.37:33836) 2024-08-20T05:15:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.059+0000 7f4096800640 1 -- 172.21.15.37:0/267264523 learned_addr learned my addr 172.21.15.37:0/267264523 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.060+0000 7f4096800640 1 -- 172.21.15.37:0/267264523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58f1240 msgr2=0x564fd58f3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.060+0000 7f4096800640 1 --2- 172.21.15.37:0/267264523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58f1240 0x564fd58f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.060+0000 7f4096800640 1 -- 172.21.15.37:0/267264523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58e52b0 msgr2=0x564fd58f0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.060+0000 7f4096800640 1 --2- 172.21.15.37:0/267264523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58e52b0 0x564fd58f0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.060+0000 7f4096800640 1 -- 172.21.15.37:0/267264523 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd57f0420 con 0x564fd58e4990 2024-08-20T05:15:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.060+0000 7f4096800640 1 --2- 172.21.15.37:0/267264523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e4990 0x564fd58e4d70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4090011570 tx=0x7f4090011a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3652185ab6325653 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.061+0000 7f4083400640 1 -- 172.21.15.37:0/267264523 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4090004b20 con 0x564fd58e4990 2024-08-20T05:15:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.061+0000 7f4083400640 1 -- 172.21.15.37:0/267264523 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4090004cc0 con 0x564fd58e4990 2024-08-20T05:15:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.061+0000 7f4083400640 1 -- 172.21.15.37:0/267264523 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40900054e0 con 0x564fd58e4990 2024-08-20T05:15:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.061+0000 7f408ea00640 1 --2- 172.21.15.37:0/3247317870 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f407c0b3c50 0x7f407c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.061+0000 7f408ea00640 1 -- 172.21.15.37:0/3247317870 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f40881043b0 con 0x7f40981090e0 2024-08-20T05:15:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.062+0000 7f409f7cb740 1 -- 172.21.15.37:0/267264523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e4990 msgr2=0x564fd58e4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.062+0000 7f409f7cb740 1 --2- 172.21.15.37:0/267264523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e4990 0x564fd58e4d70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f4090011570 tx=0x7f4090011a30 comp rx=0 tx=0).stop 2024-08-20T05:15:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.062+0000 7f409f7cb740 1 -- 172.21.15.37:0/267264523 shutdown_connections 2024-08-20T05:15:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.062+0000 7f409f7cb740 1 --2- 172.21.15.37:0/267264523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58f1240 0x564fd58f3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.062+0000 7f409f7cb740 1 --2- 172.21.15.37:0/267264523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58e52b0 0x564fd58f0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.062+0000 7f409f7cb740 1 --2- 172.21.15.37:0/267264523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e4990 0x564fd58e4d70 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.062+0000 7f409f7cb740 1 -- 172.21.15.37:0/267264523 >> 172.21.15.37:0/267264523 conn(0x564fd58e27c0 msgr2=0x564fd58e3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.062+0000 7f4095e00640 1 --2- 172.21.15.37:0/3247317870 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f407c0b3c50 0x7f407c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.063+0000 7f409f7cb740 1 -- 172.21.15.37:0/267264523 shutdown_connections 2024-08-20T05:15:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.063+0000 7f409f7cb740 1 -- 172.21.15.37:0/267264523 wait complete. 2024-08-20T05:15:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.063+0000 7f4095e00640 1 --2- 172.21.15.37:0/3247317870 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f407c0b3c50 0x7f407c0b6110 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f40880caef0 tx=0x7f408802a3f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.063+0000 7f409f7cb740 1 -- start start 2024-08-20T05:15:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.063+0000 7f409f7cb740 1 Processor -- start 2024-08-20T05:15:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.064+0000 7f409f7cb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e4990 0x564fd58f09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.064+0000 7f409f7cb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e52b0 0x564fd58ede20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.064+0000 7f409f7cb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58f1240 0x564fd58ee360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.064+0000 7f409f7cb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564fd56ac700 con 0x564fd58f1240 2024-08-20T05:15:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.064+0000 7f409f7cb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564fd57e5290 con 0x564fd58e52b0 2024-08-20T05:15:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.064+0000 7f409f7cb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564fd58f3ec0 con 0x564fd58e4990 2024-08-20T05:15:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.064+0000 7f409f7cb740 10 client.0 _ll_register_callbacks cb 0x564fd58441c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.064+0000 7f4095400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e52b0 0x564fd58ede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.064+0000 7f4095400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e52b0 0x564fd58ede20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37472/0 (socket says 172.21.15.37:37472) 2024-08-20T05:15:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.064+0000 7f4095400640 1 -- 172.21.15.37:0/1076976429 learned_addr learned my addr 172.21.15.37:0/1076976429 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.064+0000 7f4096800640 1 --2- 172.21.15.37:0/1076976429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e4990 0x564fd58f09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.065+0000 7f4095400640 1 -- 172.21.15.37:0/1076976429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e4990 msgr2=0x564fd58f09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.065+0000 7f4095400640 1 --2- 172.21.15.37:0/1076976429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e4990 0x564fd58f09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.065+0000 7f4095400640 1 -- 172.21.15.37:0/1076976429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58f1240 msgr2=0x564fd58ee360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.065+0000 7f4096800640 1 --2- 172.21.15.37:0/1076976429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58f1240 0x564fd58ee360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:27.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.065+0000 7f4095400640 1 --2- 172.21.15.37:0/1076976429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58f1240 0x564fd58ee360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.065+0000 7f4095400640 1 -- 172.21.15.37:0/1076976429 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fd55a9650 con 0x564fd58e52b0 2024-08-20T05:15:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.065+0000 7f4096800640 1 --2- 172.21.15.37:0/1076976429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58f1240 0x564fd58ee360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.065+0000 7f4095400640 1 --2- 172.21.15.37:0/1076976429 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e52b0 0x564fd58ede20 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4084004700 tx=0x7f4084011af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0f481d2251eaefe server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.065+0000 7f4077e00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:15:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.066+0000 7f4077e00640 1 -- 172.21.15.37:0/1076976429 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084012980 con 0x564fd58e52b0 2024-08-20T05:15:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.066+0000 7f409f7cb740 1 -- 172.21.15.37:0/1076976429 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4090004cc0 con 0x564fd58e52b0 2024-08-20T05:15:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.066+0000 7f4077e00640 1 -- 172.21.15.37:0/1076976429 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4084012b20 con 0x564fd58e52b0 2024-08-20T05:15:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.066+0000 7f4077e00640 1 -- 172.21.15.37:0/1076976429 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f4084025050 con 0x564fd58e52b0 2024-08-20T05:15:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.066+0000 7f409f7cb740 10 client.28634 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:27.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.066+0000 7f409f7cb740 1 -- 172.21.15.37:0/1076976429 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x564fd58ff7a0 con 0x564fd58e52b0 2024-08-20T05:15:27.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.067+0000 7f4077e00640 1 -- 172.21.15.37:0/1076976429 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4090004cc0 con 0x564fd58e52b0 2024-08-20T05:15:27.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.067+0000 7f4077e00640 1 -- 172.21.15.37:0/1076976429 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f408401a3f0 con 0x564fd58e52b0 2024-08-20T05:15:27.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.068+0000 7f409f7cb740 10 client.28634 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:27.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.068+0000 7f409f7cb740 10 client.28634 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:15:27.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.068+0000 7f409f7cb740 20 client.28634 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.068+0000 7f409f7cb740 1 --2- 172.21.15.37:0/1076976429 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x564fd5900c70 0x564fd5903060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.068+0000 7f409f7cb740 4 client.28634 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:15:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.068+0000 7f409f7cb740 1 -- 172.21.15.37:0/1076976429 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fd585c9f0 con 0x564fd5900c70 2024-08-20T05:15:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.069+0000 7f4096800640 1 --2- 172.21.15.37:0/1076976429 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x564fd5900c70 0x564fd5903060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.070+0000 7f4077e00640 10 client.28634 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:15:27.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.070+0000 7f4096800640 1 --2- 172.21.15.37:0/1076976429 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x564fd5900c70 0x564fd5903060 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=86c3faf63e14c2e3 server_cookie=e029d9f236a38e06 in_seq=0 out_seq=0 2024-08-20T05:15:27.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.071+0000 7f4077e00640 1 -- 172.21.15.37:0/1076976429 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564fd585c9f0 con 0x564fd5900c70 2024-08-20T05:15:27.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.071+0000 7f4077e00640 10 client.28634 handle_command_reply: tid=0 2024-08-20T05:15:27.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.071+0000 7f409f7cb740 1 client.28634 shutdown 2024-08-20T05:15:27.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.071+0000 7f409f7cb740 1 -- 172.21.15.37:0/1076976429 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e52b0 msgr2=0x564fd58ede20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:27.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.072+0000 7f409f7cb740 1 --2- 172.21.15.37:0/1076976429 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e52b0 0x564fd58ede20 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4084004700 tx=0x7f4084011af0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.072+0000 7f409f7cb740 1 -- 172.21.15.37:0/1076976429 shutdown_connections 2024-08-20T05:15:27.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.072+0000 7f409f7cb740 1 --2- 172.21.15.37:0/1076976429 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x564fd5900c70 0x564fd5903060 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.072+0000 7f409f7cb740 1 --2- 172.21.15.37:0/1076976429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58f1240 0x564fd58ee360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.072+0000 7f409f7cb740 1 --2- 172.21.15.37:0/1076976429 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e52b0 0x564fd58ede20 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.072+0000 7f4077e00640 0 client.28634 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:15:27.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.072+0000 7f409f7cb740 1 --2- 172.21.15.37:0/1076976429 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e4990 0x564fd58f09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.072+0000 7f409f7cb740 1 -- 172.21.15.37:0/1076976429 >> 172.21.15.37:0/1076976429 conn(0x564fd58e27c0 msgr2=0x564fd58e8360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:27.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.072+0000 7f409f7cb740 1 -- 172.21.15.37:0/1076976429 shutdown_connections 2024-08-20T05:15:27.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.072+0000 7f409f7cb740 1 -- 172.21.15.37:0/1076976429 wait complete. 2024-08-20T05:15:27.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.072+0000 7f409f7cb740 20 client.28634 trim_cache size 0 max 16384 2024-08-20T05:15:27.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.091+0000 7f409f7cb740 1 Processor -- start 2024-08-20T05:15:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.092+0000 7f409f7cb740 1 -- start start 2024-08-20T05:15:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.092+0000 7f409f7cb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e4990 0x564fd58fd040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.092+0000 7f409f7cb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e52b0 0x564fd5908930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.092+0000 7f409f7cb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58f1240 0x564fd5908e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.092+0000 7f409f7cb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40981b5e50 con 0x564fd58f1240 2024-08-20T05:15:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.092+0000 7f409f7cb740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f40981b7990 con 0x564fd58e4990 2024-08-20T05:15:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.092+0000 7f409f7cb740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f40981b6520 con 0x564fd58e52b0 2024-08-20T05:15:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.092+0000 7f4095400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e52b0 0x564fd5908930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.092+0000 7f4095400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e52b0 0x564fd5908930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33848/0 (socket says 172.21.15.37:33848) 2024-08-20T05:15:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.092+0000 7f4095400640 1 -- 172.21.15.37:0/112800483 learned_addr learned my addr 172.21.15.37:0/112800483 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.092+0000 7f4096800640 1 --2- 172.21.15.37:0/112800483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e4990 0x564fd58fd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.093+0000 7f4096800640 1 --2- 172.21.15.37:0/112800483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58f1240 0x564fd5908e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.093+0000 7f4095400640 1 -- 172.21.15.37:0/112800483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e4990 msgr2=0x564fd58fd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:27.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.093+0000 7f4095400640 1 --2- 172.21.15.37:0/112800483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e4990 0x564fd58fd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.093+0000 7f4095400640 1 -- 172.21.15.37:0/112800483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58f1240 msgr2=0x564fd5908e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:27.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.093+0000 7f4095400640 1 --2- 172.21.15.37:0/112800483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58f1240 0x564fd5908e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.093+0000 7f4095400640 1 -- 172.21.15.37:0/112800483 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fd59036e0 con 0x564fd58e52b0 2024-08-20T05:15:27.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.093+0000 7f4096800640 1 --2- 172.21.15.37:0/112800483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58f1240 0x564fd5908e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:27.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.093+0000 7f4095400640 1 --2- 172.21.15.37:0/112800483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e52b0 0x564fd5908930 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f408401a890 tx=0x7f4084005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd7c62856c64f02 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:27.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.093+0000 7f4082a00640 1 -- 172.21.15.37:0/112800483 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408401a5f0 con 0x564fd58e52b0 2024-08-20T05:15:27.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.093+0000 7f4082a00640 1 -- 172.21.15.37:0/112800483 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4084005030 con 0x564fd58e52b0 2024-08-20T05:15:27.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.093+0000 7f4082a00640 1 -- 172.21.15.37:0/112800483 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40840129e0 con 0x564fd58e52b0 2024-08-20T05:15:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.094+0000 7f409f7cb740 1 -- 172.21.15.37:0/112800483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e52b0 msgr2=0x564fd5908930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.094+0000 7f409f7cb740 1 --2- 172.21.15.37:0/112800483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e52b0 0x564fd5908930 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f408401a890 tx=0x7f4084005f90 comp rx=0 tx=0).stop 2024-08-20T05:15:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.094+0000 7f409f7cb740 1 -- 172.21.15.37:0/112800483 shutdown_connections 2024-08-20T05:15:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.094+0000 7f409f7cb740 1 --2- 172.21.15.37:0/112800483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58f1240 0x564fd5908e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.094+0000 7f409f7cb740 1 --2- 172.21.15.37:0/112800483 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58e52b0 0x564fd5908930 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.095+0000 7f409f7cb740 1 --2- 172.21.15.37:0/112800483 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e4990 0x564fd58fd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.095+0000 7f409f7cb740 1 -- 172.21.15.37:0/112800483 >> 172.21.15.37:0/112800483 conn(0x564fd58e27c0 msgr2=0x564fd58e82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.095+0000 7f409f7cb740 1 -- 172.21.15.37:0/112800483 shutdown_connections 2024-08-20T05:15:27.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.095+0000 7f409f7cb740 1 -- 172.21.15.37:0/112800483 wait complete. 2024-08-20T05:15:27.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.098+0000 7f409f7cb740 1 -- start start 2024-08-20T05:15:27.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.099+0000 7f409f7cb740 1 Processor -- start 2024-08-20T05:15:27.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.100+0000 7f409f7cb740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e4990 0x564fd58f5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.100+0000 7f409f7cb740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58e52b0 0x564fd58f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.101+0000 7f4095400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58e52b0 0x564fd58f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.101+0000 7f4095400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58e52b0 0x564fd58f56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40084/0 (socket says 172.21.15.37:40084) 2024-08-20T05:15:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.104+0000 7f4096800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e4990 0x564fd58f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.104+0000 7f4096800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e4990 0x564fd58f5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37490/0 (socket says 172.21.15.37:37490) 2024-08-20T05:15:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.104+0000 7f409f7cb740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58f1240 0x564fd58f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.104+0000 7f409f7cb740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40981b72c0 con 0x564fd58e52b0 2024-08-20T05:15:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.104+0000 7f409f7cb740 1 -- 172.21.15.37:0/3270496830 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f40981b6bf0 con 0x564fd58e4990 2024-08-20T05:15:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.104+0000 7f409f7cb740 1 -- 172.21.15.37:0/3270496830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f40981b3e30 con 0x564fd58f1240 2024-08-20T05:15:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.104+0000 7f4095400640 1 -- 172.21.15.37:0/3270496830 learned_addr learned my addr 172.21.15.37:0/3270496830 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:27.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.105+0000 7f409f7cb740 10 client.0 _ll_register_callbacks cb 0x7f4084009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:27.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.105+0000 7f4096800640 1 --2- 172.21.15.37:0/3270496830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58f1240 0x564fd58f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.108+0000 7f4096800640 1 -- 172.21.15.37:0/3270496830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e4990 msgr2=0x564fd58f5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.108+0000 7f4096800640 1 --2- 172.21.15.37:0/3270496830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e4990 0x564fd58f5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.108+0000 7f4096800640 1 -- 172.21.15.37:0/3270496830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58e52b0 msgr2=0x564fd58f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.108+0000 7f4096800640 1 --2- 172.21.15.37:0/3270496830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58e52b0 0x564fd58f56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.108+0000 7f4096800640 1 -- 172.21.15.37:0/3270496830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fd596aa60 con 0x564fd58f1240 2024-08-20T05:15:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.108+0000 7f4096800640 1 --2- 172.21.15.37:0/3270496830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58f1240 0x564fd58f5be0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4090011540 tx=0x7f4084009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6800f88c8f79710a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.109+0000 7f4077e00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:15:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.109+0000 7f4077e00640 1 -- 172.21.15.37:0/3270496830 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40900056c0 con 0x564fd58f1240 2024-08-20T05:15:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.109+0000 7f4077e00640 1 -- 172.21.15.37:0/3270496830 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f4090016040 con 0x564fd58f1240 2024-08-20T05:15:27.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.109+0000 7f409f7cb740 1 -- 172.21.15.37:0/3270496830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4084005030 con 0x564fd58f1240 2024-08-20T05:15:27.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.111+0000 7f4077e00640 1 -- 172.21.15.37:0/3270496830 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f4090005860 con 0x564fd58f1240 2024-08-20T05:15:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.111+0000 7f409f7cb740 10 client.28687 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:27.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.111+0000 7f409f7cb740 1 -- 172.21.15.37:0/3270496830 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x564fd596bd30 con 0x564fd58f1240 2024-08-20T05:15:27.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.114+0000 7f4077e00640 1 -- 172.21.15.37:0/3270496830 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4084005030 con 0x564fd58f1240 2024-08-20T05:15:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.115+0000 7f4077e00640 1 -- 172.21.15.37:0/3270496830 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f40900245b0 con 0x564fd58f1240 2024-08-20T05:15:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.115+0000 7f409f7cb740 10 client.28687 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.115+0000 7f409f7cb740 10 client.28687 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:15:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.115+0000 7f409f7cb740 20 client.28687 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.115+0000 7f409f7cb740 1 --2- 172.21.15.37:0/3270496830 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x564fd596c350 0x564fd596e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.115+0000 7f409f7cb740 4 client.28687 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:15:27.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.115+0000 7f409f7cb740 1 -- 172.21.15.37:0/3270496830 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564fd5858490 con 0x564fd596c350 2024-08-20T05:15:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.116+0000 7f4095400640 1 --2- 172.21.15.37:0/3270496830 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x564fd596c350 0x564fd596e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.117+0000 7f4095400640 1 --2- 172.21.15.37:0/3270496830 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x564fd596c350 0x564fd596e770 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a2df8fb6fb2ce428 server_cookie=6b399accf8df5c7d in_seq=0 out_seq=0 2024-08-20T05:15:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.117+0000 7f4077e00640 10 client.28687 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:15:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.117+0000 7f4077e00640 1 -- 172.21.15.37:0/3270496830 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564fd5858490 con 0x564fd596c350 2024-08-20T05:15:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.117+0000 7f4077e00640 10 client.28687 handle_command_reply: tid=0 2024-08-20T05:15:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.117+0000 7f409f7cb740 1 client.28687 shutdown 2024-08-20T05:15:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.119+0000 7f409f7cb740 1 -- 172.21.15.37:0/3270496830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58f1240 msgr2=0x564fd58f5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.119+0000 7f409f7cb740 1 --2- 172.21.15.37:0/3270496830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58f1240 0x564fd58f5be0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f4090011540 tx=0x7f4084009c50 comp rx=0 tx=0).stop 2024-08-20T05:15:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.119+0000 7f409f7cb740 1 -- 172.21.15.37:0/3270496830 shutdown_connections 2024-08-20T05:15:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.119+0000 7f409f7cb740 1 --2- 172.21.15.37:0/3270496830 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x564fd596c350 0x564fd596e770 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.119+0000 7f409f7cb740 1 --2- 172.21.15.37:0/3270496830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564fd58f1240 0x564fd58f5be0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.119+0000 7f409f7cb740 1 --2- 172.21.15.37:0/3270496830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564fd58e52b0 0x564fd58f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.119+0000 7f409f7cb740 1 --2- 172.21.15.37:0/3270496830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564fd58e4990 0x564fd58f5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.119+0000 7f409f7cb740 1 -- 172.21.15.37:0/3270496830 >> 172.21.15.37:0/3270496830 conn(0x564fd58e27c0 msgr2=0x564fd58e7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.120+0000 7f4077e00640 0 client.28687 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:15:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.120+0000 7f409f7cb740 1 -- 172.21.15.37:0/3270496830 shutdown_connections 2024-08-20T05:15:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.120+0000 7f409f7cb740 1 -- 172.21.15.37:0/3270496830 wait complete. 2024-08-20T05:15:27.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.124+0000 7f409f7cb740 20 client.28687 trim_cache size 0 max 16384 2024-08-20T05:15:27.125 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:15:27.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.129+0000 7f409ce00640 1 -- 172.21.15.37:0/3247317870 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f407c0b3c50 msgr2=0x7f407c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:27.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.129+0000 7f409ce00640 1 --2- 172.21.15.37:0/3247317870 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f407c0b3c50 0x7f407c0b6110 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f40880caef0 tx=0x7f408802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.129+0000 7f409ce00640 1 -- 172.21.15.37:0/3247317870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40981090e0 msgr2=0x7f409819f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.129+0000 7f409ce00640 1 --2- 172.21.15.37:0/3247317870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40981090e0 0x7f409819f5a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f408802a9e0 tx=0x7f4088003b90 comp rx=0 tx=0).stop 2024-08-20T05:15:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.130+0000 7f409ce00640 1 -- 172.21.15.37:0/3247317870 shutdown_connections 2024-08-20T05:15:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.130+0000 7f409ce00640 1 --2- 172.21.15.37:0/3247317870 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f407c0b3c50 0x7f407c0b6110 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.130+0000 7f409ce00640 1 --2- 172.21.15.37:0/3247317870 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f409810f470 0x7f40981a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.130+0000 7f409ce00640 1 --2- 172.21.15.37:0/3247317870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f409810eaf0 0x7f409819fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.130+0000 7f409ce00640 1 --2- 172.21.15.37:0/3247317870 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40981090e0 0x7f409819f5a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:27.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.130+0000 7f409ce00640 1 -- 172.21.15.37:0/3247317870 >> 172.21.15.37:0/3247317870 conn(0x7f4098078760 msgr2=0x7f4098078fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:27.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.130+0000 7f409ce00640 1 -- 172.21.15.37:0/3247317870 shutdown_connections 2024-08-20T05:15:27.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:27.130+0000 7f409ce00640 1 -- 172.21.15.37:0/3247317870 wait complete. 2024-08-20T05:15:27.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:27 smithi037 ceph-mon[17265]: pgmap v797: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 1.7 MiB/s wr, 184 op/s 2024-08-20T05:15:27.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:27 smithi135 ceph-mon[22342]: pgmap v797: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 1.7 MiB/s wr, 184 op/s 2024-08-20T05:15:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:27 smithi130 ceph-mon[22007]: pgmap v797: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 1.7 MiB/s wr, 184 op/s 2024-08-20T05:15:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 750.0 s, 867.6 tps, lat 122.036 ms stddev 149.518 2024-08-20T05:15:28.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T05:15:28.895 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:15:29.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:29 smithi037 ceph-mon[17265]: pgmap v798: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 3.0 MiB/s wr, 261 op/s 2024-08-20T05:15:29.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:29 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:15:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.699+0000 7f712b200640 1 -- 172.21.15.37:0/2695607029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71240986a0 msgr2=0x7f712409ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.699+0000 7f712b200640 1 --2- 172.21.15.37:0/2695607029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71240986a0 0x7f712409ab10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f71180098c0 tx=0x7f711803b370 comp rx=0 tx=0).stop 2024-08-20T05:15:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.699+0000 7f712b200640 1 -- 172.21.15.37:0/2695607029 shutdown_connections 2024-08-20T05:15:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.699+0000 7f712b200640 1 --2- 172.21.15.37:0/2695607029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f712409b250 0x7f712409d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.699+0000 7f712b200640 1 --2- 172.21.15.37:0/2695607029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71240986a0 0x7f712409ab10 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.699+0000 7f712b200640 1 --2- 172.21.15.37:0/2695607029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71240058f0 0x7f7124098110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.699+0000 7f712b200640 1 -- 172.21.15.37:0/2695607029 >> 172.21.15.37:0/2695607029 conn(0x7f712408fce0 msgr2=0x7f7124092120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.702+0000 7f712b200640 1 -- 172.21.15.37:0/2695607029 shutdown_connections 2024-08-20T05:15:29.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.702+0000 7f712b200640 1 -- 172.21.15.37:0/2695607029 wait complete. 2024-08-20T05:15:29.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.704+0000 7f712b200640 1 Processor -- start 2024-08-20T05:15:29.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.704+0000 7f712b200640 1 -- start start 2024-08-20T05:15:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.705+0000 7f712b200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71240058f0 0x7f71240a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.706 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.705+0000 7f712b200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71240986a0 0x7f71240a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.705+0000 7f7129e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71240058f0 0x7f71240a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.705+0000 7f7129e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71240058f0 0x7f71240a1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37510/0 (socket says 172.21.15.37:37510) 2024-08-20T05:15:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.706+0000 7f7129e00640 1 -- 172.21.15.37:0/172371580 learned_addr learned my addr 172.21.15.37:0/172371580 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.706+0000 7f712b200640 1 --2- 172.21.15.37:0/172371580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f712409b250 0x7f71240a23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.706+0000 7f7129400640 1 --2- 172.21.15.37:0/172371580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71240986a0 0x7f71240a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.706+0000 7f712b200640 1 -- 172.21.15.37:0/172371580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f71240943c0 con 0x7f71240986a0 2024-08-20T05:15:29.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.706+0000 7f712b200640 1 -- 172.21.15.37:0/172371580 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7124094240 con 0x7f71240058f0 2024-08-20T05:15:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.706+0000 7f712b200640 1 -- 172.21.15.37:0/172371580 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7124094540 con 0x7f712409b250 2024-08-20T05:15:29.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.706+0000 7f712a800640 1 --2- 172.21.15.37:0/172371580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f712409b250 0x7f71240a23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.707+0000 7f7129e00640 1 -- 172.21.15.37:0/172371580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f712409b250 msgr2=0x7f71240a23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:29.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.707+0000 7f7129e00640 1 --2- 172.21.15.37:0/172371580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f712409b250 0x7f71240a23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.707+0000 7f7129e00640 1 -- 172.21.15.37:0/172371580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71240986a0 msgr2=0x7f71240a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:29.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.707+0000 7f7129e00640 1 --2- 172.21.15.37:0/172371580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71240986a0 0x7f71240a1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.707+0000 7f7129e00640 1 -- 172.21.15.37:0/172371580 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71240a2c80 con 0x7f71240058f0 2024-08-20T05:15:29.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.708+0000 7f7129e00640 1 --2- 172.21.15.37:0/172371580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71240058f0 0x7f71240a1140 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f711c00e9f0 tx=0x7f711c00edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:29.711 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.711+0000 7f7122a00640 1 -- 172.21.15.37:0/172371580 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c00cd80 con 0x7f71240058f0 2024-08-20T05:15:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.711+0000 7f7122a00640 1 -- 172.21.15.37:0/172371580 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f711c005030 con 0x7f71240058f0 2024-08-20T05:15:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.711+0000 7f712b200640 1 -- 172.21.15.37:0/172371580 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71240a2f70 con 0x7f71240058f0 2024-08-20T05:15:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.711+0000 7f7122a00640 1 -- 172.21.15.37:0/172371580 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c004a20 con 0x7f71240058f0 2024-08-20T05:15:29.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.711+0000 7f712b200640 1 -- 172.21.15.37:0/172371580 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71240a3610 con 0x7f71240058f0 2024-08-20T05:15:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.730+0000 7f7134265740 1 Processor -- start 2024-08-20T05:15:29.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.730+0000 7f7134265740 1 -- start start 2024-08-20T05:15:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.731+0000 7f7134265740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c67117f0 0x5648c6713be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.731+0000 7f7134265740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6714120 0x5648c6716510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.731+0000 7f7134265740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c6716b60 0x5648c6719020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.731+0000 7f7134265740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5648c6684210 con 0x5648c67117f0 2024-08-20T05:15:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.731+0000 7f7134265740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5648c6673710 con 0x5648c6716b60 2024-08-20T05:15:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.731+0000 7f7134265740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5648c6677750 con 0x5648c6714120 2024-08-20T05:15:29.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.732+0000 7f712a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c67117f0 0x5648c6713be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.733+0000 7f712a800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c67117f0 0x5648c6713be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40110/0 (socket says 172.21.15.37:40110) 2024-08-20T05:15:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.733+0000 7f712a800640 1 -- 172.21.15.37:0/1551161853 learned_addr learned my addr 172.21.15.37:0/1551161853 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:29.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.733+0000 7f7129400640 1 --2- 172.21.15.37:0/1551161853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c6716b60 0x5648c6719020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.734+0000 7f712a800640 1 -- 172.21.15.37:0/1551161853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6714120 msgr2=0x5648c6716510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:15:29.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.734+0000 7f712a800640 1 --2- 172.21.15.37:0/1551161853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6714120 0x5648c6716510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.734+0000 7f712a800640 1 -- 172.21.15.37:0/1551161853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c6716b60 msgr2=0x5648c6719020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:29.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.734+0000 7f712a800640 1 --2- 172.21.15.37:0/1551161853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c6716b60 0x5648c6719020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.734+0000 7f712a800640 1 -- 172.21.15.37:0/1551161853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648c663fde0 con 0x5648c67117f0 2024-08-20T05:15:29.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.735+0000 7f712a800640 1 --2- 172.21.15.37:0/1551161853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c67117f0 0x5648c6713be0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f712c0692f0 tx=0x7f712c069c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4305f9957179a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:29.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.736+0000 7f7122a00640 1 -- 172.21.15.37:0/172371580 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f711c0051e0 con 0x7f71240058f0 2024-08-20T05:15:29.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.736+0000 7f7117400640 1 -- 172.21.15.37:0/1551161853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c081070 con 0x5648c67117f0 2024-08-20T05:15:29.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.736+0000 7f7117400640 1 -- 172.21.15.37:0/1551161853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f712c07c440 con 0x5648c67117f0 2024-08-20T05:15:29.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.736+0000 7f7117400640 1 -- 172.21.15.37:0/1551161853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c075630 con 0x5648c67117f0 2024-08-20T05:15:29.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.737+0000 7f7134265740 1 -- 172.21.15.37:0/1551161853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c67117f0 msgr2=0x5648c6713be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:29.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.737+0000 7f7134265740 1 --2- 172.21.15.37:0/1551161853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c67117f0 0x5648c6713be0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f712c0692f0 tx=0x7f712c069c20 comp rx=0 tx=0).stop 2024-08-20T05:15:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.738+0000 7f7122a00640 1 --2- 172.21.15.37:0/172371580 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71100b3de0 0x7f71100b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.739+0000 7f712a800640 1 --2- 172.21.15.37:0/172371580 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71100b3de0 0x7f71100b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.743+0000 7f7122a00640 1 -- 172.21.15.37:0/172371580 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f711c0e4150 con 0x7f71240058f0 2024-08-20T05:15:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.743+0000 7f712a800640 1 --2- 172.21.15.37:0/172371580 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71100b3de0 0x7f71100b62a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f712c069820 tx=0x7f712c07cf00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.743+0000 7f7134265740 1 -- 172.21.15.37:0/1551161853 shutdown_connections 2024-08-20T05:15:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.743+0000 7f7134265740 1 --2- 172.21.15.37:0/1551161853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c6716b60 0x5648c6719020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.743+0000 7f7134265740 1 --2- 172.21.15.37:0/1551161853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6714120 0x5648c6716510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.743+0000 7f7134265740 1 --2- 172.21.15.37:0/1551161853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c67117f0 0x5648c6713be0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.743+0000 7f7134265740 1 -- 172.21.15.37:0/1551161853 >> 172.21.15.37:0/1551161853 conn(0x5648c670c940 msgr2=0x5648c670d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:29.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.743+0000 7f7134265740 1 -- 172.21.15.37:0/1551161853 shutdown_connections 2024-08-20T05:15:29.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.743+0000 7f7134265740 1 -- 172.21.15.37:0/1551161853 wait complete. 2024-08-20T05:15:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.746+0000 7f7134265740 1 -- start start 2024-08-20T05:15:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.747+0000 7f7134265740 1 Processor -- start 2024-08-20T05:15:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.748+0000 7f7134265740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c67117f0 0x5648c671af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.748+0000 7f7134265740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c6714120 0x5648c671b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.749+0000 7f7129e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c67117f0 0x5648c671af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.749+0000 7f7129e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c67117f0 0x5648c671af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37524/0 (socket says 172.21.15.37:37524) 2024-08-20T05:15:29.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.749+0000 7f7129400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c6714120 0x5648c671b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.749+0000 7f7129400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c6714120 0x5648c671b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40122/0 (socket says 172.21.15.37:40122) 2024-08-20T05:15:29.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.750+0000 7f7129e00640 1 -- 172.21.15.37:0/2532050375 learned_addr learned my addr 172.21.15.37:0/2532050375 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:29.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.750+0000 7f7134265740 1 --2- 172.21.15.37:0/2532050375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6716b60 0x5648c671c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.750+0000 7f7134265740 1 -- 172.21.15.37:0/2532050375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5648c65acab0 con 0x5648c6714120 2024-08-20T05:15:29.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.750+0000 7f7134265740 1 -- 172.21.15.37:0/2532050375 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5648c661a140 con 0x5648c67117f0 2024-08-20T05:15:29.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.750+0000 7f7134265740 1 -- 172.21.15.37:0/2532050375 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5648c6719b40 con 0x5648c6716b60 2024-08-20T05:15:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.751+0000 7f7134265740 10 client.0 _ll_register_callbacks cb 0x5648c662d5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.752+0000 7f712a800640 1 --2- 172.21.15.37:0/2532050375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6716b60 0x5648c671c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.752+0000 7f7129e00640 1 -- 172.21.15.37:0/2532050375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6716b60 msgr2=0x5648c671c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:29.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.752+0000 7f7129e00640 1 --2- 172.21.15.37:0/2532050375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6716b60 0x5648c671c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.752+0000 7f7129e00640 1 -- 172.21.15.37:0/2532050375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c6714120 msgr2=0x5648c671b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:29.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.752+0000 7f7129e00640 1 --2- 172.21.15.37:0/2532050375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c6714120 0x5648c671b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.752+0000 7f7129e00640 1 -- 172.21.15.37:0/2532050375 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648c661b170 con 0x5648c67117f0 2024-08-20T05:15:29.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.753+0000 7f7129e00640 1 --2- 172.21.15.37:0/2532050375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c67117f0 0x5648c671af50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f711c0a7f10 tx=0x7f711c0aa4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3edc75497bbf4786 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:29.754 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.753+0000 7f710be00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:15:29.755 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.754+0000 7f710be00640 1 -- 172.21.15.37:0/2532050375 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c0aaca0 con 0x5648c67117f0 2024-08-20T05:15:29.755 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.754+0000 7f710be00640 1 -- 172.21.15.37:0/2532050375 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f711c0a7290 con 0x5648c67117f0 2024-08-20T05:15:29.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.755+0000 7f7134265740 1 -- 172.21.15.37:0/2532050375 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f712c07c440 con 0x5648c67117f0 2024-08-20T05:15:29.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.755+0000 7f710be00640 1 -- 172.21.15.37:0/2532050375 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f711c0aaca0 con 0x5648c67117f0 2024-08-20T05:15:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.756+0000 7f7134265740 10 client.28652 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.756+0000 7f7134265740 1 -- 172.21.15.37:0/2532050375 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5648c63d6790 con 0x5648c67117f0 2024-08-20T05:15:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.758+0000 7f710be00640 1 -- 172.21.15.37:0/2532050375 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f711c0af2a0 con 0x5648c67117f0 2024-08-20T05:15:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.758+0000 7f710be00640 1 -- 172.21.15.37:0/2532050375 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f711c020030 con 0x5648c67117f0 2024-08-20T05:15:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.759+0000 7f7134265740 10 client.28652 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.759+0000 7f7134265740 10 client.28652 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.759+0000 7f7134265740 20 client.28652 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.759+0000 7f7134265740 1 --2- 172.21.15.37:0/2532050375 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5648c6726c70 0x5648c6729090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.759+0000 7f7134265740 4 client.28652 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:15:29.761 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.759+0000 7f7134265740 1 -- 172.21.15.37:0/2532050375 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f712c07c440 con 0x5648c6726c70 2024-08-20T05:15:29.763 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.761+0000 7f7129400640 1 --2- 172.21.15.37:0/2532050375 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5648c6726c70 0x5648c6729090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.765+0000 7f7129400640 1 --2- 172.21.15.37:0/2532050375 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5648c6726c70 0x5648c6729090 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a06f6d37652e62b server_cookie=df52b1365e9992d1 in_seq=0 out_seq=0 2024-08-20T05:15:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.765+0000 7f710be00640 10 client.28652 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.766+0000 7f710be00640 1 -- 172.21.15.37:0/2532050375 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f712c07c440 con 0x5648c6726c70 2024-08-20T05:15:29.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.766+0000 7f710be00640 10 client.28652 handle_command_reply: tid=0 2024-08-20T05:15:29.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.766+0000 7f7134265740 1 client.28652 shutdown 2024-08-20T05:15:29.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.767+0000 7f7134265740 1 -- 172.21.15.37:0/2532050375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c67117f0 msgr2=0x5648c671af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:29.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.767+0000 7f7134265740 1 --2- 172.21.15.37:0/2532050375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c67117f0 0x5648c671af50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f711c0a7f10 tx=0x7f711c0aa4d0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.767+0000 7f7134265740 1 -- 172.21.15.37:0/2532050375 shutdown_connections 2024-08-20T05:15:29.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.768+0000 7f7134265740 1 --2- 172.21.15.37:0/2532050375 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5648c6726c70 0x5648c6729090 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.768+0000 7f7134265740 1 --2- 172.21.15.37:0/2532050375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6716b60 0x5648c671c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.768+0000 7f7134265740 1 --2- 172.21.15.37:0/2532050375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c6714120 0x5648c671b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.768+0000 7f710be00640 0 client.28652 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:29.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.768+0000 7f7134265740 1 --2- 172.21.15.37:0/2532050375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c67117f0 0x5648c671af50 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.768+0000 7f7134265740 1 -- 172.21.15.37:0/2532050375 >> 172.21.15.37:0/2532050375 conn(0x5648c670c940 msgr2=0x5648c670b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:29.769 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.768+0000 7f7134265740 1 -- 172.21.15.37:0/2532050375 shutdown_connections 2024-08-20T05:15:29.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.768+0000 7f7134265740 1 -- 172.21.15.37:0/2532050375 wait complete. 2024-08-20T05:15:29.770 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.769+0000 7f7134265740 20 client.28652 trim_cache size 0 max 16384 2024-08-20T05:15:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.790+0000 7f0393200640 1 -- 172.21.15.37:0/3341346892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f039410a7a0 msgr2=0x7f0394115200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.790+0000 7f0393200640 1 --2- 172.21.15.37:0/3341346892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f039410a7a0 0x7f0394115200 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f0380009890 tx=0x7f038002a370 comp rx=0 tx=0).stop 2024-08-20T05:15:29.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.790+0000 7f0393200640 1 -- 172.21.15.37:0/3341346892 shutdown_connections 2024-08-20T05:15:29.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.790+0000 7f0393200640 1 --2- 172.21.15.37:0/3341346892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0394115740 0x7f0394117b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.790+0000 7f0393200640 1 --2- 172.21.15.37:0/3341346892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f039410a7a0 0x7f0394115200 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.790+0000 7f0393200640 1 --2- 172.21.15.37:0/3341346892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0394109e80 0x7f039410a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.790+0000 7f0393200640 1 -- 172.21.15.37:0/3341346892 >> 172.21.15.37:0/3341346892 conn(0x7f039406c830 msgr2=0x7f039406cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:29.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.790+0000 7f0393200640 1 -- 172.21.15.37:0/3341346892 shutdown_connections 2024-08-20T05:15:29.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.790+0000 7f0393200640 1 -- 172.21.15.37:0/3341346892 wait complete. 2024-08-20T05:15:29.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.792+0000 7f0393200640 1 Processor -- start 2024-08-20T05:15:29.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.792+0000 7f0393200640 1 -- start start 2024-08-20T05:15:29.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.793+0000 7f0393200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0394109e80 0x7f039410bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.793+0000 7f0393200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f039410a7a0 0x7f039410c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.793+0000 7f0393200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0394115740 0x7f03941147b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.793+0000 7f0393200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f039411b100 con 0x7f039410a7a0 2024-08-20T05:15:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.793+0000 7f0393200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f039411af80 con 0x7f0394115740 2024-08-20T05:15:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.793+0000 7f0393200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f039411b280 con 0x7f0394109e80 2024-08-20T05:15:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.793+0000 7f0392800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0394115740 0x7f03941147b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.793+0000 7f0392800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0394115740 0x7f03941147b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37540/0 (socket says 172.21.15.37:37540) 2024-08-20T05:15:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.793+0000 7f0392800640 1 -- 172.21.15.37:0/3876954757 learned_addr learned my addr 172.21.15.37:0/3876954757 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.794+0000 7f0392800640 1 -- 172.21.15.37:0/3876954757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0394109e80 msgr2=0x7f039410bd50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T05:15:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.794+0000 7f0392800640 1 --2- 172.21.15.37:0/3876954757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0394109e80 0x7f039410bd50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.794+0000 7f0392800640 1 -- 172.21.15.37:0/3876954757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f039410a7a0 msgr2=0x7f039410c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.794+0000 7f0392800640 1 --2- 172.21.15.37:0/3876954757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f039410a7a0 0x7f039410c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.794+0000 7f0392800640 1 -- 172.21.15.37:0/3876954757 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0394114f30 con 0x7f0394115740 2024-08-20T05:15:29.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.795+0000 7f0392800640 1 --2- 172.21.15.37:0/3876954757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0394115740 0x7f03941147b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f038c00ed70 tx=0x7f038c00c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:29.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.796+0000 7f038aa00640 1 -- 172.21.15.37:0/3876954757 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c003b70 con 0x7f0394115740 2024-08-20T05:15:29.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.796+0000 7f038aa00640 1 -- 172.21.15.37:0/3876954757 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f038c003d10 con 0x7f0394115740 2024-08-20T05:15:29.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.796+0000 7f038aa00640 1 -- 172.21.15.37:0/3876954757 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c017830 con 0x7f0394115740 2024-08-20T05:15:29.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.796+0000 7f0393200640 1 -- 172.21.15.37:0/3876954757 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0394115220 con 0x7f0394115740 2024-08-20T05:15:29.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.796+0000 7f0393200640 1 -- 172.21.15.37:0/3876954757 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0394111630 con 0x7f0394115740 2024-08-20T05:15:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.802+0000 7f7134265740 1 Processor -- start 2024-08-20T05:15:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.802+0000 7f7134265740 1 -- start start 2024-08-20T05:15:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.802+0000 7f7134265740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c67117f0 0x5648c6717650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.802+0000 7f7134265740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6714120 0x5648c6722e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.802+0000 7f7134265740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c6716b60 0x5648c670d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.802+0000 7f7134265740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7124144670 con 0x5648c67117f0 2024-08-20T05:15:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.802+0000 7f7134265740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f71241461b0 con 0x5648c6716b60 2024-08-20T05:15:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.802+0000 7f7134265740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7124144d40 con 0x5648c6714120 2024-08-20T05:15:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.803+0000 7f712a800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c6716b60 0x5648c670d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.803+0000 7f712a800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c6716b60 0x5648c670d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37556/0 (socket says 172.21.15.37:37556) 2024-08-20T05:15:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.803+0000 7f712a800640 1 -- 172.21.15.37:0/2320557263 learned_addr learned my addr 172.21.15.37:0/2320557263 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.803+0000 7f7129400640 1 --2- 172.21.15.37:0/2320557263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6714120 0x5648c6722e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.803+0000 7f039ba68740 1 Processor -- start 2024-08-20T05:15:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.803+0000 7f712a800640 1 -- 172.21.15.37:0/2320557263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6714120 msgr2=0x5648c6722e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.803+0000 7f712a800640 1 --2- 172.21.15.37:0/2320557263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6714120 0x5648c6722e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.803+0000 7f712a800640 1 -- 172.21.15.37:0/2320557263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c67117f0 msgr2=0x5648c6717650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.803+0000 7f712a800640 1 --2- 172.21.15.37:0/2320557263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c67117f0 0x5648c6717650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.805 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.803+0000 7f712a800640 1 -- 172.21.15.37:0/2320557263 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648c644f620 con 0x5648c6716b60 2024-08-20T05:15:29.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.807+0000 7f038aa00640 1 -- 172.21.15.37:0/3876954757 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f038c0179d0 con 0x7f0394115740 2024-08-20T05:15:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.811+0000 7f712a800640 1 --2- 172.21.15.37:0/2320557263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c6716b60 0x5648c670d1a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f712c068b40 tx=0x7f712c089000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1c324dbfe48a33f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:29.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.809+0000 7f038aa00640 1 --2- 172.21.15.37:0/3876954757 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03780b3e90 0x7f03780b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.810+0000 7f038aa00640 1 -- 172.21.15.37:0/3876954757 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f038c0e43b0 con 0x7f0394115740 2024-08-20T05:15:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.810+0000 7f039ba68740 1 -- start start 2024-08-20T05:15:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.811+0000 7f039ba68740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 0x55dc90a1aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.811+0000 7f039ba68740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a26e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.811+0000 7f039ba68740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a29760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.811+0000 7f039ba68740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dc90990aa0 con 0x55dc90a27370 2024-08-20T05:15:29.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.811+0000 7f039ba68740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55dc9097ffa0 con 0x55dc90a1b3e0 2024-08-20T05:15:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.811+0000 7f039ba68740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55dc90983fe0 con 0x55dc90a1aac0 2024-08-20T05:15:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.811+0000 7f0391400640 1 --2- 172.21.15.37:0/3876954757 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03780b3e90 0x7f03780b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.812+0000 7f0392800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a29760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.812+0000 7f0392800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a29760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40150/0 (socket says 172.21.15.37:40150) 2024-08-20T05:15:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.812+0000 7f0392800640 1 -- 172.21.15.37:0/609702888 learned_addr learned my addr 172.21.15.37:0/609702888 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.813+0000 7f0392800640 1 -- 172.21.15.37:0/609702888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 msgr2=0x55dc90a1aea0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:15:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.813+0000 7f0392800640 1 --2- 172.21.15.37:0/609702888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 0x55dc90a1aea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.813+0000 7f0392800640 1 -- 172.21.15.37:0/609702888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 msgr2=0x55dc90a26e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.813+0000 7f0392800640 1 --2- 172.21.15.37:0/609702888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a26e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.813+0000 7f0392800640 1 -- 172.21.15.37:0/609702888 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc90926420 con 0x55dc90a27370 2024-08-20T05:15:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.813+0000 7f0392800640 1 --2- 172.21.15.37:0/609702888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a29760 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f038c0a8170 tx=0x7f038c0aaa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec5bf2e5600dfd1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.815+0000 7f7116a00640 1 -- 172.21.15.37:0/2320557263 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c081040 con 0x5648c6716b60 2024-08-20T05:15:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.815+0000 7f7116a00640 1 -- 172.21.15.37:0/2320557263 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f712c07c440 con 0x5648c6716b60 2024-08-20T05:15:29.816 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.815+0000 7f7116a00640 1 -- 172.21.15.37:0/2320557263 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c088660 con 0x5648c6716b60 2024-08-20T05:15:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.814+0000 7f037f400640 1 -- 172.21.15.37:0/609702888 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c0e4180 con 0x55dc90a27370 2024-08-20T05:15:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.819+0000 7f7134265740 1 -- 172.21.15.37:0/2320557263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c6716b60 msgr2=0x5648c670d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.816+0000 7f037f400640 1 -- 172.21.15.37:0/609702888 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f038c0af500 con 0x55dc90a27370 2024-08-20T05:15:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.817+0000 7f039ba68740 1 -- 172.21.15.37:0/609702888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 msgr2=0x55dc90a29760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.817+0000 7f039ba68740 1 --2- 172.21.15.37:0/609702888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a29760 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f038c0a8170 tx=0x7f038c0aaa10 comp rx=0 tx=0).stop 2024-08-20T05:15:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.817+0000 7f0391400640 1 --2- 172.21.15.37:0/3876954757 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03780b3e90 0x7f03780b6350 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x55dc90a197d0 tx=0x7f03800056d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.817+0000 7f039ba68740 1 -- 172.21.15.37:0/609702888 shutdown_connections 2024-08-20T05:15:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.817+0000 7f039ba68740 1 --2- 172.21.15.37:0/609702888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a29760 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.819+0000 7f7134265740 1 --2- 172.21.15.37:0/2320557263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c6716b60 0x5648c670d1a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f712c068b40 tx=0x7f712c089000 comp rx=0 tx=0).stop 2024-08-20T05:15:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.820+0000 7f7134265740 1 -- 172.21.15.37:0/2320557263 shutdown_connections 2024-08-20T05:15:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.817+0000 7f039ba68740 1 --2- 172.21.15.37:0/609702888 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a26e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.817+0000 7f039ba68740 1 --2- 172.21.15.37:0/609702888 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 0x55dc90a1aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.817+0000 7f039ba68740 1 -- 172.21.15.37:0/609702888 >> 172.21.15.37:0/609702888 conn(0x55dc90a188f0 msgr2=0x55dc90a19a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.818+0000 7f039ba68740 1 -- 172.21.15.37:0/609702888 shutdown_connections 2024-08-20T05:15:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.820+0000 7f7134265740 1 --2- 172.21.15.37:0/2320557263 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c6716b60 0x5648c670d1a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.822 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.820+0000 7f7134265740 1 --2- 172.21.15.37:0/2320557263 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6714120 0x5648c6722e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.820+0000 7f7134265740 1 --2- 172.21.15.37:0/2320557263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c67117f0 0x5648c6717650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.820+0000 7f7134265740 1 -- 172.21.15.37:0/2320557263 >> 172.21.15.37:0/2320557263 conn(0x5648c670c940 msgr2=0x5648c6716f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.819+0000 7f039ba68740 1 -- 172.21.15.37:0/609702888 wait complete. 2024-08-20T05:15:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.819+0000 7f039ba68740 1 -- start start 2024-08-20T05:15:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.820+0000 7f039ba68740 1 Processor -- start 2024-08-20T05:15:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.821+0000 7f7134265740 1 -- 172.21.15.37:0/2320557263 shutdown_connections 2024-08-20T05:15:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.821+0000 7f7134265740 1 -- 172.21.15.37:0/2320557263 wait complete. 2024-08-20T05:15:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.822+0000 7f7134265740 1 -- start start 2024-08-20T05:15:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.822+0000 7f7134265740 1 Processor -- start 2024-08-20T05:15:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.825+0000 7f7134265740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c67117f0 0x5648c671fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.825+0000 7f7134265740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6714120 0x5648c67201c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.825+0000 7f7134265740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c6716b60 0x5648c6720d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.821+0000 7f039ba68740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 0x55dc90a26ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.821+0000 7f039ba68740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a23f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.821+0000 7f039ba68740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a24450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.822+0000 7f039ba68740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dc907e2700 con 0x55dc90a27370 2024-08-20T05:15:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.822+0000 7f039ba68740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55dc9091b290 con 0x55dc90a1b3e0 2024-08-20T05:15:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.822+0000 7f039ba68740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55dc90a2a040 con 0x55dc90a1aac0 2024-08-20T05:15:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.822+0000 7f039ba68740 10 client.0 _ll_register_callbacks cb 0x55dc9097a1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.823+0000 7f0392800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a24450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.823+0000 7f0392800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a24450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40166/0 (socket says 172.21.15.37:40166) 2024-08-20T05:15:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.823+0000 7f0392800640 1 -- 172.21.15.37:0/3429209970 learned_addr learned my addr 172.21.15.37:0/3429209970 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.824+0000 7f0392800640 1 -- 172.21.15.37:0/3429209970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 msgr2=0x55dc90a26ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.824+0000 7f0391400640 1 --2- 172.21.15.37:0/3429209970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a23f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.824+0000 7f0391e00640 1 --2- 172.21.15.37:0/3429209970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 0x55dc90a26ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.825+0000 7f0392800640 1 --2- 172.21.15.37:0/3429209970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 0x55dc90a26ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.825+0000 7f0392800640 1 -- 172.21.15.37:0/3429209970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 msgr2=0x55dc90a23f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.825+0000 7f0392800640 1 --2- 172.21.15.37:0/3429209970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a23f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.825+0000 7f0392800640 1 -- 172.21.15.37:0/3429209970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc906df650 con 0x55dc90a27370 2024-08-20T05:15:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.825+0000 7f0391400640 1 --2- 172.21.15.37:0/3429209970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a23f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.825+0000 7f0391e00640 1 --2- 172.21.15.37:0/3429209970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 0x55dc90a26ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.825+0000 7f7134265740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7124145ae0 con 0x5648c6716b60 2024-08-20T05:15:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.825+0000 7f7134265740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7124145410 con 0x5648c67117f0 2024-08-20T05:15:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.825+0000 7f7134265740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7124142650 con 0x5648c6714120 2024-08-20T05:15:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.826+0000 7f7134265740 10 client.0 _ll_register_callbacks cb 0x7f711c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.826+0000 7f7129e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c67117f0 0x5648c671fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.827+0000 7f7129e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c67117f0 0x5648c671fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37578/0 (socket says 172.21.15.37:37578) 2024-08-20T05:15:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.827+0000 7f7129e00640 1 -- 172.21.15.37:0/3967492199 learned_addr learned my addr 172.21.15.37:0/3967492199 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.827+0000 7f7129400640 1 --2- 172.21.15.37:0/3967492199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6714120 0x5648c67201c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.827+0000 7f7129e00640 1 -- 172.21.15.37:0/3967492199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6714120 msgr2=0x5648c67201c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.828+0000 7f712a800640 1 --2- 172.21.15.37:0/3967492199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c6716b60 0x5648c6720d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.828+0000 7f7129e00640 1 --2- 172.21.15.37:0/3967492199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6714120 0x5648c67201c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.828+0000 7f7129e00640 1 -- 172.21.15.37:0/3967492199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c6716b60 msgr2=0x5648c6720d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.828+0000 7f7129e00640 1 --2- 172.21.15.37:0/3967492199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c6716b60 0x5648c6720d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.828+0000 7f7129e00640 1 -- 172.21.15.37:0/3967492199 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648c67215c0 con 0x5648c67117f0 2024-08-20T05:15:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.828+0000 7f7129400640 1 --2- 172.21.15.37:0/3967492199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6714120 0x5648c67201c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:15:29.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.828+0000 7f0392800640 1 --2- 172.21.15.37:0/3429209970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a24450 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f038c009330 tx=0x7f038c0a6d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9b33b8f0576d21 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:29.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.828+0000 7f0373e00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:15:29.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.829+0000 7f710be00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:15:29.831 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.829+0000 7f7129e00640 1 --2- 172.21.15.37:0/3967492199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c67117f0 0x5648c671fb20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f711c0a7240 tx=0x7f711c005a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b9faa9f107909b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.829+0000 7f710be00640 1 -- 172.21.15.37:0/3967492199 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711c0b7070 con 0x5648c67117f0 2024-08-20T05:15:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.830+0000 7f710be00640 1 -- 172.21.15.37:0/3967492199 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f711c0a9f00 con 0x5648c67117f0 2024-08-20T05:15:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.830+0000 7f7134265740 1 -- 172.21.15.37:0/3967492199 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f712c07c440 con 0x5648c67117f0 2024-08-20T05:15:29.832 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.832+0000 7f710be00640 1 -- 172.21.15.37:0/3967492199 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f711c0c0050 con 0x5648c67117f0 2024-08-20T05:15:29.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.832+0000 7f7134265740 10 client.28664 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:29.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.832+0000 7f7134265740 1 -- 172.21.15.37:0/3967492199 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5648c67229a0 con 0x5648c67117f0 2024-08-20T05:15:29.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.832+0000 7f710be00640 1 -- 172.21.15.37:0/3967492199 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f712c07c440 con 0x5648c67117f0 2024-08-20T05:15:29.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.832+0000 7f710be00640 1 -- 172.21.15.37:0/3967492199 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f711c020040 con 0x5648c67117f0 2024-08-20T05:15:29.833 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.833+0000 7f7134265740 10 client.28664 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:29.834 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.833+0000 7f7134265740 10 client.28664 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.833+0000 7f7134265740 20 client.28664 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.833+0000 7f7134265740 1 --2- 172.21.15.37:0/3967492199 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5648c6791930 0x5648c6793d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.835 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.833+0000 7f7134265740 4 client.28664 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:15:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.833+0000 7f7134265740 1 -- 172.21.15.37:0/3967492199 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5648c6686160 con 0x5648c6791930 2024-08-20T05:15:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.833+0000 7f7129400640 1 --2- 172.21.15.37:0/3967492199 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5648c6791930 0x5648c6793d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.834+0000 7f7129400640 1 --2- 172.21.15.37:0/3967492199 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5648c6791930 0x5648c6793d20 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=198b0b8f891c21d5 server_cookie=b15ca7942e8befe6 in_seq=0 out_seq=0 2024-08-20T05:15:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.834+0000 7f710be00640 10 client.28664 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:29.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.832+0000 7f0373e00640 1 -- 172.21.15.37:0/3429209970 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c0ca060 con 0x55dc90a27370 2024-08-20T05:15:29.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.832+0000 7f0373e00640 1 -- 172.21.15.37:0/3429209970 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f038c0aa370 con 0x55dc90a27370 2024-08-20T05:15:29.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.833+0000 7f039ba68740 1 -- 172.21.15.37:0/3429209970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f038c0af500 con 0x55dc90a27370 2024-08-20T05:15:29.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.833+0000 7f0373e00640 1 -- 172.21.15.37:0/3429209970 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f038c0a9bd0 con 0x55dc90a27370 2024-08-20T05:15:29.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.834+0000 7f039ba68740 10 client.18033 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:29.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.834+0000 7f039ba68740 1 -- 172.21.15.37:0/3429209970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55dc90a35850 con 0x55dc90a27370 2024-08-20T05:15:29.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.837+0000 7f0373e00640 1 -- 172.21.15.37:0/3429209970 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f038c0af500 con 0x55dc90a27370 2024-08-20T05:15:29.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.838+0000 7f0373e00640 1 -- 172.21.15.37:0/3429209970 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f038c00b030 con 0x55dc90a27370 2024-08-20T05:15:29.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.838+0000 7f039ba68740 10 client.18033 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:29.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.838+0000 7f039ba68740 10 client.18033 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:15:29.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.838+0000 7f039ba68740 20 client.18033 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:29.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.838+0000 7f039ba68740 1 --2- 172.21.15.37:0/3429209970 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55dc90a36ba0 0x55dc90a38f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.838+0000 7f039ba68740 4 client.18033 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:15:29.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.838+0000 7f039ba68740 1 -- 172.21.15.37:0/3429209970 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc909929f0 con 0x55dc90a36ba0 2024-08-20T05:15:29.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.839+0000 7f0391e00640 1 --2- 172.21.15.37:0/3429209970 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55dc90a36ba0 0x55dc90a38f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.840+0000 7f0391e00640 1 --2- 172.21.15.37:0/3429209970 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55dc90a36ba0 0x55dc90a38f90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=16c04a86f9b8f903 server_cookie=eadd6254ad536cf9 in_seq=0 out_seq=0 2024-08-20T05:15:29.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.840+0000 7f0373e00640 10 client.18033 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:15:29.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.841+0000 7f0373e00640 1 -- 172.21.15.37:0/3429209970 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dc909929f0 con 0x55dc90a36ba0 2024-08-20T05:15:29.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.841+0000 7f0373e00640 10 client.18033 handle_command_reply: tid=0 2024-08-20T05:15:29.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.841+0000 7f039ba68740 1 client.18033 shutdown 2024-08-20T05:15:29.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.844+0000 7f039ba68740 1 -- 172.21.15.37:0/3429209970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 msgr2=0x55dc90a24450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:29.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.844+0000 7f039ba68740 1 --2- 172.21.15.37:0/3429209970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a24450 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f038c009330 tx=0x7f038c0a6d00 comp rx=0 tx=0).stop 2024-08-20T05:15:29.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.845+0000 7f039ba68740 1 -- 172.21.15.37:0/3429209970 shutdown_connections 2024-08-20T05:15:29.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.845+0000 7f039ba68740 1 --2- 172.21.15.37:0/3429209970 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55dc90a36ba0 0x55dc90a38f90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.845+0000 7f039ba68740 1 --2- 172.21.15.37:0/3429209970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a24450 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.845+0000 7f039ba68740 1 --2- 172.21.15.37:0/3429209970 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a23f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.845+0000 7f0373e00640 0 client.18033 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:15:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.845+0000 7f039ba68740 1 --2- 172.21.15.37:0/3429209970 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 0x55dc90a26ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.845+0000 7f039ba68740 1 -- 172.21.15.37:0/3429209970 >> 172.21.15.37:0/3429209970 conn(0x55dc90a188f0 msgr2=0x55dc90a1e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.846+0000 7f039ba68740 1 -- 172.21.15.37:0/3429209970 shutdown_connections 2024-08-20T05:15:29.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.846+0000 7f039ba68740 1 -- 172.21.15.37:0/3429209970 wait complete. 2024-08-20T05:15:29.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.846+0000 7f039ba68740 20 client.18033 trim_cache size 0 max 16384 2024-08-20T05:15:29.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:29 smithi135 ceph-mon[22342]: pgmap v798: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 3.0 MiB/s wr, 261 op/s 2024-08-20T05:15:29.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:29 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:15:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.874+0000 7f710be00640 1 -- 172.21.15.37:0/3967492199 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5648c6686160 con 0x5648c6791930 2024-08-20T05:15:29.875 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.874+0000 7f710be00640 10 client.28664 handle_command_reply: tid=0 2024-08-20T05:15:29.876 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.874+0000 7f7134265740 1 client.28664 shutdown 2024-08-20T05:15:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.875+0000 7f7134265740 1 -- 172.21.15.37:0/3967492199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c67117f0 msgr2=0x5648c671fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.875+0000 7f7134265740 1 --2- 172.21.15.37:0/3967492199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c67117f0 0x5648c671fb20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f711c0a7240 tx=0x7f711c005a50 comp rx=0 tx=0).stop 2024-08-20T05:15:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.875+0000 7f7134265740 1 -- 172.21.15.37:0/3967492199 shutdown_connections 2024-08-20T05:15:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.875+0000 7f7134265740 1 --2- 172.21.15.37:0/3967492199 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5648c6791930 0x5648c6793d20 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.875+0000 7f7134265740 1 --2- 172.21.15.37:0/3967492199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648c6716b60 0x5648c6720d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.875+0000 7f710be00640 0 client.28664 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.875+0000 7f7134265740 1 --2- 172.21.15.37:0/3967492199 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648c6714120 0x5648c67201c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.877 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.875+0000 7f7134265740 1 --2- 172.21.15.37:0/3967492199 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648c67117f0 0x5648c671fb20 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.875+0000 7f7134265740 1 -- 172.21.15.37:0/3967492199 >> 172.21.15.37:0/3967492199 conn(0x5648c670c940 msgr2=0x5648c6710870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.875+0000 7f7134265740 1 -- 172.21.15.37:0/3967492199 shutdown_connections 2024-08-20T05:15:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.876+0000 7f7134265740 1 -- 172.21.15.37:0/3967492199 wait complete. 2024-08-20T05:15:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.876+0000 7f7134265740 20 client.28664 trim_cache size 0 max 16384 2024-08-20T05:15:29.878 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:15:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:15:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:15:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:15:29.879 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.877+0000 7f712b200640 1 -- 172.21.15.37:0/172371580 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71100b3de0 msgr2=0x7f71100b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.879+0000 7f712b200640 1 --2- 172.21.15.37:0/172371580 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71100b3de0 0x7f71100b62a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f712c069820 tx=0x7f712c07cf00 comp rx=0 tx=0).stop 2024-08-20T05:15:29.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.879+0000 7f039ba68740 1 Processor -- start 2024-08-20T05:15:29.880 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.879+0000 7f712b200640 1 -- 172.21.15.37:0/172371580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71240058f0 msgr2=0x7f71240a1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.879+0000 7f712b200640 1 --2- 172.21.15.37:0/172371580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71240058f0 0x7f71240a1140 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f711c00e9f0 tx=0x7f711c00edf0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.880+0000 7f712b200640 1 -- 172.21.15.37:0/172371580 shutdown_connections 2024-08-20T05:15:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.880+0000 7f712b200640 1 --2- 172.21.15.37:0/172371580 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71100b3de0 0x7f71100b62a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.880+0000 7f712b200640 1 --2- 172.21.15.37:0/172371580 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f712409b250 0x7f71240a23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.880+0000 7f712b200640 1 --2- 172.21.15.37:0/172371580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71240986a0 0x7f71240a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.880+0000 7f712b200640 1 --2- 172.21.15.37:0/172371580 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f71240058f0 0x7f71240a1140 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.881 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.880+0000 7f712b200640 1 -- 172.21.15.37:0/172371580 >> 172.21.15.37:0/172371580 conn(0x7f712408fce0 msgr2=0x7f71240900c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:29.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.879+0000 7f039ba68740 1 -- start start 2024-08-20T05:15:29.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.879+0000 7f039ba68740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 0x55dc90a139d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.879+0000 7f039ba68740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a21160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.879+0000 7f039ba68740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a216a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.879+0000 7f039ba68740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f03941c6ba0 con 0x55dc90a27370 2024-08-20T05:15:29.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.879+0000 7f039ba68740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f03941c86e0 con 0x55dc90a1b3e0 2024-08-20T05:15:29.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.879+0000 7f039ba68740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03941c7270 con 0x55dc90a1aac0 2024-08-20T05:15:29.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.880+0000 7f0392800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a216a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.881+0000 7f0391400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a21160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.881+0000 7f0391400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a21160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37590/0 (socket says 172.21.15.37:37590) 2024-08-20T05:15:29.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.881+0000 7f0391400640 1 -- 172.21.15.37:0/2926436280 learned_addr learned my addr 172.21.15.37:0/2926436280 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:29.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.881+0000 7f0391e00640 1 --2- 172.21.15.37:0/2926436280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 0x55dc90a139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.881+0000 7f0392800640 1 -- 172.21.15.37:0/2926436280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 msgr2=0x55dc90a139d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:29.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.881+0000 7f0392800640 1 --2- 172.21.15.37:0/2926436280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 0x55dc90a139d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.882+0000 7f0392800640 1 -- 172.21.15.37:0/2926436280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 msgr2=0x55dc90a21160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:29.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.882+0000 7f0392800640 1 --2- 172.21.15.37:0/2926436280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a21160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.882+0000 7f0392800640 1 -- 172.21.15.37:0/2926436280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc90a22e90 con 0x55dc90a27370 2024-08-20T05:15:29.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.882+0000 7f0391e00640 1 --2- 172.21.15.37:0/2926436280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 0x55dc90a139d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:29.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.882+0000 7f0391400640 1 --2- 172.21.15.37:0/2926436280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a21160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:15:29.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.883+0000 7f0392800640 1 --2- 172.21.15.37:0/2926436280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a216a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f038c0a74a0 tx=0x7f038c0aaa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2b8fae451e41e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:29.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.884+0000 7f037ea00640 1 -- 172.21.15.37:0/2926436280 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c0ca040 con 0x55dc90a27370 2024-08-20T05:15:29.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.884+0000 7f037ea00640 1 -- 172.21.15.37:0/2926436280 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f038c0af500 con 0x55dc90a27370 2024-08-20T05:15:29.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.885+0000 7f037ea00640 1 -- 172.21.15.37:0/2926436280 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c00c090 con 0x55dc90a27370 2024-08-20T05:15:29.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.885+0000 7f039ba68740 1 -- 172.21.15.37:0/2926436280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 msgr2=0x55dc90a216a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:29.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.885+0000 7f039ba68740 1 --2- 172.21.15.37:0/2926436280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a216a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f038c0a74a0 tx=0x7f038c0aaa10 comp rx=0 tx=0).stop 2024-08-20T05:15:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.886+0000 7f712b200640 1 -- 172.21.15.37:0/172371580 shutdown_connections 2024-08-20T05:15:29.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:29.886+0000 7f712b200640 1 -- 172.21.15.37:0/172371580 wait complete. 2024-08-20T05:15:29.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.886+0000 7f039ba68740 1 -- 172.21.15.37:0/2926436280 shutdown_connections 2024-08-20T05:15:29.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.886+0000 7f039ba68740 1 --2- 172.21.15.37:0/2926436280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a216a0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.886+0000 7f039ba68740 1 --2- 172.21.15.37:0/2926436280 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a21160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.886+0000 7f039ba68740 1 --2- 172.21.15.37:0/2926436280 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 0x55dc90a139d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.886+0000 7f039ba68740 1 -- 172.21.15.37:0/2926436280 >> 172.21.15.37:0/2926436280 conn(0x55dc90a188f0 msgr2=0x55dc90a25d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:29.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.886+0000 7f039ba68740 1 -- 172.21.15.37:0/2926436280 shutdown_connections 2024-08-20T05:15:29.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.886+0000 7f039ba68740 1 -- 172.21.15.37:0/2926436280 wait complete. 2024-08-20T05:15:29.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.888+0000 7f039ba68740 1 -- start start 2024-08-20T05:15:29.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.889+0000 7f039ba68740 1 Processor -- start 2024-08-20T05:15:29.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.890+0000 7f039ba68740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 0x55dc90a39e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.890+0000 7f039ba68740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a3a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.890+0000 7f039ba68740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a3a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.890+0000 7f039ba68740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f03941c8010 con 0x55dc90a27370 2024-08-20T05:15:29.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.890+0000 7f039ba68740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f03941c7940 con 0x55dc90a1b3e0 2024-08-20T05:15:29.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.890+0000 7f039ba68740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03941c4c30 con 0x55dc90a1aac0 2024-08-20T05:15:29.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.892+0000 7f0391e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 0x55dc90a39e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.892+0000 7f0391400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a3a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.892+0000 7f0391400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a3a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37596/0 (socket says 172.21.15.37:37596) 2024-08-20T05:15:29.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.892+0000 7f0391400640 1 -- 172.21.15.37:0/1929631395 learned_addr learned my addr 172.21.15.37:0/1929631395 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:29.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.892+0000 7f039ba68740 10 client.0 _ll_register_callbacks cb 0x7f038c0aa740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:29.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.893+0000 7f0392800640 1 --2- 172.21.15.37:0/1929631395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a3a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.893+0000 7f0391400640 1 -- 172.21.15.37:0/1929631395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 msgr2=0x55dc90a39e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:29.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.893+0000 7f0391400640 1 --2- 172.21.15.37:0/1929631395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 0x55dc90a39e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.893+0000 7f0391400640 1 -- 172.21.15.37:0/1929631395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 msgr2=0x55dc90a3a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:29.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.894+0000 7f0391400640 1 --2- 172.21.15.37:0/1929631395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a3a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.894+0000 7f0391400640 1 -- 172.21.15.37:0/1929631395 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc90aa0530 con 0x55dc90a1b3e0 2024-08-20T05:15:29.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.894+0000 7f0392800640 1 --2- 172.21.15.37:0/1929631395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a3a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:29.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.895+0000 7f0373e00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:15:29.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.895+0000 7f0391400640 1 --2- 172.21.15.37:0/1929631395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a3a370 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0380005b60 tx=0x7f0380005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2338ecb34f94ac2b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:29.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.898+0000 7f0373e00640 1 -- 172.21.15.37:0/1929631395 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380037040 con 0x55dc90a1b3e0 2024-08-20T05:15:29.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.898+0000 7f039ba68740 1 -- 172.21.15.37:0/1929631395 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f038c0af500 con 0x55dc90a1b3e0 2024-08-20T05:15:29.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.898+0000 7f0373e00640 1 -- 172.21.15.37:0/1929631395 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f038003dbc0 con 0x55dc90a1b3e0 2024-08-20T05:15:29.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.899+0000 7f0373e00640 1 -- 172.21.15.37:0/1929631395 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f03800308e0 con 0x55dc90a1b3e0 2024-08-20T05:15:29.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.900+0000 7f039ba68740 10 client.28670 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:29.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.900+0000 7f039ba68740 1 -- 172.21.15.37:0/1929631395 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x55dc90aa17b0 con 0x55dc90a1b3e0 2024-08-20T05:15:29.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.900+0000 7f0373e00640 1 -- 172.21.15.37:0/1929631395 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f038c0af500 con 0x55dc90a1b3e0 2024-08-20T05:15:29.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.900+0000 7f0373e00640 1 -- 172.21.15.37:0/1929631395 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f0380055030 con 0x55dc90a1b3e0 2024-08-20T05:15:29.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.901+0000 7f039ba68740 10 client.28670 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:29.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.901+0000 7f039ba68740 10 client.28670 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:15:29.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.901+0000 7f039ba68740 20 client.28670 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:29.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.901+0000 7f039ba68740 1 --2- 172.21.15.37:0/1929631395 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55dc90aa1f60 0x55dc90aa4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:29.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.901+0000 7f039ba68740 4 client.28670 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:15:29.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.901+0000 7f039ba68740 1 -- 172.21.15.37:0/1929631395 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dc9098e490 con 0x55dc90aa1f60 2024-08-20T05:15:29.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.901+0000 7f0391e00640 1 --2- 172.21.15.37:0/1929631395 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55dc90aa1f60 0x55dc90aa4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:29.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.902+0000 7f0391e00640 1 --2- 172.21.15.37:0/1929631395 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55dc90aa1f60 0x55dc90aa4380 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5bd9e50d8d338337 server_cookie=3e151d69c028819f in_seq=0 out_seq=0 2024-08-20T05:15:29.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.902+0000 7f0373e00640 10 client.28670 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:15:29.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.902+0000 7f0373e00640 1 -- 172.21.15.37:0/1929631395 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dc9098e490 con 0x55dc90aa1f60 2024-08-20T05:15:29.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.902+0000 7f0373e00640 10 client.28670 handle_command_reply: tid=0 2024-08-20T05:15:29.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.902+0000 7f039ba68740 1 client.28670 shutdown 2024-08-20T05:15:29.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.903+0000 7f039ba68740 1 -- 172.21.15.37:0/1929631395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 msgr2=0x55dc90a3a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:29.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.903+0000 7f039ba68740 1 --2- 172.21.15.37:0/1929631395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a3a370 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0380005b60 tx=0x7f0380005f90 comp rx=0 tx=0).stop 2024-08-20T05:15:29.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.903+0000 7f039ba68740 1 -- 172.21.15.37:0/1929631395 shutdown_connections 2024-08-20T05:15:29.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.903+0000 7f039ba68740 1 --2- 172.21.15.37:0/1929631395 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x55dc90aa1f60 0x55dc90aa4380 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.903+0000 7f039ba68740 1 --2- 172.21.15.37:0/1929631395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc90a27370 0x55dc90a3a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.903+0000 7f039ba68740 1 --2- 172.21.15.37:0/1929631395 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55dc90a1b3e0 0x55dc90a3a370 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.903+0000 7f0373e00640 0 client.28670 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:15:29.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.903+0000 7f039ba68740 1 --2- 172.21.15.37:0/1929631395 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55dc90a1aac0 0x55dc90a39e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.903+0000 7f039ba68740 1 -- 172.21.15.37:0/1929631395 >> 172.21.15.37:0/1929631395 conn(0x55dc90a188f0 msgr2=0x55dc90a172b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:29.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.903+0000 7f039ba68740 1 -- 172.21.15.37:0/1929631395 shutdown_connections 2024-08-20T05:15:29.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.903+0000 7f039ba68740 1 -- 172.21.15.37:0/1929631395 wait complete. 2024-08-20T05:15:29.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.904+0000 7f039ba68740 20 client.28670 trim_cache size 0 max 16384 2024-08-20T05:15:29.907 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:15:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.907+0000 7f0393200640 1 -- 172.21.15.37:0/3876954757 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03780b3e90 msgr2=0x7f03780b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.907+0000 7f0393200640 1 --2- 172.21.15.37:0/3876954757 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03780b3e90 0x7f03780b6350 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x55dc90a197d0 tx=0x7f03800056d0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.907+0000 7f0393200640 1 -- 172.21.15.37:0/3876954757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0394115740 msgr2=0x7f03941147b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.907+0000 7f0393200640 1 --2- 172.21.15.37:0/3876954757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0394115740 0x7f03941147b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f038c00ed70 tx=0x7f038c00c6e0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.907+0000 7f0393200640 1 -- 172.21.15.37:0/3876954757 shutdown_connections 2024-08-20T05:15:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.907+0000 7f0393200640 1 --2- 172.21.15.37:0/3876954757 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03780b3e90 0x7f03780b6350 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.907+0000 7f0393200640 1 --2- 172.21.15.37:0/3876954757 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0394115740 0x7f03941147b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.907+0000 7f0393200640 1 --2- 172.21.15.37:0/3876954757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f039410a7a0 0x7f039410c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.907+0000 7f0393200640 1 --2- 172.21.15.37:0/3876954757 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0394109e80 0x7f039410bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.907+0000 7f0393200640 1 -- 172.21.15.37:0/3876954757 >> 172.21.15.37:0/3876954757 conn(0x7f039406c830 msgr2=0x7f0394072420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.908+0000 7f0393200640 1 -- 172.21.15.37:0/3876954757 shutdown_connections 2024-08-20T05:15:29.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:29.908+0000 7f0393200640 1 -- 172.21.15.37:0/3876954757 wait complete. 2024-08-20T05:15:29.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:29 smithi130 ceph-mon[22007]: pgmap v798: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 3.0 MiB/s wr, 261 op/s 2024-08-20T05:15:29.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:29 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:15:30.849 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T05:15:31.543 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:15:31.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:31 smithi135 ceph-mon[22342]: pgmap v799: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 3.8 MiB/s wr, 345 op/s 2024-08-20T05:15:31.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:31 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:15:31.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:31 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:15:31.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:31 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:15:31.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:31 smithi130 ceph-mon[22007]: pgmap v799: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 3.8 MiB/s wr, 345 op/s 2024-08-20T05:15:31.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:31 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:15:31.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:31 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:15:31.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:31 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:15:31.964 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:31 smithi037 ceph-mon[17265]: pgmap v799: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 3.8 MiB/s wr, 345 op/s 2024-08-20T05:15:31.964 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:31 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:15:31.964 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:31 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:15:31.964 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:31 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:15:32.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.442+0000 7f9966a00640 1 -- 172.21.15.37:0/3679749152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f995809ddc0 msgr2=0x7f99580a45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:32.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.442+0000 7f9966a00640 1 --2- 172.21.15.37:0/3679749152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f995809ddc0 0x7f99580a45c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9960068900 tx=0x7f9960097b40 comp rx=0 tx=0).stop 2024-08-20T05:15:32.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.443+0000 7f9966a00640 1 -- 172.21.15.37:0/3679749152 shutdown_connections 2024-08-20T05:15:32.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.443+0000 7f9966a00640 1 --2- 172.21.15.37:0/3679749152 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f995809ddc0 0x7f99580a45c0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.443+0000 7f9966a00640 1 --2- 172.21.15.37:0/3679749152 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f995809d440 0x7f995809d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.443+0000 7f9966a00640 1 --2- 172.21.15.37:0/3679749152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9958097a30 0x7f9958097e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.443+0000 7f9966a00640 1 -- 172.21.15.37:0/3679749152 >> 172.21.15.37:0/3679749152 conn(0x7f9958093460 msgr2=0x7f9958095880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.445+0000 7f9966a00640 1 -- 172.21.15.37:0/3679749152 shutdown_connections 2024-08-20T05:15:32.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.446+0000 7f9966a00640 1 -- 172.21.15.37:0/3679749152 wait complete. 2024-08-20T05:15:32.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.447+0000 7f9966a00640 1 Processor -- start 2024-08-20T05:15:32.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.447+0000 7f9966a00640 1 -- start start 2024-08-20T05:15:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.448+0000 7f9966a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9958097a30 0x7f995812ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.448+0000 7f9966a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f995809d440 0x7f995812e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.448+0000 7f9966a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f995809ddc0 0x7f99581336b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.448+0000 7f9966a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f99580a79c0 con 0x7f995809d440 2024-08-20T05:15:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.448+0000 7f9966a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f99580a7840 con 0x7f9958097a30 2024-08-20T05:15:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.448+0000 7f9966a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f99580a7b40 con 0x7f995809ddc0 2024-08-20T05:15:32.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.448+0000 7f9965600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9958097a30 0x7f995812ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:32.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.448+0000 7f9965600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9958097a30 0x7f995812ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37618/0 (socket says 172.21.15.37:37618) 2024-08-20T05:15:32.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.448+0000 7f9965600640 1 -- 172.21.15.37:0/1227155930 learned_addr learned my addr 172.21.15.37:0/1227155930 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:32.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.448+0000 7f9966000640 1 --2- 172.21.15.37:0/1227155930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f995809ddc0 0x7f99581336b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:32.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.448+0000 7f9964c00640 1 --2- 172.21.15.37:0/1227155930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f995809d440 0x7f995812e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:32.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.449+0000 7f9965600640 1 -- 172.21.15.37:0/1227155930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f995809ddc0 msgr2=0x7f99581336b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:32.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.449+0000 7f9965600640 1 --2- 172.21.15.37:0/1227155930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f995809ddc0 0x7f99581336b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.449+0000 7f9965600640 1 -- 172.21.15.37:0/1227155930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f995809d440 msgr2=0x7f995812e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:32.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.449+0000 7f9965600640 1 --2- 172.21.15.37:0/1227155930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f995809d440 0x7f995812e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.449+0000 7f9965600640 1 -- 172.21.15.37:0/1227155930 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9958133e80 con 0x7f9958097a30 2024-08-20T05:15:32.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.449+0000 7f9965600640 1 --2- 172.21.15.37:0/1227155930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9958097a30 0x7f995812ddd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f994c00c920 tx=0x7f994c00cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.451+0000 7f995e000640 1 -- 172.21.15.37:0/1227155930 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c007c70 con 0x7f9958097a30 2024-08-20T05:15:32.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.451+0000 7f995e000640 1 -- 172.21.15.37:0/1227155930 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f994c007e10 con 0x7f9958097a30 2024-08-20T05:15:32.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.451+0000 7f995e000640 1 -- 172.21.15.37:0/1227155930 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c0187e0 con 0x7f9958097a30 2024-08-20T05:15:32.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.453+0000 7f9966a00640 1 -- 172.21.15.37:0/1227155930 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9958134170 con 0x7f9958097a30 2024-08-20T05:15:32.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.453+0000 7f9966a00640 1 -- 172.21.15.37:0/1227155930 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9958008bb0 con 0x7f9958097a30 2024-08-20T05:15:32.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.457+0000 7f996ac09740 1 Processor -- start 2024-08-20T05:15:32.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.458+0000 7f996ac09740 1 -- start start 2024-08-20T05:15:32.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.460+0000 7f996ac09740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56137138fae0 0x56137138fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.462+0000 7f9966000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56137138fae0 0x56137138fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:32.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.462+0000 7f9966000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56137138fae0 0x56137138fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40216/0 (socket says 172.21.15.37:40216) 2024-08-20T05:15:32.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.462+0000 7f9966000640 1 -- 172.21.15.37:0/3920871717 learned_addr learned my addr 172.21.15.37:0/3920871717 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.462+0000 7f996ac09740 1 --2- 172.21.15.37:0/3920871717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561371390400 0x56137139be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.462+0000 7f996ac09740 1 --2- 172.21.15.37:0/3920871717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56137139c390 0x56137139e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.462+0000 7f996ac09740 1 -- 172.21.15.37:0/3920871717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561371305aa0 con 0x56137138fae0 2024-08-20T05:15:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.462+0000 7f996ac09740 1 -- 172.21.15.37:0/3920871717 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5613712f4fa0 con 0x561371390400 2024-08-20T05:15:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.462+0000 7f996ac09740 1 -- 172.21.15.37:0/3920871717 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5613712f8fe0 con 0x56137139c390 2024-08-20T05:15:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.463+0000 7f9966000640 1 -- 172.21.15.37:0/3920871717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56137139c390 msgr2=0x56137139e780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:15:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.463+0000 7f9966000640 1 --2- 172.21.15.37:0/3920871717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56137139c390 0x56137139e780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.463+0000 7f9966000640 1 -- 172.21.15.37:0/3920871717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561371390400 msgr2=0x56137139be50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:15:32.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.463+0000 7f9966000640 1 --2- 172.21.15.37:0/3920871717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561371390400 0x56137139be50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.463+0000 7f9966000640 1 -- 172.21.15.37:0/3920871717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56137129b420 con 0x56137138fae0 2024-08-20T05:15:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.466+0000 7f995e000640 1 -- 172.21.15.37:0/1227155930 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f994c018980 con 0x7f9958097a30 2024-08-20T05:15:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.466+0000 7f9966000640 1 --2- 172.21.15.37:0/3920871717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56137138fae0 0x56137138fec0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9960052160 tx=0x7f9960068ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e8fa47af6b4437 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:32.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.467+0000 7f9952600640 1 -- 172.21.15.37:0/3920871717 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99600b3070 con 0x56137138fae0 2024-08-20T05:15:32.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.467+0000 7f9952600640 1 -- 172.21.15.37:0/3920871717 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99600a3450 con 0x56137138fae0 2024-08-20T05:15:32.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.467+0000 7f9952600640 1 -- 172.21.15.37:0/3920871717 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996009e040 con 0x56137138fae0 2024-08-20T05:15:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.469+0000 7f995e000640 1 --2- 172.21.15.37:0/1227155930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99480b3d20 0x7f99480b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.469+0000 7f995e000640 1 -- 172.21.15.37:0/1227155930 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f994c0e43d0 con 0x7f9958097a30 2024-08-20T05:15:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.469+0000 7f996ac09740 1 -- 172.21.15.37:0/3920871717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56137138fae0 msgr2=0x56137138fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.469+0000 7f996ac09740 1 --2- 172.21.15.37:0/3920871717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56137138fae0 0x56137138fec0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9960052160 tx=0x7f9960068ec0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.470+0000 7f996ac09740 1 -- 172.21.15.37:0/3920871717 shutdown_connections 2024-08-20T05:15:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.470+0000 7f996ac09740 1 --2- 172.21.15.37:0/3920871717 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56137139c390 0x56137139e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.470+0000 7f996ac09740 1 --2- 172.21.15.37:0/3920871717 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x561371390400 0x56137139be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.470+0000 7f996ac09740 1 --2- 172.21.15.37:0/3920871717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56137138fae0 0x56137138fec0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.470+0000 7f996ac09740 1 -- 172.21.15.37:0/3920871717 >> 172.21.15.37:0/3920871717 conn(0x56137138d910 msgr2=0x56137138eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.470+0000 7f996ac09740 1 -- 172.21.15.37:0/3920871717 shutdown_connections 2024-08-20T05:15:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.470+0000 7f9965600640 1 --2- 172.21.15.37:0/1227155930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99480b3d20 0x7f99480b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.470+0000 7f996ac09740 1 -- 172.21.15.37:0/3920871717 wait complete. 2024-08-20T05:15:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.471+0000 7f996ac09740 1 -- start start 2024-08-20T05:15:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.471+0000 7f996ac09740 1 Processor -- start 2024-08-20T05:15:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.472+0000 7f996ac09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137138fae0 0x56137139bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.472+0000 7f996ac09740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561371390400 0x561371398fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.473+0000 7f9966000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137138fae0 0x56137139bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.473+0000 7f9965600640 1 --2- 172.21.15.37:0/1227155930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99480b3d20 0x7f99480b61e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f994c0a7080 tx=0x7f994c005e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.473+0000 7f9966000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137138fae0 0x56137139bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37630/0 (socket says 172.21.15.37:37630) 2024-08-20T05:15:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.473+0000 7f996ac09740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56137139c390 0x561371399500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.473+0000 7f9966000640 1 -- 172.21.15.37:0/3216860699 learned_addr learned my addr 172.21.15.37:0/3216860699 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.473+0000 7f996ac09740 1 -- 172.21.15.37:0/3216860699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561371157700 con 0x561371390400 2024-08-20T05:15:32.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.473+0000 7f996ac09740 1 -- 172.21.15.37:0/3216860699 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x561371290290 con 0x56137138fae0 2024-08-20T05:15:32.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.473+0000 7f996ac09740 1 -- 172.21.15.37:0/3216860699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56137139efb0 con 0x56137139c390 2024-08-20T05:15:32.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.473+0000 7f996ac09740 10 client.0 _ll_register_callbacks cb 0x5613712ef1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:32.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.474+0000 7f9966000640 1 --2- 172.21.15.37:0/3216860699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56137139c390 0x561371399500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:32.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.475+0000 7f9964c00640 1 --2- 172.21.15.37:0/3216860699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561371390400 0x561371398fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.479+0000 7f9966000640 1 -- 172.21.15.37:0/3216860699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56137139c390 msgr2=0x561371399500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.479+0000 7f9966000640 1 --2- 172.21.15.37:0/3216860699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56137139c390 0x561371399500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.479+0000 7f9966000640 1 -- 172.21.15.37:0/3216860699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561371390400 msgr2=0x561371398fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.479+0000 7f9966000640 1 --2- 172.21.15.37:0/3216860699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561371390400 0x561371398fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.479+0000 7f9966000640 1 -- 172.21.15.37:0/3216860699 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561371054650 con 0x56137138fae0 2024-08-20T05:15:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.479+0000 7f9964c00640 1 --2- 172.21.15.37:0/3216860699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561371390400 0x561371398fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:15:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.479+0000 7f9946a00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:15:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.479+0000 7f9966000640 1 --2- 172.21.15.37:0/3216860699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137138fae0 0x56137139bb70 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9960068ce0 tx=0x7f9960097b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9899895badae30ab server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.480+0000 7f9946a00640 1 -- 172.21.15.37:0/3216860699 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99600b3070 con 0x56137138fae0 2024-08-20T05:15:32.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.480+0000 7f996ac09740 1 -- 172.21.15.37:0/3216860699 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99600a3450 con 0x56137138fae0 2024-08-20T05:15:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.480+0000 7f9946a00640 1 -- 172.21.15.37:0/3216860699 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f99600a3b80 con 0x56137138fae0 2024-08-20T05:15:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.480+0000 7f9946a00640 1 -- 172.21.15.37:0/3216860699 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f99600b3070 con 0x56137138fae0 2024-08-20T05:15:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.481+0000 7f996ac09740 10 client.28679 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.481+0000 7f996ac09740 1 -- 172.21.15.37:0/3216860699 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5613713aa7f0 con 0x56137138fae0 2024-08-20T05:15:32.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.482+0000 7f9946a00640 1 -- 172.21.15.37:0/3216860699 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99600a3450 con 0x56137138fae0 2024-08-20T05:15:32.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.482+0000 7f9946a00640 1 -- 172.21.15.37:0/3216860699 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f99600ad070 con 0x56137138fae0 2024-08-20T05:15:32.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.482+0000 7f996ac09740 10 client.28679 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:32.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.482+0000 7f996ac09740 10 client.28679 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:15:32.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.482+0000 7f996ac09740 20 client.28679 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:32.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.482+0000 7f996ac09740 1 --2- 172.21.15.37:0/3216860699 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5613713abb40 0x5613713adf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.482+0000 7f996ac09740 4 client.28679 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:15:32.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.482+0000 7f996ac09740 1 -- 172.21.15.37:0/3216860699 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613713079f0 con 0x5613713abb40 2024-08-20T05:15:32.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.483+0000 7f9964c00640 1 --2- 172.21.15.37:0/3216860699 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5613713abb40 0x5613713adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:32.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.484+0000 7f9946a00640 10 client.28679 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:15:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.485+0000 7f9964c00640 1 --2- 172.21.15.37:0/3216860699 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5613713abb40 0x5613713adf30 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5783210ee5d39bb3 server_cookie=1867a53f17855be5 in_seq=0 out_seq=0 2024-08-20T05:15:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.486+0000 7f9946a00640 1 -- 172.21.15.37:0/3216860699 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5613713079f0 con 0x5613713abb40 2024-08-20T05:15:32.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.487+0000 7f9946a00640 10 client.28679 handle_command_reply: tid=0 2024-08-20T05:15:32.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.487+0000 7f996ac09740 1 client.28679 shutdown 2024-08-20T05:15:32.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.487+0000 7f996ac09740 1 -- 172.21.15.37:0/3216860699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137138fae0 msgr2=0x56137139bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:32.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.487+0000 7f996ac09740 1 --2- 172.21.15.37:0/3216860699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137138fae0 0x56137139bb70 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9960068ce0 tx=0x7f9960097b40 comp rx=0 tx=0).stop 2024-08-20T05:15:32.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.487+0000 7f996ac09740 1 -- 172.21.15.37:0/3216860699 shutdown_connections 2024-08-20T05:15:32.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.487+0000 7f996ac09740 1 --2- 172.21.15.37:0/3216860699 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5613713abb40 0x5613713adf30 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.487+0000 7f996ac09740 1 --2- 172.21.15.37:0/3216860699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56137139c390 0x561371399500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.487+0000 7f996ac09740 1 --2- 172.21.15.37:0/3216860699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561371390400 0x561371398fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.487+0000 7f996ac09740 1 --2- 172.21.15.37:0/3216860699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137138fae0 0x56137139bb70 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.487+0000 7f996ac09740 1 -- 172.21.15.37:0/3216860699 >> 172.21.15.37:0/3216860699 conn(0x56137138d910 msgr2=0x561371393480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:32.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.487+0000 7f9946a00640 0 client.28679 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:15:32.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.488+0000 7f996ac09740 1 -- 172.21.15.37:0/3216860699 shutdown_connections 2024-08-20T05:15:32.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.488+0000 7f996ac09740 1 -- 172.21.15.37:0/3216860699 wait complete. 2024-08-20T05:15:32.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.488+0000 7f996ac09740 20 client.28679 trim_cache size 0 max 16384 2024-08-20T05:15:32.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.521+0000 7f996ac09740 1 Processor -- start 2024-08-20T05:15:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.522+0000 7f996ac09740 1 -- start start 2024-08-20T05:15:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.523+0000 7f996ac09740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56137138fae0 0x5613713b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.523+0000 7f996ac09740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561371390400 0x5613713b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.523+0000 7f996ac09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137139c390 0x5613713961d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.523+0000 7f996ac09740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9958148ae0 con 0x561371390400 2024-08-20T05:15:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.523+0000 7f996ac09740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f995814a620 con 0x56137139c390 2024-08-20T05:15:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.523+0000 7f996ac09740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f99581491b0 con 0x56137138fae0 2024-08-20T05:15:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.523+0000 7f9966000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56137138fae0 0x5613713b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.523+0000 7f9966000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56137138fae0 0x5613713b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:33992/0 (socket says 172.21.15.37:33992) 2024-08-20T05:15:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.523+0000 7f9966000640 1 -- 172.21.15.37:0/3034875769 learned_addr learned my addr 172.21.15.37:0/3034875769 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:32.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.524+0000 7f9966000640 1 --2- 172.21.15.37:0/3034875769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137139c390 0x5613713961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:32.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.524+0000 7f9964c00640 1 --2- 172.21.15.37:0/3034875769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561371390400 0x5613713b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:32.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.525+0000 7f9964c00640 1 -- 172.21.15.37:0/3034875769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56137138fae0 msgr2=0x5613713b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:32.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.525+0000 7f9964c00640 1 --2- 172.21.15.37:0/3034875769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56137138fae0 0x5613713b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.525+0000 7f9964c00640 1 -- 172.21.15.37:0/3034875769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137139c390 msgr2=0x5613713961d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:32.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.525+0000 7f9964c00640 1 --2- 172.21.15.37:0/3034875769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137139c390 0x5613713961d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.526+0000 7f9964c00640 1 -- 172.21.15.37:0/3034875769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561371390230 con 0x561371390400 2024-08-20T05:15:32.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.526+0000 7f9966000640 1 --2- 172.21.15.37:0/3034875769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56137138fae0 0x5613713b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:15:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.527+0000 7f9964c00640 1 --2- 172.21.15.37:0/3034875769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561371390400 0x5613713b10b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x561371305bf0 tx=0x7f9954005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e2197e4669e1d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.528+0000 7f9951c00640 1 -- 172.21.15.37:0/3034875769 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99540142d0 con 0x561371390400 2024-08-20T05:15:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.528+0000 7f9951c00640 1 -- 172.21.15.37:0/3034875769 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f995401b7e0 con 0x561371390400 2024-08-20T05:15:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.528+0000 7f9951c00640 1 -- 172.21.15.37:0/3034875769 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954012870 con 0x561371390400 2024-08-20T05:15:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.529+0000 7f996ac09740 1 -- 172.21.15.37:0/3034875769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561371390400 msgr2=0x5613713b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.529+0000 7f996ac09740 1 --2- 172.21.15.37:0/3034875769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561371390400 0x5613713b10b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x561371305bf0 tx=0x7f9954005f90 comp rx=0 tx=0).stop 2024-08-20T05:15:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.529+0000 7f996ac09740 1 -- 172.21.15.37:0/3034875769 shutdown_connections 2024-08-20T05:15:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.529+0000 7f996ac09740 1 --2- 172.21.15.37:0/3034875769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137139c390 0x5613713961d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.529+0000 7f996ac09740 1 --2- 172.21.15.37:0/3034875769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561371390400 0x5613713b10b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.529+0000 7f996ac09740 1 --2- 172.21.15.37:0/3034875769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56137138fae0 0x5613713b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.529+0000 7f996ac09740 1 -- 172.21.15.37:0/3034875769 >> 172.21.15.37:0/3034875769 conn(0x56137138d910 msgr2=0x56137139ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.530+0000 7f996ac09740 1 -- 172.21.15.37:0/3034875769 shutdown_connections 2024-08-20T05:15:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.530+0000 7f996ac09740 1 -- 172.21.15.37:0/3034875769 wait complete. 2024-08-20T05:15:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.531+0000 7f996ac09740 1 -- start start 2024-08-20T05:15:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.531+0000 7f996ac09740 1 Processor -- start 2024-08-20T05:15:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.532+0000 7f996ac09740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56137138fae0 0x5613713b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.533+0000 7f996ac09740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561371390400 0x56137140f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.533+0000 7f996ac09740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137139c390 0x56137140f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.533+0000 7f996ac09740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9958149f50 con 0x56137138fae0 2024-08-20T05:15:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.533+0000 7f996ac09740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9958149880 con 0x56137139c390 2024-08-20T05:15:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.533+0000 7f996ac09740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9958146aa0 con 0x561371390400 2024-08-20T05:15:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.533+0000 7f996ac09740 10 client.0 _ll_register_callbacks cb 0x7f99600b1070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.533+0000 7f9966000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137139c390 0x56137140f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.534+0000 7f9966000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137139c390 0x56137140f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:37640/0 (socket says 172.21.15.37:37640) 2024-08-20T05:15:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.534+0000 7f9966000640 1 -- 172.21.15.37:0/1601880195 learned_addr learned my addr 172.21.15.37:0/1601880195 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.534+0000 7f9966000640 1 --2- 172.21.15.37:0/1601880195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56137138fae0 0x5613713b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.534+0000 7f9964c00640 1 --2- 172.21.15.37:0/1601880195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561371390400 0x56137140f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.537+0000 7f9966000640 1 -- 172.21.15.37:0/1601880195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561371390400 msgr2=0x56137140f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.537+0000 7f9966000640 1 --2- 172.21.15.37:0/1601880195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561371390400 0x56137140f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.537+0000 7f9966000640 1 -- 172.21.15.37:0/1601880195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56137138fae0 msgr2=0x5613713b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.537+0000 7f9966000640 1 --2- 172.21.15.37:0/1601880195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56137138fae0 0x5613713b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.537+0000 7f9966000640 1 -- 172.21.15.37:0/1601880195 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613713aff70 con 0x56137139c390 2024-08-20T05:15:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.540+0000 7f9946a00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:15:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.540+0000 7f9966000640 1 --2- 172.21.15.37:0/1601880195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137139c390 0x56137140f760 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9960068b50 tx=0x7f9960097b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7a08cc3dc741844 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:32.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.540+0000 7f9946a00640 1 -- 172.21.15.37:0/1601880195 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99600cd070 con 0x56137139c390 2024-08-20T05:15:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.540+0000 7f996ac09740 1 -- 172.21.15.37:0/1601880195 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f995401b7e0 con 0x56137139c390 2024-08-20T05:15:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.540+0000 7f9946a00640 1 -- 172.21.15.37:0/1601880195 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f99600a3b80 con 0x56137139c390 2024-08-20T05:15:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.541+0000 7f9946a00640 1 -- 172.21.15.37:0/1601880195 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f99600cd070 con 0x56137139c390 2024-08-20T05:15:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.541+0000 7f996ac09740 10 client.28685 fetch_fsmap learned FSMap version 48 2024-08-20T05:15:32.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.541+0000 7f996ac09740 1 -- 172.21.15.37:0/1601880195 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x561371427600 con 0x56137139c390 2024-08-20T05:15:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.542+0000 7f9946a00640 1 -- 172.21.15.37:0/1601880195 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f995401b7e0 con 0x56137139c390 2024-08-20T05:15:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.542+0000 7f9946a00640 1 -- 172.21.15.37:0/1601880195 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 48) ==== 8370+0+0 (secure 0 0 0) 0x7f99600ad070 con 0x56137139c390 2024-08-20T05:15:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.542+0000 7f996ac09740 10 client.28685 fetch_fsmap finished waiting for FSMap version 48 2024-08-20T05:15:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.542+0000 7f996ac09740 10 client.28685 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:15:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.542+0000 7f996ac09740 20 client.28685 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.542+0000 7f996ac09740 1 --2- 172.21.15.37:0/1601880195 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5613714279e0 0x561371429e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:32.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.542+0000 7f996ac09740 4 client.28685 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:15:32.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.542+0000 7f996ac09740 1 -- 172.21.15.37:0/1601880195 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561371303490 con 0x5613714279e0 2024-08-20T05:15:32.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.543+0000 7f9964c00640 1 --2- 172.21.15.37:0/1601880195 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5613714279e0 0x561371429e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:32.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.544+0000 7f9964c00640 1 --2- 172.21.15.37:0/1601880195 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5613714279e0 0x561371429e00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e93f41fc4b10c83b server_cookie=55b6fde36ad22cc8 in_seq=0 out_seq=0 2024-08-20T05:15:32.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.544+0000 7f9946a00640 10 client.28685 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:15:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.545+0000 7f9946a00640 1 -- 172.21.15.37:0/1601880195 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561371303490 con 0x5613714279e0 2024-08-20T05:15:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.545+0000 7f9946a00640 10 client.28685 handle_command_reply: tid=0 2024-08-20T05:15:32.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.545+0000 7f996ac09740 1 client.28685 shutdown 2024-08-20T05:15:32.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.546+0000 7f996ac09740 1 -- 172.21.15.37:0/1601880195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137139c390 msgr2=0x56137140f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:32.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.546+0000 7f996ac09740 1 --2- 172.21.15.37:0/1601880195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137139c390 0x56137140f760 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9960068b50 tx=0x7f9960097b40 comp rx=0 tx=0).stop 2024-08-20T05:15:32.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.546+0000 7f996ac09740 1 -- 172.21.15.37:0/1601880195 shutdown_connections 2024-08-20T05:15:32.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.546+0000 7f996ac09740 1 --2- 172.21.15.37:0/1601880195 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x5613714279e0 0x561371429e00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.546+0000 7f996ac09740 1 --2- 172.21.15.37:0/1601880195 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56137139c390 0x56137140f760 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.546+0000 7f996ac09740 1 --2- 172.21.15.37:0/1601880195 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x561371390400 0x56137140f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.546+0000 7f996ac09740 1 --2- 172.21.15.37:0/1601880195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56137138fae0 0x5613713b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.546+0000 7f996ac09740 1 -- 172.21.15.37:0/1601880195 >> 172.21.15.37:0/1601880195 conn(0x56137138d910 msgr2=0x561371392bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:32.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.546+0000 7f9946a00640 0 client.28685 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:15:32.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.547+0000 7f996ac09740 1 -- 172.21.15.37:0/1601880195 shutdown_connections 2024-08-20T05:15:32.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.547+0000 7f996ac09740 1 -- 172.21.15.37:0/1601880195 wait complete. 2024-08-20T05:15:32.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.548+0000 7f996ac09740 20 client.28685 trim_cache size 0 max 16384 2024-08-20T05:15:32.549 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:15:32.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.549+0000 7f9966a00640 1 -- 172.21.15.37:0/1227155930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99480b3d20 msgr2=0x7f99480b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.549+0000 7f9966a00640 1 --2- 172.21.15.37:0/1227155930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99480b3d20 0x7f99480b61e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f994c0a7080 tx=0x7f994c005e40 comp rx=0 tx=0).stop 2024-08-20T05:15:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.550+0000 7f9966a00640 1 -- 172.21.15.37:0/1227155930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9958097a30 msgr2=0x7f995812ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.550+0000 7f9966a00640 1 --2- 172.21.15.37:0/1227155930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9958097a30 0x7f995812ddd0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f994c00c920 tx=0x7f994c00cde0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.550+0000 7f9966a00640 1 -- 172.21.15.37:0/1227155930 shutdown_connections 2024-08-20T05:15:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.550+0000 7f9966a00640 1 --2- 172.21.15.37:0/1227155930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f99480b3d20 0x7f99480b61e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.550+0000 7f9966a00640 1 --2- 172.21.15.37:0/1227155930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f995809ddc0 0x7f99581336b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.550+0000 7f9966a00640 1 --2- 172.21.15.37:0/1227155930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f995809d440 0x7f995812e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.550+0000 7f9966a00640 1 --2- 172.21.15.37:0/1227155930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9958097a30 0x7f995812ddd0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:32.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.550+0000 7f9966a00640 1 -- 172.21.15.37:0/1227155930 >> 172.21.15.37:0/1227155930 conn(0x7f9958093460 msgr2=0x7f9958095850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:32.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.550+0000 7f9966a00640 1 -- 172.21.15.37:0/1227155930 shutdown_connections 2024-08-20T05:15:32.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:32.550+0000 7f9966a00640 1 -- 172.21.15.37:0/1227155930 wait complete. 2024-08-20T05:15:33.043 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 755.0 s, 629.4 tps, lat 154.681 ms stddev 210.838 2024-08-20T05:15:33.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:33 smithi135 ceph-mon[22342]: pgmap v800: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 4.6 MiB/s wr, 429 op/s 2024-08-20T05:15:33.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:33 smithi130 ceph-mon[22007]: pgmap v800: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 4.6 MiB/s wr, 429 op/s 2024-08-20T05:15:34.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:33 smithi037 ceph-mon[17265]: pgmap v800: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 4.6 MiB/s wr, 429 op/s 2024-08-20T05:15:34.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:34 smithi130 ceph-mon[22007]: pgmap v801: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 6.1 MiB/s wr, 587 op/s 2024-08-20T05:15:34.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:34 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:15:35.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:34 smithi037 ceph-mon[17265]: pgmap v801: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 6.1 MiB/s wr, 587 op/s 2024-08-20T05:15:35.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:34 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:15:35.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:34 smithi135 ceph-mon[22342]: pgmap v801: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 6.1 MiB/s wr, 587 op/s 2024-08-20T05:15:35.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:34 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:15:35.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T05:15:36.183 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:15:37.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:37 smithi037 ceph-mon[17265]: pgmap v802: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 8.1 MiB/s wr, 726 op/s 2024-08-20T05:15:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:37 smithi135 ceph-mon[22342]: pgmap v802: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 8.1 MiB/s wr, 726 op/s 2024-08-20T05:15:37.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:37 smithi130 ceph-mon[22007]: pgmap v802: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 8.1 MiB/s wr, 726 op/s 2024-08-20T05:15:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 760.0 s, 479.8 tps, lat 210.998 ms stddev 234.853 2024-08-20T05:15:38.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.859+0000 7f90bb200640 1 -- 172.21.15.37:0/2151547637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90bc10ae90 msgr2=0x7f90bc111690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:38.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.859+0000 7f90bb200640 1 --2- 172.21.15.37:0/2151547637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90bc10ae90 0x7f90bc111690 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f90a8009860 tx=0x7f90a802a340 comp rx=0 tx=0).stop 2024-08-20T05:15:38.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.860+0000 7f90bb200640 1 -- 172.21.15.37:0/2151547637 shutdown_connections 2024-08-20T05:15:38.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.860+0000 7f90bb200640 1 --2- 172.21.15.37:0/2151547637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90bc10ae90 0x7f90bc111690 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.860+0000 7f90bb200640 1 --2- 172.21.15.37:0/2151547637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90bc10a510 0x7f90bc10a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.860+0000 7f90bb200640 1 --2- 172.21.15.37:0/2151547637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90bc104b00 0x7f90bc104ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.860+0000 7f90bb200640 1 -- 172.21.15.37:0/2151547637 >> 172.21.15.37:0/2151547637 conn(0x7f90bc100550 msgr2=0x7f90bc102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:38.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.860+0000 7f90bb200640 1 -- 172.21.15.37:0/2151547637 shutdown_connections 2024-08-20T05:15:38.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.860+0000 7f90bb200640 1 -- 172.21.15.37:0/2151547637 wait complete. 2024-08-20T05:15:38.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.865+0000 7f90bb200640 1 Processor -- start 2024-08-20T05:15:38.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.865+0000 7f90bb200640 1 -- start start 2024-08-20T05:15:38.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.866+0000 7f90bb200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90bc104b00 0x7f90bc111300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.866+0000 7f90bb200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90bc10a510 0x7f90bc10e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.866+0000 7f90bb200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90bc10ae90 0x7f90bc10ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.866+0000 7f90bb200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc114b50 con 0x7f90bc10ae90 2024-08-20T05:15:38.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.866+0000 7f90bb200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc1149d0 con 0x7f90bc104b00 2024-08-20T05:15:38.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.866+0000 7f90bb200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc114cd0 con 0x7f90bc10a510 2024-08-20T05:15:38.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.867+0000 7f90b9e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90bc104b00 0x7f90bc111300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:38.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.867+0000 7f90b9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90bc10a510 0x7f90bc10e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:38.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.867+0000 7f90b9e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90bc104b00 0x7f90bc111300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42380/0 (socket says 172.21.15.37:42380) 2024-08-20T05:15:38.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.867+0000 7f90b9e00640 1 -- 172.21.15.37:0/2446558465 learned_addr learned my addr 172.21.15.37:0/2446558465 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:38.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.867+0000 7f90ba800640 1 --2- 172.21.15.37:0/2446558465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90bc10ae90 0x7f90bc10ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:38.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.868+0000 7f90b9e00640 1 -- 172.21.15.37:0/2446558465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90bc10a510 msgr2=0x7f90bc10e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:38.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.868+0000 7f90b9e00640 1 --2- 172.21.15.37:0/2446558465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90bc10a510 0x7f90bc10e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.868+0000 7f90b9e00640 1 -- 172.21.15.37:0/2446558465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90bc10ae90 msgr2=0x7f90bc10ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:38.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.868+0000 7f90b9e00640 1 --2- 172.21.15.37:0/2446558465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90bc10ae90 0x7f90bc10ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.868+0000 7f90b9e00640 1 -- 172.21.15.37:0/2446558465 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90bc10f260 con 0x7f90bc104b00 2024-08-20T05:15:38.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.871+0000 7f90ba800640 1 --2- 172.21.15.37:0/2446558465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90bc10ae90 0x7f90bc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:15:38.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.871+0000 7f90b9400640 1 --2- 172.21.15.37:0/2446558465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90bc10a510 0x7f90bc10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:15:38.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.871+0000 7f90b9e00640 1 --2- 172.21.15.37:0/2446558465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90bc104b00 0x7f90bc111300 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f90b400ed80 tx=0x7f90b400c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:38.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.872+0000 7f90b2a00640 1 -- 172.21.15.37:0/2446558465 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b401c070 con 0x7f90bc104b00 2024-08-20T05:15:38.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.872+0000 7f90b2a00640 1 -- 172.21.15.37:0/2446558465 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90b4017af0 con 0x7f90bc104b00 2024-08-20T05:15:38.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.872+0000 7f90b2a00640 1 -- 172.21.15.37:0/2446558465 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b400fb00 con 0x7f90bc104b00 2024-08-20T05:15:38.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.872+0000 7f90bb200640 1 -- 172.21.15.37:0/2446558465 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90bc1ab850 con 0x7f90bc104b00 2024-08-20T05:15:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.872+0000 7f90bb200640 1 -- 172.21.15.37:0/2446558465 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90bc1abd40 con 0x7f90bc104b00 2024-08-20T05:15:38.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.884+0000 7f90c3672740 1 Processor -- start 2024-08-20T05:15:38.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.885+0000 7f90c3672740 1 -- start start 2024-08-20T05:15:38.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.885+0000 7f90c3672740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a40cb20 0x55c22a40cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.886+0000 7f90c3672740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 0x55c22a429ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.886+0000 7f90c3672740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a42a3e0 0x55c22a42c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.886+0000 7f90c3672740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c22a382aa0 con 0x55c22a40cb20 2024-08-20T05:15:38.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.886+0000 7f90c3672740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c22a371fa0 con 0x55c22a40d440 2024-08-20T05:15:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.886+0000 7f90c3672740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c22a375fe0 con 0x55c22a42a3e0 2024-08-20T05:15:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.886+0000 7f90b2a00640 1 -- 172.21.15.37:0/2446558465 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f90b401f070 con 0x7f90bc104b00 2024-08-20T05:15:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.886+0000 7f90b9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a42a3e0 0x55c22a42c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.886+0000 7f90b9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a42a3e0 0x55c22a42c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43358/0 (socket says 172.21.15.37:43358) 2024-08-20T05:15:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.886+0000 7f90b9400640 1 -- 172.21.15.37:0/553894479 learned_addr learned my addr 172.21.15.37:0/553894479 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.886+0000 7f90b9e00640 1 --2- 172.21.15.37:0/553894479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 0x55c22a429ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.887+0000 7f90ba800640 1 --2- 172.21.15.37:0/553894479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a40cb20 0x55c22a40cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.888+0000 7f90b9400640 1 -- 172.21.15.37:0/553894479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 msgr2=0x55c22a429ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.888+0000 7f90b9400640 1 --2- 172.21.15.37:0/553894479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 0x55c22a429ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.888+0000 7f90b9400640 1 -- 172.21.15.37:0/553894479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a40cb20 msgr2=0x55c22a40cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.888+0000 7f90b9400640 1 --2- 172.21.15.37:0/553894479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a40cb20 0x55c22a40cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.888+0000 7f90b9400640 1 -- 172.21.15.37:0/553894479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c22a318420 con 0x55c22a42a3e0 2024-08-20T05:15:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.888+0000 7f90b9e00640 1 --2- 172.21.15.37:0/553894479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 0x55c22a429ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:15:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.889+0000 7f90b9400640 1 --2- 172.21.15.37:0/553894479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a42a3e0 0x55c22a42c7d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f90ac009e40 tx=0x7f90ac00e5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97b3fde274f4b220 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.891+0000 7f90b2a00640 1 --2- 172.21.15.37:0/2446558465 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f90a00b3e10 0x7f90a00b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.891+0000 7f90b2a00640 1 -- 172.21.15.37:0/2446558465 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f90b40e3ff0 con 0x7f90bc104b00 2024-08-20T05:15:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.892+0000 7f90a7000640 1 -- 172.21.15.37:0/553894479 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac017070 con 0x55c22a42a3e0 2024-08-20T05:15:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.892+0000 7f90a7000640 1 -- 172.21.15.37:0/553894479 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90ac013920 con 0x55c22a42a3e0 2024-08-20T05:15:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.892+0000 7f90a7000640 1 -- 172.21.15.37:0/553894479 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac0128b0 con 0x55c22a42a3e0 2024-08-20T05:15:38.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.893+0000 7f90c3672740 1 -- 172.21.15.37:0/553894479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a42a3e0 msgr2=0x55c22a42c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:38.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.893+0000 7f90c3672740 1 --2- 172.21.15.37:0/553894479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a42a3e0 0x55c22a42c7d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f90ac009e40 tx=0x7f90ac00e5a0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.893+0000 7f90ba800640 1 --2- 172.21.15.37:0/2446558465 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f90a00b3e10 0x7f90a00b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:38.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.893+0000 7f90c3672740 1 -- 172.21.15.37:0/553894479 shutdown_connections 2024-08-20T05:15:38.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.893+0000 7f90c3672740 1 --2- 172.21.15.37:0/553894479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a42a3e0 0x55c22a42c7d0 secure :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f90ac009e40 tx=0x7f90ac00e5a0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.893+0000 7f90c3672740 1 --2- 172.21.15.37:0/553894479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 0x55c22a429ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.893+0000 7f90c3672740 1 --2- 172.21.15.37:0/553894479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a40cb20 0x55c22a40cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.893+0000 7f90c3672740 1 -- 172.21.15.37:0/553894479 >> 172.21.15.37:0/553894479 conn(0x55c22a40a950 msgr2=0x55c22a40baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:38.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.894+0000 7f90c3672740 1 -- 172.21.15.37:0/553894479 shutdown_connections 2024-08-20T05:15:38.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.894+0000 7f90c3672740 1 -- 172.21.15.37:0/553894479 wait complete. 2024-08-20T05:15:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.895+0000 7f90ba800640 1 --2- 172.21.15.37:0/2446558465 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f90a00b3e10 0x7f90a00b62d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f90a8005d00 tx=0x7f90a8005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.895+0000 7f90c3672740 1 -- start start 2024-08-20T05:15:38.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.895+0000 7f90c3672740 1 Processor -- start 2024-08-20T05:15:38.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.900+0000 7f90c3672740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a40cb20 0x55c22a429d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.900+0000 7f90c3672740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 0x55c22a4271c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.900+0000 7f90c3672740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a4277f0 0x55c22a427c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.900+0000 7f90c3672740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c22a1d4700 con 0x55c22a40cb20 2024-08-20T05:15:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.901+0000 7f90c3672740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c22a30d290 con 0x55c22a40d440 2024-08-20T05:15:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.901+0000 7f90b9400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 0x55c22a4271c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.901+0000 7f90c3672740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c22a42d0e0 con 0x55c22a4277f0 2024-08-20T05:15:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.901+0000 7f90c3672740 10 client.0 _ll_register_callbacks cb 0x55c22a36c1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.901+0000 7f90ba800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a4277f0 0x55c22a427c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.901+0000 7f90ba800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a4277f0 0x55c22a427c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43372/0 (socket says 172.21.15.37:43372) 2024-08-20T05:15:38.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.901+0000 7f90ba800640 1 -- 172.21.15.37:0/1574563223 learned_addr learned my addr 172.21.15.37:0/1574563223 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:38.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.902+0000 7f90b9400640 1 -- 172.21.15.37:0/1574563223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a4277f0 msgr2=0x55c22a427c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:38.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.902+0000 7f90b9400640 1 --2- 172.21.15.37:0/1574563223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a4277f0 0x55c22a427c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.902+0000 7f90b9400640 1 -- 172.21.15.37:0/1574563223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a40cb20 msgr2=0x55c22a429d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:38.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.902+0000 7f90b9400640 1 --2- 172.21.15.37:0/1574563223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a40cb20 0x55c22a429d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.902+0000 7f90b9400640 1 -- 172.21.15.37:0/1574563223 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c22a0d1650 con 0x55c22a40d440 2024-08-20T05:15:38.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.902+0000 7f90b9400640 1 --2- 172.21.15.37:0/1574563223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 0x55c22a4271c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f90ac008000 tx=0x7f90ac013ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d03eafea46273f62 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:38.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.902+0000 7f909b400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:15:38.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.903+0000 7f909b400640 1 -- 172.21.15.37:0/1574563223 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90ac022070 con 0x55c22a40d440 2024-08-20T05:15:38.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.903+0000 7f909b400640 1 -- 172.21.15.37:0/1574563223 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f90ac012a00 con 0x55c22a40d440 2024-08-20T05:15:38.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.903+0000 7f90c3672740 1 -- 172.21.15.37:0/1574563223 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90ac013920 con 0x55c22a40d440 2024-08-20T05:15:38.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.905+0000 7f909b400640 1 -- 172.21.15.37:0/1574563223 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f90ac017040 con 0x55c22a40d440 2024-08-20T05:15:38.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.905+0000 7f90c3672740 10 client.28694 fetch_fsmap learned FSMap version 49 2024-08-20T05:15:38.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.905+0000 7f90c3672740 1 -- 172.21.15.37:0/1574563223 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55c22a438ee0 con 0x55c22a40d440 2024-08-20T05:15:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.905+0000 7f909b400640 1 -- 172.21.15.37:0/1574563223 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90ac013e50 con 0x55c22a40d440 2024-08-20T05:15:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.905+0000 7f909b400640 1 -- 172.21.15.37:0/1574563223 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 49) ==== 8374+0+0 (secure 0 0 0) 0x7f90ac01ca20 con 0x55c22a40d440 2024-08-20T05:15:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.905+0000 7f90c3672740 10 client.28694 fetch_fsmap finished waiting for FSMap version 49 2024-08-20T05:15:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.905+0000 7f90c3672740 10 client.28694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.906+0000 7f90c3672740 20 client.28694 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.906+0000 7f90c3672740 1 --2- 172.21.15.37:0/1574563223 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c22a43a290 0x55c22a43c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.906+0000 7f90c3672740 4 client.28694 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:15:38.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.906+0000 7f90c3672740 1 -- 172.21.15.37:0/1574563223 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f90ac013920 con 0x55c22a43a290 2024-08-20T05:15:38.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.908+0000 7f90b9e00640 1 --2- 172.21.15.37:0/1574563223 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c22a43a290 0x55c22a43c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:38.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.908+0000 7f90b9e00640 1 --2- 172.21.15.37:0/1574563223 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c22a43a290 0x55c22a43c680 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9d5edb3307d62cb server_cookie=ebd02f7cb27e3382 in_seq=0 out_seq=0 2024-08-20T05:15:38.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.908+0000 7f909b400640 10 client.28694 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:38.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.909+0000 7f909b400640 1 -- 172.21.15.37:0/1574563223 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f90ac013920 con 0x55c22a43a290 2024-08-20T05:15:38.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.909+0000 7f909b400640 10 client.28694 handle_command_reply: tid=0 2024-08-20T05:15:38.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.909+0000 7f90c3672740 1 client.28694 shutdown 2024-08-20T05:15:38.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.911+0000 7f90c3672740 1 -- 172.21.15.37:0/1574563223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 msgr2=0x55c22a4271c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:38.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.911+0000 7f90c3672740 1 --2- 172.21.15.37:0/1574563223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 0x55c22a4271c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f90ac008000 tx=0x7f90ac013ce0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.911+0000 7f90c3672740 1 -- 172.21.15.37:0/1574563223 shutdown_connections 2024-08-20T05:15:38.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.911+0000 7f90c3672740 1 --2- 172.21.15.37:0/1574563223 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c22a43a290 0x55c22a43c680 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.911+0000 7f90c3672740 1 --2- 172.21.15.37:0/1574563223 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a4277f0 0x55c22a427c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.911+0000 7f90c3672740 1 --2- 172.21.15.37:0/1574563223 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 0x55c22a4271c0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.911+0000 7f90c3672740 1 --2- 172.21.15.37:0/1574563223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a40cb20 0x55c22a429d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.911+0000 7f909b400640 0 client.28694 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:38.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.911+0000 7f90c3672740 1 -- 172.21.15.37:0/1574563223 >> 172.21.15.37:0/1574563223 conn(0x55c22a40a950 msgr2=0x55c22a409b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:38.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.912+0000 7f90c3672740 1 -- 172.21.15.37:0/1574563223 shutdown_connections 2024-08-20T05:15:38.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.912+0000 7f90c3672740 1 -- 172.21.15.37:0/1574563223 wait complete. 2024-08-20T05:15:38.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.912+0000 7f90c3672740 20 client.28694 trim_cache size 0 max 16384 2024-08-20T05:15:38.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.944+0000 7f90c3672740 1 Processor -- start 2024-08-20T05:15:38.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.944+0000 7f90c3672740 1 -- start start 2024-08-20T05:15:38.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.944+0000 7f90c3672740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a40cb20 0x55c22a428f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.944+0000 7f90c3672740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 0x55c22a441d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.944+0000 7f90c3672740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a4277f0 0x55c22a442270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.944+0000 7f90c3672740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc1ad380 con 0x55c22a4277f0 2024-08-20T05:15:38.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.944+0000 7f90c3672740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc1aeef0 con 0x55c22a40d440 2024-08-20T05:15:38.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.944+0000 7f90c3672740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc1ada50 con 0x55c22a40cb20 2024-08-20T05:15:38.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.945+0000 7f90b9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a40cb20 0x55c22a428f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:38.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.945+0000 7f90b9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a40cb20 0x55c22a428f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43374/0 (socket says 172.21.15.37:43374) 2024-08-20T05:15:38.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.945+0000 7f90b9e00640 1 -- 172.21.15.37:0/2404551217 learned_addr learned my addr 172.21.15.37:0/2404551217 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:38.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.945+0000 7f90b9400640 1 --2- 172.21.15.37:0/2404551217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 0x55c22a441d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:38.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.946+0000 7f90ba800640 1 --2- 172.21.15.37:0/2404551217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a4277f0 0x55c22a442270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:38.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.946+0000 7f90b9e00640 1 -- 172.21.15.37:0/2404551217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 msgr2=0x55c22a441d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:38.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.947+0000 7f90b9e00640 1 --2- 172.21.15.37:0/2404551217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 0x55c22a441d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.947+0000 7f90b9e00640 1 -- 172.21.15.37:0/2404551217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a4277f0 msgr2=0x55c22a442270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:38.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.947+0000 7f90b9e00640 1 --2- 172.21.15.37:0/2404551217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a4277f0 0x55c22a442270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.947+0000 7f90b9e00640 1 -- 172.21.15.37:0/2404551217 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c22a426120 con 0x55c22a40cb20 2024-08-20T05:15:38.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.947+0000 7f90b9400640 1 --2- 172.21.15.37:0/2404551217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 0x55c22a441d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:15:38.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.948+0000 7f90b9e00640 1 --2- 172.21.15.37:0/2404551217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a40cb20 0x55c22a428f00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f90b40aa8a0 tx=0x7f90b40e1620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0186a20e560525c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:38.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.948+0000 7f90a6600640 1 -- 172.21.15.37:0/2404551217 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b40aa310 con 0x55c22a40cb20 2024-08-20T05:15:38.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.948+0000 7f90a6600640 1 -- 172.21.15.37:0/2404551217 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90b40aa6b0 con 0x55c22a40cb20 2024-08-20T05:15:38.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.948+0000 7f90a6600640 1 -- 172.21.15.37:0/2404551217 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b40a6330 con 0x55c22a40cb20 2024-08-20T05:15:38.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.949+0000 7f90c3672740 1 -- 172.21.15.37:0/2404551217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a40cb20 msgr2=0x55c22a428f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:38.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.949+0000 7f90c3672740 1 --2- 172.21.15.37:0/2404551217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a40cb20 0x55c22a428f00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f90b40aa8a0 tx=0x7f90b40e1620 comp rx=0 tx=0).stop 2024-08-20T05:15:38.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.950+0000 7f90c3672740 1 -- 172.21.15.37:0/2404551217 shutdown_connections 2024-08-20T05:15:38.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.950+0000 7f90c3672740 1 --2- 172.21.15.37:0/2404551217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a4277f0 0x55c22a442270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.950+0000 7f90c3672740 1 --2- 172.21.15.37:0/2404551217 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a40d440 0x55c22a441d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.950+0000 7f90c3672740 1 --2- 172.21.15.37:0/2404551217 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a40cb20 0x55c22a428f00 secure :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f90b40aa8a0 tx=0x7f90b40e1620 comp rx=0 tx=0).stop 2024-08-20T05:15:38.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.950+0000 7f90c3672740 1 -- 172.21.15.37:0/2404551217 >> 172.21.15.37:0/2404551217 conn(0x55c22a40a950 msgr2=0x55c22a4287f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:38.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.953+0000 7f90c3672740 1 -- 172.21.15.37:0/2404551217 shutdown_connections 2024-08-20T05:15:38.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.953+0000 7f90c3672740 1 -- 172.21.15.37:0/2404551217 wait complete. 2024-08-20T05:15:38.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.954+0000 7f90c3672740 1 -- start start 2024-08-20T05:15:38.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.954+0000 7f90c3672740 1 Processor -- start 2024-08-20T05:15:38.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.955+0000 7f90c3672740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a40d440 0x55c22a432b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.955+0000 7f90c3672740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a4277f0 0x55c22a441730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.956+0000 7f90b9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a40d440 0x55c22a432b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:38.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.956+0000 7f90c3672740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a441cc0 0x55c22a442140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.956+0000 7f90b9400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a4277f0 0x55c22a441730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:38.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.956+0000 7f90b9400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a4277f0 0x55c22a441730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42404/0 (socket says 172.21.15.37:42404) 2024-08-20T05:15:38.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.956+0000 7f90b9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a40d440 0x55c22a432b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43380/0 (socket says 172.21.15.37:43380) 2024-08-20T05:15:38.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.956+0000 7f90c3672740 1 -- 172.21.15.37:0/1549762566 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc1ae820 con 0x55c22a441cc0 2024-08-20T05:15:38.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.956+0000 7f90c3672740 1 -- 172.21.15.37:0/1549762566 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc1ae120 con 0x55c22a4277f0 2024-08-20T05:15:38.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.956+0000 7f90c3672740 1 -- 172.21.15.37:0/1549762566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc074470 con 0x55c22a40d440 2024-08-20T05:15:38.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.956+0000 7f90b9e00640 1 -- 172.21.15.37:0/1549762566 learned_addr learned my addr 172.21.15.37:0/1549762566 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:38.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.957+0000 7f90ba800640 1 --2- 172.21.15.37:0/1549762566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a441cc0 0x55c22a442140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:38.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.957+0000 7f90c3672740 10 client.0 _ll_register_callbacks cb 0x7f90b40e79a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:38.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.957+0000 7f90b9e00640 1 -- 172.21.15.37:0/1549762566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a4277f0 msgr2=0x55c22a441730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:38.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.957+0000 7f90b9e00640 1 --2- 172.21.15.37:0/1549762566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a4277f0 0x55c22a441730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.957+0000 7f90b9e00640 1 -- 172.21.15.37:0/1549762566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a441cc0 msgr2=0x55c22a442140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:38.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.959+0000 7f90b9e00640 1 --2- 172.21.15.37:0/1549762566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a441cc0 0x55c22a442140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.959+0000 7f90b9e00640 1 -- 172.21.15.37:0/1549762566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c22a40d270 con 0x55c22a40d440 2024-08-20T05:15:38.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.959+0000 7f90ba800640 1 --2- 172.21.15.37:0/1549762566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a441cc0 0x55c22a442140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:15:38.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.959+0000 7f90b9e00640 1 --2- 172.21.15.37:0/1549762566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a40d440 0x55c22a432b10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f90b40e1720 tx=0x7f90b4017eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ce3343d7d6aee56 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:38.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.961+0000 7f909b400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:15:38.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.961+0000 7f909b400640 1 -- 172.21.15.37:0/1549762566 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b40a6330 con 0x55c22a40d440 2024-08-20T05:15:38.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.961+0000 7f909b400640 1 -- 172.21.15.37:0/1549762566 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f90b400fca0 con 0x55c22a40d440 2024-08-20T05:15:38.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.962+0000 7f90c3672740 1 -- 172.21.15.37:0/1549762566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f90b40aa6b0 con 0x55c22a40d440 2024-08-20T05:15:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.962+0000 7f909b400640 1 -- 172.21.15.37:0/1549762566 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f90b40aa310 con 0x55c22a40d440 2024-08-20T05:15:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.962+0000 7f90c3672740 10 client.28738 fetch_fsmap learned FSMap version 49 2024-08-20T05:15:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.962+0000 7f90c3672740 1 -- 172.21.15.37:0/1549762566 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55c22a4a5010 con 0x55c22a40d440 2024-08-20T05:15:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.962+0000 7f909b400640 1 -- 172.21.15.37:0/1549762566 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90b40aa6b0 con 0x55c22a40d440 2024-08-20T05:15:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.962+0000 7f909b400640 1 -- 172.21.15.37:0/1549762566 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 49) ==== 8374+0+0 (secure 0 0 0) 0x7f90b400b030 con 0x55c22a40d440 2024-08-20T05:15:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.962+0000 7f90c3672740 10 client.28738 fetch_fsmap finished waiting for FSMap version 49 2024-08-20T05:15:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.962+0000 7f90c3672740 10 client.28738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.963+0000 7f90c3672740 20 client.28738 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.963+0000 7f90c3672740 1 --2- 172.21.15.37:0/1549762566 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c22a4a5580 0x55c22a4a79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:38.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.963+0000 7f90c3672740 4 client.28738 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:15:38.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.963+0000 7f90c3672740 1 -- 172.21.15.37:0/1549762566 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c22a3849f0 con 0x55c22a4a5580 2024-08-20T05:15:38.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.963+0000 7f90b9400640 1 --2- 172.21.15.37:0/1549762566 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c22a4a5580 0x55c22a4a79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.964+0000 7f90b9400640 1 --2- 172.21.15.37:0/1549762566 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c22a4a5580 0x55c22a4a79a0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3a06c8f63f049f5 server_cookie=ab8022e324e6fbb9 in_seq=0 out_seq=0 2024-08-20T05:15:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.964+0000 7f909b400640 10 client.28738 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.965+0000 7f909b400640 1 -- 172.21.15.37:0/1549762566 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c22a3849f0 con 0x55c22a4a5580 2024-08-20T05:15:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.965+0000 7f909b400640 10 client.28738 handle_command_reply: tid=0 2024-08-20T05:15:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.965+0000 7f90c3672740 1 client.28738 shutdown 2024-08-20T05:15:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.965+0000 7f90c3672740 1 -- 172.21.15.37:0/1549762566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a40d440 msgr2=0x55c22a432b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.965+0000 7f90c3672740 1 --2- 172.21.15.37:0/1549762566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a40d440 0x55c22a432b10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f90b40e1720 tx=0x7f90b4017eb0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.966+0000 7f90c3672740 1 -- 172.21.15.37:0/1549762566 shutdown_connections 2024-08-20T05:15:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.966+0000 7f90c3672740 1 --2- 172.21.15.37:0/1549762566 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c22a4a5580 0x55c22a4a79a0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.966+0000 7f90c3672740 1 --2- 172.21.15.37:0/1549762566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c22a441cc0 0x55c22a442140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.966+0000 7f90c3672740 1 --2- 172.21.15.37:0/1549762566 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c22a4277f0 0x55c22a441730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.966+0000 7f90c3672740 1 --2- 172.21.15.37:0/1549762566 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c22a40d440 0x55c22a432b10 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.966+0000 7f90c3672740 1 -- 172.21.15.37:0/1549762566 >> 172.21.15.37:0/1549762566 conn(0x55c22a40a950 msgr2=0x55c22a429010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:38.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.966+0000 7f909b400640 0 client.28738 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:38.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.966+0000 7f90c3672740 1 -- 172.21.15.37:0/1549762566 shutdown_connections 2024-08-20T05:15:38.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.966+0000 7f90c3672740 1 -- 172.21.15.37:0/1549762566 wait complete. 2024-08-20T05:15:38.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.967+0000 7f90c3672740 20 client.28738 trim_cache size 0 max 16384 2024-08-20T05:15:38.969 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:15:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.968+0000 7f90bb200640 1 -- 172.21.15.37:0/2446558465 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f90a00b3e10 msgr2=0x7f90a00b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.968+0000 7f90bb200640 1 --2- 172.21.15.37:0/2446558465 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f90a00b3e10 0x7f90a00b62d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f90a8005d00 tx=0x7f90a8005c90 comp rx=0 tx=0).stop 2024-08-20T05:15:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.968+0000 7f90bb200640 1 -- 172.21.15.37:0/2446558465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90bc104b00 msgr2=0x7f90bc111300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:38.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.968+0000 7f90bb200640 1 --2- 172.21.15.37:0/2446558465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90bc104b00 0x7f90bc111300 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f90b400ed80 tx=0x7f90b400c6e0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.968+0000 7f90bb200640 1 -- 172.21.15.37:0/2446558465 shutdown_connections 2024-08-20T05:15:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.968+0000 7f90bb200640 1 --2- 172.21.15.37:0/2446558465 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f90a00b3e10 0x7f90a00b62d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.968+0000 7f90bb200640 1 --2- 172.21.15.37:0/2446558465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90bc10ae90 0x7f90bc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.968+0000 7f90bb200640 1 --2- 172.21.15.37:0/2446558465 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f90bc10a510 0x7f90bc10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.968+0000 7f90bb200640 1 --2- 172.21.15.37:0/2446558465 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f90bc104b00 0x7f90bc111300 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.968+0000 7f90bb200640 1 -- 172.21.15.37:0/2446558465 >> 172.21.15.37:0/2446558465 conn(0x7f90bc100550 msgr2=0x7f90bc102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.969+0000 7f90bb200640 1 -- 172.21.15.37:0/2446558465 shutdown_connections 2024-08-20T05:15:38.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:38.969+0000 7f90bb200640 1 -- 172.21.15.37:0/2446558465 wait complete. 2024-08-20T05:15:39.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:39 smithi037 ceph-mon[17265]: pgmap v803: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 7.2 MiB/s wr, 665 op/s 2024-08-20T05:15:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:39 smithi135 ceph-mon[22342]: pgmap v803: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 7.2 MiB/s wr, 665 op/s 2024-08-20T05:15:39.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:39 smithi130 ceph-mon[22007]: pgmap v803: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 7.2 MiB/s wr, 665 op/s 2024-08-20T05:15:40.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:40 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:15:40.934 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T05:15:40.935 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T05:15:40.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:40 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:15:41.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:40 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:15:41.656 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:15:41.853 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:41 smithi037 ceph-mon[17265]: pgmap v804: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 6.9 MiB/s wr, 671 op/s 2024-08-20T05:15:41.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:41 smithi135 ceph-mon[22342]: pgmap v804: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 6.9 MiB/s wr, 671 op/s 2024-08-20T05:15:41.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:41 smithi130 ceph-mon[22007]: pgmap v804: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 6.9 MiB/s wr, 671 op/s 2024-08-20T05:15:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.630+0000 7fe25cc00640 1 -- 172.21.15.37:0/1461308266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2581039a0 msgr2=0x7fe258103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.630+0000 7fe25cc00640 1 --2- 172.21.15.37:0/1461308266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2581039a0 0x7fe258103d80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe248009900 tx=0x7fe24802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.632+0000 7fe25cc00640 1 -- 172.21.15.37:0/1461308266 shutdown_connections 2024-08-20T05:15:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.632+0000 7fe25cc00640 1 --2- 172.21.15.37:0/1461308266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe25810ce00 0x7fe25810f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.632+0000 7fe25cc00640 1 --2- 172.21.15.37:0/1461308266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2581042c0 0x7fe25810c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.632+0000 7fe25cc00640 1 --2- 172.21.15.37:0/1461308266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2581039a0 0x7fe258103d80 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.632+0000 7fe25cc00640 1 -- 172.21.15.37:0/1461308266 >> 172.21.15.37:0/1461308266 conn(0x7fe2580fd400 msgr2=0x7fe2580ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.632+0000 7fe25cc00640 1 -- 172.21.15.37:0/1461308266 shutdown_connections 2024-08-20T05:15:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.633+0000 7fe25cc00640 1 -- 172.21.15.37:0/1461308266 wait complete. 2024-08-20T05:15:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.634+0000 7fe25cc00640 1 Processor -- start 2024-08-20T05:15:42.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.636+0000 7fe25cc00640 1 -- start start 2024-08-20T05:15:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.637+0000 7fe25cc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2581039a0 0x7fe25810c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.637+0000 7fe25cc00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2581042c0 0x7fe25810c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.637+0000 7fe25cc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe25810ce00 0x7fe258108600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.637+0000 7fe25cc00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe25806d1a0 con 0x7fe2581042c0 2024-08-20T05:15:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.637+0000 7fe25cc00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe25806d020 con 0x7fe2581039a0 2024-08-20T05:15:42.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.637+0000 7fe25cc00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe25806d320 con 0x7fe25810ce00 2024-08-20T05:15:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.637+0000 7fe256800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe25810ce00 0x7fe258108600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.637+0000 7fe255e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2581039a0 0x7fe25810c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.637+0000 7fe255e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2581039a0 0x7fe25810c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42432/0 (socket says 172.21.15.37:42432) 2024-08-20T05:15:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.637+0000 7fe255e00640 1 -- 172.21.15.37:0/1242793479 learned_addr learned my addr 172.21.15.37:0/1242793479 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:42.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.638+0000 7fe24fe00640 1 --2- 172.21.15.37:0/1242793479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2581042c0 0x7fe25810c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:42.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.638+0000 7fe256800640 1 -- 172.21.15.37:0/1242793479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2581039a0 msgr2=0x7fe25810c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:42.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.638+0000 7fe256800640 1 --2- 172.21.15.37:0/1242793479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2581039a0 0x7fe25810c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.638+0000 7fe256800640 1 -- 172.21.15.37:0/1242793479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2581042c0 msgr2=0x7fe25810c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:42.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.638+0000 7fe256800640 1 --2- 172.21.15.37:0/1242793479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2581042c0 0x7fe25810c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.638+0000 7fe256800640 1 -- 172.21.15.37:0/1242793479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe258108ec0 con 0x7fe25810ce00 2024-08-20T05:15:42.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.638+0000 7fe255e00640 1 --2- 172.21.15.37:0/1242793479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2581039a0 0x7fe25810c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:15:42.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.639+0000 7fe256800640 1 --2- 172.21.15.37:0/1242793479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe25810ce00 0x7fe258108600 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe25000ca30 tx=0x7fe25000cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:42.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.640+0000 7fe24ea00640 1 -- 172.21.15.37:0/1242793479 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe250007d90 con 0x7fe25810ce00 2024-08-20T05:15:42.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.640+0000 7fe24ea00640 1 -- 172.21.15.37:0/1242793479 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe250005020 con 0x7fe25810ce00 2024-08-20T05:15:42.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.640+0000 7fe24ea00640 1 -- 172.21.15.37:0/1242793479 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25000f690 con 0x7fe25810ce00 2024-08-20T05:15:42.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.640+0000 7fe25cc00640 1 -- 172.21.15.37:0/1242793479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2581091b0 con 0x7fe25810ce00 2024-08-20T05:15:42.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.640+0000 7fe25cc00640 1 -- 172.21.15.37:0/1242793479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2581b02c0 con 0x7fe25810ce00 2024-08-20T05:15:42.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.651+0000 7fe25f61e740 1 Processor -- start 2024-08-20T05:15:42.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.651+0000 7fe24ea00640 1 -- 172.21.15.37:0/1242793479 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe25000f830 con 0x7fe25810ce00 2024-08-20T05:15:42.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.654+0000 7fe24ea00640 1 --2- 172.21.15.37:0/1242793479 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe23c0b3c50 0x7fe23c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.654+0000 7fe24ea00640 1 -- 172.21.15.37:0/1242793479 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe2500e4160 con 0x7fe25810ce00 2024-08-20T05:15:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.655+0000 7fe25f61e740 1 -- start start 2024-08-20T05:15:42.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.655+0000 7fe25f61e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc6a9d0 0x5560efc6adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.655+0000 7fe25f61e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6b2f0 0x5560efc76d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.655+0000 7fe25f61e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc77280 0x5560efc79670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.655+0000 7fe25f61e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5560efbe1870 con 0x5560efc6a9d0 2024-08-20T05:15:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.655+0000 7fe25f61e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5560efbd0d70 con 0x5560efc77280 2024-08-20T05:15:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.655+0000 7fe25f61e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5560efbd4db0 con 0x5560efc6b2f0 2024-08-20T05:15:42.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.659+0000 7fe256800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc77280 0x5560efc79670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:42.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.659+0000 7fe256800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc77280 0x5560efc79670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42446/0 (socket says 172.21.15.37:42446) 2024-08-20T05:15:42.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.659+0000 7fe256800640 1 -- 172.21.15.37:0/3156406221 learned_addr learned my addr 172.21.15.37:0/3156406221 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:42.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.660+0000 7fe255e00640 1 --2- 172.21.15.37:0/3156406221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc6a9d0 0x5560efc6adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:42.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.660+0000 7fe24fe00640 1 --2- 172.21.15.37:0/3156406221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6b2f0 0x5560efc76d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:42.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.660+0000 7fe256800640 1 -- 172.21.15.37:0/3156406221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6b2f0 msgr2=0x5560efc76d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:42.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.660+0000 7fe256800640 1 --2- 172.21.15.37:0/3156406221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6b2f0 0x5560efc76d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.660+0000 7fe256800640 1 -- 172.21.15.37:0/3156406221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc6a9d0 msgr2=0x5560efc6adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:42.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.660+0000 7fe256800640 1 --2- 172.21.15.37:0/3156406221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc6a9d0 0x5560efc6adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.660+0000 7fe256800640 1 -- 172.21.15.37:0/3156406221 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560ef930930 con 0x5560efc77280 2024-08-20T05:15:42.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.660+0000 7fe256800640 1 --2- 172.21.15.37:0/3156406221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc77280 0x5560efc79670 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe2500aaa10 tx=0x7fe2500aadd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f6360e36d4ece1c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:42.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.661+0000 7fe24fe00640 1 --2- 172.21.15.37:0/1242793479 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe23c0b3c50 0x7fe23c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:42.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.660+0000 7fe247000640 1 -- 172.21.15.37:0/3156406221 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25001d040 con 0x5560efc77280 2024-08-20T05:15:42.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.662+0000 7fe247000640 1 -- 172.21.15.37:0/3156406221 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2500b3dc0 con 0x5560efc77280 2024-08-20T05:15:42.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.662+0000 7fe247000640 1 -- 172.21.15.37:0/3156406221 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe25001d040 con 0x5560efc77280 2024-08-20T05:15:42.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.663+0000 7fe25f61e740 1 -- 172.21.15.37:0/3156406221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc77280 msgr2=0x5560efc79670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:42.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.663+0000 7fe25f61e740 1 --2- 172.21.15.37:0/3156406221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc77280 0x5560efc79670 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe2500aaa10 tx=0x7fe2500aadd0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.663+0000 7fe24fe00640 1 --2- 172.21.15.37:0/1242793479 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe23c0b3c50 0x7fe23c0b6110 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe240006fd0 tx=0x7fe2400046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:42.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.666+0000 7fe25f61e740 1 -- 172.21.15.37:0/3156406221 shutdown_connections 2024-08-20T05:15:42.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.666+0000 7fe25f61e740 1 --2- 172.21.15.37:0/3156406221 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc77280 0x5560efc79670 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.666+0000 7fe25f61e740 1 --2- 172.21.15.37:0/3156406221 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6b2f0 0x5560efc76d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.666+0000 7fe25f61e740 1 --2- 172.21.15.37:0/3156406221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc6a9d0 0x5560efc6adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.667+0000 7fe25f61e740 1 -- 172.21.15.37:0/3156406221 >> 172.21.15.37:0/3156406221 conn(0x5560efc68800 msgr2=0x5560efc699a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:42.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.667+0000 7fe25f61e740 1 -- 172.21.15.37:0/3156406221 shutdown_connections 2024-08-20T05:15:42.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.667+0000 7fe25f61e740 1 -- 172.21.15.37:0/3156406221 wait complete. 2024-08-20T05:15:42.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.668+0000 7fe25f61e740 1 -- start start 2024-08-20T05:15:42.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.669+0000 7fe25f61e740 1 Processor -- start 2024-08-20T05:15:42.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.670+0000 7fe25f61e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc6a9d0 0x5560efc76b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.670+0000 7fe25f61e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6b2f0 0x5560efc73f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.670+0000 7fe25f61e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc77280 0x5560efc74500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.670+0000 7fe25f61e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5560efa33890 con 0x5560efc77280 2024-08-20T05:15:42.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.670+0000 7fe25f61e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5560efb57b00 con 0x5560efc6a9d0 2024-08-20T05:15:42.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.670+0000 7fe25f61e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5560efc79fd0 con 0x5560efc6b2f0 2024-08-20T05:15:42.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.670+0000 7fe25f61e740 10 client.0 _ll_register_callbacks cb 0x5560efbcbdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:42.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.671+0000 7fe256800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc77280 0x5560efc74500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:42.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.671+0000 7fe256800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc77280 0x5560efc74500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54954/0 (socket says 172.21.15.37:54954) 2024-08-20T05:15:42.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.671+0000 7fe256800640 1 -- 172.21.15.37:0/3829788428 learned_addr learned my addr 172.21.15.37:0/3829788428 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:42.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.671+0000 7fe255e00640 1 --2- 172.21.15.37:0/3829788428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc6a9d0 0x5560efc76b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:42.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.672+0000 7fe24fe00640 1 --2- 172.21.15.37:0/3829788428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6b2f0 0x5560efc73f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:42.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.672+0000 7fe24fe00640 1 -- 172.21.15.37:0/3829788428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc6a9d0 msgr2=0x5560efc76b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:42.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.672+0000 7fe24fe00640 1 --2- 172.21.15.37:0/3829788428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc6a9d0 0x5560efc76b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.672+0000 7fe24fe00640 1 -- 172.21.15.37:0/3829788428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc77280 msgr2=0x5560efc74500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:42.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.672+0000 7fe24fe00640 1 --2- 172.21.15.37:0/3829788428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc77280 0x5560efc74500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.672+0000 7fe24fe00640 1 -- 172.21.15.37:0/3829788428 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560efb98a30 con 0x5560efc6b2f0 2024-08-20T05:15:42.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.673+0000 7fe24fe00640 1 --2- 172.21.15.37:0/3829788428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6b2f0 0x5560efc73f60 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x5560efc6db50 tx=0x7fe240006da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6cac18c77adaad server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:42.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.673+0000 7fe23b400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:15:42.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.673+0000 7fe23b400640 1 -- 172.21.15.37:0/3829788428 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24001b050 con 0x5560efc6b2f0 2024-08-20T05:15:42.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.673+0000 7fe23b400640 1 -- 172.21.15.37:0/3829788428 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe240015820 con 0x5560efc6b2f0 2024-08-20T05:15:42.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.673+0000 7fe25f61e740 1 -- 172.21.15.37:0/3829788428 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2500b3dc0 con 0x5560efc6b2f0 2024-08-20T05:15:42.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.674+0000 7fe23b400640 1 -- 172.21.15.37:0/3829788428 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe240015a20 con 0x5560efc6b2f0 2024-08-20T05:15:42.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.674+0000 7fe25f61e740 10 client.28747 fetch_fsmap learned FSMap version 50 2024-08-20T05:15:42.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.674+0000 7fe25f61e740 1 -- 172.21.15.37:0/3829788428 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5560efc85950 con 0x5560efc6b2f0 2024-08-20T05:15:42.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.675+0000 7fe23b400640 1 -- 172.21.15.37:0/3829788428 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2500b3dc0 con 0x5560efc6b2f0 2024-08-20T05:15:42.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.675+0000 7fe23b400640 1 -- 172.21.15.37:0/3829788428 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fe240020cb0 con 0x5560efc6b2f0 2024-08-20T05:15:42.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.675+0000 7fe25f61e740 10 client.28747 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:15:42.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.675+0000 7fe25f61e740 10 client.28747 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:42.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.675+0000 7fe25f61e740 20 client.28747 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:42.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.675+0000 7fe25f61e740 1 --2- 172.21.15.37:0/3829788428 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5560efc86e60 0x5560efc89250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.675+0000 7fe25f61e740 4 client.28747 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:15:42.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.675+0000 7fe25f61e740 1 -- 172.21.15.37:0/3829788428 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5560efbe37c0 con 0x5560efc86e60 2024-08-20T05:15:42.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.676+0000 7fe255e00640 1 --2- 172.21.15.37:0/3829788428 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5560efc86e60 0x5560efc89250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:42.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.679+0000 7fe255e00640 1 --2- 172.21.15.37:0/3829788428 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5560efc86e60 0x5560efc89250 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e2f77b603fc23d1 server_cookie=cbc7fcbfbe286f5f in_seq=0 out_seq=0 2024-08-20T05:15:42.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.679+0000 7fe23b400640 10 client.28747 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:42.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.680+0000 7fe23b400640 1 -- 172.21.15.37:0/3829788428 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5560efbe37c0 con 0x5560efc86e60 2024-08-20T05:15:42.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.680+0000 7fe23b400640 10 client.28747 handle_command_reply: tid=0 2024-08-20T05:15:42.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.681+0000 7fe25f61e740 1 client.28747 shutdown 2024-08-20T05:15:42.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.682+0000 7fe25f61e740 1 -- 172.21.15.37:0/3829788428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6b2f0 msgr2=0x5560efc73f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:42.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.682+0000 7fe25f61e740 1 --2- 172.21.15.37:0/3829788428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6b2f0 0x5560efc73f60 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x5560efc6db50 tx=0x7fe240006da0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.683+0000 7fe25f61e740 1 -- 172.21.15.37:0/3829788428 shutdown_connections 2024-08-20T05:15:42.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.683+0000 7fe25f61e740 1 --2- 172.21.15.37:0/3829788428 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5560efc86e60 0x5560efc89250 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.683+0000 7fe25f61e740 1 --2- 172.21.15.37:0/3829788428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc77280 0x5560efc74500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.683+0000 7fe25f61e740 1 --2- 172.21.15.37:0/3829788428 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6b2f0 0x5560efc73f60 secure :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0x5560efc6db50 tx=0x7fe240006da0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.683+0000 7fe25f61e740 1 --2- 172.21.15.37:0/3829788428 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc6a9d0 0x5560efc76b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.683+0000 7fe25f61e740 1 -- 172.21.15.37:0/3829788428 >> 172.21.15.37:0/3829788428 conn(0x5560efc68800 msgr2=0x5560efc6e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:42.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.683+0000 7fe23b400640 0 client.28747 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:42.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.683+0000 7fe25f61e740 1 -- 172.21.15.37:0/3829788428 shutdown_connections 2024-08-20T05:15:42.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.683+0000 7fe25f61e740 1 -- 172.21.15.37:0/3829788428 wait complete. 2024-08-20T05:15:42.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.684+0000 7fe25f61e740 20 client.28747 trim_cache size 0 max 16384 2024-08-20T05:15:42.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.730+0000 7fe25f61e740 1 Processor -- start 2024-08-20T05:15:42.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.731+0000 7fe25f61e740 1 -- start start 2024-08-20T05:15:42.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.732+0000 7fe25f61e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6a9d0 0x5560efc830f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.733+0000 7fe25f61e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc77280 0x5560efc8eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.733+0000 7fe25f61e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc69f80 0x5560efc8f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.733+0000 7fe25f61e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe2581ba4b0 con 0x5560efc77280 2024-08-20T05:15:42.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.733+0000 7fe25f61e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe2581bc050 con 0x5560efc69f80 2024-08-20T05:15:42.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.733+0000 7fe25f61e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe2581bab80 con 0x5560efc6a9d0 2024-08-20T05:15:42.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.733+0000 7fe255e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6a9d0 0x5560efc830f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:42.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.733+0000 7fe255e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6a9d0 0x5560efc830f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43430/0 (socket says 172.21.15.37:43430) 2024-08-20T05:15:42.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.733+0000 7fe255e00640 1 -- 172.21.15.37:0/4143105169 learned_addr learned my addr 172.21.15.37:0/4143105169 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:42.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.734+0000 7fe255e00640 1 -- 172.21.15.37:0/4143105169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc69f80 msgr2=0x5560efc8f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:42.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.734+0000 7fe255e00640 1 --2- 172.21.15.37:0/4143105169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc69f80 0x5560efc8f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.734+0000 7fe255e00640 1 -- 172.21.15.37:0/4143105169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc77280 msgr2=0x5560efc8eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.734+0000 7fe255e00640 1 --2- 172.21.15.37:0/4143105169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc77280 0x5560efc8eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.734+0000 7fe255e00640 1 -- 172.21.15.37:0/4143105169 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560efc68630 con 0x5560efc6a9d0 2024-08-20T05:15:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.734+0000 7fe255e00640 1 --2- 172.21.15.37:0/4143105169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6a9d0 0x5560efc830f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe2480042c0 tx=0x7fe24800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=640eb39df22b748d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.735+0000 7fe246600640 1 -- 172.21.15.37:0/4143105169 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248035040 con 0x5560efc6a9d0 2024-08-20T05:15:42.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.735+0000 7fe246600640 1 -- 172.21.15.37:0/4143105169 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2480054d0 con 0x5560efc6a9d0 2024-08-20T05:15:42.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.735+0000 7fe246600640 1 -- 172.21.15.37:0/4143105169 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248004c40 con 0x5560efc6a9d0 2024-08-20T05:15:42.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.740+0000 7fe25f61e740 1 -- 172.21.15.37:0/4143105169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6a9d0 msgr2=0x5560efc830f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:42.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.740+0000 7fe25f61e740 1 --2- 172.21.15.37:0/4143105169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6a9d0 0x5560efc830f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe2480042c0 tx=0x7fe24800b040 comp rx=0 tx=0).stop 2024-08-20T05:15:42.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.740+0000 7fe25f61e740 1 -- 172.21.15.37:0/4143105169 shutdown_connections 2024-08-20T05:15:42.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.740+0000 7fe25f61e740 1 --2- 172.21.15.37:0/4143105169 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc69f80 0x5560efc8f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.740+0000 7fe25f61e740 1 --2- 172.21.15.37:0/4143105169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc77280 0x5560efc8eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.740+0000 7fe25f61e740 1 --2- 172.21.15.37:0/4143105169 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc6a9d0 0x5560efc830f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.740+0000 7fe25f61e740 1 -- 172.21.15.37:0/4143105169 >> 172.21.15.37:0/4143105169 conn(0x5560efc68800 msgr2=0x5560efc6f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:42.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.741+0000 7fe25f61e740 1 -- 172.21.15.37:0/4143105169 shutdown_connections 2024-08-20T05:15:42.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.741+0000 7fe25f61e740 1 -- 172.21.15.37:0/4143105169 wait complete. 2024-08-20T05:15:42.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.741+0000 7fe25f61e740 1 -- start start 2024-08-20T05:15:42.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.742+0000 7fe25f61e740 1 Processor -- start 2024-08-20T05:15:42.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.743+0000 7fe25f61e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc69f80 0x5560efc7f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.743+0000 7fe25f61e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc6a9d0 0x5560efc7bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.743+0000 7fe25f61e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc77280 0x5560efc7c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.743+0000 7fe25f61e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe2581bb980 con 0x5560efc6a9d0 2024-08-20T05:15:42.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.743+0000 7fe25f61e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe2581bb250 con 0x5560efc77280 2024-08-20T05:15:42.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.743+0000 7fe25f61e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe2581b8490 con 0x5560efc69f80 2024-08-20T05:15:42.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.743+0000 7fe25f61e740 10 client.0 _ll_register_callbacks cb 0x7fe25806b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:42.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.744+0000 7fe255e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc69f80 0x5560efc7f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:42.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.744+0000 7fe255e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc69f80 0x5560efc7f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43432/0 (socket says 172.21.15.37:43432) 2024-08-20T05:15:42.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.744+0000 7fe255e00640 1 -- 172.21.15.37:0/2335885196 learned_addr learned my addr 172.21.15.37:0/2335885196 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:42.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.744+0000 7fe256800640 1 --2- 172.21.15.37:0/2335885196 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc77280 0x5560efc7c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:42.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.745+0000 7fe24fe00640 1 --2- 172.21.15.37:0/2335885196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc6a9d0 0x5560efc7bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:42.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.746+0000 7fe255e00640 1 -- 172.21.15.37:0/2335885196 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc77280 msgr2=0x5560efc7c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:42.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.746+0000 7fe255e00640 1 --2- 172.21.15.37:0/2335885196 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc77280 0x5560efc7c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.746+0000 7fe255e00640 1 -- 172.21.15.37:0/2335885196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc6a9d0 msgr2=0x5560efc7bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:42.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.746+0000 7fe255e00640 1 --2- 172.21.15.37:0/2335885196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc6a9d0 0x5560efc7bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.747+0000 7fe255e00640 1 -- 172.21.15.37:0/2335885196 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560efc69280 con 0x5560efc69f80 2024-08-20T05:15:42.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.748+0000 7fe255e00640 1 --2- 172.21.15.37:0/2335885196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc69f80 0x5560efc7f860 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe248005790 tx=0x7fe248005020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1e95649349e895 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:42.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.748+0000 7fe23b400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:15:42.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.750+0000 7fe23b400640 1 -- 172.21.15.37:0/2335885196 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe248035050 con 0x5560efc69f80 2024-08-20T05:15:42.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.750+0000 7fe23b400640 1 -- 172.21.15.37:0/2335885196 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe248032c30 con 0x5560efc69f80 2024-08-20T05:15:42.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.751+0000 7fe25f61e740 1 -- 172.21.15.37:0/2335885196 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2480054d0 con 0x5560efc69f80 2024-08-20T05:15:42.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.751+0000 7fe23b400640 1 -- 172.21.15.37:0/2335885196 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe248032e30 con 0x5560efc69f80 2024-08-20T05:15:42.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.752+0000 7fe25f61e740 10 client.28753 fetch_fsmap learned FSMap version 50 2024-08-20T05:15:42.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.752+0000 7fe25f61e740 1 -- 172.21.15.37:0/2335885196 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5560efc62de0 con 0x5560efc69f80 2024-08-20T05:15:42.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.752+0000 7fe23b400640 1 -- 172.21.15.37:0/2335885196 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2480054d0 con 0x5560efc69f80 2024-08-20T05:15:42.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.753+0000 7fe23b400640 1 -- 172.21.15.37:0/2335885196 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fe24804e970 con 0x5560efc69f80 2024-08-20T05:15:42.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.754+0000 7fe25f61e740 10 client.28753 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:15:42.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.754+0000 7fe25f61e740 10 client.28753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:42.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.754+0000 7fe25f61e740 20 client.28753 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:42.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.754+0000 7fe25f61e740 1 --2- 172.21.15.37:0/2335885196 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5560efcfb650 0x5560efcfda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:42.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.754+0000 7fe24fe00640 1 --2- 172.21.15.37:0/2335885196 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5560efcfb650 0x5560efcfda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:42.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.755+0000 7fe25f61e740 4 client.28753 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T05:15:42.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.755+0000 7fe25f61e740 1 -- 172.21.15.37:0/2335885196 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5560efbdf260 con 0x5560efcfb650 2024-08-20T05:15:42.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.755+0000 7fe24fe00640 1 --2- 172.21.15.37:0/2335885196 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5560efcfb650 0x5560efcfda70 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2535b6503dd24c97 server_cookie=54cb313bfcef4ceb in_seq=0 out_seq=0 2024-08-20T05:15:42.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.756+0000 7fe23b400640 10 client.28753 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:42.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.756+0000 7fe23b400640 1 -- 172.21.15.37:0/2335885196 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5560efbdf260 con 0x5560efcfb650 2024-08-20T05:15:42.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.756+0000 7fe23b400640 10 client.28753 handle_command_reply: tid=0 2024-08-20T05:15:42.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.756+0000 7fe25f61e740 1 client.28753 shutdown 2024-08-20T05:15:42.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.756+0000 7fe25f61e740 1 -- 172.21.15.37:0/2335885196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc69f80 msgr2=0x5560efc7f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:42.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.756+0000 7fe25f61e740 1 --2- 172.21.15.37:0/2335885196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc69f80 0x5560efc7f860 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fe248005790 tx=0x7fe248005020 comp rx=0 tx=0).stop 2024-08-20T05:15:42.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.757+0000 7fe25f61e740 1 -- 172.21.15.37:0/2335885196 shutdown_connections 2024-08-20T05:15:42.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.757+0000 7fe25f61e740 1 --2- 172.21.15.37:0/2335885196 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5560efcfb650 0x5560efcfda70 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.757+0000 7fe25f61e740 1 --2- 172.21.15.37:0/2335885196 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5560efc77280 0x5560efc7c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.757+0000 7fe25f61e740 1 --2- 172.21.15.37:0/2335885196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5560efc6a9d0 0x5560efc7bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.757+0000 7fe25f61e740 1 --2- 172.21.15.37:0/2335885196 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5560efc69f80 0x5560efc7f860 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.757+0000 7fe23b400640 0 client.28753 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:42.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.757+0000 7fe25f61e740 1 -- 172.21.15.37:0/2335885196 >> 172.21.15.37:0/2335885196 conn(0x5560efc68800 msgr2=0x5560efc670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:42.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.757+0000 7fe25f61e740 1 -- 172.21.15.37:0/2335885196 shutdown_connections 2024-08-20T05:15:42.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.757+0000 7fe25f61e740 1 -- 172.21.15.37:0/2335885196 wait complete. 2024-08-20T05:15:42.761 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:15:42.761 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-20T05:15:42.761 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "105fb8ec-e69e-4208-be4b-a3be74a706c1", 2024-08-20T05:15:42.761 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-20T05:15:42.761 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:15:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.757+0000 7fe25f61e740 20 client.28753 trim_cache size 0 max 16384 2024-08-20T05:15:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.758+0000 7fe25cc00640 1 -- 172.21.15.37:0/1242793479 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe23c0b3c50 msgr2=0x7fe23c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.758+0000 7fe25cc00640 1 --2- 172.21.15.37:0/1242793479 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe23c0b3c50 0x7fe23c0b6110 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe240006fd0 tx=0x7fe2400046c0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.758+0000 7fe25cc00640 1 -- 172.21.15.37:0/1242793479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe25810ce00 msgr2=0x7fe258108600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.758+0000 7fe25cc00640 1 --2- 172.21.15.37:0/1242793479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe25810ce00 0x7fe258108600 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe25000ca30 tx=0x7fe25000cef0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.758+0000 7fe25cc00640 1 -- 172.21.15.37:0/1242793479 shutdown_connections 2024-08-20T05:15:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.758+0000 7fe25cc00640 1 --2- 172.21.15.37:0/1242793479 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe23c0b3c50 0x7fe23c0b6110 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.758+0000 7fe25cc00640 1 --2- 172.21.15.37:0/1242793479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe25810ce00 0x7fe258108600 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.758+0000 7fe25cc00640 1 --2- 172.21.15.37:0/1242793479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2581042c0 0x7fe25810c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.758+0000 7fe25cc00640 1 --2- 172.21.15.37:0/1242793479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe2581039a0 0x7fe25810c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.758+0000 7fe25cc00640 1 -- 172.21.15.37:0/1242793479 >> 172.21.15.37:0/1242793479 conn(0x7fe2580fd400 msgr2=0x7fe258101530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.759+0000 7fe25cc00640 1 -- 172.21.15.37:0/1242793479 shutdown_connections 2024-08-20T05:15:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:42.759+0000 7fe25cc00640 1 -- 172.21.15.37:0/1242793479 wait complete. 2024-08-20T05:15:43.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 765.0 s, 532.2 tps, lat 187.276 ms stddev 212.932 2024-08-20T05:15:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.131+0000 7fbf95800640 1 -- 172.21.15.37:0/1190816700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf901046b0 msgr2=0x7fbf90104ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.131+0000 7fbf95800640 1 --2- 172.21.15.37:0/1190816700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf901046b0 0x7fbf90104ab0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009930 tx=0x7fbf8002a440 comp rx=0 tx=0).stop 2024-08-20T05:15:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.131+0000 7fbf95800640 1 -- 172.21.15.37:0/1190816700 shutdown_connections 2024-08-20T05:15:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.131+0000 7fbf95800640 1 --2- 172.21.15.37:0/1190816700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf901061c0 0x7fbf9010cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.131+0000 7fbf95800640 1 --2- 172.21.15.37:0/1190816700 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf90105800 0x7fbf90105c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.131+0000 7fbf95800640 1 --2- 172.21.15.37:0/1190816700 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf901046b0 0x7fbf90104ab0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.131+0000 7fbf95800640 1 -- 172.21.15.37:0/1190816700 >> 172.21.15.37:0/1190816700 conn(0x7fbf900fff50 msgr2=0x7fbf90102390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.131+0000 7fbf95800640 1 -- 172.21.15.37:0/1190816700 shutdown_connections 2024-08-20T05:15:43.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.132+0000 7fbf95800640 1 -- 172.21.15.37:0/1190816700 wait complete. 2024-08-20T05:15:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.132+0000 7fbf95800640 1 Processor -- start 2024-08-20T05:15:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.132+0000 7fbf95800640 1 -- start start 2024-08-20T05:15:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.133+0000 7fbf95800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf901046b0 0x7fbf9019ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.133+0000 7fbf95800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf90105800 0x7fbf9019b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.133+0000 7fbf95800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf901061c0 0x7fbf9019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.133+0000 7fbf95800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbf90110350 con 0x7fbf90105800 2024-08-20T05:15:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.133+0000 7fbf95800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbf901101d0 con 0x7fbf901046b0 2024-08-20T05:15:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.133+0000 7fbf95800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbf901104d0 con 0x7fbf901061c0 2024-08-20T05:15:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.133+0000 7fbf8fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf901046b0 0x7fbf9019ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.133+0000 7fbf94e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf901061c0 0x7fbf9019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.133+0000 7fbf8fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf901046b0 0x7fbf9019ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:48852/0 (socket says 172.21.15.37:48852) 2024-08-20T05:15:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.133+0000 7fbf8f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf90105800 0x7fbf9019b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.133+0000 7fbf8fe00640 1 -- 172.21.15.37:0/3222727881 learned_addr learned my addr 172.21.15.37:0/3222727881 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.133+0000 7fbf94e00640 1 -- 172.21.15.37:0/3222727881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf901046b0 msgr2=0x7fbf9019ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.133+0000 7fbf94e00640 1 --2- 172.21.15.37:0/3222727881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf901046b0 0x7fbf9019ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.134+0000 7fbf94e00640 1 -- 172.21.15.37:0/3222727881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf90105800 msgr2=0x7fbf9019b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.134+0000 7fbf94e00640 1 --2- 172.21.15.37:0/3222727881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf90105800 0x7fbf9019b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.134+0000 7fbf94e00640 1 -- 172.21.15.37:0/3222727881 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf9019c650 con 0x7fbf901061c0 2024-08-20T05:15:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.134+0000 7fbf8f400640 1 --2- 172.21.15.37:0/3222727881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf90105800 0x7fbf9019b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:15:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.134+0000 7fbf8fe00640 1 --2- 172.21.15.37:0/3222727881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf901046b0 0x7fbf9019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:15:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.134+0000 7fbf94e00640 1 --2- 172.21.15.37:0/3222727881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf901061c0 0x7fbf9019bd90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009fd0 tx=0x7fbf8800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.134+0000 7fbf8cc00640 1 -- 172.21.15.37:0/3222727881 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf8800ce20 con 0x7fbf901061c0 2024-08-20T05:15:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.134+0000 7fbf95800640 1 -- 172.21.15.37:0/3222727881 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf9019c940 con 0x7fbf901061c0 2024-08-20T05:15:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.134+0000 7fbf8cc00640 1 -- 172.21.15.37:0/3222727881 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf88005020 con 0x7fbf901061c0 2024-08-20T05:15:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.134+0000 7fbf8cc00640 1 -- 172.21.15.37:0/3222727881 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf88010690 con 0x7fbf901061c0 2024-08-20T05:15:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.134+0000 7fbf95800640 1 -- 172.21.15.37:0/3222727881 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf901a3010 con 0x7fbf901061c0 2024-08-20T05:15:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.137+0000 7fbf99c7e740 1 Processor -- start 2024-08-20T05:15:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.138+0000 7fbf8cc00640 1 -- 172.21.15.37:0/3222727881 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbf880054d0 con 0x7fbf901061c0 2024-08-20T05:15:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.138+0000 7fbf99c7e740 1 -- start start 2024-08-20T05:15:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.138+0000 7fbf99c7e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706ae7f0 0x5589706b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.138+0000 7fbf99c7e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b1120 0x5589706b3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.138+0000 7fbf99c7e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706b3b60 0x5589706b6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.138+0000 7fbf99c7e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558970621210 con 0x5589706b1120 2024-08-20T05:15:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.138+0000 7fbf99c7e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558970610710 con 0x5589706ae7f0 2024-08-20T05:15:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.138+0000 7fbf99c7e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558970614750 con 0x5589706b3b60 2024-08-20T05:15:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.139+0000 7fbf8fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b1120 0x5589706b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.139+0000 7fbf8fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b1120 0x5589706b3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34808/0 (socket says 172.21.15.37:34808) 2024-08-20T05:15:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.139+0000 7fbf8fe00640 1 -- 172.21.15.37:0/2812152710 learned_addr learned my addr 172.21.15.37:0/2812152710 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.139+0000 7fbf8f400640 1 --2- 172.21.15.37:0/2812152710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706ae7f0 0x5589706b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.139+0000 7fbf8fe00640 1 -- 172.21.15.37:0/2812152710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706b3b60 msgr2=0x5589706b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.139+0000 7fbf8f400640 1 --2- 172.21.15.37:0/2812152710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706b3b60 0x5589706b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.139+0000 7fbf8fe00640 1 --2- 172.21.15.37:0/2812152710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706b3b60 0x5589706b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.139+0000 7fbf8fe00640 1 -- 172.21.15.37:0/2812152710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706ae7f0 msgr2=0x5589706b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.139+0000 7fbf8fe00640 1 --2- 172.21.15.37:0/2812152710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706ae7f0 0x5589706b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.139+0000 7fbf8fe00640 1 -- 172.21.15.37:0/2812152710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589705dcde0 con 0x5589706b1120 2024-08-20T05:15:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.139+0000 7fbf8f400640 1 --2- 172.21.15.37:0/2812152710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706b3b60 0x5589706b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.139+0000 7fbf8fe00640 1 --2- 172.21.15.37:0/2812152710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b1120 0x5589706b3510 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbf8002a960 tx=0x7fbf80005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b585ba87671e090e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.140+0000 7fbf85600640 1 -- 172.21.15.37:0/2812152710 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80035030 con 0x5589706b1120 2024-08-20T05:15:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.140+0000 7fbf85600640 1 -- 172.21.15.37:0/2812152710 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf80040070 con 0x5589706b1120 2024-08-20T05:15:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.140+0000 7fbf85600640 1 -- 172.21.15.37:0/2812152710 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80031dc0 con 0x5589706b1120 2024-08-20T05:15:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.140+0000 7fbf8cc00640 1 --2- 172.21.15.37:0/3222727881 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbf740b3bd0 0x7fbf740b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.140+0000 7fbf8cc00640 1 -- 172.21.15.37:0/3222727881 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbf880e46b0 con 0x7fbf901061c0 2024-08-20T05:15:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.140+0000 7fbf8f400640 1 --2- 172.21.15.37:0/3222727881 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbf740b3bd0 0x7fbf740b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.140+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2812152710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b1120 msgr2=0x5589706b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.140+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/2812152710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b1120 0x5589706b3510 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fbf8002a960 tx=0x7fbf80005c00 comp rx=0 tx=0).stop 2024-08-20T05:15:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.140+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2812152710 shutdown_connections 2024-08-20T05:15:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.141+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/2812152710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706b3b60 0x5589706b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.141+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/2812152710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b1120 0x5589706b3510 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.141+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/2812152710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706ae7f0 0x5589706b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.141+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2812152710 >> 172.21.15.37:0/2812152710 conn(0x5589706a9940 msgr2=0x5589706aa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.141+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2812152710 shutdown_connections 2024-08-20T05:15:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.141+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2812152710 wait complete. 2024-08-20T05:15:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.141+0000 7fbf8f400640 1 --2- 172.21.15.37:0/3222727881 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbf740b3bd0 0x7fbf740b6090 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0058c0 tx=0x7fbf7c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.141+0000 7fbf99c7e740 1 -- start start 2024-08-20T05:15:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.141+0000 7fbf99c7e740 1 Processor -- start 2024-08-20T05:15:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf99c7e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706ae7f0 0x5589706b7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf99c7e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706b1120 0x5589706b8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf99c7e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b3b60 0x5589706b90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf99c7e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558970549ab0 con 0x5589706b3b60 2024-08-20T05:15:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf99c7e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5589705b7140 con 0x5589706ae7f0 2024-08-20T05:15:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf99c7e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5589706b6ae0 con 0x5589706b1120 2024-08-20T05:15:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf99c7e740 10 client.0 _ll_register_callbacks cb 0x5589705ca5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf8fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706ae7f0 0x5589706b7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf8f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706b1120 0x5589706b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf8fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706ae7f0 0x5589706b7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:48884/0 (socket says 172.21.15.37:48884) 2024-08-20T05:15:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf8fe00640 1 -- 172.21.15.37:0/625436653 learned_addr learned my addr 172.21.15.37:0/625436653 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf8f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706b1120 0x5589706b8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49096/0 (socket says 172.21.15.37:49096) 2024-08-20T05:15:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf94e00640 1 --2- 172.21.15.37:0/625436653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b3b60 0x5589706b90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf8fe00640 1 -- 172.21.15.37:0/625436653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706b1120 msgr2=0x5589706b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf8fe00640 1 --2- 172.21.15.37:0/625436653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706b1120 0x5589706b8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf8fe00640 1 -- 172.21.15.37:0/625436653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b3b60 msgr2=0x5589706b90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf8fe00640 1 --2- 172.21.15.37:0/625436653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b3b60 0x5589706b90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.142+0000 7fbf8fe00640 1 -- 172.21.15.37:0/625436653 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589705b8170 con 0x5589706ae7f0 2024-08-20T05:15:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.143+0000 7fbf8fe00640 1 --2- 172.21.15.37:0/625436653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706ae7f0 0x5589706b7e70 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbf80006010 tx=0x7fbf800317d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa58814b27c2d541 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.143+0000 7fbf7a000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:15:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.143+0000 7fbf7a000640 1 -- 172.21.15.37:0/625436653 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80053060 con 0x5589706ae7f0 2024-08-20T05:15:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.143+0000 7fbf99c7e740 1 -- 172.21.15.37:0/625436653 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf80040070 con 0x5589706ae7f0 2024-08-20T05:15:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.143+0000 7fbf7a000640 1 -- 172.21.15.37:0/625436653 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbf800037f0 con 0x5589706ae7f0 2024-08-20T05:15:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.143+0000 7fbf7a000640 1 -- 172.21.15.37:0/625436653 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fbf80035070 con 0x5589706ae7f0 2024-08-20T05:15:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.143+0000 7fbf99c7e740 10 client.28727 fetch_fsmap learned FSMap version 50 2024-08-20T05:15:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.143+0000 7fbf99c7e740 1 -- 172.21.15.37:0/625436653 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x558970373790 con 0x5589706ae7f0 2024-08-20T05:15:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.143+0000 7fbf7a000640 1 -- 172.21.15.37:0/625436653 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf80040070 con 0x5589706ae7f0 2024-08-20T05:15:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.144+0000 7fbf7a000640 1 -- 172.21.15.37:0/625436653 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fbf8004d030 con 0x5589706ae7f0 2024-08-20T05:15:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.144+0000 7fbf99c7e740 10 client.28727 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:15:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.144+0000 7fbf99c7e740 10 client.28727 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.144+0000 7fbf99c7e740 20 client.28727 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.144+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/625436653 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5589706c3600 0x5589706c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.144+0000 7fbf99c7e740 4 client.28727 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:15:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.144+0000 7fbf99c7e740 1 -- 172.21.15.37:0/625436653 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558970623160 con 0x5589706c3600 2024-08-20T05:15:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.144+0000 7fbf8f400640 1 --2- 172.21.15.37:0/625436653 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5589706c3600 0x5589706c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.145+0000 7fbf8f400640 1 --2- 172.21.15.37:0/625436653 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5589706c3600 0x5589706c59f0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4cd0290eb965baf server_cookie=d8b6777783e41dd3 in_seq=0 out_seq=0 2024-08-20T05:15:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.145+0000 7fbf7a000640 10 client.28727 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.145+0000 7fbf7a000640 1 -- 172.21.15.37:0/625436653 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558970623160 con 0x5589706c3600 2024-08-20T05:15:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.145+0000 7fbf7a000640 10 client.28727 handle_command_reply: tid=0 2024-08-20T05:15:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.145+0000 7fbf99c7e740 1 client.28727 shutdown 2024-08-20T05:15:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.146+0000 7fbf99c7e740 1 -- 172.21.15.37:0/625436653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706ae7f0 msgr2=0x5589706b7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.146+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/625436653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706ae7f0 0x5589706b7e70 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fbf80006010 tx=0x7fbf800317d0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.146+0000 7fbf99c7e740 1 -- 172.21.15.37:0/625436653 shutdown_connections 2024-08-20T05:15:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.146+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/625436653 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5589706c3600 0x5589706c59f0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.146+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/625436653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b3b60 0x5589706b90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.146+0000 7fbf7a000640 0 client.28727 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.146+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/625436653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706b1120 0x5589706b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.146+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/625436653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706ae7f0 0x5589706b7e70 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.146+0000 7fbf99c7e740 1 -- 172.21.15.37:0/625436653 >> 172.21.15.37:0/625436653 conn(0x5589706a9940 msgr2=0x5589706a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.146+0000 7fbf99c7e740 1 -- 172.21.15.37:0/625436653 shutdown_connections 2024-08-20T05:15:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.146+0000 7fbf99c7e740 1 -- 172.21.15.37:0/625436653 wait complete. 2024-08-20T05:15:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.146+0000 7fbf99c7e740 20 client.28727 trim_cache size 0 max 16384 2024-08-20T05:15:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.161+0000 7fbf99c7e740 1 Processor -- start 2024-08-20T05:15:43.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.161+0000 7fbf99c7e740 1 -- start start 2024-08-20T05:15:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.162+0000 7fbf99c7e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706ae7f0 0x5589706b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.162+0000 7fbf99c7e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706b1120 0x5589706b5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.162+0000 7fbf99c7e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706b3b60 0x5589706b5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.162+0000 7fbf99c7e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbf901ad330 con 0x5589706ae7f0 2024-08-20T05:15:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.162+0000 7fbf99c7e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbf901aeed0 con 0x5589706b1120 2024-08-20T05:15:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.162+0000 7fbf99c7e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbf901ada00 con 0x5589706b3b60 2024-08-20T05:15:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.162+0000 7fbf8fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706ae7f0 0x5589706b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.162+0000 7fbf8fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706ae7f0 0x5589706b4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34840/0 (socket says 172.21.15.37:34840) 2024-08-20T05:15:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.162+0000 7fbf8fe00640 1 -- 172.21.15.37:0/2558592667 learned_addr learned my addr 172.21.15.37:0/2558592667 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.162+0000 7fbf8f400640 1 --2- 172.21.15.37:0/2558592667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706b1120 0x5589706b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.162+0000 7fbf94e00640 1 --2- 172.21.15.37:0/2558592667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706b3b60 0x5589706b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.162+0000 7fbf8fe00640 1 -- 172.21.15.37:0/2558592667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706b3b60 msgr2=0x5589706b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.162+0000 7fbf8fe00640 1 --2- 172.21.15.37:0/2558592667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706b3b60 0x5589706b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.162+0000 7fbf8fe00640 1 -- 172.21.15.37:0/2558592667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706b1120 msgr2=0x5589706b5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.162+0000 7fbf8fe00640 1 --2- 172.21.15.37:0/2558592667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706b1120 0x5589706b5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.162+0000 7fbf8fe00640 1 -- 172.21.15.37:0/2558592667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589703ec620 con 0x5589706ae7f0 2024-08-20T05:15:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.162+0000 7fbf8fe00640 1 --2- 172.21.15.37:0/2558592667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706ae7f0 0x5589706b4af0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fbf8002a960 tx=0x7fbf80005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdfac5975d9d0811 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.163+0000 7fbf84c00640 1 -- 172.21.15.37:0/2558592667 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80053040 con 0x5589706ae7f0 2024-08-20T05:15:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.163+0000 7fbf84c00640 1 -- 172.21.15.37:0/2558592667 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf80040030 con 0x5589706ae7f0 2024-08-20T05:15:43.166 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.163+0000 7fbf84c00640 1 -- 172.21.15.37:0/2558592667 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80003df0 con 0x5589706ae7f0 2024-08-20T05:15:43.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.163+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2558592667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706ae7f0 msgr2=0x5589706b4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.163+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/2558592667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706ae7f0 0x5589706b4af0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fbf8002a960 tx=0x7fbf80005c00 comp rx=0 tx=0).stop 2024-08-20T05:15:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.163+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2558592667 shutdown_connections 2024-08-20T05:15:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.163+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/2558592667 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706b3b60 0x5589706b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.163+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/2558592667 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706b1120 0x5589706b5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.163+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/2558592667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706ae7f0 0x5589706b4af0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.163+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2558592667 >> 172.21.15.37:0/2558592667 conn(0x5589706a9940 msgr2=0x5589706adc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.164+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2558592667 shutdown_connections 2024-08-20T05:15:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.164+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2558592667 wait complete. 2024-08-20T05:15:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.164+0000 7fbf99c7e740 1 -- start start 2024-08-20T05:15:43.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.164+0000 7fbf99c7e740 1 Processor -- start 2024-08-20T05:15:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.164+0000 7fbf99c7e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706ae7f0 0x5589706bcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.165+0000 7fbf99c7e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b1120 0x5589706bd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.165+0000 7fbf99c7e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706b3b60 0x5589706be130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.165+0000 7fbf99c7e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbf901ae800 con 0x5589706b1120 2024-08-20T05:15:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.165+0000 7fbf99c7e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbf901ae0d0 con 0x5589706b3b60 2024-08-20T05:15:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.165+0000 7fbf99c7e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbf901ab310 con 0x5589706ae7f0 2024-08-20T05:15:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.165+0000 7fbf99c7e740 10 client.0 _ll_register_callbacks cb 0x7fbf80009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.165+0000 7fbf8fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706ae7f0 0x5589706bcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.165+0000 7fbf8fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706ae7f0 0x5589706bcec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49118/0 (socket says 172.21.15.37:49118) 2024-08-20T05:15:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.165+0000 7fbf8f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b1120 0x5589706bd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.165+0000 7fbf8fe00640 1 -- 172.21.15.37:0/2582834030 learned_addr learned my addr 172.21.15.37:0/2582834030 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.165+0000 7fbf94e00640 1 --2- 172.21.15.37:0/2582834030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706b3b60 0x5589706be130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.165+0000 7fbf8fe00640 1 -- 172.21.15.37:0/2582834030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706b3b60 msgr2=0x5589706be130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.165+0000 7fbf8fe00640 1 --2- 172.21.15.37:0/2582834030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706b3b60 0x5589706be130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.165+0000 7fbf8fe00640 1 -- 172.21.15.37:0/2582834030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b1120 msgr2=0x5589706bd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.165+0000 7fbf8fe00640 1 --2- 172.21.15.37:0/2582834030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b1120 0x5589706bd560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.165+0000 7fbf8fe00640 1 -- 172.21.15.37:0/2582834030 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589706be960 con 0x5589706ae7f0 2024-08-20T05:15:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.165+0000 7fbf8f400640 1 --2- 172.21.15.37:0/2582834030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b1120 0x5589706bd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:15:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.166+0000 7fbf8fe00640 1 --2- 172.21.15.37:0/2582834030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706ae7f0 0x5589706bcec0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fbf8002aa00 tx=0x7fbf80031f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4f68a49d80b52bd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.166+0000 7fbf7a000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:15:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.166+0000 7fbf7a000640 1 -- 172.21.15.37:0/2582834030 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf80053070 con 0x5589706ae7f0 2024-08-20T05:15:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.166+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2582834030 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf80040030 con 0x5589706ae7f0 2024-08-20T05:15:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.166+0000 7fbf7a000640 1 -- 172.21.15.37:0/2582834030 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbf80003d20 con 0x5589706ae7f0 2024-08-20T05:15:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.166+0000 7fbf7a000640 1 -- 172.21.15.37:0/2582834030 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fbf80073050 con 0x5589706ae7f0 2024-08-20T05:15:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.166+0000 7fbf99c7e740 10 client.28768 fetch_fsmap learned FSMap version 50 2024-08-20T05:15:43.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.166+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2582834030 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5589706bfd40 con 0x5589706ae7f0 2024-08-20T05:15:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.166+0000 7fbf7a000640 1 -- 172.21.15.37:0/2582834030 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf80040030 con 0x5589706ae7f0 2024-08-20T05:15:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.166+0000 7fbf7a000640 1 -- 172.21.15.37:0/2582834030 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fbf8006e030 con 0x5589706ae7f0 2024-08-20T05:15:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.166+0000 7fbf99c7e740 10 client.28768 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:15:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.166+0000 7fbf99c7e740 10 client.28768 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:43.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.166+0000 7fbf99c7e740 20 client.28768 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.166+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/2582834030 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55897072e2a0 0x558970730690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.166+0000 7fbf99c7e740 4 client.28768 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:15:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.166+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2582834030 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55897061ec00 con 0x55897072e2a0 2024-08-20T05:15:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.167+0000 7fbf8f400640 1 --2- 172.21.15.37:0/2582834030 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55897072e2a0 0x558970730690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.168+0000 7fbf8f400640 1 --2- 172.21.15.37:0/2582834030 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55897072e2a0 0x558970730690 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be1140bfc521c7a7 server_cookie=88b241a63b2143be in_seq=0 out_seq=0 2024-08-20T05:15:43.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.168+0000 7fbf7a000640 10 client.28768 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:43.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.252+0000 7fbf7a000640 1 -- 172.21.15.37:0/2582834030 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55897061ec00 con 0x55897072e2a0 2024-08-20T05:15:43.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.252+0000 7fbf7a000640 10 client.28768 handle_command_reply: tid=0 2024-08-20T05:15:43.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.253+0000 7fbf99c7e740 1 client.28768 shutdown 2024-08-20T05:15:43.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.253+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2582834030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706ae7f0 msgr2=0x5589706bcec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:43.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.253+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/2582834030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706ae7f0 0x5589706bcec0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fbf8002aa00 tx=0x7fbf80031f90 comp rx=0 tx=0).stop 2024-08-20T05:15:43.255 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.253+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2582834030 shutdown_connections 2024-08-20T05:15:43.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.253+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/2582834030 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55897072e2a0 0x558970730690 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.254+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/2582834030 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5589706b3b60 0x5589706be130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.254+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/2582834030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5589706b1120 0x5589706bd560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.254+0000 7fbf99c7e740 1 --2- 172.21.15.37:0/2582834030 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5589706ae7f0 0x5589706bcec0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.254+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2582834030 >> 172.21.15.37:0/2582834030 conn(0x5589706a9940 msgr2=0x5589706a89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:43.256 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.254+0000 7fbf7a000640 0 client.28768 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:43.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.255+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2582834030 shutdown_connections 2024-08-20T05:15:43.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.255+0000 7fbf99c7e740 1 -- 172.21.15.37:0/2582834030 wait complete. 2024-08-20T05:15:43.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.255+0000 7fbf99c7e740 20 client.28768 trim_cache size 0 max 16384 2024-08-20T05:15:43.257 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:15:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:15:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:15:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:15:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.256+0000 7fbf95800640 1 -- 172.21.15.37:0/3222727881 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbf740b3bd0 msgr2=0x7fbf740b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:43.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.256+0000 7fbf95800640 1 --2- 172.21.15.37:0/3222727881 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbf740b3bd0 0x7fbf740b6090 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c0058c0 tx=0x7fbf7c005850 comp rx=0 tx=0).stop 2024-08-20T05:15:43.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.256+0000 7fbf95800640 1 -- 172.21.15.37:0/3222727881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf901061c0 msgr2=0x7fbf9019bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:43.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.256+0000 7fbf95800640 1 --2- 172.21.15.37:0/3222727881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf901061c0 0x7fbf9019bd90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fbf88009fd0 tx=0x7fbf8800ef10 comp rx=0 tx=0).stop 2024-08-20T05:15:43.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.257+0000 7fbf95800640 1 -- 172.21.15.37:0/3222727881 shutdown_connections 2024-08-20T05:15:43.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.257+0000 7fbf95800640 1 --2- 172.21.15.37:0/3222727881 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbf740b3bd0 0x7fbf740b6090 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.257+0000 7fbf95800640 1 --2- 172.21.15.37:0/3222727881 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbf901061c0 0x7fbf9019bd90 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.257+0000 7fbf95800640 1 --2- 172.21.15.37:0/3222727881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf90105800 0x7fbf9019b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.257+0000 7fbf95800640 1 --2- 172.21.15.37:0/3222727881 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbf901046b0 0x7fbf9019ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:43.259 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.257+0000 7fbf95800640 1 -- 172.21.15.37:0/3222727881 >> 172.21.15.37:0/3222727881 conn(0x7fbf900fff50 msgr2=0x7fbf90108b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:43.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.257+0000 7fbf95800640 1 -- 172.21.15.37:0/3222727881 shutdown_connections 2024-08-20T05:15:43.260 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:43.257+0000 7fbf95800640 1 -- 172.21.15.37:0/3222727881 wait complete. 2024-08-20T05:15:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:43 smithi135 ceph-mon[22342]: pgmap v805: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 7.1 MiB/s wr, 679 op/s 2024-08-20T05:15:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:43 smithi135 ceph-mon[22342]: scrub queued for path: / 2024-08-20T05:15:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:43 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:43 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:15:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:43 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:15:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:43 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:15:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:43 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:15:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:43 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:43 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:15:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:43 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:43.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:43 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:43.867 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:43 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:43.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:43 smithi130 ceph-mon[22007]: pgmap v805: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 7.1 MiB/s wr, 679 op/s 2024-08-20T05:15:43.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:43 smithi130 ceph-mon[22007]: scrub queued for path: / 2024-08-20T05:15:43.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:43 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:43.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:43 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:15:43.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:43 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:15:43.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:43 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:15:43.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:43 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:15:43.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:43 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:43.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:43 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:15:43.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:43 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:43.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:43 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:43.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:43 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:44.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:43 smithi037 ceph-mon[17265]: pgmap v805: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 7.1 MiB/s wr, 679 op/s 2024-08-20T05:15:44.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:43 smithi037 ceph-mon[17265]: scrub queued for path: / 2024-08-20T05:15:44.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:43 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:44.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:43 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:15:44.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:43 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:15:44.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:43 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:15:44.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:43 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:15:44.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:43 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:44.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:43 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:15:44.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:43 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:44.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:43 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:44.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:43 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:44.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:44 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:15:44.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:44 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:44.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:44 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:44.900 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:44 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:15:44.900 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:44 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:44.900 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:44 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:44.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:44 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:15:44.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:44 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:44.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:44 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:15:45.496 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:15:45.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:45 smithi037 ceph-mon[17265]: pgmap v806: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 7.0 MiB/s wr, 729 op/s 2024-08-20T05:15:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:45 smithi135 ceph-mon[22342]: pgmap v806: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 7.0 MiB/s wr, 729 op/s 2024-08-20T05:15:45.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:45 smithi130 ceph-mon[22007]: pgmap v806: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 252 KiB/s rd, 7.0 MiB/s wr, 729 op/s 2024-08-20T05:15:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:15:47.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:47 smithi135 ceph-mon[22342]: pgmap v807: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 6.4 MiB/s wr, 669 op/s 2024-08-20T05:15:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:47 smithi130 ceph-mon[22007]: pgmap v807: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 6.4 MiB/s wr, 669 op/s 2024-08-20T05:15:48.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.011+0000 7f3293e00640 1 -- 172.21.15.37:0/403820375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32840a50b0 msgr2=0x7f32840b6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:48.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.011+0000 7f3293e00640 1 --2- 172.21.15.37:0/403820375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32840a50b0 0x7f32840b6f70 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3278009930 tx=0x7f327802a510 comp rx=0 tx=0).stop 2024-08-20T05:15:48.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.012+0000 7f3293e00640 1 -- 172.21.15.37:0/403820375 shutdown_connections 2024-08-20T05:15:48.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.012+0000 7f3293e00640 1 --2- 172.21.15.37:0/403820375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32840b74b0 0x7f32840b98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.013+0000 7f3293e00640 1 --2- 172.21.15.37:0/403820375 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32840a50b0 0x7f32840b6f70 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.014+0000 7f3293e00640 1 --2- 172.21.15.37:0/403820375 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32840a4790 0x7f32840a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.014+0000 7f3293e00640 1 -- 172.21.15.37:0/403820375 >> 172.21.15.37:0/403820375 conn(0x7f328401a040 msgr2=0x7f328401c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:48.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:47 smithi037 ceph-mon[17265]: pgmap v807: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 6.4 MiB/s wr, 669 op/s 2024-08-20T05:15:48.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.015+0000 7f3293e00640 1 -- 172.21.15.37:0/403820375 shutdown_connections 2024-08-20T05:15:48.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.016+0000 7f3293e00640 1 -- 172.21.15.37:0/403820375 wait complete. 2024-08-20T05:15:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.028+0000 7f3293e00640 1 Processor -- start 2024-08-20T05:15:48.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.029+0000 7f3293e00640 1 -- start start 2024-08-20T05:15:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.031+0000 7f3293e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32840a4790 0x7f3284143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.032+0000 7f3293e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32840a50b0 0x7f3284143940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.032+0000 7f3293e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32840b74b0 0x7f3284148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.032+0000 7f3291400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32840a4790 0x7f3284143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:48.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.032+0000 7f3291400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32840a4790 0x7f3284143400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:48918/0 (socket says 172.21.15.37:48918) 2024-08-20T05:15:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.033+0000 7f3291400640 1 -- 172.21.15.37:0/583737240 learned_addr learned my addr 172.21.15.37:0/583737240 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.033+0000 7f3291e00640 1 --2- 172.21.15.37:0/583737240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32840b74b0 0x7f3284148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.035+0000 7f3290a00640 1 --2- 172.21.15.37:0/583737240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32840a50b0 0x7f3284143940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.035+0000 7f3293e00640 1 -- 172.21.15.37:0/583737240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f32840bce50 con 0x7f32840a50b0 2024-08-20T05:15:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.035+0000 7f3293e00640 1 -- 172.21.15.37:0/583737240 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f32840bccd0 con 0x7f32840a4790 2024-08-20T05:15:48.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.035+0000 7f3293e00640 1 -- 172.21.15.37:0/583737240 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f32840bcfd0 con 0x7f32840b74b0 2024-08-20T05:15:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.036+0000 7f3291e00640 1 -- 172.21.15.37:0/583737240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32840a4790 msgr2=0x7f3284143400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.036+0000 7f3291e00640 1 --2- 172.21.15.37:0/583737240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32840a4790 0x7f3284143400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.036+0000 7f3291e00640 1 -- 172.21.15.37:0/583737240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32840a50b0 msgr2=0x7f3284143940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:48.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.036+0000 7f3291e00640 1 --2- 172.21.15.37:0/583737240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32840a50b0 0x7f3284143940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.036+0000 7f3291e00640 1 -- 172.21.15.37:0/583737240 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3284149410 con 0x7f32840b74b0 2024-08-20T05:15:48.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.037+0000 7f3291e00640 1 --2- 172.21.15.37:0/583737240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32840b74b0 0x7f3284148c40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f328c0697d0 tx=0x7f328c0749c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:48.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.038+0000 7f328a000640 1 -- 172.21.15.37:0/583737240 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c07a070 con 0x7f32840b74b0 2024-08-20T05:15:48.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.038+0000 7f328a000640 1 -- 172.21.15.37:0/583737240 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f328c075420 con 0x7f32840b74b0 2024-08-20T05:15:48.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.038+0000 7f3293e00640 1 -- 172.21.15.37:0/583737240 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3284149700 con 0x7f32840b74b0 2024-08-20T05:15:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 770.0 s, 519.0 tps, lat 190.731 ms stddev 248.726 2024-08-20T05:15:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.039+0000 7f328a000640 1 -- 172.21.15.37:0/583737240 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c072610 con 0x7f32840b74b0 2024-08-20T05:15:48.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.039+0000 7f3293e00640 1 -- 172.21.15.37:0/583737240 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f328414fdc0 con 0x7f32840b74b0 2024-08-20T05:15:48.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.046+0000 7f3296855740 1 Processor -- start 2024-08-20T05:15:48.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.048+0000 7f328a000640 1 -- 172.21.15.37:0/583737240 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f328c07d070 con 0x7f32840b74b0 2024-08-20T05:15:48.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.050+0000 7f3296855740 1 -- start start 2024-08-20T05:15:48.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.052+0000 7f328a000640 1 --2- 172.21.15.37:0/583737240 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32740b3ba0 0x7f32740b6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.053+0000 7f328a000640 1 -- 172.21.15.37:0/583737240 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f328c1480d0 con 0x7f32840b74b0 2024-08-20T05:15:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.053+0000 7f3290a00640 1 --2- 172.21.15.37:0/583737240 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32740b3ba0 0x7f32740b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.054+0000 7f3296855740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf16ac0 0x5639eaf16ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.054+0000 7f3296855740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf173e0 0x5639eaf22e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.054+0000 7f3296855740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf23370 0x5639eaf25760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.055+0000 7f3296855740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5639eae8ca60 con 0x5639eaf16ac0 2024-08-20T05:15:48.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.055+0000 7f3291e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf23370 0x5639eaf25760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.055+0000 7f3291e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf23370 0x5639eaf25760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49148/0 (socket says 172.21.15.37:49148) 2024-08-20T05:15:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.055+0000 7f3291e00640 1 -- 172.21.15.37:0/3127415044 learned_addr learned my addr 172.21.15.37:0/3127415044 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:48.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.055+0000 7f3296855740 1 -- 172.21.15.37:0/3127415044 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5639eae7bf60 con 0x5639eaf173e0 2024-08-20T05:15:48.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.055+0000 7f3296855740 1 -- 172.21.15.37:0/3127415044 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5639eae7ffa0 con 0x5639eaf23370 2024-08-20T05:15:48.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.056+0000 7f3291e00640 1 -- 172.21.15.37:0/3127415044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf173e0 msgr2=0x5639eaf22e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:15:48.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.056+0000 7f3291e00640 1 --2- 172.21.15.37:0/3127415044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf173e0 0x5639eaf22e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.056+0000 7f3291e00640 1 -- 172.21.15.37:0/3127415044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf16ac0 msgr2=0x5639eaf16ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:48.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.056+0000 7f3291e00640 1 --2- 172.21.15.37:0/3127415044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf16ac0 0x5639eaf16ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.056+0000 7f3291e00640 1 -- 172.21.15.37:0/3127415044 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639eae223e0 con 0x5639eaf23370 2024-08-20T05:15:48.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.056+0000 7f3291e00640 1 --2- 172.21.15.37:0/3127415044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf23370 0x5639eaf25760 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f328c10e9d0 tx=0x7f328c068ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89546958e4515723 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:48.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.057+0000 7f327e600640 1 -- 172.21.15.37:0/3127415044 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f328c084040 con 0x5639eaf23370 2024-08-20T05:15:48.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.057+0000 7f327e600640 1 -- 172.21.15.37:0/3127415044 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f328c113220 con 0x5639eaf23370 2024-08-20T05:15:48.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.058+0000 7f3296855740 1 -- 172.21.15.37:0/3127415044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf23370 msgr2=0x5639eaf25760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:48.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.058+0000 7f3296855740 1 --2- 172.21.15.37:0/3127415044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf23370 0x5639eaf25760 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f328c10e9d0 tx=0x7f328c068ec0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.058+0000 7f3296855740 1 -- 172.21.15.37:0/3127415044 shutdown_connections 2024-08-20T05:15:48.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.058+0000 7f3296855740 1 --2- 172.21.15.37:0/3127415044 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf23370 0x5639eaf25760 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.058+0000 7f3296855740 1 --2- 172.21.15.37:0/3127415044 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf173e0 0x5639eaf22e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.058+0000 7f3296855740 1 --2- 172.21.15.37:0/3127415044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf16ac0 0x5639eaf16ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.058+0000 7f3296855740 1 -- 172.21.15.37:0/3127415044 >> 172.21.15.37:0/3127415044 conn(0x5639eaf148f0 msgr2=0x5639eaf15a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.059+0000 7f3296855740 1 -- 172.21.15.37:0/3127415044 shutdown_connections 2024-08-20T05:15:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.059+0000 7f3296855740 1 -- 172.21.15.37:0/3127415044 wait complete. 2024-08-20T05:15:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.060+0000 7f3296855740 1 -- start start 2024-08-20T05:15:48.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.061+0000 7f3296855740 1 Processor -- start 2024-08-20T05:15:48.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.064+0000 7f3296855740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf16ac0 0x5639eaf22b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.064+0000 7f3296855740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 0x5639eaf1ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.064+0000 7f3296855740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf23370 0x5639eaf20490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.066+0000 7f3296855740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5639eacde700 con 0x5639eaf23370 2024-08-20T05:15:48.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.066+0000 7f3296855740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5639eae17250 con 0x5639eaf16ac0 2024-08-20T05:15:48.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.066+0000 7f3296855740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5639eaf26090 con 0x5639eaf173e0 2024-08-20T05:15:48.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.066+0000 7f3296855740 10 client.0 _ll_register_callbacks cb 0x5639eae76180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:48.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.066+0000 7f3290a00640 1 --2- 172.21.15.37:0/583737240 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32740b3ba0 0x7f32740b6060 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3278009900 tx=0x7f3278005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:48.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.067+0000 7f3290a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 0x5639eaf1ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:48.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.067+0000 7f3290a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 0x5639eaf1ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49158/0 (socket says 172.21.15.37:49158) 2024-08-20T05:15:48.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.067+0000 7f3290a00640 1 -- 172.21.15.37:0/2011747071 learned_addr learned my addr 172.21.15.37:0/2011747071 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:48.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.067+0000 7f3291400640 1 --2- 172.21.15.37:0/2011747071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf16ac0 0x5639eaf22b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:48.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.067+0000 7f3290a00640 1 -- 172.21.15.37:0/2011747071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf16ac0 msgr2=0x5639eaf22b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:48.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.067+0000 7f3290a00640 1 --2- 172.21.15.37:0/2011747071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf16ac0 0x5639eaf22b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.067+0000 7f3290a00640 1 -- 172.21.15.37:0/2011747071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf23370 msgr2=0x5639eaf20490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:48.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.067+0000 7f3290a00640 1 --2- 172.21.15.37:0/2011747071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf23370 0x5639eaf20490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.067+0000 7f3290a00640 1 -- 172.21.15.37:0/2011747071 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639eabdb650 con 0x5639eaf173e0 2024-08-20T05:15:48.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.069+0000 7f3290a00640 1 --2- 172.21.15.37:0/2011747071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 0x5639eaf1ff50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3278009930 tx=0x7f3278009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7296bf8443c7a77 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:48.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.069+0000 7f3272a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:15:48.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.069+0000 7f3272a00640 1 -- 172.21.15.37:0/2011747071 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327804d070 con 0x5639eaf173e0 2024-08-20T05:15:48.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.070+0000 7f3272a00640 1 -- 172.21.15.37:0/2011747071 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3278052460 con 0x5639eaf173e0 2024-08-20T05:15:48.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.073+0000 7f3296855740 1 -- 172.21.15.37:0/2011747071 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f328c113220 con 0x5639eaf173e0 2024-08-20T05:15:48.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.080+0000 7f3272a00640 1 -- 172.21.15.37:0/2011747071 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f327805b050 con 0x5639eaf173e0 2024-08-20T05:15:48.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.081+0000 7f3296855740 10 client.28780 fetch_fsmap learned FSMap version 50 2024-08-20T05:15:48.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.081+0000 7f3296855740 1 -- 172.21.15.37:0/2011747071 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5639eaf31960 con 0x5639eaf173e0 2024-08-20T05:15:48.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.085+0000 7f3272a00640 1 -- 172.21.15.37:0/2011747071 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f328c113220 con 0x5639eaf173e0 2024-08-20T05:15:48.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.089+0000 7f3272a00640 1 -- 172.21.15.37:0/2011747071 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f327803d690 con 0x5639eaf173e0 2024-08-20T05:15:48.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.090+0000 7f3296855740 10 client.28780 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:15:48.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.090+0000 7f3296855740 10 client.28780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:48.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.090+0000 7f3296855740 20 client.28780 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:48.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.091+0000 7f3296855740 1 --2- 172.21.15.37:0/2011747071 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5639eaf32ec0 0x5639eaf35320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.091+0000 7f3296855740 4 client.28780 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:15:48.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.092+0000 7f3296855740 1 -- 172.21.15.37:0/2011747071 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639eae8e9b0 con 0x5639eaf32ec0 2024-08-20T05:15:48.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.092+0000 7f3291400640 1 --2- 172.21.15.37:0/2011747071 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5639eaf32ec0 0x5639eaf35320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.094+0000 7f3272a00640 10 client.28780 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.094+0000 7f3291400640 1 --2- 172.21.15.37:0/2011747071 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5639eaf32ec0 0x5639eaf35320 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33148195c23def0e server_cookie=8aabe35a0b091fcd in_seq=0 out_seq=0 2024-08-20T05:15:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.097+0000 7f3272a00640 1 -- 172.21.15.37:0/2011747071 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5639eae8e9b0 con 0x5639eaf32ec0 2024-08-20T05:15:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.097+0000 7f3272a00640 10 client.28780 handle_command_reply: tid=0 2024-08-20T05:15:48.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.097+0000 7f3296855740 1 client.28780 shutdown 2024-08-20T05:15:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.099+0000 7f3296855740 1 -- 172.21.15.37:0/2011747071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 msgr2=0x5639eaf1ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:48.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.099+0000 7f3296855740 1 --2- 172.21.15.37:0/2011747071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 0x5639eaf1ff50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f3278009930 tx=0x7f3278009260 comp rx=0 tx=0).stop 2024-08-20T05:15:48.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.099+0000 7f3296855740 1 -- 172.21.15.37:0/2011747071 shutdown_connections 2024-08-20T05:15:48.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.099+0000 7f3296855740 1 --2- 172.21.15.37:0/2011747071 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5639eaf32ec0 0x5639eaf35320 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.099+0000 7f3272a00640 0 client.28780 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:48.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.101+0000 7f3296855740 1 --2- 172.21.15.37:0/2011747071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf23370 0x5639eaf20490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.101+0000 7f3296855740 1 --2- 172.21.15.37:0/2011747071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 0x5639eaf1ff50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.101+0000 7f3296855740 1 --2- 172.21.15.37:0/2011747071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf16ac0 0x5639eaf22b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.101+0000 7f3296855740 1 -- 172.21.15.37:0/2011747071 >> 172.21.15.37:0/2011747071 conn(0x5639eaf148f0 msgr2=0x5639eaf1a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:48.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.101+0000 7f3296855740 1 -- 172.21.15.37:0/2011747071 shutdown_connections 2024-08-20T05:15:48.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.102+0000 7f3296855740 1 -- 172.21.15.37:0/2011747071 wait complete. 2024-08-20T05:15:48.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.106+0000 7f3296855740 20 client.28780 trim_cache size 0 max 16384 2024-08-20T05:15:48.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.184+0000 7f3296855740 1 Processor -- start 2024-08-20T05:15:48.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.186+0000 7f3296855740 1 -- start start 2024-08-20T05:15:48.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.186+0000 7f3296855740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf16ac0 0x5639eaf22050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.186+0000 7f3296855740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 0x5639eaf3abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.186+0000 7f3296855740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf23370 0x5639eaf3b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.186+0000 7f3296855740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3284159720 con 0x5639eaf23370 2024-08-20T05:15:48.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.186+0000 7f3296855740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f328415b2c0 con 0x5639eaf16ac0 2024-08-20T05:15:48.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.186+0000 7f3296855740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3284159df0 con 0x5639eaf173e0 2024-08-20T05:15:48.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.187+0000 7f3290a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 0x5639eaf3abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:48.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.187+0000 7f3291400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf16ac0 0x5639eaf22050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:48.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.187+0000 7f3291400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf16ac0 0x5639eaf22050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:48952/0 (socket says 172.21.15.37:48952) 2024-08-20T05:15:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.188+0000 7f3291e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf23370 0x5639eaf3b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.188+0000 7f3291400640 1 -- 172.21.15.37:0/1006379837 learned_addr learned my addr 172.21.15.37:0/1006379837 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.188+0000 7f3291400640 1 -- 172.21.15.37:0/1006379837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 msgr2=0x5639eaf3abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.188+0000 7f3291400640 1 --2- 172.21.15.37:0/1006379837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 0x5639eaf3abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.188+0000 7f3291400640 1 -- 172.21.15.37:0/1006379837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf23370 msgr2=0x5639eaf3b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.188+0000 7f3291400640 1 --2- 172.21.15.37:0/1006379837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf23370 0x5639eaf3b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.188+0000 7f3291400640 1 -- 172.21.15.37:0/1006379837 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639eaf25ed0 con 0x5639eaf16ac0 2024-08-20T05:15:48.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.189+0000 7f3291400640 1 --2- 172.21.15.37:0/1006379837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf16ac0 0x5639eaf22050 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3280005bb0 tx=0x7f328000bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7190c903eae5c46 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.192+0000 7f327dc00640 1 -- 172.21.15.37:0/1006379837 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280003c10 con 0x5639eaf16ac0 2024-08-20T05:15:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.192+0000 7f327dc00640 1 -- 172.21.15.37:0/1006379837 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3280003db0 con 0x5639eaf16ac0 2024-08-20T05:15:48.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.192+0000 7f327dc00640 1 -- 172.21.15.37:0/1006379837 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3280025660 con 0x5639eaf16ac0 2024-08-20T05:15:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.193+0000 7f3296855740 1 -- 172.21.15.37:0/1006379837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf16ac0 msgr2=0x5639eaf22050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.193+0000 7f3296855740 1 --2- 172.21.15.37:0/1006379837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf16ac0 0x5639eaf22050 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3280005bb0 tx=0x7f328000bd50 comp rx=0 tx=0).stop 2024-08-20T05:15:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.194+0000 7f3296855740 1 -- 172.21.15.37:0/1006379837 shutdown_connections 2024-08-20T05:15:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.194+0000 7f3296855740 1 --2- 172.21.15.37:0/1006379837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf23370 0x5639eaf3b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.194+0000 7f3296855740 1 --2- 172.21.15.37:0/1006379837 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 0x5639eaf3abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.194+0000 7f3296855740 1 --2- 172.21.15.37:0/1006379837 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf16ac0 0x5639eaf22050 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.194+0000 7f3296855740 1 -- 172.21.15.37:0/1006379837 >> 172.21.15.37:0/1006379837 conn(0x5639eaf148f0 msgr2=0x5639eaf13a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.194+0000 7f3296855740 1 -- 172.21.15.37:0/1006379837 shutdown_connections 2024-08-20T05:15:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.194+0000 7f3296855740 1 -- 172.21.15.37:0/1006379837 wait complete. 2024-08-20T05:15:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.195+0000 7f3296855740 1 -- start start 2024-08-20T05:15:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.196+0000 7f3296855740 1 Processor -- start 2024-08-20T05:15:48.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.199+0000 7f3296855740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf16ac0 0x5639eaf292a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.199+0000 7f3296855740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 0x5639eaf297e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.199+0000 7f3296855740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf23370 0x5639eaf29d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.200+0000 7f3296855740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f328415abf0 con 0x5639eaf23370 2024-08-20T05:15:48.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.200+0000 7f3296855740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f328415a4c0 con 0x5639eaf16ac0 2024-08-20T05:15:48.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.200+0000 7f3296855740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f32841577b0 con 0x5639eaf173e0 2024-08-20T05:15:48.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.200+0000 7f3296855740 10 client.0 _ll_register_callbacks cb 0x7f3278041050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:48.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.200+0000 7f3290a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 0x5639eaf297e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:48.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.200+0000 7f3290a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 0x5639eaf297e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49166/0 (socket says 172.21.15.37:49166) 2024-08-20T05:15:48.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.200+0000 7f3290a00640 1 -- 172.21.15.37:0/496851921 learned_addr learned my addr 172.21.15.37:0/496851921 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.201+0000 7f3291400640 1 --2- 172.21.15.37:0/496851921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf16ac0 0x5639eaf292a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.201+0000 7f3291e00640 1 --2- 172.21.15.37:0/496851921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf23370 0x5639eaf29d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.201+0000 7f3290a00640 1 -- 172.21.15.37:0/496851921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf16ac0 msgr2=0x5639eaf292a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.201+0000 7f3290a00640 1 --2- 172.21.15.37:0/496851921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf16ac0 0x5639eaf292a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.201+0000 7f3290a00640 1 -- 172.21.15.37:0/496851921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf23370 msgr2=0x5639eaf29d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.201+0000 7f3290a00640 1 --2- 172.21.15.37:0/496851921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf23370 0x5639eaf29d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.201+0000 7f3290a00640 1 -- 172.21.15.37:0/496851921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639eaf9cc80 con 0x5639eaf173e0 2024-08-20T05:15:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.201+0000 7f3290a00640 1 --2- 172.21.15.37:0/496851921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 0x5639eaf297e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3278009460 tx=0x7f3278052710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c11becec1c5296ca server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.201+0000 7f3272a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:15:48.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.202+0000 7f3272a00640 1 -- 172.21.15.37:0/496851921 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f327804d040 con 0x5639eaf173e0 2024-08-20T05:15:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.202+0000 7f3272a00640 1 -- 172.21.15.37:0/496851921 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3278052d10 con 0x5639eaf173e0 2024-08-20T05:15:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.203+0000 7f3296855740 1 -- 172.21.15.37:0/496851921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3280003db0 con 0x5639eaf173e0 2024-08-20T05:15:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.203+0000 7f3272a00640 1 -- 172.21.15.37:0/496851921 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f327805f430 con 0x5639eaf173e0 2024-08-20T05:15:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.203+0000 7f3296855740 10 client.28786 fetch_fsmap learned FSMap version 50 2024-08-20T05:15:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.203+0000 7f3296855740 1 -- 172.21.15.37:0/496851921 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5639eaf9dfc0 con 0x5639eaf173e0 2024-08-20T05:15:48.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.204+0000 7f3272a00640 1 -- 172.21.15.37:0/496851921 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3280003db0 con 0x5639eaf173e0 2024-08-20T05:15:48.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.204+0000 7f3272a00640 1 -- 172.21.15.37:0/496851921 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f327805e070 con 0x5639eaf173e0 2024-08-20T05:15:48.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.204+0000 7f3296855740 10 client.28786 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:15:48.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.204+0000 7f3296855740 10 client.28786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:48.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.204+0000 7f3296855740 20 client.28786 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:48.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.205+0000 7f3296855740 1 --2- 172.21.15.37:0/496851921 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5639eaf32ec0 0x5639eafa0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:48.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.205+0000 7f3296855740 4 client.28786 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:15:48.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.205+0000 7f3296855740 1 -- 172.21.15.37:0/496851921 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5639eae8a450 con 0x5639eaf32ec0 2024-08-20T05:15:48.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.207+0000 7f3291400640 1 --2- 172.21.15.37:0/496851921 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5639eaf32ec0 0x5639eafa0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.213+0000 7f3291400640 1 --2- 172.21.15.37:0/496851921 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5639eaf32ec0 0x5639eafa0700 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c130765aa495dc50 server_cookie=817f47ff90a4debb in_seq=0 out_seq=0 2024-08-20T05:15:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.213+0000 7f3272a00640 10 client.28786 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.214+0000 7f3272a00640 1 -- 172.21.15.37:0/496851921 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5639eae8a450 con 0x5639eaf32ec0 2024-08-20T05:15:48.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.214+0000 7f3272a00640 10 client.28786 handle_command_reply: tid=0 2024-08-20T05:15:48.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.215+0000 7f3296855740 1 client.28786 shutdown 2024-08-20T05:15:48.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.216+0000 7f3296855740 1 -- 172.21.15.37:0/496851921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 msgr2=0x5639eaf297e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:48.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.216+0000 7f3296855740 1 --2- 172.21.15.37:0/496851921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 0x5639eaf297e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f3278009460 tx=0x7f3278052710 comp rx=0 tx=0).stop 2024-08-20T05:15:48.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.216+0000 7f3296855740 1 -- 172.21.15.37:0/496851921 shutdown_connections 2024-08-20T05:15:48.218 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.216+0000 7f3296855740 1 --2- 172.21.15.37:0/496851921 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5639eaf32ec0 0x5639eafa0700 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.217+0000 7f3296855740 1 --2- 172.21.15.37:0/496851921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5639eaf23370 0x5639eaf29d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.217+0000 7f3272a00640 0 client.28786 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:48.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.217+0000 7f3296855740 1 --2- 172.21.15.37:0/496851921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5639eaf173e0 0x5639eaf297e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.217+0000 7f3296855740 1 --2- 172.21.15.37:0/496851921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5639eaf16ac0 0x5639eaf292a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.217+0000 7f3296855740 1 -- 172.21.15.37:0/496851921 >> 172.21.15.37:0/496851921 conn(0x5639eaf148f0 msgr2=0x5639eaf1e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:48.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.217+0000 7f3296855740 1 -- 172.21.15.37:0/496851921 shutdown_connections 2024-08-20T05:15:48.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.218+0000 7f3296855740 1 -- 172.21.15.37:0/496851921 wait complete. 2024-08-20T05:15:48.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.218+0000 7f3296855740 20 client.28786 trim_cache size 0 max 16384 2024-08-20T05:15:48.220 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:15:48.220 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T05:15:48.220 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-20T05:15:48.221 INFO:teuthology.orchestra.run.smithi037.stdout: "105fb8ec-e69e-4208-be4b-a3be74a706c1": { 2024-08-20T05:15:48.221 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-20T05:15:48.221 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "105fb8ec-e69e-4208-be4b-a3be74a706c1", 2024-08-20T05:15:48.221 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-20T05:15:48.221 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:15:48.221 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:15:48.221 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:15:48.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.219+0000 7f3293e00640 1 -- 172.21.15.37:0/583737240 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32740b3ba0 msgr2=0x7f32740b6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:48.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.219+0000 7f3293e00640 1 --2- 172.21.15.37:0/583737240 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32740b3ba0 0x7f32740b6060 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3278009900 tx=0x7f3278005a20 comp rx=0 tx=0).stop 2024-08-20T05:15:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.219+0000 7f3293e00640 1 -- 172.21.15.37:0/583737240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32840b74b0 msgr2=0x7f3284148c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.219+0000 7f3293e00640 1 --2- 172.21.15.37:0/583737240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32840b74b0 0x7f3284148c40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f328c0697d0 tx=0x7f328c0749c0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.220+0000 7f3293e00640 1 -- 172.21.15.37:0/583737240 shutdown_connections 2024-08-20T05:15:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.220+0000 7f3293e00640 1 --2- 172.21.15.37:0/583737240 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32740b3ba0 0x7f32740b6060 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.220+0000 7f3293e00640 1 --2- 172.21.15.37:0/583737240 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f32840b74b0 0x7f3284148c40 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.222 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.220+0000 7f3293e00640 1 --2- 172.21.15.37:0/583737240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32840a50b0 0x7f3284143940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.220+0000 7f3293e00640 1 --2- 172.21.15.37:0/583737240 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f32840a4790 0x7f3284143400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.220+0000 7f3293e00640 1 -- 172.21.15.37:0/583737240 >> 172.21.15.37:0/583737240 conn(0x7f328401a040 msgr2=0x7f32840b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.220+0000 7f3293e00640 1 -- 172.21.15.37:0/583737240 shutdown_connections 2024-08-20T05:15:48.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:48.220+0000 7f3293e00640 1 -- 172.21.15.37:0/583737240 wait complete. 2024-08-20T05:15:49.660 INFO:tasks.cephfs.filesystem:scrub status for tag:105fb8ec-e69e-4208-be4b-a3be74a706c1 - {'path': '/', 'tag': '105fb8ec-e69e-4208-be4b-a3be74a706c1', 'options': 'recursive,force'} 2024-08-20T05:15:49.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:49 smithi135 ceph-mon[22342]: pgmap v808: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 5.2 MiB/s wr, 587 op/s 2024-08-20T05:15:49.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:49 smithi130 ceph-mon[22007]: pgmap v808: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 5.2 MiB/s wr, 587 op/s 2024-08-20T05:15:50.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:49 smithi037 ceph-mon[17265]: pgmap v808: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 5.2 MiB/s wr, 587 op/s 2024-08-20T05:15:51.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:51 smithi135 ceph-mon[22342]: pgmap v809: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 5.4 MiB/s wr, 590 op/s 2024-08-20T05:15:51.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:51 smithi130 ceph-mon[22007]: pgmap v809: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 5.4 MiB/s wr, 590 op/s 2024-08-20T05:15:52.018 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:51 smithi037 ceph-mon[17265]: pgmap v809: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 5.4 MiB/s wr, 590 op/s 2024-08-20T05:15:52.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:52 smithi130 ceph-mon[22007]: pgmap v810: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 5.1 MiB/s wr, 603 op/s 2024-08-20T05:15:53.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:52 smithi037 ceph-mon[17265]: pgmap v810: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 5.1 MiB/s wr, 603 op/s 2024-08-20T05:15:53.040 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 775.0 s, 718.0 tps, lat 142.304 ms stddev 164.134 2024-08-20T05:15:53.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:52 smithi135 ceph-mon[22342]: pgmap v810: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 305 KiB/s rd, 5.1 MiB/s wr, 603 op/s 2024-08-20T05:15:54.755 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.4 2024-08-20T05:15:54.755 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:15:55.487 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:15:55.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:55 smithi135 ceph-mon[22342]: pgmap v811: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 4.9 MiB/s wr, 634 op/s 2024-08-20T05:15:55.875 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:55 smithi037 ceph-mon[17265]: pgmap v811: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 4.9 MiB/s wr, 634 op/s 2024-08-20T05:15:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:55 smithi130 ceph-mon[22007]: pgmap v811: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 361 KiB/s rd, 4.9 MiB/s wr, 634 op/s 2024-08-20T05:15:56.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.459+0000 7f54cb200640 1 -- 172.21.15.37:0/3808354614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c41063a0 msgr2=0x7f54c410cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:56.462 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.459+0000 7f54cb200640 1 --2- 172.21.15.37:0/3808354614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c41063a0 0x7f54c410cd20 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f54bc009c10 tx=0x7f54bc02a6e0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.460+0000 7f54cb200640 1 -- 172.21.15.37:0/3808354614 shutdown_connections 2024-08-20T05:15:56.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.460+0000 7f54cb200640 1 --2- 172.21.15.37:0/3808354614 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c41063a0 0x7f54c410cd20 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.460+0000 7f54cb200640 1 --2- 172.21.15.37:0/3808354614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54c41059e0 0x7f54c4105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.460+0000 7f54cb200640 1 --2- 172.21.15.37:0/3808354614 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54c4104890 0x7f54c4104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.463 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.460+0000 7f54cb200640 1 -- 172.21.15.37:0/3808354614 >> 172.21.15.37:0/3808354614 conn(0x7f54c4100130 msgr2=0x7f54c4102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:56.464 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.462+0000 7f54cb200640 1 -- 172.21.15.37:0/3808354614 shutdown_connections 2024-08-20T05:15:56.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.462+0000 7f54cb200640 1 -- 172.21.15.37:0/3808354614 wait complete. 2024-08-20T05:15:56.466 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.464+0000 7f54cb200640 1 Processor -- start 2024-08-20T05:15:56.467 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.465+0000 7f54cb200640 1 -- start start 2024-08-20T05:15:56.468 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.466+0000 7f54cb200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54c4104890 0x7f54c4111b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.467+0000 7f54cb200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c41059e0 0x7f54c4112190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.467+0000 7f54cb200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54c41063a0 0x7f54c4112dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.467+0000 7f54cb200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54c4078d50 con 0x7f54c4104890 2024-08-20T05:15:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.467+0000 7f54cb200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54c4078bd0 con 0x7f54c41063a0 2024-08-20T05:15:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.467+0000 7f54cb200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54c4078ed0 con 0x7f54c41059e0 2024-08-20T05:15:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.467+0000 7f54c9200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54c41063a0 0x7f54c4112dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:56.470 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.467+0000 7f54c9200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54c41063a0 0x7f54c4112dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42850/0 (socket says 172.21.15.37:42850) 2024-08-20T05:15:56.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.468+0000 7f54c9200640 1 -- 172.21.15.37:0/261971779 learned_addr learned my addr 172.21.15.37:0/261971779 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:56.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.468+0000 7f54c3400640 1 --2- 172.21.15.37:0/261971779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c41059e0 0x7f54c4112190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:56.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.468+0000 7f54c9200640 1 -- 172.21.15.37:0/261971779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c41059e0 msgr2=0x7f54c4112190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:56.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.468+0000 7f54c9200640 1 --2- 172.21.15.37:0/261971779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c41059e0 0x7f54c4112190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.468+0000 7f54c9200640 1 -- 172.21.15.37:0/261971779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54c4104890 msgr2=0x7f54c4111b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:56.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.468+0000 7f54c9200640 1 --2- 172.21.15.37:0/261971779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54c4104890 0x7f54c4111b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.468+0000 7f54c9200640 1 -- 172.21.15.37:0/261971779 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c4113680 con 0x7f54c41063a0 2024-08-20T05:15:56.471 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.468+0000 7f54c3400640 1 --2- 172.21.15.37:0/261971779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c41059e0 0x7f54c4112190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:56.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.469+0000 7f54c9200640 1 --2- 172.21.15.37:0/261971779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54c41063a0 0x7f54c4112dc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f54bc004af0 tx=0x7f54bc032ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:56.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.469+0000 7f54c0c00640 1 -- 172.21.15.37:0/261971779 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc041020 con 0x7f54c41063a0 2024-08-20T05:15:56.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.469+0000 7f54cb200640 1 -- 172.21.15.37:0/261971779 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c4113910 con 0x7f54c41063a0 2024-08-20T05:15:56.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.469+0000 7f54c0c00640 1 -- 172.21.15.37:0/261971779 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54bc0318f0 con 0x7f54c41063a0 2024-08-20T05:15:56.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.470+0000 7f54c0c00640 1 -- 172.21.15.37:0/261971779 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54bc036040 con 0x7f54c41063a0 2024-08-20T05:15:56.472 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.470+0000 7f54cb200640 1 -- 172.21.15.37:0/261971779 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c4115ec0 con 0x7f54c41063a0 2024-08-20T05:15:56.478 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.476+0000 7f54c0c00640 1 -- 172.21.15.37:0/261971779 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f54bc044020 con 0x7f54c41063a0 2024-08-20T05:15:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.477+0000 7f54ce1cc740 1 Processor -- start 2024-08-20T05:15:56.480 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.478+0000 7f54ce1cc740 1 -- start start 2024-08-20T05:15:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.479+0000 7f54c0c00640 1 --2- 172.21.15.37:0/261971779 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54a80b3cd0 0x7f54a80b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.479+0000 7f54c0c00640 1 -- 172.21.15.37:0/261971779 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f54bc104c50 con 0x7f54c41063a0 2024-08-20T05:15:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.479+0000 7f54ce1cc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a0d610 0x55e7f2a0fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.480+0000 7f54ce1cc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a12330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.480+0000 7f54ce1cc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a12980 0x55e7f2a14e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.480+0000 7f54ce1cc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e7f2980210 con 0x55e7f2a0d610 2024-08-20T05:15:56.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.480+0000 7f54ce1cc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e7f296f710 con 0x55e7f2a12980 2024-08-20T05:15:56.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.480+0000 7f54ce1cc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e7f2973750 con 0x55e7f2a0ff40 2024-08-20T05:15:56.482 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.480+0000 7f54c3400640 1 --2- 172.21.15.37:0/261971779 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54a80b3cd0 0x7f54a80b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:56.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.480+0000 7f54c3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a0d610 0x55e7f2a0fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:56.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.481+0000 7f54c3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a12330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:56.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.481+0000 7f54c3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a12330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:54506/0 (socket says 172.21.15.37:54506) 2024-08-20T05:15:56.483 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.481+0000 7f54c3400640 1 -- 172.21.15.37:0/1814302768 learned_addr learned my addr 172.21.15.37:0/1814302768 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:56.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.481+0000 7f54c3400640 1 -- 172.21.15.37:0/1814302768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a12980 msgr2=0x55e7f2a14e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:56.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.481+0000 7f54c3400640 1 --2- 172.21.15.37:0/1814302768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a12980 0x55e7f2a14e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.481+0000 7f54c3400640 1 -- 172.21.15.37:0/1814302768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a0d610 msgr2=0x55e7f2a0fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:56.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.481+0000 7f54c3400640 1 --2- 172.21.15.37:0/1814302768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a0d610 0x55e7f2a0fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.481+0000 7f54c3400640 1 -- 172.21.15.37:0/1814302768 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7f293bde0 con 0x55e7f2a0ff40 2024-08-20T05:15:56.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.482+0000 7f54c3e00640 1 --2- 172.21.15.37:0/1814302768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a0d610 0x55e7f2a0fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:15:56.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.482+0000 7f54c3400640 1 --2- 172.21.15.37:0/1814302768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a12330 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f54b0015740 tx=0x7f54b0018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=249606af58ca2469 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:56.484 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.482+0000 7f54b9600640 1 -- 172.21.15.37:0/1814302768 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b001e020 con 0x55e7f2a0ff40 2024-08-20T05:15:56.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.482+0000 7f54b9600640 1 -- 172.21.15.37:0/1814302768 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54b0017c90 con 0x55e7f2a0ff40 2024-08-20T05:15:56.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.482+0000 7f54b9600640 1 -- 172.21.15.37:0/1814302768 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b000f040 con 0x55e7f2a0ff40 2024-08-20T05:15:56.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.482+0000 7f54c3400640 1 --2- 172.21.15.37:0/261971779 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54a80b3cd0 0x7f54a80b6190 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f54b00135e0 tx=0x7f54b000a920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:56.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.483+0000 7f54ce1cc740 1 -- 172.21.15.37:0/1814302768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0ff40 msgr2=0x55e7f2a12330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:56.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.483+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/1814302768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a12330 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f54b0015740 tx=0x7f54b0018000 comp rx=0 tx=0).stop 2024-08-20T05:15:56.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.484+0000 7f54ce1cc740 1 -- 172.21.15.37:0/1814302768 shutdown_connections 2024-08-20T05:15:56.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.484+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/1814302768 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a12980 0x55e7f2a14e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.484+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/1814302768 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a12330 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.484+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/1814302768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a0d610 0x55e7f2a0fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.484+0000 7f54ce1cc740 1 -- 172.21.15.37:0/1814302768 >> 172.21.15.37:0/1814302768 conn(0x55e7f2a08760 msgr2=0x55e7f2a094f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.484+0000 7f54ce1cc740 1 -- 172.21.15.37:0/1814302768 shutdown_connections 2024-08-20T05:15:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.484+0000 7f54ce1cc740 1 -- 172.21.15.37:0/1814302768 wait complete. 2024-08-20T05:15:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.485+0000 7f54ce1cc740 1 -- start start 2024-08-20T05:15:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.485+0000 7f54ce1cc740 1 Processor -- start 2024-08-20T05:15:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.486+0000 7f54ce1cc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a0d610 0x55e7f2a16da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.486+0000 7f54ce1cc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a17440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.486+0000 7f54ce1cc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a12980 0x55e7f2a18010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.486+0000 7f54c3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a17440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.486+0000 7f54c3400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a17440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:54520/0 (socket says 172.21.15.37:54520) 2024-08-20T05:15:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.486+0000 7f54c3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a0d610 0x55e7f2a16da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.486+0000 7f54c3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a0d610 0x55e7f2a16da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42858/0 (socket says 172.21.15.37:42858) 2024-08-20T05:15:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.488+0000 7f54c3400640 1 -- 172.21.15.37:0/2710816026 learned_addr learned my addr 172.21.15.37:0/2710816026 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.488+0000 7f54ce1cc740 1 -- 172.21.15.37:0/2710816026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e7f28a8ab0 con 0x55e7f2a12980 2024-08-20T05:15:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.488+0000 7f54ce1cc740 1 -- 172.21.15.37:0/2710816026 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e7f2916140 con 0x55e7f2a0d610 2024-08-20T05:15:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.488+0000 7f54ce1cc740 1 -- 172.21.15.37:0/2710816026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e7f2a15900 con 0x55e7f2a0ff40 2024-08-20T05:15:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.488+0000 7f54ce1cc740 10 client.0 _ll_register_callbacks cb 0x55e7f29295d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.488+0000 7f54c3400640 1 -- 172.21.15.37:0/2710816026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a0d610 msgr2=0x55e7f2a16da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.488+0000 7f54c3400640 1 --2- 172.21.15.37:0/2710816026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a0d610 0x55e7f2a16da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.489+0000 7f54c3400640 1 -- 172.21.15.37:0/2710816026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a12980 msgr2=0x55e7f2a18010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.489+0000 7f54c3400640 1 --2- 172.21.15.37:0/2710816026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a12980 0x55e7f2a18010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.489+0000 7f54c3400640 1 -- 172.21.15.37:0/2710816026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7f2917170 con 0x55e7f2a0ff40 2024-08-20T05:15:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.490+0000 7f54c3400640 1 --2- 172.21.15.37:0/2710816026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a17440 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f54b0006aa0 tx=0x7f54b000afa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c709e08116c044f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.490+0000 7f54ae000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:15:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.490+0000 7f54ae000640 1 -- 172.21.15.37:0/2710816026 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b001e040 con 0x55e7f2a0ff40 2024-08-20T05:15:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.491+0000 7f54ae000640 1 -- 172.21.15.37:0/2710816026 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f54b0018ab0 con 0x55e7f2a0ff40 2024-08-20T05:15:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.492+0000 7f54ce1cc740 1 -- 172.21.15.37:0/2710816026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54b0017c90 con 0x55e7f2a0ff40 2024-08-20T05:15:56.495 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.493+0000 7f54ae000640 1 -- 172.21.15.37:0/2710816026 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f54b0017e40 con 0x55e7f2a0ff40 2024-08-20T05:15:56.495 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.493+0000 7f54ce1cc740 10 client.28795 fetch_fsmap learned FSMap version 50 2024-08-20T05:15:56.495 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.493+0000 7f54ce1cc740 1 -- 172.21.15.37:0/2710816026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55e7f26d2790 con 0x55e7f2a0ff40 2024-08-20T05:15:56.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.494+0000 7f54ae000640 1 -- 172.21.15.37:0/2710816026 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54b0017c90 con 0x55e7f2a0ff40 2024-08-20T05:15:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.495+0000 7f54ae000640 1 -- 172.21.15.37:0/2710816026 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f54b0023410 con 0x55e7f2a0ff40 2024-08-20T05:15:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.495+0000 7f54ce1cc740 10 client.28795 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:15:56.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.495+0000 7f54ce1cc740 10 client.28795 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:56.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.495+0000 7f54ce1cc740 20 client.28795 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:56.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.495+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/2710816026 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e7f2a22640 0x55e7f2a24a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.495+0000 7f54ce1cc740 4 client.28795 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:15:56.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.495+0000 7f54ce1cc740 1 -- 172.21.15.37:0/2710816026 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e7f2982160 con 0x55e7f2a22640 2024-08-20T05:15:56.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.496+0000 7f54c3e00640 1 --2- 172.21.15.37:0/2710816026 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e7f2a22640 0x55e7f2a24a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:56.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.499+0000 7f54ae000640 10 client.28795 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:56.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.499+0000 7f54c3e00640 1 --2- 172.21.15.37:0/2710816026 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e7f2a22640 0x55e7f2a24a30 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24ac1916aa96aea server_cookie=c544575efe7a394c in_seq=0 out_seq=0 2024-08-20T05:15:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.500+0000 7f54ae000640 1 -- 172.21.15.37:0/2710816026 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e7f2982160 con 0x55e7f2a22640 2024-08-20T05:15:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.500+0000 7f54ae000640 10 client.28795 handle_command_reply: tid=0 2024-08-20T05:15:56.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.500+0000 7f54ce1cc740 1 client.28795 shutdown 2024-08-20T05:15:56.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.505+0000 7f54ce1cc740 1 -- 172.21.15.37:0/2710816026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0ff40 msgr2=0x55e7f2a17440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:56.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.505+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/2710816026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a17440 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f54b0006aa0 tx=0x7f54b000afa0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.506+0000 7f54ce1cc740 1 -- 172.21.15.37:0/2710816026 shutdown_connections 2024-08-20T05:15:56.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.506+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/2710816026 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e7f2a22640 0x55e7f2a24a30 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.507+0000 7f54ae000640 0 client.28795 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:56.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.507+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/2710816026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a12980 0x55e7f2a18010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.507+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/2710816026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a17440 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.507+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/2710816026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a0d610 0x55e7f2a16da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.507+0000 7f54ce1cc740 1 -- 172.21.15.37:0/2710816026 >> 172.21.15.37:0/2710816026 conn(0x55e7f2a08760 msgr2=0x55e7f2a07760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:56.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.507+0000 7f54ce1cc740 1 -- 172.21.15.37:0/2710816026 shutdown_connections 2024-08-20T05:15:56.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.507+0000 7f54ce1cc740 1 -- 172.21.15.37:0/2710816026 wait complete. 2024-08-20T05:15:56.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.507+0000 7f54ce1cc740 20 client.28795 trim_cache size 0 max 16384 2024-08-20T05:15:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.539+0000 7f54ce1cc740 1 Processor -- start 2024-08-20T05:15:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.539+0000 7f54ce1cc740 1 -- start start 2024-08-20T05:15:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.539+0000 7f54ce1cc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0d610 0x55e7f2a03660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.540+0000 7f54ce1cc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a13a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.540+0000 7f54ce1cc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a12980 0x55e7f2a13f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.540+0000 7f54ce1cc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41b19a0 con 0x55e7f2a0ff40 2024-08-20T05:15:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.540+0000 7f54ce1cc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41b3540 con 0x55e7f2a12980 2024-08-20T05:15:56.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.540+0000 7f54ce1cc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41b2070 con 0x55e7f2a0d610 2024-08-20T05:15:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.540+0000 7f54c3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0d610 0x55e7f2a03660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.540+0000 7f54c3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0d610 0x55e7f2a03660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:54524/0 (socket says 172.21.15.37:54524) 2024-08-20T05:15:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.540+0000 7f54c3e00640 1 -- 172.21.15.37:0/3061304582 learned_addr learned my addr 172.21.15.37:0/3061304582 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.541+0000 7f54c3400640 1 --2- 172.21.15.37:0/3061304582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a13a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.541+0000 7f54c9200640 1 --2- 172.21.15.37:0/3061304582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a12980 0x55e7f2a13f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.541+0000 7f54c3e00640 1 -- 172.21.15.37:0/3061304582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a12980 msgr2=0x55e7f2a13f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.541+0000 7f54c3e00640 1 --2- 172.21.15.37:0/3061304582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a12980 0x55e7f2a13f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.541+0000 7f54c3e00640 1 -- 172.21.15.37:0/3061304582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a0ff40 msgr2=0x55e7f2a13a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.541+0000 7f54c3e00640 1 --2- 172.21.15.37:0/3061304582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a13a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.541+0000 7f54c3e00640 1 -- 172.21.15.37:0/3061304582 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e7f2a18380 con 0x55e7f2a0d610 2024-08-20T05:15:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.541+0000 7f54c3e00640 1 --2- 172.21.15.37:0/3061304582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0d610 0x55e7f2a03660 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f54b400dc30 tx=0x7f54b400d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67269a6c922fdaea server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.542+0000 7f54b8c00640 1 -- 172.21.15.37:0/3061304582 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4041020 con 0x55e7f2a0d610 2024-08-20T05:15:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.542+0000 7f54b8c00640 1 -- 172.21.15.37:0/3061304582 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54b401a7e0 con 0x55e7f2a0d610 2024-08-20T05:15:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.542+0000 7f54b8c00640 1 -- 172.21.15.37:0/3061304582 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4011830 con 0x55e7f2a0d610 2024-08-20T05:15:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.543+0000 7f54ce1cc740 1 -- 172.21.15.37:0/3061304582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0d610 msgr2=0x55e7f2a03660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.543+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/3061304582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0d610 0x55e7f2a03660 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f54b400dc30 tx=0x7f54b400d4a0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.543+0000 7f54ce1cc740 1 -- 172.21.15.37:0/3061304582 shutdown_connections 2024-08-20T05:15:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.543+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/3061304582 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a12980 0x55e7f2a13f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.543+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/3061304582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a13a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.543+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/3061304582 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0d610 0x55e7f2a03660 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.543+0000 7f54ce1cc740 1 -- 172.21.15.37:0/3061304582 >> 172.21.15.37:0/3061304582 conn(0x55e7f2a08760 msgr2=0x55e7f2a12e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.543+0000 7f54ce1cc740 1 -- 172.21.15.37:0/3061304582 shutdown_connections 2024-08-20T05:15:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.544+0000 7f54ce1cc740 1 -- 172.21.15.37:0/3061304582 wait complete. 2024-08-20T05:15:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.544+0000 7f54ce1cc740 1 -- start start 2024-08-20T05:15:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.545+0000 7f54ce1cc740 1 Processor -- start 2024-08-20T05:15:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.545+0000 7f54ce1cc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0d610 0x55e7f2a1e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.545+0000 7f54ce1cc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a1eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.545+0000 7f54ce1cc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a12980 0x55e7f2a1d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.545+0000 7f54ce1cc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41b2e70 con 0x55e7f2a0ff40 2024-08-20T05:15:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.545+0000 7f54ce1cc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54c41b2740 con 0x55e7f2a12980 2024-08-20T05:15:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.545+0000 7f54ce1cc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54c4073a00 con 0x55e7f2a0d610 2024-08-20T05:15:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.545+0000 7f54ce1cc740 10 client.0 _ll_register_callbacks cb 0x7f54b0015690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:15:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.546+0000 7f54c3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0d610 0x55e7f2a1e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.546+0000 7f54c3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0d610 0x55e7f2a1e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:54534/0 (socket says 172.21.15.37:54534) 2024-08-20T05:15:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.546+0000 7f54c3e00640 1 -- 172.21.15.37:0/1996207094 learned_addr learned my addr 172.21.15.37:0/1996207094 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.546+0000 7f54c3400640 1 --2- 172.21.15.37:0/1996207094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a1eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.546+0000 7f54c9200640 1 --2- 172.21.15.37:0/1996207094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a12980 0x55e7f2a1d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.546+0000 7f54c3e00640 1 -- 172.21.15.37:0/1996207094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a12980 msgr2=0x55e7f2a1d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.547+0000 7f54c3e00640 1 --2- 172.21.15.37:0/1996207094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a12980 0x55e7f2a1d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.547+0000 7f54c3e00640 1 -- 172.21.15.37:0/1996207094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a0ff40 msgr2=0x55e7f2a1eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:15:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.547+0000 7f54c3e00640 1 --2- 172.21.15.37:0/1996207094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a1eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.547+0000 7f54c3e00640 1 -- 172.21.15.37:0/1996207094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7f274b620 con 0x55e7f2a0d610 2024-08-20T05:15:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.547+0000 7f54c9200640 1 --2- 172.21.15.37:0/1996207094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a12980 0x55e7f2a1d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.547+0000 7f54c3400640 1 --2- 172.21.15.37:0/1996207094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a1eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:15:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.547+0000 7f54c3e00640 1 --2- 172.21.15.37:0/1996207094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0d610 0x55e7f2a1e840 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f54b400dc00 tx=0x7f54b400dd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=690ca3ffd594da5a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.548+0000 7f54ae000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:15:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.548+0000 7f54ae000640 1 -- 172.21.15.37:0/1996207094 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b400de90 con 0x55e7f2a0d610 2024-08-20T05:15:56.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.548+0000 7f54ce1cc740 1 -- 172.21.15.37:0/1996207094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54b401a7e0 con 0x55e7f2a0d610 2024-08-20T05:15:56.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.548+0000 7f54ae000640 1 -- 172.21.15.37:0/1996207094 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f54b401a330 con 0x55e7f2a0d610 2024-08-20T05:15:56.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.548+0000 7f54ae000640 1 -- 172.21.15.37:0/1996207094 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f54b401a530 con 0x55e7f2a0d610 2024-08-20T05:15:56.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.549+0000 7f54ce1cc740 10 client.28801 fetch_fsmap learned FSMap version 50 2024-08-20T05:15:56.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.549+0000 7f54ce1cc740 1 -- 172.21.15.37:0/1996207094 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55e7f2a1cb00 con 0x55e7f2a0d610 2024-08-20T05:15:56.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.549+0000 7f54ae000640 1 -- 172.21.15.37:0/1996207094 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54b401a7e0 con 0x55e7f2a0d610 2024-08-20T05:15:56.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.550+0000 7f54ae000640 1 -- 172.21.15.37:0/1996207094 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f54b40115b0 con 0x55e7f2a0d610 2024-08-20T05:15:56.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.550+0000 7f54ce1cc740 10 client.28801 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:15:56.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.550+0000 7f54ce1cc740 10 client.28801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:15:56.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.550+0000 7f54ce1cc740 20 client.28801 populate_metadata read hostname 'smithi037' 2024-08-20T05:15:56.552 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.550+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/1996207094 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e7f2a22640 0x55e7f2a8f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.550+0000 7f54ce1cc740 4 client.28801 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:15:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.550+0000 7f54ce1cc740 1 -- 172.21.15.37:0/1996207094 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e7f297dc00 con 0x55e7f2a22640 2024-08-20T05:15:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.551+0000 7f54c3400640 1 --2- 172.21.15.37:0/1996207094 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e7f2a22640 0x55e7f2a8f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.551+0000 7f54c3400640 1 --2- 172.21.15.37:0/1996207094 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e7f2a22640 0x55e7f2a8f6a0 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30685edfe6b8c1b4 server_cookie=6f2f9763fe3ba933 in_seq=0 out_seq=0 2024-08-20T05:15:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.551+0000 7f54ae000640 10 client.28801 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.561+0000 7f54ae000640 1 -- 172.21.15.37:0/1996207094 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e7f297dc00 con 0x55e7f2a22640 2024-08-20T05:15:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.561+0000 7f54ae000640 10 client.28801 handle_command_reply: tid=0 2024-08-20T05:15:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.561+0000 7f54ce1cc740 1 client.28801 shutdown 2024-08-20T05:15:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.562+0000 7f54ce1cc740 1 -- 172.21.15.37:0/1996207094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0d610 msgr2=0x55e7f2a1e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.562+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/1996207094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0d610 0x55e7f2a1e840 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f54b400dc00 tx=0x7f54b400dd20 comp rx=0 tx=0).stop 2024-08-20T05:15:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.562+0000 7f54ce1cc740 1 -- 172.21.15.37:0/1996207094 shutdown_connections 2024-08-20T05:15:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.562+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/1996207094 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e7f2a22640 0x55e7f2a8f6a0 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.562+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/1996207094 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e7f2a12980 0x55e7f2a1d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.562+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/1996207094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e7f2a0ff40 0x55e7f2a1eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.562+0000 7f54ce1cc740 1 --2- 172.21.15.37:0/1996207094 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e7f2a0d610 0x55e7f2a1e840 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.562+0000 7f54ce1cc740 1 -- 172.21.15.37:0/1996207094 >> 172.21.15.37:0/1996207094 conn(0x55e7f2a08760 msgr2=0x55e7f2a07760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.562+0000 7f54ae000640 0 client.28801 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:15:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.563+0000 7f54ce1cc740 1 -- 172.21.15.37:0/1996207094 shutdown_connections 2024-08-20T05:15:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.563+0000 7f54ce1cc740 1 -- 172.21.15.37:0/1996207094 wait complete. 2024-08-20T05:15:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.563+0000 7f54ce1cc740 20 client.28801 trim_cache size 0 max 16384 2024-08-20T05:15:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:15:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:15:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:15:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:15:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.564+0000 7f54cb200640 1 -- 172.21.15.37:0/261971779 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54a80b3cd0 msgr2=0x7f54a80b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.564+0000 7f54cb200640 1 --2- 172.21.15.37:0/261971779 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54a80b3cd0 0x7f54a80b6190 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f54b00135e0 tx=0x7f54b000a920 comp rx=0 tx=0).stop 2024-08-20T05:15:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.564+0000 7f54cb200640 1 -- 172.21.15.37:0/261971779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54c41063a0 msgr2=0x7f54c4112dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.564+0000 7f54cb200640 1 --2- 172.21.15.37:0/261971779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54c41063a0 0x7f54c4112dc0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f54bc004af0 tx=0x7f54bc032ea0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.564+0000 7f54cb200640 1 -- 172.21.15.37:0/261971779 shutdown_connections 2024-08-20T05:15:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.564+0000 7f54cb200640 1 --2- 172.21.15.37:0/261971779 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54a80b3cd0 0x7f54a80b6190 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.564+0000 7f54cb200640 1 --2- 172.21.15.37:0/261971779 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54c41063a0 0x7f54c4112dc0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.564+0000 7f54cb200640 1 --2- 172.21.15.37:0/261971779 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54c41059e0 0x7f54c4112190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.564+0000 7f54cb200640 1 --2- 172.21.15.37:0/261971779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54c4104890 0x7f54c4111b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.564+0000 7f54cb200640 1 -- 172.21.15.37:0/261971779 >> 172.21.15.37:0/261971779 conn(0x7f54c4100130 msgr2=0x7f54c4106cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.565+0000 7f54cb200640 1 -- 172.21.15.37:0/261971779 shutdown_connections 2024-08-20T05:15:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:15:56.565+0000 7f54cb200640 1 -- 172.21.15.37:0/261971779 wait complete. 2024-08-20T05:15:56.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:56 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:15:56.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:56 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:15:56.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:56 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:15:56.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:56 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:15:57.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:56 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:15:57.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:56 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:15:57.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:57 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:15:57.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:57 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:15:57.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:57 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:15:57.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:57 smithi135 ceph-mon[22342]: pgmap v812: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 5.9 MiB/s wr, 610 op/s 2024-08-20T05:15:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:57 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:15:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:57 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:15:57.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:57 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:15:57.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:57 smithi130 ceph-mon[22007]: pgmap v812: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 5.9 MiB/s wr, 610 op/s 2024-08-20T05:15:57.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:57 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:15:57.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:57 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:15:57.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:57 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:15:57.971 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:57 smithi037 ceph-mon[17265]: pgmap v812: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 5.9 MiB/s wr, 610 op/s 2024-08-20T05:15:58.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 780.0 s, 501.2 tps, lat 193.749 ms stddev 247.969 2024-08-20T05:15:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.286+0000 7fa127200640 1 -- 172.21.15.37:0/1343152505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa120074c00 msgr2=0x7fa120075040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.286+0000 7fa127200640 1 --2- 172.21.15.37:0/1343152505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa120074c00 0x7fa120075040 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa1100074e0 tx=0x7fa11002b070 comp rx=0 tx=0).stop 2024-08-20T05:15:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.286+0000 7fa127200640 1 -- 172.21.15.37:0/1343152505 shutdown_connections 2024-08-20T05:15:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.286+0000 7fa127200640 1 --2- 172.21.15.37:0/1343152505 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa120075580 0x7fa12007bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.286+0000 7fa127200640 1 --2- 172.21.15.37:0/1343152505 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa120074c00 0x7fa120075040 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.286+0000 7fa127200640 1 --2- 172.21.15.37:0/1343152505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa12010a0e0 0x7fa12010a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.286+0000 7fa127200640 1 -- 172.21.15.37:0/1343152505 >> 172.21.15.37:0/1343152505 conn(0x7fa12006c830 msgr2=0x7fa12006cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.287+0000 7fa127200640 1 -- 172.21.15.37:0/1343152505 shutdown_connections 2024-08-20T05:15:58.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.287+0000 7fa127200640 1 -- 172.21.15.37:0/1343152505 wait complete. 2024-08-20T05:15:58.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.288+0000 7fa127200640 1 Processor -- start 2024-08-20T05:15:58.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.289+0000 7fa127200640 1 -- start start 2024-08-20T05:15:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.289+0000 7fa127200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa120074c00 0x7fa1200769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.289+0000 7fa127200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa120075580 0x7fa120076f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.289+0000 7fa127200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa12010a0e0 0x7fa1201be4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.289+0000 7fa127200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa120083560 con 0x7fa120074c00 2024-08-20T05:15:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.289+0000 7fa127200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa1200833e0 con 0x7fa120075580 2024-08-20T05:15:58.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.289+0000 7fa127200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa1200836e0 con 0x7fa12010a0e0 2024-08-20T05:15:58.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.291+0000 7fa125e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa120074c00 0x7fa1200769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:58.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.291+0000 7fa125400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa120075580 0x7fa120076f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.291+0000 7fa125400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa120075580 0x7fa120076f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42898/0 (socket says 172.21.15.37:42898) 2024-08-20T05:15:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.291+0000 7fa125400640 1 -- 172.21.15.37:0/4216608086 learned_addr learned my addr 172.21.15.37:0/4216608086 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:15:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.291+0000 7fa126800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa12010a0e0 0x7fa1201be4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.292+0000 7fa125400640 1 -- 172.21.15.37:0/4216608086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa12010a0e0 msgr2=0x7fa1201be4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.292+0000 7fa125400640 1 --2- 172.21.15.37:0/4216608086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa12010a0e0 0x7fa1201be4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:58.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.292+0000 7fa125400640 1 -- 172.21.15.37:0/4216608086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa120074c00 msgr2=0x7fa1200769f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:58.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.293+0000 7fa125400640 1 --2- 172.21.15.37:0/4216608086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa120074c00 0x7fa1200769f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:58.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.293+0000 7fa125400640 1 -- 172.21.15.37:0/4216608086 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1201bec60 con 0x7fa120075580 2024-08-20T05:15:58.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.293+0000 7fa125e00640 1 --2- 172.21.15.37:0/4216608086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa120074c00 0x7fa1200769f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:15:58.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.298+0000 7fa125400640 1 --2- 172.21.15.37:0/4216608086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa120075580 0x7fa120076f30 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa110005f30 tx=0x7fa1100053e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:58.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.298+0000 7fa11aa00640 1 -- 172.21.15.37:0/4216608086 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11002b9b0 con 0x7fa120075580 2024-08-20T05:15:58.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.298+0000 7fa11aa00640 1 -- 172.21.15.37:0/4216608086 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa110041070 con 0x7fa120075580 2024-08-20T05:15:58.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.298+0000 7fa11aa00640 1 -- 172.21.15.37:0/4216608086 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11000a430 con 0x7fa120075580 2024-08-20T05:15:58.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.299+0000 7fa127200640 1 -- 172.21.15.37:0/4216608086 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1201beef0 con 0x7fa120075580 2024-08-20T05:15:58.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.299+0000 7fa127200640 1 -- 172.21.15.37:0/4216608086 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1201c55d0 con 0x7fa120075580 2024-08-20T05:15:58.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.301+0000 7fa127200640 1 -- 172.21.15.37:0/4216608086 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa120075040 con 0x7fa120075580 2024-08-20T05:15:58.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.305+0000 7fa11aa00640 1 -- 172.21.15.37:0/4216608086 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa110004ad0 con 0x7fa120075580 2024-08-20T05:15:58.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.308+0000 7fa11aa00640 1 --2- 172.21.15.37:0/4216608086 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa1080b3e10 0x7fa1080b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:15:58.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.308+0000 7fa11aa00640 1 -- 172.21.15.37:0/4216608086 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa1100c65b0 con 0x7fa120075580 2024-08-20T05:15:58.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.309+0000 7fa125e00640 1 --2- 172.21.15.37:0/4216608086 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa1080b3e10 0x7fa1080b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:15:58.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.309+0000 7fa11aa00640 1 -- 172.21.15.37:0/4216608086 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa1100ca6c0 con 0x7fa120075580 2024-08-20T05:15:58.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.312+0000 7fa125e00640 1 --2- 172.21.15.37:0/4216608086 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa1080b3e10 0x7fa1080b62d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa1140058c0 tx=0x7fa114005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:15:58.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.700+0000 7fa127200640 1 -- 172.21.15.37:0/4216608086 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1201c57d0 con 0x7fa120075580 2024-08-20T05:15:58.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.700+0000 7fa11aa00640 1 -- 172.21.15.37:0/4216608086 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11983 (secure 0 0 0) 0x7fa1100ce5c0 con 0x7fa120075580 2024-08-20T05:15:58.703 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:15:58.703 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":50,"btime":"2024-08-20T05:15:39:521784+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:15:39.110643+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:15:58.703 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 50 2024-08-20T05:15:58.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.703+0000 7fa127200640 1 -- 172.21.15.37:0/4216608086 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa1080b3e10 msgr2=0x7fa1080b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:58.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.703+0000 7fa127200640 1 --2- 172.21.15.37:0/4216608086 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa1080b3e10 0x7fa1080b62d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa1140058c0 tx=0x7fa114005850 comp rx=0 tx=0).stop 2024-08-20T05:15:58.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.703+0000 7fa127200640 1 -- 172.21.15.37:0/4216608086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa120075580 msgr2=0x7fa120076f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:15:58.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.703+0000 7fa127200640 1 --2- 172.21.15.37:0/4216608086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa120075580 0x7fa120076f30 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa110005f30 tx=0x7fa1100053e0 comp rx=0 tx=0).stop 2024-08-20T05:15:58.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.704+0000 7fa127200640 1 -- 172.21.15.37:0/4216608086 shutdown_connections 2024-08-20T05:15:58.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.704+0000 7fa127200640 1 --2- 172.21.15.37:0/4216608086 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa1080b3e10 0x7fa1080b62d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:58.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.704+0000 7fa127200640 1 --2- 172.21.15.37:0/4216608086 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa12010a0e0 0x7fa1201be4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:58.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.704+0000 7fa127200640 1 --2- 172.21.15.37:0/4216608086 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa120075580 0x7fa120076f30 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:58.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.704+0000 7fa127200640 1 --2- 172.21.15.37:0/4216608086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa120074c00 0x7fa1200769f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:15:58.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.704+0000 7fa127200640 1 -- 172.21.15.37:0/4216608086 >> 172.21.15.37:0/4216608086 conn(0x7fa12006c830 msgr2=0x7fa12010ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:15:58.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.705+0000 7fa127200640 1 -- 172.21.15.37:0/4216608086 shutdown_connections 2024-08-20T05:15:58.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:15:58.705+0000 7fa127200640 1 -- 172.21.15.37:0/4216608086 wait complete. 2024-08-20T05:15:59.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:59 smithi037 ceph-mon[17265]: pgmap v813: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 5.8 MiB/s wr, 619 op/s 2024-08-20T05:15:59.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:15:59 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/4216608086' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:15:59.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:59 smithi135 ceph-mon[22342]: pgmap v813: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 5.8 MiB/s wr, 619 op/s 2024-08-20T05:15:59.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:15:59 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/4216608086' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:15:59.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:59 smithi130 ceph-mon[22007]: pgmap v813: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 5.8 MiB/s wr, 619 op/s 2024-08-20T05:15:59.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:15:59 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/4216608086' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:16:00.594 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 141.4 --await-for 45.0' 2024-08-20T05:16:00.595 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 141.4 --await-for 45.0 2024-08-20T05:16:01.384 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:16:01.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:01 smithi037 ceph-mon[17265]: pgmap v814: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 5.3 MiB/s wr, 595 op/s 2024-08-20T05:16:01.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:01 smithi135 ceph-mon[22342]: pgmap v814: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 5.3 MiB/s wr, 595 op/s 2024-08-20T05:16:01.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:01 smithi130 ceph-mon[22007]: pgmap v814: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 275 KiB/s rd, 5.3 MiB/s wr, 595 op/s 2024-08-20T05:16:02.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.279+0000 7fe9c8a00640 1 -- 172.21.15.37:0/2818276829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9c410a6c0 msgr2=0x7fe9c410ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:02.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.279+0000 7fe9c8a00640 1 --2- 172.21.15.37:0/2818276829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9c410a6c0 0x7fe9c410ab00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac009900 tx=0x7fe9ac02a420 comp rx=0 tx=0).stop 2024-08-20T05:16:02.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.280+0000 7fe9c8a00640 1 -- 172.21.15.37:0/2818276829 shutdown_connections 2024-08-20T05:16:02.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.280+0000 7fe9c8a00640 1 --2- 172.21.15.37:0/2818276829 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c410b040 0x7fe9c4111840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.281+0000 7fe9c8a00640 1 --2- 172.21.15.37:0/2818276829 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9c410a6c0 0x7fe9c410ab00 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.281+0000 7fe9c8a00640 1 --2- 172.21.15.37:0/2818276829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9c4104cb0 0x7fe9c4105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.281+0000 7fe9c8a00640 1 -- 172.21.15.37:0/2818276829 >> 172.21.15.37:0/2818276829 conn(0x7fe9c4100720 msgr2=0x7fe9c4102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.282+0000 7fe9c8a00640 1 -- 172.21.15.37:0/2818276829 shutdown_connections 2024-08-20T05:16:02.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.282+0000 7fe9c8a00640 1 -- 172.21.15.37:0/2818276829 wait complete. 2024-08-20T05:16:02.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.284+0000 7fe9c8a00640 1 Processor -- start 2024-08-20T05:16:02.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.286+0000 7fe9c8a00640 1 -- start start 2024-08-20T05:16:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.287+0000 7fe9c8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c4104cb0 0x7fe9c41117e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.287+0000 7fe9c8a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9c410a6c0 0x7fe9c411c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.287+0000 7fe9c1e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c4104cb0 0x7fe9c41117e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.287+0000 7fe9c1e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c4104cb0 0x7fe9c41117e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:54568/0 (socket says 172.21.15.37:54568) 2024-08-20T05:16:02.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.287+0000 7fe9c8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9c410b040 0x7fe9c410fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.288+0000 7fe9c1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9c410a6c0 0x7fe9c411c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:02.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.288+0000 7fe9c1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9c410a6c0 0x7fe9c411c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42928/0 (socket says 172.21.15.37:42928) 2024-08-20T05:16:02.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.289+0000 7fe9c8a00640 1 -- 172.21.15.37:0/1264049307 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c4077df0 con 0x7fe9c410b040 2024-08-20T05:16:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.289+0000 7fe9c8a00640 1 -- 172.21.15.37:0/1264049307 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c4077c70 con 0x7fe9c410a6c0 2024-08-20T05:16:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.289+0000 7fe9c8a00640 1 -- 172.21.15.37:0/1264049307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c4077f70 con 0x7fe9c4104cb0 2024-08-20T05:16:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.289+0000 7fe9c1e00640 1 -- 172.21.15.37:0/1264049307 learned_addr learned my addr 172.21.15.37:0/1264049307 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.290+0000 7fe9c1e00640 1 -- 172.21.15.37:0/1264049307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9c410a6c0 msgr2=0x7fe9c411c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.290+0000 7fe9c1e00640 1 --2- 172.21.15.37:0/1264049307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9c410a6c0 0x7fe9c411c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.290+0000 7fe9c1e00640 1 -- 172.21.15.37:0/1264049307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9c410b040 msgr2=0x7fe9c410fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:02.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.290+0000 7fe9c1e00640 1 --2- 172.21.15.37:0/1264049307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9c410b040 0x7fe9c410fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.290+0000 7fe9c1e00640 1 -- 172.21.15.37:0/1264049307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c4110340 con 0x7fe9c4104cb0 2024-08-20T05:16:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.291+0000 7fe9c1e00640 1 --2- 172.21.15.37:0/1264049307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c4104cb0 0x7fe9c41117e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00eab0 tx=0x7fe9bc00ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:02.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.291+0000 7fe9baa00640 1 -- 172.21.15.37:0/1264049307 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc00ce40 con 0x7fe9c4104cb0 2024-08-20T05:16:02.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.291+0000 7fe9baa00640 1 -- 172.21.15.37:0/1264049307 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9bc011920 con 0x7fe9c4104cb0 2024-08-20T05:16:02.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.292+0000 7fe9baa00640 1 -- 172.21.15.37:0/1264049307 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9bc010a30 con 0x7fe9c4104cb0 2024-08-20T05:16:02.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.292+0000 7fe9c8a00640 1 -- 172.21.15.37:0/1264049307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c41105d0 con 0x7fe9c4104cb0 2024-08-20T05:16:02.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.292+0000 7fe9c8a00640 1 -- 172.21.15.37:0/1264049307 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c41b48c0 con 0x7fe9c4104cb0 2024-08-20T05:16:02.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.301+0000 7fe9cb406740 1 Processor -- start 2024-08-20T05:16:02.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.301+0000 7fe9cb406740 1 -- start start 2024-08-20T05:16:02.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.301+0000 7fe9cb406740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eef3f0 0x556428eef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.302+0000 7fe9baa00640 1 -- 172.21.15.37:0/1264049307 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fe9bc010bd0 con 0x7fe9c4104cb0 2024-08-20T05:16:02.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.304+0000 7fe9baa00640 1 --2- 172.21.15.37:0/1264049307 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9a80b3de0 0x7fe9a80b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.304+0000 7fe9cb406740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428eefd10 0x556428efb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.304+0000 7fe9cb406740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428efbca0 0x556428efe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.304+0000 7fe9baa00640 1 -- 172.21.15.37:0/1264049307 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe9bc0e4590 con 0x7fe9c4104cb0 2024-08-20T05:16:02.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.304+0000 7fe9cb406740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556428e8f670 con 0x556428eef3f0 2024-08-20T05:16:02.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.304+0000 7fe9cb406740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556428e637c0 con 0x556428efbca0 2024-08-20T05:16:02.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.304+0000 7fe9cb406740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556428e52cc0 con 0x556428eefd10 2024-08-20T05:16:02.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.305+0000 7fe9c2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eef3f0 0x556428eef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:02.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.305+0000 7fe9c2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eef3f0 0x556428eef7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58082/0 (socket says 172.21.15.37:58082) 2024-08-20T05:16:02.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.305+0000 7fe9c2800640 1 -- 172.21.15.37:0/2091627741 learned_addr learned my addr 172.21.15.37:0/2091627741 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:02.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.306+0000 7fe9c1400640 1 --2- 172.21.15.37:0/2091627741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428eefd10 0x556428efb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:02.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.306+0000 7fe9c1e00640 1 --2- 172.21.15.37:0/1264049307 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9a80b3de0 0x7fe9a80b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:02.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.306+0000 7fe9c2800640 1 --2- 172.21.15.37:0/2091627741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428efbca0 0x556428efe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.306+0000 7fe9c1400640 1 -- 172.21.15.37:0/2091627741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428efbca0 msgr2=0x556428efe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.306+0000 7fe9c1400640 1 --2- 172.21.15.37:0/2091627741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428efbca0 0x556428efe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.306+0000 7fe9c1400640 1 -- 172.21.15.37:0/2091627741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eef3f0 msgr2=0x556428eef7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.306+0000 7fe9c1400640 1 --2- 172.21.15.37:0/2091627741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eef3f0 0x556428eef7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.306+0000 7fe9c1400640 1 -- 172.21.15.37:0/2091627741 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556428de6110 con 0x556428eefd10 2024-08-20T05:16:02.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.306+0000 7fe9c2800640 1 --2- 172.21.15.37:0/2091627741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428efbca0 0x556428efe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:16:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.307+0000 7fe9c1400640 1 --2- 172.21.15.37:0/2091627741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428eefd10 0x556428efb760 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac031440 tx=0x7fe9ac0041a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a66d0b21e84bc5e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.308+0000 7fe9b3000640 1 -- 172.21.15.37:0/2091627741 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac035040 con 0x556428eefd10 2024-08-20T05:16:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.308+0000 7fe9b3000640 1 -- 172.21.15.37:0/2091627741 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9ac0054f0 con 0x556428eefd10 2024-08-20T05:16:02.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.308+0000 7fe9b3000640 1 -- 172.21.15.37:0/2091627741 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0035f0 con 0x556428eefd10 2024-08-20T05:16:02.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.309+0000 7fe9cb406740 1 -- 172.21.15.37:0/2091627741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428eefd10 msgr2=0x556428efb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:02.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.309+0000 7fe9cb406740 1 --2- 172.21.15.37:0/2091627741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428eefd10 0x556428efb760 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac031440 tx=0x7fe9ac0041a0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.310+0000 7fe9cb406740 1 -- 172.21.15.37:0/2091627741 shutdown_connections 2024-08-20T05:16:02.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.310+0000 7fe9cb406740 1 --2- 172.21.15.37:0/2091627741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428efbca0 0x556428efe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.310+0000 7fe9cb406740 1 --2- 172.21.15.37:0/2091627741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428eefd10 0x556428efb760 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.310+0000 7fe9cb406740 1 --2- 172.21.15.37:0/2091627741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eef3f0 0x556428eef7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.310+0000 7fe9cb406740 1 -- 172.21.15.37:0/2091627741 >> 172.21.15.37:0/2091627741 conn(0x556428eed220 msgr2=0x556428eee3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:02.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.310+0000 7fe9cb406740 1 -- 172.21.15.37:0/2091627741 shutdown_connections 2024-08-20T05:16:02.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.310+0000 7fe9cb406740 1 -- 172.21.15.37:0/2091627741 wait complete. 2024-08-20T05:16:02.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.311+0000 7fe9cb406740 1 -- start start 2024-08-20T05:16:02.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.311+0000 7fe9cb406740 1 Processor -- start 2024-08-20T05:16:02.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.312+0000 7fe9cb406740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428eef3f0 0x556428efb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.312+0000 7fe9cb406740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eefd10 0x556428ef8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.312+0000 7fe9cb406740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428efbca0 0x556428ef9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.312+0000 7fe9cb406740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556428df8780 con 0x556428eefd10 2024-08-20T05:16:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.312+0000 7fe9cb406740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556428e56d00 con 0x556428efbca0 2024-08-20T05:16:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.312+0000 7fe9cb406740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556428cb57a0 con 0x556428eef3f0 2024-08-20T05:16:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.312+0000 7fe9cb406740 10 client.0 _ll_register_callbacks cb 0x556428e00940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.312+0000 7fe9c2800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428eef3f0 0x556428efb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.312+0000 7fe9c2800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428eef3f0 0x556428efb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:54590/0 (socket says 172.21.15.37:54590) 2024-08-20T05:16:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.313+0000 7fe9c2800640 1 -- 172.21.15.37:0/1324444613 learned_addr learned my addr 172.21.15.37:0/1324444613 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.313+0000 7fe9c2800640 1 --2- 172.21.15.37:0/1324444613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428efbca0 0x556428ef9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:02.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.313+0000 7fe9c2800640 1 -- 172.21.15.37:0/1324444613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428efbca0 msgr2=0x556428ef9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:02.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.313+0000 7fe9c2800640 1 --2- 172.21.15.37:0/1324444613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428efbca0 0x556428ef9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.313+0000 7fe9c2800640 1 -- 172.21.15.37:0/1324444613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eefd10 msgr2=0x556428ef8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:02.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.313+0000 7fe9c2800640 1 --2- 172.21.15.37:0/1324444613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eefd10 0x556428ef8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.313+0000 7fe9c2800640 1 -- 172.21.15.37:0/1324444613 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556428e059c0 con 0x556428eef3f0 2024-08-20T05:16:02.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.313+0000 7fe9c1e00640 1 --2- 172.21.15.37:0/1264049307 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9a80b3de0 0x7fe9a80b62a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc000f80 tx=0x7fe9bc0104d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:02.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.314+0000 7fe9c2800640 1 --2- 172.21.15.37:0/1324444613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428eef3f0 0x556428efb760 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4012b10 tx=0x7fe9b400d620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73ca16ade2075750 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:02.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.314+0000 7fe9a7400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:16:02.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.315+0000 7fe9a7400640 1 -- 172.21.15.37:0/1324444613 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b400fa60 con 0x556428eef3f0 2024-08-20T05:16:02.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.315+0000 7fe9a7400640 1 -- 172.21.15.37:0/1324444613 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe9b400fc00 con 0x556428eef3f0 2024-08-20T05:16:02.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.315+0000 7fe9cb406740 1 -- 172.21.15.37:0/1324444613 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9ac0054f0 con 0x556428eef3f0 2024-08-20T05:16:02.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.316+0000 7fe9a7400640 1 -- 172.21.15.37:0/1324444613 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe9b4025050 con 0x556428eef3f0 2024-08-20T05:16:02.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.316+0000 7fe9cb406740 10 client.28819 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:02.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.316+0000 7fe9cb406740 1 -- 172.21.15.37:0/1324444613 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x556428bc1b90 con 0x556428eef3f0 2024-08-20T05:16:02.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.317+0000 7fe9a7400640 1 -- 172.21.15.37:0/1324444613 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9ac0054f0 con 0x556428eef3f0 2024-08-20T05:16:02.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.317+0000 7fe9a7400640 1 -- 172.21.15.37:0/1324444613 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fe9b401e3c0 con 0x556428eef3f0 2024-08-20T05:16:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.317+0000 7fe9cb406740 10 client.28819 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.317+0000 7fe9cb406740 10 client.28819 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:16:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.317+0000 7fe9cb406740 20 client.28819 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.318+0000 7fe9cb406740 1 --2- 172.21.15.37:0/1324444613 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556428f0b650 0x556428f0dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.318+0000 7fe9cb406740 4 client.28819 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:16:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.318+0000 7fe9cb406740 1 -- 172.21.15.37:0/1324444613 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556428e65710 con 0x556428f0b650 2024-08-20T05:16:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.318+0000 7fe9c1400640 1 --2- 172.21.15.37:0/1324444613 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556428f0b650 0x556428f0dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.320+0000 7fe9c1400640 1 --2- 172.21.15.37:0/1324444613 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556428f0b650 0x556428f0dad0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e43b88f47061edc server_cookie=eb401f93d0b55e94 in_seq=0 out_seq=0 2024-08-20T05:16:02.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.320+0000 7fe9a7400640 10 client.28819 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:02.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.320+0000 7fe9a7400640 1 -- 172.21.15.37:0/1324444613 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556428e65710 con 0x556428f0b650 2024-08-20T05:16:02.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.320+0000 7fe9a7400640 10 client.28819 handle_command_reply: tid=0 2024-08-20T05:16:02.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.321+0000 7fe9cb406740 1 client.28819 shutdown 2024-08-20T05:16:02.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.321+0000 7fe9cb406740 1 -- 172.21.15.37:0/1324444613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428eef3f0 msgr2=0x556428efb760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:02.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.321+0000 7fe9cb406740 1 --2- 172.21.15.37:0/1324444613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428eef3f0 0x556428efb760 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4012b10 tx=0x7fe9b400d620 comp rx=0 tx=0).stop 2024-08-20T05:16:02.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.321+0000 7fe9cb406740 1 -- 172.21.15.37:0/1324444613 shutdown_connections 2024-08-20T05:16:02.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.321+0000 7fe9cb406740 1 --2- 172.21.15.37:0/1324444613 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556428f0b650 0x556428f0dad0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.321+0000 7fe9cb406740 1 --2- 172.21.15.37:0/1324444613 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428efbca0 0x556428ef9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.321+0000 7fe9cb406740 1 --2- 172.21.15.37:0/1324444613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eefd10 0x556428ef8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.321+0000 7fe9cb406740 1 --2- 172.21.15.37:0/1324444613 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428eef3f0 0x556428efb760 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.321+0000 7fe9cb406740 1 -- 172.21.15.37:0/1324444613 >> 172.21.15.37:0/1324444613 conn(0x556428eed220 msgr2=0x556428ef2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:02.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.321+0000 7fe9a7400640 0 client.28819 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:02.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.322+0000 7fe9cb406740 1 -- 172.21.15.37:0/1324444613 shutdown_connections 2024-08-20T05:16:02.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.323+0000 7fe9cb406740 1 -- 172.21.15.37:0/1324444613 wait complete. 2024-08-20T05:16:02.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.323+0000 7fe9cb406740 20 client.28819 trim_cache size 0 max 16384 2024-08-20T05:16:02.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.371+0000 7fe9cb406740 1 Processor -- start 2024-08-20T05:16:02.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.372+0000 7fe9cb406740 1 -- start start 2024-08-20T05:16:02.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.373+0000 7fe9cb406740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eef3f0 0x556428efa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.373+0000 7fe9cb406740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428eefd10 0x556428f133a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.373+0000 7fe9cb406740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428efbca0 0x556428f138e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.373+0000 7fe9cb406740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c41be6c0 con 0x556428eef3f0 2024-08-20T05:16:02.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.373+0000 7fe9cb406740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c41c0260 con 0x556428eefd10 2024-08-20T05:16:02.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.373+0000 7fe9cb406740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c41bed90 con 0x556428efbca0 2024-08-20T05:16:02.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.373+0000 7fe9c1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428eefd10 0x556428f133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:02.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.373+0000 7fe9c1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428eefd10 0x556428f133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42962/0 (socket says 172.21.15.37:42962) 2024-08-20T05:16:02.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.373+0000 7fe9c1400640 1 -- 172.21.15.37:0/4202339000 learned_addr learned my addr 172.21.15.37:0/4202339000 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:02.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.374+0000 7fe9c1400640 1 -- 172.21.15.37:0/4202339000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428efbca0 msgr2=0x556428f138e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:16:02.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.374+0000 7fe9c1400640 1 --2- 172.21.15.37:0/4202339000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428efbca0 0x556428f138e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.374+0000 7fe9c1400640 1 -- 172.21.15.37:0/4202339000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eef3f0 msgr2=0x556428efa8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:16:02.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.375+0000 7fe9c1400640 1 --2- 172.21.15.37:0/4202339000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eef3f0 0x556428efa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.375+0000 7fe9c1400640 1 -- 172.21.15.37:0/4202339000 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556428eee810 con 0x556428eefd10 2024-08-20T05:16:02.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.375+0000 7fe9c1400640 1 --2- 172.21.15.37:0/4202339000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428eefd10 0x556428f133a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0096c0 tx=0x7fe9ac004590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ea019fd47949cd8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:02.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.375+0000 7fe9b2600640 1 -- 172.21.15.37:0/4202339000 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac035040 con 0x556428eefd10 2024-08-20T05:16:02.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.376+0000 7fe9b2600640 1 -- 172.21.15.37:0/4202339000 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9ac005d10 con 0x556428eefd10 2024-08-20T05:16:02.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.376+0000 7fe9b2600640 1 -- 172.21.15.37:0/4202339000 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac0318e0 con 0x556428eefd10 2024-08-20T05:16:02.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.377+0000 7fe9cb406740 1 -- 172.21.15.37:0/4202339000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428eefd10 msgr2=0x556428f133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:02.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.377+0000 7fe9cb406740 1 --2- 172.21.15.37:0/4202339000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428eefd10 0x556428f133a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac0096c0 tx=0x7fe9ac004590 comp rx=0 tx=0).stop 2024-08-20T05:16:02.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.377+0000 7fe9cb406740 1 -- 172.21.15.37:0/4202339000 shutdown_connections 2024-08-20T05:16:02.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.377+0000 7fe9cb406740 1 --2- 172.21.15.37:0/4202339000 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428efbca0 0x556428f138e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.378+0000 7fe9cb406740 1 --2- 172.21.15.37:0/4202339000 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428eefd10 0x556428f133a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.378+0000 7fe9cb406740 1 --2- 172.21.15.37:0/4202339000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eef3f0 0x556428efa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.378+0000 7fe9cb406740 1 -- 172.21.15.37:0/4202339000 >> 172.21.15.37:0/4202339000 conn(0x556428eed220 msgr2=0x556428efa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:02.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.381+0000 7fe9cb406740 1 -- 172.21.15.37:0/4202339000 shutdown_connections 2024-08-20T05:16:02.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.381+0000 7fe9cb406740 1 -- 172.21.15.37:0/4202339000 wait complete. 2024-08-20T05:16:02.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.382+0000 7fe9cb406740 1 -- start start 2024-08-20T05:16:02.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.382+0000 7fe9cb406740 1 Processor -- start 2024-08-20T05:16:02.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.384+0000 7fe9cb406740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eef3f0 0x556428f04060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.385+0000 7fe9cb406740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428eefd10 0x556428ef5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.385+0000 7fe9cb406740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428efbca0 0x556428ef5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.385+0000 7fe9cb406740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c41bfb90 con 0x556428eef3f0 2024-08-20T05:16:02.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.385+0000 7fe9cb406740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c41bf460 con 0x556428eefd10 2024-08-20T05:16:02.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.385+0000 7fe9cb406740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c41bc6a0 con 0x556428efbca0 2024-08-20T05:16:02.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.385+0000 7fe9cb406740 10 client.0 _ll_register_callbacks cb 0x7fe9b400d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:02.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.387+0000 7fe9c1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428eefd10 0x556428ef5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:02.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.387+0000 7fe9c1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428eefd10 0x556428ef5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42970/0 (socket says 172.21.15.37:42970) 2024-08-20T05:16:02.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.387+0000 7fe9c1400640 1 -- 172.21.15.37:0/1575552720 learned_addr learned my addr 172.21.15.37:0/1575552720 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:02.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.387+0000 7fe9c2800640 1 --2- 172.21.15.37:0/1575552720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eef3f0 0x556428f04060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:02.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.388+0000 7fe9c2800640 1 --2- 172.21.15.37:0/1575552720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428efbca0 0x556428ef5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:02.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.389+0000 7fe9c1400640 1 -- 172.21.15.37:0/1575552720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428efbca0 msgr2=0x556428ef5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:02.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.389+0000 7fe9c1400640 1 --2- 172.21.15.37:0/1575552720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428efbca0 0x556428ef5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.389+0000 7fe9c1400640 1 -- 172.21.15.37:0/1575552720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eef3f0 msgr2=0x556428f04060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:02.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.390+0000 7fe9c1400640 1 --2- 172.21.15.37:0/1575552720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eef3f0 0x556428f04060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.390+0000 7fe9c1400640 1 -- 172.21.15.37:0/1575552720 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556428eefb40 con 0x556428eefd10 2024-08-20T05:16:02.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.390+0000 7fe9c2800640 1 --2- 172.21.15.37:0/1575552720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428efbca0 0x556428ef5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:16:02.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.391+0000 7fe9c1400640 1 --2- 172.21.15.37:0/1575552720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428eefd10 0x556428ef5820 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac005b90 tx=0x7fe9ac0043e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acc4164848180737 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:02.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.391+0000 7fe9a7400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:16:02.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.392+0000 7fe9a7400640 1 -- 172.21.15.37:0/1575552720 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac061070 con 0x556428eefd10 2024-08-20T05:16:02.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.392+0000 7fe9a7400640 1 -- 172.21.15.37:0/1575552720 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fe9ac032c40 con 0x556428eefd10 2024-08-20T05:16:02.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.392+0000 7fe9cb406740 1 -- 172.21.15.37:0/1575552720 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9ac005d10 con 0x556428eefd10 2024-08-20T05:16:02.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.392+0000 7fe9a7400640 1 -- 172.21.15.37:0/1575552720 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe9ac035040 con 0x556428eefd10 2024-08-20T05:16:02.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.393+0000 7fe9cb406740 10 client.28778 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:02.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.393+0000 7fe9cb406740 1 -- 172.21.15.37:0/1575552720 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x556428f760a0 con 0x556428eefd10 2024-08-20T05:16:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.393+0000 7fe9a7400640 1 -- 172.21.15.37:0/1575552720 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9ac005d10 con 0x556428eefd10 2024-08-20T05:16:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.393+0000 7fe9a7400640 1 -- 172.21.15.37:0/1575552720 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fe9ac057070 con 0x556428eefd10 2024-08-20T05:16:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.394+0000 7fe9cb406740 10 client.28778 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.394+0000 7fe9cb406740 10 client.28778 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:16:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.394+0000 7fe9cb406740 20 client.28778 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.394+0000 7fe9cb406740 1 --2- 172.21.15.37:0/1575552720 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556428f762c0 0x556428f786e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:02.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.394+0000 7fe9cb406740 4 client.28778 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.4, "await_for": 45.0}] 2024-08-20T05:16:02.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.394+0000 7fe9cb406740 1 -- 172.21.15.37:0/1575552720 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.4, "await_for": 45.0}) -- 0x556428e611b0 con 0x556428f762c0 2024-08-20T05:16:02.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.396+0000 7fe9c2800640 1 --2- 172.21.15.37:0/1575552720 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556428f762c0 0x556428f786e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:02.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.397+0000 7fe9c2800640 1 --2- 172.21.15.37:0/1575552720 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556428f762c0 0x556428f786e0 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2cc2f6f8b4e78e9 server_cookie=66b63fbbf34d51f2 in_seq=0 out_seq=0 2024-08-20T05:16:02.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.397+0000 7fe9a7400640 10 client.28778 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.727+0000 7fe9a7400640 1 -- 172.21.15.37:0/1575552720 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x556428e611b0 con 0x556428f762c0 2024-08-20T05:16:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.727+0000 7fe9a7400640 10 client.28778 handle_command_reply: tid=0 2024-08-20T05:16:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.727+0000 7fe9cb406740 1 client.28778 shutdown 2024-08-20T05:16:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.727+0000 7fe9cb406740 1 -- 172.21.15.37:0/1575552720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428eefd10 msgr2=0x556428ef5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.727+0000 7fe9cb406740 1 --2- 172.21.15.37:0/1575552720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428eefd10 0x556428ef5820 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac005b90 tx=0x7fe9ac0043e0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.728+0000 7fe9cb406740 1 -- 172.21.15.37:0/1575552720 shutdown_connections 2024-08-20T05:16:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.728+0000 7fe9cb406740 1 --2- 172.21.15.37:0/1575552720 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556428f762c0 0x556428f786e0 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.728+0000 7fe9cb406740 1 --2- 172.21.15.37:0/1575552720 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556428efbca0 0x556428ef5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.728+0000 7fe9cb406740 1 --2- 172.21.15.37:0/1575552720 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556428eefd10 0x556428ef5820 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.728+0000 7fe9cb406740 1 --2- 172.21.15.37:0/1575552720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556428eef3f0 0x556428f04060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.728+0000 7fe9a7400640 0 client.28778 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.728+0000 7fe9cb406740 1 -- 172.21.15.37:0/1575552720 >> 172.21.15.37:0/1575552720 conn(0x556428eed220 msgr2=0x556428eec3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.728+0000 7fe9cb406740 1 -- 172.21.15.37:0/1575552720 shutdown_connections 2024-08-20T05:16:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.728+0000 7fe9cb406740 1 -- 172.21.15.37:0/1575552720 wait complete. 2024-08-20T05:16:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.728+0000 7fe9cb406740 20 client.28778 trim_cache size 0 max 16384 2024-08-20T05:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 50, 2024-08-20T05:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 50, 2024-08-20T05:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "97d547b2": { 2024-08-20T05:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 50, 2024-08-20T05:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 141.4, 2024-08-20T05:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:16:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:16:02.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.729+0000 7fe9c8a00640 1 -- 172.21.15.37:0/1264049307 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9a80b3de0 msgr2=0x7fe9a80b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:02.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.729+0000 7fe9c8a00640 1 --2- 172.21.15.37:0/1264049307 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9a80b3de0 0x7fe9a80b62a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc000f80 tx=0x7fe9bc0104d0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.729+0000 7fe9c8a00640 1 -- 172.21.15.37:0/1264049307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c4104cb0 msgr2=0x7fe9c41117e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.729+0000 7fe9c8a00640 1 --2- 172.21.15.37:0/1264049307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c4104cb0 0x7fe9c41117e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc00eab0 tx=0x7fe9bc00ef70 comp rx=0 tx=0).stop 2024-08-20T05:16:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.729+0000 7fe9c8a00640 1 -- 172.21.15.37:0/1264049307 shutdown_connections 2024-08-20T05:16:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.729+0000 7fe9c8a00640 1 --2- 172.21.15.37:0/1264049307 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fe9a80b3de0 0x7fe9a80b62a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.729+0000 7fe9c8a00640 1 --2- 172.21.15.37:0/1264049307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9c410b040 0x7fe9c410fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.729+0000 7fe9c8a00640 1 --2- 172.21.15.37:0/1264049307 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fe9c410a6c0 0x7fe9c411c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.729+0000 7fe9c8a00640 1 --2- 172.21.15.37:0/1264049307 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fe9c4104cb0 0x7fe9c41117e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.729+0000 7fe9c8a00640 1 -- 172.21.15.37:0/1264049307 >> 172.21.15.37:0/1264049307 conn(0x7fe9c4100720 msgr2=0x7fe9c4102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.729+0000 7fe9c8a00640 1 -- 172.21.15.37:0/1264049307 shutdown_connections 2024-08-20T05:16:02.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:02.729+0000 7fe9c8a00640 1 -- 172.21.15.37:0/1264049307 wait complete. 2024-08-20T05:16:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 785.0 s, 522.1 tps, lat 174.630 ms stddev 218.706 2024-08-20T05:16:03.674 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '97d547b2', quiesce took 8.9 seconds. Will release after: 12.499999999999998 2024-08-20T05:16:03.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:03 smithi135 ceph-mon[22342]: pgmap v815: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 5.8 MiB/s wr, 630 op/s 2024-08-20T05:16:03.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:03 smithi130 ceph-mon[22007]: pgmap v815: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 5.8 MiB/s wr, 630 op/s 2024-08-20T05:16:04.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:03 smithi037 ceph-mon[17265]: pgmap v815: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 5.8 MiB/s wr, 630 op/s 2024-08-20T05:16:05.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:05 smithi135 ceph-mon[22342]: pgmap v816: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 5.6 MiB/s wr, 611 op/s 2024-08-20T05:16:05.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:05 smithi130 ceph-mon[22007]: pgmap v816: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 5.6 MiB/s wr, 611 op/s 2024-08-20T05:16:06.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:05 smithi037 ceph-mon[17265]: pgmap v816: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 5.6 MiB/s wr, 611 op/s 2024-08-20T05:16:07.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:07 smithi135 ceph-mon[22342]: pgmap v817: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 5.2 MiB/s wr, 518 op/s 2024-08-20T05:16:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:07 smithi130 ceph-mon[22007]: pgmap v817: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 5.2 MiB/s wr, 518 op/s 2024-08-20T05:16:08.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:07 smithi037 ceph-mon[17265]: pgmap v817: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 5.2 MiB/s wr, 518 op/s 2024-08-20T05:16:08.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 790.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:16:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.702+0000 7fbee0200640 1 -- 172.21.15.37:0/2459237479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbed8104190 msgr2=0x7fbed810ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.702+0000 7fbee0200640 1 --2- 172.21.15.37:0/2459237479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbed8104190 0x7fbed810ab10 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009cd0 tx=0x7fbed002a8f0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.702+0000 7fbee0200640 1 -- 172.21.15.37:0/2459237479 shutdown_connections 2024-08-20T05:16:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.702+0000 7fbee0200640 1 --2- 172.21.15.37:0/2459237479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbed8104190 0x7fbed810ab10 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.702+0000 7fbee0200640 1 --2- 172.21.15.37:0/2459237479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbed81037d0 0x7fbed8103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.702+0000 7fbee0200640 1 --2- 172.21.15.37:0/2459237479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbed8102680 0x7fbed8102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.702+0000 7fbee0200640 1 -- 172.21.15.37:0/2459237479 >> 172.21.15.37:0/2459237479 conn(0x7fbed80fdf40 msgr2=0x7fbed8100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.702+0000 7fbee0200640 1 -- 172.21.15.37:0/2459237479 shutdown_connections 2024-08-20T05:16:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.702+0000 7fbee0200640 1 -- 172.21.15.37:0/2459237479 wait complete. 2024-08-20T05:16:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.703+0000 7fbee0200640 1 Processor -- start 2024-08-20T05:16:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.703+0000 7fbee0200640 1 -- start start 2024-08-20T05:16:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.704+0000 7fbee0200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbed8102680 0x7fbed8198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.704+0000 7fbee0200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbed81037d0 0x7fbed81990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.704+0000 7fbee0200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbed8104190 0x7fbed8199cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.704+0000 7fbee0200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbed810e340 con 0x7fbed8102680 2024-08-20T05:16:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.704+0000 7fbee0200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbed810e1c0 con 0x7fbed81037d0 2024-08-20T05:16:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.704+0000 7fbee0200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbed810e4c0 con 0x7fbed8104190 2024-08-20T05:16:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.704+0000 7fbedd800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbed8102680 0x7fbed8198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.704+0000 7fbedce00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbed81037d0 0x7fbed81990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.704+0000 7fbedd800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbed8102680 0x7fbed8198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43214/0 (socket says 172.21.15.37:43214) 2024-08-20T05:16:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.704+0000 7fbedd800640 1 -- 172.21.15.37:0/2877233878 learned_addr learned my addr 172.21.15.37:0/2877233878 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.704+0000 7fbede200640 1 --2- 172.21.15.37:0/2877233878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbed8104190 0x7fbed8199cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.704+0000 7fbedce00640 1 -- 172.21.15.37:0/2877233878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbed8104190 msgr2=0x7fbed8199cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.704+0000 7fbedce00640 1 --2- 172.21.15.37:0/2877233878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbed8104190 0x7fbed8199cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.704+0000 7fbedce00640 1 -- 172.21.15.37:0/2877233878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbed8102680 msgr2=0x7fbed8198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.704+0000 7fbedce00640 1 --2- 172.21.15.37:0/2877233878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbed8102680 0x7fbed8198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.704+0000 7fbedce00640 1 -- 172.21.15.37:0/2877233878 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed819a5b0 con 0x7fbed81037d0 2024-08-20T05:16:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.704+0000 7fbedd800640 1 --2- 172.21.15.37:0/2877233878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbed8102680 0x7fbed8198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.705+0000 7fbedce00640 1 --2- 172.21.15.37:0/2877233878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbed81037d0 0x7fbed81990c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbec400e9f0 tx=0x7fbec400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.705+0000 7fbed6000640 1 -- 172.21.15.37:0/2877233878 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec400ccc0 con 0x7fbed81037d0 2024-08-20T05:16:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.705+0000 7fbed6000640 1 -- 172.21.15.37:0/2877233878 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbec4005020 con 0x7fbed81037d0 2024-08-20T05:16:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.705+0000 7fbee0200640 1 -- 172.21.15.37:0/2877233878 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed819a8a0 con 0x7fbed81037d0 2024-08-20T05:16:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.705+0000 7fbed6000640 1 -- 172.21.15.37:0/2877233878 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec4004a00 con 0x7fbed81037d0 2024-08-20T05:16:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.705+0000 7fbee0200640 1 -- 172.21.15.37:0/2877233878 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed81a0f70 con 0x7fbed81037d0 2024-08-20T05:16:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.708+0000 7fbee31e9740 1 Processor -- start 2024-08-20T05:16:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.708+0000 7fbee31e9740 1 -- start start 2024-08-20T05:16:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.708+0000 7fbee31e9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f656c0 0x560083f67ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.708+0000 7fbee31e9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f67ff0 0x560083f6a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.709+0000 7fbee31e9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f6aa30 0x560083f6cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.709+0000 7fbee31e9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560083ed4210 con 0x560083f67ff0 2024-08-20T05:16:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.709+0000 7fbee31e9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560083ec3710 con 0x560083f656c0 2024-08-20T05:16:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.709+0000 7fbee31e9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560083ec7750 con 0x560083f6aa30 2024-08-20T05:16:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.709+0000 7fbed6000640 1 -- 172.21.15.37:0/2877233878 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fbec4004ba0 con 0x7fbed81037d0 2024-08-20T05:16:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.709+0000 7fbedd800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f67ff0 0x560083f6a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.709+0000 7fbedd800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f67ff0 0x560083f6a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43216/0 (socket says 172.21.15.37:43216) 2024-08-20T05:16:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.709+0000 7fbedd800640 1 -- 172.21.15.37:0/1473764192 learned_addr learned my addr 172.21.15.37:0/1473764192 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.709+0000 7fbede200640 1 --2- 172.21.15.37:0/1473764192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f656c0 0x560083f67ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.709+0000 7fbedce00640 1 --2- 172.21.15.37:0/1473764192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f6aa30 0x560083f6cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.709+0000 7fbedd800640 1 -- 172.21.15.37:0/1473764192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f6aa30 msgr2=0x560083f6cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.709+0000 7fbedd800640 1 --2- 172.21.15.37:0/1473764192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f6aa30 0x560083f6cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.709+0000 7fbedd800640 1 -- 172.21.15.37:0/1473764192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f656c0 msgr2=0x560083f67ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.709+0000 7fbedd800640 1 --2- 172.21.15.37:0/1473764192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f656c0 0x560083f67ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.709+0000 7fbedd800640 1 -- 172.21.15.37:0/1473764192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560083e8fde0 con 0x560083f67ff0 2024-08-20T05:16:09.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.709+0000 7fbedce00640 1 --2- 172.21.15.37:0/1473764192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f6aa30 0x560083f6cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:16:09.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.709+0000 7fbede200640 1 --2- 172.21.15.37:0/1473764192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f656c0 0x560083f67ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:09.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.710+0000 7fbedd800640 1 --2- 172.21.15.37:0/1473764192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f67ff0 0x560083f6a3e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009fd0 tx=0x7fbecc011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476fee0b6d2c01b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:09.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.710+0000 7fbecaa00640 1 -- 172.21.15.37:0/1473764192 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc01e070 con 0x560083f67ff0 2024-08-20T05:16:09.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.710+0000 7fbecaa00640 1 -- 172.21.15.37:0/1473764192 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbecc00fba0 con 0x560083f67ff0 2024-08-20T05:16:09.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.710+0000 7fbecaa00640 1 -- 172.21.15.37:0/1473764192 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc019cc0 con 0x560083f67ff0 2024-08-20T05:16:09.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.710+0000 7fbed6000640 1 --2- 172.21.15.37:0/2877233878 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbec00b3bd0 0x7fbec00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.711+0000 7fbee31e9740 1 -- 172.21.15.37:0/1473764192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f67ff0 msgr2=0x560083f6a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.711+0000 7fbee31e9740 1 --2- 172.21.15.37:0/1473764192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f67ff0 0x560083f6a3e0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009fd0 tx=0x7fbecc011ae0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.711+0000 7fbed6000640 1 -- 172.21.15.37:0/2877233878 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbec40e3fe0 con 0x7fbed81037d0 2024-08-20T05:16:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.711+0000 7fbede200640 1 --2- 172.21.15.37:0/2877233878 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbec00b3bd0 0x7fbec00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.711+0000 7fbee31e9740 1 -- 172.21.15.37:0/1473764192 shutdown_connections 2024-08-20T05:16:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.711+0000 7fbee31e9740 1 --2- 172.21.15.37:0/1473764192 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f6aa30 0x560083f6cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.711+0000 7fbee31e9740 1 --2- 172.21.15.37:0/1473764192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f67ff0 0x560083f6a3e0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.711+0000 7fbee31e9740 1 --2- 172.21.15.37:0/1473764192 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f656c0 0x560083f67ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.711+0000 7fbee31e9740 1 -- 172.21.15.37:0/1473764192 >> 172.21.15.37:0/1473764192 conn(0x560083f607c0 msgr2=0x560083f615a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.711+0000 7fbee31e9740 1 -- 172.21.15.37:0/1473764192 shutdown_connections 2024-08-20T05:16:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.711+0000 7fbee31e9740 1 -- 172.21.15.37:0/1473764192 wait complete. 2024-08-20T05:16:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.711+0000 7fbee31e9740 1 -- start start 2024-08-20T05:16:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.712+0000 7fbede200640 1 --2- 172.21.15.37:0/2877233878 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbec00b3bd0 0x7fbec00b6090 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbed0005e30 tx=0x7fbed0030800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.712+0000 7fbee31e9740 1 Processor -- start 2024-08-20T05:16:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.712+0000 7fbee31e9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f656c0 0x560083f6f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.712+0000 7fbee31e9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f67ff0 0x560083f6f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.712+0000 7fbee31e9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f6aa30 0x560083f70360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.712+0000 7fbee31e9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560083dfcab0 con 0x560083f6aa30 2024-08-20T05:16:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.712+0000 7fbee31e9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560083e6a140 con 0x560083f656c0 2024-08-20T05:16:09.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.712+0000 7fbee31e9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560083f6da10 con 0x560083f67ff0 2024-08-20T05:16:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.712+0000 7fbee31e9740 10 client.0 _ll_register_callbacks cb 0x560083e7d5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.713+0000 7fbedd800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f656c0 0x560083f6f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.713+0000 7fbede200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f6aa30 0x560083f70360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.713+0000 7fbedd800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f656c0 0x560083f6f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:43718/0 (socket says 172.21.15.37:43718) 2024-08-20T05:16:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.713+0000 7fbedd800640 1 -- 172.21.15.37:0/2458154999 learned_addr learned my addr 172.21.15.37:0/2458154999 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.713+0000 7fbedce00640 1 --2- 172.21.15.37:0/2458154999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f67ff0 0x560083f6f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.713+0000 7fbedd800640 1 -- 172.21.15.37:0/2458154999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f67ff0 msgr2=0x560083f6f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.713+0000 7fbedd800640 1 --2- 172.21.15.37:0/2458154999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f67ff0 0x560083f6f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.713+0000 7fbedd800640 1 -- 172.21.15.37:0/2458154999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f6aa30 msgr2=0x560083f70360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.713+0000 7fbedd800640 1 --2- 172.21.15.37:0/2458154999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f6aa30 0x560083f70360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.713+0000 7fbedd800640 1 -- 172.21.15.37:0/2458154999 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560083e6b170 con 0x560083f656c0 2024-08-20T05:16:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.713+0000 7fbedd800640 1 --2- 172.21.15.37:0/2458154999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f656c0 0x560083f6f0f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbecc005270 tx=0x7fbecc0052a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb568aefd0207b43 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.713+0000 7fbebf400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:16:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.714+0000 7fbebf400640 1 -- 172.21.15.37:0/2458154999 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc027060 con 0x560083f656c0 2024-08-20T05:16:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.714+0000 7fbee31e9740 1 -- 172.21.15.37:0/2458154999 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560083e9aa30 con 0x560083f656c0 2024-08-20T05:16:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.714+0000 7fbebf400640 1 -- 172.21.15.37:0/2458154999 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbecc01ae00 con 0x560083f656c0 2024-08-20T05:16:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.714+0000 7fbebf400640 1 -- 172.21.15.37:0/2458154999 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fbecc02e050 con 0x560083f656c0 2024-08-20T05:16:09.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.714+0000 7fbee31e9740 10 client.28790 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.714+0000 7fbee31e9740 1 -- 172.21.15.37:0/2458154999 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x560083c26790 con 0x560083f656c0 2024-08-20T05:16:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.714+0000 7fbebf400640 1 -- 172.21.15.37:0/2458154999 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560083e9aa30 con 0x560083f656c0 2024-08-20T05:16:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.714+0000 7fbebf400640 1 -- 172.21.15.37:0/2458154999 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fbecc021030 con 0x560083f656c0 2024-08-20T05:16:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.714+0000 7fbee31e9740 10 client.28790 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.714+0000 7fbee31e9740 10 client.28790 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:16:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.714+0000 7fbee31e9740 20 client.28790 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.714+0000 7fbee31e9740 1 --2- 172.21.15.37:0/2458154999 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560083f7aa30 0x560083f7ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.714+0000 7fbee31e9740 4 client.28790 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:16:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.714+0000 7fbee31e9740 1 -- 172.21.15.37:0/2458154999 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560083ed6160 con 0x560083f7aa30 2024-08-20T05:16:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.715+0000 7fbedce00640 1 --2- 172.21.15.37:0/2458154999 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560083f7aa30 0x560083f7ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.715+0000 7fbedce00640 1 --2- 172.21.15.37:0/2458154999 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560083f7aa30 0x560083f7ce40 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf78f6fedf5f4804 server_cookie=744cc31c6609bb47 in_seq=0 out_seq=0 2024-08-20T05:16:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.715+0000 7fbebf400640 10 client.28790 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:09.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.716+0000 7fbebf400640 1 -- 172.21.15.37:0/2458154999 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560083ed6160 con 0x560083f7aa30 2024-08-20T05:16:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.716+0000 7fbebf400640 10 client.28790 handle_command_reply: tid=0 2024-08-20T05:16:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.716+0000 7fbee31e9740 1 client.28790 shutdown 2024-08-20T05:16:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.716+0000 7fbee31e9740 1 -- 172.21.15.37:0/2458154999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f656c0 msgr2=0x560083f6f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.716+0000 7fbee31e9740 1 --2- 172.21.15.37:0/2458154999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f656c0 0x560083f6f0f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fbecc005270 tx=0x7fbecc0052a0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.716+0000 7fbee31e9740 1 -- 172.21.15.37:0/2458154999 shutdown_connections 2024-08-20T05:16:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.716+0000 7fbee31e9740 1 --2- 172.21.15.37:0/2458154999 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560083f7aa30 0x560083f7ce40 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.716+0000 7fbee31e9740 1 --2- 172.21.15.37:0/2458154999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f6aa30 0x560083f70360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.716+0000 7fbee31e9740 1 --2- 172.21.15.37:0/2458154999 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f67ff0 0x560083f6f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.716+0000 7fbee31e9740 1 --2- 172.21.15.37:0/2458154999 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f656c0 0x560083f6f0f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.716+0000 7fbee31e9740 1 -- 172.21.15.37:0/2458154999 >> 172.21.15.37:0/2458154999 conn(0x560083f607c0 msgr2=0x560083f5b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.716+0000 7fbebf400640 0 client.28790 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.716+0000 7fbee31e9740 1 -- 172.21.15.37:0/2458154999 shutdown_connections 2024-08-20T05:16:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.717+0000 7fbee31e9740 1 -- 172.21.15.37:0/2458154999 wait complete. 2024-08-20T05:16:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.717+0000 7fbee31e9740 20 client.28790 trim_cache size 0 max 16384 2024-08-20T05:16:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.732+0000 7fbee31e9740 1 Processor -- start 2024-08-20T05:16:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.732+0000 7fbee31e9740 1 -- start start 2024-08-20T05:16:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.732+0000 7fbee31e9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f656c0 0x560083f6ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.732+0000 7fbee31e9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f67ff0 0x560083f6ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.732+0000 7fbee31e9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f6aa30 0x560083f6b350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.732+0000 7fbee31e9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbed81a91e0 con 0x560083f67ff0 2024-08-20T05:16:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.732+0000 7fbee31e9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbed81aad80 con 0x560083f6aa30 2024-08-20T05:16:09.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.732+0000 7fbee31e9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbed81a98b0 con 0x560083f656c0 2024-08-20T05:16:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.732+0000 7fbedce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f67ff0 0x560083f6ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.733+0000 7fbedce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f67ff0 0x560083f6ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43226/0 (socket says 172.21.15.37:43226) 2024-08-20T05:16:09.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.733+0000 7fbedce00640 1 -- 172.21.15.37:0/1006468374 learned_addr learned my addr 172.21.15.37:0/1006468374 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.733+0000 7fbede200640 1 --2- 172.21.15.37:0/1006468374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f6aa30 0x560083f6b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.733+0000 7fbedd800640 1 --2- 172.21.15.37:0/1006468374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f656c0 0x560083f6ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.733+0000 7fbedce00640 1 -- 172.21.15.37:0/1006468374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f656c0 msgr2=0x560083f6ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.733+0000 7fbedce00640 1 --2- 172.21.15.37:0/1006468374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f656c0 0x560083f6ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.733+0000 7fbedce00640 1 -- 172.21.15.37:0/1006468374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f6aa30 msgr2=0x560083f6b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.733+0000 7fbedce00640 1 --2- 172.21.15.37:0/1006468374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f6aa30 0x560083f6b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.733+0000 7fbedce00640 1 -- 172.21.15.37:0/1006468374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560083c9f620 con 0x560083f67ff0 2024-08-20T05:16:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.733+0000 7fbedce00640 1 --2- 172.21.15.37:0/1006468374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f67ff0 0x560083f6ae10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fbec40a6bb0 tx=0x7fbec4005460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805ff56eb656ccaa server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.733+0000 7fbeca000640 1 -- 172.21.15.37:0/1006468374 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec40abe60 con 0x560083f67ff0 2024-08-20T05:16:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.733+0000 7fbeca000640 1 -- 172.21.15.37:0/1006468374 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbec40c5460 con 0x560083f67ff0 2024-08-20T05:16:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.733+0000 7fbeca000640 1 -- 172.21.15.37:0/1006468374 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec401c040 con 0x560083f67ff0 2024-08-20T05:16:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.734+0000 7fbee31e9740 1 -- 172.21.15.37:0/1006468374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f67ff0 msgr2=0x560083f6ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.734+0000 7fbee31e9740 1 --2- 172.21.15.37:0/1006468374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f67ff0 0x560083f6ae10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fbec40a6bb0 tx=0x7fbec4005460 comp rx=0 tx=0).stop 2024-08-20T05:16:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.734+0000 7fbee31e9740 1 -- 172.21.15.37:0/1006468374 shutdown_connections 2024-08-20T05:16:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.734+0000 7fbee31e9740 1 --2- 172.21.15.37:0/1006468374 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f6aa30 0x560083f6b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.734+0000 7fbee31e9740 1 --2- 172.21.15.37:0/1006468374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f67ff0 0x560083f6ae10 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.734+0000 7fbee31e9740 1 --2- 172.21.15.37:0/1006468374 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f656c0 0x560083f6ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.734+0000 7fbee31e9740 1 -- 172.21.15.37:0/1006468374 >> 172.21.15.37:0/1006468374 conn(0x560083f607c0 msgr2=0x560083f6e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.734+0000 7fbee31e9740 1 -- 172.21.15.37:0/1006468374 shutdown_connections 2024-08-20T05:16:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.734+0000 7fbee31e9740 1 -- 172.21.15.37:0/1006468374 wait complete. 2024-08-20T05:16:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.734+0000 7fbee31e9740 1 -- start start 2024-08-20T05:16:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.735+0000 7fbee31e9740 1 Processor -- start 2024-08-20T05:16:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.735+0000 7fbee31e9740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f656c0 0x560083f76400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.735+0000 7fbee31e9740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f67ff0 0x560083f76940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.735+0000 7fbee31e9740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f6aa30 0x560083f76e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.735+0000 7fbee31e9740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fbed81aa6b0 con 0x560083f6aa30 2024-08-20T05:16:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.735+0000 7fbee31e9740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fbed81a9f80 con 0x560083f67ff0 2024-08-20T05:16:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.735+0000 7fbee31e9740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fbed81a71c0 con 0x560083f656c0 2024-08-20T05:16:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.735+0000 7fbee31e9740 10 client.0 _ll_register_callbacks cb 0x7fbecc01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.735+0000 7fbede200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f6aa30 0x560083f76e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.735+0000 7fbede200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f6aa30 0x560083f76e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43242/0 (socket says 172.21.15.37:43242) 2024-08-20T05:16:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.735+0000 7fbede200640 1 -- 172.21.15.37:0/2705348117 learned_addr learned my addr 172.21.15.37:0/2705348117 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.735+0000 7fbedd800640 1 --2- 172.21.15.37:0/2705348117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f656c0 0x560083f76400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.735+0000 7fbedce00640 1 --2- 172.21.15.37:0/2705348117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f67ff0 0x560083f76940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.736+0000 7fbede200640 1 -- 172.21.15.37:0/2705348117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f656c0 msgr2=0x560083f76400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.736+0000 7fbede200640 1 --2- 172.21.15.37:0/2705348117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f656c0 0x560083f76400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.736+0000 7fbede200640 1 -- 172.21.15.37:0/2705348117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f67ff0 msgr2=0x560083f76940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.736+0000 7fbede200640 1 --2- 172.21.15.37:0/2705348117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f67ff0 0x560083f76940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.736+0000 7fbede200640 1 -- 172.21.15.37:0/2705348117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560083f774f0 con 0x560083f6aa30 2024-08-20T05:16:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.736+0000 7fbede200640 1 --2- 172.21.15.37:0/2705348117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f6aa30 0x560083f76e80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009ca0 tx=0x7fbed00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6617fa75c81a376e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.736+0000 7fbebf400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:16:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.736+0000 7fbebf400640 1 -- 172.21.15.37:0/2705348117 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbed0058060 con 0x560083f6aa30 2024-08-20T05:16:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.736+0000 7fbebf400640 1 -- 172.21.15.37:0/2705348117 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fbed00318d0 con 0x560083f6aa30 2024-08-20T05:16:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.736+0000 7fbee31e9740 1 -- 172.21.15.37:0/2705348117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbec40c5460 con 0x560083f6aa30 2024-08-20T05:16:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.737+0000 7fbebf400640 1 -- 172.21.15.37:0/2705348117 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fbed005f050 con 0x560083f6aa30 2024-08-20T05:16:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.737+0000 7fbee31e9740 10 client.18138 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.737+0000 7fbee31e9740 1 -- 172.21.15.37:0/2705348117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x560083fe4830 con 0x560083f6aa30 2024-08-20T05:16:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.737+0000 7fbebf400640 1 -- 172.21.15.37:0/2705348117 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbec40c5460 con 0x560083f6aa30 2024-08-20T05:16:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.737+0000 7fbebf400640 1 -- 172.21.15.37:0/2705348117 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fbed0053c70 con 0x560083f6aa30 2024-08-20T05:16:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.737+0000 7fbee31e9740 10 client.18138 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.737+0000 7fbee31e9740 10 client.18138 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:16:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.737+0000 7fbee31e9740 20 client.18138 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.737+0000 7fbee31e9740 1 --2- 172.21.15.37:0/2705348117 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560083fe5210 0x560083fe7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:09.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.737+0000 7fbee31e9740 4 client.18138 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:16:09.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.737+0000 7fbee31e9740 1 -- 172.21.15.37:0/2705348117 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560083ed1c00 con 0x560083fe5210 2024-08-20T05:16:09.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.738+0000 7fbedd800640 1 --2- 172.21.15.37:0/2705348117 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560083fe5210 0x560083fe7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:09.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.738+0000 7fbedd800640 1 --2- 172.21.15.37:0/2705348117 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560083fe5210 0x560083fe7630 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce32a61205a29b33 server_cookie=815b32810f36ec85 in_seq=0 out_seq=0 2024-08-20T05:16:09.745 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.738+0000 7fbebf400640 10 client.18138 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.746+0000 7fbebf400640 1 -- 172.21.15.37:0/2705348117 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560083ed1c00 con 0x560083fe5210 2024-08-20T05:16:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.746+0000 7fbebf400640 10 client.18138 handle_command_reply: tid=0 2024-08-20T05:16:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.746+0000 7fbee31e9740 1 client.18138 shutdown 2024-08-20T05:16:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.747+0000 7fbee31e9740 1 -- 172.21.15.37:0/2705348117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f6aa30 msgr2=0x560083f76e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.747+0000 7fbee31e9740 1 --2- 172.21.15.37:0/2705348117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f6aa30 0x560083f76e80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009ca0 tx=0x7fbed00095c0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.747+0000 7fbee31e9740 1 -- 172.21.15.37:0/2705348117 shutdown_connections 2024-08-20T05:16:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.747+0000 7fbee31e9740 1 --2- 172.21.15.37:0/2705348117 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560083fe5210 0x560083fe7630 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.747+0000 7fbee31e9740 1 --2- 172.21.15.37:0/2705348117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560083f6aa30 0x560083f76e80 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.747+0000 7fbee31e9740 1 --2- 172.21.15.37:0/2705348117 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560083f67ff0 0x560083f76940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.747+0000 7fbee31e9740 1 --2- 172.21.15.37:0/2705348117 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560083f656c0 0x560083f76400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.747+0000 7fbee31e9740 1 -- 172.21.15.37:0/2705348117 >> 172.21.15.37:0/2705348117 conn(0x560083f607c0 msgr2=0x560083f6e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.747+0000 7fbebf400640 0 client.18138 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.747+0000 7fbee31e9740 1 -- 172.21.15.37:0/2705348117 shutdown_connections 2024-08-20T05:16:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.747+0000 7fbee31e9740 1 -- 172.21.15.37:0/2705348117 wait complete. 2024-08-20T05:16:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.747+0000 7fbee31e9740 20 client.18138 trim_cache size 0 max 16384 2024-08-20T05:16:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:16:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:16:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:16:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:16:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.748+0000 7fbee0200640 1 -- 172.21.15.37:0/2877233878 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbec00b3bd0 msgr2=0x7fbec00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.748+0000 7fbee0200640 1 --2- 172.21.15.37:0/2877233878 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbec00b3bd0 0x7fbec00b6090 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbed0005e30 tx=0x7fbed0030800 comp rx=0 tx=0).stop 2024-08-20T05:16:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.748+0000 7fbee0200640 1 -- 172.21.15.37:0/2877233878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbed81037d0 msgr2=0x7fbed81990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.748+0000 7fbee0200640 1 --2- 172.21.15.37:0/2877233878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbed81037d0 0x7fbed81990c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fbec400e9f0 tx=0x7fbec400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.748+0000 7fbee0200640 1 -- 172.21.15.37:0/2877233878 shutdown_connections 2024-08-20T05:16:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.748+0000 7fbee0200640 1 --2- 172.21.15.37:0/2877233878 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fbec00b3bd0 0x7fbec00b6090 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.748+0000 7fbee0200640 1 --2- 172.21.15.37:0/2877233878 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fbed8104190 0x7fbed8199cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.748+0000 7fbee0200640 1 --2- 172.21.15.37:0/2877233878 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fbed81037d0 0x7fbed81990c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.748+0000 7fbee0200640 1 --2- 172.21.15.37:0/2877233878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbed8102680 0x7fbed8198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.748+0000 7fbee0200640 1 -- 172.21.15.37:0/2877233878 >> 172.21.15.37:0/2877233878 conn(0x7fbed80fdf40 msgr2=0x7fbed8106af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.748+0000 7fbee0200640 1 -- 172.21.15.37:0/2877233878 shutdown_connections 2024-08-20T05:16:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:09.748+0000 7fbee0200640 1 -- 172.21.15.37:0/2877233878 wait complete. 2024-08-20T05:16:09.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:09 smithi135 ceph-mon[22342]: pgmap v818: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 3.6 MiB/s wr, 417 op/s 2024-08-20T05:16:09.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:09 smithi130 ceph-mon[22007]: pgmap v818: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 3.6 MiB/s wr, 417 op/s 2024-08-20T05:16:10.018 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:09 smithi037 ceph-mon[17265]: pgmap v818: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 3.6 MiB/s wr, 417 op/s 2024-08-20T05:16:11.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:11 smithi135 ceph-mon[22342]: pgmap v819: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 2.8 MiB/s wr, 308 op/s 2024-08-20T05:16:11.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:11 smithi130 ceph-mon[22007]: pgmap v819: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 2.8 MiB/s wr, 308 op/s 2024-08-20T05:16:12.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:11 smithi037 ceph-mon[17265]: pgmap v819: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 2.8 MiB/s wr, 308 op/s 2024-08-20T05:16:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 795.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:16:13.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:13 smithi135 ceph-mon[22342]: pgmap v820: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 2.2 MiB/s wr, 227 op/s 2024-08-20T05:16:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:13 smithi130 ceph-mon[22007]: pgmap v820: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 2.2 MiB/s wr, 227 op/s 2024-08-20T05:16:14.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:13 smithi037 ceph-mon[17265]: pgmap v820: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 2.2 MiB/s wr, 227 op/s 2024-08-20T05:16:15.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:15 smithi037 ceph-mon[17265]: pgmap v821: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 1.1 MiB/s wr, 134 op/s 2024-08-20T05:16:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:15 smithi135 ceph-mon[22342]: pgmap v821: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 1.1 MiB/s wr, 134 op/s 2024-08-20T05:16:15.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:15 smithi130 ceph-mon[22007]: pgmap v821: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 1.1 MiB/s wr, 134 op/s 2024-08-20T05:16:16.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:16:16.579 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:16:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.344+0000 7fadb2200640 1 -- 172.21.15.37:0/3023729050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadac101500 msgr2=0x7fadac1018e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.344+0000 7fadb2200640 1 --2- 172.21.15.37:0/3023729050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadac101500 0x7fadac1018e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009930 tx=0x7fad9c02a420 comp rx=0 tx=0).stop 2024-08-20T05:16:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.344+0000 7fadb2200640 1 -- 172.21.15.37:0/3023729050 shutdown_connections 2024-08-20T05:16:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.344+0000 7fadb2200640 1 --2- 172.21.15.37:0/3023729050 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadac108f80 0x7fadac10f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.344+0000 7fadb2200640 1 --2- 172.21.15.37:0/3023729050 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadac108600 0x7fadac108a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:17.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.344+0000 7fadb2200640 1 --2- 172.21.15.37:0/3023729050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadac101500 0x7fadac1018e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:17.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.344+0000 7fadb2200640 1 -- 172.21.15.37:0/3023729050 >> 172.21.15.37:0/3023729050 conn(0x7fadac076cc0 msgr2=0x7fadac0770d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:17.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.344+0000 7fadb2200640 1 -- 172.21.15.37:0/3023729050 shutdown_connections 2024-08-20T05:16:17.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.344+0000 7fadb2200640 1 -- 172.21.15.37:0/3023729050 wait complete. 2024-08-20T05:16:17.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.345+0000 7fadb2200640 1 Processor -- start 2024-08-20T05:16:17.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.345+0000 7fadb2200640 1 -- start start 2024-08-20T05:16:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.346+0000 7fadb2200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadac101500 0x7fadac19b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.346+0000 7fadb2200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadac108600 0x7fadac19b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.346+0000 7fadb2200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadac108f80 0x7fadac1a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:17.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.346+0000 7fadb2200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fadac112b40 con 0x7fadac108f80 2024-08-20T05:16:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.346+0000 7fadb2200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fadac1129c0 con 0x7fadac108600 2024-08-20T05:16:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.346+0000 7fadb2200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fadac112cc0 con 0x7fadac101500 2024-08-20T05:16:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.346+0000 7fadabe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadac108f80 0x7fadac1a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.346+0000 7fadabe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadac108f80 0x7fadac1a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48638/0 (socket says 172.21.15.37:48638) 2024-08-20T05:16:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.346+0000 7fadabe00640 1 -- 172.21.15.37:0/3405669457 learned_addr learned my addr 172.21.15.37:0/3405669457 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.346+0000 7fada2a00640 1 --2- 172.21.15.37:0/3405669457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadac108600 0x7fadac19b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.346+0000 7fadab400640 1 --2- 172.21.15.37:0/3405669457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadac101500 0x7fadac19b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.347+0000 7fadabe00640 1 -- 172.21.15.37:0/3405669457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadac101500 msgr2=0x7fadac19b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.347+0000 7fadabe00640 1 --2- 172.21.15.37:0/3405669457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadac101500 0x7fadac19b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.347+0000 7fadabe00640 1 -- 172.21.15.37:0/3405669457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadac108600 msgr2=0x7fadac19b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.347+0000 7fadabe00640 1 --2- 172.21.15.37:0/3405669457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadac108600 0x7fadac19b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:17.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.347+0000 7fadabe00640 1 -- 172.21.15.37:0/3405669457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadac1a12a0 con 0x7fadac108f80 2024-08-20T05:16:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.347+0000 7fada2a00640 1 --2- 172.21.15.37:0/3405669457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadac108600 0x7fadac19b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.347+0000 7fadabe00640 1 --2- 172.21.15.37:0/3405669457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadac108f80 0x7fadac1a0ad0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fada400eaa0 tx=0x7fada400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.347+0000 7fada8c00640 1 -- 172.21.15.37:0/3405669457 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada400cdb0 con 0x7fadac108f80 2024-08-20T05:16:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.347+0000 7fadb2200640 1 -- 172.21.15.37:0/3405669457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadac1a1590 con 0x7fadac108f80 2024-08-20T05:16:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.347+0000 7fada8c00640 1 -- 172.21.15.37:0/3405669457 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fada4005020 con 0x7fadac108f80 2024-08-20T05:16:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.347+0000 7fada8c00640 1 -- 172.21.15.37:0/3405669457 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada40116d0 con 0x7fadac108f80 2024-08-20T05:16:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.347+0000 7fadb2200640 1 -- 172.21.15.37:0/3405669457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadac1a7c50 con 0x7fadac108f80 2024-08-20T05:16:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.349+0000 7fadb2200640 1 -- 172.21.15.37:0/3405669457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadac1018e0 con 0x7fadac108f80 2024-08-20T05:16:17.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.351+0000 7fada8c00640 1 -- 172.21.15.37:0/3405669457 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fada40051d0 con 0x7fadac108f80 2024-08-20T05:16:17.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.352+0000 7fada8c00640 1 --2- 172.21.15.37:0/3405669457 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad900b3c50 0x7fad900b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:17.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.352+0000 7fada8c00640 1 -- 172.21.15.37:0/3405669457 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fada40e40b0 con 0x7fadac108f80 2024-08-20T05:16:17.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.352+0000 7fadab400640 1 --2- 172.21.15.37:0/3405669457 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad900b3c50 0x7fad900b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:17.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.353+0000 7fadab400640 1 --2- 172.21.15.37:0/3405669457 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad900b3c50 0x7fad900b6110 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fad9c031440 tx=0x7fad9c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:17.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.357+0000 7fada8c00640 1 -- 172.21.15.37:0/3405669457 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fada4016030 con 0x7fadac108f80 2024-08-20T05:16:17.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.591+0000 7fadb2200640 1 -- 172.21.15.37:0/3405669457 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fadac1a7fb0 con 0x7fadac108f80 2024-08-20T05:16:17.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.592+0000 7fada8c00640 1 -- 172.21.15.37:0/3405669457 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11983 (secure 0 0 0) 0x7fada40aacb0 con 0x7fadac108f80 2024-08-20T05:16:17.594 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:16:17.594 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":50,"btime":"2024-08-20T05:15:39:521784+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:15:39.110643+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:16:17.597 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 50 2024-08-20T05:16:17.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.594+0000 7fadb2200640 1 -- 172.21.15.37:0/3405669457 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad900b3c50 msgr2=0x7fad900b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:17.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.594+0000 7fadb2200640 1 --2- 172.21.15.37:0/3405669457 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad900b3c50 0x7fad900b6110 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fad9c031440 tx=0x7fad9c005a20 comp rx=0 tx=0).stop 2024-08-20T05:16:17.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.594+0000 7fadb2200640 1 -- 172.21.15.37:0/3405669457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadac108f80 msgr2=0x7fadac1a0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:17.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.594+0000 7fadb2200640 1 --2- 172.21.15.37:0/3405669457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadac108f80 0x7fadac1a0ad0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fada400eaa0 tx=0x7fada400ef60 comp rx=0 tx=0).stop 2024-08-20T05:16:17.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.594+0000 7fadb2200640 1 -- 172.21.15.37:0/3405669457 shutdown_connections 2024-08-20T05:16:17.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.594+0000 7fadb2200640 1 --2- 172.21.15.37:0/3405669457 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fad900b3c50 0x7fad900b6110 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:17.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.594+0000 7fadb2200640 1 --2- 172.21.15.37:0/3405669457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fadac108f80 0x7fadac1a0ad0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:17.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.594+0000 7fadb2200640 1 --2- 172.21.15.37:0/3405669457 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fadac108600 0x7fadac19b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:17.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.594+0000 7fadb2200640 1 --2- 172.21.15.37:0/3405669457 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fadac101500 0x7fadac19b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:17.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.594+0000 7fadb2200640 1 -- 172.21.15.37:0/3405669457 >> 172.21.15.37:0/3405669457 conn(0x7fadac076cc0 msgr2=0x7fadac0ffdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:17.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.595+0000 7fadb2200640 1 -- 172.21.15.37:0/3405669457 shutdown_connections 2024-08-20T05:16:17.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:17.595+0000 7fadb2200640 1 -- 172.21.15.37:0/3405669457 wait complete. 2024-08-20T05:16:17.880 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:17 smithi135 ceph-mon[22342]: pgmap v822: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 559 KiB/s wr, 55 op/s 2024-08-20T05:16:17.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:17 smithi130 ceph-mon[22007]: pgmap v822: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 559 KiB/s wr, 55 op/s 2024-08-20T05:16:18.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:17 smithi037 ceph-mon[17265]: pgmap v822: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 559 KiB/s wr, 55 op/s 2024-08-20T05:16:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 800.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:16:18.522 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id 97d547b2 --release --await' 2024-08-20T05:16:18.522 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id 97d547b2 --release --await 2024-08-20T05:16:18.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:18 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3405669457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:16:18.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:18 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3405669457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:16:18.908 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:16:18.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:18 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3405669457' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:16:19.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.474+0000 7ff1ab000640 1 -- 172.21.15.37:0/2670375790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a4102900 msgr2=0x7ff1a4102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:19.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.474+0000 7ff1ab000640 1 --2- 172.21.15.37:0/2670375790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a4102900 0x7ff1a4102ce0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7ff198009900 tx=0x7ff19802a410 comp rx=0 tx=0).stop 2024-08-20T05:16:19.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.475+0000 7ff1ab000640 1 -- 172.21.15.37:0/2670375790 shutdown_connections 2024-08-20T05:16:19.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.475+0000 7ff1ab000640 1 --2- 172.21.15.37:0/2670375790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1a4108c90 0x7ff1a410f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.475+0000 7ff1ab000640 1 --2- 172.21.15.37:0/2670375790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1a4108310 0x7ff1a4108750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.475+0000 7ff1ab000640 1 --2- 172.21.15.37:0/2670375790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a4102900 0x7ff1a4102ce0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.475+0000 7ff1ab000640 1 -- 172.21.15.37:0/2670375790 >> 172.21.15.37:0/2670375790 conn(0x7ff1a40fe390 msgr2=0x7ff1a41007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:19.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.475+0000 7ff1ab000640 1 -- 172.21.15.37:0/2670375790 shutdown_connections 2024-08-20T05:16:19.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.475+0000 7ff1ab000640 1 -- 172.21.15.37:0/2670375790 wait complete. 2024-08-20T05:16:19.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.476+0000 7ff1ab000640 1 Processor -- start 2024-08-20T05:16:19.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.476+0000 7ff1ab000640 1 -- start start 2024-08-20T05:16:19.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.476+0000 7ff1ab000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1a4102900 0x7ff1a419afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.476+0000 7ff1ab000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a4108310 0x7ff1a419b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.476+0000 7ff1ab000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1a4108c90 0x7ff1a41a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.476+0000 7ff1ab000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a4112950 con 0x7ff1a4108310 2024-08-20T05:16:19.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.476+0000 7ff1ab000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a41127d0 con 0x7ff1a4102900 2024-08-20T05:16:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.476+0000 7ff1ab000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a4112ad0 con 0x7ff1a4108c90 2024-08-20T05:16:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.476+0000 7ff1a9200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a4108310 0x7ff1a419b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.476+0000 7ff1a9200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a4108310 0x7ff1a419b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48654/0 (socket says 172.21.15.37:48654) 2024-08-20T05:16:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.476+0000 7ff1a9c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1a4102900 0x7ff1a419afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.476+0000 7ff1a9200640 1 -- 172.21.15.37:0/1971283522 learned_addr learned my addr 172.21.15.37:0/1971283522 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.477+0000 7ff1aa600640 1 --2- 172.21.15.37:0/1971283522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1a4108c90 0x7ff1a41a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.477+0000 7ff1a9200640 1 -- 172.21.15.37:0/1971283522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1a4108c90 msgr2=0x7ff1a41a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.477+0000 7ff1a9200640 1 --2- 172.21.15.37:0/1971283522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1a4108c90 0x7ff1a41a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.477+0000 7ff1a9200640 1 -- 172.21.15.37:0/1971283522 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1a4102900 msgr2=0x7ff1a419afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.477+0000 7ff1a9200640 1 --2- 172.21.15.37:0/1971283522 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1a4102900 0x7ff1a419afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.477+0000 7ff1a9200640 1 -- 172.21.15.37:0/1971283522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a41a1060 con 0x7ff1a4108310 2024-08-20T05:16:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.477+0000 7ff1a9200640 1 --2- 172.21.15.37:0/1971283522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a4108310 0x7ff1a419b4f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff19000e9f0 tx=0x7ff19000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.477+0000 7ff1a2000640 1 -- 172.21.15.37:0/1971283522 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19000cd80 con 0x7ff1a4108310 2024-08-20T05:16:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.478+0000 7ff1a2000640 1 -- 172.21.15.37:0/1971283522 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1900108e0 con 0x7ff1a4108310 2024-08-20T05:16:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.478+0000 7ff1ab000640 1 -- 172.21.15.37:0/1971283522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a41a1350 con 0x7ff1a4108310 2024-08-20T05:16:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.478+0000 7ff1a2000640 1 -- 172.21.15.37:0/1971283522 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff190018980 con 0x7ff1a4108310 2024-08-20T05:16:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.478+0000 7ff1ab000640 1 -- 172.21.15.37:0/1971283522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a41a7a10 con 0x7ff1a4108310 2024-08-20T05:16:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.481+0000 7ff1af1d7740 1 Processor -- start 2024-08-20T05:16:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.481+0000 7ff1af1d7740 1 -- start start 2024-08-20T05:16:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.481+0000 7ff1a2000640 1 -- 172.21.15.37:0/1971283522 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff190010430 con 0x7ff1a4108310 2024-08-20T05:16:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.482+0000 7ff1af1d7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 0x55b739f8e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.482+0000 7ff1af1d7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f8e7a0 0x55b739f9a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.482+0000 7ff1af1d7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f9a730 0x55b739f9cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.482+0000 7ff1af1d7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b739f2f670 con 0x55b739f8e7a0 2024-08-20T05:16:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.482+0000 7ff1af1d7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b739f03d70 con 0x55b739f8de80 2024-08-20T05:16:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.482+0000 7ff1af1d7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b739ef3270 con 0x55b739f9a730 2024-08-20T05:16:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.482+0000 7ff1a9c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f8e7a0 0x55b739f9a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.482+0000 7ff1a9c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f8e7a0 0x55b739f9a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48658/0 (socket says 172.21.15.37:48658) 2024-08-20T05:16:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.482+0000 7ff1a9c00640 1 -- 172.21.15.37:0/3493941517 learned_addr learned my addr 172.21.15.37:0/3493941517 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:19.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.482+0000 7ff1aa600640 1 --2- 172.21.15.37:0/3493941517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 0x55b739f8e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.482+0000 7ff1a9200640 1 --2- 172.21.15.37:0/3493941517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f9a730 0x55b739f9cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.482+0000 7ff1a9c00640 1 -- 172.21.15.37:0/3493941517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f9a730 msgr2=0x55b739f9cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.482+0000 7ff1a9c00640 1 --2- 172.21.15.37:0/3493941517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f9a730 0x55b739f9cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.483+0000 7ff1a9c00640 1 -- 172.21.15.37:0/3493941517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 msgr2=0x55b739f8e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.483+0000 7ff1a9c00640 1 --2- 172.21.15.37:0/3493941517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 0x55b739f8e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.483+0000 7ff1a9c00640 1 -- 172.21.15.37:0/3493941517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b739e8f870 con 0x55b739f8e7a0 2024-08-20T05:16:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.483+0000 7ff1aa600640 1 --2- 172.21.15.37:0/3493941517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 0x55b739f8e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.483+0000 7ff1a9c00640 1 --2- 172.21.15.37:0/3493941517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f8e7a0 0x55b739f9a1f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff198009900 tx=0x7ff198032b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49071b01bf1b9df server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.483+0000 7ff1a2000640 1 --2- 172.21.15.37:0/1971283522 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff18c0b3c70 0x7ff18c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.483+0000 7ff196a00640 1 -- 172.21.15.37:0/3493941517 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198040070 con 0x55b739f8e7a0 2024-08-20T05:16:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.483+0000 7ff196a00640 1 -- 172.21.15.37:0/3493941517 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff198004030 con 0x55b739f8e7a0 2024-08-20T05:16:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.483+0000 7ff196a00640 1 -- 172.21.15.37:0/3493941517 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198035040 con 0x55b739f8e7a0 2024-08-20T05:16:19.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.483+0000 7ff1a2000640 1 -- 172.21.15.37:0/1971283522 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff1900e4300 con 0x7ff1a4108310 2024-08-20T05:16:19.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.484+0000 7ff1aa600640 1 --2- 172.21.15.37:0/1971283522 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff18c0b3c70 0x7ff18c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.484+0000 7ff1af1d7740 1 -- 172.21.15.37:0/3493941517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f8e7a0 msgr2=0x55b739f9a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.484+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/3493941517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f8e7a0 0x55b739f9a1f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7ff198009900 tx=0x7ff198032b20 comp rx=0 tx=0).stop 2024-08-20T05:16:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.484+0000 7ff1af1d7740 1 -- 172.21.15.37:0/3493941517 shutdown_connections 2024-08-20T05:16:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.484+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/3493941517 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f9a730 0x55b739f9cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.484+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/3493941517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f8e7a0 0x55b739f9a1f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.484+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/3493941517 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 0x55b739f8e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.484+0000 7ff1af1d7740 1 -- 172.21.15.37:0/3493941517 >> 172.21.15.37:0/3493941517 conn(0x55b739f8bcb0 msgr2=0x55b739f8ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.485+0000 7ff1aa600640 1 --2- 172.21.15.37:0/1971283522 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff18c0b3c70 0x7ff18c0b6130 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff19c009fd0 tx=0x7ff19c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.485+0000 7ff1af1d7740 1 -- 172.21.15.37:0/3493941517 shutdown_connections 2024-08-20T05:16:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.485+0000 7ff1af1d7740 1 -- 172.21.15.37:0/3493941517 wait complete. 2024-08-20T05:16:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.485+0000 7ff1af1d7740 1 -- start start 2024-08-20T05:16:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.485+0000 7ff1af1d7740 1 Processor -- start 2024-08-20T05:16:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.486+0000 7ff1af1d7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 0x55b739f99f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.486+0000 7ff1af1d7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f8e7a0 0x55b739f973b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.486+0000 7ff1af1d7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f9a730 0x55b739f978f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.486+0000 7ff1af1d7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b739e79ff0 con 0x55b739f9a730 2024-08-20T05:16:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.486+0000 7ff1af1d7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55b739ef72b0 con 0x55b739f8de80 2024-08-20T05:16:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.486+0000 7ff1af1d7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55b739d55bb0 con 0x55b739f8e7a0 2024-08-20T05:16:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.486+0000 7ff1af1d7740 10 client.0 _ll_register_callbacks cb 0x55b739bfed70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.486+0000 7ff1a9c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 0x55b739f99f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.486+0000 7ff1a9c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 0x55b739f99f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33802/0 (socket says 172.21.15.37:33802) 2024-08-20T05:16:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.486+0000 7ff1aa600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f9a730 0x55b739f978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.486+0000 7ff1a9200640 1 --2- 172.21.15.37:0/1419415558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f8e7a0 0x55b739f973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.486+0000 7ff1a9c00640 1 -- 172.21.15.37:0/1419415558 learned_addr learned my addr 172.21.15.37:0/1419415558 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.487+0000 7ff1a9c00640 1 -- 172.21.15.37:0/1419415558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f8e7a0 msgr2=0x55b739f973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.487+0000 7ff1a9c00640 1 --2- 172.21.15.37:0/1419415558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f8e7a0 0x55b739f973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.487+0000 7ff1a9c00640 1 -- 172.21.15.37:0/1419415558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f9a730 msgr2=0x55b739f978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:19.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.487+0000 7ff1a9c00640 1 --2- 172.21.15.37:0/1419415558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f9a730 0x55b739f978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.487+0000 7ff1a9c00640 1 -- 172.21.15.37:0/1419415558 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b739c52b00 con 0x55b739f8de80 2024-08-20T05:16:19.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.487+0000 7ff1a9200640 1 --2- 172.21.15.37:0/1419415558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f8e7a0 0x55b739f973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:19.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.487+0000 7ff1aa600640 1 --2- 172.21.15.37:0/1419415558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f9a730 0x55b739f978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:19.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.487+0000 7ff1a9c00640 1 --2- 172.21.15.37:0/1419415558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 0x55b739f99f60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff198032ef0 tx=0x7ff198031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c96b49601faacfd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:19.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.487+0000 7ff18b400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:16:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.487+0000 7ff18b400640 1 -- 172.21.15.37:0/1419415558 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198035070 con 0x55b739f8de80 2024-08-20T05:16:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.487+0000 7ff1af1d7740 1 -- 172.21.15.37:0/1419415558 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff198004030 con 0x55b739f8de80 2024-08-20T05:16:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.487+0000 7ff18b400640 1 -- 172.21.15.37:0/1419415558 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff198005430 con 0x55b739f8de80 2024-08-20T05:16:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.487+0000 7ff18b400640 1 -- 172.21.15.37:0/1419415558 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff198058050 con 0x55b739f8de80 2024-08-20T05:16:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.488+0000 7ff1af1d7740 10 client.28814 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.488+0000 7ff1af1d7740 1 -- 172.21.15.37:0/1419415558 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55b739cc9960 con 0x55b739f8de80 2024-08-20T05:16:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.488+0000 7ff18b400640 1 -- 172.21.15.37:0/1419415558 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff198004030 con 0x55b739f8de80 2024-08-20T05:16:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.488+0000 7ff18b400640 1 -- 172.21.15.37:0/1419415558 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7ff198004c10 con 0x55b739f8de80 2024-08-20T05:16:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.488+0000 7ff1af1d7740 10 client.28814 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.488+0000 7ff1af1d7740 10 client.28814 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:16:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.488+0000 7ff1af1d7740 20 client.28814 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.488+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/1419415558 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b739fa9bf0 0x55b739fabfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.488+0000 7ff1af1d7740 4 client.28814 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:16:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.488+0000 7ff1af1d7740 1 -- 172.21.15.37:0/1419415558 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b739f05cc0 con 0x55b739fa9bf0 2024-08-20T05:16:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.488+0000 7ff1a9200640 1 --2- 172.21.15.37:0/1419415558 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b739fa9bf0 0x55b739fabfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.489+0000 7ff1a9200640 1 --2- 172.21.15.37:0/1419415558 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b739fa9bf0 0x55b739fabfe0 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34a8a65385dd87f3 server_cookie=1ab45d4403dd1eb3 in_seq=0 out_seq=0 2024-08-20T05:16:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.489+0000 7ff18b400640 10 client.28814 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.490+0000 7ff18b400640 1 -- 172.21.15.37:0/1419415558 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b739f05cc0 con 0x55b739fa9bf0 2024-08-20T05:16:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.490+0000 7ff18b400640 10 client.28814 handle_command_reply: tid=0 2024-08-20T05:16:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.490+0000 7ff1af1d7740 1 client.28814 shutdown 2024-08-20T05:16:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.490+0000 7ff1af1d7740 1 -- 172.21.15.37:0/1419415558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 msgr2=0x55b739f99f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.490+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/1419415558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 0x55b739f99f60 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff198032ef0 tx=0x7ff198031400 comp rx=0 tx=0).stop 2024-08-20T05:16:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.490+0000 7ff1af1d7740 1 -- 172.21.15.37:0/1419415558 shutdown_connections 2024-08-20T05:16:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.490+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/1419415558 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b739fa9bf0 0x55b739fabfe0 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.490+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/1419415558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f9a730 0x55b739f978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.490+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/1419415558 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f8e7a0 0x55b739f973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.490+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/1419415558 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 0x55b739f99f60 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.490+0000 7ff1af1d7740 1 -- 172.21.15.37:0/1419415558 >> 172.21.15.37:0/1419415558 conn(0x55b739f8bcb0 msgr2=0x55b739f91850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.490+0000 7ff18b400640 0 client.28814 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.490+0000 7ff1af1d7740 1 -- 172.21.15.37:0/1419415558 shutdown_connections 2024-08-20T05:16:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.491+0000 7ff1af1d7740 1 -- 172.21.15.37:0/1419415558 wait complete. 2024-08-20T05:16:19.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.491+0000 7ff1af1d7740 20 client.28814 trim_cache size 0 max 16384 2024-08-20T05:16:19.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.509+0000 7ff1af1d7740 1 Processor -- start 2024-08-20T05:16:19.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.509+0000 7ff1af1d7740 1 -- start start 2024-08-20T05:16:19.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.509+0000 7ff1af1d7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f8de80 0x55b739f990f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.509+0000 7ff1af1d7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8e7a0 0x55b739fb1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.509+0000 7ff1af1d7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f9a730 0x55b739fb1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.509+0000 7ff1af1d7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a41b1820 con 0x55b739f8de80 2024-08-20T05:16:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.509+0000 7ff1af1d7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a41b33c0 con 0x55b739f8e7a0 2024-08-20T05:16:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.509+0000 7ff1af1d7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a41b1ef0 con 0x55b739f9a730 2024-08-20T05:16:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.509+0000 7ff1a9c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f8de80 0x55b739f990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.509+0000 7ff1a9c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f8de80 0x55b739f990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48670/0 (socket says 172.21.15.37:48670) 2024-08-20T05:16:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.509+0000 7ff1a9c00640 1 -- 172.21.15.37:0/3789056456 learned_addr learned my addr 172.21.15.37:0/3789056456 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.509+0000 7ff1a9200640 1 --2- 172.21.15.37:0/3789056456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8e7a0 0x55b739fb1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.510+0000 7ff1aa600640 1 --2- 172.21.15.37:0/3789056456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f9a730 0x55b739fb1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.510+0000 7ff1a9c00640 1 -- 172.21.15.37:0/3789056456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f9a730 msgr2=0x55b739fb1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.510+0000 7ff1a9c00640 1 --2- 172.21.15.37:0/3789056456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f9a730 0x55b739fb1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.510+0000 7ff1a9c00640 1 -- 172.21.15.37:0/3789056456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8e7a0 msgr2=0x55b739fb1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.510+0000 7ff1a9c00640 1 --2- 172.21.15.37:0/3789056456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8e7a0 0x55b739fb1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.510+0000 7ff1a9c00640 1 -- 172.21.15.37:0/3789056456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b739f97160 con 0x55b739f8de80 2024-08-20T05:16:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.510+0000 7ff1a9c00640 1 --2- 172.21.15.37:0/3789056456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f8de80 0x55b739f990f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff198032ec0 tx=0x7ff198005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece0bc48f9538d37 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.510+0000 7ff196000640 1 -- 172.21.15.37:0/3789056456 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198061070 con 0x55b739f8de80 2024-08-20T05:16:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.510+0000 7ff196000640 1 -- 172.21.15.37:0/3789056456 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1980038c0 con 0x55b739f8de80 2024-08-20T05:16:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.511+0000 7ff196000640 1 -- 172.21.15.37:0/3789056456 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198035040 con 0x55b739f8de80 2024-08-20T05:16:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.511+0000 7ff1af1d7740 1 -- 172.21.15.37:0/3789056456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f8de80 msgr2=0x55b739f990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.511+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/3789056456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f8de80 0x55b739f990f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff198032ec0 tx=0x7ff198005fd0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.511+0000 7ff1af1d7740 1 -- 172.21.15.37:0/3789056456 shutdown_connections 2024-08-20T05:16:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.511+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/3789056456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f9a730 0x55b739fb1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.511+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/3789056456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8e7a0 0x55b739fb1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.511+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/3789056456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f8de80 0x55b739f990f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.511+0000 7ff1af1d7740 1 -- 172.21.15.37:0/3789056456 >> 172.21.15.37:0/3789056456 conn(0x55b739f8bcb0 msgr2=0x55b739f989e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.511+0000 7ff1af1d7740 1 -- 172.21.15.37:0/3789056456 shutdown_connections 2024-08-20T05:16:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.511+0000 7ff1af1d7740 1 -- 172.21.15.37:0/3789056456 wait complete. 2024-08-20T05:16:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.512+0000 7ff1af1d7740 1 -- start start 2024-08-20T05:16:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.512+0000 7ff1af1d7740 1 Processor -- start 2024-08-20T05:16:19.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.512+0000 7ff1af1d7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 0x55b739fa2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.512+0000 7ff1af1d7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f8e7a0 0x55b739f9fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.512+0000 7ff1af1d7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f9a730 0x55b739fa0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.512+0000 7ff1af1d7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a41b2cf0 con 0x55b739f9a730 2024-08-20T05:16:19.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.512+0000 7ff1af1d7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a41b25c0 con 0x55b739f8de80 2024-08-20T05:16:19.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.512+0000 7ff1af1d7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a41af800 con 0x55b739f8e7a0 2024-08-20T05:16:19.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.512+0000 7ff1af1d7740 10 client.0 _ll_register_callbacks cb 0x7ff19c009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:19.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.513+0000 7ff1a9c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 0x55b739fa2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.513+0000 7ff1a9c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 0x55b739fa2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33822/0 (socket says 172.21.15.37:33822) 2024-08-20T05:16:19.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.513+0000 7ff1a9c00640 1 -- 172.21.15.37:0/4261111741 learned_addr learned my addr 172.21.15.37:0/4261111741 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:19.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.513+0000 7ff1a9200640 1 --2- 172.21.15.37:0/4261111741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f8e7a0 0x55b739f9fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.513+0000 7ff1aa600640 1 --2- 172.21.15.37:0/4261111741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f9a730 0x55b739fa0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.513+0000 7ff1a9200640 1 -- 172.21.15.37:0/4261111741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 msgr2=0x55b739fa2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:19.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.513+0000 7ff1a9200640 1 --2- 172.21.15.37:0/4261111741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 0x55b739fa2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.513+0000 7ff1a9200640 1 -- 172.21.15.37:0/4261111741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f9a730 msgr2=0x55b739fa0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:19.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.513+0000 7ff1a9200640 1 --2- 172.21.15.37:0/4261111741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f9a730 0x55b739fa0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.513+0000 7ff1a9200640 1 -- 172.21.15.37:0/4261111741 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b739fa0950 con 0x55b739f8e7a0 2024-08-20T05:16:19.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.513+0000 7ff1aa600640 1 --2- 172.21.15.37:0/4261111741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f9a730 0x55b739fa0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:19.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.513+0000 7ff1a9200640 1 --2- 172.21.15.37:0/4261111741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f8e7a0 0x55b739f9fe00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff1900aac00 tx=0x7ff190018420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32d9c99aa51f0d9e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:19.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.513+0000 7ff18b400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:16:19.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.514+0000 7ff18b400640 1 -- 172.21.15.37:0/4261111741 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1900aaf00 con 0x55b739f8e7a0 2024-08-20T05:16:19.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.514+0000 7ff1af1d7740 1 -- 172.21.15.37:0/4261111741 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1980038c0 con 0x55b739f8e7a0 2024-08-20T05:16:19.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.514+0000 7ff18b400640 1 -- 172.21.15.37:0/4261111741 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff1900e7b90 con 0x55b739f8e7a0 2024-08-20T05:16:19.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.514+0000 7ff18b400640 1 -- 172.21.15.37:0/4261111741 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff1900af450 con 0x55b739f8e7a0 2024-08-20T05:16:19.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.514+0000 7ff1af1d7740 10 client.28861 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:19.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.514+0000 7ff1af1d7740 1 -- 172.21.15.37:0/4261111741 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55b73a0143f0 con 0x55b739f8e7a0 2024-08-20T05:16:19.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.514+0000 7ff18b400640 1 -- 172.21.15.37:0/4261111741 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff1980038c0 con 0x55b739f8e7a0 2024-08-20T05:16:19.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.514+0000 7ff18b400640 1 -- 172.21.15.37:0/4261111741 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7ff190018b20 con 0x55b739f8e7a0 2024-08-20T05:16:19.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.514+0000 7ff1af1d7740 10 client.28861 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:19.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.514+0000 7ff1af1d7740 10 client.28861 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:16:19.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.514+0000 7ff1af1d7740 20 client.28861 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:19.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.514+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/4261111741 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b73a014b70 0x55b73a016f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:19.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.514+0000 7ff1af1d7740 4 client.28861 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "97d547b2", "release": true, "await": true}] 2024-08-20T05:16:19.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.514+0000 7ff1af1d7740 1 -- 172.21.15.37:0/4261111741 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "set_id": "97d547b2", "release": true, "await": true}) -- 0x55b739f01760 con 0x55b73a014b70 2024-08-20T05:16:19.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.515+0000 7ff1a9c00640 1 --2- 172.21.15.37:0/4261111741 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b73a014b70 0x55b73a016f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:19.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.515+0000 7ff1a9c00640 1 --2- 172.21.15.37:0/4261111741 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b73a014b70 0x55b73a016f90 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63a2ceec1cf442aa server_cookie=1b22cf0aa805269 in_seq=0 out_seq=0 2024-08-20T05:16:19.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.515+0000 7ff18b400640 10 client.28861 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:19.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.560+0000 7ff18b400640 1 -- 172.21.15.37:0/4261111741 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b739f01760 con 0x55b73a014b70 2024-08-20T05:16:19.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.560+0000 7ff18b400640 10 client.28861 handle_command_reply: tid=0 2024-08-20T05:16:19.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.560+0000 7ff1af1d7740 1 client.28861 shutdown 2024-08-20T05:16:19.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.561+0000 7ff1af1d7740 1 -- 172.21.15.37:0/4261111741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f8e7a0 msgr2=0x55b739f9fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:19.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.561+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/4261111741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f8e7a0 0x55b739f9fe00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff1900aac00 tx=0x7ff190018420 comp rx=0 tx=0).stop 2024-08-20T05:16:19.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.561+0000 7ff1af1d7740 1 -- 172.21.15.37:0/4261111741 shutdown_connections 2024-08-20T05:16:19.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.561+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/4261111741 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55b73a014b70 0x55b73a016f90 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.561+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/4261111741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b739f9a730 0x55b739fa0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.561+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/4261111741 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55b739f8e7a0 0x55b739f9fe00 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.561+0000 7ff1af1d7740 1 --2- 172.21.15.37:0/4261111741 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55b739f8de80 0x55b739fa2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.561+0000 7ff1af1d7740 1 -- 172.21.15.37:0/4261111741 >> 172.21.15.37:0/4261111741 conn(0x55b739f8bcb0 msgr2=0x55b739f96450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.561+0000 7ff18b400640 0 client.28861 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.561+0000 7ff1af1d7740 1 -- 172.21.15.37:0/4261111741 shutdown_connections 2024-08-20T05:16:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.562+0000 7ff1af1d7740 1 -- 172.21.15.37:0/4261111741 wait complete. 2024-08-20T05:16:19.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.562+0000 7ff1af1d7740 20 client.28861 trim_cache size 0 max 16384 2024-08-20T05:16:19.568 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:16:19.568 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 50, 2024-08-20T05:16:19.568 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:16:19.568 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 52, 2024-08-20T05:16:19.568 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:16:19.568 INFO:teuthology.orchestra.run.smithi037.stdout: "97d547b2": { 2024-08-20T05:16:19.568 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 52, 2024-08-20T05:16:19.568 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:16:19.568 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:16:19.569 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:16:19.569 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:16:19.569 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:16:19.569 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:16:19.569 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 141.4, 2024-08-20T05:16:19.569 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:16:19.569 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:16:19.569 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:16:19.569 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:16:19.569 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:16:19.569 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:16:19.569 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:16:19.569 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:16:19.570 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:16:19.570 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:16:19.570 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:16:19.570 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:16:19.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.566+0000 7ff1ab000640 1 -- 172.21.15.37:0/1971283522 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff18c0b3c70 msgr2=0x7ff18c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:19.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.566+0000 7ff1ab000640 1 --2- 172.21.15.37:0/1971283522 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff18c0b3c70 0x7ff18c0b6130 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff19c009fd0 tx=0x7ff19c009500 comp rx=0 tx=0).stop 2024-08-20T05:16:19.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.566+0000 7ff1ab000640 1 -- 172.21.15.37:0/1971283522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a4108310 msgr2=0x7ff1a419b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:19.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.566+0000 7ff1ab000640 1 --2- 172.21.15.37:0/1971283522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a4108310 0x7ff1a419b4f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff19000e9f0 tx=0x7ff19000eeb0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.568+0000 7ff1ab000640 1 -- 172.21.15.37:0/1971283522 shutdown_connections 2024-08-20T05:16:19.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.568+0000 7ff1ab000640 1 --2- 172.21.15.37:0/1971283522 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff18c0b3c70 0x7ff18c0b6130 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.568+0000 7ff1ab000640 1 --2- 172.21.15.37:0/1971283522 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff1a4108c90 0x7ff1a41a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.568+0000 7ff1ab000640 1 --2- 172.21.15.37:0/1971283522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1a4108310 0x7ff1a419b4f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.568+0000 7ff1ab000640 1 --2- 172.21.15.37:0/1971283522 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff1a4102900 0x7ff1a419afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:19.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.568+0000 7ff1ab000640 1 -- 172.21.15.37:0/1971283522 >> 172.21.15.37:0/1971283522 conn(0x7ff1a40fe390 msgr2=0x7ff1a41048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:19.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.569+0000 7ff1ab000640 1 -- 172.21.15.37:0/1971283522 shutdown_connections 2024-08-20T05:16:19.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:19.569+0000 7ff1ab000640 1 -- 172.21.15.37:0/1971283522 wait complete. 2024-08-20T05:16:19.661 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:16:19.857 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:19 smithi130 ceph-mon[22007]: pgmap v823: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 88 KiB/s wr, 24 op/s 2024-08-20T05:16:19.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:19 smithi135 ceph-mon[22342]: pgmap v823: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 88 KiB/s wr, 24 op/s 2024-08-20T05:16:20.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:19 smithi037 ceph-mon[17265]: pgmap v823: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 88 KiB/s wr, 24 op/s 2024-08-20T05:16:21.002 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '97d547b2', total seconds elapsed: 26.2 2024-08-20T05:16:21.146 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:16:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:21 smithi135 ceph-mon[22342]: pgmap v824: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-08-20T05:16:21.923 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:21 smithi037 ceph-mon[17265]: pgmap v824: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-08-20T05:16:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:21 smithi130 ceph-mon[22007]: pgmap v824: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-08-20T05:16:22.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.411+0000 7f5a87200640 1 -- 172.21.15.37:0/1977068426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a80075b10 msgr2=0x7f5a8010e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:22.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.411+0000 7f5a87200640 1 --2- 172.21.15.37:0/1977068426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a80075b10 0x7f5a8010e9f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5a70009900 tx=0x7f5a7002a3f0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.411+0000 7f5a87200640 1 -- 172.21.15.37:0/1977068426 shutdown_connections 2024-08-20T05:16:22.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.411+0000 7f5a87200640 1 --2- 172.21.15.37:0/1977068426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a8010ef30 0x7f5a80111320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.411+0000 7f5a87200640 1 --2- 172.21.15.37:0/1977068426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a80075b10 0x7f5a8010e9f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.411+0000 7f5a87200640 1 --2- 172.21.15.37:0/1977068426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a800751f0 0x7f5a800755d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.411+0000 7f5a87200640 1 -- 172.21.15.37:0/1977068426 >> 172.21.15.37:0/1977068426 conn(0x7f5a800fe350 msgr2=0x7f5a80100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:22.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.412+0000 7f5a87200640 1 -- 172.21.15.37:0/1977068426 shutdown_connections 2024-08-20T05:16:22.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.412+0000 7f5a87200640 1 -- 172.21.15.37:0/1977068426 wait complete. 2024-08-20T05:16:22.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.413+0000 7f5a87200640 1 Processor -- start 2024-08-20T05:16:22.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.414+0000 7f5a87200640 1 -- start start 2024-08-20T05:16:22.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.414+0000 7f5a87200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a800751f0 0x7f5a8019afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.414+0000 7f5a87200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a80075b10 0x7f5a8019b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.414+0000 7f5a87200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a8010ef30 0x7f5a801a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.414+0000 7f5a87200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5a80114b60 con 0x7f5a80075b10 2024-08-20T05:16:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.414+0000 7f5a87200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a801149e0 con 0x7f5a8010ef30 2024-08-20T05:16:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.414+0000 7f5a87200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a80114ce0 con 0x7f5a800751f0 2024-08-20T05:16:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.415+0000 7f5a85e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a800751f0 0x7f5a8019afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.415+0000 7f5a85e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a800751f0 0x7f5a8019afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:45062/0 (socket says 172.21.15.37:45062) 2024-08-20T05:16:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.415+0000 7f5a86800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a8010ef30 0x7f5a801a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:22.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.415+0000 7f5a85e00640 1 -- 172.21.15.37:0/3688729793 learned_addr learned my addr 172.21.15.37:0/3688729793 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:22.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.415+0000 7f5a85400640 1 --2- 172.21.15.37:0/3688729793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a80075b10 0x7f5a8019b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:22.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.415+0000 7f5a85e00640 1 -- 172.21.15.37:0/3688729793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a8010ef30 msgr2=0x7f5a801a08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:22.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.415+0000 7f5a85e00640 1 --2- 172.21.15.37:0/3688729793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a8010ef30 0x7f5a801a08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.415+0000 7f5a85e00640 1 -- 172.21.15.37:0/3688729793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a80075b10 msgr2=0x7f5a8019b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.415+0000 7f5a85e00640 1 --2- 172.21.15.37:0/3688729793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a80075b10 0x7f5a8019b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.415+0000 7f5a85e00640 1 -- 172.21.15.37:0/3688729793 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a801a1080 con 0x7f5a800751f0 2024-08-20T05:16:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.415+0000 7f5a86800640 1 --2- 172.21.15.37:0/3688729793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a8010ef30 0x7f5a801a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.416+0000 7f5a85400640 1 --2- 172.21.15.37:0/3688729793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a80075b10 0x7f5a8019b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:16:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.416+0000 7f5a85e00640 1 --2- 172.21.15.37:0/3688729793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a800751f0 0x7f5a8019afd0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400e9f0 tx=0x7f5a7400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.416+0000 7f5a7aa00640 1 -- 172.21.15.37:0/3688729793 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400cd80 con 0x7f5a800751f0 2024-08-20T05:16:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.416+0000 7f5a7aa00640 1 -- 172.21.15.37:0/3688729793 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a740108e0 con 0x7f5a800751f0 2024-08-20T05:16:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.416+0000 7f5a7aa00640 1 -- 172.21.15.37:0/3688729793 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a74018860 con 0x7f5a800751f0 2024-08-20T05:16:22.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.416+0000 7f5a87200640 1 -- 172.21.15.37:0/3688729793 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a801a1370 con 0x7f5a800751f0 2024-08-20T05:16:22.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.416+0000 7f5a87200640 1 -- 172.21.15.37:0/3688729793 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a801a7a30 con 0x7f5a800751f0 2024-08-20T05:16:22.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.421+0000 7f5a8b225740 1 Processor -- start 2024-08-20T05:16:22.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.421+0000 7f5a8b225740 1 -- start start 2024-08-20T05:16:22.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.421+0000 7f5a8b225740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 0x559a9d87bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.421+0000 7f5a8b225740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d87c400 0x559a9d887e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.421+0000 7f5a8b225740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d888390 0x559a9d88a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.421+0000 7f5a8b225740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559a9d7f1a60 con 0x559a9d87c400 2024-08-20T05:16:22.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.421+0000 7f5a8b225740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559a9d7e0f60 con 0x559a9d888390 2024-08-20T05:16:22.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.421+0000 7f5a8b225740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559a9d7e4fa0 con 0x559a9d87bae0 2024-08-20T05:16:22.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.422+0000 7f5a86800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 0x559a9d87bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:22.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.422+0000 7f5a85400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d888390 0x559a9d88a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:22.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.422+0000 7f5a85400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d888390 0x559a9d88a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33854/0 (socket says 172.21.15.37:33854) 2024-08-20T05:16:22.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.422+0000 7f5a85400640 1 -- 172.21.15.37:0/1033144475 learned_addr learned my addr 172.21.15.37:0/1033144475 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:22.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.423+0000 7f5a85400640 1 -- 172.21.15.37:0/1033144475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 msgr2=0x559a9d87bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:22.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.423+0000 7f5a85400640 1 --2- 172.21.15.37:0/1033144475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 0x559a9d87bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.423+0000 7f5a85400640 1 -- 172.21.15.37:0/1033144475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d87c400 msgr2=0x559a9d887e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:16:22.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.423+0000 7f5a85400640 1 --2- 172.21.15.37:0/1033144475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d87c400 0x559a9d887e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.423+0000 7f5a85400640 1 -- 172.21.15.37:0/1033144475 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a9d7873e0 con 0x559a9d888390 2024-08-20T05:16:22.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.423+0000 7f5a7aa00640 1 -- 172.21.15.37:0/3688729793 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5a74010430 con 0x7f5a800751f0 2024-08-20T05:16:22.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.424+0000 7f5a85400640 1 --2- 172.21.15.37:0/1033144475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d888390 0x559a9d88a780 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5a70005dc0 tx=0x7f5a70004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9a6ba1fdb73ef0e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:22.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.424+0000 7f5a6f000640 1 -- 172.21.15.37:0/1033144475 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7003f070 con 0x559a9d888390 2024-08-20T05:16:22.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.424+0000 7f5a6f000640 1 -- 172.21.15.37:0/1033144475 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a700054f0 con 0x559a9d888390 2024-08-20T05:16:22.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.424+0000 7f5a6f000640 1 -- 172.21.15.37:0/1033144475 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70035030 con 0x559a9d888390 2024-08-20T05:16:22.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.425+0000 7f5a8b225740 1 -- 172.21.15.37:0/1033144475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d888390 msgr2=0x559a9d88a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:22.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.425+0000 7f5a8b225740 1 --2- 172.21.15.37:0/1033144475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d888390 0x559a9d88a780 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5a70005dc0 tx=0x7f5a70004260 comp rx=0 tx=0).stop 2024-08-20T05:16:22.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.426+0000 7f5a7aa00640 1 --2- 172.21.15.37:0/3688729793 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5a680b3dc0 0x7f5a680b6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.426+0000 7f5a7aa00640 1 -- 172.21.15.37:0/3688729793 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5a740e4300 con 0x7f5a800751f0 2024-08-20T05:16:22.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.426+0000 7f5a8b225740 1 -- 172.21.15.37:0/1033144475 shutdown_connections 2024-08-20T05:16:22.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.426+0000 7f5a8b225740 1 --2- 172.21.15.37:0/1033144475 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d888390 0x559a9d88a780 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.426+0000 7f5a8b225740 1 --2- 172.21.15.37:0/1033144475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d87c400 0x559a9d887e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.426+0000 7f5a8b225740 1 --2- 172.21.15.37:0/1033144475 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 0x559a9d87bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.426+0000 7f5a8b225740 1 -- 172.21.15.37:0/1033144475 >> 172.21.15.37:0/1033144475 conn(0x559a9d879910 msgr2=0x559a9d87aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:22.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.426+0000 7f5a86800640 1 --2- 172.21.15.37:0/3688729793 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5a680b3dc0 0x7f5a680b6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:22.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.426+0000 7f5a8b225740 1 -- 172.21.15.37:0/1033144475 shutdown_connections 2024-08-20T05:16:22.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.426+0000 7f5a8b225740 1 -- 172.21.15.37:0/1033144475 wait complete. 2024-08-20T05:16:22.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.427+0000 7f5a8b225740 1 -- start start 2024-08-20T05:16:22.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.427+0000 7f5a8b225740 1 Processor -- start 2024-08-20T05:16:22.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.428+0000 7f5a86800640 1 --2- 172.21.15.37:0/3688729793 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5a680b3dc0 0x7f5a680b6280 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5a8006bf20 tx=0x7f5a7c009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:22.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.428+0000 7f5a8b225740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d87bae0 0x559a9d887c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.428+0000 7f5a8b225740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d87c400 0x559a9d8850d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.428+0000 7f5a8b225740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d888390 0x559a9d885700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.428+0000 7f5a85e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d87bae0 0x559a9d887c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:22.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.428+0000 7f5a85e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d87bae0 0x559a9d887c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33862/0 (socket says 172.21.15.37:33862) 2024-08-20T05:16:22.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.429+0000 7f5a8b225740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559a9d643700 con 0x559a9d87c400 2024-08-20T05:16:22.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.429+0000 7f5a8b225740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559a9d77c250 con 0x559a9d87bae0 2024-08-20T05:16:22.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.429+0000 7f5a8b225740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559a9d88afb0 con 0x559a9d888390 2024-08-20T05:16:22.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.429+0000 7f5a8b225740 10 client.0 _ll_register_callbacks cb 0x559a9d7db180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:22.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.429+0000 7f5a85e00640 1 -- 172.21.15.37:0/3424667140 learned_addr learned my addr 172.21.15.37:0/3424667140 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.429+0000 7f5a85400640 1 --2- 172.21.15.37:0/3424667140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d87c400 0x559a9d8850d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.429+0000 7f5a86800640 1 --2- 172.21.15.37:0/3424667140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d888390 0x559a9d885700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.429+0000 7f5a85e00640 1 -- 172.21.15.37:0/3424667140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d888390 msgr2=0x559a9d885700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.429+0000 7f5a85e00640 1 --2- 172.21.15.37:0/3424667140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d888390 0x559a9d885700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.429+0000 7f5a85e00640 1 -- 172.21.15.37:0/3424667140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d87c400 msgr2=0x559a9d8850d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.429+0000 7f5a85e00640 1 --2- 172.21.15.37:0/3424667140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d87c400 0x559a9d8850d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.429+0000 7f5a85e00640 1 -- 172.21.15.37:0/3424667140 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a9d540650 con 0x559a9d87bae0 2024-08-20T05:16:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.429+0000 7f5a85400640 1 --2- 172.21.15.37:0/3424667140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d87c400 0x559a9d8850d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:16:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.430+0000 7f5a85e00640 1 --2- 172.21.15.37:0/3424667140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d87bae0 0x559a9d887c80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f5a740a80c0 tx=0x7f5a740aa960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2c671e8f9aa910b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.430+0000 7f5a63400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:16:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.430+0000 7f5a63400640 1 -- 172.21.15.37:0/3424667140 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a740aae50 con 0x559a9d87bae0 2024-08-20T05:16:22.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.430+0000 7f5a63400640 1 -- 172.21.15.37:0/3424667140 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5a740aa0b0 con 0x559a9d87bae0 2024-08-20T05:16:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.430+0000 7f5a8b225740 1 -- 172.21.15.37:0/3424667140 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a700054f0 con 0x559a9d87bae0 2024-08-20T05:16:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.430+0000 7f5a63400640 1 -- 172.21.15.37:0/3424667140 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f5a740c5050 con 0x559a9d87bae0 2024-08-20T05:16:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.430+0000 7f5a8b225740 10 client.28832 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.430+0000 7f5a8b225740 1 -- 172.21.15.37:0/3424667140 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x559a9d896940 con 0x559a9d87bae0 2024-08-20T05:16:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.431+0000 7f5a63400640 1 -- 172.21.15.37:0/3424667140 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a700054f0 con 0x559a9d87bae0 2024-08-20T05:16:22.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.432+0000 7f5a63400640 1 -- 172.21.15.37:0/3424667140 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f5a740a9b20 con 0x559a9d87bae0 2024-08-20T05:16:22.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.433+0000 7f5a8b225740 10 client.28832 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:22.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.433+0000 7f5a8b225740 10 client.28832 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:16:22.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.433+0000 7f5a8b225740 20 client.28832 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:22.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.433+0000 7f5a8b225740 1 --2- 172.21.15.37:0/3424667140 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559a9d897da0 0x559a9d89a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.434+0000 7f5a8b225740 4 client.28832 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:16:22.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.434+0000 7f5a8b225740 1 -- 172.21.15.37:0/3424667140 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a9d7f39b0 con 0x559a9d897da0 2024-08-20T05:16:22.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.434+0000 7f5a85400640 1 --2- 172.21.15.37:0/3424667140 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559a9d897da0 0x559a9d89a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.435+0000 7f5a63400640 10 client.28832 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:22.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.435+0000 7f5a85400640 1 --2- 172.21.15.37:0/3424667140 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559a9d897da0 0x559a9d89a190 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64bfcf4646846bd2 server_cookie=67c91500e5e147fe in_seq=0 out_seq=0 2024-08-20T05:16:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.436+0000 7f5a63400640 1 -- 172.21.15.37:0/3424667140 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559a9d7f39b0 con 0x559a9d897da0 2024-08-20T05:16:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.436+0000 7f5a63400640 10 client.28832 handle_command_reply: tid=0 2024-08-20T05:16:22.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.436+0000 7f5a8b225740 1 client.28832 shutdown 2024-08-20T05:16:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.437+0000 7f5a8b225740 1 -- 172.21.15.37:0/3424667140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d87bae0 msgr2=0x559a9d887c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:22.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.437+0000 7f5a8b225740 1 --2- 172.21.15.37:0/3424667140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d87bae0 0x559a9d887c80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f5a740a80c0 tx=0x7f5a740aa960 comp rx=0 tx=0).stop 2024-08-20T05:16:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.437+0000 7f5a8b225740 1 -- 172.21.15.37:0/3424667140 shutdown_connections 2024-08-20T05:16:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.437+0000 7f5a8b225740 1 --2- 172.21.15.37:0/3424667140 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559a9d897da0 0x559a9d89a190 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.437+0000 7f5a8b225740 1 --2- 172.21.15.37:0/3424667140 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d888390 0x559a9d885700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.437+0000 7f5a8b225740 1 --2- 172.21.15.37:0/3424667140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d87c400 0x559a9d8850d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.437+0000 7f5a8b225740 1 --2- 172.21.15.37:0/3424667140 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d87bae0 0x559a9d887c80 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.437+0000 7f5a8b225740 1 -- 172.21.15.37:0/3424667140 >> 172.21.15.37:0/3424667140 conn(0x559a9d879910 msgr2=0x559a9d878b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.437+0000 7f5a63400640 0 client.28832 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.437+0000 7f5a8b225740 1 -- 172.21.15.37:0/3424667140 shutdown_connections 2024-08-20T05:16:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.437+0000 7f5a8b225740 1 -- 172.21.15.37:0/3424667140 wait complete. 2024-08-20T05:16:22.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.438+0000 7f5a8b225740 20 client.28832 trim_cache size 0 max 16384 2024-08-20T05:16:22.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.461+0000 7f5a8b225740 1 Processor -- start 2024-08-20T05:16:22.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.461+0000 7f5a8b225740 1 -- start start 2024-08-20T05:16:22.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.462+0000 7f5a8b225740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 0x559a9d886700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.462+0000 7f5a8b225740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d87c400 0x559a9d89fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.462+0000 7f5a8b225740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d888390 0x559a9d89ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.462+0000 7f5a8b225740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5a801b18b0 con 0x559a9d87c400 2024-08-20T05:16:22.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.462+0000 7f5a8b225740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a801b3450 con 0x559a9d888390 2024-08-20T05:16:22.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.462+0000 7f5a8b225740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a801b1f80 con 0x559a9d87bae0 2024-08-20T05:16:22.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.462+0000 7f5a85e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 0x559a9d886700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:22.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.462+0000 7f5a85e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 0x559a9d886700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:45102/0 (socket says 172.21.15.37:45102) 2024-08-20T05:16:22.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.462+0000 7f5a85e00640 1 -- 172.21.15.37:0/2570132124 learned_addr learned my addr 172.21.15.37:0/2570132124 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:22.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.462+0000 7f5a86800640 1 --2- 172.21.15.37:0/2570132124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d888390 0x559a9d89ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:22.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.463+0000 7f5a85e00640 1 -- 172.21.15.37:0/2570132124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d888390 msgr2=0x559a9d89ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:22.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.463+0000 7f5a85e00640 1 --2- 172.21.15.37:0/2570132124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d888390 0x559a9d89ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.463+0000 7f5a85e00640 1 -- 172.21.15.37:0/2570132124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d87c400 msgr2=0x559a9d89fa40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:16:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.463+0000 7f5a85400640 1 --2- 172.21.15.37:0/2570132124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d87c400 0x559a9d89fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.464+0000 7f5a85e00640 1 --2- 172.21.15.37:0/2570132124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d87c400 0x559a9d89fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.464+0000 7f5a85e00640 1 -- 172.21.15.37:0/2570132124 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a9d87a390 con 0x559a9d87bae0 2024-08-20T05:16:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.464+0000 7f5a86800640 1 --2- 172.21.15.37:0/2570132124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d888390 0x559a9d89ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:16:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.464+0000 7f5a85e00640 1 --2- 172.21.15.37:0/2570132124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 0x559a9d886700 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400c6a0 tx=0x7f5a74009700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89c860685d43b095 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.465+0000 7f5a6e600640 1 -- 172.21.15.37:0/2570132124 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a740ca080 con 0x559a9d87bae0 2024-08-20T05:16:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.465+0000 7f5a6e600640 1 -- 172.21.15.37:0/2570132124 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a740ad070 con 0x559a9d87bae0 2024-08-20T05:16:22.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.465+0000 7f5a6e600640 1 -- 172.21.15.37:0/2570132124 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a740b3f00 con 0x559a9d87bae0 2024-08-20T05:16:22.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.465+0000 7f5a8b225740 1 -- 172.21.15.37:0/2570132124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 msgr2=0x559a9d886700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:22.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.465+0000 7f5a8b225740 1 --2- 172.21.15.37:0/2570132124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 0x559a9d886700 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400c6a0 tx=0x7f5a74009700 comp rx=0 tx=0).stop 2024-08-20T05:16:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.466+0000 7f5a8b225740 1 -- 172.21.15.37:0/2570132124 shutdown_connections 2024-08-20T05:16:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.466+0000 7f5a8b225740 1 --2- 172.21.15.37:0/2570132124 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d888390 0x559a9d89ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.466+0000 7f5a8b225740 1 --2- 172.21.15.37:0/2570132124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d87c400 0x559a9d89fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.466+0000 7f5a8b225740 1 --2- 172.21.15.37:0/2570132124 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 0x559a9d886700 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.466+0000 7f5a8b225740 1 -- 172.21.15.37:0/2570132124 >> 172.21.15.37:0/2570132124 conn(0x559a9d879910 msgr2=0x559a9d878b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.466+0000 7f5a8b225740 1 -- 172.21.15.37:0/2570132124 shutdown_connections 2024-08-20T05:16:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.466+0000 7f5a8b225740 1 -- 172.21.15.37:0/2570132124 wait complete. 2024-08-20T05:16:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.466+0000 7f5a8b225740 1 -- start start 2024-08-20T05:16:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.467+0000 7f5a8b225740 1 Processor -- start 2024-08-20T05:16:22.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.467+0000 7f5a8b225740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 0x559a9d890770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.467+0000 7f5a8b225740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d87c400 0x559a9d88dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.467+0000 7f5a8b225740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d888390 0x559a9d88e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.467+0000 7f5a8b225740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5a801b2d80 con 0x559a9d888390 2024-08-20T05:16:22.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.467+0000 7f5a8b225740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f5a801b2650 con 0x559a9d87c400 2024-08-20T05:16:22.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.467+0000 7f5a8b225740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5a801af890 con 0x559a9d87bae0 2024-08-20T05:16:22.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.467+0000 7f5a8b225740 10 client.0 _ll_register_callbacks cb 0x7f5a740aa630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:22.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.468+0000 7f5a85e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 0x559a9d890770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:22.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.468+0000 7f5a85e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 0x559a9d890770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:45106/0 (socket says 172.21.15.37:45106) 2024-08-20T05:16:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.468+0000 7f5a85e00640 1 -- 172.21.15.37:0/2373384247 learned_addr learned my addr 172.21.15.37:0/2373384247 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.468+0000 7f5a86800640 1 --2- 172.21.15.37:0/2373384247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d888390 0x559a9d88e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.468+0000 7f5a85400640 1 --2- 172.21.15.37:0/2373384247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d87c400 0x559a9d88dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.469+0000 7f5a85e00640 1 -- 172.21.15.37:0/2373384247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d87c400 msgr2=0x559a9d88dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.469+0000 7f5a85e00640 1 --2- 172.21.15.37:0/2373384247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d87c400 0x559a9d88dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.469+0000 7f5a85e00640 1 -- 172.21.15.37:0/2373384247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d888390 msgr2=0x559a9d88e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.469+0000 7f5a85e00640 1 --2- 172.21.15.37:0/2373384247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d888390 0x559a9d88e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.469+0000 7f5a85e00640 1 -- 172.21.15.37:0/2373384247 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a9d88e860 con 0x559a9d87bae0 2024-08-20T05:16:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.469+0000 7f5a85e00640 1 --2- 172.21.15.37:0/2373384247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 0x559a9d890770 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5a740af3c0 tx=0x7f5a740aa2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b75a825750df3d0f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.469+0000 7f5a63400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:16:22.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.469+0000 7f5a63400640 1 -- 172.21.15.37:0/2373384247 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a740ca050 con 0x559a9d87bae0 2024-08-20T05:16:22.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.469+0000 7f5a63400640 1 -- 172.21.15.37:0/2373384247 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5a740a7440 con 0x559a9d87bae0 2024-08-20T05:16:22.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.469+0000 7f5a8b225740 1 -- 172.21.15.37:0/2373384247 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a740ad070 con 0x559a9d87bae0 2024-08-20T05:16:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.470+0000 7f5a63400640 1 -- 172.21.15.37:0/2373384247 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f5a740aa350 con 0x559a9d87bae0 2024-08-20T05:16:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.470+0000 7f5a8b225740 10 client.28879 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.470+0000 7f5a8b225740 1 -- 172.21.15.37:0/2373384247 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x559a9d8f9830 con 0x559a9d87bae0 2024-08-20T05:16:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.470+0000 7f5a63400640 1 -- 172.21.15.37:0/2373384247 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a740aa350 con 0x559a9d87bae0 2024-08-20T05:16:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.470+0000 7f5a63400640 1 -- 172.21.15.37:0/2373384247 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f5a740c5990 con 0x559a9d87bae0 2024-08-20T05:16:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.470+0000 7f5a8b225740 10 client.28879 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.470+0000 7f5a8b225740 10 client.28879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:16:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.470+0000 7f5a8b225740 20 client.28879 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.470+0000 7f5a8b225740 1 --2- 172.21.15.37:0/2373384247 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559a9d8f9cd0 0x559a9d8fc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.470+0000 7f5a8b225740 4 client.28879 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:16:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.470+0000 7f5a8b225740 1 -- 172.21.15.37:0/2373384247 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559a9d7ef450 con 0x559a9d8f9cd0 2024-08-20T05:16:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.471+0000 7f5a85400640 1 --2- 172.21.15.37:0/2373384247 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559a9d8f9cd0 0x559a9d8fc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.471+0000 7f5a63400640 10 client.28879 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.471+0000 7f5a85400640 1 --2- 172.21.15.37:0/2373384247 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559a9d8f9cd0 0x559a9d8fc0f0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec200826a571d2f8 server_cookie=b77d675736246f33 in_seq=0 out_seq=0 2024-08-20T05:16:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.471+0000 7f5a63400640 1 -- 172.21.15.37:0/2373384247 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559a9d7ef450 con 0x559a9d8f9cd0 2024-08-20T05:16:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.471+0000 7f5a63400640 10 client.28879 handle_command_reply: tid=0 2024-08-20T05:16:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.471+0000 7f5a8b225740 1 client.28879 shutdown 2024-08-20T05:16:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.472+0000 7f5a8b225740 1 -- 172.21.15.37:0/2373384247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 msgr2=0x559a9d890770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.472+0000 7f5a8b225740 1 --2- 172.21.15.37:0/2373384247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 0x559a9d890770 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f5a740af3c0 tx=0x7f5a740aa2e0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.472+0000 7f5a8b225740 1 -- 172.21.15.37:0/2373384247 shutdown_connections 2024-08-20T05:16:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.472+0000 7f5a8b225740 1 --2- 172.21.15.37:0/2373384247 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x559a9d8f9cd0 0x559a9d8fc0f0 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.472+0000 7f5a8b225740 1 --2- 172.21.15.37:0/2373384247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559a9d888390 0x559a9d88e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.472+0000 7f5a8b225740 1 --2- 172.21.15.37:0/2373384247 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559a9d87c400 0x559a9d88dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.472+0000 7f5a8b225740 1 --2- 172.21.15.37:0/2373384247 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559a9d87bae0 0x559a9d890770 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.472+0000 7f5a8b225740 1 -- 172.21.15.37:0/2373384247 >> 172.21.15.37:0/2373384247 conn(0x559a9d879910 msgr2=0x559a9d883820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.472+0000 7f5a63400640 0 client.28879 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.472+0000 7f5a8b225740 1 -- 172.21.15.37:0/2373384247 shutdown_connections 2024-08-20T05:16:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.473+0000 7f5a8b225740 1 -- 172.21.15.37:0/2373384247 wait complete. 2024-08-20T05:16:22.478 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:16:22.478 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-20T05:16:22.478 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-08-20T05:16:22.478 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:16:22.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.473+0000 7f5a8b225740 20 client.28879 trim_cache size 0 max 16384 2024-08-20T05:16:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.474+0000 7f5a87200640 1 -- 172.21.15.37:0/3688729793 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5a680b3dc0 msgr2=0x7f5a680b6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.474+0000 7f5a87200640 1 --2- 172.21.15.37:0/3688729793 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5a680b3dc0 0x7f5a680b6280 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5a8006bf20 tx=0x7f5a7c009600 comp rx=0 tx=0).stop 2024-08-20T05:16:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.474+0000 7f5a87200640 1 -- 172.21.15.37:0/3688729793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a800751f0 msgr2=0x7f5a8019afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.474+0000 7f5a87200640 1 --2- 172.21.15.37:0/3688729793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a800751f0 0x7f5a8019afd0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400e9f0 tx=0x7f5a7400eeb0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.475+0000 7f5a87200640 1 -- 172.21.15.37:0/3688729793 shutdown_connections 2024-08-20T05:16:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.475+0000 7f5a87200640 1 --2- 172.21.15.37:0/3688729793 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f5a680b3dc0 0x7f5a680b6280 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.475+0000 7f5a87200640 1 --2- 172.21.15.37:0/3688729793 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f5a8010ef30 0x7f5a801a08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.475+0000 7f5a87200640 1 --2- 172.21.15.37:0/3688729793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a80075b10 0x7f5a8019b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.475+0000 7f5a87200640 1 --2- 172.21.15.37:0/3688729793 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5a800751f0 0x7f5a8019afd0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.475+0000 7f5a87200640 1 -- 172.21.15.37:0/3688729793 >> 172.21.15.37:0/3688729793 conn(0x7f5a800fe350 msgr2=0x7f5a800fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.475+0000 7f5a87200640 1 -- 172.21.15.37:0/3688729793 shutdown_connections 2024-08-20T05:16:22.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:22.476+0000 7f5a87200640 1 -- 172.21.15.37:0/3688729793 wait complete. 2024-08-20T05:16:23.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 805.0 s, 364.4 tps, lat 1130.921 ms stddev 3913.396 2024-08-20T05:16:23.132 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.130+0000 7faba7c00640 1 -- 172.21.15.37:0/1133306902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faba0100c00 msgr2=0x7faba0107e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:23.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.130+0000 7faba7c00640 1 --2- 172.21.15.37:0/1133306902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faba0100c00 0x7faba0107e90 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fab94009900 tx=0x7fab9402a400 comp rx=0 tx=0).stop 2024-08-20T05:16:23.133 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.130+0000 7faba7c00640 1 -- 172.21.15.37:0/1133306902 shutdown_connections 2024-08-20T05:16:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.130+0000 7faba7c00640 1 --2- 172.21.15.37:0/1133306902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba01083d0 0x7faba010a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.130+0000 7faba7c00640 1 --2- 172.21.15.37:0/1133306902 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faba0100c00 0x7faba0107e90 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.130+0000 7faba7c00640 1 --2- 172.21.15.37:0/1133306902 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba01002c0 0x7faba01006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.130+0000 7faba7c00640 1 -- 172.21.15.37:0/1133306902 >> 172.21.15.37:0/1133306902 conn(0x7faba00fc170 msgr2=0x7faba00fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.131+0000 7faba7c00640 1 -- 172.21.15.37:0/1133306902 shutdown_connections 2024-08-20T05:16:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.131+0000 7faba7c00640 1 -- 172.21.15.37:0/1133306902 wait complete. 2024-08-20T05:16:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.132+0000 7faba7c00640 1 Processor -- start 2024-08-20T05:16:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.132+0000 7faba7c00640 1 -- start start 2024-08-20T05:16:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.133+0000 7faba7c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba01002c0 0x7faba01035c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.133+0000 7faba7c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba0100c00 0x7faba0101e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.133+0000 7faba7c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faba01083d0 0x7faba0102360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.133+0000 7faba7c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faba010e400 con 0x7faba01002c0 2024-08-20T05:16:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.133+0000 7faba7c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faba010e280 con 0x7faba01083d0 2024-08-20T05:16:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.133+0000 7faba7c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faba010e580 con 0x7faba0100c00 2024-08-20T05:16:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.133+0000 7fab9fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba0100c00 0x7faba0101e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.133+0000 7fab9fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba0100c00 0x7faba0101e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50250/0 (socket says 172.21.15.37:50250) 2024-08-20T05:16:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.133+0000 7fab9fe00640 1 -- 172.21.15.37:0/3360272858 learned_addr learned my addr 172.21.15.37:0/3360272858 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.133+0000 7faba5c00640 1 --2- 172.21.15.37:0/3360272858 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faba01083d0 0x7faba0102360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.134+0000 7fab9fe00640 1 -- 172.21.15.37:0/3360272858 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faba01083d0 msgr2=0x7faba0102360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.134+0000 7fab9fe00640 1 --2- 172.21.15.37:0/3360272858 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faba01083d0 0x7faba0102360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.134+0000 7fab9fe00640 1 -- 172.21.15.37:0/3360272858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba01002c0 msgr2=0x7faba01035c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.134+0000 7fab9fe00640 1 --2- 172.21.15.37:0/3360272858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba01002c0 0x7faba01035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.134+0000 7fab9fe00640 1 -- 172.21.15.37:0/3360272858 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba0102bd0 con 0x7faba0100c00 2024-08-20T05:16:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.135+0000 7fab9fe00640 1 --2- 172.21.15.37:0/3360272858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba0100c00 0x7faba0101e20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fab94031500 tx=0x7fab94003d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.136+0000 7fab9d600640 1 -- 172.21.15.37:0/3360272858 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9403f070 con 0x7faba0100c00 2024-08-20T05:16:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.136+0000 7fab9d600640 1 -- 172.21.15.37:0/3360272858 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab9403b460 con 0x7faba0100c00 2024-08-20T05:16:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.136+0000 7fab9d600640 1 -- 172.21.15.37:0/3360272858 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94035030 con 0x7faba0100c00 2024-08-20T05:16:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.136+0000 7faba7c00640 1 -- 172.21.15.37:0/3360272858 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba01a2c60 con 0x7faba0100c00 2024-08-20T05:16:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.137+0000 7faba7c00640 1 -- 172.21.15.37:0/3360272858 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba0198a80 con 0x7faba0100c00 2024-08-20T05:16:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.142+0000 7fabaaa27740 1 Processor -- start 2024-08-20T05:16:23.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.142+0000 7fabaaa27740 1 -- start start 2024-08-20T05:16:23.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.143+0000 7fabaaa27740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9eb2b0 0x555c9f9ed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.143+0000 7fabaaa27740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9edbe0 0x555c9f9effd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.143+0000 7fabaaa27740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9f0620 0x555c9f9f2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.143+0000 7fabaaa27740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555c9f95e210 con 0x555c9f9eb2b0 2024-08-20T05:16:23.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.143+0000 7fabaaa27740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555c9f94d710 con 0x555c9f9edbe0 2024-08-20T05:16:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.143+0000 7fabaaa27740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555c9f951750 con 0x555c9f9f0620 2024-08-20T05:16:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.144+0000 7faba5c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9eb2b0 0x555c9f9ed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.144+0000 7faba5c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9eb2b0 0x555c9f9ed6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38140/0 (socket says 172.21.15.37:38140) 2024-08-20T05:16:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.144+0000 7faba5c00640 1 -- 172.21.15.37:0/3067625027 learned_addr learned my addr 172.21.15.37:0/3067625027 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:23.146 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.144+0000 7faba5200640 1 --2- 172.21.15.37:0/3067625027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9edbe0 0x555c9f9effd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:23.147 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.145+0000 7fab9d600640 1 -- 172.21.15.37:0/3360272858 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fab94042070 con 0x7faba0100c00 2024-08-20T05:16:23.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.146+0000 7faba5c00640 1 -- 172.21.15.37:0/3067625027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9f0620 msgr2=0x555c9f9f2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.149+0000 7fab9d600640 1 --2- 172.21.15.37:0/3360272858 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fab880b3cd0 0x7fab880b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.149+0000 7fab9d600640 1 -- 172.21.15.37:0/3360272858 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fab94104910 con 0x7faba0100c00 2024-08-20T05:16:23.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.145+0000 7fab9fe00640 1 --2- 172.21.15.37:0/3067625027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9f0620 0x555c9f9f2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:23.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.152+0000 7faba5c00640 1 --2- 172.21.15.37:0/3067625027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9f0620 0x555c9f9f2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.152+0000 7faba5c00640 1 -- 172.21.15.37:0/3067625027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9edbe0 msgr2=0x555c9f9effd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:23.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.152+0000 7faba5c00640 1 --2- 172.21.15.37:0/3067625027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9edbe0 0x555c9f9effd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.152+0000 7faba5c00640 1 -- 172.21.15.37:0/3067625027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c9f919de0 con 0x555c9f9eb2b0 2024-08-20T05:16:23.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.153+0000 7faba5200640 1 --2- 172.21.15.37:0/3067625027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9edbe0 0x555c9f9effd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:23.155 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.153+0000 7fab9fe00640 1 --2- 172.21.15.37:0/3067625027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9f0620 0x555c9f9f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:16:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.154+0000 7faba5c00640 1 --2- 172.21.15.37:0/3067625027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9eb2b0 0x555c9f9ed6a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fab9800a430 tx=0x7fab98009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9db94d116a2c33f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.154+0000 7faba5c00640 1 --2- 172.21.15.37:0/3360272858 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fab880b3cd0 0x7fab880b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.157+0000 7fab92000640 1 -- 172.21.15.37:0/3067625027 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab980148f0 con 0x555c9f9eb2b0 2024-08-20T05:16:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.160+0000 7fab92000640 1 -- 172.21.15.37:0/3067625027 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab98021430 con 0x555c9f9eb2b0 2024-08-20T05:16:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.160+0000 7fab92000640 1 -- 172.21.15.37:0/3067625027 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9801f5a0 con 0x555c9f9eb2b0 2024-08-20T05:16:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.157+0000 7faba5c00640 1 --2- 172.21.15.37:0/3360272858 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fab880b3cd0 0x7fab880b6190 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fab9801e000 tx=0x7fab9801f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.161+0000 7fabaaa27740 1 -- 172.21.15.37:0/3067625027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9eb2b0 msgr2=0x555c9f9ed6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.161+0000 7fabaaa27740 1 --2- 172.21.15.37:0/3067625027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9eb2b0 0x555c9f9ed6a0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fab9800a430 tx=0x7fab98009650 comp rx=0 tx=0).stop 2024-08-20T05:16:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.161+0000 7fabaaa27740 1 -- 172.21.15.37:0/3067625027 shutdown_connections 2024-08-20T05:16:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.161+0000 7fabaaa27740 1 --2- 172.21.15.37:0/3067625027 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9f0620 0x555c9f9f2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.161+0000 7fabaaa27740 1 --2- 172.21.15.37:0/3067625027 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9edbe0 0x555c9f9effd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.161+0000 7fabaaa27740 1 --2- 172.21.15.37:0/3067625027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9eb2b0 0x555c9f9ed6a0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.161+0000 7fabaaa27740 1 -- 172.21.15.37:0/3067625027 >> 172.21.15.37:0/3067625027 conn(0x555c9f9e63b0 msgr2=0x555c9f9e7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.162+0000 7fabaaa27740 1 -- 172.21.15.37:0/3067625027 shutdown_connections 2024-08-20T05:16:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.162+0000 7fabaaa27740 1 -- 172.21.15.37:0/3067625027 wait complete. 2024-08-20T05:16:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.163+0000 7fabaaa27740 1 -- start start 2024-08-20T05:16:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.163+0000 7fabaaa27740 1 Processor -- start 2024-08-20T05:16:23.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.164+0000 7fabaaa27740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9eb2b0 0x555c9f9f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.164+0000 7fabaaa27740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9edbe0 0x555c9f9f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.164+0000 7fabaaa27740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9f0620 0x555c9f9f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.164+0000 7fabaaa27740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555c9f886ab0 con 0x555c9f9eb2b0 2024-08-20T05:16:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.164+0000 7fabaaa27740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x555c9f8f4140 con 0x555c9f9f0620 2024-08-20T05:16:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.164+0000 7fabaaa27740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x555c9f9f3600 con 0x555c9f9edbe0 2024-08-20T05:16:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.165+0000 7fabaaa27740 10 client.0 _ll_register_callbacks cb 0x555c9f9075d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.165+0000 7fab9fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9edbe0 0x555c9f9f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.165+0000 7fab9fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9edbe0 0x555c9f9f53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50264/0 (socket says 172.21.15.37:50264) 2024-08-20T05:16:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.165+0000 7fab9fe00640 1 -- 172.21.15.37:0/3362535638 learned_addr learned my addr 172.21.15.37:0/3362535638 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.165+0000 7fab9fe00640 1 -- 172.21.15.37:0/3362535638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9f0620 msgr2=0x555c9f9f5fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:16:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.165+0000 7fab9fe00640 1 --2- 172.21.15.37:0/3362535638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9f0620 0x555c9f9f5fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.165+0000 7fab9fe00640 1 -- 172.21.15.37:0/3362535638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9eb2b0 msgr2=0x555c9f9f4d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:16:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.165+0000 7fab9fe00640 1 --2- 172.21.15.37:0/3362535638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9eb2b0 0x555c9f9f4d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.165+0000 7fab9fe00640 1 -- 172.21.15.37:0/3362535638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c9f8f5170 con 0x555c9f9edbe0 2024-08-20T05:16:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.166+0000 7fab9fe00640 1 --2- 172.21.15.37:0/3362535638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9edbe0 0x555c9f9f53f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fab94000c00 tx=0x7fab940cb2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abced41d80572673 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.166+0000 7fab86a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:16:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.166+0000 7fab86a00640 1 -- 172.21.15.37:0/3362535638 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab94049040 con 0x555c9f9edbe0 2024-08-20T05:16:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.166+0000 7fab86a00640 1 -- 172.21.15.37:0/3362535638 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fab940c76f0 con 0x555c9f9edbe0 2024-08-20T05:16:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.166+0000 7fabaaa27740 1 -- 172.21.15.37:0/3362535638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555c9f924a30 con 0x555c9f9edbe0 2024-08-20T05:16:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.167+0000 7fab86a00640 1 -- 172.21.15.37:0/3362535638 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fab940cbb60 con 0x555c9f9edbe0 2024-08-20T05:16:23.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.167+0000 7fabaaa27740 10 client.28885 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.167+0000 7fabaaa27740 1 -- 172.21.15.37:0/3362535638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x555c9f6b0790 con 0x555c9f9edbe0 2024-08-20T05:16:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.167+0000 7fab86a00640 1 -- 172.21.15.37:0/3362535638 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555c9f924a30 con 0x555c9f9edbe0 2024-08-20T05:16:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.167+0000 7fab86a00640 1 -- 172.21.15.37:0/3362535638 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fab9403b8d0 con 0x555c9f9edbe0 2024-08-20T05:16:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.168+0000 7fabaaa27740 10 client.28885 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.168+0000 7fabaaa27740 10 client.28885 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:16:23.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.168+0000 7fabaaa27740 20 client.28885 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:23.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.168+0000 7fabaaa27740 1 --2- 172.21.15.37:0/3362535638 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x555c9fa11920 0x555c9fa13d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.168+0000 7fabaaa27740 4 client.28885 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:16:23.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.168+0000 7fabaaa27740 1 -- 172.21.15.37:0/3362535638 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c9f960160 con 0x555c9fa11920 2024-08-20T05:16:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.170+0000 7faba5200640 1 --2- 172.21.15.37:0/3362535638 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x555c9fa11920 0x555c9fa13d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.170+0000 7faba5200640 1 --2- 172.21.15.37:0/3362535638 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x555c9fa11920 0x555c9fa13d70 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba48c7899728182a server_cookie=87cbf1221d5a70aa in_seq=0 out_seq=0 2024-08-20T05:16:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.171+0000 7fab86a00640 10 client.28885 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.171+0000 7fab86a00640 1 -- 172.21.15.37:0/3362535638 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555c9f960160 con 0x555c9fa11920 2024-08-20T05:16:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.171+0000 7fab86a00640 10 client.28885 handle_command_reply: tid=0 2024-08-20T05:16:23.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.171+0000 7fabaaa27740 1 client.28885 shutdown 2024-08-20T05:16:23.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.172+0000 7fabaaa27740 1 -- 172.21.15.37:0/3362535638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9edbe0 msgr2=0x555c9f9f53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:23.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.172+0000 7fabaaa27740 1 --2- 172.21.15.37:0/3362535638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9edbe0 0x555c9f9f53f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fab94000c00 tx=0x7fab940cb2b0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.176 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.175+0000 7fabaaa27740 1 -- 172.21.15.37:0/3362535638 shutdown_connections 2024-08-20T05:16:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.175+0000 7fabaaa27740 1 --2- 172.21.15.37:0/3362535638 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x555c9fa11920 0x555c9fa13d70 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.175+0000 7fabaaa27740 1 --2- 172.21.15.37:0/3362535638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9f0620 0x555c9f9f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.175+0000 7fabaaa27740 1 --2- 172.21.15.37:0/3362535638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9edbe0 0x555c9f9f53f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.175+0000 7fabaaa27740 1 --2- 172.21.15.37:0/3362535638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9eb2b0 0x555c9f9f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.175+0000 7fab86a00640 0 client.28885 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.175+0000 7fabaaa27740 1 -- 172.21.15.37:0/3362535638 >> 172.21.15.37:0/3362535638 conn(0x555c9f9e63b0 msgr2=0x555c9f9e54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:23.177 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.175+0000 7fabaaa27740 1 -- 172.21.15.37:0/3362535638 shutdown_connections 2024-08-20T05:16:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.175+0000 7fabaaa27740 1 -- 172.21.15.37:0/3362535638 wait complete. 2024-08-20T05:16:23.178 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.176+0000 7fabaaa27740 20 client.28885 trim_cache size 0 max 16384 2024-08-20T05:16:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.208+0000 7fabaaa27740 1 Processor -- start 2024-08-20T05:16:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.208+0000 7fabaaa27740 1 -- start start 2024-08-20T05:16:23.210 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.208+0000 7fabaaa27740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9e63b0 0x555c9f9f0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.208+0000 7fabaaa27740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9eb2b0 0x555c9f9f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.208+0000 7fabaaa27740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9edbe0 0x555c9f9e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.208+0000 7fabaaa27740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faba01a92d0 con 0x555c9f9eb2b0 2024-08-20T05:16:23.214 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.208+0000 7fabaaa27740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faba01aae70 con 0x555c9f9edbe0 2024-08-20T05:16:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.208+0000 7fabaaa27740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faba01a99a0 con 0x555c9f9e63b0 2024-08-20T05:16:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.209+0000 7faba5200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9e63b0 0x555c9f9f0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.209+0000 7faba5200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9e63b0 0x555c9f9f0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50270/0 (socket says 172.21.15.37:50270) 2024-08-20T05:16:23.215 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.209+0000 7faba5200640 1 -- 172.21.15.37:0/1261041906 learned_addr learned my addr 172.21.15.37:0/1261041906 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.209+0000 7faba5c00640 1 --2- 172.21.15.37:0/1261041906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9edbe0 0x555c9f9e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.210+0000 7faba5200640 1 -- 172.21.15.37:0/1261041906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9edbe0 msgr2=0x555c9f9e4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.210+0000 7faba5200640 1 --2- 172.21.15.37:0/1261041906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9edbe0 0x555c9f9e4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.210+0000 7faba5200640 1 -- 172.21.15.37:0/1261041906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9eb2b0 msgr2=0x555c9f9f0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.210+0000 7faba5200640 1 --2- 172.21.15.37:0/1261041906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9eb2b0 0x555c9f9f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.210+0000 7faba5200640 1 -- 172.21.15.37:0/1261041906 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c9f729620 con 0x555c9f9e63b0 2024-08-20T05:16:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.210+0000 7faba5200640 1 --2- 172.21.15.37:0/1261041906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9e63b0 0x555c9f9f0a00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x555c9fa145c0 tx=0x7fab8c015780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0e8b86099a2663b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.210+0000 7fab91600640 1 -- 172.21.15.37:0/1261041906 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c015ea0 con 0x555c9f9e63b0 2024-08-20T05:16:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.211+0000 7fab91600640 1 -- 172.21.15.37:0/1261041906 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fab8c023070 con 0x555c9f9e63b0 2024-08-20T05:16:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.211+0000 7fab91600640 1 -- 172.21.15.37:0/1261041906 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab8c016680 con 0x555c9f9e63b0 2024-08-20T05:16:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.212+0000 7fabaaa27740 1 -- 172.21.15.37:0/1261041906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9e63b0 msgr2=0x555c9f9f0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:23.216 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.212+0000 7fabaaa27740 1 --2- 172.21.15.37:0/1261041906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9e63b0 0x555c9f9f0a00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x555c9fa145c0 tx=0x7fab8c015780 comp rx=0 tx=0).stop 2024-08-20T05:16:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.212+0000 7fabaaa27740 1 -- 172.21.15.37:0/1261041906 shutdown_connections 2024-08-20T05:16:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.212+0000 7fabaaa27740 1 --2- 172.21.15.37:0/1261041906 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9edbe0 0x555c9f9e4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.212+0000 7fabaaa27740 1 --2- 172.21.15.37:0/1261041906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9eb2b0 0x555c9f9f0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.212+0000 7fabaaa27740 1 --2- 172.21.15.37:0/1261041906 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9e63b0 0x555c9f9f0a00 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.212+0000 7fabaaa27740 1 -- 172.21.15.37:0/1261041906 >> 172.21.15.37:0/1261041906 conn(0x555c9f9eae90 msgr2=0x555c9f9f2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.213+0000 7fabaaa27740 1 -- 172.21.15.37:0/1261041906 shutdown_connections 2024-08-20T05:16:23.217 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.213+0000 7fabaaa27740 1 -- 172.21.15.37:0/1261041906 wait complete. 2024-08-20T05:16:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.214+0000 7fabaaa27740 1 -- start start 2024-08-20T05:16:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.215+0000 7fabaaa27740 1 Processor -- start 2024-08-20T05:16:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.216+0000 7fabaaa27740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9e63b0 0x555c9f9f9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.218 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.216+0000 7fabaaa27740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9edbe0 0x555c9f9fa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.219 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.217+0000 7fabaaa27740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9f0620 0x555c9f9fadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.217+0000 7fabaaa27740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7faba01aa7a0 con 0x555c9f9edbe0 2024-08-20T05:16:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.217+0000 7fabaaa27740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7faba01aa070 con 0x555c9f9f0620 2024-08-20T05:16:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.217+0000 7fabaaa27740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7faba01a72d0 con 0x555c9f9e63b0 2024-08-20T05:16:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.217+0000 7fabaaa27740 10 client.0 _ll_register_callbacks cb 0x7fab940c7320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.217+0000 7faba5c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9f0620 0x555c9f9fadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.217+0000 7faba5c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9f0620 0x555c9f9fadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42550/0 (socket says 172.21.15.37:42550) 2024-08-20T05:16:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.217+0000 7faba5c00640 1 -- 172.21.15.37:0/2375319411 learned_addr learned my addr 172.21.15.37:0/2375319411 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.217+0000 7faba5200640 1 --2- 172.21.15.37:0/2375319411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9e63b0 0x555c9f9f9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.217+0000 7faba5c00640 1 -- 172.21.15.37:0/2375319411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9e63b0 msgr2=0x555c9f9f9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.217+0000 7faba5c00640 1 --2- 172.21.15.37:0/2375319411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9e63b0 0x555c9f9f9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.217+0000 7faba5c00640 1 -- 172.21.15.37:0/2375319411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9edbe0 msgr2=0x555c9f9fa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:23.220 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.217+0000 7faba5c00640 1 --2- 172.21.15.37:0/2375319411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9edbe0 0x555c9f9fa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.217+0000 7faba5c00640 1 -- 172.21.15.37:0/2375319411 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c9f9fb5f0 con 0x555c9f9f0620 2024-08-20T05:16:23.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.218+0000 7fabaaa27740 1 -- 172.21.15.37:0/2375319411 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab8c023070 con 0x555c9f9f0620 2024-08-20T05:16:23.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.218+0000 7faba5c00640 1 --2- 172.21.15.37:0/2375319411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9f0620 0x555c9f9fadc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x555c9f9f5aa0 tx=0x7fab98023070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=473ab239202bff23 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:23.221 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.218+0000 7fab86a00640 10 client.28850 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:16:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.219+0000 7fab86a00640 1 -- 172.21.15.37:0/2375319411 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab9803b050 con 0x555c9f9f0620 2024-08-20T05:16:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.219+0000 7fab86a00640 1 -- 172.21.15.37:0/2375319411 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fab98014c20 con 0x555c9f9f0620 2024-08-20T05:16:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.219+0000 7fab86a00640 1 -- 172.21.15.37:0/2375319411 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fab98031070 con 0x555c9f9f0620 2024-08-20T05:16:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.219+0000 7fabaaa27740 10 client.28850 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.219+0000 7fabaaa27740 1 -- 172.21.15.37:0/2375319411 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({fsmap=50}) -- 0x555c9f9fc920 con 0x555c9f9f0620 2024-08-20T05:16:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.220+0000 7fab86a00640 1 -- 172.21.15.37:0/2375319411 <== mon.2 v2:172.21.15.130:3300/0 4 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fab98021430 con 0x555c9f9f0620 2024-08-20T05:16:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.220+0000 7fabaaa27740 10 client.28850 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.220+0000 7fabaaa27740 10 client.28850 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:16:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.220+0000 7fabaaa27740 20 client.28850 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:23.222 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.220+0000 7fabaaa27740 1 --2- 172.21.15.37:0/2375319411 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x555c9fa7c620 0x555c9fa7ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.220+0000 7fabaaa27740 4 client.28850 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:16:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.220+0000 7fabaaa27740 1 -- 172.21.15.37:0/2375319411 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555c9f95bc00 con 0x555c9fa7c620 2024-08-20T05:16:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.221+0000 7faba5200640 1 --2- 172.21.15.37:0/2375319411 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x555c9fa7c620 0x555c9fa7ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.222+0000 7faba5200640 1 --2- 172.21.15.37:0/2375319411 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x555c9fa7c620 0x555c9fa7ea10 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c041d2df420c0c0 server_cookie=3a4eec97bde2eb0c in_seq=0 out_seq=0 2024-08-20T05:16:23.224 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.222+0000 7fab86a00640 10 client.28850 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:23.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.284+0000 7fab86a00640 1 -- 172.21.15.37:0/2375319411 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555c9f95bc00 con 0x555c9fa7c620 2024-08-20T05:16:23.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.284+0000 7fab86a00640 10 client.28850 handle_command_reply: tid=0 2024-08-20T05:16:23.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.284+0000 7fabaaa27740 1 client.28850 shutdown 2024-08-20T05:16:23.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.284+0000 7fabaaa27740 1 -- 172.21.15.37:0/2375319411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9f0620 msgr2=0x555c9f9fadc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:23.286 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.284+0000 7fabaaa27740 1 --2- 172.21.15.37:0/2375319411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9f0620 0x555c9f9fadc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x555c9f9f5aa0 tx=0x7fab98023070 comp rx=0 tx=0).stop 2024-08-20T05:16:23.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.284+0000 7fabaaa27740 1 -- 172.21.15.37:0/2375319411 shutdown_connections 2024-08-20T05:16:23.287 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.284+0000 7fabaaa27740 1 --2- 172.21.15.37:0/2375319411 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x555c9fa7c620 0x555c9fa7ea10 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.287+0000 7fabaaa27740 1 --2- 172.21.15.37:0/2375319411 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x555c9f9f0620 0x555c9f9fadc0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.287+0000 7fabaaa27740 1 --2- 172.21.15.37:0/2375319411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555c9f9edbe0 0x555c9f9fa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.287+0000 7fabaaa27740 1 --2- 172.21.15.37:0/2375319411 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x555c9f9e63b0 0x555c9f9f9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.287+0000 7fabaaa27740 1 -- 172.21.15.37:0/2375319411 >> 172.21.15.37:0/2375319411 conn(0x555c9f9eae90 msgr2=0x555c9f9f0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.287+0000 7fab86a00640 0 client.28850 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.287+0000 7fabaaa27740 1 -- 172.21.15.37:0/2375319411 shutdown_connections 2024-08-20T05:16:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.287+0000 7fabaaa27740 1 -- 172.21.15.37:0/2375319411 wait complete. 2024-08-20T05:16:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.287+0000 7fabaaa27740 20 client.28850 trim_cache size 0 max 16384 2024-08-20T05:16:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:16:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:16:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:16:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:16:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.289+0000 7faba7c00640 1 -- 172.21.15.37:0/3360272858 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fab880b3cd0 msgr2=0x7fab880b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.289+0000 7faba7c00640 1 --2- 172.21.15.37:0/3360272858 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fab880b3cd0 0x7fab880b6190 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fab9801e000 tx=0x7fab9801f000 comp rx=0 tx=0).stop 2024-08-20T05:16:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.289+0000 7faba7c00640 1 -- 172.21.15.37:0/3360272858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba0100c00 msgr2=0x7faba0101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.289+0000 7faba7c00640 1 --2- 172.21.15.37:0/3360272858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba0100c00 0x7faba0101e20 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fab94031500 tx=0x7fab94003d50 comp rx=0 tx=0).stop 2024-08-20T05:16:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.289+0000 7faba7c00640 1 -- 172.21.15.37:0/3360272858 shutdown_connections 2024-08-20T05:16:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.289+0000 7faba7c00640 1 --2- 172.21.15.37:0/3360272858 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fab880b3cd0 0x7fab880b6190 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.289+0000 7faba7c00640 1 --2- 172.21.15.37:0/3360272858 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7faba01083d0 0x7faba0102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.289+0000 7faba7c00640 1 --2- 172.21.15.37:0/3360272858 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7faba0100c00 0x7faba0101e20 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.289+0000 7faba7c00640 1 --2- 172.21.15.37:0/3360272858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba01002c0 0x7faba01035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.289+0000 7faba7c00640 1 -- 172.21.15.37:0/3360272858 >> 172.21.15.37:0/3360272858 conn(0x7faba00fc170 msgr2=0x7faba00fcd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.289+0000 7faba7c00640 1 -- 172.21.15.37:0/3360272858 shutdown_connections 2024-08-20T05:16:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:23.289+0000 7faba7c00640 1 -- 172.21.15.37:0/3360272858 wait complete. 2024-08-20T05:16:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:23 smithi130 ceph-mon[22007]: pgmap v825: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 355 KiB/s wr, 57 op/s 2024-08-20T05:16:24.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:23 smithi037 ceph-mon[17265]: pgmap v825: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 355 KiB/s wr, 57 op/s 2024-08-20T05:16:24.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:23 smithi135 ceph-mon[22342]: pgmap v825: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 355 KiB/s wr, 57 op/s 2024-08-20T05:16:25.476 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T05:16:25.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:16:25.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:25 smithi037 ceph-mon[17265]: pgmap v826: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 171 op/s 2024-08-20T05:16:25.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:25 smithi130 ceph-mon[22007]: pgmap v826: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 171 op/s 2024-08-20T05:16:26.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:25 smithi135 ceph-mon[22342]: pgmap v826: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 171 op/s 2024-08-20T05:16:26.237 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:16:26.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:26 smithi130 ceph-mon[22007]: pgmap v827: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 1.9 MiB/s wr, 202 op/s 2024-08-20T05:16:27.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:26 smithi037 ceph-mon[17265]: pgmap v827: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 1.9 MiB/s wr, 202 op/s 2024-08-20T05:16:27.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:26 smithi135 ceph-mon[22342]: pgmap v827: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 1.9 MiB/s wr, 202 op/s 2024-08-20T05:16:27.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.820+0000 7f03e0000640 1 -- 172.21.15.37:0/2030917895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03d8104ca0 msgr2=0x7f03d8105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:27.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.820+0000 7f03e0000640 1 --2- 172.21.15.37:0/2030917895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03d8104ca0 0x7f03d8105080 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f03cc009ca0 tx=0x7f03cc02a8c0 comp rx=0 tx=0).stop 2024-08-20T05:16:27.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.821+0000 7f03e0000640 1 -- 172.21.15.37:0/2030917895 shutdown_connections 2024-08-20T05:16:27.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.821+0000 7f03e0000640 1 --2- 172.21.15.37:0/2030917895 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03d810b030 0x7f03d8111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:27.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.821+0000 7f03e0000640 1 --2- 172.21.15.37:0/2030917895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d810a6b0 0x7f03d810aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:27.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.821+0000 7f03e0000640 1 --2- 172.21.15.37:0/2030917895 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03d8104ca0 0x7f03d8105080 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:27.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.821+0000 7f03e0000640 1 -- 172.21.15.37:0/2030917895 >> 172.21.15.37:0/2030917895 conn(0x7f03d81006f0 msgr2=0x7f03d8102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:27.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.821+0000 7f03e0000640 1 -- 172.21.15.37:0/2030917895 shutdown_connections 2024-08-20T05:16:27.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.821+0000 7f03e0000640 1 -- 172.21.15.37:0/2030917895 wait complete. 2024-08-20T05:16:27.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.822+0000 7f03e0000640 1 Processor -- start 2024-08-20T05:16:27.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.823+0000 7f03e0000640 1 -- start start 2024-08-20T05:16:27.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.823+0000 7f03e0000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03d8104ca0 0x7f03d819b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:27.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.823+0000 7f03e0000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03d810a6b0 0x7f03d819b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:27.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.823+0000 7f03e0000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d810b030 0x7f03d81a0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:27.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.824+0000 7f03e0000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f03d8114d40 con 0x7f03d810b030 2024-08-20T05:16:27.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.824+0000 7f03e0000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f03d8114bc0 con 0x7f03d8104ca0 2024-08-20T05:16:27.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.824+0000 7f03e0000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f03d8114ec0 con 0x7f03d810a6b0 2024-08-20T05:16:27.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.824+0000 7f03de000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d810b030 0x7f03d81a0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:27.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.824+0000 7f03de000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d810b030 0x7f03d81a0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38178/0 (socket says 172.21.15.37:38178) 2024-08-20T05:16:27.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.824+0000 7f03de000640 1 -- 172.21.15.37:0/2392074327 learned_addr learned my addr 172.21.15.37:0/2392074327 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:27.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.824+0000 7f03dcc00640 1 --2- 172.21.15.37:0/2392074327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03d810a6b0 0x7f03d819b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.826+0000 7f03dd600640 1 --2- 172.21.15.37:0/2392074327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03d8104ca0 0x7f03d819b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.830+0000 7f03de000640 1 -- 172.21.15.37:0/2392074327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03d810a6b0 msgr2=0x7f03d819b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.830+0000 7f03de000640 1 --2- 172.21.15.37:0/2392074327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03d810a6b0 0x7f03d819b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.830+0000 7f03de000640 1 -- 172.21.15.37:0/2392074327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03d8104ca0 msgr2=0x7f03d819b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.830+0000 7f03de000640 1 --2- 172.21.15.37:0/2392074327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03d8104ca0 0x7f03d819b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.830+0000 7f03de000640 1 -- 172.21.15.37:0/2392074327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d81a1240 con 0x7f03d810b030 2024-08-20T05:16:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.831+0000 7f03de000640 1 --2- 172.21.15.37:0/2392074327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d810b030 0x7f03d81a0a70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f03d000e970 tx=0x7f03d000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.832+0000 7f03d6000640 1 -- 172.21.15.37:0/2392074327 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d000ccc0 con 0x7f03d810b030 2024-08-20T05:16:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.832+0000 7f03d6000640 1 -- 172.21.15.37:0/2392074327 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03d000ce60 con 0x7f03d810b030 2024-08-20T05:16:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.832+0000 7f03d6000640 1 -- 172.21.15.37:0/2392074327 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d0010430 con 0x7f03d810b030 2024-08-20T05:16:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.832+0000 7f03e0000640 1 -- 172.21.15.37:0/2392074327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d81a1530 con 0x7f03d810b030 2024-08-20T05:16:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.832+0000 7f03e0000640 1 -- 172.21.15.37:0/2392074327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d81a7c70 con 0x7f03d810b030 2024-08-20T05:16:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.834+0000 7f03cb400640 1 -- 172.21.15.37:0/2392074327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03b4005290 con 0x7f03d810b030 2024-08-20T05:16:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.845+0000 7f03d6000640 1 -- 172.21.15.37:0/2392074327 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f03d0004f20 con 0x7f03d810b030 2024-08-20T05:16:27.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.849+0000 7f03d6000640 1 --2- 172.21.15.37:0/2392074327 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03c00b3de0 0x7f03c00b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:27.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.850+0000 7f03d6000640 1 -- 172.21.15.37:0/2392074327 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f03d00e43f0 con 0x7f03d810b030 2024-08-20T05:16:27.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.850+0000 7f03dd600640 1 --2- 172.21.15.37:0/2392074327 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03c00b3de0 0x7f03c00b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:27.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.851+0000 7f03dd600640 1 --2- 172.21.15.37:0/2392074327 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03c00b3de0 0x7f03c00b62a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f03cc005fe0 tx=0x7f03cc005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:27.852+0000 7f03d6000640 1 -- 172.21.15.37:0/2392074327 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f03d0055e20 con 0x7f03d810b030 2024-08-20T05:16:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 810.0 s, 491.4 tps, lat 197.231 ms stddev 221.259 2024-08-20T05:16:28.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:28.269+0000 7f03cb400640 1 -- 172.21.15.37:0/2392074327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f03b4005580 con 0x7f03d810b030 2024-08-20T05:16:28.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:28.271+0000 7f03d6000640 1 -- 172.21.15.37:0/2392074327 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11983 (secure 0 0 0) 0x7f03d00ab6c0 con 0x7f03d810b030 2024-08-20T05:16:28.273 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:16:28.273 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":50,"btime":"2024-08-20T05:15:39:521784+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:15:39.110643+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:16:28.274 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 50 2024-08-20T05:16:28.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:28.274+0000 7f03cb400640 1 -- 172.21.15.37:0/2392074327 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03c00b3de0 msgr2=0x7f03c00b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:28.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:28.274+0000 7f03cb400640 1 --2- 172.21.15.37:0/2392074327 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03c00b3de0 0x7f03c00b62a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f03cc005fe0 tx=0x7f03cc005f70 comp rx=0 tx=0).stop 2024-08-20T05:16:28.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:28.274+0000 7f03cb400640 1 -- 172.21.15.37:0/2392074327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d810b030 msgr2=0x7f03d81a0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:28.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:28.274+0000 7f03cb400640 1 --2- 172.21.15.37:0/2392074327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d810b030 0x7f03d81a0a70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f03d000e970 tx=0x7f03d000ed70 comp rx=0 tx=0).stop 2024-08-20T05:16:28.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:28.274+0000 7f03cb400640 1 -- 172.21.15.37:0/2392074327 shutdown_connections 2024-08-20T05:16:28.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:28.274+0000 7f03cb400640 1 --2- 172.21.15.37:0/2392074327 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f03c00b3de0 0x7f03c00b62a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:28.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:28.274+0000 7f03cb400640 1 --2- 172.21.15.37:0/2392074327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03d810b030 0x7f03d81a0a70 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:28.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:28.274+0000 7f03cb400640 1 --2- 172.21.15.37:0/2392074327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f03d810a6b0 0x7f03d819b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:28.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:28.274+0000 7f03cb400640 1 --2- 172.21.15.37:0/2392074327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f03d8104ca0 0x7f03d819b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:28.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:28.274+0000 7f03cb400640 1 -- 172.21.15.37:0/2392074327 >> 172.21.15.37:0/2392074327 conn(0x7f03d81006f0 msgr2=0x7f03d8102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:28.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:28.275+0000 7f03cb400640 1 -- 172.21.15.37:0/2392074327 shutdown_connections 2024-08-20T05:16:28.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:28.276+0000 7f03cb400640 1 -- 172.21.15.37:0/2392074327 wait complete. 2024-08-20T05:16:28.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:28 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2392074327' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:16:28.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:28 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2392074327' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:16:28.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:28 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2392074327' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:16:29.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:29 smithi135 ceph-mon[22342]: pgmap v828: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 3.1 MiB/s wr, 322 op/s 2024-08-20T05:16:29.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:29 smithi130 ceph-mon[22007]: pgmap v828: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 3.1 MiB/s wr, 322 op/s 2024-08-20T05:16:29.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:29 smithi037 ceph-mon[17265]: pgmap v828: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 3.1 MiB/s wr, 322 op/s 2024-08-20T05:16:29.993 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T05:16:30.754 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:16:31.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.818+0000 7f3f34200640 1 -- 172.21.15.37:0/495399492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c07cc90 msgr2=0x7f3f2c085680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:31.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:31 smithi037 ceph-mon[17265]: pgmap v829: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 3.6 MiB/s wr, 380 op/s 2024-08-20T05:16:31.821 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:31 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:16:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.818+0000 7f3f34200640 1 --2- 172.21.15.37:0/495399492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c07cc90 0x7f3f2c085680 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3f20009900 tx=0x7f3f2002a410 comp rx=0 tx=0).stop 2024-08-20T05:16:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.819+0000 7f3f34200640 1 -- 172.21.15.37:0/495399492 shutdown_connections 2024-08-20T05:16:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.819+0000 7f3f34200640 1 --2- 172.21.15.37:0/495399492 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f2c07f2c0 0x7f3f2c07f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.819+0000 7f3f34200640 1 --2- 172.21.15.37:0/495399492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f2c07d070 0x7f3f2c07d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.819+0000 7f3f34200640 1 --2- 172.21.15.37:0/495399492 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c07cc90 0x7f3f2c085680 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.819+0000 7f3f34200640 1 -- 172.21.15.37:0/495399492 >> 172.21.15.37:0/495399492 conn(0x7f3f2c078810 msgr2=0x7f3f2c07ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.819+0000 7f3f34200640 1 -- 172.21.15.37:0/495399492 shutdown_connections 2024-08-20T05:16:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.820+0000 7f3f34200640 1 -- 172.21.15.37:0/495399492 wait complete. 2024-08-20T05:16:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.821+0000 7f3f34200640 1 Processor -- start 2024-08-20T05:16:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.822+0000 7f3f34200640 1 -- start start 2024-08-20T05:16:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.823+0000 7f3f34200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f2c07cc90 0x7f3f2c074300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.823+0000 7f3f34200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c07d070 0x7f3f2c074840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.823+0000 7f3f34200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f2c07f2c0 0x7f3f2c06d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.824+0000 7f3f30e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c07d070 0x7f3f2c074840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.824+0000 7f3f30e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c07d070 0x7f3f2c074840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42576/0 (socket says 172.21.15.37:42576) 2024-08-20T05:16:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.824+0000 7f3f31800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f2c07cc90 0x7f3f2c074300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.824+0000 7f3f31800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f2c07cc90 0x7f3f2c074300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50312/0 (socket says 172.21.15.37:50312) 2024-08-20T05:16:31.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.825+0000 7f3f34200640 1 -- 172.21.15.37:0/4273254474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c121960 con 0x7f3f2c07f2c0 2024-08-20T05:16:31.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.825+0000 7f3f34200640 1 -- 172.21.15.37:0/4273254474 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c1217e0 con 0x7f3f2c07d070 2024-08-20T05:16:31.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.825+0000 7f3f34200640 1 -- 172.21.15.37:0/4273254474 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c121ae0 con 0x7f3f2c07cc90 2024-08-20T05:16:31.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.825+0000 7f3f32200640 1 --2- 172.21.15.37:0/4273254474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f2c07f2c0 0x7f3f2c06d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:31.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.825+0000 7f3f30e00640 1 -- 172.21.15.37:0/4273254474 learned_addr learned my addr 172.21.15.37:0/4273254474 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:31.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.826+0000 7f3f32200640 1 -- 172.21.15.37:0/4273254474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f2c07cc90 msgr2=0x7f3f2c074300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:31.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.826+0000 7f3f32200640 1 --2- 172.21.15.37:0/4273254474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f2c07cc90 0x7f3f2c074300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.826+0000 7f3f32200640 1 -- 172.21.15.37:0/4273254474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c07d070 msgr2=0x7f3f2c074840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:31.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.826+0000 7f3f32200640 1 --2- 172.21.15.37:0/4273254474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c07d070 0x7f3f2c074840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.826+0000 7f3f32200640 1 -- 172.21.15.37:0/4273254474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2c06ddf0 con 0x7f3f2c07f2c0 2024-08-20T05:16:31.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.828+0000 7f3f32200640 1 --2- 172.21.15.37:0/4273254474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f2c07f2c0 0x7f3f2c06d530 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400be20 tx=0x7f3f2400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:31.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.829+0000 7f3f2a000640 1 -- 172.21.15.37:0/4273254474 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f24019070 con 0x7f3f2c07f2c0 2024-08-20T05:16:31.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.830+0000 7f3f2a000640 1 -- 172.21.15.37:0/4273254474 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f2400cdf0 con 0x7f3f2c07f2c0 2024-08-20T05:16:31.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.831+0000 7f3f2a000640 1 -- 172.21.15.37:0/4273254474 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f24012880 con 0x7f3f2c07f2c0 2024-08-20T05:16:31.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.831+0000 7f3f34200640 1 -- 172.21.15.37:0/4273254474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f2c06e0e0 con 0x7f3f2c07f2c0 2024-08-20T05:16:31.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.831+0000 7f3f34200640 1 -- 172.21.15.37:0/4273254474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f2c073140 con 0x7f3f2c07f2c0 2024-08-20T05:16:31.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.837+0000 7f3f36e8c740 1 Processor -- start 2024-08-20T05:16:31.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.838+0000 7f3f2a000640 1 -- 172.21.15.37:0/4273254474 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3f24012a20 con 0x7f3f2c07f2c0 2024-08-20T05:16:31.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.838+0000 7f3f36e8c740 1 -- start start 2024-08-20T05:16:31.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.839+0000 7f3f36e8c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a79990 0x559e13a79d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.839+0000 7f3f36e8c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a7a2b0 0x559e13a85d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.839+0000 7f3f36e8c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a86240 0x559e13a88630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.839+0000 7f3f36e8c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559e139efaa0 con 0x559e13a7a2b0 2024-08-20T05:16:31.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.841+0000 7f3f30e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a79990 0x559e13a79d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:31.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.841+0000 7f3f30e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a79990 0x559e13a79d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50320/0 (socket says 172.21.15.37:50320) 2024-08-20T05:16:31.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.841+0000 7f3f30e00640 1 -- 172.21.15.37:0/2564894283 learned_addr learned my addr 172.21.15.37:0/2564894283 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:31.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.841+0000 7f3f36e8c740 1 -- 172.21.15.37:0/2564894283 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559e139defa0 con 0x559e13a86240 2024-08-20T05:16:31.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.842+0000 7f3f36e8c740 1 -- 172.21.15.37:0/2564894283 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559e139e2fe0 con 0x559e13a79990 2024-08-20T05:16:31.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.842+0000 7f3f30e00640 1 --2- 172.21.15.37:0/2564894283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a86240 0x559e13a88630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:31.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.843+0000 7f3f31800640 1 --2- 172.21.15.37:0/2564894283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a7a2b0 0x559e13a85d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:31.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.843+0000 7f3f2a000640 1 --2- 172.21.15.37:0/4273254474 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3f140b3cd0 0x7f3f140b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.843+0000 7f3f2a000640 1 -- 172.21.15.37:0/4273254474 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3f240e3870 con 0x7f3f2c07f2c0 2024-08-20T05:16:31.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.845+0000 7f3f31800640 1 -- 172.21.15.37:0/2564894283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a79990 msgr2=0x559e13a79d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:31.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.845+0000 7f3f31800640 1 --2- 172.21.15.37:0/2564894283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a79990 0x559e13a79d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.845+0000 7f3f31800640 1 -- 172.21.15.37:0/2564894283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a86240 msgr2=0x559e13a88630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:31.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.845+0000 7f3f31800640 1 --2- 172.21.15.37:0/2564894283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a86240 0x559e13a88630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.845+0000 7f3f31800640 1 -- 172.21.15.37:0/2564894283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e13985420 con 0x559e13a7a2b0 2024-08-20T05:16:31.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.846+0000 7f3f31800640 1 --2- 172.21.15.37:0/2564894283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a7a2b0 0x559e13a85d00 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3f20009850 tx=0x7f3f20004fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1344658991bb0ba9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:31.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.847+0000 7f3f1ea00640 1 -- 172.21.15.37:0/2564894283 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f20035030 con 0x559e13a7a2b0 2024-08-20T05:16:31.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.847+0000 7f3f1ea00640 1 -- 172.21.15.37:0/2564894283 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f200047a0 con 0x559e13a7a2b0 2024-08-20T05:16:31.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.848+0000 7f3f36e8c740 1 -- 172.21.15.37:0/2564894283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a7a2b0 msgr2=0x559e13a85d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:31.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.849+0000 7f3f1ea00640 1 -- 172.21.15.37:0/2564894283 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f20035030 con 0x559e13a7a2b0 2024-08-20T05:16:31.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.849+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/2564894283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a7a2b0 0x559e13a85d00 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3f20009850 tx=0x7f3f20004fe0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.850+0000 7f3f36e8c740 1 -- 172.21.15.37:0/2564894283 shutdown_connections 2024-08-20T05:16:31.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.850+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/2564894283 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a86240 0x559e13a88630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.850+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/2564894283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a7a2b0 0x559e13a85d00 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.850+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/2564894283 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a79990 0x559e13a79d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.850+0000 7f3f36e8c740 1 -- 172.21.15.37:0/2564894283 >> 172.21.15.37:0/2564894283 conn(0x559e13a777c0 msgr2=0x559e13a78960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:31.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.853+0000 7f3f32200640 1 --2- 172.21.15.37:0/4273254474 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3f140b3cd0 0x7f3f140b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:31.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.854+0000 7f3f32200640 1 --2- 172.21.15.37:0/4273254474 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3f140b3cd0 0x7f3f140b6190 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3f240aa350 tx=0x7f3f24014e00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.860+0000 7f3f36e8c740 1 -- 172.21.15.37:0/2564894283 shutdown_connections 2024-08-20T05:16:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.862+0000 7f3f36e8c740 1 -- 172.21.15.37:0/2564894283 wait complete. 2024-08-20T05:16:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.862+0000 7f3f36e8c740 1 -- start start 2024-08-20T05:16:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.863+0000 7f3f36e8c740 1 Processor -- start 2024-08-20T05:16:31.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:31 smithi135 ceph-mon[22342]: pgmap v829: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 3.6 MiB/s wr, 380 op/s 2024-08-20T05:16:31.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:31 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:16:31.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.864+0000 7f3f36e8c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a7a2b0 0x559e13a85b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.865+0000 7f3f36e8c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a82f90 0x559e13a833d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.865+0000 7f3f30e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a7a2b0 0x559e13a85b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.865+0000 7f3f30e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a7a2b0 0x559e13a85b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50326/0 (socket says 172.21.15.37:50326) 2024-08-20T05:16:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.865+0000 7f3f36e8c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a83910 0x559e13a92300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.865+0000 7f3f30e00640 1 -- 172.21.15.37:0/4063461845 learned_addr learned my addr 172.21.15.37:0/4063461845 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.865+0000 7f3f36e8c740 1 -- 172.21.15.37:0/4063461845 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559e13841700 con 0x559e13a83910 2024-08-20T05:16:31.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.865+0000 7f3f36e8c740 1 -- 172.21.15.37:0/4063461845 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x559e1397a290 con 0x559e13a82f90 2024-08-20T05:16:31.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.865+0000 7f3f36e8c740 1 -- 172.21.15.37:0/4063461845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x559e13a88f10 con 0x559e13a7a2b0 2024-08-20T05:16:31.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.865+0000 7f3f36e8c740 10 client.0 _ll_register_callbacks cb 0x559e139d91c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:31.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.866+0000 7f3f30e00640 1 --2- 172.21.15.37:0/4063461845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a83910 0x559e13a92300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:31.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.866+0000 7f3f30e00640 1 -- 172.21.15.37:0/4063461845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a82f90 msgr2=0x559e13a833d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:31.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.866+0000 7f3f30e00640 1 --2- 172.21.15.37:0/4063461845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a82f90 0x559e13a833d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.866+0000 7f3f30e00640 1 -- 172.21.15.37:0/4063461845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a83910 msgr2=0x559e13a92300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:31.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.866+0000 7f3f30e00640 1 --2- 172.21.15.37:0/4063461845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a83910 0x559e13a92300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.866+0000 7f3f30e00640 1 -- 172.21.15.37:0/4063461845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e1373e650 con 0x559e13a7a2b0 2024-08-20T05:16:31.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.867+0000 7f3f30e00640 1 --2- 172.21.15.37:0/4063461845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a7a2b0 0x559e13a85b40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3f18019c20 tx=0x7f3f180047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8809cdfb573f52a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:31.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.867+0000 7f3f13400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:16:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.867+0000 7f3f13400640 1 -- 172.21.15.37:0/4063461845 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18016da0 con 0x559e13a7a2b0 2024-08-20T05:16:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.868+0000 7f3f13400640 1 -- 172.21.15.37:0/4063461845 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3f180173e0 con 0x559e13a7a2b0 2024-08-20T05:16:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.868+0000 7f3f36e8c740 1 -- 172.21.15.37:0/4063461845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f200047a0 con 0x559e13a7a2b0 2024-08-20T05:16:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.869+0000 7f3f13400640 1 -- 172.21.15.37:0/4063461845 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f3f180175e0 con 0x559e13a7a2b0 2024-08-20T05:16:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.869+0000 7f3f36e8c740 10 client.28906 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.869+0000 7f3f36e8c740 1 -- 172.21.15.37:0/4063461845 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x559e13a950c0 con 0x559e13a7a2b0 2024-08-20T05:16:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.869+0000 7f3f13400640 1 -- 172.21.15.37:0/4063461845 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f200047a0 con 0x559e13a7a2b0 2024-08-20T05:16:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.870+0000 7f3f13400640 1 -- 172.21.15.37:0/4063461845 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f3f18015040 con 0x559e13a7a2b0 2024-08-20T05:16:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.870+0000 7f3f36e8c740 10 client.28906 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.870+0000 7f3f36e8c740 10 client.28906 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:16:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.870+0000 7f3f36e8c740 20 client.28906 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.871+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/4063461845 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x559e13a96620 0x559e13a98a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.871+0000 7f3f36e8c740 4 client.28906 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:16:31.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.871+0000 7f3f36e8c740 1 -- 172.21.15.37:0/4063461845 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e139f19f0 con 0x559e13a96620 2024-08-20T05:16:31.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.872+0000 7f3f31800640 1 --2- 172.21.15.37:0/4063461845 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x559e13a96620 0x559e13a98a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.878+0000 7f3f31800640 1 --2- 172.21.15.37:0/4063461845 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x559e13a96620 0x559e13a98a50 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ad67bbea3527ceb3 server_cookie=a813a649a3c86757 in_seq=0 out_seq=0 2024-08-20T05:16:31.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.878+0000 7f3f13400640 10 client.28906 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:16:31.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.879+0000 7f3f13400640 1 -- 172.21.15.37:0/4063461845 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559e139f19f0 con 0x559e13a96620 2024-08-20T05:16:31.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.879+0000 7f3f13400640 10 client.28906 handle_command_reply: tid=0 2024-08-20T05:16:31.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.880+0000 7f3f36e8c740 1 client.28906 shutdown 2024-08-20T05:16:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.881+0000 7f3f36e8c740 1 -- 172.21.15.37:0/4063461845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a7a2b0 msgr2=0x559e13a85b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.881+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/4063461845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a7a2b0 0x559e13a85b40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3f18019c20 tx=0x7f3f180047d0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.882+0000 7f3f36e8c740 1 -- 172.21.15.37:0/4063461845 shutdown_connections 2024-08-20T05:16:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.882+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/4063461845 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x559e13a96620 0x559e13a98a50 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.882+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/4063461845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a83910 0x559e13a92300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.882+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/4063461845 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a82f90 0x559e13a833d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.882+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/4063461845 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a7a2b0 0x559e13a85b40 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.882+0000 7f3f36e8c740 1 -- 172.21.15.37:0/4063461845 >> 172.21.15.37:0/4063461845 conn(0x559e13a777c0 msgr2=0x559e13a7d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.883+0000 7f3f13400640 0 client.28906 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:16:31.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.884+0000 7f3f36e8c740 1 -- 172.21.15.37:0/4063461845 shutdown_connections 2024-08-20T05:16:31.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.884+0000 7f3f36e8c740 1 -- 172.21.15.37:0/4063461845 wait complete. 2024-08-20T05:16:31.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.885+0000 7f3f36e8c740 20 client.28906 trim_cache size 0 max 16384 2024-08-20T05:16:31.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.935+0000 7f3f36e8c740 1 Processor -- start 2024-08-20T05:16:31.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.935+0000 7f3f36e8c740 1 -- start start 2024-08-20T05:16:31.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.935+0000 7f3f36e8c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a7a2b0 0x559e13a76830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.935+0000 7f3f36e8c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a82f90 0x559e13a76d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.935+0000 7f3f36e8c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a83910 0x559e13a9e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.935+0000 7f3f36e8c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c1c6d60 con 0x559e13a82f90 2024-08-20T05:16:31.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.935+0000 7f3f36e8c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c1c8900 con 0x559e13a7a2b0 2024-08-20T05:16:31.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.935+0000 7f3f36e8c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c1c7430 con 0x559e13a83910 2024-08-20T05:16:31.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.937+0000 7f3f30e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a7a2b0 0x559e13a76830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:31.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.937+0000 7f3f30e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a7a2b0 0x559e13a76830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42606/0 (socket says 172.21.15.37:42606) 2024-08-20T05:16:31.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.937+0000 7f3f30e00640 1 -- 172.21.15.37:0/3331145074 learned_addr learned my addr 172.21.15.37:0/3331145074 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:31.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.937+0000 7f3f30e00640 1 --2- 172.21.15.37:0/3331145074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a83910 0x559e13a9e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:31.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.938+0000 7f3f30e00640 1 -- 172.21.15.37:0/3331145074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a83910 msgr2=0x559e13a9e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:31.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.938+0000 7f3f30e00640 1 --2- 172.21.15.37:0/3331145074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a83910 0x559e13a9e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.938+0000 7f3f30e00640 1 -- 172.21.15.37:0/3331145074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a82f90 msgr2=0x559e13a76d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:31.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.938+0000 7f3f30e00640 1 --2- 172.21.15.37:0/3331145074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a82f90 0x559e13a76d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.939+0000 7f3f30e00640 1 -- 172.21.15.37:0/3331145074 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e13a82d40 con 0x559e13a7a2b0 2024-08-20T05:16:31.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.940+0000 7f3f30e00640 1 --2- 172.21.15.37:0/3331145074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a7a2b0 0x559e13a76830 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3f180199c0 tx=0x7f3f180046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd581595ce84cec5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:31.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.940+0000 7f3f1e000640 1 -- 172.21.15.37:0/3331145074 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18035070 con 0x559e13a7a2b0 2024-08-20T05:16:31.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.940+0000 7f3f1e000640 1 -- 172.21.15.37:0/3331145074 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f1801f070 con 0x559e13a7a2b0 2024-08-20T05:16:31.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.940+0000 7f3f1e000640 1 -- 172.21.15.37:0/3331145074 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18017c30 con 0x559e13a7a2b0 2024-08-20T05:16:31.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.942+0000 7f3f36e8c740 1 -- 172.21.15.37:0/3331145074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a7a2b0 msgr2=0x559e13a76830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:31.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.942+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/3331145074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a7a2b0 0x559e13a76830 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3f180199c0 tx=0x7f3f180046c0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.942+0000 7f3f36e8c740 1 -- 172.21.15.37:0/3331145074 shutdown_connections 2024-08-20T05:16:31.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.942+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/3331145074 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a83910 0x559e13a9e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.942+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/3331145074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a82f90 0x559e13a76d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.942+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/3331145074 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a7a2b0 0x559e13a76830 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.942+0000 7f3f36e8c740 1 -- 172.21.15.37:0/3331145074 >> 172.21.15.37:0/3331145074 conn(0x559e13a777c0 msgr2=0x559e13a76120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:31.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.943+0000 7f3f36e8c740 1 -- 172.21.15.37:0/3331145074 shutdown_connections 2024-08-20T05:16:31.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.943+0000 7f3f36e8c740 1 -- 172.21.15.37:0/3331145074 wait complete. 2024-08-20T05:16:31.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.945+0000 7f3f36e8c740 1 -- start start 2024-08-20T05:16:31.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.946+0000 7f3f36e8c740 1 Processor -- start 2024-08-20T05:16:31.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.947+0000 7f3f36e8c740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a7a2b0 0x559e13a8e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.947+0000 7f3f36e8c740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a82f90 0x559e13a89c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.948+0000 7f3f36e8c740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a83910 0x559e13a8a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.948+0000 7f3f36e8c740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c1c8230 con 0x559e13a7a2b0 2024-08-20T05:16:31.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.948+0000 7f3f36e8c740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c1c7b00 con 0x559e13a82f90 2024-08-20T05:16:31.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.948+0000 7f3f36e8c740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c1c4df0 con 0x559e13a83910 2024-08-20T05:16:31.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.948+0000 7f3f36e8c740 10 client.0 _ll_register_callbacks cb 0x7f3f1800a230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:31.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.949+0000 7f3f30e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a7a2b0 0x559e13a8e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:31.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.949+0000 7f3f30e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a7a2b0 0x559e13a8e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38212/0 (socket says 172.21.15.37:38212) 2024-08-20T05:16:31.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.949+0000 7f3f30e00640 1 -- 172.21.15.37:0/3498101721 learned_addr learned my addr 172.21.15.37:0/3498101721 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:31.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.949+0000 7f3f30e00640 1 --2- 172.21.15.37:0/3498101721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a83910 0x559e13a8a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.950+0000 7f3f30e00640 1 -- 172.21.15.37:0/3498101721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a82f90 msgr2=0x559e13a89c00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:16:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.950+0000 7f3f30e00640 1 --2- 172.21.15.37:0/3498101721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a82f90 0x559e13a89c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.950+0000 7f3f30e00640 1 -- 172.21.15.37:0/3498101721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a7a2b0 msgr2=0x559e13a8e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.950+0000 7f3f30e00640 1 --2- 172.21.15.37:0/3498101721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a7a2b0 0x559e13a8e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.950+0000 7f3f30e00640 1 -- 172.21.15.37:0/3498101721 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e13a8a750 con 0x559e13a83910 2024-08-20T05:16:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.951+0000 7f3f30e00640 1 --2- 172.21.15.37:0/3498101721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a83910 0x559e13a8a140 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800ac80 tx=0x7f3f18000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c573d5a8d9d4573b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:31.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.951+0000 7f3f13400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:16:31.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.953+0000 7f3f13400640 1 -- 172.21.15.37:0/3498101721 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18035030 con 0x559e13a83910 2024-08-20T05:16:31.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.953+0000 7f3f13400640 1 -- 172.21.15.37:0/3498101721 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3f18017780 con 0x559e13a83910 2024-08-20T05:16:31.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.953+0000 7f3f36e8c740 1 -- 172.21.15.37:0/3498101721 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f1801f070 con 0x559e13a83910 2024-08-20T05:16:31.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:31 smithi130 ceph-mon[22007]: pgmap v829: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 3.6 MiB/s wr, 380 op/s 2024-08-20T05:16:31.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:31 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:16:31.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.954+0000 7f3f13400640 1 -- 172.21.15.37:0/3498101721 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f3f18015a80 con 0x559e13a83910 2024-08-20T05:16:31.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.954+0000 7f3f36e8c740 10 client.28912 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:31.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.954+0000 7f3f36e8c740 1 -- 172.21.15.37:0/3498101721 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x559e13b01180 con 0x559e13a83910 2024-08-20T05:16:31.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.954+0000 7f3f13400640 1 -- 172.21.15.37:0/3498101721 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f1801f070 con 0x559e13a83910 2024-08-20T05:16:31.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.955+0000 7f3f13400640 1 -- 172.21.15.37:0/3498101721 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f3f1800f050 con 0x559e13a83910 2024-08-20T05:16:31.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.955+0000 7f3f36e8c740 10 client.28912 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:31.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.955+0000 7f3f36e8c740 10 client.28912 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:16:31.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.955+0000 7f3f36e8c740 20 client.28912 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:31.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.955+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/3498101721 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x559e13b01770 0x559e13b03b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:31.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.955+0000 7f3f36e8c740 4 client.28912 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:16:31.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.955+0000 7f3f36e8c740 1 -- 172.21.15.37:0/3498101721 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559e139ed490 con 0x559e13b01770 2024-08-20T05:16:31.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.955+0000 7f3f31800640 1 --2- 172.21.15.37:0/3498101721 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x559e13b01770 0x559e13b03b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:31.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.957+0000 7f3f31800640 1 --2- 172.21.15.37:0/3498101721 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x559e13b01770 0x559e13b03b90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=495ad6272fd92e1d server_cookie=9cca7576eca445c5 in_seq=0 out_seq=0 2024-08-20T05:16:31.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.957+0000 7f3f13400640 10 client.28912 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:16:31.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.957+0000 7f3f13400640 1 -- 172.21.15.37:0/3498101721 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559e139ed490 con 0x559e13b01770 2024-08-20T05:16:31.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.957+0000 7f3f13400640 10 client.28912 handle_command_reply: tid=0 2024-08-20T05:16:31.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.957+0000 7f3f36e8c740 1 client.28912 shutdown 2024-08-20T05:16:31.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.957+0000 7f3f36e8c740 1 -- 172.21.15.37:0/3498101721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a83910 msgr2=0x559e13a8a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:31.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.957+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/3498101721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a83910 0x559e13a8a140 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800ac80 tx=0x7f3f18000bc0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.958+0000 7f3f36e8c740 1 -- 172.21.15.37:0/3498101721 shutdown_connections 2024-08-20T05:16:31.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.958+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/3498101721 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x559e13b01770 0x559e13b03b90 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.958+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/3498101721 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x559e13a83910 0x559e13a8a140 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.958+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/3498101721 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x559e13a82f90 0x559e13a89c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.958+0000 7f3f36e8c740 1 --2- 172.21.15.37:0/3498101721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559e13a7a2b0 0x559e13a8e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.958+0000 7f3f13400640 0 client.28912 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:16:31.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.958+0000 7f3f36e8c740 1 -- 172.21.15.37:0/3498101721 >> 172.21.15.37:0/3498101721 conn(0x559e13a777c0 msgr2=0x559e13a76940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:31.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.959+0000 7f3f36e8c740 1 -- 172.21.15.37:0/3498101721 shutdown_connections 2024-08-20T05:16:31.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.959+0000 7f3f36e8c740 1 -- 172.21.15.37:0/3498101721 wait complete. 2024-08-20T05:16:31.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.959+0000 7f3f36e8c740 20 client.28912 trim_cache size 0 max 16384 2024-08-20T05:16:31.962 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:16:31.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.960+0000 7f3f34200640 1 -- 172.21.15.37:0/4273254474 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3f140b3cd0 msgr2=0x7f3f140b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:31.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.960+0000 7f3f34200640 1 --2- 172.21.15.37:0/4273254474 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3f140b3cd0 0x7f3f140b6190 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3f240aa350 tx=0x7f3f24014e00 comp rx=0 tx=0).stop 2024-08-20T05:16:31.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.960+0000 7f3f34200640 1 -- 172.21.15.37:0/4273254474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f2c07f2c0 msgr2=0x7f3f2c06d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:31.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.960+0000 7f3f34200640 1 --2- 172.21.15.37:0/4273254474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f2c07f2c0 0x7f3f2c06d530 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400be20 tx=0x7f3f2400bf10 comp rx=0 tx=0).stop 2024-08-20T05:16:31.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.961+0000 7f3f34200640 1 -- 172.21.15.37:0/4273254474 shutdown_connections 2024-08-20T05:16:31.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.961+0000 7f3f34200640 1 --2- 172.21.15.37:0/4273254474 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3f140b3cd0 0x7f3f140b6190 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.961+0000 7f3f34200640 1 --2- 172.21.15.37:0/4273254474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f2c07f2c0 0x7f3f2c06d530 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.961+0000 7f3f34200640 1 --2- 172.21.15.37:0/4273254474 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3f2c07d070 0x7f3f2c074840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.961+0000 7f3f34200640 1 --2- 172.21.15.37:0/4273254474 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3f2c07cc90 0x7f3f2c074300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:31.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.961+0000 7f3f34200640 1 -- 172.21.15.37:0/4273254474 >> 172.21.15.37:0/4273254474 conn(0x7f3f2c078810 msgr2=0x7f3f2c082480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:31.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.962+0000 7f3f34200640 1 -- 172.21.15.37:0/4273254474 shutdown_connections 2024-08-20T05:16:31.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:31.962+0000 7f3f34200640 1 -- 172.21.15.37:0/4273254474 wait complete. 2024-08-20T05:16:33.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 815.0 s, 474.2 tps, lat 211.465 ms stddev 270.711 2024-08-20T05:16:33.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T05:16:33.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:33 smithi135 ceph-mon[22342]: pgmap v830: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 4.4 MiB/s wr, 465 op/s 2024-08-20T05:16:33.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:16:33.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:16:33.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:16:33.959 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:33 smithi130 ceph-mon[22007]: pgmap v830: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 4.4 MiB/s wr, 465 op/s 2024-08-20T05:16:33.959 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:16:33.959 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:16:33.959 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:16:34.005 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:16:34.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:33 smithi037 ceph-mon[17265]: pgmap v830: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 4.4 MiB/s wr, 465 op/s 2024-08-20T05:16:34.018 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:16:34.018 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:16:34.018 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:16:34.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.804+0000 7f75bf600640 1 -- 172.21.15.37:0/3914350141 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b81042e0 msgr2=0x7f75b810c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:34.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.804+0000 7f75bf600640 1 --2- 172.21.15.37:0/3914350141 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b81042e0 0x7f75b810c7d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009860 tx=0x7f75a402a340 comp rx=0 tx=0).stop 2024-08-20T05:16:34.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.804+0000 7f75bf600640 1 -- 172.21.15.37:0/3914350141 shutdown_connections 2024-08-20T05:16:34.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.804+0000 7f75bf600640 1 --2- 172.21.15.37:0/3914350141 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75b810ce20 0x7f75b810f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.804+0000 7f75bf600640 1 --2- 172.21.15.37:0/3914350141 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b81042e0 0x7f75b810c7d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.804+0000 7f75bf600640 1 --2- 172.21.15.37:0/3914350141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b81039c0 0x7f75b8103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.804+0000 7f75bf600640 1 -- 172.21.15.37:0/3914350141 >> 172.21.15.37:0/3914350141 conn(0x7f75b80fd400 msgr2=0x7f75b80ff820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:34.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.804+0000 7f75bf600640 1 -- 172.21.15.37:0/3914350141 shutdown_connections 2024-08-20T05:16:34.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.804+0000 7f75bf600640 1 -- 172.21.15.37:0/3914350141 wait complete. 2024-08-20T05:16:34.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.805+0000 7f75bf600640 1 Processor -- start 2024-08-20T05:16:34.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.806+0000 7f75bf600640 1 -- start start 2024-08-20T05:16:34.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.806+0000 7f75bf600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b81039c0 0x7f75b8198fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.806+0000 7f75bf600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b81042e0 0x7f75b8199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.806+0000 7f75bf600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75b810ce20 0x7f75b819e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.806+0000 7f75bf600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f75b8112a90 con 0x7f75b81039c0 2024-08-20T05:16:34.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.806+0000 7f75bf600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f75b8112910 con 0x7f75b81042e0 2024-08-20T05:16:34.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.806+0000 7f75bf600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f75b8112c10 con 0x7f75b810ce20 2024-08-20T05:16:34.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.807+0000 7f75bd600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75b810ce20 0x7f75b819e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:34.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.807+0000 7f75bd600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75b810ce20 0x7f75b819e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49820/0 (socket says 172.21.15.37:49820) 2024-08-20T05:16:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.807+0000 7f75bd600640 1 -- 172.21.15.37:0/2973821591 learned_addr learned my addr 172.21.15.37:0/2973821591 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.807+0000 7f75b7e00640 1 --2- 172.21.15.37:0/2973821591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b81042e0 0x7f75b8199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.807+0000 7f75bcc00640 1 --2- 172.21.15.37:0/2973821591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b81039c0 0x7f75b8198fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.807+0000 7f75bd600640 1 -- 172.21.15.37:0/2973821591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b81042e0 msgr2=0x7f75b8199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.807+0000 7f75bd600640 1 --2- 172.21.15.37:0/2973821591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b81042e0 0x7f75b8199520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.807+0000 7f75bd600640 1 -- 172.21.15.37:0/2973821591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b81039c0 msgr2=0x7f75b8198fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.807+0000 7f75bd600640 1 --2- 172.21.15.37:0/2973821591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b81039c0 0x7f75b8198fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.807+0000 7f75bd600640 1 -- 172.21.15.37:0/2973821591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75b819f090 con 0x7f75b810ce20 2024-08-20T05:16:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.807+0000 7f75bcc00640 1 --2- 172.21.15.37:0/2973821591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b81039c0 0x7f75b8198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:16:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.807+0000 7f75bd600640 1 --2- 172.21.15.37:0/2973821591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75b810ce20 0x7f75b819e8c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f75b000efd0 tx=0x7f75b000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.808+0000 7f75b5600640 1 -- 172.21.15.37:0/2973821591 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b0003b70 con 0x7f75b810ce20 2024-08-20T05:16:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.808+0000 7f75b5600640 1 -- 172.21.15.37:0/2973821591 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75b0003d10 con 0x7f75b810ce20 2024-08-20T05:16:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.808+0000 7f75b5600640 1 -- 172.21.15.37:0/2973821591 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75b0004660 con 0x7f75b810ce20 2024-08-20T05:16:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.808+0000 7f75bf600640 1 -- 172.21.15.37:0/2973821591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75b819f380 con 0x7f75b810ce20 2024-08-20T05:16:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.808+0000 7f75bf600640 1 -- 172.21.15.37:0/2973821591 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75b8101550 con 0x7f75b810ce20 2024-08-20T05:16:34.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.814+0000 7f75b5600640 1 -- 172.21.15.37:0/2973821591 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f75b00137d0 con 0x7f75b810ce20 2024-08-20T05:16:34.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.815+0000 7f75c2281740 1 Processor -- start 2024-08-20T05:16:34.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.815+0000 7f75c2281740 1 -- start start 2024-08-20T05:16:34.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.816+0000 7f75c2281740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad114d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.816+0000 7f75c2281740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad1152b0 0x55f9ad120d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.816+0000 7f75c2281740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad121240 0x55f9ad123630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.816+0000 7f75c2281740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f9ad08aaa0 con 0x55f9ad114990 2024-08-20T05:16:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.816+0000 7f75c2281740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f9ad079fa0 con 0x55f9ad121240 2024-08-20T05:16:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.816+0000 7f75c2281740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f9ad07dfe0 con 0x55f9ad1152b0 2024-08-20T05:16:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.817+0000 7f75b7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad121240 0x55f9ad123630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.817+0000 7f75b7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad114d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.817+0000 7f75b5600640 1 --2- 172.21.15.37:0/2973821591 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75a00b3cd0 0x7f75a00b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.817+0000 7f75bcc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad1152b0 0x55f9ad120d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.817+0000 7f75bcc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad1152b0 0x55f9ad120d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49834/0 (socket says 172.21.15.37:49834) 2024-08-20T05:16:34.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.817+0000 7f75bcc00640 1 -- 172.21.15.37:0/532629397 learned_addr learned my addr 172.21.15.37:0/532629397 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:34.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.817+0000 7f75bd600640 1 --2- 172.21.15.37:0/2973821591 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75a00b3cd0 0x7f75a00b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:34.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.817+0000 7f75b5600640 1 -- 172.21.15.37:0/2973821591 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f75b00e8880 con 0x7f75b810ce20 2024-08-20T05:16:34.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.818+0000 7f75bcc00640 1 -- 172.21.15.37:0/532629397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad121240 msgr2=0x55f9ad123630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:34.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.818+0000 7f75bcc00640 1 --2- 172.21.15.37:0/532629397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad121240 0x55f9ad123630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.818+0000 7f75bcc00640 1 -- 172.21.15.37:0/532629397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 msgr2=0x55f9ad114d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:34.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.818+0000 7f75bcc00640 1 --2- 172.21.15.37:0/532629397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad114d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.818+0000 7f75bcc00640 1 -- 172.21.15.37:0/532629397 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9ad020420 con 0x55f9ad1152b0 2024-08-20T05:16:34.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.818+0000 7f75bd600640 1 --2- 172.21.15.37:0/2973821591 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75a00b3cd0 0x7f75a00b6190 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f75b0005c40 tx=0x7f75b0004100 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:34.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.819+0000 7f75bcc00640 1 --2- 172.21.15.37:0/532629397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad1152b0 0x55f9ad120d00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009cf0 tx=0x7f75ac0117b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54f70c72fac9cffe server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:34.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.819+0000 7f75a9c00640 1 -- 172.21.15.37:0/532629397 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac012450 con 0x55f9ad1152b0 2024-08-20T05:16:34.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.819+0000 7f75a9c00640 1 -- 172.21.15.37:0/532629397 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75ac012aa0 con 0x55f9ad1152b0 2024-08-20T05:16:34.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.819+0000 7f75a9c00640 1 -- 172.21.15.37:0/532629397 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00fb90 con 0x55f9ad1152b0 2024-08-20T05:16:34.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.820+0000 7f75c2281740 1 -- 172.21.15.37:0/532629397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad1152b0 msgr2=0x55f9ad120d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:34.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.820+0000 7f75c2281740 1 --2- 172.21.15.37:0/532629397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad1152b0 0x55f9ad120d00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009cf0 tx=0x7f75ac0117b0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.820+0000 7f75c2281740 1 -- 172.21.15.37:0/532629397 shutdown_connections 2024-08-20T05:16:34.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.820+0000 7f75c2281740 1 --2- 172.21.15.37:0/532629397 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad121240 0x55f9ad123630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.820+0000 7f75c2281740 1 --2- 172.21.15.37:0/532629397 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad1152b0 0x55f9ad120d00 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.820+0000 7f75c2281740 1 --2- 172.21.15.37:0/532629397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad114d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.820+0000 7f75c2281740 1 -- 172.21.15.37:0/532629397 >> 172.21.15.37:0/532629397 conn(0x55f9ad1127c0 msgr2=0x55f9ad113960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:34.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.820+0000 7f75c2281740 1 -- 172.21.15.37:0/532629397 shutdown_connections 2024-08-20T05:16:34.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.821+0000 7f75c2281740 1 -- 172.21.15.37:0/532629397 wait complete. 2024-08-20T05:16:34.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.821+0000 7f75c2281740 1 -- start start 2024-08-20T05:16:34.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.821+0000 7f75c2281740 1 Processor -- start 2024-08-20T05:16:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.822+0000 7f75c2281740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad120a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.822+0000 7f75c2281740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 0x55f9ad11de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.822+0000 7f75c2281740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad121240 0x55f9ad11e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.822+0000 7f75c2281740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f9acedc700 con 0x55f9ad114990 2024-08-20T05:16:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.822+0000 7f75c2281740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f9ad015290 con 0x55f9ad1152b0 2024-08-20T05:16:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.822+0000 7f75c2281740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f9ad123ec0 con 0x55f9ad121240 2024-08-20T05:16:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.822+0000 7f75c2281740 10 client.0 _ll_register_callbacks cb 0x55f9ad0741c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.822+0000 7f75bcc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 0x55f9ad11de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.822+0000 7f75bcc00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 0x55f9ad11de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45964/0 (socket says 172.21.15.37:45964) 2024-08-20T05:16:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.822+0000 7f75bcc00640 1 -- 172.21.15.37:0/2808612430 learned_addr learned my addr 172.21.15.37:0/2808612430 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.822+0000 7f75b7e00640 1 --2- 172.21.15.37:0/2808612430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad120a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.823+0000 7f75b7e00640 1 --2- 172.21.15.37:0/2808612430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad121240 0x55f9ad11e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.823+0000 7f75bcc00640 1 -- 172.21.15.37:0/2808612430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad121240 msgr2=0x55f9ad11e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.823+0000 7f75bcc00640 1 --2- 172.21.15.37:0/2808612430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad121240 0x55f9ad11e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.823+0000 7f75bcc00640 1 -- 172.21.15.37:0/2808612430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 msgr2=0x55f9ad120a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:34.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.823+0000 7f75bcc00640 1 --2- 172.21.15.37:0/2808612430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad120a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.823+0000 7f75bcc00640 1 -- 172.21.15.37:0/2808612430 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9acdd9650 con 0x55f9ad1152b0 2024-08-20T05:16:34.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.823+0000 7f75b7e00640 1 --2- 172.21.15.37:0/2808612430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad120a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:34.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.824+0000 7f759e000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:16:34.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.824+0000 7f75bcc00640 1 --2- 172.21.15.37:0/2808612430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 0x55f9ad11de90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f75ac005ab0 tx=0x7f75ac00f4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7df202293f45f64 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:34.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.824+0000 7f759e000640 1 -- 172.21.15.37:0/2808612430 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ac028070 con 0x55f9ad1152b0 2024-08-20T05:16:34.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.824+0000 7f759e000640 1 -- 172.21.15.37:0/2808612430 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f75ac004240 con 0x55f9ad1152b0 2024-08-20T05:16:34.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.824+0000 7f75c2281740 1 -- 172.21.15.37:0/2808612430 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75ac012aa0 con 0x55f9ad1152b0 2024-08-20T05:16:34.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.829+0000 7f759e000640 1 -- 172.21.15.37:0/2808612430 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f75ac034050 con 0x55f9ad1152b0 2024-08-20T05:16:34.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.829+0000 7f75c2281740 10 client.28880 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:34.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.829+0000 7f75c2281740 1 -- 172.21.15.37:0/2808612430 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55f9ad12f700 con 0x55f9ad1152b0 2024-08-20T05:16:34.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.829+0000 7f759e000640 1 -- 172.21.15.37:0/2808612430 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75ac012aa0 con 0x55f9ad1152b0 2024-08-20T05:16:34.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.829+0000 7f759e000640 1 -- 172.21.15.37:0/2808612430 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f75ac0035f0 con 0x55f9ad1152b0 2024-08-20T05:16:34.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.830+0000 7f75c2281740 10 client.28880 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:34.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.830+0000 7f75c2281740 10 client.28880 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:16:34.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.830+0000 7f75c2281740 20 client.28880 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:34.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.830+0000 7f75c2281740 1 --2- 172.21.15.37:0/2808612430 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55f9ad130ab0 0x55f9ad132ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.830+0000 7f75c2281740 4 client.28880 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:16:34.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.830+0000 7f75c2281740 1 -- 172.21.15.37:0/2808612430 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9ad08c9f0 con 0x55f9ad130ab0 2024-08-20T05:16:34.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.831+0000 7f75b7e00640 1 --2- 172.21.15.37:0/2808612430 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55f9ad130ab0 0x55f9ad132ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:34.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.832+0000 7f75b7e00640 1 --2- 172.21.15.37:0/2808612430 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55f9ad130ab0 0x55f9ad132ea0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b1ec6b6b6951d345 server_cookie=e331351f5a6bf323 in_seq=0 out_seq=0 2024-08-20T05:16:34.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.832+0000 7f759e000640 10 client.28880 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:16:34.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.833+0000 7f759e000640 1 -- 172.21.15.37:0/2808612430 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f9ad08c9f0 con 0x55f9ad130ab0 2024-08-20T05:16:34.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.833+0000 7f759e000640 10 client.28880 handle_command_reply: tid=0 2024-08-20T05:16:34.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.833+0000 7f75c2281740 1 client.28880 shutdown 2024-08-20T05:16:34.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.833+0000 7f75c2281740 1 -- 172.21.15.37:0/2808612430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 msgr2=0x55f9ad11de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:34.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.833+0000 7f75c2281740 1 --2- 172.21.15.37:0/2808612430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 0x55f9ad11de90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f75ac005ab0 tx=0x7f75ac00f4b0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.834+0000 7f75c2281740 1 -- 172.21.15.37:0/2808612430 shutdown_connections 2024-08-20T05:16:34.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.834+0000 7f75c2281740 1 --2- 172.21.15.37:0/2808612430 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55f9ad130ab0 0x55f9ad132ea0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.834+0000 7f75c2281740 1 --2- 172.21.15.37:0/2808612430 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad121240 0x55f9ad11e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.834+0000 7f759e000640 0 client.28880 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:16:34.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.834+0000 7f75c2281740 1 --2- 172.21.15.37:0/2808612430 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 0x55f9ad11de90 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.834+0000 7f75c2281740 1 --2- 172.21.15.37:0/2808612430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad120a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.834+0000 7f75c2281740 1 -- 172.21.15.37:0/2808612430 >> 172.21.15.37:0/2808612430 conn(0x55f9ad1127c0 msgr2=0x55f9ad118330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:34.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.834+0000 7f75c2281740 1 -- 172.21.15.37:0/2808612430 shutdown_connections 2024-08-20T05:16:34.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.834+0000 7f75c2281740 1 -- 172.21.15.37:0/2808612430 wait complete. 2024-08-20T05:16:34.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.835+0000 7f75c2281740 20 client.28880 trim_cache size 0 max 16384 2024-08-20T05:16:34.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.856+0000 7f75c2281740 1 Processor -- start 2024-08-20T05:16:34.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.856+0000 7f75c2281740 1 -- start start 2024-08-20T05:16:34.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.857+0000 7f75c2281740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad12cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.857+0000 7f75c2281740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 0x55f9ad1384a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.857+0000 7f75c2281740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad121240 0x55f9ad1389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.857+0000 7f75c2281740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81ad710 con 0x55f9ad114990 2024-08-20T05:16:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.857+0000 7f75c2281740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81af2b0 con 0x55f9ad1152b0 2024-08-20T05:16:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.857+0000 7f75c2281740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81adde0 con 0x55f9ad121240 2024-08-20T05:16:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.857+0000 7f75b7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad12cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.857+0000 7f75b7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad12cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41316/0 (socket says 172.21.15.37:41316) 2024-08-20T05:16:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.857+0000 7f75b7e00640 1 -- 172.21.15.37:0/1149058349 learned_addr learned my addr 172.21.15.37:0/1149058349 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.857+0000 7f75bcc00640 1 --2- 172.21.15.37:0/1149058349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 0x55f9ad1384a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.858+0000 7f75b7e00640 1 -- 172.21.15.37:0/1149058349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad121240 msgr2=0x55f9ad1389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.858+0000 7f75b7e00640 1 --2- 172.21.15.37:0/1149058349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad121240 0x55f9ad1389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.858+0000 7f75b7e00640 1 -- 172.21.15.37:0/1149058349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 msgr2=0x55f9ad1384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.858+0000 7f75b7e00640 1 --2- 172.21.15.37:0/1149058349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 0x55f9ad1384a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.858+0000 7f75b7e00640 1 -- 172.21.15.37:0/1149058349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9ad1125f0 con 0x55f9ad114990 2024-08-20T05:16:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.858+0000 7f75bcc00640 1 --2- 172.21.15.37:0/1149058349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 0x55f9ad1384a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:16:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.858+0000 7f75b7e00640 1 --2- 172.21.15.37:0/1149058349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad12cfe0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f75a40303f0 tx=0x7f75a4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c320c6bc3118a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.859+0000 7f75a9200640 1 -- 172.21.15.37:0/1149058349 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4054070 con 0x55f9ad114990 2024-08-20T05:16:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.859+0000 7f75a9200640 1 -- 172.21.15.37:0/1149058349 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75a40306d0 con 0x55f9ad114990 2024-08-20T05:16:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.859+0000 7f75a9200640 1 -- 172.21.15.37:0/1149058349 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4037040 con 0x55f9ad114990 2024-08-20T05:16:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.860+0000 7f75c2281740 1 -- 172.21.15.37:0/1149058349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 msgr2=0x55f9ad12cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.860+0000 7f75c2281740 1 --2- 172.21.15.37:0/1149058349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad12cfe0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f75a40303f0 tx=0x7f75a4005f90 comp rx=0 tx=0).stop 2024-08-20T05:16:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.860+0000 7f75c2281740 1 -- 172.21.15.37:0/1149058349 shutdown_connections 2024-08-20T05:16:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.860+0000 7f75c2281740 1 --2- 172.21.15.37:0/1149058349 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad121240 0x55f9ad1389e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.860+0000 7f75c2281740 1 --2- 172.21.15.37:0/1149058349 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 0x55f9ad1384a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.860+0000 7f75c2281740 1 --2- 172.21.15.37:0/1149058349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad12cfe0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.860+0000 7f75c2281740 1 -- 172.21.15.37:0/1149058349 >> 172.21.15.37:0/1149058349 conn(0x55f9ad1127c0 msgr2=0x55f9ad119460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.861+0000 7f75c2281740 1 -- 172.21.15.37:0/1149058349 shutdown_connections 2024-08-20T05:16:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.861+0000 7f75c2281740 1 -- 172.21.15.37:0/1149058349 wait complete. 2024-08-20T05:16:34.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.862+0000 7f75c2281740 1 -- start start 2024-08-20T05:16:34.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.862+0000 7f75c2281740 1 Processor -- start 2024-08-20T05:16:34.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.864+0000 7f75c2281740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad124540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.864+0000 7f75c2281740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 0x55f9ad124aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.864+0000 7f75c2281740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad121240 0x55f9ad1a1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.864+0000 7f75c2281740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81aebe0 con 0x55f9ad114990 2024-08-20T05:16:34.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.864+0000 7f75c2281740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81ae4b0 con 0x55f9ad1152b0 2024-08-20T05:16:34.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.864+0000 7f75c2281740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f75b81ab6f0 con 0x55f9ad121240 2024-08-20T05:16:34.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.864+0000 7f75c2281740 10 client.0 _ll_register_callbacks cb 0x7f75a4035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:34.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.864+0000 7f75b7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad121240 0x55f9ad1a1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:34.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.864+0000 7f75b7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad121240 0x55f9ad1a1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49846/0 (socket says 172.21.15.37:49846) 2024-08-20T05:16:34.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.864+0000 7f75b7e00640 1 -- 172.21.15.37:0/2564457859 learned_addr learned my addr 172.21.15.37:0/2564457859 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:34.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.865+0000 7f75b7e00640 1 --2- 172.21.15.37:0/2564457859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad124540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:34.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.865+0000 7f75bcc00640 1 --2- 172.21.15.37:0/2564457859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 0x55f9ad124aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:34.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.866+0000 7f75b7e00640 1 -- 172.21.15.37:0/2564457859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 msgr2=0x55f9ad124aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:34.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.866+0000 7f75b7e00640 1 --2- 172.21.15.37:0/2564457859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 0x55f9ad124aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.866+0000 7f75b7e00640 1 -- 172.21.15.37:0/2564457859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 msgr2=0x55f9ad124540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:34.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.866+0000 7f75b7e00640 1 --2- 172.21.15.37:0/2564457859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad124540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.866+0000 7f75b7e00640 1 -- 172.21.15.37:0/2564457859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9ad113240 con 0x55f9ad121240 2024-08-20T05:16:34.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.866+0000 7f75b7e00640 1 --2- 172.21.15.37:0/2564457859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad121240 0x55f9ad1a1c70 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f75a40303c0 tx=0x7f75a404ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d26f0cbe27a25143 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:34.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.867+0000 7f759e000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:16:34.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.867+0000 7f759e000640 1 -- 172.21.15.37:0/2564457859 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4054070 con 0x55f9ad121240 2024-08-20T05:16:34.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.867+0000 7f759e000640 1 -- 172.21.15.37:0/2564457859 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f75a404e600 con 0x55f9ad121240 2024-08-20T05:16:34.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.868+0000 7f75c2281740 1 -- 172.21.15.37:0/2564457859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75a40306d0 con 0x55f9ad121240 2024-08-20T05:16:34.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.868+0000 7f759e000640 1 -- 172.21.15.37:0/2564457859 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f75a4037070 con 0x55f9ad121240 2024-08-20T05:16:34.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.868+0000 7f75c2281740 10 client.28927 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:34.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.868+0000 7f75c2281740 1 -- 172.21.15.37:0/2564457859 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55f9ad1a32b0 con 0x55f9ad121240 2024-08-20T05:16:34.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.868+0000 7f759e000640 1 -- 172.21.15.37:0/2564457859 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75a40306d0 con 0x55f9ad121240 2024-08-20T05:16:34.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.869+0000 7f759e000640 1 -- 172.21.15.37:0/2564457859 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f75a404b030 con 0x55f9ad121240 2024-08-20T05:16:34.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.869+0000 7f75c2281740 10 client.28927 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:34.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.869+0000 7f75c2281740 10 client.28927 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:16:34.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.869+0000 7f75c2281740 20 client.28927 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:34.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.869+0000 7f75c2281740 1 --2- 172.21.15.37:0/2564457859 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55f9ad1a3850 0x55f9ad1a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:34.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.869+0000 7f75c2281740 4 client.28927 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:16:34.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.869+0000 7f75c2281740 1 -- 172.21.15.37:0/2564457859 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f9ad088490 con 0x55f9ad1a3850 2024-08-20T05:16:34.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.870+0000 7f75bcc00640 1 --2- 172.21.15.37:0/2564457859 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55f9ad1a3850 0x55f9ad1a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.878+0000 7f75bcc00640 1 --2- 172.21.15.37:0/2564457859 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55f9ad1a3850 0x55f9ad1a5c70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f7dc7283f4567689 server_cookie=bd2cfcecb47132bf in_seq=0 out_seq=0 2024-08-20T05:16:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.878+0000 7f759e000640 10 client.28927 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:16:34.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.881+0000 7f759e000640 1 -- 172.21.15.37:0/2564457859 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f9ad088490 con 0x55f9ad1a3850 2024-08-20T05:16:34.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.881+0000 7f759e000640 10 client.28927 handle_command_reply: tid=0 2024-08-20T05:16:34.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.881+0000 7f75c2281740 1 client.28927 shutdown 2024-08-20T05:16:34.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.883+0000 7f75c2281740 1 -- 172.21.15.37:0/2564457859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad121240 msgr2=0x55f9ad1a1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:34.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.883+0000 7f75c2281740 1 --2- 172.21.15.37:0/2564457859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad121240 0x55f9ad1a1c70 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f75a40303c0 tx=0x7f75a404ec90 comp rx=0 tx=0).stop 2024-08-20T05:16:34.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.885+0000 7f75c2281740 1 -- 172.21.15.37:0/2564457859 shutdown_connections 2024-08-20T05:16:34.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.885+0000 7f75c2281740 1 --2- 172.21.15.37:0/2564457859 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55f9ad1a3850 0x55f9ad1a5c70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.885+0000 7f75c2281740 1 --2- 172.21.15.37:0/2564457859 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f9ad121240 0x55f9ad1a1c70 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.885+0000 7f75c2281740 1 --2- 172.21.15.37:0/2564457859 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f9ad1152b0 0x55f9ad124aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.885+0000 7f759e000640 0 client.28927 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:16:34.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.885+0000 7f75c2281740 1 --2- 172.21.15.37:0/2564457859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9ad114990 0x55f9ad124540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.885+0000 7f75c2281740 1 -- 172.21.15.37:0/2564457859 >> 172.21.15.37:0/2564457859 conn(0x55f9ad1127c0 msgr2=0x55f9ad111120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.885+0000 7f75c2281740 1 -- 172.21.15.37:0/2564457859 shutdown_connections 2024-08-20T05:16:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.885+0000 7f75c2281740 1 -- 172.21.15.37:0/2564457859 wait complete. 2024-08-20T05:16:34.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.885+0000 7f75c2281740 20 client.28927 trim_cache size 0 max 16384 2024-08-20T05:16:34.888 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:16:34.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.887+0000 7f75bf600640 1 -- 172.21.15.37:0/2973821591 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75a00b3cd0 msgr2=0x7f75a00b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:34.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.887+0000 7f75bf600640 1 --2- 172.21.15.37:0/2973821591 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75a00b3cd0 0x7f75a00b6190 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f75b0005c40 tx=0x7f75b0004100 comp rx=0 tx=0).stop 2024-08-20T05:16:34.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.887+0000 7f75bf600640 1 -- 172.21.15.37:0/2973821591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75b810ce20 msgr2=0x7f75b819e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:34.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.887+0000 7f75bf600640 1 --2- 172.21.15.37:0/2973821591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75b810ce20 0x7f75b819e8c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f75b000efd0 tx=0x7f75b000c6a0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.887+0000 7f75bf600640 1 -- 172.21.15.37:0/2973821591 shutdown_connections 2024-08-20T05:16:34.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.887+0000 7f75bf600640 1 --2- 172.21.15.37:0/2973821591 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f75a00b3cd0 0x7f75a00b6190 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.887+0000 7f75bf600640 1 --2- 172.21.15.37:0/2973821591 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f75b810ce20 0x7f75b819e8c0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.887+0000 7f75bf600640 1 --2- 172.21.15.37:0/2973821591 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f75b81042e0 0x7f75b8199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.887+0000 7f75bf600640 1 --2- 172.21.15.37:0/2973821591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75b81039c0 0x7f75b8198fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:34.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.887+0000 7f75bf600640 1 -- 172.21.15.37:0/2973821591 >> 172.21.15.37:0/2973821591 conn(0x7f75b80fd400 msgr2=0x7f75b80fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:34.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.887+0000 7f75bf600640 1 -- 172.21.15.37:0/2973821591 shutdown_connections 2024-08-20T05:16:34.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:34.887+0000 7f75bf600640 1 -- 172.21.15.37:0/2973821591 wait complete. 2024-08-20T05:16:35.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:35 smithi135 ceph-mon[22342]: pgmap v831: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 4.8 MiB/s wr, 508 op/s 2024-08-20T05:16:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:35 smithi130 ceph-mon[22007]: pgmap v831: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 4.8 MiB/s wr, 508 op/s 2024-08-20T05:16:36.018 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:35 smithi037 ceph-mon[17265]: pgmap v831: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 4.8 MiB/s wr, 508 op/s 2024-08-20T05:16:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.483+0000 7f545be00640 1 -- 172.21.15.37:0/2022222877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f545c10a3e0 msgr2=0x7f545c10c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.483+0000 7f545be00640 1 --2- 172.21.15.37:0/2022222877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f545c10a3e0 0x7f545c10c880 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f544c009900 tx=0x7f544c02a400 comp rx=0 tx=0).stop 2024-08-20T05:16:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.483+0000 7f545be00640 1 -- 172.21.15.37:0/2022222877 shutdown_connections 2024-08-20T05:16:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.483+0000 7f545be00640 1 --2- 172.21.15.37:0/2022222877 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f545c10a3e0 0x7f545c10c880 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.483+0000 7f545be00640 1 --2- 172.21.15.37:0/2022222877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f545c1079a0 0x7f545c109d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.483+0000 7f545be00640 1 --2- 172.21.15.37:0/2022222877 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f545c06b060 0x7f545c107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.483+0000 7f545be00640 1 -- 172.21.15.37:0/2022222877 >> 172.21.15.37:0/2022222877 conn(0x7f545c0fcc50 msgr2=0x7f545c0ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.484+0000 7f545be00640 1 -- 172.21.15.37:0/2022222877 shutdown_connections 2024-08-20T05:16:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.484+0000 7f545be00640 1 -- 172.21.15.37:0/2022222877 wait complete. 2024-08-20T05:16:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.485+0000 7f545be00640 1 Processor -- start 2024-08-20T05:16:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.485+0000 7f545be00640 1 -- start start 2024-08-20T05:16:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.485+0000 7f545be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f545c06b060 0x7f545c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.485+0000 7f545be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f545c1079a0 0x7f545c19b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.485+0000 7f545be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f545c10a3e0 0x7f545c19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.485+0000 7f545be00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f545c1103e0 con 0x7f545c06b060 2024-08-20T05:16:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.485+0000 7f545be00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f545c110260 con 0x7f545c10a3e0 2024-08-20T05:16:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.485+0000 7f545be00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f545c110560 con 0x7f545c1079a0 2024-08-20T05:16:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.485+0000 7f545a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f545c1079a0 0x7f545c19b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.486+0000 7f545a000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f545c1079a0 0x7f545c19b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49864/0 (socket says 172.21.15.37:49864) 2024-08-20T05:16:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.486+0000 7f545a000640 1 -- 172.21.15.37:0/2178711080 learned_addr learned my addr 172.21.15.37:0/2178711080 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.486+0000 7f545b400640 1 --2- 172.21.15.37:0/2178711080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f545c10a3e0 0x7f545c19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.486+0000 7f545aa00640 1 --2- 172.21.15.37:0/2178711080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f545c06b060 0x7f545c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:36.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.486+0000 7f545a000640 1 -- 172.21.15.37:0/2178711080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f545c10a3e0 msgr2=0x7f545c19bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:36.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.486+0000 7f545a000640 1 --2- 172.21.15.37:0/2178711080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f545c10a3e0 0x7f545c19bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.486+0000 7f545a000640 1 -- 172.21.15.37:0/2178711080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f545c06b060 msgr2=0x7f545c19aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:36.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.486+0000 7f545a000640 1 --2- 172.21.15.37:0/2178711080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f545c06b060 0x7f545c19aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.486+0000 7f545a000640 1 -- 172.21.15.37:0/2178711080 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c19c550 con 0x7f545c1079a0 2024-08-20T05:16:36.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.486+0000 7f545a000640 1 --2- 172.21.15.37:0/2178711080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f545c1079a0 0x7f545c19b060 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f544800c970 tx=0x7f544800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:36.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.487+0000 7f5453400640 1 -- 172.21.15.37:0/2178711080 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5448014070 con 0x7f545c1079a0 2024-08-20T05:16:36.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.487+0000 7f545be00640 1 -- 172.21.15.37:0/2178711080 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f545c19c840 con 0x7f545c1079a0 2024-08-20T05:16:36.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.487+0000 7f5453400640 1 -- 172.21.15.37:0/2178711080 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5448004440 con 0x7f545c1079a0 2024-08-20T05:16:36.490 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.487+0000 7f5453400640 1 -- 172.21.15.37:0/2178711080 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5448003e50 con 0x7f545c1079a0 2024-08-20T05:16:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.487+0000 7f545be00640 1 -- 172.21.15.37:0/2178711080 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f545c1a2f10 con 0x7f545c1079a0 2024-08-20T05:16:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.494+0000 7f5453400640 1 -- 172.21.15.37:0/2178711080 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5448017070 con 0x7f545c1079a0 2024-08-20T05:16:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.494+0000 7f5464a77740 1 Processor -- start 2024-08-20T05:16:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.494+0000 7f5464a77740 1 -- start start 2024-08-20T05:16:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.495+0000 7f5464a77740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c8807f0 0x55e34c882be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.495+0000 7f5464a77740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c883120 0x55e34c885510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.495+0000 7f5464a77740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 0x55e34c888020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.495+0000 7f5464a77740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e34c7f3210 con 0x55e34c8807f0 2024-08-20T05:16:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.495+0000 7f5464a77740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e34c7e2710 con 0x55e34c883120 2024-08-20T05:16:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.495+0000 7f5464a77740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e34c7e6750 con 0x55e34c885b60 2024-08-20T05:16:36.498 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.496+0000 7f545aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c883120 0x55e34c885510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.496+0000 7f545aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c883120 0x55e34c885510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45998/0 (socket says 172.21.15.37:45998) 2024-08-20T05:16:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.496+0000 7f545aa00640 1 -- 172.21.15.37:0/445228219 learned_addr learned my addr 172.21.15.37:0/445228219 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.496+0000 7f545a000640 1 --2- 172.21.15.37:0/445228219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 0x55e34c888020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.496+0000 7f545b400640 1 --2- 172.21.15.37:0/445228219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c8807f0 0x55e34c882be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.496+0000 7f545aa00640 1 -- 172.21.15.37:0/445228219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 msgr2=0x55e34c888020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.496+0000 7f545aa00640 1 --2- 172.21.15.37:0/445228219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 0x55e34c888020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.497+0000 7f545aa00640 1 -- 172.21.15.37:0/445228219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c8807f0 msgr2=0x55e34c882be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.497+0000 7f545aa00640 1 --2- 172.21.15.37:0/445228219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c8807f0 0x55e34c882be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.499 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.497+0000 7f545aa00640 1 -- 172.21.15.37:0/445228219 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e34c7aede0 con 0x55e34c883120 2024-08-20T05:16:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.497+0000 7f545a000640 1 --2- 172.21.15.37:0/445228219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 0x55e34c888020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.497+0000 7f5453400640 1 --2- 172.21.15.37:0/2178711080 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54400b3df0 0x7f54400b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.497+0000 7f545aa00640 1 --2- 172.21.15.37:0/445228219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c883120 0x55e34c885510 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5454009fa0 tx=0x7f545400c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=155058c8c6a8dc9e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.497+0000 7f5453400640 1 -- 172.21.15.37:0/2178711080 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f54480e3b40 con 0x7f545c1079a0 2024-08-20T05:16:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.497+0000 7f5447e00640 1 -- 172.21.15.37:0/445228219 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545401a070 con 0x55e34c883120 2024-08-20T05:16:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.498+0000 7f545b400640 1 --2- 172.21.15.37:0/2178711080 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54400b3df0 0x7f54400b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.498+0000 7f5447e00640 1 -- 172.21.15.37:0/445228219 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54540158c0 con 0x55e34c883120 2024-08-20T05:16:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.498+0000 7f5447e00640 1 -- 172.21.15.37:0/445228219 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545400a8c0 con 0x55e34c883120 2024-08-20T05:16:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.498+0000 7f5464a77740 1 -- 172.21.15.37:0/445228219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c883120 msgr2=0x55e34c885510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.498+0000 7f5464a77740 1 --2- 172.21.15.37:0/445228219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c883120 0x55e34c885510 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f5454009fa0 tx=0x7f545400c8b0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.499+0000 7f545b400640 1 --2- 172.21.15.37:0/2178711080 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54400b3df0 0x7f54400b62b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f544c006010 tx=0x7f544c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.499+0000 7f5464a77740 1 -- 172.21.15.37:0/445228219 shutdown_connections 2024-08-20T05:16:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.499+0000 7f5464a77740 1 --2- 172.21.15.37:0/445228219 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 0x55e34c888020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.499+0000 7f5464a77740 1 --2- 172.21.15.37:0/445228219 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c883120 0x55e34c885510 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.499+0000 7f5464a77740 1 --2- 172.21.15.37:0/445228219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c8807f0 0x55e34c882be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.499+0000 7f5464a77740 1 -- 172.21.15.37:0/445228219 >> 172.21.15.37:0/445228219 conn(0x55e34c87b940 msgr2=0x55e34c87c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:36.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.499+0000 7f5464a77740 1 -- 172.21.15.37:0/445228219 shutdown_connections 2024-08-20T05:16:36.503 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.499+0000 7f5464a77740 1 -- 172.21.15.37:0/445228219 wait complete. 2024-08-20T05:16:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.500+0000 7f5464a77740 1 -- start start 2024-08-20T05:16:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.500+0000 7f5464a77740 1 Processor -- start 2024-08-20T05:16:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.500+0000 7f5464a77740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c8807f0 0x55e34c8a3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.500+0000 7f5464a77740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c883120 0x55e34c8a3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.501+0000 7f5464a77740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 0x55e34c8a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.501+0000 7f5464a77740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e34c71bab0 con 0x55e34c8807f0 2024-08-20T05:16:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.501+0000 7f5464a77740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e34c789140 con 0x55e34c883120 2024-08-20T05:16:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.501+0000 7f5464a77740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e34c899b50 con 0x55e34c885b60 2024-08-20T05:16:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.501+0000 7f5464a77740 10 client.0 _ll_register_callbacks cb 0x55e34c79c5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.501+0000 7f545b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 0x55e34c8a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.501+0000 7f545aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c8807f0 0x55e34c8a3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.501+0000 7f545b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 0x55e34c8a49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49878/0 (socket says 172.21.15.37:49878) 2024-08-20T05:16:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.501+0000 7f545b400640 1 -- 172.21.15.37:0/1194338656 learned_addr learned my addr 172.21.15.37:0/1194338656 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.501+0000 7f545a000640 1 --2- 172.21.15.37:0/1194338656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c883120 0x55e34c8a3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.502+0000 7f545a000640 1 -- 172.21.15.37:0/1194338656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 msgr2=0x55e34c8a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:36.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.502+0000 7f545a000640 1 --2- 172.21.15.37:0/1194338656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 0x55e34c8a49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.502+0000 7f545a000640 1 -- 172.21.15.37:0/1194338656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c8807f0 msgr2=0x55e34c8a3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:36.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.502+0000 7f545a000640 1 --2- 172.21.15.37:0/1194338656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c8807f0 0x55e34c8a3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.506 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.502+0000 7f545a000640 1 -- 172.21.15.37:0/1194338656 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e34c78a170 con 0x55e34c883120 2024-08-20T05:16:36.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.502+0000 7f545b400640 1 --2- 172.21.15.37:0/1194338656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 0x55e34c8a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:36.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.502+0000 7f545aa00640 1 --2- 172.21.15.37:0/1194338656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c8807f0 0x55e34c8a3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:36.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.503+0000 7f545a000640 1 --2- 172.21.15.37:0/1194338656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c883120 0x55e34c8a3de0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f54480aa620 tx=0x7f544800a630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b126d2de133cf5f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:36.507 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.504+0000 7f5444c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:16:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.505+0000 7f5444c00640 1 -- 172.21.15.37:0/1194338656 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54480a9e00 con 0x55e34c883120 2024-08-20T05:16:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.505+0000 7f5444c00640 1 -- 172.21.15.37:0/1194338656 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f54480cd0e0 con 0x55e34c883120 2024-08-20T05:16:36.508 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.505+0000 7f5464a77740 1 -- 172.21.15.37:0/1194338656 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54540158c0 con 0x55e34c883120 2024-08-20T05:16:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.506+0000 7f5444c00640 1 -- 172.21.15.37:0/1194338656 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f54480aa1a0 con 0x55e34c883120 2024-08-20T05:16:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.506+0000 7f5464a77740 10 client.28895 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.506+0000 7f5464a77740 1 -- 172.21.15.37:0/1194338656 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55e34c545790 con 0x55e34c883120 2024-08-20T05:16:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.506+0000 7f5444c00640 1 -- 172.21.15.37:0/1194338656 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54540158c0 con 0x55e34c883120 2024-08-20T05:16:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.506+0000 7f5444c00640 1 -- 172.21.15.37:0/1194338656 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f54480cbb90 con 0x55e34c883120 2024-08-20T05:16:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.506+0000 7f5464a77740 10 client.28895 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.506+0000 7f5464a77740 10 client.28895 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:16:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.506+0000 7f5464a77740 20 client.28895 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.506+0000 7f5464a77740 1 --2- 172.21.15.37:0/1194338656 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e34c8af480 0x55e34c8b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.507+0000 7f5464a77740 4 client.28895 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:16:36.509 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.507+0000 7f5464a77740 1 -- 172.21.15.37:0/1194338656 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e34c7f5160 con 0x55e34c8af480 2024-08-20T05:16:36.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.507+0000 7f545aa00640 1 --2- 172.21.15.37:0/1194338656 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e34c8af480 0x55e34c8b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:36.511 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.508+0000 7f545aa00640 1 --2- 172.21.15.37:0/1194338656 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e34c8af480 0x55e34c8b18d0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75c4ac06aee31012 server_cookie=a14b36b21cbd9817 in_seq=0 out_seq=0 2024-08-20T05:16:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.508+0000 7f5444c00640 10 client.28895 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.508+0000 7f5444c00640 1 -- 172.21.15.37:0/1194338656 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e34c7f5160 con 0x55e34c8af480 2024-08-20T05:16:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.508+0000 7f5444c00640 10 client.28895 handle_command_reply: tid=0 2024-08-20T05:16:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.509+0000 7f5464a77740 1 client.28895 shutdown 2024-08-20T05:16:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.509+0000 7f5464a77740 1 -- 172.21.15.37:0/1194338656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c883120 msgr2=0x55e34c8a3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.509+0000 7f5464a77740 1 --2- 172.21.15.37:0/1194338656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c883120 0x55e34c8a3de0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f54480aa620 tx=0x7f544800a630 comp rx=0 tx=0).stop 2024-08-20T05:16:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.509+0000 7f5464a77740 1 -- 172.21.15.37:0/1194338656 shutdown_connections 2024-08-20T05:16:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.509+0000 7f5464a77740 1 --2- 172.21.15.37:0/1194338656 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e34c8af480 0x55e34c8b18d0 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.512 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.509+0000 7f5464a77740 1 --2- 172.21.15.37:0/1194338656 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 0x55e34c8a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.509+0000 7f5464a77740 1 --2- 172.21.15.37:0/1194338656 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c883120 0x55e34c8a3de0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.509+0000 7f5464a77740 1 --2- 172.21.15.37:0/1194338656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c8807f0 0x55e34c8a3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.509+0000 7f5464a77740 1 -- 172.21.15.37:0/1194338656 >> 172.21.15.37:0/1194338656 conn(0x55e34c87b940 msgr2=0x55e34c87a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.509+0000 7f5444c00640 0 client.28895 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.509+0000 7f5464a77740 1 -- 172.21.15.37:0/1194338656 shutdown_connections 2024-08-20T05:16:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.509+0000 7f5464a77740 1 -- 172.21.15.37:0/1194338656 wait complete. 2024-08-20T05:16:36.513 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.510+0000 7f5464a77740 20 client.28895 trim_cache size 0 max 16384 2024-08-20T05:16:36.542 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.540+0000 7f5464a77740 1 Processor -- start 2024-08-20T05:16:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.540+0000 7f5464a77740 1 -- start start 2024-08-20T05:16:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.541+0000 7f5464a77740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c8807f0 0x55e34c87c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.541+0000 7f5464a77740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c883120 0x55e34c8aba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.541+0000 7f5464a77740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 0x55e34c886b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.541+0000 7f5464a77740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f545c072710 con 0x55e34c883120 2024-08-20T05:16:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.541+0000 7f5464a77740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f545c0742b0 con 0x55e34c8807f0 2024-08-20T05:16:36.543 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.541+0000 7f5464a77740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f545c072de0 con 0x55e34c885b60 2024-08-20T05:16:36.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.541+0000 7f545b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 0x55e34c886b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:36.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.541+0000 7f545b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 0x55e34c886b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49886/0 (socket says 172.21.15.37:49886) 2024-08-20T05:16:36.544 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.541+0000 7f545b400640 1 -- 172.21.15.37:0/785354146 learned_addr learned my addr 172.21.15.37:0/785354146 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:36.546 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.545+0000 7f545aa00640 1 --2- 172.21.15.37:0/785354146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c8807f0 0x55e34c87c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.545+0000 7f545a000640 1 --2- 172.21.15.37:0/785354146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c883120 0x55e34c8aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.545+0000 7f545aa00640 1 -- 172.21.15.37:0/785354146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 msgr2=0x55e34c886b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:36.547 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.545+0000 7f545aa00640 1 --2- 172.21.15.37:0/785354146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 0x55e34c886b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.545+0000 7f545aa00640 1 -- 172.21.15.37:0/785354146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c883120 msgr2=0x55e34c8aba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:36.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.545+0000 7f545aa00640 1 --2- 172.21.15.37:0/785354146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c883120 0x55e34c8aba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.545+0000 7f545aa00640 1 -- 172.21.15.37:0/785354146 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e34c5be620 con 0x55e34c8807f0 2024-08-20T05:16:36.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.546+0000 7f545aa00640 1 --2- 172.21.15.37:0/785354146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c8807f0 0x55e34c87c8b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x55e34c8b2180 tx=0x7f5454004b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6828d28dff8d3a22 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:36.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.546+0000 7f5447400640 1 -- 172.21.15.37:0/785354146 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5454030070 con 0x55e34c8807f0 2024-08-20T05:16:36.548 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.546+0000 7f5447400640 1 -- 172.21.15.37:0/785354146 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f545400a5b0 con 0x55e34c8807f0 2024-08-20T05:16:36.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.546+0000 7f5447400640 1 -- 172.21.15.37:0/785354146 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f545401a040 con 0x55e34c8807f0 2024-08-20T05:16:36.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.547+0000 7f5464a77740 1 -- 172.21.15.37:0/785354146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c8807f0 msgr2=0x55e34c87c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:36.549 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.547+0000 7f5464a77740 1 --2- 172.21.15.37:0/785354146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c8807f0 0x55e34c87c8b0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x55e34c8b2180 tx=0x7f5454004b50 comp rx=0 tx=0).stop 2024-08-20T05:16:36.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.549+0000 7f5464a77740 1 -- 172.21.15.37:0/785354146 shutdown_connections 2024-08-20T05:16:36.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.549+0000 7f5464a77740 1 --2- 172.21.15.37:0/785354146 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c885b60 0x55e34c886b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.550 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.549+0000 7f5464a77740 1 --2- 172.21.15.37:0/785354146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c883120 0x55e34c8aba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.549+0000 7f5464a77740 1 --2- 172.21.15.37:0/785354146 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c8807f0 0x55e34c87c8b0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.551 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.549+0000 7f5464a77740 1 -- 172.21.15.37:0/785354146 >> 172.21.15.37:0/785354146 conn(0x55e34c87b940 msgr2=0x55e34c87c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:36.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.549+0000 7f5464a77740 1 -- 172.21.15.37:0/785354146 shutdown_connections 2024-08-20T05:16:36.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.549+0000 7f5464a77740 1 -- 172.21.15.37:0/785354146 wait complete. 2024-08-20T05:16:36.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.550+0000 7f5464a77740 1 -- start start 2024-08-20T05:16:36.553 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.550+0000 7f5464a77740 1 Processor -- start 2024-08-20T05:16:36.554 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.553+0000 7f5464a77740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c8807f0 0x55e34c8a8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.553+0000 7f5464a77740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c883120 0x55e34c8a8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.554+0000 7f5464a77740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c885b60 0x55e34c8a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.554+0000 7f5464a77740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f545c073be0 con 0x55e34c8807f0 2024-08-20T05:16:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.554+0000 7f5464a77740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f545c0734b0 con 0x55e34c885b60 2024-08-20T05:16:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.554+0000 7f5464a77740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f545c0706f0 con 0x55e34c883120 2024-08-20T05:16:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.554+0000 7f5464a77740 10 client.0 _ll_register_callbacks cb 0x7f54480e7130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.554+0000 7f545b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c885b60 0x55e34c8a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.554+0000 7f545b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c885b60 0x55e34c8a9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:46032/0 (socket says 172.21.15.37:46032) 2024-08-20T05:16:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.554+0000 7f545b400640 1 -- 172.21.15.37:0/2060957830 learned_addr learned my addr 172.21.15.37:0/2060957830 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.556+0000 7f545b400640 1 -- 172.21.15.37:0/2060957830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c883120 msgr2=0x55e34c8a8fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:16:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.556+0000 7f545b400640 1 --2- 172.21.15.37:0/2060957830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c883120 0x55e34c8a8fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.556+0000 7f545b400640 1 -- 172.21.15.37:0/2060957830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c8807f0 msgr2=0x55e34c8a8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.556+0000 7f545b400640 1 --2- 172.21.15.37:0/2060957830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c8807f0 0x55e34c8a8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.556+0000 7f545b400640 1 -- 172.21.15.37:0/2060957830 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e34c8aa330 con 0x55e34c885b60 2024-08-20T05:16:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.557+0000 7f545b400640 1 --2- 172.21.15.37:0/2060957830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c885b60 0x55e34c8a9b00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f544c031500 tx=0x7f544c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=680d1672c646c792 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.557+0000 7f5444c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:16:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.558+0000 7f5444c00640 1 -- 172.21.15.37:0/2060957830 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f544c0317b0 con 0x55e34c885b60 2024-08-20T05:16:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.558+0000 7f5444c00640 1 -- 172.21.15.37:0/2060957830 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f544c04f070 con 0x55e34c885b60 2024-08-20T05:16:36.562 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.560+0000 7f5464a77740 1 -- 172.21.15.37:0/2060957830 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f545400a5b0 con 0x55e34c885b60 2024-08-20T05:16:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.561+0000 7f5444c00640 1 -- 172.21.15.37:0/2060957830 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f544c0317b0 con 0x55e34c885b60 2024-08-20T05:16:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.561+0000 7f5464a77740 10 client.28901 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.561+0000 7f5464a77740 1 -- 172.21.15.37:0/2060957830 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55e34c8ab740 con 0x55e34c885b60 2024-08-20T05:16:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.562+0000 7f5444c00640 1 -- 172.21.15.37:0/2060957830 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f544c031e00 con 0x55e34c885b60 2024-08-20T05:16:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.562+0000 7f5444c00640 1 -- 172.21.15.37:0/2060957830 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f544c044070 con 0x55e34c885b60 2024-08-20T05:16:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.562+0000 7f5464a77740 10 client.28901 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.562+0000 7f5464a77740 10 client.28901 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:16:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.562+0000 7f5464a77740 20 client.28901 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.562+0000 7f5464a77740 1 --2- 172.21.15.37:0/2060957830 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e34c89fee0 0x55e34c8a2300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.562+0000 7f5464a77740 4 client.28901 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:16:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.562+0000 7f5464a77740 1 -- 172.21.15.37:0/2060957830 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f545400a5b0 con 0x55e34c89fee0 2024-08-20T05:16:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.563+0000 7f545aa00640 1 --2- 172.21.15.37:0/2060957830 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e34c89fee0 0x55e34c8a2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.565+0000 7f545aa00640 1 --2- 172.21.15.37:0/2060957830 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e34c89fee0 0x55e34c8a2300 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc1327662ab6abd5 server_cookie=577d84a38529621a in_seq=0 out_seq=0 2024-08-20T05:16:36.567 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.565+0000 7f5444c00640 10 client.28901 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:36.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.707+0000 7f5444c00640 1 -- 172.21.15.37:0/2060957830 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f545400a5b0 con 0x55e34c89fee0 2024-08-20T05:16:36.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.707+0000 7f5444c00640 10 client.28901 handle_command_reply: tid=0 2024-08-20T05:16:36.709 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.707+0000 7f5464a77740 1 client.28901 shutdown 2024-08-20T05:16:36.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.710+0000 7f5464a77740 1 -- 172.21.15.37:0/2060957830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c885b60 msgr2=0x55e34c8a9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:36.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.710+0000 7f5464a77740 1 --2- 172.21.15.37:0/2060957830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c885b60 0x55e34c8a9b00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f544c031500 tx=0x7f544c009260 comp rx=0 tx=0).stop 2024-08-20T05:16:36.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.711+0000 7f5464a77740 1 -- 172.21.15.37:0/2060957830 shutdown_connections 2024-08-20T05:16:36.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.711+0000 7f5464a77740 1 --2- 172.21.15.37:0/2060957830 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55e34c89fee0 0x55e34c8a2300 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.712 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.711+0000 7f5464a77740 1 --2- 172.21.15.37:0/2060957830 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e34c885b60 0x55e34c8a9b00 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.711+0000 7f5464a77740 1 --2- 172.21.15.37:0/2060957830 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e34c883120 0x55e34c8a8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.711+0000 7f5444c00640 0 client.28901 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:36.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.711+0000 7f5464a77740 1 --2- 172.21.15.37:0/2060957830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e34c8807f0 0x55e34c8a8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.711+0000 7f5464a77740 1 -- 172.21.15.37:0/2060957830 >> 172.21.15.37:0/2060957830 conn(0x55e34c87b940 msgr2=0x55e34c87a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:36.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.711+0000 7f5464a77740 1 -- 172.21.15.37:0/2060957830 shutdown_connections 2024-08-20T05:16:36.713 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.711+0000 7f5464a77740 1 -- 172.21.15.37:0/2060957830 wait complete. 2024-08-20T05:16:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.712+0000 7f5464a77740 20 client.28901 trim_cache size 0 max 16384 2024-08-20T05:16:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:16:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:16:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:16:36.714 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:16:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.713+0000 7f545be00640 1 -- 172.21.15.37:0/2178711080 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54400b3df0 msgr2=0x7f54400b62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.713+0000 7f545be00640 1 --2- 172.21.15.37:0/2178711080 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54400b3df0 0x7f54400b62b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f544c006010 tx=0x7f544c005a20 comp rx=0 tx=0).stop 2024-08-20T05:16:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.713+0000 7f545be00640 1 -- 172.21.15.37:0/2178711080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f545c1079a0 msgr2=0x7f545c19b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.713+0000 7f545be00640 1 --2- 172.21.15.37:0/2178711080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f545c1079a0 0x7f545c19b060 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f544800c970 tx=0x7f544800ce30 comp rx=0 tx=0).stop 2024-08-20T05:16:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.713+0000 7f545be00640 1 -- 172.21.15.37:0/2178711080 shutdown_connections 2024-08-20T05:16:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.713+0000 7f545be00640 1 --2- 172.21.15.37:0/2178711080 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54400b3df0 0x7f54400b62b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.715 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.713+0000 7f545be00640 1 --2- 172.21.15.37:0/2178711080 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f545c10a3e0 0x7f545c19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.713+0000 7f545be00640 1 --2- 172.21.15.37:0/2178711080 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f545c1079a0 0x7f545c19b060 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.713+0000 7f545be00640 1 --2- 172.21.15.37:0/2178711080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f545c06b060 0x7f545c19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.713+0000 7f545be00640 1 -- 172.21.15.37:0/2178711080 >> 172.21.15.37:0/2178711080 conn(0x7f545c0fcc50 msgr2=0x7f545c1085a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.713+0000 7f545be00640 1 -- 172.21.15.37:0/2178711080 shutdown_connections 2024-08-20T05:16:36.716 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:36.714+0000 7f545be00640 1 -- 172.21.15.37:0/2178711080 wait complete. 2024-08-20T05:16:37.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T05:16:37.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:37 smithi037 ceph-mon[17265]: pgmap v832: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 3.8 MiB/s wr, 420 op/s 2024-08-20T05:16:37.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:37 smithi135 ceph-mon[22342]: pgmap v832: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 3.8 MiB/s wr, 420 op/s 2024-08-20T05:16:37.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:37 smithi130 ceph-mon[22007]: pgmap v832: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 3.8 MiB/s wr, 420 op/s 2024-08-20T05:16:38.042 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 820.0 s, 427.1 tps, lat 235.444 ms stddev 294.664 2024-08-20T05:16:38.220 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:16:39.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.030+0000 7f2d71600640 1 -- 172.21.15.37:0/1221763441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d6c101540 msgr2=0x7f2d6c101920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:39.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.030+0000 7f2d71600640 1 --2- 172.21.15.37:0/1221763441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d6c101540 0x7f2d6c101920 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c009860 tx=0x7f2d5c02a3d0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.030+0000 7f2d71600640 1 -- 172.21.15.37:0/1221763441 shutdown_connections 2024-08-20T05:16:39.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.030+0000 7f2d71600640 1 --2- 172.21.15.37:0/1221763441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d6c10f0f0 0x7f2d6c1114e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.030+0000 7f2d71600640 1 --2- 172.21.15.37:0/1221763441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c101e60 0x7f2d6c10ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.030+0000 7f2d71600640 1 --2- 172.21.15.37:0/1221763441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d6c101540 0x7f2d6c101920 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.030+0000 7f2d71600640 1 -- 172.21.15.37:0/1221763441 >> 172.21.15.37:0/1221763441 conn(0x7f2d6c0fd430 msgr2=0x7f2d6c0ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.031+0000 7f2d71600640 1 -- 172.21.15.37:0/1221763441 shutdown_connections 2024-08-20T05:16:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.031+0000 7f2d71600640 1 -- 172.21.15.37:0/1221763441 wait complete. 2024-08-20T05:16:39.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.032+0000 7f2d71600640 1 Processor -- start 2024-08-20T05:16:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.033+0000 7f2d71600640 1 -- start start 2024-08-20T05:16:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.033+0000 7f2d71600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c101540 0x7f2d6c10e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.033+0000 7f2d71600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d6c101e60 0x7f2d6c10bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.033+0000 7f2d71600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d6c10f0f0 0x7f2d6c10c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.033+0000 7f2d71600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c114cc0 con 0x7f2d6c101540 2024-08-20T05:16:39.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.033+0000 7f2d71600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c114b40 con 0x7f2d6c101e60 2024-08-20T05:16:39.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.033+0000 7f2d71600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c114e40 con 0x7f2d6c10f0f0 2024-08-20T05:16:39.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.034+0000 7f2d6b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d6c10f0f0 0x7f2d6c10c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:39.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.034+0000 7f2d6b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d6c10f0f0 0x7f2d6c10c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49918/0 (socket says 172.21.15.37:49918) 2024-08-20T05:16:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.034+0000 7f2d6b400640 1 -- 172.21.15.37:0/464074448 learned_addr learned my addr 172.21.15.37:0/464074448 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.035+0000 7f2d6aa00640 1 --2- 172.21.15.37:0/464074448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c101540 0x7f2d6c10e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.035+0000 7f2d6a000640 1 --2- 172.21.15.37:0/464074448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d6c101e60 0x7f2d6c10bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.035+0000 7f2d6a000640 1 -- 172.21.15.37:0/464074448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d6c10f0f0 msgr2=0x7f2d6c10c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:39.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.035+0000 7f2d6a000640 1 --2- 172.21.15.37:0/464074448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d6c10f0f0 0x7f2d6c10c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.035+0000 7f2d6a000640 1 -- 172.21.15.37:0/464074448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c101540 msgr2=0x7f2d6c10e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:39.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.035+0000 7f2d6a000640 1 --2- 172.21.15.37:0/464074448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c101540 0x7f2d6c10e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.035+0000 7f2d6a000640 1 -- 172.21.15.37:0/464074448 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c10c920 con 0x7f2d6c101e60 2024-08-20T05:16:39.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.035+0000 7f2d6aa00640 1 --2- 172.21.15.37:0/464074448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c101540 0x7f2d6c10e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:16:39.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.036+0000 7f2d6a000640 1 --2- 172.21.15.37:0/464074448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d6c101e60 0x7f2d6c10bb20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800d6d0 tx=0x7f2d5800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:39.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.036+0000 7f2d63400640 1 -- 172.21.15.37:0/464074448 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58017070 con 0x7f2d6c101e60 2024-08-20T05:16:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.036+0000 7f2d63400640 1 -- 172.21.15.37:0/464074448 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d58009820 con 0x7f2d6c101e60 2024-08-20T05:16:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.036+0000 7f2d63400640 1 -- 172.21.15.37:0/464074448 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58004c40 con 0x7f2d6c101e60 2024-08-20T05:16:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.036+0000 7f2d71600640 1 -- 172.21.15.37:0/464074448 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6c1abaa0 con 0x7f2d6c101e60 2024-08-20T05:16:39.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.037+0000 7f2d71600640 1 -- 172.21.15.37:0/464074448 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d6c1abf60 con 0x7f2d6c101e60 2024-08-20T05:16:39.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.041+0000 7f2d74043740 1 Processor -- start 2024-08-20T05:16:39.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.042+0000 7f2d63400640 1 -- 172.21.15.37:0/464074448 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f2d58005220 con 0x7f2d6c101e60 2024-08-20T05:16:39.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.043+0000 7f2d74043740 1 -- start start 2024-08-20T05:16:39.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.043+0000 7f2d74043740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305d940 0x5556a305dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.043+0000 7f2d74043740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a305e260 0x5556a3069cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.043+0000 7f2d74043740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a306a1f0 0x5556a306c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.043+0000 7f2d74043740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5556a2fd3aa0 con 0x5556a305e260 2024-08-20T05:16:39.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.043+0000 7f2d74043740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5556a2fc2fa0 con 0x5556a305d940 2024-08-20T05:16:39.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.043+0000 7f2d74043740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5556a2fc6fe0 con 0x5556a306a1f0 2024-08-20T05:16:39.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.044+0000 7f2d63400640 1 --2- 172.21.15.37:0/464074448 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2d500b3c90 0x7f2d500b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.045+0000 7f2d6b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305d940 0x5556a305dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:39.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.045+0000 7f2d6b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305d940 0x5556a305dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:46062/0 (socket says 172.21.15.37:46062) 2024-08-20T05:16:39.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.045+0000 7f2d6b400640 1 -- 172.21.15.37:0/995785578 learned_addr learned my addr 172.21.15.37:0/995785578 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:39.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.045+0000 7f2d6b400640 1 --2- 172.21.15.37:0/464074448 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2d500b3c90 0x7f2d500b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:39.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.045+0000 7f2d6a000640 1 --2- 172.21.15.37:0/995785578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a306a1f0 0x5556a306c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:39.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.045+0000 7f2d63400640 1 -- 172.21.15.37:0/464074448 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2d580e3a30 con 0x7f2d6c101e60 2024-08-20T05:16:39.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.046+0000 7f2d6b400640 1 -- 172.21.15.37:0/995785578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a306a1f0 msgr2=0x5556a306c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:39.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.046+0000 7f2d6aa00640 1 --2- 172.21.15.37:0/995785578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a305e260 0x5556a3069cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:39.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.046+0000 7f2d6b400640 1 --2- 172.21.15.37:0/995785578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a306a1f0 0x5556a306c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.046+0000 7f2d6b400640 1 -- 172.21.15.37:0/995785578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a305e260 msgr2=0x5556a3069cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:39.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.046+0000 7f2d6b400640 1 --2- 172.21.15.37:0/995785578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a305e260 0x5556a3069cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.047+0000 7f2d6b400640 1 -- 172.21.15.37:0/995785578 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556a2f69420 con 0x5556a305d940 2024-08-20T05:16:39.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.047+0000 7f2d6aa00640 1 --2- 172.21.15.37:0/995785578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a305e260 0x5556a3069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:16:39.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.048+0000 7f2d6b400640 1 --2- 172.21.15.37:0/995785578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305d940 0x5556a305dd20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400c4c0 tx=0x7f2d6400c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c7b47fb3179949a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:39.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.048+0000 7f2d6b400640 1 --2- 172.21.15.37:0/464074448 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2d500b3c90 0x7f2d500b6150 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400ce80 tx=0x7f2d64011000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:39.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.049+0000 7f2d57400640 1 -- 172.21.15.37:0/995785578 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d64003970 con 0x5556a305d940 2024-08-20T05:16:39.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.049+0000 7f2d57400640 1 -- 172.21.15.37:0/995785578 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d64004020 con 0x5556a305d940 2024-08-20T05:16:39.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.049+0000 7f2d57400640 1 -- 172.21.15.37:0/995785578 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6400eb60 con 0x5556a305d940 2024-08-20T05:16:39.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.050+0000 7f2d74043740 1 -- 172.21.15.37:0/995785578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305d940 msgr2=0x5556a305dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:39.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.050+0000 7f2d74043740 1 --2- 172.21.15.37:0/995785578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305d940 0x5556a305dd20 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400c4c0 tx=0x7f2d6400c980 comp rx=0 tx=0).stop 2024-08-20T05:16:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.050+0000 7f2d74043740 1 -- 172.21.15.37:0/995785578 shutdown_connections 2024-08-20T05:16:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.050+0000 7f2d74043740 1 --2- 172.21.15.37:0/995785578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a306a1f0 0x5556a306c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.050+0000 7f2d74043740 1 --2- 172.21.15.37:0/995785578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a305e260 0x5556a3069cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.050+0000 7f2d74043740 1 --2- 172.21.15.37:0/995785578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305d940 0x5556a305dd20 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.050+0000 7f2d74043740 1 -- 172.21.15.37:0/995785578 >> 172.21.15.37:0/995785578 conn(0x5556a305b770 msgr2=0x5556a305c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.051+0000 7f2d74043740 1 -- 172.21.15.37:0/995785578 shutdown_connections 2024-08-20T05:16:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.051+0000 7f2d74043740 1 -- 172.21.15.37:0/995785578 wait complete. 2024-08-20T05:16:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.052+0000 7f2d74043740 1 -- start start 2024-08-20T05:16:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.052+0000 7f2d74043740 1 Processor -- start 2024-08-20T05:16:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.053+0000 7f2d74043740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305d940 0x5556a3069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.053+0000 7f2d74043740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a305e260 0x5556a3066e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.053+0000 7f2d74043740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a306a1f0 0x5556a3067390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.053+0000 7f2d74043740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5556a2e25700 con 0x5556a305e260 2024-08-20T05:16:39.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.053+0000 7f2d74043740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5556a2f5e290 con 0x5556a306a1f0 2024-08-20T05:16:39.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.053+0000 7f2d74043740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5556a306cdb0 con 0x5556a305d940 2024-08-20T05:16:39.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.053+0000 7f2d74043740 10 client.0 _ll_register_callbacks cb 0x5556a2fbd1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:39.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.053+0000 7f2d6aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305d940 0x5556a3069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:39.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.053+0000 7f2d6aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305d940 0x5556a3069a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49930/0 (socket says 172.21.15.37:49930) 2024-08-20T05:16:39.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.053+0000 7f2d6aa00640 1 -- 172.21.15.37:0/1602564121 learned_addr learned my addr 172.21.15.37:0/1602564121 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:39.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.053+0000 7f2d6a000640 1 --2- 172.21.15.37:0/1602564121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a305e260 0x5556a3066e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:39.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.054+0000 7f2d6aa00640 1 -- 172.21.15.37:0/1602564121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a306a1f0 msgr2=0x5556a3067390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:39.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.054+0000 7f2d6aa00640 1 --2- 172.21.15.37:0/1602564121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a306a1f0 0x5556a3067390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.054+0000 7f2d6aa00640 1 -- 172.21.15.37:0/1602564121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a305e260 msgr2=0x5556a3066e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:39.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.054+0000 7f2d6aa00640 1 --2- 172.21.15.37:0/1602564121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a305e260 0x5556a3066e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.054+0000 7f2d6aa00640 1 -- 172.21.15.37:0/1602564121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556a2d22650 con 0x5556a305d940 2024-08-20T05:16:39.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.054+0000 7f2d6aa00640 1 --2- 172.21.15.37:0/1602564121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305d940 0x5556a3069a00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c005d00 tx=0x7f2d5c030b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ec15f3cf7a3787c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:39.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.054+0000 7f2d4be00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:16:39.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.054+0000 7f2d4be00640 1 -- 172.21.15.37:0/1602564121 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c004250 con 0x5556a305d940 2024-08-20T05:16:39.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.054+0000 7f2d4be00640 1 -- 172.21.15.37:0/1602564121 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2d5c0043f0 con 0x5556a305d940 2024-08-20T05:16:39.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.054+0000 7f2d74043740 1 -- 172.21.15.37:0/1602564121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d64004020 con 0x5556a305d940 2024-08-20T05:16:39.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.055+0000 7f2d4be00640 1 -- 172.21.15.37:0/1602564121 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f2d5c04d050 con 0x5556a305d940 2024-08-20T05:16:39.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.055+0000 7f2d74043740 10 client.28954 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:39.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.055+0000 7f2d74043740 1 -- 172.21.15.37:0/1602564121 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5556a30785a0 con 0x5556a305d940 2024-08-20T05:16:39.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.055+0000 7f2d4be00640 1 -- 172.21.15.37:0/1602564121 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d64004020 con 0x5556a305d940 2024-08-20T05:16:39.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.056+0000 7f2d4be00640 1 -- 172.21.15.37:0/1602564121 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f2d5c004bc0 con 0x5556a305d940 2024-08-20T05:16:39.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.056+0000 7f2d74043740 10 client.28954 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:39.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.056+0000 7f2d74043740 10 client.28954 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:16:39.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.056+0000 7f2d74043740 20 client.28954 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:39.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.056+0000 7f2d74043740 1 --2- 172.21.15.37:0/1602564121 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5556a3079a20 0x5556a307bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.056+0000 7f2d74043740 4 client.28954 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:16:39.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.056+0000 7f2d74043740 1 -- 172.21.15.37:0/1602564121 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556a2fd59f0 con 0x5556a3079a20 2024-08-20T05:16:39.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.057+0000 7f2d6a000640 1 --2- 172.21.15.37:0/1602564121 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5556a3079a20 0x5556a307bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:39.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.059+0000 7f2d4be00640 10 client.28954 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:16:39.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.059+0000 7f2d6a000640 1 --2- 172.21.15.37:0/1602564121 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5556a3079a20 0x5556a307bea0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=941085a4c12c741e server_cookie=260fbfc80fb17227 in_seq=0 out_seq=0 2024-08-20T05:16:39.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.060+0000 7f2d4be00640 1 -- 172.21.15.37:0/1602564121 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556a2fd59f0 con 0x5556a3079a20 2024-08-20T05:16:39.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.060+0000 7f2d4be00640 10 client.28954 handle_command_reply: tid=0 2024-08-20T05:16:39.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.060+0000 7f2d74043740 1 client.28954 shutdown 2024-08-20T05:16:39.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.061+0000 7f2d74043740 1 -- 172.21.15.37:0/1602564121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305d940 msgr2=0x5556a3069a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:39.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.061+0000 7f2d74043740 1 --2- 172.21.15.37:0/1602564121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305d940 0x5556a3069a00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c005d00 tx=0x7f2d5c030b90 comp rx=0 tx=0).stop 2024-08-20T05:16:39.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.061+0000 7f2d74043740 1 -- 172.21.15.37:0/1602564121 shutdown_connections 2024-08-20T05:16:39.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.061+0000 7f2d74043740 1 --2- 172.21.15.37:0/1602564121 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5556a3079a20 0x5556a307bea0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.061+0000 7f2d74043740 1 --2- 172.21.15.37:0/1602564121 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a306a1f0 0x5556a3067390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.061+0000 7f2d74043740 1 --2- 172.21.15.37:0/1602564121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a305e260 0x5556a3066e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.061+0000 7f2d4be00640 0 client.28954 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:16:39.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.061+0000 7f2d74043740 1 --2- 172.21.15.37:0/1602564121 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305d940 0x5556a3069a00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.061+0000 7f2d74043740 1 -- 172.21.15.37:0/1602564121 >> 172.21.15.37:0/1602564121 conn(0x5556a305b770 msgr2=0x5556a3061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:39.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.062+0000 7f2d74043740 1 -- 172.21.15.37:0/1602564121 shutdown_connections 2024-08-20T05:16:39.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.062+0000 7f2d74043740 1 -- 172.21.15.37:0/1602564121 wait complete. 2024-08-20T05:16:39.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.062+0000 7f2d74043740 20 client.28954 trim_cache size 0 max 16384 2024-08-20T05:16:39.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.079+0000 7f2d74043740 1 Processor -- start 2024-08-20T05:16:39.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.080+0000 7f2d74043740 1 -- start start 2024-08-20T05:16:39.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.080+0000 7f2d74043740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305d940 0x5556a305ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.080+0000 7f2d74043740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305e260 0x5556a30817c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.080+0000 7f2d74043740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a306a1f0 0x5556a3081d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.080+0000 7f2d74043740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c1b5e30 con 0x5556a306a1f0 2024-08-20T05:16:39.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.080+0000 7f2d74043740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c1b79d0 con 0x5556a305d940 2024-08-20T05:16:39.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.080+0000 7f2d74043740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c1b6500 con 0x5556a305e260 2024-08-20T05:16:39.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.080+0000 7f2d6aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305d940 0x5556a305ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:39.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.080+0000 7f2d6aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305d940 0x5556a305ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:46074/0 (socket says 172.21.15.37:46074) 2024-08-20T05:16:39.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.080+0000 7f2d6aa00640 1 -- 172.21.15.37:0/1497156805 learned_addr learned my addr 172.21.15.37:0/1497156805 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:39.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.081+0000 7f2d6a000640 1 --2- 172.21.15.37:0/1497156805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305e260 0x5556a30817c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:39.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.081+0000 7f2d6b400640 1 --2- 172.21.15.37:0/1497156805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a306a1f0 0x5556a3081d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:39.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.081+0000 7f2d6aa00640 1 -- 172.21.15.37:0/1497156805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305e260 msgr2=0x5556a30817c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:39.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.081+0000 7f2d6aa00640 1 --2- 172.21.15.37:0/1497156805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305e260 0x5556a30817c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.081+0000 7f2d6aa00640 1 -- 172.21.15.37:0/1497156805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a306a1f0 msgr2=0x5556a3081d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:39.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.081+0000 7f2d6aa00640 1 --2- 172.21.15.37:0/1497156805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a306a1f0 0x5556a3081d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.081+0000 7f2d6aa00640 1 -- 172.21.15.37:0/1497156805 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556a3056ed0 con 0x5556a305d940 2024-08-20T05:16:39.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.082+0000 7f2d6aa00640 1 --2- 172.21.15.37:0/1497156805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305d940 0x5556a305ab00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c005b10 tx=0x7f2d5c0308d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=443357177c697fd9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:39.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.082+0000 7f2d56a00640 1 -- 172.21.15.37:0/1497156805 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c003a30 con 0x5556a305d940 2024-08-20T05:16:39.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.082+0000 7f2d56a00640 1 -- 172.21.15.37:0/1497156805 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d5c056070 con 0x5556a305d940 2024-08-20T05:16:39.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.082+0000 7f2d56a00640 1 -- 172.21.15.37:0/1497156805 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c004b20 con 0x5556a305d940 2024-08-20T05:16:39.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.083+0000 7f2d74043740 1 -- 172.21.15.37:0/1497156805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305d940 msgr2=0x5556a305ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:39.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.083+0000 7f2d74043740 1 --2- 172.21.15.37:0/1497156805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305d940 0x5556a305ab00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c005b10 tx=0x7f2d5c0308d0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.084+0000 7f2d74043740 1 -- 172.21.15.37:0/1497156805 shutdown_connections 2024-08-20T05:16:39.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.084+0000 7f2d74043740 1 --2- 172.21.15.37:0/1497156805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a306a1f0 0x5556a3081d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.084+0000 7f2d74043740 1 --2- 172.21.15.37:0/1497156805 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305e260 0x5556a30817c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.085+0000 7f2d74043740 1 --2- 172.21.15.37:0/1497156805 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305d940 0x5556a305ab00 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.085+0000 7f2d74043740 1 -- 172.21.15.37:0/1497156805 >> 172.21.15.37:0/1497156805 conn(0x5556a305b770 msgr2=0x5556a3065ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:39.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.085+0000 7f2d74043740 1 -- 172.21.15.37:0/1497156805 shutdown_connections 2024-08-20T05:16:39.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.085+0000 7f2d74043740 1 -- 172.21.15.37:0/1497156805 wait complete. 2024-08-20T05:16:39.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.086+0000 7f2d74043740 1 -- start start 2024-08-20T05:16:39.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.086+0000 7f2d74043740 1 Processor -- start 2024-08-20T05:16:39.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.087+0000 7f2d74043740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305d940 0x5556a3072890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.087+0000 7f2d74043740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305e260 0x5556a306fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.087+0000 7f2d74043740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a306a1f0 0x5556a30704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.087+0000 7f2d74043740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c1b7300 con 0x5556a306a1f0 2024-08-20T05:16:39.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.087+0000 7f2d74043740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c1b6bd0 con 0x5556a305e260 2024-08-20T05:16:39.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.087+0000 7f2d74043740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c1b3e10 con 0x5556a305d940 2024-08-20T05:16:39.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.087+0000 7f2d74043740 10 client.0 _ll_register_callbacks cb 0x7f2d64009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:39.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.087+0000 7f2d6a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305e260 0x5556a306fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:39.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.087+0000 7f2d6b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a306a1f0 0x5556a30704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:39.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.087+0000 7f2d6a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305e260 0x5556a306fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:46090/0 (socket says 172.21.15.37:46090) 2024-08-20T05:16:39.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.087+0000 7f2d6a000640 1 -- 172.21.15.37:0/3251157991 learned_addr learned my addr 172.21.15.37:0/3251157991 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:39.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.087+0000 7f2d6aa00640 1 --2- 172.21.15.37:0/3251157991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305d940 0x5556a3072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:39.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.088+0000 7f2d6a000640 1 -- 172.21.15.37:0/3251157991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305d940 msgr2=0x5556a3072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:39.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.088+0000 7f2d6a000640 1 --2- 172.21.15.37:0/3251157991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305d940 0x5556a3072890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.088+0000 7f2d6a000640 1 -- 172.21.15.37:0/3251157991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a306a1f0 msgr2=0x5556a30704a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:39.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.088+0000 7f2d6a000640 1 --2- 172.21.15.37:0/3251157991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a306a1f0 0x5556a30704a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.088+0000 7f2d6a000640 1 -- 172.21.15.37:0/3251157991 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556a30e37a0 con 0x5556a305e260 2024-08-20T05:16:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.088+0000 7f2d6aa00640 1 --2- 172.21.15.37:0/3251157991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305d940 0x5556a3072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.088+0000 7f2d6b400640 1 --2- 172.21.15.37:0/3251157991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a306a1f0 0x5556a30704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.088+0000 7f2d6a000640 1 --2- 172.21.15.37:0/3251157991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305e260 0x5556a306fdd0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800d6a0 tx=0x7f2d580209f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2eeede8fccf0b911 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.088+0000 7f2d4be00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:16:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.089+0000 7f2d4be00640 1 -- 172.21.15.37:0/3251157991 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d58020040 con 0x5556a305e260 2024-08-20T05:16:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.089+0000 7f2d4be00640 1 -- 172.21.15.37:0/3251157991 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f2d580a6bd0 con 0x5556a305e260 2024-08-20T05:16:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.089+0000 7f2d74043740 1 -- 172.21.15.37:0/3251157991 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d5c056070 con 0x5556a305e260 2024-08-20T05:16:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.089+0000 7f2d4be00640 1 -- 172.21.15.37:0/3251157991 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f2d580aace0 con 0x5556a305e260 2024-08-20T05:16:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.089+0000 7f2d74043740 10 client.28916 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.089+0000 7f2d74043740 1 -- 172.21.15.37:0/3251157991 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5556a30e49a0 con 0x5556a305e260 2024-08-20T05:16:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.089+0000 7f2d4be00640 1 -- 172.21.15.37:0/3251157991 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d580c7070 con 0x5556a305e260 2024-08-20T05:16:39.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.089+0000 7f2d4be00640 1 -- 172.21.15.37:0/3251157991 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f2d580a6870 con 0x5556a305e260 2024-08-20T05:16:39.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.089+0000 7f2d74043740 10 client.28916 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:39.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.089+0000 7f2d74043740 10 client.28916 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:16:39.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.089+0000 7f2d74043740 20 client.28916 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:39.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.089+0000 7f2d74043740 1 --2- 172.21.15.37:0/3251157991 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5556a30e5120 0x5556a30e7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:39.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.089+0000 7f2d74043740 4 client.28916 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:16:39.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.089+0000 7f2d74043740 1 -- 172.21.15.37:0/3251157991 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5556a2fd1490 con 0x5556a30e5120 2024-08-20T05:16:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.090+0000 7f2d6aa00640 1 --2- 172.21.15.37:0/3251157991 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5556a30e5120 0x5556a30e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.091+0000 7f2d6aa00640 1 --2- 172.21.15.37:0/3251157991 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5556a30e5120 0x5556a30e7540 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e3cfa4ec9b6e6dad server_cookie=6da60b1ea9b18b08 in_seq=0 out_seq=0 2024-08-20T05:16:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.091+0000 7f2d4be00640 10 client.28916 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:16:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.091+0000 7f2d4be00640 1 -- 172.21.15.37:0/3251157991 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5556a2fd1490 con 0x5556a30e5120 2024-08-20T05:16:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.091+0000 7f2d4be00640 10 client.28916 handle_command_reply: tid=0 2024-08-20T05:16:39.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.091+0000 7f2d74043740 1 client.28916 shutdown 2024-08-20T05:16:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.091+0000 7f2d74043740 1 -- 172.21.15.37:0/3251157991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305e260 msgr2=0x5556a306fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.091+0000 7f2d74043740 1 --2- 172.21.15.37:0/3251157991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305e260 0x5556a306fdd0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800d6a0 tx=0x7f2d580209f0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.091+0000 7f2d74043740 1 -- 172.21.15.37:0/3251157991 shutdown_connections 2024-08-20T05:16:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.091+0000 7f2d74043740 1 --2- 172.21.15.37:0/3251157991 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5556a30e5120 0x5556a30e7540 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.091+0000 7f2d74043740 1 --2- 172.21.15.37:0/3251157991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5556a306a1f0 0x5556a30704a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.091+0000 7f2d74043740 1 --2- 172.21.15.37:0/3251157991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5556a305e260 0x5556a306fdd0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.091+0000 7f2d74043740 1 --2- 172.21.15.37:0/3251157991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5556a305d940 0x5556a3072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.091+0000 7f2d74043740 1 -- 172.21.15.37:0/3251157991 >> 172.21.15.37:0/3251157991 conn(0x5556a305b770 msgr2=0x5556a3068480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.091+0000 7f2d4be00640 0 client.28916 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:16:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.092+0000 7f2d74043740 1 -- 172.21.15.37:0/3251157991 shutdown_connections 2024-08-20T05:16:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.092+0000 7f2d74043740 1 -- 172.21.15.37:0/3251157991 wait complete. 2024-08-20T05:16:39.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.092+0000 7f2d74043740 20 client.28916 trim_cache size 0 max 16384 2024-08-20T05:16:39.096 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:16:39.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.093+0000 7f2d71600640 1 -- 172.21.15.37:0/464074448 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2d500b3c90 msgr2=0x7f2d500b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:39.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.093+0000 7f2d71600640 1 --2- 172.21.15.37:0/464074448 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2d500b3c90 0x7f2d500b6150 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400ce80 tx=0x7f2d64011000 comp rx=0 tx=0).stop 2024-08-20T05:16:39.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.093+0000 7f2d71600640 1 -- 172.21.15.37:0/464074448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d6c101e60 msgr2=0x7f2d6c10bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:39.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.093+0000 7f2d71600640 1 --2- 172.21.15.37:0/464074448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d6c101e60 0x7f2d6c10bb20 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800d6d0 tx=0x7f2d5800db90 comp rx=0 tx=0).stop 2024-08-20T05:16:39.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.093+0000 7f2d71600640 1 -- 172.21.15.37:0/464074448 shutdown_connections 2024-08-20T05:16:39.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.093+0000 7f2d71600640 1 --2- 172.21.15.37:0/464074448 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f2d500b3c90 0x7f2d500b6150 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.093+0000 7f2d71600640 1 --2- 172.21.15.37:0/464074448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f2d6c10f0f0 0x7f2d6c10c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.093+0000 7f2d71600640 1 --2- 172.21.15.37:0/464074448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f2d6c101e60 0x7f2d6c10bb20 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.093+0000 7f2d71600640 1 --2- 172.21.15.37:0/464074448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c101540 0x7f2d6c10e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:39.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.093+0000 7f2d71600640 1 -- 172.21.15.37:0/464074448 >> 172.21.15.37:0/464074448 conn(0x7f2d6c0fd430 msgr2=0x7f2d6c1112e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:39.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.093+0000 7f2d71600640 1 -- 172.21.15.37:0/464074448 shutdown_connections 2024-08-20T05:16:39.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:39.093+0000 7f2d71600640 1 -- 172.21.15.37:0/464074448 wait complete. 2024-08-20T05:16:39.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:39 smithi037 ceph-mon[17265]: pgmap v833: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 4.6 MiB/s wr, 491 op/s 2024-08-20T05:16:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:39 smithi135 ceph-mon[22342]: pgmap v833: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 4.6 MiB/s wr, 491 op/s 2024-08-20T05:16:39.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:39 smithi130 ceph-mon[22007]: pgmap v833: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 4.6 MiB/s wr, 491 op/s 2024-08-20T05:16:40.530 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T05:16:41.220 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:16:41.664 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:41 smithi037 ceph-mon[17265]: pgmap v834: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 4.0 MiB/s wr, 445 op/s 2024-08-20T05:16:41.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:41 smithi135 ceph-mon[22342]: pgmap v834: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 4.0 MiB/s wr, 445 op/s 2024-08-20T05:16:41.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:41 smithi130 ceph-mon[22007]: pgmap v834: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 4.0 MiB/s wr, 445 op/s 2024-08-20T05:16:42.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.738+0000 7f54ebe00640 1 -- 172.21.15.37:0/1752936516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54ec10cc70 msgr2=0x7f54ec10f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:42.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.738+0000 7f54ebe00640 1 --2- 172.21.15.37:0/1752936516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54ec10cc70 0x7f54ec10f0d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009be0 tx=0x7f54e402a710 comp rx=0 tx=0).stop 2024-08-20T05:16:42.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.738+0000 7f54ebe00640 1 -- 172.21.15.37:0/1752936516 shutdown_connections 2024-08-20T05:16:42.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.738+0000 7f54ebe00640 1 --2- 172.21.15.37:0/1752936516 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54ec10cc70 0x7f54ec10f0d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.738+0000 7f54ebe00640 1 --2- 172.21.15.37:0/1752936516 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54ec104130 0x7f54ec10c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.738+0000 7f54ebe00640 1 --2- 172.21.15.37:0/1752936516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ec103810 0x7f54ec103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.738+0000 7f54ebe00640 1 -- 172.21.15.37:0/1752936516 >> 172.21.15.37:0/1752936516 conn(0x7f54ec0fd2d0 msgr2=0x7f54ec0ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:42.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.746+0000 7f54ebe00640 1 -- 172.21.15.37:0/1752936516 shutdown_connections 2024-08-20T05:16:42.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.748+0000 7f54ebe00640 1 -- 172.21.15.37:0/1752936516 wait complete. 2024-08-20T05:16:42.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.749+0000 7f54ebe00640 1 Processor -- start 2024-08-20T05:16:42.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.749+0000 7f54ebe00640 1 -- start start 2024-08-20T05:16:42.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.750+0000 7f54ebe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54ec104130 0x7f54ec19aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.750+0000 7f54ebe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ec10cc70 0x7f54ec19b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.750+0000 7f54ebe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54ec1a0790 0x7f54ec1a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.750+0000 7f54ebe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec114ba0 con 0x7f54ec10cc70 2024-08-20T05:16:42.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.750+0000 7f54ebe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec114a20 con 0x7f54ec1a0790 2024-08-20T05:16:42.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.750+0000 7f54ebe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec114d20 con 0x7f54ec104130 2024-08-20T05:16:42.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.750+0000 7f54eaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54ec104130 0x7f54ec19aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:42.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.750+0000 7f54eaa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54ec104130 0x7f54ec19aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:49966/0 (socket says 172.21.15.37:49966) 2024-08-20T05:16:42.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.750+0000 7f54eaa00640 1 -- 172.21.15.37:0/4086177303 learned_addr learned my addr 172.21.15.37:0/4086177303 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:42.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.751+0000 7f54eb400640 1 --2- 172.21.15.37:0/4086177303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54ec1a0790 0x7f54ec1a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:42.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.751+0000 7f54eaa00640 1 -- 172.21.15.37:0/4086177303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54ec1a0790 msgr2=0x7f54ec1a0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:42.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.751+0000 7f54eaa00640 1 --2- 172.21.15.37:0/4086177303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54ec1a0790 0x7f54ec1a0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.751+0000 7f54eaa00640 1 -- 172.21.15.37:0/4086177303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ec10cc70 msgr2=0x7f54ec19b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:42.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.751+0000 7f54eaa00640 1 --2- 172.21.15.37:0/4086177303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ec10cc70 0x7f54ec19b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.751+0000 7f54eaa00640 1 -- 172.21.15.37:0/4086177303 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ec1a1340 con 0x7f54ec104130 2024-08-20T05:16:42.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.753+0000 7f54eaa00640 1 --2- 172.21.15.37:0/4086177303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54ec104130 0x7f54ec19aeb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00d6d0 tx=0x7f54dc00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:42.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.755+0000 7f54e3400640 1 -- 172.21.15.37:0/4086177303 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc017070 con 0x7f54ec104130 2024-08-20T05:16:42.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.755+0000 7f54e3400640 1 -- 172.21.15.37:0/4086177303 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54dc010460 con 0x7f54ec104130 2024-08-20T05:16:42.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.755+0000 7f54e3400640 1 -- 172.21.15.37:0/4086177303 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54dc00f600 con 0x7f54ec104130 2024-08-20T05:16:42.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.755+0000 7f54ebe00640 1 -- 172.21.15.37:0/4086177303 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ec06c8a0 con 0x7f54ec104130 2024-08-20T05:16:42.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.756+0000 7f54ebe00640 1 -- 172.21.15.37:0/4086177303 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ec06cd90 con 0x7f54ec104130 2024-08-20T05:16:42.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.760+0000 7f54f482a740 1 Processor -- start 2024-08-20T05:16:42.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.761+0000 7f54f482a740 1 -- start start 2024-08-20T05:16:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.762+0000 7f54f482a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 0x55ce7e4df6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.763+0000 7f54f482a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e4eb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.763+0000 7f54eb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 0x55ce7e4df6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:42.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.763+0000 7f54f482a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4ebb80 0x55ce7e4edf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.764+0000 7f54eb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 0x55ce7e4df6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41420/0 (socket says 172.21.15.37:41420) 2024-08-20T05:16:42.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.764+0000 7f54eb400640 1 -- 172.21.15.37:0/3353777875 learned_addr learned my addr 172.21.15.37:0/3353777875 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:42.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.764+0000 7f54f482a740 1 -- 172.21.15.37:0/3353777875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ce7e44caa0 con 0x55ce7e4df2d0 2024-08-20T05:16:42.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.764+0000 7f54f482a740 1 -- 172.21.15.37:0/3353777875 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ce7e43bfa0 con 0x55ce7e4dfbf0 2024-08-20T05:16:42.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.765+0000 7f54f482a740 1 -- 172.21.15.37:0/3353777875 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ce7e43ffe0 con 0x55ce7e4ebb80 2024-08-20T05:16:42.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.765+0000 7f54ea000640 1 --2- 172.21.15.37:0/3353777875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4ebb80 0x55ce7e4edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:42.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.766+0000 7f54ea000640 1 -- 172.21.15.37:0/3353777875 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4dfbf0 msgr2=0x55ce7e4eb640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:16:42.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.766+0000 7f54ea000640 1 --2- 172.21.15.37:0/3353777875 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e4eb640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.766+0000 7f54ea000640 1 -- 172.21.15.37:0/3353777875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 msgr2=0x55ce7e4df6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:42.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.766+0000 7f54ea000640 1 --2- 172.21.15.37:0/3353777875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 0x55ce7e4df6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.766+0000 7f54ea000640 1 -- 172.21.15.37:0/3353777875 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce7e3e2420 con 0x55ce7e4ebb80 2024-08-20T05:16:42.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.770+0000 7f54e3400640 1 -- 172.21.15.37:0/4086177303 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f54dc01a070 con 0x7f54ec104130 2024-08-20T05:16:42.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.773+0000 7f54e3400640 1 --2- 172.21.15.37:0/4086177303 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54d00b3e40 0x7f54d00b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.773+0000 7f54e3400640 1 -- 172.21.15.37:0/4086177303 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f54dc0e3640 con 0x7f54ec104130 2024-08-20T05:16:42.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.774+0000 7f54ea000640 1 --2- 172.21.15.37:0/3353777875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4ebb80 0x55ce7e4edf70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f54ec06b650 tx=0x7f54d800bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f39c42c5617451c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:42.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.774+0000 7f54eb400640 1 --2- 172.21.15.37:0/4086177303 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54d00b3e40 0x7f54d00b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:42.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.776+0000 7f54d7e00640 1 -- 172.21.15.37:0/3353777875 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d8016070 con 0x55ce7e4ebb80 2024-08-20T05:16:42.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.776+0000 7f54d7e00640 1 -- 172.21.15.37:0/3353777875 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54d80054d0 con 0x55ce7e4ebb80 2024-08-20T05:16:42.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.776+0000 7f54d7e00640 1 -- 172.21.15.37:0/3353777875 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d8004df0 con 0x55ce7e4ebb80 2024-08-20T05:16:42.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.777+0000 7f54f482a740 1 -- 172.21.15.37:0/3353777875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4ebb80 msgr2=0x55ce7e4edf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:42.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.777+0000 7f54f482a740 1 --2- 172.21.15.37:0/3353777875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4ebb80 0x55ce7e4edf70 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f54ec06b650 tx=0x7f54d800bf80 comp rx=0 tx=0).stop 2024-08-20T05:16:42.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.777+0000 7f54eb400640 1 --2- 172.21.15.37:0/4086177303 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54d00b3e40 0x7f54d00b6300 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f54e40099a0 tx=0x7f54e400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:42.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.778+0000 7f54f482a740 1 -- 172.21.15.37:0/3353777875 shutdown_connections 2024-08-20T05:16:42.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.778+0000 7f54f482a740 1 --2- 172.21.15.37:0/3353777875 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4ebb80 0x55ce7e4edf70 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.778+0000 7f54f482a740 1 --2- 172.21.15.37:0/3353777875 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e4eb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.778+0000 7f54f482a740 1 --2- 172.21.15.37:0/3353777875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 0x55ce7e4df6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.778+0000 7f54f482a740 1 -- 172.21.15.37:0/3353777875 >> 172.21.15.37:0/3353777875 conn(0x55ce7e4dd100 msgr2=0x55ce7e4de2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:42.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.778+0000 7f54f482a740 1 -- 172.21.15.37:0/3353777875 shutdown_connections 2024-08-20T05:16:42.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.778+0000 7f54f482a740 1 -- 172.21.15.37:0/3353777875 wait complete. 2024-08-20T05:16:42.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.779+0000 7f54f482a740 1 -- start start 2024-08-20T05:16:42.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.779+0000 7f54f482a740 1 Processor -- start 2024-08-20T05:16:42.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.781+0000 7f54f482a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 0x55ce7e4eb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.781+0000 7f54f482a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e4e8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.781+0000 7f54f482a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4ebb80 0x55ce7e4e8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.782+0000 7f54f482a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ce7e29e700 con 0x55ce7e4df2d0 2024-08-20T05:16:42.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.782+0000 7f54f482a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55ce7e3d7290 con 0x55ce7e4ebb80 2024-08-20T05:16:42.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.782+0000 7f54f482a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55ce7e4ee830 con 0x55ce7e4dfbf0 2024-08-20T05:16:42.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.782+0000 7f54eb400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4ebb80 0x55ce7e4e8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:42.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.782+0000 7f54eb400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4ebb80 0x55ce7e4e8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:46104/0 (socket says 172.21.15.37:46104) 2024-08-20T05:16:42.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.782+0000 7f54eb400640 1 -- 172.21.15.37:0/497087407 learned_addr learned my addr 172.21.15.37:0/497087407 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:42.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.782+0000 7f54f482a740 10 client.0 _ll_register_callbacks cb 0x55ce7e4361c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:42.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.783+0000 7f54eb400640 1 -- 172.21.15.37:0/497087407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4dfbf0 msgr2=0x55ce7e4e8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:42.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.782+0000 7f54ea000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e4e8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:42.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.783+0000 7f54eb400640 1 --2- 172.21.15.37:0/497087407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e4e8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.784+0000 7f54eb400640 1 -- 172.21.15.37:0/497087407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 msgr2=0x55ce7e4eb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:42.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.784+0000 7f54eb400640 1 --2- 172.21.15.37:0/497087407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 0x55ce7e4eb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.784+0000 7f54eb400640 1 -- 172.21.15.37:0/497087407 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce7e19b650 con 0x55ce7e4ebb80 2024-08-20T05:16:42.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.784+0000 7f54f482a740 1 -- 172.21.15.37:0/497087407 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54d80054d0 con 0x55ce7e4ebb80 2024-08-20T05:16:42.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.784+0000 7f54ea000640 1 --2- 172.21.15.37:0/497087407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e4e8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:16:42.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.785+0000 7f54d4c00640 10 client.28925 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:16:42.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.785+0000 7f54eb400640 1 --2- 172.21.15.37:0/497087407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4ebb80 0x55ce7e4e8df0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009b30 tx=0x7f54e402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10a4f31db816b1c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.787+0000 7f54d4c00640 1 -- 172.21.15.37:0/497087407 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e404f020 con 0x55ce7e4ebb80 2024-08-20T05:16:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.787+0000 7f54d4c00640 1 -- 172.21.15.37:0/497087407 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f54e4004040 con 0x55ce7e4ebb80 2024-08-20T05:16:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.787+0000 7f54d4c00640 1 -- 172.21.15.37:0/497087407 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f54e4036040 con 0x55ce7e4ebb80 2024-08-20T05:16:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.788+0000 7f54f482a740 10 client.28925 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:42.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.789+0000 7f54f482a740 1 -- 172.21.15.37:0/497087407 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({fsmap=50}) -- 0x55ce7e4fa070 con 0x55ce7e4ebb80 2024-08-20T05:16:42.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.789+0000 7f54d4c00640 1 -- 172.21.15.37:0/497087407 <== mon.2 v2:172.21.15.130:3300/0 4 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f54e4004240 con 0x55ce7e4ebb80 2024-08-20T05:16:42.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.790+0000 7f54f482a740 10 client.28925 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:42.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.790+0000 7f54f482a740 10 client.28925 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:16:42.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.790+0000 7f54f482a740 20 client.28925 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:42.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.790+0000 7f54f482a740 1 --2- 172.21.15.37:0/497087407 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55ce7e4fb470 0x55ce7e4fd860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.790+0000 7f54f482a740 4 client.28925 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:16:42.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.790+0000 7f54f482a740 1 -- 172.21.15.37:0/497087407 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce7e44e9f0 con 0x55ce7e4fb470 2024-08-20T05:16:42.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.792+0000 7f54eaa00640 1 --2- 172.21.15.37:0/497087407 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55ce7e4fb470 0x55ce7e4fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:42.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.795+0000 7f54d4c00640 10 client.28925 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:16:42.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.795+0000 7f54eaa00640 1 --2- 172.21.15.37:0/497087407 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55ce7e4fb470 0x55ce7e4fd860 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4125019e44879b17 server_cookie=2a862752f0e785e9 in_seq=0 out_seq=0 2024-08-20T05:16:42.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.798+0000 7f54d4c00640 1 -- 172.21.15.37:0/497087407 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ce7e44e9f0 con 0x55ce7e4fb470 2024-08-20T05:16:42.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.798+0000 7f54d4c00640 10 client.28925 handle_command_reply: tid=0 2024-08-20T05:16:42.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.798+0000 7f54f482a740 1 client.28925 shutdown 2024-08-20T05:16:42.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.798+0000 7f54f482a740 1 -- 172.21.15.37:0/497087407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4ebb80 msgr2=0x55ce7e4e8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:42.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.798+0000 7f54f482a740 1 --2- 172.21.15.37:0/497087407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4ebb80 0x55ce7e4e8df0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009b30 tx=0x7f54e402a710 comp rx=0 tx=0).stop 2024-08-20T05:16:42.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.799+0000 7f54f482a740 1 -- 172.21.15.37:0/497087407 shutdown_connections 2024-08-20T05:16:42.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.799+0000 7f54f482a740 1 --2- 172.21.15.37:0/497087407 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55ce7e4fb470 0x55ce7e4fd860 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.799+0000 7f54f482a740 1 --2- 172.21.15.37:0/497087407 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4ebb80 0x55ce7e4e8df0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.799+0000 7f54d4c00640 0 client.28925 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:16:42.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.799+0000 7f54f482a740 1 --2- 172.21.15.37:0/497087407 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e4e8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.799+0000 7f54f482a740 1 --2- 172.21.15.37:0/497087407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 0x55ce7e4eb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.799+0000 7f54f482a740 1 -- 172.21.15.37:0/497087407 >> 172.21.15.37:0/497087407 conn(0x55ce7e4dd100 msgr2=0x55ce7e4d3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:42.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.801+0000 7f54f482a740 1 -- 172.21.15.37:0/497087407 shutdown_connections 2024-08-20T05:16:42.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.801+0000 7f54f482a740 1 -- 172.21.15.37:0/497087407 wait complete. 2024-08-20T05:16:42.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.802+0000 7f54f482a740 20 client.28925 trim_cache size 0 max 16384 2024-08-20T05:16:42.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.835+0000 7f54f482a740 1 Processor -- start 2024-08-20T05:16:42.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.835+0000 7f54f482a740 1 -- start start 2024-08-20T05:16:42.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.836+0000 7f54f482a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 0x55ce7e4d39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.836+0000 7f54f482a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e503150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.836+0000 7f54f482a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4ebb80 0x55ce7e503690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.836+0000 7f54f482a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec072960 con 0x55ce7e4df2d0 2024-08-20T05:16:42.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.836+0000 7f54f482a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec074500 con 0x55ce7e4dfbf0 2024-08-20T05:16:42.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.836+0000 7f54f482a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec073030 con 0x55ce7e4ebb80 2024-08-20T05:16:42.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.836+0000 7f54eb400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4ebb80 0x55ce7e503690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:42.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.836+0000 7f54eb400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4ebb80 0x55ce7e503690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43476/0 (socket says 172.21.15.37:43476) 2024-08-20T05:16:42.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.836+0000 7f54eb400640 1 -- 172.21.15.37:0/100934638 learned_addr learned my addr 172.21.15.37:0/100934638 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:42.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.837+0000 7f54ea000640 1 --2- 172.21.15.37:0/100934638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e503150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:42.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.837+0000 7f54eb400640 1 -- 172.21.15.37:0/100934638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4dfbf0 msgr2=0x55ce7e503150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:42.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.837+0000 7f54eb400640 1 --2- 172.21.15.37:0/100934638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e503150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.837+0000 7f54eb400640 1 -- 172.21.15.37:0/100934638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 msgr2=0x55ce7e4d39c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:16:42.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.838+0000 7f54eaa00640 1 --2- 172.21.15.37:0/100934638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 0x55ce7e4d39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:42.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.838+0000 7f54eb400640 1 --2- 172.21.15.37:0/100934638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 0x55ce7e4d39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.838+0000 7f54eb400640 1 -- 172.21.15.37:0/100934638 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce7e4dfa20 con 0x55ce7e4ebb80 2024-08-20T05:16:42.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.840+0000 7f54eb400640 1 --2- 172.21.15.37:0/100934638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4ebb80 0x55ce7e503690 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f54e4004af0 tx=0x7f54e404a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f63e74c5a3d2a04f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:42.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.840+0000 7f54d7400640 1 -- 172.21.15.37:0/100934638 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e404f040 con 0x55ce7e4ebb80 2024-08-20T05:16:42.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.840+0000 7f54d7400640 1 -- 172.21.15.37:0/100934638 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54d80054d0 con 0x55ce7e4ebb80 2024-08-20T05:16:42.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.840+0000 7f54d7400640 1 -- 172.21.15.37:0/100934638 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e404bc70 con 0x55ce7e4ebb80 2024-08-20T05:16:42.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.842+0000 7f54f482a740 1 -- 172.21.15.37:0/100934638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4ebb80 msgr2=0x55ce7e503690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:42.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.842+0000 7f54f482a740 1 --2- 172.21.15.37:0/100934638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4ebb80 0x55ce7e503690 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f54e4004af0 tx=0x7f54e404a000 comp rx=0 tx=0).stop 2024-08-20T05:16:42.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.842+0000 7f54f482a740 1 -- 172.21.15.37:0/100934638 shutdown_connections 2024-08-20T05:16:42.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.843+0000 7f54f482a740 1 --2- 172.21.15.37:0/100934638 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4ebb80 0x55ce7e503690 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.843+0000 7f54f482a740 1 --2- 172.21.15.37:0/100934638 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e503150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.843+0000 7f54f482a740 1 --2- 172.21.15.37:0/100934638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 0x55ce7e4d39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.843+0000 7f54f482a740 1 -- 172.21.15.37:0/100934638 >> 172.21.15.37:0/100934638 conn(0x55ce7e4dd100 msgr2=0x55ce7e4d32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:42.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.845+0000 7f54f482a740 1 -- 172.21.15.37:0/100934638 shutdown_connections 2024-08-20T05:16:42.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.845+0000 7f54f482a740 1 -- 172.21.15.37:0/100934638 wait complete. 2024-08-20T05:16:42.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.845+0000 7f54f482a740 1 -- start start 2024-08-20T05:16:42.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.846+0000 7f54f482a740 1 Processor -- start 2024-08-20T05:16:42.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.848+0000 7f54f482a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 0x55ce7e4f1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.848+0000 7f54f482a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e4f2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.849+0000 7f54f482a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4ebb80 0x55ce7e4f2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.849+0000 7f54f482a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec073e30 con 0x55ce7e4df2d0 2024-08-20T05:16:42.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.849+0000 7f54f482a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec073700 con 0x55ce7e4dfbf0 2024-08-20T05:16:42.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.849+0000 7f54f482a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f54ec070960 con 0x55ce7e4ebb80 2024-08-20T05:16:42.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.850+0000 7f54f482a740 10 client.0 _ll_register_callbacks cb 0x7f54e4042070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:42.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.851+0000 7f54ea000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e4f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:42.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.852+0000 7f54ea000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e4f2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50354/0 (socket says 172.21.15.37:50354) 2024-08-20T05:16:42.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.852+0000 7f54ea000640 1 -- 172.21.15.37:0/285609123 learned_addr learned my addr 172.21.15.37:0/285609123 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:42.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.852+0000 7f54ea000640 1 -- 172.21.15.37:0/285609123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4ebb80 msgr2=0x55ce7e4f2690 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:16:42.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.852+0000 7f54ea000640 1 --2- 172.21.15.37:0/285609123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4ebb80 0x55ce7e4f2690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.852+0000 7f54ea000640 1 -- 172.21.15.37:0/285609123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 msgr2=0x55ce7e4f1bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:16:42.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.853+0000 7f54eaa00640 1 --2- 172.21.15.37:0/285609123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 0x55ce7e4f1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:42.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.854+0000 7f54ea000640 1 --2- 172.21.15.37:0/285609123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 0x55ce7e4f1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.854+0000 7f54ea000640 1 -- 172.21.15.37:0/285609123 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce7e565420 con 0x55ce7e4dfbf0 2024-08-20T05:16:42.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.857+0000 7f54ea000640 1 --2- 172.21.15.37:0/285609123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e4f2110 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f54d8017000 tx=0x7f54d800dcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e29cf694d390ff02 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:42.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.858+0000 7f54d4c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:16:42.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.858+0000 7f54d4c00640 1 -- 172.21.15.37:0/285609123 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54d8016040 con 0x55ce7e4dfbf0 2024-08-20T05:16:42.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.860+0000 7f54d4c00640 1 -- 172.21.15.37:0/285609123 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f54d80049c0 con 0x55ce7e4dfbf0 2024-08-20T05:16:42.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.861+0000 7f54f482a740 1 -- 172.21.15.37:0/285609123 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54d80054d0 con 0x55ce7e4dfbf0 2024-08-20T05:16:42.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.863+0000 7f54d4c00640 1 -- 172.21.15.37:0/285609123 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f54d8004bc0 con 0x55ce7e4dfbf0 2024-08-20T05:16:42.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.863+0000 7f54f482a740 10 client.28931 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:42.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.863+0000 7f54f482a740 1 -- 172.21.15.37:0/285609123 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55ce7e566750 con 0x55ce7e4dfbf0 2024-08-20T05:16:42.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.863+0000 7f54d4c00640 1 -- 172.21.15.37:0/285609123 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54d80054d0 con 0x55ce7e4dfbf0 2024-08-20T05:16:42.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.866+0000 7f54d4c00640 1 -- 172.21.15.37:0/285609123 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f54d802b030 con 0x55ce7e4dfbf0 2024-08-20T05:16:42.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.866+0000 7f54f482a740 10 client.28931 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:42.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.866+0000 7f54f482a740 10 client.28931 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:16:42.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.866+0000 7f54f482a740 20 client.28931 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:42.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.866+0000 7f54f482a740 1 --2- 172.21.15.37:0/285609123 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55ce7e566c10 0x55ce7e569000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:42.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.866+0000 7f54f482a740 4 client.28931 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:16:42.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.866+0000 7f54f482a740 1 -- 172.21.15.37:0/285609123 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ce7e44a490 con 0x55ce7e566c10 2024-08-20T05:16:42.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.866+0000 7f54eaa00640 1 --2- 172.21.15.37:0/285609123 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55ce7e566c10 0x55ce7e569000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:42.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.867+0000 7f54eaa00640 1 --2- 172.21.15.37:0/285609123 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55ce7e566c10 0x55ce7e569000 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b00f1cb3a010e82b server_cookie=6b5168e8ae390308 in_seq=0 out_seq=0 2024-08-20T05:16:42.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.867+0000 7f54d4c00640 10 client.28931 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:16:42.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.867+0000 7f54d4c00640 1 -- 172.21.15.37:0/285609123 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ce7e44a490 con 0x55ce7e566c10 2024-08-20T05:16:42.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.867+0000 7f54d4c00640 10 client.28931 handle_command_reply: tid=0 2024-08-20T05:16:42.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.867+0000 7f54f482a740 1 client.28931 shutdown 2024-08-20T05:16:42.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.868+0000 7f54f482a740 1 -- 172.21.15.37:0/285609123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4dfbf0 msgr2=0x55ce7e4f2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:42.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.868+0000 7f54f482a740 1 --2- 172.21.15.37:0/285609123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e4f2110 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f54d8017000 tx=0x7f54d800dcd0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.868+0000 7f54f482a740 1 -- 172.21.15.37:0/285609123 shutdown_connections 2024-08-20T05:16:42.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.868+0000 7f54f482a740 1 --2- 172.21.15.37:0/285609123 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55ce7e566c10 0x55ce7e569000 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.868+0000 7f54f482a740 1 --2- 172.21.15.37:0/285609123 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55ce7e4ebb80 0x55ce7e4f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.868+0000 7f54f482a740 1 --2- 172.21.15.37:0/285609123 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55ce7e4dfbf0 0x55ce7e4f2110 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.868+0000 7f54d4c00640 0 client.28931 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:16:42.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.868+0000 7f54f482a740 1 --2- 172.21.15.37:0/285609123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ce7e4df2d0 0x55ce7e4f1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.868+0000 7f54f482a740 1 -- 172.21.15.37:0/285609123 >> 172.21.15.37:0/285609123 conn(0x55ce7e4dd100 msgr2=0x55ce7e4d3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:42.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.868+0000 7f54f482a740 1 -- 172.21.15.37:0/285609123 shutdown_connections 2024-08-20T05:16:42.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.868+0000 7f54f482a740 1 -- 172.21.15.37:0/285609123 wait complete. 2024-08-20T05:16:42.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.868+0000 7f54f482a740 20 client.28931 trim_cache size 0 max 16384 2024-08-20T05:16:42.871 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:16:42.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.869+0000 7f54ebe00640 1 -- 172.21.15.37:0/4086177303 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54d00b3e40 msgr2=0x7f54d00b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:42.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.869+0000 7f54ebe00640 1 --2- 172.21.15.37:0/4086177303 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54d00b3e40 0x7f54d00b6300 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f54e40099a0 tx=0x7f54e400b040 comp rx=0 tx=0).stop 2024-08-20T05:16:42.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.869+0000 7f54ebe00640 1 -- 172.21.15.37:0/4086177303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54ec104130 msgr2=0x7f54ec19aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:42.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.869+0000 7f54ebe00640 1 --2- 172.21.15.37:0/4086177303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54ec104130 0x7f54ec19aeb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f54dc00d6d0 tx=0x7f54dc00db90 comp rx=0 tx=0).stop 2024-08-20T05:16:42.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.870+0000 7f54ebe00640 1 -- 172.21.15.37:0/4086177303 shutdown_connections 2024-08-20T05:16:42.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.870+0000 7f54ebe00640 1 --2- 172.21.15.37:0/4086177303 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f54d00b3e40 0x7f54d00b6300 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.870+0000 7f54ebe00640 1 --2- 172.21.15.37:0/4086177303 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f54ec1a0790 0x7f54ec1a0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.870+0000 7f54ebe00640 1 --2- 172.21.15.37:0/4086177303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54ec10cc70 0x7f54ec19b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.870+0000 7f54ebe00640 1 --2- 172.21.15.37:0/4086177303 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f54ec104130 0x7f54ec19aeb0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:42.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.870+0000 7f54ebe00640 1 -- 172.21.15.37:0/4086177303 >> 172.21.15.37:0/4086177303 conn(0x7f54ec0fd2d0 msgr2=0x7f54ec0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:42.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.870+0000 7f54ebe00640 1 -- 172.21.15.37:0/4086177303 shutdown_connections 2024-08-20T05:16:42.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:42.870+0000 7f54ebe00640 1 -- 172.21.15.37:0/4086177303 wait complete. 2024-08-20T05:16:43.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 825.0 s, 452.7 tps, lat 213.291 ms stddev 233.869 2024-08-20T05:16:43.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:43 smithi130 ceph-mon[22007]: pgmap v835: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 4.5 MiB/s wr, 472 op/s 2024-08-20T05:16:44.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:43 smithi037 ceph-mon[17265]: pgmap v835: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 4.5 MiB/s wr, 472 op/s 2024-08-20T05:16:44.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:43 smithi135 ceph-mon[22342]: pgmap v835: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 4.5 MiB/s wr, 472 op/s 2024-08-20T05:16:44.152 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T05:16:45.007 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:16:45.734 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:45 smithi037 ceph-mon[17265]: pgmap v836: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 4.3 MiB/s wr, 478 op/s 2024-08-20T05:16:45.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:45 smithi130 ceph-mon[22007]: pgmap v836: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 4.3 MiB/s wr, 478 op/s 2024-08-20T05:16:46.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:45 smithi135 ceph-mon[22342]: pgmap v836: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 4.3 MiB/s wr, 478 op/s 2024-08-20T05:16:46.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.286+0000 7f9227200640 1 -- 172.21.15.37:0/3234745459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9220104b00 msgr2=0x7f9220104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:46.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.286+0000 7f9227200640 1 --2- 172.21.15.37:0/3234745459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9220104b00 0x7f9220104ee0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9214009900 tx=0x7f921402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.286+0000 7f9227200640 1 -- 172.21.15.37:0/3234745459 shutdown_connections 2024-08-20T05:16:46.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.286+0000 7f9227200640 1 --2- 172.21.15.37:0/3234745459 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f922010ae90 0x7f9220111690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.286+0000 7f9227200640 1 --2- 172.21.15.37:0/3234745459 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f922010a510 0x7f922010a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.286+0000 7f9227200640 1 --2- 172.21.15.37:0/3234745459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9220104b00 0x7f9220104ee0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.286+0000 7f9227200640 1 -- 172.21.15.37:0/3234745459 >> 172.21.15.37:0/3234745459 conn(0x7f9220100550 msgr2=0x7f9220102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:46.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.286+0000 7f9227200640 1 -- 172.21.15.37:0/3234745459 shutdown_connections 2024-08-20T05:16:46.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.286+0000 7f9227200640 1 -- 172.21.15.37:0/3234745459 wait complete. 2024-08-20T05:16:46.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.287+0000 7f9227200640 1 Processor -- start 2024-08-20T05:16:46.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.287+0000 7f9227200640 1 -- start start 2024-08-20T05:16:46.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.288+0000 7f9227200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9220104b00 0x7f922019af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.288+0000 7f9227200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f922010a510 0x7f922019b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.288+0000 7f9227200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f922010ae90 0x7f92201a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.288+0000 7f9227200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9220114b60 con 0x7f922010ae90 2024-08-20T05:16:46.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.288+0000 7f9227200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f92201149e0 con 0x7f922010a510 2024-08-20T05:16:46.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.288+0000 7f9227200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9220114ce0 con 0x7f9220104b00 2024-08-20T05:16:46.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.288+0000 7f9226800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f922010ae90 0x7f92201a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:46.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.288+0000 7f9225e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9220104b00 0x7f922019af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:46.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.288+0000 7f9225e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9220104b00 0x7f922019af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43516/0 (socket says 172.21.15.37:43516) 2024-08-20T05:16:46.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.288+0000 7f9225e00640 1 -- 172.21.15.37:0/452179360 learned_addr learned my addr 172.21.15.37:0/452179360 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:46.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.288+0000 7f9226800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f922010ae90 0x7f92201a0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51010/0 (socket says 172.21.15.37:51010) 2024-08-20T05:16:46.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.288+0000 7f9225400640 1 --2- 172.21.15.37:0/452179360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f922010a510 0x7f922019b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:46.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.289+0000 7f9225400640 1 -- 172.21.15.37:0/452179360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9220104b00 msgr2=0x7f922019af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:46.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.289+0000 7f9225400640 1 --2- 172.21.15.37:0/452179360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9220104b00 0x7f922019af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.289+0000 7f9225400640 1 -- 172.21.15.37:0/452179360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f922010ae90 msgr2=0x7f92201a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:46.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.289+0000 7f9225400640 1 --2- 172.21.15.37:0/452179360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f922010ae90 0x7f92201a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.289+0000 7f9225400640 1 -- 172.21.15.37:0/452179360 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92201a0fe0 con 0x7f922010a510 2024-08-20T05:16:46.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.289+0000 7f9226800640 1 --2- 172.21.15.37:0/452179360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f922010ae90 0x7f92201a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:46.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.289+0000 7f9225e00640 1 --2- 172.21.15.37:0/452179360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9220104b00 0x7f922019af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:46.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.289+0000 7f9225400640 1 --2- 172.21.15.37:0/452179360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f922010a510 0x7f922019b470 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f921000e9f0 tx=0x7f921000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:46.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.289+0000 7f921aa00640 1 -- 172.21.15.37:0/452179360 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921000ccc0 con 0x7f922010a510 2024-08-20T05:16:46.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.289+0000 7f9227200640 1 -- 172.21.15.37:0/452179360 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92201a12d0 con 0x7f922010a510 2024-08-20T05:16:46.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.289+0000 7f921aa00640 1 -- 172.21.15.37:0/452179360 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92100108e0 con 0x7f922010a510 2024-08-20T05:16:46.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.289+0000 7f921aa00640 1 -- 172.21.15.37:0/452179360 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9210018880 con 0x7f922010a510 2024-08-20T05:16:46.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.289+0000 7f9227200640 1 -- 172.21.15.37:0/452179360 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92201a7b60 con 0x7f922010a510 2024-08-20T05:16:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.293+0000 7f922b236740 1 Processor -- start 2024-08-20T05:16:46.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.293+0000 7f922b236740 1 -- start start 2024-08-20T05:16:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.293+0000 7f922b236740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c304ac0 0x55568c304ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.293+0000 7f922b236740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 0x55568c310e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.293+0000 7f922b236740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c311370 0x55568c313760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.293+0000 7f922b236740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55568c27aaa0 con 0x55568c311370 2024-08-20T05:16:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.293+0000 7f922b236740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55568c269fa0 con 0x55568c304ac0 2024-08-20T05:16:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.293+0000 7f922b236740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55568c26dfe0 con 0x55568c3053e0 2024-08-20T05:16:46.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.293+0000 7f9226800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c304ac0 0x55568c304ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.293+0000 7f9225e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 0x55568c310e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.293+0000 7f9226800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c304ac0 0x55568c304ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50380/0 (socket says 172.21.15.37:50380) 2024-08-20T05:16:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.293+0000 7f9226800640 1 -- 172.21.15.37:0/3709967730 learned_addr learned my addr 172.21.15.37:0/3709967730 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.293+0000 7f9225e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 0x55568c310e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43520/0 (socket says 172.21.15.37:43520) 2024-08-20T05:16:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.294+0000 7f921aa00640 1 -- 172.21.15.37:0/452179360 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9210010430 con 0x7f922010a510 2024-08-20T05:16:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.294+0000 7f9225e00640 1 -- 172.21.15.37:0/3709967730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c304ac0 msgr2=0x55568c304ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.294+0000 7f9225e00640 1 --2- 172.21.15.37:0/3709967730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c304ac0 0x55568c304ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.294+0000 7f9225e00640 1 -- 172.21.15.37:0/3709967730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c311370 msgr2=0x55568c313760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.294+0000 7f9225e00640 1 --2- 172.21.15.37:0/3709967730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c311370 0x55568c313760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.294+0000 7f9225e00640 1 -- 172.21.15.37:0/3709967730 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55568c210420 con 0x55568c3053e0 2024-08-20T05:16:46.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.294+0000 7f9225e00640 1 --2- 172.21.15.37:0/3709967730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 0x55568c310e30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9214000c00 tx=0x7f92140044b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2af74983f61a7b87 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.295+0000 7f920f000640 1 -- 172.21.15.37:0/3709967730 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9214040070 con 0x55568c3053e0 2024-08-20T05:16:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.295+0000 7f920f000640 1 -- 172.21.15.37:0/3709967730 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92140047a0 con 0x55568c3053e0 2024-08-20T05:16:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.295+0000 7f920f000640 1 -- 172.21.15.37:0/3709967730 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9214035040 con 0x55568c3053e0 2024-08-20T05:16:46.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.295+0000 7f921aa00640 1 --2- 172.21.15.37:0/452179360 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f92080b3cf0 0x7f92080b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.295+0000 7f921aa00640 1 -- 172.21.15.37:0/452179360 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f92100e42d0 con 0x7f922010a510 2024-08-20T05:16:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.296+0000 7f922b236740 1 -- 172.21.15.37:0/3709967730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 msgr2=0x55568c310e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.296+0000 7f922b236740 1 --2- 172.21.15.37:0/3709967730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 0x55568c310e30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9214000c00 tx=0x7f92140044b0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.296+0000 7f9226800640 1 --2- 172.21.15.37:0/452179360 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f92080b3cf0 0x7f92080b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.296+0000 7f922b236740 1 -- 172.21.15.37:0/3709967730 shutdown_connections 2024-08-20T05:16:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.296+0000 7f922b236740 1 --2- 172.21.15.37:0/3709967730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c311370 0x55568c313760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.296+0000 7f922b236740 1 --2- 172.21.15.37:0/3709967730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 0x55568c310e30 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.296+0000 7f922b236740 1 --2- 172.21.15.37:0/3709967730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c304ac0 0x55568c304ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.296+0000 7f922b236740 1 -- 172.21.15.37:0/3709967730 >> 172.21.15.37:0/3709967730 conn(0x55568c3028f0 msgr2=0x55568c303a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.296+0000 7f922b236740 1 -- 172.21.15.37:0/3709967730 shutdown_connections 2024-08-20T05:16:46.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.296+0000 7f922b236740 1 -- 172.21.15.37:0/3709967730 wait complete. 2024-08-20T05:16:46.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.296+0000 7f9226800640 1 --2- 172.21.15.37:0/452179360 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f92080b3cf0 0x7f92080b61b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f921c012980 tx=0x7f921c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:46.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.297+0000 7f922b236740 1 -- start start 2024-08-20T05:16:46.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.297+0000 7f922b236740 1 Processor -- start 2024-08-20T05:16:46.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.297+0000 7f922b236740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c304ac0 0x55568c310ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.297+0000 7f922b236740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 0x55568c30dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.297+0000 7f922b236740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c311370 0x55568c30e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.297+0000 7f922b236740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55568c0cc700 con 0x55568c304ac0 2024-08-20T05:16:46.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.297+0000 7f922b236740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55568c205290 con 0x55568c311370 2024-08-20T05:16:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.297+0000 7f922b236740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55568c313f90 con 0x55568c3053e0 2024-08-20T05:16:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.297+0000 7f922b236740 10 client.0 _ll_register_callbacks cb 0x55568c2641c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.298+0000 7f9225e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c304ac0 0x55568c310ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.298+0000 7f9225e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c304ac0 0x55568c310ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51026/0 (socket says 172.21.15.37:51026) 2024-08-20T05:16:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.298+0000 7f9225e00640 1 -- 172.21.15.37:0/4112395672 learned_addr learned my addr 172.21.15.37:0/4112395672 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.298+0000 7f9226800640 1 --2- 172.21.15.37:0/4112395672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c311370 0x55568c30e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.298+0000 7f9225400640 1 --2- 172.21.15.37:0/4112395672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 0x55568c30dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.298+0000 7f9225e00640 1 -- 172.21.15.37:0/4112395672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 msgr2=0x55568c30dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.298+0000 7f9225e00640 1 --2- 172.21.15.37:0/4112395672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 0x55568c30dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.298+0000 7f9225e00640 1 -- 172.21.15.37:0/4112395672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c311370 msgr2=0x55568c30e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.298+0000 7f9225e00640 1 --2- 172.21.15.37:0/4112395672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c311370 0x55568c30e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.298+0000 7f9225e00640 1 -- 172.21.15.37:0/4112395672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55568bfc9650 con 0x55568c304ac0 2024-08-20T05:16:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.298+0000 7f9225400640 1 --2- 172.21.15.37:0/4112395672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 0x55568c30dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:16:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.298+0000 7f9225e00640 1 --2- 172.21.15.37:0/4112395672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c304ac0 0x55568c310ba0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f92140096c0 tx=0x7f9214003b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74531701a4cc2a7f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.298+0000 7f9203400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:16:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.299+0000 7f9203400640 1 -- 172.21.15.37:0/4112395672 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921404d060 con 0x55568c304ac0 2024-08-20T05:16:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.299+0000 7f9203400640 1 -- 172.21.15.37:0/4112395672 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f92140316a0 con 0x55568c304ac0 2024-08-20T05:16:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.299+0000 7f922b236740 1 -- 172.21.15.37:0/4112395672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f92140047a0 con 0x55568c304ac0 2024-08-20T05:16:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.299+0000 7f9203400640 1 -- 172.21.15.37:0/4112395672 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f9214054050 con 0x55568c304ac0 2024-08-20T05:16:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.299+0000 7f922b236740 10 client.18243 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.299+0000 7f922b236740 1 -- 172.21.15.37:0/4112395672 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55568c31f830 con 0x55568c304ac0 2024-08-20T05:16:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.299+0000 7f9203400640 1 -- 172.21.15.37:0/4112395672 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f92140047a0 con 0x55568c304ac0 2024-08-20T05:16:46.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.300+0000 7f9203400640 1 -- 172.21.15.37:0/4112395672 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f921403c9e0 con 0x55568c304ac0 2024-08-20T05:16:46.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.300+0000 7f922b236740 10 client.18243 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:46.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.300+0000 7f922b236740 10 client.18243 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:16:46.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.300+0000 7f922b236740 20 client.18243 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:46.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.300+0000 7f922b236740 1 --2- 172.21.15.37:0/4112395672 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55568c320b80 0x55568c322f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.300+0000 7f922b236740 4 client.18243 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:16:46.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.300+0000 7f922b236740 1 -- 172.21.15.37:0/4112395672 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55568c27c9f0 con 0x55568c320b80 2024-08-20T05:16:46.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.300+0000 7f9225400640 1 --2- 172.21.15.37:0/4112395672 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55568c320b80 0x55568c322f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:46.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.301+0000 7f9225400640 1 --2- 172.21.15.37:0/4112395672 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55568c320b80 0x55568c322f70 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b93b3b705a8c8b36 server_cookie=62eed15bce2c04ac in_seq=0 out_seq=0 2024-08-20T05:16:46.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.301+0000 7f9203400640 10 client.18243 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:46.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.301+0000 7f9203400640 1 -- 172.21.15.37:0/4112395672 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55568c27c9f0 con 0x55568c320b80 2024-08-20T05:16:46.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.301+0000 7f9203400640 10 client.18243 handle_command_reply: tid=0 2024-08-20T05:16:46.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.301+0000 7f922b236740 1 client.18243 shutdown 2024-08-20T05:16:46.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.302+0000 7f922b236740 1 -- 172.21.15.37:0/4112395672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c304ac0 msgr2=0x55568c310ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:46.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.302+0000 7f922b236740 1 --2- 172.21.15.37:0/4112395672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c304ac0 0x55568c310ba0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f92140096c0 tx=0x7f9214003b30 comp rx=0 tx=0).stop 2024-08-20T05:16:46.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.302+0000 7f922b236740 1 -- 172.21.15.37:0/4112395672 shutdown_connections 2024-08-20T05:16:46.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.302+0000 7f922b236740 1 --2- 172.21.15.37:0/4112395672 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55568c320b80 0x55568c322f70 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.302+0000 7f922b236740 1 --2- 172.21.15.37:0/4112395672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c311370 0x55568c30e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.302+0000 7f922b236740 1 --2- 172.21.15.37:0/4112395672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 0x55568c30dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.302+0000 7f922b236740 1 --2- 172.21.15.37:0/4112395672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c304ac0 0x55568c310ba0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.302+0000 7f9203400640 0 client.18243 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:46.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.302+0000 7f922b236740 1 -- 172.21.15.37:0/4112395672 >> 172.21.15.37:0/4112395672 conn(0x55568c3028f0 msgr2=0x55568c308460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:46.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.302+0000 7f922b236740 1 -- 172.21.15.37:0/4112395672 shutdown_connections 2024-08-20T05:16:46.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.302+0000 7f922b236740 1 -- 172.21.15.37:0/4112395672 wait complete. 2024-08-20T05:16:46.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.302+0000 7f922b236740 20 client.18243 trim_cache size 0 max 16384 2024-08-20T05:16:46.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.316+0000 7f922b236740 1 Processor -- start 2024-08-20T05:16:46.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.316+0000 7f922b236740 1 -- start start 2024-08-20T05:16:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.317+0000 7f922b236740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c304ac0 0x55568c31d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.317+0000 7f922b236740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 0x55568c3094f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.317+0000 7f922b236740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c311370 0x55568c328510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.317+0000 7f922b236740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f92201b17f0 con 0x55568c304ac0 2024-08-20T05:16:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.317+0000 7f922b236740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f92201b3390 con 0x55568c311370 2024-08-20T05:16:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.317+0000 7f922b236740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f92201b1ec0 con 0x55568c3053e0 2024-08-20T05:16:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.317+0000 7f9225400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 0x55568c3094f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.317+0000 7f9225400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 0x55568c3094f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43538/0 (socket says 172.21.15.37:43538) 2024-08-20T05:16:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.317+0000 7f9225400640 1 -- 172.21.15.37:0/3677778128 learned_addr learned my addr 172.21.15.37:0/3677778128 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:46.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.317+0000 7f9225e00640 1 --2- 172.21.15.37:0/3677778128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c304ac0 0x55568c31d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:46.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.317+0000 7f9226800640 1 --2- 172.21.15.37:0/3677778128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c311370 0x55568c328510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:46.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.317+0000 7f9225400640 1 -- 172.21.15.37:0/3677778128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c311370 msgr2=0x55568c328510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:46.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.317+0000 7f9225400640 1 --2- 172.21.15.37:0/3677778128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c311370 0x55568c328510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.317+0000 7f9225400640 1 -- 172.21.15.37:0/3677778128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c304ac0 msgr2=0x55568c31d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:46.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.317+0000 7f9225400640 1 --2- 172.21.15.37:0/3677778128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c304ac0 0x55568c31d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.317+0000 7f9225400640 1 -- 172.21.15.37:0/3677778128 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55568c303370 con 0x55568c3053e0 2024-08-20T05:16:46.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.318+0000 7f9225400640 1 --2- 172.21.15.37:0/3677778128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 0x55568c3094f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f92100a6f50 tx=0x7f921000cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b23188615b1e14a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:46.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.318+0000 7f920e600640 1 -- 172.21.15.37:0/3677778128 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92100b3ed0 con 0x55568c3053e0 2024-08-20T05:16:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.318+0000 7f920e600640 1 -- 172.21.15.37:0/3677778128 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9210010d90 con 0x55568c3053e0 2024-08-20T05:16:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.318+0000 7f920e600640 1 -- 172.21.15.37:0/3677778128 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92100a6840 con 0x55568c3053e0 2024-08-20T05:16:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.318+0000 7f922b236740 1 -- 172.21.15.37:0/3677778128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 msgr2=0x55568c3094f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.318+0000 7f922b236740 1 --2- 172.21.15.37:0/3677778128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 0x55568c3094f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f92100a6f50 tx=0x7f921000cef0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.319+0000 7f922b236740 1 -- 172.21.15.37:0/3677778128 shutdown_connections 2024-08-20T05:16:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.319+0000 7f922b236740 1 --2- 172.21.15.37:0/3677778128 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c311370 0x55568c328510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.319+0000 7f922b236740 1 --2- 172.21.15.37:0/3677778128 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c3053e0 0x55568c3094f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.319+0000 7f922b236740 1 --2- 172.21.15.37:0/3677778128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c304ac0 0x55568c31d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.319+0000 7f922b236740 1 -- 172.21.15.37:0/3677778128 >> 172.21.15.37:0/3677778128 conn(0x55568c3028f0 msgr2=0x55568c308de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.319+0000 7f922b236740 1 -- 172.21.15.37:0/3677778128 shutdown_connections 2024-08-20T05:16:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.319+0000 7f922b236740 1 -- 172.21.15.37:0/3677778128 wait complete. 2024-08-20T05:16:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.319+0000 7f922b236740 1 -- start start 2024-08-20T05:16:46.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.319+0000 7f922b236740 1 Processor -- start 2024-08-20T05:16:46.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.320+0000 7f922b236740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c304ac0 0x55568c3196a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.320+0000 7f922b236740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c3053e0 0x55568c314b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.320+0000 7f922b236740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c311370 0x55568c3150b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.320+0000 7f922b236740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f92201b2cc0 con 0x55568c3053e0 2024-08-20T05:16:46.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.320+0000 7f922b236740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f92201b2590 con 0x55568c311370 2024-08-20T05:16:46.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.320+0000 7f922b236740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f92201af7d0 con 0x55568c304ac0 2024-08-20T05:16:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.320+0000 7f922b236740 10 client.0 _ll_register_callbacks cb 0x7f9214009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.320+0000 7f9225e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c304ac0 0x55568c3196a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.320+0000 7f9225400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c3053e0 0x55568c314b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.320+0000 7f9225e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c304ac0 0x55568c3196a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43540/0 (socket says 172.21.15.37:43540) 2024-08-20T05:16:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.320+0000 7f9225e00640 1 -- 172.21.15.37:0/696737287 learned_addr learned my addr 172.21.15.37:0/696737287 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.320+0000 7f9226800640 1 --2- 172.21.15.37:0/696737287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c311370 0x55568c3150b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.321+0000 7f9225e00640 1 -- 172.21.15.37:0/696737287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c311370 msgr2=0x55568c3150b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.321+0000 7f9225e00640 1 --2- 172.21.15.37:0/696737287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c311370 0x55568c3150b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.321+0000 7f9225e00640 1 -- 172.21.15.37:0/696737287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c3053e0 msgr2=0x55568c314b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.321+0000 7f9225e00640 1 --2- 172.21.15.37:0/696737287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c3053e0 0x55568c314b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.321+0000 7f9225e00640 1 -- 172.21.15.37:0/696737287 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55568c3156a0 con 0x55568c304ac0 2024-08-20T05:16:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.321+0000 7f9225400640 1 --2- 172.21.15.37:0/696737287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c3053e0 0x55568c314b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:46.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.321+0000 7f9225e00640 1 --2- 172.21.15.37:0/696737287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c304ac0 0x55568c3196a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9214006010 tx=0x7f921403c670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72c99630d6223b27 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.321+0000 7f9203400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:16:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.321+0000 7f9203400640 1 -- 172.21.15.37:0/696737287 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f921405c020 con 0x55568c304ac0 2024-08-20T05:16:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.321+0000 7f9203400640 1 -- 172.21.15.37:0/696737287 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9214005020 con 0x55568c304ac0 2024-08-20T05:16:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.321+0000 7f922b236740 1 -- 172.21.15.37:0/696737287 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9210010d90 con 0x55568c304ac0 2024-08-20T05:16:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.321+0000 7f9203400640 1 -- 172.21.15.37:0/696737287 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f921404d070 con 0x55568c304ac0 2024-08-20T05:16:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.322+0000 7f922b236740 10 client.28987 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.322+0000 7f922b236740 1 -- 172.21.15.37:0/696737287 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55568c38b300 con 0x55568c304ac0 2024-08-20T05:16:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.322+0000 7f9203400640 1 -- 172.21.15.37:0/696737287 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9210010d90 con 0x55568c304ac0 2024-08-20T05:16:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.322+0000 7f9203400640 1 -- 172.21.15.37:0/696737287 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f9214004830 con 0x55568c304ac0 2024-08-20T05:16:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.323+0000 7f922b236740 10 client.28987 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.323+0000 7f922b236740 10 client.28987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:16:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.323+0000 7f922b236740 20 client.28987 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.323+0000 7f922b236740 1 --2- 172.21.15.37:0/696737287 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55568c38ba30 0x55568c38de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.323+0000 7f922b236740 4 client.28987 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:16:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.323+0000 7f922b236740 1 -- 172.21.15.37:0/696737287 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55568c278490 con 0x55568c38ba30 2024-08-20T05:16:46.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.323+0000 7f9225400640 1 --2- 172.21.15.37:0/696737287 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55568c38ba30 0x55568c38de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.324+0000 7f9225400640 1 --2- 172.21.15.37:0/696737287 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55568c38ba30 0x55568c38de50 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=583e5f04eca8678f server_cookie=c60db4b6c372fbe5 in_seq=0 out_seq=0 2024-08-20T05:16:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.324+0000 7f9203400640 10 client.28987 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.324+0000 7f9203400640 1 -- 172.21.15.37:0/696737287 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55568c278490 con 0x55568c38ba30 2024-08-20T05:16:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.324+0000 7f9203400640 10 client.28987 handle_command_reply: tid=0 2024-08-20T05:16:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.324+0000 7f922b236740 1 client.28987 shutdown 2024-08-20T05:16:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.324+0000 7f922b236740 1 -- 172.21.15.37:0/696737287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c304ac0 msgr2=0x55568c3196a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.324+0000 7f922b236740 1 --2- 172.21.15.37:0/696737287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c304ac0 0x55568c3196a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9214006010 tx=0x7f921403c670 comp rx=0 tx=0).stop 2024-08-20T05:16:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.324+0000 7f922b236740 1 -- 172.21.15.37:0/696737287 shutdown_connections 2024-08-20T05:16:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.324+0000 7f922b236740 1 --2- 172.21.15.37:0/696737287 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55568c38ba30 0x55568c38de50 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.324+0000 7f922b236740 1 --2- 172.21.15.37:0/696737287 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55568c311370 0x55568c3150b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.324+0000 7f922b236740 1 --2- 172.21.15.37:0/696737287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55568c3053e0 0x55568c314b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.324+0000 7f922b236740 1 --2- 172.21.15.37:0/696737287 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55568c304ac0 0x55568c3196a0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.324+0000 7f922b236740 1 -- 172.21.15.37:0/696737287 >> 172.21.15.37:0/696737287 conn(0x55568c3028f0 msgr2=0x55568c30fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.324+0000 7f9203400640 0 client.28987 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.326+0000 7f922b236740 1 -- 172.21.15.37:0/696737287 shutdown_connections 2024-08-20T05:16:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.326+0000 7f922b236740 1 -- 172.21.15.37:0/696737287 wait complete. 2024-08-20T05:16:46.333 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:16:46.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.330+0000 7f922b236740 20 client.28987 trim_cache size 0 max 16384 2024-08-20T05:16:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.334+0000 7f9227200640 1 -- 172.21.15.37:0/452179360 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f92080b3cf0 msgr2=0x7f92080b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.334+0000 7f9227200640 1 --2- 172.21.15.37:0/452179360 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f92080b3cf0 0x7f92080b61b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f921c012980 tx=0x7f921c009500 comp rx=0 tx=0).stop 2024-08-20T05:16:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.334+0000 7f9227200640 1 -- 172.21.15.37:0/452179360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f922010a510 msgr2=0x7f922019b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.334+0000 7f9227200640 1 --2- 172.21.15.37:0/452179360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f922010a510 0x7f922019b470 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f921000e9f0 tx=0x7f921000eeb0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.334+0000 7f9227200640 1 -- 172.21.15.37:0/452179360 shutdown_connections 2024-08-20T05:16:46.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.334+0000 7f9227200640 1 --2- 172.21.15.37:0/452179360 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f92080b3cf0 0x7f92080b61b0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.335+0000 7f9227200640 1 --2- 172.21.15.37:0/452179360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f922010ae90 0x7f92201a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.335+0000 7f9227200640 1 --2- 172.21.15.37:0/452179360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f922010a510 0x7f922019b470 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.335+0000 7f9227200640 1 --2- 172.21.15.37:0/452179360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9220104b00 0x7f922019af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:46.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.335+0000 7f9227200640 1 -- 172.21.15.37:0/452179360 >> 172.21.15.37:0/452179360 conn(0x7f9220100550 msgr2=0x7f9220106ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:46.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.335+0000 7f9227200640 1 -- 172.21.15.37:0/452179360 shutdown_connections 2024-08-20T05:16:46.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:46.335+0000 7f9227200640 1 -- 172.21.15.37:0/452179360 wait complete. 2024-08-20T05:16:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:47 smithi130 ceph-mon[22007]: pgmap v837: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 3.8 MiB/s wr, 418 op/s 2024-08-20T05:16:48.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:47 smithi037 ceph-mon[17265]: pgmap v837: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 3.8 MiB/s wr, 418 op/s 2024-08-20T05:16:48.040 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 830.0 s, 514.0 tps, lat 208.628 ms stddev 252.876 2024-08-20T05:16:48.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:47 smithi135 ceph-mon[22342]: pgmap v837: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 3.8 MiB/s wr, 418 op/s 2024-08-20T05:16:49.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:48 smithi037 ceph-mon[17265]: pgmap v838: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 4.6 MiB/s wr, 490 op/s 2024-08-20T05:16:49.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:48 smithi135 ceph-mon[22342]: pgmap v838: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 4.6 MiB/s wr, 490 op/s 2024-08-20T05:16:49.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:48 smithi130 ceph-mon[22007]: pgmap v838: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 4.6 MiB/s wr, 490 op/s 2024-08-20T05:16:49.669 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T05:16:49.669 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T05:16:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.948+0000 7f9c0f200640 1 -- 172.21.15.37:0/210972298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c081055f0 msgr2=0x7f9c08107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.948+0000 7f9c0f200640 1 --2- 172.21.15.37:0/210972298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c081055f0 0x7f9c08107a60 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8009900 tx=0x7f9bf802a410 comp rx=0 tx=0).stop 2024-08-20T05:16:49.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.949+0000 7f9c0f200640 1 -- 172.21.15.37:0/210972298 shutdown_connections 2024-08-20T05:16:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.949+0000 7f9c0f200640 1 --2- 172.21.15.37:0/210972298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c081081a0 0x7f9c0810a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.949+0000 7f9c0f200640 1 --2- 172.21.15.37:0/210972298 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c081055f0 0x7f9c08107a60 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.949+0000 7f9c0f200640 1 --2- 172.21.15.37:0/210972298 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c0806b170 0x7f9c08105060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.949+0000 7f9c0f200640 1 -- 172.21.15.37:0/210972298 >> 172.21.15.37:0/210972298 conn(0x7f9c080fcc50 msgr2=0x7f9c080ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:49.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.949+0000 7f9c0f200640 1 -- 172.21.15.37:0/210972298 shutdown_connections 2024-08-20T05:16:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.949+0000 7f9c0f200640 1 -- 172.21.15.37:0/210972298 wait complete. 2024-08-20T05:16:49.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.951+0000 7f9c0f200640 1 Processor -- start 2024-08-20T05:16:49.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.951+0000 7f9c0f200640 1 -- start start 2024-08-20T05:16:49.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.951+0000 7f9c0f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c0806b170 0x7f9c0819ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:49.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.951+0000 7f9c0f200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c081055f0 0x7f9c0819b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:49.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.952+0000 7f9c0f200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c081081a0 0x7f9c0819be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:49.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.952+0000 7f9c0f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0810e240 con 0x7f9c0806b170 2024-08-20T05:16:49.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.952+0000 7f9c0f200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0810e0c0 con 0x7f9c081055f0 2024-08-20T05:16:49.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.952+0000 7f9c0f200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0810e3c0 con 0x7f9c081081a0 2024-08-20T05:16:49.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.952+0000 7f9c0e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c081081a0 0x7f9c0819be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:49.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.952+0000 7f9c0d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c081055f0 0x7f9c0819b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:49.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.952+0000 7f9c0e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c081081a0 0x7f9c0819be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43552/0 (socket says 172.21.15.37:43552) 2024-08-20T05:16:49.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.952+0000 7f9c0e800640 1 -- 172.21.15.37:0/1529267621 learned_addr learned my addr 172.21.15.37:0/1529267621 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.952+0000 7f9c0d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c081055f0 0x7f9c0819b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50412/0 (socket says 172.21.15.37:50412) 2024-08-20T05:16:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.953+0000 7f9c0d400640 1 -- 172.21.15.37:0/1529267621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c081081a0 msgr2=0x7f9c0819be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.953+0000 7f9c0d400640 1 --2- 172.21.15.37:0/1529267621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c081081a0 0x7f9c0819be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.953+0000 7f9c0d400640 1 -- 172.21.15.37:0/1529267621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c0806b170 msgr2=0x7f9c0819ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.953+0000 7f9c0d400640 1 --2- 172.21.15.37:0/1529267621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c0806b170 0x7f9c0819ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.953+0000 7f9c0d400640 1 -- 172.21.15.37:0/1529267621 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0819c750 con 0x7f9c081055f0 2024-08-20T05:16:49.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.953+0000 7f9c0e800640 1 --2- 172.21.15.37:0/1529267621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c081081a0 0x7f9c0819be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:16:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.955+0000 7f9c0d400640 1 --2- 172.21.15.37:0/1529267621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c081055f0 0x7f9c0819b260 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9bf802aa00 tx=0x7f9bf8003d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:49.956 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.955+0000 7f9c02a00640 1 -- 172.21.15.37:0/1529267621 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf803f070 con 0x7f9c081055f0 2024-08-20T05:16:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.955+0000 7f9c02a00640 1 -- 172.21.15.37:0/1529267621 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bf803b460 con 0x7f9c081055f0 2024-08-20T05:16:49.957 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.955+0000 7f9c02a00640 1 -- 172.21.15.37:0/1529267621 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8035030 con 0x7f9c081055f0 2024-08-20T05:16:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.955+0000 7f9c0f200640 1 -- 172.21.15.37:0/1529267621 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0819c9e0 con 0x7f9c081055f0 2024-08-20T05:16:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.956+0000 7f9c0f200640 1 -- 172.21.15.37:0/1529267621 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c081a2fb0 con 0x7f9c081055f0 2024-08-20T05:16:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.962+0000 7f9c136bc740 1 Processor -- start 2024-08-20T05:16:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.962+0000 7f9c136bc740 1 -- start start 2024-08-20T05:16:49.964 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.963+0000 7f9c136bc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a41fbcc0 0x5567a41fe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.963+0000 7f9c136bc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a41fe5f0 0x5567a42009e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.963+0000 7f9c136bc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a4201030 0x5567a42034f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.963+0000 7f9c136bc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5567a4166210 con 0x5567a4201030 2024-08-20T05:16:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.963+0000 7f9c136bc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5567a4155710 con 0x5567a41fbcc0 2024-08-20T05:16:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.963+0000 7f9c136bc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5567a4159750 con 0x5567a41fe5f0 2024-08-20T05:16:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.963+0000 7f9c0e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a41fbcc0 0x5567a41fe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.963+0000 7f9c0e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a41fbcc0 0x5567a41fe0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50424/0 (socket says 172.21.15.37:50424) 2024-08-20T05:16:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.963+0000 7f9c0e800640 1 -- 172.21.15.37:0/2171216402 learned_addr learned my addr 172.21.15.37:0/2171216402 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:49.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.964+0000 7f9c0de00640 1 --2- 172.21.15.37:0/2171216402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a41fe5f0 0x5567a42009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:49.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.964+0000 7f9c0de00640 1 -- 172.21.15.37:0/2171216402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a41fbcc0 msgr2=0x5567a41fe0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:49.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.964+0000 7f9c0de00640 1 --2- 172.21.15.37:0/2171216402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a41fbcc0 0x5567a41fe0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.964+0000 7f9c0de00640 1 -- 172.21.15.37:0/2171216402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a4201030 msgr2=0x5567a42034f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:16:49.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.964+0000 7f9c0de00640 1 --2- 172.21.15.37:0/2171216402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a4201030 0x5567a42034f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.964+0000 7f9c0de00640 1 -- 172.21.15.37:0/2171216402 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a4121de0 con 0x5567a41fe5f0 2024-08-20T05:16:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.965+0000 7f9c0de00640 1 --2- 172.21.15.37:0/2171216402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a41fe5f0 0x5567a42009e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009d40 tx=0x7f9c0400b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adfbb7e299decea0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.965+0000 7f9bf7000640 1 -- 172.21.15.37:0/2171216402 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c04018070 con 0x5567a41fe5f0 2024-08-20T05:16:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.965+0000 7f9c02a00640 1 -- 172.21.15.37:0/1529267621 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9bf8042070 con 0x7f9c081055f0 2024-08-20T05:16:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.967+0000 7f9bf7000640 1 -- 172.21.15.37:0/2171216402 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c040138c0 con 0x5567a41fe5f0 2024-08-20T05:16:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.967+0000 7f9bf7000640 1 -- 172.21.15.37:0/2171216402 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c04012900 con 0x5567a41fe5f0 2024-08-20T05:16:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.968+0000 7f9c136bc740 1 -- 172.21.15.37:0/2171216402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a41fe5f0 msgr2=0x5567a42009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.968+0000 7f9c136bc740 1 --2- 172.21.15.37:0/2171216402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a41fe5f0 0x5567a42009e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009d40 tx=0x7f9c0400b7c0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.968+0000 7f9c136bc740 1 -- 172.21.15.37:0/2171216402 shutdown_connections 2024-08-20T05:16:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.968+0000 7f9c136bc740 1 --2- 172.21.15.37:0/2171216402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a4201030 0x5567a42034f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.968+0000 7f9c136bc740 1 --2- 172.21.15.37:0/2171216402 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a41fe5f0 0x5567a42009e0 secure :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9c04009d40 tx=0x7f9c0400b7c0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.968+0000 7f9c136bc740 1 --2- 172.21.15.37:0/2171216402 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a41fbcc0 0x5567a41fe0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.968+0000 7f9c136bc740 1 -- 172.21.15.37:0/2171216402 >> 172.21.15.37:0/2171216402 conn(0x5567a41ee600 msgr2=0x5567a41ef390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.968+0000 7f9c02a00640 1 --2- 172.21.15.37:0/1529267621 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9bf00b3c50 0x7f9bf00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:49.970 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.969+0000 7f9c02a00640 1 -- 172.21.15.37:0/1529267621 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9bf81048f0 con 0x7f9c081055f0 2024-08-20T05:16:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.969+0000 7f9c136bc740 1 -- 172.21.15.37:0/2171216402 shutdown_connections 2024-08-20T05:16:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.969+0000 7f9c136bc740 1 -- 172.21.15.37:0/2171216402 wait complete. 2024-08-20T05:16:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.970+0000 7f9c136bc740 1 -- start start 2024-08-20T05:16:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.970+0000 7f9c136bc740 1 Processor -- start 2024-08-20T05:16:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.970+0000 7f9c0e800640 1 --2- 172.21.15.37:0/1529267621 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9bf00b3c50 0x7f9bf00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.971+0000 7f9c136bc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a41fbcc0 0x5567a42169e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.971+0000 7f9c136bc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a4201030 0x5567a4217080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.971+0000 7f9c136bc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a4217c30 0x5567a42180b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.971+0000 7f9c136bc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5567a408eab0 con 0x5567a41fbcc0 2024-08-20T05:16:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.971+0000 7f9c136bc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5567a40fc140 con 0x5567a4201030 2024-08-20T05:16:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.971+0000 7f9c136bc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5567a4204010 con 0x5567a4217c30 2024-08-20T05:16:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.972+0000 7f9c136bc740 10 client.0 _ll_register_callbacks cb 0x5567a410f5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.972+0000 7f9c0d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a4201030 0x5567a4217080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.972+0000 7f9c0d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a4201030 0x5567a4217080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50438/0 (socket says 172.21.15.37:50438) 2024-08-20T05:16:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.972+0000 7f9c0d400640 1 -- 172.21.15.37:0/2688639601 learned_addr learned my addr 172.21.15.37:0/2688639601 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.972+0000 7f9c0de00640 1 --2- 172.21.15.37:0/2688639601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a41fbcc0 0x5567a42169e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.972+0000 7f9c0e800640 1 --2- 172.21.15.37:0/2688639601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a4217c30 0x5567a42180b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.972+0000 7f9c0d400640 1 -- 172.21.15.37:0/2688639601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a4217c30 msgr2=0x5567a42180b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:49.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.972+0000 7f9c0d400640 1 --2- 172.21.15.37:0/2688639601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a4217c30 0x5567a42180b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.972+0000 7f9c0d400640 1 -- 172.21.15.37:0/2688639601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a41fbcc0 msgr2=0x5567a42169e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.972+0000 7f9c0d400640 1 --2- 172.21.15.37:0/2688639601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a41fbcc0 0x5567a42169e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.972+0000 7f9c0d400640 1 -- 172.21.15.37:0/2688639601 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567a40fd170 con 0x5567a4201030 2024-08-20T05:16:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.973+0000 7f9c0d400640 1 --2- 172.21.15.37:0/2688639601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a4201030 0x5567a4217080 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9bf802a930 tx=0x7f9bf80cacd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6c57cf6c40c019a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.973+0000 7f9beb400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:16:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.974+0000 7f9beb400640 1 -- 172.21.15.37:0/2688639601 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8049040 con 0x5567a4201030 2024-08-20T05:16:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.974+0000 7f9beb400640 1 -- 172.21.15.37:0/2688639601 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9bf80c7730 con 0x5567a4201030 2024-08-20T05:16:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.974+0000 7f9c136bc740 1 -- 172.21.15.37:0/2688639601 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5567a412ca30 con 0x5567a4201030 2024-08-20T05:16:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.974+0000 7f9beb400640 1 -- 172.21.15.37:0/2688639601 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f9bf80cb4a0 con 0x5567a4201030 2024-08-20T05:16:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.975+0000 7f9c0e800640 1 --2- 172.21.15.37:0/1529267621 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9bf00b3c50 0x7f9bf00b6110 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0163d0 tx=0x7f9bfc00b430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.979+0000 7f9c136bc740 10 client.28958 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.979+0000 7f9c136bc740 1 -- 172.21.15.37:0/2688639601 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5567a3eb8790 con 0x5567a4201030 2024-08-20T05:16:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.979+0000 7f9beb400640 1 -- 172.21.15.37:0/2688639601 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bf80cfaa0 con 0x5567a4201030 2024-08-20T05:16:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.979+0000 7f9beb400640 1 -- 172.21.15.37:0/2688639601 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f9bf80cb790 con 0x5567a4201030 2024-08-20T05:16:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.980+0000 7f9c136bc740 10 client.28958 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.980+0000 7f9c136bc740 10 client.28958 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:16:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.980+0000 7f9c136bc740 20 client.28958 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.980+0000 7f9c136bc740 1 --2- 172.21.15.37:0/2688639601 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5567a42229b0 0x5567a4224dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.980+0000 7f9c136bc740 4 client.28958 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:16:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.980+0000 7f9c136bc740 1 -- 172.21.15.37:0/2688639601 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567a412ca30 con 0x5567a42229b0 2024-08-20T05:16:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.981+0000 7f9c0de00640 1 --2- 172.21.15.37:0/2688639601 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5567a42229b0 0x5567a4224dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.982+0000 7f9c0de00640 1 --2- 172.21.15.37:0/2688639601 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5567a42229b0 0x5567a4224dc0 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=329b32240b872b9 server_cookie=2e8f84e9e680dcb3 in_seq=0 out_seq=0 2024-08-20T05:16:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.982+0000 7f9beb400640 10 client.28958 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.983+0000 7f9beb400640 1 -- 172.21.15.37:0/2688639601 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5567a412ca30 con 0x5567a42229b0 2024-08-20T05:16:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.983+0000 7f9beb400640 10 client.28958 handle_command_reply: tid=0 2024-08-20T05:16:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.983+0000 7f9c136bc740 1 client.28958 shutdown 2024-08-20T05:16:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.984+0000 7f9c136bc740 1 -- 172.21.15.37:0/2688639601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a4201030 msgr2=0x5567a4217080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.984+0000 7f9c136bc740 1 --2- 172.21.15.37:0/2688639601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a4201030 0x5567a4217080 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9bf802a930 tx=0x7f9bf80cacd0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.984+0000 7f9c136bc740 1 -- 172.21.15.37:0/2688639601 shutdown_connections 2024-08-20T05:16:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.984+0000 7f9c136bc740 1 --2- 172.21.15.37:0/2688639601 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5567a42229b0 0x5567a4224dc0 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.984+0000 7f9c136bc740 1 --2- 172.21.15.37:0/2688639601 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a4217c30 0x5567a42180b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.984+0000 7f9c136bc740 1 --2- 172.21.15.37:0/2688639601 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a4201030 0x5567a4217080 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.984+0000 7f9c136bc740 1 --2- 172.21.15.37:0/2688639601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a41fbcc0 0x5567a42169e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.984+0000 7f9beb400640 0 client.28958 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:49.986 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.984+0000 7f9c136bc740 1 -- 172.21.15.37:0/2688639601 >> 172.21.15.37:0/2688639601 conn(0x5567a41ee600 msgr2=0x5567a41ed590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.988+0000 7f9c136bc740 1 -- 172.21.15.37:0/2688639601 shutdown_connections 2024-08-20T05:16:49.989 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.989+0000 7f9c136bc740 1 -- 172.21.15.37:0/2688639601 wait complete. 2024-08-20T05:16:49.990 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:49.989+0000 7f9c136bc740 20 client.28958 trim_cache size 0 max 16384 2024-08-20T05:16:50.033 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.029+0000 7f9c136bc740 1 Processor -- start 2024-08-20T05:16:50.034 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.032+0000 7f9c136bc740 1 -- start start 2024-08-20T05:16:50.034 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.033+0000 7f9c136bc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a41fbcc0 0x5567a421f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:50.034 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.033+0000 7f9c136bc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a4201030 0x5567a42014a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:50.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.033+0000 7f9c136bc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a4217c30 0x5567a42019e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:50.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.033+0000 7f9c136bc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9c080727a0 con 0x5567a4217c30 2024-08-20T05:16:50.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.033+0000 7f9c136bc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9c08074340 con 0x5567a4201030 2024-08-20T05:16:50.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.033+0000 7f9c136bc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c08072e70 con 0x5567a41fbcc0 2024-08-20T05:16:50.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.033+0000 7f9c0d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a4201030 0x5567a42014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:50.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.033+0000 7f9c0de00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a41fbcc0 0x5567a421f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:50.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.033+0000 7f9c0d400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a4201030 0x5567a42014a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50440/0 (socket says 172.21.15.37:50440) 2024-08-20T05:16:50.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.033+0000 7f9c0d400640 1 -- 172.21.15.37:0/3500867293 learned_addr learned my addr 172.21.15.37:0/3500867293 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:50.035 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.034+0000 7f9c0d400640 1 -- 172.21.15.37:0/3500867293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a41fbcc0 msgr2=0x5567a421f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.036+0000 7f9c0d400640 1 --2- 172.21.15.37:0/3500867293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a41fbcc0 0x5567a421f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.036+0000 7f9c0d400640 1 -- 172.21.15.37:0/3500867293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a4217c30 msgr2=0x5567a42019e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.036+0000 7f9c0d400640 1 --2- 172.21.15.37:0/3500867293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a4217c30 0x5567a42019e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.036+0000 7f9c0d400640 1 -- 172.21.15.37:0/3500867293 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567a3f31620 con 0x5567a4201030 2024-08-20T05:16:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.036+0000 7f9c0de00640 1 --2- 172.21.15.37:0/3500867293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a41fbcc0 0x5567a421f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:16:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.036+0000 7f9c0d400640 1 --2- 172.21.15.37:0/3500867293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a4201030 0x5567a42014a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80cb1a0 tx=0x7f9bf802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb6c7d5231803eca server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:50.038 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.036+0000 7f9bf6600640 1 -- 172.21.15.37:0/3500867293 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8049070 con 0x5567a4201030 2024-08-20T05:16:50.039 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.036+0000 7f9bf6600640 1 -- 172.21.15.37:0/3500867293 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bf80d4550 con 0x5567a4201030 2024-08-20T05:16:50.039 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.036+0000 7f9bf6600640 1 -- 172.21.15.37:0/3500867293 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf803bac0 con 0x5567a4201030 2024-08-20T05:16:50.039 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.037+0000 7f9c136bc740 1 -- 172.21.15.37:0/3500867293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a4201030 msgr2=0x5567a42014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:50.039 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.037+0000 7f9c136bc740 1 --2- 172.21.15.37:0/3500867293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a4201030 0x5567a42014a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80cb1a0 tx=0x7f9bf802a410 comp rx=0 tx=0).stop 2024-08-20T05:16:50.039 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.038+0000 7f9c136bc740 1 -- 172.21.15.37:0/3500867293 shutdown_connections 2024-08-20T05:16:50.039 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.038+0000 7f9c136bc740 1 --2- 172.21.15.37:0/3500867293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a4217c30 0x5567a42019e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:50.039 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.038+0000 7f9c136bc740 1 --2- 172.21.15.37:0/3500867293 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a4201030 0x5567a42014a0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:50.040 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.038+0000 7f9c136bc740 1 --2- 172.21.15.37:0/3500867293 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a41fbcc0 0x5567a421f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:50.040 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.038+0000 7f9c136bc740 1 -- 172.21.15.37:0/3500867293 >> 172.21.15.37:0/3500867293 conn(0x5567a41ee600 msgr2=0x5567a4202e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:50.040 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.040+0000 7f9c136bc740 1 -- 172.21.15.37:0/3500867293 shutdown_connections 2024-08-20T05:16:50.041 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.040+0000 7f9c136bc740 1 -- 172.21.15.37:0/3500867293 wait complete. 2024-08-20T05:16:50.044 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.040+0000 7f9c136bc740 1 -- start start 2024-08-20T05:16:50.044 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.040+0000 7f9c136bc740 1 Processor -- start 2024-08-20T05:16:50.044 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.041+0000 7f9c136bc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a41fbcc0 0x5567a421b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:50.044 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.041+0000 7f9c136bc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a4201030 0x5567a421bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:50.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.041+0000 7f9c136bc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a4217c30 0x5567a421cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:50.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.041+0000 7f9c136bc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9c08073c70 con 0x5567a4217c30 2024-08-20T05:16:50.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.041+0000 7f9c136bc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9c08073540 con 0x5567a41fbcc0 2024-08-20T05:16:50.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.041+0000 7f9c136bc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9c08070780 con 0x5567a4201030 2024-08-20T05:16:50.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.041+0000 7f9c136bc740 10 client.0 _ll_register_callbacks cb 0x7f9bf8005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:50.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.042+0000 7f9c0d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a4201030 0x5567a421bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:50.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.042+0000 7f9c0de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a41fbcc0 0x5567a421b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:50.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.042+0000 7f9c0d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a4201030 0x5567a421bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43594/0 (socket says 172.21.15.37:43594) 2024-08-20T05:16:50.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.042+0000 7f9c0d400640 1 -- 172.21.15.37:0/3821421097 learned_addr learned my addr 172.21.15.37:0/3821421097 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:50.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.042+0000 7f9c0e800640 1 --2- 172.21.15.37:0/3821421097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a4217c30 0x5567a421cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:50.045 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.042+0000 7f9c0d400640 1 -- 172.21.15.37:0/3821421097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a41fbcc0 msgr2=0x5567a421b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:50.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.042+0000 7f9c0d400640 1 --2- 172.21.15.37:0/3821421097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a41fbcc0 0x5567a421b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:50.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.042+0000 7f9c0d400640 1 -- 172.21.15.37:0/3821421097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a4217c30 msgr2=0x5567a421cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:50.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.042+0000 7f9c0d400640 1 --2- 172.21.15.37:0/3821421097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a4217c30 0x5567a421cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:50.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.042+0000 7f9c0d400640 1 -- 172.21.15.37:0/3821421097 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567a421d310 con 0x5567a4201030 2024-08-20T05:16:50.046 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.043+0000 7f9c0d400640 1 --2- 172.21.15.37:0/3821421097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a4201030 0x5567a421bf80 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80c5bc0 tx=0x7f9bf80d4300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e8e596bace984cf server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:50.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.043+0000 7f9beb400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:16:50.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.043+0000 7f9beb400640 1 -- 172.21.15.37:0/3821421097 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8049070 con 0x5567a4201030 2024-08-20T05:16:50.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.043+0000 7f9beb400640 1 -- 172.21.15.37:0/3821421097 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9bf80c7a90 con 0x5567a4201030 2024-08-20T05:16:50.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.043+0000 7f9c136bc740 1 -- 172.21.15.37:0/3821421097 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bf80d4550 con 0x5567a4201030 2024-08-20T05:16:50.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.043+0000 7f9beb400640 1 -- 172.21.15.37:0/3821421097 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f9bf8077050 con 0x5567a4201030 2024-08-20T05:16:50.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.043+0000 7f9c136bc740 10 client.29002 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:50.047 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.043+0000 7f9c136bc740 1 -- 172.21.15.37:0/3821421097 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5567a421d310 con 0x5567a4201030 2024-08-20T05:16:50.048 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.044+0000 7f9beb400640 1 -- 172.21.15.37:0/3821421097 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bf80d4550 con 0x5567a4201030 2024-08-20T05:16:50.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.044+0000 7f9beb400640 1 -- 172.21.15.37:0/3821421097 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f9bf80c6e10 con 0x5567a4201030 2024-08-20T05:16:50.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.044+0000 7f9c136bc740 10 client.29002 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:50.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.044+0000 7f9c136bc740 10 client.29002 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:16:50.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.044+0000 7f9c136bc740 20 client.29002 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:50.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.044+0000 7f9c136bc740 1 --2- 172.21.15.37:0/3821421097 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5567a42054f0 0x5567a4207910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:50.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.044+0000 7f9c136bc740 4 client.29002 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:16:50.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.044+0000 7f9c136bc740 1 -- 172.21.15.37:0/3821421097 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5567a4168160 con 0x5567a42054f0 2024-08-20T05:16:50.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.044+0000 7f9c0de00640 1 --2- 172.21.15.37:0/3821421097 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5567a42054f0 0x5567a4207910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:50.049 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.045+0000 7f9c0de00640 1 --2- 172.21.15.37:0/3821421097 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5567a42054f0 0x5567a4207910 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b49f9e7a643f4560 server_cookie=ec2102ec260d6090 in_seq=0 out_seq=0 2024-08-20T05:16:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.045+0000 7f9beb400640 10 client.29002 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:50.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.143+0000 7f9beb400640 1 -- 172.21.15.37:0/3821421097 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5567a4168160 con 0x5567a42054f0 2024-08-20T05:16:50.144 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.143+0000 7f9beb400640 10 client.29002 handle_command_reply: tid=0 2024-08-20T05:16:50.145 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.143+0000 7f9c136bc740 1 client.29002 shutdown 2024-08-20T05:16:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.147+0000 7f9c136bc740 1 -- 172.21.15.37:0/3821421097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a4201030 msgr2=0x5567a421bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.147+0000 7f9c136bc740 1 --2- 172.21.15.37:0/3821421097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a4201030 0x5567a421bf80 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9bf80c5bc0 tx=0x7f9bf80d4300 comp rx=0 tx=0).stop 2024-08-20T05:16:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.147+0000 7f9c136bc740 1 -- 172.21.15.37:0/3821421097 shutdown_connections 2024-08-20T05:16:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.147+0000 7f9c136bc740 1 --2- 172.21.15.37:0/3821421097 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5567a42054f0 0x5567a4207910 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.148+0000 7f9beb400640 0 client.29002 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.148+0000 7f9c136bc740 1 --2- 172.21.15.37:0/3821421097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5567a4217c30 0x5567a421cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.148+0000 7f9c136bc740 1 --2- 172.21.15.37:0/3821421097 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5567a4201030 0x5567a421bf80 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.148+0000 7f9c136bc740 1 --2- 172.21.15.37:0/3821421097 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5567a41fbcc0 0x5567a421b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.148+0000 7f9c136bc740 1 -- 172.21.15.37:0/3821421097 >> 172.21.15.37:0/3821421097 conn(0x5567a41ee600 msgr2=0x5567a42014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.151+0000 7f9c136bc740 1 -- 172.21.15.37:0/3821421097 shutdown_connections 2024-08-20T05:16:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.152+0000 7f9c136bc740 1 -- 172.21.15.37:0/3821421097 wait complete. 2024-08-20T05:16:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.152+0000 7f9c136bc740 20 client.29002 trim_cache size 0 max 16384 2024-08-20T05:16:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:16:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:16:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:16:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:16:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.157+0000 7f9c0f200640 1 -- 172.21.15.37:0/1529267621 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9bf00b3c50 msgr2=0x7f9bf00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:50.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.157+0000 7f9c0f200640 1 --2- 172.21.15.37:0/1529267621 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9bf00b3c50 0x7f9bf00b6110 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0163d0 tx=0x7f9bfc00b430 comp rx=0 tx=0).stop 2024-08-20T05:16:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.157+0000 7f9c0f200640 1 -- 172.21.15.37:0/1529267621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c081055f0 msgr2=0x7f9c0819b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.157+0000 7f9c0f200640 1 --2- 172.21.15.37:0/1529267621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c081055f0 0x7f9c0819b260 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f9bf802aa00 tx=0x7f9bf8003d50 comp rx=0 tx=0).stop 2024-08-20T05:16:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.157+0000 7f9c0f200640 1 -- 172.21.15.37:0/1529267621 shutdown_connections 2024-08-20T05:16:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.157+0000 7f9c0f200640 1 --2- 172.21.15.37:0/1529267621 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9bf00b3c50 0x7f9bf00b6110 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.157+0000 7f9c0f200640 1 --2- 172.21.15.37:0/1529267621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9c081081a0 0x7f9c0819be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.157+0000 7f9c0f200640 1 --2- 172.21.15.37:0/1529267621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9c081055f0 0x7f9c0819b260 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.157+0000 7f9c0f200640 1 --2- 172.21.15.37:0/1529267621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c0806b170 0x7f9c0819ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:50.158 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.157+0000 7f9c0f200640 1 -- 172.21.15.37:0/1529267621 >> 172.21.15.37:0/1529267621 conn(0x7f9c080fcc50 msgr2=0x7f9c080ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:50.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.160+0000 7f9c0f200640 1 -- 172.21.15.37:0/1529267621 shutdown_connections 2024-08-20T05:16:50.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:16:50.160+0000 7f9c0f200640 1 -- 172.21.15.37:0/1529267621 wait complete. 2024-08-20T05:16:50.474 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:16:51.861 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:51 smithi037 ceph-mon[17265]: pgmap v839: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 4.3 MiB/s wr, 468 op/s 2024-08-20T05:16:51.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:51 smithi135 ceph-mon[22342]: pgmap v839: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 4.3 MiB/s wr, 468 op/s 2024-08-20T05:16:51.908 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:51 smithi130 ceph-mon[22007]: pgmap v839: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 4.3 MiB/s wr, 468 op/s 2024-08-20T05:16:52.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.271+0000 7f1eac200640 1 -- 172.21.15.37:0/1348916048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ea4108e40 msgr2=0x7f1ea410f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:52.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.271+0000 7f1eac200640 1 --2- 172.21.15.37:0/1348916048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ea4108e40 0x7f1ea410f640 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009ca0 tx=0x7f1e9c02a8d0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.271+0000 7f1eac200640 1 -- 172.21.15.37:0/1348916048 shutdown_connections 2024-08-20T05:16:52.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.271+0000 7f1eac200640 1 --2- 172.21.15.37:0/1348916048 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ea4108e40 0x7f1ea410f640 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.271+0000 7f1eac200640 1 --2- 172.21.15.37:0/1348916048 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ea41084c0 0x7f1ea4108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.271+0000 7f1eac200640 1 --2- 172.21.15.37:0/1348916048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ea4102ab0 0x7f1ea4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.271+0000 7f1eac200640 1 -- 172.21.15.37:0/1348916048 >> 172.21.15.37:0/1348916048 conn(0x7f1ea40fe500 msgr2=0x7f1ea4100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:52.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.272+0000 7f1eac200640 1 -- 172.21.15.37:0/1348916048 shutdown_connections 2024-08-20T05:16:52.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.272+0000 7f1eac200640 1 -- 172.21.15.37:0/1348916048 wait complete. 2024-08-20T05:16:52.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.273+0000 7f1eac200640 1 Processor -- start 2024-08-20T05:16:52.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.273+0000 7f1eac200640 1 -- start start 2024-08-20T05:16:52.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.275+0000 7f1eac200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ea4102ab0 0x7f1ea4111ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.276+0000 7f1eac200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ea41084c0 0x7f1ea4112530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.276+0000 7f1eac200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ea4108e40 0x7f1ea4117860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.276+0000 7f1eac200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea4110910 con 0x7f1ea41084c0 2024-08-20T05:16:52.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.276+0000 7f1eac200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea4110790 con 0x7f1ea4108e40 2024-08-20T05:16:52.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.276+0000 7f1eac200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea4110a90 con 0x7f1ea4102ab0 2024-08-20T05:16:52.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.277+0000 7f1eaa200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ea4108e40 0x7f1ea4117860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:52.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.277+0000 7f1eaa200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ea4108e40 0x7f1ea4117860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50464/0 (socket says 172.21.15.37:50464) 2024-08-20T05:16:52.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.277+0000 7f1eaa200640 1 -- 172.21.15.37:0/1565539360 learned_addr learned my addr 172.21.15.37:0/1565539360 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:52.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.278+0000 7f1eaa200640 1 -- 172.21.15.37:0/1565539360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ea4102ab0 msgr2=0x7f1ea4111ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:52.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.278+0000 7f1eaa200640 1 --2- 172.21.15.37:0/1565539360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ea4102ab0 0x7f1ea4111ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.278+0000 7f1eaa200640 1 -- 172.21.15.37:0/1565539360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ea41084c0 msgr2=0x7f1ea4112530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:52.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.278+0000 7f1eaa200640 1 --2- 172.21.15.37:0/1565539360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ea41084c0 0x7f1ea4112530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.278+0000 7f1eaa200640 1 -- 172.21.15.37:0/1565539360 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea4117f90 con 0x7f1ea4108e40 2024-08-20T05:16:52.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.279+0000 7f1eaa200640 1 --2- 172.21.15.37:0/1565539360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ea4108e40 0x7f1ea4117860 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c02ae40 tx=0x7f1e9c032ff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:52.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.279+0000 7f1ea2000640 1 -- 172.21.15.37:0/1565539360 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c003b70 con 0x7f1ea4108e40 2024-08-20T05:16:52.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.280+0000 7f1ea2000640 1 -- 172.21.15.37:0/1565539360 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e9c003d10 con 0x7f1ea4108e40 2024-08-20T05:16:52.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.280+0000 7f1ea2000640 1 -- 172.21.15.37:0/1565539360 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9c030a40 con 0x7f1ea4108e40 2024-08-20T05:16:52.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.282+0000 7f1eac200640 1 -- 172.21.15.37:0/1565539360 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea4118220 con 0x7f1ea4108e40 2024-08-20T05:16:52.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.282+0000 7f1eac200640 1 -- 172.21.15.37:0/1565539360 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea41b4820 con 0x7f1ea4108e40 2024-08-20T05:16:52.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.296+0000 7f1eaeca2740 1 Processor -- start 2024-08-20T05:16:52.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.300+0000 7f1ea2000640 1 -- 172.21.15.37:0/1565539360 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f1e9c030be0 con 0x7f1ea4108e40 2024-08-20T05:16:52.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.303+0000 7f1ea2000640 1 --2- 172.21.15.37:0/1565539360 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e8c0b3d60 0x7f1e8c0b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.304+0000 7f1eaeca2740 1 -- start start 2024-08-20T05:16:52.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.304+0000 7f1eaeca2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbd89d0 0x56350fbd8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.305+0000 7f1eaeca2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd92f0 0x56350fbe4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.306+0000 7f1ea8e00640 1 --2- 172.21.15.37:0/1565539360 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e8c0b3d60 0x7f1e8c0b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:52.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.306+0000 7f1eaeca2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbe5280 0x56350fbe7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.307+0000 7f1eaeca2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56350fb4f870 con 0x56350fbd89d0 2024-08-20T05:16:52.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.307+0000 7f1eaa200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbe5280 0x56350fbe7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:52.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.307+0000 7f1eaa200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbe5280 0x56350fbe7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50478/0 (socket says 172.21.15.37:50478) 2024-08-20T05:16:52.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.307+0000 7f1eaa200640 1 -- 172.21.15.37:0/814181158 learned_addr learned my addr 172.21.15.37:0/814181158 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:52.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.307+0000 7f1eaeca2740 1 -- 172.21.15.37:0/814181158 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56350fb3ed70 con 0x56350fbe5280 2024-08-20T05:16:52.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.307+0000 7f1ea8e00640 1 --2- 172.21.15.37:0/814181158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd92f0 0x56350fbe4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:52.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.307+0000 7f1eaeca2740 1 -- 172.21.15.37:0/814181158 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56350fb42db0 con 0x56350fbd92f0 2024-08-20T05:16:52.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.312+0000 7f1ea2000640 1 -- 172.21.15.37:0/1565539360 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1e9c0c87a0 con 0x7f1ea4108e40 2024-08-20T05:16:52.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.312+0000 7f1ea9800640 1 --2- 172.21.15.37:0/814181158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbd89d0 0x56350fbd8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:52.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.315+0000 7f1ea8e00640 1 -- 172.21.15.37:0/814181158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbe5280 msgr2=0x56350fbe7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:52.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.315+0000 7f1ea8e00640 1 --2- 172.21.15.37:0/814181158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbe5280 0x56350fbe7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.315+0000 7f1ea8e00640 1 -- 172.21.15.37:0/814181158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbd89d0 msgr2=0x56350fbd8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:52.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.315+0000 7f1ea8e00640 1 --2- 172.21.15.37:0/814181158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbd89d0 0x56350fbd8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.315+0000 7f1ea8e00640 1 -- 172.21.15.37:0/814181158 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56350f89e930 con 0x56350fbd92f0 2024-08-20T05:16:52.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.316+0000 7f1ea9800640 1 --2- 172.21.15.37:0/814181158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbd89d0 0x56350fbd8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:16:52.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.316+0000 7f1eaa200640 1 --2- 172.21.15.37:0/814181158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbe5280 0x56350fbe7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:16:52.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.316+0000 7f1ea8e00640 1 --2- 172.21.15.37:0/1565539360 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e8c0b3d60 0x7f1e8c0b6220 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4107fa0 tx=0x7f1e90007930 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:52.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.316+0000 7f1ea8e00640 1 --2- 172.21.15.37:0/814181158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd92f0 0x56350fbe4d40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1e900072a0 tx=0x7f1e90019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33e6ec462ba8d6c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:52.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.318+0000 7f1e96a00640 1 -- 172.21.15.37:0/814181158 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e90020070 con 0x56350fbd92f0 2024-08-20T05:16:52.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.318+0000 7f1e96a00640 1 -- 172.21.15.37:0/814181158 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e9000ace0 con 0x56350fbd92f0 2024-08-20T05:16:52.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.319+0000 7f1eaeca2740 1 -- 172.21.15.37:0/814181158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd92f0 msgr2=0x56350fbe4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:52.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.319+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/814181158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd92f0 0x56350fbe4d40 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1e900072a0 tx=0x7f1e90019000 comp rx=0 tx=0).stop 2024-08-20T05:16:52.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.322+0000 7f1eaeca2740 1 -- 172.21.15.37:0/814181158 shutdown_connections 2024-08-20T05:16:52.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.322+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/814181158 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbe5280 0x56350fbe7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.322+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/814181158 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd92f0 0x56350fbe4d40 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.322+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/814181158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbd89d0 0x56350fbd8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.322+0000 7f1eaeca2740 1 -- 172.21.15.37:0/814181158 >> 172.21.15.37:0/814181158 conn(0x56350fbd6800 msgr2=0x56350fbd79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:52.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.322+0000 7f1eaeca2740 1 -- 172.21.15.37:0/814181158 shutdown_connections 2024-08-20T05:16:52.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.322+0000 7f1eaeca2740 1 -- 172.21.15.37:0/814181158 wait complete. 2024-08-20T05:16:52.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.323+0000 7f1eaeca2740 1 -- start start 2024-08-20T05:16:52.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.323+0000 7f1eaeca2740 1 Processor -- start 2024-08-20T05:16:52.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.325+0000 7f1eaeca2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd89d0 0x56350fbe4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.325+0000 7f1eaeca2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbd92f0 0x56350fbe1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.326+0000 7f1eaeca2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbe5280 0x56350fbe23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.326+0000 7f1ea9800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd89d0 0x56350fbe4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:52.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.326+0000 7f1ea8e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbd92f0 0x56350fbe1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:52.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.326+0000 7f1ea8e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbd92f0 0x56350fbe1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50482/0 (socket says 172.21.15.37:50482) 2024-08-20T05:16:52.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.328+0000 7f1ea9800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd89d0 0x56350fbe4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43630/0 (socket says 172.21.15.37:43630) 2024-08-20T05:16:52.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.328+0000 7f1eaeca2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56350f9a1890 con 0x56350fbe5280 2024-08-20T05:16:52.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.328+0000 7f1eaeca2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56350fac5b00 con 0x56350fbd92f0 2024-08-20T05:16:52.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.328+0000 7f1eaeca2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56350fbe8010 con 0x56350fbd89d0 2024-08-20T05:16:52.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.329+0000 7f1eaeca2740 10 client.0 _ll_register_callbacks cb 0x56350fb39dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:52.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.329+0000 7f1ea8e00640 1 -- 172.21.15.37:0/1941447017 learned_addr learned my addr 172.21.15.37:0/1941447017 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:52.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.329+0000 7f1ea8e00640 1 -- 172.21.15.37:0/1941447017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd89d0 msgr2=0x56350fbe4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:52.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.329+0000 7f1ea8e00640 1 --2- 172.21.15.37:0/1941447017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd89d0 0x56350fbe4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.329+0000 7f1ea8e00640 1 -- 172.21.15.37:0/1941447017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbe5280 msgr2=0x56350fbe23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.329+0000 7f1ea8e00640 1 --2- 172.21.15.37:0/1941447017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbe5280 0x56350fbe23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.329+0000 7f1ea8e00640 1 -- 172.21.15.37:0/1941447017 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56350fb06a30 con 0x56350fbd92f0 2024-08-20T05:16:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.330+0000 7f1ea9800640 1 --2- 172.21.15.37:0/1941447017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd89d0 0x56350fbe4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:16:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.332+0000 7f1ea8e00640 1 --2- 172.21.15.37:0/1941447017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbd92f0 0x56350fbe1e70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000de20 tx=0x7f1e90005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8aa458acace4411e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:52.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.332+0000 7f1e8b400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:16:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.332+0000 7f1e8b400640 1 -- 172.21.15.37:0/1941447017 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e90016040 con 0x56350fbd92f0 2024-08-20T05:16:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.332+0000 7f1e8b400640 1 -- 172.21.15.37:0/1941447017 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1e9001bae0 con 0x56350fbd92f0 2024-08-20T05:16:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.333+0000 7f1eaeca2740 1 -- 172.21.15.37:0/1941447017 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e9000ace0 con 0x56350fbd92f0 2024-08-20T05:16:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.333+0000 7f1e8b400640 1 -- 172.21.15.37:0/1941447017 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f1e90020040 con 0x56350fbd92f0 2024-08-20T05:16:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.333+0000 7f1eaeca2740 10 client.28976 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.333+0000 7f1eaeca2740 1 -- 172.21.15.37:0/1941447017 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x56350fbf3840 con 0x56350fbd92f0 2024-08-20T05:16:52.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.334+0000 7f1e8b400640 1 -- 172.21.15.37:0/1941447017 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e9000ae90 con 0x56350fbd92f0 2024-08-20T05:16:52.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.338+0000 7f1e8b400640 1 -- 172.21.15.37:0/1941447017 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f1e9002c070 con 0x56350fbd92f0 2024-08-20T05:16:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.338+0000 7f1eaeca2740 10 client.28976 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.338+0000 7f1eaeca2740 10 client.28976 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:16:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.338+0000 7f1eaeca2740 20 client.28976 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.338+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/1941447017 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56350fbf4bf0 0x56350fbf6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.338+0000 7f1eaeca2740 4 client.28976 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:16:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.339+0000 7f1eaeca2740 1 -- 172.21.15.37:0/1941447017 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1e9000ace0 con 0x56350fbf4bf0 2024-08-20T05:16:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.339+0000 7f1ea9800640 1 --2- 172.21.15.37:0/1941447017 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56350fbf4bf0 0x56350fbf6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.340+0000 7f1ea9800640 1 --2- 172.21.15.37:0/1941447017 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56350fbf4bf0 0x56350fbf6fe0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdeed7069f158d0a server_cookie=f303d8f337251c4c in_seq=0 out_seq=0 2024-08-20T05:16:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.340+0000 7f1e8b400640 10 client.28976 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.341+0000 7f1e8b400640 1 -- 172.21.15.37:0/1941447017 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f1e9000ace0 con 0x56350fbf4bf0 2024-08-20T05:16:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.341+0000 7f1e8b400640 10 client.28976 handle_command_reply: tid=0 2024-08-20T05:16:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.341+0000 7f1eaeca2740 1 client.28976 shutdown 2024-08-20T05:16:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.344+0000 7f1eaeca2740 1 -- 172.21.15.37:0/1941447017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbd92f0 msgr2=0x56350fbe1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.344+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/1941447017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbd92f0 0x56350fbe1e70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1e9000de20 tx=0x7f1e90005ef0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.344+0000 7f1eaeca2740 1 -- 172.21.15.37:0/1941447017 shutdown_connections 2024-08-20T05:16:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.345+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/1941447017 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56350fbf4bf0 0x56350fbf6fe0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.345+0000 7f1e8b400640 0 client.28976 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.345+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/1941447017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbe5280 0x56350fbe23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.345+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/1941447017 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbd92f0 0x56350fbe1e70 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.345+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/1941447017 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd89d0 0x56350fbe4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.345+0000 7f1eaeca2740 1 -- 172.21.15.37:0/1941447017 >> 172.21.15.37:0/1941447017 conn(0x56350fbd6800 msgr2=0x56350fbdc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.346+0000 7f1eaeca2740 1 -- 172.21.15.37:0/1941447017 shutdown_connections 2024-08-20T05:16:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.347+0000 7f1eaeca2740 1 -- 172.21.15.37:0/1941447017 wait complete. 2024-08-20T05:16:52.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.348+0000 7f1eaeca2740 20 client.28976 trim_cache size 0 max 16384 2024-08-20T05:16:52.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.390+0000 7f1eaeca2740 1 Processor -- start 2024-08-20T05:16:52.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.390+0000 7f1eaeca2740 1 -- start start 2024-08-20T05:16:52.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.391+0000 7f1eaeca2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbd89d0 0x56350fbf1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.391+0000 7f1eaeca2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbd92f0 0x56350fbe3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.392+0000 7f1ea9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbd89d0 0x56350fbf1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:52.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.392+0000 7f1eaeca2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbe5280 0x56350fbd57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.392+0000 7f1eaeca2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea41be640 con 0x56350fbd89d0 2024-08-20T05:16:52.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.392+0000 7f1eaeca2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea41c01e0 con 0x56350fbd92f0 2024-08-20T05:16:52.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.392+0000 7f1eaeca2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea41bed10 con 0x56350fbe5280 2024-08-20T05:16:52.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.392+0000 7f1ea9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbd89d0 0x56350fbf1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51162/0 (socket says 172.21.15.37:51162) 2024-08-20T05:16:52.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.392+0000 7f1ea9800640 1 -- 172.21.15.37:0/3158500308 learned_addr learned my addr 172.21.15.37:0/3158500308 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:52.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.393+0000 7f1ea8e00640 1 --2- 172.21.15.37:0/3158500308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbd92f0 0x56350fbe3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:52.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.394+0000 7f1eaa200640 1 --2- 172.21.15.37:0/3158500308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbe5280 0x56350fbd57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:52.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.394+0000 7f1ea9800640 1 -- 172.21.15.37:0/3158500308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbe5280 msgr2=0x56350fbd57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:52.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.394+0000 7f1ea9800640 1 --2- 172.21.15.37:0/3158500308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbe5280 0x56350fbd57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.394+0000 7f1ea9800640 1 -- 172.21.15.37:0/3158500308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbd92f0 msgr2=0x56350fbe3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:52.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.394+0000 7f1ea9800640 1 --2- 172.21.15.37:0/3158500308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbd92f0 0x56350fbe3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.394+0000 7f1ea9800640 1 -- 172.21.15.37:0/3158500308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56350fbd7280 con 0x56350fbd89d0 2024-08-20T05:16:52.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.396+0000 7f1ea9800640 1 --2- 172.21.15.37:0/3158500308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbd89d0 0x56350fbf1180 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009ab0 tx=0x7f1e98009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc6469cb1753e2d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:52.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.398+0000 7f1e96000640 1 -- 172.21.15.37:0/3158500308 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e980142d0 con 0x56350fbd89d0 2024-08-20T05:16:52.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.398+0000 7f1e96000640 1 -- 172.21.15.37:0/3158500308 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e9801b7e0 con 0x56350fbd89d0 2024-08-20T05:16:52.399 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.398+0000 7f1e96000640 1 -- 172.21.15.37:0/3158500308 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e98012950 con 0x56350fbd89d0 2024-08-20T05:16:52.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.399+0000 7f1eaeca2740 1 -- 172.21.15.37:0/3158500308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbd89d0 msgr2=0x56350fbf1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:52.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.399+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/3158500308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbd89d0 0x56350fbf1180 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1e98009ab0 tx=0x7f1e98009790 comp rx=0 tx=0).stop 2024-08-20T05:16:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.400+0000 7f1eaeca2740 1 -- 172.21.15.37:0/3158500308 shutdown_connections 2024-08-20T05:16:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.400+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/3158500308 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbe5280 0x56350fbd57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.400+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/3158500308 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbd92f0 0x56350fbe3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.400+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/3158500308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbd89d0 0x56350fbf1180 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.400+0000 7f1eaeca2740 1 -- 172.21.15.37:0/3158500308 >> 172.21.15.37:0/3158500308 conn(0x56350fbd6800 msgr2=0x56350fbd50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.400+0000 7f1eaeca2740 1 -- 172.21.15.37:0/3158500308 shutdown_connections 2024-08-20T05:16:52.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.400+0000 7f1eaeca2740 1 -- 172.21.15.37:0/3158500308 wait complete. 2024-08-20T05:16:52.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.401+0000 7f1eaeca2740 1 -- start start 2024-08-20T05:16:52.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.401+0000 7f1eaeca2740 1 Processor -- start 2024-08-20T05:16:52.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.404+0000 7f1eaeca2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbd89d0 0x56350fbeb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.404+0000 7f1eaeca2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd92f0 0x56350fbeb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.405+0000 7f1eaeca2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbe5280 0x56350fbebe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.405+0000 7f1ea8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd92f0 0x56350fbeb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:52.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.405+0000 7f1eaeca2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea41bfb10 con 0x56350fbd89d0 2024-08-20T05:16:52.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.405+0000 7f1eaeca2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea41bf3e0 con 0x56350fbe5280 2024-08-20T05:16:52.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.405+0000 7f1eaeca2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea41bc620 con 0x56350fbd92f0 2024-08-20T05:16:52.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.405+0000 7f1ea8e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd92f0 0x56350fbeb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:43652/0 (socket says 172.21.15.37:43652) 2024-08-20T05:16:52.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.405+0000 7f1ea8e00640 1 -- 172.21.15.37:0/3987942421 learned_addr learned my addr 172.21.15.37:0/3987942421 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:52.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.405+0000 7f1eaa200640 1 --2- 172.21.15.37:0/3987942421 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbe5280 0x56350fbebe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:52.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.405+0000 7f1eaeca2740 10 client.0 _ll_register_callbacks cb 0x7f1e9c003ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:52.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.406+0000 7f1ea8e00640 1 -- 172.21.15.37:0/3987942421 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbe5280 msgr2=0x56350fbebe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:52.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.406+0000 7f1ea8e00640 1 --2- 172.21.15.37:0/3987942421 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbe5280 0x56350fbebe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.406+0000 7f1ea8e00640 1 -- 172.21.15.37:0/3987942421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbd89d0 msgr2=0x56350fbeb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:52.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.406+0000 7f1ea8e00640 1 --2- 172.21.15.37:0/3987942421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbd89d0 0x56350fbeb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.406+0000 7f1ea8e00640 1 -- 172.21.15.37:0/3987942421 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56350fc5e9f0 con 0x56350fbd92f0 2024-08-20T05:16:52.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.406+0000 7f1ea8e00640 1 --2- 172.21.15.37:0/3987942421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd92f0 0x56350fbeb8d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f1e90024bb0 tx=0x7f1e90005330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29bcaf0f1e1ff572 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:52.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.406+0000 7f1e8b400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:16:52.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.407+0000 7f1e8b400640 1 -- 172.21.15.37:0/3987942421 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9001bae0 con 0x56350fbd92f0 2024-08-20T05:16:52.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.407+0000 7f1e8b400640 1 -- 172.21.15.37:0/3987942421 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1e9001bc80 con 0x56350fbd92f0 2024-08-20T05:16:52.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.407+0000 7f1eaeca2740 1 -- 172.21.15.37:0/3987942421 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e9801b7e0 con 0x56350fbd92f0 2024-08-20T05:16:52.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.407+0000 7f1e8b400640 1 -- 172.21.15.37:0/3987942421 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f1e90047050 con 0x56350fbd92f0 2024-08-20T05:16:52.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.407+0000 7f1eaeca2740 10 client.29017 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:52.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.407+0000 7f1eaeca2740 1 -- 172.21.15.37:0/3987942421 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x56350fc5fd10 con 0x56350fbd92f0 2024-08-20T05:16:52.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.408+0000 7f1e8b400640 1 -- 172.21.15.37:0/3987942421 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1e9801b7e0 con 0x56350fbd92f0 2024-08-20T05:16:52.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.408+0000 7f1e8b400640 1 -- 172.21.15.37:0/3987942421 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f1e9002c050 con 0x56350fbd92f0 2024-08-20T05:16:52.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.408+0000 7f1eaeca2740 10 client.29017 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:52.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.408+0000 7f1eaeca2740 10 client.29017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:16:52.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.408+0000 7f1eaeca2740 20 client.29017 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:52.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.408+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/3987942421 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56350fbf4bf0 0x56350fc62460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:52.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.408+0000 7f1eaeca2740 4 client.29017 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T05:16:52.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.408+0000 7f1eaeca2740 1 -- 172.21.15.37:0/3987942421 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56350fb517c0 con 0x56350fbf4bf0 2024-08-20T05:16:52.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.408+0000 7f1ea9800640 1 --2- 172.21.15.37:0/3987942421 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56350fbf4bf0 0x56350fc62460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:52.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.409+0000 7f1e8b400640 10 client.29017 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:52.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.412+0000 7f1ea9800640 1 --2- 172.21.15.37:0/3987942421 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56350fbf4bf0 0x56350fc62460 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f48f452081cd69e3 server_cookie=552f9c93fce45cc2 in_seq=0 out_seq=0 2024-08-20T05:16:52.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.414+0000 7f1e8b400640 1 -- 172.21.15.37:0/3987942421 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56350fb517c0 con 0x56350fbf4bf0 2024-08-20T05:16:52.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.414+0000 7f1e8b400640 10 client.29017 handle_command_reply: tid=0 2024-08-20T05:16:52.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.414+0000 7f1eaeca2740 1 client.29017 shutdown 2024-08-20T05:16:52.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.414+0000 7f1eaeca2740 1 -- 172.21.15.37:0/3987942421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd92f0 msgr2=0x56350fbeb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:52.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.414+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/3987942421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd92f0 0x56350fbeb8d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f1e90024bb0 tx=0x7f1e90005330 comp rx=0 tx=0).stop 2024-08-20T05:16:52.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.414+0000 7f1eaeca2740 1 -- 172.21.15.37:0/3987942421 shutdown_connections 2024-08-20T05:16:52.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.414+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/3987942421 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56350fbf4bf0 0x56350fc62460 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.414+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/3987942421 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56350fbe5280 0x56350fbebe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.414+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/3987942421 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56350fbd92f0 0x56350fbeb8d0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.414+0000 7f1eaeca2740 1 --2- 172.21.15.37:0/3987942421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56350fbd89d0 0x56350fbeb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.414+0000 7f1eaeca2740 1 -- 172.21.15.37:0/3987942421 >> 172.21.15.37:0/3987942421 conn(0x56350fbd6800 msgr2=0x56350fbd58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:52.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.414+0000 7f1e8b400640 0 client.29017 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:52.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.415+0000 7f1eaeca2740 1 -- 172.21.15.37:0/3987942421 shutdown_connections 2024-08-20T05:16:52.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.415+0000 7f1eaeca2740 1 -- 172.21.15.37:0/3987942421 wait complete. 2024-08-20T05:16:52.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.415+0000 7f1eaeca2740 20 client.29017 trim_cache size 0 max 16384 2024-08-20T05:16:52.417 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:16:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-20T05:16:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "92a334cb-cfb0-423a-bb34-ed8dcf3c91c6", 2024-08-20T05:16:52.417 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-20T05:16:52.417 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:16:52.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.416+0000 7f1eac200640 1 -- 172.21.15.37:0/1565539360 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e8c0b3d60 msgr2=0x7f1e8c0b6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:52.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.416+0000 7f1eac200640 1 --2- 172.21.15.37:0/1565539360 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e8c0b3d60 0x7f1e8c0b6220 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4107fa0 tx=0x7f1e90007930 comp rx=0 tx=0).stop 2024-08-20T05:16:52.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.416+0000 7f1eac200640 1 -- 172.21.15.37:0/1565539360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ea4108e40 msgr2=0x7f1ea4117860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:52.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.416+0000 7f1eac200640 1 --2- 172.21.15.37:0/1565539360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ea4108e40 0x7f1ea4117860 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c02ae40 tx=0x7f1e9c032ff0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.416+0000 7f1eac200640 1 -- 172.21.15.37:0/1565539360 shutdown_connections 2024-08-20T05:16:52.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.416+0000 7f1eac200640 1 --2- 172.21.15.37:0/1565539360 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f1e8c0b3d60 0x7f1e8c0b6220 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.416+0000 7f1eac200640 1 --2- 172.21.15.37:0/1565539360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f1ea4108e40 0x7f1ea4117860 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.416+0000 7f1eac200640 1 --2- 172.21.15.37:0/1565539360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ea41084c0 0x7f1ea4112530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.416+0000 7f1eac200640 1 --2- 172.21.15.37:0/1565539360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1ea4102ab0 0x7f1ea4111ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:52.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.416+0000 7f1eac200640 1 -- 172.21.15.37:0/1565539360 >> 172.21.15.37:0/1565539360 conn(0x7f1ea40fe500 msgr2=0x7f1ea41008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:52.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.417+0000 7f1eac200640 1 -- 172.21.15.37:0/1565539360 shutdown_connections 2024-08-20T05:16:52.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:52.417+0000 7f1eac200640 1 -- 172.21.15.37:0/1565539360 wait complete. 2024-08-20T05:16:52.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:52 smithi135 ceph-mon[22342]: scrub queued for path: / 2024-08-20T05:16:52.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:52 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:52.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:52 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:16:52.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:52 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:16:52.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:52 smithi130 ceph-mon[22007]: scrub queued for path: / 2024-08-20T05:16:52.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:52 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:52.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:52 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:16:52.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:52 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:16:53.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:52 smithi037 ceph-mon[17265]: scrub queued for path: / 2024-08-20T05:16:53.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:52 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:53.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:52 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:16:53.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:52 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:16:53.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 835.0 s, 548.2 tps, lat 173.493 ms stddev 234.110 2024-08-20T05:16:53.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:53 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:16:54.079 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:53 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:16:54.079 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:53 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:16:54.079 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:53 smithi135 ceph-mon[22342]: pgmap v840: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 4.4 MiB/s wr, 461 op/s 2024-08-20T05:16:54.080 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:53 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:54.080 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:53 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:54.080 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:53 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:54.080 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:53 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:54.080 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:53 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:54.081 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:53 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:16:54.081 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:53 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:16:54.081 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:53 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:16:54.081 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:53 smithi037 ceph-mon[17265]: pgmap v840: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 4.4 MiB/s wr, 461 op/s 2024-08-20T05:16:54.081 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:53 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:54.081 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:53 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:54.081 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:53 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:54.081 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:53 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:54.081 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:53 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:54.081 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:53 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:16:54.081 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:53 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:16:54.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:53 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:16:54.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:53 smithi130 ceph-mon[22007]: pgmap v840: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 4.4 MiB/s wr, 461 op/s 2024-08-20T05:16:54.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:53 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:54.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:53 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:54.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:53 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:54.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:53 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:54.082 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:53 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:16:54.190 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:16:54.955 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:16:55.801 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:55 smithi037 ceph-mon[17265]: pgmap v841: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 4.8 MiB/s wr, 592 op/s 2024-08-20T05:16:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.799+0000 7ff79f200640 1 -- 172.21.15.37:0/1148085313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a010cc70 msgr2=0x7ff7a010f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.799+0000 7ff79f200640 1 --2- 172.21.15.37:0/1148085313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a010cc70 0x7ff7a010f0d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff790009900 tx=0x7ff79002a440 comp rx=0 tx=0).stop 2024-08-20T05:16:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.800+0000 7ff79f200640 1 -- 172.21.15.37:0/1148085313 shutdown_connections 2024-08-20T05:16:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.800+0000 7ff79f200640 1 --2- 172.21.15.37:0/1148085313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a010cc70 0x7ff7a010f0d0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.800+0000 7ff79f200640 1 --2- 172.21.15.37:0/1148085313 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7a0104130 0x7ff7a010c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.800+0000 7ff79f200640 1 --2- 172.21.15.37:0/1148085313 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7a0103810 0x7ff7a0103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.800+0000 7ff79f200640 1 -- 172.21.15.37:0/1148085313 >> 172.21.15.37:0/1148085313 conn(0x7ff7a00fd2d0 msgr2=0x7ff7a00ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:55.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.804+0000 7ff79f200640 1 -- 172.21.15.37:0/1148085313 shutdown_connections 2024-08-20T05:16:55.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.804+0000 7ff79f200640 1 -- 172.21.15.37:0/1148085313 wait complete. 2024-08-20T05:16:55.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.807+0000 7ff79f200640 1 Processor -- start 2024-08-20T05:16:55.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.807+0000 7ff79f200640 1 -- start start 2024-08-20T05:16:55.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.808+0000 7ff79f200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7a0103810 0x7ff7a0104690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.808+0000 7ff79f200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7a0104130 0x7ff7a0104bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.808+0000 7ff79f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a010cc70 0x7ff7a0105110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.808+0000 7ff79f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a0112a30 con 0x7ff7a010cc70 2024-08-20T05:16:55.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.808+0000 7ff79f200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a01128b0 con 0x7ff7a0103810 2024-08-20T05:16:55.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.808+0000 7ff79f200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a0112bb0 con 0x7ff7a0104130 2024-08-20T05:16:55.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.808+0000 7ff79de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7a0103810 0x7ff7a0104690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:55.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.808+0000 7ff79de00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7a0103810 0x7ff7a0104690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50888/0 (socket says 172.21.15.37:50888) 2024-08-20T05:16:55.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.808+0000 7ff79de00640 1 -- 172.21.15.37:0/1127626545 learned_addr learned my addr 172.21.15.37:0/1127626545 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:55.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.809+0000 7ff79e800640 1 --2- 172.21.15.37:0/1127626545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a010cc70 0x7ff7a0105110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:55.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.809+0000 7ff79de00640 1 -- 172.21.15.37:0/1127626545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7a0104130 msgr2=0x7ff7a0104bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T05:16:55.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.809+0000 7ff79de00640 1 --2- 172.21.15.37:0/1127626545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7a0104130 0x7ff7a0104bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.809+0000 7ff79de00640 1 -- 172.21.15.37:0/1127626545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a010cc70 msgr2=0x7ff7a0105110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:55.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.809+0000 7ff79de00640 1 --2- 172.21.15.37:0/1127626545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a010cc70 0x7ff7a0105110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.809+0000 7ff79de00640 1 -- 172.21.15.37:0/1127626545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a01ab680 con 0x7ff7a0103810 2024-08-20T05:16:55.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.809+0000 7ff79de00640 1 --2- 172.21.15.37:0/1127626545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7a0103810 0x7ff7a0104690 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff79800ba50 tx=0x7ff79800bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:55.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.810+0000 7ff796a00640 1 -- 172.21.15.37:0/1127626545 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff798019070 con 0x7ff7a0103810 2024-08-20T05:16:55.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.810+0000 7ff796a00640 1 -- 172.21.15.37:0/1127626545 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff79800cc10 con 0x7ff7a0103810 2024-08-20T05:16:55.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.810+0000 7ff796a00640 1 -- 172.21.15.37:0/1127626545 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7980075f0 con 0x7ff7a0103810 2024-08-20T05:16:55.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.810+0000 7ff79f200640 1 -- 172.21.15.37:0/1127626545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a01ab970 con 0x7ff7a0103810 2024-08-20T05:16:55.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.810+0000 7ff79f200640 1 -- 172.21.15.37:0/1127626545 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a01abee0 con 0x7ff7a0103810 2024-08-20T05:16:55.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.823+0000 7ff7a7a08740 1 Processor -- start 2024-08-20T05:16:55.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.823+0000 7ff796a00640 1 -- 172.21.15.37:0/1127626545 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff79801c070 con 0x7ff7a0103810 2024-08-20T05:16:55.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.824+0000 7ff7a7a08740 1 -- start start 2024-08-20T05:16:55.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.824+0000 7ff7a7a08740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546d9aa80 0x565546d9ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.824+0000 7ff7a7a08740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9b3a0 0x565546da6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.824+0000 7ff79e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546d9aa80 0x565546d9ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:55.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.825+0000 7ff79e800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546d9aa80 0x565546d9ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50900/0 (socket says 172.21.15.37:50900) 2024-08-20T05:16:55.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.825+0000 7ff79e800640 1 -- 172.21.15.37:0/2917035951 learned_addr learned my addr 172.21.15.37:0/2917035951 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:55.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.825+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/2917035951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546da7330 0x565546da9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.825+0000 7ff7a7a08740 1 -- 172.21.15.37:0/2917035951 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x565546d10a60 con 0x565546da7330 2024-08-20T05:16:55.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.825+0000 7ff7a7a08740 1 -- 172.21.15.37:0/2917035951 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x565546cfff60 con 0x565546d9aa80 2024-08-20T05:16:55.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.825+0000 7ff7a7a08740 1 -- 172.21.15.37:0/2917035951 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x565546d03fa0 con 0x565546d9b3a0 2024-08-20T05:16:55.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.825+0000 7ff79d400640 1 --2- 172.21.15.37:0/2917035951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546da7330 0x565546da9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:55.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.825+0000 7ff79e800640 1 -- 172.21.15.37:0/2917035951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9b3a0 msgr2=0x565546da6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:55.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.825+0000 7ff79de00640 1 --2- 172.21.15.37:0/2917035951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9b3a0 0x565546da6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:55.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.825+0000 7ff79e800640 1 --2- 172.21.15.37:0/2917035951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9b3a0 0x565546da6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.825+0000 7ff79e800640 1 -- 172.21.15.37:0/2917035951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546da7330 msgr2=0x565546da9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.825+0000 7ff79e800640 1 --2- 172.21.15.37:0/2917035951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546da7330 0x565546da9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.825+0000 7ff79e800640 1 -- 172.21.15.37:0/2917035951 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565546ca63e0 con 0x565546d9aa80 2024-08-20T05:16:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.826+0000 7ff79de00640 1 --2- 172.21.15.37:0/2917035951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9b3a0 0x565546da6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:16:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.826+0000 7ff79e800640 1 --2- 172.21.15.37:0/2917035951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546d9aa80 0x565546d9ae60 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff790006010 tx=0x7ff7900046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7d9db6e8046b966 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.826+0000 7ff796a00640 1 --2- 172.21.15.37:0/1127626545 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7840b3cf0 0x7ff7840b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.826+0000 7ff796a00640 1 -- 172.21.15.37:0/1127626545 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff7980e3600 con 0x7ff7a0103810 2024-08-20T05:16:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.827+0000 7ff78b400640 1 -- 172.21.15.37:0/2917035951 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff790040070 con 0x565546d9aa80 2024-08-20T05:16:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.827+0000 7ff78b400640 1 -- 172.21.15.37:0/2917035951 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff790045910 con 0x565546d9aa80 2024-08-20T05:16:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.827+0000 7ff78b400640 1 -- 172.21.15.37:0/2917035951 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff790031940 con 0x565546d9aa80 2024-08-20T05:16:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.828+0000 7ff7a7a08740 1 -- 172.21.15.37:0/2917035951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546d9aa80 msgr2=0x565546d9ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:55.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.828+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/2917035951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546d9aa80 0x565546d9ae60 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff790006010 tx=0x7ff7900046c0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.829+0000 7ff7a7a08740 1 -- 172.21.15.37:0/2917035951 shutdown_connections 2024-08-20T05:16:55.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.829+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/2917035951 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546da7330 0x565546da9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.829+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/2917035951 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9b3a0 0x565546da6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.829+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/2917035951 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546d9aa80 0x565546d9ae60 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.829+0000 7ff7a7a08740 1 -- 172.21.15.37:0/2917035951 >> 172.21.15.37:0/2917035951 conn(0x565546d988b0 msgr2=0x565546d99a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:55.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.829+0000 7ff79de00640 1 --2- 172.21.15.37:0/1127626545 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7840b3cf0 0x7ff7840b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:55.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.829+0000 7ff7a7a08740 1 -- 172.21.15.37:0/2917035951 shutdown_connections 2024-08-20T05:16:55.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.830+0000 7ff7a7a08740 1 -- 172.21.15.37:0/2917035951 wait complete. 2024-08-20T05:16:55.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.830+0000 7ff7a7a08740 1 -- start start 2024-08-20T05:16:55.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.831+0000 7ff7a7a08740 1 Processor -- start 2024-08-20T05:16:55.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.832+0000 7ff79de00640 1 --2- 172.21.15.37:0/1127626545 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7840b3cf0 0x7ff7840b61b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff7980e10d0 tx=0x7ff798009a60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:55.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.834+0000 7ff7a7a08740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546d9aa80 0x565546da6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.834+0000 7ff7a7a08740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9b3a0 0x565546da3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.834+0000 7ff7a7a08740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546da7330 0x565546da4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.835+0000 7ff7a7a08740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x565546b62700 con 0x565546d9aa80 2024-08-20T05:16:55.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.835+0000 7ff7a7a08740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x565546c9b250 con 0x565546da7330 2024-08-20T05:16:55.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.835+0000 7ff7a7a08740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x565546da9e90 con 0x565546d9b3a0 2024-08-20T05:16:55.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.835+0000 7ff7a7a08740 10 client.0 _ll_register_callbacks cb 0x565546cfa180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:55.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.837+0000 7ff79d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9b3a0 0x565546da3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:55.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.839+0000 7ff79e800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546d9aa80 0x565546da6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:55.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.840+0000 7ff79d400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9b3a0 0x565546da3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:39654/0 (socket says 172.21.15.37:39654) 2024-08-20T05:16:55.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.840+0000 7ff79d400640 1 -- 172.21.15.37:0/115528041 learned_addr learned my addr 172.21.15.37:0/115528041 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:55.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.840+0000 7ff79e800640 1 --2- 172.21.15.37:0/115528041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546da7330 0x565546da4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:55.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.840+0000 7ff79d400640 1 -- 172.21.15.37:0/115528041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546da7330 msgr2=0x565546da4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:55.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.840+0000 7ff79d400640 1 --2- 172.21.15.37:0/115528041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546da7330 0x565546da4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.840+0000 7ff79d400640 1 -- 172.21.15.37:0/115528041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546d9aa80 msgr2=0x565546da6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:55.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.840+0000 7ff79d400640 1 --2- 172.21.15.37:0/115528041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546d9aa80 0x565546da6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.840+0000 7ff79d400640 1 -- 172.21.15.37:0/115528041 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565546a5f650 con 0x565546d9b3a0 2024-08-20T05:16:55.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.841+0000 7ff79e800640 1 --2- 172.21.15.37:0/115528041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546d9aa80 0x565546da6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:16:55.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.841+0000 7ff79d400640 1 --2- 172.21.15.37:0/115528041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9b3a0 0x565546da3ed0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff78c001d90 tx=0x7ff78c00e530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf510314420132dc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:55.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.841+0000 7ff77fe00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:16:55.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.842+0000 7ff77fe00640 1 -- 172.21.15.37:0/115528041 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78c006960 con 0x565546d9b3a0 2024-08-20T05:16:55.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.842+0000 7ff77fe00640 1 -- 172.21.15.37:0/115528041 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff78c010040 con 0x565546d9b3a0 2024-08-20T05:16:55.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.842+0000 7ff7a7a08740 1 -- 172.21.15.37:0/115528041 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff790045910 con 0x565546d9b3a0 2024-08-20T05:16:55.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.843+0000 7ff77fe00640 1 -- 172.21.15.37:0/115528041 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff78c006b00 con 0x565546d9b3a0 2024-08-20T05:16:55.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.843+0000 7ff7a7a08740 10 client.29020 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:55.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.843+0000 7ff7a7a08740 1 -- 172.21.15.37:0/115528041 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x565546db5650 con 0x565546d9b3a0 2024-08-20T05:16:55.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.847+0000 7ff77fe00640 1 -- 172.21.15.37:0/115528041 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff790045910 con 0x565546d9b3a0 2024-08-20T05:16:55.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.847+0000 7ff77fe00640 1 -- 172.21.15.37:0/115528041 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7ff78c013610 con 0x565546d9b3a0 2024-08-20T05:16:55.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.847+0000 7ff7a7a08740 10 client.29020 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:55.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.847+0000 7ff7a7a08740 10 client.29020 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:16:55.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.847+0000 7ff7a7a08740 20 client.29020 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:55.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.847+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/115528041 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x565546db6b10 0x565546db8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.847+0000 7ff7a7a08740 4 client.29020 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:16:55.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.847+0000 7ff7a7a08740 1 -- 172.21.15.37:0/115528041 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565546d129b0 con 0x565546db6b10 2024-08-20T05:16:55.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.848+0000 7ff79e800640 1 --2- 172.21.15.37:0/115528041 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x565546db6b10 0x565546db8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:55.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.849+0000 7ff79e800640 1 --2- 172.21.15.37:0/115528041 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x565546db6b10 0x565546db8fb0 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6390c725ddfff4c server_cookie=222875b013ebbb36 in_seq=0 out_seq=0 2024-08-20T05:16:55.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.849+0000 7ff77fe00640 10 client.29020 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:55.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.850+0000 7ff77fe00640 1 -- 172.21.15.37:0/115528041 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565546d129b0 con 0x565546db6b10 2024-08-20T05:16:55.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.850+0000 7ff77fe00640 10 client.29020 handle_command_reply: tid=0 2024-08-20T05:16:55.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.850+0000 7ff7a7a08740 1 client.29020 shutdown 2024-08-20T05:16:55.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.851+0000 7ff7a7a08740 1 -- 172.21.15.37:0/115528041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9b3a0 msgr2=0x565546da3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:55.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.851+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/115528041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9b3a0 0x565546da3ed0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff78c001d90 tx=0x7ff78c00e530 comp rx=0 tx=0).stop 2024-08-20T05:16:55.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.851+0000 7ff7a7a08740 1 -- 172.21.15.37:0/115528041 shutdown_connections 2024-08-20T05:16:55.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.851+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/115528041 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x565546db6b10 0x565546db8fb0 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.851+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/115528041 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546da7330 0x565546da4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.851+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/115528041 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9b3a0 0x565546da3ed0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.851+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/115528041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546d9aa80 0x565546da6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.851+0000 7ff7a7a08740 1 -- 172.21.15.37:0/115528041 >> 172.21.15.37:0/115528041 conn(0x565546d988b0 msgr2=0x565546d9e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:55.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.851+0000 7ff77fe00640 0 client.29020 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:55.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.852+0000 7ff7a7a08740 1 -- 172.21.15.37:0/115528041 shutdown_connections 2024-08-20T05:16:55.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.852+0000 7ff7a7a08740 1 -- 172.21.15.37:0/115528041 wait complete. 2024-08-20T05:16:55.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.852+0000 7ff7a7a08740 20 client.29020 trim_cache size 0 max 16384 2024-08-20T05:16:55.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:55 smithi135 ceph-mon[22342]: pgmap v841: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 4.8 MiB/s wr, 592 op/s 2024-08-20T05:16:55.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.901+0000 7ff7a7a08740 1 Processor -- start 2024-08-20T05:16:55.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.902+0000 7ff7a7a08740 1 -- start start 2024-08-20T05:16:55.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.902+0000 7ff7a7a08740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546d9aa80 0x565546da3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.902+0000 7ff7a7a08740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546da7330 0x565546da1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.902+0000 7ff7a7a08740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546db3140 0x565546da1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.902+0000 7ff7a7a08740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a01ad5d0 con 0x565546da7330 2024-08-20T05:16:55.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.902+0000 7ff7a7a08740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a01af170 con 0x565546d9aa80 2024-08-20T05:16:55.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.902+0000 7ff7a7a08740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a01adca0 con 0x565546db3140 2024-08-20T05:16:55.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.903+0000 7ff79e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546db3140 0x565546da1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:55.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.903+0000 7ff79e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546db3140 0x565546da1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:39660/0 (socket says 172.21.15.37:39660) 2024-08-20T05:16:55.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.903+0000 7ff79e800640 1 -- 172.21.15.37:0/2429137653 learned_addr learned my addr 172.21.15.37:0/2429137653 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:55.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.903+0000 7ff79e800640 1 --2- 172.21.15.37:0/2429137653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546d9aa80 0x565546da3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:55.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.904+0000 7ff79e800640 1 -- 172.21.15.37:0/2429137653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546d9aa80 msgr2=0x565546da3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:55.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.904+0000 7ff79e800640 1 --2- 172.21.15.37:0/2429137653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546d9aa80 0x565546da3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.904+0000 7ff79e800640 1 -- 172.21.15.37:0/2429137653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546da7330 msgr2=0x565546da1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:55.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.904+0000 7ff79e800640 1 --2- 172.21.15.37:0/2429137653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546da7330 0x565546da1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.904+0000 7ff79e800640 1 -- 172.21.15.37:0/2429137653 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565546d99330 con 0x565546db3140 2024-08-20T05:16:55.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.905+0000 7ff79e800640 1 --2- 172.21.15.37:0/2429137653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546db3140 0x565546da1640 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff790003750 tx=0x7ff79002a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7626af9df34aa28 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:55.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.906+0000 7ff78aa00640 1 -- 172.21.15.37:0/2429137653 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff790057040 con 0x565546db3140 2024-08-20T05:16:55.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.906+0000 7ff78aa00640 1 -- 172.21.15.37:0/2429137653 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff790031ba0 con 0x565546db3140 2024-08-20T05:16:55.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.906+0000 7ff78aa00640 1 -- 172.21.15.37:0/2429137653 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff790057040 con 0x565546db3140 2024-08-20T05:16:55.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.907+0000 7ff7a7a08740 1 -- 172.21.15.37:0/2429137653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546db3140 msgr2=0x565546da1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:55.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.907+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/2429137653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546db3140 0x565546da1640 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff790003750 tx=0x7ff79002a440 comp rx=0 tx=0).stop 2024-08-20T05:16:55.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.908+0000 7ff7a7a08740 1 -- 172.21.15.37:0/2429137653 shutdown_connections 2024-08-20T05:16:55.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.908+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/2429137653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546db3140 0x565546da1640 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.908+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/2429137653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546da7330 0x565546da1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.909+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/2429137653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546d9aa80 0x565546da3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.909+0000 7ff7a7a08740 1 -- 172.21.15.37:0/2429137653 >> 172.21.15.37:0/2429137653 conn(0x565546d988b0 msgr2=0x565546d9f550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:55.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.909+0000 7ff7a7a08740 1 -- 172.21.15.37:0/2429137653 shutdown_connections 2024-08-20T05:16:55.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.909+0000 7ff7a7a08740 1 -- 172.21.15.37:0/2429137653 wait complete. 2024-08-20T05:16:55.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.910+0000 7ff7a7a08740 1 -- start start 2024-08-20T05:16:55.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.910+0000 7ff7a7a08740 1 Processor -- start 2024-08-20T05:16:55.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.913+0000 7ff7a7a08740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9aa80 0x565546dbaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.913+0000 7ff79e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9aa80 0x565546dbaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:55.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.913+0000 7ff79e800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9aa80 0x565546dbaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:39666/0 (socket says 172.21.15.37:39666) 2024-08-20T05:16:55.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.913+0000 7ff79e800640 1 -- 172.21.15.37:0/896617135 learned_addr learned my addr 172.21.15.37:0/896617135 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:16:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.914+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/896617135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546da7330 0x565546dbb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.915+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/896617135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546db3140 0x565546dbb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.915+0000 7ff7a7a08740 1 -- 172.21.15.37:0/896617135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a01aeaa0 con 0x565546db3140 2024-08-20T05:16:55.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.915+0000 7ff7a7a08740 1 -- 172.21.15.37:0/896617135 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a01ae370 con 0x565546da7330 2024-08-20T05:16:55.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.915+0000 7ff7a7a08740 1 -- 172.21.15.37:0/896617135 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a0105990 con 0x565546d9aa80 2024-08-20T05:16:55.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.915+0000 7ff79d400640 1 --2- 172.21.15.37:0/896617135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546da7330 0x565546dbb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:55.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.916+0000 7ff79e800640 1 --2- 172.21.15.37:0/896617135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546db3140 0x565546dbb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.916+0000 7ff79e800640 1 -- 172.21.15.37:0/896617135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546da7330 msgr2=0x565546dbb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.916+0000 7ff7a7a08740 10 client.0 _ll_register_callbacks cb 0x7ff7a006b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:16:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.917+0000 7ff79e800640 1 --2- 172.21.15.37:0/896617135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546da7330 0x565546dbb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.917+0000 7ff79e800640 1 -- 172.21.15.37:0/896617135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546db3140 msgr2=0x565546dbb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:16:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.917+0000 7ff79e800640 1 --2- 172.21.15.37:0/896617135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546db3140 0x565546dbb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.917+0000 7ff79e800640 1 -- 172.21.15.37:0/896617135 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565546e21060 con 0x565546d9aa80 2024-08-20T05:16:55.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.918+0000 7ff79d400640 1 --2- 172.21.15.37:0/896617135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546da7330 0x565546dbb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:16:55.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.918+0000 7ff7a7a08740 1 -- 172.21.15.37:0/896617135 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff790031ba0 con 0x565546d9aa80 2024-08-20T05:16:55.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.918+0000 7ff77fe00640 10 client.29026 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:16:55.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.918+0000 7ff79e800640 1 --2- 172.21.15.37:0/896617135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9aa80 0x565546dbaf10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff7900314f0 tx=0x7ff79002b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dce76e42485559ce server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:16:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.922+0000 7ff77fe00640 1 -- 172.21.15.37:0/896617135 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff790000e60 con 0x565546d9aa80 2024-08-20T05:16:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.922+0000 7ff77fe00640 1 -- 172.21.15.37:0/896617135 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff7900525b0 con 0x565546d9aa80 2024-08-20T05:16:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.922+0000 7ff77fe00640 1 -- 172.21.15.37:0/896617135 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff790040040 con 0x565546d9aa80 2024-08-20T05:16:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.923+0000 7ff7a7a08740 10 client.29026 fetch_fsmap learned FSMap version 50 2024-08-20T05:16:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.923+0000 7ff7a7a08740 1 -- 172.21.15.37:0/896617135 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({fsmap=50}) -- 0x565546e222b0 con 0x565546d9aa80 2024-08-20T05:16:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.923+0000 7ff77fe00640 1 -- 172.21.15.37:0/896617135 <== mon.1 v2:172.21.15.135:3300/0 4 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7ff790052830 con 0x565546d9aa80 2024-08-20T05:16:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.923+0000 7ff7a7a08740 10 client.29026 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:16:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.924+0000 7ff7a7a08740 10 client.29026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:16:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.924+0000 7ff7a7a08740 20 client.29026 populate_metadata read hostname 'smithi037' 2024-08-20T05:16:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.924+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/896617135 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x565546e22480 0x565546e24870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:16:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.924+0000 7ff7a7a08740 4 client.29026 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:16:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.924+0000 7ff7a7a08740 1 -- 172.21.15.37:0/896617135 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x565546d0e450 con 0x565546e22480 2024-08-20T05:16:55.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.924+0000 7ff79d400640 1 --2- 172.21.15.37:0/896617135 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x565546e22480 0x565546e24870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:16:55.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.925+0000 7ff79d400640 1 --2- 172.21.15.37:0/896617135 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x565546e22480 0x565546e24870 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0d2e03cc5b76f53 server_cookie=3eb50b44c51a5491 in_seq=0 out_seq=0 2024-08-20T05:16:55.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.925+0000 7ff77fe00640 10 client.29026 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:55.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.926+0000 7ff77fe00640 1 -- 172.21.15.37:0/896617135 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x565546d0e450 con 0x565546e22480 2024-08-20T05:16:55.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.926+0000 7ff77fe00640 10 client.29026 handle_command_reply: tid=0 2024-08-20T05:16:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.926+0000 7ff7a7a08740 1 client.29026 shutdown 2024-08-20T05:16:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.927+0000 7ff7a7a08740 1 -- 172.21.15.37:0/896617135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9aa80 msgr2=0x565546dbaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.927+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/896617135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9aa80 0x565546dbaf10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff7900314f0 tx=0x7ff79002b000 comp rx=0 tx=0).stop 2024-08-20T05:16:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.927+0000 7ff7a7a08740 1 -- 172.21.15.37:0/896617135 shutdown_connections 2024-08-20T05:16:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.927+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/896617135 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x565546e22480 0x565546e24870 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.927+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/896617135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565546db3140 0x565546dbb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.927+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/896617135 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x565546da7330 0x565546dbb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.927+0000 7ff7a7a08740 1 --2- 172.21.15.37:0/896617135 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x565546d9aa80 0x565546dbaf10 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.927+0000 7ff7a7a08740 1 -- 172.21.15.37:0/896617135 >> 172.21.15.37:0/896617135 conn(0x565546d988b0 msgr2=0x565546da5500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.927+0000 7ff77fe00640 0 client.29026 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:16:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.927+0000 7ff7a7a08740 1 -- 172.21.15.37:0/896617135 shutdown_connections 2024-08-20T05:16:55.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.929+0000 7ff7a7a08740 1 -- 172.21.15.37:0/896617135 wait complete. 2024-08-20T05:16:55.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.929+0000 7ff7a7a08740 20 client.29026 trim_cache size 0 max 16384 2024-08-20T05:16:55.930 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:16:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T05:16:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-20T05:16:55.930 INFO:teuthology.orchestra.run.smithi037.stdout: "92a334cb-cfb0-423a-bb34-ed8dcf3c91c6": { 2024-08-20T05:16:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-20T05:16:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "92a334cb-cfb0-423a-bb34-ed8dcf3c91c6", 2024-08-20T05:16:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-20T05:16:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:16:55.931 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:16:55.931 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:16:55.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.932+0000 7ff79f200640 1 -- 172.21.15.37:0/1127626545 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7840b3cf0 msgr2=0x7ff7840b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:55.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.932+0000 7ff79f200640 1 --2- 172.21.15.37:0/1127626545 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7840b3cf0 0x7ff7840b61b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff7980e10d0 tx=0x7ff798009a60 comp rx=0 tx=0).stop 2024-08-20T05:16:55.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.932+0000 7ff79f200640 1 -- 172.21.15.37:0/1127626545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7a0103810 msgr2=0x7ff7a0104690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:16:55.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.932+0000 7ff79f200640 1 --2- 172.21.15.37:0/1127626545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7a0103810 0x7ff7a0104690 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff79800ba50 tx=0x7ff79800bf10 comp rx=0 tx=0).stop 2024-08-20T05:16:55.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.932+0000 7ff79f200640 1 -- 172.21.15.37:0/1127626545 shutdown_connections 2024-08-20T05:16:55.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.932+0000 7ff79f200640 1 --2- 172.21.15.37:0/1127626545 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7840b3cf0 0x7ff7840b61b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.932+0000 7ff79f200640 1 --2- 172.21.15.37:0/1127626545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7a010cc70 0x7ff7a0105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.932+0000 7ff79f200640 1 --2- 172.21.15.37:0/1127626545 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff7a0104130 0x7ff7a0104bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.932+0000 7ff79f200640 1 --2- 172.21.15.37:0/1127626545 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff7a0103810 0x7ff7a0104690 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:16:55.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.932+0000 7ff79f200640 1 -- 172.21.15.37:0/1127626545 >> 172.21.15.37:0/1127626545 conn(0x7ff7a00fd2d0 msgr2=0x7ff7a010ee90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:16:55.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.932+0000 7ff79f200640 1 -- 172.21.15.37:0/1127626545 shutdown_connections 2024-08-20T05:16:55.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:16:55.932+0000 7ff79f200640 1 -- 172.21.15.37:0/1127626545 wait complete. 2024-08-20T05:16:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:55 smithi130 ceph-mon[22007]: pgmap v841: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 4.8 MiB/s wr, 592 op/s 2024-08-20T05:16:57.503 INFO:tasks.cephfs.filesystem:scrub status for tag:92a334cb-cfb0-423a-bb34-ed8dcf3c91c6 - {'path': '/', 'tag': '92a334cb-cfb0-423a-bb34-ed8dcf3c91c6', 'options': 'recursive,force'} 2024-08-20T05:16:57.768 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:57 smithi037 ceph-mon[17265]: pgmap v842: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 4.6 MiB/s wr, 575 op/s 2024-08-20T05:16:57.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:57 smithi135 ceph-mon[22342]: pgmap v842: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 4.6 MiB/s wr, 575 op/s 2024-08-20T05:16:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:57 smithi130 ceph-mon[22007]: pgmap v842: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 4.6 MiB/s wr, 575 op/s 2024-08-20T05:16:58.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 840.0 s, 497.0 tps, lat 203.078 ms stddev 268.529 2024-08-20T05:16:59.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:16:59 smithi135 ceph-mon[22342]: pgmap v843: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 5.3 MiB/s wr, 672 op/s 2024-08-20T05:16:59.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:16:59 smithi130 ceph-mon[22007]: pgmap v843: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 5.3 MiB/s wr, 672 op/s 2024-08-20T05:17:00.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:16:59 smithi037 ceph-mon[17265]: pgmap v843: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 5.3 MiB/s wr, 672 op/s 2024-08-20T05:17:00.747 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.0 2024-08-20T05:17:00.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:17:01.435 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:17:01.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:01 smithi135 ceph-mon[22342]: pgmap v844: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 5.1 MiB/s wr, 656 op/s 2024-08-20T05:17:01.893 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:01 smithi037 ceph-mon[17265]: pgmap v844: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 5.1 MiB/s wr, 656 op/s 2024-08-20T05:17:01.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:01 smithi130 ceph-mon[22007]: pgmap v844: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 5.1 MiB/s wr, 656 op/s 2024-08-20T05:17:02.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.338+0000 7f330e200640 1 -- 172.21.15.37:0/3102129302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330811bdd0 msgr2=0x7f330811e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:02.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.339+0000 7f330e200640 1 --2- 172.21.15.37:0/3102129302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330811bdd0 0x7f330811e1c0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3300009be0 tx=0x7f330002a790 comp rx=0 tx=0).stop 2024-08-20T05:17:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.339+0000 7f330e200640 1 -- 172.21.15.37:0/3102129302 shutdown_connections 2024-08-20T05:17:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.339+0000 7f330e200640 1 --2- 172.21.15.37:0/3102129302 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330811bdd0 0x7f330811e1c0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.339+0000 7f330e200640 1 --2- 172.21.15.37:0/3102129302 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f330810a260 0x7f330810a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.339+0000 7f330e200640 1 --2- 172.21.15.37:0/3102129302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3308109e80 0x7f3308110ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.339+0000 7f330e200640 1 -- 172.21.15.37:0/3102129302 >> 172.21.15.37:0/3102129302 conn(0x7f330806dcc0 msgr2=0x7f330806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.340+0000 7f330e200640 1 -- 172.21.15.37:0/3102129302 shutdown_connections 2024-08-20T05:17:02.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.340+0000 7f330e200640 1 -- 172.21.15.37:0/3102129302 wait complete. 2024-08-20T05:17:02.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.341+0000 7f330e200640 1 Processor -- start 2024-08-20T05:17:02.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.341+0000 7f330e200640 1 -- start start 2024-08-20T05:17:02.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.342+0000 7f330e200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3308109e80 0x7f33081a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:02.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.343+0000 7f330e200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330810a260 0x7f33081a8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:02.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.343+0000 7f330e200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f330811bdd0 0x7f33081ad730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:02.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.343+0000 7f3307400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3308109e80 0x7f33081a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:02.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.344+0000 7f3307e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f330811bdd0 0x7f33081ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:02.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.344+0000 7f3307e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f330811bdd0 0x7f33081ad730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50966/0 (socket says 172.21.15.37:50966) 2024-08-20T05:17:02.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.344+0000 7f3307e00640 1 -- 172.21.15.37:0/2469367874 learned_addr learned my addr 172.21.15.37:0/2469367874 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:02.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.344+0000 7f330e200640 1 -- 172.21.15.37:0/2469367874 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f33081218c0 con 0x7f3308109e80 2024-08-20T05:17:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.344+0000 7f3306a00640 1 --2- 172.21.15.37:0/2469367874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330810a260 0x7f33081a8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.345+0000 7f330e200640 1 -- 172.21.15.37:0/2469367874 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3308121740 con 0x7f330811bdd0 2024-08-20T05:17:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.345+0000 7f330e200640 1 -- 172.21.15.37:0/2469367874 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3308121a40 con 0x7f330810a260 2024-08-20T05:17:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.345+0000 7f3307e00640 1 -- 172.21.15.37:0/2469367874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330810a260 msgr2=0x7f33081a8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.345+0000 7f3307e00640 1 --2- 172.21.15.37:0/2469367874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330810a260 0x7f33081a8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.345+0000 7f3307e00640 1 -- 172.21.15.37:0/2469367874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3308109e80 msgr2=0x7f33081a7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:02.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.345+0000 7f3307e00640 1 --2- 172.21.15.37:0/2469367874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3308109e80 0x7f33081a7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:02.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.345+0000 7f3307e00640 1 -- 172.21.15.37:0/2469367874 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33081adf00 con 0x7f330811bdd0 2024-08-20T05:17:02.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.346+0000 7f3307e00640 1 --2- 172.21.15.37:0/2469367874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f330811bdd0 0x7f33081ad730 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3300034040 tx=0x7f3300003ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:02.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.347+0000 7f32ffe00640 1 -- 172.21.15.37:0/2469367874 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300040020 con 0x7f330811bdd0 2024-08-20T05:17:02.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.348+0000 7f32ffe00640 1 -- 172.21.15.37:0/2469367874 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3300030970 con 0x7f330811bdd0 2024-08-20T05:17:02.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.348+0000 7f330e200640 1 -- 172.21.15.37:0/2469367874 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33081ae190 con 0x7f330811bdd0 2024-08-20T05:17:02.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.348+0000 7f330e200640 1 -- 172.21.15.37:0/2469367874 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33081b48b0 con 0x7f330811bdd0 2024-08-20T05:17:02.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.348+0000 7f32ffe00640 1 -- 172.21.15.37:0/2469367874 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3300036040 con 0x7f330811bdd0 2024-08-20T05:17:02.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.350+0000 7f330e200640 1 -- 172.21.15.37:0/2469367874 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e8005290 con 0x7f330811bdd0 2024-08-20T05:17:02.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.354+0000 7f32ffe00640 1 -- 172.21.15.37:0/2469367874 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3300043020 con 0x7f330811bdd0 2024-08-20T05:17:02.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.362+0000 7f32ffe00640 1 --2- 172.21.15.37:0/2469367874 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32ec0b3de0 0x7f32ec0b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:02.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.362+0000 7f32ffe00640 1 -- 172.21.15.37:0/2469367874 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f33001052d0 con 0x7f330811bdd0 2024-08-20T05:17:02.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.363+0000 7f32ffe00640 1 -- 172.21.15.37:0/2469367874 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f330004a020 con 0x7f330811bdd0 2024-08-20T05:17:02.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.364+0000 7f3307400640 1 --2- 172.21.15.37:0/2469367874 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32ec0b3de0 0x7f32ec0b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:02.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.366+0000 7f3307400640 1 --2- 172.21.15.37:0/2469367874 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32ec0b3de0 0x7f32ec0b62a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f32f8005fd0 tx=0x7f32f8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:02.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.774+0000 7f330e200640 1 -- 172.21.15.37:0/2469367874 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32e8005580 con 0x7f330811bdd0 2024-08-20T05:17:02.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.775+0000 7f32ffe00640 1 -- 172.21.15.37:0/2469367874 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11983 (secure 0 0 0) 0x7f33000cc5a0 con 0x7f330811bdd0 2024-08-20T05:17:02.778 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:17:02.778 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 50 2024-08-20T05:17:02.778 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":50,"btime":"2024-08-20T05:15:39:521784+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:15:39.110643+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:17:02.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.778+0000 7f330e200640 1 -- 172.21.15.37:0/2469367874 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32ec0b3de0 msgr2=0x7f32ec0b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:02.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.778+0000 7f330e200640 1 --2- 172.21.15.37:0/2469367874 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32ec0b3de0 0x7f32ec0b62a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f32f8005fd0 tx=0x7f32f8005850 comp rx=0 tx=0).stop 2024-08-20T05:17:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.778+0000 7f330e200640 1 -- 172.21.15.37:0/2469367874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f330811bdd0 msgr2=0x7f33081ad730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.778+0000 7f330e200640 1 --2- 172.21.15.37:0/2469367874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f330811bdd0 0x7f33081ad730 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3300034040 tx=0x7f3300003ce0 comp rx=0 tx=0).stop 2024-08-20T05:17:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.778+0000 7f330e200640 1 -- 172.21.15.37:0/2469367874 shutdown_connections 2024-08-20T05:17:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.778+0000 7f330e200640 1 --2- 172.21.15.37:0/2469367874 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f32ec0b3de0 0x7f32ec0b62a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.778+0000 7f330e200640 1 --2- 172.21.15.37:0/2469367874 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f330811bdd0 0x7f33081ad730 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.778+0000 7f330e200640 1 --2- 172.21.15.37:0/2469367874 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f330810a260 0x7f33081a8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.778+0000 7f330e200640 1 --2- 172.21.15.37:0/2469367874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3308109e80 0x7f33081a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.778+0000 7f330e200640 1 -- 172.21.15.37:0/2469367874 >> 172.21.15.37:0/2469367874 conn(0x7f330806dcc0 msgr2=0x7f330811c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.779+0000 7f330e200640 1 -- 172.21.15.37:0/2469367874 shutdown_connections 2024-08-20T05:17:02.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:02.779+0000 7f330e200640 1 -- 172.21.15.37:0/2469367874 wait complete. 2024-08-20T05:17:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 845.0 s, 532.1 tps, lat 190.345 ms stddev 207.530 2024-08-20T05:17:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.359+0000 7f50e1e00640 1 -- 172.21.15.37:0/3744302251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50dc104170 msgr2=0x7f50dc10aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.359+0000 7f50e1e00640 1 --2- 172.21.15.37:0/3744302251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50dc104170 0x7f50dc10aaf0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009cd0 tx=0x7f50d402a8e0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.359+0000 7f50e1e00640 1 -- 172.21.15.37:0/3744302251 shutdown_connections 2024-08-20T05:17:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.359+0000 7f50e1e00640 1 --2- 172.21.15.37:0/3744302251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50dc104170 0x7f50dc10aaf0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.359+0000 7f50e1e00640 1 --2- 172.21.15.37:0/3744302251 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50dc1037b0 0x7f50dc103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.359+0000 7f50e1e00640 1 --2- 172.21.15.37:0/3744302251 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50dc102660 0x7f50dc102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.359+0000 7f50e1e00640 1 -- 172.21.15.37:0/3744302251 >> 172.21.15.37:0/3744302251 conn(0x7f50dc0fdf20 msgr2=0x7f50dc100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.359+0000 7f50e1e00640 1 -- 172.21.15.37:0/3744302251 shutdown_connections 2024-08-20T05:17:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.359+0000 7f50e1e00640 1 -- 172.21.15.37:0/3744302251 wait complete. 2024-08-20T05:17:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.360+0000 7f50e1e00640 1 Processor -- start 2024-08-20T05:17:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.360+0000 7f50e1e00640 1 -- start start 2024-08-20T05:17:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.360+0000 7f50e1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50dc102660 0x7f50dc198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.360+0000 7f50e1e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50dc1037b0 0x7f50dc199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.360+0000 7f50e1e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50dc104170 0x7f50dc199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.361+0000 7f50e1e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc10e320 con 0x7f50dc102660 2024-08-20T05:17:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.361+0000 7f50e1e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc10e1a0 con 0x7f50dc1037b0 2024-08-20T05:17:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.361+0000 7f50e1e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc10e4a0 con 0x7f50dc104170 2024-08-20T05:17:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.361+0000 7f50daa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50dc102660 0x7f50dc198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.361+0000 7f50daa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50dc102660 0x7f50dc198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45624/0 (socket says 172.21.15.37:45624) 2024-08-20T05:17:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.361+0000 7f50daa00640 1 -- 172.21.15.37:0/3640369856 learned_addr learned my addr 172.21.15.37:0/3640369856 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.361+0000 7f50da000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50dc1037b0 0x7f50dc199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.361+0000 7f50db400640 1 --2- 172.21.15.37:0/3640369856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50dc104170 0x7f50dc199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.361+0000 7f50daa00640 1 -- 172.21.15.37:0/3640369856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50dc104170 msgr2=0x7f50dc199ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.361+0000 7f50daa00640 1 --2- 172.21.15.37:0/3640369856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50dc104170 0x7f50dc199ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.361+0000 7f50daa00640 1 -- 172.21.15.37:0/3640369856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50dc1037b0 msgr2=0x7f50dc199070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.361+0000 7f50daa00640 1 --2- 172.21.15.37:0/3640369856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50dc1037b0 0x7f50dc199070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.361+0000 7f50daa00640 1 -- 172.21.15.37:0/3640369856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50dc19a560 con 0x7f50dc102660 2024-08-20T05:17:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.361+0000 7f50da000640 1 --2- 172.21.15.37:0/3640369856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50dc1037b0 0x7f50dc199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.362+0000 7f50daa00640 1 --2- 172.21.15.37:0/3640369856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50dc102660 0x7f50dc198a20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00e9f0 tx=0x7f50cc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.362+0000 7f50e0a00640 1 -- 172.21.15.37:0/3640369856 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc00cd80 con 0x7f50dc102660 2024-08-20T05:17:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.362+0000 7f50e0a00640 1 -- 172.21.15.37:0/3640369856 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50cc0054d0 con 0x7f50dc102660 2024-08-20T05:17:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.362+0000 7f50e0a00640 1 -- 172.21.15.37:0/3640369856 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc010690 con 0x7f50dc102660 2024-08-20T05:17:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.362+0000 7f50e1e00640 1 -- 172.21.15.37:0/3640369856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50dc19a850 con 0x7f50dc102660 2024-08-20T05:17:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.362+0000 7f50e1e00640 1 -- 172.21.15.37:0/3640369856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50dc1a0f20 con 0x7f50dc102660 2024-08-20T05:17:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.367+0000 7f50e4c30740 1 Processor -- start 2024-08-20T05:17:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.368+0000 7f50e4c30740 1 -- start start 2024-08-20T05:17:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.368+0000 7f50e4c30740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13ec220 0x55c9e13ec620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.368+0000 7f50e4c30740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ecb60 0x55c9e13fb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.368+0000 7f50e4c30740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13fbe70 0x55c9e13fe2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.368+0000 7f50e4c30740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c9e1361210 con 0x55c9e13fbe70 2024-08-20T05:17:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.368+0000 7f50e4c30740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c9e1350710 con 0x55c9e13ec220 2024-08-20T05:17:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.368+0000 7f50e4c30740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c9e1354750 con 0x55c9e13ecb60 2024-08-20T05:17:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.369+0000 7f50db400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13ec220 0x55c9e13ec620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.369+0000 7f50da000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13fbe70 0x55c9e13fe2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.369+0000 7f50db400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13ec220 0x55c9e13ec620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33992/0 (socket says 172.21.15.37:33992) 2024-08-20T05:17:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.370+0000 7f50db400640 1 -- 172.21.15.37:0/2892842716 learned_addr learned my addr 172.21.15.37:0/2892842716 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.370+0000 7f50db400640 1 -- 172.21.15.37:0/2892842716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ecb60 msgr2=0x55c9e13fb930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:17:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.370+0000 7f50db400640 1 --2- 172.21.15.37:0/2892842716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ecb60 0x55c9e13fb930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.370+0000 7f50db400640 1 -- 172.21.15.37:0/2892842716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13fbe70 msgr2=0x55c9e13fe2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.370+0000 7f50db400640 1 --2- 172.21.15.37:0/2892842716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13fbe70 0x55c9e13fe2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.370+0000 7f50db400640 1 -- 172.21.15.37:0/2892842716 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9e131cde0 con 0x55c9e13ec220 2024-08-20T05:17:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.371+0000 7f50db400640 1 --2- 172.21.15.37:0/2892842716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13ec220 0x55c9e13ec620 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f50d402aed0 tx=0x7f50d4009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29d77e375de190c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.371+0000 7f50e0a00640 1 -- 172.21.15.37:0/3640369856 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f50cc004e10 con 0x7f50dc102660 2024-08-20T05:17:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.371+0000 7f50c7e00640 1 -- 172.21.15.37:0/2892842716 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d4048070 con 0x55c9e13ec220 2024-08-20T05:17:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.371+0000 7f50c7e00640 1 -- 172.21.15.37:0/2892842716 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50d4036070 con 0x55c9e13ec220 2024-08-20T05:17:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.371+0000 7f50c7e00640 1 -- 172.21.15.37:0/2892842716 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d4004320 con 0x55c9e13ec220 2024-08-20T05:17:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.372+0000 7f50e4c30740 1 -- 172.21.15.37:0/2892842716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13ec220 msgr2=0x55c9e13ec620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.372+0000 7f50e4c30740 1 --2- 172.21.15.37:0/2892842716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13ec220 0x55c9e13ec620 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f50d402aed0 tx=0x7f50d4009a20 comp rx=0 tx=0).stop 2024-08-20T05:17:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.372+0000 7f50e4c30740 1 -- 172.21.15.37:0/2892842716 shutdown_connections 2024-08-20T05:17:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.372+0000 7f50e4c30740 1 --2- 172.21.15.37:0/2892842716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13fbe70 0x55c9e13fe2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.372+0000 7f50e4c30740 1 --2- 172.21.15.37:0/2892842716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ecb60 0x55c9e13fb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.372+0000 7f50e4c30740 1 --2- 172.21.15.37:0/2892842716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13ec220 0x55c9e13ec620 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.372+0000 7f50e4c30740 1 -- 172.21.15.37:0/2892842716 >> 172.21.15.37:0/2892842716 conn(0x55c9e13e9330 msgr2=0x55c9e13ea110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.372+0000 7f50e4c30740 1 -- 172.21.15.37:0/2892842716 shutdown_connections 2024-08-20T05:17:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.372+0000 7f50e4c30740 1 -- 172.21.15.37:0/2892842716 wait complete. 2024-08-20T05:17:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.373+0000 7f50e4c30740 1 -- start start 2024-08-20T05:17:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.373+0000 7f50e4c30740 1 Processor -- start 2024-08-20T05:17:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.373+0000 7f50e0a00640 1 --2- 172.21.15.37:0/3640369856 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f50c00b3b60 0x7f50c00b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.373+0000 7f50e4c30740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13ec220 0x55c9e1400530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.373+0000 7f50e4c30740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ecb60 0x55c9e1400bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.373+0000 7f50e0a00640 1 -- 172.21.15.37:0/3640369856 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f50cc0e4430 con 0x7f50dc102660 2024-08-20T05:17:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.373+0000 7f50e4c30740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13fbe70 0x55c9e14017a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.373+0000 7f50e4c30740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c9e1289ab0 con 0x55c9e13ec220 2024-08-20T05:17:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.373+0000 7f50e4c30740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c9e12f7140 con 0x55c9e13fbe70 2024-08-20T05:17:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.373+0000 7f50e4c30740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c9e13fedb0 con 0x55c9e13ecb60 2024-08-20T05:17:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.373+0000 7f50e4c30740 10 client.0 _ll_register_callbacks cb 0x55c9e130a5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.374+0000 7f50db400640 1 --2- 172.21.15.37:0/3640369856 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f50c00b3b60 0x7f50c00b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.374+0000 7f50da000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ecb60 0x55c9e1400bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.374+0000 7f50da000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ecb60 0x55c9e1400bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36078/0 (socket says 172.21.15.37:36078) 2024-08-20T05:17:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.374+0000 7f50da000640 1 -- 172.21.15.37:0/4089368273 learned_addr learned my addr 172.21.15.37:0/4089368273 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.374+0000 7f50daa00640 1 --2- 172.21.15.37:0/4089368273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13ec220 0x55c9e1400530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.374+0000 7f50da000640 1 -- 172.21.15.37:0/4089368273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13fbe70 msgr2=0x55c9e14017a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:17:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.374+0000 7f50da000640 1 --2- 172.21.15.37:0/4089368273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13fbe70 0x55c9e14017a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.374+0000 7f50da000640 1 -- 172.21.15.37:0/4089368273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13ec220 msgr2=0x55c9e1400530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.374+0000 7f50da000640 1 --2- 172.21.15.37:0/4089368273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13ec220 0x55c9e1400530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.375+0000 7f50da000640 1 -- 172.21.15.37:0/4089368273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9e12f8170 con 0x55c9e13ecb60 2024-08-20T05:17:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.375+0000 7f50daa00640 1 --2- 172.21.15.37:0/4089368273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13ec220 0x55c9e1400530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:17:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.375+0000 7f50da000640 1 --2- 172.21.15.37:0/4089368273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ecb60 0x55c9e1400bd0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f50c8012d20 tx=0x7f50c800f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c02f39eb384d548d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.375+0000 7f50c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:17:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.375+0000 7f50c4c00640 1 -- 172.21.15.37:0/4089368273 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c800fe20 con 0x55c9e13ecb60 2024-08-20T05:17:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.375+0000 7f50c4c00640 1 -- 172.21.15.37:0/4089368273 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f50c8010430 con 0x55c9e13ecb60 2024-08-20T05:17:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.375+0000 7f50db400640 1 --2- 172.21.15.37:0/3640369856 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f50c00b3b60 0x7f50c00b6020 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009960 tx=0x7f50d402a8e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.376+0000 7f50e4c30740 1 -- 172.21.15.37:0/4089368273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c9e1327a30 con 0x55c9e13ecb60 2024-08-20T05:17:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.376+0000 7f50c4c00640 1 -- 172.21.15.37:0/4089368273 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f50c8010630 con 0x55c9e13ecb60 2024-08-20T05:17:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.377+0000 7f50e4c30740 10 client.29041 fetch_fsmap learned FSMap version 50 2024-08-20T05:17:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.377+0000 7f50e4c30740 1 -- 172.21.15.37:0/4089368273 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55c9e10b3790 con 0x55c9e13ecb60 2024-08-20T05:17:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.377+0000 7f50c4c00640 1 -- 172.21.15.37:0/4089368273 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55c9e1327a30 con 0x55c9e13ecb60 2024-08-20T05:17:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.378+0000 7f50c4c00640 1 -- 172.21.15.37:0/4089368273 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f50c8026880 con 0x55c9e13ecb60 2024-08-20T05:17:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.378+0000 7f50e4c30740 10 client.29041 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:17:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.378+0000 7f50e4c30740 10 client.29041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:17:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.378+0000 7f50e4c30740 20 client.29041 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.378+0000 7f50e4c30740 1 --2- 172.21.15.37:0/4089368273 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c9e140c2d0 0x55c9e140e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.378+0000 7f50e4c30740 4 client.29041 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:17:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.378+0000 7f50e4c30740 1 -- 172.21.15.37:0/4089368273 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9e1363160 con 0x55c9e140c2d0 2024-08-20T05:17:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.378+0000 7f50daa00640 1 --2- 172.21.15.37:0/4089368273 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c9e140c2d0 0x55c9e140e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.379+0000 7f50c4c00640 10 client.29041 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.380+0000 7f50daa00640 1 --2- 172.21.15.37:0/4089368273 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c9e140c2d0 0x55c9e140e6e0 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e0a29ce025638aa server_cookie=89755a4a49224fee in_seq=0 out_seq=0 2024-08-20T05:17:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.381+0000 7f50c4c00640 1 -- 172.21.15.37:0/4089368273 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c9e1363160 con 0x55c9e140c2d0 2024-08-20T05:17:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.381+0000 7f50c4c00640 10 client.29041 handle_command_reply: tid=0 2024-08-20T05:17:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.381+0000 7f50e4c30740 1 client.29041 shutdown 2024-08-20T05:17:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.384+0000 7f50e4c30740 1 -- 172.21.15.37:0/4089368273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ecb60 msgr2=0x55c9e1400bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.384+0000 7f50e4c30740 1 --2- 172.21.15.37:0/4089368273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ecb60 0x55c9e1400bd0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f50c8012d20 tx=0x7f50c800f790 comp rx=0 tx=0).stop 2024-08-20T05:17:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.385+0000 7f50e4c30740 1 -- 172.21.15.37:0/4089368273 shutdown_connections 2024-08-20T05:17:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.385+0000 7f50e4c30740 1 --2- 172.21.15.37:0/4089368273 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c9e140c2d0 0x55c9e140e6e0 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.385+0000 7f50e4c30740 1 --2- 172.21.15.37:0/4089368273 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13fbe70 0x55c9e14017a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.385+0000 7f50e4c30740 1 --2- 172.21.15.37:0/4089368273 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ecb60 0x55c9e1400bd0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.385+0000 7f50e4c30740 1 --2- 172.21.15.37:0/4089368273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13ec220 0x55c9e1400530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.385+0000 7f50e4c30740 1 -- 172.21.15.37:0/4089368273 >> 172.21.15.37:0/4089368273 conn(0x55c9e13e9330 msgr2=0x55c9e13eb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.385+0000 7f50c4c00640 0 client.29041 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.385+0000 7f50e4c30740 1 -- 172.21.15.37:0/4089368273 shutdown_connections 2024-08-20T05:17:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.386+0000 7f50e4c30740 1 -- 172.21.15.37:0/4089368273 wait complete. 2024-08-20T05:17:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.386+0000 7f50e4c30740 20 client.29041 trim_cache size 0 max 16384 2024-08-20T05:17:03.421 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.417+0000 7f50e4c30740 1 Processor -- start 2024-08-20T05:17:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.417+0000 7f50e4c30740 1 -- start start 2024-08-20T05:17:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.418+0000 7f50e4c30740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13ec220 0x55c9e1401780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.418+0000 7f50e4c30740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ecb60 0x55c9e13ff6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.418+0000 7f50e4c30740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13fbe70 0x55c9e13ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.419+0000 7f50e4c30740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc1a9010 con 0x55c9e13fbe70 2024-08-20T05:17:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.419+0000 7f50e4c30740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc1aabb0 con 0x55c9e13ec220 2024-08-20T05:17:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.419+0000 7f50e4c30740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc1a96e0 con 0x55c9e13ecb60 2024-08-20T05:17:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.419+0000 7f50daa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13ec220 0x55c9e1401780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.419+0000 7f50da000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ecb60 0x55c9e13ff6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.419+0000 7f50daa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13ec220 0x55c9e1401780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33996/0 (socket says 172.21.15.37:33996) 2024-08-20T05:17:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.419+0000 7f50daa00640 1 -- 172.21.15.37:0/440393798 learned_addr learned my addr 172.21.15.37:0/440393798 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.419+0000 7f50daa00640 1 -- 172.21.15.37:0/440393798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ecb60 msgr2=0x55c9e13ff6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.419+0000 7f50daa00640 1 --2- 172.21.15.37:0/440393798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ecb60 0x55c9e13ff6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.419+0000 7f50daa00640 1 -- 172.21.15.37:0/440393798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13fbe70 msgr2=0x55c9e13ffc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.419+0000 7f50daa00640 1 --2- 172.21.15.37:0/440393798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13fbe70 0x55c9e13ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.419+0000 7f50daa00640 1 -- 172.21.15.37:0/440393798 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9e112c620 con 0x55c9e13ec220 2024-08-20T05:17:03.424 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.420+0000 7f50daa00640 1 --2- 172.21.15.37:0/440393798 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13ec220 0x55c9e1401780 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00c6a0 tx=0x7f50cc0aad50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=875598e7ec09c6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.424+0000 7f50c7400640 1 -- 172.21.15.37:0/440393798 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0c03c0 con 0x55c9e13ec220 2024-08-20T05:17:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.424+0000 7f50c7400640 1 -- 172.21.15.37:0/440393798 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50cc0aaf80 con 0x55c9e13ec220 2024-08-20T05:17:03.426 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.424+0000 7f50c7400640 1 -- 172.21.15.37:0/440393798 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0046c0 con 0x55c9e13ec220 2024-08-20T05:17:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.429+0000 7f50e4c30740 1 -- 172.21.15.37:0/440393798 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13ec220 msgr2=0x55c9e1401780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.429+0000 7f50e4c30740 1 --2- 172.21.15.37:0/440393798 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13ec220 0x55c9e1401780 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00c6a0 tx=0x7f50cc0aad50 comp rx=0 tx=0).stop 2024-08-20T05:17:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.429+0000 7f50e4c30740 1 -- 172.21.15.37:0/440393798 shutdown_connections 2024-08-20T05:17:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.429+0000 7f50e4c30740 1 --2- 172.21.15.37:0/440393798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13fbe70 0x55c9e13ffc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.429+0000 7f50e4c30740 1 --2- 172.21.15.37:0/440393798 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ecb60 0x55c9e13ff6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.429+0000 7f50e4c30740 1 --2- 172.21.15.37:0/440393798 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13ec220 0x55c9e1401780 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.432 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.429+0000 7f50e4c30740 1 -- 172.21.15.37:0/440393798 >> 172.21.15.37:0/440393798 conn(0x55c9e13e9330 msgr2=0x55c9e13fb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:03.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.430+0000 7f50e4c30740 1 -- 172.21.15.37:0/440393798 shutdown_connections 2024-08-20T05:17:03.433 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.430+0000 7f50e4c30740 1 -- 172.21.15.37:0/440393798 wait complete. 2024-08-20T05:17:03.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.430+0000 7f50e4c30740 1 -- start start 2024-08-20T05:17:03.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.431+0000 7f50e4c30740 1 Processor -- start 2024-08-20T05:17:03.434 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.432+0000 7f50e4c30740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ec220 0x55c9e1402df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.432+0000 7f50e4c30740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13ecb60 0x55c9e1403490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.435 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.432+0000 7f50e4c30740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13fbe70 0x55c9e1403f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.432+0000 7f50e4c30740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc1aa4e0 con 0x55c9e13ecb60 2024-08-20T05:17:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.433+0000 7f50e4c30740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc1a9db0 con 0x55c9e13fbe70 2024-08-20T05:17:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.433+0000 7f50e4c30740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc1a6ff0 con 0x55c9e13ec220 2024-08-20T05:17:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.433+0000 7f50e4c30740 10 client.0 _ll_register_callbacks cb 0x7f50c8009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.435+0000 7f50daa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ec220 0x55c9e1402df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.433+0000 7f50db400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13fbe70 0x55c9e1403f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.435+0000 7f50db400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13fbe70 0x55c9e1403f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:34006/0 (socket says 172.21.15.37:34006) 2024-08-20T05:17:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.435+0000 7f50db400640 1 -- 172.21.15.37:0/256138406 learned_addr learned my addr 172.21.15.37:0/256138406 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.435+0000 7f50daa00640 1 -- 172.21.15.37:0/256138406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13fbe70 msgr2=0x55c9e1403f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.435+0000 7f50daa00640 1 --2- 172.21.15.37:0/256138406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13fbe70 0x55c9e1403f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.435+0000 7f50daa00640 1 -- 172.21.15.37:0/256138406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13ecb60 msgr2=0x55c9e1403490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.435+0000 7f50daa00640 1 --2- 172.21.15.37:0/256138406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13ecb60 0x55c9e1403490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.440 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.436+0000 7f50daa00640 1 -- 172.21.15.37:0/256138406 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9e14047a0 con 0x55c9e13ec220 2024-08-20T05:17:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.436+0000 7f50daa00640 1 --2- 172.21.15.37:0/256138406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ec220 0x55c9e1402df0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0be000 tx=0x7f50cc0c0430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2652cb7f7211bbf7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.436+0000 7f50c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:17:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.437+0000 7f50c4c00640 1 -- 172.21.15.37:0/256138406 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0c9030 con 0x55c9e13ec220 2024-08-20T05:17:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.437+0000 7f50e4c30740 1 -- 172.21.15.37:0/256138406 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50cc0aaf80 con 0x55c9e13ec220 2024-08-20T05:17:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.437+0000 7f50c4c00640 1 -- 172.21.15.37:0/256138406 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f50cc0bd040 con 0x55c9e13ec220 2024-08-20T05:17:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.438+0000 7f50c4c00640 1 -- 172.21.15.37:0/256138406 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f50cc0b4030 con 0x55c9e13ec220 2024-08-20T05:17:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.438+0000 7f50e4c30740 10 client.29044 fetch_fsmap learned FSMap version 50 2024-08-20T05:17:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.438+0000 7f50e4c30740 1 -- 172.21.15.37:0/256138406 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55c9e1407be0 con 0x55c9e13ec220 2024-08-20T05:17:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.438+0000 7f50c4c00640 1 -- 172.21.15.37:0/256138406 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50cc0aaf80 con 0x55c9e13ec220 2024-08-20T05:17:03.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.439+0000 7f50c4c00640 1 -- 172.21.15.37:0/256138406 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f50cc0b3c30 con 0x55c9e13ec220 2024-08-20T05:17:03.443 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.441+0000 7f50e4c30740 10 client.29044 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:17:03.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.441+0000 7f50e4c30740 10 client.29044 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:17:03.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.441+0000 7f50e4c30740 20 client.29044 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:03.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.441+0000 7f50e4c30740 1 --2- 172.21.15.37:0/256138406 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c9e1408510 0x55c9e1478f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:03.444 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.441+0000 7f50e4c30740 4 client.29044 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:17:03.445 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.441+0000 7f50e4c30740 1 -- 172.21.15.37:0/256138406 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c9e135ec00 con 0x55c9e1408510 2024-08-20T05:17:03.445 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.442+0000 7f50da000640 1 --2- 172.21.15.37:0/256138406 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c9e1408510 0x55c9e1478f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:03.445 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.443+0000 7f50da000640 1 --2- 172.21.15.37:0/256138406 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c9e1408510 0x55c9e1478f90 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=debc8ee85fa5bdab server_cookie=a26960cd5f01960a in_seq=0 out_seq=0 2024-08-20T05:17:03.446 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.443+0000 7f50c4c00640 10 client.29044 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:03.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:03 smithi130 ceph-mon[22007]: pgmap v845: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 4.6 MiB/s wr, 628 op/s 2024-08-20T05:17:03.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:03 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2469367874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:17:03.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:03 smithi037 ceph-mon[17265]: pgmap v845: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 4.6 MiB/s wr, 628 op/s 2024-08-20T05:17:03.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:03 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2469367874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:17:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.792+0000 7f50c4c00640 1 -- 172.21.15.37:0/256138406 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c9e135ec00 con 0x55c9e1408510 2024-08-20T05:17:03.797 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.792+0000 7f50c4c00640 10 client.29044 handle_command_reply: tid=0 2024-08-20T05:17:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.792+0000 7f50e4c30740 1 client.29044 shutdown 2024-08-20T05:17:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.793+0000 7f50e4c30740 1 -- 172.21.15.37:0/256138406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ec220 msgr2=0x55c9e1402df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.793+0000 7f50e4c30740 1 --2- 172.21.15.37:0/256138406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ec220 0x55c9e1402df0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0be000 tx=0x7f50cc0c0430 comp rx=0 tx=0).stop 2024-08-20T05:17:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.793+0000 7f50e4c30740 1 -- 172.21.15.37:0/256138406 shutdown_connections 2024-08-20T05:17:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.793+0000 7f50e4c30740 1 --2- 172.21.15.37:0/256138406 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c9e1408510 0x55c9e1478f90 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.793+0000 7f50e4c30740 1 --2- 172.21.15.37:0/256138406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c9e13fbe70 0x55c9e1403f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.793+0000 7f50c4c00640 0 client.29044 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.793+0000 7f50e4c30740 1 --2- 172.21.15.37:0/256138406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c9e13ecb60 0x55c9e1403490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.793+0000 7f50e4c30740 1 --2- 172.21.15.37:0/256138406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c9e13ec220 0x55c9e1402df0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.793+0000 7f50e4c30740 1 -- 172.21.15.37:0/256138406 >> 172.21.15.37:0/256138406 conn(0x55c9e13e9330 msgr2=0x55c9e13ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.793+0000 7f50e4c30740 1 -- 172.21.15.37:0/256138406 shutdown_connections 2024-08-20T05:17:03.798 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.793+0000 7f50e4c30740 1 -- 172.21.15.37:0/256138406 wait complete. 2024-08-20T05:17:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.793+0000 7f50e4c30740 20 client.29044 trim_cache size 0 max 16384 2024-08-20T05:17:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:17:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:17:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:17:03.799 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:17:03.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.794+0000 7f50e1e00640 1 -- 172.21.15.37:0/3640369856 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f50c00b3b60 msgr2=0x7f50c00b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:03.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.794+0000 7f50e1e00640 1 --2- 172.21.15.37:0/3640369856 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f50c00b3b60 0x7f50c00b6020 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009960 tx=0x7f50d402a8e0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.794+0000 7f50e1e00640 1 -- 172.21.15.37:0/3640369856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50dc102660 msgr2=0x7f50dc198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:03.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.794+0000 7f50e1e00640 1 --2- 172.21.15.37:0/3640369856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50dc102660 0x7f50dc198a20 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f50cc00e9f0 tx=0x7f50cc00edf0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.794+0000 7f50e1e00640 1 -- 172.21.15.37:0/3640369856 shutdown_connections 2024-08-20T05:17:03.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.794+0000 7f50e1e00640 1 --2- 172.21.15.37:0/3640369856 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f50c00b3b60 0x7f50c00b6020 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.794+0000 7f50e1e00640 1 --2- 172.21.15.37:0/3640369856 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f50dc104170 0x7f50dc199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.794+0000 7f50e1e00640 1 --2- 172.21.15.37:0/3640369856 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f50dc1037b0 0x7f50dc199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.794+0000 7f50e1e00640 1 --2- 172.21.15.37:0/3640369856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50dc102660 0x7f50dc198a20 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:03.800 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.794+0000 7f50e1e00640 1 -- 172.21.15.37:0/3640369856 >> 172.21.15.37:0/3640369856 conn(0x7f50dc0fdf20 msgr2=0x7f50dc106ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:03.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.795+0000 7f50e1e00640 1 -- 172.21.15.37:0/3640369856 shutdown_connections 2024-08-20T05:17:03.801 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:03.795+0000 7f50e1e00640 1 -- 172.21.15.37:0/3640369856 wait complete. 2024-08-20T05:17:03.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:03 smithi135 ceph-mon[22342]: pgmap v845: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 408 KiB/s rd, 4.6 MiB/s wr, 628 op/s 2024-08-20T05:17:03.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:03 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2469367874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:17:04.808 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 140.0 --await-for 45.0' 2024-08-20T05:17:04.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 140.0 --await-for 45.0 2024-08-20T05:17:05.485 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:17:05.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:05 smithi135 ceph-mon[22342]: pgmap v846: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 5.6 MiB/s wr, 707 op/s 2024-08-20T05:17:05.895 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:05 smithi037 ceph-mon[17265]: pgmap v846: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 5.6 MiB/s wr, 707 op/s 2024-08-20T05:17:05.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:05 smithi130 ceph-mon[22007]: pgmap v846: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 5.6 MiB/s wr, 707 op/s 2024-08-20T05:17:06.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.309+0000 7f7bf4c00640 1 -- 172.21.15.37:0/3714438478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bf010eaf0 msgr2=0x7f7bf010ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:06.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.309+0000 7f7bf4c00640 1 --2- 172.21.15.37:0/3714438478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bf010eaf0 0x7f7bf010ef30 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009900 tx=0x7f7bdc02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.310+0000 7f7bf4c00640 1 -- 172.21.15.37:0/3714438478 shutdown_connections 2024-08-20T05:17:06.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.310+0000 7f7bf4c00640 1 --2- 172.21.15.37:0/3714438478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf010f470 0x7f7bf0115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.310+0000 7f7bf4c00640 1 --2- 172.21.15.37:0/3714438478 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bf010eaf0 0x7f7bf010ef30 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.310+0000 7f7bf4c00640 1 --2- 172.21.15.37:0/3714438478 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bf01090e0 0x7f7bf01094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.310+0000 7f7bf4c00640 1 -- 172.21.15.37:0/3714438478 >> 172.21.15.37:0/3714438478 conn(0x7f7bf0078760 msgr2=0x7f7bf007ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:06.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.313+0000 7f7bf4c00640 1 -- 172.21.15.37:0/3714438478 shutdown_connections 2024-08-20T05:17:06.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.313+0000 7f7bf4c00640 1 -- 172.21.15.37:0/3714438478 wait complete. 2024-08-20T05:17:06.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.321+0000 7f7bf4c00640 1 Processor -- start 2024-08-20T05:17:06.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.321+0000 7f7bf4c00640 1 -- start start 2024-08-20T05:17:06.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.323+0000 7f7bf4c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bf01090e0 0x7f7bf019f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.323+0000 7f7bf4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf010eaf0 0x7f7bf019fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.323+0000 7f7bf4c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bf010f470 0x7f7bf01a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.324+0000 7f7bede00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bf01090e0 0x7f7bf019f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:06.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.324+0000 7f7bf4c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01190c0 con 0x7f7bf010eaf0 2024-08-20T05:17:06.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.324+0000 7f7bf4c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf0118f40 con 0x7f7bf010f470 2024-08-20T05:17:06.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.324+0000 7f7bf4c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf0119240 con 0x7f7bf01090e0 2024-08-20T05:17:06.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.324+0000 7f7bee800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bf010f470 0x7f7bf01a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:06.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.324+0000 7f7bee800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bf010f470 0x7f7bf01a4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:34016/0 (socket says 172.21.15.37:34016) 2024-08-20T05:17:06.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.324+0000 7f7bee800640 1 -- 172.21.15.37:0/3454740713 learned_addr learned my addr 172.21.15.37:0/3454740713 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:06.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.325+0000 7f7bee800640 1 -- 172.21.15.37:0/3454740713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bf01090e0 msgr2=0x7f7bf019f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:06.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.325+0000 7f7bee800640 1 --2- 172.21.15.37:0/3454740713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bf01090e0 0x7f7bf019f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.325+0000 7f7bee800640 1 -- 172.21.15.37:0/3454740713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf010eaf0 msgr2=0x7f7bf019fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:06.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.325+0000 7f7bee800640 1 --2- 172.21.15.37:0/3454740713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf010eaf0 0x7f7bf019fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.325+0000 7f7bee800640 1 -- 172.21.15.37:0/3454740713 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf01a5640 con 0x7f7bf010f470 2024-08-20T05:17:06.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.325+0000 7f7bee800640 1 --2- 172.21.15.37:0/3454740713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bf010f470 0x7f7bf01a4e70 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7be800eaa0 tx=0x7f7be800ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:06.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.326+0000 7f7be6a00640 1 -- 172.21.15.37:0/3454740713 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be800cdb0 con 0x7f7bf010f470 2024-08-20T05:17:06.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.326+0000 7f7be6a00640 1 -- 172.21.15.37:0/3454740713 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7be8005020 con 0x7f7bf010f470 2024-08-20T05:17:06.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.326+0000 7f7be6a00640 1 -- 172.21.15.37:0/3454740713 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be80116d0 con 0x7f7bf010f470 2024-08-20T05:17:06.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.328+0000 7f7bf4c00640 1 -- 172.21.15.37:0/3454740713 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf01a5930 con 0x7f7bf010f470 2024-08-20T05:17:06.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.328+0000 7f7bf4c00640 1 -- 172.21.15.37:0/3454740713 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf01abff0 con 0x7f7bf010f470 2024-08-20T05:17:06.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.332+0000 7f7bf75f2740 1 Processor -- start 2024-08-20T05:17:06.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.333+0000 7f7bf75f2740 1 -- start start 2024-08-20T05:17:06.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.333+0000 7f7bf75f2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.333+0000 7f7bf75f2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581ba760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.333+0000 7f7bf75f2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 0x55a2581bd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.333+0000 7f7bf75f2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a25814e670 con 0x55a2581ae3f0 2024-08-20T05:17:06.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.333+0000 7f7bf75f2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a2581227c0 con 0x55a2581baca0 2024-08-20T05:17:06.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.333+0000 7f7bf75f2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a258111cc0 con 0x55a2581aed10 2024-08-20T05:17:06.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.334+0000 7f7bed400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:06.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.334+0000 7f7bed400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581ae7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45694/0 (socket says 172.21.15.37:45694) 2024-08-20T05:17:06.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.334+0000 7f7bed400640 1 -- 172.21.15.37:0/4024397434 learned_addr learned my addr 172.21.15.37:0/4024397434 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:06.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.334+0000 7f7bed400640 1 --2- 172.21.15.37:0/4024397434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 0x55a2581bd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:06.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.335+0000 7f7bede00640 1 --2- 172.21.15.37:0/4024397434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581ba760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:06.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.335+0000 7f7bed400640 1 -- 172.21.15.37:0/4024397434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 msgr2=0x55a2581ba760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:06.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.335+0000 7f7bed400640 1 --2- 172.21.15.37:0/4024397434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581ba760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.335+0000 7f7bed400640 1 -- 172.21.15.37:0/4024397434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 msgr2=0x55a2581bd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:06.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.335+0000 7f7bed400640 1 --2- 172.21.15.37:0/4024397434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 0x55a2581bd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.336+0000 7f7bed400640 1 -- 172.21.15.37:0/4024397434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2580a5110 con 0x55a2581ae3f0 2024-08-20T05:17:06.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.338+0000 7f7bed400640 1 --2- 172.21.15.37:0/4024397434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581ae7d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc031b00 tx=0x7f7bdc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79d6b92498d138eb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:06.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.339+0000 7f7be6a00640 1 -- 172.21.15.37:0/3454740713 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7be80051d0 con 0x7f7bf010f470 2024-08-20T05:17:06.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.341+0000 7f7be6a00640 1 --2- 172.21.15.37:0/3454740713 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bd40b3c90 0x7f7bd40b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.341+0000 7f7be6a00640 1 -- 172.21.15.37:0/3454740713 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7be80e4390 con 0x7f7bf010f470 2024-08-20T05:17:06.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.342+0000 7f7bdb000640 1 -- 172.21.15.37:0/4024397434 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc035070 con 0x55a2581ae3f0 2024-08-20T05:17:06.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.342+0000 7f7bdb000640 1 -- 172.21.15.37:0/4024397434 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bdc031d60 con 0x55a2581ae3f0 2024-08-20T05:17:06.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.342+0000 7f7bdb000640 1 -- 172.21.15.37:0/4024397434 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc0046c0 con 0x55a2581ae3f0 2024-08-20T05:17:06.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.343+0000 7f7bf75f2740 1 -- 172.21.15.37:0/4024397434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 msgr2=0x55a2581ae7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:06.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.343+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/4024397434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581ae7d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc031b00 tx=0x7f7bdc000bc0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.343+0000 7f7bf75f2740 1 -- 172.21.15.37:0/4024397434 shutdown_connections 2024-08-20T05:17:06.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.343+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/4024397434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 0x55a2581bd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.343+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/4024397434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581ba760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.343+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/4024397434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581ae7d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.343+0000 7f7bede00640 1 --2- 172.21.15.37:0/3454740713 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bd40b3c90 0x7f7bd40b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:06.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.343+0000 7f7bf75f2740 1 -- 172.21.15.37:0/4024397434 >> 172.21.15.37:0/4024397434 conn(0x55a2581ac220 msgr2=0x55a2581ad3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:06.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.345+0000 7f7bede00640 1 --2- 172.21.15.37:0/3454740713 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bd40b3c90 0x7f7bd40b6150 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x55a2581ad100 tx=0x7f7be000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.347+0000 7f7bf75f2740 1 -- 172.21.15.37:0/4024397434 shutdown_connections 2024-08-20T05:17:06.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.347+0000 7f7bf75f2740 1 -- 172.21.15.37:0/4024397434 wait complete. 2024-08-20T05:17:06.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.348+0000 7f7bf75f2740 1 -- start start 2024-08-20T05:17:06.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.350+0000 7f7bf75f2740 1 Processor -- start 2024-08-20T05:17:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.352+0000 7f7bf75f2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581b7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.352+0000 7f7bf75f2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581b8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.352+0000 7f7bf75f2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 0x55a2581b8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.352+0000 7f7bf75f2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a2580b7780 con 0x55a2581ae3f0 2024-08-20T05:17:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.352+0000 7f7bf75f2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55a258115d00 con 0x55a2581baca0 2024-08-20T05:17:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.352+0000 7f7bf75f2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55a257f747a0 con 0x55a2581aed10 2024-08-20T05:17:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.352+0000 7f7bf75f2740 10 client.0 _ll_register_callbacks cb 0x55a2580bf940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.353+0000 7f7bede00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581b7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.353+0000 7f7bede00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581b7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45710/0 (socket says 172.21.15.37:45710) 2024-08-20T05:17:06.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.353+0000 7f7bede00640 1 -- 172.21.15.37:0/3679911649 learned_addr learned my addr 172.21.15.37:0/3679911649 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:06.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.354+0000 7f7bede00640 1 -- 172.21.15.37:0/3679911649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 msgr2=0x55a2581b8240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:17:06.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.354+0000 7f7bede00640 1 --2- 172.21.15.37:0/3679911649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581b8240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.354+0000 7f7bede00640 1 -- 172.21.15.37:0/3679911649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 msgr2=0x55a2581b8780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:17:06.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.354+0000 7f7bede00640 1 --2- 172.21.15.37:0/3679911649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 0x55a2581b8780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.354+0000 7f7bede00640 1 -- 172.21.15.37:0/3679911649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2580c49c0 con 0x55a2581ae3f0 2024-08-20T05:17:06.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.355+0000 7f7bede00640 1 --2- 172.21.15.37:0/3679911649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581b7d00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7be000a500 tx=0x7f7be00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f50ec00764386e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:06.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.355+0000 7f7bcf400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:17:06.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.355+0000 7f7bcf400640 1 -- 172.21.15.37:0/3679911649 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be000fd60 con 0x55a2581ae3f0 2024-08-20T05:17:06.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.355+0000 7f7bcf400640 1 -- 172.21.15.37:0/3679911649 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7be0005020 con 0x55a2581ae3f0 2024-08-20T05:17:06.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.357+0000 7f7bf75f2740 1 -- 172.21.15.37:0/3679911649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bdc031d60 con 0x55a2581ae3f0 2024-08-20T05:17:06.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.357+0000 7f7bcf400640 1 -- 172.21.15.37:0/3679911649 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f7be0005220 con 0x55a2581ae3f0 2024-08-20T05:17:06.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.357+0000 7f7bf75f2740 10 client.18294 fetch_fsmap learned FSMap version 50 2024-08-20T05:17:06.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.357+0000 7f7bf75f2740 1 -- 172.21.15.37:0/3679911649 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55a257e80b90 con 0x55a2581ae3f0 2024-08-20T05:17:06.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.358+0000 7f7bcf400640 1 -- 172.21.15.37:0/3679911649 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bdc031d60 con 0x55a2581ae3f0 2024-08-20T05:17:06.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.358+0000 7f7bcf400640 1 -- 172.21.15.37:0/3679911649 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f7be0030430 con 0x55a2581ae3f0 2024-08-20T05:17:06.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.358+0000 7f7bf75f2740 10 client.18294 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:17:06.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.358+0000 7f7bf75f2740 10 client.18294 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:17:06.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.358+0000 7f7bf75f2740 20 client.18294 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:06.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.358+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/3679911649 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a2581ca820 0x55a2581ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.358+0000 7f7bf75f2740 4 client.18294 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:17:06.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.358+0000 7f7bf75f2740 1 -- 172.21.15.37:0/3679911649 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a258124710 con 0x55a2581ca820 2024-08-20T05:17:06.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.359+0000 7f7bed400640 1 --2- 172.21.15.37:0/3679911649 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a2581ca820 0x55a2581ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:06.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.362+0000 7f7bcf400640 10 client.18294 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:06.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.362+0000 7f7bed400640 1 --2- 172.21.15.37:0/3679911649 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a2581ca820 0x55a2581ccc90 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2b5dcd6f89743c6 server_cookie=487e93bdba31fe3c in_seq=0 out_seq=0 2024-08-20T05:17:06.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.363+0000 7f7bcf400640 1 -- 172.21.15.37:0/3679911649 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a258124710 con 0x55a2581ca820 2024-08-20T05:17:06.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.363+0000 7f7bcf400640 10 client.18294 handle_command_reply: tid=0 2024-08-20T05:17:06.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.363+0000 7f7bf75f2740 1 client.18294 shutdown 2024-08-20T05:17:06.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.364+0000 7f7bf75f2740 1 -- 172.21.15.37:0/3679911649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 msgr2=0x55a2581b7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:06.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.364+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/3679911649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581b7d00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7be000a500 tx=0x7f7be00046c0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.365+0000 7f7bf75f2740 1 -- 172.21.15.37:0/3679911649 shutdown_connections 2024-08-20T05:17:06.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.365+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/3679911649 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a2581ca820 0x55a2581ccc90 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.365+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/3679911649 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 0x55a2581b8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.365+0000 7f7bcf400640 0 client.18294 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:06.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.365+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/3679911649 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581b8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.365+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/3679911649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581b7d00 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.365+0000 7f7bf75f2740 1 -- 172.21.15.37:0/3679911649 >> 172.21.15.37:0/3679911649 conn(0x55a2581ac220 msgr2=0x55a2581b1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:06.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.367+0000 7f7bf75f2740 1 -- 172.21.15.37:0/3679911649 shutdown_connections 2024-08-20T05:17:06.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.368+0000 7f7bf75f2740 1 -- 172.21.15.37:0/3679911649 wait complete. 2024-08-20T05:17:06.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.368+0000 7f7bf75f2740 20 client.18294 trim_cache size 0 max 16384 2024-08-20T05:17:06.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.403+0000 7f7bf75f2740 1 Processor -- start 2024-08-20T05:17:06.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.403+0000 7f7bf75f2740 1 -- start start 2024-08-20T05:17:06.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.404+0000 7f7bf75f2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581b2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.404+0000 7f7bf75f2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.404+0000 7f7bf75f2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 0x55a2581d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.404+0000 7f7bf75f2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01ad650 con 0x55a2581ae3f0 2024-08-20T05:17:06.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.404+0000 7f7bf75f2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01af1f0 con 0x55a2581baca0 2024-08-20T05:17:06.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.404+0000 7f7bf75f2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01add20 con 0x55a2581aed10 2024-08-20T05:17:06.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.404+0000 7f7bed400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:06.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.404+0000 7f7bee800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 0x55a2581d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:06.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.404+0000 7f7bee800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 0x55a2581d25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:34028/0 (socket says 172.21.15.37:34028) 2024-08-20T05:17:06.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.404+0000 7f7bee800640 1 -- 172.21.15.37:0/1842156991 learned_addr learned my addr 172.21.15.37:0/1842156991 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:06.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.404+0000 7f7bede00640 1 --2- 172.21.15.37:0/1842156991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:06.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.404+0000 7f7bee800640 1 -- 172.21.15.37:0/1842156991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 msgr2=0x55a2581b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:06.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.405+0000 7f7bee800640 1 --2- 172.21.15.37:0/1842156991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581b83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.405+0000 7f7bee800640 1 -- 172.21.15.37:0/1842156991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 msgr2=0x55a2581b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:06.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.405+0000 7f7bee800640 1 --2- 172.21.15.37:0/1842156991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.405+0000 7f7bee800640 1 -- 172.21.15.37:0/1842156991 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2581cd310 con 0x55a2581baca0 2024-08-20T05:17:06.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.405+0000 7f7bede00640 1 --2- 172.21.15.37:0/1842156991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:17:06.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.405+0000 7f7bed400640 1 --2- 172.21.15.37:0/1842156991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:17:06.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.405+0000 7f7bee800640 1 --2- 172.21.15.37:0/1842156991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 0x55a2581d25a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7be80a81b0 tx=0x7f7be80aab90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8ff09b3fbb3bb93 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:06.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.407+0000 7f7bda600640 1 -- 172.21.15.37:0/1842156991 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be80c5070 con 0x55a2581baca0 2024-08-20T05:17:06.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.407+0000 7f7bda600640 1 -- 172.21.15.37:0/1842156991 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7be80af540 con 0x55a2581baca0 2024-08-20T05:17:06.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.407+0000 7f7bda600640 1 -- 172.21.15.37:0/1842156991 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be80a68b0 con 0x55a2581baca0 2024-08-20T05:17:06.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.409+0000 7f7bf75f2740 1 -- 172.21.15.37:0/1842156991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 msgr2=0x55a2581d25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:06.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.409+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/1842156991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 0x55a2581d25a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7be80a81b0 tx=0x7f7be80aab90 comp rx=0 tx=0).stop 2024-08-20T05:17:06.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.409+0000 7f7bf75f2740 1 -- 172.21.15.37:0/1842156991 shutdown_connections 2024-08-20T05:17:06.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.409+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/1842156991 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 0x55a2581d25a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.409+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/1842156991 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.409+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/1842156991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.409+0000 7f7bf75f2740 1 -- 172.21.15.37:0/1842156991 >> 172.21.15.37:0/1842156991 conn(0x55a2581ac220 msgr2=0x55a2581b7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:06.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.409+0000 7f7bf75f2740 1 -- 172.21.15.37:0/1842156991 shutdown_connections 2024-08-20T05:17:06.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.409+0000 7f7bf75f2740 1 -- 172.21.15.37:0/1842156991 wait complete. 2024-08-20T05:17:06.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.410+0000 7f7bf75f2740 1 -- start start 2024-08-20T05:17:06.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.412+0000 7f7bf75f2740 1 Processor -- start 2024-08-20T05:17:06.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.413+0000 7f7bf75f2740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.414+0000 7f7bf75f2740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.415+0000 7f7bf75f2740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 0x55a2581bfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.415+0000 7f7bf75f2740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01aeb20 con 0x55a2581ae3f0 2024-08-20T05:17:06.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.415+0000 7f7bf75f2740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01ae3f0 con 0x55a2581baca0 2024-08-20T05:17:06.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.415+0000 7f7bf75f2740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf0074450 con 0x55a2581aed10 2024-08-20T05:17:06.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.416+0000 7f7bed400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:06.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.416+0000 7f7bf75f2740 10 client.0 _ll_register_callbacks cb 0x7f7be000a7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:06.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.416+0000 7f7bede00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:06.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.416+0000 7f7bede00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581c2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45720/0 (socket says 172.21.15.37:45720) 2024-08-20T05:17:06.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.416+0000 7f7bed400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581c2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:36146/0 (socket says 172.21.15.37:36146) 2024-08-20T05:17:06.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.417+0000 7f7bed400640 1 -- 172.21.15.37:0/300461770 learned_addr learned my addr 172.21.15.37:0/300461770 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:06.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.417+0000 7f7bee800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 0x55a2581bfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:06.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.418+0000 7f7bed400640 1 -- 172.21.15.37:0/300461770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 msgr2=0x55a2581bfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:06.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.418+0000 7f7bed400640 1 --2- 172.21.15.37:0/300461770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 0x55a2581bfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.418+0000 7f7bed400640 1 -- 172.21.15.37:0/300461770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 msgr2=0x55a2581c2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:06.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.418+0000 7f7bed400640 1 --2- 172.21.15.37:0/300461770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581c2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.418+0000 7f7bed400640 1 -- 172.21.15.37:0/300461770 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2581c0030 con 0x55a2581aed10 2024-08-20T05:17:06.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.419+0000 7f7bed400640 1 --2- 172.21.15.37:0/300461770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581c2fb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc031b30 tx=0x7f7bdc005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e772f4d6ba88490c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:06.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.419+0000 7f7bcf400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:17:06.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.419+0000 7f7bcf400640 1 -- 172.21.15.37:0/300461770 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc035040 con 0x55a2581aed10 2024-08-20T05:17:06.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.420+0000 7f7bcf400640 1 -- 172.21.15.37:0/300461770 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7bdc004040 con 0x55a2581aed10 2024-08-20T05:17:06.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.420+0000 7f7bf75f2740 1 -- 172.21.15.37:0/300461770 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7be80af540 con 0x55a2581aed10 2024-08-20T05:17:06.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.420+0000 7f7bcf400640 1 -- 172.21.15.37:0/300461770 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f7bdc005d50 con 0x55a2581aed10 2024-08-20T05:17:06.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.420+0000 7f7bf75f2740 10 client.29053 fetch_fsmap learned FSMap version 50 2024-08-20T05:17:06.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.420+0000 7f7bf75f2740 1 -- 172.21.15.37:0/300461770 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55a258235d90 con 0x55a2581aed10 2024-08-20T05:17:06.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.420+0000 7f7bcf400640 1 -- 172.21.15.37:0/300461770 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7be80af540 con 0x55a2581aed10 2024-08-20T05:17:06.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.421+0000 7f7bcf400640 1 -- 172.21.15.37:0/300461770 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f7bdc03a040 con 0x55a2581aed10 2024-08-20T05:17:06.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.422+0000 7f7bf75f2740 10 client.29053 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:17:06.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.422+0000 7f7bf75f2740 10 client.29053 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:17:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.422+0000 7f7bf75f2740 20 client.29053 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.422+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/300461770 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a258236080 0x55a258238470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.422+0000 7f7bf75f2740 4 client.29053 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.0, "await_for": 45.0}] 2024-08-20T05:17:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.422+0000 7f7bf75f2740 1 -- 172.21.15.37:0/300461770 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.0, "await_for": 45.0}) -- 0x55a2581201b0 con 0x55a258236080 2024-08-20T05:17:06.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.422+0000 7f7bede00640 1 --2- 172.21.15.37:0/300461770 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a258236080 0x55a258238470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:06.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.423+0000 7f7bede00640 1 --2- 172.21.15.37:0/300461770 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a258236080 0x55a258238470 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebc770bf365c1832 server_cookie=e33b5cf88fbfc48d in_seq=0 out_seq=0 2024-08-20T05:17:06.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.423+0000 7f7bcf400640 10 client.29053 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:06.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.613+0000 7f7bcf400640 1 -- 172.21.15.37:0/300461770 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a2581201b0 con 0x55a258236080 2024-08-20T05:17:06.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.613+0000 7f7bcf400640 10 client.29053 handle_command_reply: tid=0 2024-08-20T05:17:06.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.613+0000 7f7bf75f2740 1 client.29053 shutdown 2024-08-20T05:17:06.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.613+0000 7f7bf75f2740 1 -- 172.21.15.37:0/300461770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 msgr2=0x55a2581c2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:06.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.613+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/300461770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581c2fb0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc031b30 tx=0x7f7bdc005fd0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.613+0000 7f7bf75f2740 1 -- 172.21.15.37:0/300461770 shutdown_connections 2024-08-20T05:17:06.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.613+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/300461770 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55a258236080 0x55a258238470 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.613+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/300461770 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55a2581baca0 0x55a2581bfa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.613+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/300461770 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55a2581aed10 0x55a2581c2fb0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.613+0000 7f7bf75f2740 1 --2- 172.21.15.37:0/300461770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a2581ae3f0 0x55a2581c2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.613+0000 7f7bcf400640 0 client.29053 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:06.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.613+0000 7f7bf75f2740 1 -- 172.21.15.37:0/300461770 >> 172.21.15.37:0/300461770 conn(0x55a2581ac220 msgr2=0x55a2581b84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:06.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.613+0000 7f7bf75f2740 1 -- 172.21.15.37:0/300461770 shutdown_connections 2024-08-20T05:17:06.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.613+0000 7f7bf75f2740 1 -- 172.21.15.37:0/300461770 wait complete. 2024-08-20T05:17:06.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.614+0000 7f7bf75f2740 20 client.29053 trim_cache size 0 max 16384 2024-08-20T05:17:06.617 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:17:06.617 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 50, 2024-08-20T05:17:06.617 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:17:06.617 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 54, 2024-08-20T05:17:06.617 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:17:06.617 INFO:teuthology.orchestra.run.smithi037.stdout: "1b1803a4": { 2024-08-20T05:17:06.617 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 54, 2024-08-20T05:17:06.618 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:17:06.618 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:17:06.618 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:17:06.618 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:17:06.618 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:17:06.618 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:17:06.618 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 140.0, 2024-08-20T05:17:06.618 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:17:06.618 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:17:06.618 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:17:06.618 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:17:06.618 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:17:06.618 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:17:06.619 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:17:06.619 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:17:06.619 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:17:06.619 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:17:06.619 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:17:06.619 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:17:06.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.614+0000 7f7bf4c00640 1 -- 172.21.15.37:0/3454740713 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bd40b3c90 msgr2=0x7f7bd40b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:06.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.614+0000 7f7bf4c00640 1 --2- 172.21.15.37:0/3454740713 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bd40b3c90 0x7f7bd40b6150 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x55a2581ad100 tx=0x7f7be000a2d0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.614+0000 7f7bf4c00640 1 -- 172.21.15.37:0/3454740713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bf010f470 msgr2=0x7f7bf01a4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:06.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.614+0000 7f7bf4c00640 1 --2- 172.21.15.37:0/3454740713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bf010f470 0x7f7bf01a4e70 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7be800eaa0 tx=0x7f7be800ef60 comp rx=0 tx=0).stop 2024-08-20T05:17:06.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.614+0000 7f7bf4c00640 1 -- 172.21.15.37:0/3454740713 shutdown_connections 2024-08-20T05:17:06.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.614+0000 7f7bf4c00640 1 --2- 172.21.15.37:0/3454740713 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bd40b3c90 0x7f7bd40b6150 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.614+0000 7f7bf4c00640 1 --2- 172.21.15.37:0/3454740713 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7bf010f470 0x7f7bf01a4e70 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.614+0000 7f7bf4c00640 1 --2- 172.21.15.37:0/3454740713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7bf010eaf0 0x7f7bf019fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.614+0000 7f7bf4c00640 1 --2- 172.21.15.37:0/3454740713 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7bf01090e0 0x7f7bf019f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:06.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.614+0000 7f7bf4c00640 1 -- 172.21.15.37:0/3454740713 >> 172.21.15.37:0/3454740713 conn(0x7f7bf0078760 msgr2=0x7f7bf007ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:06.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.615+0000 7f7bf4c00640 1 -- 172.21.15.37:0/3454740713 shutdown_connections 2024-08-20T05:17:06.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:06.615+0000 7f7bf4c00640 1 -- 172.21.15.37:0/3454740713 wait complete. 2024-08-20T05:17:06.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:06 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:17:06.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:06 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:17:06.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:06 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:17:06.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:06 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:17:07.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:06 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:17:07.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:06 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:17:07.550 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1b1803a4', quiesce took 6.8 seconds. Will release after: 13.2 2024-08-20T05:17:07.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:07 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:17:07.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:07 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:17:07.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:07 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:17:07.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:07 smithi037 ceph-mon[17265]: pgmap v847: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 4.5 MiB/s wr, 524 op/s 2024-08-20T05:17:07.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:07 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:17:07.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:07 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:17:07.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:07 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:17:07.866 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:07 smithi135 ceph-mon[22342]: pgmap v847: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 4.5 MiB/s wr, 524 op/s 2024-08-20T05:17:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:07 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:17:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:07 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:17:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:07 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:17:07.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:07 smithi130 ceph-mon[22007]: pgmap v847: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 463 KiB/s rd, 4.5 MiB/s wr, 524 op/s 2024-08-20T05:17:08.042 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 850.0 s, 268.6 tps, lat 246.400 ms stddev 291.138 2024-08-20T05:17:09.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:09 smithi135 ceph-mon[22342]: pgmap v848: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 5.0 MiB/s wr, 530 op/s 2024-08-20T05:17:09.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:09 smithi130 ceph-mon[22007]: pgmap v848: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 5.0 MiB/s wr, 530 op/s 2024-08-20T05:17:10.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:09 smithi037 ceph-mon[17265]: pgmap v848: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 5.0 MiB/s wr, 530 op/s 2024-08-20T05:17:11.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:11 smithi135 ceph-mon[22342]: pgmap v849: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 4.2 MiB/s wr, 437 op/s 2024-08-20T05:17:11.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:11 smithi130 ceph-mon[22007]: pgmap v849: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 4.2 MiB/s wr, 437 op/s 2024-08-20T05:17:12.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:11 smithi037 ceph-mon[17265]: pgmap v849: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 4.2 MiB/s wr, 437 op/s 2024-08-20T05:17:13.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:17:13.839 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:13 smithi037 ceph-mon[17265]: pgmap v850: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 3.5 MiB/s wr, 355 op/s 2024-08-20T05:17:13.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:13 smithi135 ceph-mon[22342]: pgmap v850: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 3.5 MiB/s wr, 355 op/s 2024-08-20T05:17:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:13 smithi130 ceph-mon[22007]: pgmap v850: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 3.5 MiB/s wr, 355 op/s 2024-08-20T05:17:15.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:15 smithi037 ceph-mon[17265]: pgmap v851: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 3.1 MiB/s wr, 303 op/s 2024-08-20T05:17:15.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:15 smithi135 ceph-mon[22342]: pgmap v851: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 3.1 MiB/s wr, 303 op/s 2024-08-20T05:17:15.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:15 smithi130 ceph-mon[22007]: pgmap v851: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 3.1 MiB/s wr, 303 op/s 2024-08-20T05:17:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.933+0000 7fa7a8a00640 1 -- 172.21.15.37:0/4032348840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7a4102490 msgr2=0x7fa7a4102890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.933+0000 7fa7a8a00640 1 --2- 172.21.15.37:0/4032348840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7a4102490 0x7fa7a4102890 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa794009860 tx=0x7fa79402a340 comp rx=0 tx=0).stop 2024-08-20T05:17:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.933+0000 7fa7a8a00640 1 -- 172.21.15.37:0/4032348840 shutdown_connections 2024-08-20T05:17:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.933+0000 7fa7a8a00640 1 --2- 172.21.15.37:0/4032348840 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7a4103fa0 0x7fa7a410a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.933+0000 7fa7a8a00640 1 --2- 172.21.15.37:0/4032348840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7a41035e0 0x7fa7a4103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.933+0000 7fa7a8a00640 1 --2- 172.21.15.37:0/4032348840 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7a4102490 0x7fa7a4102890 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.933+0000 7fa7a8a00640 1 -- 172.21.15.37:0/4032348840 >> 172.21.15.37:0/4032348840 conn(0x7fa7a40fdd30 msgr2=0x7fa7a4100170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.933+0000 7fa7a8a00640 1 -- 172.21.15.37:0/4032348840 shutdown_connections 2024-08-20T05:17:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.933+0000 7fa7a8a00640 1 -- 172.21.15.37:0/4032348840 wait complete. 2024-08-20T05:17:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.935+0000 7fa7a8a00640 1 Processor -- start 2024-08-20T05:17:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.935+0000 7fa7a8a00640 1 -- start start 2024-08-20T05:17:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.935+0000 7fa7a8a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7a4102490 0x7fa7a419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.935+0000 7fa7a8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7a41035e0 0x7fa7a419b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.935+0000 7fa7a8a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7a4103fa0 0x7fa7a419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.935+0000 7fa7a8a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a410e100 con 0x7fa7a4103fa0 2024-08-20T05:17:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.935+0000 7fa7a8a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a410df80 con 0x7fa7a4102490 2024-08-20T05:17:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.935+0000 7fa7a8a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a410e280 con 0x7fa7a41035e0 2024-08-20T05:17:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.935+0000 7fa7a3200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7a4103fa0 0x7fa7a419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.936+0000 7fa7a3200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7a4103fa0 0x7fa7a419bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38008/0 (socket says 172.21.15.37:38008) 2024-08-20T05:17:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.936+0000 7fa7a3200640 1 -- 172.21.15.37:0/4021150206 learned_addr learned my addr 172.21.15.37:0/4021150206 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.936+0000 7fa7a2800640 1 --2- 172.21.15.37:0/4021150206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7a4102490 0x7fa7a419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.936+0000 7fa79be00640 1 --2- 172.21.15.37:0/4021150206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7a41035e0 0x7fa7a419b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.936+0000 7fa7a2800640 1 -- 172.21.15.37:0/4021150206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7a41035e0 msgr2=0x7fa7a419b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.936+0000 7fa7a2800640 1 --2- 172.21.15.37:0/4021150206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7a41035e0 0x7fa7a419b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.936+0000 7fa7a2800640 1 -- 172.21.15.37:0/4021150206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7a4103fa0 msgr2=0x7fa7a419bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.936+0000 7fa7a2800640 1 --2- 172.21.15.37:0/4021150206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7a4103fa0 0x7fa7a419bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.936+0000 7fa7a2800640 1 -- 172.21.15.37:0/4021150206 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a419c5e0 con 0x7fa7a4102490 2024-08-20T05:17:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.936+0000 7fa7a3200640 1 --2- 172.21.15.37:0/4021150206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7a4103fa0 0x7fa7a419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.936+0000 7fa79be00640 1 --2- 172.21.15.37:0/4021150206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7a41035e0 0x7fa7a419b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.936+0000 7fa7a2800640 1 --2- 172.21.15.37:0/4021150206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7a4102490 0x7fa7a419aaa0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa79402a860 tx=0x7fa794032dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.937+0000 7fa79b400640 1 -- 172.21.15.37:0/4021150206 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa794037040 con 0x7fa7a4102490 2024-08-20T05:17:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.937+0000 7fa79b400640 1 -- 172.21.15.37:0/4021150206 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa794030bc0 con 0x7fa7a4102490 2024-08-20T05:17:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.937+0000 7fa7a8a00640 1 -- 172.21.15.37:0/4021150206 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a419c870 con 0x7fa7a4102490 2024-08-20T05:17:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.937+0000 7fa79b400640 1 -- 172.21.15.37:0/4021150206 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa794003850 con 0x7fa7a4102490 2024-08-20T05:17:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.937+0000 7fa7a8a00640 1 -- 172.21.15.37:0/4021150206 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a41a2fa0 con 0x7fa7a4102490 2024-08-20T05:17:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.940+0000 7fa7ac44e740 1 Processor -- start 2024-08-20T05:17:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.940+0000 7fa7ac44e740 1 -- start start 2024-08-20T05:17:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.940+0000 7fa7ac44e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f3760167f0 0x55f376018be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.940+0000 7fa7ac44e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 0x55f37601b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.940+0000 7fa7ac44e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f37601bb60 0x55f37601e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.940+0000 7fa7ac44e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f375f89210 con 0x55f376019120 2024-08-20T05:17:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.940+0000 7fa7ac44e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f375f78710 con 0x55f3760167f0 2024-08-20T05:17:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.940+0000 7fa7ac44e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f375f7c750 con 0x55f37601bb60 2024-08-20T05:17:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.940+0000 7fa7a3200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f3760167f0 0x55f376018be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.940+0000 7fa79b400640 1 -- 172.21.15.37:0/4021150206 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa794043020 con 0x7fa7a4102490 2024-08-20T05:17:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.940+0000 7fa79be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f37601bb60 0x55f37601e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.940+0000 7fa7a3200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f3760167f0 0x55f376018be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33670/0 (socket says 172.21.15.37:33670) 2024-08-20T05:17:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.940+0000 7fa7a3200640 1 -- 172.21.15.37:0/1156363730 learned_addr learned my addr 172.21.15.37:0/1156363730 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.941+0000 7fa7a3200640 1 -- 172.21.15.37:0/1156363730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f37601bb60 msgr2=0x55f37601e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.941+0000 7fa7a3200640 1 --2- 172.21.15.37:0/1156363730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f37601bb60 0x55f37601e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.941+0000 7fa7a3200640 1 -- 172.21.15.37:0/1156363730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 msgr2=0x55f37601b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.941+0000 7fa7a3200640 1 --2- 172.21.15.37:0/1156363730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 0x55f37601b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.941+0000 7fa7a3200640 1 -- 172.21.15.37:0/1156363730 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f375f44de0 con 0x55f3760167f0 2024-08-20T05:17:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.941+0000 7fa7a3200640 1 --2- 172.21.15.37:0/1156363730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f3760167f0 0x55f376018be0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa79c011890 tx=0x7fa79c011d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f80b42a4765f419e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.941+0000 7fa793400640 1 -- 172.21.15.37:0/1156363730 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c011310 con 0x55f3760167f0 2024-08-20T05:17:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.941+0000 7fa793400640 1 -- 172.21.15.37:0/1156363730 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa79c00f9a0 con 0x55f3760167f0 2024-08-20T05:17:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.941+0000 7fa793400640 1 -- 172.21.15.37:0/1156363730 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0056b0 con 0x55f3760167f0 2024-08-20T05:17:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.942+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1156363730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f3760167f0 msgr2=0x55f376018be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.942+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/1156363730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f3760167f0 0x55f376018be0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa79c011890 tx=0x7fa79c011d50 comp rx=0 tx=0).stop 2024-08-20T05:17:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.942+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1156363730 shutdown_connections 2024-08-20T05:17:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.942+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/1156363730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f37601bb60 0x55f37601e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.942+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/1156363730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 0x55f37601b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.942+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/1156363730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f3760167f0 0x55f376018be0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.942+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1156363730 >> 172.21.15.37:0/1156363730 conn(0x55f376011940 msgr2=0x55f3760126d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.942+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1156363730 shutdown_connections 2024-08-20T05:17:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.942+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1156363730 wait complete. 2024-08-20T05:17:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.942+0000 7fa79b400640 1 --2- 172.21.15.37:0/4021150206 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa7880b3b60 0x7fa7880b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.943+0000 7fa7ac44e740 1 -- start start 2024-08-20T05:17:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.943+0000 7fa79b400640 1 -- 172.21.15.37:0/4021150206 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa794103180 con 0x7fa7a4102490 2024-08-20T05:17:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.943+0000 7fa7a3200640 1 --2- 172.21.15.37:0/4021150206 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa7880b3b60 0x7fa7880b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.943+0000 7fa7ac44e740 1 Processor -- start 2024-08-20T05:17:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.943+0000 7fa7ac44e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3760167f0 0x55f37601fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.943+0000 7fa7ac44e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 0x55f376020540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.943+0000 7fa7ac44e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f37601bb60 0x55f3760210f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.943+0000 7fa7ac44e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f375eb1ab0 con 0x55f376019120 2024-08-20T05:17:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.943+0000 7fa7ac44e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55f375f1f140 con 0x55f37601bb60 2024-08-20T05:17:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.943+0000 7fa7ac44e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55f37601eb40 con 0x55f3760167f0 2024-08-20T05:17:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.944+0000 7fa7ac44e740 10 client.0 _ll_register_callbacks cb 0x55f375f325d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.944+0000 7fa79be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 0x55f376020540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.944+0000 7fa7a3200640 1 --2- 172.21.15.37:0/4021150206 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa7880b3b60 0x7fa7880b6020 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa79c011860 tx=0x7fa79c009a30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.944+0000 7fa79be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 0x55f376020540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38024/0 (socket says 172.21.15.37:38024) 2024-08-20T05:17:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.944+0000 7fa79be00640 1 -- 172.21.15.37:0/1008548241 learned_addr learned my addr 172.21.15.37:0/1008548241 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.944+0000 7fa7a2800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3760167f0 0x55f37601fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.944+0000 7fa7a3200640 1 --2- 172.21.15.37:0/1008548241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f37601bb60 0x55f3760210f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.944+0000 7fa79be00640 1 -- 172.21.15.37:0/1008548241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3760167f0 msgr2=0x55f37601fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.944+0000 7fa79be00640 1 --2- 172.21.15.37:0/1008548241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3760167f0 0x55f37601fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.944+0000 7fa79be00640 1 -- 172.21.15.37:0/1008548241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f37601bb60 msgr2=0x55f3760210f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.944+0000 7fa79be00640 1 --2- 172.21.15.37:0/1008548241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f37601bb60 0x55f3760210f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.944+0000 7fa79be00640 1 -- 172.21.15.37:0/1008548241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f375f20170 con 0x55f376019120 2024-08-20T05:17:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.944+0000 7fa7a2800640 1 --2- 172.21.15.37:0/1008548241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3760167f0 0x55f37601fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.945+0000 7fa79be00640 1 --2- 172.21.15.37:0/1008548241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 0x55f376020540 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa78c011d10 tx=0x7fa78c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc2b214916ab5d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.945+0000 7fa787e00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:17:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.945+0000 7fa787e00640 1 -- 172.21.15.37:0/1008548241 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c004260 con 0x55f376019120 2024-08-20T05:17:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.945+0000 7fa787e00640 1 -- 172.21.15.37:0/1008548241 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa78c017070 con 0x55f376019120 2024-08-20T05:17:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.945+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1008548241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa79c00f9a0 con 0x55f376019120 2024-08-20T05:17:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.945+0000 7fa787e00640 1 -- 172.21.15.37:0/1008548241 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fa78c025050 con 0x55f376019120 2024-08-20T05:17:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.945+0000 7fa7ac44e740 10 client.18306 fetch_fsmap learned FSMap version 50 2024-08-20T05:17:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.945+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1008548241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55f375cdb790 con 0x55f376019120 2024-08-20T05:17:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.945+0000 7fa787e00640 1 -- 172.21.15.37:0/1008548241 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa79c00f9a0 con 0x55f376019120 2024-08-20T05:17:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.946+0000 7fa787e00640 1 -- 172.21.15.37:0/1008548241 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fa78c01a4a0 con 0x55f376019120 2024-08-20T05:17:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.946+0000 7fa7ac44e740 10 client.18306 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:17:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.946+0000 7fa7ac44e740 10 client.18306 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:17:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.946+0000 7fa7ac44e740 20 client.18306 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.946+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/1008548241 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f37602bba0 0x55f37602dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.946+0000 7fa7ac44e740 4 client.18306 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:17:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.946+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1008548241 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f375f8b160 con 0x55f37602bba0 2024-08-20T05:17:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.946+0000 7fa7a2800640 1 --2- 172.21.15.37:0/1008548241 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f37602bba0 0x55f37602dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.947+0000 7fa7a2800640 1 --2- 172.21.15.37:0/1008548241 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f37602bba0 0x55f37602dfe0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c2b49970b2c4baa server_cookie=651112c2738aa3a3 in_seq=0 out_seq=0 2024-08-20T05:17:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.947+0000 7fa787e00640 10 client.18306 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.947+0000 7fa787e00640 1 -- 172.21.15.37:0/1008548241 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f375f8b160 con 0x55f37602bba0 2024-08-20T05:17:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.947+0000 7fa787e00640 10 client.18306 handle_command_reply: tid=0 2024-08-20T05:17:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.947+0000 7fa7ac44e740 1 client.18306 shutdown 2024-08-20T05:17:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.948+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1008548241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 msgr2=0x55f376020540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.948+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/1008548241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 0x55f376020540 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa78c011d10 tx=0x7fa78c00f790 comp rx=0 tx=0).stop 2024-08-20T05:17:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.948+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1008548241 shutdown_connections 2024-08-20T05:17:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.948+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/1008548241 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f37602bba0 0x55f37602dfe0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.948+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/1008548241 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f37601bb60 0x55f3760210f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.948+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/1008548241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 0x55f376020540 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.948+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/1008548241 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3760167f0 0x55f37601fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.948+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1008548241 >> 172.21.15.37:0/1008548241 conn(0x55f376011940 msgr2=0x55f3760109b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.948+0000 7fa787e00640 0 client.18306 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.948+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1008548241 shutdown_connections 2024-08-20T05:17:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.948+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1008548241 wait complete. 2024-08-20T05:17:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.948+0000 7fa7ac44e740 20 client.18306 trim_cache size 0 max 16384 2024-08-20T05:17:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.963+0000 7fa7ac44e740 1 Processor -- start 2024-08-20T05:17:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.963+0000 7fa7ac44e740 1 -- start start 2024-08-20T05:17:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.964+0000 7fa7ac44e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3760167f0 0x55f37601fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.964+0000 7fa7ac44e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 0x55f3760203e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.964+0000 7fa7ac44e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f37601bb60 0x55f37601cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.964+0000 7fa7ac44e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a41ad290 con 0x55f376019120 2024-08-20T05:17:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.964+0000 7fa7ac44e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a41aee30 con 0x55f37601bb60 2024-08-20T05:17:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.964+0000 7fa7ac44e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a41ad960 con 0x55f3760167f0 2024-08-20T05:17:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.964+0000 7fa79be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 0x55f3760203e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.964+0000 7fa79be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 0x55f3760203e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38038/0 (socket says 172.21.15.37:38038) 2024-08-20T05:17:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.964+0000 7fa79be00640 1 -- 172.21.15.37:0/1494071676 learned_addr learned my addr 172.21.15.37:0/1494071676 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.964+0000 7fa7a2800640 1 --2- 172.21.15.37:0/1494071676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3760167f0 0x55f37601fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.964+0000 7fa7a3200640 1 --2- 172.21.15.37:0/1494071676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f37601bb60 0x55f37601cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.964+0000 7fa79be00640 1 -- 172.21.15.37:0/1494071676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3760167f0 msgr2=0x55f37601fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.964+0000 7fa79be00640 1 --2- 172.21.15.37:0/1494071676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3760167f0 0x55f37601fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.964+0000 7fa79be00640 1 -- 172.21.15.37:0/1494071676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f37601bb60 msgr2=0x55f37601cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.964+0000 7fa79be00640 1 --2- 172.21.15.37:0/1494071676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f37601bb60 0x55f37601cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.964+0000 7fa79be00640 1 -- 172.21.15.37:0/1494071676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f376012ba0 con 0x55f376019120 2024-08-20T05:17:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.965+0000 7fa79be00640 1 --2- 172.21.15.37:0/1494071676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 0x55f3760203e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa78c000c00 tx=0x7fa78c005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecfcf1faf0f528c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.965+0000 7fa792a00640 1 -- 172.21.15.37:0/1494071676 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c02f020 con 0x55f376019120 2024-08-20T05:17:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.965+0000 7fa792a00640 1 -- 172.21.15.37:0/1494071676 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa78c01ab30 con 0x55f376019120 2024-08-20T05:17:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.965+0000 7fa792a00640 1 -- 172.21.15.37:0/1494071676 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c003850 con 0x55f376019120 2024-08-20T05:17:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.965+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1494071676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 msgr2=0x55f3760203e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.965+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/1494071676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 0x55f3760203e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa78c000c00 tx=0x7fa78c005990 comp rx=0 tx=0).stop 2024-08-20T05:17:16.971 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.966+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1494071676 shutdown_connections 2024-08-20T05:17:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.966+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/1494071676 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f37601bb60 0x55f37601cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.966+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/1494071676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f376019120 0x55f3760203e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.966+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/1494071676 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f3760167f0 0x55f37601fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.966+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1494071676 >> 172.21.15.37:0/1494071676 conn(0x55f376011940 msgr2=0x55f37601bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.966+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1494071676 shutdown_connections 2024-08-20T05:17:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.966+0000 7fa7ac44e740 1 -- 172.21.15.37:0/1494071676 wait complete. 2024-08-20T05:17:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.966+0000 7fa7ac44e740 1 -- start start 2024-08-20T05:17:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.966+0000 7fa7ac44e740 1 Processor -- start 2024-08-20T05:17:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.967+0000 7fa7ac44e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3760167f0 0x55f376027680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.967+0000 7fa7ac44e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f376019120 0x55f376026380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.967+0000 7fa7ac44e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f37601bb60 0x55f3760268c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.967+0000 7fa7ac44e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a41ae760 con 0x55f3760167f0 2024-08-20T05:17:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.967+0000 7fa7ac44e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a41ae030 con 0x55f376019120 2024-08-20T05:17:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.967+0000 7fa7ac44e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a41ab270 con 0x55f37601bb60 2024-08-20T05:17:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.967+0000 7fa7ac44e740 10 client.0 _ll_register_callbacks cb 0x7fa78c011920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.967+0000 7fa79be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f376019120 0x55f376026380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.967+0000 7fa7a2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3760167f0 0x55f376027680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.967+0000 7fa79be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f376019120 0x55f376026380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33708/0 (socket says 172.21.15.37:33708) 2024-08-20T05:17:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.967+0000 7fa79be00640 1 -- 172.21.15.37:0/3372408486 learned_addr learned my addr 172.21.15.37:0/3372408486 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.967+0000 7fa7a3200640 1 --2- 172.21.15.37:0/3372408486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f37601bb60 0x55f3760268c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.967+0000 7fa79be00640 1 -- 172.21.15.37:0/3372408486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f37601bb60 msgr2=0x55f3760268c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.967+0000 7fa79be00640 1 --2- 172.21.15.37:0/3372408486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f37601bb60 0x55f3760268c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.967+0000 7fa79be00640 1 -- 172.21.15.37:0/3372408486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3760167f0 msgr2=0x55f376027680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.967+0000 7fa79be00640 1 --2- 172.21.15.37:0/3372408486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3760167f0 0x55f376027680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.967+0000 7fa79be00640 1 -- 172.21.15.37:0/3372408486 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f376021460 con 0x55f376019120 2024-08-20T05:17:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.968+0000 7fa79be00640 1 --2- 172.21.15.37:0/3372408486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f376019120 0x55f376026380 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa78c011a30 tx=0x7fa78c00f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b998833b31402d44 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.968+0000 7fa787e00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:17:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.968+0000 7fa787e00640 1 -- 172.21.15.37:0/3372408486 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78c038070 con 0x55f376019120 2024-08-20T05:17:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.968+0000 7fa7ac44e740 1 -- 172.21.15.37:0/3372408486 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa78c01ab30 con 0x55f376019120 2024-08-20T05:17:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.968+0000 7fa787e00640 1 -- 172.21.15.37:0/3372408486 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa78c011e00 con 0x55f376019120 2024-08-20T05:17:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.968+0000 7fa787e00640 1 -- 172.21.15.37:0/3372408486 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fa78c044050 con 0x55f376019120 2024-08-20T05:17:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.968+0000 7fa7ac44e740 10 client.29042 fetch_fsmap learned FSMap version 50 2024-08-20T05:17:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.968+0000 7fa7ac44e740 1 -- 172.21.15.37:0/3372408486 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55f375d54620 con 0x55f376019120 2024-08-20T05:17:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.969+0000 7fa787e00640 1 -- 172.21.15.37:0/3372408486 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa78c01ab30 con 0x55f376019120 2024-08-20T05:17:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.969+0000 7fa787e00640 1 -- 172.21.15.37:0/3372408486 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7fa78c003cb0 con 0x55f376019120 2024-08-20T05:17:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.969+0000 7fa7ac44e740 10 client.29042 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:17:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.969+0000 7fa7ac44e740 10 client.29042 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:17:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.969+0000 7fa7ac44e740 20 client.29042 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.969+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/3372408486 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f376096df0 0x55f376099210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.969+0000 7fa7ac44e740 4 client.29042 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:17:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.969+0000 7fa7ac44e740 1 -- 172.21.15.37:0/3372408486 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f375f86c00 con 0x55f376096df0 2024-08-20T05:17:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.969+0000 7fa7a2800640 1 --2- 172.21.15.37:0/3372408486 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f376096df0 0x55f376099210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.970+0000 7fa7a2800640 1 --2- 172.21.15.37:0/3372408486 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f376096df0 0x55f376099210 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fe909eff9772c3 server_cookie=7b4619f1018b995b in_seq=0 out_seq=0 2024-08-20T05:17:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.970+0000 7fa787e00640 10 client.29042 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.978+0000 7fa787e00640 1 -- 172.21.15.37:0/3372408486 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f375f86c00 con 0x55f376096df0 2024-08-20T05:17:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.978+0000 7fa787e00640 10 client.29042 handle_command_reply: tid=0 2024-08-20T05:17:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.978+0000 7fa7ac44e740 1 client.29042 shutdown 2024-08-20T05:17:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.978+0000 7fa7ac44e740 1 -- 172.21.15.37:0/3372408486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f376019120 msgr2=0x55f376026380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.978+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/3372408486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f376019120 0x55f376026380 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa78c011a30 tx=0x7fa78c00f790 comp rx=0 tx=0).stop 2024-08-20T05:17:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.978+0000 7fa7ac44e740 1 -- 172.21.15.37:0/3372408486 shutdown_connections 2024-08-20T05:17:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.978+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/3372408486 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55f376096df0 0x55f376099210 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.978+0000 7fa787e00640 0 client.29042 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.978+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/3372408486 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55f37601bb60 0x55f3760268c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.978+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/3372408486 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55f376019120 0x55f376026380 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.978+0000 7fa7ac44e740 1 --2- 172.21.15.37:0/3372408486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f3760167f0 0x55f376027680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.978+0000 7fa7ac44e740 1 -- 172.21.15.37:0/3372408486 >> 172.21.15.37:0/3372408486 conn(0x55f376011940 msgr2=0x55f376010190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.978+0000 7fa7ac44e740 1 -- 172.21.15.37:0/3372408486 shutdown_connections 2024-08-20T05:17:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.979+0000 7fa7ac44e740 1 -- 172.21.15.37:0/3372408486 wait complete. 2024-08-20T05:17:16.981 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.979+0000 7fa7ac44e740 20 client.29042 trim_cache size 0 max 16384 2024-08-20T05:17:16.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:17:16.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:17:16.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:17:16.982 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:17:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.979+0000 7fa7a8a00640 1 -- 172.21.15.37:0/4021150206 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa7880b3b60 msgr2=0x7fa7880b6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.979+0000 7fa7a8a00640 1 --2- 172.21.15.37:0/4021150206 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa7880b3b60 0x7fa7880b6020 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fa79c011860 tx=0x7fa79c009a30 comp rx=0 tx=0).stop 2024-08-20T05:17:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.979+0000 7fa7a8a00640 1 -- 172.21.15.37:0/4021150206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7a4102490 msgr2=0x7fa7a419aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.979+0000 7fa7a8a00640 1 --2- 172.21.15.37:0/4021150206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7a4102490 0x7fa7a419aaa0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa79402a860 tx=0x7fa794032dc0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.979+0000 7fa7a8a00640 1 -- 172.21.15.37:0/4021150206 shutdown_connections 2024-08-20T05:17:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.979+0000 7fa7a8a00640 1 --2- 172.21.15.37:0/4021150206 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa7880b3b60 0x7fa7880b6020 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.979+0000 7fa7a8a00640 1 --2- 172.21.15.37:0/4021150206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7a4103fa0 0x7fa7a419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.979+0000 7fa7a8a00640 1 --2- 172.21.15.37:0/4021150206 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7a41035e0 0x7fa7a419b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.979+0000 7fa7a8a00640 1 --2- 172.21.15.37:0/4021150206 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7a4102490 0x7fa7a419aaa0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:16.983 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.979+0000 7fa7a8a00640 1 -- 172.21.15.37:0/4021150206 >> 172.21.15.37:0/4021150206 conn(0x7fa7a40fdd30 msgr2=0x7fa7a40750b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:16.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.979+0000 7fa7a8a00640 1 -- 172.21.15.37:0/4021150206 shutdown_connections 2024-08-20T05:17:16.984 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:16.980+0000 7fa7a8a00640 1 -- 172.21.15.37:0/4021150206 wait complete. 2024-08-20T05:17:17.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:17 smithi135 ceph-mon[22342]: pgmap v852: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 1.4 MiB/s wr, 157 op/s 2024-08-20T05:17:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:17 smithi130 ceph-mon[22007]: pgmap v852: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 1.4 MiB/s wr, 157 op/s 2024-08-20T05:17:18.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:17 smithi037 ceph-mon[17265]: pgmap v852: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 1.4 MiB/s wr, 157 op/s 2024-08-20T05:17:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:17:19.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:19 smithi135 ceph-mon[22342]: pgmap v853: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 1.2 MiB/s wr, 124 op/s 2024-08-20T05:17:19.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:19 smithi130 ceph-mon[22007]: pgmap v853: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 1.2 MiB/s wr, 124 op/s 2024-08-20T05:17:20.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:19 smithi037 ceph-mon[17265]: pgmap v853: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 1.2 MiB/s wr, 124 op/s 2024-08-20T05:17:20.750 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:17:21.174 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:17:21.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:21 smithi135 ceph-mon[22342]: pgmap v854: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 241 KiB/s wr, 45 op/s 2024-08-20T05:17:21.873 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:21 smithi037 ceph-mon[17265]: pgmap v854: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 241 KiB/s wr, 45 op/s 2024-08-20T05:17:21.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.945+0000 7fca9aa00640 1 -- 172.21.15.37:0/2135676357 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca840318a0 con 0x7fca9c1084c0 2024-08-20T05:17:21.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.946+0000 7fcaa2800640 1 -- 172.21.15.37:0/2135676357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca9c1084c0 msgr2=0x7fca9c108900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:21.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.946+0000 7fcaa2800640 1 --2- 172.21.15.37:0/2135676357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca9c1084c0 0x7fca9c108900 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fca84009900 tx=0x7fca8402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:17:21.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.946+0000 7fcaa2800640 1 -- 172.21.15.37:0/2135676357 shutdown_connections 2024-08-20T05:17:21.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.946+0000 7fcaa2800640 1 --2- 172.21.15.37:0/2135676357 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca9c108e40 0x7fca9c10f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:21.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.946+0000 7fcaa2800640 1 --2- 172.21.15.37:0/2135676357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca9c1084c0 0x7fca9c108900 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:21.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.946+0000 7fcaa2800640 1 --2- 172.21.15.37:0/2135676357 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca9c102ab0 0x7fca9c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:21.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.946+0000 7fcaa2800640 1 -- 172.21.15.37:0/2135676357 >> 172.21.15.37:0/2135676357 conn(0x7fca9c0fe500 msgr2=0x7fca9c100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:21.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.946+0000 7fcaa2800640 1 -- 172.21.15.37:0/2135676357 shutdown_connections 2024-08-20T05:17:21.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.946+0000 7fcaa2800640 1 -- 172.21.15.37:0/2135676357 wait complete. 2024-08-20T05:17:21.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.947+0000 7fcaa2800640 1 Processor -- start 2024-08-20T05:17:21.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.947+0000 7fcaa2800640 1 -- start start 2024-08-20T05:17:21.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.948+0000 7fcaa2800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca9c102ab0 0x7fca9c19b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:21.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.948+0000 7fcaa2800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca9c1084c0 0x7fca9c19b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:21.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.948+0000 7fcaa2800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca9c108e40 0x7fca9c1a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:21.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.948+0000 7fcaa2800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c076480 con 0x7fca9c108e40 2024-08-20T05:17:21.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.948+0000 7fcaa2800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c076300 con 0x7fca9c1084c0 2024-08-20T05:17:21.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.948+0000 7fcaa2800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fca9c076600 con 0x7fca9c102ab0 2024-08-20T05:17:21.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.948+0000 7fca9be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca9c108e40 0x7fca9c1a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:21.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.948+0000 7fca9be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca9c108e40 0x7fca9c1a0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38054/0 (socket says 172.21.15.37:38054) 2024-08-20T05:17:21.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.948+0000 7fca9be00640 1 -- 172.21.15.37:0/1220809755 learned_addr learned my addr 172.21.15.37:0/1220809755 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:21.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.948+0000 7fca92a00640 1 --2- 172.21.15.37:0/1220809755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca9c1084c0 0x7fca9c19b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:21.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.948+0000 7fca9b400640 1 --2- 172.21.15.37:0/1220809755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca9c102ab0 0x7fca9c19b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:21.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.949+0000 7fca9be00640 1 -- 172.21.15.37:0/1220809755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca9c102ab0 msgr2=0x7fca9c19b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:21.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.949+0000 7fca9be00640 1 --2- 172.21.15.37:0/1220809755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca9c102ab0 0x7fca9c19b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:21.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.949+0000 7fca9be00640 1 -- 172.21.15.37:0/1220809755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca9c1084c0 msgr2=0x7fca9c19b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:21.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.949+0000 7fca9be00640 1 --2- 172.21.15.37:0/1220809755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca9c1084c0 0x7fca9c19b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:21.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.949+0000 7fca9be00640 1 -- 172.21.15.37:0/1220809755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9c1a1360 con 0x7fca9c108e40 2024-08-20T05:17:21.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.949+0000 7fca9be00640 1 --2- 172.21.15.37:0/1220809755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca9c108e40 0x7fca9c1a0b90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fca9400eb10 tx=0x7fca9400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:21.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.949+0000 7fca98c00640 1 -- 172.21.15.37:0/1220809755 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94004b20 con 0x7fca9c108e40 2024-08-20T05:17:21.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.949+0000 7fca98c00640 1 -- 172.21.15.37:0/1220809755 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca94004cc0 con 0x7fca9c108e40 2024-08-20T05:17:21.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.949+0000 7fca98c00640 1 -- 172.21.15.37:0/1220809755 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca94010670 con 0x7fca9c108e40 2024-08-20T05:17:21.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.949+0000 7fcaa2800640 1 -- 172.21.15.37:0/1220809755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca9c1a1650 con 0x7fca9c108e40 2024-08-20T05:17:21.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.949+0000 7fcaa2800640 1 -- 172.21.15.37:0/1220809755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca9c1a7d10 con 0x7fca9c108e40 2024-08-20T05:17:21.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.950+0000 7fcaa2800640 1 -- 172.21.15.37:0/1220809755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca9c102e90 con 0x7fca9c108e40 2024-08-20T05:17:21.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.953+0000 7fca98c00640 1 -- 172.21.15.37:0/1220809755 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fca94005020 con 0x7fca9c108e40 2024-08-20T05:17:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:21 smithi130 ceph-mon[22007]: pgmap v854: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 241 KiB/s wr, 45 op/s 2024-08-20T05:17:21.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.954+0000 7fca98c00640 1 --2- 172.21.15.37:0/1220809755 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca800b3c50 0x7fca800b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:21.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.954+0000 7fca98c00640 1 -- 172.21.15.37:0/1220809755 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fca940e44c0 con 0x7fca9c108e40 2024-08-20T05:17:21.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.954+0000 7fca9b400640 1 --2- 172.21.15.37:0/1220809755 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca800b3c50 0x7fca800b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:21.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.955+0000 7fca9b400640 1 --2- 172.21.15.37:0/1220809755 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca800b3c50 0x7fca800b6110 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009bd0 tx=0x7fca8c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:21.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:21.958+0000 7fca98c00640 1 -- 172.21.15.37:0/1220809755 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fca940ab710 con 0x7fca9c108e40 2024-08-20T05:17:22.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:22.193+0000 7fcaa2800640 1 -- 172.21.15.37:0/1220809755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca9c1a8000 con 0x7fca9c108e40 2024-08-20T05:17:22.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:22.194+0000 7fca98c00640 1 -- 172.21.15.37:0/1220809755 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11983 (secure 0 0 0) 0x7fca940ab010 con 0x7fca9c108e40 2024-08-20T05:17:22.196 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:17:22.197 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":50,"btime":"2024-08-20T05:15:39:521784+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:15:39.110643+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:17:22.197 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 50 2024-08-20T05:17:22.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:22.197+0000 7fcaa2800640 1 -- 172.21.15.37:0/1220809755 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca800b3c50 msgr2=0x7fca800b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:22.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:22.197+0000 7fcaa2800640 1 --2- 172.21.15.37:0/1220809755 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca800b3c50 0x7fca800b6110 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009bd0 tx=0x7fca8c005f90 comp rx=0 tx=0).stop 2024-08-20T05:17:22.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:22.197+0000 7fcaa2800640 1 -- 172.21.15.37:0/1220809755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca9c108e40 msgr2=0x7fca9c1a0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:22.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:22.197+0000 7fcaa2800640 1 --2- 172.21.15.37:0/1220809755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca9c108e40 0x7fca9c1a0b90 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fca9400eb10 tx=0x7fca9400c2d0 comp rx=0 tx=0).stop 2024-08-20T05:17:22.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:22.197+0000 7fcaa2800640 1 -- 172.21.15.37:0/1220809755 shutdown_connections 2024-08-20T05:17:22.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:22.197+0000 7fcaa2800640 1 --2- 172.21.15.37:0/1220809755 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fca800b3c50 0x7fca800b6110 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:22.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:22.197+0000 7fcaa2800640 1 --2- 172.21.15.37:0/1220809755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca9c108e40 0x7fca9c1a0b90 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:22.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:22.197+0000 7fcaa2800640 1 --2- 172.21.15.37:0/1220809755 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fca9c1084c0 0x7fca9c19b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:22.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:22.197+0000 7fcaa2800640 1 --2- 172.21.15.37:0/1220809755 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fca9c102ab0 0x7fca9c19b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:22.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:22.197+0000 7fcaa2800640 1 -- 172.21.15.37:0/1220809755 >> 172.21.15.37:0/1220809755 conn(0x7fca9c0fe500 msgr2=0x7fca9c1062d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:22.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:22.197+0000 7fcaa2800640 1 -- 172.21.15.37:0/1220809755 shutdown_connections 2024-08-20T05:17:22.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:22.197+0000 7fcaa2800640 1 -- 172.21.15.37:0/1220809755 wait complete. 2024-08-20T05:17:22.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:22 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1220809755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:17:22.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:22 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1220809755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:17:23.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:22 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1220809755' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:17:23.046 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 865.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-08-20T05:17:23.700 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id 1b1803a4 --release --await' 2024-08-20T05:17:23.701 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id 1b1803a4 --release --await 2024-08-20T05:17:23.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:23 smithi135 ceph-mon[22342]: pgmap v855: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.7 KiB/s wr, 13 op/s 2024-08-20T05:17:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:23 smithi130 ceph-mon[22007]: pgmap v855: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.7 KiB/s wr, 13 op/s 2024-08-20T05:17:24.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:23 smithi037 ceph-mon[17265]: pgmap v855: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 6.7 KiB/s wr, 13 op/s 2024-08-20T05:17:24.087 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:17:24.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.687+0000 7f178b200640 1 -- 172.21.15.37:0/1534299976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f178c108330 msgr2=0x7f178c108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:24.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.687+0000 7f178b200640 1 --2- 172.21.15.37:0/1534299976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f178c108330 0x7f178c108770 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1778009900 tx=0x7f177802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.687+0000 7f178b200640 1 -- 172.21.15.37:0/1534299976 shutdown_connections 2024-08-20T05:17:24.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.687+0000 7f178b200640 1 --2- 172.21.15.37:0/1534299976 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f178c108cb0 0x7f178c10f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.687+0000 7f178b200640 1 --2- 172.21.15.37:0/1534299976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f178c108330 0x7f178c108770 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.687+0000 7f178b200640 1 --2- 172.21.15.37:0/1534299976 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f178c102920 0x7f178c102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.687+0000 7f178b200640 1 -- 172.21.15.37:0/1534299976 >> 172.21.15.37:0/1534299976 conn(0x7f178c0fe350 msgr2=0x7f178c100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.687+0000 7f178b200640 1 -- 172.21.15.37:0/1534299976 shutdown_connections 2024-08-20T05:17:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.687+0000 7f178b200640 1 -- 172.21.15.37:0/1534299976 wait complete. 2024-08-20T05:17:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.688+0000 7f178b200640 1 Processor -- start 2024-08-20T05:17:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.688+0000 7f178b200640 1 -- start start 2024-08-20T05:17:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.689+0000 7f178b200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f178c102920 0x7f178c198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.689+0000 7f178b200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f178c108330 0x7f178c199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.689+0000 7f178b200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f178c108cb0 0x7f178c19e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.689+0000 7f178b200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f178c1129c0 con 0x7f178c108330 2024-08-20T05:17:24.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.689+0000 7f178b200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f178c112840 con 0x7f178c102920 2024-08-20T05:17:24.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.689+0000 7f178b200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f178c112b40 con 0x7f178c108cb0 2024-08-20T05:17:24.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.689+0000 7f1789400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f178c108330 0x7f178c199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.689+0000 7f1789e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f178c102920 0x7f178c198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.689+0000 7f1789e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f178c102920 0x7f178c198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:48772/0 (socket says 172.21.15.37:48772) 2024-08-20T05:17:24.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.689+0000 7f1789e00640 1 -- 172.21.15.37:0/902103110 learned_addr learned my addr 172.21.15.37:0/902103110 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:24.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.689+0000 7f178a800640 1 --2- 172.21.15.37:0/902103110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f178c108cb0 0x7f178c19e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.689+0000 7f1789e00640 1 -- 172.21.15.37:0/902103110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f178c108cb0 msgr2=0x7f178c19e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:24.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.689+0000 7f1789e00640 1 --2- 172.21.15.37:0/902103110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f178c108cb0 0x7f178c19e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.689+0000 7f1789e00640 1 -- 172.21.15.37:0/902103110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f178c108330 msgr2=0x7f178c199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:24.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.689+0000 7f1789e00640 1 --2- 172.21.15.37:0/902103110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f178c108330 0x7f178c199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.689+0000 7f1789e00640 1 -- 172.21.15.37:0/902103110 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178c19edc0 con 0x7f178c102920 2024-08-20T05:17:24.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.689+0000 7f178a800640 1 --2- 172.21.15.37:0/902103110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f178c108cb0 0x7f178c19e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:17:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.690+0000 7f1789e00640 1 --2- 172.21.15.37:0/902103110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f178c102920 0x7f178c198d10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f177c00d950 tx=0x7f177c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.690+0000 7f1782a00640 1 -- 172.21.15.37:0/902103110 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c017070 con 0x7f178c102920 2024-08-20T05:17:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.690+0000 7f178b200640 1 -- 172.21.15.37:0/902103110 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f178c19f0b0 con 0x7f178c102920 2024-08-20T05:17:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.690+0000 7f1782a00640 1 -- 172.21.15.37:0/902103110 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f177c009c30 con 0x7f178c102920 2024-08-20T05:17:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.690+0000 7f1782a00640 1 -- 172.21.15.37:0/902103110 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c00f620 con 0x7f178c102920 2024-08-20T05:17:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.690+0000 7f178b200640 1 -- 172.21.15.37:0/902103110 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f178c1a5940 con 0x7f178c102920 2024-08-20T05:17:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.693+0000 7f17933e7740 1 Processor -- start 2024-08-20T05:17:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.693+0000 7f17933e7740 1 -- start start 2024-08-20T05:17:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.693+0000 7f17933e7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c8e80 0x556c2e2c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.693+0000 7f17933e7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c97a0 0x556c2e2d9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.693+0000 7f17933e7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2d9b40 0x556c2e2dbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.693+0000 7f17933e7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556c2e26a670 con 0x556c2e2d9b40 2024-08-20T05:17:24.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.693+0000 7f17933e7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556c2e23ed70 con 0x556c2e2c97a0 2024-08-20T05:17:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.693+0000 7f17933e7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556c2e22e270 con 0x556c2e2c8e80 2024-08-20T05:17:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.694+0000 7f1782a00640 1 -- 172.21.15.37:0/902103110 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f177c010460 con 0x7f178c102920 2024-08-20T05:17:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.694+0000 7f1789400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2d9b40 0x556c2e2dbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.694+0000 7f1789400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2d9b40 0x556c2e2dbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38942/0 (socket says 172.21.15.37:38942) 2024-08-20T05:17:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.694+0000 7f1789400640 1 -- 172.21.15.37:0/414625029 learned_addr learned my addr 172.21.15.37:0/414625029 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.694+0000 7f178a800640 1 --2- 172.21.15.37:0/414625029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c8e80 0x556c2e2c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.694+0000 7f1789e00640 1 --2- 172.21.15.37:0/414625029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c97a0 0x556c2e2d9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.694+0000 7f1789400640 1 -- 172.21.15.37:0/414625029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c8e80 msgr2=0x556c2e2c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.694+0000 7f1789400640 1 --2- 172.21.15.37:0/414625029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c8e80 0x556c2e2c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.694+0000 7f1789400640 1 -- 172.21.15.37:0/414625029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c97a0 msgr2=0x556c2e2d9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.694+0000 7f1789400640 1 --2- 172.21.15.37:0/414625029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c97a0 0x556c2e2d9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.694+0000 7f1789400640 1 -- 172.21.15.37:0/414625029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c2e1ca870 con 0x556c2e2d9b40 2024-08-20T05:17:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.694+0000 7f178a800640 1 --2- 172.21.15.37:0/414625029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c8e80 0x556c2e2c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.694+0000 7f1789e00640 1 --2- 172.21.15.37:0/414625029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c97a0 0x556c2e2d9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:17:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.695+0000 7f1789400640 1 --2- 172.21.15.37:0/414625029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2d9b40 0x556c2e2dbf30 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f1778000c00 tx=0x7f1778004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7badd3bbb3d7797 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.695+0000 7f1777000640 1 -- 172.21.15.37:0/414625029 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1778035040 con 0x556c2e2d9b40 2024-08-20T05:17:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.695+0000 7f1777000640 1 -- 172.21.15.37:0/414625029 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17780054f0 con 0x556c2e2d9b40 2024-08-20T05:17:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.695+0000 7f1777000640 1 -- 172.21.15.37:0/414625029 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1778003850 con 0x556c2e2d9b40 2024-08-20T05:17:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.696+0000 7f17933e7740 1 -- 172.21.15.37:0/414625029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2d9b40 msgr2=0x556c2e2dbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.696+0000 7f17933e7740 1 --2- 172.21.15.37:0/414625029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2d9b40 0x556c2e2dbf30 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f1778000c00 tx=0x7f1778004180 comp rx=0 tx=0).stop 2024-08-20T05:17:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.696+0000 7f17933e7740 1 -- 172.21.15.37:0/414625029 shutdown_connections 2024-08-20T05:17:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.696+0000 7f17933e7740 1 --2- 172.21.15.37:0/414625029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2d9b40 0x556c2e2dbf30 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.696+0000 7f17933e7740 1 --2- 172.21.15.37:0/414625029 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c97a0 0x556c2e2d9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.696+0000 7f17933e7740 1 --2- 172.21.15.37:0/414625029 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c8e80 0x556c2e2c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.696+0000 7f17933e7740 1 -- 172.21.15.37:0/414625029 >> 172.21.15.37:0/414625029 conn(0x556c2e2c6cb0 msgr2=0x556c2e2c7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.696+0000 7f17933e7740 1 -- 172.21.15.37:0/414625029 shutdown_connections 2024-08-20T05:17:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.696+0000 7f17933e7740 1 -- 172.21.15.37:0/414625029 wait complete. 2024-08-20T05:17:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.696+0000 7f1782a00640 1 --2- 172.21.15.37:0/902103110 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f17700b3c00 0x7f17700b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.696+0000 7f17933e7740 1 -- start start 2024-08-20T05:17:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.696+0000 7f1782a00640 1 -- 172.21.15.37:0/902103110 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f177c0e3bc0 con 0x7f178c102920 2024-08-20T05:17:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.696+0000 7f178a800640 1 --2- 172.21.15.37:0/902103110 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f17700b3c00 0x7f17700b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.696+0000 7f17933e7740 1 Processor -- start 2024-08-20T05:17:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.697+0000 7f17933e7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c8e80 0x556c2e2d9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.697+0000 7f17933e7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c97a0 0x556c2e2d67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.697+0000 7f17933e7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2d9b40 0x556c2e2d6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.697+0000 7f17933e7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556c2e1b4ff0 con 0x556c2e2d9b40 2024-08-20T05:17:24.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.697+0000 7f17933e7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x556c2e2322b0 con 0x556c2e2c8e80 2024-08-20T05:17:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.697+0000 7f17933e7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x556c2e090bb0 con 0x556c2e2c97a0 2024-08-20T05:17:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.697+0000 7f17933e7740 10 client.0 _ll_register_callbacks cb 0x556c2df39d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.697+0000 7f178a800640 1 --2- 172.21.15.37:0/902103110 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f17700b3c00 0x7f17700b60c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1784005fd0 tx=0x7f1784009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.697+0000 7f1789400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c97a0 0x556c2e2d67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.697+0000 7f1789400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c97a0 0x556c2e2d67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50502/0 (socket says 172.21.15.37:50502) 2024-08-20T05:17:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.697+0000 7f1789400640 1 -- 172.21.15.37:0/3923929578 learned_addr learned my addr 172.21.15.37:0/3923929578 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.697+0000 7f1789e00640 1 --2- 172.21.15.37:0/3923929578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c8e80 0x556c2e2d9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.697+0000 7f178a800640 1 --2- 172.21.15.37:0/3923929578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2d9b40 0x556c2e2d6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.698+0000 7f1789400640 1 -- 172.21.15.37:0/3923929578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c8e80 msgr2=0x556c2e2d9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.698+0000 7f1789400640 1 --2- 172.21.15.37:0/3923929578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c8e80 0x556c2e2d9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.698+0000 7f1789400640 1 -- 172.21.15.37:0/3923929578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2d9b40 msgr2=0x556c2e2d6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:24.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.698+0000 7f1789400640 1 --2- 172.21.15.37:0/3923929578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2d9b40 0x556c2e2d6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.698+0000 7f1789400640 1 -- 172.21.15.37:0/3923929578 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c2df8db00 con 0x556c2e2c97a0 2024-08-20T05:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.698+0000 7f178a800640 1 --2- 172.21.15.37:0/3923929578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2d9b40 0x556c2e2d6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.698+0000 7f1789e00640 1 --2- 172.21.15.37:0/3923929578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c8e80 0x556c2e2d9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.698+0000 7f1789400640 1 --2- 172.21.15.37:0/3923929578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c97a0 0x556c2e2d67a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1778031440 tx=0x7f17780058d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71f328c95e2aa3e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.698+0000 7f176b400640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.698+0000 7f176b400640 1 -- 172.21.15.37:0/3923929578 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1778052060 con 0x556c2e2c97a0 2024-08-20T05:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.698+0000 7f17933e7740 1 -- 172.21.15.37:0/3923929578 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17780054f0 con 0x556c2e2c97a0 2024-08-20T05:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.699+0000 7f176b400640 1 -- 172.21.15.37:0/3923929578 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f1778004ec0 con 0x556c2e2c97a0 2024-08-20T05:17:24.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.699+0000 7f176b400640 1 -- 172.21.15.37:0/3923929578 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f1778035070 con 0x556c2e2c97a0 2024-08-20T05:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.699+0000 7f17933e7740 10 client.29089 fetch_fsmap learned FSMap version 50 2024-08-20T05:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.699+0000 7f17933e7740 1 -- 172.21.15.37:0/3923929578 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x556c2e004960 con 0x556c2e2c97a0 2024-08-20T05:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.699+0000 7f176b400640 1 -- 172.21.15.37:0/3923929578 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17780054f0 con 0x556c2e2c97a0 2024-08-20T05:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.699+0000 7f176b400640 1 -- 172.21.15.37:0/3923929578 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f17780314a0 con 0x556c2e2c97a0 2024-08-20T05:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.699+0000 7f17933e7740 10 client.29089 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.699+0000 7f17933e7740 10 client.29089 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.699+0000 7f17933e7740 20 client.29089 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.699+0000 7f17933e7740 1 --2- 172.21.15.37:0/3923929578 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556c2e2e8fe0 0x556c2e2eb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.700+0000 7f17933e7740 4 client.29089 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.700+0000 7f17933e7740 1 -- 172.21.15.37:0/3923929578 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c2e240cc0 con 0x556c2e2e8fe0 2024-08-20T05:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.700+0000 7f1789e00640 1 --2- 172.21.15.37:0/3923929578 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556c2e2e8fe0 0x556c2e2eb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.700+0000 7f1789e00640 1 --2- 172.21.15.37:0/3923929578 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556c2e2e8fe0 0x556c2e2eb3d0 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0b408de7497d262 server_cookie=d2119188b69052ec in_seq=0 out_seq=0 2024-08-20T05:17:24.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.700+0000 7f176b400640 10 client.29089 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:24.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.701+0000 7f176b400640 1 -- 172.21.15.37:0/3923929578 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556c2e240cc0 con 0x556c2e2e8fe0 2024-08-20T05:17:24.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.701+0000 7f176b400640 10 client.29089 handle_command_reply: tid=0 2024-08-20T05:17:24.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.701+0000 7f17933e7740 1 client.29089 shutdown 2024-08-20T05:17:24.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.701+0000 7f17933e7740 1 -- 172.21.15.37:0/3923929578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c97a0 msgr2=0x556c2e2d67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:24.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.701+0000 7f17933e7740 1 --2- 172.21.15.37:0/3923929578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c97a0 0x556c2e2d67a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f1778031440 tx=0x7f17780058d0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.702+0000 7f17933e7740 1 -- 172.21.15.37:0/3923929578 shutdown_connections 2024-08-20T05:17:24.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.702+0000 7f17933e7740 1 --2- 172.21.15.37:0/3923929578 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556c2e2e8fe0 0x556c2e2eb3d0 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.702+0000 7f17933e7740 1 --2- 172.21.15.37:0/3923929578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2d9b40 0x556c2e2d6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.702+0000 7f17933e7740 1 --2- 172.21.15.37:0/3923929578 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c97a0 0x556c2e2d67a0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.702+0000 7f176b400640 0 client.29089 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:24.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.702+0000 7f17933e7740 1 --2- 172.21.15.37:0/3923929578 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c8e80 0x556c2e2d9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.702+0000 7f17933e7740 1 -- 172.21.15.37:0/3923929578 >> 172.21.15.37:0/3923929578 conn(0x556c2e2c6cb0 msgr2=0x556c2e2cc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:24.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.702+0000 7f17933e7740 1 -- 172.21.15.37:0/3923929578 shutdown_connections 2024-08-20T05:17:24.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.702+0000 7f17933e7740 1 -- 172.21.15.37:0/3923929578 wait complete. 2024-08-20T05:17:24.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.702+0000 7f17933e7740 20 client.29089 trim_cache size 0 max 16384 2024-08-20T05:17:24.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.720+0000 7f17933e7740 1 Processor -- start 2024-08-20T05:17:24.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.720+0000 7f17933e7740 1 -- start start 2024-08-20T05:17:24.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.720+0000 7f17933e7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2c8e80 0x556c2e2d84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.720+0000 7f17933e7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c97a0 0x556c2e2ee3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.720+0000 7f17933e7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2d9b40 0x556c2e2ee930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.720+0000 7f17933e7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f178c1ad300 con 0x556c2e2c8e80 2024-08-20T05:17:24.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.720+0000 7f17933e7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f178c1aeea0 con 0x556c2e2d9b40 2024-08-20T05:17:24.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.720+0000 7f17933e7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f178c1ad9d0 con 0x556c2e2c97a0 2024-08-20T05:17:24.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.721+0000 7f1789e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2c8e80 0x556c2e2d84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.721+0000 7f1789e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2c8e80 0x556c2e2d84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38968/0 (socket says 172.21.15.37:38968) 2024-08-20T05:17:24.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.721+0000 7f1789e00640 1 -- 172.21.15.37:0/22480266 learned_addr learned my addr 172.21.15.37:0/22480266 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:24.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.721+0000 7f1789400640 1 --2- 172.21.15.37:0/22480266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c97a0 0x556c2e2ee3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.721+0000 7f178a800640 1 --2- 172.21.15.37:0/22480266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2d9b40 0x556c2e2ee930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.721+0000 7f1789e00640 1 -- 172.21.15.37:0/22480266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c97a0 msgr2=0x556c2e2ee3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:24.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.721+0000 7f1789e00640 1 --2- 172.21.15.37:0/22480266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c97a0 0x556c2e2ee3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.721+0000 7f1789e00640 1 -- 172.21.15.37:0/22480266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2d9b40 msgr2=0x556c2e2ee930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:24.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.721+0000 7f1789e00640 1 --2- 172.21.15.37:0/22480266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2d9b40 0x556c2e2ee930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.721+0000 7f1789e00640 1 -- 172.21.15.37:0/22480266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c2e2d8f80 con 0x556c2e2c8e80 2024-08-20T05:17:24.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.721+0000 7f1789400640 1 --2- 172.21.15.37:0/22480266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c97a0 0x556c2e2ee3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:17:24.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.721+0000 7f1789e00640 1 --2- 172.21.15.37:0/22480266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2c8e80 0x556c2e2d84e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f177c0a7980 tx=0x7f177c0e1190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1520b994da6d3b65 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:24.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.722+0000 7f1776600640 1 -- 172.21.15.37:0/22480266 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c020040 con 0x556c2e2c8e80 2024-08-20T05:17:24.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.722+0000 7f1776600640 1 -- 172.21.15.37:0/22480266 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f177c0aa220 con 0x556c2e2c8e80 2024-08-20T05:17:24.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.722+0000 7f1776600640 1 -- 172.21.15.37:0/22480266 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c0b37c0 con 0x556c2e2c8e80 2024-08-20T05:17:24.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.722+0000 7f17933e7740 1 -- 172.21.15.37:0/22480266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2c8e80 msgr2=0x556c2e2d84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:24.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.722+0000 7f17933e7740 1 --2- 172.21.15.37:0/22480266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2c8e80 0x556c2e2d84e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f177c0a7980 tx=0x7f177c0e1190 comp rx=0 tx=0).stop 2024-08-20T05:17:24.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.722+0000 7f17933e7740 1 -- 172.21.15.37:0/22480266 shutdown_connections 2024-08-20T05:17:24.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.722+0000 7f17933e7740 1 --2- 172.21.15.37:0/22480266 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2d9b40 0x556c2e2ee930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.722+0000 7f17933e7740 1 --2- 172.21.15.37:0/22480266 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2c97a0 0x556c2e2ee3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.722+0000 7f17933e7740 1 --2- 172.21.15.37:0/22480266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2c8e80 0x556c2e2d84e0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.722+0000 7f17933e7740 1 -- 172.21.15.37:0/22480266 >> 172.21.15.37:0/22480266 conn(0x556c2e2c6cb0 msgr2=0x556c2e2d7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:24.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.722+0000 7f17933e7740 1 -- 172.21.15.37:0/22480266 shutdown_connections 2024-08-20T05:17:24.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.723+0000 7f17933e7740 1 -- 172.21.15.37:0/22480266 wait complete. 2024-08-20T05:17:24.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.723+0000 7f17933e7740 1 -- start start 2024-08-20T05:17:24.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.723+0000 7f17933e7740 1 Processor -- start 2024-08-20T05:17:24.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f17933e7740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c8e80 0x556c2e2eea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f17933e7740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2c97a0 0x556c2e2ebf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f17933e7740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2d9b40 0x556c2e2ec450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f17933e7740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f178c1ae7d0 con 0x556c2e2c97a0 2024-08-20T05:17:24.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f17933e7740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f178c1ae0a0 con 0x556c2e2c8e80 2024-08-20T05:17:24.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f17933e7740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f178c1ab2e0 con 0x556c2e2d9b40 2024-08-20T05:17:24.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f17933e7740 10 client.0 _ll_register_callbacks cb 0x7f17840096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:24.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f1789e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c8e80 0x556c2e2eea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f1789400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2c97a0 0x556c2e2ebf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f1789e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c8e80 0x556c2e2eea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:48800/0 (socket says 172.21.15.37:48800) 2024-08-20T05:17:24.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f1789e00640 1 -- 172.21.15.37:0/3985586719 learned_addr learned my addr 172.21.15.37:0/3985586719 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:24.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f178a800640 1 --2- 172.21.15.37:0/3985586719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2d9b40 0x556c2e2ec450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f1789e00640 1 -- 172.21.15.37:0/3985586719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2d9b40 msgr2=0x556c2e2ec450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:24.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f1789e00640 1 --2- 172.21.15.37:0/3985586719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2d9b40 0x556c2e2ec450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f1789e00640 1 -- 172.21.15.37:0/3985586719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2c97a0 msgr2=0x556c2e2ebf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:24.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f1789e00640 1 --2- 172.21.15.37:0/3985586719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2c97a0 0x556c2e2ebf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f1789e00640 1 -- 172.21.15.37:0/3985586719 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c2e2ecc80 con 0x556c2e2c8e80 2024-08-20T05:17:24.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.724+0000 7f1789400640 1 --2- 172.21.15.37:0/3985586719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2c97a0 0x556c2e2ebf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:24.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.725+0000 7f1789e00640 1 --2- 172.21.15.37:0/3985586719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c8e80 0x556c2e2eea20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f177c010cf0 tx=0x7f177c0e1260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97bb96055a009546 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:24.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.725+0000 7f176b400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:17:24.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.725+0000 7f176b400640 1 -- 172.21.15.37:0/3985586719 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c0c3020 con 0x556c2e2c8e80 2024-08-20T05:17:24.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.725+0000 7f176b400640 1 -- 172.21.15.37:0/3985586719 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f177c0cd0b0 con 0x556c2e2c8e80 2024-08-20T05:17:24.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.725+0000 7f17933e7740 1 -- 172.21.15.37:0/3985586719 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f177c0aa220 con 0x556c2e2c8e80 2024-08-20T05:17:24.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.725+0000 7f176b400640 1 -- 172.21.15.37:0/3985586719 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f177c020070 con 0x556c2e2c8e80 2024-08-20T05:17:24.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.725+0000 7f17933e7740 10 client.29066 fetch_fsmap learned FSMap version 50 2024-08-20T05:17:24.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.725+0000 7f17933e7740 1 -- 172.21.15.37:0/3985586719 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x556c2e353940 con 0x556c2e2c8e80 2024-08-20T05:17:24.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.726+0000 7f176b400640 1 -- 172.21.15.37:0/3985586719 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f177c0aa220 con 0x556c2e2c8e80 2024-08-20T05:17:24.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.726+0000 7f176b400640 1 -- 172.21.15.37:0/3985586719 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 50) ==== 8378+0+0 (secure 0 0 0) 0x7f177c0c7020 con 0x556c2e2c8e80 2024-08-20T05:17:24.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.726+0000 7f17933e7740 10 client.29066 fetch_fsmap finished waiting for FSMap version 50 2024-08-20T05:17:24.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.726+0000 7f17933e7740 10 client.29066 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:17:24.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.726+0000 7f17933e7740 20 client.29066 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:24.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.726+0000 7f17933e7740 1 --2- 172.21.15.37:0/3985586719 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556c2e353f60 0x556c2e356380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:24.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.726+0000 7f17933e7740 4 client.29066 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1b1803a4", "release": true, "await": true}] 2024-08-20T05:17:24.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.726+0000 7f17933e7740 1 -- 172.21.15.37:0/3985586719 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1b1803a4", "release": true, "await": true}) -- 0x556c2e23c760 con 0x556c2e353f60 2024-08-20T05:17:24.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.726+0000 7f1789400640 1 --2- 172.21.15.37:0/3985586719 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556c2e353f60 0x556c2e356380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:24.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.727+0000 7f1789400640 1 --2- 172.21.15.37:0/3985586719 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556c2e353f60 0x556c2e356380 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f470e26f6c844f9a server_cookie=999090e1ddeff064 in_seq=0 out_seq=0 2024-08-20T05:17:24.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.727+0000 7f176b400640 10 client.29066 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:24.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.756+0000 7f176b400640 1 -- 172.21.15.37:0/3985586719 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x556c2e23c760 con 0x556c2e353f60 2024-08-20T05:17:24.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.757+0000 7f176b400640 10 client.29066 handle_command_reply: tid=0 2024-08-20T05:17:24.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.757+0000 7f17933e7740 1 client.29066 shutdown 2024-08-20T05:17:24.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.757+0000 7f17933e7740 1 -- 172.21.15.37:0/3985586719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c8e80 msgr2=0x556c2e2eea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:24.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.757+0000 7f17933e7740 1 --2- 172.21.15.37:0/3985586719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c8e80 0x556c2e2eea20 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f177c010cf0 tx=0x7f177c0e1260 comp rx=0 tx=0).stop 2024-08-20T05:17:24.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.757+0000 7f17933e7740 1 -- 172.21.15.37:0/3985586719 shutdown_connections 2024-08-20T05:17:24.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.757+0000 7f17933e7740 1 --2- 172.21.15.37:0/3985586719 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x556c2e353f60 0x556c2e356380 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.757+0000 7f17933e7740 1 --2- 172.21.15.37:0/3985586719 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x556c2e2d9b40 0x556c2e2ec450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.757+0000 7f17933e7740 1 --2- 172.21.15.37:0/3985586719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556c2e2c97a0 0x556c2e2ebf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.757+0000 7f17933e7740 1 --2- 172.21.15.37:0/3985586719 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x556c2e2c8e80 0x556c2e2eea20 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.757+0000 7f176b400640 0 client.29066 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:24.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.757+0000 7f17933e7740 1 -- 172.21.15.37:0/3985586719 >> 172.21.15.37:0/3985586719 conn(0x556c2e2c6cb0 msgr2=0x556c2e2d85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:24.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.757+0000 7f17933e7740 1 -- 172.21.15.37:0/3985586719 shutdown_connections 2024-08-20T05:17:24.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.757+0000 7f17933e7740 1 -- 172.21.15.37:0/3985586719 wait complete. 2024-08-20T05:17:24.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.758+0000 7f17933e7740 20 client.29066 trim_cache size 0 max 16384 2024-08-20T05:17:24.761 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:17:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 50, 2024-08-20T05:17:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:17:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 56, 2024-08-20T05:17:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:17:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "1b1803a4": { 2024-08-20T05:17:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 56, 2024-08-20T05:17:24.761 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:17:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:17:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:17:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:17:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:17:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:17:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 140.0, 2024-08-20T05:17:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:17:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:17:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:17:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:17:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:17:24.762 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:17:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:17:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:17:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:17:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:17:24.763 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:17:24.763 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:17:24.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.758+0000 7f178b200640 1 -- 172.21.15.37:0/902103110 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f17700b3c00 msgr2=0x7f17700b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:24.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.758+0000 7f178b200640 1 --2- 172.21.15.37:0/902103110 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f17700b3c00 0x7f17700b60c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1784005fd0 tx=0x7f1784009800 comp rx=0 tx=0).stop 2024-08-20T05:17:24.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.758+0000 7f178b200640 1 -- 172.21.15.37:0/902103110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f178c102920 msgr2=0x7f178c198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:24.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.758+0000 7f178b200640 1 --2- 172.21.15.37:0/902103110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f178c102920 0x7f178c198d10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f177c00d950 tx=0x7f177c00de10 comp rx=0 tx=0).stop 2024-08-20T05:17:24.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.758+0000 7f178b200640 1 -- 172.21.15.37:0/902103110 shutdown_connections 2024-08-20T05:17:24.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.759+0000 7f178b200640 1 --2- 172.21.15.37:0/902103110 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f17700b3c00 0x7f17700b60c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.759+0000 7f178b200640 1 --2- 172.21.15.37:0/902103110 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f178c108cb0 0x7f178c19e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.759+0000 7f178b200640 1 --2- 172.21.15.37:0/902103110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f178c108330 0x7f178c199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.759+0000 7f178b200640 1 --2- 172.21.15.37:0/902103110 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f178c102920 0x7f178c198d10 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:24.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.759+0000 7f178b200640 1 -- 172.21.15.37:0/902103110 >> 172.21.15.37:0/902103110 conn(0x7f178c0fe350 msgr2=0x7f178c100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:24.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.759+0000 7f178b200640 1 -- 172.21.15.37:0/902103110 shutdown_connections 2024-08-20T05:17:24.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:24.759+0000 7f178b200640 1 -- 172.21.15.37:0/902103110 wait complete. 2024-08-20T05:17:25.808 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1b1803a4', total seconds elapsed: 25.1 2024-08-20T05:17:25.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:25 smithi135 ceph-mon[22342]: pgmap v856: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-08-20T05:17:25.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:25 smithi130 ceph-mon[22007]: pgmap v856: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-08-20T05:17:26.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:25 smithi037 ceph-mon[17265]: pgmap v856: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 12 KiB/s wr, 16 op/s 2024-08-20T05:17:27.505 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:17:27.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:27 smithi037 ceph-mon[17265]: pgmap v857: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-08-20T05:17:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:27 smithi130 ceph-mon[22007]: pgmap v857: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-08-20T05:17:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 870.0 s, 355.1 tps, lat 1219.215 ms stddev 4280.130 2024-08-20T05:17:28.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:27 smithi135 ceph-mon[22342]: pgmap v857: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 50 KiB/s wr, 18 op/s 2024-08-20T05:17:28.161 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:17:29.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:29 smithi130 ceph-mon[22007]: pgmap v858: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 487 KiB/s wr, 75 op/s 2024-08-20T05:17:30.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:29 smithi037 ceph-mon[17265]: pgmap v858: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 487 KiB/s wr, 75 op/s 2024-08-20T05:17:30.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:29 smithi135 ceph-mon[22342]: pgmap v858: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 487 KiB/s wr, 75 op/s 2024-08-20T05:17:30.156 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.154+0000 7f8f47400640 1 -- 172.21.15.37:0/4174954012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f401037d0 msgr2=0x7f8f40103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.154+0000 7f8f47400640 1 --2- 172.21.15.37:0/4174954012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f401037d0 0x7f8f40103c50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c009930 tx=0x7f8f2c02a420 comp rx=0 tx=0).stop 2024-08-20T05:17:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.154+0000 7f8f47400640 1 -- 172.21.15.37:0/4174954012 shutdown_connections 2024-08-20T05:17:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.154+0000 7f8f47400640 1 --2- 172.21.15.37:0/4174954012 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f40104190 0x7f8f4010ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.154+0000 7f8f47400640 1 --2- 172.21.15.37:0/4174954012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f401037d0 0x7f8f40103c50 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.154+0000 7f8f47400640 1 --2- 172.21.15.37:0/4174954012 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f40102680 0x7f8f40102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.154+0000 7f8f47400640 1 -- 172.21.15.37:0/4174954012 >> 172.21.15.37:0/4174954012 conn(0x7f8f400fdf40 msgr2=0x7f8f40100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.154+0000 7f8f47400640 1 -- 172.21.15.37:0/4174954012 shutdown_connections 2024-08-20T05:17:30.157 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.154+0000 7f8f47400640 1 -- 172.21.15.37:0/4174954012 wait complete. 2024-08-20T05:17:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.155+0000 7f8f47400640 1 Processor -- start 2024-08-20T05:17:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.155+0000 7f8f47400640 1 -- start start 2024-08-20T05:17:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.156+0000 7f8f47400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f40102680 0x7f8f4019ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.156+0000 7f8f47400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f401037d0 0x7f8f4019b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.156+0000 7f8f47400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f40104190 0x7f8f4019bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.156+0000 7f8f47400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4010e3c0 con 0x7f8f40102680 2024-08-20T05:17:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.156+0000 7f8f47400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4010e240 con 0x7f8f40104190 2024-08-20T05:17:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.156+0000 7f8f47400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8f4010e540 con 0x7f8f401037d0 2024-08-20T05:17:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.156+0000 7f8f44a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f40102680 0x7f8f4019ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.156+0000 7f8f44a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f40102680 0x7f8f4019ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38988/0 (socket says 172.21.15.37:38988) 2024-08-20T05:17:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.156+0000 7f8f44a00640 1 -- 172.21.15.37:0/734147444 learned_addr learned my addr 172.21.15.37:0/734147444 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:30.159 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.156+0000 7f8f3fe00640 1 --2- 172.21.15.37:0/734147444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f401037d0 0x7f8f4019b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.156+0000 7f8f45400640 1 --2- 172.21.15.37:0/734147444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f40104190 0x7f8f4019bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.157+0000 7f8f44a00640 1 -- 172.21.15.37:0/734147444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f401037d0 msgr2=0x7f8f4019b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.157+0000 7f8f44a00640 1 --2- 172.21.15.37:0/734147444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f401037d0 0x7f8f4019b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.157+0000 7f8f44a00640 1 -- 172.21.15.37:0/734147444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f40104190 msgr2=0x7f8f4019bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.157+0000 7f8f44a00640 1 --2- 172.21.15.37:0/734147444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f40104190 0x7f8f4019bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.160 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.157+0000 7f8f44a00640 1 -- 172.21.15.37:0/734147444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4019c870 con 0x7f8f40102680 2024-08-20T05:17:30.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.157+0000 7f8f44a00640 1 --2- 172.21.15.37:0/734147444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f40102680 0x7f8f4019ad30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400b4a0 tx=0x7f8f3400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:30.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.157+0000 7f8f3d600640 1 -- 172.21.15.37:0/734147444 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f34014070 con 0x7f8f40102680 2024-08-20T05:17:30.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.157+0000 7f8f3d600640 1 -- 172.21.15.37:0/734147444 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f34010ac0 con 0x7f8f40102680 2024-08-20T05:17:30.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.157+0000 7f8f3d600640 1 -- 172.21.15.37:0/734147444 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f34017c30 con 0x7f8f40102680 2024-08-20T05:17:30.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.157+0000 7f8f47400640 1 -- 172.21.15.37:0/734147444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f4019cb60 con 0x7f8f40102680 2024-08-20T05:17:30.161 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.157+0000 7f8f47400640 1 -- 172.21.15.37:0/734147444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f401a3230 con 0x7f8f40102680 2024-08-20T05:17:30.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.160+0000 7f8f4a27d740 1 Processor -- start 2024-08-20T05:17:30.162 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.161+0000 7f8f4a27d740 1 -- start start 2024-08-20T05:17:30.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.161+0000 7f8f4a27d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d75610 0x558063d77a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.163 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.161+0000 7f8f4a27d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d77f40 0x558063d7a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.161+0000 7f8f4a27d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d7a980 0x558063d7ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.161+0000 7f8f3d600640 1 -- 172.21.15.37:0/734147444 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8f34017070 con 0x7f8f40102680 2024-08-20T05:17:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.161+0000 7f8f4a27d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558063ce8210 con 0x558063d7a980 2024-08-20T05:17:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.161+0000 7f8f4a27d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558063cd7710 con 0x558063d75610 2024-08-20T05:17:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.161+0000 7f8f4a27d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558063cdb750 con 0x558063d77f40 2024-08-20T05:17:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.161+0000 7f8f45400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d75610 0x558063d77a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.161+0000 7f8f44a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d77f40 0x558063d7a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.161+0000 7f8f3fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d7a980 0x558063d7ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.161+0000 7f8f44a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d77f40 0x558063d7a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50554/0 (socket says 172.21.15.37:50554) 2024-08-20T05:17:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.161+0000 7f8f44a00640 1 -- 172.21.15.37:0/1483774634 learned_addr learned my addr 172.21.15.37:0/1483774634 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.161+0000 7f8f45400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d75610 0x558063d77a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:48818/0 (socket says 172.21.15.37:48818) 2024-08-20T05:17:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.162+0000 7f8f44a00640 1 -- 172.21.15.37:0/1483774634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d75610 msgr2=0x558063d77a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.162+0000 7f8f44a00640 1 --2- 172.21.15.37:0/1483774634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d75610 0x558063d77a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.162+0000 7f8f44a00640 1 -- 172.21.15.37:0/1483774634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d7a980 msgr2=0x558063d7ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.162+0000 7f8f44a00640 1 --2- 172.21.15.37:0/1483774634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d7a980 0x558063d7ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.162+0000 7f8f44a00640 1 -- 172.21.15.37:0/1483774634 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558063ca3de0 con 0x558063d77f40 2024-08-20T05:17:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.162+0000 7f8f3fe00640 1 --2- 172.21.15.37:0/1483774634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d7a980 0x558063d7ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.162+0000 7f8f44a00640 1 --2- 172.21.15.37:0/1483774634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d77f40 0x558063d7a330 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f8f340e9700 tx=0x7f8f340e97f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa0dc2c632a85adb server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:30.168 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.162+0000 7f8f31c00640 1 -- 172.21.15.37:0/1483774634 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f340f7070 con 0x558063d77f40 2024-08-20T05:17:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.162+0000 7f8f31c00640 1 -- 172.21.15.37:0/1483774634 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f340e3e00 con 0x558063d77f40 2024-08-20T05:17:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.162+0000 7f8f31c00640 1 -- 172.21.15.37:0/1483774634 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f340ef950 con 0x558063d77f40 2024-08-20T05:17:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.163+0000 7f8f3d600640 1 --2- 172.21.15.37:0/734147444 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8f280b3c50 0x7f8f280b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.163+0000 7f8f3d600640 1 -- 172.21.15.37:0/734147444 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8f340e3600 con 0x7f8f40102680 2024-08-20T05:17:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.163+0000 7f8f45400640 1 --2- 172.21.15.37:0/734147444 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8f280b3c50 0x7f8f280b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.163+0000 7f8f4a27d740 1 -- 172.21.15.37:0/1483774634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d77f40 msgr2=0x558063d7a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.163+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/1483774634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d77f40 0x558063d7a330 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f8f340e9700 tx=0x7f8f340e97f0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.164+0000 7f8f4a27d740 1 -- 172.21.15.37:0/1483774634 shutdown_connections 2024-08-20T05:17:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.164+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/1483774634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d7a980 0x558063d7ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.164+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/1483774634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d77f40 0x558063d7a330 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.164+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/1483774634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d75610 0x558063d77a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.169 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.164+0000 7f8f4a27d740 1 -- 172.21.15.37:0/1483774634 >> 172.21.15.37:0/1483774634 conn(0x558063d70760 msgr2=0x558063d714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.164+0000 7f8f4a27d740 1 -- 172.21.15.37:0/1483774634 shutdown_connections 2024-08-20T05:17:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.164+0000 7f8f4a27d740 1 -- 172.21.15.37:0/1483774634 wait complete. 2024-08-20T05:17:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.164+0000 7f8f45400640 1 --2- 172.21.15.37:0/734147444 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8f280b3c50 0x7f8f280b6110 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8f4019bab0 tx=0x7f8f38009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.164+0000 7f8f4a27d740 1 -- start start 2024-08-20T05:17:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.164+0000 7f8f4a27d740 1 Processor -- start 2024-08-20T05:17:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.165+0000 7f8f4a27d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d75610 0x558063d87550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.165+0000 7f8f4a27d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d77f40 0x558063d87bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.165+0000 7f8f4a27d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d7a980 0x558063d887c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.165+0000 7f8f4a27d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558063c10ab0 con 0x558063d75610 2024-08-20T05:17:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.165+0000 7f8f4a27d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558063c7e140 con 0x558063d77f40 2024-08-20T05:17:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.165+0000 7f8f4a27d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558063d86170 con 0x558063d7a980 2024-08-20T05:17:30.170 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.165+0000 7f8f4a27d740 10 client.0 _ll_register_callbacks cb 0x558063c915d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.165+0000 7f8f44a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d75610 0x558063d87550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.165+0000 7f8f44a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d75610 0x558063d87550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39012/0 (socket says 172.21.15.37:39012) 2024-08-20T05:17:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.165+0000 7f8f44a00640 1 -- 172.21.15.37:0/3886758570 learned_addr learned my addr 172.21.15.37:0/3886758570 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.165+0000 7f8f3fe00640 1 --2- 172.21.15.37:0/3886758570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d77f40 0x558063d87bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.165+0000 7f8f45400640 1 --2- 172.21.15.37:0/3886758570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d7a980 0x558063d887c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.165+0000 7f8f44a00640 1 -- 172.21.15.37:0/3886758570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d7a980 msgr2=0x558063d887c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.165+0000 7f8f44a00640 1 --2- 172.21.15.37:0/3886758570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d7a980 0x558063d887c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.165+0000 7f8f44a00640 1 -- 172.21.15.37:0/3886758570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d77f40 msgr2=0x558063d87bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.165+0000 7f8f44a00640 1 --2- 172.21.15.37:0/3886758570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d77f40 0x558063d87bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.166+0000 7f8f44a00640 1 -- 172.21.15.37:0/3886758570 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558063c7f170 con 0x558063d75610 2024-08-20T05:17:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.166+0000 7f8f44a00640 1 --2- 172.21.15.37:0/3886758570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d75610 0x558063d87550 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8f340aa190 tx=0x7f8f340e6e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a3e72b6caf2c98 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:30.171 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.166+0000 7f8f26000640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:17:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.166+0000 7f8f26000640 1 -- 172.21.15.37:0/3886758570 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3401e070 con 0x558063d75610 2024-08-20T05:17:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.166+0000 7f8f26000640 1 -- 172.21.15.37:0/3886758570 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8f340e3c00 con 0x558063d75610 2024-08-20T05:17:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.166+0000 7f8f4a27d740 1 -- 172.21.15.37:0/3886758570 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f340e3e00 con 0x558063d75610 2024-08-20T05:17:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.166+0000 7f8f26000640 1 -- 172.21.15.37:0/3886758570 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f8f340a9fd0 con 0x558063d75610 2024-08-20T05:17:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.166+0000 7f8f4a27d740 10 client.18348 fetch_fsmap learned FSMap version 51 2024-08-20T05:17:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.166+0000 7f8f4a27d740 1 -- 172.21.15.37:0/3886758570 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x558063a3a790 con 0x558063d75610 2024-08-20T05:17:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.167+0000 7f8f26000640 1 -- 172.21.15.37:0/3886758570 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f340e3e00 con 0x558063d75610 2024-08-20T05:17:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.167+0000 7f8f26000640 1 -- 172.21.15.37:0/3886758570 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f8f34091070 con 0x558063d75610 2024-08-20T05:17:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.167+0000 7f8f4a27d740 10 client.18348 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T05:17:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.167+0000 7f8f4a27d740 10 client.18348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:17:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.167+0000 7f8f4a27d740 20 client.18348 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.167+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/3886758570 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558063d92d70 0x558063d95160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.167+0000 7f8f4a27d740 4 client.18348 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:17:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.167+0000 7f8f4a27d740 1 -- 172.21.15.37:0/3886758570 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558063cea160 con 0x558063d92d70 2024-08-20T05:17:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.167+0000 7f8f3fe00640 1 --2- 172.21.15.37:0/3886758570 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558063d92d70 0x558063d95160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.168+0000 7f8f3fe00640 1 --2- 172.21.15.37:0/3886758570 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558063d92d70 0x558063d95160 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=947c94e6ac3761fb server_cookie=a4fc4d3f4c7847a2 in_seq=0 out_seq=0 2024-08-20T05:17:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.168+0000 7f8f26000640 10 client.18348 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.168+0000 7f8f26000640 1 -- 172.21.15.37:0/3886758570 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558063cea160 con 0x558063d92d70 2024-08-20T05:17:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.168+0000 7f8f26000640 10 client.18348 handle_command_reply: tid=0 2024-08-20T05:17:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.169+0000 7f8f4a27d740 1 client.18348 shutdown 2024-08-20T05:17:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.169+0000 7f8f4a27d740 1 -- 172.21.15.37:0/3886758570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d75610 msgr2=0x558063d87550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.169+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/3886758570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d75610 0x558063d87550 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f8f340aa190 tx=0x7f8f340e6e10 comp rx=0 tx=0).stop 2024-08-20T05:17:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.169+0000 7f8f4a27d740 1 -- 172.21.15.37:0/3886758570 shutdown_connections 2024-08-20T05:17:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.169+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/3886758570 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558063d92d70 0x558063d95160 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.169+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/3886758570 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d7a980 0x558063d887c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.169+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/3886758570 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d77f40 0x558063d87bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.169+0000 7f8f26000640 0 client.18348 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.169+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/3886758570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d75610 0x558063d87550 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.169+0000 7f8f4a27d740 1 -- 172.21.15.37:0/3886758570 >> 172.21.15.37:0/3886758570 conn(0x558063d70760 msgr2=0x558063d6f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.169+0000 7f8f4a27d740 1 -- 172.21.15.37:0/3886758570 shutdown_connections 2024-08-20T05:17:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.169+0000 7f8f4a27d740 1 -- 172.21.15.37:0/3886758570 wait complete. 2024-08-20T05:17:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.169+0000 7f8f4a27d740 20 client.18348 trim_cache size 0 max 16384 2024-08-20T05:17:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.185+0000 7f8f4a27d740 1 Processor -- start 2024-08-20T05:17:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.185+0000 7f8f4a27d740 1 -- start start 2024-08-20T05:17:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.185+0000 7f8f4a27d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d75610 0x558063d735a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.185+0000 7f8f4a27d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d77f40 0x558063d8f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.185+0000 7f8f4a27d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d7a980 0x558063d73ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.185+0000 7f8f4a27d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8f401a9320 con 0x558063d77f40 2024-08-20T05:17:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.185+0000 7f8f4a27d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8f401aae90 con 0x558063d7a980 2024-08-20T05:17:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.185+0000 7f8f4a27d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8f401a99f0 con 0x558063d75610 2024-08-20T05:17:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.185+0000 7f8f3fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d77f40 0x558063d8f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.185+0000 7f8f44a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d75610 0x558063d735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.185+0000 7f8f44a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d75610 0x558063d735a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50574/0 (socket says 172.21.15.37:50574) 2024-08-20T05:17:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.185+0000 7f8f44a00640 1 -- 172.21.15.37:0/1051131946 learned_addr learned my addr 172.21.15.37:0/1051131946 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.186+0000 7f8f45400640 1 --2- 172.21.15.37:0/1051131946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d7a980 0x558063d73ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.186+0000 7f8f44a00640 1 -- 172.21.15.37:0/1051131946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d7a980 msgr2=0x558063d73ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.186+0000 7f8f44a00640 1 --2- 172.21.15.37:0/1051131946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d7a980 0x558063d73ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.186+0000 7f8f44a00640 1 -- 172.21.15.37:0/1051131946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d77f40 msgr2=0x558063d8f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.186+0000 7f8f44a00640 1 --2- 172.21.15.37:0/1051131946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d77f40 0x558063d8f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.186+0000 7f8f44a00640 1 -- 172.21.15.37:0/1051131946 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558063ab3620 con 0x558063d75610 2024-08-20T05:17:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.186+0000 7f8f3fe00640 1 --2- 172.21.15.37:0/1051131946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d77f40 0x558063d8f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.186+0000 7f8f44a00640 1 --2- 172.21.15.37:0/1051131946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d75610 0x558063d735a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8f340a6280 tx=0x7f8f340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0e1d2204fd07396 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.186+0000 7f8f31200640 1 -- 172.21.15.37:0/1051131946 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f3401e020 con 0x558063d75610 2024-08-20T05:17:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.186+0000 7f8f31200640 1 -- 172.21.15.37:0/1051131946 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f340a9d10 con 0x558063d75610 2024-08-20T05:17:30.190 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.186+0000 7f8f31200640 1 -- 172.21.15.37:0/1051131946 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f340092b0 con 0x558063d75610 2024-08-20T05:17:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.187+0000 7f8f4a27d740 1 -- 172.21.15.37:0/1051131946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d75610 msgr2=0x558063d735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.187+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/1051131946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d75610 0x558063d735a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8f340a6280 tx=0x7f8f340046c0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.187+0000 7f8f4a27d740 1 -- 172.21.15.37:0/1051131946 shutdown_connections 2024-08-20T05:17:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.187+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/1051131946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d7a980 0x558063d73ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.187+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/1051131946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d77f40 0x558063d8f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.187+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/1051131946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d75610 0x558063d735a0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.187+0000 7f8f4a27d740 1 -- 172.21.15.37:0/1051131946 >> 172.21.15.37:0/1051131946 conn(0x558063d70760 msgr2=0x558063d6f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.187+0000 7f8f4a27d740 1 -- 172.21.15.37:0/1051131946 shutdown_connections 2024-08-20T05:17:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.187+0000 7f8f4a27d740 1 -- 172.21.15.37:0/1051131946 wait complete. 2024-08-20T05:17:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.187+0000 7f8f4a27d740 1 -- start start 2024-08-20T05:17:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.187+0000 7f8f4a27d740 1 Processor -- start 2024-08-20T05:17:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.188+0000 7f8f4a27d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d75610 0x558063d8c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.188+0000 7f8f4a27d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d77f40 0x558063d8cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.188+0000 7f8f4a27d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d7a980 0x558063d8daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.188+0000 7f8f4a27d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8f401aa7c0 con 0x558063d75610 2024-08-20T05:17:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.188+0000 7f8f4a27d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8f401aa0c0 con 0x558063d77f40 2024-08-20T05:17:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.188+0000 7f8f4a27d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8f401a7320 con 0x558063d7a980 2024-08-20T05:17:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.188+0000 7f8f4a27d740 10 client.0 _ll_register_callbacks cb 0x7f8f340f5070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.188+0000 7f8f3fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d77f40 0x558063d8cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.188+0000 7f8f44a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d75610 0x558063d8c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.188+0000 7f8f3fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d77f40 0x558063d8cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:48842/0 (socket says 172.21.15.37:48842) 2024-08-20T05:17:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.188+0000 7f8f3fe00640 1 -- 172.21.15.37:0/939706672 learned_addr learned my addr 172.21.15.37:0/939706672 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.188+0000 7f8f45400640 1 --2- 172.21.15.37:0/939706672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d7a980 0x558063d8daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.188+0000 7f8f3fe00640 1 -- 172.21.15.37:0/939706672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d7a980 msgr2=0x558063d8daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.188+0000 7f8f3fe00640 1 --2- 172.21.15.37:0/939706672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d7a980 0x558063d8daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.188+0000 7f8f3fe00640 1 -- 172.21.15.37:0/939706672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d75610 msgr2=0x558063d8c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.188+0000 7f8f3fe00640 1 --2- 172.21.15.37:0/939706672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d75610 0x558063d8c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.188+0000 7f8f3fe00640 1 -- 172.21.15.37:0/939706672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558063d8e320 con 0x558063d77f40 2024-08-20T05:17:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.189+0000 7f8f44a00640 1 --2- 172.21.15.37:0/939706672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d75610 0x558063d8c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.189+0000 7f8f3fe00640 1 --2- 172.21.15.37:0/939706672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d77f40 0x558063d8cf20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c02a9e0 tx=0x7f8f2c004580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6edbe9b49461867 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.189+0000 7f8f26000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:17:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.189+0000 7f8f26000640 1 -- 172.21.15.37:0/939706672 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c035040 con 0x558063d77f40 2024-08-20T05:17:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.189+0000 7f8f4a27d740 1 -- 172.21.15.37:0/939706672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f340a9d10 con 0x558063d77f40 2024-08-20T05:17:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.189+0000 7f8f26000640 1 -- 172.21.15.37:0/939706672 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8f2c003ac0 con 0x558063d77f40 2024-08-20T05:17:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.189+0000 7f8f26000640 1 -- 172.21.15.37:0/939706672 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f8f2c003cc0 con 0x558063d77f40 2024-08-20T05:17:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.189+0000 7f8f4a27d740 10 client.29081 fetch_fsmap learned FSMap version 51 2024-08-20T05:17:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.189+0000 7f8f4a27d740 1 -- 172.21.15.37:0/939706672 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x558063d8f7e0 con 0x558063d77f40 2024-08-20T05:17:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.189+0000 7f8f26000640 1 -- 172.21.15.37:0/939706672 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f340a9d10 con 0x558063d77f40 2024-08-20T05:17:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.190+0000 7f8f26000640 1 -- 172.21.15.37:0/939706672 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f8f2c0464d0 con 0x558063d77f40 2024-08-20T05:17:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.190+0000 7f8f4a27d740 10 client.29081 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T05:17:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.190+0000 7f8f4a27d740 10 client.29081 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:17:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.190+0000 7f8f4a27d740 20 client.29081 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.190+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/939706672 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558063dfddd0 0x558063e001f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.190+0000 7f8f4a27d740 4 client.29081 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:17:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.190+0000 7f8f4a27d740 1 -- 172.21.15.37:0/939706672 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558063ce5c00 con 0x558063dfddd0 2024-08-20T05:17:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.190+0000 7f8f44a00640 1 --2- 172.21.15.37:0/939706672 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558063dfddd0 0x558063e001f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.190+0000 7f8f44a00640 1 --2- 172.21.15.37:0/939706672 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558063dfddd0 0x558063e001f0 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6079692103e5f1be server_cookie=75557b3c28c713f1 in_seq=0 out_seq=0 2024-08-20T05:17:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.190+0000 7f8f26000640 10 client.29081 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:30.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.412+0000 7f8f26000640 1 -- 172.21.15.37:0/939706672 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558063ce5c00 con 0x558063dfddd0 2024-08-20T05:17:30.415 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.412+0000 7f8f26000640 10 client.29081 handle_command_reply: tid=0 2024-08-20T05:17:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.412+0000 7f8f4a27d740 1 client.29081 shutdown 2024-08-20T05:17:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.413+0000 7f8f4a27d740 1 -- 172.21.15.37:0/939706672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d77f40 msgr2=0x558063d8cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.413+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/939706672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d77f40 0x558063d8cf20 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c02a9e0 tx=0x7f8f2c004580 comp rx=0 tx=0).stop 2024-08-20T05:17:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.413+0000 7f8f4a27d740 1 -- 172.21.15.37:0/939706672 shutdown_connections 2024-08-20T05:17:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.413+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/939706672 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558063dfddd0 0x558063e001f0 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.413+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/939706672 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558063d7a980 0x558063d8daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.413+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/939706672 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558063d77f40 0x558063d8cf20 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.413+0000 7f8f4a27d740 1 --2- 172.21.15.37:0/939706672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558063d75610 0x558063d8c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.413+0000 7f8f4a27d740 1 -- 172.21.15.37:0/939706672 >> 172.21.15.37:0/939706672 conn(0x558063d70760 msgr2=0x558063d99870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.413+0000 7f8f26000640 0 client.29081 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.413+0000 7f8f4a27d740 1 -- 172.21.15.37:0/939706672 shutdown_connections 2024-08-20T05:17:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.413+0000 7f8f4a27d740 1 -- 172.21.15.37:0/939706672 wait complete. 2024-08-20T05:17:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.414+0000 7f8f4a27d740 20 client.29081 trim_cache size 0 max 16384 2024-08-20T05:17:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:17:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:17:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:17:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:17:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.415+0000 7f8f47400640 1 -- 172.21.15.37:0/734147444 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8f280b3c50 msgr2=0x7f8f280b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.415+0000 7f8f47400640 1 --2- 172.21.15.37:0/734147444 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8f280b3c50 0x7f8f280b6110 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8f4019bab0 tx=0x7f8f38009500 comp rx=0 tx=0).stop 2024-08-20T05:17:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.415+0000 7f8f47400640 1 -- 172.21.15.37:0/734147444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f40102680 msgr2=0x7f8f4019ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.415+0000 7f8f47400640 1 --2- 172.21.15.37:0/734147444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f40102680 0x7f8f4019ad30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8f3400b4a0 tx=0x7f8f3400b960 comp rx=0 tx=0).stop 2024-08-20T05:17:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.415+0000 7f8f47400640 1 -- 172.21.15.37:0/734147444 shutdown_connections 2024-08-20T05:17:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.415+0000 7f8f47400640 1 --2- 172.21.15.37:0/734147444 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8f280b3c50 0x7f8f280b6110 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.415+0000 7f8f47400640 1 --2- 172.21.15.37:0/734147444 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8f40104190 0x7f8f4019bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.415+0000 7f8f47400640 1 --2- 172.21.15.37:0/734147444 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8f401037d0 0x7f8f4019b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.415+0000 7f8f47400640 1 --2- 172.21.15.37:0/734147444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f40102680 0x7f8f4019ad30 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.415+0000 7f8f47400640 1 -- 172.21.15.37:0/734147444 >> 172.21.15.37:0/734147444 conn(0x7f8f400fdf40 msgr2=0x7f8f400750b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.415+0000 7f8f47400640 1 -- 172.21.15.37:0/734147444 shutdown_connections 2024-08-20T05:17:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:30.415+0000 7f8f47400640 1 -- 172.21.15.37:0/734147444 wait complete. 2024-08-20T05:17:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.836+0000 7f0c76600640 1 -- 172.21.15.37:0/2440162853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7010b050 msgr2=0x7f0c70111850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.836+0000 7f0c76600640 1 --2- 172.21.15.37:0/2440162853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7010b050 0x7f0c70111850 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009ca0 tx=0x7f0c6802a8d0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.837+0000 7f0c76600640 1 -- 172.21.15.37:0/2440162853 shutdown_connections 2024-08-20T05:17:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.837+0000 7f0c76600640 1 --2- 172.21.15.37:0/2440162853 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7010b050 0x7f0c70111850 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.837+0000 7f0c76600640 1 --2- 172.21.15.37:0/2440162853 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c7010a6d0 0x7f0c7010ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.837+0000 7f0c76600640 1 --2- 172.21.15.37:0/2440162853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c70104cc0 0x7f0c701050a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.837+0000 7f0c76600640 1 -- 172.21.15.37:0/2440162853 >> 172.21.15.37:0/2440162853 conn(0x7f0c701006f0 msgr2=0x7f0c70102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:30.840 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:30 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:17:30.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.839+0000 7f0c76600640 1 -- 172.21.15.37:0/2440162853 shutdown_connections 2024-08-20T05:17:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.839+0000 7f0c76600640 1 -- 172.21.15.37:0/2440162853 wait complete. 2024-08-20T05:17:30.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.842+0000 7f0c76600640 1 Processor -- start 2024-08-20T05:17:30.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.842+0000 7f0c76600640 1 -- start start 2024-08-20T05:17:30.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.846+0000 7f0c76600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c70104cc0 0x7f0c70111500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.846+0000 7f0c76600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7010a6d0 0x7f0c7010e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.847+0000 7f0c76600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c7010b050 0x7f0c7010ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.847+0000 7f0c6f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c70104cc0 0x7f0c70111500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.847+0000 7f0c6f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c70104cc0 0x7f0c70111500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:48866/0 (socket says 172.21.15.37:48866) 2024-08-20T05:17:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.847+0000 7f0c67e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7010a6d0 0x7f0c7010e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.847+0000 7f0c67e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7010a6d0 0x7f0c7010e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:50602/0 (socket says 172.21.15.37:50602) 2024-08-20T05:17:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.847+0000 7f0c76600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0c70114cd0 con 0x7f0c7010b050 2024-08-20T05:17:30.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.847+0000 7f0c76600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0c70114b50 con 0x7f0c70104cc0 2024-08-20T05:17:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.847+0000 7f0c76600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0c70114e50 con 0x7f0c7010a6d0 2024-08-20T05:17:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.848+0000 7f0c6f400640 1 -- 172.21.15.37:0/3087561710 learned_addr learned my addr 172.21.15.37:0/3087561710 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:30.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.848+0000 7f0c6fe00640 1 --2- 172.21.15.37:0/3087561710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c7010b050 0x7f0c7010ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.849+0000 7f0c6f400640 1 -- 172.21.15.37:0/3087561710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7010a6d0 msgr2=0x7f0c7010e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.849+0000 7f0c6f400640 1 --2- 172.21.15.37:0/3087561710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7010a6d0 0x7f0c7010e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.849+0000 7f0c6f400640 1 -- 172.21.15.37:0/3087561710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c7010b050 msgr2=0x7f0c7010ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.849+0000 7f0c6f400640 1 --2- 172.21.15.37:0/3087561710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c7010b050 0x7f0c7010ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.849+0000 7f0c6f400640 1 -- 172.21.15.37:0/3087561710 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7010f490 con 0x7f0c70104cc0 2024-08-20T05:17:30.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.849+0000 7f0c67e00640 1 --2- 172.21.15.37:0/3087561710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7010a6d0 0x7f0c7010e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:30.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.849+0000 7f0c6f400640 1 --2- 172.21.15.37:0/3087561710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c70104cc0 0x7f0c70111500 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000c890 tx=0x7f0c6000cd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:30.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.849+0000 7f0c6cc00640 1 -- 172.21.15.37:0/3087561710 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60004220 con 0x7f0c70104cc0 2024-08-20T05:17:30.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.850+0000 7f0c6cc00640 1 -- 172.21.15.37:0/3087561710 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c600043c0 con 0x7f0c70104cc0 2024-08-20T05:17:30.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.850+0000 7f0c76600640 1 -- 172.21.15.37:0/3087561710 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c701a11f0 con 0x7f0c70104cc0 2024-08-20T05:17:30.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.850+0000 7f0c6cc00640 1 -- 172.21.15.37:0/3087561710 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c60004a00 con 0x7f0c70104cc0 2024-08-20T05:17:30.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.850+0000 7f0c76600640 1 -- 172.21.15.37:0/3087561710 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c701a1730 con 0x7f0c70104cc0 2024-08-20T05:17:30.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.856+0000 7f0c7908e740 1 Processor -- start 2024-08-20T05:17:30.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.856+0000 7f0c6cc00640 1 -- 172.21.15.37:0/3087561710 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0c600079b0 con 0x7f0c70104cc0 2024-08-20T05:17:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.857+0000 7f0c7908e740 1 -- start start 2024-08-20T05:17:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.859+0000 7f0c7908e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072d6900 0x558d072d6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.859+0000 7f0c7908e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072e2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.859+0000 7f0c7908e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072e31b0 0x558d072e55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.859+0000 7f0c7908e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558d0724ca60 con 0x558d072d6900 2024-08-20T05:17:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.859+0000 7f0c7908e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558d0723bf60 con 0x558d072d7220 2024-08-20T05:17:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.859+0000 7f0c7908e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558d0723ffa0 con 0x558d072e31b0 2024-08-20T05:17:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.860+0000 7f0c6f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072e2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.860+0000 7f0c67e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072e31b0 0x558d072e55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.860+0000 7f0c6cc00640 1 --2- 172.21.15.37:0/3087561710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0c540b3de0 0x7f0c540b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.861+0000 7f0c6f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072e2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:48880/0 (socket says 172.21.15.37:48880) 2024-08-20T05:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.861+0000 7f0c6f400640 1 -- 172.21.15.37:0/1327351319 learned_addr learned my addr 172.21.15.37:0/1327351319 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.861+0000 7f0c6cc00640 1 -- 172.21.15.37:0/3087561710 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0c600e3c70 con 0x7f0c70104cc0 2024-08-20T05:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.862+0000 7f0c67e00640 1 -- 172.21.15.37:0/1327351319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 msgr2=0x558d072e2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.862+0000 7f0c67e00640 1 --2- 172.21.15.37:0/1327351319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072e2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.862+0000 7f0c67e00640 1 -- 172.21.15.37:0/1327351319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072d6900 msgr2=0x558d072d6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.862+0000 7f0c67e00640 1 --2- 172.21.15.37:0/1327351319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072d6900 0x558d072d6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.862+0000 7f0c67e00640 1 -- 172.21.15.37:0/1327351319 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d071e23e0 con 0x558d072e31b0 2024-08-20T05:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.863+0000 7f0c67e00640 1 --2- 172.21.15.37:0/1327351319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072e31b0 0x558d072e55a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800bfb0 tx=0x7f0c58010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f72180d694a0d122 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.863+0000 7f0c64c00640 1 -- 172.21.15.37:0/1327351319 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c58004220 con 0x558d072e31b0 2024-08-20T05:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.863+0000 7f0c64c00640 1 -- 172.21.15.37:0/1327351319 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c580043c0 con 0x558d072e31b0 2024-08-20T05:17:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.863+0000 7f0c64c00640 1 -- 172.21.15.37:0/1327351319 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c58004220 con 0x558d072e31b0 2024-08-20T05:17:30.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.864+0000 7f0c6fe00640 1 --2- 172.21.15.37:0/3087561710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0c540b3de0 0x7f0c540b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.866+0000 7f0c7908e740 1 -- 172.21.15.37:0/1327351319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072e31b0 msgr2=0x558d072e55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.866+0000 7f0c7908e740 1 --2- 172.21.15.37:0/1327351319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072e31b0 0x558d072e55a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800bfb0 tx=0x7f0c58010860 comp rx=0 tx=0).stop 2024-08-20T05:17:30.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.869+0000 7f0c7908e740 1 -- 172.21.15.37:0/1327351319 shutdown_connections 2024-08-20T05:17:30.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.869+0000 7f0c7908e740 1 --2- 172.21.15.37:0/1327351319 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072e31b0 0x558d072e55a0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.869+0000 7f0c7908e740 1 --2- 172.21.15.37:0/1327351319 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072e2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.869+0000 7f0c7908e740 1 --2- 172.21.15.37:0/1327351319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072d6900 0x558d072d6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.869+0000 7f0c7908e740 1 -- 172.21.15.37:0/1327351319 >> 172.21.15.37:0/1327351319 conn(0x558d072d4730 msgr2=0x558d072d58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:30.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.869+0000 7f0c6fe00640 1 --2- 172.21.15.37:0/3087561710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0c540b3de0 0x7f0c540b62a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0c6802aec0 tx=0x7f0c68009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.869+0000 7f0c7908e740 1 -- 172.21.15.37:0/1327351319 shutdown_connections 2024-08-20T05:17:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.870+0000 7f0c7908e740 1 -- 172.21.15.37:0/1327351319 wait complete. 2024-08-20T05:17:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.870+0000 7f0c7908e740 1 -- start start 2024-08-20T05:17:30.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.871+0000 7f0c7908e740 1 Processor -- start 2024-08-20T05:17:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.871+0000 7f0c7908e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072d6900 0x558d072e2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.871+0000 7f0c7908e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072dfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.871+0000 7f0c7908e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072e31b0 0x558d072e03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.871+0000 7f0c7908e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558d0709e700 con 0x558d072e31b0 2024-08-20T05:17:30.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.871+0000 7f0c7908e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558d071d7250 con 0x558d072d7220 2024-08-20T05:17:30.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.871+0000 7f0c7908e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558d072e5e30 con 0x558d072d6900 2024-08-20T05:17:30.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.871+0000 7f0c7908e740 10 client.0 _ll_register_callbacks cb 0x558d07236180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:30.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.872+0000 7f0c67e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072dfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.872+0000 7f0c6f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072d6900 0x558d072e2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.872+0000 7f0c67e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072dfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:48884/0 (socket says 172.21.15.37:48884) 2024-08-20T05:17:30.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.872+0000 7f0c67e00640 1 -- 172.21.15.37:0/3275697248 learned_addr learned my addr 172.21.15.37:0/3275697248 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:30.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.873+0000 7f0c67e00640 1 -- 172.21.15.37:0/3275697248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072d6900 msgr2=0x558d072e2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:30.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.873+0000 7f0c67e00640 1 --2- 172.21.15.37:0/3275697248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072d6900 0x558d072e2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.873+0000 7f0c67e00640 1 -- 172.21.15.37:0/3275697248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072e31b0 msgr2=0x558d072e03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:30.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.873+0000 7f0c67e00640 1 --2- 172.21.15.37:0/3275697248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072e31b0 0x558d072e03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.873+0000 7f0c67e00640 1 -- 172.21.15.37:0/3275697248 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d06f9b650 con 0x558d072d7220 2024-08-20T05:17:30.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.873+0000 7f0c67e00640 1 --2- 172.21.15.37:0/3275697248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072dfe60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0c580052a0 tx=0x7f0c58010fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=652c94068ea3cd67 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:30.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.873+0000 7f0c5d600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:17:30.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.875+0000 7f0c5d600640 1 -- 172.21.15.37:0/3275697248 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5802a060 con 0x558d072d7220 2024-08-20T05:17:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.876+0000 7f0c5d600640 1 -- 172.21.15.37:0/3275697248 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0c580037f0 con 0x558d072d7220 2024-08-20T05:17:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.876+0000 7f0c7908e740 1 -- 172.21.15.37:0/3275697248 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c580043c0 con 0x558d072d7220 2024-08-20T05:17:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.876+0000 7f0c5d600640 1 -- 172.21.15.37:0/3275697248 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f0c580039f0 con 0x558d072d7220 2024-08-20T05:17:30.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.876+0000 7f0c7908e740 10 client.29093 fetch_fsmap learned FSMap version 51 2024-08-20T05:17:30.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.876+0000 7f0c7908e740 1 -- 172.21.15.37:0/3275697248 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x558d072f16e0 con 0x558d072d7220 2024-08-20T05:17:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.877+0000 7f0c5d600640 1 -- 172.21.15.37:0/3275697248 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c580043c0 con 0x558d072d7220 2024-08-20T05:17:30.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.878+0000 7f0c5d600640 1 -- 172.21.15.37:0/3275697248 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f0c580115c0 con 0x558d072d7220 2024-08-20T05:17:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.878+0000 7f0c7908e740 10 client.29093 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T05:17:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.878+0000 7f0c7908e740 10 client.29093 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:17:30.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.878+0000 7f0c7908e740 20 client.29093 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.879+0000 7f0c7908e740 1 --2- 172.21.15.37:0/3275697248 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558d072f2ae0 0x558d072f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.879+0000 7f0c7908e740 4 client.29093 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:17:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.879+0000 7f0c7908e740 1 -- 172.21.15.37:0/3275697248 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d0724e9b0 con 0x558d072f2ae0 2024-08-20T05:17:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.880+0000 7f0c6f400640 1 --2- 172.21.15.37:0/3275697248 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558d072f2ae0 0x558d072f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.881+0000 7f0c5d600640 10 client.29093 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:30.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.881+0000 7f0c6f400640 1 --2- 172.21.15.37:0/3275697248 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558d072f2ae0 0x558d072f4ed0 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13ee495cb26c21fb server_cookie=4699710f6d36ebff in_seq=0 out_seq=0 2024-08-20T05:17:30.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.881+0000 7f0c5d600640 1 -- 172.21.15.37:0/3275697248 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d0724e9b0 con 0x558d072f2ae0 2024-08-20T05:17:30.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.881+0000 7f0c5d600640 10 client.29093 handle_command_reply: tid=0 2024-08-20T05:17:30.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.881+0000 7f0c7908e740 1 client.29093 shutdown 2024-08-20T05:17:30.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.882+0000 7f0c7908e740 1 -- 172.21.15.37:0/3275697248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 msgr2=0x558d072dfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.882+0000 7f0c7908e740 1 --2- 172.21.15.37:0/3275697248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072dfe60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f0c580052a0 tx=0x7f0c58010fd0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.882+0000 7f0c7908e740 1 -- 172.21.15.37:0/3275697248 shutdown_connections 2024-08-20T05:17:30.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.882+0000 7f0c7908e740 1 --2- 172.21.15.37:0/3275697248 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558d072f2ae0 0x558d072f4ed0 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.882+0000 7f0c7908e740 1 --2- 172.21.15.37:0/3275697248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072e31b0 0x558d072e03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.882+0000 7f0c5d600640 0 client.29093 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:30.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.882+0000 7f0c7908e740 1 --2- 172.21.15.37:0/3275697248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072dfe60 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.882+0000 7f0c7908e740 1 --2- 172.21.15.37:0/3275697248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072d6900 0x558d072e2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.883+0000 7f0c7908e740 1 -- 172.21.15.37:0/3275697248 >> 172.21.15.37:0/3275697248 conn(0x558d072d4730 msgr2=0x558d072da2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:30.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.883+0000 7f0c7908e740 1 -- 172.21.15.37:0/3275697248 shutdown_connections 2024-08-20T05:17:30.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.883+0000 7f0c7908e740 1 -- 172.21.15.37:0/3275697248 wait complete. 2024-08-20T05:17:30.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.883+0000 7f0c7908e740 20 client.29093 trim_cache size 0 max 16384 2024-08-20T05:17:30.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.925+0000 7f0c7908e740 1 Processor -- start 2024-08-20T05:17:30.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.925+0000 7f0c7908e740 1 -- start start 2024-08-20T05:17:30.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.925+0000 7f0c7908e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072d6900 0x558d072fa560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.925+0000 7f0c7908e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072faaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.925+0000 7f0c7908e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072e31b0 0x558d072dd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.925+0000 7f0c7908e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0c701be6a0 con 0x558d072d6900 2024-08-20T05:17:30.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.925+0000 7f0c7908e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0c701c0210 con 0x558d072d7220 2024-08-20T05:17:30.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.925+0000 7f0c7908e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0c701bed70 con 0x558d072e31b0 2024-08-20T05:17:30.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.926+0000 7f0c67e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072faaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.926+0000 7f0c67e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072faaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:48888/0 (socket says 172.21.15.37:48888) 2024-08-20T05:17:30.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.926+0000 7f0c67e00640 1 -- 172.21.15.37:0/3148216134 learned_addr learned my addr 172.21.15.37:0/3148216134 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:30.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.926+0000 7f0c6f400640 1 --2- 172.21.15.37:0/3148216134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072d6900 0x558d072fa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.926+0000 7f0c6fe00640 1 --2- 172.21.15.37:0/3148216134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072e31b0 0x558d072dd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.927+0000 7f0c6fe00640 1 -- 172.21.15.37:0/3148216134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 msgr2=0x558d072faaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:30.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.927+0000 7f0c6fe00640 1 --2- 172.21.15.37:0/3148216134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072faaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.927+0000 7f0c6fe00640 1 -- 172.21.15.37:0/3148216134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072d6900 msgr2=0x558d072fa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:30.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.927+0000 7f0c6fe00640 1 --2- 172.21.15.37:0/3148216134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072d6900 0x558d072fa560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.927+0000 7f0c6fe00640 1 -- 172.21.15.37:0/3148216134 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d072d7050 con 0x558d072e31b0 2024-08-20T05:17:30.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.927+0000 7f0c6fe00640 1 --2- 172.21.15.37:0/3148216134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072e31b0 0x558d072dd070 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009bf0 tx=0x7f0c6803d070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1aea3ed9a609e30 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:30.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.928+0000 7f0c5fe00640 1 -- 172.21.15.37:0/3148216134 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c68041070 con 0x558d072e31b0 2024-08-20T05:17:30.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.928+0000 7f0c5fe00640 1 -- 172.21.15.37:0/3148216134 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c68036040 con 0x558d072e31b0 2024-08-20T05:17:30.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.928+0000 7f0c5fe00640 1 -- 172.21.15.37:0/3148216134 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c68046a70 con 0x558d072e31b0 2024-08-20T05:17:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.929+0000 7f0c7908e740 1 -- 172.21.15.37:0/3148216134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072e31b0 msgr2=0x558d072dd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.929+0000 7f0c7908e740 1 --2- 172.21.15.37:0/3148216134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072e31b0 0x558d072dd070 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f0c68009bf0 tx=0x7f0c6803d070 comp rx=0 tx=0).stop 2024-08-20T05:17:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.929+0000 7f0c7908e740 1 -- 172.21.15.37:0/3148216134 shutdown_connections 2024-08-20T05:17:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.929+0000 7f0c7908e740 1 --2- 172.21.15.37:0/3148216134 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072e31b0 0x558d072dd070 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.929+0000 7f0c7908e740 1 --2- 172.21.15.37:0/3148216134 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072faaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.929+0000 7f0c7908e740 1 --2- 172.21.15.37:0/3148216134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072d6900 0x558d072fa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.929+0000 7f0c7908e740 1 -- 172.21.15.37:0/3148216134 >> 172.21.15.37:0/3148216134 conn(0x558d072d4730 msgr2=0x558d072d3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.931+0000 7f0c7908e740 1 -- 172.21.15.37:0/3148216134 shutdown_connections 2024-08-20T05:17:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.931+0000 7f0c7908e740 1 -- 172.21.15.37:0/3148216134 wait complete. 2024-08-20T05:17:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.932+0000 7f0c7908e740 1 -- start start 2024-08-20T05:17:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.932+0000 7f0c7908e740 1 Processor -- start 2024-08-20T05:17:30.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.933+0000 7f0c7908e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072d6900 0x558d072e8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.933+0000 7f0c7908e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072e8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.933+0000 7f0c7908e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072e31b0 0x558d073555e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.933+0000 7f0c7908e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0c701bfb40 con 0x558d072e31b0 2024-08-20T05:17:30.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.933+0000 7f0c7908e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0c701bf440 con 0x558d072d7220 2024-08-20T05:17:30.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.933+0000 7f0c7908e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0c701bc640 con 0x558d072d6900 2024-08-20T05:17:30.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.933+0000 7f0c7908e740 10 client.0 _ll_register_callbacks cb 0x7f0c5800be30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:30.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.934+0000 7f0c6f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072d6900 0x558d072e8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.934+0000 7f0c67e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072e8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.934+0000 7f0c67e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072e8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:48902/0 (socket says 172.21.15.37:48902) 2024-08-20T05:17:30.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.934+0000 7f0c67e00640 1 -- 172.21.15.37:0/436815441 learned_addr learned my addr 172.21.15.37:0/436815441 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:30.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.934+0000 7f0c6fe00640 1 --2- 172.21.15.37:0/436815441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072e31b0 0x558d073555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.934+0000 7f0c67e00640 1 -- 172.21.15.37:0/436815441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072d6900 msgr2=0x558d072e8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.934+0000 7f0c67e00640 1 --2- 172.21.15.37:0/436815441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072d6900 0x558d072e8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.934+0000 7f0c67e00640 1 -- 172.21.15.37:0/436815441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072e31b0 msgr2=0x558d073555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.934+0000 7f0c67e00640 1 --2- 172.21.15.37:0/436815441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072e31b0 0x558d073555e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.934+0000 7f0c67e00640 1 -- 172.21.15.37:0/436815441 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d07355cf0 con 0x558d072d7220 2024-08-20T05:17:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.935+0000 7f0c67e00640 1 --2- 172.21.15.37:0/436815441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072e8ed0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0c58011b30 tx=0x7f0c58005690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77baa6381f04773e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.935+0000 7f0c5d600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:17:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.936+0000 7f0c5d600640 1 -- 172.21.15.37:0/436815441 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c58034080 con 0x558d072d7220 2024-08-20T05:17:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.936+0000 7f0c7908e740 1 -- 172.21.15.37:0/436815441 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c68036040 con 0x558d072d7220 2024-08-20T05:17:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.936+0000 7f0c5d600640 1 -- 172.21.15.37:0/436815441 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0c580035f0 con 0x558d072d7220 2024-08-20T05:17:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.936+0000 7f0c5d600640 1 -- 172.21.15.37:0/436815441 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f0c58046050 con 0x558d072d7220 2024-08-20T05:17:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.936+0000 7f0c7908e740 10 client.29099 fetch_fsmap learned FSMap version 51 2024-08-20T05:17:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.936+0000 7f0c7908e740 1 -- 172.21.15.37:0/436815441 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x558d0735d0e0 con 0x558d072d7220 2024-08-20T05:17:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.937+0000 7f0c5d600640 1 -- 172.21.15.37:0/436815441 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c68036040 con 0x558d072d7220 2024-08-20T05:17:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.937+0000 7f0c5d600640 1 -- 172.21.15.37:0/436815441 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f0c580041c0 con 0x558d072d7220 2024-08-20T05:17:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.937+0000 7f0c7908e740 10 client.29099 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T05:17:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.937+0000 7f0c7908e740 10 client.29099 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:17:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.937+0000 7f0c7908e740 20 client.29099 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.937+0000 7f0c7908e740 1 --2- 172.21.15.37:0/436815441 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558d072f2ae0 0x558d0735f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.937+0000 7f0c7908e740 4 client.29099 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:17:30.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.937+0000 7f0c7908e740 1 -- 172.21.15.37:0/436815441 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558d0724a450 con 0x558d072f2ae0 2024-08-20T05:17:30.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.938+0000 7f0c6f400640 1 --2- 172.21.15.37:0/436815441 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558d072f2ae0 0x558d0735f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:30.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.939+0000 7f0c5d600640 10 client.29099 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:30.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.939+0000 7f0c6f400640 1 --2- 172.21.15.37:0/436815441 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558d072f2ae0 0x558d0735f750 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c38d0509b05b6f5 server_cookie=88e37d53fae68e3d in_seq=0 out_seq=0 2024-08-20T05:17:30.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.940+0000 7f0c5d600640 1 -- 172.21.15.37:0/436815441 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558d0724a450 con 0x558d072f2ae0 2024-08-20T05:17:30.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.940+0000 7f0c5d600640 10 client.29099 handle_command_reply: tid=0 2024-08-20T05:17:30.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.941+0000 7f0c7908e740 1 client.29099 shutdown 2024-08-20T05:17:30.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.941+0000 7f0c7908e740 1 -- 172.21.15.37:0/436815441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 msgr2=0x558d072e8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.941+0000 7f0c7908e740 1 --2- 172.21.15.37:0/436815441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072e8ed0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0c58011b30 tx=0x7f0c58005690 comp rx=0 tx=0).stop 2024-08-20T05:17:30.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.941+0000 7f0c7908e740 1 -- 172.21.15.37:0/436815441 shutdown_connections 2024-08-20T05:17:30.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.941+0000 7f0c7908e740 1 --2- 172.21.15.37:0/436815441 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558d072f2ae0 0x558d0735f750 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.941+0000 7f0c7908e740 1 --2- 172.21.15.37:0/436815441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558d072e31b0 0x558d073555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.941+0000 7f0c7908e740 1 --2- 172.21.15.37:0/436815441 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558d072d7220 0x558d072e8ed0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.941+0000 7f0c7908e740 1 --2- 172.21.15.37:0/436815441 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558d072d6900 0x558d072e8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.941+0000 7f0c7908e740 1 -- 172.21.15.37:0/436815441 >> 172.21.15.37:0/436815441 conn(0x558d072d4730 msgr2=0x558d072de6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:30.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.942+0000 7f0c5d600640 0 client.29099 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:30.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.942+0000 7f0c7908e740 1 -- 172.21.15.37:0/436815441 shutdown_connections 2024-08-20T05:17:30.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.942+0000 7f0c7908e740 1 -- 172.21.15.37:0/436815441 wait complete. 2024-08-20T05:17:30.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.942+0000 7f0c7908e740 20 client.29099 trim_cache size 0 max 16384 2024-08-20T05:17:30.946 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:17:30.946 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-20T05:17:30.946 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-08-20T05:17:30.946 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:17:30.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.943+0000 7f0c76600640 1 -- 172.21.15.37:0/3087561710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0c540b3de0 msgr2=0x7f0c540b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.943+0000 7f0c76600640 1 --2- 172.21.15.37:0/3087561710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0c540b3de0 0x7f0c540b62a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0c6802aec0 tx=0x7f0c68009920 comp rx=0 tx=0).stop 2024-08-20T05:17:30.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.943+0000 7f0c76600640 1 -- 172.21.15.37:0/3087561710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c70104cc0 msgr2=0x7f0c70111500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:30.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.943+0000 7f0c76600640 1 --2- 172.21.15.37:0/3087561710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c70104cc0 0x7f0c70111500 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f0c6000c890 tx=0x7f0c6000cd50 comp rx=0 tx=0).stop 2024-08-20T05:17:30.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.944+0000 7f0c76600640 1 -- 172.21.15.37:0/3087561710 shutdown_connections 2024-08-20T05:17:30.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.944+0000 7f0c76600640 1 --2- 172.21.15.37:0/3087561710 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0c540b3de0 0x7f0c540b62a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.944+0000 7f0c76600640 1 --2- 172.21.15.37:0/3087561710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c7010b050 0x7f0c7010ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.944+0000 7f0c76600640 1 --2- 172.21.15.37:0/3087561710 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0c7010a6d0 0x7f0c7010e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.944+0000 7f0c76600640 1 --2- 172.21.15.37:0/3087561710 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0c70104cc0 0x7f0c70111500 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:30.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.944+0000 7f0c76600640 1 -- 172.21.15.37:0/3087561710 >> 172.21.15.37:0/3087561710 conn(0x7f0c701006f0 msgr2=0x7f0c70100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:30.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.944+0000 7f0c76600640 1 -- 172.21.15.37:0/3087561710 shutdown_connections 2024-08-20T05:17:30.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:30.944+0000 7f0c76600640 1 -- 172.21.15.37:0/3087561710 wait complete. 2024-08-20T05:17:30.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:30 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:17:31.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:30 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:17:31.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:31 smithi037 ceph-mon[17265]: pgmap v859: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 1.4 MiB/s wr, 154 op/s 2024-08-20T05:17:31.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:31 smithi130 ceph-mon[22007]: pgmap v859: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 1.4 MiB/s wr, 154 op/s 2024-08-20T05:17:32.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:31 smithi135 ceph-mon[22342]: pgmap v859: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 1.4 MiB/s wr, 154 op/s 2024-08-20T05:17:33.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 875.0 s, 414.0 tps, lat 233.020 ms stddev 301.121 2024-08-20T05:17:33.203 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T05:17:33.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:17:33.848 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:17:33.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:33 smithi130 ceph-mon[22007]: pgmap v860: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-08-20T05:17:33.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:33 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:17:34.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:33 smithi037 ceph-mon[17265]: pgmap v860: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-08-20T05:17:34.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:33 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:17:34.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:33 smithi135 ceph-mon[22342]: pgmap v860: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 1.7 MiB/s wr, 195 op/s 2024-08-20T05:17:34.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:33 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:17:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.762+0000 7ffb5d200640 1 -- 172.21.15.37:0/2509740309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb58077d20 msgr2=0x7ffb58113170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.762+0000 7ffb5d200640 1 --2- 172.21.15.37:0/2509740309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb58077d20 0x7ffb58113170 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ffb44009900 tx=0x7ffb4402a420 comp rx=0 tx=0).stop 2024-08-20T05:17:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.765+0000 7ffb5d200640 1 -- 172.21.15.37:0/2509740309 shutdown_connections 2024-08-20T05:17:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.765+0000 7ffb5d200640 1 --2- 172.21.15.37:0/2509740309 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb581136b0 0x7ffb58115aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.765+0000 7ffb5d200640 1 --2- 172.21.15.37:0/2509740309 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb58077d20 0x7ffb58113170 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:34.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.765+0000 7ffb5d200640 1 --2- 172.21.15.37:0/2509740309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb58077400 0x7ffb580777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:34.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.765+0000 7ffb5d200640 1 -- 172.21.15.37:0/2509740309 >> 172.21.15.37:0/2509740309 conn(0x7ffb581006f0 msgr2=0x7ffb58102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:34.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.770+0000 7ffb5d200640 1 -- 172.21.15.37:0/2509740309 shutdown_connections 2024-08-20T05:17:34.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.770+0000 7ffb5d200640 1 -- 172.21.15.37:0/2509740309 wait complete. 2024-08-20T05:17:34.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.771+0000 7ffb5d200640 1 Processor -- start 2024-08-20T05:17:34.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.771+0000 7ffb5d200640 1 -- start start 2024-08-20T05:17:34.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.772+0000 7ffb5d200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb58077400 0x7ffb5819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:34.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.772+0000 7ffb5d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb58077d20 0x7ffb5819fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.772+0000 7ffb5d200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb581136b0 0x7ffb581a4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.772+0000 7ffb5d200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ffb58119100 con 0x7ffb58077d20 2024-08-20T05:17:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.772+0000 7ffb5d200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ffb58118f80 con 0x7ffb581136b0 2024-08-20T05:17:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.772+0000 7ffb5d200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ffb58119280 con 0x7ffb58077400 2024-08-20T05:17:34.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.773+0000 7ffb56800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb581136b0 0x7ffb581a4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:34.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.773+0000 7ffb56800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb581136b0 0x7ffb581a4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45788/0 (socket says 172.21.15.37:45788) 2024-08-20T05:17:34.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.773+0000 7ffb56800640 1 -- 172.21.15.37:0/1546664042 learned_addr learned my addr 172.21.15.37:0/1546664042 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:34.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.773+0000 7ffb55e00640 1 --2- 172.21.15.37:0/1546664042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb58077400 0x7ffb5819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:34.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.773+0000 7ffb56800640 1 -- 172.21.15.37:0/1546664042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb58077400 msgr2=0x7ffb5819f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:34.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.773+0000 7ffb56800640 1 --2- 172.21.15.37:0/1546664042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb58077400 0x7ffb5819f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:34.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.773+0000 7ffb56800640 1 -- 172.21.15.37:0/1546664042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb58077d20 msgr2=0x7ffb5819fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:34.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.773+0000 7ffb56800640 1 --2- 172.21.15.37:0/1546664042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb58077d20 0x7ffb5819fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:34.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.773+0000 7ffb56800640 1 -- 172.21.15.37:0/1546664042 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb581a55e0 con 0x7ffb581136b0 2024-08-20T05:17:34.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.774+0000 7ffb55e00640 1 --2- 172.21.15.37:0/1546664042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb58077400 0x7ffb5819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:17:34.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.774+0000 7ffb56800640 1 --2- 172.21.15.37:0/1546664042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb581136b0 0x7ffb581a4e10 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000ccb0 tx=0x7ffb5000a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:34.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.774+0000 7ffb4ea00640 1 -- 172.21.15.37:0/1546664042 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5000f450 con 0x7ffb581136b0 2024-08-20T05:17:34.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.774+0000 7ffb4ea00640 1 -- 172.21.15.37:0/1546664042 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb5000faa0 con 0x7ffb581136b0 2024-08-20T05:17:34.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.774+0000 7ffb4ea00640 1 -- 172.21.15.37:0/1546664042 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb50018b90 con 0x7ffb581136b0 2024-08-20T05:17:34.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.774+0000 7ffb5d200640 1 -- 172.21.15.37:0/1546664042 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb581a58d0 con 0x7ffb581136b0 2024-08-20T05:17:34.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.775+0000 7ffb5d200640 1 -- 172.21.15.37:0/1546664042 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb581abf90 con 0x7ffb581136b0 2024-08-20T05:17:34.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.777+0000 7ffb5d200640 1 -- 172.21.15.37:0/1546664042 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb580777e0 con 0x7ffb581136b0 2024-08-20T05:17:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.782+0000 7ffb4ea00640 1 -- 172.21.15.37:0/1546664042 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ffb5000f5f0 con 0x7ffb581136b0 2024-08-20T05:17:34.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.784+0000 7ffb4ea00640 1 --2- 172.21.15.37:0/1546664042 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ffb3c0b3de0 0x7ffb3c0b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:34.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.784+0000 7ffb4ea00640 1 -- 172.21.15.37:0/1546664042 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ffb500e4310 con 0x7ffb581136b0 2024-08-20T05:17:34.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.785+0000 7ffb4ea00640 1 -- 172.21.15.37:0/1546664042 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ffb50014030 con 0x7ffb581136b0 2024-08-20T05:17:34.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.786+0000 7ffb55e00640 1 --2- 172.21.15.37:0/1546664042 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ffb3c0b3de0 0x7ffb3c0b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:34.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:34.795+0000 7ffb55e00640 1 --2- 172.21.15.37:0/1546664042 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ffb3c0b3de0 0x7ffb3c0b62a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ffb480058c0 tx=0x7ffb48005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:34.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T05:17:34.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T05:17:34.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T05:17:34.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T05:17:34.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:17:34.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:17:34.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:17:35.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T05:17:35.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T05:17:35.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T05:17:35.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T05:17:35.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:17:35.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:17:35.017 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:17:35.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-08-20T05:17:35.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-08-20T05:17:35.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-08-20T05:17:35.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-08-20T05:17:35.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:17:35.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:17:35.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:17:35.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:35.192+0000 7ffb5d200640 1 -- 172.21.15.37:0/1546664042 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb581ac2e0 con 0x7ffb581136b0 2024-08-20T05:17:35.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:35.194+0000 7ffb4ea00640 1 -- 172.21.15.37:0/1546664042 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+11981 (secure 0 0 0) 0x7ffb500ab560 con 0x7ffb581136b0 2024-08-20T05:17:35.198 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:17:35.198 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":51,"btime":"2024-08-20T05:17:29:625896+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":51,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:17:29.119084+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:17:35.201 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 51 2024-08-20T05:17:35.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:35.201+0000 7ffb5d200640 1 -- 172.21.15.37:0/1546664042 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ffb3c0b3de0 msgr2=0x7ffb3c0b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:35.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:35.201+0000 7ffb5d200640 1 --2- 172.21.15.37:0/1546664042 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ffb3c0b3de0 0x7ffb3c0b62a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ffb480058c0 tx=0x7ffb48005d30 comp rx=0 tx=0).stop 2024-08-20T05:17:35.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:35.201+0000 7ffb5d200640 1 -- 172.21.15.37:0/1546664042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb581136b0 msgr2=0x7ffb581a4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:35.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:35.201+0000 7ffb5d200640 1 --2- 172.21.15.37:0/1546664042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb581136b0 0x7ffb581a4e10 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000ccb0 tx=0x7ffb5000a620 comp rx=0 tx=0).stop 2024-08-20T05:17:35.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:35.201+0000 7ffb5d200640 1 -- 172.21.15.37:0/1546664042 shutdown_connections 2024-08-20T05:17:35.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:35.201+0000 7ffb5d200640 1 --2- 172.21.15.37:0/1546664042 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ffb3c0b3de0 0x7ffb3c0b62a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:35.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:35.201+0000 7ffb5d200640 1 --2- 172.21.15.37:0/1546664042 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ffb581136b0 0x7ffb581a4e10 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:35.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:35.201+0000 7ffb5d200640 1 --2- 172.21.15.37:0/1546664042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb58077d20 0x7ffb5819fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:35.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:35.201+0000 7ffb5d200640 1 --2- 172.21.15.37:0/1546664042 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ffb58077400 0x7ffb5819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:35.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:35.201+0000 7ffb5d200640 1 -- 172.21.15.37:0/1546664042 >> 172.21.15.37:0/1546664042 conn(0x7ffb581006f0 msgr2=0x7ffb58102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:35.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:35.202+0000 7ffb5d200640 1 -- 172.21.15.37:0/1546664042 shutdown_connections 2024-08-20T05:17:35.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:35.202+0000 7ffb5d200640 1 -- 172.21.15.37:0/1546664042 wait complete. 2024-08-20T05:17:35.874 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:35 smithi037 ceph-mon[17265]: Adjusting osd_memory_target on smithi037 to 177.5M 2024-08-20T05:17:35.874 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:35 smithi037 ceph-mon[17265]: Unable to set osd_memory_target on smithi037 to 186146508: error parsing value: Value '186146508' is below minimum 939524096 2024-08-20T05:17:35.874 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:35 smithi037 ceph-mon[17265]: pgmap v861: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 2.7 MiB/s wr, 308 op/s 2024-08-20T05:17:35.874 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:35 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1546664042' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:17:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:35 smithi130 ceph-mon[22007]: Adjusting osd_memory_target on smithi037 to 177.5M 2024-08-20T05:17:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:35 smithi130 ceph-mon[22007]: Unable to set osd_memory_target on smithi037 to 186146508: error parsing value: Value '186146508' is below minimum 939524096 2024-08-20T05:17:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:35 smithi130 ceph-mon[22007]: pgmap v861: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 2.7 MiB/s wr, 308 op/s 2024-08-20T05:17:35.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:35 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1546664042' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:17:36.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:35 smithi135 ceph-mon[22342]: Adjusting osd_memory_target on smithi037 to 177.5M 2024-08-20T05:17:36.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:35 smithi135 ceph-mon[22342]: Unable to set osd_memory_target on smithi037 to 186146508: error parsing value: Value '186146508' is below minimum 939524096 2024-08-20T05:17:36.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:35 smithi135 ceph-mon[22342]: pgmap v861: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 2.7 MiB/s wr, 308 op/s 2024-08-20T05:17:36.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:35 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1546664042' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:17:36.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T05:17:37.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:36 smithi037 ceph-mon[17265]: pgmap v862: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 2.9 MiB/s wr, 340 op/s 2024-08-20T05:17:37.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:36 smithi135 ceph-mon[22342]: pgmap v862: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 2.9 MiB/s wr, 340 op/s 2024-08-20T05:17:37.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:36 smithi130 ceph-mon[22007]: pgmap v862: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 2.9 MiB/s wr, 340 op/s 2024-08-20T05:17:37.742 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:17:38.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 880.0 s, 422.0 tps, lat 250.551 ms stddev 295.482 2024-08-20T05:17:38.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.786+0000 7f40e6000640 1 -- 172.21.15.37:0/305399239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40e0075270 msgr2=0x7f40e0075650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:38.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.786+0000 7f40e6000640 1 --2- 172.21.15.37:0/305399239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40e0075270 0x7f40e0075650 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f40d001a910 tx=0x7f40d003b470 comp rx=0 tx=0).stop 2024-08-20T05:17:38.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.786+0000 7f40e6000640 1 -- 172.21.15.37:0/305399239 shutdown_connections 2024-08-20T05:17:38.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.786+0000 7f40e6000640 1 --2- 172.21.15.37:0/305399239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e0113810 0x7f40e0115c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.786+0000 7f40e6000640 1 --2- 172.21.15.37:0/305399239 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40e0075b90 0x7f40e01132d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.786+0000 7f40e6000640 1 --2- 172.21.15.37:0/305399239 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40e0075270 0x7f40e0075650 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.786+0000 7f40e6000640 1 -- 172.21.15.37:0/305399239 >> 172.21.15.37:0/305399239 conn(0x7f40e00fe520 msgr2=0x7f40e0100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:38.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.786+0000 7f40e6000640 1 -- 172.21.15.37:0/305399239 shutdown_connections 2024-08-20T05:17:38.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.786+0000 7f40e6000640 1 -- 172.21.15.37:0/305399239 wait complete. 2024-08-20T05:17:38.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.790+0000 7f40e6000640 1 Processor -- start 2024-08-20T05:17:38.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.790+0000 7f40e6000640 1 -- start start 2024-08-20T05:17:38.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.791+0000 7f40e6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e0075270 0x7f40e010f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.791+0000 7f40e6000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40e0075b90 0x7f40e010f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.791+0000 7f40e6000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40e0113810 0x7f40e019c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.791+0000 7f40e6000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40e0109390 con 0x7f40e0075270 2024-08-20T05:17:38.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.791+0000 7f40e6000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f40e0109210 con 0x7f40e0075b90 2024-08-20T05:17:38.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.791+0000 7f40e6000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f40e0109510 con 0x7f40e0113810 2024-08-20T05:17:38.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.791+0000 7f40df400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e0075270 0x7f40e010f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:38.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.792+0000 7f40df400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e0075270 0x7f40e010f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55952/0 (socket says 172.21.15.37:55952) 2024-08-20T05:17:38.794 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.792+0000 7f40df400640 1 -- 172.21.15.37:0/1202255353 learned_addr learned my addr 172.21.15.37:0/1202255353 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:38.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.793+0000 7f40df400640 1 -- 172.21.15.37:0/1202255353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40e0113810 msgr2=0x7f40e019c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:38.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.793+0000 7f40df400640 1 --2- 172.21.15.37:0/1202255353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40e0113810 0x7f40e019c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.795+0000 7f40df400640 1 -- 172.21.15.37:0/1202255353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40e0075b90 msgr2=0x7f40e010f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.795+0000 7f40df400640 1 --2- 172.21.15.37:0/1202255353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40e0075b90 0x7f40e010f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.795+0000 7f40df400640 1 -- 172.21.15.37:0/1202255353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e019ced0 con 0x7f40e0075270 2024-08-20T05:17:38.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.795+0000 7f40df400640 1 --2- 172.21.15.37:0/1202255353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e0075270 0x7f40e010f0d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f40d0006010 tx=0x7f40d00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:38.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.797+0000 7f40d7e00640 1 -- 172.21.15.37:0/1202255353 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d004f020 con 0x7f40e0075270 2024-08-20T05:17:38.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.797+0000 7f40d7e00640 1 -- 172.21.15.37:0/1202255353 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40d00035f0 con 0x7f40e0075270 2024-08-20T05:17:38.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.797+0000 7f40d7e00640 1 -- 172.21.15.37:0/1202255353 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d0046070 con 0x7f40e0075270 2024-08-20T05:17:38.801 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.800+0000 7f40e6000640 1 -- 172.21.15.37:0/1202255353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e019d160 con 0x7f40e0075270 2024-08-20T05:17:38.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.800+0000 7f40e6000640 1 -- 172.21.15.37:0/1202255353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e006c8a0 con 0x7f40e0075270 2024-08-20T05:17:38.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.805+0000 7f40e8be0740 1 Processor -- start 2024-08-20T05:17:38.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.806+0000 7f40e8be0740 1 -- start start 2024-08-20T05:17:38.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.806+0000 7f40e8be0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d619178910 0x55d619178cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.806+0000 7f40e8be0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619179230 0x55d619184c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.806+0000 7f40e8be0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6191851c0 0x55d6191875b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.807+0000 7f40e8be0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d6190eeaa0 con 0x55d6191851c0 2024-08-20T05:17:38.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.807+0000 7f40e8be0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d6190ddfa0 con 0x55d619178910 2024-08-20T05:17:38.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.807+0000 7f40e8be0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d6190e1fe0 con 0x55d619179230 2024-08-20T05:17:38.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.807+0000 7f40dfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d619178910 0x55d619178cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:38.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.807+0000 7f40dfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d619178910 0x55d619178cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45804/0 (socket says 172.21.15.37:45804) 2024-08-20T05:17:38.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.807+0000 7f40dfe00640 1 -- 172.21.15.37:0/1828865832 learned_addr learned my addr 172.21.15.37:0/1828865832 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:38.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.808+0000 7f40dfe00640 1 -- 172.21.15.37:0/1828865832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619179230 msgr2=0x55d619184c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:17:38.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.808+0000 7f40dfe00640 1 --2- 172.21.15.37:0/1828865832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619179230 0x55d619184c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.808+0000 7f40dfe00640 1 -- 172.21.15.37:0/1828865832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6191851c0 msgr2=0x55d6191875b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:17:38.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.810+0000 7f40dfe00640 1 --2- 172.21.15.37:0/1828865832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6191851c0 0x55d6191875b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.811+0000 7f40d7e00640 1 -- 172.21.15.37:0/1202255353 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f40d0052020 con 0x7f40e0075270 2024-08-20T05:17:38.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.811+0000 7f40dfe00640 1 -- 172.21.15.37:0/1828865832 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d619084420 con 0x55d619178910 2024-08-20T05:17:38.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.812+0000 7f40dfe00640 1 --2- 172.21.15.37:0/1828865832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d619178910 0x55d619178cf0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009cd0 tx=0x7f40d800b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2364586f94434655 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:38.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.812+0000 7f40cbe00640 1 -- 172.21.15.37:0/1828865832 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d800bb30 con 0x55d619178910 2024-08-20T05:17:38.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.813+0000 7f40cbe00640 1 -- 172.21.15.37:0/1828865832 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40d8017070 con 0x55d619178910 2024-08-20T05:17:38.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.813+0000 7f40cbe00640 1 -- 172.21.15.37:0/1828865832 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d80115f0 con 0x55d619178910 2024-08-20T05:17:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.813+0000 7f40e8be0740 1 -- 172.21.15.37:0/1828865832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d619178910 msgr2=0x55d619178cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:38.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.813+0000 7f40e8be0740 1 --2- 172.21.15.37:0/1828865832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d619178910 0x55d619178cf0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009cd0 tx=0x7f40d800b420 comp rx=0 tx=0).stop 2024-08-20T05:17:38.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.814+0000 7f40e8be0740 1 -- 172.21.15.37:0/1828865832 shutdown_connections 2024-08-20T05:17:38.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.814+0000 7f40e8be0740 1 --2- 172.21.15.37:0/1828865832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6191851c0 0x55d6191875b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.814+0000 7f40e8be0740 1 --2- 172.21.15.37:0/1828865832 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619179230 0x55d619184c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.814+0000 7f40e8be0740 1 --2- 172.21.15.37:0/1828865832 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d619178910 0x55d619178cf0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.814+0000 7f40e8be0740 1 -- 172.21.15.37:0/1828865832 >> 172.21.15.37:0/1828865832 conn(0x55d619176740 msgr2=0x55d6191778e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:38.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.814+0000 7f40d7e00640 1 --2- 172.21.15.37:0/1202255353 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f40c40b3c50 0x7f40c40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.814+0000 7f40d7e00640 1 -- 172.21.15.37:0/1202255353 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f40d0114f60 con 0x7f40e0075270 2024-08-20T05:17:38.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.814+0000 7f40dea00640 1 --2- 172.21.15.37:0/1202255353 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f40c40b3c50 0x7f40c40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:38.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.816+0000 7f40dea00640 1 --2- 172.21.15.37:0/1202255353 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f40c40b3c50 0x7f40c40b6110 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0058c0 tx=0x7f40cc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:38.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.816+0000 7f40e8be0740 1 -- 172.21.15.37:0/1828865832 shutdown_connections 2024-08-20T05:17:38.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.816+0000 7f40e8be0740 1 -- 172.21.15.37:0/1828865832 wait complete. 2024-08-20T05:17:38.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.817+0000 7f40e8be0740 1 -- start start 2024-08-20T05:17:38.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.817+0000 7f40e8be0740 1 Processor -- start 2024-08-20T05:17:38.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.818+0000 7f40e8be0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619178910 0x55d619184930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.818+0000 7f40e8be0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d619179230 0x55d619181d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.818+0000 7f40e8be0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6191851c0 0x55d6191822c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.819+0000 7f40df400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619178910 0x55d619184930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:38.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.819+0000 7f40df400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619178910 0x55d619184930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57500/0 (socket says 172.21.15.37:57500) 2024-08-20T05:17:38.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.820+0000 7f40dea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d619179230 0x55d619181d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:38.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.820+0000 7f40dea00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d619179230 0x55d619181d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45818/0 (socket says 172.21.15.37:45818) 2024-08-20T05:17:38.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.820+0000 7f40e8be0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d618f40700 con 0x55d6191851c0 2024-08-20T05:17:38.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.820+0000 7f40e8be0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55d619079290 con 0x55d619179230 2024-08-20T05:17:38.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.820+0000 7f40e8be0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55d619187e40 con 0x55d619178910 2024-08-20T05:17:38.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.820+0000 7f40e8be0740 10 client.0 _ll_register_callbacks cb 0x55d6190d81c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:38.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.820+0000 7f40df400640 1 -- 172.21.15.37:0/4092604923 learned_addr learned my addr 172.21.15.37:0/4092604923 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:38.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.821+0000 7f40dfe00640 1 --2- 172.21.15.37:0/4092604923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6191851c0 0x55d6191822c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:38.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.821+0000 7f40dea00640 1 -- 172.21.15.37:0/4092604923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619178910 msgr2=0x55d619184930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:38.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.821+0000 7f40dea00640 1 --2- 172.21.15.37:0/4092604923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619178910 0x55d619184930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.821+0000 7f40dea00640 1 -- 172.21.15.37:0/4092604923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6191851c0 msgr2=0x55d6191822c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:38.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.821+0000 7f40dea00640 1 --2- 172.21.15.37:0/4092604923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6191851c0 0x55d6191822c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.821+0000 7f40dea00640 1 -- 172.21.15.37:0/4092604923 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d618e3d650 con 0x55d619179230 2024-08-20T05:17:38.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.821+0000 7f40df400640 1 --2- 172.21.15.37:0/4092604923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619178910 0x55d619184930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:38.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.821+0000 7f40dea00640 1 --2- 172.21.15.37:0/4092604923 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d619179230 0x55d619181d80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0106b0 tx=0x7f40cc005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa801b91f727814a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:38.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.821+0000 7f40c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:17:38.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.823+0000 7f40c8c00640 1 -- 172.21.15.37:0/4092604923 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc020070 con 0x55d619179230 2024-08-20T05:17:38.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.823+0000 7f40c8c00640 1 -- 172.21.15.37:0/4092604923 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f40cc01c830 con 0x55d619179230 2024-08-20T05:17:38.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.823+0000 7f40e8be0740 1 -- 172.21.15.37:0/4092604923 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40d8017070 con 0x55d619179230 2024-08-20T05:17:38.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.824+0000 7f40c8c00640 1 -- 172.21.15.37:0/4092604923 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f40cc01ca30 con 0x55d619179230 2024-08-20T05:17:38.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.824+0000 7f40e8be0740 10 client.29111 fetch_fsmap learned FSMap version 51 2024-08-20T05:17:38.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.824+0000 7f40e8be0740 1 -- 172.21.15.37:0/4092604923 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55d6191936b0 con 0x55d619179230 2024-08-20T05:17:38.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.825+0000 7f40c8c00640 1 -- 172.21.15.37:0/4092604923 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40d8017070 con 0x55d619179230 2024-08-20T05:17:38.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.826+0000 7f40c8c00640 1 -- 172.21.15.37:0/4092604923 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f40cc02f420 con 0x55d619179230 2024-08-20T05:17:38.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.826+0000 7f40e8be0740 10 client.29111 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T05:17:38.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.826+0000 7f40e8be0740 10 client.29111 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:17:38.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.826+0000 7f40e8be0740 20 client.29111 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:38.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.826+0000 7f40e8be0740 1 --2- 172.21.15.37:0/4092604923 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55d619194ac0 0x55d619196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.826+0000 7f40e8be0740 4 client.29111 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:17:38.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.826+0000 7f40e8be0740 1 -- 172.21.15.37:0/4092604923 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6190f09f0 con 0x55d619194ac0 2024-08-20T05:17:38.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.827+0000 7f40df400640 1 --2- 172.21.15.37:0/4092604923 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55d619194ac0 0x55d619196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:38.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.827+0000 7f40df400640 1 --2- 172.21.15.37:0/4092604923 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55d619194ac0 0x55d619196eb0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a3a940c76b154396 server_cookie=cf96381a60252c95 in_seq=0 out_seq=0 2024-08-20T05:17:38.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.828+0000 7f40c8c00640 10 client.29111 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:17:38.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.828+0000 7f40c8c00640 1 -- 172.21.15.37:0/4092604923 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6190f09f0 con 0x55d619194ac0 2024-08-20T05:17:38.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.828+0000 7f40c8c00640 10 client.29111 handle_command_reply: tid=0 2024-08-20T05:17:38.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.828+0000 7f40e8be0740 1 client.29111 shutdown 2024-08-20T05:17:38.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.829+0000 7f40e8be0740 1 -- 172.21.15.37:0/4092604923 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d619179230 msgr2=0x55d619181d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:38.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.829+0000 7f40e8be0740 1 --2- 172.21.15.37:0/4092604923 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d619179230 0x55d619181d80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0106b0 tx=0x7f40cc005f90 comp rx=0 tx=0).stop 2024-08-20T05:17:38.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.829+0000 7f40e8be0740 1 -- 172.21.15.37:0/4092604923 shutdown_connections 2024-08-20T05:17:38.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.829+0000 7f40e8be0740 1 --2- 172.21.15.37:0/4092604923 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55d619194ac0 0x55d619196eb0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.829+0000 7f40e8be0740 1 --2- 172.21.15.37:0/4092604923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d6191851c0 0x55d6191822c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.829+0000 7f40e8be0740 1 --2- 172.21.15.37:0/4092604923 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d619179230 0x55d619181d80 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.829+0000 7f40e8be0740 1 --2- 172.21.15.37:0/4092604923 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619178910 0x55d619184930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.829+0000 7f40e8be0740 1 -- 172.21.15.37:0/4092604923 >> 172.21.15.37:0/4092604923 conn(0x55d619176740 msgr2=0x55d61917c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:38.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.829+0000 7f40c8c00640 0 client.29111 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:17:38.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.830+0000 7f40e8be0740 1 -- 172.21.15.37:0/4092604923 shutdown_connections 2024-08-20T05:17:38.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.830+0000 7f40e8be0740 1 -- 172.21.15.37:0/4092604923 wait complete. 2024-08-20T05:17:38.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.830+0000 7f40e8be0740 20 client.29111 trim_cache size 0 max 16384 2024-08-20T05:17:38.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.867+0000 7f40e8be0740 1 Processor -- start 2024-08-20T05:17:38.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.867+0000 7f40e8be0740 1 -- start start 2024-08-20T05:17:38.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.868+0000 7f40e8be0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d619178910 0x55d619177c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.868+0000 7f40e8be0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619179230 0x55d619183ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.868+0000 7f40e8be0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6191851c0 0x55d61919c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.868+0000 7f40e8be0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40e01b5e90 con 0x55d619178910 2024-08-20T05:17:38.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.868+0000 7f40e8be0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f40e01b7a00 con 0x55d6191851c0 2024-08-20T05:17:38.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.868+0000 7f40e8be0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f40e01b6560 con 0x55d619179230 2024-08-20T05:17:38.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.869+0000 7f40dea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619179230 0x55d619183ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:38.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.869+0000 7f40dea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619179230 0x55d619183ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57508/0 (socket says 172.21.15.37:57508) 2024-08-20T05:17:38.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.869+0000 7f40dea00640 1 -- 172.21.15.37:0/2250244662 learned_addr learned my addr 172.21.15.37:0/2250244662 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:38.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.869+0000 7f40dfe00640 1 --2- 172.21.15.37:0/2250244662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6191851c0 0x55d61919c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:38.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.869+0000 7f40df400640 1 --2- 172.21.15.37:0/2250244662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d619178910 0x55d619177c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:38.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.869+0000 7f40dea00640 1 -- 172.21.15.37:0/2250244662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6191851c0 msgr2=0x55d61919c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:38.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.869+0000 7f40dea00640 1 --2- 172.21.15.37:0/2250244662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6191851c0 0x55d61919c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.869+0000 7f40dea00640 1 -- 172.21.15.37:0/2250244662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d619178910 msgr2=0x55d619177c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:38.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.869+0000 7f40dea00640 1 --2- 172.21.15.37:0/2250244662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d619178910 0x55d619177c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.869+0000 7f40dea00640 1 -- 172.21.15.37:0/2250244662 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6191771c0 con 0x55d619179230 2024-08-20T05:17:38.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.870+0000 7f40dfe00640 1 --2- 172.21.15.37:0/2250244662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6191851c0 0x55d61919c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:17:38.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.870+0000 7f40df400640 1 --2- 172.21.15.37:0/2250244662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d619178910 0x55d619177c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:17:38.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.870+0000 7f40dea00640 1 --2- 172.21.15.37:0/2250244662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619179230 0x55d619183ac0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00a010 tx=0x7f40cc00ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79fb018cb45b5f20 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:38.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.871+0000 7f40cb400640 1 -- 172.21.15.37:0/2250244662 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc035070 con 0x55d619179230 2024-08-20T05:17:38.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.871+0000 7f40cb400640 1 -- 172.21.15.37:0/2250244662 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40cc009730 con 0x55d619179230 2024-08-20T05:17:38.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.871+0000 7f40cb400640 1 -- 172.21.15.37:0/2250244662 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40cc035070 con 0x55d619179230 2024-08-20T05:17:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.872+0000 7f40e8be0740 1 -- 172.21.15.37:0/2250244662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619179230 msgr2=0x55d619183ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:38.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.873+0000 7f40e8be0740 1 --2- 172.21.15.37:0/2250244662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619179230 0x55d619183ac0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00a010 tx=0x7f40cc00ed80 comp rx=0 tx=0).stop 2024-08-20T05:17:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.873+0000 7f40e8be0740 1 -- 172.21.15.37:0/2250244662 shutdown_connections 2024-08-20T05:17:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.873+0000 7f40e8be0740 1 --2- 172.21.15.37:0/2250244662 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6191851c0 0x55d61919c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.873+0000 7f40e8be0740 1 --2- 172.21.15.37:0/2250244662 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619179230 0x55d619183ac0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.873+0000 7f40e8be0740 1 --2- 172.21.15.37:0/2250244662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d619178910 0x55d619177c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.874+0000 7f40e8be0740 1 -- 172.21.15.37:0/2250244662 >> 172.21.15.37:0/2250244662 conn(0x55d619176740 msgr2=0x55d6191833b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.874+0000 7f40e8be0740 1 -- 172.21.15.37:0/2250244662 shutdown_connections 2024-08-20T05:17:38.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.874+0000 7f40e8be0740 1 -- 172.21.15.37:0/2250244662 wait complete. 2024-08-20T05:17:38.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.876+0000 7f40e8be0740 1 -- start start 2024-08-20T05:17:38.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.876+0000 7f40e8be0740 1 Processor -- start 2024-08-20T05:17:38.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.877+0000 7f40e8be0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d619178910 0x55d61918ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.877+0000 7f40e8be0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619179230 0x55d61918b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.877+0000 7f40e8be0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6191851c0 0x55d6191f78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.877+0000 7f40e8be0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f40e01b7330 con 0x55d619178910 2024-08-20T05:17:38.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.877+0000 7f40e8be0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f40e01b6c30 con 0x55d6191851c0 2024-08-20T05:17:38.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.877+0000 7f40e8be0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f40e0110200 con 0x55d619179230 2024-08-20T05:17:38.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.877+0000 7f40e8be0740 10 client.0 _ll_register_callbacks cb 0x7f40cc014050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:38.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.877+0000 7f40df400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d619178910 0x55d61918ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:38.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.878+0000 7f40dfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6191851c0 0x55d6191f78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:38.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.878+0000 7f40dea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619179230 0x55d61918b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:38.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.878+0000 7f40dfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6191851c0 0x55d6191f78f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45842/0 (socket says 172.21.15.37:45842) 2024-08-20T05:17:38.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.878+0000 7f40dfe00640 1 -- 172.21.15.37:0/579153010 learned_addr learned my addr 172.21.15.37:0/579153010 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:38.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.878+0000 7f40dea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619179230 0x55d61918b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57514/0 (socket says 172.21.15.37:57514) 2024-08-20T05:17:38.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.878+0000 7f40dfe00640 1 -- 172.21.15.37:0/579153010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619179230 msgr2=0x55d61918b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:38.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.878+0000 7f40dfe00640 1 --2- 172.21.15.37:0/579153010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619179230 0x55d61918b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.878+0000 7f40dfe00640 1 -- 172.21.15.37:0/579153010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d619178910 msgr2=0x55d61918ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.878+0000 7f40dfe00640 1 --2- 172.21.15.37:0/579153010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d619178910 0x55d61918ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.879+0000 7f40dfe00640 1 -- 172.21.15.37:0/579153010 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6191f8030 con 0x55d6191851c0 2024-08-20T05:17:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.879+0000 7f40df400640 1 --2- 172.21.15.37:0/579153010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d619178910 0x55d61918ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.879+0000 7f40dfe00640 1 --2- 172.21.15.37:0/579153010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6191851c0 0x55d6191f78f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009c70 tx=0x7f40d800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4217bd6cc0cc9141 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.879+0000 7f40c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:17:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.880+0000 7f40c8c00640 1 -- 172.21.15.37:0/579153010 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d80253f0 con 0x55d6191851c0 2024-08-20T05:17:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.880+0000 7f40c8c00640 1 -- 172.21.15.37:0/579153010 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f40d801b3f0 con 0x55d6191851c0 2024-08-20T05:17:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.880+0000 7f40e8be0740 1 -- 172.21.15.37:0/579153010 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40cc009730 con 0x55d6191851c0 2024-08-20T05:17:38.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.881+0000 7f40c8c00640 1 -- 172.21.15.37:0/579153010 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f40d801b5f0 con 0x55d6191851c0 2024-08-20T05:17:38.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.881+0000 7f40e8be0740 10 client.29117 fetch_fsmap learned FSMap version 51 2024-08-20T05:17:38.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.881+0000 7f40e8be0740 1 -- 172.21.15.37:0/579153010 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x55d6191ff420 con 0x55d6191851c0 2024-08-20T05:17:38.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.881+0000 7f40c8c00640 1 -- 172.21.15.37:0/579153010 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40cc009730 con 0x55d6191851c0 2024-08-20T05:17:38.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.882+0000 7f40c8c00640 1 -- 172.21.15.37:0/579153010 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f40d8011070 con 0x55d6191851c0 2024-08-20T05:17:38.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.882+0000 7f40e8be0740 10 client.29117 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T05:17:38.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.882+0000 7f40e8be0740 10 client.29117 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:17:38.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.882+0000 7f40e8be0740 20 client.29117 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:38.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.882+0000 7f40e8be0740 1 --2- 172.21.15.37:0/579153010 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55d6191ff9b0 0x55d619201dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:38.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.882+0000 7f40e8be0740 4 client.29117 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:17:38.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.882+0000 7f40e8be0740 1 -- 172.21.15.37:0/579153010 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d6190ec490 con 0x55d6191ff9b0 2024-08-20T05:17:38.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.882+0000 7f40df400640 1 --2- 172.21.15.37:0/579153010 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55d6191ff9b0 0x55d619201dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:38.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.883+0000 7f40df400640 1 --2- 172.21.15.37:0/579153010 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55d6191ff9b0 0x55d619201dd0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=19ff466ea4d58568 server_cookie=ef69c7dad5dc9e05 in_seq=0 out_seq=0 2024-08-20T05:17:38.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.883+0000 7f40c8c00640 10 client.29117 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:17:38.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.883+0000 7f40c8c00640 1 -- 172.21.15.37:0/579153010 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d6190ec490 con 0x55d6191ff9b0 2024-08-20T05:17:38.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.883+0000 7f40c8c00640 10 client.29117 handle_command_reply: tid=0 2024-08-20T05:17:38.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.883+0000 7f40e8be0740 1 client.29117 shutdown 2024-08-20T05:17:38.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.884+0000 7f40e8be0740 1 -- 172.21.15.37:0/579153010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6191851c0 msgr2=0x55d6191f78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:38.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.884+0000 7f40e8be0740 1 --2- 172.21.15.37:0/579153010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6191851c0 0x55d6191f78f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009c70 tx=0x7f40d800bea0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.884+0000 7f40e8be0740 1 -- 172.21.15.37:0/579153010 shutdown_connections 2024-08-20T05:17:38.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.884+0000 7f40e8be0740 1 --2- 172.21.15.37:0/579153010 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55d6191ff9b0 0x55d619201dd0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.884+0000 7f40e8be0740 1 --2- 172.21.15.37:0/579153010 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55d6191851c0 0x55d6191f78f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.884+0000 7f40e8be0740 1 --2- 172.21.15.37:0/579153010 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55d619179230 0x55d61918b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.884+0000 7f40e8be0740 1 --2- 172.21.15.37:0/579153010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d619178910 0x55d61918ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.884+0000 7f40e8be0740 1 -- 172.21.15.37:0/579153010 >> 172.21.15.37:0/579153010 conn(0x55d619176740 msgr2=0x55d619177420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:38.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.885+0000 7f40c8c00640 0 client.29117 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:17:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.885+0000 7f40e8be0740 1 -- 172.21.15.37:0/579153010 shutdown_connections 2024-08-20T05:17:38.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.887+0000 7f40e8be0740 1 -- 172.21.15.37:0/579153010 wait complete. 2024-08-20T05:17:38.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.888+0000 7f40e8be0740 20 client.29117 trim_cache size 0 max 16384 2024-08-20T05:17:38.890 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:17:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.890+0000 7f40e6000640 1 -- 172.21.15.37:0/1202255353 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f40c40b3c50 msgr2=0x7f40c40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.890+0000 7f40e6000640 1 --2- 172.21.15.37:0/1202255353 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f40c40b3c50 0x7f40c40b6110 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f40cc0058c0 tx=0x7f40cc005850 comp rx=0 tx=0).stop 2024-08-20T05:17:38.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.890+0000 7f40e6000640 1 -- 172.21.15.37:0/1202255353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e0075270 msgr2=0x7f40e010f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.890+0000 7f40e6000640 1 --2- 172.21.15.37:0/1202255353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e0075270 0x7f40e010f0d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f40d0006010 tx=0x7f40d00048f0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.890+0000 7f40e6000640 1 -- 172.21.15.37:0/1202255353 shutdown_connections 2024-08-20T05:17:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.890+0000 7f40e6000640 1 --2- 172.21.15.37:0/1202255353 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f40c40b3c50 0x7f40c40b6110 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.890+0000 7f40e6000640 1 --2- 172.21.15.37:0/1202255353 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f40e0113810 0x7f40e019c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.890+0000 7f40e6000640 1 --2- 172.21.15.37:0/1202255353 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f40e0075b90 0x7f40e010f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.890+0000 7f40e6000640 1 --2- 172.21.15.37:0/1202255353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40e0075270 0x7f40e010f0d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.890+0000 7f40e6000640 1 -- 172.21.15.37:0/1202255353 >> 172.21.15.37:0/1202255353 conn(0x7f40e00fe520 msgr2=0x7f40e00ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.891+0000 7f40e6000640 1 -- 172.21.15.37:0/1202255353 shutdown_connections 2024-08-20T05:17:38.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:38.891+0000 7f40e6000640 1 -- 172.21.15.37:0/1202255353 wait complete. 2024-08-20T05:17:39.823 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:39 smithi037 ceph-mon[17265]: pgmap v863: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 3.8 MiB/s wr, 426 op/s 2024-08-20T05:17:39.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T05:17:39.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:39 smithi135 ceph-mon[22342]: pgmap v863: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 3.8 MiB/s wr, 426 op/s 2024-08-20T05:17:39.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:39 smithi130 ceph-mon[22007]: pgmap v863: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 3.8 MiB/s wr, 426 op/s 2024-08-20T05:17:40.613 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:17:41.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.425+0000 7ff8cbe00640 1 -- 172.21.15.37:0/4013618229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8c4077400 msgr2=0x7ff8c40777e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:41.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.425+0000 7ff8cbe00640 1 --2- 172.21.15.37:0/4013618229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8c4077400 0x7ff8c40777e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009be0 tx=0x7ff8b802a6e0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.425+0000 7ff8cbe00640 1 -- 172.21.15.37:0/4013618229 shutdown_connections 2024-08-20T05:17:41.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.425+0000 7ff8cbe00640 1 --2- 172.21.15.37:0/4013618229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8c4113690 0x7ff8c4115a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.425+0000 7ff8cbe00640 1 --2- 172.21.15.37:0/4013618229 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8c4077d20 0x7ff8c4113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.425+0000 7ff8cbe00640 1 --2- 172.21.15.37:0/4013618229 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8c4077400 0x7ff8c40777e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.425+0000 7ff8cbe00640 1 -- 172.21.15.37:0/4013618229 >> 172.21.15.37:0/4013618229 conn(0x7ff8c4100730 msgr2=0x7ff8c4102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:41.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.425+0000 7ff8cbe00640 1 -- 172.21.15.37:0/4013618229 shutdown_connections 2024-08-20T05:17:41.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.425+0000 7ff8cbe00640 1 -- 172.21.15.37:0/4013618229 wait complete. 2024-08-20T05:17:41.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.428+0000 7ff8cbe00640 1 Processor -- start 2024-08-20T05:17:41.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.428+0000 7ff8cbe00640 1 -- start start 2024-08-20T05:17:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.428+0000 7ff8cbe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8c4077400 0x7ff8c4112b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.428+0000 7ff8cbe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8c4077d20 0x7ff8c41130b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.428+0000 7ff8cbe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8c4113690 0x7ff8c410cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.428+0000 7ff8cbe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c4105200 con 0x7ff8c4113690 2024-08-20T05:17:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.428+0000 7ff8cbe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c4105080 con 0x7ff8c4077d20 2024-08-20T05:17:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.428+0000 7ff8cbe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff8c4105380 con 0x7ff8c4077400 2024-08-20T05:17:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.429+0000 7ff8c8a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8c4077d20 0x7ff8c41130b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.429+0000 7ff8c8a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8c4077d20 0x7ff8c41130b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45852/0 (socket says 172.21.15.37:45852) 2024-08-20T05:17:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.429+0000 7ff8c8a00640 1 -- 172.21.15.37:0/3644880426 learned_addr learned my addr 172.21.15.37:0/3644880426 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:41.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.429+0000 7ff8c8a00640 1 -- 172.21.15.37:0/3644880426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8c4077400 msgr2=0x7ff8c4112b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T05:17:41.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.429+0000 7ff8c8a00640 1 --2- 172.21.15.37:0/3644880426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8c4077400 0x7ff8c4112b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.429+0000 7ff8c8a00640 1 -- 172.21.15.37:0/3644880426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8c4113690 msgr2=0x7ff8c410cf80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T05:17:41.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.429+0000 7ff8c8a00640 1 --2- 172.21.15.37:0/3644880426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8c4113690 0x7ff8c410cf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.429+0000 7ff8c8a00640 1 -- 172.21.15.37:0/3644880426 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c410d840 con 0x7ff8c4077d20 2024-08-20T05:17:41.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.430+0000 7ff8c8a00640 1 --2- 172.21.15.37:0/3644880426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8c4077d20 0x7ff8c41130b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000e9c0 tx=0x7ff8b000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:41.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.430+0000 7ff8c2000640 1 -- 172.21.15.37:0/3644880426 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b000ccc0 con 0x7ff8c4077d20 2024-08-20T05:17:41.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.430+0000 7ff8cbe00640 1 -- 172.21.15.37:0/3644880426 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8c410db30 con 0x7ff8c4077d20 2024-08-20T05:17:41.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.430+0000 7ff8cbe00640 1 -- 172.21.15.37:0/3644880426 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8c41b4940 con 0x7ff8c4077d20 2024-08-20T05:17:41.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.430+0000 7ff8c2000640 1 -- 172.21.15.37:0/3644880426 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8b00054d0 con 0x7ff8c4077d20 2024-08-20T05:17:41.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.430+0000 7ff8c2000640 1 -- 172.21.15.37:0/3644880426 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0010430 con 0x7ff8c4077d20 2024-08-20T05:17:41.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.436+0000 7ff8ce85e740 1 Processor -- start 2024-08-20T05:17:41.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.437+0000 7ff8ce85e740 1 -- start start 2024-08-20T05:17:41.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.437+0000 7ff8ce85e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc40940 0x5628dfc40d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.437+0000 7ff8ce85e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc41260 0x5628dfc4ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.437+0000 7ff8ce85e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc4d1f0 0x5628dfc4f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.437+0000 7ff8ce85e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5628dfbb6aa0 con 0x5628dfc40940 2024-08-20T05:17:41.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.437+0000 7ff8ce85e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5628dfba5fa0 con 0x5628dfc41260 2024-08-20T05:17:41.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.437+0000 7ff8ce85e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5628dfba9fe0 con 0x5628dfc4d1f0 2024-08-20T05:17:41.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.437+0000 7ff8c9400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc41260 0x5628dfc4ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:41.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.437+0000 7ff8c9400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc41260 0x5628dfc4ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45856/0 (socket says 172.21.15.37:45856) 2024-08-20T05:17:41.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.438+0000 7ff8c9400640 1 -- 172.21.15.37:0/2667498496 learned_addr learned my addr 172.21.15.37:0/2667498496 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:41.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.438+0000 7ff8c9e00640 1 --2- 172.21.15.37:0/2667498496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc40940 0x5628dfc40d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:41.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.438+0000 7ff8c2000640 1 -- 172.21.15.37:0/3644880426 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff8b00046c0 con 0x7ff8c4077d20 2024-08-20T05:17:41.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.438+0000 7ff8c9400640 1 -- 172.21.15.37:0/2667498496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc4d1f0 msgr2=0x5628dfc4f5e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:17:41.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.438+0000 7ff8c9400640 1 --2- 172.21.15.37:0/2667498496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc4d1f0 0x5628dfc4f5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.438+0000 7ff8c9400640 1 -- 172.21.15.37:0/2667498496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc40940 msgr2=0x5628dfc40d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:41.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.438+0000 7ff8c9400640 1 --2- 172.21.15.37:0/2667498496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc40940 0x5628dfc40d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.438+0000 7ff8c9400640 1 -- 172.21.15.37:0/2667498496 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628dfb4c420 con 0x5628dfc41260 2024-08-20T05:17:41.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.439+0000 7ff8c9400640 1 --2- 172.21.15.37:0/2667498496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc41260 0x5628dfc4ccb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff8b802acd0 tx=0x7ff8b80304c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30b272a7e441d1d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:41.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.439+0000 7ff8b6600640 1 -- 172.21.15.37:0/2667498496 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8040020 con 0x5628dfc41260 2024-08-20T05:17:41.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.439+0000 7ff8b6600640 1 -- 172.21.15.37:0/2667498496 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8b80307b0 con 0x5628dfc41260 2024-08-20T05:17:41.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.439+0000 7ff8b6600640 1 -- 172.21.15.37:0/2667498496 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8036040 con 0x5628dfc41260 2024-08-20T05:17:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.441+0000 7ff8ce85e740 1 -- 172.21.15.37:0/2667498496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc41260 msgr2=0x5628dfc4ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.441+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/2667498496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc41260 0x5628dfc4ccb0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7ff8b802acd0 tx=0x7ff8b80304c0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.442+0000 7ff8ce85e740 1 -- 172.21.15.37:0/2667498496 shutdown_connections 2024-08-20T05:17:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.442+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/2667498496 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc4d1f0 0x5628dfc4f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.442+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/2667498496 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc41260 0x5628dfc4ccb0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.442+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/2667498496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc40940 0x5628dfc40d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.442+0000 7ff8ce85e740 1 -- 172.21.15.37:0/2667498496 >> 172.21.15.37:0/2667498496 conn(0x5628dfc3e770 msgr2=0x5628dfc3f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:41.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.443+0000 7ff8ce85e740 1 -- 172.21.15.37:0/2667498496 shutdown_connections 2024-08-20T05:17:41.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.443+0000 7ff8ce85e740 1 -- 172.21.15.37:0/2667498496 wait complete. 2024-08-20T05:17:41.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.443+0000 7ff8c2000640 1 --2- 172.21.15.37:0/3644880426 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8ac0b3ba0 0x7ff8ac0b6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.444+0000 7ff8ce85e740 1 -- start start 2024-08-20T05:17:41.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.444+0000 7ff8c2000640 1 -- 172.21.15.37:0/3644880426 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff8b00e4240 con 0x7ff8c4077d20 2024-08-20T05:17:41.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.444+0000 7ff8ce85e740 1 Processor -- start 2024-08-20T05:17:41.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.444+0000 7ff8c9400640 1 --2- 172.21.15.37:0/3644880426 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8ac0b3ba0 0x7ff8ac0b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:41.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.445+0000 7ff8ce85e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc40940 0x5628dfc4c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.445+0000 7ff8ce85e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc41260 0x5628dfc49e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.445+0000 7ff8ce85e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc4d1f0 0x5628dfc4a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.445+0000 7ff8ce85e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5628dfa08700 con 0x5628dfc40940 2024-08-20T05:17:41.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.445+0000 7ff8ce85e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5628dfb41290 con 0x5628dfc41260 2024-08-20T05:17:41.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.445+0000 7ff8ce85e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5628dfc60e20 con 0x5628dfc4d1f0 2024-08-20T05:17:41.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.445+0000 7ff8ce85e740 10 client.0 _ll_register_callbacks cb 0x5628dfba01c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:41.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.446+0000 7ff8c9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc4d1f0 0x5628dfc4a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:41.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.446+0000 7ff8c9e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc4d1f0 0x5628dfc4a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57544/0 (socket says 172.21.15.37:57544) 2024-08-20T05:17:41.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.446+0000 7ff8c9e00640 1 -- 172.21.15.37:0/2701600114 learned_addr learned my addr 172.21.15.37:0/2701600114 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:41.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.446+0000 7ff8c9400640 1 --2- 172.21.15.37:0/2701600114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc40940 0x5628dfc4c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:41.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.446+0000 7ff8c8a00640 1 --2- 172.21.15.37:0/2701600114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc41260 0x5628dfc49e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:41.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.447+0000 7ff8c9e00640 1 -- 172.21.15.37:0/2701600114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc41260 msgr2=0x5628dfc49e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:41.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.447+0000 7ff8c9e00640 1 --2- 172.21.15.37:0/2701600114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc41260 0x5628dfc49e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.447+0000 7ff8c9e00640 1 -- 172.21.15.37:0/2701600114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc40940 msgr2=0x5628dfc4c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:41.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.447+0000 7ff8c9e00640 1 --2- 172.21.15.37:0/2701600114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc40940 0x5628dfc4c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.447+0000 7ff8c9e00640 1 -- 172.21.15.37:0/2701600114 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628df905650 con 0x5628dfc4d1f0 2024-08-20T05:17:41.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.447+0000 7ff8c8a00640 1 --2- 172.21.15.37:0/2701600114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc41260 0x5628dfc49e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:17:41.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.447+0000 7ff8c9400640 1 --2- 172.21.15.37:0/2701600114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc40940 0x5628dfc4c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.448+0000 7ff8c9e00640 1 --2- 172.21.15.37:0/2701600114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc4d1f0 0x5628dfc4a340 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00e1d0 tx=0x7ff8bc00e690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbeacbdff836634a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.448+0000 7ff8aaa00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:17:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.449+0000 7ff8c9400640 1 --2- 172.21.15.37:0/3644880426 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8ac0b3ba0 0x7ff8ac0b6060 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009560 tx=0x7ff8b8030e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.449+0000 7ff8aaa00640 1 -- 172.21.15.37:0/2701600114 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc017070 con 0x5628dfc4d1f0 2024-08-20T05:17:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.449+0000 7ff8aaa00640 1 -- 172.21.15.37:0/2701600114 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff8bc013680 con 0x5628dfc4d1f0 2024-08-20T05:17:41.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.449+0000 7ff8ce85e740 1 -- 172.21.15.37:0/2701600114 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8b80307b0 con 0x5628dfc4d1f0 2024-08-20T05:17:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.449+0000 7ff8aaa00640 1 -- 172.21.15.37:0/2701600114 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7ff8bc021050 con 0x5628dfc4d1f0 2024-08-20T05:17:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.450+0000 7ff8ce85e740 10 client.29152 fetch_fsmap learned FSMap version 51 2024-08-20T05:17:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.450+0000 7ff8ce85e740 1 -- 172.21.15.37:0/2701600114 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5628dfc6c720 con 0x5628dfc4d1f0 2024-08-20T05:17:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.450+0000 7ff8aaa00640 1 -- 172.21.15.37:0/2701600114 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8b80307b0 con 0x5628dfc4d1f0 2024-08-20T05:17:41.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.450+0000 7ff8aaa00640 1 -- 172.21.15.37:0/2701600114 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7ff8bc01c9d0 con 0x5628dfc4d1f0 2024-08-20T05:17:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.451+0000 7ff8ce85e740 10 client.29152 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T05:17:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.451+0000 7ff8ce85e740 10 client.29152 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:17:41.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.451+0000 7ff8ce85e740 20 client.29152 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.451+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/2701600114 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5628dfc6dc30 0x5628dfc70020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.451+0000 7ff8ce85e740 4 client.29152 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:17:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.451+0000 7ff8ce85e740 1 -- 172.21.15.37:0/2701600114 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628dfbb89f0 con 0x5628dfc6dc30 2024-08-20T05:17:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.452+0000 7ff8c9400640 1 --2- 172.21.15.37:0/2701600114 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5628dfc6dc30 0x5628dfc70020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.452+0000 7ff8c9400640 1 --2- 172.21.15.37:0/2701600114 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5628dfc6dc30 0x5628dfc70020 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f51bcc5c139f2f4 server_cookie=944c87c107996473 in_seq=0 out_seq=0 2024-08-20T05:17:41.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.452+0000 7ff8aaa00640 10 client.29152 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:17:41.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.453+0000 7ff8aaa00640 1 -- 172.21.15.37:0/2701600114 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628dfbb89f0 con 0x5628dfc6dc30 2024-08-20T05:17:41.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.453+0000 7ff8aaa00640 10 client.29152 handle_command_reply: tid=0 2024-08-20T05:17:41.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.453+0000 7ff8ce85e740 1 client.29152 shutdown 2024-08-20T05:17:41.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.457+0000 7ff8ce85e740 1 -- 172.21.15.37:0/2701600114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc4d1f0 msgr2=0x5628dfc4a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:41.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.457+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/2701600114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc4d1f0 0x5628dfc4a340 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00e1d0 tx=0x7ff8bc00e690 comp rx=0 tx=0).stop 2024-08-20T05:17:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.457+0000 7ff8ce85e740 1 -- 172.21.15.37:0/2701600114 shutdown_connections 2024-08-20T05:17:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.457+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/2701600114 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5628dfc6dc30 0x5628dfc70020 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.457+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/2701600114 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc4d1f0 0x5628dfc4a340 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.457+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/2701600114 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc41260 0x5628dfc49e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.457+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/2701600114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc40940 0x5628dfc4c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.457+0000 7ff8ce85e740 1 -- 172.21.15.37:0/2701600114 >> 172.21.15.37:0/2701600114 conn(0x5628dfc3e770 msgr2=0x5628dfc442e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.458+0000 7ff8aaa00640 0 client.29152 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:17:41.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.458+0000 7ff8ce85e740 1 -- 172.21.15.37:0/2701600114 shutdown_connections 2024-08-20T05:17:41.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.458+0000 7ff8ce85e740 1 -- 172.21.15.37:0/2701600114 wait complete. 2024-08-20T05:17:41.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.459+0000 7ff8ce85e740 20 client.29152 trim_cache size 0 max 16384 2024-08-20T05:17:41.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.494+0000 7ff8ce85e740 1 Processor -- start 2024-08-20T05:17:41.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.494+0000 7ff8ce85e740 1 -- start start 2024-08-20T05:17:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.495+0000 7ff8ce85e740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc40940 0x5628dfc69fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.495+0000 7ff8ce85e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc41260 0x5628dfc45300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.495+0000 7ff8ce85e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc4d1f0 0x5628dfc758b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.495+0000 7ff8ce85e740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a400fcf0 con 0x5628dfc4d1f0 2024-08-20T05:17:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.495+0000 7ff8ce85e740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a4011860 con 0x5628dfc40940 2024-08-20T05:17:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.495+0000 7ff8ce85e740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a40103c0 con 0x5628dfc41260 2024-08-20T05:17:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.496+0000 7ff8c9400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc40940 0x5628dfc69fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.496+0000 7ff8c8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc41260 0x5628dfc45300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.496+0000 7ff8c8a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc41260 0x5628dfc45300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57550/0 (socket says 172.21.15.37:57550) 2024-08-20T05:17:41.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.496+0000 7ff8c8a00640 1 -- 172.21.15.37:0/1199771657 learned_addr learned my addr 172.21.15.37:0/1199771657 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.496+0000 7ff8c9e00640 1 --2- 172.21.15.37:0/1199771657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc4d1f0 0x5628dfc758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.496+0000 7ff8c9400640 1 -- 172.21.15.37:0/1199771657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc41260 msgr2=0x5628dfc45300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.496+0000 7ff8c9400640 1 --2- 172.21.15.37:0/1199771657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc41260 0x5628dfc45300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.496+0000 7ff8c9400640 1 -- 172.21.15.37:0/1199771657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc4d1f0 msgr2=0x5628dfc758b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.496+0000 7ff8c9400640 1 --2- 172.21.15.37:0/1199771657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc4d1f0 0x5628dfc758b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.497+0000 7ff8c9400640 1 -- 172.21.15.37:0/1199771657 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628dfc3f450 con 0x5628dfc40940 2024-08-20T05:17:41.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.498+0000 7ff8c9400640 1 --2- 172.21.15.37:0/1199771657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc40940 0x5628dfc69fd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009b30 tx=0x7ff8b8030430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e4096b30bcb3423 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.498+0000 7ff8b5c00640 1 -- 172.21.15.37:0/1199771657 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b8040030 con 0x5628dfc40940 2024-08-20T05:17:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.498+0000 7ff8b5c00640 1 -- 172.21.15.37:0/1199771657 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff8b8030730 con 0x5628dfc40940 2024-08-20T05:17:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.498+0000 7ff8b5c00640 1 -- 172.21.15.37:0/1199771657 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8b80316a0 con 0x5628dfc40940 2024-08-20T05:17:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.500+0000 7ff8ce85e740 1 -- 172.21.15.37:0/1199771657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc40940 msgr2=0x5628dfc69fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.500+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/1199771657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc40940 0x5628dfc69fd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009b30 tx=0x7ff8b8030430 comp rx=0 tx=0).stop 2024-08-20T05:17:41.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.500+0000 7ff8ce85e740 1 -- 172.21.15.37:0/1199771657 shutdown_connections 2024-08-20T05:17:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.500+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/1199771657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc4d1f0 0x5628dfc758b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.500+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/1199771657 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc41260 0x5628dfc45300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.500+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/1199771657 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc40940 0x5628dfc69fd0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.500+0000 7ff8ce85e740 1 -- 172.21.15.37:0/1199771657 >> 172.21.15.37:0/1199771657 conn(0x5628dfc3e770 msgr2=0x5628dfc44bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:41.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.501+0000 7ff8ce85e740 1 -- 172.21.15.37:0/1199771657 shutdown_connections 2024-08-20T05:17:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.501+0000 7ff8ce85e740 1 -- 172.21.15.37:0/1199771657 wait complete. 2024-08-20T05:17:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.502+0000 7ff8ce85e740 1 -- start start 2024-08-20T05:17:41.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.502+0000 7ff8ce85e740 1 Processor -- start 2024-08-20T05:17:41.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.505+0000 7ff8ce85e740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc40940 0x5628dfc66460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.506+0000 7ff8ce85e740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc41260 0x5628dfc669e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.506+0000 7ff8c9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc40940 0x5628dfc66460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:41.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.506+0000 7ff8c9400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc40940 0x5628dfc66460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57554/0 (socket says 172.21.15.37:57554) 2024-08-20T05:17:41.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.507+0000 7ff8c9400640 1 -- 172.21.15.37:0/4014676403 learned_addr learned my addr 172.21.15.37:0/4014676403 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:41.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.507+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/4014676403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc4d1f0 0x5628dfc61b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.507+0000 7ff8ce85e740 1 -- 172.21.15.37:0/4014676403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a4011190 con 0x5628dfc41260 2024-08-20T05:17:41.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.507+0000 7ff8c9e00640 1 --2- 172.21.15.37:0/4014676403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc4d1f0 0x5628dfc61b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:41.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.507+0000 7ff8c8a00640 1 --2- 172.21.15.37:0/4014676403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc41260 0x5628dfc669e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.508+0000 7ff8ce85e740 1 -- 172.21.15.37:0/4014676403 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a4010a90 con 0x5628dfc4d1f0 2024-08-20T05:17:41.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.508+0000 7ff8ce85e740 1 -- 172.21.15.37:0/4014676403 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a400dcd0 con 0x5628dfc40940 2024-08-20T05:17:41.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.509+0000 7ff8ce85e740 10 client.0 _ll_register_callbacks cb 0x7ff8bc009290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.509+0000 7ff8c9e00640 1 -- 172.21.15.37:0/4014676403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc40940 msgr2=0x5628dfc66460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.509+0000 7ff8c9e00640 1 --2- 172.21.15.37:0/4014676403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc40940 0x5628dfc66460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.509+0000 7ff8c9e00640 1 -- 172.21.15.37:0/4014676403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc41260 msgr2=0x5628dfc669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.509+0000 7ff8c9e00640 1 --2- 172.21.15.37:0/4014676403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc41260 0x5628dfc669e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.509+0000 7ff8c9e00640 1 -- 172.21.15.37:0/4014676403 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628dfc623b0 con 0x5628dfc4d1f0 2024-08-20T05:17:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.510+0000 7ff8c9400640 1 --2- 172.21.15.37:0/4014676403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc40940 0x5628dfc66460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:41.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.510+0000 7ff8ce85e740 1 -- 172.21.15.37:0/4014676403 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8b8030730 con 0x5628dfc4d1f0 2024-08-20T05:17:41.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.510+0000 7ff8c9e00640 1 --2- 172.21.15.37:0/4014676403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc4d1f0 0x5628dfc61b80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc01ce20 tx=0x7ff8bc01c670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=199a947d00ab3f0c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:41.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.510+0000 7ff8aaa00640 10 client.29135 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:17:41.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.513+0000 7ff8aaa00640 1 -- 172.21.15.37:0/4014676403 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc034050 con 0x5628dfc4d1f0 2024-08-20T05:17:41.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.513+0000 7ff8aaa00640 1 -- 172.21.15.37:0/4014676403 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff8bc013680 con 0x5628dfc4d1f0 2024-08-20T05:17:41.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.513+0000 7ff8aaa00640 1 -- 172.21.15.37:0/4014676403 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7ff8bc02a070 con 0x5628dfc4d1f0 2024-08-20T05:17:41.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.513+0000 7ff8ce85e740 10 client.29135 fetch_fsmap learned FSMap version 51 2024-08-20T05:17:41.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.516+0000 7ff8ce85e740 1 -- 172.21.15.37:0/4014676403 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({fsmap=51}) -- 0x5628dfcd84b0 con 0x5628dfc4d1f0 2024-08-20T05:17:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.516+0000 7ff8aaa00640 1 -- 172.21.15.37:0/4014676403 <== mon.2 v2:172.21.15.130:3300/0 4 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7ff8bc0138c0 con 0x5628dfc4d1f0 2024-08-20T05:17:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.516+0000 7ff8ce85e740 10 client.29135 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T05:17:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.516+0000 7ff8ce85e740 10 client.29135 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:17:41.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.516+0000 7ff8ce85e740 20 client.29135 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:41.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.516+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/4014676403 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5628dfcd8aa0 0x5628dfcdaee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:41.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.516+0000 7ff8ce85e740 4 client.29135 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:17:41.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.516+0000 7ff8ce85e740 1 -- 172.21.15.37:0/4014676403 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5628dfbb4490 con 0x5628dfcd8aa0 2024-08-20T05:17:41.520 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.517+0000 7ff8c9400640 1 --2- 172.21.15.37:0/4014676403 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5628dfcd8aa0 0x5628dfcdaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:41.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.518+0000 7ff8c9400640 1 --2- 172.21.15.37:0/4014676403 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5628dfcd8aa0 0x5628dfcdaee0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=53e53d3d0e9b4749 server_cookie=d9ccf10ad499be2 in_seq=0 out_seq=0 2024-08-20T05:17:41.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.518+0000 7ff8aaa00640 10 client.29135 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:17:41.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.518+0000 7ff8aaa00640 1 -- 172.21.15.37:0/4014676403 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5628dfbb4490 con 0x5628dfcd8aa0 2024-08-20T05:17:41.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.518+0000 7ff8aaa00640 10 client.29135 handle_command_reply: tid=0 2024-08-20T05:17:41.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.518+0000 7ff8ce85e740 1 client.29135 shutdown 2024-08-20T05:17:41.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.519+0000 7ff8ce85e740 1 -- 172.21.15.37:0/4014676403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc4d1f0 msgr2=0x5628dfc61b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:41.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.519+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/4014676403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc4d1f0 0x5628dfc61b80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc01ce20 tx=0x7ff8bc01c670 comp rx=0 tx=0).stop 2024-08-20T05:17:41.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.519+0000 7ff8ce85e740 1 -- 172.21.15.37:0/4014676403 shutdown_connections 2024-08-20T05:17:41.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.519+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/4014676403 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x5628dfcd8aa0 0x5628dfcdaee0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.519+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/4014676403 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5628dfc4d1f0 0x5628dfc61b80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.519+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/4014676403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5628dfc41260 0x5628dfc669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.519+0000 7ff8ce85e740 1 --2- 172.21.15.37:0/4014676403 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5628dfc40940 0x5628dfc66460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.519+0000 7ff8ce85e740 1 -- 172.21.15.37:0/4014676403 >> 172.21.15.37:0/4014676403 conn(0x5628dfc3e770 msgr2=0x5628dfc4bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.519+0000 7ff8aaa00640 0 client.29135 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:17:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.519+0000 7ff8ce85e740 1 -- 172.21.15.37:0/4014676403 shutdown_connections 2024-08-20T05:17:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.519+0000 7ff8ce85e740 1 -- 172.21.15.37:0/4014676403 wait complete. 2024-08-20T05:17:41.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.520+0000 7ff8ce85e740 20 client.29135 trim_cache size 0 max 16384 2024-08-20T05:17:41.526 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:17:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.521+0000 7ff8cbe00640 1 -- 172.21.15.37:0/3644880426 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8ac0b3ba0 msgr2=0x7ff8ac0b6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.521+0000 7ff8cbe00640 1 --2- 172.21.15.37:0/3644880426 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8ac0b3ba0 0x7ff8ac0b6060 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8009560 tx=0x7ff8b8030e40 comp rx=0 tx=0).stop 2024-08-20T05:17:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.521+0000 7ff8cbe00640 1 -- 172.21.15.37:0/3644880426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8c4077d20 msgr2=0x7ff8c41130b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:41.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.521+0000 7ff8cbe00640 1 --2- 172.21.15.37:0/3644880426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8c4077d20 0x7ff8c41130b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff8b000e9c0 tx=0x7ff8b000ee80 comp rx=0 tx=0).stop 2024-08-20T05:17:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.522+0000 7ff8cbe00640 1 -- 172.21.15.37:0/3644880426 shutdown_connections 2024-08-20T05:17:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.522+0000 7ff8cbe00640 1 --2- 172.21.15.37:0/3644880426 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8ac0b3ba0 0x7ff8ac0b6060 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.522+0000 7ff8cbe00640 1 --2- 172.21.15.37:0/3644880426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8c4113690 0x7ff8c410cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.522+0000 7ff8cbe00640 1 --2- 172.21.15.37:0/3644880426 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8c4077d20 0x7ff8c41130b0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.522+0000 7ff8cbe00640 1 --2- 172.21.15.37:0/3644880426 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8c4077400 0x7ff8c4112b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.522+0000 7ff8cbe00640 1 -- 172.21.15.37:0/3644880426 >> 172.21.15.37:0/3644880426 conn(0x7ff8c4100730 msgr2=0x7ff8c4102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.522+0000 7ff8cbe00640 1 -- 172.21.15.37:0/3644880426 shutdown_connections 2024-08-20T05:17:41.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:41.522+0000 7ff8cbe00640 1 -- 172.21.15.37:0/3644880426 wait complete. 2024-08-20T05:17:41.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:41 smithi037 ceph-mon[17265]: pgmap v864: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 4.1 MiB/s wr, 450 op/s 2024-08-20T05:17:41.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:41 smithi135 ceph-mon[22342]: pgmap v864: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 4.1 MiB/s wr, 450 op/s 2024-08-20T05:17:41.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:41 smithi130 ceph-mon[22007]: pgmap v864: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 4.1 MiB/s wr, 450 op/s 2024-08-20T05:17:42.454 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T05:17:43.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 885.0 s, 460.2 tps, lat 211.934 ms stddev 230.473 2024-08-20T05:17:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:17:43.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.624+0000 7f7162a00640 1 -- 172.21.15.37:0/1278583752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715c1063a0 msgr2=0x7f715c10cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:43.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.624+0000 7f7162a00640 1 --2- 172.21.15.37:0/1278583752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715c1063a0 0x7f715c10cd20 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7144009930 tx=0x7f714402a420 comp rx=0 tx=0).stop 2024-08-20T05:17:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.625+0000 7f7162a00640 1 -- 172.21.15.37:0/1278583752 shutdown_connections 2024-08-20T05:17:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.625+0000 7f7162a00640 1 --2- 172.21.15.37:0/1278583752 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715c1063a0 0x7f715c10cd20 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.625+0000 7f7162a00640 1 --2- 172.21.15.37:0/1278583752 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f715c1059e0 0x7f715c105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.625+0000 7f7162a00640 1 --2- 172.21.15.37:0/1278583752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f715c104890 0x7f715c104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.625+0000 7f7162a00640 1 -- 172.21.15.37:0/1278583752 >> 172.21.15.37:0/1278583752 conn(0x7f715c100130 msgr2=0x7f715c102570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.625+0000 7f7162a00640 1 -- 172.21.15.37:0/1278583752 shutdown_connections 2024-08-20T05:17:43.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.625+0000 7f7162a00640 1 -- 172.21.15.37:0/1278583752 wait complete. 2024-08-20T05:17:43.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.628+0000 7f7162a00640 1 Processor -- start 2024-08-20T05:17:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.629+0000 7f7162a00640 1 -- start start 2024-08-20T05:17:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.629+0000 7f7162a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f715c104890 0x7f715c196800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.629+0000 7f7162a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f715c1059e0 0x7f715c196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.629+0000 7f7162a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715c1063a0 0x7f715c197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.631 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.629+0000 7f7160a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715c1063a0 0x7f715c197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.629+0000 7f7160a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715c1063a0 0x7f715c197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46134/0 (socket says 172.21.15.37:46134) 2024-08-20T05:17:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.629+0000 7f7160a00640 1 -- 172.21.15.37:0/2277245930 learned_addr learned my addr 172.21.15.37:0/2277245930 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.629+0000 7f7162a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f715c110530 con 0x7f715c1059e0 2024-08-20T05:17:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.630+0000 7f7162a00640 1 -- 172.21.15.37:0/2277245930 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f715c1103b0 con 0x7f715c104890 2024-08-20T05:17:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.630+0000 7f7162a00640 1 -- 172.21.15.37:0/2277245930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f715c1106b0 con 0x7f715c1063a0 2024-08-20T05:17:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.630+0000 7f715be00640 1 --2- 172.21.15.37:0/2277245930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f715c104890 0x7f715c196800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.630+0000 7f7160a00640 1 -- 172.21.15.37:0/2277245930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f715c104890 msgr2=0x7f715c196800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:43.632 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.630+0000 7f7160a00640 1 --2- 172.21.15.37:0/2277245930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f715c104890 0x7f715c196800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.630+0000 7f7160a00640 1 -- 172.21.15.37:0/2277245930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f715c1059e0 msgr2=0x7f715c196e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.630+0000 7f7160a00640 1 --2- 172.21.15.37:0/2277245930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f715c1059e0 0x7f715c196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.630+0000 7f7160a00640 1 -- 172.21.15.37:0/2277245930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715c198340 con 0x7f715c1063a0 2024-08-20T05:17:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.630+0000 7f715be00640 1 --2- 172.21.15.37:0/2277245930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f715c104890 0x7f715c196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:17:43.633 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.630+0000 7f7160a00640 1 --2- 172.21.15.37:0/2277245930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715c1063a0 0x7f715c197a80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7144005ab0 tx=0x7f7144003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:43.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.632+0000 7f7158c00640 1 -- 172.21.15.37:0/2277245930 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714403f070 con 0x7f715c1063a0 2024-08-20T05:17:43.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.632+0000 7f7158c00640 1 -- 172.21.15.37:0/2277245930 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7144031c60 con 0x7f715c1063a0 2024-08-20T05:17:43.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.632+0000 7f7158c00640 1 -- 172.21.15.37:0/2277245930 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144035030 con 0x7f715c1063a0 2024-08-20T05:17:43.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.632+0000 7f7162a00640 1 -- 172.21.15.37:0/2277245930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715c1985d0 con 0x7f715c1063a0 2024-08-20T05:17:43.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.633+0000 7f7162a00640 1 -- 172.21.15.37:0/2277245930 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f715c19ccf0 con 0x7f715c1063a0 2024-08-20T05:17:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.640+0000 7f7158c00640 1 -- 172.21.15.37:0/2277245930 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7144042070 con 0x7f715c1063a0 2024-08-20T05:17:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.642+0000 7f7165a40740 1 Processor -- start 2024-08-20T05:17:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.643+0000 7f7165a40740 1 -- start start 2024-08-20T05:17:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.643+0000 7f7165a40740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c5988f2b0 0x560c598916a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.643+0000 7f7165a40740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c59891be0 0x560c59893fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.643+0000 7f7165a40740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c59894620 0x560c59896ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.643+0000 7f7165a40740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560c59802210 con 0x560c59894620 2024-08-20T05:17:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.643+0000 7f7165a40740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560c597f1710 con 0x560c59891be0 2024-08-20T05:17:43.646 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.643+0000 7f7165a40740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560c597f5750 con 0x560c5988f2b0 2024-08-20T05:17:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.643+0000 7f715b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c5988f2b0 0x560c598916a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.644+0000 7f715b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c5988f2b0 0x560c598916a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46138/0 (socket says 172.21.15.37:46138) 2024-08-20T05:17:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.644+0000 7f715b400640 1 -- 172.21.15.37:0/769315716 learned_addr learned my addr 172.21.15.37:0/769315716 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:43.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.644+0000 7f715be00640 1 --2- 172.21.15.37:0/769315716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c59891be0 0x560c59893fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.644+0000 7f715b400640 1 -- 172.21.15.37:0/769315716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c59891be0 msgr2=0x560c59893fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.644+0000 7f715b400640 1 --2- 172.21.15.37:0/769315716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c59891be0 0x560c59893fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.644+0000 7f715b400640 1 -- 172.21.15.37:0/769315716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c59894620 msgr2=0x560c59896ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.644+0000 7f715b400640 1 --2- 172.21.15.37:0/769315716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c59894620 0x560c59896ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.644+0000 7f715b400640 1 -- 172.21.15.37:0/769315716 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c597bdde0 con 0x560c5988f2b0 2024-08-20T05:17:43.651 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.645+0000 7f715b400640 1 --2- 172.21.15.37:0/769315716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c5988f2b0 0x560c598916a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f714c00ab90 tx=0x7f714c00f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f3dcb9a070e0065 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.645+0000 7f7151200640 1 -- 172.21.15.37:0/769315716 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c015070 con 0x560c5988f2b0 2024-08-20T05:17:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.645+0000 7f7151200640 1 -- 172.21.15.37:0/769315716 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f714c0054d0 con 0x560c5988f2b0 2024-08-20T05:17:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.645+0000 7f7151200640 1 -- 172.21.15.37:0/769315716 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c011440 con 0x560c5988f2b0 2024-08-20T05:17:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.646+0000 7f7165a40740 1 -- 172.21.15.37:0/769315716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c5988f2b0 msgr2=0x560c598916a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.646+0000 7f7165a40740 1 --2- 172.21.15.37:0/769315716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c5988f2b0 0x560c598916a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f714c00ab90 tx=0x7f714c00f730 comp rx=0 tx=0).stop 2024-08-20T05:17:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.647+0000 7f7165a40740 1 -- 172.21.15.37:0/769315716 shutdown_connections 2024-08-20T05:17:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.647+0000 7f7165a40740 1 --2- 172.21.15.37:0/769315716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c59894620 0x560c59896ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.647+0000 7f7165a40740 1 --2- 172.21.15.37:0/769315716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c59891be0 0x560c59893fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.647+0000 7f7165a40740 1 --2- 172.21.15.37:0/769315716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c5988f2b0 0x560c598916a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.647+0000 7f7165a40740 1 -- 172.21.15.37:0/769315716 >> 172.21.15.37:0/769315716 conn(0x560c5988a3b0 msgr2=0x560c5988b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.647+0000 7f7165a40740 1 -- 172.21.15.37:0/769315716 shutdown_connections 2024-08-20T05:17:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.647+0000 7f7165a40740 1 -- 172.21.15.37:0/769315716 wait complete. 2024-08-20T05:17:43.652 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.647+0000 7f7165a40740 1 -- start start 2024-08-20T05:17:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.648+0000 7f7165a40740 1 Processor -- start 2024-08-20T05:17:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.648+0000 7f7165a40740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c5988f2b0 0x560c59898d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.648+0000 7f7165a40740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c59891be0 0x560c598993b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.648+0000 7f7165a40740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c59894620 0x560c59899f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.653 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.649+0000 7f7165a40740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560c5972aab0 con 0x560c5988f2b0 2024-08-20T05:17:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.649+0000 7f7165a40740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560c59798140 con 0x560c59891be0 2024-08-20T05:17:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.649+0000 7f7165a40740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560c59897600 con 0x560c59894620 2024-08-20T05:17:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.649+0000 7f7165a40740 10 client.0 _ll_register_callbacks cb 0x560c597ab5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.650+0000 7f715be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c59891be0 0x560c598993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.650+0000 7f715be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c59891be0 0x560c598993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47350/0 (socket says 172.21.15.37:47350) 2024-08-20T05:17:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.650+0000 7f715be00640 1 -- 172.21.15.37:0/2036604723 learned_addr learned my addr 172.21.15.37:0/2036604723 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.651+0000 7f715b400640 1 --2- 172.21.15.37:0/2036604723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c59894620 0x560c59899f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.651+0000 7f7158c00640 1 --2- 172.21.15.37:0/2277245930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71400b3b70 0x7f71400b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.654 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.651+0000 7f7158c00640 1 -- 172.21.15.37:0/2277245930 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7144104820 con 0x7f715c1063a0 2024-08-20T05:17:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.652+0000 7f715be00640 1 -- 172.21.15.37:0/2036604723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c59894620 msgr2=0x560c59899f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.652+0000 7f715be00640 1 --2- 172.21.15.37:0/2036604723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c59894620 0x560c59899f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.652+0000 7f715be00640 1 -- 172.21.15.37:0/2036604723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c5988f2b0 msgr2=0x560c59898d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.652+0000 7f715be00640 1 --2- 172.21.15.37:0/2036604723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c5988f2b0 0x560c59898d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.652+0000 7f715be00640 1 -- 172.21.15.37:0/2036604723 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c59799170 con 0x560c59891be0 2024-08-20T05:17:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.652+0000 7f715b400640 1 --2- 172.21.15.37:0/2036604723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c59894620 0x560c59899f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:17:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.652+0000 7f7160a00640 1 --2- 172.21.15.37:0/2277245930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71400b3b70 0x7f71400b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:43.655 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.654+0000 7f7149600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:17:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.654+0000 7f715be00640 1 --2- 172.21.15.37:0/2036604723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c59891be0 0x560c598993b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f71540116e0 tx=0x7f7154011ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=833728d527d91eb5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:43.656 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.654+0000 7f7160a00640 1 --2- 172.21.15.37:0/2277245930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71400b3b70 0x7f71400b6030 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f71440cb360 tx=0x7f71440045e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.655+0000 7f7149600640 1 -- 172.21.15.37:0/2036604723 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154003b70 con 0x560c59891be0 2024-08-20T05:17:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.655+0000 7f7149600640 1 -- 172.21.15.37:0/2036604723 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7154003d10 con 0x560c59891be0 2024-08-20T05:17:43.657 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.656+0000 7f7165a40740 1 -- 172.21.15.37:0/2036604723 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560c597c8a30 con 0x560c59891be0 2024-08-20T05:17:43.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.657+0000 7f7149600640 1 -- 172.21.15.37:0/2036604723 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f7154025050 con 0x560c59891be0 2024-08-20T05:17:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.657+0000 7f7165a40740 10 client.29144 fetch_fsmap learned FSMap version 51 2024-08-20T05:17:43.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.657+0000 7f7165a40740 1 -- 172.21.15.37:0/2036604723 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x560c59554790 con 0x560c59891be0 2024-08-20T05:17:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.659+0000 7f7149600640 1 -- 172.21.15.37:0/2036604723 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560c597c8a30 con 0x560c59891be0 2024-08-20T05:17:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.659+0000 7f7149600640 1 -- 172.21.15.37:0/2036604723 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f71540045b0 con 0x560c59891be0 2024-08-20T05:17:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.659+0000 7f7165a40740 10 client.29144 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T05:17:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.659+0000 7f7165a40740 10 client.29144 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:17:43.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.659+0000 7f7165a40740 20 client.29144 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.659+0000 7f7165a40740 1 --2- 172.21.15.37:0/2036604723 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560c598a4aa0 0x560c598a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.659+0000 7f7165a40740 4 client.29144 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:17:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.660+0000 7f7165a40740 1 -- 172.21.15.37:0/2036604723 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c59804160 con 0x560c598a4aa0 2024-08-20T05:17:43.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.660+0000 7f715b400640 1 --2- 172.21.15.37:0/2036604723 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560c598a4aa0 0x560c598a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.661+0000 7f715b400640 1 --2- 172.21.15.37:0/2036604723 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560c598a4aa0 0x560c598a6f00 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=789275484c5bc461 server_cookie=66ccb8d8f9c62b6b in_seq=0 out_seq=0 2024-08-20T05:17:43.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.662+0000 7f7149600640 10 client.29144 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.662+0000 7f7149600640 1 -- 172.21.15.37:0/2036604723 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560c59804160 con 0x560c598a4aa0 2024-08-20T05:17:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.662+0000 7f7149600640 10 client.29144 handle_command_reply: tid=0 2024-08-20T05:17:43.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.663+0000 7f7165a40740 1 client.29144 shutdown 2024-08-20T05:17:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.663+0000 7f7165a40740 1 -- 172.21.15.37:0/2036604723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c59891be0 msgr2=0x560c598993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:43.665 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.663+0000 7f7165a40740 1 --2- 172.21.15.37:0/2036604723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c59891be0 0x560c598993b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f71540116e0 tx=0x7f7154011ba0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.664+0000 7f7165a40740 1 -- 172.21.15.37:0/2036604723 shutdown_connections 2024-08-20T05:17:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.664+0000 7f7165a40740 1 --2- 172.21.15.37:0/2036604723 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560c598a4aa0 0x560c598a6f00 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.664+0000 7f7165a40740 1 --2- 172.21.15.37:0/2036604723 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c59894620 0x560c59899f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.664+0000 7f7149600640 0 client.29144 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:43.666 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.664+0000 7f7165a40740 1 --2- 172.21.15.37:0/2036604723 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c59891be0 0x560c598993b0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.664+0000 7f7165a40740 1 --2- 172.21.15.37:0/2036604723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c5988f2b0 0x560c59898d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.664+0000 7f7165a40740 1 -- 172.21.15.37:0/2036604723 >> 172.21.15.37:0/2036604723 conn(0x560c5988a3b0 msgr2=0x560c598894d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.664+0000 7f7165a40740 1 -- 172.21.15.37:0/2036604723 shutdown_connections 2024-08-20T05:17:43.667 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.664+0000 7f7165a40740 1 -- 172.21.15.37:0/2036604723 wait complete. 2024-08-20T05:17:43.668 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.664+0000 7f7165a40740 20 client.29144 trim_cache size 0 max 16384 2024-08-20T05:17:43.668 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:43 smithi037 ceph-mon[17265]: pgmap v865: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 3.5 MiB/s wr, 415 op/s 2024-08-20T05:17:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.715+0000 7f7165a40740 1 Processor -- start 2024-08-20T05:17:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.715+0000 7f7165a40740 1 -- start start 2024-08-20T05:17:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.716+0000 7f7165a40740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c5988f2b0 0x560c5988aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.716+0000 7f7165a40740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c59891be0 0x560c59896310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.716+0000 7f7165a40740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c59894620 0x560c59896850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.716+0000 7f7165a40740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f715c1ba240 con 0x560c59891be0 2024-08-20T05:17:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.716+0000 7f7165a40740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f715c1bbdb0 con 0x560c5988f2b0 2024-08-20T05:17:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.716+0000 7f7165a40740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f715c1ba910 con 0x560c59894620 2024-08-20T05:17:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.716+0000 7f715b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c5988f2b0 0x560c5988aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.716+0000 7f715b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c5988f2b0 0x560c5988aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47362/0 (socket says 172.21.15.37:47362) 2024-08-20T05:17:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.716+0000 7f715b400640 1 -- 172.21.15.37:0/848536838 learned_addr learned my addr 172.21.15.37:0/848536838 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.716+0000 7f715b400640 1 --2- 172.21.15.37:0/848536838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c59894620 0x560c59896850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.717+0000 7f715b400640 1 -- 172.21.15.37:0/848536838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c59894620 msgr2=0x560c59896850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.717+0000 7f715b400640 1 --2- 172.21.15.37:0/848536838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c59894620 0x560c59896850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.717+0000 7f715b400640 1 -- 172.21.15.37:0/848536838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c59891be0 msgr2=0x560c59896310 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:17:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.717+0000 7f715b400640 1 --2- 172.21.15.37:0/848536838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c59891be0 0x560c59896310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.717+0000 7f715b400640 1 -- 172.21.15.37:0/848536838 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c595cd620 con 0x560c5988f2b0 2024-08-20T05:17:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.717+0000 7f715b400640 1 --2- 172.21.15.37:0/848536838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c5988f2b0 0x560c5988aff0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f714c004ae0 tx=0x7f714c01b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=376129a6ba673b61 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.717+0000 7f714be00640 1 -- 172.21.15.37:0/848536838 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c015040 con 0x560c5988f2b0 2024-08-20T05:17:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.718+0000 7f714be00640 1 -- 172.21.15.37:0/848536838 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560c59804160 con 0x560c5988f2b0 2024-08-20T05:17:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.718+0000 7f714be00640 1 -- 172.21.15.37:0/848536838 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c015040 con 0x560c5988f2b0 2024-08-20T05:17:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.719+0000 7f7165a40740 1 -- 172.21.15.37:0/848536838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c5988f2b0 msgr2=0x560c5988aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.719+0000 7f7165a40740 1 --2- 172.21.15.37:0/848536838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c5988f2b0 0x560c5988aff0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f714c004ae0 tx=0x7f714c01b040 comp rx=0 tx=0).stop 2024-08-20T05:17:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.719+0000 7f7165a40740 1 -- 172.21.15.37:0/848536838 shutdown_connections 2024-08-20T05:17:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.719+0000 7f7165a40740 1 --2- 172.21.15.37:0/848536838 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c59894620 0x560c59896850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.719+0000 7f7165a40740 1 --2- 172.21.15.37:0/848536838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c59891be0 0x560c59896310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.719+0000 7f7165a40740 1 --2- 172.21.15.37:0/848536838 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c5988f2b0 0x560c5988aff0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.719+0000 7f7165a40740 1 -- 172.21.15.37:0/848536838 >> 172.21.15.37:0/848536838 conn(0x560c5988a3b0 msgr2=0x560c59885230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.719+0000 7f7165a40740 1 -- 172.21.15.37:0/848536838 shutdown_connections 2024-08-20T05:17:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.719+0000 7f7165a40740 1 -- 172.21.15.37:0/848536838 wait complete. 2024-08-20T05:17:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.720+0000 7f7165a40740 1 -- start start 2024-08-20T05:17:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.720+0000 7f7165a40740 1 Processor -- start 2024-08-20T05:17:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.721+0000 7f7165a40740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c5988f2b0 0x560c5989d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.721+0000 7f7165a40740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c59891be0 0x560c5989dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.721+0000 7f7165a40740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c59894620 0x560c5989eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.721+0000 7f7165a40740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f715c1bb6e0 con 0x560c59894620 2024-08-20T05:17:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.721+0000 7f7165a40740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f715c1bafe0 con 0x560c5988f2b0 2024-08-20T05:17:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.721+0000 7f7165a40740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f715c1b8220 con 0x560c59891be0 2024-08-20T05:17:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.721+0000 7f7165a40740 10 client.0 _ll_register_callbacks cb 0x7f7154009760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.722+0000 7f715b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c5988f2b0 0x560c5989d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.722+0000 7f715b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c5988f2b0 0x560c5989d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47364/0 (socket says 172.21.15.37:47364) 2024-08-20T05:17:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.722+0000 7f715b400640 1 -- 172.21.15.37:0/3397549898 learned_addr learned my addr 172.21.15.37:0/3397549898 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:43.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.722+0000 7f715be00640 1 --2- 172.21.15.37:0/3397549898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c59891be0 0x560c5989dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:43.726 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.723+0000 7f715b400640 1 --2- 172.21.15.37:0/3397549898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c59894620 0x560c5989eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.725+0000 7f715be00640 1 -- 172.21.15.37:0/3397549898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c5988f2b0 msgr2=0x560c5989d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.725+0000 7f715be00640 1 --2- 172.21.15.37:0/3397549898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c5988f2b0 0x560c5989d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.725+0000 7f715be00640 1 -- 172.21.15.37:0/3397549898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c59894620 msgr2=0x560c5989eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.726+0000 7f715be00640 1 --2- 172.21.15.37:0/3397549898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c59894620 0x560c5989eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.727+0000 7f715be00640 1 -- 172.21.15.37:0/3397549898 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c5989f3b0 con 0x560c59891be0 2024-08-20T05:17:43.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.729+0000 7f715be00640 1 --2- 172.21.15.37:0/3397549898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c59891be0 0x560c5989dfb0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f71540125e0 tx=0x7f7154009e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbae5de8fa7934a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.729+0000 7f7149600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:17:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.731+0000 7f7149600640 1 -- 172.21.15.37:0/3397549898 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154004c00 con 0x560c59891be0 2024-08-20T05:17:43.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.732+0000 7f7149600640 1 -- 172.21.15.37:0/3397549898 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7154004da0 con 0x560c59891be0 2024-08-20T05:17:43.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.733+0000 7f7165a40740 1 -- 172.21.15.37:0/3397549898 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560c59804160 con 0x560c59891be0 2024-08-20T05:17:43.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.734+0000 7f7149600640 1 -- 172.21.15.37:0/3397549898 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f715400f940 con 0x560c59891be0 2024-08-20T05:17:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.734+0000 7f7165a40740 10 client.29173 fetch_fsmap learned FSMap version 51 2024-08-20T05:17:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.736+0000 7f7165a40740 1 -- 172.21.15.37:0/3397549898 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x560c598a07f0 con 0x560c59891be0 2024-08-20T05:17:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.736+0000 7f7149600640 1 -- 172.21.15.37:0/3397549898 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560c59804160 con 0x560c59891be0 2024-08-20T05:17:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.737+0000 7f7149600640 1 -- 172.21.15.37:0/3397549898 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f7154005040 con 0x560c59891be0 2024-08-20T05:17:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.737+0000 7f7165a40740 10 client.29173 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T05:17:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.737+0000 7f7165a40740 10 client.29173 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:17:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.737+0000 7f7165a40740 20 client.29173 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.737+0000 7f7165a40740 1 --2- 172.21.15.37:0/3397549898 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560c598a4aa0 0x560c599117b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.737+0000 7f7165a40740 4 client.29173 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:17:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.737+0000 7f7165a40740 1 -- 172.21.15.37:0/3397549898 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560c597ffc00 con 0x560c598a4aa0 2024-08-20T05:17:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.738+0000 7f715b400640 1 --2- 172.21.15.37:0/3397549898 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560c598a4aa0 0x560c599117b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.740+0000 7f715b400640 1 --2- 172.21.15.37:0/3397549898 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560c598a4aa0 0x560c599117b0 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5be9ccf135a0873 server_cookie=72e2f7e85a7960cc in_seq=0 out_seq=0 2024-08-20T05:17:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:43.742+0000 7f7149600640 10 client.29173 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:43.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:43 smithi135 ceph-mon[22342]: pgmap v865: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 3.5 MiB/s wr, 415 op/s 2024-08-20T05:17:43.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:43 smithi130 ceph-mon[22007]: pgmap v865: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 3.5 MiB/s wr, 415 op/s 2024-08-20T05:17:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.012+0000 7f7149600640 1 -- 172.21.15.37:0/3397549898 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560c597ffc00 con 0x560c598a4aa0 2024-08-20T05:17:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.012+0000 7f7149600640 10 client.29173 handle_command_reply: tid=0 2024-08-20T05:17:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.012+0000 7f7165a40740 1 client.29173 shutdown 2024-08-20T05:17:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.013+0000 7f7165a40740 1 -- 172.21.15.37:0/3397549898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c59891be0 msgr2=0x560c5989dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.013+0000 7f7165a40740 1 --2- 172.21.15.37:0/3397549898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c59891be0 0x560c5989dfb0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f71540125e0 tx=0x7f7154009e50 comp rx=0 tx=0).stop 2024-08-20T05:17:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.013+0000 7f7165a40740 1 -- 172.21.15.37:0/3397549898 shutdown_connections 2024-08-20T05:17:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.013+0000 7f7165a40740 1 --2- 172.21.15.37:0/3397549898 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560c598a4aa0 0x560c599117b0 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.013+0000 7f7165a40740 1 --2- 172.21.15.37:0/3397549898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560c59894620 0x560c5989eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.013+0000 7f7165a40740 1 --2- 172.21.15.37:0/3397549898 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560c59891be0 0x560c5989dfb0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.013+0000 7f7165a40740 1 --2- 172.21.15.37:0/3397549898 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560c5988f2b0 0x560c5989d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.013+0000 7f7149600640 0 client.29173 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.013+0000 7f7165a40740 1 -- 172.21.15.37:0/3397549898 >> 172.21.15.37:0/3397549898 conn(0x560c5988a3b0 msgr2=0x560c59896310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.013+0000 7f7165a40740 1 -- 172.21.15.37:0/3397549898 shutdown_connections 2024-08-20T05:17:44.016 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.014+0000 7f7165a40740 1 -- 172.21.15.37:0/3397549898 wait complete. 2024-08-20T05:17:44.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.014+0000 7f7165a40740 20 client.29173 trim_cache size 0 max 16384 2024-08-20T05:17:44.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:17:44.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:17:44.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:17:44.017 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:17:44.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.016+0000 7f7162a00640 1 -- 172.21.15.37:0/2277245930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71400b3b70 msgr2=0x7f71400b6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:44.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.016+0000 7f7162a00640 1 --2- 172.21.15.37:0/2277245930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71400b3b70 0x7f71400b6030 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f71440cb360 tx=0x7f71440045e0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.016+0000 7f7162a00640 1 -- 172.21.15.37:0/2277245930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715c1063a0 msgr2=0x7f715c197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:44.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.016+0000 7f7162a00640 1 --2- 172.21.15.37:0/2277245930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715c1063a0 0x7f715c197a80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7144005ab0 tx=0x7f7144003cd0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.016+0000 7f7162a00640 1 -- 172.21.15.37:0/2277245930 shutdown_connections 2024-08-20T05:17:44.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.016+0000 7f7162a00640 1 --2- 172.21.15.37:0/2277245930 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f71400b3b70 0x7f71400b6030 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.016+0000 7f7162a00640 1 --2- 172.21.15.37:0/2277245930 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f715c1063a0 0x7f715c197a80 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.016+0000 7f7162a00640 1 --2- 172.21.15.37:0/2277245930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f715c1059e0 0x7f715c196e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.016+0000 7f7162a00640 1 --2- 172.21.15.37:0/2277245930 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f715c104890 0x7f715c196800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.018 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.016+0000 7f7162a00640 1 -- 172.21.15.37:0/2277245930 >> 172.21.15.37:0/2277245930 conn(0x7f715c100130 msgr2=0x7f715c0792d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.016+0000 7f7162a00640 1 -- 172.21.15.37:0/2277245930 shutdown_connections 2024-08-20T05:17:44.019 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:44.016+0000 7f7162a00640 1 -- 172.21.15.37:0/2277245930 wait complete. 2024-08-20T05:17:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.249+0000 7f5134800640 1 -- 172.21.15.37:0/600206742 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f512c10a6b0 msgr2=0x7f512c10aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.249+0000 7f5134800640 1 --2- 172.21.15.37:0/600206742 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f512c10a6b0 0x7f512c10aaf0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f511c009900 tx=0x7f511c02a440 comp rx=0 tx=0).stop 2024-08-20T05:17:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.249+0000 7f5134800640 1 -- 172.21.15.37:0/600206742 shutdown_connections 2024-08-20T05:17:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.249+0000 7f5134800640 1 --2- 172.21.15.37:0/600206742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f512c10b030 0x7f512c111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.249+0000 7f5134800640 1 --2- 172.21.15.37:0/600206742 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f512c10a6b0 0x7f512c10aaf0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.249+0000 7f5134800640 1 --2- 172.21.15.37:0/600206742 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f512c104ca0 0x7f512c105080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.249+0000 7f5134800640 1 -- 172.21.15.37:0/600206742 >> 172.21.15.37:0/600206742 conn(0x7f512c100730 msgr2=0x7f512c102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.250+0000 7f5134800640 1 -- 172.21.15.37:0/600206742 shutdown_connections 2024-08-20T05:17:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.250+0000 7f5134800640 1 -- 172.21.15.37:0/600206742 wait complete. 2024-08-20T05:17:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.251+0000 7f5134800640 1 Processor -- start 2024-08-20T05:17:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.252+0000 7f5134800640 1 -- start start 2024-08-20T05:17:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.252+0000 7f5134800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f512c104ca0 0x7f512c0744a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.253+0000 7f5134800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f512c10a6b0 0x7f512c0749e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.253+0000 7f5134800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f512c10b030 0x7f512c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.253+0000 7f5134800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f512c114d40 con 0x7f512c104ca0 2024-08-20T05:17:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.253+0000 7f5134800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f512c114bc0 con 0x7f512c10a6b0 2024-08-20T05:17:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.253+0000 7f5134800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f512c114ec0 con 0x7f512c10b030 2024-08-20T05:17:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.253+0000 7f5132800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f512c10b030 0x7f512c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:44.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.253+0000 7f5132800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f512c10b030 0x7f512c06d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46198/0 (socket says 172.21.15.37:46198) 2024-08-20T05:17:44.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.253+0000 7f5132800640 1 -- 172.21.15.37:0/2922473224 learned_addr learned my addr 172.21.15.37:0/2922473224 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.254+0000 7f5132800640 1 -- 172.21.15.37:0/2922473224 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f512c10a6b0 msgr2=0x7f512c0749e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T05:17:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.254+0000 7f5132800640 1 --2- 172.21.15.37:0/2922473224 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f512c10a6b0 0x7f512c0749e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.254+0000 7f5132800640 1 -- 172.21.15.37:0/2922473224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f512c104ca0 msgr2=0x7f512c0744a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.254+0000 7f5132800640 1 --2- 172.21.15.37:0/2922473224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f512c104ca0 0x7f512c0744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.254+0000 7f5132800640 1 -- 172.21.15.37:0/2922473224 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512c06e0b0 con 0x7f512c10b030 2024-08-20T05:17:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.254+0000 7f5132800640 1 --2- 172.21.15.37:0/2922473224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f512c10b030 0x7f512c06d7f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f512800b970 tx=0x7f512800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.254+0000 7f5126a00640 1 -- 172.21.15.37:0/2922473224 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128019070 con 0x7f512c10b030 2024-08-20T05:17:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.255+0000 7f5134800640 1 -- 172.21.15.37:0/2922473224 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512c06e3a0 con 0x7f512c10b030 2024-08-20T05:17:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.255+0000 7f5134800640 1 -- 172.21.15.37:0/2922473224 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f512c0733b0 con 0x7f512c10b030 2024-08-20T05:17:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.255+0000 7f5126a00640 1 -- 172.21.15.37:0/2922473224 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5128014440 con 0x7f512c10b030 2024-08-20T05:17:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.255+0000 7f5126a00640 1 -- 172.21.15.37:0/2922473224 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51280075b0 con 0x7f512c10b030 2024-08-20T05:17:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.264+0000 7f5137414740 1 Processor -- start 2024-08-20T05:17:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.266+0000 7f5126a00640 1 -- 172.21.15.37:0/2922473224 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f512801c070 con 0x7f512c10b030 2024-08-20T05:17:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.266+0000 7f5137414740 1 -- start start 2024-08-20T05:17:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.267+0000 7f5137414740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24cf940 0x5647d24cfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.267+0000 7f5137414740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24d0260 0x5647d24dbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.267+0000 7f5137414740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d24dc1f0 0x5647d24de5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.267+0000 7f5137414740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5647d2445aa0 con 0x5647d24dc1f0 2024-08-20T05:17:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.267+0000 7f5137414740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5647d2434fa0 con 0x5647d24d0260 2024-08-20T05:17:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.267+0000 7f5137414740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5647d2438fe0 con 0x5647d24cf940 2024-08-20T05:17:44.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.267+0000 7f5131400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24cf940 0x5647d24cfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:44.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.267+0000 7f5131400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24cf940 0x5647d24cfd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46208/0 (socket says 172.21.15.37:46208) 2024-08-20T05:17:44.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.267+0000 7f5131400640 1 -- 172.21.15.37:0/519325758 learned_addr learned my addr 172.21.15.37:0/519325758 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:44.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.268+0000 7f5126a00640 1 --2- 172.21.15.37:0/2922473224 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f51140b3c90 0x7f51140b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.269+0000 7f5126a00640 1 -- 172.21.15.37:0/2922473224 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f51280e35a0 con 0x7f512c10b030 2024-08-20T05:17:44.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.270+0000 7f5131e00640 1 --2- 172.21.15.37:0/519325758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24d0260 0x5647d24dbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:44.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.270+0000 7f5131400640 1 -- 172.21.15.37:0/519325758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24d0260 msgr2=0x5647d24dbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:44.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.270+0000 7f5131400640 1 --2- 172.21.15.37:0/519325758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24d0260 0x5647d24dbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.270+0000 7f5131400640 1 -- 172.21.15.37:0/519325758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d24dc1f0 msgr2=0x5647d24de5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:44.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.270+0000 7f5131400640 1 --2- 172.21.15.37:0/519325758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d24dc1f0 0x5647d24de5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.270+0000 7f5131400640 1 -- 172.21.15.37:0/519325758 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647d23db420 con 0x5647d24cf940 2024-08-20T05:17:44.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.270+0000 7f5131400640 1 --2- 172.21.15.37:0/519325758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24cf940 0x5647d24cfd20 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f511c009850 tx=0x7f511c004c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0830432f107bfee server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:44.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.271+0000 7f5132800640 1 --2- 172.21.15.37:0/2922473224 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f51140b3c90 0x7f51140b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:44.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.271+0000 7f511b000640 1 -- 172.21.15.37:0/519325758 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c042020 con 0x5647d24cf940 2024-08-20T05:17:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.271+0000 7f511b000640 1 -- 172.21.15.37:0/519325758 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f511c003670 con 0x5647d24cf940 2024-08-20T05:17:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.271+0000 7f511b000640 1 -- 172.21.15.37:0/519325758 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c0055e0 con 0x5647d24cf940 2024-08-20T05:17:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.272+0000 7f5137414740 1 -- 172.21.15.37:0/519325758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24cf940 msgr2=0x5647d24cfd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.273+0000 7f5137414740 1 --2- 172.21.15.37:0/519325758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24cf940 0x5647d24cfd20 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f511c009850 tx=0x7f511c004c90 comp rx=0 tx=0).stop 2024-08-20T05:17:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.273+0000 7f5132800640 1 --2- 172.21.15.37:0/2922473224 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f51140b3c90 0x7f51140b6150 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f51280a9e50 tx=0x7f5128004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.274+0000 7f5137414740 1 -- 172.21.15.37:0/519325758 shutdown_connections 2024-08-20T05:17:44.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.274+0000 7f5137414740 1 --2- 172.21.15.37:0/519325758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d24dc1f0 0x5647d24de5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.274+0000 7f5137414740 1 --2- 172.21.15.37:0/519325758 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24d0260 0x5647d24dbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.274+0000 7f5137414740 1 --2- 172.21.15.37:0/519325758 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24cf940 0x5647d24cfd20 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.274+0000 7f5137414740 1 -- 172.21.15.37:0/519325758 >> 172.21.15.37:0/519325758 conn(0x5647d24cd770 msgr2=0x5647d24ce910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.274+0000 7f5137414740 1 -- 172.21.15.37:0/519325758 shutdown_connections 2024-08-20T05:17:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.275+0000 7f5137414740 1 -- 172.21.15.37:0/519325758 wait complete. 2024-08-20T05:17:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.275+0000 7f5137414740 1 -- start start 2024-08-20T05:17:44.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.276+0000 7f5137414740 1 Processor -- start 2024-08-20T05:17:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.278+0000 7f5137414740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24cf940 0x5647d24dba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.278+0000 7f5137414740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24d0260 0x5647d24d8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.278+0000 7f5137414740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d24dc1f0 0x5647d24d9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.278+0000 7f5137414740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5647d2297700 con 0x5647d24dc1f0 2024-08-20T05:17:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.278+0000 7f5137414740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5647d23d0290 con 0x5647d24cf940 2024-08-20T05:17:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.278+0000 7f5137414740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5647d24dee10 con 0x5647d24d0260 2024-08-20T05:17:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.278+0000 7f5137414740 10 client.0 _ll_register_callbacks cb 0x5647d242f1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.278+0000 7f5131400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24cf940 0x5647d24dba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:44.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.278+0000 7f5131400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24cf940 0x5647d24dba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47396/0 (socket says 172.21.15.37:47396) 2024-08-20T05:17:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.278+0000 7f5131400640 1 -- 172.21.15.37:0/1975133581 learned_addr learned my addr 172.21.15.37:0/1975133581 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.279+0000 7f5131e00640 1 --2- 172.21.15.37:0/1975133581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24d0260 0x5647d24d8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.279+0000 7f5131400640 1 -- 172.21.15.37:0/1975133581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24d0260 msgr2=0x5647d24d8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:44.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.279+0000 7f5131400640 1 --2- 172.21.15.37:0/1975133581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24d0260 0x5647d24d8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.279+0000 7f5131400640 1 -- 172.21.15.37:0/1975133581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d24dc1f0 msgr2=0x5647d24d9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.279+0000 7f5131400640 1 --2- 172.21.15.37:0/1975133581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d24dc1f0 0x5647d24d9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.279+0000 7f5131400640 1 -- 172.21.15.37:0/1975133581 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647d2194650 con 0x5647d24cf940 2024-08-20T05:17:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.279+0000 7f5131400640 1 --2- 172.21.15.37:0/1975133581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24cf940 0x5647d24dba60 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f511c009900 tx=0x7f511c03e690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a5df4fd5386f6e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.279+0000 7f510f400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:17:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.280+0000 7f510f400640 1 -- 172.21.15.37:0/1975133581 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c052060 con 0x5647d24cf940 2024-08-20T05:17:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.280+0000 7f5137414740 1 -- 172.21.15.37:0/1975133581 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f511c003670 con 0x5647d24cf940 2024-08-20T05:17:44.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.280+0000 7f510f400640 1 -- 172.21.15.37:0/1975133581 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f511c004f80 con 0x5647d24cf940 2024-08-20T05:17:44.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.280+0000 7f510f400640 1 -- 172.21.15.37:0/1975133581 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f511c042030 con 0x5647d24cf940 2024-08-20T05:17:44.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.280+0000 7f5137414740 10 client.29159 fetch_fsmap learned FSMap version 51 2024-08-20T05:17:44.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.280+0000 7f5137414740 1 -- 172.21.15.37:0/1975133581 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5647d24ea720 con 0x5647d24cf940 2024-08-20T05:17:44.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.281+0000 7f510f400640 1 -- 172.21.15.37:0/1975133581 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f511c003670 con 0x5647d24cf940 2024-08-20T05:17:44.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.282+0000 7f510f400640 1 -- 172.21.15.37:0/1975133581 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f511c047450 con 0x5647d24cf940 2024-08-20T05:17:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.283+0000 7f5137414740 10 client.29159 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T05:17:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.283+0000 7f5137414740 10 client.29159 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:17:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.283+0000 7f5137414740 20 client.29159 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.283+0000 7f5137414740 1 --2- 172.21.15.37:0/1975133581 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5647d24eba70 0x5647d24ede60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.283+0000 7f5137414740 4 client.29159 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:17:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.283+0000 7f5137414740 1 -- 172.21.15.37:0/1975133581 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5647d24479f0 con 0x5647d24eba70 2024-08-20T05:17:44.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.283+0000 7f5131e00640 1 --2- 172.21.15.37:0/1975133581 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5647d24eba70 0x5647d24ede60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:44.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.286+0000 7f5131e00640 1 --2- 172.21.15.37:0/1975133581 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5647d24eba70 0x5647d24ede60 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ae62b1b8e97bca8b server_cookie=28aa7ac5fe1b7c3f in_seq=0 out_seq=0 2024-08-20T05:17:44.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.286+0000 7f510f400640 10 client.29159 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:17:44.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.287+0000 7f510f400640 1 -- 172.21.15.37:0/1975133581 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5647d24479f0 con 0x5647d24eba70 2024-08-20T05:17:44.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.288+0000 7f510f400640 10 client.29159 handle_command_reply: tid=0 2024-08-20T05:17:44.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.288+0000 7f5137414740 1 client.29159 shutdown 2024-08-20T05:17:44.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.289+0000 7f5137414740 1 -- 172.21.15.37:0/1975133581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24cf940 msgr2=0x5647d24dba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:44.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.289+0000 7f5137414740 1 --2- 172.21.15.37:0/1975133581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24cf940 0x5647d24dba60 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f511c009900 tx=0x7f511c03e690 comp rx=0 tx=0).stop 2024-08-20T05:17:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.289+0000 7f5137414740 1 -- 172.21.15.37:0/1975133581 shutdown_connections 2024-08-20T05:17:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.290+0000 7f5137414740 1 --2- 172.21.15.37:0/1975133581 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5647d24eba70 0x5647d24ede60 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.290+0000 7f5137414740 1 --2- 172.21.15.37:0/1975133581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d24dc1f0 0x5647d24d9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.290+0000 7f5137414740 1 --2- 172.21.15.37:0/1975133581 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24d0260 0x5647d24d8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.290+0000 7f5137414740 1 --2- 172.21.15.37:0/1975133581 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24cf940 0x5647d24dba60 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.290+0000 7f5137414740 1 -- 172.21.15.37:0/1975133581 >> 172.21.15.37:0/1975133581 conn(0x5647d24cd770 msgr2=0x5647d24d32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:44.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.290+0000 7f510f400640 0 client.29159 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:17:44.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.290+0000 7f5137414740 1 -- 172.21.15.37:0/1975133581 shutdown_connections 2024-08-20T05:17:44.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.290+0000 7f5137414740 1 -- 172.21.15.37:0/1975133581 wait complete. 2024-08-20T05:17:44.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.291+0000 7f5137414740 20 client.29159 trim_cache size 0 max 16384 2024-08-20T05:17:44.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.323+0000 7f5137414740 1 Processor -- start 2024-08-20T05:17:44.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.324+0000 7f5137414740 1 -- start start 2024-08-20T05:17:44.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.325+0000 7f5137414740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d24cf940 0x5647d24cc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.325+0000 7f5137414740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24d0260 0x5647d24ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.325+0000 7f5137414740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24dc1f0 0x5647d24f0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.326+0000 7f5137414740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f512c1cf640 con 0x5647d24cf940 2024-08-20T05:17:44.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.326+0000 7f5131e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24d0260 0x5647d24ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:44.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.326+0000 7f5131e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24d0260 0x5647d24ccc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46232/0 (socket says 172.21.15.37:46232) 2024-08-20T05:17:44.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.326+0000 7f5131e00640 1 -- 172.21.15.37:0/678825663 learned_addr learned my addr 172.21.15.37:0/678825663 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:44.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.326+0000 7f5137414740 1 -- 172.21.15.37:0/678825663 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f512c1d11b0 con 0x5647d24dc1f0 2024-08-20T05:17:44.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.326+0000 7f5137414740 1 -- 172.21.15.37:0/678825663 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f512c1cfd10 con 0x5647d24d0260 2024-08-20T05:17:44.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.326+0000 7f5131400640 1 --2- 172.21.15.37:0/678825663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24dc1f0 0x5647d24f0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:44.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.326+0000 7f5131e00640 1 -- 172.21.15.37:0/678825663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24dc1f0 msgr2=0x5647d24f0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:44.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.326+0000 7f5131e00640 1 --2- 172.21.15.37:0/678825663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24dc1f0 0x5647d24f0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.326+0000 7f5131e00640 1 -- 172.21.15.37:0/678825663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d24cf940 msgr2=0x5647d24cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:44.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.326+0000 7f5131e00640 1 --2- 172.21.15.37:0/678825663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d24cf940 0x5647d24cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.326+0000 7f5131e00640 1 -- 172.21.15.37:0/678825663 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647d24c8ef0 con 0x5647d24d0260 2024-08-20T05:17:44.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.327+0000 7f5131e00640 1 --2- 172.21.15.37:0/678825663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24d0260 0x5647d24ccc80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f512000bd30 tx=0x7f5120005f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c512bb340d3913ab server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:44.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.329+0000 7f511a600640 1 -- 172.21.15.37:0/678825663 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5120012dc0 con 0x5647d24d0260 2024-08-20T05:17:44.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.330+0000 7f511a600640 1 -- 172.21.15.37:0/678825663 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5120005020 con 0x5647d24d0260 2024-08-20T05:17:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.330+0000 7f511a600640 1 -- 172.21.15.37:0/678825663 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5120004a00 con 0x5647d24d0260 2024-08-20T05:17:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.331+0000 7f5137414740 1 -- 172.21.15.37:0/678825663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24d0260 msgr2=0x5647d24ccc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.331+0000 7f5137414740 1 --2- 172.21.15.37:0/678825663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24d0260 0x5647d24ccc80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f512000bd30 tx=0x7f5120005f30 comp rx=0 tx=0).stop 2024-08-20T05:17:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.335+0000 7f5137414740 1 -- 172.21.15.37:0/678825663 shutdown_connections 2024-08-20T05:17:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.335+0000 7f5137414740 1 --2- 172.21.15.37:0/678825663 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24dc1f0 0x5647d24f0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.335+0000 7f5137414740 1 --2- 172.21.15.37:0/678825663 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24d0260 0x5647d24ccc80 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.335+0000 7f5137414740 1 --2- 172.21.15.37:0/678825663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d24cf940 0x5647d24cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.335+0000 7f5137414740 1 -- 172.21.15.37:0/678825663 >> 172.21.15.37:0/678825663 conn(0x5647d24cd770 msgr2=0x5647d24cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.335+0000 7f5137414740 1 -- 172.21.15.37:0/678825663 shutdown_connections 2024-08-20T05:17:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.336+0000 7f5137414740 1 -- 172.21.15.37:0/678825663 wait complete. 2024-08-20T05:17:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.336+0000 7f5137414740 1 -- start start 2024-08-20T05:17:44.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.337+0000 7f5137414740 1 Processor -- start 2024-08-20T05:17:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.338+0000 7f5137414740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24cf940 0x5647d24f07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.338+0000 7f5137414740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24d0260 0x5647d24f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.339+0000 7f5131400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24cf940 0x5647d24f07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.339+0000 7f5131400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24cf940 0x5647d24f07b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47410/0 (socket says 172.21.15.37:47410) 2024-08-20T05:17:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.339+0000 7f5137414740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d24dc1f0 0x5647d254b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.339+0000 7f5137414740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f512c1d0ae0 con 0x5647d24dc1f0 2024-08-20T05:17:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.339+0000 7f5137414740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f512c1d03e0 con 0x5647d24cf940 2024-08-20T05:17:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.339+0000 7f5137414740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f512c07b1f0 con 0x5647d24d0260 2024-08-20T05:17:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.339+0000 7f5137414740 10 client.0 _ll_register_callbacks cb 0x7f511c004be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.339+0000 7f5131400640 1 -- 172.21.15.37:0/3159575975 learned_addr learned my addr 172.21.15.37:0/3159575975 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.340+0000 7f5131400640 1 --2- 172.21.15.37:0/3159575975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d24dc1f0 0x5647d254b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.341+0000 7f5131400640 1 -- 172.21.15.37:0/3159575975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24d0260 msgr2=0x5647d24f0d50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:17:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.341+0000 7f5131400640 1 --2- 172.21.15.37:0/3159575975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24d0260 0x5647d24f0d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.341+0000 7f5131400640 1 -- 172.21.15.37:0/3159575975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d24dc1f0 msgr2=0x5647d254b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.341+0000 7f5131400640 1 --2- 172.21.15.37:0/3159575975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d24dc1f0 0x5647d254b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.341+0000 7f5131400640 1 -- 172.21.15.37:0/3159575975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647d254bcc0 con 0x5647d24cf940 2024-08-20T05:17:44.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.342+0000 7f5131400640 1 --2- 172.21.15.37:0/3159575975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24cf940 0x5647d24f07b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f511c047ac0 tx=0x7f511c02a440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab4284d40b359e24 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:44.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.342+0000 7f510f400640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:17:44.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.342+0000 7f510f400640 1 -- 172.21.15.37:0/3159575975 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511c052040 con 0x5647d24cf940 2024-08-20T05:17:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.343+0000 7f510f400640 1 -- 172.21.15.37:0/3159575975 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f511c02acc0 con 0x5647d24cf940 2024-08-20T05:17:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.343+0000 7f5137414740 1 -- 172.21.15.37:0/3159575975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5120005020 con 0x5647d24cf940 2024-08-20T05:17:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.343+0000 7f510f400640 1 -- 172.21.15.37:0/3159575975 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f511c05c080 con 0x5647d24cf940 2024-08-20T05:17:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.343+0000 7f5137414740 10 client.29165 fetch_fsmap learned FSMap version 51 2024-08-20T05:17:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.344+0000 7f5137414740 1 -- 172.21.15.37:0/3159575975 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x5647d2556360 con 0x5647d24cf940 2024-08-20T05:17:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.344+0000 7f510f400640 1 -- 172.21.15.37:0/3159575975 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5120005020 con 0x5647d24cf940 2024-08-20T05:17:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.344+0000 7f510f400640 1 -- 172.21.15.37:0/3159575975 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f511c004db0 con 0x5647d24cf940 2024-08-20T05:17:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.344+0000 7f5137414740 10 client.29165 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T05:17:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.345+0000 7f5137414740 10 client.29165 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:17:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.345+0000 7f5137414740 20 client.29165 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.345+0000 7f5137414740 1 --2- 172.21.15.37:0/3159575975 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5647d2556b10 0x5647d2558f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.345+0000 7f5137414740 4 client.29165 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:17:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.345+0000 7f5137414740 1 -- 172.21.15.37:0/3159575975 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5647d2443490 con 0x5647d2556b10 2024-08-20T05:17:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.345+0000 7f5131e00640 1 --2- 172.21.15.37:0/3159575975 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5647d2556b10 0x5647d2558f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.346+0000 7f510f400640 10 client.29165 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:17:44.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.349+0000 7f5131e00640 1 --2- 172.21.15.37:0/3159575975 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5647d2556b10 0x5647d2558f30 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed52d69c7dc7e44f server_cookie=5fafd69aa3a84c8 in_seq=0 out_seq=0 2024-08-20T05:17:44.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.350+0000 7f510f400640 1 -- 172.21.15.37:0/3159575975 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5647d2443490 con 0x5647d2556b10 2024-08-20T05:17:44.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.350+0000 7f510f400640 10 client.29165 handle_command_reply: tid=0 2024-08-20T05:17:44.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.350+0000 7f5137414740 1 client.29165 shutdown 2024-08-20T05:17:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.351+0000 7f5137414740 1 -- 172.21.15.37:0/3159575975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24cf940 msgr2=0x5647d24f07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:44.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.351+0000 7f5137414740 1 --2- 172.21.15.37:0/3159575975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24cf940 0x5647d24f07b0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f511c047ac0 tx=0x7f511c02a440 comp rx=0 tx=0).stop 2024-08-20T05:17:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.354+0000 7f5137414740 1 -- 172.21.15.37:0/3159575975 shutdown_connections 2024-08-20T05:17:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.354+0000 7f5137414740 1 --2- 172.21.15.37:0/3159575975 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5647d2556b10 0x5647d2558f30 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.354+0000 7f5137414740 1 --2- 172.21.15.37:0/3159575975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5647d24dc1f0 0x5647d254b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.354+0000 7f5137414740 1 --2- 172.21.15.37:0/3159575975 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5647d24d0260 0x5647d24f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.354+0000 7f5137414740 1 --2- 172.21.15.37:0/3159575975 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5647d24cf940 0x5647d24f07b0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.354+0000 7f5137414740 1 -- 172.21.15.37:0/3159575975 >> 172.21.15.37:0/3159575975 conn(0x5647d24cd770 msgr2=0x5647d24cc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:44.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.354+0000 7f510f400640 0 client.29165 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:17:44.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.355+0000 7f5137414740 1 -- 172.21.15.37:0/3159575975 shutdown_connections 2024-08-20T05:17:44.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.355+0000 7f5137414740 1 -- 172.21.15.37:0/3159575975 wait complete. 2024-08-20T05:17:44.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.355+0000 7f5137414740 20 client.29165 trim_cache size 0 max 16384 2024-08-20T05:17:44.358 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:17:44.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.357+0000 7f5134800640 1 -- 172.21.15.37:0/2922473224 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f51140b3c90 msgr2=0x7f51140b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:44.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.357+0000 7f5134800640 1 --2- 172.21.15.37:0/2922473224 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f51140b3c90 0x7f51140b6150 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f51280a9e50 tx=0x7f5128004a40 comp rx=0 tx=0).stop 2024-08-20T05:17:44.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.357+0000 7f5134800640 1 -- 172.21.15.37:0/2922473224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f512c10b030 msgr2=0x7f512c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.357+0000 7f5134800640 1 --2- 172.21.15.37:0/2922473224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f512c10b030 0x7f512c06d7f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f512800b970 tx=0x7f512800be30 comp rx=0 tx=0).stop 2024-08-20T05:17:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.358+0000 7f5134800640 1 -- 172.21.15.37:0/2922473224 shutdown_connections 2024-08-20T05:17:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.358+0000 7f5134800640 1 --2- 172.21.15.37:0/2922473224 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f51140b3c90 0x7f51140b6150 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.358+0000 7f5134800640 1 --2- 172.21.15.37:0/2922473224 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f512c10b030 0x7f512c06d7f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.358+0000 7f5134800640 1 --2- 172.21.15.37:0/2922473224 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f512c10a6b0 0x7f512c0749e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.358+0000 7f5134800640 1 --2- 172.21.15.37:0/2922473224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f512c104ca0 0x7f512c0744a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:44.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.358+0000 7f5134800640 1 -- 172.21.15.37:0/2922473224 >> 172.21.15.37:0/2922473224 conn(0x7f512c100730 msgr2=0x7f512c102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:44.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.358+0000 7f5134800640 1 -- 172.21.15.37:0/2922473224 shutdown_connections 2024-08-20T05:17:44.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:44.359+0000 7f5134800640 1 -- 172.21.15.37:0/2922473224 wait complete. 2024-08-20T05:17:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:45 smithi135 ceph-mon[22342]: pgmap v866: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 4.1 MiB/s wr, 489 op/s 2024-08-20T05:17:45.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:45 smithi130 ceph-mon[22007]: pgmap v866: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 4.1 MiB/s wr, 489 op/s 2024-08-20T05:17:46.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:45 smithi037 ceph-mon[17265]: pgmap v866: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 4.1 MiB/s wr, 489 op/s 2024-08-20T05:17:47.172 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T05:17:47.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:47 smithi135 ceph-mon[22342]: pgmap v867: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 3.6 MiB/s wr, 425 op/s 2024-08-20T05:17:47.897 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:17:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:47 smithi130 ceph-mon[22007]: pgmap v867: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 3.6 MiB/s wr, 425 op/s 2024-08-20T05:17:48.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:47 smithi037 ceph-mon[17265]: pgmap v867: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 3.6 MiB/s wr, 425 op/s 2024-08-20T05:17:48.040 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 890.0 s, 704.4 tps, lat 140.177 ms stddev 152.709 2024-08-20T05:17:48.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.886+0000 7f3db1800640 1 -- 172.21.15.37:0/797619204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dac109e80 msgr2=0x7f3dac110ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:48.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.886+0000 7f3db1800640 1 --2- 172.21.15.37:0/797619204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dac109e80 0x7f3dac110ee0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009890 tx=0x7f3d9c02a380 comp rx=0 tx=0).stop 2024-08-20T05:17:48.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.886+0000 7f3db1800640 1 -- 172.21.15.37:0/797619204 shutdown_connections 2024-08-20T05:17:48.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.886+0000 7f3db1800640 1 --2- 172.21.15.37:0/797619204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac11bdd0 0x7f3dac11e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.886+0000 7f3db1800640 1 --2- 172.21.15.37:0/797619204 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dac10a260 0x7f3dac10a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.886+0000 7f3db1800640 1 --2- 172.21.15.37:0/797619204 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dac109e80 0x7f3dac110ee0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.886+0000 7f3db1800640 1 -- 172.21.15.37:0/797619204 >> 172.21.15.37:0/797619204 conn(0x7f3dac06c830 msgr2=0x7f3dac06cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:48.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.886+0000 7f3db1800640 1 -- 172.21.15.37:0/797619204 shutdown_connections 2024-08-20T05:17:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.886+0000 7f3db1800640 1 -- 172.21.15.37:0/797619204 wait complete. 2024-08-20T05:17:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.888+0000 7f3db1800640 1 Processor -- start 2024-08-20T05:17:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.892+0000 7f3db1800640 1 -- start start 2024-08-20T05:17:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.893+0000 7f3db1800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dac109e80 0x7f3dac1a7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.894+0000 7f3db1800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac10a260 0x7f3dac1a8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.894+0000 7f3db1800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dac11bdd0 0x7f3dac1ad530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.894+0000 7f3dab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac10a260 0x7f3dac1a8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.894+0000 7f3db1800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac1217a0 con 0x7f3dac10a260 2024-08-20T05:17:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.894+0000 7f3db0e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dac11bdd0 0x7f3dac1ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.895+0000 7f3db0e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dac11bdd0 0x7f3dac1ad530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47418/0 (socket says 172.21.15.37:47418) 2024-08-20T05:17:48.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.895+0000 7f3db0e00640 1 -- 172.21.15.37:0/2205612382 learned_addr learned my addr 172.21.15.37:0/2205612382 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:48.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.895+0000 7f3db1800640 1 -- 172.21.15.37:0/2205612382 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac121620 con 0x7f3dac11bdd0 2024-08-20T05:17:48.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.895+0000 7f3db1800640 1 -- 172.21.15.37:0/2205612382 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac121920 con 0x7f3dac109e80 2024-08-20T05:17:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.896+0000 7f3db0e00640 1 -- 172.21.15.37:0/2205612382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dac109e80 msgr2=0x7f3dac1a7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.896+0000 7f3db0e00640 1 --2- 172.21.15.37:0/2205612382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dac109e80 0x7f3dac1a7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.896+0000 7f3db0e00640 1 -- 172.21.15.37:0/2205612382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac10a260 msgr2=0x7f3dac1a8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.896+0000 7f3db0e00640 1 --2- 172.21.15.37:0/2205612382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac10a260 0x7f3dac1a8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.896+0000 7f3db0e00640 1 -- 172.21.15.37:0/2205612382 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dac1add00 con 0x7f3dac11bdd0 2024-08-20T05:17:48.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.897+0000 7f3dab400640 1 --2- 172.21.15.37:0/2205612382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac10a260 0x7f3dac1a8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:17:48.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.897+0000 7f3db0e00640 1 --2- 172.21.15.37:0/2205612382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dac11bdd0 0x7f3dac1ad530 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f3da400eaa0 tx=0x7f3da400ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:48.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.897+0000 7f3da8c00640 1 -- 172.21.15.37:0/2205612382 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da400cdb0 con 0x7f3dac11bdd0 2024-08-20T05:17:48.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.897+0000 7f3da8c00640 1 -- 172.21.15.37:0/2205612382 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3da4005020 con 0x7f3dac11bdd0 2024-08-20T05:17:48.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.897+0000 7f3da8c00640 1 -- 172.21.15.37:0/2205612382 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da40116b0 con 0x7f3dac11bdd0 2024-08-20T05:17:48.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.897+0000 7f3db1800640 1 -- 172.21.15.37:0/2205612382 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dac1adff0 con 0x7f3dac11bdd0 2024-08-20T05:17:48.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.898+0000 7f3db1800640 1 -- 172.21.15.37:0/2205612382 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dac1b46b0 con 0x7f3dac11bdd0 2024-08-20T05:17:48.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.905+0000 7f3db5a73740 1 Processor -- start 2024-08-20T05:17:48.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.906+0000 7f3da8c00640 1 -- 172.21.15.37:0/2205612382 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3da40054b0 con 0x7f3dac11bdd0 2024-08-20T05:17:48.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.908+0000 7f3da8c00640 1 --2- 172.21.15.37:0/2205612382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d900b3d40 0x7f3d900b6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:48.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.910+0000 7f3db5a73740 1 -- start start 2024-08-20T05:17:48.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.911+0000 7f3db5a73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b965ac0 0x557e3b965ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.911+0000 7f3db5a73740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b9663e0 0x557e3b971e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.911+0000 7f3db5a73740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b972370 0x557e3b974760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.911+0000 7f3db5a73740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e3b8dbaa0 con 0x557e3b972370 2024-08-20T05:17:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.911+0000 7f3db5a73740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557e3b8cafa0 con 0x557e3b9663e0 2024-08-20T05:17:48.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.911+0000 7f3db5a73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557e3b8cefe0 con 0x557e3b965ac0 2024-08-20T05:17:48.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.912+0000 7f3db0e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b972370 0x557e3b974760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:48.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.912+0000 7f3db0e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b972370 0x557e3b974760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56774/0 (socket says 172.21.15.37:56774) 2024-08-20T05:17:48.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.912+0000 7f3db0e00640 1 -- 172.21.15.37:0/2526169189 learned_addr learned my addr 172.21.15.37:0/2526169189 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:48.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.912+0000 7f3dab400640 1 --2- 172.21.15.37:0/2526169189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b9663e0 0x557e3b971e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:48.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.912+0000 7f3dabe00640 1 --2- 172.21.15.37:0/2526169189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b965ac0 0x557e3b965ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:48.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.912+0000 7f3da8c00640 1 -- 172.21.15.37:0/2205612382 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3da40e4130 con 0x7f3dac11bdd0 2024-08-20T05:17:48.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.914+0000 7f3dabe00640 1 -- 172.21.15.37:0/2526169189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b9663e0 msgr2=0x557e3b971e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:48.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.915+0000 7f3dabe00640 1 --2- 172.21.15.37:0/2526169189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b9663e0 0x557e3b971e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.915+0000 7f3dabe00640 1 -- 172.21.15.37:0/2526169189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b972370 msgr2=0x557e3b974760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:48.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.915+0000 7f3dabe00640 1 --2- 172.21.15.37:0/2526169189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b972370 0x557e3b974760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.915+0000 7f3dabe00640 1 -- 172.21.15.37:0/2526169189 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e3b871420 con 0x557e3b965ac0 2024-08-20T05:17:48.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.916+0000 7f3db0e00640 1 --2- 172.21.15.37:0/2526169189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b972370 0x557e3b974760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:17:48.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.916+0000 7f3dab400640 1 --2- 172.21.15.37:0/2526169189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b9663e0 0x557e3b971e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:17:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.917+0000 7f3dabe00640 1 --2- 172.21.15.37:0/2526169189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b965ac0 0x557e3b965ea0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009890 tx=0x7f3d9c009490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b91fa812b630bde server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.918+0000 7f3da1600640 1 -- 172.21.15.37:0/2526169189 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c037040 con 0x557e3b965ac0 2024-08-20T05:17:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.918+0000 7f3da1600640 1 -- 172.21.15.37:0/2526169189 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d9c040070 con 0x557e3b965ac0 2024-08-20T05:17:48.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.920+0000 7f3da1600640 1 -- 172.21.15.37:0/2526169189 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c0035f0 con 0x557e3b965ac0 2024-08-20T05:17:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.920+0000 7f3db5a73740 1 -- 172.21.15.37:0/2526169189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b965ac0 msgr2=0x557e3b965ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.920+0000 7f3db5a73740 1 --2- 172.21.15.37:0/2526169189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b965ac0 0x557e3b965ea0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009890 tx=0x7f3d9c009490 comp rx=0 tx=0).stop 2024-08-20T05:17:48.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.920+0000 7f3dab400640 1 --2- 172.21.15.37:0/2205612382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d900b3d40 0x7f3d900b6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:48.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.922+0000 7f3db5a73740 1 -- 172.21.15.37:0/2526169189 shutdown_connections 2024-08-20T05:17:48.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.922+0000 7f3db5a73740 1 --2- 172.21.15.37:0/2526169189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b972370 0x557e3b974760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.922+0000 7f3db5a73740 1 --2- 172.21.15.37:0/2526169189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b9663e0 0x557e3b971e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.922+0000 7f3db5a73740 1 --2- 172.21.15.37:0/2526169189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b965ac0 0x557e3b965ea0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.922+0000 7f3db5a73740 1 -- 172.21.15.37:0/2526169189 >> 172.21.15.37:0/2526169189 conn(0x557e3b9638f0 msgr2=0x557e3b964a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.923+0000 7f3dab400640 1 --2- 172.21.15.37:0/2205612382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d900b3d40 0x7f3d900b6200 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009510 tx=0x7f3d98004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.923+0000 7f3db5a73740 1 -- 172.21.15.37:0/2526169189 shutdown_connections 2024-08-20T05:17:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.924+0000 7f3db5a73740 1 -- 172.21.15.37:0/2526169189 wait complete. 2024-08-20T05:17:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.925+0000 7f3db5a73740 1 -- start start 2024-08-20T05:17:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.925+0000 7f3db5a73740 1 Processor -- start 2024-08-20T05:17:48.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.929+0000 7f3db5a73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b965ac0 0x557e3b9719c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:48.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.930+0000 7f3db5a73740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b9663e0 0x557e3b96ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.930+0000 7f3dabe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b965ac0 0x557e3b9719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.930+0000 7f3dabe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b965ac0 0x557e3b9719c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46268/0 (socket says 172.21.15.37:46268) 2024-08-20T05:17:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.931+0000 7f3dabe00640 1 -- 172.21.15.37:0/1373167521 learned_addr learned my addr 172.21.15.37:0/1373167521 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.931+0000 7f3db5a73740 1 --2- 172.21.15.37:0/1373167521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b972370 0x557e3b96f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.931+0000 7f3dab400640 1 --2- 172.21.15.37:0/1373167521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b9663e0 0x557e3b96ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:48.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.931+0000 7f3db5a73740 1 -- 172.21.15.37:0/1373167521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557e3b72d700 con 0x557e3b9663e0 2024-08-20T05:17:48.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.932+0000 7f3db5a73740 1 -- 172.21.15.37:0/1373167521 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557e3b866290 con 0x557e3b972370 2024-08-20T05:17:48.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.933+0000 7f3db5a73740 1 -- 172.21.15.37:0/1373167521 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557e3b975030 con 0x557e3b965ac0 2024-08-20T05:17:48.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.933+0000 7f3db0e00640 1 --2- 172.21.15.37:0/1373167521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b972370 0x557e3b96f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.934+0000 7f3db5a73740 10 client.0 _ll_register_callbacks cb 0x557e3b8c51c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.935+0000 7f3dabe00640 1 -- 172.21.15.37:0/1373167521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b972370 msgr2=0x557e3b96f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.935+0000 7f3dabe00640 1 --2- 172.21.15.37:0/1373167521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b972370 0x557e3b96f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.935+0000 7f3dabe00640 1 -- 172.21.15.37:0/1373167521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b9663e0 msgr2=0x557e3b96ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.935+0000 7f3dabe00640 1 --2- 172.21.15.37:0/1373167521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b9663e0 0x557e3b96ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.935+0000 7f3dabe00640 1 -- 172.21.15.37:0/1373167521 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e3b62a650 con 0x557e3b965ac0 2024-08-20T05:17:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.937+0000 7f3dabe00640 1 --2- 172.21.15.37:0/1373167521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b965ac0 0x557e3b9719c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009340 tx=0x7f3d9c0095a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b673d24e821bbe88 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.937+0000 7f3d96000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:17:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.938+0000 7f3d96000640 1 -- 172.21.15.37:0/1373167521 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c04a070 con 0x557e3b965ac0 2024-08-20T05:17:48.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.938+0000 7f3db5a73740 1 -- 172.21.15.37:0/1373167521 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d9c040070 con 0x557e3b965ac0 2024-08-20T05:17:48.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.938+0000 7f3d96000640 1 -- 172.21.15.37:0/1373167521 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3d9c004240 con 0x557e3b965ac0 2024-08-20T05:17:48.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.939+0000 7f3d96000640 1 -- 172.21.15.37:0/1373167521 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f3d9c037040 con 0x557e3b965ac0 2024-08-20T05:17:48.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.939+0000 7f3db5a73740 10 client.29194 fetch_fsmap learned FSMap version 51 2024-08-20T05:17:48.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.939+0000 7f3db5a73740 1 -- 172.21.15.37:0/1373167521 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x557e3b9806c0 con 0x557e3b965ac0 2024-08-20T05:17:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.940+0000 7f3d96000640 1 -- 172.21.15.37:0/1373167521 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d9c040070 con 0x557e3b965ac0 2024-08-20T05:17:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.940+0000 7f3d96000640 1 -- 172.21.15.37:0/1373167521 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f3d9c03a070 con 0x557e3b965ac0 2024-08-20T05:17:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.941+0000 7f3db5a73740 10 client.29194 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T05:17:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.941+0000 7f3db5a73740 10 client.29194 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:17:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.941+0000 7f3db5a73740 20 client.29194 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.941+0000 7f3db5a73740 1 --2- 172.21.15.37:0/1373167521 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x557e3b981a10 0x557e3b983e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.941+0000 7f3db5a73740 4 client.29194 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:17:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.941+0000 7f3db5a73740 1 -- 172.21.15.37:0/1373167521 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e3b8dd9f0 con 0x557e3b981a10 2024-08-20T05:17:48.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.941+0000 7f3dab400640 1 --2- 172.21.15.37:0/1373167521 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x557e3b981a10 0x557e3b983e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:48.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.942+0000 7f3dab400640 1 --2- 172.21.15.37:0/1373167521 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x557e3b981a10 0x557e3b983e00 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=90794613d1ecdd85 server_cookie=db93e12c24fc4e16 in_seq=0 out_seq=0 2024-08-20T05:17:48.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.942+0000 7f3d96000640 10 client.29194 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:17:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.943+0000 7f3d96000640 1 -- 172.21.15.37:0/1373167521 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557e3b8dd9f0 con 0x557e3b981a10 2024-08-20T05:17:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.943+0000 7f3d96000640 10 client.29194 handle_command_reply: tid=0 2024-08-20T05:17:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.945+0000 7f3db5a73740 1 client.29194 shutdown 2024-08-20T05:17:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.946+0000 7f3db5a73740 1 -- 172.21.15.37:0/1373167521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b965ac0 msgr2=0x557e3b9719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.946+0000 7f3db5a73740 1 --2- 172.21.15.37:0/1373167521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b965ac0 0x557e3b9719c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c009340 tx=0x7f3d9c0095a0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.946+0000 7f3db5a73740 1 -- 172.21.15.37:0/1373167521 shutdown_connections 2024-08-20T05:17:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.947+0000 7f3db5a73740 1 --2- 172.21.15.37:0/1373167521 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x557e3b981a10 0x557e3b983e00 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.947+0000 7f3db5a73740 1 --2- 172.21.15.37:0/1373167521 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b972370 0x557e3b96f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.947+0000 7f3db5a73740 1 --2- 172.21.15.37:0/1373167521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b9663e0 0x557e3b96ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.947+0000 7f3db5a73740 1 --2- 172.21.15.37:0/1373167521 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b965ac0 0x557e3b9719c0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.947+0000 7f3db5a73740 1 -- 172.21.15.37:0/1373167521 >> 172.21.15.37:0/1373167521 conn(0x557e3b9638f0 msgr2=0x557e3b969460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.947+0000 7f3d96000640 0 client.29194 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:17:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.948+0000 7f3db5a73740 1 -- 172.21.15.37:0/1373167521 shutdown_connections 2024-08-20T05:17:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.948+0000 7f3db5a73740 1 -- 172.21.15.37:0/1373167521 wait complete. 2024-08-20T05:17:48.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.949+0000 7f3db5a73740 20 client.29194 trim_cache size 0 max 16384 2024-08-20T05:17:48.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.984+0000 7f3db5a73740 1 Processor -- start 2024-08-20T05:17:48.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.984+0000 7f3db5a73740 1 -- start start 2024-08-20T05:17:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.985+0000 7f3db5a73740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b965ac0 0x557e3b96f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.985+0000 7f3db5a73740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b9663e0 0x557e3b970b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.985+0000 7f3db5a73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b972370 0x557e3b973760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.985+0000 7f3db5a73740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac1be3f0 con 0x557e3b9663e0 2024-08-20T05:17:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.985+0000 7f3db5a73740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac1bff60 con 0x557e3b965ac0 2024-08-20T05:17:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.985+0000 7f3db5a73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac1beac0 con 0x557e3b972370 2024-08-20T05:17:48.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.986+0000 7f3dab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b9663e0 0x557e3b970b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:48.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.986+0000 7f3dab400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b9663e0 0x557e3b970b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56794/0 (socket says 172.21.15.37:56794) 2024-08-20T05:17:48.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.986+0000 7f3dab400640 1 -- 172.21.15.37:0/148144499 learned_addr learned my addr 172.21.15.37:0/148144499 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:48.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.986+0000 7f3dab400640 1 -- 172.21.15.37:0/148144499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b972370 msgr2=0x557e3b973760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:17:48.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.986+0000 7f3dab400640 1 --2- 172.21.15.37:0/148144499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b972370 0x557e3b973760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.986+0000 7f3dab400640 1 -- 172.21.15.37:0/148144499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b965ac0 msgr2=0x557e3b96f3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:17:48.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.986+0000 7f3dab400640 1 --2- 172.21.15.37:0/148144499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b965ac0 0x557e3b96f3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.986+0000 7f3dab400640 1 -- 172.21.15.37:0/148144499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e3b964fd0 con 0x557e3b9663e0 2024-08-20T05:17:48.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.987+0000 7f3dab400640 1 --2- 172.21.15.37:0/148144499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b9663e0 0x557e3b970b50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3dac11e4c0 tx=0x7f3d98015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9e094f50731ee8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:48.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.988+0000 7f3da0c00640 1 -- 172.21.15.37:0/148144499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9801ec00 con 0x557e3b9663e0 2024-08-20T05:17:48.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.988+0000 7f3da0c00640 1 -- 172.21.15.37:0/148144499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d9801eda0 con 0x557e3b9663e0 2024-08-20T05:17:48.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.988+0000 7f3da0c00640 1 -- 172.21.15.37:0/148144499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d98010800 con 0x557e3b9663e0 2024-08-20T05:17:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.991+0000 7f3db5a73740 1 -- 172.21.15.37:0/148144499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b9663e0 msgr2=0x557e3b970b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.991+0000 7f3db5a73740 1 --2- 172.21.15.37:0/148144499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b9663e0 0x557e3b970b50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3dac11e4c0 tx=0x7f3d98015000 comp rx=0 tx=0).stop 2024-08-20T05:17:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.992+0000 7f3db5a73740 1 -- 172.21.15.37:0/148144499 shutdown_connections 2024-08-20T05:17:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.992+0000 7f3db5a73740 1 --2- 172.21.15.37:0/148144499 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b972370 0x557e3b973760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.992+0000 7f3db5a73740 1 --2- 172.21.15.37:0/148144499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b9663e0 0x557e3b970b50 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.992+0000 7f3db5a73740 1 --2- 172.21.15.37:0/148144499 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b965ac0 0x557e3b96f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.992+0000 7f3db5a73740 1 -- 172.21.15.37:0/148144499 >> 172.21.15.37:0/148144499 conn(0x557e3b9638f0 msgr2=0x557e3b970440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:48.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.993+0000 7f3db5a73740 1 -- 172.21.15.37:0/148144499 shutdown_connections 2024-08-20T05:17:48.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.993+0000 7f3db5a73740 1 -- 172.21.15.37:0/148144499 wait complete. 2024-08-20T05:17:48.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.994+0000 7f3db5a73740 1 -- start start 2024-08-20T05:17:48.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.995+0000 7f3db5a73740 1 Processor -- start 2024-08-20T05:17:48.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.997+0000 7f3db5a73740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b965ac0 0x557e3b986e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:48.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.997+0000 7f3db5a73740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b9663e0 0x557e3b987380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:48.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.997+0000 7f3db5a73740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b972370 0x557e3b984590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:48.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.997+0000 7f3db5a73740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac1bf890 con 0x557e3b9663e0 2024-08-20T05:17:48.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.997+0000 7f3db5a73740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac1bf190 con 0x557e3b965ac0 2024-08-20T05:17:48.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.997+0000 7f3db5a73740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac1bc3d0 con 0x557e3b972370 2024-08-20T05:17:48.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.997+0000 7f3db5a73740 10 client.0 _ll_register_callbacks cb 0x7f3d98005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:49.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.998+0000 7f3dabe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b965ac0 0x557e3b986e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:49.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.998+0000 7f3db0e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b972370 0x557e3b984590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:49.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.998+0000 7f3db0e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b972370 0x557e3b984590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46290/0 (socket says 172.21.15.37:46290) 2024-08-20T05:17:49.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.998+0000 7f3db0e00640 1 -- 172.21.15.37:0/2834339696 learned_addr learned my addr 172.21.15.37:0/2834339696 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:49.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:48.998+0000 7f3dabe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b965ac0 0x557e3b986e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47448/0 (socket says 172.21.15.37:47448) 2024-08-20T05:17:49.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.000+0000 7f3dab400640 1 --2- 172.21.15.37:0/2834339696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b9663e0 0x557e3b987380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:49.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.000+0000 7f3db0e00640 1 -- 172.21.15.37:0/2834339696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b965ac0 msgr2=0x557e3b986e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:49.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.000+0000 7f3db0e00640 1 --2- 172.21.15.37:0/2834339696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b965ac0 0x557e3b986e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:49.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.000+0000 7f3db0e00640 1 -- 172.21.15.37:0/2834339696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b9663e0 msgr2=0x557e3b987380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:49.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.000+0000 7f3db0e00640 1 --2- 172.21.15.37:0/2834339696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b9663e0 0x557e3b987380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:49.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.000+0000 7f3db0e00640 1 -- 172.21.15.37:0/2834339696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e3b984dc0 con 0x557e3b972370 2024-08-20T05:17:49.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.001+0000 7f3db0e00640 1 --2- 172.21.15.37:0/2834339696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b972370 0x557e3b984590 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3da40a7f50 tx=0x7f3da4074150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58069c99d40d7368 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:49.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.001+0000 7f3d96000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:17:49.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.001+0000 7f3d96000640 1 -- 172.21.15.37:0/2834339696 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da401f070 con 0x557e3b972370 2024-08-20T05:17:49.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.001+0000 7f3d96000640 1 -- 172.21.15.37:0/2834339696 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3da40051d0 con 0x557e3b972370 2024-08-20T05:17:49.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.002+0000 7f3db5a73740 1 -- 172.21.15.37:0/2834339696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d9801eda0 con 0x557e3b972370 2024-08-20T05:17:49.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.002+0000 7f3d96000640 1 -- 172.21.15.37:0/2834339696 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) ==== 24+0+0 (secure 0 0 0) 0x7f3da40ab3e0 con 0x557e3b972370 2024-08-20T05:17:49.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.002+0000 7f3db5a73740 10 client.29197 fetch_fsmap learned FSMap version 51 2024-08-20T05:17:49.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.002+0000 7f3db5a73740 1 -- 172.21.15.37:0/2834339696 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) -- 0x557e3b9ec120 con 0x557e3b972370 2024-08-20T05:17:49.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.002+0000 7f3d96000640 1 -- 172.21.15.37:0/2834339696 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d9801eda0 con 0x557e3b972370 2024-08-20T05:17:49.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.003+0000 7f3d96000640 1 -- 172.21.15.37:0/2834339696 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 51) ==== 8374+0+0 (secure 0 0 0) 0x7f3da4071050 con 0x557e3b972370 2024-08-20T05:17:49.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.003+0000 7f3db5a73740 10 client.29197 fetch_fsmap finished waiting for FSMap version 51 2024-08-20T05:17:49.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.003+0000 7f3db5a73740 10 client.29197 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:17:49.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.003+0000 7f3db5a73740 20 client.29197 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:49.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.003+0000 7f3db5a73740 1 --2- 172.21.15.37:0/2834339696 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x557e3b9ec880 0x557e3b9eeca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:49.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.003+0000 7f3db5a73740 4 client.29197 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:17:49.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.003+0000 7f3db5a73740 1 -- 172.21.15.37:0/2834339696 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557e3b8d9490 con 0x557e3b9ec880 2024-08-20T05:17:49.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.003+0000 7f3dabe00640 1 --2- 172.21.15.37:0/2834339696 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x557e3b9ec880 0x557e3b9eeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:49.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.004+0000 7f3dabe00640 1 --2- 172.21.15.37:0/2834339696 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x557e3b9ec880 0x557e3b9eeca0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2ff85f1e7678ced2 server_cookie=ebf3a3c3613e252d in_seq=0 out_seq=0 2024-08-20T05:17:49.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.004+0000 7f3d96000640 10 client.29197 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:17:49.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.004+0000 7f3d96000640 1 -- 172.21.15.37:0/2834339696 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557e3b8d9490 con 0x557e3b9ec880 2024-08-20T05:17:49.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.004+0000 7f3d96000640 10 client.29197 handle_command_reply: tid=0 2024-08-20T05:17:49.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.004+0000 7f3db5a73740 1 client.29197 shutdown 2024-08-20T05:17:49.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.004+0000 7f3db5a73740 1 -- 172.21.15.37:0/2834339696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b972370 msgr2=0x557e3b984590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:49.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.004+0000 7f3db5a73740 1 --2- 172.21.15.37:0/2834339696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b972370 0x557e3b984590 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3da40a7f50 tx=0x7f3da4074150 comp rx=0 tx=0).stop 2024-08-20T05:17:49.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.005+0000 7f3db5a73740 1 -- 172.21.15.37:0/2834339696 shutdown_connections 2024-08-20T05:17:49.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.005+0000 7f3db5a73740 1 --2- 172.21.15.37:0/2834339696 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x557e3b9ec880 0x557e3b9eeca0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:49.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.005+0000 7f3db5a73740 1 --2- 172.21.15.37:0/2834339696 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x557e3b972370 0x557e3b984590 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:49.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.005+0000 7f3db5a73740 1 --2- 172.21.15.37:0/2834339696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557e3b9663e0 0x557e3b987380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:49.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.005+0000 7f3d96000640 0 client.29197 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:17:49.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.005+0000 7f3db5a73740 1 --2- 172.21.15.37:0/2834339696 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x557e3b965ac0 0x557e3b986e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:49.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.005+0000 7f3db5a73740 1 -- 172.21.15.37:0/2834339696 >> 172.21.15.37:0/2834339696 conn(0x557e3b9638f0 msgr2=0x557e3b962ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:49.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.005+0000 7f3db5a73740 1 -- 172.21.15.37:0/2834339696 shutdown_connections 2024-08-20T05:17:49.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.007+0000 7f3db5a73740 1 -- 172.21.15.37:0/2834339696 wait complete. 2024-08-20T05:17:49.009 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.007+0000 7f3db5a73740 20 client.29197 trim_cache size 0 max 16384 2024-08-20T05:17:49.009 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:17:49.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.008+0000 7f3db1800640 1 -- 172.21.15.37:0/2205612382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d900b3d40 msgr2=0x7f3d900b6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:49.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.008+0000 7f3db1800640 1 --2- 172.21.15.37:0/2205612382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d900b3d40 0x7f3d900b6200 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009510 tx=0x7f3d98004730 comp rx=0 tx=0).stop 2024-08-20T05:17:49.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.008+0000 7f3db1800640 1 -- 172.21.15.37:0/2205612382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dac11bdd0 msgr2=0x7f3dac1ad530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:49.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.008+0000 7f3db1800640 1 --2- 172.21.15.37:0/2205612382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dac11bdd0 0x7f3dac1ad530 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f3da400eaa0 tx=0x7f3da400ef60 comp rx=0 tx=0).stop 2024-08-20T05:17:49.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.009+0000 7f3db1800640 1 -- 172.21.15.37:0/2205612382 shutdown_connections 2024-08-20T05:17:49.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.009+0000 7f3db1800640 1 --2- 172.21.15.37:0/2205612382 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d900b3d40 0x7f3d900b6200 secure :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009510 tx=0x7f3d98004730 comp rx=0 tx=0).stop 2024-08-20T05:17:49.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.009+0000 7f3db1800640 1 --2- 172.21.15.37:0/2205612382 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3dac11bdd0 0x7f3dac1ad530 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:49.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.009+0000 7f3db1800640 1 --2- 172.21.15.37:0/2205612382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dac10a260 0x7f3dac1a8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:49.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.009+0000 7f3db1800640 1 --2- 172.21.15.37:0/2205612382 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3dac109e80 0x7f3dac1a7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:49.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.009+0000 7f3db1800640 1 -- 172.21.15.37:0/2205612382 >> 172.21.15.37:0/2205612382 conn(0x7f3dac06c830 msgr2=0x7f3dac11c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:49.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.009+0000 7f3db1800640 1 -- 172.21.15.37:0/2205612382 shutdown_connections 2024-08-20T05:17:49.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:49.009+0000 7f3db1800640 1 -- 172.21.15.37:0/2205612382 wait complete. 2024-08-20T05:17:49.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:49 smithi130 ceph-mon[22007]: pgmap v868: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 4.9 MiB/s wr, 541 op/s 2024-08-20T05:17:50.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:49 smithi037 ceph-mon[17265]: pgmap v868: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 4.9 MiB/s wr, 541 op/s 2024-08-20T05:17:50.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:49 smithi135 ceph-mon[22342]: pgmap v868: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 4.9 MiB/s wr, 541 op/s 2024-08-20T05:17:50.767 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:50 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:17:50.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:50 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:17:51.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:50 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:17:51.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:51 smithi130 ceph-mon[22007]: pgmap v869: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 5.4 MiB/s wr, 578 op/s 2024-08-20T05:17:52.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:51 smithi037 ceph-mon[17265]: pgmap v869: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 5.4 MiB/s wr, 578 op/s 2024-08-20T05:17:52.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:51 smithi135 ceph-mon[22342]: pgmap v869: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 5.4 MiB/s wr, 578 op/s 2024-08-20T05:17:52.692 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T05:17:53.040 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 895.0 s, 403.4 tps, lat 250.040 ms stddev 291.033 2024-08-20T05:17:53.366 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:17:53.791 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:53 smithi037 ceph-mon[17265]: pgmap v870: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 5.2 MiB/s wr, 556 op/s 2024-08-20T05:17:53.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:53 smithi130 ceph-mon[22007]: pgmap v870: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 5.2 MiB/s wr, 556 op/s 2024-08-20T05:17:54.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:53 smithi135 ceph-mon[22342]: pgmap v870: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 5.2 MiB/s wr, 556 op/s 2024-08-20T05:17:54.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.248+0000 7f3d9f200640 1 -- 172.21.15.37:0/3239256618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d98115740 msgr2=0x7f3d98117b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:54.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.248+0000 7f3d9f200640 1 --2- 172.21.15.37:0/3239256618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d98115740 0x7f3d98117b30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3d90009ca0 tx=0x7f3d9002a970 comp rx=0 tx=0).stop 2024-08-20T05:17:54.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.249+0000 7f3d9f200640 1 -- 172.21.15.37:0/3239256618 shutdown_connections 2024-08-20T05:17:54.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.249+0000 7f3d9f200640 1 --2- 172.21.15.37:0/3239256618 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d98115740 0x7f3d98117b30 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.249+0000 7f3d9f200640 1 --2- 172.21.15.37:0/3239256618 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d9810a7a0 0x7f3d98115200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.249+0000 7f3d9f200640 1 --2- 172.21.15.37:0/3239256618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d98109e80 0x7f3d9810a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.249+0000 7f3d9f200640 1 -- 172.21.15.37:0/3239256618 >> 172.21.15.37:0/3239256618 conn(0x7f3d9806dcc0 msgr2=0x7f3d9806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:54.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.249+0000 7f3d9f200640 1 -- 172.21.15.37:0/3239256618 shutdown_connections 2024-08-20T05:17:54.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.249+0000 7f3d9f200640 1 -- 172.21.15.37:0/3239256618 wait complete. 2024-08-20T05:17:54.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.250+0000 7f3d9f200640 1 Processor -- start 2024-08-20T05:17:54.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.251+0000 7f3d9f200640 1 -- start start 2024-08-20T05:17:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.252+0000 7f3d9f200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d98109e80 0x7f3d981a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.252+0000 7f3d9f200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d9810a7a0 0x7f3d981a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.252+0000 7f3d9f200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d98115740 0x7f3d981a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.252+0000 7f3d9f200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9811b3b0 con 0x7f3d98115740 2024-08-20T05:17:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.252+0000 7f3d9f200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9811b230 con 0x7f3d98109e80 2024-08-20T05:17:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.252+0000 7f3d9f200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9811b530 con 0x7f3d9810a7a0 2024-08-20T05:17:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.252+0000 7f3d9d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d98115740 0x7f3d981a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.252+0000 7f3d9d200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d98115740 0x7f3d981a71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33120/0 (socket says 172.21.15.37:33120) 2024-08-20T05:17:54.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.252+0000 7f3d9d200640 1 -- 172.21.15.37:0/4257712189 learned_addr learned my addr 172.21.15.37:0/4257712189 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:54.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.253+0000 7f3d9d200640 1 -- 172.21.15.37:0/4257712189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d9810a7a0 msgr2=0x7f3d981a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:54.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.253+0000 7f3d9d200640 1 --2- 172.21.15.37:0/4257712189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d9810a7a0 0x7f3d981a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.253+0000 7f3d9d200640 1 -- 172.21.15.37:0/4257712189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d98109e80 msgr2=0x7f3d981a1900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T05:17:54.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.253+0000 7f3d9d200640 1 --2- 172.21.15.37:0/4257712189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d98109e80 0x7f3d981a1900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.253+0000 7f3d9d200640 1 -- 172.21.15.37:0/4257712189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d981a79b0 con 0x7f3d98115740 2024-08-20T05:17:54.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.254+0000 7f3d9d200640 1 --2- 172.21.15.37:0/4257712189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d98115740 0x7f3d981a71e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3d900098d0 tx=0x7f3d90030670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.254+0000 7f3d94c00640 1 -- 172.21.15.37:0/4257712189 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90034030 con 0x7f3d98115740 2024-08-20T05:17:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.255+0000 7f3d9f200640 1 -- 172.21.15.37:0/4257712189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d981a7c40 con 0x7f3d98115740 2024-08-20T05:17:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.255+0000 7f3d9f200640 1 -- 172.21.15.37:0/4257712189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d981ae360 con 0x7f3d98115740 2024-08-20T05:17:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.255+0000 7f3d94c00640 1 -- 172.21.15.37:0/4257712189 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d90030b30 con 0x7f3d98115740 2024-08-20T05:17:54.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.255+0000 7f3d94c00640 1 -- 172.21.15.37:0/4257712189 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90039680 con 0x7f3d98115740 2024-08-20T05:17:54.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.259+0000 7f3da1c6f740 1 Processor -- start 2024-08-20T05:17:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.260+0000 7f3d94c00640 1 -- 172.21.15.37:0/4257712189 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3d90037020 con 0x7f3d98115740 2024-08-20T05:17:54.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.263+0000 7f3da1c6f740 1 -- start start 2024-08-20T05:17:54.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.263+0000 7f3da1c6f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 0x5633e66b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.263+0000 7f3da1c6f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b3260 0x5633e66becb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.263+0000 7f3da1c6f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.263+0000 7f3da1c6f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5633e6628aa0 con 0x5633e66b3260 2024-08-20T05:17:54.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.263+0000 7f3da1c6f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5633e6617fa0 con 0x5633e66c3600 2024-08-20T05:17:54.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.263+0000 7f3da1c6f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5633e661bfe0 con 0x5633e66b2940 2024-08-20T05:17:54.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.264+0000 7f3d97400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 0x5633e66b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:54.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.264+0000 7f3d97400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 0x5633e66b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46264/0 (socket says 172.21.15.37:46264) 2024-08-20T05:17:54.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.264+0000 7f3d97400640 1 -- 172.21.15.37:0/37835786 learned_addr learned my addr 172.21.15.37:0/37835786 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:54.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.264+0000 7f3d97400640 1 --2- 172.21.15.37:0/37835786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:54.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.265+0000 7f3d97400640 1 -- 172.21.15.37:0/37835786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 msgr2=0x5633e66c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:54.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.265+0000 7f3d97400640 1 --2- 172.21.15.37:0/37835786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66c59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.265+0000 7f3d97400640 1 -- 172.21.15.37:0/37835786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b3260 msgr2=0x5633e66becb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.265+0000 7f3d97400640 1 --2- 172.21.15.37:0/37835786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b3260 0x5633e66becb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.265+0000 7f3d97400640 1 -- 172.21.15.37:0/37835786 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633e65be420 con 0x5633e66b2940 2024-08-20T05:17:54.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.266+0000 7f3d97400640 1 --2- 172.21.15.37:0/37835786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 0x5633e66b2d20 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3d84001f20 tx=0x7f3d84007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2f36a4ae9c4733 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:54.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.267+0000 7f3d8d600640 1 -- 172.21.15.37:0/37835786 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400d030 con 0x5633e66b2940 2024-08-20T05:17:54.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.267+0000 7f3d8d600640 1 -- 172.21.15.37:0/37835786 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d840044d0 con 0x5633e66b2940 2024-08-20T05:17:54.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.267+0000 7f3d8d600640 1 -- 172.21.15.37:0/37835786 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400d030 con 0x5633e66b2940 2024-08-20T05:17:54.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.267+0000 7f3d94c00640 1 --2- 172.21.15.37:0/4257712189 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d7c0b3c50 0x7f3d7c0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.268+0000 7f3da1c6f740 1 -- 172.21.15.37:0/37835786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 msgr2=0x5633e66b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:54.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.268+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/37835786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 0x5633e66b2d20 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3d84001f20 tx=0x7f3d84007e00 comp rx=0 tx=0).stop 2024-08-20T05:17:54.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.268+0000 7f3d94c00640 1 -- 172.21.15.37:0/4257712189 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3d90104f80 con 0x7f3d98115740 2024-08-20T05:17:54.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.269+0000 7f3d97e00640 1 --2- 172.21.15.37:0/4257712189 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d7c0b3c50 0x7f3d7c0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:54.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.269+0000 7f3da1c6f740 1 -- 172.21.15.37:0/37835786 shutdown_connections 2024-08-20T05:17:54.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.269+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/37835786 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.269+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/37835786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b3260 0x5633e66becb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.269+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/37835786 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 0x5633e66b2d20 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.269+0000 7f3da1c6f740 1 -- 172.21.15.37:0/37835786 >> 172.21.15.37:0/37835786 conn(0x5633e66b0770 msgr2=0x5633e66b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:54.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.270+0000 7f3da1c6f740 1 -- 172.21.15.37:0/37835786 shutdown_connections 2024-08-20T05:17:54.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.270+0000 7f3da1c6f740 1 -- 172.21.15.37:0/37835786 wait complete. 2024-08-20T05:17:54.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.271+0000 7f3da1c6f740 1 -- start start 2024-08-20T05:17:54.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.272+0000 7f3d97e00640 1 --2- 172.21.15.37:0/4257712189 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d7c0b3c50 0x7f3d7c0b6110 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x5633e66b1650 tx=0x7f3d88006c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:54.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.272+0000 7f3da1c6f740 1 Processor -- start 2024-08-20T05:17:54.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.273+0000 7f3da1c6f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 0x5633e66b8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.274+0000 7f3da1c6f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b3260 0x5633e66b8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.274+0000 7f3d97e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 0x5633e66b8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:54.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.274+0000 7f3d97e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 0x5633e66b8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46270/0 (socket says 172.21.15.37:46270) 2024-08-20T05:17:54.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.274+0000 7f3d97e00640 1 -- 172.21.15.37:0/2398746868 learned_addr learned my addr 172.21.15.37:0/2398746868 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:54.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.274+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/2398746868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.274+0000 7f3d97400640 1 --2- 172.21.15.37:0/2398746868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b3260 0x5633e66b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:54.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.275+0000 7f3d9d200640 1 --2- 172.21.15.37:0/2398746868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:54.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.275+0000 7f3da1c6f740 1 -- 172.21.15.37:0/2398746868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5633e647a700 con 0x5633e66b3260 2024-08-20T05:17:54.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.275+0000 7f3da1c6f740 1 -- 172.21.15.37:0/2398746868 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5633e65b3290 con 0x5633e66c3600 2024-08-20T05:17:54.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.275+0000 7f3da1c6f740 1 -- 172.21.15.37:0/2398746868 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5633e66bf540 con 0x5633e66b2940 2024-08-20T05:17:54.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.276+0000 7f3da1c6f740 10 client.0 _ll_register_callbacks cb 0x5633e66121c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:54.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.276+0000 7f3d97e00640 1 -- 172.21.15.37:0/2398746868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 msgr2=0x5633e66b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:54.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.276+0000 7f3d97e00640 1 --2- 172.21.15.37:0/2398746868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66b8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.276+0000 7f3d97e00640 1 -- 172.21.15.37:0/2398746868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b3260 msgr2=0x5633e66b8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:54.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.276+0000 7f3d97e00640 1 --2- 172.21.15.37:0/2398746868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b3260 0x5633e66b8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.276+0000 7f3d97e00640 1 -- 172.21.15.37:0/2398746868 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633e6377650 con 0x5633e66b2940 2024-08-20T05:17:54.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.277+0000 7f3d9d200640 1 --2- 172.21.15.37:0/2398746868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:54.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.277+0000 7f3d97400640 1 --2- 172.21.15.37:0/2398746868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b3260 0x5633e66b8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:54.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.277+0000 7f3d97e00640 1 --2- 172.21.15.37:0/2398746868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 0x5633e66b8100 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3d88013f70 tx=0x7f3d88004840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30518891b074a36b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:54.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.277+0000 7f3d82000640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:17:54.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.277+0000 7f3d82000640 1 -- 172.21.15.37:0/2398746868 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8801d5f0 con 0x5633e66b2940 2024-08-20T05:17:54.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.277+0000 7f3da1c6f740 1 -- 172.21.15.37:0/2398746868 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d840044d0 con 0x5633e66b2940 2024-08-20T05:17:54.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.278+0000 7f3d82000640 1 -- 172.21.15.37:0/2398746868 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3d8801d790 con 0x5633e66b2940 2024-08-20T05:17:54.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.278+0000 7f3d82000640 1 -- 172.21.15.37:0/2398746868 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f3d8802b050 con 0x5633e66b2940 2024-08-20T05:17:54.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.278+0000 7f3da1c6f740 10 client.29203 fetch_fsmap learned FSMap version 52 2024-08-20T05:17:54.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.278+0000 7f3da1c6f740 1 -- 172.21.15.37:0/2398746868 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5633e66d6030 con 0x5633e66b2940 2024-08-20T05:17:54.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.278+0000 7f3d82000640 1 -- 172.21.15.37:0/2398746868 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d840044d0 con 0x5633e66b2940 2024-08-20T05:17:54.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.279+0000 7f3d82000640 1 -- 172.21.15.37:0/2398746868 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 52) ==== 8370+0+0 (secure 0 0 0) 0x7f3d88012070 con 0x5633e66b2940 2024-08-20T05:17:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.280+0000 7f3da1c6f740 10 client.29203 fetch_fsmap finished waiting for FSMap version 52 2024-08-20T05:17:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.280+0000 7f3da1c6f740 10 client.29203 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:17:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.280+0000 7f3da1c6f740 20 client.29203 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.280+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/2398746868 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5633e66d74e0 0x5633e66d9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.280+0000 7f3da1c6f740 4 client.29203 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:17:54.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.280+0000 7f3da1c6f740 1 -- 172.21.15.37:0/2398746868 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633e662a9f0 con 0x5633e66d74e0 2024-08-20T05:17:54.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.280+0000 7f3d97400640 1 --2- 172.21.15.37:0/2398746868 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5633e66d74e0 0x5633e66d9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:54.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.281+0000 7f3d97400640 1 --2- 172.21.15.37:0/2398746868 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5633e66d74e0 0x5633e66d9970 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff42de5901206db server_cookie=50c21fc3ae5f9272 in_seq=0 out_seq=0 2024-08-20T05:17:54.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.281+0000 7f3d82000640 10 client.29203 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:54.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.282+0000 7f3d82000640 1 -- 172.21.15.37:0/2398746868 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5633e662a9f0 con 0x5633e66d74e0 2024-08-20T05:17:54.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.282+0000 7f3d82000640 10 client.29203 handle_command_reply: tid=0 2024-08-20T05:17:54.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.282+0000 7f3da1c6f740 1 client.29203 shutdown 2024-08-20T05:17:54.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.283+0000 7f3da1c6f740 1 -- 172.21.15.37:0/2398746868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 msgr2=0x5633e66b8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:54.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.283+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/2398746868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 0x5633e66b8100 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3d88013f70 tx=0x7f3d88004840 comp rx=0 tx=0).stop 2024-08-20T05:17:54.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.283+0000 7f3da1c6f740 1 -- 172.21.15.37:0/2398746868 shutdown_connections 2024-08-20T05:17:54.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.283+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/2398746868 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5633e66d74e0 0x5633e66d9970 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.283+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/2398746868 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66b8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.283+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/2398746868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b3260 0x5633e66b8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.283+0000 7f3d82000640 0 client.29203 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.283+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/2398746868 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 0x5633e66b8100 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.283+0000 7f3da1c6f740 1 -- 172.21.15.37:0/2398746868 >> 172.21.15.37:0/2398746868 conn(0x5633e66b0770 msgr2=0x5633e66b62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.283+0000 7f3da1c6f740 1 -- 172.21.15.37:0/2398746868 shutdown_connections 2024-08-20T05:17:54.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.283+0000 7f3da1c6f740 1 -- 172.21.15.37:0/2398746868 wait complete. 2024-08-20T05:17:54.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.284+0000 7f3da1c6f740 20 client.29203 trim_cache size 0 max 16384 2024-08-20T05:17:54.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.311+0000 7f3da1c6f740 1 Processor -- start 2024-08-20T05:17:54.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.311+0000 7f3da1c6f740 1 -- start start 2024-08-20T05:17:54.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.311+0000 7f3da1c6f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b2940 0x5633e66df240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.312+0000 7f3da1c6f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b3260 0x5633e66df780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.312+0000 7f3da1c6f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.312+0000 7f3da1c6f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7800fba0 con 0x5633e66b2940 2024-08-20T05:17:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.312+0000 7f3da1c6f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3d780116e0 con 0x5633e66c3600 2024-08-20T05:17:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.312+0000 7f3da1c6f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78010270 con 0x5633e66b3260 2024-08-20T05:17:54.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.313+0000 7f3d97400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b3260 0x5633e66df780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:54.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.313+0000 7f3d97400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b3260 0x5633e66df780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46278/0 (socket says 172.21.15.37:46278) 2024-08-20T05:17:54.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.313+0000 7f3d97400640 1 -- 172.21.15.37:0/1416537691 learned_addr learned my addr 172.21.15.37:0/1416537691 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:54.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.314+0000 7f3d9d200640 1 --2- 172.21.15.37:0/1416537691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:54.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.315+0000 7f3d97400640 1 -- 172.21.15.37:0/1416537691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 msgr2=0x5633e66c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:54.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.315+0000 7f3d97400640 1 --2- 172.21.15.37:0/1416537691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66c1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.315+0000 7f3d97400640 1 -- 172.21.15.37:0/1416537691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b2940 msgr2=0x5633e66df240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:54.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.315+0000 7f3d97400640 1 --2- 172.21.15.37:0/1416537691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b2940 0x5633e66df240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.315+0000 7f3d97400640 1 -- 172.21.15.37:0/1416537691 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633e66d9ff0 con 0x5633e66b3260 2024-08-20T05:17:54.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.315+0000 7f3d9d200640 1 --2- 172.21.15.37:0/1416537691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:17:54.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.316+0000 7f3d97400640 1 --2- 172.21.15.37:0/1416537691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b3260 0x5633e66df780 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3d84001f70 tx=0x7f3d84006c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64bbfc6e5084f15e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:54.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.316+0000 7f3d8cc00640 1 -- 172.21.15.37:0/1416537691 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400d070 con 0x5633e66b3260 2024-08-20T05:17:54.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.316+0000 7f3d8cc00640 1 -- 172.21.15.37:0/1416537691 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d8400e040 con 0x5633e66b3260 2024-08-20T05:17:54.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.317+0000 7f3d8cc00640 1 -- 172.21.15.37:0/1416537691 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84010040 con 0x5633e66b3260 2024-08-20T05:17:54.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.318+0000 7f3da1c6f740 1 -- 172.21.15.37:0/1416537691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b3260 msgr2=0x5633e66df780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:54.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.318+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/1416537691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b3260 0x5633e66df780 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3d84001f70 tx=0x7f3d84006c20 comp rx=0 tx=0).stop 2024-08-20T05:17:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.318+0000 7f3da1c6f740 1 -- 172.21.15.37:0/1416537691 shutdown_connections 2024-08-20T05:17:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.319+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/1416537691 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.319+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/1416537691 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b3260 0x5633e66df780 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.319+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/1416537691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b2940 0x5633e66df240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.319+0000 7f3da1c6f740 1 -- 172.21.15.37:0/1416537691 >> 172.21.15.37:0/1416537691 conn(0x5633e66b0770 msgr2=0x5633e66c0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:54.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.323+0000 7f3da1c6f740 1 -- 172.21.15.37:0/1416537691 shutdown_connections 2024-08-20T05:17:54.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.323+0000 7f3da1c6f740 1 -- 172.21.15.37:0/1416537691 wait complete. 2024-08-20T05:17:54.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.324+0000 7f3da1c6f740 1 -- start start 2024-08-20T05:17:54.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.324+0000 7f3da1c6f740 1 Processor -- start 2024-08-20T05:17:54.327 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.326+0000 7f3da1c6f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 0x5633e673aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.326+0000 7f3da1c6f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b3260 0x5633e673b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.326+0000 7f3da1c6f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.327+0000 7f3da1c6f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78011010 con 0x5633e66b3260 2024-08-20T05:17:54.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.327+0000 7f3d9d200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:54.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.327+0000 7f3d97400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b3260 0x5633e673b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.327+0000 7f3d9d200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66c9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47824/0 (socket says 172.21.15.37:47824) 2024-08-20T05:17:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.327+0000 7f3d9d200640 1 -- 172.21.15.37:0/1880833808 learned_addr learned my addr 172.21.15.37:0/1880833808 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:54.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.327+0000 7f3da1c6f740 1 -- 172.21.15.37:0/1880833808 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3d78010940 con 0x5633e66c3600 2024-08-20T05:17:54.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.327+0000 7f3da1c6f740 1 -- 172.21.15.37:0/1880833808 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7800db80 con 0x5633e66b2940 2024-08-20T05:17:54.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.328+0000 7f3da1c6f740 10 client.0 _ll_register_callbacks cb 0x7f3d88009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:54.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.328+0000 7f3d9d200640 1 -- 172.21.15.37:0/1880833808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 msgr2=0x5633e673aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:54.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.328+0000 7f3d9d200640 1 --2- 172.21.15.37:0/1880833808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 0x5633e673aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.328+0000 7f3d9d200640 1 -- 172.21.15.37:0/1880833808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b3260 msgr2=0x5633e673b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:54.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.328+0000 7f3d9d200640 1 --2- 172.21.15.37:0/1880833808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b3260 0x5633e673b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.328+0000 7f3d9d200640 1 -- 172.21.15.37:0/1880833808 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633e66ca610 con 0x5633e66c3600 2024-08-20T05:17:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.329+0000 7f3d9d200640 1 --2- 172.21.15.37:0/1880833808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66c9f70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3d90102680 tx=0x7f3d900cc070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34021a911c34998f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.329+0000 7f3d82000640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:17:54.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.330+0000 7f3d82000640 1 -- 172.21.15.37:0/1880833808 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d900e2030 con 0x5633e66c3600 2024-08-20T05:17:54.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.330+0000 7f3d82000640 1 -- 172.21.15.37:0/1880833808 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3d900cce00 con 0x5633e66c3600 2024-08-20T05:17:54.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.330+0000 7f3da1c6f740 1 -- 172.21.15.37:0/1880833808 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d8400e040 con 0x5633e66c3600 2024-08-20T05:17:54.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.330+0000 7f3d82000640 1 -- 172.21.15.37:0/1880833808 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f3d900cb5e0 con 0x5633e66c3600 2024-08-20T05:17:54.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.330+0000 7f3da1c6f740 10 client.29192 fetch_fsmap learned FSMap version 52 2024-08-20T05:17:54.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.330+0000 7f3da1c6f740 1 -- 172.21.15.37:0/1880833808 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5633e66d1a50 con 0x5633e66c3600 2024-08-20T05:17:54.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.331+0000 7f3d82000640 1 -- 172.21.15.37:0/1880833808 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d8400e040 con 0x5633e66c3600 2024-08-20T05:17:54.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.331+0000 7f3d82000640 1 -- 172.21.15.37:0/1880833808 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 52) ==== 8370+0+0 (secure 0 0 0) 0x7f3d90041070 con 0x5633e66c3600 2024-08-20T05:17:54.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.331+0000 7f3da1c6f740 10 client.29192 fetch_fsmap finished waiting for FSMap version 52 2024-08-20T05:17:54.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.332+0000 7f3da1c6f740 10 client.29192 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:17:54.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.332+0000 7f3da1c6f740 20 client.29192 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:54.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.332+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/1880833808 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5633e66d21b0 0x5633e674d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:54.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.332+0000 7f3da1c6f740 4 client.29192 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:17:54.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.332+0000 7f3da1c6f740 1 -- 172.21.15.37:0/1880833808 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5633e6626490 con 0x5633e66d21b0 2024-08-20T05:17:54.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.332+0000 7f3d97e00640 1 --2- 172.21.15.37:0/1880833808 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5633e66d21b0 0x5633e674d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.337+0000 7f3d97e00640 1 --2- 172.21.15.37:0/1880833808 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5633e66d21b0 0x5633e674d1f0 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=721b2e69e49d65ee server_cookie=551276d38a25f17f in_seq=0 out_seq=0 2024-08-20T05:17:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.338+0000 7f3d82000640 10 client.29192 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.338+0000 7f3d82000640 1 -- 172.21.15.37:0/1880833808 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5633e6626490 con 0x5633e66d21b0 2024-08-20T05:17:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.338+0000 7f3d82000640 10 client.29192 handle_command_reply: tid=0 2024-08-20T05:17:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.338+0000 7f3da1c6f740 1 client.29192 shutdown 2024-08-20T05:17:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.338+0000 7f3da1c6f740 1 -- 172.21.15.37:0/1880833808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 msgr2=0x5633e66c9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.338+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/1880833808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66c9f70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3d90102680 tx=0x7f3d900cc070 comp rx=0 tx=0).stop 2024-08-20T05:17:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.338+0000 7f3da1c6f740 1 -- 172.21.15.37:0/1880833808 shutdown_connections 2024-08-20T05:17:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.338+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/1880833808 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5633e66d21b0 0x5633e674d1f0 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.338+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/1880833808 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5633e66c3600 0x5633e66c9f70 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.338+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/1880833808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5633e66b3260 0x5633e673b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.338+0000 7f3da1c6f740 1 --2- 172.21.15.37:0/1880833808 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5633e66b2940 0x5633e673aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.338+0000 7f3da1c6f740 1 -- 172.21.15.37:0/1880833808 >> 172.21.15.37:0/1880833808 conn(0x5633e66b0770 msgr2=0x5633e66b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.339+0000 7f3d82000640 0 client.29192 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.339+0000 7f3da1c6f740 1 -- 172.21.15.37:0/1880833808 shutdown_connections 2024-08-20T05:17:54.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.343+0000 7f3da1c6f740 1 -- 172.21.15.37:0/1880833808 wait complete. 2024-08-20T05:17:54.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.343+0000 7f3da1c6f740 20 client.29192 trim_cache size 0 max 16384 2024-08-20T05:17:54.345 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:17:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.344+0000 7f3d9f200640 1 -- 172.21.15.37:0/4257712189 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d7c0b3c50 msgr2=0x7f3d7c0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.344+0000 7f3d9f200640 1 --2- 172.21.15.37:0/4257712189 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d7c0b3c50 0x7f3d7c0b6110 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x5633e66b1650 tx=0x7f3d88006c30 comp rx=0 tx=0).stop 2024-08-20T05:17:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.344+0000 7f3d9f200640 1 -- 172.21.15.37:0/4257712189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d98115740 msgr2=0x7f3d981a71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.344+0000 7f3d9f200640 1 --2- 172.21.15.37:0/4257712189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d98115740 0x7f3d981a71e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3d900098d0 tx=0x7f3d90030670 comp rx=0 tx=0).stop 2024-08-20T05:17:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.345+0000 7f3d9f200640 1 -- 172.21.15.37:0/4257712189 shutdown_connections 2024-08-20T05:17:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.345+0000 7f3d9f200640 1 --2- 172.21.15.37:0/4257712189 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d7c0b3c50 0x7f3d7c0b6110 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.345+0000 7f3d9f200640 1 --2- 172.21.15.37:0/4257712189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d98115740 0x7f3d981a71e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.345+0000 7f3d9f200640 1 --2- 172.21.15.37:0/4257712189 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d9810a7a0 0x7f3d981a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.345+0000 7f3d9f200640 1 --2- 172.21.15.37:0/4257712189 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d98109e80 0x7f3d981a1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.345+0000 7f3d9f200640 1 -- 172.21.15.37:0/4257712189 >> 172.21.15.37:0/4257712189 conn(0x7f3d9806dcc0 msgr2=0x7f3d98071510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:54.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.345+0000 7f3d9f200640 1 -- 172.21.15.37:0/4257712189 shutdown_connections 2024-08-20T05:17:54.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:54.345+0000 7f3d9f200640 1 -- 172.21.15.37:0/4257712189 wait complete. 2024-08-20T05:17:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:55 smithi130 ceph-mon[22007]: pgmap v871: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 6.6 MiB/s wr, 650 op/s 2024-08-20T05:17:56.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:55 smithi037 ceph-mon[17265]: pgmap v871: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 6.6 MiB/s wr, 650 op/s 2024-08-20T05:17:56.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:55 smithi135 ceph-mon[22342]: pgmap v871: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 6.6 MiB/s wr, 650 op/s 2024-08-20T05:17:56.820 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-20T05:17:56.820 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-20T05:17:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.277+0000 7fc430e00640 1 -- 172.21.15.37:0/3895938730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc42c06b170 msgr2=0x7fc42c105060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.277+0000 7fc430e00640 1 --2- 172.21.15.37:0/3895938730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc42c06b170 0x7fc42c105060 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc418009900 tx=0x7fc41802a420 comp rx=0 tx=0).stop 2024-08-20T05:17:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.278+0000 7fc430e00640 1 -- 172.21.15.37:0/3895938730 shutdown_connections 2024-08-20T05:17:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.278+0000 7fc430e00640 1 --2- 172.21.15.37:0/3895938730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42c1081a0 0x7fc42c10a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.278+0000 7fc430e00640 1 --2- 172.21.15.37:0/3895938730 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc42c1055f0 0x7fc42c107a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.278+0000 7fc430e00640 1 --2- 172.21.15.37:0/3895938730 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc42c06b170 0x7fc42c105060 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.279 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.278+0000 7fc430e00640 1 -- 172.21.15.37:0/3895938730 >> 172.21.15.37:0/3895938730 conn(0x7fc42c0fcc50 msgr2=0x7fc42c0ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.279+0000 7fc430e00640 1 -- 172.21.15.37:0/3895938730 shutdown_connections 2024-08-20T05:17:57.281 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.280+0000 7fc430e00640 1 -- 172.21.15.37:0/3895938730 wait complete. 2024-08-20T05:17:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.282+0000 7fc430e00640 1 Processor -- start 2024-08-20T05:17:57.285 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.283+0000 7fc430e00640 1 -- start start 2024-08-20T05:17:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.284+0000 7fc430e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42c06b170 0x7fc42c1967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.284+0000 7fc430e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc42c1055f0 0x7fc42c196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.284+0000 7fc430e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc42c1081a0 0x7fc42c197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.284+0000 7fc42b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42c06b170 0x7fc42c1967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.284+0000 7fc42b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42c06b170 0x7fc42c1967e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33188/0 (socket says 172.21.15.37:33188) 2024-08-20T05:17:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.286+0000 7fc42aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc42c1055f0 0x7fc42c196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.286+0000 7fc42aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc42c1055f0 0x7fc42c196e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46292/0 (socket says 172.21.15.37:46292) 2024-08-20T05:17:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.288+0000 7fc42b400640 1 -- 172.21.15.37:0/2243092434 learned_addr learned my addr 172.21.15.37:0/2243092434 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.288+0000 7fc430e00640 1 -- 172.21.15.37:0/2243092434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c10e240 con 0x7fc42c06b170 2024-08-20T05:17:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.288+0000 7fc42be00640 1 --2- 172.21.15.37:0/2243092434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc42c1081a0 0x7fc42c197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:57.290 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.288+0000 7fc430e00640 1 -- 172.21.15.37:0/2243092434 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c10e0c0 con 0x7fc42c1081a0 2024-08-20T05:17:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.288+0000 7fc430e00640 1 -- 172.21.15.37:0/2243092434 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c10e3c0 con 0x7fc42c1055f0 2024-08-20T05:17:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.289+0000 7fc42be00640 1 -- 172.21.15.37:0/2243092434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc42c1055f0 msgr2=0x7fc42c196e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.289+0000 7fc42be00640 1 --2- 172.21.15.37:0/2243092434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc42c1055f0 0x7fc42c196e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.289+0000 7fc42be00640 1 -- 172.21.15.37:0/2243092434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42c06b170 msgr2=0x7fc42c1967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.289+0000 7fc42be00640 1 --2- 172.21.15.37:0/2243092434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42c06b170 0x7fc42c1967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.291 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.289+0000 7fc42be00640 1 -- 172.21.15.37:0/2243092434 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42c198320 con 0x7fc42c1081a0 2024-08-20T05:17:57.293 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.291+0000 7fc42be00640 1 --2- 172.21.15.37:0/2243092434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc42c1081a0 0x7fc42c197a60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc42400be20 tx=0x7fc42400bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:57.294 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.293+0000 7fc423e00640 1 -- 172.21.15.37:0/2243092434 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc424019070 con 0x7fc42c1081a0 2024-08-20T05:17:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.293+0000 7fc423e00640 1 -- 172.21.15.37:0/2243092434 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc4240148f0 con 0x7fc42c1081a0 2024-08-20T05:17:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.293+0000 7fc423e00640 1 -- 172.21.15.37:0/2243092434 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc424012840 con 0x7fc42c1081a0 2024-08-20T05:17:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.293+0000 7fc430e00640 1 -- 172.21.15.37:0/2243092434 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc42c198610 con 0x7fc42c1081a0 2024-08-20T05:17:57.295 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.293+0000 7fc430e00640 1 -- 172.21.15.37:0/2243092434 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc42c19ed60 con 0x7fc42c1081a0 2024-08-20T05:17:57.301 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.300+0000 7fc423e00640 1 -- 172.21.15.37:0/2243092434 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fc42401c070 con 0x7fc42c1081a0 2024-08-20T05:17:57.305 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.304+0000 7fc423e00640 1 --2- 172.21.15.37:0/2243092434 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc4100b3de0 0x7fc4100b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.306 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.304+0000 7fc423e00640 1 -- 172.21.15.37:0/2243092434 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc4240e36f0 con 0x7fc42c1081a0 2024-08-20T05:17:57.307 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.306+0000 7fc42b400640 1 --2- 172.21.15.37:0/2243092434 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc4100b3de0 0x7fc4100b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:57.308 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.307+0000 7fc42b400640 1 --2- 172.21.15.37:0/2243092434 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc4100b3de0 0x7fc4100b62a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc4180096c0 tx=0x7fc4180314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:57.309 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.307+0000 7fc4353d0740 1 Processor -- start 2024-08-20T05:17:57.310 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.308+0000 7fc4353d0740 1 -- start start 2024-08-20T05:17:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.308+0000 7fc4353d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a930480 0x55963a932870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.308+0000 7fc4353d0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a932db0 0x55963a9351a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.309+0000 7fc4353d0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a9357f0 0x55963a937cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.309+0000 7fc4353d0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55963a8a3210 con 0x55963a932db0 2024-08-20T05:17:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.309+0000 7fc4353d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55963a892710 con 0x55963a930480 2024-08-20T05:17:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.309+0000 7fc42aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a932db0 0x55963a9351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.309+0000 7fc42b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a930480 0x55963a932870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.309+0000 7fc42b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a930480 0x55963a932870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47850/0 (socket says 172.21.15.37:47850) 2024-08-20T05:17:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.309+0000 7fc42b400640 1 -- 172.21.15.37:0/3869133769 learned_addr learned my addr 172.21.15.37:0/3869133769 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:57.311 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.309+0000 7fc4353d0740 1 -- 172.21.15.37:0/3869133769 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55963a896750 con 0x55963a9357f0 2024-08-20T05:17:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.310+0000 7fc42be00640 1 --2- 172.21.15.37:0/3869133769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a9357f0 0x55963a937cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.310+0000 7fc42b400640 1 -- 172.21.15.37:0/3869133769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a9357f0 msgr2=0x55963a937cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.310+0000 7fc42b400640 1 --2- 172.21.15.37:0/3869133769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a9357f0 0x55963a937cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.310+0000 7fc42b400640 1 -- 172.21.15.37:0/3869133769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a932db0 msgr2=0x55963a9351a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.310+0000 7fc42b400640 1 --2- 172.21.15.37:0/3869133769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a932db0 0x55963a9351a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.310+0000 7fc42b400640 1 -- 172.21.15.37:0/3869133769 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55963a85ede0 con 0x55963a930480 2024-08-20T05:17:57.312 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.310+0000 7fc42be00640 1 --2- 172.21.15.37:0/3869133769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a9357f0 0x55963a937cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:17:57.314 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.313+0000 7fc42b400640 1 --2- 172.21.15.37:0/3869133769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a930480 0x55963a932870 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc418003720 tx=0x7fc41803e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfbad905a913f1a8 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.313+0000 7fc420c00640 1 -- 172.21.15.37:0/3869133769 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41804d070 con 0x55963a930480 2024-08-20T05:17:57.317 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.314+0000 7fc420c00640 1 -- 172.21.15.37:0/3869133769 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc418031c50 con 0x55963a930480 2024-08-20T05:17:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.314+0000 7fc420c00640 1 -- 172.21.15.37:0/3869133769 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc418035050 con 0x55963a930480 2024-08-20T05:17:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.315+0000 7fc4353d0740 1 -- 172.21.15.37:0/3869133769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a930480 msgr2=0x55963a932870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.315+0000 7fc4353d0740 1 --2- 172.21.15.37:0/3869133769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a930480 0x55963a932870 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc418003720 tx=0x7fc41803e000 comp rx=0 tx=0).stop 2024-08-20T05:17:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.315+0000 7fc4353d0740 1 -- 172.21.15.37:0/3869133769 shutdown_connections 2024-08-20T05:17:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.315+0000 7fc4353d0740 1 --2- 172.21.15.37:0/3869133769 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a9357f0 0x55963a937cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.315+0000 7fc4353d0740 1 --2- 172.21.15.37:0/3869133769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a932db0 0x55963a9351a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.315+0000 7fc4353d0740 1 --2- 172.21.15.37:0/3869133769 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a930480 0x55963a932870 secure :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc418003720 tx=0x7fc41803e000 comp rx=0 tx=0).stop 2024-08-20T05:17:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.315+0000 7fc4353d0740 1 -- 172.21.15.37:0/3869133769 >> 172.21.15.37:0/3869133769 conn(0x55963a92b580 msgr2=0x55963a92c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:57.318 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.316+0000 7fc4353d0740 1 -- 172.21.15.37:0/3869133769 shutdown_connections 2024-08-20T05:17:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.317+0000 7fc4353d0740 1 -- 172.21.15.37:0/3869133769 wait complete. 2024-08-20T05:17:57.319 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.317+0000 7fc4353d0740 1 -- start start 2024-08-20T05:17:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.318+0000 7fc4353d0740 1 Processor -- start 2024-08-20T05:17:57.320 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.319+0000 7fc4353d0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a932db0 0x55963a93a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.319+0000 7fc4353d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a9357f0 0x55963a93a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.321 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.319+0000 7fc4353d0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a93b340 0x55963a93b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.320+0000 7fc42b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a932db0 0x55963a93a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:57.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.320+0000 7fc42b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a932db0 0x55963a93a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46302/0 (socket says 172.21.15.37:46302) 2024-08-20T05:17:57.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.320+0000 7fc42b400640 1 -- 172.21.15.37:0/1877141866 learned_addr learned my addr 172.21.15.37:0/1877141866 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:57.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.320+0000 7fc4353d0740 1 -- 172.21.15.37:0/1877141866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55963a7cbab0 con 0x55963a93b340 2024-08-20T05:17:57.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.320+0000 7fc4353d0740 1 -- 172.21.15.37:0/1877141866 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55963a839140 con 0x55963a9357f0 2024-08-20T05:17:57.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.320+0000 7fc4353d0740 1 -- 172.21.15.37:0/1877141866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55963a938770 con 0x55963a932db0 2024-08-20T05:17:57.322 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.320+0000 7fc4353d0740 10 client.0 _ll_register_callbacks cb 0x55963a84c5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.320+0000 7fc42be00640 1 --2- 172.21.15.37:0/1877141866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a93b340 0x55963a93b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.321+0000 7fc42b400640 1 -- 172.21.15.37:0/1877141866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a9357f0 msgr2=0x55963a93a790 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:17:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.321+0000 7fc42b400640 1 --2- 172.21.15.37:0/1877141866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a9357f0 0x55963a93a790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.321+0000 7fc42b400640 1 -- 172.21.15.37:0/1877141866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a93b340 msgr2=0x55963a93b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.321+0000 7fc42b400640 1 --2- 172.21.15.37:0/1877141866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a93b340 0x55963a93b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.323 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.321+0000 7fc42b400640 1 -- 172.21.15.37:0/1877141866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55963a83a170 con 0x55963a932db0 2024-08-20T05:17:57.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.322+0000 7fc42b400640 1 --2- 172.21.15.37:0/1877141866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a932db0 0x55963a93a0f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc418005ab0 tx=0x7fc4180496e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5087807d1dec7455 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:57.327 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.322+0000 7fc415600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:17:57.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.326+0000 7fc415600640 1 -- 172.21.15.37:0/1877141866 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc418059020 con 0x55963a932db0 2024-08-20T05:17:57.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.326+0000 7fc415600640 1 -- 172.21.15.37:0/1877141866 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc418049e00 con 0x55963a932db0 2024-08-20T05:17:57.328 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.326+0000 7fc4353d0740 1 -- 172.21.15.37:0/1877141866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55963a869a30 con 0x55963a932db0 2024-08-20T05:17:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.327+0000 7fc415600640 1 -- 172.21.15.37:0/1877141866 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fc418035070 con 0x55963a932db0 2024-08-20T05:17:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.327+0000 7fc4353d0740 10 client.29215 fetch_fsmap learned FSMap version 52 2024-08-20T05:17:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.327+0000 7fc4353d0740 1 -- 172.21.15.37:0/1877141866 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55963a5f5790 con 0x55963a932db0 2024-08-20T05:17:57.329 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.328+0000 7fc415600640 1 -- 172.21.15.37:0/1877141866 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55963a869a30 con 0x55963a932db0 2024-08-20T05:17:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.328+0000 7fc415600640 1 -- 172.21.15.37:0/1877141866 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 52) ==== 8370+0+0 (secure 0 0 0) 0x7fc418052800 con 0x55963a932db0 2024-08-20T05:17:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.328+0000 7fc4353d0740 10 client.29215 fetch_fsmap finished waiting for FSMap version 52 2024-08-20T05:17:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.328+0000 7fc4353d0740 10 client.29215 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:17:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.328+0000 7fc4353d0740 20 client.29215 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.328+0000 7fc4353d0740 1 --2- 172.21.15.37:0/1877141866 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55963a945ce0 0x55963a9480d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.328+0000 7fc4353d0740 4 client.29215 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:17:57.330 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.328+0000 7fc4353d0740 1 -- 172.21.15.37:0/1877141866 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55963a8a5160 con 0x55963a945ce0 2024-08-20T05:17:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.329+0000 7fc42aa00640 1 --2- 172.21.15.37:0/1877141866 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55963a945ce0 0x55963a9480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.330+0000 7fc42aa00640 1 --2- 172.21.15.37:0/1877141866 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55963a945ce0 0x55963a9480d0 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44a1dd67ab17436a server_cookie=88835110a87337d7 in_seq=0 out_seq=0 2024-08-20T05:17:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.330+0000 7fc415600640 10 client.29215 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.331+0000 7fc415600640 1 -- 172.21.15.37:0/1877141866 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55963a8a5160 con 0x55963a945ce0 2024-08-20T05:17:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.331+0000 7fc415600640 10 client.29215 handle_command_reply: tid=0 2024-08-20T05:17:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.331+0000 7fc4353d0740 1 client.29215 shutdown 2024-08-20T05:17:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.334+0000 7fc4353d0740 1 -- 172.21.15.37:0/1877141866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a932db0 msgr2=0x55963a93a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.334+0000 7fc4353d0740 1 --2- 172.21.15.37:0/1877141866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a932db0 0x55963a93a0f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fc418005ab0 tx=0x7fc4180496e0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.334+0000 7fc4353d0740 1 -- 172.21.15.37:0/1877141866 shutdown_connections 2024-08-20T05:17:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.334+0000 7fc4353d0740 1 --2- 172.21.15.37:0/1877141866 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55963a945ce0 0x55963a9480d0 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.334+0000 7fc4353d0740 1 --2- 172.21.15.37:0/1877141866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a93b340 0x55963a93b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.334+0000 7fc4353d0740 1 --2- 172.21.15.37:0/1877141866 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a9357f0 0x55963a93a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.338 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.334+0000 7fc4353d0740 1 --2- 172.21.15.37:0/1877141866 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a932db0 0x55963a93a0f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.338 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.334+0000 7fc4353d0740 1 -- 172.21.15.37:0/1877141866 >> 172.21.15.37:0/1877141866 conn(0x55963a92b580 msgr2=0x55963a92a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:57.338 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.334+0000 7fc415600640 0 client.29215 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:57.338 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.337+0000 7fc4353d0740 1 -- 172.21.15.37:0/1877141866 shutdown_connections 2024-08-20T05:17:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.337+0000 7fc4353d0740 1 -- 172.21.15.37:0/1877141866 wait complete. 2024-08-20T05:17:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.337+0000 7fc4353d0740 20 client.29215 trim_cache size 0 max 16384 2024-08-20T05:17:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.373+0000 7fc4353d0740 1 Processor -- start 2024-08-20T05:17:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.374+0000 7fc4353d0740 1 -- start start 2024-08-20T05:17:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.374+0000 7fc4353d0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a932db0 0x55963a9362e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.374+0000 7fc4353d0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a9357f0 0x55963a926590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.375+0000 7fc42b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a932db0 0x55963a9362e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.375+0000 7fc42b400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a932db0 0x55963a9362e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46310/0 (socket says 172.21.15.37:46310) 2024-08-20T05:17:57.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.375+0000 7fc4353d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a93b340 0x55963a92ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.375+0000 7fc4353d0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c1ba090 con 0x55963a9357f0 2024-08-20T05:17:57.378 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.375+0000 7fc4353d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c1bbbd0 con 0x55963a93b340 2024-08-20T05:17:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.375+0000 7fc4353d0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c1ba760 con 0x55963a932db0 2024-08-20T05:17:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.375+0000 7fc42b400640 1 -- 172.21.15.37:0/2572470494 learned_addr learned my addr 172.21.15.37:0/2572470494 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.375+0000 7fc42be00640 1 --2- 172.21.15.37:0/2572470494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a93b340 0x55963a92ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.375+0000 7fc42aa00640 1 --2- 172.21.15.37:0/2572470494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a9357f0 0x55963a926590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.376+0000 7fc42b400640 1 -- 172.21.15.37:0/2572470494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a93b340 msgr2=0x55963a92ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.376+0000 7fc42b400640 1 --2- 172.21.15.37:0/2572470494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a93b340 0x55963a92ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.376+0000 7fc42b400640 1 -- 172.21.15.37:0/2572470494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a9357f0 msgr2=0x55963a926590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.376+0000 7fc42b400640 1 --2- 172.21.15.37:0/2572470494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a9357f0 0x55963a926590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.376+0000 7fc42b400640 1 -- 172.21.15.37:0/2572470494 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55963a66e620 con 0x55963a932db0 2024-08-20T05:17:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.376+0000 7fc42aa00640 1 --2- 172.21.15.37:0/2572470494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a9357f0 0x55963a926590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:17:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.376+0000 7fc42b400640 1 --2- 172.21.15.37:0/2572470494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a932db0 0x55963a9362e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc418060040 tx=0x7fc4180497d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e47d52202d7766 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.376+0000 7fc417e00640 1 -- 172.21.15.37:0/2572470494 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc418059040 con 0x55963a932db0 2024-08-20T05:17:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.377+0000 7fc417e00640 1 -- 172.21.15.37:0/2572470494 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc41806b070 con 0x55963a932db0 2024-08-20T05:17:57.379 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.377+0000 7fc417e00640 1 -- 172.21.15.37:0/2572470494 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41804d040 con 0x55963a932db0 2024-08-20T05:17:57.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.378+0000 7fc4353d0740 1 -- 172.21.15.37:0/2572470494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a932db0 msgr2=0x55963a9362e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:57.380 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.378+0000 7fc4353d0740 1 --2- 172.21.15.37:0/2572470494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a932db0 0x55963a9362e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fc418060040 tx=0x7fc4180497d0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.379+0000 7fc4353d0740 1 -- 172.21.15.37:0/2572470494 shutdown_connections 2024-08-20T05:17:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.379+0000 7fc4353d0740 1 --2- 172.21.15.37:0/2572470494 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a93b340 0x55963a92ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.379+0000 7fc4353d0740 1 --2- 172.21.15.37:0/2572470494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a9357f0 0x55963a926590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.379+0000 7fc4353d0740 1 --2- 172.21.15.37:0/2572470494 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a932db0 0x55963a9362e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.379+0000 7fc4353d0740 1 -- 172.21.15.37:0/2572470494 >> 172.21.15.37:0/2572470494 conn(0x55963a92b580 msgr2=0x55963a935bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.379+0000 7fc4353d0740 1 -- 172.21.15.37:0/2572470494 shutdown_connections 2024-08-20T05:17:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.379+0000 7fc4353d0740 1 -- 172.21.15.37:0/2572470494 wait complete. 2024-08-20T05:17:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.380+0000 7fc4353d0740 1 -- start start 2024-08-20T05:17:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.380+0000 7fc4353d0740 1 Processor -- start 2024-08-20T05:17:57.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.384+0000 7fc4353d0740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a932db0 0x55963a93ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.384+0000 7fc4353d0740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a9357f0 0x55963a93f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.384+0000 7fc4353d0740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a93b340 0x55963a940040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.384+0000 7fc4353d0740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c1bb500 con 0x55963a93b340 2024-08-20T05:17:57.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.384+0000 7fc4353d0740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c1bae30 con 0x55963a932db0 2024-08-20T05:17:57.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.384+0000 7fc4353d0740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c1b8070 con 0x55963a9357f0 2024-08-20T05:17:57.386 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.384+0000 7fc4353d0740 10 client.0 _ll_register_callbacks cb 0x7fc41c0093d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:57.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.385+0000 7fc42b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a932db0 0x55963a93ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:57.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.385+0000 7fc42aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a9357f0 0x55963a93f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:57.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.385+0000 7fc42aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a9357f0 0x55963a93f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46316/0 (socket says 172.21.15.37:46316) 2024-08-20T05:17:57.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.385+0000 7fc42b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a932db0 0x55963a93ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47876/0 (socket says 172.21.15.37:47876) 2024-08-20T05:17:57.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.385+0000 7fc42aa00640 1 -- 172.21.15.37:0/2029105009 learned_addr learned my addr 172.21.15.37:0/2029105009 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:57.387 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.385+0000 7fc42be00640 1 --2- 172.21.15.37:0/2029105009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a93b340 0x55963a940040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.386+0000 7fc42aa00640 1 -- 172.21.15.37:0/2029105009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a932db0 msgr2=0x55963a93ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.386+0000 7fc42aa00640 1 --2- 172.21.15.37:0/2029105009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a932db0 0x55963a93ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.388 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.386+0000 7fc42aa00640 1 -- 172.21.15.37:0/2029105009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a93b340 msgr2=0x55963a940040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.386+0000 7fc42aa00640 1 --2- 172.21.15.37:0/2029105009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a93b340 0x55963a940040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.386+0000 7fc42aa00640 1 -- 172.21.15.37:0/2029105009 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55963a940870 con 0x55963a9357f0 2024-08-20T05:17:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.386+0000 7fc42be00640 1 --2- 172.21.15.37:0/2029105009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a93b340 0x55963a940040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.387+0000 7fc42aa00640 1 --2- 172.21.15.37:0/2029105009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a9357f0 0x55963a93f4e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc41c000c00 tx=0x7fc41c009e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=385973e090281d7e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.387+0000 7fc415600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:17:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.387+0000 7fc415600640 1 -- 172.21.15.37:0/2029105009 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c016cc0 con 0x55963a9357f0 2024-08-20T05:17:57.389 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.387+0000 7fc415600640 1 -- 172.21.15.37:0/2029105009 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fc41c024410 con 0x55963a9357f0 2024-08-20T05:17:57.390 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.387+0000 7fc4353d0740 1 -- 172.21.15.37:0/2029105009 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc41806b070 con 0x55963a9357f0 2024-08-20T05:17:57.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.388+0000 7fc415600640 1 -- 172.21.15.37:0/2029105009 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fc41c016e60 con 0x55963a9357f0 2024-08-20T05:17:57.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.388+0000 7fc4353d0740 10 client.29221 fetch_fsmap learned FSMap version 52 2024-08-20T05:17:57.394 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.388+0000 7fc4353d0740 1 -- 172.21.15.37:0/2029105009 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55963a941cb0 con 0x55963a9357f0 2024-08-20T05:17:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.388+0000 7fc415600640 1 -- 172.21.15.37:0/2029105009 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc41806b070 con 0x55963a9357f0 2024-08-20T05:17:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.388+0000 7fc415600640 1 -- 172.21.15.37:0/2029105009 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 52) ==== 8370+0+0 (secure 0 0 0) 0x7fc41c02e750 con 0x55963a9357f0 2024-08-20T05:17:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.388+0000 7fc4353d0740 10 client.29221 fetch_fsmap finished waiting for FSMap version 52 2024-08-20T05:17:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.388+0000 7fc4353d0740 10 client.29221 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:17:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.388+0000 7fc4353d0740 20 client.29221 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.389+0000 7fc4353d0740 1 --2- 172.21.15.37:0/2029105009 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55963a9b0b00 0x55963a9b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.389+0000 7fc4353d0740 4 client.29221 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:17:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.389+0000 7fc4353d0740 1 -- 172.21.15.37:0/2029105009 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55963a8a0c00 con 0x55963a9b0b00 2024-08-20T05:17:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.389+0000 7fc42b400640 1 --2- 172.21.15.37:0/2029105009 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55963a9b0b00 0x55963a9b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.389+0000 7fc42b400640 1 --2- 172.21.15.37:0/2029105009 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55963a9b0b00 0x55963a9b2f20 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff8af53ef9adf978 server_cookie=8e3b8ad515437e02 in_seq=0 out_seq=0 2024-08-20T05:17:57.395 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.389+0000 7fc415600640 10 client.29221 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.398+0000 7fc415600640 1 -- 172.21.15.37:0/2029105009 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55963a8a0c00 con 0x55963a9b0b00 2024-08-20T05:17:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.398+0000 7fc415600640 10 client.29221 handle_command_reply: tid=0 2024-08-20T05:17:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.398+0000 7fc4353d0740 1 client.29221 shutdown 2024-08-20T05:17:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.398+0000 7fc4353d0740 1 -- 172.21.15.37:0/2029105009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a9357f0 msgr2=0x55963a93f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:57.400 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.398+0000 7fc4353d0740 1 --2- 172.21.15.37:0/2029105009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a9357f0 0x55963a93f4e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fc41c000c00 tx=0x7fc41c009e50 comp rx=0 tx=0).stop 2024-08-20T05:17:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.399+0000 7fc4353d0740 1 -- 172.21.15.37:0/2029105009 shutdown_connections 2024-08-20T05:17:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.399+0000 7fc4353d0740 1 --2- 172.21.15.37:0/2029105009 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55963a9b0b00 0x55963a9b2f20 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.399+0000 7fc4353d0740 1 --2- 172.21.15.37:0/2029105009 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55963a93b340 0x55963a940040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.401 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.399+0000 7fc4353d0740 1 --2- 172.21.15.37:0/2029105009 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55963a9357f0 0x55963a93f4e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.399+0000 7fc4353d0740 1 --2- 172.21.15.37:0/2029105009 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55963a932db0 0x55963a93ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.399+0000 7fc4353d0740 1 -- 172.21.15.37:0/2029105009 >> 172.21.15.37:0/2029105009 conn(0x55963a92b580 msgr2=0x55963a935bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.399+0000 7fc415600640 0 client.29221 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.399+0000 7fc4353d0740 1 -- 172.21.15.37:0/2029105009 shutdown_connections 2024-08-20T05:17:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.399+0000 7fc4353d0740 1 -- 172.21.15.37:0/2029105009 wait complete. 2024-08-20T05:17:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.399+0000 7fc4353d0740 20 client.29221 trim_cache size 0 max 16384 2024-08-20T05:17:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:17:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:17:57.402 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:17:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:17:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.400+0000 7fc430e00640 1 -- 172.21.15.37:0/2243092434 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc4100b3de0 msgr2=0x7fc4100b62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.400+0000 7fc430e00640 1 --2- 172.21.15.37:0/2243092434 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc4100b3de0 0x7fc4100b62a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc4180096c0 tx=0x7fc4180314a0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.400+0000 7fc430e00640 1 -- 172.21.15.37:0/2243092434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc42c1081a0 msgr2=0x7fc42c197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.400+0000 7fc430e00640 1 --2- 172.21.15.37:0/2243092434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc42c1081a0 0x7fc42c197a60 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc42400be20 tx=0x7fc42400bf10 comp rx=0 tx=0).stop 2024-08-20T05:17:57.403 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.400+0000 7fc430e00640 1 -- 172.21.15.37:0/2243092434 shutdown_connections 2024-08-20T05:17:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.400+0000 7fc430e00640 1 --2- 172.21.15.37:0/2243092434 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fc4100b3de0 0x7fc4100b62a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.400+0000 7fc430e00640 1 --2- 172.21.15.37:0/2243092434 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fc42c1081a0 0x7fc42c197a60 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.400+0000 7fc430e00640 1 --2- 172.21.15.37:0/2243092434 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fc42c1055f0 0x7fc42c196e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.400+0000 7fc430e00640 1 --2- 172.21.15.37:0/2243092434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc42c06b170 0x7fc42c1967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.400+0000 7fc430e00640 1 -- 172.21.15.37:0/2243092434 >> 172.21.15.37:0/2243092434 conn(0x7fc42c0fcc50 msgr2=0x7fc42c0ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.401+0000 7fc430e00640 1 -- 172.21.15.37:0/2243092434 shutdown_connections 2024-08-20T05:17:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:17:57.401+0000 7fc430e00640 1 -- 172.21.15.37:0/2243092434 wait complete. 2024-08-20T05:17:57.603 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:17:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:57 smithi130 ceph-mon[22007]: pgmap v872: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 6.3 MiB/s wr, 553 op/s 2024-08-20T05:17:57.994 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:57 smithi037 ceph-mon[17265]: pgmap v872: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 6.3 MiB/s wr, 553 op/s 2024-08-20T05:17:58.041 INFO:teuthology.orchestra.run.smithi037.stderr:progress: 900.0 s, 437.6 tps, lat 226.694 ms stddev 258.266 2024-08-20T05:17:58.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:57 smithi135 ceph-mon[22342]: pgmap v872: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 6.3 MiB/s wr, 553 op/s 2024-08-20T05:17:58.377 INFO:teuthology.orchestra.run.smithi037.stdout:transaction type: 2024-08-20T05:17:58.377 INFO:teuthology.orchestra.run.smithi037.stdout:scaling factor: 32 2024-08-20T05:17:58.378 INFO:teuthology.orchestra.run.smithi037.stdout:query mode: simple 2024-08-20T05:17:58.378 INFO:teuthology.orchestra.run.smithi037.stdout:number of clients: 100 2024-08-20T05:17:58.378 INFO:teuthology.orchestra.run.smithi037.stdout:number of threads: 4 2024-08-20T05:17:58.378 INFO:teuthology.orchestra.run.smithi037.stdout:duration: 900 s 2024-08-20T05:17:58.378 INFO:teuthology.orchestra.run.smithi037.stdout:number of transactions actually processed: 606726 2024-08-20T05:17:58.378 INFO:teuthology.orchestra.run.smithi037.stdout:latency average = 148.323 ms 2024-08-20T05:17:58.378 INFO:teuthology.orchestra.run.smithi037.stdout:latency stddev = 950.495 ms 2024-08-20T05:17:58.378 INFO:teuthology.orchestra.run.smithi037.stdout:tps = 673.888011 (including connections establishing) 2024-08-20T05:17:58.378 INFO:teuthology.orchestra.run.smithi037.stdout:tps = 673.892484 (excluding connections establishing) 2024-08-20T05:17:58.385 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-08-20T05:17:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.408+0000 7f8b6ac00640 1 -- 172.21.15.37:0/3454078222 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b64075b90 msgr2=0x7f8b64113130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:58.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.408+0000 7f8b6ac00640 1 --2- 172.21.15.37:0/3454078222 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b64075b90 0x7f8b64113130 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009860 tx=0x7f8b5002a340 comp rx=0 tx=0).stop 2024-08-20T05:17:58.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.408+0000 7f8b6ac00640 1 -- 172.21.15.37:0/3454078222 shutdown_connections 2024-08-20T05:17:58.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.408+0000 7f8b6ac00640 1 --2- 172.21.15.37:0/3454078222 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b64113670 0x7f8b64115a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.408+0000 7f8b6ac00640 1 --2- 172.21.15.37:0/3454078222 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b64075b90 0x7f8b64113130 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.408+0000 7f8b6ac00640 1 --2- 172.21.15.37:0/3454078222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b64075270 0x7f8b64075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.408+0000 7f8b6ac00640 1 -- 172.21.15.37:0/3454078222 >> 172.21.15.37:0/3454078222 conn(0x7f8b640fe3c0 msgr2=0x7f8b641007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:58.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.408+0000 7f8b6ac00640 1 -- 172.21.15.37:0/3454078222 shutdown_connections 2024-08-20T05:17:58.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.408+0000 7f8b6ac00640 1 -- 172.21.15.37:0/3454078222 wait complete. 2024-08-20T05:17:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.409+0000 7f8b6ac00640 1 Processor -- start 2024-08-20T05:17:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.409+0000 7f8b6ac00640 1 -- start start 2024-08-20T05:17:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.410+0000 7f8b6ac00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b64075270 0x7f8b6419f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.410+0000 7f8b6ac00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b64075b90 0x7f8b6419f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.410+0000 7f8b6ac00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b64113670 0x7f8b641a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.410+0000 7f8b6ac00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b64118ef0 con 0x7f8b64113670 2024-08-20T05:17:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.410+0000 7f8b6ac00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8b64118d70 con 0x7f8b64075270 2024-08-20T05:17:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.410+0000 7f8b6ac00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8b64119070 con 0x7f8b64075b90 2024-08-20T05:17:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.410+0000 7f8b68e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b64075b90 0x7f8b6419f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.410+0000 7f8b68e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b64075b90 0x7f8b6419f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46342/0 (socket says 172.21.15.37:46342) 2024-08-20T05:17:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.410+0000 7f8b68e00640 1 -- 172.21.15.37:0/1618974277 learned_addr learned my addr 172.21.15.37:0/1618974277 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.411+0000 7f8b69800640 1 --2- 172.21.15.37:0/1618974277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b64075270 0x7f8b6419f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.411+0000 7f8b6a200640 1 --2- 172.21.15.37:0/1618974277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b64113670 0x7f8b641a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.411+0000 7f8b68e00640 1 -- 172.21.15.37:0/1618974277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b64075270 msgr2=0x7f8b6419f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.411+0000 7f8b68e00640 1 --2- 172.21.15.37:0/1618974277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b64075270 0x7f8b6419f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.411+0000 7f8b68e00640 1 -- 172.21.15.37:0/1618974277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b64113670 msgr2=0x7f8b641a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.411+0000 7f8b68e00640 1 --2- 172.21.15.37:0/1618974277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b64113670 0x7f8b641a4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.411+0000 7f8b68e00640 1 -- 172.21.15.37:0/1618974277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b641a5470 con 0x7f8b64075b90 2024-08-20T05:17:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.411+0000 7f8b6a200640 1 --2- 172.21.15.37:0/1618974277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b64113670 0x7f8b641a4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:17:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.411+0000 7f8b68e00640 1 --2- 172.21.15.37:0/1618974277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b64075b90 0x7f8b6419f900 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8b50035040 tx=0x7f8b50032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.412+0000 7f8b62000640 1 -- 172.21.15.37:0/1618974277 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b50037040 con 0x7f8b64075b90 2024-08-20T05:17:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.412+0000 7f8b62000640 1 -- 172.21.15.37:0/1618974277 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b50041070 con 0x7f8b64075b90 2024-08-20T05:17:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.412+0000 7f8b62000640 1 -- 172.21.15.37:0/1618974277 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b50003850 con 0x7f8b64075b90 2024-08-20T05:17:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.412+0000 7f8b6ac00640 1 -- 172.21.15.37:0/1618974277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b641a5700 con 0x7f8b64075b90 2024-08-20T05:17:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.412+0000 7f8b6ac00640 1 -- 172.21.15.37:0/1618974277 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b641abe20 con 0x7f8b64075b90 2024-08-20T05:17:58.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.415+0000 7f8b6ec5a740 1 Processor -- start 2024-08-20T05:17:58.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.415+0000 7f8b6ec5a740 1 -- start start 2024-08-20T05:17:58.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.415+0000 7f8b6ec5a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7b4ba0 0x558aee7b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.416+0000 7f8b6ec5a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b54c0 0x558aee7c0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.416+0000 7f8b6ec5a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 0x558aee7c3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.416+0000 7f8b6ec5a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558aee72b870 con 0x558aee7c1450 2024-08-20T05:17:58.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.416+0000 7f8b6ec5a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558aee71ad70 con 0x558aee7b54c0 2024-08-20T05:17:58.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.416+0000 7f8b6ec5a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558aee71edb0 con 0x558aee7b4ba0 2024-08-20T05:17:58.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.416+0000 7f8b62000640 1 -- 172.21.15.37:0/1618974277 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f8b500039f0 con 0x7f8b64075b90 2024-08-20T05:17:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.416+0000 7f8b69800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b54c0 0x558aee7c0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.416+0000 7f8b69800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b54c0 0x558aee7c0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47914/0 (socket says 172.21.15.37:47914) 2024-08-20T05:17:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.416+0000 7f8b69800640 1 -- 172.21.15.37:0/218077646 learned_addr learned my addr 172.21.15.37:0/218077646 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.416+0000 7f8b68e00640 1 --2- 172.21.15.37:0/218077646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 0x558aee7c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.416+0000 7f8b6a200640 1 --2- 172.21.15.37:0/218077646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7b4ba0 0x558aee7b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.417+0000 7f8b69800640 1 -- 172.21.15.37:0/218077646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7b4ba0 msgr2=0x558aee7b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.417+0000 7f8b69800640 1 --2- 172.21.15.37:0/218077646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7b4ba0 0x558aee7b4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.417+0000 7f8b69800640 1 -- 172.21.15.37:0/218077646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 msgr2=0x558aee7c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.417+0000 7f8b69800640 1 --2- 172.21.15.37:0/218077646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 0x558aee7c3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.417+0000 7f8b69800640 1 -- 172.21.15.37:0/218077646 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aee47a930 con 0x558aee7b54c0 2024-08-20T05:17:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.417+0000 7f8b69800640 1 --2- 172.21.15.37:0/218077646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b54c0 0x558aee7c0f10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009cc0 tx=0x7f8b58011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86de030517bac454 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.417+0000 7f8b56a00640 1 -- 172.21.15.37:0/218077646 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58005220 con 0x558aee7b54c0 2024-08-20T05:17:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.418+0000 7f8b56a00640 1 -- 172.21.15.37:0/218077646 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b58004c50 con 0x558aee7b54c0 2024-08-20T05:17:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.418+0000 7f8b56a00640 1 -- 172.21.15.37:0/218077646 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b580197f0 con 0x558aee7b54c0 2024-08-20T05:17:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.418+0000 7f8b62000640 1 --2- 172.21.15.37:0/1618974277 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8b4c0b3c70 0x7f8b4c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.418+0000 7f8b62000640 1 -- 172.21.15.37:0/1618974277 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8b50103bf0 con 0x7f8b64075b90 2024-08-20T05:17:58.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.418+0000 7f8b6a200640 1 --2- 172.21.15.37:0/1618974277 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8b4c0b3c70 0x7f8b4c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.418+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/218077646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b54c0 msgr2=0x558aee7c0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:58.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.418+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/218077646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b54c0 0x558aee7c0f10 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009cc0 tx=0x7f8b58011810 comp rx=0 tx=0).stop 2024-08-20T05:17:58.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.419+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/218077646 shutdown_connections 2024-08-20T05:17:58.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.419+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/218077646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 0x558aee7c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.419+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/218077646 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b54c0 0x558aee7c0f10 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.419+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/218077646 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7b4ba0 0x558aee7b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.419+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/218077646 >> 172.21.15.37:0/218077646 conn(0x558aee7b29d0 msgr2=0x558aee7b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.419+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/218077646 shutdown_connections 2024-08-20T05:17:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.419+0000 7f8b6a200640 1 --2- 172.21.15.37:0/1618974277 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8b4c0b3c70 0x7f8b4c0b6130 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8b6406bf20 tx=0x7f8b5c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.419+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/218077646 wait complete. 2024-08-20T05:17:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.420+0000 7f8b6ec5a740 1 -- start start 2024-08-20T05:17:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.420+0000 7f8b6ec5a740 1 Processor -- start 2024-08-20T05:17:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.420+0000 7f8b6ec5a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b4ba0 0x558aee7c0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.420+0000 7f8b6ec5a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7b54c0 0x558aee7be060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.420+0000 7f8b6ec5a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 0x558aee7be5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.420+0000 7f8b6ec5a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558aee57d890 con 0x558aee7c1450 2024-08-20T05:17:58.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.420+0000 7f8b6ec5a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x558aee6a1b00 con 0x558aee7b4ba0 2024-08-20T05:17:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.420+0000 7f8b6ec5a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x558aee7c41a0 con 0x558aee7b54c0 2024-08-20T05:17:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.420+0000 7f8b6ec5a740 10 client.0 _ll_register_callbacks cb 0x558aee715dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.421+0000 7f8b69800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b4ba0 0x558aee7c0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.421+0000 7f8b69800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b4ba0 0x558aee7c0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47920/0 (socket says 172.21.15.37:47920) 2024-08-20T05:17:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.421+0000 7f8b69800640 1 -- 172.21.15.37:0/314596071 learned_addr learned my addr 172.21.15.37:0/314596071 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.421+0000 7f8b6a200640 1 --2- 172.21.15.37:0/314596071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 0x558aee7be5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.421+0000 7f8b68e00640 1 --2- 172.21.15.37:0/314596071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7b54c0 0x558aee7be060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.421+0000 7f8b6a200640 1 -- 172.21.15.37:0/314596071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7b54c0 msgr2=0x558aee7be060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.421+0000 7f8b6a200640 1 --2- 172.21.15.37:0/314596071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7b54c0 0x558aee7be060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.421+0000 7f8b6a200640 1 -- 172.21.15.37:0/314596071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b4ba0 msgr2=0x558aee7c0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.421+0000 7f8b6a200640 1 --2- 172.21.15.37:0/314596071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b4ba0 0x558aee7c0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.421+0000 7f8b6a200640 1 -- 172.21.15.37:0/314596071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aee6e2a30 con 0x558aee7c1450 2024-08-20T05:17:58.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.421+0000 7f8b69800640 1 --2- 172.21.15.37:0/314596071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b4ba0 0x558aee7c0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:58.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.422+0000 7f8b6a200640 1 --2- 172.21.15.37:0/314596071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 0x558aee7be5a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009fd0 tx=0x7f8b5c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905f41bb7a2e5255 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.422+0000 7f8b4b400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:17:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.422+0000 7f8b4b400640 1 -- 172.21.15.37:0/314596071 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c01fc50 con 0x558aee7c1450 2024-08-20T05:17:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.422+0000 7f8b4b400640 1 -- 172.21.15.37:0/314596071 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8b5c017030 con 0x558aee7c1450 2024-08-20T05:17:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.422+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/314596071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b58004c50 con 0x558aee7c1450 2024-08-20T05:17:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.422+0000 7f8b4b400640 1 -- 172.21.15.37:0/314596071 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f8b5c032050 con 0x558aee7c1450 2024-08-20T05:17:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.422+0000 7f8b6ec5a740 10 client.18438 fetch_fsmap learned FSMap version 52 2024-08-20T05:17:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.422+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/314596071 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x558aee7cfa40 con 0x558aee7c1450 2024-08-20T05:17:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.423+0000 7f8b4b400640 1 -- 172.21.15.37:0/314596071 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b58004c50 con 0x558aee7c1450 2024-08-20T05:17:58.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.423+0000 7f8b4b400640 1 -- 172.21.15.37:0/314596071 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 52) ==== 8370+0+0 (secure 0 0 0) 0x7f8b5c0055a0 con 0x558aee7c1450 2024-08-20T05:17:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.423+0000 7f8b6ec5a740 10 client.18438 fetch_fsmap finished waiting for FSMap version 52 2024-08-20T05:17:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.423+0000 7f8b6ec5a740 10 client.18438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:17:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.423+0000 7f8b6ec5a740 20 client.18438 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.423+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/314596071 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558aee7d0fa0 0x558aee7d33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.423+0000 7f8b6ec5a740 4 client.18438 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:17:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.423+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/314596071 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558aee72d7c0 con 0x558aee7d0fa0 2024-08-20T05:17:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.424+0000 7f8b69800640 1 --2- 172.21.15.37:0/314596071 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558aee7d0fa0 0x558aee7d33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.424+0000 7f8b4b400640 10 client.18438 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:58.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.424+0000 7f8b69800640 1 --2- 172.21.15.37:0/314596071 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558aee7d0fa0 0x558aee7d33b0 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49c26538cbfe7e16 server_cookie=6dfe68d5fb3188ee in_seq=0 out_seq=0 2024-08-20T05:17:58.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.425+0000 7f8b4b400640 1 -- 172.21.15.37:0/314596071 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558aee72d7c0 con 0x558aee7d0fa0 2024-08-20T05:17:58.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.425+0000 7f8b4b400640 10 client.18438 handle_command_reply: tid=0 2024-08-20T05:17:58.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.425+0000 7f8b6ec5a740 1 client.18438 shutdown 2024-08-20T05:17:58.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.426+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/314596071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 msgr2=0x558aee7be5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:58.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.426+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/314596071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 0x558aee7be5a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c009fd0 tx=0x7f8b5c004ab0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.426+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/314596071 shutdown_connections 2024-08-20T05:17:58.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.426+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/314596071 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558aee7d0fa0 0x558aee7d33b0 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.426+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/314596071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 0x558aee7be5a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.426+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/314596071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7b54c0 0x558aee7be060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.426+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/314596071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b4ba0 0x558aee7c0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.426+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/314596071 >> 172.21.15.37:0/314596071 conn(0x558aee7b29d0 msgr2=0x558aee7b8570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:58.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.426+0000 7f8b4b400640 0 client.18438 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:58.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.426+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/314596071 shutdown_connections 2024-08-20T05:17:58.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.426+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/314596071 wait complete. 2024-08-20T05:17:58.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.426+0000 7f8b6ec5a740 20 client.18438 trim_cache size 0 max 16384 2024-08-20T05:17:58.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.445+0000 7f8b6ec5a740 1 Processor -- start 2024-08-20T05:17:58.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.445+0000 7f8b6ec5a740 1 -- start start 2024-08-20T05:17:58.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.445+0000 7f8b6ec5a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b4ba0 0x558aee7cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.445+0000 7f8b6ec5a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7b54c0 0x558aee7bfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.445+0000 7f8b6ec5a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7c1450 0x558aee7d8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.445+0000 7f8b6ec5a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641b5c20 con 0x558aee7b54c0 2024-08-20T05:17:58.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.445+0000 7f8b6ec5a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641b7760 con 0x558aee7b4ba0 2024-08-20T05:17:58.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.445+0000 7f8b6ec5a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641b62f0 con 0x558aee7c1450 2024-08-20T05:17:58.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.445+0000 7f8b68e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7b54c0 0x558aee7bfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.445+0000 7f8b69800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b4ba0 0x558aee7cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.445+0000 7f8b68e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7b54c0 0x558aee7bfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33248/0 (socket says 172.21.15.37:33248) 2024-08-20T05:17:58.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.445+0000 7f8b68e00640 1 -- 172.21.15.37:0/705858553 learned_addr learned my addr 172.21.15.37:0/705858553 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:58.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.446+0000 7f8b6a200640 1 --2- 172.21.15.37:0/705858553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7c1450 0x558aee7d8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.446+0000 7f8b69800640 1 -- 172.21.15.37:0/705858553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7c1450 msgr2=0x558aee7d8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:58.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.446+0000 7f8b69800640 1 --2- 172.21.15.37:0/705858553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7c1450 0x558aee7d8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.446+0000 7f8b69800640 1 -- 172.21.15.37:0/705858553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7b54c0 msgr2=0x558aee7bfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:58.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.446+0000 7f8b69800640 1 --2- 172.21.15.37:0/705858553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7b54c0 0x558aee7bfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.446+0000 7f8b69800640 1 -- 172.21.15.37:0/705858553 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aee7b52f0 con 0x558aee7b4ba0 2024-08-20T05:17:58.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.446+0000 7f8b68e00640 1 --2- 172.21.15.37:0/705858553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7b54c0 0x558aee7bfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:17:58.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.446+0000 7f8b69800640 1 --2- 172.21.15.37:0/705858553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b4ba0 0x558aee7cd2f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009c90 tx=0x7f8b58009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ead69612b0d69bde server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:58.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.446+0000 7f8b56000640 1 -- 172.21.15.37:0/705858553 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58004220 con 0x558aee7b4ba0 2024-08-20T05:17:58.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.446+0000 7f8b56000640 1 -- 172.21.15.37:0/705858553 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b580043c0 con 0x558aee7b4ba0 2024-08-20T05:17:58.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.446+0000 7f8b56000640 1 -- 172.21.15.37:0/705858553 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b58003970 con 0x558aee7b4ba0 2024-08-20T05:17:58.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.447+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/705858553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b4ba0 msgr2=0x558aee7cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:58.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.447+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/705858553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b4ba0 0x558aee7cd2f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009c90 tx=0x7f8b58009260 comp rx=0 tx=0).stop 2024-08-20T05:17:58.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.447+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/705858553 shutdown_connections 2024-08-20T05:17:58.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.448+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/705858553 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7c1450 0x558aee7d8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.448+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/705858553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7b54c0 0x558aee7bfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.448+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/705858553 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b4ba0 0x558aee7cd2f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.448+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/705858553 >> 172.21.15.37:0/705858553 conn(0x558aee7b29d0 msgr2=0x558aee7bf690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.448+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/705858553 shutdown_connections 2024-08-20T05:17:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.448+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/705858553 wait complete. 2024-08-20T05:17:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.448+0000 7f8b6ec5a740 1 -- start start 2024-08-20T05:17:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.448+0000 7f8b6ec5a740 1 Processor -- start 2024-08-20T05:17:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.449+0000 7f8b6ec5a740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7b4ba0 0x558aee7c9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.449+0000 7f8b6ec5a740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b54c0 0x558aee7c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.449+0000 7f8b6ec5a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 0x558aee7c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.449+0000 7f8b6ec5a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641b7090 con 0x558aee7c1450 2024-08-20T05:17:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.449+0000 7f8b6ec5a740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641b69c0 con 0x558aee7b54c0 2024-08-20T05:17:58.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.449+0000 7f8b6ec5a740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f8b641b3c00 con 0x558aee7b4ba0 2024-08-20T05:17:58.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.449+0000 7f8b6ec5a740 10 client.0 _ll_register_callbacks cb 0x7f8b5c009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:17:58.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.449+0000 7f8b6a200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 0x558aee7c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.449+0000 7f8b68e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b54c0 0x558aee7c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.449+0000 7f8b6a200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 0x558aee7c4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33250/0 (socket says 172.21.15.37:33250) 2024-08-20T05:17:58.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.449+0000 7f8b6a200640 1 -- 172.21.15.37:0/3833710210 learned_addr learned my addr 172.21.15.37:0/3833710210 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:17:58.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.449+0000 7f8b69800640 1 --2- 172.21.15.37:0/3833710210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7b4ba0 0x558aee7c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.450+0000 7f8b6a200640 1 -- 172.21.15.37:0/3833710210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7b4ba0 msgr2=0x558aee7c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:58.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.450+0000 7f8b6a200640 1 --2- 172.21.15.37:0/3833710210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7b4ba0 0x558aee7c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.450+0000 7f8b6a200640 1 -- 172.21.15.37:0/3833710210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b54c0 msgr2=0x558aee7c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:17:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.450+0000 7f8b6a200640 1 --2- 172.21.15.37:0/3833710210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b54c0 0x558aee7c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.450+0000 7f8b6a200640 1 -- 172.21.15.37:0/3833710210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aee7c5750 con 0x558aee7c1450 2024-08-20T05:17:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.450+0000 7f8b6a200640 1 --2- 172.21.15.37:0/3833710210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 0x558aee7c4f20 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c005a40 tx=0x7f8b5c027710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b04858a5fdff2e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:17:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.450+0000 7f8b4b400640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:17:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.450+0000 7f8b4b400640 1 -- 172.21.15.37:0/3833710210 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c027d10 con 0x558aee7c1450 2024-08-20T05:17:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.450+0000 7f8b4b400640 1 -- 172.21.15.37:0/3833710210 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f8b5c036410 con 0x558aee7c1450 2024-08-20T05:17:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.450+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/3833710210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b580043c0 con 0x558aee7c1450 2024-08-20T05:17:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.451+0000 7f8b4b400640 1 -- 172.21.15.37:0/3833710210 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f8b5c044050 con 0x558aee7c1450 2024-08-20T05:17:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.451+0000 7f8b6ec5a740 10 client.18444 fetch_fsmap learned FSMap version 52 2024-08-20T05:17:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.451+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/3833710210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x558aee83ba00 con 0x558aee7c1450 2024-08-20T05:17:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.451+0000 7f8b4b400640 1 -- 172.21.15.37:0/3833710210 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b580043c0 con 0x558aee7c1450 2024-08-20T05:17:58.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.451+0000 7f8b4b400640 1 -- 172.21.15.37:0/3833710210 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 52) ==== 8370+0+0 (secure 0 0 0) 0x7f8b5c01c3f0 con 0x558aee7c1450 2024-08-20T05:17:58.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.451+0000 7f8b6ec5a740 10 client.18444 fetch_fsmap finished waiting for FSMap version 52 2024-08-20T05:17:58.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.451+0000 7f8b6ec5a740 10 client.18444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:17:58.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.451+0000 7f8b6ec5a740 20 client.18444 populate_metadata read hostname 'smithi037' 2024-08-20T05:17:58.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.451+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/3833710210 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558aee83c170 0x558aee83e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:17:58.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.451+0000 7f8b6ec5a740 4 client.18444 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-20T05:17:58.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.451+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/3833710210 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558aee729260 con 0x558aee83c170 2024-08-20T05:17:58.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.452+0000 7f8b69800640 1 --2- 172.21.15.37:0/3833710210 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558aee83c170 0x558aee83e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:17:58.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.453+0000 7f8b69800640 1 --2- 172.21.15.37:0/3833710210 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558aee83c170 0x558aee83e590 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27c3ef97423e32bc server_cookie=e0f87a62ae7780df in_seq=0 out_seq=0 2024-08-20T05:17:58.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.453+0000 7f8b4b400640 10 client.18444 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:58.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.453+0000 7f8b4b400640 1 -- 172.21.15.37:0/3833710210 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558aee729260 con 0x558aee83c170 2024-08-20T05:17:58.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.453+0000 7f8b4b400640 10 client.18444 handle_command_reply: tid=0 2024-08-20T05:17:58.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.453+0000 7f8b6ec5a740 1 client.18444 shutdown 2024-08-20T05:17:58.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.454+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/3833710210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 msgr2=0x558aee7c4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:58.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.454+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/3833710210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 0x558aee7c4f20 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c005a40 tx=0x7f8b5c027710 comp rx=0 tx=0).stop 2024-08-20T05:17:58.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.454+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/3833710210 shutdown_connections 2024-08-20T05:17:58.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.454+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/3833710210 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x558aee83c170 0x558aee83e590 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.454+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/3833710210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558aee7c1450 0x558aee7c4f20 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.454+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/3833710210 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x558aee7b54c0 0x558aee7c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.454+0000 7f8b6ec5a740 1 --2- 172.21.15.37:0/3833710210 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x558aee7b4ba0 0x558aee7c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.454+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/3833710210 >> 172.21.15.37:0/3833710210 conn(0x558aee7b29d0 msgr2=0x558aee7b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:58.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.454+0000 7f8b4b400640 0 client.18444 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:17:58.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.454+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/3833710210 shutdown_connections 2024-08-20T05:17:58.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.454+0000 7f8b6ec5a740 1 -- 172.21.15.37:0/3833710210 wait complete. 2024-08-20T05:17:58.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.454+0000 7f8b6ec5a740 20 client.18444 trim_cache size 0 max 16384 2024-08-20T05:17:58.459 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:17:58.459 INFO:teuthology.orchestra.run.smithi037.stdout: "return_code": 0, 2024-08-20T05:17:58.459 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_tag": "40271891-a6af-4d64-b010-dc58730fb5b5", 2024-08-20T05:17:58.459 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": "asynchronous" 2024-08-20T05:17:58.459 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:17:58.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.455+0000 7f8b6ac00640 1 -- 172.21.15.37:0/1618974277 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8b4c0b3c70 msgr2=0x7f8b4c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.455+0000 7f8b6ac00640 1 --2- 172.21.15.37:0/1618974277 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8b4c0b3c70 0x7f8b4c0b6130 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f8b6406bf20 tx=0x7f8b5c009500 comp rx=0 tx=0).stop 2024-08-20T05:17:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.455+0000 7f8b6ac00640 1 -- 172.21.15.37:0/1618974277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b64075b90 msgr2=0x7f8b6419f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:17:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.455+0000 7f8b6ac00640 1 --2- 172.21.15.37:0/1618974277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b64075b90 0x7f8b6419f900 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8b50035040 tx=0x7f8b50032d50 comp rx=0 tx=0).stop 2024-08-20T05:17:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.455+0000 7f8b6ac00640 1 -- 172.21.15.37:0/1618974277 shutdown_connections 2024-08-20T05:17:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.455+0000 7f8b6ac00640 1 --2- 172.21.15.37:0/1618974277 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f8b4c0b3c70 0x7f8b4c0b6130 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.455+0000 7f8b6ac00640 1 --2- 172.21.15.37:0/1618974277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b64113670 0x7f8b641a4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.455+0000 7f8b6ac00640 1 --2- 172.21.15.37:0/1618974277 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f8b64075b90 0x7f8b6419f900 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.455+0000 7f8b6ac00640 1 --2- 172.21.15.37:0/1618974277 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f8b64075270 0x7f8b6419f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:17:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.455+0000 7f8b6ac00640 1 -- 172.21.15.37:0/1618974277 >> 172.21.15.37:0/1618974277 conn(0x7f8b640fe3c0 msgr2=0x7f8b640fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:17:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.455+0000 7f8b6ac00640 1 -- 172.21.15.37:0/1618974277 shutdown_connections 2024-08-20T05:17:58.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:17:58.455+0000 7f8b6ac00640 1 -- 172.21.15.37:0/1618974277 wait complete. 2024-08-20T05:17:58.756 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:58 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:17:59.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:58 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:17:59.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:58 smithi037 ceph-mon[17265]: pgmap v873: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 7.0 MiB/s wr, 620 op/s 2024-08-20T05:17:59.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:58 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:17:59.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:58 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:17:59.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:58 smithi135 ceph-mon[22342]: pgmap v873: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 7.0 MiB/s wr, 620 op/s 2024-08-20T05:17:59.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:58 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:17:59.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:58 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:17:59.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:58 smithi130 ceph-mon[22007]: pgmap v873: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 7.0 MiB/s wr, 620 op/s 2024-08-20T05:17:59.386 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:17:59.763 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:59 smithi037 ceph-mon[17265]: scrub queued for path: / 2024-08-20T05:17:59.764 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:59 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:17:59.764 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:59 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:17:59.764 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:59 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:17:59.764 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:59 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:17:59.764 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:59 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:17:59.764 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:59 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:17:59.764 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:59 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:17:59.764 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:59 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:17:59.764 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:59 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:17:59.764 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:17:59 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:00.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:59 smithi135 ceph-mon[22342]: scrub queued for path: / 2024-08-20T05:18:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:59 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:59 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:18:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:59 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:18:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:59 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:18:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:59 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:59 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:18:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:59 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:59 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:18:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:59 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:00.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:17:59 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:18:00.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:59 smithi130 ceph-mon[22007]: scrub queued for path: / 2024-08-20T05:18:00.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:59 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:00.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:59 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:18:00.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:59 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:18:00.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:59 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:18:00.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:59 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:00.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:59 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:18:00.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:59 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:00.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:59 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:18:00.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:59 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:00.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:17:59 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:01.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:00 smithi037 ceph-mon[17265]: pgmap v874: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 7.1 MiB/s wr, 611 op/s 2024-08-20T05:18:01.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:00 smithi135 ceph-mon[22342]: pgmap v874: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 7.1 MiB/s wr, 611 op/s 2024-08-20T05:18:01.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:00 smithi130 ceph-mon[22007]: pgmap v874: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 7.1 MiB/s wr, 611 op/s 2024-08-20T05:18:02.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.257+0000 7f7ccde00640 1 -- 172.21.15.37:0/3274428954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cc810a0e0 msgr2=0x7f7cc810a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:02.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.257+0000 7f7ccde00640 1 --2- 172.21.15.37:0/3274428954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cc810a0e0 0x7f7cc810a4c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8009900 tx=0x7f7cb802a420 comp rx=0 tx=0).stop 2024-08-20T05:18:02.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.257+0000 7f7ccde00640 1 -- 172.21.15.37:0/3274428954 shutdown_connections 2024-08-20T05:18:02.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.257+0000 7f7ccde00640 1 --2- 172.21.15.37:0/3274428954 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cc810f8c0 0x7f7cc8116050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.258+0000 7f7ccde00640 1 --2- 172.21.15.37:0/3274428954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc810ef40 0x7f7cc810f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.258+0000 7f7ccde00640 1 --2- 172.21.15.37:0/3274428954 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cc810a0e0 0x7f7cc810a4c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.258+0000 7f7ccde00640 1 -- 172.21.15.37:0/3274428954 >> 172.21.15.37:0/3274428954 conn(0x7f7cc806dcc0 msgr2=0x7f7cc806e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:02.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.258+0000 7f7ccde00640 1 -- 172.21.15.37:0/3274428954 shutdown_connections 2024-08-20T05:18:02.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.258+0000 7f7ccde00640 1 -- 172.21.15.37:0/3274428954 wait complete. 2024-08-20T05:18:02.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.259+0000 7f7ccde00640 1 Processor -- start 2024-08-20T05:18:02.333 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.260+0000 7f7ccde00640 1 -- start start 2024-08-20T05:18:02.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.263+0000 7f7ccde00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cc810a0e0 0x7f7cc8119b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.264+0000 7f7ccde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc810ef40 0x7f7cc8118050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.264+0000 7f7cc6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cc810a0e0 0x7f7cc8119b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:02.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.264+0000 7f7ccde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cc810f8c0 0x7f7cc8118680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.264+0000 7f7cc6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cc810a0e0 0x7f7cc8119b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:46384/0 (socket says 172.21.15.37:46384) 2024-08-20T05:18:02.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.265+0000 7f7cc7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cc810f8c0 0x7f7cc8118680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:02.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.265+0000 7f7cc7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cc810f8c0 0x7f7cc8118680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47958/0 (socket says 172.21.15.37:47958) 2024-08-20T05:18:02.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.268+0000 7f7cbfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc810ef40 0x7f7cc8118050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:02.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.268+0000 7f7cbfe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc810ef40 0x7f7cc8118050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33270/0 (socket says 172.21.15.37:33270) 2024-08-20T05:18:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.268+0000 7f7ccde00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc811b320 con 0x7f7cc810ef40 2024-08-20T05:18:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.268+0000 7f7ccde00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc811b1a0 con 0x7f7cc810f8c0 2024-08-20T05:18:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.268+0000 7f7ccde00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc811b4a0 con 0x7f7cc810a0e0 2024-08-20T05:18:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.268+0000 7f7cc6a00640 1 -- 172.21.15.37:0/3148764233 learned_addr learned my addr 172.21.15.37:0/3148764233 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.268+0000 7f7cc7400640 1 -- 172.21.15.37:0/3148764233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cc810a0e0 msgr2=0x7f7cc8119b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.268+0000 7f7cc7400640 1 --2- 172.21.15.37:0/3148764233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cc810a0e0 0x7f7cc8119b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.268+0000 7f7cc7400640 1 -- 172.21.15.37:0/3148764233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc810ef40 msgr2=0x7f7cc8118050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.268+0000 7f7cc7400640 1 --2- 172.21.15.37:0/3148764233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc810ef40 0x7f7cc8118050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.269+0000 7f7cc7400640 1 -- 172.21.15.37:0/3148764233 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cc81b4050 con 0x7f7cc810f8c0 2024-08-20T05:18:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.270+0000 7f7cc7400640 1 --2- 172.21.15.37:0/3148764233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cc810f8c0 0x7f7cc8118680 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000ccb0 tx=0x7f7cc000a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.271+0000 7f7ccca00640 1 -- 172.21.15.37:0/3148764233 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc000ce60 con 0x7f7cc810f8c0 2024-08-20T05:18:02.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.271+0000 7f7ccca00640 1 -- 172.21.15.37:0/3148764233 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cc0003b70 con 0x7f7cc810f8c0 2024-08-20T05:18:02.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.271+0000 7f7ccca00640 1 -- 172.21.15.37:0/3148764233 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc000f6b0 con 0x7f7cc810f8c0 2024-08-20T05:18:02.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.273+0000 7f7ccde00640 1 -- 172.21.15.37:0/3148764233 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cc81b4220 con 0x7f7cc810f8c0 2024-08-20T05:18:02.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.273+0000 7f7ccde00640 1 -- 172.21.15.37:0/3148764233 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cc81b46e0 con 0x7f7cc810f8c0 2024-08-20T05:18:02.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.285+0000 7f7ccca00640 1 -- 172.21.15.37:0/3148764233 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7cc0004020 con 0x7f7cc810f8c0 2024-08-20T05:18:02.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.287+0000 7f7cd08a3740 1 Processor -- start 2024-08-20T05:18:02.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.288+0000 7f7cd08a3740 1 -- start start 2024-08-20T05:18:02.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.288+0000 7f7cd08a3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56002332f950 0x56002332fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.288+0000 7f7cd08a3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560023330270 0x56002333bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.288+0000 7f7cd08a3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002333c200 0x56002333e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.289+0000 7f7cd08a3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5600232a5a60 con 0x56002332f950 2024-08-20T05:18:02.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.289+0000 7f7cd08a3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560023294f60 con 0x56002333c200 2024-08-20T05:18:02.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.289+0000 7f7cd08a3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560023298fa0 con 0x560023330270 2024-08-20T05:18:02.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.289+0000 7f7ccca00640 1 --2- 172.21.15.37:0/3148764233 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7cac0b3d20 0x7f7cac0b61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.289+0000 7f7ccca00640 1 -- 172.21.15.37:0/3148764233 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7cc00e3f40 con 0x7f7cc810f8c0 2024-08-20T05:18:02.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.290+0000 7f7cc7400640 1 --2- 172.21.15.37:0/3148764233 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7cac0b3d20 0x7f7cac0b61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:02.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.290+0000 7f7cc6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560023330270 0x56002333bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:02.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.291+0000 7f7cbfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002333c200 0x56002333e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:02.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.291+0000 7f7cbfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002333c200 0x56002333e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47968/0 (socket says 172.21.15.37:47968) 2024-08-20T05:18:02.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.291+0000 7f7cbfe00640 1 -- 172.21.15.37:0/3426378876 learned_addr learned my addr 172.21.15.37:0/3426378876 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:02.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.291+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/3426378876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56002332f950 0x56002332fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:02.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.292+0000 7f7cc7400640 1 --2- 172.21.15.37:0/3148764233 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7cac0b3d20 0x7f7cac0b61e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000afd0 tx=0x7f7cc0007ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:02.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.293+0000 7f7cbfe00640 1 -- 172.21.15.37:0/3426378876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560023330270 msgr2=0x56002333bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:02.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.293+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/3426378876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560023330270 0x56002333bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.293+0000 7f7cbfe00640 1 -- 172.21.15.37:0/3426378876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56002332f950 msgr2=0x56002332fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:02.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.293+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/3426378876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56002332f950 0x56002332fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.293+0000 7f7cbfe00640 1 -- 172.21.15.37:0/3426378876 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56002323b3e0 con 0x56002333c200 2024-08-20T05:18:02.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.294+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/3426378876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002333c200 0x56002333e5f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0012580 tx=0x7f7cb000b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b59295a7fef70200 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:02.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.296+0000 7f7cb7e00640 1 -- 172.21.15.37:0/3426378876 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0004230 con 0x56002333c200 2024-08-20T05:18:02.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.296+0000 7f7cb7e00640 1 -- 172.21.15.37:0/3426378876 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cb00043d0 con 0x56002333c200 2024-08-20T05:18:02.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.296+0000 7f7cb7e00640 1 -- 172.21.15.37:0/3426378876 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb001e840 con 0x56002333c200 2024-08-20T05:18:02.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.297+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3426378876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002333c200 msgr2=0x56002333e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:02.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.297+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/3426378876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002333c200 0x56002333e5f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0012580 tx=0x7f7cb000b770 comp rx=0 tx=0).stop 2024-08-20T05:18:02.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.297+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3426378876 shutdown_connections 2024-08-20T05:18:02.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.297+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/3426378876 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002333c200 0x56002333e5f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.297+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/3426378876 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560023330270 0x56002333bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.297+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/3426378876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56002332f950 0x56002332fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.297+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3426378876 >> 172.21.15.37:0/3426378876 conn(0x56002332d780 msgr2=0x56002332e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:02.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.297+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3426378876 shutdown_connections 2024-08-20T05:18:02.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.297+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3426378876 wait complete. 2024-08-20T05:18:02.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.298+0000 7f7cd08a3740 1 -- start start 2024-08-20T05:18:02.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.298+0000 7f7cd08a3740 1 Processor -- start 2024-08-20T05:18:02.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.299+0000 7f7cd08a3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 0x56002333bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.299+0000 7f7cd08a3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560023330270 0x560023338f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.299+0000 7f7cd08a3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56002333c200 0x5600233395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.299+0000 7f7cd08a3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5600230f7700 con 0x56002333c200 2024-08-20T05:18:02.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.299+0000 7f7cd08a3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560023230250 con 0x56002332f950 2024-08-20T05:18:02.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.299+0000 7f7cd08a3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56002333ee80 con 0x560023330270 2024-08-20T05:18:02.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.299+0000 7f7cd08a3740 10 client.0 _ll_register_callbacks cb 0x56002328f180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:02.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.300+0000 7f7cbfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 0x56002333bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:02.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.300+0000 7f7cbfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 0x56002333bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47974/0 (socket says 172.21.15.37:47974) 2024-08-20T05:18:02.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.300+0000 7f7cbfe00640 1 -- 172.21.15.37:0/13277003 learned_addr learned my addr 172.21.15.37:0/13277003 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:02.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.302+0000 7f7cc6a00640 1 --2- 172.21.15.37:0/13277003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560023330270 0x560023338f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:02.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.302+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/13277003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56002333c200 0x5600233395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:02.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.302+0000 7f7cbfe00640 1 -- 172.21.15.37:0/13277003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560023330270 msgr2=0x560023338f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:02.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.302+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/13277003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560023330270 0x560023338f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.303+0000 7f7cbfe00640 1 -- 172.21.15.37:0/13277003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56002333c200 msgr2=0x5600233395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:02.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.303+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/13277003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56002333c200 0x5600233395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.303+0000 7f7cbfe00640 1 -- 172.21.15.37:0/13277003 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560022ff4650 con 0x56002332f950 2024-08-20T05:18:02.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.303+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/13277003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 0x56002333bb20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00058c0 tx=0x7f7cb0003f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2754a5cbaf4fbaf7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:02.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.303+0000 7f7cb4c00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:18:02.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.303+0000 7f7cb4c00640 1 -- 172.21.15.37:0/13277003 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb00050f0 con 0x56002332f950 2024-08-20T05:18:02.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.303+0000 7f7cb4c00640 1 -- 172.21.15.37:0/13277003 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7cb0005290 con 0x56002332f950 2024-08-20T05:18:02.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.303+0000 7f7cd08a3740 1 -- 172.21.15.37:0/13277003 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cb00043d0 con 0x56002332f950 2024-08-20T05:18:02.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.304+0000 7f7cb4c00640 1 -- 172.21.15.37:0/13277003 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f7cb0005490 con 0x56002332f950 2024-08-20T05:18:02.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.304+0000 7f7cd08a3740 10 client.29237 fetch_fsmap learned FSMap version 52 2024-08-20T05:18:02.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.304+0000 7f7cd08a3740 1 -- 172.21.15.37:0/13277003 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x56002334a7e0 con 0x56002332f950 2024-08-20T05:18:02.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.304+0000 7f7cb4c00640 1 -- 172.21.15.37:0/13277003 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cb00043d0 con 0x56002332f950 2024-08-20T05:18:02.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.304+0000 7f7cb4c00640 1 -- 172.21.15.37:0/13277003 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 52) ==== 8370+0+0 (secure 0 0 0) 0x7f7cb0029070 con 0x56002332f950 2024-08-20T05:18:02.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.305+0000 7f7cd08a3740 10 client.29237 fetch_fsmap finished waiting for FSMap version 52 2024-08-20T05:18:02.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.305+0000 7f7cd08a3740 10 client.29237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:18:02.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.305+0000 7f7cd08a3740 20 client.29237 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:02.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.305+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/13277003 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56002334bb30 0x56002334df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.305+0000 7f7cd08a3740 4 client.29237 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:18:02.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.305+0000 7f7cd08a3740 1 -- 172.21.15.37:0/13277003 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600232a79b0 con 0x56002334bb30 2024-08-20T05:18:02.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.305+0000 7f7cc6a00640 1 --2- 172.21.15.37:0/13277003 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56002334bb30 0x56002334df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:02.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.306+0000 7f7cb4c00640 10 client.29237 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:02.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.308+0000 7f7cc6a00640 1 --2- 172.21.15.37:0/13277003 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56002334bb30 0x56002334df20 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=670889bda6f57b35 server_cookie=f32d100e5a43e88 in_seq=0 out_seq=0 2024-08-20T05:18:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.309+0000 7f7cb4c00640 1 -- 172.21.15.37:0/13277003 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5600232a79b0 con 0x56002334bb30 2024-08-20T05:18:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.309+0000 7f7cb4c00640 10 client.29237 handle_command_reply: tid=0 2024-08-20T05:18:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.310+0000 7f7cd08a3740 1 client.29237 shutdown 2024-08-20T05:18:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.310+0000 7f7cd08a3740 1 -- 172.21.15.37:0/13277003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 msgr2=0x56002333bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.310+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/13277003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 0x56002333bb20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f7cb00058c0 tx=0x7f7cb0003f50 comp rx=0 tx=0).stop 2024-08-20T05:18:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.310+0000 7f7cd08a3740 1 -- 172.21.15.37:0/13277003 shutdown_connections 2024-08-20T05:18:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.310+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/13277003 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x56002334bb30 0x56002334df20 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.310+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/13277003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56002333c200 0x5600233395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.311+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/13277003 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560023330270 0x560023338f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.311+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/13277003 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 0x56002333bb20 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.311+0000 7f7cd08a3740 1 -- 172.21.15.37:0/13277003 >> 172.21.15.37:0/13277003 conn(0x56002332d780 msgr2=0x5600233332f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:02.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.311+0000 7f7cb4c00640 0 client.29237 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:02.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.312+0000 7f7cd08a3740 1 -- 172.21.15.37:0/13277003 shutdown_connections 2024-08-20T05:18:02.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.312+0000 7f7cd08a3740 1 -- 172.21.15.37:0/13277003 wait complete. 2024-08-20T05:18:02.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.313+0000 7f7cd08a3740 20 client.29237 trim_cache size 0 max 16384 2024-08-20T05:18:02.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.353+0000 7f7cd08a3740 1 Processor -- start 2024-08-20T05:18:02.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.353+0000 7f7cd08a3740 1 -- start start 2024-08-20T05:18:02.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.353+0000 7f7cd08a3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 0x56002333a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.353+0000 7f7cd08a3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560023330270 0x5600233536e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.353+0000 7f7cd08a3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56002333c200 0x560023353c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.353+0000 7f7cd08a3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81be550 con 0x560023330270 2024-08-20T05:18:02.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.353+0000 7f7cd08a3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81c0090 con 0x56002332f950 2024-08-20T05:18:02.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.353+0000 7f7cd08a3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81bec20 con 0x56002333c200 2024-08-20T05:18:02.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.354+0000 7f7cc6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560023330270 0x5600233536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:02.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.354+0000 7f7cc6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560023330270 0x5600233536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33304/0 (socket says 172.21.15.37:33304) 2024-08-20T05:18:02.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.355+0000 7f7cbfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 0x56002333a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:02.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.355+0000 7f7cbfe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 0x56002333a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:47986/0 (socket says 172.21.15.37:47986) 2024-08-20T05:18:02.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.355+0000 7f7cbfe00640 1 -- 172.21.15.37:0/3331015390 learned_addr learned my addr 172.21.15.37:0/3331015390 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:02.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.355+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/3331015390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56002333c200 0x560023353c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:02.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.356+0000 7f7cbfe00640 1 -- 172.21.15.37:0/3331015390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56002333c200 msgr2=0x560023353c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:02.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.356+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/3331015390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56002333c200 0x560023353c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.356+0000 7f7cbfe00640 1 -- 172.21.15.37:0/3331015390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560023330270 msgr2=0x5600233536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:02.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.356+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/3331015390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560023330270 0x5600233536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.357+0000 7f7cbfe00640 1 -- 172.21.15.37:0/3331015390 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56002333ea10 con 0x56002332f950 2024-08-20T05:18:02.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.357+0000 7f7cc6a00640 1 --2- 172.21.15.37:0/3331015390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560023330270 0x5600233536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:02.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.358+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/3331015390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 0x56002333a5a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000bfd0 tx=0x7f7cb000bd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=846d089f12f02e57 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:02.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.359+0000 7f7cb7400640 1 -- 172.21.15.37:0/3331015390 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000b8e0 con 0x56002332f950 2024-08-20T05:18:02.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.359+0000 7f7cb7400640 1 -- 172.21.15.37:0/3331015390 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cb0012080 con 0x56002332f950 2024-08-20T05:18:02.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.359+0000 7f7cb7400640 1 -- 172.21.15.37:0/3331015390 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb001ebd0 con 0x56002332f950 2024-08-20T05:18:02.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.360+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3331015390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 msgr2=0x56002333a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:02.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.360+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/3331015390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 0x56002333a5a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000bfd0 tx=0x7f7cb000bd90 comp rx=0 tx=0).stop 2024-08-20T05:18:02.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.360+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3331015390 shutdown_connections 2024-08-20T05:18:02.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.360+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/3331015390 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56002333c200 0x560023353c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.361+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/3331015390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560023330270 0x5600233536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.361+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/3331015390 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 0x56002333a5a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.361+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3331015390 >> 172.21.15.37:0/3331015390 conn(0x56002332d780 msgr2=0x56002332c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:02.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.361+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3331015390 shutdown_connections 2024-08-20T05:18:02.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.361+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3331015390 wait complete. 2024-08-20T05:18:02.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.362+0000 7f7cd08a3740 1 -- start start 2024-08-20T05:18:02.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.362+0000 7f7cd08a3740 1 Processor -- start 2024-08-20T05:18:02.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.368+0000 7f7cd08a3740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 0x5600233417e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.368+0000 7f7cd08a3740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560023330270 0x560023341d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.368+0000 7f7cd08a3740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56002333c200 0x5600233b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.368+0000 7f7cd08a3740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81bf9c0 con 0x560023330270 2024-08-20T05:18:02.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.368+0000 7f7cd08a3740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81bf2f0 con 0x56002332f950 2024-08-20T05:18:02.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.368+0000 7f7cd08a3740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7cc81bc530 con 0x56002333c200 2024-08-20T05:18:02.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.368+0000 7f7cd08a3740 10 client.0 _ll_register_callbacks cb 0x7f7cb8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:02.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.369+0000 7f7cc6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560023330270 0x560023341d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:02.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.369+0000 7f7cc6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560023330270 0x560023341d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33316/0 (socket says 172.21.15.37:33316) 2024-08-20T05:18:02.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.369+0000 7f7cc6a00640 1 -- 172.21.15.37:0/3668604316 learned_addr learned my addr 172.21.15.37:0/3668604316 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:02.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.369+0000 7f7cc6a00640 1 -- 172.21.15.37:0/3668604316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56002333c200 msgr2=0x5600233b46b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:18:02.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.369+0000 7f7cc6a00640 1 --2- 172.21.15.37:0/3668604316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56002333c200 0x5600233b46b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.369+0000 7f7cc6a00640 1 -- 172.21.15.37:0/3668604316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 msgr2=0x5600233417e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-20T05:18:02.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.369+0000 7f7cc6a00640 1 --2- 172.21.15.37:0/3668604316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 0x5600233417e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.369+0000 7f7cc6a00640 1 -- 172.21.15.37:0/3668604316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600233b4da0 con 0x560023330270 2024-08-20T05:18:02.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.371+0000 7f7cc6a00640 1 --2- 172.21.15.37:0/3668604316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560023330270 0x560023341d40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80092a0 tx=0x7f7cb8005120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3ca0dbefda239 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:02.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.371+0000 7f7cb4c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:18:02.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.374+0000 7f7cb4c00640 1 -- 172.21.15.37:0/3668604316 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8035040 con 0x560023330270 2024-08-20T05:18:02.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.374+0000 7f7cb4c00640 1 -- 172.21.15.37:0/3668604316 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7cb80046c0 con 0x560023330270 2024-08-20T05:18:02.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.374+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3668604316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7cb0012080 con 0x560023330270 2024-08-20T05:18:02.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.375+0000 7f7cb4c00640 1 -- 172.21.15.37:0/3668604316 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f7cb8054050 con 0x560023330270 2024-08-20T05:18:02.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.375+0000 7f7cd08a3740 10 client.18459 fetch_fsmap learned FSMap version 52 2024-08-20T05:18:02.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.375+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3668604316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5600233b6140 con 0x560023330270 2024-08-20T05:18:02.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.376+0000 7f7cb4c00640 1 -- 172.21.15.37:0/3668604316 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cb0012080 con 0x560023330270 2024-08-20T05:18:02.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.376+0000 7f7cb4c00640 1 -- 172.21.15.37:0/3668604316 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 52) ==== 8370+0+0 (secure 0 0 0) 0x7f7cb8003bb0 con 0x560023330270 2024-08-20T05:18:02.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.376+0000 7f7cd08a3740 10 client.18459 fetch_fsmap finished waiting for FSMap version 52 2024-08-20T05:18:02.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.376+0000 7f7cd08a3740 10 client.18459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:18:02.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.376+0000 7f7cd08a3740 20 client.18459 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:02.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.376+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/3668604316 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5600233b68f0 0x5600233b8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:02.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.376+0000 7f7cd08a3740 4 client.18459 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:18:02.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.376+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3668604316 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5600232a3450 con 0x5600233b68f0 2024-08-20T05:18:02.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.377+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/3668604316 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5600233b68f0 0x5600233b8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:02.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.379+0000 7f7cbfe00640 1 --2- 172.21.15.37:0/3668604316 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5600233b68f0 0x5600233b8d10 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4272ccec740d4af9 server_cookie=8a0e982ee01a63be in_seq=0 out_seq=0 2024-08-20T05:18:02.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.379+0000 7f7cb4c00640 10 client.18459 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:02.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.381+0000 7f7cb4c00640 1 -- 172.21.15.37:0/3668604316 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5600232a3450 con 0x5600233b68f0 2024-08-20T05:18:02.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.381+0000 7f7cb4c00640 10 client.18459 handle_command_reply: tid=0 2024-08-20T05:18:02.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.381+0000 7f7cd08a3740 1 client.18459 shutdown 2024-08-20T05:18:02.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.381+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3668604316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560023330270 msgr2=0x560023341d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:02.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.381+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/3668604316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560023330270 0x560023341d40 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80092a0 tx=0x7f7cb8005120 comp rx=0 tx=0).stop 2024-08-20T05:18:02.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.382+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3668604316 shutdown_connections 2024-08-20T05:18:02.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.382+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/3668604316 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5600233b68f0 0x5600233b8d10 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.382+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/3668604316 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x56002333c200 0x5600233b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.382+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/3668604316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560023330270 0x560023341d40 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.382+0000 7f7cd08a3740 1 --2- 172.21.15.37:0/3668604316 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x56002332f950 0x5600233417e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.382+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3668604316 >> 172.21.15.37:0/3668604316 conn(0x56002332d780 msgr2=0x5600233376c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:02.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.382+0000 7f7cb4c00640 0 client.18459 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:02.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.383+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3668604316 shutdown_connections 2024-08-20T05:18:02.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.383+0000 7f7cd08a3740 1 -- 172.21.15.37:0/3668604316 wait complete. 2024-08-20T05:18:02.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.383+0000 7f7cd08a3740 20 client.18459 trim_cache size 0 max 16384 2024-08-20T05:18:02.388 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:18:02.388 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-20T05:18:02.388 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": { 2024-08-20T05:18:02.388 INFO:teuthology.orchestra.run.smithi037.stdout: "40271891-a6af-4d64-b010-dc58730fb5b5": { 2024-08-20T05:18:02.389 INFO:teuthology.orchestra.run.smithi037.stdout: "path": "/", 2024-08-20T05:18:02.389 INFO:teuthology.orchestra.run.smithi037.stdout: "tag": "40271891-a6af-4d64-b010-dc58730fb5b5", 2024-08-20T05:18:02.389 INFO:teuthology.orchestra.run.smithi037.stdout: "options": "recursive,force" 2024-08-20T05:18:02.389 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:02.389 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:02.389 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:18:02.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.387+0000 7f7ccde00640 1 -- 172.21.15.37:0/3148764233 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7cac0b3d20 msgr2=0x7f7cac0b61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:02.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.387+0000 7f7ccde00640 1 --2- 172.21.15.37:0/3148764233 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7cac0b3d20 0x7f7cac0b61e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000afd0 tx=0x7f7cc0007ef0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.387+0000 7f7ccde00640 1 -- 172.21.15.37:0/3148764233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cc810f8c0 msgr2=0x7f7cc8118680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:02.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.387+0000 7f7ccde00640 1 --2- 172.21.15.37:0/3148764233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cc810f8c0 0x7f7cc8118680 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000ccb0 tx=0x7f7cc000a620 comp rx=0 tx=0).stop 2024-08-20T05:18:02.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.387+0000 7f7ccde00640 1 -- 172.21.15.37:0/3148764233 shutdown_connections 2024-08-20T05:18:02.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.387+0000 7f7ccde00640 1 --2- 172.21.15.37:0/3148764233 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7cac0b3d20 0x7f7cac0b61e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.387+0000 7f7ccde00640 1 --2- 172.21.15.37:0/3148764233 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7cc810f8c0 0x7f7cc8118680 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.387+0000 7f7ccde00640 1 --2- 172.21.15.37:0/3148764233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc810ef40 0x7f7cc8118050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.387+0000 7f7ccde00640 1 --2- 172.21.15.37:0/3148764233 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7cc810a0e0 0x7f7cc8119b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:02.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.387+0000 7f7ccde00640 1 -- 172.21.15.37:0/3148764233 >> 172.21.15.37:0/3148764233 conn(0x7f7cc806dcc0 msgr2=0x7f7cc8073130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:02.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.388+0000 7f7ccde00640 1 -- 172.21.15.37:0/3148764233 shutdown_connections 2024-08-20T05:18:02.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:02.388+0000 7f7ccde00640 1 -- 172.21.15.37:0/3148764233 wait complete. 2024-08-20T05:18:02.951 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 26.6 2024-08-20T05:18:02.952 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:18:03.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:03 smithi135 ceph-mon[22342]: pgmap v875: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 6.4 MiB/s wr, 558 op/s 2024-08-20T05:18:03.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:03 smithi130 ceph-mon[22007]: pgmap v875: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 6.4 MiB/s wr, 558 op/s 2024-08-20T05:18:04.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:03 smithi037 ceph-mon[17265]: pgmap v875: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 6.4 MiB/s wr, 558 op/s 2024-08-20T05:18:05.858 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:05 smithi037 ceph-mon[17265]: pgmap v876: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 7.3 MiB/s wr, 667 op/s 2024-08-20T05:18:05.858 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:05 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:18:05.860 INFO:tasks.cephfs.filesystem:scrub status for tag:40271891-a6af-4d64-b010-dc58730fb5b5 - {'path': '/', 'tag': '40271891-a6af-4d64-b010-dc58730fb5b5', 'options': 'recursive,force'} 2024-08-20T05:18:05.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:05 smithi135 ceph-mon[22342]: pgmap v876: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 7.3 MiB/s wr, 667 op/s 2024-08-20T05:18:05.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:05 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:18:05.917 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:18:05.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:05 smithi130 ceph-mon[22007]: pgmap v876: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 7.3 MiB/s wr, 667 op/s 2024-08-20T05:18:05.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:05 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:18:06.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.764+0000 7ff72fe00640 1 -- 172.21.15.37:0/3971400989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73010a520 msgr2=0x7ff73010a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:06.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.764+0000 7ff72fe00640 1 --2- 172.21.15.37:0/3971400989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73010a520 0x7ff73010a960 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff718009860 tx=0x7ff71802a340 comp rx=0 tx=0).stop 2024-08-20T05:18:06.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.765+0000 7ff72fe00640 1 -- 172.21.15.37:0/3971400989 shutdown_connections 2024-08-20T05:18:06.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.765+0000 7ff72fe00640 1 --2- 172.21.15.37:0/3971400989 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff73010aea0 0x7ff7301116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:06.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.765+0000 7ff72fe00640 1 --2- 172.21.15.37:0/3971400989 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff73010a520 0x7ff73010a960 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:06.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.765+0000 7ff72fe00640 1 --2- 172.21.15.37:0/3971400989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff730104b10 0x7ff730104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:06.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.765+0000 7ff72fe00640 1 -- 172.21.15.37:0/3971400989 >> 172.21.15.37:0/3971400989 conn(0x7ff730100540 msgr2=0x7ff730102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:06.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.765+0000 7ff72fe00640 1 -- 172.21.15.37:0/3971400989 shutdown_connections 2024-08-20T05:18:06.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.766+0000 7ff72fe00640 1 -- 172.21.15.37:0/3971400989 wait complete. 2024-08-20T05:18:06.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.767+0000 7ff72fe00640 1 Processor -- start 2024-08-20T05:18:06.769 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.768+0000 7ff72fe00640 1 -- start start 2024-08-20T05:18:06.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.768+0000 7ff72fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff730104b10 0x7ff730111530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:06.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.768+0000 7ff72fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff73010aea0 0x7ff73010e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:06.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.768+0000 7ff72fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff73010ed10 0x7ff73010f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:06.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.769+0000 7ff72fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff730114b60 con 0x7ff73010ed10 2024-08-20T05:18:06.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.769+0000 7ff72fe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff7301149e0 con 0x7ff73010aea0 2024-08-20T05:18:06.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.769+0000 7ff72fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff730114ce0 con 0x7ff730104b10 2024-08-20T05:18:06.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.769+0000 7ff72f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff73010ed10 0x7ff73010f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:06.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.769+0000 7ff72f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff73010ed10 0x7ff73010f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33870/0 (socket says 172.21.15.37:33870) 2024-08-20T05:18:06.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.769+0000 7ff72f400640 1 -- 172.21.15.37:0/1175446794 learned_addr learned my addr 172.21.15.37:0/1175446794 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:06.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.770+0000 7ff72f400640 1 -- 172.21.15.37:0/1175446794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff730104b10 msgr2=0x7ff730111530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-20T05:18:06.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.772+0000 7ff72f400640 1 --2- 172.21.15.37:0/1175446794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff730104b10 0x7ff730111530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:06.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.773+0000 7ff727e00640 1 --2- 172.21.15.37:0/1175446794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff73010aea0 0x7ff73010e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:06.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.773+0000 7ff72f400640 1 -- 172.21.15.37:0/1175446794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff73010aea0 msgr2=0x7ff73010e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:06.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.773+0000 7ff72f400640 1 --2- 172.21.15.37:0/1175446794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff73010aea0 0x7ff73010e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:06.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.774+0000 7ff72f400640 1 -- 172.21.15.37:0/1175446794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7301abb60 con 0x7ff73010ed10 2024-08-20T05:18:06.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.774+0000 7ff727e00640 1 --2- 172.21.15.37:0/1175446794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff73010aea0 0x7ff73010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:18:06.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.776+0000 7ff72f400640 1 --2- 172.21.15.37:0/1175446794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff73010ed10 0x7ff73010f1c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff72800b970 tx=0x7ff72800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:06.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.777+0000 7ff727400640 1 -- 172.21.15.37:0/1175446794 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff728019070 con 0x7ff73010ed10 2024-08-20T05:18:06.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.777+0000 7ff72fe00640 1 -- 172.21.15.37:0/1175446794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7301abe50 con 0x7ff73010ed10 2024-08-20T05:18:06.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.777+0000 7ff72fe00640 1 -- 172.21.15.37:0/1175446794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7301ac360 con 0x7ff73010ed10 2024-08-20T05:18:06.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.779+0000 7ff727400640 1 -- 172.21.15.37:0/1175446794 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff728014440 con 0x7ff73010ed10 2024-08-20T05:18:06.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.779+0000 7ff727400640 1 -- 172.21.15.37:0/1175446794 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7280075d0 con 0x7ff73010ed10 2024-08-20T05:18:06.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.782+0000 7ff72fe00640 1 -- 172.21.15.37:0/1175446794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff70c0052c0 con 0x7ff73010ed10 2024-08-20T05:18:06.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.787+0000 7ff727400640 1 -- 172.21.15.37:0/1175446794 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff72801c070 con 0x7ff73010ed10 2024-08-20T05:18:06.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.790+0000 7ff727400640 1 --2- 172.21.15.37:0/1175446794 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7140b3da0 0x7ff7140b6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:06.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.791+0000 7ff727400640 1 -- 172.21.15.37:0/1175446794 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff7280e33e0 con 0x7ff73010ed10 2024-08-20T05:18:06.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.795+0000 7ff72ea00640 1 --2- 172.21.15.37:0/1175446794 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7140b3da0 0x7ff7140b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:06.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.798+0000 7ff727400640 1 -- 172.21.15.37:0/1175446794 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff7280a9fe0 con 0x7ff73010ed10 2024-08-20T05:18:06.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:06.800+0000 7ff72ea00640 1 --2- 172.21.15.37:0/1175446794 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7140b3da0 0x7ff7140b6260 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff7200058c0 tx=0x7ff720005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:06.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:06 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:18:06.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:06 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:06.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:06 smithi130 ceph-mon[22007]: scrub summary: active paths [/] 2024-08-20T05:18:06.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:06 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:06.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:06 smithi130 ceph-mon[22007]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:07.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:06 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:18:07.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:06 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:07.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:06 smithi037 ceph-mon[17265]: scrub summary: active paths [/] 2024-08-20T05:18:07.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:06 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:07.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:06 smithi037 ceph-mon[17265]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:07.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:06 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:18:07.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:06 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:07.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:06 smithi135 ceph-mon[22342]: scrub summary: active paths [/] 2024-08-20T05:18:07.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:06 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:07.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:06 smithi135 ceph-mon[22342]: scrub summary: idle+waiting paths [/] 2024-08-20T05:18:07.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:07.302+0000 7ff72fe00640 1 -- 172.21.15.37:0/1175446794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff70c0055b0 con 0x7ff73010ed10 2024-08-20T05:18:07.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:07.303+0000 7ff727400640 1 -- 172.21.15.37:0/1175446794 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+11981 (secure 0 0 0) 0x7ff7280ae530 con 0x7ff73010ed10 2024-08-20T05:18:07.308 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:07.308 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":53,"btime":"2024-08-20T05:18:04:592807+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":53,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:18:03.860690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:18:07.309 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 53 2024-08-20T05:18:07.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:07.308+0000 7ff72fe00640 1 -- 172.21.15.37:0/1175446794 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7140b3da0 msgr2=0x7ff7140b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:07.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:07.308+0000 7ff72fe00640 1 --2- 172.21.15.37:0/1175446794 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7140b3da0 0x7ff7140b6260 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff7200058c0 tx=0x7ff720005850 comp rx=0 tx=0).stop 2024-08-20T05:18:07.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:07.308+0000 7ff72fe00640 1 -- 172.21.15.37:0/1175446794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff73010ed10 msgr2=0x7ff73010f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:07.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:07.308+0000 7ff72fe00640 1 --2- 172.21.15.37:0/1175446794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff73010ed10 0x7ff73010f1c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff72800b970 tx=0x7ff72800be30 comp rx=0 tx=0).stop 2024-08-20T05:18:07.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:07.308+0000 7ff72fe00640 1 -- 172.21.15.37:0/1175446794 shutdown_connections 2024-08-20T05:18:07.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:07.308+0000 7ff72fe00640 1 --2- 172.21.15.37:0/1175446794 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff7140b3da0 0x7ff7140b6260 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:07.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:07.308+0000 7ff72fe00640 1 --2- 172.21.15.37:0/1175446794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff73010ed10 0x7ff73010f1c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:07.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:07.308+0000 7ff72fe00640 1 --2- 172.21.15.37:0/1175446794 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff73010aea0 0x7ff73010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:07.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:07.308+0000 7ff72fe00640 1 --2- 172.21.15.37:0/1175446794 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff730104b10 0x7ff730111530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:07.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:07.308+0000 7ff72fe00640 1 -- 172.21.15.37:0/1175446794 >> 172.21.15.37:0/1175446794 conn(0x7ff730100540 msgr2=0x7ff730102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:07.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:07.310+0000 7ff72fe00640 1 -- 172.21.15.37:0/1175446794 shutdown_connections 2024-08-20T05:18:07.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:07.310+0000 7ff72fe00640 1 -- 172.21.15.37:0/1175446794 wait complete. 2024-08-20T05:18:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:07 smithi130 ceph-mon[22007]: pgmap v877: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 6.4 MiB/s wr, 634 op/s 2024-08-20T05:18:07.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:07 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1175446794' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:18:08.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:07 smithi037 ceph-mon[17265]: pgmap v877: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 6.4 MiB/s wr, 634 op/s 2024-08-20T05:18:08.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:07 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1175446794' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:18:08.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:07 smithi135 ceph-mon[22342]: pgmap v877: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 6.4 MiB/s wr, 634 op/s 2024-08-20T05:18:08.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:07 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1175446794' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:18:08.354 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db / --timeout 90 --expiration 146.6 --await-for 45.0' 2024-08-20T05:18:08.355 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db / --timeout 90 --expiration 146.6 --await-for 45.0 2024-08-20T05:18:09.120 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:18:09.852 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:09 smithi037 ceph-mon[17265]: pgmap v878: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 7.0 MiB/s wr, 749 op/s 2024-08-20T05:18:09.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:09 smithi130 ceph-mon[22007]: pgmap v878: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 7.0 MiB/s wr, 749 op/s 2024-08-20T05:18:09.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.961+0000 7f163be00640 1 -- 172.21.15.37:0/878186024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f163c104130 msgr2=0x7f163c10c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:09.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.963+0000 7f163be00640 1 --2- 172.21.15.37:0/878186024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f163c104130 0x7f163c10c620 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1628009900 tx=0x7f162802a420 comp rx=0 tx=0).stop 2024-08-20T05:18:09.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.963+0000 7f163be00640 1 -- 172.21.15.37:0/878186024 shutdown_connections 2024-08-20T05:18:09.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.963+0000 7f163be00640 1 --2- 172.21.15.37:0/878186024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f163c10cc70 0x7f163c10f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:09.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.963+0000 7f163be00640 1 --2- 172.21.15.37:0/878186024 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f163c104130 0x7f163c10c620 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:09.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.963+0000 7f163be00640 1 --2- 172.21.15.37:0/878186024 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f163c103810 0x7f163c103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:09.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.963+0000 7f163be00640 1 -- 172.21.15.37:0/878186024 >> 172.21.15.37:0/878186024 conn(0x7f163c0fd2d0 msgr2=0x7f163c0ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:09.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.964+0000 7f163be00640 1 -- 172.21.15.37:0/878186024 shutdown_connections 2024-08-20T05:18:09.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.964+0000 7f163be00640 1 -- 172.21.15.37:0/878186024 wait complete. 2024-08-20T05:18:09.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.965+0000 7f163be00640 1 Processor -- start 2024-08-20T05:18:09.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.966+0000 7f163be00640 1 -- start start 2024-08-20T05:18:09.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.966+0000 7f163be00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f163c103810 0x7f163c074420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:09.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.966+0000 7f163be00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f163c104130 0x7f163c074960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:09.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.966+0000 7f163be00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f163c10cc70 0x7f163c06d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:09.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.967+0000 7f163aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f163c103810 0x7f163c074420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:09.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.968+0000 7f163aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f163c103810 0x7f163c074420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:47168/0 (socket says 172.21.15.37:47168) 2024-08-20T05:18:09.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.968+0000 7f163a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f163c104130 0x7f163c074960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:09.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.968+0000 7f163a000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f163c104130 0x7f163c074960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50200/0 (socket says 172.21.15.37:50200) 2024-08-20T05:18:09.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.969+0000 7f163b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f163c10cc70 0x7f163c06d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:09.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.970+0000 7f163b400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f163c10cc70 0x7f163c06d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33888/0 (socket says 172.21.15.37:33888) 2024-08-20T05:18:09.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.970+0000 7f163be00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f163c112930 con 0x7f163c10cc70 2024-08-20T05:18:09.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.970+0000 7f163be00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f163c1127b0 con 0x7f163c104130 2024-08-20T05:18:09.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.970+0000 7f163be00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f163c112ab0 con 0x7f163c103810 2024-08-20T05:18:09.971 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.970+0000 7f163aa00640 1 -- 172.21.15.37:0/3985922634 learned_addr learned my addr 172.21.15.37:0/3985922634 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:09.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.971+0000 7f163b400640 1 -- 172.21.15.37:0/3985922634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f163c103810 msgr2=0x7f163c074420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:09.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.971+0000 7f163b400640 1 --2- 172.21.15.37:0/3985922634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f163c103810 0x7f163c074420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:09.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.971+0000 7f163b400640 1 -- 172.21.15.37:0/3985922634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f163c104130 msgr2=0x7f163c074960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:09.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.971+0000 7f163b400640 1 --2- 172.21.15.37:0/3985922634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f163c104130 0x7f163c074960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:09.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.971+0000 7f163b400640 1 -- 172.21.15.37:0/3985922634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f163c06dfb0 con 0x7f163c10cc70 2024-08-20T05:18:09.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.973+0000 7f163b400640 1 --2- 172.21.15.37:0/3985922634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f163c10cc70 0x7f163c06d6f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1634009fd0 tx=0x7f163400b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:09.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.973+0000 7f1633400640 1 -- 172.21.15.37:0/3985922634 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634004b20 con 0x7f163c10cc70 2024-08-20T05:18:09.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.973+0000 7f163be00640 1 -- 172.21.15.37:0/3985922634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f163c06e2a0 con 0x7f163c10cc70 2024-08-20T05:18:09.974 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.973+0000 7f163be00640 1 -- 172.21.15.37:0/3985922634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f163c073260 con 0x7f163c10cc70 2024-08-20T05:18:09.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.981+0000 7f1633400640 1 -- 172.21.15.37:0/3985922634 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1634019900 con 0x7f163c10cc70 2024-08-20T05:18:09.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.981+0000 7f1633400640 1 -- 172.21.15.37:0/3985922634 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1634004b20 con 0x7f163c10cc70 2024-08-20T05:18:09.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.984+0000 7f1633400640 1 -- 172.21.15.37:0/3985922634 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f16340218e0 con 0x7f163c10cc70 2024-08-20T05:18:09.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.986+0000 7f16446aa740 1 Processor -- start 2024-08-20T05:18:09.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.986+0000 7f16446aa740 1 -- start start 2024-08-20T05:18:09.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.987+0000 7f16446aa740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b065b5d0 0x5608b065b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:09.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.987+0000 7f16446aa740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b065bef0 0x5608b0667940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:09.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.987+0000 7f16446aa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b0667e80 0x5608b066a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:09.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.987+0000 7f16446aa740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5608b05fb670 con 0x5608b065b5d0 2024-08-20T05:18:09.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.987+0000 7f16446aa740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5608b05cf7c0 con 0x5608b065bef0 2024-08-20T05:18:09.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.987+0000 7f1633400640 1 --2- 172.21.15.37:0/3985922634 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f16200b3ef0 0x7f16200b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.987+0000 7f16446aa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5608b05becc0 con 0x5608b0667e80 2024-08-20T05:18:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.987+0000 7f1633400640 1 -- 172.21.15.37:0/3985922634 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f16340e7a30 con 0x7f163c10cc70 2024-08-20T05:18:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.987+0000 7f163aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b065bef0 0x5608b0667940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.987+0000 7f163aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b065bef0 0x5608b0667940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50202/0 (socket says 172.21.15.37:50202) 2024-08-20T05:18:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.987+0000 7f163aa00640 1 -- 172.21.15.37:0/2477236926 learned_addr learned my addr 172.21.15.37:0/2477236926 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.988+0000 7f163b400640 1 --2- 172.21.15.37:0/2477236926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b0667e80 0x5608b066a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.988+0000 7f163aa00640 1 -- 172.21.15.37:0/2477236926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b0667e80 msgr2=0x5608b066a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.988+0000 7f163aa00640 1 --2- 172.21.15.37:0/2477236926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b0667e80 0x5608b066a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.988+0000 7f163aa00640 1 -- 172.21.15.37:0/2477236926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b065b5d0 msgr2=0x5608b065b9b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:18:09.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.988+0000 7f163a000640 1 --2- 172.21.15.37:0/2477236926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b065b5d0 0x5608b065b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:09.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.989+0000 7f163aa00640 1 --2- 172.21.15.37:0/2477236926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b065b5d0 0x5608b065b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:09.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.989+0000 7f163aa00640 1 -- 172.21.15.37:0/2477236926 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608b0552110 con 0x5608b065bef0 2024-08-20T05:18:09.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.990+0000 7f163b400640 1 --2- 172.21.15.37:0/2477236926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b0667e80 0x5608b066a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:18:09.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.990+0000 7f163a000640 1 --2- 172.21.15.37:0/2477236926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b065b5d0 0x5608b065b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:18:09.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.990+0000 7f163a000640 1 --2- 172.21.15.37:0/3985922634 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f16200b3ef0 0x7f16200b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:09.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.990+0000 7f163aa00640 1 --2- 172.21.15.37:0/2477236926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b065bef0 0x5608b0667940 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f162c009dc0 tx=0x7f162c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=943b808d4bfd71c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:09.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.990+0000 7f1627e00640 1 -- 172.21.15.37:0/2477236926 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c01aa50 con 0x5608b065bef0 2024-08-20T05:18:09.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.991+0000 7f1627e00640 1 -- 172.21.15.37:0/2477236926 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f162c0054d0 con 0x5608b065bef0 2024-08-20T05:18:09.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.992+0000 7f16446aa740 1 -- 172.21.15.37:0/2477236926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b065bef0 msgr2=0x5608b0667940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:09.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.992+0000 7f16446aa740 1 --2- 172.21.15.37:0/2477236926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b065bef0 0x5608b0667940 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f162c009dc0 tx=0x7f162c011810 comp rx=0 tx=0).stop 2024-08-20T05:18:09.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.992+0000 7f163a000640 1 --2- 172.21.15.37:0/3985922634 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f16200b3ef0 0x7f16200b63b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f162802aa10 tx=0x7f1628009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:09.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.992+0000 7f16446aa740 1 -- 172.21.15.37:0/2477236926 shutdown_connections 2024-08-20T05:18:09.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.992+0000 7f16446aa740 1 --2- 172.21.15.37:0/2477236926 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b0667e80 0x5608b066a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:09.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.992+0000 7f16446aa740 1 --2- 172.21.15.37:0/2477236926 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b065bef0 0x5608b0667940 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:09.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.992+0000 7f16446aa740 1 --2- 172.21.15.37:0/2477236926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b065b5d0 0x5608b065b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:09.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.992+0000 7f16446aa740 1 -- 172.21.15.37:0/2477236926 >> 172.21.15.37:0/2477236926 conn(0x5608b0659400 msgr2=0x5608b065a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:09.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.993+0000 7f16446aa740 1 -- 172.21.15.37:0/2477236926 shutdown_connections 2024-08-20T05:18:09.995 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.994+0000 7f16446aa740 1 -- 172.21.15.37:0/2477236926 wait complete. 2024-08-20T05:18:09.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.995+0000 7f16446aa740 1 -- start start 2024-08-20T05:18:09.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.996+0000 7f16446aa740 1 Processor -- start 2024-08-20T05:18:09.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.997+0000 7f16446aa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b065b5d0 0x5608b0667760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:09.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.997+0000 7f16446aa740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b0667e80 0x5608b0664bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:09.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.997+0000 7f16446aa740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b0665140 0x5608b06655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.998+0000 7f163b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b0665140 0x5608b06655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.998+0000 7f16446aa740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5608b0564780 con 0x5608b0667e80 2024-08-20T05:18:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.998+0000 7f16446aa740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5608b05c2d00 con 0x5608b0665140 2024-08-20T05:18:10.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.998+0000 7f16446aa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5608b04217a0 con 0x5608b065b5d0 2024-08-20T05:18:10.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.998+0000 7f163aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b065b5d0 0x5608b0667760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.998+0000 7f163aa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b065b5d0 0x5608b0667760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:47184/0 (socket says 172.21.15.37:47184) 2024-08-20T05:18:10.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.998+0000 7f163aa00640 1 -- 172.21.15.37:0/2244526673 learned_addr learned my addr 172.21.15.37:0/2244526673 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:10.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.999+0000 7f163a000640 1 --2- 172.21.15.37:0/2244526673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b0667e80 0x5608b0664bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:09.998+0000 7f163b400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b0665140 0x5608b06655c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50212/0 (socket says 172.21.15.37:50212) 2024-08-20T05:18:10.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.000+0000 7f163aa00640 1 -- 172.21.15.37:0/2244526673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b0665140 msgr2=0x5608b06655c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:10.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.000+0000 7f163aa00640 1 --2- 172.21.15.37:0/2244526673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b0665140 0x5608b06655c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.000+0000 7f163aa00640 1 -- 172.21.15.37:0/2244526673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b0667e80 msgr2=0x5608b0664bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:10.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.000+0000 7f163aa00640 1 --2- 172.21.15.37:0/2244526673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b0667e80 0x5608b0664bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.000+0000 7f16446aa740 10 client.0 _ll_register_callbacks cb 0x5608b056c940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:10.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.000+0000 7f163aa00640 1 -- 172.21.15.37:0/2244526673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608b05719c0 con 0x5608b065b5d0 2024-08-20T05:18:10.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.000+0000 7f163b400640 1 --2- 172.21.15.37:0/2244526673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b0665140 0x5608b06655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:18:10.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.000+0000 7f16446aa740 1 -- 172.21.15.37:0/2244526673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5608b05d1710 con 0x5608b065b5d0 2024-08-20T05:18:10.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.001+0000 7f163aa00640 1 --2- 172.21.15.37:0/2244526673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b065b5d0 0x5608b0667760 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f162c004c80 tx=0x7f162c009320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fefffd6cb4b1e036 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:10.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.001+0000 7f1624c00640 10 client.29263 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:18:10.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.001+0000 7f1624c00640 1 -- 172.21.15.37:0/2244526673 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c030020 con 0x5608b065b5d0 2024-08-20T05:18:10.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.001+0000 7f1624c00640 1 -- 172.21.15.37:0/2244526673 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f162c01c4e0 con 0x5608b065b5d0 2024-08-20T05:18:10.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.001+0000 7f1624c00640 1 -- 172.21.15.37:0/2244526673 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f162c01a850 con 0x5608b065b5d0 2024-08-20T05:18:10.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.001+0000 7f16446aa740 10 client.29263 fetch_fsmap learned FSMap version 54 2024-08-20T05:18:10.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.002+0000 7f16446aa740 1 -- 172.21.15.37:0/2244526673 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({fsmap=54}) -- 0x5608b032db90 con 0x5608b065b5d0 2024-08-20T05:18:10.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.002+0000 7f1624c00640 1 -- 172.21.15.37:0/2244526673 <== mon.1 v2:172.21.15.135:3300/0 4 ==== fsmap(e 54) ==== 8378+0+0 (secure 0 0 0) 0x7f162c01a9f0 con 0x5608b065b5d0 2024-08-20T05:18:10.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.002+0000 7f16446aa740 10 client.29263 fetch_fsmap finished waiting for FSMap version 54 2024-08-20T05:18:10.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.002+0000 7f16446aa740 10 client.29263 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:18:10.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.002+0000 7f16446aa740 20 client.29263 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:10.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.002+0000 7f16446aa740 1 --2- 172.21.15.37:0/2244526673 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5608b06777a0 0x5608b0679b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.002+0000 7f16446aa740 4 client.29263 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:18:10.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.002+0000 7f16446aa740 1 -- 172.21.15.37:0/2244526673 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608b05cd1b0 con 0x5608b06777a0 2024-08-20T05:18:10.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.003+0000 7f163a000640 1 --2- 172.21.15.37:0/2244526673 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5608b06777a0 0x5608b0679b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.004+0000 7f163a000640 1 --2- 172.21.15.37:0/2244526673 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5608b06777a0 0x5608b0679b90 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d32ef96c15448b9 server_cookie=9f6d437eff21eec9 in_seq=0 out_seq=0 2024-08-20T05:18:10.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.004+0000 7f1624c00640 10 client.29263 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:10.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.004+0000 7f1624c00640 1 -- 172.21.15.37:0/2244526673 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608b05cd1b0 con 0x5608b06777a0 2024-08-20T05:18:10.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.004+0000 7f1624c00640 10 client.29263 handle_command_reply: tid=0 2024-08-20T05:18:10.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.005+0000 7f16446aa740 1 client.29263 shutdown 2024-08-20T05:18:10.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.005+0000 7f16446aa740 1 -- 172.21.15.37:0/2244526673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b065b5d0 msgr2=0x5608b0667760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.005+0000 7f16446aa740 1 --2- 172.21.15.37:0/2244526673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b065b5d0 0x5608b0667760 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f162c004c80 tx=0x7f162c009320 comp rx=0 tx=0).stop 2024-08-20T05:18:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.005+0000 7f16446aa740 1 -- 172.21.15.37:0/2244526673 shutdown_connections 2024-08-20T05:18:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.005+0000 7f16446aa740 1 --2- 172.21.15.37:0/2244526673 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5608b06777a0 0x5608b0679b90 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.005+0000 7f16446aa740 1 --2- 172.21.15.37:0/2244526673 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b0665140 0x5608b06655c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.005+0000 7f16446aa740 1 --2- 172.21.15.37:0/2244526673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b0667e80 0x5608b0664bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.005+0000 7f16446aa740 1 --2- 172.21.15.37:0/2244526673 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b065b5d0 0x5608b0667760 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.005+0000 7f16446aa740 1 -- 172.21.15.37:0/2244526673 >> 172.21.15.37:0/2244526673 conn(0x5608b0659400 msgr2=0x5608b065e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.005+0000 7f1624c00640 0 client.29263 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:10.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.006+0000 7f16446aa740 1 -- 172.21.15.37:0/2244526673 shutdown_connections 2024-08-20T05:18:10.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.006+0000 7f16446aa740 1 -- 172.21.15.37:0/2244526673 wait complete. 2024-08-20T05:18:10.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.006+0000 7f16446aa740 20 client.29263 trim_cache size 0 max 16384 2024-08-20T05:18:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.042+0000 7f16446aa740 1 Processor -- start 2024-08-20T05:18:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.043+0000 7f16446aa740 1 -- start start 2024-08-20T05:18:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.043+0000 7f16446aa740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b065b5d0 0x5608b0669270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.043+0000 7f16446aa740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b0665140 0x5608b06697b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.043+0000 7f16446aa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b0667e80 0x5608b067f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.044 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.043+0000 7f16446aa740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f161c00fc00 con 0x5608b0665140 2024-08-20T05:18:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.043+0000 7f16446aa740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f161c011740 con 0x5608b065b5d0 2024-08-20T05:18:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.043+0000 7f16446aa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f161c0102d0 con 0x5608b0667e80 2024-08-20T05:18:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.043+0000 7f163aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b065b5d0 0x5608b0669270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.043+0000 7f163aa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b065b5d0 0x5608b0669270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50224/0 (socket says 172.21.15.37:50224) 2024-08-20T05:18:10.045 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.043+0000 7f163aa00640 1 -- 172.21.15.37:0/3421867360 learned_addr learned my addr 172.21.15.37:0/3421867360 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:10.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.044+0000 7f163b400640 1 --2- 172.21.15.37:0/3421867360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b0667e80 0x5608b067f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.044+0000 7f163aa00640 1 -- 172.21.15.37:0/3421867360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b0667e80 msgr2=0x5608b067f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:10.046 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.044+0000 7f163aa00640 1 --2- 172.21.15.37:0/3421867360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b0667e80 0x5608b067f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.044+0000 7f163aa00640 1 -- 172.21.15.37:0/3421867360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b0665140 msgr2=0x5608b06697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.044+0000 7f163aa00640 1 --2- 172.21.15.37:0/3421867360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b0665140 0x5608b06697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.044+0000 7f163aa00640 1 -- 172.21.15.37:0/3421867360 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608b06630b0 con 0x5608b065b5d0 2024-08-20T05:18:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.044+0000 7f163b400640 1 --2- 172.21.15.37:0/3421867360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b0667e80 0x5608b067f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:18:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.044+0000 7f163aa00640 1 --2- 172.21.15.37:0/3421867360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b065b5d0 0x5608b0669270 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f162c01c7d0 tx=0x7f162c02c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d6f4645f32188ac server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.045+0000 7f1627400640 1 -- 172.21.15.37:0/3421867360 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c030040 con 0x5608b065b5d0 2024-08-20T05:18:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.045+0000 7f1627400640 1 -- 172.21.15.37:0/3421867360 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5608b05d1710 con 0x5608b065b5d0 2024-08-20T05:18:10.047 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.045+0000 7f1627400640 1 -- 172.21.15.37:0/3421867360 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c005560 con 0x5608b065b5d0 2024-08-20T05:18:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.046+0000 7f16446aa740 1 -- 172.21.15.37:0/3421867360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b065b5d0 msgr2=0x5608b0669270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.046+0000 7f16446aa740 1 --2- 172.21.15.37:0/3421867360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b065b5d0 0x5608b0669270 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f162c01c7d0 tx=0x7f162c02c000 comp rx=0 tx=0).stop 2024-08-20T05:18:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.046+0000 7f16446aa740 1 -- 172.21.15.37:0/3421867360 shutdown_connections 2024-08-20T05:18:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.047+0000 7f16446aa740 1 --2- 172.21.15.37:0/3421867360 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b0667e80 0x5608b067f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.047+0000 7f16446aa740 1 --2- 172.21.15.37:0/3421867360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b0665140 0x5608b06697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.048 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.047+0000 7f16446aa740 1 --2- 172.21.15.37:0/3421867360 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b065b5d0 0x5608b0669270 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.047+0000 7f16446aa740 1 -- 172.21.15.37:0/3421867360 >> 172.21.15.37:0/3421867360 conn(0x5608b0659400 msgr2=0x5608b065fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.047+0000 7f16446aa740 1 -- 172.21.15.37:0/3421867360 shutdown_connections 2024-08-20T05:18:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.047+0000 7f16446aa740 1 -- 172.21.15.37:0/3421867360 wait complete. 2024-08-20T05:18:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.048+0000 7f16446aa740 1 -- start start 2024-08-20T05:18:10.049 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.048+0000 7f16446aa740 1 Processor -- start 2024-08-20T05:18:10.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.049+0000 7f16446aa740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b065b5d0 0x5608b0670100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.050+0000 7f16446aa740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b0665140 0x5608b0670680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.050+0000 7f16446aa740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b0667e80 0x5608b066afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.050+0000 7f163aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b065b5d0 0x5608b0670100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.051+0000 7f16446aa740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f161c011070 con 0x5608b065b5d0 2024-08-20T05:18:10.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.051+0000 7f16446aa740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f161c0109a0 con 0x5608b0667e80 2024-08-20T05:18:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.051+0000 7f16446aa740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f161c00dbe0 con 0x5608b0665140 2024-08-20T05:18:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.051+0000 7f16446aa740 10 client.0 _ll_register_callbacks cb 0x7f162c009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.052+0000 7f163aa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b065b5d0 0x5608b0670100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33920/0 (socket says 172.21.15.37:33920) 2024-08-20T05:18:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.052+0000 7f163aa00640 1 -- 172.21.15.37:0/2548127139 learned_addr learned my addr 172.21.15.37:0/2548127139 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.052+0000 7f163a000640 1 --2- 172.21.15.37:0/2548127139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b0665140 0x5608b0670680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.052+0000 7f163b400640 1 --2- 172.21.15.37:0/2548127139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b0667e80 0x5608b066afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.053+0000 7f163aa00640 1 -- 172.21.15.37:0/2548127139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b0665140 msgr2=0x5608b0670680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.053+0000 7f163aa00640 1 --2- 172.21.15.37:0/2548127139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b0665140 0x5608b0670680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.053+0000 7f163aa00640 1 -- 172.21.15.37:0/2548127139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b0667e80 msgr2=0x5608b066afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.053+0000 7f163aa00640 1 --2- 172.21.15.37:0/2548127139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b0667e80 0x5608b066afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.053+0000 7f163aa00640 1 -- 172.21.15.37:0/2548127139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608b066b7f0 con 0x5608b065b5d0 2024-08-20T05:18:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.054+0000 7f163aa00640 1 --2- 172.21.15.37:0/2548127139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b065b5d0 0x5608b0670100 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f162c01d020 tx=0x7f162c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0670b3cf896184 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.054+0000 7f1624c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:18:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.055+0000 7f1624c00640 1 -- 172.21.15.37:0/2548127139 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c04b070 con 0x5608b065b5d0 2024-08-20T05:18:10.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.055+0000 7f16446aa740 1 -- 172.21.15.37:0/2548127139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5608b05d1710 con 0x5608b065b5d0 2024-08-20T05:18:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.056+0000 7f1624c00640 1 -- 172.21.15.37:0/2548127139 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f162c01a9f0 con 0x5608b065b5d0 2024-08-20T05:18:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.056+0000 7f1624c00640 1 -- 172.21.15.37:0/2548127139 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f162c030040 con 0x5608b065b5d0 2024-08-20T05:18:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.056+0000 7f16446aa740 10 client.18477 fetch_fsmap learned FSMap version 54 2024-08-20T05:18:10.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.056+0000 7f16446aa740 1 -- 172.21.15.37:0/2548127139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5608b06e2f90 con 0x5608b065b5d0 2024-08-20T05:18:10.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.057+0000 7f1624c00640 1 -- 172.21.15.37:0/2548127139 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5608b05d1710 con 0x5608b065b5d0 2024-08-20T05:18:10.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.057+0000 7f1624c00640 1 -- 172.21.15.37:0/2548127139 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 54) ==== 8378+0+0 (secure 0 0 0) 0x7f162c0045a0 con 0x5608b065b5d0 2024-08-20T05:18:10.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.057+0000 7f16446aa740 10 client.18477 fetch_fsmap finished waiting for FSMap version 54 2024-08-20T05:18:10.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.057+0000 7f16446aa740 10 client.18477 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:18:10.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.057+0000 7f16446aa740 20 client.18477 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:10.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.057+0000 7f16446aa740 1 --2- 172.21.15.37:0/2548127139 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5608b06e35a0 0x5608b06e59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.057+0000 7f16446aa740 4 client.18477 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.6, "await_for": 45.0}] 2024-08-20T05:18:10.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.057+0000 7f16446aa740 1 -- 172.21.15.37:0/2548127139 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 146.6, "await_for": 45.0}) -- 0x5608b065f260 con 0x5608b06e35a0 2024-08-20T05:18:10.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.058+0000 7f163a000640 1 --2- 172.21.15.37:0/2548127139 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5608b06e35a0 0x5608b06e59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.059+0000 7f163a000640 1 --2- 172.21.15.37:0/2548127139 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5608b06e35a0 0x5608b06e59c0 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f79cbad4c71075e server_cookie=37ba1fbf5a0ce851 in_seq=0 out_seq=0 2024-08-20T05:18:10.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.059+0000 7f1624c00640 10 client.18477 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:10.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:09 smithi135 ceph-mon[22342]: pgmap v878: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 7.0 MiB/s wr, 749 op/s 2024-08-20T05:18:10.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.290+0000 7f1624c00640 1 -- 172.21.15.37:0/2548127139 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5608b065f260 con 0x5608b06e35a0 2024-08-20T05:18:10.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.290+0000 7f1624c00640 10 client.18477 handle_command_reply: tid=0 2024-08-20T05:18:10.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.290+0000 7f16446aa740 1 client.18477 shutdown 2024-08-20T05:18:10.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.292+0000 7f16446aa740 1 -- 172.21.15.37:0/2548127139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b065b5d0 msgr2=0x5608b0670100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.292+0000 7f16446aa740 1 --2- 172.21.15.37:0/2548127139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b065b5d0 0x5608b0670100 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f162c01d020 tx=0x7f162c005f90 comp rx=0 tx=0).stop 2024-08-20T05:18:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.292+0000 7f16446aa740 1 -- 172.21.15.37:0/2548127139 shutdown_connections 2024-08-20T05:18:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.292+0000 7f16446aa740 1 --2- 172.21.15.37:0/2548127139 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5608b06e35a0 0x5608b06e59c0 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.292+0000 7f16446aa740 1 --2- 172.21.15.37:0/2548127139 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5608b0667e80 0x5608b066afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.292+0000 7f1624c00640 0 client.18477 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:10.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.292+0000 7f16446aa740 1 --2- 172.21.15.37:0/2548127139 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5608b0665140 0x5608b0670680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.292+0000 7f16446aa740 1 --2- 172.21.15.37:0/2548127139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5608b065b5d0 0x5608b0670100 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.292+0000 7f16446aa740 1 -- 172.21.15.37:0/2548127139 >> 172.21.15.37:0/2548127139 conn(0x5608b0659400 msgr2=0x5608b0657ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:10.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.293+0000 7f16446aa740 1 -- 172.21.15.37:0/2548127139 shutdown_connections 2024-08-20T05:18:10.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.293+0000 7f16446aa740 1 -- 172.21.15.37:0/2548127139 wait complete. 2024-08-20T05:18:10.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.293+0000 7f16446aa740 20 client.18477 trim_cache size 0 max 16384 2024-08-20T05:18:10.295 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:18:10.295 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 54, 2024-08-20T05:18:10.295 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:18:10.295 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 58, 2024-08-20T05:18:10.296 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:18:10.296 INFO:teuthology.orchestra.run.smithi037.stdout: "f5944875": { 2024-08-20T05:18:10.296 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 58, 2024-08-20T05:18:10.296 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:18:10.296 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:18:10.296 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:18:10.296 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:18:10.296 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:10.296 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:18:10.296 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 146.6, 2024-08-20T05:18:10.296 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:18:10.296 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:18:10.296 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:18:10.296 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:18:10.297 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "QUIESCED", 2024-08-20T05:18:10.297 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:18:10.297 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:10.297 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:10.297 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:10.297 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:10.297 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:10.297 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:18:10.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.294+0000 7f163be00640 1 -- 172.21.15.37:0/3985922634 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f16200b3ef0 msgr2=0x7f16200b63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:10.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.294+0000 7f163be00640 1 --2- 172.21.15.37:0/3985922634 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f16200b3ef0 0x7f16200b63b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f162802aa10 tx=0x7f1628009260 comp rx=0 tx=0).stop 2024-08-20T05:18:10.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.294+0000 7f163be00640 1 -- 172.21.15.37:0/3985922634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f163c10cc70 msgr2=0x7f163c06d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:10.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.294+0000 7f163be00640 1 --2- 172.21.15.37:0/3985922634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f163c10cc70 0x7f163c06d6f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f1634009fd0 tx=0x7f163400b690 comp rx=0 tx=0).stop 2024-08-20T05:18:10.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.295+0000 7f163be00640 1 -- 172.21.15.37:0/3985922634 shutdown_connections 2024-08-20T05:18:10.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.295+0000 7f163be00640 1 --2- 172.21.15.37:0/3985922634 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f16200b3ef0 0x7f16200b63b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.295+0000 7f163be00640 1 --2- 172.21.15.37:0/3985922634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f163c10cc70 0x7f163c06d6f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.295+0000 7f163be00640 1 --2- 172.21.15.37:0/3985922634 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f163c104130 0x7f163c074960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.295+0000 7f163be00640 1 --2- 172.21.15.37:0/3985922634 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f163c103810 0x7f163c074420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.295+0000 7f163be00640 1 -- 172.21.15.37:0/3985922634 >> 172.21.15.37:0/3985922634 conn(0x7f163c0fd2d0 msgr2=0x7f163c0fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:10.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.295+0000 7f163be00640 1 -- 172.21.15.37:0/3985922634 shutdown_connections 2024-08-20T05:18:10.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:10.295+0000 7f163be00640 1 -- 172.21.15.37:0/3985922634 wait complete. 2024-08-20T05:18:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.619+0000 7fa73d600640 1 -- 172.21.15.37:0/2588582716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7381037d0 msgr2=0x7fa738103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.619+0000 7fa73d600640 1 --2- 172.21.15.37:0/2588582716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7381037d0 0x7fa738103c50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa720009890 tx=0x7fa72002a380 comp rx=0 tx=0).stop 2024-08-20T05:18:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.619+0000 7fa73d600640 1 -- 172.21.15.37:0/2588582716 shutdown_connections 2024-08-20T05:18:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.619+0000 7fa73d600640 1 --2- 172.21.15.37:0/2588582716 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa738104190 0x7fa73810ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.619+0000 7fa73d600640 1 --2- 172.21.15.37:0/2588582716 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa7381037d0 0x7fa738103c50 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.619+0000 7fa73d600640 1 --2- 172.21.15.37:0/2588582716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738102680 0x7fa738102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.619+0000 7fa73d600640 1 -- 172.21.15.37:0/2588582716 >> 172.21.15.37:0/2588582716 conn(0x7fa7380fdf40 msgr2=0x7fa738100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.620+0000 7fa73d600640 1 -- 172.21.15.37:0/2588582716 shutdown_connections 2024-08-20T05:18:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.620+0000 7fa73d600640 1 -- 172.21.15.37:0/2588582716 wait complete. 2024-08-20T05:18:10.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.622+0000 7fa73d600640 1 Processor -- start 2024-08-20T05:18:10.623 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.623+0000 7fa73d600640 1 -- start start 2024-08-20T05:18:10.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.624+0000 7fa73d600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738102680 0x7fa738196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.625 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.624+0000 7fa73d600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7381037d0 0x7fa738196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.624+0000 7fa73d600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa738104190 0x7fa738197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.624+0000 7fa73d600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa73810e320 con 0x7fa738102680 2024-08-20T05:18:10.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.624+0000 7fa73d600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa73810e1a0 con 0x7fa7381037d0 2024-08-20T05:18:10.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.624+0000 7fa73d600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa73810e4a0 con 0x7fa738104190 2024-08-20T05:18:10.626 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.626+0000 7fa736a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738102680 0x7fa738196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.626+0000 7fa736a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738102680 0x7fa738196940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33950/0 (socket says 172.21.15.37:33950) 2024-08-20T05:18:10.627 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.626+0000 7fa736a00640 1 -- 172.21.15.37:0/1852069227 learned_addr learned my addr 172.21.15.37:0/1852069227 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.627+0000 7fa736a00640 1 -- 172.21.15.37:0/1852069227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa738104190 msgr2=0x7fa738197bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T05:18:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.627+0000 7fa736a00640 1 --2- 172.21.15.37:0/1852069227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa738104190 0x7fa738197bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.627+0000 7fa736a00640 1 -- 172.21.15.37:0/1852069227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7381037d0 msgr2=0x7fa738196f90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-20T05:18:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.627+0000 7fa736a00640 1 --2- 172.21.15.37:0/1852069227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7381037d0 0x7fa738196f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.627+0000 7fa736a00640 1 -- 172.21.15.37:0/1852069227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa738198480 con 0x7fa738102680 2024-08-20T05:18:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.627+0000 7fa736a00640 1 --2- 172.21.15.37:0/1852069227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738102680 0x7fa738196940 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa72800e9c0 tx=0x7fa72800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.628+0000 7fa72f400640 1 -- 172.21.15.37:0/1852069227 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72800cde0 con 0x7fa738102680 2024-08-20T05:18:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.628+0000 7fa73d600640 1 -- 172.21.15.37:0/1852069227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa738198770 con 0x7fa738102680 2024-08-20T05:18:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.629+0000 7fa73d600640 1 -- 172.21.15.37:0/1852069227 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa73819ae20 con 0x7fa738102680 2024-08-20T05:18:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.629+0000 7fa72f400640 1 -- 172.21.15.37:0/1852069227 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa728009520 con 0x7fa738102680 2024-08-20T05:18:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.629+0000 7fa72f400640 1 -- 172.21.15.37:0/1852069227 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa728010430 con 0x7fa738102680 2024-08-20T05:18:10.635 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.634+0000 7fa74042b740 1 Processor -- start 2024-08-20T05:18:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.634+0000 7fa74042b740 1 -- start start 2024-08-20T05:18:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.634+0000 7fa74042b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346bf610 0x5573346c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.634+0000 7fa74042b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346c1f40 0x5573346c4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.634+0000 7fa74042b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346c4980 0x5573346c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.634+0000 7fa74042b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557334632210 con 0x5573346c4980 2024-08-20T05:18:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.634+0000 7fa74042b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x557334621710 con 0x5573346c1f40 2024-08-20T05:18:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.634+0000 7fa74042b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x557334625750 con 0x5573346bf610 2024-08-20T05:18:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.635+0000 7fa737400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346bf610 0x5573346c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.635+0000 7fa737400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346bf610 0x5573346c1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:47226/0 (socket says 172.21.15.37:47226) 2024-08-20T05:18:10.636 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.635+0000 7fa737400640 1 -- 172.21.15.37:0/1581596955 learned_addr learned my addr 172.21.15.37:0/1581596955 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.635+0000 7fa737400640 1 -- 172.21.15.37:0/1581596955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346c1f40 msgr2=0x5573346c4330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-20T05:18:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.635+0000 7fa737400640 1 --2- 172.21.15.37:0/1581596955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346c1f40 0x5573346c4330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.635+0000 7fa737400640 1 -- 172.21.15.37:0/1581596955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346c4980 msgr2=0x5573346c6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.635+0000 7fa737400640 1 --2- 172.21.15.37:0/1581596955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346c4980 0x5573346c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.635+0000 7fa737400640 1 -- 172.21.15.37:0/1581596955 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573345edde0 con 0x5573346bf610 2024-08-20T05:18:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.636+0000 7fa72f400640 1 -- 172.21.15.37:0/1852069227 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa7280035f0 con 0x7fa738102680 2024-08-20T05:18:10.637 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.636+0000 7fa737400640 1 --2- 172.21.15.37:0/1581596955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346bf610 0x5573346c1a00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa730009e20 tx=0x7fa73000e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a191079cead3fba7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.636+0000 7fa727400640 1 -- 172.21.15.37:0/1581596955 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730003b70 con 0x5573346bf610 2024-08-20T05:18:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.637+0000 7fa727400640 1 -- 172.21.15.37:0/1581596955 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa730003d10 con 0x5573346bf610 2024-08-20T05:18:10.638 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.637+0000 7fa727400640 1 -- 172.21.15.37:0/1581596955 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730018870 con 0x5573346bf610 2024-08-20T05:18:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.638+0000 7fa74042b740 1 -- 172.21.15.37:0/1581596955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346bf610 msgr2=0x5573346c1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.638+0000 7fa74042b740 1 --2- 172.21.15.37:0/1581596955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346bf610 0x5573346c1a00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fa730009e20 tx=0x7fa73000e720 comp rx=0 tx=0).stop 2024-08-20T05:18:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.638+0000 7fa72f400640 1 --2- 172.21.15.37:0/1852069227 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa71c0b3c90 0x7fa71c0b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.639 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.638+0000 7fa72f400640 1 -- 172.21.15.37:0/1852069227 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa7280e43e0 con 0x7fa738102680 2024-08-20T05:18:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.638+0000 7fa74042b740 1 -- 172.21.15.37:0/1581596955 shutdown_connections 2024-08-20T05:18:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.638+0000 7fa74042b740 1 --2- 172.21.15.37:0/1581596955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346c4980 0x5573346c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.638+0000 7fa74042b740 1 --2- 172.21.15.37:0/1581596955 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346c1f40 0x5573346c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.638+0000 7fa74042b740 1 --2- 172.21.15.37:0/1581596955 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346bf610 0x5573346c1a00 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.639+0000 7fa74042b740 1 -- 172.21.15.37:0/1581596955 >> 172.21.15.37:0/1581596955 conn(0x5573346ba760 msgr2=0x5573346bb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.639+0000 7fa736a00640 1 --2- 172.21.15.37:0/1852069227 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa71c0b3c90 0x7fa71c0b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.639+0000 7fa74042b740 1 -- 172.21.15.37:0/1581596955 shutdown_connections 2024-08-20T05:18:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.639+0000 7fa74042b740 1 -- 172.21.15.37:0/1581596955 wait complete. 2024-08-20T05:18:10.640 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.640+0000 7fa74042b740 1 -- start start 2024-08-20T05:18:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.640+0000 7fa74042b740 1 Processor -- start 2024-08-20T05:18:10.644 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.642+0000 7fa736a00640 1 --2- 172.21.15.37:0/1852069227 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa71c0b3c90 0x7fa71c0b6150 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa728004610 tx=0x7fa72800efb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.644+0000 7fa74042b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346bf610 0x5573346c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.644+0000 7fa74042b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346c1f40 0x5573346c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.644+0000 7fa74042b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346c4980 0x5573346c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.644+0000 7fa74042b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55733455aab0 con 0x5573346c1f40 2024-08-20T05:18:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.644+0000 7fa74042b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5573345c8140 con 0x5573346c4980 2024-08-20T05:18:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.644+0000 7fa74042b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5573346c7960 con 0x5573346bf610 2024-08-20T05:18:10.645 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.644+0000 7fa74042b740 10 client.0 _ll_register_callbacks cb 0x5573345db5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.645+0000 7fa737400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346bf610 0x5573346c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.645+0000 7fa737400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346bf610 0x5573346c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:47236/0 (socket says 172.21.15.37:47236) 2024-08-20T05:18:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.645+0000 7fa737400640 1 -- 172.21.15.37:0/305790668 learned_addr learned my addr 172.21.15.37:0/305790668 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.645+0000 7fa737400640 1 --2- 172.21.15.37:0/305790668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346c4980 0x5573346c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.646+0000 7fa737400640 1 -- 172.21.15.37:0/305790668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346c4980 msgr2=0x5573346c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.646+0000 7fa72fe00640 1 --2- 172.21.15.37:0/305790668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346c1f40 0x5573346c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.647 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.646+0000 7fa737400640 1 --2- 172.21.15.37:0/305790668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346c4980 0x5573346c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.647+0000 7fa737400640 1 -- 172.21.15.37:0/305790668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346c1f40 msgr2=0x5573346c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.647+0000 7fa737400640 1 --2- 172.21.15.37:0/305790668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346c1f40 0x5573346c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.648 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.647+0000 7fa737400640 1 -- 172.21.15.37:0/305790668 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573345c9170 con 0x5573346bf610 2024-08-20T05:18:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.647+0000 7fa72fe00640 1 --2- 172.21.15.37:0/305790668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346c1f40 0x5573346c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-20T05:18:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.648+0000 7fa737400640 1 --2- 172.21.15.37:0/305790668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346bf610 0x5573346c8d30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa730005fd0 tx=0x7fa7300098d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f755c9ae651e0ca server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.648+0000 7fa71be00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:18:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.648+0000 7fa71be00640 1 -- 172.21.15.37:0/305790668 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa730020040 con 0x5573346bf610 2024-08-20T05:18:10.649 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.648+0000 7fa71be00640 1 -- 172.21.15.37:0/305790668 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa7300041e0 con 0x5573346bf610 2024-08-20T05:18:10.650 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.648+0000 7fa74042b740 1 -- 172.21.15.37:0/305790668 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa730003d10 con 0x5573346bf610 2024-08-20T05:18:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.657+0000 7fa71be00640 1 -- 172.21.15.37:0/305790668 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fa7300043e0 con 0x5573346bf610 2024-08-20T05:18:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.657+0000 7fa74042b740 10 client.29278 fetch_fsmap learned FSMap version 54 2024-08-20T05:18:10.658 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.657+0000 7fa74042b740 1 -- 172.21.15.37:0/305790668 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x557334384790 con 0x5573346bf610 2024-08-20T05:18:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.658+0000 7fa71be00640 1 -- 172.21.15.37:0/305790668 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa730003d10 con 0x5573346bf610 2024-08-20T05:18:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.658+0000 7fa71be00640 1 -- 172.21.15.37:0/305790668 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 54) ==== 8378+0+0 (secure 0 0 0) 0x7fa730026040 con 0x5573346bf610 2024-08-20T05:18:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.658+0000 7fa74042b740 10 client.29278 fetch_fsmap finished waiting for FSMap version 54 2024-08-20T05:18:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.658+0000 7fa74042b740 10 client.29278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:18:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.658+0000 7fa74042b740 20 client.29278 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.658+0000 7fa74042b740 1 --2- 172.21.15.37:0/305790668 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5573346e5c90 0x5573346e8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.658+0000 7fa74042b740 4 client.29278 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:18:10.659 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.658+0000 7fa74042b740 1 -- 172.21.15.37:0/305790668 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557334634160 con 0x5573346e5c90 2024-08-20T05:18:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.658+0000 7fa72fe00640 1 --2- 172.21.15.37:0/305790668 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5573346e5c90 0x5573346e8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.659+0000 7fa71be00640 10 client.29278 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:10.660 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.659+0000 7fa72fe00640 1 --2- 172.21.15.37:0/305790668 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5573346e5c90 0x5573346e8110 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77c0d39f4a098db0 server_cookie=2cbfc1430f53d791 in_seq=0 out_seq=0 2024-08-20T05:18:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.660+0000 7fa71be00640 1 -- 172.21.15.37:0/305790668 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557334634160 con 0x5573346e5c90 2024-08-20T05:18:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.660+0000 7fa71be00640 10 client.29278 handle_command_reply: tid=0 2024-08-20T05:18:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.660+0000 7fa74042b740 1 client.29278 shutdown 2024-08-20T05:18:10.661 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.661+0000 7fa74042b740 1 -- 172.21.15.37:0/305790668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346bf610 msgr2=0x5573346c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.661+0000 7fa74042b740 1 --2- 172.21.15.37:0/305790668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346bf610 0x5573346c8d30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa730005fd0 tx=0x7fa7300098d0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.662 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.661+0000 7fa74042b740 1 -- 172.21.15.37:0/305790668 shutdown_connections 2024-08-20T05:18:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.661+0000 7fa74042b740 1 --2- 172.21.15.37:0/305790668 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5573346e5c90 0x5573346e8110 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.662+0000 7fa71be00640 0 client.29278 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.662+0000 7fa74042b740 1 --2- 172.21.15.37:0/305790668 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346c4980 0x5573346c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.662+0000 7fa74042b740 1 --2- 172.21.15.37:0/305790668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346c1f40 0x5573346c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.662+0000 7fa74042b740 1 --2- 172.21.15.37:0/305790668 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346bf610 0x5573346c8d30 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.662+0000 7fa74042b740 1 -- 172.21.15.37:0/305790668 >> 172.21.15.37:0/305790668 conn(0x5573346ba760 msgr2=0x5573346b9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.662+0000 7fa74042b740 1 -- 172.21.15.37:0/305790668 shutdown_connections 2024-08-20T05:18:10.663 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.663+0000 7fa74042b740 1 -- 172.21.15.37:0/305790668 wait complete. 2024-08-20T05:18:10.664 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.663+0000 7fa74042b740 20 client.29278 trim_cache size 0 max 16384 2024-08-20T05:18:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.689+0000 7fa74042b740 1 Processor -- start 2024-08-20T05:18:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.689+0000 7fa74042b740 1 -- start start 2024-08-20T05:18:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.690+0000 7fa74042b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346bf610 0x5573346c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.690+0000 7fa74042b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346c1f40 0x5573346b9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.690 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.690+0000 7fa74042b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346c4980 0x5573346bc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.690+0000 7fa74042b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa71400fce0 con 0x5573346c1f40 2024-08-20T05:18:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.690+0000 7fa74042b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa714011820 con 0x5573346bf610 2024-08-20T05:18:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.690+0000 7fa74042b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa7140103b0 con 0x5573346c4980 2024-08-20T05:18:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.690+0000 7fa72fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346c1f40 0x5573346b9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.690+0000 7fa72fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346c1f40 0x5573346b9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33988/0 (socket says 172.21.15.37:33988) 2024-08-20T05:18:10.691 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.690+0000 7fa72fe00640 1 -- 172.21.15.37:0/4142790561 learned_addr learned my addr 172.21.15.37:0/4142790561 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:10.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.691+0000 7fa737400640 1 --2- 172.21.15.37:0/4142790561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346c4980 0x5573346bc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.691+0000 7fa737400640 1 --2- 172.21.15.37:0/4142790561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346bf610 0x5573346c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.691+0000 7fa72fe00640 1 -- 172.21.15.37:0/4142790561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346c4980 msgr2=0x5573346bc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:10.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.691+0000 7fa72fe00640 1 --2- 172.21.15.37:0/4142790561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346c4980 0x5573346bc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.691+0000 7fa72fe00640 1 -- 172.21.15.37:0/4142790561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346bf610 msgr2=0x5573346c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:10.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.691+0000 7fa72fe00640 1 --2- 172.21.15.37:0/4142790561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346bf610 0x5573346c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.692 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.691+0000 7fa72fe00640 1 -- 172.21.15.37:0/4142790561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573346c1d70 con 0x5573346c1f40 2024-08-20T05:18:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.692+0000 7fa72fe00640 1 --2- 172.21.15.37:0/4142790561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346c1f40 0x5573346b9f50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa720035040 tx=0x7fa7200094e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae1e28ebc3dc949 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.692+0000 7fa726a00640 1 -- 172.21.15.37:0/4142790561 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720037040 con 0x5573346c1f40 2024-08-20T05:18:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.692+0000 7fa726a00640 1 -- 172.21.15.37:0/4142790561 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557334634160 con 0x5573346c1f40 2024-08-20T05:18:10.693 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.692+0000 7fa726a00640 1 -- 172.21.15.37:0/4142790561 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7200053d0 con 0x5573346c1f40 2024-08-20T05:18:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.693+0000 7fa74042b740 1 -- 172.21.15.37:0/4142790561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346c1f40 msgr2=0x5573346b9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.693+0000 7fa74042b740 1 --2- 172.21.15.37:0/4142790561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346c1f40 0x5573346b9f50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa720035040 tx=0x7fa7200094e0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.693+0000 7fa74042b740 1 -- 172.21.15.37:0/4142790561 shutdown_connections 2024-08-20T05:18:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.693+0000 7fa74042b740 1 --2- 172.21.15.37:0/4142790561 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346c4980 0x5573346bc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.693+0000 7fa74042b740 1 --2- 172.21.15.37:0/4142790561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346c1f40 0x5573346b9f50 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.694 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.693+0000 7fa74042b740 1 --2- 172.21.15.37:0/4142790561 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346bf610 0x5573346c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.693+0000 7fa74042b740 1 -- 172.21.15.37:0/4142790561 >> 172.21.15.37:0/4142790561 conn(0x5573346ba760 msgr2=0x5573346beaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.694+0000 7fa74042b740 1 -- 172.21.15.37:0/4142790561 shutdown_connections 2024-08-20T05:18:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.694+0000 7fa74042b740 1 -- 172.21.15.37:0/4142790561 wait complete. 2024-08-20T05:18:10.695 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.695+0000 7fa74042b740 1 -- start start 2024-08-20T05:18:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.695+0000 7fa74042b740 1 Processor -- start 2024-08-20T05:18:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.695+0000 7fa74042b740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346bf610 0x5573346d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.695+0000 7fa74042b740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346c1f40 0x5573346cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.695+0000 7fa74042b740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346c4980 0x5573346cfa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.696 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.695+0000 7fa74042b740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa714011150 con 0x5573346bf610 2024-08-20T05:18:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.695+0000 7fa74042b740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa714010a80 con 0x5573346c1f40 2024-08-20T05:18:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.695+0000 7fa74042b740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa71400dc80 con 0x5573346c4980 2024-08-20T05:18:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.695+0000 7fa74042b740 10 client.0 _ll_register_callbacks cb 0x7fa730009cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:10.697 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.696+0000 7fa737400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346bf610 0x5573346d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.696+0000 7fa737400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346bf610 0x5573346d0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33994/0 (socket says 172.21.15.37:33994) 2024-08-20T05:18:10.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.696+0000 7fa72fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346c1f40 0x5573346cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.696+0000 7fa72fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346c1f40 0x5573346cf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:50276/0 (socket says 172.21.15.37:50276) 2024-08-20T05:18:10.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.696+0000 7fa72fe00640 1 -- 172.21.15.37:0/685667724 learned_addr learned my addr 172.21.15.37:0/685667724 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:10.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.697+0000 7fa737400640 1 --2- 172.21.15.37:0/685667724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346c4980 0x5573346cfa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.697+0000 7fa72fe00640 1 -- 172.21.15.37:0/685667724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346c4980 msgr2=0x5573346cfa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:10.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.697+0000 7fa72fe00640 1 --2- 172.21.15.37:0/685667724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346c4980 0x5573346cfa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.698 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.697+0000 7fa72fe00640 1 -- 172.21.15.37:0/685667724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346bf610 msgr2=0x5573346d0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:10.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.697+0000 7fa72fe00640 1 --2- 172.21.15.37:0/685667724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346bf610 0x5573346d0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:10.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.697+0000 7fa72fe00640 1 -- 172.21.15.37:0/685667724 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573343fd620 con 0x5573346c1f40 2024-08-20T05:18:10.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.698+0000 7fa72fe00640 1 --2- 172.21.15.37:0/685667724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346c1f40 0x5573346cf350 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa720009250 tx=0x7fa720005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81c24a06ee0d0a05 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:10.699 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.698+0000 7fa71be00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:18:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.699+0000 7fa71be00640 1 -- 172.21.15.37:0/685667724 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72004a070 con 0x5573346c1f40 2024-08-20T05:18:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.699+0000 7fa71be00640 1 -- 172.21.15.37:0/685667724 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa720004240 con 0x5573346c1f40 2024-08-20T05:18:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.699+0000 7fa74042b740 1 -- 172.21.15.37:0/685667724 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557334634160 con 0x5573346c1f40 2024-08-20T05:18:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.699+0000 7fa71be00640 1 -- 172.21.15.37:0/685667724 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fa720037040 con 0x5573346c1f40 2024-08-20T05:18:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.699+0000 7fa74042b740 10 client.29270 fetch_fsmap learned FSMap version 54 2024-08-20T05:18:10.700 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.699+0000 7fa74042b740 1 -- 172.21.15.37:0/685667724 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55733474faf0 con 0x5573346c1f40 2024-08-20T05:18:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.699+0000 7fa71be00640 1 -- 172.21.15.37:0/685667724 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557334634160 con 0x5573346c1f40 2024-08-20T05:18:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.700+0000 7fa71be00640 1 -- 172.21.15.37:0/685667724 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 54) ==== 8378+0+0 (secure 0 0 0) 0x7fa720004750 con 0x5573346c1f40 2024-08-20T05:18:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.700+0000 7fa74042b740 10 client.29270 fetch_fsmap finished waiting for FSMap version 54 2024-08-20T05:18:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.700+0000 7fa74042b740 10 client.29270 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:18:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.700+0000 7fa74042b740 20 client.29270 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.700+0000 7fa74042b740 1 --2- 172.21.15.37:0/685667724 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5573346e5c90 0x557334752460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.700+0000 7fa74042b740 4 client.29270 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:18:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.700+0000 7fa74042b740 1 -- 172.21.15.37:0/685667724 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55733462fc00 con 0x5573346e5c90 2024-08-20T05:18:10.701 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.700+0000 7fa737400640 1 --2- 172.21.15.37:0/685667724 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5573346e5c90 0x557334752460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.701+0000 7fa737400640 1 --2- 172.21.15.37:0/685667724 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5573346e5c90 0x557334752460 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c94a11a216725dca server_cookie=cdd08a24b4fbffa7 in_seq=0 out_seq=0 2024-08-20T05:18:10.702 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:10.701+0000 7fa71be00640 10 client.29270 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:10.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:10 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:18:11.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:10 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:18:11.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:10 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:18:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.586+0000 7fa71be00640 1 -- 172.21.15.37:0/685667724 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55733462fc00 con 0x5573346e5c90 2024-08-20T05:18:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.586+0000 7fa71be00640 10 client.29270 handle_command_reply: tid=0 2024-08-20T05:18:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.586+0000 7fa74042b740 1 client.29270 shutdown 2024-08-20T05:18:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.587+0000 7fa74042b740 1 -- 172.21.15.37:0/685667724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346c1f40 msgr2=0x5573346cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.587+0000 7fa74042b740 1 --2- 172.21.15.37:0/685667724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346c1f40 0x5573346cf350 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fa720009250 tx=0x7fa720005fa0 comp rx=0 tx=0).stop 2024-08-20T05:18:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.587+0000 7fa74042b740 1 -- 172.21.15.37:0/685667724 shutdown_connections 2024-08-20T05:18:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.587+0000 7fa74042b740 1 --2- 172.21.15.37:0/685667724 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5573346e5c90 0x557334752460 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.587+0000 7fa74042b740 1 --2- 172.21.15.37:0/685667724 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573346c4980 0x5573346cfa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.587+0000 7fa74042b740 1 --2- 172.21.15.37:0/685667724 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573346c1f40 0x5573346cf350 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.587+0000 7fa74042b740 1 --2- 172.21.15.37:0/685667724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573346bf610 0x5573346d0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.587+0000 7fa71be00640 0 client.29270 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.587+0000 7fa74042b740 1 -- 172.21.15.37:0/685667724 >> 172.21.15.37:0/685667724 conn(0x5573346ba760 msgr2=0x5573346b8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.587+0000 7fa74042b740 1 -- 172.21.15.37:0/685667724 shutdown_connections 2024-08-20T05:18:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.587+0000 7fa74042b740 1 -- 172.21.15.37:0/685667724 wait complete. 2024-08-20T05:18:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.587+0000 7fa74042b740 20 client.29270 trim_cache size 0 max 16384 2024-08-20T05:18:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:18:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:18:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:18:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:18:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.588+0000 7fa73d600640 1 -- 172.21.15.37:0/1852069227 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa71c0b3c90 msgr2=0x7fa71c0b6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.588+0000 7fa73d600640 1 --2- 172.21.15.37:0/1852069227 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa71c0b3c90 0x7fa71c0b6150 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa728004610 tx=0x7fa72800efb0 comp rx=0 tx=0).stop 2024-08-20T05:18:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.588+0000 7fa73d600640 1 -- 172.21.15.37:0/1852069227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738102680 msgr2=0x7fa738196940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.588+0000 7fa73d600640 1 --2- 172.21.15.37:0/1852069227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738102680 0x7fa738196940 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa72800e9c0 tx=0x7fa72800ee80 comp rx=0 tx=0).stop 2024-08-20T05:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.588+0000 7fa73d600640 1 -- 172.21.15.37:0/1852069227 shutdown_connections 2024-08-20T05:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.588+0000 7fa73d600640 1 --2- 172.21.15.37:0/1852069227 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa71c0b3c90 0x7fa71c0b6150 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.588+0000 7fa73d600640 1 --2- 172.21.15.37:0/1852069227 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa738104190 0x7fa738197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.588+0000 7fa73d600640 1 --2- 172.21.15.37:0/1852069227 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa7381037d0 0x7fa738196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.588+0000 7fa73d600640 1 --2- 172.21.15.37:0/1852069227 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa738102680 0x7fa738196940 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.588+0000 7fa73d600640 1 -- 172.21.15.37:0/1852069227 >> 172.21.15.37:0/1852069227 conn(0x7fa7380fdf40 msgr2=0x7fa738108fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.589+0000 7fa73d600640 1 -- 172.21.15.37:0/1852069227 shutdown_connections 2024-08-20T05:18:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:11.589+0000 7fa73d600640 1 -- 172.21.15.37:0/1852069227 wait complete. 2024-08-20T05:18:11.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:11 smithi130 ceph-mon[22007]: pgmap v879: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 7.3 MiB/s wr, 828 op/s 2024-08-20T05:18:12.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:11 smithi037 ceph-mon[17265]: pgmap v879: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 7.3 MiB/s wr, 828 op/s 2024-08-20T05:18:12.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:11 smithi135 ceph-mon[22342]: pgmap v879: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 7.3 MiB/s wr, 828 op/s 2024-08-20T05:18:13.667 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f5944875', quiesce took 10.7 seconds. Will release after: 15.900000000000002 2024-08-20T05:18:13.917 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:13 smithi135 ceph-mon[22342]: pgmap v880: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.8 MiB/s wr, 696 op/s 2024-08-20T05:18:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:13 smithi130 ceph-mon[22007]: pgmap v880: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.8 MiB/s wr, 696 op/s 2024-08-20T05:18:14.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:13 smithi037 ceph-mon[17265]: pgmap v880: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.8 MiB/s wr, 696 op/s 2024-08-20T05:18:15.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:15 smithi130 ceph-mon[22007]: pgmap v881: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 5.6 MiB/s wr, 709 op/s 2024-08-20T05:18:16.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:15 smithi037 ceph-mon[17265]: pgmap v881: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 5.6 MiB/s wr, 709 op/s 2024-08-20T05:18:16.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:15 smithi135 ceph-mon[22342]: pgmap v881: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 5.6 MiB/s wr, 709 op/s 2024-08-20T05:18:16.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:16 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:18:16.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:16 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:18:17.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:16 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:18:17.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:16 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:18:17.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:16 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:18:17.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:16 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:18:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:17 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:18:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:17 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:18:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:17 smithi130 ceph-mon[22007]: scrub summary: idle 2024-08-20T05:18:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:17 smithi130 ceph-mon[22007]: pgmap v882: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 4.3 MiB/s wr, 549 op/s 2024-08-20T05:18:18.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:17 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:18:18.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:17 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:18:18.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:17 smithi037 ceph-mon[17265]: scrub summary: idle 2024-08-20T05:18:18.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:17 smithi037 ceph-mon[17265]: pgmap v882: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 4.3 MiB/s wr, 549 op/s 2024-08-20T05:18:18.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:17 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:18:18.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:17 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:18:18.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:17 smithi135 ceph-mon[22342]: scrub summary: idle 2024-08-20T05:18:18.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:17 smithi135 ceph-mon[22342]: pgmap v882: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 4.3 MiB/s wr, 549 op/s 2024-08-20T05:18:19.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:19 smithi130 ceph-mon[22007]: pgmap v883: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 3.4 MiB/s wr, 444 op/s 2024-08-20T05:18:20.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:19 smithi037 ceph-mon[17265]: pgmap v883: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 3.4 MiB/s wr, 444 op/s 2024-08-20T05:18:20.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:19 smithi135 ceph-mon[22342]: pgmap v883: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 3.4 MiB/s wr, 444 op/s 2024-08-20T05:18:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:21 smithi130 ceph-mon[22007]: pgmap v884: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.3 MiB/s wr, 309 op/s 2024-08-20T05:18:22.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:21 smithi037 ceph-mon[17265]: pgmap v884: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.3 MiB/s wr, 309 op/s 2024-08-20T05:18:22.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:21 smithi135 ceph-mon[22342]: pgmap v884: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.3 MiB/s wr, 309 op/s 2024-08-20T05:18:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:23 smithi130 ceph-mon[22007]: pgmap v885: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 705 KiB/s wr, 113 op/s 2024-08-20T05:18:24.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:23 smithi037 ceph-mon[17265]: pgmap v885: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 705 KiB/s wr, 113 op/s 2024-08-20T05:18:24.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:23 smithi135 ceph-mon[22342]: pgmap v885: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 705 KiB/s wr, 113 op/s 2024-08-20T05:18:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.718+0000 7f6a00e00640 1 -- 172.21.15.37:0/514436927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69fc1037d0 msgr2=0x7f69fc103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.718+0000 7f6a00e00640 1 --2- 172.21.15.37:0/514436927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69fc1037d0 0x7f69fc103c50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009930 tx=0x7f69e402a420 comp rx=0 tx=0).stop 2024-08-20T05:18:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.718+0000 7f6a00e00640 1 -- 172.21.15.37:0/514436927 shutdown_connections 2024-08-20T05:18:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.718+0000 7f6a00e00640 1 --2- 172.21.15.37:0/514436927 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69fc104190 0x7f69fc10ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.718+0000 7f6a00e00640 1 --2- 172.21.15.37:0/514436927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69fc1037d0 0x7f69fc103c50 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.718+0000 7f6a00e00640 1 --2- 172.21.15.37:0/514436927 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69fc102680 0x7f69fc102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.718+0000 7f6a00e00640 1 -- 172.21.15.37:0/514436927 >> 172.21.15.37:0/514436927 conn(0x7f69fc0fdf40 msgr2=0x7f69fc100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:24.720 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.718+0000 7f6a00e00640 1 -- 172.21.15.37:0/514436927 shutdown_connections 2024-08-20T05:18:24.721 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.718+0000 7f6a00e00640 1 -- 172.21.15.37:0/514436927 wait complete. 2024-08-20T05:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.719+0000 7f6a00e00640 1 Processor -- start 2024-08-20T05:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.719+0000 7f6a00e00640 1 -- start start 2024-08-20T05:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.719+0000 7f6a00e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69fc102680 0x7f69fc076a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.719+0000 7f6a00e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69fc1037d0 0x7f69fc075270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.719+0000 7f6a00e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69fc104190 0x7f69fc0757b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.720+0000 7f6a00e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc10e2f0 con 0x7f69fc102680 2024-08-20T05:18:24.722 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.720+0000 7f6a00e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc10e170 con 0x7f69fc1037d0 2024-08-20T05:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.720+0000 7f6a00e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc10e470 con 0x7f69fc104190 2024-08-20T05:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.720+0000 7f69f9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69fc102680 0x7f69fc076a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.720+0000 7f69f9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69fc102680 0x7f69fc076a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54988/0 (socket says 172.21.15.37:54988) 2024-08-20T05:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.720+0000 7f69f9e00640 1 -- 172.21.15.37:0/2618324739 learned_addr learned my addr 172.21.15.37:0/2618324739 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.720+0000 7f69f1400640 1 --2- 172.21.15.37:0/2618324739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69fc1037d0 0x7f69fc075270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.720+0000 7f69fa800640 1 --2- 172.21.15.37:0/2618324739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69fc104190 0x7f69fc0757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.720+0000 7f69f9e00640 1 -- 172.21.15.37:0/2618324739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69fc104190 msgr2=0x7f69fc0757b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.720+0000 7f69f9e00640 1 --2- 172.21.15.37:0/2618324739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69fc104190 0x7f69fc0757b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.720+0000 7f69f9e00640 1 -- 172.21.15.37:0/2618324739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69fc1037d0 msgr2=0x7f69fc075270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.720+0000 7f69f9e00640 1 --2- 172.21.15.37:0/2618324739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69fc1037d0 0x7f69fc075270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.720+0000 7f69f9e00640 1 -- 172.21.15.37:0/2618324739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69fc076020 con 0x7f69fc102680 2024-08-20T05:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.720+0000 7f69fa800640 1 --2- 172.21.15.37:0/2618324739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69fc104190 0x7f69fc0757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:18:24.723 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.720+0000 7f69f9e00640 1 --2- 172.21.15.37:0/2618324739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69fc102680 0x7f69fc076a10 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00e9f0 tx=0x7f69ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.721+0000 7f69f3400640 1 -- 172.21.15.37:0/2618324739 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec00cd80 con 0x7f69fc102680 2024-08-20T05:18:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.721+0000 7f69f3400640 1 -- 172.21.15.37:0/2618324739 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69ec0054d0 con 0x7f69fc102680 2024-08-20T05:18:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.721+0000 7f69f3400640 1 -- 172.21.15.37:0/2618324739 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec010690 con 0x7f69fc102680 2024-08-20T05:18:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.721+0000 7f6a00e00640 1 -- 172.21.15.37:0/2618324739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69fc1a2bb0 con 0x7f69fc102680 2024-08-20T05:18:24.724 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.721+0000 7f6a00e00640 1 -- 172.21.15.37:0/2618324739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69fc1a30d0 con 0x7f69fc102680 2024-08-20T05:18:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.724+0000 7f6a03ca4740 1 Processor -- start 2024-08-20T05:18:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.724+0000 7f6a03ca4740 1 -- start start 2024-08-20T05:18:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.724+0000 7f69f3400640 1 -- 172.21.15.37:0/2618324739 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f69ec004e90 con 0x7f69fc102680 2024-08-20T05:18:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.724+0000 7f6a03ca4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a992b0 0x560860a9b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.724+0000 7f6a03ca4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a9bbe0 0x560860a9dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.724+0000 7f6a03ca4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9e620 0x560860aa0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.726 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.724+0000 7f6a03ca4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560860a0c210 con 0x560860a9e620 2024-08-20T05:18:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.724+0000 7f6a03ca4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5608609fb710 con 0x560860a9bbe0 2024-08-20T05:18:24.727 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.724+0000 7f6a03ca4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5608609ff750 con 0x560860a992b0 2024-08-20T05:18:24.728 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.725+0000 7f69f9e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a9bbe0 0x560860a9dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.725+0000 7f69fa800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a992b0 0x560860a9b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.725+0000 7f69f1400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9e620 0x560860aa0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.725+0000 7f69fa800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a992b0 0x560860a9b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:60096/0 (socket says 172.21.15.37:60096) 2024-08-20T05:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.725+0000 7f69fa800640 1 -- 172.21.15.37:0/2360564376 learned_addr learned my addr 172.21.15.37:0/2360564376 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.725+0000 7f69fa800640 1 -- 172.21.15.37:0/2360564376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a9bbe0 msgr2=0x560860a9dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.725+0000 7f69fa800640 1 --2- 172.21.15.37:0/2360564376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a9bbe0 0x560860a9dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.725+0000 7f69fa800640 1 -- 172.21.15.37:0/2360564376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9e620 msgr2=0x560860aa0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.725+0000 7f69fa800640 1 --2- 172.21.15.37:0/2360564376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9e620 0x560860aa0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.725+0000 7f69fa800640 1 -- 172.21.15.37:0/2360564376 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608609c7de0 con 0x560860a992b0 2024-08-20T05:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.725+0000 7f69f9e00640 1 --2- 172.21.15.37:0/2360564376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a9bbe0 0x560860a9dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.725+0000 7f69fa800640 1 --2- 172.21.15.37:0/2360564376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a992b0 0x560860a9b6a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009fd0 tx=0x7f69f40108e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f942149a5da8d5f9 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:24.729 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.726+0000 7f69eb400640 1 -- 172.21.15.37:0/2360564376 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4011760 con 0x560860a992b0 2024-08-20T05:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.726+0000 7f69eb400640 1 -- 172.21.15.37:0/2360564376 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69f4011db0 con 0x560860a992b0 2024-08-20T05:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.726+0000 7f69eb400640 1 -- 172.21.15.37:0/2360564376 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f400e3c0 con 0x560860a992b0 2024-08-20T05:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.726+0000 7f69f3400640 1 --2- 172.21.15.37:0/2618324739 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f69e00b3c50 0x7f69e00b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.726+0000 7f69f3400640 1 -- 172.21.15.37:0/2618324739 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f69ec0e4430 con 0x7f69fc102680 2024-08-20T05:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.726+0000 7f69f9e00640 1 --2- 172.21.15.37:0/2618324739 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f69e00b3c50 0x7f69e00b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.726+0000 7f6a03ca4740 1 -- 172.21.15.37:0/2360564376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a992b0 msgr2=0x560860a9b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.726+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/2360564376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a992b0 0x560860a9b6a0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009fd0 tx=0x7f69f40108e0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.727+0000 7f6a03ca4740 1 -- 172.21.15.37:0/2360564376 shutdown_connections 2024-08-20T05:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.727+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/2360564376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9e620 0x560860aa0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.727+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/2360564376 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a9bbe0 0x560860a9dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.727+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/2360564376 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a992b0 0x560860a9b6a0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.730 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.727+0000 7f6a03ca4740 1 -- 172.21.15.37:0/2360564376 >> 172.21.15.37:0/2360564376 conn(0x560860a943b0 msgr2=0x560860a95190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.727+0000 7f6a03ca4740 1 -- 172.21.15.37:0/2360564376 shutdown_connections 2024-08-20T05:18:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.727+0000 7f6a03ca4740 1 -- 172.21.15.37:0/2360564376 wait complete. 2024-08-20T05:18:24.731 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.727+0000 7f69f9e00640 1 --2- 172.21.15.37:0/2618324739 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f69e00b3c50 0x7f69e00b6110 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0e46d0 tx=0x7f69ec0e7e70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.727+0000 7f6a03ca4740 1 -- start start 2024-08-20T05:18:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.727+0000 7f6a03ca4740 1 Processor -- start 2024-08-20T05:18:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.728+0000 7f6a03ca4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a992b0 0x560860aa2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.733 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.728+0000 7f6a03ca4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a9bbe0 0x560860aa3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.728+0000 7f6a03ca4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9e620 0x560860aa3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.728+0000 7f6a03ca4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560860934ab0 con 0x560860a9e620 2024-08-20T05:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.728+0000 7f6a03ca4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5608609a2140 con 0x560860a992b0 2024-08-20T05:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.728+0000 7f6a03ca4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560860aa1600 con 0x560860a9bbe0 2024-08-20T05:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.728+0000 7f6a03ca4740 10 client.0 _ll_register_callbacks cb 0x5608609b55d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.728+0000 7f69fa800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9e620 0x560860aa3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.728+0000 7f69fa800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9e620 0x560860aa3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55014/0 (socket says 172.21.15.37:55014) 2024-08-20T05:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.728+0000 7f69fa800640 1 -- 172.21.15.37:0/716281026 learned_addr learned my addr 172.21.15.37:0/716281026 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.728+0000 7f69f1400640 1 --2- 172.21.15.37:0/716281026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a9bbe0 0x560860aa3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:24.734 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.728+0000 7f69fa800640 1 --2- 172.21.15.37:0/716281026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a992b0 0x560860aa2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.729+0000 7f69f1400640 1 -- 172.21.15.37:0/716281026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a992b0 msgr2=0x560860aa2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.729+0000 7f69f1400640 1 --2- 172.21.15.37:0/716281026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a992b0 0x560860aa2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.729+0000 7f69f1400640 1 -- 172.21.15.37:0/716281026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9e620 msgr2=0x560860aa3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.729+0000 7f69f1400640 1 --2- 172.21.15.37:0/716281026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9e620 0x560860aa3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.729+0000 7f69f1400640 1 -- 172.21.15.37:0/716281026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608609a3170 con 0x560860a9bbe0 2024-08-20T05:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.729+0000 7f69fa800640 1 --2- 172.21.15.37:0/716281026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a992b0 0x560860aa2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.729+0000 7f69f1400640 1 --2- 172.21.15.37:0/716281026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a9bbe0 0x560860aa3390 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f69e4005ab0 tx=0x7f69e4031d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cd124e8fa58979f server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.729+0000 7f69dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.729+0000 7f69dfe00640 1 -- 172.21.15.37:0/716281026 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e4035040 con 0x560860a9bbe0 2024-08-20T05:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.729+0000 7f6a03ca4740 1 -- 172.21.15.37:0/716281026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5608609d2a30 con 0x560860a9bbe0 2024-08-20T05:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.729+0000 7f69dfe00640 1 -- 172.21.15.37:0/716281026 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f69e4004040 con 0x560860a9bbe0 2024-08-20T05:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.730+0000 7f69dfe00640 1 -- 172.21.15.37:0/716281026 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f69e404e050 con 0x560860a9bbe0 2024-08-20T05:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.730+0000 7f6a03ca4740 10 client.29296 fetch_fsmap learned FSMap version 54 2024-08-20T05:18:24.735 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.730+0000 7f6a03ca4740 1 -- 172.21.15.37:0/716281026 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x56086075e790 con 0x560860a9bbe0 2024-08-20T05:18:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.730+0000 7f69dfe00640 1 -- 172.21.15.37:0/716281026 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5608609d2a30 con 0x560860a9bbe0 2024-08-20T05:18:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.730+0000 7f69dfe00640 1 -- 172.21.15.37:0/716281026 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 54) ==== 8378+0+0 (secure 0 0 0) 0x7f69e403c440 con 0x560860a9bbe0 2024-08-20T05:18:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.730+0000 7f6a03ca4740 10 client.29296 fetch_fsmap finished waiting for FSMap version 54 2024-08-20T05:18:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.730+0000 7f6a03ca4740 10 client.29296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:18:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.730+0000 7f6a03ca4740 20 client.29296 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.730+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/716281026 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560860aae990 0x560860ab0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.730+0000 7f6a03ca4740 4 client.29296 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:18:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.730+0000 7f6a03ca4740 1 -- 172.21.15.37:0/716281026 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560860a0e160 con 0x560860aae990 2024-08-20T05:18:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.731+0000 7f69fa800640 1 --2- 172.21.15.37:0/716281026 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560860aae990 0x560860ab0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.732+0000 7f69fa800640 1 --2- 172.21.15.37:0/716281026 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560860aae990 0x560860ab0d80 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fea080433c0b7555 server_cookie=c1c73cda77be7c45 in_seq=0 out_seq=0 2024-08-20T05:18:24.736 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.732+0000 7f69dfe00640 10 client.29296 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.732+0000 7f69dfe00640 1 -- 172.21.15.37:0/716281026 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560860a0e160 con 0x560860aae990 2024-08-20T05:18:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.732+0000 7f69dfe00640 10 client.29296 handle_command_reply: tid=0 2024-08-20T05:18:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.733+0000 7f6a03ca4740 1 client.29296 shutdown 2024-08-20T05:18:24.737 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.733+0000 7f6a03ca4740 1 -- 172.21.15.37:0/716281026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a9bbe0 msgr2=0x560860aa3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.733+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/716281026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a9bbe0 0x560860aa3390 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f69e4005ab0 tx=0x7f69e4031d90 comp rx=0 tx=0).stop 2024-08-20T05:18:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.733+0000 7f6a03ca4740 1 -- 172.21.15.37:0/716281026 shutdown_connections 2024-08-20T05:18:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.733+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/716281026 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560860aae990 0x560860ab0d80 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.733+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/716281026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9e620 0x560860aa3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.733+0000 7f69dfe00640 0 client.29296 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.733+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/716281026 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a9bbe0 0x560860aa3390 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.733+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/716281026 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a992b0 0x560860aa2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.733+0000 7f6a03ca4740 1 -- 172.21.15.37:0/716281026 >> 172.21.15.37:0/716281026 conn(0x560860a943b0 msgr2=0x560860a934d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.733+0000 7f6a03ca4740 1 -- 172.21.15.37:0/716281026 shutdown_connections 2024-08-20T05:18:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.733+0000 7f6a03ca4740 1 -- 172.21.15.37:0/716281026 wait complete. 2024-08-20T05:18:24.738 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.733+0000 7f6a03ca4740 20 client.29296 trim_cache size 0 max 16384 2024-08-20T05:18:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.748+0000 7f6a03ca4740 1 Processor -- start 2024-08-20T05:18:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.749+0000 7f6a03ca4740 1 -- start start 2024-08-20T05:18:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.749+0000 7f6a03ca4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a992b0 0x560860aa02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.751 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.749+0000 7f6a03ca4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9bbe0 0x560860aa07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.749+0000 7f6a03ca4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a9e620 0x560860aa2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.749+0000 7f6a03ca4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc1ad500 con 0x560860a9bbe0 2024-08-20T05:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.749+0000 7f6a03ca4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc1af040 con 0x560860a992b0 2024-08-20T05:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.749+0000 7f6a03ca4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc1adbd0 con 0x560860a9e620 2024-08-20T05:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.749+0000 7f69f1400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9bbe0 0x560860aa07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.749+0000 7f69f1400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9bbe0 0x560860aa07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55016/0 (socket says 172.21.15.37:55016) 2024-08-20T05:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.749+0000 7f69f1400640 1 -- 172.21.15.37:0/3982389166 learned_addr learned my addr 172.21.15.37:0/3982389166 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.749+0000 7f69fa800640 1 --2- 172.21.15.37:0/3982389166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a992b0 0x560860aa02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.749+0000 7f69f1400640 1 -- 172.21.15.37:0/3982389166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a9e620 msgr2=0x560860aa2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.749+0000 7f69f1400640 1 --2- 172.21.15.37:0/3982389166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a9e620 0x560860aa2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.749+0000 7f69f1400640 1 -- 172.21.15.37:0/3982389166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a992b0 msgr2=0x560860aa02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.749+0000 7f69f1400640 1 --2- 172.21.15.37:0/3982389166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a992b0 0x560860aa02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.749+0000 7f69f1400640 1 -- 172.21.15.37:0/3982389166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560860ab10f0 con 0x560860a9bbe0 2024-08-20T05:18:24.752 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.750+0000 7f69f1400640 1 --2- 172.21.15.37:0/3982389166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9bbe0 0x560860aa07e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009850 tx=0x7f69e402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c20414822bc5d8e server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:24.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.750+0000 7f69eaa00640 1 -- 172.21.15.37:0/3982389166 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e4057070 con 0x560860a9bbe0 2024-08-20T05:18:24.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.750+0000 7f69eaa00640 1 -- 172.21.15.37:0/3982389166 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69e403c440 con 0x560860a9bbe0 2024-08-20T05:18:24.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.750+0000 7f69eaa00640 1 -- 172.21.15.37:0/3982389166 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e4035040 con 0x560860a9bbe0 2024-08-20T05:18:24.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.750+0000 7f6a03ca4740 1 -- 172.21.15.37:0/3982389166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9bbe0 msgr2=0x560860aa07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:24.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.750+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/3982389166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9bbe0 0x560860aa07e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009850 tx=0x7f69e402a420 comp rx=0 tx=0).stop 2024-08-20T05:18:24.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.750+0000 7f6a03ca4740 1 -- 172.21.15.37:0/3982389166 shutdown_connections 2024-08-20T05:18:24.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.750+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/3982389166 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a9e620 0x560860aa2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.750+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/3982389166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9bbe0 0x560860aa07e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.750+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/3982389166 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a992b0 0x560860aa02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.750+0000 7f6a03ca4740 1 -- 172.21.15.37:0/3982389166 >> 172.21.15.37:0/3982389166 conn(0x560860a943b0 msgr2=0x560860aa1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:24.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.751+0000 7f6a03ca4740 1 -- 172.21.15.37:0/3982389166 shutdown_connections 2024-08-20T05:18:24.756 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.751+0000 7f6a03ca4740 1 -- 172.21.15.37:0/3982389166 wait complete. 2024-08-20T05:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.751+0000 7f6a03ca4740 1 -- start start 2024-08-20T05:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.751+0000 7f6a03ca4740 1 Processor -- start 2024-08-20T05:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.751+0000 7f6a03ca4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a992b0 0x560860aa7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.751+0000 7f6a03ca4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a9bbe0 0x560860aa8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.752+0000 7f6a03ca4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9e620 0x560860aa9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.752+0000 7f6a03ca4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc1ae970 con 0x560860a9e620 2024-08-20T05:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.752+0000 7f6a03ca4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc1ae2a0 con 0x560860a992b0 2024-08-20T05:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.752+0000 7f6a03ca4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f69fc1ab4e0 con 0x560860a9bbe0 2024-08-20T05:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.752+0000 7f6a03ca4740 10 client.0 _ll_register_callbacks cb 0x7f69e4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.752+0000 7f69f1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a9bbe0 0x560860aa8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.752+0000 7f69f1400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a9bbe0 0x560860aa8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:60126/0 (socket says 172.21.15.37:60126) 2024-08-20T05:18:24.757 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.752+0000 7f69f1400640 1 -- 172.21.15.37:0/1223595637 learned_addr learned my addr 172.21.15.37:0/1223595637 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.752+0000 7f69fa800640 1 --2- 172.21.15.37:0/1223595637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a992b0 0x560860aa7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.752+0000 7f69fa800640 1 --2- 172.21.15.37:0/1223595637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9e620 0x560860aa9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.752+0000 7f69f1400640 1 -- 172.21.15.37:0/1223595637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a992b0 msgr2=0x560860aa7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.752+0000 7f69f1400640 1 --2- 172.21.15.37:0/1223595637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a992b0 0x560860aa7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.752+0000 7f69f1400640 1 -- 172.21.15.37:0/1223595637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9e620 msgr2=0x560860aa9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.752+0000 7f69f1400640 1 --2- 172.21.15.37:0/1223595637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9e620 0x560860aa9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.752+0000 7f69f1400640 1 -- 172.21.15.37:0/1223595637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608607d7620 con 0x560860a9bbe0 2024-08-20T05:18:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.752+0000 7f69fa800640 1 --2- 172.21.15.37:0/1223595637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9e620 0x560860aa9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:18:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.753+0000 7f69f1400640 1 --2- 172.21.15.37:0/1223595637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a9bbe0 0x560860aa8490 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f69e4005ec0 tx=0x7f69e4005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72b7707307931828 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.753+0000 7f69dfe00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:18:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.753+0000 7f69dfe00640 1 -- 172.21.15.37:0/1223595637 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e4057070 con 0x560860a9bbe0 2024-08-20T05:18:24.758 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.753+0000 7f6a03ca4740 1 -- 172.21.15.37:0/1223595637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69e403c440 con 0x560860a9bbe0 2024-08-20T05:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.753+0000 7f69dfe00640 1 -- 172.21.15.37:0/1223595637 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f69e4046840 con 0x560860a9bbe0 2024-08-20T05:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.753+0000 7f69dfe00640 1 -- 172.21.15.37:0/1223595637 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f69e4035040 con 0x560860a9bbe0 2024-08-20T05:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.753+0000 7f6a03ca4740 10 client.29299 fetch_fsmap learned FSMap version 54 2024-08-20T05:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.753+0000 7f6a03ca4740 1 -- 172.21.15.37:0/1223595637 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x560860aaaa80 con 0x560860a9bbe0 2024-08-20T05:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.754+0000 7f69dfe00640 1 -- 172.21.15.37:0/1223595637 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f69e403c440 con 0x560860a9bbe0 2024-08-20T05:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.754+0000 7f69dfe00640 1 -- 172.21.15.37:0/1223595637 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 54) ==== 8378+0+0 (secure 0 0 0) 0x7f69e403b9d0 con 0x560860a9bbe0 2024-08-20T05:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.754+0000 7f6a03ca4740 10 client.29299 fetch_fsmap finished waiting for FSMap version 54 2024-08-20T05:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.754+0000 7f6a03ca4740 10 client.29299 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.754+0000 7f6a03ca4740 20 client.29299 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.754+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/1223595637 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560860b196e0 0x560860b1bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.754+0000 7f6a03ca4740 4 client.29299 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.754+0000 7f6a03ca4740 1 -- 172.21.15.37:0/1223595637 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560860a09c00 con 0x560860b196e0 2024-08-20T05:18:24.759 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.754+0000 7f69fa800640 1 --2- 172.21.15.37:0/1223595637 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560860b196e0 0x560860b1bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:24.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.755+0000 7f69fa800640 1 --2- 172.21.15.37:0/1223595637 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560860b196e0 0x560860b1bad0 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=101921d5039418bc server_cookie=1d9c6ea91bd91986 in_seq=0 out_seq=0 2024-08-20T05:18:24.760 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.755+0000 7f69dfe00640 10 client.29299 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.763+0000 7f69dfe00640 1 -- 172.21.15.37:0/1223595637 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560860a09c00 con 0x560860b196e0 2024-08-20T05:18:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.763+0000 7f69dfe00640 10 client.29299 handle_command_reply: tid=0 2024-08-20T05:18:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.763+0000 7f6a03ca4740 1 client.29299 shutdown 2024-08-20T05:18:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.763+0000 7f6a03ca4740 1 -- 172.21.15.37:0/1223595637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a9bbe0 msgr2=0x560860aa8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.763+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/1223595637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a9bbe0 0x560860aa8490 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f69e4005ec0 tx=0x7f69e4005bd0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.763+0000 7f6a03ca4740 1 -- 172.21.15.37:0/1223595637 shutdown_connections 2024-08-20T05:18:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.763+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/1223595637 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x560860b196e0 0x560860b1bad0 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.763+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/1223595637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560860a9e620 0x560860aa9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.763+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/1223595637 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560860a9bbe0 0x560860aa8490 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.763+0000 7f6a03ca4740 1 --2- 172.21.15.37:0/1223595637 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560860a992b0 0x560860aa7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.763+0000 7f6a03ca4740 1 -- 172.21.15.37:0/1223595637 >> 172.21.15.37:0/1223595637 conn(0x560860a943b0 msgr2=0x560860aa02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.763+0000 7f69dfe00640 0 client.29299 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.763+0000 7f6a03ca4740 1 -- 172.21.15.37:0/1223595637 shutdown_connections 2024-08-20T05:18:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.763+0000 7f6a03ca4740 1 -- 172.21.15.37:0/1223595637 wait complete. 2024-08-20T05:18:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.763+0000 7f6a03ca4740 20 client.29299 trim_cache size 0 max 16384 2024-08-20T05:18:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:18:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:18:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:18:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:18:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.764+0000 7f6a00e00640 1 -- 172.21.15.37:0/2618324739 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f69e00b3c50 msgr2=0x7f69e00b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.764+0000 7f6a00e00640 1 --2- 172.21.15.37:0/2618324739 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f69e00b3c50 0x7f69e00b6110 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0e46d0 tx=0x7f69ec0e7e70 comp rx=0 tx=0).stop 2024-08-20T05:18:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.764+0000 7f6a00e00640 1 -- 172.21.15.37:0/2618324739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69fc102680 msgr2=0x7f69fc076a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.764+0000 7f6a00e00640 1 --2- 172.21.15.37:0/2618324739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69fc102680 0x7f69fc076a10 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00e9f0 tx=0x7f69ec00edf0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.764+0000 7f6a00e00640 1 -- 172.21.15.37:0/2618324739 shutdown_connections 2024-08-20T05:18:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.764+0000 7f6a00e00640 1 --2- 172.21.15.37:0/2618324739 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f69e00b3c50 0x7f69e00b6110 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.764+0000 7f6a00e00640 1 --2- 172.21.15.37:0/2618324739 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f69fc104190 0x7f69fc0757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.764+0000 7f6a00e00640 1 --2- 172.21.15.37:0/2618324739 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f69fc1037d0 0x7f69fc075270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.764+0000 7f6a00e00640 1 --2- 172.21.15.37:0/2618324739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69fc102680 0x7f69fc076a10 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.764+0000 7f6a00e00640 1 -- 172.21.15.37:0/2618324739 >> 172.21.15.37:0/2618324739 conn(0x7f69fc0fdf40 msgr2=0x7f69fc104b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.764+0000 7f6a00e00640 1 -- 172.21.15.37:0/2618324739 shutdown_connections 2024-08-20T05:18:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:24.764+0000 7f6a00e00640 1 -- 172.21.15.37:0/2618324739 wait complete. 2024-08-20T05:18:25.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:25 smithi037 ceph-mon[17265]: pgmap v886: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 652 KiB/s wr, 106 op/s 2024-08-20T05:18:25.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:25 smithi130 ceph-mon[22007]: pgmap v886: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 652 KiB/s wr, 106 op/s 2024-08-20T05:18:26.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:25 smithi135 ceph-mon[22342]: pgmap v886: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 652 KiB/s wr, 106 op/s 2024-08-20T05:18:27.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:27 smithi130 ceph-mon[22007]: pgmap v887: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.8 KiB/s wr, 16 op/s 2024-08-20T05:18:28.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:27 smithi037 ceph-mon[17265]: pgmap v887: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.8 KiB/s wr, 16 op/s 2024-08-20T05:18:28.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:27 smithi135 ceph-mon[22342]: pgmap v887: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.8 KiB/s wr, 16 op/s 2024-08-20T05:18:29.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:18:29.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:29 smithi130 ceph-mon[22007]: pgmap v888: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-08-20T05:18:29.968 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:18:30.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:29 smithi037 ceph-mon[17265]: pgmap v888: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-08-20T05:18:30.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:29 smithi135 ceph-mon[22342]: pgmap v888: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-08-20T05:18:30.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.532+0000 7fd14ae00640 1 -- 172.21.15.37:0/590895880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1441090e0 msgr2=0x7fd1441094c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.532+0000 7fd14ae00640 1 --2- 172.21.15.37:0/590895880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1441090e0 0x7fd1441094c0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd134009900 tx=0x7fd13402a410 comp rx=0 tx=0).stop 2024-08-20T05:18:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.532+0000 7fd14ae00640 1 -- 172.21.15.37:0/590895880 shutdown_connections 2024-08-20T05:18:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.532+0000 7fd14ae00640 1 --2- 172.21.15.37:0/590895880 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd14410f470 0x7fd144115c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.532+0000 7fd14ae00640 1 --2- 172.21.15.37:0/590895880 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd14410eaf0 0x7fd14410ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.532+0000 7fd14ae00640 1 --2- 172.21.15.37:0/590895880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1441090e0 0x7fd1441094c0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.532+0000 7fd14ae00640 1 -- 172.21.15.37:0/590895880 >> 172.21.15.37:0/590895880 conn(0x7fd144078760 msgr2=0x7fd14407ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.532+0000 7fd14ae00640 1 -- 172.21.15.37:0/590895880 shutdown_connections 2024-08-20T05:18:30.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.532+0000 7fd14ae00640 1 -- 172.21.15.37:0/590895880 wait complete. 2024-08-20T05:18:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.533+0000 7fd14ae00640 1 Processor -- start 2024-08-20T05:18:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.533+0000 7fd14ae00640 1 -- start start 2024-08-20T05:18:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.534+0000 7fd14ae00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1441090e0 0x7fd14419f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.534+0000 7fd14ae00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd14410eaf0 0x7fd14419fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.534+0000 7fd14ae00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14410f470 0x7fd1441a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.534+0000 7fd14ae00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd1441190f0 con 0x7fd14410f470 2024-08-20T05:18:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.534+0000 7fd14ae00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd144118f70 con 0x7fd1441090e0 2024-08-20T05:18:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.534+0000 7fd14ae00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd144119270 con 0x7fd14410eaf0 2024-08-20T05:18:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.534+0000 7fd148e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14410f470 0x7fd1441a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.534+0000 7fd148e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14410f470 0x7fd1441a4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55046/0 (socket says 172.21.15.37:55046) 2024-08-20T05:18:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.534+0000 7fd148e00640 1 -- 172.21.15.37:0/2223745892 learned_addr learned my addr 172.21.15.37:0/2223745892 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.534+0000 7fd143e00640 1 --2- 172.21.15.37:0/2223745892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1441090e0 0x7fd14419f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.534+0000 7fd13b400640 1 --2- 172.21.15.37:0/2223745892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd14410eaf0 0x7fd14419fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.534+0000 7fd148e00640 1 -- 172.21.15.37:0/2223745892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd14410eaf0 msgr2=0x7fd14419fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.534+0000 7fd148e00640 1 --2- 172.21.15.37:0/2223745892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd14410eaf0 0x7fd14419fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.534+0000 7fd148e00640 1 -- 172.21.15.37:0/2223745892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1441090e0 msgr2=0x7fd14419f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.534+0000 7fd148e00640 1 --2- 172.21.15.37:0/2223745892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1441090e0 0x7fd14419f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.535+0000 7fd148e00640 1 -- 172.21.15.37:0/2223745892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1441a5670 con 0x7fd14410f470 2024-08-20T05:18:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.535+0000 7fd148e00640 1 --2- 172.21.15.37:0/2223745892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14410f470 0x7fd1441a4ea0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00eb10 tx=0x7fd13c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.535+0000 7fd141600640 1 -- 172.21.15.37:0/2223745892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c004b20 con 0x7fd14410f470 2024-08-20T05:18:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.535+0000 7fd141600640 1 -- 172.21.15.37:0/2223745892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd13c004cc0 con 0x7fd14410f470 2024-08-20T05:18:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.535+0000 7fd14ae00640 1 -- 172.21.15.37:0/2223745892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1441a5960 con 0x7fd14410f470 2024-08-20T05:18:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.535+0000 7fd141600640 1 -- 172.21.15.37:0/2223745892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd13c010670 con 0x7fd14410f470 2024-08-20T05:18:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.535+0000 7fd14ae00640 1 -- 172.21.15.37:0/2223745892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1441ac020 con 0x7fd14410f470 2024-08-20T05:18:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.536+0000 7fd14ae00640 1 -- 172.21.15.37:0/2223745892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1441094c0 con 0x7fd14410f470 2024-08-20T05:18:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.539+0000 7fd141600640 1 -- 172.21.15.37:0/2223745892 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd13c005020 con 0x7fd14410f470 2024-08-20T05:18:30.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.540+0000 7fd141600640 1 --2- 172.21.15.37:0/2223745892 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd1280b3bd0 0x7fd1280b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:30.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.540+0000 7fd141600640 1 -- 172.21.15.37:0/2223745892 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd13c0e4580 con 0x7fd14410f470 2024-08-20T05:18:30.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.540+0000 7fd143e00640 1 --2- 172.21.15.37:0/2223745892 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd1280b3bd0 0x7fd1280b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:30.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.541+0000 7fd143e00640 1 --2- 172.21.15.37:0/2223745892 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd1280b3bd0 0x7fd1280b6090 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd134005ab0 tx=0x7fd134005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:30.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.544+0000 7fd141600640 1 -- 172.21.15.37:0/2223745892 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fd13c0ab7d0 con 0x7fd14410f470 2024-08-20T05:18:30.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.776+0000 7fd14ae00640 1 -- 172.21.15.37:0/2223745892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd14402e340 con 0x7fd14410f470 2024-08-20T05:18:30.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.777+0000 7fd141600640 1 -- 172.21.15.37:0/2223745892 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+11983 (secure 0 0 0) 0x7fd13c0ab0d0 con 0x7fd14410f470 2024-08-20T05:18:30.779 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:30.779 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":54,"btime":"2024-08-20T05:18:09:624585+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:18:08.860273+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:18:30.779 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 54 2024-08-20T05:18:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.779+0000 7fd14ae00640 1 -- 172.21.15.37:0/2223745892 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd1280b3bd0 msgr2=0x7fd1280b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.779+0000 7fd14ae00640 1 --2- 172.21.15.37:0/2223745892 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd1280b3bd0 0x7fd1280b6090 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fd134005ab0 tx=0x7fd134005a20 comp rx=0 tx=0).stop 2024-08-20T05:18:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.779+0000 7fd14ae00640 1 -- 172.21.15.37:0/2223745892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14410f470 msgr2=0x7fd1441a4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.779+0000 7fd14ae00640 1 --2- 172.21.15.37:0/2223745892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14410f470 0x7fd1441a4ea0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00eb10 tx=0x7fd13c00c2d0 comp rx=0 tx=0).stop 2024-08-20T05:18:30.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.779+0000 7fd14ae00640 1 -- 172.21.15.37:0/2223745892 shutdown_connections 2024-08-20T05:18:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.779+0000 7fd14ae00640 1 --2- 172.21.15.37:0/2223745892 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd1280b3bd0 0x7fd1280b6090 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.779+0000 7fd14ae00640 1 --2- 172.21.15.37:0/2223745892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd14410f470 0x7fd1441a4ea0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.779+0000 7fd14ae00640 1 --2- 172.21.15.37:0/2223745892 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd14410eaf0 0x7fd14419fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.779+0000 7fd14ae00640 1 --2- 172.21.15.37:0/2223745892 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd1441090e0 0x7fd14419f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.779+0000 7fd14ae00640 1 -- 172.21.15.37:0/2223745892 >> 172.21.15.37:0/2223745892 conn(0x7fd144078760 msgr2=0x7fd144078fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.779+0000 7fd14ae00640 1 -- 172.21.15.37:0/2223745892 shutdown_connections 2024-08-20T05:18:30.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:30.779+0000 7fd14ae00640 1 -- 172.21.15.37:0/2223745892 wait complete. 2024-08-20T05:18:31.699 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --set-id f5944875 --release --await' 2024-08-20T05:18:31.699 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --set-id f5944875 --release --await 2024-08-20T05:18:31.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:31 smithi130 ceph-mon[22007]: pgmap v889: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2024-08-20T05:18:31.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:31 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2223745892' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:18:32.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:31 smithi037 ceph-mon[17265]: pgmap v889: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2024-08-20T05:18:32.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:31 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2223745892' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:18:32.083 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:18:32.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:31 smithi135 ceph-mon[22342]: pgmap v889: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2024-08-20T05:18:32.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:31 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2223745892' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:18:32.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.741+0000 7fb966c00640 1 -- 172.21.15.37:0/2780245116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb960104ca0 msgr2=0x7fb960105080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:32.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.741+0000 7fb966c00640 1 --2- 172.21.15.37:0/2780245116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb960104ca0 0x7fb960105080 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fb950009900 tx=0x7fb95002a410 comp rx=0 tx=0).stop 2024-08-20T05:18:32.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.741+0000 7fb966c00640 1 -- 172.21.15.37:0/2780245116 shutdown_connections 2024-08-20T05:18:32.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.741+0000 7fb966c00640 1 --2- 172.21.15.37:0/2780245116 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb96010b030 0x7fb960111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.741+0000 7fb966c00640 1 --2- 172.21.15.37:0/2780245116 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb96010a6b0 0x7fb96010aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.741+0000 7fb966c00640 1 --2- 172.21.15.37:0/2780245116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb960104ca0 0x7fb960105080 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.741+0000 7fb966c00640 1 -- 172.21.15.37:0/2780245116 >> 172.21.15.37:0/2780245116 conn(0x7fb960100730 msgr2=0x7fb960102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:32.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.741+0000 7fb966c00640 1 -- 172.21.15.37:0/2780245116 shutdown_connections 2024-08-20T05:18:32.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.741+0000 7fb966c00640 1 -- 172.21.15.37:0/2780245116 wait complete. 2024-08-20T05:18:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.742+0000 7fb966c00640 1 Processor -- start 2024-08-20T05:18:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.742+0000 7fb966c00640 1 -- start start 2024-08-20T05:18:32.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.743+0000 7fb966c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb960104ca0 0x7fb96019b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.743+0000 7fb966c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb96010a6b0 0x7fb96019b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.743+0000 7fb966c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96010b030 0x7fb9601a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.743+0000 7fb966c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb960114cf0 con 0x7fb96010b030 2024-08-20T05:18:32.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.743+0000 7fb966c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb960114b70 con 0x7fb960104ca0 2024-08-20T05:18:32.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.743+0000 7fb966c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb960114e70 con 0x7fb96010a6b0 2024-08-20T05:18:32.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.743+0000 7fb964c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96010b030 0x7fb9601a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.743+0000 7fb95fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb960104ca0 0x7fb96019b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.743+0000 7fb964c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96010b030 0x7fb9601a0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55062/0 (socket says 172.21.15.37:55062) 2024-08-20T05:18:32.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.743+0000 7fb964c00640 1 -- 172.21.15.37:0/1974732211 learned_addr learned my addr 172.21.15.37:0/1974732211 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:32.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.743+0000 7fb95f400640 1 --2- 172.21.15.37:0/1974732211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb96010a6b0 0x7fb96019b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.744+0000 7fb964c00640 1 -- 172.21.15.37:0/1974732211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb96010a6b0 msgr2=0x7fb96019b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:32.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.744+0000 7fb964c00640 1 --2- 172.21.15.37:0/1974732211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb96010a6b0 0x7fb96019b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.744+0000 7fb964c00640 1 -- 172.21.15.37:0/1974732211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb960104ca0 msgr2=0x7fb96019b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:32.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.744+0000 7fb964c00640 1 --2- 172.21.15.37:0/1974732211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb960104ca0 0x7fb96019b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.744+0000 7fb964c00640 1 -- 172.21.15.37:0/1974732211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9601a12b0 con 0x7fb96010b030 2024-08-20T05:18:32.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.744+0000 7fb964c00640 1 --2- 172.21.15.37:0/1974732211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96010b030 0x7fb9601a0ae0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb95800eaa0 tx=0x7fb95800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:32.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.744+0000 7fb95cc00640 1 -- 172.21.15.37:0/1974732211 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95800cdb0 con 0x7fb96010b030 2024-08-20T05:18:32.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.744+0000 7fb95cc00640 1 -- 172.21.15.37:0/1974732211 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb958005020 con 0x7fb96010b030 2024-08-20T05:18:32.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.744+0000 7fb95cc00640 1 -- 172.21.15.37:0/1974732211 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9580116d0 con 0x7fb96010b030 2024-08-20T05:18:32.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.744+0000 7fb966c00640 1 -- 172.21.15.37:0/1974732211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9601a15a0 con 0x7fb96010b030 2024-08-20T05:18:32.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.745+0000 7fb966c00640 1 -- 172.21.15.37:0/1974732211 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9601a7c60 con 0x7fb96010b030 2024-08-20T05:18:32.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.747+0000 7fb9697e4740 1 Processor -- start 2024-08-20T05:18:32.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.748+0000 7fb95cc00640 1 -- 172.21.15.37:0/1974732211 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fb9580051d0 con 0x7fb96010b030 2024-08-20T05:18:32.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.748+0000 7fb9697e4740 1 -- start start 2024-08-20T05:18:32.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.748+0000 7fb9697e4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3bcf0 0x5570beb3c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.748+0000 7fb9697e4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb3c610 0x5570beb48060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.748+0000 7fb9697e4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb485a0 0x5570beb4a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.748+0000 7fb9697e4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5570beadd670 con 0x5570beb485a0 2024-08-20T05:18:32.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.748+0000 7fb9697e4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5570beab1d70 con 0x5570beb3c610 2024-08-20T05:18:32.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.748+0000 7fb9697e4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5570beaa1270 con 0x5570beb3bcf0 2024-08-20T05:18:32.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.749+0000 7fb95fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb3c610 0x5570beb48060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.749+0000 7fb95f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3bcf0 0x5570beb3c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.749+0000 7fb95fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb3c610 0x5570beb48060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:45450/0 (socket says 172.21.15.37:45450) 2024-08-20T05:18:32.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.749+0000 7fb95fe00640 1 -- 172.21.15.37:0/4046215501 learned_addr learned my addr 172.21.15.37:0/4046215501 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:32.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.749+0000 7fb95f400640 1 --2- 172.21.15.37:0/4046215501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb485a0 0x5570beb4a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.749+0000 7fb95fe00640 1 -- 172.21.15.37:0/4046215501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3bcf0 msgr2=0x5570beb3c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:32.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.749+0000 7fb95fe00640 1 --2- 172.21.15.37:0/4046215501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3bcf0 0x5570beb3c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.749+0000 7fb95fe00640 1 -- 172.21.15.37:0/4046215501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb485a0 msgr2=0x5570beb4a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:32.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.749+0000 7fb95fe00640 1 --2- 172.21.15.37:0/4046215501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb485a0 0x5570beb4a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.749+0000 7fb95fe00640 1 -- 172.21.15.37:0/4046215501 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570bea3d870 con 0x5570beb3c610 2024-08-20T05:18:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.750+0000 7fb95fe00640 1 --2- 172.21.15.37:0/4046215501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb3c610 0x5570beb48060 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb950009900 tx=0x7fb950032bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d91233440f820cce server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.750+0000 7fb95cc00640 1 --2- 172.21.15.37:0/1974732211 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb9440b3bd0 0x7fb9440b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.750+0000 7fb95cc00640 1 -- 172.21.15.37:0/1974732211 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb9580e4090 con 0x7fb96010b030 2024-08-20T05:18:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.750+0000 7fb955200640 1 -- 172.21.15.37:0/4046215501 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950040070 con 0x5570beb3c610 2024-08-20T05:18:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.750+0000 7fb95f400640 1 --2- 172.21.15.37:0/1974732211 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb9440b3bd0 0x7fb9440b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.750+0000 7fb955200640 1 -- 172.21.15.37:0/4046215501 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb950004030 con 0x5570beb3c610 2024-08-20T05:18:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.750+0000 7fb955200640 1 -- 172.21.15.37:0/4046215501 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950035040 con 0x5570beb3c610 2024-08-20T05:18:32.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.751+0000 7fb9697e4740 1 -- 172.21.15.37:0/4046215501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb3c610 msgr2=0x5570beb48060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:32.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.751+0000 7fb95f400640 1 --2- 172.21.15.37:0/1974732211 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb9440b3bd0 0x7fb9440b6090 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb960109e50 tx=0x7fb94c004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:32.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.751+0000 7fb9697e4740 1 --2- 172.21.15.37:0/4046215501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb3c610 0x5570beb48060 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb950009900 tx=0x7fb950032bd0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.751+0000 7fb9697e4740 1 -- 172.21.15.37:0/4046215501 shutdown_connections 2024-08-20T05:18:32.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.751+0000 7fb9697e4740 1 --2- 172.21.15.37:0/4046215501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb485a0 0x5570beb4a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.751+0000 7fb9697e4740 1 --2- 172.21.15.37:0/4046215501 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb3c610 0x5570beb48060 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.751+0000 7fb9697e4740 1 --2- 172.21.15.37:0/4046215501 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3bcf0 0x5570beb3c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.751+0000 7fb9697e4740 1 -- 172.21.15.37:0/4046215501 >> 172.21.15.37:0/4046215501 conn(0x5570beb39b20 msgr2=0x5570beb3acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:32.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.751+0000 7fb9697e4740 1 -- 172.21.15.37:0/4046215501 shutdown_connections 2024-08-20T05:18:32.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.751+0000 7fb9697e4740 1 -- 172.21.15.37:0/4046215501 wait complete. 2024-08-20T05:18:32.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.752+0000 7fb9697e4740 1 -- start start 2024-08-20T05:18:32.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.752+0000 7fb9697e4740 1 Processor -- start 2024-08-20T05:18:32.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.752+0000 7fb9697e4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb3bcf0 0x5570beb47d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.752+0000 7fb9697e4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3c610 0x5570beb451d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.752+0000 7fb9697e4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb485a0 0x5570beb45710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.752+0000 7fb9697e4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5570bea27ff0 con 0x5570beb3bcf0 2024-08-20T05:18:32.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.752+0000 7fb9697e4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5570beaa52b0 con 0x5570beb485a0 2024-08-20T05:18:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.752+0000 7fb9697e4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5570be903bb0 con 0x5570beb3c610 2024-08-20T05:18:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.753+0000 7fb9697e4740 10 client.0 _ll_register_callbacks cb 0x5570be7acd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.753+0000 7fb95fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb3bcf0 0x5570beb47d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.753+0000 7fb95f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3c610 0x5570beb451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.753+0000 7fb95fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb3bcf0 0x5570beb47d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55090/0 (socket says 172.21.15.37:55090) 2024-08-20T05:18:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.753+0000 7fb95fe00640 1 -- 172.21.15.37:0/104924727 learned_addr learned my addr 172.21.15.37:0/104924727 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.753+0000 7fb964c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb485a0 0x5570beb45710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.753+0000 7fb964c00640 1 -- 172.21.15.37:0/104924727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3c610 msgr2=0x5570beb451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.753+0000 7fb964c00640 1 --2- 172.21.15.37:0/104924727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3c610 0x5570beb451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.753+0000 7fb964c00640 1 -- 172.21.15.37:0/104924727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb3bcf0 msgr2=0x5570beb47d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.753+0000 7fb964c00640 1 --2- 172.21.15.37:0/104924727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb3bcf0 0x5570beb47d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.753+0000 7fb964c00640 1 -- 172.21.15.37:0/104924727 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570be800b00 con 0x5570beb485a0 2024-08-20T05:18:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.753+0000 7fb95f400640 1 --2- 172.21.15.37:0/104924727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3c610 0x5570beb451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.754+0000 7fb964c00640 1 --2- 172.21.15.37:0/104924727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb485a0 0x5570beb45710 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb9580a7f00 tx=0x7fb9580aa820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d71ceb0dfab0414 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.754+0000 7fb949600640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:18:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.754+0000 7fb949600640 1 -- 172.21.15.37:0/104924727 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95801f040 con 0x5570beb485a0 2024-08-20T05:18:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.754+0000 7fb9697e4740 1 -- 172.21.15.37:0/104924727 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb950004030 con 0x5570beb485a0 2024-08-20T05:18:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.754+0000 7fb949600640 1 -- 172.21.15.37:0/104924727 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb9580a9ef0 con 0x5570beb485a0 2024-08-20T05:18:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.754+0000 7fb949600640 1 -- 172.21.15.37:0/104924727 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fb9580b3c90 con 0x5570beb485a0 2024-08-20T05:18:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.754+0000 7fb9697e4740 10 client.29306 fetch_fsmap learned FSMap version 54 2024-08-20T05:18:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.754+0000 7fb9697e4740 1 -- 172.21.15.37:0/104924727 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5570be877960 con 0x5570beb485a0 2024-08-20T05:18:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.754+0000 7fb949600640 1 -- 172.21.15.37:0/104924727 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb950004030 con 0x5570beb485a0 2024-08-20T05:18:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.755+0000 7fb949600640 1 -- 172.21.15.37:0/104924727 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 54) ==== 8378+0+0 (secure 0 0 0) 0x7fb95800f040 con 0x5570beb485a0 2024-08-20T05:18:32.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.755+0000 7fb9697e4740 10 client.29306 fetch_fsmap finished waiting for FSMap version 54 2024-08-20T05:18:32.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.755+0000 7fb9697e4740 10 client.29306 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:18:32.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.755+0000 7fb9697e4740 20 client.29306 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:32.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.755+0000 7fb9697e4740 1 --2- 172.21.15.37:0/104924727 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5570beb57be0 0x5570beb5a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.755+0000 7fb9697e4740 4 client.29306 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:18:32.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.755+0000 7fb9697e4740 1 -- 172.21.15.37:0/104924727 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5570beab3cc0 con 0x5570beb57be0 2024-08-20T05:18:32.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.755+0000 7fb95fe00640 1 --2- 172.21.15.37:0/104924727 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5570beb57be0 0x5570beb5a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.756+0000 7fb95fe00640 1 --2- 172.21.15.37:0/104924727 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5570beb57be0 0x5570beb5a040 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f521d6192c5abd74 server_cookie=2dc53741264c01e in_seq=0 out_seq=0 2024-08-20T05:18:32.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.756+0000 7fb949600640 10 client.29306 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:32.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.757+0000 7fb949600640 1 -- 172.21.15.37:0/104924727 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5570beab3cc0 con 0x5570beb57be0 2024-08-20T05:18:32.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.757+0000 7fb949600640 10 client.29306 handle_command_reply: tid=0 2024-08-20T05:18:32.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.757+0000 7fb9697e4740 1 client.29306 shutdown 2024-08-20T05:18:32.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.757+0000 7fb9697e4740 1 -- 172.21.15.37:0/104924727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb485a0 msgr2=0x5570beb45710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:32.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.757+0000 7fb9697e4740 1 --2- 172.21.15.37:0/104924727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb485a0 0x5570beb45710 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb9580a7f00 tx=0x7fb9580aa820 comp rx=0 tx=0).stop 2024-08-20T05:18:32.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.757+0000 7fb9697e4740 1 -- 172.21.15.37:0/104924727 shutdown_connections 2024-08-20T05:18:32.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.757+0000 7fb9697e4740 1 --2- 172.21.15.37:0/104924727 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5570beb57be0 0x5570beb5a040 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.757+0000 7fb9697e4740 1 --2- 172.21.15.37:0/104924727 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb485a0 0x5570beb45710 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.757+0000 7fb9697e4740 1 --2- 172.21.15.37:0/104924727 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3c610 0x5570beb451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.757+0000 7fb949600640 0 client.29306 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:32.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.757+0000 7fb9697e4740 1 --2- 172.21.15.37:0/104924727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb3bcf0 0x5570beb47d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.757+0000 7fb9697e4740 1 -- 172.21.15.37:0/104924727 >> 172.21.15.37:0/104924727 conn(0x5570beb39b20 msgr2=0x5570beb3f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:32.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.757+0000 7fb9697e4740 1 -- 172.21.15.37:0/104924727 shutdown_connections 2024-08-20T05:18:32.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.757+0000 7fb9697e4740 1 -- 172.21.15.37:0/104924727 wait complete. 2024-08-20T05:18:32.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.757+0000 7fb9697e4740 20 client.29306 trim_cache size 0 max 16384 2024-08-20T05:18:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.775+0000 7fb9697e4740 1 Processor -- start 2024-08-20T05:18:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.775+0000 7fb9697e4740 1 -- start start 2024-08-20T05:18:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.776+0000 7fb9697e4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3bcf0 0x5570beb54190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.776+0000 7fb9697e4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb3c610 0x5570beb46f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.776+0000 7fb9697e4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb485a0 0x5570beb5f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.776+0000 7fb9697e4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb9601b1a70 con 0x5570beb485a0 2024-08-20T05:18:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.776+0000 7fb9697e4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb9601b35b0 con 0x5570beb3c610 2024-08-20T05:18:32.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.776+0000 7fb9697e4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb9601b2140 con 0x5570beb3bcf0 2024-08-20T05:18:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.776+0000 7fb964c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb485a0 0x5570beb5f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.776+0000 7fb964c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb485a0 0x5570beb5f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55102/0 (socket says 172.21.15.37:55102) 2024-08-20T05:18:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.776+0000 7fb964c00640 1 -- 172.21.15.37:0/2177638523 learned_addr learned my addr 172.21.15.37:0/2177638523 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.776+0000 7fb95fe00640 1 --2- 172.21.15.37:0/2177638523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3bcf0 0x5570beb54190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.776+0000 7fb95f400640 1 --2- 172.21.15.37:0/2177638523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb3c610 0x5570beb46f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.776+0000 7fb964c00640 1 -- 172.21.15.37:0/2177638523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3bcf0 msgr2=0x5570beb54190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.776+0000 7fb964c00640 1 --2- 172.21.15.37:0/2177638523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3bcf0 0x5570beb54190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.776+0000 7fb964c00640 1 -- 172.21.15.37:0/2177638523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb3c610 msgr2=0x5570beb46f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.776+0000 7fb964c00640 1 --2- 172.21.15.37:0/2177638523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb3c610 0x5570beb46f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.776+0000 7fb964c00640 1 -- 172.21.15.37:0/2177638523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570beb480f0 con 0x5570beb485a0 2024-08-20T05:18:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.777+0000 7fb964c00640 1 --2- 172.21.15.37:0/2177638523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb485a0 0x5570beb5f910 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb9580c7040 tx=0x7fb958000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7431e9cb214ae17 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.777+0000 7fb94be00640 1 -- 172.21.15.37:0/2177638523 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95801f070 con 0x5570beb485a0 2024-08-20T05:18:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.777+0000 7fb94be00640 1 -- 172.21.15.37:0/2177638523 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb958089070 con 0x5570beb485a0 2024-08-20T05:18:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.777+0000 7fb94be00640 1 -- 172.21.15.37:0/2177638523 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9580c5370 con 0x5570beb485a0 2024-08-20T05:18:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.778+0000 7fb9697e4740 1 -- 172.21.15.37:0/2177638523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb485a0 msgr2=0x5570beb5f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.778+0000 7fb9697e4740 1 --2- 172.21.15.37:0/2177638523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb485a0 0x5570beb5f910 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fb9580c7040 tx=0x7fb958000f40 comp rx=0 tx=0).stop 2024-08-20T05:18:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.778+0000 7fb9697e4740 1 -- 172.21.15.37:0/2177638523 shutdown_connections 2024-08-20T05:18:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.778+0000 7fb9697e4740 1 --2- 172.21.15.37:0/2177638523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb485a0 0x5570beb5f910 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.778+0000 7fb9697e4740 1 --2- 172.21.15.37:0/2177638523 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb3c610 0x5570beb46f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.778+0000 7fb9697e4740 1 --2- 172.21.15.37:0/2177638523 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3bcf0 0x5570beb54190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.778+0000 7fb9697e4740 1 -- 172.21.15.37:0/2177638523 >> 172.21.15.37:0/2177638523 conn(0x5570beb39b20 msgr2=0x5570beb46800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.778+0000 7fb9697e4740 1 -- 172.21.15.37:0/2177638523 shutdown_connections 2024-08-20T05:18:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.778+0000 7fb9697e4740 1 -- 172.21.15.37:0/2177638523 wait complete. 2024-08-20T05:18:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.778+0000 7fb9697e4740 1 -- start start 2024-08-20T05:18:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.778+0000 7fb9697e4740 1 Processor -- start 2024-08-20T05:18:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.779+0000 7fb9697e4740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3bcf0 0x5570beb50a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.779+0000 7fb9697e4740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb3c610 0x5570beb4bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.779+0000 7fb9697e4740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb485a0 0x5570beb4c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.779+0000 7fb9697e4740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb9601b2ee0 con 0x5570beb3c610 2024-08-20T05:18:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.779+0000 7fb9697e4740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fb9601b2810 con 0x5570beb485a0 2024-08-20T05:18:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.779+0000 7fb9697e4740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fb9601afa50 con 0x5570beb3bcf0 2024-08-20T05:18:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.779+0000 7fb9697e4740 10 client.0 _ll_register_callbacks cb 0x7fb9580a6bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.779+0000 7fb95f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb3c610 0x5570beb4bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.779+0000 7fb95fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3bcf0 0x5570beb50a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.779+0000 7fb95fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3bcf0 0x5570beb50a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:60220/0 (socket says 172.21.15.37:60220) 2024-08-20T05:18:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.779+0000 7fb95fe00640 1 -- 172.21.15.37:0/1684535788 learned_addr learned my addr 172.21.15.37:0/1684535788 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.779+0000 7fb964c00640 1 --2- 172.21.15.37:0/1684535788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb485a0 0x5570beb4c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.780+0000 7fb95fe00640 1 -- 172.21.15.37:0/1684535788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb485a0 msgr2=0x5570beb4c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.780+0000 7fb95fe00640 1 --2- 172.21.15.37:0/1684535788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb485a0 0x5570beb4c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.780+0000 7fb95fe00640 1 -- 172.21.15.37:0/1684535788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb3c610 msgr2=0x5570beb4bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.780+0000 7fb95fe00640 1 --2- 172.21.15.37:0/1684535788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb3c610 0x5570beb4bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.780+0000 7fb95fe00640 1 -- 172.21.15.37:0/1684535788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570beb4cd20 con 0x5570beb3bcf0 2024-08-20T05:18:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.780+0000 7fb95fe00640 1 --2- 172.21.15.37:0/1684535788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3bcf0 0x5570beb50a40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb950009900 tx=0x7fb950032d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a848a60fd1fffe4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.780+0000 7fb949600640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:18:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.780+0000 7fb949600640 1 -- 172.21.15.37:0/1684535788 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95005c060 con 0x5570beb3bcf0 2024-08-20T05:18:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.780+0000 7fb949600640 1 -- 172.21.15.37:0/1684535788 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fb9500053e0 con 0x5570beb3bcf0 2024-08-20T05:18:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.780+0000 7fb9697e4740 1 -- 172.21.15.37:0/1684535788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb958089070 con 0x5570beb3bcf0 2024-08-20T05:18:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.781+0000 7fb949600640 1 -- 172.21.15.37:0/1684535788 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fb950063050 con 0x5570beb3bcf0 2024-08-20T05:18:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.781+0000 7fb9697e4740 10 client.29323 fetch_fsmap learned FSMap version 54 2024-08-20T05:18:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.781+0000 7fb9697e4740 1 -- 172.21.15.37:0/1684535788 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x5570bebc2a50 con 0x5570beb3bcf0 2024-08-20T05:18:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.781+0000 7fb949600640 1 -- 172.21.15.37:0/1684535788 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb958089070 con 0x5570beb3bcf0 2024-08-20T05:18:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.781+0000 7fb949600640 1 -- 172.21.15.37:0/1684535788 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 54) ==== 8378+0+0 (secure 0 0 0) 0x7fb950056070 con 0x5570beb3bcf0 2024-08-20T05:18:32.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.781+0000 7fb9697e4740 10 client.29323 fetch_fsmap finished waiting for FSMap version 54 2024-08-20T05:18:32.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.781+0000 7fb9697e4740 10 client.29323 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:18:32.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.781+0000 7fb9697e4740 20 client.29323 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:32.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.781+0000 7fb9697e4740 1 --2- 172.21.15.37:0/1684535788 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5570bebc2d90 0x5570bebc5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:32.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.781+0000 7fb9697e4740 4 client.29323 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f5944875", "release": true, "await": true}] 2024-08-20T05:18:32.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.781+0000 7fb9697e4740 1 -- 172.21.15.37:0/1684535788 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f5944875", "release": true, "await": true}) -- 0x5570beaaf760 con 0x5570bebc2d90 2024-08-20T05:18:32.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.781+0000 7fb95f400640 1 --2- 172.21.15.37:0/1684535788 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5570bebc2d90 0x5570bebc5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:32.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.782+0000 7fb95f400640 1 --2- 172.21.15.37:0/1684535788 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5570bebc2d90 0x5570bebc5180 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64b1e43ea339a519 server_cookie=cf45dd2daa639cc0 in_seq=0 out_seq=0 2024-08-20T05:18:32.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.782+0000 7fb949600640 10 client.29323 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.802+0000 7fb949600640 1 -- 172.21.15.37:0/1684535788 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5570beaaf760 con 0x5570bebc2d90 2024-08-20T05:18:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.802+0000 7fb949600640 10 client.29323 handle_command_reply: tid=0 2024-08-20T05:18:32.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.802+0000 7fb9697e4740 1 client.29323 shutdown 2024-08-20T05:18:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.802+0000 7fb9697e4740 1 -- 172.21.15.37:0/1684535788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3bcf0 msgr2=0x5570beb50a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.802+0000 7fb9697e4740 1 --2- 172.21.15.37:0/1684535788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3bcf0 0x5570beb50a40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fb950009900 tx=0x7fb950032d40 comp rx=0 tx=0).stop 2024-08-20T05:18:32.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.803+0000 7fb9697e4740 1 -- 172.21.15.37:0/1684535788 shutdown_connections 2024-08-20T05:18:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.803+0000 7fb9697e4740 1 --2- 172.21.15.37:0/1684535788 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5570bebc2d90 0x5570bebc5180 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.803+0000 7fb9697e4740 1 --2- 172.21.15.37:0/1684535788 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5570beb485a0 0x5570beb4c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.803+0000 7fb9697e4740 1 --2- 172.21.15.37:0/1684535788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5570beb3c610 0x5570beb4bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.803+0000 7fb949600640 0 client.29323 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.803+0000 7fb9697e4740 1 --2- 172.21.15.37:0/1684535788 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5570beb3bcf0 0x5570beb50a40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.803+0000 7fb9697e4740 1 -- 172.21.15.37:0/1684535788 >> 172.21.15.37:0/1684535788 conn(0x5570beb39b20 msgr2=0x5570beb47020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.803+0000 7fb9697e4740 1 -- 172.21.15.37:0/1684535788 shutdown_connections 2024-08-20T05:18:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.803+0000 7fb9697e4740 1 -- 172.21.15.37:0/1684535788 wait complete. 2024-08-20T05:18:32.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.803+0000 7fb9697e4740 20 client.29323 trim_cache size 0 max 16384 2024-08-20T05:18:32.807 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:18:32.807 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 54, 2024-08-20T05:18:32.807 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:18:32.807 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 60, 2024-08-20T05:18:32.807 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": { 2024-08-20T05:18:32.807 INFO:teuthology.orchestra.run.smithi037.stdout: "f5944875": { 2024-08-20T05:18:32.807 INFO:teuthology.orchestra.run.smithi037.stdout: "version": 60, 2024-08-20T05:18:32.807 INFO:teuthology.orchestra.run.smithi037.stdout: "age_ref": 0.0, 2024-08-20T05:18:32.807 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:18:32.807 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:18:32.807 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:18:32.807 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:32.808 INFO:teuthology.orchestra.run.smithi037.stdout: "timeout": 90.0, 2024-08-20T05:18:32.808 INFO:teuthology.orchestra.run.smithi037.stdout: "expiration": 146.6, 2024-08-20T05:18:32.808 INFO:teuthology.orchestra.run.smithi037.stdout: "members": { 2024-08-20T05:18:32.808 INFO:teuthology.orchestra.run.smithi037.stdout: "file:/": { 2024-08-20T05:18:32.808 INFO:teuthology.orchestra.run.smithi037.stdout: "excluded": false, 2024-08-20T05:18:32.808 INFO:teuthology.orchestra.run.smithi037.stdout: "state": { 2024-08-20T05:18:32.808 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RELEASED", 2024-08-20T05:18:32.808 INFO:teuthology.orchestra.run.smithi037.stdout: "age": 0.0 2024-08-20T05:18:32.808 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:32.808 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:32.808 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:32.808 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:32.808 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:32.808 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:18:32.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.804+0000 7fb966c00640 1 -- 172.21.15.37:0/1974732211 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb9440b3bd0 msgr2=0x7fb9440b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:32.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.804+0000 7fb966c00640 1 --2- 172.21.15.37:0/1974732211 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb9440b3bd0 0x7fb9440b6090 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb960109e50 tx=0x7fb94c004730 comp rx=0 tx=0).stop 2024-08-20T05:18:32.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.804+0000 7fb966c00640 1 -- 172.21.15.37:0/1974732211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96010b030 msgr2=0x7fb9601a0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:32.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.804+0000 7fb966c00640 1 --2- 172.21.15.37:0/1974732211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96010b030 0x7fb9601a0ae0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb95800eaa0 tx=0x7fb95800ef60 comp rx=0 tx=0).stop 2024-08-20T05:18:32.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.804+0000 7fb966c00640 1 -- 172.21.15.37:0/1974732211 shutdown_connections 2024-08-20T05:18:32.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.804+0000 7fb966c00640 1 --2- 172.21.15.37:0/1974732211 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fb9440b3bd0 0x7fb9440b6090 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.804+0000 7fb966c00640 1 --2- 172.21.15.37:0/1974732211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb96010b030 0x7fb9601a0ae0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.804+0000 7fb966c00640 1 --2- 172.21.15.37:0/1974732211 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fb96010a6b0 0x7fb96019b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.804+0000 7fb966c00640 1 --2- 172.21.15.37:0/1974732211 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fb960104ca0 0x7fb96019b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:32.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.804+0000 7fb966c00640 1 -- 172.21.15.37:0/1974732211 >> 172.21.15.37:0/1974732211 conn(0x7fb960100730 msgr2=0x7fb960101080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:32.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.804+0000 7fb966c00640 1 -- 172.21.15.37:0/1974732211 shutdown_connections 2024-08-20T05:18:32.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:32.804+0000 7fb966c00640 1 -- 172.21.15.37:0/1974732211 wait complete. 2024-08-20T05:18:33.017 DEBUG:teuthology.orchestra.run.smithi037:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-08-20T05:18:33.186 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/: 2024-08-20T05:18:33.187 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:18:33.187 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 . 2024-08-20T05:18:33.187 INFO:teuthology.orchestra.run.smithi037.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 .. 2024-08-20T05:18:33.187 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 data 2024-08-20T05:18:33.187 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.187 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data: 2024-08-20T05:18:33.187 INFO:teuthology.orchestra.run.smithi037.stdout:total 36 2024-08-20T05:18:33.187 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 . 2024-08-20T05:18:33.187 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 .. 2024-08-20T05:18:33.187 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Aug 20 05:02 base 2024-08-20T05:18:33.187 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Aug 20 05:02 current_logfiles 2024-08-20T05:18:33.187 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Aug 20 05:02 global 2024-08-20T05:18:33.187 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 log 2024-08-20T05:18:33.188 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_commit_ts 2024-08-20T05:18:33.188 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_dynshmem 2024-08-20T05:18:33.188 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Aug 20 05:02 pg_hba.conf 2024-08-20T05:18:33.188 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Aug 20 05:02 pg_ident.conf 2024-08-20T05:18:33.188 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:18 pg_logical 2024-08-20T05:18:33.188 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 20 05:02 pg_multixact 2024-08-20T05:18:33.188 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_notify 2024-08-20T05:18:33.188 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_replslot 2024-08-20T05:18:33.188 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_serial 2024-08-20T05:18:33.188 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_snapshots 2024-08-20T05:18:33.188 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:18 pg_stat 2024-08-20T05:18:33.188 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:18 pg_stat_tmp 2024-08-20T05:18:33.188 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:18 pg_subtrans 2024-08-20T05:18:33.188 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_tblspc 2024-08-20T05:18:33.189 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pg_twophase 2024-08-20T05:18:33.189 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:02 PG_VERSION 2024-08-20T05:18:33.189 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 56 Aug 20 05:18 pg_wal 2024-08-20T05:18:33.189 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 pg_xact 2024-08-20T05:18:33.189 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Aug 20 05:02 postgresql.auto.conf 2024-08-20T05:18:33.189 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Aug 20 05:02 postgresql.conf 2024-08-20T05:18:33.189 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Aug 20 05:02 postmaster.opts 2024-08-20T05:18:33.189 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.189 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base: 2024-08-20T05:18:33.189 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:18:33.189 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Aug 20 05:02 . 2024-08-20T05:18:33.189 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.189 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 20 05:02 1 2024-08-20T05:18:33.189 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 20 05:02 13493 2024-08-20T05:18:33.190 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Aug 20 05:10 13494 2024-08-20T05:18:33.190 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 pgsql_tmp 2024-08-20T05:18:33.190 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.190 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/1: 2024-08-20T05:18:33.190 INFO:teuthology.orchestra.run.smithi037.stdout:total 7777 2024-08-20T05:18:33.190 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 20 05:02 . 2024-08-20T05:18:33.190 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Aug 20 05:02 .. 2024-08-20T05:18:33.190 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 112 2024-08-20T05:18:33.190 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 113 2024-08-20T05:18:33.190 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 20 05:02 1247 2024-08-20T05:18:33.190 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1247_fsm 2024-08-20T05:18:33.190 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1247_vm 2024-08-20T05:18:33.190 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Aug 20 05:02 1249 2024-08-20T05:18:33.191 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1249_fsm 2024-08-20T05:18:33.191 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1249_vm 2024-08-20T05:18:33.191 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Aug 20 05:02 1255 2024-08-20T05:18:33.191 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1255_fsm 2024-08-20T05:18:33.191 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1255_vm 2024-08-20T05:18:33.191 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 20 05:02 1259 2024-08-20T05:18:33.191 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1259_fsm 2024-08-20T05:18:33.191 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1259_vm 2024-08-20T05:18:33.191 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Aug 20 05:02 13344 2024-08-20T05:18:33.191 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13344_fsm 2024-08-20T05:18:33.191 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13344_vm 2024-08-20T05:18:33.191 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13346 2024-08-20T05:18:33.191 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13348 2024-08-20T05:18:33.191 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13349 2024-08-20T05:18:33.191 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13349_fsm 2024-08-20T05:18:33.192 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13349_vm 2024-08-20T05:18:33.192 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13351 2024-08-20T05:18:33.192 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13353 2024-08-20T05:18:33.192 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13354 2024-08-20T05:18:33.192 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13354_fsm 2024-08-20T05:18:33.192 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13354_vm 2024-08-20T05:18:33.192 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13356 2024-08-20T05:18:33.192 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13358 2024-08-20T05:18:33.192 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13359 2024-08-20T05:18:33.192 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13359_fsm 2024-08-20T05:18:33.192 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13359_vm 2024-08-20T05:18:33.192 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13361 2024-08-20T05:18:33.192 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13363 2024-08-20T05:18:33.192 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 1417 2024-08-20T05:18:33.192 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 1418 2024-08-20T05:18:33.192 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 174 2024-08-20T05:18:33.193 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 175 2024-08-20T05:18:33.193 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2187 2024-08-20T05:18:33.193 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2224 2024-08-20T05:18:33.193 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2328 2024-08-20T05:18:33.193 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2336 2024-08-20T05:18:33.193 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2337 2024-08-20T05:18:33.193 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2579 2024-08-20T05:18:33.193 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2600 2024-08-20T05:18:33.193 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2600_fsm 2024-08-20T05:18:33.193 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2600_vm 2024-08-20T05:18:33.193 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2601 2024-08-20T05:18:33.193 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2601_fsm 2024-08-20T05:18:33.193 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2601_vm 2024-08-20T05:18:33.193 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:02 2602 2024-08-20T05:18:33.194 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2602_fsm 2024-08-20T05:18:33.194 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2602_vm 2024-08-20T05:18:33.194 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2603 2024-08-20T05:18:33.194 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2603_fsm 2024-08-20T05:18:33.194 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2603_vm 2024-08-20T05:18:33.194 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2604 2024-08-20T05:18:33.194 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2605 2024-08-20T05:18:33.194 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2605_fsm 2024-08-20T05:18:33.194 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2605_vm 2024-08-20T05:18:33.194 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2606 2024-08-20T05:18:33.194 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2606_fsm 2024-08-20T05:18:33.194 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2606_vm 2024-08-20T05:18:33.195 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2607 2024-08-20T05:18:33.195 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2607_fsm 2024-08-20T05:18:33.195 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2607_vm 2024-08-20T05:18:33.195 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Aug 20 05:02 2608 2024-08-20T05:18:33.195 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2608_fsm 2024-08-20T05:18:33.195 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2608_vm 2024-08-20T05:18:33.195 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Aug 20 05:02 2609 2024-08-20T05:18:33.195 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2609_fsm 2024-08-20T05:18:33.195 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2609_vm 2024-08-20T05:18:33.195 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2610 2024-08-20T05:18:33.195 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2610_fsm 2024-08-20T05:18:33.195 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2610_vm 2024-08-20T05:18:33.195 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2611 2024-08-20T05:18:33.196 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2612 2024-08-20T05:18:33.196 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2612_fsm 2024-08-20T05:18:33.196 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2612_vm 2024-08-20T05:18:33.196 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2613 2024-08-20T05:18:33.196 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2615 2024-08-20T05:18:33.196 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2615_fsm 2024-08-20T05:18:33.196 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2615_vm 2024-08-20T05:18:33.196 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2616 2024-08-20T05:18:33.196 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2616_fsm 2024-08-20T05:18:33.196 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2616_vm 2024-08-20T05:18:33.196 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Aug 20 05:02 2617 2024-08-20T05:18:33.196 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2617_fsm 2024-08-20T05:18:33.196 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2617_vm 2024-08-20T05:18:33.196 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 20 05:02 2618 2024-08-20T05:18:33.196 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2618_fsm 2024-08-20T05:18:33.197 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2618_vm 2024-08-20T05:18:33.197 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Aug 20 05:02 2619 2024-08-20T05:18:33.197 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2619_fsm 2024-08-20T05:18:33.197 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2619_vm 2024-08-20T05:18:33.197 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2620 2024-08-20T05:18:33.197 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2650 2024-08-20T05:18:33.197 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2651 2024-08-20T05:18:33.197 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2652 2024-08-20T05:18:33.197 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2653 2024-08-20T05:18:33.197 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2654 2024-08-20T05:18:33.197 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2655 2024-08-20T05:18:33.197 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2656 2024-08-20T05:18:33.197 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2657 2024-08-20T05:18:33.197 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 20 05:02 2658 2024-08-20T05:18:33.197 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 20 05:02 2659 2024-08-20T05:18:33.198 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2660 2024-08-20T05:18:33.198 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2661 2024-08-20T05:18:33.198 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2662 2024-08-20T05:18:33.198 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:02 2663 2024-08-20T05:18:33.198 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2664 2024-08-20T05:18:33.198 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2665 2024-08-20T05:18:33.198 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2666 2024-08-20T05:18:33.198 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2667 2024-08-20T05:18:33.198 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2668 2024-08-20T05:18:33.198 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2669 2024-08-20T05:18:33.198 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2670 2024-08-20T05:18:33.198 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Aug 20 05:02 2673 2024-08-20T05:18:33.199 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Aug 20 05:02 2674 2024-08-20T05:18:33.199 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Aug 20 05:02 2675 2024-08-20T05:18:33.199 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2678 2024-08-20T05:18:33.199 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2679 2024-08-20T05:18:33.199 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2680 2024-08-20T05:18:33.199 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2681 2024-08-20T05:18:33.199 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2682 2024-08-20T05:18:33.199 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2683 2024-08-20T05:18:33.199 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2684 2024-08-20T05:18:33.199 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2685 2024-08-20T05:18:33.199 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2686 2024-08-20T05:18:33.199 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2687 2024-08-20T05:18:33.199 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2688 2024-08-20T05:18:33.199 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:02 2689 2024-08-20T05:18:33.199 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 20 05:02 2690 2024-08-20T05:18:33.200 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Aug 20 05:02 2691 2024-08-20T05:18:33.200 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2692 2024-08-20T05:18:33.200 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2693 2024-08-20T05:18:33.200 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2696 2024-08-20T05:18:33.200 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2699 2024-08-20T05:18:33.200 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2701 2024-08-20T05:18:33.200 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2702 2024-08-20T05:18:33.200 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2703 2024-08-20T05:18:33.200 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2704 2024-08-20T05:18:33.200 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2753 2024-08-20T05:18:33.200 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2753_fsm 2024-08-20T05:18:33.200 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2753_vm 2024-08-20T05:18:33.200 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2754 2024-08-20T05:18:33.200 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2755 2024-08-20T05:18:33.200 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2756 2024-08-20T05:18:33.200 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2757 2024-08-20T05:18:33.201 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2830 2024-08-20T05:18:33.201 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2831 2024-08-20T05:18:33.201 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2832 2024-08-20T05:18:33.201 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2833 2024-08-20T05:18:33.201 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2834 2024-08-20T05:18:33.201 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2835 2024-08-20T05:18:33.201 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2836 2024-08-20T05:18:33.201 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2837 2024-08-20T05:18:33.201 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Aug 20 05:02 2838 2024-08-20T05:18:33.201 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2838_fsm 2024-08-20T05:18:33.201 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2838_vm 2024-08-20T05:18:33.201 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2839 2024-08-20T05:18:33.201 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2840 2024-08-20T05:18:33.201 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2840_fsm 2024-08-20T05:18:33.202 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2840_vm 2024-08-20T05:18:33.202 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2841 2024-08-20T05:18:33.202 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2995 2024-08-20T05:18:33.202 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2996 2024-08-20T05:18:33.202 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3079 2024-08-20T05:18:33.202 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3079_fsm 2024-08-20T05:18:33.202 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3079_vm 2024-08-20T05:18:33.202 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3080 2024-08-20T05:18:33.202 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3081 2024-08-20T05:18:33.202 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 3085 2024-08-20T05:18:33.202 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3118 2024-08-20T05:18:33.202 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3119 2024-08-20T05:18:33.202 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 20 05:02 3164 2024-08-20T05:18:33.202 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3256 2024-08-20T05:18:33.203 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3257 2024-08-20T05:18:33.203 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3258 2024-08-20T05:18:33.203 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3350 2024-08-20T05:18:33.203 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3351 2024-08-20T05:18:33.203 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3379 2024-08-20T05:18:33.203 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3380 2024-08-20T05:18:33.203 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3381 2024-08-20T05:18:33.203 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3394 2024-08-20T05:18:33.203 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3394_fsm 2024-08-20T05:18:33.203 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3394_vm 2024-08-20T05:18:33.203 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3395 2024-08-20T05:18:33.203 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3429 2024-08-20T05:18:33.203 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3430 2024-08-20T05:18:33.203 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3431 2024-08-20T05:18:33.203 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3433 2024-08-20T05:18:33.204 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3439 2024-08-20T05:18:33.204 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3440 2024-08-20T05:18:33.204 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 3455 2024-08-20T05:18:33.204 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Aug 20 05:02 3456 2024-08-20T05:18:33.204 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3456_fsm 2024-08-20T05:18:33.204 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3456_vm 2024-08-20T05:18:33.204 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3466 2024-08-20T05:18:33.204 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3467 2024-08-20T05:18:33.204 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3468 2024-08-20T05:18:33.204 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3501 2024-08-20T05:18:33.204 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3502 2024-08-20T05:18:33.204 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3503 2024-08-20T05:18:33.204 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3534 2024-08-20T05:18:33.204 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3541 2024-08-20T05:18:33.204 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3541_fsm 2024-08-20T05:18:33.204 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3541_vm 2024-08-20T05:18:33.205 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3542 2024-08-20T05:18:33.205 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3574 2024-08-20T05:18:33.205 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3575 2024-08-20T05:18:33.205 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3576 2024-08-20T05:18:33.205 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3596 2024-08-20T05:18:33.205 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3597 2024-08-20T05:18:33.205 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3598 2024-08-20T05:18:33.205 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3599 2024-08-20T05:18:33.205 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3600 2024-08-20T05:18:33.205 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3600_fsm 2024-08-20T05:18:33.205 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3600_vm 2024-08-20T05:18:33.205 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3601 2024-08-20T05:18:33.205 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3601_fsm 2024-08-20T05:18:33.205 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3601_vm 2024-08-20T05:18:33.205 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3602 2024-08-20T05:18:33.206 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3602_fsm 2024-08-20T05:18:33.206 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3602_vm 2024-08-20T05:18:33.206 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3603 2024-08-20T05:18:33.206 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3603_fsm 2024-08-20T05:18:33.206 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3603_vm 2024-08-20T05:18:33.206 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3604 2024-08-20T05:18:33.206 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3605 2024-08-20T05:18:33.206 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3606 2024-08-20T05:18:33.206 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3607 2024-08-20T05:18:33.206 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3608 2024-08-20T05:18:33.206 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 3609 2024-08-20T05:18:33.206 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3712 2024-08-20T05:18:33.206 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3764 2024-08-20T05:18:33.206 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3764_fsm 2024-08-20T05:18:33.207 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3764_vm 2024-08-20T05:18:33.207 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3766 2024-08-20T05:18:33.207 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3767 2024-08-20T05:18:33.207 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3997 2024-08-20T05:18:33.207 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4143 2024-08-20T05:18:33.207 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4144 2024-08-20T05:18:33.207 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4145 2024-08-20T05:18:33.207 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4146 2024-08-20T05:18:33.207 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4147 2024-08-20T05:18:33.207 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4148 2024-08-20T05:18:33.207 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4149 2024-08-20T05:18:33.207 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4150 2024-08-20T05:18:33.207 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4151 2024-08-20T05:18:33.207 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4152 2024-08-20T05:18:33.207 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4153 2024-08-20T05:18:33.208 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4154 2024-08-20T05:18:33.208 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4155 2024-08-20T05:18:33.208 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4156 2024-08-20T05:18:33.208 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4157 2024-08-20T05:18:33.208 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4158 2024-08-20T05:18:33.208 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4159 2024-08-20T05:18:33.208 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4160 2024-08-20T05:18:33.208 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4161 2024-08-20T05:18:33.208 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4162 2024-08-20T05:18:33.219 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4163 2024-08-20T05:18:33.219 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4164 2024-08-20T05:18:33.219 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4165 2024-08-20T05:18:33.220 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4166 2024-08-20T05:18:33.220 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4167 2024-08-20T05:18:33.220 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4168 2024-08-20T05:18:33.220 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4169 2024-08-20T05:18:33.220 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4170 2024-08-20T05:18:33.220 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4171 2024-08-20T05:18:33.220 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4172 2024-08-20T05:18:33.220 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4173 2024-08-20T05:18:33.220 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4174 2024-08-20T05:18:33.220 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 5002 2024-08-20T05:18:33.220 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 548 2024-08-20T05:18:33.220 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 549 2024-08-20T05:18:33.220 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6102 2024-08-20T05:18:33.221 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6104 2024-08-20T05:18:33.221 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6106 2024-08-20T05:18:33.221 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6110 2024-08-20T05:18:33.221 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6111 2024-08-20T05:18:33.221 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6112 2024-08-20T05:18:33.221 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6113 2024-08-20T05:18:33.221 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6117 2024-08-20T05:18:33.221 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 826 2024-08-20T05:18:33.221 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 827 2024-08-20T05:18:33.221 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 828 2024-08-20T05:18:33.221 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 20 05:02 pg_filenode.map 2024-08-20T05:18:33.221 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:02 PG_VERSION 2024-08-20T05:18:33.221 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.221 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-08-20T05:18:33.222 INFO:teuthology.orchestra.run.smithi037.stdout:total 7777 2024-08-20T05:18:33.222 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 Aug 20 05:02 . 2024-08-20T05:18:33.222 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Aug 20 05:02 .. 2024-08-20T05:18:33.222 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 112 2024-08-20T05:18:33.222 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 113 2024-08-20T05:18:33.222 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 20 05:02 1247 2024-08-20T05:18:33.222 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1247_fsm 2024-08-20T05:18:33.222 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1247_vm 2024-08-20T05:18:33.222 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Aug 20 05:02 1249 2024-08-20T05:18:33.222 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1249_fsm 2024-08-20T05:18:33.222 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1249_vm 2024-08-20T05:18:33.222 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Aug 20 05:02 1255 2024-08-20T05:18:33.222 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1255_fsm 2024-08-20T05:18:33.222 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1255_vm 2024-08-20T05:18:33.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 20 05:02 1259 2024-08-20T05:18:33.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1259_fsm 2024-08-20T05:18:33.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1259_vm 2024-08-20T05:18:33.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Aug 20 05:02 13344 2024-08-20T05:18:33.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13344_fsm 2024-08-20T05:18:33.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13344_vm 2024-08-20T05:18:33.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13346 2024-08-20T05:18:33.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13348 2024-08-20T05:18:33.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13349 2024-08-20T05:18:33.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13349_fsm 2024-08-20T05:18:33.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13349_vm 2024-08-20T05:18:33.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13351 2024-08-20T05:18:33.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13353 2024-08-20T05:18:33.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13354 2024-08-20T05:18:33.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13354_fsm 2024-08-20T05:18:33.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13354_vm 2024-08-20T05:18:33.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13356 2024-08-20T05:18:33.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13358 2024-08-20T05:18:33.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13359 2024-08-20T05:18:33.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13359_fsm 2024-08-20T05:18:33.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13359_vm 2024-08-20T05:18:33.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13361 2024-08-20T05:18:33.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13363 2024-08-20T05:18:33.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 1417 2024-08-20T05:18:33.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 1418 2024-08-20T05:18:33.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 174 2024-08-20T05:18:33.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 175 2024-08-20T05:18:33.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2187 2024-08-20T05:18:33.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2224 2024-08-20T05:18:33.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2328 2024-08-20T05:18:33.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2336 2024-08-20T05:18:33.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2337 2024-08-20T05:18:33.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2579 2024-08-20T05:18:33.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2600 2024-08-20T05:18:33.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2600_fsm 2024-08-20T05:18:33.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2600_vm 2024-08-20T05:18:33.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2601 2024-08-20T05:18:33.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2601_fsm 2024-08-20T05:18:33.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2601_vm 2024-08-20T05:18:33.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:02 2602 2024-08-20T05:18:33.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2602_fsm 2024-08-20T05:18:33.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2602_vm 2024-08-20T05:18:33.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2603 2024-08-20T05:18:33.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2603_fsm 2024-08-20T05:18:33.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2603_vm 2024-08-20T05:18:33.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2604 2024-08-20T05:18:33.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2605 2024-08-20T05:18:33.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2605_fsm 2024-08-20T05:18:33.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2605_vm 2024-08-20T05:18:33.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2606 2024-08-20T05:18:33.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2606_fsm 2024-08-20T05:18:33.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2606_vm 2024-08-20T05:18:33.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2607 2024-08-20T05:18:33.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2607_fsm 2024-08-20T05:18:33.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2607_vm 2024-08-20T05:18:33.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Aug 20 05:02 2608 2024-08-20T05:18:33.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2608_fsm 2024-08-20T05:18:33.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2608_vm 2024-08-20T05:18:33.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Aug 20 05:02 2609 2024-08-20T05:18:33.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2609_fsm 2024-08-20T05:18:33.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2609_vm 2024-08-20T05:18:33.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2610 2024-08-20T05:18:33.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2610_fsm 2024-08-20T05:18:33.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2610_vm 2024-08-20T05:18:33.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2611 2024-08-20T05:18:33.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2612 2024-08-20T05:18:33.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2612_fsm 2024-08-20T05:18:33.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2612_vm 2024-08-20T05:18:33.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2613 2024-08-20T05:18:33.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2615 2024-08-20T05:18:33.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2615_fsm 2024-08-20T05:18:33.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2615_vm 2024-08-20T05:18:33.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2616 2024-08-20T05:18:33.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2616_fsm 2024-08-20T05:18:33.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2616_vm 2024-08-20T05:18:33.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Aug 20 05:02 2617 2024-08-20T05:18:33.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2617_fsm 2024-08-20T05:18:33.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2617_vm 2024-08-20T05:18:33.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 20 05:02 2618 2024-08-20T05:18:33.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2618_fsm 2024-08-20T05:18:33.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2618_vm 2024-08-20T05:18:33.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Aug 20 05:02 2619 2024-08-20T05:18:33.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2619_fsm 2024-08-20T05:18:33.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2619_vm 2024-08-20T05:18:33.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2620 2024-08-20T05:18:33.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2650 2024-08-20T05:18:33.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2651 2024-08-20T05:18:33.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2652 2024-08-20T05:18:33.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2653 2024-08-20T05:18:33.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2654 2024-08-20T05:18:33.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2655 2024-08-20T05:18:33.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2656 2024-08-20T05:18:33.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2657 2024-08-20T05:18:33.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 20 05:02 2658 2024-08-20T05:18:33.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 20 05:02 2659 2024-08-20T05:18:33.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2660 2024-08-20T05:18:33.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2661 2024-08-20T05:18:33.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2662 2024-08-20T05:18:33.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:02 2663 2024-08-20T05:18:33.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2664 2024-08-20T05:18:33.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2665 2024-08-20T05:18:33.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2666 2024-08-20T05:18:33.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2667 2024-08-20T05:18:33.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2668 2024-08-20T05:18:33.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2669 2024-08-20T05:18:33.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2670 2024-08-20T05:18:33.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Aug 20 05:02 2673 2024-08-20T05:18:33.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Aug 20 05:02 2674 2024-08-20T05:18:33.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Aug 20 05:02 2675 2024-08-20T05:18:33.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2678 2024-08-20T05:18:33.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2679 2024-08-20T05:18:33.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2680 2024-08-20T05:18:33.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2681 2024-08-20T05:18:33.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2682 2024-08-20T05:18:33.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2683 2024-08-20T05:18:33.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2684 2024-08-20T05:18:33.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2685 2024-08-20T05:18:33.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2686 2024-08-20T05:18:33.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2687 2024-08-20T05:18:33.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2688 2024-08-20T05:18:33.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:02 2689 2024-08-20T05:18:33.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 20 05:02 2690 2024-08-20T05:18:33.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Aug 20 05:02 2691 2024-08-20T05:18:33.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2692 2024-08-20T05:18:33.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2693 2024-08-20T05:18:33.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2696 2024-08-20T05:18:33.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2699 2024-08-20T05:18:33.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2701 2024-08-20T05:18:33.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2702 2024-08-20T05:18:33.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2703 2024-08-20T05:18:33.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2704 2024-08-20T05:18:33.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2753 2024-08-20T05:18:33.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2753_fsm 2024-08-20T05:18:33.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2753_vm 2024-08-20T05:18:33.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2754 2024-08-20T05:18:33.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2755 2024-08-20T05:18:33.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2756 2024-08-20T05:18:33.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2757 2024-08-20T05:18:33.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2830 2024-08-20T05:18:33.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2831 2024-08-20T05:18:33.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2832 2024-08-20T05:18:33.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2833 2024-08-20T05:18:33.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2834 2024-08-20T05:18:33.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2835 2024-08-20T05:18:33.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2836 2024-08-20T05:18:33.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2837 2024-08-20T05:18:33.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Aug 20 05:02 2838 2024-08-20T05:18:33.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2838_fsm 2024-08-20T05:18:33.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2838_vm 2024-08-20T05:18:33.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2839 2024-08-20T05:18:33.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2840 2024-08-20T05:18:33.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2840_fsm 2024-08-20T05:18:33.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2840_vm 2024-08-20T05:18:33.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2841 2024-08-20T05:18:33.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2995 2024-08-20T05:18:33.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2996 2024-08-20T05:18:33.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3079 2024-08-20T05:18:33.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3079_fsm 2024-08-20T05:18:33.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3079_vm 2024-08-20T05:18:33.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3080 2024-08-20T05:18:33.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3081 2024-08-20T05:18:33.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 3085 2024-08-20T05:18:33.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3118 2024-08-20T05:18:33.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3119 2024-08-20T05:18:33.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 20 05:02 3164 2024-08-20T05:18:33.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3256 2024-08-20T05:18:33.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3257 2024-08-20T05:18:33.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3258 2024-08-20T05:18:33.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3350 2024-08-20T05:18:33.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3351 2024-08-20T05:18:33.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3379 2024-08-20T05:18:33.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3380 2024-08-20T05:18:33.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3381 2024-08-20T05:18:33.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3394 2024-08-20T05:18:33.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3394_fsm 2024-08-20T05:18:33.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3394_vm 2024-08-20T05:18:33.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3395 2024-08-20T05:18:33.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3429 2024-08-20T05:18:33.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3430 2024-08-20T05:18:33.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3431 2024-08-20T05:18:33.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3433 2024-08-20T05:18:33.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3439 2024-08-20T05:18:33.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3440 2024-08-20T05:18:33.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 3455 2024-08-20T05:18:33.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Aug 20 05:02 3456 2024-08-20T05:18:33.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3456_fsm 2024-08-20T05:18:33.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3456_vm 2024-08-20T05:18:33.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3466 2024-08-20T05:18:33.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3467 2024-08-20T05:18:33.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3468 2024-08-20T05:18:33.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3501 2024-08-20T05:18:33.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3502 2024-08-20T05:18:33.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3503 2024-08-20T05:18:33.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3534 2024-08-20T05:18:33.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3541 2024-08-20T05:18:33.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3541_fsm 2024-08-20T05:18:33.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3541_vm 2024-08-20T05:18:33.237 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3542 2024-08-20T05:18:33.237 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3574 2024-08-20T05:18:33.237 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3575 2024-08-20T05:18:33.237 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3576 2024-08-20T05:18:33.237 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3596 2024-08-20T05:18:33.237 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3597 2024-08-20T05:18:33.237 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3598 2024-08-20T05:18:33.237 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3599 2024-08-20T05:18:33.237 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3600 2024-08-20T05:18:33.237 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3600_fsm 2024-08-20T05:18:33.237 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3600_vm 2024-08-20T05:18:33.237 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3601 2024-08-20T05:18:33.237 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3601_fsm 2024-08-20T05:18:33.238 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3601_vm 2024-08-20T05:18:33.238 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3602 2024-08-20T05:18:33.238 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3602_fsm 2024-08-20T05:18:33.238 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3602_vm 2024-08-20T05:18:33.238 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3603 2024-08-20T05:18:33.238 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3603_fsm 2024-08-20T05:18:33.238 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3603_vm 2024-08-20T05:18:33.238 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3604 2024-08-20T05:18:33.238 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3605 2024-08-20T05:18:33.238 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3606 2024-08-20T05:18:33.238 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3607 2024-08-20T05:18:33.238 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3608 2024-08-20T05:18:33.238 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 3609 2024-08-20T05:18:33.239 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3712 2024-08-20T05:18:33.239 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3764 2024-08-20T05:18:33.239 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3764_fsm 2024-08-20T05:18:33.239 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3764_vm 2024-08-20T05:18:33.239 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3766 2024-08-20T05:18:33.239 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3767 2024-08-20T05:18:33.239 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3997 2024-08-20T05:18:33.239 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4143 2024-08-20T05:18:33.239 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4144 2024-08-20T05:18:33.239 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4145 2024-08-20T05:18:33.239 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4146 2024-08-20T05:18:33.239 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4147 2024-08-20T05:18:33.239 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4148 2024-08-20T05:18:33.239 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4149 2024-08-20T05:18:33.239 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4150 2024-08-20T05:18:33.240 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4151 2024-08-20T05:18:33.240 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4152 2024-08-20T05:18:33.240 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4153 2024-08-20T05:18:33.240 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4154 2024-08-20T05:18:33.240 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4155 2024-08-20T05:18:33.240 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4156 2024-08-20T05:18:33.240 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4157 2024-08-20T05:18:33.240 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4158 2024-08-20T05:18:33.240 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4159 2024-08-20T05:18:33.240 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4160 2024-08-20T05:18:33.240 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4161 2024-08-20T05:18:33.240 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4162 2024-08-20T05:18:33.240 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4163 2024-08-20T05:18:33.240 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4164 2024-08-20T05:18:33.240 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4165 2024-08-20T05:18:33.241 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4166 2024-08-20T05:18:33.241 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4167 2024-08-20T05:18:33.241 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4168 2024-08-20T05:18:33.241 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4169 2024-08-20T05:18:33.241 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4170 2024-08-20T05:18:33.241 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4171 2024-08-20T05:18:33.241 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4172 2024-08-20T05:18:33.249 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4173 2024-08-20T05:18:33.249 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4174 2024-08-20T05:18:33.249 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 5002 2024-08-20T05:18:33.250 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 548 2024-08-20T05:18:33.250 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 549 2024-08-20T05:18:33.250 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6102 2024-08-20T05:18:33.250 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6104 2024-08-20T05:18:33.250 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6106 2024-08-20T05:18:33.250 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6110 2024-08-20T05:18:33.250 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6111 2024-08-20T05:18:33.250 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6112 2024-08-20T05:18:33.250 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6113 2024-08-20T05:18:33.250 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6117 2024-08-20T05:18:33.250 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 826 2024-08-20T05:18:33.250 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 827 2024-08-20T05:18:33.250 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 828 2024-08-20T05:18:33.250 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 20 05:02 pg_filenode.map 2024-08-20T05:18:33.251 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:02 PG_VERSION 2024-08-20T05:18:33.251 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.251 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-08-20T05:18:33.251 INFO:teuthology.orchestra.run.smithi037.stdout:total 541766 2024-08-20T05:18:33.251 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 Aug 20 05:10 . 2024-08-20T05:18:33.251 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Aug 20 05:02 .. 2024-08-20T05:18:33.251 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 112 2024-08-20T05:18:33.251 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 113 2024-08-20T05:18:33.251 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 20 05:03 1247 2024-08-20T05:18:33.251 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1247_fsm 2024-08-20T05:18:33.251 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:03 1247_vm 2024-08-20T05:18:33.251 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Aug 20 05:03 1249 2024-08-20T05:18:33.251 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:03 1249_fsm 2024-08-20T05:18:33.251 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:03 1249_vm 2024-08-20T05:18:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Aug 20 05:02 1255 2024-08-20T05:18:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1255_fsm 2024-08-20T05:18:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1255_vm 2024-08-20T05:18:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Aug 20 05:18 1259 2024-08-20T05:18:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1259_fsm 2024-08-20T05:18:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:03 1259_vm 2024-08-20T05:18:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Aug 20 05:02 13344 2024-08-20T05:18:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13344_fsm 2024-08-20T05:18:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13344_vm 2024-08-20T05:18:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13346 2024-08-20T05:18:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13348 2024-08-20T05:18:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13349 2024-08-20T05:18:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13349_fsm 2024-08-20T05:18:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13349_vm 2024-08-20T05:18:33.253 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13351 2024-08-20T05:18:33.253 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13353 2024-08-20T05:18:33.253 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13354 2024-08-20T05:18:33.253 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13354_fsm 2024-08-20T05:18:33.253 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13354_vm 2024-08-20T05:18:33.253 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13356 2024-08-20T05:18:33.253 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13358 2024-08-20T05:18:33.253 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13359 2024-08-20T05:18:33.253 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 13359_fsm 2024-08-20T05:18:33.253 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13359_vm 2024-08-20T05:18:33.253 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 13361 2024-08-20T05:18:33.253 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 13363 2024-08-20T05:18:33.254 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 1417 2024-08-20T05:18:33.254 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 1418 2024-08-20T05:18:33.254 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 439574528 Aug 20 05:18 16396 2024-08-20T05:18:33.254 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Aug 20 05:15 16396_fsm 2024-08-20T05:18:33.254 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:14 16396_vm 2024-08-20T05:18:33.254 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1122304 Aug 20 05:18 16397 2024-08-20T05:18:33.254 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:17 16397_fsm 2024-08-20T05:18:33.254 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:17 16397_vm 2024-08-20T05:18:33.254 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 770048 Aug 20 05:17 16399 2024-08-20T05:18:33.254 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:18 16399_fsm 2024-08-20T05:18:33.254 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:18 16399_vm 2024-08-20T05:18:33.254 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:17 16400 2024-08-20T05:18:33.254 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:17 16402 2024-08-20T05:18:33.254 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Aug 20 05:18 16404 2024-08-20T05:18:33.254 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32940032 Aug 20 05:18 16406 2024-08-20T05:18:33.255 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:17 16406_fsm 2024-08-20T05:18:33.255 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:17 16406_vm 2024-08-20T05:18:33.255 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 174 2024-08-20T05:18:33.255 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 175 2024-08-20T05:18:33.255 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2187 2024-08-20T05:18:33.255 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2224 2024-08-20T05:18:33.255 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2328 2024-08-20T05:18:33.255 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2336 2024-08-20T05:18:33.255 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2337 2024-08-20T05:18:33.255 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:03 2579 2024-08-20T05:18:33.255 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2600 2024-08-20T05:18:33.255 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2600_fsm 2024-08-20T05:18:33.255 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2600_vm 2024-08-20T05:18:33.255 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2601 2024-08-20T05:18:33.255 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2601_fsm 2024-08-20T05:18:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2601_vm 2024-08-20T05:18:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:02 2602 2024-08-20T05:18:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2602_fsm 2024-08-20T05:18:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2602_vm 2024-08-20T05:18:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2603 2024-08-20T05:18:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2603_fsm 2024-08-20T05:18:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2603_vm 2024-08-20T05:18:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2604 2024-08-20T05:18:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2605 2024-08-20T05:18:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2605_fsm 2024-08-20T05:18:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2605_vm 2024-08-20T05:18:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:03 2606 2024-08-20T05:18:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2606_fsm 2024-08-20T05:18:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:03 2606_vm 2024-08-20T05:18:33.257 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2607 2024-08-20T05:18:33.257 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2607_fsm 2024-08-20T05:18:33.257 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2607_vm 2024-08-20T05:18:33.257 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Aug 20 05:03 2608 2024-08-20T05:18:33.257 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2608_fsm 2024-08-20T05:18:33.257 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:03 2608_vm 2024-08-20T05:18:33.257 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Aug 20 05:02 2609 2024-08-20T05:18:33.257 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2609_fsm 2024-08-20T05:18:33.257 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2609_vm 2024-08-20T05:18:33.257 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:03 2610 2024-08-20T05:18:33.257 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2610_fsm 2024-08-20T05:18:33.257 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:03 2610_vm 2024-08-20T05:18:33.257 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2611 2024-08-20T05:18:33.258 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2612 2024-08-20T05:18:33.258 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2612_fsm 2024-08-20T05:18:33.258 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2612_vm 2024-08-20T05:18:33.258 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2613 2024-08-20T05:18:33.258 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2615 2024-08-20T05:18:33.258 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2615_fsm 2024-08-20T05:18:33.258 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2615_vm 2024-08-20T05:18:33.258 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2616 2024-08-20T05:18:33.258 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2616_fsm 2024-08-20T05:18:33.258 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2616_vm 2024-08-20T05:18:33.258 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Aug 20 05:02 2617 2024-08-20T05:18:33.258 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2617_fsm 2024-08-20T05:18:33.258 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2617_vm 2024-08-20T05:18:33.258 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Aug 20 05:02 2618 2024-08-20T05:18:33.259 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2618_fsm 2024-08-20T05:18:33.259 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2618_vm 2024-08-20T05:18:33.259 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 172032 Aug 20 05:18 2619 2024-08-20T05:18:33.259 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:06 2619_fsm 2024-08-20T05:18:33.259 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:03 2619_vm 2024-08-20T05:18:33.259 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2620 2024-08-20T05:18:33.259 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2650 2024-08-20T05:18:33.259 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2651 2024-08-20T05:18:33.259 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2652 2024-08-20T05:18:33.259 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2653 2024-08-20T05:18:33.259 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2654 2024-08-20T05:18:33.259 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2655 2024-08-20T05:18:33.259 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2656 2024-08-20T05:18:33.259 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2657 2024-08-20T05:18:33.260 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Aug 20 05:03 2658 2024-08-20T05:18:33.260 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Aug 20 05:03 2659 2024-08-20T05:18:33.260 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2660 2024-08-20T05:18:33.260 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2661 2024-08-20T05:18:33.260 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:03 2662 2024-08-20T05:18:33.260 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:03 2663 2024-08-20T05:18:33.260 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:03 2664 2024-08-20T05:18:33.260 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:03 2665 2024-08-20T05:18:33.260 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:03 2666 2024-08-20T05:18:33.260 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:03 2667 2024-08-20T05:18:33.260 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2668 2024-08-20T05:18:33.260 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2669 2024-08-20T05:18:33.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2670 2024-08-20T05:18:33.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Aug 20 05:03 2673 2024-08-20T05:18:33.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Aug 20 05:03 2674 2024-08-20T05:18:33.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Aug 20 05:02 2675 2024-08-20T05:18:33.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:03 2678 2024-08-20T05:18:33.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:03 2679 2024-08-20T05:18:33.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2680 2024-08-20T05:18:33.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2681 2024-08-20T05:18:33.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2682 2024-08-20T05:18:33.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2683 2024-08-20T05:18:33.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2684 2024-08-20T05:18:33.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2685 2024-08-20T05:18:33.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2686 2024-08-20T05:18:33.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2687 2024-08-20T05:18:33.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 2688 2024-08-20T05:18:33.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Aug 20 05:02 2689 2024-08-20T05:18:33.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Aug 20 05:02 2690 2024-08-20T05:18:33.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Aug 20 05:02 2691 2024-08-20T05:18:33.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2692 2024-08-20T05:18:33.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2693 2024-08-20T05:18:33.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:09 2696 2024-08-20T05:18:33.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2699 2024-08-20T05:18:33.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2701 2024-08-20T05:18:33.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2702 2024-08-20T05:18:33.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:03 2703 2024-08-20T05:18:33.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:03 2704 2024-08-20T05:18:33.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2753 2024-08-20T05:18:33.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2753_fsm 2024-08-20T05:18:33.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2753_vm 2024-08-20T05:18:33.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2754 2024-08-20T05:18:33.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2755 2024-08-20T05:18:33.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2756 2024-08-20T05:18:33.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 2757 2024-08-20T05:18:33.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2830 2024-08-20T05:18:33.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2831 2024-08-20T05:18:33.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2832 2024-08-20T05:18:33.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2833 2024-08-20T05:18:33.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2834 2024-08-20T05:18:33.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2835 2024-08-20T05:18:33.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2836 2024-08-20T05:18:33.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2837 2024-08-20T05:18:33.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Aug 20 05:02 2838 2024-08-20T05:18:33.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2838_fsm 2024-08-20T05:18:33.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2838_vm 2024-08-20T05:18:33.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2839 2024-08-20T05:18:33.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2840 2024-08-20T05:18:33.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2840_fsm 2024-08-20T05:18:33.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2840_vm 2024-08-20T05:18:33.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2841 2024-08-20T05:18:33.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2995 2024-08-20T05:18:33.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2996 2024-08-20T05:18:33.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3079 2024-08-20T05:18:33.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3079_fsm 2024-08-20T05:18:33.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3079_vm 2024-08-20T05:18:33.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3080 2024-08-20T05:18:33.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3081 2024-08-20T05:18:33.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:02 3085 2024-08-20T05:18:33.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3118 2024-08-20T05:18:33.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3119 2024-08-20T05:18:33.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Aug 20 05:02 3164 2024-08-20T05:18:33.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3256 2024-08-20T05:18:33.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3257 2024-08-20T05:18:33.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3258 2024-08-20T05:18:33.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3350 2024-08-20T05:18:33.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3351 2024-08-20T05:18:33.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3379 2024-08-20T05:18:33.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3380 2024-08-20T05:18:33.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3381 2024-08-20T05:18:33.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3394 2024-08-20T05:18:33.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3394_fsm 2024-08-20T05:18:33.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3394_vm 2024-08-20T05:18:33.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3395 2024-08-20T05:18:33.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3429 2024-08-20T05:18:33.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3430 2024-08-20T05:18:33.266 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3431 2024-08-20T05:18:33.266 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3433 2024-08-20T05:18:33.266 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3439 2024-08-20T05:18:33.266 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3440 2024-08-20T05:18:33.266 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Aug 20 05:03 3455 2024-08-20T05:18:33.266 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Aug 20 05:02 3456 2024-08-20T05:18:33.266 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3456_fsm 2024-08-20T05:18:33.266 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3456_vm 2024-08-20T05:18:33.266 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3466 2024-08-20T05:18:33.266 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3467 2024-08-20T05:18:33.266 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3468 2024-08-20T05:18:33.267 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3501 2024-08-20T05:18:33.267 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3502 2024-08-20T05:18:33.267 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3503 2024-08-20T05:18:33.267 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3534 2024-08-20T05:18:33.267 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3541 2024-08-20T05:18:33.267 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3541_fsm 2024-08-20T05:18:33.267 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3541_vm 2024-08-20T05:18:33.267 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3542 2024-08-20T05:18:33.267 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3574 2024-08-20T05:18:33.267 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3575 2024-08-20T05:18:33.267 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3576 2024-08-20T05:18:33.267 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3596 2024-08-20T05:18:33.267 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3597 2024-08-20T05:18:33.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3598 2024-08-20T05:18:33.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3599 2024-08-20T05:18:33.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3600 2024-08-20T05:18:33.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3600_fsm 2024-08-20T05:18:33.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3600_vm 2024-08-20T05:18:33.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3601 2024-08-20T05:18:33.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3601_fsm 2024-08-20T05:18:33.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3601_vm 2024-08-20T05:18:33.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3602 2024-08-20T05:18:33.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3602_fsm 2024-08-20T05:18:33.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3602_vm 2024-08-20T05:18:33.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3603 2024-08-20T05:18:33.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3603_fsm 2024-08-20T05:18:33.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3603_vm 2024-08-20T05:18:33.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3604 2024-08-20T05:18:33.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3605 2024-08-20T05:18:33.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3606 2024-08-20T05:18:33.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3607 2024-08-20T05:18:33.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3608 2024-08-20T05:18:33.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Aug 20 05:02 3609 2024-08-20T05:18:33.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3712 2024-08-20T05:18:33.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3764 2024-08-20T05:18:33.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 3764_fsm 2024-08-20T05:18:33.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3764_vm 2024-08-20T05:18:33.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3766 2024-08-20T05:18:33.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 3767 2024-08-20T05:18:33.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3997 2024-08-20T05:18:33.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4143 2024-08-20T05:18:33.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4144 2024-08-20T05:18:33.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4145 2024-08-20T05:18:33.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4146 2024-08-20T05:18:33.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4147 2024-08-20T05:18:33.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4148 2024-08-20T05:18:33.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4149 2024-08-20T05:18:33.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4150 2024-08-20T05:18:33.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4151 2024-08-20T05:18:33.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4152 2024-08-20T05:18:33.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4153 2024-08-20T05:18:33.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4154 2024-08-20T05:18:33.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4155 2024-08-20T05:18:33.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4156 2024-08-20T05:18:33.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4157 2024-08-20T05:18:33.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4158 2024-08-20T05:18:33.271 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4159 2024-08-20T05:18:33.271 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4160 2024-08-20T05:18:33.271 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4161 2024-08-20T05:18:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4162 2024-08-20T05:18:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4163 2024-08-20T05:18:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4164 2024-08-20T05:18:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4165 2024-08-20T05:18:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4166 2024-08-20T05:18:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4167 2024-08-20T05:18:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4168 2024-08-20T05:18:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4169 2024-08-20T05:18:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4170 2024-08-20T05:18:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4171 2024-08-20T05:18:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4172 2024-08-20T05:18:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4173 2024-08-20T05:18:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4174 2024-08-20T05:18:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 5002 2024-08-20T05:18:33.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 548 2024-08-20T05:18:33.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 549 2024-08-20T05:18:33.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6102 2024-08-20T05:18:33.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6104 2024-08-20T05:18:33.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6106 2024-08-20T05:18:33.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6110 2024-08-20T05:18:33.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6111 2024-08-20T05:18:33.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6112 2024-08-20T05:18:33.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6113 2024-08-20T05:18:33.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6117 2024-08-20T05:18:33.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 826 2024-08-20T05:18:33.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 827 2024-08-20T05:18:33.274 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 828 2024-08-20T05:18:33.274 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 20 05:02 pg_filenode.map 2024-08-20T05:18:33.274 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 Aug 20 05:02 pg_internal.init 2024-08-20T05:18:33.274 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:02 PG_VERSION 2024-08-20T05:18:33.274 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.274 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-08-20T05:18:33.274 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:18:33.274 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:18:33.274 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 Aug 20 05:02 .. 2024-08-20T05:18:33.274 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.274 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/global: 2024-08-20T05:18:33.274 INFO:teuthology.orchestra.run.smithi037.stdout:total 560 2024-08-20T05:18:33.274 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 Aug 20 05:02 . 2024-08-20T05:18:33.275 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1213 2024-08-20T05:18:33.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1213_fsm 2024-08-20T05:18:33.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1213_vm 2024-08-20T05:18:33.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1214 2024-08-20T05:18:33.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1214_fsm 2024-08-20T05:18:33.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1214_vm 2024-08-20T05:18:33.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 1232 2024-08-20T05:18:33.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 1233 2024-08-20T05:18:33.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1260 2024-08-20T05:18:33.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1260_fsm 2024-08-20T05:18:33.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1260_vm 2024-08-20T05:18:33.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1261 2024-08-20T05:18:33.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1261_fsm 2024-08-20T05:18:33.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1261_vm 2024-08-20T05:18:33.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1262 2024-08-20T05:18:33.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 1262_fsm 2024-08-20T05:18:33.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 1262_vm 2024-08-20T05:18:33.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2396 2024-08-20T05:18:33.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Aug 20 05:02 2396_fsm 2024-08-20T05:18:33.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2396_vm 2024-08-20T05:18:33.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2397 2024-08-20T05:18:33.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2671 2024-08-20T05:18:33.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2672 2024-08-20T05:18:33.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2676 2024-08-20T05:18:33.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2677 2024-08-20T05:18:33.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2694 2024-08-20T05:18:33.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2695 2024-08-20T05:18:33.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2697 2024-08-20T05:18:33.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Aug 20 05:02 2698 2024-08-20T05:18:33.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2846 2024-08-20T05:18:33.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2847 2024-08-20T05:18:33.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2964 2024-08-20T05:18:33.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2965 2024-08-20T05:18:33.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 2966 2024-08-20T05:18:33.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 2967 2024-08-20T05:18:33.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 3592 2024-08-20T05:18:33.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 3593 2024-08-20T05:18:33.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4060 2024-08-20T05:18:33.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4061 2024-08-20T05:18:33.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4175 2024-08-20T05:18:33.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4176 2024-08-20T05:18:33.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4177 2024-08-20T05:18:33.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4178 2024-08-20T05:18:33.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4181 2024-08-20T05:18:33.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4182 2024-08-20T05:18:33.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4183 2024-08-20T05:18:33.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4184 2024-08-20T05:18:33.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 4185 2024-08-20T05:18:33.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 4186 2024-08-20T05:18:33.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6000 2024-08-20T05:18:33.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6001 2024-08-20T05:18:33.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6002 2024-08-20T05:18:33.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 6100 2024-08-20T05:18:33.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6114 2024-08-20T05:18:33.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 6115 2024-08-20T05:18:33.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:18 pg_control 2024-08-20T05:18:33.279 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Aug 20 05:02 pg_filenode.map 2024-08-20T05:18:33.279 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 Aug 20 05:02 pg_internal.init 2024-08-20T05:18:33.279 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.279 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/log: 2024-08-20T05:18:33.279 INFO:teuthology.orchestra.run.smithi037.stdout:total 2 2024-08-20T05:18:33.279 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 . 2024-08-20T05:18:33.279 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.279 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1748 Aug 20 05:18 postgresql-Tue.log 2024-08-20T05:18:33.279 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.279 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-08-20T05:18:33.279 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:18:33.279 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:18:33.280 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.280 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.280 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-08-20T05:18:33.280 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:18:33.280 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:18:33.280 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.280 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.280 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-08-20T05:18:33.280 INFO:teuthology.orchestra.run.smithi037.stdout:total 1 2024-08-20T05:18:33.280 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:18 . 2024-08-20T05:18:33.280 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.280 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 mappings 2024-08-20T05:18:33.280 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Aug 20 05:18 replorigin_checkpoint 2024-08-20T05:18:33.281 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 snapshots 2024-08-20T05:18:33.281 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.281 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-08-20T05:18:33.281 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:18:33.281 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:18:33.281 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:18 .. 2024-08-20T05:18:33.281 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.281 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-08-20T05:18:33.281 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:18:33.281 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:18:33.281 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:18 .. 2024-08-20T05:18:33.281 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.281 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-08-20T05:18:33.281 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:18:33.281 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 20 05:02 . 2024-08-20T05:18:33.282 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.282 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 members 2024-08-20T05:18:33.282 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 offsets 2024-08-20T05:18:33.282 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.282 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-08-20T05:18:33.282 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-08-20T05:18:33.282 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 . 2024-08-20T05:18:33.282 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 20 05:02 .. 2024-08-20T05:18:33.282 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:02 0000 2024-08-20T05:18:33.282 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.282 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-08-20T05:18:33.282 INFO:teuthology.orchestra.run.smithi037.stdout:total 8 2024-08-20T05:18:33.282 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 . 2024-08-20T05:18:33.282 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 Aug 20 05:02 .. 2024-08-20T05:18:33.282 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Aug 20 05:07 0000 2024-08-20T05:18:33.283 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.283 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-08-20T05:18:33.283 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:18:33.283 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:18:33.283 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.283 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.283 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-08-20T05:18:33.283 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:18:33.283 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:18:33.283 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.283 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.283 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-08-20T05:18:33.283 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:18:33.283 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:18:33.283 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.284 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.284 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-08-20T05:18:33.284 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:18:33.284 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:18:33.284 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.284 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.284 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-08-20T05:18:33.284 INFO:teuthology.orchestra.run.smithi037.stdout:total 15 2024-08-20T05:18:33.284 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Aug 20 05:18 . 2024-08-20T05:18:33.284 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.284 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 Aug 20 05:18 db_0.stat 2024-08-20T05:18:33.284 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 Aug 20 05:18 db_13494.stat 2024-08-20T05:18:33.284 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 Aug 20 05:18 global.stat 2024-08-20T05:18:33.284 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.284 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-08-20T05:18:33.285 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:18:33.285 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:18 . 2024-08-20T05:18:33.285 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.285 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.285 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-08-20T05:18:33.285 INFO:teuthology.orchestra.run.smithi037.stdout:total 72 2024-08-20T05:18:33.285 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:18 . 2024-08-20T05:18:33.285 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.285 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Aug 20 05:18 0009 2024-08-20T05:18:33.285 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.285 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-08-20T05:18:33.285 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:18:33.285 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:18:33.285 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.285 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.286 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-08-20T05:18:33.286 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:18:33.286 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:18:33.286 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.286 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.286 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-08-20T05:18:33.286 INFO:teuthology.orchestra.run.smithi037.stdout:total 901120 2024-08-20T05:18:33.286 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 56 Aug 20 05:18 . 2024-08-20T05:18:33.286 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.286 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:18 00000001000000000000005D 2024-08-20T05:18:33.286 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:07 00000001000000000000005E 2024-08-20T05:18:33.286 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:09 00000001000000000000005F 2024-08-20T05:18:33.286 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:07 000000010000000000000060 2024-08-20T05:18:33.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:11 000000010000000000000061 2024-08-20T05:18:33.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:09 000000010000000000000062 2024-08-20T05:18:33.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:09 000000010000000000000063 2024-08-20T05:18:33.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:09 000000010000000000000064 2024-08-20T05:18:33.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:10 000000010000000000000065 2024-08-20T05:18:33.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:10 000000010000000000000066 2024-08-20T05:18:33.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:09 000000010000000000000067 2024-08-20T05:18:33.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:10 000000010000000000000068 2024-08-20T05:18:33.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:09 000000010000000000000069 2024-08-20T05:18:33.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:10 00000001000000000000006A 2024-08-20T05:18:33.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:12 00000001000000000000006B 2024-08-20T05:18:33.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:07 00000001000000000000006C 2024-08-20T05:18:33.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:09 00000001000000000000006D 2024-08-20T05:18:33.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:09 00000001000000000000006E 2024-08-20T05:18:33.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:09 00000001000000000000006F 2024-08-20T05:18:33.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:09 000000010000000000000070 2024-08-20T05:18:33.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:09 000000010000000000000071 2024-08-20T05:18:33.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:09 000000010000000000000072 2024-08-20T05:18:33.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:10 000000010000000000000073 2024-08-20T05:18:33.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:08 000000010000000000000074 2024-08-20T05:18:33.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:12 000000010000000000000075 2024-08-20T05:18:33.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:10 000000010000000000000076 2024-08-20T05:18:33.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:09 000000010000000000000077 2024-08-20T05:18:33.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:09 000000010000000000000078 2024-08-20T05:18:33.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:13 000000010000000000000079 2024-08-20T05:18:33.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:15 00000001000000000000007A 2024-08-20T05:18:33.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:13 00000001000000000000007B 2024-08-20T05:18:33.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:14 00000001000000000000007C 2024-08-20T05:18:33.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:16 00000001000000000000007D 2024-08-20T05:18:33.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:17 00000001000000000000007E 2024-08-20T05:18:33.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:13 00000001000000000000007F 2024-08-20T05:18:33.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:12 000000010000000000000080 2024-08-20T05:18:33.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:15 000000010000000000000081 2024-08-20T05:18:33.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:12 000000010000000000000082 2024-08-20T05:18:33.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:13 000000010000000000000083 2024-08-20T05:18:33.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:15 000000010000000000000084 2024-08-20T05:18:33.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:12 000000010000000000000085 2024-08-20T05:18:33.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:14 000000010000000000000086 2024-08-20T05:18:33.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:13 000000010000000000000087 2024-08-20T05:18:33.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:16 000000010000000000000088 2024-08-20T05:18:33.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:14 000000010000000000000089 2024-08-20T05:18:33.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:16 00000001000000000000008A 2024-08-20T05:18:33.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:13 00000001000000000000008B 2024-08-20T05:18:33.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:14 00000001000000000000008C 2024-08-20T05:18:33.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:13 00000001000000000000008D 2024-08-20T05:18:33.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:14 00000001000000000000008E 2024-08-20T05:18:33.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:14 00000001000000000000008F 2024-08-20T05:18:33.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:15 000000010000000000000090 2024-08-20T05:18:33.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:13 000000010000000000000091 2024-08-20T05:18:33.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:13 000000010000000000000092 2024-08-20T05:18:33.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Aug 20 05:13 000000010000000000000093 2024-08-20T05:18:33.290 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 archive_status 2024-08-20T05:18:33.290 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.290 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-08-20T05:18:33.290 INFO:teuthology.orchestra.run.smithi037.stdout:total 0 2024-08-20T05:18:33.290 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Aug 20 05:02 . 2024-08-20T05:18:33.290 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 56 Aug 20 05:18 .. 2024-08-20T05:18:33.290 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:33.291 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-08-20T05:18:33.291 INFO:teuthology.orchestra.run.smithi037.stdout:total 152 2024-08-20T05:18:33.291 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 Aug 20 05:02 . 2024-08-20T05:18:33.291 INFO:teuthology.orchestra.run.smithi037.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 Aug 20 05:18 .. 2024-08-20T05:18:33.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 155648 Aug 20 05:18 0000 2024-08-20T05:18:33.292 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-08-20T05:18:33.302 INFO:tasks.quiescer:joining Quiescers 2024-08-20T05:18:33.302 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-08-20T05:18:33.303 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:18:33.735 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f5944875', total seconds elapsed: 30.8 2024-08-20T05:18:33.820 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:18:33.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:33 smithi130 ceph-mon[22007]: pgmap v890: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.1 KiB/s wr, 11 op/s 2024-08-20T05:18:33.959 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:33 smithi037 ceph-mon[17265]: pgmap v890: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.1 KiB/s wr, 11 op/s 2024-08-20T05:18:34.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:33 smithi135 ceph-mon[22342]: pgmap v890: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.1 KiB/s wr, 11 op/s 2024-08-20T05:18:34.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.614+0000 7f7f58a00640 1 -- 172.21.15.37:0/2381869248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f54102900 msgr2=0x7f7f54102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.614+0000 7f7f58a00640 1 --2- 172.21.15.37:0/2381869248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f54102900 0x7f7f54102ce0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f7f44009900 tx=0x7f7f4402a3f0 comp rx=0 tx=0).stop 2024-08-20T05:18:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.614+0000 7f7f58a00640 1 -- 172.21.15.37:0/2381869248 shutdown_connections 2024-08-20T05:18:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.614+0000 7f7f58a00640 1 --2- 172.21.15.37:0/2381869248 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f54108c90 0x7f7f5410f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.614+0000 7f7f58a00640 1 --2- 172.21.15.37:0/2381869248 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f54108310 0x7f7f54108750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.614+0000 7f7f58a00640 1 --2- 172.21.15.37:0/2381869248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f54102900 0x7f7f54102ce0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.614+0000 7f7f58a00640 1 -- 172.21.15.37:0/2381869248 >> 172.21.15.37:0/2381869248 conn(0x7f7f540fe390 msgr2=0x7f7f541007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.614+0000 7f7f58a00640 1 -- 172.21.15.37:0/2381869248 shutdown_connections 2024-08-20T05:18:34.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.614+0000 7f7f58a00640 1 -- 172.21.15.37:0/2381869248 wait complete. 2024-08-20T05:18:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.615+0000 7f7f58a00640 1 Processor -- start 2024-08-20T05:18:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.615+0000 7f7f58a00640 1 -- start start 2024-08-20T05:18:34.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.615+0000 7f7f58a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f54102900 0x7f7f54198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.616+0000 7f7f58a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f54108310 0x7f7f541992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.616+0000 7f7f58a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f54108c90 0x7f7f5419e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.616+0000 7f7f58a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7f54112960 con 0x7f7f54108c90 2024-08-20T05:18:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.616+0000 7f7f58a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7f541127e0 con 0x7f7f54108310 2024-08-20T05:18:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.616+0000 7f7f58a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7f54112ae0 con 0x7f7f54102900 2024-08-20T05:18:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.616+0000 7f7f53200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f54108c90 0x7f7f5419e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.616+0000 7f7f52800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f54102900 0x7f7f54198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.616+0000 7f7f51e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f54108310 0x7f7f541992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.616+0000 7f7f53200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f54108c90 0x7f7f5419e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52984/0 (socket says 172.21.15.37:52984) 2024-08-20T05:18:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.616+0000 7f7f53200640 1 -- 172.21.15.37:0/4258475089 learned_addr learned my addr 172.21.15.37:0/4258475089 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.616+0000 7f7f53200640 1 -- 172.21.15.37:0/4258475089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f54102900 msgr2=0x7f7f54198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.616+0000 7f7f53200640 1 --2- 172.21.15.37:0/4258475089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f54102900 0x7f7f54198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.616+0000 7f7f53200640 1 -- 172.21.15.37:0/4258475089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f54108310 msgr2=0x7f7f541992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:34.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.616+0000 7f7f53200640 1 --2- 172.21.15.37:0/4258475089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f54108310 0x7f7f541992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:34.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.616+0000 7f7f53200640 1 -- 172.21.15.37:0/4258475089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5419ee10 con 0x7f7f54108c90 2024-08-20T05:18:34.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.616+0000 7f7f52800640 1 --2- 172.21.15.37:0/4258475089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f54102900 0x7f7f54198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:34.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.617+0000 7f7f53200640 1 --2- 172.21.15.37:0/4258475089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f54108c90 0x7f7f5419e640 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009fd0 tx=0x7f7f4c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:34.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.617+0000 7f7f4b400640 1 -- 172.21.15.37:0/4258475089 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c017070 con 0x7f7f54108c90 2024-08-20T05:18:34.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.617+0000 7f7f4b400640 1 -- 172.21.15.37:0/4258475089 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f4c003e20 con 0x7f7f54108c90 2024-08-20T05:18:34.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.617+0000 7f7f58a00640 1 -- 172.21.15.37:0/4258475089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5419f100 con 0x7f7f54108c90 2024-08-20T05:18:34.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.617+0000 7f7f4b400640 1 -- 172.21.15.37:0/4258475089 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c010460 con 0x7f7f54108c90 2024-08-20T05:18:34.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.617+0000 7f7f58a00640 1 -- 172.21.15.37:0/4258475089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f541a57c0 con 0x7f7f54108c90 2024-08-20T05:18:34.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.619+0000 7f7f58a00640 1 -- 172.21.15.37:0/4258475089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f54102ce0 con 0x7f7f54108c90 2024-08-20T05:18:34.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.621+0000 7f7f4b400640 1 -- 172.21.15.37:0/4258475089 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7f4c003970 con 0x7f7f54108c90 2024-08-20T05:18:34.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.622+0000 7f7f4b400640 1 --2- 172.21.15.37:0/4258475089 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f380b3cf0 0x7f7f380b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:34.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.623+0000 7f7f4b400640 1 -- 172.21.15.37:0/4258475089 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f7f4c0e3be0 con 0x7f7f54108c90 2024-08-20T05:18:34.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.623+0000 7f7f52800640 1 --2- 172.21.15.37:0/4258475089 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f380b3cf0 0x7f7f380b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:34.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.623+0000 7f7f52800640 1 --2- 172.21.15.37:0/4258475089 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f380b3cf0 0x7f7f380b61b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7f44005ab0 tx=0x7f7f44005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:34.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.626+0000 7f7f4b400640 1 -- 172.21.15.37:0/4258475089 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f7f4c0aa7e0 con 0x7f7f54108c90 2024-08-20T05:18:34.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.870+0000 7f7f58a00640 1 -- 172.21.15.37:0/4258475089 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f5402e340 con 0x7f7f54108c90 2024-08-20T05:18:34.873 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:34 smithi037 ceph-mon[17265]: pgmap v891: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 KiB/s wr, 17 op/s 2024-08-20T05:18:34.873 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:34 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:18:34.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.871+0000 7f7f4b400640 1 -- 172.21.15.37:0/4258475089 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+11983 (secure 0 0 0) 0x7f7f4c0b3100 con 0x7f7f54108c90 2024-08-20T05:18:34.873 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:34.873 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":54,"btime":"2024-08-20T05:18:09:624585+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:18:08.860273+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:18:34.874 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 54 2024-08-20T05:18:34.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.874+0000 7f7f58a00640 1 -- 172.21.15.37:0/4258475089 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f380b3cf0 msgr2=0x7f7f380b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:34.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.874+0000 7f7f58a00640 1 --2- 172.21.15.37:0/4258475089 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f380b3cf0 0x7f7f380b61b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7f44005ab0 tx=0x7f7f44005a20 comp rx=0 tx=0).stop 2024-08-20T05:18:34.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.874+0000 7f7f58a00640 1 -- 172.21.15.37:0/4258475089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f54108c90 msgr2=0x7f7f5419e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:34.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.874+0000 7f7f58a00640 1 --2- 172.21.15.37:0/4258475089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f54108c90 0x7f7f5419e640 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c009fd0 tx=0x7f7f4c00b260 comp rx=0 tx=0).stop 2024-08-20T05:18:34.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.874+0000 7f7f58a00640 1 -- 172.21.15.37:0/4258475089 shutdown_connections 2024-08-20T05:18:34.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.874+0000 7f7f58a00640 1 --2- 172.21.15.37:0/4258475089 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7f380b3cf0 0x7f7f380b61b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:34.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.874+0000 7f7f58a00640 1 --2- 172.21.15.37:0/4258475089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f54108c90 0x7f7f5419e640 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:34.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.874+0000 7f7f58a00640 1 --2- 172.21.15.37:0/4258475089 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7f54108310 0x7f7f541992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:34.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.874+0000 7f7f58a00640 1 --2- 172.21.15.37:0/4258475089 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7f54102900 0x7f7f54198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:34.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.874+0000 7f7f58a00640 1 -- 172.21.15.37:0/4258475089 >> 172.21.15.37:0/4258475089 conn(0x7f7f540fe390 msgr2=0x7f7f541048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:34.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.874+0000 7f7f58a00640 1 -- 172.21.15.37:0/4258475089 shutdown_connections 2024-08-20T05:18:34.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:34.874+0000 7f7f58a00640 1 -- 172.21.15.37:0/4258475089 wait complete. 2024-08-20T05:18:34.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:34 smithi130 ceph-mon[22007]: pgmap v891: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 KiB/s wr, 17 op/s 2024-08-20T05:18:34.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:34 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:18:35.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:34 smithi135 ceph-mon[22342]: pgmap v891: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.9 KiB/s wr, 17 op/s 2024-08-20T05:18:35.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:34 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:18:35.862 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-20T05:18:35.903 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24695 quiesce db --cancel --all' 2024-08-20T05:18:35.903 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- timeout 105 ceph tell mds.24695 quiesce db --cancel --all 2024-08-20T05:18:35.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:35 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/4258475089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:18:35.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:35 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T05:18:35.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:35 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-08-20T05:18:35.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:35 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T05:18:35.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:35 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T05:18:35.992 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:35 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T05:18:35.993 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:35 smithi037 ceph-mon[17265]: Adjusting osd_memory_target on smithi130 to 176.0M 2024-08-20T05:18:35.993 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:35 smithi037 ceph-mon[17265]: Unable to set osd_memory_target on smithi130 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-08-20T05:18:35.993 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:35 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:18:35.993 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:35 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:18:35.993 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:35 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:18:36.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:35 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/4258475089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:18:36.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:35 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T05:18:36.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:35 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-08-20T05:18:36.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:35 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T05:18:36.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:35 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T05:18:36.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:35 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T05:18:36.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:35 smithi135 ceph-mon[22342]: Adjusting osd_memory_target on smithi130 to 176.0M 2024-08-20T05:18:36.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:35 smithi135 ceph-mon[22342]: Unable to set osd_memory_target on smithi130 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-08-20T05:18:36.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:35 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:18:36.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:35 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:18:36.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:35 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:18:36.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:35 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/4258475089' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:18:36.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:35 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-08-20T05:18:36.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:35 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi135", "name": "osd_memory_target"} : dispatch 2024-08-20T05:18:36.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:35 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-08-20T05:18:36.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:35 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-08-20T05:18:36.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:35 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-08-20T05:18:36.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:35 smithi130 ceph-mon[22007]: Adjusting osd_memory_target on smithi130 to 176.0M 2024-08-20T05:18:36.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:35 smithi130 ceph-mon[22007]: Unable to set osd_memory_target on smithi130 to 184575283: error parsing value: Value '184575283' is below minimum 939524096 2024-08-20T05:18:36.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:35 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:18:36.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:35 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:18:36.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:35 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:18:36.258 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:18:37.006 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:36 smithi037 ceph-mon[17265]: pgmap v892: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 15 op/s 2024-08-20T05:18:37.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.015+0000 7f27f3e00640 1 -- 172.21.15.37:0/3543941956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27ec075c70 msgr2=0x7f27ec10eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.015+0000 7f27f3e00640 1 --2- 172.21.15.37:0/3543941956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27ec075c70 0x7f27ec10eb00 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009900 tx=0x7f27d802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.015+0000 7f27f3e00640 1 -- 172.21.15.37:0/3543941956 shutdown_connections 2024-08-20T05:18:37.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.015+0000 7f27f3e00640 1 --2- 172.21.15.37:0/3543941956 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27ec10f0d0 0x7f27ec1114c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.015+0000 7f27f3e00640 1 --2- 172.21.15.37:0/3543941956 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27ec075c70 0x7f27ec10eb00 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.015+0000 7f27f3e00640 1 --2- 172.21.15.37:0/3543941956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27ec075270 0x7f27ec075650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.015+0000 7f27f3e00640 1 -- 172.21.15.37:0/3543941956 >> 172.21.15.37:0/3543941956 conn(0x7f27ec0fe520 msgr2=0x7f27ec100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:37.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.015+0000 7f27f3e00640 1 -- 172.21.15.37:0/3543941956 shutdown_connections 2024-08-20T05:18:37.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.015+0000 7f27f3e00640 1 -- 172.21.15.37:0/3543941956 wait complete. 2024-08-20T05:18:37.018 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:18:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.016+0000 7f27f3e00640 1 Processor -- start 2024-08-20T05:18:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.016+0000 7f27f3e00640 1 -- start start 2024-08-20T05:18:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.017+0000 7f27f3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27ec075270 0x7f27ec19b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.017+0000 7f27f3e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27ec075c70 0x7f27ec19b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.017+0000 7f27f3e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27ec10f0d0 0x7f27ec1a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.017+0000 7f27f3e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec114cd0 con 0x7f27ec075270 2024-08-20T05:18:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.017+0000 7f27f3e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec114b50 con 0x7f27ec10f0d0 2024-08-20T05:18:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.017+0000 7f27f3e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec114e50 con 0x7f27ec075c70 2024-08-20T05:18:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.017+0000 7f27f1400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27ec075270 0x7f27ec19b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.017+0000 7f27f1e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27ec10f0d0 0x7f27ec1a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.017+0000 7f27f0a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27ec075c70 0x7f27ec19b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.017+0000 7f27f1e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27ec10f0d0 0x7f27ec1a0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:52912/0 (socket says 172.21.15.37:52912) 2024-08-20T05:18:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.017+0000 7f27f0a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27ec075c70 0x7f27ec19b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:44332/0 (socket says 172.21.15.37:44332) 2024-08-20T05:18:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.017+0000 7f27f1e00640 1 -- 172.21.15.37:0/4279216857 learned_addr learned my addr 172.21.15.37:0/4279216857 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.018+0000 7f27f1e00640 1 -- 172.21.15.37:0/4279216857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27ec075c70 msgr2=0x7f27ec19b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.018+0000 7f27f1e00640 1 --2- 172.21.15.37:0/4279216857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27ec075c70 0x7f27ec19b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.018+0000 7f27f1e00640 1 -- 172.21.15.37:0/4279216857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27ec075270 msgr2=0x7f27ec19b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.018+0000 7f27f1e00640 1 --2- 172.21.15.37:0/4279216857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27ec075270 0x7f27ec19b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.018+0000 7f27f1e00640 1 -- 172.21.15.37:0/4279216857 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27ec1a12b0 con 0x7f27ec10f0d0 2024-08-20T05:18:37.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.018+0000 7f27f1e00640 1 --2- 172.21.15.37:0/4279216857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27ec10f0d0 0x7f27ec1a0ae0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f27e400d950 tx=0x7f27e400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:37.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.018+0000 7f27ea000640 1 -- 172.21.15.37:0/4279216857 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4017070 con 0x7f27ec10f0d0 2024-08-20T05:18:37.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.018+0000 7f27f3e00640 1 -- 172.21.15.37:0/4279216857 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27ec1a15a0 con 0x7f27ec10f0d0 2024-08-20T05:18:37.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.019+0000 7f27f3e00640 1 -- 172.21.15.37:0/4279216857 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27ec1a7c60 con 0x7f27ec10f0d0 2024-08-20T05:18:37.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.019+0000 7f27ea000640 1 -- 172.21.15.37:0/4279216857 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27e4009c30 con 0x7f27ec10f0d0 2024-08-20T05:18:37.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.019+0000 7f27ea000640 1 -- 172.21.15.37:0/4279216857 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e4020060 con 0x7f27ec10f0d0 2024-08-20T05:18:37.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.022+0000 7f27f680f740 1 Processor -- start 2024-08-20T05:18:37.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.022+0000 7f27ea000640 1 -- 172.21.15.37:0/4279216857 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f27e4003bf0 con 0x7f27ec10f0d0 2024-08-20T05:18:37.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.023+0000 7f27f680f740 1 -- start start 2024-08-20T05:18:37.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.023+0000 7f27f680f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c53900 0x564495c53ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.023+0000 7f27f680f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c54220 0x564495c5fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.023+0000 7f27f680f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 0x564495c625a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.023+0000 7f27f680f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564495bc9a60 con 0x564495c601b0 2024-08-20T05:18:37.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.023+0000 7f27f680f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564495bb8f60 con 0x564495c54220 2024-08-20T05:18:37.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.023+0000 7f27f680f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564495bbcfa0 con 0x564495c53900 2024-08-20T05:18:37.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.023+0000 7f27f1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c54220 0x564495c5fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.023+0000 7f27f1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c54220 0x564495c5fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:52926/0 (socket says 172.21.15.37:52926) 2024-08-20T05:18:37.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.023+0000 7f27f1400640 1 -- 172.21.15.37:0/2173854448 learned_addr learned my addr 172.21.15.37:0/2173854448 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:37.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.023+0000 7f27f0a00640 1 --2- 172.21.15.37:0/2173854448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c53900 0x564495c53ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.023+0000 7f27f0a00640 1 --2- 172.21.15.37:0/2173854448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 0x564495c625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.024+0000 7f27f1400640 1 -- 172.21.15.37:0/2173854448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c53900 msgr2=0x564495c53ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:37.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.024+0000 7f27f1400640 1 --2- 172.21.15.37:0/2173854448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c53900 0x564495c53ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.024+0000 7f27f1400640 1 -- 172.21.15.37:0/2173854448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 msgr2=0x564495c625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:37.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.024+0000 7f27f1400640 1 --2- 172.21.15.37:0/2173854448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 0x564495c625a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.024+0000 7f27f1400640 1 -- 172.21.15.37:0/2173854448 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564495b5f3e0 con 0x564495c54220 2024-08-20T05:18:37.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.024+0000 7f27f0a00640 1 --2- 172.21.15.37:0/2173854448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c53900 0x564495c53ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:18:37.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.024+0000 7f27f1400640 1 --2- 172.21.15.37:0/2173854448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c54220 0x564495c5fc70 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f27e00114f0 tx=0x7f27e00119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a13d3d9cf2437d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:37.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.024+0000 7f27de600640 1 -- 172.21.15.37:0/2173854448 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e001e070 con 0x564495c54220 2024-08-20T05:18:37.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.024+0000 7f27de600640 1 -- 172.21.15.37:0/2173854448 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27e000fad0 con 0x564495c54220 2024-08-20T05:18:37.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.024+0000 7f27de600640 1 -- 172.21.15.37:0/2173854448 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e0019b10 con 0x564495c54220 2024-08-20T05:18:37.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.024+0000 7f27ea000640 1 --2- 172.21.15.37:0/4279216857 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27d40b3c50 0x7f27d40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.025+0000 7f27ea000640 1 -- 172.21.15.37:0/4279216857 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f27e40e3850 con 0x7f27ec10f0d0 2024-08-20T05:18:37.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.025+0000 7f27f0a00640 1 --2- 172.21.15.37:0/4279216857 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27d40b3c50 0x7f27d40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.025+0000 7f27f680f740 1 -- 172.21.15.37:0/2173854448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c54220 msgr2=0x564495c5fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.025+0000 7f27f680f740 1 --2- 172.21.15.37:0/2173854448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c54220 0x564495c5fc70 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f27e00114f0 tx=0x7f27e00119b0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.026+0000 7f27f680f740 1 -- 172.21.15.37:0/2173854448 shutdown_connections 2024-08-20T05:18:37.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.026+0000 7f27f680f740 1 --2- 172.21.15.37:0/2173854448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 0x564495c625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.026+0000 7f27f680f740 1 --2- 172.21.15.37:0/2173854448 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c54220 0x564495c5fc70 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.026+0000 7f27f680f740 1 --2- 172.21.15.37:0/2173854448 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c53900 0x564495c53ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.026+0000 7f27f680f740 1 -- 172.21.15.37:0/2173854448 >> 172.21.15.37:0/2173854448 conn(0x564495c51730 msgr2=0x564495c528d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:37.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.026+0000 7f27f680f740 1 -- 172.21.15.37:0/2173854448 shutdown_connections 2024-08-20T05:18:37.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.026+0000 7f27f680f740 1 -- 172.21.15.37:0/2173854448 wait complete. 2024-08-20T05:18:37.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.026+0000 7f27f0a00640 1 --2- 172.21.15.37:0/4279216857 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27d40b3c50 0x7f27d40b6110 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f27d8005ab0 tx=0x7f27d8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:37.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.026+0000 7f27f680f740 1 -- start start 2024-08-20T05:18:37.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.026+0000 7f27f680f740 1 Processor -- start 2024-08-20T05:18:37.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.027+0000 7f27f680f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c53900 0x564495c5f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.027+0000 7f27f680f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c54220 0x564495c5cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.027+0000 7f27f680f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 0x564495c5d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.027+0000 7f27f680f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564495a1b700 con 0x564495c601b0 2024-08-20T05:18:37.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.027+0000 7f27f680f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x564495b54250 con 0x564495c54220 2024-08-20T05:18:37.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.027+0000 7f27f680f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x564495c62e30 con 0x564495c53900 2024-08-20T05:18:37.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.027+0000 7f27f680f740 10 client.0 _ll_register_callbacks cb 0x564495bb3180 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:37.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.027+0000 7f27f1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 0x564495c5d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.027+0000 7f27f1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 0x564495c5d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53012/0 (socket says 172.21.15.37:53012) 2024-08-20T05:18:37.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.027+0000 7f27f1e00640 1 -- 172.21.15.37:0/2688791857 learned_addr learned my addr 172.21.15.37:0/2688791857 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:37.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.027+0000 7f27f1400640 1 --2- 172.21.15.37:0/2688791857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c53900 0x564495c5f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.027+0000 7f27f0a00640 1 --2- 172.21.15.37:0/2688791857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c54220 0x564495c5cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.028+0000 7f27f1e00640 1 -- 172.21.15.37:0/2688791857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c53900 msgr2=0x564495c5f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:37.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.028+0000 7f27f1e00640 1 --2- 172.21.15.37:0/2688791857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c53900 0x564495c5f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.028+0000 7f27f1e00640 1 -- 172.21.15.37:0/2688791857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c54220 msgr2=0x564495c5cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:37.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.028+0000 7f27f1e00640 1 --2- 172.21.15.37:0/2688791857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c54220 0x564495c5cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.028+0000 7f27f1e00640 1 -- 172.21.15.37:0/2688791857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564495918650 con 0x564495c601b0 2024-08-20T05:18:37.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.028+0000 7f27f1e00640 1 --2- 172.21.15.37:0/2688791857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 0x564495c5d310 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f27e40a64d0 tx=0x7f27e40a9c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7b42c198ccff29 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:37.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.028+0000 7f27d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:18:37.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.028+0000 7f27d2a00640 1 -- 172.21.15.37:0/2688791857 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e40aa450 con 0x564495c601b0 2024-08-20T05:18:37.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.028+0000 7f27d2a00640 1 -- 172.21.15.37:0/2688791857 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f27e40a4d80 con 0x564495c601b0 2024-08-20T05:18:37.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.028+0000 7f27f680f740 1 -- 172.21.15.37:0/2688791857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27e000fad0 con 0x564495c601b0 2024-08-20T05:18:37.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.029+0000 7f27d2a00640 1 -- 172.21.15.37:0/2688791857 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f27e40ae9a0 con 0x564495c601b0 2024-08-20T05:18:37.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.029+0000 7f27f680f740 10 client.18549 fetch_fsmap learned FSMap version 55 2024-08-20T05:18:37.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.029+0000 7f27f680f740 1 -- 172.21.15.37:0/2688791857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x564495c6e6c0 con 0x564495c601b0 2024-08-20T05:18:37.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.029+0000 7f27d2a00640 1 -- 172.21.15.37:0/2688791857 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27e000fad0 con 0x564495c601b0 2024-08-20T05:18:37.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.029+0000 7f27d2a00640 1 -- 172.21.15.37:0/2688791857 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 55) ==== 8382+0+0 (secure 0 0 0) 0x7f27e40a91b0 con 0x564495c601b0 2024-08-20T05:18:37.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.029+0000 7f27f680f740 10 client.18549 fetch_fsmap finished waiting for FSMap version 55 2024-08-20T05:18:37.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.029+0000 7f27f680f740 10 client.18549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:18:37.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.029+0000 7f27f680f740 20 client.18549 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:37.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.029+0000 7f27f680f740 1 --2- 172.21.15.37:0/2688791857 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564495c6fb80 0x564495c71f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.030+0000 7f27f680f740 4 client.18549 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:18:37.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.030+0000 7f27f680f740 1 -- 172.21.15.37:0/2688791857 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564495bcb9b0 con 0x564495c6fb80 2024-08-20T05:18:37.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.030+0000 7f27f1400640 1 --2- 172.21.15.37:0/2688791857 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564495c6fb80 0x564495c71f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.031+0000 7f27f1400640 1 --2- 172.21.15.37:0/2688791857 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564495c6fb80 0x564495c71f70 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3823fe622594acdc server_cookie=8e8dc178befcf419 in_seq=0 out_seq=0 2024-08-20T05:18:37.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.031+0000 7f27d2a00640 10 client.18549 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:37.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.031+0000 7f27d2a00640 1 -- 172.21.15.37:0/2688791857 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564495bcb9b0 con 0x564495c6fb80 2024-08-20T05:18:37.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.031+0000 7f27d2a00640 10 client.18549 handle_command_reply: tid=0 2024-08-20T05:18:37.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.031+0000 7f27f680f740 1 client.18549 shutdown 2024-08-20T05:18:37.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.032+0000 7f27f680f740 1 -- 172.21.15.37:0/2688791857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 msgr2=0x564495c5d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.032+0000 7f27f680f740 1 --2- 172.21.15.37:0/2688791857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 0x564495c5d310 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f27e40a64d0 tx=0x7f27e40a9c80 comp rx=0 tx=0).stop 2024-08-20T05:18:37.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.032+0000 7f27f680f740 1 -- 172.21.15.37:0/2688791857 shutdown_connections 2024-08-20T05:18:37.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.032+0000 7f27f680f740 1 --2- 172.21.15.37:0/2688791857 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564495c6fb80 0x564495c71f70 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.032+0000 7f27f680f740 1 --2- 172.21.15.37:0/2688791857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 0x564495c5d310 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.032+0000 7f27f680f740 1 --2- 172.21.15.37:0/2688791857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c54220 0x564495c5cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.032+0000 7f27f680f740 1 --2- 172.21.15.37:0/2688791857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c53900 0x564495c5f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.032+0000 7f27f680f740 1 -- 172.21.15.37:0/2688791857 >> 172.21.15.37:0/2688791857 conn(0x564495c51730 msgr2=0x564495c572a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:37.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.032+0000 7f27d2a00640 0 client.18549 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:37.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.032+0000 7f27f680f740 1 -- 172.21.15.37:0/2688791857 shutdown_connections 2024-08-20T05:18:37.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.032+0000 7f27f680f740 1 -- 172.21.15.37:0/2688791857 wait complete. 2024-08-20T05:18:37.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.032+0000 7f27f680f740 20 client.18549 trim_cache size 0 max 16384 2024-08-20T05:18:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.060+0000 7f27f680f740 1 Processor -- start 2024-08-20T05:18:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.060+0000 7f27f680f740 1 -- start start 2024-08-20T05:18:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.060+0000 7f27f680f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c53900 0x564495c5eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.060+0000 7f27f680f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c54220 0x564495c77820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.060+0000 7f27f680f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c601b0 0x564495c77d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.060+0000 7f27f680f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec1b1a00 con 0x564495c53900 2024-08-20T05:18:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.060+0000 7f27f680f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec1b3570 con 0x564495c601b0 2024-08-20T05:18:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.060+0000 7f27f680f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec1b2100 con 0x564495c54220 2024-08-20T05:18:37.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.061+0000 7f27f1e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c601b0 0x564495c77d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.061+0000 7f27f0a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c54220 0x564495c77820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.061+0000 7f27f0a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c54220 0x564495c77820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:44360/0 (socket says 172.21.15.37:44360) 2024-08-20T05:18:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.061+0000 7f27f0a00640 1 -- 172.21.15.37:0/2865979790 learned_addr learned my addr 172.21.15.37:0/2865979790 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.061+0000 7f27f1400640 1 --2- 172.21.15.37:0/2865979790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c53900 0x564495c5eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.061+0000 7f27f0a00640 1 -- 172.21.15.37:0/2865979790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c601b0 msgr2=0x564495c77d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.061+0000 7f27f0a00640 1 --2- 172.21.15.37:0/2865979790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c601b0 0x564495c77d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.062+0000 7f27f0a00640 1 -- 172.21.15.37:0/2865979790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c53900 msgr2=0x564495c5eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.062+0000 7f27f0a00640 1 --2- 172.21.15.37:0/2865979790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c53900 0x564495c5eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.062+0000 7f27f0a00640 1 -- 172.21.15.37:0/2865979790 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564495c5cb80 con 0x564495c54220 2024-08-20T05:18:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.062+0000 7f27f0a00640 1 --2- 172.21.15.37:0/2865979790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c54220 0x564495c77820 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009230 tx=0x7f27d803f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b9107f4af001058 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.062+0000 7f27ddc00640 1 -- 172.21.15.37:0/2865979790 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d80314a0 con 0x564495c54220 2024-08-20T05:18:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.062+0000 7f27ddc00640 1 -- 172.21.15.37:0/2865979790 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27d8031af0 con 0x564495c54220 2024-08-20T05:18:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.062+0000 7f27ddc00640 1 -- 172.21.15.37:0/2865979790 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d8052b00 con 0x564495c54220 2024-08-20T05:18:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.063+0000 7f27f680f740 1 -- 172.21.15.37:0/2865979790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c54220 msgr2=0x564495c77820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.063+0000 7f27f680f740 1 --2- 172.21.15.37:0/2865979790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c54220 0x564495c77820 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f27d8009230 tx=0x7f27d803f040 comp rx=0 tx=0).stop 2024-08-20T05:18:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.063+0000 7f27f680f740 1 -- 172.21.15.37:0/2865979790 shutdown_connections 2024-08-20T05:18:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.063+0000 7f27f680f740 1 --2- 172.21.15.37:0/2865979790 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c601b0 0x564495c77d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.063+0000 7f27f680f740 1 --2- 172.21.15.37:0/2865979790 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c54220 0x564495c77820 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.063+0000 7f27f680f740 1 --2- 172.21.15.37:0/2865979790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c53900 0x564495c5eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.063+0000 7f27f680f740 1 -- 172.21.15.37:0/2865979790 >> 172.21.15.37:0/2865979790 conn(0x564495c51730 msgr2=0x564495c50810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.063+0000 7f27f680f740 1 -- 172.21.15.37:0/2865979790 shutdown_connections 2024-08-20T05:18:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.063+0000 7f27f680f740 1 -- 172.21.15.37:0/2865979790 wait complete. 2024-08-20T05:18:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.064+0000 7f27f680f740 1 -- start start 2024-08-20T05:18:37.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.064+0000 7f27f680f740 1 Processor -- start 2024-08-20T05:18:37.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.064+0000 7f27f680f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c53900 0x564495c685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.065+0000 7f27f680f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c54220 0x564495c65b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.065+0000 7f27f680f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 0x564495c66050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.065+0000 7f27f680f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec1b2ea0 con 0x564495c601b0 2024-08-20T05:18:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.065+0000 7f27f680f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec1b27d0 con 0x564495c53900 2024-08-20T05:18:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.065+0000 7f27f680f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f27ec1af9e0 con 0x564495c54220 2024-08-20T05:18:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.065+0000 7f27f680f740 10 client.0 _ll_register_callbacks cb 0x7f27e40035f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.065+0000 7f27f1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c53900 0x564495c685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.065+0000 7f27f1400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c53900 0x564495c685d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:52942/0 (socket says 172.21.15.37:52942) 2024-08-20T05:18:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.065+0000 7f27f0a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c54220 0x564495c65b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.065+0000 7f27f1400640 1 -- 172.21.15.37:0/678057495 learned_addr learned my addr 172.21.15.37:0/678057495 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.065+0000 7f27f1e00640 1 --2- 172.21.15.37:0/678057495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 0x564495c66050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.066+0000 7f27f0a00640 1 -- 172.21.15.37:0/678057495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c53900 msgr2=0x564495c685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:37.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.066+0000 7f27f0a00640 1 --2- 172.21.15.37:0/678057495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c53900 0x564495c685d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.066+0000 7f27f0a00640 1 -- 172.21.15.37:0/678057495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 msgr2=0x564495c66050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:37.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.066+0000 7f27f0a00640 1 --2- 172.21.15.37:0/678057495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 0x564495c66050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.066+0000 7f27f0a00640 1 -- 172.21.15.37:0/678057495 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564495c666c0 con 0x564495c54220 2024-08-20T05:18:37.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.066+0000 7f27f1400640 1 --2- 172.21.15.37:0/678057495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c53900 0x564495c685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:37.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.066+0000 7f27f1e00640 1 --2- 172.21.15.37:0/678057495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 0x564495c66050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:37.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.066+0000 7f27f0a00640 1 --2- 172.21.15.37:0/678057495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c54220 0x564495c65b10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f27d8031440 tx=0x7f27d8003f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb49e00411002e2b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:37.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.066+0000 7f27d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:18:37.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.067+0000 7f27d2a00640 1 -- 172.21.15.37:0/678057495 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d80316b0 con 0x564495c54220 2024-08-20T05:18:37.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.067+0000 7f27d2a00640 1 -- 172.21.15.37:0/678057495 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f27d8031850 con 0x564495c54220 2024-08-20T05:18:37.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.067+0000 7f27f680f740 1 -- 172.21.15.37:0/678057495 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27d8031af0 con 0x564495c54220 2024-08-20T05:18:37.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.067+0000 7f27d2a00640 1 -- 172.21.15.37:0/678057495 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f27d8064050 con 0x564495c54220 2024-08-20T05:18:37.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.067+0000 7f27f680f740 10 client.29347 fetch_fsmap learned FSMap version 55 2024-08-20T05:18:37.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.067+0000 7f27f680f740 1 -- 172.21.15.37:0/678057495 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x564495cda6c0 con 0x564495c54220 2024-08-20T05:18:37.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.067+0000 7f27d2a00640 1 -- 172.21.15.37:0/678057495 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27d8031af0 con 0x564495c54220 2024-08-20T05:18:37.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.068+0000 7f27d2a00640 1 -- 172.21.15.37:0/678057495 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 55) ==== 8382+0+0 (secure 0 0 0) 0x7f27d8044050 con 0x564495c54220 2024-08-20T05:18:37.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.068+0000 7f27f680f740 10 client.29347 fetch_fsmap finished waiting for FSMap version 55 2024-08-20T05:18:37.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.068+0000 7f27f680f740 10 client.29347 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:18:37.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.068+0000 7f27f680f740 20 client.29347 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:37.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.068+0000 7f27f680f740 1 --2- 172.21.15.37:0/678057495 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564495cdad90 0x564495cdd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.068+0000 7f27f680f740 4 client.29347 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-20T05:18:37.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.068+0000 7f27f680f740 1 -- 172.21.15.37:0/678057495 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564495bc7450 con 0x564495cdad90 2024-08-20T05:18:37.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.068+0000 7f27f1400640 1 --2- 172.21.15.37:0/678057495 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564495cdad90 0x564495cdd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.069+0000 7f27f1400640 1 --2- 172.21.15.37:0/678057495 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564495cdad90 0x564495cdd1b0 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1fecf8dd7e06cd1 server_cookie=8f8332601eb60e80 in_seq=0 out_seq=0 2024-08-20T05:18:37.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.069+0000 7f27d2a00640 10 client.29347 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:37.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.069+0000 7f27d2a00640 1 -- 172.21.15.37:0/678057495 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564495bc7450 con 0x564495cdad90 2024-08-20T05:18:37.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.069+0000 7f27d2a00640 10 client.29347 handle_command_reply: tid=0 2024-08-20T05:18:37.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.069+0000 7f27f680f740 1 client.29347 shutdown 2024-08-20T05:18:37.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.069+0000 7f27f680f740 1 -- 172.21.15.37:0/678057495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c54220 msgr2=0x564495c65b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.069+0000 7f27f680f740 1 --2- 172.21.15.37:0/678057495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c54220 0x564495c65b10 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f27d8031440 tx=0x7f27d8003f60 comp rx=0 tx=0).stop 2024-08-20T05:18:37.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.069+0000 7f27f680f740 1 -- 172.21.15.37:0/678057495 shutdown_connections 2024-08-20T05:18:37.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.069+0000 7f27f680f740 1 --2- 172.21.15.37:0/678057495 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x564495cdad90 0x564495cdd1b0 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.069+0000 7f27f680f740 1 --2- 172.21.15.37:0/678057495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564495c601b0 0x564495c66050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.069+0000 7f27f680f740 1 --2- 172.21.15.37:0/678057495 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x564495c54220 0x564495c65b10 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.069+0000 7f27f680f740 1 --2- 172.21.15.37:0/678057495 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x564495c53900 0x564495c685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.069+0000 7f27d2a00640 0 client.29347 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:37.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.069+0000 7f27f680f740 1 -- 172.21.15.37:0/678057495 >> 172.21.15.37:0/678057495 conn(0x564495c51730 msgr2=0x564495c5b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:37.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.070+0000 7f27f680f740 1 -- 172.21.15.37:0/678057495 shutdown_connections 2024-08-20T05:18:37.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.070+0000 7f27f680f740 1 -- 172.21.15.37:0/678057495 wait complete. 2024-08-20T05:18:37.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.070+0000 7f27f680f740 20 client.29347 trim_cache size 0 max 16384 2024-08-20T05:18:37.074 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:18:37.074 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "no active scrubs running", 2024-08-20T05:18:37.074 INFO:teuthology.orchestra.run.smithi037.stdout: "scrubs": {} 2024-08-20T05:18:37.075 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:18:37.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.071+0000 7f27f3e00640 1 -- 172.21.15.37:0/4279216857 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27d40b3c50 msgr2=0x7f27d40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.071+0000 7f27f3e00640 1 --2- 172.21.15.37:0/4279216857 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27d40b3c50 0x7f27d40b6110 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f27d8005ab0 tx=0x7f27d8005a20 comp rx=0 tx=0).stop 2024-08-20T05:18:37.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.071+0000 7f27f3e00640 1 -- 172.21.15.37:0/4279216857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27ec10f0d0 msgr2=0x7f27ec1a0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.071+0000 7f27f3e00640 1 --2- 172.21.15.37:0/4279216857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27ec10f0d0 0x7f27ec1a0ae0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f27e400d950 tx=0x7f27e400de10 comp rx=0 tx=0).stop 2024-08-20T05:18:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.071+0000 7f27f3e00640 1 -- 172.21.15.37:0/4279216857 shutdown_connections 2024-08-20T05:18:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.071+0000 7f27f3e00640 1 --2- 172.21.15.37:0/4279216857 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f27d40b3c50 0x7f27d40b6110 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.071+0000 7f27f3e00640 1 --2- 172.21.15.37:0/4279216857 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f27ec10f0d0 0x7f27ec1a0ae0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.071+0000 7f27f3e00640 1 --2- 172.21.15.37:0/4279216857 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f27ec075c70 0x7f27ec19b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.071+0000 7f27f3e00640 1 --2- 172.21.15.37:0/4279216857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27ec075270 0x7f27ec19b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.071+0000 7f27f3e00640 1 -- 172.21.15.37:0/4279216857 >> 172.21.15.37:0/4279216857 conn(0x7f27ec0fe520 msgr2=0x7f27ec1112a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.071+0000 7f27f3e00640 1 -- 172.21.15.37:0/4279216857 shutdown_connections 2024-08-20T05:18:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:37.071+0000 7f27f3e00640 1 -- 172.21.15.37:0/4279216857 wait complete. 2024-08-20T05:18:37.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:36 smithi135 ceph-mon[22342]: pgmap v892: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 15 op/s 2024-08-20T05:18:37.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:36 smithi130 ceph-mon[22007]: pgmap v892: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 15 op/s 2024-08-20T05:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.884+0000 7f0b82800640 1 -- 172.21.15.37:0/770686064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7c06b170 msgr2=0x7f0b7c105060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.884+0000 7f0b82800640 1 --2- 172.21.15.37:0/770686064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7c06b170 0x7f0b7c105060 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0b70009900 tx=0x7f0b7002a3f0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.884+0000 7f0b82800640 1 -- 172.21.15.37:0/770686064 shutdown_connections 2024-08-20T05:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.884+0000 7f0b82800640 1 --2- 172.21.15.37:0/770686064 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b7c1081a0 0x7f0b7c10a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.884+0000 7f0b82800640 1 --2- 172.21.15.37:0/770686064 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b7c1055f0 0x7f0b7c107a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.886 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.884+0000 7f0b82800640 1 --2- 172.21.15.37:0/770686064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7c06b170 0x7f0b7c105060 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.884+0000 7f0b82800640 1 -- 172.21.15.37:0/770686064 >> 172.21.15.37:0/770686064 conn(0x7f0b7c0fcc50 msgr2=0x7f0b7c0ff070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.884+0000 7f0b82800640 1 -- 172.21.15.37:0/770686064 shutdown_connections 2024-08-20T05:18:37.887 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.884+0000 7f0b82800640 1 -- 172.21.15.37:0/770686064 wait complete. 2024-08-20T05:18:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.885+0000 7f0b82800640 1 Processor -- start 2024-08-20T05:18:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.885+0000 7f0b82800640 1 -- start start 2024-08-20T05:18:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.885+0000 7f0b82800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b7c06b170 0x7f0b7c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.885+0000 7f0b82800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b7c1055f0 0x7f0b7c19b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.885+0000 7f0b82800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7c1081a0 0x7f0b7c19bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.885+0000 7f0b82800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c10e140 con 0x7f0b7c1081a0 2024-08-20T05:18:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.885+0000 7f0b82800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c10dfc0 con 0x7f0b7c06b170 2024-08-20T05:18:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.885+0000 7f0b82800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c10e2c0 con 0x7f0b7c1055f0 2024-08-20T05:18:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.886+0000 7f0b81400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b7c06b170 0x7f0b7c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.889 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.886+0000 7f0b81e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7c1081a0 0x7f0b7c19bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.886+0000 7f0b81400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b7c06b170 0x7f0b7c19aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:52968/0 (socket says 172.21.15.37:52968) 2024-08-20T05:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.886+0000 7f0b81400640 1 -- 172.21.15.37:0/260849445 learned_addr learned my addr 172.21.15.37:0/260849445 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.886+0000 7f0b80a00640 1 --2- 172.21.15.37:0/260849445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b7c1055f0 0x7f0b7c19b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.886+0000 7f0b81400640 1 -- 172.21.15.37:0/260849445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b7c1055f0 msgr2=0x7f0b7c19b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.886+0000 7f0b81400640 1 --2- 172.21.15.37:0/260849445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b7c1055f0 0x7f0b7c19b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.886+0000 7f0b81400640 1 -- 172.21.15.37:0/260849445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7c1081a0 msgr2=0x7f0b7c19bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.886+0000 7f0b81400640 1 --2- 172.21.15.37:0/260849445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7c1081a0 0x7f0b7c19bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.886+0000 7f0b81400640 1 -- 172.21.15.37:0/260849445 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b7c19c5c0 con 0x7f0b7c06b170 2024-08-20T05:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.886+0000 7f0b81e00640 1 --2- 172.21.15.37:0/260849445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7c1081a0 0x7f0b7c19bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.886+0000 7f0b81400640 1 --2- 172.21.15.37:0/260849445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b7c06b170 0x7f0b7c19aa80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0b70005ab0 tx=0x7f0b70003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.887+0000 7f0b7a000640 1 -- 172.21.15.37:0/260849445 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b7003f070 con 0x7f0b7c06b170 2024-08-20T05:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.887+0000 7f0b7a000640 1 -- 172.21.15.37:0/260849445 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b70031c50 con 0x7f0b7c06b170 2024-08-20T05:18:37.890 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.887+0000 7f0b7a000640 1 -- 172.21.15.37:0/260849445 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70035030 con 0x7f0b7c06b170 2024-08-20T05:18:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.887+0000 7f0b82800640 1 -- 172.21.15.37:0/260849445 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b7c19c850 con 0x7f0b7c06b170 2024-08-20T05:18:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.887+0000 7f0b82800640 1 -- 172.21.15.37:0/260849445 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b7c1a2f80 con 0x7f0b7c06b170 2024-08-20T05:18:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.890+0000 7f0b86dee740 1 Processor -- start 2024-08-20T05:18:37.891 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.890+0000 7f0b86dee740 1 -- start start 2024-08-20T05:18:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.890+0000 7f0b86dee740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 0x5573cd854be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.890+0000 7f0b86dee740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd855120 0x5573cd857510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.890+0000 7f0b86dee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd857b60 0x5573cd85a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.890+0000 7f0b86dee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5573cd7c5210 con 0x5573cd857b60 2024-08-20T05:18:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.890+0000 7f0b86dee740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5573cd7b4710 con 0x5573cd855120 2024-08-20T05:18:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.890+0000 7f0b86dee740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5573cd7b8750 con 0x5573cd8527f0 2024-08-20T05:18:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.890+0000 7f0b7a000640 1 -- 172.21.15.37:0/260849445 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0b70042070 con 0x7f0b7c06b170 2024-08-20T05:18:37.893 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.890+0000 7f0b80a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd857b60 0x5573cd85a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.890+0000 7f0b81e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 0x5573cd854be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.890+0000 7f0b81e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 0x5573cd854be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:44380/0 (socket says 172.21.15.37:44380) 2024-08-20T05:18:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.890+0000 7f0b81e00640 1 -- 172.21.15.37:0/2670441202 learned_addr learned my addr 172.21.15.37:0/2670441202 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.891+0000 7f0b81400640 1 --2- 172.21.15.37:0/2670441202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd855120 0x5573cd857510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.891+0000 7f0b80a00640 1 -- 172.21.15.37:0/2670441202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 msgr2=0x5573cd854be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.891+0000 7f0b80a00640 1 --2- 172.21.15.37:0/2670441202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 0x5573cd854be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.891+0000 7f0b80a00640 1 -- 172.21.15.37:0/2670441202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd855120 msgr2=0x5573cd857510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.891+0000 7f0b80a00640 1 --2- 172.21.15.37:0/2670441202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd855120 0x5573cd857510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.891+0000 7f0b80a00640 1 -- 172.21.15.37:0/2670441202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573cd780de0 con 0x5573cd857b60 2024-08-20T05:18:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.891+0000 7f0b81e00640 1 --2- 172.21.15.37:0/2670441202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 0x5573cd854be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.891+0000 7f0b80a00640 1 --2- 172.21.15.37:0/2670441202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd857b60 0x5573cd85a020 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009c00 tx=0x7f0b68011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d470d90927b1c200 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:37.894 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.891+0000 7f0b6e600640 1 -- 172.21.15.37:0/2670441202 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68004230 con 0x5573cd857b60 2024-08-20T05:18:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.891+0000 7f0b6e600640 1 -- 172.21.15.37:0/2670441202 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b680043d0 con 0x5573cd857b60 2024-08-20T05:18:37.895 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.891+0000 7f0b6e600640 1 -- 172.21.15.37:0/2670441202 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68004c60 con 0x5573cd857b60 2024-08-20T05:18:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.892+0000 7f0b7a000640 1 --2- 172.21.15.37:0/260849445 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0b640b3bd0 0x7f0b640b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.892+0000 7f0b7a000640 1 -- 172.21.15.37:0/260849445 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0b701046b0 con 0x7f0b7c06b170 2024-08-20T05:18:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.892+0000 7f0b81e00640 1 --2- 172.21.15.37:0/260849445 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0b640b3bd0 0x7f0b640b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.892+0000 7f0b86dee740 1 -- 172.21.15.37:0/2670441202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd857b60 msgr2=0x5573cd85a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.892+0000 7f0b86dee740 1 --2- 172.21.15.37:0/2670441202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd857b60 0x5573cd85a020 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009c00 tx=0x7f0b68011810 comp rx=0 tx=0).stop 2024-08-20T05:18:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.893+0000 7f0b86dee740 1 -- 172.21.15.37:0/2670441202 shutdown_connections 2024-08-20T05:18:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.893+0000 7f0b86dee740 1 --2- 172.21.15.37:0/2670441202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd857b60 0x5573cd85a020 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.893+0000 7f0b86dee740 1 --2- 172.21.15.37:0/2670441202 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd855120 0x5573cd857510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.896 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.893+0000 7f0b86dee740 1 --2- 172.21.15.37:0/2670441202 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 0x5573cd854be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.893+0000 7f0b86dee740 1 -- 172.21.15.37:0/2670441202 >> 172.21.15.37:0/2670441202 conn(0x5573cd84d940 msgr2=0x5573cd84e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.893+0000 7f0b86dee740 1 -- 172.21.15.37:0/2670441202 shutdown_connections 2024-08-20T05:18:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.893+0000 7f0b86dee740 1 -- 172.21.15.37:0/2670441202 wait complete. 2024-08-20T05:18:37.897 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.893+0000 7f0b81e00640 1 --2- 172.21.15.37:0/260849445 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0b640b3bd0 0x7f0b640b6090 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0b74009fd0 tx=0x7f0b74009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:37.897 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:37 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:18:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.893+0000 7f0b86dee740 1 -- start start 2024-08-20T05:18:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.894+0000 7f0b86dee740 1 Processor -- start 2024-08-20T05:18:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.894+0000 7f0b86dee740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 0x5573cd85bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.894+0000 7f0b86dee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd855120 0x5573cd85c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.894+0000 7f0b86dee740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd857b60 0x5573cd85d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.901 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.894+0000 7f0b86dee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5573cd6edab0 con 0x5573cd855120 2024-08-20T05:18:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.894+0000 7f0b86dee740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5573cd75b140 con 0x5573cd857b60 2024-08-20T05:18:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.894+0000 7f0b86dee740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5573cd85ab40 con 0x5573cd8527f0 2024-08-20T05:18:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.894+0000 7f0b86dee740 10 client.0 _ll_register_callbacks cb 0x5573cd76e5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.894+0000 7f0b80a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd855120 0x5573cd85c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.894+0000 7f0b81400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 0x5573cd85bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.894+0000 7f0b81400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 0x5573cd85bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:44396/0 (socket says 172.21.15.37:44396) 2024-08-20T05:18:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.894+0000 7f0b80a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd855120 0x5573cd85c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53080/0 (socket says 172.21.15.37:53080) 2024-08-20T05:18:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.894+0000 7f0b81400640 1 -- 172.21.15.37:0/1708619751 learned_addr learned my addr 172.21.15.37:0/1708619751 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.895+0000 7f0b81e00640 1 --2- 172.21.15.37:0/1708619751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd857b60 0x5573cd85d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.895+0000 7f0b81400640 1 -- 172.21.15.37:0/1708619751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd857b60 msgr2=0x5573cd85d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.895+0000 7f0b81400640 1 --2- 172.21.15.37:0/1708619751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd857b60 0x5573cd85d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.895+0000 7f0b81400640 1 -- 172.21.15.37:0/1708619751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd855120 msgr2=0x5573cd85c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:37.902 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.895+0000 7f0b81400640 1 --2- 172.21.15.37:0/1708619751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd855120 0x5573cd85c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.895+0000 7f0b81400640 1 -- 172.21.15.37:0/1708619751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573cd75c170 con 0x5573cd8527f0 2024-08-20T05:18:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.895+0000 7f0b80a00640 1 --2- 172.21.15.37:0/1708619751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd855120 0x5573cd85c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.895+0000 7f0b81e00640 1 --2- 172.21.15.37:0/1708619751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd857b60 0x5573cd85d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.895+0000 7f0b81400640 1 --2- 172.21.15.37:0/1708619751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 0x5573cd85bed0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0b700c8520 tx=0x7f0b700cb080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44d51c54731abb21 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.895+0000 7f0b62a00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:18:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.895+0000 7f0b62a00640 1 -- 172.21.15.37:0/1708619751 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70049070 con 0x5573cd8527f0 2024-08-20T05:18:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.895+0000 7f0b86dee740 1 -- 172.21.15.37:0/1708619751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b680043d0 con 0x5573cd8527f0 2024-08-20T05:18:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.895+0000 7f0b62a00640 1 -- 172.21.15.37:0/1708619751 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0b70104370 con 0x5573cd8527f0 2024-08-20T05:18:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.896+0000 7f0b62a00640 1 -- 172.21.15.37:0/1708619751 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f0b700cadc0 con 0x5573cd8527f0 2024-08-20T05:18:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.896+0000 7f0b86dee740 10 client.29359 fetch_fsmap learned FSMap version 55 2024-08-20T05:18:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.896+0000 7f0b86dee740 1 -- 172.21.15.37:0/1708619751 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5573cd517790 con 0x5573cd8527f0 2024-08-20T05:18:37.903 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.896+0000 7f0b62a00640 1 -- 172.21.15.37:0/1708619751 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b680043d0 con 0x5573cd8527f0 2024-08-20T05:18:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.896+0000 7f0b62a00640 1 -- 172.21.15.37:0/1708619751 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 55) ==== 8382+0+0 (secure 0 0 0) 0x7f0b700d3e20 con 0x5573cd8527f0 2024-08-20T05:18:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.896+0000 7f0b86dee740 10 client.29359 fetch_fsmap finished waiting for FSMap version 55 2024-08-20T05:18:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.896+0000 7f0b86dee740 10 client.29359 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:18:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.896+0000 7f0b86dee740 20 client.29359 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.896+0000 7f0b86dee740 1 --2- 172.21.15.37:0/1708619751 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5573cd867a10 0x5573cd869e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.896+0000 7f0b86dee740 4 client.29359 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:18:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.896+0000 7f0b86dee740 1 -- 172.21.15.37:0/1708619751 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5573cd7c7160 con 0x5573cd867a10 2024-08-20T05:18:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.897+0000 7f0b80a00640 1 --2- 172.21.15.37:0/1708619751 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5573cd867a10 0x5573cd869e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.897+0000 7f0b80a00640 1 --2- 172.21.15.37:0/1708619751 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5573cd867a10 0x5573cd869e60 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed56ce2d069c6598 server_cookie=8925a7c069bc575e in_seq=0 out_seq=0 2024-08-20T05:18:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.897+0000 7f0b62a00640 10 client.29359 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.898+0000 7f0b62a00640 1 -- 172.21.15.37:0/1708619751 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5573cd7c7160 con 0x5573cd867a10 2024-08-20T05:18:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.898+0000 7f0b62a00640 10 client.29359 handle_command_reply: tid=0 2024-08-20T05:18:37.904 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.898+0000 7f0b86dee740 1 client.29359 shutdown 2024-08-20T05:18:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.899+0000 7f0b86dee740 1 -- 172.21.15.37:0/1708619751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 msgr2=0x5573cd85bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.899+0000 7f0b86dee740 1 --2- 172.21.15.37:0/1708619751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 0x5573cd85bed0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0b700c8520 tx=0x7f0b700cb080 comp rx=0 tx=0).stop 2024-08-20T05:18:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.899+0000 7f0b86dee740 1 -- 172.21.15.37:0/1708619751 shutdown_connections 2024-08-20T05:18:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.899+0000 7f0b86dee740 1 --2- 172.21.15.37:0/1708619751 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5573cd867a10 0x5573cd869e60 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.899+0000 7f0b86dee740 1 --2- 172.21.15.37:0/1708619751 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd857b60 0x5573cd85d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.899+0000 7f0b86dee740 1 --2- 172.21.15.37:0/1708619751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd855120 0x5573cd85c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.899+0000 7f0b86dee740 1 --2- 172.21.15.37:0/1708619751 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 0x5573cd85bed0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.899+0000 7f0b86dee740 1 -- 172.21.15.37:0/1708619751 >> 172.21.15.37:0/1708619751 conn(0x5573cd84d940 msgr2=0x5573cd84c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.899+0000 7f0b62a00640 0 client.29359 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.899+0000 7f0b86dee740 1 -- 172.21.15.37:0/1708619751 shutdown_connections 2024-08-20T05:18:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.899+0000 7f0b86dee740 1 -- 172.21.15.37:0/1708619751 wait complete. 2024-08-20T05:18:37.905 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.899+0000 7f0b86dee740 20 client.29359 trim_cache size 0 max 16384 2024-08-20T05:18:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.915+0000 7f0b86dee740 1 Processor -- start 2024-08-20T05:18:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.915+0000 7f0b86dee740 1 -- start start 2024-08-20T05:18:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.915+0000 7f0b86dee740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd8527f0 0x5573cd851c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.915+0000 7f0b86dee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd855120 0x5573cd8521c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.918 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.915+0000 7f0b86dee740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd857b60 0x5573cd858af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.915+0000 7f0b86dee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c1ad2f0 con 0x5573cd855120 2024-08-20T05:18:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.915+0000 7f0b86dee740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c1aee60 con 0x5573cd8527f0 2024-08-20T05:18:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.915+0000 7f0b86dee740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c1ad9f0 con 0x5573cd857b60 2024-08-20T05:18:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.916+0000 7f0b81400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd8527f0 0x5573cd851c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.916+0000 7f0b81400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd8527f0 0x5573cd851c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53002/0 (socket says 172.21.15.37:53002) 2024-08-20T05:18:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.916+0000 7f0b81400640 1 -- 172.21.15.37:0/2472814327 learned_addr learned my addr 172.21.15.37:0/2472814327 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.916+0000 7f0b80a00640 1 --2- 172.21.15.37:0/2472814327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd855120 0x5573cd8521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.916+0000 7f0b81e00640 1 --2- 172.21.15.37:0/2472814327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd857b60 0x5573cd858af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.916+0000 7f0b81400640 1 -- 172.21.15.37:0/2472814327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd857b60 msgr2=0x5573cd858af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.916+0000 7f0b81400640 1 --2- 172.21.15.37:0/2472814327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd857b60 0x5573cd858af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.916+0000 7f0b81400640 1 -- 172.21.15.37:0/2472814327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd855120 msgr2=0x5573cd8521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:37.919 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.916+0000 7f0b81400640 1 --2- 172.21.15.37:0/2472814327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd855120 0x5573cd8521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.916+0000 7f0b81400640 1 -- 172.21.15.37:0/2472814327 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573cd590620 con 0x5573cd8527f0 2024-08-20T05:18:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.916+0000 7f0b81e00640 1 --2- 172.21.15.37:0/2472814327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd857b60 0x5573cd858af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:18:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.916+0000 7f0b81400640 1 --2- 172.21.15.37:0/2472814327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd8527f0 0x5573cd851c80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0b700cb240 tx=0x7f0b700d2c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a08c01fc8d7f7a5c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.916+0000 7f0b6dc00640 1 -- 172.21.15.37:0/2472814327 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70049040 con 0x5573cd8527f0 2024-08-20T05:18:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.916+0000 7f0b6dc00640 1 -- 172.21.15.37:0/2472814327 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b700cb2b0 con 0x5573cd8527f0 2024-08-20T05:18:37.920 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.916+0000 7f0b6dc00640 1 -- 172.21.15.37:0/2472814327 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70104370 con 0x5573cd8527f0 2024-08-20T05:18:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.917+0000 7f0b86dee740 1 -- 172.21.15.37:0/2472814327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd8527f0 msgr2=0x5573cd851c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.922 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.917+0000 7f0b86dee740 1 --2- 172.21.15.37:0/2472814327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd8527f0 0x5573cd851c80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0b700cb240 tx=0x7f0b700d2c10 comp rx=0 tx=0).stop 2024-08-20T05:18:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.917+0000 7f0b86dee740 1 -- 172.21.15.37:0/2472814327 shutdown_connections 2024-08-20T05:18:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.917+0000 7f0b86dee740 1 --2- 172.21.15.37:0/2472814327 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd857b60 0x5573cd858af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.917+0000 7f0b86dee740 1 --2- 172.21.15.37:0/2472814327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd855120 0x5573cd8521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.917+0000 7f0b86dee740 1 --2- 172.21.15.37:0/2472814327 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd8527f0 0x5573cd851c80 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.917+0000 7f0b86dee740 1 -- 172.21.15.37:0/2472814327 >> 172.21.15.37:0/2472814327 conn(0x5573cd84d940 msgr2=0x5573cd857f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.917+0000 7f0b86dee740 1 -- 172.21.15.37:0/2472814327 shutdown_connections 2024-08-20T05:18:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.917+0000 7f0b86dee740 1 -- 172.21.15.37:0/2472814327 wait complete. 2024-08-20T05:18:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.918+0000 7f0b86dee740 1 -- start start 2024-08-20T05:18:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.918+0000 7f0b86dee740 1 Processor -- start 2024-08-20T05:18:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.918+0000 7f0b86dee740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 0x5573cd860b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.918+0000 7f0b86dee740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd855120 0x5573cd8611f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.918+0000 7f0b86dee740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd857b60 0x5573cd861dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.923 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.918+0000 7f0b86dee740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c1ae790 con 0x5573cd857b60 2024-08-20T05:18:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.918+0000 7f0b86dee740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c1ae0c0 con 0x5573cd855120 2024-08-20T05:18:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.918+0000 7f0b86dee740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f0b7c1ab2d0 con 0x5573cd8527f0 2024-08-20T05:18:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.918+0000 7f0b86dee740 10 client.0 _ll_register_callbacks cb 0x7f0b70005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.919+0000 7f0b81e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd857b60 0x5573cd861dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.919+0000 7f0b80a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd855120 0x5573cd8611f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.919+0000 7f0b81e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd857b60 0x5573cd861dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53090/0 (socket says 172.21.15.37:53090) 2024-08-20T05:18:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.919+0000 7f0b81e00640 1 -- 172.21.15.37:0/2178650702 learned_addr learned my addr 172.21.15.37:0/2178650702 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.919+0000 7f0b81400640 1 --2- 172.21.15.37:0/2178650702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 0x5573cd860b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.919+0000 7f0b80a00640 1 -- 172.21.15.37:0/2178650702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 msgr2=0x5573cd860b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.919+0000 7f0b80a00640 1 --2- 172.21.15.37:0/2178650702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 0x5573cd860b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.919+0000 7f0b80a00640 1 -- 172.21.15.37:0/2178650702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd857b60 msgr2=0x5573cd861dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.919+0000 7f0b80a00640 1 --2- 172.21.15.37:0/2178650702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd857b60 0x5573cd861dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.919+0000 7f0b80a00640 1 -- 172.21.15.37:0/2178650702 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573cd8625f0 con 0x5573cd855120 2024-08-20T05:18:37.924 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.919+0000 7f0b81400640 1 --2- 172.21.15.37:0/2178650702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 0x5573cd860b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.919+0000 7f0b81e00640 1 --2- 172.21.15.37:0/2178650702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd857b60 0x5573cd861dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.919+0000 7f0b80a00640 1 --2- 172.21.15.37:0/2178650702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd855120 0x5573cd8611f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0b68005890 tx=0x7f0b68005f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3d48ac0be74ab09 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.919+0000 7f0b62a00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:18:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.920+0000 7f0b62a00640 1 -- 172.21.15.37:0/2178650702 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b6801e040 con 0x5573cd855120 2024-08-20T05:18:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.920+0000 7f0b86dee740 1 -- 172.21.15.37:0/2178650702 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b700cb2b0 con 0x5573cd855120 2024-08-20T05:18:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.920+0000 7f0b62a00640 1 -- 172.21.15.37:0/2178650702 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f0b68019a60 con 0x5573cd855120 2024-08-20T05:18:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.920+0000 7f0b62a00640 1 -- 172.21.15.37:0/2178650702 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f0b6803a050 con 0x5573cd855120 2024-08-20T05:18:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.920+0000 7f0b86dee740 10 client.29354 fetch_fsmap learned FSMap version 55 2024-08-20T05:18:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.920+0000 7f0b86dee740 1 -- 172.21.15.37:0/2178650702 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5573cd8639d0 con 0x5573cd855120 2024-08-20T05:18:37.925 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.921+0000 7f0b62a00640 1 -- 172.21.15.37:0/2178650702 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b700cb2b0 con 0x5573cd855120 2024-08-20T05:18:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.922+0000 7f0b62a00640 1 -- 172.21.15.37:0/2178650702 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 55) ==== 8382+0+0 (secure 0 0 0) 0x7f0b68024040 con 0x5573cd855120 2024-08-20T05:18:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.922+0000 7f0b86dee740 10 client.29354 fetch_fsmap finished waiting for FSMap version 55 2024-08-20T05:18:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.922+0000 7f0b86dee740 10 client.29354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-20T05:18:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.922+0000 7f0b86dee740 20 client.29354 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:37.926 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.922+0000 7f0b86dee740 1 --2- 172.21.15.37:0/2178650702 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5573cd8d2740 0x5573cd8d4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.922+0000 7f0b86dee740 4 client.29354 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-20T05:18:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.922+0000 7f0b86dee740 1 -- 172.21.15.37:0/2178650702 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5573cd7c2c00 con 0x5573cd8d2740 2024-08-20T05:18:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.922+0000 7f0b81400640 1 --2- 172.21.15.37:0/2178650702 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5573cd8d2740 0x5573cd8d4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.922+0000 7f0b81400640 1 --2- 172.21.15.37:0/2178650702 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5573cd8d2740 0x5573cd8d4b30 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61131bead6d0bd1a server_cookie=5a193b1cf48cd3c in_seq=0 out_seq=0 2024-08-20T05:18:37.927 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.922+0000 7f0b62a00640 10 client.29354 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.931+0000 7f0b62a00640 1 -- 172.21.15.37:0/2178650702 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5573cd7c2c00 con 0x5573cd8d2740 2024-08-20T05:18:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.931+0000 7f0b62a00640 10 client.29354 handle_command_reply: tid=0 2024-08-20T05:18:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.931+0000 7f0b86dee740 1 client.29354 shutdown 2024-08-20T05:18:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.931+0000 7f0b86dee740 1 -- 172.21.15.37:0/2178650702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd855120 msgr2=0x5573cd8611f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.931+0000 7f0b86dee740 1 --2- 172.21.15.37:0/2178650702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd855120 0x5573cd8611f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0b68005890 tx=0x7f0b68005f60 comp rx=0 tx=0).stop 2024-08-20T05:18:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.932+0000 7f0b86dee740 1 -- 172.21.15.37:0/2178650702 shutdown_connections 2024-08-20T05:18:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.932+0000 7f0b86dee740 1 --2- 172.21.15.37:0/2178650702 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5573cd8d2740 0x5573cd8d4b30 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.932+0000 7f0b86dee740 1 --2- 172.21.15.37:0/2178650702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573cd857b60 0x5573cd861dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.932+0000 7f0b86dee740 1 --2- 172.21.15.37:0/2178650702 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5573cd855120 0x5573cd8611f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.932+0000 7f0b62a00640 0 client.29354 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:37.934 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.932+0000 7f0b86dee740 1 --2- 172.21.15.37:0/2178650702 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5573cd8527f0 0x5573cd860b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.932+0000 7f0b86dee740 1 -- 172.21.15.37:0/2178650702 >> 172.21.15.37:0/2178650702 conn(0x5573cd84d940 msgr2=0x5573cd852060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.932+0000 7f0b86dee740 1 -- 172.21.15.37:0/2178650702 shutdown_connections 2024-08-20T05:18:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.932+0000 7f0b86dee740 1 -- 172.21.15.37:0/2178650702 wait complete. 2024-08-20T05:18:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.932+0000 7f0b86dee740 20 client.29354 trim_cache size 0 max 16384 2024-08-20T05:18:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:{ 2024-08-20T05:18:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "message": "", 2024-08-20T05:18:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout: "return_code": 0 2024-08-20T05:18:37.935 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stdout:} 2024-08-20T05:18:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.933+0000 7f0b82800640 1 -- 172.21.15.37:0/260849445 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0b640b3bd0 msgr2=0x7f0b640b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.933+0000 7f0b82800640 1 --2- 172.21.15.37:0/260849445 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0b640b3bd0 0x7f0b640b6090 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0b74009fd0 tx=0x7f0b74009500 comp rx=0 tx=0).stop 2024-08-20T05:18:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.933+0000 7f0b82800640 1 -- 172.21.15.37:0/260849445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b7c06b170 msgr2=0x7f0b7c19aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.933+0000 7f0b82800640 1 --2- 172.21.15.37:0/260849445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b7c06b170 0x7f0b7c19aa80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0b70005ab0 tx=0x7f0b70003b90 comp rx=0 tx=0).stop 2024-08-20T05:18:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.933+0000 7f0b82800640 1 -- 172.21.15.37:0/260849445 shutdown_connections 2024-08-20T05:18:37.936 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.933+0000 7f0b82800640 1 --2- 172.21.15.37:0/260849445 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0b640b3bd0 0x7f0b640b6090 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.933+0000 7f0b82800640 1 --2- 172.21.15.37:0/260849445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b7c1081a0 0x7f0b7c19bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.933+0000 7f0b82800640 1 --2- 172.21.15.37:0/260849445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f0b7c1055f0 0x7f0b7c19b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.933+0000 7f0b82800640 1 --2- 172.21.15.37:0/260849445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f0b7c06b170 0x7f0b7c19aa80 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.933+0000 7f0b82800640 1 -- 172.21.15.37:0/260849445 >> 172.21.15.37:0/260849445 conn(0x7f0b7c0fcc50 msgr2=0x7f0b7c0ff040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.933+0000 7f0b82800640 1 -- 172.21.15.37:0/260849445 shutdown_connections 2024-08-20T05:18:37.937 INFO:teuthology.task.background_exec.ubuntu@smithi037.front.sepia.ceph.com.smithi037.stderr:2024-08-20T05:18:37.933+0000 7f0b82800640 1 -- 172.21.15.37:0/260849445 wait complete. 2024-08-20T05:18:38.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.017+0000 7f583fe00640 1 -- 172.21.15.37:0/2921800621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f584010a520 msgr2=0x7f584010a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:38.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.017+0000 7f583fe00640 1 --2- 172.21.15.37:0/2921800621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f584010a520 0x7f584010a960 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5828009900 tx=0x7f582802a410 comp rx=0 tx=0).stop 2024-08-20T05:18:38.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.017+0000 7f583fe00640 1 -- 172.21.15.37:0/2921800621 shutdown_connections 2024-08-20T05:18:38.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.017+0000 7f583fe00640 1 --2- 172.21.15.37:0/2921800621 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f584010aea0 0x7f58401116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.017+0000 7f583fe00640 1 --2- 172.21.15.37:0/2921800621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f584010a520 0x7f584010a960 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.017+0000 7f583fe00640 1 --2- 172.21.15.37:0/2921800621 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5840104b10 0x7f5840104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.017+0000 7f583fe00640 1 -- 172.21.15.37:0/2921800621 >> 172.21.15.37:0/2921800621 conn(0x7f5840100540 msgr2=0x7f5840102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.017+0000 7f583fe00640 1 -- 172.21.15.37:0/2921800621 shutdown_connections 2024-08-20T05:18:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.017+0000 7f583fe00640 1 -- 172.21.15.37:0/2921800621 wait complete. 2024-08-20T05:18:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.018+0000 7f583fe00640 1 Processor -- start 2024-08-20T05:18:38.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.018+0000 7f583fe00640 1 -- start start 2024-08-20T05:18:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.019+0000 7f583fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5840104b10 0x7f584019aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.019+0000 7f583fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f584010a520 0x7f584019b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.019+0000 7f583fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f584010aea0 0x7f58401a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.019+0000 7f583fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5840114b40 con 0x7f584010aea0 2024-08-20T05:18:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.019+0000 7f583fe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f58401149c0 con 0x7f584010a520 2024-08-20T05:18:38.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.019+0000 7f583fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f5840114cc0 con 0x7f5840104b10 2024-08-20T05:18:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.019+0000 7f5837e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f584010a520 0x7f584019b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.019+0000 7f5837e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f584010a520 0x7f584019b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53026/0 (socket says 172.21.15.37:53026) 2024-08-20T05:18:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.019+0000 7f5837e00640 1 -- 172.21.15.37:0/2762250959 learned_addr learned my addr 172.21.15.37:0/2762250959 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.019+0000 7f583f400640 1 --2- 172.21.15.37:0/2762250959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f584010aea0 0x7f58401a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.019+0000 7f583ea00640 1 --2- 172.21.15.37:0/2762250959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5840104b10 0x7f584019aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.019+0000 7f5837e00640 1 -- 172.21.15.37:0/2762250959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5840104b10 msgr2=0x7f584019aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:38.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.019+0000 7f5837e00640 1 --2- 172.21.15.37:0/2762250959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5840104b10 0x7f584019aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.019+0000 7f5837e00640 1 -- 172.21.15.37:0/2762250959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f584010aea0 msgr2=0x7f58401a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:38.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.019+0000 7f5837e00640 1 --2- 172.21.15.37:0/2762250959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f584010aea0 0x7f58401a07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.020+0000 7f5837e00640 1 -- 172.21.15.37:0/2762250959 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58401a0fa0 con 0x7f584010a520 2024-08-20T05:18:38.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.020+0000 7f5837e00640 1 --2- 172.21.15.37:0/2762250959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f584010a520 0x7f584019b430 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5828005ab0 tx=0x7f5828003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:38.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.020+0000 7f5837400640 1 -- 172.21.15.37:0/2762250959 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582803f070 con 0x7f584010a520 2024-08-20T05:18:38.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.020+0000 7f5837400640 1 -- 172.21.15.37:0/2762250959 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5828031b60 con 0x7f584010a520 2024-08-20T05:18:38.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.020+0000 7f5837400640 1 -- 172.21.15.37:0/2762250959 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5828035030 con 0x7f584010a520 2024-08-20T05:18:38.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.020+0000 7f583fe00640 1 -- 172.21.15.37:0/2762250959 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58401a1230 con 0x7f584010a520 2024-08-20T05:18:38.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.020+0000 7f583fe00640 1 -- 172.21.15.37:0/2762250959 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58401a7950 con 0x7f584010a520 2024-08-20T05:18:38.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.023+0000 7f5848403740 1 Processor -- start 2024-08-20T05:18:38.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.024+0000 7f5848403740 1 -- start start 2024-08-20T05:18:38.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.024+0000 7f5837400640 1 -- 172.21.15.37:0/2762250959 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f5828042070 con 0x7f584010a520 2024-08-20T05:18:38.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.024+0000 7f5848403740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adc200 0x5648e4adc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.024+0000 7f5848403740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4adcb20 0x5648e4ae8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.024+0000 7f5848403740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4ae8ab0 0x5648e4aeaea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.024+0000 7f5848403740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5648e4a52950 con 0x5648e4adcb20 2024-08-20T05:18:38.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.024+0000 7f5848403740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5648e4a41e50 con 0x5648e4adc200 2024-08-20T05:18:38.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.024+0000 7f5848403740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5648e4a45e90 con 0x5648e4ae8ab0 2024-08-20T05:18:38.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.024+0000 7f583ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4adcb20 0x5648e4ae8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.024+0000 7f5837e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4ae8ab0 0x5648e4aeaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.024+0000 7f583f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adc200 0x5648e4adc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.024+0000 7f5837e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4ae8ab0 0x5648e4aeaea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:44448/0 (socket says 172.21.15.37:44448) 2024-08-20T05:18:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.024+0000 7f583f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adc200 0x5648e4adc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53038/0 (socket says 172.21.15.37:53038) 2024-08-20T05:18:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.024+0000 7f583ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4adcb20 0x5648e4ae8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53112/0 (socket says 172.21.15.37:53112) 2024-08-20T05:18:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.024+0000 7f5837e00640 1 -- 172.21.15.37:0/4289382479 learned_addr learned my addr 172.21.15.37:0/4289382479 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.025+0000 7f5837e00640 1 -- 172.21.15.37:0/4289382479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adc200 msgr2=0x5648e4adc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.025+0000 7f5837e00640 1 --2- 172.21.15.37:0/4289382479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adc200 0x5648e4adc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.025+0000 7f5837e00640 1 -- 172.21.15.37:0/4289382479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4adcb20 msgr2=0x5648e4ae8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.025+0000 7f5837e00640 1 --2- 172.21.15.37:0/4289382479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4adcb20 0x5648e4ae8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.025+0000 7f5837e00640 1 -- 172.21.15.37:0/4289382479 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648e4a11e80 con 0x5648e4ae8ab0 2024-08-20T05:18:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.025+0000 7f583ea00640 1 --2- 172.21.15.37:0/4289382479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4adcb20 0x5648e4ae8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.025+0000 7f5837e00640 1 --2- 172.21.15.37:0/4289382479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4ae8ab0 0x5648e4aeaea0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f582810a750 tx=0x7f582810a840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1e6acf257318dce server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.025+0000 7f582fe00640 1 -- 172.21.15.37:0/4289382479 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5828104c40 con 0x5648e4ae8ab0 2024-08-20T05:18:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.026+0000 7f582fe00640 1 -- 172.21.15.37:0/4289382479 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5828111030 con 0x5648e4ae8ab0 2024-08-20T05:18:38.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.026+0000 7f582fe00640 1 -- 172.21.15.37:0/4289382479 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5828116710 con 0x5648e4ae8ab0 2024-08-20T05:18:38.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.026+0000 7f5837400640 1 --2- 172.21.15.37:0/2762250959 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f58240b3cf0 0x7f58240b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.026+0000 7f5837400640 1 -- 172.21.15.37:0/2762250959 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5828104650 con 0x7f584010a520 2024-08-20T05:18:38.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.026+0000 7f583f400640 1 --2- 172.21.15.37:0/2762250959 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f58240b3cf0 0x7f58240b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.026+0000 7f5848403740 1 -- 172.21.15.37:0/4289382479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4ae8ab0 msgr2=0x5648e4aeaea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:38.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.026+0000 7f5848403740 1 --2- 172.21.15.37:0/4289382479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4ae8ab0 0x5648e4aeaea0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f582810a750 tx=0x7f582810a840 comp rx=0 tx=0).stop 2024-08-20T05:18:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.026+0000 7f5848403740 1 -- 172.21.15.37:0/4289382479 shutdown_connections 2024-08-20T05:18:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.026+0000 7f5848403740 1 --2- 172.21.15.37:0/4289382479 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4ae8ab0 0x5648e4aeaea0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.026+0000 7f5848403740 1 --2- 172.21.15.37:0/4289382479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4adcb20 0x5648e4ae8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.026+0000 7f5848403740 1 --2- 172.21.15.37:0/4289382479 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adc200 0x5648e4adc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.027+0000 7f5848403740 1 -- 172.21.15.37:0/4289382479 >> 172.21.15.37:0/4289382479 conn(0x5648e4ada030 msgr2=0x5648e4adb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.027+0000 7f5848403740 1 -- 172.21.15.37:0/4289382479 shutdown_connections 2024-08-20T05:18:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.027+0000 7f5848403740 1 -- 172.21.15.37:0/4289382479 wait complete. 2024-08-20T05:18:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.027+0000 7f583f400640 1 --2- 172.21.15.37:0/2762250959 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f58240b3cf0 0x7f58240b61b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5838005fd0 tx=0x7f5838009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.027+0000 7f5848403740 1 -- start start 2024-08-20T05:18:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.027+0000 7f5848403740 1 Processor -- start 2024-08-20T05:18:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.028+0000 7f5848403740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 0x5648e4ae8560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.028+0000 7f5848403740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adcb20 0x5648e4ae59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.028+0000 7f5848403740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 0x5648e4ae6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.028+0000 7f5848403740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5648e48a4810 con 0x5648e4ae8ab0 2024-08-20T05:18:38.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.028+0000 7f5848403740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x5648e49dd0d0 con 0x5648e4adcb20 2024-08-20T05:18:38.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.028+0000 7f5848403740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x5648e4aeb4f0 con 0x5648e4adc200 2024-08-20T05:18:38.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.028+0000 7f5848403740 10 client.0 _ll_register_callbacks cb 0x5648e49ede60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:38.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.028+0000 7f583ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 0x5648e4ae8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.028+0000 7f583ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 0x5648e4ae8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:44460/0 (socket says 172.21.15.37:44460) 2024-08-20T05:18:38.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.028+0000 7f583ea00640 1 -- 172.21.15.37:0/2089158414 learned_addr learned my addr 172.21.15.37:0/2089158414 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:38.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.028+0000 7f5837e00640 1 --2- 172.21.15.37:0/2089158414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adcb20 0x5648e4ae59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.028+0000 7f583f400640 1 --2- 172.21.15.37:0/2089158414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 0x5648e4ae6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.029+0000 7f583ea00640 1 -- 172.21.15.37:0/2089158414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adcb20 msgr2=0x5648e4ae59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:38.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.029+0000 7f583ea00640 1 --2- 172.21.15.37:0/2089158414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adcb20 0x5648e4ae59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.029+0000 7f583ea00640 1 -- 172.21.15.37:0/2089158414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 msgr2=0x5648e4ae6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:38.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.029+0000 7f583ea00640 1 --2- 172.21.15.37:0/2089158414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 0x5648e4ae6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.029+0000 7f583ea00640 1 -- 172.21.15.37:0/2089158414 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648e4a0eee0 con 0x5648e4adc200 2024-08-20T05:18:38.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.029+0000 7f583f400640 1 --2- 172.21.15.37:0/2089158414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 0x5648e4ae6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:18:38.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.029+0000 7f583ea00640 1 --2- 172.21.15.37:0/2089158414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 0x5648e4ae8560 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5830012740 tx=0x7f5830012c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c0369f0b8340596 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:38.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.029+0000 7f582cc00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:18:38.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.029+0000 7f582cc00640 1 -- 172.21.15.37:0/2089158414 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5830004030 con 0x5648e4adc200 2024-08-20T05:18:38.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.029+0000 7f5848403740 1 -- 172.21.15.37:0/2089158414 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5828111030 con 0x5648e4adc200 2024-08-20T05:18:38.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.029+0000 7f582cc00640 1 -- 172.21.15.37:0/2089158414 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f58300041d0 con 0x5648e4adc200 2024-08-20T05:18:38.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.030+0000 7f582cc00640 1 -- 172.21.15.37:0/2089158414 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f5830025050 con 0x5648e4adc200 2024-08-20T05:18:38.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.030+0000 7f5848403740 10 client.29377 fetch_fsmap learned FSMap version 55 2024-08-20T05:18:38.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.030+0000 7f5848403740 1 -- 172.21.15.37:0/2089158414 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5648e47a18b0 con 0x5648e4adc200 2024-08-20T05:18:38.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.030+0000 7f582cc00640 1 -- 172.21.15.37:0/2089158414 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5828111030 con 0x5648e4adc200 2024-08-20T05:18:38.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.030+0000 7f582cc00640 1 -- 172.21.15.37:0/2089158414 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 55) ==== 8382+0+0 (secure 0 0 0) 0x7f5830003960 con 0x5648e4adc200 2024-08-20T05:18:38.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.030+0000 7f5848403740 10 client.29377 fetch_fsmap finished waiting for FSMap version 55 2024-08-20T05:18:38.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.030+0000 7f5848403740 10 client.29377 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:18:38.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.030+0000 7f5848403740 20 client.29377 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:38.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.030+0000 7f5848403740 1 --2- 172.21.15.37:0/2089158414 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5648e4af8370 0x5648e4afa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.030+0000 7f5848403740 4 client.29377 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:18:38.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.030+0000 7f5848403740 1 -- 172.21.15.37:0/2089158414 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648e4a548a0 con 0x5648e4af8370 2024-08-20T05:18:38.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.031+0000 7f5837e00640 1 --2- 172.21.15.37:0/2089158414 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5648e4af8370 0x5648e4afa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.031+0000 7f5837e00640 1 --2- 172.21.15.37:0/2089158414 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5648e4af8370 0x5648e4afa760 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcc573189afce5a5 server_cookie=2db10d41cef74d3f in_seq=0 out_seq=0 2024-08-20T05:18:38.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.031+0000 7f582cc00640 10 client.29377 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:38.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.032+0000 7f582cc00640 1 -- 172.21.15.37:0/2089158414 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5648e4a548a0 con 0x5648e4af8370 2024-08-20T05:18:38.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.032+0000 7f582cc00640 10 client.29377 handle_command_reply: tid=0 2024-08-20T05:18:38.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.032+0000 7f5848403740 1 client.29377 shutdown 2024-08-20T05:18:38.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.032+0000 7f5848403740 1 -- 172.21.15.37:0/2089158414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 msgr2=0x5648e4ae8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:38.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.032+0000 7f5848403740 1 --2- 172.21.15.37:0/2089158414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 0x5648e4ae8560 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f5830012740 tx=0x7f5830012c00 comp rx=0 tx=0).stop 2024-08-20T05:18:38.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.032+0000 7f5848403740 1 -- 172.21.15.37:0/2089158414 shutdown_connections 2024-08-20T05:18:38.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.032+0000 7f5848403740 1 --2- 172.21.15.37:0/2089158414 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5648e4af8370 0x5648e4afa760 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.032+0000 7f5848403740 1 --2- 172.21.15.37:0/2089158414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 0x5648e4ae6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.032+0000 7f5848403740 1 --2- 172.21.15.37:0/2089158414 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adcb20 0x5648e4ae59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.032+0000 7f5848403740 1 --2- 172.21.15.37:0/2089158414 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 0x5648e4ae8560 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.032+0000 7f582cc00640 0 client.29377 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:38.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.032+0000 7f5848403740 1 -- 172.21.15.37:0/2089158414 >> 172.21.15.37:0/2089158414 conn(0x5648e4ada030 msgr2=0x5648e4adfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:38.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.033+0000 7f5848403740 1 -- 172.21.15.37:0/2089158414 shutdown_connections 2024-08-20T05:18:38.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.033+0000 7f5848403740 1 -- 172.21.15.37:0/2089158414 wait complete. 2024-08-20T05:18:38.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.033+0000 7f5848403740 20 client.29377 trim_cache size 0 max 16384 2024-08-20T05:18:38.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.051+0000 7f5848403740 1 Processor -- start 2024-08-20T05:18:38.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.051+0000 7f5848403740 1 -- start start 2024-08-20T05:18:38.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.051+0000 7f5848403740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 0x5648e4ae0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.051+0000 7f5848403740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adcb20 0x5648e4b00030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.051+0000 7f5848403740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 0x5648e4b00570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.051+0000 7f5848403740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f58401b1710 con 0x5648e4ae8ab0 2024-08-20T05:18:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.051+0000 7f5848403740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f58401b3280 con 0x5648e4adcb20 2024-08-20T05:18:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.051+0000 7f5848403740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f58401b1e10 con 0x5648e4adc200 2024-08-20T05:18:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.051+0000 7f583f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 0x5648e4b00570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.051+0000 7f583f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 0x5648e4b00570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53126/0 (socket says 172.21.15.37:53126) 2024-08-20T05:18:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.051+0000 7f583ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 0x5648e4ae0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.051+0000 7f583f400640 1 -- 172.21.15.37:0/2036802572 learned_addr learned my addr 172.21.15.37:0/2036802572 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:38.054 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.051+0000 7f5837e00640 1 --2- 172.21.15.37:0/2036802572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adcb20 0x5648e4b00030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.052+0000 7f583f400640 1 -- 172.21.15.37:0/2036802572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 msgr2=0x5648e4ae0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.052+0000 7f583f400640 1 --2- 172.21.15.37:0/2036802572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 0x5648e4ae0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.052+0000 7f583f400640 1 -- 172.21.15.37:0/2036802572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adcb20 msgr2=0x5648e4b00030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.052+0000 7f583f400640 1 --2- 172.21.15.37:0/2036802572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adcb20 0x5648e4b00030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.052+0000 7f583f400640 1 -- 172.21.15.37:0/2036802572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648e49de170 con 0x5648e4ae8ab0 2024-08-20T05:18:38.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.052+0000 7f5837e00640 1 --2- 172.21.15.37:0/2036802572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adcb20 0x5648e4b00030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.052+0000 7f583f400640 1 --2- 172.21.15.37:0/2036802572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 0x5648e4b00570 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5838003e90 tx=0x7f5838016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8f68b4a20c698a server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.052+0000 7f582f400640 1 -- 172.21.15.37:0/2036802572 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5838004600 con 0x5648e4ae8ab0 2024-08-20T05:18:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.053+0000 7f582f400640 1 -- 172.21.15.37:0/2036802572 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58380047a0 con 0x5648e4ae8ab0 2024-08-20T05:18:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.053+0000 7f582f400640 1 -- 172.21.15.37:0/2036802572 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5838005940 con 0x5648e4ae8ab0 2024-08-20T05:18:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.053+0000 7f5848403740 1 -- 172.21.15.37:0/2036802572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 msgr2=0x5648e4b00570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.053+0000 7f5848403740 1 --2- 172.21.15.37:0/2036802572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 0x5648e4b00570 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5838003e90 tx=0x7f5838016000 comp rx=0 tx=0).stop 2024-08-20T05:18:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.053+0000 7f5848403740 1 -- 172.21.15.37:0/2036802572 shutdown_connections 2024-08-20T05:18:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.053+0000 7f5848403740 1 --2- 172.21.15.37:0/2036802572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 0x5648e4b00570 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.053+0000 7f5848403740 1 --2- 172.21.15.37:0/2036802572 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adcb20 0x5648e4b00030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.053+0000 7f5848403740 1 --2- 172.21.15.37:0/2036802572 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 0x5648e4ae0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.053+0000 7f5848403740 1 -- 172.21.15.37:0/2036802572 >> 172.21.15.37:0/2036802572 conn(0x5648e4ada030 msgr2=0x5648e4ad90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.053+0000 7f5848403740 1 -- 172.21.15.37:0/2036802572 shutdown_connections 2024-08-20T05:18:38.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.054+0000 7f5848403740 1 -- 172.21.15.37:0/2036802572 wait complete. 2024-08-20T05:18:38.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.054+0000 7f5848403740 1 -- start start 2024-08-20T05:18:38.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.054+0000 7f5848403740 1 Processor -- start 2024-08-20T05:18:38.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.054+0000 7f5848403740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 0x5648e4af0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.055+0000 7f5848403740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adcb20 0x5648e4aed270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.055+0000 7f5848403740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 0x5648e4aed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.055+0000 7f5848403740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f58401b2bb0 con 0x5648e4ae8ab0 2024-08-20T05:18:38.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.055+0000 7f5848403740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f58401b24e0 con 0x5648e4adcb20 2024-08-20T05:18:38.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.055+0000 7f5848403740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f58401af6f0 con 0x5648e4adc200 2024-08-20T05:18:38.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.055+0000 7f5848403740 10 client.0 _ll_register_callbacks cb 0x7f5830009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:38.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.055+0000 7f583ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 0x5648e4af0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.055+0000 7f583ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 0x5648e4af0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:44486/0 (socket says 172.21.15.37:44486) 2024-08-20T05:18:38.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.055+0000 7f583f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 0x5648e4aed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.055+0000 7f583ea00640 1 -- 172.21.15.37:0/2951705773 learned_addr learned my addr 172.21.15.37:0/2951705773 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:38.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.055+0000 7f5837e00640 1 --2- 172.21.15.37:0/2951705773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adcb20 0x5648e4aed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.055+0000 7f583ea00640 1 -- 172.21.15.37:0/2951705773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adcb20 msgr2=0x5648e4aed270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:38.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.055+0000 7f583ea00640 1 --2- 172.21.15.37:0/2951705773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adcb20 0x5648e4aed270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.055+0000 7f583ea00640 1 -- 172.21.15.37:0/2951705773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 msgr2=0x5648e4aed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:38.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.055+0000 7f583ea00640 1 --2- 172.21.15.37:0/2951705773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 0x5648e4aed7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.055+0000 7f583ea00640 1 -- 172.21.15.37:0/2951705773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648e4aedf20 con 0x5648e4adc200 2024-08-20T05:18:38.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.055+0000 7f5837e00640 1 --2- 172.21.15.37:0/2951705773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adcb20 0x5648e4aed270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:38.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.056+0000 7f583ea00640 1 --2- 172.21.15.37:0/2951705773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 0x5648e4af0d90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5830003f20 tx=0x7f5830003800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6c9dbee21ea395 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:38.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.056+0000 7f582cc00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:18:38.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.056+0000 7f582cc00640 1 -- 172.21.15.37:0/2951705773 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583002d030 con 0x5648e4adc200 2024-08-20T05:18:38.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.056+0000 7f582cc00640 1 -- 172.21.15.37:0/2951705773 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f5830018040 con 0x5648e4adc200 2024-08-20T05:18:38.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.056+0000 7f5848403740 1 -- 172.21.15.37:0/2951705773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58380047a0 con 0x5648e4adc200 2024-08-20T05:18:38.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.056+0000 7f582cc00640 1 -- 172.21.15.37:0/2951705773 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f5830037050 con 0x5648e4adc200 2024-08-20T05:18:38.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.056+0000 7f5848403740 10 client.29383 fetch_fsmap learned FSMap version 55 2024-08-20T05:18:38.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.056+0000 7f5848403740 1 -- 172.21.15.37:0/2951705773 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5648e4b63fd0 con 0x5648e4adc200 2024-08-20T05:18:38.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.057+0000 7f582cc00640 1 -- 172.21.15.37:0/2951705773 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58380047a0 con 0x5648e4adc200 2024-08-20T05:18:38.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.057+0000 7f582cc00640 1 -- 172.21.15.37:0/2951705773 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 55) ==== 8382+0+0 (secure 0 0 0) 0x7f58300054f0 con 0x5648e4adc200 2024-08-20T05:18:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.057+0000 7f5848403740 10 client.29383 fetch_fsmap finished waiting for FSMap version 55 2024-08-20T05:18:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.057+0000 7f5848403740 10 client.29383 resolve_mds: validated gid 24695 aka daemon mds.b 2024-08-20T05:18:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.057+0000 7f5848403740 20 client.29383 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.057+0000 7f5848403740 1 --2- 172.21.15.37:0/2951705773 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5648e4b64770 0x5648e4b66b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.057+0000 7f5848403740 4 client.29383 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-08-20T05:18:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.057+0000 7f5848403740 1 -- 172.21.15.37:0/2951705773 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5648e4a50340 con 0x5648e4b64770 2024-08-20T05:18:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.057+0000 7f5837e00640 1 --2- 172.21.15.37:0/2951705773 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5648e4b64770 0x5648e4b66b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.058+0000 7f5837e00640 1 --2- 172.21.15.37:0/2951705773 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5648e4b64770 0x5648e4b66b90 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6332e917ba00154a server_cookie=ed689c8aa85be531 in_seq=0 out_seq=0 2024-08-20T05:18:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.058+0000 7f582cc00640 10 client.29383 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.058+0000 7f582cc00640 1 -- 172.21.15.37:0/2951705773 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x5648e4a50340 con 0x5648e4b64770 2024-08-20T05:18:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.058+0000 7f582cc00640 10 client.29383 handle_command_reply: tid=0 2024-08-20T05:18:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.058+0000 7f5848403740 1 client.29383 shutdown 2024-08-20T05:18:38.062 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.058+0000 7f5848403740 1 -- 172.21.15.37:0/2951705773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 msgr2=0x5648e4af0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:38.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.058+0000 7f5848403740 1 --2- 172.21.15.37:0/2951705773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 0x5648e4af0d90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f5830003f20 tx=0x7f5830003800 comp rx=0 tx=0).stop 2024-08-20T05:18:38.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.058+0000 7f5848403740 1 -- 172.21.15.37:0/2951705773 shutdown_connections 2024-08-20T05:18:38.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.058+0000 7f5848403740 1 --2- 172.21.15.37:0/2951705773 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x5648e4b64770 0x5648e4b66b90 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.058+0000 7f5848403740 1 --2- 172.21.15.37:0/2951705773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5648e4ae8ab0 0x5648e4aed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.058+0000 7f5848403740 1 --2- 172.21.15.37:0/2951705773 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5648e4adcb20 0x5648e4aed270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.058+0000 7f5848403740 1 --2- 172.21.15.37:0/2951705773 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5648e4adc200 0x5648e4af0d90 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.058+0000 7f582cc00640 0 client.29383 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:38.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.058+0000 7f5848403740 1 -- 172.21.15.37:0/2951705773 >> 172.21.15.37:0/2951705773 conn(0x5648e4ada030 msgr2=0x5648e4af3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:38.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.059+0000 7f5848403740 1 -- 172.21.15.37:0/2951705773 shutdown_connections 2024-08-20T05:18:38.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.059+0000 7f5848403740 1 -- 172.21.15.37:0/2951705773 wait complete. 2024-08-20T05:18:38.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.059+0000 7f5848403740 20 client.29383 trim_cache size 0 max 16384 2024-08-20T05:18:38.063 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:18:38.064 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 55, 2024-08-20T05:18:38.064 INFO:teuthology.orchestra.run.smithi037.stdout: "leader": 24695, 2024-08-20T05:18:38.064 INFO:teuthology.orchestra.run.smithi037.stdout: "set_version": 60, 2024-08-20T05:18:38.064 INFO:teuthology.orchestra.run.smithi037.stdout: "sets": {} 2024-08-20T05:18:38.064 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:18:38.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.059+0000 7f583fe00640 1 -- 172.21.15.37:0/2762250959 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f58240b3cf0 msgr2=0x7f58240b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:38.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.059+0000 7f583fe00640 1 --2- 172.21.15.37:0/2762250959 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f58240b3cf0 0x7f58240b61b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5838005fd0 tx=0x7f5838009500 comp rx=0 tx=0).stop 2024-08-20T05:18:38.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.059+0000 7f583fe00640 1 -- 172.21.15.37:0/2762250959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f584010a520 msgr2=0x7f584019b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:38.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.059+0000 7f583fe00640 1 --2- 172.21.15.37:0/2762250959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f584010a520 0x7f584019b430 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5828005ab0 tx=0x7f5828003c10 comp rx=0 tx=0).stop 2024-08-20T05:18:38.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.059+0000 7f583fe00640 1 -- 172.21.15.37:0/2762250959 shutdown_connections 2024-08-20T05:18:38.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.059+0000 7f583fe00640 1 --2- 172.21.15.37:0/2762250959 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f58240b3cf0 0x7f58240b61b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.059+0000 7f583fe00640 1 --2- 172.21.15.37:0/2762250959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f584010aea0 0x7f58401a07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.059+0000 7f583fe00640 1 --2- 172.21.15.37:0/2762250959 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f584010a520 0x7f584019b430 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.059+0000 7f583fe00640 1 --2- 172.21.15.37:0/2762250959 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f5840104b10 0x7f584019aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:38.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.059+0000 7f583fe00640 1 -- 172.21.15.37:0/2762250959 >> 172.21.15.37:0/2762250959 conn(0x7f5840100540 msgr2=0x7f5840102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:38.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.060+0000 7f583fe00640 1 -- 172.21.15.37:0/2762250959 shutdown_connections 2024-08-20T05:18:38.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:38.060+0000 7f583fe00640 1 -- 172.21.15.37:0/2762250959 wait complete. 2024-08-20T05:18:38.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:37 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:18:38.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:37 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:18:38.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:38 smithi037 ceph-mon[17265]: pgmap v893: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 19 op/s 2024-08-20T05:18:39.011 INFO:tasks.quiescer:done joining Quiescers 2024-08-20T05:18:39.011 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-08-20T05:18:39.021 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi037.front.sepia.ceph.com 2024-08-20T05:18:39.033 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-08-20T05:18:39.044 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-08-20T05:18:39.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:38 smithi135 ceph-mon[22342]: pgmap v893: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 19 op/s 2024-08-20T05:18:39.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:38 smithi130 ceph-mon[22007]: pgmap v893: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 19 op/s 2024-08-20T05:18:39.742 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-20T05:18:39.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:18:40.123 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:18:40.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.736+0000 7fdcad800640 1 -- 172.21.15.37:0/648473508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdca8108e40 msgr2=0x7fdca810f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:40.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.736+0000 7fdcad800640 1 --2- 172.21.15.37:0/648473508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdca8108e40 0x7fdca810f640 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009ca0 tx=0x7fdca002a8c0 comp rx=0 tx=0).stop 2024-08-20T05:18:40.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.737+0000 7fdcad800640 1 -- 172.21.15.37:0/648473508 shutdown_connections 2024-08-20T05:18:40.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.737+0000 7fdcad800640 1 --2- 172.21.15.37:0/648473508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdca8108e40 0x7fdca810f640 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:40.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.737+0000 7fdcad800640 1 --2- 172.21.15.37:0/648473508 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdca81084c0 0x7fdca8108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.737+0000 7fdcad800640 1 --2- 172.21.15.37:0/648473508 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdca8102ab0 0x7fdca8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.737+0000 7fdcad800640 1 -- 172.21.15.37:0/648473508 >> 172.21.15.37:0/648473508 conn(0x7fdca80fe500 msgr2=0x7fdca8100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.737+0000 7fdcad800640 1 -- 172.21.15.37:0/648473508 shutdown_connections 2024-08-20T05:18:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.737+0000 7fdcad800640 1 -- 172.21.15.37:0/648473508 wait complete. 2024-08-20T05:18:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.738+0000 7fdcad800640 1 Processor -- start 2024-08-20T05:18:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.738+0000 7fdcad800640 1 -- start start 2024-08-20T05:18:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.738+0000 7fdcad800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdca8102ab0 0x7fdca819b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.738+0000 7fdcad800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdca81084c0 0x7fdca819b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.738+0000 7fdcad800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdca8108e40 0x7fdca81a09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:40.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.738+0000 7fdcad800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdca8112b00 con 0x7fdca8108e40 2024-08-20T05:18:40.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.738+0000 7fdcad800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fdca8112980 con 0x7fdca81084c0 2024-08-20T05:18:40.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.738+0000 7fdcad800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fdca8112c80 con 0x7fdca8102ab0 2024-08-20T05:18:40.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.738+0000 7fdca7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdca8108e40 0x7fdca81a09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:40.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.738+0000 7fdca7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdca8108e40 0x7fdca81a09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53136/0 (socket says 172.21.15.37:53136) 2024-08-20T05:18:40.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.739+0000 7fdca7400640 1 -- 172.21.15.37:0/2987644182 learned_addr learned my addr 172.21.15.37:0/2987644182 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:40.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.739+0000 7fdca6a00640 1 --2- 172.21.15.37:0/2987644182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdca8102ab0 0x7fdca819b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:40.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.739+0000 7fdc9e000640 1 --2- 172.21.15.37:0/2987644182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdca81084c0 0x7fdca819b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:40.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.739+0000 7fdca7400640 1 -- 172.21.15.37:0/2987644182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdca8102ab0 msgr2=0x7fdca819b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:40.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.739+0000 7fdca7400640 1 --2- 172.21.15.37:0/2987644182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdca8102ab0 0x7fdca819b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:40.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.739+0000 7fdca7400640 1 -- 172.21.15.37:0/2987644182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdca81084c0 msgr2=0x7fdca819b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:40.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.739+0000 7fdca7400640 1 --2- 172.21.15.37:0/2987644182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdca81084c0 0x7fdca819b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:40.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.739+0000 7fdca7400640 1 -- 172.21.15.37:0/2987644182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca81a11b0 con 0x7fdca8108e40 2024-08-20T05:18:40.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.739+0000 7fdc9e000640 1 --2- 172.21.15.37:0/2987644182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdca81084c0 0x7fdca819b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:40.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.739+0000 7fdca7400640 1 --2- 172.21.15.37:0/2987644182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdca8108e40 0x7fdca81a09e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdca00098d0 tx=0x7fdca00317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:40.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.740+0000 7fdc9fe00640 1 -- 172.21.15.37:0/2987644182 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0003b70 con 0x7fdca8108e40 2024-08-20T05:18:40.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.740+0000 7fdc9fe00640 1 -- 172.21.15.37:0/2987644182 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdca0003d10 con 0x7fdca8108e40 2024-08-20T05:18:40.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.740+0000 7fdcad800640 1 -- 172.21.15.37:0/2987644182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca81a1440 con 0x7fdca8108e40 2024-08-20T05:18:40.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.740+0000 7fdc9fe00640 1 -- 172.21.15.37:0/2987644182 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca002fa20 con 0x7fdca8108e40 2024-08-20T05:18:40.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.740+0000 7fdcad800640 1 -- 172.21.15.37:0/2987644182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca81a7b60 con 0x7fdca8108e40 2024-08-20T05:18:40.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.741+0000 7fdcad800640 1 -- 172.21.15.37:0/2987644182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca8102e90 con 0x7fdca8108e40 2024-08-20T05:18:40.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.743+0000 7fdc9fe00640 1 -- 172.21.15.37:0/2987644182 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdca002fc00 con 0x7fdca8108e40 2024-08-20T05:18:40.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.745+0000 7fdc9fe00640 1 --2- 172.21.15.37:0/2987644182 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc8c0b3bd0 0x7fdc8c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:40.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.746+0000 7fdc9fe00640 1 -- 172.21.15.37:0/2987644182 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fdca0105450 con 0x7fdca8108e40 2024-08-20T05:18:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.746+0000 7fdca6a00640 1 --2- 172.21.15.37:0/2987644182 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc8c0b3bd0 0x7fdc8c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.746+0000 7fdca6a00640 1 --2- 172.21.15.37:0/2987644182 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc8c0b3bd0 0x7fdc8c0b6090 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009bd0 tx=0x7fdc98005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.750+0000 7fdc9fe00640 1 -- 172.21.15.37:0/2987644182 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fdca00cc6a0 con 0x7fdca8108e40 2024-08-20T05:18:40.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.995+0000 7fdcad800640 1 -- 172.21.15.37:0/2987644182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdca810f030 con 0x7fdca8108e40 2024-08-20T05:18:40.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.996+0000 7fdc9fe00640 1 -- 172.21.15.37:0/2987644182 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+11984 (secure 0 0 0) 0x7fdca00cbfa0 con 0x7fdca8108e40 2024-08-20T05:18:40.998 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:40.998 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":55,"btime":"2024-08-20T05:18:36:706404+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":55,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:18:36.295915+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24637,24649,24656,24695,24664]},"id":1}]} 2024-08-20T05:18:40.999 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 55 2024-08-20T05:18:41.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.998+0000 7fdcad800640 1 -- 172.21.15.37:0/2987644182 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc8c0b3bd0 msgr2=0x7fdc8c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:41.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.998+0000 7fdcad800640 1 --2- 172.21.15.37:0/2987644182 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc8c0b3bd0 0x7fdc8c0b6090 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009bd0 tx=0x7fdc98005f90 comp rx=0 tx=0).stop 2024-08-20T05:18:41.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.998+0000 7fdcad800640 1 -- 172.21.15.37:0/2987644182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdca8108e40 msgr2=0x7fdca81a09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:41.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.998+0000 7fdcad800640 1 --2- 172.21.15.37:0/2987644182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdca8108e40 0x7fdca81a09e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fdca00098d0 tx=0x7fdca00317b0 comp rx=0 tx=0).stop 2024-08-20T05:18:41.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.999+0000 7fdcad800640 1 -- 172.21.15.37:0/2987644182 shutdown_connections 2024-08-20T05:18:41.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.999+0000 7fdcad800640 1 --2- 172.21.15.37:0/2987644182 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdc8c0b3bd0 0x7fdc8c0b6090 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:41.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.999+0000 7fdcad800640 1 --2- 172.21.15.37:0/2987644182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdca8108e40 0x7fdca81a09e0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:41.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.999+0000 7fdcad800640 1 --2- 172.21.15.37:0/2987644182 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fdca81084c0 0x7fdca819b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.999+0000 7fdcad800640 1 --2- 172.21.15.37:0/2987644182 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fdca8102ab0 0x7fdca819b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.999+0000 7fdcad800640 1 -- 172.21.15.37:0/2987644182 >> 172.21.15.37:0/2987644182 conn(0x7fdca80fe500 msgr2=0x7fdca8104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.999+0000 7fdcad800640 1 -- 172.21.15.37:0/2987644182 shutdown_connections 2024-08-20T05:18:41.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:40.999+0000 7fdcad800640 1 -- 172.21.15.37:0/2987644182 wait complete. 2024-08-20T05:18:41.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:41 smithi037 ceph-mon[17265]: pgmap v894: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 22 op/s 2024-08-20T05:18:41.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:41 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2987644182' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:18:41.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-08-20T05:18:41.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:41 smithi135 ceph-mon[22342]: pgmap v894: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 22 op/s 2024-08-20T05:18:41.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:41 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2987644182' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:18:41.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:41 smithi130 ceph-mon[22007]: pgmap v894: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 22 op/s 2024-08-20T05:18:41.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:41 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2987644182' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:18:42.183 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:18:42.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.775+0000 7f9f1fa00640 1 -- 172.21.15.37:0/4080093653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f181039d0 msgr2=0x7f9f18103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:42.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.775+0000 7f9f1fa00640 1 --2- 172.21.15.37:0/4080093653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f181039d0 0x7f9f18103db0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c009900 tx=0x7f9f0c02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.776+0000 7f9f1fa00640 1 -- 172.21.15.37:0/4080093653 shutdown_connections 2024-08-20T05:18:42.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.776+0000 7f9f1fa00640 1 --2- 172.21.15.37:0/4080093653 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f1810ce30 0x7f9f1810f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.776+0000 7f9f1fa00640 1 --2- 172.21.15.37:0/4080093653 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f181042f0 0x7f9f1810c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.776+0000 7f9f1fa00640 1 --2- 172.21.15.37:0/4080093653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f181039d0 0x7f9f18103db0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.776+0000 7f9f1fa00640 1 -- 172.21.15.37:0/4080093653 >> 172.21.15.37:0/4080093653 conn(0x7f9f180fd410 msgr2=0x7f9f180ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:42.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.776+0000 7f9f1fa00640 1 -- 172.21.15.37:0/4080093653 shutdown_connections 2024-08-20T05:18:42.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.776+0000 7f9f1fa00640 1 -- 172.21.15.37:0/4080093653 wait complete. 2024-08-20T05:18:42.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.776+0000 7f9f1fa00640 1 Processor -- start 2024-08-20T05:18:42.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.777+0000 7f9f1fa00640 1 -- start start 2024-08-20T05:18:42.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.777+0000 7f9f1fa00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f181039d0 0x7f9f18101680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.777+0000 7f9f1fa00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f181042f0 0x7f9f18101bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.777+0000 7f9f1fa00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f1810ce30 0x7f9f18102100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.777+0000 7f9f1fa00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9f18112af0 con 0x7f9f181042f0 2024-08-20T05:18:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.777+0000 7f9f1fa00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9f18112970 con 0x7f9f1810ce30 2024-08-20T05:18:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.777+0000 7f9f1fa00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9f18112c70 con 0x7f9f181039d0 2024-08-20T05:18:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.777+0000 7f9f17e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f181042f0 0x7f9f18101bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.777+0000 7f9f17e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f181042f0 0x7f9f18101bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53152/0 (socket says 172.21.15.37:53152) 2024-08-20T05:18:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.777+0000 7f9f17e00640 1 -- 172.21.15.37:0/2611624712 learned_addr learned my addr 172.21.15.37:0/2611624712 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.777+0000 7f9f1d000640 1 --2- 172.21.15.37:0/2611624712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f181039d0 0x7f9f18101680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.777+0000 7f9f1da00640 1 --2- 172.21.15.37:0/2611624712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f1810ce30 0x7f9f18102100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.778+0000 7f9f17e00640 1 -- 172.21.15.37:0/2611624712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f181039d0 msgr2=0x7f9f18101680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.778+0000 7f9f17e00640 1 --2- 172.21.15.37:0/2611624712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f181039d0 0x7f9f18101680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.778+0000 7f9f17e00640 1 -- 172.21.15.37:0/2611624712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f1810ce30 msgr2=0x7f9f18102100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:42.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.778+0000 7f9f17e00640 1 --2- 172.21.15.37:0/2611624712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f1810ce30 0x7f9f18102100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.778+0000 7f9f17e00640 1 -- 172.21.15.37:0/2611624712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f181a73c0 con 0x7f9f181042f0 2024-08-20T05:18:42.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.778+0000 7f9f17e00640 1 --2- 172.21.15.37:0/2611624712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f181042f0 0x7f9f18101bc0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400e9c0 tx=0x7f9f0400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:42.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.778+0000 7f9f15600640 1 -- 172.21.15.37:0/2611624712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400ccc0 con 0x7f9f181042f0 2024-08-20T05:18:42.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.778+0000 7f9f15600640 1 -- 172.21.15.37:0/2611624712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f040035f0 con 0x7f9f181042f0 2024-08-20T05:18:42.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.778+0000 7f9f15600640 1 -- 172.21.15.37:0/2611624712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400ce60 con 0x7f9f181042f0 2024-08-20T05:18:42.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.778+0000 7f9f1fa00640 1 -- 172.21.15.37:0/2611624712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f181a76b0 con 0x7f9f181042f0 2024-08-20T05:18:42.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.778+0000 7f9f1fa00640 1 -- 172.21.15.37:0/2611624712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f181a7ba0 con 0x7f9f181042f0 2024-08-20T05:18:42.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.782+0000 7f9f223cc740 1 Processor -- start 2024-08-20T05:18:42.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.782+0000 7f9f223cc740 1 -- start start 2024-08-20T05:18:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.782+0000 7f9f15600640 1 -- 172.21.15.37:0/2611624712 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9f04004000 con 0x7f9f181042f0 2024-08-20T05:18:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.782+0000 7f9f223cc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 0x55e998cb2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.782+0000 7f9f223cc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cb32b0 0x55e998cbed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.782+0000 7f9f223cc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cbf240 0x55e998cc1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.782+0000 7f9f223cc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e998c28aa0 con 0x55e998cbf240 2024-08-20T05:18:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.782+0000 7f9f223cc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e998c17fa0 con 0x55e998cb32b0 2024-08-20T05:18:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.782+0000 7f9f223cc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e998c1bfe0 con 0x55e998cb2990 2024-08-20T05:18:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.783+0000 7f9f1da00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 0x55e998cb2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.783+0000 7f9f1d000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cb32b0 0x55e998cbed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.783+0000 7f9f1da00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 0x55e998cb2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:44526/0 (socket says 172.21.15.37:44526) 2024-08-20T05:18:42.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.783+0000 7f9f1da00640 1 -- 172.21.15.37:0/2246711031 learned_addr learned my addr 172.21.15.37:0/2246711031 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.783+0000 7f9f1d000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cb32b0 0x55e998cbed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:53114/0 (socket says 172.21.15.37:53114) 2024-08-20T05:18:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.783+0000 7f9f17e00640 1 --2- 172.21.15.37:0/2246711031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cbf240 0x55e998cc1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.783+0000 7f9f1da00640 1 -- 172.21.15.37:0/2246711031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cb32b0 msgr2=0x55e998cbed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.783+0000 7f9f1da00640 1 --2- 172.21.15.37:0/2246711031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cb32b0 0x55e998cbed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.783+0000 7f9f1da00640 1 -- 172.21.15.37:0/2246711031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cbf240 msgr2=0x55e998cc1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.783+0000 7f9f1da00640 1 --2- 172.21.15.37:0/2246711031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cbf240 0x55e998cc1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.783+0000 7f9f1da00640 1 -- 172.21.15.37:0/2246711031 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e998bbe420 con 0x55e998cb2990 2024-08-20T05:18:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.784+0000 7f9f1da00640 1 --2- 172.21.15.37:0/2246711031 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 0x55e998cb2d70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009fd0 tx=0x7f9f10010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b6fd1b106a28abc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.784+0000 7f9f0a000640 1 -- 172.21.15.37:0/2246711031 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10016070 con 0x55e998cb2990 2024-08-20T05:18:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.784+0000 7f9f0a000640 1 -- 172.21.15.37:0/2246711031 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f10012bc0 con 0x55e998cb2990 2024-08-20T05:18:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.784+0000 7f9f0a000640 1 -- 172.21.15.37:0/2246711031 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1001bbc0 con 0x55e998cb2990 2024-08-20T05:18:42.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.784+0000 7f9f15600640 1 --2- 172.21.15.37:0/2611624712 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f000b3bd0 0x7f9f000b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.785+0000 7f9f15600640 1 -- 172.21.15.37:0/2611624712 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9f040e4280 con 0x7f9f181042f0 2024-08-20T05:18:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.785+0000 7f9f223cc740 1 -- 172.21.15.37:0/2246711031 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 msgr2=0x55e998cb2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.785+0000 7f9f223cc740 1 --2- 172.21.15.37:0/2246711031 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 0x55e998cb2d70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f9f10009fd0 tx=0x7f9f10010800 comp rx=0 tx=0).stop 2024-08-20T05:18:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.785+0000 7f9f1d000640 1 --2- 172.21.15.37:0/2611624712 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f000b3bd0 0x7f9f000b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.785+0000 7f9f223cc740 1 -- 172.21.15.37:0/2246711031 shutdown_connections 2024-08-20T05:18:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.785+0000 7f9f223cc740 1 --2- 172.21.15.37:0/2246711031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cbf240 0x55e998cc1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.785+0000 7f9f223cc740 1 --2- 172.21.15.37:0/2246711031 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cb32b0 0x55e998cbed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.785+0000 7f9f223cc740 1 --2- 172.21.15.37:0/2246711031 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 0x55e998cb2d70 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.785+0000 7f9f223cc740 1 -- 172.21.15.37:0/2246711031 >> 172.21.15.37:0/2246711031 conn(0x55e998cb07c0 msgr2=0x55e998cb1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.785+0000 7f9f223cc740 1 -- 172.21.15.37:0/2246711031 shutdown_connections 2024-08-20T05:18:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.785+0000 7f9f223cc740 1 -- 172.21.15.37:0/2246711031 wait complete. 2024-08-20T05:18:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.786+0000 7f9f1d000640 1 --2- 172.21.15.37:0/2611624712 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f000b3bd0 0x7f9f000b6090 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c005ab0 tx=0x7f9f0c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:42.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.786+0000 7f9f223cc740 1 -- start start 2024-08-20T05:18:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.786+0000 7f9f223cc740 1 Processor -- start 2024-08-20T05:18:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.786+0000 7f9f223cc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 0x55e998cbea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.786+0000 7f9f223cc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cb32b0 0x55e998cbbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.786+0000 7f9f223cc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cbf240 0x55e998cbc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.786+0000 7f9f223cc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e998a7a700 con 0x55e998cbf240 2024-08-20T05:18:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.786+0000 7f9f223cc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e998bb3290 con 0x55e998cb32b0 2024-08-20T05:18:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.786+0000 7f9f223cc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e998cc1ec0 con 0x55e998cb2990 2024-08-20T05:18:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.786+0000 7f9f223cc740 10 client.0 _ll_register_callbacks cb 0x55e998c121c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.787+0000 7f9f1d000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 0x55e998cbea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.787+0000 7f9f1da00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cbf240 0x55e998cbc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.787+0000 7f9f1d000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 0x55e998cbea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:44538/0 (socket says 172.21.15.37:44538) 2024-08-20T05:18:42.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.787+0000 7f9f1d000640 1 -- 172.21.15.37:0/1888531008 learned_addr learned my addr 172.21.15.37:0/1888531008 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.787+0000 7f9f17e00640 1 --2- 172.21.15.37:0/1888531008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cb32b0 0x55e998cbbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.787+0000 7f9f17e00640 1 -- 172.21.15.37:0/1888531008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 msgr2=0x55e998cbea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.787+0000 7f9f17e00640 1 --2- 172.21.15.37:0/1888531008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 0x55e998cbea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.787+0000 7f9f17e00640 1 -- 172.21.15.37:0/1888531008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cbf240 msgr2=0x55e998cbc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.787+0000 7f9f17e00640 1 --2- 172.21.15.37:0/1888531008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cbf240 0x55e998cbc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.787+0000 7f9f17e00640 1 -- 172.21.15.37:0/1888531008 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e998977650 con 0x55e998cb32b0 2024-08-20T05:18:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.787+0000 7f9f17e00640 1 --2- 172.21.15.37:0/1888531008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cb32b0 0x55e998cbbe70 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9f040e1a30 tx=0x7f9f040aacc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8b318fd29920e7d server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.787+0000 7f9efea00640 10 client.0 ms_handle_connect on v2:172.21.15.130:3300/0 2024-08-20T05:18:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.788+0000 7f9efea00640 1 -- 172.21.15.37:0/1888531008 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f040ab530 con 0x55e998cb32b0 2024-08-20T05:18:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.788+0000 7f9f223cc740 1 -- 172.21.15.37:0/1888531008 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f10012bc0 con 0x55e998cb32b0 2024-08-20T05:18:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.788+0000 7f9efea00640 1 -- 172.21.15.37:0/1888531008 <== mon.2 v2:172.21.15.130:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9f040037a0 con 0x55e998cb32b0 2024-08-20T05:18:42.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.788+0000 7f9efea00640 1 -- 172.21.15.37:0/1888531008 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f9f040aae30 con 0x55e998cb32b0 2024-08-20T05:18:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.788+0000 7f9f223cc740 10 client.29390 fetch_fsmap learned FSMap version 56 2024-08-20T05:18:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.788+0000 7f9f223cc740 1 -- 172.21.15.37:0/1888531008 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55e998ccd7d0 con 0x55e998cb32b0 2024-08-20T05:18:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.788+0000 7f9efea00640 1 -- 172.21.15.37:0/1888531008 <== mon.2 v2:172.21.15.130:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f10012bc0 con 0x55e998cb32b0 2024-08-20T05:18:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.788+0000 7f9efea00640 1 -- 172.21.15.37:0/1888531008 <== mon.2 v2:172.21.15.130:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f9f040b3a50 con 0x55e998cb32b0 2024-08-20T05:18:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.788+0000 7f9f223cc740 10 client.29390 fetch_fsmap finished waiting for FSMap version 56 2024-08-20T05:18:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.788+0000 7f9f223cc740 10 client.29390 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:18:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.788+0000 7f9f223cc740 20 client.29390 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.788+0000 7f9f223cc740 1 --2- 172.21.15.37:0/1888531008 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55e998ccec30 0x55e998cd1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.788+0000 7f9f223cc740 4 client.29390 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:18:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.788+0000 7f9f223cc740 1 -- 172.21.15.37:0/1888531008 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e998c2a9f0 con 0x55e998ccec30 2024-08-20T05:18:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.789+0000 7f9f1d000640 1 --2- 172.21.15.37:0/1888531008 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55e998ccec30 0x55e998cd1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.789+0000 7f9f1d000640 1 --2- 172.21.15.37:0/1888531008 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55e998ccec30 0x55e998cd1020 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=119a148b6f0da688 server_cookie=4957a5bb8d262c87 in_seq=0 out_seq=0 2024-08-20T05:18:42.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.789+0000 7f9efea00640 10 client.29390 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:18:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.790+0000 7f9efea00640 1 -- 172.21.15.37:0/1888531008 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e998c2a9f0 con 0x55e998ccec30 2024-08-20T05:18:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.790+0000 7f9efea00640 10 client.29390 handle_command_reply: tid=0 2024-08-20T05:18:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.790+0000 7f9f223cc740 1 client.29390 shutdown 2024-08-20T05:18:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.790+0000 7f9f223cc740 1 -- 172.21.15.37:0/1888531008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cb32b0 msgr2=0x55e998cbbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.790+0000 7f9f223cc740 1 --2- 172.21.15.37:0/1888531008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cb32b0 0x55e998cbbe70 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9f040e1a30 tx=0x7f9f040aacc0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.791+0000 7f9f223cc740 1 -- 172.21.15.37:0/1888531008 shutdown_connections 2024-08-20T05:18:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.791+0000 7f9f223cc740 1 --2- 172.21.15.37:0/1888531008 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55e998ccec30 0x55e998cd1020 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.791+0000 7f9f223cc740 1 --2- 172.21.15.37:0/1888531008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cbf240 0x55e998cbc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.791+0000 7f9f223cc740 1 --2- 172.21.15.37:0/1888531008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cb32b0 0x55e998cbbe70 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.791+0000 7f9efea00640 0 client.29390 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:18:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.791+0000 7f9f223cc740 1 --2- 172.21.15.37:0/1888531008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 0x55e998cbea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.791+0000 7f9f223cc740 1 -- 172.21.15.37:0/1888531008 >> 172.21.15.37:0/1888531008 conn(0x55e998cb07c0 msgr2=0x55e998cb6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:42.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.791+0000 7f9f223cc740 1 -- 172.21.15.37:0/1888531008 shutdown_connections 2024-08-20T05:18:42.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.791+0000 7f9f223cc740 1 -- 172.21.15.37:0/1888531008 wait complete. 2024-08-20T05:18:42.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.791+0000 7f9f223cc740 20 client.29390 trim_cache size 0 max 16384 2024-08-20T05:18:42.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.805+0000 7f9f223cc740 1 Processor -- start 2024-08-20T05:18:42.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.805+0000 7f9f223cc740 1 -- start start 2024-08-20T05:18:42.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.805+0000 7f9f223cc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 0x55e998cd6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.805+0000 7f9f223cc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cb32b0 0x55e998cd6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.805+0000 7f9f223cc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cbf240 0x55e998cb90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.805+0000 7f9f223cc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9f181b1930 con 0x55e998cb32b0 2024-08-20T05:18:42.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.805+0000 7f9f223cc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9f181b34d0 con 0x55e998cbf240 2024-08-20T05:18:42.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.805+0000 7f9f223cc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9f181b2060 con 0x55e998cb2990 2024-08-20T05:18:42.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.806+0000 7f9f17e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cb32b0 0x55e998cd6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.806+0000 7f9f17e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cb32b0 0x55e998cd6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53162/0 (socket says 172.21.15.37:53162) 2024-08-20T05:18:42.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.806+0000 7f9f17e00640 1 -- 172.21.15.37:0/2569842921 learned_addr learned my addr 172.21.15.37:0/2569842921 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:42.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.806+0000 7f9f1d000640 1 --2- 172.21.15.37:0/2569842921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 0x55e998cd6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.806+0000 7f9f1da00640 1 --2- 172.21.15.37:0/2569842921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cbf240 0x55e998cb90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.806+0000 7f9f17e00640 1 -- 172.21.15.37:0/2569842921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 msgr2=0x55e998cd6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:42.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.806+0000 7f9f17e00640 1 --2- 172.21.15.37:0/2569842921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 0x55e998cd6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.806+0000 7f9f17e00640 1 -- 172.21.15.37:0/2569842921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cbf240 msgr2=0x55e998cb90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:42.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.806+0000 7f9f17e00640 1 --2- 172.21.15.37:0/2569842921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cbf240 0x55e998cb90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.806+0000 7f9f17e00640 1 -- 172.21.15.37:0/2569842921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e998cbadf0 con 0x55e998cb32b0 2024-08-20T05:18:42.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.806+0000 7f9f17e00640 1 --2- 172.21.15.37:0/2569842921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cb32b0 0x55e998cd6e70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f9f040aadc0 tx=0x7f9f040aad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9352a71de19f9d5 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.806+0000 7f9f09600640 1 -- 172.21.15.37:0/2569842921 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f040ab530 con 0x55e998cb32b0 2024-08-20T05:18:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.806+0000 7f9f09600640 1 -- 172.21.15.37:0/2569842921 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f04004410 con 0x55e998cb32b0 2024-08-20T05:18:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.807+0000 7f9f09600640 1 -- 172.21.15.37:0/2569842921 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f040b3a50 con 0x55e998cb32b0 2024-08-20T05:18:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.807+0000 7f9f223cc740 1 -- 172.21.15.37:0/2569842921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cb32b0 msgr2=0x55e998cd6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.807+0000 7f9f223cc740 1 --2- 172.21.15.37:0/2569842921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cb32b0 0x55e998cd6e70 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f9f040aadc0 tx=0x7f9f040aad30 comp rx=0 tx=0).stop 2024-08-20T05:18:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.807+0000 7f9f223cc740 1 -- 172.21.15.37:0/2569842921 shutdown_connections 2024-08-20T05:18:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.807+0000 7f9f223cc740 1 --2- 172.21.15.37:0/2569842921 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cbf240 0x55e998cb90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.807+0000 7f9f223cc740 1 --2- 172.21.15.37:0/2569842921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cb32b0 0x55e998cd6e70 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.807+0000 7f9f223cc740 1 --2- 172.21.15.37:0/2569842921 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb2990 0x55e998cd6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.807+0000 7f9f223cc740 1 -- 172.21.15.37:0/2569842921 >> 172.21.15.37:0/2569842921 conn(0x55e998cb07c0 msgr2=0x55e998caf940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.807+0000 7f9f223cc740 1 -- 172.21.15.37:0/2569842921 shutdown_connections 2024-08-20T05:18:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.807+0000 7f9f223cc740 1 -- 172.21.15.37:0/2569842921 wait complete. 2024-08-20T05:18:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.808+0000 7f9f223cc740 1 -- start start 2024-08-20T05:18:42.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.808+0000 7f9f223cc740 1 Processor -- start 2024-08-20T05:18:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.808+0000 7f9f223cc740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cb2990 0x55e998cc7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.808+0000 7f9f223cc740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb32b0 0x55e998cc4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.808+0000 7f9f223cc740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cbf240 0x55e998cc5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.808+0000 7f9f223cc740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9f181b2e00 con 0x55e998cb2990 2024-08-20T05:18:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.808+0000 7f9f223cc740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9f181b2730 con 0x55e998cbf240 2024-08-20T05:18:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.808+0000 7f9f223cc740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9f181af910 con 0x55e998cb32b0 2024-08-20T05:18:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.808+0000 7f9f223cc740 10 client.0 _ll_register_callbacks cb 0x7f9f04003d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.809+0000 7f9f1d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cb2990 0x55e998cc7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.809+0000 7f9f1d000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cb2990 0x55e998cc7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53172/0 (socket says 172.21.15.37:53172) 2024-08-20T05:18:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.809+0000 7f9f1d000640 1 -- 172.21.15.37:0/3868948803 learned_addr learned my addr 172.21.15.37:0/3868948803 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.809+0000 7f9f17e00640 1 --2- 172.21.15.37:0/3868948803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb32b0 0x55e998cc4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.809+0000 7f9f1da00640 1 --2- 172.21.15.37:0/3868948803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cbf240 0x55e998cc5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.809+0000 7f9f1d000640 1 -- 172.21.15.37:0/3868948803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb32b0 msgr2=0x55e998cc4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:42.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.809+0000 7f9f1d000640 1 --2- 172.21.15.37:0/3868948803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb32b0 0x55e998cc4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.809+0000 7f9f1d000640 1 -- 172.21.15.37:0/3868948803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cbf240 msgr2=0x55e998cc5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:42.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.809+0000 7f9f1d000640 1 --2- 172.21.15.37:0/3868948803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cbf240 0x55e998cc5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.809+0000 7f9f1d000640 1 -- 172.21.15.37:0/3868948803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e998d38910 con 0x55e998cb2990 2024-08-20T05:18:42.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.809+0000 7f9f17e00640 1 --2- 172.21.15.37:0/3868948803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb32b0 0x55e998cc4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:42.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.810+0000 7f9f1d000640 1 --2- 172.21.15.37:0/3868948803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cb2990 0x55e998cc7970 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c000c00 tx=0x7f9f0c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6776a7479feab76 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:42.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.810+0000 7f9efea00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:18:42.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.810+0000 7f9efea00640 1 -- 172.21.15.37:0/3868948803 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c035040 con 0x55e998cb2990 2024-08-20T05:18:42.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.810+0000 7f9efea00640 1 -- 172.21.15.37:0/3868948803 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9f0c0035f0 con 0x55e998cb2990 2024-08-20T05:18:42.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.810+0000 7f9f223cc740 1 -- 172.21.15.37:0/3868948803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f04004410 con 0x55e998cb2990 2024-08-20T05:18:42.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.810+0000 7f9efea00640 1 -- 172.21.15.37:0/3868948803 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f9f0c066050 con 0x55e998cb2990 2024-08-20T05:18:42.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.810+0000 7f9f223cc740 10 client.18615 fetch_fsmap learned FSMap version 56 2024-08-20T05:18:42.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.810+0000 7f9f223cc740 1 -- 172.21.15.37:0/3868948803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55e998d39b30 con 0x55e998cb2990 2024-08-20T05:18:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.811+0000 7f9efea00640 1 -- 172.21.15.37:0/3868948803 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f04004410 con 0x55e998cb2990 2024-08-20T05:18:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.811+0000 7f9efea00640 1 -- 172.21.15.37:0/3868948803 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f9f0c032780 con 0x55e998cb2990 2024-08-20T05:18:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.811+0000 7f9f223cc740 10 client.18615 fetch_fsmap finished waiting for FSMap version 56 2024-08-20T05:18:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.811+0000 7f9f223cc740 10 client.18615 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-08-20T05:18:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.811+0000 7f9f223cc740 20 client.18615 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.811+0000 7f9f223cc740 1 --2- 172.21.15.37:0/3868948803 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55e998d3a2c0 0x55e998d3c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.811+0000 7f9f223cc740 4 client.18615 mds_command: new command op to 24637 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:18:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.811+0000 7f9f223cc740 1 -- 172.21.15.37:0/3868948803 --> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e998c26490 con 0x55e998d3a2c0 2024-08-20T05:18:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.811+0000 7f9f17e00640 1 --2- 172.21.15.37:0/3868948803 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55e998d3a2c0 0x55e998d3c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.812+0000 7f9f17e00640 1 --2- 172.21.15.37:0/3868948803 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55e998d3a2c0 0x55e998d3c6e0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=668aeaa63a3c7769 server_cookie=50884a468568e515 in_seq=0 out_seq=0 2024-08-20T05:18:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.812+0000 7f9efea00640 10 client.18615 ms_handle_connect on v2:172.21.15.135:6834/998113160 2024-08-20T05:18:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.812+0000 7f9efea00640 1 -- 172.21.15.37:0/3868948803 <== mds.4 v2:172.21.15.135:6834/998113160 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e998c26490 con 0x55e998d3a2c0 2024-08-20T05:18:42.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.812+0000 7f9efea00640 10 client.18615 handle_command_reply: tid=0 2024-08-20T05:18:42.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.812+0000 7f9f223cc740 1 client.18615 shutdown 2024-08-20T05:18:42.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.812+0000 7f9f223cc740 1 -- 172.21.15.37:0/3868948803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cb2990 msgr2=0x55e998cc7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:42.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.812+0000 7f9f223cc740 1 --2- 172.21.15.37:0/3868948803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cb2990 0x55e998cc7970 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c000c00 tx=0x7f9f0c009260 comp rx=0 tx=0).stop 2024-08-20T05:18:42.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.812+0000 7f9f223cc740 1 -- 172.21.15.37:0/3868948803 shutdown_connections 2024-08-20T05:18:42.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.812+0000 7f9f223cc740 1 --2- 172.21.15.37:0/3868948803 >> [v2:172.21.15.135:6834/998113160,v1:172.21.15.135:6835/998113160] conn(0x55e998d3a2c0 0x55e998d3c6e0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.812+0000 7f9f223cc740 1 --2- 172.21.15.37:0/3868948803 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e998cbf240 0x55e998cc5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.812+0000 7f9f223cc740 1 --2- 172.21.15.37:0/3868948803 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e998cb32b0 0x55e998cc4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.812+0000 7f9f223cc740 1 --2- 172.21.15.37:0/3868948803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e998cb2990 0x55e998cc7970 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.812+0000 7f9efea00640 0 client.18615 ms_handle_reset on v2:172.21.15.135:6834/998113160 2024-08-20T05:18:42.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.812+0000 7f9f223cc740 1 -- 172.21.15.37:0/3868948803 >> 172.21.15.37:0/3868948803 conn(0x55e998cb07c0 msgr2=0x55e998cbd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:42.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.812+0000 7f9f223cc740 1 -- 172.21.15.37:0/3868948803 shutdown_connections 2024-08-20T05:18:42.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.812+0000 7f9f223cc740 1 -- 172.21.15.37:0/3868948803 wait complete. 2024-08-20T05:18:42.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.813+0000 7f9f223cc740 20 client.18615 trim_cache size 0 max 16384 2024-08-20T05:18:42.825 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:18:42.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.813+0000 7f9f1fa00640 1 -- 172.21.15.37:0/2611624712 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f000b3bd0 msgr2=0x7f9f000b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:42.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.813+0000 7f9f1fa00640 1 --2- 172.21.15.37:0/2611624712 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f000b3bd0 0x7f9f000b6090 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c005ab0 tx=0x7f9f0c005a20 comp rx=0 tx=0).stop 2024-08-20T05:18:42.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.813+0000 7f9f1fa00640 1 -- 172.21.15.37:0/2611624712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f181042f0 msgr2=0x7f9f18101bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:42.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.813+0000 7f9f1fa00640 1 --2- 172.21.15.37:0/2611624712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f181042f0 0x7f9f18101bc0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400e9c0 tx=0x7f9f0400ee80 comp rx=0 tx=0).stop 2024-08-20T05:18:42.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.813+0000 7f9f1fa00640 1 -- 172.21.15.37:0/2611624712 shutdown_connections 2024-08-20T05:18:42.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.813+0000 7f9f1fa00640 1 --2- 172.21.15.37:0/2611624712 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9f000b3bd0 0x7f9f000b6090 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.813+0000 7f9f1fa00640 1 --2- 172.21.15.37:0/2611624712 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9f1810ce30 0x7f9f18102100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.813+0000 7f9f1fa00640 1 --2- 172.21.15.37:0/2611624712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f181042f0 0x7f9f18101bc0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.813+0000 7f9f1fa00640 1 --2- 172.21.15.37:0/2611624712 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9f181039d0 0x7f9f18101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:42.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.813+0000 7f9f1fa00640 1 -- 172.21.15.37:0/2611624712 >> 172.21.15.37:0/2611624712 conn(0x7f9f180fd410 msgr2=0x7f9f180fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:42.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.814+0000 7f9f1fa00640 1 -- 172.21.15.37:0/2611624712 shutdown_connections 2024-08-20T05:18:42.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:42.814+0000 7f9f1fa00640 1 -- 172.21.15.37:0/2611624712 wait complete. 2024-08-20T05:18:42.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:42 smithi135 ceph-mon[22342]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:18:42.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:42 smithi130 ceph-mon[22007]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:18:43.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:42 smithi037 ceph-mon[17265]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-08-20T05:18:43.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-08-20T05:18:43.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:43 smithi130 ceph-mon[22007]: pgmap v895: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-08-20T05:18:44.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:43 smithi037 ceph-mon[17265]: pgmap v895: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-08-20T05:18:44.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:43 smithi135 ceph-mon[22342]: pgmap v895: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 15 KiB/s wr, 18 op/s 2024-08-20T05:18:44.120 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:18:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.676+0000 7f3d8fe00640 1 -- 172.21.15.37:0/3238179008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d90108cb0 msgr2=0x7f3d9010f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.676+0000 7f3d8fe00640 1 --2- 172.21.15.37:0/3238179008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d90108cb0 0x7f3d9010f4b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009ca0 tx=0x7f3d8802a8c0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.677+0000 7f3d8fe00640 1 -- 172.21.15.37:0/3238179008 shutdown_connections 2024-08-20T05:18:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.677+0000 7f3d8fe00640 1 --2- 172.21.15.37:0/3238179008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d90108cb0 0x7f3d9010f4b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.677+0000 7f3d8fe00640 1 --2- 172.21.15.37:0/3238179008 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d90108330 0x7f3d90108770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.677+0000 7f3d8fe00640 1 --2- 172.21.15.37:0/3238179008 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d90102920 0x7f3d90102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.677+0000 7f3d8fe00640 1 -- 172.21.15.37:0/3238179008 >> 172.21.15.37:0/3238179008 conn(0x7f3d900fe350 msgr2=0x7f3d90100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.677+0000 7f3d8fe00640 1 -- 172.21.15.37:0/3238179008 shutdown_connections 2024-08-20T05:18:44.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.677+0000 7f3d8fe00640 1 -- 172.21.15.37:0/3238179008 wait complete. 2024-08-20T05:18:44.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.678+0000 7f3d8fe00640 1 Processor -- start 2024-08-20T05:18:44.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.678+0000 7f3d8fe00640 1 -- start start 2024-08-20T05:18:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.678+0000 7f3d8fe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d90102920 0x7f3d900751d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.678+0000 7f3d8fe00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d90108330 0x7f3d90075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.678+0000 7f3d8fe00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d90108cb0 0x7f3d90075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.678+0000 7f3d8fe00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d901129c0 con 0x7f3d90108cb0 2024-08-20T05:18:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.678+0000 7f3d8fe00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3d90112840 con 0x7f3d90102920 2024-08-20T05:18:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.678+0000 7f3d8fe00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d90112b40 con 0x7f3d90108330 2024-08-20T05:18:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.679+0000 7f3d8f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d90108cb0 0x7f3d90075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.679+0000 7f3d8e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d90108330 0x7f3d90075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.679+0000 7f3d8e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d90108330 0x7f3d90075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:45288/0 (socket says 172.21.15.37:45288) 2024-08-20T05:18:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.679+0000 7f3d8f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d90108cb0 0x7f3d90075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59322/0 (socket says 172.21.15.37:59322) 2024-08-20T05:18:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.679+0000 7f3d8e000640 1 -- 172.21.15.37:0/2954499039 learned_addr learned my addr 172.21.15.37:0/2954499039 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.679+0000 7f3d8ea00640 1 --2- 172.21.15.37:0/2954499039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d90102920 0x7f3d900751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.679+0000 7f3d8e000640 1 -- 172.21.15.37:0/2954499039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d90102920 msgr2=0x7f3d900751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:44.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.679+0000 7f3d8e000640 1 --2- 172.21.15.37:0/2954499039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d90102920 0x7f3d900751d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.679+0000 7f3d8e000640 1 -- 172.21.15.37:0/2954499039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d90108cb0 msgr2=0x7f3d90075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:44.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.679+0000 7f3d8e000640 1 --2- 172.21.15.37:0/2954499039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d90108cb0 0x7f3d90075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.679+0000 7f3d8e000640 1 -- 172.21.15.37:0/2954499039 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d901a70f0 con 0x7f3d90108330 2024-08-20T05:18:44.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.679+0000 7f3d8f400640 1 --2- 172.21.15.37:0/2954499039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d90108cb0 0x7f3d90075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:44.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.679+0000 7f3d8e000640 1 --2- 172.21.15.37:0/2954499039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d90108330 0x7f3d90075710 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00d950 tx=0x7f3d7c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:44.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.680+0000 7f3d87400640 1 -- 172.21.15.37:0/2954499039 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c017070 con 0x7f3d90108330 2024-08-20T05:18:44.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.680+0000 7f3d87400640 1 -- 172.21.15.37:0/2954499039 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d7c009c30 con 0x7f3d90108330 2024-08-20T05:18:44.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.680+0000 7f3d8fe00640 1 -- 172.21.15.37:0/2954499039 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d901a73e0 con 0x7f3d90108330 2024-08-20T05:18:44.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.680+0000 7f3d87400640 1 -- 172.21.15.37:0/2954499039 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c00f620 con 0x7f3d90108330 2024-08-20T05:18:44.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.680+0000 7f3d8fe00640 1 -- 172.21.15.37:0/2954499039 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d901a7920 con 0x7f3d90108330 2024-08-20T05:18:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.683+0000 7f3d98215740 1 Processor -- start 2024-08-20T05:18:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.683+0000 7f3d98215740 1 -- start start 2024-08-20T05:18:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.683+0000 7f3d98215740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 0x55e906da1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.683+0000 7f3d98215740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906da23e0 0x55e906dade30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.683+0000 7f3d98215740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906dae370 0x55e906db0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.684+0000 7f3d98215740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e906d17aa0 con 0x55e906dae370 2024-08-20T05:18:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.684+0000 7f3d98215740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e906d06fa0 con 0x55e906da1ac0 2024-08-20T05:18:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.684+0000 7f3d98215740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e906d0afe0 con 0x55e906da23e0 2024-08-20T05:18:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.684+0000 7f3d87400640 1 -- 172.21.15.37:0/2954499039 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f3d7c010460 con 0x7f3d90108330 2024-08-20T05:18:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.684+0000 7f3d8f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 0x55e906da1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.684+0000 7f3d8f400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 0x55e906da1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42182/0 (socket says 172.21.15.37:42182) 2024-08-20T05:18:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.684+0000 7f3d8f400640 1 -- 172.21.15.37:0/2469995738 learned_addr learned my addr 172.21.15.37:0/2469995738 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.684+0000 7f3d8ea00640 1 --2- 172.21.15.37:0/2469995738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906da23e0 0x55e906dade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.684+0000 7f3d8e000640 1 --2- 172.21.15.37:0/2469995738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906dae370 0x55e906db0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.684+0000 7f3d8f400640 1 -- 172.21.15.37:0/2469995738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906da23e0 msgr2=0x55e906dade30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.684+0000 7f3d8f400640 1 --2- 172.21.15.37:0/2469995738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906da23e0 0x55e906dade30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.684+0000 7f3d8f400640 1 -- 172.21.15.37:0/2469995738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906dae370 msgr2=0x55e906db0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.684+0000 7f3d8f400640 1 --2- 172.21.15.37:0/2469995738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906dae370 0x55e906db0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.684+0000 7f3d8f400640 1 -- 172.21.15.37:0/2469995738 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e906cad420 con 0x55e906da1ac0 2024-08-20T05:18:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.684+0000 7f3d8e000640 1 --2- 172.21.15.37:0/2469995738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906dae370 0x55e906db0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:18:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.685+0000 7f3d8f400640 1 --2- 172.21.15.37:0/2469995738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 0x55e906da1ea0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3d8802aeb0 tx=0x7f3d88005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d6ec6c431bd68bd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.685+0000 7f3d7b400640 1 -- 172.21.15.37:0/2469995738 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88031650 con 0x55e906da1ac0 2024-08-20T05:18:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.686+0000 7f3d7b400640 1 -- 172.21.15.37:0/2469995738 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d88036040 con 0x55e906da1ac0 2024-08-20T05:18:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.686+0000 7f3d7b400640 1 -- 172.21.15.37:0/2469995738 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88004470 con 0x55e906da1ac0 2024-08-20T05:18:44.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.686+0000 7f3d87400640 1 --2- 172.21.15.37:0/2954499039 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d740b3c70 0x7f3d740b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.686+0000 7f3d87400640 1 -- 172.21.15.37:0/2954499039 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3d7c0e3ac0 con 0x7f3d90108330 2024-08-20T05:18:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.686+0000 7f3d8ea00640 1 --2- 172.21.15.37:0/2954499039 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d740b3c70 0x7f3d740b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.687+0000 7f3d98215740 1 -- 172.21.15.37:0/2469995738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 msgr2=0x55e906da1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.687+0000 7f3d98215740 1 --2- 172.21.15.37:0/2469995738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 0x55e906da1ea0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f3d8802aeb0 tx=0x7f3d88005fd0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.687+0000 7f3d98215740 1 -- 172.21.15.37:0/2469995738 shutdown_connections 2024-08-20T05:18:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.687+0000 7f3d98215740 1 --2- 172.21.15.37:0/2469995738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906dae370 0x55e906db0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.687+0000 7f3d98215740 1 --2- 172.21.15.37:0/2469995738 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906da23e0 0x55e906dade30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.687+0000 7f3d98215740 1 --2- 172.21.15.37:0/2469995738 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 0x55e906da1ea0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.687+0000 7f3d98215740 1 -- 172.21.15.37:0/2469995738 >> 172.21.15.37:0/2469995738 conn(0x55e906d9f8f0 msgr2=0x55e906da0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.687+0000 7f3d8ea00640 1 --2- 172.21.15.37:0/2954499039 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d740b3c70 0x7f3d740b6130 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x55e906da07d0 tx=0x7f3d8000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.687+0000 7f3d98215740 1 -- 172.21.15.37:0/2469995738 shutdown_connections 2024-08-20T05:18:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.687+0000 7f3d98215740 1 -- 172.21.15.37:0/2469995738 wait complete. 2024-08-20T05:18:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.687+0000 7f3d98215740 1 -- start start 2024-08-20T05:18:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.688+0000 7f3d98215740 1 Processor -- start 2024-08-20T05:18:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.688+0000 7f3d98215740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 0x55e906dadb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.688+0000 7f3d98215740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906da23e0 0x55e906daaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.688+0000 7f3d98215740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906dae370 0x55e906dab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.688+0000 7f3d98215740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e906b69700 con 0x55e906da23e0 2024-08-20T05:18:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.688+0000 7f3d98215740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e906ca2290 con 0x55e906da1ac0 2024-08-20T05:18:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.688+0000 7f3d98215740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e906db0e10 con 0x55e906dae370 2024-08-20T05:18:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.688+0000 7f3d98215740 10 client.0 _ll_register_callbacks cb 0x55e906d011c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:44.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.688+0000 7f3d8e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906da23e0 0x55e906daaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.688+0000 7f3d8e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906da23e0 0x55e906daaf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59332/0 (socket says 172.21.15.37:59332) 2024-08-20T05:18:44.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.689+0000 7f3d8e000640 1 -- 172.21.15.37:0/209957435 learned_addr learned my addr 172.21.15.37:0/209957435 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:44.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.689+0000 7f3d8ea00640 1 --2- 172.21.15.37:0/209957435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 0x55e906dadb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.689+0000 7f3d8f400640 1 --2- 172.21.15.37:0/209957435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906dae370 0x55e906dab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.689+0000 7f3d8e000640 1 -- 172.21.15.37:0/209957435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906dae370 msgr2=0x55e906dab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:44.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.689+0000 7f3d8e000640 1 --2- 172.21.15.37:0/209957435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906dae370 0x55e906dab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.689+0000 7f3d8e000640 1 -- 172.21.15.37:0/209957435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 msgr2=0x55e906dadb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:44.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.689+0000 7f3d8e000640 1 --2- 172.21.15.37:0/209957435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 0x55e906dadb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.689+0000 7f3d8e000640 1 -- 172.21.15.37:0/209957435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e906a66650 con 0x55e906da23e0 2024-08-20T05:18:44.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.690+0000 7f3d6fe00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:18:44.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.689+0000 7f3d8e000640 1 --2- 172.21.15.37:0/209957435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906da23e0 0x55e906daaf80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0aa6b0 tx=0x7f3d7c0aa4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b475cb2a729c32 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:44.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.690+0000 7f3d6fe00640 1 -- 172.21.15.37:0/209957435 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c020070 con 0x55e906da23e0 2024-08-20T05:18:44.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.690+0000 7f3d6fe00640 1 -- 172.21.15.37:0/209957435 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3d7c0cbb70 con 0x55e906da23e0 2024-08-20T05:18:44.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.690+0000 7f3d98215740 1 -- 172.21.15.37:0/209957435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d88036040 con 0x55e906da23e0 2024-08-20T05:18:44.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.690+0000 7f3d6fe00640 1 -- 172.21.15.37:0/209957435 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f3d7c0aa230 con 0x55e906da23e0 2024-08-20T05:18:44.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.690+0000 7f3d98215740 10 client.18627 fetch_fsmap learned FSMap version 56 2024-08-20T05:18:44.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.690+0000 7f3d98215740 1 -- 172.21.15.37:0/209957435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55e906dbc650 con 0x55e906da23e0 2024-08-20T05:18:44.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.691+0000 7f3d6fe00640 1 -- 172.21.15.37:0/209957435 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d88036040 con 0x55e906da23e0 2024-08-20T05:18:44.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.691+0000 7f3d6fe00640 1 -- 172.21.15.37:0/209957435 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f3d7c0a6090 con 0x55e906da23e0 2024-08-20T05:18:44.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.691+0000 7f3d98215740 10 client.18627 fetch_fsmap finished waiting for FSMap version 56 2024-08-20T05:18:44.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.691+0000 7f3d98215740 10 client.18627 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:18:44.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.691+0000 7f3d98215740 20 client.18627 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:44.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.691+0000 7f3d98215740 1 --2- 172.21.15.37:0/209957435 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55e906dbdbb0 0x55e906dbffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.691+0000 7f3d98215740 4 client.18627 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:18:44.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.691+0000 7f3d98215740 1 -- 172.21.15.37:0/209957435 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e906d199f0 con 0x55e906dbdbb0 2024-08-20T05:18:44.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.691+0000 7f3d8ea00640 1 --2- 172.21.15.37:0/209957435 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55e906dbdbb0 0x55e906dbffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.692+0000 7f3d8ea00640 1 --2- 172.21.15.37:0/209957435 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55e906dbdbb0 0x55e906dbffa0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=58e6fbfd65b8f191 server_cookie=147b1546e777d22f in_seq=0 out_seq=0 2024-08-20T05:18:44.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.692+0000 7f3d6fe00640 10 client.18627 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:18:44.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.693+0000 7f3d6fe00640 1 -- 172.21.15.37:0/209957435 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e906d199f0 con 0x55e906dbdbb0 2024-08-20T05:18:44.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.693+0000 7f3d6fe00640 10 client.18627 handle_command_reply: tid=0 2024-08-20T05:18:44.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.693+0000 7f3d98215740 1 client.18627 shutdown 2024-08-20T05:18:44.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.693+0000 7f3d98215740 1 -- 172.21.15.37:0/209957435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906da23e0 msgr2=0x55e906daaf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:44.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.693+0000 7f3d98215740 1 --2- 172.21.15.37:0/209957435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906da23e0 0x55e906daaf80 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0aa6b0 tx=0x7f3d7c0aa4f0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.693+0000 7f3d98215740 1 -- 172.21.15.37:0/209957435 shutdown_connections 2024-08-20T05:18:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.693+0000 7f3d98215740 1 --2- 172.21.15.37:0/209957435 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55e906dbdbb0 0x55e906dbffa0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.693+0000 7f3d98215740 1 --2- 172.21.15.37:0/209957435 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906dae370 0x55e906dab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.693+0000 7f3d98215740 1 --2- 172.21.15.37:0/209957435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906da23e0 0x55e906daaf80 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.693+0000 7f3d98215740 1 --2- 172.21.15.37:0/209957435 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 0x55e906dadb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.693+0000 7f3d98215740 1 -- 172.21.15.37:0/209957435 >> 172.21.15.37:0/209957435 conn(0x55e906d9f8f0 msgr2=0x55e906da5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.693+0000 7f3d6fe00640 0 client.18627 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:18:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.693+0000 7f3d98215740 1 -- 172.21.15.37:0/209957435 shutdown_connections 2024-08-20T05:18:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.694+0000 7f3d98215740 1 -- 172.21.15.37:0/209957435 wait complete. 2024-08-20T05:18:44.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.694+0000 7f3d98215740 20 client.18627 trim_cache size 0 max 16384 2024-08-20T05:18:44.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.708+0000 7f3d98215740 1 Processor -- start 2024-08-20T05:18:44.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.708+0000 7f3d98215740 1 -- start start 2024-08-20T05:18:44.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.708+0000 7f3d98215740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906da1250 0x55e906db9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.708+0000 7f3d98215740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906d9f8f0 0x55e906dc5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.708+0000 7f3d98215740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 0x55e906dc5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.708+0000 7f3d98215740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d901b1740 con 0x55e906d9f8f0 2024-08-20T05:18:44.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.708+0000 7f3d98215740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3d901b32e0 con 0x55e906da1ac0 2024-08-20T05:18:44.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.708+0000 7f3d98215740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d901b1e70 con 0x55e906da1250 2024-08-20T05:18:44.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.708+0000 7f3d8e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906d9f8f0 0x55e906dc5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.709+0000 7f3d8e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906d9f8f0 0x55e906dc5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59348/0 (socket says 172.21.15.37:59348) 2024-08-20T05:18:44.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.709+0000 7f3d8e000640 1 -- 172.21.15.37:0/1593310971 learned_addr learned my addr 172.21.15.37:0/1593310971 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:44.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.709+0000 7f3d8ea00640 1 --2- 172.21.15.37:0/1593310971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906da1250 0x55e906db9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.709+0000 7f3d8f400640 1 --2- 172.21.15.37:0/1593310971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 0x55e906dc5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.709+0000 7f3d8f400640 1 -- 172.21.15.37:0/1593310971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906da1250 msgr2=0x55e906db9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:44.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.709+0000 7f3d8f400640 1 --2- 172.21.15.37:0/1593310971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906da1250 0x55e906db9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.709+0000 7f3d8f400640 1 -- 172.21.15.37:0/1593310971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906d9f8f0 msgr2=0x55e906dc5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:44.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.709+0000 7f3d8f400640 1 --2- 172.21.15.37:0/1593310971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906d9f8f0 0x55e906dc5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.709+0000 7f3d8f400640 1 -- 172.21.15.37:0/1593310971 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e906dab820 con 0x55e906da1ac0 2024-08-20T05:18:44.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.709+0000 7f3d8f400640 1 --2- 172.21.15.37:0/1593310971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 0x55e906dc5db0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3d88005e30 tx=0x7f3d880095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=675fe7caf55793f6 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:44.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.710+0000 7f3d7aa00640 1 -- 172.21.15.37:0/1593310971 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88055070 con 0x55e906da1ac0 2024-08-20T05:18:44.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.710+0000 7f3d7aa00640 1 -- 172.21.15.37:0/1593310971 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d88036040 con 0x55e906da1ac0 2024-08-20T05:18:44.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.710+0000 7f3d7aa00640 1 -- 172.21.15.37:0/1593310971 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88004040 con 0x55e906da1ac0 2024-08-20T05:18:44.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.710+0000 7f3d98215740 1 -- 172.21.15.37:0/1593310971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 msgr2=0x55e906dc5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:44.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.710+0000 7f3d98215740 1 --2- 172.21.15.37:0/1593310971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 0x55e906dc5db0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3d88005e30 tx=0x7f3d880095c0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.711+0000 7f3d98215740 1 -- 172.21.15.37:0/1593310971 shutdown_connections 2024-08-20T05:18:44.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.711+0000 7f3d98215740 1 --2- 172.21.15.37:0/1593310971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906da1ac0 0x55e906dc5db0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.711+0000 7f3d98215740 1 --2- 172.21.15.37:0/1593310971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906d9f8f0 0x55e906dc5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.711+0000 7f3d98215740 1 --2- 172.21.15.37:0/1593310971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906da1250 0x55e906db9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.711+0000 7f3d98215740 1 -- 172.21.15.37:0/1593310971 >> 172.21.15.37:0/1593310971 conn(0x55e906da6920 msgr2=0x55e906dacdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:44.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.711+0000 7f3d98215740 1 -- 172.21.15.37:0/1593310971 shutdown_connections 2024-08-20T05:18:44.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.711+0000 7f3d98215740 1 -- 172.21.15.37:0/1593310971 wait complete. 2024-08-20T05:18:44.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.711+0000 7f3d98215740 1 -- start start 2024-08-20T05:18:44.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.711+0000 7f3d98215740 1 Processor -- start 2024-08-20T05:18:44.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.712+0000 7f3d98215740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906d9f8f0 0x55e906db6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.712+0000 7f3d98215740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906da1250 0x55e906db1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.712+0000 7f3d98215740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906da1ac0 0x55e906db2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.712+0000 7f3d98215740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3d901b2c10 con 0x55e906da1ac0 2024-08-20T05:18:44.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.712+0000 7f3d98215740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f3d901b2540 con 0x55e906d9f8f0 2024-08-20T05:18:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.712+0000 7f3d98215740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f3d901af720 con 0x55e906da1250 2024-08-20T05:18:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.712+0000 7f3d98215740 10 client.0 _ll_register_callbacks cb 0x7f3d7c00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.712+0000 7f3d8f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906da1ac0 0x55e906db2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.712+0000 7f3d8f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906da1ac0 0x55e906db2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59354/0 (socket says 172.21.15.37:59354) 2024-08-20T05:18:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.712+0000 7f3d8f400640 1 -- 172.21.15.37:0/2288582587 learned_addr learned my addr 172.21.15.37:0/2288582587 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.712+0000 7f3d8ea00640 1 --2- 172.21.15.37:0/2288582587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906d9f8f0 0x55e906db6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.712+0000 7f3d8e000640 1 --2- 172.21.15.37:0/2288582587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906da1250 0x55e906db1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.713+0000 7f3d8f400640 1 -- 172.21.15.37:0/2288582587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906da1250 msgr2=0x55e906db1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.713+0000 7f3d8f400640 1 --2- 172.21.15.37:0/2288582587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906da1250 0x55e906db1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.713+0000 7f3d8f400640 1 -- 172.21.15.37:0/2288582587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906d9f8f0 msgr2=0x55e906db6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.713+0000 7f3d8f400640 1 --2- 172.21.15.37:0/2288582587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906d9f8f0 0x55e906db6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.713+0000 7f3d8f400640 1 -- 172.21.15.37:0/2288582587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e906db29a0 con 0x55e906da1ac0 2024-08-20T05:18:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.713+0000 7f3d8ea00640 1 --2- 172.21.15.37:0/2288582587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906d9f8f0 0x55e906db6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:18:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.713+0000 7f3d8f400640 1 --2- 172.21.15.37:0/2288582587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906da1ac0 0x55e906db2170 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f3d8802a900 tx=0x7f3d88003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4f20c918a6f363 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.713+0000 7f3d6fe00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:18:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.713+0000 7f3d6fe00640 1 -- 172.21.15.37:0/2288582587 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d88055040 con 0x55e906da1ac0 2024-08-20T05:18:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.713+0000 7f3d6fe00640 1 -- 172.21.15.37:0/2288582587 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f3d88031450 con 0x55e906da1ac0 2024-08-20T05:18:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.713+0000 7f3d98215740 1 -- 172.21.15.37:0/2288582587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d88036040 con 0x55e906da1ac0 2024-08-20T05:18:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.714+0000 7f3d6fe00640 1 -- 172.21.15.37:0/2288582587 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f3d88031650 con 0x55e906da1ac0 2024-08-20T05:18:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.714+0000 7f3d98215740 10 client.18633 fetch_fsmap learned FSMap version 56 2024-08-20T05:18:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.714+0000 7f3d98215740 1 -- 172.21.15.37:0/2288582587 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55e906e288a0 con 0x55e906da1ac0 2024-08-20T05:18:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.714+0000 7f3d6fe00640 1 -- 172.21.15.37:0/2288582587 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d88036040 con 0x55e906da1ac0 2024-08-20T05:18:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.714+0000 7f3d6fe00640 1 -- 172.21.15.37:0/2288582587 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f3d88063030 con 0x55e906da1ac0 2024-08-20T05:18:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.714+0000 7f3d98215740 10 client.18633 fetch_fsmap finished waiting for FSMap version 56 2024-08-20T05:18:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.714+0000 7f3d98215740 10 client.18633 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2024-08-20T05:18:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.714+0000 7f3d98215740 20 client.18633 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.714+0000 7f3d98215740 1 --2- 172.21.15.37:0/2288582587 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55e906da23e0 0x55e906e2ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.714+0000 7f3d98215740 4 client.18633 mds_command: new command op to 24649 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:18:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.714+0000 7f3d98215740 1 -- 172.21.15.37:0/2288582587 --> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e906d15490 con 0x55e906da23e0 2024-08-20T05:18:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.715+0000 7f3d8ea00640 1 --2- 172.21.15.37:0/2288582587 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55e906da23e0 0x55e906e2ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.715+0000 7f3d8ea00640 1 --2- 172.21.15.37:0/2288582587 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55e906da23e0 0x55e906e2ad10 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1480bc834dae1f32 server_cookie=e437472ac1690e03 in_seq=0 out_seq=0 2024-08-20T05:18:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.715+0000 7f3d6fe00640 10 client.18633 ms_handle_connect on v2:172.21.15.135:6836/894352067 2024-08-20T05:18:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.716+0000 7f3d6fe00640 1 -- 172.21.15.37:0/2288582587 <== mds.3 v2:172.21.15.135:6836/894352067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e906d15490 con 0x55e906da23e0 2024-08-20T05:18:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.716+0000 7f3d6fe00640 10 client.18633 handle_command_reply: tid=0 2024-08-20T05:18:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.716+0000 7f3d98215740 1 client.18633 shutdown 2024-08-20T05:18:44.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.716+0000 7f3d98215740 1 -- 172.21.15.37:0/2288582587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906da1ac0 msgr2=0x55e906db2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:44.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.716+0000 7f3d98215740 1 --2- 172.21.15.37:0/2288582587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906da1ac0 0x55e906db2170 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f3d8802a900 tx=0x7f3d88003d30 comp rx=0 tx=0).stop 2024-08-20T05:18:44.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.716+0000 7f3d98215740 1 -- 172.21.15.37:0/2288582587 shutdown_connections 2024-08-20T05:18:44.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.716+0000 7f3d98215740 1 --2- 172.21.15.37:0/2288582587 >> [v2:172.21.15.135:6836/894352067,v1:172.21.15.135:6837/894352067] conn(0x55e906da23e0 0x55e906e2ad10 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.716+0000 7f3d98215740 1 --2- 172.21.15.37:0/2288582587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e906da1ac0 0x55e906db2170 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.716+0000 7f3d98215740 1 --2- 172.21.15.37:0/2288582587 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e906da1250 0x55e906db1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.716+0000 7f3d98215740 1 --2- 172.21.15.37:0/2288582587 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e906d9f8f0 0x55e906db6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.716+0000 7f3d98215740 1 -- 172.21.15.37:0/2288582587 >> 172.21.15.37:0/2288582587 conn(0x55e906da6920 msgr2=0x55e906d9e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.716+0000 7f3d6fe00640 0 client.18633 ms_handle_reset on v2:172.21.15.135:6836/894352067 2024-08-20T05:18:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.716+0000 7f3d98215740 1 -- 172.21.15.37:0/2288582587 shutdown_connections 2024-08-20T05:18:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.716+0000 7f3d98215740 1 -- 172.21.15.37:0/2288582587 wait complete. 2024-08-20T05:18:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.716+0000 7f3d98215740 20 client.18633 trim_cache size 0 max 16384 2024-08-20T05:18:44.722 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:18:44.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.717+0000 7f3d8fe00640 1 -- 172.21.15.37:0/2954499039 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d740b3c70 msgr2=0x7f3d740b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:44.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.717+0000 7f3d8fe00640 1 --2- 172.21.15.37:0/2954499039 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d740b3c70 0x7f3d740b6130 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x55e906da07d0 tx=0x7f3d8000b410 comp rx=0 tx=0).stop 2024-08-20T05:18:44.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.717+0000 7f3d8fe00640 1 -- 172.21.15.37:0/2954499039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d90108330 msgr2=0x7f3d90075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:44.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.717+0000 7f3d8fe00640 1 --2- 172.21.15.37:0/2954499039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d90108330 0x7f3d90075710 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00d950 tx=0x7f3d7c00de10 comp rx=0 tx=0).stop 2024-08-20T05:18:44.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.717+0000 7f3d8fe00640 1 -- 172.21.15.37:0/2954499039 shutdown_connections 2024-08-20T05:18:44.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.717+0000 7f3d8fe00640 1 --2- 172.21.15.37:0/2954499039 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f3d740b3c70 0x7f3d740b6130 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.717+0000 7f3d8fe00640 1 --2- 172.21.15.37:0/2954499039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d90108cb0 0x7f3d90075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.717+0000 7f3d8fe00640 1 --2- 172.21.15.37:0/2954499039 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f3d90108330 0x7f3d90075710 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.717+0000 7f3d8fe00640 1 --2- 172.21.15.37:0/2954499039 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f3d90102920 0x7f3d900751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:44.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.717+0000 7f3d8fe00640 1 -- 172.21.15.37:0/2954499039 >> 172.21.15.37:0/2954499039 conn(0x7f3d900fe350 msgr2=0x7f3d90101850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:44.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.717+0000 7f3d8fe00640 1 -- 172.21.15.37:0/2954499039 shutdown_connections 2024-08-20T05:18:44.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:44.717+0000 7f3d8fe00640 1 -- 172.21.15.37:0/2954499039 wait complete. 2024-08-20T05:18:45.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-20T05:18:45.943 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:45 smithi037 ceph-mon[17265]: pgmap v896: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 KiB/s wr, 22 op/s 2024-08-20T05:18:45.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:45 smithi130 ceph-mon[22007]: pgmap v896: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 KiB/s wr, 22 op/s 2024-08-20T05:18:46.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:45 smithi135 ceph-mon[22342]: pgmap v896: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 15 KiB/s wr, 22 op/s 2024-08-20T05:18:46.177 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:18:46.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.835+0000 7fd7fde00640 1 -- 172.21.15.37:0/2628494735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8102ab0 msgr2=0x7fd7f8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:46.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.835+0000 7fd7fde00640 1 --2- 172.21.15.37:0/2628494735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8102ab0 0x7fd7f8102e90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009900 tx=0x7fd7e802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.836+0000 7fd7fde00640 1 -- 172.21.15.37:0/2628494735 shutdown_connections 2024-08-20T05:18:46.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.836+0000 7fd7fde00640 1 --2- 172.21.15.37:0/2628494735 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7f8108e40 0x7fd7f810f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.836+0000 7fd7fde00640 1 --2- 172.21.15.37:0/2628494735 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7f81084c0 0x7fd7f8108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.836+0000 7fd7fde00640 1 --2- 172.21.15.37:0/2628494735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8102ab0 0x7fd7f8102e90 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.836+0000 7fd7fde00640 1 -- 172.21.15.37:0/2628494735 >> 172.21.15.37:0/2628494735 conn(0x7fd7f80fe500 msgr2=0x7fd7f8100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:46.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.836+0000 7fd7fde00640 1 -- 172.21.15.37:0/2628494735 shutdown_connections 2024-08-20T05:18:46.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.836+0000 7fd7fde00640 1 -- 172.21.15.37:0/2628494735 wait complete. 2024-08-20T05:18:46.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.837+0000 7fd7fde00640 1 Processor -- start 2024-08-20T05:18:46.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.837+0000 7fd7fde00640 1 -- start start 2024-08-20T05:18:46.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.837+0000 7fd7fde00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7f8102ab0 0x7fd7f8198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.837+0000 7fd7fde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7f81084c0 0x7fd7f81994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.837+0000 7fd7fde00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108e40 0x7fd7f819e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.837+0000 7fd7fde00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f8112b50 con 0x7fd7f8108e40 2024-08-20T05:18:46.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.837+0000 7fd7fde00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81129d0 con 0x7fd7f81084c0 2024-08-20T05:18:46.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.837+0000 7fd7fde00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f8112cd0 con 0x7fd7f8102ab0 2024-08-20T05:18:46.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.838+0000 7fd7f6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7f8102ab0 0x7fd7f8198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.838+0000 7fd7f6a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7f8102ab0 0x7fd7f8198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:45336/0 (socket says 172.21.15.37:45336) 2024-08-20T05:18:46.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.838+0000 7fd7f6a00640 1 -- 172.21.15.37:0/4123340650 learned_addr learned my addr 172.21.15.37:0/4123340650 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:46.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.838+0000 7fd7f6000640 1 --2- 172.21.15.37:0/4123340650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7f81084c0 0x7fd7f81994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.838+0000 7fd7f7400640 1 --2- 172.21.15.37:0/4123340650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108e40 0x7fd7f819e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.838+0000 7fd7f6a00640 1 -- 172.21.15.37:0/4123340650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7f81084c0 msgr2=0x7fd7f81994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:46.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.838+0000 7fd7f6a00640 1 --2- 172.21.15.37:0/4123340650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7f81084c0 0x7fd7f81994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.838+0000 7fd7f6a00640 1 -- 172.21.15.37:0/4123340650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108e40 msgr2=0x7fd7f819e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:46.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.838+0000 7fd7f6a00640 1 --2- 172.21.15.37:0/4123340650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108e40 0x7fd7f819e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.838+0000 7fd7f6a00640 1 -- 172.21.15.37:0/4123340650 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7f819f050 con 0x7fd7f8102ab0 2024-08-20T05:18:46.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.838+0000 7fd7f6a00640 1 --2- 172.21.15.37:0/4123340650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7f8102ab0 0x7fd7f8198fa0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8005ab0 tx=0x7fd7e8003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:46.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.839+0000 7fd7fca00640 1 -- 172.21.15.37:0/4123340650 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e803f070 con 0x7fd7f8102ab0 2024-08-20T05:18:46.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.839+0000 7fd7fde00640 1 -- 172.21.15.37:0/4123340650 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7f819f2e0 con 0x7fd7f8102ab0 2024-08-20T05:18:46.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.839+0000 7fd7fde00640 1 -- 172.21.15.37:0/4123340650 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7f81a5a00 con 0x7fd7f8102ab0 2024-08-20T05:18:46.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.839+0000 7fd7fca00640 1 -- 172.21.15.37:0/4123340650 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7e8031b60 con 0x7fd7f8102ab0 2024-08-20T05:18:46.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.839+0000 7fd7fca00640 1 -- 172.21.15.37:0/4123340650 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8049060 con 0x7fd7f8102ab0 2024-08-20T05:18:46.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.842+0000 7fd80080f740 1 Processor -- start 2024-08-20T05:18:46.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.842+0000 7fd80080f740 1 -- start start 2024-08-20T05:18:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.842+0000 7fd80080f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601925940 0x560601925d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.842+0000 7fd80080f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560601926260 0x560601931cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.842+0000 7fd80080f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606019321f0 0x5606019345e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.842+0000 7fd80080f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56060189baa0 con 0x5606019321f0 2024-08-20T05:18:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.842+0000 7fd80080f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x56060188afa0 con 0x560601926260 2024-08-20T05:18:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.842+0000 7fd80080f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x56060188efe0 con 0x560601925940 2024-08-20T05:18:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.842+0000 7fd7fca00640 1 -- 172.21.15.37:0/4123340650 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fd7e8042070 con 0x7fd7f8102ab0 2024-08-20T05:18:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.843+0000 7fd7f7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601925940 0x560601925d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.843+0000 7fd7f7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601925940 0x560601925d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:45342/0 (socket says 172.21.15.37:45342) 2024-08-20T05:18:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.843+0000 7fd7f7400640 1 -- 172.21.15.37:0/3582499073 learned_addr learned my addr 172.21.15.37:0/3582499073 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:46.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.843+0000 7fd7f6000640 1 --2- 172.21.15.37:0/3582499073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606019321f0 0x5606019345e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.843+0000 7fd7f6a00640 1 --2- 172.21.15.37:0/3582499073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560601926260 0x560601931cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.843+0000 7fd7f7400640 1 -- 172.21.15.37:0/3582499073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560601926260 msgr2=0x560601931cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.843+0000 7fd7f7400640 1 --2- 172.21.15.37:0/3582499073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560601926260 0x560601931cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.843+0000 7fd7f7400640 1 -- 172.21.15.37:0/3582499073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606019321f0 msgr2=0x5606019345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.843+0000 7fd7f7400640 1 --2- 172.21.15.37:0/3582499073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606019321f0 0x5606019345e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.843+0000 7fd7f7400640 1 -- 172.21.15.37:0/3582499073 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560601831420 con 0x560601925940 2024-08-20T05:18:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.844+0000 7fd7f7400640 1 --2- 172.21.15.37:0/3582499073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601925940 0x560601925d20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009fd0 tx=0x7fd7f00118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58c4bdb7d5f560d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.844+0000 7fd7e3e00640 1 -- 172.21.15.37:0/3582499073 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0004d20 con 0x560601925940 2024-08-20T05:18:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.844+0000 7fd7e3e00640 1 -- 172.21.15.37:0/3582499073 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7f0004050 con 0x560601925940 2024-08-20T05:18:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.844+0000 7fd7e3e00640 1 -- 172.21.15.37:0/3582499073 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0005220 con 0x560601925940 2024-08-20T05:18:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.844+0000 7fd7fca00640 1 --2- 172.21.15.37:0/4123340650 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd7dc0b3cd0 0x7fd7dc0b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.845+0000 7fd7fca00640 1 -- 172.21.15.37:0/4123340650 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd7e8104250 con 0x7fd7f8102ab0 2024-08-20T05:18:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.845+0000 7fd7f6a00640 1 --2- 172.21.15.37:0/4123340650 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd7dc0b3cd0 0x7fd7dc0b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.845+0000 7fd80080f740 1 -- 172.21.15.37:0/3582499073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601925940 msgr2=0x560601925d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.845+0000 7fd80080f740 1 --2- 172.21.15.37:0/3582499073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601925940 0x560601925d20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009fd0 tx=0x7fd7f00118d0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.845+0000 7fd80080f740 1 -- 172.21.15.37:0/3582499073 shutdown_connections 2024-08-20T05:18:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.845+0000 7fd80080f740 1 --2- 172.21.15.37:0/3582499073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5606019321f0 0x5606019345e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.845+0000 7fd80080f740 1 --2- 172.21.15.37:0/3582499073 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560601926260 0x560601931cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.845+0000 7fd80080f740 1 --2- 172.21.15.37:0/3582499073 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601925940 0x560601925d20 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.845+0000 7fd80080f740 1 -- 172.21.15.37:0/3582499073 >> 172.21.15.37:0/3582499073 conn(0x560601923770 msgr2=0x560601924910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.845+0000 7fd80080f740 1 -- 172.21.15.37:0/3582499073 shutdown_connections 2024-08-20T05:18:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.845+0000 7fd80080f740 1 -- 172.21.15.37:0/3582499073 wait complete. 2024-08-20T05:18:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.845+0000 7fd7f6a00640 1 --2- 172.21.15.37:0/4123340650 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd7dc0b3cd0 0x7fd7dc0b6190 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd7e802a9b0 tx=0x7fd7e8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.846+0000 7fd80080f740 1 -- start start 2024-08-20T05:18:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.846+0000 7fd80080f740 1 Processor -- start 2024-08-20T05:18:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.846+0000 7fd80080f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601925940 0x5606019319e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.846+0000 7fd80080f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601926260 0x56060192ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.847+0000 7fd80080f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606019321f0 0x56060192f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.847+0000 7fd80080f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5606016ed700 con 0x560601926260 2024-08-20T05:18:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.847+0000 7fd80080f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x560601826290 con 0x5606019321f0 2024-08-20T05:18:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.847+0000 7fd80080f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x560601934e70 con 0x560601925940 2024-08-20T05:18:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.847+0000 7fd80080f740 10 client.0 _ll_register_callbacks cb 0x5606018851c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.847+0000 7fd7f6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601926260 0x56060192ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.847+0000 7fd7f6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601926260 0x56060192ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59386/0 (socket says 172.21.15.37:59386) 2024-08-20T05:18:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.847+0000 7fd7f7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601925940 0x5606019319e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.847+0000 7fd7f6000640 1 -- 172.21.15.37:0/4259518854 learned_addr learned my addr 172.21.15.37:0/4259518854 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.847+0000 7fd7f7400640 1 --2- 172.21.15.37:0/4259518854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606019321f0 0x56060192f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.847+0000 7fd7f6000640 1 -- 172.21.15.37:0/4259518854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601925940 msgr2=0x5606019319e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.847+0000 7fd7f6000640 1 --2- 172.21.15.37:0/4259518854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601925940 0x5606019319e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.847+0000 7fd7f6000640 1 -- 172.21.15.37:0/4259518854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606019321f0 msgr2=0x56060192f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.847+0000 7fd7f6000640 1 --2- 172.21.15.37:0/4259518854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606019321f0 0x56060192f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.847+0000 7fd7f6000640 1 -- 172.21.15.37:0/4259518854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606015ea650 con 0x560601926260 2024-08-20T05:18:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.847+0000 7fd7f7400640 1 --2- 172.21.15.37:0/4259518854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606019321f0 0x56060192f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:18:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.848+0000 7fd7f6000640 1 --2- 172.21.15.37:0/4259518854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601926260 0x56060192ee30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40126e0 tx=0x7fd7e4012ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b535d398ed7fec server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.848+0000 7fd7e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:18:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.848+0000 7fd7e0c00640 1 -- 172.21.15.37:0/4259518854 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e4012190 con 0x560601926260 2024-08-20T05:18:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.848+0000 7fd80080f740 1 -- 172.21.15.37:0/4259518854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7f0004050 con 0x560601926260 2024-08-20T05:18:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.848+0000 7fd7e0c00640 1 -- 172.21.15.37:0/4259518854 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd7e4004020 con 0x560601926260 2024-08-20T05:18:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.848+0000 7fd7e0c00640 1 -- 172.21.15.37:0/4259518854 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fd7e4025050 con 0x560601926260 2024-08-20T05:18:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.848+0000 7fd80080f740 10 client.18645 fetch_fsmap learned FSMap version 56 2024-08-20T05:18:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.848+0000 7fd80080f740 1 -- 172.21.15.37:0/4259518854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x560601944b60 con 0x560601926260 2024-08-20T05:18:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.848+0000 7fd7e0c00640 1 -- 172.21.15.37:0/4259518854 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7f0004050 con 0x560601926260 2024-08-20T05:18:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.849+0000 7fd7e0c00640 1 -- 172.21.15.37:0/4259518854 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7fd7e4003630 con 0x560601926260 2024-08-20T05:18:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.849+0000 7fd80080f740 10 client.18645 fetch_fsmap finished waiting for FSMap version 56 2024-08-20T05:18:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.849+0000 7fd80080f740 10 client.18645 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:18:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.849+0000 7fd80080f740 20 client.18645 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.849+0000 7fd80080f740 1 --2- 172.21.15.37:0/4259518854 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x560601946010 0x560601948450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.849+0000 7fd80080f740 4 client.18645 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:18:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.849+0000 7fd80080f740 1 -- 172.21.15.37:0/4259518854 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56060189d9f0 con 0x560601946010 2024-08-20T05:18:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.849+0000 7fd7f7400640 1 --2- 172.21.15.37:0/4259518854 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x560601946010 0x560601948450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.850+0000 7fd7f7400640 1 --2- 172.21.15.37:0/4259518854 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x560601946010 0x560601948450 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=811067bf33d70a24 server_cookie=e1151f155f067415 in_seq=0 out_seq=0 2024-08-20T05:18:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.850+0000 7fd7e0c00640 10 client.18645 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:18:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.851+0000 7fd7e0c00640 1 -- 172.21.15.37:0/4259518854 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56060189d9f0 con 0x560601946010 2024-08-20T05:18:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.851+0000 7fd7e0c00640 10 client.18645 handle_command_reply: tid=0 2024-08-20T05:18:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.851+0000 7fd80080f740 1 client.18645 shutdown 2024-08-20T05:18:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.851+0000 7fd80080f740 1 -- 172.21.15.37:0/4259518854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601926260 msgr2=0x56060192ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.851+0000 7fd80080f740 1 --2- 172.21.15.37:0/4259518854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601926260 0x56060192ee30 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40126e0 tx=0x7fd7e4012ba0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.851+0000 7fd80080f740 1 -- 172.21.15.37:0/4259518854 shutdown_connections 2024-08-20T05:18:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.851+0000 7fd80080f740 1 --2- 172.21.15.37:0/4259518854 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x560601946010 0x560601948450 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.851+0000 7fd80080f740 1 --2- 172.21.15.37:0/4259518854 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606019321f0 0x56060192f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.851+0000 7fd80080f740 1 --2- 172.21.15.37:0/4259518854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601926260 0x56060192ee30 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.851+0000 7fd80080f740 1 --2- 172.21.15.37:0/4259518854 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601925940 0x5606019319e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.851+0000 7fd80080f740 1 -- 172.21.15.37:0/4259518854 >> 172.21.15.37:0/4259518854 conn(0x560601923770 msgr2=0x560601929310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.851+0000 7fd7e0c00640 0 client.18645 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:18:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.851+0000 7fd80080f740 1 -- 172.21.15.37:0/4259518854 shutdown_connections 2024-08-20T05:18:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.851+0000 7fd80080f740 1 -- 172.21.15.37:0/4259518854 wait complete. 2024-08-20T05:18:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.852+0000 7fd80080f740 20 client.18645 trim_cache size 0 max 16384 2024-08-20T05:18:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.865+0000 7fd80080f740 1 Processor -- start 2024-08-20T05:18:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.865+0000 7fd80080f740 1 -- start start 2024-08-20T05:18:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.866+0000 7fd80080f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560601925940 0x560601942420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.866+0000 7fd80080f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601926260 0x56060194dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.866+0000 7fd80080f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5606019321f0 0x56060194e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.866+0000 7fd80080f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81ad620 con 0x560601926260 2024-08-20T05:18:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.866+0000 7fd80080f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81af1c0 con 0x560601925940 2024-08-20T05:18:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.866+0000 7fd80080f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81add50 con 0x5606019321f0 2024-08-20T05:18:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.866+0000 7fd7f6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601926260 0x56060194dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.866+0000 7fd7f7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560601925940 0x560601942420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.866+0000 7fd7f6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601926260 0x56060194dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59388/0 (socket says 172.21.15.37:59388) 2024-08-20T05:18:46.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.866+0000 7fd7f7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560601925940 0x560601942420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42242/0 (socket says 172.21.15.37:42242) 2024-08-20T05:18:46.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.866+0000 7fd7f6000640 1 -- 172.21.15.37:0/3781353965 learned_addr learned my addr 172.21.15.37:0/3781353965 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:46.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.866+0000 7fd7f7400640 1 --2- 172.21.15.37:0/3781353965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5606019321f0 0x56060194e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.866+0000 7fd7f7400640 1 -- 172.21.15.37:0/3781353965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5606019321f0 msgr2=0x56060194e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:46.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.866+0000 7fd7f7400640 1 --2- 172.21.15.37:0/3781353965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5606019321f0 0x56060194e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.866+0000 7fd7f7400640 1 -- 172.21.15.37:0/3781353965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601926260 msgr2=0x56060194dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:46.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.866+0000 7fd7f7400640 1 --2- 172.21.15.37:0/3781353965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601926260 0x56060194dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.866+0000 7fd7f7400640 1 -- 172.21.15.37:0/3781353965 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606019235a0 con 0x560601925940 2024-08-20T05:18:46.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.867+0000 7fd7f7400640 1 --2- 172.21.15.37:0/3781353965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560601925940 0x560601942420 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009fa0 tx=0x7fd7f00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dfe31023e8fd93c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.867+0000 7fd7e3400640 1 -- 172.21.15.37:0/3781353965 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0003b90 con 0x560601925940 2024-08-20T05:18:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.867+0000 7fd7e3400640 1 -- 172.21.15.37:0/3781353965 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7f0004940 con 0x560601925940 2024-08-20T05:18:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.867+0000 7fd7e3400640 1 -- 172.21.15.37:0/3781353965 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f0005480 con 0x560601925940 2024-08-20T05:18:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.868+0000 7fd80080f740 1 -- 172.21.15.37:0/3781353965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560601925940 msgr2=0x560601942420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.868+0000 7fd80080f740 1 --2- 172.21.15.37:0/3781353965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560601925940 0x560601942420 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0009fa0 tx=0x7fd7f00118d0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.868+0000 7fd80080f740 1 -- 172.21.15.37:0/3781353965 shutdown_connections 2024-08-20T05:18:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.868+0000 7fd80080f740 1 --2- 172.21.15.37:0/3781353965 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x5606019321f0 0x56060194e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.868+0000 7fd80080f740 1 --2- 172.21.15.37:0/3781353965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601926260 0x56060194dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.868+0000 7fd80080f740 1 --2- 172.21.15.37:0/3781353965 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x560601925940 0x560601942420 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.868+0000 7fd80080f740 1 -- 172.21.15.37:0/3781353965 >> 172.21.15.37:0/3781353965 conn(0x560601923770 msgr2=0x560601930c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.868+0000 7fd80080f740 1 -- 172.21.15.37:0/3781353965 shutdown_connections 2024-08-20T05:18:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.868+0000 7fd80080f740 1 -- 172.21.15.37:0/3781353965 wait complete. 2024-08-20T05:18:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.868+0000 7fd80080f740 1 -- start start 2024-08-20T05:18:46.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.868+0000 7fd80080f740 1 Processor -- start 2024-08-20T05:18:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.869+0000 7fd80080f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601925940 0x56060193a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.869+0000 7fd80080f740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601926260 0x56060193aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.869+0000 7fd80080f740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606019321f0 0x56060193af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.869+0000 7fd80080f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81aeaf0 con 0x560601925940 2024-08-20T05:18:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.869+0000 7fd80080f740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81ae420 con 0x5606019321f0 2024-08-20T05:18:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.869+0000 7fd80080f740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fd7f81ab600 con 0x560601926260 2024-08-20T05:18:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.869+0000 7fd80080f740 10 client.0 _ll_register_callbacks cb 0x7fd7e4009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.869+0000 7fd7f7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601925940 0x56060193a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.869+0000 7fd7f7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601925940 0x56060193a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59396/0 (socket says 172.21.15.37:59396) 2024-08-20T05:18:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.869+0000 7fd7f7400640 1 -- 172.21.15.37:0/26733641 learned_addr learned my addr 172.21.15.37:0/26733641 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.869+0000 7fd7f6000640 1 --2- 172.21.15.37:0/26733641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601926260 0x56060193aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.869+0000 7fd7f7400640 1 --2- 172.21.15.37:0/26733641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606019321f0 0x56060193af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.870+0000 7fd7f7400640 1 -- 172.21.15.37:0/26733641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601926260 msgr2=0x56060193aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.870+0000 7fd7f7400640 1 --2- 172.21.15.37:0/26733641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601926260 0x56060193aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.870+0000 7fd7f7400640 1 -- 172.21.15.37:0/26733641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606019321f0 msgr2=0x56060193af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.870+0000 7fd7f7400640 1 --2- 172.21.15.37:0/26733641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606019321f0 0x56060193af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.870+0000 7fd7f7400640 1 -- 172.21.15.37:0/26733641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606019241f0 con 0x560601925940 2024-08-20T05:18:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.870+0000 7fd7f6000640 1 --2- 172.21.15.37:0/26733641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601926260 0x56060193aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.870+0000 7fd7f7400640 1 --2- 172.21.15.37:0/26733641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601925940 0x56060193a500 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0006010 tx=0x7fd7f0009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc343fbe63df7cd server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.870+0000 7fd7e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:18:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.870+0000 7fd7e0c00640 1 -- 172.21.15.37:0/26733641 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7f000f4e0 con 0x560601925940 2024-08-20T05:18:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.870+0000 7fd80080f740 1 -- 172.21.15.37:0/26733641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7f0004940 con 0x560601925940 2024-08-20T05:18:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.870+0000 7fd7e0c00640 1 -- 172.21.15.37:0/26733641 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fd7f000f680 con 0x560601925940 2024-08-20T05:18:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.871+0000 7fd7e0c00640 1 -- 172.21.15.37:0/26733641 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fd7f0040050 con 0x560601925940 2024-08-20T05:18:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.871+0000 7fd80080f740 10 client.18651 fetch_fsmap learned FSMap version 56 2024-08-20T05:18:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.871+0000 7fd80080f740 1 -- 172.21.15.37:0/26733641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5606019b0f30 con 0x560601925940 2024-08-20T05:18:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.871+0000 7fd7e0c00640 1 -- 172.21.15.37:0/26733641 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7f0004940 con 0x560601925940 2024-08-20T05:18:46.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.871+0000 7fd7e0c00640 1 -- 172.21.15.37:0/26733641 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7fd7f002f030 con 0x560601925940 2024-08-20T05:18:46.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.871+0000 7fd80080f740 10 client.18651 fetch_fsmap finished waiting for FSMap version 56 2024-08-20T05:18:46.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.871+0000 7fd80080f740 10 client.18651 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-08-20T05:18:46.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.871+0000 7fd80080f740 20 client.18651 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:46.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.871+0000 7fd80080f740 1 --2- 172.21.15.37:0/26733641 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5606019b1380 0x5606019b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:46.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.871+0000 7fd80080f740 4 client.18651 mds_command: new command op to 24656 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:18:46.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.871+0000 7fd80080f740 1 -- 172.21.15.37:0/26733641 --> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560601899490 con 0x5606019b1380 2024-08-20T05:18:46.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.872+0000 7fd7f6000640 1 --2- 172.21.15.37:0/26733641 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5606019b1380 0x5606019b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:46.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.872+0000 7fd7f6000640 1 --2- 172.21.15.37:0/26733641 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5606019b1380 0x5606019b37a0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a4c8caa261be2f0b server_cookie=5bf2e23fddfd8b6a in_seq=0 out_seq=0 2024-08-20T05:18:46.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.872+0000 7fd7e0c00640 10 client.18651 ms_handle_connect on v2:172.21.15.130:6836/1513603753 2024-08-20T05:18:46.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.872+0000 7fd7e0c00640 1 -- 172.21.15.37:0/26733641 <== mds.2 v2:172.21.15.130:6836/1513603753 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560601899490 con 0x5606019b1380 2024-08-20T05:18:46.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.872+0000 7fd7e0c00640 10 client.18651 handle_command_reply: tid=0 2024-08-20T05:18:46.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.872+0000 7fd80080f740 1 client.18651 shutdown 2024-08-20T05:18:46.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.872+0000 7fd80080f740 1 -- 172.21.15.37:0/26733641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601925940 msgr2=0x56060193a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:46.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.872+0000 7fd80080f740 1 --2- 172.21.15.37:0/26733641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601925940 0x56060193a500 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0006010 tx=0x7fd7f0009500 comp rx=0 tx=0).stop 2024-08-20T05:18:46.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.873+0000 7fd80080f740 1 -- 172.21.15.37:0/26733641 shutdown_connections 2024-08-20T05:18:46.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.873+0000 7fd80080f740 1 --2- 172.21.15.37:0/26733641 >> [v2:172.21.15.130:6836/1513603753,v1:172.21.15.130:6837/1513603753] conn(0x5606019b1380 0x5606019b37a0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.873+0000 7fd80080f740 1 --2- 172.21.15.37:0/26733641 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x5606019321f0 0x56060193af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.873+0000 7fd80080f740 1 --2- 172.21.15.37:0/26733641 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x560601926260 0x56060193aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.873+0000 7fd80080f740 1 --2- 172.21.15.37:0/26733641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560601925940 0x56060193a500 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.873+0000 7fd7e0c00640 0 client.18651 ms_handle_reset on v2:172.21.15.130:6836/1513603753 2024-08-20T05:18:46.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.873+0000 7fd80080f740 1 -- 172.21.15.37:0/26733641 >> 172.21.15.37:0/26733641 conn(0x560601923770 msgr2=0x5606019289a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:46.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.873+0000 7fd80080f740 1 -- 172.21.15.37:0/26733641 shutdown_connections 2024-08-20T05:18:46.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.873+0000 7fd80080f740 1 -- 172.21.15.37:0/26733641 wait complete. 2024-08-20T05:18:46.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.873+0000 7fd80080f740 20 client.18651 trim_cache size 0 max 16384 2024-08-20T05:18:46.878 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:18:46.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.874+0000 7fd7fde00640 1 -- 172.21.15.37:0/4123340650 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd7dc0b3cd0 msgr2=0x7fd7dc0b6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:46.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.874+0000 7fd7fde00640 1 --2- 172.21.15.37:0/4123340650 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd7dc0b3cd0 0x7fd7dc0b6190 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd7e802a9b0 tx=0x7fd7e8031400 comp rx=0 tx=0).stop 2024-08-20T05:18:46.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.874+0000 7fd7fde00640 1 -- 172.21.15.37:0/4123340650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7f8102ab0 msgr2=0x7fd7f8198fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:46.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.874+0000 7fd7fde00640 1 --2- 172.21.15.37:0/4123340650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7f8102ab0 0x7fd7f8198fa0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8005ab0 tx=0x7fd7e8003c10 comp rx=0 tx=0).stop 2024-08-20T05:18:46.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.874+0000 7fd7fde00640 1 -- 172.21.15.37:0/4123340650 shutdown_connections 2024-08-20T05:18:46.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.874+0000 7fd7fde00640 1 --2- 172.21.15.37:0/4123340650 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fd7dc0b3cd0 0x7fd7dc0b6190 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.874+0000 7fd7fde00640 1 --2- 172.21.15.37:0/4123340650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7f8108e40 0x7fd7f819e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.874+0000 7fd7fde00640 1 --2- 172.21.15.37:0/4123340650 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fd7f81084c0 0x7fd7f81994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.874+0000 7fd7fde00640 1 --2- 172.21.15.37:0/4123340650 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fd7f8102ab0 0x7fd7f8198fa0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:46.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.874+0000 7fd7fde00640 1 -- 172.21.15.37:0/4123340650 >> 172.21.15.37:0/4123340650 conn(0x7fd7f80fe500 msgr2=0x7fd7f81008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:46.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.874+0000 7fd7fde00640 1 -- 172.21.15.37:0/4123340650 shutdown_connections 2024-08-20T05:18:46.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:46.874+0000 7fd7fde00640 1 -- 172.21.15.37:0/4123340650 wait complete. 2024-08-20T05:18:47.832 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:47 smithi037 ceph-mon[17265]: pgmap v897: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.9 KiB/s wr, 16 op/s 2024-08-20T05:18:47.834 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-20T05:18:47.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:47 smithi130 ceph-mon[22007]: pgmap v897: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.9 KiB/s wr, 16 op/s 2024-08-20T05:18:48.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:47 smithi135 ceph-mon[22342]: pgmap v897: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.9 KiB/s wr, 16 op/s 2024-08-20T05:18:48.217 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:18:48.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.885+0000 7f9cde000640 1 -- 172.21.15.37:0/3891468059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd8077d20 msgr2=0x7f9cd8113150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:48.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.885+0000 7f9cde000640 1 --2- 172.21.15.37:0/3891468059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd8077d20 0x7f9cd8113150 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009900 tx=0x7f9cc002a3f0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.885+0000 7f9cde000640 1 -- 172.21.15.37:0/3891468059 shutdown_connections 2024-08-20T05:18:48.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.885+0000 7f9cde000640 1 --2- 172.21.15.37:0/3891468059 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd8113690 0x7f9cd8115a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.885+0000 7f9cde000640 1 --2- 172.21.15.37:0/3891468059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd8077d20 0x7f9cd8113150 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.885+0000 7f9cde000640 1 --2- 172.21.15.37:0/3891468059 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cd8077400 0x7f9cd80777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.885+0000 7f9cde000640 1 -- 172.21.15.37:0/3891468059 >> 172.21.15.37:0/3891468059 conn(0x7f9cd8100730 msgr2=0x7f9cd8102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:48.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.885+0000 7f9cde000640 1 -- 172.21.15.37:0/3891468059 shutdown_connections 2024-08-20T05:18:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.885+0000 7f9cde000640 1 -- 172.21.15.37:0/3891468059 wait complete. 2024-08-20T05:18:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.886+0000 7f9cde000640 1 Processor -- start 2024-08-20T05:18:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.886+0000 7f9cde000640 1 -- start start 2024-08-20T05:18:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.886+0000 7f9cde000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd8077400 0x7f9cd819f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.886+0000 7f9cde000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cd8077d20 0x7f9cd819fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.887+0000 7f9cde000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd8113690 0x7f9cd81a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.887+0000 7f9cde000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd8119080 con 0x7f9cd8077400 2024-08-20T05:18:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.887+0000 7f9cde000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd8118f00 con 0x7f9cd8077d20 2024-08-20T05:18:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.887+0000 7f9cde000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd8119200 con 0x7f9cd8113690 2024-08-20T05:18:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.887+0000 7f9cd7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd8077400 0x7f9cd819f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.887+0000 7f9cd7400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd8077400 0x7f9cd819f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59408/0 (socket says 172.21.15.37:59408) 2024-08-20T05:18:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.887+0000 7f9cd7400640 1 -- 172.21.15.37:0/2096636295 learned_addr learned my addr 172.21.15.37:0/2096636295 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:48.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.887+0000 7f9ccea00640 1 --2- 172.21.15.37:0/2096636295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cd8077d20 0x7f9cd819fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.887+0000 7f9cd7e00640 1 --2- 172.21.15.37:0/2096636295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd8113690 0x7f9cd81a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.887+0000 7f9cd7400640 1 -- 172.21.15.37:0/2096636295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd8113690 msgr2=0x7f9cd81a4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.887+0000 7f9cd7400640 1 --2- 172.21.15.37:0/2096636295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd8113690 0x7f9cd81a4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.887+0000 7f9cd7400640 1 -- 172.21.15.37:0/2096636295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cd8077d20 msgr2=0x7f9cd819fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.887+0000 7f9cd7400640 1 --2- 172.21.15.37:0/2096636295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cd8077d20 0x7f9cd819fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.887+0000 7f9cd7400640 1 -- 172.21.15.37:0/2096636295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd81a5640 con 0x7f9cd8077400 2024-08-20T05:18:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.887+0000 7f9ccea00640 1 --2- 172.21.15.37:0/2096636295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cd8077d20 0x7f9cd819fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:18:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.888+0000 7f9cd7400640 1 --2- 172.21.15.37:0/2096636295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd8077400 0x7f9cd819f590 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800e9f0 tx=0x7f9cc800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.888+0000 7f9cd4c00640 1 -- 172.21.15.37:0/2096636295 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc800cd80 con 0x7f9cd8077400 2024-08-20T05:18:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.888+0000 7f9cd4c00640 1 -- 172.21.15.37:0/2096636295 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cc80108e0 con 0x7f9cd8077400 2024-08-20T05:18:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.888+0000 7f9cde000640 1 -- 172.21.15.37:0/2096636295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd81a5930 con 0x7f9cd8077400 2024-08-20T05:18:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.888+0000 7f9cd4c00640 1 -- 172.21.15.37:0/2096636295 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc8018980 con 0x7f9cd8077400 2024-08-20T05:18:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.888+0000 7f9cde000640 1 -- 172.21.15.37:0/2096636295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd81ac1c0 con 0x7f9cd8077400 2024-08-20T05:18:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.891+0000 7f9ce0c1d740 1 Processor -- start 2024-08-20T05:18:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.891+0000 7f9ce0c1d740 1 -- start start 2024-08-20T05:18:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.891+0000 7f9ce0c1d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251fe940 0x55e2251fed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.891+0000 7f9ce0c1d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2251ff260 0x55e22520acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.892+0000 7f9ce0c1d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 0x55e22520d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.892+0000 7f9ce0c1d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e225174aa0 con 0x55e22520b1f0 2024-08-20T05:18:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.892+0000 7f9ce0c1d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e225163fa0 con 0x55e2251ff260 2024-08-20T05:18:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.892+0000 7f9ce0c1d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e225167fe0 con 0x55e2251fe940 2024-08-20T05:18:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.892+0000 7f9cd4c00640 1 -- 172.21.15.37:0/2096636295 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f9cc8010430 con 0x7f9cd8077400 2024-08-20T05:18:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.892+0000 7f9ccea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 0x55e22520d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.892+0000 7f9ccea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 0x55e22520d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59422/0 (socket says 172.21.15.37:59422) 2024-08-20T05:18:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.892+0000 7f9ccea00640 1 -- 172.21.15.37:0/2629480342 learned_addr learned my addr 172.21.15.37:0/2629480342 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.892+0000 7f9cd7e00640 1 --2- 172.21.15.37:0/2629480342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251fe940 0x55e2251fed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.892+0000 7f9cd7400640 1 --2- 172.21.15.37:0/2629480342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2251ff260 0x55e22520acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.892+0000 7f9ccea00640 1 -- 172.21.15.37:0/2629480342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251fe940 msgr2=0x55e2251fed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.892+0000 7f9ccea00640 1 --2- 172.21.15.37:0/2629480342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251fe940 0x55e2251fed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.892+0000 7f9ccea00640 1 -- 172.21.15.37:0/2629480342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2251ff260 msgr2=0x55e22520acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.892+0000 7f9ccea00640 1 --2- 172.21.15.37:0/2629480342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2251ff260 0x55e22520acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.892+0000 7f9ccea00640 1 -- 172.21.15.37:0/2629480342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e22510a420 con 0x55e22520b1f0 2024-08-20T05:18:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.893+0000 7f9ccea00640 1 --2- 172.21.15.37:0/2629480342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 0x55e22520d5e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009900 tx=0x7f9cc0032c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ea630dde738fbc server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.893+0000 7f9cc7e00640 1 -- 172.21.15.37:0/2629480342 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc003f070 con 0x55e22520b1f0 2024-08-20T05:18:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.893+0000 7f9cc7e00640 1 -- 172.21.15.37:0/2629480342 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cc0032e10 con 0x55e22520b1f0 2024-08-20T05:18:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.893+0000 7f9cc7e00640 1 -- 172.21.15.37:0/2629480342 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0035070 con 0x55e22520b1f0 2024-08-20T05:18:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.894+0000 7f9cd4c00640 1 --2- 172.21.15.37:0/2096636295 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9cbc0b3c50 0x7f9cbc0b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.894+0000 7f9cd4c00640 1 -- 172.21.15.37:0/2096636295 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9cc80e4340 con 0x7f9cd8077400 2024-08-20T05:18:48.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.894+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/2629480342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 msgr2=0x55e22520d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:48.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.894+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/2629480342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 0x55e22520d5e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0009900 tx=0x7f9cc0032c20 comp rx=0 tx=0).stop 2024-08-20T05:18:48.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.894+0000 7f9cd7e00640 1 --2- 172.21.15.37:0/2096636295 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9cbc0b3c50 0x7f9cbc0b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.894+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/2629480342 shutdown_connections 2024-08-20T05:18:48.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.894+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/2629480342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 0x55e22520d5e0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.894+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/2629480342 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2251ff260 0x55e22520acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.894+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/2629480342 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251fe940 0x55e2251fed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.894+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/2629480342 >> 172.21.15.37:0/2629480342 conn(0x55e2251fc770 msgr2=0x55e2251fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:48.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.894+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/2629480342 shutdown_connections 2024-08-20T05:18:48.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.894+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/2629480342 wait complete. 2024-08-20T05:18:48.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.895+0000 7f9cd7e00640 1 --2- 172.21.15.37:0/2096636295 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9cbc0b3c50 0x7f9cbc0b6110 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9cd806be60 tx=0x7f9cd0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:48.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.895+0000 7f9ce0c1d740 1 -- start start 2024-08-20T05:18:48.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.895+0000 7f9ce0c1d740 1 Processor -- start 2024-08-20T05:18:48.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.895+0000 7f9ce0c1d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251fe940 0x55e22520a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.896+0000 7f9ce0c1d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2251ff260 0x55e225207e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.896+0000 7f9ce0c1d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 0x55e225208370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.896+0000 7f9ce0c1d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e224fc6700 con 0x55e22520b1f0 2024-08-20T05:18:48.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.896+0000 7f9ce0c1d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55e2250ff290 con 0x55e2251ff260 2024-08-20T05:18:48.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.896+0000 7f9ce0c1d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55e22520de10 con 0x55e2251fe940 2024-08-20T05:18:48.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.896+0000 7f9ce0c1d740 10 client.0 _ll_register_callbacks cb 0x55e22515e1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:48.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.896+0000 7f9cd7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 0x55e225208370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.896+0000 7f9cd7400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251fe940 0x55e22520a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.896+0000 7f9cd7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 0x55e225208370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59426/0 (socket says 172.21.15.37:59426) 2024-08-20T05:18:48.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.896+0000 7f9cd7e00640 1 -- 172.21.15.37:0/1097805490 learned_addr learned my addr 172.21.15.37:0/1097805490 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:48.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.896+0000 7f9ccea00640 1 --2- 172.21.15.37:0/1097805490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2251ff260 0x55e225207e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.896+0000 7f9cd7e00640 1 -- 172.21.15.37:0/1097805490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251fe940 msgr2=0x55e22520a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:48.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.896+0000 7f9cd7e00640 1 --2- 172.21.15.37:0/1097805490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251fe940 0x55e22520a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.896+0000 7f9cd7e00640 1 -- 172.21.15.37:0/1097805490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2251ff260 msgr2=0x55e225207e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:48.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.896+0000 7f9cd7e00640 1 --2- 172.21.15.37:0/1097805490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2251ff260 0x55e225207e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.896+0000 7f9cd7e00640 1 -- 172.21.15.37:0/1097805490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e224ec3650 con 0x55e22520b1f0 2024-08-20T05:18:48.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.896+0000 7f9ccea00640 1 --2- 172.21.15.37:0/1097805490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2251ff260 0x55e225207e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:48.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.897+0000 7f9cd7e00640 1 --2- 172.21.15.37:0/1097805490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 0x55e225208370 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009f50 tx=0x7f9cd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a830734d691e9d2 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:48.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.897+0000 7f9cc4c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:18:48.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.897+0000 7f9cc4c00640 1 -- 172.21.15.37:0/1097805490 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0004b20 con 0x55e22520b1f0 2024-08-20T05:18:48.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.897+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/1097805490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cc0032e10 con 0x55e22520b1f0 2024-08-20T05:18:48.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.897+0000 7f9cc4c00640 1 -- 172.21.15.37:0/1097805490 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9cd0004cc0 con 0x55e22520b1f0 2024-08-20T05:18:48.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.897+0000 7f9cc4c00640 1 -- 172.21.15.37:0/1097805490 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f9cd000f8b0 con 0x55e22520b1f0 2024-08-20T05:18:48.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.897+0000 7f9ce0c1d740 10 client.18663 fetch_fsmap learned FSMap version 56 2024-08-20T05:18:48.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.897+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/1097805490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55e225219720 con 0x55e22520b1f0 2024-08-20T05:18:48.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.898+0000 7f9cc4c00640 1 -- 172.21.15.37:0/1097805490 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cc0032e10 con 0x55e22520b1f0 2024-08-20T05:18:48.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.898+0000 7f9cc4c00640 1 -- 172.21.15.37:0/1097805490 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f9cd0026070 con 0x55e22520b1f0 2024-08-20T05:18:48.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.898+0000 7f9ce0c1d740 10 client.18663 fetch_fsmap finished waiting for FSMap version 56 2024-08-20T05:18:48.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.898+0000 7f9ce0c1d740 10 client.18663 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:18:48.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.898+0000 7f9ce0c1d740 20 client.18663 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:48.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.898+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/1097805490 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55e22521abd0 0x55e22521cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.898+0000 7f9ce0c1d740 4 client.18663 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:18:48.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.898+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/1097805490 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2251769f0 con 0x55e22521abd0 2024-08-20T05:18:48.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.898+0000 7f9cd7400640 1 --2- 172.21.15.37:0/1097805490 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55e22521abd0 0x55e22521cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.899+0000 7f9cd7400640 1 --2- 172.21.15.37:0/1097805490 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55e22521abd0 0x55e22521cfc0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1e7bcf6f2af065a7 server_cookie=da893125dfd217a3 in_seq=0 out_seq=0 2024-08-20T05:18:48.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.899+0000 7f9cc4c00640 10 client.18663 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:18:48.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.900+0000 7f9cc4c00640 1 -- 172.21.15.37:0/1097805490 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e2251769f0 con 0x55e22521abd0 2024-08-20T05:18:48.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.900+0000 7f9cc4c00640 10 client.18663 handle_command_reply: tid=0 2024-08-20T05:18:48.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.900+0000 7f9ce0c1d740 1 client.18663 shutdown 2024-08-20T05:18:48.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.900+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/1097805490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 msgr2=0x55e225208370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:48.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.900+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/1097805490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 0x55e225208370 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009f50 tx=0x7f9cd0004a40 comp rx=0 tx=0).stop 2024-08-20T05:18:48.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.900+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/1097805490 shutdown_connections 2024-08-20T05:18:48.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.900+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/1097805490 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55e22521abd0 0x55e22521cfc0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.900+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/1097805490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 0x55e225208370 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.900+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/1097805490 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2251ff260 0x55e225207e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.900+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/1097805490 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251fe940 0x55e22520a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.900+0000 7f9cc4c00640 0 client.18663 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:18:48.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.900+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/1097805490 >> 172.21.15.37:0/1097805490 conn(0x55e2251fc770 msgr2=0x55e2252022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:48.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.900+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/1097805490 shutdown_connections 2024-08-20T05:18:48.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.900+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/1097805490 wait complete. 2024-08-20T05:18:48.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.900+0000 7f9ce0c1d740 20 client.18663 trim_cache size 0 max 16384 2024-08-20T05:18:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.914+0000 7f9ce0c1d740 1 Processor -- start 2024-08-20T05:18:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.914+0000 7f9ce0c1d740 1 -- start start 2024-08-20T05:18:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.915+0000 7f9ce0c1d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251fe940 0x55e2251fb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.915+0000 7f9ce0c1d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e2251ff260 0x55e2252228d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.915+0000 7f9ce0c1d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e22520b1f0 0x55e225222e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.915+0000 7f9ce0c1d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd81b5e00 con 0x55e2251ff260 2024-08-20T05:18:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.915+0000 7f9ce0c1d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd81b79a0 con 0x55e22520b1f0 2024-08-20T05:18:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.915+0000 7f9ce0c1d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd81b6530 con 0x55e2251fe940 2024-08-20T05:18:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.915+0000 7f9ccea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e2251ff260 0x55e2252228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.915+0000 7f9ccea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e2251ff260 0x55e2252228d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59436/0 (socket says 172.21.15.37:59436) 2024-08-20T05:18:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.915+0000 7f9ccea00640 1 -- 172.21.15.37:0/3676729013 learned_addr learned my addr 172.21.15.37:0/3676729013 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.915+0000 7f9cd7400640 1 --2- 172.21.15.37:0/3676729013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251fe940 0x55e2251fb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.915+0000 7f9cd7e00640 1 --2- 172.21.15.37:0/3676729013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e22520b1f0 0x55e225222e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.915+0000 7f9ccea00640 1 -- 172.21.15.37:0/3676729013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251fe940 msgr2=0x55e2251fb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:48.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.915+0000 7f9ccea00640 1 --2- 172.21.15.37:0/3676729013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251fe940 0x55e2251fb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.915+0000 7f9ccea00640 1 -- 172.21.15.37:0/3676729013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e22520b1f0 msgr2=0x55e225222e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:48.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.915+0000 7f9ccea00640 1 --2- 172.21.15.37:0/3676729013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e22520b1f0 0x55e225222e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.915+0000 7f9ccea00640 1 -- 172.21.15.37:0/3676729013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2251ff090 con 0x55e2251ff260 2024-08-20T05:18:48.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.916+0000 7f9ccea00640 1 --2- 172.21.15.37:0/3676729013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e2251ff260 0x55e2252228d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0005230 tx=0x7f9cc0005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e779bae933d901ec server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:48.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.916+0000 7f9cc7400640 1 -- 172.21.15.37:0/3676729013 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc004b070 con 0x55e2251ff260 2024-08-20T05:18:48.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.916+0000 7f9cc7400640 1 -- 172.21.15.37:0/3676729013 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cc0031d10 con 0x55e2251ff260 2024-08-20T05:18:48.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.916+0000 7f9cc7400640 1 -- 172.21.15.37:0/3676729013 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc003f070 con 0x55e2251ff260 2024-08-20T05:18:48.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.916+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/3676729013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e2251ff260 msgr2=0x55e2252228d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:48.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.916+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/3676729013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e2251ff260 0x55e2252228d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0005230 tx=0x7f9cc0005300 comp rx=0 tx=0).stop 2024-08-20T05:18:48.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.916+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/3676729013 shutdown_connections 2024-08-20T05:18:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.916+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/3676729013 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e22520b1f0 0x55e225222e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.916+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/3676729013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e2251ff260 0x55e2252228d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.916+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/3676729013 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251fe940 0x55e2251fb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.917+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/3676729013 >> 172.21.15.37:0/3676729013 conn(0x55e2251fc770 msgr2=0x55e225209c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.917+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/3676729013 shutdown_connections 2024-08-20T05:18:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.917+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/3676729013 wait complete. 2024-08-20T05:18:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.917+0000 7f9ce0c1d740 1 -- start start 2024-08-20T05:18:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.917+0000 7f9ce0c1d740 1 Processor -- start 2024-08-20T05:18:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9ce0c1d740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2251fe940 0x55e225213710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9ce0c1d740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251ff260 0x55e225210c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9ce0c1d740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 0x55e225211140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9ce0c1d740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd81b72d0 con 0x55e22520b1f0 2024-08-20T05:18:48.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9ce0c1d740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd81b6c00 con 0x55e2251fe940 2024-08-20T05:18:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9ce0c1d740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd81b3de0 con 0x55e2251ff260 2024-08-20T05:18:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9ce0c1d740 10 client.0 _ll_register_callbacks cb 0x7f9cd0009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9cd7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2251fe940 0x55e225213710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9ccea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251ff260 0x55e225210c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9ccea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251ff260 0x55e225210c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:45428/0 (socket says 172.21.15.37:45428) 2024-08-20T05:18:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9cd7400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2251fe940 0x55e225213710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42336/0 (socket says 172.21.15.37:42336) 2024-08-20T05:18:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9ccea00640 1 -- 172.21.15.37:0/233521682 learned_addr learned my addr 172.21.15.37:0/233521682 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9cd7e00640 1 --2- 172.21.15.37:0/233521682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 0x55e225211140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9ccea00640 1 -- 172.21.15.37:0/233521682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2251fe940 msgr2=0x55e225213710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9ccea00640 1 --2- 172.21.15.37:0/233521682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2251fe940 0x55e225213710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9ccea00640 1 -- 172.21.15.37:0/233521682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 msgr2=0x55e225211140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9ccea00640 1 --2- 172.21.15.37:0/233521682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 0x55e225211140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9ccea00640 1 -- 172.21.15.37:0/233521682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e225211970 con 0x55e2251ff260 2024-08-20T05:18:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.918+0000 7f9cd7e00640 1 --2- 172.21.15.37:0/233521682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 0x55e225211140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:18:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.919+0000 7f9ccea00640 1 --2- 172.21.15.37:0/233521682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251ff260 0x55e225210c00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0049040 tx=0x7f9cc0032fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea8f298b0fa7e5ea server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.919+0000 7f9cc4c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:18:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.919+0000 7f9cc4c00640 1 -- 172.21.15.37:0/233521682 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc004b040 con 0x55e2251ff260 2024-08-20T05:18:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.919+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/233521682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cc0031d10 con 0x55e2251ff260 2024-08-20T05:18:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.919+0000 7f9cc4c00640 1 -- 172.21.15.37:0/233521682 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f9cc0004e30 con 0x55e2251ff260 2024-08-20T05:18:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.919+0000 7f9cc4c00640 1 -- 172.21.15.37:0/233521682 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f9cc003f040 con 0x55e2251ff260 2024-08-20T05:18:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.919+0000 7f9ce0c1d740 10 client.29461 fetch_fsmap learned FSMap version 56 2024-08-20T05:18:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.919+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/233521682 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55e2252858b0 con 0x55e2251ff260 2024-08-20T05:18:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.919+0000 7f9cc4c00640 1 -- 172.21.15.37:0/233521682 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cc0031d10 con 0x55e2251ff260 2024-08-20T05:18:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.920+0000 7f9cc4c00640 1 -- 172.21.15.37:0/233521682 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f9cc004e070 con 0x55e2251ff260 2024-08-20T05:18:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.920+0000 7f9ce0c1d740 10 client.29461 fetch_fsmap finished waiting for FSMap version 56 2024-08-20T05:18:48.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.920+0000 7f9ce0c1d740 10 client.29461 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-20T05:18:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.920+0000 7f9ce0c1d740 20 client.29461 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.920+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/233521682 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55e225285ae0 0x55e225287ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.920+0000 7f9ce0c1d740 4 client.29461 mds_command: new command op to 24664 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:18:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.920+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/233521682 --> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e2251fbee0 con 0x55e225285ae0 2024-08-20T05:18:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.920+0000 7f9cd7400640 1 --2- 172.21.15.37:0/233521682 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55e225285ae0 0x55e225287ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.921+0000 7f9cd7400640 1 --2- 172.21.15.37:0/233521682 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55e225285ae0 0x55e225287ed0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9181f3f80f6ace7c server_cookie=d57978c1ddeb998a in_seq=0 out_seq=0 2024-08-20T05:18:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.921+0000 7f9cc4c00640 10 client.29461 ms_handle_connect on v2:172.21.15.135:6838/2602130726 2024-08-20T05:18:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.921+0000 7f9cc4c00640 1 -- 172.21.15.37:0/233521682 <== mds.1 v2:172.21.15.135:6838/2602130726 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e2251fbee0 con 0x55e225285ae0 2024-08-20T05:18:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.921+0000 7f9cc4c00640 10 client.29461 handle_command_reply: tid=0 2024-08-20T05:18:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.921+0000 7f9ce0c1d740 1 client.29461 shutdown 2024-08-20T05:18:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.921+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/233521682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251ff260 msgr2=0x55e225210c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.921+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/233521682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251ff260 0x55e225210c00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0049040 tx=0x7f9cc0032fc0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.921+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/233521682 shutdown_connections 2024-08-20T05:18:48.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.921+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/233521682 >> [v2:172.21.15.135:6838/2602130726,v1:172.21.15.135:6839/2602130726] conn(0x55e225285ae0 0x55e225287ed0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.921+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/233521682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e22520b1f0 0x55e225211140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.921+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/233521682 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55e2251ff260 0x55e225210c00 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.921+0000 7f9ce0c1d740 1 --2- 172.21.15.37:0/233521682 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55e2251fe940 0x55e225213710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.921+0000 7f9cc4c00640 0 client.29461 ms_handle_reset on v2:172.21.15.135:6838/2602130726 2024-08-20T05:18:48.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.921+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/233521682 >> 172.21.15.37:0/233521682 conn(0x55e2251fc770 msgr2=0x55e2252066b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:48.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.921+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/233521682 shutdown_connections 2024-08-20T05:18:48.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.921+0000 7f9ce0c1d740 1 -- 172.21.15.37:0/233521682 wait complete. 2024-08-20T05:18:48.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.922+0000 7f9ce0c1d740 20 client.29461 trim_cache size 0 max 16384 2024-08-20T05:18:48.940 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:18:48.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.922+0000 7f9cde000640 1 -- 172.21.15.37:0/2096636295 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9cbc0b3c50 msgr2=0x7f9cbc0b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:48.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.922+0000 7f9cde000640 1 --2- 172.21.15.37:0/2096636295 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9cbc0b3c50 0x7f9cbc0b6110 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9cd806be60 tx=0x7f9cd0009500 comp rx=0 tx=0).stop 2024-08-20T05:18:48.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.922+0000 7f9cde000640 1 -- 172.21.15.37:0/2096636295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd8077400 msgr2=0x7f9cd819f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:48.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.922+0000 7f9cde000640 1 --2- 172.21.15.37:0/2096636295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd8077400 0x7f9cd819f590 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800e9f0 tx=0x7f9cc800eeb0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.922+0000 7f9cde000640 1 -- 172.21.15.37:0/2096636295 shutdown_connections 2024-08-20T05:18:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.922+0000 7f9cde000640 1 --2- 172.21.15.37:0/2096636295 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f9cbc0b3c50 0x7f9cbc0b6110 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.922+0000 7f9cde000640 1 --2- 172.21.15.37:0/2096636295 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f9cd8113690 0x7f9cd81a4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.922+0000 7f9cde000640 1 --2- 172.21.15.37:0/2096636295 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f9cd8077d20 0x7f9cd819fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.922+0000 7f9cde000640 1 --2- 172.21.15.37:0/2096636295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cd8077400 0x7f9cd819f590 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.922+0000 7f9cde000640 1 -- 172.21.15.37:0/2096636295 >> 172.21.15.37:0/2096636295 conn(0x7f9cd8100730 msgr2=0x7f9cd8102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.923+0000 7f9cde000640 1 -- 172.21.15.37:0/2096636295 shutdown_connections 2024-08-20T05:18:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:48.923+0000 7f9cde000640 1 -- 172.21.15.37:0/2096636295 wait complete. 2024-08-20T05:18:49.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-20T05:18:49.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:49 smithi130 ceph-mon[22007]: pgmap v898: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 KiB/s wr, 16 op/s 2024-08-20T05:18:50.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:49 smithi037 ceph-mon[17265]: pgmap v898: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 KiB/s wr, 16 op/s 2024-08-20T05:18:50.105 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:18:50.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:49 smithi135 ceph-mon[22342]: pgmap v898: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 KiB/s wr, 16 op/s 2024-08-20T05:18:50.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.769+0000 7f6415a00640 1 -- 172.21.15.37:0/961105456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64101039d0 msgr2=0x7f6410103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:50.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.769+0000 7f6415a00640 1 --2- 172.21.15.37:0/961105456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64101039d0 0x7f6410103db0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f6400009900 tx=0x7f640002a410 comp rx=0 tx=0).stop 2024-08-20T05:18:50.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.769+0000 7f6415a00640 1 -- 172.21.15.37:0/961105456 shutdown_connections 2024-08-20T05:18:50.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.769+0000 7f6415a00640 1 --2- 172.21.15.37:0/961105456 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f641010ce30 0x7f641010f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.769+0000 7f6415a00640 1 --2- 172.21.15.37:0/961105456 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64101042f0 0x7f641010c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.769+0000 7f6415a00640 1 --2- 172.21.15.37:0/961105456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64101039d0 0x7f6410103db0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.770+0000 7f6415a00640 1 -- 172.21.15.37:0/961105456 >> 172.21.15.37:0/961105456 conn(0x7f64100fd410 msgr2=0x7f64100ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:50.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.770+0000 7f6415a00640 1 -- 172.21.15.37:0/961105456 shutdown_connections 2024-08-20T05:18:50.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.770+0000 7f6415a00640 1 -- 172.21.15.37:0/961105456 wait complete. 2024-08-20T05:18:50.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.770+0000 7f6415a00640 1 Processor -- start 2024-08-20T05:18:50.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.771+0000 7f6415a00640 1 -- start start 2024-08-20T05:18:50.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.771+0000 7f6415a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64101039d0 0x7f6410198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.771+0000 7f6415a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64101042f0 0x7f64101994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.771+0000 7f6415a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f641010ce30 0x7f641019e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.771+0000 7f6415a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6410112af0 con 0x7f64101042f0 2024-08-20T05:18:50.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.771+0000 7f6415a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f6410112970 con 0x7f641010ce30 2024-08-20T05:18:50.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.771+0000 7f6415a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f6410112c70 con 0x7f64101039d0 2024-08-20T05:18:50.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.771+0000 7f640e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64101042f0 0x7f64101994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.771+0000 7f640e000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64101042f0 0x7f64101994e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59470/0 (socket says 172.21.15.37:59470) 2024-08-20T05:18:50.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.771+0000 7f640e000640 1 -- 172.21.15.37:0/45206068 learned_addr learned my addr 172.21.15.37:0/45206068 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:50.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.771+0000 7f640ea00640 1 --2- 172.21.15.37:0/45206068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64101039d0 0x7f6410198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.771+0000 7f640f400640 1 --2- 172.21.15.37:0/45206068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f641010ce30 0x7f641019e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.772+0000 7f640e000640 1 -- 172.21.15.37:0/45206068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64101039d0 msgr2=0x7f6410198fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.772+0000 7f640e000640 1 --2- 172.21.15.37:0/45206068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64101039d0 0x7f6410198fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.772+0000 7f640e000640 1 -- 172.21.15.37:0/45206068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f641010ce30 msgr2=0x7f641019e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.772+0000 7f640e000640 1 --2- 172.21.15.37:0/45206068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f641010ce30 0x7f641019e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.772+0000 7f640e000640 1 -- 172.21.15.37:0/45206068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f641019f050 con 0x7f64101042f0 2024-08-20T05:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.772+0000 7f640f400640 1 --2- 172.21.15.37:0/45206068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f641010ce30 0x7f641019e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.772+0000 7f640e000640 1 --2- 172.21.15.37:0/45206068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64101042f0 0x7f64101994e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00e9c0 tx=0x7f63fc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.772+0000 7f6407400640 1 -- 172.21.15.37:0/45206068 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc00ccc0 con 0x7f64101042f0 2024-08-20T05:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.772+0000 7f6415a00640 1 -- 172.21.15.37:0/45206068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f641019f340 con 0x7f64101042f0 2024-08-20T05:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.772+0000 7f6407400640 1 -- 172.21.15.37:0/45206068 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63fc0035f0 con 0x7f64101042f0 2024-08-20T05:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.772+0000 7f6407400640 1 -- 172.21.15.37:0/45206068 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc00ce60 con 0x7f64101042f0 2024-08-20T05:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.773+0000 7f6415a00640 1 -- 172.21.15.37:0/45206068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64101a5bd0 con 0x7f64101042f0 2024-08-20T05:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.775+0000 7f64185d6740 1 Processor -- start 2024-08-20T05:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.776+0000 7f64185d6740 1 -- start start 2024-08-20T05:18:50.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.776+0000 7f64185d6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f94940 0x55c0e7f94d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.776+0000 7f64185d6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7f95260 0x55c0e7fa0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.776+0000 7f64185d6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7fa11f0 0x55c0e7fa35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.776+0000 7f64185d6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c0e7f0aaa0 con 0x55c0e7f95260 2024-08-20T05:18:50.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.776+0000 7f64185d6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c0e7ef9fa0 con 0x55c0e7fa11f0 2024-08-20T05:18:50.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.776+0000 7f64185d6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c0e7efdfe0 con 0x55c0e7f94940 2024-08-20T05:18:50.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.776+0000 7f6407400640 1 -- 172.21.15.37:0/45206068 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f63fc004000 con 0x7f64101042f0 2024-08-20T05:18:50.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.776+0000 7f640ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7f95260 0x55c0e7fa0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.776+0000 7f640f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f94940 0x55c0e7f94d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.776+0000 7f640f400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f94940 0x55c0e7f94d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:45466/0 (socket says 172.21.15.37:45466) 2024-08-20T05:18:50.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.776+0000 7f640f400640 1 -- 172.21.15.37:0/3617925681 learned_addr learned my addr 172.21.15.37:0/3617925681 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:50.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.777+0000 7f640e000640 1 --2- 172.21.15.37:0/3617925681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7fa11f0 0x55c0e7fa35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.777+0000 7f640f400640 1 -- 172.21.15.37:0/3617925681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7fa11f0 msgr2=0x55c0e7fa35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.777+0000 7f640f400640 1 --2- 172.21.15.37:0/3617925681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7fa11f0 0x55c0e7fa35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.777+0000 7f640f400640 1 -- 172.21.15.37:0/3617925681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7f95260 msgr2=0x55c0e7fa0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.777+0000 7f640f400640 1 --2- 172.21.15.37:0/3617925681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7f95260 0x55c0e7fa0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.777+0000 7f640f400640 1 -- 172.21.15.37:0/3617925681 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0e7ea0420 con 0x55c0e7f94940 2024-08-20T05:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.777+0000 7f640f400640 1 --2- 172.21.15.37:0/3617925681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f94940 0x55c0e7f94d20 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6408009fb0 tx=0x7f6408010800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=562080af8740602c server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.777+0000 7f63fbe00640 1 -- 172.21.15.37:0/3617925681 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6408016070 con 0x55c0e7f94940 2024-08-20T05:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.777+0000 7f63fbe00640 1 -- 172.21.15.37:0/3617925681 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6408012bc0 con 0x55c0e7f94940 2024-08-20T05:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.777+0000 7f63fbe00640 1 -- 172.21.15.37:0/3617925681 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f640801bcb0 con 0x55c0e7f94940 2024-08-20T05:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.778+0000 7f6407400640 1 --2- 172.21.15.37:0/45206068 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f63f40b3c50 0x7f63f40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.778+0000 7f6407400640 1 -- 172.21.15.37:0/45206068 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f63fc0e42d0 con 0x7f64101042f0 2024-08-20T05:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.778+0000 7f64185d6740 1 -- 172.21.15.37:0/3617925681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f94940 msgr2=0x55c0e7f94d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.778+0000 7f64185d6740 1 --2- 172.21.15.37:0/3617925681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f94940 0x55c0e7f94d20 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6408009fb0 tx=0x7f6408010800 comp rx=0 tx=0).stop 2024-08-20T05:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.778+0000 7f640ea00640 1 --2- 172.21.15.37:0/45206068 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f63f40b3c50 0x7f63f40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.778+0000 7f64185d6740 1 -- 172.21.15.37:0/3617925681 shutdown_connections 2024-08-20T05:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.778+0000 7f64185d6740 1 --2- 172.21.15.37:0/3617925681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7fa11f0 0x55c0e7fa35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.778+0000 7f64185d6740 1 --2- 172.21.15.37:0/3617925681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7f95260 0x55c0e7fa0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.778+0000 7f64185d6740 1 --2- 172.21.15.37:0/3617925681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f94940 0x55c0e7f94d20 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.778+0000 7f64185d6740 1 -- 172.21.15.37:0/3617925681 >> 172.21.15.37:0/3617925681 conn(0x55c0e7f92770 msgr2=0x55c0e7f93910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.778+0000 7f64185d6740 1 -- 172.21.15.37:0/3617925681 shutdown_connections 2024-08-20T05:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.779+0000 7f64185d6740 1 -- 172.21.15.37:0/3617925681 wait complete. 2024-08-20T05:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.779+0000 7f640ea00640 1 --2- 172.21.15.37:0/45206068 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f63f40b3c50 0x7f63f40b6110 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6400005ab0 tx=0x7f6400005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.779+0000 7f64185d6740 1 -- start start 2024-08-20T05:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.779+0000 7f64185d6740 1 Processor -- start 2024-08-20T05:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.780+0000 7f64185d6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f94940 0x55c0e7fa09a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.780+0000 7f64185d6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7f95260 0x55c0e7f9ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.780+0000 7f64185d6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7fa11f0 0x55c0e7f9e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.780+0000 7f64185d6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c0e7d5c700 con 0x55c0e7fa11f0 2024-08-20T05:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.780+0000 7f64185d6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x55c0e7e95290 con 0x55c0e7f95260 2024-08-20T05:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.780+0000 7f64185d6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x55c0e7fa3e70 con 0x55c0e7f94940 2024-08-20T05:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.780+0000 7f64185d6740 10 client.0 _ll_register_callbacks cb 0x55c0e7ef41c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.780+0000 7f640ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f94940 0x55c0e7fa09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.780+0000 7f640f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7fa11f0 0x55c0e7f9e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.780+0000 7f640ea00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f94940 0x55c0e7fa09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:45480/0 (socket says 172.21.15.37:45480) 2024-08-20T05:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.780+0000 7f640ea00640 1 -- 172.21.15.37:0/2869162872 learned_addr learned my addr 172.21.15.37:0/2869162872 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.780+0000 7f640e000640 1 --2- 172.21.15.37:0/2869162872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7f95260 0x55c0e7f9ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.781+0000 7f640f400640 1 -- 172.21.15.37:0/2869162872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f94940 msgr2=0x55c0e7fa09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.781+0000 7f640f400640 1 --2- 172.21.15.37:0/2869162872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f94940 0x55c0e7fa09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.781+0000 7f640f400640 1 -- 172.21.15.37:0/2869162872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7f95260 msgr2=0x55c0e7f9ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.781+0000 7f640f400640 1 --2- 172.21.15.37:0/2869162872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7f95260 0x55c0e7f9ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.781+0000 7f640f400640 1 -- 172.21.15.37:0/2869162872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0e7c59650 con 0x55c0e7fa11f0 2024-08-20T05:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.781+0000 7f640e000640 1 --2- 172.21.15.37:0/2869162872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7f95260 0x55c0e7f9ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:50.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.781+0000 7f640f400640 1 --2- 172.21.15.37:0/2869162872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7fa11f0 0x55c0e7f9e330 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6408009f80 tx=0x7f640801b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8006a8766a5f231 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:50.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.781+0000 7f63f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2024-08-20T05:18:50.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.781+0000 7f63f8c00640 1 -- 172.21.15.37:0/2869162872 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6408016040 con 0x55c0e7fa11f0 2024-08-20T05:18:50.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.781+0000 7f63f8c00640 1 -- 172.21.15.37:0/2869162872 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f640801ba30 con 0x55c0e7fa11f0 2024-08-20T05:18:50.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.781+0000 7f64185d6740 1 -- 172.21.15.37:0/2869162872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6408012bc0 con 0x55c0e7fa11f0 2024-08-20T05:18:50.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.781+0000 7f63f8c00640 1 -- 172.21.15.37:0/2869162872 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f6408031050 con 0x55c0e7fa11f0 2024-08-20T05:18:50.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.781+0000 7f64185d6740 10 client.18681 fetch_fsmap learned FSMap version 56 2024-08-20T05:18:50.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.781+0000 7f64185d6740 1 -- 172.21.15.37:0/2869162872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55c0e7fb3aa0 con 0x55c0e7fa11f0 2024-08-20T05:18:50.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.782+0000 7f63f8c00640 1 -- 172.21.15.37:0/2869162872 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6408012bc0 con 0x55c0e7fa11f0 2024-08-20T05:18:50.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.782+0000 7f63f8c00640 1 -- 172.21.15.37:0/2869162872 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f640802c030 con 0x55c0e7fa11f0 2024-08-20T05:18:50.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.782+0000 7f64185d6740 10 client.18681 fetch_fsmap finished waiting for FSMap version 56 2024-08-20T05:18:50.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.782+0000 7f64185d6740 10 client.18681 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:18:50.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.782+0000 7f64185d6740 20 client.18681 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:50.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.782+0000 7f64185d6740 1 --2- 172.21.15.37:0/2869162872 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c0e7fb4ea0 0x55c0e7fb7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.782+0000 7f64185d6740 4 client.18681 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-20T05:18:50.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.782+0000 7f64185d6740 1 -- 172.21.15.37:0/2869162872 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c0e7f0c9f0 con 0x55c0e7fb4ea0 2024-08-20T05:18:50.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.782+0000 7f640ea00640 1 --2- 172.21.15.37:0/2869162872 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c0e7fb4ea0 0x55c0e7fb7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.783+0000 7f640ea00640 1 --2- 172.21.15.37:0/2869162872 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c0e7fb4ea0 0x55c0e7fb7290 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f667b538cbba5c5d server_cookie=e530979d1da4e79c in_seq=0 out_seq=0 2024-08-20T05:18:50.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.783+0000 7f63f8c00640 10 client.18681 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:50.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.784+0000 7f63f8c00640 1 -- 172.21.15.37:0/2869162872 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c0e7f0c9f0 con 0x55c0e7fb4ea0 2024-08-20T05:18:50.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.784+0000 7f63f8c00640 10 client.18681 handle_command_reply: tid=0 2024-08-20T05:18:50.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.784+0000 7f64185d6740 1 client.18681 shutdown 2024-08-20T05:18:50.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.784+0000 7f64185d6740 1 -- 172.21.15.37:0/2869162872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7fa11f0 msgr2=0x55c0e7f9e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:50.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.784+0000 7f64185d6740 1 --2- 172.21.15.37:0/2869162872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7fa11f0 0x55c0e7f9e330 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6408009f80 tx=0x7f640801b650 comp rx=0 tx=0).stop 2024-08-20T05:18:50.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.784+0000 7f64185d6740 1 -- 172.21.15.37:0/2869162872 shutdown_connections 2024-08-20T05:18:50.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.784+0000 7f64185d6740 1 --2- 172.21.15.37:0/2869162872 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c0e7fb4ea0 0x55c0e7fb7290 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.784+0000 7f64185d6740 1 --2- 172.21.15.37:0/2869162872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7fa11f0 0x55c0e7f9e330 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.784+0000 7f64185d6740 1 --2- 172.21.15.37:0/2869162872 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7f95260 0x55c0e7f9ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.784+0000 7f64185d6740 1 --2- 172.21.15.37:0/2869162872 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f94940 0x55c0e7fa09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.784+0000 7f64185d6740 1 -- 172.21.15.37:0/2869162872 >> 172.21.15.37:0/2869162872 conn(0x55c0e7f92770 msgr2=0x55c0e7f98310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:50.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.785+0000 7f63f8c00640 0 client.18681 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:50.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.785+0000 7f64185d6740 1 -- 172.21.15.37:0/2869162872 shutdown_connections 2024-08-20T05:18:50.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.785+0000 7f64185d6740 1 -- 172.21.15.37:0/2869162872 wait complete. 2024-08-20T05:18:50.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.785+0000 7f64185d6740 20 client.18681 trim_cache size 0 max 16384 2024-08-20T05:18:50.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.798+0000 7f64185d6740 1 Processor -- start 2024-08-20T05:18:50.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.799+0000 7f64185d6740 1 -- start start 2024-08-20T05:18:50.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.799+0000 7f64185d6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7f94940 0x55c0e7f9fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.799+0000 7f64185d6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7f95260 0x55c0e7fbc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.799+0000 7f64185d6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7fa11f0 0x55c0e7fbce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.799+0000 7f64185d6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f64101ad6d0 con 0x55c0e7f94940 2024-08-20T05:18:50.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.799+0000 7f64185d6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64101af270 con 0x55c0e7f95260 2024-08-20T05:18:50.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.799+0000 7f64185d6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f64101ade00 con 0x55c0e7fa11f0 2024-08-20T05:18:50.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.799+0000 7f640ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7f94940 0x55c0e7f9fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.799+0000 7f640ea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7f94940 0x55c0e7f9fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59484/0 (socket says 172.21.15.37:59484) 2024-08-20T05:18:50.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.799+0000 7f640ea00640 1 -- 172.21.15.37:0/4281023796 learned_addr learned my addr 172.21.15.37:0/4281023796 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:50.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.799+0000 7f640e000640 1 --2- 172.21.15.37:0/4281023796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7f95260 0x55c0e7fbc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.799+0000 7f640f400640 1 --2- 172.21.15.37:0/4281023796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7fa11f0 0x55c0e7fbce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.799+0000 7f640ea00640 1 -- 172.21.15.37:0/4281023796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7fa11f0 msgr2=0x55c0e7fbce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:50.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.799+0000 7f640ea00640 1 --2- 172.21.15.37:0/4281023796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7fa11f0 0x55c0e7fbce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.799+0000 7f640ea00640 1 -- 172.21.15.37:0/4281023796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7f95260 msgr2=0x55c0e7fbc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:50.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.800+0000 7f640ea00640 1 --2- 172.21.15.37:0/4281023796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7f95260 0x55c0e7fbc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.800+0000 7f640ea00640 1 -- 172.21.15.37:0/4281023796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c0e7fa0d10 con 0x55c0e7f94940 2024-08-20T05:18:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.800+0000 7f640ea00640 1 --2- 172.21.15.37:0/4281023796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7f94940 0x55c0e7f9fb30 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6400009230 tx=0x7f640003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc7b37d8294808b server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.800+0000 7f63fb400640 1 -- 172.21.15.37:0/4281023796 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400035040 con 0x55c0e7f94940 2024-08-20T05:18:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.800+0000 7f63fb400640 1 -- 172.21.15.37:0/4281023796 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f640005a070 con 0x55c0e7f94940 2024-08-20T05:18:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.800+0000 7f63fb400640 1 -- 172.21.15.37:0/4281023796 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6400054a60 con 0x55c0e7f94940 2024-08-20T05:18:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.801+0000 7f64185d6740 1 -- 172.21.15.37:0/4281023796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7f94940 msgr2=0x55c0e7f9fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.801+0000 7f64185d6740 1 --2- 172.21.15.37:0/4281023796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7f94940 0x55c0e7f9fb30 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6400009230 tx=0x7f640003f000 comp rx=0 tx=0).stop 2024-08-20T05:18:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.801+0000 7f64185d6740 1 -- 172.21.15.37:0/4281023796 shutdown_connections 2024-08-20T05:18:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.801+0000 7f64185d6740 1 --2- 172.21.15.37:0/4281023796 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7fa11f0 0x55c0e7fbce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.801+0000 7f64185d6740 1 --2- 172.21.15.37:0/4281023796 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7f95260 0x55c0e7fbc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.801+0000 7f64185d6740 1 --2- 172.21.15.37:0/4281023796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7f94940 0x55c0e7f9fb30 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.801+0000 7f64185d6740 1 -- 172.21.15.37:0/4281023796 >> 172.21.15.37:0/4281023796 conn(0x55c0e7f92770 msgr2=0x55c0e7f9f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.801+0000 7f64185d6740 1 -- 172.21.15.37:0/4281023796 shutdown_connections 2024-08-20T05:18:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.801+0000 7f64185d6740 1 -- 172.21.15.37:0/4281023796 wait complete. 2024-08-20T05:18:50.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.801+0000 7f64185d6740 1 -- start start 2024-08-20T05:18:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.801+0000 7f64185d6740 1 Processor -- start 2024-08-20T05:18:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.802+0000 7f64185d6740 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7f94940 0x55c0e7fad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.802+0000 7f64185d6740 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f95260 0x55c0e7fade60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.802+0000 7f64185d6740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7fa11f0 0x55c0e7f9aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.802+0000 7f64185d6740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f64101aeba0 con 0x55c0e7fa11f0 2024-08-20T05:18:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.802+0000 7f64185d6740 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64101ae4d0 con 0x55c0e7f94940 2024-08-20T05:18:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.802+0000 7f64185d6740 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f64101ab6b0 con 0x55c0e7f95260 2024-08-20T05:18:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.802+0000 7f64185d6740 10 client.0 _ll_register_callbacks cb 0x7f6400009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-20T05:18:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.802+0000 7f640f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7fa11f0 0x55c0e7f9aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.802+0000 7f640e000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f95260 0x55c0e7fade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.802+0000 7f640f400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7fa11f0 0x55c0e7f9aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59496/0 (socket says 172.21.15.37:59496) 2024-08-20T05:18:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.802+0000 7f640f400640 1 -- 172.21.15.37:0/1313184203 learned_addr learned my addr 172.21.15.37:0/1313184203 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.802+0000 7f640ea00640 1 --2- 172.21.15.37:0/1313184203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7f94940 0x55c0e7fad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.803+0000 7f640e000640 1 -- 172.21.15.37:0/1313184203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7f94940 msgr2=0x55c0e7fad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.803+0000 7f640e000640 1 --2- 172.21.15.37:0/1313184203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7f94940 0x55c0e7fad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.803+0000 7f640e000640 1 -- 172.21.15.37:0/1313184203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7fa11f0 msgr2=0x55c0e7f9aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-20T05:18:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.803+0000 7f640e000640 1 --2- 172.21.15.37:0/1313184203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7fa11f0 0x55c0e7f9aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.803+0000 7f640e000640 1 -- 172.21.15.37:0/1313184203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c0e7f9b300 con 0x55c0e7f95260 2024-08-20T05:18:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.803+0000 7f640ea00640 1 --2- 172.21.15.37:0/1313184203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7f94940 0x55c0e7fad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:18:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.803+0000 7f640e000640 1 --2- 172.21.15.37:0/1313184203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f95260 0x55c0e7fade60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0e19d0 tx=0x7f63fc0aa7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47d74dd2f110c848 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.803+0000 7f63f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.135:3300/0 2024-08-20T05:18:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.803+0000 7f63f8c00640 1 -- 172.21.15.37:0/1313184203 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63fc0aa930 con 0x55c0e7f95260 2024-08-20T05:18:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.803+0000 7f63f8c00640 1 -- 172.21.15.37:0/1313184203 <== mon.1 v2:172.21.15.135:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f63fc0a6790 con 0x55c0e7f95260 2024-08-20T05:18:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.803+0000 7f64185d6740 1 -- 172.21.15.37:0/1313184203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f640005a070 con 0x55c0e7f95260 2024-08-20T05:18:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.803+0000 7f63f8c00640 1 -- 172.21.15.37:0/1313184203 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f63fc0042f0 con 0x55c0e7f95260 2024-08-20T05:18:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.803+0000 7f64185d6740 10 client.29479 fetch_fsmap learned FSMap version 56 2024-08-20T05:18:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.803+0000 7f64185d6740 1 -- 172.21.15.37:0/1313184203 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x55c0e801f570 con 0x55c0e7f95260 2024-08-20T05:18:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.804+0000 7f63f8c00640 1 -- 172.21.15.37:0/1313184203 <== mon.1 v2:172.21.15.135:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f640005a070 con 0x55c0e7f95260 2024-08-20T05:18:50.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.804+0000 7f63f8c00640 1 -- 172.21.15.37:0/1313184203 <== mon.1 v2:172.21.15.135:3300/0 5 ==== fsmap(e 56) ==== 8386+0+0 (secure 0 0 0) 0x7f63fc0a9af0 con 0x55c0e7f95260 2024-08-20T05:18:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.804+0000 7f64185d6740 10 client.29479 fetch_fsmap finished waiting for FSMap version 56 2024-08-20T05:18:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.804+0000 7f64185d6740 10 client.29479 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-20T05:18:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.804+0000 7f64185d6740 20 client.29479 populate_metadata read hostname 'smithi037' 2024-08-20T05:18:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.804+0000 7f64185d6740 1 --2- 172.21.15.37:0/1313184203 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c0e801fca0 0x55c0e80220c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.804+0000 7f64185d6740 4 client.29479 mds_command: new command op to 24695 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-20T05:18:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.804+0000 7f64185d6740 1 -- 172.21.15.37:0/1313184203 --> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c0e7f08490 con 0x55c0e801fca0 2024-08-20T05:18:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.805+0000 7f640ea00640 1 --2- 172.21.15.37:0/1313184203 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c0e801fca0 0x55c0e80220c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.805+0000 7f640ea00640 1 --2- 172.21.15.37:0/1313184203 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c0e801fca0 0x55c0e80220c0 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8203a78374060fc server_cookie=6e68896ce88c3a01 in_seq=0 out_seq=0 2024-08-20T05:18:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.805+0000 7f63f8c00640 10 client.29479 ms_handle_connect on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.805+0000 7f63f8c00640 1 -- 172.21.15.37:0/1313184203 <== mds.0 v2:172.21.15.130:6838/2863850712 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c0e7f08490 con 0x55c0e801fca0 2024-08-20T05:18:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.805+0000 7f63f8c00640 10 client.29479 handle_command_reply: tid=0 2024-08-20T05:18:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.805+0000 7f64185d6740 1 client.29479 shutdown 2024-08-20T05:18:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.806+0000 7f64185d6740 1 -- 172.21.15.37:0/1313184203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f95260 msgr2=0x55c0e7fade60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.806+0000 7f64185d6740 1 --2- 172.21.15.37:0/1313184203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f95260 0x55c0e7fade60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0e19d0 tx=0x7f63fc0aa7f0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.806+0000 7f64185d6740 1 -- 172.21.15.37:0/1313184203 shutdown_connections 2024-08-20T05:18:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.806+0000 7f64185d6740 1 --2- 172.21.15.37:0/1313184203 >> [v2:172.21.15.130:6838/2863850712,v1:172.21.15.130:6839/2863850712] conn(0x55c0e801fca0 0x55c0e80220c0 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.806+0000 7f64185d6740 1 --2- 172.21.15.37:0/1313184203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c0e7fa11f0 0x55c0e7f9aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.806+0000 7f64185d6740 1 --2- 172.21.15.37:0/1313184203 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x55c0e7f95260 0x55c0e7fade60 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.806+0000 7f64185d6740 1 --2- 172.21.15.37:0/1313184203 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x55c0e7f94940 0x55c0e7fad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.806+0000 7f64185d6740 1 -- 172.21.15.37:0/1313184203 >> 172.21.15.37:0/1313184203 conn(0x55c0e7f92770 msgr2=0x55c0e7f91030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.806+0000 7f63f8c00640 0 client.29479 ms_handle_reset on v2:172.21.15.130:6838/2863850712 2024-08-20T05:18:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.806+0000 7f64185d6740 1 -- 172.21.15.37:0/1313184203 shutdown_connections 2024-08-20T05:18:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.806+0000 7f64185d6740 1 -- 172.21.15.37:0/1313184203 wait complete. 2024-08-20T05:18:50.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.806+0000 7f64185d6740 20 client.29479 trim_cache size 0 max 16384 2024-08-20T05:18:50.824 INFO:teuthology.orchestra.run.smithi037.stdout:[] 2024-08-20T05:18:50.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.807+0000 7f6415a00640 1 -- 172.21.15.37:0/45206068 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f63f40b3c50 msgr2=0x7f63f40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:50.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.807+0000 7f6415a00640 1 --2- 172.21.15.37:0/45206068 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f63f40b3c50 0x7f63f40b6110 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6400005ab0 tx=0x7f6400005a20 comp rx=0 tx=0).stop 2024-08-20T05:18:50.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.807+0000 7f6415a00640 1 -- 172.21.15.37:0/45206068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64101042f0 msgr2=0x7f64101994e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:50.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.807+0000 7f6415a00640 1 --2- 172.21.15.37:0/45206068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64101042f0 0x7f64101994e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00e9c0 tx=0x7f63fc00ee80 comp rx=0 tx=0).stop 2024-08-20T05:18:50.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.807+0000 7f6415a00640 1 -- 172.21.15.37:0/45206068 shutdown_connections 2024-08-20T05:18:50.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.807+0000 7f6415a00640 1 --2- 172.21.15.37:0/45206068 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f63f40b3c50 0x7f63f40b6110 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.807+0000 7f6415a00640 1 --2- 172.21.15.37:0/45206068 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f641010ce30 0x7f641019e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.807+0000 7f6415a00640 1 --2- 172.21.15.37:0/45206068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64101042f0 0x7f64101994e0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.807+0000 7f6415a00640 1 --2- 172.21.15.37:0/45206068 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64101039d0 0x7f6410198fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.807+0000 7f6415a00640 1 -- 172.21.15.37:0/45206068 >> 172.21.15.37:0/45206068 conn(0x7f64100fd410 msgr2=0x7f64100fe010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.807+0000 7f6415a00640 1 -- 172.21.15.37:0/45206068 shutdown_connections 2024-08-20T05:18:50.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:50.807+0000 7f6415a00640 1 -- 172.21.15.37:0/45206068 wait complete. 2024-08-20T05:18:51.708 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/github.com_ceph_ceph-c_ef4275410d8483698016fe484b2a3c664080b4c1/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-08-20T05:18:51.708 INFO:tasks.fwd_scrub:done joining 2024-08-20T05:18:51.709 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-08-20T05:18:51.719 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-20T05:18:51.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.898+0000 7ff4e4a00640 1 -- 172.21.15.37:0/2069792368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e0105da0 msgr2=0x7ff4e01061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:51.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.898+0000 7ff4e4a00640 1 --2- 172.21.15.37:0/2069792368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e0105da0 0x7ff4e01061a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ff4d0009900 tx=0x7ff4d002a3f0 comp rx=0 tx=0).stop 2024-08-20T05:18:51.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.898+0000 7ff4e4a00640 1 -- 172.21.15.37:0/2069792368 shutdown_connections 2024-08-20T05:18:51.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.898+0000 7ff4e4a00640 1 --2- 172.21.15.37:0/2069792368 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e0104fb0 0x7ff4e010cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:51.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.898+0000 7ff4e4a00640 1 --2- 172.21.15.37:0/2069792368 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4e01045f0 0x7ff4e0104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:51.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.898+0000 7ff4e4a00640 1 --2- 172.21.15.37:0/2069792368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e0105da0 0x7ff4e01061a0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:51.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.898+0000 7ff4e4a00640 1 -- 172.21.15.37:0/2069792368 >> 172.21.15.37:0/2069792368 conn(0x7ff4e0100140 msgr2=0x7ff4e0102580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:51.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.898+0000 7ff4e4a00640 1 -- 172.21.15.37:0/2069792368 shutdown_connections 2024-08-20T05:18:51.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.898+0000 7ff4e4a00640 1 -- 172.21.15.37:0/2069792368 wait complete. 2024-08-20T05:18:51.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.899+0000 7ff4e4a00640 1 Processor -- start 2024-08-20T05:18:51.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.899+0000 7ff4e4a00640 1 -- start start 2024-08-20T05:18:51.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.899+0000 7ff4e4a00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4e01045f0 0x7ff4e019ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:51.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.899+0000 7ff4e4a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e0104fb0 0x7ff4e019b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:51.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.899+0000 7ff4e4a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e0105da0 0x7ff4e019bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:51.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.899+0000 7ff4e4a00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e0110650 con 0x7ff4e0105da0 2024-08-20T05:18:51.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.899+0000 7ff4e4a00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e01104d0 con 0x7ff4e01045f0 2024-08-20T05:18:51.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.899+0000 7ff4e4a00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e01107d0 con 0x7ff4e0104fb0 2024-08-20T05:18:51.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.900+0000 7ff4de800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e0105da0 0x7ff4e019bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:51.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.900+0000 7ff4dde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4e01045f0 0x7ff4e019ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:51.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.900+0000 7ff4de800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e0105da0 0x7ff4e019bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59514/0 (socket says 172.21.15.37:59514) 2024-08-20T05:18:51.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.900+0000 7ff4dde00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4e01045f0 0x7ff4e019ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:42414/0 (socket says 172.21.15.37:42414) 2024-08-20T05:18:51.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.900+0000 7ff4d5400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e0104fb0 0x7ff4e019b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:51.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.900+0000 7ff4de800640 1 -- 172.21.15.37:0/682578131 learned_addr learned my addr 172.21.15.37:0/682578131 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:51.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.900+0000 7ff4dde00640 1 -- 172.21.15.37:0/682578131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e0104fb0 msgr2=0x7ff4e019b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:51.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.900+0000 7ff4dde00640 1 --2- 172.21.15.37:0/682578131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e0104fb0 0x7ff4e019b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:51.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.900+0000 7ff4dde00640 1 -- 172.21.15.37:0/682578131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e0105da0 msgr2=0x7ff4e019bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:51.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.900+0000 7ff4dde00640 1 --2- 172.21.15.37:0/682578131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e0105da0 0x7ff4e019bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:51.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.900+0000 7ff4dde00640 1 -- 172.21.15.37:0/682578131 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e019c880 con 0x7ff4e01045f0 2024-08-20T05:18:51.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.900+0000 7ff4de800640 1 --2- 172.21.15.37:0/682578131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e0105da0 0x7ff4e019bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:51.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.901+0000 7ff4dde00640 1 --2- 172.21.15.37:0/682578131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4e01045f0 0x7ff4e019ad40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff4d002a9e0 tx=0x7ff4d0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:51.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.901+0000 7ff4d7400640 1 -- 172.21.15.37:0/682578131 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d003f070 con 0x7ff4e01045f0 2024-08-20T05:18:51.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.901+0000 7ff4d7400640 1 -- 172.21.15.37:0/682578131 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4d0031c50 con 0x7ff4e01045f0 2024-08-20T05:18:51.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.901+0000 7ff4d7400640 1 -- 172.21.15.37:0/682578131 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4d0035030 con 0x7ff4e01045f0 2024-08-20T05:18:51.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.901+0000 7ff4e4a00640 1 -- 172.21.15.37:0/682578131 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e019cb10 con 0x7ff4e01045f0 2024-08-20T05:18:51.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.901+0000 7ff4e4a00640 1 -- 172.21.15.37:0/682578131 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e01a3240 con 0x7ff4e01045f0 2024-08-20T05:18:51.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.902+0000 7ff4e4a00640 1 -- 172.21.15.37:0/682578131 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4e0104a70 con 0x7ff4e01045f0 2024-08-20T05:18:51.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.904+0000 7ff4d7400640 1 -- 172.21.15.37:0/682578131 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff4d0042070 con 0x7ff4e01045f0 2024-08-20T05:18:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.906+0000 7ff4d7400640 1 --2- 172.21.15.37:0/682578131 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4c40b3c50 0x7ff4c40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.906+0000 7ff4d7400640 1 -- 172.21.15.37:0/682578131 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff4d0104ef0 con 0x7ff4e01045f0 2024-08-20T05:18:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.906+0000 7ff4d5400640 1 --2- 172.21.15.37:0/682578131 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4c40b3c50 0x7ff4c40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.906+0000 7ff4d5400640 1 --2- 172.21.15.37:0/682578131 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4c40b3c50 0x7ff4c40b6110 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80095f0 tx=0x7ff4c8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:51.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:51.907+0000 7ff4d7400640 1 -- 172.21.15.37:0/682578131 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff4d00cbaf0 con 0x7ff4e01045f0 2024-08-20T05:18:51.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:51 smithi130 ceph-mon[22007]: pgmap v899: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2024-08-20T05:18:52.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:51 smithi037 ceph-mon[17265]: pgmap v899: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2024-08-20T05:18:52.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.106+0000 7ff4e4a00640 1 -- 172.21.15.37:0/682578131 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4e0063a80 con 0x7ff4e01045f0 2024-08-20T05:18:52.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.108+0000 7ff4d7400640 1 -- 172.21.15.37:0/682578131 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24873 (secure 0 0 0) 0x7ff4d00d0040 con 0x7ff4e01045f0 2024-08-20T05:18:52.110 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:52.110 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":88,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","created":"2024-08-20T04:50:26.520303+0000","modified":"2024-08-20T05:01:30.328315+0000","last_up_change":"2024-08-20T04:58:12.250259+0000","last_in_change":"2024-08-20T04:57:49.724189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T04:54:16.381529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T04:59:08.598741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T04:59:10.793802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-20T04:59:19.888446+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a813e53b-68b3-43ff-a59b-aed00e98f2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6803","nonce":3569936373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6805","nonce":3569936373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6809","nonce":3569936373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6807","nonce":3569936373}]},"public_addr":"172.21.15.37:6803/3569936373","cluster_addr":"172.21.15.37:6805/3569936373","heartbeat_back_addr":"172.21.15.37:6809/3569936373","heartbeat_front_addr":"172.21.15.37:6807/3569936373","state":["exists","up"]},{"osd":1,"uuid":"c216a8d0-9685-467a-8161-700682ce617c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6801","nonce":4206461125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6803","nonce":4206461125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6807","nonce":4206461125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6805","nonce":4206461125}]},"public_addr":"172.21.15.130:6801/4206461125","cluster_addr":"172.21.15.130:6803/4206461125","heartbeat_back_addr":"172.21.15.130:6807/4206461125","heartbeat_front_addr":"172.21.15.130:6805/4206461125","state":["exists","up"]},{"osd":2,"uuid":"34402442-c652-40eb-865e-a607a28846b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6801","nonce":2653255199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6803","nonce":2653255199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6807","nonce":2653255199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6805","nonce":2653255199}]},"public_addr":"172.21.15.135:6801/2653255199","cluster_addr":"172.21.15.135:6803/2653255199","heartbeat_back_addr":"172.21.15.135:6807/2653255199","heartbeat_front_addr":"172.21.15.135:6805/2653255199","state":["exists","up"]},{"osd":3,"uuid":"ec7be9dc-96b5-4816-9065-8121baedcdc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6811","nonce":2601290990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6813","nonce":2601290990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6817","nonce":2601290990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6815","nonce":2601290990}]},"public_addr":"172.21.15.37:6811/2601290990","cluster_addr":"172.21.15.37:6813/2601290990","heartbeat_back_addr":"172.21.15.37:6817/2601290990","heartbeat_front_addr":"172.21.15.37:6815/2601290990","state":["exists","up"]},{"osd":4,"uuid":"2dbd47f9-8686-4707-8862-3c7a99a37d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6809","nonce":3542081474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6811","nonce":3542081474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6815","nonce":3542081474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6813","nonce":3542081474}]},"public_addr":"172.21.15.130:6809/3542081474","cluster_addr":"172.21.15.130:6811/3542081474","heartbeat_back_addr":"172.21.15.130:6815/3542081474","heartbeat_front_addr":"172.21.15.130:6813/3542081474","state":["exists","up"]},{"osd":5,"uuid":"9a07a137-d6b7-4aba-8678-4fd164597f27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6809","nonce":2507249148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6811","nonce":2507249148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6815","nonce":2507249148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6813","nonce":2507249148}]},"public_addr":"172.21.15.135:6809/2507249148","cluster_addr":"172.21.15.135:6811/2507249148","heartbeat_back_addr":"172.21.15.135:6815/2507249148","heartbeat_front_addr":"172.21.15.135:6813/2507249148","state":["exists","up"]},{"osd":6,"uuid":"6d6346e8-5418-4c30-9bb3-5af352b616a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6819","nonce":155932692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6821","nonce":155932692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6825","nonce":155932692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6823","nonce":155932692}]},"public_addr":"172.21.15.37:6819/155932692","cluster_addr":"172.21.15.37:6821/155932692","heartbeat_back_addr":"172.21.15.37:6825/155932692","heartbeat_front_addr":"172.21.15.37:6823/155932692","state":["exists","up"]},{"osd":7,"uuid":"c87804c2-d456-495e-b36e-33dbb3548347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6817","nonce":4148130245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6819","nonce":4148130245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6823","nonce":4148130245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6821","nonce":4148130245}]},"public_addr":"172.21.15.130:6817/4148130245","cluster_addr":"172.21.15.130:6819/4148130245","heartbeat_back_addr":"172.21.15.130:6823/4148130245","heartbeat_front_addr":"172.21.15.130:6821/4148130245","state":["exists","up"]},{"osd":8,"uuid":"a7d4c9c8-1826-4703-92ad-ded2800b4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6817","nonce":222884649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6819","nonce":222884649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6823","nonce":222884649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6821","nonce":222884649}]},"public_addr":"172.21.15.135:6817/222884649","cluster_addr":"172.21.15.135:6819/222884649","heartbeat_back_addr":"172.21.15.135:6823/222884649","heartbeat_front_addr":"172.21.15.135:6821/222884649","state":["exists","up"]},{"osd":9,"uuid":"f9e0c194-66b5-4e62-b2ae-816a4a4fffbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6827","nonce":2240773042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6829","nonce":2240773042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6833","nonce":2240773042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6831","nonce":2240773042}]},"public_addr":"172.21.15.37:6827/2240773042","cluster_addr":"172.21.15.37:6829/2240773042","heartbeat_back_addr":"172.21.15.37:6833/2240773042","heartbeat_front_addr":"172.21.15.37:6831/2240773042","state":["exists","up"]},{"osd":10,"uuid":"fa6a50a5-2b97-42d1-9b57-b5502b7083d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6825","nonce":2896730163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6827","nonce":2896730163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6831","nonce":2896730163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6829","nonce":2896730163}]},"public_addr":"172.21.15.130:6825/2896730163","cluster_addr":"172.21.15.130:6827/2896730163","heartbeat_back_addr":"172.21.15.130:6831/2896730163","heartbeat_front_addr":"172.21.15.130:6829/2896730163","state":["exists","up"]},{"osd":11,"uuid":"9a305d75-030d-41db-abfb-81bb71e8c6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6825","nonce":2532897645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6827","nonce":2532897645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6831","nonce":2532897645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6829","nonce":2532897645}]},"public_addr":"172.21.15.135:6825/2532897645","cluster_addr":"172.21.15.135:6827/2532897645","heartbeat_back_addr":"172.21.15.135:6831/2532897645","heartbeat_front_addr":"172.21.15.135:6829/2532897645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:26.455665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:51.456030+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:14.332699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:42.749386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:07.587091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:32.450249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:01.864489+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:26.830527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:51.206257+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:20.400020+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:46.329864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:58:11.086508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4282140105":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/1217599998":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/3737412906":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/58912454":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/2105948300":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/1480362562":"2024-08-21T04:50:59.520912+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T05:18:52.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.111+0000 7ff4e4a00640 1 -- 172.21.15.37:0/682578131 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4c40b3c50 msgr2=0x7ff4c40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:52.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.111+0000 7ff4e4a00640 1 --2- 172.21.15.37:0/682578131 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4c40b3c50 0x7ff4c40b6110 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff4c80095f0 tx=0x7ff4c8005f90 comp rx=0 tx=0).stop 2024-08-20T05:18:52.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.111+0000 7ff4e4a00640 1 -- 172.21.15.37:0/682578131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4e01045f0 msgr2=0x7ff4e019ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:52.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.111+0000 7ff4e4a00640 1 --2- 172.21.15.37:0/682578131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4e01045f0 0x7ff4e019ad40 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff4d002a9e0 tx=0x7ff4d0003c10 comp rx=0 tx=0).stop 2024-08-20T05:18:52.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.111+0000 7ff4e4a00640 1 -- 172.21.15.37:0/682578131 shutdown_connections 2024-08-20T05:18:52.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.111+0000 7ff4e4a00640 1 --2- 172.21.15.37:0/682578131 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff4c40b3c50 0x7ff4c40b6110 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.111+0000 7ff4e4a00640 1 --2- 172.21.15.37:0/682578131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4e0105da0 0x7ff4e019bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.111+0000 7ff4e4a00640 1 --2- 172.21.15.37:0/682578131 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff4e0104fb0 0x7ff4e019b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.111+0000 7ff4e4a00640 1 --2- 172.21.15.37:0/682578131 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff4e01045f0 0x7ff4e019ad40 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.111+0000 7ff4e4a00640 1 -- 172.21.15.37:0/682578131 >> 172.21.15.37:0/682578131 conn(0x7ff4e0100140 msgr2=0x7ff4e0108d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:52.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.111+0000 7ff4e4a00640 1 -- 172.21.15.37:0/682578131 shutdown_connections 2024-08-20T05:18:52.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.111+0000 7ff4e4a00640 1 -- 172.21.15.37:0/682578131 wait complete. 2024-08-20T05:18:52.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:51 smithi135 ceph-mon[22342]: pgmap v899: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.8 KiB/s wr, 15 op/s 2024-08-20T05:18:52.129 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-20T04:54:16.381529+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-20T04:59:08.598741+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-20T04:59:10.793802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-08-20T04:59:19.888446+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-20T05:18:52.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-20T05:18:52.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.290+0000 7f85b9800640 1 -- 172.21.15.37:0/3213719949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85b4103fb0 msgr2=0x7f85b410a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:52.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.290+0000 7f85b9800640 1 --2- 172.21.15.37:0/3213719949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85b4103fb0 0x7f85b410a930 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f85ac009930 tx=0x7f85ac02a420 comp rx=0 tx=0).stop 2024-08-20T05:18:52.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.290+0000 7f85b9800640 1 -- 172.21.15.37:0/3213719949 shutdown_connections 2024-08-20T05:18:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.290+0000 7f85b9800640 1 --2- 172.21.15.37:0/3213719949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85b4103fb0 0x7f85b410a930 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.290+0000 7f85b9800640 1 --2- 172.21.15.37:0/3213719949 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85b41035f0 0x7f85b4103a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.290+0000 7f85b9800640 1 --2- 172.21.15.37:0/3213719949 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85b41024a0 0x7f85b41028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.290+0000 7f85b9800640 1 -- 172.21.15.37:0/3213719949 >> 172.21.15.37:0/3213719949 conn(0x7f85b40fdd60 msgr2=0x7f85b4100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.290+0000 7f85b9800640 1 -- 172.21.15.37:0/3213719949 shutdown_connections 2024-08-20T05:18:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.290+0000 7f85b9800640 1 -- 172.21.15.37:0/3213719949 wait complete. 2024-08-20T05:18:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.291+0000 7f85b9800640 1 Processor -- start 2024-08-20T05:18:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.291+0000 7f85b9800640 1 -- start start 2024-08-20T05:18:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.292+0000 7f85b9800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85b41024a0 0x7f85b419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.292+0000 7f85b9800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85b41035f0 0x7f85b419b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.292+0000 7f85b9800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85b4103fb0 0x7f85b419bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.292+0000 7f85b9800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f85b410e160 con 0x7f85b41024a0 2024-08-20T05:18:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.292+0000 7f85b9800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f85b410dfe0 con 0x7f85b41035f0 2024-08-20T05:18:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.292+0000 7f85b9800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f85b410e2e0 con 0x7f85b4103fb0 2024-08-20T05:18:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.292+0000 7f85b3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85b41024a0 0x7f85b419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.292+0000 7f85b3e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85b41024a0 0x7f85b419aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59542/0 (socket says 172.21.15.37:59542) 2024-08-20T05:18:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.292+0000 7f85b3e00640 1 -- 172.21.15.37:0/2570735953 learned_addr learned my addr 172.21.15.37:0/2570735953 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.292+0000 7f85ab400640 1 --2- 172.21.15.37:0/2570735953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85b41035f0 0x7f85b419b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.292+0000 7f85b8e00640 1 --2- 172.21.15.37:0/2570735953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85b4103fb0 0x7f85b419bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.292+0000 7f85b3e00640 1 -- 172.21.15.37:0/2570735953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85b4103fb0 msgr2=0x7f85b419bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.292+0000 7f85b3e00640 1 --2- 172.21.15.37:0/2570735953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85b4103fb0 0x7f85b419bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.292+0000 7f85b3e00640 1 -- 172.21.15.37:0/2570735953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85b41035f0 msgr2=0x7f85b419b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.292+0000 7f85b3e00640 1 --2- 172.21.15.37:0/2570735953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85b41035f0 0x7f85b419b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.292+0000 7f85b3e00640 1 -- 172.21.15.37:0/2570735953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b419c580 con 0x7f85b41024a0 2024-08-20T05:18:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.293+0000 7f85b3e00640 1 --2- 172.21.15.37:0/2570735953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85b41024a0 0x7f85b419aa40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f85a400eb90 tx=0x7f85a400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.293+0000 7f85b1600640 1 -- 172.21.15.37:0/2570735953 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a4004d20 con 0x7f85b41024a0 2024-08-20T05:18:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.293+0000 7f85b1600640 1 -- 172.21.15.37:0/2570735953 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f85a400ee90 con 0x7f85b41024a0 2024-08-20T05:18:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.293+0000 7f85b9800640 1 -- 172.21.15.37:0/2570735953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b419c870 con 0x7f85b41024a0 2024-08-20T05:18:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.293+0000 7f85b1600640 1 -- 172.21.15.37:0/2570735953 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85a4010670 con 0x7f85b41024a0 2024-08-20T05:18:52.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.293+0000 7f85b9800640 1 -- 172.21.15.37:0/2570735953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b41a2f40 con 0x7f85b41024a0 2024-08-20T05:18:52.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.294+0000 7f85b9800640 1 -- 172.21.15.37:0/2570735953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85b41028a0 con 0x7f85b41024a0 2024-08-20T05:18:52.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.296+0000 7f85b1600640 1 -- 172.21.15.37:0/2570735953 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f85a4005020 con 0x7f85b41024a0 2024-08-20T05:18:52.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.298+0000 7f85b1600640 1 --2- 172.21.15.37:0/2570735953 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f85980b3bd0 0x7f85980b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.298+0000 7f85b1600640 1 -- 172.21.15.37:0/2570735953 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f85a40e46d0 con 0x7f85b41024a0 2024-08-20T05:18:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.298+0000 7f85ab400640 1 --2- 172.21.15.37:0/2570735953 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f85980b3bd0 0x7f85980b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:52.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.299+0000 7f85ab400640 1 --2- 172.21.15.37:0/2570735953 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f85980b3bd0 0x7f85980b6090 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f859c009bd0 tx=0x7f859c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:52.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.301+0000 7f85b1600640 1 -- 172.21.15.37:0/2570735953 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f85a40ab920 con 0x7f85b41024a0 2024-08-20T05:18:52.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.494+0000 7f85b9800640 1 -- 172.21.15.37:0/2570735953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f85b41a3810 con 0x7f85b41024a0 2024-08-20T05:18:52.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.494+0000 7f85b1600640 1 -- 172.21.15.37:0/2570735953 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f85a40ab220 con 0x7f85b41024a0 2024-08-20T05:18:52.496 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-08-20T05:18:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.497+0000 7f85b9800640 1 -- 172.21.15.37:0/2570735953 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f85980b3bd0 msgr2=0x7f85980b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.497+0000 7f85b9800640 1 --2- 172.21.15.37:0/2570735953 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f85980b3bd0 0x7f85980b6090 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f859c009bd0 tx=0x7f859c005f90 comp rx=0 tx=0).stop 2024-08-20T05:18:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.497+0000 7f85b9800640 1 -- 172.21.15.37:0/2570735953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85b41024a0 msgr2=0x7f85b419aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.497+0000 7f85b9800640 1 --2- 172.21.15.37:0/2570735953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85b41024a0 0x7f85b419aa40 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f85a400eb90 tx=0x7f85a400c6a0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.497+0000 7f85b9800640 1 -- 172.21.15.37:0/2570735953 shutdown_connections 2024-08-20T05:18:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.497+0000 7f85b9800640 1 --2- 172.21.15.37:0/2570735953 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f85980b3bd0 0x7f85980b6090 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.497+0000 7f85b9800640 1 --2- 172.21.15.37:0/2570735953 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f85b4103fb0 0x7f85b419bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.497+0000 7f85b9800640 1 --2- 172.21.15.37:0/2570735953 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f85b41035f0 0x7f85b419b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.497+0000 7f85b9800640 1 --2- 172.21.15.37:0/2570735953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85b41024a0 0x7f85b419aa40 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.497+0000 7f85b9800640 1 -- 172.21.15.37:0/2570735953 >> 172.21.15.37:0/2570735953 conn(0x7f85b40fdd60 msgr2=0x7f85b40750b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:52.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.497+0000 7f85b9800640 1 -- 172.21.15.37:0/2570735953 shutdown_connections 2024-08-20T05:18:52.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.497+0000 7f85b9800640 1 -- 172.21.15.37:0/2570735953 wait complete. 2024-08-20T05:18:52.515 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-20T05:18:52.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.680+0000 7ff405400640 1 -- 172.21.15.37:0/4219273652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff400075850 msgr2=0x7ff400075cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:52.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.680+0000 7ff405400640 1 --2- 172.21.15.37:0/4219273652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff400075850 0x7ff400075cd0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009900 tx=0x7ff3e802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.680+0000 7ff405400640 1 -- 172.21.15.37:0/4219273652 shutdown_connections 2024-08-20T05:18:52.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.680+0000 7ff405400640 1 --2- 172.21.15.37:0/4219273652 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff400106190 0x7ff400110e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.680+0000 7ff405400640 1 --2- 172.21.15.37:0/4219273652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff400075850 0x7ff400075cd0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.680+0000 7ff405400640 1 --2- 172.21.15.37:0/4219273652 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff400076cc0 0x7ff400075310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.680+0000 7ff405400640 1 -- 172.21.15.37:0/4219273652 >> 172.21.15.37:0/4219273652 conn(0x7ff4000fdf40 msgr2=0x7ff400100360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:52.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.680+0000 7ff405400640 1 -- 172.21.15.37:0/4219273652 shutdown_connections 2024-08-20T05:18:52.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.680+0000 7ff405400640 1 -- 172.21.15.37:0/4219273652 wait complete. 2024-08-20T05:18:52.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.681+0000 7ff405400640 1 Processor -- start 2024-08-20T05:18:52.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.681+0000 7ff405400640 1 -- start start 2024-08-20T05:18:52.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.681+0000 7ff405400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff400075850 0x7ff40019f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:52.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.681+0000 7ff405400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff400076cc0 0x7ff40019f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:52.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.681+0000 7ff405400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4001a02d0 0x7ff4001a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:52.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.681+0000 7ff405400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff400114950 con 0x7ff4001a02d0 2024-08-20T05:18:52.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.681+0000 7ff405400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff4001147d0 con 0x7ff400075850 2024-08-20T05:18:52.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.681+0000 7ff405400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff400114ad0 con 0x7ff400076cc0 2024-08-20T05:18:52.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.681+0000 7ff3ff200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4001a02d0 0x7ff4001a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:52.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.682+0000 7ff3ff200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4001a02d0 0x7ff4001a0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59554/0 (socket says 172.21.15.37:59554) 2024-08-20T05:18:52.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.682+0000 7ff3ff200640 1 -- 172.21.15.37:0/2488481176 learned_addr learned my addr 172.21.15.37:0/2488481176 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:52.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.682+0000 7ff3f5e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff400076cc0 0x7ff40019f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:52.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.682+0000 7ff3fe800640 1 --2- 172.21.15.37:0/2488481176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff400075850 0x7ff40019f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:52.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.682+0000 7ff3ff200640 1 -- 172.21.15.37:0/2488481176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff400076cc0 msgr2=0x7ff40019f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:52.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.682+0000 7ff3ff200640 1 --2- 172.21.15.37:0/2488481176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff400076cc0 0x7ff40019f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.682+0000 7ff3ff200640 1 -- 172.21.15.37:0/2488481176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff400075850 msgr2=0x7ff40019f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:52.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.682+0000 7ff3ff200640 1 --2- 172.21.15.37:0/2488481176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff400075850 0x7ff40019f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.682+0000 7ff3ff200640 1 -- 172.21.15.37:0/2488481176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4001a0f80 con 0x7ff4001a02d0 2024-08-20T05:18:52.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.682+0000 7ff3fe800640 1 --2- 172.21.15.37:0/2488481176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff400075850 0x7ff40019f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:18:52.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.682+0000 7ff3ff200640 1 --2- 172.21.15.37:0/2488481176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4001a02d0 0x7ff4001a0780 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800eb10 tx=0x7ff3f800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:52.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.682+0000 7ff3f7e00640 1 -- 172.21.15.37:0/2488481176 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8004b20 con 0x7ff4001a02d0 2024-08-20T05:18:52.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.682+0000 7ff3f7e00640 1 -- 172.21.15.37:0/2488481176 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3f8004cc0 con 0x7ff4001a02d0 2024-08-20T05:18:52.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.682+0000 7ff3f7e00640 1 -- 172.21.15.37:0/2488481176 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8010670 con 0x7ff4001a02d0 2024-08-20T05:18:52.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.682+0000 7ff405400640 1 -- 172.21.15.37:0/2488481176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4001a7370 con 0x7ff4001a02d0 2024-08-20T05:18:52.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.683+0000 7ff405400640 1 -- 172.21.15.37:0/2488481176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4001a7860 con 0x7ff4001a02d0 2024-08-20T05:18:52.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.684+0000 7ff405400640 1 -- 172.21.15.37:0/2488481176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff400104f60 con 0x7ff4001a02d0 2024-08-20T05:18:52.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.686+0000 7ff3f7e00640 1 -- 172.21.15.37:0/2488481176 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff3f8005020 con 0x7ff4001a02d0 2024-08-20T05:18:52.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.688+0000 7ff3f7e00640 1 --2- 172.21.15.37:0/2488481176 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff3e40b3bd0 0x7ff3e40b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:52.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.689+0000 7ff3f7e00640 1 -- 172.21.15.37:0/2488481176 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff3f80e45a0 con 0x7ff4001a02d0 2024-08-20T05:18:52.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.689+0000 7ff3fe800640 1 --2- 172.21.15.37:0/2488481176 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff3e40b3bd0 0x7ff3e40b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:52.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.689+0000 7ff3fe800640 1 --2- 172.21.15.37:0/2488481176 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff3e40b3bd0 0x7ff3e40b6090 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009c20 tx=0x7ff3f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:52.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.692+0000 7ff3f7e00640 1 -- 172.21.15.37:0/2488481176 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff3f80ab7f0 con 0x7ff4001a02d0 2024-08-20T05:18:52.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:52 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/682578131' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:18:52.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:52 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2570735953' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T05:18:52.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.889+0000 7ff405400640 1 -- 172.21.15.37:0/2488481176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff40002e3e0 con 0x7ff4001a02d0 2024-08-20T05:18:52.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.889+0000 7ff3f7e00640 1 -- 172.21.15.37:0/2488481176 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7ff3f80ab0f0 con 0x7ff4001a02d0 2024-08-20T05:18:52.891 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-08-20T05:18:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.892+0000 7ff405400640 1 -- 172.21.15.37:0/2488481176 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff3e40b3bd0 msgr2=0x7ff3e40b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.892+0000 7ff405400640 1 --2- 172.21.15.37:0/2488481176 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff3e40b3bd0 0x7ff3e40b6090 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009c20 tx=0x7ff3f0005f90 comp rx=0 tx=0).stop 2024-08-20T05:18:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.892+0000 7ff405400640 1 -- 172.21.15.37:0/2488481176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4001a02d0 msgr2=0x7ff4001a0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.892+0000 7ff405400640 1 --2- 172.21.15.37:0/2488481176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4001a02d0 0x7ff4001a0780 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7ff3f800eb10 tx=0x7ff3f800c2d0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.892+0000 7ff405400640 1 -- 172.21.15.37:0/2488481176 shutdown_connections 2024-08-20T05:18:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.892+0000 7ff405400640 1 --2- 172.21.15.37:0/2488481176 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff3e40b3bd0 0x7ff3e40b6090 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.892+0000 7ff405400640 1 --2- 172.21.15.37:0/2488481176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4001a02d0 0x7ff4001a0780 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.892+0000 7ff405400640 1 --2- 172.21.15.37:0/2488481176 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff400076cc0 0x7ff40019f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.892+0000 7ff405400640 1 --2- 172.21.15.37:0/2488481176 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff400075850 0x7ff40019f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:52.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.892+0000 7ff405400640 1 -- 172.21.15.37:0/2488481176 >> 172.21.15.37:0/2488481176 conn(0x7ff4000fdf40 msgr2=0x7ff400102130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.892+0000 7ff405400640 1 -- 172.21.15.37:0/2488481176 shutdown_connections 2024-08-20T05:18:52.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:52.892+0000 7ff405400640 1 -- 172.21.15.37:0/2488481176 wait complete. 2024-08-20T05:18:52.910 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-20T05:18:52.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:52 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/682578131' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:18:52.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:52 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2570735953' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T05:18:53.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.070+0000 7febc4800640 1 -- 172.21.15.37:0/2375293071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febbc104890 msgr2=0x7febbc104c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.070+0000 7febc4800640 1 --2- 172.21.15.37:0/2375293071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febbc104890 0x7febbc104c90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7febb0009930 tx=0x7febb002a440 comp rx=0 tx=0).stop 2024-08-20T05:18:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.070+0000 7febc4800640 1 -- 172.21.15.37:0/2375293071 shutdown_connections 2024-08-20T05:18:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.070+0000 7febc4800640 1 --2- 172.21.15.37:0/2375293071 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febbc1063a0 0x7febbc10cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.070+0000 7febc4800640 1 --2- 172.21.15.37:0/2375293071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febbc1059e0 0x7febbc105e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.070+0000 7febc4800640 1 --2- 172.21.15.37:0/2375293071 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febbc104890 0x7febbc104c90 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.070+0000 7febc4800640 1 -- 172.21.15.37:0/2375293071 >> 172.21.15.37:0/2375293071 conn(0x7febbc100170 msgr2=0x7febbc102590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.070+0000 7febc4800640 1 -- 172.21.15.37:0/2375293071 shutdown_connections 2024-08-20T05:18:53.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.071+0000 7febc4800640 1 -- 172.21.15.37:0/2375293071 wait complete. 2024-08-20T05:18:53.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.071+0000 7febc4800640 1 Processor -- start 2024-08-20T05:18:53.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.071+0000 7febc4800640 1 -- start start 2024-08-20T05:18:53.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.072+0000 7febc4800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febbc104890 0x7febbc19ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:53.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.072+0000 7febc4800640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febbc1059e0 0x7febbc19b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:53.075 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.072+0000 7febc4800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febbc1063a0 0x7febbc19bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.072+0000 7febc4800640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7febbc110550 con 0x7febbc104890 2024-08-20T05:18:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.072+0000 7febc4800640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7febbc1103d0 con 0x7febbc1059e0 2024-08-20T05:18:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.072+0000 7febc4800640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7febbc1106d0 con 0x7febbc1063a0 2024-08-20T05:18:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.072+0000 7febc1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febbc104890 0x7febbc19ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.072+0000 7febc2800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febbc1063a0 0x7febbc19bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.072+0000 7febc1e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febbc104890 0x7febbc19ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43478/0 (socket says 172.21.15.37:43478) 2024-08-20T05:18:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.072+0000 7febc1e00640 1 -- 172.21.15.37:0/1523369699 learned_addr learned my addr 172.21.15.37:0/1523369699 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.072+0000 7febc1400640 1 --2- 172.21.15.37:0/1523369699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febbc1059e0 0x7febbc19b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.072+0000 7febc2800640 1 -- 172.21.15.37:0/1523369699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febbc1059e0 msgr2=0x7febbc19b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.072+0000 7febc2800640 1 --2- 172.21.15.37:0/1523369699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febbc1059e0 0x7febbc19b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.073+0000 7febc2800640 1 -- 172.21.15.37:0/1523369699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febbc104890 msgr2=0x7febbc19ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.073+0000 7febc2800640 1 --2- 172.21.15.37:0/1523369699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febbc104890 0x7febbc19ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.073+0000 7febc2800640 1 -- 172.21.15.37:0/1523369699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febbc19c7b0 con 0x7febbc1063a0 2024-08-20T05:18:53.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.073+0000 7febc1e00640 1 --2- 172.21.15.37:0/1523369699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febbc104890 0x7febbc19ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.073+0000 7febc2800640 1 --2- 172.21.15.37:0/1523369699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febbc1063a0 0x7febbc19bef0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7febb8009fd0 tx=0x7febb800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.073+0000 7febb6a00640 1 -- 172.21.15.37:0/1523369699 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb800ce20 con 0x7febbc1063a0 2024-08-20T05:18:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.073+0000 7febb6a00640 1 -- 172.21.15.37:0/1523369699 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febb8005020 con 0x7febbc1063a0 2024-08-20T05:18:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.073+0000 7febc4800640 1 -- 172.21.15.37:0/1523369699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febbc19caa0 con 0x7febbc1063a0 2024-08-20T05:18:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.073+0000 7febb6a00640 1 -- 172.21.15.37:0/1523369699 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febb8010690 con 0x7febbc1063a0 2024-08-20T05:18:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.073+0000 7febc4800640 1 -- 172.21.15.37:0/1523369699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febbc1a3170 con 0x7febbc1063a0 2024-08-20T05:18:53.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.074+0000 7febc4800640 1 -- 172.21.15.37:0/1523369699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febbc10bba0 con 0x7febbc1063a0 2024-08-20T05:18:53.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.077+0000 7febb6a00640 1 -- 172.21.15.37:0/1523369699 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7febb80054d0 con 0x7febbc1063a0 2024-08-20T05:18:53.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.078+0000 7febb6a00640 1 --2- 172.21.15.37:0/1523369699 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feba40b3c50 0x7feba40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:53.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.078+0000 7febb6a00640 1 -- 172.21.15.37:0/1523369699 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7febb80e4b70 con 0x7febbc1063a0 2024-08-20T05:18:53.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.078+0000 7febc1e00640 1 --2- 172.21.15.37:0/1523369699 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feba40b3c50 0x7feba40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:53.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.079+0000 7febc1e00640 1 --2- 172.21.15.37:0/1523369699 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feba40b3c50 0x7feba40b6110 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7febb0000c00 tx=0x7febb0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:53.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.080+0000 7febb6a00640 1 -- 172.21.15.37:0/1523369699 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7febb80abdc0 con 0x7febbc1063a0 2024-08-20T05:18:53.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:52 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/682578131' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:18:53.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:52 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2570735953' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-08-20T05:18:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.276+0000 7febc4800640 1 -- 172.21.15.37:0/1523369699 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7febbc02e340 con 0x7febbc1063a0 2024-08-20T05:18:53.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.277+0000 7febb6a00640 1 -- 172.21.15.37:0/1523369699 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7febb80ab6c0 con 0x7febbc1063a0 2024-08-20T05:18:53.279 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2024-08-20T05:18:53.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.279+0000 7febc4800640 1 -- 172.21.15.37:0/1523369699 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feba40b3c50 msgr2=0x7feba40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:53.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.279+0000 7febc4800640 1 --2- 172.21.15.37:0/1523369699 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feba40b3c50 0x7feba40b6110 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7febb0000c00 tx=0x7febb0005a20 comp rx=0 tx=0).stop 2024-08-20T05:18:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.279+0000 7febc4800640 1 -- 172.21.15.37:0/1523369699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febbc1063a0 msgr2=0x7febbc19bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.279+0000 7febc4800640 1 --2- 172.21.15.37:0/1523369699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febbc1063a0 0x7febbc19bef0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7febb8009fd0 tx=0x7febb800ef10 comp rx=0 tx=0).stop 2024-08-20T05:18:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.279+0000 7febc4800640 1 -- 172.21.15.37:0/1523369699 shutdown_connections 2024-08-20T05:18:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.279+0000 7febc4800640 1 --2- 172.21.15.37:0/1523369699 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7feba40b3c50 0x7feba40b6110 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.279+0000 7febc4800640 1 --2- 172.21.15.37:0/1523369699 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7febbc1063a0 0x7febbc19bef0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.279+0000 7febc4800640 1 --2- 172.21.15.37:0/1523369699 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7febbc1059e0 0x7febbc19b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.279+0000 7febc4800640 1 --2- 172.21.15.37:0/1523369699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febbc104890 0x7febbc19ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.279+0000 7febc4800640 1 -- 172.21.15.37:0/1523369699 >> 172.21.15.37:0/1523369699 conn(0x7febbc100170 msgr2=0x7febbc108d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.280+0000 7febc4800640 1 -- 172.21.15.37:0/1523369699 shutdown_connections 2024-08-20T05:18:53.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.280+0000 7febc4800640 1 -- 172.21.15.37:0/1523369699 wait complete. 2024-08-20T05:18:53.298 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-08-20T05:18:53.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.458+0000 7eff49e00640 1 -- 172.21.15.37:0/2575539737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff44106380 msgr2=0x7eff4410cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:53.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.458+0000 7eff49e00640 1 --2- 172.21.15.37:0/2575539737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff44106380 0x7eff4410cd00 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7eff3c009cd0 tx=0x7eff3c02a8e0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.458+0000 7eff49e00640 1 -- 172.21.15.37:0/2575539737 shutdown_connections 2024-08-20T05:18:53.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.458+0000 7eff49e00640 1 --2- 172.21.15.37:0/2575539737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff44106380 0x7eff4410cd00 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.458+0000 7eff49e00640 1 --2- 172.21.15.37:0/2575539737 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff441059c0 0x7eff44105e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.458+0000 7eff49e00640 1 --2- 172.21.15.37:0/2575539737 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44104870 0x7eff44104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.458+0000 7eff49e00640 1 -- 172.21.15.37:0/2575539737 >> 172.21.15.37:0/2575539737 conn(0x7eff44100170 msgr2=0x7eff44102590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:53.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.458+0000 7eff49e00640 1 -- 172.21.15.37:0/2575539737 shutdown_connections 2024-08-20T05:18:53.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.458+0000 7eff49e00640 1 -- 172.21.15.37:0/2575539737 wait complete. 2024-08-20T05:18:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.459+0000 7eff49e00640 1 Processor -- start 2024-08-20T05:18:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.459+0000 7eff49e00640 1 -- start start 2024-08-20T05:18:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.459+0000 7eff49e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44104870 0x7eff4419ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.459+0000 7eff49e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff441059c0 0x7eff4419b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.459+0000 7eff49e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff44106380 0x7eff4419bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.459+0000 7eff49e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7eff44110530 con 0x7eff44106380 2024-08-20T05:18:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.459+0000 7eff49e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7eff441103b0 con 0x7eff441059c0 2024-08-20T05:18:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.459+0000 7eff49e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7eff441106b0 con 0x7eff44104870 2024-08-20T05:18:53.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.459+0000 7eff43400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff44106380 0x7eff4419bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.459+0000 7eff42a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44104870 0x7eff4419ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.460+0000 7eff42a00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44104870 0x7eff4419ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:34470/0 (socket says 172.21.15.37:34470) 2024-08-20T05:18:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.460+0000 7eff42a00640 1 -- 172.21.15.37:0/3200475631 learned_addr learned my addr 172.21.15.37:0/3200475631 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.460+0000 7eff3a000640 1 --2- 172.21.15.37:0/3200475631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff441059c0 0x7eff4419b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.460+0000 7eff42a00640 1 -- 172.21.15.37:0/3200475631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff441059c0 msgr2=0x7eff4419b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.460+0000 7eff42a00640 1 --2- 172.21.15.37:0/3200475631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff441059c0 0x7eff4419b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.460+0000 7eff42a00640 1 -- 172.21.15.37:0/3200475631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff44106380 msgr2=0x7eff4419bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.460+0000 7eff42a00640 1 --2- 172.21.15.37:0/3200475631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff44106380 0x7eff4419bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.460+0000 7eff42a00640 1 -- 172.21.15.37:0/3200475631 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4419c820 con 0x7eff44104870 2024-08-20T05:18:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.460+0000 7eff43400640 1 --2- 172.21.15.37:0/3200475631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff44106380 0x7eff4419bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:18:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.460+0000 7eff42a00640 1 --2- 172.21.15.37:0/3200475631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44104870 0x7eff4419ace0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7eff3400e9f0 tx=0x7eff3400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.460+0000 7eff48a00640 1 -- 172.21.15.37:0/3200475631 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff3400cd80 con 0x7eff44104870 2024-08-20T05:18:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.461+0000 7eff48a00640 1 -- 172.21.15.37:0/3200475631 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff340054d0 con 0x7eff44104870 2024-08-20T05:18:53.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.461+0000 7eff49e00640 1 -- 172.21.15.37:0/3200475631 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff4419cb10 con 0x7eff44104870 2024-08-20T05:18:53.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.461+0000 7eff48a00640 1 -- 172.21.15.37:0/3200475631 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff34010690 con 0x7eff44104870 2024-08-20T05:18:53.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.461+0000 7eff49e00640 1 -- 172.21.15.37:0/3200475631 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff441a31e0 con 0x7eff44104870 2024-08-20T05:18:53.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.462+0000 7eff49e00640 1 -- 172.21.15.37:0/3200475631 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff4410bb60 con 0x7eff44104870 2024-08-20T05:18:53.466 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.464+0000 7eff48a00640 1 -- 172.21.15.37:0/3200475631 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7eff34004e30 con 0x7eff44104870 2024-08-20T05:18:53.467 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.466+0000 7eff48a00640 1 --2- 172.21.15.37:0/3200475631 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff280b3bd0 0x7eff280b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:53.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.466+0000 7eff48a00640 1 -- 172.21.15.37:0/3200475631 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7eff340e4630 con 0x7eff44104870 2024-08-20T05:18:53.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.466+0000 7eff3a000640 1 --2- 172.21.15.37:0/3200475631 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff280b3bd0 0x7eff280b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:53.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.467+0000 7eff3a000640 1 --2- 172.21.15.37:0/3200475631 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff280b3bd0 0x7eff280b6090 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7eff2c009bd0 tx=0x7eff2c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:53.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.467+0000 7eff48a00640 1 -- 172.21.15.37:0/3200475631 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7eff34055e20 con 0x7eff44104870 2024-08-20T05:18:53.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.665+0000 7eff49e00640 1 -- 172.21.15.37:0/3200475631 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7eff44063a80 con 0x7eff44104870 2024-08-20T05:18:53.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.666+0000 7eff48a00640 1 -- 172.21.15.37:0/3200475631 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v88) ==== 103+0+11 (secure 0 0 0) 0x7eff340ab880 con 0x7eff44104870 2024-08-20T05:18:53.668 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-08-20T05:18:53.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.669+0000 7eff49e00640 1 -- 172.21.15.37:0/3200475631 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff280b3bd0 msgr2=0x7eff280b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:53.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.669+0000 7eff49e00640 1 --2- 172.21.15.37:0/3200475631 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff280b3bd0 0x7eff280b6090 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7eff2c009bd0 tx=0x7eff2c005f90 comp rx=0 tx=0).stop 2024-08-20T05:18:53.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.669+0000 7eff49e00640 1 -- 172.21.15.37:0/3200475631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44104870 msgr2=0x7eff4419ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:53.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.669+0000 7eff49e00640 1 --2- 172.21.15.37:0/3200475631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44104870 0x7eff4419ace0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7eff3400e9f0 tx=0x7eff3400edf0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.669+0000 7eff49e00640 1 -- 172.21.15.37:0/3200475631 shutdown_connections 2024-08-20T05:18:53.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.669+0000 7eff49e00640 1 --2- 172.21.15.37:0/3200475631 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7eff280b3bd0 0x7eff280b6090 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.669+0000 7eff49e00640 1 --2- 172.21.15.37:0/3200475631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff44106380 0x7eff4419bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.669+0000 7eff49e00640 1 --2- 172.21.15.37:0/3200475631 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7eff441059c0 0x7eff4419b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.669+0000 7eff49e00640 1 --2- 172.21.15.37:0/3200475631 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7eff44104870 0x7eff4419ace0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.669+0000 7eff49e00640 1 -- 172.21.15.37:0/3200475631 >> 172.21.15.37:0/3200475631 conn(0x7eff44100170 msgr2=0x7eff44108d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:53.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.669+0000 7eff49e00640 1 -- 172.21.15.37:0/3200475631 shutdown_connections 2024-08-20T05:18:53.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.669+0000 7eff49e00640 1 -- 172.21.15.37:0/3200475631 wait complete. 2024-08-20T05:18:53.687 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-08-20T05:18:53.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.844+0000 7f82f6000640 1 -- 172.21.15.37:0/584122890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82f010edb0 msgr2=0x7f82f01111a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:53.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.844+0000 7f82f6000640 1 --2- 172.21.15.37:0/584122890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82f010edb0 0x7f82f01111a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f82e8009ca0 tx=0x7f82e802a950 comp rx=0 tx=0).stop 2024-08-20T05:18:53.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.844+0000 7f82f6000640 1 -- 172.21.15.37:0/584122890 shutdown_connections 2024-08-20T05:18:53.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.844+0000 7f82f6000640 1 --2- 172.21.15.37:0/584122890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82f010edb0 0x7f82f01111a0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.844+0000 7f82f6000640 1 --2- 172.21.15.37:0/584122890 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f0075850 0x7f82f0075cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.844+0000 7f82f6000640 1 --2- 172.21.15.37:0/584122890 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82f0076dc0 0x7f82f0075310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.845+0000 7f82f6000640 1 -- 172.21.15.37:0/584122890 >> 172.21.15.37:0/584122890 conn(0x7f82f00fdf40 msgr2=0x7f82f0100380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:53.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.845+0000 7f82f6000640 1 -- 172.21.15.37:0/584122890 shutdown_connections 2024-08-20T05:18:53.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.845+0000 7f82f6000640 1 -- 172.21.15.37:0/584122890 wait complete. 2024-08-20T05:18:53.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.845+0000 7f82f6000640 1 Processor -- start 2024-08-20T05:18:53.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.846+0000 7f82f6000640 1 -- start start 2024-08-20T05:18:53.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.846+0000 7f82f6000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82f0075850 0x7f82f019f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:53.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.846+0000 7f82f6000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82f0076dc0 0x7f82f019f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:53.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.846+0000 7f82f6000640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f010edb0 0x7f82f01a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:53.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.846+0000 7f82f6000640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f82f0114a10 con 0x7f82f0076dc0 2024-08-20T05:18:53.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.846+0000 7f82f6000640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f82f0114890 con 0x7f82f0075850 2024-08-20T05:18:53.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.846+0000 7f82f6000640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f82f0114b90 con 0x7f82f010edb0 2024-08-20T05:18:53.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.846+0000 7f82eea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82f0076dc0 0x7f82f019f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:53.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.846+0000 7f82ef400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82f0075850 0x7f82f019f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:53.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.846+0000 7f82eea00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82f0076dc0 0x7f82f019f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43518/0 (socket says 172.21.15.37:43518) 2024-08-20T05:18:53.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.846+0000 7f82eea00640 1 -- 172.21.15.37:0/1502156345 learned_addr learned my addr 172.21.15.37:0/1502156345 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:18:53.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.846+0000 7f82efe00640 1 --2- 172.21.15.37:0/1502156345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f010edb0 0x7f82f01a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:53.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.847+0000 7f82eea00640 1 -- 172.21.15.37:0/1502156345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f010edb0 msgr2=0x7f82f01a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:53.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.847+0000 7f82eea00640 1 --2- 172.21.15.37:0/1502156345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f010edb0 0x7f82f01a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.847+0000 7f82eea00640 1 -- 172.21.15.37:0/1502156345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82f0075850 msgr2=0x7f82f019f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:53.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.847+0000 7f82eea00640 1 --2- 172.21.15.37:0/1502156345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82f0075850 0x7f82f019f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:53.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.847+0000 7f82eea00640 1 -- 172.21.15.37:0/1502156345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f01a0c40 con 0x7f82f0076dc0 2024-08-20T05:18:53.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.847+0000 7f82efe00640 1 --2- 172.21.15.37:0/1502156345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f010edb0 0x7f82f01a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-20T05:18:53.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.847+0000 7f82eea00640 1 --2- 172.21.15.37:0/1502156345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82f0076dc0 0x7f82f019f750 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00e9f0 tx=0x7f82dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:53.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.847+0000 7f82e7e00640 1 -- 172.21.15.37:0/1502156345 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc00cd80 con 0x7f82f0076dc0 2024-08-20T05:18:53.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.847+0000 7f82e7e00640 1 -- 172.21.15.37:0/1502156345 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82dc0054d0 con 0x7f82f0076dc0 2024-08-20T05:18:53.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.847+0000 7f82f6000640 1 -- 172.21.15.37:0/1502156345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f01a0f30 con 0x7f82f0076dc0 2024-08-20T05:18:53.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.847+0000 7f82e7e00640 1 -- 172.21.15.37:0/1502156345 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82dc010690 con 0x7f82f0076dc0 2024-08-20T05:18:53.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.847+0000 7f82f6000640 1 -- 172.21.15.37:0/1502156345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f01a7600 con 0x7f82f0076dc0 2024-08-20T05:18:53.852 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.848+0000 7f82f6000640 1 -- 172.21.15.37:0/1502156345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f0075cd0 con 0x7f82f0076dc0 2024-08-20T05:18:53.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.851+0000 7f82e7e00640 1 -- 172.21.15.37:0/1502156345 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f82dc004e30 con 0x7f82f0076dc0 2024-08-20T05:18:53.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.853+0000 7f82e7e00640 1 --2- 172.21.15.37:0/1502156345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f82d40b3c50 0x7f82d40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:18:53.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.853+0000 7f82e7e00640 1 -- 172.21.15.37:0/1502156345 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f82dc0e4630 con 0x7f82f0076dc0 2024-08-20T05:18:53.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.853+0000 7f82ef400640 1 --2- 172.21.15.37:0/1502156345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f82d40b3c50 0x7f82d40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:18:53.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.854+0000 7f82e7e00640 1 -- 172.21.15.37:0/1502156345 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f82dc055e20 con 0x7f82f0076dc0 2024-08-20T05:18:53.855 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:53.854+0000 7f82ef400640 1 --2- 172.21.15.37:0/1502156345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f82d40b3c50 0x7f82d40b6110 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009bd0 tx=0x7f82e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:18:53.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:53 smithi130 ceph-mon[22007]: pgmap v900: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-08-20T05:18:53.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:53 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2488481176' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T05:18:53.956 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:53 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1523369699' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T05:18:54.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:53 smithi037 ceph-mon[17265]: pgmap v900: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-08-20T05:18:54.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:53 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2488481176' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T05:18:54.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:53 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1523369699' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T05:18:54.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:54.104+0000 7f82f6000640 1 -- 172.21.15.37:0/1502156345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f82f0104f80 con 0x7f82f0076dc0 2024-08-20T05:18:54.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:53 smithi135 ceph-mon[22342]: pgmap v900: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-08-20T05:18:54.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:53 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2488481176' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-08-20T05:18:54.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:53 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1523369699' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-08-20T05:18:54.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:54.115+0000 7f82e7e00640 1 -- 172.21.15.37:0/1502156345 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+821375 (secure 0 0 0) 0x7f82f0104f80 con 0x7f82f0076dc0 2024-08-20T05:18:54.128 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:18:54.128 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:18:54.128 INFO:teuthology.orchestra.run.smithi037.stdout: "epoch": 18, 2024-08-20T05:18:54.128 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.128 INFO:teuthology.orchestra.run.smithi037.stdout: "active_gid": 14150, 2024-08-20T05:18:54.128 INFO:teuthology.orchestra.run.smithi037.stdout: "active_name": "x", 2024-08-20T05:18:54.128 INFO:teuthology.orchestra.run.smithi037.stdout: "active_addrs": { 2024-08-20T05:18:54.128 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-08-20T05:18:54.128 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.128 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-08-20T05:18:54.128 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:6800", 2024-08-20T05:18:54.129 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 839402922 2024-08-20T05:18:54.129 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.129 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.129 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-08-20T05:18:54.129 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:6801", 2024-08-20T05:18:54.129 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 839402922 2024-08-20T05:18:54.129 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.129 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-20T05:18:54.129 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.129 INFO:teuthology.orchestra.run.smithi037.stdout: "active_addr": "172.21.15.37:6801/839402922", 2024-08-20T05:18:54.129 INFO:teuthology.orchestra.run.smithi037.stdout: "active_change": "2024-08-20T04:51:27.878054+0000", 2024-08-20T05:18:54.129 INFO:teuthology.orchestra.run.smithi037.stdout: "active_mgr_features": 4540701547738038271, 2024-08-20T05:18:54.129 INFO:teuthology.orchestra.run.smithi037.stdout: "available": true, 2024-08-20T05:18:54.129 INFO:teuthology.orchestra.run.smithi037.stdout: "standbys": [ 2024-08-20T05:18:54.130 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.130 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 24163, 2024-08-20T05:18:54.130 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "z", 2024-08-20T05:18:54.130 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_features": 4540701547738038271, 2024-08-20T05:18:54.130 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-08-20T05:18:54.130 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.130 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-08-20T05:18:54.130 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.130 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.130 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.130 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-20T05:18:54.130 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-20T05:18:54.130 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.130 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.131 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.131 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-20T05:18:54.131 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.131 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.131 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.131 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-08-20T05:18:54.131 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.131 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.131 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.136 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.136 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.136 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.136 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.136 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.136 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.136 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.136 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.136 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.136 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.136 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.136 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.136 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.136 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.137 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.137 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.137 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-08-20T05:18:54.137 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-08-20T05:18:54.137 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.137 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.137 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.137 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.137 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.137 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.137 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.137 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to", 2024-08-20T05:18:54.137 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.137 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.138 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.138 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.138 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-08-20T05:18:54.138 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-08-20T05:18:54.138 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.138 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.138 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.138 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-08-20T05:18:54.138 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.138 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.138 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.138 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-08-20T05:18:54.138 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.138 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.138 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.139 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.139 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-08-20T05:18:54.139 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-08-20T05:18:54.139 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.139 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.139 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.139 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.139 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.139 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.139 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.139 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-08-20T05:18:54.139 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.139 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.139 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.140 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.140 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-08-20T05:18:54.140 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-08-20T05:18:54.140 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.140 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.140 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.140 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.140 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.140 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.140 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.140 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-08-20T05:18:54.140 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.140 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.140 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.141 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.141 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-08-20T05:18:54.141 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-08-20T05:18:54.141 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.141 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.141 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.141 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-08-20T05:18:54.141 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.141 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.141 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.141 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-08-20T05:18:54.141 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.141 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.141 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.142 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.142 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-08-20T05:18:54.142 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-08-20T05:18:54.142 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.142 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.142 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.142 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.142 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.142 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.142 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.142 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-08-20T05:18:54.142 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.142 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.143 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.143 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.143 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-08-20T05:18:54.143 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-08-20T05:18:54.143 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.143 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.143 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.143 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.143 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.143 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.143 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.143 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-20T05:18:54.143 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.144 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.144 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.144 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.144 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-08-20T05:18:54.144 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-08-20T05:18:54.144 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.144 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.144 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.144 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.144 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.144 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.144 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.144 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-08-20T05:18:54.145 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.145 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.145 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.145 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.145 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.145 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.145 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.145 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.145 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.145 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.145 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.145 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.145 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.146 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.146 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.146 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.146 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.146 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.146 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.146 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.146 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.146 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-08-20T05:18:54.146 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.146 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.147 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.147 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-08-20T05:18:54.147 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-08-20T05:18:54.147 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.147 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.147 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.147 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.147 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.147 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.147 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.147 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-08-20T05:18:54.147 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.147 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.147 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.147 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.148 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-08-20T05:18:54.148 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-08-20T05:18:54.148 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.148 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.148 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.148 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-08-20T05:18:54.148 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.148 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.148 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.148 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-08-20T05:18:54.148 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T05:18:54.148 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.148 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.148 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.149 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-08-20T05:18:54.149 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-08-20T05:18:54.149 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-20T05:18:54.149 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.149 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.149 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.149 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-08-20T05:18:54.149 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-08-20T05:18:54.149 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.149 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-20T05:18:54.149 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T05:18:54.149 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.149 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.149 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.149 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-08-20T05:18:54.149 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-08-20T05:18:54.150 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-20T05:18:54.150 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.150 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.150 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-08-20T05:18:54.150 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-20T05:18:54.150 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-08-20T05:18:54.150 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.150 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-20T05:18:54.150 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.150 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.150 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.150 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.150 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-08-20T05:18:54.151 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-08-20T05:18:54.151 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.151 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.151 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.151 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-08-20T05:18:54.151 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.151 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.151 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.151 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-20T05:18:54.151 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-20T05:18:54.151 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.151 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.152 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.152 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-08-20T05:18:54.152 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-08-20T05:18:54.152 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:54.152 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.152 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.152 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-08-20T05:18:54.152 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-08-20T05:18:54.152 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-08-20T05:18:54.152 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.152 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-08-20T05:18:54.152 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-20T05:18:54.152 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.152 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.153 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.153 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-08-20T05:18:54.153 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-08-20T05:18:54.153 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.153 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.153 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.153 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-08-20T05:18:54.153 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.153 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.153 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.153 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-08-20T05:18:54.153 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T05:18:54.154 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.154 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.154 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.154 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-08-20T05:18:54.154 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-08-20T05:18:54.154 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-20T05:18:54.154 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.154 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.154 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.154 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-08-20T05:18:54.154 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-08-20T05:18:54.154 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.154 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-20T05:18:54.155 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T05:18:54.155 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.155 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.155 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.155 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.155 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.155 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.155 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.155 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.155 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.155 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.155 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.155 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.155 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.156 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.156 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.156 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.156 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.156 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.156 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.156 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.156 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.156 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.156 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.156 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.156 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.156 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.156 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.157 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.157 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.157 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.157 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.157 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.157 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.157 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.157 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.157 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.157 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.157 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.157 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.157 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.157 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.158 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.158 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.158 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.158 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.158 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.158 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.158 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.158 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.158 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.158 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.158 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.159 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.159 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.159 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.159 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.159 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.159 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.159 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.159 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.159 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.159 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.159 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.159 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.159 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.159 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.160 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.160 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.160 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.160 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.160 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.160 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.160 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.160 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-08-20T05:18:54.160 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-08-20T05:18:54.160 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:54.160 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.160 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.160 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.161 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.161 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.161 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.161 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-20T05:18:54.161 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.161 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.161 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.161 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.161 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-08-20T05:18:54.161 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-08-20T05:18:54.161 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.161 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.161 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.161 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-08-20T05:18:54.162 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.162 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.162 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.162 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-08-20T05:18:54.162 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-08-20T05:18:54.162 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-08-20T05:18:54.162 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-08-20T05:18:54.162 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-08-20T05:18:54.162 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.162 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-08-20T05:18:54.162 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.162 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.162 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.162 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.162 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-08-20T05:18:54.163 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-08-20T05:18:54.163 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.163 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.163 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.163 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.163 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.163 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.163 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.163 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-20T05:18:54.163 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.163 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.163 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.163 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.164 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-20T05:18:54.164 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-20T05:18:54.164 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.164 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.164 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.164 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-20T05:18:54.164 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.164 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.164 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.164 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-20T05:18:54.164 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.164 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.164 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.164 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.164 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.165 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.165 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.165 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.165 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.165 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.165 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.165 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.165 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.165 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.165 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.165 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.165 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.165 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.165 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-08-20T05:18:54.165 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-08-20T05:18:54.166 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.166 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.166 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.166 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-20T05:18:54.166 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-20T05:18:54.166 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.166 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.166 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-20T05:18:54.166 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-20T05:18:54.166 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.166 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.166 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.166 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-08-20T05:18:54.166 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-08-20T05:18:54.167 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-20T05:18:54.167 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.167 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.167 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:54.167 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.167 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.167 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.167 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-20T05:18:54.167 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.167 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.167 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.167 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.167 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.168 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.168 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.168 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-08-20T05:18:54.168 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.168 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.168 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.168 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-08-20T05:18:54.168 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-08-20T05:18:54.168 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:54.168 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.168 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.168 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-08-20T05:18:54.168 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.168 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.169 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.169 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-20T05:18:54.169 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.169 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.169 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.169 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.169 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-08-20T05:18:54.169 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-08-20T05:18:54.169 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.169 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.169 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.169 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-08-20T05:18:54.169 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.170 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.170 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.170 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-20T05:18:54.170 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.170 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.170 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.170 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.170 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-08-20T05:18:54.170 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-08-20T05:18:54.170 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.170 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.170 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.170 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-08-20T05:18:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-20T05:18:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-08-20T05:18:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-08-20T05:18:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.171 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-20T05:18:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-20T05:18:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-08-20T05:18:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-08-20T05:18:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-20T05:18:54.172 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.173 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.173 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.173 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-20T05:18:54.173 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.173 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.173 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.173 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.173 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-08-20T05:18:54.173 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-08-20T05:18:54.173 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:54.173 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.173 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.173 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-08-20T05:18:54.173 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.174 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.174 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.174 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-20T05:18:54.174 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.174 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.174 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.174 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.174 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-08-20T05:18:54.174 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-08-20T05:18:54.174 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.174 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.174 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.174 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.174 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.175 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.175 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.175 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-08-20T05:18:54.175 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-08-20T05:18:54.175 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-08-20T05:18:54.175 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.175 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-20T05:18:54.175 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.175 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.175 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.175 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.175 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-08-20T05:18:54.175 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-08-20T05:18:54.175 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.176 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.176 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.176 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.176 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.176 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.176 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.176 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-20T05:18:54.176 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.176 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.176 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.176 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.176 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-08-20T05:18:54.176 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-08-20T05:18:54.176 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.176 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.176 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.177 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.177 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.177 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.177 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.177 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-20T05:18:54.177 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.177 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.177 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.177 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.177 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-08-20T05:18:54.177 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-08-20T05:18:54.177 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.177 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.177 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.177 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.178 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.178 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.178 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.178 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-20T05:18:54.178 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.178 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.178 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.178 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.178 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-08-20T05:18:54.178 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-08-20T05:18:54.178 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.178 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.178 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.178 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-20T05:18:54.178 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.179 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.179 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.179 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-20T05:18:54.179 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.179 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.179 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.179 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.179 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-08-20T05:18:54.179 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-08-20T05:18:54.179 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.179 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.179 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.179 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-20T05:18:54.179 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.179 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.180 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.180 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-08-20T05:18:54.180 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.180 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.180 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.180 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.180 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-08-20T05:18:54.180 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-08-20T05:18:54.180 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.180 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.180 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.180 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-20T05:18:54.180 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.180 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.180 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.181 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-08-20T05:18:54.181 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.181 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.181 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.181 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.181 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-08-20T05:18:54.181 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-08-20T05:18:54.181 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.181 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.181 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.181 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-20T05:18:54.181 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.181 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.182 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.182 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-20T05:18:54.182 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.182 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.182 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.182 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.182 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-08-20T05:18:54.182 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-08-20T05:18:54.182 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.182 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.182 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.182 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-20T05:18:54.182 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.182 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.183 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.183 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-08-20T05:18:54.183 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.183 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.183 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.183 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.183 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-08-20T05:18:54.183 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-08-20T05:18:54.183 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.183 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.183 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.183 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-20T05:18:54.183 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.183 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.184 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.184 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-08-20T05:18:54.184 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.184 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.184 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.184 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.184 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-08-20T05:18:54.184 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-08-20T05:18:54.184 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.184 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.184 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.184 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-20T05:18:54.184 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.184 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.184 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.185 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-08-20T05:18:54.185 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.185 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.185 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.185 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.185 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-08-20T05:18:54.185 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-08-20T05:18:54.185 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.185 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.185 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.185 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-20T05:18:54.185 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.185 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.185 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.185 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-08-20T05:18:54.186 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.186 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.186 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.186 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.186 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-08-20T05:18:54.186 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-08-20T05:18:54.186 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.186 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.186 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.186 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-20T05:18:54.186 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.186 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.186 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.186 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-08-20T05:18:54.187 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.187 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.187 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.187 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.187 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-08-20T05:18:54.187 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-08-20T05:18:54.187 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.187 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.187 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.187 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-20T05:18:54.187 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.187 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.187 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.187 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-08-20T05:18:54.188 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.188 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.188 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.188 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.188 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nginx": { 2024-08-20T05:18:54.188 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nginx", 2024-08-20T05:18:54.188 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.188 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.188 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.188 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-20T05:18:54.188 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.188 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.188 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.188 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nginx container image", 2024-08-20T05:18:54.188 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.189 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.189 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.189 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.189 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-08-20T05:18:54.189 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-08-20T05:18:54.189 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.189 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.189 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.189 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-20T05:18:54.189 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.189 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.189 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.189 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-20T05:18:54.189 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.189 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.189 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.190 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.190 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-08-20T05:18:54.190 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-08-20T05:18:54.190 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.190 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.190 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.190 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-20T05:18:54.190 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.190 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.190 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.190 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-08-20T05:18:54.190 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.190 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.190 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.190 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.191 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-08-20T05:18:54.191 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-08-20T05:18:54.191 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.191 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.191 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.191 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-20T05:18:54.191 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.191 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.191 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.191 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-20T05:18:54.191 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.193 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.193 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.194 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.194 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-08-20T05:18:54.194 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-08-20T05:18:54.194 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.194 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.194 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.194 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-20T05:18:54.194 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.194 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.194 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.194 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-08-20T05:18:54.194 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.195 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.195 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.195 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.195 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-08-20T05:18:54.195 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-08-20T05:18:54.195 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.195 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.195 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.195 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-20T05:18:54.195 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.195 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.195 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.195 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-08-20T05:18:54.195 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.196 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.196 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.196 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.196 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-08-20T05:18:54.196 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-08-20T05:18:54.196 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.196 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.196 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.196 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-20T05:18:54.196 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.196 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.197 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.197 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-08-20T05:18:54.197 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.197 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.197 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.197 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.197 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-08-20T05:18:54.197 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-08-20T05:18:54.197 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.197 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.197 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.197 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.198 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.198 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.198 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.198 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-08-20T05:18:54.198 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.198 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.198 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.198 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.198 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-08-20T05:18:54.198 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-08-20T05:18:54.198 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.198 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.198 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.199 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-20T05:18:54.199 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.199 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.199 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.199 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-20T05:18:54.199 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.199 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.199 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.199 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.199 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-08-20T05:18:54.199 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-08-20T05:18:54.199 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.199 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.199 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.199 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-08-20T05:18:54.200 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.200 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.200 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.200 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-20T05:18:54.200 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.200 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.200 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.200 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.200 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-08-20T05:18:54.200 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-08-20T05:18:54.200 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.200 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.200 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.200 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-08-20T05:18:54.201 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.201 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.201 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.201 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-20T05:18:54.201 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.201 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.201 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.201 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.201 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-08-20T05:18:54.201 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-08-20T05:18:54.201 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.201 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.201 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.201 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-08-20T05:18:54.201 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.202 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.202 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.202 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-08-20T05:18:54.202 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.202 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.202 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.202 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.202 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-08-20T05:18:54.202 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-08-20T05:18:54.202 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.202 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.202 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.202 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.202 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.202 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-20T05:18:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-08-20T05:18:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-08-20T05:18:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-20T05:18:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.204 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-08-20T05:18:54.204 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.204 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.204 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.204 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.204 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-08-20T05:18:54.204 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-08-20T05:18:54.204 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.204 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.204 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.204 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-20T05:18:54.204 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.204 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.204 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.205 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-20T05:18:54.205 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.205 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.205 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.205 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.205 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-08-20T05:18:54.205 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-08-20T05:18:54.205 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.205 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.205 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.205 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-20T05:18:54.205 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.205 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.205 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.205 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-08-20T05:18:54.205 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.206 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.206 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.206 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.206 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-08-20T05:18:54.206 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-08-20T05:18:54.206 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.206 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.206 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.206 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.206 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.206 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.206 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.206 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-20T05:18:54.206 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.207 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.207 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.207 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.207 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-08-20T05:18:54.207 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-08-20T05:18:54.207 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.207 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.207 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.207 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.207 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.207 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.207 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.207 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-20T05:18:54.207 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.208 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.208 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.208 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.208 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.208 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.208 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.208 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.208 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.208 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.208 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.208 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.208 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.208 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.208 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.208 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.209 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.209 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.209 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.209 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.209 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.209 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.209 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.209 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.209 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.209 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-08-20T05:18:54.209 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-08-20T05:18:54.209 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.209 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.209 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.209 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.210 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.210 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.210 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.210 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-20T05:18:54.210 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.210 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.210 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.210 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.210 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.210 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.210 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.210 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.210 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.210 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.211 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.211 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.211 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.211 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-20T05:18:54.211 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.211 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.211 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.211 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.211 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.211 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.211 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.211 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.211 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.211 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.211 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.212 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.212 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.212 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.212 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.212 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.212 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.212 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.212 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.212 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.212 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.212 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.212 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.212 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.212 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.212 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.213 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.213 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.213 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.213 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.213 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.213 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.213 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.213 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.213 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.213 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.213 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.213 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.213 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.213 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-20T05:18:54.213 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-20T05:18:54.214 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.214 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.214 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.214 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.214 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.214 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.214 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.214 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-20T05:18:54.214 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.214 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.214 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.214 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.214 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-20T05:18:54.214 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-20T05:18:54.214 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.215 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.215 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.215 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-08-20T05:18:54.215 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.215 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.215 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.215 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-20T05:18:54.215 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.215 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.215 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.215 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.215 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-08-20T05:18:54.215 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-08-20T05:18:54.215 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.216 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.216 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.216 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:54.216 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.216 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.216 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.216 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-08-20T05:18:54.216 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.216 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.216 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.216 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.216 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-08-20T05:18:54.216 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-08-20T05:18:54.216 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.216 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.217 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.217 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:54.217 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.217 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.217 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.217 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-20T05:18:54.217 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.217 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.217 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.217 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.217 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-08-20T05:18:54.217 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-08-20T05:18:54.217 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.217 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.217 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.218 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.218 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.218 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.218 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.218 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-08-20T05:18:54.218 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.218 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.218 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.218 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.218 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-08-20T05:18:54.218 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-08-20T05:18:54.218 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.218 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.218 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.219 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-08-20T05:18:54.219 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.219 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.219 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.219 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-08-20T05:18:54.219 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-08-20T05:18:54.219 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.219 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-08-20T05:18:54.219 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.219 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.219 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.219 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.220 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-08-20T05:18:54.220 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-08-20T05:18:54.220 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.220 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.220 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.220 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-08-20T05:18:54.220 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.220 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.220 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.220 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-20T05:18:54.220 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.220 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.220 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.220 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.220 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-08-20T05:18:54.221 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-08-20T05:18:54.221 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.221 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.221 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.221 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-20T05:18:54.221 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.221 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.221 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.221 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-20T05:18:54.221 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.221 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.221 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.221 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.221 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-08-20T05:18:54.222 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-08-20T05:18:54.222 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.222 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.222 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.222 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.222 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.222 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.222 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.222 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-20T05:18:54.222 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.222 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.222 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.222 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.222 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-08-20T05:18:54.223 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-08-20T05:18:54.223 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.223 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.223 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.223 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.223 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.223 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.223 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.223 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-20T05:18:54.223 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.223 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.223 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.223 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.223 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-08-20T05:18:54.223 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-08-20T05:18:54.224 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.224 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.224 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.224 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.224 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.224 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.224 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.224 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-20T05:18:54.224 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.224 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.224 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.224 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.224 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-08-20T05:18:54.224 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-08-20T05:18:54.224 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.225 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.225 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.225 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.225 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.225 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.225 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.225 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-20T05:18:54.225 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.225 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.225 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.225 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.225 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-08-20T05:18:54.225 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-08-20T05:18:54.225 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.226 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.226 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.226 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.226 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.226 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.226 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.226 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-20T05:18:54.226 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.226 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.226 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.226 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.226 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-08-20T05:18:54.226 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-08-20T05:18:54.226 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.227 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.227 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.227 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-08-20T05:18:54.227 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.227 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.227 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.227 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-08-20T05:18:54.227 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.227 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.227 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.227 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.227 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.227 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.227 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.227 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.228 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.228 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.228 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.228 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.228 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.228 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.228 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.228 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.228 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.228 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.228 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-08-20T05:18:54.228 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-08-20T05:18:54.228 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.228 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-20T05:18:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-08-20T05:18:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-08-20T05:18:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.229 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-20T05:18:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-08-20T05:18:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-08-20T05:18:54.230 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-20T05:18:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.231 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-08-20T05:18:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-08-20T05:18:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-08-20T05:18:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.232 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-08-20T05:18:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-08-20T05:18:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-20T05:18:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.233 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-08-20T05:18:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-08-20T05:18:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-20T05:18:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.234 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-08-20T05:18:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.235 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.236 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.237 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.237 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.237 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.237 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.237 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.237 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.237 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.237 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.237 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.237 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.237 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.237 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.237 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.238 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.239 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-08-20T05:18:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-08-20T05:18:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-08-20T05:18:54.240 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-20T05:18:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.241 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-08-20T05:18:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-08-20T05:18:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-08-20T05:18:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.242 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-20T05:18:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-08-20T05:18:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.243 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-20T05:18:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-20T05:18:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.244 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-08-20T05:18:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-20T05:18:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.245 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-20T05:18:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-20T05:18:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.246 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-08-20T05:18:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-08-20T05:18:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.247 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.248 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.248 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.248 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.248 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-20T05:18:54.248 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-20T05:18:54.248 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.248 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.248 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.248 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.248 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.248 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.248 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.248 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.248 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.249 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.249 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.249 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.249 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-08-20T05:18:54.249 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-20T05:18:54.249 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.249 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.249 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.249 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.249 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.249 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.249 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.249 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.249 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.250 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.250 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.250 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.250 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-20T05:18:54.250 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-20T05:18:54.250 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.250 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.250 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.250 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.250 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.250 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.250 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.250 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.250 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.250 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-20T05:18:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-20T05:18:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.251 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-20T05:18:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-20T05:18:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.252 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-20T05:18:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-20T05:18:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.253 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-20T05:18:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-20T05:18:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.254 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-20T05:18:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-20T05:18:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.255 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-20T05:18:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-20T05:18:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.256 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-20T05:18:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-20T05:18:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.257 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-08-20T05:18:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-20T05:18:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-20T05:18:54.258 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-20T05:18:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-20T05:18:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.259 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.260 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.260 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.260 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.260 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.260 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.260 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.260 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.260 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.260 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-08-20T05:18:54.260 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-08-20T05:18:54.260 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.260 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.260 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.261 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.261 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.261 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.261 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.261 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.261 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.261 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.261 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.261 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.261 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-08-20T05:18:54.261 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-20T05:18:54.261 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.261 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.261 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.262 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-20T05:18:54.262 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.262 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.262 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.262 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.262 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.262 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.262 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.262 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.262 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-20T05:18:54.262 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-20T05:18:54.262 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.263 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.263 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.263 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.263 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.263 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.263 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.263 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.263 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.263 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.263 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.263 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.263 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-20T05:18:54.264 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-20T05:18:54.264 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.264 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.264 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.264 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.264 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.264 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.264 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.264 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.264 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.264 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.264 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.264 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.264 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-20T05:18:54.264 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-20T05:18:54.265 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.265 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.265 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.265 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.265 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.265 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.265 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.265 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.265 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.265 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.265 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.265 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.265 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-20T05:18:54.265 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-20T05:18:54.266 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.266 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.266 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.266 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.266 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.266 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.266 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.266 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.266 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.266 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.266 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.266 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.266 INFO:teuthology.orchestra.run.smithi037.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-20T05:18:54.266 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-20T05:18:54.266 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.267 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.267 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.267 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "[]", 2024-08-20T05:18:54.267 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.267 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.267 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.267 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.267 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.267 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.267 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.267 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.267 INFO:teuthology.orchestra.run.smithi037.stdout: "MULTICLUSTER_CONFIG": { 2024-08-20T05:18:54.267 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-20T05:18:54.267 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.268 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.268 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.268 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "{}", 2024-08-20T05:18:54.268 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.268 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.268 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.268 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.268 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.268 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.268 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.268 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.268 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-08-20T05:18:54.268 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-20T05:18:54.269 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.269 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.269 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.269 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.269 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.269 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.269 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.269 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.269 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.269 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.269 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.269 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.269 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-20T05:18:54.269 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-20T05:18:54.270 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.270 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.270 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.270 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.270 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.270 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.270 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.270 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.270 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.270 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.270 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.270 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.270 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-20T05:18:54.271 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-20T05:18:54.271 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.271 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.271 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.271 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.271 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.271 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.271 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.271 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.271 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.271 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.271 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.271 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.271 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-20T05:18:54.272 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-20T05:18:54.272 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.272 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.272 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.272 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.272 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.272 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.272 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.272 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.272 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.272 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.273 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.273 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.273 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-20T05:18:54.273 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-20T05:18:54.273 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.273 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.273 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.273 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.273 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.273 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.273 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.273 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.273 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.273 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.274 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.274 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.274 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-20T05:18:54.274 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-20T05:18:54.274 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.274 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.274 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.274 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.274 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.274 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.274 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.274 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.274 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.275 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.275 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.275 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.275 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-20T05:18:54.275 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-20T05:18:54.275 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.275 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.275 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.275 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.275 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.275 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.275 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.275 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.275 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.276 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.276 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.276 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.276 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-20T05:18:54.276 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-20T05:18:54.276 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.276 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.276 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.276 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.276 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.276 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.276 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.276 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.276 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.277 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.277 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.277 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.277 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-20T05:18:54.277 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-20T05:18:54.277 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.277 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.277 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.277 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.277 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.277 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.277 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.277 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.277 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.278 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.278 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.278 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.278 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-08-20T05:18:54.278 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-20T05:18:54.278 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.278 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.278 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.278 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.278 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.279 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.279 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.279 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.279 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.279 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.279 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.279 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.279 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-20T05:18:54.279 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-20T05:18:54.279 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.279 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.279 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.279 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-20T05:18:54.279 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.280 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.280 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.280 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.280 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.280 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.280 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.280 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.280 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-20T05:18:54.280 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-20T05:18:54.280 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.280 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.280 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.280 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:54.281 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.281 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.281 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.281 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.281 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.281 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.281 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.281 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.281 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-20T05:18:54.281 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-20T05:18:54.281 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.281 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.281 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.281 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-08-20T05:18:54.281 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.282 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.282 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.282 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.282 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.282 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.282 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.282 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.282 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-20T05:18:54.282 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-20T05:18:54.282 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.282 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.282 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.282 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-08-20T05:18:54.283 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.283 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.283 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.283 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.283 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.283 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.283 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.283 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.283 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-08-20T05:18:54.283 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-20T05:18:54.283 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.283 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.283 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.283 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.284 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.284 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.284 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.284 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.284 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.284 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.284 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.284 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.284 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-20T05:18:54.284 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-20T05:18:54.284 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.284 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.284 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.285 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-20T05:18:54.285 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.285 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.285 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.285 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.285 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.285 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.285 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.285 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.285 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-08-20T05:18:54.285 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-20T05:18:54.285 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.285 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.285 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.286 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.286 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.286 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.286 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.286 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.286 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.286 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.286 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.286 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.286 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-08-20T05:18:54.286 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-20T05:18:54.286 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.286 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.287 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.287 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.287 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.287 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.287 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.287 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.287 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.287 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.287 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.287 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.287 INFO:teuthology.orchestra.run.smithi037.stdout: "UNSAFE_TLS_v1_2": { 2024-08-20T05:18:54.287 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-20T05:18:54.287 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.287 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.288 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.288 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.288 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.288 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.288 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.288 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.288 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.288 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.288 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.288 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.288 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-20T05:18:54.288 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-20T05:18:54.288 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.288 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.289 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.289 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.289 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.289 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.289 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.289 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.289 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.289 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.289 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.289 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.289 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-20T05:18:54.289 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-20T05:18:54.289 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.289 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.290 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.290 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:54.290 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.290 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.290 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.290 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.290 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.290 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.290 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.290 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.290 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-20T05:18:54.290 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-20T05:18:54.290 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.290 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.291 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.291 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-20T05:18:54.291 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.291 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.291 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.291 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.291 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.291 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.291 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.291 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.291 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-08-20T05:18:54.291 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-08-20T05:18:54.291 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.292 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.292 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.292 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.292 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.292 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.292 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.292 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.292 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.292 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.292 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.292 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.292 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-08-20T05:18:54.292 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-08-20T05:18:54.292 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.292 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.293 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.293 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.293 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.293 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.293 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.293 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.293 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.293 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.293 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.293 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.293 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-08-20T05:18:54.293 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-08-20T05:18:54.293 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.293 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.294 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.294 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.294 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.294 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.294 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.294 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-08-20T05:18:54.294 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.294 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.294 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.294 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.294 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-08-20T05:18:54.294 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-08-20T05:18:54.294 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-08-20T05:18:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-08-20T05:18:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-08-20T05:18:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.295 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.296 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.296 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.296 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.296 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.296 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.296 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.296 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.296 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.296 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.296 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.296 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.296 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.296 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.296 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.296 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.297 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.297 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.297 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.297 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.297 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.297 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.297 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.297 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.297 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.297 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.297 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.297 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.298 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.298 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.298 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.298 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.298 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.298 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.298 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.298 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.298 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.298 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.298 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.298 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.298 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.299 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.299 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.299 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.299 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.299 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.299 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.299 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.299 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.299 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.299 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.299 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.299 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.299 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.299 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.299 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.300 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.300 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.300 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.300 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.300 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.300 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.300 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.300 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.300 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.300 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.300 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.300 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.300 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.300 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.300 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.301 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.301 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.301 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.301 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.301 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.301 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.301 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.301 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.301 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.301 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-08-20T05:18:54.301 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-08-20T05:18:54.301 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.301 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.301 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.302 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.302 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.302 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.302 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.302 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-08-20T05:18:54.302 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.302 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.302 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.302 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.302 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-08-20T05:18:54.302 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-08-20T05:18:54.302 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.302 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.302 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.302 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.303 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.303 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.303 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.303 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.303 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.303 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.303 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.303 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.303 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-20T05:18:54.303 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-20T05:18:54.303 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.303 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.303 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.304 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-08-20T05:18:54.304 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.304 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.304 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.304 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.304 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.304 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.304 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.304 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.304 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-20T05:18:54.304 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-20T05:18:54.304 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.304 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.304 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.304 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-08-20T05:18:54.305 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.305 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.305 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.305 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.305 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.305 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.305 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.305 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.305 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.305 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.305 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.305 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.305 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.305 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.305 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.306 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.306 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.306 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.306 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.306 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.306 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.306 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.306 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-08-20T05:18:54.306 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-08-20T05:18:54.306 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.306 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.306 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.306 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.306 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.306 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.307 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.307 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.307 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.307 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.307 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.307 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.307 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-08-20T05:18:54.307 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-08-20T05:18:54.307 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.307 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.307 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.307 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-08-20T05:18:54.307 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.307 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.307 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.308 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.308 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.308 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.308 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.308 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.308 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-08-20T05:18:54.308 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-08-20T05:18:54.308 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.308 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.308 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.308 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-08-20T05:18:54.308 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.308 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.308 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.308 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.309 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-08-20T05:18:54.309 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.309 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.309 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.309 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.309 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.309 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.309 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-08-20T05:18:54.309 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-08-20T05:18:54.309 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.309 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.309 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.310 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-08-20T05:18:54.310 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-08-20T05:18:54.310 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-08-20T05:18:54.310 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.310 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.310 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.310 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.310 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.310 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.310 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-08-20T05:18:54.310 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-08-20T05:18:54.310 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.310 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.310 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.310 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.310 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.311 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.311 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.311 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.311 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.311 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.311 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.311 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.311 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.311 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.311 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.311 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-08-20T05:18:54.311 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.311 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.311 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.312 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-08-20T05:18:54.312 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-08-20T05:18:54.312 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.312 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.312 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.312 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.312 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.312 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.312 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.312 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-08-20T05:18:54.312 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.312 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.312 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.312 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.313 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.313 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.313 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.313 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.313 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.313 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.313 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.313 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.313 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.313 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.313 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.313 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.313 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.314 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.314 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.314 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.314 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.314 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.314 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.314 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.314 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.314 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.314 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.314 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.314 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.314 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.315 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.315 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.315 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.315 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.315 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.315 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.315 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.315 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.315 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.315 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.315 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.315 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.315 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.315 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.316 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.316 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.316 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.316 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.316 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.316 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.316 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.316 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.316 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.316 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.316 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.316 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.316 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.316 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.317 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.317 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.317 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.317 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.317 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.317 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.317 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.317 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.317 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.317 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.317 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.317 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.317 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.317 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.318 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.318 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.318 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-08-20T05:18:54.318 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-08-20T05:18:54.318 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.318 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.318 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.318 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-08-20T05:18:54.318 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.318 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.318 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.318 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-20T05:18:54.318 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.319 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.319 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.319 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.319 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-08-20T05:18:54.319 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-08-20T05:18:54.319 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.319 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.319 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.319 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-08-20T05:18:54.319 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.319 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.319 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.319 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-20T05:18:54.320 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.320 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.320 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.320 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.320 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-08-20T05:18:54.320 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-08-20T05:18:54.320 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.320 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.320 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.320 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-08-20T05:18:54.320 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.320 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.320 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.320 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-08-20T05:18:54.321 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.321 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.321 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.321 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.321 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-08-20T05:18:54.321 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-08-20T05:18:54.321 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.321 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.321 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.321 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-08-20T05:18:54.321 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.321 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.321 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.321 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-20T05:18:54.321 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.322 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.322 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.322 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.322 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-08-20T05:18:54.322 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-08-20T05:18:54.322 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.322 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.322 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.322 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.322 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.322 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.322 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.322 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-20T05:18:54.323 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.323 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.323 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.323 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.323 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-20T05:18:54.323 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-20T05:18:54.323 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.323 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.323 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.323 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-20T05:18:54.323 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.323 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.323 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.324 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-08-20T05:18:54.324 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.324 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.324 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.324 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.324 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.324 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.324 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.324 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.324 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.324 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.324 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.324 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.325 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.325 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.325 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.325 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.325 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.325 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.325 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-08-20T05:18:54.325 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-08-20T05:18:54.325 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.325 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.325 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.325 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-08-20T05:18:54.326 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.326 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.326 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.326 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-20T05:18:54.326 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.326 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.326 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.326 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.326 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.326 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.326 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.326 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-08-20T05:18:54.327 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.327 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.327 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.327 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.327 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.327 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.327 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.327 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.327 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.327 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.327 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.327 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.327 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.327 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.327 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.328 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.328 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.328 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.328 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.328 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.328 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.328 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.328 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.328 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.328 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.328 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.328 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.329 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.329 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.329 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.329 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.329 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.329 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.329 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.329 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.329 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.329 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.329 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.329 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.329 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.329 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.330 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.330 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.330 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.330 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.330 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.330 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.330 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.330 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.330 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.330 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.330 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.330 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.330 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.331 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.331 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.331 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.331 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.331 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.331 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.331 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.331 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.331 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.331 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.331 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.331 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.331 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.331 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.332 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.332 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.332 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.332 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.332 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.332 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-08-20T05:18:54.332 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-08-20T05:18:54.332 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.332 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.332 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.332 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-08-20T05:18:54.333 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.333 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.333 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.333 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.333 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.333 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.333 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.333 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-08-20T05:18:54.333 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-08-20T05:18:54.333 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.333 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.333 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.333 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-08-20T05:18:54.334 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.334 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.334 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.334 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.334 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.334 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.334 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.334 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.334 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-20T05:18:54.334 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-20T05:18:54.334 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.334 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.334 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.334 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-20T05:18:54.335 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.335 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.335 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.335 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.335 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.335 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.335 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.335 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.335 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.335 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.335 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.335 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.335 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.335 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.336 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.336 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.336 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.336 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.336 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.336 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.336 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.336 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.336 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.336 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.336 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.336 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-08-20T05:18:54.336 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-08-20T05:18:54.336 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-08-20T05:18:54.336 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.337 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-08-20T05:18:54.337 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-08-20T05:18:54.337 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.337 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.337 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.337 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-08-20T05:18:54.337 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.337 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.337 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.337 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-20T05:18:54.337 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.337 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.337 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.338 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.338 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-08-20T05:18:54.338 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-08-20T05:18:54.338 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.338 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.338 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.338 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-08-20T05:18:54.338 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.338 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.338 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.338 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-20T05:18:54.338 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.338 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.339 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.339 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.339 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-08-20T05:18:54.339 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-08-20T05:18:54.339 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.339 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.339 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.339 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.339 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.339 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.339 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.339 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-08-20T05:18:54.339 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.339 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.339 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.339 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.340 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-20T05:18:54.340 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-20T05:18:54.340 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.340 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.340 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.340 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-08-20T05:18:54.340 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-08-20T05:18:54.340 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.340 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.340 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-20T05:18:54.340 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.340 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.340 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.341 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.341 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.341 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.341 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.341 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.341 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.341 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.341 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.341 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.341 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.341 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.341 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.341 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.341 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.341 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.342 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.342 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.342 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.342 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.342 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.342 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.342 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.342 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.342 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.342 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.342 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.342 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.342 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.342 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.343 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.343 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.343 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.343 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.343 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.343 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.343 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.343 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.343 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.343 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.343 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.343 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.343 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.343 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.344 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.344 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.344 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.344 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.344 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.344 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.344 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.344 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.344 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.344 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.344 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.344 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.344 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.345 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.345 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.345 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.345 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.345 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.345 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.345 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.345 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.345 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.345 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.345 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.345 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.345 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.345 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.345 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.346 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-08-20T05:18:54.346 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-08-20T05:18:54.346 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.346 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.346 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.346 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.346 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.346 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.346 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.346 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-08-20T05:18:54.346 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.347 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.347 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.347 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.347 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-08-20T05:18:54.347 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-08-20T05:18:54.347 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.347 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.347 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.347 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-08-20T05:18:54.347 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.347 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.347 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.347 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-08-20T05:18:54.347 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.348 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.348 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.348 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.348 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.348 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.348 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.348 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.348 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.348 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.348 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.348 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.348 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.348 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.348 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.349 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.349 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.349 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.349 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-08-20T05:18:54.349 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-08-20T05:18:54.349 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.349 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.349 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.349 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-08-20T05:18:54.349 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.349 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.349 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.349 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T05:18:54.350 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.350 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.350 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.350 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.350 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-08-20T05:18:54.350 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-08-20T05:18:54.350 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.350 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.350 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.350 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-20T05:18:54.350 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-20T05:18:54.350 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-08-20T05:18:54.350 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.351 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-20T05:18:54.351 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.351 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.351 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.351 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.351 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-08-20T05:18:54.351 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-08-20T05:18:54.351 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.351 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.351 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.351 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.351 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.351 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.351 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.352 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-08-20T05:18:54.352 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.352 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.352 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.352 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.352 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-08-20T05:18:54.352 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-08-20T05:18:54.352 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.352 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.352 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.352 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-08-20T05:18:54.353 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.353 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.353 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.353 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T05:18:54.353 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.353 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.353 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.353 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.353 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.353 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.353 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.353 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-08-20T05:18:54.354 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.354 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.354 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.354 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.354 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.354 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.354 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.354 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.354 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.354 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.354 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.354 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.355 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.355 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.355 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.355 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.355 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.355 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.355 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.355 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.355 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.355 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.355 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.355 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.355 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.356 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.356 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.356 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.356 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.356 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.356 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.356 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.356 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.356 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.356 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.356 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.356 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.356 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.357 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.357 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.357 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.357 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.357 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.357 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.357 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.357 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.357 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.357 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.357 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.357 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.357 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.358 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.358 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.358 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.358 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.358 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.358 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.358 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.358 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.358 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.358 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.358 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.358 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.359 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.359 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.359 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.359 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.359 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.359 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.359 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.359 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.359 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.359 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.359 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.360 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.360 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.360 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.360 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.360 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.360 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.360 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.360 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.360 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.360 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.360 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.360 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.360 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.361 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.361 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.361 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.361 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-08-20T05:18:54.361 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.361 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.361 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.361 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.361 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.361 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.361 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.361 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.361 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.362 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.362 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.362 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.362 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.362 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.362 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.362 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.362 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.362 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.362 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.362 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.362 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.362 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.363 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.363 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.363 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.363 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.363 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.363 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.363 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.363 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.363 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.363 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.363 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.363 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.364 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.364 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.364 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.364 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.364 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.364 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.364 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.364 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.364 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.364 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.364 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.364 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.364 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.365 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.365 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.365 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.365 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.365 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.365 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.365 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.365 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.365 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.365 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.365 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.365 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.365 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.365 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.366 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.366 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.366 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.366 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.366 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.366 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.366 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.366 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.366 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.366 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.366 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.366 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.367 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.367 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.367 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.367 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.367 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.367 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.367 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.367 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.367 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.367 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.367 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.367 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.367 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.368 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.368 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.368 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.368 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-08-20T05:18:54.368 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.368 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.368 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.368 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-08-20T05:18:54.368 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-08-20T05:18:54.368 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.368 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.368 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.368 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-08-20T05:18:54.368 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.369 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.369 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.369 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-20T05:18:54.369 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.369 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.369 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.369 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.369 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-08-20T05:18:54.369 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-08-20T05:18:54.369 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.369 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.369 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.370 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:54.370 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-08-20T05:18:54.370 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.370 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.370 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-20T05:18:54.370 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.370 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.370 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.370 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.370 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.370 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.370 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.370 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.370 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.371 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.371 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.371 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.371 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.371 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.371 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.371 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.371 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.371 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.371 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.371 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.371 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.371 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.372 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.372 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.372 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.372 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.372 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.372 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.372 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.372 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.372 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.372 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.372 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.372 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.372 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.372 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.373 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.373 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.373 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.373 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.373 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.373 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.373 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.373 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.373 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.373 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.373 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.373 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.373 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.374 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.374 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.374 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.374 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.374 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.374 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.374 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.374 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.374 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.374 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.374 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.374 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.375 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.375 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.375 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.375 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.375 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.375 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.375 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.375 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.375 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.375 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.376 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.376 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.376 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.376 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.376 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.376 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.376 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.376 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.376 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.376 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.376 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.376 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.376 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.376 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.377 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.377 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.377 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.377 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.377 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.377 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.377 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-08-20T05:18:54.377 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.377 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.377 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.377 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-08-20T05:18:54.377 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-08-20T05:18:54.377 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.377 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.377 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.378 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-08-20T05:18:54.378 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.378 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.378 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.378 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-08-20T05:18:54.378 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-20T05:18:54.378 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.378 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.378 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.378 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.378 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.378 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.378 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.378 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.379 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.379 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.379 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.379 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.379 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.379 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.379 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.379 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.379 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.379 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.379 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.379 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.379 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.379 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.380 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.380 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.380 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.380 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.380 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.380 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.380 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.380 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.380 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.380 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.380 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.380 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.380 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.380 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.381 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.381 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.381 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.381 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.381 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.381 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.381 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.381 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.381 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.381 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.381 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.381 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.381 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.381 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.381 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.382 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.382 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.382 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.382 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.382 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.382 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.382 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.382 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.382 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.382 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.382 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.382 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.382 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.382 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.383 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.383 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.383 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.383 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.383 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.383 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.383 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.383 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.383 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-08-20T05:18:54.383 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-08-20T05:18:54.383 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.383 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.383 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.384 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.384 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.384 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.384 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.384 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-08-20T05:18:54.384 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-20T05:18:54.384 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.384 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.384 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.384 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-08-20T05:18:54.384 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-08-20T05:18:54.384 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.384 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.385 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.385 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-08-20T05:18:54.385 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.385 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.385 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.385 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-08-20T05:18:54.385 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.385 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.385 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.385 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.385 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-08-20T05:18:54.385 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-08-20T05:18:54.385 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.385 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.386 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.386 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-08-20T05:18:54.386 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.386 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.386 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.386 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-08-20T05:18:54.386 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.386 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.386 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.386 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.386 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-08-20T05:18:54.386 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-08-20T05:18:54.386 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.386 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.387 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.387 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.387 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.387 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.387 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.387 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-08-20T05:18:54.387 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.387 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.387 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.387 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.387 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.387 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.387 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.387 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.388 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.388 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.388 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.388 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.388 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.388 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.388 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.388 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.388 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.388 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.388 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-08-20T05:18:54.388 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-08-20T05:18:54.388 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.388 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.389 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.389 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-08-20T05:18:54.389 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.389 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.389 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.389 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-20T05:18:54.389 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-20T05:18:54.389 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.389 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.389 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.389 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.389 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.389 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.389 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-08-20T05:18:54.389 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.390 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.390 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.390 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.390 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.390 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.390 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.390 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.390 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.390 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.390 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.390 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.390 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.390 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.390 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.391 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.391 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.391 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.391 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.391 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.391 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.391 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.391 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.391 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.391 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.391 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.391 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.391 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.391 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.392 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.392 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.392 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.392 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.392 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.392 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.392 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.392 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.392 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.392 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.392 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.392 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.392 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.392 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.392 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.393 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.393 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.393 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.393 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.393 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.393 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.393 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.393 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.393 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.393 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.393 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.393 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.393 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.393 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.393 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.393 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.394 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.394 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.394 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.394 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.394 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.394 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.394 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.394 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.394 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.394 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.394 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.394 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.394 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.395 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.395 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.395 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.395 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.395 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.395 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.395 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.395 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.395 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.395 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.395 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.395 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.395 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.395 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.396 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.396 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.396 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.396 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-08-20T05:18:54.396 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.396 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.396 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.396 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.396 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.396 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.396 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.396 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.396 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.396 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.396 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.397 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.397 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.397 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.397 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.397 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.397 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.397 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.397 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.397 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.397 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.398 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.398 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.398 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.398 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.398 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.398 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.398 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.398 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.398 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.398 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.398 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.398 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.399 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.399 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.399 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.399 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.399 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.399 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.399 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.399 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.399 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.399 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.399 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.399 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.399 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.399 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.400 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.400 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.400 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.400 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.400 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.400 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.400 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.400 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.400 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.400 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.400 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.400 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.400 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.400 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.401 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.401 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.401 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.401 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.401 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.401 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.401 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.401 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.401 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.401 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.401 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.401 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.401 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.401 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.402 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.402 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.402 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.402 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.402 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.402 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.402 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.402 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.402 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.402 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.402 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.402 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.403 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.403 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.403 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.403 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-08-20T05:18:54.403 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.403 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.403 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.403 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.403 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.403 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.403 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.403 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.403 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.403 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.404 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.404 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.404 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.404 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.404 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.404 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.404 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.404 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.404 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.404 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.404 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.404 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.404 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.405 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.405 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.405 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.405 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.405 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.405 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.405 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.405 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.405 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.405 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.405 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.405 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.405 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.405 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.406 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.406 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.406 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.406 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.406 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.406 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.406 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.406 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.406 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.406 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.406 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.406 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.406 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.407 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.407 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.407 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.407 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.407 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.407 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.407 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.407 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.407 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.407 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.407 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.407 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.407 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.407 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.408 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.408 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.408 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.408 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.408 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.408 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.408 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.408 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.408 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.408 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.408 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.408 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.408 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.408 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.408 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.408 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.409 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.409 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.409 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.409 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.409 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.409 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.409 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.409 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.409 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.409 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.409 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-08-20T05:18:54.409 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.409 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.409 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.409 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-08-20T05:18:54.410 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-08-20T05:18:54.410 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.410 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.410 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.410 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.410 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.410 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.410 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.410 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-20T05:18:54.410 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.410 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.410 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.410 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.411 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.411 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.411 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.411 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.411 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.411 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.411 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.411 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.411 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.411 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.411 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.411 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.411 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.411 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.412 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.412 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.412 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.412 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.412 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.412 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.412 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.412 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.412 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.412 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.412 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.412 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.412 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.412 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.413 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.413 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.413 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.413 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.413 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.413 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.413 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.413 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.413 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.413 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.413 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.413 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.413 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.414 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.414 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.414 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.414 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.414 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.414 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.414 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.414 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.414 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.414 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.414 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.414 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.414 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.415 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.415 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.415 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.415 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.415 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.415 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.415 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.415 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.415 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.415 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.415 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.415 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.415 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.416 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.416 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.416 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.416 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-08-20T05:18:54.416 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-08-20T05:18:54.416 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.416 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.416 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.416 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.416 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.416 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.416 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.416 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-08-20T05:18:54.416 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-08-20T05:18:54.417 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-08-20T05:18:54.417 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.417 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-08-20T05:18:54.417 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.417 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.417 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.417 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.417 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.417 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.417 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.417 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.417 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.417 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.417 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.418 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.418 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.418 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.418 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.418 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.418 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.418 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.418 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.418 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.418 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.418 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-08-20T05:18:54.418 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.418 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.419 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.419 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.419 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.419 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.419 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.419 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.419 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.419 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.419 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.419 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.419 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.419 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.419 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.419 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.420 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.420 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.420 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.420 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.420 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.420 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.420 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.420 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.420 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.420 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.420 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.420 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.420 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.420 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.420 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.421 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.421 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.421 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.421 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.421 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.421 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.421 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.421 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.421 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.421 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.421 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.421 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.421 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.421 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.421 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.422 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.422 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.422 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.422 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.422 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.422 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.422 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.422 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.422 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.422 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.422 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.422 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.422 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.423 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.423 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.423 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.423 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.423 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.423 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.423 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.423 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.423 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.423 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.423 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.423 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.423 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.423 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.423 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.424 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.424 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.424 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.424 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.424 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.424 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.424 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.424 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.424 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.424 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.424 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.424 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.424 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.424 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.424 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.425 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.425 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-08-20T05:18:54.425 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.425 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.425 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.425 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.425 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.425 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.425 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.425 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.425 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.425 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.425 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.425 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.426 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.426 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.426 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.426 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.426 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.426 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.426 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.426 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.426 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.426 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.426 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.427 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.427 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.427 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.427 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.427 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.427 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.427 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.427 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.427 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.427 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.427 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.427 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.427 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.428 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.428 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.428 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.428 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.428 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.428 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.428 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.428 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.428 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.428 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.428 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.428 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.428 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.429 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.429 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.429 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.429 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.429 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.429 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.429 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.429 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.429 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.429 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.429 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.429 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.429 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.430 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.430 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.430 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.430 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.430 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.430 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.430 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.430 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.430 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.430 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.430 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.430 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.431 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.431 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.431 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.431 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.431 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.431 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.431 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.431 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.431 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.431 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.431 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.431 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.432 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-08-20T05:18:54.432 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.432 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.432 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.432 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.432 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.432 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.432 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.432 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.432 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.433 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.433 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.433 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.433 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.433 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.433 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.433 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.433 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.433 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.433 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.433 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.433 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.433 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.433 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.434 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.434 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.434 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.434 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.434 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.434 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.434 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.434 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.434 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.434 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.434 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.434 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.434 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.434 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.435 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.435 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.435 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.435 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.435 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.435 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.435 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.435 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.435 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.435 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.435 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.435 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.435 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.435 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.435 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.436 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.436 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.436 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.436 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.436 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.436 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.436 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.436 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.436 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.436 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.436 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.436 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.436 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.436 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.437 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.437 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.437 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.437 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.437 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.437 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.437 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.437 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-20T05:18:54.437 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-20T05:18:54.437 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.437 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.437 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.437 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-20T05:18:54.438 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.438 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.438 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.438 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.438 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.438 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.438 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.438 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.438 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.438 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.438 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.438 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.438 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.439 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.439 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.439 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.439 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.439 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.439 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.439 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.439 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.439 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.439 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-08-20T05:18:54.439 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-08-20T05:18:54.439 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:54.439 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.439 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.440 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-08-20T05:18:54.440 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-08-20T05:18:54.440 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.440 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.440 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-08-20T05:18:54.440 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-20T05:18:54.440 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.440 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.440 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.440 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.440 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.440 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.440 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-08-20T05:18:54.441 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.441 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.441 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.441 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-08-20T05:18:54.441 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-08-20T05:18:54.441 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.441 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.441 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.441 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.441 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.441 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.441 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.441 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-20T05:18:54.441 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.442 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.442 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.442 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-08-20T05:18:54.442 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-08-20T05:18:54.442 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.442 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.442 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.442 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.442 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.442 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.442 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.442 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.443 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.443 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.443 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.443 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.443 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.443 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.443 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.443 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.443 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.443 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.443 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.443 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.444 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.444 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.444 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.444 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.444 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.444 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.444 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.444 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.444 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.444 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.444 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.444 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.444 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.445 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.445 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.445 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.445 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.445 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.445 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.445 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.445 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.445 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.445 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.445 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.445 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.445 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.445 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.446 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.446 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.446 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.446 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.446 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.446 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.446 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.446 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.446 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.446 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.446 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.447 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.447 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.447 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.447 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.447 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.447 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.447 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.447 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.447 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.447 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.447 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.447 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.448 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.448 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.448 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.448 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.448 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.448 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.448 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.448 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.448 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.448 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.448 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.448 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.448 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-08-20T05:18:54.448 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-08-20T05:18:54.448 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.449 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.449 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.449 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-08-20T05:18:54.449 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.449 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.449 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.449 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-08-20T05:18:54.449 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.449 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.449 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.449 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-20T05:18:54.449 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-20T05:18:54.449 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.450 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.450 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.450 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-20T05:18:54.450 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.450 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.450 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.450 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-08-20T05:18:54.450 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.450 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.450 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.450 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.450 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.450 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.451 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.451 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.451 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.451 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.451 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.451 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.451 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.451 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.451 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.451 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.451 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.451 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.451 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.451 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.452 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.452 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-08-20T05:18:54.452 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.452 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.452 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.452 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-08-20T05:18:54.452 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-08-20T05:18:54.452 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.452 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.452 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.452 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.452 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.453 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.453 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.453 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.453 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.453 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.453 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.453 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.453 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-08-20T05:18:54.453 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-08-20T05:18:54.453 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.453 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.453 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.453 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.453 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.454 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.454 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.454 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-20T05:18:54.454 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-20T05:18:54.454 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.454 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.454 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.454 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.455 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.455 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.455 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.455 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.455 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.455 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.455 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.455 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.455 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.455 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.455 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.455 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.455 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.455 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.456 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.456 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.456 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.456 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.456 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.456 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.456 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.456 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.456 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.456 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.456 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.456 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.456 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.457 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.457 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.457 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.457 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.457 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.457 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.457 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.457 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.457 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.457 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.457 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.457 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.457 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.458 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.458 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.458 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.458 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.458 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.458 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.458 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.458 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.458 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.458 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.458 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.458 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.459 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.459 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.459 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.459 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.459 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.459 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.459 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.459 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.459 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.459 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.459 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.460 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.460 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.460 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.460 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-08-20T05:18:54.460 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-08-20T05:18:54.460 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.460 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.460 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.460 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.460 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.460 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.460 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.460 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.460 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.461 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.461 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.461 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.461 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-20T05:18:54.461 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-20T05:18:54.461 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.461 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.461 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.461 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-08-20T05:18:54.461 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.461 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.461 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.461 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.461 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.461 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.462 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.462 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.462 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-08-20T05:18:54.462 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-08-20T05:18:54.462 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:54.462 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.462 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.462 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-08-20T05:18:54.462 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.462 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.462 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.462 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.462 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.463 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.463 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.463 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.463 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-20T05:18:54.463 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-20T05:18:54.463 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.463 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.463 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.463 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-08-20T05:18:54.463 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.463 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.463 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.463 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-20T05:18:54.463 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.463 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.464 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.464 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.464 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-20T05:18:54.464 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-20T05:18:54.464 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.464 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.464 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.464 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-08-20T05:18:54.464 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.464 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.464 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.464 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-20T05:18:54.465 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.465 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.465 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.465 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.465 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.465 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.465 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.465 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.465 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.465 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.465 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.465 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.465 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.465 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.465 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.465 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.466 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.466 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.466 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-08-20T05:18:54.466 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-08-20T05:18:54.466 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.466 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.466 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.466 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-08-20T05:18:54.466 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.466 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.466 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.466 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.466 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.466 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.467 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.467 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.467 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-08-20T05:18:54.467 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-08-20T05:18:54.467 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.467 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.467 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.467 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-08-20T05:18:54.467 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.467 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.467 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.467 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-08-20T05:18:54.467 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-08-20T05:18:54.467 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.467 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.468 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.468 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.468 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.468 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.468 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-08-20T05:18:54.468 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-08-20T05:18:54.468 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.468 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.468 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.468 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-08-20T05:18:54.468 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-08-20T05:18:54.468 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-08-20T05:18:54.468 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.469 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.469 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.469 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.469 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.469 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.469 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.469 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.469 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.469 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-08-20T05:18:54.469 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.469 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.469 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.469 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.470 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.470 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.470 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.470 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.470 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.470 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.470 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.470 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.470 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.470 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.470 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.470 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.470 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.471 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.471 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.471 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.471 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.471 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.471 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.471 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.471 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.471 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.471 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.471 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.471 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.471 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.471 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.472 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.472 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.472 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.472 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.472 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.472 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.472 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.472 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.472 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.472 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.472 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.472 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.472 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.473 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.473 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.473 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.473 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.473 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.473 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.473 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.473 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.473 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.473 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.473 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.473 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.473 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.473 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.474 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.474 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.474 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.474 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.474 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.474 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.474 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.474 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.474 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.474 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.474 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.474 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.474 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.475 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.475 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.475 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-08-20T05:18:54.475 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-08-20T05:18:54.475 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.475 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.475 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.475 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:54.475 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.475 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.475 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.475 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.475 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.475 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.475 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.476 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.476 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-08-20T05:18:54.476 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-08-20T05:18:54.476 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.476 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.476 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.476 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.476 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.476 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.476 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.476 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.476 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.476 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.476 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.476 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.477 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.477 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.477 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.477 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.477 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.477 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.477 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.477 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.477 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.477 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.477 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.477 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.477 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.477 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.477 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-08-20T05:18:54.478 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-08-20T05:18:54.478 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.478 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.478 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.478 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.478 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.478 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.478 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.478 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.478 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.478 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.478 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.478 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.478 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.479 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.479 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.479 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-08-20T05:18:54.479 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.479 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.479 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.479 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-08-20T05:18:54.479 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-08-20T05:18:54.479 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.479 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.479 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.479 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.479 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.479 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.480 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.480 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.480 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.480 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.480 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.480 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.480 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-08-20T05:18:54.480 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-08-20T05:18:54.480 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.480 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.480 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.480 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.480 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.480 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.480 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.481 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.481 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.481 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.481 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.481 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.481 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.481 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.481 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.481 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.481 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.481 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.481 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.481 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.482 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.482 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.482 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.482 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.482 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.482 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.482 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.482 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.482 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.482 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.482 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.482 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.482 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.483 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.483 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.483 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.483 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.483 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.483 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.483 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.483 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.483 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.483 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.483 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.483 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.483 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.483 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.484 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.484 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.484 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.484 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.484 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.484 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.484 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.484 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.484 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.484 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.484 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.484 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.484 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.484 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.484 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.485 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.485 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.485 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.485 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.485 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.485 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.485 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.485 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.485 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.485 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.485 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.485 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.485 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.486 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.486 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.486 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.486 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.486 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.486 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.486 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.486 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-20T05:18:54.486 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-20T05:18:54.486 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.486 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.486 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.486 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.486 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.487 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.487 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.487 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.487 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.487 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.487 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.487 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.487 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-20T05:18:54.487 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-20T05:18:54.487 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.487 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.487 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.487 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.488 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.488 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.488 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.488 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.488 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.488 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.488 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.488 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.488 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.488 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.488 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.488 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.488 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.488 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.488 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.489 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.489 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.489 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.489 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.489 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.489 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.489 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.489 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.489 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.489 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.489 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-08-20T05:18:54.489 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.489 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.489 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.489 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.490 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.490 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.490 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.490 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.490 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.490 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.490 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.490 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.490 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.490 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.490 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.490 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.490 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.490 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.491 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.491 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.491 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.491 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.491 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.491 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.491 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.491 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.491 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.491 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.491 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.491 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.491 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.491 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.491 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.492 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.492 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.492 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.492 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.492 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.492 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.492 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.492 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.492 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.492 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.492 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.492 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.492 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.492 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.493 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.494 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.494 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.494 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.494 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.494 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.494 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.494 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.494 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.494 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.494 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.494 INFO:teuthology.orchestra.run.smithi037.stdout: "secondary_zone_period_retry_limit": { 2024-08-20T05:18:54.494 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-20T05:18:54.494 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.494 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.495 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.495 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-20T05:18:54.495 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.495 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.495 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.495 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-20T05:18:54.495 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.495 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.495 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.495 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.495 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.495 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.495 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.496 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.496 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.496 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.496 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.496 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.496 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.496 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.496 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.496 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.496 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.496 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.496 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.496 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.497 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.497 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-08-20T05:18:54.497 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.497 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.497 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.497 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.497 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.497 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.497 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.497 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.497 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.497 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.497 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.497 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.498 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.498 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.498 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.498 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.498 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.498 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.498 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.498 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.499 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.499 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.499 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.499 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.499 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.499 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.499 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.499 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.499 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.499 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.499 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.499 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.499 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.499 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.500 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.500 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.500 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.500 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.500 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.500 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.500 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.500 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.500 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.500 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.500 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.500 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.500 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.500 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.501 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.501 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.501 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.501 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.501 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.501 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.501 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.501 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.501 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.501 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.501 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.501 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.501 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.501 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.501 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.502 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.502 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.502 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.502 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.502 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.502 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.502 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.502 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.502 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.502 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.502 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.502 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.502 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.502 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.503 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.503 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.503 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.503 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.503 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.503 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.503 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.503 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.503 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.503 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.503 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-08-20T05:18:54.503 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-08-20T05:18:54.503 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.503 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.503 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.504 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-08-20T05:18:54.504 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.504 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.504 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.504 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-20T05:18:54.504 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.504 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.504 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.504 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.504 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.504 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.504 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.504 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-08-20T05:18:54.504 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.505 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.505 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.505 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.505 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.505 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.505 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.505 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.505 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.505 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.505 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.505 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.505 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.505 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.505 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.506 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.506 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.506 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.506 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.506 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.506 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.506 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.506 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.506 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.506 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.506 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.506 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.506 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.507 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.507 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.507 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.507 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.507 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.507 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.507 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.507 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.507 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.507 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.507 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.507 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.507 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.507 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.508 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.508 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.508 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.508 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.508 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.508 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.508 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.508 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.508 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.508 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.508 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.508 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.508 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.509 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.509 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.509 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.509 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.509 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.509 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.509 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.509 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.509 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.509 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.509 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.509 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.509 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.509 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.510 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.510 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.510 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.510 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.510 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-08-20T05:18:54.510 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-08-20T05:18:54.510 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.510 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.510 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.510 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.510 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.510 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.511 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.511 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.511 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.511 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.511 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.511 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.511 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-08-20T05:18:54.511 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-08-20T05:18:54.511 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.511 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.511 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.512 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-08-20T05:18:54.512 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.512 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.512 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.512 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.512 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.512 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.512 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.512 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.512 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-08-20T05:18:54.512 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-08-20T05:18:54.512 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.512 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.512 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.513 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.513 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.513 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.513 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.513 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.513 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.513 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.513 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.513 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.513 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-08-20T05:18:54.513 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-08-20T05:18:54.513 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.513 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.513 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.513 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.514 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.514 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.514 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.514 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.514 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.514 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.514 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.514 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.514 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-08-20T05:18:54.514 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-08-20T05:18:54.514 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:54.514 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.514 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.514 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.515 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.515 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.515 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.515 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.515 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.515 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.515 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.515 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.515 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-08-20T05:18:54.515 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-08-20T05:18:54.515 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.515 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.516 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.516 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.516 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.516 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.516 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.516 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.516 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.516 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.516 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.516 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.516 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-08-20T05:18:54.517 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-08-20T05:18:54.517 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.517 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.517 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.517 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.517 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.517 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.517 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.517 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.517 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.517 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.517 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.517 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.517 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-08-20T05:18:54.518 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-08-20T05:18:54.518 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.518 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.518 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.518 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.518 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.518 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.518 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.518 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.518 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.518 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.518 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.518 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.519 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-08-20T05:18:54.519 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-08-20T05:18:54.519 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.519 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.519 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.519 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.519 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-20T05:18:54.519 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-08-20T05:18:54.519 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.519 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.519 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.519 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.519 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.520 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.520 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.520 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.520 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.520 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.520 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.520 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.520 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.520 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.520 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.520 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.520 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.520 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.521 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.521 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.521 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-08-20T05:18:54.521 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-08-20T05:18:54.521 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.521 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.521 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.521 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.521 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.521 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.521 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.521 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.522 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.522 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.522 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.522 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.522 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-08-20T05:18:54.522 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-08-20T05:18:54.522 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.522 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.522 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.522 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.522 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.522 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.523 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.523 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.523 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.523 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.523 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.523 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.523 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-08-20T05:18:54.523 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-08-20T05:18:54.523 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.523 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.523 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.523 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.524 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.524 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.524 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.524 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.524 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.524 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.524 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.524 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.524 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.524 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.524 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.524 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smb", 2024-08-20T05:18:54.524 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.524 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.524 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.525 INFO:teuthology.orchestra.run.smithi037.stdout: "internal_store_backend": { 2024-08-20T05:18:54.525 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "internal_store_backend", 2024-08-20T05:18:54.525 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.525 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.525 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.525 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.525 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.525 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.525 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.525 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-20T05:18:54.525 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.525 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.525 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.525 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.526 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.526 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.526 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.526 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.526 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.526 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.526 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.526 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.526 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.526 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.526 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.526 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.526 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.526 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.527 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.527 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.527 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.527 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.527 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.527 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.527 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.527 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.527 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.527 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.527 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.527 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.527 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.528 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.528 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.528 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.528 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.528 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.528 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.528 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.528 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.528 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.528 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.528 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.528 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.528 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.528 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.529 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.529 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.529 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.529 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.529 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.529 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.529 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.529 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.529 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.529 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.529 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.529 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.530 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.530 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.530 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.530 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.530 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.530 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.530 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.530 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.530 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.530 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.530 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.530 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.530 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.530 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.531 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.531 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.531 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.531 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.531 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.531 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.531 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.531 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.531 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.531 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.531 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.531 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.531 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.531 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.531 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: "update_orchestration": { 2024-08-20T05:18:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "update_orchestration", 2024-08-20T05:18:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-20T05:18:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-08-20T05:18:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-08-20T05:18:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-08-20T05:18:54.534 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.534 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.534 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.534 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.534 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.534 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.534 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.534 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-08-20T05:18:54.534 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.534 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.534 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.534 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.534 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-08-20T05:18:54.534 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-08-20T05:18:54.535 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.535 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.535 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.535 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.535 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.535 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.535 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.535 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-08-20T05:18:54.535 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.535 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.535 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.535 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.535 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.535 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.535 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.536 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.536 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.536 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.536 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.536 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.536 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.536 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.536 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.536 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.536 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.536 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.536 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.536 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.536 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.536 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.537 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.537 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.537 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.537 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.537 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.537 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.537 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.537 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.537 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.537 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.537 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.537 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.537 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.537 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.537 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.538 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.538 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.538 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.538 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.538 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.538 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.538 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.538 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.538 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.538 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.538 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.538 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.538 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.539 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.539 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.539 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.539 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.539 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.539 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.539 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.539 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.539 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.539 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.539 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.539 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.539 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.540 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.540 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.540 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.540 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.540 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.540 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.540 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.540 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.540 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.540 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.540 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.540 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.540 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.540 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.541 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.541 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.541 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.541 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.541 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.541 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.541 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.541 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.541 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.541 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.541 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.541 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.541 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.541 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.542 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-08-20T05:18:54.542 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.542 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.542 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.542 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.542 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.542 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.542 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.542 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.542 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.542 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.542 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.542 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.542 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.543 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.543 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.543 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.543 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.543 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.543 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.543 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.543 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.543 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.543 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.543 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.543 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.543 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.544 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.544 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.544 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.544 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.544 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.544 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.544 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.544 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.544 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.544 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.544 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.545 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.545 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.545 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.545 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.545 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.545 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.545 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.545 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.545 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.545 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.545 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.545 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.546 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.546 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.546 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.546 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.546 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.546 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.546 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.546 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.546 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.546 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.546 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.546 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.547 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.547 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.547 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.547 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.547 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.547 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.547 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.547 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.547 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.547 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.547 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.548 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.548 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.548 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.548 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.548 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.548 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.548 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.548 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.548 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.548 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.548 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.548 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.548 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.549 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.549 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.549 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.549 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.549 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.549 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-08-20T05:18:54.549 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.549 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.549 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.549 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.549 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.549 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.549 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.549 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.550 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.550 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.550 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.550 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.550 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.550 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.550 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.550 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.550 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.550 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.550 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.550 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.551 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.551 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.551 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.551 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.551 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.551 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.551 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.551 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.551 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.551 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.551 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.551 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.551 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.552 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.552 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.552 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.552 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.552 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.552 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.552 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.552 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.552 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.552 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.552 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.552 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.552 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.553 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.553 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.553 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.553 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.553 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.553 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.553 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.553 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.553 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.553 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.553 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.554 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.554 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.554 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.554 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.554 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.554 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.554 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.554 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.554 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.554 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.554 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.554 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.554 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.555 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.555 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.555 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.555 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.555 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.555 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.555 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.555 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.555 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.555 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.555 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.555 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.556 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.556 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.556 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.556 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.556 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.556 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.556 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.556 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.556 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-08-20T05:18:54.556 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.556 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.556 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.556 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-08-20T05:18:54.557 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-08-20T05:18:54.557 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.557 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.557 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.557 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-20T05:18:54.557 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.557 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.557 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.557 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.557 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.557 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.557 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.557 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.558 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-20T05:18:54.558 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-20T05:18:54.558 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.558 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.558 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.558 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-08-20T05:18:54.558 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.558 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.558 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.558 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.558 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.558 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.558 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.559 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.559 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.559 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.559 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.559 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.559 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.559 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.559 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.559 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.559 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.559 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.559 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.559 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.560 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.560 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.560 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.560 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.560 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.560 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.560 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.560 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.560 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.560 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.560 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.560 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.561 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.561 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.561 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.561 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.561 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.561 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.561 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.561 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.561 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.561 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.561 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.561 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.561 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.561 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.561 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.562 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.562 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.562 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.562 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.562 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.562 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.562 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.562 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.562 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.562 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.562 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.562 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.562 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.563 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.563 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.563 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.563 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.563 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.563 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.563 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.563 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.563 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.563 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.563 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.563 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.563 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.563 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.564 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.564 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.564 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.564 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.564 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.564 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.564 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.564 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.564 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.564 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.564 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.565 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.565 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.565 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.565 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.565 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.565 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.565 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.565 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.565 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.565 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.565 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-08-20T05:18:54.565 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.565 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.565 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.566 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-08-20T05:18:54.566 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-08-20T05:18:54.566 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.566 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.566 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.566 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.566 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.566 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.566 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.566 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-20T05:18:54.566 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.566 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.566 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.567 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.567 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-08-20T05:18:54.567 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-08-20T05:18:54.567 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.567 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.567 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.567 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.567 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.567 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.567 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.567 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-20T05:18:54.567 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.567 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.567 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.568 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.568 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-08-20T05:18:54.568 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-08-20T05:18:54.568 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.568 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.568 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.568 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.568 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.568 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.568 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.568 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-20T05:18:54.568 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.568 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.568 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.569 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.569 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-08-20T05:18:54.569 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-08-20T05:18:54.569 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.569 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.569 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.569 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.569 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.569 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.569 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.569 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-20T05:18:54.570 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.570 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.570 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.570 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.570 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-08-20T05:18:54.570 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-08-20T05:18:54.570 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.570 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.570 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.570 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.570 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.570 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.570 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.571 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-20T05:18:54.571 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.571 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.571 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.571 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.571 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-08-20T05:18:54.571 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-08-20T05:18:54.571 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.571 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.571 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.571 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.571 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.571 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.571 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.571 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.572 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.572 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.572 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.572 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.572 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-08-20T05:18:54.572 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-08-20T05:18:54.572 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.572 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.572 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.572 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.572 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.572 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.572 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.572 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.573 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.573 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.573 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.573 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.573 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-08-20T05:18:54.573 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-08-20T05:18:54.573 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.573 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.573 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.573 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-20T05:18:54.573 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.573 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.573 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.573 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.573 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.574 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.574 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.574 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.574 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-08-20T05:18:54.574 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-08-20T05:18:54.574 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.574 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.574 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.574 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.574 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.574 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.574 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.574 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.575 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.575 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.575 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.575 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.575 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-20T05:18:54.575 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-20T05:18:54.575 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.575 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.575 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.575 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-08-20T05:18:54.575 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-08-20T05:18:54.575 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.575 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.575 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.575 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.576 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.576 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.576 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.576 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-08-20T05:18:54.576 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-08-20T05:18:54.576 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.576 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.576 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.576 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-08-20T05:18:54.576 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.576 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.576 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.576 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.576 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.577 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.577 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.577 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.577 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-08-20T05:18:54.577 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-08-20T05:18:54.577 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.577 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.577 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.577 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.577 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.577 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.577 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.577 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.577 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.578 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.578 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.578 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.578 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-08-20T05:18:54.578 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-08-20T05:18:54.578 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.578 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.578 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.578 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.578 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.578 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.578 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.578 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.578 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.579 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.579 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.579 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.579 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.579 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.579 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.579 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.579 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.579 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.579 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.579 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.579 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.579 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.579 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.579 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.580 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.580 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.580 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.580 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.580 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.580 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.580 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.580 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.580 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.580 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.580 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.580 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.580 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.580 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.580 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.581 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.581 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.581 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.581 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.581 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.581 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.581 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.581 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.581 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.581 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.581 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.581 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.581 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.581 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.581 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.582 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.582 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.582 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.582 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.582 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.582 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.582 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.582 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.582 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.582 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.582 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.582 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.582 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.583 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.583 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.583 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.583 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.583 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.583 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.583 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.583 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.583 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.583 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.583 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.583 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.583 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.583 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.583 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.584 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-08-20T05:18:54.584 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-08-20T05:18:54.584 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.584 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.584 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.584 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.584 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.584 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.584 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.584 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.584 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.584 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.584 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.585 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.585 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-08-20T05:18:54.585 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-08-20T05:18:54.585 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.585 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.585 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.585 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.585 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.585 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.585 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.585 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.585 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.585 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.585 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.586 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.586 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.586 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.586 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.586 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.586 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.586 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.586 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.586 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.586 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.586 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.586 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.586 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.587 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.587 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.587 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-08-20T05:18:54.587 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-08-20T05:18:54.587 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.587 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.587 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.587 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-20T05:18:54.587 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.587 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.587 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.587 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.587 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.588 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.588 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.588 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.588 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.588 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.588 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.588 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-08-20T05:18:54.588 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.588 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.588 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.588 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.588 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.588 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.588 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.589 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.589 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.589 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.589 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.589 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.589 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.589 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.589 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.590 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.590 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.590 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.590 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.590 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.590 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.591 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.591 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.591 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.591 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.591 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.591 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.591 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.591 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.591 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.591 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.591 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.591 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.592 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.592 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.592 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.592 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.592 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.592 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.592 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.592 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.592 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.592 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.592 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.592 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.592 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.593 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.593 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.593 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.593 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.593 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.593 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.593 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.593 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.593 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.593 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.593 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.593 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.594 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.594 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.594 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.594 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.594 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.594 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.594 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.594 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.594 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.594 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.594 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.594 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.595 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.595 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.595 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.595 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.595 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.595 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.595 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.595 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.595 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.595 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.595 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.595 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.596 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.596 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.596 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.596 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.596 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.596 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.596 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.596 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.596 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-08-20T05:18:54.596 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.597 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.597 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.597 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.597 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.597 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.597 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.597 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.597 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.597 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.597 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.597 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.597 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.598 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.598 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.598 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.598 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.598 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.598 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.598 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.598 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.598 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.599 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.599 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.599 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.599 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.599 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.599 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.599 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.599 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.599 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.599 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.599 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.600 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.600 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.600 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.600 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.600 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.600 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.600 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.600 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.600 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.600 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.600 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.600 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.600 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.600 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.601 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.601 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.601 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.601 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.601 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.601 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.601 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.601 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.601 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.601 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.601 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.601 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.601 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.601 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.602 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.602 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.602 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.602 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.602 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.602 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.602 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.602 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.602 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.602 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.602 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.602 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.602 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-08-20T05:18:54.603 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-08-20T05:18:54.603 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.603 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.603 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.603 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-08-20T05:18:54.603 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.603 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.603 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.603 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-20T05:18:54.603 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.603 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.603 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.603 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.604 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-08-20T05:18:54.604 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-08-20T05:18:54.604 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.604 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.604 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.604 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.604 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.604 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.604 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.604 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-08-20T05:18:54.604 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.604 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.604 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.604 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.605 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-08-20T05:18:54.605 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-08-20T05:18:54.605 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.605 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.605 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.605 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.605 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.605 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.605 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.605 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-20T05:18:54.605 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.605 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.605 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.605 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.606 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-08-20T05:18:54.606 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-08-20T05:18:54.606 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.606 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.606 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.606 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.606 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.606 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.606 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.606 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-20T05:18:54.606 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.606 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.606 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.606 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.607 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.607 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.607 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.607 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.607 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.607 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.607 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.607 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.607 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.607 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.607 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.607 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.607 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.607 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.607 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.608 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.608 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.608 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-08-20T05:18:54.608 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.608 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.608 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.608 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-08-20T05:18:54.608 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-08-20T05:18:54.608 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-20T05:18:54.608 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.608 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.608 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-08-20T05:18:54.608 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.609 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.609 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.609 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.609 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.609 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.609 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.609 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.609 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-08-20T05:18:54.609 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-08-20T05:18:54.609 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.609 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.609 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.609 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.609 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.610 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.610 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.610 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.610 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.610 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.610 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.610 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.610 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-20T05:18:54.610 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-20T05:18:54.610 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.610 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.610 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.610 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-20T05:18:54.611 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.611 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.611 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.611 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.611 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.611 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.611 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.611 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.611 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.611 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.611 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.611 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.611 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.611 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.612 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.612 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.612 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.612 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.612 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.612 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.612 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.612 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.612 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.612 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.612 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.612 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.612 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.612 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.613 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.613 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.613 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.613 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.613 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.613 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.613 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.613 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.613 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.613 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.613 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.613 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.614 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.614 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.614 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.614 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.614 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.614 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.614 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.614 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.614 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.614 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.614 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.614 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.615 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.615 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.615 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.615 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.615 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.615 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.615 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.615 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.615 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.615 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.615 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.615 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.616 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.616 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.616 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.616 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.616 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.616 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.616 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.616 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.616 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.616 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.616 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.616 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.616 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.616 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.617 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.617 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.617 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.617 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.617 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.617 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.617 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.617 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.617 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.617 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.617 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.617 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.617 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.617 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.618 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-08-20T05:18:54.618 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-08-20T05:18:54.618 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.618 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.618 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.618 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.618 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.618 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.618 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.618 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.618 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.618 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.618 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.619 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.619 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-08-20T05:18:54.619 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-08-20T05:18:54.619 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.619 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.619 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.619 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-08-20T05:18:54.619 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.619 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.619 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.619 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.619 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.619 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.619 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.620 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.620 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-08-20T05:18:54.620 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-08-20T05:18:54.620 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.620 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.620 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.620 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-20T05:18:54.620 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.620 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.620 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.620 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.620 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.620 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.620 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.621 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.621 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.621 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.621 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-20T05:18:54.621 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.621 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.621 INFO:teuthology.orchestra.run.smithi037.stdout: "gid": 24173, 2024-08-20T05:18:54.621 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "y", 2024-08-20T05:18:54.621 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr_features": 4540701547738038271, 2024-08-20T05:18:54.621 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-08-20T05:18:54.621 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.621 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-08-20T05:18:54.621 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.621 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.622 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.622 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-20T05:18:54.622 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-20T05:18:54.622 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.622 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.622 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.622 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-20T05:18:54.622 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.622 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.622 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.622 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-08-20T05:18:54.622 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.623 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.623 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.623 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.623 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.623 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.623 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.623 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.623 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.623 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.623 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.623 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.623 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.623 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.623 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.624 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.624 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.624 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.624 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.624 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.624 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.624 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.624 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.624 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.624 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.624 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.624 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.624 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.624 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.625 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.625 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.625 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.625 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.625 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.625 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.625 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.625 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.625 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.625 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.625 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.625 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.625 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.625 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.626 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.626 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.626 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.626 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.626 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.626 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.626 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.626 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.626 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.626 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.626 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.626 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.626 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.627 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.627 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.627 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.627 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.627 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.627 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.627 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.627 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.627 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.627 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.627 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.627 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.627 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.628 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.628 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.628 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.628 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.628 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.628 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-08-20T05:18:54.628 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-08-20T05:18:54.628 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.628 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.628 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.628 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.628 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.629 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.629 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.629 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to", 2024-08-20T05:18:54.629 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.629 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.629 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.629 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.629 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-08-20T05:18:54.629 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-08-20T05:18:54.629 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.629 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.629 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.629 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-08-20T05:18:54.630 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.630 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.630 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.630 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-08-20T05:18:54.630 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.630 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.630 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.630 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.630 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-08-20T05:18:54.630 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-08-20T05:18:54.630 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.630 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.630 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.631 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.631 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.631 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.631 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.631 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-08-20T05:18:54.631 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.631 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.631 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.631 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.631 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-08-20T05:18:54.631 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-08-20T05:18:54.631 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.631 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.632 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.632 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.632 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.632 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.632 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.632 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-08-20T05:18:54.632 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.632 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.632 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.632 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.632 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-08-20T05:18:54.632 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-08-20T05:18:54.632 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.632 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.633 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.633 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-08-20T05:18:54.633 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.633 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.633 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.633 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-08-20T05:18:54.633 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.633 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.633 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.633 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.633 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-08-20T05:18:54.634 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-08-20T05:18:54.634 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.634 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.634 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.634 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.634 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.634 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.634 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.634 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-08-20T05:18:54.634 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.634 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.634 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.634 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.635 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-08-20T05:18:54.635 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-08-20T05:18:54.635 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.635 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.635 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.635 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.635 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.635 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.635 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.635 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-20T05:18:54.635 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.635 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.635 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.635 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.636 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-08-20T05:18:54.636 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-08-20T05:18:54.636 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.636 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.636 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.636 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.636 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.636 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.636 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.636 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-08-20T05:18:54.636 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.636 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.636 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.636 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.637 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.637 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.637 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.637 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.637 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.637 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.637 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.637 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.637 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.637 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.637 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.637 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.637 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.637 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.638 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.638 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.638 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.638 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-08-20T05:18:54.638 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.638 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.638 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.638 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-08-20T05:18:54.638 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-08-20T05:18:54.638 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.639 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.639 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.639 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.639 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.639 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.639 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.639 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-08-20T05:18:54.639 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.639 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.639 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.639 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.639 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-08-20T05:18:54.639 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-08-20T05:18:54.639 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.640 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.640 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.640 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-08-20T05:18:54.640 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.640 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.640 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.640 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-08-20T05:18:54.640 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T05:18:54.640 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.640 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.640 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.640 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-08-20T05:18:54.640 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-08-20T05:18:54.641 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-20T05:18:54.641 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.641 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.641 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.641 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-08-20T05:18:54.641 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-08-20T05:18:54.641 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.641 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-20T05:18:54.641 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T05:18:54.641 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.641 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.641 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.641 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-08-20T05:18:54.642 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-08-20T05:18:54.642 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-20T05:18:54.642 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.642 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.642 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-08-20T05:18:54.642 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-20T05:18:54.642 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-08-20T05:18:54.642 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.642 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-20T05:18:54.642 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.642 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.642 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.643 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.643 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-08-20T05:18:54.643 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-08-20T05:18:54.643 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.643 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.643 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.643 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-08-20T05:18:54.643 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.643 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.643 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.643 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-20T05:18:54.643 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-20T05:18:54.643 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.643 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.644 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.644 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-08-20T05:18:54.644 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-08-20T05:18:54.644 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:54.644 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.644 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.644 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-08-20T05:18:54.644 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-08-20T05:18:54.644 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-08-20T05:18:54.644 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.644 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-08-20T05:18:54.644 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-20T05:18:54.644 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.644 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.645 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.645 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-08-20T05:18:54.645 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-08-20T05:18:54.645 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.645 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.645 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.645 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-08-20T05:18:54.645 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.645 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.645 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.645 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-08-20T05:18:54.645 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T05:18:54.646 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.646 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.646 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.646 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-08-20T05:18:54.646 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-08-20T05:18:54.646 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-20T05:18:54.646 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.646 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.646 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.646 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-08-20T05:18:54.646 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-08-20T05:18:54.647 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.647 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-20T05:18:54.647 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T05:18:54.647 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.647 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.647 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.647 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.647 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.647 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.647 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.647 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.648 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.648 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.648 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.648 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.648 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.648 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.648 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.648 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.648 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.648 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.648 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.648 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.648 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.649 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.649 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.649 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.649 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.649 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.649 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.649 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.649 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.649 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.649 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.649 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.649 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.649 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.649 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.649 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.650 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.650 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.650 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.650 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.650 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.650 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.650 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.650 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.650 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.650 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.650 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.650 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.650 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.651 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.651 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.651 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.651 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.651 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.651 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.651 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.651 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.651 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.651 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.651 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.651 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.651 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.651 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.652 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.652 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.652 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.652 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.652 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.652 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.652 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.652 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.652 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.652 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.652 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-08-20T05:18:54.652 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-08-20T05:18:54.652 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:54.653 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.653 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.653 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.653 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.653 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.653 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.653 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-20T05:18:54.653 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.653 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.653 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.653 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.654 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-08-20T05:18:54.654 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-08-20T05:18:54.654 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.654 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.654 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.654 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-08-20T05:18:54.654 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.654 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.654 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.654 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-08-20T05:18:54.654 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-08-20T05:18:54.654 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-08-20T05:18:54.654 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-08-20T05:18:54.654 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-08-20T05:18:54.655 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.655 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-08-20T05:18:54.655 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.655 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.655 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.655 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.655 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-08-20T05:18:54.655 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-08-20T05:18:54.655 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.655 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.655 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.655 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.655 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.655 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.656 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.656 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-20T05:18:54.656 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.656 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.656 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.656 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.656 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-20T05:18:54.656 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-20T05:18:54.656 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.656 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.656 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.656 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-20T05:18:54.656 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.657 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.657 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.657 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-20T05:18:54.657 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.657 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.657 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.657 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.657 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.657 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.657 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.657 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.657 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.657 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.657 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.658 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.658 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.658 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.658 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.658 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.658 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.658 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.658 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-08-20T05:18:54.658 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-08-20T05:18:54.658 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.658 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.658 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.659 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-20T05:18:54.659 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-20T05:18:54.659 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.659 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.659 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-20T05:18:54.659 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-20T05:18:54.659 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.659 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.659 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.659 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-08-20T05:18:54.659 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-08-20T05:18:54.659 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-20T05:18:54.659 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.659 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.660 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:54.660 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.660 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.660 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.660 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-20T05:18:54.660 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.660 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.660 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.660 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.660 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.661 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.661 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.661 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-08-20T05:18:54.661 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.661 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.661 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.661 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-08-20T05:18:54.661 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-08-20T05:18:54.661 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:54.661 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.661 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.661 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-08-20T05:18:54.661 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.661 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.662 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.662 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-20T05:18:54.662 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.662 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.662 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.662 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.662 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-08-20T05:18:54.662 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-08-20T05:18:54.662 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.662 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.662 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.662 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-08-20T05:18:54.662 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.663 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.663 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.663 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-20T05:18:54.663 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.663 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.663 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.663 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.663 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-08-20T05:18:54.663 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-08-20T05:18:54.663 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.663 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.663 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.663 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-08-20T05:18:54.663 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.664 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.664 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.664 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-20T05:18:54.664 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.664 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.664 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.664 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.664 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-08-20T05:18:54.664 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-08-20T05:18:54.664 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.664 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.664 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.664 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.664 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.664 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.665 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.665 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-20T05:18:54.665 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-20T05:18:54.665 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.665 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.665 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.665 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-08-20T05:18:54.665 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-08-20T05:18:54.665 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.665 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.665 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.665 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-20T05:18:54.666 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.666 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.666 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.666 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-20T05:18:54.666 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.666 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.666 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.666 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.666 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-08-20T05:18:54.666 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-08-20T05:18:54.666 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:54.666 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.666 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.666 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-08-20T05:18:54.667 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.667 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.667 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.667 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-20T05:18:54.667 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.667 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.667 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.667 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.667 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-08-20T05:18:54.667 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-08-20T05:18:54.667 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.667 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.667 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.667 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.668 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.668 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.668 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.668 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-08-20T05:18:54.668 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-08-20T05:18:54.668 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-08-20T05:18:54.668 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.668 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-20T05:18:54.668 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.668 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.668 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.668 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.668 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-08-20T05:18:54.668 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-08-20T05:18:54.668 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.669 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.669 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.669 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.669 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.669 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.669 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.669 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-20T05:18:54.669 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.669 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.669 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.669 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.669 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-08-20T05:18:54.669 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-08-20T05:18:54.669 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.670 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.670 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.670 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.670 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.670 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.670 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.670 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-20T05:18:54.670 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.670 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.670 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.670 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.670 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-08-20T05:18:54.671 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-08-20T05:18:54.671 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.671 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.671 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.671 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.671 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.671 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.671 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.671 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-20T05:18:54.671 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.671 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.671 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.671 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.671 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-08-20T05:18:54.671 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-08-20T05:18:54.672 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.672 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.672 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.672 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-20T05:18:54.672 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.672 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.672 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.672 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-20T05:18:54.672 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.672 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.672 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.672 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.672 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-08-20T05:18:54.672 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-08-20T05:18:54.672 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.673 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.673 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.673 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-20T05:18:54.673 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.673 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.673 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.673 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-08-20T05:18:54.673 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.673 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.673 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.673 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.673 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-08-20T05:18:54.673 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-08-20T05:18:54.673 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.673 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.674 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.674 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-20T05:18:54.674 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.674 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.674 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.674 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-08-20T05:18:54.674 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.674 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.674 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.674 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.674 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-08-20T05:18:54.674 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-08-20T05:18:54.674 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-20T05:18:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-20T05:18:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-08-20T05:18:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-08-20T05:18:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.675 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-20T05:18:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-08-20T05:18:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-08-20T05:18:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-08-20T05:18:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.676 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-20T05:18:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-08-20T05:18:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-08-20T05:18:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-08-20T05:18:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.677 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-20T05:18:54.678 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.678 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.678 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.678 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-08-20T05:18:54.678 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.678 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.678 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.678 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.678 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-08-20T05:18:54.678 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-08-20T05:18:54.678 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.678 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.678 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.678 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-20T05:18:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-08-20T05:18:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-08-20T05:18:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-08-20T05:18:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-20T05:18:54.679 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-08-20T05:18:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-08-20T05:18:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-08-20T05:18:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-20T05:18:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.680 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-08-20T05:18:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nginx": { 2024-08-20T05:18:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nginx", 2024-08-20T05:18:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-20T05:18:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.681 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nginx container image", 2024-08-20T05:18:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-08-20T05:18:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-08-20T05:18:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-20T05:18:54.682 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-20T05:18:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-08-20T05:18:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-08-20T05:18:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-20T05:18:54.683 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-08-20T05:18:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-08-20T05:18:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-08-20T05:18:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-20T05:18:54.684 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-20T05:18:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-08-20T05:18:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-08-20T05:18:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-20T05:18:54.685 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-08-20T05:18:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-08-20T05:18:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-08-20T05:18:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.686 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-20T05:18:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-08-20T05:18:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-08-20T05:18:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-08-20T05:18:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.687 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-20T05:18:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-08-20T05:18:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-08-20T05:18:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-08-20T05:18:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.688 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-08-20T05:18:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-08-20T05:18:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-08-20T05:18:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-20T05:18:54.689 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-20T05:18:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-08-20T05:18:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-08-20T05:18:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-08-20T05:18:54.690 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-20T05:18:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-08-20T05:18:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-08-20T05:18:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-08-20T05:18:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.691 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.692 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.692 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-20T05:18:54.692 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.692 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.692 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.692 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.692 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-08-20T05:18:54.692 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-08-20T05:18:54.692 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.692 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.692 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.692 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-08-20T05:18:54.692 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.692 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.693 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.693 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-08-20T05:18:54.693 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.693 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.693 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.693 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.693 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-08-20T05:18:54.693 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-08-20T05:18:54.693 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.693 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.693 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.693 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.693 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.693 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.694 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.694 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-20T05:18:54.694 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.694 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.694 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.694 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.694 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-08-20T05:18:54.694 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-08-20T05:18:54.694 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.694 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.694 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.694 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-20T05:18:54.694 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.694 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.694 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.695 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-08-20T05:18:54.695 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.695 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.695 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.695 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.695 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-08-20T05:18:54.695 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-08-20T05:18:54.695 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.695 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.695 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.695 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-20T05:18:54.695 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.695 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.695 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.695 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-20T05:18:54.696 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.696 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.696 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.696 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.696 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-08-20T05:18:54.696 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-08-20T05:18:54.696 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.696 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.696 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.696 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-20T05:18:54.696 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.696 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.696 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.696 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-08-20T05:18:54.697 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.697 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.697 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.697 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.697 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-08-20T05:18:54.697 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-08-20T05:18:54.697 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.697 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.697 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.697 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.697 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.697 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.697 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.697 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-20T05:18:54.698 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.698 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.698 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.698 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.698 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-08-20T05:18:54.698 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-08-20T05:18:54.698 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.698 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.698 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.698 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.698 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.698 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.699 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.699 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-20T05:18:54.699 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.699 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.699 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.699 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.699 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.699 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.699 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.699 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.699 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.700 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.700 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.700 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.700 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.700 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.700 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.700 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.700 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.700 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.700 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.700 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.700 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.700 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.700 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.700 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.701 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.701 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-08-20T05:18:54.701 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-08-20T05:18:54.701 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.701 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.701 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.701 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.701 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.701 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.701 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.701 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-20T05:18:54.701 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.701 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.701 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.701 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.702 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.702 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.702 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.702 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.702 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.702 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.702 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.702 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.702 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.702 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-20T05:18:54.702 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.702 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.702 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.702 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.703 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.703 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.703 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.703 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.703 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.703 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.703 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.703 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.703 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.703 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.703 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.703 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.703 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.703 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.703 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.704 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-20T05:18:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-20T05:18:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.705 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-20T05:18:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-20T05:18:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-20T05:18:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-08-20T05:18:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.706 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-20T05:18:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-08-20T05:18:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-08-20T05:18:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.707 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-08-20T05:18:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-08-20T05:18:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-08-20T05:18:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.708 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-20T05:18:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-08-20T05:18:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-08-20T05:18:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-08-20T05:18:54.709 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-08-20T05:18:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-08-20T05:18:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-08-20T05:18:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-08-20T05:18:54.710 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-08-20T05:18:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-08-20T05:18:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-08-20T05:18:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-08-20T05:18:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-08-20T05:18:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.711 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-20T05:18:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-08-20T05:18:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-08-20T05:18:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-20T05:18:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.712 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-20T05:18:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-08-20T05:18:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-08-20T05:18:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.713 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-20T05:18:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-08-20T05:18:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-08-20T05:18:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.714 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-20T05:18:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-08-20T05:18:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-08-20T05:18:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-20T05:18:54.715 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-08-20T05:18:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-08-20T05:18:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-20T05:18:54.716 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-08-20T05:18:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-08-20T05:18:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.717 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-20T05:18:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-08-20T05:18:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-08-20T05:18:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-08-20T05:18:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-08-20T05:18:54.718 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.719 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-08-20T05:18:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-08-20T05:18:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-20T05:18:54.720 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-08-20T05:18:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-08-20T05:18:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-20T05:18:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.721 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-08-20T05:18:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-08-20T05:18:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-20T05:18:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.722 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-08-20T05:18:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-08-20T05:18:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-08-20T05:18:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.723 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-08-20T05:18:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-08-20T05:18:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-20T05:18:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.724 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-08-20T05:18:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-08-20T05:18:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-20T05:18:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.725 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-08-20T05:18:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.726 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.727 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.728 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.729 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.730 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-08-20T05:18:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-08-20T05:18:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-08-20T05:18:54.731 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-20T05:18:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.732 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-08-20T05:18:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-08-20T05:18:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.733 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-08-20T05:18:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-20T05:18:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-08-20T05:18:54.734 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-20T05:18:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-20T05:18:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.735 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-08-20T05:18:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-20T05:18:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.736 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-20T05:18:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-20T05:18:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.737 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-08-20T05:18:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-08-20T05:18:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.738 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-20T05:18:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-20T05:18:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.739 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-08-20T05:18:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-20T05:18:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-20T05:18:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-20T05:18:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.741 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-20T05:18:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-20T05:18:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.742 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-20T05:18:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-20T05:18:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.743 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-20T05:18:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-20T05:18:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.744 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-20T05:18:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-20T05:18:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.745 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-20T05:18:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-20T05:18:54.746 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-20T05:18:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-20T05:18:54.747 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.748 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.748 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.748 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.748 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.748 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.748 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.748 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.748 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.748 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.748 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.748 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.749 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-20T05:18:54.749 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-20T05:18:54.749 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.749 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.749 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.749 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.749 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.749 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.749 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.749 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.749 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.749 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.749 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.750 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.750 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-08-20T05:18:54.750 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-20T05:18:54.750 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.750 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.750 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.750 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-20T05:18:54.750 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.750 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.750 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.750 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.750 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.750 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.750 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.750 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.751 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-20T05:18:54.751 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-20T05:18:54.751 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.751 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.751 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.751 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.751 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.751 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.751 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.751 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.751 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.751 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.751 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.751 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.752 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-08-20T05:18:54.752 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-08-20T05:18:54.752 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.752 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.752 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.752 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.752 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.752 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.752 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.752 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.752 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.752 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.752 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.752 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.753 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-08-20T05:18:54.753 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-20T05:18:54.753 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.753 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.753 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.753 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-20T05:18:54.753 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.753 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.753 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.753 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.753 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.753 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.753 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.754 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.754 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-20T05:18:54.754 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-20T05:18:54.754 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.754 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.754 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.754 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.754 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.754 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.754 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.754 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.754 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.754 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.755 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.755 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.755 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-20T05:18:54.755 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-20T05:18:54.755 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.755 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.755 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.755 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.755 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.755 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.755 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.755 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.755 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.756 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.756 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.756 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.756 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-20T05:18:54.756 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-20T05:18:54.756 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.756 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.756 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.756 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.756 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.756 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.756 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.756 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.756 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.756 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.757 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.757 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.757 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-20T05:18:54.757 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-20T05:18:54.757 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.757 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.757 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.757 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.757 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.757 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.757 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.757 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.757 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.757 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.758 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.758 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.758 INFO:teuthology.orchestra.run.smithi037.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-20T05:18:54.758 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-20T05:18:54.758 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.758 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.758 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.758 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "[]", 2024-08-20T05:18:54.758 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.758 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.758 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.758 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.758 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.759 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.759 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.759 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.759 INFO:teuthology.orchestra.run.smithi037.stdout: "MULTICLUSTER_CONFIG": { 2024-08-20T05:18:54.759 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-20T05:18:54.759 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.759 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.759 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.759 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "{}", 2024-08-20T05:18:54.759 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.759 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.759 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.759 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.759 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.759 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.760 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.760 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.760 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-08-20T05:18:54.760 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-20T05:18:54.760 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.760 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.760 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.760 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.760 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.760 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.760 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.760 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.761 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.761 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.761 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.761 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.761 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-20T05:18:54.761 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-20T05:18:54.761 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.761 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.761 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.761 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.761 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.761 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.761 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.762 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.762 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.762 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.762 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.762 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.762 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-20T05:18:54.762 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-20T05:18:54.762 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.762 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.762 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.762 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.762 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.762 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.763 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.763 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.763 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.763 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.763 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.763 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.763 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-20T05:18:54.763 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-20T05:18:54.763 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.763 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.763 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.763 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.763 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.763 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.764 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.764 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.764 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.764 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.764 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.764 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.764 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-20T05:18:54.764 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-20T05:18:54.764 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.764 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.764 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.764 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.764 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.764 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.764 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.765 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.765 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.765 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.765 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.765 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.765 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-20T05:18:54.765 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-20T05:18:54.765 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.765 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.765 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.765 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.765 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.765 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.766 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.766 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.766 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.766 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.766 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.766 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.766 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-20T05:18:54.766 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-20T05:18:54.766 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.766 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.766 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.766 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.766 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.767 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.767 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.767 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.767 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.767 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.767 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.767 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.767 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-20T05:18:54.767 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-20T05:18:54.767 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.767 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.767 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.767 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.767 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.768 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.768 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.768 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.768 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.768 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.768 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.768 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.768 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-20T05:18:54.768 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-20T05:18:54.768 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.768 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.768 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.768 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.768 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.769 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.769 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.769 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.769 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.769 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.769 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.769 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.769 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-08-20T05:18:54.769 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-20T05:18:54.769 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.769 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.769 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.769 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.769 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.770 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.770 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.770 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.770 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.770 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.770 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.770 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.770 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-20T05:18:54.770 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-20T05:18:54.770 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.770 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.770 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.771 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-20T05:18:54.771 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.771 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.771 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.771 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.771 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.771 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.771 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.771 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.771 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-20T05:18:54.771 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-20T05:18:54.771 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.771 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.771 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.772 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:54.772 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.772 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.772 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.772 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.772 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.772 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.772 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.772 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.772 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-20T05:18:54.772 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-20T05:18:54.772 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.772 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.772 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.772 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-08-20T05:18:54.773 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.773 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.773 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.773 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.773 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.773 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.773 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.773 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.773 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-20T05:18:54.773 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-20T05:18:54.773 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.773 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.773 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.773 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-08-20T05:18:54.773 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.774 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.774 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.774 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.774 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.774 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.774 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.774 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.774 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-08-20T05:18:54.774 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-20T05:18:54.774 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.774 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.774 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.775 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.775 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.775 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.775 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.775 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.775 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.775 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.775 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.775 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.775 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-20T05:18:54.775 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-20T05:18:54.775 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.775 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.775 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.775 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-20T05:18:54.776 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.776 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.776 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.776 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.776 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.776 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.776 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.776 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.776 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-08-20T05:18:54.776 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-20T05:18:54.776 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.776 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.776 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.776 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.777 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.777 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.777 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.777 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.777 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.777 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.777 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.777 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.777 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-08-20T05:18:54.777 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-20T05:18:54.777 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.777 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.777 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.777 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.778 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.778 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.778 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.778 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.778 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.778 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.778 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.778 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.778 INFO:teuthology.orchestra.run.smithi037.stdout: "UNSAFE_TLS_v1_2": { 2024-08-20T05:18:54.778 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-20T05:18:54.778 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.778 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.778 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.778 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.778 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.779 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.779 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.779 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.779 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.779 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.779 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.779 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.779 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-20T05:18:54.779 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-20T05:18:54.779 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.779 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.779 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.779 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.779 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.779 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.780 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.780 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.780 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.780 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.780 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.780 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.780 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-20T05:18:54.780 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-20T05:18:54.780 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.780 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.780 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.780 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:54.780 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.780 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.780 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.781 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.781 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.781 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.781 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.781 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.781 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-20T05:18:54.781 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-20T05:18:54.781 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.781 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.781 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.781 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-20T05:18:54.781 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.781 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.781 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.781 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.782 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.782 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.782 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.782 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.782 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-08-20T05:18:54.782 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-08-20T05:18:54.782 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.782 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.782 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.782 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.782 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.782 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.782 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.782 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.783 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.783 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.783 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.783 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.783 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-08-20T05:18:54.783 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-08-20T05:18:54.783 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.783 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.783 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.783 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.783 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.783 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.783 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.784 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.784 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.784 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.784 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.784 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.784 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-08-20T05:18:54.784 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-08-20T05:18:54.784 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.784 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.784 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.784 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.784 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.784 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.784 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.784 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-08-20T05:18:54.785 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.785 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.785 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.785 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.785 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-08-20T05:18:54.785 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-08-20T05:18:54.785 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.785 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.785 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.785 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-08-20T05:18:54.785 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.785 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.785 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.786 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.786 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.786 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.786 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.786 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.786 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-08-20T05:18:54.786 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-08-20T05:18:54.786 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.786 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.786 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.786 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.786 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.786 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.786 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.787 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.787 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.787 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.787 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.787 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.787 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.787 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.787 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.787 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.787 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.787 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.787 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.787 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.788 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.788 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.788 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.788 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.788 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.788 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.788 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.788 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.788 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.788 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.788 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.788 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.788 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.788 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.789 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.789 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.789 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.789 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.789 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.789 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.789 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.789 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.789 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.789 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.789 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.789 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.789 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.789 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.790 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.790 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.790 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.790 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.790 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.790 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.790 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.790 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.790 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.790 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.790 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.790 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.790 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.790 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.790 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.791 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.791 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.791 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.791 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.791 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.791 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.791 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.791 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.791 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.791 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.791 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.791 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.791 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.791 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.792 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.792 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.792 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.792 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.792 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.792 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-08-20T05:18:54.792 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-08-20T05:18:54.792 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.792 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.792 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.792 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.792 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.792 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.792 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.792 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-08-20T05:18:54.793 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.793 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.793 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.793 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.793 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-08-20T05:18:54.793 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-08-20T05:18:54.793 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.793 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.793 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.793 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.793 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.793 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.793 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.793 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.794 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.794 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.794 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.794 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.794 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-20T05:18:54.794 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-20T05:18:54.794 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.794 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.794 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.794 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-08-20T05:18:54.794 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.794 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.794 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.794 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.794 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.795 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.795 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.795 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.795 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-20T05:18:54.795 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-20T05:18:54.795 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.795 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.795 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.795 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-08-20T05:18:54.795 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.795 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.795 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.795 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.795 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.795 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.796 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.796 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.796 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.796 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.796 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.796 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.796 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.796 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.796 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.796 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.796 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.796 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.796 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.796 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.796 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.797 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.797 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-08-20T05:18:54.797 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-08-20T05:18:54.797 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.797 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.797 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.797 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.797 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.797 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.797 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.797 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.797 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.797 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.797 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.798 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.798 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-08-20T05:18:54.798 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-08-20T05:18:54.798 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.798 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.798 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.798 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-08-20T05:18:54.798 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.798 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.798 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.798 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.798 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.798 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.798 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.799 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.799 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-08-20T05:18:54.799 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-08-20T05:18:54.799 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.799 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.799 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.799 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-08-20T05:18:54.799 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.799 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.799 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.799 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.800 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-08-20T05:18:54.800 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.800 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.800 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.800 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.800 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.800 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.800 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-08-20T05:18:54.800 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-08-20T05:18:54.800 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.800 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.800 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.800 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-08-20T05:18:54.800 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-08-20T05:18:54.801 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-08-20T05:18:54.801 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.801 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.801 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.801 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.801 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.801 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.801 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-08-20T05:18:54.801 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-08-20T05:18:54.801 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.801 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.801 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.801 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.801 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.801 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.802 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.802 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.802 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.802 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.802 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.802 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.802 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.802 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.802 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.802 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-08-20T05:18:54.802 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.802 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.802 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.802 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-08-20T05:18:54.803 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-08-20T05:18:54.803 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.803 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.803 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.803 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.803 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.803 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.803 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.803 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-08-20T05:18:54.803 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.803 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.803 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.803 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.803 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.803 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.804 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.804 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.804 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.804 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.804 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.804 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.804 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.804 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.804 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.804 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.804 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.804 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.804 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.804 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.804 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.805 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.805 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.805 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.805 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.805 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.805 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.805 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.805 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.805 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.805 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.805 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.805 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.805 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.805 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.806 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.806 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.806 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.806 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.806 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.806 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.806 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.806 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.806 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.806 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.806 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.806 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.806 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.807 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.807 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.807 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.807 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.807 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.807 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.807 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.807 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.807 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.807 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.807 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.807 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.807 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.807 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.807 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.808 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.808 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.808 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.808 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.808 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.808 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.808 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.808 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.808 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.808 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.808 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.808 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-08-20T05:18:54.808 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-08-20T05:18:54.808 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.809 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.809 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.809 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-08-20T05:18:54.809 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.809 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.809 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.809 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-20T05:18:54.809 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.809 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.809 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.809 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.809 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-08-20T05:18:54.809 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-08-20T05:18:54.809 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.810 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.810 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.810 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-08-20T05:18:54.810 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.810 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.810 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.810 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-20T05:18:54.810 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.810 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.810 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.810 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.811 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-08-20T05:18:54.811 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-08-20T05:18:54.811 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.811 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.811 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.811 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-08-20T05:18:54.811 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.811 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.811 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.811 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-08-20T05:18:54.811 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.811 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.811 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.812 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.812 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-08-20T05:18:54.812 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-08-20T05:18:54.812 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.812 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.812 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.812 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-08-20T05:18:54.812 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.812 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.812 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.812 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-20T05:18:54.812 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.812 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.812 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.812 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.813 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-08-20T05:18:54.813 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-08-20T05:18:54.813 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.813 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.813 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.813 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.813 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.813 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.813 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.813 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-20T05:18:54.813 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.813 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.813 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.813 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.814 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-20T05:18:54.814 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-20T05:18:54.814 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.814 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.814 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.814 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-20T05:18:54.814 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.814 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.814 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.814 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-08-20T05:18:54.814 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.814 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.814 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.815 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.815 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.815 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.815 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.815 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.815 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.815 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.815 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.815 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.815 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.815 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.815 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.815 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.815 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.816 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.816 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-08-20T05:18:54.816 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-08-20T05:18:54.816 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.816 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.816 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.816 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-08-20T05:18:54.816 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.816 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.816 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.816 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-20T05:18:54.816 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.816 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.816 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.817 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.817 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.817 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.817 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.817 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-08-20T05:18:54.817 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.817 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.817 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.817 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.817 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.817 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.817 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.817 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.817 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.818 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.818 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.818 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.818 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.818 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.818 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.818 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.818 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.818 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.818 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.818 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.818 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.818 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.818 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.819 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.819 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.819 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.819 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.819 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.819 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.819 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.819 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.819 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.819 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.819 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.819 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.819 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.819 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.820 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.820 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.820 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.820 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.820 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.820 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.820 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.820 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.820 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.820 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.820 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.820 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.820 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.821 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.821 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.821 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.821 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.821 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.821 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.821 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.821 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.821 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.821 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.821 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.821 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.822 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.822 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.822 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.822 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.822 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.822 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.822 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.822 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.822 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.822 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.822 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.822 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-08-20T05:18:54.822 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-08-20T05:18:54.822 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.823 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.823 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.823 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-08-20T05:18:54.823 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.823 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.823 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.823 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.823 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.823 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.823 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.823 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.823 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-08-20T05:18:54.823 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-08-20T05:18:54.823 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.824 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.824 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.824 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-08-20T05:18:54.824 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.824 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.824 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.824 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.824 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.824 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.824 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.824 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.824 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-20T05:18:54.825 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-20T05:18:54.825 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.825 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.825 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.825 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-20T05:18:54.825 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.825 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.825 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.825 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.825 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.825 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.825 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.825 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.825 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.826 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.826 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.826 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.826 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.826 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.826 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.826 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.826 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.826 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.826 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.826 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.826 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.826 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.827 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.827 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.827 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.827 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-08-20T05:18:54.827 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-08-20T05:18:54.827 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-08-20T05:18:54.827 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.827 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-08-20T05:18:54.827 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-08-20T05:18:54.827 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.827 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.827 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.827 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-08-20T05:18:54.827 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.828 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.828 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.828 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-20T05:18:54.828 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.828 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.828 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.828 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.828 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-08-20T05:18:54.828 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-08-20T05:18:54.828 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.828 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.828 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.828 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-08-20T05:18:54.828 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.828 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.829 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.829 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-20T05:18:54.829 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.829 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.829 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.829 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.829 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-08-20T05:18:54.829 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-08-20T05:18:54.829 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.829 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.829 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.829 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.830 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.830 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.830 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.830 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-08-20T05:18:54.830 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.830 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.830 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.830 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-20T05:18:54.830 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-20T05:18:54.830 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.830 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.830 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.831 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-08-20T05:18:54.831 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-08-20T05:18:54.831 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.831 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.831 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-20T05:18:54.831 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.831 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.831 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.831 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.831 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.831 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.831 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.831 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.831 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.832 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.832 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.832 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.832 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.832 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.832 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.832 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.832 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.832 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.832 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.832 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.832 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.832 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.832 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.833 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.833 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.833 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.833 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.833 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.833 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.833 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.833 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.833 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.833 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.833 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.833 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.834 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.834 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.834 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.834 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.834 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.834 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.834 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.834 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.834 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.834 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.834 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.835 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.835 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.835 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.835 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.835 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.835 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.835 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.835 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.835 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.835 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.835 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.835 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.835 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.836 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.836 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.836 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.836 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.836 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.836 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.836 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.836 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.836 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.836 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.836 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.836 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.836 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.836 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-08-20T05:18:54.836 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-08-20T05:18:54.837 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.837 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.837 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.837 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.837 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.837 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.837 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.837 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-08-20T05:18:54.837 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.837 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.837 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.837 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.837 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-08-20T05:18:54.837 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-08-20T05:18:54.837 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.838 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.838 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.838 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-08-20T05:18:54.838 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.838 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.838 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.838 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-08-20T05:18:54.838 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.838 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.838 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.838 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.839 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.839 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.839 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.839 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.839 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.839 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.839 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.839 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.839 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.839 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.839 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.839 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.839 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.839 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.840 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-08-20T05:18:54.840 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-08-20T05:18:54.840 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.840 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.840 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.840 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-08-20T05:18:54.840 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.840 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.840 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.840 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T05:18:54.840 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.840 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.840 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.840 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-08-20T05:18:54.841 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-08-20T05:18:54.841 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.841 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.841 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.841 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-20T05:18:54.841 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-20T05:18:54.841 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-08-20T05:18:54.841 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.841 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-20T05:18:54.841 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.841 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.841 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.841 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.841 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-08-20T05:18:54.842 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-08-20T05:18:54.842 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.842 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.842 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.842 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.842 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.842 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.842 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.842 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-08-20T05:18:54.842 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.842 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.842 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.842 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.843 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-08-20T05:18:54.843 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-08-20T05:18:54.843 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.843 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.843 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.843 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-08-20T05:18:54.843 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.843 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.843 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.843 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T05:18:54.843 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.843 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.843 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.843 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.844 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.844 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.844 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.844 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-08-20T05:18:54.844 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.844 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.844 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.844 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.844 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.844 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.844 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.844 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.844 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.844 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.844 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.845 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.845 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.845 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.845 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.845 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.845 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.845 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.845 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.845 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.845 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.845 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.845 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.845 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.845 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.846 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.846 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.846 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.846 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.846 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.846 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.846 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.846 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.846 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.846 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.846 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.846 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.846 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.847 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.847 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.847 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.847 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.847 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.847 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.847 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.847 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.847 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.847 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.847 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.847 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.847 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.848 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.848 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.848 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.848 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.848 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.848 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.848 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.848 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.848 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.848 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.848 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.849 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.849 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.849 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.849 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.849 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.849 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.849 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.849 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.849 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.849 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.849 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.849 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.849 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.849 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.849 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.850 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.850 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.850 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.850 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.850 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.850 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.850 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.850 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.850 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.850 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.850 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.850 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.850 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.851 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-08-20T05:18:54.851 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.851 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.851 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.851 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.851 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.851 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.851 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.851 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.851 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.851 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.851 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.851 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.851 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.852 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.852 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.852 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.852 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.852 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.852 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.852 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.852 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.852 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.852 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.852 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.852 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.852 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.852 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.853 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.853 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.853 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.853 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.853 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.853 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.853 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.853 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.853 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.853 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.854 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.854 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.854 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.854 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.854 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.854 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.854 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.854 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.854 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.854 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.854 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.855 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.855 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.855 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.855 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.855 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.855 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.855 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.855 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.855 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.855 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.855 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.855 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.855 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.856 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.856 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.856 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.856 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.856 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.856 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.856 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.856 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.856 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.856 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.856 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.856 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.856 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.856 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.857 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.857 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.857 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.857 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.857 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.857 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.857 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.857 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.857 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.857 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.857 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.857 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.858 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.858 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.858 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.858 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-08-20T05:18:54.858 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.858 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.858 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.858 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-08-20T05:18:54.858 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-08-20T05:18:54.858 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.858 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.858 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.858 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-08-20T05:18:54.858 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.859 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.859 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.859 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-20T05:18:54.859 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.859 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.859 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.859 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.859 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-08-20T05:18:54.859 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-08-20T05:18:54.859 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.859 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.859 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.859 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:54.859 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-08-20T05:18:54.860 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.860 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.860 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-20T05:18:54.860 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.860 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.860 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.860 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.860 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.860 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.860 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.860 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.860 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.860 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.860 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.860 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.861 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.861 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.861 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.861 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.861 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.861 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.861 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.861 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.861 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.861 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.861 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.861 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.862 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.862 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.862 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.862 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.862 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.862 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.862 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.862 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.862 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.862 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.862 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.862 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.862 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.863 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.863 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.863 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.863 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.863 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.863 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.863 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.863 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.863 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.863 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.863 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.863 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.863 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.863 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.863 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.864 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.864 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.864 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.864 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.864 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.864 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.864 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.864 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.864 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.864 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.864 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.864 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.864 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.864 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.865 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.865 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.865 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.865 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.865 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.865 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.865 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.865 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.865 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.865 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.865 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.865 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.865 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.866 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.866 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.866 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.866 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.866 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.866 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.866 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.866 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.866 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.866 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.866 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.866 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.866 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-08-20T05:18:54.866 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.867 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.867 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.867 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-08-20T05:18:54.867 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-08-20T05:18:54.867 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.867 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.867 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.867 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-08-20T05:18:54.867 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.867 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.867 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.867 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-08-20T05:18:54.867 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-20T05:18:54.867 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.868 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.868 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.868 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.868 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.868 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.868 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.868 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.868 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.868 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.868 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.868 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.868 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.868 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.868 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.869 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.869 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.869 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.869 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.869 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.869 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.869 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.869 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.869 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.869 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.869 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.869 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.869 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.869 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.870 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.870 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.870 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.870 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.870 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.870 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.870 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.870 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.870 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.870 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.870 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.870 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.871 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.871 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.871 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.871 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.871 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.871 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.871 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.871 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.871 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.871 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.871 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.871 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.871 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.871 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.871 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.872 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.872 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.872 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.872 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.872 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.872 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.872 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.872 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.872 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.872 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.872 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.872 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.872 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.872 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.873 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.873 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.873 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.873 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-08-20T05:18:54.873 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-08-20T05:18:54.873 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.873 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.873 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.873 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.873 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.873 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.873 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.873 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-08-20T05:18:54.873 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-20T05:18:54.873 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.874 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.874 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.874 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-08-20T05:18:54.874 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-08-20T05:18:54.874 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.874 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.874 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.874 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-08-20T05:18:54.874 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.874 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.874 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.874 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-08-20T05:18:54.874 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.874 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.875 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.875 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.875 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-08-20T05:18:54.875 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-08-20T05:18:54.875 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.875 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.875 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.875 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-08-20T05:18:54.875 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.875 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.875 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.875 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-08-20T05:18:54.875 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.875 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.875 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.876 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.876 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-08-20T05:18:54.876 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-08-20T05:18:54.876 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.876 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.876 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.876 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.876 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.876 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.876 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.876 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-08-20T05:18:54.876 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.876 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.876 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.877 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.877 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.877 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.877 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.877 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.877 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.877 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.877 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.877 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.877 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.877 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.877 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.877 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.877 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.877 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.878 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-08-20T05:18:54.878 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-08-20T05:18:54.878 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.878 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.878 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.878 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-08-20T05:18:54.878 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.878 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.878 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.878 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-20T05:18:54.878 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-20T05:18:54.878 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.878 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.878 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.878 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.879 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.879 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.879 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-08-20T05:18:54.879 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.879 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.879 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.879 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.879 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.879 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.879 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.879 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.879 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.879 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.879 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.879 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.880 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.880 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.880 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.880 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.880 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.880 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.880 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.880 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.880 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.880 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.880 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.880 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.880 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.880 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.880 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.881 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.881 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.881 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.881 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.881 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.881 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.881 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.881 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.881 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.881 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.881 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.881 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.881 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.881 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.882 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.882 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.882 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.882 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.882 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.882 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.882 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.882 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.882 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.882 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.882 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.882 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.882 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.883 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.883 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.883 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.883 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.883 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.883 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.883 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.883 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.883 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.883 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.883 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.883 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.883 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.883 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.883 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.884 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.884 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.884 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.884 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.884 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.884 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.884 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.884 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.884 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.884 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.884 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.884 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.884 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.884 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.885 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.885 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.885 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.885 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.885 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.885 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.885 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.885 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-08-20T05:18:54.885 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.885 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.885 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.885 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.885 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.885 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.885 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.886 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.886 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.886 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.886 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.886 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.886 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.886 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.886 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.886 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.886 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.886 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.886 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.886 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.887 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.887 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.887 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.887 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.887 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.887 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.887 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.887 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.887 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.887 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.887 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.887 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.887 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.887 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.888 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.888 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.888 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.888 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.888 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.888 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.888 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.888 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.888 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.888 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.888 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.888 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.888 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.888 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.889 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.889 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.889 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.889 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.889 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.889 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.889 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.889 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.889 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.889 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.889 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.889 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.889 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.889 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.890 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.890 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.890 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.890 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.890 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.890 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.890 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.890 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.890 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.890 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.890 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.890 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.890 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.890 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.890 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.891 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.891 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.891 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.891 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.891 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.891 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.891 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.891 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.891 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.891 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.891 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.891 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.891 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.891 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-08-20T05:18:54.892 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.892 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.892 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.892 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.892 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.892 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.892 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.892 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.892 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.892 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.892 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.892 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.892 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.892 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.892 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.893 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.893 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.893 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.893 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.893 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.893 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.893 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.893 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.893 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.893 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.893 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.893 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.893 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.893 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.894 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.894 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.894 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.894 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.894 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.894 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.894 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.894 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.894 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.894 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.894 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.894 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.895 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.895 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.895 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.895 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.895 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.895 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.895 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.895 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.895 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.895 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.895 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.895 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.895 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.895 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.896 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.896 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.896 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.896 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.896 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.896 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.896 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.896 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.896 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.896 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.896 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.896 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.896 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.896 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.897 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.897 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.897 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.897 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.897 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.897 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.897 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.897 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.897 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.897 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.897 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.897 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.897 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.897 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.897 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.898 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.898 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.898 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.898 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.898 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.898 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.898 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-08-20T05:18:54.898 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.898 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.898 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.898 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-08-20T05:18:54.898 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-08-20T05:18:54.898 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.899 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.899 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.899 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.899 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.899 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.899 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.899 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-20T05:18:54.899 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.899 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.899 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.899 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.899 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.899 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.900 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.900 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.900 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.900 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.900 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.900 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.900 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.900 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.900 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.900 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.900 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.901 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.901 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.901 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.901 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.901 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.901 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.901 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.901 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.901 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.901 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.901 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.901 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.901 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.901 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.901 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.902 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.902 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.902 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.902 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.902 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.902 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.902 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.902 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.902 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.902 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.902 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.902 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.902 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.902 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.903 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.903 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.903 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.903 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.903 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.903 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.903 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.903 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.903 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.903 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.903 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.903 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.903 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.903 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.903 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.904 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.904 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.904 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.904 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.904 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.904 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.904 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.904 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.904 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.904 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.904 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.904 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.904 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.904 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-08-20T05:18:54.904 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-08-20T05:18:54.905 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.905 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.905 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.905 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.905 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.905 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.905 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.905 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-08-20T05:18:54.905 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-08-20T05:18:54.905 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-08-20T05:18:54.905 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.905 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-08-20T05:18:54.905 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.905 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.906 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.906 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.906 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.906 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.906 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.906 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.906 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.906 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.906 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.906 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.906 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.906 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.906 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.906 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.907 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.907 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.907 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.907 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.907 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.907 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-08-20T05:18:54.907 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.907 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.907 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.907 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.907 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.907 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.907 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.907 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.907 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.908 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.908 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.908 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.908 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.908 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.908 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.908 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.908 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.908 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.908 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.908 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.908 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.908 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.908 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.909 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.909 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.909 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.909 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.909 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.909 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.909 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.909 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.909 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.909 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.909 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.909 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.909 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.909 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.909 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.910 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.910 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.910 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.910 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.910 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.910 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.910 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.910 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.910 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.910 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.910 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.910 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.910 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.911 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.911 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.911 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.911 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.911 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.911 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.911 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.911 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.911 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.911 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.911 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.911 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.911 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.911 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.911 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.912 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.912 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.912 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.912 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.912 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.912 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.912 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.912 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.912 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.912 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.912 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.912 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.912 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.912 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.912 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.913 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.913 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.913 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.913 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.913 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.913 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.913 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.913 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.913 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.913 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-08-20T05:18:54.913 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.913 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.913 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.913 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.913 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.914 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.914 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.914 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.914 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.914 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.914 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.914 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.914 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.914 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.914 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.914 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.914 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.914 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.914 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.914 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.915 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.915 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.915 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.915 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.915 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.915 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.915 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.915 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.915 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.915 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.915 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.915 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.915 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.915 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.915 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.916 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.916 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.916 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.916 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.916 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.916 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.916 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.916 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.916 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.916 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.916 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.916 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.916 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.916 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.917 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.917 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.917 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.917 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.917 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.917 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.917 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.917 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.917 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.917 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.917 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.917 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.917 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.917 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.917 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.918 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.918 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.918 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.918 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.918 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.918 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.918 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.918 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.918 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.918 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.918 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.918 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.918 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.919 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.919 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.919 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.919 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.919 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.919 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.919 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.919 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.919 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.919 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.919 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.919 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.919 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.919 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-08-20T05:18:54.919 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.919 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.920 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.921 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.921 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.921 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.921 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.921 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.921 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.921 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.921 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.921 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.921 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.921 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.921 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.921 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.921 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.922 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.922 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.922 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.922 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.922 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.922 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.922 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.922 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.922 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.922 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.922 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.922 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.922 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.922 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.923 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.923 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.923 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.923 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.923 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.923 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.923 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.923 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.923 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.923 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.923 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.923 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.923 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.923 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.924 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.924 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.924 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.924 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.924 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.924 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.924 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.924 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.924 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.924 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.924 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.924 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.924 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.924 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.925 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-20T05:18:54.925 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-20T05:18:54.925 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.925 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.925 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.925 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-20T05:18:54.925 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.925 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.925 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.925 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.925 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.925 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.925 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.926 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.926 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.926 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.926 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.926 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.926 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.926 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.926 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.926 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.926 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.926 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.926 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.926 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.927 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.927 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.927 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-08-20T05:18:54.927 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-08-20T05:18:54.927 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:54.927 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.927 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.927 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-08-20T05:18:54.927 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-08-20T05:18:54.927 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.927 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.927 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-08-20T05:18:54.927 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-20T05:18:54.928 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.928 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.928 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.928 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.928 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.928 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.928 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-08-20T05:18:54.928 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.928 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.928 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.928 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-08-20T05:18:54.928 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-08-20T05:18:54.928 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.929 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.929 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.929 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.929 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.929 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.929 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.929 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-20T05:18:54.929 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.929 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.929 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.929 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.929 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-08-20T05:18:54.929 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-08-20T05:18:54.930 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.930 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.930 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.930 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.930 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.930 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.930 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.930 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.930 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.930 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.930 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.930 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.931 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.931 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.931 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.931 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.931 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.931 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.931 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.931 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.931 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.931 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.931 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.931 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.931 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.931 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.932 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.932 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.932 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.932 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.932 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.932 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.932 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.932 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.932 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.932 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.932 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.932 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.932 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.932 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.932 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.932 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.933 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.933 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.933 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.933 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.933 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.933 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.933 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.933 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.933 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.933 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.933 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.933 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.933 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.933 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.934 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.934 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.934 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.934 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.934 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.934 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.934 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.934 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.934 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.934 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.935 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.935 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.935 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.935 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.935 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.935 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.935 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.935 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.935 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.935 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.935 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.935 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.935 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.935 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.936 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.936 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.936 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-08-20T05:18:54.936 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-08-20T05:18:54.936 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.936 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.936 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.936 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-08-20T05:18:54.936 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.936 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.936 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.936 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-08-20T05:18:54.936 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.937 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.937 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.937 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.937 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-20T05:18:54.937 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-20T05:18:54.937 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:54.937 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.937 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.937 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-20T05:18:54.937 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.937 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.937 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.937 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-08-20T05:18:54.938 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.938 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.938 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.938 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.938 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.938 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.938 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.938 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.938 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.938 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.938 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.938 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.939 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.939 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.939 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.939 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.939 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.939 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.939 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.939 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.939 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.939 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-08-20T05:18:54.939 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.939 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.940 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.940 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-08-20T05:18:54.940 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-08-20T05:18:54.940 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.940 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.940 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.940 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.940 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.940 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.940 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.940 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.940 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.940 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.940 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.941 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.941 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-08-20T05:18:54.941 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-08-20T05:18:54.941 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.941 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.941 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.941 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.941 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.941 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.941 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.941 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-20T05:18:54.942 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-20T05:18:54.942 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.942 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.942 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.942 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.942 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.942 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.942 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.942 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.942 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.942 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.942 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.942 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.943 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.943 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.943 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.943 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.943 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.943 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.943 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.943 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.943 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.943 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.943 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.943 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.943 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.944 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.944 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.944 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.944 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.944 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.944 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.944 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.944 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.944 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.944 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.944 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.944 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.945 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.945 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.945 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.945 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.945 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.945 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.945 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.945 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.945 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.945 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.945 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.945 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.946 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.946 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.946 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.946 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.946 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.946 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.946 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.946 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.946 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.946 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.946 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.946 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.947 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.947 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.947 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.947 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.947 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.947 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.947 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.947 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.947 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.947 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.947 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.947 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.948 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-08-20T05:18:54.948 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-08-20T05:18:54.948 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.948 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.948 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.948 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.948 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.948 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.948 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.948 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.948 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.949 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.949 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.949 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.949 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-20T05:18:54.949 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-20T05:18:54.949 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.949 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.949 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.949 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-08-20T05:18:54.949 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.949 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.949 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.950 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.950 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.950 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.950 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.950 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.950 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-08-20T05:18:54.950 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-08-20T05:18:54.950 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:54.950 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.950 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.950 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-08-20T05:18:54.951 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.951 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.951 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.951 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.951 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.951 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.951 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.951 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.951 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-20T05:18:54.951 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-20T05:18:54.951 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.951 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.951 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.951 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-08-20T05:18:54.952 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.952 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.952 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.952 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-20T05:18:54.952 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.952 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.952 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.952 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.952 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-20T05:18:54.952 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-20T05:18:54.952 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.952 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.952 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.952 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-08-20T05:18:54.952 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.953 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.953 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.953 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-20T05:18:54.953 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.953 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.953 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.953 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.953 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.953 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.953 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.954 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-08-20T05:18:54.955 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-08-20T05:18:54.955 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.955 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.955 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.955 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-08-20T05:18:54.955 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.955 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.955 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.955 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.955 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.955 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.955 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.955 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.956 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-08-20T05:18:54.956 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-08-20T05:18:54.956 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.956 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.956 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.956 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-08-20T05:18:54.956 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.956 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.956 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.956 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-08-20T05:18:54.956 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-08-20T05:18:54.956 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.956 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.957 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.957 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.957 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.957 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.957 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-08-20T05:18:54.957 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-08-20T05:18:54.957 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.957 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.957 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.957 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-08-20T05:18:54.957 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-08-20T05:18:54.957 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-08-20T05:18:54.957 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.957 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.958 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.958 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.958 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.958 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.958 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.958 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.958 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.958 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-08-20T05:18:54.958 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.958 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.958 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.958 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.958 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.959 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.959 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.959 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.959 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.959 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.959 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.959 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.959 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.959 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.959 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.959 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.959 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.959 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.960 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.960 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.960 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.960 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.960 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.960 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.960 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.960 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.960 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.960 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.960 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.960 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.960 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.960 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.961 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.961 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.961 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.961 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.961 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.961 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.961 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.961 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.961 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.961 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.961 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.961 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.962 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.962 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.962 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.962 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.962 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.962 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.962 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.962 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.962 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.962 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.962 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.962 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.962 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.962 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.963 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.963 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.963 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.963 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.963 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.963 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.963 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.963 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.963 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.963 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.963 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.963 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.963 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.963 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.964 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.964 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-08-20T05:18:54.964 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-08-20T05:18:54.964 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.964 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.964 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.964 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:54.964 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.964 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.964 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.964 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.964 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.964 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.964 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.964 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.965 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-08-20T05:18:54.965 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-08-20T05:18:54.965 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.965 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.965 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.965 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.965 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.965 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.965 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.965 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.965 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.965 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.965 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.965 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.966 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.966 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.966 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.966 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.966 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.966 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.966 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.966 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.966 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.966 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.966 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.967 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.967 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.967 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.967 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-08-20T05:18:54.967 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-08-20T05:18:54.967 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.967 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.967 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.967 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.967 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.967 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.967 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.967 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.967 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.967 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.968 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.968 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.968 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.968 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.968 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.968 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-08-20T05:18:54.968 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.968 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.968 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.968 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-08-20T05:18:54.968 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-08-20T05:18:54.968 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.968 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.968 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.968 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:54.969 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.969 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.969 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.969 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.969 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.969 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.969 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.969 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.969 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-08-20T05:18:54.969 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-08-20T05:18:54.969 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.969 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.969 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.969 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.970 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.970 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.970 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.970 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.970 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.970 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.970 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.970 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.970 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.970 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.970 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.970 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.971 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.971 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.971 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.971 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.971 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.971 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.971 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.971 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.971 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.971 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.971 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.971 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.971 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.971 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.972 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.972 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.972 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.972 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.972 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.972 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.972 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.972 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.972 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.972 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.972 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.972 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.972 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.972 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.973 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.973 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.973 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.973 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.973 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.973 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.973 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.973 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.973 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.973 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.973 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.973 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.973 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.973 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.973 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.974 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.974 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.974 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.974 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.974 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.974 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.974 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.974 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.974 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.974 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.974 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.974 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.974 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.975 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.975 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.975 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.975 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.975 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.975 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.975 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.975 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.975 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.975 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.975 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-20T05:18:54.975 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-20T05:18:54.975 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.975 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.976 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.976 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.976 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.976 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.976 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.976 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.976 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.976 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.976 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.976 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.976 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-20T05:18:54.976 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-20T05:18:54.976 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.976 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.976 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.977 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.977 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.977 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.977 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.977 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.977 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.977 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.977 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.977 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.977 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.977 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.977 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.977 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.977 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.978 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.978 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.978 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.978 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.978 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.978 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.978 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.978 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.978 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.978 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.978 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.978 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.978 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-08-20T05:18:54.978 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.979 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.979 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.979 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.979 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.979 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.979 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.979 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.979 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.979 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.979 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.979 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.979 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.979 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.979 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.979 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.980 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.980 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.980 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.980 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.980 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.980 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.980 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.980 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.980 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.980 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.980 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.980 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.980 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.980 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.980 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.981 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.981 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.981 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.981 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.981 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.981 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.981 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.981 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.981 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.981 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.981 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.981 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.981 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.981 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.981 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.982 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.982 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.982 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.982 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.982 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.982 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.982 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.982 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.982 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.982 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.982 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.982 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.982 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.983 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.983 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.983 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.983 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.983 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.983 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.983 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.983 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.983 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.983 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.983 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.983 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.983 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.983 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.984 INFO:teuthology.orchestra.run.smithi037.stdout: "secondary_zone_period_retry_limit": { 2024-08-20T05:18:54.984 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-20T05:18:54.984 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.984 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.984 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.984 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-20T05:18:54.984 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.984 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.984 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.984 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-20T05:18:54.984 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.984 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.984 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.984 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.984 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.985 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.985 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.985 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.985 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.985 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.985 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.985 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.985 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.985 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.985 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.985 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.985 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.985 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.985 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.985 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.985 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.986 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-08-20T05:18:54.986 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.986 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.986 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.986 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.986 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.986 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.986 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.986 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.986 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.986 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.986 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.986 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.987 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.987 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.987 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.987 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.987 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.987 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.987 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.987 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.987 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.987 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.987 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.987 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.987 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.987 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.988 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.988 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.988 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.988 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.988 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.988 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.988 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.988 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.988 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.988 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.988 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.988 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.988 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.988 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.989 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.989 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.989 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.989 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.989 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.989 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.989 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.989 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.989 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.989 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.989 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.989 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.989 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.989 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.989 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.990 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.990 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.990 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.990 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.990 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.990 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.990 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.990 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.990 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.990 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.990 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.990 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.990 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.990 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.991 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.991 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.991 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.991 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.991 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:54.991 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:54.991 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:54.991 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:54.991 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.991 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:54.991 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.991 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.991 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.991 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.991 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.991 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.992 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.992 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.992 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-08-20T05:18:54.992 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-08-20T05:18:54.992 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.992 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.992 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.992 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-08-20T05:18:54.992 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.992 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.992 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.992 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-20T05:18:54.992 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.993 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.993 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.993 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.993 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:54.993 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.993 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:54.993 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-08-20T05:18:54.993 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:54.993 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:54.993 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:54.993 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:54.993 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:54.993 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.993 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.994 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.994 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.994 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.994 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.994 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.994 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.994 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.994 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.994 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.994 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.994 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.994 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.994 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.994 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.995 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.995 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.995 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.995 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:54.995 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:54.995 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.995 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.995 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.995 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.995 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.995 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.995 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.995 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.995 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.995 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.996 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.996 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.996 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:54.996 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:54.996 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.996 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.996 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.996 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:54.996 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.996 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.996 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:54.996 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:54.996 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:54.996 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:54.996 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:54.997 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:54.997 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:54.997 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:54.997 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.997 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.997 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.997 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.997 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.997 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:54.997 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:54.997 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:54.997 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.997 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:54.997 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:54.997 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.998 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.998 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.998 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.998 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.998 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.998 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.998 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.998 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-08-20T05:18:54.998 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-08-20T05:18:54.998 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.998 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.998 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.998 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:54.998 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:54.999 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:54.999 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:54.999 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:54.999 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:54.999 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:54.999 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:54.999 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:54.999 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-08-20T05:18:54.999 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-08-20T05:18:54.999 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:54.999 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:54.999 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:54.999 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-08-20T05:18:54.999 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.000 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.000 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.000 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.000 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.000 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.000 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.000 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.000 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-08-20T05:18:55.000 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-08-20T05:18:55.000 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.001 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.001 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.001 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.001 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.001 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.001 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.001 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.001 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.001 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.001 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.001 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.001 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-08-20T05:18:55.001 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-08-20T05:18:55.001 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.001 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.002 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.002 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.002 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.002 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.002 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.002 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.002 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.002 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.002 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.002 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.002 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-08-20T05:18:55.002 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-08-20T05:18:55.002 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:55.002 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.002 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.003 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.003 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.003 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.003 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.003 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.003 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.003 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.003 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.003 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.003 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-08-20T05:18:55.003 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-08-20T05:18:55.003 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.003 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.003 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.003 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.004 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.004 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.004 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.004 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.004 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.004 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.004 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.004 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.004 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-08-20T05:18:55.004 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-08-20T05:18:55.004 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.004 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.004 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.004 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.005 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.005 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.005 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.005 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.005 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.005 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.005 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.005 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.005 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-08-20T05:18:55.005 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-08-20T05:18:55.005 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.005 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.005 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.005 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.006 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.006 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.006 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.006 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.006 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.006 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.006 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.006 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.006 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-08-20T05:18:55.006 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-08-20T05:18:55.006 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.006 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.006 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.007 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.007 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-20T05:18:55.007 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-08-20T05:18:55.007 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.007 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.007 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.007 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.007 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.007 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.007 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.007 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.007 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.007 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.007 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.007 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.008 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.008 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.008 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.008 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.008 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.008 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.008 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.008 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.008 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-08-20T05:18:55.008 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-08-20T05:18:55.008 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.008 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.008 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.008 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.009 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.009 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.009 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.009 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.009 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.009 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.009 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.009 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.009 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-08-20T05:18:55.009 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-08-20T05:18:55.009 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.009 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.009 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.009 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.009 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.010 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.010 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.010 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.010 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.010 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.010 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.010 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.010 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-08-20T05:18:55.010 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-08-20T05:18:55.010 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.010 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.010 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.010 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.011 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.011 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.011 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.011 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.011 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.011 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.011 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.011 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.011 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.011 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.011 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.011 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smb", 2024-08-20T05:18:55.011 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.011 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.011 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.012 INFO:teuthology.orchestra.run.smithi037.stdout: "internal_store_backend": { 2024-08-20T05:18:55.012 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "internal_store_backend", 2024-08-20T05:18:55.012 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.012 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.012 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.012 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.012 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.012 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.012 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.012 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-20T05:18:55.012 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.012 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.012 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.012 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.012 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.013 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.013 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.013 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.013 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.013 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.013 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.013 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.013 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.013 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.013 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.013 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.013 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.013 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.013 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.013 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.014 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.014 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.014 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.014 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.014 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.014 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.014 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.014 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.014 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.014 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.014 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.014 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.014 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.014 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.014 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: "update_orchestration": { 2024-08-20T05:18:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "update_orchestration", 2024-08-20T05:18:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-20T05:18:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-08-20T05:18:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.020 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.020 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-08-20T05:18:55.020 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-08-20T05:18:55.020 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.020 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.020 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.020 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.020 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.020 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.020 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.020 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-08-20T05:18:55.020 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.020 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.020 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.020 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.021 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-08-20T05:18:55.021 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-08-20T05:18:55.021 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.021 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.021 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.021 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.021 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.021 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.021 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.021 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-08-20T05:18:55.021 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.021 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.021 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.021 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.021 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.022 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.022 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.022 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.022 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.022 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.022 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.022 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.022 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.022 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.022 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.022 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.022 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.022 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.022 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.023 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.024 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.024 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.024 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.024 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.024 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.024 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.024 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.024 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.024 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.024 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.024 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.024 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.024 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.025 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.025 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.025 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.025 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.025 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.025 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.025 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.025 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.025 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.025 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.025 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.025 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.025 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.025 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.025 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.026 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.026 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.026 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.026 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.026 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.026 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.026 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.026 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.026 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.026 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.026 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.026 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.026 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.026 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.027 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-08-20T05:18:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.028 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.029 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.029 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.029 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.029 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.029 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.029 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.029 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.029 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.029 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.029 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.029 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.029 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.029 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.029 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.029 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.029 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.030 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.030 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.030 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.030 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.030 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.030 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.030 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.030 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.030 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.030 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.030 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.030 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.030 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.030 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.031 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.031 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.031 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.031 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.031 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.031 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.031 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.031 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.031 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.031 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.031 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.031 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.031 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.031 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.031 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.032 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.032 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.032 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.032 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.032 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.032 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.032 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.032 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.032 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.032 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.032 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.032 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.032 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.032 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.033 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-08-20T05:18:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.035 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.036 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.037 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.037 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.037 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.037 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.037 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.037 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.037 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.037 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.037 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.037 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.037 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.037 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.037 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.037 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.038 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.038 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.038 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.038 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.038 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.038 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.038 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.038 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.038 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.038 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.038 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.038 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.038 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.038 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.039 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.039 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.039 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.039 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.039 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.039 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.039 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.039 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.039 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.039 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.039 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.039 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.039 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.039 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.040 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.040 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.040 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.040 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.040 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.040 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.040 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.040 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-08-20T05:18:55.040 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.040 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.040 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.040 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-08-20T05:18:55.040 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-08-20T05:18:55.040 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.040 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.041 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.041 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-20T05:18:55.041 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.041 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.041 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.041 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.041 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.041 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.041 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.041 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.041 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-20T05:18:55.041 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-20T05:18:55.041 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.041 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.042 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.042 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-08-20T05:18:55.042 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.042 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.042 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.042 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.042 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.042 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.042 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.042 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.042 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.042 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.042 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.042 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.043 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.043 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.043 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.043 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.043 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.043 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.043 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.043 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.043 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.043 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.043 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.043 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.043 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.043 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.043 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.044 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.044 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.044 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.044 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.044 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.044 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.044 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.044 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.044 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.044 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.044 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.044 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.044 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.044 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.044 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.045 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.045 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.045 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.045 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.045 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.045 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.045 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.045 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.045 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.045 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.045 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.045 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.045 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.045 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.046 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.046 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.046 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.046 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.046 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.046 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.046 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.046 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.046 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.046 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.046 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.046 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.046 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.047 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.047 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.047 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.047 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.047 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.047 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.047 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.047 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.047 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.047 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.047 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.047 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.047 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.047 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.048 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.048 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.048 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.048 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.048 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.048 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.048 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.048 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.048 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.048 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.048 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.048 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.048 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-08-20T05:18:55.049 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.049 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.049 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.049 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-08-20T05:18:55.049 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-08-20T05:18:55.049 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.049 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.049 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.049 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.049 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.049 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.049 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.050 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-20T05:18:55.050 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.050 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.050 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.050 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.050 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-08-20T05:18:55.050 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-08-20T05:18:55.050 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.050 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.050 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.050 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.050 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.050 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.051 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.051 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-20T05:18:55.051 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.051 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.051 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.051 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.051 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-08-20T05:18:55.051 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-08-20T05:18:55.051 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.051 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.051 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.051 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.051 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.051 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.052 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.052 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-20T05:18:55.052 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.052 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.052 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.052 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.052 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-08-20T05:18:55.052 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-08-20T05:18:55.052 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.052 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.052 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.052 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.052 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.052 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.053 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.053 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-20T05:18:55.053 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.053 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.053 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.053 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.053 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-08-20T05:18:55.053 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-08-20T05:18:55.053 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.053 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.053 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.053 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.053 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.054 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.054 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.054 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-20T05:18:55.054 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.054 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.054 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.054 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.054 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-08-20T05:18:55.054 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-08-20T05:18:55.054 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.054 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.055 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.055 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.055 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.055 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.055 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.055 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.055 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.055 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.055 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.055 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.055 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-08-20T05:18:55.055 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-08-20T05:18:55.055 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.056 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.056 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.056 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.056 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.056 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.056 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.056 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.056 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.056 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.056 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.056 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.056 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-08-20T05:18:55.056 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-08-20T05:18:55.057 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.057 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.057 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.057 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-20T05:18:55.057 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.057 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.057 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.057 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.057 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.057 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.057 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.057 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.057 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-08-20T05:18:55.057 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-08-20T05:18:55.057 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.058 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-20T05:18:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-20T05:18:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-08-20T05:18:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-08-20T05:18:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-08-20T05:18:55.059 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-08-20T05:18:55.060 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.060 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.060 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.060 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-08-20T05:18:55.060 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.060 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.060 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.060 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.060 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.060 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.060 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.060 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.060 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-08-20T05:18:55.060 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-08-20T05:18:55.061 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.061 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.061 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.061 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.061 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.061 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.061 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.061 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.061 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.061 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.061 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.061 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.061 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-08-20T05:18:55.062 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-08-20T05:18:55.062 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.062 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.062 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.062 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.062 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.062 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.062 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.062 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.062 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.062 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.062 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.062 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.063 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.063 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.063 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.063 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.063 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.063 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.063 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.063 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.063 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.063 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.063 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.063 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.063 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.063 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.063 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.064 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.064 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.064 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.064 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.064 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.064 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.064 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.064 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.064 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.064 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.064 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.064 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.064 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.065 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.065 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.065 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.065 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.065 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.065 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.065 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.065 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.065 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.065 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.065 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.065 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.065 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.065 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.065 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.066 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.066 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.066 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.066 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.066 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.066 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.066 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.066 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.066 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.066 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.066 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.067 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.067 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.067 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.067 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.067 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.067 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.067 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.067 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.067 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.067 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.067 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.067 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.067 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.067 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.067 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.068 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.068 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-08-20T05:18:55.068 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-08-20T05:18:55.068 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.068 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.068 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.068 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.068 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.068 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.068 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.068 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.068 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.068 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.068 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.068 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.069 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-08-20T05:18:55.069 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-08-20T05:18:55.069 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.069 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.069 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.069 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.069 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.069 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.069 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.069 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.069 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.069 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.069 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.069 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.070 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.070 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.070 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.070 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.070 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.070 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.070 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.070 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.070 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.070 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.070 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.070 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.070 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.071 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.071 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-08-20T05:18:55.071 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-08-20T05:18:55.071 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.071 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.071 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.071 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-20T05:18:55.071 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.071 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.071 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.071 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.071 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.071 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.071 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.072 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.072 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.072 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.072 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.072 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-08-20T05:18:55.072 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.072 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.072 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.072 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.072 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.072 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.072 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.072 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.072 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.072 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.072 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.073 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.073 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.073 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.073 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.073 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.073 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.073 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.073 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.073 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.073 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.073 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.073 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.073 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.073 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.073 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.074 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.074 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.074 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.074 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.074 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.074 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.074 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.074 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.074 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.074 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.074 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.074 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.074 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.075 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.075 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.075 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.075 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.075 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.075 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.075 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.075 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.075 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.075 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.075 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.075 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.075 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.075 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.075 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.076 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.076 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.076 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.076 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.076 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.076 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.076 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.076 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.076 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.076 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.076 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.076 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.076 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.076 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.076 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.077 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.077 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.077 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.077 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.077 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.077 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.077 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.077 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.077 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.077 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.077 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.077 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.077 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.077 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.078 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.078 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.078 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.078 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.078 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.078 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.078 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.078 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-08-20T05:18:55.078 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.078 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.078 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.078 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.078 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.079 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.079 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.079 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.079 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.079 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.079 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.079 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.079 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.079 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.079 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.079 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.079 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.079 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.079 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.079 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.080 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.080 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.080 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.080 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.080 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.080 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.080 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.080 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.080 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.080 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.080 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.080 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.080 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.080 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.080 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.081 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.081 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.081 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.081 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.081 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.081 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.081 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.081 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.081 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.081 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.081 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.081 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.081 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.081 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.081 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.082 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.082 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.082 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.082 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.082 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.082 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.082 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.082 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.082 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.082 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.082 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.082 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.082 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.082 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.083 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.083 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.083 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.083 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.083 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.083 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.083 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.083 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.083 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.083 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-08-20T05:18:55.083 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-08-20T05:18:55.083 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.083 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.084 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.084 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-08-20T05:18:55.084 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.084 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.084 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.084 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-20T05:18:55.084 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.084 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.084 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.084 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.084 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-08-20T05:18:55.084 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-08-20T05:18:55.084 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.084 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.085 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.085 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.085 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.085 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.085 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.085 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-08-20T05:18:55.085 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.085 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.085 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.085 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.085 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-08-20T05:18:55.085 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-08-20T05:18:55.085 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.085 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.086 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.086 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.086 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.086 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.086 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.086 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-20T05:18:55.086 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.086 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.086 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.086 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.086 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-08-20T05:18:55.086 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-08-20T05:18:55.086 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.086 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.087 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.087 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.087 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.087 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.087 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.087 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-20T05:18:55.087 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.087 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.087 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.087 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.087 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.087 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.087 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.087 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.088 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.088 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.088 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.088 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.088 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.088 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.088 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.088 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.088 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.088 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.088 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.088 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.089 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.089 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-08-20T05:18:55.089 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.089 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.089 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.089 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-08-20T05:18:55.089 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-08-20T05:18:55.089 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-20T05:18:55.089 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.089 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.089 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-08-20T05:18:55.089 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.089 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.089 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.089 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.090 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.090 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.090 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.090 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.090 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-08-20T05:18:55.090 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-08-20T05:18:55.090 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.090 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.090 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.090 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.090 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.090 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.090 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.090 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.091 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.091 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.091 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.091 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.091 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-20T05:18:55.091 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-20T05:18:55.091 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.091 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.091 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.091 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-20T05:18:55.091 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.091 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.091 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.091 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.091 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.091 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.092 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.092 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.092 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.092 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.092 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.092 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.092 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.092 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.092 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.092 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.092 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.092 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.092 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.092 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.092 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.093 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.093 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.093 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.093 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.093 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.093 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.093 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.093 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.093 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.093 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.093 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.093 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.093 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.094 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.094 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.094 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.094 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.094 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.094 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.094 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.094 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.094 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.094 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.094 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.094 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.094 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.094 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.095 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.095 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.095 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.095 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.095 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.095 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.095 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.095 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.095 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.095 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.095 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.095 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.095 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.095 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.095 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.096 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.096 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.096 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.096 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.096 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.096 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.096 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.096 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.096 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.096 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.096 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.096 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.096 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.096 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.096 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.097 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.097 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.097 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.097 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.097 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.097 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.097 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.097 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.097 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.097 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.097 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.097 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.097 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.097 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-08-20T05:18:55.097 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-08-20T05:18:55.098 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.098 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.098 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.098 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.098 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.098 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.098 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.098 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.098 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.098 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.098 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.098 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.098 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-08-20T05:18:55.098 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-08-20T05:18:55.098 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.099 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.099 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.099 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-08-20T05:18:55.099 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.099 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.099 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.099 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.099 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.099 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.099 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.099 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.099 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-08-20T05:18:55.099 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-08-20T05:18:55.099 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.099 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.100 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.100 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-20T05:18:55.100 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.100 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.100 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.100 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.100 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.100 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.100 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.100 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.100 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.100 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.100 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-20T05:18:55.101 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.101 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.101 INFO:teuthology.orchestra.run.smithi037.stdout: "modules": [ 2024-08-20T05:18:55.101 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-08-20T05:18:55.101 INFO:teuthology.orchestra.run.smithi037.stdout: "dashboard", 2024-08-20T05:18:55.101 INFO:teuthology.orchestra.run.smithi037.stdout: "iostat", 2024-08-20T05:18:55.101 INFO:teuthology.orchestra.run.smithi037.stdout: "nfs", 2024-08-20T05:18:55.101 INFO:teuthology.orchestra.run.smithi037.stdout: "restful" 2024-08-20T05:18:55.101 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.101 INFO:teuthology.orchestra.run.smithi037.stdout: "available_modules": [ 2024-08-20T05:18:55.101 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.101 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "alerts", 2024-08-20T05:18:55.102 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.102 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.102 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.102 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-20T05:18:55.102 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-20T05:18:55.102 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.102 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.102 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.102 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-20T05:18:55.102 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.102 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.102 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.102 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How frequently to reexamine health status", 2024-08-20T05:18:55.102 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.103 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.103 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.103 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.103 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.103 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.103 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.103 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.103 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.103 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.103 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.103 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.103 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.103 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.103 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.103 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.104 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.104 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.104 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.104 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.104 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.104 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.104 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.104 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.104 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.104 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.104 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.104 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.104 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.104 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.105 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.105 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.105 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.105 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.105 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.105 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.105 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.105 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.105 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.105 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.105 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.105 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.105 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.105 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.106 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.106 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.106 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.106 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.106 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.106 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.106 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.106 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.106 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.106 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.106 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.106 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.107 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.107 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.107 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.107 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.107 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.107 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.107 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.107 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.107 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.107 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.107 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.107 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.107 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.107 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.108 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.108 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.108 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.108 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.108 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_destination": { 2024-08-20T05:18:55.108 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_destination", 2024-08-20T05:18:55.108 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.108 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.108 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.108 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.108 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.108 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.108 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.108 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email address to send alerts to", 2024-08-20T05:18:55.108 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.109 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.109 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.109 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.109 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_from_name": { 2024-08-20T05:18:55.109 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_from_name", 2024-08-20T05:18:55.109 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.109 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.109 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.109 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "Ceph", 2024-08-20T05:18:55.109 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.109 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.109 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.109 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Email From: name", 2024-08-20T05:18:55.109 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.109 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.109 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.110 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.110 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_host": { 2024-08-20T05:18:55.110 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_host", 2024-08-20T05:18:55.110 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.110 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.110 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.110 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.110 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.110 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.110 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.110 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP server", 2024-08-20T05:18:55.110 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.110 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.110 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.111 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.111 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_password": { 2024-08-20T05:18:55.111 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_password", 2024-08-20T05:18:55.111 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.111 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.111 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.111 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.111 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.111 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.111 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.111 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Password to authenticate with", 2024-08-20T05:18:55.111 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.111 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.111 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.111 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.112 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_port": { 2024-08-20T05:18:55.112 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_port", 2024-08-20T05:18:55.112 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.112 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.112 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.112 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "465", 2024-08-20T05:18:55.112 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.112 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.112 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.112 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP port", 2024-08-20T05:18:55.112 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.112 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.112 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.112 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.112 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_sender": { 2024-08-20T05:18:55.113 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_sender", 2024-08-20T05:18:55.113 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.113 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.113 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.113 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.113 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.113 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.113 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.113 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SMTP envelope sender", 2024-08-20T05:18:55.113 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.113 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.113 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.113 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.113 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_ssl": { 2024-08-20T05:18:55.113 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_ssl", 2024-08-20T05:18:55.114 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.114 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.114 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.114 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.114 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.114 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.114 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.114 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-20T05:18:55.114 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.114 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.114 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.114 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.114 INFO:teuthology.orchestra.run.smithi037.stdout: "smtp_user": { 2024-08-20T05:18:55.114 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smtp_user", 2024-08-20T05:18:55.114 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.115 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.115 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.115 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.115 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.115 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.115 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.115 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "User to authenticate as", 2024-08-20T05:18:55.115 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.115 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.115 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.115 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.115 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.115 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.115 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.116 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.116 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.116 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.116 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.116 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.116 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.116 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.116 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.116 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.116 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.116 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.116 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.116 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.116 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.116 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "balancer", 2024-08-20T05:18:55.116 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.117 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.117 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.117 INFO:teuthology.orchestra.run.smithi037.stdout: "active": { 2024-08-20T05:18:55.117 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "active", 2024-08-20T05:18:55.117 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.117 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.117 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.117 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.117 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.117 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.117 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.117 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically balance PGs across cluster", 2024-08-20T05:18:55.117 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.117 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.117 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.118 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.118 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_time": { 2024-08-20T05:18:55.118 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_time", 2024-08-20T05:18:55.118 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.118 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.118 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.118 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0000", 2024-08-20T05:18:55.118 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.118 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.118 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.118 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "beginning time of day to automatically balance", 2024-08-20T05:18:55.118 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T05:18:55.118 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.119 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.119 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.119 INFO:teuthology.orchestra.run.smithi037.stdout: "begin_weekday": { 2024-08-20T05:18:55.119 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "begin_weekday", 2024-08-20T05:18:55.119 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-20T05:18:55.119 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.119 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.119 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.119 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-08-20T05:18:55.119 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-08-20T05:18:55.119 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.119 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-20T05:18:55.119 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T05:18:55.119 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.119 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.120 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.120 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_max_iterations": { 2024-08-20T05:18:55.120 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_max_iterations", 2024-08-20T05:18:55.120 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-20T05:18:55.120 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.120 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.120 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "25", 2024-08-20T05:18:55.120 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-20T05:18:55.120 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "250", 2024-08-20T05:18:55.120 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.120 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-20T05:18:55.120 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.120 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.120 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.120 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.121 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_metrics": { 2024-08-20T05:18:55.121 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_metrics", 2024-08-20T05:18:55.121 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.121 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.121 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.121 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "pgs,objects,bytes", 2024-08-20T05:18:55.121 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.121 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.121 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.121 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-20T05:18:55.121 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-20T05:18:55.121 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.121 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.121 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.122 INFO:teuthology.orchestra.run.smithi037.stdout: "crush_compat_step": { 2024-08-20T05:18:55.122 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crush_compat_step", 2024-08-20T05:18:55.122 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:55.122 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.122 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.122 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.5", 2024-08-20T05:18:55.122 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0.001", 2024-08-20T05:18:55.122 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "0.999", 2024-08-20T05:18:55.122 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.122 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "aggressiveness of optimization", 2024-08-20T05:18:55.122 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-20T05:18:55.122 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.122 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.122 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.123 INFO:teuthology.orchestra.run.smithi037.stdout: "end_time": { 2024-08-20T05:18:55.123 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_time", 2024-08-20T05:18:55.123 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.123 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.123 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.123 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2359", 2024-08-20T05:18:55.123 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.123 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.123 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.123 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ending time of day to automatically balance", 2024-08-20T05:18:55.123 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-20T05:18:55.123 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.123 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.123 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.123 INFO:teuthology.orchestra.run.smithi037.stdout: "end_weekday": { 2024-08-20T05:18:55.124 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "end_weekday", 2024-08-20T05:18:55.124 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-20T05:18:55.124 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.124 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.124 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.124 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "0", 2024-08-20T05:18:55.124 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "6", 2024-08-20T05:18:55.124 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.124 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-20T05:18:55.124 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-20T05:18:55.124 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.124 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.124 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.124 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.125 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.125 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.125 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.125 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.125 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.125 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.125 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.125 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.125 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.125 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.125 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.125 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.125 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.125 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.125 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.126 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.126 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.126 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.126 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.126 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.126 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.126 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.126 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.126 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.126 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.126 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.126 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.126 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.126 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.127 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.127 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.127 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.127 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.127 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.127 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.127 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.127 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.127 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.127 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.127 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.127 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.127 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.127 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.128 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.128 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.128 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.128 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.128 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.128 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.128 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.128 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.128 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.128 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.128 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.128 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.128 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.128 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.128 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.129 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.129 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.129 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.129 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.129 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.129 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.129 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.129 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.129 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.129 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.129 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.129 INFO:teuthology.orchestra.run.smithi037.stdout: "min_score": { 2024-08-20T05:18:55.129 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_score", 2024-08-20T05:18:55.129 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:55.129 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.130 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.130 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.130 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.130 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.130 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.130 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-20T05:18:55.130 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.130 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.130 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.130 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.130 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-08-20T05:18:55.130 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-08-20T05:18:55.130 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.130 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.130 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.131 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "upmap", 2024-08-20T05:18:55.131 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.131 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.131 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.131 INFO:teuthology.orchestra.run.smithi037.stdout: "crush-compat", 2024-08-20T05:18:55.131 INFO:teuthology.orchestra.run.smithi037.stdout: "none", 2024-08-20T05:18:55.131 INFO:teuthology.orchestra.run.smithi037.stdout: "read", 2024-08-20T05:18:55.131 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap", 2024-08-20T05:18:55.131 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap-read" 2024-08-20T05:18:55.131 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.131 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Balancer mode", 2024-08-20T05:18:55.131 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.131 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.132 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.132 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.132 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_ids": { 2024-08-20T05:18:55.132 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_ids", 2024-08-20T05:18:55.132 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.132 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.132 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.132 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.132 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.132 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.132 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.132 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-20T05:18:55.132 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.132 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.133 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.133 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.133 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-20T05:18:55.133 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-20T05:18:55.133 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.133 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.133 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.133 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-20T05:18:55.133 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.133 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.133 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.133 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-20T05:18:55.133 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.133 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.133 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.134 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.134 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.134 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.134 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.134 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.134 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.134 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.134 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.134 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.134 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.134 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.134 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.134 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.134 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.135 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.135 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_deviation": { 2024-08-20T05:18:55.135 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_deviation", 2024-08-20T05:18:55.135 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.135 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.135 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.135 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-20T05:18:55.135 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-20T05:18:55.135 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.135 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.135 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-20T05:18:55.135 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-20T05:18:55.135 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.136 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.136 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.136 INFO:teuthology.orchestra.run.smithi037.stdout: "upmap_max_optimizations": { 2024-08-20T05:18:55.136 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "upmap_max_optimizations", 2024-08-20T05:18:55.136 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-20T05:18:55.136 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.136 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.136 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:55.136 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.136 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.136 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.136 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-20T05:18:55.136 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.136 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.137 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.137 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.137 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.137 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.137 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.137 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm", 2024-08-20T05:18:55.137 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.137 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.137 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.137 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_down_multiplier": { 2024-08-20T05:18:55.137 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_down_multiplier", 2024-08-20T05:18:55.137 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:55.137 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.137 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.137 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-08-20T05:18:55.138 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.138 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.138 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.138 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-20T05:18:55.138 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.138 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.138 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.138 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.138 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_refresh_rate": { 2024-08-20T05:18:55.138 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_refresh_rate", 2024-08-20T05:18:55.138 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.138 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.138 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.138 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "20", 2024-08-20T05:18:55.139 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.139 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.139 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.139 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-20T05:18:55.139 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.139 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.139 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.139 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.139 INFO:teuthology.orchestra.run.smithi037.stdout: "agent_starting_port": { 2024-08-20T05:18:55.139 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "agent_starting_port", 2024-08-20T05:18:55.139 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.139 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.139 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.140 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4721", 2024-08-20T05:18:55.140 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.140 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.140 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.140 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-20T05:18:55.140 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.140 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.140 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.140 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.140 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_ptrace": { 2024-08-20T05:18:55.140 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_ptrace", 2024-08-20T05:18:55.140 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.140 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.140 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.140 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.140 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.141 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.141 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.141 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-20T05:18:55.141 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-20T05:18:55.141 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.141 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.141 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.141 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_interval": { 2024-08-20T05:18:55.141 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_interval", 2024-08-20T05:18:55.141 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.141 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.141 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.141 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-20T05:18:55.141 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.142 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.142 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.142 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-20T05:18:55.142 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.142 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.142 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.142 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.142 INFO:teuthology.orchestra.run.smithi037.stdout: "autotune_memory_target_ratio": { 2024-08-20T05:18:55.142 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "autotune_memory_target_ratio", 2024-08-20T05:18:55.142 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:55.142 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.142 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.142 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0.7", 2024-08-20T05:18:55.142 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.143 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.143 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.143 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-20T05:18:55.143 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.143 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.143 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.143 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.143 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm_log_destination": { 2024-08-20T05:18:55.143 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephadm_log_destination", 2024-08-20T05:18:55.143 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.143 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.143 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.143 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.143 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.143 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.143 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.144 INFO:teuthology.orchestra.run.smithi037.stdout: "file", 2024-08-20T05:18:55.144 INFO:teuthology.orchestra.run.smithi037.stdout: "file,syslog", 2024-08-20T05:18:55.144 INFO:teuthology.orchestra.run.smithi037.stdout: "syslog" 2024-08-20T05:18:55.144 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.144 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-20T05:18:55.144 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.144 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.144 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.144 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.144 INFO:teuthology.orchestra.run.smithi037.stdout: "cgroups_split": { 2024-08-20T05:18:55.144 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cgroups_split", 2024-08-20T05:18:55.144 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.144 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.144 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.144 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.145 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.145 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.145 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.145 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-20T05:18:55.145 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.145 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.145 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.145 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.145 INFO:teuthology.orchestra.run.smithi037.stdout: "config_checks_enabled": { 2024-08-20T05:18:55.145 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_checks_enabled", 2024-08-20T05:18:55.145 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.145 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.145 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.145 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.146 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.146 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.146 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.146 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-20T05:18:55.146 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.146 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.146 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.146 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.146 INFO:teuthology.orchestra.run.smithi037.stdout: "config_dashboard": { 2024-08-20T05:18:55.146 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_dashboard", 2024-08-20T05:18:55.146 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.146 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.146 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.146 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.147 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.147 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.147 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.147 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-20T05:18:55.147 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.147 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.147 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.147 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.147 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_alertmanager": { 2024-08-20T05:18:55.147 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_alertmanager", 2024-08-20T05:18:55.147 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.147 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.147 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.147 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-08-20T05:18:55.148 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.148 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.148 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.148 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-20T05:18:55.148 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.148 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.148 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.148 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.148 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_base": { 2024-08-20T05:18:55.148 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_base", 2024-08-20T05:18:55.148 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.148 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.148 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.149 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-20T05:18:55.149 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.149 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.149 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.149 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Container image name, without the tag", 2024-08-20T05:18:55.149 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.149 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.149 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.149 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.149 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_elasticsearch": { 2024-08-20T05:18:55.149 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_elasticsearch", 2024-08-20T05:18:55.149 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.150 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.150 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.150 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-20T05:18:55.150 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.150 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.150 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.150 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "elasticsearch container image", 2024-08-20T05:18:55.150 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.150 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.150 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.150 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.150 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_grafana": { 2024-08-20T05:18:55.150 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_grafana", 2024-08-20T05:18:55.150 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.151 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.151 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.151 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-08-20T05:18:55.151 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.151 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.151 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.151 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-20T05:18:55.151 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.151 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.151 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.151 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.151 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_haproxy": { 2024-08-20T05:18:55.151 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_haproxy", 2024-08-20T05:18:55.151 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.151 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.152 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.152 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-20T05:18:55.152 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.152 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.152 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.152 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "HAproxy container image", 2024-08-20T05:18:55.152 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.152 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.152 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.152 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.152 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_agent": { 2024-08-20T05:18:55.152 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_agent", 2024-08-20T05:18:55.152 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.152 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.153 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.153 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-20T05:18:55.153 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.153 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.153 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.153 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger agent container image", 2024-08-20T05:18:55.153 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.153 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.153 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.153 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.153 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_collector": { 2024-08-20T05:18:55.153 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_collector", 2024-08-20T05:18:55.153 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.153 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.154 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.154 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-20T05:18:55.154 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.154 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.154 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.154 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger collector container image", 2024-08-20T05:18:55.154 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.154 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.154 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.154 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.154 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_jaeger_query": { 2024-08-20T05:18:55.155 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_jaeger_query", 2024-08-20T05:18:55.155 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.155 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.155 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.155 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-20T05:18:55.155 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.155 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.155 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.155 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Jaeger query container image", 2024-08-20T05:18:55.155 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.155 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.156 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.156 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.156 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_keepalived": { 2024-08-20T05:18:55.156 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_keepalived", 2024-08-20T05:18:55.156 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.156 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.156 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.156 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-20T05:18:55.156 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.156 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.156 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.156 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Keepalived container image", 2024-08-20T05:18:55.156 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.156 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.157 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.157 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.157 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_loki": { 2024-08-20T05:18:55.157 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_loki", 2024-08-20T05:18:55.157 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.157 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.157 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.157 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-20T05:18:55.157 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.157 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.157 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.157 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Loki container image", 2024-08-20T05:18:55.157 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.157 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.158 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.158 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.158 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nginx": { 2024-08-20T05:18:55.158 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nginx", 2024-08-20T05:18:55.158 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.158 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.158 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.158 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-08-20T05:18:55.158 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.158 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.158 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.158 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nginx container image", 2024-08-20T05:18:55.158 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.158 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.159 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.159 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.159 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_node_exporter": { 2024-08-20T05:18:55.159 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_node_exporter", 2024-08-20T05:18:55.159 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.159 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.159 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.159 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-08-20T05:18:55.159 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.159 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.159 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.159 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-20T05:18:55.159 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.159 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.160 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.160 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.160 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_nvmeof": { 2024-08-20T05:18:55.160 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_nvmeof", 2024-08-20T05:18:55.160 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.160 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.160 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.160 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-20T05:18:55.160 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.160 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.160 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.160 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Nvme-of container image", 2024-08-20T05:18:55.160 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.160 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.160 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.161 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.161 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_prometheus": { 2024-08-20T05:18:55.161 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_prometheus", 2024-08-20T05:18:55.161 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.161 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.161 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.161 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-08-20T05:18:55.161 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.161 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.161 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.161 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Prometheus container image", 2024-08-20T05:18:55.161 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.161 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.161 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.161 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.162 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_promtail": { 2024-08-20T05:18:55.162 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_promtail", 2024-08-20T05:18:55.162 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.162 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.162 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.162 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-20T05:18:55.162 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.162 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.162 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.163 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Promtail container image", 2024-08-20T05:18:55.163 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.163 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.163 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.163 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.163 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_samba": { 2024-08-20T05:18:55.163 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_samba", 2024-08-20T05:18:55.163 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.163 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.163 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.163 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-20T05:18:55.163 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.163 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.163 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.164 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Samba/SMB container image", 2024-08-20T05:18:55.164 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.164 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.164 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.164 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.164 INFO:teuthology.orchestra.run.smithi037.stdout: "container_image_snmp_gateway": { 2024-08-20T05:18:55.164 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_image_snmp_gateway", 2024-08-20T05:18:55.164 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.164 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.164 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.164 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-20T05:18:55.164 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.164 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.164 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.165 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "SNMP Gateway container image", 2024-08-20T05:18:55.165 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.165 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.165 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.165 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.165 INFO:teuthology.orchestra.run.smithi037.stdout: "container_init": { 2024-08-20T05:18:55.165 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "container_init", 2024-08-20T05:18:55.165 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.165 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.165 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.165 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.165 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.165 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.165 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.165 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Run podman/docker with `--init`", 2024-08-20T05:18:55.166 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.166 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.166 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.166 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.166 INFO:teuthology.orchestra.run.smithi037.stdout: "daemon_cache_timeout": { 2024-08-20T05:18:55.166 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "daemon_cache_timeout", 2024-08-20T05:18:55.166 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.166 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.166 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.166 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-20T05:18:55.166 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.167 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.167 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.167 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-20T05:18:55.167 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.167 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.167 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.167 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.167 INFO:teuthology.orchestra.run.smithi037.stdout: "default_cephadm_command_timeout": { 2024-08-20T05:18:55.167 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_cephadm_command_timeout", 2024-08-20T05:18:55.167 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.167 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.167 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.167 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "900", 2024-08-20T05:18:55.168 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.168 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.168 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.168 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-20T05:18:55.168 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.168 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.168 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.168 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.168 INFO:teuthology.orchestra.run.smithi037.stdout: "default_registry": { 2024-08-20T05:18:55.168 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "default_registry", 2024-08-20T05:18:55.168 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.168 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.168 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.168 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "docker.io", 2024-08-20T05:18:55.168 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.169 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.169 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.169 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-20T05:18:55.169 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.169 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.169 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.169 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.169 INFO:teuthology.orchestra.run.smithi037.stdout: "device_cache_timeout": { 2024-08-20T05:18:55.169 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_cache_timeout", 2024-08-20T05:18:55.169 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.169 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.169 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.169 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1800", 2024-08-20T05:18:55.169 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.170 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.170 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.170 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache device inventory", 2024-08-20T05:18:55.170 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.170 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.170 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.170 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.170 INFO:teuthology.orchestra.run.smithi037.stdout: "device_enhanced_scan": { 2024-08-20T05:18:55.170 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_enhanced_scan", 2024-08-20T05:18:55.170 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.170 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.170 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.170 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.170 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.171 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.171 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.171 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-20T05:18:55.171 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.171 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.171 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.171 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.171 INFO:teuthology.orchestra.run.smithi037.stdout: "facts_cache_timeout": { 2024-08-20T05:18:55.171 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "facts_cache_timeout", 2024-08-20T05:18:55.171 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.171 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.171 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.171 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-20T05:18:55.172 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.172 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.172 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.172 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "seconds to cache host facts data", 2024-08-20T05:18:55.172 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.172 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.172 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.172 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.172 INFO:teuthology.orchestra.run.smithi037.stdout: "grafana_dashboards_path": { 2024-08-20T05:18:55.172 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "grafana_dashboards_path", 2024-08-20T05:18:55.172 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.172 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.172 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.172 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-20T05:18:55.172 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.173 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.173 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.173 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-20T05:18:55.173 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.173 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.173 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.173 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.173 INFO:teuthology.orchestra.run.smithi037.stdout: "host_check_interval": { 2024-08-20T05:18:55.173 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "host_check_interval", 2024-08-20T05:18:55.173 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.173 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.173 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.173 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-20T05:18:55.173 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.173 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.174 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.174 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to perform a host check", 2024-08-20T05:18:55.174 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.174 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.174 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.174 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.174 INFO:teuthology.orchestra.run.smithi037.stdout: "hw_monitoring": { 2024-08-20T05:18:55.174 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hw_monitoring", 2024-08-20T05:18:55.174 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.174 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.174 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.174 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.174 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.174 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.175 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.175 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-20T05:18:55.175 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.175 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.175 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.175 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.175 INFO:teuthology.orchestra.run.smithi037.stdout: "inventory_list_all": { 2024-08-20T05:18:55.175 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "inventory_list_all", 2024-08-20T05:18:55.175 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.175 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.175 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.175 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.175 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.175 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.175 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.176 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-20T05:18:55.176 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.176 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.176 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.176 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.176 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.176 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.176 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.176 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.176 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.176 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.176 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.176 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.177 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.177 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.177 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.177 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.177 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.177 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.177 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.177 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.177 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.177 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.177 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.177 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.178 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.178 INFO:teuthology.orchestra.run.smithi037.stdout: "log_refresh_metadata": { 2024-08-20T05:18:55.178 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_refresh_metadata", 2024-08-20T05:18:55.178 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.178 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.178 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.178 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.178 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.178 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.178 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.178 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-20T05:18:55.178 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.178 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.179 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.179 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.179 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.179 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.179 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.179 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.179 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.179 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.179 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.179 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.179 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.179 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-20T05:18:55.179 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.179 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.179 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.180 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.180 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.180 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.180 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.180 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.180 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.180 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.180 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.180 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.180 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.180 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.180 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.180 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.180 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.180 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.181 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.181 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.181 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.181 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.181 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.181 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.181 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.181 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.181 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.181 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.181 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.181 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.181 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.181 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.181 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.182 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.182 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.182 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.182 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.182 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.182 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.182 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-20T05:18:55.182 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-20T05:18:55.182 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.182 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.182 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.182 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.182 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.182 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.182 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.183 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-20T05:18:55.183 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.183 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.183 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.183 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.183 INFO:teuthology.orchestra.run.smithi037.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-20T05:18:55.183 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-20T05:18:55.183 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.183 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.183 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.183 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "*", 2024-08-20T05:18:55.183 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.183 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.183 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.184 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-20T05:18:55.184 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.184 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.184 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.184 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.184 INFO:teuthology.orchestra.run.smithi037.stdout: "max_count_per_host": { 2024-08-20T05:18:55.184 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_count_per_host", 2024-08-20T05:18:55.184 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.184 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.184 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.184 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:55.184 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.184 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.184 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.184 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of daemons per service per host", 2024-08-20T05:18:55.185 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.185 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.185 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.185 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.185 INFO:teuthology.orchestra.run.smithi037.stdout: "max_osd_draining_count": { 2024-08-20T05:18:55.185 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_osd_draining_count", 2024-08-20T05:18:55.185 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.185 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.185 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.185 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:55.185 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.185 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.185 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.185 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-20T05:18:55.185 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.185 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.186 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.186 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.186 INFO:teuthology.orchestra.run.smithi037.stdout: "migration_current": { 2024-08-20T05:18:55.186 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "migration_current", 2024-08-20T05:18:55.186 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.186 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.186 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.186 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.186 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.186 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.186 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.186 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "internal - do not modify", 2024-08-20T05:18:55.186 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.187 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.187 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.187 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.187 INFO:teuthology.orchestra.run.smithi037.stdout: "mode": { 2024-08-20T05:18:55.187 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mode", 2024-08-20T05:18:55.187 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.187 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.187 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.187 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "root", 2024-08-20T05:18:55.187 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.187 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.187 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.187 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm-package", 2024-08-20T05:18:55.187 INFO:teuthology.orchestra.run.smithi037.stdout: "root" 2024-08-20T05:18:55.188 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.188 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "mode for remote execution of cephadm", 2024-08-20T05:18:55.188 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.188 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.188 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.188 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.188 INFO:teuthology.orchestra.run.smithi037.stdout: "oob_default_addr": { 2024-08-20T05:18:55.188 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "oob_default_addr", 2024-08-20T05:18:55.188 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.188 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.188 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.188 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "169.254.1.1", 2024-08-20T05:18:55.188 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.188 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.189 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.189 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-20T05:18:55.189 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.189 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.189 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.189 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.189 INFO:teuthology.orchestra.run.smithi037.stdout: "prometheus_alerts_path": { 2024-08-20T05:18:55.189 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus_alerts_path", 2024-08-20T05:18:55.189 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.189 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.189 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.189 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-20T05:18:55.189 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.189 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.189 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.190 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-20T05:18:55.190 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.190 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.190 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.190 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.190 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_insecure": { 2024-08-20T05:18:55.190 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_insecure", 2024-08-20T05:18:55.190 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.190 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.190 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.190 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.190 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.190 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.190 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.191 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-20T05:18:55.191 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.191 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.191 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.191 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.191 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_password": { 2024-08-20T05:18:55.191 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_password", 2024-08-20T05:18:55.191 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.191 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.191 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.191 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.191 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.191 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.191 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.191 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-20T05:18:55.192 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.192 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.192 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.192 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.192 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_url": { 2024-08-20T05:18:55.192 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_url", 2024-08-20T05:18:55.192 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.192 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.192 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.192 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.192 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.192 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.192 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.192 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-20T05:18:55.192 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.193 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.193 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.193 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.193 INFO:teuthology.orchestra.run.smithi037.stdout: "registry_username": { 2024-08-20T05:18:55.193 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "registry_username", 2024-08-20T05:18:55.193 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.193 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.193 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.193 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.193 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.193 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.193 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.193 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-20T05:18:55.194 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.194 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.194 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.194 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.194 INFO:teuthology.orchestra.run.smithi037.stdout: "secure_monitoring_stack": { 2024-08-20T05:18:55.194 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secure_monitoring_stack", 2024-08-20T05:18:55.194 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.194 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.194 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.194 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.194 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.194 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.195 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.195 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-20T05:18:55.195 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.195 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.195 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.195 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.195 INFO:teuthology.orchestra.run.smithi037.stdout: "service_discovery_port": { 2024-08-20T05:18:55.195 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "service_discovery_port", 2024-08-20T05:18:55.195 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.195 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.195 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.195 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8765", 2024-08-20T05:18:55.195 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.195 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.196 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.196 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "cephadm service discovery port", 2024-08-20T05:18:55.196 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.196 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.196 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.196 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.196 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.196 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.196 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.196 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.196 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.196 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.196 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.196 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.197 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.197 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.197 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.197 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.197 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.197 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.197 INFO:teuthology.orchestra.run.smithi037.stdout: "ssh_config_file": { 2024-08-20T05:18:55.197 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssh_config_file", 2024-08-20T05:18:55.197 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.197 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.197 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.197 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.197 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.198 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.198 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.198 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-20T05:18:55.198 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.198 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.198 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.198 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.198 INFO:teuthology.orchestra.run.smithi037.stdout: "use_agent": { 2024-08-20T05:18:55.198 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_agent", 2024-08-20T05:18:55.198 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.198 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.198 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.198 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.199 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.199 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.199 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.199 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-20T05:18:55.199 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.199 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.199 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.199 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.199 INFO:teuthology.orchestra.run.smithi037.stdout: "use_repo_digest": { 2024-08-20T05:18:55.199 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "use_repo_digest", 2024-08-20T05:18:55.199 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.199 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.199 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.199 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.200 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.200 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.200 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.200 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-20T05:18:55.200 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.200 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.200 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.200 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.200 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_failed_host_check": { 2024-08-20T05:18:55.200 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_failed_host_check", 2024-08-20T05:18:55.200 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.200 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.201 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.201 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.201 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.201 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.201 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.201 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if the host check fails", 2024-08-20T05:18:55.201 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.201 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.201 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.202 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.202 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_daemons": { 2024-08-20T05:18:55.202 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_daemons", 2024-08-20T05:18:55.202 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.202 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.202 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.202 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.202 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.202 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.202 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.202 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-20T05:18:55.202 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.203 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.203 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.203 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.203 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_on_stray_hosts": { 2024-08-20T05:18:55.203 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_on_stray_hosts", 2024-08-20T05:18:55.203 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.203 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.203 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.203 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.203 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.203 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.203 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.204 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-20T05:18:55.204 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.204 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.204 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.204 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.204 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.204 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.204 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.204 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crash", 2024-08-20T05:18:55.204 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.204 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.204 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.204 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.205 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.205 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.205 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.205 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.205 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.205 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.205 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.205 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.205 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.205 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.205 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.205 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.206 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.206 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.206 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.206 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.206 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.206 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.206 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.206 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.206 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.206 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.206 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.207 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.207 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.207 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.207 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.207 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.207 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.207 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.207 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.207 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.207 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.207 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.207 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.207 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.208 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.208 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.208 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.208 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.208 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.208 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.208 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.208 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.208 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.208 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.208 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.208 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.209 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.209 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.209 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.209 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.209 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.209 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.209 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.209 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.209 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.209 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.209 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.209 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.209 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.209 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.210 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.210 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.210 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.210 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.210 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.210 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.210 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.210 INFO:teuthology.orchestra.run.smithi037.stdout: "retain_interval": { 2024-08-20T05:18:55.210 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retain_interval", 2024-08-20T05:18:55.210 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.210 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.210 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.210 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "31536000", 2024-08-20T05:18:55.211 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.211 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.211 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.211 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-20T05:18:55.211 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.211 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.211 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.211 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.211 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.211 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.211 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.211 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.211 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.211 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.212 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.212 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.212 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.212 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.212 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.212 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.212 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.212 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.212 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_recent_interval": { 2024-08-20T05:18:55.212 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_recent_interval", 2024-08-20T05:18:55.212 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.212 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.212 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.212 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1209600", 2024-08-20T05:18:55.213 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.213 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.213 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.213 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-20T05:18:55.213 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.213 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.213 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.213 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.213 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.213 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.213 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.213 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dashboard", 2024-08-20T05:18:55.213 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.213 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.214 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.214 INFO:teuthology.orchestra.run.smithi037.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-20T05:18:55.214 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-20T05:18:55.214 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.214 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.214 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.214 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:55.214 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.214 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.214 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.214 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.214 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.214 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.217 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.217 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.217 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_HOST": { 2024-08-20T05:18:55.217 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-20T05:18:55.217 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.218 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.218 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.218 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.218 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.218 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.218 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.218 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.218 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.218 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.218 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.218 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.218 INFO:teuthology.orchestra.run.smithi037.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-20T05:18:55.218 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-20T05:18:55.219 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.219 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.219 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.219 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.219 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.219 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.219 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.219 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.219 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.219 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.219 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.219 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.219 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_ENABLED": { 2024-08-20T05:18:55.219 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_ENABLED", 2024-08-20T05:18:55.219 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.220 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.220 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.220 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.220 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.220 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.220 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.220 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.220 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.220 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.220 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.220 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.220 INFO:teuthology.orchestra.run.smithi037.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-20T05:18:55.220 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-20T05:18:55.220 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.220 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.221 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.221 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.221 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.221 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.221 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.221 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.221 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.221 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.221 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.221 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.221 INFO:teuthology.orchestra.run.smithi037.stdout: "ENABLE_BROWSABLE_API": { 2024-08-20T05:18:55.221 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-20T05:18:55.221 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.221 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.221 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.221 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.222 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.222 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.222 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.222 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.222 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.222 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.222 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.222 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.222 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-20T05:18:55.222 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-20T05:18:55.222 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.222 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.222 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.223 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.223 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.223 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.223 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.223 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.223 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.223 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.223 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.223 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.223 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-20T05:18:55.223 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-20T05:18:55.223 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.224 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.224 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.224 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.224 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.224 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.224 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.224 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.224 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.224 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.224 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.224 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.224 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-20T05:18:55.224 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-20T05:18:55.225 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.225 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.225 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.225 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.225 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.225 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.225 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.225 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.225 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.225 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.225 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.225 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.226 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-20T05:18:55.226 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-20T05:18:55.226 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.226 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.226 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.226 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.226 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.226 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.226 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.226 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.226 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.226 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.226 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.227 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.227 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-20T05:18:55.227 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-20T05:18:55.227 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.227 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.227 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.227 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.227 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.227 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.227 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.227 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.228 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.228 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.228 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.228 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.228 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-20T05:18:55.228 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-20T05:18:55.228 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.228 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.228 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.228 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.228 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.228 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.229 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.229 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.229 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.229 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.229 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.229 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.229 INFO:teuthology.orchestra.run.smithi037.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-20T05:18:55.229 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-20T05:18:55.229 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.229 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.229 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.229 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.230 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.230 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.230 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.230 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.230 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.230 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.230 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.230 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.230 INFO:teuthology.orchestra.run.smithi037.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-20T05:18:55.230 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-20T05:18:55.230 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.231 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_PASSWORD": { 2024-08-20T05:18:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-20T05:18:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-20T05:18:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.232 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-20T05:18:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-20T05:18:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.233 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.234 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_URL": { 2024-08-20T05:18:55.234 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_URL", 2024-08-20T05:18:55.234 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.234 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.234 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.234 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.234 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.234 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.234 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.234 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.234 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.234 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.234 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.235 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.235 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_API_USERNAME": { 2024-08-20T05:18:55.235 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-20T05:18:55.235 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.235 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.235 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.235 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-20T05:18:55.235 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.235 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.235 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.235 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.236 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.236 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.236 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.236 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.236 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-20T05:18:55.236 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-20T05:18:55.236 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.236 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.236 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.236 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.236 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.236 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.236 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.236 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.237 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.237 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.237 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.237 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.237 INFO:teuthology.orchestra.run.smithi037.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-20T05:18:55.237 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-20T05:18:55.237 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.237 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.237 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.237 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.237 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.237 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.237 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.237 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.238 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.238 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.238 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.238 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.238 INFO:teuthology.orchestra.run.smithi037.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-20T05:18:55.238 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-20T05:18:55.238 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.238 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.238 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.238 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.238 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.238 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.238 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.238 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.239 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.239 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.239 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.239 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.239 INFO:teuthology.orchestra.run.smithi037.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-20T05:18:55.239 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-20T05:18:55.239 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.239 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.239 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.239 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.239 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.239 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.239 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.239 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.240 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.240 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.240 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.240 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.240 INFO:teuthology.orchestra.run.smithi037.stdout: "MANAGED_BY_CLUSTERS": { 2024-08-20T05:18:55.240 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-08-20T05:18:55.240 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.240 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.240 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.240 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "[]", 2024-08-20T05:18:55.240 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.240 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.240 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.240 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.241 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.241 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.241 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.241 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.241 INFO:teuthology.orchestra.run.smithi037.stdout: "MULTICLUSTER_CONFIG": { 2024-08-20T05:18:55.241 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "MULTICLUSTER_CONFIG", 2024-08-20T05:18:55.241 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.241 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.241 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.241 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "{}", 2024-08-20T05:18:55.241 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.241 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.241 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.241 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.241 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.242 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.242 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.242 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.242 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_HOST": { 2024-08-20T05:18:55.242 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-20T05:18:55.242 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.242 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.242 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.242 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.242 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.242 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.242 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.242 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.242 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.243 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.243 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.243 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.243 INFO:teuthology.orchestra.run.smithi037.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-20T05:18:55.243 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-20T05:18:55.243 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.243 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.243 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.243 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.243 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.243 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.243 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.243 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.243 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.243 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.243 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.244 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.244 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-20T05:18:55.244 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-20T05:18:55.244 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.244 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.244 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.244 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.244 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.244 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.244 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.244 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.244 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.244 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.244 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.244 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.245 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-20T05:18:55.245 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-20T05:18:55.245 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.245 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.245 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.245 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.245 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.245 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.245 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.245 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.245 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.245 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.245 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.246 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.246 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-20T05:18:55.246 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-20T05:18:55.246 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.246 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.246 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.246 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.246 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.246 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.246 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.246 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.246 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.247 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.247 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.247 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.247 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-20T05:18:55.247 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-20T05:18:55.247 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.247 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.247 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.247 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.247 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.247 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.247 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.247 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.247 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.248 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.248 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.248 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.248 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-20T05:18:55.248 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-20T05:18:55.248 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.248 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.248 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.248 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.248 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.248 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.248 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.248 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.249 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.249 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.249 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.249 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.249 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-20T05:18:55.249 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-20T05:18:55.249 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.249 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.249 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.249 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.249 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.250 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.250 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.250 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.250 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.250 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.250 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.250 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.250 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-20T05:18:55.250 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-20T05:18:55.250 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.250 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.250 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.251 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.251 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.251 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.251 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.251 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.251 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.251 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.251 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.251 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.251 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_ENABLED": { 2024-08-20T05:18:55.251 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-20T05:18:55.251 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.251 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.251 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.252 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.252 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.252 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.252 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.252 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.252 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.252 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.252 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.252 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.252 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-20T05:18:55.252 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-20T05:18:55.252 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.252 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.252 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.252 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-20T05:18:55.253 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.253 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.253 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.253 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.253 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.253 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.253 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.253 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.253 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-20T05:18:55.253 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-20T05:18:55.253 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.253 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.253 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.253 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-20T05:18:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-20T05:18:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.254 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8", 2024-08-20T05:18:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.255 INFO:teuthology.orchestra.run.smithi037.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-20T05:18:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-20T05:18:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "45", 2024-08-20T05:18:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.256 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ACCESS_KEY": { 2024-08-20T05:18:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-20T05:18:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.257 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-20T05:18:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-20T05:18:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "admin", 2024-08-20T05:18:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.258 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SECRET_KEY": { 2024-08-20T05:18:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-20T05:18:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.259 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: "RGW_API_SSL_VERIFY": { 2024-08-20T05:18:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-20T05:18:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.260 INFO:teuthology.orchestra.run.smithi037.stdout: "UNSAFE_TLS_v1_2": { 2024-08-20T05:18:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "UNSAFE_TLS_v1_2", 2024-08-20T05:18:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.261 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-20T05:18:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-20T05:18:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.262 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-20T05:18:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-20T05:18:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.263 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-20T05:18:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-20T05:18:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-20T05:18:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.264 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: "cross_origin_url": { 2024-08-20T05:18:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cross_origin_url", 2024-08-20T05:18:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.265 INFO:teuthology.orchestra.run.smithi037.stdout: "crt_file": { 2024-08-20T05:18:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "crt_file", 2024-08-20T05:18:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.266 INFO:teuthology.orchestra.run.smithi037.stdout: "debug": { 2024-08-20T05:18:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "debug", 2024-08-20T05:18:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Enable/disable debug options", 2024-08-20T05:18:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.267 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: "jwt_token_ttl": { 2024-08-20T05:18:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "jwt_token_ttl", 2024-08-20T05:18:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "28800", 2024-08-20T05:18:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.268 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-08-20T05:18:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-08-20T05:18:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.269 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.270 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.270 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.270 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.270 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.270 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.270 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.270 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.270 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.270 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.270 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.270 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.270 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.270 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.271 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.271 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.271 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.271 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.271 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.271 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.271 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.271 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.271 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.271 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.271 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.271 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.271 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.272 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.273 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.274 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: "motd": { 2024-08-20T05:18:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "motd", 2024-08-20T05:18:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "The message of the day", 2024-08-20T05:18:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.275 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect_resolve_ip_addr": { 2024-08-20T05:18:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "redirect_resolve_ip_addr", 2024-08-20T05:18:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-20T05:18:55.276 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-20T05:18:55.277 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.277 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.277 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.277 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-08-20T05:18:55.277 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.277 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.277 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.277 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.277 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.277 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.277 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.277 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.277 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-20T05:18:55.277 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-20T05:18:55.278 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.278 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.278 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.278 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8080", 2024-08-20T05:18:55.278 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.278 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.278 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.278 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.278 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.278 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.278 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.278 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.278 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.278 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.279 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.279 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.279 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.279 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.279 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.279 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.279 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.279 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.279 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.279 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.279 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.279 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.279 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-08-20T05:18:55.280 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-08-20T05:18:55.280 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.280 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.280 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.280 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.280 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.280 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.280 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.280 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.280 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.280 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.280 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.280 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.280 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl_server_port": { 2024-08-20T05:18:55.280 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl_server_port", 2024-08-20T05:18:55.281 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.281 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.281 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.281 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8443", 2024-08-20T05:18:55.281 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.281 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.281 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.281 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.281 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.281 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.281 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.281 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.281 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-08-20T05:18:55.281 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-08-20T05:18:55.281 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.282 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.282 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.282 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "redirect", 2024-08-20T05:18:55.282 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.282 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.282 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.282 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.282 INFO:teuthology.orchestra.run.smithi037.stdout: "redirect" 2024-08-20T05:18:55.282 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.282 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.282 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.282 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.282 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.282 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.283 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-08-20T05:18:55.283 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-08-20T05:18:55.283 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.283 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.283 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.283 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-08-20T05:18:55.283 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-08-20T05:18:55.283 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-08-20T05:18:55.283 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.283 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.283 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.283 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.283 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.283 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.283 INFO:teuthology.orchestra.run.smithi037.stdout: "url_prefix": { 2024-08-20T05:18:55.284 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url_prefix", 2024-08-20T05:18:55.284 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.284 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.284 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.284 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.284 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.284 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.284 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.284 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.284 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.284 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.284 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.284 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.284 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.284 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.285 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.285 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-08-20T05:18:55.285 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.285 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.285 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.285 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_monitoring": { 2024-08-20T05:18:55.285 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_monitoring", 2024-08-20T05:18:55.285 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.285 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.285 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.285 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.285 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.285 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.285 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.286 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "monitor device health metrics", 2024-08-20T05:18:55.286 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.286 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.286 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.286 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.286 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.286 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.286 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.286 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.286 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.286 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.286 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.286 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.286 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.287 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.287 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.287 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.287 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.287 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.287 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.287 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.287 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.287 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.287 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.287 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.287 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.287 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.287 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.288 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.288 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.288 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.288 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.288 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.288 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.288 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.288 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.288 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.288 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.288 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.288 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.288 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.288 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.288 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.289 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.289 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.289 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.289 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.289 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.289 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.289 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.289 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.289 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.289 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.289 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.289 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.289 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.290 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.290 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.290 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.290 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.290 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.290 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.290 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.290 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.290 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.290 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.290 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.290 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.290 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.291 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.291 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.291 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.291 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.291 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.291 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.291 INFO:teuthology.orchestra.run.smithi037.stdout: "mark_out_threshold": { 2024-08-20T05:18:55.291 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mark_out_threshold", 2024-08-20T05:18:55.291 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.291 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.291 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.291 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "2419200", 2024-08-20T05:18:55.291 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.291 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.292 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.292 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-20T05:18:55.292 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.292 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.292 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.292 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.292 INFO:teuthology.orchestra.run.smithi037.stdout: "pool_name": { 2024-08-20T05:18:55.292 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pool_name", 2024-08-20T05:18:55.292 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.292 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.292 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.292 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "device_health_metrics", 2024-08-20T05:18:55.292 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.292 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.292 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.292 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-20T05:18:55.293 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.293 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.293 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.293 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.293 INFO:teuthology.orchestra.run.smithi037.stdout: "retention_period": { 2024-08-20T05:18:55.293 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "retention_period", 2024-08-20T05:18:55.293 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.293 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.293 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.293 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15552000", 2024-08-20T05:18:55.293 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.293 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.293 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.293 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long to retain device health metrics", 2024-08-20T05:18:55.293 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.294 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.294 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.294 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.294 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_frequency": { 2024-08-20T05:18:55.294 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_frequency", 2024-08-20T05:18:55.294 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.294 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.294 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.294 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-08-20T05:18:55.294 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.294 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.294 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.295 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-20T05:18:55.295 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.295 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.295 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.295 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.295 INFO:teuthology.orchestra.run.smithi037.stdout: "self_heal": { 2024-08-20T05:18:55.295 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "self_heal", 2024-08-20T05:18:55.295 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.295 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.295 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.295 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.295 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.295 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.295 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.295 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-20T05:18:55.296 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.296 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.296 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.296 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.296 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-20T05:18:55.296 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-20T05:18:55.296 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.296 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.296 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.296 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-20T05:18:55.296 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.296 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.296 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.296 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how frequently to wake up and check device health", 2024-08-20T05:18:55.296 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.297 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.297 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.297 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.297 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.297 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.297 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.297 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.297 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.297 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.297 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.297 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.297 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.297 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.297 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.297 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.298 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.298 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.298 INFO:teuthology.orchestra.run.smithi037.stdout: "warn_threshold": { 2024-08-20T05:18:55.298 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "warn_threshold", 2024-08-20T05:18:55.298 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.298 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.298 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.298 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7257600", 2024-08-20T05:18:55.298 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.298 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.298 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.298 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-20T05:18:55.298 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.299 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.299 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.299 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.299 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.299 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.299 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.299 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "diskprediction_local", 2024-08-20T05:18:55.299 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.299 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.299 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.299 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.299 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.299 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.299 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.299 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.300 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.300 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.300 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.300 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.300 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.300 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.300 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.300 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.300 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.300 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.300 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.300 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.300 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.300 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.301 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.301 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.301 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.301 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.301 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.301 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.301 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.301 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.301 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.301 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.301 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.301 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.301 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.301 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.302 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.302 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.302 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.302 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.302 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.302 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.302 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.302 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.302 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.302 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.302 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.303 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.303 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.303 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.303 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.303 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.303 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.303 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.303 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.303 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.303 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.303 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.303 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.303 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.303 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.303 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.303 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.304 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.304 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.304 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.304 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.304 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.304 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.304 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.304 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.304 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.304 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.304 INFO:teuthology.orchestra.run.smithi037.stdout: "predict_interval": { 2024-08-20T05:18:55.304 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predict_interval", 2024-08-20T05:18:55.304 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.304 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.304 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.305 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "86400", 2024-08-20T05:18:55.305 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.305 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.305 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.305 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.305 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.305 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.305 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.305 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.305 INFO:teuthology.orchestra.run.smithi037.stdout: "predictor_model": { 2024-08-20T05:18:55.305 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "predictor_model", 2024-08-20T05:18:55.305 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.305 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.305 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.305 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "prophetstor", 2024-08-20T05:18:55.305 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.306 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.306 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.306 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.306 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.306 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.306 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.306 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.306 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-20T05:18:55.306 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-20T05:18:55.306 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.306 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.306 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.306 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "600", 2024-08-20T05:18:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.307 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "influx", 2024-08-20T05:18:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": false, 2024-08-20T05:18:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "influxdb python module not found", 2024-08-20T05:18:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.308 INFO:teuthology.orchestra.run.smithi037.stdout: "batch_size": { 2024-08-20T05:18:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "batch_size", 2024-08-20T05:18:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5000", 2024-08-20T05:18:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-20T05:18:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: "database": { 2024-08-20T05:18:55.309 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "database", 2024-08-20T05:18:55.310 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.310 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.310 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.310 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "ceph", 2024-08-20T05:18:55.310 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.310 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.310 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.310 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-20T05:18:55.310 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.310 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.310 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.310 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.311 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": { 2024-08-20T05:18:55.311 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "hostname", 2024-08-20T05:18:55.311 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.311 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.311 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.311 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.311 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.311 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.311 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.311 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server hostname", 2024-08-20T05:18:55.311 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.311 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.311 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.311 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.312 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-20T05:18:55.312 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-20T05:18:55.312 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.312 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.312 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.312 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "30", 2024-08-20T05:18:55.312 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "5", 2024-08-20T05:18:55.312 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.312 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.312 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-20T05:18:55.312 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.312 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.312 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.312 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.312 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.313 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.313 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.313 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.313 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.313 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.313 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.313 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.313 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.313 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.313 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.313 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.313 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.313 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.313 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.313 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.313 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.314 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.314 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.314 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.314 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.314 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.314 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.314 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.314 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.314 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.314 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.314 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.314 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.314 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.314 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.315 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.315 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.315 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.315 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.315 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.315 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.315 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.315 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.315 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.315 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.315 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.315 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.315 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.315 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.315 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.316 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.316 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.316 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.316 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.316 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.316 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.316 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.316 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.316 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.316 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.316 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.316 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.316 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.316 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.317 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.317 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.317 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.317 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.317 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.317 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.317 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.317 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.317 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.317 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.317 INFO:teuthology.orchestra.run.smithi037.stdout: "password": { 2024-08-20T05:18:55.317 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "password", 2024-08-20T05:18:55.317 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.317 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.317 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.318 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.318 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.318 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.318 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.318 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "password of InfluxDB server user", 2024-08-20T05:18:55.318 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.318 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.318 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.318 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.318 INFO:teuthology.orchestra.run.smithi037.stdout: "port": { 2024-08-20T05:18:55.318 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "port", 2024-08-20T05:18:55.318 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.318 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.318 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.319 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "8086", 2024-08-20T05:18:55.319 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.319 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.319 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.319 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "InfluxDB server port", 2024-08-20T05:18:55.319 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.319 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.319 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.319 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.319 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.319 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.319 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.319 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.319 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.320 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.320 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.320 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.320 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.320 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.320 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.320 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.320 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.320 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.320 INFO:teuthology.orchestra.run.smithi037.stdout: "ssl": { 2024-08-20T05:18:55.320 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ssl", 2024-08-20T05:18:55.320 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.320 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.320 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.320 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "false", 2024-08-20T05:18:55.320 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.321 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.321 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.321 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T05:18:55.321 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.321 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.321 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.321 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.321 INFO:teuthology.orchestra.run.smithi037.stdout: "threads": { 2024-08-20T05:18:55.321 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threads", 2024-08-20T05:18:55.321 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.321 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.321 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.321 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-20T05:18:55.321 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-20T05:18:55.321 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "32", 2024-08-20T05:18:55.322 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.322 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-20T05:18:55.322 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.322 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.322 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.322 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.322 INFO:teuthology.orchestra.run.smithi037.stdout: "username": { 2024-08-20T05:18:55.322 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "username", 2024-08-20T05:18:55.322 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.322 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.322 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.322 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.322 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.322 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.322 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.323 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "username of InfluxDB server user", 2024-08-20T05:18:55.323 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.323 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.323 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.323 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.323 INFO:teuthology.orchestra.run.smithi037.stdout: "verify_ssl": { 2024-08-20T05:18:55.323 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "verify_ssl", 2024-08-20T05:18:55.323 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.323 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.323 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.323 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "true", 2024-08-20T05:18:55.323 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.323 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.323 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.323 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-20T05:18:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "insights", 2024-08-20T05:18:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.324 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.325 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.325 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.325 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.325 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.325 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.325 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.325 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.325 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.325 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.325 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.325 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.325 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.325 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.325 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.326 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.326 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.326 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.326 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.326 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.326 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.326 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.326 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.326 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.326 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.326 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.326 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.326 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.326 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.327 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.327 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.327 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.327 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.327 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.327 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.327 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.327 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.327 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.327 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.327 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.327 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.327 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.327 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.328 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.328 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.328 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.328 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.328 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.328 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.328 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.328 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.328 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.328 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.328 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.328 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.328 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.328 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.328 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.329 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.329 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.329 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.329 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.329 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.329 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.329 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.329 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.329 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.329 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.329 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.329 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.329 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.329 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.329 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.329 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.330 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.330 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.330 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.330 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.330 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.330 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.330 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.330 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.330 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.330 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.330 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "iostat", 2024-08-20T05:18:55.330 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.330 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.330 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.331 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.331 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.331 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.331 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.331 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.331 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.331 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.331 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.331 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.331 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.331 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.331 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.331 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.332 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.332 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.332 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.332 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.332 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.332 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.332 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.332 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.332 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.332 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.332 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.332 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.332 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.332 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.333 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.333 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.333 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.333 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.333 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.333 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.333 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.333 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.333 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.333 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.333 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.333 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.333 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.333 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.334 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.335 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.336 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "k8sevents", 2024-08-20T05:18:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_event_retention_days": { 2024-08-20T05:18:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "ceph_event_retention_days", 2024-08-20T05:18:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "7", 2024-08-20T05:18:55.337 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-20T05:18:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: "config_check_secs": { 2024-08-20T05:18:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "config_check_secs", 2024-08-20T05:18:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "10", 2024-08-20T05:18:55.338 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-20T05:18:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.339 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.340 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.341 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.342 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.344 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "localpool", 2024-08-20T05:18:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: "failure_domain": { 2024-08-20T05:18:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "failure_domain", 2024-08-20T05:18:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.345 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "host", 2024-08-20T05:18:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "failure domain for any created local pool", 2024-08-20T05:18:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-20T05:18:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.346 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.347 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "min_size": { 2024-08-20T05:18:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "min_size", 2024-08-20T05:18:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default min_size for any created local pool", 2024-08-20T05:18:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-20T05:18:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "num_rep": { 2024-08-20T05:18:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "num_rep", 2024-08-20T05:18:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3", 2024-08-20T05:18:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default replica count for any created local pool", 2024-08-20T05:18:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_num": { 2024-08-20T05:18:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_num", 2024-08-20T05:18:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "128", 2024-08-20T05:18:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "default pg_num for any created local pool", 2024-08-20T05:18:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.355 INFO:teuthology.orchestra.run.smithi037.stdout: "prefix": { 2024-08-20T05:18:55.355 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prefix", 2024-08-20T05:18:55.355 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.355 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.355 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.355 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.355 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.355 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.355 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.355 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "name prefix for any created local pool", 2024-08-20T05:18:55.355 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.356 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.356 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.356 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.356 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.356 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.356 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.356 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.356 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.356 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.356 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.356 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.356 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.357 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.357 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.357 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.357 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.357 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.357 INFO:teuthology.orchestra.run.smithi037.stdout: "subtree": { 2024-08-20T05:18:55.357 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "subtree", 2024-08-20T05:18:55.357 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.357 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.357 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.357 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "rack", 2024-08-20T05:18:55.357 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.357 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.357 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.358 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-20T05:18:55.358 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-20T05:18:55.358 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.358 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.358 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.358 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.358 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.358 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.358 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mds_autoscaler", 2024-08-20T05:18:55.358 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.358 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.358 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.358 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.359 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.359 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.359 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.359 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.359 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.359 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.359 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.359 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.359 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.359 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.359 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.359 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.359 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.359 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.360 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.360 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.360 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.360 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.360 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.360 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.360 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.360 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.360 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.360 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.360 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.360 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.360 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.360 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.361 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.361 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.361 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.361 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.361 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.361 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.361 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.361 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.361 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.361 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.361 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.361 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.361 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.361 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.362 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.362 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.362 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.362 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.362 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.362 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.362 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.362 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.362 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.362 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.362 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.362 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.363 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.363 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.363 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.363 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.363 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.363 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.363 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.363 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.363 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.363 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.363 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.363 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.363 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.364 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.364 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.364 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.364 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.364 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.364 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.364 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.364 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.364 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.364 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.364 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.364 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.364 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.364 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.364 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.364 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.365 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.365 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.365 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirroring", 2024-08-20T05:18:55.365 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.365 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.365 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.365 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.365 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.365 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.365 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.365 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.365 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.365 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.365 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.366 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.366 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.366 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.366 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.366 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.366 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.366 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.366 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.366 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.366 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.366 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.366 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.366 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.366 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.367 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.367 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.367 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.367 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.367 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.367 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.367 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.367 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.367 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.367 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.367 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.367 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.368 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.368 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.368 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.368 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.368 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.368 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.368 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.368 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.368 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.368 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.368 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.368 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.368 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.368 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.368 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.369 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.369 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.369 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.369 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.369 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.369 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.369 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.369 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.369 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.369 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.369 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.369 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.369 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.369 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.369 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.370 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.370 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.370 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.370 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.370 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.370 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.370 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.370 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.370 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.370 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.370 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.370 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.370 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.371 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.371 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.371 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.371 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.371 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.371 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.371 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.371 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.371 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.371 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.371 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "nfs", 2024-08-20T05:18:55.371 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.372 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.372 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.372 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.372 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.372 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.372 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.372 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.372 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.372 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.372 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.372 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.372 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.372 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.372 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.373 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.373 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.373 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.373 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.373 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.373 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.373 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.373 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.373 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.373 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.373 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.373 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.373 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.373 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.373 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.373 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.374 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.374 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.374 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.374 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.374 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.374 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.374 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.374 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.374 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.374 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.374 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.374 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.374 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.374 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.375 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.375 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.375 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.375 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.375 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.375 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.375 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.375 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.375 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.375 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.375 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.375 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.375 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.375 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.375 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.376 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.376 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.376 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.376 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.376 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.376 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.376 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.376 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.376 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.376 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.376 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.376 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.376 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.376 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.377 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.377 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.377 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.377 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.377 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.377 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.377 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.377 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.377 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.377 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.377 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.377 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.377 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.377 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.378 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.378 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.378 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-08-20T05:18:55.378 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.378 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.378 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.378 INFO:teuthology.orchestra.run.smithi037.stdout: "fail_fs": { 2024-08-20T05:18:55.378 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "fail_fs", 2024-08-20T05:18:55.378 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.378 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.378 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.378 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.378 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.379 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.379 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.379 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-20T05:18:55.379 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.379 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.379 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.379 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.379 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.379 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.379 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.379 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.379 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.379 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.379 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.379 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.380 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.380 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.380 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.380 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.380 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.380 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.380 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.380 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.380 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.380 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.380 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.380 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.380 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.380 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.381 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.381 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.381 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.381 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.381 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.381 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.381 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.381 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.381 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.381 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.381 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.381 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.381 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.381 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.381 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.382 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.382 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.382 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.382 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.382 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.382 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.382 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.382 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.382 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.382 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.382 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.382 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.382 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.382 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.382 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.383 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.383 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.383 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.383 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.383 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.383 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.383 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.383 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.383 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.383 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.383 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.383 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.383 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.383 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.383 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.384 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.384 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.384 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.384 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator": { 2024-08-20T05:18:55.384 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "orchestrator", 2024-08-20T05:18:55.384 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.384 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.384 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.384 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.384 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.384 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.384 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.384 INFO:teuthology.orchestra.run.smithi037.stdout: "cephadm", 2024-08-20T05:18:55.384 INFO:teuthology.orchestra.run.smithi037.stdout: "rook", 2024-08-20T05:18:55.385 INFO:teuthology.orchestra.run.smithi037.stdout: "test_orchestrator" 2024-08-20T05:18:55.385 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.385 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Orchestrator backend", 2024-08-20T05:18:55.385 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.385 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.385 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.385 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.385 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.385 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.385 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.385 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.385 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.385 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.385 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.385 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.386 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.386 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.386 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.386 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.386 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.386 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.386 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.386 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.386 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.386 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_perf_query", 2024-08-20T05:18:55.386 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.386 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.386 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.386 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.386 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.387 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.387 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.387 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.387 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.387 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.387 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.387 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.387 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.387 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.387 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.387 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.387 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.387 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.387 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.388 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.388 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.388 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.388 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.388 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.388 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.388 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.388 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.388 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.388 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.388 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.388 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.388 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.388 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.388 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.389 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.389 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.389 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.389 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.389 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.389 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.389 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.389 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.389 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.389 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.389 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.389 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.389 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.389 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.390 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.390 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.390 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.390 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.390 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.390 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.390 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.390 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.390 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.390 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.390 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.390 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.390 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.391 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.391 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.391 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.391 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.391 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.391 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.391 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.391 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.391 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.391 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.391 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.391 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.391 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.391 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.391 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.392 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.392 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.392 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.392 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.392 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.392 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.392 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.392 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.392 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.392 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.392 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.392 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.392 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.392 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.392 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "osd_support", 2024-08-20T05:18:55.393 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.393 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.393 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.393 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.393 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.393 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.393 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.393 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.393 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.393 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.393 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.393 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.393 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.393 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.393 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.394 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.394 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.394 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.394 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.394 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.394 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.394 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.394 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.394 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.394 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.394 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.394 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.394 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.395 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.395 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.395 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.395 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.395 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.395 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.395 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.395 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.395 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.395 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.395 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.395 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.395 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.395 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.396 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.396 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.396 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.396 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.396 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.396 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.396 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.396 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.396 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.396 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.396 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.396 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.396 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.396 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.396 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.397 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.397 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.397 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.397 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.397 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.397 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.397 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.397 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.397 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.397 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.397 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.397 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.397 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.397 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.398 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.398 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.398 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.398 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.398 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.398 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.398 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.398 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.398 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.398 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.398 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.398 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.398 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.398 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.399 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.399 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.399 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.399 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.399 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.399 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "pg_autoscaler", 2024-08-20T05:18:55.399 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.399 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.399 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.399 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.399 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.399 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.399 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.399 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.399 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.400 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.400 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.400 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.400 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.400 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.400 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.400 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.400 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.400 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.400 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.400 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.400 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.400 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.400 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.401 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.401 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.401 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.401 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.401 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.401 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.401 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.401 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.401 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.401 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.401 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.401 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.401 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.401 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.402 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.402 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.402 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.402 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.402 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.402 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.402 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.402 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.402 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.402 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.402 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.403 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-20T05:18:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-20T05:18:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.404 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-20T05:18:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.405 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "threshold": { 2024-08-20T05:18:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "threshold", 2024-08-20T05:18:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.406 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "3.0", 2024-08-20T05:18:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1.0", 2024-08-20T05:18:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "scaling threshold", 2024-08-20T05:18:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-20T05:18:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "progress", 2024-08-20T05:18:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.407 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_pg_recovery_event": { 2024-08-20T05:18:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_pg_recovery_event", 2024-08-20T05:18:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-20T05:18:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.408 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-08-20T05:18:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-08-20T05:18:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.409 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.410 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.411 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.412 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.413 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.414 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "max_completed_events": { 2024-08-20T05:18:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_completed_events", 2024-08-20T05:18:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "50", 2024-08-20T05:18:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "number of past completed events to remember", 2024-08-20T05:18:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.415 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "sleep_interval": { 2024-08-20T05:18:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sleep_interval", 2024-08-20T05:18:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-20T05:18:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "how long the module is going to sleep", 2024-08-20T05:18:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.416 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.417 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "prometheus", 2024-08-20T05:18:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "cache": { 2024-08-20T05:18:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cache", 2024-08-20T05:18:55.418 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "exclude_perf_counters": { 2024-08-20T05:18:55.419 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "exclude_perf_counters", 2024-08-20T05:18:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-20T05:18:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-20T05:18:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.420 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.421 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.422 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.423 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.424 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools": { 2024-08-20T05:18:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools", 2024-08-20T05:18:55.425 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-20T05:18:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-20T05:18:55.426 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "300", 2024-08-20T05:18:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "scrape_interval": { 2024-08-20T05:18:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "scrape_interval", 2024-08-20T05:18:55.427 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15.0", 2024-08-20T05:18:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.428 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-20T05:18:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-20T05:18:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "::", 2024-08-20T05:18:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-20T05:18:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.429 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-20T05:18:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-20T05:18:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "9283", 2024-08-20T05:18:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-20T05:18:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.430 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "stale_cache_strategy": { 2024-08-20T05:18:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stale_cache_strategy", 2024-08-20T05:18:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "log", 2024-08-20T05:18:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.432 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_behaviour": { 2024-08-20T05:18:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_behaviour", 2024-08-20T05:18:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "default", 2024-08-20T05:18:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "default", 2024-08-20T05:18:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "error" 2024-08-20T05:18:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.433 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "standby_error_status_code": { 2024-08-20T05:18:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "standby_error_status_code", 2024-08-20T05:18:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "500", 2024-08-20T05:18:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "400", 2024-08-20T05:18:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "599", 2024-08-20T05:18:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.434 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-08-20T05:18:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.435 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.436 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.437 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.438 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.439 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.440 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_snap_create": { 2024-08-20T05:18:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_snap_create", 2024-08-20T05:18:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10", 2024-08-20T05:18:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.441 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "mirror_snapshot_schedule": { 2024-08-20T05:18:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "mirror_snapshot_schedule", 2024-08-20T05:18:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.442 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.443 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "trash_purge_schedule": { 2024-08-20T05:18:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "trash_purge_schedule", 2024-08-20T05:18:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.444 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "restful", 2024-08-20T05:18:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "enable_auth": { 2024-08-20T05:18:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enable_auth", 2024-08-20T05:18:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.445 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "key_file": { 2024-08-20T05:18:55.446 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "key_file", 2024-08-20T05:18:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.447 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.448 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.449 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.450 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.451 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.452 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "server_addr": { 2024-08-20T05:18:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_addr", 2024-08-20T05:18:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.453 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "server_port": { 2024-08-20T05:18:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "server_port", 2024-08-20T05:18:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.454 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.455 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.456 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rgw", 2024-08-20T05:18:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.457 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.458 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.459 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.460 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.461 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "secondary_zone_period_retry_limit": { 2024-08-20T05:18:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "secondary_zone_period_retry_limit", 2024-08-20T05:18:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.462 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "5", 2024-08-20T05:18:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-08-20T05:18:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.463 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.464 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rook", 2024-08-20T05:18:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.465 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.466 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.467 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.468 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.469 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.470 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.471 INFO:teuthology.orchestra.run.smithi037.stdout: "storage_class": { 2024-08-20T05:18:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "storage_class", 2024-08-20T05:18:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "local", 2024-08-20T05:18:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-20T05:18:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.472 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "selftest", 2024-08-20T05:18:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.473 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.474 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.475 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.476 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.477 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.478 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "roption1": { 2024-08-20T05:18:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption1", 2024-08-20T05:18:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.479 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "roption2": { 2024-08-20T05:18:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "roption2", 2024-08-20T05:18:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "xyz", 2024-08-20T05:18:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.480 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption1": { 2024-08-20T05:18:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption1", 2024-08-20T05:18:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.481 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption2": { 2024-08-20T05:18:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption2", 2024-08-20T05:18:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.482 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption3": { 2024-08-20T05:18:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption3", 2024-08-20T05:18:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "float", 2024-08-20T05:18:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption4": { 2024-08-20T05:18:55.483 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption4", 2024-08-20T05:18:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption5": { 2024-08-20T05:18:55.484 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption5", 2024-08-20T05:18:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption6": { 2024-08-20T05:18:55.485 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption6", 2024-08-20T05:18:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "rwoption7": { 2024-08-20T05:18:55.486 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rwoption7", 2024-08-20T05:18:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "1", 2024-08-20T05:18:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "42", 2024-08-20T05:18:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.487 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "testkey": { 2024-08-20T05:18:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testkey", 2024-08-20T05:18:55.488 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "testlkey": { 2024-08-20T05:18:55.489 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testlkey", 2024-08-20T05:18:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "testnewline": { 2024-08-20T05:18:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "testnewline", 2024-08-20T05:18:55.490 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.491 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "smb", 2024-08-20T05:18:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "internal_store_backend": { 2024-08-20T05:18:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "internal_store_backend", 2024-08-20T05:18:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-08-20T05:18:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.492 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.493 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.494 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.495 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.496 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.497 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.498 INFO:teuthology.orchestra.run.smithi037.stdout: "update_orchestration": { 2024-08-20T05:18:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "update_orchestration", 2024-08-20T05:18:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-08-20T05:18:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.499 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snap_schedule", 2024-08-20T05:18:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "allow_m_granularity": { 2024-08-20T05:18:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "allow_m_granularity", 2024-08-20T05:18:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.500 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "allow minute scheduled snapshots", 2024-08-20T05:18:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "dump_on_update": { 2024-08-20T05:18:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "dump_on_update", 2024-08-20T05:18:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.501 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "dump database to debug log on update", 2024-08-20T05:18:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.502 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.504 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.505 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.506 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.507 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "stats", 2024-08-20T05:18:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.508 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.509 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.510 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.511 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.512 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.513 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.514 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "status", 2024-08-20T05:18:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.515 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.516 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.517 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.518 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.519 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telegraf", 2024-08-20T05:18:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.521 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "address": { 2024-08-20T05:18:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "address", 2024-08-20T05:18:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-20T05:18:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.522 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-20T05:18:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-20T05:18:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "15", 2024-08-20T05:18:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.523 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.524 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.525 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.526 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.527 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.528 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.529 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "telemetry", 2024-08-20T05:18:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_basic": { 2024-08-20T05:18:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_basic", 2024-08-20T05:18:55.530 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-20T05:18:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_crash": { 2024-08-20T05:18:55.531 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_crash", 2024-08-20T05:18:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-20T05:18:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_device": { 2024-08-20T05:18:55.532 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_device", 2024-08-20T05:18:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-20T05:18:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.533 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_ident": { 2024-08-20T05:18:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_ident", 2024-08-20T05:18:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-20T05:18:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.534 INFO:teuthology.orchestra.run.smithi037.stdout: "channel_perf": { 2024-08-20T05:18:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "channel_perf", 2024-08-20T05:18:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-20T05:18:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.535 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "contact": { 2024-08-20T05:18:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "contact", 2024-08-20T05:18:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.536 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "description": { 2024-08-20T05:18:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "description", 2024-08-20T05:18:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.537 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "device_url": { 2024-08-20T05:18:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "device_url", 2024-08-20T05:18:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-20T05:18:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.538 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "enabled": { 2024-08-20T05:18:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "enabled", 2024-08-20T05:18:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.539 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-20T05:18:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-20T05:18:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "24", 2024-08-20T05:18:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "8", 2024-08-20T05:18:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.540 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "last_opt_revision": { 2024-08-20T05:18:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "last_opt_revision", 2024-08-20T05:18:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "1", 2024-08-20T05:18:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.541 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard": { 2024-08-20T05:18:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard", 2024-08-20T05:18:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.542 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "leaderboard_description": { 2024-08-20T05:18:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "leaderboard_description", 2024-08-20T05:18:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.543 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.544 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.545 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.546 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.547 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.548 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "organization": { 2024-08-20T05:18:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "organization", 2024-08-20T05:18:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.549 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "proxy": { 2024-08-20T05:18:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "proxy", 2024-08-20T05:18:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.550 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.551 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "url": { 2024-08-20T05:18:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "url", 2024-08-20T05:18:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.552 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-20T05:18:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "test_orchestrator", 2024-08-20T05:18:55.553 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.554 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.555 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.556 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.557 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.558 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.559 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-08-20T05:18:55.560 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.561 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.562 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.563 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.564 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.565 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "max_concurrent_clones": { 2024-08-20T05:18:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "max_concurrent_clones", 2024-08-20T05:18:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "4", 2024-08-20T05:18:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.566 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-20T05:18:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "periodic_async_work": { 2024-08-20T05:18:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "periodic_async_work", 2024-08-20T05:18:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.567 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Periodically check for async work", 2024-08-20T05:18:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_delay": { 2024-08-20T05:18:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_delay", 2024-08-20T05:18:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.568 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-20T05:18:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "snapshot_clone_no_wait": { 2024-08-20T05:18:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "snapshot_clone_no_wait", 2024-08-20T05:18:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.569 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "True", 2024-08-20T05:18:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-20T05:18:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.570 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix", 2024-08-20T05:18:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "can_run": true, 2024-08-20T05:18:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: "error_string": "", 2024-08-20T05:18:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "module_options": { 2024-08-20T05:18:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "discovery_interval": { 2024-08-20T05:18:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "discovery_interval", 2024-08-20T05:18:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "uint", 2024-08-20T05:18:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "100", 2024-08-20T05:18:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "identifier": { 2024-08-20T05:18:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "identifier", 2024-08-20T05:18:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "interval": { 2024-08-20T05:18:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "interval", 2024-08-20T05:18:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "secs", 2024-08-20T05:18:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "60", 2024-08-20T05:18:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.574 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "log_level": { 2024-08-20T05:18:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_level", 2024-08-20T05:18:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.575 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster": { 2024-08-20T05:18:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster", 2024-08-20T05:18:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.576 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_cluster_level": { 2024-08-20T05:18:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_cluster_level", 2024-08-20T05:18:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.577 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "info", 2024-08-20T05:18:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [ 2024-08-20T05:18:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "", 2024-08-20T05:18:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "critical", 2024-08-20T05:18:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "debug", 2024-08-20T05:18:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "error", 2024-08-20T05:18:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "info", 2024-08-20T05:18:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "warning" 2024-08-20T05:18:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.578 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "log_to_file": { 2024-08-20T05:18:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "log_to_file", 2024-08-20T05:18:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "bool", 2024-08-20T05:18:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "False", 2024-08-20T05:18:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.579 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "sqlite3_killpoint": { 2024-08-20T05:18:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "sqlite3_killpoint", 2024-08-20T05:18:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "dev", 2024-08-20T05:18:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 1, 2024-08-20T05:18:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "0", 2024-08-20T05:18:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.580 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_host": { 2024-08-20T05:18:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_host", 2024-08-20T05:18:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "", 2024-08-20T05:18:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.581 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_port": { 2024-08-20T05:18:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_port", 2024-08-20T05:18:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "int", 2024-08-20T05:18:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "10051", 2024-08-20T05:18:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.582 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "zabbix_sender": { 2024-08-20T05:18:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "zabbix_sender", 2024-08-20T05:18:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "str", 2024-08-20T05:18:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "level": "advanced", 2024-08-20T05:18:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "flags": 0, 2024-08-20T05:18:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-20T05:18:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "min": "", 2024-08-20T05:18:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "max": "", 2024-08-20T05:18:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "enum_allowed": [], 2024-08-20T05:18:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "desc": "", 2024-08-20T05:18:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "long_desc": "", 2024-08-20T05:18:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "tags": [], 2024-08-20T05:18:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: "see_also": [] 2024-08-20T05:18:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.583 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "services": { 2024-08-20T05:18:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "dashboard": "https://172.21.15.37:8443/" 2024-08-20T05:18:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "always_on_modules": { 2024-08-20T05:18:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "octopus": [ 2024-08-20T05:18:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-08-20T05:18:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-08-20T05:18:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-08-20T05:18:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-08-20T05:18:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-08-20T05:18:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-08-20T05:18:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-08-20T05:18:55.584 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-08-20T05:18:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-08-20T05:18:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-08-20T05:18:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "pacific": [ 2024-08-20T05:18:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-08-20T05:18:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-08-20T05:18:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-08-20T05:18:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-08-20T05:18:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-08-20T05:18:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-08-20T05:18:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-08-20T05:18:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-08-20T05:18:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-08-20T05:18:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-08-20T05:18:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "quincy": [ 2024-08-20T05:18:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-08-20T05:18:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-08-20T05:18:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-08-20T05:18:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-08-20T05:18:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-08-20T05:18:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-08-20T05:18:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-08-20T05:18:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-08-20T05:18:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-08-20T05:18:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-08-20T05:18:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "reef": [ 2024-08-20T05:18:55.586 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-08-20T05:18:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-08-20T05:18:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-08-20T05:18:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-08-20T05:18:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-08-20T05:18:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-08-20T05:18:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-08-20T05:18:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-08-20T05:18:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-08-20T05:18:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-08-20T05:18:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-08-20T05:18:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "squid": [ 2024-08-20T05:18:55.587 INFO:teuthology.orchestra.run.smithi037.stdout: "balancer", 2024-08-20T05:18:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-08-20T05:18:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "devicehealth", 2024-08-20T05:18:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "orchestrator", 2024-08-20T05:18:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "pg_autoscaler", 2024-08-20T05:18:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "progress", 2024-08-20T05:18:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "rbd_support", 2024-08-20T05:18:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "status", 2024-08-20T05:18:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "telemetry", 2024-08-20T05:18:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "volumes" 2024-08-20T05:18:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-20T05:18:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "last_failure_osd_epoch": 3, 2024-08-20T05:18:55.588 INFO:teuthology.orchestra.run.smithi037.stdout: "active_clients": [ 2024-08-20T05:18:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "devicehealth", 2024-08-20T05:18:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-08-20T05:18:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-08-20T05:18:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-08-20T05:18:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3726395445 2024-08-20T05:18:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-20T05:18:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "libcephsqlite", 2024-08-20T05:18:55.589 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-08-20T05:18:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-08-20T05:18:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-08-20T05:18:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3197144397 2024-08-20T05:18:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-20T05:18:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "rbd_support", 2024-08-20T05:18:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-08-20T05:18:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-08-20T05:18:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-08-20T05:18:55.590 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 712925947 2024-08-20T05:18:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-20T05:18:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "volumes", 2024-08-20T05:18:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "addrvec": [ 2024-08-20T05:18:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: { 2024-08-20T05:18:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v2", 2024-08-20T05:18:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2024-08-20T05:18:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 4195212710 2024-08-20T05:18:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.591 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-20T05:18:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:55.592 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-08-20T05:18:55.592 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:18:55.594 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:54 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3200475631' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-20T05:18:55.594 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:54 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1502156345' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-20T05:18:55.594 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:54 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3200475631' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-20T05:18:55.594 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:54 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1502156345' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-20T05:18:55.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:54.123+0000 7f82f6000640 1 -- 172.21.15.37:0/1502156345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f82d40b3c50 msgr2=0x7f82d40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:55.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:54.123+0000 7f82f6000640 1 --2- 172.21.15.37:0/1502156345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f82d40b3c50 0x7f82d40b6110 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f82e0009bd0 tx=0x7f82e0005f90 comp rx=0 tx=0).stop 2024-08-20T05:18:55.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:54.123+0000 7f82f6000640 1 -- 172.21.15.37:0/1502156345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82f0076dc0 msgr2=0x7f82f019f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:18:55.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:54.123+0000 7f82f6000640 1 --2- 172.21.15.37:0/1502156345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82f0076dc0 0x7f82f019f750 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f82dc00e9f0 tx=0x7f82dc00edf0 comp rx=0 tx=0).stop 2024-08-20T05:18:55.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:54.123+0000 7f82f6000640 1 -- 172.21.15.37:0/1502156345 shutdown_connections 2024-08-20T05:18:55.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:54.123+0000 7f82f6000640 1 --2- 172.21.15.37:0/1502156345 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f82d40b3c50 0x7f82d40b6110 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:55.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:54.123+0000 7f82f6000640 1 --2- 172.21.15.37:0/1502156345 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f82f010edb0 0x7f82f01a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:54.123+0000 7f82f6000640 1 --2- 172.21.15.37:0/1502156345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82f0076dc0 0x7f82f019f750 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:54.123+0000 7f82f6000640 1 --2- 172.21.15.37:0/1502156345 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f82f0075850 0x7f82f019f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:18:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:54.123+0000 7f82f6000640 1 -- 172.21.15.37:0/1502156345 >> 172.21.15.37:0/1502156345 conn(0x7f82f00fdf40 msgr2=0x7f82f0102150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:18:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:54.123+0000 7f82f6000640 1 -- 172.21.15.37:0/1502156345 shutdown_connections 2024-08-20T05:18:55.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:18:54.123+0000 7f82f6000640 1 -- 172.21.15.37:0/1502156345 wait complete. 2024-08-20T05:18:55.603 DEBUG:tasks.check_counter:Getting stats from a 2024-08-20T05:18:55.603 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph daemon mds.a perf dump 2024-08-20T05:18:55.603 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:54 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3200475631' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-08-20T05:18:55.604 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:54 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1502156345' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-08-20T05:18:55.658 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:55 smithi037 ceph-mon[17265]: pgmap v901: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.3 KiB/s wr, 13 op/s 2024-08-20T05:18:55.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:55 smithi130 ceph-mon[22007]: pgmap v901: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.3 KiB/s wr, 13 op/s 2024-08-20T05:18:55.997 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:18:56.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:55 smithi135 ceph-mon[22342]: pgmap v901: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.3 KiB/s wr, 13 op/s 2024-08-20T05:18:56.692 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:18:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T05:18:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1483, 2024-08-20T05:18:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 1452, 2024-08-20T05:18:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 1132320, 2024-08-20T05:18:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 556166, 2024-08-20T05:18:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 5, 2024-08-20T05:18:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-08-20T05:18:56.692 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.300589784, 2024-08-20T05:18:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.151026937, 2024-08-20T05:18:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.080959675, 2024-08-20T05:18:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.055793492, 2024-08-20T05:18:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:18:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1451, 2024-08-20T05:18:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.285077639, 2024-08-20T05:18:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000196469 2024-08-20T05:18:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:18:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.693 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 754320, 2024-08-20T05:18:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 198416 2024-08-20T05:18:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T05:18:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1047, 2024-08-20T05:18:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 1289, 2024-08-20T05:18:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 258042, 2024-08-20T05:18:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 919258, 2024-08-20T05:18:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 7, 2024-08-20T05:18:56.694 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 4, 2024-08-20T05:18:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.207179636, 2024-08-20T05:18:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.093294318, 2024-08-20T05:18:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.033296453, 2024-08-20T05:18:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.063801779, 2024-08-20T05:18:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:18:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1287, 2024-08-20T05:18:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.223473174, 2024-08-20T05:18:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000173638 2024-08-20T05:18:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:18:56.695 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-20T05:18:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 586880 2024-08-20T05:18:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T05:18:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1399, 2024-08-20T05:18:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 1399, 2024-08-20T05:18:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 2797820, 2024-08-20T05:18:56.696 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 444059, 2024-08-20T05:18:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 5, 2024-08-20T05:18:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 3, 2024-08-20T05:18:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.224327261, 2024-08-20T05:18:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.091853852, 2024-08-20T05:18:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.053094084, 2024-08-20T05:18:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.056744558, 2024-08-20T05:18:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:18:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1398, 2024-08-20T05:18:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.195556043, 2024-08-20T05:18:56.697 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000139882 2024-08-20T05:18:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:18:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-08-20T05:18:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 448 2024-08-20T05:18:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-08-20T05:18:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 1, 2024-08-20T05:18:56.698 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-08-20T05:18:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-MDSRank": { 2024-08-20T05:18:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-08-20T05:18:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-08-20T05:18:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 5761, 2024-08-20T05:18:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.244044382, 2024-08-20T05:18:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000042361 2024-08-20T05:18:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-PurgeQueue": { 2024-08-20T05:18:56.699 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-08-20T05:18:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-08-20T05:18:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-08-20T05:18:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "request": 0, 2024-08-20T05:18:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "reply": 0, 2024-08-20T05:18:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "reply_latency": { 2024-08-20T05:18:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.700 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_reply": 0, 2024-08-20T05:18:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "forward": 0, 2024-08-20T05:18:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_complete": 0, 2024-08-20T05:18:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_keys": 0, 2024-08-20T05:18:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_commit": 0, 2024-08-20T05:18:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_split": 0, 2024-08-20T05:18:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_merge": 0, 2024-08-20T05:18:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes": 444, 2024-08-20T05:18:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_top": 146, 2024-08-20T05:18:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_bottom": 298, 2024-08-20T05:18:56.701 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pin_tail": 0, 2024-08-20T05:18:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pinned": 236, 2024-08-20T05:18:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_expired": 0, 2024-08-20T05:18:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_with_caps": 0, 2024-08-20T05:18:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": 0, 2024-08-20T05:18:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "subtrees": 18, 2024-08-20T05:18:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse": 0, 2024-08-20T05:18:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_hit": 0, 2024-08-20T05:18:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_forward": 0, 2024-08-20T05:18:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_discover": 0, 2024-08-20T05:18:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_dir_fetch": 0, 2024-08-20T05:18:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_remote_ino": 0, 2024-08-20T05:18:56.702 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_lock": 0, 2024-08-20T05:18:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "load_cent": 0, 2024-08-20T05:18:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "q": 0, 2024-08-20T05:18:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "exported": 0, 2024-08-20T05:18:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "exported_inodes": 0, 2024-08-20T05:18:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "imported": 0, 2024-08-20T05:18:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "imported_inodes": 0, 2024-08-20T05:18:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_dir_fetch": 0, 2024-08-20T05:18:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_backtrace_fetch": 0, 2024-08-20T05:18:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_peer_discover": 0, 2024-08-20T05:18:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rfiles": 0, 2024-08-20T05:18:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rbytes": 0, 2024-08-20T05:18:56.703 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rsnaps": 0, 2024-08-20T05:18:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_fetch": 0, 2024-08-20T05:18:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_set_tag": 0, 2024-08-20T05:18:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T05:18:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_inotable_repaired": 0, 2024-08-20T05:18:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_inodes": 0, 2024-08-20T05:18:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T05:18:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dirfrag_rstats": 0, 2024-08-20T05:18:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_file_inodes": 0, 2024-08-20T05:18:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_inode_file_caps": 0, 2024-08-20T05:18:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_revoke": 0, 2024-08-20T05:18:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_grant": 0, 2024-08-20T05:18:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T05:18:56.704 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T05:18:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T05:18:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps": 0, 2024-08-20T05:18:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps_dirty": 0, 2024-08-20T05:18:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_cap_release": 0, 2024-08-20T05:18:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "process_request_cap_release": 0 2024-08-20T05:18:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache": { 2024-08-20T05:18:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update": 0, 2024-08-20T05:18:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update_receipt": 0, 2024-08-20T05:18:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_try_discover": 0, 2024-08-20T05:18:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_send_discover": 0, 2024-08-20T05:18:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_handle_discover": 0, 2024-08-20T05:18:56.705 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays": 0, 2024-08-20T05:18:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_delayed": 0, 2024-08-20T05:18:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_enqueuing": 0, 2024-08-20T05:18:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_created": 0, 2024-08-20T05:18:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_enqueued": 0, 2024-08-20T05:18:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_reintegrated": 0, 2024-08-20T05:18:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_migrated": 0, 2024-08-20T05:18:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_processing": 0, 2024-08-20T05:18:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_enqueued": 0, 2024-08-20T05:18:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_prioritized": 0, 2024-08-20T05:18:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_started": 0, 2024-08-20T05:18:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_completed": 0, 2024-08-20T05:18:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_path": 0, 2024-08-20T05:18:56.706 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_inode": 0, 2024-08-20T05:18:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T05:18:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_exportdir": 0, 2024-08-20T05:18:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_flush": 0, 2024-08-20T05:18:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragmentdir": 0, 2024-08-20T05:18:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragstats": 0, 2024-08-20T05:18:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_inodestats": 0 2024-08-20T05:18:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log": { 2024-08-20T05:18:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "evlrg": 0, 2024-08-20T05:18:56.707 INFO:teuthology.orchestra.run.smithi037.stdout: "evadd": 0, 2024-08-20T05:18:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "evex": 0, 2024-08-20T05:18:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "evtrm": 0, 2024-08-20T05:18:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "ev": 1111, 2024-08-20T05:18:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "evexg": 0, 2024-08-20T05:18:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "evexd": 0, 2024-08-20T05:18:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "segadd": 0, 2024-08-20T05:18:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "segex": 0, 2024-08-20T05:18:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "segtrm": 0, 2024-08-20T05:18:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "seg": 3, 2024-08-20T05:18:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "segmjr": 2, 2024-08-20T05:18:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "segexg": 0, 2024-08-20T05:18:56.708 INFO:teuthology.orchestra.run.smithi037.stdout: "segexd": 0, 2024-08-20T05:18:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "expos": 4194304, 2024-08-20T05:18:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "wrpos": 6627953, 2024-08-20T05:18:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "rdpos": 6627379, 2024-08-20T05:18:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "jlat": { 2024-08-20T05:18:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "replayed": 1111 2024-08-20T05:18:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_mem": { 2024-08-20T05:18:56.709 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 401, 2024-08-20T05:18:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "ino+": 576, 2024-08-20T05:18:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "ino-": 175, 2024-08-20T05:18:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "dir": 56, 2024-08-20T05:18:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "dir+": 56, 2024-08-20T05:18:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "dir-": 0, 2024-08-20T05:18:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "dn": 444, 2024-08-20T05:18:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "dn+": 615, 2024-08-20T05:18:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "dn-": 171, 2024-08-20T05:18:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "cap": 0, 2024-08-20T05:18:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "cap+": 0, 2024-08-20T05:18:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "cap-": 0, 2024-08-20T05:18:56.710 INFO:teuthology.orchestra.run.smithi037.stdout: "rss": 51444, 2024-08-20T05:18:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "heap": 252493824 2024-08-20T05:18:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_server": { 2024-08-20T05:18:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_client_request": 0, 2024-08-20T05:18:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_server_request": 0, 2024-08-20T05:18:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_request": 0, 2024-08-20T05:18:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_session": 0, 2024-08-20T05:18:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_peer_request": 0, 2024-08-20T05:18:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "req_create_latency": { 2024-08-20T05:18:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.711 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getattr_latency": { 2024-08-20T05:18:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getfilelock_latency": { 2024-08-20T05:18:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.712 INFO:teuthology.orchestra.run.smithi037.stdout: "req_link_latency": { 2024-08-20T05:18:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookup_latency": { 2024-08-20T05:18:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookuphash_latency": { 2024-08-20T05:18:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.713 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupino_latency": { 2024-08-20T05:18:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupname_latency": { 2024-08-20T05:18:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.714 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupparent_latency": { 2024-08-20T05:18:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupsnap_latency": { 2024-08-20T05:18:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.715 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lssnap_latency": { 2024-08-20T05:18:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mkdir_latency": { 2024-08-20T05:18:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.716 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mknod_latency": { 2024-08-20T05:18:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mksnap_latency": { 2024-08-20T05:18:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.717 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "req_open_latency": { 2024-08-20T05:18:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "req_readdir_latency": { 2024-08-20T05:18:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.718 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rename_latency": { 2024-08-20T05:18:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "req_renamesnap_latency": { 2024-08-20T05:18:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.719 INFO:teuthology.orchestra.run.smithi037.stdout: "req_snapdiff_latency": { 2024-08-20T05:18:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmdir_latency": { 2024-08-20T05:18:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmsnap_latency": { 2024-08-20T05:18:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.720 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmxattr_latency": { 2024-08-20T05:18:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setattr_latency": { 2024-08-20T05:18:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.721 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setdirlayout_latency": { 2024-08-20T05:18:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setfilelock_latency": { 2024-08-20T05:18:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setlayout_latency": { 2024-08-20T05:18:56.722 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setxattr_latency": { 2024-08-20T05:18:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "req_symlink_latency": { 2024-08-20T05:18:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.723 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "req_unlink_latency": { 2024-08-20T05:18:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_revoke_eviction": 0, 2024-08-20T05:18:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_acquisition_throttle": 0, 2024-08-20T05:18:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getvxattr_latency": { 2024-08-20T05:18:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.724 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_sessions": { 2024-08-20T05:18:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "session_count": 1, 2024-08-20T05:18:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "session_add": 2, 2024-08-20T05:18:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "session_remove": 1, 2024-08-20T05:18:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_open": 1, 2024-08-20T05:18:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_stale": 0, 2024-08-20T05:18:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "total_load": 0, 2024-08-20T05:18:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "average_load": 0, 2024-08-20T05:18:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "avg_session_uptime": 2063, 2024-08-20T05:18:56.725 INFO:teuthology.orchestra.run.smithi037.stdout: "mdthresh_evicted": 0 2024-08-20T05:18:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-08-20T05:18:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-08-20T05:18:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-08-20T05:18:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T05:18:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-08-20T05:18:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T05:18:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-08-20T05:18:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T05:18:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T05:18:56.726 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T05:18:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T05:18:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T05:18:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-08-20T05:18:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T05:18:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T05:18:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-08-20T05:18:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-08-20T05:18:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-08-20T05:18:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-08-20T05:18:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T05:18:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T05:18:56.727 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T05:18:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T05:18:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T05:18:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-08-20T05:18:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-08-20T05:18:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-08-20T05:18:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T05:18:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T05:18:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-08-20T05:18:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-08-20T05:18:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-08-20T05:18:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-08-20T05:18:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T05:18:56.728 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-08-20T05:18:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T05:18:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-08-20T05:18:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 205719, 2024-08-20T05:18:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 446, 2024-08-20T05:18:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-08-20T05:18:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-08-20T05:18:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-08-20T05:18:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-08-20T05:18:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-08-20T05:18:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-08-20T05:18:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-08-20T05:18:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-08-20T05:18:56.729 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 8864, 2024-08-20T05:18:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 167, 2024-08-20T05:18:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T05:18:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-08-20T05:18:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-08-20T05:18:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-08-20T05:18:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 1301550, 2024-08-20T05:18:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 10576, 2024-08-20T05:18:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-08-20T05:18:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-08-20T05:18:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-08-20T05:18:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-08-20T05:18:56.730 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter": { 2024-08-20T05:18:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "op_active": 0, 2024-08-20T05:18:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "op_laggy": 0, 2024-08-20T05:18:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send": 3565, 2024-08-20T05:18:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send_bytes": 21, 2024-08-20T05:18:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "op_resend": 3, 2024-08-20T05:18:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "op_reply": 3565, 2024-08-20T05:18:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "op_latency": { 2024-08-20T05:18:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3565, 2024-08-20T05:18:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 5.299933479, 2024-08-20T05:18:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.001486657 2024-08-20T05:18:56.731 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "op_inflight": 0, 2024-08-20T05:18:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "oplen_avg": { 2024-08-20T05:18:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3565, 2024-08-20T05:18:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 3566 2024-08-20T05:18:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "op": 3565, 2024-08-20T05:18:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "op_r": 3565, 2024-08-20T05:18:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "op_w": 0, 2024-08-20T05:18:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "op_rmw": 0, 2024-08-20T05:18:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "op_pg": 0, 2024-08-20T05:18:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_stat": 2167, 2024-08-20T05:18:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_create": 0, 2024-08-20T05:18:56.732 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_read": 1396, 2024-08-20T05:18:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_write": 0, 2024-08-20T05:18:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writefull": 0, 2024-08-20T05:18:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writesame": 0, 2024-08-20T05:18:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_append": 0, 2024-08-20T05:18:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_zero": 0, 2024-08-20T05:18:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_truncate": 0, 2024-08-20T05:18:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_delete": 0, 2024-08-20T05:18:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_mapext": 0, 2024-08-20T05:18:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_sparse_read": 0, 2024-08-20T05:18:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_clonerange": 0, 2024-08-20T05:18:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_getxattr": 1, 2024-08-20T05:18:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_setxattr": 0, 2024-08-20T05:18:56.733 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_cmpxattr": 0, 2024-08-20T05:18:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_rmxattr": 0, 2024-08-20T05:18:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_resetxattrs": 0, 2024-08-20T05:18:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_call": 0, 2024-08-20T05:18:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_watch": 0, 2024-08-20T05:18:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_notify": 0, 2024-08-20T05:18:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T05:18:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls": 0, 2024-08-20T05:18:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls_filter": 0, 2024-08-20T05:18:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_other": 0, 2024-08-20T05:18:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_active": 0, 2024-08-20T05:18:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_send": 0, 2024-08-20T05:18:56.734 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_resend": 0, 2024-08-20T05:18:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_ping": 0, 2024-08-20T05:18:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_active": 0, 2024-08-20T05:18:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_send": 0, 2024-08-20T05:18:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_resend": 0, 2024-08-20T05:18:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_active": 0, 2024-08-20T05:18:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_send": 0, 2024-08-20T05:18:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_resend": 0, 2024-08-20T05:18:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_active": 0, 2024-08-20T05:18:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_send": 0, 2024-08-20T05:18:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_resend": 0, 2024-08-20T05:18:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "command_active": 0, 2024-08-20T05:18:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "command_send": 0, 2024-08-20T05:18:56.735 INFO:teuthology.orchestra.run.smithi037.stdout: "command_resend": 0, 2024-08-20T05:18:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "map_epoch": 88, 2024-08-20T05:18:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "map_full": 0, 2024-08-20T05:18:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "map_inc": 4, 2024-08-20T05:18:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_sessions": 5, 2024-08-20T05:18:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_open": 7, 2024-08-20T05:18:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_close": 2, 2024-08-20T05:18:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_laggy": 0, 2024-08-20T05:18:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_wr": 0, 2024-08-20T05:18:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_rd": 2, 2024-08-20T05:18:56.736 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_del": 0 2024-08-20T05:18:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "oft": { 2024-08-20T05:18:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_objs": 0, 2024-08-20T05:18:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_kv_pairs": 0, 2024-08-20T05:18:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_updates": 0, 2024-08-20T05:18:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_removes": 0 2024-08-20T05:18:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "purge_queue": { 2024-08-20T05:18:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops": 0, 2024-08-20T05:18:56.737 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops_high_water": 0, 2024-08-20T05:18:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing": 0, 2024-08-20T05:18:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_high_water": 0, 2024-08-20T05:18:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed_ops": 0, 2024-08-20T05:18:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed": 0, 2024-08-20T05:18:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_item_in_journal": 0 2024-08-20T05:18:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T05:18:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-08-20T05:18:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-08-20T05:18:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-08-20T05:18:56.738 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 3925, 2024-08-20T05:18:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 3813606, 2024-08-20T05:18:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-08-20T05:18:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 3925, 2024-08-20T05:18:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-08-20T05:18:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-08-20T05:18:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3925, 2024-08-20T05:18:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 3813606, 2024-08-20T05:18:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-08-20T05:18:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.739 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_bytes": { 2024-08-20T05:18:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-08-20T05:18:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-08-20T05:18:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-08-20T05:18:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-08-20T05:18:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-08-20T05:18:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-08-20T05:18:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-08-20T05:18:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 3565, 2024-08-20T05:18:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 2433654, 2024-08-20T05:18:56.740 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3565, 2024-08-20T05:18:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 2433654, 2024-08-20T05:18:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-08-20T05:18:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_ops": { 2024-08-20T05:18:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-08-20T05:18:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1024, 2024-08-20T05:18:56.741 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-08-20T05:18:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-08-20T05:18:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-08-20T05:18:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-08-20T05:18:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-08-20T05:18:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 3565, 2024-08-20T05:18:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 3565, 2024-08-20T05:18:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3565, 2024-08-20T05:18:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 3565, 2024-08-20T05:18:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-08-20T05:18:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.742 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle": { 2024-08-20T05:18:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-08-20T05:18:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-08-20T05:18:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-08-20T05:18:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-08-20T05:18:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-08-20T05:18:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-08-20T05:18:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-08-20T05:18:56.743 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-08-20T05:18:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-08-20T05:18:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-08-20T05:18:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-08-20T05:18:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-08-20T05:18:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle-0x55dbd237c960": { 2024-08-20T05:18:56.744 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-08-20T05:18:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-08-20T05:18:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-08-20T05:18:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-08-20T05:18:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-08-20T05:18:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-08-20T05:18:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-08-20T05:18:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-08-20T05:18:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-08-20T05:18:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-08-20T05:18:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-08-20T05:18:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-08-20T05:18:56.745 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "trackedop": { 2024-08-20T05:18:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_ops_count": 0 2024-08-20T05:18:56.746 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:56.746 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:18:57.722 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-08-20T05:18:57.722 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-08-20T05:18:57.722 DEBUG:tasks.check_counter:Getting stats from d 2024-08-20T05:18:57.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph daemon mds.d perf dump 2024-08-20T05:18:57.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:57 smithi130 ceph-mon[22007]: pgmap v902: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 9 op/s 2024-08-20T05:18:58.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:57 smithi037 ceph-mon[17265]: pgmap v902: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 9 op/s 2024-08-20T05:18:58.107 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:18:58.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:57 smithi135 ceph-mon[22342]: pgmap v902: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 9 op/s 2024-08-20T05:18:58.752 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:18:58.752 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T05:18:58.752 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 0, 2024-08-20T05:18:58.752 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2, 2024-08-20T05:18:58.752 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 0, 2024-08-20T05:18:58.752 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 0, 2024-08-20T05:18:58.753 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-08-20T05:18:58.753 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 0, 2024-08-20T05:18:58.753 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.003225786, 2024-08-20T05:18:58.753 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000000000, 2024-08-20T05:18:58.753 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.000502189, 2024-08-20T05:18:58.753 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T05:18:58.753 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:18:58.753 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:58.753 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:58.753 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:58.753 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:58.753 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:18:58.753 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:58.754 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:58.754 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:58.754 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:58.754 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T05:18:58.754 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T05:18:58.754 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:58.754 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T05:18:58.754 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 332, 2024-08-20T05:18:58.754 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 327, 2024-08-20T05:18:58.754 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 551888, 2024-08-20T05:18:58.754 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 201328, 2024-08-20T05:18:58.754 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 2, 2024-08-20T05:18:58.754 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-08-20T05:18:58.755 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.097849214, 2024-08-20T05:18:58.755 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.061963998, 2024-08-20T05:18:58.755 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.039180392, 2024-08-20T05:18:58.755 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T05:18:58.755 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:18:58.755 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 327, 2024-08-20T05:18:58.755 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.070911869, 2024-08-20T05:18:58.755 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000216855 2024-08-20T05:18:58.755 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:58.755 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:18:58.755 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:58.755 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:58.755 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:58.755 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:58.756 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 551888, 2024-08-20T05:18:58.756 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 201328 2024-08-20T05:18:58.756 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:58.756 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T05:18:58.756 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 2, 2024-08-20T05:18:58.756 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 249, 2024-08-20T05:18:58.756 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 320, 2024-08-20T05:18:58.756 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 203792, 2024-08-20T05:18:58.756 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-08-20T05:18:58.756 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-08-20T05:18:58.756 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.039014417, 2024-08-20T05:18:58.756 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.033310623, 2024-08-20T05:18:58.756 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.002193704, 2024-08-20T05:18:58.757 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T05:18:58.757 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:18:58.757 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 247, 2024-08-20T05:18:58.757 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.058257277, 2024-08-20T05:18:58.757 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000235859 2024-08-20T05:18:58.757 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:58.757 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:18:58.757 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:58.757 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:58.757 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:58.757 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:58.757 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-20T05:18:58.757 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 203792 2024-08-20T05:18:58.758 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:58.758 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-08-20T05:18:58.758 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 0, 2024-08-20T05:18:58.758 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-08-20T05:18:58.758 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:58.758 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-08-20T05:18:58.758 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-08-20T05:18:58.758 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-08-20T05:18:58.758 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T05:18:58.758 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-08-20T05:18:58.758 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T05:18:58.758 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-08-20T05:18:58.758 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T05:18:58.759 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T05:18:58.759 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T05:18:58.759 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T05:18:58.759 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T05:18:58.759 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-08-20T05:18:58.759 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T05:18:58.759 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T05:18:58.759 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-08-20T05:18:58.759 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-08-20T05:18:58.759 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-08-20T05:18:58.759 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-08-20T05:18:58.759 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T05:18:58.759 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T05:18:58.759 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T05:18:58.760 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T05:18:58.760 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T05:18:58.760 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-08-20T05:18:58.760 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-08-20T05:18:58.760 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-08-20T05:18:58.760 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T05:18:58.760 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T05:18:58.760 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-08-20T05:18:58.760 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-08-20T05:18:58.760 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-08-20T05:18:58.760 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-08-20T05:18:58.760 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T05:18:58.760 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-08-20T05:18:58.761 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T05:18:58.761 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-08-20T05:18:58.761 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 148704, 2024-08-20T05:18:58.761 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 29, 2024-08-20T05:18:58.761 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-08-20T05:18:58.761 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-08-20T05:18:58.761 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-08-20T05:18:58.761 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-08-20T05:18:58.761 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-08-20T05:18:58.761 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-08-20T05:18:58.761 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-08-20T05:18:58.761 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-08-20T05:18:58.761 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 0, 2024-08-20T05:18:58.762 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 0, 2024-08-20T05:18:58.762 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T05:18:58.762 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-08-20T05:18:58.762 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-08-20T05:18:58.762 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-08-20T05:18:58.762 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 928, 2024-08-20T05:18:58.762 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 2, 2024-08-20T05:18:58.762 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-08-20T05:18:58.762 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-08-20T05:18:58.762 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-08-20T05:18:58.762 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-08-20T05:18:58.762 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:18:58.762 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T05:18:58.762 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-08-20T05:18:58.763 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-08-20T05:18:58.763 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-08-20T05:18:58.763 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 330, 2024-08-20T05:18:58.763 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 502565, 2024-08-20T05:18:58.763 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-08-20T05:18:58.763 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 330, 2024-08-20T05:18:58.763 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-08-20T05:18:58.763 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-08-20T05:18:58.763 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 330, 2024-08-20T05:18:58.763 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 502565, 2024-08-20T05:18:58.763 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-08-20T05:18:58.763 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:18:58.763 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:18:58.764 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:18:58.764 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:58.764 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:18:58.764 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:18:59.670 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-08-20T05:18:59.670 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-08-20T05:18:59.670 DEBUG:tasks.check_counter:Getting stats from g 2024-08-20T05:18:59.671 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph daemon mds.g perf dump 2024-08-20T05:18:59.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:18:59 smithi130 ceph-mon[22007]: pgmap v903: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 10 op/s 2024-08-20T05:19:00.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:18:59 smithi037 ceph-mon[17265]: pgmap v903: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 10 op/s 2024-08-20T05:19:00.051 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:19:00.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:18:59 smithi135 ceph-mon[22342]: pgmap v903: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 938 B/s wr, 10 op/s 2024-08-20T05:19:00.759 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:19:00.759 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T05:19:00.760 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 1076, 2024-08-20T05:19:00.760 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 1078, 2024-08-20T05:19:00.760 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 361481, 2024-08-20T05:19:00.760 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 342169, 2024-08-20T05:19:00.760 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 7, 2024-08-20T05:19:00.760 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-08-20T05:19:00.760 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.248550829, 2024-08-20T05:19:00.760 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.122389002, 2024-08-20T05:19:00.760 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.047725239, 2024-08-20T05:19:00.760 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.060026694, 2024-08-20T05:19:00.760 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:00.760 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 1076, 2024-08-20T05:19:00.760 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.239970663, 2024-08-20T05:19:00.761 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000223021 2024-08-20T05:19:00.761 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.761 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:00.761 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.761 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.761 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.761 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.761 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T05:19:00.761 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T05:19:00.761 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.761 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T05:19:00.762 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 2525, 2024-08-20T05:19:00.762 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2494, 2024-08-20T05:19:00.762 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 3281105, 2024-08-20T05:19:00.762 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 888065, 2024-08-20T05:19:00.762 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-08-20T05:19:00.762 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 3, 2024-08-20T05:19:00.762 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.362415793, 2024-08-20T05:19:00.762 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.167344146, 2024-08-20T05:19:00.762 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.099150378, 2024-08-20T05:19:00.762 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.086137519, 2024-08-20T05:19:00.763 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:00.763 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 2493, 2024-08-20T05:19:00.763 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.310745219, 2024-08-20T05:19:00.763 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000124647 2024-08-20T05:19:00.763 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.763 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:00.763 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.763 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.763 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.763 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.763 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 755200, 2024-08-20T05:19:00.763 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 199856 2024-08-20T05:19:00.763 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.764 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T05:19:00.764 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 9, 2024-08-20T05:19:00.764 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 251, 2024-08-20T05:19:00.764 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 4612, 2024-08-20T05:19:00.764 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 590261, 2024-08-20T05:19:00.764 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 7, 2024-08-20T05:19:00.764 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 4, 2024-08-20T05:19:00.764 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.048524951, 2024-08-20T05:19:00.764 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.038652699, 2024-08-20T05:19:00.764 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.006632500, 2024-08-20T05:19:00.764 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000071017, 2024-08-20T05:19:00.764 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:00.764 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 250, 2024-08-20T05:19:00.765 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.052942331, 2024-08-20T05:19:00.765 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000211769 2024-08-20T05:19:00.765 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.765 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:00.765 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.765 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.765 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.765 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.765 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-08-20T05:19:00.765 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 589296 2024-08-20T05:19:00.765 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.765 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-08-20T05:19:00.766 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 1, 2024-08-20T05:19:00.766 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-08-20T05:19:00.766 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.766 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-MDSRank": { 2024-08-20T05:19:00.766 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-08-20T05:19:00.766 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-08-20T05:19:00.766 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 5255, 2024-08-20T05:19:00.766 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.199735779, 2024-08-20T05:19:00.766 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000038008 2024-08-20T05:19:00.766 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:19:00.766 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.767 INFO:teuthology.orchestra.run.smithi037.stdout: "finisher-PurgeQueue": { 2024-08-20T05:19:00.767 INFO:teuthology.orchestra.run.smithi037.stdout: "queue_len": 0, 2024-08-20T05:19:00.767 INFO:teuthology.orchestra.run.smithi037.stdout: "complete_latency": { 2024-08-20T05:19:00.767 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.767 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.767 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.767 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:19:00.767 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.767 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-08-20T05:19:00.767 INFO:teuthology.orchestra.run.smithi037.stdout: "request": 0, 2024-08-20T05:19:00.767 INFO:teuthology.orchestra.run.smithi037.stdout: "reply": 0, 2024-08-20T05:19:00.767 INFO:teuthology.orchestra.run.smithi037.stdout: "reply_latency": { 2024-08-20T05:19:00.768 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.768 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.768 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.768 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.768 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_reply": 0, 2024-08-20T05:19:00.768 INFO:teuthology.orchestra.run.smithi037.stdout: "forward": 0, 2024-08-20T05:19:00.768 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_complete": 0, 2024-08-20T05:19:00.768 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_fetch_keys": 0, 2024-08-20T05:19:00.768 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_commit": 0, 2024-08-20T05:19:00.768 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_split": 0, 2024-08-20T05:19:00.768 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_merge": 0, 2024-08-20T05:19:00.768 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes": 435, 2024-08-20T05:19:00.769 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_top": 0, 2024-08-20T05:19:00.769 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_bottom": 435, 2024-08-20T05:19:00.769 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pin_tail": 0, 2024-08-20T05:19:00.769 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_pinned": 435, 2024-08-20T05:19:00.769 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_expired": 0, 2024-08-20T05:19:00.769 INFO:teuthology.orchestra.run.smithi037.stdout: "inodes_with_caps": 0, 2024-08-20T05:19:00.769 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": 0, 2024-08-20T05:19:00.769 INFO:teuthology.orchestra.run.smithi037.stdout: "subtrees": 8, 2024-08-20T05:19:00.769 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse": 0, 2024-08-20T05:19:00.769 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_hit": 0, 2024-08-20T05:19:00.769 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_forward": 0, 2024-08-20T05:19:00.769 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_discover": 0, 2024-08-20T05:19:00.770 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_dir_fetch": 0, 2024-08-20T05:19:00.770 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_remote_ino": 0, 2024-08-20T05:19:00.770 INFO:teuthology.orchestra.run.smithi037.stdout: "traverse_lock": 0, 2024-08-20T05:19:00.770 INFO:teuthology.orchestra.run.smithi037.stdout: "load_cent": 0, 2024-08-20T05:19:00.770 INFO:teuthology.orchestra.run.smithi037.stdout: "q": 0, 2024-08-20T05:19:00.770 INFO:teuthology.orchestra.run.smithi037.stdout: "exported": 0, 2024-08-20T05:19:00.770 INFO:teuthology.orchestra.run.smithi037.stdout: "exported_inodes": 0, 2024-08-20T05:19:00.770 INFO:teuthology.orchestra.run.smithi037.stdout: "imported": 0, 2024-08-20T05:19:00.770 INFO:teuthology.orchestra.run.smithi037.stdout: "imported_inodes": 0, 2024-08-20T05:19:00.770 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_dir_fetch": 0, 2024-08-20T05:19:00.770 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_backtrace_fetch": 0, 2024-08-20T05:19:00.770 INFO:teuthology.orchestra.run.smithi037.stdout: "openino_peer_discover": 0, 2024-08-20T05:19:00.771 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rfiles": 0, 2024-08-20T05:19:00.771 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rbytes": 0, 2024-08-20T05:19:00.771 INFO:teuthology.orchestra.run.smithi037.stdout: "root_rsnaps": 0, 2024-08-20T05:19:00.771 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_fetch": 0, 2024-08-20T05:19:00.771 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_set_tag": 0, 2024-08-20T05:19:00.771 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T05:19:00.771 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_inotable_repaired": 0, 2024-08-20T05:19:00.771 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_inodes": 0, 2024-08-20T05:19:00.771 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T05:19:00.771 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_dirfrag_rstats": 0, 2024-08-20T05:19:00.771 INFO:teuthology.orchestra.run.smithi037.stdout: "scrub_file_inodes": 0, 2024-08-20T05:19:00.771 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_inode_file_caps": 0, 2024-08-20T05:19:00.772 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_revoke": 0, 2024-08-20T05:19:00.772 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_grant": 0, 2024-08-20T05:19:00.772 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T05:19:00.772 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T05:19:00.772 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T05:19:00.772 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps": 0, 2024-08-20T05:19:00.772 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_caps_dirty": 0, 2024-08-20T05:19:00.772 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_cap_release": 0, 2024-08-20T05:19:00.772 INFO:teuthology.orchestra.run.smithi037.stdout: "process_request_cap_release": 0 2024-08-20T05:19:00.772 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.772 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_cache": { 2024-08-20T05:19:00.772 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update": 0, 2024-08-20T05:19:00.772 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_update_receipt": 0, 2024-08-20T05:19:00.772 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_try_discover": 0, 2024-08-20T05:19:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_send_discover": 0, 2024-08-20T05:19:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "dir_handle_discover": 0, 2024-08-20T05:19:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays": 0, 2024-08-20T05:19:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_delayed": 0, 2024-08-20T05:19:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "num_strays_enqueuing": 0, 2024-08-20T05:19:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_created": 0, 2024-08-20T05:19:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_enqueued": 0, 2024-08-20T05:19:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_reintegrated": 0, 2024-08-20T05:19:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "strays_migrated": 0, 2024-08-20T05:19:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_processing": 0, 2024-08-20T05:19:00.773 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_enqueued": 0, 2024-08-20T05:19:00.774 INFO:teuthology.orchestra.run.smithi037.stdout: "num_recovering_prioritized": 0, 2024-08-20T05:19:00.774 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_started": 0, 2024-08-20T05:19:00.774 INFO:teuthology.orchestra.run.smithi037.stdout: "recovery_completed": 0, 2024-08-20T05:19:00.774 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_path": 0, 2024-08-20T05:19:00.774 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_quiesce_inode": 0, 2024-08-20T05:19:00.774 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T05:19:00.774 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_exportdir": 0, 2024-08-20T05:19:00.774 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_flush": 0, 2024-08-20T05:19:00.774 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragmentdir": 0, 2024-08-20T05:19:00.774 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_fragstats": 0, 2024-08-20T05:19:00.774 INFO:teuthology.orchestra.run.smithi037.stdout: "ireq_inodestats": 0 2024-08-20T05:19:00.775 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.775 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_log": { 2024-08-20T05:19:00.775 INFO:teuthology.orchestra.run.smithi037.stdout: "evlrg": 0, 2024-08-20T05:19:00.775 INFO:teuthology.orchestra.run.smithi037.stdout: "evadd": 0, 2024-08-20T05:19:00.775 INFO:teuthology.orchestra.run.smithi037.stdout: "evex": 0, 2024-08-20T05:19:00.775 INFO:teuthology.orchestra.run.smithi037.stdout: "evtrm": 0, 2024-08-20T05:19:00.775 INFO:teuthology.orchestra.run.smithi037.stdout: "ev": 1434, 2024-08-20T05:19:00.775 INFO:teuthology.orchestra.run.smithi037.stdout: "evexg": 0, 2024-08-20T05:19:00.775 INFO:teuthology.orchestra.run.smithi037.stdout: "evexd": 0, 2024-08-20T05:19:00.775 INFO:teuthology.orchestra.run.smithi037.stdout: "segadd": 0, 2024-08-20T05:19:00.775 INFO:teuthology.orchestra.run.smithi037.stdout: "segex": 0, 2024-08-20T05:19:00.776 INFO:teuthology.orchestra.run.smithi037.stdout: "segtrm": 0, 2024-08-20T05:19:00.776 INFO:teuthology.orchestra.run.smithi037.stdout: "seg": 3, 2024-08-20T05:19:00.776 INFO:teuthology.orchestra.run.smithi037.stdout: "segmjr": 2, 2024-08-20T05:19:00.776 INFO:teuthology.orchestra.run.smithi037.stdout: "segexg": 0, 2024-08-20T05:19:00.776 INFO:teuthology.orchestra.run.smithi037.stdout: "segexd": 0, 2024-08-20T05:19:00.776 INFO:teuthology.orchestra.run.smithi037.stdout: "expos": 4194304, 2024-08-20T05:19:00.776 INFO:teuthology.orchestra.run.smithi037.stdout: "wrpos": 6170601, 2024-08-20T05:19:00.776 INFO:teuthology.orchestra.run.smithi037.stdout: "rdpos": 6169463, 2024-08-20T05:19:00.776 INFO:teuthology.orchestra.run.smithi037.stdout: "jlat": { 2024-08-20T05:19:00.776 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.776 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.776 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.776 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.776 INFO:teuthology.orchestra.run.smithi037.stdout: "replayed": 1434 2024-08-20T05:19:00.777 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.777 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_mem": { 2024-08-20T05:19:00.777 INFO:teuthology.orchestra.run.smithi037.stdout: "ino": 251, 2024-08-20T05:19:00.777 INFO:teuthology.orchestra.run.smithi037.stdout: "ino+": 439, 2024-08-20T05:19:00.777 INFO:teuthology.orchestra.run.smithi037.stdout: "ino-": 188, 2024-08-20T05:19:00.777 INFO:teuthology.orchestra.run.smithi037.stdout: "dir": 17, 2024-08-20T05:19:00.777 INFO:teuthology.orchestra.run.smithi037.stdout: "dir+": 18, 2024-08-20T05:19:00.777 INFO:teuthology.orchestra.run.smithi037.stdout: "dir-": 1, 2024-08-20T05:19:00.777 INFO:teuthology.orchestra.run.smithi037.stdout: "dn": 435, 2024-08-20T05:19:00.777 INFO:teuthology.orchestra.run.smithi037.stdout: "dn+": 442, 2024-08-20T05:19:00.777 INFO:teuthology.orchestra.run.smithi037.stdout: "dn-": 7, 2024-08-20T05:19:00.777 INFO:teuthology.orchestra.run.smithi037.stdout: "cap": 0, 2024-08-20T05:19:00.777 INFO:teuthology.orchestra.run.smithi037.stdout: "cap+": 0, 2024-08-20T05:19:00.778 INFO:teuthology.orchestra.run.smithi037.stdout: "cap-": 0, 2024-08-20T05:19:00.778 INFO:teuthology.orchestra.run.smithi037.stdout: "rss": 49640, 2024-08-20T05:19:00.778 INFO:teuthology.orchestra.run.smithi037.stdout: "heap": 251387904 2024-08-20T05:19:00.778 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.778 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_server": { 2024-08-20T05:19:00.778 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_client_request": 0, 2024-08-20T05:19:00.778 INFO:teuthology.orchestra.run.smithi037.stdout: "dispatch_server_request": 0, 2024-08-20T05:19:00.778 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_request": 0, 2024-08-20T05:19:00.778 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_client_session": 0, 2024-08-20T05:19:00.778 INFO:teuthology.orchestra.run.smithi037.stdout: "handle_peer_request": 0, 2024-08-20T05:19:00.778 INFO:teuthology.orchestra.run.smithi037.stdout: "req_create_latency": { 2024-08-20T05:19:00.778 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.779 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.779 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.779 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.779 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getattr_latency": { 2024-08-20T05:19:00.779 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.779 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.779 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.779 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.779 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getfilelock_latency": { 2024-08-20T05:19:00.779 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.779 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.779 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.779 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.780 INFO:teuthology.orchestra.run.smithi037.stdout: "req_link_latency": { 2024-08-20T05:19:00.780 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.780 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.780 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.780 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.780 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookup_latency": { 2024-08-20T05:19:00.780 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.780 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.780 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.780 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.780 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookuphash_latency": { 2024-08-20T05:19:00.780 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.780 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.780 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.781 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.781 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupino_latency": { 2024-08-20T05:19:00.781 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.781 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.781 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.781 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.781 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupname_latency": { 2024-08-20T05:19:00.781 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.781 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.781 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.781 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.781 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupparent_latency": { 2024-08-20T05:19:00.781 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.782 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.782 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.782 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.782 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lookupsnap_latency": { 2024-08-20T05:19:00.782 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.782 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.782 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.782 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.782 INFO:teuthology.orchestra.run.smithi037.stdout: "req_lssnap_latency": { 2024-08-20T05:19:00.782 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.782 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.782 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.782 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.782 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mkdir_latency": { 2024-08-20T05:19:00.783 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.783 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.783 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.783 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.783 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mknod_latency": { 2024-08-20T05:19:00.784 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.784 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.784 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.784 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.784 INFO:teuthology.orchestra.run.smithi037.stdout: "req_mksnap_latency": { 2024-08-20T05:19:00.784 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.784 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.784 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.784 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.784 INFO:teuthology.orchestra.run.smithi037.stdout: "req_open_latency": { 2024-08-20T05:19:00.784 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.784 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.784 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.784 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.785 INFO:teuthology.orchestra.run.smithi037.stdout: "req_readdir_latency": { 2024-08-20T05:19:00.785 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.785 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.785 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.785 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.785 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rename_latency": { 2024-08-20T05:19:00.785 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.785 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.785 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.785 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.785 INFO:teuthology.orchestra.run.smithi037.stdout: "req_renamesnap_latency": { 2024-08-20T05:19:00.785 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.785 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.785 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.786 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.786 INFO:teuthology.orchestra.run.smithi037.stdout: "req_snapdiff_latency": { 2024-08-20T05:19:00.786 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.786 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.786 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.786 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.786 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmdir_latency": { 2024-08-20T05:19:00.786 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.786 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.786 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.786 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.786 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmsnap_latency": { 2024-08-20T05:19:00.786 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.786 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.787 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.787 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.787 INFO:teuthology.orchestra.run.smithi037.stdout: "req_rmxattr_latency": { 2024-08-20T05:19:00.787 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.787 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.787 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.787 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.787 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setattr_latency": { 2024-08-20T05:19:00.787 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.787 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.787 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.787 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.787 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setdirlayout_latency": { 2024-08-20T05:19:00.787 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.788 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.788 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.788 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.788 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setfilelock_latency": { 2024-08-20T05:19:00.788 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.788 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.788 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.788 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.788 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setlayout_latency": { 2024-08-20T05:19:00.788 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.788 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.788 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.788 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.788 INFO:teuthology.orchestra.run.smithi037.stdout: "req_setxattr_latency": { 2024-08-20T05:19:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "req_symlink_latency": { 2024-08-20T05:19:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "req_unlink_latency": { 2024-08-20T05:19:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.789 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_revoke_eviction": 0, 2024-08-20T05:19:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "cap_acquisition_throttle": 0, 2024-08-20T05:19:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "req_getvxattr_latency": { 2024-08-20T05:19:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:19:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_sessions": { 2024-08-20T05:19:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "session_count": 1, 2024-08-20T05:19:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "session_add": 1, 2024-08-20T05:19:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "session_remove": 0, 2024-08-20T05:19:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_open": 1, 2024-08-20T05:19:00.790 INFO:teuthology.orchestra.run.smithi037.stdout: "sessions_stale": 0, 2024-08-20T05:19:00.791 INFO:teuthology.orchestra.run.smithi037.stdout: "total_load": 0, 2024-08-20T05:19:00.791 INFO:teuthology.orchestra.run.smithi037.stdout: "average_load": 0, 2024-08-20T05:19:00.791 INFO:teuthology.orchestra.run.smithi037.stdout: "avg_session_uptime": 2069, 2024-08-20T05:19:00.791 INFO:teuthology.orchestra.run.smithi037.stdout: "mdthresh_evicted": 0 2024-08-20T05:19:00.791 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.791 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-08-20T05:19:00.791 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-08-20T05:19:00.791 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-08-20T05:19:00.791 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T05:19:00.791 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-08-20T05:19:00.791 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T05:19:00.791 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-08-20T05:19:00.791 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T05:19:00.791 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T05:19:00.792 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T05:19:00.792 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T05:19:00.792 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T05:19:00.792 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-08-20T05:19:00.792 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T05:19:00.792 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T05:19:00.792 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-08-20T05:19:00.792 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-08-20T05:19:00.792 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-08-20T05:19:00.792 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-08-20T05:19:00.792 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T05:19:00.792 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T05:19:00.792 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T05:19:00.793 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T05:19:00.793 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T05:19:00.793 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-08-20T05:19:00.793 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-08-20T05:19:00.793 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-08-20T05:19:00.793 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T05:19:00.793 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T05:19:00.793 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-08-20T05:19:00.793 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-08-20T05:19:00.793 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-08-20T05:19:00.793 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-08-20T05:19:00.793 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T05:19:00.793 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-08-20T05:19:00.794 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T05:19:00.794 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-08-20T05:19:00.794 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 207218, 2024-08-20T05:19:00.794 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 299, 2024-08-20T05:19:00.794 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-08-20T05:19:00.794 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-08-20T05:19:00.794 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-08-20T05:19:00.794 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-08-20T05:19:00.794 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-08-20T05:19:00.794 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-08-20T05:19:00.794 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-08-20T05:19:00.794 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-08-20T05:19:00.794 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 8864, 2024-08-20T05:19:00.795 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 167, 2024-08-20T05:19:00.795 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T05:19:00.795 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-08-20T05:19:00.795 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-08-20T05:19:00.795 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-08-20T05:19:00.795 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 898951, 2024-08-20T05:19:00.795 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 7451, 2024-08-20T05:19:00.795 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-08-20T05:19:00.795 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-08-20T05:19:00.795 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-08-20T05:19:00.795 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-08-20T05:19:00.795 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.795 INFO:teuthology.orchestra.run.smithi037.stdout: "objecter": { 2024-08-20T05:19:00.795 INFO:teuthology.orchestra.run.smithi037.stdout: "op_active": 0, 2024-08-20T05:19:00.796 INFO:teuthology.orchestra.run.smithi037.stdout: "op_laggy": 0, 2024-08-20T05:19:00.796 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send": 3243, 2024-08-20T05:19:00.796 INFO:teuthology.orchestra.run.smithi037.stdout: "op_send_bytes": 21, 2024-08-20T05:19:00.796 INFO:teuthology.orchestra.run.smithi037.stdout: "op_resend": 3, 2024-08-20T05:19:00.796 INFO:teuthology.orchestra.run.smithi037.stdout: "op_reply": 3243, 2024-08-20T05:19:00.796 INFO:teuthology.orchestra.run.smithi037.stdout: "op_latency": { 2024-08-20T05:19:00.796 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3243, 2024-08-20T05:19:00.796 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 60.230248220, 2024-08-20T05:19:00.796 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.018572386 2024-08-20T05:19:00.796 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.796 INFO:teuthology.orchestra.run.smithi037.stdout: "op_inflight": 0, 2024-08-20T05:19:00.796 INFO:teuthology.orchestra.run.smithi037.stdout: "oplen_avg": { 2024-08-20T05:19:00.796 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 3243, 2024-08-20T05:19:00.796 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 3244 2024-08-20T05:19:00.796 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.797 INFO:teuthology.orchestra.run.smithi037.stdout: "op": 3243, 2024-08-20T05:19:00.797 INFO:teuthology.orchestra.run.smithi037.stdout: "op_r": 3243, 2024-08-20T05:19:00.797 INFO:teuthology.orchestra.run.smithi037.stdout: "op_w": 0, 2024-08-20T05:19:00.797 INFO:teuthology.orchestra.run.smithi037.stdout: "op_rmw": 0, 2024-08-20T05:19:00.797 INFO:teuthology.orchestra.run.smithi037.stdout: "op_pg": 0, 2024-08-20T05:19:00.797 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_stat": 2000, 2024-08-20T05:19:00.797 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_create": 0, 2024-08-20T05:19:00.797 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_read": 1241, 2024-08-20T05:19:00.797 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_write": 0, 2024-08-20T05:19:00.797 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writefull": 0, 2024-08-20T05:19:00.797 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_writesame": 0, 2024-08-20T05:19:00.797 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_append": 0, 2024-08-20T05:19:00.797 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_zero": 0, 2024-08-20T05:19:00.797 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_truncate": 0, 2024-08-20T05:19:00.797 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_delete": 0, 2024-08-20T05:19:00.798 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_mapext": 0, 2024-08-20T05:19:00.798 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_sparse_read": 0, 2024-08-20T05:19:00.798 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_clonerange": 0, 2024-08-20T05:19:00.798 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_getxattr": 1, 2024-08-20T05:19:00.798 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_setxattr": 0, 2024-08-20T05:19:00.798 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_cmpxattr": 0, 2024-08-20T05:19:00.798 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_rmxattr": 0, 2024-08-20T05:19:00.798 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_resetxattrs": 0, 2024-08-20T05:19:00.798 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_call": 0, 2024-08-20T05:19:00.798 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_watch": 0, 2024-08-20T05:19:00.798 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_notify": 0, 2024-08-20T05:19:00.798 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T05:19:00.798 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls": 0, 2024-08-20T05:19:00.799 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_pgls_filter": 0, 2024-08-20T05:19:00.799 INFO:teuthology.orchestra.run.smithi037.stdout: "osdop_other": 0, 2024-08-20T05:19:00.799 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_active": 0, 2024-08-20T05:19:00.799 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_send": 0, 2024-08-20T05:19:00.799 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_resend": 0, 2024-08-20T05:19:00.799 INFO:teuthology.orchestra.run.smithi037.stdout: "linger_ping": 0, 2024-08-20T05:19:00.799 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_active": 0, 2024-08-20T05:19:00.799 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_send": 0, 2024-08-20T05:19:00.799 INFO:teuthology.orchestra.run.smithi037.stdout: "poolop_resend": 0, 2024-08-20T05:19:00.799 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_active": 0, 2024-08-20T05:19:00.799 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_send": 0, 2024-08-20T05:19:00.799 INFO:teuthology.orchestra.run.smithi037.stdout: "poolstat_resend": 0, 2024-08-20T05:19:00.799 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_active": 0, 2024-08-20T05:19:00.799 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_send": 0, 2024-08-20T05:19:00.799 INFO:teuthology.orchestra.run.smithi037.stdout: "statfs_resend": 0, 2024-08-20T05:19:00.800 INFO:teuthology.orchestra.run.smithi037.stdout: "command_active": 0, 2024-08-20T05:19:00.800 INFO:teuthology.orchestra.run.smithi037.stdout: "command_send": 0, 2024-08-20T05:19:00.800 INFO:teuthology.orchestra.run.smithi037.stdout: "command_resend": 0, 2024-08-20T05:19:00.800 INFO:teuthology.orchestra.run.smithi037.stdout: "map_epoch": 88, 2024-08-20T05:19:00.800 INFO:teuthology.orchestra.run.smithi037.stdout: "map_full": 0, 2024-08-20T05:19:00.800 INFO:teuthology.orchestra.run.smithi037.stdout: "map_inc": 4, 2024-08-20T05:19:00.800 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_sessions": 6, 2024-08-20T05:19:00.800 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_open": 8, 2024-08-20T05:19:00.800 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_session_close": 2, 2024-08-20T05:19:00.800 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_laggy": 0, 2024-08-20T05:19:00.800 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_wr": 0, 2024-08-20T05:19:00.800 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_rd": 2, 2024-08-20T05:19:00.800 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_del": 0 2024-08-20T05:19:00.801 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.801 INFO:teuthology.orchestra.run.smithi037.stdout: "oft": { 2024-08-20T05:19:00.801 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_objs": 0, 2024-08-20T05:19:00.801 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_kv_pairs": 0, 2024-08-20T05:19:00.801 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_updates": 0, 2024-08-20T05:19:00.801 INFO:teuthology.orchestra.run.smithi037.stdout: "omap_total_removes": 0 2024-08-20T05:19:00.801 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.801 INFO:teuthology.orchestra.run.smithi037.stdout: "purge_queue": { 2024-08-20T05:19:00.801 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops": 0, 2024-08-20T05:19:00.801 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_ops_high_water": 0, 2024-08-20T05:19:00.801 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing": 0, 2024-08-20T05:19:00.801 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executing_high_water": 0, 2024-08-20T05:19:00.801 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed_ops": 0, 2024-08-20T05:19:00.801 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_executed": 0, 2024-08-20T05:19:00.802 INFO:teuthology.orchestra.run.smithi037.stdout: "pq_item_in_journal": 0 2024-08-20T05:19:00.802 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.802 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T05:19:00.802 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-08-20T05:19:00.802 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-08-20T05:19:00.802 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-08-20T05:19:00.802 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 3606, 2024-08-20T05:19:00.802 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 3301176, 2024-08-20T05:19:00.802 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:00.802 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 3606, 2024-08-20T05:19:00.802 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-08-20T05:19:00.802 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-08-20T05:19:00.803 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3606, 2024-08-20T05:19:00.803 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 3301176, 2024-08-20T05:19:00.803 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-08-20T05:19:00.803 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.803 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.803 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.803 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:19:00.803 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.803 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_bytes": { 2024-08-20T05:19:00.803 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-08-20T05:19:00.803 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-08-20T05:19:00.803 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-08-20T05:19:00.803 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-08-20T05:19:00.803 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-08-20T05:19:00.804 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:00.804 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:00.804 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 3243, 2024-08-20T05:19:00.804 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 1976302, 2024-08-20T05:19:00.804 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3243, 2024-08-20T05:19:00.804 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 1976302, 2024-08-20T05:19:00.804 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-08-20T05:19:00.804 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.804 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.804 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.804 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:19:00.804 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.804 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-objecter_ops": { 2024-08-20T05:19:00.805 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-08-20T05:19:00.805 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 1024, 2024-08-20T05:19:00.805 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-08-20T05:19:00.805 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-08-20T05:19:00.805 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-08-20T05:19:00.805 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:00.805 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:00.805 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 3243, 2024-08-20T05:19:00.805 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 3243, 2024-08-20T05:19:00.805 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 3243, 2024-08-20T05:19:00.805 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 3243, 2024-08-20T05:19:00.805 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-08-20T05:19:00.805 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.805 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.806 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.806 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:19:00.806 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.806 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle": { 2024-08-20T05:19:00.806 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-08-20T05:19:00.806 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-08-20T05:19:00.806 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-08-20T05:19:00.806 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-08-20T05:19:00.806 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-08-20T05:19:00.806 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:00.806 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:00.806 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-08-20T05:19:00.807 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-08-20T05:19:00.807 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-08-20T05:19:00.807 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-08-20T05:19:00.807 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-08-20T05:19:00.807 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.807 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.807 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.807 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:19:00.807 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.807 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-write_buf_throttle-0x560026fbe6e0": { 2024-08-20T05:19:00.807 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-08-20T05:19:00.807 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 3758096384, 2024-08-20T05:19:00.807 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-08-20T05:19:00.807 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 0, 2024-08-20T05:19:00.808 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 0, 2024-08-20T05:19:00.808 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:00.808 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:00.808 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-08-20T05:19:00.808 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-08-20T05:19:00.808 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 0, 2024-08-20T05:19:00.808 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 0, 2024-08-20T05:19:00.808 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-08-20T05:19:00.808 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:00.808 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:00.808 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:00.808 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:19:00.808 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:00.808 INFO:teuthology.orchestra.run.smithi037.stdout: "trackedop": { 2024-08-20T05:19:00.809 INFO:teuthology.orchestra.run.smithi037.stdout: "slow_ops_count": 0 2024-08-20T05:19:00.809 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:19:00.809 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:19:01.654 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-08-20T05:19:01.654 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-08-20T05:19:01.654 DEBUG:tasks.check_counter:Getting stats from j 2024-08-20T05:19:01.655 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph daemon mds.j perf dump 2024-08-20T05:19:01.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:01 smithi130 ceph-mon[22007]: pgmap v904: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-20T05:19:02.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:01 smithi037 ceph-mon[17265]: pgmap v904: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-20T05:19:02.039 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:19:02.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:01 smithi135 ceph-mon[22342]: pgmap v904: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-20T05:19:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-08-20T05:19:02.728 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T05:19:02.729 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 330, 2024-08-20T05:19:02.729 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 327, 2024-08-20T05:19:02.729 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 549488, 2024-08-20T05:19:02.729 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 202160, 2024-08-20T05:19:02.729 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-08-20T05:19:02.729 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 0, 2024-08-20T05:19:02.729 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.096107294, 2024-08-20T05:19:02.729 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.060518042, 2024-08-20T05:19:02.729 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.038060266, 2024-08-20T05:19:02.729 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T05:19:02.729 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:02.729 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 326, 2024-08-20T05:19:02.729 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.067889052, 2024-08-20T05:19:02.730 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000208248 2024-08-20T05:19:02.730 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:02.730 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:02.730 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:02.730 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:02.730 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:02.730 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:02.730 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 549488, 2024-08-20T05:19:02.730 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 202160 2024-08-20T05:19:02.730 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:02.730 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T05:19:02.730 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 6, 2024-08-20T05:19:02.730 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 252, 2024-08-20T05:19:02.731 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 3264, 2024-08-20T05:19:02.731 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 204416, 2024-08-20T05:19:02.731 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 4, 2024-08-20T05:19:02.731 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 2, 2024-08-20T05:19:02.731 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.044722242, 2024-08-20T05:19:02.731 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.036022781, 2024-08-20T05:19:02.731 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.005501579, 2024-08-20T05:19:02.731 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T05:19:02.731 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:02.731 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 251, 2024-08-20T05:19:02.731 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.058661064, 2024-08-20T05:19:02.731 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000233709 2024-08-20T05:19:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-08-20T05:19:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 204416 2024-08-20T05:19:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T05:19:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_messages": 0, 2024-08-20T05:19:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages": 2, 2024-08-20T05:19:02.732 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_bytes": 0, 2024-08-20T05:19:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_bytes": 0, 2024-08-20T05:19:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_created_connections": 2, 2024-08-20T05:19:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_active_connections": 1, 2024-08-20T05:19:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_total_time": 0.000795191, 2024-08-20T05:19:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_send_time": 0.000000000, 2024-08-20T05:19:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_recv_time": 0.000613888, 2024-08-20T05:19:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-20T05:19:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:02.733 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:02.734 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:02.734 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:02.734 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:02.734 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:02.734 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T05:19:02.734 INFO:teuthology.orchestra.run.smithi037.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T05:19:02.734 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:02.734 INFO:teuthology.orchestra.run.smithi037.stdout: "cct": { 2024-08-20T05:19:02.734 INFO:teuthology.orchestra.run.smithi037.stdout: "total_workers": 0, 2024-08-20T05:19:02.734 INFO:teuthology.orchestra.run.smithi037.stdout: "unhealthy_workers": 0 2024-08-20T05:19:02.734 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:02.734 INFO:teuthology.orchestra.run.smithi037.stdout: "mempool": { 2024-08-20T05:19:02.734 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_bytes": 0, 2024-08-20T05:19:02.735 INFO:teuthology.orchestra.run.smithi037.stdout: "bloom_filter_items": 0, 2024-08-20T05:19:02.735 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T05:19:02.735 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_alloc_items": 0, 2024-08-20T05:19:02.735 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T05:19:02.735 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_data_items": 0, 2024-08-20T05:19:02.735 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T05:19:02.735 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T05:19:02.735 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T05:19:02.735 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T05:19:02.735 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T05:19:02.735 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_other_items": 0, 2024-08-20T05:19:02.735 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T05:19:02.735 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T05:19:02.735 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_bytes": 0, 2024-08-20T05:19:02.736 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_extent_items": 0, 2024-08-20T05:19:02.736 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_bytes": 0, 2024-08-20T05:19:02.736 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_blob_items": 0, 2024-08-20T05:19:02.736 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T05:19:02.736 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T05:19:02.736 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T05:19:02.736 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T05:19:02.736 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T05:19:02.736 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_fsck_items": 0, 2024-08-20T05:19:02.736 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_bytes": 0, 2024-08-20T05:19:02.736 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_txc_items": 0, 2024-08-20T05:19:02.736 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T05:19:02.736 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T05:19:02.736 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_bytes": 0, 2024-08-20T05:19:02.737 INFO:teuthology.orchestra.run.smithi037.stdout: "bluestore_writing_items": 0, 2024-08-20T05:19:02.737 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_bytes": 0, 2024-08-20T05:19:02.737 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_items": 0, 2024-08-20T05:19:02.737 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T05:19:02.737 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_reader_items": 0, 2024-08-20T05:19:02.737 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T05:19:02.737 INFO:teuthology.orchestra.run.smithi037.stdout: "bluefs_file_writer_items": 0, 2024-08-20T05:19:02.737 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_bytes": 149735, 2024-08-20T05:19:02.737 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_anon_items": 30, 2024-08-20T05:19:02.737 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_bytes": 0, 2024-08-20T05:19:02.737 INFO:teuthology.orchestra.run.smithi037.stdout: "buffer_meta_items": 0, 2024-08-20T05:19:02.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_bytes": 0, 2024-08-20T05:19:02.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_items": 0, 2024-08-20T05:19:02.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_bytes": 0, 2024-08-20T05:19:02.738 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_mapbl_items": 0, 2024-08-20T05:19:02.738 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_bytes": 0, 2024-08-20T05:19:02.738 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_pglog_items": 0, 2024-08-20T05:19:02.738 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_bytes": 0, 2024-08-20T05:19:02.738 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_items": 0, 2024-08-20T05:19:02.738 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T05:19:02.738 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_mapping_items": 0, 2024-08-20T05:19:02.738 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_bytes": 0, 2024-08-20T05:19:02.738 INFO:teuthology.orchestra.run.smithi037.stdout: "pgmap_items": 0, 2024-08-20T05:19:02.738 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_bytes": 928, 2024-08-20T05:19:02.738 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_co_items": 2, 2024-08-20T05:19:02.738 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_bytes": 0, 2024-08-20T05:19:02.738 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_1_items": 0, 2024-08-20T05:19:02.738 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_bytes": 0, 2024-08-20T05:19:02.738 INFO:teuthology.orchestra.run.smithi037.stdout: "unittest_2_items": 0 2024-08-20T05:19:02.739 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-08-20T05:19:02.739 INFO:teuthology.orchestra.run.smithi037.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T05:19:02.739 INFO:teuthology.orchestra.run.smithi037.stdout: "val": 0, 2024-08-20T05:19:02.739 INFO:teuthology.orchestra.run.smithi037.stdout: "max": 104857600, 2024-08-20T05:19:02.739 INFO:teuthology.orchestra.run.smithi037.stdout: "get_started": 0, 2024-08-20T05:19:02.739 INFO:teuthology.orchestra.run.smithi037.stdout: "get": 332, 2024-08-20T05:19:02.739 INFO:teuthology.orchestra.run.smithi037.stdout: "get_sum": 502825, 2024-08-20T05:19:02.739 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:02.739 INFO:teuthology.orchestra.run.smithi037.stdout: "get_or_fail_success": 332, 2024-08-20T05:19:02.739 INFO:teuthology.orchestra.run.smithi037.stdout: "take": 0, 2024-08-20T05:19:02.739 INFO:teuthology.orchestra.run.smithi037.stdout: "take_sum": 0, 2024-08-20T05:19:02.739 INFO:teuthology.orchestra.run.smithi037.stdout: "put": 332, 2024-08-20T05:19:02.739 INFO:teuthology.orchestra.run.smithi037.stdout: "put_sum": 502825, 2024-08-20T05:19:02.740 INFO:teuthology.orchestra.run.smithi037.stdout: "wait": { 2024-08-20T05:19:02.740 INFO:teuthology.orchestra.run.smithi037.stdout: "avgcount": 0, 2024-08-20T05:19:02.740 INFO:teuthology.orchestra.run.smithi037.stdout: "sum": 0.000000000, 2024-08-20T05:19:02.740 INFO:teuthology.orchestra.run.smithi037.stdout: "avgtime": 0.000000000 2024-08-20T05:19:02.740 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:19:02.740 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-08-20T05:19:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-08-20T05:19:03.623 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-08-20T05:19:03.623 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-08-20T05:19:03.623 DEBUG:tasks.check_counter:Getting stats from b 2024-08-20T05:19:03.624 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph daemon mds.b perf dump 2024-08-20T05:19:03.881 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T05:19:03.896 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:03 smithi037 ceph-mon[17265]: pgmap v905: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-20T05:19:03.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:03 smithi130 ceph-mon[22007]: pgmap v905: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-20T05:19:04.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:03 smithi135 ceph-mon[22342]: pgmap v905: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-08-20T05:19:04.460 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-08-20T05:19:04.460 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T05:19:04.460 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 11303, 2024-08-20T05:19:04.460 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 9482, 2024-08-20T05:19:04.460 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 4486293, 2024-08-20T05:19:04.460 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 8049639, 2024-08-20T05:19:04.461 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 11, 2024-08-20T05:19:04.461 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 3, 2024-08-20T05:19:04.461 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.722280940, 2024-08-20T05:19:04.461 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.322801538, 2024-08-20T05:19:04.461 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.409007078, 2024-08-20T05:19:04.461 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.062933114, 2024-08-20T05:19:04.461 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:04.461 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 9487, 2024-08-20T05:19:04.461 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 1.537132646, 2024-08-20T05:19:04.461 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000162025 2024-08-20T05:19:04.461 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.461 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:04.461 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 15001, 2024-08-20T05:19:04.461 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.002370428, 2024-08-20T05:19:04.462 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000158 2024-08-20T05:19:04.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.462 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 801616, 2024-08-20T05:19:04.462 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 229200 2024-08-20T05:19:04.462 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.462 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T05:19:04.462 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 4452, 2024-08-20T05:19:04.462 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 4415, 2024-08-20T05:19:04.462 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 1506862, 2024-08-20T05:19:04.462 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 3087866, 2024-08-20T05:19:04.462 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 9, 2024-08-20T05:19:04.462 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 6, 2024-08-20T05:19:04.463 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.362160507, 2024-08-20T05:19:04.463 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.193894428, 2024-08-20T05:19:04.463 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.152971276, 2024-08-20T05:19:04.463 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.035255913, 2024-08-20T05:19:04.463 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:04.463 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 4417, 2024-08-20T05:19:04.463 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 2.932492261, 2024-08-20T05:19:04.463 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000663910 2024-08-20T05:19:04.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.463 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:04.463 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 4975, 2024-08-20T05:19:04.463 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000868919, 2024-08-20T05:19:04.463 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000174 2024-08-20T05:19:04.463 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.464 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-08-20T05:19:04.464 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 526112 2024-08-20T05:19:04.464 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.464 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T05:19:04.464 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 12740, 2024-08-20T05:19:04.464 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 13923, 2024-08-20T05:19:04.464 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 4627035, 2024-08-20T05:19:04.464 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 15917409, 2024-08-20T05:19:04.464 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 356, 2024-08-20T05:19:04.464 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 11, 2024-08-20T05:19:04.464 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 1.131763602, 2024-08-20T05:19:04.464 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.495542997, 2024-08-20T05:19:04.464 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.603957318, 2024-08-20T05:19:04.464 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.128875096, 2024-08-20T05:19:04.465 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:04.465 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 13912, 2024-08-20T05:19:04.465 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 1.330463725, 2024-08-20T05:19:04.465 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000095634 2024-08-20T05:19:04.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.465 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:04.465 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 17926, 2024-08-20T05:19:04.465 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.002873089, 2024-08-20T05:19:04.465 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000160 2024-08-20T05:19:04.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.465 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 2092080, 2024-08-20T05:19:04.465 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 4094944 2024-08-20T05:19:04.465 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.466 INFO:teuthology.orchestra.run.smithi130.stdout: "cct": { 2024-08-20T05:19:04.466 INFO:teuthology.orchestra.run.smithi130.stdout: "total_workers": 1, 2024-08-20T05:19:04.466 INFO:teuthology.orchestra.run.smithi130.stdout: "unhealthy_workers": 0 2024-08-20T05:19:04.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.466 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-MDSRank": { 2024-08-20T05:19:04.466 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-20T05:19:04.466 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-20T05:19:04.466 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 4656, 2024-08-20T05:19:04.466 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 2.390851183, 2024-08-20T05:19:04.466 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000513498 2024-08-20T05:19:04.466 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:04.466 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.466 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-PurgeQueue": { 2024-08-20T05:19:04.467 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-20T05:19:04.467 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-20T05:19:04.467 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 120, 2024-08-20T05:19:04.467 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.008188494, 2024-08-20T05:19:04.467 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000068237 2024-08-20T05:19:04.467 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:04.467 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.467 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": { 2024-08-20T05:19:04.467 INFO:teuthology.orchestra.run.smithi130.stdout: "request": 2098, 2024-08-20T05:19:04.467 INFO:teuthology.orchestra.run.smithi130.stdout: "reply": 1993, 2024-08-20T05:19:04.467 INFO:teuthology.orchestra.run.smithi130.stdout: "reply_latency": { 2024-08-20T05:19:04.467 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 1993, 2024-08-20T05:19:04.467 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 35.345020371, 2024-08-20T05:19:04.467 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.017734581 2024-08-20T05:19:04.468 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.468 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_reply": 0, 2024-08-20T05:19:04.468 INFO:teuthology.orchestra.run.smithi130.stdout: "forward": 105, 2024-08-20T05:19:04.468 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_complete": 7, 2024-08-20T05:19:04.468 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_keys": 2, 2024-08-20T05:19:04.468 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_commit": 615, 2024-08-20T05:19:04.468 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_split": 3, 2024-08-20T05:19:04.468 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_merge": 0, 2024-08-20T05:19:04.468 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes": 201, 2024-08-20T05:19:04.468 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_top": 47, 2024-08-20T05:19:04.468 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_bottom": 144, 2024-08-20T05:19:04.468 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pin_tail": 10, 2024-08-20T05:19:04.468 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pinned": 132, 2024-08-20T05:19:04.468 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_expired": 1353, 2024-08-20T05:19:04.469 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_with_caps": 118, 2024-08-20T05:19:04.469 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": 118, 2024-08-20T05:19:04.469 INFO:teuthology.orchestra.run.smithi130.stdout: "subtrees": 12, 2024-08-20T05:19:04.469 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse": 3313, 2024-08-20T05:19:04.469 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_hit": 2536, 2024-08-20T05:19:04.469 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_forward": 105, 2024-08-20T05:19:04.469 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_discover": 137, 2024-08-20T05:19:04.469 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_dir_fetch": 2, 2024-08-20T05:19:04.469 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_remote_ino": 0, 2024-08-20T05:19:04.469 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_lock": 40, 2024-08-20T05:19:04.469 INFO:teuthology.orchestra.run.smithi130.stdout: "load_cent": 1079, 2024-08-20T05:19:04.469 INFO:teuthology.orchestra.run.smithi130.stdout: "q": 0, 2024-08-20T05:19:04.469 INFO:teuthology.orchestra.run.smithi130.stdout: "exported": 27, 2024-08-20T05:19:04.469 INFO:teuthology.orchestra.run.smithi130.stdout: "exported_inodes": 1031, 2024-08-20T05:19:04.470 INFO:teuthology.orchestra.run.smithi130.stdout: "imported": 4, 2024-08-20T05:19:04.470 INFO:teuthology.orchestra.run.smithi130.stdout: "imported_inodes": 117, 2024-08-20T05:19:04.470 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_dir_fetch": 0, 2024-08-20T05:19:04.470 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_backtrace_fetch": 1304, 2024-08-20T05:19:04.470 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_peer_discover": 0, 2024-08-20T05:19:04.470 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rfiles": 1016, 2024-08-20T05:19:04.470 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rbytes": 1494308803, 2024-08-20T05:19:04.470 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rsnaps": 0, 2024-08-20T05:19:04.470 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_fetch": 1304, 2024-08-20T05:19:04.470 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_set_tag": 0, 2024-08-20T05:19:04.470 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T05:19:04.470 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_inotable_repaired": 0, 2024-08-20T05:19:04.470 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_inodes": 273, 2024-08-20T05:19:04.470 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_base_inodes": 16, 2024-08-20T05:19:04.471 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dirfrag_rstats": 257, 2024-08-20T05:19:04.471 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_file_inodes": 1031, 2024-08-20T05:19:04.471 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_inode_file_caps": 10, 2024-08-20T05:19:04.471 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_revoke": 743, 2024-08-20T05:19:04.471 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_grant": 1685, 2024-08-20T05:19:04.471 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T05:19:04.471 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T05:19:04.471 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T05:19:04.471 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps": 1921, 2024-08-20T05:19:04.471 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps_dirty": 998, 2024-08-20T05:19:04.471 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_cap_release": 77, 2024-08-20T05:19:04.471 INFO:teuthology.orchestra.run.smithi130.stdout: "process_request_cap_release": 233 2024-08-20T05:19:04.471 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.471 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_cache": { 2024-08-20T05:19:04.471 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update": 0, 2024-08-20T05:19:04.472 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update_receipt": 0, 2024-08-20T05:19:04.472 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_try_discover": 0, 2024-08-20T05:19:04.472 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_send_discover": 137, 2024-08-20T05:19:04.472 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_handle_discover": 36, 2024-08-20T05:19:04.472 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays": 0, 2024-08-20T05:19:04.472 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_delayed": 0, 2024-08-20T05:19:04.472 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_enqueuing": 0, 2024-08-20T05:19:04.472 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_created": 57, 2024-08-20T05:19:04.472 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_enqueued": 35, 2024-08-20T05:19:04.472 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_reintegrated": 22, 2024-08-20T05:19:04.472 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_migrated": 0, 2024-08-20T05:19:04.472 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_processing": 0, 2024-08-20T05:19:04.472 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_enqueued": 0, 2024-08-20T05:19:04.472 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_prioritized": 0, 2024-08-20T05:19:04.473 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_started": 0, 2024-08-20T05:19:04.473 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_completed": 0, 2024-08-20T05:19:04.473 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_path": 15, 2024-08-20T05:19:04.473 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_inode": 2780, 2024-08-20T05:19:04.473 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_enqueue_scrub": 16, 2024-08-20T05:19:04.473 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_exportdir": 27, 2024-08-20T05:19:04.473 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_flush": 0, 2024-08-20T05:19:04.473 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragmentdir": 3, 2024-08-20T05:19:04.473 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragstats": 0, 2024-08-20T05:19:04.473 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_inodestats": 0 2024-08-20T05:19:04.473 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.473 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_log": { 2024-08-20T05:19:04.473 INFO:teuthology.orchestra.run.smithi130.stdout: "evlrg": 0, 2024-08-20T05:19:04.473 INFO:teuthology.orchestra.run.smithi130.stdout: "evadd": 3087, 2024-08-20T05:19:04.473 INFO:teuthology.orchestra.run.smithi130.stdout: "evex": 3083, 2024-08-20T05:19:04.474 INFO:teuthology.orchestra.run.smithi130.stdout: "evtrm": 3083, 2024-08-20T05:19:04.474 INFO:teuthology.orchestra.run.smithi130.stdout: "ev": 4, 2024-08-20T05:19:04.474 INFO:teuthology.orchestra.run.smithi130.stdout: "evexg": 0, 2024-08-20T05:19:04.474 INFO:teuthology.orchestra.run.smithi130.stdout: "evexd": 2, 2024-08-20T05:19:04.474 INFO:teuthology.orchestra.run.smithi130.stdout: "segadd": 78, 2024-08-20T05:19:04.474 INFO:teuthology.orchestra.run.smithi130.stdout: "segex": 77, 2024-08-20T05:19:04.474 INFO:teuthology.orchestra.run.smithi130.stdout: "segtrm": 77, 2024-08-20T05:19:04.474 INFO:teuthology.orchestra.run.smithi130.stdout: "seg": 1, 2024-08-20T05:19:04.474 INFO:teuthology.orchestra.run.smithi130.stdout: "segmjr": 1, 2024-08-20T05:19:04.474 INFO:teuthology.orchestra.run.smithi130.stdout: "segexg": 0, 2024-08-20T05:19:04.474 INFO:teuthology.orchestra.run.smithi130.stdout: "segexd": 1, 2024-08-20T05:19:04.474 INFO:teuthology.orchestra.run.smithi130.stdout: "expos": 12632205, 2024-08-20T05:19:04.474 INFO:teuthology.orchestra.run.smithi130.stdout: "wrpos": 12652195, 2024-08-20T05:19:04.474 INFO:teuthology.orchestra.run.smithi130.stdout: "rdpos": 0, 2024-08-20T05:19:04.475 INFO:teuthology.orchestra.run.smithi130.stdout: "jlat": { 2024-08-20T05:19:04.475 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 1580, 2024-08-20T05:19:04.475 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 7.809047834, 2024-08-20T05:19:04.475 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.004942435 2024-08-20T05:19:04.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.475 INFO:teuthology.orchestra.run.smithi130.stdout: "replayed": 0 2024-08-20T05:19:04.475 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.475 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_mem": { 2024-08-20T05:19:04.475 INFO:teuthology.orchestra.run.smithi130.stdout: "ino": 207, 2024-08-20T05:19:04.475 INFO:teuthology.orchestra.run.smithi130.stdout: "ino+": 1406, 2024-08-20T05:19:04.475 INFO:teuthology.orchestra.run.smithi130.stdout: "ino-": 1199, 2024-08-20T05:19:04.475 INFO:teuthology.orchestra.run.smithi130.stdout: "dir": 48, 2024-08-20T05:19:04.475 INFO:teuthology.orchestra.run.smithi130.stdout: "dir+": 88, 2024-08-20T05:19:04.475 INFO:teuthology.orchestra.run.smithi130.stdout: "dir-": 40, 2024-08-20T05:19:04.476 INFO:teuthology.orchestra.run.smithi130.stdout: "dn": 201, 2024-08-20T05:19:04.476 INFO:teuthology.orchestra.run.smithi130.stdout: "dn+": 1873, 2024-08-20T05:19:04.476 INFO:teuthology.orchestra.run.smithi130.stdout: "dn-": 1672, 2024-08-20T05:19:04.476 INFO:teuthology.orchestra.run.smithi130.stdout: "cap": 118, 2024-08-20T05:19:04.476 INFO:teuthology.orchestra.run.smithi130.stdout: "cap+": 1278, 2024-08-20T05:19:04.476 INFO:teuthology.orchestra.run.smithi130.stdout: "cap-": 1160, 2024-08-20T05:19:04.476 INFO:teuthology.orchestra.run.smithi130.stdout: "rss": 70052, 2024-08-20T05:19:04.476 INFO:teuthology.orchestra.run.smithi130.stdout: "heap": 297656320 2024-08-20T05:19:04.476 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.476 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_server": { 2024-08-20T05:19:04.476 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_client_request": 2486, 2024-08-20T05:19:04.476 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_server_request": 370, 2024-08-20T05:19:04.476 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_request": 2098, 2024-08-20T05:19:04.477 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_session": 114, 2024-08-20T05:19:04.477 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_peer_request": 554, 2024-08-20T05:19:04.477 INFO:teuthology.orchestra.run.smithi130.stdout: "req_create_latency": { 2024-08-20T05:19:04.477 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 1032, 2024-08-20T05:19:04.477 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 5.287076717, 2024-08-20T05:19:04.477 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.005123136 2024-08-20T05:19:04.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.477 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getattr_latency": { 2024-08-20T05:19:04.477 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 84, 2024-08-20T05:19:04.477 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 2.478973919, 2024-08-20T05:19:04.477 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.029511594 2024-08-20T05:19:04.477 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.477 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getfilelock_latency": { 2024-08-20T05:19:04.477 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.478 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.478 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.478 INFO:teuthology.orchestra.run.smithi130.stdout: "req_link_latency": { 2024-08-20T05:19:04.478 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 22, 2024-08-20T05:19:04.478 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.033696092, 2024-08-20T05:19:04.478 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.001531640 2024-08-20T05:19:04.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.478 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookup_latency": { 2024-08-20T05:19:04.478 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 209, 2024-08-20T05:19:04.478 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 26.532847269, 2024-08-20T05:19:04.478 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.126951422 2024-08-20T05:19:04.478 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.478 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookuphash_latency": { 2024-08-20T05:19:04.479 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.479 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.479 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.479 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupino_latency": { 2024-08-20T05:19:04.479 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 1, 2024-08-20T05:19:04.479 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000145307, 2024-08-20T05:19:04.479 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000145307 2024-08-20T05:19:04.479 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.479 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupname_latency": { 2024-08-20T05:19:04.479 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.479 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.479 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.480 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupparent_latency": { 2024-08-20T05:19:04.480 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.480 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.480 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.480 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupsnap_latency": { 2024-08-20T05:19:04.480 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.480 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.480 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.480 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.481 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lssnap_latency": { 2024-08-20T05:19:04.481 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.481 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.481 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.481 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mkdir_latency": { 2024-08-20T05:19:04.481 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 37, 2024-08-20T05:19:04.481 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.390886198, 2024-08-20T05:19:04.481 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.010564491 2024-08-20T05:19:04.481 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.481 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mknod_latency": { 2024-08-20T05:19:04.481 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.481 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.482 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.482 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mksnap_latency": { 2024-08-20T05:19:04.482 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.482 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.482 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.482 INFO:teuthology.orchestra.run.smithi130.stdout: "req_open_latency": { 2024-08-20T05:19:04.482 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 467, 2024-08-20T05:19:04.482 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.206704965, 2024-08-20T05:19:04.482 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000442623 2024-08-20T05:19:04.482 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.482 INFO:teuthology.orchestra.run.smithi130.stdout: "req_readdir_latency": { 2024-08-20T05:19:04.483 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 41, 2024-08-20T05:19:04.483 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.074654558, 2024-08-20T05:19:04.483 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.001820842 2024-08-20T05:19:04.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.483 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rename_latency": { 2024-08-20T05:19:04.483 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 56, 2024-08-20T05:19:04.483 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.229793268, 2024-08-20T05:19:04.483 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.004103451 2024-08-20T05:19:04.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.483 INFO:teuthology.orchestra.run.smithi130.stdout: "req_renamesnap_latency": { 2024-08-20T05:19:04.483 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.483 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.483 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.483 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.484 INFO:teuthology.orchestra.run.smithi130.stdout: "req_snapdiff_latency": { 2024-08-20T05:19:04.484 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.484 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.484 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.484 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmdir_latency": { 2024-08-20T05:19:04.484 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 2, 2024-08-20T05:19:04.484 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.014564946, 2024-08-20T05:19:04.484 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.007282473 2024-08-20T05:19:04.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.484 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmsnap_latency": { 2024-08-20T05:19:04.484 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.484 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.484 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.484 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.485 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmxattr_latency": { 2024-08-20T05:19:04.485 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.485 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.485 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.485 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setattr_latency": { 2024-08-20T05:19:04.485 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 2, 2024-08-20T05:19:04.485 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.001765611, 2024-08-20T05:19:04.485 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000882805 2024-08-20T05:19:04.485 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.485 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setdirlayout_latency": { 2024-08-20T05:19:04.485 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.485 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.485 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.486 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setfilelock_latency": { 2024-08-20T05:19:04.486 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.486 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.486 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.486 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setlayout_latency": { 2024-08-20T05:19:04.486 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.486 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.486 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.486 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.486 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setxattr_latency": { 2024-08-20T05:19:04.486 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 8, 2024-08-20T05:19:04.487 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.020344239, 2024-08-20T05:19:04.487 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.002543029 2024-08-20T05:19:04.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.487 INFO:teuthology.orchestra.run.smithi130.stdout: "req_symlink_latency": { 2024-08-20T05:19:04.487 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.487 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.487 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.487 INFO:teuthology.orchestra.run.smithi130.stdout: "req_unlink_latency": { 2024-08-20T05:19:04.487 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 32, 2024-08-20T05:19:04.487 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.073567282, 2024-08-20T05:19:04.487 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.002298977 2024-08-20T05:19:04.487 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.487 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_revoke_eviction": 0, 2024-08-20T05:19:04.488 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_acquisition_throttle": 0, 2024-08-20T05:19:04.488 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getvxattr_latency": { 2024-08-20T05:19:04.488 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.488 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.488 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.488 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:04.488 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.488 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_sessions": { 2024-08-20T05:19:04.488 INFO:teuthology.orchestra.run.smithi130.stdout: "session_count": 1, 2024-08-20T05:19:04.488 INFO:teuthology.orchestra.run.smithi130.stdout: "session_add": 3, 2024-08-20T05:19:04.488 INFO:teuthology.orchestra.run.smithi130.stdout: "session_remove": 2, 2024-08-20T05:19:04.488 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_open": 1, 2024-08-20T05:19:04.488 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_stale": 0, 2024-08-20T05:19:04.488 INFO:teuthology.orchestra.run.smithi130.stdout: "total_load": 25, 2024-08-20T05:19:04.489 INFO:teuthology.orchestra.run.smithi130.stdout: "average_load": 25, 2024-08-20T05:19:04.489 INFO:teuthology.orchestra.run.smithi130.stdout: "avg_session_uptime": 1013, 2024-08-20T05:19:04.489 INFO:teuthology.orchestra.run.smithi130.stdout: "mdthresh_evicted": 0 2024-08-20T05:19:04.489 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.489 INFO:teuthology.orchestra.run.smithi130.stdout: "mempool": { 2024-08-20T05:19:04.489 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_bytes": 0, 2024-08-20T05:19:04.489 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_items": 0, 2024-08-20T05:19:04.489 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T05:19:04.489 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_items": 0, 2024-08-20T05:19:04.489 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T05:19:04.489 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_items": 0, 2024-08-20T05:19:04.489 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T05:19:04.489 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T05:19:04.489 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T05:19:04.489 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T05:19:04.490 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T05:19:04.490 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_items": 0, 2024-08-20T05:19:04.490 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T05:19:04.490 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T05:19:04.490 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_bytes": 0, 2024-08-20T05:19:04.490 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_items": 0, 2024-08-20T05:19:04.490 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_bytes": 0, 2024-08-20T05:19:04.490 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_items": 0, 2024-08-20T05:19:04.490 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T05:19:04.490 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T05:19:04.490 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T05:19:04.490 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T05:19:04.490 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T05:19:04.490 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_items": 0, 2024-08-20T05:19:04.491 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_bytes": 0, 2024-08-20T05:19:04.491 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_items": 0, 2024-08-20T05:19:04.491 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T05:19:04.491 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T05:19:04.491 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_bytes": 0, 2024-08-20T05:19:04.491 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_items": 0, 2024-08-20T05:19:04.491 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_bytes": 0, 2024-08-20T05:19:04.491 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_items": 0, 2024-08-20T05:19:04.491 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T05:19:04.491 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_items": 0, 2024-08-20T05:19:04.491 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T05:19:04.491 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_items": 0, 2024-08-20T05:19:04.491 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_bytes": 301143, 2024-08-20T05:19:04.491 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_items": 276, 2024-08-20T05:19:04.491 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_bytes": 0, 2024-08-20T05:19:04.492 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_items": 0, 2024-08-20T05:19:04.492 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_bytes": 0, 2024-08-20T05:19:04.492 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_items": 0, 2024-08-20T05:19:04.492 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_bytes": 0, 2024-08-20T05:19:04.492 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_items": 0, 2024-08-20T05:19:04.492 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_bytes": 0, 2024-08-20T05:19:04.492 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_items": 0, 2024-08-20T05:19:04.492 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_bytes": 8864, 2024-08-20T05:19:04.492 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_items": 167, 2024-08-20T05:19:04.492 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T05:19:04.492 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_items": 0, 2024-08-20T05:19:04.492 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_bytes": 0, 2024-08-20T05:19:04.492 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_items": 0, 2024-08-20T05:19:04.492 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_bytes": 741942, 2024-08-20T05:19:04.492 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_items": 9280, 2024-08-20T05:19:04.493 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_bytes": 0, 2024-08-20T05:19:04.493 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_items": 0, 2024-08-20T05:19:04.493 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_bytes": 0, 2024-08-20T05:19:04.493 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_items": 0 2024-08-20T05:19:04.493 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.493 INFO:teuthology.orchestra.run.smithi130.stdout: "objecter": { 2024-08-20T05:19:04.493 INFO:teuthology.orchestra.run.smithi130.stdout: "op_active": 0, 2024-08-20T05:19:04.493 INFO:teuthology.orchestra.run.smithi130.stdout: "op_laggy": 0, 2024-08-20T05:19:04.493 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send": 6707, 2024-08-20T05:19:04.493 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send_bytes": 11082007, 2024-08-20T05:19:04.493 INFO:teuthology.orchestra.run.smithi130.stdout: "op_resend": 37, 2024-08-20T05:19:04.493 INFO:teuthology.orchestra.run.smithi130.stdout: "op_reply": 6707, 2024-08-20T05:19:04.493 INFO:teuthology.orchestra.run.smithi130.stdout: "op_latency": { 2024-08-20T05:19:04.493 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 6707, 2024-08-20T05:19:04.493 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 276.510909046, 2024-08-20T05:19:04.494 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.041227211 2024-08-20T05:19:04.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.494 INFO:teuthology.orchestra.run.smithi130.stdout: "op_inflight": 0, 2024-08-20T05:19:04.494 INFO:teuthology.orchestra.run.smithi130.stdout: "oplen_avg": { 2024-08-20T05:19:04.494 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 6707, 2024-08-20T05:19:04.494 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 11159 2024-08-20T05:19:04.494 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.494 INFO:teuthology.orchestra.run.smithi130.stdout: "op": 6707, 2024-08-20T05:19:04.494 INFO:teuthology.orchestra.run.smithi130.stdout: "op_r": 1354, 2024-08-20T05:19:04.494 INFO:teuthology.orchestra.run.smithi130.stdout: "op_w": 5353, 2024-08-20T05:19:04.494 INFO:teuthology.orchestra.run.smithi130.stdout: "op_rmw": 0, 2024-08-20T05:19:04.494 INFO:teuthology.orchestra.run.smithi130.stdout: "op_pg": 0, 2024-08-20T05:19:04.494 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_stat": 544, 2024-08-20T05:19:04.494 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_create": 2049, 2024-08-20T05:19:04.495 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_read": 25, 2024-08-20T05:19:04.495 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_write": 1589, 2024-08-20T05:19:04.495 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writefull": 250, 2024-08-20T05:19:04.495 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writesame": 0, 2024-08-20T05:19:04.495 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_append": 0, 2024-08-20T05:19:04.495 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_zero": 0, 2024-08-20T05:19:04.495 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_truncate": 3, 2024-08-20T05:19:04.495 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_delete": 598, 2024-08-20T05:19:04.495 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_mapext": 0, 2024-08-20T05:19:04.495 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_sparse_read": 0, 2024-08-20T05:19:04.495 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_clonerange": 0, 2024-08-20T05:19:04.495 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_getxattr": 1327, 2024-08-20T05:19:04.495 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_setxattr": 3101, 2024-08-20T05:19:04.495 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_cmpxattr": 0, 2024-08-20T05:19:04.495 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_rmxattr": 0, 2024-08-20T05:19:04.496 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_resetxattrs": 0, 2024-08-20T05:19:04.496 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_call": 0, 2024-08-20T05:19:04.496 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_watch": 0, 2024-08-20T05:19:04.496 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_notify": 0, 2024-08-20T05:19:04.496 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T05:19:04.496 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls": 0, 2024-08-20T05:19:04.496 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls_filter": 0, 2024-08-20T05:19:04.496 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_other": 0, 2024-08-20T05:19:04.496 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_active": 0, 2024-08-20T05:19:04.496 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_send": 0, 2024-08-20T05:19:04.496 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_resend": 0, 2024-08-20T05:19:04.496 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_ping": 0, 2024-08-20T05:19:04.496 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_active": 0, 2024-08-20T05:19:04.497 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_send": 0, 2024-08-20T05:19:04.497 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_resend": 0, 2024-08-20T05:19:04.497 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_active": 0, 2024-08-20T05:19:04.497 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_send": 0, 2024-08-20T05:19:04.497 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_resend": 0, 2024-08-20T05:19:04.497 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_active": 0, 2024-08-20T05:19:04.497 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_send": 0, 2024-08-20T05:19:04.497 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_resend": 0, 2024-08-20T05:19:04.497 INFO:teuthology.orchestra.run.smithi130.stdout: "command_active": 0, 2024-08-20T05:19:04.497 INFO:teuthology.orchestra.run.smithi130.stdout: "command_send": 0, 2024-08-20T05:19:04.497 INFO:teuthology.orchestra.run.smithi130.stdout: "command_resend": 0, 2024-08-20T05:19:04.497 INFO:teuthology.orchestra.run.smithi130.stdout: "map_epoch": 88, 2024-08-20T05:19:04.497 INFO:teuthology.orchestra.run.smithi130.stdout: "map_full": 0, 2024-08-20T05:19:04.497 INFO:teuthology.orchestra.run.smithi130.stdout: "map_inc": 11, 2024-08-20T05:19:04.498 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_sessions": 12, 2024-08-20T05:19:04.498 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_open": 12, 2024-08-20T05:19:04.498 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_close": 0, 2024-08-20T05:19:04.498 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_laggy": 0, 2024-08-20T05:19:04.498 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_wr": 1542, 2024-08-20T05:19:04.498 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_rd": 18, 2024-08-20T05:19:04.498 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_del": 113 2024-08-20T05:19:04.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.498 INFO:teuthology.orchestra.run.smithi130.stdout: "oft": { 2024-08-20T05:19:04.498 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_objs": 1, 2024-08-20T05:19:04.498 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_kv_pairs": 0, 2024-08-20T05:19:04.498 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_updates": 0, 2024-08-20T05:19:04.498 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_removes": 0 2024-08-20T05:19:04.498 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.499 INFO:teuthology.orchestra.run.smithi130.stdout: "purge_queue": { 2024-08-20T05:19:04.499 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops": 0, 2024-08-20T05:19:04.499 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops_high_water": 17, 2024-08-20T05:19:04.499 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing": 0, 2024-08-20T05:19:04.499 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_high_water": 5, 2024-08-20T05:19:04.499 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed_ops": 82, 2024-08-20T05:19:04.499 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed": 35, 2024-08-20T05:19:04.499 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_item_in_journal": 0 2024-08-20T05:19:04.499 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.499 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T05:19:04.499 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:04.499 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-20T05:19:04.499 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:04.499 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 28491, 2024-08-20T05:19:04.500 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 7775827, 2024-08-20T05:19:04.500 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:04.500 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 28491, 2024-08-20T05:19:04.500 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-20T05:19:04.500 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-20T05:19:04.500 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 28491, 2024-08-20T05:19:04.500 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 7775827, 2024-08-20T05:19:04.500 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:04.500 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.500 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.500 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.500 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:04.500 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.500 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_bytes": { 2024-08-20T05:19:04.500 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:04.501 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-20T05:19:04.501 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:04.501 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-20T05:19:04.501 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-20T05:19:04.501 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:04.501 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:04.501 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 6707, 2024-08-20T05:19:04.501 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 11085686, 2024-08-20T05:19:04.501 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 6707, 2024-08-20T05:19:04.501 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 11085686, 2024-08-20T05:19:04.501 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:04.501 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.501 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.501 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.501 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:04.502 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.502 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_ops": { 2024-08-20T05:19:04.502 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:04.502 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 1024, 2024-08-20T05:19:04.502 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:04.502 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-20T05:19:04.502 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-20T05:19:04.502 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:04.502 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:04.502 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 6707, 2024-08-20T05:19:04.502 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 6707, 2024-08-20T05:19:04.502 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 6707, 2024-08-20T05:19:04.502 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 6707, 2024-08-20T05:19:04.502 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:04.503 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.503 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.503 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.503 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:04.503 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.503 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle": { 2024-08-20T05:19:04.503 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:04.503 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-20T05:19:04.503 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:04.503 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 35, 2024-08-20T05:19:04.503 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 3799, 2024-08-20T05:19:04.503 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:04.503 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 35, 2024-08-20T05:19:04.503 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-20T05:19:04.503 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-20T05:19:04.504 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 9, 2024-08-20T05:19:04.504 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 3799, 2024-08-20T05:19:04.504 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:04.504 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.504 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.504 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.504 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:04.504 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.504 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle-0x55dc3d0666e0": { 2024-08-20T05:19:04.504 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:04.504 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-20T05:19:04.504 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:04.504 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 3087, 2024-08-20T05:19:04.504 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 8457891, 2024-08-20T05:19:04.504 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:04.505 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 3087, 2024-08-20T05:19:04.505 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-20T05:19:04.505 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-20T05:19:04.505 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 1580, 2024-08-20T05:19:04.505 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 8457891, 2024-08-20T05:19:04.505 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:04.505 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:04.505 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:04.505 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:04.505 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:04.505 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:04.505 INFO:teuthology.orchestra.run.smithi130.stdout: "trackedop": { 2024-08-20T05:19:04.505 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_ops_count": 1679 2024-08-20T05:19:04.505 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:04.506 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-08-20T05:19:05.337 INFO:tasks.check_counter:Daemon mds.b mds.exported=27 2024-08-20T05:19:05.337 INFO:tasks.check_counter:Daemon mds.b mds.imported=4 2024-08-20T05:19:05.337 DEBUG:tasks.check_counter:Getting stats from e 2024-08-20T05:19:05.337 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph daemon mds.e perf dump 2024-08-20T05:19:05.602 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T05:19:05.908 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:05 smithi130 ceph-mon[22007]: pgmap v906: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-20T05:19:06.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:05 smithi037 ceph-mon[17265]: pgmap v906: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-20T05:19:06.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:05 smithi135 ceph-mon[22342]: pgmap v906: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 597 B/s wr, 11 op/s 2024-08-20T05:19:06.124 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-08-20T05:19:06.124 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T05:19:06.124 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 1697, 2024-08-20T05:19:06.124 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 1664, 2024-08-20T05:19:06.125 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 5385128, 2024-08-20T05:19:06.125 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 625336, 2024-08-20T05:19:06.125 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 5, 2024-08-20T05:19:06.125 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 1, 2024-08-20T05:19:06.125 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.204226597, 2024-08-20T05:19:06.125 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.101797533, 2024-08-20T05:19:06.125 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.064629505, 2024-08-20T05:19:06.125 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.033497322, 2024-08-20T05:19:06.125 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:06.125 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 1664, 2024-08-20T05:19:06.125 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.104470460, 2024-08-20T05:19:06.125 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000062782 2024-08-20T05:19:06.125 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.125 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:06.126 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.126 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.126 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.126 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 759664, 2024-08-20T05:19:06.126 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 203664 2024-08-20T05:19:06.126 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.126 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T05:19:06.126 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 60, 2024-08-20T05:19:06.126 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 308, 2024-08-20T05:19:06.126 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 15260, 2024-08-20T05:19:06.126 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 609678, 2024-08-20T05:19:06.126 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 8, 2024-08-20T05:19:06.127 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 4, 2024-08-20T05:19:06.127 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.023310691, 2024-08-20T05:19:06.127 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.015317639, 2024-08-20T05:19:06.127 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.003511644, 2024-08-20T05:19:06.127 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.001976425, 2024-08-20T05:19:06.127 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:06.127 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 306, 2024-08-20T05:19:06.127 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.019642875, 2024-08-20T05:19:06.127 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000064192 2024-08-20T05:19:06.127 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.127 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:06.127 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.127 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.128 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.128 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-20T05:19:06.128 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 591168 2024-08-20T05:19:06.128 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.128 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T05:19:06.128 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 2283, 2024-08-20T05:19:06.128 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 2284, 2024-08-20T05:19:06.128 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 4841035, 2024-08-20T05:19:06.128 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 725683, 2024-08-20T05:19:06.128 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 5, 2024-08-20T05:19:06.128 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 4, 2024-08-20T05:19:06.128 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.177575484, 2024-08-20T05:19:06.129 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.063459135, 2024-08-20T05:19:06.129 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.044803684, 2024-08-20T05:19:06.129 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.057807127, 2024-08-20T05:19:06.129 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:06.129 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 2282, 2024-08-20T05:19:06.129 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.116917678, 2024-08-20T05:19:06.129 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000051234 2024-08-20T05:19:06.129 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.129 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:06.129 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.129 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.129 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.129 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.130 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T05:19:06.130 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T05:19:06.130 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.130 INFO:teuthology.orchestra.run.smithi130.stdout: "cct": { 2024-08-20T05:19:06.130 INFO:teuthology.orchestra.run.smithi130.stdout: "total_workers": 1, 2024-08-20T05:19:06.130 INFO:teuthology.orchestra.run.smithi130.stdout: "unhealthy_workers": 0 2024-08-20T05:19:06.130 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.130 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-MDSRank": { 2024-08-20T05:19:06.130 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-20T05:19:06.130 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-20T05:19:06.130 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 6136, 2024-08-20T05:19:06.130 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.159445677, 2024-08-20T05:19:06.130 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000025985 2024-08-20T05:19:06.130 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:06.131 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.131 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-PurgeQueue": { 2024-08-20T05:19:06.131 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-20T05:19:06.131 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-20T05:19:06.131 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.131 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.131 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.131 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:06.131 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.131 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": { 2024-08-20T05:19:06.131 INFO:teuthology.orchestra.run.smithi130.stdout: "request": 0, 2024-08-20T05:19:06.131 INFO:teuthology.orchestra.run.smithi130.stdout: "reply": 0, 2024-08-20T05:19:06.131 INFO:teuthology.orchestra.run.smithi130.stdout: "reply_latency": { 2024-08-20T05:19:06.131 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.132 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.132 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.132 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.132 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_reply": 0, 2024-08-20T05:19:06.132 INFO:teuthology.orchestra.run.smithi130.stdout: "forward": 0, 2024-08-20T05:19:06.132 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_complete": 0, 2024-08-20T05:19:06.132 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_keys": 0, 2024-08-20T05:19:06.132 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_commit": 0, 2024-08-20T05:19:06.132 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_split": 0, 2024-08-20T05:19:06.132 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_merge": 0, 2024-08-20T05:19:06.132 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes": 193, 2024-08-20T05:19:06.132 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_top": 47, 2024-08-20T05:19:06.132 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_bottom": 146, 2024-08-20T05:19:06.132 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pin_tail": 0, 2024-08-20T05:19:06.133 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pinned": 15, 2024-08-20T05:19:06.133 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_expired": 0, 2024-08-20T05:19:06.133 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_with_caps": 0, 2024-08-20T05:19:06.133 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": 0, 2024-08-20T05:19:06.133 INFO:teuthology.orchestra.run.smithi130.stdout: "subtrees": 5, 2024-08-20T05:19:06.133 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse": 0, 2024-08-20T05:19:06.133 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_hit": 0, 2024-08-20T05:19:06.133 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_forward": 0, 2024-08-20T05:19:06.133 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_discover": 0, 2024-08-20T05:19:06.133 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_dir_fetch": 0, 2024-08-20T05:19:06.133 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_remote_ino": 0, 2024-08-20T05:19:06.133 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_lock": 0, 2024-08-20T05:19:06.133 INFO:teuthology.orchestra.run.smithi130.stdout: "load_cent": 0, 2024-08-20T05:19:06.134 INFO:teuthology.orchestra.run.smithi130.stdout: "q": 0, 2024-08-20T05:19:06.134 INFO:teuthology.orchestra.run.smithi130.stdout: "exported": 0, 2024-08-20T05:19:06.134 INFO:teuthology.orchestra.run.smithi130.stdout: "exported_inodes": 0, 2024-08-20T05:19:06.134 INFO:teuthology.orchestra.run.smithi130.stdout: "imported": 0, 2024-08-20T05:19:06.134 INFO:teuthology.orchestra.run.smithi130.stdout: "imported_inodes": 0, 2024-08-20T05:19:06.134 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_dir_fetch": 0, 2024-08-20T05:19:06.135 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_backtrace_fetch": 0, 2024-08-20T05:19:06.135 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_peer_discover": 0, 2024-08-20T05:19:06.135 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rfiles": 1016, 2024-08-20T05:19:06.135 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rbytes": 1494308803, 2024-08-20T05:19:06.135 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rsnaps": 0, 2024-08-20T05:19:06.135 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_fetch": 0, 2024-08-20T05:19:06.135 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_set_tag": 0, 2024-08-20T05:19:06.135 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T05:19:06.135 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_inotable_repaired": 0, 2024-08-20T05:19:06.135 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_inodes": 0, 2024-08-20T05:19:06.135 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T05:19:06.135 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dirfrag_rstats": 0, 2024-08-20T05:19:06.136 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_file_inodes": 0, 2024-08-20T05:19:06.136 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_inode_file_caps": 0, 2024-08-20T05:19:06.136 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_revoke": 0, 2024-08-20T05:19:06.136 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_grant": 0, 2024-08-20T05:19:06.136 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T05:19:06.136 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T05:19:06.136 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T05:19:06.136 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps": 0, 2024-08-20T05:19:06.136 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps_dirty": 0, 2024-08-20T05:19:06.136 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_cap_release": 0, 2024-08-20T05:19:06.136 INFO:teuthology.orchestra.run.smithi130.stdout: "process_request_cap_release": 0 2024-08-20T05:19:06.136 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.136 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_cache": { 2024-08-20T05:19:06.137 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update": 0, 2024-08-20T05:19:06.137 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update_receipt": 0, 2024-08-20T05:19:06.137 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_try_discover": 0, 2024-08-20T05:19:06.137 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_send_discover": 0, 2024-08-20T05:19:06.137 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_handle_discover": 0, 2024-08-20T05:19:06.137 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays": 0, 2024-08-20T05:19:06.137 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_delayed": 0, 2024-08-20T05:19:06.137 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_enqueuing": 0, 2024-08-20T05:19:06.137 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_created": 0, 2024-08-20T05:19:06.137 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_enqueued": 0, 2024-08-20T05:19:06.137 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_reintegrated": 0, 2024-08-20T05:19:06.137 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_migrated": 0, 2024-08-20T05:19:06.137 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_processing": 0, 2024-08-20T05:19:06.137 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_enqueued": 0, 2024-08-20T05:19:06.137 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_prioritized": 0, 2024-08-20T05:19:06.138 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_started": 0, 2024-08-20T05:19:06.138 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_completed": 0, 2024-08-20T05:19:06.138 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_path": 0, 2024-08-20T05:19:06.138 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_inode": 0, 2024-08-20T05:19:06.138 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T05:19:06.138 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_exportdir": 0, 2024-08-20T05:19:06.138 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_flush": 0, 2024-08-20T05:19:06.138 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragmentdir": 0, 2024-08-20T05:19:06.138 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragstats": 0, 2024-08-20T05:19:06.138 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_inodestats": 0 2024-08-20T05:19:06.138 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.138 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_log": { 2024-08-20T05:19:06.139 INFO:teuthology.orchestra.run.smithi130.stdout: "evlrg": 0, 2024-08-20T05:19:06.139 INFO:teuthology.orchestra.run.smithi130.stdout: "evadd": 0, 2024-08-20T05:19:06.139 INFO:teuthology.orchestra.run.smithi130.stdout: "evex": 0, 2024-08-20T05:19:06.139 INFO:teuthology.orchestra.run.smithi130.stdout: "evtrm": 0, 2024-08-20T05:19:06.139 INFO:teuthology.orchestra.run.smithi130.stdout: "ev": 3087, 2024-08-20T05:19:06.139 INFO:teuthology.orchestra.run.smithi130.stdout: "evexg": 0, 2024-08-20T05:19:06.139 INFO:teuthology.orchestra.run.smithi130.stdout: "evexd": 0, 2024-08-20T05:19:06.139 INFO:teuthology.orchestra.run.smithi130.stdout: "segadd": 0, 2024-08-20T05:19:06.139 INFO:teuthology.orchestra.run.smithi130.stdout: "segex": 0, 2024-08-20T05:19:06.139 INFO:teuthology.orchestra.run.smithi130.stdout: "segtrm": 0, 2024-08-20T05:19:06.139 INFO:teuthology.orchestra.run.smithi130.stdout: "seg": 2, 2024-08-20T05:19:06.139 INFO:teuthology.orchestra.run.smithi130.stdout: "segmjr": 75, 2024-08-20T05:19:06.139 INFO:teuthology.orchestra.run.smithi130.stdout: "segexg": 0, 2024-08-20T05:19:06.139 INFO:teuthology.orchestra.run.smithi130.stdout: "segexd": 0, 2024-08-20T05:19:06.140 INFO:teuthology.orchestra.run.smithi130.stdout: "expos": 12632205, 2024-08-20T05:19:06.140 INFO:teuthology.orchestra.run.smithi130.stdout: "wrpos": 12652195, 2024-08-20T05:19:06.140 INFO:teuthology.orchestra.run.smithi130.stdout: "rdpos": 12646982, 2024-08-20T05:19:06.140 INFO:teuthology.orchestra.run.smithi130.stdout: "jlat": { 2024-08-20T05:19:06.140 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.140 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.140 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.140 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.140 INFO:teuthology.orchestra.run.smithi130.stdout: "replayed": 3087 2024-08-20T05:19:06.140 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.140 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_mem": { 2024-08-20T05:19:06.140 INFO:teuthology.orchestra.run.smithi130.stdout: "ino": 131, 2024-08-20T05:19:06.141 INFO:teuthology.orchestra.run.smithi130.stdout: "ino+": 1188, 2024-08-20T05:19:06.141 INFO:teuthology.orchestra.run.smithi130.stdout: "ino-": 1057, 2024-08-20T05:19:06.141 INFO:teuthology.orchestra.run.smithi130.stdout: "dir": 18, 2024-08-20T05:19:06.141 INFO:teuthology.orchestra.run.smithi130.stdout: "dir+": 76, 2024-08-20T05:19:06.141 INFO:teuthology.orchestra.run.smithi130.stdout: "dir-": 58, 2024-08-20T05:19:06.141 INFO:teuthology.orchestra.run.smithi130.stdout: "dn": 193, 2024-08-20T05:19:06.141 INFO:teuthology.orchestra.run.smithi130.stdout: "dn+": 1235, 2024-08-20T05:19:06.141 INFO:teuthology.orchestra.run.smithi130.stdout: "dn-": 1042, 2024-08-20T05:19:06.141 INFO:teuthology.orchestra.run.smithi130.stdout: "cap": 0, 2024-08-20T05:19:06.141 INFO:teuthology.orchestra.run.smithi130.stdout: "cap+": 0, 2024-08-20T05:19:06.141 INFO:teuthology.orchestra.run.smithi130.stdout: "cap-": 0, 2024-08-20T05:19:06.141 INFO:teuthology.orchestra.run.smithi130.stdout: "rss": 51596, 2024-08-20T05:19:06.141 INFO:teuthology.orchestra.run.smithi130.stdout: "heap": 254971904 2024-08-20T05:19:06.142 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.142 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_server": { 2024-08-20T05:19:06.142 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_client_request": 0, 2024-08-20T05:19:06.142 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_server_request": 0, 2024-08-20T05:19:06.142 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_request": 0, 2024-08-20T05:19:06.142 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_session": 0, 2024-08-20T05:19:06.142 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_peer_request": 0, 2024-08-20T05:19:06.142 INFO:teuthology.orchestra.run.smithi130.stdout: "req_create_latency": { 2024-08-20T05:19:06.142 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.142 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.142 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.142 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.142 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getattr_latency": { 2024-08-20T05:19:06.143 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.143 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.143 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.143 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.143 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getfilelock_latency": { 2024-08-20T05:19:06.143 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.144 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.144 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.144 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.144 INFO:teuthology.orchestra.run.smithi130.stdout: "req_link_latency": { 2024-08-20T05:19:06.144 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.144 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.144 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.144 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.144 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookup_latency": { 2024-08-20T05:19:06.144 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.144 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.144 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.145 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.145 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookuphash_latency": { 2024-08-20T05:19:06.145 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.145 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.145 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.145 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.145 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupino_latency": { 2024-08-20T05:19:06.145 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.145 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.145 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.145 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.145 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupname_latency": { 2024-08-20T05:19:06.145 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.145 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.146 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.146 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.146 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupparent_latency": { 2024-08-20T05:19:06.146 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.146 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.146 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.146 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.146 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupsnap_latency": { 2024-08-20T05:19:06.146 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.146 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.146 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.146 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.147 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lssnap_latency": { 2024-08-20T05:19:06.147 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.147 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.147 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.147 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.147 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mkdir_latency": { 2024-08-20T05:19:06.147 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.148 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.148 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.148 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.148 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mknod_latency": { 2024-08-20T05:19:06.148 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.148 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.148 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.148 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.148 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mksnap_latency": { 2024-08-20T05:19:06.148 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.148 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.148 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.148 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.148 INFO:teuthology.orchestra.run.smithi130.stdout: "req_open_latency": { 2024-08-20T05:19:06.149 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.149 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.149 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.149 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.149 INFO:teuthology.orchestra.run.smithi130.stdout: "req_readdir_latency": { 2024-08-20T05:19:06.149 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.149 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.149 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.149 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.149 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rename_latency": { 2024-08-20T05:19:06.149 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.149 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.149 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.149 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.150 INFO:teuthology.orchestra.run.smithi130.stdout: "req_renamesnap_latency": { 2024-08-20T05:19:06.150 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.150 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.150 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.150 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.150 INFO:teuthology.orchestra.run.smithi130.stdout: "req_snapdiff_latency": { 2024-08-20T05:19:06.150 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.150 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.150 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.150 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.150 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmdir_latency": { 2024-08-20T05:19:06.150 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.150 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.150 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.151 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.151 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmsnap_latency": { 2024-08-20T05:19:06.151 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.151 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.151 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.151 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.151 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmxattr_latency": { 2024-08-20T05:19:06.151 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.151 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.151 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.151 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.151 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setattr_latency": { 2024-08-20T05:19:06.151 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.151 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.152 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.152 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.152 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setdirlayout_latency": { 2024-08-20T05:19:06.152 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.152 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.152 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.152 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.152 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setfilelock_latency": { 2024-08-20T05:19:06.152 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.152 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.152 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.152 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.152 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setlayout_latency": { 2024-08-20T05:19:06.152 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.153 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.153 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.153 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.153 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setxattr_latency": { 2024-08-20T05:19:06.153 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.153 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.153 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.153 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.153 INFO:teuthology.orchestra.run.smithi130.stdout: "req_symlink_latency": { 2024-08-20T05:19:06.153 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.153 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.153 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.153 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.153 INFO:teuthology.orchestra.run.smithi130.stdout: "req_unlink_latency": { 2024-08-20T05:19:06.154 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.154 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.154 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.154 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.154 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_revoke_eviction": 0, 2024-08-20T05:19:06.154 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_acquisition_throttle": 0, 2024-08-20T05:19:06.154 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getvxattr_latency": { 2024-08-20T05:19:06.154 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.154 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.154 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.154 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:06.154 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.154 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_sessions": { 2024-08-20T05:19:06.155 INFO:teuthology.orchestra.run.smithi130.stdout: "session_count": 1, 2024-08-20T05:19:06.155 INFO:teuthology.orchestra.run.smithi130.stdout: "session_add": 3, 2024-08-20T05:19:06.155 INFO:teuthology.orchestra.run.smithi130.stdout: "session_remove": 2, 2024-08-20T05:19:06.155 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_open": 1, 2024-08-20T05:19:06.155 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_stale": 0, 2024-08-20T05:19:06.155 INFO:teuthology.orchestra.run.smithi130.stdout: "total_load": 0, 2024-08-20T05:19:06.155 INFO:teuthology.orchestra.run.smithi130.stdout: "average_load": 0, 2024-08-20T05:19:06.155 INFO:teuthology.orchestra.run.smithi130.stdout: "avg_session_uptime": 2288, 2024-08-20T05:19:06.155 INFO:teuthology.orchestra.run.smithi130.stdout: "mdthresh_evicted": 0 2024-08-20T05:19:06.155 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.155 INFO:teuthology.orchestra.run.smithi130.stdout: "mempool": { 2024-08-20T05:19:06.155 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_bytes": 0, 2024-08-20T05:19:06.155 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_items": 0, 2024-08-20T05:19:06.156 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T05:19:06.156 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_items": 0, 2024-08-20T05:19:06.156 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T05:19:06.156 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_items": 0, 2024-08-20T05:19:06.156 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T05:19:06.156 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T05:19:06.156 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T05:19:06.156 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T05:19:06.156 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T05:19:06.156 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_items": 0, 2024-08-20T05:19:06.156 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T05:19:06.156 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T05:19:06.156 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_bytes": 0, 2024-08-20T05:19:06.156 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_items": 0, 2024-08-20T05:19:06.157 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_bytes": 0, 2024-08-20T05:19:06.157 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_items": 0, 2024-08-20T05:19:06.157 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T05:19:06.157 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T05:19:06.157 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T05:19:06.157 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T05:19:06.157 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T05:19:06.157 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_items": 0, 2024-08-20T05:19:06.157 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_bytes": 0, 2024-08-20T05:19:06.157 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_items": 0, 2024-08-20T05:19:06.157 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T05:19:06.157 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T05:19:06.157 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_bytes": 0, 2024-08-20T05:19:06.158 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_items": 0, 2024-08-20T05:19:06.158 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_bytes": 0, 2024-08-20T05:19:06.158 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_items": 0, 2024-08-20T05:19:06.158 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T05:19:06.158 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_items": 0, 2024-08-20T05:19:06.158 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T05:19:06.158 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_items": 0, 2024-08-20T05:19:06.158 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_bytes": 203190, 2024-08-20T05:19:06.158 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_items": 171, 2024-08-20T05:19:06.158 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_bytes": 0, 2024-08-20T05:19:06.158 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_items": 0, 2024-08-20T05:19:06.158 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_bytes": 0, 2024-08-20T05:19:06.158 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_items": 0, 2024-08-20T05:19:06.159 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_bytes": 0, 2024-08-20T05:19:06.159 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_items": 0, 2024-08-20T05:19:06.159 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_bytes": 0, 2024-08-20T05:19:06.159 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_items": 0, 2024-08-20T05:19:06.159 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_bytes": 8864, 2024-08-20T05:19:06.159 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_items": 167, 2024-08-20T05:19:06.159 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T05:19:06.159 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_items": 0, 2024-08-20T05:19:06.159 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_bytes": 0, 2024-08-20T05:19:06.159 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_items": 0, 2024-08-20T05:19:06.159 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_bytes": 457028, 2024-08-20T05:19:06.159 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_items": 3721, 2024-08-20T05:19:06.159 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_bytes": 0, 2024-08-20T05:19:06.160 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_items": 0, 2024-08-20T05:19:06.160 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_bytes": 0, 2024-08-20T05:19:06.160 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_items": 0 2024-08-20T05:19:06.160 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.160 INFO:teuthology.orchestra.run.smithi130.stdout: "objecter": { 2024-08-20T05:19:06.160 INFO:teuthology.orchestra.run.smithi130.stdout: "op_active": 0, 2024-08-20T05:19:06.160 INFO:teuthology.orchestra.run.smithi130.stdout: "op_laggy": 0, 2024-08-20T05:19:06.160 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send": 3666, 2024-08-20T05:19:06.160 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send_bytes": 26, 2024-08-20T05:19:06.160 INFO:teuthology.orchestra.run.smithi130.stdout: "op_resend": 4, 2024-08-20T05:19:06.160 INFO:teuthology.orchestra.run.smithi130.stdout: "op_reply": 3666, 2024-08-20T05:19:06.160 INFO:teuthology.orchestra.run.smithi130.stdout: "op_latency": { 2024-08-20T05:19:06.160 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 3666, 2024-08-20T05:19:06.160 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 12.219784795, 2024-08-20T05:19:06.161 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.003333274 2024-08-20T05:19:06.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.161 INFO:teuthology.orchestra.run.smithi130.stdout: "op_inflight": 0, 2024-08-20T05:19:06.161 INFO:teuthology.orchestra.run.smithi130.stdout: "oplen_avg": { 2024-08-20T05:19:06.161 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 3666, 2024-08-20T05:19:06.161 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 3667 2024-08-20T05:19:06.161 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.161 INFO:teuthology.orchestra.run.smithi130.stdout: "op": 3666, 2024-08-20T05:19:06.161 INFO:teuthology.orchestra.run.smithi130.stdout: "op_r": 3666, 2024-08-20T05:19:06.161 INFO:teuthology.orchestra.run.smithi130.stdout: "op_w": 0, 2024-08-20T05:19:06.161 INFO:teuthology.orchestra.run.smithi130.stdout: "op_rmw": 0, 2024-08-20T05:19:06.161 INFO:teuthology.orchestra.run.smithi130.stdout: "op_pg": 0, 2024-08-20T05:19:06.161 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_stat": 2258, 2024-08-20T05:19:06.162 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_create": 0, 2024-08-20T05:19:06.162 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_read": 1405, 2024-08-20T05:19:06.162 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_write": 0, 2024-08-20T05:19:06.162 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writefull": 0, 2024-08-20T05:19:06.162 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writesame": 0, 2024-08-20T05:19:06.162 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_append": 0, 2024-08-20T05:19:06.162 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_zero": 0, 2024-08-20T05:19:06.162 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_truncate": 0, 2024-08-20T05:19:06.162 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_delete": 0, 2024-08-20T05:19:06.162 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_mapext": 0, 2024-08-20T05:19:06.162 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_sparse_read": 0, 2024-08-20T05:19:06.163 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_clonerange": 0, 2024-08-20T05:19:06.163 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_getxattr": 2, 2024-08-20T05:19:06.163 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_setxattr": 0, 2024-08-20T05:19:06.163 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_cmpxattr": 0, 2024-08-20T05:19:06.163 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_rmxattr": 0, 2024-08-20T05:19:06.163 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_resetxattrs": 0, 2024-08-20T05:19:06.163 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_call": 0, 2024-08-20T05:19:06.163 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_watch": 0, 2024-08-20T05:19:06.163 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_notify": 0, 2024-08-20T05:19:06.163 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T05:19:06.163 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls": 0, 2024-08-20T05:19:06.163 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls_filter": 0, 2024-08-20T05:19:06.163 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_other": 0, 2024-08-20T05:19:06.164 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_active": 0, 2024-08-20T05:19:06.164 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_send": 0, 2024-08-20T05:19:06.164 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_resend": 0, 2024-08-20T05:19:06.164 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_ping": 0, 2024-08-20T05:19:06.164 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_active": 0, 2024-08-20T05:19:06.164 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_send": 0, 2024-08-20T05:19:06.164 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_resend": 0, 2024-08-20T05:19:06.164 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_active": 0, 2024-08-20T05:19:06.164 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_send": 0, 2024-08-20T05:19:06.164 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_resend": 0, 2024-08-20T05:19:06.164 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_active": 0, 2024-08-20T05:19:06.164 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_send": 0, 2024-08-20T05:19:06.164 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_resend": 0, 2024-08-20T05:19:06.165 INFO:teuthology.orchestra.run.smithi130.stdout: "command_active": 0, 2024-08-20T05:19:06.165 INFO:teuthology.orchestra.run.smithi130.stdout: "command_send": 0, 2024-08-20T05:19:06.165 INFO:teuthology.orchestra.run.smithi130.stdout: "command_resend": 0, 2024-08-20T05:19:06.165 INFO:teuthology.orchestra.run.smithi130.stdout: "map_epoch": 88, 2024-08-20T05:19:06.165 INFO:teuthology.orchestra.run.smithi130.stdout: "map_full": 0, 2024-08-20T05:19:06.165 INFO:teuthology.orchestra.run.smithi130.stdout: "map_inc": 4, 2024-08-20T05:19:06.165 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_sessions": 6, 2024-08-20T05:19:06.165 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_open": 8, 2024-08-20T05:19:06.165 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_close": 2, 2024-08-20T05:19:06.165 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_laggy": 0, 2024-08-20T05:19:06.165 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_wr": 0, 2024-08-20T05:19:06.165 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_rd": 2, 2024-08-20T05:19:06.165 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_del": 0 2024-08-20T05:19:06.165 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.166 INFO:teuthology.orchestra.run.smithi130.stdout: "oft": { 2024-08-20T05:19:06.166 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_objs": 0, 2024-08-20T05:19:06.166 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_kv_pairs": 0, 2024-08-20T05:19:06.166 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_updates": 0, 2024-08-20T05:19:06.166 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_removes": 0 2024-08-20T05:19:06.166 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.166 INFO:teuthology.orchestra.run.smithi130.stdout: "purge_queue": { 2024-08-20T05:19:06.166 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops": 0, 2024-08-20T05:19:06.166 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops_high_water": 0, 2024-08-20T05:19:06.166 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing": 0, 2024-08-20T05:19:06.166 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_high_water": 0, 2024-08-20T05:19:06.166 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed_ops": 0, 2024-08-20T05:19:06.166 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed": 0, 2024-08-20T05:19:06.167 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_item_in_journal": 0 2024-08-20T05:19:06.167 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.167 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T05:19:06.167 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:06.167 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-20T05:19:06.167 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:06.167 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 4036, 2024-08-20T05:19:06.167 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 9856395, 2024-08-20T05:19:06.167 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:06.167 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 4036, 2024-08-20T05:19:06.167 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-20T05:19:06.167 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-20T05:19:06.167 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 4036, 2024-08-20T05:19:06.168 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 9856395, 2024-08-20T05:19:06.168 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:06.168 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.168 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.168 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.168 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:06.168 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.168 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_bytes": { 2024-08-20T05:19:06.168 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:06.168 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-20T05:19:06.168 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:06.168 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-20T05:19:06.169 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-20T05:19:06.169 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:06.169 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:06.169 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 3666, 2024-08-20T05:19:06.169 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 8457901, 2024-08-20T05:19:06.169 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 3666, 2024-08-20T05:19:06.169 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 8457901, 2024-08-20T05:19:06.169 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:06.169 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.169 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.170 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.170 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:06.170 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.170 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_ops": { 2024-08-20T05:19:06.170 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:06.170 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 1024, 2024-08-20T05:19:06.170 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:06.170 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-20T05:19:06.170 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-20T05:19:06.170 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:06.170 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:06.170 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 3666, 2024-08-20T05:19:06.170 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 3666, 2024-08-20T05:19:06.171 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 3666, 2024-08-20T05:19:06.171 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 3666, 2024-08-20T05:19:06.171 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:06.171 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.171 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.171 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.171 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:06.171 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.171 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle": { 2024-08-20T05:19:06.171 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:06.171 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-20T05:19:06.171 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:06.171 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-20T05:19:06.171 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-20T05:19:06.172 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:06.172 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:06.172 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-20T05:19:06.172 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-20T05:19:06.172 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 0, 2024-08-20T05:19:06.172 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 0, 2024-08-20T05:19:06.172 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:06.172 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.172 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.172 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.172 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:06.172 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.173 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle-0x5623dfce6960": { 2024-08-20T05:19:06.173 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:06.173 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-20T05:19:06.173 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:06.173 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-20T05:19:06.173 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-20T05:19:06.173 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:06.173 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:06.173 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-20T05:19:06.173 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-20T05:19:06.173 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 0, 2024-08-20T05:19:06.173 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 0, 2024-08-20T05:19:06.173 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:06.174 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:06.174 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:06.174 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:06.174 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:06.174 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:06.174 INFO:teuthology.orchestra.run.smithi130.stdout: "trackedop": { 2024-08-20T05:19:06.174 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_ops_count": 0 2024-08-20T05:19:06.174 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:06.174 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-08-20T05:19:06.932 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-08-20T05:19:06.932 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-08-20T05:19:06.932 DEBUG:tasks.check_counter:Getting stats from h 2024-08-20T05:19:06.932 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph daemon mds.h perf dump 2024-08-20T05:19:07.179 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T05:19:07.749 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-08-20T05:19:07.750 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T05:19:07.750 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 2998, 2024-08-20T05:19:07.750 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 2961, 2024-08-20T05:19:07.750 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 2215585, 2024-08-20T05:19:07.750 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 2548303, 2024-08-20T05:19:07.750 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 20, 2024-08-20T05:19:07.750 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 5, 2024-08-20T05:19:07.750 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.249013289, 2024-08-20T05:19:07.750 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.115045422, 2024-08-20T05:19:07.750 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.079022060, 2024-08-20T05:19:07.750 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.044747556, 2024-08-20T05:19:07.750 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:07.751 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 2960, 2024-08-20T05:19:07.751 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.130836757, 2024-08-20T05:19:07.751 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000044201 2024-08-20T05:19:07.751 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.751 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:07.751 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 176, 2024-08-20T05:19:07.751 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000029124, 2024-08-20T05:19:07.751 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000165 2024-08-20T05:19:07.751 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.751 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 786400, 2024-08-20T05:19:07.751 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 221072 2024-08-20T05:19:07.751 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.751 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T05:19:07.752 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 1689, 2024-08-20T05:19:07.752 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 1662, 2024-08-20T05:19:07.752 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 1115918, 2024-08-20T05:19:07.752 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 1340063, 2024-08-20T05:19:07.752 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 10, 2024-08-20T05:19:07.752 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 6, 2024-08-20T05:19:07.752 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.123813421, 2024-08-20T05:19:07.752 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.059771399, 2024-08-20T05:19:07.752 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.049095649, 2024-08-20T05:19:07.752 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.016124955, 2024-08-20T05:19:07.752 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:07.752 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 1663, 2024-08-20T05:19:07.752 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.081859824, 2024-08-20T05:19:07.753 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000049224 2024-08-20T05:19:07.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.753 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:07.753 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 1111, 2024-08-20T05:19:07.753 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000182471, 2024-08-20T05:19:07.753 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000164 2024-08-20T05:19:07.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.753 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-08-20T05:19:07.753 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 594880 2024-08-20T05:19:07.753 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.753 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T05:19:07.753 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 5088, 2024-08-20T05:19:07.753 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 6342, 2024-08-20T05:19:07.753 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 2164486, 2024-08-20T05:19:07.754 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 2993247, 2024-08-20T05:19:07.754 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 40, 2024-08-20T05:19:07.754 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 7, 2024-08-20T05:19:07.754 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.498700554, 2024-08-20T05:19:07.754 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.278534395, 2024-08-20T05:19:07.754 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.241432475, 2024-08-20T05:19:07.754 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.021187596, 2024-08-20T05:19:07.754 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:07.754 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 6338, 2024-08-20T05:19:07.754 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.457845968, 2024-08-20T05:19:07.754 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000072238 2024-08-20T05:19:07.754 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.755 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:07.755 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 7795, 2024-08-20T05:19:07.755 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.001498809, 2024-08-20T05:19:07.755 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000192 2024-08-20T05:19:07.755 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.755 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 608416, 2024-08-20T05:19:07.755 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 1425712 2024-08-20T05:19:07.755 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.755 INFO:teuthology.orchestra.run.smithi130.stdout: "cct": { 2024-08-20T05:19:07.755 INFO:teuthology.orchestra.run.smithi130.stdout: "total_workers": 1, 2024-08-20T05:19:07.755 INFO:teuthology.orchestra.run.smithi130.stdout: "unhealthy_workers": 0 2024-08-20T05:19:07.755 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.755 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-MDSRank": { 2024-08-20T05:19:07.755 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-20T05:19:07.756 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-20T05:19:07.756 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 4205, 2024-08-20T05:19:07.756 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.813881959, 2024-08-20T05:19:07.756 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000193551 2024-08-20T05:19:07.756 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:07.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.756 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-PurgeQueue": { 2024-08-20T05:19:07.756 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-20T05:19:07.756 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-20T05:19:07.756 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 17, 2024-08-20T05:19:07.756 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000468320, 2024-08-20T05:19:07.756 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000027548 2024-08-20T05:19:07.756 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:07.756 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.757 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": { 2024-08-20T05:19:07.757 INFO:teuthology.orchestra.run.smithi130.stdout: "request": 670, 2024-08-20T05:19:07.757 INFO:teuthology.orchestra.run.smithi130.stdout: "reply": 662, 2024-08-20T05:19:07.757 INFO:teuthology.orchestra.run.smithi130.stdout: "reply_latency": { 2024-08-20T05:19:07.757 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 662, 2024-08-20T05:19:07.757 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 11.593390376, 2024-08-20T05:19:07.757 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.017512674 2024-08-20T05:19:07.757 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.757 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_reply": 0, 2024-08-20T05:19:07.757 INFO:teuthology.orchestra.run.smithi130.stdout: "forward": 8, 2024-08-20T05:19:07.757 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_complete": 1, 2024-08-20T05:19:07.757 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_keys": 0, 2024-08-20T05:19:07.757 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_commit": 11, 2024-08-20T05:19:07.758 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_split": 0, 2024-08-20T05:19:07.758 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_merge": 0, 2024-08-20T05:19:07.758 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes": 266, 2024-08-20T05:19:07.758 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_top": 0, 2024-08-20T05:19:07.758 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_bottom": 266, 2024-08-20T05:19:07.758 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pin_tail": 0, 2024-08-20T05:19:07.758 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pinned": 266, 2024-08-20T05:19:07.758 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_expired": 0, 2024-08-20T05:19:07.758 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_with_caps": 247, 2024-08-20T05:19:07.758 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": 247, 2024-08-20T05:19:07.758 INFO:teuthology.orchestra.run.smithi130.stdout: "subtrees": 9, 2024-08-20T05:19:07.758 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse": 904, 2024-08-20T05:19:07.758 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_hit": 892, 2024-08-20T05:19:07.759 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_forward": 7, 2024-08-20T05:19:07.759 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_discover": 3, 2024-08-20T05:19:07.759 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_dir_fetch": 1, 2024-08-20T05:19:07.759 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_remote_ino": 0, 2024-08-20T05:19:07.759 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_lock": 0, 2024-08-20T05:19:07.759 INFO:teuthology.orchestra.run.smithi130.stdout: "load_cent": 248, 2024-08-20T05:19:07.759 INFO:teuthology.orchestra.run.smithi130.stdout: "q": 0, 2024-08-20T05:19:07.759 INFO:teuthology.orchestra.run.smithi130.stdout: "exported": 0, 2024-08-20T05:19:07.759 INFO:teuthology.orchestra.run.smithi130.stdout: "exported_inodes": 0, 2024-08-20T05:19:07.759 INFO:teuthology.orchestra.run.smithi130.stdout: "imported": 6, 2024-08-20T05:19:07.759 INFO:teuthology.orchestra.run.smithi130.stdout: "imported_inodes": 246, 2024-08-20T05:19:07.759 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_dir_fetch": 0, 2024-08-20T05:19:07.759 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_backtrace_fetch": 3598, 2024-08-20T05:19:07.759 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_peer_discover": 1, 2024-08-20T05:19:07.760 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rfiles": 1020, 2024-08-20T05:19:07.760 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rbytes": 1528108595, 2024-08-20T05:19:07.760 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rsnaps": 0, 2024-08-20T05:19:07.760 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_fetch": 3598, 2024-08-20T05:19:07.760 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_set_tag": 0, 2024-08-20T05:19:07.760 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T05:19:07.760 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_inotable_repaired": 0, 2024-08-20T05:19:07.760 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_inodes": 0, 2024-08-20T05:19:07.760 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T05:19:07.760 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dirfrag_rstats": 0, 2024-08-20T05:19:07.760 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_file_inodes": 3598, 2024-08-20T05:19:07.760 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_inode_file_caps": 12, 2024-08-20T05:19:07.760 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_revoke": 462, 2024-08-20T05:19:07.760 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_grant": 890, 2024-08-20T05:19:07.761 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T05:19:07.761 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T05:19:07.761 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T05:19:07.761 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps": 938, 2024-08-20T05:19:07.761 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps_dirty": 417, 2024-08-20T05:19:07.761 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_cap_release": 22, 2024-08-20T05:19:07.761 INFO:teuthology.orchestra.run.smithi130.stdout: "process_request_cap_release": 8 2024-08-20T05:19:07.761 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.761 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_cache": { 2024-08-20T05:19:07.761 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update": 0, 2024-08-20T05:19:07.761 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update_receipt": 0, 2024-08-20T05:19:07.761 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_try_discover": 0, 2024-08-20T05:19:07.761 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_send_discover": 4, 2024-08-20T05:19:07.761 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_handle_discover": 6, 2024-08-20T05:19:07.761 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays": 0, 2024-08-20T05:19:07.762 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_delayed": 0, 2024-08-20T05:19:07.762 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_enqueuing": 0, 2024-08-20T05:19:07.762 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_created": 2, 2024-08-20T05:19:07.762 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_enqueued": 2, 2024-08-20T05:19:07.762 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_reintegrated": 0, 2024-08-20T05:19:07.762 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_migrated": 0, 2024-08-20T05:19:07.762 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_processing": 0, 2024-08-20T05:19:07.762 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_enqueued": 0, 2024-08-20T05:19:07.762 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_prioritized": 0, 2024-08-20T05:19:07.762 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_started": 0, 2024-08-20T05:19:07.762 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_completed": 0, 2024-08-20T05:19:07.762 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_path": 15, 2024-08-20T05:19:07.762 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_inode": 3764, 2024-08-20T05:19:07.763 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T05:19:07.763 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_exportdir": 0, 2024-08-20T05:19:07.763 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_flush": 0, 2024-08-20T05:19:07.763 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragmentdir": 0, 2024-08-20T05:19:07.763 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragstats": 0, 2024-08-20T05:19:07.763 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_inodestats": 0 2024-08-20T05:19:07.763 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.763 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_log": { 2024-08-20T05:19:07.763 INFO:teuthology.orchestra.run.smithi130.stdout: "evlrg": 0, 2024-08-20T05:19:07.763 INFO:teuthology.orchestra.run.smithi130.stdout: "evadd": 998, 2024-08-20T05:19:07.763 INFO:teuthology.orchestra.run.smithi130.stdout: "evex": 0, 2024-08-20T05:19:07.763 INFO:teuthology.orchestra.run.smithi130.stdout: "evtrm": 0, 2024-08-20T05:19:07.763 INFO:teuthology.orchestra.run.smithi130.stdout: "ev": 998, 2024-08-20T05:19:07.763 INFO:teuthology.orchestra.run.smithi130.stdout: "evexg": 0, 2024-08-20T05:19:07.764 INFO:teuthology.orchestra.run.smithi130.stdout: "evexd": 0, 2024-08-20T05:19:07.764 INFO:teuthology.orchestra.run.smithi130.stdout: "segadd": 2, 2024-08-20T05:19:07.764 INFO:teuthology.orchestra.run.smithi130.stdout: "segex": 0, 2024-08-20T05:19:07.764 INFO:teuthology.orchestra.run.smithi130.stdout: "segtrm": 0, 2024-08-20T05:19:07.764 INFO:teuthology.orchestra.run.smithi130.stdout: "seg": 2, 2024-08-20T05:19:07.764 INFO:teuthology.orchestra.run.smithi130.stdout: "segmjr": 2, 2024-08-20T05:19:07.764 INFO:teuthology.orchestra.run.smithi130.stdout: "segexg": 0, 2024-08-20T05:19:07.764 INFO:teuthology.orchestra.run.smithi130.stdout: "segexd": 0, 2024-08-20T05:19:07.764 INFO:teuthology.orchestra.run.smithi130.stdout: "expos": 4194304, 2024-08-20T05:19:07.764 INFO:teuthology.orchestra.run.smithi130.stdout: "wrpos": 5463274, 2024-08-20T05:19:07.764 INFO:teuthology.orchestra.run.smithi130.stdout: "rdpos": 0, 2024-08-20T05:19:07.764 INFO:teuthology.orchestra.run.smithi130.stdout: "jlat": { 2024-08-20T05:19:07.764 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 542, 2024-08-20T05:19:07.764 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 3.932745252, 2024-08-20T05:19:07.765 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.007255987 2024-08-20T05:19:07.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.765 INFO:teuthology.orchestra.run.smithi130.stdout: "replayed": 0 2024-08-20T05:19:07.765 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.765 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_mem": { 2024-08-20T05:19:07.765 INFO:teuthology.orchestra.run.smithi130.stdout: "ino": 267, 2024-08-20T05:19:07.765 INFO:teuthology.orchestra.run.smithi130.stdout: "ino+": 269, 2024-08-20T05:19:07.765 INFO:teuthology.orchestra.run.smithi130.stdout: "ino-": 2, 2024-08-20T05:19:07.765 INFO:teuthology.orchestra.run.smithi130.stdout: "dir": 25, 2024-08-20T05:19:07.765 INFO:teuthology.orchestra.run.smithi130.stdout: "dir+": 26, 2024-08-20T05:19:07.765 INFO:teuthology.orchestra.run.smithi130.stdout: "dir-": 1, 2024-08-20T05:19:07.765 INFO:teuthology.orchestra.run.smithi130.stdout: "dn": 266, 2024-08-20T05:19:07.765 INFO:teuthology.orchestra.run.smithi130.stdout: "dn+": 270, 2024-08-20T05:19:07.766 INFO:teuthology.orchestra.run.smithi130.stdout: "dn-": 4, 2024-08-20T05:19:07.766 INFO:teuthology.orchestra.run.smithi130.stdout: "cap": 247, 2024-08-20T05:19:07.766 INFO:teuthology.orchestra.run.smithi130.stdout: "cap+": 478, 2024-08-20T05:19:07.766 INFO:teuthology.orchestra.run.smithi130.stdout: "cap-": 231, 2024-08-20T05:19:07.766 INFO:teuthology.orchestra.run.smithi130.stdout: "rss": 62124, 2024-08-20T05:19:07.766 INFO:teuthology.orchestra.run.smithi130.stdout: "heap": 266199040 2024-08-20T05:19:07.766 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.766 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_server": { 2024-08-20T05:19:07.766 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_client_request": 718, 2024-08-20T05:19:07.766 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_server_request": 0, 2024-08-20T05:19:07.766 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_request": 670, 2024-08-20T05:19:07.766 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_session": 18, 2024-08-20T05:19:07.766 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_peer_request": 0, 2024-08-20T05:19:07.767 INFO:teuthology.orchestra.run.smithi130.stdout: "req_create_latency": { 2024-08-20T05:19:07.767 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.767 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.767 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.767 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.767 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getattr_latency": { 2024-08-20T05:19:07.767 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 409, 2024-08-20T05:19:07.767 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 11.456910399, 2024-08-20T05:19:07.767 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.028012005 2024-08-20T05:19:07.767 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.767 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getfilelock_latency": { 2024-08-20T05:19:07.767 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.767 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.767 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.768 INFO:teuthology.orchestra.run.smithi130.stdout: "req_link_latency": { 2024-08-20T05:19:07.768 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.768 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.768 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.768 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookup_latency": { 2024-08-20T05:19:07.768 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 161, 2024-08-20T05:19:07.768 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.071076766, 2024-08-20T05:19:07.768 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000441470 2024-08-20T05:19:07.768 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.768 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookuphash_latency": { 2024-08-20T05:19:07.768 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.769 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.769 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.769 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupino_latency": { 2024-08-20T05:19:07.769 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.769 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.769 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.769 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupname_latency": { 2024-08-20T05:19:07.769 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.769 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.769 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.769 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.770 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupparent_latency": { 2024-08-20T05:19:07.770 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.770 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.770 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.770 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupsnap_latency": { 2024-08-20T05:19:07.770 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.770 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.770 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.770 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.770 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lssnap_latency": { 2024-08-20T05:19:07.770 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.771 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.771 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.771 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mkdir_latency": { 2024-08-20T05:19:07.771 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.771 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.771 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.771 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mknod_latency": { 2024-08-20T05:19:07.771 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.771 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.771 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.771 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.772 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mksnap_latency": { 2024-08-20T05:19:07.772 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.772 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.772 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.772 INFO:teuthology.orchestra.run.smithi130.stdout: "req_open_latency": { 2024-08-20T05:19:07.772 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 84, 2024-08-20T05:19:07.772 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.053741569, 2024-08-20T05:19:07.772 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000639780 2024-08-20T05:19:07.772 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.772 INFO:teuthology.orchestra.run.smithi130.stdout: "req_readdir_latency": { 2024-08-20T05:19:07.772 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 6, 2024-08-20T05:19:07.772 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.008529353, 2024-08-20T05:19:07.772 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.001421558 2024-08-20T05:19:07.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.773 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rename_latency": { 2024-08-20T05:19:07.773 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.773 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.773 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.773 INFO:teuthology.orchestra.run.smithi130.stdout: "req_renamesnap_latency": { 2024-08-20T05:19:07.773 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.773 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.773 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.773 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.773 INFO:teuthology.orchestra.run.smithi130.stdout: "req_snapdiff_latency": { 2024-08-20T05:19:07.773 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.773 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.774 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.774 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmdir_latency": { 2024-08-20T05:19:07.774 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.774 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.774 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.774 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmsnap_latency": { 2024-08-20T05:19:07.774 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.774 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.774 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.774 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.774 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmxattr_latency": { 2024-08-20T05:19:07.775 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.775 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.775 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.775 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setattr_latency": { 2024-08-20T05:19:07.775 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.775 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.775 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.775 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.775 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setdirlayout_latency": { 2024-08-20T05:19:07.775 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.775 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.776 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.776 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setfilelock_latency": { 2024-08-20T05:19:07.776 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.776 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.776 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.776 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setlayout_latency": { 2024-08-20T05:19:07.776 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.776 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.776 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.776 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.776 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setxattr_latency": { 2024-08-20T05:19:07.776 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.777 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.777 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.777 INFO:teuthology.orchestra.run.smithi130.stdout: "req_symlink_latency": { 2024-08-20T05:19:07.777 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.777 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.777 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.777 INFO:teuthology.orchestra.run.smithi130.stdout: "req_unlink_latency": { 2024-08-20T05:19:07.777 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 2, 2024-08-20T05:19:07.777 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.003132289, 2024-08-20T05:19:07.777 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.001566144 2024-08-20T05:19:07.777 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.778 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_revoke_eviction": 0, 2024-08-20T05:19:07.778 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_acquisition_throttle": 0, 2024-08-20T05:19:07.778 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getvxattr_latency": { 2024-08-20T05:19:07.778 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.778 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.778 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.778 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:07.778 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.778 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_sessions": { 2024-08-20T05:19:07.778 INFO:teuthology.orchestra.run.smithi130.stdout: "session_count": 1, 2024-08-20T05:19:07.778 INFO:teuthology.orchestra.run.smithi130.stdout: "session_add": 2, 2024-08-20T05:19:07.778 INFO:teuthology.orchestra.run.smithi130.stdout: "session_remove": 1, 2024-08-20T05:19:07.779 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_open": 1, 2024-08-20T05:19:07.779 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_stale": 0, 2024-08-20T05:19:07.779 INFO:teuthology.orchestra.run.smithi130.stdout: "total_load": 35, 2024-08-20T05:19:07.779 INFO:teuthology.orchestra.run.smithi130.stdout: "average_load": 35, 2024-08-20T05:19:07.779 INFO:teuthology.orchestra.run.smithi130.stdout: "avg_session_uptime": 990, 2024-08-20T05:19:07.779 INFO:teuthology.orchestra.run.smithi130.stdout: "mdthresh_evicted": 0 2024-08-20T05:19:07.779 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.779 INFO:teuthology.orchestra.run.smithi130.stdout: "mempool": { 2024-08-20T05:19:07.779 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_bytes": 0, 2024-08-20T05:19:07.779 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_items": 0, 2024-08-20T05:19:07.779 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T05:19:07.779 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_items": 0, 2024-08-20T05:19:07.779 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T05:19:07.779 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_items": 0, 2024-08-20T05:19:07.779 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T05:19:07.780 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T05:19:07.780 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T05:19:07.780 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T05:19:07.780 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T05:19:07.780 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_items": 0, 2024-08-20T05:19:07.780 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T05:19:07.780 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T05:19:07.780 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_bytes": 0, 2024-08-20T05:19:07.780 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_items": 0, 2024-08-20T05:19:07.780 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_bytes": 0, 2024-08-20T05:19:07.780 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_items": 0, 2024-08-20T05:19:07.780 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T05:19:07.781 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T05:19:07.781 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T05:19:07.781 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T05:19:07.781 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T05:19:07.781 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_items": 0, 2024-08-20T05:19:07.781 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_bytes": 0, 2024-08-20T05:19:07.781 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_items": 0, 2024-08-20T05:19:07.781 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T05:19:07.781 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T05:19:07.781 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_bytes": 0, 2024-08-20T05:19:07.781 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_items": 0, 2024-08-20T05:19:07.781 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_bytes": 0, 2024-08-20T05:19:07.781 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_items": 0, 2024-08-20T05:19:07.781 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T05:19:07.782 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_items": 0, 2024-08-20T05:19:07.782 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T05:19:07.782 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_items": 0, 2024-08-20T05:19:07.782 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_bytes": 305241, 2024-08-20T05:19:07.782 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_items": 353, 2024-08-20T05:19:07.782 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_bytes": 0, 2024-08-20T05:19:07.782 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_items": 0, 2024-08-20T05:19:07.782 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_bytes": 0, 2024-08-20T05:19:07.782 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_items": 0, 2024-08-20T05:19:07.782 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_bytes": 0, 2024-08-20T05:19:07.782 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_items": 0, 2024-08-20T05:19:07.782 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_bytes": 0, 2024-08-20T05:19:07.783 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_items": 0, 2024-08-20T05:19:07.783 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_bytes": 8864, 2024-08-20T05:19:07.783 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_items": 167, 2024-08-20T05:19:07.783 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T05:19:07.783 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_items": 0, 2024-08-20T05:19:07.783 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_bytes": 0, 2024-08-20T05:19:07.783 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_items": 0, 2024-08-20T05:19:07.783 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_bytes": 933951, 2024-08-20T05:19:07.783 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_items": 10311, 2024-08-20T05:19:07.783 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_bytes": 0, 2024-08-20T05:19:07.783 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_items": 0, 2024-08-20T05:19:07.783 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_bytes": 0, 2024-08-20T05:19:07.783 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_items": 0 2024-08-20T05:19:07.783 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.784 INFO:teuthology.orchestra.run.smithi130.stdout: "objecter": { 2024-08-20T05:19:07.784 INFO:teuthology.orchestra.run.smithi130.stdout: "op_active": 0, 2024-08-20T05:19:07.784 INFO:teuthology.orchestra.run.smithi130.stdout: "op_laggy": 0, 2024-08-20T05:19:07.784 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send": 4305, 2024-08-20T05:19:07.784 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send_bytes": 1329856, 2024-08-20T05:19:07.784 INFO:teuthology.orchestra.run.smithi130.stdout: "op_resend": 33, 2024-08-20T05:19:07.784 INFO:teuthology.orchestra.run.smithi130.stdout: "op_reply": 4305, 2024-08-20T05:19:07.784 INFO:teuthology.orchestra.run.smithi130.stdout: "op_latency": { 2024-08-20T05:19:07.784 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 4305, 2024-08-20T05:19:07.784 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 13.536759881, 2024-08-20T05:19:07.784 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.003144427 2024-08-20T05:19:07.784 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.784 INFO:teuthology.orchestra.run.smithi130.stdout: "op_inflight": 0, 2024-08-20T05:19:07.784 INFO:teuthology.orchestra.run.smithi130.stdout: "oplen_avg": { 2024-08-20T05:19:07.785 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 4305, 2024-08-20T05:19:07.785 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 4392 2024-08-20T05:19:07.785 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.785 INFO:teuthology.orchestra.run.smithi130.stdout: "op": 4305, 2024-08-20T05:19:07.785 INFO:teuthology.orchestra.run.smithi130.stdout: "op_r": 3600, 2024-08-20T05:19:07.785 INFO:teuthology.orchestra.run.smithi130.stdout: "op_w": 705, 2024-08-20T05:19:07.785 INFO:teuthology.orchestra.run.smithi130.stdout: "op_rmw": 0, 2024-08-20T05:19:07.785 INFO:teuthology.orchestra.run.smithi130.stdout: "op_pg": 0, 2024-08-20T05:19:07.785 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_stat": 0, 2024-08-20T05:19:07.785 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_create": 10, 2024-08-20T05:19:07.785 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_read": 1, 2024-08-20T05:19:07.785 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_write": 543, 2024-08-20T05:19:07.785 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writefull": 60, 2024-08-20T05:19:07.785 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writesame": 0, 2024-08-20T05:19:07.785 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_append": 0, 2024-08-20T05:19:07.786 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_zero": 0, 2024-08-20T05:19:07.786 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_truncate": 0, 2024-08-20T05:19:07.786 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_delete": 16, 2024-08-20T05:19:07.786 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_mapext": 0, 2024-08-20T05:19:07.786 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_sparse_read": 0, 2024-08-20T05:19:07.786 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_clonerange": 0, 2024-08-20T05:19:07.786 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_getxattr": 3598, 2024-08-20T05:19:07.786 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_setxattr": 20, 2024-08-20T05:19:07.786 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_cmpxattr": 0, 2024-08-20T05:19:07.786 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_rmxattr": 0, 2024-08-20T05:19:07.786 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_resetxattrs": 0, 2024-08-20T05:19:07.786 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_call": 0, 2024-08-20T05:19:07.786 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_watch": 0, 2024-08-20T05:19:07.787 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_notify": 0, 2024-08-20T05:19:07.787 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T05:19:07.787 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls": 0, 2024-08-20T05:19:07.787 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls_filter": 0, 2024-08-20T05:19:07.787 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_other": 0, 2024-08-20T05:19:07.787 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_active": 0, 2024-08-20T05:19:07.787 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_send": 0, 2024-08-20T05:19:07.787 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_resend": 0, 2024-08-20T05:19:07.787 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_ping": 0, 2024-08-20T05:19:07.787 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_active": 0, 2024-08-20T05:19:07.787 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_send": 0, 2024-08-20T05:19:07.787 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_resend": 0, 2024-08-20T05:19:07.787 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_active": 0, 2024-08-20T05:19:07.787 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_send": 0, 2024-08-20T05:19:07.788 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_resend": 0, 2024-08-20T05:19:07.788 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_active": 0, 2024-08-20T05:19:07.788 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_send": 0, 2024-08-20T05:19:07.788 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_resend": 0, 2024-08-20T05:19:07.788 INFO:teuthology.orchestra.run.smithi130.stdout: "command_active": 0, 2024-08-20T05:19:07.788 INFO:teuthology.orchestra.run.smithi130.stdout: "command_send": 0, 2024-08-20T05:19:07.788 INFO:teuthology.orchestra.run.smithi130.stdout: "command_resend": 0, 2024-08-20T05:19:07.788 INFO:teuthology.orchestra.run.smithi130.stdout: "map_epoch": 88, 2024-08-20T05:19:07.788 INFO:teuthology.orchestra.run.smithi130.stdout: "map_full": 0, 2024-08-20T05:19:07.788 INFO:teuthology.orchestra.run.smithi130.stdout: "map_inc": 4, 2024-08-20T05:19:07.788 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_sessions": 12, 2024-08-20T05:19:07.788 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_open": 12, 2024-08-20T05:19:07.788 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_close": 0, 2024-08-20T05:19:07.789 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_laggy": 0, 2024-08-20T05:19:07.789 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_wr": 117, 2024-08-20T05:19:07.789 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_rd": 2, 2024-08-20T05:19:07.789 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_del": 25 2024-08-20T05:19:07.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.789 INFO:teuthology.orchestra.run.smithi130.stdout: "oft": { 2024-08-20T05:19:07.789 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_objs": 1, 2024-08-20T05:19:07.789 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_kv_pairs": 0, 2024-08-20T05:19:07.789 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_updates": 0, 2024-08-20T05:19:07.789 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_removes": 0 2024-08-20T05:19:07.789 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.789 INFO:teuthology.orchestra.run.smithi130.stdout: "purge_queue": { 2024-08-20T05:19:07.789 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops": 0, 2024-08-20T05:19:07.789 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops_high_water": 4, 2024-08-20T05:19:07.789 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing": 0, 2024-08-20T05:19:07.790 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_high_water": 2, 2024-08-20T05:19:07.790 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed_ops": 4, 2024-08-20T05:19:07.790 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed": 2, 2024-08-20T05:19:07.790 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_item_in_journal": 0 2024-08-20T05:19:07.790 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.790 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T05:19:07.790 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:07.790 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-20T05:19:07.790 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:07.790 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 9771, 2024-08-20T05:19:07.790 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 4521488, 2024-08-20T05:19:07.790 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:07.790 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 9771, 2024-08-20T05:19:07.790 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-20T05:19:07.791 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-20T05:19:07.791 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 9771, 2024-08-20T05:19:07.791 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 4521488, 2024-08-20T05:19:07.791 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:07.791 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.791 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.791 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.791 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:07.791 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.791 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_bytes": { 2024-08-20T05:19:07.791 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:07.791 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-20T05:19:07.792 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:07.792 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-20T05:19:07.792 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-20T05:19:07.792 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:07.792 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:07.792 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 4305, 2024-08-20T05:19:07.792 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 1330058, 2024-08-20T05:19:07.792 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 4305, 2024-08-20T05:19:07.792 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 1330058, 2024-08-20T05:19:07.792 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:07.792 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.792 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.792 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.792 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:07.793 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.793 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_ops": { 2024-08-20T05:19:07.793 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:07.793 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 1024, 2024-08-20T05:19:07.793 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:07.793 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-20T05:19:07.793 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-20T05:19:07.793 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:07.793 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:07.793 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 4305, 2024-08-20T05:19:07.793 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 4305, 2024-08-20T05:19:07.793 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 4305, 2024-08-20T05:19:07.793 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 4305, 2024-08-20T05:19:07.793 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:07.794 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.794 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.794 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.794 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:07.794 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.794 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle": { 2024-08-20T05:19:07.794 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:07.794 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-20T05:19:07.794 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:07.794 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 2, 2024-08-20T05:19:07.794 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 218, 2024-08-20T05:19:07.794 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:07.794 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 2, 2024-08-20T05:19:07.795 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-20T05:19:07.795 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-20T05:19:07.795 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 1, 2024-08-20T05:19:07.795 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 218, 2024-08-20T05:19:07.795 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:07.795 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.795 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.795 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.795 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:07.795 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.795 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle-0x55f48a5e66e0": { 2024-08-20T05:19:07.795 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:07.795 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-20T05:19:07.795 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:07.796 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 998, 2024-08-20T05:19:07.796 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 1268970, 2024-08-20T05:19:07.796 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:07.796 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 998, 2024-08-20T05:19:07.796 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-20T05:19:07.796 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-20T05:19:07.796 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 542, 2024-08-20T05:19:07.796 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 1268970, 2024-08-20T05:19:07.796 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:07.796 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:07.796 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:07.796 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:07.796 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:07.796 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:07.797 INFO:teuthology.orchestra.run.smithi130.stdout: "trackedop": { 2024-08-20T05:19:07.797 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_ops_count": 2824 2024-08-20T05:19:07.797 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:07.797 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-08-20T05:19:07.797 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:07 smithi130 ceph-mon[22007]: pgmap v907: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-20T05:19:08.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:07 smithi037 ceph-mon[17265]: pgmap v907: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-20T05:19:08.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:07 smithi135 ceph-mon[22342]: pgmap v907: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-20T05:19:08.585 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-08-20T05:19:08.585 INFO:tasks.check_counter:Daemon mds.h mds.imported=6 2024-08-20T05:19:08.585 DEBUG:tasks.check_counter:Getting stats from k 2024-08-20T05:19:08.585 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph daemon mds.k perf dump 2024-08-20T05:19:08.833 INFO:teuthology.orchestra.run.smithi130.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.b/config 2024-08-20T05:19:09.370 INFO:teuthology.orchestra.run.smithi130.stdout:{ 2024-08-20T05:19:09.371 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T05:19:09.371 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 371, 2024-08-20T05:19:09.371 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 340, 2024-08-20T05:19:09.371 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 758482, 2024-08-20T05:19:09.371 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 205940, 2024-08-20T05:19:09.371 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 6, 2024-08-20T05:19:09.371 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 1, 2024-08-20T05:19:09.371 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.050716218, 2024-08-20T05:19:09.371 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.025314850, 2024-08-20T05:19:09.371 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.030925898, 2024-08-20T05:19:09.371 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.000020769, 2024-08-20T05:19:09.372 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:09.372 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 339, 2024-08-20T05:19:09.372 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.019250685, 2024-08-20T05:19:09.372 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000056786 2024-08-20T05:19:09.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.372 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:09.372 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.372 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.372 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.372 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.372 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 757648, 2024-08-20T05:19:09.373 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 205616 2024-08-20T05:19:09.373 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.373 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T05:19:09.373 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 1055, 2024-08-20T05:19:09.373 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 1304, 2024-08-20T05:19:09.373 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 261426, 2024-08-20T05:19:09.373 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 837953, 2024-08-20T05:19:09.373 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 5, 2024-08-20T05:19:09.373 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 4, 2024-08-20T05:19:09.373 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.128411546, 2024-08-20T05:19:09.373 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.057637707, 2024-08-20T05:19:09.373 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.024381279, 2024-08-20T05:19:09.373 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.034977372, 2024-08-20T05:19:09.373 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:09.374 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 1303, 2024-08-20T05:19:09.374 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.068861752, 2024-08-20T05:19:09.374 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000052848 2024-08-20T05:19:09.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.374 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:09.374 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.374 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.374 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.374 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.374 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-08-20T05:19:09.374 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 504048 2024-08-20T05:19:09.375 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.375 INFO:teuthology.orchestra.run.smithi130.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T05:19:09.375 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_messages": 2455, 2024-08-20T05:19:09.375 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages": 2457, 2024-08-20T05:19:09.375 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_bytes": 1992885, 2024-08-20T05:19:09.375 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_bytes": 780748, 2024-08-20T05:19:09.375 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_created_connections": 4, 2024-08-20T05:19:09.375 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_active_connections": 3, 2024-08-20T05:19:09.375 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_total_time": 0.263952412, 2024-08-20T05:19:09.375 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_send_time": 0.117751008, 2024-08-20T05:19:09.375 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_recv_time": 0.057964568, 2024-08-20T05:19:09.375 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_running_fast_dispatch_time": 0.070246159, 2024-08-20T05:19:09.375 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:09.376 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 2455, 2024-08-20T05:19:09.376 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.113082874, 2024-08-20T05:19:09.376 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000046062 2024-08-20T05:19:09.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.376 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:09.376 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.376 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.376 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.376 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T05:19:09.376 INFO:teuthology.orchestra.run.smithi130.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T05:19:09.376 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.376 INFO:teuthology.orchestra.run.smithi130.stdout: "cct": { 2024-08-20T05:19:09.376 INFO:teuthology.orchestra.run.smithi130.stdout: "total_workers": 1, 2024-08-20T05:19:09.377 INFO:teuthology.orchestra.run.smithi130.stdout: "unhealthy_workers": 0 2024-08-20T05:19:09.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.377 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-MDSRank": { 2024-08-20T05:19:09.377 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-20T05:19:09.377 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-20T05:19:09.377 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 5942, 2024-08-20T05:19:09.377 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.154049588, 2024-08-20T05:19:09.377 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000025925 2024-08-20T05:19:09.377 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:09.377 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.377 INFO:teuthology.orchestra.run.smithi130.stdout: "finisher-PurgeQueue": { 2024-08-20T05:19:09.378 INFO:teuthology.orchestra.run.smithi130.stdout: "queue_len": 0, 2024-08-20T05:19:09.378 INFO:teuthology.orchestra.run.smithi130.stdout: "complete_latency": { 2024-08-20T05:19:09.378 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.378 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.378 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.378 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:09.378 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.378 INFO:teuthology.orchestra.run.smithi130.stdout: "mds": { 2024-08-20T05:19:09.378 INFO:teuthology.orchestra.run.smithi130.stdout: "request": 0, 2024-08-20T05:19:09.378 INFO:teuthology.orchestra.run.smithi130.stdout: "reply": 0, 2024-08-20T05:19:09.378 INFO:teuthology.orchestra.run.smithi130.stdout: "reply_latency": { 2024-08-20T05:19:09.378 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.378 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.379 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.379 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.379 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_reply": 0, 2024-08-20T05:19:09.379 INFO:teuthology.orchestra.run.smithi130.stdout: "forward": 0, 2024-08-20T05:19:09.379 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_complete": 0, 2024-08-20T05:19:09.379 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_fetch_keys": 0, 2024-08-20T05:19:09.379 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_commit": 0, 2024-08-20T05:19:09.379 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_split": 0, 2024-08-20T05:19:09.379 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_merge": 0, 2024-08-20T05:19:09.379 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes": 261, 2024-08-20T05:19:09.379 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_top": 56, 2024-08-20T05:19:09.380 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_bottom": 205, 2024-08-20T05:19:09.380 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pin_tail": 0, 2024-08-20T05:19:09.380 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_pinned": 182, 2024-08-20T05:19:09.380 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_expired": 0, 2024-08-20T05:19:09.380 INFO:teuthology.orchestra.run.smithi130.stdout: "inodes_with_caps": 0, 2024-08-20T05:19:09.380 INFO:teuthology.orchestra.run.smithi130.stdout: "caps": 0, 2024-08-20T05:19:09.380 INFO:teuthology.orchestra.run.smithi130.stdout: "subtrees": 8, 2024-08-20T05:19:09.380 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse": 0, 2024-08-20T05:19:09.380 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_hit": 0, 2024-08-20T05:19:09.380 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_forward": 0, 2024-08-20T05:19:09.380 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_discover": 0, 2024-08-20T05:19:09.380 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_dir_fetch": 0, 2024-08-20T05:19:09.380 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_remote_ino": 0, 2024-08-20T05:19:09.380 INFO:teuthology.orchestra.run.smithi130.stdout: "traverse_lock": 0, 2024-08-20T05:19:09.380 INFO:teuthology.orchestra.run.smithi130.stdout: "load_cent": 0, 2024-08-20T05:19:09.381 INFO:teuthology.orchestra.run.smithi130.stdout: "q": 0, 2024-08-20T05:19:09.381 INFO:teuthology.orchestra.run.smithi130.stdout: "exported": 0, 2024-08-20T05:19:09.381 INFO:teuthology.orchestra.run.smithi130.stdout: "exported_inodes": 0, 2024-08-20T05:19:09.381 INFO:teuthology.orchestra.run.smithi130.stdout: "imported": 0, 2024-08-20T05:19:09.381 INFO:teuthology.orchestra.run.smithi130.stdout: "imported_inodes": 0, 2024-08-20T05:19:09.381 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_dir_fetch": 0, 2024-08-20T05:19:09.381 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_backtrace_fetch": 0, 2024-08-20T05:19:09.381 INFO:teuthology.orchestra.run.smithi130.stdout: "openino_peer_discover": 0, 2024-08-20T05:19:09.381 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rfiles": 0, 2024-08-20T05:19:09.381 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rbytes": 0, 2024-08-20T05:19:09.381 INFO:teuthology.orchestra.run.smithi130.stdout: "root_rsnaps": 0, 2024-08-20T05:19:09.381 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_fetch": 0, 2024-08-20T05:19:09.381 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_set_tag": 0, 2024-08-20T05:19:09.382 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T05:19:09.382 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_inotable_repaired": 0, 2024-08-20T05:19:09.382 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_inodes": 0, 2024-08-20T05:19:09.382 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T05:19:09.382 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_dirfrag_rstats": 0, 2024-08-20T05:19:09.382 INFO:teuthology.orchestra.run.smithi130.stdout: "scrub_file_inodes": 0, 2024-08-20T05:19:09.382 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_inode_file_caps": 0, 2024-08-20T05:19:09.382 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_revoke": 0, 2024-08-20T05:19:09.382 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_grant": 0, 2024-08-20T05:19:09.382 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T05:19:09.382 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T05:19:09.382 INFO:teuthology.orchestra.run.smithi130.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T05:19:09.382 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps": 0, 2024-08-20T05:19:09.382 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_caps_dirty": 0, 2024-08-20T05:19:09.383 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_cap_release": 0, 2024-08-20T05:19:09.383 INFO:teuthology.orchestra.run.smithi130.stdout: "process_request_cap_release": 0 2024-08-20T05:19:09.383 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.383 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_cache": { 2024-08-20T05:19:09.383 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update": 0, 2024-08-20T05:19:09.383 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_update_receipt": 0, 2024-08-20T05:19:09.383 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_try_discover": 0, 2024-08-20T05:19:09.383 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_send_discover": 0, 2024-08-20T05:19:09.383 INFO:teuthology.orchestra.run.smithi130.stdout: "dir_handle_discover": 0, 2024-08-20T05:19:09.383 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays": 0, 2024-08-20T05:19:09.383 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_delayed": 0, 2024-08-20T05:19:09.383 INFO:teuthology.orchestra.run.smithi130.stdout: "num_strays_enqueuing": 0, 2024-08-20T05:19:09.383 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_created": 0, 2024-08-20T05:19:09.383 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_enqueued": 0, 2024-08-20T05:19:09.383 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_reintegrated": 0, 2024-08-20T05:19:09.384 INFO:teuthology.orchestra.run.smithi130.stdout: "strays_migrated": 0, 2024-08-20T05:19:09.384 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_processing": 0, 2024-08-20T05:19:09.384 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_enqueued": 0, 2024-08-20T05:19:09.384 INFO:teuthology.orchestra.run.smithi130.stdout: "num_recovering_prioritized": 0, 2024-08-20T05:19:09.384 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_started": 0, 2024-08-20T05:19:09.384 INFO:teuthology.orchestra.run.smithi130.stdout: "recovery_completed": 0, 2024-08-20T05:19:09.384 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_path": 0, 2024-08-20T05:19:09.384 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_quiesce_inode": 0, 2024-08-20T05:19:09.384 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T05:19:09.384 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_exportdir": 0, 2024-08-20T05:19:09.384 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_flush": 0, 2024-08-20T05:19:09.384 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragmentdir": 0, 2024-08-20T05:19:09.384 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_fragstats": 0, 2024-08-20T05:19:09.384 INFO:teuthology.orchestra.run.smithi130.stdout: "ireq_inodestats": 0 2024-08-20T05:19:09.384 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.385 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_log": { 2024-08-20T05:19:09.385 INFO:teuthology.orchestra.run.smithi130.stdout: "evlrg": 0, 2024-08-20T05:19:09.385 INFO:teuthology.orchestra.run.smithi130.stdout: "evadd": 0, 2024-08-20T05:19:09.385 INFO:teuthology.orchestra.run.smithi130.stdout: "evex": 0, 2024-08-20T05:19:09.385 INFO:teuthology.orchestra.run.smithi130.stdout: "evtrm": 0, 2024-08-20T05:19:09.385 INFO:teuthology.orchestra.run.smithi130.stdout: "ev": 998, 2024-08-20T05:19:09.385 INFO:teuthology.orchestra.run.smithi130.stdout: "evexg": 0, 2024-08-20T05:19:09.385 INFO:teuthology.orchestra.run.smithi130.stdout: "evexd": 0, 2024-08-20T05:19:09.385 INFO:teuthology.orchestra.run.smithi130.stdout: "segadd": 0, 2024-08-20T05:19:09.385 INFO:teuthology.orchestra.run.smithi130.stdout: "segex": 0, 2024-08-20T05:19:09.385 INFO:teuthology.orchestra.run.smithi130.stdout: "segtrm": 0, 2024-08-20T05:19:09.385 INFO:teuthology.orchestra.run.smithi130.stdout: "seg": 2, 2024-08-20T05:19:09.385 INFO:teuthology.orchestra.run.smithi130.stdout: "segmjr": 2, 2024-08-20T05:19:09.386 INFO:teuthology.orchestra.run.smithi130.stdout: "segexg": 0, 2024-08-20T05:19:09.386 INFO:teuthology.orchestra.run.smithi130.stdout: "segexd": 0, 2024-08-20T05:19:09.386 INFO:teuthology.orchestra.run.smithi130.stdout: "expos": 4194304, 2024-08-20T05:19:09.386 INFO:teuthology.orchestra.run.smithi130.stdout: "wrpos": 5463274, 2024-08-20T05:19:09.386 INFO:teuthology.orchestra.run.smithi130.stdout: "rdpos": 5462700, 2024-08-20T05:19:09.386 INFO:teuthology.orchestra.run.smithi130.stdout: "jlat": { 2024-08-20T05:19:09.386 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.386 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.386 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.386 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.386 INFO:teuthology.orchestra.run.smithi130.stdout: "replayed": 998 2024-08-20T05:19:09.387 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.387 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_mem": { 2024-08-20T05:19:09.387 INFO:teuthology.orchestra.run.smithi130.stdout: "ino": 258, 2024-08-20T05:19:09.387 INFO:teuthology.orchestra.run.smithi130.stdout: "ino+": 260, 2024-08-20T05:19:09.387 INFO:teuthology.orchestra.run.smithi130.stdout: "ino-": 2, 2024-08-20T05:19:09.387 INFO:teuthology.orchestra.run.smithi130.stdout: "dir": 16, 2024-08-20T05:19:09.387 INFO:teuthology.orchestra.run.smithi130.stdout: "dir+": 16, 2024-08-20T05:19:09.387 INFO:teuthology.orchestra.run.smithi130.stdout: "dir-": 0, 2024-08-20T05:19:09.387 INFO:teuthology.orchestra.run.smithi130.stdout: "dn": 261, 2024-08-20T05:19:09.387 INFO:teuthology.orchestra.run.smithi130.stdout: "dn+": 261, 2024-08-20T05:19:09.387 INFO:teuthology.orchestra.run.smithi130.stdout: "dn-": 0, 2024-08-20T05:19:09.387 INFO:teuthology.orchestra.run.smithi130.stdout: "cap": 0, 2024-08-20T05:19:09.387 INFO:teuthology.orchestra.run.smithi130.stdout: "cap+": 0, 2024-08-20T05:19:09.387 INFO:teuthology.orchestra.run.smithi130.stdout: "cap-": 0, 2024-08-20T05:19:09.388 INFO:teuthology.orchestra.run.smithi130.stdout: "rss": 50844, 2024-08-20T05:19:09.388 INFO:teuthology.orchestra.run.smithi130.stdout: "heap": 250335232 2024-08-20T05:19:09.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.388 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_server": { 2024-08-20T05:19:09.388 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_client_request": 0, 2024-08-20T05:19:09.388 INFO:teuthology.orchestra.run.smithi130.stdout: "dispatch_server_request": 0, 2024-08-20T05:19:09.388 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_request": 0, 2024-08-20T05:19:09.388 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_client_session": 0, 2024-08-20T05:19:09.388 INFO:teuthology.orchestra.run.smithi130.stdout: "handle_peer_request": 0, 2024-08-20T05:19:09.388 INFO:teuthology.orchestra.run.smithi130.stdout: "req_create_latency": { 2024-08-20T05:19:09.388 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.388 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.388 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.388 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.389 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getattr_latency": { 2024-08-20T05:19:09.389 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.389 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.389 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.389 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.389 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getfilelock_latency": { 2024-08-20T05:19:09.389 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.389 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.389 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.389 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.389 INFO:teuthology.orchestra.run.smithi130.stdout: "req_link_latency": { 2024-08-20T05:19:09.389 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.389 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.389 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.389 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.390 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookup_latency": { 2024-08-20T05:19:09.390 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.390 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.390 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.390 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookuphash_latency": { 2024-08-20T05:19:09.390 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.390 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.390 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.390 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.390 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupino_latency": { 2024-08-20T05:19:09.390 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.390 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.390 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.391 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupname_latency": { 2024-08-20T05:19:09.391 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.391 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.391 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.391 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupparent_latency": { 2024-08-20T05:19:09.391 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.391 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.391 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.391 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lookupsnap_latency": { 2024-08-20T05:19:09.391 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.391 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.391 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.391 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.392 INFO:teuthology.orchestra.run.smithi130.stdout: "req_lssnap_latency": { 2024-08-20T05:19:09.392 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.392 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.392 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.392 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.392 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mkdir_latency": { 2024-08-20T05:19:09.392 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.392 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.393 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.393 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mknod_latency": { 2024-08-20T05:19:09.393 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.393 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.393 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.393 INFO:teuthology.orchestra.run.smithi130.stdout: "req_mksnap_latency": { 2024-08-20T05:19:09.393 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.393 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.393 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.393 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.393 INFO:teuthology.orchestra.run.smithi130.stdout: "req_open_latency": { 2024-08-20T05:19:09.393 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.393 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.394 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.394 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.394 INFO:teuthology.orchestra.run.smithi130.stdout: "req_readdir_latency": { 2024-08-20T05:19:09.394 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.394 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.394 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.394 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.394 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rename_latency": { 2024-08-20T05:19:09.394 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.394 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.394 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.394 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.394 INFO:teuthology.orchestra.run.smithi130.stdout: "req_renamesnap_latency": { 2024-08-20T05:19:09.394 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.395 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.395 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.395 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.395 INFO:teuthology.orchestra.run.smithi130.stdout: "req_snapdiff_latency": { 2024-08-20T05:19:09.395 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.395 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.395 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.395 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.395 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmdir_latency": { 2024-08-20T05:19:09.395 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.395 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.395 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.395 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.395 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmsnap_latency": { 2024-08-20T05:19:09.395 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.396 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.396 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.396 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.396 INFO:teuthology.orchestra.run.smithi130.stdout: "req_rmxattr_latency": { 2024-08-20T05:19:09.396 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.396 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.396 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.396 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.396 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setattr_latency": { 2024-08-20T05:19:09.396 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.396 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.396 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.396 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.396 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setdirlayout_latency": { 2024-08-20T05:19:09.397 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.397 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.397 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.397 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.397 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setfilelock_latency": { 2024-08-20T05:19:09.397 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.397 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.397 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.397 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.397 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setlayout_latency": { 2024-08-20T05:19:09.398 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.398 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.398 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.398 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.398 INFO:teuthology.orchestra.run.smithi130.stdout: "req_setxattr_latency": { 2024-08-20T05:19:09.398 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.398 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.398 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.398 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.398 INFO:teuthology.orchestra.run.smithi130.stdout: "req_symlink_latency": { 2024-08-20T05:19:09.398 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.398 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.398 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.398 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.399 INFO:teuthology.orchestra.run.smithi130.stdout: "req_unlink_latency": { 2024-08-20T05:19:09.399 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.399 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.399 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.399 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.399 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_revoke_eviction": 0, 2024-08-20T05:19:09.399 INFO:teuthology.orchestra.run.smithi130.stdout: "cap_acquisition_throttle": 0, 2024-08-20T05:19:09.399 INFO:teuthology.orchestra.run.smithi130.stdout: "req_getvxattr_latency": { 2024-08-20T05:19:09.399 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.399 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.399 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.399 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:09.400 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.400 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_sessions": { 2024-08-20T05:19:09.400 INFO:teuthology.orchestra.run.smithi130.stdout: "session_count": 1, 2024-08-20T05:19:09.400 INFO:teuthology.orchestra.run.smithi130.stdout: "session_add": 2, 2024-08-20T05:19:09.400 INFO:teuthology.orchestra.run.smithi130.stdout: "session_remove": 1, 2024-08-20T05:19:09.400 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_open": 1, 2024-08-20T05:19:09.400 INFO:teuthology.orchestra.run.smithi130.stdout: "sessions_stale": 0, 2024-08-20T05:19:09.400 INFO:teuthology.orchestra.run.smithi130.stdout: "total_load": 0, 2024-08-20T05:19:09.400 INFO:teuthology.orchestra.run.smithi130.stdout: "average_load": 0, 2024-08-20T05:19:09.400 INFO:teuthology.orchestra.run.smithi130.stdout: "avg_session_uptime": 2291, 2024-08-20T05:19:09.400 INFO:teuthology.orchestra.run.smithi130.stdout: "mdthresh_evicted": 0 2024-08-20T05:19:09.400 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.400 INFO:teuthology.orchestra.run.smithi130.stdout: "mempool": { 2024-08-20T05:19:09.401 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_bytes": 0, 2024-08-20T05:19:09.401 INFO:teuthology.orchestra.run.smithi130.stdout: "bloom_filter_items": 0, 2024-08-20T05:19:09.401 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T05:19:09.401 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_alloc_items": 0, 2024-08-20T05:19:09.401 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T05:19:09.401 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_data_items": 0, 2024-08-20T05:19:09.401 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T05:19:09.401 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T05:19:09.401 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T05:19:09.401 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T05:19:09.401 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T05:19:09.401 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_other_items": 0, 2024-08-20T05:19:09.401 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T05:19:09.401 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T05:19:09.401 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_bytes": 0, 2024-08-20T05:19:09.402 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_extent_items": 0, 2024-08-20T05:19:09.402 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_bytes": 0, 2024-08-20T05:19:09.402 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_blob_items": 0, 2024-08-20T05:19:09.402 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T05:19:09.402 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T05:19:09.402 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T05:19:09.402 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T05:19:09.402 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T05:19:09.402 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_fsck_items": 0, 2024-08-20T05:19:09.402 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_bytes": 0, 2024-08-20T05:19:09.402 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_txc_items": 0, 2024-08-20T05:19:09.403 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T05:19:09.403 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T05:19:09.403 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_bytes": 0, 2024-08-20T05:19:09.403 INFO:teuthology.orchestra.run.smithi130.stdout: "bluestore_writing_items": 0, 2024-08-20T05:19:09.403 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_bytes": 0, 2024-08-20T05:19:09.403 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_items": 0, 2024-08-20T05:19:09.403 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T05:19:09.403 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_reader_items": 0, 2024-08-20T05:19:09.404 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T05:19:09.404 INFO:teuthology.orchestra.run.smithi130.stdout: "bluefs_file_writer_items": 0, 2024-08-20T05:19:09.404 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_bytes": 200201, 2024-08-20T05:19:09.404 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_anon_items": 304, 2024-08-20T05:19:09.404 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_bytes": 0, 2024-08-20T05:19:09.404 INFO:teuthology.orchestra.run.smithi130.stdout: "buffer_meta_items": 0, 2024-08-20T05:19:09.404 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_bytes": 0, 2024-08-20T05:19:09.404 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_items": 0, 2024-08-20T05:19:09.404 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_bytes": 0, 2024-08-20T05:19:09.404 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_mapbl_items": 0, 2024-08-20T05:19:09.404 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_bytes": 0, 2024-08-20T05:19:09.404 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_pglog_items": 0, 2024-08-20T05:19:09.404 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_bytes": 8864, 2024-08-20T05:19:09.405 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_items": 167, 2024-08-20T05:19:09.405 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T05:19:09.405 INFO:teuthology.orchestra.run.smithi130.stdout: "osdmap_mapping_items": 0, 2024-08-20T05:19:09.405 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_bytes": 0, 2024-08-20T05:19:09.405 INFO:teuthology.orchestra.run.smithi130.stdout: "pgmap_items": 0, 2024-08-20T05:19:09.405 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_bytes": 793999, 2024-08-20T05:19:09.405 INFO:teuthology.orchestra.run.smithi130.stdout: "mds_co_items": 6693, 2024-08-20T05:19:09.405 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_bytes": 0, 2024-08-20T05:19:09.405 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_1_items": 0, 2024-08-20T05:19:09.405 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_bytes": 0, 2024-08-20T05:19:09.405 INFO:teuthology.orchestra.run.smithi130.stdout: "unittest_2_items": 0 2024-08-20T05:19:09.405 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.405 INFO:teuthology.orchestra.run.smithi130.stdout: "objecter": { 2024-08-20T05:19:09.405 INFO:teuthology.orchestra.run.smithi130.stdout: "op_active": 0, 2024-08-20T05:19:09.405 INFO:teuthology.orchestra.run.smithi130.stdout: "op_laggy": 0, 2024-08-20T05:19:09.406 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send": 3506, 2024-08-20T05:19:09.406 INFO:teuthology.orchestra.run.smithi130.stdout: "op_send_bytes": 21, 2024-08-20T05:19:09.406 INFO:teuthology.orchestra.run.smithi130.stdout: "op_resend": 3, 2024-08-20T05:19:09.406 INFO:teuthology.orchestra.run.smithi130.stdout: "op_reply": 3506, 2024-08-20T05:19:09.406 INFO:teuthology.orchestra.run.smithi130.stdout: "op_latency": { 2024-08-20T05:19:09.406 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 3506, 2024-08-20T05:19:09.406 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 13.001770345, 2024-08-20T05:19:09.406 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.003708434 2024-08-20T05:19:09.406 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.406 INFO:teuthology.orchestra.run.smithi130.stdout: "op_inflight": 0, 2024-08-20T05:19:09.406 INFO:teuthology.orchestra.run.smithi130.stdout: "oplen_avg": { 2024-08-20T05:19:09.406 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 3506, 2024-08-20T05:19:09.406 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 3507 2024-08-20T05:19:09.406 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.406 INFO:teuthology.orchestra.run.smithi130.stdout: "op": 3506, 2024-08-20T05:19:09.407 INFO:teuthology.orchestra.run.smithi130.stdout: "op_r": 3506, 2024-08-20T05:19:09.407 INFO:teuthology.orchestra.run.smithi130.stdout: "op_w": 0, 2024-08-20T05:19:09.407 INFO:teuthology.orchestra.run.smithi130.stdout: "op_rmw": 0, 2024-08-20T05:19:09.407 INFO:teuthology.orchestra.run.smithi130.stdout: "op_pg": 0, 2024-08-20T05:19:09.407 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_stat": 2179, 2024-08-20T05:19:09.407 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_create": 0, 2024-08-20T05:19:09.407 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_read": 1325, 2024-08-20T05:19:09.407 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_write": 0, 2024-08-20T05:19:09.407 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writefull": 0, 2024-08-20T05:19:09.407 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_writesame": 0, 2024-08-20T05:19:09.407 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_append": 0, 2024-08-20T05:19:09.407 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_zero": 0, 2024-08-20T05:19:09.407 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_truncate": 0, 2024-08-20T05:19:09.408 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_delete": 0, 2024-08-20T05:19:09.408 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_mapext": 0, 2024-08-20T05:19:09.408 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_sparse_read": 0, 2024-08-20T05:19:09.408 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_clonerange": 0, 2024-08-20T05:19:09.408 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_getxattr": 1, 2024-08-20T05:19:09.408 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_setxattr": 0, 2024-08-20T05:19:09.408 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_cmpxattr": 0, 2024-08-20T05:19:09.408 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_rmxattr": 0, 2024-08-20T05:19:09.408 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_resetxattrs": 0, 2024-08-20T05:19:09.408 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_call": 0, 2024-08-20T05:19:09.408 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_watch": 0, 2024-08-20T05:19:09.408 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_notify": 0, 2024-08-20T05:19:09.409 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T05:19:09.409 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls": 0, 2024-08-20T05:19:09.409 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_pgls_filter": 0, 2024-08-20T05:19:09.409 INFO:teuthology.orchestra.run.smithi130.stdout: "osdop_other": 0, 2024-08-20T05:19:09.409 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_active": 0, 2024-08-20T05:19:09.409 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_send": 0, 2024-08-20T05:19:09.409 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_resend": 0, 2024-08-20T05:19:09.409 INFO:teuthology.orchestra.run.smithi130.stdout: "linger_ping": 0, 2024-08-20T05:19:09.409 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_active": 0, 2024-08-20T05:19:09.409 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_send": 0, 2024-08-20T05:19:09.409 INFO:teuthology.orchestra.run.smithi130.stdout: "poolop_resend": 0, 2024-08-20T05:19:09.409 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_active": 0, 2024-08-20T05:19:09.409 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_send": 0, 2024-08-20T05:19:09.409 INFO:teuthology.orchestra.run.smithi130.stdout: "poolstat_resend": 0, 2024-08-20T05:19:09.410 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_active": 0, 2024-08-20T05:19:09.410 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_send": 0, 2024-08-20T05:19:09.410 INFO:teuthology.orchestra.run.smithi130.stdout: "statfs_resend": 0, 2024-08-20T05:19:09.410 INFO:teuthology.orchestra.run.smithi130.stdout: "command_active": 0, 2024-08-20T05:19:09.410 INFO:teuthology.orchestra.run.smithi130.stdout: "command_send": 0, 2024-08-20T05:19:09.410 INFO:teuthology.orchestra.run.smithi130.stdout: "command_resend": 0, 2024-08-20T05:19:09.410 INFO:teuthology.orchestra.run.smithi130.stdout: "map_epoch": 88, 2024-08-20T05:19:09.410 INFO:teuthology.orchestra.run.smithi130.stdout: "map_full": 0, 2024-08-20T05:19:09.410 INFO:teuthology.orchestra.run.smithi130.stdout: "map_inc": 4, 2024-08-20T05:19:09.410 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_sessions": 5, 2024-08-20T05:19:09.410 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_open": 6, 2024-08-20T05:19:09.410 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_session_close": 1, 2024-08-20T05:19:09.410 INFO:teuthology.orchestra.run.smithi130.stdout: "osd_laggy": 0, 2024-08-20T05:19:09.410 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_wr": 0, 2024-08-20T05:19:09.411 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_rd": 2, 2024-08-20T05:19:09.411 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_del": 0 2024-08-20T05:19:09.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.411 INFO:teuthology.orchestra.run.smithi130.stdout: "oft": { 2024-08-20T05:19:09.411 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_objs": 0, 2024-08-20T05:19:09.411 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_kv_pairs": 0, 2024-08-20T05:19:09.411 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_updates": 0, 2024-08-20T05:19:09.411 INFO:teuthology.orchestra.run.smithi130.stdout: "omap_total_removes": 0 2024-08-20T05:19:09.411 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.411 INFO:teuthology.orchestra.run.smithi130.stdout: "purge_queue": { 2024-08-20T05:19:09.411 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops": 0, 2024-08-20T05:19:09.411 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_ops_high_water": 0, 2024-08-20T05:19:09.411 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing": 0, 2024-08-20T05:19:09.411 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executing_high_water": 0, 2024-08-20T05:19:09.412 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed_ops": 0, 2024-08-20T05:19:09.412 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_executed": 0, 2024-08-20T05:19:09.412 INFO:teuthology.orchestra.run.smithi130.stdout: "pq_item_in_journal": 0 2024-08-20T05:19:09.412 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.412 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T05:19:09.412 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:09.412 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-20T05:19:09.412 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:09.412 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 3877, 2024-08-20T05:19:09.412 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 2641956, 2024-08-20T05:19:09.412 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:09.412 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 3877, 2024-08-20T05:19:09.412 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-20T05:19:09.412 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-20T05:19:09.413 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 3877, 2024-08-20T05:19:09.413 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 2641956, 2024-08-20T05:19:09.413 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:09.413 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.413 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.413 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.413 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:09.413 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.413 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_bytes": { 2024-08-20T05:19:09.413 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:09.413 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 104857600, 2024-08-20T05:19:09.413 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:09.413 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-20T05:19:09.413 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-20T05:19:09.413 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:09.414 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:09.414 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 3506, 2024-08-20T05:19:09.414 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 1268975, 2024-08-20T05:19:09.414 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 3506, 2024-08-20T05:19:09.414 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 1268975, 2024-08-20T05:19:09.414 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:09.414 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.414 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.414 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.414 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:09.414 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.414 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-objecter_ops": { 2024-08-20T05:19:09.414 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:09.414 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 1024, 2024-08-20T05:19:09.414 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:09.415 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-20T05:19:09.415 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-20T05:19:09.415 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:09.415 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:09.415 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 3506, 2024-08-20T05:19:09.415 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 3506, 2024-08-20T05:19:09.415 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 3506, 2024-08-20T05:19:09.415 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 3506, 2024-08-20T05:19:09.415 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:09.415 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.415 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.415 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.415 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:09.415 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.416 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle": { 2024-08-20T05:19:09.416 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:09.416 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-20T05:19:09.416 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:09.416 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-20T05:19:09.416 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-20T05:19:09.416 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:09.416 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:09.416 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-20T05:19:09.416 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-20T05:19:09.416 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 0, 2024-08-20T05:19:09.416 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 0, 2024-08-20T05:19:09.416 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:09.416 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.417 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.417 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.417 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:09.417 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.417 INFO:teuthology.orchestra.run.smithi130.stdout: "throttle-write_buf_throttle-0x55cebad2a960": { 2024-08-20T05:19:09.417 INFO:teuthology.orchestra.run.smithi130.stdout: "val": 0, 2024-08-20T05:19:09.417 INFO:teuthology.orchestra.run.smithi130.stdout: "max": 3758096384, 2024-08-20T05:19:09.417 INFO:teuthology.orchestra.run.smithi130.stdout: "get_started": 0, 2024-08-20T05:19:09.417 INFO:teuthology.orchestra.run.smithi130.stdout: "get": 0, 2024-08-20T05:19:09.417 INFO:teuthology.orchestra.run.smithi130.stdout: "get_sum": 0, 2024-08-20T05:19:09.417 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:09.418 INFO:teuthology.orchestra.run.smithi130.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:09.418 INFO:teuthology.orchestra.run.smithi130.stdout: "take": 0, 2024-08-20T05:19:09.418 INFO:teuthology.orchestra.run.smithi130.stdout: "take_sum": 0, 2024-08-20T05:19:09.418 INFO:teuthology.orchestra.run.smithi130.stdout: "put": 0, 2024-08-20T05:19:09.418 INFO:teuthology.orchestra.run.smithi130.stdout: "put_sum": 0, 2024-08-20T05:19:09.418 INFO:teuthology.orchestra.run.smithi130.stdout: "wait": { 2024-08-20T05:19:09.418 INFO:teuthology.orchestra.run.smithi130.stdout: "avgcount": 0, 2024-08-20T05:19:09.418 INFO:teuthology.orchestra.run.smithi130.stdout: "sum": 0.000000000, 2024-08-20T05:19:09.418 INFO:teuthology.orchestra.run.smithi130.stdout: "avgtime": 0.000000000 2024-08-20T05:19:09.418 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:09.418 INFO:teuthology.orchestra.run.smithi130.stdout: }, 2024-08-20T05:19:09.418 INFO:teuthology.orchestra.run.smithi130.stdout: "trackedop": { 2024-08-20T05:19:09.418 INFO:teuthology.orchestra.run.smithi130.stdout: "slow_ops_count": 0 2024-08-20T05:19:09.419 INFO:teuthology.orchestra.run.smithi130.stdout: } 2024-08-20T05:19:09.419 INFO:teuthology.orchestra.run.smithi130.stdout:} 2024-08-20T05:19:09.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:09 smithi130 ceph-mon[22007]: pgmap v908: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-20T05:19:10.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:09 smithi037 ceph-mon[17265]: pgmap v908: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-20T05:19:10.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:09 smithi135 ceph-mon[22342]: pgmap v908: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-08-20T05:19:10.162 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-08-20T05:19:10.162 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-08-20T05:19:10.162 DEBUG:tasks.check_counter:Getting stats from c 2024-08-20T05:19:10.162 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph daemon mds.c perf dump 2024-08-20T05:19:10.462 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T05:19:11.156 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-08-20T05:19:11.156 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T05:19:11.156 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 5298, 2024-08-20T05:19:11.156 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 6890, 2024-08-20T05:19:11.157 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 2314884, 2024-08-20T05:19:11.157 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 5803382, 2024-08-20T05:19:11.157 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 19, 2024-08-20T05:19:11.157 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2024-08-20T05:19:11.157 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.522382459, 2024-08-20T05:19:11.157 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.266355445, 2024-08-20T05:19:11.157 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.197174203, 2024-08-20T05:19:11.157 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.067545973, 2024-08-20T05:19:11.157 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:11.157 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 6888, 2024-08-20T05:19:11.157 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.207922680, 2024-08-20T05:19:11.157 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000175366 2024-08-20T05:19:11.157 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.157 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:11.157 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4904, 2024-08-20T05:19:11.158 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000907605, 2024-08-20T05:19:11.158 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000185 2024-08-20T05:19:11.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.158 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 760336, 2024-08-20T05:19:11.158 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 1907664 2024-08-20T05:19:11.158 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.159 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T05:19:11.159 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 3536, 2024-08-20T05:19:11.159 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 3835, 2024-08-20T05:19:11.159 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 2751182, 2024-08-20T05:19:11.159 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 1580134, 2024-08-20T05:19:11.159 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 11, 2024-08-20T05:19:11.159 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 7, 2024-08-20T05:19:11.159 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.294267185, 2024-08-20T05:19:11.159 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.143679231, 2024-08-20T05:19:11.159 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.101620005, 2024-08-20T05:19:11.159 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.043683680, 2024-08-20T05:19:11.159 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:11.159 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3835, 2024-08-20T05:19:11.160 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.182901007, 2024-08-20T05:19:11.160 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000047692 2024-08-20T05:19:11.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.160 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:11.160 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1274, 2024-08-20T05:19:11.160 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000249950, 2024-08-20T05:19:11.160 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000196 2024-08-20T05:19:11.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.160 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 783472, 2024-08-20T05:19:11.160 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 222464 2024-08-20T05:19:11.160 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.160 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T05:19:11.160 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 5026, 2024-08-20T05:19:11.160 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 6475, 2024-08-20T05:19:11.161 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 2396807, 2024-08-20T05:19:11.161 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 3151164, 2024-08-20T05:19:11.161 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 39, 2024-08-20T05:19:11.161 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 6, 2024-08-20T05:19:11.161 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.438255884, 2024-08-20T05:19:11.161 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.217331764, 2024-08-20T05:19:11.161 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.204037295, 2024-08-20T05:19:11.161 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.031031385, 2024-08-20T05:19:11.161 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:11.161 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 6473, 2024-08-20T05:19:11.161 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.858609631, 2024-08-20T05:19:11.161 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000132644 2024-08-20T05:19:11.161 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.161 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:11.162 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 7903, 2024-08-20T05:19:11.162 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.001609936, 2024-08-20T05:19:11.162 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000203 2024-08-20T05:19:11.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.162 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-20T05:19:11.162 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 506272 2024-08-20T05:19:11.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.162 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-08-20T05:19:11.162 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-08-20T05:19:11.162 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-08-20T05:19:11.162 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.162 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-08-20T05:19:11.163 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-08-20T05:19:11.163 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-08-20T05:19:11.163 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 6283, 2024-08-20T05:19:11.163 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.582277708, 2024-08-20T05:19:11.163 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000251834 2024-08-20T05:19:11.163 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:11.163 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.163 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-08-20T05:19:11.163 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-08-20T05:19:11.163 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-08-20T05:19:11.163 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 83, 2024-08-20T05:19:11.163 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.003671998, 2024-08-20T05:19:11.163 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000044240 2024-08-20T05:19:11.163 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:11.163 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.164 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-08-20T05:19:11.164 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 808, 2024-08-20T05:19:11.164 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 704, 2024-08-20T05:19:11.164 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-08-20T05:19:11.164 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 704, 2024-08-20T05:19:11.164 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 27.793209200, 2024-08-20T05:19:11.164 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.039478990 2024-08-20T05:19:11.164 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.164 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-08-20T05:19:11.164 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 104, 2024-08-20T05:19:11.164 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 9, 2024-08-20T05:19:11.164 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 1, 2024-08-20T05:19:11.164 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 11, 2024-08-20T05:19:11.164 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2024-08-20T05:19:11.165 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-08-20T05:19:11.165 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 482, 2024-08-20T05:19:11.165 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 35, 2024-08-20T05:19:11.165 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 433, 2024-08-20T05:19:11.165 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 14, 2024-08-20T05:19:11.165 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 432, 2024-08-20T05:19:11.165 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 184, 2024-08-20T05:19:11.165 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 396, 2024-08-20T05:19:11.165 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 396, 2024-08-20T05:19:11.165 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 18, 2024-08-20T05:19:11.165 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 1244, 2024-08-20T05:19:11.165 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 1120, 2024-08-20T05:19:11.165 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 94, 2024-08-20T05:19:11.165 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 5, 2024-08-20T05:19:11.165 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-08-20T05:19:11.166 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-08-20T05:19:11.166 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2024-08-20T05:19:11.166 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 1469, 2024-08-20T05:19:11.166 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 1, 2024-08-20T05:19:11.166 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 3, 2024-08-20T05:19:11.166 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 171, 2024-08-20T05:19:11.166 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 13, 2024-08-20T05:19:11.166 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 577, 2024-08-20T05:19:11.166 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-08-20T05:19:11.166 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 5574, 2024-08-20T05:19:11.166 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-08-20T05:19:11.166 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 1020, 2024-08-20T05:19:11.166 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 1528108595, 2024-08-20T05:19:11.166 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2024-08-20T05:19:11.167 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 5574, 2024-08-20T05:19:11.167 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-08-20T05:19:11.167 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T05:19:11.167 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-08-20T05:19:11.167 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 241, 2024-08-20T05:19:11.167 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T05:19:11.167 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 241, 2024-08-20T05:19:11.167 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 5333, 2024-08-20T05:19:11.167 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 19, 2024-08-20T05:19:11.167 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 709, 2024-08-20T05:19:11.167 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 1423, 2024-08-20T05:19:11.167 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T05:19:11.167 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T05:19:11.167 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T05:19:11.167 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 1109, 2024-08-20T05:19:11.168 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 167, 2024-08-20T05:19:11.168 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 32, 2024-08-20T05:19:11.168 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 77 2024-08-20T05:19:11.168 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.168 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-08-20T05:19:11.168 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2024-08-20T05:19:11.168 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2024-08-20T05:19:11.168 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2024-08-20T05:19:11.168 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 39, 2024-08-20T05:19:11.168 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2024-08-20T05:19:11.168 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2024-08-20T05:19:11.168 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-08-20T05:19:11.168 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-08-20T05:19:11.168 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 17, 2024-08-20T05:19:11.168 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 17, 2024-08-20T05:19:11.169 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-08-20T05:19:11.169 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-08-20T05:19:11.169 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-08-20T05:19:11.169 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-08-20T05:19:11.169 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-08-20T05:19:11.169 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-08-20T05:19:11.169 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-08-20T05:19:11.169 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_path": 15, 2024-08-20T05:19:11.169 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_inode": 5219, 2024-08-20T05:19:11.169 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T05:19:11.169 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 3, 2024-08-20T05:19:11.169 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-08-20T05:19:11.169 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2024-08-20T05:19:11.169 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-08-20T05:19:11.169 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2024-08-20T05:19:11.170 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.170 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-08-20T05:19:11.170 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2024-08-20T05:19:11.170 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 1111, 2024-08-20T05:19:11.170 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2024-08-20T05:19:11.170 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2024-08-20T05:19:11.170 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 1111, 2024-08-20T05:19:11.170 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-08-20T05:19:11.171 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2024-08-20T05:19:11.171 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 3, 2024-08-20T05:19:11.171 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2024-08-20T05:19:11.171 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2024-08-20T05:19:11.171 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 3, 2024-08-20T05:19:11.171 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 2, 2024-08-20T05:19:11.171 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-08-20T05:19:11.171 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2024-08-20T05:19:11.171 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2024-08-20T05:19:11.171 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 6627953, 2024-08-20T05:19:11.171 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 0, 2024-08-20T05:19:11.171 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-08-20T05:19:11.171 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 860, 2024-08-20T05:19:11.172 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 8.896669929, 2024-08-20T05:19:11.172 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.010344965 2024-08-20T05:19:11.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.172 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 0 2024-08-20T05:19:11.172 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.172 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-08-20T05:19:11.172 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 463, 2024-08-20T05:19:11.172 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 644, 2024-08-20T05:19:11.172 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 181, 2024-08-20T05:19:11.172 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 57, 2024-08-20T05:19:11.172 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 66, 2024-08-20T05:19:11.172 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 9, 2024-08-20T05:19:11.173 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 482, 2024-08-20T05:19:11.173 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 684, 2024-08-20T05:19:11.173 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 202, 2024-08-20T05:19:11.173 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 396, 2024-08-20T05:19:11.173 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 722, 2024-08-20T05:19:11.173 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 326, 2024-08-20T05:19:11.173 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 61380, 2024-08-20T05:19:11.173 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 269340672 2024-08-20T05:19:11.173 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.173 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-08-20T05:19:11.173 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 833, 2024-08-20T05:19:11.173 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 37, 2024-08-20T05:19:11.173 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 808, 2024-08-20T05:19:11.174 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 121, 2024-08-20T05:19:11.174 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 74, 2024-08-20T05:19:11.174 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-08-20T05:19:11.174 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 17, 2024-08-20T05:19:11.174 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 21.219472427, 2024-08-20T05:19:11.174 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 1.248204260 2024-08-20T05:19:11.174 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.174 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-08-20T05:19:11.174 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 153, 2024-08-20T05:19:11.174 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 5.369132444, 2024-08-20T05:19:11.174 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.035092368 2024-08-20T05:19:11.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.175 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-08-20T05:19:11.175 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.175 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.175 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.175 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-08-20T05:19:11.175 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.175 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.175 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.175 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.175 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-08-20T05:19:11.176 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 362, 2024-08-20T05:19:11.176 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.028383333, 2024-08-20T05:19:11.176 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.002840837 2024-08-20T05:19:11.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.176 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-08-20T05:19:11.176 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.176 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.176 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.176 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.176 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-08-20T05:19:11.176 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.176 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.177 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.178 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-08-20T05:19:11.178 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.178 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.178 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.178 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.178 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-08-20T05:19:11.178 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.178 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.179 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.179 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-08-20T05:19:11.179 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.179 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.179 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.179 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.179 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-08-20T05:19:11.180 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.180 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.180 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.180 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.180 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-08-20T05:19:11.180 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.180 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.181 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.181 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.181 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-08-20T05:19:11.181 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.181 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.181 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.181 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.181 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-08-20T05:19:11.181 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.181 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.181 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.182 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-08-20T05:19:11.182 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 124, 2024-08-20T05:19:11.182 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.086240630, 2024-08-20T05:19:11.182 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000695488 2024-08-20T05:19:11.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.182 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-08-20T05:19:11.182 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 28, 2024-08-20T05:19:11.182 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.055596820, 2024-08-20T05:19:11.182 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001985600 2024-08-20T05:19:11.182 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.183 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-08-20T05:19:11.183 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 7, 2024-08-20T05:19:11.183 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.011567392, 2024-08-20T05:19:11.183 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001652484 2024-08-20T05:19:11.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.183 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-08-20T05:19:11.183 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.183 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.183 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.183 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.183 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-08-20T05:19:11.184 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.184 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.184 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.184 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-08-20T05:19:11.184 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.184 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.184 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.184 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.184 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-08-20T05:19:11.184 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.184 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.185 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.185 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-08-20T05:19:11.185 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.185 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.185 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.185 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.185 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-08-20T05:19:11.185 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.185 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.185 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.186 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-08-20T05:19:11.186 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.186 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.186 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.186 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.186 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-08-20T05:19:11.186 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.186 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.186 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.187 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-08-20T05:19:11.187 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.187 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.187 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.187 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-08-20T05:19:11.187 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.187 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.187 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.187 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.187 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-08-20T05:19:11.188 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.188 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.188 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.188 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-08-20T05:19:11.188 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 13, 2024-08-20T05:19:11.188 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.022816154, 2024-08-20T05:19:11.188 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001755088 2024-08-20T05:19:11.188 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.188 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-08-20T05:19:11.188 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-08-20T05:19:11.188 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-08-20T05:19:11.189 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.189 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.189 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.189 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:11.189 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.189 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-08-20T05:19:11.189 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 1, 2024-08-20T05:19:11.189 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 2, 2024-08-20T05:19:11.189 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 1, 2024-08-20T05:19:11.189 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 1, 2024-08-20T05:19:11.189 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-08-20T05:19:11.189 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 111, 2024-08-20T05:19:11.190 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 111, 2024-08-20T05:19:11.190 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 2303, 2024-08-20T05:19:11.190 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-08-20T05:19:11.190 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.190 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-08-20T05:19:11.190 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-08-20T05:19:11.190 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-08-20T05:19:11.190 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T05:19:11.190 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-08-20T05:19:11.190 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T05:19:11.190 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-08-20T05:19:11.190 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T05:19:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T05:19:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T05:19:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T05:19:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T05:19:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-08-20T05:19:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T05:19:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T05:19:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-08-20T05:19:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-08-20T05:19:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-08-20T05:19:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-08-20T05:19:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T05:19:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T05:19:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T05:19:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T05:19:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T05:19:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-08-20T05:19:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-08-20T05:19:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-08-20T05:19:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T05:19:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T05:19:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-08-20T05:19:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-08-20T05:19:11.192 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-08-20T05:19:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-08-20T05:19:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T05:19:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-08-20T05:19:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T05:19:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-08-20T05:19:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 303981, 2024-08-20T05:19:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 545, 2024-08-20T05:19:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 88, 2024-08-20T05:19:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 1, 2024-08-20T05:19:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-08-20T05:19:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-08-20T05:19:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-08-20T05:19:11.193 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-08-20T05:19:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-08-20T05:19:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-08-20T05:19:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 8864, 2024-08-20T05:19:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 167, 2024-08-20T05:19:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T05:19:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-08-20T05:19:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-08-20T05:19:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-08-20T05:19:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 1641125, 2024-08-20T05:19:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 17691, 2024-08-20T05:19:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-08-20T05:19:11.194 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-08-20T05:19:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-08-20T05:19:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-08-20T05:19:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-08-20T05:19:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-08-20T05:19:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-08-20T05:19:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 6703, 2024-08-20T05:19:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 2521805, 2024-08-20T05:19:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 30, 2024-08-20T05:19:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 6703, 2024-08-20T05:19:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-08-20T05:19:11.195 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 6703, 2024-08-20T05:19:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 63.184689949, 2024-08-20T05:19:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.009426329 2024-08-20T05:19:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-08-20T05:19:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-08-20T05:19:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 6703, 2024-08-20T05:19:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 6853 2024-08-20T05:19:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 6703, 2024-08-20T05:19:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 5593, 2024-08-20T05:19:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 1110, 2024-08-20T05:19:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-08-20T05:19:11.196 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-08-20T05:19:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 0, 2024-08-20T05:19:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 10, 2024-08-20T05:19:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 9, 2024-08-20T05:19:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 869, 2024-08-20T05:19:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 69, 2024-08-20T05:19:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-08-20T05:19:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-08-20T05:19:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-08-20T05:19:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-08-20T05:19:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 46, 2024-08-20T05:19:11.197 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-08-20T05:19:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-08-20T05:19:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-08-20T05:19:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 5579, 2024-08-20T05:19:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 20, 2024-08-20T05:19:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-08-20T05:19:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-08-20T05:19:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-08-20T05:19:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-08-20T05:19:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-08-20T05:19:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-08-20T05:19:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T05:19:11.198 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-08-20T05:19:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-08-20T05:19:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-08-20T05:19:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-08-20T05:19:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-08-20T05:19:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-08-20T05:19:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-08-20T05:19:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-08-20T05:19:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-08-20T05:19:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-08-20T05:19:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-08-20T05:19:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-08-20T05:19:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-08-20T05:19:11.199 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-08-20T05:19:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-08-20T05:19:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-08-20T05:19:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-08-20T05:19:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-08-20T05:19:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-08-20T05:19:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 88, 2024-08-20T05:19:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-08-20T05:19:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 4, 2024-08-20T05:19:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 12, 2024-08-20T05:19:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 12, 2024-08-20T05:19:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-08-20T05:19:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-08-20T05:19:11.200 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 184, 2024-08-20T05:19:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 20, 2024-08-20T05:19:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 47 2024-08-20T05:19:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-08-20T05:19:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 1, 2024-08-20T05:19:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-08-20T05:19:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-08-20T05:19:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-08-20T05:19:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-08-20T05:19:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-08-20T05:19:11.201 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 10, 2024-08-20T05:19:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-08-20T05:19:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 5, 2024-08-20T05:19:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed_ops": 34, 2024-08-20T05:19:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 17, 2024-08-20T05:19:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-08-20T05:19:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T05:19:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-08-20T05:19:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:11.202 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 13856, 2024-08-20T05:19:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 6099041, 2024-08-20T05:19:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 13856, 2024-08-20T05:19:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-08-20T05:19:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-08-20T05:19:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 13856, 2024-08-20T05:19:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 6099041, 2024-08-20T05:19:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.203 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-08-20T05:19:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-08-20T05:19:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-08-20T05:19:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-08-20T05:19:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 6703, 2024-08-20T05:19:11.204 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 2523510, 2024-08-20T05:19:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 6703, 2024-08-20T05:19:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 2523510, 2024-08-20T05:19:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-08-20T05:19:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-08-20T05:19:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-08-20T05:19:11.205 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-08-20T05:19:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 6703, 2024-08-20T05:19:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 6703, 2024-08-20T05:19:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 6703, 2024-08-20T05:19:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 6703, 2024-08-20T05:19:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.206 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-08-20T05:19:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-08-20T05:19:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 17, 2024-08-20T05:19:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 1853, 2024-08-20T05:19:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 17, 2024-08-20T05:19:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-08-20T05:19:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-08-20T05:19:11.207 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 9, 2024-08-20T05:19:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1853, 2024-08-20T05:19:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x55573a2b06e0": { 2024-08-20T05:19:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-08-20T05:19:11.208 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 1111, 2024-08-20T05:19:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 2433649, 2024-08-20T05:19:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 1111, 2024-08-20T05:19:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-08-20T05:19:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-08-20T05:19:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 860, 2024-08-20T05:19:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 2433649, 2024-08-20T05:19:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:11.209 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:11.210 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:11.210 INFO:teuthology.orchestra.run.smithi135.stdout: "trackedop": { 2024-08-20T05:19:11.210 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 4299 2024-08-20T05:19:11.210 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:11.210 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-08-20T05:19:11.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:11 smithi130 ceph-mon[22007]: pgmap v909: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:19:12.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:11 smithi037 ceph-mon[17265]: pgmap v909: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:19:12.024 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:11 smithi135 ceph-mon[22342]: pgmap v909: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:19:12.062 INFO:tasks.check_counter:Daemon mds.c mds.exported=3 2024-08-20T05:19:12.062 INFO:tasks.check_counter:Daemon mds.c mds.imported=13 2024-08-20T05:19:12.062 DEBUG:tasks.check_counter:Getting stats from f 2024-08-20T05:19:12.062 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph daemon mds.f perf dump 2024-08-20T05:19:12.309 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T05:19:12.813 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-08-20T05:19:12.814 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T05:19:12.814 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 6577, 2024-08-20T05:19:12.814 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 7849, 2024-08-20T05:19:12.814 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 2373204, 2024-08-20T05:19:12.814 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 4809905, 2024-08-20T05:19:12.814 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 11, 2024-08-20T05:19:12.814 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2024-08-20T05:19:12.814 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.572037963, 2024-08-20T05:19:12.814 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.248925630, 2024-08-20T05:19:12.814 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.243278023, 2024-08-20T05:19:12.814 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.095856834, 2024-08-20T05:19:12.815 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:12.815 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 7847, 2024-08-20T05:19:12.815 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.453921023, 2024-08-20T05:19:12.815 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000057846 2024-08-20T05:19:12.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.815 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:12.815 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 9875, 2024-08-20T05:19:12.815 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.001822595, 2024-08-20T05:19:12.815 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000184 2024-08-20T05:19:12.815 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.815 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T05:19:12.815 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T05:19:12.816 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.816 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T05:19:12.816 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 3725, 2024-08-20T05:19:12.816 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 4850, 2024-08-20T05:19:12.816 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 1808619, 2024-08-20T05:19:12.816 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 2837501, 2024-08-20T05:19:12.816 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 21, 2024-08-20T05:19:12.816 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 8, 2024-08-20T05:19:12.816 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.337927284, 2024-08-20T05:19:12.816 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.163795009, 2024-08-20T05:19:12.816 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.133237721, 2024-08-20T05:19:12.816 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.046042746, 2024-08-20T05:19:12.817 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:12.817 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4846, 2024-08-20T05:19:12.817 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.396826887, 2024-08-20T05:19:12.817 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000081887 2024-08-20T05:19:12.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.817 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:12.817 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3089, 2024-08-20T05:19:12.817 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000530595, 2024-08-20T05:19:12.817 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000171 2024-08-20T05:19:12.817 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.817 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 657104, 2024-08-20T05:19:12.818 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 2055376 2024-08-20T05:19:12.818 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.818 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T05:19:12.818 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 1920, 2024-08-20T05:19:12.818 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1885, 2024-08-20T05:19:12.818 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 1752108, 2024-08-20T05:19:12.818 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 1372340, 2024-08-20T05:19:12.818 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 37, 2024-08-20T05:19:12.818 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2024-08-20T05:19:12.818 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.191443034, 2024-08-20T05:19:12.818 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.086883801, 2024-08-20T05:19:12.818 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.075800267, 2024-08-20T05:19:12.819 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.028512685, 2024-08-20T05:19:12.819 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:12.819 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1887, 2024-08-20T05:19:12.819 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.117896431, 2024-08-20T05:19:12.819 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000062478 2024-08-20T05:19:12.819 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.819 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:12.819 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 354, 2024-08-20T05:19:12.819 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000073697, 2024-08-20T05:19:12.819 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000208 2024-08-20T05:19:12.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.820 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 777200, 2024-08-20T05:19:12.820 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 225456 2024-08-20T05:19:12.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.820 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-08-20T05:19:12.820 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-08-20T05:19:12.820 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-08-20T05:19:12.820 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.820 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-08-20T05:19:12.821 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-08-20T05:19:12.821 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-08-20T05:19:12.821 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4165, 2024-08-20T05:19:12.821 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.083527393, 2024-08-20T05:19:12.821 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000260150 2024-08-20T05:19:12.821 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:12.821 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.821 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-08-20T05:19:12.821 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-08-20T05:19:12.821 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-08-20T05:19:12.821 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 975, 2024-08-20T05:19:12.822 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.034569813, 2024-08-20T05:19:12.822 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000035456 2024-08-20T05:19:12.822 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:12.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.822 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-08-20T05:19:12.822 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 633, 2024-08-20T05:19:12.822 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 633, 2024-08-20T05:19:12.822 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-08-20T05:19:12.822 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 633, 2024-08-20T05:19:12.822 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 125.392893793, 2024-08-20T05:19:12.822 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.198093039 2024-08-20T05:19:12.822 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.823 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-08-20T05:19:12.823 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2024-08-20T05:19:12.823 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2024-08-20T05:19:12.823 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2024-08-20T05:19:12.823 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 11, 2024-08-20T05:19:12.823 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2024-08-20T05:19:12.823 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-08-20T05:19:12.823 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 257, 2024-08-20T05:19:12.823 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 0, 2024-08-20T05:19:12.823 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 0, 2024-08-20T05:19:12.823 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 257, 2024-08-20T05:19:12.823 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 257, 2024-08-20T05:19:12.824 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 6, 2024-08-20T05:19:12.824 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 241, 2024-08-20T05:19:12.824 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 241, 2024-08-20T05:19:12.824 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 9, 2024-08-20T05:19:12.824 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 1687, 2024-08-20T05:19:12.824 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 1451, 2024-08-20T05:19:12.824 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2024-08-20T05:19:12.824 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 4, 2024-08-20T05:19:12.824 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-08-20T05:19:12.824 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-08-20T05:19:12.824 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 54, 2024-08-20T05:19:12.825 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 1240, 2024-08-20T05:19:12.825 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 1, 2024-08-20T05:19:12.825 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 1, 2024-08-20T05:19:12.825 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 6, 2024-08-20T05:19:12.825 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 7, 2024-08-20T05:19:12.825 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 243, 2024-08-20T05:19:12.825 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-08-20T05:19:12.825 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 3598, 2024-08-20T05:19:12.825 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-08-20T05:19:12.825 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 1020, 2024-08-20T05:19:12.825 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 1528108595, 2024-08-20T05:19:12.825 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2024-08-20T05:19:12.826 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 3598, 2024-08-20T05:19:12.826 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-08-20T05:19:12.826 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T05:19:12.826 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-08-20T05:19:12.826 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2024-08-20T05:19:12.826 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T05:19:12.826 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2024-08-20T05:19:12.826 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 3598, 2024-08-20T05:19:12.826 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 136, 2024-08-20T05:19:12.826 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 517, 2024-08-20T05:19:12.826 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 572, 2024-08-20T05:19:12.826 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T05:19:12.826 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T05:19:12.827 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T05:19:12.827 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 916, 2024-08-20T05:19:12.827 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 187, 2024-08-20T05:19:12.827 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 98, 2024-08-20T05:19:12.827 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 718 2024-08-20T05:19:12.827 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.827 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-08-20T05:19:12.827 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2024-08-20T05:19:12.827 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2024-08-20T05:19:12.827 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2024-08-20T05:19:12.827 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 4, 2024-08-20T05:19:12.827 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 120, 2024-08-20T05:19:12.827 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2024-08-20T05:19:12.828 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-08-20T05:19:12.828 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-08-20T05:19:12.828 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 187, 2024-08-20T05:19:12.828 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 187, 2024-08-20T05:19:12.828 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-08-20T05:19:12.828 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-08-20T05:19:12.828 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-08-20T05:19:12.828 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-08-20T05:19:12.828 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-08-20T05:19:12.828 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-08-20T05:19:12.828 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-08-20T05:19:12.828 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_path": 15, 2024-08-20T05:19:12.829 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_inode": 3757, 2024-08-20T05:19:12.829 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T05:19:12.829 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 1, 2024-08-20T05:19:12.829 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-08-20T05:19:12.829 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2024-08-20T05:19:12.829 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-08-20T05:19:12.829 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2024-08-20T05:19:12.829 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.829 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-08-20T05:19:12.829 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2024-08-20T05:19:12.829 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 1434, 2024-08-20T05:19:12.829 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2024-08-20T05:19:12.829 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2024-08-20T05:19:12.830 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 1434, 2024-08-20T05:19:12.830 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-08-20T05:19:12.830 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2024-08-20T05:19:12.830 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 3, 2024-08-20T05:19:12.830 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2024-08-20T05:19:12.830 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2024-08-20T05:19:12.830 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 3, 2024-08-20T05:19:12.830 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 2, 2024-08-20T05:19:12.830 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-08-20T05:19:12.830 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2024-08-20T05:19:12.830 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2024-08-20T05:19:12.830 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 6170601, 2024-08-20T05:19:12.831 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 0, 2024-08-20T05:19:12.831 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-08-20T05:19:12.831 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 653, 2024-08-20T05:19:12.831 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 9.847029023, 2024-08-20T05:19:12.831 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.015079676 2024-08-20T05:19:12.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.831 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 0 2024-08-20T05:19:12.831 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.831 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-08-20T05:19:12.831 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 260, 2024-08-20T05:19:12.831 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 447, 2024-08-20T05:19:12.831 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 187, 2024-08-20T05:19:12.831 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 26, 2024-08-20T05:19:12.832 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 27, 2024-08-20T05:19:12.832 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 1, 2024-08-20T05:19:12.832 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 257, 2024-08-20T05:19:12.832 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 450, 2024-08-20T05:19:12.832 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 193, 2024-08-20T05:19:12.832 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 241, 2024-08-20T05:19:12.832 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 685, 2024-08-20T05:19:12.832 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 444, 2024-08-20T05:19:12.832 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 60176, 2024-08-20T05:19:12.832 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 267186176 2024-08-20T05:19:12.832 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.832 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-08-20T05:19:12.832 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 1945, 2024-08-20T05:19:12.833 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 82, 2024-08-20T05:19:12.833 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 633, 2024-08-20T05:19:12.833 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 14, 2024-08-20T05:19:12.833 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 560, 2024-08-20T05:19:12.833 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-08-20T05:19:12.833 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 184, 2024-08-20T05:19:12.833 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 63.726399340, 2024-08-20T05:19:12.833 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.346339126 2024-08-20T05:19:12.833 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.833 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-08-20T05:19:12.833 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 35, 2024-08-20T05:19:12.833 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.447985544, 2024-08-20T05:19:12.833 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.012799586 2024-08-20T05:19:12.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.834 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-08-20T05:19:12.834 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.834 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.834 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.834 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-08-20T05:19:12.834 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.834 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.834 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.834 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.834 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-08-20T05:19:12.834 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 135, 2024-08-20T05:19:12.835 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 58.605543658, 2024-08-20T05:19:12.835 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.434115138 2024-08-20T05:19:12.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.835 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-08-20T05:19:12.835 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.835 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.835 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.835 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-08-20T05:19:12.835 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1, 2024-08-20T05:19:12.835 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000255444, 2024-08-20T05:19:12.835 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000255444 2024-08-20T05:19:12.835 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.836 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-08-20T05:19:12.836 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.836 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.836 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.836 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-08-20T05:19:12.836 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.836 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.836 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.836 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.836 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-08-20T05:19:12.836 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.836 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.837 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.837 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.837 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-08-20T05:19:12.837 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.838 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.838 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.838 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-08-20T05:19:12.838 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.838 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.838 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.838 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.838 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-08-20T05:19:12.839 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.839 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.839 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.839 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-08-20T05:19:12.839 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.839 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.839 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.839 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.839 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-08-20T05:19:12.839 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 85, 2024-08-20T05:19:12.839 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.045915336, 2024-08-20T05:19:12.840 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000540180 2024-08-20T05:19:12.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.840 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-08-20T05:19:12.840 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 6, 2024-08-20T05:19:12.840 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.004412714, 2024-08-20T05:19:12.840 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000735452 2024-08-20T05:19:12.840 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.840 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-08-20T05:19:12.840 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 184, 2024-08-20T05:19:12.841 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 2.524791355, 2024-08-20T05:19:12.841 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.013721692 2024-08-20T05:19:12.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.841 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-08-20T05:19:12.841 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.841 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.841 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.841 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.841 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-08-20T05:19:12.841 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.841 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.842 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.842 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-08-20T05:19:12.842 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.842 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.842 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.842 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-08-20T05:19:12.842 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.842 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.842 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.842 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.842 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-08-20T05:19:12.843 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.843 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.843 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.843 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-08-20T05:19:12.843 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.843 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.843 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.843 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.843 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-08-20T05:19:12.843 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.843 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.844 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.844 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-08-20T05:19:12.844 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.844 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.844 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.844 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-08-20T05:19:12.844 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.844 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.844 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.844 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.844 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-08-20T05:19:12.845 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.845 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.845 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.845 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-08-20T05:19:12.845 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.845 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.845 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.845 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.845 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-08-20T05:19:12.845 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3, 2024-08-20T05:19:12.845 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.037590402, 2024-08-20T05:19:12.846 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.012530134 2024-08-20T05:19:12.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.846 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-08-20T05:19:12.846 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-08-20T05:19:12.846 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-08-20T05:19:12.846 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.846 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.846 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.846 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:12.846 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.846 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-08-20T05:19:12.846 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 1, 2024-08-20T05:19:12.847 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 1, 2024-08-20T05:19:12.847 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 0, 2024-08-20T05:19:12.847 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 1, 2024-08-20T05:19:12.847 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-08-20T05:19:12.847 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 67, 2024-08-20T05:19:12.847 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 67, 2024-08-20T05:19:12.847 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 995, 2024-08-20T05:19:12.847 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-08-20T05:19:12.847 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.847 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-08-20T05:19:12.847 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-08-20T05:19:12.847 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-08-20T05:19:12.847 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T05:19:12.848 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-08-20T05:19:12.848 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T05:19:12.848 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-08-20T05:19:12.848 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T05:19:12.848 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T05:19:12.848 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T05:19:12.848 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T05:19:12.848 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T05:19:12.848 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-08-20T05:19:12.848 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T05:19:12.848 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T05:19:12.849 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-08-20T05:19:12.849 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-08-20T05:19:12.849 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-08-20T05:19:12.849 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-08-20T05:19:12.849 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T05:19:12.849 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T05:19:12.849 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T05:19:12.849 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T05:19:12.849 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T05:19:12.849 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-08-20T05:19:12.849 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-08-20T05:19:12.850 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-08-20T05:19:12.850 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T05:19:12.850 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T05:19:12.850 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-08-20T05:19:12.850 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-08-20T05:19:12.850 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-08-20T05:19:12.850 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-08-20T05:19:12.850 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T05:19:12.850 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-08-20T05:19:12.850 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T05:19:12.850 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-08-20T05:19:12.850 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 313014, 2024-08-20T05:19:12.851 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 348, 2024-08-20T05:19:12.851 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-08-20T05:19:12.851 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-08-20T05:19:12.851 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-08-20T05:19:12.851 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-08-20T05:19:12.851 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-08-20T05:19:12.851 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-08-20T05:19:12.851 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-08-20T05:19:12.851 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-08-20T05:19:12.851 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 8864, 2024-08-20T05:19:12.851 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 167, 2024-08-20T05:19:12.852 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T05:19:12.852 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-08-20T05:19:12.852 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-08-20T05:19:12.852 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-08-20T05:19:12.852 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 913376, 2024-08-20T05:19:12.852 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 10572, 2024-08-20T05:19:12.852 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-08-20T05:19:12.852 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-08-20T05:19:12.852 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-08-20T05:19:12.852 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-08-20T05:19:12.852 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.852 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-08-20T05:19:12.853 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-08-20T05:19:12.853 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-08-20T05:19:12.853 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 5221, 2024-08-20T05:19:12.853 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 2096295, 2024-08-20T05:19:12.853 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 33, 2024-08-20T05:19:12.853 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 5221, 2024-08-20T05:19:12.853 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-08-20T05:19:12.853 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 5221, 2024-08-20T05:19:12.853 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 35.201262128, 2024-08-20T05:19:12.853 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.006742245 2024-08-20T05:19:12.853 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.853 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-08-20T05:19:12.854 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-08-20T05:19:12.854 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 5221, 2024-08-20T05:19:12.854 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 5415 2024-08-20T05:19:12.854 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.854 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 5221, 2024-08-20T05:19:12.854 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 3734, 2024-08-20T05:19:12.854 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 1487, 2024-08-20T05:19:12.854 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-08-20T05:19:12.854 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-08-20T05:19:12.854 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 0, 2024-08-20T05:19:12.854 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 10, 2024-08-20T05:19:12.854 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 136, 2024-08-20T05:19:12.855 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 789, 2024-08-20T05:19:12.855 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 152, 2024-08-20T05:19:12.855 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-08-20T05:19:12.855 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-08-20T05:19:12.855 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-08-20T05:19:12.855 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-08-20T05:19:12.855 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 386, 2024-08-20T05:19:12.855 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-08-20T05:19:12.855 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-08-20T05:19:12.855 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-08-20T05:19:12.855 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 3598, 2024-08-20T05:19:12.855 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 20, 2024-08-20T05:19:12.856 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-08-20T05:19:12.856 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-08-20T05:19:12.856 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-08-20T05:19:12.856 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-08-20T05:19:12.856 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-08-20T05:19:12.856 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-08-20T05:19:12.856 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T05:19:12.856 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-08-20T05:19:12.856 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-08-20T05:19:12.856 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-08-20T05:19:12.856 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-08-20T05:19:12.856 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-08-20T05:19:12.856 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-08-20T05:19:12.857 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-08-20T05:19:12.857 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-08-20T05:19:12.857 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-08-20T05:19:12.857 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-08-20T05:19:12.857 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-08-20T05:19:12.857 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-08-20T05:19:12.857 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-08-20T05:19:12.857 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-08-20T05:19:12.857 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-08-20T05:19:12.857 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-08-20T05:19:12.857 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-08-20T05:19:12.857 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-08-20T05:19:12.857 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-08-20T05:19:12.858 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 88, 2024-08-20T05:19:12.858 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-08-20T05:19:12.858 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 4, 2024-08-20T05:19:12.858 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 12, 2024-08-20T05:19:12.858 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 12, 2024-08-20T05:19:12.858 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-08-20T05:19:12.858 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-08-20T05:19:12.858 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 227, 2024-08-20T05:19:12.858 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 0, 2024-08-20T05:19:12.858 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 97 2024-08-20T05:19:12.858 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.858 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-08-20T05:19:12.858 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 1, 2024-08-20T05:19:12.859 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-08-20T05:19:12.859 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-08-20T05:19:12.859 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-08-20T05:19:12.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.859 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-08-20T05:19:12.859 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-08-20T05:19:12.859 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 10, 2024-08-20T05:19:12.859 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-08-20T05:19:12.859 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 5, 2024-08-20T05:19:12.859 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed_ops": 374, 2024-08-20T05:19:12.859 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 187, 2024-08-20T05:19:12.859 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-08-20T05:19:12.859 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.860 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T05:19:12.860 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:12.860 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-08-20T05:19:12.860 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:12.860 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 12218, 2024-08-20T05:19:12.860 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 4735086, 2024-08-20T05:19:12.860 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:12.860 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 12218, 2024-08-20T05:19:12.860 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-08-20T05:19:12.860 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-08-20T05:19:12.860 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 12218, 2024-08-20T05:19:12.860 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 4735086, 2024-08-20T05:19:12.861 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:12.861 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.861 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.861 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.861 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:12.861 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.861 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-08-20T05:19:12.861 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:12.861 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-08-20T05:19:12.862 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:12.862 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-08-20T05:19:12.862 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-08-20T05:19:12.862 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:12.862 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:12.862 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 5221, 2024-08-20T05:19:12.862 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 2116678, 2024-08-20T05:19:12.862 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 5221, 2024-08-20T05:19:12.862 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 2116678, 2024-08-20T05:19:12.862 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:12.862 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.863 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.863 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.863 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:12.863 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.863 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-08-20T05:19:12.863 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:12.863 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-08-20T05:19:12.863 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:12.863 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-08-20T05:19:12.863 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-08-20T05:19:12.864 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:12.864 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:12.864 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 5221, 2024-08-20T05:19:12.864 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 5221, 2024-08-20T05:19:12.864 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 5221, 2024-08-20T05:19:12.864 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 5221, 2024-08-20T05:19:12.864 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:12.864 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.864 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.864 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.864 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:12.865 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.865 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-08-20T05:19:12.865 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:12.865 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-08-20T05:19:12.865 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:12.865 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 187, 2024-08-20T05:19:12.865 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 20383, 2024-08-20T05:19:12.865 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:12.865 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 187, 2024-08-20T05:19:12.865 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-08-20T05:19:12.865 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-08-20T05:19:12.865 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 136, 2024-08-20T05:19:12.865 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 20383, 2024-08-20T05:19:12.866 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:12.866 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.866 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.866 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.866 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:12.866 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.866 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x56203c31e6e0": { 2024-08-20T05:19:12.866 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:12.866 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-08-20T05:19:12.866 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:12.866 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 1434, 2024-08-20T05:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 1976297, 2024-08-20T05:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 1434, 2024-08-20T05:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-08-20T05:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-08-20T05:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 653, 2024-08-20T05:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 1976297, 2024-08-20T05:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:12.867 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:12.868 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:12.868 INFO:teuthology.orchestra.run.smithi135.stdout: "trackedop": { 2024-08-20T05:19:12.868 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 2776 2024-08-20T05:19:12.868 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:12.868 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-08-20T05:19:13.589 INFO:tasks.check_counter:Daemon mds.f mds.exported=1 2024-08-20T05:19:13.590 INFO:tasks.check_counter:Daemon mds.f mds.imported=7 2024-08-20T05:19:13.590 DEBUG:tasks.check_counter:Getting stats from i 2024-08-20T05:19:13.590 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph daemon mds.i perf dump 2024-08-20T05:19:13.838 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T05:19:13.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:13 smithi135 ceph-mon[22342]: pgmap v910: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-20T05:19:13.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:13 smithi130 ceph-mon[22007]: pgmap v910: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-20T05:19:13.987 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:13 smithi037 ceph-mon[17265]: pgmap v910: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-20T05:19:14.407 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-08-20T05:19:14.408 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T05:19:14.408 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 5523, 2024-08-20T05:19:14.408 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 5486, 2024-08-20T05:19:14.408 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 1962664, 2024-08-20T05:19:14.408 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 4485926, 2024-08-20T05:19:14.408 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 11, 2024-08-20T05:19:14.408 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 5, 2024-08-20T05:19:14.408 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.469193796, 2024-08-20T05:19:14.408 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.222557299, 2024-08-20T05:19:14.408 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.199216606, 2024-08-20T05:19:14.409 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.052673024, 2024-08-20T05:19:14.409 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:14.409 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 5484, 2024-08-20T05:19:14.409 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.369141433, 2024-08-20T05:19:14.409 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000067312 2024-08-20T05:19:14.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.409 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:14.409 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 7166, 2024-08-20T05:19:14.409 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.001359151, 2024-08-20T05:19:14.409 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000189 2024-08-20T05:19:14.409 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.409 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T05:19:14.410 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T05:19:14.410 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.410 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T05:19:14.410 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 3806, 2024-08-20T05:19:14.410 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 4907, 2024-08-20T05:19:14.410 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 2092403, 2024-08-20T05:19:14.410 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 2755855, 2024-08-20T05:19:14.410 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 16, 2024-08-20T05:19:14.410 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 7, 2024-08-20T05:19:14.410 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.381107374, 2024-08-20T05:19:14.410 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.210993824, 2024-08-20T05:19:14.411 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.210529627, 2024-08-20T05:19:14.411 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.005375820, 2024-08-20T05:19:14.411 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:14.411 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 4906, 2024-08-20T05:19:14.411 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.324009792, 2024-08-20T05:19:14.411 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000066043 2024-08-20T05:19:14.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.411 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:14.411 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 5480, 2024-08-20T05:19:14.411 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000939345, 2024-08-20T05:19:14.411 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000171 2024-08-20T05:19:14.411 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.412 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 1863296, 2024-08-20T05:19:14.412 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 2454896 2024-08-20T05:19:14.412 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.412 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T05:19:14.412 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 1159, 2024-08-20T05:19:14.412 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 1404, 2024-08-20T05:19:14.412 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 509628, 2024-08-20T05:19:14.412 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 1436326, 2024-08-20T05:19:14.412 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 41, 2024-08-20T05:19:14.412 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 10, 2024-08-20T05:19:14.412 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.129453525, 2024-08-20T05:19:14.412 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.055213750, 2024-08-20T05:19:14.413 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.036590506, 2024-08-20T05:19:14.413 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.025969598, 2024-08-20T05:19:14.413 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:14.413 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1403, 2024-08-20T05:19:14.413 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.097138897, 2024-08-20T05:19:14.413 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000069236 2024-08-20T05:19:14.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.413 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:14.413 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 204, 2024-08-20T05:19:14.413 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000093026, 2024-08-20T05:19:14.413 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000456 2024-08-20T05:19:14.413 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.413 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-08-20T05:19:14.414 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 506544 2024-08-20T05:19:14.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.414 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-08-20T05:19:14.414 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-08-20T05:19:14.414 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-08-20T05:19:14.414 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.414 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-08-20T05:19:14.414 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-08-20T05:19:14.414 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-08-20T05:19:14.414 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3485, 2024-08-20T05:19:14.414 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 1.162405940, 2024-08-20T05:19:14.414 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000333545 2024-08-20T05:19:14.414 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:14.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.415 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-08-20T05:19:14.415 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-08-20T05:19:14.415 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-08-20T05:19:14.415 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 25, 2024-08-20T05:19:14.415 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000599376, 2024-08-20T05:19:14.415 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000023975 2024-08-20T05:19:14.415 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:14.415 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.415 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-08-20T05:19:14.415 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 1301, 2024-08-20T05:19:14.415 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 1287, 2024-08-20T05:19:14.415 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-08-20T05:19:14.416 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1287, 2024-08-20T05:19:14.416 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 18.373112165, 2024-08-20T05:19:14.416 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.014275922 2024-08-20T05:19:14.416 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.416 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-08-20T05:19:14.416 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 14, 2024-08-20T05:19:14.416 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 2, 2024-08-20T05:19:14.416 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 1, 2024-08-20T05:19:14.416 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 11, 2024-08-20T05:19:14.416 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2024-08-20T05:19:14.416 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-08-20T05:19:14.416 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 309, 2024-08-20T05:19:14.417 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 0, 2024-08-20T05:19:14.417 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 114, 2024-08-20T05:19:14.417 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 195, 2024-08-20T05:19:14.417 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 309, 2024-08-20T05:19:14.417 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 181, 2024-08-20T05:19:14.417 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 61, 2024-08-20T05:19:14.417 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 61, 2024-08-20T05:19:14.417 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 6, 2024-08-20T05:19:14.417 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 3020, 2024-08-20T05:19:14.417 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 2349, 2024-08-20T05:19:14.417 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 14, 2024-08-20T05:19:14.417 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 6, 2024-08-20T05:19:14.417 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-08-20T05:19:14.417 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-08-20T05:19:14.418 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 199, 2024-08-20T05:19:14.418 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 1129, 2024-08-20T05:19:14.418 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 1, 2024-08-20T05:19:14.418 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 6, 2024-08-20T05:19:14.418 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 175, 2024-08-20T05:19:14.418 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 7, 2024-08-20T05:19:14.418 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 200, 2024-08-20T05:19:14.418 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-08-20T05:19:14.418 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 1661, 2024-08-20T05:19:14.418 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-08-20T05:19:14.418 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 1020, 2024-08-20T05:19:14.418 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 1528108595, 2024-08-20T05:19:14.418 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2024-08-20T05:19:14.419 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 1661, 2024-08-20T05:19:14.419 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-08-20T05:19:14.419 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T05:19:14.419 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-08-20T05:19:14.419 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 33, 2024-08-20T05:19:14.419 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T05:19:14.419 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 33, 2024-08-20T05:19:14.419 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 1628, 2024-08-20T05:19:14.419 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 5, 2024-08-20T05:19:14.419 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 789, 2024-08-20T05:19:14.419 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 1127, 2024-08-20T05:19:14.419 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T05:19:14.420 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T05:19:14.420 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T05:19:14.420 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 1345, 2024-08-20T05:19:14.420 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 422, 2024-08-20T05:19:14.420 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 70, 2024-08-20T05:19:14.420 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 545 2024-08-20T05:19:14.420 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.420 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-08-20T05:19:14.420 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2024-08-20T05:19:14.420 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2024-08-20T05:19:14.420 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2024-08-20T05:19:14.420 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 6, 2024-08-20T05:19:14.420 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 28, 2024-08-20T05:19:14.420 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2024-08-20T05:19:14.421 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-08-20T05:19:14.421 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-08-20T05:19:14.421 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 127, 2024-08-20T05:19:14.421 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 2, 2024-08-20T05:19:14.421 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 125, 2024-08-20T05:19:14.421 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-08-20T05:19:14.421 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-08-20T05:19:14.421 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-08-20T05:19:14.421 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-08-20T05:19:14.421 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-08-20T05:19:14.421 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-08-20T05:19:14.421 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_path": 15, 2024-08-20T05:19:14.422 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_inode": 1916, 2024-08-20T05:19:14.422 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T05:19:14.422 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 6, 2024-08-20T05:19:14.422 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-08-20T05:19:14.422 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2024-08-20T05:19:14.422 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-08-20T05:19:14.422 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2024-08-20T05:19:14.422 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.422 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-08-20T05:19:14.422 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2024-08-20T05:19:14.422 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 1537, 2024-08-20T05:19:14.422 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2024-08-20T05:19:14.422 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2024-08-20T05:19:14.423 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 1537, 2024-08-20T05:19:14.423 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-08-20T05:19:14.423 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2024-08-20T05:19:14.423 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 3, 2024-08-20T05:19:14.423 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2024-08-20T05:19:14.423 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2024-08-20T05:19:14.423 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 3, 2024-08-20T05:19:14.423 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 2, 2024-08-20T05:19:14.423 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-08-20T05:19:14.423 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2024-08-20T05:19:14.423 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2024-08-20T05:19:14.423 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 6633368, 2024-08-20T05:19:14.423 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 0, 2024-08-20T05:19:14.424 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-08-20T05:19:14.424 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 1096, 2024-08-20T05:19:14.424 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 13.983215857, 2024-08-20T05:19:14.424 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.012758408 2024-08-20T05:19:14.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.424 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 0 2024-08-20T05:19:14.424 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.424 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-08-20T05:19:14.424 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 79, 2024-08-20T05:19:14.424 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 249, 2024-08-20T05:19:14.424 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 170, 2024-08-20T05:19:14.424 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 23, 2024-08-20T05:19:14.424 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 30, 2024-08-20T05:19:14.425 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 7, 2024-08-20T05:19:14.425 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 309, 2024-08-20T05:19:14.425 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 492, 2024-08-20T05:19:14.425 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 183, 2024-08-20T05:19:14.425 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 61, 2024-08-20T05:19:14.425 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 419, 2024-08-20T05:19:14.425 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 358, 2024-08-20T05:19:14.425 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 61240, 2024-08-20T05:19:14.425 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 266190848 2024-08-20T05:19:14.425 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.425 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-08-20T05:19:14.425 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 2200, 2024-08-20T05:19:14.426 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2024-08-20T05:19:14.426 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 1301, 2024-08-20T05:19:14.426 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 260, 2024-08-20T05:19:14.426 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 77, 2024-08-20T05:19:14.426 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-08-20T05:19:14.426 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 37, 2024-08-20T05:19:14.426 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.059725772, 2024-08-20T05:19:14.426 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001614210 2024-08-20T05:19:14.426 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.426 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-08-20T05:19:14.426 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 246, 2024-08-20T05:19:14.426 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 16.361791157, 2024-08-20T05:19:14.426 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.066511346 2024-08-20T05:19:14.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.427 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-08-20T05:19:14.427 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.427 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.427 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.427 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-08-20T05:19:14.427 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 125, 2024-08-20T05:19:14.427 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.249457171, 2024-08-20T05:19:14.427 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001995657 2024-08-20T05:19:14.427 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.427 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-08-20T05:19:14.427 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 466, 2024-08-20T05:19:14.428 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.489204080, 2024-08-20T05:19:14.428 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001049794 2024-08-20T05:19:14.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.428 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-08-20T05:19:14.428 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.428 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.428 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.428 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.428 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-08-20T05:19:14.428 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.428 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-08-20T05:19:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-08-20T05:19:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-08-20T05:19:14.429 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.430 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.430 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.430 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-08-20T05:19:14.430 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.430 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.430 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.430 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.430 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-08-20T05:19:14.430 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.430 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.431 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.431 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-08-20T05:19:14.431 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.431 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.431 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.431 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-08-20T05:19:14.431 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.431 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.431 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.431 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.432 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-08-20T05:19:14.432 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 156, 2024-08-20T05:19:14.432 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.088185189, 2024-08-20T05:19:14.432 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000565289 2024-08-20T05:19:14.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.432 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-08-20T05:19:14.432 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 5, 2024-08-20T05:19:14.432 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.007747491, 2024-08-20T05:19:14.432 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001549498 2024-08-20T05:19:14.432 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.432 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-08-20T05:19:14.432 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 125, 2024-08-20T05:19:14.432 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.891160596, 2024-08-20T05:19:14.432 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.007129284 2024-08-20T05:19:14.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.433 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-08-20T05:19:14.433 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.433 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.433 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.433 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-08-20T05:19:14.433 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.433 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.433 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.433 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.433 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-08-20T05:19:14.433 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.433 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.433 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.434 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-08-20T05:19:14.434 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.434 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.434 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.434 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-08-20T05:19:14.434 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.434 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.434 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.434 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.434 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-08-20T05:19:14.434 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.435 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.435 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.435 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-08-20T05:19:14.435 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.435 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.435 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.435 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-08-20T05:19:14.435 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.435 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.435 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.435 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.436 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-08-20T05:19:14.436 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.436 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.436 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.436 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-08-20T05:19:14.436 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.436 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.436 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.436 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.436 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-08-20T05:19:14.436 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.437 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.437 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.437 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-08-20T05:19:14.437 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 127, 2024-08-20T05:19:14.437 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.225840709, 2024-08-20T05:19:14.437 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.001778273 2024-08-20T05:19:14.437 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.437 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-08-20T05:19:14.437 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-08-20T05:19:14.437 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-08-20T05:19:14.437 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.438 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.438 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.438 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:14.438 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.438 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-08-20T05:19:14.438 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 1, 2024-08-20T05:19:14.438 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 1, 2024-08-20T05:19:14.438 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 0, 2024-08-20T05:19:14.438 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 1, 2024-08-20T05:19:14.438 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-08-20T05:19:14.438 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 153, 2024-08-20T05:19:14.438 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 153, 2024-08-20T05:19:14.439 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 2308, 2024-08-20T05:19:14.439 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-08-20T05:19:14.439 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.439 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-08-20T05:19:14.439 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-08-20T05:19:14.439 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-08-20T05:19:14.439 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T05:19:14.439 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-08-20T05:19:14.439 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T05:19:14.439 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-08-20T05:19:14.439 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T05:19:14.439 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T05:19:14.439 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T05:19:14.440 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T05:19:14.440 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T05:19:14.440 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-08-20T05:19:14.440 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T05:19:14.440 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T05:19:14.440 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-08-20T05:19:14.440 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-08-20T05:19:14.440 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-08-20T05:19:14.440 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-08-20T05:19:14.440 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T05:19:14.440 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T05:19:14.440 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T05:19:14.440 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T05:19:14.440 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T05:19:14.441 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-08-20T05:19:14.441 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-08-20T05:19:14.441 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-08-20T05:19:14.441 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T05:19:14.441 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T05:19:14.441 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-08-20T05:19:14.441 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-08-20T05:19:14.441 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-08-20T05:19:14.441 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-08-20T05:19:14.441 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T05:19:14.441 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-08-20T05:19:14.441 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T05:19:14.441 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-08-20T05:19:14.441 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 314173, 2024-08-20T05:19:14.442 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 177, 2024-08-20T05:19:14.442 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-08-20T05:19:14.442 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-08-20T05:19:14.442 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-08-20T05:19:14.442 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-08-20T05:19:14.442 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-08-20T05:19:14.442 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-08-20T05:19:14.442 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-08-20T05:19:14.442 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-08-20T05:19:14.442 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 8864, 2024-08-20T05:19:14.442 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 167, 2024-08-20T05:19:14.442 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T05:19:14.442 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-08-20T05:19:14.443 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-08-20T05:19:14.443 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-08-20T05:19:14.443 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 474098, 2024-08-20T05:19:14.443 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 14954, 2024-08-20T05:19:14.443 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-08-20T05:19:14.443 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-08-20T05:19:14.443 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-08-20T05:19:14.443 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-08-20T05:19:14.443 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.443 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-08-20T05:19:14.443 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-08-20T05:19:14.443 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-08-20T05:19:14.443 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 3009, 2024-08-20T05:19:14.443 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 2502836, 2024-08-20T05:19:14.444 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 32, 2024-08-20T05:19:14.444 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 3009, 2024-08-20T05:19:14.444 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-08-20T05:19:14.444 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3009, 2024-08-20T05:19:14.444 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 22.325532149, 2024-08-20T05:19:14.444 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.007419585 2024-08-20T05:19:14.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.444 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-08-20T05:19:14.444 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-08-20T05:19:14.444 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3009, 2024-08-20T05:19:14.444 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 3186 2024-08-20T05:19:14.444 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.444 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 3009, 2024-08-20T05:19:14.445 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 1665, 2024-08-20T05:19:14.445 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 1344, 2024-08-20T05:19:14.445 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-08-20T05:19:14.445 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-08-20T05:19:14.445 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 0, 2024-08-20T05:19:14.445 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 10, 2024-08-20T05:19:14.445 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 1, 2024-08-20T05:19:14.445 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 1097, 2024-08-20T05:19:14.445 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 61, 2024-08-20T05:19:14.445 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-08-20T05:19:14.445 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-08-20T05:19:14.445 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-08-20T05:19:14.445 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-08-20T05:19:14.446 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 22, 2024-08-20T05:19:14.446 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-08-20T05:19:14.446 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-08-20T05:19:14.446 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-08-20T05:19:14.446 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 1664, 2024-08-20T05:19:14.446 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 20, 2024-08-20T05:19:14.446 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-08-20T05:19:14.446 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-08-20T05:19:14.446 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-08-20T05:19:14.446 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-08-20T05:19:14.446 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-08-20T05:19:14.446 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-08-20T05:19:14.447 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T05:19:14.447 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-08-20T05:19:14.447 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-08-20T05:19:14.447 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-08-20T05:19:14.447 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-08-20T05:19:14.447 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-08-20T05:19:14.447 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-08-20T05:19:14.447 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-08-20T05:19:14.447 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-08-20T05:19:14.447 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-08-20T05:19:14.447 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-08-20T05:19:14.447 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-08-20T05:19:14.447 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-08-20T05:19:14.447 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-08-20T05:19:14.448 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-08-20T05:19:14.448 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-08-20T05:19:14.448 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-08-20T05:19:14.448 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-08-20T05:19:14.448 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-08-20T05:19:14.448 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-08-20T05:19:14.448 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 88, 2024-08-20T05:19:14.448 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-08-20T05:19:14.448 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 4, 2024-08-20T05:19:14.448 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 12, 2024-08-20T05:19:14.448 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 12, 2024-08-20T05:19:14.448 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 0, 2024-08-20T05:19:14.448 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-08-20T05:19:14.448 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 251, 2024-08-20T05:19:14.449 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 6, 2024-08-20T05:19:14.449 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 54 2024-08-20T05:19:14.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.449 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-08-20T05:19:14.449 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 1, 2024-08-20T05:19:14.449 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-08-20T05:19:14.449 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-08-20T05:19:14.449 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-08-20T05:19:14.449 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.449 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-08-20T05:19:14.449 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-08-20T05:19:14.449 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 10, 2024-08-20T05:19:14.449 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-08-20T05:19:14.449 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 2, 2024-08-20T05:19:14.450 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed_ops": 10, 2024-08-20T05:19:14.450 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 2, 2024-08-20T05:19:14.450 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-08-20T05:19:14.450 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.450 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T05:19:14.450 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:14.450 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-08-20T05:19:14.450 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:14.450 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 10484, 2024-08-20T05:19:14.450 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 3465835, 2024-08-20T05:19:14.450 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:14.450 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 10484, 2024-08-20T05:19:14.450 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-08-20T05:19:14.450 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-08-20T05:19:14.451 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 10484, 2024-08-20T05:19:14.451 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 3465835, 2024-08-20T05:19:14.451 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:14.451 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.451 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.451 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.451 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:14.451 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.451 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-08-20T05:19:14.451 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:14.451 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-08-20T05:19:14.451 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:14.451 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-08-20T05:19:14.451 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-08-20T05:19:14.452 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:14.452 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:14.452 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 3009, 2024-08-20T05:19:14.452 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 2503018, 2024-08-20T05:19:14.452 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 3009, 2024-08-20T05:19:14.452 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 2503018, 2024-08-20T05:19:14.452 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:14.452 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.452 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.452 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.452 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:14.453 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.453 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-08-20T05:19:14.453 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:14.453 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-08-20T05:19:14.453 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:14.453 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-08-20T05:19:14.453 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-08-20T05:19:14.453 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:14.453 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:14.453 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 3009, 2024-08-20T05:19:14.453 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 3009, 2024-08-20T05:19:14.453 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 3009, 2024-08-20T05:19:14.453 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 3009, 2024-08-20T05:19:14.453 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:14.454 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.454 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.454 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.454 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:14.454 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.454 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-08-20T05:19:14.454 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:14.454 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-08-20T05:19:14.454 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:14.454 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 2, 2024-08-20T05:19:14.454 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 218, 2024-08-20T05:19:14.454 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:14.454 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 2, 2024-08-20T05:19:14.455 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-08-20T05:19:14.455 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-08-20T05:19:14.455 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 1, 2024-08-20T05:19:14.455 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 218, 2024-08-20T05:19:14.455 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:14.455 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.455 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.455 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.455 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:14.455 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.455 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x558cd95946e0": { 2024-08-20T05:19:14.455 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:14.456 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-08-20T05:19:14.456 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:14.456 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 1537, 2024-08-20T05:19:14.456 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 2439064, 2024-08-20T05:19:14.456 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:14.456 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 1537, 2024-08-20T05:19:14.456 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-08-20T05:19:14.456 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-08-20T05:19:14.456 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 1096, 2024-08-20T05:19:14.456 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 2439064, 2024-08-20T05:19:14.456 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:14.456 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:14.456 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:14.456 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:14.457 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:14.457 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:14.457 INFO:teuthology.orchestra.run.smithi135.stdout: "trackedop": { 2024-08-20T05:19:14.457 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 1306 2024-08-20T05:19:14.457 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:14.457 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-08-20T05:19:15.290 INFO:tasks.check_counter:Daemon mds.i mds.exported=6 2024-08-20T05:19:15.290 INFO:tasks.check_counter:Daemon mds.i mds.imported=7 2024-08-20T05:19:15.291 DEBUG:tasks.check_counter:Getting stats from l 2024-08-20T05:19:15.291 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph daemon mds.l perf dump 2024-08-20T05:19:15.547 INFO:teuthology.orchestra.run.smithi135.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.c/config 2024-08-20T05:19:15.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:15 smithi037 ceph-mon[17265]: pgmap v911: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-20T05:19:15.933 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:15 smithi135 ceph-mon[22342]: pgmap v911: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-20T05:19:15.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:15 smithi130 ceph-mon[22007]: pgmap v911: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-08-20T05:19:16.209 INFO:teuthology.orchestra.run.smithi135.stdout:{ 2024-08-20T05:19:16.210 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-0": { 2024-08-20T05:19:16.210 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 3501, 2024-08-20T05:19:16.210 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 3502, 2024-08-20T05:19:16.210 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 3421961, 2024-08-20T05:19:16.210 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 1113007, 2024-08-20T05:19:16.210 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 6, 2024-08-20T05:19:16.210 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 2, 2024-08-20T05:19:16.210 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.325410277, 2024-08-20T05:19:16.210 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.137313823, 2024-08-20T05:19:16.210 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.070096184, 2024-08-20T05:19:16.210 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.098514008, 2024-08-20T05:19:16.211 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:16.211 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3500, 2024-08-20T05:19:16.211 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.158594833, 2024-08-20T05:19:16.211 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000045312 2024-08-20T05:19:16.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.211 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:16.211 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.211 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.211 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.211 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-20T05:19:16.211 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 0 2024-08-20T05:19:16.211 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.212 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-1": { 2024-08-20T05:19:16.212 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 379, 2024-08-20T05:19:16.212 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 346, 2024-08-20T05:19:16.212 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 762028, 2024-08-20T05:19:16.212 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 208202, 2024-08-20T05:19:16.212 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 3, 2024-08-20T05:19:16.212 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 2, 2024-08-20T05:19:16.212 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.055074031, 2024-08-20T05:19:16.212 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.026650640, 2024-08-20T05:19:16.212 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.036728751, 2024-08-20T05:19:16.212 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000052312, 2024-08-20T05:19:16.212 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:16.212 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 346, 2024-08-20T05:19:16.212 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.023952339, 2024-08-20T05:19:16.213 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000069226 2024-08-20T05:19:16.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.213 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:16.213 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.213 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.213 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.213 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.214 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 761472, 2024-08-20T05:19:16.214 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 207504 2024-08-20T05:19:16.214 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.214 INFO:teuthology.orchestra.run.smithi135.stdout: "AsyncMessenger::Worker-2": { 2024-08-20T05:19:16.214 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_messages": 3, 2024-08-20T05:19:16.214 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages": 256, 2024-08-20T05:19:16.214 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_bytes": 588, 2024-08-20T05:19:16.214 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_bytes": 595598, 2024-08-20T05:19:16.214 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_created_connections": 6, 2024-08-20T05:19:16.214 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_active_connections": 3, 2024-08-20T05:19:16.214 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_total_time": 0.017646498, 2024-08-20T05:19:16.215 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_send_time": 0.013855466, 2024-08-20T05:19:16.215 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_recv_time": 0.001448099, 2024-08-20T05:19:16.215 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_running_fast_dispatch_time": 0.000027350, 2024-08-20T05:19:16.215 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_messages_queue_lat": { 2024-08-20T05:19:16.215 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 254, 2024-08-20T05:19:16.215 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.031785139, 2024-08-20T05:19:16.215 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000125138 2024-08-20T05:19:16.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.215 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_handle_ack_lat": { 2024-08-20T05:19:16.215 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.215 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.215 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.215 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.216 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-20T05:19:16.216 INFO:teuthology.orchestra.run.smithi135.stdout: "msgr_send_encrypted_bytes": 595280 2024-08-20T05:19:16.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.216 INFO:teuthology.orchestra.run.smithi135.stdout: "cct": { 2024-08-20T05:19:16.216 INFO:teuthology.orchestra.run.smithi135.stdout: "total_workers": 1, 2024-08-20T05:19:16.216 INFO:teuthology.orchestra.run.smithi135.stdout: "unhealthy_workers": 0 2024-08-20T05:19:16.216 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.216 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-MDSRank": { 2024-08-20T05:19:16.216 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-08-20T05:19:16.216 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-08-20T05:19:16.216 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 5975, 2024-08-20T05:19:16.216 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.145481010, 2024-08-20T05:19:16.216 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000024348 2024-08-20T05:19:16.216 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:16.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.217 INFO:teuthology.orchestra.run.smithi135.stdout: "finisher-PurgeQueue": { 2024-08-20T05:19:16.217 INFO:teuthology.orchestra.run.smithi135.stdout: "queue_len": 0, 2024-08-20T05:19:16.217 INFO:teuthology.orchestra.run.smithi135.stdout: "complete_latency": { 2024-08-20T05:19:16.217 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.217 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.217 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.217 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:16.217 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.217 INFO:teuthology.orchestra.run.smithi135.stdout: "mds": { 2024-08-20T05:19:16.217 INFO:teuthology.orchestra.run.smithi135.stdout: "request": 0, 2024-08-20T05:19:16.217 INFO:teuthology.orchestra.run.smithi135.stdout: "reply": 0, 2024-08-20T05:19:16.217 INFO:teuthology.orchestra.run.smithi135.stdout: "reply_latency": { 2024-08-20T05:19:16.217 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.218 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.218 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.218 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.218 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_reply": 0, 2024-08-20T05:19:16.218 INFO:teuthology.orchestra.run.smithi135.stdout: "forward": 0, 2024-08-20T05:19:16.218 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_complete": 0, 2024-08-20T05:19:16.218 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_fetch_keys": 0, 2024-08-20T05:19:16.218 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_commit": 0, 2024-08-20T05:19:16.218 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_split": 0, 2024-08-20T05:19:16.218 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_merge": 0, 2024-08-20T05:19:16.218 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes": 301, 2024-08-20T05:19:16.218 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_top": 1, 2024-08-20T05:19:16.218 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_bottom": 300, 2024-08-20T05:19:16.218 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pin_tail": 0, 2024-08-20T05:19:16.219 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_pinned": 300, 2024-08-20T05:19:16.219 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_expired": 0, 2024-08-20T05:19:16.219 INFO:teuthology.orchestra.run.smithi135.stdout: "inodes_with_caps": 0, 2024-08-20T05:19:16.219 INFO:teuthology.orchestra.run.smithi135.stdout: "caps": 0, 2024-08-20T05:19:16.219 INFO:teuthology.orchestra.run.smithi135.stdout: "subtrees": 3, 2024-08-20T05:19:16.219 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse": 0, 2024-08-20T05:19:16.219 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_hit": 0, 2024-08-20T05:19:16.219 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_forward": 0, 2024-08-20T05:19:16.219 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_discover": 0, 2024-08-20T05:19:16.219 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_dir_fetch": 0, 2024-08-20T05:19:16.219 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_remote_ino": 0, 2024-08-20T05:19:16.219 INFO:teuthology.orchestra.run.smithi135.stdout: "traverse_lock": 0, 2024-08-20T05:19:16.219 INFO:teuthology.orchestra.run.smithi135.stdout: "load_cent": 0, 2024-08-20T05:19:16.219 INFO:teuthology.orchestra.run.smithi135.stdout: "q": 0, 2024-08-20T05:19:16.219 INFO:teuthology.orchestra.run.smithi135.stdout: "exported": 0, 2024-08-20T05:19:16.220 INFO:teuthology.orchestra.run.smithi135.stdout: "exported_inodes": 0, 2024-08-20T05:19:16.220 INFO:teuthology.orchestra.run.smithi135.stdout: "imported": 0, 2024-08-20T05:19:16.220 INFO:teuthology.orchestra.run.smithi135.stdout: "imported_inodes": 0, 2024-08-20T05:19:16.220 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_dir_fetch": 0, 2024-08-20T05:19:16.220 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_backtrace_fetch": 0, 2024-08-20T05:19:16.220 INFO:teuthology.orchestra.run.smithi135.stdout: "openino_peer_discover": 0, 2024-08-20T05:19:16.220 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rfiles": 0, 2024-08-20T05:19:16.220 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rbytes": 0, 2024-08-20T05:19:16.220 INFO:teuthology.orchestra.run.smithi135.stdout: "root_rsnaps": 0, 2024-08-20T05:19:16.220 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_fetch": 0, 2024-08-20T05:19:16.220 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_set_tag": 0, 2024-08-20T05:19:16.220 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_backtrace_repaired": 0, 2024-08-20T05:19:16.220 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_inotable_repaired": 0, 2024-08-20T05:19:16.221 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_inodes": 0, 2024-08-20T05:19:16.221 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dir_base_inodes": 0, 2024-08-20T05:19:16.221 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_dirfrag_rstats": 0, 2024-08-20T05:19:16.221 INFO:teuthology.orchestra.run.smithi135.stdout: "scrub_file_inodes": 0, 2024-08-20T05:19:16.221 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_inode_file_caps": 0, 2024-08-20T05:19:16.221 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_revoke": 0, 2024-08-20T05:19:16.221 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_grant": 0, 2024-08-20T05:19:16.221 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_trunc": 0, 2024-08-20T05:19:16.221 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-20T05:19:16.221 INFO:teuthology.orchestra.run.smithi135.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-20T05:19:16.221 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps": 0, 2024-08-20T05:19:16.221 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_caps_dirty": 0, 2024-08-20T05:19:16.221 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_cap_release": 0, 2024-08-20T05:19:16.221 INFO:teuthology.orchestra.run.smithi135.stdout: "process_request_cap_release": 0 2024-08-20T05:19:16.222 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.222 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_cache": { 2024-08-20T05:19:16.222 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update": 0, 2024-08-20T05:19:16.222 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_update_receipt": 0, 2024-08-20T05:19:16.222 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_try_discover": 0, 2024-08-20T05:19:16.222 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_send_discover": 0, 2024-08-20T05:19:16.222 INFO:teuthology.orchestra.run.smithi135.stdout: "dir_handle_discover": 0, 2024-08-20T05:19:16.222 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays": 0, 2024-08-20T05:19:16.222 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_delayed": 0, 2024-08-20T05:19:16.222 INFO:teuthology.orchestra.run.smithi135.stdout: "num_strays_enqueuing": 0, 2024-08-20T05:19:16.222 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_created": 0, 2024-08-20T05:19:16.222 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_enqueued": 0, 2024-08-20T05:19:16.222 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_reintegrated": 0, 2024-08-20T05:19:16.223 INFO:teuthology.orchestra.run.smithi135.stdout: "strays_migrated": 0, 2024-08-20T05:19:16.223 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_processing": 0, 2024-08-20T05:19:16.223 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_enqueued": 0, 2024-08-20T05:19:16.223 INFO:teuthology.orchestra.run.smithi135.stdout: "num_recovering_prioritized": 0, 2024-08-20T05:19:16.223 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_started": 0, 2024-08-20T05:19:16.223 INFO:teuthology.orchestra.run.smithi135.stdout: "recovery_completed": 0, 2024-08-20T05:19:16.223 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_path": 0, 2024-08-20T05:19:16.223 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_quiesce_inode": 0, 2024-08-20T05:19:16.223 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_enqueue_scrub": 0, 2024-08-20T05:19:16.223 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_exportdir": 0, 2024-08-20T05:19:16.223 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_flush": 0, 2024-08-20T05:19:16.223 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragmentdir": 0, 2024-08-20T05:19:16.223 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_fragstats": 0, 2024-08-20T05:19:16.223 INFO:teuthology.orchestra.run.smithi135.stdout: "ireq_inodestats": 0 2024-08-20T05:19:16.223 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.224 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_log": { 2024-08-20T05:19:16.224 INFO:teuthology.orchestra.run.smithi135.stdout: "evlrg": 0, 2024-08-20T05:19:16.224 INFO:teuthology.orchestra.run.smithi135.stdout: "evadd": 0, 2024-08-20T05:19:16.224 INFO:teuthology.orchestra.run.smithi135.stdout: "evex": 0, 2024-08-20T05:19:16.224 INFO:teuthology.orchestra.run.smithi135.stdout: "evtrm": 0, 2024-08-20T05:19:16.224 INFO:teuthology.orchestra.run.smithi135.stdout: "ev": 1537, 2024-08-20T05:19:16.224 INFO:teuthology.orchestra.run.smithi135.stdout: "evexg": 0, 2024-08-20T05:19:16.224 INFO:teuthology.orchestra.run.smithi135.stdout: "evexd": 0, 2024-08-20T05:19:16.224 INFO:teuthology.orchestra.run.smithi135.stdout: "segadd": 0, 2024-08-20T05:19:16.224 INFO:teuthology.orchestra.run.smithi135.stdout: "segex": 0, 2024-08-20T05:19:16.224 INFO:teuthology.orchestra.run.smithi135.stdout: "segtrm": 0, 2024-08-20T05:19:16.224 INFO:teuthology.orchestra.run.smithi135.stdout: "seg": 3, 2024-08-20T05:19:16.224 INFO:teuthology.orchestra.run.smithi135.stdout: "segmjr": 2, 2024-08-20T05:19:16.224 INFO:teuthology.orchestra.run.smithi135.stdout: "segexg": 0, 2024-08-20T05:19:16.225 INFO:teuthology.orchestra.run.smithi135.stdout: "segexd": 0, 2024-08-20T05:19:16.225 INFO:teuthology.orchestra.run.smithi135.stdout: "expos": 4194304, 2024-08-20T05:19:16.225 INFO:teuthology.orchestra.run.smithi135.stdout: "wrpos": 6633368, 2024-08-20T05:19:16.225 INFO:teuthology.orchestra.run.smithi135.stdout: "rdpos": 6632794, 2024-08-20T05:19:16.225 INFO:teuthology.orchestra.run.smithi135.stdout: "jlat": { 2024-08-20T05:19:16.225 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.225 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.225 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.225 INFO:teuthology.orchestra.run.smithi135.stdout: "replayed": 1537 2024-08-20T05:19:16.225 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.225 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_mem": { 2024-08-20T05:19:16.225 INFO:teuthology.orchestra.run.smithi135.stdout: "ino": 68, 2024-08-20T05:19:16.225 INFO:teuthology.orchestra.run.smithi135.stdout: "ino+": 242, 2024-08-20T05:19:16.225 INFO:teuthology.orchestra.run.smithi135.stdout: "ino-": 174, 2024-08-20T05:19:16.226 INFO:teuthology.orchestra.run.smithi135.stdout: "dir": 12, 2024-08-20T05:19:16.226 INFO:teuthology.orchestra.run.smithi135.stdout: "dir+": 22, 2024-08-20T05:19:16.226 INFO:teuthology.orchestra.run.smithi135.stdout: "dir-": 10, 2024-08-20T05:19:16.226 INFO:teuthology.orchestra.run.smithi135.stdout: "dn": 301, 2024-08-20T05:19:16.226 INFO:teuthology.orchestra.run.smithi135.stdout: "dn+": 483, 2024-08-20T05:19:16.226 INFO:teuthology.orchestra.run.smithi135.stdout: "dn-": 182, 2024-08-20T05:19:16.226 INFO:teuthology.orchestra.run.smithi135.stdout: "cap": 0, 2024-08-20T05:19:16.226 INFO:teuthology.orchestra.run.smithi135.stdout: "cap+": 0, 2024-08-20T05:19:16.226 INFO:teuthology.orchestra.run.smithi135.stdout: "cap-": 0, 2024-08-20T05:19:16.226 INFO:teuthology.orchestra.run.smithi135.stdout: "rss": 50716, 2024-08-20T05:19:16.226 INFO:teuthology.orchestra.run.smithi135.stdout: "heap": 251453440 2024-08-20T05:19:16.226 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.226 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_server": { 2024-08-20T05:19:16.227 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_client_request": 0, 2024-08-20T05:19:16.227 INFO:teuthology.orchestra.run.smithi135.stdout: "dispatch_server_request": 0, 2024-08-20T05:19:16.227 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_request": 0, 2024-08-20T05:19:16.227 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_client_session": 0, 2024-08-20T05:19:16.227 INFO:teuthology.orchestra.run.smithi135.stdout: "handle_peer_request": 0, 2024-08-20T05:19:16.227 INFO:teuthology.orchestra.run.smithi135.stdout: "req_create_latency": { 2024-08-20T05:19:16.227 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.227 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.227 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.227 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.227 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getattr_latency": { 2024-08-20T05:19:16.227 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.227 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.227 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.228 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getfilelock_latency": { 2024-08-20T05:19:16.228 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.228 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.228 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.228 INFO:teuthology.orchestra.run.smithi135.stdout: "req_link_latency": { 2024-08-20T05:19:16.228 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.228 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.228 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.228 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.228 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookup_latency": { 2024-08-20T05:19:16.228 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.228 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.229 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.229 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookuphash_latency": { 2024-08-20T05:19:16.229 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.229 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.229 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.229 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupino_latency": { 2024-08-20T05:19:16.229 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.229 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.229 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.229 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.229 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupname_latency": { 2024-08-20T05:19:16.229 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.229 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.230 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.230 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupparent_latency": { 2024-08-20T05:19:16.230 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.230 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.230 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.230 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lookupsnap_latency": { 2024-08-20T05:19:16.230 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.230 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.230 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.230 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.230 INFO:teuthology.orchestra.run.smithi135.stdout: "req_lssnap_latency": { 2024-08-20T05:19:16.230 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.231 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.231 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.231 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mkdir_latency": { 2024-08-20T05:19:16.231 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.231 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.231 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.231 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mknod_latency": { 2024-08-20T05:19:16.231 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.231 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.231 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.231 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.231 INFO:teuthology.orchestra.run.smithi135.stdout: "req_mksnap_latency": { 2024-08-20T05:19:16.232 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.232 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.232 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.232 INFO:teuthology.orchestra.run.smithi135.stdout: "req_open_latency": { 2024-08-20T05:19:16.232 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.232 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.232 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.232 INFO:teuthology.orchestra.run.smithi135.stdout: "req_readdir_latency": { 2024-08-20T05:19:16.232 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.232 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.232 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.232 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.233 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rename_latency": { 2024-08-20T05:19:16.233 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.233 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.233 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.233 INFO:teuthology.orchestra.run.smithi135.stdout: "req_renamesnap_latency": { 2024-08-20T05:19:16.233 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.233 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.233 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.233 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.233 INFO:teuthology.orchestra.run.smithi135.stdout: "req_snapdiff_latency": { 2024-08-20T05:19:16.233 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.233 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.234 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.234 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmdir_latency": { 2024-08-20T05:19:16.234 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.234 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.234 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.234 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmsnap_latency": { 2024-08-20T05:19:16.234 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.234 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.234 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.234 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.234 INFO:teuthology.orchestra.run.smithi135.stdout: "req_rmxattr_latency": { 2024-08-20T05:19:16.234 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.235 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.235 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.235 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setattr_latency": { 2024-08-20T05:19:16.235 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.235 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.235 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.235 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setdirlayout_latency": { 2024-08-20T05:19:16.235 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.235 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.235 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.235 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.235 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setfilelock_latency": { 2024-08-20T05:19:16.236 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.236 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.236 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.236 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setlayout_latency": { 2024-08-20T05:19:16.236 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.236 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.236 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.236 INFO:teuthology.orchestra.run.smithi135.stdout: "req_setxattr_latency": { 2024-08-20T05:19:16.236 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.236 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.236 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.236 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.237 INFO:teuthology.orchestra.run.smithi135.stdout: "req_symlink_latency": { 2024-08-20T05:19:16.237 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.237 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.237 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.237 INFO:teuthology.orchestra.run.smithi135.stdout: "req_unlink_latency": { 2024-08-20T05:19:16.237 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.237 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.237 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.237 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.237 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_revoke_eviction": 0, 2024-08-20T05:19:16.237 INFO:teuthology.orchestra.run.smithi135.stdout: "cap_acquisition_throttle": 0, 2024-08-20T05:19:16.237 INFO:teuthology.orchestra.run.smithi135.stdout: "req_getvxattr_latency": { 2024-08-20T05:19:16.237 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.237 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.238 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.238 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:16.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.238 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_sessions": { 2024-08-20T05:19:16.238 INFO:teuthology.orchestra.run.smithi135.stdout: "session_count": 1, 2024-08-20T05:19:16.238 INFO:teuthology.orchestra.run.smithi135.stdout: "session_add": 1, 2024-08-20T05:19:16.238 INFO:teuthology.orchestra.run.smithi135.stdout: "session_remove": 0, 2024-08-20T05:19:16.238 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_open": 1, 2024-08-20T05:19:16.238 INFO:teuthology.orchestra.run.smithi135.stdout: "sessions_stale": 0, 2024-08-20T05:19:16.238 INFO:teuthology.orchestra.run.smithi135.stdout: "total_load": 0, 2024-08-20T05:19:16.238 INFO:teuthology.orchestra.run.smithi135.stdout: "average_load": 0, 2024-08-20T05:19:16.238 INFO:teuthology.orchestra.run.smithi135.stdout: "avg_session_uptime": 2309, 2024-08-20T05:19:16.238 INFO:teuthology.orchestra.run.smithi135.stdout: "mdthresh_evicted": 0 2024-08-20T05:19:16.238 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.239 INFO:teuthology.orchestra.run.smithi135.stdout: "mempool": { 2024-08-20T05:19:16.239 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_bytes": 0, 2024-08-20T05:19:16.239 INFO:teuthology.orchestra.run.smithi135.stdout: "bloom_filter_items": 0, 2024-08-20T05:19:16.239 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_bytes": 0, 2024-08-20T05:19:16.239 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_alloc_items": 0, 2024-08-20T05:19:16.239 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_bytes": 0, 2024-08-20T05:19:16.239 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_data_items": 0, 2024-08-20T05:19:16.239 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-20T05:19:16.239 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_onode_items": 0, 2024-08-20T05:19:16.239 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-20T05:19:16.239 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_meta_items": 0, 2024-08-20T05:19:16.239 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_bytes": 0, 2024-08-20T05:19:16.239 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_other_items": 0, 2024-08-20T05:19:16.239 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-20T05:19:16.240 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_cache_buffer_items": 0, 2024-08-20T05:19:16.240 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_bytes": 0, 2024-08-20T05:19:16.240 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_extent_items": 0, 2024-08-20T05:19:16.240 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_bytes": 0, 2024-08-20T05:19:16.240 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_blob_items": 0, 2024-08-20T05:19:16.240 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-20T05:19:16.240 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_shared_blob_items": 0, 2024-08-20T05:19:16.240 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-20T05:19:16.240 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_inline_bl_items": 0, 2024-08-20T05:19:16.240 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_bytes": 0, 2024-08-20T05:19:16.240 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_fsck_items": 0, 2024-08-20T05:19:16.240 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_bytes": 0, 2024-08-20T05:19:16.240 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_txc_items": 0, 2024-08-20T05:19:16.240 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-20T05:19:16.240 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_deferred_items": 0, 2024-08-20T05:19:16.241 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_bytes": 0, 2024-08-20T05:19:16.241 INFO:teuthology.orchestra.run.smithi135.stdout: "bluestore_writing_items": 0, 2024-08-20T05:19:16.241 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_bytes": 0, 2024-08-20T05:19:16.241 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_items": 0, 2024-08-20T05:19:16.241 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_bytes": 0, 2024-08-20T05:19:16.241 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_reader_items": 0, 2024-08-20T05:19:16.241 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_bytes": 0, 2024-08-20T05:19:16.241 INFO:teuthology.orchestra.run.smithi135.stdout: "bluefs_file_writer_items": 0, 2024-08-20T05:19:16.241 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_bytes": 185038, 2024-08-20T05:19:16.241 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_anon_items": 108, 2024-08-20T05:19:16.241 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_bytes": 0, 2024-08-20T05:19:16.241 INFO:teuthology.orchestra.run.smithi135.stdout: "buffer_meta_items": 0, 2024-08-20T05:19:16.241 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_bytes": 0, 2024-08-20T05:19:16.241 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_items": 0, 2024-08-20T05:19:16.241 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_bytes": 0, 2024-08-20T05:19:16.242 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_mapbl_items": 0, 2024-08-20T05:19:16.242 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_bytes": 0, 2024-08-20T05:19:16.242 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_pglog_items": 0, 2024-08-20T05:19:16.242 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_bytes": 8864, 2024-08-20T05:19:16.242 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_items": 167, 2024-08-20T05:19:16.242 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_bytes": 0, 2024-08-20T05:19:16.242 INFO:teuthology.orchestra.run.smithi135.stdout: "osdmap_mapping_items": 0, 2024-08-20T05:19:16.242 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_bytes": 0, 2024-08-20T05:19:16.242 INFO:teuthology.orchestra.run.smithi135.stdout: "pgmap_items": 0, 2024-08-20T05:19:16.242 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_bytes": 387127, 2024-08-20T05:19:16.242 INFO:teuthology.orchestra.run.smithi135.stdout: "mds_co_items": 11905, 2024-08-20T05:19:16.242 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_bytes": 0, 2024-08-20T05:19:16.242 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_1_items": 0, 2024-08-20T05:19:16.242 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_bytes": 0, 2024-08-20T05:19:16.242 INFO:teuthology.orchestra.run.smithi135.stdout: "unittest_2_items": 0 2024-08-20T05:19:16.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.243 INFO:teuthology.orchestra.run.smithi135.stdout: "objecter": { 2024-08-20T05:19:16.243 INFO:teuthology.orchestra.run.smithi135.stdout: "op_active": 0, 2024-08-20T05:19:16.243 INFO:teuthology.orchestra.run.smithi135.stdout: "op_laggy": 0, 2024-08-20T05:19:16.243 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send": 3503, 2024-08-20T05:19:16.243 INFO:teuthology.orchestra.run.smithi135.stdout: "op_send_bytes": 21, 2024-08-20T05:19:16.243 INFO:teuthology.orchestra.run.smithi135.stdout: "op_resend": 3, 2024-08-20T05:19:16.243 INFO:teuthology.orchestra.run.smithi135.stdout: "op_reply": 3503, 2024-08-20T05:19:16.243 INFO:teuthology.orchestra.run.smithi135.stdout: "op_latency": { 2024-08-20T05:19:16.243 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3503, 2024-08-20T05:19:16.243 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 17.281641202, 2024-08-20T05:19:16.243 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.004933383 2024-08-20T05:19:16.243 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.243 INFO:teuthology.orchestra.run.smithi135.stdout: "op_inflight": 0, 2024-08-20T05:19:16.243 INFO:teuthology.orchestra.run.smithi135.stdout: "oplen_avg": { 2024-08-20T05:19:16.244 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 3503, 2024-08-20T05:19:16.244 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 3504 2024-08-20T05:19:16.244 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.244 INFO:teuthology.orchestra.run.smithi135.stdout: "op": 3503, 2024-08-20T05:19:16.244 INFO:teuthology.orchestra.run.smithi135.stdout: "op_r": 3503, 2024-08-20T05:19:16.244 INFO:teuthology.orchestra.run.smithi135.stdout: "op_w": 0, 2024-08-20T05:19:16.244 INFO:teuthology.orchestra.run.smithi135.stdout: "op_rmw": 0, 2024-08-20T05:19:16.244 INFO:teuthology.orchestra.run.smithi135.stdout: "op_pg": 0, 2024-08-20T05:19:16.244 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_stat": 2109, 2024-08-20T05:19:16.244 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_create": 0, 2024-08-20T05:19:16.244 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_read": 1392, 2024-08-20T05:19:16.244 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_write": 0, 2024-08-20T05:19:16.244 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writefull": 0, 2024-08-20T05:19:16.245 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_writesame": 0, 2024-08-20T05:19:16.245 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_append": 0, 2024-08-20T05:19:16.245 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_zero": 0, 2024-08-20T05:19:16.245 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_truncate": 0, 2024-08-20T05:19:16.245 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_delete": 0, 2024-08-20T05:19:16.245 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_mapext": 0, 2024-08-20T05:19:16.245 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_sparse_read": 0, 2024-08-20T05:19:16.245 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_clonerange": 0, 2024-08-20T05:19:16.245 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_getxattr": 1, 2024-08-20T05:19:16.245 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_setxattr": 0, 2024-08-20T05:19:16.245 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_cmpxattr": 0, 2024-08-20T05:19:16.245 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_rmxattr": 0, 2024-08-20T05:19:16.245 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_resetxattrs": 0, 2024-08-20T05:19:16.245 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_call": 0, 2024-08-20T05:19:16.246 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_watch": 0, 2024-08-20T05:19:16.246 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_notify": 0, 2024-08-20T05:19:16.246 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_src_cmpxattr": 0, 2024-08-20T05:19:16.246 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls": 0, 2024-08-20T05:19:16.246 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_pgls_filter": 0, 2024-08-20T05:19:16.246 INFO:teuthology.orchestra.run.smithi135.stdout: "osdop_other": 0, 2024-08-20T05:19:16.246 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_active": 0, 2024-08-20T05:19:16.246 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_send": 0, 2024-08-20T05:19:16.246 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_resend": 0, 2024-08-20T05:19:16.246 INFO:teuthology.orchestra.run.smithi135.stdout: "linger_ping": 0, 2024-08-20T05:19:16.246 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_active": 0, 2024-08-20T05:19:16.246 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_send": 0, 2024-08-20T05:19:16.246 INFO:teuthology.orchestra.run.smithi135.stdout: "poolop_resend": 0, 2024-08-20T05:19:16.246 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_active": 0, 2024-08-20T05:19:16.247 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_send": 0, 2024-08-20T05:19:16.247 INFO:teuthology.orchestra.run.smithi135.stdout: "poolstat_resend": 0, 2024-08-20T05:19:16.247 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_active": 0, 2024-08-20T05:19:16.247 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_send": 0, 2024-08-20T05:19:16.247 INFO:teuthology.orchestra.run.smithi135.stdout: "statfs_resend": 0, 2024-08-20T05:19:16.247 INFO:teuthology.orchestra.run.smithi135.stdout: "command_active": 0, 2024-08-20T05:19:16.247 INFO:teuthology.orchestra.run.smithi135.stdout: "command_send": 0, 2024-08-20T05:19:16.247 INFO:teuthology.orchestra.run.smithi135.stdout: "command_resend": 0, 2024-08-20T05:19:16.247 INFO:teuthology.orchestra.run.smithi135.stdout: "map_epoch": 88, 2024-08-20T05:19:16.247 INFO:teuthology.orchestra.run.smithi135.stdout: "map_full": 0, 2024-08-20T05:19:16.247 INFO:teuthology.orchestra.run.smithi135.stdout: "map_inc": 4, 2024-08-20T05:19:16.247 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_sessions": 4, 2024-08-20T05:19:16.248 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_open": 5, 2024-08-20T05:19:16.248 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_session_close": 1, 2024-08-20T05:19:16.248 INFO:teuthology.orchestra.run.smithi135.stdout: "osd_laggy": 0, 2024-08-20T05:19:16.249 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_wr": 0, 2024-08-20T05:19:16.250 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_rd": 2, 2024-08-20T05:19:16.250 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_del": 0 2024-08-20T05:19:16.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.250 INFO:teuthology.orchestra.run.smithi135.stdout: "oft": { 2024-08-20T05:19:16.250 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_objs": 0, 2024-08-20T05:19:16.250 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_kv_pairs": 0, 2024-08-20T05:19:16.250 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_updates": 0, 2024-08-20T05:19:16.250 INFO:teuthology.orchestra.run.smithi135.stdout: "omap_total_removes": 0 2024-08-20T05:19:16.250 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.250 INFO:teuthology.orchestra.run.smithi135.stdout: "purge_queue": { 2024-08-20T05:19:16.250 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops": 0, 2024-08-20T05:19:16.250 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_ops_high_water": 0, 2024-08-20T05:19:16.250 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing": 0, 2024-08-20T05:19:16.250 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executing_high_water": 0, 2024-08-20T05:19:16.251 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed_ops": 0, 2024-08-20T05:19:16.251 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_executed": 0, 2024-08-20T05:19:16.251 INFO:teuthology.orchestra.run.smithi135.stdout: "pq_item_in_journal": 0 2024-08-20T05:19:16.251 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.251 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-20T05:19:16.251 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:16.251 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-08-20T05:19:16.251 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:16.251 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 3879, 2024-08-20T05:19:16.251 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 3813361, 2024-08-20T05:19:16.251 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:16.251 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 3879, 2024-08-20T05:19:16.251 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-08-20T05:19:16.252 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-08-20T05:19:16.252 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 3879, 2024-08-20T05:19:16.252 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 3813361, 2024-08-20T05:19:16.252 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:16.252 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.252 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.252 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.252 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:16.252 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.252 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_bytes": { 2024-08-20T05:19:16.252 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:16.252 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 104857600, 2024-08-20T05:19:16.252 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:16.252 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-08-20T05:19:16.253 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-08-20T05:19:16.253 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:16.253 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:16.253 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 3503, 2024-08-20T05:19:16.253 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 2439069, 2024-08-20T05:19:16.253 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 3503, 2024-08-20T05:19:16.253 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 2439069, 2024-08-20T05:19:16.253 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:16.253 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.253 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.253 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.253 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:16.253 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.253 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-objecter_ops": { 2024-08-20T05:19:16.254 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:16.254 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 1024, 2024-08-20T05:19:16.254 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:16.254 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-08-20T05:19:16.254 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-08-20T05:19:16.254 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:16.254 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:16.254 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 3503, 2024-08-20T05:19:16.254 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 3503, 2024-08-20T05:19:16.254 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 3503, 2024-08-20T05:19:16.254 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 3503, 2024-08-20T05:19:16.254 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:16.254 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.254 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.255 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.255 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:16.255 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.255 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle": { 2024-08-20T05:19:16.255 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:16.255 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-08-20T05:19:16.255 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:16.255 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-08-20T05:19:16.255 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-08-20T05:19:16.255 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:16.255 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:16.255 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-08-20T05:19:16.255 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-08-20T05:19:16.255 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-08-20T05:19:16.256 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-08-20T05:19:16.256 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:16.256 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.256 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.256 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.256 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:16.256 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.256 INFO:teuthology.orchestra.run.smithi135.stdout: "throttle-write_buf_throttle-0x5565880c4960": { 2024-08-20T05:19:16.256 INFO:teuthology.orchestra.run.smithi135.stdout: "val": 0, 2024-08-20T05:19:16.256 INFO:teuthology.orchestra.run.smithi135.stdout: "max": 3758096384, 2024-08-20T05:19:16.256 INFO:teuthology.orchestra.run.smithi135.stdout: "get_started": 0, 2024-08-20T05:19:16.256 INFO:teuthology.orchestra.run.smithi135.stdout: "get": 0, 2024-08-20T05:19:16.256 INFO:teuthology.orchestra.run.smithi135.stdout: "get_sum": 0, 2024-08-20T05:19:16.256 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_fail": 0, 2024-08-20T05:19:16.257 INFO:teuthology.orchestra.run.smithi135.stdout: "get_or_fail_success": 0, 2024-08-20T05:19:16.257 INFO:teuthology.orchestra.run.smithi135.stdout: "take": 0, 2024-08-20T05:19:16.257 INFO:teuthology.orchestra.run.smithi135.stdout: "take_sum": 0, 2024-08-20T05:19:16.257 INFO:teuthology.orchestra.run.smithi135.stdout: "put": 0, 2024-08-20T05:19:16.257 INFO:teuthology.orchestra.run.smithi135.stdout: "put_sum": 0, 2024-08-20T05:19:16.257 INFO:teuthology.orchestra.run.smithi135.stdout: "wait": { 2024-08-20T05:19:16.257 INFO:teuthology.orchestra.run.smithi135.stdout: "avgcount": 0, 2024-08-20T05:19:16.257 INFO:teuthology.orchestra.run.smithi135.stdout: "sum": 0.000000000, 2024-08-20T05:19:16.257 INFO:teuthology.orchestra.run.smithi135.stdout: "avgtime": 0.000000000 2024-08-20T05:19:16.257 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:16.257 INFO:teuthology.orchestra.run.smithi135.stdout: }, 2024-08-20T05:19:16.257 INFO:teuthology.orchestra.run.smithi135.stdout: "trackedop": { 2024-08-20T05:19:16.257 INFO:teuthology.orchestra.run.smithi135.stdout: "slow_ops_count": 0 2024-08-20T05:19:16.257 INFO:teuthology.orchestra.run.smithi135.stdout: } 2024-08-20T05:19:16.257 INFO:teuthology.orchestra.run.smithi135.stdout:} 2024-08-20T05:19:17.284 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-08-20T05:19:17.284 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-08-20T05:19:17.284 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-20T05:19:17.296 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-20T05:19:17.296 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T05:19:17.296 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-20T05:19:17.350 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-08-20T05:19:17.350 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-20T05:19:17.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd blocklist ls 2024-08-20T05:19:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:19:17.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:17 smithi130 ceph-mon[22007]: pgmap v912: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-20T05:19:17.998 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:17 smithi037 ceph-mon[17265]: pgmap v912: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-20T05:19:18.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:17 smithi135 ceph-mon[22342]: pgmap v912: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-08-20T05:19:18.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.426+0000 7fa2eb200640 1 -- 172.21.15.37:0/2895535406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2e4104b00 msgr2=0x7fa2e4104ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:18.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.426+0000 7fa2eb200640 1 --2- 172.21.15.37:0/2895535406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2e4104b00 0x7fa2e4104ee0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009900 tx=0x7fa2d802a3f0 comp rx=0 tx=0).stop 2024-08-20T05:19:18.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.426+0000 7fa2eb200640 1 -- 172.21.15.37:0/2895535406 shutdown_connections 2024-08-20T05:19:18.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.426+0000 7fa2eb200640 1 --2- 172.21.15.37:0/2895535406 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2e410ae90 0x7fa2e4111690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:18.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.426+0000 7fa2eb200640 1 --2- 172.21.15.37:0/2895535406 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2e410a510 0x7fa2e410a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:18.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.426+0000 7fa2eb200640 1 --2- 172.21.15.37:0/2895535406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2e4104b00 0x7fa2e4104ee0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:18.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.426+0000 7fa2eb200640 1 -- 172.21.15.37:0/2895535406 >> 172.21.15.37:0/2895535406 conn(0x7fa2e4100550 msgr2=0x7fa2e4102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:18.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.426+0000 7fa2eb200640 1 -- 172.21.15.37:0/2895535406 shutdown_connections 2024-08-20T05:19:18.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.426+0000 7fa2eb200640 1 -- 172.21.15.37:0/2895535406 wait complete. 2024-08-20T05:19:18.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.427+0000 7fa2eb200640 1 Processor -- start 2024-08-20T05:19:18.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.428+0000 7fa2eb200640 1 -- start start 2024-08-20T05:19:18.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.428+0000 7fa2eb200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2e4104b00 0x7fa2e419af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:18.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.428+0000 7fa2eb200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2e410a510 0x7fa2e419b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:18.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.428+0000 7fa2eb200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2e410ae90 0x7fa2e41a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:18.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.428+0000 7fa2eb200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e4114b60 con 0x7fa2e4104b00 2024-08-20T05:19:18.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.428+0000 7fa2eb200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e41149e0 con 0x7fa2e410a510 2024-08-20T05:19:18.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.428+0000 7fa2eb200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e4114ce0 con 0x7fa2e410ae90 2024-08-20T05:19:18.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.428+0000 7fa2e9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2e4104b00 0x7fa2e419af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:18.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.428+0000 7fa2ea800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2e410ae90 0x7fa2e41a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:18.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.428+0000 7fa2ea800640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2e410ae90 0x7fa2e41a0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:57394/0 (socket says 172.21.15.37:57394) 2024-08-20T05:19:18.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.428+0000 7fa2e9e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2e4104b00 0x7fa2e419af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52478/0 (socket says 172.21.15.37:52478) 2024-08-20T05:19:18.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.428+0000 7fa2ea800640 1 -- 172.21.15.37:0/3489666246 learned_addr learned my addr 172.21.15.37:0/3489666246 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:19:18.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.428+0000 7fa2e9400640 1 --2- 172.21.15.37:0/3489666246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2e410a510 0x7fa2e419b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:18.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.429+0000 7fa2ea800640 1 -- 172.21.15.37:0/3489666246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2e410a510 msgr2=0x7fa2e419b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:18.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.429+0000 7fa2ea800640 1 --2- 172.21.15.37:0/3489666246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2e410a510 0x7fa2e419b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:18.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.429+0000 7fa2ea800640 1 -- 172.21.15.37:0/3489666246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2e4104b00 msgr2=0x7fa2e419af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:18.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.429+0000 7fa2ea800640 1 --2- 172.21.15.37:0/3489666246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2e4104b00 0x7fa2e419af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:18.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.429+0000 7fa2ea800640 1 -- 172.21.15.37:0/3489666246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e41a0fe0 con 0x7fa2e410ae90 2024-08-20T05:19:18.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.429+0000 7fa2ea800640 1 --2- 172.21.15.37:0/3489666246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2e410ae90 0x7fa2e41a0810 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009fd0 tx=0x7fa2e000b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:18.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.429+0000 7fa2dea00640 1 -- 172.21.15.37:0/3489666246 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0017070 con 0x7fa2e410ae90 2024-08-20T05:19:18.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.429+0000 7fa2eb200640 1 -- 172.21.15.37:0/3489666246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e41a12d0 con 0x7fa2e410ae90 2024-08-20T05:19:18.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.429+0000 7fa2dea00640 1 -- 172.21.15.37:0/3489666246 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2e0003e20 con 0x7fa2e410ae90 2024-08-20T05:19:18.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.429+0000 7fa2dea00640 1 -- 172.21.15.37:0/3489666246 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0010460 con 0x7fa2e410ae90 2024-08-20T05:19:18.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.429+0000 7fa2eb200640 1 -- 172.21.15.37:0/3489666246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e41a7990 con 0x7fa2e410ae90 2024-08-20T05:19:18.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.430+0000 7fa2eb200640 1 -- 172.21.15.37:0/3489666246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2e4104ee0 con 0x7fa2e410ae90 2024-08-20T05:19:18.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.433+0000 7fa2dea00640 1 -- 172.21.15.37:0/3489666246 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa2e0003970 con 0x7fa2e410ae90 2024-08-20T05:19:18.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.434+0000 7fa2dea00640 1 --2- 172.21.15.37:0/3489666246 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2cc0b3cf0 0x7fa2cc0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:18.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.434+0000 7fa2dea00640 1 -- 172.21.15.37:0/3489666246 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa2e00e3d60 con 0x7fa2e410ae90 2024-08-20T05:19:18.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.434+0000 7fa2e9e00640 1 --2- 172.21.15.37:0/3489666246 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2cc0b3cf0 0x7fa2cc0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:18.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.435+0000 7fa2e9e00640 1 --2- 172.21.15.37:0/3489666246 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2cc0b3cf0 0x7fa2cc0b61b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8005ab0 tx=0x7fa2d8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:18.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.439+0000 7fa2dea00640 1 -- 172.21.15.37:0/3489666246 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa2e00aafb0 con 0x7fa2e410ae90 2024-08-20T05:19:18.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.644+0000 7fa2eb200640 1 -- 172.21.15.37:0/3489666246 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa2e41a7c80 con 0x7fa2e410ae90 2024-08-20T05:19:18.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.645+0000 7fa2dea00640 1 -- 172.21.15.37:0/3489666246 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) ==== 81+0+590 (secure 0 0 0) 0x7fa2e00b3280 con 0x7fa2e410ae90 2024-08-20T05:19:18.647 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/4282140105 2024-08-21T04:51:27.877907+0000 2024-08-20T05:19:18.647 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1217599998 2024-08-21T04:51:27.877907+0000 2024-08-20T05:19:18.647 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/1372988755 2024-08-21T04:51:27.877907+0000 2024-08-20T05:19:18.647 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3737412906 2024-08-21T04:51:27.877907+0000 2024-08-20T05:19:18.648 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/2577159152 2024-08-21T04:50:59.520912+0000 2024-08-20T05:19:18.648 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/2577159152 2024-08-21T04:50:59.520912+0000 2024-08-20T05:19:18.648 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/1372988755 2024-08-21T04:51:27.877907+0000 2024-08-20T05:19:18.648 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/58912454 2024-08-21T04:50:59.520912+0000 2024-08-20T05:19:18.648 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2105948300 2024-08-21T04:50:59.520912+0000 2024-08-20T05:19:18.648 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1480362562 2024-08-21T04:50:59.520912+0000 2024-08-20T05:19:18.648 INFO:teuthology.orchestra.run.smithi037.stderr:listed 10 entries 2024-08-20T05:19:18.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.647+0000 7fa2eb200640 1 -- 172.21.15.37:0/3489666246 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2cc0b3cf0 msgr2=0x7fa2cc0b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:18.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.647+0000 7fa2eb200640 1 --2- 172.21.15.37:0/3489666246 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2cc0b3cf0 0x7fa2cc0b61b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8005ab0 tx=0x7fa2d8005a20 comp rx=0 tx=0).stop 2024-08-20T05:19:18.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.647+0000 7fa2eb200640 1 -- 172.21.15.37:0/3489666246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2e410ae90 msgr2=0x7fa2e41a0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:18.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.647+0000 7fa2eb200640 1 --2- 172.21.15.37:0/3489666246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2e410ae90 0x7fa2e41a0810 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009fd0 tx=0x7fa2e000b260 comp rx=0 tx=0).stop 2024-08-20T05:19:18.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.647+0000 7fa2eb200640 1 -- 172.21.15.37:0/3489666246 shutdown_connections 2024-08-20T05:19:18.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.647+0000 7fa2eb200640 1 --2- 172.21.15.37:0/3489666246 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa2cc0b3cf0 0x7fa2cc0b61b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:18.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.647+0000 7fa2eb200640 1 --2- 172.21.15.37:0/3489666246 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa2e410ae90 0x7fa2e41a0810 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:18.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.647+0000 7fa2eb200640 1 --2- 172.21.15.37:0/3489666246 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa2e410a510 0x7fa2e419b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:18.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.647+0000 7fa2eb200640 1 --2- 172.21.15.37:0/3489666246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2e4104b00 0x7fa2e419af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:18.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.647+0000 7fa2eb200640 1 -- 172.21.15.37:0/3489666246 >> 172.21.15.37:0/3489666246 conn(0x7fa2e4100550 msgr2=0x7fa2e4103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:18.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.648+0000 7fa2eb200640 1 -- 172.21.15.37:0/3489666246 shutdown_connections 2024-08-20T05:19:18.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:18.648+0000 7fa2eb200640 1 -- 172.21.15.37:0/3489666246 wait complete. 2024-08-20T05:19:18.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:18 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3489666246' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T05:19:19.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:18 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3489666246' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T05:19:19.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:18 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3489666246' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-08-20T05:19:19.635 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-20T05:19:19.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T05:19:19.635 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /tmp/cephfs 2024-08-20T05:19:19.829 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2024-08-20T05:19:19.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T05:19:19.829 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-08-20T05:19:19.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T05:19:19.922 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-08-20T05:19:19.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:19 smithi130 ceph-mon[22007]: pgmap v913: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:19:19.999 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-08-20T05:19:19.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T05:19:19.999 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-08-20T05:19:20.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:19 smithi037 ceph-mon[17265]: pgmap v913: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:19:20.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-20T05:19:20.058 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-08-20T05:19:20.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:19 smithi135 ceph-mon[22342]: pgmap v913: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-08-20T05:19:20.443 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-20T05:19:20.454 INFO:tasks.cephadm:Teardown begin 2024-08-20T05:19:20.455 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-20T05:19:20.455 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:19:20.841 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:19:21.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.427+0000 7ff889200640 1 -- 172.21.15.37:0/3705697681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff88410f470 msgr2=0x7ff884115c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:21.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.427+0000 7ff889200640 1 --2- 172.21.15.37:0/3705697681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff88410f470 0x7ff884115c70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009ca0 tx=0x7ff87c02a8c0 comp rx=0 tx=0).stop 2024-08-20T05:19:21.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.427+0000 7ff889200640 1 -- 172.21.15.37:0/3705697681 shutdown_connections 2024-08-20T05:19:21.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.427+0000 7ff889200640 1 --2- 172.21.15.37:0/3705697681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff88410f470 0x7ff884115c70 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:21.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.427+0000 7ff889200640 1 --2- 172.21.15.37:0/3705697681 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff88410eaf0 0x7ff88410ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:21.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.427+0000 7ff889200640 1 --2- 172.21.15.37:0/3705697681 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff8841090e0 0x7ff8841094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:21.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.427+0000 7ff889200640 1 -- 172.21.15.37:0/3705697681 >> 172.21.15.37:0/3705697681 conn(0x7ff884078760 msgr2=0x7ff88407ab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:21.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.427+0000 7ff889200640 1 -- 172.21.15.37:0/3705697681 shutdown_connections 2024-08-20T05:19:21.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.427+0000 7ff889200640 1 -- 172.21.15.37:0/3705697681 wait complete. 2024-08-20T05:19:21.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.428+0000 7ff889200640 1 Processor -- start 2024-08-20T05:19:21.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.428+0000 7ff889200640 1 -- start start 2024-08-20T05:19:21.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.428+0000 7ff889200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8841090e0 0x7ff88419f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:21.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.428+0000 7ff889200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff88410eaf0 0x7ff88419fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:21.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.428+0000 7ff889200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff88410f470 0x7ff8841a4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:21.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.428+0000 7ff889200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff8841190f0 con 0x7ff88410f470 2024-08-20T05:19:21.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.428+0000 7ff889200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7ff884118f70 con 0x7ff8841090e0 2024-08-20T05:19:21.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.428+0000 7ff889200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7ff884119270 con 0x7ff88410eaf0 2024-08-20T05:19:21.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.429+0000 7ff882800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff88410f470 0x7ff8841a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:21.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.429+0000 7ff881e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8841090e0 0x7ff88419f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:21.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.429+0000 7ff882800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff88410f470 0x7ff8841a4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52500/0 (socket says 172.21.15.37:52500) 2024-08-20T05:19:21.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.429+0000 7ff882800640 1 -- 172.21.15.37:0/3633682910 learned_addr learned my addr 172.21.15.37:0/3633682910 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:19:21.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.429+0000 7ff881e00640 1 --2- 172.21.15.37:0/3633682910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8841090e0 0x7ff88419f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:56864/0 (socket says 172.21.15.37:56864) 2024-08-20T05:19:21.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.429+0000 7ff87be00640 1 --2- 172.21.15.37:0/3633682910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff88410eaf0 0x7ff88419fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:21.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.429+0000 7ff881e00640 1 -- 172.21.15.37:0/3633682910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff88410eaf0 msgr2=0x7ff88419fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:21.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.429+0000 7ff881e00640 1 --2- 172.21.15.37:0/3633682910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff88410eaf0 0x7ff88419fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:21.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.429+0000 7ff881e00640 1 -- 172.21.15.37:0/3633682910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff88410f470 msgr2=0x7ff8841a4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:21.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.429+0000 7ff881e00640 1 --2- 172.21.15.37:0/3633682910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff88410f470 0x7ff8841a4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:21.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.429+0000 7ff881e00640 1 -- 172.21.15.37:0/3633682910 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8841a55f0 con 0x7ff8841090e0 2024-08-20T05:19:21.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.429+0000 7ff882800640 1 --2- 172.21.15.37:0/3633682910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff88410f470 0x7ff8841a4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:19:21.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.430+0000 7ff881e00640 1 --2- 172.21.15.37:0/3633682910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8841090e0 0x7ff88419f540 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff874005fd0 tx=0x7ff87400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:21.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.430+0000 7ff87aa00640 1 -- 172.21.15.37:0/3633682910 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874009c30 con 0x7ff8841090e0 2024-08-20T05:19:21.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.430+0000 7ff889200640 1 -- 172.21.15.37:0/3633682910 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8841a58e0 con 0x7ff8841090e0 2024-08-20T05:19:21.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.430+0000 7ff87aa00640 1 -- 172.21.15.37:0/3633682910 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff874009dd0 con 0x7ff8841090e0 2024-08-20T05:19:21.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.430+0000 7ff87aa00640 1 -- 172.21.15.37:0/3633682910 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff874010460 con 0x7ff8841090e0 2024-08-20T05:19:21.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.430+0000 7ff889200640 1 -- 172.21.15.37:0/3633682910 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8841ac170 con 0x7ff8841090e0 2024-08-20T05:19:21.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.431+0000 7ff889200640 1 -- 172.21.15.37:0/3633682910 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff88410a390 con 0x7ff8841090e0 2024-08-20T05:19:21.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.434+0000 7ff87aa00640 1 -- 172.21.15.37:0/3633682910 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7ff874003e80 con 0x7ff8841090e0 2024-08-20T05:19:21.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.436+0000 7ff87aa00640 1 --2- 172.21.15.37:0/3633682910 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8680b3bd0 0x7ff8680b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:21.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.436+0000 7ff87aa00640 1 -- 172.21.15.37:0/3633682910 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7ff8740e3f10 con 0x7ff8841090e0 2024-08-20T05:19:21.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.436+0000 7ff87be00640 1 --2- 172.21.15.37:0/3633682910 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8680b3bd0 0x7ff8680b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:21.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.437+0000 7ff87be00640 1 --2- 172.21.15.37:0/3633682910 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8680b3bd0 0x7ff8680b6090 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff8841089e0 tx=0x7ff86c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:21.465 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.437+0000 7ff87aa00640 1 -- 172.21.15.37:0/3633682910 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7ff874017020 con 0x7ff8841090e0 2024-08-20T05:19:21.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.672+0000 7ff889200640 1 -- 172.21.15.37:0/3633682910 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8841094c0 con 0x7ff8841090e0 2024-08-20T05:19:21.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.673+0000 7ff87aa00640 1 -- 172.21.15.37:0/3633682910 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+11986 (secure 0 0 0) 0x7ff8841094c0 con 0x7ff8841090e0 2024-08-20T05:19:21.675 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:19:21.675 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":56,"btime":"2024-08-20T05:18:41:600336+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:18:41.295623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:19:21.676 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 56 2024-08-20T05:19:21.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.675+0000 7ff889200640 1 -- 172.21.15.37:0/3633682910 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8680b3bd0 msgr2=0x7ff8680b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:21.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.675+0000 7ff889200640 1 --2- 172.21.15.37:0/3633682910 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8680b3bd0 0x7ff8680b6090 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff8841089e0 tx=0x7ff86c00b410 comp rx=0 tx=0).stop 2024-08-20T05:19:21.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.675+0000 7ff889200640 1 -- 172.21.15.37:0/3633682910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8841090e0 msgr2=0x7ff88419f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:21.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.675+0000 7ff889200640 1 --2- 172.21.15.37:0/3633682910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8841090e0 0x7ff88419f540 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff874005fd0 tx=0x7ff87400dde0 comp rx=0 tx=0).stop 2024-08-20T05:19:21.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.675+0000 7ff889200640 1 -- 172.21.15.37:0/3633682910 shutdown_connections 2024-08-20T05:19:21.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.675+0000 7ff889200640 1 --2- 172.21.15.37:0/3633682910 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7ff8680b3bd0 0x7ff8680b6090 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:21.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.675+0000 7ff889200640 1 --2- 172.21.15.37:0/3633682910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff88410f470 0x7ff8841a4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:21.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.675+0000 7ff889200640 1 --2- 172.21.15.37:0/3633682910 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7ff88410eaf0 0x7ff88419fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:21.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.675+0000 7ff889200640 1 --2- 172.21.15.37:0/3633682910 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7ff8841090e0 0x7ff88419f540 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:21.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.675+0000 7ff889200640 1 -- 172.21.15.37:0/3633682910 >> 172.21.15.37:0/3633682910 conn(0x7ff884078760 msgr2=0x7ff88407ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:21.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.676+0000 7ff889200640 1 -- 172.21.15.37:0/3633682910 shutdown_connections 2024-08-20T05:19:21.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:21.676+0000 7ff889200640 1 -- 172.21.15.37:0/3633682910 wait complete. 2024-08-20T05:19:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:21 smithi130 ceph-mon[22007]: pgmap v914: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:19:21.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:21 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3633682910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:19:22.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:21 smithi037 ceph-mon[17265]: pgmap v914: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:19:22.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:21 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3633682910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:19:22.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:21 smithi135 ceph-mon[22342]: pgmap v914: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 11 op/s 2024-08-20T05:19:22.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:21 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3633682910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:19:22.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs dump --format=json 2024-08-20T05:19:23.007 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:19:23.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.586+0000 7f24ff600640 1 -- 172.21.15.37:0/1381326722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f81084b0 msgr2=0x7f24f81088f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:23.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.586+0000 7f24ff600640 1 --2- 172.21.15.37:0/1381326722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f81084b0 0x7f24f81088f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f24e4009900 tx=0x7f24e402a410 comp rx=0 tx=0).stop 2024-08-20T05:19:23.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.586+0000 7f24ff600640 1 -- 172.21.15.37:0/1381326722 shutdown_connections 2024-08-20T05:19:23.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.586+0000 7f24ff600640 1 --2- 172.21.15.37:0/1381326722 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24f8108e30 0x7f24f810f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:23.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.586+0000 7f24ff600640 1 --2- 172.21.15.37:0/1381326722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f81084b0 0x7f24f81088f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:23.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.586+0000 7f24ff600640 1 --2- 172.21.15.37:0/1381326722 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24f8100b20 0x7f24f8100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:23.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.586+0000 7f24ff600640 1 -- 172.21.15.37:0/1381326722 >> 172.21.15.37:0/1381326722 conn(0x7f24f80fc730 msgr2=0x7f24f80feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:23.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.586+0000 7f24ff600640 1 -- 172.21.15.37:0/1381326722 shutdown_connections 2024-08-20T05:19:23.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.586+0000 7f24ff600640 1 -- 172.21.15.37:0/1381326722 wait complete. 2024-08-20T05:19:23.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.587+0000 7f24ff600640 1 Processor -- start 2024-08-20T05:19:23.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.587+0000 7f24ff600640 1 -- start start 2024-08-20T05:19:23.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.588+0000 7f24ff600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24f8100b20 0x7f24f8198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:23.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.588+0000 7f24ff600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24f81084b0 0x7f24f81994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:23.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.588+0000 7f24ff600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f8108e30 0x7f24f819e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:23.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.588+0000 7f24ff600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f24f8112ae0 con 0x7f24f8108e30 2024-08-20T05:19:23.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.588+0000 7f24ff600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f24f8112960 con 0x7f24f81084b0 2024-08-20T05:19:23.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.588+0000 7f24ff600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f24f8112c60 con 0x7f24f8100b20 2024-08-20T05:19:23.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.588+0000 7f24fcc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24f8100b20 0x7f24f8198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:23.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.588+0000 7f24fd600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f8108e30 0x7f24f819e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:23.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.588+0000 7f24fcc00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24f8100b20 0x7f24f8198f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:56806/0 (socket says 172.21.15.37:56806) 2024-08-20T05:19:23.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.588+0000 7f24fcc00640 1 -- 172.21.15.37:0/167103804 learned_addr learned my addr 172.21.15.37:0/167103804 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:19:23.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.588+0000 7f24f7e00640 1 --2- 172.21.15.37:0/167103804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24f81084b0 0x7f24f81994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:23.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.588+0000 7f24fcc00640 1 -- 172.21.15.37:0/167103804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24f81084b0 msgr2=0x7f24f81994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:23.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.588+0000 7f24fcc00640 1 --2- 172.21.15.37:0/167103804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24f81084b0 0x7f24f81994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:23.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.588+0000 7f24fcc00640 1 -- 172.21.15.37:0/167103804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f8108e30 msgr2=0x7f24f819e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:23.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.589+0000 7f24fcc00640 1 --2- 172.21.15.37:0/167103804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f8108e30 0x7f24f819e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:23.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.589+0000 7f24fcc00640 1 -- 172.21.15.37:0/167103804 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f819f040 con 0x7f24f8100b20 2024-08-20T05:19:23.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.589+0000 7f24fcc00640 1 --2- 172.21.15.37:0/167103804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24f8100b20 0x7f24f8198f90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00ea60 tx=0x7f24ec00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:23.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.589+0000 7f24f5600640 1 -- 172.21.15.37:0/167103804 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec00cde0 con 0x7f24f8100b20 2024-08-20T05:19:23.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.589+0000 7f24ff600640 1 -- 172.21.15.37:0/167103804 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f819f330 con 0x7f24f8100b20 2024-08-20T05:19:23.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.589+0000 7f24f5600640 1 -- 172.21.15.37:0/167103804 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24ec0035f0 con 0x7f24f8100b20 2024-08-20T05:19:23.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.589+0000 7f24f5600640 1 -- 172.21.15.37:0/167103804 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec010690 con 0x7f24f8100b20 2024-08-20T05:19:23.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.589+0000 7f24ff600640 1 -- 172.21.15.37:0/167103804 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f81a59f0 con 0x7f24f8100b20 2024-08-20T05:19:23.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.590+0000 7f24ff600640 1 -- 172.21.15.37:0/167103804 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f8100f00 con 0x7f24f8100b20 2024-08-20T05:19:23.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.593+0000 7f24f5600640 1 -- 172.21.15.37:0/167103804 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f24ec0037a0 con 0x7f24f8100b20 2024-08-20T05:19:23.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.595+0000 7f24f5600640 1 --2- 172.21.15.37:0/167103804 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f24e00b3bd0 0x7f24e00b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:23.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.595+0000 7f24f5600640 1 -- 172.21.15.37:0/167103804 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f24ec0e4400 con 0x7f24f8100b20 2024-08-20T05:19:23.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.595+0000 7f24f7e00640 1 --2- 172.21.15.37:0/167103804 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f24e00b3bd0 0x7f24e00b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:23.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.596+0000 7f24f7e00640 1 --2- 172.21.15.37:0/167103804 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f24e00b3bd0 0x7f24e00b6090 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f24e4005ab0 tx=0x7f24e4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:23.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.597+0000 7f24f5600640 1 -- 172.21.15.37:0/167103804 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f24ec055e20 con 0x7f24f8100b20 2024-08-20T05:19:23.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:23 smithi037 ceph-mon[17265]: pgmap v915: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 341 B/s wr, 9 op/s 2024-08-20T05:19:23.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.827+0000 7f24ff600640 1 -- 172.21.15.37:0/167103804 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24f819a0c0 con 0x7f24f8100b20 2024-08-20T05:19:23.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.828+0000 7f24f5600640 1 -- 172.21.15.37:0/167103804 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+11986 (secure 0 0 0) 0x7f24ec0ab6b0 con 0x7f24f8100b20 2024-08-20T05:19:23.829 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:19:23.830 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":56,"btime":"2024-08-20T05:18:41:600336+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2131006297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2131006297},{"type":"v1","addr":"172.21.15.37:6835","nonce":2131006297}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6837/3652581224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6836","nonce":3652581224},{"type":"v1","addr":"172.21.15.37:6837","nonce":3652581224}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":56,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-20T04:59:13.823062+0000","modified":"2024-08-20T05:18:41.295623+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24695,"mds_1":24664,"mds_2":24656,"mds_3":24649,"mds_4":24637},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14652":{"gid":14652,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6839/1587848243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6838","nonce":1587848243},{"type":"v1","addr":"172.21.15.37:6839","nonce":1587848243}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14664":{"gid":14664,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6841/466077750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6840","nonce":466077750},{"type":"v1","addr":"172.21.15.37:6841","nonce":466077750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6833/1818782678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6832","nonce":1818782678},{"type":"v1","addr":"172.21.15.130:6833","nonce":1818782678}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24592":{"gid":24592,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.135:6833/4059666386","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":4059666386},{"type":"v1","addr":"172.21.15.135:6833","nonce":4059666386}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24626":{"gid":24626,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.130:6835/538714148","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6834","nonce":538714148},{"type":"v1","addr":"172.21.15.130:6835","nonce":538714148}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6835/998113160","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6834","nonce":998113160},{"type":"v1","addr":"172.21.15.135:6835","nonce":998113160}]},"join_fscid":-1,"export_targets":[0,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24649":{"gid":24649,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":22,"addr":"172.21.15.135:6837/894352067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6836","nonce":894352067},{"type":"v1","addr":"172.21.15.135:6837","nonce":894352067}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24656":{"gid":24656,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":21,"addr":"172.21.15.130:6837/1513603753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6836","nonce":1513603753},{"type":"v1","addr":"172.21.15.130:6837","nonce":1513603753}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24664":{"gid":24664,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":20,"addr":"172.21.15.135:6839/2602130726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6838","nonce":2602130726},{"type":"v1","addr":"172.21.15.135:6839","nonce":2602130726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24695":{"gid":24695,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.130:6839/2863850712","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6838","nonce":2863850712},{"type":"v1","addr":"172.21.15.130:6839","nonce":2863850712}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24695,"qdb_cluster":[24664,24695,24656,24649,24637]},"id":1}]} 2024-08-20T05:19:23.830 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 56 2024-08-20T05:19:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.831+0000 7f24ff600640 1 -- 172.21.15.37:0/167103804 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f24e00b3bd0 msgr2=0x7f24e00b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.831+0000 7f24ff600640 1 --2- 172.21.15.37:0/167103804 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f24e00b3bd0 0x7f24e00b6090 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f24e4005ab0 tx=0x7f24e4005a20 comp rx=0 tx=0).stop 2024-08-20T05:19:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.831+0000 7f24ff600640 1 -- 172.21.15.37:0/167103804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24f8100b20 msgr2=0x7f24f8198f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.831+0000 7f24ff600640 1 --2- 172.21.15.37:0/167103804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24f8100b20 0x7f24f8198f90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f24ec00ea60 tx=0x7f24ec00ef20 comp rx=0 tx=0).stop 2024-08-20T05:19:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.831+0000 7f24ff600640 1 -- 172.21.15.37:0/167103804 shutdown_connections 2024-08-20T05:19:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.831+0000 7f24ff600640 1 --2- 172.21.15.37:0/167103804 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f24e00b3bd0 0x7f24e00b6090 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.831+0000 7f24ff600640 1 --2- 172.21.15.37:0/167103804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f8108e30 0x7f24f819e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.831+0000 7f24ff600640 1 --2- 172.21.15.37:0/167103804 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f24f81084b0 0x7f24f81994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.831+0000 7f24ff600640 1 --2- 172.21.15.37:0/167103804 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f24f8100b20 0x7f24f8198f90 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.831+0000 7f24ff600640 1 -- 172.21.15.37:0/167103804 >> 172.21.15.37:0/167103804 conn(0x7f24f80fc730 msgr2=0x7f24f80fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.831+0000 7f24ff600640 1 -- 172.21.15.37:0/167103804 shutdown_connections 2024-08-20T05:19:23.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:23.831+0000 7f24ff600640 1 -- 172.21.15.37:0/167103804 wait complete. 2024-08-20T05:19:23.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:23 smithi130 ceph-mon[22007]: pgmap v915: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 341 B/s wr, 9 op/s 2024-08-20T05:19:24.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:23 smithi135 ceph-mon[22342]: pgmap v915: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 341 B/s wr, 9 op/s 2024-08-20T05:19:24.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd dump --format=json 2024-08-20T05:19:24.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:24 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/167103804' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:19:25.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:24 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/167103804' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:19:25.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:24 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/167103804' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-08-20T05:19:25.132 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:19:25.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.679+0000 7f83f7600640 1 -- 172.21.15.37:0/717847061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f010a7a0 msgr2=0x7f83f0115200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:25.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.679+0000 7f83f7600640 1 --2- 172.21.15.37:0/717847061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f010a7a0 0x7f83f0115200 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009900 tx=0x7f83dc02a480 comp rx=0 tx=0).stop 2024-08-20T05:19:25.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.679+0000 7f83f7600640 1 -- 172.21.15.37:0/717847061 shutdown_connections 2024-08-20T05:19:25.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.679+0000 7f83f7600640 1 --2- 172.21.15.37:0/717847061 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0115740 0x7f83f0117b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:25.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.679+0000 7f83f7600640 1 --2- 172.21.15.37:0/717847061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f010a7a0 0x7f83f0115200 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:25.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.679+0000 7f83f7600640 1 --2- 172.21.15.37:0/717847061 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83f0109e80 0x7f83f010a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:25.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.679+0000 7f83f7600640 1 -- 172.21.15.37:0/717847061 >> 172.21.15.37:0/717847061 conn(0x7f83f006dcc0 msgr2=0x7f83f006e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:25.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.679+0000 7f83f7600640 1 -- 172.21.15.37:0/717847061 shutdown_connections 2024-08-20T05:19:25.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.680+0000 7f83f7600640 1 -- 172.21.15.37:0/717847061 wait complete. 2024-08-20T05:19:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.680+0000 7f83f7600640 1 Processor -- start 2024-08-20T05:19:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.681+0000 7f83f7600640 1 -- start start 2024-08-20T05:19:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.681+0000 7f83f7600640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0109e80 0x7f83f01a3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.681+0000 7f83f7600640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83f010a7a0 0x7f83f01a3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.681+0000 7f83f7600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f0115740 0x7f83f01a9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.681+0000 7f83f7600640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f83f011b290 con 0x7f83f0115740 2024-08-20T05:19:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.681+0000 7f83f7600640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f83f011b110 con 0x7f83f010a7a0 2024-08-20T05:19:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.681+0000 7f83f7600640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f83f011b410 con 0x7f83f0109e80 2024-08-20T05:19:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.681+0000 7f83f5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f0115740 0x7f83f01a9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.681+0000 7f83f4c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0109e80 0x7f83f01a3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.681+0000 7f83f4c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0109e80 0x7f83f01a3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.135:3300/0 says I am v2:172.21.15.37:56814/0 (socket says 172.21.15.37:56814) 2024-08-20T05:19:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.681+0000 7f83f4c00640 1 -- 172.21.15.37:0/124677209 learned_addr learned my addr 172.21.15.37:0/124677209 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:19:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.681+0000 7f83f5600640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f0115740 0x7f83f01a9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54582/0 (socket says 172.21.15.37:54582) 2024-08-20T05:19:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.681+0000 7f83efe00640 1 --2- 172.21.15.37:0/124677209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83f010a7a0 0x7f83f01a3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.682+0000 7f83f5600640 1 -- 172.21.15.37:0/124677209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0109e80 msgr2=0x7f83f01a3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.682+0000 7f83f5600640 1 --2- 172.21.15.37:0/124677209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0109e80 0x7f83f01a3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.682+0000 7f83f5600640 1 -- 172.21.15.37:0/124677209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83f010a7a0 msgr2=0x7f83f01a3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.682+0000 7f83f5600640 1 --2- 172.21.15.37:0/124677209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83f010a7a0 0x7f83f01a3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.682+0000 7f83f5600640 1 -- 172.21.15.37:0/124677209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f01a9a00 con 0x7f83f0115740 2024-08-20T05:19:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.682+0000 7f83f4c00640 1 --2- 172.21.15.37:0/124677209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0109e80 0x7f83f01a3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:19:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.682+0000 7f83f5600640 1 --2- 172.21.15.37:0/124677209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f0115740 0x7f83f01a9230 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f83e8005fd0 tx=0x7f83e800edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.682+0000 7f83ed600640 1 -- 172.21.15.37:0/124677209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e8004d20 con 0x7f83f0115740 2024-08-20T05:19:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.682+0000 7f83f7600640 1 -- 172.21.15.37:0/124677209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f01a9cf0 con 0x7f83f0115740 2024-08-20T05:19:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.683+0000 7f83ed600640 1 -- 172.21.15.37:0/124677209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83e8005020 con 0x7f83f0115740 2024-08-20T05:19:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.683+0000 7f83ed600640 1 -- 172.21.15.37:0/124677209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e80116b0 con 0x7f83f0115740 2024-08-20T05:19:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.683+0000 7f83f7600640 1 -- 172.21.15.37:0/124677209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f01b03b0 con 0x7f83f0115740 2024-08-20T05:19:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.684+0000 7f83f7600640 1 -- 172.21.15.37:0/124677209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83f0074640 con 0x7f83f0115740 2024-08-20T05:19:25.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.686+0000 7f83ed600640 1 -- 172.21.15.37:0/124677209 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f83e80054d0 con 0x7f83f0115740 2024-08-20T05:19:25.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.687+0000 7f83ed600640 1 --2- 172.21.15.37:0/124677209 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83d80b3bd0 0x7f83d80b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:25.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.688+0000 7f83ed600640 1 -- 172.21.15.37:0/124677209 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7f83e80e40b0 con 0x7f83f0115740 2024-08-20T05:19:25.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.688+0000 7f83f4c00640 1 --2- 172.21.15.37:0/124677209 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83d80b3bd0 0x7f83d80b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:25.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.688+0000 7f83f4c00640 1 --2- 172.21.15.37:0/124677209 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83d80b3bd0 0x7f83d80b6090 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f83e4011550 tx=0x7f83e4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:25.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.689+0000 7f83ed600640 1 -- 172.21.15.37:0/124677209 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f83e8016030 con 0x7f83f0115740 2024-08-20T05:19:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.885+0000 7f83f7600640 1 -- 172.21.15.37:0/124677209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83f01b0640 con 0x7f83f0115740 2024-08-20T05:19:25.887 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:25 smithi037 ceph-mon[17265]: pgmap v916: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-08-20T05:19:25.888 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.887+0000 7f83ed600640 1 -- 172.21.15.37:0/124677209 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24873 (secure 0 0 0) 0x7f83e80aacb0 con 0x7f83f0115740 2024-08-20T05:19:25.889 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-08-20T05:19:25.889 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":88,"fsid":"93c5cea6-5eaf-11ef-bccf-c7b262605968","created":"2024-08-20T04:50:26.520303+0000","modified":"2024-08-20T05:01:30.328315+0000","last_up_change":"2024-08-20T04:58:12.250259+0000","last_in_change":"2024-08-20T04:57:49.724189+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-20T04:54:16.381529+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-20T04:59:08.598741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-20T04:59:10.793802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-20T04:59:19.888446+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a813e53b-68b3-43ff-a59b-aed00e98f2fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6803","nonce":3569936373}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6805","nonce":3569936373}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6809","nonce":3569936373}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3569936373},{"type":"v1","addr":"172.21.15.37:6807","nonce":3569936373}]},"public_addr":"172.21.15.37:6803/3569936373","cluster_addr":"172.21.15.37:6805/3569936373","heartbeat_back_addr":"172.21.15.37:6809/3569936373","heartbeat_front_addr":"172.21.15.37:6807/3569936373","state":["exists","up"]},{"osd":1,"uuid":"c216a8d0-9685-467a-8161-700682ce617c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6800","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6801","nonce":4206461125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6802","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6803","nonce":4206461125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6806","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6807","nonce":4206461125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6804","nonce":4206461125},{"type":"v1","addr":"172.21.15.130:6805","nonce":4206461125}]},"public_addr":"172.21.15.130:6801/4206461125","cluster_addr":"172.21.15.130:6803/4206461125","heartbeat_back_addr":"172.21.15.130:6807/4206461125","heartbeat_front_addr":"172.21.15.130:6805/4206461125","state":["exists","up"]},{"osd":2,"uuid":"34402442-c652-40eb-865e-a607a28846b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6801","nonce":2653255199}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6803","nonce":2653255199}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6807","nonce":2653255199}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2653255199},{"type":"v1","addr":"172.21.15.135:6805","nonce":2653255199}]},"public_addr":"172.21.15.135:6801/2653255199","cluster_addr":"172.21.15.135:6803/2653255199","heartbeat_back_addr":"172.21.15.135:6807/2653255199","heartbeat_front_addr":"172.21.15.135:6805/2653255199","state":["exists","up"]},{"osd":3,"uuid":"ec7be9dc-96b5-4816-9065-8121baedcdc5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6811","nonce":2601290990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6813","nonce":2601290990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6817","nonce":2601290990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":2601290990},{"type":"v1","addr":"172.21.15.37:6815","nonce":2601290990}]},"public_addr":"172.21.15.37:6811/2601290990","cluster_addr":"172.21.15.37:6813/2601290990","heartbeat_back_addr":"172.21.15.37:6817/2601290990","heartbeat_front_addr":"172.21.15.37:6815/2601290990","state":["exists","up"]},{"osd":4,"uuid":"2dbd47f9-8686-4707-8862-3c7a99a37d73","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6808","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6809","nonce":3542081474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6810","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6811","nonce":3542081474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6814","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6815","nonce":3542081474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6812","nonce":3542081474},{"type":"v1","addr":"172.21.15.130:6813","nonce":3542081474}]},"public_addr":"172.21.15.130:6809/3542081474","cluster_addr":"172.21.15.130:6811/3542081474","heartbeat_back_addr":"172.21.15.130:6815/3542081474","heartbeat_front_addr":"172.21.15.130:6813/3542081474","state":["exists","up"]},{"osd":5,"uuid":"9a07a137-d6b7-4aba-8678-4fd164597f27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6809","nonce":2507249148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6811","nonce":2507249148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6815","nonce":2507249148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":2507249148},{"type":"v1","addr":"172.21.15.135:6813","nonce":2507249148}]},"public_addr":"172.21.15.135:6809/2507249148","cluster_addr":"172.21.15.135:6811/2507249148","heartbeat_back_addr":"172.21.15.135:6815/2507249148","heartbeat_front_addr":"172.21.15.135:6813/2507249148","state":["exists","up"]},{"osd":6,"uuid":"6d6346e8-5418-4c30-9bb3-5af352b616a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6819","nonce":155932692}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6821","nonce":155932692}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6825","nonce":155932692}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":155932692},{"type":"v1","addr":"172.21.15.37:6823","nonce":155932692}]},"public_addr":"172.21.15.37:6819/155932692","cluster_addr":"172.21.15.37:6821/155932692","heartbeat_back_addr":"172.21.15.37:6825/155932692","heartbeat_front_addr":"172.21.15.37:6823/155932692","state":["exists","up"]},{"osd":7,"uuid":"c87804c2-d456-495e-b36e-33dbb3548347","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6816","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6817","nonce":4148130245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6818","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6819","nonce":4148130245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6822","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6823","nonce":4148130245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6820","nonce":4148130245},{"type":"v1","addr":"172.21.15.130:6821","nonce":4148130245}]},"public_addr":"172.21.15.130:6817/4148130245","cluster_addr":"172.21.15.130:6819/4148130245","heartbeat_back_addr":"172.21.15.130:6823/4148130245","heartbeat_front_addr":"172.21.15.130:6821/4148130245","state":["exists","up"]},{"osd":8,"uuid":"a7d4c9c8-1826-4703-92ad-ded2800b4780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6817","nonce":222884649}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6819","nonce":222884649}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6823","nonce":222884649}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":222884649},{"type":"v1","addr":"172.21.15.135:6821","nonce":222884649}]},"public_addr":"172.21.15.135:6817/222884649","cluster_addr":"172.21.15.135:6819/222884649","heartbeat_back_addr":"172.21.15.135:6823/222884649","heartbeat_front_addr":"172.21.15.135:6821/222884649","state":["exists","up"]},{"osd":9,"uuid":"f9e0c194-66b5-4e62-b2ae-816a4a4fffbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6827","nonce":2240773042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6829","nonce":2240773042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6833","nonce":2240773042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2240773042},{"type":"v1","addr":"172.21.15.37:6831","nonce":2240773042}]},"public_addr":"172.21.15.37:6827/2240773042","cluster_addr":"172.21.15.37:6829/2240773042","heartbeat_back_addr":"172.21.15.37:6833/2240773042","heartbeat_front_addr":"172.21.15.37:6831/2240773042","state":["exists","up"]},{"osd":10,"uuid":"fa6a50a5-2b97-42d1-9b57-b5502b7083d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6824","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6825","nonce":2896730163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6826","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6827","nonce":2896730163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6830","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6831","nonce":2896730163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.130:6828","nonce":2896730163},{"type":"v1","addr":"172.21.15.130:6829","nonce":2896730163}]},"public_addr":"172.21.15.130:6825/2896730163","cluster_addr":"172.21.15.130:6827/2896730163","heartbeat_back_addr":"172.21.15.130:6831/2896730163","heartbeat_front_addr":"172.21.15.130:6829/2896730163","state":["exists","up"]},{"osd":11,"uuid":"9a305d75-030d-41db-abfb-81bb71e8c6db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6825","nonce":2532897645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6827","nonce":2532897645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6831","nonce":2532897645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":2532897645},{"type":"v1","addr":"172.21.15.135:6829","nonce":2532897645}]},"public_addr":"172.21.15.135:6825/2532897645","cluster_addr":"172.21.15.135:6827/2532897645","heartbeat_back_addr":"172.21.15.135:6831/2532897645","heartbeat_front_addr":"172.21.15.135:6829/2532897645","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:26.455665+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:53:51.456030+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:14.332699+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:54:42.749386+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:07.587091+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:55:32.450249+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:01.864489+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:26.830527+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:56:51.206257+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:20.400020+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:57:46.329864+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-20T04:58:11.086508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1b","mappings":[{"from":2,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.5","mappings":[{"from":9,"to":10}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.1b","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4282140105":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/1217599998":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/3737412906":"2024-08-21T04:51:27.877907+0000","172.21.15.37:6801/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/2577159152":"2024-08-21T04:50:59.520912+0000","172.21.15.37:6800/1372988755":"2024-08-21T04:51:27.877907+0000","172.21.15.37:0/58912454":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/2105948300":"2024-08-21T04:50:59.520912+0000","172.21.15.37:0/1480362562":"2024-08-21T04:50:59.520912+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-20T05:19:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.890+0000 7f83f7600640 1 -- 172.21.15.37:0/124677209 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83d80b3bd0 msgr2=0x7f83d80b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.890+0000 7f83f7600640 1 --2- 172.21.15.37:0/124677209 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83d80b3bd0 0x7f83d80b6090 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f83e4011550 tx=0x7f83e4005f90 comp rx=0 tx=0).stop 2024-08-20T05:19:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.890+0000 7f83f7600640 1 -- 172.21.15.37:0/124677209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f0115740 msgr2=0x7f83f01a9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.890+0000 7f83f7600640 1 --2- 172.21.15.37:0/124677209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f0115740 0x7f83f01a9230 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f83e8005fd0 tx=0x7f83e800edd0 comp rx=0 tx=0).stop 2024-08-20T05:19:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.890+0000 7f83f7600640 1 -- 172.21.15.37:0/124677209 shutdown_connections 2024-08-20T05:19:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.890+0000 7f83f7600640 1 --2- 172.21.15.37:0/124677209 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f83d80b3bd0 0x7f83d80b6090 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.890+0000 7f83f7600640 1 --2- 172.21.15.37:0/124677209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83f0115740 0x7f83f01a9230 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.890+0000 7f83f7600640 1 --2- 172.21.15.37:0/124677209 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f83f010a7a0 0x7f83f01a3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.890+0000 7f83f7600640 1 --2- 172.21.15.37:0/124677209 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f83f0109e80 0x7f83f01a3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.890+0000 7f83f7600640 1 -- 172.21.15.37:0/124677209 >> 172.21.15.37:0/124677209 conn(0x7f83f006dcc0 msgr2=0x7f83f010af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.890+0000 7f83f7600640 1 -- 172.21.15.37:0/124677209 shutdown_connections 2024-08-20T05:19:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:25.890+0000 7f83f7600640 1 -- 172.21.15.37:0/124677209 wait complete. 2024-08-20T05:19:25.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:25 smithi130 ceph-mon[22007]: pgmap v916: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-08-20T05:19:26.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:25 smithi135 ceph-mon[22342]: pgmap v916: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-08-20T05:19:26.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs fail cephfs 2024-08-20T05:19:27.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:26 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/124677209' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:19:27.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:26 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/124677209' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:19:27.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:26 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/124677209' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-08-20T05:19:27.210 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:19:27.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.857+0000 7fa0b4c00640 1 -- 172.21.15.37:0/2409787470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b0108330 msgr2=0x7fa0b0108770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:27.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.857+0000 7fa0b4c00640 1 --2- 172.21.15.37:0/2409787470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b0108330 0x7fa0b0108770 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa09c009900 tx=0x7fa09c02a410 comp rx=0 tx=0).stop 2024-08-20T05:19:27.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.857+0000 7fa0b4c00640 1 -- 172.21.15.37:0/2409787470 shutdown_connections 2024-08-20T05:19:27.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.857+0000 7fa0b4c00640 1 --2- 172.21.15.37:0/2409787470 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b0108cb0 0x7fa0b010f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:27.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.857+0000 7fa0b4c00640 1 --2- 172.21.15.37:0/2409787470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b0108330 0x7fa0b0108770 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:27.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.857+0000 7fa0b4c00640 1 --2- 172.21.15.37:0/2409787470 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b0102920 0x7fa0b0102d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:27.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.857+0000 7fa0b4c00640 1 -- 172.21.15.37:0/2409787470 >> 172.21.15.37:0/2409787470 conn(0x7fa0b00fe350 msgr2=0x7fa0b0100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:27.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.857+0000 7fa0b4c00640 1 -- 172.21.15.37:0/2409787470 shutdown_connections 2024-08-20T05:19:27.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.857+0000 7fa0b4c00640 1 -- 172.21.15.37:0/2409787470 wait complete. 2024-08-20T05:19:27.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.858+0000 7fa0b4c00640 1 Processor -- start 2024-08-20T05:19:27.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.858+0000 7fa0b4c00640 1 -- start start 2024-08-20T05:19:27.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.858+0000 7fa0b4c00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b0102920 0x7fa0b0198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:27.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.858+0000 7fa0b4c00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b0108330 0x7fa0b0199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:27.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.858+0000 7fa0b4c00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b0108cb0 0x7fa0b019e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:27.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.858+0000 7fa0b4c00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b01129c0 con 0x7fa0b0102920 2024-08-20T05:19:27.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.858+0000 7fa0b4c00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b0112840 con 0x7fa0b0108cb0 2024-08-20T05:19:27.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.858+0000 7fa0b4c00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b0112b40 con 0x7fa0b0108330 2024-08-20T05:19:27.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.859+0000 7fa0af400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b0102920 0x7fa0b0198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:27.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.859+0000 7fa0af400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b0102920 0x7fa0b0198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54600/0 (socket says 172.21.15.37:54600) 2024-08-20T05:19:27.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.859+0000 7fa0af400640 1 -- 172.21.15.37:0/910722052 learned_addr learned my addr 172.21.15.37:0/910722052 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:19:27.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.859+0000 7fa0afe00640 1 --2- 172.21.15.37:0/910722052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b0108cb0 0x7fa0b019e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:27.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.859+0000 7fa0aea00640 1 --2- 172.21.15.37:0/910722052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b0108330 0x7fa0b0199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:27.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.859+0000 7fa0af400640 1 -- 172.21.15.37:0/910722052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b0108330 msgr2=0x7fa0b0199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:27.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.859+0000 7fa0af400640 1 --2- 172.21.15.37:0/910722052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b0108330 0x7fa0b0199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:27.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.859+0000 7fa0af400640 1 -- 172.21.15.37:0/910722052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b0108cb0 msgr2=0x7fa0b019e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:27.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.859+0000 7fa0af400640 1 --2- 172.21.15.37:0/910722052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b0108cb0 0x7fa0b019e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:27.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.859+0000 7fa0af400640 1 -- 172.21.15.37:0/910722052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b019ee00 con 0x7fa0b0102920 2024-08-20T05:19:27.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.860+0000 7fa0af400640 1 --2- 172.21.15.37:0/910722052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b0102920 0x7fa0b0198d50 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000d950 tx=0x7fa0a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:27.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.860+0000 7fa0a7e00640 1 -- 172.21.15.37:0/910722052 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0017030 con 0x7fa0b0102920 2024-08-20T05:19:27.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.860+0000 7fa0a7e00640 1 -- 172.21.15.37:0/910722052 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa0a0004020 con 0x7fa0b0102920 2024-08-20T05:19:27.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.860+0000 7fa0a7e00640 1 -- 172.21.15.37:0/910722052 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a00047a0 con 0x7fa0b0102920 2024-08-20T05:19:27.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.860+0000 7fa0b4c00640 1 -- 172.21.15.37:0/910722052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b019f0f0 con 0x7fa0b0102920 2024-08-20T05:19:27.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.860+0000 7fa0b4c00640 1 -- 172.21.15.37:0/910722052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b01a57b0 con 0x7fa0b0102920 2024-08-20T05:19:27.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.861+0000 7fa0b4c00640 1 -- 172.21.15.37:0/910722052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b0102d00 con 0x7fa0b0102920 2024-08-20T05:19:27.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.863+0000 7fa0a7e00640 1 -- 172.21.15.37:0/910722052 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fa0a0009a30 con 0x7fa0b0102920 2024-08-20T05:19:27.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.865+0000 7fa0a7e00640 1 --2- 172.21.15.37:0/910722052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa0940b3cf0 0x7fa0940b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:27.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.865+0000 7fa0a7e00640 1 -- 172.21.15.37:0/910722052 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9158+0+0 (secure 0 0 0) 0x7fa0a00e39a0 con 0x7fa0b0102920 2024-08-20T05:19:27.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.865+0000 7fa0aea00640 1 --2- 172.21.15.37:0/910722052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa0940b3cf0 0x7fa0940b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:27.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.866+0000 7fa0aea00640 1 --2- 172.21.15.37:0/910722052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa0940b3cf0 0x7fa0940b61b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa09c005ab0 tx=0x7fa09c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:27.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:27.869+0000 7fa0a7e00640 1 -- 172.21.15.37:0/910722052 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fa0a00aabf0 con 0x7fa0b0102920 2024-08-20T05:19:28.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:27 smithi037 ceph-mon[17265]: pgmap v917: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2024-08-20T05:19:28.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:28.105+0000 7fa0b4c00640 1 -- 172.21.15.37:0/910722052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa0b01a5b90 con 0x7fa0b0102920 2024-08-20T05:19:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:28.107+0000 7fa0a7e00640 1 -- 172.21.15.37:0/910722052 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) ==== 161+0+0 (secure 0 0 0) 0x7fa0a00aa4f0 con 0x7fa0b0102920 2024-08-20T05:19:28.108 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-20T05:19:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:28.111+0000 7fa0b4c00640 1 -- 172.21.15.37:0/910722052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa0940b3cf0 msgr2=0x7fa0940b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:28.111+0000 7fa0b4c00640 1 --2- 172.21.15.37:0/910722052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa0940b3cf0 0x7fa0940b61b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa09c005ab0 tx=0x7fa09c005a20 comp rx=0 tx=0).stop 2024-08-20T05:19:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:28.111+0000 7fa0b4c00640 1 -- 172.21.15.37:0/910722052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b0102920 msgr2=0x7fa0b0198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:28.111+0000 7fa0b4c00640 1 --2- 172.21.15.37:0/910722052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b0102920 0x7fa0b0198d50 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000d950 tx=0x7fa0a000de10 comp rx=0 tx=0).stop 2024-08-20T05:19:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:28.112+0000 7fa0b4c00640 1 -- 172.21.15.37:0/910722052 shutdown_connections 2024-08-20T05:19:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:28.112+0000 7fa0b4c00640 1 --2- 172.21.15.37:0/910722052 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fa0940b3cf0 0x7fa0940b61b0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:28.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:28.112+0000 7fa0b4c00640 1 --2- 172.21.15.37:0/910722052 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fa0b0108cb0 0x7fa0b019e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:28.112+0000 7fa0b4c00640 1 --2- 172.21.15.37:0/910722052 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fa0b0108330 0x7fa0b0199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:28.112+0000 7fa0b4c00640 1 --2- 172.21.15.37:0/910722052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0b0102920 0x7fa0b0198d50 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:28.112+0000 7fa0b4c00640 1 -- 172.21.15.37:0/910722052 >> 172.21.15.37:0/910722052 conn(0x7fa0b00fe350 msgr2=0x7fa0b0100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:28.112+0000 7fa0b4c00640 1 -- 172.21.15.37:0/910722052 shutdown_connections 2024-08-20T05:19:28.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:28.113+0000 7fa0b4c00640 1 -- 172.21.15.37:0/910722052 wait complete. 2024-08-20T05:19:28.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:27 smithi135 ceph-mon[22342]: pgmap v917: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2024-08-20T05:19:28.150 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:27 smithi130 ceph-mon[22007]: pgmap v917: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2024-08-20T05:19:28.455 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b[51794]: ignoring --setuser ceph since I am not root 2024-08-20T05:19:28.455 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b[51794]: ignoring --setgroup ceph since I am not root 2024-08-20T05:19:28.456 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-mds[51798]: -- 172.21.15.130:0/1176791736 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5567d9c23c20 con 0x5567d9c01400 2024-08-20T05:19:28.456 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b[51794]: starting mds.b at 2024-08-20T05:19:28.456 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-e[51181]: ignoring --setuser ceph since I am not root 2024-08-20T05:19:28.456 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-e[51181]: ignoring --setgroup ceph since I am not root 2024-08-20T05:19:28.456 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-mds[51185]: -- 172.21.15.130:0/1410579324 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c6d2529c20 con 0x55c6d2507000 2024-08-20T05:19:28.456 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-e[51181]: starting mds.e at 2024-08-20T05:19:28.456 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-e[51181]: 2024-08-20T05:19:28.153+0000 7f6c8d1e5640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-08-20T05:19:28.457 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-k[50868]: ignoring --setuser ceph since I am not root 2024-08-20T05:19:28.457 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-k[50868]: ignoring --setgroup ceph since I am not root 2024-08-20T05:19:28.457 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-mds[50872]: -- 172.21.15.130:0/1655538159 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558f6587b860 con 0x558f65859400 2024-08-20T05:19:28.457 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-k[50868]: starting mds.k at 2024-08-20T05:19:28.457 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-h[51486]: ignoring --setuser ceph since I am not root 2024-08-20T05:19:28.457 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-h[51486]: ignoring --setgroup ceph since I am not root 2024-08-20T05:19:28.457 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-mds[51491]: -- 172.21.15.130:0/1800353980 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5632349cd860 con 0x5632349ab000 2024-08-20T05:19:28.457 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-h[51486]: starting mds.h at 2024-08-20T05:19:28.457 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-h[51486]: 2024-08-20T05:19:28.153+0000 7fde70624640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-08-20T05:19:28.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:28 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-a[17261]: 2024-08-20T05:19:28.105+0000 7fa7d0400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-20T05:19:28.516 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 05:19:28 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-a[60991]: ignoring --setuser ceph since I am not root 2024-08-20T05:19:28.516 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 05:19:28 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-a[60991]: ignoring --setgroup ceph since I am not root 2024-08-20T05:19:28.516 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 05:19:28 smithi037 ceph-mds[60995]: -- 172.21.15.37:0/1181995470 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56270fb49860 con 0x56270fb27400 2024-08-20T05:19:28.516 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 05:19:28 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-a[60991]: starting mds.a at 2024-08-20T05:19:28.517 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 05:19:28 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-g[60579]: ignoring --setuser ceph since I am not root 2024-08-20T05:19:28.517 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 05:19:28 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-g[60579]: ignoring --setgroup ceph since I am not root 2024-08-20T05:19:28.517 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 05:19:28 smithi037 ceph-mds[60583]: -- 172.21.15.37:0/280609986 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a523bf5860 con 0x55a523bd2800 2024-08-20T05:19:28.517 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 05:19:28 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-g[60579]: starting mds.g at 2024-08-20T05:19:28.615 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-l[51652]: ignoring --setuser ceph since I am not root 2024-08-20T05:19:28.616 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-l[51652]: ignoring --setgroup ceph since I am not root 2024-08-20T05:19:28.616 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-mds[51656]: -- 172.21.15.135:0/2057751456 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563b18debc20 con 0x563b18dc9400 2024-08-20T05:19:28.616 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-l[51652]: starting mds.l at 2024-08-20T05:19:28.616 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-f[51953]: ignoring --setuser ceph since I am not root 2024-08-20T05:19:28.616 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-f[51953]: ignoring --setgroup ceph since I am not root 2024-08-20T05:19:28.616 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-mds[51957]: -- 172.21.15.135:0/2521680711 <== mon.2 v2:172.21.15.130:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e55a401860 con 0x55e55a3df000 2024-08-20T05:19:28.616 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-f[51953]: starting mds.f at 2024-08-20T05:19:28.617 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-i[52567]: ignoring --setuser ceph since I am not root 2024-08-20T05:19:28.617 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-i[52567]: ignoring --setgroup ceph since I am not root 2024-08-20T05:19:28.617 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-mds[52571]: -- 172.21.15.135:0/1950854436 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562894ad1860 con 0x562894aaf000 2024-08-20T05:19:28.617 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-i[52567]: starting mds.i at 2024-08-20T05:19:28.617 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-c[52266]: ignoring --setuser ceph since I am not root 2024-08-20T05:19:28.617 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-c[52266]: ignoring --setgroup ceph since I am not root 2024-08-20T05:19:28.617 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-mds[52270]: -- 172.21.15.135:0/1533842354 <== mon.1 v2:172.21.15.135:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56376c71f860 con 0x56376c6fc800 2024-08-20T05:19:28.618 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-c[52266]: starting mds.c at 2024-08-20T05:19:28.618 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-c[52266]: 2024-08-20T05:19:28.195+0000 7f637bbbf640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-08-20T05:19:29.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:28 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/910722052' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-20T05:19:29.015 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:28 smithi037 ceph-mon[17265]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-20T05:19:29.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:28 smithi037 ceph-mon[17265]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-20T05:19:29.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:28 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/910722052' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-20T05:19:29.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:28 smithi037 ceph-mon[17265]: osdmap e89: 12 total, 12 up, 12 in 2024-08-20T05:19:29.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:28 smithi037 ceph-mon[17265]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-20T05:19:29.016 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:28 smithi037 ceph-mon[17265]: pgmap v919: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.9 KiB/s wr, 13 op/s 2024-08-20T05:19:29.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/910722052' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-20T05:19:29.115 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-mon[22342]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-20T05:19:29.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-mon[22342]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-20T05:19:29.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/910722052' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-20T05:19:29.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-mon[22342]: osdmap e89: 12 total, 12 up, 12 in 2024-08-20T05:19:29.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-mon[22342]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-20T05:19:29.116 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:28 smithi135 ceph-mon[22342]: pgmap v919: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.9 KiB/s wr, 13 op/s 2024-08-20T05:19:29.152 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-08-20T05:19:29.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/910722052' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-08-20T05:19:29.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-mon[22007]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-20T05:19:29.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-mon[22007]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-20T05:19:29.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/910722052' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-20T05:19:29.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-mon[22007]: osdmap e89: 12 total, 12 up, 12 in 2024-08-20T05:19:29.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-mon[22007]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-08-20T05:19:29.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:28 smithi130 ceph-mon[22007]: pgmap v919: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.9 KiB/s wr, 13 op/s 2024-08-20T05:19:29.536 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:19:30.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.111+0000 7f1006400640 1 -- 172.21.15.37:0/1772111800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f100010a520 msgr2=0x7f100010a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:30.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.111+0000 7f1006400640 1 --2- 172.21.15.37:0/1772111800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f100010a520 0x7f100010a960 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f0fec009900 tx=0x7f0fec02a3f0 comp rx=0 tx=0).stop 2024-08-20T05:19:30.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.111+0000 7f1006400640 1 -- 172.21.15.37:0/1772111800 shutdown_connections 2024-08-20T05:19:30.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.111+0000 7f1006400640 1 --2- 172.21.15.37:0/1772111800 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f100010aea0 0x7f10001116a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:30.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.111+0000 7f1006400640 1 --2- 172.21.15.37:0/1772111800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f100010a520 0x7f100010a960 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:30.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.111+0000 7f1006400640 1 --2- 172.21.15.37:0/1772111800 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f1000104b10 0x7f1000104ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:30.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.111+0000 7f1006400640 1 -- 172.21.15.37:0/1772111800 >> 172.21.15.37:0/1772111800 conn(0x7f1000100540 msgr2=0x7f1000102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:30.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.111+0000 7f1006400640 1 -- 172.21.15.37:0/1772111800 shutdown_connections 2024-08-20T05:19:30.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.111+0000 7f1006400640 1 -- 172.21.15.37:0/1772111800 wait complete. 2024-08-20T05:19:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.112+0000 7f1006400640 1 Processor -- start 2024-08-20T05:19:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.113+0000 7f1006400640 1 -- start start 2024-08-20T05:19:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.113+0000 7f1006400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1000104b10 0x7f100019af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.113+0000 7f1006400640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f100010a520 0x7f100019b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:30.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.113+0000 7f1006400640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100010aea0 0x7f10001a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:30.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.113+0000 7f1006400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1000114bb0 con 0x7f1000104b10 2024-08-20T05:19:30.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.113+0000 7f1006400640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f1000114a30 con 0x7f100010a520 2024-08-20T05:19:30.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.113+0000 7f1006400640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f1000114d30 con 0x7f100010aea0 2024-08-20T05:19:30.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.113+0000 7f1005000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1000104b10 0x7f100019af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:30.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.113+0000 7f0fffe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f100010a520 0x7f100019b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.114+0000 7f0fffe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f100010a520 0x7f100019b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:55524/0 (socket says 172.21.15.37:55524) 2024-08-20T05:19:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.114+0000 7f0fffe00640 1 -- 172.21.15.37:0/2299929971 learned_addr learned my addr 172.21.15.37:0/2299929971 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:19:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.114+0000 7f1005a00640 1 --2- 172.21.15.37:0/2299929971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100010aea0 0x7f10001a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.114+0000 7f1005a00640 1 -- 172.21.15.37:0/2299929971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f100010a520 msgr2=0x7f100019b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.114+0000 7f1005a00640 1 --2- 172.21.15.37:0/2299929971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f100010a520 0x7f100019b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.114+0000 7f1005a00640 1 -- 172.21.15.37:0/2299929971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1000104b10 msgr2=0x7f100019af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.114+0000 7f1005a00640 1 --2- 172.21.15.37:0/2299929971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1000104b10 0x7f100019af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.114+0000 7f1005a00640 1 -- 172.21.15.37:0/2299929971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10001a0fb0 con 0x7f100010aea0 2024-08-20T05:19:30.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.114+0000 7f1005a00640 1 --2- 172.21.15.37:0/2299929971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100010aea0 0x7f10001a07e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8016fd0 tx=0x7f0ff800ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.119+0000 7f0ffd600640 1 -- 172.21.15.37:0/2299929971 <== mon.1 v2:172.21.15.135:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8004d20 con 0x7f100010aea0 2024-08-20T05:19:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.119+0000 7f0ffd600640 1 -- 172.21.15.37:0/2299929971 <== mon.1 v2:172.21.15.135:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ff8015e20 con 0x7f100010aea0 2024-08-20T05:19:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.119+0000 7f1006400640 1 -- 172.21.15.37:0/2299929971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10001a12a0 con 0x7f100010aea0 2024-08-20T05:19:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.119+0000 7f0ffd600640 1 -- 172.21.15.37:0/2299929971 <== mon.1 v2:172.21.15.135:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff80054c0 con 0x7f100010aea0 2024-08-20T05:19:30.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.119+0000 7f1006400640 1 -- 172.21.15.37:0/2299929971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10000772c0 con 0x7f100010aea0 2024-08-20T05:19:30.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.121+0000 7f1006400640 1 -- 172.21.15.37:0/2299929971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1000104ef0 con 0x7f100010aea0 2024-08-20T05:19:30.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.123+0000 7f0ffd600640 1 -- 172.21.15.37:0/2299929971 <== mon.1 v2:172.21.15.135:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f0ff800bb00 con 0x7f100010aea0 2024-08-20T05:19:30.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.124+0000 7f0ffd600640 1 --2- 172.21.15.37:0/2299929971 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0fe80b3cf0 0x7f0fe80b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:30.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.124+0000 7f0ffd600640 1 -- 172.21.15.37:0/2299929971 <== mon.1 v2:172.21.15.135:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9588+0+0 (secure 0 0 0) 0x7f0ff80ec8b0 con 0x7f100010aea0 2024-08-20T05:19:30.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.125+0000 7f1005000640 1 --2- 172.21.15.37:0/2299929971 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0fe80b3cf0 0x7f0fe80b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:30.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.125+0000 7f1005000640 1 --2- 172.21.15.37:0/2299929971 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0fe80b3cf0 0x7f0fe80b61b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40095f0 tx=0x7f0ff4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:30.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.143+0000 7f0ffd600640 1 -- 172.21.15.37:0/2299929971 <== mon.1 v2:172.21.15.135:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f0ff80b3950 con 0x7f100010aea0 2024-08-20T05:19:30.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.130:6833/2226122241,v1:172.21.15.130:6832/2226122241] up:boot 2024-08-20T05:19:30.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.130:6834/3937997869,v1:172.21.15.130:6835/3937997869] up:boot 2024-08-20T05:19:30.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.130:6836/650903486,v1:172.21.15.130:6838/650903486] up:boot 2024-08-20T05:19:30.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.130:6837/1558447361,v1:172.21.15.130:6839/1558447361] up:boot 2024-08-20T05:19:30.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.37:6838/1261210348,v1:172.21.15.37:6839/1261210348] up:boot 2024-08-20T05:19:30.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.37:6840/272877409,v1:172.21.15.37:6841/272877409] up:boot 2024-08-20T05:19:30.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.135:6832/2487170868,v1:172.21.15.135:6834/2487170868] up:boot 2024-08-20T05:19:30.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.135:6833/1099691380,v1:172.21.15.135:6835/1099691380] up:boot 2024-08-20T05:19:30.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.135:6837/2999966150,v1:172.21.15.135:6839/2999966150] up:boot 2024-08-20T05:19:30.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: mds.? [v2:172.21.15.135:6836/1806762837,v1:172.21.15.135:6838/1806762837] up:boot 2024-08-20T05:19:30.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-20T05:19:30.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-20T05:19:30.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-20T05:19:30.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T05:19:30.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T05:19:30.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T05:19:30.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-20T05:19:30.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T05:19:30.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T05:19:30.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T05:19:30.267 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:30 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-20T05:19:30.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:30.381+0000 7f1006400640 1 -- 172.21.15.37:0/2299929971 --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f10000775e0 con 0x7f100010aea0 2024-08-20T05:19:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.130:6833/2226122241,v1:172.21.15.130:6832/2226122241] up:boot 2024-08-20T05:19:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.130:6834/3937997869,v1:172.21.15.130:6835/3937997869] up:boot 2024-08-20T05:19:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.130:6836/650903486,v1:172.21.15.130:6838/650903486] up:boot 2024-08-20T05:19:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.130:6837/1558447361,v1:172.21.15.130:6839/1558447361] up:boot 2024-08-20T05:19:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.37:6838/1261210348,v1:172.21.15.37:6839/1261210348] up:boot 2024-08-20T05:19:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.37:6840/272877409,v1:172.21.15.37:6841/272877409] up:boot 2024-08-20T05:19:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.135:6832/2487170868,v1:172.21.15.135:6834/2487170868] up:boot 2024-08-20T05:19:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.135:6833/1099691380,v1:172.21.15.135:6835/1099691380] up:boot 2024-08-20T05:19:30.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.135:6837/2999966150,v1:172.21.15.135:6839/2999966150] up:boot 2024-08-20T05:19:30.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: mds.? [v2:172.21.15.135:6836/1806762837,v1:172.21.15.135:6838/1806762837] up:boot 2024-08-20T05:19:30.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-20T05:19:30.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-20T05:19:30.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-20T05:19:30.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T05:19:30.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T05:19:30.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T05:19:30.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-20T05:19:30.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T05:19:30.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T05:19:30.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T05:19:30.457 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:30 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-20T05:19:30.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.130:6833/2226122241,v1:172.21.15.130:6832/2226122241] up:boot 2024-08-20T05:19:30.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.130:6834/3937997869,v1:172.21.15.130:6835/3937997869] up:boot 2024-08-20T05:19:30.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.130:6836/650903486,v1:172.21.15.130:6838/650903486] up:boot 2024-08-20T05:19:30.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.130:6837/1558447361,v1:172.21.15.130:6839/1558447361] up:boot 2024-08-20T05:19:30.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.37:6838/1261210348,v1:172.21.15.37:6839/1261210348] up:boot 2024-08-20T05:19:30.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.37:6840/272877409,v1:172.21.15.37:6841/272877409] up:boot 2024-08-20T05:19:30.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.135:6832/2487170868,v1:172.21.15.135:6834/2487170868] up:boot 2024-08-20T05:19:30.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.135:6833/1099691380,v1:172.21.15.135:6835/1099691380] up:boot 2024-08-20T05:19:30.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.135:6837/2999966150,v1:172.21.15.135:6839/2999966150] up:boot 2024-08-20T05:19:30.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: mds.? [v2:172.21.15.135:6836/1806762837,v1:172.21.15.135:6838/1806762837] up:boot 2024-08-20T05:19:30.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-08-20T05:19:30.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-08-20T05:19:30.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-08-20T05:19:30.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-08-20T05:19:30.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-08-20T05:19:30.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-08-20T05:19:30.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-08-20T05:19:30.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-08-20T05:19:30.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-08-20T05:19:30.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-08-20T05:19:30.617 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:30 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-08-20T05:19:31.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:31.126+0000 7f0ffd600640 1 -- 172.21.15.37:0/2299929971 <== mon.1 v2:172.21.15.135:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v59) ==== 104+0+0 (secure 0 0 0) 0x7f0ff80b3250 con 0x7f100010aea0 2024-08-20T05:19:31.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:31.129+0000 7f1006400640 1 -- 172.21.15.37:0/2299929971 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0fe80b3cf0 msgr2=0x7f0fe80b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:31.129+0000 7f1006400640 1 --2- 172.21.15.37:0/2299929971 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0fe80b3cf0 0x7f0fe80b61b0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0ff40095f0 tx=0x7f0ff4005f90 comp rx=0 tx=0).stop 2024-08-20T05:19:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:31.129+0000 7f1006400640 1 -- 172.21.15.37:0/2299929971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100010aea0 msgr2=0x7f10001a07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:31.129+0000 7f1006400640 1 --2- 172.21.15.37:0/2299929971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100010aea0 0x7f10001a07e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8016fd0 tx=0x7f0ff800ca50 comp rx=0 tx=0).stop 2024-08-20T05:19:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:31.129+0000 7f1006400640 1 -- 172.21.15.37:0/2299929971 shutdown_connections 2024-08-20T05:19:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:31.129+0000 7f1006400640 1 --2- 172.21.15.37:0/2299929971 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f0fe80b3cf0 0x7f0fe80b61b0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:31.129+0000 7f1006400640 1 --2- 172.21.15.37:0/2299929971 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f100010aea0 0x7f10001a07e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:31.129+0000 7f1006400640 1 --2- 172.21.15.37:0/2299929971 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f100010a520 0x7f100019b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:31.129+0000 7f1006400640 1 --2- 172.21.15.37:0/2299929971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1000104b10 0x7f100019af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:31.129+0000 7f1006400640 1 -- 172.21.15.37:0/2299929971 >> 172.21.15.37:0/2299929971 conn(0x7f1000100540 msgr2=0x7f1000103a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:31.130+0000 7f1006400640 1 -- 172.21.15.37:0/2299929971 shutdown_connections 2024-08-20T05:19:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:31.130+0000 7f1006400640 1 -- 172.21.15.37:0/2299929971 wait complete. 2024-08-20T05:19:31.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:31 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/2299929971' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-20T05:19:31.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:31 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-20T05:19:31.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:31 smithi130 ceph-mon[22007]: pgmap v920: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.1 KiB/s wr, 13 op/s 2024-08-20T05:19:31.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:31 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/2299929971' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-20T05:19:31.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:31 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-20T05:19:31.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:31 smithi037 ceph-mon[17265]: pgmap v920: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.1 KiB/s wr, 13 op/s 2024-08-20T05:19:31.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:31 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/2299929971' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-20T05:19:31.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:31 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-08-20T05:19:31.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:31 smithi135 ceph-mon[22342]: pgmap v920: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.1 KiB/s wr, 13 op/s 2024-08-20T05:19:32.288 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:32 smithi037 ceph-mon[17265]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-20T05:19:32.289 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:32 smithi037 ceph-mon[17265]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-20T05:19:32.289 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:32 smithi037 ceph-mon[17265]: Cluster is now healthy 2024-08-20T05:19:32.289 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:32 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-20T05:19:32.289 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:32 smithi037 ceph-mon[17265]: fsmap 12 up:standby 2024-08-20T05:19:32.292 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-20T05:19:32.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:32 smithi130 ceph-mon[22007]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-20T05:19:32.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:32 smithi130 ceph-mon[22007]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-20T05:19:32.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:32 smithi130 ceph-mon[22007]: Cluster is now healthy 2024-08-20T05:19:32.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:32 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-20T05:19:32.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:32 smithi130 ceph-mon[22007]: fsmap 12 up:standby 2024-08-20T05:19:32.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:32 smithi135 ceph-mon[22342]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-20T05:19:32.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:32 smithi135 ceph-mon[22342]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-20T05:19:32.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:32 smithi135 ceph-mon[22342]: Cluster is now healthy 2024-08-20T05:19:32.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:32 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-20T05:19:32.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:32 smithi135 ceph-mon[22342]: fsmap 12 up:standby 2024-08-20T05:19:32.675 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:19:33.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.265+0000 7f64a7e00640 1 -- 172.21.15.37:0/1033988946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a8077400 msgr2=0x7f64a80777e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.265+0000 7f64a7e00640 1 --2- 172.21.15.37:0/1033988946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a8077400 0x7f64a80777e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6498009900 tx=0x7f649802a410 comp rx=0 tx=0).stop 2024-08-20T05:19:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.265+0000 7f64a7e00640 1 -- 172.21.15.37:0/1033988946 shutdown_connections 2024-08-20T05:19:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.265+0000 7f64a7e00640 1 --2- 172.21.15.37:0/1033988946 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64a81134f0 0x7f64a81158e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.265+0000 7f64a7e00640 1 --2- 172.21.15.37:0/1033988946 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a8077d20 0x7f64a8112fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.265+0000 7f64a7e00640 1 --2- 172.21.15.37:0/1033988946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a8077400 0x7f64a80777e0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.265+0000 7f64a7e00640 1 -- 172.21.15.37:0/1033988946 >> 172.21.15.37:0/1033988946 conn(0x7f64a8100550 msgr2=0x7f64a8102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.265+0000 7f64a7e00640 1 -- 172.21.15.37:0/1033988946 shutdown_connections 2024-08-20T05:19:33.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.265+0000 7f64a7e00640 1 -- 172.21.15.37:0/1033988946 wait complete. 2024-08-20T05:19:33.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.266+0000 7f64a7e00640 1 Processor -- start 2024-08-20T05:19:33.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.266+0000 7f64a7e00640 1 -- start start 2024-08-20T05:19:33.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.267+0000 7f64a7e00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a8077400 0x7f64a819f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:33.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.267+0000 7f64a7e00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a8077d20 0x7f64a819f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:33.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.267+0000 7f64a7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64a81134f0 0x7f64a81a4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:33.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.267+0000 7f64a7e00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f64a8118f50 con 0x7f64a8077400 2024-08-20T05:19:33.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.267+0000 7f64a7e00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f64a8118dd0 con 0x7f64a8077d20 2024-08-20T05:19:33.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.267+0000 7f64a7e00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f64a81190d0 con 0x7f64a81134f0 2024-08-20T05:19:33.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.267+0000 7f64a6a00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a8077400 0x7f64a819f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:33.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.267+0000 7f649e000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a8077d20 0x7f64a819f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:33.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.267+0000 7f649e000640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a8077d20 0x7f64a819f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.130:3300/0 says I am v2:172.21.15.37:33624/0 (socket says 172.21.15.37:33624) 2024-08-20T05:19:33.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.267+0000 7f649e000640 1 -- 172.21.15.37:0/1955082445 learned_addr learned my addr 172.21.15.37:0/1955082445 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:19:33.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.267+0000 7f64a7400640 1 --2- 172.21.15.37:0/1955082445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64a81134f0 0x7f64a81a4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:33.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.268+0000 7f649e000640 1 -- 172.21.15.37:0/1955082445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64a81134f0 msgr2=0x7f64a81a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:33.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.268+0000 7f649e000640 1 --2- 172.21.15.37:0/1955082445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64a81134f0 0x7f64a81a4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:33.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.268+0000 7f649e000640 1 -- 172.21.15.37:0/1955082445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a8077400 msgr2=0x7f64a819f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:33.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.268+0000 7f649e000640 1 --2- 172.21.15.37:0/1955082445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a8077400 0x7f64a819f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:33.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.268+0000 7f649e000640 1 -- 172.21.15.37:0/1955082445 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a81a53b0 con 0x7f64a8077d20 2024-08-20T05:19:33.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.268+0000 7f64a6a00640 1 --2- 172.21.15.37:0/1955082445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a8077400 0x7f64a819f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-20T05:19:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.268+0000 7f649e000640 1 --2- 172.21.15.37:0/1955082445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a8077d20 0x7f64a819f840 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f649000e9f0 tx=0x7f649000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.268+0000 7f649fe00640 1 -- 172.21.15.37:0/1955082445 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649000cd80 con 0x7f64a8077d20 2024-08-20T05:19:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.268+0000 7f64a7e00640 1 -- 172.21.15.37:0/1955082445 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a81a56a0 con 0x7f64a8077d20 2024-08-20T05:19:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.268+0000 7f649fe00640 1 -- 172.21.15.37:0/1955082445 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64900108e0 con 0x7f64a8077d20 2024-08-20T05:19:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.268+0000 7f649fe00640 1 -- 172.21.15.37:0/1955082445 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6490018980 con 0x7f64a8077d20 2024-08-20T05:19:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.268+0000 7f64a7e00640 1 -- 172.21.15.37:0/1955082445 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a81abf30 con 0x7f64a8077d20 2024-08-20T05:19:33.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.269+0000 7f64a7e00640 1 -- 172.21.15.37:0/1955082445 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64a8078910 con 0x7f64a8077d20 2024-08-20T05:19:33.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.272+0000 7f649fe00640 1 -- 172.21.15.37:0/1955082445 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f6490010430 con 0x7f64a8077d20 2024-08-20T05:19:33.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.273+0000 7f649fe00640 1 --2- 172.21.15.37:0/1955082445 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f648c0b3cf0 0x7f648c0b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:33.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.273+0000 7f649fe00640 1 -- 172.21.15.37:0/1955082445 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9588+0+0 (secure 0 0 0) 0x7f64900e46d0 con 0x7f64a8077d20 2024-08-20T05:19:33.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.273+0000 7f64a6a00640 1 --2- 172.21.15.37:0/1955082445 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f648c0b3cf0 0x7f648c0b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:33.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.274+0000 7f64a6a00640 1 --2- 172.21.15.37:0/1955082445 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f648c0b3cf0 0x7f648c0b61b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6498005ab0 tx=0x7f6498005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:33.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.275+0000 7f649fe00640 1 -- 172.21.15.37:0/1955082445 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f64900ab120 con 0x7f64a8077d20 2024-08-20T05:19:33.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:33 smithi130 ceph-mon[22007]: pgmap v921: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-08-20T05:19:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:33.471+0000 7f64a7e00640 1 -- 172.21.15.37:0/1955082445 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f64a80777e0 con 0x7f64a8077d20 2024-08-20T05:19:33.473 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:33 smithi037 ceph-mon[17265]: pgmap v921: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-08-20T05:19:33.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:33 smithi135 ceph-mon[22342]: pgmap v921: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2024-08-20T05:19:34.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:34.135+0000 7f649fe00640 1 -- 172.21.15.37:0/1955082445 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) ==== 181+0+0 (secure 0 0 0) 0x7f64a80777e0 con 0x7f64a8077d20 2024-08-20T05:19:34.138 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2024-08-20T05:19:34.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:34.139+0000 7f64a7e00640 1 -- 172.21.15.37:0/1955082445 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f648c0b3cf0 msgr2=0x7f648c0b61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:34.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:34.139+0000 7f64a7e00640 1 --2- 172.21.15.37:0/1955082445 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f648c0b3cf0 0x7f648c0b61b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6498005ab0 tx=0x7f6498005a20 comp rx=0 tx=0).stop 2024-08-20T05:19:34.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:34.139+0000 7f64a7e00640 1 -- 172.21.15.37:0/1955082445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a8077d20 msgr2=0x7f64a819f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:34.139+0000 7f64a7e00640 1 --2- 172.21.15.37:0/1955082445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a8077d20 0x7f64a819f840 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f649000e9f0 tx=0x7f649000eeb0 comp rx=0 tx=0).stop 2024-08-20T05:19:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:34.139+0000 7f64a7e00640 1 -- 172.21.15.37:0/1955082445 shutdown_connections 2024-08-20T05:19:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:34.139+0000 7f64a7e00640 1 --2- 172.21.15.37:0/1955082445 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f648c0b3cf0 0x7f648c0b61b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:34.139+0000 7f64a7e00640 1 --2- 172.21.15.37:0/1955082445 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f64a81134f0 0x7f64a81a4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:34.139+0000 7f64a7e00640 1 --2- 172.21.15.37:0/1955082445 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f64a8077d20 0x7f64a819f840 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:34.139+0000 7f64a7e00640 1 --2- 172.21.15.37:0/1955082445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64a8077400 0x7f64a819f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:34.139+0000 7f64a7e00640 1 -- 172.21.15.37:0/1955082445 >> 172.21.15.37:0/1955082445 conn(0x7f64a8100550 msgr2=0x7f64a8102940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:34.140+0000 7f64a7e00640 1 -- 172.21.15.37:0/1955082445 shutdown_connections 2024-08-20T05:19:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:34.140+0000 7f64a7e00640 1 -- 172.21.15.37:0/1955082445 wait complete. 2024-08-20T05:19:34.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:34 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/1955082445' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T05:19:34.367 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:34 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T05:19:34.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:34 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/1955082445' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T05:19:34.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:34 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T05:19:34.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:34 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/1955082445' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T05:19:34.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:34 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T05:19:35.248 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-20T05:19:35.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:35 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T05:19:35.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:35 smithi130 ceph-mon[22007]: osdmap e90: 12 total, 12 up, 12 in 2024-08-20T05:19:35.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:35 smithi130 ceph-mon[22007]: pgmap v923: 97 pgs: 97 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T05:19:35.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:35 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T05:19:35.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:35 smithi037 ceph-mon[17265]: osdmap e90: 12 total, 12 up, 12 in 2024-08-20T05:19:35.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:35 smithi037 ceph-mon[17265]: pgmap v923: 97 pgs: 97 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T05:19:35.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:35 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T05:19:35.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:35 smithi135 ceph-mon[22342]: osdmap e90: 12 total, 12 up, 12 in 2024-08-20T05:19:35.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:35 smithi135 ceph-mon[22342]: pgmap v923: 97 pgs: 97 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T05:19:35.636 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:19:36.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.280+0000 7fddbee00640 1 -- 172.21.15.37:0/3129536611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddb8113690 msgr2=0x7fddb8115a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.280+0000 7fddbee00640 1 --2- 172.21.15.37:0/3129536611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddb8113690 0x7fddb8115a80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fddb0009be0 tx=0x7fddb002a6c0 comp rx=0 tx=0).stop 2024-08-20T05:19:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.280+0000 7fddbee00640 1 -- 172.21.15.37:0/3129536611 shutdown_connections 2024-08-20T05:19:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.280+0000 7fddbee00640 1 --2- 172.21.15.37:0/3129536611 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddb8113690 0x7fddb8115a80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.280+0000 7fddbee00640 1 --2- 172.21.15.37:0/3129536611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8077d20 0x7fddb8113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.280+0000 7fddbee00640 1 --2- 172.21.15.37:0/3129536611 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddb8077400 0x7fddb80777e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.280+0000 7fddbee00640 1 -- 172.21.15.37:0/3129536611 >> 172.21.15.37:0/3129536611 conn(0x7fddb8100730 msgr2=0x7fddb8102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.280+0000 7fddbee00640 1 -- 172.21.15.37:0/3129536611 shutdown_connections 2024-08-20T05:19:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.280+0000 7fddbee00640 1 -- 172.21.15.37:0/3129536611 wait complete. 2024-08-20T05:19:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.281+0000 7fddbee00640 1 Processor -- start 2024-08-20T05:19:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.281+0000 7fddbee00640 1 -- start start 2024-08-20T05:19:36.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.282+0000 7fddbee00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddb8077400 0x7fddb819f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.282+0000 7fddbee00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddb8077d20 0x7fddb819faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.282+0000 7fddbee00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8113690 0x7fddb81a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.282+0000 7fddbee00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fddb8119060 con 0x7fddb8113690 2024-08-20T05:19:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.282+0000 7fddbee00640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7fddb8118ee0 con 0x7fddb8077d20 2024-08-20T05:19:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.282+0000 7fddbee00640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7fddb81191e0 con 0x7fddb8077400 2024-08-20T05:19:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.282+0000 7fddbce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8113690 0x7fddb81a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.282+0000 7fddafe00640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddb8077d20 0x7fddb819faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.282+0000 7fddb7e00640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddb8077400 0x7fddb819f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.282+0000 7fddbce00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8113690 0x7fddb81a4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35898/0 (socket says 172.21.15.37:35898) 2024-08-20T05:19:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.282+0000 7fddbce00640 1 -- 172.21.15.37:0/3693143909 learned_addr learned my addr 172.21.15.37:0/3693143909 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:19:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.283+0000 7fddafe00640 1 -- 172.21.15.37:0/3693143909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddb8077400 msgr2=0x7fddb819f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:36.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.283+0000 7fddafe00640 1 --2- 172.21.15.37:0/3693143909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddb8077400 0x7fddb819f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.283+0000 7fddafe00640 1 -- 172.21.15.37:0/3693143909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8113690 msgr2=0x7fddb81a4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.283+0000 7fddafe00640 1 --2- 172.21.15.37:0/3693143909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8113690 0x7fddb81a4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.283+0000 7fddafe00640 1 -- 172.21.15.37:0/3693143909 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb81a5660 con 0x7fddb8077d20 2024-08-20T05:19:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.283+0000 7fddafe00640 1 --2- 172.21.15.37:0/3693143909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddb8077d20 0x7fddb819faf0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fdda0005fd0 tx=0x7fdda000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.283+0000 7fddb5600640 1 -- 172.21.15.37:0/3693143909 <== mon.2 v2:172.21.15.130:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda000cd00 con 0x7fddb8077d20 2024-08-20T05:19:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.283+0000 7fddb5600640 1 -- 172.21.15.37:0/3693143909 <== mon.2 v2:172.21.15.130:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdda00035f0 con 0x7fddb8077d20 2024-08-20T05:19:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.283+0000 7fddbee00640 1 -- 172.21.15.37:0/3693143909 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb81a5950 con 0x7fddb8077d20 2024-08-20T05:19:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.283+0000 7fddb5600640 1 -- 172.21.15.37:0/3693143909 <== mon.2 v2:172.21.15.130:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda0010690 con 0x7fddb8077d20 2024-08-20T05:19:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.283+0000 7fddbee00640 1 -- 172.21.15.37:0/3693143909 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb81ac010 con 0x7fddb8077d20 2024-08-20T05:19:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.284+0000 7fddbee00640 1 -- 172.21.15.37:0/3693143909 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb80777e0 con 0x7fddb8077d20 2024-08-20T05:19:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.287+0000 7fddb5600640 1 -- 172.21.15.37:0/3693143909 <== mon.2 v2:172.21.15.130:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7fdda0003a80 con 0x7fddb8077d20 2024-08-20T05:19:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.288+0000 7fddb5600640 1 --2- 172.21.15.37:0/3693143909 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd9c0b3bd0 0x7fdd9c0b6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:36.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.288+0000 7fddb5600640 1 -- 172.21.15.37:0/3693143909 <== mon.2 v2:172.21.15.130:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9055+0+0 (secure 0 0 0) 0x7fdda00e4250 con 0x7fddb8077d20 2024-08-20T05:19:36.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.288+0000 7fddb7e00640 1 --2- 172.21.15.37:0/3693143909 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd9c0b3bd0 0x7fdd9c0b6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:36.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.289+0000 7fddb7e00640 1 --2- 172.21.15.37:0/3693143909 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd9c0b3bd0 0x7fdd9c0b6090 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009bd0 tx=0x7fdda8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:36.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.289+0000 7fddb5600640 1 -- 172.21.15.37:0/3693143909 <== mon.2 v2:172.21.15.130:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7fdda0009510 con 0x7fddb8077d20 2024-08-20T05:19:36.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:36 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:19:36.490 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:36 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:19:36.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:36.489+0000 7fddbee00640 1 -- 172.21.15.37:0/3693143909 --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fddb81ac3f0 con 0x7fddb8077d20 2024-08-20T05:19:36.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:36 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-08-20T05:19:37.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:37.158+0000 7fddb5600640 1 -- 172.21.15.37:0/3693143909 <== mon.2 v2:172.21.15.130:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) ==== 169+0+0 (secure 0 0 0) 0x7fdda00ab510 con 0x7fddb8077d20 2024-08-20T05:19:37.159 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2024-08-20T05:19:37.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:37.162+0000 7fddbee00640 1 -- 172.21.15.37:0/3693143909 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd9c0b3bd0 msgr2=0x7fdd9c0b6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:37.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:37.162+0000 7fddbee00640 1 --2- 172.21.15.37:0/3693143909 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd9c0b3bd0 0x7fdd9c0b6090 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009bd0 tx=0x7fdda8005f90 comp rx=0 tx=0).stop 2024-08-20T05:19:37.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:37.162+0000 7fddbee00640 1 -- 172.21.15.37:0/3693143909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddb8077d20 msgr2=0x7fddb819faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:37.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:37.162+0000 7fddbee00640 1 --2- 172.21.15.37:0/3693143909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddb8077d20 0x7fddb819faf0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fdda0005fd0 tx=0x7fdda000ee50 comp rx=0 tx=0).stop 2024-08-20T05:19:37.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:37.162+0000 7fddbee00640 1 -- 172.21.15.37:0/3693143909 shutdown_connections 2024-08-20T05:19:37.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:37.162+0000 7fddbee00640 1 --2- 172.21.15.37:0/3693143909 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7fdd9c0b3bd0 0x7fdd9c0b6090 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:37.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:37.162+0000 7fddbee00640 1 --2- 172.21.15.37:0/3693143909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb8113690 0x7fddb81a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:37.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:37.162+0000 7fddbee00640 1 --2- 172.21.15.37:0/3693143909 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7fddb8077d20 0x7fddb819faf0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:37.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:37.162+0000 7fddbee00640 1 --2- 172.21.15.37:0/3693143909 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7fddb8077400 0x7fddb819f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:37.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:37.162+0000 7fddbee00640 1 -- 172.21.15.37:0/3693143909 >> 172.21.15.37:0/3693143909 conn(0x7fddb8100730 msgr2=0x7fddb8102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:37.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:37.163+0000 7fddbee00640 1 -- 172.21.15.37:0/3693143909 shutdown_connections 2024-08-20T05:19:37.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:37.163+0000 7fddbee00640 1 -- 172.21.15.37:0/3693143909 wait complete. 2024-08-20T05:19:37.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:37 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/3693143909' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T05:19:37.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:37 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T05:19:37.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:37 smithi130 ceph-mon[22007]: pgmap v924: 97 pgs: 97 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T05:19:37.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:37 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:19:37.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:37 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:19:37.456 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:37 smithi130 ceph-mon[22007]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:19:37.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:37 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/3693143909' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T05:19:37.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:37 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T05:19:37.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:37 smithi037 ceph-mon[17265]: pgmap v924: 97 pgs: 97 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T05:19:37.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:37 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:19:37.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:37 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:19:37.516 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:37 smithi037 ceph-mon[17265]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:19:37.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:37 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/3693143909' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T05:19:37.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:37 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T05:19:37.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:37 smithi135 ceph-mon[22342]: pgmap v924: 97 pgs: 97 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T05:19:37.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:37 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-08-20T05:19:37.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:37 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-08-20T05:19:37.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:37 smithi135 ceph-mon[22342]: from='mgr.14150 172.21.15.37:0/421402947' entity='mgr.x' 2024-08-20T05:19:37.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1 shell --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-08-20T05:19:38.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:38 smithi037 ceph-mon[17265]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T05:19:38.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:38 smithi037 ceph-mon[17265]: osdmap e91: 12 total, 12 up, 12 in 2024-08-20T05:19:38.376 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/mon.a/config 2024-08-20T05:19:38.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:38 smithi130 ceph-mon[22007]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T05:19:38.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:38 smithi130 ceph-mon[22007]: osdmap e91: 12 total, 12 up, 12 in 2024-08-20T05:19:38.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:38 smithi135 ceph-mon[22342]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T05:19:38.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:38 smithi135 ceph-mon[22342]: osdmap e91: 12 total, 12 up, 12 in 2024-08-20T05:19:38.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.956+0000 7f7c14200640 1 -- 172.21.15.37:0/128575377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0c077400 msgr2=0x7f7c0c0777e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:38.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.956+0000 7f7c14200640 1 --2- 172.21.15.37:0/128575377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0c077400 0x7f7c0c0777e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7c00009900 tx=0x7f7c0002a410 comp rx=0 tx=0).stop 2024-08-20T05:19:38.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.956+0000 7f7c14200640 1 -- 172.21.15.37:0/128575377 shutdown_connections 2024-08-20T05:19:38.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.956+0000 7f7c14200640 1 --2- 172.21.15.37:0/128575377 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c0c113690 0x7f7c0c115a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:38.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.956+0000 7f7c14200640 1 --2- 172.21.15.37:0/128575377 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c0c077d20 0x7f7c0c113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:38.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.956+0000 7f7c14200640 1 --2- 172.21.15.37:0/128575377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0c077400 0x7f7c0c0777e0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:38.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.956+0000 7f7c14200640 1 -- 172.21.15.37:0/128575377 >> 172.21.15.37:0/128575377 conn(0x7f7c0c100730 msgr2=0x7f7c0c102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:38.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.956+0000 7f7c14200640 1 -- 172.21.15.37:0/128575377 shutdown_connections 2024-08-20T05:19:38.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.956+0000 7f7c14200640 1 -- 172.21.15.37:0/128575377 wait complete. 2024-08-20T05:19:38.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.957+0000 7f7c14200640 1 Processor -- start 2024-08-20T05:19:38.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.957+0000 7f7c14200640 1 -- start start 2024-08-20T05:19:38.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.958+0000 7f7c14200640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0c077400 0x7f7c0c19f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:38.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.958+0000 7f7c14200640 1 --2- >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c0c077d20 0x7f7c0c19fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:38.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.958+0000 7f7c14200640 1 --2- >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c0c113690 0x7f7c0c1a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:38.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.958+0000 7f7c14200640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c1190f0 con 0x7f7c0c077400 2024-08-20T05:19:38.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.958+0000 7f7c14200640 1 -- --> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c118f70 con 0x7f7c0c113690 2024-08-20T05:19:38.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.958+0000 7f7c14200640 1 -- --> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0c119270 con 0x7f7c0c077d20 2024-08-20T05:19:38.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.958+0000 7f7c11800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0c077400 0x7f7c0c19f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:38.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.958+0000 7f7c11800640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0c077400 0x7f7c0c19f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35918/0 (socket says 172.21.15.37:35918) 2024-08-20T05:19:38.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.958+0000 7f7c11800640 1 -- 172.21.15.37:0/877950477 learned_addr learned my addr 172.21.15.37:0/877950477 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-08-20T05:19:38.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.958+0000 7f7c10e00640 1 --2- 172.21.15.37:0/877950477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c0c077d20 0x7f7c0c19fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:38.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.958+0000 7f7c12200640 1 --2- 172.21.15.37:0/877950477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c0c113690 0x7f7c0c1a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:38.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.959+0000 7f7c11800640 1 -- 172.21.15.37:0/877950477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c0c077d20 msgr2=0x7f7c0c19fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:38.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.959+0000 7f7c11800640 1 --2- 172.21.15.37:0/877950477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c0c077d20 0x7f7c0c19fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:38.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.959+0000 7f7c11800640 1 -- 172.21.15.37:0/877950477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c0c113690 msgr2=0x7f7c0c1a4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:38.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.959+0000 7f7c11800640 1 --2- 172.21.15.37:0/877950477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c0c113690 0x7f7c0c1a4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:38.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.959+0000 7f7c11800640 1 -- 172.21.15.37:0/877950477 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c0c1a5650 con 0x7f7c0c077400 2024-08-20T05:19:38.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.959+0000 7f7c11800640 1 --2- 172.21.15.37:0/877950477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0c077400 0x7f7c0c19f5a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7c00005ab0 tx=0x7f7c00003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:38.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.959+0000 7f7c0a000640 1 -- 172.21.15.37:0/877950477 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c0003f070 con 0x7f7c0c077400 2024-08-20T05:19:38.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.959+0000 7f7c0a000640 1 -- 172.21.15.37:0/877950477 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c00031d60 con 0x7f7c0c077400 2024-08-20T05:19:38.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.959+0000 7f7c0a000640 1 -- 172.21.15.37:0/877950477 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c00035030 con 0x7f7c0c077400 2024-08-20T05:19:38.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.959+0000 7f7c14200640 1 -- 172.21.15.37:0/877950477 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c0c1a58e0 con 0x7f7c0c077400 2024-08-20T05:19:38.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.959+0000 7f7c14200640 1 -- 172.21.15.37:0/877950477 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c0c1ac000 con 0x7f7c0c077400 2024-08-20T05:19:38.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.960+0000 7f7c14200640 1 -- 172.21.15.37:0/877950477 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c0c0777e0 con 0x7f7c0c077400 2024-08-20T05:19:38.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.962+0000 7f7c0a000640 1 -- 172.21.15.37:0/877950477 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) ==== 151059+0+0 (secure 0 0 0) 0x7f7c00042070 con 0x7f7c0c077400 2024-08-20T05:19:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.964+0000 7f7c0a000640 1 --2- 172.21.15.37:0/877950477 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bf40b3c50 0x7f7bf40b6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-20T05:19:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.964+0000 7f7c0a000640 1 -- 172.21.15.37:0/877950477 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8496+0+0 (secure 0 0 0) 0x7f7c00104410 con 0x7f7c0c077400 2024-08-20T05:19:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.964+0000 7f7c10e00640 1 --2- 172.21.15.37:0/877950477 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bf40b3c50 0x7f7bf40b6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-20T05:19:38.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.965+0000 7f7c10e00640 1 --2- 172.21.15.37:0/877950477 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bf40b3c50 0x7f7bf40b6110 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c079f60 tx=0x7f7bf8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-20T05:19:38.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:38.968+0000 7f7c0a000640 1 -- 172.21.15.37:0/877950477 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196112 (secure 0 0 0) 0x7f7c000cb2d0 con 0x7f7c0c077400 2024-08-20T05:19:39.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:39.168+0000 7f7c14200640 1 -- 172.21.15.37:0/877950477 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7c0c1ac290 con 0x7f7c0c077400 2024-08-20T05:19:39.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:39 smithi130 ceph-mon[22007]: pgmap v926: 33 pgs: 33 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T05:19:39.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:39 smithi037 ceph-mon[17265]: pgmap v926: 33 pgs: 33 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T05:19:39.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:39 smithi135 ceph-mon[22342]: pgmap v926: 33 pgs: 33 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T05:19:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:40.170+0000 7f7c0a000640 1 -- 172.21.15.37:0/877950477 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v92) ==== 178+0+0 (secure 0 0 0) 0x7f7c000cf820 con 0x7f7c0c077400 2024-08-20T05:19:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data_ec' removed 2024-08-20T05:19:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:40.173+0000 7f7c14200640 1 -- 172.21.15.37:0/877950477 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bf40b3c50 msgr2=0x7f7bf40b6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:40.173+0000 7f7c14200640 1 --2- 172.21.15.37:0/877950477 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bf40b3c50 0x7f7bf40b6110 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c079f60 tx=0x7f7bf8005f90 comp rx=0 tx=0).stop 2024-08-20T05:19:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:40.173+0000 7f7c14200640 1 -- 172.21.15.37:0/877950477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0c077400 msgr2=0x7f7c0c19f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-20T05:19:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:40.173+0000 7f7c14200640 1 --2- 172.21.15.37:0/877950477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0c077400 0x7f7c0c19f5a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7c00005ab0 tx=0x7f7c00003c80 comp rx=0 tx=0).stop 2024-08-20T05:19:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:40.173+0000 7f7c14200640 1 -- 172.21.15.37:0/877950477 shutdown_connections 2024-08-20T05:19:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:40.173+0000 7f7c14200640 1 --2- 172.21.15.37:0/877950477 >> [v2:172.21.15.37:6800/839402922,v1:172.21.15.37:6801/839402922] conn(0x7f7bf40b3c50 0x7f7bf40b6110 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:40.173+0000 7f7c14200640 1 --2- 172.21.15.37:0/877950477 >> [v2:172.21.15.130:3300/0,v1:172.21.15.130:6789/0] conn(0x7f7c0c113690 0x7f7c0c1a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:40.173+0000 7f7c14200640 1 --2- 172.21.15.37:0/877950477 >> [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] conn(0x7f7c0c077d20 0x7f7c0c19fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:40.173+0000 7f7c14200640 1 --2- 172.21.15.37:0/877950477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c0c077400 0x7f7c0c19f5a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-20T05:19:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:40.173+0000 7f7c14200640 1 -- 172.21.15.37:0/877950477 >> 172.21.15.37:0/877950477 conn(0x7f7c0c100730 msgr2=0x7f7c0c102b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-20T05:19:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:40.174+0000 7f7c14200640 1 -- 172.21.15.37:0/877950477 shutdown_connections 2024-08-20T05:19:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-08-20T05:19:40.174+0000 7f7c14200640 1 -- 172.21.15.37:0/877950477 wait complete. 2024-08-20T05:19:40.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:40 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/877950477' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T05:19:40.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:40 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/877950477' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T05:19:40.615 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:40 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/877950477' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-08-20T05:19:41.244 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T05:19:41.308 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T05:19:41.338 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T05:19:41.386 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-20T05:19:41.386 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-20T05:19:41.440 DEBUG:teuthology.orchestra.run.smithi130:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-20T05:19:41.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:41 smithi130 ceph-mon[22007]: from='client.? 172.21.15.37:0/877950477' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T05:19:41.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:41 smithi130 ceph-mon[22007]: osdmap e92: 12 total, 12 up, 12 in 2024-08-20T05:19:41.455 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:41 smithi130 ceph-mon[22007]: pgmap v928: 1 pgs: 1 active+clean; 577 KiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T05:19:41.456 DEBUG:teuthology.orchestra.run.smithi135:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-20T05:19:41.472 INFO:tasks.cephadm:Stopping all daemons... 2024-08-20T05:19:41.472 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-08-20T05:19:41.472 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mon.a 2024-08-20T05:19:41.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:41 smithi037 ceph-mon[17265]: from='client.? 172.21.15.37:0/877950477' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T05:19:41.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:41 smithi037 ceph-mon[17265]: osdmap e92: 12 total, 12 up, 12 in 2024-08-20T05:19:41.515 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:41 smithi037 ceph-mon[17265]: pgmap v928: 1 pgs: 1 active+clean; 577 KiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T05:19:41.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:41 smithi135 ceph-mon[22342]: from='client.? 172.21.15.37:0/877950477' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-20T05:19:41.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:41 smithi135 ceph-mon[22342]: osdmap e92: 12 total, 12 up, 12 in 2024-08-20T05:19:41.616 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:41 smithi135 ceph-mon[22342]: pgmap v928: 1 pgs: 1 active+clean; 577 KiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-20T05:19:41.919 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:41 smithi037 systemd[1]: Stopping Ceph mon.a for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:19:42.265 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:41 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-a[17261]: 2024-08-20T05:19:41.916+0000 7fa7d7200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:19:42.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:41 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-a[17261]: 2024-08-20T05:19:41.916+0000 7fa7d7200640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-08-20T05:19:42.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:41 smithi037 podman[112242]: 2024-08-20 05:19:41.980689105 +0000 UTC m=+0.215390287 container died e1ebf7073663a00dc70e32dcc5c41b517b3d86993bf0233b5e23f654f95fcc00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-20T05:19:42.765 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:42 smithi037 podman[112242]: 2024-08-20 05:19:42.463979878 +0000 UTC m=+0.698681062 container cleanup e1ebf7073663a00dc70e32dcc5c41b517b3d86993bf0233b5e23f654f95fcc00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-08-20T05:19:42.766 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:42 smithi037 bash[112242]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-a 2024-08-20T05:19:43.266 INFO:journalctl@ceph.mon.a.smithi037.stdout:Aug 20 05:19:42 smithi037 podman[112254]: 2024-08-20 05:19:42.965766133 +0000 UTC m=+0.974548292 container remove e1ebf7073663a00dc70e32dcc5c41b517b3d86993bf0233b5e23f654f95fcc00 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-a, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-08-20T05:19:43.313 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mon.a.service' 2024-08-20T05:19:43.489 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:19:43.489 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-08-20T05:19:43.489 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-08-20T05:19:43.489 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mon.b 2024-08-20T05:19:43.955 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:43 smithi130 systemd[1]: Stopping Ceph mon.b for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:19:44.705 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:44 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-b[22003]: 2024-08-20T05:19:44.346+0000 7f1a0f0f3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:19:44.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:44 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-b[22003]: 2024-08-20T05:19:44.346+0000 7f1a0f0f3640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-08-20T05:19:44.706 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:44 smithi130 podman[57415]: 2024-08-20 05:19:44.551735248 +0000 UTC m=+0.774675496 container died 543875a034e5d15c928ed796436a41c82e3fbee1f84e0ee051b8c27bbfa8054a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-20T05:19:45.205 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:44 smithi130 podman[57415]: 2024-08-20 05:19:44.929250076 +0000 UTC m=+1.152190312 container cleanup 543875a034e5d15c928ed796436a41c82e3fbee1f84e0ee051b8c27bbfa8054a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-08-20T05:19:45.206 INFO:journalctl@ceph.mon.b.smithi130.stdout:Aug 20 05:19:44 smithi130 bash[57415]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-b 2024-08-20T05:19:45.368 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mon.b.service' 2024-08-20T05:19:45.422 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:19:45.422 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-08-20T05:19:45.422 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-08-20T05:19:45.423 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mon.c 2024-08-20T05:19:45.865 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:45 smithi135 systemd[1]: Stopping Ceph mon.c for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:19:46.433 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:46 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-c[22338]: 2024-08-20T05:19:46.128+0000 7f12f84ba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:19:46.434 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:46 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-c[22338]: 2024-08-20T05:19:46.128+0000 7f12f84ba640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-08-20T05:19:46.434 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:46 smithi135 podman[57933]: 2024-08-20 05:19:46.240942234 +0000 UTC m=+0.408046668 container died cdd2b1e22e07d235f3dfdd901a6d0cb023738d4297e452e35526406a0730e6fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-20T05:19:46.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:46 smithi135 podman[57933]: 2024-08-20 05:19:46.671054011 +0000 UTC m=+0.838158447 container cleanup cdd2b1e22e07d235f3dfdd901a6d0cb023738d4297e452e35526406a0730e6fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-20T05:19:46.686 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:46 smithi135 bash[57933]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-c 2024-08-20T05:19:47.154 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mon.c.service' 2024-08-20T05:19:47.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:46 smithi135 podman[57946]: 2024-08-20 05:19:46.914834869 +0000 UTC m=+0.666724076 container remove cdd2b1e22e07d235f3dfdd901a6d0cb023738d4297e452e35526406a0730e6fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mon-c, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-20T05:19:47.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:47 smithi135 systemd[1]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mon.c.service: Deactivated successfully. 2024-08-20T05:19:47.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:47 smithi135 systemd[1]: Stopped Ceph mon.c for 93c5cea6-5eaf-11ef-bccf-c7b262605968. 2024-08-20T05:19:47.176 INFO:journalctl@ceph.mon.c.smithi135.stdout:Aug 20 05:19:47 smithi135 systemd[1]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mon.c.service: Consumed 16.352s CPU time. 2024-08-20T05:19:47.203 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:19:47.203 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-08-20T05:19:47.203 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-08-20T05:19:47.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mgr.x 2024-08-20T05:19:47.516 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 05:19:47 smithi037 systemd[1]: Stopping Ceph mgr.x for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:19:48.016 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 05:19:47 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: 2024-08-20T05:19:47.638+0000 7f4fb3200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:19:48.016 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 05:19:47 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x[17504]: 2024-08-20T05:19:47.638+0000 7f4fb3200640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-08-20T05:19:48.016 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 05:19:47 smithi037 podman[112360]: 2024-08-20 05:19:47.720659729 +0000 UTC m=+0.219626962 container died 92646408c94e32f09b983964cf6ebed2466895b3a44a6c0556f14ab956867e8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T05:19:48.807 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 05:19:48 smithi037 podman[112360]: 2024-08-20 05:19:48.553720365 +0000 UTC m=+1.052687596 container cleanup 92646408c94e32f09b983964cf6ebed2466895b3a44a6c0556f14ab956867e8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux ) 2024-08-20T05:19:48.807 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 05:19:48 smithi037 bash[112360]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x 2024-08-20T05:19:49.084 INFO:journalctl@ceph.mgr.x.smithi037.stdout:Aug 20 05:19:48 smithi037 podman[112373]: 2024-08-20 05:19:48.805848257 +0000 UTC m=+1.063123068 container remove 92646408c94e32f09b983964cf6ebed2466895b3a44a6c0556f14ab956867e8c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:ef4275410d8483698016fe484b2a3c664080b4c1, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-08-20T05:19:49.107 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mgr.x.service' 2024-08-20T05:19:49.181 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:19:49.182 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-08-20T05:19:49.182 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-08-20T05:19:49.182 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mgr.y 2024-08-20T05:19:49.523 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 20 05:19:49 smithi130 systemd[1]: Stopping Ceph mgr.y for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:19:49.955 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 20 05:19:49 smithi130 podman[57539]: 2024-08-20 05:19:49.521703272 +0000 UTC m=+0.144903162 container died 48a8abbaf7de5e6ce2ef24a64e5153f323faa8652c11f659b729b7c6827985f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-y, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T05:19:50.371 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 20 05:19:50 smithi130 podman[57539]: 2024-08-20 05:19:50.118661253 +0000 UTC m=+0.741861145 container cleanup 48a8abbaf7de5e6ce2ef24a64e5153f323faa8652c11f659b729b7c6827985f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-y, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-08-20T05:19:50.371 INFO:journalctl@ceph.mgr.y.smithi130.stdout:Aug 20 05:19:50 smithi130 bash[57539]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-y 2024-08-20T05:19:50.514 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mgr.y.service' 2024-08-20T05:19:50.550 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:19:50.550 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-08-20T05:19:50.550 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-08-20T05:19:50.550 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mgr.z 2024-08-20T05:19:50.865 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Aug 20 05:19:50 smithi135 systemd[1]: Stopping Ceph mgr.z for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:19:51.615 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Aug 20 05:19:51 smithi135 podman[58069]: 2024-08-20 05:19:51.191771685 +0000 UTC m=+0.449259423 container died c8c410a818f9c2c3776b06404e0cf8ba49a337abfdf5d987571ad855eab44d80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-z, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T05:19:52.005 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Aug 20 05:19:51 smithi135 podman[58069]: 2024-08-20 05:19:51.753167161 +0000 UTC m=+1.010654898 container cleanup c8c410a818f9c2c3776b06404e0cf8ba49a337abfdf5d987571ad855eab44d80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-20T05:19:52.005 INFO:journalctl@ceph.mgr.z.smithi135.stdout:Aug 20 05:19:51 smithi135 bash[58069]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mgr-z 2024-08-20T05:19:52.132 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mgr.z.service' 2024-08-20T05:19:52.167 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:19:52.167 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-08-20T05:19:52.168 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-20T05:19:52.168 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.0 2024-08-20T05:19:52.516 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 05:19:52 smithi037 systemd[1]: Stopping Ceph osd.0 for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:19:53.015 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 05:19:52 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-0[33556]: 2024-08-20T05:19:52.585+0000 7fb306a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:19:53.016 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 05:19:52 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-0[33556]: 2024-08-20T05:19:52.585+0000 7fb306a00640 -1 osd.0 92 *** Got signal Terminated *** 2024-08-20T05:19:53.016 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 05:19:52 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-0[33556]: 2024-08-20T05:19:52.585+0000 7fb306a00640 -1 osd.0 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T05:19:58.515 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 05:19:58 smithi037 podman[112480]: 2024-08-20 05:19:58.214092592 +0000 UTC m=+5.758241277 container died 1a3d02ce37ff8ecdf227b5df08b2e9164582fa332dbfb1f63f7263e708339ea5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T05:19:58.970 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 05:19:58 smithi037 podman[112480]: 2024-08-20 05:19:58.709011645 +0000 UTC m=+6.253160329 container cleanup 1a3d02ce37ff8ecdf227b5df08b2e9164582fa332dbfb1f63f7263e708339ea5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T05:19:58.970 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 05:19:58 smithi037 bash[112480]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-0 2024-08-20T05:19:59.265 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 05:19:58 smithi037 podman[112497]: 2024-08-20 05:19:58.968974601 +0000 UTC m=+0.732459190 container remove 1a3d02ce37ff8ecdf227b5df08b2e9164582fa332dbfb1f63f7263e708339ea5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-08-20T05:19:59.765 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 05:19:59 smithi037 podman[112584]: 2024-08-20 05:19:59.415610278 +0000 UTC m=+0.027939815 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T05:19:59.765 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 05:19:59 smithi037 podman[112584]: 2024-08-20 05:19:59.561814939 +0000 UTC m=+0.174144475 container create 4541042f063847cd5414824128a62f48107bb801197552f8604c44244c6d1b17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T05:20:00.211 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 05:19:59 smithi037 podman[112584]: 2024-08-20 05:19:59.84778398 +0000 UTC m=+0.460113523 container init 4541042f063847cd5414824128a62f48107bb801197552f8604c44244c6d1b17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-20T05:20:00.211 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 05:19:59 smithi037 podman[112584]: 2024-08-20 05:19:59.854882575 +0000 UTC m=+0.467212112 container start 4541042f063847cd5414824128a62f48107bb801197552f8604c44244c6d1b17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T05:20:00.211 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 05:19:59 smithi037 podman[112584]: 2024-08-20 05:19:59.947552708 +0000 UTC m=+0.559882255 container attach 4541042f063847cd5414824128a62f48107bb801197552f8604c44244c6d1b17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T05:20:00.515 INFO:journalctl@ceph.osd.0.smithi037.stdout:Aug 20 05:20:00 smithi037 podman[112584]: 2024-08-20 05:20:00.210186533 +0000 UTC m=+0.822516082 container died 4541042f063847cd5414824128a62f48107bb801197552f8604c44244c6d1b17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-08-20T05:20:01.078 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.0.service' 2024-08-20T05:20:01.155 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:20:01.155 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-20T05:20:01.155 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-20T05:20:01.156 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.1 2024-08-20T05:20:01.455 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 05:20:01 smithi130 systemd[1]: Stopping Ceph osd.1 for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:20:01.955 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 05:20:01 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-1[26411]: 2024-08-20T05:20:01.464+0000 7f7e82b9f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:20:01.955 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 05:20:01 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-1[26411]: 2024-08-20T05:20:01.464+0000 7f7e82b9f640 -1 osd.1 92 *** Got signal Terminated *** 2024-08-20T05:20:01.956 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 05:20:01 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-1[26411]: 2024-08-20T05:20:01.464+0000 7f7e82b9f640 -1 osd.1 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T05:20:07.205 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 05:20:06 smithi130 podman[57675]: 2024-08-20 05:20:06.943353426 +0000 UTC m=+5.599081768 container died 25d9e12a70f62bf44ffe89ba6104027eafd0f8010ecb0643fc51cf20ed816561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-1, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-20T05:20:07.601 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 05:20:07 smithi130 podman[57675]: 2024-08-20 05:20:07.331910828 +0000 UTC m=+5.987639171 container cleanup 25d9e12a70f62bf44ffe89ba6104027eafd0f8010ecb0643fc51cf20ed816561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-1, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-20T05:20:07.601 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 05:20:07 smithi130 bash[57675]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-1 2024-08-20T05:20:07.945 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 05:20:07 smithi130 podman[57694]: 2024-08-20 05:20:07.600276757 +0000 UTC m=+0.642682046 container remove 25d9e12a70f62bf44ffe89ba6104027eafd0f8010ecb0643fc51cf20ed816561 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-1, ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-20T05:20:08.205 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 05:20:07 smithi130 podman[57781]: 2024-08-20 05:20:07.847508746 +0000 UTC m=+0.015842476 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T05:20:08.206 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 05:20:07 smithi130 podman[57781]: 2024-08-20 05:20:07.968011426 +0000 UTC m=+0.136345157 container create e00c6fbc52513242de87e9ff65d4f1578f8c9efa78a56d6cbb579a7e721c6d2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-08-20T05:20:08.705 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 05:20:08 smithi130 podman[57781]: 2024-08-20 05:20:08.237487058 +0000 UTC m=+0.405820789 container init e00c6fbc52513242de87e9ff65d4f1578f8c9efa78a56d6cbb579a7e721c6d2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T05:20:08.706 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 05:20:08 smithi130 podman[57781]: 2024-08-20 05:20:08.240758218 +0000 UTC m=+0.409091953 container start e00c6fbc52513242de87e9ff65d4f1578f8c9efa78a56d6cbb579a7e721c6d2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0) 2024-08-20T05:20:08.706 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 05:20:08 smithi130 podman[57781]: 2024-08-20 05:20:08.31253537 +0000 UTC m=+0.480869110 container attach e00c6fbc52513242de87e9ff65d4f1578f8c9efa78a56d6cbb579a7e721c6d2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-1-deactivate, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-08-20T05:20:08.706 INFO:journalctl@ceph.osd.1.smithi130.stdout:Aug 20 05:20:08 smithi130 podman[57781]: 2024-08-20 05:20:08.448859509 +0000 UTC m=+0.617193242 container died e00c6fbc52513242de87e9ff65d4f1578f8c9efa78a56d6cbb579a7e721c6d2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T05:20:09.113 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.1.service' 2024-08-20T05:20:09.160 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:20:09.160 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-20T05:20:09.160 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-20T05:20:09.161 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.2 2024-08-20T05:20:09.475 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 05:20:09 smithi135 systemd[1]: Stopping Ceph osd.2 for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:20:09.865 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 05:20:09 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-2[27288]: 2024-08-20T05:20:09.473+0000 7fd3f8283640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:20:09.866 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 05:20:09 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-2[27288]: 2024-08-20T05:20:09.473+0000 7fd3f8283640 -1 osd.2 92 *** Got signal Terminated *** 2024-08-20T05:20:09.866 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 05:20:09 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-2[27288]: 2024-08-20T05:20:09.473+0000 7fd3f8283640 -1 osd.2 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T05:20:15.268 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 05:20:14 smithi135 podman[58199]: 2024-08-20 05:20:14.973112082 +0000 UTC m=+5.620694301 container died aa1d36194c8fdb7e1266e7f06d541d5e7fe7b05cd60031b129d08ffe4490d56c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-2, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T05:20:15.610 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 05:20:15 smithi135 podman[58199]: 2024-08-20 05:20:15.358008756 +0000 UTC m=+6.005590972 container cleanup aa1d36194c8fdb7e1266e7f06d541d5e7fe7b05cd60031b129d08ffe4490d56c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-20T05:20:15.611 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 05:20:15 smithi135 bash[58199]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-2 2024-08-20T05:20:15.865 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 05:20:15 smithi135 podman[58215]: 2024-08-20 05:20:15.609790847 +0000 UTC m=+0.629670543 container remove aa1d36194c8fdb7e1266e7f06d541d5e7fe7b05cd60031b129d08ffe4490d56c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T05:20:16.206 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 05:20:15 smithi135 podman[58305]: 2024-08-20 05:20:15.830278438 +0000 UTC m=+0.015905347 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T05:20:16.207 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 05:20:15 smithi135 podman[58305]: 2024-08-20 05:20:15.960810308 +0000 UTC m=+0.146437219 container create 10ff6de9351d199c9d17b0fa7af2fda223e180c7f4acb66edc5a6e2cb6e5fa2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-20T05:20:16.207 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 05:20:16 smithi135 podman[58305]: 2024-08-20 05:20:16.205630063 +0000 UTC m=+0.391256971 container init 10ff6de9351d199c9d17b0fa7af2fda223e180c7f4acb66edc5a6e2cb6e5fa2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.36.0) 2024-08-20T05:20:16.596 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 05:20:16 smithi135 podman[58305]: 2024-08-20 05:20:16.209359992 +0000 UTC m=+0.394986907 container start 10ff6de9351d199c9d17b0fa7af2fda223e180c7f4acb66edc5a6e2cb6e5fa2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-08-20T05:20:16.596 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 05:20:16 smithi135 podman[58305]: 2024-08-20 05:20:16.314125693 +0000 UTC m=+0.499752603 container attach 10ff6de9351d199c9d17b0fa7af2fda223e180c7f4acb66edc5a6e2cb6e5fa2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-08-20T05:20:16.865 INFO:journalctl@ceph.osd.2.smithi135.stdout:Aug 20 05:20:16 smithi135 podman[58305]: 2024-08-20 05:20:16.596081248 +0000 UTC m=+0.781708158 container died 10ff6de9351d199c9d17b0fa7af2fda223e180c7f4acb66edc5a6e2cb6e5fa2b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-2-deactivate, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-08-20T05:20:17.427 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.2.service' 2024-08-20T05:20:17.468 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:20:17.469 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-20T05:20:17.469 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-20T05:20:17.469 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.3 2024-08-20T05:20:17.927 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 20 05:20:17 smithi037 systemd[1]: Stopping Ceph osd.3 for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:20:18.265 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 20 05:20:17 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-3[40406]: 2024-08-20T05:20:17.924+0000 7fc08c200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:20:18.266 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 20 05:20:17 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-3[40406]: 2024-08-20T05:20:17.924+0000 7fc08c200640 -1 osd.3 92 *** Got signal Terminated *** 2024-08-20T05:20:18.266 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 20 05:20:17 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-3[40406]: 2024-08-20T05:20:17.924+0000 7fc08c200640 -1 osd.3 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T05:20:18.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:18 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:18.674+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:19.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:18 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:18.981+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:20.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:19 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:19.684+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:20.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:19 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:19.936+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:20.615 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:20 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:20.292+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:21.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:20 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:20.648+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:21.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:20 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:20.922+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:21.615 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:21 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:21.259+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:22.118 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:21 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:21.681+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:22.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:21 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:21.938+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:22.615 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:22 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:22.264+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:23.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:22 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:22.663+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:23.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:22 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:22.983+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:23.615 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:23 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:23.259+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:24.015 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 20 05:20:23 smithi037 podman[112688]: 2024-08-20 05:20:23.734377964 +0000 UTC m=+5.974195561 container died 0b316fc2cac2e59ec1c6089bd7c9df544908233a0b2761201fc1c4e2aed25c74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True) 2024-08-20T05:20:24.016 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:23 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:23.937+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:24.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:23 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:23.691+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:24.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:24 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:24.035+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:24.515 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 20 05:20:24 smithi037 podman[112688]: 2024-08-20 05:20:24.347088586 +0000 UTC m=+6.586906181 container cleanup 0b316fc2cac2e59ec1c6089bd7c9df544908233a0b2761201fc1c4e2aed25c74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T05:20:24.515 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 20 05:20:24 smithi037 bash[112688]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-3 2024-08-20T05:20:24.615 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:24 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:24.286+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:24.947 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 20 05:20:24 smithi037 podman[112717]: 2024-08-20 05:20:24.648930004 +0000 UTC m=+0.902485137 container remove 0b316fc2cac2e59ec1c6089bd7c9df544908233a0b2761201fc1c4e2aed25c74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-3, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T05:20:25.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:24 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:24.676+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:25.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:24 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:24.945+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:25.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:25 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:25.033+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:25.570 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 20 05:20:25 smithi037 podman[112805]: 2024-08-20 05:20:25.174945336 +0000 UTC m=+0.027922996 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T05:20:25.570 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 20 05:20:25 smithi037 podman[112805]: 2024-08-20 05:20:25.283459531 +0000 UTC m=+0.136437179 container create 0ed062ed697fc30a9024268e188f4d2cb4084c00945cdc75337581a7574659ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0) 2024-08-20T05:20:25.570 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 20 05:20:25 smithi037 podman[112805]: 2024-08-20 05:20:25.569599987 +0000 UTC m=+0.422577647 container init 0ed062ed697fc30a9024268e188f4d2cb4084c00945cdc75337581a7574659ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T05:20:25.615 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:25 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:25.297+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:25.846 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 20 05:20:25 smithi037 podman[112805]: 2024-08-20 05:20:25.576653803 +0000 UTC m=+0.429631453 container start 0ed062ed697fc30a9024268e188f4d2cb4084c00945cdc75337581a7574659ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731) 2024-08-20T05:20:25.847 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 20 05:20:25 smithi037 podman[112805]: 2024-08-20 05:20:25.727845133 +0000 UTC m=+0.580822815 container attach 0ed062ed697fc30a9024268e188f4d2cb4084c00945cdc75337581a7574659ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-08-20T05:20:26.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:25 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:25.689+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:26.223 INFO:journalctl@ceph.osd.3.smithi037.stdout:Aug 20 05:20:25 smithi037 podman[112805]: 2024-08-20 05:20:25.846087554 +0000 UTC m=+0.699065208 container died 0ed062ed697fc30a9024268e188f4d2cb4084c00945cdc75337581a7574659ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-20T05:20:26.223 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:25 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:25.977+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:26.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:26 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:26.050+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:26.584 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.3.service' 2024-08-20T05:20:26.615 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:26 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:26.260+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:26.661 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:20:26.661 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-20T05:20:26.661 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-20T05:20:26.662 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.4 2024-08-20T05:20:26.956 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 05:20:26 smithi130 systemd[1]: Stopping Ceph osd.4 for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:20:27.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:26 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:26.641+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:27.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:26 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:26.996+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:27.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:27 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:27.018+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:27.456 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 05:20:26 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4[33284]: 2024-08-20T05:20:26.969+0000 7f01cf4c5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:20:27.456 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 05:20:26 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4[33284]: 2024-08-20T05:20:26.969+0000 7f01cf4c5640 -1 osd.4 92 *** Got signal Terminated *** 2024-08-20T05:20:27.456 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 05:20:26 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4[33284]: 2024-08-20T05:20:26.969+0000 7f01cf4c5640 -1 osd.4 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T05:20:27.534 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:27 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:27.240+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:27.865 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:27 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:27.628+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:27.866 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:27 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:27.533+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:28.357 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:28 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:28.013+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:28.357 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:28 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:28.013+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:28.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:28 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:28.034+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:28.570 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:28.270+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:28.865 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:28.569+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:28.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:28.646+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:29.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:29 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:29.003+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:29.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:29 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:29.003+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:29.455 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 05:20:28 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4[33284]: 2024-08-20T05:20:28.988+0000 7f01cbada640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.926869+0000 front 2024-08-20T05:20:05.926841+0000 (oldest deadline 2024-08-20T05:20:28.227011+0000) 2024-08-20T05:20:29.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:29 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:29.043+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:29.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:29 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:29.043+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:29.541 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:29 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:29.227+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:29.865 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:29 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:29.540+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:29.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:29 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:29.647+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:30.456 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 05:20:29 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4[33284]: 2024-08-20T05:20:29.994+0000 7f01cbada640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.926869+0000 front 2024-08-20T05:20:05.926841+0000 (oldest deadline 2024-08-20T05:20:28.227011+0000) 2024-08-20T05:20:30.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:30 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:30.085+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:30.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:30 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:30.085+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:30.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:30.021+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:30.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:30.021+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:30.583 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:30 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:30.253+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:30.866 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:30 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:30.580+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:30.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:30 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:30.611+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:31.009 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:30 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:30.692+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:31.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:31 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:31.008+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:31.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:31 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:31.008+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:31.455 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 05:20:30 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4[33284]: 2024-08-20T05:20:30.962+0000 7f01cbada640 -1 osd.4 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.926869+0000 front 2024-08-20T05:20:05.926841+0000 (oldest deadline 2024-08-20T05:20:28.227011+0000) 2024-08-20T05:20:31.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:31 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:31.059+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:31.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:31 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:31.059+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:31.583 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:31 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:31.296+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:31.583 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:31 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:31.296+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.130274+0000 front 2024-08-20T05:20:05.130299+0000 (oldest deadline 2024-08-20T05:20:31.030394+0000) 2024-08-20T05:20:31.865 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:31 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:31.581+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:31.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:31 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:31.634+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:32.015 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:31 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:31.682+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:32.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:32 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:32.043+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:32.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:32 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:32.043+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:32.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:32 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:32.037+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:32.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:32 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:32.037+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:32.563 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:32 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:32.256+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:32.563 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:32 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:32.256+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.130274+0000 front 2024-08-20T05:20:05.130299+0000 (oldest deadline 2024-08-20T05:20:31.030394+0000) 2024-08-20T05:20:32.865 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:32 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:32.561+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:32.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:32 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:32.654+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:32.905 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 05:20:32 smithi130 podman[57884]: 2024-08-20 05:20:32.606927641 +0000 UTC m=+5.747024821 container died 0c14b874ef1dba49bf796d5fc5278b572cd06e2daf86d0156e7b127886fa851a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux ) 2024-08-20T05:20:33.015 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:32 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:32.684+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:33.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:33 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:33.054+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:33.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:33 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:33.054+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:33.206 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 05:20:33 smithi130 podman[57884]: 2024-08-20 05:20:33.003417443 +0000 UTC m=+6.143514611 container cleanup 0c14b874ef1dba49bf796d5fc5278b572cd06e2daf86d0156e7b127886fa851a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux ) 2024-08-20T05:20:33.206 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 05:20:33 smithi130 bash[57884]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4 2024-08-20T05:20:33.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:33 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:33.019+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:33.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:33 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:33.019+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:33.533 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:33 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:33.232+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:33.533 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:33 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:33.232+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.130274+0000 front 2024-08-20T05:20:05.130299+0000 (oldest deadline 2024-08-20T05:20:31.030394+0000) 2024-08-20T05:20:33.656 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 05:20:33 smithi130 podman[57911]: 2024-08-20 05:20:33.329959223 +0000 UTC m=+0.717203951 container remove 0c14b874ef1dba49bf796d5fc5278b572cd06e2daf86d0156e7b127886fa851a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T05:20:33.657 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:33 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:33.462+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:33.865 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:33 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:33.531+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:33.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:33 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:33.659+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:33.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:33 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:33.659+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:33.955 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 05:20:33 smithi130 podman[58001]: 2024-08-20 05:20:33.65591955 +0000 UTC m=+0.107838046 container create 73a2820d85ad4b3b2c91e76097f6da4078360cba27b34af1bde905ad75e9053b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T05:20:33.955 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 05:20:33 smithi130 podman[58001]: 2024-08-20 05:20:33.564504045 +0000 UTC m=+0.016422555 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T05:20:33.956 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 05:20:33 smithi130 podman[58001]: 2024-08-20 05:20:33.900189623 +0000 UTC m=+0.352108130 container init 73a2820d85ad4b3b2c91e76097f6da4078360cba27b34af1bde905ad75e9053b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS) 2024-08-20T05:20:33.956 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 05:20:33 smithi130 podman[58001]: 2024-08-20 05:20:33.903432612 +0000 UTC m=+0.355351112 container start 73a2820d85ad4b3b2c91e76097f6da4078360cba27b34af1bde905ad75e9053b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T05:20:34.015 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:33 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:33.674+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:34.425 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:34 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:34.014+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:34.425 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:34 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:34.014+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:34.425 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 05:20:34 smithi130 podman[58001]: 2024-08-20 05:20:34.00025453 +0000 UTC m=+0.452173042 container attach 73a2820d85ad4b3b2c91e76097f6da4078360cba27b34af1bde905ad75e9053b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0) 2024-08-20T05:20:34.425 INFO:journalctl@ceph.osd.4.smithi130.stdout:Aug 20 05:20:34 smithi130 podman[58001]: 2024-08-20 05:20:34.096196642 +0000 UTC m=+0.548115151 container died 73a2820d85ad4b3b2c91e76097f6da4078360cba27b34af1bde905ad75e9053b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T05:20:34.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:34 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:34.021+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:34.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:34 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:34.021+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:34.569 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:34 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:34.187+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:34.569 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:34 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:34.187+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.130274+0000 front 2024-08-20T05:20:05.130299+0000 (oldest deadline 2024-08-20T05:20:31.030394+0000) 2024-08-20T05:20:34.705 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:34 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:34.423+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:34.775 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.4.service' 2024-08-20T05:20:34.816 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:20:34.817 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-20T05:20:34.817 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-20T05:20:34.817 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.5 2024-08-20T05:20:34.845 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:34 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:34.567+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:34.845 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:34 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:34.684+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:34.846 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:34 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:34.684+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:35.015 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:34 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:34.708+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:35.115 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:34 smithi135 systemd[1]: Stopping Ceph osd.5 for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:20:35.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:34 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:34.992+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:35.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:34 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:34.993+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:35.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:35 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:35.039+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:35.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:35 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:35.039+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:35.539 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:35 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:35.201+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:35.539 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:35 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:35.201+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.130274+0000 front 2024-08-20T05:20:05.130299+0000 (oldest deadline 2024-08-20T05:20:31.030394+0000) 2024-08-20T05:20:35.539 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:35 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:35.329+0000 7f0d37138640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:20:35.539 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:35 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:35.329+0000 7f0d37138640 -1 osd.5 92 *** Got signal Terminated *** 2024-08-20T05:20:35.539 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:35 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:35.329+0000 7f0d37138640 -1 osd.5 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T05:20:35.865 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:35 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:35.537+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:35.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:35 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:35.734+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:35.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:35 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:35.734+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:35.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:35 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:35.734+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:35.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:35 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:35.455+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:36.015 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:35 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:35.693+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:36.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:36 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:36.017+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:36.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:36 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:36.017+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:36.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:36 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:36.017+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:36.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:36 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:36.071+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:36.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:36 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:36.071+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:36.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:36 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:36.071+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:36.526 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:36 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:36.161+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:36.526 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:36 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:36.161+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.130274+0000 front 2024-08-20T05:20:05.130299+0000 (oldest deadline 2024-08-20T05:20:31.030394+0000) 2024-08-20T05:20:36.865 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:36 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:36.525+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:36.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:36 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:36.711+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:36.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:36 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:36.711+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:36.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:36 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:36.711+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:36.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:36 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:36.495+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:37.015 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:36 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:36.649+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:37.015 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:36 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:36.649+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.306465+0000 front 2024-08-20T05:20:10.306428+0000 (oldest deadline 2024-08-20T05:20:36.206711+0000) 2024-08-20T05:20:37.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:37 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:37.008+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:37.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:37 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:37.008+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:37.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:37 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:37.008+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:37.488 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:37 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:37.115+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:37.489 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:37 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:37.115+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.130274+0000 front 2024-08-20T05:20:05.130299+0000 (oldest deadline 2024-08-20T05:20:31.030394+0000) 2024-08-20T05:20:37.489 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:37 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:37.115+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:11.030912+0000 front 2024-08-20T05:20:11.031267+0000 (oldest deadline 2024-08-20T05:20:36.331055+0000) 2024-08-20T05:20:37.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:37 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:37.034+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:37.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:37 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:37.034+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:37.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:37 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:37.034+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:37.750 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:37 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:37.487+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:37.751 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:37 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:37.487+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:37.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:37 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:37.538+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:38.015 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:37 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:37.679+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:38.015 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:37 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:37.679+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.306465+0000 front 2024-08-20T05:20:10.306428+0000 (oldest deadline 2024-08-20T05:20:36.206711+0000) 2024-08-20T05:20:38.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:37 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:37.749+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:38.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:37 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:37.749+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:38.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:37 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:37.749+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:38.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:38 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:38.044+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:38.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:38 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:38.044+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:38.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:38 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:38.044+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:38.461 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:38 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:38.164+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:38.461 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:38 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:38.164+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.130274+0000 front 2024-08-20T05:20:05.130299+0000 (oldest deadline 2024-08-20T05:20:31.030394+0000) 2024-08-20T05:20:38.461 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:38 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:38.164+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:11.030912+0000 front 2024-08-20T05:20:11.031267+0000 (oldest deadline 2024-08-20T05:20:36.331055+0000) 2024-08-20T05:20:38.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:38 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:38.070+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:38.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:38 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:38.070+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:38.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:38 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:38.070+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:38.768 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:38 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:38.459+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:38.768 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:38 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:38.459+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:38.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:38 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:38.538+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:39.015 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:38 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:38.638+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:39.015 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:38 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:38.638+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.306465+0000 front 2024-08-20T05:20:10.306428+0000 (oldest deadline 2024-08-20T05:20:36.206711+0000) 2024-08-20T05:20:39.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:38 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:38.767+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:39.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:38 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:38.767+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:39.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:38 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:38.767+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:39.413 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:39 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:39.135+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:39.691 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:39 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:39.135+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.130274+0000 front 2024-08-20T05:20:05.130299+0000 (oldest deadline 2024-08-20T05:20:31.030394+0000) 2024-08-20T05:20:39.691 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:39 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:39.135+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:11.030912+0000 front 2024-08-20T05:20:11.031267+0000 (oldest deadline 2024-08-20T05:20:36.331055+0000) 2024-08-20T05:20:39.692 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:39 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:39.039+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:39.692 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:39 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:39.039+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:39.693 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:39 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:39.039+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:39.693 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:39 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:39.038+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:39.693 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:39 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:39.038+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:39.693 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:39 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:39.038+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:39.811 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:39 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:39.411+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:39.811 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:39 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:39.411+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:39.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:39 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:39.542+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:39.956 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:39 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:39.542+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:40.009 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:39 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:39.600+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:40.009 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:39 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:39.600+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.306465+0000 front 2024-08-20T05:20:10.306428+0000 (oldest deadline 2024-08-20T05:20:36.206711+0000) 2024-08-20T05:20:40.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:39 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:39.809+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:40.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:39 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:39.809+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:40.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:39 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:39.809+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:40.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:40 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:40.008+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:40.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:40 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:40.008+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:40.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:40 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:40.008+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:40.407 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:40 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:40.151+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:56.125907+0000 front 2024-08-20T05:19:56.125930+0000 (oldest deadline 2024-08-20T05:20:19.626063+0000) 2024-08-20T05:20:40.407 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:40 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:40.151+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.130274+0000 front 2024-08-20T05:20:05.130299+0000 (oldest deadline 2024-08-20T05:20:31.030394+0000) 2024-08-20T05:20:40.407 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:40 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5[34195]: 2024-08-20T05:20:40.151+0000 7f0d3374d640 -1 osd.5 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:11.030912+0000 front 2024-08-20T05:20:11.031267+0000 (oldest deadline 2024-08-20T05:20:36.331055+0000) 2024-08-20T05:20:40.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:40 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:40.007+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:40.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:40 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:40.007+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:40.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:40 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:40.007+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:40.764 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:40 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:40.405+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:40.764 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:40 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:40.405+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:40.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:40 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:40.560+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:40.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:40 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:40.560+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:40.971 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:40 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:40.605+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:40.971 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:40 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:40.605+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.306465+0000 front 2024-08-20T05:20:10.306428+0000 (oldest deadline 2024-08-20T05:20:36.206711+0000) 2024-08-20T05:20:41.048 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:40 smithi135 podman[58421]: 2024-08-20 05:20:40.763687384 +0000 UTC m=+5.746675450 container died d5019682a409fed89e8c5a46a30319f76bfb1363205d60a98f559053ea875bee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T05:20:41.048 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:40 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:40.791+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:41.048 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:40 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:40.791+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:41.049 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:40 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:40.791+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:41.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:40 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:40.970+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:41.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:40 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:40.970+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:41.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:40 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:40.970+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:41.341 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:41 smithi135 podman[58421]: 2024-08-20 05:20:41.130135202 +0000 UTC m=+6.113123268 container cleanup d5019682a409fed89e8c5a46a30319f76bfb1363205d60a98f559053ea875bee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T05:20:41.341 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:41 smithi135 bash[58421]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5 2024-08-20T05:20:41.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:40 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:40.984+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:41.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:40 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:40.984+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:41.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:40 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:40.984+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:41.615 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:41 smithi135 podman[58436]: 2024-08-20 05:20:41.340199261 +0000 UTC m=+0.575351953 container remove d5019682a409fed89e8c5a46a30319f76bfb1363205d60a98f559053ea875bee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-20T05:20:41.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:41 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:41.374+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:41.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:41 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:41.374+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:41.937 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:41 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:41.598+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:41.937 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:41 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:41.598+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:42.000 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:41 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:41.654+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:42.000 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:41 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:41.654+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.306465+0000 front 2024-08-20T05:20:10.306428+0000 (oldest deadline 2024-08-20T05:20:36.206711+0000) 2024-08-20T05:20:42.020 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:41 smithi135 podman[58527]: 2024-08-20 05:20:41.64215096 +0000 UTC m=+0.015621198 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T05:20:42.020 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:41 smithi135 podman[58527]: 2024-08-20 05:20:41.758004185 +0000 UTC m=+0.131474410 container create d83ad0fadc44f6782ecd22e0a961076438b1b6b6b8d45c43554a532c7be70e6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0) 2024-08-20T05:20:42.020 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:41 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:41.788+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:42.020 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:41 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:41.788+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:42.020 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:41 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:41.788+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:42.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:41 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:41.936+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:42.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:41 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:41.936+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:42.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:41 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:41.936+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:42.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:41 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:41.998+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:42.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:41 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:41.998+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:42.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:41 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:41.998+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:42.365 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:42 smithi135 podman[58527]: 2024-08-20 05:20:42.019368833 +0000 UTC m=+0.392839058 container init d83ad0fadc44f6782ecd22e0a961076438b1b6b6b8d45c43554a532c7be70e6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T05:20:42.366 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:42 smithi135 podman[58527]: 2024-08-20 05:20:42.023028125 +0000 UTC m=+0.396498352 container start d83ad0fadc44f6782ecd22e0a961076438b1b6b6b8d45c43554a532c7be70e6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-08-20T05:20:42.366 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:42 smithi135 podman[58527]: 2024-08-20 05:20:42.136165374 +0000 UTC m=+0.509635600 container attach d83ad0fadc44f6782ecd22e0a961076438b1b6b6b8d45c43554a532c7be70e6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T05:20:42.366 INFO:journalctl@ceph.osd.5.smithi135.stdout:Aug 20 05:20:42 smithi135 podman[58527]: 2024-08-20 05:20:42.22556136 +0000 UTC m=+0.599031590 container died d83ad0fadc44f6782ecd22e0a961076438b1b6b6b8d45c43554a532c7be70e6f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-20T05:20:42.762 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:42 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:42.423+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:42.763 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:42 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:42.423+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:42.838 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.5.service' 2024-08-20T05:20:42.916 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:20:42.917 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-20T05:20:42.917 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-08-20T05:20:42.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.6 2024-08-20T05:20:42.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:42 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:42.637+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:42.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:42 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:42.637+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:42.956 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:42 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:42.663+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:42.956 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:42 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:42.663+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.306465+0000 front 2024-08-20T05:20:10.306428+0000 (oldest deadline 2024-08-20T05:20:36.206711+0000) 2024-08-20T05:20:43.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:42 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:42.761+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:43.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:42 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:42.761+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:43.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:42 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:42.761+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:43.265 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:43 smithi037 systemd[1]: Stopping Ceph osd.6 for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:20:43.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:42 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:42.955+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:43.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:42 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:42.955+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:43.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:42 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:42.955+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:43.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:42 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:42.954+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:43.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:42 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:42.954+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:43.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:42 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:42.954+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:43.713 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:43 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:43.353+0000 7f6059800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:20:43.713 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:43 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:43.353+0000 7f6059800640 -1 osd.6 92 *** Got signal Terminated *** 2024-08-20T05:20:43.713 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:43 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:43.353+0000 7f6059800640 -1 osd.6 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T05:20:43.784 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:43 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:43.389+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:43.784 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:43 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:43.389+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:43.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:43 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:43.650+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:43.956 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:43 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:43.650+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:44.015 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:43 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:43.712+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:44.015 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:43 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:43.712+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.306465+0000 front 2024-08-20T05:20:10.306428+0000 (oldest deadline 2024-08-20T05:20:36.206711+0000) 2024-08-20T05:20:44.015 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:43 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:43.954+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:44.015 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:43 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:43.954+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:44.016 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:43 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:43.954+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:44.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:43 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:43.782+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:44.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:43 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:43.782+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:44.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:43 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:43.782+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:44.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:43 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:43.958+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:44.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:43 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:43.958+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:44.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:43 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:43.958+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:44.765 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:44 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:44.433+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:44.766 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:44 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:44.433+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:44.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:44 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:44.696+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:44.956 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:44 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:44.696+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:45.001 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:44 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:44.748+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:45.001 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:44 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:44.748+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.306465+0000 front 2024-08-20T05:20:10.306428+0000 (oldest deadline 2024-08-20T05:20:36.206711+0000) 2024-08-20T05:20:45.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:44 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:44.764+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:45.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:44 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:44.764+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:45.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:44 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:44.764+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:45.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:45 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:45.000+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:45.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:45 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:45.000+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:45.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:45 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:45.000+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:45.457 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:44 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:44.977+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:45.458 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:44 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:44.977+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:45.458 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:44 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:44.977+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:45.750 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:45 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:45.456+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:45.750 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:45 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:45.456+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:45.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:45 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:45.684+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:45.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:45 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:45.684+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:46.003 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:45 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:45.707+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:46.003 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:45 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:45.707+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.306465+0000 front 2024-08-20T05:20:10.306428+0000 (oldest deadline 2024-08-20T05:20:36.206711+0000) 2024-08-20T05:20:46.025 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:45 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:45.748+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:46.025 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:45 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:45.748+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:46.025 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:45 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:45.748+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:46.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:46 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:46.002+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:46.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:46 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:46.002+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:46.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:46 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:46.002+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:46.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:45 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:45.982+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:46.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:45 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:45.982+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:46.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:45 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:45.982+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:46.780 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:46 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:46.423+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:46.781 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:46 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:46.423+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:46.781 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:46 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:46.423+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:20:46.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:46 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:46.672+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:46.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:46 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:46.672+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:46.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:46 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:46.672+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.002216+0000 front 2024-08-20T05:20:22.002067+0000 (oldest deadline 2024-08-20T05:20:46.102032+0000) 2024-08-20T05:20:47.015 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:46 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:46.715+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:47.015 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:46 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:46.715+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.306465+0000 front 2024-08-20T05:20:10.306428+0000 (oldest deadline 2024-08-20T05:20:36.206711+0000) 2024-08-20T05:20:47.015 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:46 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:46.955+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:47.015 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:46 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:46.955+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:47.015 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:46 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:46.955+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:47.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:46 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:46.778+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:47.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:46 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:46.778+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:47.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:46 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:46.778+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:47.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:46 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:46.955+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:47.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:46 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:46.955+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:47.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:46 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:46.955+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:47.749 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:47 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:47.421+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:47.750 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:47 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:47.421+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:47.750 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:47 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:47.421+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:20:47.945 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:47 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:47.666+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:47.945 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:47 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:47.666+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:47.945 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:47 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:47.666+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.002216+0000 front 2024-08-20T05:20:22.002067+0000 (oldest deadline 2024-08-20T05:20:46.102032+0000) 2024-08-20T05:20:48.015 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:47 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:47.751+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:05.605487+0000 front 2024-08-20T05:20:05.605346+0000 (oldest deadline 2024-08-20T05:20:30.305626+0000) 2024-08-20T05:20:48.016 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:47 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6[46869]: 2024-08-20T05:20:47.751+0000 7f6050200640 -1 osd.6 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.306465+0000 front 2024-08-20T05:20:10.306428+0000 (oldest deadline 2024-08-20T05:20:36.206711+0000) 2024-08-20T05:20:48.016 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:47 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:47.977+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:48.016 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:47 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:47.977+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:48.016 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:47 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:47.977+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:48.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:47 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:47.748+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:48.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:47 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:47.748+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:48.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:47 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:47.748+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:48.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:47 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:47.943+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:48.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:47 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:47.943+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:48.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:47 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:47.943+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:48.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:47 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:47.943+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:20:48.787 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:48 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:48.446+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:48.787 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:48 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:48.446+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:48.788 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:48 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:48.446+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:20:48.924 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:48 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:48.624+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:48.924 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:48 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:48.624+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:48.924 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:48 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:48.624+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.002216+0000 front 2024-08-20T05:20:22.002067+0000 (oldest deadline 2024-08-20T05:20:46.102032+0000) 2024-08-20T05:20:49.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:48 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:48.786+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:49.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:48 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:48.786+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:49.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:48 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:48.786+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:49.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:48 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:48.921+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:49.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:48 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:48.921+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:49.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:48 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:48.921+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:49.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:48 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:48.921+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:20:49.265 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:49 smithi037 podman[112906]: 2024-08-20 05:20:49.035776818 +0000 UTC m=+5.819995619 container died afdb0c3b91ea315c859b275c7f3a2ab5309489ef7c99fa619df9276531ac24b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-08-20T05:20:49.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:48 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:48.964+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:49.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:48 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:48.964+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:49.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:48 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:48.964+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:49.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:48 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:48.964+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:20:49.636 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:49 smithi037 podman[112906]: 2024-08-20 05:20:49.61018378 +0000 UTC m=+6.394402581 container cleanup afdb0c3b91ea315c859b275c7f3a2ab5309489ef7c99fa619df9276531ac24b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-08-20T05:20:49.636 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:49 smithi037 bash[112906]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6 2024-08-20T05:20:49.761 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:49 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:49.404+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:49.761 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:49 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:49.404+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:49.761 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:49 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:49.404+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:20:49.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:49 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:49.610+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:49.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:49 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:49.610+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:49.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:49 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:49.610+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.002216+0000 front 2024-08-20T05:20:22.002067+0000 (oldest deadline 2024-08-20T05:20:46.102032+0000) 2024-08-20T05:20:50.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:49 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:49.759+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:50.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:49 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:49.759+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:50.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:49 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:49.759+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:50.265 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:49 smithi037 podman[112923]: 2024-08-20 05:20:49.853781807 +0000 UTC m=+0.810473300 container remove afdb0c3b91ea315c859b275c7f3a2ab5309489ef7c99fa619df9276531ac24b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-20T05:20:50.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:50 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:50.011+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:50.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:50 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:50.011+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:50.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:50 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:50.011+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:50.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:50 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:50.011+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:20:50.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:49 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:49.956+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:50.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:49 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:49.956+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:50.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:49 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:49.956+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:50.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:49 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:49.956+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:20:50.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:50 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:50.364+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:50.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:50 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:50.364+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:50.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:50 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:50.364+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:20:50.717 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:50 smithi037 podman[113013]: 2024-08-20 05:20:50.342328957 +0000 UTC m=+0.027474551 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T05:20:50.717 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:50 smithi037 podman[113013]: 2024-08-20 05:20:50.496292668 +0000 UTC m=+0.181438252 container create 6b88605b7a8f48313a740c274595d48dbe8f6a48e2031f7a90ae5aa5d7f88e26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.36.0) 2024-08-20T05:20:50.717 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:50 smithi037 podman[113013]: 2024-08-20 05:20:50.715695989 +0000 UTC m=+0.400841573 container init 6b88605b7a8f48313a740c274595d48dbe8f6a48e2031f7a90ae5aa5d7f88e26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, io.buildah.version=1.36.0) 2024-08-20T05:20:50.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:50 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:50.632+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:50.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:50 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:50.632+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:50.956 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:50 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:50.632+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.002216+0000 front 2024-08-20T05:20:22.002067+0000 (oldest deadline 2024-08-20T05:20:46.102032+0000) 2024-08-20T05:20:50.993 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:50 smithi037 podman[113013]: 2024-08-20 05:20:50.722792267 +0000 UTC m=+0.407937859 container start 6b88605b7a8f48313a740c274595d48dbe8f6a48e2031f7a90ae5aa5d7f88e26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T05:20:50.993 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:50 smithi037 podman[113013]: 2024-08-20 05:20:50.857289308 +0000 UTC m=+0.542434910 container attach 6b88605b7a8f48313a740c274595d48dbe8f6a48e2031f7a90ae5aa5d7f88e26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-20T05:20:51.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:50 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:50.769+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:51.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:50 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:50.769+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:51.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:50 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:50.769+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:51.265 INFO:journalctl@ceph.osd.6.smithi037.stdout:Aug 20 05:20:50 smithi037 podman[113013]: 2024-08-20 05:20:50.992942847 +0000 UTC m=+0.678088437 container died 6b88605b7a8f48313a740c274595d48dbe8f6a48e2031f7a90ae5aa5d7f88e26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-20T05:20:51.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:51 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:51.000+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:51.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:51 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:51.000+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:51.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:51 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:51.000+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:51.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:51 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:51.000+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:20:51.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:50 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:50.964+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:51.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:50 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:50.964+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:51.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:50 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:50.964+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:51.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:50 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:50.964+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:20:51.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:51 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:51.355+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:51.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:51 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:51.355+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:51.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:51 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:51.355+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:20:51.780 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.6.service' 2024-08-20T05:20:51.896 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:20:51.896 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-08-20T05:20:51.896 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-08-20T05:20:51.896 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.7 2024-08-20T05:20:51.924 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:51 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:51.649+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:51.924 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:51 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:51.649+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:51.924 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:51 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:51.649+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.002216+0000 front 2024-08-20T05:20:22.002067+0000 (oldest deadline 2024-08-20T05:20:46.102032+0000) 2024-08-20T05:20:52.016 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:51 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:51.991+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:52.016 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:51 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:51.991+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:52.016 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:51 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:51.991+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:52.016 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:51 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:51.991+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:20:52.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:51 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:51.745+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:52.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:51 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:51.745+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:52.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:51 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:51.745+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:52.200 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:51 smithi130 systemd[1]: Stopping Ceph osd.7 for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:20:52.201 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:51 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:51.977+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:52.201 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:51 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:51.977+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:52.201 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:51 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:51.977+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:52.201 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:51 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:51.977+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:20:52.455 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:52 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:52.198+0000 7f64f7612640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:20:52.455 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:52 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:52.198+0000 7f64f7612640 -1 osd.7 92 *** Got signal Terminated *** 2024-08-20T05:20:52.455 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:52 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:52.198+0000 7f64f7612640 -1 osd.7 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T05:20:52.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:52 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:52.325+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:52.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:52 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:52.325+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:52.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:52 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:52.325+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:20:52.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:52 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:52.681+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:52.956 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:52 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:52.681+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:52.956 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:52 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:52.681+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.002216+0000 front 2024-08-20T05:20:22.002067+0000 (oldest deadline 2024-08-20T05:20:46.102032+0000) 2024-08-20T05:20:53.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:52 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:52.724+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:53.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:52 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:52.724+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:53.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:52 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:52.724+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:53.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:52 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:52.988+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:53.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:52 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:52.988+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:53.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:52 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:52.988+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:53.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:52 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:52.988+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:20:53.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:52 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:52.963+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:53.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:52 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:52.963+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:53.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:52 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:52.963+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:53.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:52 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:52.963+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:20:53.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:53 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:53.322+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:53.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:53 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:53.322+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:53.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:53 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:53.322+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:20:54.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:53 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:53.729+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:54.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:53 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:53.729+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:54.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:53 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:53.729+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:54.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:53 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:53.958+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:54.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:53 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:53.958+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:54.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:53 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:53.958+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:54.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:53 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:53.958+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:20:54.206 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:53 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:53.713+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:54.206 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:53 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:53.713+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:54.206 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:53 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:53.713+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.002216+0000 front 2024-08-20T05:20:22.002067+0000 (oldest deadline 2024-08-20T05:20:46.102032+0000) 2024-08-20T05:20:54.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:53 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:53.986+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:54.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:53 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:53.986+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:54.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:53 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:53.986+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:54.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:53 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:53.986+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:20:54.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:54 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:54.353+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:54.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:54 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:54.353+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:54.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:54 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:54.353+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:20:54.955 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:54 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:54.668+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:54.956 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:54 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:54.668+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:54.956 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:54 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:54.668+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.002216+0000 front 2024-08-20T05:20:22.002067+0000 (oldest deadline 2024-08-20T05:20:46.102032+0000) 2024-08-20T05:20:55.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:54 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:54.732+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:55.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:54 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:54.732+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:55.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:54 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:54.732+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:55.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:54 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:54.732+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:20:55.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:54 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:54.976+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:55.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:54 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:54.976+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:55.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:54 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:54.976+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:55.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:54 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:54.976+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:20:55.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:54 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:54.976+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:20:55.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:54 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:54.979+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:55.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:54 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:54.979+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:55.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:54 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:54.979+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:55.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:54 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:54.979+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:20:55.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:55 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:55.305+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:55.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:55 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:55.305+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:55.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:55 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:55.305+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:20:56.016 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:55 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:55.716+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:56.017 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:55 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:55.716+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:56.017 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:55 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:55.716+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.002216+0000 front 2024-08-20T05:20:22.002067+0000 (oldest deadline 2024-08-20T05:20:46.102032+0000) 2024-08-20T05:20:56.017 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:55 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:55.716+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.703659+0000 front 2024-08-20T05:20:30.703680+0000 (oldest deadline 2024-08-20T05:20:54.803783+0000) 2024-08-20T05:20:56.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:55 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:55.698+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:56.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:55 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:55.698+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:56.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:55 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:55.698+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:56.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:55 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:55.698+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:20:56.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:56 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:56.011+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:56.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:56 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:56.011+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:56.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:56 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:56.011+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:56.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:56 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:56.011+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:20:56.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:56 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:56.011+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:20:56.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:56 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:56.014+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:56.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:56 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:56.014+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:56.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:56 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:56.014+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:56.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:56 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:56.014+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:20:56.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:56 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:56.305+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:56.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:56 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:56.305+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:56.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:56 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:56.305+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:20:56.998 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:56 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:56.680+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:56.998 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:56 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:56.680+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:56.998 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:56 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:56.680+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:56.999 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:56 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:56.680+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:20:57.205 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:56 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:56.748+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.299545+0000 front 2024-08-20T05:20:03.299617+0000 (oldest deadline 2024-08-20T05:20:32.700096+0000) 2024-08-20T05:20:57.206 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:56 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:56.748+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.700672+0000 front 2024-08-20T05:20:12.700727+0000 (oldest deadline 2024-08-20T05:20:38.600535+0000) 2024-08-20T05:20:57.206 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:56 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:56.748+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.002216+0000 front 2024-08-20T05:20:22.002067+0000 (oldest deadline 2024-08-20T05:20:46.102032+0000) 2024-08-20T05:20:57.206 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:56 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7[39756]: 2024-08-20T05:20:56.748+0000 7f64f3c27640 -1 osd.7 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.703659+0000 front 2024-08-20T05:20:30.703680+0000 (oldest deadline 2024-08-20T05:20:54.803783+0000) 2024-08-20T05:20:57.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:56 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:56.995+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:57.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:56 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:56.995+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:57.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:56 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:56.995+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:57.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:56 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:56.995+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:20:57.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:56 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:56.976+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:57.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:56 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:56.976+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:57.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:56 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:56.976+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:57.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:56 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:56.976+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:20:57.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:56 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:56.976+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:20:57.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:57 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:57.312+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:57.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:57 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:57.312+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:57.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:57 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:57.312+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:20:57.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:57 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:57.312+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.902240+0000 front 2024-08-20T05:20:31.902255+0000 (oldest deadline 2024-08-20T05:20:57.202146+0000) 2024-08-20T05:20:58.009 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:57 smithi130 podman[58102]: 2024-08-20 05:20:57.726673273 +0000 UTC m=+5.640805354 container died 762a8d823c79e6585a80f834357c65c66e1688ccceaebd5c4c364db5f4ad9c4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-20T05:20:58.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:57 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:57.713+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:58.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:57 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:57.713+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:58.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:57 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:57.713+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:58.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:57 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:57.713+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:20:58.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:57 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:57.983+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:58.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:57 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:57.983+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:58.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:57 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:57.983+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:58.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:57 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:57.983+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:20:58.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:57 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:57.983+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:20:58.394 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:58 smithi130 podman[58102]: 2024-08-20 05:20:58.115912708 +0000 UTC m=+6.030044744 container cleanup 762a8d823c79e6585a80f834357c65c66e1688ccceaebd5c4c364db5f4ad9c4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-20T05:20:58.394 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:58 smithi130 bash[58102]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7 2024-08-20T05:20:58.394 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:58 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:58.041+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:58.395 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:58 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:58.041+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:58.395 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:58 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:58.041+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:58.395 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:58 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:58.041+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:20:58.395 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:58 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:58.041+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:20:58.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:58 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:58.326+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:58.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:58 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:58.326+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:58.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:58 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:58.326+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:20:58.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:58 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:58.326+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.902240+0000 front 2024-08-20T05:20:31.902255+0000 (oldest deadline 2024-08-20T05:20:57.202146+0000) 2024-08-20T05:20:58.705 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:58 smithi130 podman[58117]: 2024-08-20 05:20:58.392563521 +0000 UTC m=+0.651318443 container remove 762a8d823c79e6585a80f834357c65c66e1688ccceaebd5c4c364db5f4ad9c4c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-20T05:20:59.055 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:58 smithi130 podman[58205]: 2024-08-20 05:20:58.64463122 +0000 UTC m=+0.015566991 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T05:20:59.055 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:58 smithi130 podman[58205]: 2024-08-20 05:20:58.743450156 +0000 UTC m=+0.114385966 container create 1a2d9c5c2c19904310a1df332b8dad535d4f32d04b621c0f09138236559268a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7-deactivate, io.buildah.version=1.36.0, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-08-20T05:20:59.055 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:58 smithi130 podman[58205]: 2024-08-20 05:20:58.979199768 +0000 UTC m=+0.350135538 container init 1a2d9c5c2c19904310a1df332b8dad535d4f32d04b621c0f09138236559268a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-20T05:20:59.055 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:58 smithi130 podman[58205]: 2024-08-20 05:20:58.982489092 +0000 UTC m=+0.353424859 container start 1a2d9c5c2c19904310a1df332b8dad535d4f32d04b621c0f09138236559268a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-08-20T05:20:59.055 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:59 smithi130 podman[58205]: 2024-08-20 05:20:59.054305847 +0000 UTC m=+0.425241619 container attach 1a2d9c5c2c19904310a1df332b8dad535d4f32d04b621c0f09138236559268a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-08-20T05:20:59.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:58 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:58.673+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:59.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:58 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:58.673+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:59.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:58 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:58.673+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:59.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:58 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:58.673+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:20:59.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:58 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:58.993+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:20:59.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:58 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:58.993+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:20:59.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:58 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:58.993+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:20:59.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:58 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:58.993+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:20:59.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:20:58 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:20:58.993+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:20:59.451 INFO:journalctl@ceph.osd.7.smithi130.stdout:Aug 20 05:20:59 smithi130 podman[58205]: 2024-08-20 05:20:59.172877299 +0000 UTC m=+0.543813076 container died 1a2d9c5c2c19904310a1df332b8dad535d4f32d04b621c0f09138236559268a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.vendor=CentOS) 2024-08-20T05:20:59.452 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:59 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:59.084+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:20:59.452 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:59 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:59.084+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:20:59.452 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:59 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:59.084+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:20:59.452 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:59 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:59.084+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:20:59.452 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:20:59 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:20:59.084+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:20:59.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:59 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:59.304+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:20:59.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:59 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:59.304+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:20:59.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:59 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:59.304+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:20:59.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:20:59 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:20:59.304+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.902240+0000 front 2024-08-20T05:20:31.902255+0000 (oldest deadline 2024-08-20T05:20:57.202146+0000) 2024-08-20T05:20:59.870 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.7.service' 2024-08-20T05:20:59.949 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:20:59.949 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-08-20T05:20:59.949 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-08-20T05:20:59.949 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.8 2024-08-20T05:20:59.976 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:59 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:59.670+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:20:59.977 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:59 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:59.670+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:20:59.977 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:59 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:59.670+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:20:59.977 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:20:59 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:20:59.670+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:00.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:00 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:00.054+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:00.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:00 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:00.054+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:00.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:00 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:00.054+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:00.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:00 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:00.054+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:00.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:00 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:00.054+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:00.277 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:00 smithi135 systemd[1]: Stopping Ceph osd.8 for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:21:00.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:00 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:00.034+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:21:00.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:00 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:00.034+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:21:00.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:00 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:00.034+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:21:00.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:00 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:00.034+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:21:00.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:00 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:00.034+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:21:00.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:00 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:00.276+0000 7fc6b1520640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:21:00.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:00 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:00.276+0000 7fc6b1520640 -1 osd.8 92 *** Got signal Terminated *** 2024-08-20T05:21:00.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:00 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:00.276+0000 7fc6b1520640 -1 osd.8 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T05:21:00.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:00 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:00.326+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:21:00.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:00 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:00.326+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:21:00.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:00 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:00.326+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:21:00.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:00 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:00.326+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.902240+0000 front 2024-08-20T05:20:31.902255+0000 (oldest deadline 2024-08-20T05:20:57.202146+0000) 2024-08-20T05:21:01.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:00 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:00.674+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:01.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:00 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:00.674+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:01.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:00 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:00.674+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:01.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:00 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:00.674+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:01.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:01 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:01.055+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:01.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:01 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:01.055+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:01.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:01 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:01.055+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:01.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:01 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:01.055+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:01.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:01 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:01.055+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:01.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:01.064+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:21:01.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:01.064+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:21:01.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:01.064+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:21:01.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:01.064+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:21:01.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:01.064+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:21:01.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:01 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:01.064+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:34.958379+0000 front 2024-08-20T05:20:34.958257+0000 (oldest deadline 2024-08-20T05:21:00.858347+0000) 2024-08-20T05:21:01.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:01 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:01.284+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:21:01.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:01 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:01.284+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:21:01.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:01 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:01.284+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:21:01.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:01 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:01.284+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.902240+0000 front 2024-08-20T05:20:31.902255+0000 (oldest deadline 2024-08-20T05:20:57.202146+0000) 2024-08-20T05:21:02.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:01 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:01.638+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:02.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:01 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:01.638+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:02.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:01 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:01.638+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:02.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:01 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:01.638+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:02.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:01 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:01.638+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:02.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:02 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:02.028+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:02.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:02 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:02.028+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:02.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:02 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:02.028+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:02.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:02 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:02.028+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:02.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:02 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:02.028+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:02.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:02 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:02.112+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:21:02.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:02 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:02.112+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:21:02.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:02 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:02.112+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:21:02.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:02 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:02.112+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:21:02.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:02 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:02.112+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:21:02.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:02 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:02.112+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:34.958379+0000 front 2024-08-20T05:20:34.958257+0000 (oldest deadline 2024-08-20T05:21:00.858347+0000) 2024-08-20T05:21:02.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:02 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:02.255+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:21:02.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:02 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:02.255+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:21:02.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:02 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:02.255+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:21:02.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:02 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:02.255+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.902240+0000 front 2024-08-20T05:20:31.902255+0000 (oldest deadline 2024-08-20T05:20:57.202146+0000) 2024-08-20T05:21:03.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:02 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:02.620+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:03.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:02 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:02.620+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:03.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:02 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:02.620+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:03.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:02 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:02.620+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:03.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:02 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:02.620+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:03.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:03 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:03.014+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:03.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:03 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:03.014+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:03.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:03 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:03.014+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:03.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:03 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:03.014+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:03.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:03 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:03.014+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:03.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:03 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:03.014+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:03.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:03 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:03.127+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:21:03.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:03 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:03.127+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:21:03.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:03 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:03.127+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:21:03.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:03 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:03.127+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:21:03.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:03 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:03.127+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:21:03.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:03 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:03.127+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:34.958379+0000 front 2024-08-20T05:20:34.958257+0000 (oldest deadline 2024-08-20T05:21:00.858347+0000) 2024-08-20T05:21:03.615 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:03 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:03.262+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:21:03.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:03 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:03.262+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:21:03.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:03 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:03.262+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:21:03.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:03 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:03.262+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.902240+0000 front 2024-08-20T05:20:31.902255+0000 (oldest deadline 2024-08-20T05:20:57.202146+0000) 2024-08-20T05:21:03.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:03 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:03.262+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.702815+0000 front 2024-08-20T05:20:37.702829+0000 (oldest deadline 2024-08-20T05:21:02.403025+0000) 2024-08-20T05:21:04.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:03 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:03.629+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:04.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:03 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:03.629+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:04.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:03 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:03.629+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:04.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:03 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:03.629+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:04.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:03 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:03.629+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:04.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:04 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:04.046+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:04.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:04 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:04.046+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:04.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:04 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:04.046+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:04.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:04 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:04.046+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:04.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:04 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:04.046+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:04.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:04 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:04.046+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:04.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:04.135+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:21:04.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:04.135+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:21:04.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:04.135+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:21:04.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:04.135+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:21:04.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:04.135+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:21:04.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:04 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:04.135+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:34.958379+0000 front 2024-08-20T05:20:34.958257+0000 (oldest deadline 2024-08-20T05:21:00.858347+0000) 2024-08-20T05:21:04.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:04 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:04.242+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:21:04.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:04 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:04.242+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:21:04.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:04 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:04.242+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:21:04.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:04 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:04.242+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.902240+0000 front 2024-08-20T05:20:31.902255+0000 (oldest deadline 2024-08-20T05:20:57.202146+0000) 2024-08-20T05:21:04.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:04 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:04.242+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.702815+0000 front 2024-08-20T05:20:37.702829+0000 (oldest deadline 2024-08-20T05:21:02.403025+0000) 2024-08-20T05:21:05.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:04 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:04.650+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:05.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:04 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:04.650+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:05.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:04 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:04.650+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:05.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:04 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:04.650+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:05.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:04 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:04.650+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:05.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:05 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:05.038+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:05.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:05 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:05.038+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:05.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:05 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:05.038+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:05.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:05 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:05.038+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:05.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:05 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:05.038+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:05.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:05 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:05.038+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:05.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:05 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:05.086+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:21:05.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:05 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:05.086+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:21:05.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:05 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:05.086+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:21:05.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:05 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:05.086+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:21:05.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:05 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:05.086+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:21:05.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:05 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:05.086+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:34.958379+0000 front 2024-08-20T05:20:34.958257+0000 (oldest deadline 2024-08-20T05:21:00.858347+0000) 2024-08-20T05:21:05.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:05 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:05.233+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:01.697200+0000 front 2024-08-20T05:20:01.697263+0000 (oldest deadline 2024-08-20T05:20:26.997283+0000) 2024-08-20T05:21:05.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:05 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:05.233+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:14.399658+0000 front 2024-08-20T05:20:14.399640+0000 (oldest deadline 2024-08-20T05:20:36.699806+0000) 2024-08-20T05:21:05.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:05 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:05.233+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:20.801064+0000 front 2024-08-20T05:20:20.801086+0000 (oldest deadline 2024-08-20T05:20:46.100973+0000) 2024-08-20T05:21:05.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:05 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:05.233+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.902240+0000 front 2024-08-20T05:20:31.902255+0000 (oldest deadline 2024-08-20T05:20:57.202146+0000) 2024-08-20T05:21:05.616 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:05 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8[40679]: 2024-08-20T05:21:05.233+0000 7fc6a9b2d640 -1 osd.8 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.702815+0000 front 2024-08-20T05:20:37.702829+0000 (oldest deadline 2024-08-20T05:21:02.403025+0000) 2024-08-20T05:21:06.062 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:05 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:05.685+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:06.062 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:05 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:05.685+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:06.062 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:05 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:05.685+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:06.062 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:05 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:05.685+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:06.062 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:05 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:05.685+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:06.063 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:05 smithi135 podman[58642]: 2024-08-20 05:21:05.783540995 +0000 UTC m=+5.635092265 container died fd65d2f158b1bba9ad47819f77e3a8f7ee2843061a0f0c87137577cbe472aa20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731) 2024-08-20T05:21:06.365 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:06 smithi135 podman[58642]: 2024-08-20 05:21:06.168772476 +0000 UTC m=+6.020323735 container cleanup fd65d2f158b1bba9ad47819f77e3a8f7ee2843061a0f0c87137577cbe472aa20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731) 2024-08-20T05:21:06.366 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:06 smithi135 bash[58642]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8 2024-08-20T05:21:06.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:05 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:05.996+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:06.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:05 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:05.996+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:06.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:05 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:05.996+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:06.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:05 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:05.996+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:06.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:05 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:05.996+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:06.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:05 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:05.996+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:06.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:06 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:06.058+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:21:06.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:06 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:06.058+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:21:06.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:06 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:06.058+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:21:06.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:06 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:06.058+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:21:06.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:06 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:06.058+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:21:06.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:06 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:06.058+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:34.958379+0000 front 2024-08-20T05:20:34.958257+0000 (oldest deadline 2024-08-20T05:21:00.858347+0000) 2024-08-20T05:21:06.693 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:06 smithi135 podman[58656]: 2024-08-20 05:21:06.395192732 +0000 UTC m=+0.610705720 container remove fd65d2f158b1bba9ad47819f77e3a8f7ee2843061a0f0c87137577cbe472aa20 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-08-20T05:21:06.944 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:06 smithi135 podman[58746]: 2024-08-20 05:21:06.697273813 +0000 UTC m=+0.015854729 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T05:21:06.945 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:06 smithi135 podman[58746]: 2024-08-20 05:21:06.796088879 +0000 UTC m=+0.114669821 container create 5cd85e9c204306e6f5c95ebad69413164369b2adc93fd13bd7f783dcce1853df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-08-20T05:21:06.945 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:06 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:06.691+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:06.945 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:06 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:06.691+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:06.945 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:06 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:06.691+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:06.945 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:06 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:06.691+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:06.945 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:06 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:06.691+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:07.240 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:07 smithi135 podman[58746]: 2024-08-20 05:21:07.040538856 +0000 UTC m=+0.359119756 container init 5cd85e9c204306e6f5c95ebad69413164369b2adc93fd13bd7f783dcce1853df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T05:21:07.240 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:07 smithi135 podman[58746]: 2024-08-20 05:21:07.043869927 +0000 UTC m=+0.362450833 container start 5cd85e9c204306e6f5c95ebad69413164369b2adc93fd13bd7f783dcce1853df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-08-20T05:21:07.241 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:07 smithi135 podman[58746]: 2024-08-20 05:21:07.115530286 +0000 UTC m=+0.434111199 container attach 5cd85e9c204306e6f5c95ebad69413164369b2adc93fd13bd7f783dcce1853df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T05:21:07.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:06 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:06.982+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:07.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:06 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:06.982+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:07.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:06 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:06.982+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:07.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:06 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:06.982+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:07.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:06 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:06.982+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:07.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:06 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:06.982+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:07.509 INFO:journalctl@ceph.osd.8.smithi135.stdout:Aug 20 05:21:07 smithi135 podman[58746]: 2024-08-20 05:21:07.239421389 +0000 UTC m=+0.558002290 container died 5cd85e9c204306e6f5c95ebad69413164369b2adc93fd13bd7f783dcce1853df (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-08-20T05:21:07.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:07 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:07.096+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:21:07.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:07 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:07.096+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:21:07.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:07 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:07.096+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:21:07.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:07 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:07.096+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:21:07.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:07 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:07.096+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:21:07.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:07 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:07.096+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:34.958379+0000 front 2024-08-20T05:20:34.958257+0000 (oldest deadline 2024-08-20T05:21:00.858347+0000) 2024-08-20T05:21:07.837 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:07 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:07.683+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:07.837 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:07 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:07.683+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:07.837 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:07 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:07.683+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:07.838 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:07 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:07.683+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:07.838 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:07 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:07.683+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:07.857 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.8.service' 2024-08-20T05:21:07.936 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:21:07.937 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-08-20T05:21:07.937 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-08-20T05:21:07.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.9 2024-08-20T05:21:08.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:08 smithi037 systemd[1]: Stopping Ceph osd.9 for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:21:08.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:08 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:08.053+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:21:08.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:08 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:08.053+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:21:08.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:08 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:08.053+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:21:08.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:08 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:08.053+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:21:08.266 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:08 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:08.053+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:21:08.267 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:08 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:08.053+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:34.958379+0000 front 2024-08-20T05:20:34.958257+0000 (oldest deadline 2024-08-20T05:21:00.858347+0000) 2024-08-20T05:21:08.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:08 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:08.023+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:08.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:08 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:08.023+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:08.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:08 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:08.023+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:08.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:08 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:08.023+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:08.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:08 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:08.023+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:08.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:08 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:08.023+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:08.765 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:08 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:08.415+0000 7fc0a0e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:21:08.765 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:08 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:08.415+0000 7fc0a0e00640 -1 osd.9 92 *** Got signal Terminated *** 2024-08-20T05:21:08.765 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:08 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:08.415+0000 7fc0a0e00640 -1 osd.9 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T05:21:09.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:08 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:08.706+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:09.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:08 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:08.706+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:09.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:08 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:08.706+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:09.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:08 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:08.706+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:09.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:08 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:08.706+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:09.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:09 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:09.043+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:09.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:09 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:09.043+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:09.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:09 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:09.043+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:09.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:09 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:09.043+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:09.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:09 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:09.043+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:09.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:09 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:09.043+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:09.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:09 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:09.027+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:21:09.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:09 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:09.027+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:21:09.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:09 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:09.027+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:21:09.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:09 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:09.027+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:21:09.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:09 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:09.027+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:21:09.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:09 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:09.027+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:34.958379+0000 front 2024-08-20T05:20:34.958257+0000 (oldest deadline 2024-08-20T05:21:00.858347+0000) 2024-08-20T05:21:10.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:09 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:09.693+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:10.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:09 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:09.693+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:10.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:09 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:09.693+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:10.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:09 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:09.693+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:10.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:09 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:09.693+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:10.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:09 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:09.693+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:10.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:09 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:09.994+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:10.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:09 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:09.994+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:10.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:09 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:09.994+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:10.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:09 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:09.994+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:10.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:09 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:09.994+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:10.207 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:09 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:09.994+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:10.207 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:09 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:09.994+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:47.631162+0000 front 2024-08-20T05:20:47.631258+0000 (oldest deadline 2024-08-20T05:21:09.330952+0000) 2024-08-20T05:21:10.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:10 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:10.020+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:21:10.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:10 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:10.021+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:21:10.517 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:10 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:10.021+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:21:10.517 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:10 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:10.021+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:21:10.517 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:10 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:10.021+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:21:10.517 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:10 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:10.021+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:34.958379+0000 front 2024-08-20T05:20:34.958257+0000 (oldest deadline 2024-08-20T05:21:00.858347+0000) 2024-08-20T05:21:11.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:10 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:10.739+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:11.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:10 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:10.739+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:11.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:10 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:10.739+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:11.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:10 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:10.739+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:11.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:10 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:10.739+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:11.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:10 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:10.739+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:11.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:11 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:11.041+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:11.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:11 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:11.041+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:11.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:11 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:11.041+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:11.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:11 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:11.041+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:11.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:11 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:11.041+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:11.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:11 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:11.041+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:11.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:11 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:11.041+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:47.631162+0000 front 2024-08-20T05:20:47.631258+0000 (oldest deadline 2024-08-20T05:21:09.330952+0000) 2024-08-20T05:21:11.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:11 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:11.048+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:21:11.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:11 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:11.048+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:21:11.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:11 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:11.048+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:21:11.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:11 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:11.048+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:21:11.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:11 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:11.048+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:21:11.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:11 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:11.048+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:34.958379+0000 front 2024-08-20T05:20:34.958257+0000 (oldest deadline 2024-08-20T05:21:00.858347+0000) 2024-08-20T05:21:12.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:11 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:11.743+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:12.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:11 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:11.743+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:12.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:11 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:11.743+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:12.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:11 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:11.743+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:12.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:11 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:11.743+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:12.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:11 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:11.743+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:12.458 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:12 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:12.059+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:12.458 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:12 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:12.059+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:12.458 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:12 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:12.059+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:12.458 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:12 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:12.059+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:12.458 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:12 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:12.059+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:12.458 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:12 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:12.059+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:12.458 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:12 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:12.059+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:47.631162+0000 front 2024-08-20T05:20:47.631258+0000 (oldest deadline 2024-08-20T05:21:09.330952+0000) 2024-08-20T05:21:12.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:12 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:12.035+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:21:12.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:12 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:12.035+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:21:12.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:12 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:12.035+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:21:12.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:12 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:12.035+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:21:12.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:12 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:12.035+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:21:12.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:12 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:12.035+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:34.958379+0000 front 2024-08-20T05:20:34.958257+0000 (oldest deadline 2024-08-20T05:21:00.858347+0000) 2024-08-20T05:21:13.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:12 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:12.708+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:13.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:12 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:12.708+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:13.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:12 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:12.708+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:13.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:12 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:12.708+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:13.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:12 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:12.708+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:13.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:12 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:12.708+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:13.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:13 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:13.036+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:13.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:13 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:13.036+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:13.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:13 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:13.036+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:13.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:13 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:13.036+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:13.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:13 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:13.036+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:13.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:13 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:13.036+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:13.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:13 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:13.036+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:47.631162+0000 front 2024-08-20T05:20:47.631258+0000 (oldest deadline 2024-08-20T05:21:09.330952+0000) 2024-08-20T05:21:13.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:13 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:13.039+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:54.650647+0000 front 2024-08-20T05:19:54.650678+0000 (oldest deadline 2024-08-20T05:20:18.651696+0000) 2024-08-20T05:21:13.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:13 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:13.039+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.953395+0000 front 2024-08-20T05:20:03.953078+0000 (oldest deadline 2024-08-20T05:20:28.653144+0000) 2024-08-20T05:21:13.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:13 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:13.039+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.354498+0000 front 2024-08-20T05:20:10.354430+0000 (oldest deadline 2024-08-20T05:20:35.654351+0000) 2024-08-20T05:21:13.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:13 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:13.039+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:17.955413+0000 front 2024-08-20T05:20:17.955385+0000 (oldest deadline 2024-08-20T05:20:48.556197+0000) 2024-08-20T05:21:13.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:13 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:13.039+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:30.257829+0000 front 2024-08-20T05:20:30.258147+0000 (oldest deadline 2024-08-20T05:20:54.957711+0000) 2024-08-20T05:21:13.516 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:13 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9[53817]: 2024-08-20T05:21:13.039+0000 7fc097800640 -1 osd.9 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:34.958379+0000 front 2024-08-20T05:20:34.958257+0000 (oldest deadline 2024-08-20T05:21:00.858347+0000) 2024-08-20T05:21:14.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:13 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:13.661+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:14.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:13 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:13.661+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:14.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:13 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:13.661+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:14.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:13 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:13.661+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:14.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:13 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:13.661+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:14.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:13 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:13.661+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:14.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:14 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:14.030+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:14.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:14 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:14.030+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:14.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:14 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:14.030+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:14.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:14 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:14.030+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:14.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:14 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:14.030+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:14.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:14 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:14.030+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:14.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:14 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:14.030+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:47.631162+0000 front 2024-08-20T05:20:47.631258+0000 (oldest deadline 2024-08-20T05:21:09.330952+0000) 2024-08-20T05:21:14.658 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:14 smithi037 podman[113115]: 2024-08-20 05:21:14.301753531 +0000 UTC m=+6.073964744 container died 513deaa5df740293d133495141d625e63b0c3a8f31798ad1ea9fae8c615e83a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T05:21:14.918 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:14 smithi037 podman[113115]: 2024-08-20 05:21:14.888618265 +0000 UTC m=+6.660829478 container cleanup 513deaa5df740293d133495141d625e63b0c3a8f31798ad1ea9fae8c615e83a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, CEPH_POINT_RELEASE=) 2024-08-20T05:21:14.918 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:14 smithi037 bash[113115]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9 2024-08-20T05:21:15.017 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:14 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:14.679+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:15.017 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:14 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:14.679+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:15.017 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:14 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:14.679+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:15.017 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:14 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:14.679+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:15.017 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:14 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:14.679+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:15.017 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:14 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:14.679+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:15.265 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:15 smithi037 podman[113133]: 2024-08-20 05:21:15.090160546 +0000 UTC m=+0.782707588 container remove 513deaa5df740293d133495141d625e63b0c3a8f31798ad1ea9fae8c615e83a9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-20T05:21:15.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:15 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:15.062+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:15.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:15 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:15.062+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:15.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:15 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:15.062+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:15.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:15 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:15.062+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:15.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:15 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:15.062+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:15.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:15 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:15.062+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:15.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:15 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:15.062+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:47.631162+0000 front 2024-08-20T05:20:47.631258+0000 (oldest deadline 2024-08-20T05:21:09.330952+0000) 2024-08-20T05:21:15.928 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:15 smithi037 podman[113219]: 2024-08-20 05:21:15.564968638 +0000 UTC m=+0.027406639 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T05:21:15.929 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:15 smithi037 podman[113219]: 2024-08-20 05:21:15.666222525 +0000 UTC m=+0.128660525 container create 7476d759b03889ba9f04366225f9350ca4fd07c856093b08f2660dd9ae863320 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2) 2024-08-20T05:21:16.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:15 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:15.701+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:16.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:15 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:15.701+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:16.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:15 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:15.701+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:16.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:15 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:15.701+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:16.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:15 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:15.701+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:16.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:15 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:15.701+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:16.206 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:15 smithi037 podman[113219]: 2024-08-20 05:21:15.927274735 +0000 UTC m=+0.389712736 container init 7476d759b03889ba9f04366225f9350ca4fd07c856093b08f2660dd9ae863320 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-08-20T05:21:16.206 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:15 smithi037 podman[113219]: 2024-08-20 05:21:15.935246601 +0000 UTC m=+0.397684602 container start 7476d759b03889ba9f04366225f9350ca4fd07c856093b08f2660dd9ae863320 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.build-date=20240731) 2024-08-20T05:21:16.206 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:16 smithi037 podman[113219]: 2024-08-20 05:21:16.018466667 +0000 UTC m=+0.480904667 container attach 7476d759b03889ba9f04366225f9350ca4fd07c856093b08f2660dd9ae863320 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9-deactivate, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-08-20T05:21:16.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:16 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:16.023+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:16.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:16 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:16.023+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:16.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:16 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:16.023+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:16.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:16 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:16.023+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:16.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:16 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:16.023+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:16.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:16 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:16.023+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:16.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:16 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:16.023+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:47.631162+0000 front 2024-08-20T05:20:47.631258+0000 (oldest deadline 2024-08-20T05:21:09.330952+0000) 2024-08-20T05:21:16.515 INFO:journalctl@ceph.osd.9.smithi037.stdout:Aug 20 05:21:16 smithi037 podman[113242]: 2024-08-20 05:21:16.246483128 +0000 UTC m=+0.027428391 container died 7476d759b03889ba9f04366225f9350ca4fd07c856093b08f2660dd9ae863320 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2) 2024-08-20T05:21:16.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.9.service' 2024-08-20T05:21:17.048 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:21:17.048 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-08-20T05:21:17.048 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-08-20T05:21:17.048 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.10 2024-08-20T05:21:17.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:16 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:16.712+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:17.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:16 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:16.712+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:17.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:16 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:16.712+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:17.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:16 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:16.712+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:17.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:16 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:16.712+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:17.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:16 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:16.712+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:17.382 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:16 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:16.994+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:17.382 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:16 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:16.994+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:17.382 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:16 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:16.994+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:17.382 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:16 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:16.994+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:17.382 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:16 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:16.994+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:17.383 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:16 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:16.994+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:17.383 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:16 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:16.994+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:47.631162+0000 front 2024-08-20T05:20:47.631258+0000 (oldest deadline 2024-08-20T05:21:09.330952+0000) 2024-08-20T05:21:17.383 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:17 smithi130 systemd[1]: Stopping Ceph osd.10 for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:21:17.383 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:17 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:17.380+0000 7f1c00e64640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:21:17.383 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:17 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:17.380+0000 7f1c00e64640 -1 osd.10 92 *** Got signal Terminated *** 2024-08-20T05:21:17.383 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:17 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:17.380+0000 7f1c00e64640 -1 osd.10 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T05:21:18.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:17 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:17.717+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:18.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:17 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:17.717+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:18.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:17 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:17.717+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:18.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:17 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:17.717+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:18.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:17 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:17.717+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:18.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:17 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:17.717+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:18.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:17 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:17.955+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:18.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:17 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:17.955+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:18.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:17 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:17.955+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:18.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:17 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:17.955+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:18.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:17 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:17.955+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:18.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:17 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:17.955+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:18.456 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:17 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:17.955+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:47.631162+0000 front 2024-08-20T05:20:47.631258+0000 (oldest deadline 2024-08-20T05:21:09.330952+0000) 2024-08-20T05:21:18.865 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:18 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:18.720+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:18.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:18 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:18.720+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:18.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:18 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:18.720+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:18.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:18 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:18.720+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:18.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:18 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:18.720+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:18.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:18 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:18.720+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:19.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:18 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:18.914+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:19.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:18 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:18.914+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:19.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:18 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:18.914+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:19.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:18 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:18.914+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:19.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:18 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:18.914+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:19.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:18 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:18.914+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:19.207 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:18 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:18.914+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:47.631162+0000 front 2024-08-20T05:20:47.631258+0000 (oldest deadline 2024-08-20T05:21:09.330952+0000) 2024-08-20T05:21:20.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:19 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:19.693+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:20.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:19 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:19.693+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:20.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:19 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:19.693+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:20.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:19 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:19.693+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:20.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:19 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:19.693+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:20.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:19 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:19.693+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:20.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:19 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:19.867+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:20.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:19 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:19.867+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:20.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:19 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:19.867+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:20.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:19 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:19.867+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:20.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:19 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:19.867+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:20.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:19 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:19.867+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:20.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:19 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:19.867+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:47.631162+0000 front 2024-08-20T05:20:47.631258+0000 (oldest deadline 2024-08-20T05:21:09.330952+0000) 2024-08-20T05:21:21.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:20 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:20.730+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:21.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:20 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:20.730+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:21.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:20 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:20.730+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:21.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:20 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:20.730+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:21.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:20 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:20.730+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:21.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:20 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:20.730+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:21.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:20 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:20.730+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-20T05:20:55.243332+0000 front 2024-08-20T05:20:55.243423+0000 (oldest deadline 2024-08-20T05:21:19.943374+0000) 2024-08-20T05:21:21.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:20 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:20.878+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:21.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:20 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:20.878+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:21.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:20 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:20.878+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:21.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:20 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:20.878+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:21.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:20 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:20.878+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:21.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:20 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:20.878+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:21.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:20 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:20.878+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:47.631162+0000 front 2024-08-20T05:20:47.631258+0000 (oldest deadline 2024-08-20T05:21:09.330952+0000) 2024-08-20T05:21:22.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:21 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:21.750+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:22.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:21 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:21.750+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:22.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:21 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:21.750+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:22.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:21 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:21.750+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:22.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:21 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:21.750+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:22.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:21 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:21.750+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:22.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:21 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:21.750+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-20T05:20:55.243332+0000 front 2024-08-20T05:20:55.243423+0000 (oldest deadline 2024-08-20T05:21:19.943374+0000) 2024-08-20T05:21:22.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:21 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:21.838+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:55.322559+0000 front 2024-08-20T05:19:55.322741+0000 (oldest deadline 2024-08-20T05:20:23.523069+0000) 2024-08-20T05:21:22.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:21 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:21.838+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:03.523474+0000 front 2024-08-20T05:20:03.523447+0000 (oldest deadline 2024-08-20T05:20:27.623611+0000) 2024-08-20T05:21:22.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:21 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:21.838+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:10.425404+0000 front 2024-08-20T05:20:10.425389+0000 (oldest deadline 2024-08-20T05:20:35.125381+0000) 2024-08-20T05:21:22.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:21 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:21.838+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6814 osd.3 since back 2024-08-20T05:20:22.027766+0000 front 2024-08-20T05:20:22.027737+0000 (oldest deadline 2024-08-20T05:20:47.228000+0000) 2024-08-20T05:21:22.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:21 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:21.838+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.829151+0000 front 2024-08-20T05:20:31.829171+0000 (oldest deadline 2024-08-20T05:20:57.129286+0000) 2024-08-20T05:21:22.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:21 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:21.838+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:37.129779+0000 front 2024-08-20T05:20:37.129864+0000 (oldest deadline 2024-08-20T05:21:02.429672+0000) 2024-08-20T05:21:22.206 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:21 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10[46584]: 2024-08-20T05:21:21.838+0000 7f1bfd479640 -1 osd.10 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:47.631162+0000 front 2024-08-20T05:20:47.631258+0000 (oldest deadline 2024-08-20T05:21:09.330952+0000) 2024-08-20T05:21:23.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:22 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:22.761+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:23.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:22 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:22.761+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:23.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:22 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:22.761+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:23.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:22 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:22.761+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:23.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:22 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:22.761+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:23.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:22 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:22.761+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:23.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:22 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:22.761+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-20T05:20:55.243332+0000 front 2024-08-20T05:20:55.243423+0000 (oldest deadline 2024-08-20T05:21:19.943374+0000) 2024-08-20T05:21:23.205 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:22 smithi130 podman[58322]: 2024-08-20 05:21:22.950635551 +0000 UTC m=+5.706985706 container died 54bcfe4d330e6da080af3ca50029ddd321b6ce5bcd70ddac582210ab225b763d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-08-20T05:21:23.705 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:23 smithi130 podman[58322]: 2024-08-20 05:21:23.285671463 +0000 UTC m=+6.042021610 container cleanup 54bcfe4d330e6da080af3ca50029ddd321b6ce5bcd70ddac582210ab225b763d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0) 2024-08-20T05:21:23.706 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:23 smithi130 bash[58322]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10 2024-08-20T05:21:23.706 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:23 smithi130 podman[58337]: 2024-08-20 05:21:23.470483558 +0000 UTC m=+0.516953543 container remove 54bcfe4d330e6da080af3ca50029ddd321b6ce5bcd70ddac582210ab225b763d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-20T05:21:24.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:23 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:23.789+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:24.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:23 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:23.789+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:24.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:23 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:23.789+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:24.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:23 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:23.789+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:24.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:23 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:23.789+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:24.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:23 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:23.789+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:24.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:23 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:23.789+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-20T05:20:55.243332+0000 front 2024-08-20T05:20:55.243423+0000 (oldest deadline 2024-08-20T05:21:19.943374+0000) 2024-08-20T05:21:24.191 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:23 smithi130 podman[58426]: 2024-08-20 05:21:23.788039657 +0000 UTC m=+0.015974894 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T05:21:24.191 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:23 smithi130 podman[58426]: 2024-08-20 05:21:23.888222176 +0000 UTC m=+0.116157404 container create 5d4df7276be93d6bdcefc5d200d6b355df4225ac878d0f7d01128cfaa99721d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10-deactivate, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T05:21:24.191 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:24 smithi130 podman[58426]: 2024-08-20 05:21:24.115656604 +0000 UTC m=+0.343591831 container init 5d4df7276be93d6bdcefc5d200d6b355df4225ac878d0f7d01128cfaa99721d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux ) 2024-08-20T05:21:24.191 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:24 smithi130 podman[58426]: 2024-08-20 05:21:24.118893078 +0000 UTC m=+0.346828306 container start 5d4df7276be93d6bdcefc5d200d6b355df4225ac878d0f7d01128cfaa99721d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10-deactivate, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-20T05:21:24.192 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:24 smithi130 podman[58426]: 2024-08-20 05:21:24.190473604 +0000 UTC m=+0.418408832 container attach 5d4df7276be93d6bdcefc5d200d6b355df4225ac878d0f7d01128cfaa99721d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-20T05:21:24.455 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:24 smithi130 podman[58426]: 2024-08-20 05:21:24.306250781 +0000 UTC m=+0.534186011 container died 5d4df7276be93d6bdcefc5d200d6b355df4225ac878d0f7d01128cfaa99721d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-20T05:21:24.843 INFO:journalctl@ceph.osd.10.smithi130.stdout:Aug 20 05:21:24 smithi130 podman[58449]: 2024-08-20 05:21:24.827135248 +0000 UTC m=+0.515273392 container remove 5d4df7276be93d6bdcefc5d200d6b355df4225ac878d0f7d01128cfaa99721d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-08-20T05:21:24.849 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.10.service' 2024-08-20T05:21:24.889 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:21:24.889 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-08-20T05:21:24.890 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-08-20T05:21:24.890 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.11 2024-08-20T05:21:25.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:24 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:24.774+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:25.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:24 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:24.774+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:25.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:24 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:24.774+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:25.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:24 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:24.774+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:25.117 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:24 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:24.774+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:25.117 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:24 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:24.774+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:25.117 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:24 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:24.774+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-20T05:20:55.243332+0000 front 2024-08-20T05:20:55.243423+0000 (oldest deadline 2024-08-20T05:21:19.943374+0000) 2024-08-20T05:21:25.117 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:24 smithi135 systemd[1]: Stopping Ceph osd.11 for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:21:25.615 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:25 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:25.188+0000 7f7342fbe640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:21:25.615 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:25 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:25.188+0000 7f7342fbe640 -1 osd.11 92 *** Got signal Terminated *** 2024-08-20T05:21:25.616 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:25 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:25.188+0000 7f7342fbe640 -1 osd.11 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-20T05:21:26.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:25 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:25.771+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:26.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:25 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:25.771+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:26.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:25 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:25.771+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:26.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:25 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:25.771+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:26.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:25 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:25.771+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:26.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:25 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:25.771+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:26.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:25 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:25.771+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-20T05:20:55.243332+0000 front 2024-08-20T05:20:55.243423+0000 (oldest deadline 2024-08-20T05:21:19.943374+0000) 2024-08-20T05:21:27.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:26 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:26.783+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:27.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:26 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:26.783+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:27.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:26 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:26.783+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:27.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:26 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:26.783+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:27.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:26 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:26.783+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:27.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:26 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:26.783+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:27.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:26 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:26.783+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-20T05:20:55.243332+0000 front 2024-08-20T05:20:55.243423+0000 (oldest deadline 2024-08-20T05:21:19.943374+0000) 2024-08-20T05:21:28.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:27 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:27.770+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:28.115 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:27 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:27.770+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:28.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:27 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:27.770+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:28.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:27 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:27.770+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:28.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:27 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:27.770+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:28.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:27 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:27.770+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:28.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:27 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:27.770+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-20T05:20:55.243332+0000 front 2024-08-20T05:20:55.243423+0000 (oldest deadline 2024-08-20T05:21:19.943374+0000) 2024-08-20T05:21:29.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:28.731+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:29.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:28.731+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:29.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:28.731+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:29.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:28.731+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:29.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:28.731+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:29.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:28.731+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:29.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:28 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:28.731+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-20T05:20:55.243332+0000 front 2024-08-20T05:20:55.243423+0000 (oldest deadline 2024-08-20T05:21:19.943374+0000) 2024-08-20T05:21:30.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:29 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:29.709+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-08-20T05:19:52.733977+0000 front 2024-08-20T05:19:52.733994+0000 (oldest deadline 2024-08-20T05:20:18.634013+0000) 2024-08-20T05:21:30.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:29 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:29.709+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6804 osd.1 since back 2024-08-20T05:20:02.135293+0000 front 2024-08-20T05:20:02.135260+0000 (oldest deadline 2024-08-20T05:20:32.735921+0000) 2024-08-20T05:21:30.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:29 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:29.709+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6804 osd.2 since back 2024-08-20T05:20:12.736341+0000 front 2024-08-20T05:20:12.736366+0000 (oldest deadline 2024-08-20T05:20:35.036600+0000) 2024-08-20T05:21:30.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:29 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:29.709+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6812 osd.4 since back 2024-08-20T05:20:31.339771+0000 front 2024-08-20T05:20:31.339795+0000 (oldest deadline 2024-08-20T05:20:54.239778+0000) 2024-08-20T05:21:30.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:29 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:29.709+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6812 osd.5 since back 2024-08-20T05:20:35.940748+0000 front 2024-08-20T05:20:35.940727+0000 (oldest deadline 2024-08-20T05:21:01.240945+0000) 2024-08-20T05:21:30.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:29 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:29.709+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.37:6822 osd.6 since back 2024-08-20T05:20:45.242537+0000 front 2024-08-20T05:20:45.242558+0000 (oldest deadline 2024-08-20T05:21:09.342542+0000) 2024-08-20T05:21:30.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:29 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:29.709+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.130:6820 osd.7 since back 2024-08-20T05:20:55.243332+0000 front 2024-08-20T05:20:55.243423+0000 (oldest deadline 2024-08-20T05:21:19.943374+0000) 2024-08-20T05:21:30.116 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:29 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11[47196]: 2024-08-20T05:21:29.709+0000 7f733f5d3640 -1 osd.11 92 heartbeat_check: no reply from 172.21.15.135:6820 osd.8 since back 2024-08-20T05:21:03.444435+0000 front 2024-08-20T05:21:03.444490+0000 (oldest deadline 2024-08-20T05:21:29.344539+0000) 2024-08-20T05:21:30.924 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:30 smithi135 podman[58861]: 2024-08-20 05:21:30.668422699 +0000 UTC m=+5.581438288 container died 2e21c453d48c49ab875160ee80260e47a3ec849835f8edb4d29df808b607a350 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True) 2024-08-20T05:21:31.207 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:30 smithi135 podman[58861]: 2024-08-20 05:21:30.997007203 +0000 UTC m=+5.910022777 container cleanup 2e21c453d48c49ab875160ee80260e47a3ec849835f8edb4d29df808b607a350 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T05:21:31.207 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:30 smithi135 bash[58861]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11 2024-08-20T05:21:31.605 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:31 smithi135 podman[58876]: 2024-08-20 05:21:31.206501281 +0000 UTC m=+0.531890078 container remove 2e21c453d48c49ab875160ee80260e47a3ec849835f8edb4d29df808b607a350 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-08-20T05:21:31.865 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:31 smithi135 podman[58967]: 2024-08-20 05:21:31.506824394 +0000 UTC m=+0.015822317 image pull 9f5c88d94bb632e604503b516326cdfcf31eea177420de126ce2ba09454a7f4a quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8 2024-08-20T05:21:31.865 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:31 smithi135 podman[58967]: 2024-08-20 05:21:31.607170515 +0000 UTC m=+0.116168426 container create deac5617aca94295ed3202c8e1f11ce1768e49bf9ec74d2f79515c65e4adae3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731) 2024-08-20T05:21:31.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:31 smithi135 podman[58967]: 2024-08-20 05:21:31.809809898 +0000 UTC m=+0.318807808 container init deac5617aca94295ed3202c8e1f11ce1768e49bf9ec74d2f79515c65e4adae3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-08-20T05:21:31.866 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:31 smithi135 podman[58967]: 2024-08-20 05:21:31.813211541 +0000 UTC m=+0.322209462 container start deac5617aca94295ed3202c8e1f11ce1768e49bf9ec74d2f79515c65e4adae3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T05:21:32.305 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:31 smithi135 podman[58967]: 2024-08-20 05:21:31.902098595 +0000 UTC m=+0.411096519 container attach deac5617aca94295ed3202c8e1f11ce1768e49bf9ec74d2f79515c65e4adae3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T05:21:32.305 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:31 smithi135 podman[58967]: 2024-08-20 05:21:31.996818586 +0000 UTC m=+0.505816500 container died deac5617aca94295ed3202c8e1f11ce1768e49bf9ec74d2f79515c65e4adae3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-20T05:21:32.572 INFO:journalctl@ceph.osd.11.smithi135.stdout:Aug 20 05:21:32 smithi135 podman[58990]: 2024-08-20 05:21:32.546660235 +0000 UTC m=+0.542919743 container remove deac5617aca94295ed3202c8e1f11ce1768e49bf9ec74d2f79515c65e4adae3c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T05:21:32.578 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@osd.11.service' 2024-08-20T05:21:32.616 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:21:32.616 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-08-20T05:21:32.616 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-08-20T05:21:32.616 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.a 2024-08-20T05:21:33.015 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 05:21:32 smithi037 systemd[1]: Stopping Ceph mds.a for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:21:33.515 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 05:21:33 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-a[60991]: 2024-08-20T05:21:33.037+0000 7f5dd1c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:21:33.515 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 05:21:33 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-a[60991]: 2024-08-20T05:21:33.037+0000 7f5dd1c00640 -1 mds.a *** got signal Terminated *** 2024-08-20T05:21:36.516 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 05:21:36 smithi037 podman[113333]: 2024-08-20 05:21:36.218787735 +0000 UTC m=+3.296345457 container died 078ff38624ccb70cf3dfad834e098d6ab05e71c3d2217cbf71d5e553e6c34dba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-a, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-08-20T05:21:36.979 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 05:21:36 smithi037 podman[113333]: 2024-08-20 05:21:36.751058014 +0000 UTC m=+3.828615727 container cleanup 078ff38624ccb70cf3dfad834e098d6ab05e71c3d2217cbf71d5e553e6c34dba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-20T05:21:36.979 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 05:21:36 smithi037 bash[113333]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-a 2024-08-20T05:21:37.264 INFO:journalctl@ceph.mds.a.smithi037.stdout:Aug 20 05:21:36 smithi037 podman[113345]: 2024-08-20 05:21:36.977920203 +0000 UTC m=+0.743497478 container remove 078ff38624ccb70cf3dfad834e098d6ab05e71c3d2217cbf71d5e553e6c34dba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-a, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-08-20T05:21:37.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.a.service' 2024-08-20T05:21:37.359 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:21:37.359 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-08-20T05:21:37.359 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-08-20T05:21:37.360 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.d 2024-08-20T05:21:37.743 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 20 05:21:37 smithi037 systemd[1]: Stopping Ceph mds.d for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:21:38.015 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 20 05:21:37 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-d[59818]: 2024-08-20T05:21:37.741+0000 7f2aa9000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:21:38.016 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 20 05:21:37 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-d[59818]: 2024-08-20T05:21:37.741+0000 7f2aa9000640 -1 mds.d *** got signal Terminated *** 2024-08-20T05:21:40.354 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 20 05:21:40 smithi037 podman[113454]: 2024-08-20 05:21:40.077954294 +0000 UTC m=+2.429045632 container died 79c4bb61dcc34777a6e8f7731f42617d63641370aa84b8e3657b5df9b15afa1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-d, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-20T05:21:40.765 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 20 05:21:40 smithi037 podman[113454]: 2024-08-20 05:21:40.571968074 +0000 UTC m=+2.923059401 container cleanup 79c4bb61dcc34777a6e8f7731f42617d63641370aa84b8e3657b5df9b15afa1b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-d, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-08-20T05:21:40.766 INFO:journalctl@ceph.mds.d.smithi037.stdout:Aug 20 05:21:40 smithi037 bash[113454]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-d 2024-08-20T05:21:41.073 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.d.service' 2024-08-20T05:21:41.143 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:21:41.143 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-08-20T05:21:41.143 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-08-20T05:21:41.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.g 2024-08-20T05:21:41.515 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 05:21:41 smithi037 systemd[1]: Stopping Ceph mds.g for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:21:42.015 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 05:21:41 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-g[60579]: 2024-08-20T05:21:41.546+0000 7fd4b6000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:21:42.015 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 05:21:41 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-g[60579]: 2024-08-20T05:21:41.546+0000 7fd4b6000640 -1 mds.g *** got signal Terminated *** 2024-08-20T05:21:44.515 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 05:21:44 smithi037 podman[113574]: 2024-08-20 05:21:44.210958169 +0000 UTC m=+2.789355654 container stop 43fba314613eceeee2162f4f666bdd4812d1672e69e1f5dcfa86189b256252a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731) 2024-08-20T05:21:44.516 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 05:21:44 smithi037 podman[113574]: 2024-08-20 05:21:44.236910026 +0000 UTC m=+2.815307511 container died 43fba314613eceeee2162f4f666bdd4812d1672e69e1f5dcfa86189b256252a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-g, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T05:21:44.979 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 05:21:44 smithi037 podman[113574]: 2024-08-20 05:21:44.71843094 +0000 UTC m=+3.296828412 container cleanup 43fba314613eceeee2162f4f666bdd4812d1672e69e1f5dcfa86189b256252a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T05:21:44.980 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 05:21:44 smithi037 bash[113574]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-g 2024-08-20T05:21:45.259 INFO:journalctl@ceph.mds.g.smithi037.stdout:Aug 20 05:21:44 smithi037 podman[113586]: 2024-08-20 05:21:44.978155733 +0000 UTC m=+0.749281074 container remove 43fba314613eceeee2162f4f666bdd4812d1672e69e1f5dcfa86189b256252a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-08-20T05:21:45.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.g.service' 2024-08-20T05:21:45.354 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:21:45.354 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-08-20T05:21:45.354 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-08-20T05:21:45.354 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.j 2024-08-20T05:21:45.765 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 20 05:21:45 smithi037 systemd[1]: Stopping Ceph mds.j for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:21:46.265 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 20 05:21:45 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-j[59406]: 2024-08-20T05:21:45.783+0000 7f3f06e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:21:46.265 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 20 05:21:45 smithi037 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-j[59406]: 2024-08-20T05:21:45.783+0000 7f3f06e00640 -1 mds.j *** got signal Terminated *** 2024-08-20T05:21:48.265 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 20 05:21:47 smithi037 podman[113693]: 2024-08-20 05:21:47.997569001 +0000 UTC m=+2.362799220 container died ee4ea35400eca8d3508823bce19f90f026e3e44e67e0a680f0b599caf4034479 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-j, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-20T05:21:48.601 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 20 05:21:48 smithi037 podman[113693]: 2024-08-20 05:21:48.580554099 +0000 UTC m=+2.945784316 container cleanup ee4ea35400eca8d3508823bce19f90f026e3e44e67e0a680f0b599caf4034479 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-20T05:21:48.601 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 20 05:21:48 smithi037 bash[113693]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-j 2024-08-20T05:21:49.051 INFO:journalctl@ceph.mds.j.smithi037.stdout:Aug 20 05:21:48 smithi037 podman[113716]: 2024-08-20 05:21:48.790472249 +0000 UTC m=+0.787115879 container remove ee4ea35400eca8d3508823bce19f90f026e3e44e67e0a680f0b599caf4034479 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-j, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-20T05:21:49.066 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.j.service' 2024-08-20T05:21:49.138 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:21:49.138 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-08-20T05:21:49.138 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-08-20T05:21:49.138 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.b 2024-08-20T05:21:49.428 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 05:21:49 smithi130 systemd[1]: Stopping Ceph mds.b for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:21:49.681 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 05:21:49 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b[51794]: 2024-08-20T05:21:49.426+0000 7f732f06e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:21:49.681 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 05:21:49 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b[51794]: 2024-08-20T05:21:49.426+0000 7f732f06e640 -1 mds.b *** got signal Terminated *** 2024-08-20T05:21:52.455 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 05:21:52 smithi130 podman[58528]: 2024-08-20 05:21:52.184440788 +0000 UTC m=+2.853239699 container died 27e70f1225f770de63a157df3c9b38147981388e31f94b430198d4c6a7f3bfd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True) 2024-08-20T05:21:52.837 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 05:21:52 smithi130 podman[58528]: 2024-08-20 05:21:52.560609724 +0000 UTC m=+3.229408636 container cleanup 27e70f1225f770de63a157df3c9b38147981388e31f94b430198d4c6a7f3bfd5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-20T05:21:52.838 INFO:journalctl@ceph.mds.b.smithi130.stdout:Aug 20 05:21:52 smithi130 bash[58528]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-b 2024-08-20T05:21:52.964 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.b.service' 2024-08-20T05:21:53.001 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:21:53.001 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-08-20T05:21:53.001 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-08-20T05:21:53.002 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.e 2024-08-20T05:21:53.205 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 05:21:53 smithi130 systemd[1]: Stopping Ceph mds.e for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:21:53.705 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 05:21:53 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-e[51181]: 2024-08-20T05:21:53.305+0000 7f6c8b1e1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:21:53.705 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 05:21:53 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-e[51181]: 2024-08-20T05:21:53.305+0000 7f6c8b1e1640 -1 mds.e *** got signal Terminated *** 2024-08-20T05:21:56.441 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 05:21:56 smithi130 podman[58659]: 2024-08-20 05:21:56.170456526 +0000 UTC m=+2.951196838 container died 010ddc9a7d93b99433f18d85960c866710e99518272663b56591163abc9a2f9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True) 2024-08-20T05:21:56.691 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 05:21:56 smithi130 podman[58659]: 2024-08-20 05:21:56.514402593 +0000 UTC m=+3.295142909 container cleanup 010ddc9a7d93b99433f18d85960c866710e99518272663b56591163abc9a2f9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-e, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-20T05:21:56.691 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 05:21:56 smithi130 bash[58659]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-e 2024-08-20T05:21:56.949 INFO:journalctl@ceph.mds.e.smithi130.stdout:Aug 20 05:21:56 smithi130 podman[58671]: 2024-08-20 05:21:56.6904437 +0000 UTC m=+0.510281147 container remove 010ddc9a7d93b99433f18d85960c866710e99518272663b56591163abc9a2f9e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T05:21:56.950 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.e.service' 2024-08-20T05:21:56.999 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:21:56.999 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-08-20T05:21:56.999 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-08-20T05:21:56.999 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.h 2024-08-20T05:21:57.205 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 05:21:57 smithi130 systemd[1]: Stopping Ceph mds.h for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:21:57.705 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 05:21:57 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-h[51486]: 2024-08-20T05:21:57.317+0000 7fde6e620640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:21:57.705 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 05:21:57 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-h[51486]: 2024-08-20T05:21:57.317+0000 7fde6e620640 -1 mds.h *** got signal Terminated *** 2024-08-20T05:22:00.436 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 05:22:00 smithi130 podman[58781]: 2024-08-20 05:22:00.176297102 +0000 UTC m=+2.954631166 container died 0e6a1f28ebce34cb13f3aff44407e341dc373d95bfd86344359144d7b7dc20ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-08-20T05:22:00.703 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 05:22:00 smithi130 podman[58781]: 2024-08-20 05:22:00.501559231 +0000 UTC m=+3.279893287 container cleanup 0e6a1f28ebce34cb13f3aff44407e341dc373d95bfd86344359144d7b7dc20ed (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-h, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T05:22:00.703 INFO:journalctl@ceph.mds.h.smithi130.stdout:Aug 20 05:22:00 smithi130 bash[58781]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-h 2024-08-20T05:22:00.916 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.h.service' 2024-08-20T05:22:00.948 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:22:00.949 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-08-20T05:22:00.949 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-08-20T05:22:00.949 DEBUG:teuthology.orchestra.run.smithi130:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.k 2024-08-20T05:22:01.455 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 20 05:22:01 smithi130 systemd[1]: Stopping Ceph mds.k for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:22:01.455 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 20 05:22:01 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-k[50868]: 2024-08-20T05:22:01.254+0000 7fd2a1cd0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:22:01.456 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 20 05:22:01 smithi130 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-k[50868]: 2024-08-20T05:22:01.254+0000 7fd2a1cd0640 -1 mds.k *** got signal Terminated *** 2024-08-20T05:22:04.455 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 20 05:22:04 smithi130 podman[58903]: 2024-08-20 05:22:04.194729593 +0000 UTC m=+3.029071113 container died 410859f184b578765d795984af85d144aaefd0600550cf86698f4ae3ba14dd43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-k, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T05:22:04.889 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 20 05:22:04 smithi130 podman[58903]: 2024-08-20 05:22:04.530347178 +0000 UTC m=+3.364688689 container cleanup 410859f184b578765d795984af85d144aaefd0600550cf86698f4ae3ba14dd43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-k, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-08-20T05:22:04.889 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 20 05:22:04 smithi130 bash[58903]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-k 2024-08-20T05:22:04.890 INFO:journalctl@ceph.mds.k.smithi130.stdout:Aug 20 05:22:04 smithi130 podman[58917]: 2024-08-20 05:22:04.681222848 +0000 UTC m=+0.476952518 container remove 410859f184b578765d795984af85d144aaefd0600550cf86698f4ae3ba14dd43 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-k, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-20T05:22:04.904 DEBUG:teuthology.orchestra.run.smithi130:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.k.service' 2024-08-20T05:22:04.936 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:22:04.937 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-08-20T05:22:04.937 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-08-20T05:22:04.937 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.c 2024-08-20T05:22:05.298 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 05:22:04 smithi135 systemd[1]: Stopping Ceph mds.c for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:22:05.615 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 05:22:05 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-c[52266]: 2024-08-20T05:22:05.304+0000 7f6379bbb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:22:05.615 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 05:22:05 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-c[52266]: 2024-08-20T05:22:05.304+0000 7f6379bbb640 -1 mds.c *** got signal Terminated *** 2024-08-20T05:22:08.498 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 05:22:08 smithi135 podman[59068]: 2024-08-20 05:22:08.230543908 +0000 UTC m=+3.101007374 container died 7d337573f9e8401230655003aa088192363f333825229869d5a5bda8c6ef75f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-c, ceph=True, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-08-20T05:22:08.865 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 05:22:08 smithi135 podman[59068]: 2024-08-20 05:22:08.604626621 +0000 UTC m=+3.475090088 container cleanup 7d337573f9e8401230655003aa088192363f333825229869d5a5bda8c6ef75f4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-c, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-20T05:22:08.865 INFO:journalctl@ceph.mds.c.smithi135.stdout:Aug 20 05:22:08 smithi135 bash[59068]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-c 2024-08-20T05:22:09.037 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.c.service' 2024-08-20T05:22:09.074 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:22:09.074 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-08-20T05:22:09.074 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-08-20T05:22:09.074 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.f 2024-08-20T05:22:09.393 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 05:22:09 smithi135 systemd[1]: Stopping Ceph mds.f for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:22:09.865 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 05:22:09 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-f[51953]: 2024-08-20T05:22:09.391+0000 7f0acfd7a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:22:09.865 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 05:22:09 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-f[51953]: 2024-08-20T05:22:09.391+0000 7f0acfd7a640 -1 mds.f *** got signal Terminated *** 2024-08-20T05:22:12.533 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 05:22:12 smithi135 podman[59202]: 2024-08-20 05:22:12.225847236 +0000 UTC m=+2.930980230 container died 43e6161555a8b8359f19666d65757fcd89773733093cedd8f25060f1ad143a0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-f, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, maintainer=Guillaume Abrioux ) 2024-08-20T05:22:12.533 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 05:22:12 smithi135 podman[59202]: 2024-08-20 05:22:12.532276085 +0000 UTC m=+3.237409082 container cleanup 43e6161555a8b8359f19666d65757fcd89773733093cedd8f25060f1ad143a0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754) 2024-08-20T05:22:12.865 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 05:22:12 smithi135 bash[59202]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-f 2024-08-20T05:22:12.865 INFO:journalctl@ceph.mds.f.smithi135.stdout:Aug 20 05:22:12 smithi135 podman[59214]: 2024-08-20 05:22:12.718724261 +0000 UTC m=+0.490040264 container remove 43e6161555a8b8359f19666d65757fcd89773733093cedd8f25060f1ad143a0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-20T05:22:12.936 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.f.service' 2024-08-20T05:22:12.969 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:22:12.969 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-08-20T05:22:12.969 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-08-20T05:22:12.969 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.i 2024-08-20T05:22:13.297 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 05:22:13 smithi135 systemd[1]: Stopping Ceph mds.i for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:22:13.615 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 05:22:13 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-i[52567]: 2024-08-20T05:22:13.295+0000 7f3746b13640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:22:13.615 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 05:22:13 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-i[52567]: 2024-08-20T05:22:13.295+0000 7f3746b13640 -1 mds.i *** got signal Terminated *** 2024-08-20T05:22:16.523 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 05:22:16 smithi135 podman[59325]: 2024-08-20 05:22:16.214914505 +0000 UTC m=+3.027712538 container died dbda39241ba238aa002de8290da57d1521b842406fb6fa99903bf2aa8823ec51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-i, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-20T05:22:16.865 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 05:22:16 smithi135 podman[59325]: 2024-08-20 05:22:16.604354596 +0000 UTC m=+3.417152610 container cleanup dbda39241ba238aa002de8290da57d1521b842406fb6fa99903bf2aa8823ec51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-i, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, org.label-schema.license=GPLv2) 2024-08-20T05:22:16.865 INFO:journalctl@ceph.mds.i.smithi135.stdout:Aug 20 05:22:16 smithi135 bash[59325]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-i 2024-08-20T05:22:17.043 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.i.service' 2024-08-20T05:22:17.076 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:22:17.076 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-08-20T05:22:17.076 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-08-20T05:22:17.076 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.l 2024-08-20T05:22:17.542 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 05:22:17 smithi135 systemd[1]: Stopping Ceph mds.l for 93c5cea6-5eaf-11ef-bccf-c7b262605968... 2024-08-20T05:22:17.542 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 05:22:17 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-l[51652]: 2024-08-20T05:22:17.383+0000 7fd0018e8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-20T05:22:17.542 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 05:22:17 smithi135 ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-l[51652]: 2024-08-20T05:22:17.383+0000 7fd0018e8640 -1 mds.l *** got signal Terminated *** 2024-08-20T05:22:20.560 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 05:22:20 smithi135 podman[59448]: 2024-08-20 05:22:20.221264034 +0000 UTC m=+2.927081467 container died 189e6b2e677f9ed589b086251fe0462d05e1e4dc0031656960eaf61da454e1db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-20T05:22:20.865 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 05:22:20 smithi135 podman[59448]: 2024-08-20 05:22:20.65860773 +0000 UTC m=+3.364425156 container cleanup 189e6b2e677f9ed589b086251fe0462d05e1e4dc0031656960eaf61da454e1db (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:9fef3676e228a6a987e17bf85cedfa9ed4ad03e64c3b44ff5ea1f6d196d5afb8, name=ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-l, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-08-19-1357-ef42754, io.buildah.version=1.36.0) 2024-08-20T05:22:20.865 INFO:journalctl@ceph.mds.l.smithi135.stdout:Aug 20 05:22:20 smithi135 bash[59448]: ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968-mds-l 2024-08-20T05:22:21.047 DEBUG:teuthology.orchestra.run.smithi135:> sudo pkill -f 'journalctl -f -n 0 -u ceph-93c5cea6-5eaf-11ef-bccf-c7b262605968@mds.l.service' 2024-08-20T05:22:21.079 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-20T05:22:21.079 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-08-20T05:22:21.079 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-20T05:22:21.364 INFO:teuthology.orchestra.run.smithi037.stdout:Deleting cluster with fsid: 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T05:22:25.380 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-20T05:22:25.586 INFO:teuthology.orchestra.run.smithi130.stdout:Deleting cluster with fsid: 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T05:22:28.094 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 --force --keep-logs 2024-08-20T05:22:28.296 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T05:22:30.848 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T05:22:30.913 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T05:22:30.946 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-20T05:22:30.973 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-20T05:22:30.975 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861482/remote/smithi037/crash 2024-08-20T05:22:30.976 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/crash -- . 2024-08-20T05:22:31.049 INFO:teuthology.orchestra.run.smithi037.stderr:tar: /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-20T05:22:31.049 INFO:teuthology.orchestra.run.smithi037.stderr:tar: Error is not recoverable: exiting now 2024-08-20T05:22:31.053 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861482/remote/smithi130/crash 2024-08-20T05:22:31.053 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/crash -- . 2024-08-20T05:22:31.102 INFO:teuthology.orchestra.run.smithi130.stderr:tar: /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-20T05:22:31.102 INFO:teuthology.orchestra.run.smithi130.stderr:tar: Error is not recoverable: exiting now 2024-08-20T05:22:31.104 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861482/remote/smithi135/crash 2024-08-20T05:22:31.105 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/crash -- . 2024-08-20T05:22:31.145 INFO:teuthology.orchestra.run.smithi135.stderr:tar: /var/lib/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/crash: Cannot open: No such file or directory 2024-08-20T05:22:31.145 INFO:teuthology.orchestra.run.smithi135.stderr:tar: Error is not recoverable: exiting now 2024-08-20T05:22:31.146 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-20T05:22:31.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-20T05:22:31.292 INFO:teuthology.orchestra.run.smithi037.stdout:2024-08-20T05:05:26.853057+0000 mds.b (mds.0) 19 : cluster [WRN] Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/pg_wal) see mds.b log and `damage ls` output for details 2024-08-20T05:22:31.293 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-08-20T05:22:31.294 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[SEC\]' /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-20T05:22:31.376 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]' /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-20T05:22:31.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[WRN\]' /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-20T05:22:31.540 INFO:teuthology.orchestra.run.smithi037.stdout:2024-08-20T05:05:26.853057+0000 mds.b (mds.0) 19 : cluster [WRN] Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/pg_wal) see mds.b log and `damage ls` output for details 2024-08-20T05:22:31.541 INFO:tasks.cephadm:Compressing logs... 2024-08-20T05:22:31.541 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-20T05:22:31.545 DEBUG:teuthology.orchestra.run.smithi130:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-20T05:22:31.548 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-20T05:22:31.579 INFO:teuthology.orchestra.run.smithi135.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-08-20T05:22:31.583 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-20T05:22:31.583 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-20T05:22:31.587 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.2.log 2024-08-20T05:22:31.587 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.5.log 2024-08-20T05:22:31.587 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.f.log 2024-08-20T05:22:31.587 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.c.log 2024-08-20T05:22:31.587 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.8.log 2024-08-20T05:22:31.587 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.log 2024-08-20T05:22:31.588 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.i.log 2024-08-20T05:22:31.588 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.l.log 2024-08-20T05:22:31.588 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-20T05:22:31.588 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mon.c.log 2024-08-20T05:22:31.588 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.11.log 2024-08-20T05:22:31.588 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-20T05:22:31.588 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mgr.z.log 2024-08-20T05:22:31.590 INFO:teuthology.orchestra.run.smithi130.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-08-20T05:22:31.590 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-20T05:22:31.590 INFO:teuthology.orchestra.run.smithi130.stderr:gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-20T05:22:31.590 INFO:teuthology.orchestra.run.smithi130.stderr:gzip/var/log/ceph/cephadm.log: -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.7.log 2024-08-20T05:22:31.590 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.e.log 2024-08-20T05:22:31.590 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.log 2024-08-20T05:22:31.590 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.4.log 2024-08-20T05:22:31.590 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mon.b.log 2024-08-20T05:22:31.593 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.1.log 2024-08-20T05:22:31.593 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.k.log 2024-08-20T05:22:31.593 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-20T05:22:31.593 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.10.log 2024-08-20T05:22:31.593 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.h.log 2024-08-20T05:22:31.593 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mgr.y.log 2024-08-20T05:22:31.594 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.b.log 2024-08-20T05:22:31.594 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-20T05:22:31.600 INFO:teuthology.orchestra.run.smithi037.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-08-20T05:22:31.604 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-20T05:22:31.605 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.audit.log 2024-08-20T05:22:31.606 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.9.log 2024-08-20T05:22:31.606 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mgr.x.log 2024-08-20T05:22:31.607 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.log 2024-08-20T05:22:31.608 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.g.log 2024-08-20T05:22:31.609 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.3.log 2024-08-20T05:22:31.609 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.cephadm.log 2024-08-20T05:22:31.610 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.0.log 2024-08-20T05:22:31.611 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.j.log 2024-08-20T05:22:31.612 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.0.log: 87.1% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-20T05:22:31.612 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mon.a.log 2024-08-20T05:22:31.613 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.a.log 2024-08-20T05:22:31.613 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.6.log 2024-08-20T05:22:31.614 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.d.log 2024-08-20T05:22:31.615 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-volume.log 2024-08-20T05:22:31.616 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-08-20T05:22:31.619 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-volume.log: /var/log/ceph/ceph-client.admin.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-08-20T05:22:31.620 INFO:teuthology.orchestra.run.smithi037.stderr: 94.9% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.j.log.gz 2024-08-20T05:22:31.621 INFO:teuthology.orchestra.run.smithi037.stderr: 94.6% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-20T05:22:31.623 INFO:teuthology.orchestra.run.smithi037.stderr: 94.8% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.d.log.gz 2024-08-20T05:22:31.669 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-volume.log: /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mgr.z.log: 82.5% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-20T05:22:31.694 INFO:teuthology.orchestra.run.smithi130.stderr:/var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.b.log: /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-volume.log: 93.0% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mgr.y.log.gz 2024-08-20T05:22:31.706 INFO:teuthology.orchestra.run.smithi130.stderr: 93.5% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.k.log.gz 2024-08-20T05:22:31.720 INFO:teuthology.orchestra.run.smithi037.stderr: 90.2% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-20T05:22:31.731 INFO:teuthology.orchestra.run.smithi130.stderr: 90.8% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-20T05:22:31.771 INFO:teuthology.orchestra.run.smithi130.stderr: 82.6% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-20T05:22:31.813 INFO:teuthology.orchestra.run.smithi130.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-20T05:22:31.815 INFO:teuthology.orchestra.run.smithi130.stderr: 87.1% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-20T05:22:31.821 INFO:teuthology.orchestra.run.smithi135.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-20T05:22:31.868 INFO:teuthology.orchestra.run.smithi135.stderr: 90.8% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-20T05:22:31.961 INFO:teuthology.orchestra.run.smithi037.stderr: 82.5% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.cephadm.log.gz 2024-08-20T05:22:31.981 INFO:teuthology.orchestra.run.smithi130.stderr: 90.3% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-20T05:22:31.989 INFO:teuthology.orchestra.run.smithi135.stderr: 90.3% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.audit.log.gz 2024-08-20T05:22:32.004 INFO:teuthology.orchestra.run.smithi135.stderr: 93.1% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mgr.z.log.gz 2024-08-20T05:22:32.295 INFO:teuthology.orchestra.run.smithi037.stderr: 93.4% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.g.log.gz 2024-08-20T05:22:32.318 INFO:teuthology.orchestra.run.smithi037.stderr: 90.8% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-volume.log.gz 2024-08-20T05:22:32.332 INFO:teuthology.orchestra.run.smithi130.stderr: 91.4% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mon.b.log.gz 2024-08-20T05:22:32.358 INFO:teuthology.orchestra.run.smithi037.stderr: 90.5% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mgr.x.log.gz 2024-08-20T05:22:32.445 INFO:teuthology.orchestra.run.smithi135.stderr: 87.1% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph.log.gz 2024-08-20T05:22:33.041 INFO:teuthology.orchestra.run.smithi130.stderr: 94.0% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.e.log.gz 2024-08-20T05:22:33.367 INFO:teuthology.orchestra.run.smithi037.stderr: 93.3% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.a.log.gz 2024-08-20T05:22:33.408 INFO:teuthology.orchestra.run.smithi135.stderr: 94.0% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.l.log.gz 2024-08-20T05:22:35.745 INFO:teuthology.orchestra.run.smithi037.stderr: 90.2% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mon.a.log.gz 2024-08-20T05:22:38.827 INFO:teuthology.orchestra.run.smithi130.stderr: 93.7% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.b.log.gz 2024-08-20T05:22:42.744 INFO:teuthology.orchestra.run.smithi135.stderr: 91.4% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mon.c.log.gz 2024-08-20T05:22:42.883 INFO:teuthology.orchestra.run.smithi130.stderr: 95.3% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.h.log.gz 2024-08-20T05:22:57.254 INFO:teuthology.orchestra.run.smithi135.stderr: 94.4% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.i.log.gz 2024-08-20T05:23:01.177 INFO:teuthology.orchestra.run.smithi135.stderr: 95.1% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.c.log.gz 2024-08-20T05:23:03.966 INFO:teuthology.orchestra.run.smithi135.stderr: 95.1% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-mds.f.log.gz 2024-08-20T05:23:26.334 INFO:teuthology.orchestra.run.smithi130.stderr: 90.5% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.10.log.gz 2024-08-20T05:23:48.947 INFO:teuthology.orchestra.run.smithi130.stderr: 90.5% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.1.log.gz 2024-08-20T05:24:24.144 INFO:teuthology.orchestra.run.smithi130.stderr: 90.6% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.7.log.gz 2024-08-20T05:24:41.582 INFO:teuthology.orchestra.run.smithi130.stderr: 90.9% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.4.log.gz 2024-08-20T05:24:41.584 INFO:teuthology.orchestra.run.smithi130.stderr: 2024-08-20T05:24:41.584 INFO:teuthology.orchestra.run.smithi130.stderr:real 2m10.021s 2024-08-20T05:24:41.584 INFO:teuthology.orchestra.run.smithi130.stderr:user 4m20.035s 2024-08-20T05:24:41.584 INFO:teuthology.orchestra.run.smithi130.stderr:sys 0m8.351s 2024-08-20T05:27:25.043 INFO:teuthology.orchestra.run.smithi037.stderr: 90.8% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.6.log.gz 2024-08-20T05:27:31.369 INFO:teuthology.orchestra.run.smithi037.stderr: 90.7% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.0.log.gz 2024-08-20T05:27:44.276 INFO:teuthology.orchestra.run.smithi037.stderr: 90.6% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.3.log.gz 2024-08-20T05:28:57.579 INFO:teuthology.orchestra.run.smithi037.stderr: 90.8% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.9.log.gz 2024-08-20T05:28:57.591 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-08-20T05:28:57.592 INFO:teuthology.orchestra.run.smithi037.stderr:real 6m26.018s 2024-08-20T05:28:57.592 INFO:teuthology.orchestra.run.smithi037.stderr:user 5m50.341s 2024-08-20T05:28:57.592 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m35.365s 2024-08-20T05:32:18.985 INFO:teuthology.orchestra.run.smithi135.stderr: 90.6% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.8.log.gz 2024-08-20T05:33:48.153 INFO:teuthology.orchestra.run.smithi135.stderr: 90.7% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.11.log.gz 2024-08-20T05:35:04.173 INFO:teuthology.orchestra.run.smithi135.stderr: 90.9% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.2.log.gz 2024-08-20T05:35:32.634 INFO:teuthology.orchestra.run.smithi135.stderr: 90.6% -- replaced with /var/log/ceph/93c5cea6-5eaf-11ef-bccf-c7b262605968/ceph-osd.5.log.gz 2024-08-20T05:35:32.636 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-08-20T05:35:32.636 INFO:teuthology.orchestra.run.smithi135.stderr:real 13m1.073s 2024-08-20T05:35:32.636 INFO:teuthology.orchestra.run.smithi135.stderr:user 4m55.441s 2024-08-20T05:35:32.636 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m12.675s 2024-08-20T05:35:32.636 INFO:tasks.cephadm:Archiving logs... 2024-08-20T05:35:32.638 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861482/remote/smithi037/log 2024-08-20T05:35:32.639 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-20T05:36:28.498 DEBUG:teuthology.misc:Transferring archived files from smithi130:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861482/remote/smithi130/log 2024-08-20T05:36:28.499 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-20T05:37:15.558 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861482/remote/smithi135/log 2024-08-20T05:37:15.559 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-20T05:38:08.139 INFO:tasks.cephadm:Removing cluster... 2024-08-20T05:38:08.140 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 --force 2024-08-20T05:38:08.528 INFO:teuthology.orchestra.run.smithi037.stdout:Deleting cluster with fsid: 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T05:38:10.321 DEBUG:teuthology.orchestra.run.smithi130:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 --force 2024-08-20T05:38:10.525 INFO:teuthology.orchestra.run.smithi130.stdout:Deleting cluster with fsid: 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T05:38:11.216 DEBUG:teuthology.orchestra.run.smithi135:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 93c5cea6-5eaf-11ef-bccf-c7b262605968 --force 2024-08-20T05:38:11.863 INFO:teuthology.orchestra.run.smithi135.stdout:Deleting cluster with fsid: 93c5cea6-5eaf-11ef-bccf-c7b262605968 2024-08-20T05:38:12.456 INFO:tasks.cephadm:Removing cephadm ... 2024-08-20T05:38:12.457 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-20T05:38:12.497 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-20T05:38:12.516 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-20T05:38:12.533 INFO:tasks.cephadm:Teardown complete 2024-08-20T05:38:12.533 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-20T05:38:12.544 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-20T05:38:12.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-20T05:38:12.550 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-20T05:38:12.560 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-20T05:38:12.686 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-20T05:38:12.696 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-20T05:38:12.696 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T05:38:12.701 DEBUG:teuthology.orchestra.run.smithi130:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T05:38:12.703 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-20T05:38:12.717 INFO:teuthology.orchestra.run.smithi130.stderr:bash: line 1: ntpq: command not found 2024-08-20T05:38:12.717 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-08-20T05:38:12.732 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-08-20T05:38:12.738 INFO:teuthology.orchestra.run.smithi130.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T05:38:12.738 INFO:teuthology.orchestra.run.smithi130.stdout:=============================================================================== 2024-08-20T05:38:12.739 INFO:teuthology.orchestra.run.smithi130.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 +127us[ +139us] +/- 45ms 2024-08-20T05:38:12.739 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 1 -541us[ -541us] +/- 66ms 2024-08-20T05:38:12.739 INFO:teuthology.orchestra.run.smithi130.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +441us[ +452us] +/- 80ms 2024-08-20T05:38:12.739 INFO:teuthology.orchestra.run.smithi130.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T05:38:12.756 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T05:38:12.756 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-08-20T05:38:12.756 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv01.front.sepia.ceph.com 3 6 377 5 +115us[ +116us] +/- 45ms 2024-08-20T05:38:12.756 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -547us[ -546us] +/- 66ms 2024-08-20T05:38:12.756 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 +425us[ +425us] +/- 80ms 2024-08-20T05:38:12.756 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T05:38:12.827 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-20T05:38:12.827 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-08-20T05:38:12.827 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 +144us[ +167us] +/- 45ms 2024-08-20T05:38:12.827 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 63 -527us[ -512us] +/- 65ms 2024-08-20T05:38:12.827 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 +443us[ +465us] +/- 80ms 2024-08-20T05:38:12.827 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-20T05:38:12.829 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-20T05:38:12.839 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-20T05:38:12.840 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-20T05:38:12.868 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-20T05:38:13.031 DEBUG:teuthology.orchestra.run.smithi130:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-20T05:38:13.106 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-20T05:38:13.169 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T05:38:13.230 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T05:38:13.230 DEBUG:teuthology.orchestra.run.smithi130:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T05:38:13.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T05:38:13.261 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-08-20T05:38:13.287 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T05:38:13.288 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-20T05:38:13.298 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-20T05:38:13.404 INFO:teuthology.task.internal:Duration was 3182.865780 seconds 2024-08-20T05:38:13.404 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-20T05:38:13.415 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-20T05:38:13.415 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-20T05:38:13.420 DEBUG:teuthology.orchestra.run.smithi130:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-20T05:38:13.422 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-20T05:38:13.496 INFO:teuthology.orchestra.run.smithi130.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T05:38:13.497 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T05:38:13.527 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-20T05:38:13.916 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-20T05:38:13.916 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2024-08-20T05:38:13.916 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-20T05:38:13.978 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi130.front.sepia.ceph.com 2024-08-20T05:38:13.981 DEBUG:teuthology.orchestra.run.smithi130:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-20T05:38:14.014 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-08-20T05:38:14.014 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-20T05:38:14.047 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-20T05:38:14.047 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-20T05:38:14.051 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-20T05:38:14.056 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-20T05:38:14.116 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-20T05:38:14.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-20T05:38:14.120 DEBUG:teuthology.orchestra.run.smithi130:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-20T05:38:14.126 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-20T05:38:15.659 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-20T05:38:15.671 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-20T05:38:15.671 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-20T05:38:15.740 DEBUG:teuthology.orchestra.run.smithi130:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-20T05:38:15.772 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-20T05:38:15.979 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-20T05:38:15.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-20T05:38:15.995 DEBUG:teuthology.orchestra.run.smithi130:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-20T05:38:15.997 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-20T05:38:16.023 INFO:teuthology.orchestra.run.smithi130.stdout:kernel.core_pattern = core 2024-08-20T05:38:16.042 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-08-20T05:38:16.066 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2024-08-20T05:38:16.104 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-20T05:38:16.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T05:38:16.137 DEBUG:teuthology.orchestra.run.smithi130:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-20T05:38:16.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T05:38:16.154 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-20T05:38:16.171 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-20T05:38:16.172 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-20T05:38:16.184 INFO:teuthology.task.internal:Transferring archived files... 2024-08-20T05:38:16.185 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861482/remote/smithi037 2024-08-20T05:38:16.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-20T05:38:16.283 DEBUG:teuthology.misc:Transferring archived files from smithi130:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861482/remote/smithi130 2024-08-20T05:38:16.284 DEBUG:teuthology.orchestra.run.smithi130:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-20T05:38:16.321 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-08-19_19:57:23-fs-wip-hemanth-testing-2024-08-19-1357-distro-default-smithi/7861482/remote/smithi135 2024-08-20T05:38:16.322 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-20T05:38:16.360 INFO:teuthology.task.internal:Removing archive directory... 2024-08-20T05:38:16.360 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-20T05:38:16.364 DEBUG:teuthology.orchestra.run.smithi130:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-20T05:38:16.366 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-20T05:38:16.413 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-20T05:38:16.426 INFO:teuthology.task.internal:Not uploading archives. 2024-08-20T05:38:16.426 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-20T05:38:16.490 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-20T05:38:16.491 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-20T05:38:16.495 DEBUG:teuthology.orchestra.run.smithi130:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-20T05:38:16.498 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-20T05:38:16.513 INFO:teuthology.orchestra.run.smithi130.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 20 05:38 /home/ubuntu/cephtest 2024-08-20T05:38:16.515 INFO:teuthology.orchestra.run.smithi135.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 20 05:38 /home/ubuntu/cephtest 2024-08-20T05:38:16.526 INFO:teuthology.orchestra.run.smithi037.stdout: 393255 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 20 05:38 /home/ubuntu/cephtest 2024-08-20T05:38:16.528 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-20T05:38:16.540 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-20T05:38:16.650 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7e35574567e19d2ca345caad671b98560d512bea description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/postgres}} duration: 3182.865779876709 failure_reason: '"2024-08-20T05:05:26.853057+0000 mds.b (mds.0) 19 : cluster [WRN] Scrub error on inode 0x10000000007 (/volumes/qa/sv_1/091b5016-889b-437d-8bd4-e6363dc551f0/postgres/data/pg_wal) see mds.b log and `damage ls` output for details" in cluster log' flavor: default owner: scheduled_hyelloji@teuthology success: false 2024-08-20T05:38:16.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-20T05:38:16.735 INFO:teuthology.run:FAIL